2025-03-14T05:33:55.8352964Z Current runner version: '2.322.0' 2025-03-14T05:33:55.8359618Z Runner name: 'i-011f73f0c8d1623b6' 2025-03-14T05:33:55.8360565Z Runner group name: 'Default' 2025-03-14T05:33:55.8361471Z Machine name: 'ip-10-1-69-91' 2025-03-14T05:33:55.8366294Z ##[group]GITHUB_TOKEN Permissions 2025-03-14T05:33:55.8369146Z Actions: read 2025-03-14T05:33:55.8369836Z Attestations: read 2025-03-14T05:33:55.8370543Z Checks: read 2025-03-14T05:33:55.8371199Z Contents: read 2025-03-14T05:33:55.8371835Z Deployments: read 2025-03-14T05:33:55.8372587Z Discussions: read 2025-03-14T05:33:55.8373226Z Issues: read 2025-03-14T05:33:55.8373833Z Metadata: read 2025-03-14T05:33:55.8374513Z Packages: read 2025-03-14T05:33:55.8375144Z Pages: read 2025-03-14T05:33:55.8375793Z PullRequests: read 2025-03-14T05:33:55.8376439Z RepositoryProjects: read 2025-03-14T05:33:55.8377278Z SecurityEvents: read 2025-03-14T05:33:55.8377907Z Statuses: read 2025-03-14T05:33:55.8378506Z ##[endgroup] 2025-03-14T05:33:55.8381954Z Secret source: Actions 2025-03-14T05:33:55.8382921Z Prepare workflow directory 2025-03-14T05:33:56.1364668Z Prepare all required actions 2025-03-14T05:33:56.1407527Z Getting action download info 2025-03-14T05:33:56.3133131Z Download action repository 'pytorch/test-infra@main' (SHA:de00dac6adc071cb2f9861380a0ed3947b93e5cc) 2025-03-14T05:33:57.8495946Z Download action repository 'pytorch/pytorch@main' (SHA:d4496346b901e9a4c3993bf6b2054014c7c0b731) 2025-03-14T05:34:12.0510165Z Download action repository 'aws-actions/configure-aws-credentials@v3' (SHA:50ac8dd1e1b10d09dac7b8727528b91bed831ac0) 2025-03-14T05:34:12.2441902Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2025-03-14T05:34:12.5309566Z Getting action download info 2025-03-14T05:34:12.6254621Z Download action repository 'actions/checkout@v4' (SHA:11bd71901bbe5b1630ceea73d27597364c9af683) 2025-03-14T05:34:12.8280099Z Getting action download info 2025-03-14T05:34:12.9206383Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2025-03-14T05:34:13.1131914Z Getting action download info 2025-03-14T05:34:13.2052814Z Download action repository 'nick-fields/retry@3e91a01664abd3c5cd539100d10d33b9c5b68482' (SHA:3e91a01664abd3c5cd539100d10d33b9c5b68482) 2025-03-14T05:34:13.3530681Z Getting action download info 2025-03-14T05:34:13.4992931Z Uses: pytorch/pytorch/.github/workflows/_linux-test.yml@refs/heads/main (aed0b7a742a2d7b7901790622829cbd2135049a4) 2025-03-14T05:34:13.4995121Z ##[group] Inputs 2025-03-14T05:34:13.4995492Z build-environment: linux-focal-py3.9-clang9-xla 2025-03-14T05:34:13.4996067Z test-matrix: {"include": [{"config": "xla", "shard": 1, "num_shards": 1, "runner": "lf.linux.12xlarge"}]} 2025-03-14T05:34:13.4996745Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:13.4997249Z sync-tag: 2025-03-14T05:34:13.4998029Z timeout-minutes: 240 2025-03-14T05:34:13.4998312Z use-gha: 2025-03-14T05:34:13.4998570Z dashboard-tag: 2025-03-14T05:34:13.4998838Z s3-bucket: gha-artifacts 2025-03-14T05:34:13.4999115Z aws-role-to-assume: 2025-03-14T05:34:13.4999875Z disable-monitor: false 2025-03-14T05:34:13.5000185Z ##[endgroup] 2025-03-14T05:34:13.5000607Z Complete job name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:34:13.5643930Z A job started hook has been configured by the self-hosted runner administrator 2025-03-14T05:34:13.5741914Z ##[group]Run '/home/ec2-user/runner-scripts/before_job.sh' 2025-03-14T05:34:13.5750206Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:13.5750841Z ##[endgroup] 2025-03-14T05:34:15.2302636Z Runner Type: lf.linux.12xlarge 2025-03-14T05:34:15.2303096Z Instance Type: c5.12xlarge 2025-03-14T05:34:15.2303480Z AMI Name: unknown 2025-03-14T05:34:15.2330559Z AMI ID: ami-05b10e08d247fb927 2025-03-14T05:34:20.2417711Z ##[group]Run pytorch/test-infra/.github/actions/setup-ssh@main 2025-03-14T05:34:20.2418317Z with: 2025-03-14T05:34:20.2419305Z github-secret: *** 2025-03-14T05:34:20.2420077Z instructions: All testing is done inside the container, to start an interactive session run: docker exec -it $(docker container ps --format '{{.ID}}') bash 2025-03-14T05:34:20.2420991Z activate-with-label: false 2025-03-14T05:34:20.2421372Z label: with-ssh 2025-03-14T05:34:20.2421726Z remove-existing-keys: true 2025-03-14T05:34:20.2422114Z fail-silently: true 2025-03-14T05:34:20.2422445Z env: 2025-03-14T05:34:20.2422785Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:20.2423144Z ##[endgroup] 2025-03-14T05:34:20.3536176Z Please see https://github.com/pytorch/pytorch/wiki/Debugging-using-with-ssh-for-Github-Actions for more info. 2025-03-14T05:34:20.3538014Z Not on pull request and ciflow reference could not be extracted, skipping adding ssh keys 2025-03-14T05:34:20.3683588Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2025-03-14T05:34:20.3684016Z with: 2025-03-14T05:34:20.3684239Z no-sudo: true 2025-03-14T05:34:20.3684483Z submodules: recursive 2025-03-14T05:34:20.3684875Z fetch-depth: 0 2025-03-14T05:34:20.3685269Z env: 2025-03-14T05:34:20.3685505Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:20.3685792Z ##[endgroup] 2025-03-14T05:34:20.3769647Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T05:34:20.3770647Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T05:34:20.3779797Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:20.3780191Z env: 2025-03-14T05:34:20.3780415Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:20.3780682Z ##[endgroup] 2025-03-14T05:34:20.3868956Z ##[group]Run # Use all available CPUs for fetching 2025-03-14T05:34:20.3869419Z # Use all available CPUs for fetching 2025-03-14T05:34:20.3869822Z cd "${GITHUB_WORKSPACE}" 2025-03-14T05:34:20.3870243Z git config --global fetch.parallel 0 2025-03-14T05:34:20.3870683Z git config --global submodule.fetchJobs 0 2025-03-14T05:34:20.3871055Z  2025-03-14T05:34:20.3871556Z # Clean workspace. The default checkout action should also do this, but 2025-03-14T05:34:20.3872055Z # do it here as well just in case 2025-03-14T05:34:20.3872381Z if [[ -d .git ]]; then 2025-03-14T05:34:20.3872693Z  if [ -z "${NO_SUDO}" ]; then 2025-03-14T05:34:20.3873023Z  sudo git clean -ffdx 2025-03-14T05:34:20.3873324Z  else 2025-03-14T05:34:20.3873578Z  git clean -ffdx 2025-03-14T05:34:20.3873860Z  fi 2025-03-14T05:34:20.3874094Z fi 2025-03-14T05:34:20.3879349Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:20.3879733Z env: 2025-03-14T05:34:20.3880034Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:20.3880327Z NO_SUDO: true 2025-03-14T05:34:20.3880566Z ##[endgroup] 2025-03-14T05:34:20.7291627Z Removing .additional_ci_files/ 2025-03-14T05:34:20.7292079Z Removing build/ 2025-03-14T05:34:20.7292365Z Removing dist/ 2025-03-14T05:34:20.7292746Z Removing logs-test-xla-1-1-lf.linux.12xlarge_38754363397.zip 2025-03-14T05:34:20.7293325Z Removing test-jsons-test-xla-1-1-lf.linux.12xlarge_38754363397.zip 2025-03-14T05:34:20.7293919Z Removing test-reports-test-xla-1-1-lf.linux.12xlarge_38754363397.zip 2025-03-14T05:34:20.7294398Z Removing tools/__pycache__/ 2025-03-14T05:34:20.7294714Z Removing tools/stats/__pycache__/ 2025-03-14T05:34:20.7295124Z Removing tools/stats/upload_utilization_stats/__pycache__/ 2025-03-14T05:34:20.7295545Z Removing torch/__pycache__/ 2025-03-14T05:34:20.7295870Z Removing torch/_strobelight/__pycache__/ 2025-03-14T05:34:20.7296230Z Removing torch/_vendor/__pycache__/ 2025-03-14T05:34:20.7296627Z Removing torch/_vendor/packaging/__pycache__/ 2025-03-14T05:34:20.7296994Z Removing torch/include/ 2025-03-14T05:34:20.7297278Z Removing usage_log.txt 2025-03-14T05:34:20.7297850Z Removing xla/ 2025-03-14T05:34:20.7378538Z ##[group]Run actions/checkout@v4 2025-03-14T05:34:20.7378831Z with: 2025-03-14T05:34:20.7379084Z ref: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:34:20.7379420Z fetch-depth: 0 2025-03-14T05:34:20.7379670Z submodules: recursive 2025-03-14T05:34:20.7379939Z show-progress: false 2025-03-14T05:34:20.7380210Z repository: pytorch/pytorch 2025-03-14T05:34:20.7380605Z token: *** 2025-03-14T05:34:20.7380830Z ssh-strict: true 2025-03-14T05:34:20.7381071Z ssh-user: git 2025-03-14T05:34:20.7381315Z persist-credentials: true 2025-03-14T05:34:20.7381588Z clean: true 2025-03-14T05:34:20.7381838Z sparse-checkout-cone-mode: true 2025-03-14T05:34:20.7382125Z fetch-tags: false 2025-03-14T05:34:20.7382361Z lfs: false 2025-03-14T05:34:20.7382786Z set-safe-directory: true 2025-03-14T05:34:20.7383059Z env: 2025-03-14T05:34:20.7383282Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:20.7383550Z ##[endgroup] 2025-03-14T05:34:20.8441346Z Syncing repository: pytorch/pytorch 2025-03-14T05:34:20.8442714Z ##[group]Getting Git version info 2025-03-14T05:34:20.8443231Z Working directory is '/home/ec2-user/actions-runner/_work/pytorch/pytorch' 2025-03-14T05:34:20.8443935Z [command]/usr/bin/git version 2025-03-14T05:34:20.8444248Z git version 2.47.1 2025-03-14T05:34:20.8455995Z ##[endgroup] 2025-03-14T05:34:20.8465733Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/8f8211f9-2be4-4384-8207-10e393ac4039/.gitconfig' 2025-03-14T05:34:20.8488038Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/8f8211f9-2be4-4384-8207-10e393ac4039' before making global git config changes 2025-03-14T05:34:20.8491027Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T05:34:20.8494726Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-03-14T05:34:20.8542508Z [command]/usr/bin/git config --local --get remote.origin.url 2025-03-14T05:34:20.8562698Z https://github.com/pytorch/pytorch 2025-03-14T05:34:20.8574906Z ##[group]Removing previously created refs, to avoid conflicts 2025-03-14T05:34:20.8577731Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD 2025-03-14T05:34:20.8597009Z HEAD 2025-03-14T05:34:20.8630065Z ##[endgroup] 2025-03-14T05:34:20.8630785Z [command]/usr/bin/git submodule status 2025-03-14T05:34:20.8954829Z 7e1e1fe3858c63c251c637ae41a20de425dde96f android/libs/fbjni (v0.1.0-12-g7e1e1fe) 2025-03-14T05:34:20.9026907Z 4dfe081cf6bcd15db339cf2680b9281b8451eeb3 third_party/FP16 (4dfe081) 2025-03-14T05:34:20.9096760Z b408327ac2a15ec3e43352421954f5b1967701d1 third_party/FXdiv (b408327) 2025-03-14T05:34:20.9192488Z c07e3a0400713d546e0dea2d5466dd22ea389c73 third_party/NNPACK (c07e3a0) 2025-03-14T05:34:20.9213160Z e170594ac7cf1dac584da473d4ca9301087090c1 third_party/NVTX (v3.1.0) 2025-03-14T05:34:20.9318896Z a6bfc237255a6bac1513f7c1ebde6d8aed6b5191 third_party/VulkanMemoryAllocator (v2.1.0-705-ga6bfc23) 2025-03-14T05:34:20.9857021Z 51a0103656eff6fc9bfd39a4597923c4b542c883 third_party/XNNPACK (remotes/origin/ds/ndk-1243-g51a010365) 2025-03-14T05:34:20.9882605Z 0d98dba29d66e93259db7daa53a9327df767a415 third_party/benchmark (v1.6.1) 2025-03-14T05:34:20.9910153Z 8086bbe3a78d931eb96fe12fdc014082e18d18d3 third_party/composable_kernel (mock-tag-test-6-g8086bbe3a) 2025-03-14T05:34:21.0036654Z 3b6597bba913d51161383657829b7e644e59c006 third_party/cpp-httplib (v0.15.3-20-g3b6597b) 2025-03-14T05:34:21.0154699Z 1e83a2fdd3102f65c6f1fb602c1b320486218a99 third_party/cpuinfo (1e83a2f) 2025-03-14T05:34:21.0188100Z 91b7532f3386768bba4f444ee7672b497f34da8a third_party/cudnn_frontend (v0.5-44-g91b7532) 2025-03-14T05:34:21.0272155Z afa1772203677c5118fcd82537a9c8fefbcc7008 third_party/cutlass (v3.8.0) 2025-03-14T05:34:21.0995374Z 3147391d946bb4b6c68edd901f2add6ac1f31f8c third_party/eigen (3.4.0) 2025-03-14T05:34:21.1326921Z dbc3157bf256f1339b3fa1fef2be89ac4078be0e third_party/fbgemm (v0.4.1-446-gdbc3157b) 2025-03-14T05:34:21.1406995Z 979702c87a8713a8e0a5e9fee122b90d2ef13be5 third_party/flash-attention (v2.7.4) 2025-03-14T05:34:21.1430759Z 01834de25e4bf3975a9a00e816292b1ad0fe184b third_party/flatbuffers (v23.3.3) 2025-03-14T05:34:21.1846708Z 123913715afeb8a437e6388b4473fcc4753e1c9a third_party/fmt (11.1.4) 2025-03-14T05:34:21.1958404Z 3fb5c176c17c765a3492cd2f0321b0dab712f350 third_party/gemmlowp/gemmlowp (remotes/origin/revert-87-master-135-g3fb5c17) 2025-03-14T05:34:21.2071469Z 5354032ea08eadd7fc4456477f7f7c6308818509 third_party/gloo (5354032) 2025-03-14T05:34:21.2344946Z b514bdc898e2951020cbdca1304b75f5950d1f59 third_party/googletest (release-1.8.0-3484-gb514bdc8) 2025-03-14T05:34:21.2428574Z 719d8e6cd7f7a0e01b155657526d693acf97c2b3 third_party/ideep (pytorch-rls-v3.7.1) 2025-03-14T05:34:21.2486907Z 5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42 third_party/ittapi (v3.23.0-14-g5b8a7d7) 2025-03-14T05:34:21.2724120Z 2859721fd9e73d3ca1c56f827dbc64e6d68f78a2 third_party/kineto (remotes/origin/sraikund/test-53-g2859721) 2025-03-14T05:34:21.2748241Z ef685a13cfbe8d418aa2ed34350e21e4938358b6 third_party/kleidiai (v1.3.0) 2025-03-14T05:34:21.2774156Z b66e3214d8a104669c2ec05ae91ebc26a8f5ab78 third_party/mimalloc (v1.8.2) 2025-03-14T05:34:21.3252982Z 87cda1d6646592ac5866dc703c8e1839046a6806 third_party/nlohmann (v3.10.1-113-g87cda1d6) 2025-03-14T05:34:21.3573918Z b8baa8446686496da4cc8fda09f2b6fe65c2a02c third_party/onnx (v1.17.0) 2025-03-14T05:34:21.3596749Z a799f4aed9c94b765dcdaabaeab7d5e7e2310878 third_party/opentelemetry-cpp (v1.14.2) 2025-03-14T05:34:21.3621094Z 9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe third_party/pocketfft (release_for_eigen-11-g9d3ab05) 2025-03-14T05:34:21.4006932Z d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a third_party/protobuf (v3.7.0-rc.2-1279-gd1eca4e4b) 2025-03-14T05:34:21.4075553Z 072586a71b55b7f8c584153d223e95687148a900 third_party/psimd (heads/master) 2025-03-14T05:34:21.4128575Z 4fe0e1e183925bf8cfa6aae24237e724a96479b8 third_party/pthreadpool (0.1-144-g4fe0e1e) 2025-03-14T05:34:21.4176746Z a2e59f0e7065404b44dfe92a28aca47ba1378dc4 third_party/pybind11 (v2.11.0-182-ga2e59f0e) 2025-03-14T05:34:21.4246976Z f45429b087dd7d5bc78bb40dc7cf06425c252d67 third_party/python-peachpy (remotes/origin/pre-generated) 2025-03-14T05:34:21.4354710Z 56e1f79cb140fb9326d612d0be06b5250565cade third_party/sleef (3.7-33-g56e1f79) 2025-03-14T05:34:21.4419659Z 52791a2fd214b2a9dc5759d36725909c1daa7f2e third_party/tensorpipe (remotes/origin/master) 2025-03-14T05:34:21.4429521Z ##[group]Cleaning the repository 2025-03-14T05:34:21.4434023Z [command]/usr/bin/git clean -ffdx 2025-03-14T05:34:21.4618884Z [command]/usr/bin/git reset --hard HEAD 2025-03-14T05:34:22.5046909Z Updating files: 76% (12697/16541) 2025-03-14T05:34:22.5261822Z Updating files: 77% (12737/16541) 2025-03-14T05:34:22.5500500Z Updating files: 78% (12902/16541) 2025-03-14T05:34:22.5691756Z Updating files: 79% (13068/16541) 2025-03-14T05:34:22.5914228Z Updating files: 80% (13233/16541) 2025-03-14T05:34:22.6029421Z Updating files: 81% (13399/16541) 2025-03-14T05:34:22.6157686Z Updating files: 82% (13564/16541) 2025-03-14T05:34:22.6310999Z Updating files: 83% (13730/16541) 2025-03-14T05:34:22.6433604Z Updating files: 84% (13895/16541) 2025-03-14T05:34:22.6525490Z Updating files: 85% (14060/16541) 2025-03-14T05:34:22.6674510Z Updating files: 86% (14226/16541) 2025-03-14T05:34:22.6784532Z Updating files: 87% (14391/16541) 2025-03-14T05:34:22.6930806Z Updating files: 88% (14557/16541) 2025-03-14T05:34:22.7129510Z Updating files: 89% (14722/16541) 2025-03-14T05:34:22.7231815Z Updating files: 90% (14887/16541) 2025-03-14T05:34:22.7352434Z Updating files: 91% (15053/16541) 2025-03-14T05:34:22.7510966Z Updating files: 92% (15218/16541) 2025-03-14T05:34:22.7674185Z Updating files: 93% (15384/16541) 2025-03-14T05:34:22.7845913Z Updating files: 94% (15549/16541) 2025-03-14T05:34:22.7986279Z Updating files: 95% (15714/16541) 2025-03-14T05:34:22.8127660Z Updating files: 96% (15880/16541) 2025-03-14T05:34:22.8406427Z Updating files: 97% (16045/16541) 2025-03-14T05:34:22.8545291Z Updating files: 98% (16211/16541) 2025-03-14T05:34:22.8690868Z Updating files: 99% (16376/16541) 2025-03-14T05:34:22.8691319Z Updating files: 100% (16541/16541) 2025-03-14T05:34:22.8691668Z Updating files: 100% (16541/16541), done. 2025-03-14T05:34:22.8856326Z HEAD is now at bd72c961cb2 Remove temp changes 2025-03-14T05:34:22.8927846Z ##[endgroup] 2025-03-14T05:34:22.8929011Z ##[group]Disabling automatic garbage collection 2025-03-14T05:34:22.8934257Z [command]/usr/bin/git config --local gc.auto 0 2025-03-14T05:34:22.8963998Z ##[endgroup] 2025-03-14T05:34:22.8964455Z ##[group]Setting up auth 2025-03-14T05:34:22.8968772Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T05:34:22.8995404Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T05:34:22.9282059Z Entering 'android/libs/fbjni' 2025-03-14T05:34:22.9333701Z Entering 'third_party/FP16' 2025-03-14T05:34:22.9385039Z Entering 'third_party/FXdiv' 2025-03-14T05:34:22.9435961Z Entering 'third_party/NNPACK' 2025-03-14T05:34:22.9486222Z Entering 'third_party/NVTX' 2025-03-14T05:34:22.9536599Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T05:34:22.9589818Z Entering 'third_party/XNNPACK' 2025-03-14T05:34:22.9656057Z Entering 'third_party/benchmark' 2025-03-14T05:34:22.9706718Z Entering 'third_party/composable_kernel' 2025-03-14T05:34:22.9765611Z Entering 'third_party/cpp-httplib' 2025-03-14T05:34:22.9820783Z Entering 'third_party/cpuinfo' 2025-03-14T05:34:22.9870605Z Entering 'third_party/cudnn_frontend' 2025-03-14T05:34:22.9922753Z Entering 'third_party/cutlass' 2025-03-14T05:34:22.9983236Z Entering 'third_party/eigen' 2025-03-14T05:34:23.0034933Z Entering 'third_party/fbgemm' 2025-03-14T05:34:23.0086821Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T05:34:23.0135648Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T05:34:23.0186695Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T05:34:23.0243193Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T05:34:23.0299566Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T05:34:23.0350629Z Entering 'third_party/flash-attention' 2025-03-14T05:34:23.0403737Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T05:34:23.0462597Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T05:34:23.0522920Z Entering 'third_party/flatbuffers' 2025-03-14T05:34:23.0580867Z Entering 'third_party/fmt' 2025-03-14T05:34:23.0630834Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T05:34:23.0682421Z Entering 'third_party/gloo' 2025-03-14T05:34:23.0730652Z Entering 'third_party/googletest' 2025-03-14T05:34:23.0782616Z Entering 'third_party/ideep' 2025-03-14T05:34:23.0835962Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T05:34:23.0890590Z Entering 'third_party/ittapi' 2025-03-14T05:34:23.0941021Z Entering 'third_party/kineto' 2025-03-14T05:34:23.0992598Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T05:34:23.1044443Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T05:34:23.1094134Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T05:34:23.1145443Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T05:34:23.1196569Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T05:34:23.1246612Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T05:34:23.1300778Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T05:34:23.1349335Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T05:34:23.1404218Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T05:34:23.1452926Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T05:34:23.1506059Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T05:34:23.1559105Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T05:34:23.1610329Z Entering 'third_party/kleidiai' 2025-03-14T05:34:23.1662917Z Entering 'third_party/mimalloc' 2025-03-14T05:34:23.1713429Z Entering 'third_party/nlohmann' 2025-03-14T05:34:23.1765728Z Entering 'third_party/onnx' 2025-03-14T05:34:23.1832830Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T05:34:23.1885440Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T05:34:23.1936817Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T05:34:23.1987529Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T05:34:23.2038171Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T05:34:23.2093182Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T05:34:23.2144610Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T05:34:23.2195873Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T05:34:23.2253998Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T05:34:23.2303772Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T05:34:23.2355726Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T05:34:23.2406847Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T05:34:23.2474751Z Entering 'third_party/pocketfft' 2025-03-14T05:34:23.2526357Z Entering 'third_party/protobuf' 2025-03-14T05:34:23.2581325Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T05:34:23.2630097Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T05:34:23.2682669Z Entering 'third_party/psimd' 2025-03-14T05:34:23.2730675Z Entering 'third_party/pthreadpool' 2025-03-14T05:34:23.2782238Z Entering 'third_party/pybind11' 2025-03-14T05:34:23.2831766Z Entering 'third_party/python-peachpy' 2025-03-14T05:34:23.2922456Z Entering 'third_party/sleef' 2025-03-14T05:34:23.2938094Z Entering 'third_party/tensorpipe' 2025-03-14T05:34:23.2988968Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T05:34:23.3042978Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T05:34:23.3092865Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T05:34:23.3146254Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T05:34:23.3204899Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T05:34:23.3271805Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T05:34:23.3302707Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T05:34:23.3583591Z Entering 'android/libs/fbjni' 2025-03-14T05:34:23.3634885Z Entering 'third_party/FP16' 2025-03-14T05:34:23.3685475Z Entering 'third_party/FXdiv' 2025-03-14T05:34:23.3733672Z Entering 'third_party/NNPACK' 2025-03-14T05:34:23.3785486Z Entering 'third_party/NVTX' 2025-03-14T05:34:23.3836411Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T05:34:23.3886694Z Entering 'third_party/XNNPACK' 2025-03-14T05:34:23.3954459Z Entering 'third_party/benchmark' 2025-03-14T05:34:23.4006158Z Entering 'third_party/composable_kernel' 2025-03-14T05:34:23.4063369Z Entering 'third_party/cpp-httplib' 2025-03-14T05:34:23.4117936Z Entering 'third_party/cpuinfo' 2025-03-14T05:34:23.4169099Z Entering 'third_party/cudnn_frontend' 2025-03-14T05:34:23.4221383Z Entering 'third_party/cutlass' 2025-03-14T05:34:23.4286000Z Entering 'third_party/eigen' 2025-03-14T05:34:23.4341521Z Entering 'third_party/fbgemm' 2025-03-14T05:34:23.4397518Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T05:34:23.4447752Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T05:34:23.4500141Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T05:34:23.4560835Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T05:34:23.4609493Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T05:34:23.4660456Z Entering 'third_party/flash-attention' 2025-03-14T05:34:23.4711615Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T05:34:23.4766783Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T05:34:23.4829789Z Entering 'third_party/flatbuffers' 2025-03-14T05:34:23.4886485Z Entering 'third_party/fmt' 2025-03-14T05:34:23.4941224Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T05:34:23.4992359Z Entering 'third_party/gloo' 2025-03-14T05:34:23.5046167Z Entering 'third_party/googletest' 2025-03-14T05:34:23.5096224Z Entering 'third_party/ideep' 2025-03-14T05:34:23.5146371Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T05:34:23.5204090Z Entering 'third_party/ittapi' 2025-03-14T05:34:23.5253139Z Entering 'third_party/kineto' 2025-03-14T05:34:23.5304432Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T05:34:23.5355022Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T05:34:23.5406685Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T05:34:23.5467721Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T05:34:23.5522165Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T05:34:23.5569237Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T05:34:23.5628674Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T05:34:23.5677385Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T05:34:23.5727565Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T05:34:23.5786740Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T05:34:23.5838500Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T05:34:23.5886890Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T05:34:23.5935773Z Entering 'third_party/kleidiai' 2025-03-14T05:34:23.5988297Z Entering 'third_party/mimalloc' 2025-03-14T05:34:23.6042457Z Entering 'third_party/nlohmann' 2025-03-14T05:34:23.6099162Z Entering 'third_party/onnx' 2025-03-14T05:34:23.6169152Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T05:34:23.6225893Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T05:34:23.6278703Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T05:34:23.6326686Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T05:34:23.6376207Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T05:34:23.6425988Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T05:34:23.6475101Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T05:34:23.6524808Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T05:34:23.6576575Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T05:34:23.6626391Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T05:34:23.6686915Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T05:34:23.6747764Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T05:34:23.6819150Z Entering 'third_party/pocketfft' 2025-03-14T05:34:23.6878865Z Entering 'third_party/protobuf' 2025-03-14T05:34:23.6939312Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T05:34:23.6989538Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T05:34:23.7041010Z Entering 'third_party/psimd' 2025-03-14T05:34:23.7094890Z Entering 'third_party/pthreadpool' 2025-03-14T05:34:23.7145927Z Entering 'third_party/pybind11' 2025-03-14T05:34:23.7195485Z Entering 'third_party/python-peachpy' 2025-03-14T05:34:23.7246289Z Entering 'third_party/sleef' 2025-03-14T05:34:23.7296776Z Entering 'third_party/tensorpipe' 2025-03-14T05:34:23.7348486Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T05:34:23.7406392Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T05:34:23.7452986Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T05:34:23.7503595Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T05:34:23.7550647Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T05:34:23.7621985Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T05:34:23.7667926Z ##[endgroup] 2025-03-14T05:34:23.7668430Z ##[group]Fetching the repository 2025-03-14T05:34:23.7674400Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2025-03-14T05:34:24.0162210Z From https://github.com/pytorch/pytorch 2025-03-14T05:34:24.0162854Z - [deleted] (none) -> ciflow/inductor/147552 2025-03-14T05:34:24.0544064Z - [deleted] (none) -> ciflow/inductor/149162 2025-03-14T05:34:24.0544689Z - [deleted] (none) -> ciflow/inductor/149167 2025-03-14T05:34:24.0545177Z - [deleted] (none) -> ciflow/mps/149123 2025-03-14T05:34:24.0545762Z - [deleted] (none) -> ciflow/trunk/147552 2025-03-14T05:34:24.0546547Z - [deleted] (none) -> ciflow/trunk/149171 2025-03-14T05:34:25.4250250Z 708a6d24ef4..a7fd123a105 gh/XuehaiPan/105/base -> origin/gh/XuehaiPan/105/base 2025-03-14T05:34:25.4255284Z cd35157939a..400fb6b954b gh/XuehaiPan/105/head -> origin/gh/XuehaiPan/105/head 2025-03-14T05:34:25.4261337Z + 8ff954ec831...dd091eb179e gh/XuehaiPan/105/orig -> origin/gh/XuehaiPan/105/orig (forced update) 2025-03-14T05:34:25.4267399Z c249567a846..ee65b27eaf4 gh/XuehaiPan/13/base -> origin/gh/XuehaiPan/13/base 2025-03-14T05:34:25.4274472Z e4931479838..43fb2e297e0 gh/XuehaiPan/13/head -> origin/gh/XuehaiPan/13/head 2025-03-14T05:34:25.4280664Z + 983bfc24d05...9b2bca889cb gh/XuehaiPan/13/orig -> origin/gh/XuehaiPan/13/orig (forced update) 2025-03-14T05:34:25.4286445Z 826899b19ca..eb39f4a7f8f gh/XuehaiPan/14/base -> origin/gh/XuehaiPan/14/base 2025-03-14T05:34:25.4292491Z cd7154ec08c..acff96a79ad gh/XuehaiPan/14/head -> origin/gh/XuehaiPan/14/head 2025-03-14T05:34:25.4298588Z + 97f66624f40...8fb2f7a06c2 gh/XuehaiPan/14/orig -> origin/gh/XuehaiPan/14/orig (forced update) 2025-03-14T05:34:25.4304819Z dec95a75ada..df9eb561f4f gh/XuehaiPan/179/base -> origin/gh/XuehaiPan/179/base 2025-03-14T05:34:25.4310553Z b797ea9517f..dae2fd762ed gh/XuehaiPan/179/head -> origin/gh/XuehaiPan/179/head 2025-03-14T05:34:25.4316965Z + a60f6c704be...a765a088f1a gh/XuehaiPan/179/orig -> origin/gh/XuehaiPan/179/orig (forced update) 2025-03-14T05:34:25.4323321Z 52e13e69219..87fe33ef964 gh/XuehaiPan/189/base -> origin/gh/XuehaiPan/189/base 2025-03-14T05:34:25.4329806Z da7c40c9dec..a2a924adf1d gh/XuehaiPan/189/head -> origin/gh/XuehaiPan/189/head 2025-03-14T05:34:25.4335857Z + 354700762d5...6bd873b4da7 gh/XuehaiPan/189/orig -> origin/gh/XuehaiPan/189/orig (forced update) 2025-03-14T05:34:25.4344011Z a8fb34cae53..af5bc4e801a gh/XuehaiPan/249/base -> origin/gh/XuehaiPan/249/base 2025-03-14T05:34:25.4350442Z 108d7f193af..4037b4fc227 gh/XuehaiPan/249/head -> origin/gh/XuehaiPan/249/head 2025-03-14T05:34:25.4356385Z + 7699702f5fd...38e92854787 gh/XuehaiPan/249/orig -> origin/gh/XuehaiPan/249/orig (forced update) 2025-03-14T05:34:25.4362200Z b3bb23708f6..ac684fae383 gh/XuehaiPan/253/base -> origin/gh/XuehaiPan/253/base 2025-03-14T05:34:25.4368670Z 877a79e8a68..8e0f02a7be5 gh/XuehaiPan/253/head -> origin/gh/XuehaiPan/253/head 2025-03-14T05:34:25.4374481Z + 8df0e95bf74...2d95342bd35 gh/XuehaiPan/253/orig -> origin/gh/XuehaiPan/253/orig (forced update) 2025-03-14T05:34:25.4380688Z ff84ad727c1..b0aee1f20c1 gh/XuehaiPan/254/base -> origin/gh/XuehaiPan/254/base 2025-03-14T05:34:25.4386845Z 715ac1dfa51..15cf0019cbe gh/XuehaiPan/254/head -> origin/gh/XuehaiPan/254/head 2025-03-14T05:34:25.4392596Z + edeff7c0064...05116cf0919 gh/XuehaiPan/254/orig -> origin/gh/XuehaiPan/254/orig (forced update) 2025-03-14T05:34:25.4398337Z 062bbcd4b05..cce45b10618 gh/XuehaiPan/255/base -> origin/gh/XuehaiPan/255/base 2025-03-14T05:34:25.4405772Z c382241afdf..fd94b3884b0 gh/XuehaiPan/255/head -> origin/gh/XuehaiPan/255/head 2025-03-14T05:34:25.4411998Z + cf79c58d031...6039683d77d gh/XuehaiPan/255/orig -> origin/gh/XuehaiPan/255/orig (forced update) 2025-03-14T05:34:25.4418056Z af3ed87405e..3867b41eddc gh/XuehaiPan/257/base -> origin/gh/XuehaiPan/257/base 2025-03-14T05:34:25.4424395Z e308c157fe3..b831702ab54 gh/XuehaiPan/257/head -> origin/gh/XuehaiPan/257/head 2025-03-14T05:34:25.4430831Z + 87852423f75...ac5f48532c0 gh/XuehaiPan/257/orig -> origin/gh/XuehaiPan/257/orig (forced update) 2025-03-14T05:34:25.4437808Z ca147cffda7..21f53568c63 gh/XuehaiPan/72/base -> origin/gh/XuehaiPan/72/base 2025-03-14T05:34:25.4445694Z ae400005561..fbe409a11ef gh/XuehaiPan/72/head -> origin/gh/XuehaiPan/72/head 2025-03-14T05:34:25.4452275Z + fabe748e933...ba98b3e681e gh/XuehaiPan/72/orig -> origin/gh/XuehaiPan/72/orig (forced update) 2025-03-14T05:34:25.4462439Z afdde8178df..59096115f82 gh/XuehaiPan/97/base -> origin/gh/XuehaiPan/97/base 2025-03-14T05:34:25.4469242Z cb62513bade..0e5501ab3c8 gh/XuehaiPan/97/head -> origin/gh/XuehaiPan/97/head 2025-03-14T05:34:25.4475589Z + f7c34825abf...047714a3f6b gh/XuehaiPan/97/orig -> origin/gh/XuehaiPan/97/orig (forced update) 2025-03-14T05:34:25.4483025Z 5a43050ab9b..016d7beb544 gh/XuehaiPan/98/base -> origin/gh/XuehaiPan/98/base 2025-03-14T05:34:25.4489371Z 71e5dee8c99..f59a954ce40 gh/XuehaiPan/98/head -> origin/gh/XuehaiPan/98/head 2025-03-14T05:34:25.4495830Z + adb3fd6e0b1...c2504709c1d gh/XuehaiPan/98/orig -> origin/gh/XuehaiPan/98/orig (forced update) 2025-03-14T05:34:25.4544198Z 75c1feab54b..6c5546475f6 gh/xmfan/197/head -> origin/gh/xmfan/197/head 2025-03-14T05:34:25.4551157Z + d30cde840bf...be447b425d6 gh/xmfan/197/orig -> origin/gh/xmfan/197/orig (forced update) 2025-03-14T05:34:25.4557831Z + 44f565b7a1b...217eb23e4eb gh/xmfan/199/orig -> origin/gh/xmfan/199/orig (forced update) 2025-03-14T05:34:25.4570544Z aed0b7a742a..d4496346b90 main -> origin/main 2025-03-14T05:34:25.4585712Z 49570cb4024..15cd6921a56 viable/strict -> origin/viable/strict 2025-03-14T05:34:25.4586341Z t [tag update] ciflow/inductor/113257 -> ciflow/inductor/113257 2025-03-14T05:34:25.4586889Z t [tag update] ciflow/inductor/129420 -> ciflow/inductor/129420 2025-03-14T05:34:25.4587445Z t [tag update] ciflow/inductor/137400 -> ciflow/inductor/137400 2025-03-14T05:34:25.4588181Z t [tag update] ciflow/inductor/138214 -> ciflow/inductor/138214 2025-03-14T05:34:25.4592089Z t [tag update] ciflow/inductor/148328 -> ciflow/inductor/148328 2025-03-14T05:34:25.4592895Z t [tag update] ciflow/inductor/148484 -> ciflow/inductor/148484 2025-03-14T05:34:25.4593722Z t [tag update] ciflow/inductor/148569 -> ciflow/inductor/148569 2025-03-14T05:34:25.4594928Z t [tag update] ciflow/inductor/149014 -> ciflow/inductor/149014 2025-03-14T05:34:25.4595834Z t [tag update] ciflow/inductor/149027 -> ciflow/inductor/149027 2025-03-14T05:34:25.4597067Z * [new tag] ciflow/inductor/149178 -> ciflow/inductor/149178 2025-03-14T05:34:25.4599217Z * [new tag] ciflow/rocm-mi300/149088 -> ciflow/rocm-mi300/149088 2025-03-14T05:34:25.4600312Z * [new tag] ciflow/rocm/147527 -> ciflow/rocm/147527 2025-03-14T05:34:25.4601641Z t [tag update] ciflow/trunk/113257 -> ciflow/trunk/113257 2025-03-14T05:34:25.4602255Z t [tag update] ciflow/trunk/113258 -> ciflow/trunk/113258 2025-03-14T05:34:25.4603105Z t [tag update] ciflow/trunk/129420 -> ciflow/trunk/129420 2025-03-14T05:34:25.4603978Z t [tag update] ciflow/trunk/137400 -> ciflow/trunk/137400 2025-03-14T05:34:25.4606743Z * [new tag] ciflow/trunk/147527 -> ciflow/trunk/147527 2025-03-14T05:34:25.4607664Z t [tag update] ciflow/trunk/148180 -> ciflow/trunk/148180 2025-03-14T05:34:25.4608791Z * [new tag] ciflow/trunk/149064 -> ciflow/trunk/149064 2025-03-14T05:34:25.5131935Z [command]/usr/bin/git rev-parse --verify --quiet aed0b7a742a2d7b7901790622829cbd2135049a4^{object} 2025-03-14T05:34:25.5155923Z aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:34:25.5157594Z ##[endgroup] 2025-03-14T05:34:25.5158046Z ##[group]Determining the checkout info 2025-03-14T05:34:25.5158651Z ##[endgroup] 2025-03-14T05:34:25.5163080Z [command]/usr/bin/git sparse-checkout disable 2025-03-14T05:34:25.8955672Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig 2025-03-14T05:34:25.8981942Z ##[group]Checking out the ref 2025-03-14T05:34:25.8984065Z [command]/usr/bin/git checkout --progress --force aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:34:26.0166890Z Previous HEAD position was bd72c961cb2 Remove temp changes 2025-03-14T05:34:26.0186069Z HEAD is now at aed0b7a742a [c10d] Add param recording for uniqueID broadcasting and allgather (#149166) 2025-03-14T05:34:26.0209893Z ##[endgroup] 2025-03-14T05:34:26.0210382Z ##[group]Setting up auth for fetching submodules 2025-03-14T05:34:26.0215088Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-03-14T05:34:26.0255733Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2025-03-14T05:34:26.0279894Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2025-03-14T05:34:26.0305466Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2025-03-14T05:34:26.0327395Z ##[endgroup] 2025-03-14T05:34:26.0327872Z ##[group]Fetching submodules 2025-03-14T05:34:26.0330205Z [command]/usr/bin/git submodule sync --recursive 2025-03-14T05:34:26.0615405Z Synchronizing submodule url for 'android/libs/fbjni' 2025-03-14T05:34:26.0636404Z Synchronizing submodule url for 'third_party/FP16' 2025-03-14T05:34:26.0654330Z Synchronizing submodule url for 'third_party/FXdiv' 2025-03-14T05:34:26.0673541Z Synchronizing submodule url for 'third_party/NNPACK' 2025-03-14T05:34:26.0693125Z Synchronizing submodule url for 'third_party/NVTX' 2025-03-14T05:34:26.0715027Z Synchronizing submodule url for 'third_party/VulkanMemoryAllocator' 2025-03-14T05:34:26.0733775Z Synchronizing submodule url for 'third_party/XNNPACK' 2025-03-14T05:34:26.0767939Z Synchronizing submodule url for 'third_party/benchmark' 2025-03-14T05:34:26.0789382Z Synchronizing submodule url for 'third_party/composable_kernel' 2025-03-14T05:34:26.0814758Z Synchronizing submodule url for 'third_party/cpp-httplib' 2025-03-14T05:34:26.0835582Z Synchronizing submodule url for 'third_party/cpuinfo' 2025-03-14T05:34:26.0854550Z Synchronizing submodule url for 'third_party/cudnn_frontend' 2025-03-14T05:34:26.0874144Z Synchronizing submodule url for 'third_party/cutlass' 2025-03-14T05:34:26.0904274Z Synchronizing submodule url for 'third_party/eigen' 2025-03-14T05:34:26.0926368Z Synchronizing submodule url for 'third_party/fbgemm' 2025-03-14T05:34:26.0946069Z Synchronizing submodule url for 'third_party/fbgemm/third_party/asmjit' 2025-03-14T05:34:26.0964969Z Synchronizing submodule url for 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T05:34:26.0984646Z Synchronizing submodule url for 'third_party/fbgemm/third_party/cutlass' 2025-03-14T05:34:26.1010490Z Synchronizing submodule url for 'third_party/fbgemm/third_party/googletest' 2025-03-14T05:34:26.1031014Z Synchronizing submodule url for 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T05:34:26.1053033Z Synchronizing submodule url for 'third_party/flash-attention' 2025-03-14T05:34:26.1071804Z Synchronizing submodule url for 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T05:34:26.1095236Z Synchronizing submodule url for 'third_party/flash-attention/csrc/cutlass' 2025-03-14T05:34:26.1128000Z Synchronizing submodule url for 'third_party/flatbuffers' 2025-03-14T05:34:26.1152276Z Synchronizing submodule url for 'third_party/fmt' 2025-03-14T05:34:26.1171949Z Synchronizing submodule url for 'third_party/gemmlowp/gemmlowp' 2025-03-14T05:34:26.1193387Z Synchronizing submodule url for 'third_party/gloo' 2025-03-14T05:34:26.1211366Z Synchronizing submodule url for 'third_party/googletest' 2025-03-14T05:34:26.1233140Z Synchronizing submodule url for 'third_party/ideep' 2025-03-14T05:34:26.1249481Z Synchronizing submodule url for 'third_party/ideep/mkl-dnn' 2025-03-14T05:34:26.1280243Z Synchronizing submodule url for 'third_party/ittapi' 2025-03-14T05:34:26.1300921Z Synchronizing submodule url for 'third_party/kineto' 2025-03-14T05:34:26.1321057Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T05:34:26.1340804Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T05:34:26.1361353Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T05:34:26.1380493Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T05:34:26.1402169Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T05:34:26.1421462Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T05:34:26.1443657Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T05:34:26.1463847Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T05:34:26.1484818Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T05:34:26.1506045Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T05:34:26.1526967Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T05:34:26.1546369Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T05:34:26.1568326Z Synchronizing submodule url for 'third_party/kleidiai' 2025-03-14T05:34:26.1589978Z Synchronizing submodule url for 'third_party/mimalloc' 2025-03-14T05:34:26.1609518Z Synchronizing submodule url for 'third_party/nlohmann' 2025-03-14T05:34:26.1632429Z Synchronizing submodule url for 'third_party/onnx' 2025-03-14T05:34:26.1667202Z Synchronizing submodule url for 'third_party/onnx/third_party/pybind11' 2025-03-14T05:34:26.1689881Z Synchronizing submodule url for 'third_party/opentelemetry-cpp' 2025-03-14T05:34:26.1711375Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T05:34:26.1728119Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T05:34:26.1748087Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T05:34:26.1766472Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T05:34:26.1789943Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T05:34:26.1807092Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T05:34:26.1827263Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T05:34:26.1846625Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T05:34:26.1867248Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T05:34:26.1887701Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T05:34:26.1930016Z Synchronizing submodule url for 'third_party/pocketfft' 2025-03-14T05:34:26.1950860Z Synchronizing submodule url for 'third_party/protobuf' 2025-03-14T05:34:26.1971846Z Synchronizing submodule url for 'third_party/protobuf/third_party/benchmark' 2025-03-14T05:34:26.1991499Z Synchronizing submodule url for 'third_party/protobuf/third_party/googletest' 2025-03-14T05:34:26.2012030Z Synchronizing submodule url for 'third_party/psimd' 2025-03-14T05:34:26.2033935Z Synchronizing submodule url for 'third_party/pthreadpool' 2025-03-14T05:34:26.2051888Z Synchronizing submodule url for 'third_party/pybind11' 2025-03-14T05:34:26.2071990Z Synchronizing submodule url for 'third_party/python-peachpy' 2025-03-14T05:34:26.2091005Z Synchronizing submodule url for 'third_party/sleef' 2025-03-14T05:34:26.2114229Z Synchronizing submodule url for 'third_party/tensorpipe' 2025-03-14T05:34:26.2131131Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/googletest' 2025-03-14T05:34:26.2151651Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libnop' 2025-03-14T05:34:26.2168859Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libuv' 2025-03-14T05:34:26.2189127Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T05:34:26.2206735Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T05:34:26.2239227Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2025-03-14T05:34:26.2693014Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2025-03-14T05:34:26.2820622Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2025-03-14T05:34:26.2920368Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2025-03-14T05:34:26.3191591Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2025-03-14T05:34:26.3667578Z Submodule path 'third_party/NVTX': checked out 'e170594ac7cf1dac584da473d4ca9301087090c1' 2025-03-14T05:34:26.4104611Z Submodule path 'third_party/VulkanMemoryAllocator': checked out 'a6bfc237255a6bac1513f7c1ebde6d8aed6b5191' 2025-03-14T05:34:27.2330743Z Submodule path 'third_party/XNNPACK': checked out '51a0103656eff6fc9bfd39a4597923c4b542c883' 2025-03-14T05:34:27.2585153Z Submodule path 'third_party/benchmark': checked out '0d98dba29d66e93259db7daa53a9327df767a415' 2025-03-14T05:34:27.5521440Z Submodule path 'third_party/composable_kernel': checked out '8086bbe3a78d931eb96fe12fdc014082e18d18d3' 2025-03-14T05:34:27.6041232Z Submodule path 'third_party/cpp-httplib': checked out '3b6597bba913d51161383657829b7e644e59c006' 2025-03-14T05:34:27.7184369Z Submodule path 'third_party/cpuinfo': checked out '1e83a2fdd3102f65c6f1fb602c1b320486218a99' 2025-03-14T05:34:27.7581063Z Submodule path 'third_party/cudnn_frontend': checked out '91b7532f3386768bba4f444ee7672b497f34da8a' 2025-03-14T05:34:28.4345031Z Submodule path 'third_party/cutlass': checked out 'afa1772203677c5118fcd82537a9c8fefbcc7008' 2025-03-14T05:34:28.7071899Z Submodule path 'third_party/eigen': checked out '3147391d946bb4b6c68edd901f2add6ac1f31f8c' 2025-03-14T05:34:28.7790101Z Submodule path 'third_party/fbgemm': checked out 'dbc3157bf256f1339b3fa1fef2be89ac4078be0e' 2025-03-14T05:34:28.8285905Z Submodule path 'third_party/fbgemm/third_party/asmjit': checked out 'd3fbf7c9bc7c1d1365a94a45614b91c5a3706b81' 2025-03-14T05:34:28.9379767Z Submodule path 'third_party/fbgemm/third_party/cpuinfo': checked out 'ed8b86a253800bafdb7b25c5c399f91bff9cb1f3' 2025-03-14T05:34:29.4391172Z Submodule path 'third_party/fbgemm/third_party/cutlass': checked out 'fc9ebc645b63f3a6bc80aaefde5c063fb72110d6' 2025-03-14T05:34:29.4865782Z Submodule path 'third_party/fbgemm/third_party/googletest': checked out 'cbf019de22c8dd37b2108da35b2748fd702d1796' 2025-03-14T05:34:29.4994644Z Submodule path 'third_party/fbgemm/third_party/hipify_torch': checked out '23f53b025b466d8ec3c45d52290d3442f7fbe6b1' 2025-03-14T05:34:29.6108023Z Submodule path 'third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5' 2025-03-14T05:34:29.8866002Z Submodule path 'third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33' 2025-03-14T05:34:30.5547905Z Submodule path 'third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420' 2025-03-14T05:34:30.7095593Z Submodule path 'third_party/flatbuffers': checked out '01834de25e4bf3975a9a00e816292b1ad0fe184b' 2025-03-14T05:34:30.7442430Z Submodule path 'third_party/fmt': checked out '123913715afeb8a437e6388b4473fcc4753e1c9a' 2025-03-14T05:34:30.7836062Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2025-03-14T05:34:30.8111136Z Submodule path 'third_party/gloo': checked out '5354032ea08eadd7fc4456477f7f7c6308818509' 2025-03-14T05:34:30.8580405Z Submodule path 'third_party/googletest': checked out 'b514bdc898e2951020cbdca1304b75f5950d1f59' 2025-03-14T05:34:30.8717765Z Submodule path 'third_party/ideep': checked out '719d8e6cd7f7a0e01b155657526d693acf97c2b3' 2025-03-14T05:34:31.4788399Z Submodule path 'third_party/ideep/mkl-dnn': checked out '8d263e693366ef8db40acc569cc7d8edf644556d' 2025-03-14T05:34:31.4967764Z Submodule path 'third_party/ittapi': checked out '5b8a7d7422611c3a0d799fb5fc5dd4abfae35b42' 2025-03-14T05:34:31.6009323Z Submodule path 'third_party/kineto': checked out '2859721fd9e73d3ca1c56f827dbc64e6d68f78a2' 2025-03-14T05:34:31.6854764Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out '7d04a0053a845370ae06ce317a22a48e9edcc74e' 2025-03-14T05:34:31.8785428Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2025-03-14T05:34:31.8983104Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2025-03-14T05:34:31.9360489Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2025-03-14T05:34:31.9500363Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2025-03-14T05:34:31.9591099Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2025-03-14T05:34:31.9775739Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2025-03-14T05:34:32.0192808Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '58d77fa8070e8cec2dc1ed015d66b454c8d78850' 2025-03-14T05:34:32.1248868Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2025-03-14T05:34:32.1422304Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2025-03-14T05:34:32.1805955Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '0041a40c1350ba702d475b9c4ad62da77caea164' 2025-03-14T05:34:32.2264786Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '7aca84427f224eeed3144123d5230d5871e93347' 2025-03-14T05:34:32.2638445Z Submodule path 'third_party/kleidiai': checked out 'ef685a13cfbe8d418aa2ed34350e21e4938358b6' 2025-03-14T05:34:32.3016977Z Submodule path 'third_party/mimalloc': checked out 'b66e3214d8a104669c2ec05ae91ebc26a8f5ab78' 2025-03-14T05:34:32.4104056Z Submodule path 'third_party/nlohmann': checked out '87cda1d6646592ac5866dc703c8e1839046a6806' 2025-03-14T05:34:32.8123263Z Submodule path 'third_party/onnx': checked out 'b8baa8446686496da4cc8fda09f2b6fe65c2a02c' 2025-03-14T05:34:32.8515803Z Submodule path 'third_party/onnx/third_party/pybind11': checked out '3e9dfa2866941655c56877882565e7577de6fc7b' 2025-03-14T05:34:32.9370280Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2025-03-14T05:34:32.9594627Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2025-03-14T05:34:33.0006923Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2025-03-14T05:34:33.0132963Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2025-03-14T05:34:33.1240132Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2025-03-14T05:34:33.1366469Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2025-03-14T05:34:33.1525626Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2025-03-14T05:34:33.1696221Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2025-03-14T05:34:33.4302691Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2025-03-14T05:34:33.4775711Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-03-14T05:34:34.0343201Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2025-03-14T05:34:34.0453748Z Submodule path 'third_party/pocketfft': checked out '9d3ab05a7fffbc71a492bc6a17be034e83e8f0fe' 2025-03-14T05:34:34.3330123Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2025-03-14T05:34:34.3491085Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2025-03-14T05:34:34.4016822Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2025-03-14T05:34:34.4107809Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2025-03-14T05:34:34.4228925Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2025-03-14T05:34:34.4607437Z Submodule path 'third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2025-03-14T05:34:34.4902432Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2025-03-14T05:34:34.5335425Z Submodule path 'third_party/sleef': checked out '56e1f79cb140fb9326d612d0be06b5250565cade' 2025-03-14T05:34:34.5641522Z Submodule path 'third_party/tensorpipe': checked out '52791a2fd214b2a9dc5759d36725909c1daa7f2e' 2025-03-14T05:34:34.6100215Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2025-03-14T05:34:34.6265781Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2025-03-14T05:34:34.6895226Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '1dff88e5161cba5c59276d2070d2e304e4dcb242' 2025-03-14T05:34:34.7190971Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2025-03-14T05:34:34.7285687Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2025-03-14T05:34:34.7322886Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2025-03-14T05:34:34.7607152Z Entering 'android/libs/fbjni' 2025-03-14T05:34:34.7645225Z Entering 'third_party/FP16' 2025-03-14T05:34:34.7685491Z Entering 'third_party/FXdiv' 2025-03-14T05:34:34.7723767Z Entering 'third_party/NNPACK' 2025-03-14T05:34:34.7764203Z Entering 'third_party/NVTX' 2025-03-14T05:34:34.7804842Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T05:34:34.7844018Z Entering 'third_party/XNNPACK' 2025-03-14T05:34:34.7895482Z Entering 'third_party/benchmark' 2025-03-14T05:34:34.7939385Z Entering 'third_party/composable_kernel' 2025-03-14T05:34:34.7986964Z Entering 'third_party/cpp-httplib' 2025-03-14T05:34:34.8025248Z Entering 'third_party/cpuinfo' 2025-03-14T05:34:34.8064328Z Entering 'third_party/cudnn_frontend' 2025-03-14T05:34:34.8106252Z Entering 'third_party/cutlass' 2025-03-14T05:34:34.8157689Z Entering 'third_party/eigen' 2025-03-14T05:34:34.8199922Z Entering 'third_party/fbgemm' 2025-03-14T05:34:34.8239262Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T05:34:34.8282212Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T05:34:34.8321484Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T05:34:34.8366598Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T05:34:34.8406740Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T05:34:34.8446181Z Entering 'third_party/flash-attention' 2025-03-14T05:34:34.8486265Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T05:34:34.8527498Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T05:34:34.8575234Z Entering 'third_party/flatbuffers' 2025-03-14T05:34:34.8617901Z Entering 'third_party/fmt' 2025-03-14T05:34:34.8656575Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T05:34:34.8698825Z Entering 'third_party/gloo' 2025-03-14T05:34:34.8738645Z Entering 'third_party/googletest' 2025-03-14T05:34:34.8782291Z Entering 'third_party/ideep' 2025-03-14T05:34:34.8820412Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T05:34:34.8867106Z Entering 'third_party/ittapi' 2025-03-14T05:34:34.8904529Z Entering 'third_party/kineto' 2025-03-14T05:34:34.8943183Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T05:34:34.8981707Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T05:34:34.9021311Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T05:34:34.9060154Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T05:34:34.9106710Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T05:34:34.9141499Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T05:34:34.9184846Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T05:34:34.9222556Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T05:34:34.9261125Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T05:34:34.9307032Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T05:34:34.9346180Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T05:34:34.9384793Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T05:34:34.9423481Z Entering 'third_party/kleidiai' 2025-03-14T05:34:34.9462895Z Entering 'third_party/mimalloc' 2025-03-14T05:34:34.9502310Z Entering 'third_party/nlohmann' 2025-03-14T05:34:34.9543638Z Entering 'third_party/onnx' 2025-03-14T05:34:34.9598720Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T05:34:34.9639665Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T05:34:34.9681226Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T05:34:34.9718400Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T05:34:34.9756632Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T05:34:34.9801803Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T05:34:34.9840339Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T05:34:34.9884793Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T05:34:34.9923338Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T05:34:34.9964106Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T05:34:35.0004112Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T05:34:35.0043293Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T05:34:35.0104334Z Entering 'third_party/pocketfft' 2025-03-14T05:34:35.0141553Z Entering 'third_party/protobuf' 2025-03-14T05:34:35.0185141Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T05:34:35.0222388Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T05:34:35.0262009Z Entering 'third_party/psimd' 2025-03-14T05:34:35.0301268Z Entering 'third_party/pthreadpool' 2025-03-14T05:34:35.0340551Z Entering 'third_party/pybind11' 2025-03-14T05:34:35.0380374Z Entering 'third_party/python-peachpy' 2025-03-14T05:34:35.0419495Z Entering 'third_party/sleef' 2025-03-14T05:34:35.0458793Z Entering 'third_party/tensorpipe' 2025-03-14T05:34:35.0499454Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T05:34:35.0537408Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T05:34:35.0577498Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T05:34:35.0618739Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T05:34:35.0665134Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T05:34:35.0720573Z ##[endgroup] 2025-03-14T05:34:35.0721051Z ##[group]Persisting credentials for submodules 2025-03-14T05:34:35.0725302Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2025-03-14T05:34:35.1001707Z Entering 'android/libs/fbjni' 2025-03-14T05:34:35.1035056Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1035623Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1070692Z Entering 'third_party/FP16' 2025-03-14T05:34:35.1105433Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1105927Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1142198Z Entering 'third_party/FXdiv' 2025-03-14T05:34:35.1177231Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1177664Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1211817Z Entering 'third_party/NNPACK' 2025-03-14T05:34:35.1246679Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1247089Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1279774Z Entering 'third_party/NVTX' 2025-03-14T05:34:35.1313237Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1313723Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1344193Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T05:34:35.1376647Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1377060Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1408993Z Entering 'third_party/XNNPACK' 2025-03-14T05:34:35.1443847Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1444317Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1495346Z Entering 'third_party/benchmark' 2025-03-14T05:34:35.1528283Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1528702Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1566448Z Entering 'third_party/composable_kernel' 2025-03-14T05:34:35.1600352Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1600887Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1638503Z Entering 'third_party/cpp-httplib' 2025-03-14T05:34:35.1671834Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1672249Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1704856Z Entering 'third_party/cpuinfo' 2025-03-14T05:34:35.1740578Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1741054Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1774345Z Entering 'third_party/cudnn_frontend' 2025-03-14T05:34:35.1807228Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1807635Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1841351Z Entering 'third_party/cutlass' 2025-03-14T05:34:35.1874135Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1874555Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1914909Z Entering 'third_party/eigen' 2025-03-14T05:34:35.1948922Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1949406Z url.https://github.com/.insteadof 2025-03-14T05:34:35.1985302Z Entering 'third_party/fbgemm' 2025-03-14T05:34:35.2018758Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2019177Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2050745Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T05:34:35.2085935Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2086379Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2120670Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T05:34:35.2153357Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2153834Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2185667Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T05:34:35.2219617Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2220082Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2260339Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T05:34:35.2292749Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2293154Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2325942Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T05:34:35.2358160Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2358620Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2391320Z Entering 'third_party/flash-attention' 2025-03-14T05:34:35.2426736Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2427214Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2466973Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T05:34:35.2500556Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2501020Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2542348Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T05:34:35.2574609Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2575011Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2615986Z Entering 'third_party/flatbuffers' 2025-03-14T05:34:35.2648698Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2649100Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2689023Z Entering 'third_party/fmt' 2025-03-14T05:34:35.2723369Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2723852Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2760037Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T05:34:35.2794671Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2795160Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2823283Z Entering 'third_party/gloo' 2025-03-14T05:34:35.2856689Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2857102Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2887980Z Entering 'third_party/googletest' 2025-03-14T05:34:35.2922111Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2922606Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2953692Z Entering 'third_party/ideep' 2025-03-14T05:34:35.2987327Z url.https://github.com/.insteadof 2025-03-14T05:34:35.2987830Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3019727Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T05:34:35.3051402Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3051809Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3089711Z Entering 'third_party/ittapi' 2025-03-14T05:34:35.3123007Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3123452Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3156207Z Entering 'third_party/kineto' 2025-03-14T05:34:35.3191208Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3191695Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3222817Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T05:34:35.3253533Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3253943Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3286032Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T05:34:35.3317812Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3318475Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3351998Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T05:34:35.3385286Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3385790Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3426342Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T05:34:35.3459591Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3460082Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3489573Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T05:34:35.3523037Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3523528Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3564106Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T05:34:35.3596832Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3597634Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3631055Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T05:34:35.3665160Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3665797Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3697336Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T05:34:35.3733497Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3733890Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3768105Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T05:34:35.3801818Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3802207Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3845953Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T05:34:35.3877597Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3878015Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3913690Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T05:34:35.3946067Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3946499Z url.https://github.com/.insteadof 2025-03-14T05:34:35.3986310Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T05:34:35.4016923Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4017351Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4055772Z Entering 'third_party/kleidiai' 2025-03-14T05:34:35.4090496Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4090909Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4123438Z Entering 'third_party/mimalloc' 2025-03-14T05:34:35.4158576Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4159023Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4190048Z Entering 'third_party/nlohmann' 2025-03-14T05:34:35.4223199Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4223603Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4255713Z Entering 'third_party/onnx' 2025-03-14T05:34:35.4289515Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4289925Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4336055Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T05:34:35.4369733Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4370135Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4406588Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T05:34:35.4440221Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4440704Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4473258Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T05:34:35.4507053Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4507465Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4541315Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T05:34:35.4573968Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4574362Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4606255Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T05:34:35.4639141Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4639857Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4668777Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T05:34:35.4702788Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4703291Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4735180Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T05:34:35.4767878Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4768289Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4805973Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T05:34:35.4843899Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4844367Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4882941Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T05:34:35.4915264Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4915727Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4945858Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T05:34:35.4976978Z url.https://github.com/.insteadof 2025-03-14T05:34:35.4977390Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5013205Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T05:34:35.5046613Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5047021Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5082575Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T05:34:35.5115340Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5115821Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5166804Z Entering 'third_party/pocketfft' 2025-03-14T05:34:35.5200527Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5201374Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5230557Z Entering 'third_party/protobuf' 2025-03-14T05:34:35.5266259Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5266722Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5301273Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T05:34:35.5332993Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5333403Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5373041Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T05:34:35.5406384Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5406786Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5440150Z Entering 'third_party/psimd' 2025-03-14T05:34:35.5475359Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5475842Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5506418Z Entering 'third_party/pthreadpool' 2025-03-14T05:34:35.5540067Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5540536Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5578061Z Entering 'third_party/pybind11' 2025-03-14T05:34:35.5616050Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5616770Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5650815Z Entering 'third_party/python-peachpy' 2025-03-14T05:34:35.5686320Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5686706Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5718615Z Entering 'third_party/sleef' 2025-03-14T05:34:35.5753625Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5754543Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5784197Z Entering 'third_party/tensorpipe' 2025-03-14T05:34:35.5818100Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5818570Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5848762Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T05:34:35.5882837Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5883338Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5916373Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T05:34:35.5948774Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5949239Z url.https://github.com/.insteadof 2025-03-14T05:34:35.5981005Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T05:34:35.6011596Z url.https://github.com/.insteadof 2025-03-14T05:34:35.6012163Z url.https://github.com/.insteadof 2025-03-14T05:34:35.6044927Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T05:34:35.6078812Z url.https://github.com/.insteadof 2025-03-14T05:34:35.6079550Z url.https://github.com/.insteadof 2025-03-14T05:34:35.6110741Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T05:34:35.6148229Z url.https://github.com/.insteadof 2025-03-14T05:34:35.6148632Z url.https://github.com/.insteadof 2025-03-14T05:34:35.6206987Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2025-03-14T05:34:35.6487140Z Entering 'android/libs/fbjni' 2025-03-14T05:34:35.6530216Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-03-14T05:34:35.6546855Z Entering 'third_party/FP16' 2025-03-14T05:34:35.6593079Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-03-14T05:34:35.6607253Z Entering 'third_party/FXdiv' 2025-03-14T05:34:35.6655063Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-03-14T05:34:35.6669311Z Entering 'third_party/NNPACK' 2025-03-14T05:34:35.6716058Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-03-14T05:34:35.6730335Z Entering 'third_party/NVTX' 2025-03-14T05:34:35.6778822Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-03-14T05:34:35.6795207Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T05:34:35.6840749Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-03-14T05:34:35.6854637Z Entering 'third_party/XNNPACK' 2025-03-14T05:34:35.6902737Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-03-14T05:34:35.6931278Z Entering 'third_party/benchmark' 2025-03-14T05:34:35.6979655Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-03-14T05:34:35.6995713Z Entering 'third_party/composable_kernel' 2025-03-14T05:34:35.7041189Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-03-14T05:34:35.7064126Z Entering 'third_party/cpp-httplib' 2025-03-14T05:34:35.7110633Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-03-14T05:34:35.7126236Z Entering 'third_party/cpuinfo' 2025-03-14T05:34:35.7174925Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-03-14T05:34:35.7190654Z Entering 'third_party/cudnn_frontend' 2025-03-14T05:34:35.7237914Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-03-14T05:34:35.7255200Z Entering 'third_party/cutlass' 2025-03-14T05:34:35.7304766Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-03-14T05:34:35.7327136Z Entering 'third_party/eigen' 2025-03-14T05:34:35.7375101Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/eigen/config remote.origin.url 2025-03-14T05:34:35.7392900Z Entering 'third_party/fbgemm' 2025-03-14T05:34:35.7439909Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-03-14T05:34:35.7453635Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T05:34:35.7502075Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/asmjit/config remote.origin.url 2025-03-14T05:34:35.7517711Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T05:34:35.7563381Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cpuinfo/config remote.origin.url 2025-03-14T05:34:35.7580666Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T05:34:35.7631227Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/cutlass/config remote.origin.url 2025-03-14T05:34:35.7651086Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T05:34:35.7698857Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/googletest/config remote.origin.url 2025-03-14T05:34:35.7713516Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T05:34:35.7760043Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/third_party/hipify_torch/config remote.origin.url 2025-03-14T05:34:35.7774830Z Entering 'third_party/flash-attention' 2025-03-14T05:34:35.7823480Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-03-14T05:34:35.7840148Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T05:34:35.7886594Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-03-14T05:34:35.7911145Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T05:34:35.7956828Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-03-14T05:34:35.7983558Z Entering 'third_party/flatbuffers' 2025-03-14T05:34:35.8030325Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-03-14T05:34:35.8048754Z Entering 'third_party/fmt' 2025-03-14T05:34:35.8099666Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-03-14T05:34:35.8116397Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T05:34:35.8164122Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-03-14T05:34:35.8181289Z Entering 'third_party/gloo' 2025-03-14T05:34:35.8227952Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-03-14T05:34:35.8245140Z Entering 'third_party/googletest' 2025-03-14T05:34:35.8294927Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-03-14T05:34:35.8311230Z Entering 'third_party/ideep' 2025-03-14T05:34:35.8359538Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-03-14T05:34:35.8372962Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T05:34:35.8419889Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-03-14T05:34:35.8444045Z Entering 'third_party/ittapi' 2025-03-14T05:34:35.8489479Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-03-14T05:34:35.8506124Z Entering 'third_party/kineto' 2025-03-14T05:34:35.8552455Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-03-14T05:34:35.8566589Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T05:34:35.8613400Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-03-14T05:34:35.8629775Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T05:34:35.8673399Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-03-14T05:34:35.8688393Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T05:34:35.8732784Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-03-14T05:34:35.8749267Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T05:34:35.8797187Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-03-14T05:34:35.8811186Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T05:34:35.8859072Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-03-14T05:34:35.8872201Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T05:34:35.8919662Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-03-14T05:34:35.8934767Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T05:34:35.8982449Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-03-14T05:34:35.8998897Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T05:34:35.9043185Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-03-14T05:34:35.9060273Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T05:34:35.9106550Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-03-14T05:34:35.9122998Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T05:34:35.9168987Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-03-14T05:34:35.9187173Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T05:34:35.9239047Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-03-14T05:34:35.9252594Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T05:34:35.9299686Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-03-14T05:34:35.9320529Z Entering 'third_party/kleidiai' 2025-03-14T05:34:35.9367051Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-03-14T05:34:35.9383750Z Entering 'third_party/mimalloc' 2025-03-14T05:34:35.9431165Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-03-14T05:34:35.9446430Z Entering 'third_party/nlohmann' 2025-03-14T05:34:35.9492012Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-03-14T05:34:35.9509872Z Entering 'third_party/onnx' 2025-03-14T05:34:35.9556735Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-03-14T05:34:35.9589684Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T05:34:35.9635903Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-03-14T05:34:35.9652016Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T05:34:35.9701274Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-03-14T05:34:35.9718635Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T05:34:35.9764046Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-03-14T05:34:35.9780915Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T05:34:35.9825980Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-03-14T05:34:35.9840968Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T05:34:35.9887266Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-03-14T05:34:35.9903091Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T05:34:35.9950365Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-03-14T05:34:35.9966243Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T05:34:36.0011143Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-03-14T05:34:36.0027495Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T05:34:36.0071760Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-03-14T05:34:36.0086551Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T05:34:36.0134118Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-03-14T05:34:36.0147270Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T05:34:36.0195889Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-03-14T05:34:36.0210836Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T05:34:36.0258675Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-03-14T05:34:36.0274032Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T05:34:36.0320244Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-03-14T05:34:36.0356762Z Entering 'third_party/pocketfft' 2025-03-14T05:34:36.0402499Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-03-14T05:34:36.0419818Z Entering 'third_party/protobuf' 2025-03-14T05:34:36.0465708Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-03-14T05:34:36.0484348Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T05:34:36.0527008Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-03-14T05:34:36.0543164Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T05:34:36.0590304Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-03-14T05:34:36.0606810Z Entering 'third_party/psimd' 2025-03-14T05:34:36.0651354Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-03-14T05:34:36.0667718Z Entering 'third_party/pthreadpool' 2025-03-14T05:34:36.0713879Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-03-14T05:34:36.0727668Z Entering 'third_party/pybind11' 2025-03-14T05:34:36.0773413Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-03-14T05:34:36.0790343Z Entering 'third_party/python-peachpy' 2025-03-14T05:34:36.0835517Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-03-14T05:34:36.0849835Z Entering 'third_party/sleef' 2025-03-14T05:34:36.0896324Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-03-14T05:34:36.0913762Z Entering 'third_party/tensorpipe' 2025-03-14T05:34:36.0958803Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-03-14T05:34:36.0973292Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T05:34:36.1021574Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-03-14T05:34:36.1036423Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T05:34:36.1082353Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-03-14T05:34:36.1095393Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T05:34:36.1142716Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-03-14T05:34:36.1158995Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T05:34:36.1205136Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-03-14T05:34:36.1220271Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T05:34:36.1268247Z file:/home/ec2-user/actions-runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-03-14T05:34:36.2181860Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2025-03-14T05:34:36.2455437Z Entering 'android/libs/fbjni' 2025-03-14T05:34:36.2494881Z Entering 'third_party/FP16' 2025-03-14T05:34:36.2532766Z Entering 'third_party/FXdiv' 2025-03-14T05:34:36.2570840Z Entering 'third_party/NNPACK' 2025-03-14T05:34:36.2608995Z Entering 'third_party/NVTX' 2025-03-14T05:34:36.2646924Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T05:34:36.2686121Z Entering 'third_party/XNNPACK' 2025-03-14T05:34:36.2740691Z Entering 'third_party/benchmark' 2025-03-14T05:34:36.2781263Z Entering 'third_party/composable_kernel' 2025-03-14T05:34:36.2825907Z Entering 'third_party/cpp-httplib' 2025-03-14T05:34:36.2864742Z Entering 'third_party/cpuinfo' 2025-03-14T05:34:36.2904291Z Entering 'third_party/cudnn_frontend' 2025-03-14T05:34:36.2942956Z Entering 'third_party/cutlass' 2025-03-14T05:34:36.2991200Z Entering 'third_party/eigen' 2025-03-14T05:34:36.3031844Z Entering 'third_party/fbgemm' 2025-03-14T05:34:36.3069869Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T05:34:36.3108126Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T05:34:36.3144617Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T05:34:36.3189338Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T05:34:36.3228006Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T05:34:36.3267189Z Entering 'third_party/flash-attention' 2025-03-14T05:34:36.3307437Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T05:34:36.3351271Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T05:34:36.3399542Z Entering 'third_party/flatbuffers' 2025-03-14T05:34:36.3441658Z Entering 'third_party/fmt' 2025-03-14T05:34:36.3482440Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T05:34:36.3523736Z Entering 'third_party/gloo' 2025-03-14T05:34:36.3562704Z Entering 'third_party/googletest' 2025-03-14T05:34:36.3602595Z Entering 'third_party/ideep' 2025-03-14T05:34:36.3640903Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T05:34:36.3687262Z Entering 'third_party/ittapi' 2025-03-14T05:34:36.3725337Z Entering 'third_party/kineto' 2025-03-14T05:34:36.3764077Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T05:34:36.3802697Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T05:34:36.3842119Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T05:34:36.3881214Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T05:34:36.3919366Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T05:34:36.3961994Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T05:34:36.4003054Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T05:34:36.4040964Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T05:34:36.4082571Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T05:34:36.4126734Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T05:34:36.4177418Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T05:34:36.4215244Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T05:34:36.4260544Z Entering 'third_party/kleidiai' 2025-03-14T05:34:36.4299919Z Entering 'third_party/mimalloc' 2025-03-14T05:34:36.4338479Z Entering 'third_party/nlohmann' 2025-03-14T05:34:36.4379931Z Entering 'third_party/onnx' 2025-03-14T05:34:36.4433411Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T05:34:36.4472585Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T05:34:36.4514352Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T05:34:36.4550838Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T05:34:36.4587836Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T05:34:36.4624451Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T05:34:36.4663588Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T05:34:36.4701851Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T05:34:36.4739633Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T05:34:36.4777431Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T05:34:36.4815006Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T05:34:36.4859868Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T05:34:36.4918957Z Entering 'third_party/pocketfft' 2025-03-14T05:34:36.4957601Z Entering 'third_party/protobuf' 2025-03-14T05:34:36.5000630Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T05:34:36.5038021Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T05:34:36.5081230Z Entering 'third_party/psimd' 2025-03-14T05:34:36.5119361Z Entering 'third_party/pthreadpool' 2025-03-14T05:34:36.5158194Z Entering 'third_party/pybind11' 2025-03-14T05:34:36.5197997Z Entering 'third_party/python-peachpy' 2025-03-14T05:34:36.5237055Z Entering 'third_party/sleef' 2025-03-14T05:34:36.5275337Z Entering 'third_party/tensorpipe' 2025-03-14T05:34:36.5321586Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T05:34:36.5361241Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T05:34:36.5400751Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T05:34:36.5439567Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T05:34:36.5476794Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T05:34:36.5533383Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2025-03-14T05:34:36.5811546Z Entering 'android/libs/fbjni' 2025-03-14T05:34:36.5850219Z Entering 'third_party/FP16' 2025-03-14T05:34:36.5888946Z Entering 'third_party/FXdiv' 2025-03-14T05:34:36.5927025Z Entering 'third_party/NNPACK' 2025-03-14T05:34:36.5966479Z Entering 'third_party/NVTX' 2025-03-14T05:34:36.6007512Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T05:34:36.6046401Z Entering 'third_party/XNNPACK' 2025-03-14T05:34:36.6102008Z Entering 'third_party/benchmark' 2025-03-14T05:34:36.6141561Z Entering 'third_party/composable_kernel' 2025-03-14T05:34:36.6191938Z Entering 'third_party/cpp-httplib' 2025-03-14T05:34:36.6231393Z Entering 'third_party/cpuinfo' 2025-03-14T05:34:36.6270183Z Entering 'third_party/cudnn_frontend' 2025-03-14T05:34:36.6310053Z Entering 'third_party/cutlass' 2025-03-14T05:34:36.6357492Z Entering 'third_party/eigen' 2025-03-14T05:34:36.6400491Z Entering 'third_party/fbgemm' 2025-03-14T05:34:36.6440571Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T05:34:36.6485884Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T05:34:36.6523471Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T05:34:36.6567072Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T05:34:36.6605515Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T05:34:36.6646924Z Entering 'third_party/flash-attention' 2025-03-14T05:34:36.6686819Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T05:34:36.6729195Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T05:34:36.6775657Z Entering 'third_party/flatbuffers' 2025-03-14T05:34:36.6818312Z Entering 'third_party/fmt' 2025-03-14T05:34:36.6861077Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T05:34:36.6901063Z Entering 'third_party/gloo' 2025-03-14T05:34:36.6940157Z Entering 'third_party/googletest' 2025-03-14T05:34:36.6980592Z Entering 'third_party/ideep' 2025-03-14T05:34:36.7020575Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T05:34:36.7068311Z Entering 'third_party/ittapi' 2025-03-14T05:34:36.7107999Z Entering 'third_party/kineto' 2025-03-14T05:34:36.7146568Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T05:34:36.7184137Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T05:34:36.7222857Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T05:34:36.7261467Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T05:34:36.7301776Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T05:34:36.7338832Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T05:34:36.7389104Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T05:34:36.7425733Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T05:34:36.7463867Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T05:34:36.7503813Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T05:34:36.7543584Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T05:34:36.7581993Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T05:34:36.7621809Z Entering 'third_party/kleidiai' 2025-03-14T05:34:36.7661109Z Entering 'third_party/mimalloc' 2025-03-14T05:34:36.7700708Z Entering 'third_party/nlohmann' 2025-03-14T05:34:36.7741291Z Entering 'third_party/onnx' 2025-03-14T05:34:36.7796904Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T05:34:36.7836834Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T05:34:36.7881358Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T05:34:36.7921596Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T05:34:36.7959799Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T05:34:36.7998385Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T05:34:36.8037060Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T05:34:36.8074156Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T05:34:36.8113228Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T05:34:36.8150238Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T05:34:36.8189786Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T05:34:36.8229929Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T05:34:36.8287339Z Entering 'third_party/pocketfft' 2025-03-14T05:34:36.8326133Z Entering 'third_party/protobuf' 2025-03-14T05:34:36.8367738Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T05:34:36.8411981Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T05:34:36.8451442Z Entering 'third_party/psimd' 2025-03-14T05:34:36.8489609Z Entering 'third_party/pthreadpool' 2025-03-14T05:34:36.8529199Z Entering 'third_party/pybind11' 2025-03-14T05:34:36.8567829Z Entering 'third_party/python-peachpy' 2025-03-14T05:34:36.8606396Z Entering 'third_party/sleef' 2025-03-14T05:34:36.8646066Z Entering 'third_party/tensorpipe' 2025-03-14T05:34:36.8686191Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T05:34:36.8726815Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T05:34:36.8764990Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T05:34:36.8805092Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T05:34:36.8846463Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T05:34:36.8894350Z ##[endgroup] 2025-03-14T05:34:36.8931384Z [command]/usr/bin/git log -1 --format=%H 2025-03-14T05:34:36.8953510Z aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:34:36.9120096Z Prepare all required actions 2025-03-14T05:34:36.9120701Z Getting action download info 2025-03-14T05:34:37.0149761Z ##[group]Run ./.github/actions/setup-linux 2025-03-14T05:34:37.0150109Z env: 2025-03-14T05:34:37.0150348Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:37.0150639Z ##[endgroup] 2025-03-14T05:34:37.0204185Z ##[group]Run set -euo pipefail 2025-03-14T05:34:37.0204542Z set -euo pipefail 2025-03-14T05:34:37.0204956Z function get_ec2_metadata() { 2025-03-14T05:34:37.0205534Z  # Pulled from instance metadata endpoint for EC2 2025-03-14T05:34:37.0206247Z  # see https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instancedata-data-retrieval.html 2025-03-14T05:34:37.0206998Z  category=$1 2025-03-14T05:34:37.0207389Z  # If it is GCP runner (runner name contains gcp), do not run this 2025-03-14T05:34:37.0207856Z  runner_name_str=i-011f73f0c8d1623b6 2025-03-14T05:34:37.0208262Z  if [[ -f /.inarc ]]; then 2025-03-14T05:34:37.0208641Z  echo "ARC Runner, no info on ec2 metadata" 2025-03-14T05:34:37.0209069Z  elif [[ $runner_name_str == *"gcp"* ]]; then 2025-03-14T05:34:37.0209573Z  echo "Runner is from Google Cloud Platform, No info on ec2 metadata" 2025-03-14T05:34:37.0210031Z  else 2025-03-14T05:34:37.0210925Z  curl -H "X-aws-ec2-metadata-token: $(curl -s -X PUT "http://169.254.169.254/latest/api/token" -H "X-aws-ec2-metadata-token-ttl-seconds: 30")" -fsSL "http://169.254.169.254/latest/meta-data/${category}" 2025-03-14T05:34:37.0211878Z  fi 2025-03-14T05:34:37.0212117Z } 2025-03-14T05:34:37.0212406Z echo "ami-id: $(get_ec2_metadata ami-id)" 2025-03-14T05:34:37.0212866Z echo "instance-id: $(get_ec2_metadata instance-id)" 2025-03-14T05:34:37.0213361Z echo "instance-type: $(get_ec2_metadata instance-type)" 2025-03-14T05:34:37.0213810Z echo "system info $(uname -a)" 2025-03-14T05:34:37.0220347Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:37.0220728Z env: 2025-03-14T05:34:37.0220954Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:37.0221205Z ##[endgroup] 2025-03-14T05:34:37.0359076Z ami-id: ami-05b10e08d247fb927 2025-03-14T05:34:37.0464711Z instance-id: i-011f73f0c8d1623b6 2025-03-14T05:34:37.0575548Z instance-type: c5.12xlarge 2025-03-14T05:34:37.0585857Z system info Linux ip-10-1-69-91.ec2.internal 6.1.128-136.201.amzn2023.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Feb 10 16:18:01 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux 2025-03-14T05:34:37.0619401Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T05:34:37.0620314Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T05:34:37.0626098Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:37.0626486Z env: 2025-03-14T05:34:37.0626726Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:37.0626991Z ##[endgroup] 2025-03-14T05:34:37.0682007Z ##[group]Run if systemctl is-active --quiet docker; then 2025-03-14T05:34:37.0682449Z if systemctl is-active --quiet docker; then 2025-03-14T05:34:37.0682841Z  echo "Docker daemon is running..."; 2025-03-14T05:34:37.0683163Z else 2025-03-14T05:34:37.0683516Z  echo "Starting docker deamon..." && sudo systemctl start docker; 2025-03-14T05:34:37.0683929Z fi 2025-03-14T05:34:37.0689460Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:37.0689863Z env: 2025-03-14T05:34:37.0690118Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:37.0690401Z ##[endgroup] 2025-03-14T05:34:37.0760017Z Docker daemon is running... 2025-03-14T05:34:37.0810308Z ##[group]Run nick-fields/retry@v3.0.0 2025-03-14T05:34:37.0810614Z with: 2025-03-14T05:34:37.0810820Z shell: bash 2025-03-14T05:34:37.0811207Z timeout_minutes: 5 2025-03-14T05:34:37.0811459Z max_attempts: 3 2025-03-14T05:34:37.0811702Z retry_wait_seconds: 30 2025-03-14T05:34:37.0814055Z command: AWS_ACCOUNT_ID=$(aws sts get-caller-identity|grep Account|cut -f4 -d\") aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" # For LF Runners we need to make sure we also login to Meta's ECR docker registry too. META_AWS_ACCOUNT_ID=308535385114 if [ "$AWS_ACCOUNT_ID" != "$META_AWS_ACCOUNT_ID" ] ; then aws ecr get-login-password --region "$AWS_DEFAULT_REGION" | docker login --username AWS \ --password-stdin "$META_AWS_ACCOUNT_ID.dkr.ecr.$AWS_DEFAULT_REGION.amazonaws.com" fi 2025-03-14T05:34:37.0816523Z polling_interval_seconds: 1 2025-03-14T05:34:37.0816816Z warning_on_retry: true 2025-03-14T05:34:37.0817091Z continue_on_error: false 2025-03-14T05:34:37.0817451Z env: 2025-03-14T05:34:37.0817649Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:37.0817909Z AWS_RETRY_MODE: standard 2025-03-14T05:34:37.0818169Z AWS_MAX_ATTEMPTS: 5 2025-03-14T05:34:37.0818427Z AWS_DEFAULT_REGION: us-east-1 2025-03-14T05:34:37.0818691Z ##[endgroup] 2025-03-14T05:34:38.1331751Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T05:34:38.1332476Z Configure a credential helper to remove this warning. See 2025-03-14T05:34:38.1333086Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T05:34:38.1333505Z 2025-03-14T05:34:38.1333611Z Login Succeeded 2025-03-14T05:34:38.6203283Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T05:34:38.6204037Z Configure a credential helper to remove this warning. See 2025-03-14T05:34:38.6204777Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T05:34:38.6205215Z 2025-03-14T05:34:38.6205313Z Login Succeeded 2025-03-14T05:34:39.1654657Z Command completed after 1 attempt(s). 2025-03-14T05:34:39.1727095Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T05:34:39.1727674Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T05:34:39.1728197Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T05:34:39.1734581Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:39.1734978Z env: 2025-03-14T05:34:39.1735223Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:39.1735510Z ##[endgroup] 2025-03-14T05:34:39.1834044Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T05:34:39.1834615Z # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T05:34:39.1835074Z # shellcheck disable=SC2046 2025-03-14T05:34:39.1835422Z docker stop $(docker ps -q) || true 2025-03-14T05:34:39.1835782Z # Prune all of the docker images 2025-03-14T05:34:39.1836136Z docker system prune -af 2025-03-14T05:34:39.1841790Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:39.1842182Z env: 2025-03-14T05:34:39.1842417Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:39.1842697Z ##[endgroup] 2025-03-14T05:34:39.2108759Z "docker stop" requires at least 1 argument. 2025-03-14T05:34:39.2109196Z See 'docker stop --help'. 2025-03-14T05:34:39.2109384Z 2025-03-14T05:34:39.2109574Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2025-03-14T05:34:39.2109861Z 2025-03-14T05:34:39.2110001Z Stop one or more running containers 2025-03-14T05:34:39.2255508Z Total reclaimed space: 0B 2025-03-14T05:34:39.2294168Z ##[group]Run set +e 2025-03-14T05:34:39.2294443Z set +e 2025-03-14T05:34:39.2294699Z set -x 2025-03-14T05:34:39.2294932Z  2025-03-14T05:34:39.2295184Z PT_DOMAIN=download.pytorch.org 2025-03-14T05:34:39.2295752Z # TODO: Flaky access to download.pytorch.org https://github.com/pytorch/pytorch/issues/100400, 2025-03-14T05:34:39.2296628Z # cleaning this up once the issue is fixed. There are more than one resolved IP here, the last 2025-03-14T05:34:39.2297157Z # one is returned at random 2025-03-14T05:34:39.2297550Z RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" | tail -n1) 2025-03-14T05:34:39.2297927Z  2025-03-14T05:34:39.2298167Z if [ -z "${RESOLVED_IP}" ]; then 2025-03-14T05:34:39.2298597Z  echo "Couldn't resolve ${PT_DOMAIN}, retrying with Google DNS..." 2025-03-14T05:34:39.2299113Z  RESOLVED_IP=$(dig -4 +short "${PT_DOMAIN}" @8.8.8.8 | tail -n1) 2025-03-14T05:34:39.2299510Z  2025-03-14T05:34:39.2299759Z  if [ -z "${RESOLVED_IP}" ]; then 2025-03-14T05:34:39.2300258Z  echo "Couldn't resolve ${PT_DOMAIN}, exiting..." 2025-03-14T05:34:39.2300626Z  exit 1 2025-03-14T05:34:39.2300868Z  fi 2025-03-14T05:34:39.2301075Z fi 2025-03-14T05:34:39.2301294Z  2025-03-14T05:34:39.2301566Z if grep -r "${PT_DOMAIN}" /etc/hosts; then 2025-03-14T05:34:39.2301936Z  # Clean up any old records first 2025-03-14T05:34:39.2302294Z  sudo sed -i "/${PT_DOMAIN}/d" /etc/hosts 2025-03-14T05:34:39.2302623Z fi 2025-03-14T05:34:39.2302841Z  2025-03-14T05:34:39.2303157Z echo "${RESOLVED_IP} ${PT_DOMAIN}" | sudo tee -a /etc/hosts 2025-03-14T05:34:39.2303558Z cat /etc/hosts 2025-03-14T05:34:39.2308751Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:39.2309132Z env: 2025-03-14T05:34:39.2309368Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:39.2309637Z ##[endgroup] 2025-03-14T05:34:39.2333266Z + PT_DOMAIN=download.pytorch.org 2025-03-14T05:34:39.2338041Z ++ dig -4 +short download.pytorch.org 2025-03-14T05:34:39.2339063Z ++ tail -n1 2025-03-14T05:34:39.2689523Z + RESOLVED_IP=18.160.10.22 2025-03-14T05:34:39.2689868Z + '[' -z 18.160.10.22 ']' 2025-03-14T05:34:39.2690214Z + grep -r download.pytorch.org /etc/hosts 2025-03-14T05:34:39.2703124Z 18.160.10.36 download.pytorch.org 2025-03-14T05:34:39.2704536Z + sudo sed -i /download.pytorch.org/d /etc/hosts 2025-03-14T05:34:39.6202465Z + echo '18.160.10.22 download.pytorch.org' 2025-03-14T05:34:39.6202945Z + sudo tee -a /etc/hosts 2025-03-14T05:34:39.7351172Z 18.160.10.22 download.pytorch.org 2025-03-14T05:34:39.7365174Z + cat /etc/hosts 2025-03-14T05:34:39.7373483Z 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 2025-03-14T05:34:39.7378411Z ::1 localhost6 localhost6.localdomain6 2025-03-14T05:34:39.7378821Z 18.160.10.22 download.pytorch.org 2025-03-14T05:34:39.7543376Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2025-03-14T05:34:39.7543857Z with: 2025-03-14T05:34:39.7544284Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:39.7544805Z docker-build-dir: .ci/docker 2025-03-14T05:34:39.7545096Z working-directory: . 2025-03-14T05:34:39.7545446Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:39.7545842Z force-push: false 2025-03-14T05:34:39.7546063Z env: 2025-03-14T05:34:39.7546285Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:39.7546550Z ##[endgroup] 2025-03-14T05:34:39.7578939Z ##[group]Run set -ex 2025-03-14T05:34:39.7579244Z set -ex 2025-03-14T05:34:39.7579464Z  2025-03-14T05:34:39.7579857Z # If the docker build directory or the build script doesn't exist, the action will 2025-03-14T05:34:39.7580556Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2025-03-14T05:34:39.7581115Z # job could then download the pre-built image as usual 2025-03-14T05:34:39.7581631Z if [[ ! -d "${DOCKER_BUILD_DIR}" ]] || [[ ! -f "${DOCKER_BUILD_DIR}/build.sh" ]]; then 2025-03-14T05:34:39.7582099Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7582542Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7582942Z  2025-03-14T05:34:39.7583292Z  echo "There is no Docker build script in ${REPO_NAME} repo, skipping..." 2025-03-14T05:34:39.7583725Z  exit 0 2025-03-14T05:34:39.7583954Z else 2025-03-14T05:34:39.7584211Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7584537Z fi 2025-03-14T05:34:39.7584755Z  2025-03-14T05:34:39.7585103Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2025-03-14T05:34:39.7585698Z  # The docker image name already includes the ECR prefix and tag, so we can just 2025-03-14T05:34:39.7586227Z  # use it as it is, but first let's extract the tag 2025-03-14T05:34:39.7586819Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2025-03-14T05:34:39.7587314Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7587796Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7588202Z else 2025-03-14T05:34:39.7588520Z  DOCKER_TAG=$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2025-03-14T05:34:39.7588978Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7589604Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7590151Z fi 2025-03-14T05:34:39.7596407Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:39.7596788Z env: 2025-03-14T05:34:39.7597027Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:39.7597299Z REPO_NAME: pytorch 2025-03-14T05:34:39.7597754Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:39.7598263Z DOCKER_BUILD_DIR: .ci/docker 2025-03-14T05:34:39.7598634Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:39.7599019Z ##[endgroup] 2025-03-14T05:34:39.7621968Z + [[ ! -d .ci/docker ]] 2025-03-14T05:34:39.7622286Z + [[ ! -f .ci/docker/build.sh ]] 2025-03-14T05:34:39.7622615Z + echo skip=false 2025-03-14T05:34:39.7623743Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2025-03-14T05:34:39.7629625Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:39.7630419Z ++ awk -F '[:,]' '{print $2}' 2025-03-14T05:34:39.7650505Z + DOCKER_TAG=v1.3-lite 2025-03-14T05:34:39.7651097Z + echo docker-tag=v1.3-lite 2025-03-14T05:34:39.7651641Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:39.7687998Z ##[group]Run set +e 2025-03-14T05:34:39.7688327Z set +e 2025-03-14T05:34:39.7688579Z set -x 2025-03-14T05:34:39.7688823Z  2025-03-14T05:34:39.7689056Z login() { 2025-03-14T05:34:39.7689563Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-03-14T05:34:39.7690115Z } 2025-03-14T05:34:39.7690350Z  2025-03-14T05:34:39.7690589Z retry () { 2025-03-14T05:34:39.7690890Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-03-14T05:34:39.7691226Z } 2025-03-14T05:34:39.7691454Z  2025-03-14T05:34:39.7691696Z retry login "${DOCKER_REGISTRY}" 2025-03-14T05:34:39.7692030Z  2025-03-14T05:34:39.7692270Z START_TIME=$(date +%s) 2025-03-14T05:34:39.7692598Z # Wait up to 120 minutes 2025-03-14T05:34:39.7692987Z while [[ $(( $(date +%s) - 7200 )) -lt $START_TIME ]]; do 2025-03-14T05:34:39.7693514Z  # Check if image already exists, if it does then skip building it 2025-03-14T05:34:39.7694036Z  if docker manifest inspect "${DOCKER_IMAGE}"; then 2025-03-14T05:34:39.7694426Z  exit 0 2025-03-14T05:34:39.7694684Z  fi 2025-03-14T05:34:39.7694922Z  2025-03-14T05:34:39.7695330Z  # NB: This flag is used by Docker build workflow to push the image to ECR, so we can 2025-03-14T05:34:39.7696023Z  # use this to differentiate between the Docker build and regular build jobs. For the 2025-03-14T05:34:39.7696719Z  # latter, it will wait for the Docker images to become available before continuing 2025-03-14T05:34:39.7697346Z  if [ "${DOCKER_PUSH:-false}" == "true" ]; then 2025-03-14T05:34:39.7697747Z  # It's a Docker build job, let's build the image 2025-03-14T05:34:39.7698095Z  break 2025-03-14T05:34:39.7698484Z  else 2025-03-14T05:34:39.7698830Z  # It's a regular build job, wait for the image to become available 2025-03-14T05:34:39.7699247Z  sleep 300 2025-03-14T05:34:39.7699501Z  fi 2025-03-14T05:34:39.7699727Z done 2025-03-14T05:34:39.7699949Z  2025-03-14T05:34:39.7700300Z # NB: This part requires a full checkout. Otherwise, the merge base will 2025-03-14T05:34:39.7700854Z # be empty. The default action would be to continue rebuild the image 2025-03-14T05:34:39.7701340Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2025-03-14T05:34:39.7701801Z  # if we're on the base branch then use the parent commit 2025-03-14T05:34:39.7702206Z  MERGE_BASE=$(git rev-parse HEAD~) 2025-03-14T05:34:39.7702529Z else 2025-03-14T05:34:39.7702866Z  # otherwise we're on a PR, so use the most recent base commit 2025-03-14T05:34:39.7703340Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2025-03-14T05:34:39.7703707Z fi 2025-03-14T05:34:39.7703929Z  2025-03-14T05:34:39.7704170Z if [[ -z "${MERGE_BASE}" ]]; then 2025-03-14T05:34:39.7704532Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7704866Z  2025-03-14T05:34:39.7705331Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2025-03-14T05:34:39.7705872Z  exit 0 2025-03-14T05:34:39.7706110Z fi 2025-03-14T05:34:39.7706333Z  2025-03-14T05:34:39.7706650Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2025-03-14T05:34:39.7707321Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2025-03-14T05:34:39.7707900Z  exit 1 2025-03-14T05:34:39.7708224Z fi 2025-03-14T05:34:39.7708451Z  2025-03-14T05:34:39.7708817Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2025-03-14T05:34:39.7709471Z # If no image exists but the hash is the same as the previous hash then we should error out here 2025-03-14T05:34:39.7710050Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2025-03-14T05:34:39.7710717Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2025-03-14T05:34:39.7711462Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2025-03-14T05:34:39.7711910Z fi 2025-03-14T05:34:39.7712126Z  2025-03-14T05:34:39.7712393Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2025-03-14T05:34:39.7718007Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:39.7718397Z env: 2025-03-14T05:34:39.7718640Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:39.7718938Z DOCKER_BUILD_DIR: .ci/docker 2025-03-14T05:34:39.7719347Z BASE_REVISION: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:34:39.7719924Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:39.7720440Z DOCKER_TAG: v1.3-lite 2025-03-14T05:34:39.7720806Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:39.7721314Z DOCKER_PUSH: 2025-03-14T05:34:39.7721530Z ##[endgroup] 2025-03-14T05:34:39.7744448Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:39.7745174Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:39.7746888Z + aws ecr get-login-password --region us-east-1 2025-03-14T05:34:39.7748544Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:40.2693078Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T05:34:40.2706540Z Configure a credential helper to remove this warning. See 2025-03-14T05:34:40.2707164Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T05:34:40.2707791Z 2025-03-14T05:34:40.2707907Z Login Succeeded 2025-03-14T05:34:40.2713112Z ++ date +%s 2025-03-14T05:34:40.2720769Z + START_TIME=1741930480 2025-03-14T05:34:40.2724382Z ++ date +%s 2025-03-14T05:34:40.2732481Z + [[ 1741923280 -lt 1741930480 ]] 2025-03-14T05:34:40.2733079Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:40.5676057Z { 2025-03-14T05:34:40.5676387Z "schemaVersion": 2, 2025-03-14T05:34:40.5676904Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2025-03-14T05:34:40.5677401Z "config": { 2025-03-14T05:34:40.5677778Z "mediaType": "application/vnd.docker.container.image.v1+json", 2025-03-14T05:34:40.5678225Z "size": 20302, 2025-03-14T05:34:40.5678712Z "digest": "sha256:3f0a96285c3f041ba3fb0458700ecf22dcae07db7d2673d53620cfb6e910a801" 2025-03-14T05:34:40.5679236Z }, 2025-03-14T05:34:40.5679480Z "layers": [ 2025-03-14T05:34:40.5679751Z { 2025-03-14T05:34:40.5680121Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5680583Z "size": 55105522, 2025-03-14T05:34:40.5681053Z "digest": "sha256:cd81d20ef38bd8d74acbc5e89281e2113c826f25e8156b36f1863270b91691ed" 2025-03-14T05:34:40.5681573Z }, 2025-03-14T05:34:40.5681859Z { 2025-03-14T05:34:40.5682232Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5682691Z "size": 15558271, 2025-03-14T05:34:40.5683161Z "digest": "sha256:f0388f0d5bf1adc15e551cceee5a85f21b1ebf5b13c380ee0e941c5d55013598" 2025-03-14T05:34:40.5683687Z }, 2025-03-14T05:34:40.5683916Z { 2025-03-14T05:34:40.5684282Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5684909Z "size": 54751917, 2025-03-14T05:34:40.5685661Z "digest": "sha256:5d473f760e53d3d50afd1cebc7113387023a04ff8ec34073c4412b465ccc2fc5" 2025-03-14T05:34:40.5686182Z }, 2025-03-14T05:34:40.5686443Z { 2025-03-14T05:34:40.5686798Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5687255Z "size": 197072749, 2025-03-14T05:34:40.5687719Z "digest": "sha256:66d32181a1ed55cf7269c27a7a18858d7a4679d9fccbc616d5d878b6ddded25b" 2025-03-14T05:34:40.5688229Z }, 2025-03-14T05:34:40.5688458Z { 2025-03-14T05:34:40.5688817Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5689274Z "size": 6051871, 2025-03-14T05:34:40.5689733Z "digest": "sha256:53e6a6c5cc814bb0599f0a52321614f26a8ccbbf27c087dcadd1780c749ffb11" 2025-03-14T05:34:40.5690250Z }, 2025-03-14T05:34:40.5690486Z { 2025-03-14T05:34:40.5690851Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5691312Z "size": 21644684, 2025-03-14T05:34:40.5691779Z "digest": "sha256:aa4c3d38c3ef04f23e7513cf49baf5363dd88eabe3d0ef7fb64f1588bbb4d089" 2025-03-14T05:34:40.5692306Z }, 2025-03-14T05:34:40.5692685Z { 2025-03-14T05:34:40.5693105Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5693559Z "size": 248, 2025-03-14T05:34:40.5693997Z "digest": "sha256:8b0846683480a779b560e40739abc52e18f26d9e63c744178f0f6f5014c9954f" 2025-03-14T05:34:40.5694497Z }, 2025-03-14T05:34:40.5694733Z { 2025-03-14T05:34:40.5695094Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5695549Z "size": 121330030, 2025-03-14T05:34:40.5695989Z "digest": "sha256:45fcd21edc3c509e981521e64e3448033bd6f7ab189768ab2d02956a505a8b62" 2025-03-14T05:34:40.5696494Z }, 2025-03-14T05:34:40.5696716Z { 2025-03-14T05:34:40.5697076Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5697527Z "size": 9311, 2025-03-14T05:34:40.5697979Z "digest": "sha256:ee6ee5455a19a6d2278b560300eb5abd977ae2ea4cb11161fd1f82f59c2b1732" 2025-03-14T05:34:40.5698488Z }, 2025-03-14T05:34:40.5698714Z { 2025-03-14T05:34:40.5699073Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5699673Z "size": 6625428431, 2025-03-14T05:34:40.5700135Z "digest": "sha256:d8ce676aff014060c697a005d6d7a42eb983cf30748e1743b119ca8c10bd497f" 2025-03-14T05:34:40.5700757Z }, 2025-03-14T05:34:40.5700976Z { 2025-03-14T05:34:40.5701433Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5701863Z "size": 648835, 2025-03-14T05:34:40.5702296Z "digest": "sha256:14afca80fd552d77f35f7ade96a5283ee3e85fff7dc934ce92f7f73f16a1cbd6" 2025-03-14T05:34:40.5702782Z }, 2025-03-14T05:34:40.5702982Z { 2025-03-14T05:34:40.5703507Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5703945Z "size": 2464075, 2025-03-14T05:34:40.5704381Z "digest": "sha256:976466ecfd39df2ce963cdfb444a466271623ce236199c9ac35d3f63c0f71ba8" 2025-03-14T05:34:40.5704873Z }, 2025-03-14T05:34:40.5705158Z { 2025-03-14T05:34:40.5705695Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5706150Z "size": 86782316, 2025-03-14T05:34:40.5706611Z "digest": "sha256:ce2083aca1337d28816b4f6abf5f66d40aa27ea4325a41043d6be8e0f3f4ef4f" 2025-03-14T05:34:40.5707122Z }, 2025-03-14T05:34:40.5707349Z { 2025-03-14T05:34:40.5707710Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5708161Z "size": 348, 2025-03-14T05:34:40.5708596Z "digest": "sha256:28310576f7b193a2f3e7c14c06423d47cc8475992b38b82fbc17f96037bf424f" 2025-03-14T05:34:40.5709219Z }, 2025-03-14T05:34:40.5709440Z { 2025-03-14T05:34:40.5709777Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5710217Z "size": 49631131, 2025-03-14T05:34:40.5710660Z "digest": "sha256:7785707ea59f3658f65800fd12bab45f9b9c0d43436066ae4665707c70c64770" 2025-03-14T05:34:40.5711150Z }, 2025-03-14T05:34:40.5711492Z { 2025-03-14T05:34:40.5711925Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5712353Z "size": 12582345, 2025-03-14T05:34:40.5712786Z "digest": "sha256:b3471a6007c09b862d76cdcc2394fe10f21fa5edc1e3531313f50e5cb932a4f6" 2025-03-14T05:34:40.5713260Z }, 2025-03-14T05:34:40.5713476Z { 2025-03-14T05:34:40.5713816Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5714240Z "size": 30800070, 2025-03-14T05:34:40.5714678Z "digest": "sha256:c49feadec2456eacd3990a507a16860d1e6a2ea55ebde7b5d02fdaedb6d15074" 2025-03-14T05:34:40.5715162Z }, 2025-03-14T05:34:40.5715371Z { 2025-03-14T05:34:40.5715706Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5716124Z "size": 273661150, 2025-03-14T05:34:40.5716530Z "digest": "sha256:42ff0bef89864f80223b6e67918fb6d1b087518376e0bcb98de1ab428ad08d59" 2025-03-14T05:34:40.5717000Z }, 2025-03-14T05:34:40.5717208Z { 2025-03-14T05:34:40.5717548Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5717967Z "size": 44000793, 2025-03-14T05:34:40.5718416Z "digest": "sha256:bca0a279ba8f4dbc852687d8d8637dc5b5d5a677cea971d1c8dab5c9aa968f29" 2025-03-14T05:34:40.5718899Z }, 2025-03-14T05:34:40.5719116Z { 2025-03-14T05:34:40.5719452Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5719876Z "size": 1104825, 2025-03-14T05:34:40.5720308Z "digest": "sha256:b53906efea720f32acb69acb8e8e5b44ea51dcb6bfab8bbd08f7f2110816274a" 2025-03-14T05:34:40.5720795Z }, 2025-03-14T05:34:40.5721009Z { 2025-03-14T05:34:40.5721347Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5721768Z "size": 2106321, 2025-03-14T05:34:40.5722199Z "digest": "sha256:fc9c2e306e8d33d55564f0b6a63772af4c065aadd4fc4d6aa4ddc8d4b6e354a6" 2025-03-14T05:34:40.5722665Z }, 2025-03-14T05:34:40.5722878Z { 2025-03-14T05:34:40.5723215Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5723641Z "size": 2500680, 2025-03-14T05:34:40.5724068Z "digest": "sha256:c31469dacd4efe33cc0f095d07b8cf5f25a13a512999c23f16c51b0683d50e7d" 2025-03-14T05:34:40.5724742Z }, 2025-03-14T05:34:40.5724966Z { 2025-03-14T05:34:40.5725516Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5725977Z "size": 2105, 2025-03-14T05:34:40.5726445Z "digest": "sha256:a490aa80cfb8cb0ebe08cce810f99cb2887865b2cbaccf572b585c2e2e8cdea5" 2025-03-14T05:34:40.5726969Z }, 2025-03-14T05:34:40.5727200Z { 2025-03-14T05:34:40.5727565Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5728014Z "size": 508, 2025-03-14T05:34:40.5728466Z "digest": "sha256:af38fafd5281c058b52e1aed873b558ffb1e0e6945c3f572bb98a1e510b676ce" 2025-03-14T05:34:40.5728976Z }, 2025-03-14T05:34:40.5729180Z { 2025-03-14T05:34:40.5729539Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5729991Z "size": 238, 2025-03-14T05:34:40.5730436Z "digest": "sha256:f019768365832e634a2d5aa84132b8ed36349a6dd532b4d6682ba1918b1b186f" 2025-03-14T05:34:40.5730938Z }, 2025-03-14T05:34:40.5731162Z { 2025-03-14T05:34:40.5731623Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5732039Z "size": 32, 2025-03-14T05:34:40.5732453Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-03-14T05:34:40.5732925Z }, 2025-03-14T05:34:40.5733135Z { 2025-03-14T05:34:40.5733469Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5733887Z "size": 992, 2025-03-14T05:34:40.5734301Z "digest": "sha256:8abf3df306123ec7d510177df018163ad8be68a39297ef4628fff6c6f023edcd" 2025-03-14T05:34:40.5734769Z }, 2025-03-14T05:34:40.5734978Z { 2025-03-14T05:34:40.5735310Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5735713Z "size": 1003, 2025-03-14T05:34:40.5736236Z "digest": "sha256:826c11fbe9d1ecae827dc1c85d0818ecf2fbc68d61def83bd473b3383b749d0e" 2025-03-14T05:34:40.5736717Z }, 2025-03-14T05:34:40.5736936Z { 2025-03-14T05:34:40.5737281Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5737704Z "size": 1444451192, 2025-03-14T05:34:40.5738137Z "digest": "sha256:87abd3ae6c4f92af5f014e44713c2300feb629694b2d87424132434f1a0d3b7c" 2025-03-14T05:34:40.5738608Z }, 2025-03-14T05:34:40.5738817Z { 2025-03-14T05:34:40.5739153Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5739569Z "size": 222, 2025-03-14T05:34:40.5739994Z "digest": "sha256:57b3bfcb2bf41dba6f921caf50df60b2fcf581abdcc4c9530b51248e3bcf8dc9" 2025-03-14T05:34:40.5740480Z }, 2025-03-14T05:34:40.5740693Z { 2025-03-14T05:34:40.5741030Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5741453Z "size": 261, 2025-03-14T05:34:40.5741857Z "digest": "sha256:d37056629615df6edcfa3d81383d2b5d62c62d3eb8f25b6ada08d70a877d2b2d" 2025-03-14T05:34:40.5742330Z }, 2025-03-14T05:34:40.5742547Z { 2025-03-14T05:34:40.5742887Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-03-14T05:34:40.5743307Z "size": 93, 2025-03-14T05:34:40.5743718Z "digest": "sha256:ed9b6d851a3c9505441cde2bc66e9279013dc6a90b5a66ce63051e257314f4c6" 2025-03-14T05:34:40.5744189Z } 2025-03-14T05:34:40.5744403Z ] 2025-03-14T05:34:40.5744617Z } 2025-03-14T05:34:40.5744847Z + exit 0 2025-03-14T05:34:40.5783464Z ##[group]Run set -eux 2025-03-14T05:34:40.5783775Z set -eux 2025-03-14T05:34:40.5784680Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin 2025-03-14T05:34:40.5791892Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:40.5792289Z env: 2025-03-14T05:34:40.5792534Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:40.5792829Z ##[endgroup] 2025-03-14T05:34:40.5824039Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token 2025-03-14T05:34:40.5824838Z + jq --raw-output .SecretString 2025-03-14T05:34:40.5825589Z + jq -r .docker_hub_readonly_token 2025-03-14T05:34:40.5826077Z + docker login --username pytorchbot --password-stdin 2025-03-14T05:34:41.1204470Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T05:34:41.1205508Z Configure a credential helper to remove this warning. See 2025-03-14T05:34:41.1206173Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T05:34:41.1206585Z 2025-03-14T05:34:41.1206704Z Login Succeeded 2025-03-14T05:34:41.1296934Z ##[group]Run tag=${ECR_DOCKER_IMAGE##*/} 2025-03-14T05:34:41.1297306Z tag=${ECR_DOCKER_IMAGE##*/} 2025-03-14T05:34:41.1297690Z echo "docker pull ghcr.io/pytorch/ci-image:${tag/:/-}" 2025-03-14T05:34:41.1303113Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:41.1303489Z env: 2025-03-14T05:34:41.1303712Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:41.1304192Z ECR_DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:41.1304672Z ##[endgroup] 2025-03-14T05:34:41.1329448Z docker pull ghcr.io/pytorch/ci-image:xla_base-v1.3-lite 2025-03-14T05:34:41.1388676Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2025-03-14T05:34:41.1389107Z with: 2025-03-14T05:34:41.1389513Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:41.1390093Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:41.1390475Z env: 2025-03-14T05:34:41.1390695Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:41.1390958Z ##[endgroup] 2025-03-14T05:34:41.1419634Z ##[group]Run set -x 2025-03-14T05:34:41.1419915Z set -x 2025-03-14T05:34:41.1420150Z set +e 2025-03-14T05:34:41.1420383Z  2025-03-14T05:34:41.1420602Z login() { 2025-03-14T05:34:41.1421074Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-03-14T05:34:41.1421600Z } 2025-03-14T05:34:41.1421820Z  2025-03-14T05:34:41.1422022Z retry () { 2025-03-14T05:34:41.1422355Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-03-14T05:34:41.1422676Z } 2025-03-14T05:34:41.1422891Z  2025-03-14T05:34:41.1423130Z retry login "${DOCKER_REGISTRY}" 2025-03-14T05:34:41.1423440Z  2025-03-14T05:34:41.1423641Z set -e 2025-03-14T05:34:41.1423982Z # ignore output since only exit code is used for conditional 2025-03-14T05:34:41.1424463Z # only pull docker image if it's not available locally 2025-03-14T05:34:41.1424993Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2025-03-14T05:34:41.1425479Z  retry docker pull "${DOCKER_IMAGE}" 2025-03-14T05:34:41.1425798Z fi 2025-03-14T05:34:41.1430519Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:34:41.1430897Z env: 2025-03-14T05:34:41.1431121Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:34:41.1431565Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:41.1432140Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:41.1432520Z ##[endgroup] 2025-03-14T05:34:41.1453393Z + set +e 2025-03-14T05:34:41.1454012Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:41.1454511Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:41.1456480Z + aws ecr get-login-password --region us-east-1 2025-03-14T05:34:41.1457701Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-03-14T05:34:41.6326465Z WARNING! Your password will be stored unencrypted in /home/ec2-user/.docker/config.json. 2025-03-14T05:34:41.6327110Z Configure a credential helper to remove this warning. See 2025-03-14T05:34:41.6327720Z https://docs.docker.com/engine/reference/commandline/login/#credentials-store 2025-03-14T05:34:41.6328351Z 2025-03-14T05:34:41.6328465Z Login Succeeded 2025-03-14T05:34:41.6339608Z + set -e 2025-03-14T05:34:41.6340176Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:41.6462089Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:41.6462867Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:34:41.9195473Z v1.3-lite: Pulling from pytorch/xla_base 2025-03-14T05:34:41.9205625Z cd81d20ef38b: Pulling fs layer 2025-03-14T05:34:41.9206664Z f0388f0d5bf1: Pulling fs layer 2025-03-14T05:34:41.9207541Z 5d473f760e53: Pulling fs layer 2025-03-14T05:34:41.9208411Z 66d32181a1ed: Pulling fs layer 2025-03-14T05:34:41.9208918Z 53e6a6c5cc81: Pulling fs layer 2025-03-14T05:34:41.9209240Z aa4c3d38c3ef: Pulling fs layer 2025-03-14T05:34:41.9209566Z 8b0846683480: Pulling fs layer 2025-03-14T05:34:41.9209923Z 45fcd21edc3c: Pulling fs layer 2025-03-14T05:34:41.9210248Z ee6ee5455a19: Pulling fs layer 2025-03-14T05:34:41.9210572Z d8ce676aff01: Pulling fs layer 2025-03-14T05:34:41.9210879Z 14afca80fd55: Pulling fs layer 2025-03-14T05:34:41.9211505Z 976466ecfd39: Pulling fs layer 2025-03-14T05:34:41.9211838Z ce2083aca133: Pulling fs layer 2025-03-14T05:34:41.9212155Z 28310576f7b1: Pulling fs layer 2025-03-14T05:34:41.9212474Z 7785707ea59f: Pulling fs layer 2025-03-14T05:34:41.9212786Z b3471a6007c0: Pulling fs layer 2025-03-14T05:34:41.9213100Z c49feadec245: Pulling fs layer 2025-03-14T05:34:41.9213416Z 42ff0bef8986: Pulling fs layer 2025-03-14T05:34:41.9213732Z bca0a279ba8f: Pulling fs layer 2025-03-14T05:34:41.9214053Z b53906efea72: Pulling fs layer 2025-03-14T05:34:41.9214369Z fc9c2e306e8d: Pulling fs layer 2025-03-14T05:34:41.9214685Z c31469dacd4e: Pulling fs layer 2025-03-14T05:34:41.9215001Z a490aa80cfb8: Pulling fs layer 2025-03-14T05:34:41.9215322Z af38fafd5281: Pulling fs layer 2025-03-14T05:34:41.9215678Z aa4c3d38c3ef: Waiting 2025-03-14T05:34:41.9215969Z f01976836583: Pulling fs layer 2025-03-14T05:34:41.9216271Z 8b0846683480: Waiting 2025-03-14T05:34:41.9216538Z 4f4fb700ef54: Pulling fs layer 2025-03-14T05:34:41.9216851Z 45fcd21edc3c: Waiting 2025-03-14T05:34:41.9217129Z ee6ee5455a19: Waiting 2025-03-14T05:34:41.9217414Z 8abf3df30612: Pulling fs layer 2025-03-14T05:34:41.9217725Z d8ce676aff01: Waiting 2025-03-14T05:34:41.9217997Z 14afca80fd55: Waiting 2025-03-14T05:34:41.9218280Z 826c11fbe9d1: Pulling fs layer 2025-03-14T05:34:41.9218602Z 87abd3ae6c4f: Pulling fs layer 2025-03-14T05:34:41.9218908Z 976466ecfd39: Waiting 2025-03-14T05:34:41.9219195Z 57b3bfcb2bf4: Pulling fs layer 2025-03-14T05:34:41.9219508Z 66d32181a1ed: Waiting 2025-03-14T05:34:41.9219781Z ce2083aca133: Waiting 2025-03-14T05:34:41.9220055Z c49feadec245: Waiting 2025-03-14T05:34:41.9220339Z d37056629615: Pulling fs layer 2025-03-14T05:34:41.9220643Z 28310576f7b1: Waiting 2025-03-14T05:34:41.9220909Z ed9b6d851a3c: Pulling fs layer 2025-03-14T05:34:41.9221225Z 53e6a6c5cc81: Waiting 2025-03-14T05:34:41.9221500Z 42ff0bef8986: Waiting 2025-03-14T05:34:41.9221773Z bca0a279ba8f: Waiting 2025-03-14T05:34:41.9222047Z fc9c2e306e8d: Waiting 2025-03-14T05:34:41.9222327Z 87abd3ae6c4f: Waiting 2025-03-14T05:34:41.9222602Z 57b3bfcb2bf4: Waiting 2025-03-14T05:34:41.9222875Z 4f4fb700ef54: Waiting 2025-03-14T05:34:41.9223145Z d37056629615: Waiting 2025-03-14T05:34:41.9223412Z b53906efea72: Waiting 2025-03-14T05:34:41.9223687Z ed9b6d851a3c: Waiting 2025-03-14T05:34:41.9223963Z c31469dacd4e: Waiting 2025-03-14T05:34:41.9224239Z a490aa80cfb8: Waiting 2025-03-14T05:34:41.9224510Z af38fafd5281: Waiting 2025-03-14T05:34:41.9224761Z 8abf3df30612: Waiting 2025-03-14T05:34:41.9225032Z 826c11fbe9d1: Waiting 2025-03-14T05:34:41.9225299Z 7785707ea59f: Waiting 2025-03-14T05:34:41.9225568Z b3471a6007c0: Waiting 2025-03-14T05:34:41.9225838Z f01976836583: Waiting 2025-03-14T05:34:42.2368567Z f0388f0d5bf1: Verifying Checksum 2025-03-14T05:34:42.2369317Z f0388f0d5bf1: Download complete 2025-03-14T05:34:42.7224407Z 5d473f760e53: Verifying Checksum 2025-03-14T05:34:42.7224818Z 5d473f760e53: Download complete 2025-03-14T05:34:42.7616681Z cd81d20ef38b: Verifying Checksum 2025-03-14T05:34:42.7617123Z cd81d20ef38b: Download complete 2025-03-14T05:34:42.9754432Z 53e6a6c5cc81: Verifying Checksum 2025-03-14T05:34:42.9754833Z 53e6a6c5cc81: Download complete 2025-03-14T05:34:43.0725307Z 8b0846683480: Verifying Checksum 2025-03-14T05:34:43.0725821Z 8b0846683480: Download complete 2025-03-14T05:34:43.1893231Z aa4c3d38c3ef: Verifying Checksum 2025-03-14T05:34:43.1893668Z aa4c3d38c3ef: Download complete 2025-03-14T05:34:43.3753343Z ee6ee5455a19: Verifying Checksum 2025-03-14T05:34:43.3753808Z ee6ee5455a19: Download complete 2025-03-14T05:34:44.0206888Z cd81d20ef38b: Pull complete 2025-03-14T05:34:44.2905265Z f0388f0d5bf1: Pull complete 2025-03-14T05:34:44.8735602Z 45fcd21edc3c: Verifying Checksum 2025-03-14T05:34:44.8736026Z 45fcd21edc3c: Download complete 2025-03-14T05:34:45.0264487Z 14afca80fd55: Verifying Checksum 2025-03-14T05:34:45.0264901Z 14afca80fd55: Download complete 2025-03-14T05:34:45.5002095Z 66d32181a1ed: Verifying Checksum 2025-03-14T05:34:45.5002487Z 66d32181a1ed: Download complete 2025-03-14T05:34:45.5531929Z 976466ecfd39: Verifying Checksum 2025-03-14T05:34:45.5532325Z 976466ecfd39: Download complete 2025-03-14T05:34:45.6167802Z 5d473f760e53: Pull complete 2025-03-14T05:34:45.6435668Z 28310576f7b1: Verifying Checksum 2025-03-14T05:34:45.6436193Z 28310576f7b1: Download complete 2025-03-14T05:34:46.4954575Z 7785707ea59f: Verifying Checksum 2025-03-14T05:34:46.4955017Z 7785707ea59f: Download complete 2025-03-14T05:34:46.7909936Z b3471a6007c0: Verifying Checksum 2025-03-14T05:34:46.7910364Z b3471a6007c0: Download complete 2025-03-14T05:34:47.5426180Z ce2083aca133: Verifying Checksum 2025-03-14T05:34:47.5426603Z ce2083aca133: Download complete 2025-03-14T05:34:47.7694563Z c49feadec245: Verifying Checksum 2025-03-14T05:34:47.7694964Z c49feadec245: Download complete 2025-03-14T05:34:49.1152375Z 66d32181a1ed: Pull complete 2025-03-14T05:34:49.1605132Z bca0a279ba8f: Verifying Checksum 2025-03-14T05:34:49.1605612Z bca0a279ba8f: Download complete 2025-03-14T05:34:49.2873509Z 53e6a6c5cc81: Pull complete 2025-03-14T05:34:49.3467587Z b53906efea72: Verifying Checksum 2025-03-14T05:34:49.3467966Z b53906efea72: Download complete 2025-03-14T05:34:49.4923722Z fc9c2e306e8d: Verifying Checksum 2025-03-14T05:34:49.4924148Z fc9c2e306e8d: Download complete 2025-03-14T05:34:49.6614008Z c31469dacd4e: Download complete 2025-03-14T05:34:49.7489706Z a490aa80cfb8: Verifying Checksum 2025-03-14T05:34:49.7490100Z a490aa80cfb8: Download complete 2025-03-14T05:34:49.8055726Z aa4c3d38c3ef: Pull complete 2025-03-14T05:34:49.8312259Z 8b0846683480: Pull complete 2025-03-14T05:34:49.8373873Z af38fafd5281: Download complete 2025-03-14T05:34:50.0707346Z f01976836583: Verifying Checksum 2025-03-14T05:34:50.0707779Z f01976836583: Download complete 2025-03-14T05:34:50.0784969Z 4f4fb700ef54: Verifying Checksum 2025-03-14T05:34:50.0785484Z 4f4fb700ef54: Download complete 2025-03-14T05:34:50.2271066Z 8abf3df30612: Download complete 2025-03-14T05:34:50.3212970Z 826c11fbe9d1: Verifying Checksum 2025-03-14T05:34:50.3213416Z 826c11fbe9d1: Download complete 2025-03-14T05:34:52.5746157Z 42ff0bef8986: Verifying Checksum 2025-03-14T05:34:52.5746646Z 42ff0bef8986: Download complete 2025-03-14T05:34:52.7811563Z d37056629615: Verifying Checksum 2025-03-14T05:34:52.7811930Z d37056629615: Download complete 2025-03-14T05:34:52.9163444Z ed9b6d851a3c: Verifying Checksum 2025-03-14T05:34:52.9164408Z ed9b6d851a3c: Download complete 2025-03-14T05:34:56.7216704Z 45fcd21edc3c: Pull complete 2025-03-14T05:34:56.7359563Z ee6ee5455a19: Pull complete 2025-03-14T05:35:16.2359423Z 87abd3ae6c4f: Verifying Checksum 2025-03-14T05:35:16.2360884Z 87abd3ae6c4f: Download complete 2025-03-14T05:36:32.6034599Z d8ce676aff01: Verifying Checksum 2025-03-14T05:36:32.6037257Z d8ce676aff01: Download complete 2025-03-14T05:37:31.7988471Z d8ce676aff01: Pull complete 2025-03-14T05:37:32.3017971Z 14afca80fd55: Pull complete 2025-03-14T05:37:32.7462615Z 976466ecfd39: Pull complete 2025-03-14T05:37:35.0181553Z ce2083aca133: Pull complete 2025-03-14T05:37:35.4909616Z 28310576f7b1: Pull complete 2025-03-14T05:37:36.6841406Z 7785707ea59f: Pull complete 2025-03-14T05:37:37.8658812Z b3471a6007c0: Pull complete 2025-03-14T05:37:39.2212607Z c49feadec245: Pull complete 2025-03-14T05:37:50.7496296Z 42ff0bef8986: Pull complete 2025-03-14T05:37:53.6787279Z bca0a279ba8f: Pull complete 2025-03-14T05:37:54.1902593Z b53906efea72: Pull complete 2025-03-14T05:37:54.6910571Z fc9c2e306e8d: Pull complete 2025-03-14T05:37:55.2651078Z c31469dacd4e: Pull complete 2025-03-14T05:37:55.7343957Z a490aa80cfb8: Pull complete 2025-03-14T05:37:56.1892091Z af38fafd5281: Pull complete 2025-03-14T05:37:56.6600715Z f01976836583: Pull complete 2025-03-14T05:37:57.1209038Z 4f4fb700ef54: Pull complete 2025-03-14T05:37:57.4784727Z 8abf3df30612: Pull complete 2025-03-14T05:37:57.8418181Z 826c11fbe9d1: Pull complete 2025-03-14T05:38:18.7409718Z 87abd3ae6c4f: Pull complete 2025-03-14T05:38:19.2014405Z 57b3bfcb2bf4: Pull complete 2025-03-14T05:38:19.6656019Z d37056629615: Pull complete 2025-03-14T05:38:20.1380685Z ed9b6d851a3c: Pull complete 2025-03-14T05:38:20.3686816Z Digest: sha256:2e8aa6551e059f9b636de3582c14d5b861af3c8419e08937c6dde4d8446823c7 2025-03-14T05:38:20.4660716Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:38:20.5103496Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:38:20.5158655Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T05:38:20.5159655Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-03-14T05:38:20.5170065Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:20.5170517Z env: 2025-03-14T05:38:20.5170787Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:20.5171092Z ##[endgroup] 2025-03-14T05:38:20.5266479Z Prepare all required actions 2025-03-14T05:38:20.5575529Z ##[group]Run ./.github/actions/get-workflow-job-id 2025-03-14T05:38:20.5575899Z with: 2025-03-14T05:38:20.5576310Z github-token: *** 2025-03-14T05:38:20.5576563Z env: 2025-03-14T05:38:20.5576799Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:20.5577082Z ##[endgroup] 2025-03-14T05:38:20.5737288Z ##[group]Run set -eux 2025-03-14T05:38:20.5737628Z set -eux 2025-03-14T05:38:20.5738112Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2025-03-14T05:38:20.5743735Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:20.5744147Z env: 2025-03-14T05:38:20.5744393Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:20.5745177Z GITHUB_TOKEN: *** 2025-03-14T05:38:20.5745601Z ##[endgroup] 2025-03-14T05:38:20.5768618Z + python3 .github/scripts/get_workflow_job_id.py 13849515290 i-011f73f0c8d1623b6 2025-03-14T05:38:23.1344722Z setting job-id=38757034389 2025-03-14T05:38:23.1345412Z setting job-name=linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:38:23.1666347Z ##[group]Run python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 dataclasses_json==0.6.7 2025-03-14T05:38:23.1667136Z python3 -m pip install psutil==5.9.1 nvidia-ml-py==11.525.84 dataclasses_json==0.6.7 2025-03-14T05:38:23.1667758Z python3 -m tools.stats.monitor > usage_log.txt 2>&1 & 2025-03-14T05:38:23.1668270Z echo "monitor-script-pid=${!}" >> "${GITHUB_OUTPUT}" 2025-03-14T05:38:23.1674369Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:23.1674779Z env: 2025-03-14T05:38:23.1675028Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:23.1675320Z JOB_ID: 38757034389 2025-03-14T05:38:23.1675741Z JOB_NAME: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:38:23.1676384Z WORKFLOW_NAME: pull 2025-03-14T05:38:23.1676673Z WORKFLOW_RUN_ID: 13849515290 2025-03-14T05:38:23.1676957Z ##[endgroup] 2025-03-14T05:38:23.3965197Z Defaulting to user installation because normal site-packages is not writeable 2025-03-14T05:38:23.4125067Z Requirement already satisfied: psutil==5.9.1 in /home/ec2-user/.local/lib/python3.9/site-packages (5.9.1) 2025-03-14T05:38:23.4127960Z Requirement already satisfied: nvidia-ml-py==11.525.84 in /home/ec2-user/.local/lib/python3.9/site-packages (11.525.84) 2025-03-14T05:38:23.4132084Z Requirement already satisfied: dataclasses_json==0.6.7 in /home/ec2-user/.local/lib/python3.9/site-packages (0.6.7) 2025-03-14T05:38:23.4230074Z Requirement already satisfied: marshmallow<4.0.0,>=3.18.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from dataclasses_json==0.6.7) (3.26.1) 2025-03-14T05:38:23.4233796Z Requirement already satisfied: typing-inspect<1,>=0.4.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from dataclasses_json==0.6.7) (0.9.0) 2025-03-14T05:38:23.4318777Z Requirement already satisfied: packaging>=17.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from marshmallow<4.0.0,>=3.18.0->dataclasses_json==0.6.7) (24.2) 2025-03-14T05:38:23.4346787Z Requirement already satisfied: mypy-extensions>=0.3.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from typing-inspect<1,>=0.4.0->dataclasses_json==0.6.7) (1.0.0) 2025-03-14T05:38:23.4349275Z Requirement already satisfied: typing-extensions>=3.7.4 in /home/ec2-user/.local/lib/python3.9/site-packages (from typing-inspect<1,>=0.4.0->dataclasses_json==0.6.7) (4.12.2) 2025-03-14T05:38:23.6143994Z Prepare all required actions 2025-03-14T05:38:23.6144410Z Getting action download info 2025-03-14T05:38:23.7295267Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2025-03-14T05:38:24.3354874Z Download action repository 'actions/download-artifact@v4' (SHA:cc203385981b70ca67e1cc392babf9cc229d5806) 2025-03-14T05:38:25.6255651Z ##[group]Run ./.github/actions/download-build-artifacts 2025-03-14T05:38:25.6256070Z with: 2025-03-14T05:38:25.6256342Z name: linux-focal-py3.9-clang9-xla 2025-03-14T05:38:25.6256686Z s3-bucket: gha-artifacts 2025-03-14T05:38:25.6256969Z env: 2025-03-14T05:38:25.6257323Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:25.6257601Z ##[endgroup] 2025-03-14T05:38:25.6308997Z ##[group]Run seemethere/download-artifact-s3@v4 2025-03-14T05:38:25.6309373Z with: 2025-03-14T05:38:25.6309640Z name: linux-focal-py3.9-clang9-xla 2025-03-14T05:38:25.6309987Z s3-bucket: gha-artifacts 2025-03-14T05:38:25.6310340Z region: us-east-1 2025-03-14T05:38:25.6310578Z env: 2025-03-14T05:38:25.6310811Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:25.6311094Z ##[endgroup] 2025-03-14T05:38:26.3086383Z (node:300266) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2025-03-14T05:38:26.3086959Z 2025-03-14T05:38:26.3087163Z Please migrate your code to use AWS SDK for JavaScript (v3). 2025-03-14T05:38:26.3087765Z For more information, check the migration guide at https://a.co/7PzMCcy 2025-03-14T05:38:26.3088363Z (Use `node --trace-warnings ...` to show where the warning was created) 2025-03-14T05:38:26.4054678Z Found 1 objects with prefix pytorch/pytorch/13849515290/linux-focal-py3.9-clang9-xla/ 2025-03-14T05:38:26.4055451Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2025-03-14T05:38:34.2563437Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/artifacts.zip 2025-03-14T05:38:34.2569259Z Artifact download has finished successfully 2025-03-14T05:38:34.2792869Z ##[group]Run unzip -o artifacts.zip 2025-03-14T05:38:34.2793256Z unzip -o artifacts.zip 2025-03-14T05:38:34.2799255Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:34.2799678Z env: 2025-03-14T05:38:34.2799947Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:34.2800251Z ##[endgroup] 2025-03-14T05:38:34.2845881Z Archive: artifacts.zip 2025-03-14T05:38:34.2846531Z creating: dist/ 2025-03-14T05:38:35.1562161Z inflating: dist/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl 2025-03-14T05:38:35.1676616Z inflating: dist/.ninja_log 2025-03-14T05:38:35.1677112Z creating: build/custom_test_artifacts/ 2025-03-14T05:38:35.1677543Z creating: build/custom_test_artifacts/custom-op-build/ 2025-03-14T05:38:35.1678071Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2025-03-14T05:38:35.1678689Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2025-03-14T05:38:35.1679447Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2025-03-14T05:38:35.1680151Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/ 2025-03-14T05:38:35.1680852Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CMakeSystem.cmake 2025-03-14T05:38:35.1681598Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CompilerIdC/ 2025-03-14T05:38:35.1682337Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CompilerIdC/tmp/ 2025-03-14T05:38:35.1683170Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CompilerIdC/CMakeCCompilerId.c 2025-03-14T05:38:35.1684022Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CompilerIdC/a.out 2025-03-14T05:38:35.1684924Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CMakeCCompiler.cmake 2025-03-14T05:38:35.1685961Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CompilerIdCXX/ 2025-03-14T05:38:35.1686728Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CompilerIdCXX/tmp/ 2025-03-14T05:38:35.1687601Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-03-14T05:38:35.1688491Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CompilerIdCXX/a.out 2025-03-14T05:38:35.1689318Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CMakeCXXCompiler.cmake 2025-03-14T05:38:35.1690202Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CMakeDetermineCompilerABI_C.bin 2025-03-14T05:38:35.1691869Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.4/CMakeDetermineCompilerABI_CXX.bin 2025-03-14T05:38:35.1692681Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2025-03-14T05:38:35.1693388Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2025-03-14T05:38:35.1694088Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2025-03-14T05:38:35.1694863Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2025-03-14T05:38:35.1695745Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2025-03-14T05:38:35.1696599Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2025-03-14T05:38:35.1697391Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2025-03-14T05:38:35.1698212Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2025-03-14T05:38:35.1699032Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2025-03-14T05:38:35.1699855Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2025-03-14T05:38:35.1700677Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2025-03-14T05:38:35.1701484Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2025-03-14T05:38:35.1716311Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2025-03-14T05:38:35.1851872Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2025-03-14T05:38:35.1852660Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2025-03-14T05:38:35.1853495Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2025-03-14T05:38:35.1854426Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2025-03-14T05:38:35.1855340Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2025-03-14T05:38:35.1856171Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2025-03-14T05:38:35.1857030Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2025-03-14T05:38:35.1857897Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2025-03-14T05:38:35.1858772Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2025-03-14T05:38:35.1859646Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2025-03-14T05:38:35.1860497Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2025-03-14T05:38:35.1875212Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2025-03-14T05:38:35.1921642Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2025-03-14T05:38:35.1922609Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-03-14T05:38:35.1923441Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2025-03-14T05:38:35.1924188Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2025-03-14T05:38:35.1925011Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2025-03-14T05:38:35.1925690Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2025-03-14T05:38:35.1926349Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2025-03-14T05:38:35.1926941Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2025-03-14T05:38:35.1927541Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2025-03-14T05:38:35.2049750Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2025-03-14T05:38:35.2088434Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2025-03-14T05:38:35.2089012Z creating: build/custom_test_artifacts/jit-hook-build/ 2025-03-14T05:38:35.2089521Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2025-03-14T05:38:35.2090131Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2025-03-14T05:38:35.2091688Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2025-03-14T05:38:35.2092389Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/ 2025-03-14T05:38:35.2093078Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CMakeSystem.cmake 2025-03-14T05:38:35.2093825Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CompilerIdC/ 2025-03-14T05:38:35.2094556Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CompilerIdC/tmp/ 2025-03-14T05:38:35.2095380Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CompilerIdC/CMakeCCompilerId.c 2025-03-14T05:38:35.2096240Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CompilerIdC/a.out 2025-03-14T05:38:35.2097030Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CMakeCCompiler.cmake 2025-03-14T05:38:35.2097954Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CompilerIdCXX/ 2025-03-14T05:38:35.2098692Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CompilerIdCXX/tmp/ 2025-03-14T05:38:35.2099579Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-03-14T05:38:35.2100819Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CompilerIdCXX/a.out 2025-03-14T05:38:35.2101659Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CMakeCXXCompiler.cmake 2025-03-14T05:38:35.2103007Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CMakeDetermineCompilerABI_C.bin 2025-03-14T05:38:35.2104621Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.4/CMakeDetermineCompilerABI_CXX.bin 2025-03-14T05:38:35.2105419Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2025-03-14T05:38:35.2106109Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2025-03-14T05:38:35.2106811Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2025-03-14T05:38:35.2107613Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2025-03-14T05:38:35.2108521Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2025-03-14T05:38:35.2109483Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2025-03-14T05:38:35.2110294Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2025-03-14T05:38:35.2111127Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2025-03-14T05:38:35.2111975Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2025-03-14T05:38:35.2112820Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2025-03-14T05:38:35.2113663Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2025-03-14T05:38:35.2114488Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2025-03-14T05:38:35.2127536Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2025-03-14T05:38:35.2159918Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2025-03-14T05:38:35.2160850Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-03-14T05:38:35.2161666Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2025-03-14T05:38:35.2162401Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2025-03-14T05:38:35.2163084Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2025-03-14T05:38:35.2163747Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2025-03-14T05:38:35.2164390Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2025-03-14T05:38:35.2165094Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2025-03-14T05:38:35.2165858Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2025-03-14T05:38:35.2191749Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2025-03-14T05:38:35.2192361Z creating: build/custom_test_artifacts/custom-backend-build/ 2025-03-14T05:38:35.2192928Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2025-03-14T05:38:35.2193590Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2025-03-14T05:38:35.2194371Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2025-03-14T05:38:35.2195323Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/ 2025-03-14T05:38:35.2196077Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CMakeSystem.cmake 2025-03-14T05:38:35.2196875Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CompilerIdC/ 2025-03-14T05:38:35.2197649Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CompilerIdC/tmp/ 2025-03-14T05:38:35.2198539Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CompilerIdC/CMakeCCompilerId.c 2025-03-14T05:38:35.2199438Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CompilerIdC/a.out 2025-03-14T05:38:35.2200281Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CMakeCCompiler.cmake 2025-03-14T05:38:35.2201098Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CompilerIdCXX/ 2025-03-14T05:38:35.2201892Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CompilerIdCXX/tmp/ 2025-03-14T05:38:35.2202818Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-03-14T05:38:35.2203760Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CompilerIdCXX/a.out 2025-03-14T05:38:35.2204733Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CMakeCXXCompiler.cmake 2025-03-14T05:38:35.2205782Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CMakeDetermineCompilerABI_C.bin 2025-03-14T05:38:35.2207150Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.4/CMakeDetermineCompilerABI_CXX.bin 2025-03-14T05:38:35.2208016Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2025-03-14T05:38:35.2208763Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2025-03-14T05:38:35.2209528Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2025-03-14T05:38:35.2210393Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2025-03-14T05:38:35.2211369Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2025-03-14T05:38:35.2212312Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2025-03-14T05:38:35.2213189Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2025-03-14T05:38:35.2214097Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2025-03-14T05:38:35.2215017Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2025-03-14T05:38:35.2215935Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2025-03-14T05:38:35.2216855Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2025-03-14T05:38:35.2217763Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2025-03-14T05:38:35.2218737Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2025-03-14T05:38:35.2296926Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2025-03-14T05:38:35.2297890Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2025-03-14T05:38:35.2298811Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2025-03-14T05:38:35.2300004Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2025-03-14T05:38:35.2300993Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2025-03-14T05:38:35.2301925Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2025-03-14T05:38:35.2302881Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2025-03-14T05:38:35.2303857Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2025-03-14T05:38:35.2304827Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2025-03-14T05:38:35.2305799Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2025-03-14T05:38:35.2306749Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2025-03-14T05:38:35.2319361Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2025-03-14T05:38:35.2343817Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2025-03-14T05:38:35.2344883Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-03-14T05:38:35.2345943Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2025-03-14T05:38:35.2346752Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2025-03-14T05:38:35.2347491Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2025-03-14T05:38:35.2348223Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2025-03-14T05:38:35.2348931Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2025-03-14T05:38:35.2349561Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2025-03-14T05:38:35.2350209Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2025-03-14T05:38:35.2421153Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2025-03-14T05:38:35.2440670Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2025-03-14T05:38:35.2441225Z creating: build/lib/ 2025-03-14T05:38:35.2510595Z inflating: build/lib/libprotobuf-lite.a 2025-03-14T05:38:35.2871071Z inflating: build/lib/libprotobuf.a 2025-03-14T05:38:35.3268185Z inflating: build/lib/libprotoc.a 2025-03-14T05:38:35.3275117Z inflating: build/lib/libpthreadpool.a 2025-03-14T05:38:35.3282066Z inflating: build/lib/libcpuinfo.a 2025-03-14T05:38:35.3288565Z inflating: build/lib/libcpuinfo_internals.a 2025-03-14T05:38:35.3289225Z inflating: build/lib/libclog.a 2025-03-14T05:38:35.3308098Z inflating: build/lib/libpytorch_qnnpack.a 2025-03-14T05:38:35.3308760Z inflating: build/lib/libnnpack_reference_layers.a 2025-03-14T05:38:35.3325990Z inflating: build/lib/libnnpack.a 2025-03-14T05:38:35.3481349Z inflating: build/lib/libmicrokernels-prod.a 2025-03-14T05:38:35.4074560Z inflating: build/lib/libmicrokernels-all.a 2025-03-14T05:38:35.4180541Z inflating: build/lib/libXNNPACK.a 2025-03-14T05:38:35.4238761Z inflating: build/lib/libbenchmark.a 2025-03-14T05:38:35.4239264Z inflating: build/lib/libbenchmark_main.a 2025-03-14T05:38:35.4295644Z inflating: build/lib/libgtest.a 2025-03-14T05:38:35.4306200Z inflating: build/lib/libgmock.a 2025-03-14T05:38:35.4306856Z inflating: build/lib/libgmock_main.a 2025-03-14T05:38:35.4307479Z inflating: build/lib/libgtest_main.a 2025-03-14T05:38:35.4314738Z inflating: build/lib/libittnotify.a 2025-03-14T05:38:35.4373665Z inflating: build/lib/libasmjit.a 2025-03-14T05:38:35.4399189Z inflating: build/lib/libtensorpipe_uv.a 2025-03-14T05:38:35.4848315Z inflating: build/lib/libtensorpipe.a 2025-03-14T05:38:35.4929576Z inflating: build/lib/libgloo.a 2025-03-14T05:38:35.4970352Z inflating: build/lib/libonnx_proto.a 2025-03-14T05:38:35.5914713Z inflating: build/lib/libfbgemm.a 2025-03-14T05:38:35.6574296Z inflating: build/lib/libonnx.a 2025-03-14T05:38:36.8871952Z inflating: build/lib/libdnnl.a 2025-03-14T05:38:36.8887450Z inflating: build/lib/libfmt.a 2025-03-14T05:38:36.9120394Z inflating: build/lib/libkineto.a 2025-03-14T05:38:36.9215423Z inflating: build/lib/libc10.so 2025-03-14T05:38:36.9216283Z inflating: build/lib/libtorch_global_deps.so 2025-03-14T05:38:38.8963936Z inflating: build/lib/libtorch_cpu.so 2025-03-14T05:38:38.8964835Z inflating: build/lib/libtorch.so 2025-03-14T05:38:38.8967881Z inflating: build/lib/libunbox_lib.a 2025-03-14T05:38:38.8989537Z inflating: build/lib/libjitbackend_test.so 2025-03-14T05:38:38.9012971Z inflating: build/lib/libbackend_with_compiler.so 2025-03-14T05:38:38.9084749Z inflating: build/lib/libtorchbind_test.so 2025-03-14T05:38:38.9111030Z inflating: build/lib/libaoti_custom_ops.so 2025-03-14T05:38:38.9113508Z inflating: build/lib/libshm.so 2025-03-14T05:38:39.1024300Z inflating: build/lib/libtorch_python.so 2025-03-14T05:38:39.1059800Z inflating: build/lib/libnnapi_backend.so 2025-03-14T05:38:39.1060284Z creating: build/bin/ 2025-03-14T05:38:39.1060836Z creating: build/bin/CMakeFiles/ 2025-03-14T05:38:39.1061279Z inflating: build/bin/cmake_install.cmake 2025-03-14T05:38:39.1061670Z inflating: build/bin/CTestTestfile.cmake 2025-03-14T05:38:39.1411658Z inflating: build/bin/protoc-3.13.0.0 2025-03-14T05:38:39.1763330Z inflating: build/bin/protoc 2025-03-14T05:38:39.1809995Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2025-03-14T05:38:39.1859409Z inflating: build/bin/c10_DeviceGuard_test 2025-03-14T05:38:39.1909226Z inflating: build/bin/c10_Device_test 2025-03-14T05:38:39.1959779Z inflating: build/bin/c10_Scalar_test 2025-03-14T05:38:39.2006082Z inflating: build/bin/c10_StreamGuard_test 2025-03-14T05:38:39.2052822Z inflating: build/bin/c10_SymInt_test 2025-03-14T05:38:39.2108823Z inflating: build/bin/c10_DispatchKeySet_test 2025-03-14T05:38:39.2159436Z inflating: build/bin/c10_InlineDeviceGuard_test 2025-03-14T05:38:39.2211093Z inflating: build/bin/c10_InlineStreamGuard_test 2025-03-14T05:38:39.2264907Z inflating: build/bin/c10_SizesAndStrides_test 2025-03-14T05:38:39.2311880Z inflating: build/bin/c10_ConstexprCrc_test 2025-03-14T05:38:39.2357908Z inflating: build/bin/c10_DeadlockDetection_test 2025-03-14T05:38:39.2406607Z inflating: build/bin/c10_Bitset_test 2025-03-14T05:38:39.2469936Z inflating: build/bin/c10_cow_test 2025-03-14T05:38:39.2520114Z inflating: build/bin/c10_ArrayRef_test 2025-03-14T05:38:39.2566192Z inflating: build/bin/c10_Half_test 2025-03-14T05:38:39.2619566Z inflating: build/bin/c10_LeftRight_test 2025-03-14T05:38:39.2668131Z inflating: build/bin/c10_Metaprogramming_test 2025-03-14T05:38:39.2717422Z inflating: build/bin/c10_Synchronized_test 2025-03-14T05:38:39.2767795Z inflating: build/bin/c10_ThreadLocal_test 2025-03-14T05:38:39.2819618Z inflating: build/bin/c10_NetworkFlow_test 2025-03-14T05:38:39.2866984Z inflating: build/bin/c10_TypeList_test 2025-03-14T05:38:39.2916325Z inflating: build/bin/c10_TypeIndex_test 2025-03-14T05:38:39.2961921Z inflating: build/bin/c10_TypeTraits_test 2025-03-14T05:38:39.3008596Z inflating: build/bin/c10_bit_cast_test 2025-03-14T05:38:39.3061317Z inflating: build/bin/c10_bfloat16_test 2025-03-14T05:38:39.3110139Z inflating: build/bin/c10_accumulate_test 2025-03-14T05:38:39.3158925Z inflating: build/bin/c10_error_test 2025-03-14T05:38:39.3209914Z inflating: build/bin/c10_complex_math_test 2025-03-14T05:38:39.3259660Z inflating: build/bin/c10_exception_test 2025-03-14T05:38:39.3311439Z inflating: build/bin/c10_complex_test 2025-03-14T05:38:39.3359312Z inflating: build/bin/c10_flags_test 2025-03-14T05:38:39.3406314Z inflating: build/bin/c10_generic_math_test 2025-03-14T05:38:39.3451911Z inflating: build/bin/c10_irange_test 2025-03-14T05:38:39.3503089Z inflating: build/bin/c10_lazy_test 2025-03-14T05:38:39.3554969Z inflating: build/bin/c10_logging_test 2025-03-14T05:38:39.3604681Z inflating: build/bin/c10_registry_test 2025-03-14T05:38:39.3662663Z inflating: build/bin/c10_ordered_preserving_dict_test 2025-03-14T05:38:39.3711111Z inflating: build/bin/c10_ssize_test 2025-03-14T05:38:39.3759073Z inflating: build/bin/c10_string_util_test 2025-03-14T05:38:39.3805393Z inflating: build/bin/c10_string_view_test 2025-03-14T05:38:39.3876047Z inflating: build/bin/c10_optional_test 2025-03-14T05:38:39.3922961Z inflating: build/bin/c10_tempfile_test 2025-03-14T05:38:39.3961189Z inflating: build/bin/c10_intrusive_ptr_benchmark 2025-03-14T05:38:39.4009187Z inflating: build/bin/c10_typeid_test 2025-03-14T05:38:39.4143088Z inflating: build/bin/c10_intrusive_ptr_test 2025-03-14T05:38:39.4272869Z inflating: build/bin/c10_small_vector_test 2025-03-14T05:38:39.4647636Z inflating: build/bin/vec_test_all_types_DEFAULT 2025-03-14T05:38:39.5031839Z inflating: build/bin/vec_test_all_types_AVX512 2025-03-14T05:38:39.5429389Z inflating: build/bin/vec_test_all_types_AVX2 2025-03-14T05:38:39.5477578Z inflating: build/bin/static_runtime_bench 2025-03-14T05:38:39.5756335Z inflating: build/bin/static_runtime_test 2025-03-14T05:38:39.5822634Z inflating: build/bin/Dict_test 2025-03-14T05:38:39.5870388Z inflating: build/bin/Dimname_test 2025-03-14T05:38:39.5930730Z inflating: build/bin/MaybeOwned_test 2025-03-14T05:38:39.5984358Z inflating: build/bin/NamedTensor_test 2025-03-14T05:38:39.6038348Z inflating: build/bin/apply_utils_test 2025-03-14T05:38:39.6092893Z inflating: build/bin/atest 2025-03-14T05:38:39.6154562Z inflating: build/bin/basic 2025-03-14T05:38:39.6206156Z inflating: build/bin/broadcast_test 2025-03-14T05:38:39.6252031Z inflating: build/bin/cpu_allocator_test 2025-03-14T05:38:39.6307462Z inflating: build/bin/cpu_generator_test 2025-03-14T05:38:39.6357988Z inflating: build/bin/cpu_profiling_allocator_test 2025-03-14T05:38:39.6444060Z inflating: build/bin/cpu_rng_test 2025-03-14T05:38:39.6490065Z inflating: build/bin/dispatch_key_set_test 2025-03-14T05:38:39.6546404Z inflating: build/bin/extension_backend_test 2025-03-14T05:38:39.6594083Z inflating: build/bin/dlconvertor_test 2025-03-14T05:38:39.6642619Z inflating: build/bin/half_test 2025-03-14T05:38:39.6733498Z inflating: build/bin/ivalue_test 2025-03-14T05:38:39.6782660Z inflating: build/bin/lazy_tensor_test 2025-03-14T05:38:39.6832666Z inflating: build/bin/math_kernel_test 2025-03-14T05:38:39.6882451Z inflating: build/bin/memory_format_test 2025-03-14T05:38:39.6930992Z inflating: build/bin/memory_overlapping_test 2025-03-14T05:38:39.6981697Z inflating: build/bin/mobile_memory_cleanup 2025-03-14T05:38:39.7034102Z inflating: build/bin/native_test 2025-03-14T05:38:39.7082264Z inflating: build/bin/operator_name_test 2025-03-14T05:38:39.7127911Z inflating: build/bin/operators_test 2025-03-14T05:38:39.7177159Z inflating: build/bin/packedtensoraccessor_test 2025-03-14T05:38:39.7245409Z inflating: build/bin/pow_test 2025-03-14T05:38:39.7299640Z inflating: build/bin/quantized_test 2025-03-14T05:38:39.7346129Z inflating: build/bin/reduce_ops_test 2025-03-14T05:38:39.7394880Z inflating: build/bin/reportMemoryUsage_test 2025-03-14T05:38:39.7446240Z inflating: build/bin/scalar_tensor_test 2025-03-14T05:38:39.7501904Z inflating: build/bin/scalar_test 2025-03-14T05:38:39.7549355Z inflating: build/bin/StorageUtils_test 2025-03-14T05:38:39.7598078Z inflating: build/bin/stride_properties_test 2025-03-14T05:38:39.7673310Z inflating: build/bin/tensor_iterator_test 2025-03-14T05:38:39.7722726Z inflating: build/bin/test_parallel 2025-03-14T05:38:39.7724017Z inflating: build/bin/thread_init_test 2025-03-14T05:38:39.7772207Z inflating: build/bin/type_ptr_test 2025-03-14T05:38:39.7829920Z inflating: build/bin/type_test 2025-03-14T05:38:39.7880432Z inflating: build/bin/undefined_tensor_test 2025-03-14T05:38:39.7881122Z inflating: build/bin/verify_api_visibility 2025-03-14T05:38:39.7949330Z inflating: build/bin/legacy_vmap_test 2025-03-14T05:38:39.7998651Z inflating: build/bin/weakref_test 2025-03-14T05:38:39.8046459Z inflating: build/bin/wrapdim_test 2025-03-14T05:38:39.8095087Z inflating: build/bin/xla_tensor_test 2025-03-14T05:38:39.8152154Z inflating: build/bin/IListRef_test 2025-03-14T05:38:39.8246022Z inflating: build/bin/List_test 2025-03-14T05:38:39.8306647Z inflating: build/bin/KernelFunction_test 2025-03-14T05:38:39.8426731Z inflating: build/bin/kernel_function_legacy_test 2025-03-14T05:38:39.8516994Z inflating: build/bin/kernel_function_test 2025-03-14T05:38:39.8639211Z inflating: build/bin/kernel_lambda_legacy_test 2025-03-14T05:38:39.8736686Z inflating: build/bin/kernel_lambda_test 2025-03-14T05:38:39.8793779Z inflating: build/bin/kernel_stackbased_test 2025-03-14T05:38:39.8885957Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2025-03-14T05:38:39.8932513Z inflating: build/bin/CppSignature_test 2025-03-14T05:38:39.8986218Z inflating: build/bin/backend_fallback_test 2025-03-14T05:38:39.9030994Z inflating: build/bin/op_allowlist_test 2025-03-14T05:38:39.9088878Z inflating: build/bin/inline_container_test 2025-03-14T05:38:39.9140207Z inflating: build/bin/test_edge_op_registration 2025-03-14T05:38:39.9440308Z inflating: build/bin/op_registration_test 2025-03-14T05:38:39.9986697Z inflating: build/bin/test_jit 2025-03-14T05:38:40.0036217Z inflating: build/bin/BackoffTest 2025-03-14T05:38:40.0085305Z inflating: build/bin/HashStoreTest 2025-03-14T05:38:40.0134139Z inflating: build/bin/FileStoreTest 2025-03-14T05:38:40.0186207Z inflating: build/bin/TCPStoreTest 2025-03-14T05:38:40.0197309Z inflating: build/bin/tutorial_tensorexpr 2025-03-14T05:38:40.0204087Z inflating: build/bin/ProcessGroupMPITest 2025-03-14T05:38:40.0206768Z inflating: build/bin/example_allreduce 2025-03-14T05:38:40.0270033Z inflating: build/bin/ProcessGroupGlooTest 2025-03-14T05:38:40.0323238Z inflating: build/bin/test_dist_autograd 2025-03-14T05:38:40.0385573Z inflating: build/bin/test_cpp_rpc 2025-03-14T05:38:40.1241751Z inflating: build/bin/test_tensorexpr 2025-03-14T05:38:40.1242403Z inflating: build/bin/parallel_benchmark 2025-03-14T05:38:40.2476157Z inflating: build/bin/test_api 2025-03-14T05:38:40.2478320Z inflating: build/bin/torch_shm_manager 2025-03-14T05:38:40.2786488Z inflating: build/bin/test_lazy 2025-03-14T05:38:40.2786917Z creating: .additional_ci_files/ 2025-03-14T05:38:40.2886401Z inflating: .additional_ci_files/test-times.json 2025-03-14T05:38:40.3272836Z inflating: .additional_ci_files/test-class-times.json 2025-03-14T05:38:40.3474200Z ##[group]Run rm artifacts.zip 2025-03-14T05:38:40.3474529Z rm artifacts.zip 2025-03-14T05:38:40.3480249Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:40.3480659Z env: 2025-03-14T05:38:40.3480893Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:40.3481177Z ##[endgroup] 2025-03-14T05:38:40.3995495Z ##[group]Run df -H 2025-03-14T05:38:40.3995757Z df -H 2025-03-14T05:38:40.4000818Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:40.4001224Z env: 2025-03-14T05:38:40.4001461Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:40.4001745Z ##[endgroup] 2025-03-14T05:38:40.4040054Z Filesystem Size Used Avail Use% Mounted on 2025-03-14T05:38:40.4040566Z devtmpfs 4.2M 0 4.2M 0% /dev 2025-03-14T05:38:40.4041227Z tmpfs 50G 0 50G 0% /dev/shm 2025-03-14T05:38:40.4041633Z tmpfs 20G 652k 20G 1% /run 2025-03-14T05:38:40.4041989Z /dev/nvme0n1p1 215G 37G 179G 18% / 2025-03-14T05:38:40.4042421Z tmpfs 50G 29k 50G 1% /tmp 2025-03-14T05:38:40.4042828Z /dev/nvme0n1p128 11M 1.4M 9.2M 13% /boot/efi 2025-03-14T05:38:40.4076753Z Prepare all required actions 2025-03-14T05:38:40.4077606Z Getting action download info 2025-03-14T05:38:40.5370250Z ##[group]Run ./.github/actions/download-td-artifacts 2025-03-14T05:38:40.5370642Z with: 2025-03-14T05:38:40.5370875Z env: 2025-03-14T05:38:40.5371119Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:40.5371415Z ##[endgroup] 2025-03-14T05:38:40.5576792Z ##[group]Run seemethere/download-artifact-s3@v4 2025-03-14T05:38:40.5577173Z with: 2025-03-14T05:38:40.5577419Z name: td_results 2025-03-14T05:38:40.5577801Z s3-bucket: gha-artifacts 2025-03-14T05:38:40.5578097Z region: us-east-1 2025-03-14T05:38:40.5578353Z env: 2025-03-14T05:38:40.5578587Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:40.5578867Z ##[endgroup] 2025-03-14T05:38:40.9949876Z (node:300284) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2025-03-14T05:38:40.9950417Z 2025-03-14T05:38:40.9950727Z Please migrate your code to use AWS SDK for JavaScript (v3). 2025-03-14T05:38:40.9951299Z For more information, check the migration guide at https://a.co/7PzMCcy 2025-03-14T05:38:40.9951883Z (Use `node --trace-warnings ...` to show where the warning was created) 2025-03-14T05:38:41.0952579Z Found 1 objects with prefix pytorch/pytorch/13849515290/td_results/ 2025-03-14T05:38:41.0953372Z Starting download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2025-03-14T05:38:41.1712551Z Finished download (1/1): /home/ec2-user/actions-runner/_work/pytorch/pytorch/td_results.json 2025-03-14T05:38:41.1716064Z Artifact download has finished successfully 2025-03-14T05:38:41.2158043Z ##[group]Run mkdir -p .additional_ci_files 2025-03-14T05:38:41.2158425Z mkdir -p .additional_ci_files 2025-03-14T05:38:41.2158866Z mv td_results.json .additional_ci_files/td_results.json || true 2025-03-14T05:38:41.2165121Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:41.2165900Z env: 2025-03-14T05:38:41.2166245Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:41.2166538Z ##[endgroup] 2025-03-14T05:38:41.2739209Z ##[group]Run .github/scripts/parse_ref.py 2025-03-14T05:38:41.2739595Z .github/scripts/parse_ref.py 2025-03-14T05:38:41.2745416Z shell: /usr/bin/bash -e {0} 2025-03-14T05:38:41.2745708Z env: 2025-03-14T05:38:41.2745957Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:41.2746240Z ##[endgroup] 2025-03-14T05:38:41.3074551Z Prepare all required actions 2025-03-14T05:38:41.3074957Z Getting action download info 2025-03-14T05:38:41.4588079Z ##[group]Run ./.github/actions/filter-test-configs 2025-03-14T05:38:41.4588469Z with: 2025-03-14T05:38:41.4588935Z github-token: *** 2025-03-14T05:38:41.4589426Z test-matrix: {"include": [{"config": "xla", "shard": 1, "num_shards": 1, "runner": "lf.linux.12xlarge"}]} 2025-03-14T05:38:41.4590119Z job-name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:38:41.4590712Z env: 2025-03-14T05:38:41.4590957Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:41.4591245Z ##[endgroup] 2025-03-14T05:38:41.4807590Z ##[group]Run nick-fields/retry@v3.0.0 2025-03-14T05:38:41.4807935Z with: 2025-03-14T05:38:41.4808182Z shell: bash 2025-03-14T05:38:41.4808442Z timeout_minutes: 10 2025-03-14T05:38:41.4808720Z max_attempts: 5 2025-03-14T05:38:41.4808992Z retry_wait_seconds: 30 2025-03-14T05:38:41.4809903Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2025-03-14T05:38:41.4810788Z polling_interval_seconds: 1 2025-03-14T05:38:41.4811397Z warning_on_retry: true 2025-03-14T05:38:41.4811678Z continue_on_error: false 2025-03-14T05:38:41.4811953Z env: 2025-03-14T05:38:41.4812188Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:41.4812739Z GITHUB_TOKEN: *** 2025-03-14T05:38:41.4812991Z ##[endgroup] 2025-03-14T05:38:41.5744901Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.1 2025-03-14T05:38:41.7981805Z Defaulting to user installation because normal site-packages is not writeable 2025-03-14T05:38:41.8132009Z Requirement already satisfied: requests==2.27.1 in /home/ec2-user/.local/lib/python3.9/site-packages (2.27.1) 2025-03-14T05:38:41.8136155Z Requirement already satisfied: pyyaml==6.0.1 in /home/ec2-user/.local/lib/python3.9/site-packages (6.0.1) 2025-03-14T05:38:41.8246989Z Requirement already satisfied: charset-normalizer~=2.0.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2.0.12) 2025-03-14T05:38:41.8249318Z Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (1.25.10) 2025-03-14T05:38:41.8253158Z Requirement already satisfied: certifi>=2017.4.17 in /home/ec2-user/.local/lib/python3.9/site-packages (from requests==2.27.1) (2025.1.31) 2025-03-14T05:38:41.8263129Z Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3.9/site-packages (from requests==2.27.1) (2.10) 2025-03-14T05:38:42.5574572Z Command completed after 1 attempt(s). 2025-03-14T05:38:42.5845486Z ##[group]Run set -x 2025-03-14T05:38:42.5845807Z set -x 2025-03-14T05:38:42.5846072Z  2025-03-14T05:38:42.5846505Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-03-14T05:38:42.5847034Z # in runner workspace 2025-03-14T05:38:42.5847487Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2025-03-14T05:38:42.5854990Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:42.5855417Z env: 2025-03-14T05:38:42.5855683Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:42.5856005Z ##[endgroup] 2025-03-14T05:38:42.5884971Z + python3 /home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2025-03-14T05:38:42.6250678Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2025-03-14T05:38:42.6251131Z echo "Workflow: ${GITHUB_WORKFLOW}" 2025-03-14T05:38:42.6251510Z echo "Job name: ${JOB_NAME}" 2025-03-14T05:38:42.6251825Z  2025-03-14T05:38:42.6252244Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-03-14T05:38:42.6252762Z # in runner workspace 2025-03-14T05:38:42.6253225Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2025-03-14T05:38:42.6253950Z  --workflow "${GITHUB_WORKFLOW}" \ 2025-03-14T05:38:42.6254333Z  --job-name "${JOB_NAME}" \ 2025-03-14T05:38:42.6254914Z  --test-matrix "{"include": [{"config": "xla", "shard": 1, "num_shards": 1, "runner": "lf.linux.12xlarge"}]}" \ 2025-03-14T05:38:42.6255530Z  --selected-test-configs "" \ 2025-03-14T05:38:42.6255910Z  --pr-number "${PR_NUMBER}" \ 2025-03-14T05:38:42.6256268Z  --tag "${TAG}" \ 2025-03-14T05:38:42.6256598Z  --event-name "${EVENT_NAME}" \ 2025-03-14T05:38:42.6256959Z  --schedule "${SCHEDULE}" \ 2025-03-14T05:38:42.6257423Z  --branch "${HEAD_BRANCH}" 2025-03-14T05:38:42.6263000Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:42.6263404Z env: 2025-03-14T05:38:42.6263652Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:42.6264158Z GITHUB_TOKEN: *** 2025-03-14T05:38:42.6264576Z JOB_NAME: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:38:42.6265065Z PR_NUMBER: 2025-03-14T05:38:42.6265531Z TAG: 2025-03-14T05:38:42.6265955Z EVENT_NAME: push 2025-03-14T05:38:42.6266333Z SCHEDULE: 2025-03-14T05:38:42.6266589Z HEAD_BRANCH: 2025-03-14T05:38:42.6266884Z ##[endgroup] 2025-03-14T05:38:42.6290779Z Workflow: pull 2025-03-14T05:38:42.6291252Z Job name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:38:42.8895884Z ##[group]Run echo "Filtered matrix:" 2025-03-14T05:38:42.8896255Z echo "Filtered matrix:" 2025-03-14T05:38:42.8896778Z echo "{"include": [{"config": "xla", "shard": 1, "num_shards": 1, "runner": "lf.linux.12xlarge"}]}" 2025-03-14T05:38:42.8897301Z  2025-03-14T05:38:42.8897641Z echo 2025-03-14T05:38:42.8897928Z echo "Is the current job unstable? False" 2025-03-14T05:38:42.8898277Z  2025-03-14T05:38:42.8898494Z echo 2025-03-14T05:38:42.8898769Z echo "Is keep-going label set? False" 2025-03-14T05:38:42.8899105Z  2025-03-14T05:38:42.8899336Z echo 2025-03-14T05:38:42.8899587Z echo "Renabled issues? " 2025-03-14T05:38:42.8905864Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:42.8906301Z env: 2025-03-14T05:38:42.8906559Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:42.8906826Z ##[endgroup] 2025-03-14T05:38:42.8929598Z Filtered matrix: 2025-03-14T05:38:42.8930037Z {include: [{config: xla, shard: 1, num_shards: 1, runner: lf.linux.12xlarge}]} 2025-03-14T05:38:42.8930397Z 2025-03-14T05:38:42.8930610Z Is the current job unstable? False 2025-03-14T05:38:42.8930843Z 2025-03-14T05:38:42.8930979Z Is keep-going label set? False 2025-03-14T05:38:42.8931180Z 2025-03-14T05:38:42.8931293Z Renabled issues? 2025-03-14T05:38:42.9015162Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2025-03-14T05:38:42.9015713Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2025-03-14T05:38:42.9021033Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T05:38:42.9021439Z env: 2025-03-14T05:38:42.9021681Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:42.9021967Z JOB_TIMEOUT: 240 2025-03-14T05:38:42.9022216Z ##[endgroup] 2025-03-14T05:38:42.9166318Z ##[group]Run set -x 2025-03-14T05:38:42.9166708Z set -x 2025-03-14T05:38:42.9166954Z  2025-03-14T05:38:42.9167217Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2025-03-14T05:38:42.9167638Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2025-03-14T05:38:42.9168063Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2025-03-14T05:38:42.9168454Z  TEST_COMMAND=.ci/onnx/test.sh 2025-03-14T05:38:42.9168780Z else 2025-03-14T05:38:42.9169054Z  TEST_COMMAND=.ci/pytorch/test.sh 2025-03-14T05:38:42.9169384Z fi 2025-03-14T05:38:42.9169610Z  2025-03-14T05:38:42.9169895Z # Leaving 1GB for the runner and other things 2025-03-14T05:38:42.9170505Z TOTAL_AVAILABLE_MEMORY_IN_GB=$(awk '/MemTotal/ { printf "%.3f \n", $2/1024/1024 - 1 }' /proc/meminfo) 2025-03-14T05:38:42.9171422Z # https://docs.docker.com/engine/containers/resource_constraints/#--memory-swap-details, the 3GB swap 2025-03-14T05:38:42.9172164Z # comes from https://github.com/pytorch/test-infra/pull/6058 2025-03-14T05:38:42.9172732Z TOTAL_MEMORY_WITH_SWAP=$(("${TOTAL_AVAILABLE_MEMORY_IN_GB%.*}" + 3)) 2025-03-14T05:38:42.9173178Z  2025-03-14T05:38:42.9173465Z if [[ ${BUILD_ENVIRONMENT} == *"s390x"* ]]; then 2025-03-14T05:38:42.9173832Z  SHM_OPTS= 2025-03-14T05:38:42.9174103Z  JENKINS_USER= 2025-03-14T05:38:42.9174478Z  # ensure that docker container cleanly exits in 12 hours 2025-03-14T05:38:42.9174975Z  # if for some reason cleanup action doesn't stop container 2025-03-14T05:38:42.9175402Z  # when job is cancelled 2025-03-14T05:38:42.9175735Z  DOCKER_SHELL_CMD="sleep 12h" 2025-03-14T05:38:42.9176049Z  2025-03-14T05:38:42.9176437Z  # since some steps are skipped on s390x, if they are necessary, run them here 2025-03-14T05:38:42.9177018Z  env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T05:38:42.9177627Z  env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-03-14T05:38:42.9178011Z else 2025-03-14T05:38:42.9178288Z  SHM_OPTS="--shm-size=${SHM_SIZE}" 2025-03-14T05:38:42.9178657Z  JENKINS_USER="--user jenkins" 2025-03-14T05:38:42.9178991Z  DOCKER_SHELL_CMD= 2025-03-14T05:38:42.9179389Z fi 2025-03-14T05:38:42.9179611Z  2025-03-14T05:38:42.9179960Z # detached container should get cleaned up by teardown_ec2_linux 2025-03-14T05:38:42.9180511Z # TODO: Stop building test binaries as part of the build phase 2025-03-14T05:38:42.9181136Z # Used for GPU_FLAG, SHM_OPTS, JENKINS_USER and DOCKER_SHELL_CMD since that doesn't play nice 2025-03-14T05:38:42.9181682Z # shellcheck disable=SC2086,SC2090 2025-03-14T05:38:42.9182027Z container_name=$(docker run \ 2025-03-14T05:38:42.9182340Z  ${GPU_FLAG:-} \ 2025-03-14T05:38:42.9182651Z  ${SCCACHE_SERVER_PORT_DOCKER_FLAG:-} \ 2025-03-14T05:38:42.9183004Z  -e BUILD_ENVIRONMENT \ 2025-03-14T05:38:42.9183298Z  -e PR_NUMBER \ 2025-03-14T05:38:42.9183575Z  -e GITHUB_ACTIONS \ 2025-03-14T05:38:42.9183860Z  -e GITHUB_REPOSITORY \ 2025-03-14T05:38:42.9184175Z  -e GITHUB_WORKFLOW \ 2025-03-14T05:38:42.9184476Z  -e GITHUB_JOB \ 2025-03-14T05:38:42.9184760Z  -e GITHUB_RUN_ID \ 2025-03-14T05:38:42.9185057Z  -e GITHUB_RUN_NUMBER \ 2025-03-14T05:38:42.9185467Z  -e GITHUB_RUN_ATTEMPT \ 2025-03-14T05:38:42.9185759Z  -e JOB_ID \ 2025-03-14T05:38:42.9186015Z  -e JOB_NAME \ 2025-03-14T05:38:42.9186277Z  -e BASE_SHA \ 2025-03-14T05:38:42.9186533Z  -e BRANCH \ 2025-03-14T05:38:42.9186784Z  -e SHA1 \ 2025-03-14T05:38:42.9187038Z  -e AWS_DEFAULT_REGION \ 2025-03-14T05:38:42.9187429Z  -e IN_WHEEL_TEST \ 2025-03-14T05:38:42.9187714Z  -e SHARD_NUMBER \ 2025-03-14T05:38:42.9187996Z  -e TEST_CONFIG \ 2025-03-14T05:38:42.9188444Z  -e NUM_TEST_SHARDS \ 2025-03-14T05:38:42.9188824Z  -e REENABLED_ISSUES \ 2025-03-14T05:38:42.9189147Z  -e CONTINUE_THROUGH_ERROR \ 2025-03-14T05:38:42.9189467Z  -e VERBOSE_TEST_LOGS \ 2025-03-14T05:38:42.9189780Z  -e TEST_SHOWLOCALS \ 2025-03-14T05:38:42.9190084Z  -e NO_TEST_TIMEOUT \ 2025-03-14T05:38:42.9190374Z  -e NO_TD \ 2025-03-14T05:38:42.9190643Z  -e TD_DISTRIBUTED \ 2025-03-14T05:38:42.9190938Z  -e PR_LABELS \ 2025-03-14T05:38:42.9191252Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2025-03-14T05:38:42.9191600Z  -e SCCACHE_BUCKET \ 2025-03-14T05:38:42.9191896Z  -e SCCACHE_REGION \ 2025-03-14T05:38:42.9192187Z  -e XLA_CUDA \ 2025-03-14T05:38:42.9192493Z  -e XLA_CLANG_CACHE_S3_BUCKET_NAME \ 2025-03-14T05:38:42.9192874Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2025-03-14T05:38:42.9193268Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2025-03-14T05:38:42.9193655Z  -e SKIP_SCCACHE_INITIALIZATION=1 \ 2025-03-14T05:38:42.9194013Z  -e HUGGING_FACE_HUB_TOKEN \ 2025-03-14T05:38:42.9194359Z  -e SCRIBE_GRAPHQL_ACCESS_TOKEN \ 2025-03-14T05:38:42.9194698Z  -e DASHBOARD_TAG \ 2025-03-14T05:38:42.9194992Z  -e IS_A100_RUNNER \ 2025-03-14T05:38:42.9195301Z  -e ARTIFACTS_FILE_SUFFIX \ 2025-03-14T05:38:42.9195679Z  --memory="${TOTAL_AVAILABLE_MEMORY_IN_GB%.*}g" \ 2025-03-14T05:38:42.9196103Z  --memory-swap="${TOTAL_MEMORY_WITH_SWAP}g" \ 2025-03-14T05:38:42.9196531Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2025-03-14T05:38:42.9196940Z  --security-opt seccomp=unconfined \ 2025-03-14T05:38:42.9197298Z  --cap-add=SYS_PTRACE \ 2025-03-14T05:38:42.9197611Z  --ipc=host \ 2025-03-14T05:38:42.9197883Z  ${SHM_OPTS} \ 2025-03-14T05:38:42.9198227Z  --tty \ 2025-03-14T05:38:42.9198482Z  --detach \ 2025-03-14T05:38:42.9198762Z  --name="${container_name}" \ 2025-03-14T05:38:42.9199094Z  ${JENKINS_USER} \ 2025-03-14T05:38:42.9199456Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2025-03-14T05:38:42.9199870Z  -w /var/lib/jenkins/workspace \ 2025-03-14T05:38:42.9200207Z  "${DOCKER_IMAGE}" \ 2025-03-14T05:38:42.9200502Z  ${DOCKER_SHELL_CMD} 2025-03-14T05:38:42.9200782Z ) 2025-03-14T05:38:42.9201087Z # Propagate download.pytorch.org IP to container 2025-03-14T05:38:42.9201874Z grep download.pytorch.org /etc/hosts | docker exec -i "${container_name}" sudo bash -c "/bin/cat >> /etc/hosts" 2025-03-14T05:38:42.9202567Z echo "DOCKER_CONTAINER_ID=${container_name}" >> "${GITHUB_ENV}" 2025-03-14T05:38:42.9202973Z  2025-03-14T05:38:42.9203243Z if [[ ${BUILD_ENVIRONMENT} == *"s390x"* ]]; then 2025-03-14T05:38:42.9203815Z  docker exec -t "${container_name}" sh -c "python3 -m pip install -r .ci/docker/requirements-ci.txt" 2025-03-14T05:38:42.9204318Z fi 2025-03-14T05:38:42.9204541Z  2025-03-14T05:38:42.9205304Z docker exec -t "${container_name}" sh -c "python3 -m pip install $(echo dist/*.whl)[opt-einsum] && ${TEST_COMMAND}" 2025-03-14T05:38:42.9210759Z shell: /usr/bin/bash -e {0} 2025-03-14T05:38:42.9211060Z env: 2025-03-14T05:38:42.9211300Z GIT_DEFAULT_BRANCH: main 2025-03-14T05:38:42.9211653Z BUILD_ENVIRONMENT: linux-focal-py3.9-clang9-xla 2025-03-14T05:38:42.9212029Z PR_NUMBER: 2025-03-14T05:38:42.9212298Z GITHUB_REPOSITORY: pytorch/pytorch 2025-03-14T05:38:42.9212635Z GITHUB_WORKFLOW: pull 2025-03-14T05:38:42.9212913Z GITHUB_JOB: test 2025-03-14T05:38:42.9213177Z GITHUB_RUN_ID: 13849515290 2025-03-14T05:38:42.9213576Z GITHUB_RUN_NUMBER: 299021 2025-03-14T05:38:42.9213856Z GITHUB_RUN_ATTEMPT: 1 2025-03-14T05:38:42.9214138Z JOB_ID: 38757034389 2025-03-14T05:38:42.9214553Z JOB_NAME: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:38:42.9215022Z BRANCH: main 2025-03-14T05:38:42.9215308Z SHA1: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:38:42.9215709Z BASE_SHA: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:38:42.9216075Z TEST_CONFIG: xla 2025-03-14T05:38:42.9216332Z SHARD_NUMBER: 1 2025-03-14T05:38:42.9216582Z NUM_TEST_SHARDS: 1 2025-03-14T05:38:42.9216844Z REENABLED_ISSUES: 2025-03-14T05:38:42.9217116Z CONTINUE_THROUGH_ERROR: False 2025-03-14T05:38:42.9217519Z VERBOSE_TEST_LOGS: False 2025-03-14T05:38:42.9217786Z TEST_SHOWLOCALS: False 2025-03-14T05:38:42.9218049Z NO_TEST_TIMEOUT: False 2025-03-14T05:38:42.9218303Z NO_TD: False 2025-03-14T05:38:42.9218529Z TD_DISTRIBUTED: False 2025-03-14T05:38:42.9218835Z SCCACHE_BUCKET: ossci-compiler-cache-circleci-v2 2025-03-14T05:38:42.9219184Z SCCACHE_REGION: us-east-1 2025-03-14T05:38:42.9219449Z SHM_SIZE: 1g 2025-03-14T05:38:42.9219849Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:38:42.9220326Z XLA_CUDA: 0 2025-03-14T05:38:42.9220683Z XLA_CLANG_CACHE_S3_BUCKET_NAME: ossci-compiler-clang-cache-circleci-xla 2025-03-14T05:38:42.9221135Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2025-03-14T05:38:42.9221458Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 0 2025-03-14T05:38:42.9221757Z DASHBOARD_TAG: 2025-03-14T05:38:42.9222167Z HUGGING_FACE_HUB_TOKEN: *** 2025-03-14T05:38:42.9222575Z SCRIBE_GRAPHQL_ACCESS_TOKEN: *** 2025-03-14T05:38:42.9222868Z IS_A100_RUNNER: 0 2025-03-14T05:38:42.9223211Z ARTIFACTS_FILE_SUFFIX: test-xla-1-1-lf.linux.12xlarge_38757034389 2025-03-14T05:38:42.9223611Z ##[endgroup] 2025-03-14T05:38:42.9245559Z + [[ xla == \m\u\l\t\i\g\p\u ]] 2025-03-14T05:38:42.9246114Z + [[ linux-focal-py3.9-clang9-xla == *onnx* ]] 2025-03-14T05:38:42.9246515Z + TEST_COMMAND=.ci/pytorch/test.sh 2025-03-14T05:38:42.9248465Z ++ awk '/MemTotal/ { printf "%.3f \n", $2/1024/1024 - 1 }' /proc/meminfo 2025-03-14T05:38:42.9266800Z + TOTAL_AVAILABLE_MEMORY_IN_GB='91.276 ' 2025-03-14T05:38:42.9267167Z + TOTAL_MEMORY_WITH_SWAP=94 2025-03-14T05:38:42.9267514Z + [[ linux-focal-py3.9-clang9-xla == *\s\3\9\0\x* ]] 2025-03-14T05:38:42.9267890Z + SHM_OPTS=--shm-size=1g 2025-03-14T05:38:42.9268186Z + JENKINS_USER='--user jenkins' 2025-03-14T05:38:42.9268482Z + DOCKER_SHELL_CMD= 2025-03-14T05:38:42.9274824Z +++ nproc --ignore=2 2025-03-14T05:38:42.9292264Z ++ docker run -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e TD_DISTRIBUTED -e PR_LABELS -e MAX_JOBS=46 -e SCCACHE_BUCKET -e SCCACHE_REGION -e XLA_CUDA -e XLA_CLANG_CACHE_S3_BUCKET_NAME -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e SKIP_SCCACHE_INITIALIZATION=1 -e HUGGING_FACE_HUB_TOKEN -e SCRIBE_GRAPHQL_ACCESS_TOKEN -e DASHBOARD_TAG -e IS_A100_RUNNER -e ARTIFACTS_FILE_SUFFIX --memory=91g --memory-swap=94g --env-file=/tmp/github_env_13849515290 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --ipc=host --shm-size=1g --tty --detach --name= --user jenkins -v /home/ec2-user/actions-runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T05:39:36.2923270Z + container_name=009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T05:39:36.2925692Z + grep download.pytorch.org /etc/hosts 2025-03-14T05:39:36.2927830Z + docker exec -i 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 sudo bash -c '/bin/cat >> /etc/hosts' 2025-03-14T05:39:36.4895792Z + echo DOCKER_CONTAINER_ID=009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T05:39:36.4896502Z + [[ linux-focal-py3.9-clang9-xla == *\s\3\9\0\x* ]] 2025-03-14T05:39:36.4899520Z ++ echo dist/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl 2025-03-14T05:39:36.4901724Z + docker exec -t 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 sh -c 'python3 -m pip install dist/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl[opt-einsum] && .ci/pytorch/test.sh' 2025-03-14T05:39:36.9047213Z Processing ./dist/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl (from torch==2.8.0a0+gitaed0b7a) 2025-03-14T05:39:37.3611334Z Collecting filelock (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) 2025-03-14T05:39:37.4007292Z Downloading filelock-3.17.0-py3-none-any.whl.metadata (2.9 kB) 2025-03-14T05:39:37.4091991Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/lib/python3.10/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (4.12.2) 2025-03-14T05:39:37.4094927Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/lib/python3.10/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (1.13.3) 2025-03-14T05:39:37.4097762Z Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (3.4.2) 2025-03-14T05:39:37.4251313Z Collecting jinja2 (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) 2025-03-14T05:39:37.4287229Z Downloading jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB) 2025-03-14T05:39:37.4547543Z Collecting fsspec (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) 2025-03-14T05:39:37.4588123Z Downloading fsspec-2025.3.0-py3-none-any.whl.metadata (11 kB) 2025-03-14T05:39:37.5070827Z Collecting opt-einsum>=3.3 (from torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) 2025-03-14T05:39:37.5109472Z Downloading opt_einsum-3.4.0-py3-none-any.whl.metadata (6.3 kB) 2025-03-14T05:39:37.5195625Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy>=1.13.3->torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) (1.3.0) 2025-03-14T05:39:37.5650552Z Collecting MarkupSafe>=2.0 (from jinja2->torch==2.8.0a0+gitaed0b7a->torch==2.8.0a0+gitaed0b7a) 2025-03-14T05:39:37.5686758Z Downloading MarkupSafe-3.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB) 2025-03-14T05:39:37.5869325Z Downloading opt_einsum-3.4.0-py3-none-any.whl (71 kB) 2025-03-14T05:39:37.6027961Z Downloading filelock-3.17.0-py3-none-any.whl (16 kB) 2025-03-14T05:39:37.6127381Z Downloading fsspec-2025.3.0-py3-none-any.whl (193 kB) 2025-03-14T05:39:37.6295611Z Downloading jinja2-3.1.6-py3-none-any.whl (134 kB) 2025-03-14T05:39:37.6414617Z Downloading MarkupSafe-3.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (20 kB) 2025-03-14T05:39:37.9028867Z Installing collected packages: opt-einsum, MarkupSafe, fsspec, filelock, jinja2, torch 2025-03-14T05:39:45.5371283Z Successfully installed MarkupSafe-3.0.2 filelock-3.17.0 fsspec-2025.3.0 jinja2-3.1.6 opt-einsum-3.4.0 torch-2.8.0a0+gitaed0b7a 2025-03-14T05:39:45.6204170Z + export TERM=vt100 2025-03-14T05:39:45.6204507Z + TERM=vt100 2025-03-14T05:39:45.6204936Z ++ dirname .ci/pytorch/test.sh 2025-03-14T05:39:45.6216706Z + source .ci/pytorch/common.sh 2025-03-14T05:39:45.6217075Z +++ dirname .ci/pytorch/common.sh 2025-03-14T05:39:45.6224629Z ++ source .ci/pytorch/common_utils.sh 2025-03-14T05:39:45.6225896Z +++ declare -f -t trap_add 2025-03-14T05:39:45.6229702Z ++ set -ex -o pipefail 2025-03-14T05:39:45.6230023Z ++ [[ linux-focal-py3.9-clang9-xla == *rocm* ]] 2025-03-14T05:39:45.6230392Z ++ BUILD_TEST_LIBTORCH=0 2025-03-14T05:39:45.6230706Z + [[ linux-focal-py3.9-clang9-xla != *rocm* ]] 2025-03-14T05:39:45.6231106Z + [[ linux-focal-py3.9-clang9-xla != *s390x* ]] 2025-03-14T05:39:45.6231487Z + [[ -d /var/lib/jenkins/workspace ]] 2025-03-14T05:39:45.6234192Z ++ stat -c %u /var/lib/jenkins/workspace 2025-03-14T05:39:45.6250212Z + WORKSPACE_ORIGINAL_OWNER_ID=1000 2025-03-14T05:39:45.6250606Z + trap_add cleanup_workspace EXIT 2025-03-14T05:39:45.6250945Z + trap_add_cmd=cleanup_workspace 2025-03-14T05:39:45.6251250Z + shift 2025-03-14T05:39:45.6251489Z + for trap_add_name in "$@" 2025-03-14T05:39:45.6256237Z +++ trap -p EXIT 2025-03-14T05:39:45.6259021Z ++ eval 'extract_trap_cmd ' 2025-03-14T05:39:45.6259316Z +++ extract_trap_cmd 2025-03-14T05:39:45.6259580Z +++ printf '%s\n' '' 2025-03-14T05:39:45.6259947Z ++ printf '%s\n' cleanup_workspace 2025-03-14T05:39:45.6261462Z + trap -- ' 2025-03-14T05:39:45.6261707Z cleanup_workspace' EXIT 2025-03-14T05:39:45.6262046Z + sudo chown -R jenkins /var/lib/jenkins/workspace 2025-03-14T05:39:46.1168243Z + git config --global --add safe.directory /var/lib/jenkins/workspace 2025-03-14T05:39:46.1188985Z + echo 'Environment variables:' 2025-03-14T05:39:46.1189433Z Environment variables: 2025-03-14T05:39:46.1189793Z + env 2025-03-14T05:39:46.1196149Z NVIDIA_VISIBLE_DEVICES=all 2025-03-14T05:39:46.1196605Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-03-14T05:39:46.1197251Z PYTHON_SHA256=bfb249609990220491a1b92850a07135ed0831e41738cf681d63cf01b2a8fbd1 2025-03-14T05:39:46.1197762Z TF_CUDA_COMPUTE_CAPABILITIES=5.2,7.5 2025-03-14T05:39:46.1198105Z CONTINUE_THROUGH_ERROR=False 2025-03-14T05:39:46.1198427Z TAGS=bazel,configure_env,install_deps 2025-03-14T05:39:46.1198814Z BUILD_ENVIRONMENT=linux-focal-py3.9-clang9-xla 2025-03-14T05:39:46.1199178Z HOSTNAME=009676804ee5 2025-03-14T05:39:46.1199447Z PYTHON_VERSION=3.10.16 2025-03-14T05:39:46.1200052Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1200708Z GITHUB_ACTION=__self 2025-03-14T05:39:46.1200993Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2025-03-14T05:39:46.1201318Z GITHUB_RUN_NUMBER=299021 2025-03-14T05:39:46.1201584Z TEST_CONFIG=xla 2025-03-14T05:39:46.1201858Z GITHUB_REPOSITORY_OWNER_ID=21003710 2025-03-14T05:39:46.1202207Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2025-03-14T05:39:46.1202779Z IS_A100_RUNNER=0 2025-03-14T05:39:46.1203288Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2025-03-14T05:39:46.1203672Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2025-03-14T05:39:46.1204000Z GITHUB_REF_TYPE=branch 2025-03-14T05:39:46.1204284Z TORCH_CUDA_ARCH_LIST=Maxwell 2025-03-14T05:39:46.1204728Z BASE_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:39:46.1205083Z XLA_CUDA=0 2025-03-14T05:39:46.1205440Z HUGGING_FACE_HUB_TOKEN=*** 2025-03-14T05:39:46.1208347Z *** 2025-03-14T05:39:46.1208594Z GITHUB_REPOSITORY_ID=65600975 2025-03-14T05:39:46.1208898Z GITHUB_ACTIONS=true 2025-03-14T05:39:46.1209192Z NVIDIA_DRIVER_CAPABILITIES=compute,utility 2025-03-14T05:39:46.1209576Z SHA1=aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:39:46.1209970Z GITHUB_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:39:46.1210505Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/main 2025-03-14T05:39:46.1211000Z CXX=clang++ 2025-03-14T05:39:46.1211252Z VERBOSE_TEST_LOGS=False 2025-03-14T05:39:46.1211517Z USE_CUDA=0 2025-03-14T05:39:46.1211765Z GITHUB_REF=refs/heads/main 2025-03-14T05:39:46.1212050Z SHARD_NUMBER=1 2025-03-14T05:39:46.1212312Z GITHUB_REF_PROTECTED=true 2025-03-14T05:39:46.1212578Z HOME=/home/jenkins 2025-03-14T05:39:46.1212864Z GITHUB_API_URL=https://api.github.com 2025-03-14T05:39:46.1213217Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2025-03-14T05:39:46.1213534Z LANG=C.UTF-8 2025-03-14T05:39:46.1213774Z CARGO_HOME=/opt/cargo 2025-03-14T05:39:46.1214063Z OPENSSL_INCLUDE_DIR=/usr/include/openssl 2025-03-14T05:39:46.1214398Z NUM_TEST_SHARDS=1 2025-03-14T05:39:46.1214998Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1215711Z GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D 2025-03-14T05:39:46.1216217Z JOB_NAME=linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:39:46.1217176Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1218032Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2025-03-14T05:39:46.1218565Z GITHUB_EVENT_NAME=push 2025-03-14T05:39:46.1218842Z DASHBOARD_TAG= 2025-03-14T05:39:46.1219099Z GITHUB_RUN_ID=13849515290 2025-03-14T05:39:46.1219763Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1220484Z GITHUB_ACTOR=pytorchmergebot 2025-03-14T05:39:46.1220780Z PR_NUMBER= 2025-03-14T05:39:46.1221023Z GITHUB_RUN_ATTEMPT=1 2025-03-14T05:39:46.1221357Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2025-03-14T05:39:46.1221718Z TERM=vt100 2025-03-14T05:39:46.1221951Z BRANCH=main 2025-03-14T05:39:46.1222196Z RUSTUP_HOME=/opt/rustup 2025-03-14T05:39:46.1222483Z SCCACHE_REGION=us-east-1 2025-03-14T05:39:46.1222781Z CUDA_PATH=/usr/local/cuda 2025-03-14T05:39:46.1223334Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2025-03-14T05:39:46.1223953Z GITHUB_SERVER_URL=https://github.com 2025-03-14T05:39:46.1224289Z REENABLED_ISSUES= 2025-03-14T05:39:46.1224542Z SHLVL=1 2025-03-14T05:39:46.1224771Z MAX_JOBS=46 2025-03-14T05:39:46.1225012Z GITHUB_ACTOR_ID=97764156 2025-03-14T05:39:46.1225376Z GITHUB_WORKFLOW_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:39:46.1225779Z GITHUB_REF_NAME=main 2025-03-14T05:39:46.1226184Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2025-03-14T05:39:46.1226635Z GITHUB_JOB=test 2025-03-14T05:39:46.1227111Z LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64: 2025-03-14T05:39:46.1227668Z NO_TEST_TIMEOUT=False 2025-03-14T05:39:46.1227935Z TD_DISTRIBUTED=False 2025-03-14T05:39:46.1228239Z TF_CUDA_PATHS=/usr/local/cuda,/usr/include,/usr 2025-03-14T05:39:46.1228621Z GITHUB_REPOSITORY=pytorch/pytorch 2025-03-14T05:39:46.1228945Z GITHUB_RETENTION_DAYS=90 2025-03-14T05:39:46.1229418Z GITHUB_ACTION_REPOSITORY= 2025-03-14T05:39:46.1230221Z PATH=/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-03-14T05:39:46.1230995Z GITHUB_BASE_REF= 2025-03-14T05:39:46.1231239Z CC=clang 2025-03-14T05:39:46.1231581Z ARTIFACTS_FILE_SUFFIX=test-xla-1-1-lf.linux.12xlarge_38757034389 2025-03-14T05:39:46.1232004Z CI=true 2025-03-14T05:39:46.1232254Z OPENSSL_LIB_DIR=/usr/lib/x86_64-linux-gnu 2025-03-14T05:39:46.1232608Z GITHUB_REPOSITORY_OWNER=pytorch 2025-03-14T05:39:46.1232908Z JOB_ID=38757034389 2025-03-14T05:39:46.1233154Z GITHUB_HEAD_REF= 2025-03-14T05:39:46.1233404Z GITHUB_ACTION_REF= 2025-03-14T05:39:46.1233705Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2025-03-14T05:39:46.1234079Z TEST_SHOWLOCALS=False 2025-03-14T05:39:46.1234352Z GITHUB_WORKFLOW=pull 2025-03-14T05:39:46.1234979Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1235650Z NO_TD=False 2025-03-14T05:39:46.1235901Z SKIP_SCCACHE_INITIALIZATION=1 2025-03-14T05:39:46.1236200Z TPUVM_MODE= 2025-03-14T05:39:46.1236428Z _=/usr/bin/env 2025-03-14T05:39:46.1236768Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2025-03-14T05:39:46.1362706Z + TORCH_INSTALL_DIR=/opt/conda/lib/python3.10/site-packages/torch 2025-03-14T05:39:46.1363444Z + TORCH_BIN_DIR=/opt/conda/lib/python3.10/site-packages/torch/bin 2025-03-14T05:39:46.1363972Z + TORCH_LIB_DIR=/opt/conda/lib/python3.10/site-packages/torch/lib 2025-03-14T05:39:46.1364503Z + TORCH_TEST_DIR=/opt/conda/lib/python3.10/site-packages/torch/test 2025-03-14T05:39:46.1365095Z + BUILD_DIR=build 2025-03-14T05:39:46.1365542Z + BUILD_RENAMED_DIR=build_renamed 2025-03-14T05:39:46.1365866Z + BUILD_BIN_DIR=build/bin 2025-03-14T05:39:46.1366147Z + SHARD_NUMBER=1 2025-03-14T05:39:46.1366584Z + NUM_TEST_SHARDS=1 2025-03-14T05:39:46.1366873Z + export TORCH_SERIALIZATION_DEBUG=1 2025-03-14T05:39:46.1367207Z + TORCH_SERIALIZATION_DEBUG=1 2025-03-14T05:39:46.1367510Z + export VALGRIND=ON 2025-03-14T05:39:46.1367772Z + VALGRIND=ON 2025-03-14T05:39:46.1368058Z + [[ linux-focal-py3.9-clang9-xla == *clang9* ]] 2025-03-14T05:39:46.1368420Z + export VALGRIND=OFF 2025-03-14T05:39:46.1368684Z + VALGRIND=OFF 2025-03-14T05:39:46.1368977Z + [[ linux-focal-py3.9-clang9-xla == *s390x* ]] 2025-03-14T05:39:46.1369319Z + [[ 0 == \1 ]] 2025-03-14T05:39:46.1369556Z + [[ False == \1 ]] 2025-03-14T05:39:46.1369846Z + [[ linux-focal-py3.9-clang9-xla != *bazel* ]] 2025-03-14T05:39:46.1370221Z ++ realpath build/custom_test_artifacts 2025-03-14T05:39:46.1375468Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/workspace/build/custom_test_artifacts 2025-03-14T05:39:46.1375991Z + [[ -n '' ]] 2025-03-14T05:39:46.1376251Z + echo 'Environment variables' 2025-03-14T05:39:46.1376559Z Environment variables 2025-03-14T05:39:46.1376819Z + env 2025-03-14T05:39:46.1384003Z NVIDIA_VISIBLE_DEVICES=all 2025-03-14T05:39:46.1384445Z GITHUB_WORKSPACE=/home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-03-14T05:39:46.1385066Z PYTHON_SHA256=bfb249609990220491a1b92850a07135ed0831e41738cf681d63cf01b2a8fbd1 2025-03-14T05:39:46.1385576Z TF_CUDA_COMPUTE_CAPABILITIES=5.2,7.5 2025-03-14T05:39:46.1385900Z CONTINUE_THROUGH_ERROR=False 2025-03-14T05:39:46.1386222Z TAGS=bazel,configure_env,install_deps 2025-03-14T05:39:46.1386603Z BUILD_ENVIRONMENT=linux-focal-py3.9-clang9-xla 2025-03-14T05:39:46.1386981Z HOSTNAME=009676804ee5 2025-03-14T05:39:46.1387250Z PYTHON_VERSION=3.10.16 2025-03-14T05:39:46.1387863Z GITHUB_PATH=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/add_path_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1388525Z GITHUB_ACTION=__self 2025-03-14T05:39:46.1388814Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2025-03-14T05:39:46.1389141Z GITHUB_RUN_NUMBER=299021 2025-03-14T05:39:46.1389425Z TEST_CONFIG=xla 2025-03-14T05:39:46.1389702Z GITHUB_REPOSITORY_OWNER_ID=21003710 2025-03-14T05:39:46.1390055Z TORCH_NVCC_FLAGS=-Xfatbin -compress-all 2025-03-14T05:39:46.1390507Z IS_A100_RUNNER=0 2025-03-14T05:39:46.1390977Z SCRIBE_GRAPHQL_ACCESS_TOKEN=*** 2025-03-14T05:39:46.1391314Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2025-03-14T05:39:46.1391656Z GITHUB_REF_TYPE=branch 2025-03-14T05:39:46.1391942Z TORCH_CUDA_ARCH_LIST=Maxwell 2025-03-14T05:39:46.1392281Z BASE_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:39:46.1392624Z XLA_CUDA=0 2025-03-14T05:39:46.1393002Z HUGGING_FACE_HUB_TOKEN=*** 2025-03-14T05:39:46.1393390Z *** 2025-03-14T05:39:46.1393617Z GITHUB_REPOSITORY_ID=65600975 2025-03-14T05:39:46.1393922Z GITHUB_ACTIONS=true 2025-03-14T05:39:46.1394218Z NVIDIA_DRIVER_CAPABILITIES=compute,utility 2025-03-14T05:39:46.1394606Z SHA1=aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:39:46.1394999Z GITHUB_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:39:46.1395578Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/pull.yml@refs/heads/main 2025-03-14T05:39:46.1396061Z CXX=clang++ 2025-03-14T05:39:46.1396313Z TORCH_SERIALIZATION_DEBUG=1 2025-03-14T05:39:46.1396607Z VERBOSE_TEST_LOGS=False 2025-03-14T05:39:46.1396871Z USE_CUDA=0 2025-03-14T05:39:46.1397109Z GITHUB_REF=refs/heads/main 2025-03-14T05:39:46.1397391Z SHARD_NUMBER=1 2025-03-14T05:39:46.1397642Z GITHUB_REF_PROTECTED=true 2025-03-14T05:39:46.1397920Z HOME=/home/jenkins 2025-03-14T05:39:46.1398210Z GITHUB_API_URL=https://api.github.com 2025-03-14T05:39:46.1398561Z PYTORCH_TEST_RERUN_DISABLED_TESTS=0 2025-03-14T05:39:46.1398876Z LANG=C.UTF-8 2025-03-14T05:39:46.1399119Z CARGO_HOME=/opt/cargo 2025-03-14T05:39:46.1399410Z OPENSSL_INCLUDE_DIR=/usr/include/openssl 2025-03-14T05:39:46.1399742Z NUM_TEST_SHARDS=1 2025-03-14T05:39:46.1400328Z GITHUB_STATE=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/save_state_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1401037Z GPG_KEY=A035C8C19219BA821ECEA86B64E628F8D684696D 2025-03-14T05:39:46.1401632Z JOB_NAME=linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T05:39:46.1402434Z GITHUB_ENV=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_env_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1403276Z GITHUB_EVENT_PATH=/home/ec2-user/actions-runner/_work/_temp/_github_workflow/event.json 2025-03-14T05:39:46.1403809Z GITHUB_EVENT_NAME=push 2025-03-14T05:39:46.1404085Z DASHBOARD_TAG= 2025-03-14T05:39:46.1404341Z GITHUB_RUN_ID=13849515290 2025-03-14T05:39:46.1405101Z GITHUB_STEP_SUMMARY=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/step_summary_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1405829Z GITHUB_ACTOR=pytorchmergebot 2025-03-14T05:39:46.1406126Z PR_NUMBER= 2025-03-14T05:39:46.1406366Z GITHUB_RUN_ATTEMPT=1 2025-03-14T05:39:46.1406632Z VALGRIND=OFF 2025-03-14T05:39:46.1406937Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2025-03-14T05:39:46.1407309Z TERM=vt100 2025-03-14T05:39:46.1407535Z BRANCH=main 2025-03-14T05:39:46.1407778Z RUSTUP_HOME=/opt/rustup 2025-03-14T05:39:46.1408062Z SCCACHE_REGION=us-east-1 2025-03-14T05:39:46.1408354Z CUDA_PATH=/usr/local/cuda 2025-03-14T05:39:46.1408890Z GITHUB_ACTION_PATH=/home/ec2-user/actions-runner/_work/pytorch/pytorch/./.github/actions/setup-linux 2025-03-14T05:39:46.1409501Z GITHUB_SERVER_URL=https://github.com 2025-03-14T05:39:46.1409828Z REENABLED_ISSUES= 2025-03-14T05:39:46.1410074Z SHLVL=1 2025-03-14T05:39:46.1410292Z MAX_JOBS=46 2025-03-14T05:39:46.1410529Z GITHUB_ACTOR_ID=97764156 2025-03-14T05:39:46.1410894Z GITHUB_WORKFLOW_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:39:46.1411295Z GITHUB_REF_NAME=main 2025-03-14T05:39:46.1411696Z XLA_CLANG_CACHE_S3_BUCKET_NAME=ossci-compiler-clang-cache-circleci-xla 2025-03-14T05:39:46.1412148Z GITHUB_JOB=test 2025-03-14T05:39:46.1412640Z LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64: 2025-03-14T05:39:46.1413200Z NO_TEST_TIMEOUT=False 2025-03-14T05:39:46.1413470Z TD_DISTRIBUTED=False 2025-03-14T05:39:46.1413776Z TF_CUDA_PATHS=/usr/local/cuda,/usr/include,/usr 2025-03-14T05:39:46.1414222Z GITHUB_REPOSITORY=pytorch/pytorch 2025-03-14T05:39:46.1414544Z GITHUB_RETENTION_DAYS=90 2025-03-14T05:39:46.1414819Z GITHUB_ACTION_REPOSITORY= 2025-03-14T05:39:46.1415564Z PATH=/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-03-14T05:39:46.1416349Z GITHUB_BASE_REF= 2025-03-14T05:39:46.1416595Z CC=clang 2025-03-14T05:39:46.1416942Z ARTIFACTS_FILE_SUFFIX=test-xla-1-1-lf.linux.12xlarge_38757034389 2025-03-14T05:39:46.1417365Z CI=true 2025-03-14T05:39:46.1417618Z OPENSSL_LIB_DIR=/usr/lib/x86_64-linux-gnu 2025-03-14T05:39:46.1417969Z GITHUB_REPOSITORY_OWNER=pytorch 2025-03-14T05:39:46.1418272Z JOB_ID=38757034389 2025-03-14T05:39:46.1418520Z GITHUB_HEAD_REF= 2025-03-14T05:39:46.1418766Z GITHUB_ACTION_REF= 2025-03-14T05:39:46.1419079Z SCCACHE_BUCKET=ossci-compiler-cache-circleci-v2 2025-03-14T05:39:46.1419456Z TEST_SHOWLOCALS=False 2025-03-14T05:39:46.1419727Z GITHUB_WORKFLOW=pull 2025-03-14T05:39:46.1420351Z GITHUB_OUTPUT=/home/ec2-user/actions-runner/_work/_temp/_runner_file_commands/set_output_28a94f20-1700-44db-932f-26e5bcab34ab 2025-03-14T05:39:46.1421020Z NO_TD=False 2025-03-14T05:39:46.1421272Z SKIP_SCCACHE_INITIALIZATION=1 2025-03-14T05:39:46.1421559Z TPUVM_MODE= 2025-03-14T05:39:46.1421794Z _=/usr/bin/env 2025-03-14T05:39:46.1422048Z + echo 'Testing pytorch' 2025-03-14T05:39:46.1422335Z Testing pytorch 2025-03-14T05:39:46.1422592Z + export LANG=C.UTF-8 2025-03-14T05:39:46.1422860Z + LANG=C.UTF-8 2025-03-14T05:39:46.1423103Z + PR_NUMBER= 2025-03-14T05:39:46.1423350Z + [[ xla == \d\e\f\a\u\l\t ]] 2025-03-14T05:39:46.1423658Z + [[ xla == \d\i\s\t\r\i\b\u\t\e\d ]] 2025-03-14T05:39:46.1423974Z + [[ xla == \s\l\o\w ]] 2025-03-14T05:39:46.1424316Z + [[ linux-focal-py3.9-clang9-xla == *slow-gradcheck* ]] 2025-03-14T05:39:46.1424745Z + [[ linux-focal-py3.9-clang9-xla == *cuda* ]] 2025-03-14T05:39:46.1425199Z + [[ linux-focal-py3.9-clang9-xla == *rocm* ]] 2025-03-14T05:39:46.1425591Z + [[ linux-focal-py3.9-clang9-xla == *xpu* ]] 2025-03-14T05:39:46.1425942Z + [[ xla == *crossref* ]] 2025-03-14T05:39:46.1426244Z + [[ linux-focal-py3.9-clang9-xla == *rocm* ]] 2025-03-14T05:39:46.1426625Z + [[ linux-focal-py3.9-clang9-xla == *xpu* ]] 2025-03-14T05:39:46.1427027Z + [[ linux-focal-py3.9-clang9-xla != *-bazel-* ]] 2025-03-14T05:39:46.1427408Z + pip_install --user ninja==1.10.2 2025-03-14T05:39:46.1427825Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2025-03-14T05:39:46.1428344Z + python3 -m pip install --progress-bar off --user ninja==1.10.2 2025-03-14T05:39:46.6404916Z Collecting ninja==1.10.2 2025-03-14T05:39:46.6757806Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2025-03-14T05:39:46.6875714Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2025-03-14T05:39:46.9206491Z Installing collected packages: ninja 2025-03-14T05:39:46.9336294Z Successfully installed ninja-1.10.2 2025-03-14T05:39:47.0088377Z + export PATH=/home/jenkins/.local/bin:/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-03-14T05:39:47.0089927Z + PATH=/home/jenkins/.local/bin:/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-03-14T05:39:47.0090866Z + [[ linux-focal-py3.9-clang9-xla == *aarch64* ]] 2025-03-14T05:39:47.0091225Z + install_tlparse 2025-03-14T05:39:47.0091511Z + pip_install --user tlparse==0.3.30 2025-03-14T05:39:47.0107203Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2025-03-14T05:39:47.0107816Z + python3 -m pip install --progress-bar off --user tlparse==0.3.30 2025-03-14T05:39:47.8216360Z Collecting tlparse==0.3.30 2025-03-14T05:39:47.8598961Z Downloading tlparse-0.3.30-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.9 kB) 2025-03-14T05:39:47.9387834Z Downloading tlparse-0.3.30-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.3 MB) 2025-03-14T05:39:48.3047604Z Installing collected packages: tlparse 2025-03-14T05:39:48.3759127Z Successfully installed tlparse-0.3.30 2025-03-14T05:39:48.4555637Z ++ python -m site --user-base 2025-03-14T05:39:48.4727455Z + PATH=/home/jenkins/.local/bin:/home/jenkins/.local/bin:/opt/conda/bin:/home/jenkins/.local/bin:/opt/cargo/bin:/usr/local/cuda:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-03-14T05:39:48.4728522Z + [[ linux-focal-py3.9-clang9-xla == *asan* ]] 2025-03-14T05:39:48.4728928Z + [[ linux-focal-py3.9-clang9-xla == *-debug* ]] 2025-03-14T05:39:48.4729342Z + [[ linux-focal-py3.9-clang9-xla != *-bazel-* ]] 2025-03-14T05:39:48.4729910Z + echo 'We are not in debug mode: linux-focal-py3.9-clang9-xla. Expect the assertion to pass' 2025-03-14T05:39:48.4730633Z We are not in debug mode: linux-focal-py3.9-clang9-xla. Expect the assertion to pass 2025-03-14T05:39:48.4731122Z + cd test 2025-03-14T05:39:48.4731504Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2025-03-14T05:39:49.8269414Z + [[ xla == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2025-03-14T05:39:49.8269875Z + [[ xla == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2025-03-14T05:39:49.8270546Z + DYNAMO_BENCHMARK_FLAGS=() 2025-03-14T05:39:49.8270914Z + [[ xla == *pr_time_benchmarks* ]] 2025-03-14T05:39:49.8271244Z + [[ xla == *dynamo_eager* ]] 2025-03-14T05:39:49.8271543Z + [[ xla == *aot_eager* ]] 2025-03-14T05:39:49.8271830Z + [[ xla == *aot_inductor* ]] 2025-03-14T05:39:49.8272140Z + [[ xla == *max_autotune_inductor* ]] 2025-03-14T05:39:49.8272466Z + [[ xla == *inductor* ]] 2025-03-14T05:39:49.8272748Z + [[ xla == *dynamic* ]] 2025-03-14T05:39:49.8273018Z + [[ xla == *cpu* ]] 2025-03-14T05:39:49.8273323Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2025-03-14T05:39:49.8292309Z + [[ linux-focal-py3.9-clang9-xla == *libtorch* ]] 2025-03-14T05:39:49.8294233Z + [[ linux-focal-py3.9-clang9-xla == *-bazel-* ]] 2025-03-14T05:39:49.8294719Z + cd test 2025-03-14T05:39:49.8295470Z + python -c 'import torch; print(torch.__config__.show())' 2025-03-14T05:39:50.9673778Z PyTorch built with: 2025-03-14T05:39:50.9674131Z - GCC 4.2 2025-03-14T05:39:50.9674397Z - C++ Version: 201703 2025-03-14T05:39:50.9674679Z - clang 11.0.1 2025-03-14T05:39:50.9675082Z - Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-03-14T05:39:50.9675555Z - OpenMP 201811 2025-03-14T05:39:50.9675866Z - LAPACK is enabled (usually provided by MKL) 2025-03-14T05:39:50.9676229Z - NNPACK is enabled 2025-03-14T05:39:50.9676522Z - CPU capability usage: AVX512 2025-03-14T05:39:50.9682132Z - Build settings: BLAS_INFO=open, BUILD_TYPE=Release, COMMIT_SHA=aed0b7a742a2d7b7901790622829cbd2135049a4, CXX_COMPILER=/tmp/cache/bin/clang++, CXX_FLAGS= -D_GLIBCXX_USE_CXX11_ABI=1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=braced-scalar-init -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wvla-extension -Wsuggest-override -Wnewline-eof -Winconsistent-missing-override -Winconsistent-missing-destructor-override -Wno-pass-failed -Wno-error=old-style-cast -Wconstant-conversion -Qunused-arguments -fcolor-diagnostics -faligned-new -fno-math-errno -fno-trapping-math -Werror=format, FORCE_FALLBACK_CUDA_MPI=1, LAPACK_INFO=open, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.8.0, USE_CUDA=0, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_EIGEN_FOR_BLAS=ON, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=OFF, USE_MKLDNN=ON, USE_MPI=ON, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, 2025-03-14T05:39:50.9687942Z 2025-03-14T05:39:51.1767869Z + cd test 2025-03-14T05:39:51.1768775Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2025-03-14T05:39:52.3016209Z ATen/Parallel: 2025-03-14T05:39:52.3016571Z at::get_num_threads() : 24 2025-03-14T05:39:52.3016923Z at::get_num_interop_threads() : 24 2025-03-14T05:39:52.3017255Z OpenMP 201811 2025-03-14T05:39:52.3017515Z omp_get_max_threads() : 24 2025-03-14T05:39:52.3017801Z MKL not found 2025-03-14T05:39:52.3018177Z Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-03-14T05:39:52.3018672Z std::thread::hardware_concurrency() : 48 2025-03-14T05:39:52.3019020Z Environment variables: 2025-03-14T05:39:52.3019309Z OMP_NUM_THREADS : [not set] 2025-03-14T05:39:52.3019607Z MKL_NUM_THREADS : [not set] 2025-03-14T05:39:52.3019911Z ATen parallel backend: OpenMP 2025-03-14T05:39:52.3020113Z 2025-03-14T05:39:52.5115735Z + [[ xla == *numpy_2* ]] 2025-03-14T05:39:52.5116227Z + [[ linux-focal-py3.9-clang9-xla == *aarch64* ]] 2025-03-14T05:39:52.5116631Z + [[ xla == *backward* ]] 2025-03-14T05:39:52.5116955Z + [[ xla == *xla* ]] 2025-03-14T05:39:52.5117220Z + install_torchvision 2025-03-14T05:39:52.5117497Z + local orig_preload 2025-03-14T05:39:52.5117770Z + local commit 2025-03-14T05:39:52.5118026Z ++ get_pinned_commit vision 2025-03-14T05:39:52.5118356Z ++ cat .github/ci_commit_pins/vision.txt 2025-03-14T05:39:52.5127972Z + commit=d23a6e1664d20707c11781299611436e1f0c104f 2025-03-14T05:39:52.5128357Z + orig_preload= 2025-03-14T05:39:52.5128610Z + '[' -n '' ']' 2025-03-14T05:39:52.5129214Z + pip_install --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2025-03-14T05:39:52.5129959Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2025-03-14T05:39:52.5130807Z + python3 -m pip install --progress-bar off --no-use-pep517 --user git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2025-03-14T05:39:52.8857851Z Collecting git+https://github.com/pytorch/vision.git@d23a6e1664d20707c11781299611436e1f0c104f 2025-03-14T05:39:52.8860886Z Cloning https://github.com/pytorch/vision.git (to revision d23a6e1664d20707c11781299611436e1f0c104f) to /tmp/pip-req-build-k9vxf4e7 2025-03-14T05:39:52.8883118Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-k9vxf4e7 2025-03-14T05:39:54.2570856Z Running command git rev-parse -q --verify 'sha^d23a6e1664d20707c11781299611436e1f0c104f' 2025-03-14T05:39:54.2592930Z Running command git fetch -q https://github.com/pytorch/vision.git d23a6e1664d20707c11781299611436e1f0c104f 2025-03-14T05:39:54.3600835Z Running command git checkout -q d23a6e1664d20707c11781299611436e1f0c104f 2025-03-14T05:39:54.6760078Z Resolved https://github.com/pytorch/vision.git to commit d23a6e1664d20707c11781299611436e1f0c104f 2025-03-14T05:39:56.6560843Z Preparing metadata (setup.py) ... [?25l- \ done 2025-03-14T05:39:56.6597065Z [?25hRequirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.1.3) 2025-03-14T05:39:56.6598210Z Requirement already satisfied: torch in /opt/conda/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (2.8.0a0+gitaed0b7a) 2025-03-14T05:39:56.6601242Z Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /opt/conda/lib/python3.10/site-packages (from torchvision==0.19.0a0+d23a6e1) (11.1.0) 2025-03-14T05:39:56.6682935Z Requirement already satisfied: filelock in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.17.0) 2025-03-14T05:39:56.6684151Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (4.12.2) 2025-03-14T05:39:56.6687054Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (1.13.3) 2025-03-14T05:39:56.6690048Z Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.4.2) 2025-03-14T05:39:56.6692968Z Requirement already satisfied: jinja2 in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (3.1.6) 2025-03-14T05:39:56.6695862Z Requirement already satisfied: fsspec in /opt/conda/lib/python3.10/site-packages (from torch->torchvision==0.19.0a0+d23a6e1) (2025.3.0) 2025-03-14T05:39:56.6714214Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy>=1.13.3->torch->torchvision==0.19.0a0+d23a6e1) (1.3.0) 2025-03-14T05:39:56.7167907Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from jinja2->torch->torchvision==0.19.0a0+d23a6e1) (3.0.2) 2025-03-14T05:39:56.7246199Z Building wheels for collected packages: torchvision 2025-03-14T05:40:22.2068039Z Building wheel for torchvision (setup.py) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | done 2025-03-14T05:40:22.2106658Z [?25h Created wheel for torchvision: filename=torchvision-0.19.0a0+d23a6e1-cp310-cp310-linux_x86_64.whl size=1169213 sha256=5791de6594e9ad0ef1e3c1ee490e13d50482bac37b3b988aac31f2d86f232f4c 2025-03-14T05:40:22.2107987Z Stored in directory: /home/jenkins/.cache/pip/wheels/0e/56/35/02931e71eb23fd2b85591c7ec05b733ca7c8b328a2fd151f96 2025-03-14T05:40:22.2142579Z Successfully built torchvision 2025-03-14T05:40:22.3706312Z Installing collected packages: torchvision 2025-03-14T05:40:22.7533890Z Successfully installed torchvision-0.19.0a0+d23a6e1 2025-03-14T05:40:22.8580081Z + '[' -n '' ']' 2025-03-14T05:40:22.8580409Z + build_xla 2025-03-14T05:40:22.8580650Z + pushd .. 2025-03-14T05:40:22.8580924Z /var/lib/jenkins /var/lib/jenkins/workspace 2025-03-14T05:40:22.8581764Z + python -c 'import os, torch, shutil; shutil.copytree(os.path.join(os.path.dirname(torch.__file__), '\''include'\''), '\''workspace/torch/include'\'', dirs_exist_ok=True)' 2025-03-14T05:40:24.9642387Z + popd 2025-03-14T05:40:24.9642812Z /var/lib/jenkins/workspace 2025-03-14T05:40:24.9643167Z ++ dirname .ci/pytorch/test.sh 2025-03-14T05:40:24.9651814Z + source .ci/pytorch/common-build.sh 2025-03-14T05:40:24.9653330Z ++ [[ linux-focal-py3.9-clang9-xla != *win-* ]] 2025-03-14T05:40:24.9659011Z ++++ dirname .ci/pytorch/common-build.sh 2025-03-14T05:40:24.9668893Z +++ cd .ci/pytorch 2025-03-14T05:40:24.9669217Z +++ pwd -P 2025-03-14T05:40:24.9671365Z ++ script_dir=/var/lib/jenkins/workspace/.ci/pytorch 2025-03-14T05:40:24.9671783Z ++ [[ linux-focal-py3.9-clang9-xla == *-pch* ]] 2025-03-14T05:40:24.9672132Z ++ which sccache 2025-03-14T05:40:24.9684841Z ++ sccache --stop-server 2025-03-14T05:40:24.9716964Z ++ true 2025-03-14T05:40:24.9717263Z ++ rm -f /home/jenkins/sccache_error.log 2025-03-14T05:40:24.9724911Z ++ trap_add sccache_epilogue EXIT 2025-03-14T05:40:24.9725270Z ++ trap_add_cmd=sccache_epilogue 2025-03-14T05:40:24.9725590Z ++ shift 2025-03-14T05:40:24.9725847Z ++ for trap_add_name in "$@" 2025-03-14T05:40:24.9731525Z ++++ trap -p EXIT 2025-03-14T05:40:24.9734277Z +++ eval 'extract_trap_cmd trap -- '\'' 2025-03-14T05:40:24.9734679Z cleanup_workspace'\'' EXIT' 2025-03-14T05:40:24.9734999Z ++++ extract_trap_cmd trap -- ' 2025-03-14T05:40:24.9735315Z cleanup_workspace' EXIT 2025-03-14T05:40:24.9735590Z ++++ printf '%s\n' ' 2025-03-14T05:40:24.9735853Z cleanup_workspace' 2025-03-14T05:40:24.9736129Z +++ printf '%s\n' sccache_epilogue 2025-03-14T05:40:24.9737290Z ++ trap -- ' 2025-03-14T05:40:24.9737659Z cleanup_workspace 2025-03-14T05:40:24.9738005Z sccache_epilogue' EXIT 2025-03-14T05:40:24.9738276Z ++ [[ -n 1 ]] 2025-03-14T05:40:24.9738684Z ++ echo 'Skipping sccache server initialization, setting environment variables' 2025-03-14T05:40:24.9739311Z Skipping sccache server initialization, setting environment variables 2025-03-14T05:40:24.9739783Z ++ export SCCACHE_IDLE_TIMEOUT=0 2025-03-14T05:40:24.9740096Z ++ SCCACHE_IDLE_TIMEOUT=0 2025-03-14T05:40:24.9740467Z ++ export SCCACHE_ERROR_LOG=/home/jenkins/sccache_error.log 2025-03-14T05:40:24.9740921Z ++ SCCACHE_ERROR_LOG=/home/jenkins/sccache_error.log 2025-03-14T05:40:24.9741542Z ++ export RUST_LOG=sccache::server=error 2025-03-14T05:40:24.9741889Z ++ RUST_LOG=sccache::server=error 2025-03-14T05:40:24.9742190Z ++ sccache --zero-stats 2025-03-14T05:40:24.9944355Z Compile requests 0 2025-03-14T05:40:24.9944871Z Compile requests executed 0 2025-03-14T05:40:24.9945256Z Cache hits 0 2025-03-14T05:40:24.9945597Z Cache misses 0 2025-03-14T05:40:24.9945926Z Cache timeouts 0 2025-03-14T05:40:24.9946256Z Cache read errors 0 2025-03-14T05:40:24.9946591Z Forced recaches 0 2025-03-14T05:40:24.9946920Z Cache write errors 0 2025-03-14T05:40:24.9947261Z Compilation failures 0 2025-03-14T05:40:24.9947596Z Cache errors 0 2025-03-14T05:40:24.9947962Z Non-cacheable compilations 0 2025-03-14T05:40:24.9948309Z Non-cacheable calls 0 2025-03-14T05:40:24.9948660Z Non-compilation calls 0 2025-03-14T05:40:24.9949003Z Unsupported compiler calls 0 2025-03-14T05:40:24.9949350Z Average cache write 0.000 s 2025-03-14T05:40:24.9949698Z Average cache read miss 0.000 s 2025-03-14T05:40:24.9950048Z Average cache read hit 0.000 s 2025-03-14T05:40:24.9950403Z Failed distributed compilations 0 2025-03-14T05:40:24.9951216Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2025-03-14T05:40:24.9951991Z ++ which ccache 2025-03-14T05:40:24.9953238Z ++ ccache --zero-stats 2025-03-14T05:40:25.0255341Z Statistics zeroed 2025-03-14T05:40:25.0256194Z ++ ccache --show-stats 2025-03-14T05:40:25.0309788Z cache directory /home/jenkins/.cache/ccache 2025-03-14T05:40:25.0311036Z primary config /home/jenkins/.config/ccache/ccache.conf 2025-03-14T05:40:25.0311557Z secondary config (readonly) /etc/ccache.conf 2025-03-14T05:40:25.0312003Z stats updated Fri Mar 14 05:40:25 2025 2025-03-14T05:40:25.0312443Z stats zeroed Fri Mar 14 05:40:24 2025 2025-03-14T05:40:25.0312845Z cache hit (direct) 0 2025-03-14T05:40:25.0313193Z cache hit (preprocessed) 0 2025-03-14T05:40:25.0313535Z cache miss 0 2025-03-14T05:40:25.0313871Z cache hit rate 0.00 % 2025-03-14T05:40:25.0314220Z cleanups performed 0 2025-03-14T05:40:25.0314560Z files in cache 0 2025-03-14T05:40:25.0314895Z cache size 0.0 kB 2025-03-14T05:40:25.0315242Z max cache size 5.0 GB 2025-03-14T05:40:25.0315592Z ++ trap_add ccache_epilogue EXIT 2025-03-14T05:40:25.0315904Z ++ trap_add_cmd=ccache_epilogue 2025-03-14T05:40:25.0316208Z ++ shift 2025-03-14T05:40:25.0316454Z ++ for trap_add_name in "$@" 2025-03-14T05:40:25.0316797Z ++++ trap -p EXIT 2025-03-14T05:40:25.0317907Z +++ eval 'extract_trap_cmd trap -- '\'' 2025-03-14T05:40:25.0318245Z cleanup_workspace 2025-03-14T05:40:25.0318509Z sccache_epilogue'\'' EXIT' 2025-03-14T05:40:25.0318817Z ++++ extract_trap_cmd trap -- ' 2025-03-14T05:40:25.0319117Z cleanup_workspace 2025-03-14T05:40:25.0319377Z sccache_epilogue' EXIT 2025-03-14T05:40:25.0319650Z ++++ printf '%s\n' ' 2025-03-14T05:40:25.0319910Z cleanup_workspace 2025-03-14T05:40:25.0320165Z sccache_epilogue' 2025-03-14T05:40:25.0320438Z +++ printf '%s\n' ccache_epilogue 2025-03-14T05:40:25.0320761Z ++ trap -- ' 2025-03-14T05:40:25.0321010Z cleanup_workspace 2025-03-14T05:40:25.0321261Z sccache_epilogue 2025-03-14T05:40:25.0321604Z ccache_epilogue' EXIT 2025-03-14T05:40:25.0321873Z + XLA_DIR=xla 2025-03-14T05:40:25.0322107Z + USE_CACHE=1 2025-03-14T05:40:25.0322344Z + clone_pytorch_xla 2025-03-14T05:40:25.0322607Z + [[ ! -d ./xla ]] 2025-03-14T05:40:25.0322993Z + git clone --recursive --quiet https://github.com/pytorch/xla.git 2025-03-14T05:40:28.3790822Z + pushd xla 2025-03-14T05:40:28.3791266Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2025-03-14T05:40:28.3791715Z ++ cat ../.github/ci_commit_pins/xla.txt 2025-03-14T05:40:28.3799471Z + git checkout b2b890e962f5fb6f481e5da2eb4a43bb990d0f1b 2025-03-14T05:40:28.4628794Z Note: switching to 'b2b890e962f5fb6f481e5da2eb4a43bb990d0f1b'. 2025-03-14T05:40:28.4629149Z 2025-03-14T05:40:28.4629381Z You are in 'detached HEAD' state. You can look around, make experimental 2025-03-14T05:40:28.4630041Z changes and commit them, and you can discard any commits you make in this 2025-03-14T05:40:28.4630623Z state without impacting any branches by switching back to a branch. 2025-03-14T05:40:28.4631017Z 2025-03-14T05:40:28.4631237Z If you want to create a new branch to retain commits you create, you may 2025-03-14T05:40:28.4631802Z do so (now or later) by using -c with the switch command. Example: 2025-03-14T05:40:28.4632118Z 2025-03-14T05:40:28.4632247Z git switch -c 2025-03-14T05:40:28.4632455Z 2025-03-14T05:40:28.4632583Z Or undo this operation with: 2025-03-14T05:40:28.4632775Z 2025-03-14T05:40:28.4632886Z git switch - 2025-03-14T05:40:28.4633026Z 2025-03-14T05:40:28.4633287Z Turn off this advice by setting config variable advice.detachedHead to false 2025-03-14T05:40:28.4633648Z 2025-03-14T05:40:28.4633971Z HEAD is now at b2b890e96 Migrate from capture_pre_autograd_graph to export_for_training (#8398) 2025-03-14T05:40:28.4634513Z + git submodule sync 2025-03-14T05:40:28.4863338Z + git submodule update --init --recursive 2025-03-14T05:40:28.5093737Z + popd 2025-03-14T05:40:28.5094135Z /var/lib/jenkins/workspace 2025-03-14T05:40:28.5094463Z + source xla/.circleci/common.sh 2025-03-14T05:40:28.5094771Z ++ set -ex 2025-03-14T05:40:28.5095016Z ++ CONTINUE_ON_ERROR=false 2025-03-14T05:40:28.5095293Z ++ [[ false == \1 ]] 2025-03-14T05:40:28.5101463Z ++++ which conda 2025-03-14T05:40:28.5108516Z +++ dirname /opt/conda/bin/conda 2025-03-14T05:40:28.5117686Z ++ export CMAKE_PREFIX_PATH=/opt/conda/bin/../ 2025-03-14T05:40:28.5118091Z ++ CMAKE_PREFIX_PATH=/opt/conda/bin/../ 2025-03-14T05:40:28.5122033Z +++ python3-config --prefix 2025-03-14T05:40:28.5248595Z ++ export LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib 2025-03-14T05:40:28.5249576Z ++ LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib 2025-03-14T05:40:28.5250457Z ++ echo /lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib 2025-03-14T05:40:28.5251275Z /lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib 2025-03-14T05:40:28.5251905Z + rm xla/torch_patches/.torch_pin 2025-03-14T05:40:28.5260869Z rm: cannot remove 'xla/torch_patches/.torch_pin': No such file or directory 2025-03-14T05:40:28.5261636Z + true 2025-03-14T05:40:28.5261893Z + apply_patches 2025-03-14T05:40:28.5262167Z + ./xla/scripts/apply_patches.sh 2025-03-14T05:40:28.5286323Z +++ dirname ./xla/scripts/apply_patches.sh 2025-03-14T05:40:28.5290026Z ++ cd ./xla/scripts 2025-03-14T05:40:28.5290347Z ++ pwd -P 2025-03-14T05:40:28.5292035Z + CDIR=/var/lib/jenkins/workspace/xla/scripts 2025-03-14T05:40:28.5292753Z + XDIR=/var/lib/jenkins/workspace/xla/scripts/.. 2025-03-14T05:40:28.5293521Z + PTDIR=/var/lib/jenkins/workspace/xla/scripts/../.. 2025-03-14T05:40:28.5294157Z + OPENXLADIR=/var/lib/jenkins/workspace/xla/scripts/../third_party/xla 2025-03-14T05:40:28.5294724Z + TORCH_PIN=/var/lib/jenkins/workspace/xla/scripts/../.torch_pin 2025-03-14T05:40:28.5295248Z + '[' -f /var/lib/jenkins/workspace/xla/scripts/../.torch_pin ']' 2025-03-14T05:40:28.5296255Z + python /var/lib/jenkins/workspace/xla/scripts/cond_patch.py /var/lib/jenkins/workspace/xla/scripts/../torch_patches /var/lib/jenkins/workspace/xla/scripts/../.. 2025-03-14T05:40:28.5772748Z + [[ -n '' ]] 2025-03-14T05:40:28.5777691Z ++ python -c 'from distutils.sysconfig import get_python_lib; print(get_python_lib())' 2025-03-14T05:40:28.6931693Z + SITE_PACKAGES=/opt/conda/lib/python3.10/site-packages 2025-03-14T05:40:28.6932335Z + retry install_deps_pytorch_xla xla 1 2025-03-14T05:40:28.6932691Z + install_deps_pytorch_xla xla 1 2025-03-14T05:40:28.6932996Z + XLA_DIR=xla 2025-03-14T05:40:28.6933239Z + USE_CACHE=1 2025-03-14T05:40:28.6933484Z + pip install sympy 2025-03-14T05:40:29.0663291Z Requirement already satisfied: sympy in /opt/conda/lib/python3.10/site-packages (1.13.3) 2025-03-14T05:40:29.0675458Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy) (1.3.0) 2025-03-14T05:40:29.3588513Z + pip install ninja 2025-03-14T05:40:29.7350769Z Requirement already satisfied: ninja in /home/jenkins/.local/lib/python3.10/site-packages (1.10.2) 2025-03-14T05:40:30.0300662Z + pip install hypothesis 2025-03-14T05:40:30.4068593Z Requirement already satisfied: hypothesis in /opt/conda/lib/python3.10/site-packages (6.115.6) 2025-03-14T05:40:30.4175294Z Requirement already satisfied: attrs>=22.2.0 in /opt/conda/lib/python3.10/site-packages (from hypothesis) (24.3.0) 2025-03-14T05:40:30.4178443Z Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in /opt/conda/lib/python3.10/site-packages (from hypothesis) (2.4.0) 2025-03-14T05:40:30.4183579Z Requirement already satisfied: exceptiongroup>=1.0.0 in /opt/conda/lib/python3.10/site-packages (from hypothesis) (1.2.0) 2025-03-14T05:40:30.7044934Z + pip install cloud-tpu-client 2025-03-14T05:40:31.0807831Z Requirement already satisfied: cloud-tpu-client in /opt/conda/lib/python3.10/site-packages (0.10) 2025-03-14T05:40:31.0814348Z Requirement already satisfied: google-api-python-client==1.8.0 in /opt/conda/lib/python3.10/site-packages (from cloud-tpu-client) (1.8.0) 2025-03-14T05:40:31.0817391Z Requirement already satisfied: oauth2client in /opt/conda/lib/python3.10/site-packages (from cloud-tpu-client) (4.1.3) 2025-03-14T05:40:31.0841979Z Requirement already satisfied: httplib2<1dev,>=0.9.2 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (0.22.0) 2025-03-14T05:40:31.0843331Z Requirement already satisfied: google-auth>=1.4.1 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (2.38.0) 2025-03-14T05:40:31.0845213Z Requirement already satisfied: google-auth-httplib2>=0.0.3 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (0.2.0) 2025-03-14T05:40:31.0848988Z Requirement already satisfied: google-api-core<2dev,>=1.13.0 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (1.34.1) 2025-03-14T05:40:31.0852887Z Requirement already satisfied: six<2dev,>=1.6.1 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (1.17.0) 2025-03-14T05:40:31.0856892Z Requirement already satisfied: uritemplate<4dev,>=3.0.0 in /opt/conda/lib/python3.10/site-packages (from google-api-python-client==1.8.0->cloud-tpu-client) (3.0.1) 2025-03-14T05:40:31.0873729Z Requirement already satisfied: pyasn1>=0.1.7 in /opt/conda/lib/python3.10/site-packages (from oauth2client->cloud-tpu-client) (0.6.1) 2025-03-14T05:40:31.0878014Z Requirement already satisfied: pyasn1-modules>=0.0.5 in /opt/conda/lib/python3.10/site-packages (from oauth2client->cloud-tpu-client) (0.4.1) 2025-03-14T05:40:31.0881683Z Requirement already satisfied: rsa>=3.1.4 in /opt/conda/lib/python3.10/site-packages (from oauth2client->cloud-tpu-client) (4.9) 2025-03-14T05:40:31.0918733Z Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.56.2 in /opt/conda/lib/python3.10/site-packages (from google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (1.69.1) 2025-03-14T05:40:31.0920880Z Requirement already satisfied: protobuf!=3.20.0,!=3.20.1,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5,<4.0.0dev,>=3.19.5 in /opt/conda/lib/python3.10/site-packages (from google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (3.20.3) 2025-03-14T05:40:31.0925716Z Requirement already satisfied: requests<3.0.0dev,>=2.18.0 in /opt/conda/lib/python3.10/site-packages (from google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (2.32.3) 2025-03-14T05:40:31.0963130Z Requirement already satisfied: cachetools<6.0,>=2.0.0 in /opt/conda/lib/python3.10/site-packages (from google-auth>=1.4.1->google-api-python-client==1.8.0->cloud-tpu-client) (5.5.2) 2025-03-14T05:40:31.0996116Z Requirement already satisfied: pyparsing!=3.0.0,!=3.0.1,!=3.0.2,!=3.0.3,<4,>=2.4.2 in /opt/conda/lib/python3.10/site-packages (from httplib2<1dev,>=0.9.2->google-api-python-client==1.8.0->cloud-tpu-client) (3.2.1) 2025-03-14T05:40:31.1088346Z Requirement already satisfied: charset-normalizer<4,>=2 in /opt/conda/lib/python3.10/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (3.3.2) 2025-03-14T05:40:31.1091252Z Requirement already satisfied: idna<4,>=2.5 in /opt/conda/lib/python3.10/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (3.7) 2025-03-14T05:40:31.1095209Z Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.10/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (1.26.20) 2025-03-14T05:40:31.1099102Z Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/lib/python3.10/site-packages (from requests<3.0.0dev,>=2.18.0->google-api-core<2dev,>=1.13.0->google-api-python-client==1.8.0->cloud-tpu-client) (2025.1.31) 2025-03-14T05:40:31.3994639Z + pip install absl-py 2025-03-14T05:40:31.7737801Z Requirement already satisfied: absl-py in /opt/conda/lib/python3.10/site-packages (2.1.0) 2025-03-14T05:40:32.0692411Z + pip install pandas 2025-03-14T05:40:32.4448416Z Requirement already satisfied: pandas in /opt/conda/lib/python3.10/site-packages (2.2.3) 2025-03-14T05:40:32.4739877Z Requirement already satisfied: numpy>=1.22.4 in /opt/conda/lib/python3.10/site-packages (from pandas) (2.1.3) 2025-03-14T05:40:32.4741294Z Requirement already satisfied: python-dateutil>=2.8.2 in /opt/conda/lib/python3.10/site-packages (from pandas) (2.9.0.post0) 2025-03-14T05:40:32.4744689Z Requirement already satisfied: pytz>=2020.1 in /opt/conda/lib/python3.10/site-packages (from pandas) (2025.1) 2025-03-14T05:40:32.4748423Z Requirement already satisfied: tzdata>=2022.7 in /opt/conda/lib/python3.10/site-packages (from pandas) (2025.1) 2025-03-14T05:40:32.4774467Z Requirement already satisfied: six>=1.5 in /opt/conda/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas) (1.17.0) 2025-03-14T05:40:32.7415082Z + pip install tabulate 2025-03-14T05:40:33.1168805Z Requirement already satisfied: tabulate in /opt/conda/lib/python3.10/site-packages (0.9.0) 2025-03-14T05:40:33.4131522Z + pip install --upgrade 'numpy>=1.18.5' 2025-03-14T05:40:33.7906041Z Requirement already satisfied: numpy>=1.18.5 in /opt/conda/lib/python3.10/site-packages (2.1.3) 2025-03-14T05:40:33.9670621Z Collecting numpy>=1.18.5 2025-03-14T05:40:34.0015954Z Downloading numpy-2.2.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB) 2025-03-14T05:40:34.0209490Z Downloading numpy-2.2.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.4 MB) 2025-03-14T05:40:34.1234420Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/16.4 MB ? eta -:--:-- 2025-03-14T05:40:34.1235290Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.4/16.4 MB 183.6 MB/s eta 0:00:00 2025-03-14T05:40:34.3749307Z [?25hInstalling collected packages: numpy 2025-03-14T05:40:34.3749792Z Attempting uninstall: numpy 2025-03-14T05:40:34.3766538Z Found existing installation: numpy 2.1.3 2025-03-14T05:40:34.4267210Z Uninstalling numpy-2.1.3: 2025-03-14T05:40:34.6491442Z Successfully uninstalled numpy-2.1.3 2025-03-14T05:40:36.2671281Z ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 2025-03-14T05:40:36.2672500Z numba 0.61.0 requires numpy<2.2,>=1.24, but you have numpy 2.2.3 which is incompatible. 2025-03-14T05:40:36.2673094Z Successfully installed numpy-2.2.3 2025-03-14T05:40:36.3560543Z + pip install --upgrade numba 2025-03-14T05:40:36.7292430Z Requirement already satisfied: numba in /opt/conda/lib/python3.10/site-packages (0.61.0) 2025-03-14T05:40:36.8468695Z Requirement already satisfied: llvmlite<0.45,>=0.44.0dev0 in /opt/conda/lib/python3.10/site-packages (from numba) (0.44.0) 2025-03-14T05:40:36.9690804Z Collecting numpy<2.2,>=1.24 (from numba) 2025-03-14T05:40:36.9708024Z Using cached numpy-2.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB) 2025-03-14T05:40:36.9758980Z Using cached numpy-2.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.3 MB) 2025-03-14T05:40:37.2330345Z Installing collected packages: numpy 2025-03-14T05:40:37.2331034Z Attempting uninstall: numpy 2025-03-14T05:40:37.2351732Z Found existing installation: numpy 2.2.3 2025-03-14T05:40:37.2807956Z Uninstalling numpy-2.2.3: 2025-03-14T05:40:37.2891407Z Successfully uninstalled numpy-2.2.3 2025-03-14T05:40:38.8633689Z Successfully installed numpy-2.1.3 2025-03-14T05:40:38.9527958Z + pip install 'cmake>=3.13' --upgrade 2025-03-14T05:40:39.4900017Z Collecting cmake>=3.13 2025-03-14T05:40:39.5253700Z Downloading cmake-3.31.6-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.3 kB) 2025-03-14T05:40:39.5358853Z Downloading cmake-3.31.6-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (27.8 MB) 2025-03-14T05:40:39.7189605Z [?25l ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 0.0/27.8 MB ? eta -:--:-- 2025-03-14T05:40:39.7190423Z  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 27.8/27.8 MB 169.1 MB/s eta 0:00:00 2025-03-14T05:40:40.0233127Z [?25hInstalling collected packages: cmake 2025-03-14T05:40:40.8851283Z Successfully installed cmake-3.31.6 2025-03-14T05:40:40.9721546Z + sudo apt-get -qq update 2025-03-14T05:40:41.7965462Z + sudo apt-get -qq install npm nodejs 2025-03-14T05:40:43.7272727Z debconf: delaying package configuration, since apt-utils is not installed 2025-03-14T05:40:43.7840184Z Selecting previously unselected package gtk-update-icon-cache. 2025-03-14T05:40:43.7949920Z (Reading database ... 2025-03-14T05:40:43.7950509Z (Reading database ... 5% 2025-03-14T05:40:43.7950838Z (Reading database ... 10% 2025-03-14T05:40:43.7951131Z (Reading database ... 15% 2025-03-14T05:40:43.7951420Z (Reading database ... 20% 2025-03-14T05:40:43.7951706Z (Reading database ... 25% 2025-03-14T05:40:43.7951993Z (Reading database ... 30% 2025-03-14T05:40:43.7952316Z (Reading database ... 35% 2025-03-14T05:40:43.7952611Z (Reading database ... 40% 2025-03-14T05:40:43.7952899Z (Reading database ... 45% 2025-03-14T05:40:43.7953187Z (Reading database ... 50% 2025-03-14T05:40:43.7967071Z (Reading database ... 55% 2025-03-14T05:40:43.7985476Z (Reading database ... 60% 2025-03-14T05:40:43.8001728Z (Reading database ... 65% 2025-03-14T05:40:43.8023166Z (Reading database ... 70% 2025-03-14T05:40:43.8025811Z (Reading database ... 75% 2025-03-14T05:40:43.8065483Z (Reading database ... 80% 2025-03-14T05:40:43.8074004Z (Reading database ... 85% 2025-03-14T05:40:43.8085392Z (Reading database ... 90% 2025-03-14T05:40:43.8106097Z (Reading database ... 95% 2025-03-14T05:40:43.8106511Z (Reading database ... 100% 2025-03-14T05:40:43.8107041Z (Reading database ... 49820 files and directories currently installed.) 2025-03-14T05:40:43.8109897Z Preparing to unpack .../000-gtk-update-icon-cache_3.24.24-4+deb11u4_amd64.deb ... 2025-03-14T05:40:43.8129856Z Unpacking gtk-update-icon-cache (3.24.24-4+deb11u4) ... 2025-03-14T05:40:43.8489635Z Selecting previously unselected package adwaita-icon-theme. 2025-03-14T05:40:43.8522866Z Preparing to unpack .../001-adwaita-icon-theme_3.38.0-1_all.deb ... 2025-03-14T05:40:43.8544580Z Unpacking adwaita-icon-theme (3.38.0-1) ... 2025-03-14T05:40:44.8187543Z Selecting previously unselected package dbus-user-session. 2025-03-14T05:40:44.8244005Z Preparing to unpack .../002-dbus-user-session_1.12.28-0+deb11u1_amd64.deb ... 2025-03-14T05:40:44.8266307Z Unpacking dbus-user-session (1.12.28-0+deb11u1) ... 2025-03-14T05:40:44.8554617Z Selecting previously unselected package libdconf1:amd64. 2025-03-14T05:40:44.8609791Z Preparing to unpack .../003-libdconf1_0.38.0-2_amd64.deb ... 2025-03-14T05:40:44.8648704Z Unpacking libdconf1:amd64 (0.38.0-2) ... 2025-03-14T05:40:44.8869224Z Selecting previously unselected package dconf-service. 2025-03-14T05:40:44.8909015Z Preparing to unpack .../004-dconf-service_0.38.0-2_amd64.deb ... 2025-03-14T05:40:44.8926462Z Unpacking dconf-service (0.38.0-2) ... 2025-03-14T05:40:44.9129413Z Selecting previously unselected package dconf-gsettings-backend:amd64. 2025-03-14T05:40:44.9166882Z Preparing to unpack .../005-dconf-gsettings-backend_0.38.0-2_amd64.deb ... 2025-03-14T05:40:44.9187350Z Unpacking dconf-gsettings-backend:amd64 (0.38.0-2) ... 2025-03-14T05:40:44.9419417Z Selecting previously unselected package libproxy1v5:amd64. 2025-03-14T05:40:44.9452256Z Preparing to unpack .../006-libproxy1v5_0.4.17-1_amd64.deb ... 2025-03-14T05:40:44.9469381Z Unpacking libproxy1v5:amd64 (0.4.17-1) ... 2025-03-14T05:40:44.9689847Z Selecting previously unselected package glib-networking-common. 2025-03-14T05:40:44.9726728Z Preparing to unpack .../007-glib-networking-common_2.66.0-2_all.deb ... 2025-03-14T05:40:44.9746811Z Unpacking glib-networking-common (2.66.0-2) ... 2025-03-14T05:40:45.0101443Z Selecting previously unselected package glib-networking-services. 2025-03-14T05:40:45.0133837Z Preparing to unpack .../008-glib-networking-services_2.66.0-2_amd64.deb ... 2025-03-14T05:40:45.0159617Z Unpacking glib-networking-services (2.66.0-2) ... 2025-03-14T05:40:45.0368331Z Selecting previously unselected package gsettings-desktop-schemas. 2025-03-14T05:40:45.0406447Z Preparing to unpack .../009-gsettings-desktop-schemas_3.38.0-2_all.deb ... 2025-03-14T05:40:45.0431128Z Unpacking gsettings-desktop-schemas (3.38.0-2) ... 2025-03-14T05:40:45.1128162Z Selecting previously unselected package glib-networking:amd64. 2025-03-14T05:40:45.1167347Z Preparing to unpack .../010-glib-networking_2.66.0-2_amd64.deb ... 2025-03-14T05:40:45.1187743Z Unpacking glib-networking:amd64 (2.66.0-2) ... 2025-03-14T05:40:45.1449757Z Selecting previously unselected package gyp. 2025-03-14T05:40:45.1487898Z Preparing to unpack .../011-gyp_0.1+20200513gitcaa6002-2_all.deb ... 2025-03-14T05:40:45.1512645Z Unpacking gyp (0.1+20200513gitcaa6002-2) ... 2025-03-14T05:40:45.1850333Z Selecting previously unselected package libauthen-sasl-perl. 2025-03-14T05:40:45.1887684Z Preparing to unpack .../012-libauthen-sasl-perl_2.1600-1.1_all.deb ... 2025-03-14T05:40:45.1910859Z Unpacking libauthen-sasl-perl (2.1600-1.1) ... 2025-03-14T05:40:45.2165592Z Selecting previously unselected package libc-ares2:amd64. 2025-03-14T05:40:45.2201315Z Preparing to unpack .../013-libc-ares2_1.17.1-1+deb11u3_amd64.deb ... 2025-03-14T05:40:45.2213161Z Unpacking libc-ares2:amd64 (1.17.1-1+deb11u3) ... 2025-03-14T05:40:45.2470814Z Selecting previously unselected package libclone-perl. 2025-03-14T05:40:45.2509528Z Preparing to unpack .../014-libclone-perl_0.45-1+b1_amd64.deb ... 2025-03-14T05:40:45.2528798Z Unpacking libclone-perl (0.45-1+b1) ... 2025-03-14T05:40:45.2763115Z Selecting previously unselected package libcolord2:amd64. 2025-03-14T05:40:45.2798846Z Preparing to unpack .../015-libcolord2_1.4.5-3_amd64.deb ... 2025-03-14T05:40:45.2822248Z Unpacking libcolord2:amd64 (1.4.5-3) ... 2025-03-14T05:40:45.3121977Z Selecting previously unselected package libdata-dump-perl. 2025-03-14T05:40:45.3159151Z Preparing to unpack .../016-libdata-dump-perl_1.23-1.1_all.deb ... 2025-03-14T05:40:45.3182749Z Unpacking libdata-dump-perl (1.23-1.1) ... 2025-03-14T05:40:45.3386125Z Selecting previously unselected package libencode-locale-perl. 2025-03-14T05:40:45.3417332Z Preparing to unpack .../017-libencode-locale-perl_1.05-1.1_all.deb ... 2025-03-14T05:40:45.3441684Z Unpacking libencode-locale-perl (1.05-1.1) ... 2025-03-14T05:40:45.3653158Z Selecting previously unselected package libepoxy0:amd64. 2025-03-14T05:40:45.3688451Z Preparing to unpack .../018-libepoxy0_1.5.5-1_amd64.deb ... 2025-03-14T05:40:45.3711701Z Unpacking libepoxy0:amd64 (1.5.5-1) ... 2025-03-14T05:40:45.4041498Z Selecting previously unselected package libipc-system-simple-perl. 2025-03-14T05:40:45.4076115Z Preparing to unpack .../019-libipc-system-simple-perl_1.30-1_all.deb ... 2025-03-14T05:40:45.4091084Z Unpacking libipc-system-simple-perl (1.30-1) ... 2025-03-14T05:40:45.4269094Z Selecting previously unselected package libfile-basedir-perl. 2025-03-14T05:40:45.4306925Z Preparing to unpack .../020-libfile-basedir-perl_0.08-1_all.deb ... 2025-03-14T05:40:45.4324397Z Unpacking libfile-basedir-perl (0.08-1) ... 2025-03-14T05:40:45.4522304Z Selecting previously unselected package liburi-perl. 2025-03-14T05:40:45.4557539Z Preparing to unpack .../021-liburi-perl_5.08-1_all.deb ... 2025-03-14T05:40:45.4572758Z Unpacking liburi-perl (5.08-1) ... 2025-03-14T05:40:45.4830979Z Selecting previously unselected package libfile-desktopentry-perl. 2025-03-14T05:40:45.4867216Z Preparing to unpack .../022-libfile-desktopentry-perl_0.22-2_all.deb ... 2025-03-14T05:40:45.4886018Z Unpacking libfile-desktopentry-perl (0.22-2) ... 2025-03-14T05:40:45.5082110Z Selecting previously unselected package libtimedate-perl. 2025-03-14T05:40:45.5117421Z Preparing to unpack .../023-libtimedate-perl_2.3300-2_all.deb ... 2025-03-14T05:40:45.5131781Z Unpacking libtimedate-perl (2.3300-2) ... 2025-03-14T05:40:45.5360679Z Selecting previously unselected package libhttp-date-perl. 2025-03-14T05:40:45.5397583Z Preparing to unpack .../024-libhttp-date-perl_6.05-1_all.deb ... 2025-03-14T05:40:45.5414449Z Unpacking libhttp-date-perl (6.05-1) ... 2025-03-14T05:40:45.5618165Z Selecting previously unselected package libfile-listing-perl. 2025-03-14T05:40:45.5651384Z Preparing to unpack .../025-libfile-listing-perl_6.14-1_all.deb ... 2025-03-14T05:40:45.5672858Z Unpacking libfile-listing-perl (6.14-1) ... 2025-03-14T05:40:45.5872555Z Selecting previously unselected package libfile-mimeinfo-perl. 2025-03-14T05:40:45.5910209Z Preparing to unpack .../026-libfile-mimeinfo-perl_0.30-1_all.deb ... 2025-03-14T05:40:45.5928585Z Unpacking libfile-mimeinfo-perl (0.30-1) ... 2025-03-14T05:40:45.6149767Z Selecting previously unselected package libfont-afm-perl. 2025-03-14T05:40:45.6185805Z Preparing to unpack .../027-libfont-afm-perl_1.20-3_all.deb ... 2025-03-14T05:40:45.6208104Z Unpacking libfont-afm-perl (1.20-3) ... 2025-03-14T05:40:45.6411079Z Selecting previously unselected package libjson-glib-1.0-common. 2025-03-14T05:40:45.6447287Z Preparing to unpack .../028-libjson-glib-1.0-common_1.6.2-1_all.deb ... 2025-03-14T05:40:45.6466427Z Unpacking libjson-glib-1.0-common (1.6.2-1) ... 2025-03-14T05:40:45.6754078Z Selecting previously unselected package libjson-glib-1.0-0:amd64. 2025-03-14T05:40:45.6790126Z Preparing to unpack .../029-libjson-glib-1.0-0_1.6.2-1_amd64.deb ... 2025-03-14T05:40:45.6810183Z Unpacking libjson-glib-1.0-0:amd64 (1.6.2-1) ... 2025-03-14T05:40:45.7084012Z Selecting previously unselected package libsoup2.4-1:amd64. 2025-03-14T05:40:45.7118781Z Preparing to unpack .../030-libsoup2.4-1_2.72.0-2+deb11u1_amd64.deb ... 2025-03-14T05:40:45.7133926Z Unpacking libsoup2.4-1:amd64 (2.72.0-2+deb11u1) ... 2025-03-14T05:40:45.7533039Z Selecting previously unselected package libsoup-gnome2.4-1:amd64. 2025-03-14T05:40:45.7567961Z Preparing to unpack .../031-libsoup-gnome2.4-1_2.72.0-2+deb11u1_amd64.deb ... 2025-03-14T05:40:45.7590524Z Unpacking libsoup-gnome2.4-1:amd64 (2.72.0-2+deb11u1) ... 2025-03-14T05:40:45.7815734Z Selecting previously unselected package librest-0.7-0:amd64. 2025-03-14T05:40:45.7849795Z Preparing to unpack .../032-librest-0.7-0_0.8.1-1.1_amd64.deb ... 2025-03-14T05:40:45.7869647Z Unpacking librest-0.7-0:amd64 (0.8.1-1.1) ... 2025-03-14T05:40:45.8106037Z Selecting previously unselected package libwayland-cursor0:amd64. 2025-03-14T05:40:45.8137929Z Preparing to unpack .../033-libwayland-cursor0_1.18.0-2~exp1.1_amd64.deb ... 2025-03-14T05:40:45.8161900Z Unpacking libwayland-cursor0:amd64 (1.18.0-2~exp1.1) ... 2025-03-14T05:40:45.8380647Z Selecting previously unselected package libwayland-egl1:amd64. 2025-03-14T05:40:45.8412455Z Preparing to unpack .../034-libwayland-egl1_1.18.0-2~exp1.1_amd64.deb ... 2025-03-14T05:40:45.8437331Z Unpacking libwayland-egl1:amd64 (1.18.0-2~exp1.1) ... 2025-03-14T05:40:45.8643856Z Selecting previously unselected package libxcursor1:amd64. 2025-03-14T05:40:45.8673883Z Preparing to unpack .../035-libxcursor1_1%3a1.2.0-2_amd64.deb ... 2025-03-14T05:40:45.8696340Z Unpacking libxcursor1:amd64 (1:1.2.0-2) ... 2025-03-14T05:40:45.8922417Z Selecting previously unselected package libgtk-3-common. 2025-03-14T05:40:45.8955976Z Preparing to unpack .../036-libgtk-3-common_3.24.24-4+deb11u4_all.deb ... 2025-03-14T05:40:45.8966989Z Unpacking libgtk-3-common (3.24.24-4+deb11u4) ... 2025-03-14T05:40:46.2064821Z Selecting previously unselected package libgtk-3-0:amd64. 2025-03-14T05:40:46.2108814Z Preparing to unpack .../037-libgtk-3-0_3.24.24-4+deb11u4_amd64.deb ... 2025-03-14T05:40:46.2126900Z Unpacking libgtk-3-0:amd64 (3.24.24-4+deb11u4) ... 2025-03-14T05:40:46.4143485Z Selecting previously unselected package libgtk-3-bin. 2025-03-14T05:40:46.4185514Z Preparing to unpack .../038-libgtk-3-bin_3.24.24-4+deb11u4_amd64.deb ... 2025-03-14T05:40:46.4203197Z Unpacking libgtk-3-bin (3.24.24-4+deb11u4) ... 2025-03-14T05:40:46.4472450Z Selecting previously unselected package libhtml-tagset-perl. 2025-03-14T05:40:46.4514512Z Preparing to unpack .../039-libhtml-tagset-perl_3.20-4_all.deb ... 2025-03-14T05:40:46.4527474Z Unpacking libhtml-tagset-perl (3.20-4) ... 2025-03-14T05:40:46.4708212Z Selecting previously unselected package libhtml-parser-perl. 2025-03-14T05:40:46.4746734Z Preparing to unpack .../040-libhtml-parser-perl_3.75-1+b1_amd64.deb ... 2025-03-14T05:40:46.4766304Z Unpacking libhtml-parser-perl (3.75-1+b1) ... 2025-03-14T05:40:46.5032837Z Selecting previously unselected package libio-html-perl. 2025-03-14T05:40:46.5067884Z Preparing to unpack .../041-libio-html-perl_1.004-2_all.deb ... 2025-03-14T05:40:46.5089572Z Unpacking libio-html-perl (1.004-2) ... 2025-03-14T05:40:46.5290281Z Selecting previously unselected package liblwp-mediatypes-perl. 2025-03-14T05:40:46.5327181Z Preparing to unpack .../042-liblwp-mediatypes-perl_6.04-1_all.deb ... 2025-03-14T05:40:46.5348732Z Unpacking liblwp-mediatypes-perl (6.04-1) ... 2025-03-14T05:40:46.5552854Z Selecting previously unselected package libhttp-message-perl. 2025-03-14T05:40:46.5589680Z Preparing to unpack .../043-libhttp-message-perl_6.28-1_all.deb ... 2025-03-14T05:40:46.5607025Z Unpacking libhttp-message-perl (6.28-1) ... 2025-03-14T05:40:46.5866478Z Selecting previously unselected package libhtml-form-perl. 2025-03-14T05:40:46.5896839Z Preparing to unpack .../044-libhtml-form-perl_6.07-1_all.deb ... 2025-03-14T05:40:46.5922684Z Unpacking libhtml-form-perl (6.07-1) ... 2025-03-14T05:40:46.6121997Z Selecting previously unselected package libhtml-tree-perl. 2025-03-14T05:40:46.6159539Z Preparing to unpack .../045-libhtml-tree-perl_5.07-2_all.deb ... 2025-03-14T05:40:46.6174690Z Unpacking libhtml-tree-perl (5.07-2) ... 2025-03-14T05:40:46.6514407Z Selecting previously unselected package libhtml-format-perl. 2025-03-14T05:40:46.6550061Z Preparing to unpack .../046-libhtml-format-perl_2.12-1.1_all.deb ... 2025-03-14T05:40:46.6569455Z Unpacking libhtml-format-perl (2.12-1.1) ... 2025-03-14T05:40:46.6801654Z Selecting previously unselected package libhttp-cookies-perl. 2025-03-14T05:40:46.6837009Z Preparing to unpack .../047-libhttp-cookies-perl_6.10-1_all.deb ... 2025-03-14T05:40:46.6850232Z Unpacking libhttp-cookies-perl (6.10-1) ... 2025-03-14T05:40:46.7061292Z Selecting previously unselected package libhttp-daemon-perl. 2025-03-14T05:40:46.7093843Z Preparing to unpack .../048-libhttp-daemon-perl_6.12-1+deb11u1_all.deb ... 2025-03-14T05:40:46.7117608Z Unpacking libhttp-daemon-perl (6.12-1+deb11u1) ... 2025-03-14T05:40:46.7325043Z Selecting previously unselected package libhttp-negotiate-perl. 2025-03-14T05:40:46.7360386Z Preparing to unpack .../049-libhttp-negotiate-perl_6.01-1_all.deb ... 2025-03-14T05:40:46.7375530Z Unpacking libhttp-negotiate-perl (6.01-1) ... 2025-03-14T05:40:46.7568944Z Selecting previously unselected package perl-openssl-defaults:amd64. 2025-03-14T05:40:46.7606418Z Preparing to unpack .../050-perl-openssl-defaults_5_amd64.deb ... 2025-03-14T05:40:46.7626752Z Unpacking perl-openssl-defaults:amd64 (5) ... 2025-03-14T05:40:46.7836692Z Selecting previously unselected package libnet-ssleay-perl. 2025-03-14T05:40:46.7868647Z Preparing to unpack .../051-libnet-ssleay-perl_1.88-3+b1_amd64.deb ... 2025-03-14T05:40:46.7888716Z Unpacking libnet-ssleay-perl (1.88-3+b1) ... 2025-03-14T05:40:46.8322080Z Selecting previously unselected package libio-socket-ssl-perl. 2025-03-14T05:40:46.8359366Z Preparing to unpack .../052-libio-socket-ssl-perl_2.069-1_all.deb ... 2025-03-14T05:40:46.8376254Z Unpacking libio-socket-ssl-perl (2.069-1) ... 2025-03-14T05:40:46.8721721Z Selecting previously unselected package libjs-highlight.js. 2025-03-14T05:40:46.8757789Z Preparing to unpack .../053-libjs-highlight.js_9.18.5+dfsg1-1_all.deb ... 2025-03-14T05:40:46.8776215Z Unpacking libjs-highlight.js (9.18.5+dfsg1-1) ... 2025-03-14T05:40:46.9272481Z Selecting previously unselected package libjs-inherits. 2025-03-14T05:40:46.9310112Z Preparing to unpack .../054-libjs-inherits_2.0.4-1_all.deb ... 2025-03-14T05:40:46.9329894Z Unpacking libjs-inherits (2.0.4-1) ... 2025-03-14T05:40:46.9523498Z Selecting previously unselected package libjs-is-typedarray. 2025-03-14T05:40:46.9558816Z Preparing to unpack .../055-libjs-is-typedarray_1.0.0-3_all.deb ... 2025-03-14T05:40:46.9574389Z Unpacking libjs-is-typedarray (1.0.0-3) ... 2025-03-14T05:40:46.9770591Z Selecting previously unselected package libjs-psl. 2025-03-14T05:40:46.9807092Z Preparing to unpack .../056-libjs-psl_1.8.0+ds-4_all.deb ... 2025-03-14T05:40:46.9828500Z Unpacking libjs-psl (1.8.0+ds-4) ... 2025-03-14T05:40:47.0065968Z Selecting previously unselected package libjs-typedarray-to-buffer. 2025-03-14T05:40:47.0097113Z Preparing to unpack .../057-libjs-typedarray-to-buffer_4.0.0-1_all.deb ... 2025-03-14T05:40:47.0119871Z Unpacking libjs-typedarray-to-buffer (4.0.0-1) ... 2025-03-14T05:40:47.0329895Z Selecting previously unselected package liblua5.3-0:amd64. 2025-03-14T05:40:47.0367064Z Preparing to unpack .../058-liblua5.3-0_5.3.3-1.1+deb11u1_amd64.deb ... 2025-03-14T05:40:47.0386111Z Unpacking liblua5.3-0:amd64 (5.3.3-1.1+deb11u1) ... 2025-03-14T05:40:47.0653419Z Selecting previously unselected package libnet-http-perl. 2025-03-14T05:40:47.0688971Z Preparing to unpack .../059-libnet-http-perl_6.20-1_all.deb ... 2025-03-14T05:40:47.0711157Z Unpacking libnet-http-perl (6.20-1) ... 2025-03-14T05:40:47.0912534Z Selecting previously unselected package libtry-tiny-perl. 2025-03-14T05:40:47.0948245Z Preparing to unpack .../060-libtry-tiny-perl_0.30-1_all.deb ... 2025-03-14T05:40:47.0966651Z Unpacking libtry-tiny-perl (0.30-1) ... 2025-03-14T05:40:47.1169112Z Selecting previously unselected package libwww-robotrules-perl. 2025-03-14T05:40:47.1206851Z Preparing to unpack .../061-libwww-robotrules-perl_6.02-1_all.deb ... 2025-03-14T05:40:47.1226676Z Unpacking libwww-robotrules-perl (6.02-1) ... 2025-03-14T05:40:47.1436799Z Selecting previously unselected package libwww-perl. 2025-03-14T05:40:47.1469480Z Preparing to unpack .../062-libwww-perl_6.52-1_all.deb ... 2025-03-14T05:40:47.1489807Z Unpacking libwww-perl (6.52-1) ... 2025-03-14T05:40:47.1810804Z Selecting previously unselected package liblwp-protocol-https-perl. 2025-03-14T05:40:47.1847112Z Preparing to unpack .../063-liblwp-protocol-https-perl_6.10-1_all.deb ... 2025-03-14T05:40:47.1868462Z Unpacking liblwp-protocol-https-perl (6.10-1) ... 2025-03-14T05:40:47.2069227Z Selecting previously unselected package libnet-smtp-ssl-perl. 2025-03-14T05:40:47.2107412Z Preparing to unpack .../064-libnet-smtp-ssl-perl_1.04-1_all.deb ... 2025-03-14T05:40:47.2127137Z Unpacking libnet-smtp-ssl-perl (1.04-1) ... 2025-03-14T05:40:47.2329968Z Selecting previously unselected package libmailtools-perl. 2025-03-14T05:40:47.2367328Z Preparing to unpack .../065-libmailtools-perl_2.21-1_all.deb ... 2025-03-14T05:40:47.2385602Z Unpacking libmailtools-perl (2.21-1) ... 2025-03-14T05:40:47.2656924Z Selecting previously unselected package libxml-parser-perl:amd64. 2025-03-14T05:40:47.2693801Z Preparing to unpack .../066-libxml-parser-perl_2.46-2_amd64.deb ... 2025-03-14T05:40:47.2717085Z Unpacking libxml-parser-perl:amd64 (2.46-2) ... 2025-03-14T05:40:47.3061694Z Selecting previously unselected package libxml-twig-perl. 2025-03-14T05:40:47.3095683Z Preparing to unpack .../067-libxml-twig-perl_1%3a3.52-1_all.deb ... 2025-03-14T05:40:47.3118791Z Unpacking libxml-twig-perl (1:3.52-1) ... 2025-03-14T05:40:47.3429691Z Selecting previously unselected package libnet-dbus-perl. 2025-03-14T05:40:47.3467458Z Preparing to unpack .../068-libnet-dbus-perl_1.2.0-1+b1_amd64.deb ... 2025-03-14T05:40:47.3487841Z Unpacking libnet-dbus-perl (1.2.0-1+b1) ... 2025-03-14T05:40:47.3919297Z Selecting previously unselected package libuv1:amd64. 2025-03-14T05:40:47.3956593Z Preparing to unpack .../069-libuv1_1.40.0-2+deb11u1_amd64.deb ... 2025-03-14T05:40:47.3995800Z Unpacking libuv1:amd64 (1.40.0-2+deb11u1) ... 2025-03-14T05:40:47.4364233Z Selecting previously unselected package libuv1-dev:amd64. 2025-03-14T05:40:47.4399630Z Preparing to unpack .../070-libuv1-dev_1.40.0-2+deb11u1_amd64.deb ... 2025-03-14T05:40:47.4446814Z Unpacking libuv1-dev:amd64 (1.40.0-2+deb11u1) ... 2025-03-14T05:40:47.4891252Z Selecting previously unselected package libnode72:amd64. 2025-03-14T05:40:47.4927434Z Preparing to unpack .../071-libnode72_12.22.12~dfsg-1~deb11u6_amd64.deb ... 2025-03-14T05:40:47.4967444Z Unpacking libnode72:amd64 (12.22.12~dfsg-1~deb11u6) ... 2025-03-14T05:40:48.0873049Z Selecting previously unselected package libnode-dev. 2025-03-14T05:40:48.0918713Z Preparing to unpack .../072-libnode-dev_12.22.12~dfsg-1~deb11u6_amd64.deb ... 2025-03-14T05:40:48.0961079Z Unpacking libnode-dev (12.22.12~dfsg-1~deb11u6) ... 2025-03-14T05:40:48.1571594Z Selecting previously unselected package libtext-iconv-perl. 2025-03-14T05:40:48.1617658Z Preparing to unpack .../073-libtext-iconv-perl_1.7-7+b1_amd64.deb ... 2025-03-14T05:40:48.1662774Z Unpacking libtext-iconv-perl (1.7-7+b1) ... 2025-03-14T05:40:48.1969749Z Selecting previously unselected package libtie-ixhash-perl. 2025-03-14T05:40:48.2008095Z Preparing to unpack .../074-libtie-ixhash-perl_1.23-2.1_all.deb ... 2025-03-14T05:40:48.2050156Z Unpacking libtie-ixhash-perl (1.23-2.1) ... 2025-03-14T05:40:48.2401993Z Selecting previously unselected package libvte-2.91-common. 2025-03-14T05:40:48.2438427Z Preparing to unpack .../075-libvte-2.91-common_0.62.3-1_amd64.deb ... 2025-03-14T05:40:48.2479495Z Unpacking libvte-2.91-common (0.62.3-1) ... 2025-03-14T05:40:48.2996504Z Selecting previously unselected package libvte-2.91-0:amd64. 2025-03-14T05:40:48.3032767Z Preparing to unpack .../076-libvte-2.91-0_0.62.3-1_amd64.deb ... 2025-03-14T05:40:48.3077168Z Unpacking libvte-2.91-0:amd64 (0.62.3-1) ... 2025-03-14T05:40:48.3522754Z Selecting previously unselected package libx11-protocol-perl. 2025-03-14T05:40:48.3557231Z Preparing to unpack .../077-libx11-protocol-perl_0.56-7.1_all.deb ... 2025-03-14T05:40:48.3602269Z Unpacking libx11-protocol-perl (0.56-7.1) ... 2025-03-14T05:40:48.4021164Z Selecting previously unselected package libxml-xpathengine-perl. 2025-03-14T05:40:48.4055655Z Preparing to unpack .../078-libxml-xpathengine-perl_0.14-1_all.deb ... 2025-03-14T05:40:48.4105326Z Unpacking libxml-xpathengine-perl (0.14-1) ... 2025-03-14T05:40:48.4459107Z Selecting previously unselected package nodejs. 2025-03-14T05:40:48.4494760Z Preparing to unpack .../079-nodejs_12.22.12~dfsg-1~deb11u6_amd64.deb ... 2025-03-14T05:40:48.4539365Z Unpacking nodejs (12.22.12~dfsg-1~deb11u6) ... 2025-03-14T05:40:48.4949872Z Selecting previously unselected package node-abbrev. 2025-03-14T05:40:48.4988241Z Preparing to unpack .../080-node-abbrev_1.1.1-2_all.deb ... 2025-03-14T05:40:48.5028737Z Unpacking node-abbrev (1.1.1-2) ... 2025-03-14T05:40:48.5312295Z Selecting previously unselected package node-ms. 2025-03-14T05:40:48.5348897Z Preparing to unpack .../081-node-ms_2.1.3+~cs0.7.31-1_all.deb ... 2025-03-14T05:40:48.5394328Z Unpacking node-ms (2.1.3+~cs0.7.31-1) ... 2025-03-14T05:40:48.5873799Z Selecting previously unselected package node-debug. 2025-03-14T05:40:48.5912353Z Preparing to unpack .../082-node-debug_4.3.1+~cs4.1.5-1_all.deb ... 2025-03-14T05:40:48.5959341Z Unpacking node-debug (4.3.1+~cs4.1.5-1) ... 2025-03-14T05:40:48.6270946Z Selecting previously unselected package node-yallist. 2025-03-14T05:40:48.6310431Z Preparing to unpack .../083-node-yallist_4.0.0-1_all.deb ... 2025-03-14T05:40:48.6353802Z Unpacking node-yallist (4.0.0-1) ... 2025-03-14T05:40:48.6650542Z Selecting previously unselected package node-lru-cache. 2025-03-14T05:40:48.6687546Z Preparing to unpack .../084-node-lru-cache_5.1.1-5_all.deb ... 2025-03-14T05:40:48.6732400Z Unpacking node-lru-cache (5.1.1-5) ... 2025-03-14T05:40:48.7042996Z Selecting previously unselected package node-semver. 2025-03-14T05:40:48.7079844Z Preparing to unpack .../085-node-semver_7.3.4-1_all.deb ... 2025-03-14T05:40:48.7128015Z Unpacking node-semver (7.3.4-1) ... 2025-03-14T05:40:48.7530538Z Selecting previously unselected package node-agent-base. 2025-03-14T05:40:48.7567329Z Preparing to unpack .../086-node-agent-base_6.0.2-2_all.deb ... 2025-03-14T05:40:48.7608288Z Unpacking node-agent-base (6.0.2-2) ... 2025-03-14T05:40:48.7928322Z Selecting previously unselected package node-fast-deep-equal. 2025-03-14T05:40:48.7968534Z Preparing to unpack .../087-node-fast-deep-equal_3.1.3-1_all.deb ... 2025-03-14T05:40:48.8017925Z Unpacking node-fast-deep-equal (3.1.3-1) ... 2025-03-14T05:40:48.8329693Z Selecting previously unselected package node-json-schema-traverse. 2025-03-14T05:40:48.8367173Z Preparing to unpack .../088-node-json-schema-traverse_1.0.0-2_all.deb ... 2025-03-14T05:40:48.8418829Z Unpacking node-json-schema-traverse (1.0.0-2) ... 2025-03-14T05:40:48.8727831Z Selecting previously unselected package node-jsonify. 2025-03-14T05:40:48.8766190Z Preparing to unpack .../089-node-jsonify_0.0.0-1.1_all.deb ... 2025-03-14T05:40:48.8819031Z Unpacking node-jsonify (0.0.0-1.1) ... 2025-03-14T05:40:48.9128794Z Selecting previously unselected package node-json-stable-stringify. 2025-03-14T05:40:48.9167000Z Preparing to unpack .../090-node-json-stable-stringify_1.0.1+~cs5.1.32-1_all.deb ... 2025-03-14T05:40:48.9206929Z Unpacking node-json-stable-stringify (1.0.1+~cs5.1.32-1) ... 2025-03-14T05:40:48.9524909Z Selecting previously unselected package node-punycode. 2025-03-14T05:40:48.9559186Z Preparing to unpack .../091-node-punycode_2.1.1-3_all.deb ... 2025-03-14T05:40:48.9606409Z Unpacking node-punycode (2.1.1-3) ... 2025-03-14T05:40:48.9925969Z Selecting previously unselected package node-uri-js. 2025-03-14T05:40:48.9961312Z Preparing to unpack .../092-node-uri-js_4.4.0+dfsg-5_all.deb ... 2025-03-14T05:40:49.0005888Z Unpacking node-uri-js (4.4.0+dfsg-5) ... 2025-03-14T05:40:49.0361737Z Selecting previously unselected package node-ajv. 2025-03-14T05:40:49.0397713Z Preparing to unpack .../093-node-ajv_6.12.6-2_all.deb ... 2025-03-14T05:40:49.0444271Z Unpacking node-ajv (6.12.6-2) ... 2025-03-14T05:40:49.0848852Z Selecting previously unselected package node-ansi. 2025-03-14T05:40:49.0887354Z Preparing to unpack .../094-node-ansi_0.3.1-1_all.deb ... 2025-03-14T05:40:49.0930872Z Unpacking node-ansi (0.3.1-1) ... 2025-03-14T05:40:49.1249480Z Selecting previously unselected package node-ansi-regex. 2025-03-14T05:40:49.1287250Z Preparing to unpack .../095-node-ansi-regex_5.0.1-1~deb11u1_all.deb ... 2025-03-14T05:40:49.1329943Z Unpacking node-ansi-regex (5.0.1-1~deb11u1) ... 2025-03-14T05:40:49.1645317Z Selecting previously unselected package node-color-name. 2025-03-14T05:40:49.1683444Z Preparing to unpack .../096-node-color-name_1.1.4+~1.1.1-1_all.deb ... 2025-03-14T05:40:49.1726746Z Unpacking node-color-name (1.1.4+~1.1.1-1) ... 2025-03-14T05:40:49.2033270Z Selecting previously unselected package node-color-convert. 2025-03-14T05:40:49.2068564Z Preparing to unpack .../097-node-color-convert_1.9.3-1_all.deb ... 2025-03-14T05:40:49.2116227Z Unpacking node-color-convert (1.9.3-1) ... 2025-03-14T05:40:49.2425300Z Selecting previously unselected package node-ansi-styles. 2025-03-14T05:40:49.2460561Z Preparing to unpack .../098-node-ansi-styles_4.2.1-1_all.deb ... 2025-03-14T05:40:49.2511565Z Unpacking node-ansi-styles (4.2.1-1) ... 2025-03-14T05:40:49.2826310Z Selecting previously unselected package node-ansistyles. 2025-03-14T05:40:49.2862924Z Preparing to unpack .../099-node-ansistyles_0.1.3-2_all.deb ... 2025-03-14T05:40:49.2904269Z Unpacking node-ansistyles (0.1.3-2) ... 2025-03-14T05:40:49.3224701Z Selecting previously unselected package node-aproba. 2025-03-14T05:40:49.3260519Z Preparing to unpack .../100-node-aproba_2.0.0-1_all.deb ... 2025-03-14T05:40:49.3305976Z Unpacking node-aproba (2.0.0-1) ... 2025-03-14T05:40:49.3623197Z Selecting previously unselected package node-archy. 2025-03-14T05:40:49.3658071Z Preparing to unpack .../101-node-archy_1.0.0-3_all.deb ... 2025-03-14T05:40:49.3708507Z Unpacking node-archy (1.0.0-3) ... 2025-03-14T05:40:49.4025477Z Selecting previously unselected package node-delegates. 2025-03-14T05:40:49.4060845Z Preparing to unpack .../102-node-delegates_1.0.0-2_all.deb ... 2025-03-14T05:40:49.4110982Z Unpacking node-delegates (1.0.0-2) ... 2025-03-14T05:40:49.4433234Z Selecting previously unselected package node-inherits. 2025-03-14T05:40:49.4467464Z Preparing to unpack .../103-node-inherits_2.0.4-1_all.deb ... 2025-03-14T05:40:49.4520385Z Unpacking node-inherits (2.0.4-1) ... 2025-03-14T05:40:49.4821642Z Selecting previously unselected package node-core-util-is. 2025-03-14T05:40:49.4854396Z Preparing to unpack .../104-node-core-util-is_1.0.2-2_all.deb ... 2025-03-14T05:40:49.4904399Z Unpacking node-core-util-is (1.0.2-2) ... 2025-03-14T05:40:49.5218053Z Selecting previously unselected package node-safe-buffer. 2025-03-14T05:40:49.5254575Z Preparing to unpack .../105-node-safe-buffer_5.2.1+~cs2.1.2-1_all.deb ... 2025-03-14T05:40:49.5301971Z Unpacking node-safe-buffer (5.2.1+~cs2.1.2-1) ... 2025-03-14T05:40:49.5596168Z Selecting previously unselected package node-string-decoder. 2025-03-14T05:40:49.5633336Z Preparing to unpack .../106-node-string-decoder_1.3.0-2_all.deb ... 2025-03-14T05:40:49.5671124Z Unpacking node-string-decoder (1.3.0-2) ... 2025-03-14T05:40:49.5995215Z Selecting previously unselected package node-process-nextick-args. 2025-03-14T05:40:49.6031169Z Preparing to unpack .../107-node-process-nextick-args_2.0.0-1_all.deb ... 2025-03-14T05:40:49.6071605Z Unpacking node-process-nextick-args (2.0.0-1) ... 2025-03-14T05:40:49.6392287Z Selecting previously unselected package node-util-deprecate. 2025-03-14T05:40:49.6429691Z Preparing to unpack .../108-node-util-deprecate_1.0.2-1_all.deb ... 2025-03-14T05:40:49.6468496Z Unpacking node-util-deprecate (1.0.2-1) ... 2025-03-14T05:40:49.6786839Z Selecting previously unselected package node-isarray. 2025-03-14T05:40:49.6822688Z Preparing to unpack .../109-node-isarray_2.0.5-1_all.deb ... 2025-03-14T05:40:49.6868184Z Unpacking node-isarray (2.0.5-1) ... 2025-03-14T05:40:49.7169423Z Selecting previously unselected package node-readable-stream. 2025-03-14T05:40:49.7208624Z Preparing to unpack .../110-node-readable-stream_3.6.0-2_all.deb ... 2025-03-14T05:40:49.7257041Z Unpacking node-readable-stream (3.6.0-2) ... 2025-03-14T05:40:49.7618343Z Selecting previously unselected package node-are-we-there-yet. 2025-03-14T05:40:49.7642258Z Preparing to unpack .../111-node-are-we-there-yet_1.1.5-1_all.deb ... 2025-03-14T05:40:49.7688193Z Unpacking node-are-we-there-yet (1.1.5-1) ... 2025-03-14T05:40:49.8006135Z Selecting previously unselected package node-asap. 2025-03-14T05:40:49.8041541Z Preparing to unpack .../112-node-asap_2.0.6-2_all.deb ... 2025-03-14T05:40:49.8086908Z Unpacking node-asap (2.0.6-2) ... 2025-03-14T05:40:49.8409721Z Selecting previously unselected package node-asn1. 2025-03-14T05:40:49.8446811Z Preparing to unpack .../113-node-asn1_0.2.3-2_all.deb ... 2025-03-14T05:40:49.8493693Z Unpacking node-asn1 (0.2.3-2) ... 2025-03-14T05:40:49.8817005Z Selecting previously unselected package node-assert-plus. 2025-03-14T05:40:49.8853422Z Preparing to unpack .../114-node-assert-plus_1.0.0-2_all.deb ... 2025-03-14T05:40:49.8901030Z Unpacking node-assert-plus (1.0.0-2) ... 2025-03-14T05:40:49.9225051Z Selecting previously unselected package node-asynckit. 2025-03-14T05:40:49.9261460Z Preparing to unpack .../115-node-asynckit_0.4.0-3_all.deb ... 2025-03-14T05:40:49.9308738Z Unpacking node-asynckit (0.4.0-3) ... 2025-03-14T05:40:49.9636008Z Selecting previously unselected package node-aws-sign2. 2025-03-14T05:40:49.9670061Z Preparing to unpack .../116-node-aws-sign2_0.7.1-2_all.deb ... 2025-03-14T05:40:49.9717338Z Unpacking node-aws-sign2 (0.7.1-2) ... 2025-03-14T05:40:50.0032511Z Selecting previously unselected package node-aws4. 2025-03-14T05:40:50.0067618Z Preparing to unpack .../117-node-aws4_1.11.0-1_all.deb ... 2025-03-14T05:40:50.0113855Z Unpacking node-aws4 (1.11.0-1) ... 2025-03-14T05:40:50.0426774Z Selecting previously unselected package node-balanced-match. 2025-03-14T05:40:50.0462724Z Preparing to unpack .../118-node-balanced-match_1.0.0-1_all.deb ... 2025-03-14T05:40:50.0508280Z Unpacking node-balanced-match (1.0.0-1) ... 2025-03-14T05:40:50.0832144Z Selecting previously unselected package node-tweetnacl. 2025-03-14T05:40:50.0867948Z Preparing to unpack .../119-node-tweetnacl_1.0.3+dfsg-1_all.deb ... 2025-03-14T05:40:50.0913881Z Unpacking node-tweetnacl (1.0.3+dfsg-1) ... 2025-03-14T05:40:50.1255259Z Selecting previously unselected package node-bcrypt-pbkdf. 2025-03-14T05:40:50.1288626Z Preparing to unpack .../120-node-bcrypt-pbkdf_1.0.2-1_all.deb ... 2025-03-14T05:40:50.1334942Z Unpacking node-bcrypt-pbkdf (1.0.2-1) ... 2025-03-14T05:40:50.1649998Z Selecting previously unselected package node-brace-expansion. 2025-03-14T05:40:50.1687289Z Preparing to unpack .../121-node-brace-expansion_2.0.0-1_all.deb ... 2025-03-14T05:40:50.1735762Z Unpacking node-brace-expansion (2.0.0-1) ... 2025-03-14T05:40:50.2053818Z Selecting previously unselected package node-builtins. 2025-03-14T05:40:50.2087537Z Preparing to unpack .../122-node-builtins_1.0.3-2_all.deb ... 2025-03-14T05:40:50.2135541Z Unpacking node-builtins (1.0.3-2) ... 2025-03-14T05:40:50.2451060Z Selecting previously unselected package node-chownr. 2025-03-14T05:40:50.2487460Z Preparing to unpack .../123-node-chownr_1.1.3-5_all.deb ... 2025-03-14T05:40:50.2536957Z Unpacking node-chownr (1.1.3-5) ... 2025-03-14T05:40:50.2850129Z Selecting previously unselected package node-fs.realpath. 2025-03-14T05:40:50.2887003Z Preparing to unpack .../124-node-fs.realpath_1.0.0-1.1_all.deb ... 2025-03-14T05:40:50.2937579Z Unpacking node-fs.realpath (1.0.0-1.1) ... 2025-03-14T05:40:50.3234001Z Selecting previously unselected package node-wrappy. 2025-03-14T05:40:50.3267992Z Preparing to unpack .../125-node-wrappy_1.0.2-1.1_all.deb ... 2025-03-14T05:40:50.3320817Z Unpacking node-wrappy (1.0.2-1.1) ... 2025-03-14T05:40:50.3636175Z Selecting previously unselected package node-once. 2025-03-14T05:40:50.3669429Z Preparing to unpack .../126-node-once_1.4.0-3_all.deb ... 2025-03-14T05:40:50.3719132Z Unpacking node-once (1.4.0-3) ... 2025-03-14T05:40:50.4023067Z Selecting previously unselected package node-inflight. 2025-03-14T05:40:50.4055541Z Preparing to unpack .../127-node-inflight_1.0.6-1.1_all.deb ... 2025-03-14T05:40:50.4102391Z Unpacking node-inflight (1.0.6-1.1) ... 2025-03-14T05:40:50.4411142Z Selecting previously unselected package node-minimatch. 2025-03-14T05:40:50.4447185Z Preparing to unpack .../128-node-minimatch_3.0.4+~3.0.3-1+deb11u2_all.deb ... 2025-03-14T05:40:50.4488463Z Unpacking node-minimatch (3.0.4+~3.0.3-1+deb11u2) ... 2025-03-14T05:40:50.4824656Z Selecting previously unselected package node-path-is-absolute. 2025-03-14T05:40:50.4861643Z Preparing to unpack .../129-node-path-is-absolute_2.0.0-1_all.deb ... 2025-03-14T05:40:50.4905996Z Unpacking node-path-is-absolute (2.0.0-1) ... 2025-03-14T05:40:50.5225212Z Selecting previously unselected package node-glob. 2025-03-14T05:40:50.5258278Z Preparing to unpack .../130-node-glob_7.1.6+~7.1.3-1_all.deb ... 2025-03-14T05:40:50.5304609Z Unpacking node-glob (7.1.6+~7.1.3-1) ... 2025-03-14T05:40:50.5697278Z Selecting previously unselected package node-graceful-fs. 2025-03-14T05:40:50.5733203Z Preparing to unpack .../131-node-graceful-fs_4.2.4+repack-1_all.deb ... 2025-03-14T05:40:50.5774549Z Unpacking node-graceful-fs (4.2.4+repack-1) ... 2025-03-14T05:40:50.6072185Z Selecting previously unselected package node-mkdirp. 2025-03-14T05:40:50.6112270Z Preparing to unpack .../132-node-mkdirp_1.0.4+~1.0.1-1_all.deb ... 2025-03-14T05:40:50.6156104Z Unpacking node-mkdirp (1.0.4+~1.0.1-1) ... 2025-03-14T05:40:50.6488195Z Selecting previously unselected package node-run-queue. 2025-03-14T05:40:50.6526819Z Preparing to unpack .../133-node-run-queue_2.0.0-1_all.deb ... 2025-03-14T05:40:50.6570472Z Unpacking node-run-queue (2.0.0-1) ... 2025-03-14T05:40:50.6872753Z Selecting previously unselected package node-rimraf. 2025-03-14T05:40:50.6910824Z Preparing to unpack .../134-node-rimraf_3.0.2-1_all.deb ... 2025-03-14T05:40:50.6957120Z Unpacking node-rimraf (3.0.2-1) ... 2025-03-14T05:40:50.7271839Z Selecting previously unselected package node-imurmurhash. 2025-03-14T05:40:50.7310385Z Preparing to unpack .../135-node-imurmurhash_0.1.4-1.1_all.deb ... 2025-03-14T05:40:50.7356747Z Unpacking node-imurmurhash (0.1.4-1.1) ... 2025-03-14T05:40:50.7669963Z Selecting previously unselected package node-iferr. 2025-03-14T05:40:50.7708281Z Preparing to unpack .../136-node-iferr_1.0.2-1_all.deb ... 2025-03-14T05:40:50.7752607Z Unpacking node-iferr (1.0.2-1) ... 2025-03-14T05:40:50.8052487Z Selecting previously unselected package node-fs-write-stream-atomic. 2025-03-14T05:40:50.8088982Z Preparing to unpack .../137-node-fs-write-stream-atomic_1.0.10-4_all.deb ... 2025-03-14T05:40:50.8135929Z Unpacking node-fs-write-stream-atomic (1.0.10-4) ... 2025-03-14T05:40:50.8442823Z Selecting previously unselected package node-copy-concurrently. 2025-03-14T05:40:50.8478543Z Preparing to unpack .../138-node-copy-concurrently_1.0.5-7_all.deb ... 2025-03-14T05:40:50.8526519Z Unpacking node-copy-concurrently (1.0.5-7) ... 2025-03-14T05:40:50.8834613Z Selecting previously unselected package node-move-concurrently. 2025-03-14T05:40:50.8868130Z Preparing to unpack .../139-node-move-concurrently_1.0.1-2_all.deb ... 2025-03-14T05:40:50.8920476Z Unpacking node-move-concurrently (1.0.1-2) ... 2025-03-14T05:40:50.9219738Z Selecting previously unselected package node-escape-string-regexp. 2025-03-14T05:40:50.9253390Z Preparing to unpack .../140-node-escape-string-regexp_4.0.0-1_all.deb ... 2025-03-14T05:40:50.9296018Z Unpacking node-escape-string-regexp (4.0.0-1) ... 2025-03-14T05:40:50.9624419Z Selecting previously unselected package node-indent-string. 2025-03-14T05:40:50.9656670Z Preparing to unpack .../141-node-indent-string_4.0.0-1_all.deb ... 2025-03-14T05:40:50.9706638Z Unpacking node-indent-string (4.0.0-1) ... 2025-03-14T05:40:51.0024604Z Selecting previously unselected package node-p-map. 2025-03-14T05:40:51.0055630Z Preparing to unpack .../142-node-p-map_4.0.0-1_all.deb ... 2025-03-14T05:40:51.0101758Z Unpacking node-p-map (4.0.0-1) ... 2025-03-14T05:40:51.0432096Z Selecting previously unselected package node-promise-inflight. 2025-03-14T05:40:51.0467929Z Preparing to unpack .../143-node-promise-inflight_1.0.1-1.1_all.deb ... 2025-03-14T05:40:51.0512833Z Unpacking node-promise-inflight (1.0.1-1.1) ... 2025-03-14T05:40:51.0832117Z Selecting previously unselected package node-ssri. 2025-03-14T05:40:51.0868585Z Preparing to unpack .../144-node-ssri_8.0.1-2_all.deb ... 2025-03-14T05:40:51.0910938Z Unpacking node-ssri (8.0.1-2) ... 2025-03-14T05:40:51.1230993Z Selecting previously unselected package node-unique-filename. 2025-03-14T05:40:51.1267789Z Preparing to unpack .../145-node-unique-filename_1.1.1+ds-1_all.deb ... 2025-03-14T05:40:51.1311446Z Unpacking node-unique-filename (1.1.1+ds-1) ... 2025-03-14T05:40:51.1632748Z Selecting previously unselected package node-cacache. 2025-03-14T05:40:51.1668462Z Preparing to unpack .../146-node-cacache_15.0.5+~cs13.9.21-1_all.deb ... 2025-03-14T05:40:51.1713362Z Unpacking node-cacache (15.0.5+~cs13.9.21-1) ... 2025-03-14T05:40:51.2072101Z Selecting previously unselected package node-caseless. 2025-03-14T05:40:51.2110278Z Preparing to unpack .../147-node-caseless_0.12.1-1_all.deb ... 2025-03-14T05:40:51.2157578Z Unpacking node-caseless (0.12.1-1) ... 2025-03-14T05:40:51.2470894Z Selecting previously unselected package node-has-flag. 2025-03-14T05:40:51.2509096Z Preparing to unpack .../148-node-has-flag_4.0.0-1_all.deb ... 2025-03-14T05:40:51.2556367Z Unpacking node-has-flag (4.0.0-1) ... 2025-03-14T05:40:51.2870474Z Selecting previously unselected package node-supports-color. 2025-03-14T05:40:51.2910358Z Preparing to unpack .../149-node-supports-color_8.1.0+~7.2.0-1_all.deb ... 2025-03-14T05:40:51.2957279Z Unpacking node-supports-color (8.1.0+~7.2.0-1) ... 2025-03-14T05:40:51.3270281Z Selecting previously unselected package node-chalk. 2025-03-14T05:40:51.3307933Z Preparing to unpack .../150-node-chalk_4.1.0-1_all.deb ... 2025-03-14T05:40:51.3354526Z Unpacking node-chalk (4.1.0-1) ... 2025-03-14T05:40:51.3668901Z Selecting previously unselected package node-clone. 2025-03-14T05:40:51.3707252Z Preparing to unpack .../151-node-clone_2.1.2-2_all.deb ... 2025-03-14T05:40:51.3752571Z Unpacking node-clone (2.1.2-2) ... 2025-03-14T05:40:51.4062481Z Selecting previously unselected package node-colors. 2025-03-14T05:40:51.4097075Z Preparing to unpack .../152-node-colors_1.4.0-1_all.deb ... 2025-03-14T05:40:51.4144744Z Unpacking node-colors (1.4.0-1) ... 2025-03-14T05:40:51.4488792Z Selecting previously unselected package node-strip-ansi. 2025-03-14T05:40:51.4526277Z Preparing to unpack .../153-node-strip-ansi_6.0.0-2_all.deb ... 2025-03-14T05:40:51.4570001Z Unpacking node-strip-ansi (6.0.0-2) ... 2025-03-14T05:40:51.4905280Z Selecting previously unselected package node-defaults. 2025-03-14T05:40:51.4940163Z Preparing to unpack .../154-node-defaults_1.0.3-2_all.deb ... 2025-03-14T05:40:51.4986411Z Unpacking node-defaults (1.0.3-2) ... 2025-03-14T05:40:51.5309771Z Selecting previously unselected package node-wcwidth.js. 2025-03-14T05:40:51.5347210Z Preparing to unpack .../155-node-wcwidth.js_1.0.0-1.1_all.deb ... 2025-03-14T05:40:51.5391611Z Unpacking node-wcwidth.js (1.0.0-1.1) ... 2025-03-14T05:40:51.5711349Z Selecting previously unselected package node-columnify. 2025-03-14T05:40:51.5748218Z Preparing to unpack .../156-node-columnify_1.5.4-3_all.deb ... 2025-03-14T05:40:51.5793760Z Unpacking node-columnify (1.5.4-3) ... 2025-03-14T05:40:51.6103151Z Selecting previously unselected package node-delayed-stream. 2025-03-14T05:40:51.6136375Z Preparing to unpack .../157-node-delayed-stream_1.0.0-4_all.deb ... 2025-03-14T05:40:51.6177095Z Unpacking node-delayed-stream (1.0.0-4) ... 2025-03-14T05:40:51.6489099Z Selecting previously unselected package node-combined-stream. 2025-03-14T05:40:51.6526780Z Preparing to unpack .../158-node-combined-stream_1.0.8-1_all.deb ... 2025-03-14T05:40:51.6568665Z Unpacking node-combined-stream (1.0.8-1) ... 2025-03-14T05:40:51.6889183Z Selecting previously unselected package node-concat-map. 2025-03-14T05:40:51.6926781Z Preparing to unpack .../159-node-concat-map_0.0.1-2_all.deb ... 2025-03-14T05:40:51.6970494Z Unpacking node-concat-map (0.0.1-2) ... 2025-03-14T05:40:51.7307092Z Selecting previously unselected package node-console-control-strings. 2025-03-14T05:40:51.7342514Z Preparing to unpack .../160-node-console-control-strings_1.1.0-2_all.deb ... 2025-03-14T05:40:51.7387953Z Unpacking node-console-control-strings (1.1.0-2) ... 2025-03-14T05:40:51.7819575Z Selecting previously unselected package node-dashdash. 2025-03-14T05:40:51.7856527Z Preparing to unpack .../161-node-dashdash_2.0.0-1_all.deb ... 2025-03-14T05:40:51.7885605Z Unpacking node-dashdash (2.0.0-1) ... 2025-03-14T05:40:51.8122314Z Selecting previously unselected package node-depd. 2025-03-14T05:40:51.8160937Z Preparing to unpack .../162-node-depd_2.0.0-1_all.deb ... 2025-03-14T05:40:51.8178455Z Unpacking node-depd (2.0.0-1) ... 2025-03-14T05:40:51.8408659Z Selecting previously unselected package node-jsbn. 2025-03-14T05:40:51.8446912Z Preparing to unpack .../163-node-jsbn_1.1.0-1.1_all.deb ... 2025-03-14T05:40:51.8469919Z Unpacking node-jsbn (1.1.0-1.1) ... 2025-03-14T05:40:51.8690715Z Selecting previously unselected package node-ecc-jsbn. 2025-03-14T05:40:51.8727213Z Preparing to unpack .../164-node-ecc-jsbn_0.2.0-2_all.deb ... 2025-03-14T05:40:51.8747852Z Unpacking node-ecc-jsbn (0.2.0-2) ... 2025-03-14T05:40:51.8970232Z Selecting previously unselected package node-iconv-lite. 2025-03-14T05:40:51.9007467Z Preparing to unpack .../165-node-iconv-lite_0.5.1-3_all.deb ... 2025-03-14T05:40:51.9028920Z Unpacking node-iconv-lite (0.5.1-3) ... 2025-03-14T05:40:51.9485336Z Selecting previously unselected package node-encoding. 2025-03-14T05:40:51.9523241Z Preparing to unpack .../166-node-encoding_0.1.13-1_all.deb ... 2025-03-14T05:40:51.9542685Z Unpacking node-encoding (0.1.13-1) ... 2025-03-14T05:40:51.9754759Z Selecting previously unselected package node-err-code. 2025-03-14T05:40:51.9791445Z Preparing to unpack .../167-node-err-code_2.0.3+dfsg-1_all.deb ... 2025-03-14T05:40:51.9812645Z Unpacking node-err-code (2.0.3+dfsg-1) ... 2025-03-14T05:40:52.0011791Z Selecting previously unselected package node-extend. 2025-03-14T05:40:52.0047790Z Preparing to unpack .../168-node-extend_3.0.2-1_all.deb ... 2025-03-14T05:40:52.0067833Z Unpacking node-extend (3.0.2-1) ... 2025-03-14T05:40:52.0272433Z Selecting previously unselected package node-extsprintf. 2025-03-14T05:40:52.0312379Z Preparing to unpack .../169-node-extsprintf_1.4.0-1_all.deb ... 2025-03-14T05:40:52.0327373Z Unpacking node-extsprintf (1.4.0-1) ... 2025-03-14T05:40:52.0533648Z Selecting previously unselected package node-forever-agent. 2025-03-14T05:40:52.0569237Z Preparing to unpack .../170-node-forever-agent_0.6.1-2_all.deb ... 2025-03-14T05:40:52.0590730Z Unpacking node-forever-agent (0.6.1-2) ... 2025-03-14T05:40:52.0832312Z Selecting previously unselected package node-mime. 2025-03-14T05:40:52.0868069Z Preparing to unpack .../171-node-mime_2.5.0+dfsg+~cs3.90.0-1_all.deb ... 2025-03-14T05:40:52.0928320Z Unpacking node-mime (2.5.0+dfsg+~cs3.90.0-1) ... 2025-03-14T05:40:52.1152225Z Selecting previously unselected package node-mime-types. 2025-03-14T05:40:52.1192428Z Preparing to unpack .../172-node-mime-types_2.1.28-1_all.deb ... 2025-03-14T05:40:52.1207373Z Unpacking node-mime-types (2.1.28-1) ... 2025-03-14T05:40:52.1426045Z Selecting previously unselected package node-form-data. 2025-03-14T05:40:52.1463913Z Preparing to unpack .../173-node-form-data_3.0.0-2_all.deb ... 2025-03-14T05:40:52.1487014Z Unpacking node-form-data (3.0.0-2) ... 2025-03-14T05:40:52.1703772Z Selecting previously unselected package node-function-bind. 2025-03-14T05:40:52.1736120Z Preparing to unpack .../174-node-function-bind_1.1.1+repack-1_all.deb ... 2025-03-14T05:40:52.1761223Z Unpacking node-function-bind (1.1.1+repack-1) ... 2025-03-14T05:40:52.1970659Z Selecting previously unselected package node-string-width. 2025-03-14T05:40:52.2007081Z Preparing to unpack .../175-node-string-width_4.2.0-1_all.deb ... 2025-03-14T05:40:52.2030726Z Unpacking node-string-width (4.2.0-1) ... 2025-03-14T05:40:52.2242468Z Selecting previously unselected package node-object-assign. 2025-03-14T05:40:52.2275814Z Preparing to unpack .../176-node-object-assign_4.1.1-3_all.deb ... 2025-03-14T05:40:52.2296229Z Unpacking node-object-assign (4.1.1-3) ... 2025-03-14T05:40:52.2491880Z Selecting previously unselected package node-has-unicode. 2025-03-14T05:40:52.2527323Z Preparing to unpack .../177-node-has-unicode_2.0.1-2_all.deb ... 2025-03-14T05:40:52.2548429Z Unpacking node-has-unicode (2.0.1-2) ... 2025-03-14T05:40:52.2733702Z Selecting previously unselected package node-wide-align. 2025-03-14T05:40:52.2769387Z Preparing to unpack .../178-node-wide-align_1.1.3-1_all.deb ... 2025-03-14T05:40:52.2788652Z Unpacking node-wide-align (1.1.3-1) ... 2025-03-14T05:40:52.2990594Z Selecting previously unselected package node-signal-exit. 2025-03-14T05:40:52.3028670Z Preparing to unpack .../179-node-signal-exit_3.0.3-1_all.deb ... 2025-03-14T05:40:52.3046192Z Unpacking node-signal-exit (3.0.3-1) ... 2025-03-14T05:40:52.3235846Z Selecting previously unselected package node-gauge. 2025-03-14T05:40:52.3270368Z Preparing to unpack .../180-node-gauge_2.7.4-1.1_all.deb ... 2025-03-14T05:40:52.3298688Z Unpacking node-gauge (2.7.4-1.1) ... 2025-03-14T05:40:52.3524838Z Selecting previously unselected package node-getpass. 2025-03-14T05:40:52.3559937Z Preparing to unpack .../181-node-getpass_0.1.7-1.1_all.deb ... 2025-03-14T05:40:52.3582046Z Unpacking node-getpass (0.1.7-1.1) ... 2025-03-14T05:40:52.3773682Z Selecting previously unselected package node-nopt. 2025-03-14T05:40:52.3809160Z Preparing to unpack .../182-node-nopt_5.0.0-1_all.deb ... 2025-03-14T05:40:52.3837437Z Unpacking node-nopt (5.0.0-1) ... 2025-03-14T05:40:52.4046775Z Selecting previously unselected package node-set-blocking. 2025-03-14T05:40:52.4084158Z Preparing to unpack .../183-node-set-blocking_2.0.0-1.1_all.deb ... 2025-03-14T05:40:52.4102046Z Unpacking node-set-blocking (2.0.0-1.1) ... 2025-03-14T05:40:52.4311169Z Selecting previously unselected package node-npmlog. 2025-03-14T05:40:52.4347583Z Preparing to unpack .../184-node-npmlog_4.1.2-2_all.deb ... 2025-03-14T05:40:52.4367192Z Unpacking node-npmlog (4.1.2-2) ... 2025-03-14T05:40:52.4554353Z Selecting previously unselected package node-osenv. 2025-03-14T05:40:52.4591323Z Preparing to unpack .../185-node-osenv_0.1.5-1_all.deb ... 2025-03-14T05:40:52.4606623Z Unpacking node-osenv (0.1.5-1) ... 2025-03-14T05:40:52.4805518Z Selecting previously unselected package node-tar. 2025-03-14T05:40:52.4841042Z Preparing to unpack .../186-node-tar_6.0.5+ds1+~cs11.3.9-1+deb11u2_all.deb ... 2025-03-14T05:40:52.4862798Z Unpacking node-tar (6.0.5+ds1+~cs11.3.9-1+deb11u2) ... 2025-03-14T05:40:52.5102990Z Selecting previously unselected package node-isexe. 2025-03-14T05:40:52.5135534Z Preparing to unpack .../187-node-isexe_2.0.0-5_all.deb ... 2025-03-14T05:40:52.5159299Z Unpacking node-isexe (2.0.0-5) ... 2025-03-14T05:40:52.5351835Z Selecting previously unselected package node-which. 2025-03-14T05:40:52.5391224Z Preparing to unpack .../188-node-which_2.0.2+~cs1.3.2-1_all.deb ... 2025-03-14T05:40:52.5407576Z Unpacking node-which (2.0.2+~cs1.3.2-1) ... 2025-03-14T05:40:52.5613737Z Selecting previously unselected package node-gyp. 2025-03-14T05:40:52.5649526Z Preparing to unpack .../189-node-gyp_7.1.2-4_all.deb ... 2025-03-14T05:40:52.5674870Z Unpacking node-gyp (7.1.2-4) ... 2025-03-14T05:40:52.5913162Z Selecting previously unselected package node-har-schema. 2025-03-14T05:40:52.5948738Z Preparing to unpack .../190-node-har-schema_2.0.0-4_all.deb ... 2025-03-14T05:40:52.5969720Z Unpacking node-har-schema (2.0.0-4) ... 2025-03-14T05:40:52.6175316Z Selecting previously unselected package node-har-validator. 2025-03-14T05:40:52.6211571Z Preparing to unpack .../191-node-har-validator_5.1.5-1_all.deb ... 2025-03-14T05:40:52.6230015Z Unpacking node-har-validator (5.1.5-1) ... 2025-03-14T05:40:52.6419749Z Selecting previously unselected package node-hosted-git-info. 2025-03-14T05:40:52.6455049Z Preparing to unpack .../192-node-hosted-git-info_3.0.8-1_all.deb ... 2025-03-14T05:40:52.6477372Z Unpacking node-hosted-git-info (3.0.8-1) ... 2025-03-14T05:40:52.6665254Z Selecting previously unselected package node-json-schema. 2025-03-14T05:40:52.6703121Z Preparing to unpack .../193-node-json-schema_0.3.0+~7.0.6-1+deb11u1_all.deb ... 2025-03-14T05:40:52.6726424Z Unpacking node-json-schema (0.3.0+~7.0.6-1+deb11u1) ... 2025-03-14T05:40:52.6945648Z Selecting previously unselected package node-verror. 2025-03-14T05:40:52.6982345Z Preparing to unpack .../194-node-verror_1.10.0-1.1_all.deb ... 2025-03-14T05:40:52.7004407Z Unpacking node-verror (1.10.0-1.1) ... 2025-03-14T05:40:52.7241212Z Selecting previously unselected package node-jsprim. 2025-03-14T05:40:52.7275780Z Preparing to unpack .../195-node-jsprim_2.0.0-1_all.deb ... 2025-03-14T05:40:52.7298598Z Unpacking node-jsprim (2.0.0-1) ... 2025-03-14T05:40:52.7494758Z Selecting previously unselected package node-sshpk. 2025-03-14T05:40:52.7530414Z Preparing to unpack .../196-node-sshpk_1.16.1+dfsg-2_all.deb ... 2025-03-14T05:40:52.7553452Z Unpacking node-sshpk (1.16.1+dfsg-2) ... 2025-03-14T05:40:52.7810224Z Selecting previously unselected package node-http-signature. 2025-03-14T05:40:52.7847461Z Preparing to unpack .../197-node-http-signature_1.3.5-1_all.deb ... 2025-03-14T05:40:52.7866822Z Unpacking node-http-signature (1.3.5-1) ... 2025-03-14T05:40:52.8066094Z Selecting previously unselected package node-https-proxy-agent. 2025-03-14T05:40:52.8103673Z Preparing to unpack .../198-node-https-proxy-agent_5.0.0-3_all.deb ... 2025-03-14T05:40:52.8123674Z Unpacking node-https-proxy-agent (5.0.0-3) ... 2025-03-14T05:40:52.8324812Z Selecting previously unselected package node-ini. 2025-03-14T05:40:52.8362231Z Preparing to unpack .../199-node-ini_2.0.0-1_all.deb ... 2025-03-14T05:40:52.8382320Z Unpacking node-ini (2.0.0-1) ... 2025-03-14T05:40:52.8586639Z Selecting previously unselected package node-ip. 2025-03-14T05:40:52.8624715Z Preparing to unpack .../200-node-ip_1.1.5-5_all.deb ... 2025-03-14T05:40:52.8645454Z Unpacking node-ip (1.1.5-5) ... 2025-03-14T05:40:52.8872355Z Selecting previously unselected package node-ip-regex. 2025-03-14T05:40:52.8912100Z Preparing to unpack .../201-node-ip-regex_4.3.0-1_all.deb ... 2025-03-14T05:40:52.8944457Z Unpacking node-ip-regex (4.3.0-1) ... 2025-03-14T05:40:52.9222491Z Selecting previously unselected package node-is-typedarray. 2025-03-14T05:40:52.9256378Z Preparing to unpack .../202-node-is-typedarray_1.0.0-3_all.deb ... 2025-03-14T05:40:52.9296816Z Unpacking node-is-typedarray (1.0.0-3) ... 2025-03-14T05:40:52.9605569Z Selecting previously unselected package node-isstream. 2025-03-14T05:40:52.9641673Z Preparing to unpack .../203-node-isstream_0.1.2+dfsg-1.1_all.deb ... 2025-03-14T05:40:52.9679235Z Unpacking node-isstream (0.1.2+dfsg-1.1) ... 2025-03-14T05:40:52.9996068Z Selecting previously unselected package node-json-parse-better-errors. 2025-03-14T05:40:53.0032780Z Preparing to unpack .../204-node-json-parse-better-errors_1.0.2+~2.3.1-1_all.deb ... 2025-03-14T05:40:53.0075206Z Unpacking node-json-parse-better-errors (1.0.2+~2.3.1-1) ... 2025-03-14T05:40:53.0395816Z Selecting previously unselected package node-json-stringify-safe. 2025-03-14T05:40:53.0434701Z Preparing to unpack .../205-node-json-stringify-safe_5.0.1+repack-3_all.deb ... 2025-03-14T05:40:53.0482207Z Unpacking node-json-stringify-safe (5.0.1+repack-3) ... 2025-03-14T05:40:53.0822568Z Selecting previously unselected package node-jsonparse. 2025-03-14T05:40:53.0856431Z Preparing to unpack .../206-node-jsonparse_1.3.1-7_all.deb ... 2025-03-14T05:40:53.0906464Z Unpacking node-jsonparse (1.3.1-7) ... 2025-03-14T05:40:53.1235118Z Selecting previously unselected package node-through. 2025-03-14T05:40:53.1269930Z Preparing to unpack .../207-node-through_2.3.8+~cs0.0.30-1_all.deb ... 2025-03-14T05:40:53.1318694Z Unpacking node-through (2.3.8+~cs0.0.30-1) ... 2025-03-14T05:40:53.1625829Z Selecting previously unselected package node-jsonstream. 2025-03-14T05:40:53.1662936Z Preparing to unpack .../208-node-jsonstream_1.3.5-1_all.deb ... 2025-03-14T05:40:53.1707801Z Unpacking node-jsonstream (1.3.5-1) ... 2025-03-14T05:40:53.2025694Z Selecting previously unselected package node-leven. 2025-03-14T05:40:53.2063187Z Preparing to unpack .../209-node-leven_3.1.0+~cs1.1.1-1_all.deb ... 2025-03-14T05:40:53.2110582Z Unpacking node-leven (3.1.0+~cs1.1.1-1) ... 2025-03-14T05:40:53.2425159Z Selecting previously unselected package node-lockfile. 2025-03-14T05:40:53.2461356Z Preparing to unpack .../210-node-lockfile_1.0.4-3_all.deb ... 2025-03-14T05:40:53.2512926Z Unpacking node-lockfile (1.0.4-3) ... 2025-03-14T05:40:53.2828536Z Selecting previously unselected package node-mute-stream. 2025-03-14T05:40:53.2864055Z Preparing to unpack .../211-node-mute-stream_0.0.8-2_all.deb ... 2025-03-14T05:40:53.2911835Z Unpacking node-mute-stream (0.0.8-2) ... 2025-03-14T05:40:53.3232307Z Selecting previously unselected package node-resolve. 2025-03-14T05:40:53.3268007Z Preparing to unpack .../212-node-resolve_1.19.0+~cs5.20.8-2_all.deb ... 2025-03-14T05:40:53.3319389Z Unpacking node-resolve (1.19.0+~cs5.20.8-2) ... 2025-03-14T05:40:53.3649756Z Selecting previously unselected package node-spdx-license-ids. 2025-03-14T05:40:53.3687482Z Preparing to unpack .../213-node-spdx-license-ids_3.0.7-1_all.deb ... 2025-03-14T05:40:53.3734991Z Unpacking node-spdx-license-ids (3.0.7-1) ... 2025-03-14T05:40:53.4048938Z Selecting previously unselected package node-spdx-exceptions. 2025-03-14T05:40:53.4087869Z Preparing to unpack .../214-node-spdx-exceptions_2.3.0-1_all.deb ... 2025-03-14T05:40:53.4133093Z Unpacking node-spdx-exceptions (2.3.0-1) ... 2025-03-14T05:40:53.4436631Z Selecting previously unselected package node-spdx-expression-parse. 2025-03-14T05:40:53.4471083Z Preparing to unpack .../215-node-spdx-expression-parse_3.0.1-1_all.deb ... 2025-03-14T05:40:53.4519326Z Unpacking node-spdx-expression-parse (3.0.1-1) ... 2025-03-14T05:40:53.4846581Z Selecting previously unselected package node-spdx-correct. 2025-03-14T05:40:53.4882820Z Preparing to unpack .../216-node-spdx-correct_3.1.1-1_all.deb ... 2025-03-14T05:40:53.4927374Z Unpacking node-spdx-correct (3.1.1-1) ... 2025-03-14T05:40:53.5236138Z Selecting previously unselected package node-validate-npm-package-license. 2025-03-14T05:40:53.5271610Z Preparing to unpack .../217-node-validate-npm-package-license_3.0.4-1_all.deb ... 2025-03-14T05:40:53.5319139Z Unpacking node-validate-npm-package-license (3.0.4-1) ... 2025-03-14T05:40:53.5635549Z Selecting previously unselected package node-normalize-package-data. 2025-03-14T05:40:53.5670693Z Preparing to unpack .../218-node-normalize-package-data_3.0.0+~2.4.0-1_all.deb ... 2025-03-14T05:40:53.5720407Z Unpacking node-normalize-package-data (3.0.0+~2.4.0-1) ... 2025-03-14T05:40:53.6026830Z Selecting previously unselected package node-npm-bundled. 2025-03-14T05:40:53.6064587Z Preparing to unpack .../219-node-npm-bundled_1.1.1-1_all.deb ... 2025-03-14T05:40:53.6110583Z Unpacking node-npm-bundled (1.1.1-1) ... 2025-03-14T05:40:53.6424650Z Selecting previously unselected package node-validate-npm-package-name. 2025-03-14T05:40:53.6459135Z Preparing to unpack .../220-node-validate-npm-package-name_3.0.0-1.1_all.deb ... 2025-03-14T05:40:53.6504350Z Unpacking node-validate-npm-package-name (3.0.0-1.1) ... 2025-03-14T05:40:53.6803834Z Selecting previously unselected package node-npm-package-arg. 2025-03-14T05:40:53.6840710Z Preparing to unpack .../221-node-npm-package-arg_8.1.0-1_all.deb ... 2025-03-14T05:40:53.6878695Z Unpacking node-npm-package-arg (8.1.0-1) ... 2025-03-14T05:40:53.7195953Z Selecting previously unselected package node-number-is-nan. 2025-03-14T05:40:53.7232554Z Preparing to unpack .../222-node-number-is-nan_2.0.0-1_all.deb ... 2025-03-14T05:40:53.7280461Z Unpacking node-number-is-nan (2.0.0-1) ... 2025-03-14T05:40:53.7595550Z Selecting previously unselected package node-oauth-sign. 2025-03-14T05:40:53.7632960Z Preparing to unpack .../223-node-oauth-sign_0.9.0-2_all.deb ... 2025-03-14T05:40:53.7679511Z Unpacking node-oauth-sign (0.9.0-2) ... 2025-03-14T05:40:53.8036014Z Selecting previously unselected package xdg-utils. 2025-03-14T05:40:53.8071058Z Preparing to unpack .../224-xdg-utils_1.1.3-4.1_all.deb ... 2025-03-14T05:40:53.8125384Z Unpacking xdg-utils (1.1.3-4.1) ... 2025-03-14T05:40:53.8489158Z Selecting previously unselected package node-opener. 2025-03-14T05:40:53.8527260Z Preparing to unpack .../225-node-opener_1.5.2-1_all.deb ... 2025-03-14T05:40:53.8569401Z Unpacking node-opener (1.5.2-1) ... 2025-03-14T05:40:53.8874479Z Selecting previously unselected package node-performance-now. 2025-03-14T05:40:53.8912919Z Preparing to unpack .../226-node-performance-now_2.1.0+debian-1.1_all.deb ... 2025-03-14T05:40:53.8962305Z Unpacking node-performance-now (2.1.0+debian-1.1) ... 2025-03-14T05:40:53.9273049Z Selecting previously unselected package node-retry. 2025-03-14T05:40:53.9312114Z Preparing to unpack .../227-node-retry_0.12.0-1_all.deb ... 2025-03-14T05:40:53.9358864Z Unpacking node-retry (0.12.0-1) ... 2025-03-14T05:40:53.9671100Z Selecting previously unselected package node-promise-retry. 2025-03-14T05:40:53.9710917Z Preparing to unpack .../228-node-promise-retry_2.0.1-1_all.deb ... 2025-03-14T05:40:53.9755786Z Unpacking node-promise-retry (2.0.1-1) ... 2025-03-14T05:40:54.0034257Z Selecting previously unselected package node-read. 2025-03-14T05:40:54.0068459Z Preparing to unpack .../229-node-read_1.0.7-2_all.deb ... 2025-03-14T05:40:54.0101541Z Unpacking node-read (1.0.7-2) ... 2025-03-14T05:40:54.0364291Z Selecting previously unselected package node-promzard. 2025-03-14T05:40:54.0401448Z Preparing to unpack .../230-node-promzard_0.3.0-1.1_all.deb ... 2025-03-14T05:40:54.0438625Z Unpacking node-promzard (0.3.0-1.1) ... 2025-03-14T05:40:54.0729685Z Selecting previously unselected package node-psl. 2025-03-14T05:40:54.0767209Z Preparing to unpack .../231-node-psl_1.8.0+ds-4_all.deb ... 2025-03-14T05:40:54.0809583Z Unpacking node-psl (1.8.0+ds-4) ... 2025-03-14T05:40:54.1131918Z Selecting previously unselected package node-puka. 2025-03-14T05:40:54.1168693Z Preparing to unpack .../232-node-puka_1.0.1+dfsg-2_all.deb ... 2025-03-14T05:40:54.1216822Z Unpacking node-puka (1.0.1+dfsg-2) ... 2025-03-14T05:40:54.1564980Z Selecting previously unselected package node-qs. 2025-03-14T05:40:54.1601977Z Preparing to unpack .../233-node-qs_6.9.4+ds-1+deb11u1_all.deb ... 2025-03-14T05:40:54.1647068Z Unpacking node-qs (6.9.4+ds-1+deb11u1) ... 2025-03-14T05:40:54.1971666Z Selecting previously unselected package node-slash. 2025-03-14T05:40:54.2008127Z Preparing to unpack .../234-node-slash_3.0.0-1_all.deb ... 2025-03-14T05:40:54.2050665Z Unpacking node-slash (3.0.0-1) ... 2025-03-14T05:40:54.2363070Z Selecting previously unselected package node-read-package-json. 2025-03-14T05:40:54.2400083Z Preparing to unpack .../235-node-read-package-json_3.0.0-1_all.deb ... 2025-03-14T05:40:54.2448741Z Unpacking node-read-package-json (3.0.0-1) ... 2025-03-14T05:40:54.2763047Z Selecting previously unselected package node-universalify. 2025-03-14T05:40:54.2800144Z Preparing to unpack .../236-node-universalify_2.0.0-2_all.deb ... 2025-03-14T05:40:54.2847420Z Unpacking node-universalify (2.0.0-2) ... 2025-03-14T05:40:54.3163636Z Selecting previously unselected package node-tough-cookie. 2025-03-14T05:40:54.3201398Z Preparing to unpack .../237-node-tough-cookie_4.0.0-2+deb11u1_all.deb ... 2025-03-14T05:40:54.3246499Z Unpacking node-tough-cookie (4.0.0-2+deb11u1) ... 2025-03-14T05:40:54.3595040Z Selecting previously unselected package node-tunnel-agent. 2025-03-14T05:40:54.3632328Z Preparing to unpack .../238-node-tunnel-agent_0.6.1-2_all.deb ... 2025-03-14T05:40:54.3675629Z Unpacking node-tunnel-agent (0.6.1-2) ... 2025-03-14T05:40:54.3994943Z Selecting previously unselected package node-uuid. 2025-03-14T05:40:54.4032355Z Preparing to unpack .../239-node-uuid_8.3.2+~8.3.0-4_all.deb ... 2025-03-14T05:40:54.4081551Z Unpacking node-uuid (8.3.2+~8.3.0-4) ... 2025-03-14T05:40:54.4464443Z Selecting previously unselected package node-request. 2025-03-14T05:40:54.4501292Z Preparing to unpack .../240-node-request_2.88.1-5_all.deb ... 2025-03-14T05:40:54.4546061Z Unpacking node-request (2.88.1-5) ... 2025-03-14T05:40:54.4890847Z Selecting previously unselected package node-resolve-from. 2025-03-14T05:40:54.4927379Z Preparing to unpack .../241-node-resolve-from_5.0.0+~3.1.0+~3.3.0+~2.0.0-1_all.deb ... 2025-03-14T05:40:54.4974653Z Unpacking node-resolve-from (5.0.0+~3.1.0+~3.3.0+~2.0.0-1) ... 2025-03-14T05:40:54.5313364Z Selecting previously unselected package node-text-table. 2025-03-14T05:40:54.5349919Z Preparing to unpack .../242-node-text-table_0.2.0-2_all.deb ... 2025-03-14T05:40:54.5397867Z Unpacking node-text-table (0.2.0-2) ... 2025-03-14T05:40:54.5713626Z Selecting previously unselected package node-typedarray-to-buffer. 2025-03-14T05:40:54.5750329Z Preparing to unpack .../243-node-typedarray-to-buffer_4.0.0-1_all.deb ... 2025-03-14T05:40:54.5797345Z Unpacking node-typedarray-to-buffer (4.0.0-1) ... 2025-03-14T05:40:54.6122275Z Selecting previously unselected package node-write-file-atomic. 2025-03-14T05:40:54.6159138Z Preparing to unpack .../244-node-write-file-atomic_3.0.3+~3.0.1-1_all.deb ... 2025-03-14T05:40:54.6209023Z Unpacking node-write-file-atomic (3.0.3+~3.0.1-1) ... 2025-03-14T05:40:54.6528700Z Selecting previously unselected package nodejs-doc. 2025-03-14T05:40:54.6566860Z Preparing to unpack .../245-nodejs-doc_12.22.12~dfsg-1~deb11u6_all.deb ... 2025-03-14T05:40:54.6608948Z Unpacking nodejs-doc (12.22.12~dfsg-1~deb11u6) ... 2025-03-14T05:40:54.8365845Z Selecting previously unselected package npm. 2025-03-14T05:40:54.8406759Z Preparing to unpack .../246-npm_7.5.2+ds-2_all.deb ... 2025-03-14T05:40:54.8559686Z Unpacking npm (7.5.2+ds-2) ... 2025-03-14T05:40:54.9744518Z Selecting previously unselected package termit. 2025-03-14T05:40:54.9787925Z Preparing to unpack .../247-termit_3.1-1_amd64.deb ... 2025-03-14T05:40:54.9838901Z Unpacking termit (3.1-1) ... 2025-03-14T05:40:55.0284846Z Selecting previously unselected package x11-xserver-utils. 2025-03-14T05:40:55.0327422Z Preparing to unpack .../248-x11-xserver-utils_7.7+8_amd64.deb ... 2025-03-14T05:40:55.0368402Z Unpacking x11-xserver-utils (7.7+8) ... 2025-03-14T05:40:55.1012567Z Setting up node-qs (6.9.4+ds-1+deb11u1) ... 2025-03-14T05:40:55.1168109Z Setting up libtext-iconv-perl (1.7-7+b1) ... 2025-03-14T05:40:55.1310660Z Setting up gtk-update-icon-cache (3.24.24-4+deb11u4) ... 2025-03-14T05:40:55.1446347Z Setting up node-extsprintf (1.4.0-1) ... 2025-03-14T05:40:55.1590558Z Setting up libproxy1v5:amd64 (0.4.17-1) ... 2025-03-14T05:40:55.1739888Z Setting up libtie-ixhash-perl (1.23-2.1) ... 2025-03-14T05:40:55.1883524Z Setting up libjs-inherits (2.0.4-1) ... 2025-03-14T05:40:55.2027128Z Setting up libfont-afm-perl (1.20-3) ... 2025-03-14T05:40:55.2155980Z Setting up libvte-2.91-common (0.62.3-1) ... 2025-03-14T05:40:55.2394134Z Setting up libclone-perl (0.45-1+b1) ... 2025-03-14T05:40:55.2534269Z Setting up libhtml-tagset-perl (3.20-4) ... 2025-03-14T05:40:55.2672428Z Setting up libauthen-sasl-perl (2.1600-1.1) ... 2025-03-14T05:40:55.2808698Z Setting up libxcursor1:amd64 (1:1.2.0-2) ... 2025-03-14T05:40:55.2955138Z Setting up liblwp-mediatypes-perl (6.04-1) ... 2025-03-14T05:40:55.3102136Z Setting up node-through (2.3.8+~cs0.0.30-1) ... 2025-03-14T05:40:55.3247177Z Setting up libtry-tiny-perl (0.30-1) ... 2025-03-14T05:40:55.3391306Z Setting up perl-openssl-defaults:amd64 (5) ... 2025-03-14T05:40:55.3539943Z Setting up node-color-name (1.1.4+~1.1.1-1) ... 2025-03-14T05:40:55.3669164Z Setting up libencode-locale-perl (1.05-1.1) ... 2025-03-14T05:40:55.3815643Z Setting up libc-ares2:amd64 (1.17.1-1+deb11u3) ... 2025-03-14T05:40:55.3961448Z Setting up node-uuid (8.3.2+~8.3.0-4) ... 2025-03-14T05:40:55.4110359Z Setting up x11-xserver-utils (7.7+8) ... 2025-03-14T05:40:55.4316137Z Setting up node-indent-string (4.0.0-1) ... 2025-03-14T05:40:55.4452640Z Setting up libcolord2:amd64 (1.4.5-3) ... 2025-03-14T05:40:55.4598414Z Setting up node-chownr (1.1.3-5) ... 2025-03-14T05:40:55.4749081Z Setting up libdconf1:amd64 (0.38.0-2) ... 2025-03-14T05:40:55.4879090Z Setting up libjs-psl (1.8.0+ds-4) ... 2025-03-14T05:40:55.5022655Z Setting up node-json-schema-traverse (1.0.0-2) ... 2025-03-14T05:40:55.5157016Z Setting up dbus-user-session (1.12.28-0+deb11u1) ... 2025-03-14T05:40:55.5349198Z Setting up node-universalify (2.0.0-2) ... 2025-03-14T05:40:55.5489137Z Setting up node-ini (2.0.0-1) ... 2025-03-14T05:40:55.5628574Z Setting up libuv1:amd64 (1.40.0-2+deb11u1) ... 2025-03-14T05:40:55.5767976Z Setting up node-json-parse-better-errors (1.0.2+~2.3.1-1) ... 2025-03-14T05:40:55.5893893Z Setting up node-fast-deep-equal (3.1.3-1) ... 2025-03-14T05:40:55.6044058Z Setting up node-err-code (2.0.3+dfsg-1) ... 2025-03-14T05:40:55.6176640Z Setting up adwaita-icon-theme (3.38.0-1) ... 2025-03-14T05:40:55.6790839Z update-alternatives: using /usr/share/icons/Adwaita/cursor.theme to provide /usr/share/icons/default/index.theme (x-cursor-theme) in auto mode 2025-03-14T05:40:55.6866687Z Setting up libdata-dump-perl (1.23-1.1) ... 2025-03-14T05:40:55.7020543Z Setting up node-resolve-from (5.0.0+~3.1.0+~3.3.0+~2.0.0-1) ... 2025-03-14T05:40:55.7157002Z Setting up libepoxy0:amd64 (1.5.5-1) ... 2025-03-14T05:40:55.7299646Z Setting up libipc-system-simple-perl (1.30-1) ... 2025-03-14T05:40:55.7415848Z Setting up libxml-xpathengine-perl (0.14-1) ... 2025-03-14T05:40:55.7538339Z Setting up libio-html-perl (1.004-2) ... 2025-03-14T05:40:55.7677314Z Setting up libtimedate-perl (2.3300-2) ... 2025-03-14T05:40:55.7815673Z Setting up libjs-typedarray-to-buffer (4.0.0-1) ... 2025-03-14T05:40:55.7947607Z Setting up libjs-highlight.js (9.18.5+dfsg1-1) ... 2025-03-14T05:40:55.8096685Z Setting up libwayland-cursor0:amd64 (1.18.0-2~exp1.1) ... 2025-03-14T05:40:55.8227410Z Setting up liblua5.3-0:amd64 (5.3.3-1.1+deb11u1) ... 2025-03-14T05:40:55.8368854Z Setting up libjson-glib-1.0-common (1.6.2-1) ... 2025-03-14T05:40:55.8514087Z Setting up node-json-schema (0.3.0+~7.0.6-1+deb11u1) ... 2025-03-14T05:40:55.8651021Z Setting up libwayland-egl1:amd64 (1.18.0-2~exp1.1) ... 2025-03-14T05:40:55.8784946Z Setting up glib-networking-common (2.66.0-2) ... 2025-03-14T05:40:55.8926903Z Setting up xdg-utils (1.1.3-4.1) ... 2025-03-14T05:40:55.9039766Z update-alternatives: using /usr/bin/xdg-open to provide /usr/bin/open (open) in auto mode 2025-03-14T05:40:55.9134197Z Setting up liburi-perl (5.08-1) ... 2025-03-14T05:40:55.9274350Z Setting up libx11-protocol-perl (0.56-7.1) ... 2025-03-14T05:40:55.9423797Z Setting up libjs-is-typedarray (1.0.0-3) ... 2025-03-14T05:40:55.9566667Z Setting up gyp (0.1+20200513gitcaa6002-2) ... 2025-03-14T05:40:56.1848291Z Setting up libnet-ssleay-perl (1.88-3+b1) ... 2025-03-14T05:40:56.2127227Z Setting up libuv1-dev:amd64 (1.40.0-2+deb11u1) ... 2025-03-14T05:40:56.2346664Z Setting up glib-networking-services (2.66.0-2) ... 2025-03-14T05:40:56.2571905Z Setting up libhttp-date-perl (6.05-1) ... 2025-03-14T05:40:56.2789376Z Setting up libfile-basedir-perl (0.08-1) ... 2025-03-14T05:40:56.2928864Z Setting up libfile-listing-perl (6.14-1) ... 2025-03-14T05:40:56.3080366Z Setting up libnet-http-perl (6.20-1) ... 2025-03-14T05:40:56.3225425Z Setting up dconf-service (0.38.0-2) ... 2025-03-14T05:40:56.3367501Z Setting up libnode72:amd64 (12.22.12~dfsg-1~deb11u6) ... 2025-03-14T05:40:56.3501381Z Setting up libjson-glib-1.0-0:amd64 (1.6.2-1) ... 2025-03-14T05:40:56.3646266Z Setting up libfile-desktopentry-perl (0.22-2) ... 2025-03-14T05:40:56.3788840Z Setting up nodejs-doc (12.22.12~dfsg-1~deb11u6) ... 2025-03-14T05:40:56.3927290Z Setting up node-is-typedarray (1.0.0-3) ... 2025-03-14T05:40:56.4064456Z Setting up libwww-robotrules-perl (6.02-1) ... 2025-03-14T05:40:56.4210761Z Setting up libhtml-parser-perl (3.75-1+b1) ... 2025-03-14T05:40:56.4356614Z Setting up libio-socket-ssl-perl (2.069-1) ... 2025-03-14T05:40:56.4491424Z Setting up libhttp-message-perl (6.28-1) ... 2025-03-14T05:40:56.4625303Z Setting up libhtml-form-perl (6.07-1) ... 2025-03-14T05:40:56.4764388Z Setting up libfile-mimeinfo-perl (0.30-1) ... 2025-03-14T05:40:56.4905255Z Setting up libhttp-negotiate-perl (6.01-1) ... 2025-03-14T05:40:56.5042399Z Setting up dconf-gsettings-backend:amd64 (0.38.0-2) ... 2025-03-14T05:40:56.5178855Z Setting up libnode-dev (12.22.12~dfsg-1~deb11u6) ... 2025-03-14T05:40:56.5326297Z Setting up libhttp-cookies-perl (6.10-1) ... 2025-03-14T05:40:56.5467802Z Setting up libhtml-tree-perl (5.07-2) ... 2025-03-14T05:40:56.5612794Z Setting up libhtml-format-perl (2.12-1.1) ... 2025-03-14T05:40:56.5759276Z Setting up nodejs (12.22.12~dfsg-1~deb11u6) ... 2025-03-14T05:40:56.5909201Z update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode 2025-03-14T05:40:56.6003629Z Setting up node-aws4 (1.11.0-1) ... 2025-03-14T05:40:56.6303785Z Setting up node-function-bind (1.1.1+repack-1) ... 2025-03-14T05:40:56.6447362Z Setting up node-clone (2.1.2-2) ... 2025-03-14T05:40:56.6590308Z Setting up node-iferr (1.0.2-1) ... 2025-03-14T05:40:56.6741589Z Setting up node-has-flag (4.0.0-1) ... 2025-03-14T05:40:56.6882807Z Setting up node-asap (2.0.6-2) ... 2025-03-14T05:40:56.7030715Z Setting up node-mime (2.5.0+dfsg+~cs3.90.0-1) ... 2025-03-14T05:40:56.7216336Z Setting up node-inherits (2.0.4-1) ... 2025-03-14T05:40:56.7367838Z Setting up node-path-is-absolute (2.0.0-1) ... 2025-03-14T05:40:56.7515363Z Setting up node-iconv-lite (0.5.1-3) ... 2025-03-14T05:40:56.7649980Z Setting up node-safe-buffer (5.2.1+~cs2.1.2-1) ... 2025-03-14T05:40:56.7768389Z Setting up node-promise-inflight (1.0.1-1.1) ... 2025-03-14T05:40:56.7888134Z Setting up node-json-stringify-safe (5.0.1+repack-3) ... 2025-03-14T05:40:56.8026322Z Setting up libnet-smtp-ssl-perl (1.04-1) ... 2025-03-14T05:40:56.8153158Z Setting up node-har-schema (2.0.0-4) ... 2025-03-14T05:40:56.8290560Z Setting up node-mime-types (2.1.28-1) ... 2025-03-14T05:40:56.8441463Z Setting up node-performance-now (2.1.0+debian-1.1) ... 2025-03-14T05:40:56.8586374Z Setting up libmailtools-perl (2.21-1) ... 2025-03-14T05:40:56.8730144Z Setting up node-balanced-match (1.0.0-1) ... 2025-03-14T05:40:56.8874814Z Setting up node-ansi (0.3.1-1) ... 2025-03-14T05:40:56.9022771Z Setting up node-brace-expansion (2.0.0-1) ... 2025-03-14T05:40:56.9168078Z Setting up node-spdx-exceptions (2.3.0-1) ... 2025-03-14T05:40:56.9309163Z Setting up node-set-blocking (2.0.0-1.1) ... 2025-03-14T05:40:56.9448771Z Setting up node-tunnel-agent (0.6.1-2) ... 2025-03-14T05:40:56.9590276Z Setting up node-npm-bundled (1.1.1-1) ... 2025-03-14T05:40:56.9728479Z Setting up node-signal-exit (3.0.3-1) ... 2025-03-14T05:40:56.9857078Z Setting up node-wrappy (1.0.2-1.1) ... 2025-03-14T05:40:57.0003958Z Setting up node-typedarray-to-buffer (4.0.0-1) ... 2025-03-14T05:40:57.0150271Z Setting up node-text-table (0.2.0-2) ... 2025-03-14T05:40:57.0289051Z Setting up node-asynckit (0.4.0-3) ... 2025-03-14T05:40:57.0434828Z Setting up node-ip (1.1.5-5) ... 2025-03-14T05:40:57.0571667Z Setting up node-punycode (2.1.1-3) ... 2025-03-14T05:40:57.0722030Z Setting up node-defaults (1.0.3-2) ... 2025-03-14T05:40:57.0866580Z Setting up node-mute-stream (0.0.8-2) ... 2025-03-14T05:40:57.1008583Z Setting up node-number-is-nan (2.0.0-1) ... 2025-03-14T05:40:57.1151983Z Setting up libhttp-daemon-perl (6.12-1+deb11u1) ... 2025-03-14T05:40:57.1288949Z Setting up node-graceful-fs (4.2.4+repack-1) ... 2025-03-14T05:40:57.1429653Z Setting up node-jsonify (0.0.0-1.1) ... 2025-03-14T05:40:57.1566311Z Setting up node-json-stable-stringify (1.0.1+~cs5.1.32-1) ... 2025-03-14T05:40:57.1711939Z Setting up node-aproba (2.0.0-1) ... 2025-03-14T05:40:57.1850290Z Setting up node-ip-regex (4.3.0-1) ... 2025-03-14T05:40:57.1992429Z Setting up node-spdx-license-ids (3.0.7-1) ... 2025-03-14T05:40:57.2131727Z Setting up node-string-decoder (1.3.0-2) ... 2025-03-14T05:40:57.2283229Z Setting up node-mkdirp (1.0.4+~1.0.1-1) ... 2025-03-14T05:40:57.2419505Z Setting up node-run-queue (2.0.0-1) ... 2025-03-14T05:40:57.2560588Z Setting up node-core-util-is (1.0.2-2) ... 2025-03-14T05:40:57.2697800Z Setting up node-uri-js (4.4.0+dfsg-5) ... 2025-03-14T05:40:57.2843107Z Setting up node-minimatch (3.0.4+~3.0.3-1+deb11u2) ... 2025-03-14T05:40:57.2985591Z Setting up node-opener (1.5.2-1) ... 2025-03-14T05:40:57.3130727Z Setting up node-archy (1.0.0-3) ... 2025-03-14T05:40:57.3277520Z Setting up node-caseless (0.12.1-1) ... 2025-03-14T05:40:57.3409257Z Setting up node-imurmurhash (0.1.4-1.1) ... 2025-03-14T05:40:57.3554098Z Setting up node-encoding (0.1.13-1) ... 2025-03-14T05:40:57.3690611Z Setting up node-read (1.0.7-2) ... 2025-03-14T05:40:57.3839366Z Setting up node-asn1 (0.2.3-2) ... 2025-03-14T05:40:57.3977297Z Setting up node-color-convert (1.9.3-1) ... 2025-03-14T05:40:57.4120836Z Setting up libgtk-3-common (3.24.24-4+deb11u4) ... 2025-03-14T05:40:57.4309071Z Setting up node-isarray (2.0.5-1) ... 2025-03-14T05:40:57.4443093Z Setting up node-osenv (0.1.5-1) ... 2025-03-14T05:40:57.4570126Z Setting up node-ms (2.1.3+~cs0.7.31-1) ... 2025-03-14T05:40:57.4721900Z Setting up node-process-nextick-args (2.0.0-1) ... 2025-03-14T05:40:57.4867071Z Setting up node-has-unicode (2.0.1-2) ... 2025-03-14T05:40:57.5001308Z Setting up node-fs-write-stream-atomic (1.0.10-4) ... 2025-03-14T05:40:57.5145053Z Setting up node-forever-agent (0.6.1-2) ... 2025-03-14T05:40:57.5290076Z Setting up node-delayed-stream (1.0.0-4) ... 2025-03-14T05:40:57.5427778Z Setting up node-isstream (0.1.2+dfsg-1.1) ... 2025-03-14T05:40:57.5569149Z Setting up node-builtins (1.0.3-2) ... 2025-03-14T05:40:57.5721309Z Setting up gsettings-desktop-schemas (3.38.0-2) ... 2025-03-14T05:40:57.5867587Z Setting up node-colors (1.4.0-1) ... 2025-03-14T05:40:57.6003426Z Setting up node-fs.realpath (1.0.0-1.1) ... 2025-03-14T05:40:57.6142438Z Setting up node-oauth-sign (0.9.0-2) ... 2025-03-14T05:40:57.6283768Z Setting up node-jsbn (1.1.0-1.1) ... 2025-03-14T05:40:57.6427880Z Setting up node-object-assign (4.1.1-3) ... 2025-03-14T05:40:57.6569335Z Setting up node-leven (3.1.0+~cs1.1.1-1) ... 2025-03-14T05:40:57.6712199Z Setting up node-abbrev (1.1.1-2) ... 2025-03-14T05:40:57.6853280Z Setting up node-puka (1.0.1+dfsg-2) ... 2025-03-14T05:40:57.6999535Z Setting up node-supports-color (8.1.0+~7.2.0-1) ... 2025-03-14T05:40:57.7147588Z Setting up node-yallist (4.0.0-1) ... 2025-03-14T05:40:57.7284664Z Setting up node-ansi-regex (5.0.1-1~deb11u1) ... 2025-03-14T05:40:57.7418189Z Setting up node-once (1.4.0-3) ... 2025-03-14T05:40:57.7561654Z Setting up node-write-file-atomic (3.0.3+~3.0.1-1) ... 2025-03-14T05:40:57.7709530Z Setting up node-psl (1.8.0+ds-4) ... 2025-03-14T05:40:57.7851671Z Setting up node-slash (3.0.0-1) ... 2025-03-14T05:40:57.7993703Z Setting up node-util-deprecate (1.0.2-1) ... 2025-03-14T05:40:57.8278022Z Setting up node-retry (0.12.0-1) ... 2025-03-14T05:40:57.8421642Z Setting up node-concat-map (0.0.1-2) ... 2025-03-14T05:40:57.8566786Z Setting up node-assert-plus (1.0.0-2) ... 2025-03-14T05:40:57.8698448Z Setting up node-ansistyles (0.1.3-2) ... 2025-03-14T05:40:57.8846517Z Setting up node-delegates (1.0.0-2) ... 2025-03-14T05:40:57.8980271Z Setting up node-depd (2.0.0-1) ... 2025-03-14T05:40:57.9121136Z Setting up node-isexe (2.0.0-5) ... 2025-03-14T05:40:57.9264463Z Setting up node-resolve (1.19.0+~cs5.20.8-2) ... 2025-03-14T05:40:57.9395398Z Setting up node-jsonparse (1.3.1-7) ... 2025-03-14T05:40:57.9544219Z Setting up node-ajv (6.12.6-2) ... 2025-03-14T05:40:57.9688661Z Setting up node-tweetnacl (1.0.3+dfsg-1) ... 2025-03-14T05:40:57.9825932Z Setting up node-escape-string-regexp (4.0.0-1) ... 2025-03-14T05:40:57.9955260Z Setting up node-aws-sign2 (0.7.1-2) ... 2025-03-14T05:40:58.0101873Z Setting up node-console-control-strings (1.1.0-2) ... 2025-03-14T05:40:58.0248275Z Setting up node-debug (4.3.1+~cs4.1.5-1) ... 2025-03-14T05:40:58.0385757Z Setting up node-extend (3.0.2-1) ... 2025-03-14T05:40:58.0530168Z Setting up node-jsonstream (1.3.5-1) ... 2025-03-14T05:40:58.0676141Z Setting up node-dashdash (2.0.0-1) ... 2025-03-14T05:40:58.0810268Z Setting up node-p-map (4.0.0-1) ... 2025-03-14T05:40:58.0959659Z Setting up node-validate-npm-package-name (3.0.0-1.1) ... 2025-03-14T05:40:58.1090602Z Setting up node-promzard (0.3.0-1.1) ... 2025-03-14T05:40:58.1229747Z Setting up node-wcwidth.js (1.0.0-1.1) ... 2025-03-14T05:40:58.1369043Z Setting up node-ecc-jsbn (0.2.0-2) ... 2025-03-14T05:40:58.1512956Z Setting up node-combined-stream (1.0.8-1) ... 2025-03-14T05:40:58.1648600Z Setting up node-unique-filename (1.1.1+ds-1) ... 2025-03-14T05:40:58.1785946Z Setting up node-ansi-styles (4.2.1-1) ... 2025-03-14T05:40:58.1922205Z Setting up node-form-data (3.0.0-2) ... 2025-03-14T05:40:58.2068803Z Setting up node-strip-ansi (6.0.0-2) ... 2025-03-14T05:40:58.2203130Z Setting up node-lockfile (1.0.4-3) ... 2025-03-14T05:40:58.2346302Z Setting up node-chalk (4.1.0-1) ... 2025-03-14T05:40:58.2486872Z Setting up node-spdx-expression-parse (3.0.1-1) ... 2025-03-14T05:40:58.2634636Z Setting up node-which (2.0.2+~cs1.3.2-1) ... 2025-03-14T05:40:58.2767246Z Setting up node-tar (6.0.5+ds1+~cs11.3.9-1+deb11u2) ... 2025-03-14T05:40:58.2914270Z Setting up node-inflight (1.0.6-1.1) ... 2025-03-14T05:40:58.3059500Z Setting up node-tough-cookie (4.0.0-2+deb11u1) ... 2025-03-14T05:40:58.3205019Z Setting up node-verror (1.10.0-1.1) ... 2025-03-14T05:40:58.3347138Z Setting up node-getpass (0.1.7-1.1) ... 2025-03-14T05:40:58.3485114Z Setting up node-nopt (5.0.0-1) ... 2025-03-14T05:40:58.3613390Z Setting up node-string-width (4.2.0-1) ... 2025-03-14T05:40:58.3754254Z Setting up node-har-validator (5.1.5-1) ... 2025-03-14T05:40:58.3902202Z Setting up node-readable-stream (3.6.0-2) ... 2025-03-14T05:40:58.4049227Z Setting up node-ssri (8.0.1-2) ... 2025-03-14T05:40:58.4186007Z Setting up node-lru-cache (5.1.1-5) ... 2025-03-14T05:40:58.4328698Z Setting up node-bcrypt-pbkdf (1.0.2-1) ... 2025-03-14T05:40:58.4469399Z Setting up node-promise-retry (2.0.1-1) ... 2025-03-14T05:40:58.4610288Z Setting up node-columnify (1.5.4-3) ... 2025-03-14T05:40:58.4759342Z Setting up node-jsprim (2.0.0-1) ... 2025-03-14T05:40:58.4890233Z Setting up node-are-we-there-yet (1.1.5-1) ... 2025-03-14T05:40:58.5041733Z Setting up node-spdx-correct (3.1.1-1) ... 2025-03-14T05:40:58.5187057Z Setting up node-glob (7.1.6+~7.1.3-1) ... 2025-03-14T05:40:58.5328063Z Setting up node-hosted-git-info (3.0.8-1) ... 2025-03-14T05:40:58.5456479Z Setting up node-wide-align (1.1.3-1) ... 2025-03-14T05:40:58.5596325Z Setting up node-rimraf (3.0.2-1) ... 2025-03-14T05:40:58.5745173Z Setting up node-sshpk (1.16.1+dfsg-2) ... 2025-03-14T05:40:58.5888479Z Setting up node-semver (7.3.4-1) ... 2025-03-14T05:40:58.6027293Z Setting up node-validate-npm-package-license (3.0.4-1) ... 2025-03-14T05:40:58.6168147Z Setting up node-copy-concurrently (1.0.5-7) ... 2025-03-14T05:40:58.6310699Z Setting up node-move-concurrently (1.0.1-2) ... 2025-03-14T05:40:58.6450557Z Setting up node-agent-base (6.0.2-2) ... 2025-03-14T05:40:58.6597153Z Setting up node-http-signature (1.3.5-1) ... 2025-03-14T05:40:58.6730021Z Setting up node-gauge (2.7.4-1.1) ... 2025-03-14T05:40:58.6808652Z Setting up node-normalize-package-data (3.0.0+~2.4.0-1) ... 2025-03-14T05:40:58.6929811Z Setting up node-npm-package-arg (8.1.0-1) ... 2025-03-14T05:40:58.7046122Z Setting up node-request (2.88.1-5) ... 2025-03-14T05:40:58.7176157Z Setting up node-npmlog (4.1.2-2) ... 2025-03-14T05:40:58.7313209Z Setting up node-https-proxy-agent (5.0.0-3) ... 2025-03-14T05:40:58.7455439Z Setting up node-cacache (15.0.5+~cs13.9.21-1) ... 2025-03-14T05:40:58.7586008Z Setting up node-read-package-json (3.0.0-1) ... 2025-03-14T05:40:58.7725534Z Setting up node-gyp (7.1.2-4) ... 2025-03-14T05:40:58.7872318Z Setting up npm (7.5.2+ds-2) ... 2025-03-14T05:40:58.8178714Z Setting up libwww-perl (6.52-1) ... 2025-03-14T05:40:58.8341258Z Setting up liblwp-protocol-https-perl (6.10-1) ... 2025-03-14T05:40:58.8468108Z Setting up libxml-parser-perl:amd64 (2.46-2) ... 2025-03-14T05:40:58.8609127Z Setting up libxml-twig-perl (1:3.52-1) ... 2025-03-14T05:40:58.8751993Z Setting up libnet-dbus-perl (1.2.0-1+b1) ... 2025-03-14T05:40:58.8984538Z Processing triggers for libglib2.0-0:amd64 (2.66.8-1+deb11u5) ... 2025-03-14T05:40:58.9309080Z Processing triggers for libc-bin (2.31-13+deb11u11) ... 2025-03-14T05:40:58.9411046Z ldconfig: /usr/local/lib/libur_loader.so.0 is not a symbolic link 2025-03-14T05:40:58.9411411Z 2025-03-14T05:40:58.9411677Z ldconfig: /usr/local/lib/libur_adapter_opencl.so.0 is not a symbolic link 2025-03-14T05:40:58.9412043Z 2025-03-14T05:40:58.9412335Z ldconfig: /usr/local/lib/libur_adapter_level_zero.so.0 is not a symbolic link 2025-03-14T05:40:58.9412716Z 2025-03-14T05:40:58.9413129Z ldconfig: /usr/local/lib/libumf.so.0 is not a symbolic link 2025-03-14T05:40:58.9413431Z 2025-03-14T05:40:58.9413657Z ldconfig: /usr/local/lib/libtcm_debug.so.1 is not a symbolic link 2025-03-14T05:40:58.9413982Z 2025-03-14T05:40:58.9414182Z ldconfig: /usr/local/lib/libtcm.so.1 is not a symbolic link 2025-03-14T05:40:58.9414477Z 2025-03-14T05:40:58.9414731Z ldconfig: /usr/local/lib/libtbbmalloc_proxy.so.2 is not a symbolic link 2025-03-14T05:40:58.9415086Z 2025-03-14T05:40:58.9415310Z ldconfig: /usr/local/lib/libtbbmalloc.so.2 is not a symbolic link 2025-03-14T05:40:58.9415633Z 2025-03-14T05:40:58.9415864Z ldconfig: /usr/local/lib/libtbbbind_2_5.so.3 is not a symbolic link 2025-03-14T05:40:58.9416195Z 2025-03-14T05:40:58.9416423Z ldconfig: /usr/local/lib/libtbbbind_2_0.so.3 is not a symbolic link 2025-03-14T05:40:58.9416751Z 2025-03-14T05:40:58.9416978Z ldconfig: /usr/local/lib/libtbbbind.so.3 is not a symbolic link 2025-03-14T05:40:58.9417301Z 2025-03-14T05:40:58.9417513Z ldconfig: /usr/local/lib/libtbb.so.12 is not a symbolic link 2025-03-14T05:40:58.9417820Z 2025-03-14T05:40:58.9418041Z ldconfig: /usr/local/lib/libhwloc.so.15 is not a symbolic link 2025-03-14T05:40:58.9418360Z 2025-03-14T05:40:58.9780357Z Setting up glib-networking:amd64 (2.66.0-2) ... 2025-03-14T05:40:58.9927036Z Setting up libsoup2.4-1:amd64 (2.72.0-2+deb11u1) ... 2025-03-14T05:40:59.0126616Z Setting up libsoup-gnome2.4-1:amd64 (2.72.0-2+deb11u1) ... 2025-03-14T05:40:59.0273889Z Setting up librest-0.7-0:amd64 (0.8.1-1.1) ... 2025-03-14T05:40:59.0427009Z Setting up libgtk-3-0:amd64 (3.24.24-4+deb11u4) ... 2025-03-14T05:40:59.0703766Z Setting up libgtk-3-bin (3.24.24-4+deb11u4) ... 2025-03-14T05:40:59.1007468Z Setting up libvte-2.91-0:amd64 (0.62.3-1) ... 2025-03-14T05:40:59.1155669Z Setting up termit (3.1-1) ... 2025-03-14T05:40:59.1407729Z update-alternatives: using /usr/bin/termit to provide /usr/bin/x-terminal-emulator (x-terminal-emulator) in auto mode 2025-03-14T05:40:59.1491371Z Processing triggers for libc-bin (2.31-13+deb11u11) ... 2025-03-14T05:40:59.1566639Z ldconfig: /usr/local/lib/libur_loader.so.0 is not a symbolic link 2025-03-14T05:40:59.1567010Z 2025-03-14T05:40:59.1567267Z ldconfig: /usr/local/lib/libur_adapter_opencl.so.0 is not a symbolic link 2025-03-14T05:40:59.1567650Z 2025-03-14T05:40:59.1567909Z ldconfig: /usr/local/lib/libur_adapter_level_zero.so.0 is not a symbolic link 2025-03-14T05:40:59.1568299Z 2025-03-14T05:40:59.1568495Z ldconfig: /usr/local/lib/libumf.so.0 is not a symbolic link 2025-03-14T05:40:59.1568825Z 2025-03-14T05:40:59.1569037Z ldconfig: /usr/local/lib/libtcm_debug.so.1 is not a symbolic link 2025-03-14T05:40:59.1569371Z 2025-03-14T05:40:59.1569561Z ldconfig: /usr/local/lib/libtcm.so.1 is not a symbolic link 2025-03-14T05:40:59.1569872Z 2025-03-14T05:40:59.1570134Z ldconfig: /usr/local/lib/libtbbmalloc_proxy.so.2 is not a symbolic link 2025-03-14T05:40:59.1570490Z 2025-03-14T05:40:59.1570728Z ldconfig: /usr/local/lib/libtbbmalloc.so.2 is not a symbolic link 2025-03-14T05:40:59.1571058Z 2025-03-14T05:40:59.1571292Z ldconfig: /usr/local/lib/libtbbbind_2_5.so.3 is not a symbolic link 2025-03-14T05:40:59.1571623Z 2025-03-14T05:40:59.1571852Z ldconfig: /usr/local/lib/libtbbbind_2_0.so.3 is not a symbolic link 2025-03-14T05:40:59.1572181Z 2025-03-14T05:40:59.1572399Z ldconfig: /usr/local/lib/libtbbbind.so.3 is not a symbolic link 2025-03-14T05:40:59.1572719Z 2025-03-14T05:40:59.1572925Z ldconfig: /usr/local/lib/libtbb.so.12 is not a symbolic link 2025-03-14T05:40:59.1573225Z 2025-03-14T05:40:59.1573436Z ldconfig: /usr/local/lib/libhwloc.so.15 is not a symbolic link 2025-03-14T05:40:59.1573746Z 2025-03-14T05:40:59.2044454Z + sudo apt-get install -y lcov 2025-03-14T05:40:59.2172492Z 2025-03-14T05:40:59.2587497Z Reading package lists... 0% 2025-03-14T05:40:59.2587794Z 2025-03-14T05:40:59.2793541Z Reading package lists... 0% 2025-03-14T05:40:59.2793790Z 2025-03-14T05:40:59.5790854Z Reading package lists... 0% 2025-03-14T05:40:59.5791130Z 2025-03-14T05:40:59.5791262Z Reading package lists... 82% 2025-03-14T05:40:59.5791724Z 2025-03-14T05:40:59.5932965Z Reading package lists... 82% 2025-03-14T05:40:59.5933213Z 2025-03-14T05:40:59.5933346Z Reading package lists... 86% 2025-03-14T05:40:59.5933539Z 2025-03-14T05:40:59.5940114Z Reading package lists... 86% 2025-03-14T05:40:59.5940305Z 2025-03-14T05:40:59.5940480Z Reading package lists... 86% 2025-03-14T05:40:59.5940668Z 2025-03-14T05:40:59.5972141Z Reading package lists... 86% 2025-03-14T05:40:59.5972390Z 2025-03-14T05:40:59.5972519Z Reading package lists... 86% 2025-03-14T05:40:59.5972712Z 2025-03-14T05:40:59.6397582Z Reading package lists... 86% 2025-03-14T05:40:59.6397816Z 2025-03-14T05:40:59.6397944Z Reading package lists... 98% 2025-03-14T05:40:59.6398137Z 2025-03-14T05:40:59.6456323Z Reading package lists... 98% 2025-03-14T05:40:59.6456573Z 2025-03-14T05:40:59.6456703Z Reading package lists... Done 2025-03-14T05:40:59.6456902Z 2025-03-14T05:40:59.6580636Z 2025-03-14T05:40:59.6581150Z Building dependency tree... 0% 2025-03-14T05:40:59.6581438Z 2025-03-14T05:40:59.6729662Z Building dependency tree... 0% 2025-03-14T05:40:59.6729926Z 2025-03-14T05:40:59.6730059Z Building dependency tree... 50% 2025-03-14T05:40:59.6730262Z 2025-03-14T05:40:59.7429051Z Building dependency tree... 50% 2025-03-14T05:40:59.7429330Z 2025-03-14T05:40:59.7429468Z Building dependency tree... Done 2025-03-14T05:40:59.7429680Z 2025-03-14T05:40:59.7429687Z 2025-03-14T05:40:59.7429820Z Reading state information... 0% 2025-03-14T05:40:59.7430022Z 2025-03-14T05:40:59.7432037Z Reading state information... 0% 2025-03-14T05:40:59.7432241Z 2025-03-14T05:40:59.7432379Z Reading state information... Done 2025-03-14T05:40:59.7432589Z 2025-03-14T05:40:59.7558337Z lcov is already the newest version (1.14-2). 2025-03-14T05:40:59.8521701Z 0 upgraded, 0 newly installed, 0 to remove and 23 not upgraded. 2025-03-14T05:40:59.8567128Z + sudo npm install -g @bazel/bazelisk 2025-03-14T05:41:00.1989655Z [?25l[..................] | idealTree: timing arborist:ctor Completed in 1ms 2025-03-14T05:41:00.2554482Z [..................] | idealTree:lib: sill idealTree buildDeps 2025-03-14T05:41:00.2842998Z [..................] | idealTree:lib: sill idealTree buildDeps 2025-03-14T05:41:00.2843408Z 2025-03-14T05:41:00.2865109Z [?25hnpm ERR! code EEXIST 2025-03-14T05:41:00.2866364Z npm ERR! path /usr/local/bin/bazel 2025-03-14T05:41:00.2887685Z npm ERR! EEXIST: file already exists 2025-03-14T05:41:00.2888329Z npm ERR! File exists: /usr/local/bin/bazel 2025-03-14T05:41:00.2889040Z npm ERR! Remove the existing file and try again, or run npm 2025-03-14T05:41:00.2889767Z npm ERR! with --force to overwrite files recklessly. 2025-03-14T05:41:00.3710028Z  2025-03-14T05:41:00.3710556Z npm ERR! A complete log of this run can be found in: 2025-03-14T05:41:00.3711359Z npm ERR! /root/.npm/_logs/2025-03-14T05_41_00_289Z-debug.log 2025-03-14T05:41:00.3757172Z + [[ -e /usr/bin/bazel ]] 2025-03-14T05:41:00.3757528Z ++ command -v bazelisk 2025-03-14T05:41:00.3759954Z + sudo ln -s '' /usr/bin/bazel 2025-03-14T05:41:00.3825634Z ln: failed to create symbolic link '/usr/bin/bazel' -> '': No such file or directory 2025-03-14T05:41:00.3828354Z + CUBLAS_PATTERN='/usr/include/cublas*' 2025-03-14T05:41:00.3830029Z + ls '/usr/include/cublas*' 2025-03-14T05:41:00.3848473Z + CMAKE_PREFIX_PATH=/opt/conda/lib/python3.10/site-packages/torch:/opt/conda/bin/../ 2025-03-14T05:41:00.3849031Z + XLA_SANDBOX_BUILD=1 2025-03-14T05:41:00.3849308Z + build_torch_xla xla 2025-03-14T05:41:00.3849578Z + XLA_DIR=xla 2025-03-14T05:41:00.3849845Z + pushd xla 2025-03-14T05:41:00.3850171Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2025-03-14T05:41:00.3850827Z + python setup.py install 2025-03-14T05:41:00.6303159Z Building torch_xla version: 2.7.0+gitb2b890e 2025-03-14T05:41:00.6303628Z XLA Commit ID: b2b890e962f5fb6f481e5da2eb4a43bb990d0f1b 2025-03-14T05:41:00.6304103Z PyTorch Commit ID: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T05:41:00.6576984Z running install 2025-03-14T05:41:00.6577937Z /opt/conda/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2025-03-14T05:41:00.6578698Z !! 2025-03-14T05:41:00.6578832Z 2025-03-14T05:41:00.6578976Z ******************************************************************************** 2025-03-14T05:41:00.6579394Z Please avoid running ``setup.py`` directly. 2025-03-14T05:41:00.6579817Z Instead, use pypa/build, pypa/installer or other 2025-03-14T05:41:00.6580232Z standards-based tools. 2025-03-14T05:41:00.6580440Z 2025-03-14T05:41:00.6580762Z See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2025-03-14T05:41:00.6581314Z ******************************************************************************** 2025-03-14T05:41:00.6581573Z 2025-03-14T05:41:00.6581662Z !! 2025-03-14T05:41:00.6581899Z self.initialize_options() 2025-03-14T05:41:00.6878578Z /opt/conda/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:66: EasyInstallDeprecationWarning: easy_install command is deprecated. 2025-03-14T05:41:00.6879399Z !! 2025-03-14T05:41:00.6879537Z 2025-03-14T05:41:00.6879683Z ******************************************************************************** 2025-03-14T05:41:00.6880130Z Please avoid running ``setup.py`` and ``easy_install``. 2025-03-14T05:41:00.6880590Z Instead, use pypa/build, pypa/installer or other 2025-03-14T05:41:00.6880980Z standards-based tools. 2025-03-14T05:41:00.6881175Z 2025-03-14T05:41:00.6881610Z See https://github.com/pypa/setuptools/issues/917 for details. 2025-03-14T05:41:00.6882088Z ******************************************************************************** 2025-03-14T05:41:00.6882335Z 2025-03-14T05:41:00.6882438Z !! 2025-03-14T05:41:00.6882675Z self.initialize_options() 2025-03-14T05:41:00.7355366Z running bdist_egg 2025-03-14T05:41:00.7496324Z running egg_info 2025-03-14T05:41:00.7496640Z creating torch_xla.egg-info 2025-03-14T05:41:00.7543404Z writing torch_xla.egg-info/PKG-INFO 2025-03-14T05:41:00.7551035Z writing dependency_links to torch_xla.egg-info/dependency_links.txt 2025-03-14T05:41:00.7552738Z writing entry points to torch_xla.egg-info/entry_points.txt 2025-03-14T05:41:00.7559918Z writing requirements to torch_xla.egg-info/requires.txt 2025-03-14T05:41:00.7561186Z writing top-level names to torch_xla.egg-info/top_level.txt 2025-03-14T05:41:00.7562344Z writing manifest file 'torch_xla.egg-info/SOURCES.txt' 2025-03-14T05:41:00.7692783Z reading manifest file 'torch_xla.egg-info/SOURCES.txt' 2025-03-14T05:41:00.7693222Z adding license file 'LICENSE' 2025-03-14T05:41:00.7711197Z writing manifest file 'torch_xla.egg-info/SOURCES.txt' 2025-03-14T05:41:00.7711735Z installing library code to build/bdist.linux-x86_64/egg 2025-03-14T05:41:00.7712135Z running install_lib 2025-03-14T05:41:00.7712401Z running build_py 2025-03-14T05:41:00.7712655Z creating build 2025-03-14T05:41:00.7712938Z creating build/lib.linux-x86_64-cpython-310 2025-03-14T05:41:00.7713364Z creating build/lib.linux-x86_64-cpython-310/torch_xla 2025-03-14T05:41:00.7713937Z copying torch_xla/_patched_functions.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2025-03-14T05:41:00.7714613Z copying torch_xla/stablehlo.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2025-03-14T05:41:00.7715829Z copying torch_xla/tf_saved_model_integration.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2025-03-14T05:41:00.7716915Z copying torch_xla/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2025-03-14T05:41:00.7718834Z copying torch_xla/runtime.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2025-03-14T05:41:00.7719975Z copying torch_xla/torch_xla.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2025-03-14T05:41:00.7721115Z copying torch_xla/version.py -> build/lib.linux-x86_64-cpython-310/torch_xla 2025-03-14T05:41:00.7723065Z creating build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo 2025-03-14T05:41:00.7723896Z copying torch_xla/_dynamo/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo 2025-03-14T05:41:00.7725271Z copying torch_xla/_dynamo/config.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo 2025-03-14T05:41:00.7726512Z copying torch_xla/_dynamo/dynamo_bridge.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo 2025-03-14T05:41:00.7729331Z creating build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7730418Z copying torch_xla/_internal/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7731603Z copying torch_xla/_internal/c10d_registration.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7732768Z copying torch_xla/_internal/custom_kernel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7733987Z copying torch_xla/_internal/decomp_registration.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7735038Z copying torch_xla/_internal/gpu.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7736201Z copying torch_xla/_internal/neuron_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7737350Z copying torch_xla/_internal/rendezvous.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7738424Z copying torch_xla/_internal/tpu.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7739592Z copying torch_xla/_internal/utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7741083Z copying torch_xla/_internal/xpu.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7742069Z copying torch_xla/_internal/neuron.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7743277Z copying torch_xla/_internal/pjrt.py -> build/lib.linux-x86_64-cpython-310/torch_xla/_internal 2025-03-14T05:41:00.7745226Z creating build/lib.linux-x86_64-cpython-310/torch_xla/amp 2025-03-14T05:41:00.7746046Z copying torch_xla/amp/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp 2025-03-14T05:41:00.7747350Z copying torch_xla/amp/autocast_mode.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp 2025-03-14T05:41:00.7748437Z copying torch_xla/amp/grad_scaler.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp 2025-03-14T05:41:00.7750610Z creating build/lib.linux-x86_64-cpython-310/torch_xla/core 2025-03-14T05:41:00.7751393Z copying torch_xla/core/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2025-03-14T05:41:00.7752527Z copying torch_xla/core/dynamo_bridge.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2025-03-14T05:41:00.7753642Z copying torch_xla/core/functions.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2025-03-14T05:41:00.7754794Z copying torch_xla/core/xla_env_vars.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2025-03-14T05:41:00.7755927Z copying torch_xla/core/xla_op_registry.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2025-03-14T05:41:00.7757052Z copying torch_xla/core/xla_builder.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2025-03-14T05:41:00.7758374Z copying torch_xla/core/xla_model.py -> build/lib.linux-x86_64-cpython-310/torch_xla/core 2025-03-14T05:41:00.7760991Z creating build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7761820Z copying torch_xla/debug/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7762945Z copying torch_xla/debug/frame_parser_util.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7764108Z copying torch_xla/debug/graph_saver.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7765484Z copying torch_xla/debug/metrics.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7766912Z copying torch_xla/debug/metrics_compare_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7768063Z copying torch_xla/debug/model_comparator.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7769247Z copying torch_xla/debug/metrics_saver.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7770349Z copying torch_xla/debug/profiler.py -> build/lib.linux-x86_64-cpython-310/torch_xla/debug 2025-03-14T05:41:00.7772835Z creating build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2025-03-14T05:41:00.7773724Z copying torch_xla/distributed/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2025-03-14T05:41:00.7774834Z copying torch_xla/distributed/data_parallel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2025-03-14T05:41:00.7776095Z copying torch_xla/distributed/parallel_loader.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2025-03-14T05:41:00.7777369Z copying torch_xla/distributed/xla_backend.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2025-03-14T05:41:00.7778679Z copying torch_xla/distributed/xla_multiprocessing.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2025-03-14T05:41:00.7779914Z copying torch_xla/distributed/zero_redundancy_optimizer.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed 2025-03-14T05:41:00.7783356Z creating build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7784226Z copying torch_xla/experimental/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7785550Z copying torch_xla/experimental/callback.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7786872Z copying torch_xla/experimental/deprecation.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7787996Z copying torch_xla/experimental/dynamo_mark_sharding.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7789140Z copying torch_xla/experimental/dynamo_set_buffer_donor.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7790140Z copying torch_xla/experimental/eager.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7791263Z copying torch_xla/experimental/fori_loop.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7792552Z copying torch_xla/experimental/mark_pattern_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7793852Z copying torch_xla/experimental/pjrt_backend.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7795117Z copying torch_xla/experimental/plugins.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7796315Z copying torch_xla/experimental/pytreeify.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7797465Z copying torch_xla/experimental/quantized.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7799066Z copying torch_xla/experimental/scan_layers.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7800251Z copying torch_xla/experimental/stablehlo_custom_call.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7801390Z copying torch_xla/experimental/unbounded_dynamism_export.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7802576Z copying torch_xla/experimental/xla_dynamic_reshape_ops.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7803677Z copying torch_xla/experimental/xla_marker.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7804894Z copying torch_xla/experimental/xla_mlir_debuginfo.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7806181Z copying torch_xla/experimental/xla_quantized_matmul.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7807278Z copying torch_xla/experimental/custom_kernel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7808647Z copying torch_xla/experimental/scan.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7810224Z copying torch_xla/experimental/spmd_fully_sharded_data_parallel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7811226Z copying torch_xla/experimental/triton.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental 2025-03-14T05:41:00.7812985Z creating build/lib.linux-x86_64-cpython-310/torch_xla/test 2025-03-14T05:41:00.7813760Z copying torch_xla/test/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/test 2025-03-14T05:41:00.7814843Z copying torch_xla/test/test_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/test 2025-03-14T05:41:00.7817231Z creating build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7818006Z copying torch_xla/utils/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7819184Z copying torch_xla/utils/checkpoint_tagger.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7820309Z copying torch_xla/utils/closures.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7821431Z copying torch_xla/utils/dlpack.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7822566Z copying torch_xla/utils/keyd_queue.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7823713Z copying torch_xla/utils/stablehlo_test_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7824788Z copying torch_xla/utils/utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7825903Z copying torch_xla/utils/checkpoint.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7827111Z copying torch_xla/utils/serialization.py -> build/lib.linux-x86_64-cpython-310/torch_xla/utils 2025-03-14T05:41:00.7829385Z creating build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2025-03-14T05:41:00.7830194Z copying torch_xla/amp/syncfree/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2025-03-14T05:41:00.7831432Z copying torch_xla/amp/syncfree/_functional.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2025-03-14T05:41:00.7832573Z copying torch_xla/amp/syncfree/adam.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2025-03-14T05:41:00.7833728Z copying torch_xla/amp/syncfree/adamw.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2025-03-14T05:41:00.7834973Z copying torch_xla/amp/syncfree/sgd.py -> build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree 2025-03-14T05:41:00.7837253Z creating build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7838088Z copying torch_xla/distributed/fsdp/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7839365Z copying torch_xla/distributed/fsdp/_init_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7840676Z copying torch_xla/distributed/fsdp/consolidate_sharded_ckpts.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7841763Z copying torch_xla/distributed/fsdp/state_dict_utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7842882Z copying torch_xla/distributed/fsdp/utils.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7844040Z copying torch_xla/distributed/fsdp/wrap.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7845452Z copying torch_xla/distributed/fsdp/xla_flatten_params_wrapper.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7846864Z copying torch_xla/distributed/fsdp/xla_fully_sharded_data_parallel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp 2025-03-14T05:41:00.7849554Z creating build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2025-03-14T05:41:00.7850365Z copying torch_xla/distributed/spmd/api.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2025-03-14T05:41:00.7851761Z copying torch_xla/distributed/spmd/debugging.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2025-03-14T05:41:00.7853018Z copying torch_xla/distributed/spmd/xla_sharded_tensor.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2025-03-14T05:41:00.7854141Z copying torch_xla/distributed/spmd/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2025-03-14T05:41:00.7855294Z copying torch_xla/distributed/spmd/xla_sharding.py -> build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd 2025-03-14T05:41:00.7857893Z creating build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:41:00.7858924Z copying torch_xla/experimental/distributed_checkpoint/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:41:00.7860197Z copying torch_xla/experimental/distributed_checkpoint/_helpers.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:41:00.7861479Z copying torch_xla/experimental/distributed_checkpoint/manager.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:41:00.7862777Z copying torch_xla/experimental/distributed_checkpoint/planners.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:41:00.7864118Z copying torch_xla/experimental/distributed_checkpoint/util.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:41:00.7865669Z creating build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels 2025-03-14T05:41:00.7866826Z copying torch_xla/experimental/pallas_kernels/__init__.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels 2025-03-14T05:41:00.7868347Z copying torch_xla/experimental/pallas_kernels/multi_queries_paged_attention_kernel.py -> build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels 2025-03-14T05:41:00.7889872Z running build_ext 2025-03-14T05:41:01.8810291Z bazel build //:_XLAC.so --symlink_prefix=build/temp.linux-x86_64-cpython-310/bazel- --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=1 --remote_default_exec_properties=cache-silo-key=dev 2025-03-14T05:41:01.8834866Z 2025/03/14 05:41:01 Downloading https://releases.bazel.build/6.5.0/release/bazel-6.5.0-linux-x86_64... 2025-03-14T05:41:02.0814664Z Extracting Bazel installation... 2025-03-14T05:41:03.4989456Z Starting local Bazel server and connecting to it... 2025-03-14T05:41:04.8744687Z INFO: Options provided by the client: 2025-03-14T05:41:04.8745220Z Inherited 'common' options: --isatty=1 --terminal_columns=0 2025-03-14T05:41:04.8745975Z INFO: Reading rc options for 'build' from /var/lib/jenkins/workspace/xla/.bazelrc: 2025-03-14T05:41:04.8746613Z Inherited 'common' options: --experimental_repo_remote_exec 2025-03-14T05:41:04.8747354Z INFO: Reading rc options for 'build' from /var/lib/jenkins/workspace/xla/.bazelrc: 2025-03-14T05:41:04.8751239Z 'build' options: --announce_rc --nocheck_visibility --enable_platform_specific_config --experimental_cc_shared_library --define=no_aws_support=true --define=no_hdfs_support=true --define=no_hdfs_support=true --define=no_kafka_support=true --define=no_ignite_support=true --define=grpc_no_ares=true -c opt --config=short_logs --action_env=CC=gcc --action_env=CXX=g++ --spawn_strategy=standalone --incompatible_strict_action_env --noremote_upload_local_results --java_runtime_version=remotejdk_11 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --define framework_shared_object=false --define tsl_protobuf_header_only=false --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --define=with_xla_support=true --noincompatible_remove_legacy_whole_archive --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility 2025-03-14T05:41:04.8755666Z INFO: Found applicable config definition build:short_logs in file /var/lib/jenkins/workspace/xla/.bazelrc: --output_filter=DONT_MATCH_ANYTHING 2025-03-14T05:41:04.8759619Z INFO: Found applicable config definition build:linux in file /var/lib/jenkins/workspace/xla/.bazelrc: --config=posix --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --define=build_with_onednn_v2=true --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable 2025-03-14T05:41:04.8763309Z INFO: Found applicable config definition build:posix in file /var/lib/jenkins/workspace/xla/.bazelrc: --copt=-Wno-sign-compare --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 2025-03-14T05:41:04.8765086Z INFO: Found applicable config definition build:dynamic_kernels in file /var/lib/jenkins/workspace/xla/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS 2025-03-14T05:41:04.9054133Z Loading: 2025-03-14T05:41:05.1127140Z 2025-03-14T05:41:05.1127892Z Loading: 2025-03-14T05:41:05.3135360Z 2025-03-14T05:41:05.3136186Z Loading: 2025-03-14T05:41:05.3137167Z Fetching repository @pybind11_bazel; starting 2025-03-14T05:41:05.4914385Z 2025-03-14T05:41:05.4915044Z  2025-03-14T05:41:05.4916195Z DEBUG: Rule 'pybind11_bazel' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "6426567481ee345eb48661e7db86adc053881cb4dd39fbf527c8986316b682b9" 2025-03-14T05:41:05.4917441Z Loading: 2025-03-14T05:41:05.4917759Z Fetching repository @pybind11_bazel; starting 2025-03-14T05:41:05.4918073Z 2025-03-14T05:41:05.4918246Z  2025-03-14T05:41:05.4918853Z DEBUG: Repository pybind11_bazel instantiated at: 2025-03-14T05:41:05.4919676Z /var/lib/jenkins/workspace/xla/WORKSPACE:6:13: in 2025-03-14T05:41:05.4920249Z Repository rule http_archive defined at: 2025-03-14T05:41:05.4921138Z /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in 2025-03-14T05:41:05.4922016Z Loading: 2025-03-14T05:41:05.4922338Z Fetching repository @pybind11_bazel; starting 2025-03-14T05:41:05.7142365Z 2025-03-14T05:41:05.7142993Z  2025-03-14T05:41:05.7143317Z Loading: 2025-03-14T05:41:05.7143654Z Fetching repository @xla; starting 2025-03-14T05:41:05.9375947Z 2025-03-14T05:41:05.9376575Z  2025-03-14T05:41:05.9376911Z Loading: 2025-03-14T05:41:05.9377260Z Fetching repository @xla; starting 2025-03-14T05:41:05.9377765Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 1.8 MiB (1,835,032B) 2025-03-14T05:41:06.1460907Z 2025-03-14T05:41:06.1461589Z  2025-03-14T05:41:06.1461894Z  2025-03-14T05:41:06.1462176Z Loading: 2025-03-14T05:41:06.1462560Z Fetching repository @xla; starting 2025-03-14T05:41:06.1463067Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 3.0 MiB (3,145,754B) 2025-03-14T05:41:06.3551850Z 2025-03-14T05:41:06.3552442Z  2025-03-14T05:41:06.3552752Z  2025-03-14T05:41:06.3553086Z Loading: 2025-03-14T05:41:06.3553438Z Fetching repository @xla; starting 2025-03-14T05:41:06.3554290Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 4.2 MiB (4,456,474B) 2025-03-14T05:41:06.7154849Z 2025-03-14T05:41:06.7155518Z  2025-03-14T05:41:06.7155834Z  2025-03-14T05:41:06.7156123Z Loading: 2025-03-14T05:41:06.7156448Z Fetching repository @xla; starting 2025-03-14T05:41:06.7156964Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 5.6 MiB (5,864,150B) 2025-03-14T05:41:06.9988584Z 2025-03-14T05:41:06.9989104Z  2025-03-14T05:41:06.9989407Z  2025-03-14T05:41:06.9989742Z Loading: 2025-03-14T05:41:06.9990092Z Fetching repository @xla; starting 2025-03-14T05:41:06.9990606Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 8.2 MiB (8,650,778B) 2025-03-14T05:41:07.2141821Z 2025-03-14T05:41:07.2142418Z  2025-03-14T05:41:07.2142727Z  2025-03-14T05:41:07.2143053Z Loading: 2025-03-14T05:41:07.2143394Z Fetching repository @xla; starting 2025-03-14T05:41:07.2143913Z Fetching https://github.com/...eac4e00ae34821.tar.gz; 9.5 MiB (9,961,496B) 2025-03-14T05:41:07.4163276Z 2025-03-14T05:41:07.4164045Z  2025-03-14T05:41:07.4164385Z  2025-03-14T05:41:07.4164803Z Loading: 2025-03-14T05:41:07.4165179Z Fetching repository @xla; starting 2025-03-14T05:41:07.4165913Z Fetching https://github.com/...c4e00ae34821.tar.gz; 10.5 MiB (11,010,074B) 2025-03-14T05:41:07.6418765Z 2025-03-14T05:41:07.6419344Z  2025-03-14T05:41:07.6419662Z  2025-03-14T05:41:07.6419957Z Loading: 2025-03-14T05:41:07.6420293Z Fetching repository @xla; starting 2025-03-14T05:41:07.6420798Z Fetching https://github.com/...c4e00ae34821.tar.gz; 11.8 MiB (12,320,794B) 2025-03-14T05:41:07.9173647Z 2025-03-14T05:41:07.9174305Z  2025-03-14T05:41:07.9174599Z  2025-03-14T05:41:07.9174885Z Loading: 2025-03-14T05:41:07.9175518Z Fetching repository @xla; starting 2025-03-14T05:41:07.9176072Z Fetching https://github.com/...c4e00ae34821.tar.gz; 13.1 MiB (13,688,907B) 2025-03-14T05:41:08.1173369Z 2025-03-14T05:41:08.1173938Z  2025-03-14T05:41:08.1174234Z  2025-03-14T05:41:08.1174525Z Loading: 2025-03-14T05:41:08.1174874Z Fetching repository @xla; starting 2025-03-14T05:41:08.5183725Z 2025-03-14T05:41:08.5184359Z  2025-03-14T05:41:08.5184718Z Loading: 2025-03-14T05:41:08.5185063Z Fetching repository @xla; starting 2025-03-14T05:41:08.5185552Z Fetching ...al/xla; Extracting 30f22f4d6cb523e035c237f30aeac4e00ae34821.ta\ 2025-03-14T05:41:08.5186028Z r.gz 2025-03-14T05:41:08.9087273Z 2025-03-14T05:41:08.9087899Z  2025-03-14T05:41:08.9088193Z  2025-03-14T05:41:08.9088436Z  2025-03-14T05:41:08.9088690Z Loading: 2025-03-14T05:41:08.9089056Z Fetching repository @xla; Patching repository 2025-03-14T05:41:08.9272237Z 2025-03-14T05:41:08.9272960Z  2025-03-14T05:41:08.9274883Z DEBUG: Rule 'xla' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "546dc97a5bee684b3baf1c14c00ef6c73f18c717ebb97c000a35f683bf53c244" 2025-03-14T05:41:08.9276692Z Loading: 2025-03-14T05:41:08.9277239Z Fetching repository @xla; Patching repository 2025-03-14T05:41:08.9277755Z 2025-03-14T05:41:08.9277952Z  2025-03-14T05:41:08.9278557Z DEBUG: Repository xla instantiated at: 2025-03-14T05:41:08.9279436Z /var/lib/jenkins/workspace/xla/WORKSPACE:55:13: in 2025-03-14T05:41:08.9280276Z Repository rule http_archive defined at: 2025-03-14T05:41:08.9281854Z /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in 2025-03-14T05:41:08.9283494Z Loading: 2025-03-14T05:41:08.9284038Z Fetching repository @xla; Patching repository 2025-03-14T05:41:09.1376097Z 2025-03-14T05:41:09.1376870Z  2025-03-14T05:41:09.1377685Z Loading: 2025-03-14T05:41:09.1378279Z Fetching repository @rules_python; starting 2025-03-14T05:41:09.1379215Z Fetching ...5/external/rules_python; Extracting rules_python-0.39.0.tar.gz 2025-03-14T05:41:09.3218119Z 2025-03-14T05:41:09.3218790Z  2025-03-14T05:41:09.3219210Z  2025-03-14T05:41:09.3220170Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:154:14: 2025-03-14T05:41:09.3221264Z HERMETIC_PYTHON_VERSION variable was not set correctly, using default version. 2025-03-14T05:41:09.3222044Z Python 3.10 will be used. 2025-03-14T05:41:09.3222499Z To select Python version, either set HERMETIC_PYTHON_VERSION env variable in 2025-03-14T05:41:09.3222970Z your shell: 2025-03-14T05:41:09.3223240Z export HERMETIC_PYTHON_VERSION=3.12 2025-03-14T05:41:09.3223729Z OR pass it as an argument to bazel command directly or inside your .bazelrc 2025-03-14T05:41:09.3224172Z file: 2025-03-14T05:41:09.3224457Z --repo_env=HERMETIC_PYTHON_VERSION=3.12 2025-03-14T05:41:09.3224842Z Loading: 2025-03-14T05:41:09.3225171Z Fetching repository @python_version_repo; starting 2025-03-14T05:41:09.3289069Z 2025-03-14T05:41:09.3289480Z  2025-03-14T05:41:09.3290682Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:87:10: 2025-03-14T05:41:09.3291539Z ============================= 2025-03-14T05:41:09.3291861Z Hermetic Python configuration: 2025-03-14T05:41:09.3292166Z Version: "3.10" 2025-03-14T05:41:09.3292418Z Kind: "" 2025-03-14T05:41:09.3292696Z Interpreter: "default" (provided by rules_python) 2025-03-14T05:41:09.3293229Z Requirements_lock label: "@python_version_repo//:requirements_lock_3_10.txt" 2025-03-14T05:41:09.3293714Z ===================================== 2025-03-14T05:41:09.3294059Z Loading: 2025-03-14T05:41:09.3294609Z Fetching repository @python_version_repo; starting 2025-03-14T05:41:09.5490232Z 2025-03-14T05:41:09.5490858Z  2025-03-14T05:41:09.5491185Z Loading: 2025-03-14T05:41:09.5491534Z Fetching repository @pypi; Restarting. 2025-03-14T05:41:09.5492003Z Fetching repository @python_x86_64-unknown-linux-gnu; starting 2025-03-14T05:41:09.5492607Z Fetching https://github.com/...86_64-unknown-linux-gnu-install_only.tar.gz 2025-03-14T05:41:09.7742099Z 2025-03-14T05:41:09.7742754Z  2025-03-14T05:41:09.7743121Z  2025-03-14T05:41:09.7743370Z  2025-03-14T05:41:09.7743692Z Loading: 2025-03-14T05:41:09.7744036Z Fetching repository @pypi; Restarting. 2025-03-14T05:41:09.7744563Z Fetching repository @python_x86_64-unknown-linux-gnu; starting 2025-03-14T05:41:09.7745184Z Fetching ...ux-gnu; Extracting cpython-3.10.15+20241016-x86_64-unknown-lin\ 2025-03-14T05:41:09.7745677Z ux-gnu-install_only.tar.gz 2025-03-14T05:41:10.5197214Z 2025-03-14T05:41:10.5197840Z  2025-03-14T05:41:10.5198162Z  2025-03-14T05:41:10.5198407Z  2025-03-14T05:41:10.5198632Z  2025-03-14T05:41:10.5198913Z Loading: 2025-03-14T05:41:10.5199253Z Fetching repository @pypi; Restarting. 2025-03-14T05:41:10.5199720Z Fetching repository @python_x86_64-unknown-linux-gnu; starting 2025-03-14T05:41:10.6832989Z 2025-03-14T05:41:10.6833764Z  2025-03-14T05:41:10.6834153Z  2025-03-14T05:41:10.6835368Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/repo.bzl:132:14: 2025-03-14T05:41:10.6836998Z Warning: skipping import of repository 'llvm-raw' because it already exists. 2025-03-14T05:41:10.6837956Z Loading: 2025-03-14T05:41:10.9204091Z 2025-03-14T05:41:10.9204831Z Loading: 2025-03-14T05:41:10.9205231Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:10.9205808Z Fetching https://storage.googleapis.com/...c4fde581cec0295abed8c977.tar.gz 2025-03-14T05:41:11.1207554Z 2025-03-14T05:41:11.1208174Z  2025-03-14T05:41:11.1208481Z  2025-03-14T05:41:11.1208757Z Loading: 2025-03-14T05:41:11.1209103Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:11.1209636Z Fetching https://storage.googleapis.com/...ed8c977.tar.gz; 14.2 MiB (6.7%) 2025-03-14T05:41:11.3211862Z 2025-03-14T05:41:11.3212504Z  2025-03-14T05:41:11.3212806Z  2025-03-14T05:41:11.3213080Z Loading: 2025-03-14T05:41:11.3213423Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:11.3213951Z Fetching https://storage.googleapis.com/...d8c977.tar.gz; 37.2 MiB (17.4%) 2025-03-14T05:41:11.5908290Z 2025-03-14T05:41:11.5909007Z  2025-03-14T05:41:11.5909398Z  2025-03-14T05:41:11.5909680Z Loading: 2025-03-14T05:41:11.5910019Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:11.5910624Z Fetching https://storage.googleapis.com/...d8c977.tar.gz; 83.5 MiB (39.1%) 2025-03-14T05:41:11.9218453Z 2025-03-14T05:41:11.9219108Z  2025-03-14T05:41:11.9219461Z  2025-03-14T05:41:11.9219740Z Loading: 2025-03-14T05:41:11.9220113Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:11.9220656Z Fetching https://storage.googleapis.com/...8c977.tar.gz; 106.4 MiB (49.9%) 2025-03-14T05:41:12.1227601Z 2025-03-14T05:41:12.1228201Z  2025-03-14T05:41:12.1228531Z  2025-03-14T05:41:12.1228823Z Loading: 2025-03-14T05:41:12.1229166Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:12.1229706Z Fetching https://storage.googleapis.com/...8c977.tar.gz; 129.8 MiB (60.8%) 2025-03-14T05:41:12.3893339Z 2025-03-14T05:41:12.3893957Z  2025-03-14T05:41:12.3894306Z  2025-03-14T05:41:12.3894595Z Loading: 2025-03-14T05:41:12.3894949Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:12.3895731Z Fetching https://storage.googleapis.com/...8c977.tar.gz; 176.7 MiB (82.8%) 2025-03-14T05:41:12.7234073Z 2025-03-14T05:41:12.7234699Z  2025-03-14T05:41:12.7235058Z  2025-03-14T05:41:12.7235349Z Loading: 2025-03-14T05:41:12.7235710Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:13.1238768Z 2025-03-14T05:41:13.1239311Z  2025-03-14T05:41:13.1239670Z Loading: 2025-03-14T05:41:13.1240029Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:13.1240546Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:13.1241013Z r.gz 2025-03-14T05:41:14.1248128Z 2025-03-14T05:41:14.1248750Z  2025-03-14T05:41:14.1249107Z  2025-03-14T05:41:14.1249363Z  2025-03-14T05:41:14.1249645Z Loading: 2025-03-14T05:41:14.1249993Z Fetching repository @llvm-raw; starting 2025-03-14T05:41:14.1250506Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:14.1250992Z r.gz 2025-03-14T05:41:15.1291272Z 2025-03-14T05:41:15.1291958Z  2025-03-14T05:41:15.1292252Z  2025-03-14T05:41:15.1292493Z  2025-03-14T05:41:15.1292759Z Loading: 2025-03-14T05:41:15.1293105Z Fetching repository @llvm-raw; starting 4s 2025-03-14T05:41:15.1293620Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:15.1294086Z r.gz 2025-03-14T05:41:16.1300650Z 2025-03-14T05:41:16.1301284Z  2025-03-14T05:41:16.1301619Z  2025-03-14T05:41:16.1301865Z  2025-03-14T05:41:16.1302136Z Loading: 2025-03-14T05:41:16.1302486Z Fetching repository @llvm-raw; starting 5s 2025-03-14T05:41:16.1303003Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:16.1303469Z r.gz 2025-03-14T05:41:17.1311288Z 2025-03-14T05:41:17.1311905Z  2025-03-14T05:41:17.1312200Z  2025-03-14T05:41:17.1312444Z  2025-03-14T05:41:17.1312745Z Loading: 2025-03-14T05:41:17.1313090Z Fetching repository @llvm-raw; starting 6s 2025-03-14T05:41:17.1313851Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:17.1314325Z r.gz 4s 2025-03-14T05:41:18.1321920Z 2025-03-14T05:41:18.1322570Z  2025-03-14T05:41:18.1322921Z  2025-03-14T05:41:18.1323177Z  2025-03-14T05:41:18.1323460Z Loading: 2025-03-14T05:41:18.1323820Z Fetching repository @llvm-raw; starting 7s 2025-03-14T05:41:18.1324344Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:18.1324955Z r.gz 5s 2025-03-14T05:41:19.1329805Z 2025-03-14T05:41:19.1330441Z  2025-03-14T05:41:19.1330769Z  2025-03-14T05:41:19.1331021Z  2025-03-14T05:41:19.1331309Z Loading: 2025-03-14T05:41:19.1331663Z Fetching repository @llvm-raw; starting 8s 2025-03-14T05:41:19.1332221Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:19.1332697Z r.gz 6s 2025-03-14T05:41:20.1338282Z 2025-03-14T05:41:20.1338867Z  2025-03-14T05:41:20.1339183Z  2025-03-14T05:41:20.1339424Z  2025-03-14T05:41:20.1339692Z Loading: 2025-03-14T05:41:20.1340036Z Fetching repository @llvm-raw; starting 9s 2025-03-14T05:41:20.1340555Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:20.1341024Z r.gz 7s 2025-03-14T05:41:21.1348675Z 2025-03-14T05:41:21.1349260Z  2025-03-14T05:41:21.1349564Z  2025-03-14T05:41:21.1349803Z  2025-03-14T05:41:21.1350071Z Loading: 2025-03-14T05:41:21.1350419Z Fetching repository @llvm-raw; starting 10s 2025-03-14T05:41:21.1350945Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:21.1351416Z r.gz 8s 2025-03-14T05:41:22.1357702Z 2025-03-14T05:41:22.1358324Z  2025-03-14T05:41:22.1358683Z  2025-03-14T05:41:22.1359200Z  2025-03-14T05:41:22.1359482Z Loading: 2025-03-14T05:41:22.1359848Z Fetching repository @llvm-raw; starting 11s 2025-03-14T05:41:22.1360370Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:22.1360840Z r.gz 9s 2025-03-14T05:41:23.1367469Z 2025-03-14T05:41:23.1368076Z  2025-03-14T05:41:23.1368379Z  2025-03-14T05:41:23.1368623Z  2025-03-14T05:41:23.1368898Z Loading: 2025-03-14T05:41:23.1369252Z Fetching repository @llvm-raw; starting 12s 2025-03-14T05:41:23.1369773Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:23.1370249Z r.gz 10s 2025-03-14T05:41:24.1375773Z 2025-03-14T05:41:24.1376413Z  2025-03-14T05:41:24.1376742Z  2025-03-14T05:41:24.1376992Z  2025-03-14T05:41:24.1377267Z Loading: 2025-03-14T05:41:24.1377605Z Fetching repository @llvm-raw; starting 13s 2025-03-14T05:41:24.1378152Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:24.1378648Z r.gz 11s 2025-03-14T05:41:25.1386496Z 2025-03-14T05:41:25.1387121Z  2025-03-14T05:41:25.1387459Z  2025-03-14T05:41:25.1387700Z  2025-03-14T05:41:25.1387969Z Loading: 2025-03-14T05:41:25.1388300Z Fetching repository @llvm-raw; starting 14s 2025-03-14T05:41:25.1388816Z Fetching ...vm-raw; Extracting 9c9d4b9e73c19842c4fde581cec0295abed8c977.ta\ 2025-03-14T05:41:25.1389288Z r.gz 12s 2025-03-14T05:41:26.1396303Z 2025-03-14T05:41:26.1396930Z  2025-03-14T05:41:26.1397276Z  2025-03-14T05:41:26.1397528Z  2025-03-14T05:41:26.1397806Z Loading: 2025-03-14T05:41:26.1606332Z 2025-03-14T05:41:26.1608025Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/tsl/third_party/repo.bzl:132:14: 2025-03-14T05:41:26.1610043Z Warning: skipping import of repository 'pybind11_bazel' because it already exists. 2025-03-14T05:41:26.1611072Z Loading: 2025-03-14T05:41:26.1611646Z 2025-03-14T05:41:26.1612851Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/tsl/third_party/repo.bzl:132:14: 2025-03-14T05:41:26.1614702Z Warning: skipping import of repository 'pybind11' because it already exists. 2025-03-14T05:41:26.1615677Z Loading: 2025-03-14T05:41:26.1615949Z 2025-03-14T05:41:26.1617170Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/repo.bzl:132:14: 2025-03-14T05:41:26.1619058Z Warning: skipping import of repository 'jsoncpp_git' because it already exists. 2025-03-14T05:41:26.1620062Z Loading: 2025-03-14T05:41:26.4358380Z 2025-03-14T05:41:26.4359063Z Loading: 2025-03-14T05:41:26.4359487Z Fetching repository @com_github_grpc_grpc; starting 2025-03-14T05:41:26.4360061Z Fetching ...c_grpc; Extracting b54a5b338637f92bfcf4b0bc05e0f57a5fd8fadd.ta\ 2025-03-14T05:41:26.4360531Z r.gz 2025-03-14T05:41:27.3406175Z 2025-03-14T05:41:27.3406953Z  2025-03-14T05:41:27.3407428Z  2025-03-14T05:41:27.3407813Z  2025-03-14T05:41:27.3408273Z Loading: 2025-03-14T05:41:27.7409915Z 2025-03-14T05:41:27.7410575Z Loading: 2025-03-14T05:41:27.7411021Z Fetching repository @com_google_protobuf; starting 2025-03-14T05:41:27.7411599Z Fetching ...232118ec5/external/com_google_protobuf; Extracting v3.21.9.zip 2025-03-14T05:41:27.9415299Z 2025-03-14T05:41:27.9415937Z  2025-03-14T05:41:27.9416231Z  2025-03-14T05:41:27.9416488Z Loading: 2025-03-14T05:41:27.9890516Z 2025-03-14T05:41:27.9891341Z Loading: 2025-03-14T05:41:27.9924376Z 2025-03-14T05:41:27.9925227Z Loading: 0 packages loaded 2025-03-14T05:41:28.1328935Z 2025-03-14T05:41:28.1330096Z Analyzing: target //:_XLAC.so (1 packages loaded, 0 targets configured) 2025-03-14T05:41:28.3422166Z 2025-03-14T05:41:28.3423104Z Analyzing: target //:_XLAC.so (33 packages loaded, 9 targets configured) 2025-03-14T05:41:28.3423731Z Fetching repository @local_config_python; starting 2025-03-14T05:41:28.3424200Z Fetching repository @go_sdk; Finding Go SHA-256 sums 2025-03-14T05:41:28.5933604Z 2025-03-14T05:41:28.5934382Z  2025-03-14T05:41:28.5934854Z  2025-03-14T05:41:28.5935670Z Analyzing: target //:_XLAC.so (33 packages loaded, 9 targets configured) 2025-03-14T05:41:28.5936575Z Fetching repository @local_config_python; starting 2025-03-14T05:41:28.5937486Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2025-03-14T05:41:28.8412092Z 2025-03-14T05:41:28.8412725Z  2025-03-14T05:41:28.8413022Z  2025-03-14T05:41:28.8413527Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2025-03-14T05:41:28.8414187Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2025-03-14T05:41:28.8414822Z Fetching https://dl.google.com/...8.4.linux-amd64.tar.gz; 25.6 MiB (18.9%) 2025-03-14T05:41:29.1435538Z 2025-03-14T05:41:29.1436324Z  2025-03-14T05:41:29.1436683Z  2025-03-14T05:41:29.1437202Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2025-03-14T05:41:29.1437839Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2025-03-14T05:41:29.1438461Z Fetching https://dl.google.com/...8.4.linux-amd64.tar.gz; 53.1 MiB (39.3%) 2025-03-14T05:41:29.4411324Z 2025-03-14T05:41:29.4412066Z  2025-03-14T05:41:29.4412376Z  2025-03-14T05:41:29.4412890Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2025-03-14T05:41:29.4413531Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2025-03-14T05:41:29.4414149Z Fetching https://dl.google.com/....4.linux-amd64.tar.gz; 107.2 MiB (79.3%) 2025-03-14T05:41:29.7443355Z 2025-03-14T05:41:29.7444192Z  2025-03-14T05:41:29.7446816Z  2025-03-14T05:41:29.7447375Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2025-03-14T05:41:29.7448011Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2025-03-14T05:41:30.7451123Z 2025-03-14T05:41:30.7451722Z  2025-03-14T05:41:30.7452327Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2025-03-14T05:41:30.7452977Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2025-03-14T05:41:31.9458306Z 2025-03-14T05:41:31.9458933Z  2025-03-14T05:41:31.9459507Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2025-03-14T05:41:31.9460150Z Fetching repository @go_sdk; Downloading and extracting Go toolchain 2025-03-14T05:41:32.2053861Z 2025-03-14T05:41:32.2054457Z  2025-03-14T05:41:32.2055060Z Analyzing: target //:_XLAC.so (34 packages loaded, 9 targets configured) 2025-03-14T05:41:32.2055590Z currently loading: @go_sdk// 2025-03-14T05:41:32.4072487Z 2025-03-14T05:41:32.4073123Z  2025-03-14T05:41:32.4073716Z Analyzing: target //:_XLAC.so (41 packages loaded, 266 targets configured) 2025-03-14T05:41:32.4074237Z currently loading: @torch// 2025-03-14T05:41:32.7467869Z 2025-03-14T05:41:32.7468623Z  2025-03-14T05:41:32.7469212Z Analyzing: target //:_XLAC.so (44 packages loaded, 266 targets configured) 2025-03-14T05:41:32.7469774Z Fetching repository @local_config_cc; starting 2025-03-14T05:41:33.1472827Z 2025-03-14T05:41:33.1473585Z  2025-03-14T05:41:33.1474489Z Analyzing: target //:_XLAC.so (44 packages loaded, 266 targets configured) 2025-03-14T05:41:33.1475304Z currently loading: @local_config_cc// 2025-03-14T05:41:33.1475851Z Fetching repository @protobuf; starting 2025-03-14T05:41:33.1477110Z Fetching ...05232118ec5/external/protobuf; Extracting protobuf-27.0.tar.gz 2025-03-14T05:41:33.4897046Z 2025-03-14T05:41:33.4897721Z  2025-03-14T05:41:33.4898023Z  2025-03-14T05:41:33.4898267Z  2025-03-14T05:41:33.4898780Z Analyzing: target //:_XLAC.so (53 packages loaded, 8978 targets configured) 2025-03-14T05:41:33.4899428Z currently loading: @com_google_absl//absl/synchronization ... (4 packages) 2025-03-14T05:41:33.7049838Z 2025-03-14T05:41:33.7050669Z  2025-03-14T05:41:33.7051571Z Analyzing: target //:_XLAC.so (156 packages loaded, 10441 targets configured) 2025-03-14T05:41:33.7052503Z currently loading: @com_google_protobuf// ... (5 packages) 2025-03-14T05:41:33.7053151Z Fetching repository @pybind11; starting 2025-03-14T05:41:33.7053739Z Fetching repository @eigen_archive; starting 2025-03-14T05:41:33.7054313Z Fetching repository @llvm-project; starting 2025-03-14T05:41:33.7054921Z Fetching repository @double_conversion; starting 2025-03-14T05:41:33.7055661Z Fetching repository @com_googlesource_code_re2; starting 2025-03-14T05:41:33.7056346Z Fetching repository @stablehlo; starting 2025-03-14T05:41:33.7056921Z Fetching repository @zlib; starting 2025-03-14T05:41:33.7057649Z Fetching ...rchive; Extracting eigen-33d0937c6bdf5ec999939fb17f2a553183d14\ 2025-03-14T05:41:33.7058387Z a74.tar.gz ... (16 fetches) 2025-03-14T05:41:33.8174178Z 2025-03-14T05:41:33.8174805Z  2025-03-14T05:41:33.8175104Z  2025-03-14T05:41:33.8175349Z  2025-03-14T05:41:33.8175583Z  2025-03-14T05:41:33.8175818Z  2025-03-14T05:41:33.8176052Z  2025-03-14T05:41:33.8176288Z  2025-03-14T05:41:33.8176522Z  2025-03-14T05:41:33.8176759Z  2025-03-14T05:41:33.8176992Z  2025-03-14T05:41:33.8178083Z DEBUG: Rule 'pybind11' indicated that a canonical reproducible form can be obtained by modifying arguments sha256 = "cd2fc28640a6b3d712cfd17c176a52185a97c99707f42ac38fa87385de177ec1" 2025-03-14T05:41:33.8179321Z Analyzing: target //:_XLAC.so (172 packages loaded, 12564 targets configured) 2025-03-14T05:41:33.8180141Z currently loading: @xla//xla/mlir_hlo ... (3 packages) 2025-03-14T05:41:33.8180568Z Fetching repository @pybind11; starting 2025-03-14T05:41:33.8180965Z Fetching repository @eigen_archive; starting 2025-03-14T05:41:33.8181356Z Fetching repository @llvm-project; starting 2025-03-14T05:41:33.8181771Z Fetching repository @double_conversion; starting 2025-03-14T05:41:33.8182174Z Fetching repository @stablehlo; starting 2025-03-14T05:41:33.8182664Z Fetching ...rchive; Extracting eigen-33d0937c6bdf5ec999939fb17f2a553183d14\ 2025-03-14T05:41:33.8183160Z a74.tar.gz 2025-03-14T05:41:33.8183571Z Fetching https://storage.googleapis.com/...b4735a6f08c324145625447fb6d.zip 2025-03-14T05:41:33.8184115Z Fetching repository @curl; starting ... (14 fetches) 2025-03-14T05:41:33.8184398Z 2025-03-14T05:41:33.8184515Z  2025-03-14T05:41:33.8184762Z  2025-03-14T05:41:33.8184997Z  2025-03-14T05:41:33.8185242Z  2025-03-14T05:41:33.8185478Z  2025-03-14T05:41:33.8185712Z  2025-03-14T05:41:33.8185950Z  2025-03-14T05:41:33.8186182Z  2025-03-14T05:41:33.8186414Z  2025-03-14T05:41:33.8186651Z  2025-03-14T05:41:33.8186998Z DEBUG: Repository pybind11 instantiated at: 2025-03-14T05:41:33.8187508Z /var/lib/jenkins/workspace/xla/WORKSPACE:12:13: in 2025-03-14T05:41:33.8187967Z Repository rule http_archive defined at: 2025-03-14T05:41:33.8188807Z /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/bazel_tools/tools/build_defs/repo/http.bzl:372:31: in 2025-03-14T05:41:33.8189874Z Analyzing: target //:_XLAC.so (172 packages loaded, 12564 targets configured) 2025-03-14T05:41:33.8190430Z currently loading: @xla//xla/mlir_hlo ... (3 packages) 2025-03-14T05:41:33.8190867Z Fetching repository @pybind11; starting 2025-03-14T05:41:33.8191418Z Fetching repository @eigen_archive; starting 2025-03-14T05:41:33.8191828Z Fetching repository @llvm-project; starting 2025-03-14T05:41:33.8192247Z Fetching repository @double_conversion; starting 2025-03-14T05:41:33.8192651Z Fetching repository @stablehlo; starting 2025-03-14T05:41:33.8193149Z Fetching ...rchive; Extracting eigen-33d0937c6bdf5ec999939fb17f2a553183d14\ 2025-03-14T05:41:33.8193772Z a74.tar.gz 2025-03-14T05:41:33.8194371Z Fetching https://storage.googleapis.com/...b4735a6f08c324145625447fb6d.zip 2025-03-14T05:41:33.8195057Z Fetching repository @curl; starting ... (14 fetches) 2025-03-14T05:41:34.0186982Z 2025-03-14T05:41:34.0187806Z  2025-03-14T05:41:34.0188273Z  2025-03-14T05:41:34.0188673Z  2025-03-14T05:41:34.0189063Z  2025-03-14T05:41:34.0189438Z  2025-03-14T05:41:34.0189818Z  2025-03-14T05:41:34.0190196Z  2025-03-14T05:41:34.0190594Z  2025-03-14T05:41:34.0190974Z  2025-03-14T05:41:34.0191400Z  2025-03-14T05:41:34.0192284Z Analyzing: target //:_XLAC.so (182 packages loaded, 14052 targets configured) 2025-03-14T05:41:34.0193287Z currently loading: @xla//xla/mlir_hlo ... (4 packages) 2025-03-14T05:41:34.0194072Z Fetching repository @llvm-project; starting 2025-03-14T05:41:34.0194759Z Fetching repository @stablehlo; starting 2025-03-14T05:41:34.0195399Z Fetching repository @curl; starting 2025-03-14T05:41:34.0196010Z Fetching repository @boringssl; starting 2025-03-14T05:41:34.0196867Z Fetching https://storage.googleapis.com/...a4bcdc.tar.gz; 13.6 MiB (32.8%) 2025-03-14T05:41:34.0198033Z Fetching ...74777805232118ec5/external/curl; Extracting curl-8.11.0.tar.gz 2025-03-14T05:41:34.0199097Z Fetching repository @pypi_torch; Running IsStandaloneInterpreter 2025-03-14T05:41:34.0200061Z Fetching repository @pypi_pyyaml; starting ... (9 fetches) 2025-03-14T05:41:34.2220438Z 2025-03-14T05:41:34.2221157Z  2025-03-14T05:41:34.2221502Z  2025-03-14T05:41:34.2221746Z  2025-03-14T05:41:34.2222182Z  2025-03-14T05:41:34.2222419Z  2025-03-14T05:41:34.2222651Z  2025-03-14T05:41:34.2222881Z  2025-03-14T05:41:34.2223114Z  2025-03-14T05:41:34.2223345Z  2025-03-14T05:41:34.2223877Z Analyzing: target //:_XLAC.so (186 packages loaded, 14289 targets configured) 2025-03-14T05:41:34.2224475Z currently loading: @llvm-project//mlir ... (3 packages) 2025-03-14T05:41:34.2224907Z Fetching repository @stablehlo; starting 2025-03-14T05:41:34.2225284Z Fetching repository @boringssl; starting 2025-03-14T05:41:34.2225806Z Fetching https://storage.googleapis.com/...a4bcdc.tar.gz; 30.2 MiB (72.9%) 2025-03-14T05:41:34.2226443Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2025-03-14T05:41:34.2226910Z ch) 2025-03-14T05:41:34.2227276Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2025-03-14T05:41:34.2227751Z yaml==6.0.1) 2025-03-14T05:41:34.2228149Z Fetching ...blehlo; Extracting d1db6dfe13488b4735a6f08c324145625447fb6d.zi\ 2025-03-14T05:41:34.2228608Z p 2025-03-14T05:41:34.4396180Z 2025-03-14T05:41:34.4396970Z  2025-03-14T05:41:34.4397322Z  2025-03-14T05:41:34.4397608Z  2025-03-14T05:41:34.4397879Z  2025-03-14T05:41:34.4398246Z  2025-03-14T05:41:34.4398489Z  2025-03-14T05:41:34.4398727Z  2025-03-14T05:41:34.4398964Z  2025-03-14T05:41:34.4399212Z  2025-03-14T05:41:34.4399454Z  2025-03-14T05:41:34.4399986Z Analyzing: target //:_XLAC.so (194 packages loaded, 19290 targets configured) 2025-03-14T05:41:34.4400618Z currently loading: @xla//xla/service/spmd/shardy/mhlo_round_trip 2025-03-14T05:41:34.4401088Z Fetching repository @stablehlo; starting 2025-03-14T05:41:34.4401455Z Fetching repository @boringssl; starting 2025-03-14T05:41:34.4401952Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2025-03-14T05:41:34.4402665Z ch) 2025-03-14T05:41:34.4403069Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2025-03-14T05:41:34.4403560Z yaml==6.0.1) 2025-03-14T05:41:34.4403959Z Fetching ...blehlo; Extracting d1db6dfe13488b4735a6f08c324145625447fb6d.zi\ 2025-03-14T05:41:34.4404417Z p 2025-03-14T05:41:34.4404937Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2025-03-14T05:41:34.4405410Z r.gz 2025-03-14T05:41:34.4405664Z Fetching repository @onednn; starting 2025-03-14T05:41:34.6319577Z 2025-03-14T05:41:34.6320380Z  2025-03-14T05:41:34.6320869Z  2025-03-14T05:41:34.6321248Z  2025-03-14T05:41:34.6321660Z  2025-03-14T05:41:34.6321984Z  2025-03-14T05:41:34.6322312Z  2025-03-14T05:41:34.6322639Z  2025-03-14T05:41:34.6322958Z  2025-03-14T05:41:34.6323295Z  2025-03-14T05:41:34.6323641Z  2025-03-14T05:41:34.6323995Z  2025-03-14T05:41:34.6324362Z  2025-03-14T05:41:34.6325332Z Analyzing: target //:_XLAC.so (206 packages loaded, 21913 targets configured) 2025-03-14T05:41:34.6326299Z Fetching repository @stablehlo; starting 2025-03-14T05:41:34.6326955Z Fetching repository @boringssl; starting 2025-03-14T05:41:34.6327815Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2025-03-14T05:41:34.6328661Z ch) 2025-03-14T05:41:34.6329345Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2025-03-14T05:41:34.6330378Z yaml==6.0.1) 2025-03-14T05:41:34.6331035Z Fetching ...blehlo; Extracting d1db6dfe13488b4735a6f08c324145625447fb6d.zi\ 2025-03-14T05:41:34.6331842Z p 2025-03-14T05:41:34.6332512Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2025-03-14T05:41:34.6333333Z r.gz 2025-03-14T05:41:34.6333740Z Fetching repository @onednn; starting 2025-03-14T05:41:34.6334556Z Fetching ...b58aa74777805232118ec5/external/onednn; Extracting v3.5.tar.gz 2025-03-14T05:41:34.8486622Z 2025-03-14T05:41:34.8487360Z  2025-03-14T05:41:34.8488131Z  2025-03-14T05:41:34.8488478Z  2025-03-14T05:41:34.8488744Z  2025-03-14T05:41:34.8488981Z  2025-03-14T05:41:34.8489204Z  2025-03-14T05:41:34.8502249Z  2025-03-14T05:41:34.8502527Z  2025-03-14T05:41:34.8502774Z  2025-03-14T05:41:34.8503015Z  2025-03-14T05:41:34.8503253Z  2025-03-14T05:41:34.8503476Z  2025-03-14T05:41:34.8503997Z Analyzing: target //:_XLAC.so (207 packages loaded, 22837 targets configured) 2025-03-14T05:41:34.8504545Z Fetching repository @boringssl; starting 2025-03-14T05:41:34.8505077Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2025-03-14T05:41:34.8505547Z ch) 2025-03-14T05:41:34.8505931Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2025-03-14T05:41:34.8506413Z yaml==6.0.1) 2025-03-14T05:41:34.8506844Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2025-03-14T05:41:34.8507312Z r.gz 2025-03-14T05:41:34.8507575Z Fetching repository @onednn; starting 2025-03-14T05:41:34.8508060Z Fetching ...b58aa74777805232118ec5/external/onednn; Extracting v3.5.tar.gz 2025-03-14T05:41:34.8508592Z Fetching repository @com_nlohmann_json; starting 2025-03-14T05:41:34.8509115Z Fetching ...32118ec5/external/com_nlohmann_json; Extracting v3.11.2.tar.gz 2025-03-14T05:41:35.1484917Z 2025-03-14T05:41:35.1485644Z  2025-03-14T05:41:35.1486120Z  2025-03-14T05:41:35.1486525Z  2025-03-14T05:41:35.1486911Z  2025-03-14T05:41:35.1487328Z  2025-03-14T05:41:35.1487751Z  2025-03-14T05:41:35.1488157Z  2025-03-14T05:41:35.1488471Z  2025-03-14T05:41:35.1488709Z  2025-03-14T05:41:35.1488944Z  2025-03-14T05:41:35.1489184Z  2025-03-14T05:41:35.1489716Z Analyzing: target //:_XLAC.so (208 packages loaded, 22844 targets configured) 2025-03-14T05:41:35.1490496Z Fetching repository @boringssl; starting 2025-03-14T05:41:35.1491013Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2025-03-14T05:41:35.1491470Z ch) 2025-03-14T05:41:35.1491856Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2025-03-14T05:41:35.1492332Z yaml==6.0.1) 2025-03-14T05:41:35.1492734Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2025-03-14T05:41:35.1493202Z r.gz 2025-03-14T05:41:35.1493453Z Fetching repository @onednn; starting 2025-03-14T05:41:35.1493940Z Fetching ...b58aa74777805232118ec5/external/onednn; Extracting v3.5.tar.gz 2025-03-14T05:41:35.5488675Z 2025-03-14T05:41:35.5489457Z  2025-03-14T05:41:35.5489907Z  2025-03-14T05:41:35.5490291Z  2025-03-14T05:41:35.5490678Z  2025-03-14T05:41:35.5491061Z  2025-03-14T05:41:35.5491441Z  2025-03-14T05:41:35.5491820Z  2025-03-14T05:41:35.5492217Z  2025-03-14T05:41:35.5492595Z  2025-03-14T05:41:35.5493499Z Analyzing: target //:_XLAC.so (209 packages loaded, 23977 targets configured) 2025-03-14T05:41:35.5494440Z Fetching repository @boringssl; starting 2025-03-14T05:41:35.5495277Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2025-03-14T05:41:35.5496075Z ch) 2025-03-14T05:41:35.5496701Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2025-03-14T05:41:35.5497524Z yaml==6.0.1) 2025-03-14T05:41:35.5498203Z Fetching ...ingssl; Extracting c00d7ca810e93780bd0c8ee4eea28f4f2ea4bcdc.ta\ 2025-03-14T05:41:35.5499011Z r.gz 2025-03-14T05:41:35.7493141Z 2025-03-14T05:41:35.7493794Z  2025-03-14T05:41:35.7494094Z  2025-03-14T05:41:35.7494374Z  2025-03-14T05:41:35.7494599Z  2025-03-14T05:41:35.7494835Z  2025-03-14T05:41:35.7495068Z  2025-03-14T05:41:35.7495300Z  2025-03-14T05:41:35.7495849Z Analyzing: target //:_XLAC.so (210 packages loaded, 24948 targets configured) 2025-03-14T05:41:35.7496514Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2025-03-14T05:41:35.7497225Z ch) 2025-03-14T05:41:35.7497619Z Fetching ...pyyaml; Running whl_library.ResolveRequirement(pypi_pyyaml, py\ 2025-03-14T05:41:35.7498095Z yaml==6.0.1) 2025-03-14T05:41:36.1553356Z 2025-03-14T05:41:36.1554064Z  2025-03-14T05:41:36.1554357Z  2025-03-14T05:41:36.1554601Z  2025-03-14T05:41:36.1554840Z  2025-03-14T05:41:36.1555432Z Analyzing: target //:_XLAC.so (210 packages loaded, 24993 targets configured) 2025-03-14T05:41:36.1556114Z Fetching ..._torch; Running whl_library.ResolveRequirement(pypi_torch, tor\ 2025-03-14T05:41:36.1556581Z ch) 2025-03-14T05:41:36.1557035Z Fetching ...pyyaml; Running whl_library.ExtractWheel(pypi_pyyaml, /home/je\ 2025-03-14T05:41:36.1557676Z nkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/py\ 2025-03-14T05:41:36.1558346Z pi_pyyaml/PyYAML-6.0.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.\ 2025-03-14T05:41:36.1558832Z whl) 2025-03-14T05:41:36.4832859Z 2025-03-14T05:41:36.4833500Z  2025-03-14T05:41:36.4833803Z  2025-03-14T05:41:36.4834049Z  2025-03-14T05:41:36.4834349Z  2025-03-14T05:41:36.4834604Z  2025-03-14T05:41:36.4834839Z  2025-03-14T05:41:36.4835368Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:36.4836038Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2025-03-14T05:41:36.4836670Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:36.4837260Z i_torch/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl) 2025-03-14T05:41:37.5504970Z 2025-03-14T05:41:37.5505612Z  2025-03-14T05:41:37.5505914Z  2025-03-14T05:41:37.5506161Z  2025-03-14T05:41:37.5506924Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:37.5507600Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2025-03-14T05:41:37.5508253Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:37.5508846Z i_torch/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl) 2025-03-14T05:41:38.5514786Z 2025-03-14T05:41:38.5515392Z  2025-03-14T05:41:38.5515699Z  2025-03-14T05:41:38.5515945Z  2025-03-14T05:41:38.5516479Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:38.5517150Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2025-03-14T05:41:38.5517782Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:38.5518378Z i_torch/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl) 4s 2025-03-14T05:41:39.5525379Z 2025-03-14T05:41:39.5526192Z  2025-03-14T05:41:39.5526499Z  2025-03-14T05:41:39.5526772Z  2025-03-14T05:41:39.5527304Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:39.5527983Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2025-03-14T05:41:39.5528626Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:39.5529228Z i_torch/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl) 5s 2025-03-14T05:41:40.5530187Z 2025-03-14T05:41:40.5530813Z  2025-03-14T05:41:40.5531145Z  2025-03-14T05:41:40.5531390Z  2025-03-14T05:41:40.5531920Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:40.5532585Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2025-03-14T05:41:40.5533226Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:40.5533865Z i_torch/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl) 6s 2025-03-14T05:41:41.7538172Z 2025-03-14T05:41:41.7539068Z  2025-03-14T05:41:41.7539371Z  2025-03-14T05:41:41.7539599Z  2025-03-14T05:41:41.7540140Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:41.7540801Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2025-03-14T05:41:41.7541438Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:41.7542038Z i_torch/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl) 7s 2025-03-14T05:41:42.7546473Z 2025-03-14T05:41:42.7547216Z  2025-03-14T05:41:42.7547512Z  2025-03-14T05:41:42.7547750Z  2025-03-14T05:41:42.7548277Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:42.7548940Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2025-03-14T05:41:42.7549599Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:42.7550206Z i_torch/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl) 8s 2025-03-14T05:41:43.7557737Z 2025-03-14T05:41:43.7558280Z  2025-03-14T05:41:43.7558585Z  2025-03-14T05:41:43.7558825Z  2025-03-14T05:41:43.7559347Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:43.7560010Z Fetching ..._torch; Running whl_library.ExtractWheel(pypi_torch, /home/jen\ 2025-03-14T05:41:43.7560650Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:43.7561248Z i_torch/torch-2.8.0a0+gitaed0b7a-cp310-cp310-linux_x86_64.whl) 9s 2025-03-14T05:41:44.1216311Z 2025-03-14T05:41:44.1216851Z  2025-03-14T05:41:44.1217216Z  2025-03-14T05:41:44.1217467Z  2025-03-14T05:41:44.1217991Z Analyzing: target //:_XLAC.so (211 packages loaded, 24993 targets configured) 2025-03-14T05:41:44.1218795Z currently loading: @pypi_torch// 2025-03-14T05:41:44.3563334Z 2025-03-14T05:41:44.3564016Z  2025-03-14T05:41:44.3564771Z Analyzing: target //:_XLAC.so (213 packages loaded, 27314 targets configured) 2025-03-14T05:41:44.3565674Z Fetching ...nsions; Running whl_library.ResolveRequirement(pypi_typing_ext\ 2025-03-14T05:41:44.3566188Z ensions, typing-extensions==4.11.0) 2025-03-14T05:41:44.3566681Z Fetching ...jinja2; Running whl_library.ResolveRequirement(pypi_jinja2, ji\ 2025-03-14T05:41:44.3567155Z nja2==3.1.4) 2025-03-14T05:41:44.3567550Z Fetching ...lelock; Running whl_library.ResolveRequirement(pypi_filelock, \ 2025-03-14T05:41:44.3568023Z filelock==3.14.0) 2025-03-14T05:41:44.3568430Z Fetching ...tworkx; Running whl_library.ResolveRequirement(pypi_networkx, \ 2025-03-14T05:41:44.3568906Z networkx==3.3) 2025-03-14T05:41:44.3569291Z Fetching ..._sympy; Running whl_library.ResolveRequirement(pypi_sympy, sym\ 2025-03-14T05:41:44.3569759Z py==1.12) 2025-03-14T05:41:44.3570159Z Fetching ...fsspec; Running whl_library.ResolveRequirement(pypi_fsspec, fs\ 2025-03-14T05:41:44.3570638Z spec==2024.5.0) 2025-03-14T05:41:45.2969951Z 2025-03-14T05:41:45.2970562Z  2025-03-14T05:41:45.2970865Z  2025-03-14T05:41:45.2971127Z  2025-03-14T05:41:45.2971372Z  2025-03-14T05:41:45.2971605Z  2025-03-14T05:41:45.2971838Z  2025-03-14T05:41:45.2972073Z  2025-03-14T05:41:45.2972304Z  2025-03-14T05:41:45.2972536Z  2025-03-14T05:41:45.2972768Z  2025-03-14T05:41:45.2973001Z  2025-03-14T05:41:45.2973234Z  2025-03-14T05:41:45.2973761Z Analyzing: target //:_XLAC.so (213 packages loaded, 27314 targets configured) 2025-03-14T05:41:45.2974430Z Fetching ...nsions; Running whl_library.ResolveRequirement(pypi_typing_ext\ 2025-03-14T05:41:45.2975106Z ensions, typing-extensions==4.11.0) 2025-03-14T05:41:45.2975751Z Fetching ...jinja2; Running whl_library.ResolveRequirement(pypi_jinja2, ji\ 2025-03-14T05:41:45.2976477Z nja2==3.1.4) 2025-03-14T05:41:45.2976962Z Fetching ...lelock; Running whl_library.ExtractWheel(pypi_filelock, /home/\ 2025-03-14T05:41:45.2977839Z jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/\ 2025-03-14T05:41:45.2978389Z pypi_filelock/filelock-3.14.0-py3-none-any.whl) 2025-03-14T05:41:45.2979106Z Fetching ...tworkx; Running whl_library.ResolveRequirement(pypi_networkx, \ 2025-03-14T05:41:45.2979576Z networkx==3.3) 2025-03-14T05:41:45.2979974Z Fetching ..._sympy; Running whl_library.ResolveRequirement(pypi_sympy, sym\ 2025-03-14T05:41:45.2980437Z py==1.12) 2025-03-14T05:41:45.2980829Z Fetching ...fsspec; Running whl_library.ResolveRequirement(pypi_fsspec, fs\ 2025-03-14T05:41:45.2981294Z spec==2024.5.0) 2025-03-14T05:41:45.5020193Z 2025-03-14T05:41:45.5020971Z  2025-03-14T05:41:45.5021317Z  2025-03-14T05:41:45.5021565Z  2025-03-14T05:41:45.5021807Z  2025-03-14T05:41:45.5022043Z  2025-03-14T05:41:45.5022304Z  2025-03-14T05:41:45.5022632Z  2025-03-14T05:41:45.5022887Z  2025-03-14T05:41:45.5023108Z  2025-03-14T05:41:45.5023341Z  2025-03-14T05:41:45.5023574Z  2025-03-14T05:41:45.5023811Z  2025-03-14T05:41:45.5024045Z  2025-03-14T05:41:45.5024583Z Analyzing: target //:_XLAC.so (215 packages loaded, 27314 targets configured) 2025-03-14T05:41:45.5025117Z currently loading: @pypi_jinja2// 2025-03-14T05:41:45.5025614Z Fetching ...tworkx; Running whl_library.ExtractWheel(pypi_networkx, /home/\ 2025-03-14T05:41:45.5026249Z jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/\ 2025-03-14T05:41:45.5026774Z pypi_networkx/networkx-3.3-py3-none-any.whl) 2025-03-14T05:41:45.5027272Z Fetching ..._sympy; Running whl_library.ExtractWheel(pypi_sympy, /home/jen\ 2025-03-14T05:41:45.5027898Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:45.5028623Z i_sympy/sympy-1.12-py3-none-any.whl) 2025-03-14T05:41:45.5029103Z Fetching ...fsspec; Running whl_library.ExtractWheel(pypi_fsspec, /home/je\ 2025-03-14T05:41:45.5029741Z nkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/py\ 2025-03-14T05:41:45.5030261Z pi_fsspec/fsspec-2024.5.0-py3-none-any.whl) 2025-03-14T05:41:45.7144246Z 2025-03-14T05:41:45.7144838Z  2025-03-14T05:41:45.7145227Z  2025-03-14T05:41:45.7145469Z  2025-03-14T05:41:45.7145707Z  2025-03-14T05:41:45.7145942Z  2025-03-14T05:41:45.7146174Z  2025-03-14T05:41:45.7146404Z  2025-03-14T05:41:45.7146624Z  2025-03-14T05:41:45.7146857Z  2025-03-14T05:41:45.7147091Z  2025-03-14T05:41:45.7147625Z Analyzing: target //:_XLAC.so (217 packages loaded, 27314 targets configured) 2025-03-14T05:41:45.7148242Z currently loading: @pypi_networkx// 2025-03-14T05:41:45.7148742Z Fetching ..._sympy; Running whl_library.ExtractWheel(pypi_sympy, /home/jen\ 2025-03-14T05:41:45.7149662Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:45.7150535Z i_sympy/sympy-1.12-py3-none-any.whl) 2025-03-14T05:41:45.9573418Z 2025-03-14T05:41:45.9574035Z  2025-03-14T05:41:45.9574328Z  2025-03-14T05:41:45.9574576Z  2025-03-14T05:41:45.9574819Z  2025-03-14T05:41:45.9575345Z Analyzing: target //:_XLAC.so (218 packages loaded, 27314 targets configured) 2025-03-14T05:41:45.9576015Z Fetching ..._sympy; Running whl_library.ExtractWheel(pypi_sympy, /home/jen\ 2025-03-14T05:41:45.9576657Z kins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/pyp\ 2025-03-14T05:41:45.9577165Z i_sympy/sympy-1.12-py3-none-any.whl) 2025-03-14T05:41:46.3578515Z 2025-03-14T05:41:46.3579120Z  2025-03-14T05:41:46.3579423Z  2025-03-14T05:41:46.3579682Z  2025-03-14T05:41:46.3580206Z Analyzing: target //:_XLAC.so (219 packages loaded, 39117 targets configured) 2025-03-14T05:41:46.3580920Z Fetching ...upsafe; Running whl_library.ResolveRequirement(pypi_markupsafe\ 2025-03-14T05:41:46.3581659Z , markupsafe==2.1.5) 2025-03-14T05:41:46.3582087Z Fetching ...mpmath; Running whl_library.ResolveRequirement(pypi_mpmath, mp\ 2025-03-14T05:41:46.3582564Z math==1.3.0) 2025-03-14T05:41:46.9441321Z 2025-03-14T05:41:46.9441933Z  2025-03-14T05:41:46.9442236Z  2025-03-14T05:41:46.9442480Z  2025-03-14T05:41:46.9442719Z  2025-03-14T05:41:46.9443257Z Analyzing: target //:_XLAC.so (219 packages loaded, 39117 targets configured) 2025-03-14T05:41:46.9443927Z Fetching ...upsafe; Running whl_library.ResolveRequirement(pypi_markupsafe\ 2025-03-14T05:41:46.9444626Z , markupsafe==2.1.5) 2025-03-14T05:41:46.9445053Z Fetching ...mpmath; Running whl_library.ExtractWheel(pypi_mpmath, /home/je\ 2025-03-14T05:41:46.9445688Z nkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/py\ 2025-03-14T05:41:46.9446227Z pi_mpmath/mpmath-1.3.0-py3-none-any.whl) 2025-03-14T05:41:47.1586906Z 2025-03-14T05:41:47.1587570Z  2025-03-14T05:41:47.1587886Z  2025-03-14T05:41:47.1588129Z  2025-03-14T05:41:47.1588376Z  2025-03-14T05:41:47.1588611Z  2025-03-14T05:41:47.1589137Z Analyzing: target //:_XLAC.so (220 packages loaded, 40697 targets configured) 2025-03-14T05:41:47.1589809Z Fetching ...upsafe; Running whl_library.ResolveRequirement(pypi_markupsafe\ 2025-03-14T05:41:47.1590294Z , markupsafe==2.1.5) 2025-03-14T05:41:47.3591810Z 2025-03-14T05:41:47.3592432Z  2025-03-14T05:41:47.3592725Z  2025-03-14T05:41:47.3593257Z Analyzing: target //:_XLAC.so (221 packages loaded, 40743 targets configured) 2025-03-14T05:41:47.6488378Z 2025-03-14T05:41:47.6489329Z INFO: Analyzed target //:_XLAC.so (221 packages loaded, 40755 targets configured). 2025-03-14T05:41:47.6489960Z  checking cached actions 2025-03-14T05:41:47.6520275Z 2025-03-14T05:41:47.6520998Z INFO: Found 1 target... 2025-03-14T05:41:47.6521421Z  checking cached actions 2025-03-14T05:41:47.7606301Z 2025-03-14T05:41:47.7607168Z [0 / 189] checking cached actions 2025-03-14T05:41:48.0147268Z 2025-03-14T05:41:48.0148623Z [414 / 15,082] 30 actions, 22 running 2025-03-14T05:41:48.0149542Z Executing genrule @local_config_python//:python_include; 0s local 2025-03-14T05:41:48.0150595Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2025-03-14T05:41:48.0151460Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.0152393Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 0s local 2025-03-14T05:41:48.0153505Z Compiling src/compiler/ruby_generator.cc [for tool]; 0s local 2025-03-14T05:41:48.0154416Z Compiling absl/log/initialize.cc; 0s local 2025-03-14T05:41:48.0155097Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.0155987Z Compiling src/compiler/cpp_plugin.cc [for tool]; 0s local ... 2025-03-14T05:41:48.2285505Z 2025-03-14T05:41:48.2286355Z  2025-03-14T05:41:48.2286881Z  2025-03-14T05:41:48.2287254Z  2025-03-14T05:41:48.2287747Z  2025-03-14T05:41:48.2288262Z  2025-03-14T05:41:48.2288685Z  2025-03-14T05:41:48.2289052Z  2025-03-14T05:41:48.2289415Z  2025-03-14T05:41:48.2290014Z [896 / 15,235] 44 actions, 41 running 2025-03-14T05:41:48.2290814Z Executing genrule @local_config_python//:python_include; 0s local 2025-03-14T05:41:48.2291785Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2025-03-14T05:41:48.2292593Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.2293445Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 0s local 2025-03-14T05:41:48.2294424Z Compiling src/compiler/ruby_generator.cc [for tool]; 0s local 2025-03-14T05:41:48.2295363Z Compiling absl/log/initialize.cc; 0s local 2025-03-14T05:41:48.2296037Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.2296794Z Compiling src/compiler/cpp_plugin.cc [for tool]; 0s local ... 2025-03-14T05:41:48.3660372Z 2025-03-14T05:41:48.3661215Z  2025-03-14T05:41:48.3661677Z  2025-03-14T05:41:48.3662064Z  2025-03-14T05:41:48.3662483Z  2025-03-14T05:41:48.3662883Z  2025-03-14T05:41:48.3663287Z  2025-03-14T05:41:48.3663684Z  2025-03-14T05:41:48.3664070Z  2025-03-14T05:41:48.3664674Z [1,240 / 15,235] 44 actions, 41 running 2025-03-14T05:41:48.3665706Z Executing genrule @local_config_python//:python_include; 0s local 2025-03-14T05:41:48.3666721Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2025-03-14T05:41:48.3667544Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.3668598Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 0s local 2025-03-14T05:41:48.3669618Z Compiling src/compiler/ruby_generator.cc [for tool]; 0s local 2025-03-14T05:41:48.3670449Z Compiling absl/log/initialize.cc; 0s local 2025-03-14T05:41:48.3671136Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.3671914Z Compiling src/compiler/cpp_plugin.cc [for tool]; 0s local ... 2025-03-14T05:41:48.5905785Z 2025-03-14T05:41:48.5906583Z  2025-03-14T05:41:48.5907053Z  2025-03-14T05:41:48.5907444Z  2025-03-14T05:41:48.5907860Z  2025-03-14T05:41:48.5908257Z  2025-03-14T05:41:48.5908659Z  2025-03-14T05:41:48.5909037Z  2025-03-14T05:41:48.5909430Z  2025-03-14T05:41:48.5910020Z [1,855 / 15,235] 44 actions, 41 running 2025-03-14T05:41:48.5910886Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2025-03-14T05:41:48.5911738Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.5912581Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 0s local 2025-03-14T05:41:48.5913584Z Compiling src/compiler/ruby_generator.cc [for tool]; 0s local 2025-03-14T05:41:48.5914743Z Compiling absl/log/initialize.cc; 0s local 2025-03-14T05:41:48.5915453Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.5916219Z Compiling src/compiler/cpp_plugin.cc [for tool]; 0s local 2025-03-14T05:41:48.5917080Z Compiling src/compiler/php_generator.cc [for tool]; 0s local ... 2025-03-14T05:41:48.7675532Z 2025-03-14T05:41:48.7676337Z  2025-03-14T05:41:48.7676802Z  2025-03-14T05:41:48.7677199Z  2025-03-14T05:41:48.7677597Z  2025-03-14T05:41:48.7678012Z  2025-03-14T05:41:48.7678388Z  2025-03-14T05:41:48.7678794Z  2025-03-14T05:41:48.7679175Z  2025-03-14T05:41:48.7679742Z [2,351 / 15,235] 43 actions, 41 running 2025-03-14T05:41:48.7680556Z Compiling llvm/lib/Demangle/RustDemangle.cpp [for tool]; 0s local 2025-03-14T05:41:48.7681373Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.7682215Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 0s local 2025-03-14T05:41:48.7683283Z Compiling src/compiler/ruby_generator.cc [for tool]; 0s local 2025-03-14T05:41:48.7684032Z @com_google_protobuf//:protoc_lib; 0s local 2025-03-14T05:41:48.7684938Z Compiling src/compiler/cpp_plugin.cc [for tool]; 0s local 2025-03-14T05:41:48.7685803Z Compiling src/compiler/php_generator.cc [for tool]; 0s local 2025-03-14T05:41:48.7686789Z Compiling src/compiler/objective_c_generator.cc [for tool]; 0s local ... 2025-03-14T05:41:48.9705153Z 2025-03-14T05:41:48.9705963Z  2025-03-14T05:41:48.9706457Z  2025-03-14T05:41:48.9706864Z  2025-03-14T05:41:48.9707241Z  2025-03-14T05:41:48.9707647Z  2025-03-14T05:41:48.9708052Z  2025-03-14T05:41:48.9708448Z  2025-03-14T05:41:48.9708810Z  2025-03-14T05:41:48.9709362Z [2,849 / 15,235] 43 actions, 41 running 2025-03-14T05:41:48.9710026Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:48.9710944Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 1s local 2025-03-14T05:41:48.9712012Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T05:41:48.9713190Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:48.9713956Z Compiling src/compiler/cpp_plugin.cc [for tool]; 1s local 2025-03-14T05:41:48.9714866Z Compiling src/compiler/php_generator.cc [for tool]; 1s local 2025-03-14T05:41:48.9715858Z Compiling src/compiler/objective_c_generator.cc [for tool]; 1s local 2025-03-14T05:41:48.9716926Z Compiling src/compiler/python_generator.cc [for tool]; 1s local ... 2025-03-14T05:41:49.1719814Z 2025-03-14T05:41:49.1720655Z  2025-03-14T05:41:49.1721125Z  2025-03-14T05:41:49.1721550Z  2025-03-14T05:41:49.1721981Z  2025-03-14T05:41:49.1722327Z  2025-03-14T05:41:49.1722704Z  2025-03-14T05:41:49.1723120Z  2025-03-14T05:41:49.1723541Z  2025-03-14T05:41:49.1724087Z [3,327 / 15,235] 45 actions, 41 running 2025-03-14T05:41:49.1724941Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:49.1725861Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 1s local 2025-03-14T05:41:49.1726904Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.1727682Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:49.1728428Z Compiling src/compiler/cpp_plugin.cc [for tool]; 1s local 2025-03-14T05:41:49.1729324Z Compiling src/compiler/php_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.1730307Z Compiling src/compiler/objective_c_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.1731336Z Compiling src/compiler/python_generator.cc [for tool]; 1s local ... 2025-03-14T05:41:49.3907910Z 2025-03-14T05:41:49.3908740Z  2025-03-14T05:41:49.3909217Z  2025-03-14T05:41:49.3909622Z  2025-03-14T05:41:49.3910030Z  2025-03-14T05:41:49.3910429Z  2025-03-14T05:41:49.3910840Z  2025-03-14T05:41:49.3911238Z  2025-03-14T05:41:49.3918109Z  2025-03-14T05:41:49.3919134Z [4,034 / 15,235] 46 actions, 40 running 2025-03-14T05:41:49.3919843Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:49.3920734Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 1s local 2025-03-14T05:41:49.3921757Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.3922541Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:49.3923308Z Compiling src/compiler/cpp_plugin.cc [for tool]; 1s local 2025-03-14T05:41:49.3924199Z Compiling src/compiler/php_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.3925335Z Compiling src/compiler/objective_c_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.3926397Z Compiling src/compiler/python_generator.cc [for tool]; 1s local ... 2025-03-14T05:41:49.5739808Z 2025-03-14T05:41:49.5740664Z  2025-03-14T05:41:49.5741112Z  2025-03-14T05:41:49.5741495Z  2025-03-14T05:41:49.5741928Z  2025-03-14T05:41:49.5742306Z  2025-03-14T05:41:49.5742693Z  2025-03-14T05:41:49.5743086Z  2025-03-14T05:41:49.5743481Z  2025-03-14T05:41:49.5744075Z [4,392 / 15,235] 45 actions, 41 running 2025-03-14T05:41:49.5744833Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:49.5745699Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 1s local 2025-03-14T05:41:49.5746653Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.5747452Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:49.5748187Z Compiling src/compiler/cpp_plugin.cc [for tool]; 1s local 2025-03-14T05:41:49.5749062Z Compiling src/compiler/php_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.5750073Z Compiling src/compiler/objective_c_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.5751131Z Compiling src/compiler/python_generator.cc [for tool]; 1s local ... 2025-03-14T05:41:49.7914677Z 2025-03-14T05:41:49.7915531Z  2025-03-14T05:41:49.7915997Z  2025-03-14T05:41:49.8021493Z  2025-03-14T05:41:49.8021891Z  2025-03-14T05:41:49.8022250Z  2025-03-14T05:41:49.8022622Z  2025-03-14T05:41:49.8022983Z  2025-03-14T05:41:49.8023353Z  2025-03-14T05:41:49.8023912Z [4,465 / 15,235] 47 actions, 41 running 2025-03-14T05:41:49.8024584Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:49.8025442Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 1s local 2025-03-14T05:41:49.8026450Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.8027215Z @com_google_protobuf//:protoc_lib; 1s local 2025-03-14T05:41:49.8027933Z Compiling src/compiler/cpp_plugin.cc [for tool]; 1s local 2025-03-14T05:41:49.8028821Z Compiling src/compiler/php_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.8029761Z Compiling src/compiler/objective_c_generator.cc [for tool]; 1s local 2025-03-14T05:41:49.8030824Z Compiling src/compiler/python_generator.cc [for tool]; 1s local ... 2025-03-14T05:41:49.9897627Z 2025-03-14T05:41:49.9898495Z  2025-03-14T05:41:49.9898996Z  2025-03-14T05:41:49.9899411Z  2025-03-14T05:41:49.9899815Z  2025-03-14T05:41:49.9900211Z  2025-03-14T05:41:49.9900599Z  2025-03-14T05:41:49.9900974Z  2025-03-14T05:41:49.9901365Z  2025-03-14T05:41:49.9901947Z [5,154 / 15,235] 45 actions, 41 running 2025-03-14T05:41:49.9902642Z @com_google_protobuf//:protoc_lib; 2s local 2025-03-14T05:41:49.9903515Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 2s local 2025-03-14T05:41:49.9904580Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T05:41:49.9905367Z @com_google_protobuf//:protoc_lib; 2s local 2025-03-14T05:41:49.9906137Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2025-03-14T05:41:49.9907347Z Compiling src/compiler/php_generator.cc [for tool]; 2s local 2025-03-14T05:41:49.9908483Z Compiling src/compiler/objective_c_generator.cc [for tool]; 2s local 2025-03-14T05:41:49.9909557Z Compiling src/compiler/python_generator.cc [for tool]; 2s local ... 2025-03-14T05:41:50.1910801Z 2025-03-14T05:41:50.1911647Z  2025-03-14T05:41:50.1912147Z  2025-03-14T05:41:50.1912560Z  2025-03-14T05:41:50.1912980Z  2025-03-14T05:41:50.1913379Z  2025-03-14T05:41:50.1913793Z  2025-03-14T05:41:50.1914199Z  2025-03-14T05:41:50.1914592Z  2025-03-14T05:41:50.1915656Z [5,354 / 15,235] 44 actions, 41 running 2025-03-14T05:41:50.1916528Z @com_google_protobuf//:protoc_lib; 2s local 2025-03-14T05:41:50.1917621Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 2s local 2025-03-14T05:41:50.1918867Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.1919841Z @com_google_protobuf//:protoc_lib; 2s local 2025-03-14T05:41:50.1920778Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2025-03-14T05:41:50.1921876Z Compiling src/compiler/php_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.1923002Z Compiling src/compiler/objective_c_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.1924189Z Compiling src/compiler/python_generator.cc [for tool]; 2s local ... 2025-03-14T05:41:50.3921535Z 2025-03-14T05:41:50.3922448Z  2025-03-14T05:41:50.3922979Z  2025-03-14T05:41:50.3923689Z  2025-03-14T05:41:50.3924125Z  2025-03-14T05:41:50.3924689Z  2025-03-14T05:41:50.3925133Z  2025-03-14T05:41:50.3925557Z  2025-03-14T05:41:50.3925995Z  2025-03-14T05:41:50.3926636Z [5,994 / 15,235] 46 actions, 40 running 2025-03-14T05:41:50.3927396Z @com_google_protobuf//:protoc_lib; 2s local 2025-03-14T05:41:50.3928403Z Compiling src/google/protobuf/compiler/java/enum.cc [for tool]; 2s local 2025-03-14T05:41:50.3929606Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.3930589Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2025-03-14T05:41:50.3932041Z Compiling src/compiler/php_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.3932982Z Compiling src/compiler/objective_c_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.3934023Z Compiling src/compiler/python_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.3935019Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 2s local ... 2025-03-14T05:41:50.5931236Z 2025-03-14T05:41:50.5932609Z  2025-03-14T05:41:50.5933122Z  2025-03-14T05:41:50.5933579Z  2025-03-14T05:41:50.5934030Z  2025-03-14T05:41:50.5934479Z  2025-03-14T05:41:50.5934915Z  2025-03-14T05:41:50.5935352Z  2025-03-14T05:41:50.5935788Z  2025-03-14T05:41:50.5936423Z [6,631 / 15,235] 43 actions, 40 running 2025-03-14T05:41:50.5937322Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.5938369Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2025-03-14T05:41:50.5939374Z Compiling src/compiler/php_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.5940448Z Compiling src/compiler/objective_c_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.5941496Z Compiling src/compiler/python_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.5942619Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 2s local 2025-03-14T05:41:50.5943598Z @com_google_protobuf//:protoc_lib; 2s local 2025-03-14T05:41:50.5944493Z Compiling src/compiler/node_generator.cc [for tool]; 2s local ... 2025-03-14T05:41:50.7943459Z 2025-03-14T05:41:50.7944297Z  2025-03-14T05:41:50.7944779Z  2025-03-14T05:41:50.7945197Z  2025-03-14T05:41:50.7945644Z  2025-03-14T05:41:50.7946078Z  2025-03-14T05:41:50.7946512Z  2025-03-14T05:41:50.7946945Z  2025-03-14T05:41:50.7947355Z  2025-03-14T05:41:50.7948280Z [7,366 / 15,235] 45 actions, 40 running 2025-03-14T05:41:50.7949136Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.7950122Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2025-03-14T05:41:50.7951032Z Compiling src/compiler/php_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.7952110Z Compiling src/compiler/objective_c_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.7953156Z Compiling src/compiler/python_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.7954288Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 2s local 2025-03-14T05:41:50.7955353Z Compiling src/compiler/node_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.7956528Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 2s local ... 2025-03-14T05:41:50.9948156Z 2025-03-14T05:41:50.9949044Z  2025-03-14T05:41:50.9949540Z  2025-03-14T05:41:50.9949935Z  2025-03-14T05:41:50.9950355Z  2025-03-14T05:41:50.9950834Z  2025-03-14T05:41:50.9951225Z  2025-03-14T05:41:50.9951625Z  2025-03-14T05:41:50.9952024Z  2025-03-14T05:41:50.9952626Z [7,946 / 15,235] 46 actions, 41 running 2025-03-14T05:41:50.9953485Z Compiling src/compiler/ruby_generator.cc [for tool]; 3s local 2025-03-14T05:41:50.9954441Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2025-03-14T05:41:50.9955456Z Compiling src/compiler/objective_c_generator.cc [for tool]; 3s local 2025-03-14T05:41:50.9956521Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T05:41:50.9957622Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T05:41:50.9958792Z Compiling src/compiler/node_generator.cc [for tool]; 2s local 2025-03-14T05:41:50.9959869Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 2s local 2025-03-14T05:41:50.9960933Z Compiling src/compiler/csharp_generator.cc [for tool]; 2s local ... 2025-03-14T05:41:51.1957068Z 2025-03-14T05:41:51.1957960Z  2025-03-14T05:41:51.1958543Z  2025-03-14T05:41:51.1959439Z  2025-03-14T05:41:51.1959809Z  2025-03-14T05:41:51.1960259Z  2025-03-14T05:41:51.1960721Z  2025-03-14T05:41:51.1961179Z  2025-03-14T05:41:51.1962127Z  2025-03-14T05:41:51.1962906Z [8,726 / 15,235] 46 actions, 42 running 2025-03-14T05:41:51.1963881Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2025-03-14T05:41:51.1965078Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.1966491Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T05:41:51.1967579Z Compiling src/compiler/node_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.1968629Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2025-03-14T05:41:51.1969631Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.1970749Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.1971830Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local ... 2025-03-14T05:41:51.4098726Z 2025-03-14T05:41:51.4099566Z  2025-03-14T05:41:51.4100107Z  2025-03-14T05:41:51.4100518Z  2025-03-14T05:41:51.4100888Z  2025-03-14T05:41:51.4101254Z  2025-03-14T05:41:51.4101649Z  2025-03-14T05:41:51.4102024Z  2025-03-14T05:41:51.4102413Z  2025-03-14T05:41:51.4102977Z [9,088 / 15,235] 47 actions, 46 running 2025-03-14T05:41:51.4103709Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2025-03-14T05:41:51.4104644Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.4105709Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T05:41:51.4106774Z Compiling src/compiler/node_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.4107891Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2025-03-14T05:41:51.4109410Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.4110457Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.4111410Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local ... 2025-03-14T05:41:51.6124380Z 2025-03-14T05:41:51.6125355Z  2025-03-14T05:41:51.6125858Z  2025-03-14T05:41:51.6126295Z  2025-03-14T05:41:51.6126730Z  2025-03-14T05:41:51.6127164Z  2025-03-14T05:41:51.6127595Z  2025-03-14T05:41:51.6127994Z  2025-03-14T05:41:51.6128368Z  2025-03-14T05:41:51.6128951Z [9,091 / 15,235] 47 actions, 46 running 2025-03-14T05:41:51.6129748Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2025-03-14T05:41:51.6130746Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.6131866Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T05:41:51.6133086Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2025-03-14T05:41:51.6134227Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.6135201Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.6136254Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local 2025-03-14T05:41:51.6137183Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 3s local ... 2025-03-14T05:41:51.8185541Z 2025-03-14T05:41:51.8186391Z  2025-03-14T05:41:51.8187043Z  2025-03-14T05:41:51.8187456Z  2025-03-14T05:41:51.8187870Z  2025-03-14T05:41:51.8188274Z  2025-03-14T05:41:51.8188680Z  2025-03-14T05:41:51.8189086Z  2025-03-14T05:41:51.8189509Z  2025-03-14T05:41:51.8190091Z [9,097 / 15,235] 47 actions running 2025-03-14T05:41:51.8190960Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.8192034Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T05:41:51.8193174Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 3s local 2025-03-14T05:41:51.8194681Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.8195673Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2025-03-14T05:41:51.8196548Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 3s local 2025-03-14T05:41:51.8197438Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 3s local 2025-03-14T05:41:51.8198406Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 3s local ... 2025-03-14T05:41:52.0198397Z 2025-03-14T05:41:52.0199421Z  2025-03-14T05:41:52.0199883Z  2025-03-14T05:41:52.0200272Z  2025-03-14T05:41:52.0200708Z  2025-03-14T05:41:52.0201122Z  2025-03-14T05:41:52.0201530Z  2025-03-14T05:41:52.0201943Z  2025-03-14T05:41:52.0202337Z  2025-03-14T05:41:52.0202906Z [9,106 / 15,235] 47 actions running 2025-03-14T05:41:52.0203798Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.0205026Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 4s local 2025-03-14T05:41:52.0206145Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2025-03-14T05:41:52.0207214Z Compiling src/compiler/csharp_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.0208097Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.0208997Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2025-03-14T05:41:52.0209904Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 3s local 2025-03-14T05:41:52.0210807Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 3s local ... 2025-03-14T05:41:52.2204373Z 2025-03-14T05:41:52.2205446Z  2025-03-14T05:41:52.2205930Z  2025-03-14T05:41:52.2206337Z  2025-03-14T05:41:52.2206718Z  2025-03-14T05:41:52.2207127Z  2025-03-14T05:41:52.2207549Z  2025-03-14T05:41:52.2208274Z  2025-03-14T05:41:52.2208728Z  2025-03-14T05:41:52.2209357Z [9,109 / 15,235] 47 actions running 2025-03-14T05:41:52.2210225Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.2211246Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 4s local 2025-03-14T05:41:52.2212366Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2025-03-14T05:41:52.2213456Z Compiling src/compiler/csharp_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.2214423Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.2215355Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2025-03-14T05:41:52.2216275Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 4s local 2025-03-14T05:41:52.2217243Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 4s local ... 2025-03-14T05:41:52.4212882Z 2025-03-14T05:41:52.4213828Z  2025-03-14T05:41:52.4214331Z  2025-03-14T05:41:52.4214782Z  2025-03-14T05:41:52.4215177Z  2025-03-14T05:41:52.4215577Z  2025-03-14T05:41:52.4215977Z  2025-03-14T05:41:52.4216387Z  2025-03-14T05:41:52.4216783Z  2025-03-14T05:41:52.4217385Z [9,111 / 15,235] 47 actions running 2025-03-14T05:41:52.4218280Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.4219372Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 4s local 2025-03-14T05:41:52.4220546Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2025-03-14T05:41:52.4221627Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.4222592Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2025-03-14T05:41:52.4223578Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 4s local 2025-03-14T05:41:52.4224510Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 4s local 2025-03-14T05:41:52.4225313Z Compiling google/fft.cc; 4s local ... 2025-03-14T05:41:52.6221501Z 2025-03-14T05:41:52.6222461Z  2025-03-14T05:41:52.6223339Z  2025-03-14T05:41:52.6223745Z  2025-03-14T05:41:52.6224162Z  2025-03-14T05:41:52.6224604Z  2025-03-14T05:41:52.6225000Z  2025-03-14T05:41:52.6225398Z  2025-03-14T05:41:52.6225760Z  2025-03-14T05:41:52.6226287Z [9,115 / 15,235] 47 actions running 2025-03-14T05:41:52.6227118Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.6228178Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2025-03-14T05:41:52.6229171Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.6230081Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2025-03-14T05:41:52.6230921Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 4s local 2025-03-14T05:41:52.6231802Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 4s local 2025-03-14T05:41:52.6232564Z Compiling google/fft.cc; 4s local 2025-03-14T05:41:52.6233399Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local ... 2025-03-14T05:41:52.8227631Z 2025-03-14T05:41:52.8228604Z  2025-03-14T05:41:52.8229093Z  2025-03-14T05:41:52.8229511Z  2025-03-14T05:41:52.8229926Z  2025-03-14T05:41:52.8230342Z  2025-03-14T05:41:52.8230761Z  2025-03-14T05:41:52.8231169Z  2025-03-14T05:41:52.8231559Z  2025-03-14T05:41:52.8232135Z [9,117 / 15,235] 48 actions, 47 running 2025-03-14T05:41:52.8232979Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.8234040Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local 2025-03-14T05:41:52.8235091Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T05:41:52.8236013Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 4s local 2025-03-14T05:41:52.8236885Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 4s local 2025-03-14T05:41:52.8238115Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 4s local 2025-03-14T05:41:52.8238977Z Compiling google/fft.cc; 4s local 2025-03-14T05:41:52.8239815Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local ... 2025-03-14T05:41:53.0471547Z 2025-03-14T05:41:53.0472533Z  2025-03-14T05:41:53.0473002Z  2025-03-14T05:41:53.0473394Z  2025-03-14T05:41:53.0473817Z  2025-03-14T05:41:53.0474229Z  2025-03-14T05:41:53.0474625Z  2025-03-14T05:41:53.0475024Z  2025-03-14T05:41:53.0475431Z  2025-03-14T05:41:53.0476028Z [9,120 / 15,235] 48 actions, 47 running 2025-03-14T05:41:53.0476911Z Compiling src/compiler/python_generator.cc [for tool]; 5s local 2025-03-14T05:41:53.0478022Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T05:41:53.0479035Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2025-03-14T05:41:53.0479972Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local 2025-03-14T05:41:53.0480872Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2025-03-14T05:41:53.0481678Z Compiling google/fft.cc; 5s local 2025-03-14T05:41:53.0482518Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2025-03-14T05:41:53.0483530Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 4s local ... 2025-03-14T05:41:53.3135682Z 2025-03-14T05:41:53.3136622Z  2025-03-14T05:41:53.3137121Z  2025-03-14T05:41:53.3137581Z  2025-03-14T05:41:53.3138009Z  2025-03-14T05:41:53.3138446Z  2025-03-14T05:41:53.3138836Z  2025-03-14T05:41:53.3139249Z  2025-03-14T05:41:53.3139667Z  2025-03-14T05:41:53.3140262Z [9,123 / 15,235] 48 actions, 47 running 2025-03-14T05:41:53.3141172Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T05:41:53.3142266Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2025-03-14T05:41:53.3143280Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local 2025-03-14T05:41:53.3144554Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2025-03-14T05:41:53.3145319Z Compiling google/fft.cc; 5s local 2025-03-14T05:41:53.3146138Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2025-03-14T05:41:53.3147217Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 5s local 2025-03-14T05:41:53.3148294Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 4s local ... 2025-03-14T05:41:53.5640609Z 2025-03-14T05:41:53.5641590Z  2025-03-14T05:41:53.5642064Z  2025-03-14T05:41:53.5642488Z  2025-03-14T05:41:53.5642878Z  2025-03-14T05:41:53.5643280Z  2025-03-14T05:41:53.5643693Z  2025-03-14T05:41:53.5644072Z  2025-03-14T05:41:53.5644640Z  2025-03-14T05:41:53.5645216Z [9,127 / 15,235] 48 actions, 47 running 2025-03-14T05:41:53.5646152Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T05:41:53.5647218Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2025-03-14T05:41:53.5648113Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local 2025-03-14T05:41:53.5648961Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2025-03-14T05:41:53.5677498Z Compiling google/fft.cc; 5s local 2025-03-14T05:41:53.5678399Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2025-03-14T05:41:53.5679390Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 5s local 2025-03-14T05:41:53.5680286Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 5s local ... 2025-03-14T05:41:53.7649857Z 2025-03-14T05:41:53.7650818Z  2025-03-14T05:41:53.7651296Z  2025-03-14T05:41:53.7651719Z  2025-03-14T05:41:53.7652151Z  2025-03-14T05:41:53.7652586Z  2025-03-14T05:41:53.7653019Z  2025-03-14T05:41:53.7653431Z  2025-03-14T05:41:53.7653843Z  2025-03-14T05:41:53.7654457Z [9,130 / 15,235] 48 actions, 47 running 2025-03-14T05:41:53.7655778Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T05:41:53.7656847Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 5s local 2025-03-14T05:41:53.7657667Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local 2025-03-14T05:41:53.7658574Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2025-03-14T05:41:53.7659357Z Compiling google/fft.cc; 5s local 2025-03-14T05:41:53.7660234Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2025-03-14T05:41:53.7661308Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 5s local 2025-03-14T05:41:53.7662279Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 5s local ... 2025-03-14T05:41:54.0244880Z 2025-03-14T05:41:54.0245868Z  2025-03-14T05:41:54.0246331Z  2025-03-14T05:41:54.0246692Z  2025-03-14T05:41:54.0247073Z  2025-03-14T05:41:54.0247434Z  2025-03-14T05:41:54.0247810Z  2025-03-14T05:41:54.0248177Z  2025-03-14T05:41:54.0248567Z  2025-03-14T05:41:54.0249080Z [9,134 / 15,235] 48 actions running 2025-03-14T05:41:54.0249920Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T05:41:54.0250864Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2025-03-14T05:41:54.0251639Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local 2025-03-14T05:41:54.0252410Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local 2025-03-14T05:41:54.0253076Z Compiling google/fft.cc; 5s local 2025-03-14T05:41:54.0253832Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2025-03-14T05:41:54.0254734Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 5s local 2025-03-14T05:41:54.0255530Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 5s local ... 2025-03-14T05:41:54.2247738Z 2025-03-14T05:41:54.2248674Z  2025-03-14T05:41:54.2249113Z  2025-03-14T05:41:54.2249471Z  2025-03-14T05:41:54.2249824Z  2025-03-14T05:41:54.2250218Z  2025-03-14T05:41:54.2250907Z  2025-03-14T05:41:54.2251264Z  2025-03-14T05:41:54.2251618Z  2025-03-14T05:41:54.2252115Z [9,137 / 15,235] 48 actions running 2025-03-14T05:41:54.2252926Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T05:41:54.2253839Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2025-03-14T05:41:54.2254820Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local 2025-03-14T05:41:54.2255624Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2025-03-14T05:41:54.2256267Z Compiling google/fft.cc; 6s local 2025-03-14T05:41:54.2257090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T05:41:54.2257947Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 6s local 2025-03-14T05:41:54.2258787Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 5s local ... 2025-03-14T05:41:54.4636163Z 2025-03-14T05:41:54.4637004Z  2025-03-14T05:41:54.4637509Z  2025-03-14T05:41:54.4637946Z  2025-03-14T05:41:54.4638359Z  2025-03-14T05:41:54.4638764Z  2025-03-14T05:41:54.4639177Z  2025-03-14T05:41:54.4639554Z  2025-03-14T05:41:54.4639905Z  2025-03-14T05:41:54.4640495Z [9,141 / 15,235] 48 actions, 47 running 2025-03-14T05:41:54.4641429Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T05:41:54.4642432Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2025-03-14T05:41:54.4643186Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local 2025-03-14T05:41:54.4644037Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2025-03-14T05:41:54.4644978Z Compiling google/fft.cc; 6s local 2025-03-14T05:41:54.4645821Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T05:41:54.4646881Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 6s local 2025-03-14T05:41:54.4648143Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local ... 2025-03-14T05:41:54.6649037Z 2025-03-14T05:41:54.6649906Z  2025-03-14T05:41:54.6650384Z  2025-03-14T05:41:54.6650768Z  2025-03-14T05:41:54.6651147Z  2025-03-14T05:41:54.6651538Z  2025-03-14T05:41:54.6651918Z  2025-03-14T05:41:54.6652313Z  2025-03-14T05:41:54.6652723Z  2025-03-14T05:41:54.6653264Z [9,144 / 15,235] 48 actions running 2025-03-14T05:41:54.6654131Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T05:41:54.6655132Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2025-03-14T05:41:54.6655948Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local 2025-03-14T05:41:54.6656795Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2025-03-14T05:41:54.6657545Z Compiling google/fft.cc; 6s local 2025-03-14T05:41:54.6658361Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T05:41:54.6659370Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 6s local 2025-03-14T05:41:54.6660284Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local ... 2025-03-14T05:41:54.8719581Z 2025-03-14T05:41:54.8720380Z  2025-03-14T05:41:54.8720880Z  2025-03-14T05:41:54.8721291Z  2025-03-14T05:41:54.8721679Z  2025-03-14T05:41:54.8722080Z  2025-03-14T05:41:54.8722479Z  2025-03-14T05:41:54.8722875Z  2025-03-14T05:41:54.8723293Z  2025-03-14T05:41:54.8723903Z [9,148 / 15,235] 48 actions, 47 running 2025-03-14T05:41:54.8724961Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T05:41:54.8725955Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 6s local 2025-03-14T05:41:54.8726809Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local 2025-03-14T05:41:54.8727662Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local 2025-03-14T05:41:54.8728418Z Compiling google/fft.cc; 6s local 2025-03-14T05:41:54.8729287Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T05:41:54.8730688Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 6s local 2025-03-14T05:41:54.8731589Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local ... 2025-03-14T05:41:55.0852852Z 2025-03-14T05:41:55.0853670Z  2025-03-14T05:41:55.0854157Z  2025-03-14T05:41:55.0854584Z  2025-03-14T05:41:55.0854995Z  2025-03-14T05:41:55.0855397Z  2025-03-14T05:41:55.0855789Z  2025-03-14T05:41:55.0856204Z  2025-03-14T05:41:55.0856608Z  2025-03-14T05:41:55.0857202Z [9,151 / 15,235] 48 actions, 47 running 2025-03-14T05:41:55.0857981Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T05:41:55.0859042Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2025-03-14T05:41:55.0859943Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T05:41:55.0860771Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2025-03-14T05:41:55.0861501Z Compiling google/fft.cc; 7s local 2025-03-14T05:41:55.0862284Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T05:41:55.0863209Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 6s local 2025-03-14T05:41:55.0864102Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local ... 2025-03-14T05:41:55.3217191Z 2025-03-14T05:41:55.3218037Z  2025-03-14T05:41:55.3218518Z  2025-03-14T05:41:55.3218928Z  2025-03-14T05:41:55.3219336Z  2025-03-14T05:41:55.3219721Z  2025-03-14T05:41:55.3220129Z  2025-03-14T05:41:55.3220505Z  2025-03-14T05:41:55.3220906Z  2025-03-14T05:41:55.3221491Z [9,154 / 15,235] 48 actions, 47 running 2025-03-14T05:41:55.3222399Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T05:41:55.3223389Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2025-03-14T05:41:55.3224629Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T05:41:55.3225526Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2025-03-14T05:41:55.3226276Z Compiling google/fft.cc; 7s local 2025-03-14T05:41:55.3227080Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T05:41:55.3227976Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 7s local 2025-03-14T05:41:55.3228875Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local ... 2025-03-14T05:41:55.5211269Z 2025-03-14T05:41:55.5212113Z  2025-03-14T05:41:55.5212582Z  2025-03-14T05:41:55.5213017Z  2025-03-14T05:41:55.5213430Z  2025-03-14T05:41:55.5213858Z  2025-03-14T05:41:55.5214282Z  2025-03-14T05:41:55.5214667Z  2025-03-14T05:41:55.5215026Z  2025-03-14T05:41:55.5215604Z [9,156 / 15,235] 48 actions, 47 running 2025-03-14T05:41:55.5216531Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T05:41:55.5217531Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2025-03-14T05:41:55.5218378Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T05:41:55.5219200Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2025-03-14T05:41:55.5219943Z Compiling google/fft.cc; 7s local 2025-03-14T05:41:55.5220751Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T05:41:55.5221681Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 7s local 2025-03-14T05:41:55.5222561Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local ... 2025-03-14T05:41:55.7533510Z 2025-03-14T05:41:55.7534342Z  2025-03-14T05:41:55.7534797Z  2025-03-14T05:41:55.7535175Z  2025-03-14T05:41:55.7535554Z  2025-03-14T05:41:55.7535918Z  2025-03-14T05:41:55.7536282Z  2025-03-14T05:41:55.7536640Z  2025-03-14T05:41:55.7536997Z  2025-03-14T05:41:55.7537578Z [9,160 / 15,235] 48 actions, 47 running 2025-03-14T05:41:55.7538485Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T05:41:55.7539846Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 7s local 2025-03-14T05:41:55.7540734Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T05:41:55.7541563Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2025-03-14T05:41:55.7542313Z Compiling google/fft.cc; 7s local 2025-03-14T05:41:55.7543079Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T05:41:55.7543981Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 7s local 2025-03-14T05:41:55.7544853Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local ... 2025-03-14T05:41:56.0263940Z 2025-03-14T05:41:56.0264708Z  2025-03-14T05:41:56.0265130Z  2025-03-14T05:41:56.0265707Z  2025-03-14T05:41:56.0266053Z  2025-03-14T05:41:56.0266389Z  2025-03-14T05:41:56.0266725Z  2025-03-14T05:41:56.0267097Z  2025-03-14T05:41:56.0267436Z  2025-03-14T05:41:56.0267921Z [9,163 / 15,235] 47 actions running 2025-03-14T05:41:56.0268696Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T05:41:56.0269550Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 8s local 2025-03-14T05:41:56.0270264Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T05:41:56.0270961Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local 2025-03-14T05:41:56.0271576Z Compiling google/fft.cc; 7s local 2025-03-14T05:41:56.0272256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T05:41:56.0273065Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 7s local 2025-03-14T05:41:56.0273787Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local ... 2025-03-14T05:41:56.2271593Z 2025-03-14T05:41:56.2272434Z  2025-03-14T05:41:56.2272945Z  2025-03-14T05:41:56.2273371Z  2025-03-14T05:41:56.2274144Z  2025-03-14T05:41:56.2274573Z  2025-03-14T05:41:56.2274952Z  2025-03-14T05:41:56.2275357Z  2025-03-14T05:41:56.2275779Z  2025-03-14T05:41:56.2276351Z [9,164 / 15,235] 48 actions running 2025-03-14T05:41:56.2277296Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T05:41:56.2278488Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 8s local 2025-03-14T05:41:56.2279419Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2025-03-14T05:41:56.2280263Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2025-03-14T05:41:56.2281021Z Compiling google/fft.cc; 8s local 2025-03-14T05:41:56.2281834Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T05:41:56.2282868Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 8s local 2025-03-14T05:41:56.2283764Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local ... 2025-03-14T05:41:56.4279215Z 2025-03-14T05:41:56.4280115Z  2025-03-14T05:41:56.4280632Z  2025-03-14T05:41:56.4281060Z  2025-03-14T05:41:56.4281486Z  2025-03-14T05:41:56.4281909Z  2025-03-14T05:41:56.4282323Z  2025-03-14T05:41:56.4282748Z  2025-03-14T05:41:56.4283179Z  2025-03-14T05:41:56.4283766Z [9,170 / 15,235] 48 actions running 2025-03-14T05:41:56.4284888Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T05:41:56.4286017Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 8s local 2025-03-14T05:41:56.4286934Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2025-03-14T05:41:56.4287885Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2025-03-14T05:41:56.4288705Z Compiling google/fft.cc; 8s local 2025-03-14T05:41:56.4289581Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T05:41:56.4290645Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 8s local 2025-03-14T05:41:56.4291629Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local ... 2025-03-14T05:41:56.8291611Z 2025-03-14T05:41:56.8292424Z  2025-03-14T05:41:56.8292915Z  2025-03-14T05:41:56.8293325Z  2025-03-14T05:41:56.8293686Z  2025-03-14T05:41:56.8294077Z  2025-03-14T05:41:56.8294478Z  2025-03-14T05:41:56.8294889Z  2025-03-14T05:41:56.8295276Z  2025-03-14T05:41:56.8295874Z [9,176 / 15,235] 48 actions, 47 running 2025-03-14T05:41:56.8296838Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T05:41:56.8297894Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 8s local 2025-03-14T05:41:56.8298781Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2025-03-14T05:41:56.8299691Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2025-03-14T05:41:56.8300571Z Compiling google/fft.cc; 8s local 2025-03-14T05:41:56.8301466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T05:41:56.8302523Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 8s local 2025-03-14T05:41:56.8303492Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local ... 2025-03-14T05:41:57.0288112Z 2025-03-14T05:41:57.0288915Z  2025-03-14T05:41:57.0289412Z  2025-03-14T05:41:57.0289851Z  2025-03-14T05:41:57.0290251Z  2025-03-14T05:41:57.0290642Z  2025-03-14T05:41:57.0291038Z  2025-03-14T05:41:57.0291431Z  2025-03-14T05:41:57.0291816Z  2025-03-14T05:41:57.0292383Z [9,181 / 15,235] 48 actions running 2025-03-14T05:41:57.0293281Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T05:41:57.0294271Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2025-03-14T05:41:57.0295141Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2025-03-14T05:41:57.0296020Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T05:41:57.0297130Z Compiling google/fft.cc; 8s local 2025-03-14T05:41:57.0298291Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T05:41:57.0299329Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 8s local 2025-03-14T05:41:57.0300168Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local ... 2025-03-14T05:41:57.4296341Z 2025-03-14T05:41:57.4297163Z  2025-03-14T05:41:57.4297580Z  2025-03-14T05:41:57.4297999Z  2025-03-14T05:41:57.4298392Z  2025-03-14T05:41:57.4298804Z  2025-03-14T05:41:57.4299180Z  2025-03-14T05:41:57.4299556Z  2025-03-14T05:41:57.4299933Z  2025-03-14T05:41:57.4300432Z [9,185 / 15,235] 48 actions running 2025-03-14T05:41:57.4301379Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T05:41:57.4302393Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2025-03-14T05:41:57.4303246Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2025-03-14T05:41:57.4304179Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T05:41:57.4304896Z Compiling google/fft.cc; 9s local 2025-03-14T05:41:57.4305734Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T05:41:57.4306729Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local 2025-03-14T05:41:57.4307635Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2025-03-14T05:41:57.6304253Z 2025-03-14T05:41:57.6305054Z  2025-03-14T05:41:57.6305538Z  2025-03-14T05:41:57.6305930Z  2025-03-14T05:41:57.6306350Z  2025-03-14T05:41:57.6306735Z  2025-03-14T05:41:57.6307102Z  2025-03-14T05:41:57.6307483Z  2025-03-14T05:41:57.6307886Z  2025-03-14T05:41:57.6308443Z [9,187 / 15,235] 48 actions running 2025-03-14T05:41:57.6309328Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T05:41:57.6310372Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2025-03-14T05:41:57.6311198Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2025-03-14T05:41:57.6312436Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T05:41:57.6313201Z Compiling google/fft.cc; 9s local 2025-03-14T05:41:57.6314016Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T05:41:57.6314979Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local 2025-03-14T05:41:57.6315882Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2025-03-14T05:41:57.8317035Z 2025-03-14T05:41:57.8317785Z  2025-03-14T05:41:57.8318253Z  2025-03-14T05:41:57.8318647Z  2025-03-14T05:41:57.8319050Z  2025-03-14T05:41:57.8319460Z  2025-03-14T05:41:57.8319865Z  2025-03-14T05:41:57.8320257Z  2025-03-14T05:41:57.8320632Z  2025-03-14T05:41:57.8321173Z [9,191 / 15,235] 48 actions running 2025-03-14T05:41:57.8322162Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T05:41:57.8323246Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 9s local 2025-03-14T05:41:57.8324080Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2025-03-14T05:41:57.8325103Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T05:41:57.8325886Z Compiling google/fft.cc; 9s local 2025-03-14T05:41:57.8326724Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T05:41:57.8327627Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local 2025-03-14T05:41:57.8328524Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2025-03-14T05:41:58.0323790Z 2025-03-14T05:41:58.0324743Z  2025-03-14T05:41:58.0325229Z  2025-03-14T05:41:58.0325636Z  2025-03-14T05:41:58.0326051Z  2025-03-14T05:41:58.0326472Z  2025-03-14T05:41:58.0326890Z  2025-03-14T05:41:58.0327323Z  2025-03-14T05:41:58.0327722Z  2025-03-14T05:41:58.0328672Z [9,195 / 15,235] 48 actions, 47 running 2025-03-14T05:41:58.0329614Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T05:41:58.0330679Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2025-03-14T05:41:58.0331591Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T05:41:58.0332474Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2025-03-14T05:41:58.0333242Z Compiling google/fft.cc; 9s local 2025-03-14T05:41:58.0334098Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T05:41:58.0335152Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local 2025-03-14T05:41:58.0336109Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2025-03-14T05:41:58.2330619Z 2025-03-14T05:41:58.2331478Z  2025-03-14T05:41:58.2331972Z  2025-03-14T05:41:58.2332361Z  2025-03-14T05:41:58.2332765Z  2025-03-14T05:41:58.2333152Z  2025-03-14T05:41:58.2333571Z  2025-03-14T05:41:58.2333950Z  2025-03-14T05:41:58.2334321Z  2025-03-14T05:41:58.2334866Z [9,198 / 15,235] 48 actions running 2025-03-14T05:41:58.2335781Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T05:41:58.2336761Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2025-03-14T05:41:58.2337730Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T05:41:58.2338578Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2025-03-14T05:41:58.2339293Z Compiling google/fft.cc; 10s local 2025-03-14T05:41:58.2340086Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T05:41:58.2341097Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local 2025-03-14T05:41:58.2342016Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local ... 2025-03-14T05:41:58.4836336Z 2025-03-14T05:41:58.4837188Z  2025-03-14T05:41:58.4837731Z  2025-03-14T05:41:58.4838189Z  2025-03-14T05:41:58.4838576Z  2025-03-14T05:41:58.4839335Z  2025-03-14T05:41:58.4839739Z  2025-03-14T05:41:58.4840147Z  2025-03-14T05:41:58.4840537Z  2025-03-14T05:41:58.4841134Z [9,199 / 15,235] 48 actions, 47 running 2025-03-14T05:41:58.4842116Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T05:41:58.4843180Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2025-03-14T05:41:58.4844076Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T05:41:58.4845106Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2025-03-14T05:41:58.4845758Z Compiling google/fft.cc; 10s local 2025-03-14T05:41:58.4846553Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T05:41:58.4847471Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local 2025-03-14T05:41:58.4848346Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local ... 2025-03-14T05:41:58.7153902Z 2025-03-14T05:41:58.7154748Z  2025-03-14T05:41:58.7155196Z  2025-03-14T05:41:58.7155566Z  2025-03-14T05:41:58.7155940Z  2025-03-14T05:41:58.7156314Z  2025-03-14T05:41:58.7156691Z  2025-03-14T05:41:58.7157069Z  2025-03-14T05:41:58.7157435Z  2025-03-14T05:41:58.7157970Z [9,202 / 15,235] 48 actions, 47 running 2025-03-14T05:41:58.7158905Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T05:41:58.7160029Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2025-03-14T05:41:58.7160989Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T05:41:58.7161951Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2025-03-14T05:41:58.7162605Z Compiling google/fft.cc; 10s local 2025-03-14T05:41:58.7163444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T05:41:58.7164955Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local 2025-03-14T05:41:58.7166202Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local ... 2025-03-14T05:41:58.9591493Z 2025-03-14T05:41:58.9592290Z  2025-03-14T05:41:58.9592735Z  2025-03-14T05:41:58.9593108Z  2025-03-14T05:41:58.9593475Z  2025-03-14T05:41:58.9593836Z  2025-03-14T05:41:58.9594187Z  2025-03-14T05:41:58.9594558Z  2025-03-14T05:41:58.9594930Z  2025-03-14T05:41:58.9595495Z [9,205 / 15,235] 48 actions, 47 running 2025-03-14T05:41:58.9596434Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T05:41:58.9597419Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 10s local 2025-03-14T05:41:58.9598254Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T05:41:58.9599109Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2025-03-14T05:41:58.9599834Z Compiling google/fft.cc; 10s local 2025-03-14T05:41:58.9600693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T05:41:58.9601638Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local 2025-03-14T05:41:58.9602501Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local ... 2025-03-14T05:41:59.2340574Z 2025-03-14T05:41:59.2341344Z  2025-03-14T05:41:59.2341837Z  2025-03-14T05:41:59.2342257Z  2025-03-14T05:41:59.2342658Z  2025-03-14T05:41:59.2343058Z  2025-03-14T05:41:59.2343452Z  2025-03-14T05:41:59.2343810Z  2025-03-14T05:41:59.2344208Z  2025-03-14T05:41:59.2344736Z [9,207 / 15,235] 48 actions running 2025-03-14T05:41:59.2345629Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T05:41:59.2346663Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 11s local 2025-03-14T05:41:59.2347564Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T05:41:59.2348504Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2025-03-14T05:41:59.2349294Z Compiling google/fft.cc; 11s local 2025-03-14T05:41:59.2350466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T05:41:59.2351474Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2025-03-14T05:41:59.2352386Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local ... 2025-03-14T05:41:59.4560471Z 2025-03-14T05:41:59.4561332Z  2025-03-14T05:41:59.4561805Z  2025-03-14T05:41:59.4562222Z  2025-03-14T05:41:59.4562643Z  2025-03-14T05:41:59.4563053Z  2025-03-14T05:41:59.4563475Z  2025-03-14T05:41:59.4563881Z  2025-03-14T05:41:59.4564278Z  2025-03-14T05:41:59.4565047Z [9,212 / 15,235] 48 actions, 47 running 2025-03-14T05:41:59.4566216Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T05:41:59.4567304Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 11s local 2025-03-14T05:41:59.4568274Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T05:41:59.4569178Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2025-03-14T05:41:59.4569910Z Compiling google/fft.cc; 11s local 2025-03-14T05:41:59.4570763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T05:41:59.4571790Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2025-03-14T05:41:59.4572735Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2025-03-14T05:41:59.6602023Z 2025-03-14T05:41:59.6602843Z  2025-03-14T05:41:59.6603322Z  2025-03-14T05:41:59.6603693Z  2025-03-14T05:41:59.6604081Z  2025-03-14T05:41:59.6604588Z  2025-03-14T05:41:59.6604987Z  2025-03-14T05:41:59.6605353Z  2025-03-14T05:41:59.6605720Z  2025-03-14T05:41:59.6606303Z [9,214 / 15,235] 48 actions, 47 running 2025-03-14T05:41:59.6607513Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T05:41:59.6608638Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 11s local 2025-03-14T05:41:59.6609502Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T05:41:59.6610391Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2025-03-14T05:41:59.6611139Z Compiling google/fft.cc; 11s local 2025-03-14T05:41:59.6612148Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T05:41:59.6613137Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2025-03-14T05:41:59.6614054Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2025-03-14T05:41:59.9172266Z 2025-03-14T05:41:59.9173051Z  2025-03-14T05:41:59.9173574Z  2025-03-14T05:41:59.9173987Z  2025-03-14T05:41:59.9174413Z  2025-03-14T05:41:59.9174826Z  2025-03-14T05:41:59.9175238Z  2025-03-14T05:41:59.9175631Z  2025-03-14T05:41:59.9176029Z  2025-03-14T05:41:59.9176691Z [9,216 / 15,235] 48 actions, 47 running 2025-03-14T05:41:59.9177652Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T05:41:59.9178659Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 11s local 2025-03-14T05:41:59.9179515Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T05:41:59.9180368Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2025-03-14T05:41:59.9181070Z Compiling google/fft.cc; 11s local 2025-03-14T05:41:59.9181871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T05:41:59.9182774Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2025-03-14T05:41:59.9183622Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2025-03-14T05:42:00.2350387Z 2025-03-14T05:42:00.2351202Z  2025-03-14T05:42:00.2351686Z  2025-03-14T05:42:00.2352105Z  2025-03-14T05:42:00.2352525Z  2025-03-14T05:42:00.2352930Z  2025-03-14T05:42:00.2353347Z  2025-03-14T05:42:00.2353807Z  2025-03-14T05:42:00.2354572Z  2025-03-14T05:42:00.2355156Z [9,218 / 15,235] 48 actions running 2025-03-14T05:42:00.2356144Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T05:42:00.2357247Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2025-03-14T05:42:00.2358163Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2025-03-14T05:42:00.2358992Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2025-03-14T05:42:00.2359745Z Compiling google/fft.cc; 12s local 2025-03-14T05:42:00.2360497Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T05:42:00.2361461Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2025-03-14T05:42:00.2362306Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local ... 2025-03-14T05:42:00.4363472Z 2025-03-14T05:42:00.4364315Z  2025-03-14T05:42:00.4364954Z  2025-03-14T05:42:00.4365593Z  2025-03-14T05:42:00.4365994Z  2025-03-14T05:42:00.4366401Z  2025-03-14T05:42:00.4366796Z  2025-03-14T05:42:00.4367203Z  2025-03-14T05:42:00.4367596Z  2025-03-14T05:42:00.4368160Z [9,220 / 15,235] 48 actions running 2025-03-14T05:42:00.4369124Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T05:42:00.4370186Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2025-03-14T05:42:00.4371090Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2025-03-14T05:42:00.4371996Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2025-03-14T05:42:00.4372722Z Compiling google/fft.cc; 12s local 2025-03-14T05:42:00.4373594Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T05:42:00.4374586Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2025-03-14T05:42:00.4375461Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2025-03-14T05:42:00.7724987Z 2025-03-14T05:42:00.7725801Z  2025-03-14T05:42:00.7726313Z  2025-03-14T05:42:00.7726727Z  2025-03-14T05:42:00.7727135Z  2025-03-14T05:42:00.7727539Z  2025-03-14T05:42:00.7727951Z  2025-03-14T05:42:00.7728359Z  2025-03-14T05:42:00.7728769Z  2025-03-14T05:42:00.7729366Z [9,224 / 15,235] 48 actions, 47 running 2025-03-14T05:42:00.7730343Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T05:42:00.7731412Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 12s local 2025-03-14T05:42:00.7732333Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2025-03-14T05:42:00.7733242Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2025-03-14T05:42:00.7734026Z Compiling google/fft.cc; 12s local 2025-03-14T05:42:00.7734887Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T05:42:00.7735962Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2025-03-14T05:42:00.7737067Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2025-03-14T05:42:01.0368300Z 2025-03-14T05:42:01.0369127Z  2025-03-14T05:42:01.0369624Z  2025-03-14T05:42:01.0370034Z  2025-03-14T05:42:01.0370587Z  2025-03-14T05:42:01.0371008Z  2025-03-14T05:42:01.0371415Z  2025-03-14T05:42:01.0371837Z  2025-03-14T05:42:01.0372212Z  2025-03-14T05:42:01.0372738Z [9,224 / 15,235] 48 actions running 2025-03-14T05:42:01.0373700Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T05:42:01.0374778Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2025-03-14T05:42:01.0375684Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T05:42:01.0376623Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T05:42:01.0377405Z Compiling google/fft.cc; 12s local 2025-03-14T05:42:01.0378284Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T05:42:01.0379633Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2025-03-14T05:42:01.0380587Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2025-03-14T05:42:01.2372944Z 2025-03-14T05:42:01.2373829Z  2025-03-14T05:42:01.2374345Z  2025-03-14T05:42:01.2374771Z  2025-03-14T05:42:01.2375180Z  2025-03-14T05:42:01.2375590Z  2025-03-14T05:42:01.2375998Z  2025-03-14T05:42:01.2376373Z  2025-03-14T05:42:01.2376755Z  2025-03-14T05:42:01.2377311Z [9,226 / 15,235] 48 actions running 2025-03-14T05:42:01.2378221Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T05:42:01.2379378Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2025-03-14T05:42:01.2380334Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T05:42:01.2381276Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T05:42:01.2382029Z Compiling google/fft.cc; 13s local 2025-03-14T05:42:01.2382930Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T05:42:01.2383999Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2025-03-14T05:42:01.2384941Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local ... 2025-03-14T05:42:01.4841528Z 2025-03-14T05:42:01.4842581Z  2025-03-14T05:42:01.4843060Z  2025-03-14T05:42:01.4843461Z  2025-03-14T05:42:01.4843859Z  2025-03-14T05:42:01.4844249Z  2025-03-14T05:42:01.4844840Z  2025-03-14T05:42:01.4845234Z  2025-03-14T05:42:01.4845622Z  2025-03-14T05:42:01.4846216Z [9,227 / 15,235] 48 actions, 47 running 2025-03-14T05:42:01.4847159Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T05:42:01.4848196Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2025-03-14T05:42:01.4849493Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T05:42:01.4850430Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T05:42:01.4851188Z Compiling google/fft.cc; 13s local 2025-03-14T05:42:01.4852008Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T05:42:01.4852994Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2025-03-14T05:42:01.4853905Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2025-03-14T05:42:01.7004680Z 2025-03-14T05:42:01.7005565Z  2025-03-14T05:42:01.7006029Z  2025-03-14T05:42:01.7006439Z  2025-03-14T05:42:01.7006826Z  2025-03-14T05:42:01.7007229Z  2025-03-14T05:42:01.7007626Z  2025-03-14T05:42:01.7008024Z  2025-03-14T05:42:01.7008443Z  2025-03-14T05:42:01.7009047Z [9,230 / 15,235] 48 actions, 47 running 2025-03-14T05:42:01.7010011Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T05:42:01.7011182Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2025-03-14T05:42:01.7012100Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T05:42:01.7012965Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T05:42:01.7013784Z Compiling google/fft.cc; 13s local 2025-03-14T05:42:01.7014680Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T05:42:01.7015694Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2025-03-14T05:42:01.7016631Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2025-03-14T05:42:02.0164931Z 2025-03-14T05:42:02.0165974Z  2025-03-14T05:42:02.0166501Z  2025-03-14T05:42:02.0166932Z  2025-03-14T05:42:02.0167365Z  2025-03-14T05:42:02.0167773Z  2025-03-14T05:42:02.0168186Z  2025-03-14T05:42:02.0168611Z  2025-03-14T05:42:02.0169020Z  2025-03-14T05:42:02.0169676Z [9,233 / 15,235] 48 actions, 47 running 2025-03-14T05:42:02.0170645Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T05:42:02.0172165Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 13s local 2025-03-14T05:42:02.0173110Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T05:42:02.0174045Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T05:42:02.0174860Z Compiling google/fft.cc; 13s local 2025-03-14T05:42:02.0175716Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T05:42:02.0176769Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2025-03-14T05:42:02.0177734Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2025-03-14T05:42:02.2384783Z 2025-03-14T05:42:02.2385613Z  2025-03-14T05:42:02.2386104Z  2025-03-14T05:42:02.2386526Z  2025-03-14T05:42:02.2386920Z  2025-03-14T05:42:02.2387345Z  2025-03-14T05:42:02.2387763Z  2025-03-14T05:42:02.2388200Z  2025-03-14T05:42:02.2388628Z  2025-03-14T05:42:02.2389230Z [9,233 / 15,235] 48 actions running 2025-03-14T05:42:02.2390166Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T05:42:02.2391202Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2025-03-14T05:42:02.2392089Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2025-03-14T05:42:02.2392960Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T05:42:02.2393691Z Compiling google/fft.cc; 14s local 2025-03-14T05:42:02.2394529Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T05:42:02.2395570Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2025-03-14T05:42:02.2396497Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2025-03-14T05:42:02.4390474Z 2025-03-14T05:42:02.4391335Z  2025-03-14T05:42:02.4391817Z  2025-03-14T05:42:02.4392204Z  2025-03-14T05:42:02.4392963Z  2025-03-14T05:42:02.4393410Z  2025-03-14T05:42:02.4393847Z  2025-03-14T05:42:02.4394219Z  2025-03-14T05:42:02.4394622Z  2025-03-14T05:42:02.4395166Z [9,235 / 15,235] 48 actions running 2025-03-14T05:42:02.4396118Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T05:42:02.4397152Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2025-03-14T05:42:02.4398013Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2025-03-14T05:42:02.4398902Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T05:42:02.4399643Z Compiling google/fft.cc; 14s local 2025-03-14T05:42:02.4400596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T05:42:02.4401586Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2025-03-14T05:42:02.4402514Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2025-03-14T05:42:02.6397460Z 2025-03-14T05:42:02.6398299Z  2025-03-14T05:42:02.6398793Z  2025-03-14T05:42:02.6399180Z  2025-03-14T05:42:02.6399545Z  2025-03-14T05:42:02.6399947Z  2025-03-14T05:42:02.6400351Z  2025-03-14T05:42:02.6400759Z  2025-03-14T05:42:02.6401133Z  2025-03-14T05:42:02.6401686Z [9,236 / 15,235] 48 actions running 2025-03-14T05:42:02.6402634Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T05:42:02.6403676Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2025-03-14T05:42:02.6404739Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2025-03-14T05:42:02.6405617Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T05:42:02.6406350Z Compiling google/fft.cc; 14s local 2025-03-14T05:42:02.6407182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T05:42:02.6408177Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2025-03-14T05:42:02.6409135Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2025-03-14T05:42:02.8542825Z 2025-03-14T05:42:02.8543677Z  2025-03-14T05:42:02.8544161Z  2025-03-14T05:42:02.8544575Z  2025-03-14T05:42:02.8544974Z  2025-03-14T05:42:02.8545369Z  2025-03-14T05:42:02.8545724Z  2025-03-14T05:42:02.8546090Z  2025-03-14T05:42:02.8546469Z  2025-03-14T05:42:02.8547066Z [9,240 / 15,235] 48 actions, 47 running 2025-03-14T05:42:02.8547960Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T05:42:02.8548987Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 14s local 2025-03-14T05:42:02.8549896Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2025-03-14T05:42:02.8550787Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T05:42:02.8551627Z Compiling google/fft.cc; 14s local 2025-03-14T05:42:02.8552611Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T05:42:02.8553607Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2025-03-14T05:42:02.8554585Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2025-03-14T05:42:03.2403520Z 2025-03-14T05:42:03.2404343Z  2025-03-14T05:42:03.2404979Z  2025-03-14T05:42:03.2405385Z  2025-03-14T05:42:03.2405774Z  2025-03-14T05:42:03.2406149Z  2025-03-14T05:42:03.2406552Z  2025-03-14T05:42:03.2406963Z  2025-03-14T05:42:03.2407380Z  2025-03-14T05:42:03.2407948Z [9,244 / 15,235] 48 actions running 2025-03-14T05:42:03.2408919Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T05:42:03.2409939Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2025-03-14T05:42:03.2410816Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T05:42:03.2411715Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2025-03-14T05:42:03.2412834Z Compiling google/fft.cc; 15s local 2025-03-14T05:42:03.2413770Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T05:42:03.2414799Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2025-03-14T05:42:03.2415754Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2025-03-14T05:42:03.4411115Z 2025-03-14T05:42:03.4411993Z  2025-03-14T05:42:03.4412492Z  2025-03-14T05:42:03.4414998Z  2025-03-14T05:42:03.4415841Z  2025-03-14T05:42:03.4416864Z  2025-03-14T05:42:03.4417347Z  2025-03-14T05:42:03.4417778Z  2025-03-14T05:42:03.4418206Z  2025-03-14T05:42:03.4418802Z [9,246 / 15,235] 48 actions running 2025-03-14T05:42:03.4419782Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T05:42:03.4420868Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2025-03-14T05:42:03.4421852Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T05:42:03.4422816Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2025-03-14T05:42:03.4423641Z Compiling google/fft.cc; 15s local 2025-03-14T05:42:03.4424526Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T05:42:03.4425556Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2025-03-14T05:42:03.4426541Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T05:42:03.6417396Z 2025-03-14T05:42:03.6418212Z  2025-03-14T05:42:03.6418678Z  2025-03-14T05:42:03.6419097Z  2025-03-14T05:42:03.6419518Z  2025-03-14T05:42:03.6419934Z  2025-03-14T05:42:03.6420359Z  2025-03-14T05:42:03.6420778Z  2025-03-14T05:42:03.6421199Z  2025-03-14T05:42:03.6421744Z [9,248 / 15,235] 48 actions running 2025-03-14T05:42:03.6422701Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T05:42:03.6423742Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2025-03-14T05:42:03.6425033Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T05:42:03.6425963Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2025-03-14T05:42:03.6426763Z Compiling google/fft.cc; 15s local 2025-03-14T05:42:03.6427596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T05:42:03.6428657Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2025-03-14T05:42:03.6429634Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T05:42:03.8518684Z 2025-03-14T05:42:03.8519495Z  2025-03-14T05:42:03.8519954Z  2025-03-14T05:42:03.8520367Z  2025-03-14T05:42:03.8520785Z  2025-03-14T05:42:03.8521177Z  2025-03-14T05:42:03.8521566Z  2025-03-14T05:42:03.8521965Z  2025-03-14T05:42:03.8522363Z  2025-03-14T05:42:03.8522976Z [9,252 / 15,235] 48 actions, 47 running 2025-03-14T05:42:03.8523978Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T05:42:03.8525120Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 15s local 2025-03-14T05:42:03.8525928Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T05:42:03.8526752Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2025-03-14T05:42:03.8527417Z Compiling google/fft.cc; 15s local 2025-03-14T05:42:03.8528269Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T05:42:03.8529312Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2025-03-14T05:42:03.8530229Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T05:42:04.0522352Z 2025-03-14T05:42:04.0523163Z  2025-03-14T05:42:04.0523584Z  2025-03-14T05:42:04.0523930Z  2025-03-14T05:42:04.0524268Z  2025-03-14T05:42:04.0524741Z  2025-03-14T05:42:04.0543825Z  2025-03-14T05:42:04.0544315Z  2025-03-14T05:42:04.0545176Z  2025-03-14T05:42:04.0545786Z [9,253 / 15,235] 48 actions, 47 running 2025-03-14T05:42:04.0546614Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T05:42:04.0547619Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2025-03-14T05:42:04.0548532Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T05:42:04.0549367Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2025-03-14T05:42:04.0550105Z Compiling google/fft.cc; 16s local 2025-03-14T05:42:04.0551056Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T05:42:04.0552165Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2025-03-14T05:42:04.0553072Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T05:42:04.3042421Z 2025-03-14T05:42:04.3043241Z  2025-03-14T05:42:04.3043750Z  2025-03-14T05:42:04.3044168Z  2025-03-14T05:42:04.3044677Z  2025-03-14T05:42:04.3045132Z  2025-03-14T05:42:04.3045527Z  2025-03-14T05:42:04.3045955Z  2025-03-14T05:42:04.3046327Z  2025-03-14T05:42:04.3046906Z [9,255 / 15,235] 48 actions, 46 running 2025-03-14T05:42:04.3047872Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T05:42:04.3048887Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2025-03-14T05:42:04.3049791Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T05:42:04.3050668Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2025-03-14T05:42:04.3051437Z Compiling google/fft.cc; 16s local 2025-03-14T05:42:04.3052272Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T05:42:04.3053258Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2025-03-14T05:42:04.3054149Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T05:42:04.6427852Z 2025-03-14T05:42:04.6428753Z  2025-03-14T05:42:04.6429251Z  2025-03-14T05:42:04.6430016Z  2025-03-14T05:42:04.6430435Z  2025-03-14T05:42:04.6430867Z  2025-03-14T05:42:04.6431277Z  2025-03-14T05:42:04.6431624Z  2025-03-14T05:42:04.6431964Z  2025-03-14T05:42:04.6432493Z [9,257 / 15,235] 48 actions running 2025-03-14T05:42:04.6433447Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T05:42:04.6434564Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2025-03-14T05:42:04.6435541Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T05:42:04.6436518Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2025-03-14T05:42:04.6437336Z Compiling google/fft.cc; 16s local 2025-03-14T05:42:04.6438253Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T05:42:04.6439353Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2025-03-14T05:42:04.6440360Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2025-03-14T05:42:04.9553374Z 2025-03-14T05:42:04.9554186Z  2025-03-14T05:42:04.9554724Z  2025-03-14T05:42:04.9555187Z  2025-03-14T05:42:04.9555629Z  2025-03-14T05:42:04.9556044Z  2025-03-14T05:42:04.9556468Z  2025-03-14T05:42:04.9556904Z  2025-03-14T05:42:04.9557355Z  2025-03-14T05:42:04.9558001Z [9,262 / 15,235] 48 actions, 47 running 2025-03-14T05:42:04.9558982Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T05:42:04.9560080Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 16s local 2025-03-14T05:42:04.9561026Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T05:42:04.9561948Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2025-03-14T05:42:04.9562772Z Compiling google/fft.cc; 16s local 2025-03-14T05:42:04.9564069Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T05:42:04.9565267Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2025-03-14T05:42:04.9566445Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2025-03-14T05:42:05.2285801Z 2025-03-14T05:42:05.2286642Z  2025-03-14T05:42:05.2287132Z  2025-03-14T05:42:05.2287545Z  2025-03-14T05:42:05.2287952Z  2025-03-14T05:42:05.2288368Z  2025-03-14T05:42:05.2288775Z  2025-03-14T05:42:05.2289143Z  2025-03-14T05:42:05.2289532Z  2025-03-14T05:42:05.2290135Z [9,265 / 15,235] 48 actions, 47 running 2025-03-14T05:42:05.2291085Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T05:42:05.2292054Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2025-03-14T05:42:05.2292868Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T05:42:05.2293724Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2025-03-14T05:42:05.2294509Z Compiling google/fft.cc; 17s local 2025-03-14T05:42:05.2295318Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T05:42:05.2296334Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T05:42:05.2297240Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2025-03-14T05:42:05.4437916Z 2025-03-14T05:42:05.4438765Z  2025-03-14T05:42:05.4439287Z  2025-03-14T05:42:05.4439706Z  2025-03-14T05:42:05.4440526Z  2025-03-14T05:42:05.4440943Z  2025-03-14T05:42:05.4441538Z  2025-03-14T05:42:05.4442106Z  2025-03-14T05:42:05.4442654Z  2025-03-14T05:42:05.4443365Z [9,269 / 15,235] 48 actions running 2025-03-14T05:42:05.4444639Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T05:42:05.4445910Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2025-03-14T05:42:05.4447013Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T05:42:05.4448146Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2025-03-14T05:42:05.4449627Z Compiling google/fft.cc; 17s local 2025-03-14T05:42:05.4450637Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T05:42:05.4451810Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T05:42:05.4452873Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T05:42:05.7394778Z 2025-03-14T05:42:05.7395651Z  2025-03-14T05:42:05.7396140Z  2025-03-14T05:42:05.7396561Z  2025-03-14T05:42:05.7396938Z  2025-03-14T05:42:05.7397333Z  2025-03-14T05:42:05.7397730Z  2025-03-14T05:42:05.7398139Z  2025-03-14T05:42:05.7398528Z  2025-03-14T05:42:05.7399138Z [9,270 / 15,235] 48 actions, 47 running 2025-03-14T05:42:05.7400565Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T05:42:05.7401690Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 17s local 2025-03-14T05:42:05.7402617Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T05:42:05.7403788Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2025-03-14T05:42:05.7404871Z Compiling google/fft.cc; 17s local 2025-03-14T05:42:05.7405851Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T05:42:05.7407039Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T05:42:05.7408062Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T05:42:06.0446580Z 2025-03-14T05:42:06.0447451Z  2025-03-14T05:42:06.0447976Z  2025-03-14T05:42:06.0448805Z  2025-03-14T05:42:06.0449361Z  2025-03-14T05:42:06.0449906Z  2025-03-14T05:42:06.0450455Z  2025-03-14T05:42:06.0450967Z  2025-03-14T05:42:06.0451478Z  2025-03-14T05:42:06.0452166Z [9,272 / 15,235] 48 actions running 2025-03-14T05:42:06.0453617Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T05:42:06.0454850Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2025-03-14T05:42:06.0455888Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T05:42:06.0456939Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T05:42:06.0457954Z Compiling google/fft.cc; 18s local 2025-03-14T05:42:06.0458987Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T05:42:06.0460174Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T05:42:06.0461298Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T05:42:06.2746142Z 2025-03-14T05:42:06.2747086Z  2025-03-14T05:42:06.2747587Z  2025-03-14T05:42:06.2748136Z  2025-03-14T05:42:06.2750324Z  2025-03-14T05:42:06.2753464Z  2025-03-14T05:42:06.2756478Z  2025-03-14T05:42:06.2759422Z  2025-03-14T05:42:06.2762395Z  2025-03-14T05:42:06.2765904Z [9,274 / 15,235] 48 actions, 47 running 2025-03-14T05:42:06.2769435Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T05:42:06.2772990Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2025-03-14T05:42:06.2774692Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T05:42:06.2775845Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T05:42:06.2776852Z Compiling google/fft.cc; 18s local 2025-03-14T05:42:06.2777837Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T05:42:06.2779070Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T05:42:06.2780128Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T05:42:06.5170126Z 2025-03-14T05:42:06.5170933Z  2025-03-14T05:42:06.5171392Z  2025-03-14T05:42:06.5171780Z  2025-03-14T05:42:06.5172163Z  2025-03-14T05:42:06.5172570Z  2025-03-14T05:42:06.5172961Z  2025-03-14T05:42:06.5173649Z  2025-03-14T05:42:06.5174015Z  2025-03-14T05:42:06.5174567Z [9,278 / 15,235] 48 actions, 47 running 2025-03-14T05:42:06.5175472Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T05:42:06.5176427Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2025-03-14T05:42:06.5177166Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T05:42:06.5178005Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T05:42:06.5178751Z Compiling google/fft.cc; 18s local 2025-03-14T05:42:06.5179541Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T05:42:06.5180483Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T05:42:06.5181484Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local ... 2025-03-14T05:42:06.8446465Z 2025-03-14T05:42:06.8447303Z  2025-03-14T05:42:06.8447841Z  2025-03-14T05:42:06.8448275Z  2025-03-14T05:42:06.8448721Z  2025-03-14T05:42:06.8449149Z  2025-03-14T05:42:06.8449588Z  2025-03-14T05:42:06.8450034Z  2025-03-14T05:42:06.8450472Z  2025-03-14T05:42:06.8451080Z [9,282 / 15,235] 48 actions, 47 running 2025-03-14T05:42:06.8452042Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T05:42:06.8453136Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local 2025-03-14T05:42:06.8454016Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T05:42:06.8454914Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T05:42:06.8455614Z Compiling google/fft.cc; 18s local 2025-03-14T05:42:06.8456435Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T05:42:06.8457588Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T05:42:06.8458794Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local ... 2025-03-14T05:42:07.0479902Z 2025-03-14T05:42:07.0480787Z  2025-03-14T05:42:07.0481309Z  2025-03-14T05:42:07.0481741Z  2025-03-14T05:42:07.0482174Z  2025-03-14T05:42:07.0482600Z  2025-03-14T05:42:07.0483020Z  2025-03-14T05:42:07.0483443Z  2025-03-14T05:42:07.0483869Z  2025-03-14T05:42:07.0484584Z [9,285 / 15,235] 48 actions running 2025-03-14T05:42:07.0485601Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T05:42:07.0486729Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2025-03-14T05:42:07.0487701Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T05:42:07.0488668Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2025-03-14T05:42:07.0489493Z Compiling google/fft.cc; 19s local 2025-03-14T05:42:07.0490404Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T05:42:07.0491677Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T05:42:07.0492719Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local ... 2025-03-14T05:42:07.3198313Z 2025-03-14T05:42:07.3199157Z  2025-03-14T05:42:07.3199661Z  2025-03-14T05:42:07.3200099Z  2025-03-14T05:42:07.3200528Z  2025-03-14T05:42:07.3200960Z  2025-03-14T05:42:07.3201380Z  2025-03-14T05:42:07.3201797Z  2025-03-14T05:42:07.3202231Z  2025-03-14T05:42:07.3202851Z [9,287 / 15,235] 48 actions, 47 running 2025-03-14T05:42:07.3203861Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T05:42:07.3205147Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2025-03-14T05:42:07.3206095Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T05:42:07.3207063Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2025-03-14T05:42:07.3207934Z Compiling google/fft.cc; 19s local 2025-03-14T05:42:07.3208847Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T05:42:07.3210271Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T05:42:07.3211265Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local ... 2025-03-14T05:42:07.6489515Z 2025-03-14T05:42:07.6490286Z  2025-03-14T05:42:07.6490917Z  2025-03-14T05:42:07.6491350Z  2025-03-14T05:42:07.6491779Z  2025-03-14T05:42:07.6492207Z  2025-03-14T05:42:07.6492632Z  2025-03-14T05:42:07.6493051Z  2025-03-14T05:42:07.6493475Z  2025-03-14T05:42:07.6494065Z [9,288 / 15,235] 48 actions running 2025-03-14T05:42:07.6495079Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T05:42:07.6496222Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local 2025-03-14T05:42:07.6497198Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T05:42:07.6498205Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2025-03-14T05:42:07.6499053Z Compiling google/fft.cc; 19s local 2025-03-14T05:42:07.6499974Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T05:42:07.6501076Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T05:42:07.6502090Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local ... 2025-03-14T05:42:08.0496975Z 2025-03-14T05:42:08.0497801Z  2025-03-14T05:42:08.0498320Z  2025-03-14T05:42:08.0498769Z  2025-03-14T05:42:08.0499331Z  2025-03-14T05:42:08.0499759Z  2025-03-14T05:42:08.0500189Z  2025-03-14T05:42:08.0500615Z  2025-03-14T05:42:08.0501042Z  2025-03-14T05:42:08.0501634Z [9,293 / 15,235] 48 actions running 2025-03-14T05:42:08.0502625Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T05:42:08.0504111Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2025-03-14T05:42:08.0505111Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T05:42:08.0506098Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2025-03-14T05:42:08.0506941Z Compiling google/fft.cc; 20s local 2025-03-14T05:42:08.0507857Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T05:42:08.0508967Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T05:42:08.0509978Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local ... 2025-03-14T05:42:08.2503547Z 2025-03-14T05:42:08.2504413Z  2025-03-14T05:42:08.2504908Z  2025-03-14T05:42:08.2505325Z  2025-03-14T05:42:08.2505744Z  2025-03-14T05:42:08.2506147Z  2025-03-14T05:42:08.2506567Z  2025-03-14T05:42:08.2506980Z  2025-03-14T05:42:08.2507389Z  2025-03-14T05:42:08.2507988Z [9,296 / 15,235] 47 actions running 2025-03-14T05:42:08.2509026Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T05:42:08.2510159Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2025-03-14T05:42:08.2511204Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T05:42:08.2512095Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2025-03-14T05:42:08.2512846Z Compiling google/fft.cc; 20s local 2025-03-14T05:42:08.2513657Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T05:42:08.2514672Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T05:42:08.2515679Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local ... 2025-03-14T05:42:08.4509705Z 2025-03-14T05:42:08.4510520Z  2025-03-14T05:42:08.4511029Z  2025-03-14T05:42:08.4511478Z  2025-03-14T05:42:08.4511918Z  2025-03-14T05:42:08.4512342Z  2025-03-14T05:42:08.4512758Z  2025-03-14T05:42:08.4513166Z  2025-03-14T05:42:08.4513602Z  2025-03-14T05:42:08.4514196Z [9,298 / 15,235] 48 actions running 2025-03-14T05:42:08.4515509Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T05:42:08.4516660Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2025-03-14T05:42:08.4517637Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T05:42:08.4518628Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2025-03-14T05:42:08.4519458Z Compiling google/fft.cc; 20s local 2025-03-14T05:42:08.4520352Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T05:42:08.4521423Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T05:42:08.4522420Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local ... 2025-03-14T05:42:08.7700820Z 2025-03-14T05:42:08.7701688Z  2025-03-14T05:42:08.7702166Z  2025-03-14T05:42:08.7702588Z  2025-03-14T05:42:08.7703012Z  2025-03-14T05:42:08.7703423Z  2025-03-14T05:42:08.7703895Z  2025-03-14T05:42:08.7704306Z  2025-03-14T05:42:08.7704737Z  2025-03-14T05:42:08.7705350Z [9,302 / 15,235] 48 actions, 47 running 2025-03-14T05:42:08.7706328Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T05:42:08.7707369Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local 2025-03-14T05:42:08.7708321Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T05:42:08.7709300Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2025-03-14T05:42:08.7710124Z Compiling google/fft.cc; 20s local 2025-03-14T05:42:08.7711006Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T05:42:08.7712107Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T05:42:08.7713064Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local ... 2025-03-14T05:42:09.0519243Z 2025-03-14T05:42:09.0520084Z  2025-03-14T05:42:09.0520573Z  2025-03-14T05:42:09.0521331Z  2025-03-14T05:42:09.0521820Z  2025-03-14T05:42:09.0522241Z  2025-03-14T05:42:09.0522657Z  2025-03-14T05:42:09.0523063Z  2025-03-14T05:42:09.0523472Z  2025-03-14T05:42:09.0524034Z [9,304 / 15,235] 48 actions running 2025-03-14T05:42:09.0525179Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T05:42:09.0526261Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2025-03-14T05:42:09.0527229Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T05:42:09.0528321Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2025-03-14T05:42:09.0529142Z Compiling google/fft.cc; 21s local 2025-03-14T05:42:09.0530045Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T05:42:09.0531129Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T05:42:09.0532134Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local ... 2025-03-14T05:42:09.2525555Z 2025-03-14T05:42:09.2526436Z  2025-03-14T05:42:09.2526906Z  2025-03-14T05:42:09.2527432Z  2025-03-14T05:42:09.2527835Z  2025-03-14T05:42:09.2528254Z  2025-03-14T05:42:09.2528677Z  2025-03-14T05:42:09.2529068Z  2025-03-14T05:42:09.2529473Z  2025-03-14T05:42:09.2530030Z [9,305 / 15,235] 48 actions running 2025-03-14T05:42:09.2531013Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T05:42:09.2532165Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2025-03-14T05:42:09.2533107Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T05:42:09.2534027Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2025-03-14T05:42:09.2534847Z Compiling google/fft.cc; 21s local 2025-03-14T05:42:09.2535804Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T05:42:09.2536865Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T05:42:09.2538203Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local ... 2025-03-14T05:42:09.4531815Z 2025-03-14T05:42:09.4532668Z  2025-03-14T05:42:09.4533142Z  2025-03-14T05:42:09.4533557Z  2025-03-14T05:42:09.4533962Z  2025-03-14T05:42:09.4534371Z  2025-03-14T05:42:09.4534774Z  2025-03-14T05:42:09.4535168Z  2025-03-14T05:42:09.4535554Z  2025-03-14T05:42:09.4536113Z [9,308 / 15,235] 48 actions running 2025-03-14T05:42:09.4537118Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T05:42:09.4538217Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2025-03-14T05:42:09.4539155Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T05:42:09.4540077Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2025-03-14T05:42:09.4540842Z Compiling google/fft.cc; 21s local 2025-03-14T05:42:09.4541785Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T05:42:09.4542902Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T05:42:09.4543877Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local ... 2025-03-14T05:42:09.8539452Z 2025-03-14T05:42:09.8540245Z  2025-03-14T05:42:09.8540736Z  2025-03-14T05:42:09.8541157Z  2025-03-14T05:42:09.8541550Z  2025-03-14T05:42:09.8541985Z  2025-03-14T05:42:09.8542395Z  2025-03-14T05:42:09.8542790Z  2025-03-14T05:42:09.8543186Z  2025-03-14T05:42:09.8543736Z [9,310 / 15,235] 48 actions running 2025-03-14T05:42:09.8544672Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T05:42:09.8545742Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local 2025-03-14T05:42:09.8546724Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T05:42:09.8548110Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2025-03-14T05:42:09.8548968Z Compiling google/fft.cc; 21s local 2025-03-14T05:42:09.8549930Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T05:42:09.8551060Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T05:42:09.8552093Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local ... 2025-03-14T05:42:10.1342667Z 2025-03-14T05:42:10.1343480Z  2025-03-14T05:42:10.1343953Z  2025-03-14T05:42:10.1344330Z  2025-03-14T05:42:10.1344696Z  2025-03-14T05:42:10.1345074Z  2025-03-14T05:42:10.1345484Z  2025-03-14T05:42:10.1345884Z  2025-03-14T05:42:10.1346276Z  2025-03-14T05:42:10.1346867Z [9,315 / 15,235] 48 actions, 47 running 2025-03-14T05:42:10.1347852Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T05:42:10.1348988Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2025-03-14T05:42:10.1350000Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T05:42:10.1350987Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T05:42:10.1351815Z Compiling google/fft.cc; 22s local 2025-03-14T05:42:10.1352732Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T05:42:10.1353823Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T05:42:10.1354839Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local ... 2025-03-14T05:42:10.3679186Z 2025-03-14T05:42:10.3680019Z  2025-03-14T05:42:10.3680493Z  2025-03-14T05:42:10.3680912Z  2025-03-14T05:42:10.3681323Z  2025-03-14T05:42:10.3681725Z  2025-03-14T05:42:10.3682137Z  2025-03-14T05:42:10.3682542Z  2025-03-14T05:42:10.3682952Z  2025-03-14T05:42:10.3683538Z [9,318 / 15,235] 48 actions, 47 running 2025-03-14T05:42:10.3684648Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T05:42:10.3685680Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2025-03-14T05:42:10.3686989Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T05:42:10.3687959Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T05:42:10.3688721Z Compiling google/fft.cc; 22s local 2025-03-14T05:42:10.3689608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T05:42:10.3690737Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T05:42:10.3691698Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local ... 2025-03-14T05:42:10.5738984Z 2025-03-14T05:42:10.5739754Z  2025-03-14T05:42:10.5740244Z  2025-03-14T05:42:10.5740680Z  2025-03-14T05:42:10.5741077Z  2025-03-14T05:42:10.5741497Z  2025-03-14T05:42:10.5741917Z  2025-03-14T05:42:10.5742326Z  2025-03-14T05:42:10.5742716Z  2025-03-14T05:42:10.5743333Z [9,323 / 15,235] 48 actions, 47 running 2025-03-14T05:42:10.5744310Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T05:42:10.5745286Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2025-03-14T05:42:10.5746188Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T05:42:10.5747076Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T05:42:10.5747885Z Compiling google/fft.cc; 22s local 2025-03-14T05:42:10.5748745Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T05:42:10.5749769Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T05:42:10.5750739Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local ... 2025-03-14T05:42:10.8389713Z 2025-03-14T05:42:10.8390564Z  2025-03-14T05:42:10.8391034Z  2025-03-14T05:42:10.8391434Z  2025-03-14T05:42:10.8391834Z  2025-03-14T05:42:10.8392217Z  2025-03-14T05:42:10.8392607Z  2025-03-14T05:42:10.8393330Z  2025-03-14T05:42:10.8393767Z  2025-03-14T05:42:10.8394360Z [9,327 / 15,235] 48 actions, 47 running 2025-03-14T05:42:10.8395343Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T05:42:10.8396456Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local 2025-03-14T05:42:10.8397414Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T05:42:10.8398171Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T05:42:10.8398788Z Compiling google/fft.cc; 22s local 2025-03-14T05:42:10.8399523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T05:42:10.8400400Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T05:42:10.8401202Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local ... 2025-03-14T05:42:11.0553212Z 2025-03-14T05:42:11.0553979Z  2025-03-14T05:42:11.0554472Z  2025-03-14T05:42:11.0554936Z  2025-03-14T05:42:11.0555315Z  2025-03-14T05:42:11.0555741Z  2025-03-14T05:42:11.0556109Z  2025-03-14T05:42:11.0556475Z  2025-03-14T05:42:11.0556860Z  2025-03-14T05:42:11.0557450Z [9,327 / 15,235] 48 actions running 2025-03-14T05:42:11.0558432Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T05:42:11.0559542Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2025-03-14T05:42:11.0560451Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T05:42:11.0561399Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T05:42:11.0562169Z Compiling google/fft.cc; 23s local 2025-03-14T05:42:11.0563090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T05:42:11.0564210Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T05:42:11.0565620Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local ... 2025-03-14T05:42:11.4561060Z 2025-03-14T05:42:11.4561907Z  2025-03-14T05:42:11.4562781Z  2025-03-14T05:42:11.4563187Z  2025-03-14T05:42:11.4563570Z  2025-03-14T05:42:11.4563983Z  2025-03-14T05:42:11.4564393Z  2025-03-14T05:42:11.4564952Z  2025-03-14T05:42:11.4565558Z  2025-03-14T05:42:11.4566141Z [9,328 / 15,235] 48 actions running 2025-03-14T05:42:11.4567108Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T05:42:11.4568207Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2025-03-14T05:42:11.4569162Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T05:42:11.4570135Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T05:42:11.4571075Z Compiling google/fft.cc; 23s local 2025-03-14T05:42:11.4571992Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T05:42:11.4573081Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T05:42:11.4574035Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local ... 2025-03-14T05:42:11.7372246Z 2025-03-14T05:42:11.7373054Z  2025-03-14T05:42:11.7373533Z  2025-03-14T05:42:11.7373895Z  2025-03-14T05:42:11.7374256Z  2025-03-14T05:42:11.7374629Z  2025-03-14T05:42:11.7375024Z  2025-03-14T05:42:11.7375407Z  2025-03-14T05:42:11.7375818Z  2025-03-14T05:42:11.7376438Z [9,333 / 15,235] 48 actions, 47 running 2025-03-14T05:42:11.7377405Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T05:42:11.7378480Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2025-03-14T05:42:11.7379505Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T05:42:11.7380422Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T05:42:11.7381250Z Compiling google/fft.cc; 23s local 2025-03-14T05:42:11.7382521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T05:42:11.7383645Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T05:42:11.7384656Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local ... 2025-03-14T05:42:11.9429420Z 2025-03-14T05:42:11.9430239Z  2025-03-14T05:42:11.9430679Z  2025-03-14T05:42:11.9431052Z  2025-03-14T05:42:11.9431440Z  2025-03-14T05:42:11.9431837Z  2025-03-14T05:42:11.9432209Z  2025-03-14T05:42:11.9432729Z  2025-03-14T05:42:11.9433130Z  2025-03-14T05:42:11.9433710Z [9,334 / 15,235] 48 actions, 47 running 2025-03-14T05:42:11.9434729Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T05:42:11.9435838Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2025-03-14T05:42:11.9436673Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T05:42:11.9437565Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T05:42:11.9438260Z Compiling google/fft.cc; 23s local 2025-03-14T05:42:11.9439097Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T05:42:11.9440142Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T05:42:11.9441083Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local ... 2025-03-14T05:42:12.1529506Z 2025-03-14T05:42:12.1530364Z  2025-03-14T05:42:12.1530859Z  2025-03-14T05:42:12.1531285Z  2025-03-14T05:42:12.1531675Z  2025-03-14T05:42:12.1532090Z  2025-03-14T05:42:12.1532491Z  2025-03-14T05:42:12.1532899Z  2025-03-14T05:42:12.1533299Z  2025-03-14T05:42:12.1533908Z [9,337 / 15,235] 48 actions, 47 running 2025-03-14T05:42:12.1534855Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T05:42:12.1535924Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T05:42:12.1536872Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T05:42:12.1538144Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T05:42:12.1538901Z Compiling google/fft.cc; 24s local 2025-03-14T05:42:12.1539752Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T05:42:12.1540810Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T05:42:12.1541729Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local ... 2025-03-14T05:42:12.4571142Z 2025-03-14T05:42:12.4571995Z  2025-03-14T05:42:12.4572482Z  2025-03-14T05:42:12.4572933Z  2025-03-14T05:42:12.4573354Z  2025-03-14T05:42:12.4573776Z  2025-03-14T05:42:12.4574178Z  2025-03-14T05:42:12.4574613Z  2025-03-14T05:42:12.4575001Z  2025-03-14T05:42:12.4575594Z [9,340 / 15,235] 48 actions running 2025-03-14T05:42:12.4576635Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T05:42:12.4577771Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T05:42:12.4578709Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T05:42:12.4579598Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T05:42:12.4580397Z Compiling google/fft.cc; 24s local 2025-03-14T05:42:12.4581236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T05:42:12.4582276Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T05:42:12.4583195Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local ... 2025-03-14T05:42:12.7136208Z 2025-03-14T05:42:12.7137007Z  2025-03-14T05:42:12.7137435Z  2025-03-14T05:42:12.7137797Z  2025-03-14T05:42:12.7138136Z  2025-03-14T05:42:12.7138485Z  2025-03-14T05:42:12.7138838Z  2025-03-14T05:42:12.7139183Z  2025-03-14T05:42:12.7139520Z  2025-03-14T05:42:12.7140376Z [9,343 / 15,235] 48 actions, 47 running 2025-03-14T05:42:12.7141204Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T05:42:12.7142133Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T05:42:12.7142928Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T05:42:12.7143713Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T05:42:12.7144393Z Compiling google/fft.cc; 24s local 2025-03-14T05:42:12.7145160Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T05:42:12.7146024Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T05:42:12.7146976Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local ... 2025-03-14T05:42:12.9544612Z 2025-03-14T05:42:12.9545476Z  2025-03-14T05:42:12.9546059Z  2025-03-14T05:42:12.9546587Z  2025-03-14T05:42:12.9547105Z  2025-03-14T05:42:12.9547626Z  2025-03-14T05:42:12.9548099Z  2025-03-14T05:42:12.9548537Z  2025-03-14T05:42:12.9548957Z  2025-03-14T05:42:12.9549581Z [9,346 / 15,235] 48 actions, 47 running 2025-03-14T05:42:12.9550566Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T05:42:12.9551716Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T05:42:12.9552710Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T05:42:12.9553650Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T05:42:12.9554488Z Compiling google/fft.cc; 24s local 2025-03-14T05:42:12.9555376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T05:42:12.9556417Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T05:42:12.9557402Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local ... 2025-03-14T05:42:13.2190748Z 2025-03-14T05:42:13.2191550Z  2025-03-14T05:42:13.2192034Z  2025-03-14T05:42:13.2192414Z  2025-03-14T05:42:13.2192866Z  2025-03-14T05:42:13.2193255Z  2025-03-14T05:42:13.2193974Z  2025-03-14T05:42:13.2194356Z  2025-03-14T05:42:13.2194748Z  2025-03-14T05:42:13.2195349Z [9,351 / 15,235] 48 actions, 47 running 2025-03-14T05:42:13.2196321Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T05:42:13.2197333Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T05:42:13.2198224Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T05:42:13.2199129Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T05:42:13.2199994Z Compiling google/fft.cc; 25s local 2025-03-14T05:42:13.2200863Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T05:42:13.2201813Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T05:42:13.2202689Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local ... 2025-03-14T05:42:13.4897702Z 2025-03-14T05:42:13.4898542Z  2025-03-14T05:42:13.4899036Z  2025-03-14T05:42:13.4899464Z  2025-03-14T05:42:13.4899884Z  2025-03-14T05:42:13.4900303Z  2025-03-14T05:42:13.4900711Z  2025-03-14T05:42:13.4901116Z  2025-03-14T05:42:13.4901510Z  2025-03-14T05:42:13.4902054Z [9,353 / 15,235] 48 actions running 2025-03-14T05:42:13.4902983Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T05:42:13.4904066Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T05:42:13.4904915Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T05:42:13.4905824Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T05:42:13.4906619Z Compiling google/fft.cc; 25s local 2025-03-14T05:42:13.4907485Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T05:42:13.4908871Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T05:42:13.4909864Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local ... 2025-03-14T05:42:13.7611078Z 2025-03-14T05:42:13.7611926Z  2025-03-14T05:42:13.7612418Z  2025-03-14T05:42:13.7612845Z  2025-03-14T05:42:13.7613264Z  2025-03-14T05:42:13.7613651Z  2025-03-14T05:42:13.7614064Z  2025-03-14T05:42:13.7614483Z  2025-03-14T05:42:13.7614897Z  2025-03-14T05:42:13.7615519Z [9,359 / 15,235] 48 actions, 47 running 2025-03-14T05:42:13.7616520Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T05:42:13.7617598Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T05:42:13.7618476Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T05:42:13.7619249Z Compiling google/fft.cc; 25s local 2025-03-14T05:42:13.7620110Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T05:42:13.7621215Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T05:42:13.7622227Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T05:42:13.7623167Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local ... 2025-03-14T05:42:14.0950032Z 2025-03-14T05:42:14.0950850Z  2025-03-14T05:42:14.0951285Z  2025-03-14T05:42:14.0951637Z  2025-03-14T05:42:14.0952016Z  2025-03-14T05:42:14.0952384Z  2025-03-14T05:42:14.0952748Z  2025-03-14T05:42:14.0953123Z  2025-03-14T05:42:14.0953486Z  2025-03-14T05:42:14.0954006Z [9,361 / 15,235] 48 actions running 2025-03-14T05:42:14.0954866Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T05:42:14.0955810Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T05:42:14.0956609Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T05:42:14.0957243Z Compiling google/fft.cc; 26s local 2025-03-14T05:42:14.0958039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T05:42:14.0959426Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T05:42:14.0960471Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T05:42:14.0961401Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local ... 2025-03-14T05:42:14.2989530Z 2025-03-14T05:42:14.2990335Z  2025-03-14T05:42:14.2990747Z  2025-03-14T05:42:14.2991085Z  2025-03-14T05:42:14.2991413Z  2025-03-14T05:42:14.2991733Z  2025-03-14T05:42:14.2992060Z  2025-03-14T05:42:14.2992391Z  2025-03-14T05:42:14.2992713Z  2025-03-14T05:42:14.2993210Z [9,364 / 15,235] 48 actions, 47 running 2025-03-14T05:42:14.2993979Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T05:42:14.2994818Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T05:42:14.2995563Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T05:42:14.2996182Z Compiling google/fft.cc; 26s local 2025-03-14T05:42:14.2996873Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T05:42:14.2997661Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T05:42:14.2998414Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T05:42:14.2999150Z Compiling src/common/memory_zero_pad.cpp; 21s local ... 2025-03-14T05:42:14.6233372Z 2025-03-14T05:42:14.6234194Z  2025-03-14T05:42:14.6234649Z  2025-03-14T05:42:14.6235009Z  2025-03-14T05:42:14.6235386Z  2025-03-14T05:42:14.6235781Z  2025-03-14T05:42:14.6236141Z  2025-03-14T05:42:14.6236498Z  2025-03-14T05:42:14.6236847Z  2025-03-14T05:42:14.6237417Z [9,369 / 15,235] 48 actions, 47 running 2025-03-14T05:42:14.6238298Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T05:42:14.6239829Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T05:42:14.6240765Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T05:42:14.6241533Z Compiling google/fft.cc; 26s local 2025-03-14T05:42:14.6242372Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T05:42:14.6243373Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T05:42:14.6244259Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T05:42:14.6245307Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local ... 2025-03-14T05:42:14.8317334Z 2025-03-14T05:42:14.8318177Z  2025-03-14T05:42:14.8318644Z  2025-03-14T05:42:14.8319036Z  2025-03-14T05:42:14.8319416Z  2025-03-14T05:42:14.8319809Z  2025-03-14T05:42:14.8320182Z  2025-03-14T05:42:14.8320568Z  2025-03-14T05:42:14.8320945Z  2025-03-14T05:42:14.8321496Z [9,376 / 15,235] 48 actions, 47 running 2025-03-14T05:42:14.8322418Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T05:42:14.8323413Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T05:42:14.8324207Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T05:42:14.8325045Z Compiling google/fft.cc; 26s local 2025-03-14T05:42:14.8325794Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T05:42:14.8326696Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T05:42:14.8327502Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T05:42:14.8328201Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local ... 2025-03-14T05:42:15.0910092Z 2025-03-14T05:42:15.0910958Z  2025-03-14T05:42:15.0911530Z  2025-03-14T05:42:15.0911957Z  2025-03-14T05:42:15.0912388Z  2025-03-14T05:42:15.0912852Z  2025-03-14T05:42:15.0913282Z  2025-03-14T05:42:15.0913756Z  2025-03-14T05:42:15.0914215Z  2025-03-14T05:42:15.0914842Z [9,378 / 15,235] 48 actions running 2025-03-14T05:42:15.0916196Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T05:42:15.0917306Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T05:42:15.0918267Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T05:42:15.0919052Z Compiling google/fft.cc; 27s local 2025-03-14T05:42:15.0919897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T05:42:15.0920943Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T05:42:15.0921888Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T05:42:15.0922832Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local ... 2025-03-14T05:42:15.3200313Z 2025-03-14T05:42:15.3201074Z  2025-03-14T05:42:15.3201510Z  2025-03-14T05:42:15.3201884Z  2025-03-14T05:42:15.3202265Z  2025-03-14T05:42:15.3202665Z  2025-03-14T05:42:15.3203035Z  2025-03-14T05:42:15.3203408Z  2025-03-14T05:42:15.3203771Z  2025-03-14T05:42:15.3204285Z [9,380 / 15,235] 48 actions, 47 running 2025-03-14T05:42:15.3205282Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T05:42:15.3206200Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T05:42:15.3206981Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T05:42:15.3207689Z Compiling google/fft.cc; 27s local 2025-03-14T05:42:15.3208506Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T05:42:15.3209517Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T05:42:15.3210308Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T05:42:15.3211131Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local ... 2025-03-14T05:42:15.5377668Z 2025-03-14T05:42:15.5378480Z  2025-03-14T05:42:15.5379290Z  2025-03-14T05:42:15.5379663Z  2025-03-14T05:42:15.5380061Z  2025-03-14T05:42:15.5380440Z  2025-03-14T05:42:15.5380841Z  2025-03-14T05:42:15.5381361Z  2025-03-14T05:42:15.5381733Z  2025-03-14T05:42:15.5382262Z [9,384 / 15,235] 48 actions, 47 running 2025-03-14T05:42:15.5383080Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T05:42:15.5396350Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T05:42:15.5397382Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T05:42:15.5398049Z Compiling google/fft.cc; 27s local 2025-03-14T05:42:15.5398784Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T05:42:15.5399671Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T05:42:15.5400461Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T05:42:15.5401279Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local ... 2025-03-14T05:42:15.8452723Z 2025-03-14T05:42:15.8453508Z  2025-03-14T05:42:15.8453942Z  2025-03-14T05:42:15.8454320Z  2025-03-14T05:42:15.8454689Z  2025-03-14T05:42:15.8455059Z  2025-03-14T05:42:15.8455437Z  2025-03-14T05:42:15.8455817Z  2025-03-14T05:42:15.8456187Z  2025-03-14T05:42:15.8456722Z [9,389 / 15,235] 48 actions, 47 running 2025-03-14T05:42:15.8457564Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T05:42:15.8458485Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T05:42:15.8459275Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T05:42:15.8459979Z Compiling google/fft.cc; 27s local 2025-03-14T05:42:15.8460733Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T05:42:15.8461612Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T05:42:15.8462434Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T05:42:15.8463523Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local ... 2025-03-14T05:42:16.0919652Z 2025-03-14T05:42:16.0920376Z  2025-03-14T05:42:16.0920797Z  2025-03-14T05:42:16.0921169Z  2025-03-14T05:42:16.0921533Z  2025-03-14T05:42:16.0922023Z  2025-03-14T05:42:16.0922396Z  2025-03-14T05:42:16.0922771Z  2025-03-14T05:42:16.0923131Z  2025-03-14T05:42:16.0923649Z [9,389 / 15,235] 48 actions running 2025-03-14T05:42:16.0924606Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T05:42:16.0925513Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T05:42:16.0926305Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 28s local 2025-03-14T05:42:16.0926960Z Compiling google/fft.cc; 28s local 2025-03-14T05:42:16.0927731Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T05:42:16.0928651Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T05:42:16.0929486Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T05:42:16.0930303Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local ... 2025-03-14T05:42:16.3215386Z 2025-03-14T05:42:16.3216218Z  2025-03-14T05:42:16.3216692Z  2025-03-14T05:42:16.3217092Z  2025-03-14T05:42:16.3217487Z  2025-03-14T05:42:16.3217902Z  2025-03-14T05:42:16.3218327Z  2025-03-14T05:42:16.3218722Z  2025-03-14T05:42:16.3219137Z  2025-03-14T05:42:16.3219712Z [9,391 / 15,235] 48 actions, 47 running 2025-03-14T05:42:16.3220672Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T05:42:16.3221737Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T05:42:16.3222612Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 28s local 2025-03-14T05:42:16.3223750Z Compiling google/fft.cc; 28s local 2025-03-14T05:42:16.3224652Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T05:42:16.3225686Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T05:42:16.3226613Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T05:42:16.3227460Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local ... 2025-03-14T05:42:16.5220760Z 2025-03-14T05:42:16.5221589Z  2025-03-14T05:42:16.5222069Z  2025-03-14T05:42:16.5222476Z  2025-03-14T05:42:16.5222885Z  2025-03-14T05:42:16.5223307Z  2025-03-14T05:42:16.5223842Z  2025-03-14T05:42:16.5224259Z  2025-03-14T05:42:16.5224654Z  2025-03-14T05:42:16.5225221Z [9,392 / 15,235] 48 actions, 47 running 2025-03-14T05:42:16.5226146Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T05:42:16.5227140Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T05:42:16.5227937Z Compiling google/fft.cc; 28s local 2025-03-14T05:42:16.5228816Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T05:42:16.5229749Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T05:42:16.5230542Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T05:42:16.5231342Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T05:42:16.5232231Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local ... 2025-03-14T05:42:16.8931737Z 2025-03-14T05:42:16.8932600Z  2025-03-14T05:42:16.8933092Z  2025-03-14T05:42:16.8933483Z  2025-03-14T05:42:16.8933930Z  2025-03-14T05:42:16.8934327Z  2025-03-14T05:42:16.8934723Z  2025-03-14T05:42:16.8935120Z  2025-03-14T05:42:16.8935547Z  2025-03-14T05:42:16.8936114Z [9,395 / 15,235] 48 actions running 2025-03-14T05:42:16.8937066Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T05:42:16.8938103Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T05:42:16.8939322Z Compiling google/fft.cc; 28s local 2025-03-14T05:42:16.8940172Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T05:42:16.8941213Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T05:42:16.8942144Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T05:42:16.8943037Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T05:42:16.8943912Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local ... 2025-03-14T05:42:17.1421306Z 2025-03-14T05:42:17.1422131Z  2025-03-14T05:42:17.1422747Z  2025-03-14T05:42:17.1423177Z  2025-03-14T05:42:17.1423617Z  2025-03-14T05:42:17.1424046Z  2025-03-14T05:42:17.1424472Z  2025-03-14T05:42:17.1424899Z  2025-03-14T05:42:17.1425305Z  2025-03-14T05:42:17.1425938Z [9,399 / 15,235] 48 actions, 47 running 2025-03-14T05:42:17.1426859Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T05:42:17.1427833Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 29s local 2025-03-14T05:42:17.1428482Z Compiling google/fft.cc; 29s local 2025-03-14T05:42:17.1429303Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T05:42:17.1430298Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T05:42:17.1431200Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T05:42:17.1432026Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T05:42:17.1432912Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local ... 2025-03-14T05:42:17.3686066Z 2025-03-14T05:42:17.3686897Z  2025-03-14T05:42:17.3687391Z  2025-03-14T05:42:17.3687769Z  2025-03-14T05:42:17.3688186Z  2025-03-14T05:42:17.3688567Z  2025-03-14T05:42:17.3688963Z  2025-03-14T05:42:17.3689727Z  2025-03-14T05:42:17.3690151Z  2025-03-14T05:42:17.3690762Z [9,403 / 15,235] 48 actions, 47 running 2025-03-14T05:42:17.3691644Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T05:42:17.3692562Z Compiling google/fft.cc; 29s local 2025-03-14T05:42:17.3693441Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T05:42:17.3694517Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T05:42:17.3695454Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T05:42:17.3696264Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T05:42:17.3697096Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T05:42:17.3698055Z Compiling src/google/protobuf/descriptor.cc [for tool]; 11s local ... 2025-03-14T05:42:17.6422959Z 2025-03-14T05:42:17.6423768Z  2025-03-14T05:42:17.6424245Z  2025-03-14T05:42:17.6424668Z  2025-03-14T05:42:17.6425096Z  2025-03-14T05:42:17.6425509Z  2025-03-14T05:42:17.6425903Z  2025-03-14T05:42:17.6426284Z  2025-03-14T05:42:17.6426707Z  2025-03-14T05:42:17.6427317Z [9,409 / 15,235] 48 actions, 47 running 2025-03-14T05:42:17.6428301Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T05:42:17.6429226Z Compiling google/fft.cc; 29s local 2025-03-14T05:42:17.6430062Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T05:42:17.6431055Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T05:42:17.6431937Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T05:42:17.6432812Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T05:42:17.6433785Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T05:42:17.6434840Z Compiling src/google/protobuf/descriptor.cc [for tool]; 11s local ... 2025-03-14T05:42:17.8618323Z 2025-03-14T05:42:17.8619166Z  2025-03-14T05:42:17.8619983Z  2025-03-14T05:42:17.8620404Z  2025-03-14T05:42:17.8620807Z  2025-03-14T05:42:17.8621218Z  2025-03-14T05:42:17.8621630Z  2025-03-14T05:42:17.8622033Z  2025-03-14T05:42:17.8622443Z  2025-03-14T05:42:17.8623029Z [9,413 / 15,235] 48 actions, 47 running 2025-03-14T05:42:17.8623976Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T05:42:17.8624787Z Compiling google/fft.cc; 29s local 2025-03-14T05:42:17.8625641Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T05:42:17.8626668Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T05:42:17.8627567Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T05:42:17.8628537Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T05:42:17.8629393Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T05:42:17.8630424Z Compiling src/google/protobuf/descriptor.cc [for tool]; 11s local ... 2025-03-14T05:42:18.0689743Z 2025-03-14T05:42:18.0690538Z  2025-03-14T05:42:18.0691173Z  2025-03-14T05:42:18.0691578Z  2025-03-14T05:42:18.0692009Z  2025-03-14T05:42:18.0692422Z  2025-03-14T05:42:18.0692822Z  2025-03-14T05:42:18.0693219Z  2025-03-14T05:42:18.0693635Z  2025-03-14T05:42:18.0694263Z [9,416 / 15,235] 48 actions, 47 running 2025-03-14T05:42:18.0695244Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T05:42:18.0696139Z Compiling google/fft.cc; 30s local 2025-03-14T05:42:18.0697004Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T05:42:18.0698069Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T05:42:18.0698998Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T05:42:18.0700239Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T05:42:18.0701086Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T05:42:18.0702070Z Compiling src/google/protobuf/descriptor.cc [for tool]; 12s local ... 2025-03-14T05:42:18.2943421Z 2025-03-14T05:42:18.2944233Z  2025-03-14T05:42:18.2944724Z  2025-03-14T05:42:18.2945125Z  2025-03-14T05:42:18.2945529Z  2025-03-14T05:42:18.2945951Z  2025-03-14T05:42:18.2946360Z  2025-03-14T05:42:18.2946775Z  2025-03-14T05:42:18.2947176Z  2025-03-14T05:42:18.2947757Z [9,417 / 15,235] 48 actions running 2025-03-14T05:42:18.2948720Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T05:42:18.2949635Z Compiling google/fft.cc; 30s local 2025-03-14T05:42:18.2950504Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T05:42:18.2951526Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T05:42:18.2952488Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T05:42:18.2953399Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T05:42:18.2954186Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T05:42:18.2955209Z Compiling src/google/protobuf/descriptor.cc [for tool]; 12s local ... 2025-03-14T05:42:18.4964268Z 2025-03-14T05:42:18.4965265Z  2025-03-14T05:42:18.4966092Z  2025-03-14T05:42:18.4966490Z  2025-03-14T05:42:18.4966898Z  2025-03-14T05:42:18.4967307Z  2025-03-14T05:42:18.4967706Z  2025-03-14T05:42:18.4968092Z  2025-03-14T05:42:18.4968478Z  2025-03-14T05:42:18.4969038Z [9,422 / 15,235] 48 actions running 2025-03-14T05:42:18.4970027Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T05:42:18.4971203Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T05:42:18.4972263Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T05:42:18.4973538Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T05:42:18.4974416Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T05:42:18.4975262Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T05:42:18.4976220Z Compiling src/google/protobuf/descriptor.cc [for tool]; 12s local 2025-03-14T05:42:18.4977271Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local ... 2025-03-14T05:42:18.8817270Z 2025-03-14T05:42:18.8818128Z  2025-03-14T05:42:18.8818645Z  2025-03-14T05:42:18.8819063Z  2025-03-14T05:42:18.8819467Z  2025-03-14T05:42:18.8819871Z  2025-03-14T05:42:18.8820269Z  2025-03-14T05:42:18.8820680Z  2025-03-14T05:42:18.8821076Z  2025-03-14T05:42:18.8821651Z [9,425 / 15,235] 48 actions, 47 running 2025-03-14T05:42:18.8822562Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T05:42:18.8823760Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T05:42:18.8824803Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T05:42:18.8825667Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T05:42:18.8826583Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T05:42:18.8827495Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local 2025-03-14T05:42:18.8828437Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2025-03-14T05:42:18.8829236Z Compiling src/cpu/nhwc_pooling.cpp; 7s local ... 2025-03-14T05:42:19.0957258Z 2025-03-14T05:42:19.0958050Z  2025-03-14T05:42:19.0958529Z  2025-03-14T05:42:19.0958937Z  2025-03-14T05:42:19.0959351Z  2025-03-14T05:42:19.0959740Z  2025-03-14T05:42:19.0960139Z  2025-03-14T05:42:19.0960541Z  2025-03-14T05:42:19.0960914Z  2025-03-14T05:42:19.0961840Z [9,429 / 15,235] 48 actions running 2025-03-14T05:42:19.0962775Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T05:42:19.0963898Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T05:42:19.0965044Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T05:42:19.0966095Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T05:42:19.0966918Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T05:42:19.0967816Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local 2025-03-14T05:42:19.0968778Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2025-03-14T05:42:19.0969610Z Compiling src/cpu/nhwc_pooling.cpp; 7s local ... 2025-03-14T05:42:19.2963641Z 2025-03-14T05:42:19.2964476Z  2025-03-14T05:42:19.2965106Z  2025-03-14T05:42:19.2965740Z  2025-03-14T05:42:19.2966118Z  2025-03-14T05:42:19.2966484Z  2025-03-14T05:42:19.2966857Z  2025-03-14T05:42:19.2967259Z  2025-03-14T05:42:19.2967625Z  2025-03-14T05:42:19.2968170Z [9,431 / 15,235] 48 actions running 2025-03-14T05:42:19.2969051Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T05:42:19.2970158Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T05:42:19.2971143Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T05:42:19.2971952Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T05:42:19.2972776Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T05:42:19.2973659Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local 2025-03-14T05:42:19.2974541Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2025-03-14T05:42:19.2975434Z Compiling src/cpu/ref_batch_normalization.cpp; 6s local ... 2025-03-14T05:42:19.4968423Z 2025-03-14T05:42:19.4969243Z  2025-03-14T05:42:19.4969754Z  2025-03-14T05:42:19.4970215Z  2025-03-14T05:42:19.4970625Z  2025-03-14T05:42:19.4971372Z  2025-03-14T05:42:19.4971767Z  2025-03-14T05:42:19.4972155Z  2025-03-14T05:42:19.4972662Z  2025-03-14T05:42:19.4973179Z [9,433 / 15,235] 48 actions running 2025-03-14T05:42:19.4974047Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T05:42:19.4975136Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T05:42:19.4976142Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T05:42:19.4977019Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T05:42:19.4977856Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T05:42:19.4978790Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local 2025-03-14T05:42:19.4979782Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2025-03-14T05:42:19.4980744Z Compiling src/cpu/ref_batch_normalization.cpp; 6s local ... 2025-03-14T05:42:19.8530432Z 2025-03-14T05:42:19.8531331Z  2025-03-14T05:42:19.8531820Z  2025-03-14T05:42:19.8532230Z  2025-03-14T05:42:19.8532653Z  2025-03-14T05:42:19.8533071Z  2025-03-14T05:42:19.8533480Z  2025-03-14T05:42:19.8533895Z  2025-03-14T05:42:19.8534317Z  2025-03-14T05:42:19.8534933Z [9,440 / 15,235] 48 actions, 47 running 2025-03-14T05:42:19.8535832Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T05:42:19.8537027Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T05:42:19.8538054Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T05:42:19.8539491Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T05:42:19.8540384Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T05:42:19.8541301Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local 2025-03-14T05:42:19.8542596Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2025-03-14T05:42:19.8543453Z Compiling src/cpu/ref_deconvolution.cpp; 6s local ... 2025-03-14T05:42:20.0920628Z 2025-03-14T05:42:20.0921594Z  2025-03-14T05:42:20.0922120Z  2025-03-14T05:42:20.0922561Z  2025-03-14T05:42:20.0922977Z  2025-03-14T05:42:20.0923419Z  2025-03-14T05:42:20.0923851Z  2025-03-14T05:42:20.0924274Z  2025-03-14T05:42:20.0924855Z  2025-03-14T05:42:20.0925475Z [9,443 / 15,235] 48 actions, 47 running 2025-03-14T05:42:20.0926455Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T05:42:20.0927653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T05:42:20.0928708Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T05:42:20.0929618Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T05:42:20.0930524Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T05:42:20.0931503Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local 2025-03-14T05:42:20.0932494Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2025-03-14T05:42:20.0933356Z Compiling src/cpu/ref_deconvolution.cpp; 6s local ... 2025-03-14T05:42:20.2976636Z 2025-03-14T05:42:20.2977468Z  2025-03-14T05:42:20.2977973Z  2025-03-14T05:42:20.2978391Z  2025-03-14T05:42:20.2978820Z  2025-03-14T05:42:20.2979246Z  2025-03-14T05:42:20.2979673Z  2025-03-14T05:42:20.2980088Z  2025-03-14T05:42:20.2980483Z  2025-03-14T05:42:20.2981046Z [9,446 / 15,235] 48 actions running 2025-03-14T05:42:20.2982011Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T05:42:20.2983242Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T05:42:20.2984303Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T05:42:20.2985252Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T05:42:20.2986499Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T05:42:20.2987477Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local 2025-03-14T05:42:20.2988476Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2025-03-14T05:42:20.2989334Z Compiling src/cpu/ref_deconvolution.cpp; 6s local ... 2025-03-14T05:42:20.5064927Z 2025-03-14T05:42:20.5066102Z  2025-03-14T05:42:20.5066606Z  2025-03-14T05:42:20.5067034Z  2025-03-14T05:42:20.5067458Z  2025-03-14T05:42:20.5067878Z  2025-03-14T05:42:20.5068281Z  2025-03-14T05:42:20.5068680Z  2025-03-14T05:42:20.5069062Z  2025-03-14T05:42:20.5069650Z [9,448 / 15,235] 48 actions, 47 running 2025-03-14T05:42:20.5070643Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T05:42:20.5071846Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T05:42:20.5072858Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T05:42:20.5073761Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T05:42:20.5074565Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T05:42:20.5075514Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local 2025-03-14T05:42:20.5076477Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2025-03-14T05:42:20.5077280Z Compiling src/cpu/ref_eltwise.cpp; 6s local ... 2025-03-14T05:42:20.7431911Z 2025-03-14T05:42:20.7432738Z  2025-03-14T05:42:20.7433224Z  2025-03-14T05:42:20.7433615Z  2025-03-14T05:42:20.7434014Z  2025-03-14T05:42:20.7434389Z  2025-03-14T05:42:20.7434773Z  2025-03-14T05:42:20.7435144Z  2025-03-14T05:42:20.7435532Z  2025-03-14T05:42:20.7436109Z [9,451 / 15,235] 48 actions, 47 running 2025-03-14T05:42:20.7437365Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T05:42:20.7438476Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T05:42:20.7439514Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T05:42:20.7440331Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T05:42:20.7441167Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T05:42:20.7442068Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local 2025-03-14T05:42:20.7443001Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2025-03-14T05:42:20.7443793Z Compiling src/cpu/ref_eltwise.cpp; 7s local ... 2025-03-14T05:42:21.0548476Z 2025-03-14T05:42:21.0549340Z  2025-03-14T05:42:21.0549838Z  2025-03-14T05:42:21.0550267Z  2025-03-14T05:42:21.0550683Z  2025-03-14T05:42:21.0551084Z  2025-03-14T05:42:21.0551499Z  2025-03-14T05:42:21.0551915Z  2025-03-14T05:42:21.0552326Z  2025-03-14T05:42:21.0552985Z [9,454 / 15,235] 48 actions, 47 running 2025-03-14T05:42:21.0554092Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T05:42:21.0555257Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T05:42:21.0556287Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T05:42:21.0557146Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T05:42:21.0557975Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T05:42:21.0558918Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local 2025-03-14T05:42:21.0559883Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2025-03-14T05:42:21.0560687Z Compiling src/cpu/ref_eltwise.cpp; 7s local ... 2025-03-14T05:42:21.2658390Z 2025-03-14T05:42:21.2659196Z  2025-03-14T05:42:21.2659629Z  2025-03-14T05:42:21.2659983Z  2025-03-14T05:42:21.2660319Z  2025-03-14T05:42:21.2660717Z  2025-03-14T05:42:21.2661071Z  2025-03-14T05:42:21.2661716Z  2025-03-14T05:42:21.2662083Z  2025-03-14T05:42:21.2662621Z [9,457 / 15,235] 48 actions, 47 running 2025-03-14T05:42:21.2663436Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T05:42:21.2664450Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T05:42:21.2665528Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T05:42:21.2666313Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T05:42:21.2667025Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T05:42:21.2667854Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local 2025-03-14T05:42:21.2668675Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2025-03-14T05:42:21.2669369Z Compiling src/cpu/ref_eltwise.cpp; 7s local ... 2025-03-14T05:42:21.4990514Z 2025-03-14T05:42:21.4991381Z  2025-03-14T05:42:21.4991971Z  2025-03-14T05:42:21.4992419Z  2025-03-14T05:42:21.4992822Z  2025-03-14T05:42:21.4993205Z  2025-03-14T05:42:21.4993581Z  2025-03-14T05:42:21.4993968Z  2025-03-14T05:42:21.4994349Z  2025-03-14T05:42:21.4994873Z [9,459 / 15,235] 48 actions running 2025-03-14T05:42:21.4995746Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T05:42:21.4996917Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T05:42:21.4997904Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T05:42:21.4998735Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T05:42:21.4999551Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T05:42:21.5000466Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local 2025-03-14T05:42:21.5001289Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2025-03-14T05:42:21.5002605Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local ... 2025-03-14T05:42:21.7973449Z 2025-03-14T05:42:21.7974300Z  2025-03-14T05:42:21.7974777Z  2025-03-14T05:42:21.7975150Z  2025-03-14T05:42:21.7975535Z  2025-03-14T05:42:21.7975913Z  2025-03-14T05:42:21.7976308Z  2025-03-14T05:42:21.7976691Z  2025-03-14T05:42:21.7977079Z  2025-03-14T05:42:21.7977649Z [9,460 / 15,235] 48 actions, 47 running 2025-03-14T05:42:21.7978584Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T05:42:21.7979730Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T05:42:21.7980749Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T05:42:21.7981560Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T05:42:21.7982315Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T05:42:21.7983061Z Compiling src/cpu/ref_eltwise.cpp; 8s local 2025-03-14T05:42:21.7983887Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2025-03-14T05:42:21.7984751Z Compiling src/cpu/ref_lrn.cpp; 7s local ... 2025-03-14T05:42:22.1001616Z 2025-03-14T05:42:22.1002408Z  2025-03-14T05:42:22.1002872Z  2025-03-14T05:42:22.1003255Z  2025-03-14T05:42:22.1003640Z  2025-03-14T05:42:22.1004033Z  2025-03-14T05:42:22.1004424Z  2025-03-14T05:42:22.1004985Z  2025-03-14T05:42:22.1005347Z  2025-03-14T05:42:22.1005910Z [9,463 / 15,235] 48 actions running 2025-03-14T05:42:22.1006855Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T05:42:22.1008024Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T05:42:22.1008997Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T05:42:22.1009825Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T05:42:22.1010808Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T05:42:22.1012071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2025-03-14T05:42:22.1012904Z Compiling src/cpu/ref_lrn.cpp; 7s local 2025-03-14T05:42:22.1013535Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2025-03-14T05:42:22.3440175Z 2025-03-14T05:42:22.3440985Z  2025-03-14T05:42:22.3441500Z  2025-03-14T05:42:22.3441884Z  2025-03-14T05:42:22.3442275Z  2025-03-14T05:42:22.3442654Z  2025-03-14T05:42:22.3443053Z  2025-03-14T05:42:22.3443432Z  2025-03-14T05:42:22.3443807Z  2025-03-14T05:42:22.3444385Z [9,465 / 15,235] 48 actions, 47 running 2025-03-14T05:42:22.3445439Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T05:42:22.3446537Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T05:42:22.3447543Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T05:42:22.3448360Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T05:42:22.3449302Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T05:42:22.3450208Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2025-03-14T05:42:22.3451060Z Compiling src/cpu/ref_lrn.cpp; 7s local 2025-03-14T05:42:22.3451698Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2025-03-14T05:42:22.5609433Z 2025-03-14T05:42:22.5610284Z  2025-03-14T05:42:22.5610763Z  2025-03-14T05:42:22.5611169Z  2025-03-14T05:42:22.5611575Z  2025-03-14T05:42:22.5611951Z  2025-03-14T05:42:22.5612354Z  2025-03-14T05:42:22.5612760Z  2025-03-14T05:42:22.5613196Z  2025-03-14T05:42:22.5613844Z [9,470 / 15,235] 48 actions, 47 running 2025-03-14T05:42:22.5614874Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T05:42:22.5616388Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T05:42:22.5617474Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T05:42:22.5618322Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T05:42:22.5619092Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T05:42:22.5620024Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2025-03-14T05:42:22.5620878Z Compiling src/cpu/ref_pooling.cpp; 7s local 2025-03-14T05:42:22.5621540Z @com_google_protobuf//:protobuf; 5s local ... 2025-03-14T05:42:22.8353689Z 2025-03-14T05:42:22.8354499Z  2025-03-14T05:42:22.8355017Z  2025-03-14T05:42:22.8355459Z  2025-03-14T05:42:22.8355899Z  2025-03-14T05:42:22.8356342Z  2025-03-14T05:42:22.8356737Z  2025-03-14T05:42:22.8357181Z  2025-03-14T05:42:22.8357597Z  2025-03-14T05:42:22.8358226Z [9,474 / 15,235] 48 actions, 47 running 2025-03-14T05:42:22.8359265Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T05:42:22.8360538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T05:42:22.8361664Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T05:42:22.8362607Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T05:42:22.8363496Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T05:42:22.8364781Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2025-03-14T05:42:22.8365930Z @com_google_protobuf//:protobuf; 5s local 2025-03-14T05:42:22.8366829Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 5s local ... 2025-03-14T05:42:23.1012270Z 2025-03-14T05:42:23.1013106Z  2025-03-14T05:42:23.1013551Z  2025-03-14T05:42:23.1013959Z  2025-03-14T05:42:23.1014358Z  2025-03-14T05:42:23.1014748Z  2025-03-14T05:42:23.1015143Z  2025-03-14T05:42:23.1015537Z  2025-03-14T05:42:23.1015919Z  2025-03-14T05:42:23.1016507Z [9,474 / 15,235] 48 actions running 2025-03-14T05:42:23.1017818Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T05:42:23.1018921Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T05:42:23.1020037Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T05:42:23.1021060Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T05:42:23.1021822Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T05:42:23.1022763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2025-03-14T05:42:23.1023661Z @com_google_protobuf//:protobuf; 5s local 2025-03-14T05:42:23.1024524Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 5s local ... 2025-03-14T05:42:23.3018707Z 2025-03-14T05:42:23.3019572Z  2025-03-14T05:42:23.3020061Z  2025-03-14T05:42:23.3020477Z  2025-03-14T05:42:23.3020869Z  2025-03-14T05:42:23.3021322Z  2025-03-14T05:42:23.3021731Z  2025-03-14T05:42:23.3022115Z  2025-03-14T05:42:23.3022484Z  2025-03-14T05:42:23.3023092Z [9,476 / 15,235] 48 actions, 47 running 2025-03-14T05:42:23.3024036Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T05:42:23.3025168Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T05:42:23.3026148Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T05:42:23.3026975Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T05:42:23.3027791Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T05:42:23.3028799Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2025-03-14T05:42:23.3029850Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 5s local 2025-03-14T05:42:23.3030849Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 5s local ... 2025-03-14T05:42:23.5971462Z 2025-03-14T05:42:23.5972608Z  2025-03-14T05:42:23.5973135Z  2025-03-14T05:42:23.5973527Z  2025-03-14T05:42:23.5973895Z  2025-03-14T05:42:23.5974300Z  2025-03-14T05:42:23.5974702Z  2025-03-14T05:42:23.5975105Z  2025-03-14T05:42:23.5975513Z  2025-03-14T05:42:23.5976098Z [9,480 / 15,235] 48 actions, 47 running 2025-03-14T05:42:23.5977051Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T05:42:23.5978212Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T05:42:23.5979202Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T05:42:23.5980076Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T05:42:23.5980878Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T05:42:23.5982033Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2025-03-14T05:42:23.5983120Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T05:42:23.5984193Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 5s local ... 2025-03-14T05:42:23.8323693Z 2025-03-14T05:42:23.8324531Z  2025-03-14T05:42:23.8325242Z  2025-03-14T05:42:23.8325681Z  2025-03-14T05:42:23.8326250Z  2025-03-14T05:42:23.8326691Z  2025-03-14T05:42:23.8327096Z  2025-03-14T05:42:23.8327509Z  2025-03-14T05:42:23.8327902Z  2025-03-14T05:42:23.8328504Z [9,486 / 15,235] 48 actions, 47 running 2025-03-14T05:42:23.8329490Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T05:42:23.8330680Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T05:42:23.8331708Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T05:42:23.8332607Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T05:42:23.8333439Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T05:42:23.8334512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2025-03-14T05:42:23.8336014Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T05:42:23.8337042Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 6s local ... 2025-03-14T05:42:24.1033434Z 2025-03-14T05:42:24.1034301Z  2025-03-14T05:42:24.1034778Z  2025-03-14T05:42:24.1035182Z  2025-03-14T05:42:24.1035591Z  2025-03-14T05:42:24.1035984Z  2025-03-14T05:42:24.1036396Z  2025-03-14T05:42:24.1036805Z  2025-03-14T05:42:24.1037176Z  2025-03-14T05:42:24.1037701Z [9,488 / 15,235] 48 actions running 2025-03-14T05:42:24.1038626Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2025-03-14T05:42:24.1039734Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T05:42:24.1040714Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T05:42:24.1041606Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T05:42:24.1042425Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T05:42:24.1043354Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2025-03-14T05:42:24.1044377Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T05:42:24.1045537Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 6s local ... 2025-03-14T05:42:24.3030027Z 2025-03-14T05:42:24.3030894Z  2025-03-14T05:42:24.3031400Z  2025-03-14T05:42:24.3031806Z  2025-03-14T05:42:24.3032214Z  2025-03-14T05:42:24.3032593Z  2025-03-14T05:42:24.3032985Z  2025-03-14T05:42:24.3033408Z  2025-03-14T05:42:24.3033816Z  2025-03-14T05:42:24.3034384Z [9,491 / 15,235] 48 actions running 2025-03-14T05:42:24.3035388Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2025-03-14T05:42:24.3036970Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T05:42:24.3038072Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T05:42:24.3038920Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T05:42:24.3039800Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T05:42:24.3040812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2025-03-14T05:42:24.3041925Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T05:42:24.3042983Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 6s local ... 2025-03-14T05:42:24.5432265Z 2025-03-14T05:42:24.5433136Z  2025-03-14T05:42:24.5433625Z  2025-03-14T05:42:24.5434044Z  2025-03-14T05:42:24.5434450Z  2025-03-14T05:42:24.5434868Z  2025-03-14T05:42:24.5435305Z  2025-03-14T05:42:24.5435715Z  2025-03-14T05:42:24.5436126Z  2025-03-14T05:42:24.5436763Z [9,500 / 15,235] 48 actions, 47 running 2025-03-14T05:42:24.5437736Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2025-03-14T05:42:24.5438898Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T05:42:24.5439936Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T05:42:24.5440835Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T05:42:24.5441686Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T05:42:24.5442730Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2025-03-14T05:42:24.5443847Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T05:42:24.5445084Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 6s local ... 2025-03-14T05:42:24.7462341Z 2025-03-14T05:42:24.7463120Z  2025-03-14T05:42:24.7463608Z  2025-03-14T05:42:24.7464043Z  2025-03-14T05:42:24.7464456Z  2025-03-14T05:42:24.7464873Z  2025-03-14T05:42:24.7465579Z  2025-03-14T05:42:24.7465984Z  2025-03-14T05:42:24.7466737Z  2025-03-14T05:42:24.7467356Z [9,504 / 15,235] 48 actions, 47 running 2025-03-14T05:42:24.7468299Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T05:42:24.7469374Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T05:42:24.7470290Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T05:42:24.7471389Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2025-03-14T05:42:24.7472545Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T05:42:24.7473558Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2025-03-14T05:42:24.7474596Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 6s local 2025-03-14T05:42:24.7475669Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 6s local ... 2025-03-14T05:42:24.9564178Z 2025-03-14T05:42:24.9565165Z  2025-03-14T05:42:24.9565847Z  2025-03-14T05:42:24.9566239Z  2025-03-14T05:42:24.9566640Z  2025-03-14T05:42:24.9567051Z  2025-03-14T05:42:24.9567455Z  2025-03-14T05:42:24.9567845Z  2025-03-14T05:42:24.9568225Z  2025-03-14T05:42:24.9568789Z [9,508 / 15,235] 48 actions, 47 running 2025-03-14T05:42:24.9569685Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T05:42:24.9570644Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T05:42:24.9571499Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T05:42:24.9572437Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2025-03-14T05:42:24.9573473Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T05:42:24.9574470Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2025-03-14T05:42:24.9575414Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 7s local 2025-03-14T05:42:24.9576815Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local ... 2025-03-14T05:42:25.2674895Z 2025-03-14T05:42:25.2675753Z  2025-03-14T05:42:25.2676261Z  2025-03-14T05:42:25.2676675Z  2025-03-14T05:42:25.2677081Z  2025-03-14T05:42:25.2677500Z  2025-03-14T05:42:25.2677899Z  2025-03-14T05:42:25.2678287Z  2025-03-14T05:42:25.2678710Z  2025-03-14T05:42:25.2679303Z [9,514 / 15,235] 48 actions, 47 running 2025-03-14T05:42:25.2680211Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T05:42:25.2681230Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T05:42:25.2682062Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T05:42:25.2683051Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2025-03-14T05:42:25.2684060Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T05:42:25.2685243Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2025-03-14T05:42:25.2686210Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 7s local 2025-03-14T05:42:25.2687239Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local ... 2025-03-14T05:42:25.5037651Z 2025-03-14T05:42:25.5038479Z  2025-03-14T05:42:25.5038963Z  2025-03-14T05:42:25.5039353Z  2025-03-14T05:42:25.5039755Z  2025-03-14T05:42:25.5040168Z  2025-03-14T05:42:25.5040590Z  2025-03-14T05:42:25.5040986Z  2025-03-14T05:42:25.5041401Z  2025-03-14T05:42:25.5041972Z [9,516 / 15,235] 48 actions running 2025-03-14T05:42:25.5042867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T05:42:25.5043932Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T05:42:25.5044916Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T05:42:25.5045915Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2025-03-14T05:42:25.5046947Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T05:42:25.5048354Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 7s local 2025-03-14T05:42:25.5049387Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 7s local 2025-03-14T05:42:25.5050577Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local ... 2025-03-14T05:42:25.8321905Z 2025-03-14T05:42:25.8322743Z  2025-03-14T05:42:25.8323218Z  2025-03-14T05:42:25.8323623Z  2025-03-14T05:42:25.8324029Z  2025-03-14T05:42:25.8324451Z  2025-03-14T05:42:25.8325021Z  2025-03-14T05:42:25.8325414Z  2025-03-14T05:42:25.8325804Z  2025-03-14T05:42:25.8326413Z [9,519 / 15,235] 48 actions, 47 running 2025-03-14T05:42:25.8327377Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T05:42:25.8328490Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T05:42:25.8329311Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T05:42:25.8330310Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2025-03-14T05:42:25.8331393Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2025-03-14T05:42:25.8332404Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2025-03-14T05:42:25.8333393Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2025-03-14T05:42:25.8334425Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 8s local ... 2025-03-14T05:42:26.0398435Z 2025-03-14T05:42:26.0399260Z  2025-03-14T05:42:26.0399748Z  2025-03-14T05:42:26.0400177Z  2025-03-14T05:42:26.0400601Z  2025-03-14T05:42:26.0401018Z  2025-03-14T05:42:26.0401436Z  2025-03-14T05:42:26.0401855Z  2025-03-14T05:42:26.0402289Z  2025-03-14T05:42:26.0402883Z [9,524 / 15,235] 48 actions, 47 running 2025-03-14T05:42:26.0404210Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T05:42:26.0405443Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T05:42:26.0406312Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T05:42:26.0407193Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T05:42:26.0408251Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2025-03-14T05:42:26.0409276Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2025-03-14T05:42:26.0410251Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2025-03-14T05:42:26.0411237Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 8s local ... 2025-03-14T05:42:26.2490213Z 2025-03-14T05:42:26.2491059Z  2025-03-14T05:42:26.2491562Z  2025-03-14T05:42:26.2491978Z  2025-03-14T05:42:26.2492383Z  2025-03-14T05:42:26.2492787Z  2025-03-14T05:42:26.2493170Z  2025-03-14T05:42:26.2493630Z  2025-03-14T05:42:26.2494038Z  2025-03-14T05:42:26.2494631Z [9,538 / 15,235] 48 actions, 47 running 2025-03-14T05:42:26.2495568Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T05:42:26.2496647Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T05:42:26.2497498Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T05:42:26.2498448Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T05:42:26.2499481Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2025-03-14T05:42:26.2500458Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2025-03-14T05:42:26.2501452Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2025-03-14T05:42:26.2502459Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s8.cpp; 7s local ... 2025-03-14T05:42:26.4805762Z 2025-03-14T05:42:26.4840278Z  2025-03-14T05:42:26.4841303Z  2025-03-14T05:42:26.4841735Z  2025-03-14T05:42:26.4842495Z  2025-03-14T05:42:26.4842938Z  2025-03-14T05:42:26.4843361Z  2025-03-14T05:42:26.4843791Z  2025-03-14T05:42:26.4844251Z  2025-03-14T05:42:26.4845062Z [9,544 / 15,235] 48 actions, 47 running 2025-03-14T05:42:26.4845996Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T05:42:26.4847088Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T05:42:26.4847931Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T05:42:26.4848819Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T05:42:26.4849875Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2025-03-14T05:42:26.4850846Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local 2025-03-14T05:42:26.4851712Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2025-03-14T05:42:26.4852690Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 7s local ... 2025-03-14T05:42:26.7048019Z 2025-03-14T05:42:26.7048812Z  2025-03-14T05:42:26.7049320Z  2025-03-14T05:42:26.7049740Z  2025-03-14T05:42:26.7050155Z  2025-03-14T05:42:26.7050566Z  2025-03-14T05:42:26.7050989Z  2025-03-14T05:42:26.7051398Z  2025-03-14T05:42:26.7051794Z  2025-03-14T05:42:26.7052371Z [9,548 / 15,235] 48 actions running 2025-03-14T05:42:26.7053324Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T05:42:26.7054339Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T05:42:26.7055210Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T05:42:26.7056208Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T05:42:26.7057323Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T05:42:26.7058733Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2025-03-14T05:42:26.7059758Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 8s local 2025-03-14T05:42:26.7060787Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 7s local ... 2025-03-14T05:42:26.9093436Z 2025-03-14T05:42:26.9094255Z  2025-03-14T05:42:26.9094764Z  2025-03-14T05:42:26.9095182Z  2025-03-14T05:42:26.9095575Z  2025-03-14T05:42:26.9095973Z  2025-03-14T05:42:26.9096374Z  2025-03-14T05:42:26.9096769Z  2025-03-14T05:42:26.9097167Z  2025-03-14T05:42:26.9097772Z [9,551 / 15,235] 48 actions, 47 running 2025-03-14T05:42:26.9098678Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T05:42:26.9099701Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T05:42:26.9100558Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T05:42:26.9101543Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T05:42:26.9102595Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T05:42:26.9103608Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2025-03-14T05:42:26.9104528Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local 2025-03-14T05:42:26.9105521Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 7s local ... 2025-03-14T05:42:27.2634209Z 2025-03-14T05:42:27.2635030Z  2025-03-14T05:42:27.2635645Z  2025-03-14T05:42:27.2636073Z  2025-03-14T05:42:27.2636474Z  2025-03-14T05:42:27.2636858Z  2025-03-14T05:42:27.2637243Z  2025-03-14T05:42:27.2637639Z  2025-03-14T05:42:27.2638037Z  2025-03-14T05:42:27.2638638Z [9,555 / 15,235] 48 actions, 47 running 2025-03-14T05:42:27.2639509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T05:42:27.2640424Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T05:42:27.2641319Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T05:42:27.2642604Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T05:42:27.2643659Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T05:42:27.2644580Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2025-03-14T05:42:27.2645699Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local 2025-03-14T05:42:27.2646667Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local ... 2025-03-14T05:42:27.5056439Z 2025-03-14T05:42:27.5057231Z  2025-03-14T05:42:27.5057729Z  2025-03-14T05:42:27.5058136Z  2025-03-14T05:42:27.5058533Z  2025-03-14T05:42:27.5058966Z  2025-03-14T05:42:27.5059366Z  2025-03-14T05:42:27.5059757Z  2025-03-14T05:42:27.5060179Z  2025-03-14T05:42:27.5060757Z [9,557 / 15,235] 48 actions running 2025-03-14T05:42:27.5061725Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T05:42:27.5062820Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T05:42:27.5063712Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T05:42:27.5064681Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T05:42:27.5065959Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T05:42:27.5066971Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2025-03-14T05:42:27.5067963Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local 2025-03-14T05:42:27.5068983Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local ... 2025-03-14T05:42:27.9062662Z 2025-03-14T05:42:27.9063546Z  2025-03-14T05:42:27.9064044Z  2025-03-14T05:42:27.9064464Z  2025-03-14T05:42:27.9064850Z  2025-03-14T05:42:27.9065253Z  2025-03-14T05:42:27.9065841Z  2025-03-14T05:42:27.9066232Z  2025-03-14T05:42:27.9067135Z  2025-03-14T05:42:27.9067726Z [9,561 / 15,235] 48 actions running 2025-03-14T05:42:27.9068610Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T05:42:27.9069579Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T05:42:27.9070423Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T05:42:27.9071376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T05:42:27.9072406Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T05:42:27.9073416Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2025-03-14T05:42:27.9074402Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2025-03-14T05:42:27.9075427Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local ... 2025-03-14T05:42:28.1067596Z 2025-03-14T05:42:28.1068435Z  2025-03-14T05:42:28.1068929Z  2025-03-14T05:42:28.1069351Z  2025-03-14T05:42:28.1069756Z  2025-03-14T05:42:28.1070183Z  2025-03-14T05:42:28.1070581Z  2025-03-14T05:42:28.1070977Z  2025-03-14T05:42:28.1071376Z  2025-03-14T05:42:28.1071944Z [9,566 / 15,235] 48 actions running 2025-03-14T05:42:28.1072855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T05:42:28.1073879Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T05:42:28.1074717Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T05:42:28.1075677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T05:42:28.1076739Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T05:42:28.1077865Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2025-03-14T05:42:28.1078847Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2025-03-14T05:42:28.1079888Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 9s local ... 2025-03-14T05:42:28.3431693Z 2025-03-14T05:42:28.3432892Z  2025-03-14T05:42:28.3433401Z  2025-03-14T05:42:28.3433786Z  2025-03-14T05:42:28.3434165Z  2025-03-14T05:42:28.3434561Z  2025-03-14T05:42:28.3434883Z  2025-03-14T05:42:28.3435217Z  2025-03-14T05:42:28.3435617Z  2025-03-14T05:42:28.3436198Z [9,572 / 15,235] 48 actions, 47 running 2025-03-14T05:42:28.3437106Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T05:42:28.3438231Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T05:42:28.3439077Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T05:42:28.3440023Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T05:42:28.3441099Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T05:42:28.3442108Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2025-03-14T05:42:28.3443056Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2025-03-14T05:42:28.3444064Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 9s local ... 2025-03-14T05:42:28.6230394Z 2025-03-14T05:42:28.6231167Z  2025-03-14T05:42:28.6231587Z  2025-03-14T05:42:28.6231943Z  2025-03-14T05:42:28.6232305Z  2025-03-14T05:42:28.6232666Z  2025-03-14T05:42:28.6233028Z  2025-03-14T05:42:28.6233387Z  2025-03-14T05:42:28.6233742Z  2025-03-14T05:42:28.6234271Z [9,578 / 15,235] 48 actions, 47 running 2025-03-14T05:42:28.6235033Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T05:42:28.6235915Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T05:42:28.6236694Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T05:42:28.6237552Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T05:42:28.6238872Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T05:42:28.6239761Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2025-03-14T05:42:28.6240731Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local 2025-03-14T05:42:28.6241577Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local ... 2025-03-14T05:42:28.9077746Z 2025-03-14T05:42:28.9078580Z  2025-03-14T05:42:28.9079079Z  2025-03-14T05:42:28.9079493Z  2025-03-14T05:42:28.9079908Z  2025-03-14T05:42:28.9080324Z  2025-03-14T05:42:28.9080721Z  2025-03-14T05:42:28.9081118Z  2025-03-14T05:42:28.9081526Z  2025-03-14T05:42:28.9082110Z [9,578 / 15,235] 48 actions running 2025-03-14T05:42:28.9083028Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T05:42:28.9084063Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T05:42:28.9085147Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T05:42:28.9086111Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T05:42:28.9087168Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T05:42:28.9088157Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T05:42:28.9089111Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2025-03-14T05:42:28.9090269Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local ... 2025-03-14T05:42:29.3083354Z 2025-03-14T05:42:29.3084225Z  2025-03-14T05:42:29.3084931Z  2025-03-14T05:42:29.3085378Z  2025-03-14T05:42:29.3085785Z  2025-03-14T05:42:29.3086200Z  2025-03-14T05:42:29.3086625Z  2025-03-14T05:42:29.3087031Z  2025-03-14T05:42:29.3087444Z  2025-03-14T05:42:29.3088046Z [9,585 / 15,235] 48 actions running 2025-03-14T05:42:29.3089077Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T05:42:29.3090136Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T05:42:29.3091402Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T05:42:29.3092449Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T05:42:29.3093545Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T05:42:29.3094564Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T05:42:29.3095685Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2025-03-14T05:42:29.3096709Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2025-03-14T05:42:29.5088964Z 2025-03-14T05:42:29.5089790Z  2025-03-14T05:42:29.5090264Z  2025-03-14T05:42:29.5090655Z  2025-03-14T05:42:29.5091070Z  2025-03-14T05:42:29.5091497Z  2025-03-14T05:42:29.5091881Z  2025-03-14T05:42:29.5092260Z  2025-03-14T05:42:29.5092639Z  2025-03-14T05:42:29.5093204Z [9,588 / 15,235] 48 actions running 2025-03-14T05:42:29.5094081Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T05:42:29.5095027Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T05:42:29.5095863Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T05:42:29.5096788Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T05:42:29.5097835Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T05:42:29.5098943Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T05:42:29.5099878Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2025-03-14T05:42:29.5100878Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2025-03-14T05:42:29.7118702Z 2025-03-14T05:42:29.7119562Z  2025-03-14T05:42:29.7120072Z  2025-03-14T05:42:29.7120516Z  2025-03-14T05:42:29.7121306Z  2025-03-14T05:42:29.7121765Z  2025-03-14T05:42:29.7122216Z  2025-03-14T05:42:29.7122621Z  2025-03-14T05:42:29.7123055Z  2025-03-14T05:42:29.7123641Z [9,599 / 15,235] 48 actions, 47 running 2025-03-14T05:42:29.7124586Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T05:42:29.7125867Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T05:42:29.7126795Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T05:42:29.7127804Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T05:42:29.7128981Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T05:42:29.7130000Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T05:42:29.7131035Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local 2025-03-14T05:42:29.7132123Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2025-03-14T05:42:29.9471130Z 2025-03-14T05:42:29.9471983Z  2025-03-14T05:42:29.9472471Z  2025-03-14T05:42:29.9472845Z  2025-03-14T05:42:29.9473227Z  2025-03-14T05:42:29.9473619Z  2025-03-14T05:42:29.9474021Z  2025-03-14T05:42:29.9474430Z  2025-03-14T05:42:29.9474846Z  2025-03-14T05:42:29.9475455Z [9,614 / 15,235] 48 actions, 47 running 2025-03-14T05:42:29.9476439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T05:42:29.9477515Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T05:42:29.9478379Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T05:42:29.9479396Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T05:42:29.9480541Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T05:42:29.9481586Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T05:42:29.9482627Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2025-03-14T05:42:29.9484043Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2025-03-14T05:42:30.2067165Z 2025-03-14T05:42:30.2068020Z  2025-03-14T05:42:30.2068540Z  2025-03-14T05:42:30.2068963Z  2025-03-14T05:42:30.2069497Z  2025-03-14T05:42:30.2069903Z  2025-03-14T05:42:30.2070297Z  2025-03-14T05:42:30.2070697Z  2025-03-14T05:42:30.2071119Z  2025-03-14T05:42:30.2071712Z [9,618 / 15,235] 48 actions, 47 running 2025-03-14T05:42:30.2072545Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T05:42:30.2073506Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T05:42:30.2074547Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T05:42:30.2075511Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T05:42:30.2076625Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T05:42:30.2077608Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T05:42:30.2078559Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2025-03-14T05:42:30.2079510Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 10s local ... 2025-03-14T05:42:30.5093976Z 2025-03-14T05:42:30.5094816Z  2025-03-14T05:42:30.5095290Z  2025-03-14T05:42:30.5095620Z  2025-03-14T05:42:30.5096036Z  2025-03-14T05:42:30.5096436Z  2025-03-14T05:42:30.5096818Z  2025-03-14T05:42:30.5097207Z  2025-03-14T05:42:30.5097589Z  2025-03-14T05:42:30.5098153Z [9,621 / 15,235] 48 actions running 2025-03-14T05:42:30.5099071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T05:42:30.5100097Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T05:42:30.5101400Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T05:42:30.5102390Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T05:42:30.5103442Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T05:42:30.5104416Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T05:42:30.5105405Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2025-03-14T05:42:30.5106275Z Compiling src/cpu/rnn/ref_rnn.cpp; 6s local ... 2025-03-14T05:42:30.7873361Z 2025-03-14T05:42:30.7874385Z  2025-03-14T05:42:30.7874888Z  2025-03-14T05:42:30.7875323Z  2025-03-14T05:42:30.7875763Z  2025-03-14T05:42:30.7876190Z  2025-03-14T05:42:30.7876628Z  2025-03-14T05:42:30.7877066Z  2025-03-14T05:42:30.7877478Z  2025-03-14T05:42:30.7878232Z [9,622 / 15,235] 48 actions, 47 running 2025-03-14T05:42:30.7879280Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T05:42:30.7880467Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T05:42:30.7881457Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T05:42:30.7882553Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T05:42:30.7883761Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T05:42:30.7885038Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T05:42:30.7886161Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T05:42:30.7887138Z Compiling src/cpu/rnn/ref_rnn.cpp; 6s local ... 2025-03-14T05:42:31.0170782Z 2025-03-14T05:42:31.0171624Z  2025-03-14T05:42:31.0172124Z  2025-03-14T05:42:31.0172558Z  2025-03-14T05:42:31.0173015Z  2025-03-14T05:42:31.0173451Z  2025-03-14T05:42:31.0173879Z  2025-03-14T05:42:31.0174309Z  2025-03-14T05:42:31.0174733Z  2025-03-14T05:42:31.0175391Z [9,626 / 15,235] 48 actions, 47 running 2025-03-14T05:42:31.0176393Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T05:42:31.0177795Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T05:42:31.0178705Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T05:42:31.0179750Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T05:42:31.0180916Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T05:42:31.0182018Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T05:42:31.0183109Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T05:42:31.0184065Z Compiling src/cpu/rnn/ref_rnn.cpp; 6s local ... 2025-03-14T05:42:31.3101118Z 2025-03-14T05:42:31.3101990Z  2025-03-14T05:42:31.3102515Z  2025-03-14T05:42:31.3102951Z  2025-03-14T05:42:31.3103369Z  2025-03-14T05:42:31.3103797Z  2025-03-14T05:42:31.3104260Z  2025-03-14T05:42:31.3104696Z  2025-03-14T05:42:31.3105138Z  2025-03-14T05:42:31.3105724Z [9,629 / 15,235] 48 actions running 2025-03-14T05:42:31.3106732Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T05:42:31.3107758Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T05:42:31.3108639Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T05:42:31.3109525Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T05:42:31.3110527Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T05:42:31.3111464Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T05:42:31.3112382Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T05:42:31.3113218Z Compiling src/cpu/rnn/ref_rnn.cpp; 6s local ... 2025-03-14T05:42:31.5107100Z 2025-03-14T05:42:31.5107912Z  2025-03-14T05:42:31.5108754Z  2025-03-14T05:42:31.5109164Z  2025-03-14T05:42:31.5109573Z  2025-03-14T05:42:31.5109962Z  2025-03-14T05:42:31.5110379Z  2025-03-14T05:42:31.5110775Z  2025-03-14T05:42:31.5111201Z  2025-03-14T05:42:31.5111785Z [9,632 / 15,235] 48 actions running 2025-03-14T05:42:31.5112701Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T05:42:31.5113765Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T05:42:31.5114653Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T05:42:31.5115672Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T05:42:31.5116798Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T05:42:31.5117857Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T05:42:31.5118883Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T05:42:31.5119777Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local ... 2025-03-14T05:42:31.7167156Z 2025-03-14T05:42:31.7168027Z  2025-03-14T05:42:31.7168515Z  2025-03-14T05:42:31.7168932Z  2025-03-14T05:42:31.7169370Z  2025-03-14T05:42:31.7169785Z  2025-03-14T05:42:31.7170198Z  2025-03-14T05:42:31.7170618Z  2025-03-14T05:42:31.7171020Z  2025-03-14T05:42:31.7171648Z [9,633 / 15,235] 48 actions, 47 running 2025-03-14T05:42:31.7172580Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T05:42:31.7173624Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T05:42:31.7174666Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T05:42:31.7175725Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T05:42:31.7176802Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T05:42:31.7177827Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T05:42:31.7178817Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T05:42:31.7180146Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local ... 2025-03-14T05:42:31.9866941Z 2025-03-14T05:42:31.9867714Z  2025-03-14T05:42:31.9868179Z  2025-03-14T05:42:31.9868615Z  2025-03-14T05:42:31.9869066Z  2025-03-14T05:42:31.9869444Z  2025-03-14T05:42:31.9869823Z  2025-03-14T05:42:31.9870236Z  2025-03-14T05:42:31.9870621Z  2025-03-14T05:42:31.9871228Z [9,638 / 15,235] 48 actions, 47 running 2025-03-14T05:42:31.9872143Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T05:42:31.9873172Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T05:42:31.9874002Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T05:42:31.9874944Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T05:42:31.9876040Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T05:42:31.9877168Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T05:42:31.9878182Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2025-03-14T05:42:31.9879038Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local ... 2025-03-14T05:42:32.2126377Z 2025-03-14T05:42:32.2127233Z  2025-03-14T05:42:32.2127688Z  2025-03-14T05:42:32.2128070Z  2025-03-14T05:42:32.2128448Z  2025-03-14T05:42:32.2128820Z  2025-03-14T05:42:32.2129221Z  2025-03-14T05:42:32.2129627Z  2025-03-14T05:42:32.2130133Z  2025-03-14T05:42:32.2130741Z [9,640 / 15,235] 48 actions, 47 running 2025-03-14T05:42:32.2131645Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T05:42:32.2132684Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T05:42:32.2133897Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T05:42:32.2134904Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T05:42:32.2136003Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T05:42:32.2136995Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T05:42:32.2137987Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2025-03-14T05:42:32.2138855Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local ... 2025-03-14T05:42:32.4824146Z 2025-03-14T05:42:32.4825007Z  2025-03-14T05:42:32.4825493Z  2025-03-14T05:42:32.4825901Z  2025-03-14T05:42:32.4826317Z  2025-03-14T05:42:32.4826728Z  2025-03-14T05:42:32.4827103Z  2025-03-14T05:42:32.4827473Z  2025-03-14T05:42:32.4827879Z  2025-03-14T05:42:32.4828477Z [9,642 / 15,235] 48 actions, 47 running 2025-03-14T05:42:32.4829415Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T05:42:32.4830489Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T05:42:32.4831395Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T05:42:32.4832315Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T05:42:32.4833304Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T05:42:32.4834210Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T05:42:32.4835254Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2025-03-14T05:42:32.4836096Z Compiling src/cpu/rnn/ref_rnn.cpp; 7s local ... 2025-03-14T05:42:32.7116834Z 2025-03-14T05:42:32.7117680Z  2025-03-14T05:42:32.7118162Z  2025-03-14T05:42:32.7118563Z  2025-03-14T05:42:32.7118962Z  2025-03-14T05:42:32.7119362Z  2025-03-14T05:42:32.7119778Z  2025-03-14T05:42:32.7120181Z  2025-03-14T05:42:32.7120560Z  2025-03-14T05:42:32.7121138Z [9,642 / 15,235] 48 actions running 2025-03-14T05:42:32.7122065Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T05:42:32.7123438Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T05:42:32.7124280Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T05:42:32.7125391Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T05:42:32.7126433Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T05:42:32.7127459Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2025-03-14T05:42:32.7128446Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2025-03-14T05:42:32.7129264Z Compiling src/cpu/rnn/ref_rnn.cpp; 8s local ... 2025-03-14T05:42:32.9123251Z 2025-03-14T05:42:32.9124141Z  2025-03-14T05:42:32.9124637Z  2025-03-14T05:42:32.9125193Z  2025-03-14T05:42:32.9125605Z  2025-03-14T05:42:32.9126024Z  2025-03-14T05:42:32.9126474Z  2025-03-14T05:42:32.9126891Z  2025-03-14T05:42:32.9127331Z  2025-03-14T05:42:32.9127901Z [9,646 / 15,235] 48 actions running 2025-03-14T05:42:32.9128893Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T05:42:32.9129977Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T05:42:32.9130836Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T05:42:32.9131830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T05:42:32.9132889Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T05:42:32.9134070Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2025-03-14T05:42:32.9135040Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 15s local 2025-03-14T05:42:32.9135873Z Compiling src/cpu/rnn/ref_rnn.cpp; 8s local ... 2025-03-14T05:42:33.1176463Z 2025-03-14T05:42:33.1177279Z  2025-03-14T05:42:33.1178106Z  2025-03-14T05:42:33.1178529Z  2025-03-14T05:42:33.1178959Z  2025-03-14T05:42:33.1179353Z  2025-03-14T05:42:33.1179745Z  2025-03-14T05:42:33.1180185Z  2025-03-14T05:42:33.1180569Z  2025-03-14T05:42:33.1181253Z [9,651 / 15,235] 48 actions, 47 running 2025-03-14T05:42:33.1182221Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T05:42:33.1183245Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T05:42:33.1184160Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T05:42:33.1185153Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T05:42:33.1186203Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T05:42:33.1187212Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2025-03-14T05:42:33.1188210Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 15s local 2025-03-14T05:42:33.1189113Z Compiling src/cpu/rnn/ref_rnn.cpp; 8s local ... 2025-03-14T05:42:33.3262059Z 2025-03-14T05:42:33.3262912Z  2025-03-14T05:42:33.3263401Z  2025-03-14T05:42:33.3263831Z  2025-03-14T05:42:33.3264225Z  2025-03-14T05:42:33.3264626Z  2025-03-14T05:42:33.3265023Z  2025-03-14T05:42:33.3265718Z  2025-03-14T05:42:33.3266139Z  2025-03-14T05:42:33.3266733Z [9,654 / 15,235] 48 actions, 47 running 2025-03-14T05:42:33.3267669Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T05:42:33.3268650Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T05:42:33.3269453Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T05:42:33.3270401Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T05:42:33.3271519Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T05:42:33.3272413Z Compiling src/cpu/rnn/ref_rnn.cpp; 8s local 2025-03-14T05:42:33.3273166Z Compiling src/cpu/simple_resampling.cpp; 7s local 2025-03-14T05:42:33.3274421Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 6s local ... 2025-03-14T05:42:33.5663087Z 2025-03-14T05:42:33.5664399Z  2025-03-14T05:42:33.5665083Z  2025-03-14T05:42:33.5665709Z  2025-03-14T05:42:33.5666084Z  2025-03-14T05:42:33.5666425Z  2025-03-14T05:42:33.5666783Z  2025-03-14T05:42:33.5667138Z  2025-03-14T05:42:33.5667486Z  2025-03-14T05:42:33.5667981Z [9,656 / 15,235] 48 actions, 47 running 2025-03-14T05:42:33.5668728Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T05:42:33.5669683Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T05:42:33.5670471Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T05:42:33.5671444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T05:42:33.5672555Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 16s local 2025-03-14T05:42:33.5673422Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2025-03-14T05:42:33.5674167Z Compiling src/cpu/simple_resampling.cpp; 7s local 2025-03-14T05:42:33.5674994Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 7s local ... 2025-03-14T05:42:33.8236717Z 2025-03-14T05:42:33.8237851Z  2025-03-14T05:42:33.8238373Z  2025-03-14T05:42:33.8238799Z  2025-03-14T05:42:33.8239205Z  2025-03-14T05:42:33.8239615Z  2025-03-14T05:42:33.8240029Z  2025-03-14T05:42:33.8240432Z  2025-03-14T05:42:33.8240883Z  2025-03-14T05:42:33.8241491Z [9,658 / 15,235] 48 actions, 47 running 2025-03-14T05:42:33.8242445Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T05:42:33.8243500Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T05:42:33.8244394Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T05:42:33.8245926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T05:42:33.8247094Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 16s local 2025-03-14T05:42:33.8247976Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2025-03-14T05:42:33.8248694Z Compiling src/cpu/simple_resampling.cpp; 8s local 2025-03-14T05:42:33.8249604Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 7s local ... 2025-03-14T05:42:34.0772251Z 2025-03-14T05:42:34.0773117Z  2025-03-14T05:42:34.0773626Z  2025-03-14T05:42:34.0774013Z  2025-03-14T05:42:34.0774386Z  2025-03-14T05:42:34.0774741Z  2025-03-14T05:42:34.0775123Z  2025-03-14T05:42:34.0775501Z  2025-03-14T05:42:34.0775867Z  2025-03-14T05:42:34.0776425Z [9,662 / 15,235] 48 actions, 47 running 2025-03-14T05:42:34.0777442Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T05:42:34.0778424Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T05:42:34.0779224Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T05:42:34.0780130Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T05:42:34.0780959Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2025-03-14T05:42:34.0781643Z Compiling src/cpu/simple_resampling.cpp; 8s local 2025-03-14T05:42:34.0782414Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 7s local 2025-03-14T05:42:34.0783327Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 7s local ... 2025-03-14T05:42:34.3134567Z 2025-03-14T05:42:34.3136252Z  2025-03-14T05:42:34.3136818Z  2025-03-14T05:42:34.3137259Z  2025-03-14T05:42:34.3137666Z  2025-03-14T05:42:34.3138052Z  2025-03-14T05:42:34.3138452Z  2025-03-14T05:42:34.3138879Z  2025-03-14T05:42:34.3139309Z  2025-03-14T05:42:34.3139932Z [9,666 / 15,235] 48 actions, 47 running 2025-03-14T05:42:34.3140902Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T05:42:34.3144175Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T05:42:34.3145068Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T05:42:34.3146066Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T05:42:34.3147038Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2025-03-14T05:42:34.3147805Z Compiling src/cpu/simple_resampling.cpp; 8s local 2025-03-14T05:42:34.3148686Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 7s local 2025-03-14T05:42:34.3149716Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 7s local ... 2025-03-14T05:42:34.6212918Z 2025-03-14T05:42:34.6213754Z  2025-03-14T05:42:34.6214259Z  2025-03-14T05:42:34.6214698Z  2025-03-14T05:42:34.6215124Z  2025-03-14T05:42:34.6215568Z  2025-03-14T05:42:34.6216009Z  2025-03-14T05:42:34.6216457Z  2025-03-14T05:42:34.6216944Z  2025-03-14T05:42:34.6217579Z [9,668 / 15,235] 48 actions, 47 running 2025-03-14T05:42:34.6218610Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T05:42:34.6219751Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T05:42:34.6220706Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T05:42:34.6221779Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T05:42:34.6222794Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2025-03-14T05:42:34.6223605Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T05:42:34.6224535Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 8s local 2025-03-14T05:42:34.6225627Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 7s local ... 2025-03-14T05:42:34.9048844Z 2025-03-14T05:42:34.9049839Z  2025-03-14T05:42:34.9050295Z  2025-03-14T05:42:34.9050699Z  2025-03-14T05:42:34.9051087Z  2025-03-14T05:42:34.9051954Z  2025-03-14T05:42:34.9052369Z  2025-03-14T05:42:34.9052803Z  2025-03-14T05:42:34.9053193Z  2025-03-14T05:42:34.9053769Z [9,671 / 15,235] 48 actions, 47 running 2025-03-14T05:42:34.9054714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T05:42:34.9055681Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T05:42:34.9056510Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T05:42:34.9057454Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T05:42:34.9058341Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2025-03-14T05:42:34.9059061Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T05:42:34.9059942Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 8s local 2025-03-14T05:42:34.9060957Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 7s local ... 2025-03-14T05:42:35.1142295Z 2025-03-14T05:42:35.1143335Z  2025-03-14T05:42:35.1143793Z  2025-03-14T05:42:35.1144205Z  2025-03-14T05:42:35.1144593Z  2025-03-14T05:42:35.1144986Z  2025-03-14T05:42:35.1145398Z  2025-03-14T05:42:35.1145796Z  2025-03-14T05:42:35.1146183Z  2025-03-14T05:42:35.1146736Z [9,673 / 15,235] 48 actions running 2025-03-14T05:42:35.1147680Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T05:42:35.1148691Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T05:42:35.1149601Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T05:42:35.1150591Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T05:42:35.1151548Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2025-03-14T05:42:35.1152266Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T05:42:35.1153123Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 8s local 2025-03-14T05:42:35.1154191Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 8s local ... 2025-03-14T05:42:35.3344004Z 2025-03-14T05:42:35.3344970Z  2025-03-14T05:42:35.3345413Z  2025-03-14T05:42:35.3345799Z  2025-03-14T05:42:35.3346158Z  2025-03-14T05:42:35.3346526Z  2025-03-14T05:42:35.3346915Z  2025-03-14T05:42:35.3347297Z  2025-03-14T05:42:35.3347671Z  2025-03-14T05:42:35.3348231Z [9,678 / 15,235] 48 actions, 47 running 2025-03-14T05:42:35.3349122Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T05:42:35.3350116Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T05:42:35.3350958Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T05:42:35.3351868Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T05:42:35.3352775Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2025-03-14T05:42:35.3353567Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T05:42:35.3354396Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 8s local 2025-03-14T05:42:35.3355337Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 8s local ... 2025-03-14T05:42:35.5515805Z 2025-03-14T05:42:35.5516831Z  2025-03-14T05:42:35.5517254Z  2025-03-14T05:42:35.5517598Z  2025-03-14T05:42:35.5517950Z  2025-03-14T05:42:35.5518301Z  2025-03-14T05:42:35.5518632Z  2025-03-14T05:42:35.5518981Z  2025-03-14T05:42:35.5519318Z  2025-03-14T05:42:35.5519825Z [9,680 / 15,235] 48 actions, 47 running 2025-03-14T05:42:35.5520626Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T05:42:35.5521578Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T05:42:35.5522375Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T05:42:35.5523283Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T05:42:35.5524487Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2025-03-14T05:42:35.5525347Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T05:42:35.5526136Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 9s local 2025-03-14T05:42:35.5526998Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 8s local ... 2025-03-14T05:42:35.8775818Z 2025-03-14T05:42:35.8776819Z  2025-03-14T05:42:35.8777307Z  2025-03-14T05:42:35.8777727Z  2025-03-14T05:42:35.8778131Z  2025-03-14T05:42:35.8778570Z  2025-03-14T05:42:35.8778982Z  2025-03-14T05:42:35.8779395Z  2025-03-14T05:42:35.8779805Z  2025-03-14T05:42:35.8780432Z [9,683 / 15,235] 48 actions, 47 running 2025-03-14T05:42:35.8781409Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T05:42:35.8782610Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T05:42:35.8783476Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T05:42:35.8784536Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T05:42:35.8785464Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2025-03-14T05:42:35.8786200Z Compiling src/cpu/simple_resampling.cpp; 10s local 2025-03-14T05:42:35.8787067Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 9s local 2025-03-14T05:42:35.8788074Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 8s local ... 2025-03-14T05:42:36.0789131Z 2025-03-14T05:42:36.0790096Z  2025-03-14T05:42:36.0790587Z  2025-03-14T05:42:36.0791000Z  2025-03-14T05:42:36.0791399Z  2025-03-14T05:42:36.0791772Z  2025-03-14T05:42:36.0792175Z  2025-03-14T05:42:36.0792590Z  2025-03-14T05:42:36.0792997Z  2025-03-14T05:42:36.0793607Z [9,686 / 15,235] 48 actions, 47 running 2025-03-14T05:42:36.0794544Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T05:42:36.0795631Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T05:42:36.0796966Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T05:42:36.0797906Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T05:42:36.0798875Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2025-03-14T05:42:36.0799667Z Compiling src/cpu/simple_resampling.cpp; 10s local 2025-03-14T05:42:36.0800535Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 9s local 2025-03-14T05:42:36.0801467Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 9s local ... 2025-03-14T05:42:36.2963638Z 2025-03-14T05:42:36.2964546Z  2025-03-14T05:42:36.2965134Z  2025-03-14T05:42:36.2965713Z  2025-03-14T05:42:36.2966105Z  2025-03-14T05:42:36.2966502Z  2025-03-14T05:42:36.2966861Z  2025-03-14T05:42:36.2967261Z  2025-03-14T05:42:36.2967670Z  2025-03-14T05:42:36.2968273Z [9,688 / 15,235] 48 actions, 47 running 2025-03-14T05:42:36.2969184Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T05:42:36.2970203Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T05:42:36.2971072Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T05:42:36.2971997Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T05:42:36.2972939Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2025-03-14T05:42:36.2973701Z Compiling src/cpu/simple_resampling.cpp; 10s local 2025-03-14T05:42:36.2974540Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 9s local 2025-03-14T05:42:36.2975524Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 9s local ... 2025-03-14T05:42:36.5155017Z 2025-03-14T05:42:36.5156013Z  2025-03-14T05:42:36.5156517Z  2025-03-14T05:42:36.5156909Z  2025-03-14T05:42:36.5157353Z  2025-03-14T05:42:36.5157748Z  2025-03-14T05:42:36.5158138Z  2025-03-14T05:42:36.5158527Z  2025-03-14T05:42:36.5159332Z  2025-03-14T05:42:36.5159935Z [9,689 / 15,235] 48 actions running 2025-03-14T05:42:36.5160943Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T05:42:36.5161998Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T05:42:36.5162897Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T05:42:36.5163907Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T05:42:36.5165014Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T05:42:36.5166051Z Compiling src/cpu/simple_resampling.cpp; 10s local 2025-03-14T05:42:36.5166972Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 9s local 2025-03-14T05:42:36.5167932Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 9s local ... 2025-03-14T05:42:36.7561790Z 2025-03-14T05:42:36.7562791Z  2025-03-14T05:42:36.7563300Z  2025-03-14T05:42:36.7563678Z  2025-03-14T05:42:36.7564079Z  2025-03-14T05:42:36.7564515Z  2025-03-14T05:42:36.7565084Z  2025-03-14T05:42:36.7568088Z  2025-03-14T05:42:36.7568519Z  2025-03-14T05:42:36.7569117Z [9,691 / 15,235] 48 actions, 47 running 2025-03-14T05:42:36.7570075Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T05:42:36.7571168Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T05:42:36.7572092Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T05:42:36.7573133Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T05:42:36.7574069Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T05:42:36.7574797Z Compiling src/cpu/simple_resampling.cpp; 11s local 2025-03-14T05:42:36.7575659Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 10s local 2025-03-14T05:42:36.7576703Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 9s local ... 2025-03-14T05:42:37.1163977Z 2025-03-14T05:42:37.1165027Z  2025-03-14T05:42:37.1165746Z  2025-03-14T05:42:37.1166477Z  2025-03-14T05:42:37.1166893Z  2025-03-14T05:42:37.1167299Z  2025-03-14T05:42:37.1167711Z  2025-03-14T05:42:37.1168129Z  2025-03-14T05:42:37.1168516Z  2025-03-14T05:42:37.1169060Z [9,693 / 15,235] 48 actions running 2025-03-14T05:42:37.1169961Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T05:42:37.1170961Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T05:42:37.1171819Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T05:42:37.1172762Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T05:42:37.1173689Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T05:42:37.1174482Z Compiling src/cpu/simple_resampling.cpp; 11s local 2025-03-14T05:42:37.1175433Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 10s local 2025-03-14T05:42:37.1176481Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local ... 2025-03-14T05:42:37.3173809Z 2025-03-14T05:42:37.3174804Z  2025-03-14T05:42:37.3175439Z  2025-03-14T05:42:37.3175981Z  2025-03-14T05:42:37.3176492Z  2025-03-14T05:42:37.3177110Z  2025-03-14T05:42:37.3177635Z  2025-03-14T05:42:37.3280273Z  2025-03-14T05:42:37.3281379Z  2025-03-14T05:42:37.3283960Z [9,696 / 15,235] 48 actions, 47 running 2025-03-14T05:42:37.3284959Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T05:42:37.3285963Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T05:42:37.3286904Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T05:42:37.3287878Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T05:42:37.3288827Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T05:42:37.3290026Z Compiling src/cpu/simple_resampling.cpp; 11s local 2025-03-14T05:42:37.3290959Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 10s local 2025-03-14T05:42:37.3292016Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local ... 2025-03-14T05:42:37.5613974Z 2025-03-14T05:42:37.5614870Z  2025-03-14T05:42:37.5615681Z  2025-03-14T05:42:37.5616851Z  2025-03-14T05:42:37.5617336Z  2025-03-14T05:42:37.5617773Z  2025-03-14T05:42:37.5618159Z  2025-03-14T05:42:37.5618567Z  2025-03-14T05:42:37.5618989Z  2025-03-14T05:42:37.5619621Z [9,700 / 15,235] 48 actions, 47 running 2025-03-14T05:42:37.5620561Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T05:42:37.5621618Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T05:42:37.5622528Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T05:42:37.5623532Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T05:42:37.5624561Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T05:42:37.5625392Z Compiling src/cpu/simple_resampling.cpp; 11s local 2025-03-14T05:42:37.5626336Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 11s local 2025-03-14T05:42:37.5627424Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local ... 2025-03-14T05:42:37.8112145Z 2025-03-14T05:42:37.8113098Z  2025-03-14T05:42:37.8113796Z  2025-03-14T05:42:37.8114197Z  2025-03-14T05:42:37.8114765Z  2025-03-14T05:42:37.8115310Z  2025-03-14T05:42:37.8115849Z  2025-03-14T05:42:37.8116390Z  2025-03-14T05:42:37.8116929Z  2025-03-14T05:42:37.8117664Z [9,702 / 15,235] 48 actions, 47 running 2025-03-14T05:42:37.8118727Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T05:42:37.8119851Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T05:42:37.8120873Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T05:42:37.8121972Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T05:42:37.8123470Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T05:42:37.8124385Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T05:42:37.8125503Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 11s local 2025-03-14T05:42:37.8126637Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local ... 2025-03-14T05:42:38.0576961Z 2025-03-14T05:42:38.0577834Z  2025-03-14T05:42:38.0578376Z  2025-03-14T05:42:38.0578784Z  2025-03-14T05:42:38.0579189Z  2025-03-14T05:42:38.0579604Z  2025-03-14T05:42:38.0580028Z  2025-03-14T05:42:38.0580418Z  2025-03-14T05:42:38.0580806Z  2025-03-14T05:42:38.0581406Z [9,708 / 15,235] 48 actions, 47 running 2025-03-14T05:42:38.0582357Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T05:42:38.0583406Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T05:42:38.0584230Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T05:42:38.0585176Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T05:42:38.0586044Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T05:42:38.0586772Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T05:42:38.0587609Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 11s local 2025-03-14T05:42:38.0588584Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local ... 2025-03-14T05:42:38.2784247Z 2025-03-14T05:42:38.2785513Z  2025-03-14T05:42:38.2786023Z  2025-03-14T05:42:38.2786421Z  2025-03-14T05:42:38.2786804Z  2025-03-14T05:42:38.2787179Z  2025-03-14T05:42:38.2787539Z  2025-03-14T05:42:38.2787907Z  2025-03-14T05:42:38.2788265Z  2025-03-14T05:42:38.2788819Z [9,709 / 15,235] 48 actions, 47 running 2025-03-14T05:42:38.2790145Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T05:42:38.2791216Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T05:42:38.2792053Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T05:42:38.2792993Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T05:42:38.2793910Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T05:42:38.2794650Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T05:42:38.2795517Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 11s local 2025-03-14T05:42:38.2796414Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local ... 2025-03-14T05:42:38.5076593Z 2025-03-14T05:42:38.5077708Z  2025-03-14T05:42:38.5078136Z  2025-03-14T05:42:38.5078490Z  2025-03-14T05:42:38.5078835Z  2025-03-14T05:42:38.5079181Z  2025-03-14T05:42:38.5079535Z  2025-03-14T05:42:38.5079877Z  2025-03-14T05:42:38.5080269Z  2025-03-14T05:42:38.5080817Z [9,710 / 15,235] 48 actions, 47 running 2025-03-14T05:42:38.5081819Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T05:42:38.5082761Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T05:42:38.5083563Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T05:42:38.5084476Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T05:42:38.5085482Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T05:42:38.5086136Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T05:42:38.5086891Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 11s local 2025-03-14T05:42:38.5087846Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local ... 2025-03-14T05:42:38.7176185Z 2025-03-14T05:42:38.7177042Z  2025-03-14T05:42:38.7177526Z  2025-03-14T05:42:38.7177930Z  2025-03-14T05:42:38.7178349Z  2025-03-14T05:42:38.7178741Z  2025-03-14T05:42:38.7179535Z  2025-03-14T05:42:38.7179912Z  2025-03-14T05:42:38.7180299Z  2025-03-14T05:42:38.7180830Z [9,713 / 15,235] 48 actions running 2025-03-14T05:42:38.7181731Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T05:42:38.7182705Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T05:42:38.7183528Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T05:42:38.7184542Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T05:42:38.7185467Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T05:42:38.7186184Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T05:42:38.7187037Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 12s local 2025-03-14T05:42:38.7187988Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local ... 2025-03-14T05:42:39.1084558Z 2025-03-14T05:42:39.1085717Z  2025-03-14T05:42:39.1086303Z  2025-03-14T05:42:39.1086836Z  2025-03-14T05:42:39.1087315Z  2025-03-14T05:42:39.1087771Z  2025-03-14T05:42:39.1088152Z  2025-03-14T05:42:39.1088589Z  2025-03-14T05:42:39.1089067Z  2025-03-14T05:42:39.1089680Z [9,716 / 15,235] 48 actions, 47 running 2025-03-14T05:42:39.1090597Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T05:42:39.1091605Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T05:42:39.1092433Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T05:42:39.1093372Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T05:42:39.1094337Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T05:42:39.1095125Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T05:42:39.1095989Z Compiling src/cpu/x64/brgemm/jit_brdgmm_kernel.cpp; 12s local 2025-03-14T05:42:39.1097334Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2025-03-14T05:42:39.3183880Z 2025-03-14T05:42:39.3184881Z  2025-03-14T05:42:39.3185340Z  2025-03-14T05:42:39.3187317Z  2025-03-14T05:42:39.3190304Z  2025-03-14T05:42:39.3193154Z  2025-03-14T05:42:39.3196106Z  2025-03-14T05:42:39.3199057Z  2025-03-14T05:42:39.3200778Z  2025-03-14T05:42:39.3201578Z [9,718 / 15,235] 48 actions running 2025-03-14T05:42:39.3202648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T05:42:39.3203836Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T05:42:39.3205030Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T05:42:39.3206106Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T05:42:39.3207145Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T05:42:39.3208192Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T05:42:39.3209169Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2025-03-14T05:42:39.3210322Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T05:42:39.6336890Z 2025-03-14T05:42:39.6338309Z  2025-03-14T05:42:39.6339035Z  2025-03-14T05:42:39.6340103Z  2025-03-14T05:42:39.6340547Z  2025-03-14T05:42:39.6340928Z  2025-03-14T05:42:39.6341320Z  2025-03-14T05:42:39.6341851Z  2025-03-14T05:42:39.6342388Z  2025-03-14T05:42:39.6343066Z [9,722 / 15,235] 48 actions, 47 running 2025-03-14T05:42:39.6344038Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T05:42:39.6345074Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T05:42:39.6345955Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T05:42:39.6346940Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T05:42:39.6347906Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T05:42:39.6349022Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T05:42:39.6349916Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2025-03-14T05:42:39.6350692Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T05:42:39.9191392Z 2025-03-14T05:42:39.9192741Z  2025-03-14T05:42:39.9193253Z  2025-03-14T05:42:39.9193648Z  2025-03-14T05:42:39.9194057Z  2025-03-14T05:42:39.9194466Z  2025-03-14T05:42:39.9194873Z  2025-03-14T05:42:39.9195266Z  2025-03-14T05:42:39.9195663Z  2025-03-14T05:42:39.9196252Z [9,727 / 15,235] 48 actions running 2025-03-14T05:42:39.9197210Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T05:42:39.9198231Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T05:42:39.9199109Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T05:42:39.9200107Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T05:42:39.9201043Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T05:42:39.9201805Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T05:42:39.9202677Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2025-03-14T05:42:39.9203454Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T05:42:40.1195974Z 2025-03-14T05:42:40.1196802Z  2025-03-14T05:42:40.1197298Z  2025-03-14T05:42:40.1197717Z  2025-03-14T05:42:40.1198141Z  2025-03-14T05:42:40.1198555Z  2025-03-14T05:42:40.1198963Z  2025-03-14T05:42:40.1199377Z  2025-03-14T05:42:40.1199797Z  2025-03-14T05:42:40.1200364Z [9,729 / 15,235] 48 actions running 2025-03-14T05:42:40.1201315Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T05:42:40.1202566Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T05:42:40.1203765Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T05:42:40.1204884Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T05:42:40.1205649Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T05:42:40.1206284Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T05:42:40.1207029Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2025-03-14T05:42:40.1207829Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T05:42:40.3323397Z 2025-03-14T05:42:40.3324998Z  2025-03-14T05:42:40.3326018Z  2025-03-14T05:42:40.3326576Z  2025-03-14T05:42:40.3327179Z  2025-03-14T05:42:40.3328682Z  2025-03-14T05:42:40.3329214Z  2025-03-14T05:42:40.3329689Z  2025-03-14T05:42:40.3331159Z  2025-03-14T05:42:40.3331904Z [9,731 / 15,235] 48 actions, 47 running 2025-03-14T05:42:40.3332969Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T05:42:40.3335461Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T05:42:40.3336549Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T05:42:40.3339477Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T05:42:40.3340719Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T05:42:40.3342740Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T05:42:40.3343897Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2025-03-14T05:42:40.3344892Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T05:42:40.7063781Z 2025-03-14T05:42:40.7064885Z  2025-03-14T05:42:40.7066020Z  2025-03-14T05:42:40.7067776Z  2025-03-14T05:42:40.7068314Z  2025-03-14T05:42:40.7069724Z  2025-03-14T05:42:40.7070288Z  2025-03-14T05:42:40.7071002Z  2025-03-14T05:42:40.7071497Z  2025-03-14T05:42:40.7072132Z [9,735 / 15,235] 48 actions, 47 running 2025-03-14T05:42:40.7074115Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T05:42:40.7075762Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T05:42:40.7077019Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T05:42:40.7078044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T05:42:40.7079023Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T05:42:40.7080844Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T05:42:40.7081878Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2025-03-14T05:42:40.7083724Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:42:40.9204272Z 2025-03-14T05:42:40.9205264Z  2025-03-14T05:42:40.9205774Z  2025-03-14T05:42:40.9206193Z  2025-03-14T05:42:40.9206621Z  2025-03-14T05:42:40.9207041Z  2025-03-14T05:42:40.9207450Z  2025-03-14T05:42:40.9207851Z  2025-03-14T05:42:40.9208257Z  2025-03-14T05:42:40.9208885Z [9,736 / 15,235] 48 actions running 2025-03-14T05:42:40.9209813Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T05:42:40.9210836Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T05:42:40.9211697Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T05:42:40.9212689Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T05:42:40.9213633Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T05:42:40.9214369Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T05:42:40.9215261Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2025-03-14T05:42:40.9216058Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:42:41.1456095Z 2025-03-14T05:42:41.1456925Z  2025-03-14T05:42:41.1457396Z  2025-03-14T05:42:41.1457785Z  2025-03-14T05:42:41.1458173Z  2025-03-14T05:42:41.1458564Z  2025-03-14T05:42:41.1458944Z  2025-03-14T05:42:41.1459657Z  2025-03-14T05:42:41.1460060Z  2025-03-14T05:42:41.1460677Z [9,738 / 15,235] 48 actions, 47 running 2025-03-14T05:42:41.1461562Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T05:42:41.1462531Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T05:42:41.1463420Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T05:42:41.1464324Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T05:42:41.1465187Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T05:42:41.1466181Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T05:42:41.1467035Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2025-03-14T05:42:41.1467798Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:42:41.5190884Z 2025-03-14T05:42:41.5191764Z  2025-03-14T05:42:41.5192259Z  2025-03-14T05:42:41.5192649Z  2025-03-14T05:42:41.5193088Z  2025-03-14T05:42:41.5193509Z  2025-03-14T05:42:41.5193941Z  2025-03-14T05:42:41.5194346Z  2025-03-14T05:42:41.5194706Z  2025-03-14T05:42:41.5195231Z [9,741 / 15,235] 48 actions, 47 running 2025-03-14T05:42:41.5196060Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T05:42:41.5196979Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T05:42:41.5197767Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T05:42:41.5198658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T05:42:41.5199576Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T05:42:41.5200268Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T05:42:41.5201082Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2025-03-14T05:42:41.5201803Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:42:41.7216464Z 2025-03-14T05:42:41.7217343Z  2025-03-14T05:42:41.7217919Z  2025-03-14T05:42:41.7218683Z  2025-03-14T05:42:41.7219081Z  2025-03-14T05:42:41.7219474Z  2025-03-14T05:42:41.7219853Z  2025-03-14T05:42:41.7220247Z  2025-03-14T05:42:41.7220644Z  2025-03-14T05:42:41.7221165Z [9,745 / 15,235] 48 actions running 2025-03-14T05:42:41.7222053Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T05:42:41.7223056Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T05:42:41.7223948Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T05:42:41.7224946Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T05:42:41.7225903Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T05:42:41.7226693Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T05:42:41.7227604Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2025-03-14T05:42:41.7228432Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:41.9536917Z 2025-03-14T05:42:41.9537739Z  2025-03-14T05:42:41.9538175Z  2025-03-14T05:42:41.9538544Z  2025-03-14T05:42:41.9538900Z  2025-03-14T05:42:41.9539260Z  2025-03-14T05:42:41.9539592Z  2025-03-14T05:42:41.9539972Z  2025-03-14T05:42:41.9540345Z  2025-03-14T05:42:41.9540943Z [9,746 / 15,235] 48 actions, 47 running 2025-03-14T05:42:41.9541898Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T05:42:41.9542904Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T05:42:41.9543815Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T05:42:41.9544771Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T05:42:41.9545683Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T05:42:41.9546397Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T05:42:41.9547597Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2025-03-14T05:42:41.9548326Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:42:42.2225361Z 2025-03-14T05:42:42.2226172Z  2025-03-14T05:42:42.2226651Z  2025-03-14T05:42:42.2227043Z  2025-03-14T05:42:42.2227460Z  2025-03-14T05:42:42.2227867Z  2025-03-14T05:42:42.2228212Z  2025-03-14T05:42:42.2228541Z  2025-03-14T05:42:42.2228863Z  2025-03-14T05:42:42.2229502Z [9,748 / 15,235] 48 actions, 47 running 2025-03-14T05:42:42.2230446Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T05:42:42.2231499Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T05:42:42.2232400Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T05:42:42.2233295Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T05:42:42.2234163Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T05:42:42.2234980Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T05:42:42.2235879Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T05:42:42.2236663Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:42.4416761Z 2025-03-14T05:42:42.4417594Z  2025-03-14T05:42:42.4418093Z  2025-03-14T05:42:42.4418529Z  2025-03-14T05:42:42.4418945Z  2025-03-14T05:42:42.4419383Z  2025-03-14T05:42:42.4419817Z  2025-03-14T05:42:42.4420253Z  2025-03-14T05:42:42.4420814Z  2025-03-14T05:42:42.4421457Z [9,749 / 15,235] 48 actions, 47 running 2025-03-14T05:42:42.4422495Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T05:42:42.4423649Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T05:42:42.4424367Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T05:42:42.4425307Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T05:42:42.4426293Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T05:42:42.4427399Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T05:42:42.4428305Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T05:42:42.4429110Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:42.7225496Z 2025-03-14T05:42:42.7226263Z  2025-03-14T05:42:42.7226717Z  2025-03-14T05:42:42.7227099Z  2025-03-14T05:42:42.7227449Z  2025-03-14T05:42:42.7227788Z  2025-03-14T05:42:42.7228161Z  2025-03-14T05:42:42.7228534Z  2025-03-14T05:42:42.7228892Z  2025-03-14T05:42:42.7229347Z [9,750 / 15,235] 48 actions running 2025-03-14T05:42:42.7230115Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T05:42:42.7231106Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T05:42:42.7231937Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T05:42:42.7232744Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T05:42:42.7233666Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T05:42:42.7234292Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T05:42:42.7235070Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T05:42:42.7235844Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:42.9332168Z 2025-03-14T05:42:42.9333023Z  2025-03-14T05:42:42.9333509Z  2025-03-14T05:42:42.9333939Z  2025-03-14T05:42:42.9334357Z  2025-03-14T05:42:42.9334768Z  2025-03-14T05:42:42.9335187Z  2025-03-14T05:42:42.9335603Z  2025-03-14T05:42:42.9336028Z  2025-03-14T05:42:42.9336644Z [9,753 / 15,235] 48 actions, 47 running 2025-03-14T05:42:42.9337761Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T05:42:42.9338883Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T05:42:42.9340135Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T05:42:42.9341217Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T05:42:42.9342219Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T05:42:42.9343017Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T05:42:42.9343949Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T05:42:42.9344792Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:43.1995660Z 2025-03-14T05:42:43.1996483Z  2025-03-14T05:42:43.1997009Z  2025-03-14T05:42:43.1997441Z  2025-03-14T05:42:43.1997871Z  2025-03-14T05:42:43.1998301Z  2025-03-14T05:42:43.1998721Z  2025-03-14T05:42:43.1999143Z  2025-03-14T05:42:43.1999547Z  2025-03-14T05:42:43.2000172Z [9,757 / 15,235] 48 actions, 47 running 2025-03-14T05:42:43.2001112Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T05:42:43.2002208Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T05:42:43.2003154Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T05:42:43.2004161Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T05:42:43.2005275Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T05:42:43.2006073Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T05:42:43.2006963Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T05:42:43.2007758Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:42:43.5233894Z 2025-03-14T05:42:43.5234749Z  2025-03-14T05:42:43.5235341Z  2025-03-14T05:42:43.5235737Z  2025-03-14T05:42:43.5236222Z  2025-03-14T05:42:43.5236610Z  2025-03-14T05:42:43.5237028Z  2025-03-14T05:42:43.5237494Z  2025-03-14T05:42:43.5237889Z  2025-03-14T05:42:43.5238518Z [9,761 / 15,235] 48 actions running 2025-03-14T05:42:43.5239442Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T05:42:43.5241001Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T05:42:43.5241935Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T05:42:43.5242944Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T05:42:43.5243904Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T05:42:43.5244851Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T05:42:43.5245663Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T05:42:43.5246381Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:42:43.7240852Z 2025-03-14T05:42:43.7241725Z  2025-03-14T05:42:43.7242222Z  2025-03-14T05:42:43.7242624Z  2025-03-14T05:42:43.7243030Z  2025-03-14T05:42:43.7243406Z  2025-03-14T05:42:43.7243826Z  2025-03-14T05:42:43.7244217Z  2025-03-14T05:42:43.7244795Z  2025-03-14T05:42:43.7245399Z [9,762 / 15,235] 48 actions running 2025-03-14T05:42:43.7246369Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T05:42:43.7247404Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T05:42:43.7248227Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T05:42:43.7249195Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T05:42:43.7250121Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T05:42:43.7251013Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T05:42:43.7251914Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T05:42:43.7252735Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:42:44.1247420Z 2025-03-14T05:42:44.1248280Z  2025-03-14T05:42:44.1248755Z  2025-03-14T05:42:44.1249137Z  2025-03-14T05:42:44.1249560Z  2025-03-14T05:42:44.1249975Z  2025-03-14T05:42:44.1250779Z  2025-03-14T05:42:44.1251208Z  2025-03-14T05:42:44.1251641Z  2025-03-14T05:42:44.1252208Z [9,764 / 15,235] 48 actions running 2025-03-14T05:42:44.1253148Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T05:42:44.1254136Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T05:42:44.1254998Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T05:42:44.1255966Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T05:42:44.1256812Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T05:42:44.1257430Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T05:42:44.1258278Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T05:42:44.1259026Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:44.4117023Z 2025-03-14T05:42:44.4117854Z  2025-03-14T05:42:44.4118316Z  2025-03-14T05:42:44.4118700Z  2025-03-14T05:42:44.4119091Z  2025-03-14T05:42:44.4119491Z  2025-03-14T05:42:44.4119859Z  2025-03-14T05:42:44.4120237Z  2025-03-14T05:42:44.4120607Z  2025-03-14T05:42:44.4121157Z [9,765 / 15,235] 48 actions, 47 running 2025-03-14T05:42:44.4122037Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T05:42:44.4123006Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T05:42:44.4123807Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T05:42:44.4124850Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T05:42:44.4125710Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T05:42:44.4126409Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T05:42:44.4127221Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T05:42:44.4127938Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:44.7256762Z 2025-03-14T05:42:44.7257640Z  2025-03-14T05:42:44.7258151Z  2025-03-14T05:42:44.7258886Z  2025-03-14T05:42:44.7259280Z  2025-03-14T05:42:44.7259707Z  2025-03-14T05:42:44.7260137Z  2025-03-14T05:42:44.7260550Z  2025-03-14T05:42:44.7260964Z  2025-03-14T05:42:44.7261574Z [9,767 / 15,235] 48 actions running 2025-03-14T05:42:44.7262536Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T05:42:44.7263585Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T05:42:44.7264526Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T05:42:44.7265796Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T05:42:44.7266811Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T05:42:44.7267621Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T05:42:44.7268552Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T05:42:44.7269414Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:44.9261069Z 2025-03-14T05:42:44.9261872Z  2025-03-14T05:42:44.9262401Z  2025-03-14T05:42:44.9262838Z  2025-03-14T05:42:44.9263274Z  2025-03-14T05:42:44.9263716Z  2025-03-14T05:42:44.9264131Z  2025-03-14T05:42:44.9264546Z  2025-03-14T05:42:44.9264978Z  2025-03-14T05:42:44.9265800Z [9,771 / 15,235] 48 actions running 2025-03-14T05:42:44.9266780Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T05:42:44.9267862Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T05:42:44.9268787Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T05:42:44.9269781Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T05:42:44.9270770Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T05:42:44.9271570Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T05:42:44.9272826Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T05:42:44.9273658Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:42:45.1459682Z 2025-03-14T05:42:45.1460553Z  2025-03-14T05:42:45.1461078Z  2025-03-14T05:42:45.1461503Z  2025-03-14T05:42:45.1461900Z  2025-03-14T05:42:45.1462316Z  2025-03-14T05:42:45.1462727Z  2025-03-14T05:42:45.1463139Z  2025-03-14T05:42:45.1463567Z  2025-03-14T05:42:45.1464176Z [9,772 / 15,235] 48 actions, 47 running 2025-03-14T05:42:45.1465128Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T05:42:45.1466274Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T05:42:45.1467028Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T05:42:45.1467848Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T05:42:45.1468648Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T05:42:45.1469371Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T05:42:45.1470186Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T05:42:45.1471066Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local ... 2025-03-14T05:42:45.4915805Z 2025-03-14T05:42:45.4916619Z  2025-03-14T05:42:45.4917104Z  2025-03-14T05:42:45.4917507Z  2025-03-14T05:42:45.4917891Z  2025-03-14T05:42:45.4918295Z  2025-03-14T05:42:45.4918701Z  2025-03-14T05:42:45.4919100Z  2025-03-14T05:42:45.4919469Z  2025-03-14T05:42:45.4920041Z [9,774 / 15,235] 48 actions, 47 running 2025-03-14T05:42:45.4920966Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T05:42:45.4922002Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T05:42:45.4922874Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T05:42:45.4923850Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T05:42:45.4925319Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T05:42:45.4926068Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T05:42:45.4926918Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T05:42:45.4927848Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local ... 2025-03-14T05:42:45.7270358Z 2025-03-14T05:42:45.7271207Z  2025-03-14T05:42:45.7271690Z  2025-03-14T05:42:45.7272078Z  2025-03-14T05:42:45.7272471Z  2025-03-14T05:42:45.7272892Z  2025-03-14T05:42:45.7273271Z  2025-03-14T05:42:45.7273639Z  2025-03-14T05:42:45.7274035Z  2025-03-14T05:42:45.7274618Z [9,774 / 15,235] 48 actions running 2025-03-14T05:42:45.7275523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T05:42:45.7276575Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T05:42:45.7277483Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T05:42:45.7278461Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T05:42:45.7279366Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2025-03-14T05:42:45.7280150Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T05:42:45.7281015Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T05:42:45.7282010Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local ... 2025-03-14T05:42:46.6059641Z 2025-03-14T05:42:46.6060490Z  2025-03-14T05:42:46.6060953Z  2025-03-14T05:42:46.6061327Z  2025-03-14T05:42:46.6061712Z  2025-03-14T05:42:46.6062113Z  2025-03-14T05:42:46.6062503Z  2025-03-14T05:42:46.6062914Z  2025-03-14T05:42:46.6063227Z  2025-03-14T05:42:46.6063820Z [9,775 / 15,235] 48 actions, 47 running 2025-03-14T05:42:46.6065068Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T05:42:46.6066361Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T05:42:46.6067299Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T05:42:46.6068256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2025-03-14T05:42:46.6069133Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T05:42:46.6069881Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T05:42:46.6070743Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T05:42:46.6071724Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local ... 2025-03-14T05:42:46.9132098Z 2025-03-14T05:42:46.9132891Z  2025-03-14T05:42:46.9133398Z  2025-03-14T05:42:46.9133823Z  2025-03-14T05:42:46.9134246Z  2025-03-14T05:42:46.9134658Z  2025-03-14T05:42:46.9135071Z  2025-03-14T05:42:46.9135481Z  2025-03-14T05:42:46.9135887Z  2025-03-14T05:42:46.9136536Z [9,777 / 15,235] 48 actions, 47 running 2025-03-14T05:42:46.9137494Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T05:42:46.9138521Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T05:42:46.9139520Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T05:42:46.9140464Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T05:42:46.9141220Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T05:42:46.9142077Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T05:42:46.9142973Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T05:42:46.9144087Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local ... 2025-03-14T05:42:47.1281243Z 2025-03-14T05:42:47.1282119Z  2025-03-14T05:42:47.1282636Z  2025-03-14T05:42:47.1283100Z  2025-03-14T05:42:47.1283493Z  2025-03-14T05:42:47.1283872Z  2025-03-14T05:42:47.1284305Z  2025-03-14T05:42:47.1284860Z  2025-03-14T05:42:47.1285622Z  2025-03-14T05:42:47.1286196Z [9,778 / 15,235] 48 actions running 2025-03-14T05:42:47.1287138Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T05:42:47.1288160Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T05:42:47.1289092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T05:42:47.1289995Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T05:42:47.1290736Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T05:42:47.1291589Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2025-03-14T05:42:47.1292546Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T05:42:47.1293626Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local ... 2025-03-14T05:42:47.3941829Z 2025-03-14T05:42:47.3942684Z  2025-03-14T05:42:47.3943198Z  2025-03-14T05:42:47.3943664Z  2025-03-14T05:42:47.3944035Z  2025-03-14T05:42:47.3944407Z  2025-03-14T05:42:47.3944928Z  2025-03-14T05:42:47.3945544Z  2025-03-14T05:42:47.3945920Z  2025-03-14T05:42:47.3946498Z [9,779 / 15,235] 48 actions, 47 running 2025-03-14T05:42:47.3947329Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T05:42:47.3948282Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T05:42:47.3949237Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T05:42:47.3950170Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T05:42:47.3950885Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T05:42:47.3951745Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2025-03-14T05:42:47.3952601Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T05:42:47.3953998Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local ... 2025-03-14T05:42:47.7289047Z 2025-03-14T05:42:47.7289960Z  2025-03-14T05:42:47.7290465Z  2025-03-14T05:42:47.7290891Z  2025-03-14T05:42:47.7291298Z  2025-03-14T05:42:47.7291695Z  2025-03-14T05:42:47.7292094Z  2025-03-14T05:42:47.7292506Z  2025-03-14T05:42:47.7292918Z  2025-03-14T05:42:47.7293499Z [9,779 / 15,235] 48 actions running 2025-03-14T05:42:47.7294444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T05:42:47.7295510Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T05:42:47.7296477Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T05:42:47.7297416Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T05:42:47.7298170Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T05:42:47.7299055Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2025-03-14T05:42:47.7300014Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T05:42:47.7301109Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local ... 2025-03-14T05:42:48.0610453Z 2025-03-14T05:42:48.0611207Z  2025-03-14T05:42:48.0611698Z  2025-03-14T05:42:48.0612099Z  2025-03-14T05:42:48.0612487Z  2025-03-14T05:42:48.0612893Z  2025-03-14T05:42:48.0613293Z  2025-03-14T05:42:48.0613714Z  2025-03-14T05:42:48.0614166Z  2025-03-14T05:42:48.0614774Z [9,781 / 15,235] 48 actions, 47 running 2025-03-14T05:42:48.0615702Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T05:42:48.0616698Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T05:42:48.0617664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T05:42:48.0618624Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T05:42:48.0619437Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T05:42:48.0620199Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T05:42:48.0621706Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2025-03-14T05:42:48.0622526Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:42:48.2789191Z 2025-03-14T05:42:48.2790016Z  2025-03-14T05:42:48.2790532Z  2025-03-14T05:42:48.2790993Z  2025-03-14T05:42:48.2791423Z  2025-03-14T05:42:48.2791856Z  2025-03-14T05:42:48.2792264Z  2025-03-14T05:42:48.2792679Z  2025-03-14T05:42:48.2793092Z  2025-03-14T05:42:48.2793678Z [9,785 / 15,235] 48 actions, 47 running 2025-03-14T05:42:48.2794567Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T05:42:48.2795593Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T05:42:48.2796533Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T05:42:48.2797465Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T05:42:48.2798192Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T05:42:48.2799050Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T05:42:48.2800061Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2025-03-14T05:42:48.2800968Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:42:48.5297222Z 2025-03-14T05:42:48.5298090Z  2025-03-14T05:42:48.5298584Z  2025-03-14T05:42:48.5298967Z  2025-03-14T05:42:48.5299400Z  2025-03-14T05:42:48.5299814Z  2025-03-14T05:42:48.5300207Z  2025-03-14T05:42:48.5300621Z  2025-03-14T05:42:48.5301030Z  2025-03-14T05:42:48.5301562Z [9,787 / 15,235] 48 actions running 2025-03-14T05:42:48.5302435Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T05:42:48.5303355Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T05:42:48.5304713Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T05:42:48.5305697Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T05:42:48.5306409Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T05:42:48.5307251Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T05:42:48.5308250Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T05:42:48.5309064Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:42:48.7838566Z 2025-03-14T05:42:48.7839397Z  2025-03-14T05:42:48.7839841Z  2025-03-14T05:42:48.7840227Z  2025-03-14T05:42:48.7840602Z  2025-03-14T05:42:48.7840976Z  2025-03-14T05:42:48.7841357Z  2025-03-14T05:42:48.7841726Z  2025-03-14T05:42:48.7842099Z  2025-03-14T05:42:48.7842658Z [9,791 / 15,235] 48 actions, 47 running 2025-03-14T05:42:48.7843547Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T05:42:48.7844499Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T05:42:48.7845583Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T05:42:48.7846428Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T05:42:48.7847128Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T05:42:48.7848034Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T05:42:48.7849043Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2025-03-14T05:42:48.7850206Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 10s local ... 2025-03-14T05:42:49.1304395Z 2025-03-14T05:42:49.1305235Z  2025-03-14T05:42:49.1305734Z  2025-03-14T05:42:49.1306128Z  2025-03-14T05:42:49.1306523Z  2025-03-14T05:42:49.1306928Z  2025-03-14T05:42:49.1307311Z  2025-03-14T05:42:49.1307711Z  2025-03-14T05:42:49.1308086Z  2025-03-14T05:42:49.1308701Z [9,793 / 15,235] 48 actions running 2025-03-14T05:42:49.1309626Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T05:42:49.1310971Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T05:42:49.1311912Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T05:42:49.1312810Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T05:42:49.1313572Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T05:42:49.1314524Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T05:42:49.1315606Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2025-03-14T05:42:49.1316731Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 11s local ... 2025-03-14T05:42:49.3328554Z 2025-03-14T05:42:49.3329387Z  2025-03-14T05:42:49.3329856Z  2025-03-14T05:42:49.3330297Z  2025-03-14T05:42:49.3330710Z  2025-03-14T05:42:49.3331139Z  2025-03-14T05:42:49.3331620Z  2025-03-14T05:42:49.3332038Z  2025-03-14T05:42:49.3332467Z  2025-03-14T05:42:49.3333041Z [9,794 / 15,235] 48 actions running 2025-03-14T05:42:49.3333991Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T05:42:49.3334917Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T05:42:49.3335875Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T05:42:49.3345215Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T05:42:49.3346228Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T05:42:49.3347210Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T05:42:49.3348406Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2025-03-14T05:42:49.3349592Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 11s local ... 2025-03-14T05:42:49.5479562Z 2025-03-14T05:42:49.5480417Z  2025-03-14T05:42:49.5481300Z  2025-03-14T05:42:49.5481791Z  2025-03-14T05:42:49.5482210Z  2025-03-14T05:42:49.5482599Z  2025-03-14T05:42:49.5483019Z  2025-03-14T05:42:49.5483418Z  2025-03-14T05:42:49.5483825Z  2025-03-14T05:42:49.5484461Z [9,795 / 15,235] 48 actions, 47 running 2025-03-14T05:42:49.5485591Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T05:42:49.5486649Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T05:42:49.5487668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T05:42:49.5488613Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T05:42:49.5489396Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T05:42:49.5490388Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T05:42:49.5491549Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2025-03-14T05:42:49.5492732Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 11s local ... 2025-03-14T05:42:49.9317770Z 2025-03-14T05:42:49.9318617Z  2025-03-14T05:42:49.9319128Z  2025-03-14T05:42:49.9319544Z  2025-03-14T05:42:49.9319966Z  2025-03-14T05:42:49.9320392Z  2025-03-14T05:42:49.9320810Z  2025-03-14T05:42:49.9321234Z  2025-03-14T05:42:49.9321661Z  2025-03-14T05:42:49.9322256Z [9,796 / 15,235] 48 actions running 2025-03-14T05:42:49.9323209Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T05:42:49.9324238Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T05:42:49.9325395Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T05:42:49.9326363Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T05:42:49.9327157Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T05:42:49.9328161Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T05:42:49.9329578Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2025-03-14T05:42:49.9330762Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 11s local ... 2025-03-14T05:42:50.4603887Z 2025-03-14T05:42:50.4604904Z  2025-03-14T05:42:50.4605428Z  2025-03-14T05:42:50.4605857Z  2025-03-14T05:42:50.4606261Z  2025-03-14T05:42:50.4606645Z  2025-03-14T05:42:50.4607042Z  2025-03-14T05:42:50.4607448Z  2025-03-14T05:42:50.4607863Z  2025-03-14T05:42:50.4608475Z [9,797 / 15,235] 48 actions, 47 running 2025-03-14T05:42:50.4609428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T05:42:50.4610391Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T05:42:50.4611457Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T05:42:50.4612452Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T05:42:50.4613180Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T05:42:50.4614142Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T05:42:50.4615245Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2025-03-14T05:42:50.4616303Z Compiling src/cpu/x64/jit_avx512_common_1x1_convolution.cpp; 12s local ... 2025-03-14T05:42:50.7327016Z 2025-03-14T05:42:50.7327857Z  2025-03-14T05:42:50.7328351Z  2025-03-14T05:42:50.7328758Z  2025-03-14T05:42:50.7329187Z  2025-03-14T05:42:50.7329589Z  2025-03-14T05:42:50.7329954Z  2025-03-14T05:42:50.7330294Z  2025-03-14T05:42:50.7330686Z  2025-03-14T05:42:50.7331240Z [9,801 / 15,235] 48 actions running 2025-03-14T05:42:50.7332150Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T05:42:50.7332961Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T05:42:50.7334335Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T05:42:50.7335298Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T05:42:50.7336011Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T05:42:50.7336922Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T05:42:50.7338058Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T05:42:50.7339178Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 11s local ... 2025-03-14T05:42:51.1332917Z 2025-03-14T05:42:51.1333821Z  2025-03-14T05:42:51.1334310Z  2025-03-14T05:42:51.1334752Z  2025-03-14T05:42:51.1335219Z  2025-03-14T05:42:51.1335651Z  2025-03-14T05:42:51.1336068Z  2025-03-14T05:42:51.1336483Z  2025-03-14T05:42:51.1336913Z  2025-03-14T05:42:51.1337504Z [9,802 / 15,235] 48 actions running 2025-03-14T05:42:51.1338531Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T05:42:51.1339595Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T05:42:51.1340612Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T05:42:51.1341609Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T05:42:51.1342394Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T05:42:51.1343387Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T05:42:51.1344580Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T05:42:51.1345729Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local ... 2025-03-14T05:42:51.3338698Z 2025-03-14T05:42:51.3339560Z  2025-03-14T05:42:51.3340051Z  2025-03-14T05:42:51.3340478Z  2025-03-14T05:42:51.3340880Z  2025-03-14T05:42:51.3341301Z  2025-03-14T05:42:51.3341714Z  2025-03-14T05:42:51.3342123Z  2025-03-14T05:42:51.3342584Z  2025-03-14T05:42:51.3343152Z [9,804 / 15,235] 48 actions running 2025-03-14T05:42:51.3344391Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T05:42:51.3345390Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T05:42:51.3346370Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T05:42:51.3347306Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T05:42:51.3348051Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T05:42:51.3349028Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T05:42:51.3350188Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T05:42:51.3351460Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local ... 2025-03-14T05:42:51.7345626Z 2025-03-14T05:42:51.7346486Z  2025-03-14T05:42:51.7346968Z  2025-03-14T05:42:51.7347376Z  2025-03-14T05:42:51.7347813Z  2025-03-14T05:42:51.7348152Z  2025-03-14T05:42:51.7348561Z  2025-03-14T05:42:51.7348963Z  2025-03-14T05:42:51.7349361Z  2025-03-14T05:42:51.7349970Z [9,805 / 15,235] 48 actions running 2025-03-14T05:42:51.7350914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T05:42:51.7351961Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T05:42:51.7352970Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T05:42:51.7353953Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T05:42:51.7354760Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T05:42:51.7355772Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T05:42:51.7356866Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T05:42:51.7357946Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local ... 2025-03-14T05:42:51.9517896Z 2025-03-14T05:42:51.9518768Z  2025-03-14T05:42:51.9519272Z  2025-03-14T05:42:51.9519692Z  2025-03-14T05:42:51.9520123Z  2025-03-14T05:42:51.9520557Z  2025-03-14T05:42:51.9520954Z  2025-03-14T05:42:51.9521363Z  2025-03-14T05:42:51.9521778Z  2025-03-14T05:42:51.9522396Z [9,806 / 15,235] 48 actions, 47 running 2025-03-14T05:42:51.9523348Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T05:42:51.9524277Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T05:42:51.9525374Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T05:42:51.9526273Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T05:42:51.9527008Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T05:42:51.9527983Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T05:42:51.9529157Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T05:42:51.9530319Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local ... 2025-03-14T05:42:52.2350592Z 2025-03-14T05:42:52.2351438Z  2025-03-14T05:42:52.2351937Z  2025-03-14T05:42:52.2352349Z  2025-03-14T05:42:52.2352763Z  2025-03-14T05:42:52.2353171Z  2025-03-14T05:42:52.2353578Z  2025-03-14T05:42:52.2353959Z  2025-03-14T05:42:52.2354326Z  2025-03-14T05:42:52.2355040Z [9,810 / 15,235] 48 actions, 47 running 2025-03-14T05:42:52.2356024Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T05:42:52.2357107Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T05:42:52.2358112Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T05:42:52.2359076Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T05:42:52.2359873Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T05:42:52.2360932Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T05:42:52.2362597Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T05:42:52.2363781Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local ... 2025-03-14T05:42:52.4595534Z 2025-03-14T05:42:52.4596382Z  2025-03-14T05:42:52.4596855Z  2025-03-14T05:42:52.4597261Z  2025-03-14T05:42:52.4597655Z  2025-03-14T05:42:52.4598052Z  2025-03-14T05:42:52.4598446Z  2025-03-14T05:42:52.4598845Z  2025-03-14T05:42:52.4599270Z  2025-03-14T05:42:52.4599877Z [9,812 / 15,235] 48 actions, 47 running 2025-03-14T05:42:52.4600793Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T05:42:52.4601802Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T05:42:52.4602784Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T05:42:52.4603757Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T05:42:52.4604513Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T05:42:52.4605591Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T05:42:52.4606684Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T05:42:52.4607746Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local ... 2025-03-14T05:42:52.7355382Z 2025-03-14T05:42:52.7356234Z  2025-03-14T05:42:52.7356720Z  2025-03-14T05:42:52.7357141Z  2025-03-14T05:42:52.7357547Z  2025-03-14T05:42:52.7358100Z  2025-03-14T05:42:52.7358506Z  2025-03-14T05:42:52.7358924Z  2025-03-14T05:42:52.7359356Z  2025-03-14T05:42:52.7359943Z [9,814 / 15,235] 48 actions running 2025-03-14T05:42:52.7360926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T05:42:52.7362306Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T05:42:52.7363288Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T05:42:52.7364238Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T05:42:52.7365220Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T05:42:52.7366370Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T05:42:52.7367413Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T05:42:52.7368526Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local ... 2025-03-14T05:42:52.9679468Z 2025-03-14T05:42:52.9680329Z  2025-03-14T05:42:52.9680842Z  2025-03-14T05:42:52.9681276Z  2025-03-14T05:42:52.9681715Z  2025-03-14T05:42:52.9682131Z  2025-03-14T05:42:52.9682556Z  2025-03-14T05:42:52.9682974Z  2025-03-14T05:42:52.9683407Z  2025-03-14T05:42:52.9684052Z [9,815 / 15,235] 48 actions, 47 running 2025-03-14T05:42:52.9685163Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T05:42:52.9686210Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T05:42:52.9687194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T05:42:52.9688105Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T05:42:52.9688867Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T05:42:52.9689812Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T05:42:52.9690964Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T05:42:52.9692093Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local ... 2025-03-14T05:42:53.2121688Z 2025-03-14T05:42:53.2122538Z  2025-03-14T05:42:53.2123035Z  2025-03-14T05:42:53.2123472Z  2025-03-14T05:42:53.2123902Z  2025-03-14T05:42:53.2124299Z  2025-03-14T05:42:53.2124885Z  2025-03-14T05:42:53.2125297Z  2025-03-14T05:42:53.2126100Z  2025-03-14T05:42:53.2126668Z [9,817 / 15,235] 48 actions, 47 running 2025-03-14T05:42:53.2127641Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T05:42:53.2128625Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T05:42:53.2129622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T05:42:53.2130502Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T05:42:53.2131232Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T05:42:53.2132182Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T05:42:53.2133348Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T05:42:53.2134485Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local ... 2025-03-14T05:42:53.5364290Z 2025-03-14T05:42:53.5365268Z  2025-03-14T05:42:53.5365949Z  2025-03-14T05:42:53.5366322Z  2025-03-14T05:42:53.5366714Z  2025-03-14T05:42:53.5367081Z  2025-03-14T05:42:53.5367456Z  2025-03-14T05:42:53.5367833Z  2025-03-14T05:42:53.5368195Z  2025-03-14T05:42:53.5368727Z [9,819 / 15,235] 47 actions running 2025-03-14T05:42:53.5369596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T05:42:53.5370507Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T05:42:53.5371403Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T05:42:53.5372231Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T05:42:53.5372948Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T05:42:53.5373822Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T05:42:53.5374859Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T05:42:53.5376263Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local ... 2025-03-14T05:42:53.7370227Z 2025-03-14T05:42:53.7371000Z  2025-03-14T05:42:53.7371481Z  2025-03-14T05:42:53.7371891Z  2025-03-14T05:42:53.7372307Z  2025-03-14T05:42:53.7372732Z  2025-03-14T05:42:53.7373161Z  2025-03-14T05:42:53.7373574Z  2025-03-14T05:42:53.7373972Z  2025-03-14T05:42:53.7374561Z [9,819 / 15,235] 48 actions running 2025-03-14T05:42:53.7375557Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T05:42:53.7376637Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T05:42:53.7377669Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T05:42:53.7378683Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T05:42:53.7379502Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T05:42:53.7380530Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T05:42:53.7381751Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T05:42:53.7382944Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local ... 2025-03-14T05:42:53.9514747Z 2025-03-14T05:42:53.9515553Z  2025-03-14T05:42:53.9516056Z  2025-03-14T05:42:53.9516492Z  2025-03-14T05:42:53.9516847Z  2025-03-14T05:42:53.9517257Z  2025-03-14T05:42:53.9517625Z  2025-03-14T05:42:53.9518027Z  2025-03-14T05:42:53.9518453Z  2025-03-14T05:42:53.9519073Z [9,821 / 15,235] 48 actions, 47 running 2025-03-14T05:42:53.9520069Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T05:42:53.9521109Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T05:42:53.9522128Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T05:42:53.9523141Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T05:42:53.9523979Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T05:42:53.9525489Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T05:42:53.9526644Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T05:42:53.9527810Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local ... 2025-03-14T05:42:54.1689659Z 2025-03-14T05:42:54.1690540Z  2025-03-14T05:42:54.1691048Z  2025-03-14T05:42:54.1691478Z  2025-03-14T05:42:54.1691906Z  2025-03-14T05:42:54.1692336Z  2025-03-14T05:42:54.1692748Z  2025-03-14T05:42:54.1693175Z  2025-03-14T05:42:54.1693607Z  2025-03-14T05:42:54.1694230Z [9,823 / 15,235] 48 actions, 47 running 2025-03-14T05:42:54.1695256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T05:42:54.1696328Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T05:42:54.1697416Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T05:42:54.1698426Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T05:42:54.1699323Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T05:42:54.1700309Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T05:42:54.1701486Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T05:42:54.1702647Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2025-03-14T05:42:54.4922636Z 2025-03-14T05:42:54.4923417Z  2025-03-14T05:42:54.4923935Z  2025-03-14T05:42:54.4924362Z  2025-03-14T05:42:54.4924942Z  2025-03-14T05:42:54.4925342Z  2025-03-14T05:42:54.4925757Z  2025-03-14T05:42:54.4926179Z  2025-03-14T05:42:54.4926601Z  2025-03-14T05:42:54.4927179Z [9,825 / 15,235] 48 actions, 47 running 2025-03-14T05:42:54.4930235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T05:42:54.4931471Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T05:42:54.4932510Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T05:42:54.4933428Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T05:42:54.4934197Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T05:42:54.4935138Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T05:42:54.4936297Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T05:42:54.4937475Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2025-03-14T05:42:54.7380326Z 2025-03-14T05:42:54.7381148Z  2025-03-14T05:42:54.7381656Z  2025-03-14T05:42:54.7382098Z  2025-03-14T05:42:54.7382534Z  2025-03-14T05:42:54.7382939Z  2025-03-14T05:42:54.7383359Z  2025-03-14T05:42:54.7383789Z  2025-03-14T05:42:54.7384206Z  2025-03-14T05:42:54.7384827Z [9,825 / 15,235] 48 actions running 2025-03-14T05:42:54.7385797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T05:42:54.7386838Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T05:42:54.7387836Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T05:42:54.7388780Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T05:42:54.7389526Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T05:42:54.7390516Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T05:42:54.7391681Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T05:42:54.7392807Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2025-03-14T05:42:55.1386088Z 2025-03-14T05:42:55.1386929Z  2025-03-14T05:42:55.1387436Z  2025-03-14T05:42:55.1387842Z  2025-03-14T05:42:55.1388267Z  2025-03-14T05:42:55.1388714Z  2025-03-14T05:42:55.1389451Z  2025-03-14T05:42:55.1389870Z  2025-03-14T05:42:55.1390283Z  2025-03-14T05:42:55.1390850Z [9,827 / 15,235] 48 actions running 2025-03-14T05:42:55.1391797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T05:42:55.1392793Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T05:42:55.1393769Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T05:42:55.1394639Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T05:42:55.1395390Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T05:42:55.1396353Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T05:42:55.1397484Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T05:42:55.1398562Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local ... 2025-03-14T05:42:55.3866029Z 2025-03-14T05:42:55.3866862Z  2025-03-14T05:42:55.3867378Z  2025-03-14T05:42:55.3867784Z  2025-03-14T05:42:55.3868198Z  2025-03-14T05:42:55.3868602Z  2025-03-14T05:42:55.3869016Z  2025-03-14T05:42:55.3869434Z  2025-03-14T05:42:55.3869818Z  2025-03-14T05:42:55.3870410Z [9,828 / 15,235] 48 actions, 47 running 2025-03-14T05:42:55.3871279Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T05:42:55.3872260Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T05:42:55.3873253Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T05:42:55.3874164Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T05:42:55.3875071Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T05:42:55.3876204Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T05:42:55.3877655Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2025-03-14T05:42:55.3878521Z @onednn//:mkl_dnn; 15s local ... 2025-03-14T05:42:55.7413179Z 2025-03-14T05:42:55.7414014Z  2025-03-14T05:42:55.7414633Z  2025-03-14T05:42:55.7415048Z  2025-03-14T05:42:55.7415473Z  2025-03-14T05:42:55.7415866Z  2025-03-14T05:42:55.7416264Z  2025-03-14T05:42:55.7416670Z  2025-03-14T05:42:55.7417089Z  2025-03-14T05:42:55.7417668Z [9,828 / 15,235] 48 actions running 2025-03-14T05:42:55.7418581Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T05:42:55.7419564Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T05:42:55.7420693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T05:42:55.7421612Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T05:42:55.7422459Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T05:42:55.7423581Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T05:42:55.7424673Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2025-03-14T05:42:55.7425493Z @onednn//:mkl_dnn; 15s local ... 2025-03-14T05:42:56.1427128Z 2025-03-14T05:42:56.1428019Z  2025-03-14T05:42:56.1428539Z  2025-03-14T05:42:56.1428925Z  2025-03-14T05:42:56.1429316Z  2025-03-14T05:42:56.1429714Z  2025-03-14T05:42:56.1430108Z  2025-03-14T05:42:56.1430501Z  2025-03-14T05:42:56.1431024Z  2025-03-14T05:42:56.1431661Z [9,829 / 15,235] 48 actions, 47 running 2025-03-14T05:42:56.1432596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T05:42:56.1433616Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T05:42:56.1434634Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T05:42:56.1435612Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T05:42:56.1436532Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T05:42:56.1438124Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T05:42:56.1439216Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2025-03-14T05:42:56.1440084Z @onednn//:mkl_dnn; 16s local ... 2025-03-14T05:42:56.4196822Z 2025-03-14T05:42:56.4198064Z  2025-03-14T05:42:56.4198621Z  2025-03-14T05:42:56.4199080Z  2025-03-14T05:42:56.4199522Z  2025-03-14T05:42:56.4199980Z  2025-03-14T05:42:56.4200456Z  2025-03-14T05:42:56.4200918Z  2025-03-14T05:42:56.4201372Z  2025-03-14T05:42:56.4202028Z [9,830 / 15,235] 48 actions, 47 running 2025-03-14T05:42:56.4203039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T05:42:56.4204109Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T05:42:56.4205349Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T05:42:56.4206327Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T05:42:56.4207290Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T05:42:56.4208453Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T05:42:56.4209603Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2025-03-14T05:42:56.4210489Z @onednn//:mkl_dnn; 16s local ... 2025-03-14T05:42:56.7400198Z 2025-03-14T05:42:56.7401130Z  2025-03-14T05:42:56.7401617Z  2025-03-14T05:42:56.7402066Z  2025-03-14T05:42:56.7402487Z  2025-03-14T05:42:56.7402908Z  2025-03-14T05:42:56.7403341Z  2025-03-14T05:42:56.7403740Z  2025-03-14T05:42:56.7404154Z  2025-03-14T05:42:56.7404852Z [9,831 / 15,235] 48 actions running 2025-03-14T05:42:56.7406158Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T05:42:56.7407204Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T05:42:56.7408188Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T05:42:56.7409162Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T05:42:56.7410107Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T05:42:56.7411284Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T05:42:56.7412411Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2025-03-14T05:42:56.7413530Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local ... 2025-03-14T05:42:56.9536798Z 2025-03-14T05:42:56.9537695Z  2025-03-14T05:42:56.9538178Z  2025-03-14T05:42:56.9538613Z  2025-03-14T05:42:56.9539031Z  2025-03-14T05:42:56.9539434Z  2025-03-14T05:42:56.9539857Z  2025-03-14T05:42:56.9540252Z  2025-03-14T05:42:56.9540658Z  2025-03-14T05:42:56.9541305Z [9,832 / 15,235] 48 actions, 47 running 2025-03-14T05:42:56.9542277Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T05:42:56.9543306Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T05:42:56.9544256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T05:42:56.9545152Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T05:42:56.9546027Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T05:42:56.9547190Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T05:42:56.9548313Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T05:42:56.9549165Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:42:57.3208144Z 2025-03-14T05:42:57.3209284Z  2025-03-14T05:42:57.3210053Z  2025-03-14T05:42:57.3210628Z  2025-03-14T05:42:57.3212211Z  2025-03-14T05:42:57.3212868Z  2025-03-14T05:42:57.3213502Z  2025-03-14T05:42:57.3214507Z  2025-03-14T05:42:57.3215103Z  2025-03-14T05:42:57.3215949Z [9,834 / 15,235] 48 actions, 47 running 2025-03-14T05:42:57.3334063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T05:42:57.3335017Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T05:42:57.3335867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T05:42:57.3336710Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T05:42:57.3337512Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T05:42:57.3338447Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T05:42:57.3339345Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T05:42:57.3340117Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:42:57.5438795Z 2025-03-14T05:42:57.5439727Z  2025-03-14T05:42:57.5440217Z  2025-03-14T05:42:57.5440658Z  2025-03-14T05:42:57.5441081Z  2025-03-14T05:42:57.5441502Z  2025-03-14T05:42:57.5441913Z  2025-03-14T05:42:57.5442318Z  2025-03-14T05:42:57.5442731Z  2025-03-14T05:42:57.5443332Z [9,835 / 15,235] 48 actions running 2025-03-14T05:42:57.5444232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T05:42:57.5445432Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T05:42:57.5446442Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T05:42:57.5447353Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T05:42:57.5448287Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T05:42:57.5449252Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T05:42:57.5450476Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T05:42:57.5451317Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:42:57.7413552Z 2025-03-14T05:42:57.7414331Z  2025-03-14T05:42:57.7414838Z  2025-03-14T05:42:57.7415227Z  2025-03-14T05:42:57.7415628Z  2025-03-14T05:42:57.7416032Z  2025-03-14T05:42:57.7416410Z  2025-03-14T05:42:57.7416791Z  2025-03-14T05:42:57.7417185Z  2025-03-14T05:42:57.7417698Z [9,838 / 15,235] 48 actions running 2025-03-14T05:42:57.7418527Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T05:42:57.7419593Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T05:42:57.7420683Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T05:42:57.7421702Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T05:42:57.7422700Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T05:42:57.7423986Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T05:42:57.7425215Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T05:42:57.7426138Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:42:57.9828703Z 2025-03-14T05:42:57.9829554Z  2025-03-14T05:42:57.9830067Z  2025-03-14T05:42:57.9830484Z  2025-03-14T05:42:57.9830927Z  2025-03-14T05:42:57.9831373Z  2025-03-14T05:42:57.9831797Z  2025-03-14T05:42:57.9832204Z  2025-03-14T05:42:57.9832602Z  2025-03-14T05:42:57.9833200Z [9,841 / 15,235] 48 actions, 47 running 2025-03-14T05:42:57.9834159Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T05:42:57.9835178Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T05:42:57.9836209Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T05:42:57.9837215Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T05:42:57.9838196Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T05:42:57.9839803Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T05:42:57.9841019Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T05:42:57.9841924Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:42:58.3176664Z 2025-03-14T05:42:58.3177502Z  2025-03-14T05:42:58.3177985Z  2025-03-14T05:42:58.3178318Z  2025-03-14T05:42:58.3178708Z  2025-03-14T05:42:58.3179091Z  2025-03-14T05:42:58.3179487Z  2025-03-14T05:42:58.3179871Z  2025-03-14T05:42:58.3180272Z  2025-03-14T05:42:58.3180869Z [9,842 / 15,235] 48 actions, 47 running 2025-03-14T05:42:58.3181805Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T05:42:58.3182711Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T05:42:58.3183663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T05:42:58.3184537Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T05:42:58.3185460Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T05:42:58.3186628Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T05:42:58.3187796Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T05:42:58.3188612Z @onednn//:mkl_dnn; 15s local ... 2025-03-14T05:42:58.5516086Z 2025-03-14T05:42:58.5516899Z  2025-03-14T05:42:58.5517419Z  2025-03-14T05:42:58.5517828Z  2025-03-14T05:42:58.5518231Z  2025-03-14T05:42:58.5518646Z  2025-03-14T05:42:58.5519050Z  2025-03-14T05:42:58.5519446Z  2025-03-14T05:42:58.5519853Z  2025-03-14T05:42:58.5520461Z [9,843 / 15,235] 48 actions running 2025-03-14T05:42:58.5521381Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T05:42:58.5522735Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T05:42:58.5523746Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T05:42:58.5524799Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T05:42:58.5525716Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T05:42:58.5526833Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T05:42:58.5527938Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2025-03-14T05:42:58.5528947Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2025-03-14T05:42:58.7426437Z 2025-03-14T05:42:58.7427376Z  2025-03-14T05:42:58.7427910Z  2025-03-14T05:42:58.7428347Z  2025-03-14T05:42:58.7428735Z  2025-03-14T05:42:58.7429107Z  2025-03-14T05:42:58.7429471Z  2025-03-14T05:42:58.7429873Z  2025-03-14T05:42:58.7430270Z  2025-03-14T05:42:58.7430824Z [9,845 / 15,235] 48 actions running 2025-03-14T05:42:58.7431731Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T05:42:58.7432683Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T05:42:58.7433630Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T05:42:58.7434532Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T05:42:58.7435431Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T05:42:58.7436507Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T05:42:58.7437591Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2025-03-14T05:42:58.7438592Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2025-03-14T05:42:58.9494744Z 2025-03-14T05:42:58.9495556Z  2025-03-14T05:42:58.9496041Z  2025-03-14T05:42:58.9496469Z  2025-03-14T05:42:58.9496900Z  2025-03-14T05:42:58.9497352Z  2025-03-14T05:42:58.9497785Z  2025-03-14T05:42:58.9498556Z  2025-03-14T05:42:58.9498977Z  2025-03-14T05:42:58.9499593Z [9,846 / 15,235] 48 actions, 47 running 2025-03-14T05:42:58.9500558Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T05:42:58.9501615Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T05:42:58.9502633Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T05:42:58.9503543Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T05:42:58.9504452Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T05:42:58.9505549Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T05:42:58.9506615Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2025-03-14T05:42:58.9507624Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2025-03-14T05:42:59.3431931Z 2025-03-14T05:42:59.3432773Z  2025-03-14T05:42:59.3433301Z  2025-03-14T05:42:59.3433730Z  2025-03-14T05:42:59.3434143Z  2025-03-14T05:42:59.3434538Z  2025-03-14T05:42:59.3434934Z  2025-03-14T05:42:59.3435313Z  2025-03-14T05:42:59.3435715Z  2025-03-14T05:42:59.3436313Z [9,846 / 15,235] 48 actions running 2025-03-14T05:42:59.3437243Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T05:42:59.3438243Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T05:42:59.3439244Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T05:42:59.3440110Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T05:42:59.3440961Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T05:42:59.3442129Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T05:42:59.3443675Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 19s local 2025-03-14T05:42:59.3444965Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2025-03-14T05:42:59.5441959Z 2025-03-14T05:42:59.5442784Z  2025-03-14T05:42:59.5443280Z  2025-03-14T05:42:59.5443674Z  2025-03-14T05:42:59.5444059Z  2025-03-14T05:42:59.5444446Z  2025-03-14T05:42:59.5444991Z  2025-03-14T05:42:59.5445383Z  2025-03-14T05:42:59.5445770Z  2025-03-14T05:42:59.5446351Z [9,847 / 15,235] 48 actions running 2025-03-14T05:42:59.5447276Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T05:42:59.5448246Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T05:42:59.5449171Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T05:42:59.5450188Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T05:42:59.5451124Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T05:42:59.5452318Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T05:42:59.5453320Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2025-03-14T05:42:59.5454149Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local ... 2025-03-14T05:42:59.7447282Z 2025-03-14T05:42:59.7448085Z  2025-03-14T05:42:59.7448549Z  2025-03-14T05:42:59.7448950Z  2025-03-14T05:42:59.7449326Z  2025-03-14T05:42:59.7449709Z  2025-03-14T05:42:59.7450065Z  2025-03-14T05:42:59.7450438Z  2025-03-14T05:42:59.7450815Z  2025-03-14T05:42:59.7451360Z [9,849 / 15,235] 48 actions running 2025-03-14T05:42:59.7452236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T05:42:59.7453270Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T05:42:59.7454218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T05:42:59.7455202Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T05:42:59.7456143Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T05:42:59.7457626Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T05:42:59.7458597Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2025-03-14T05:42:59.7459449Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local ... 2025-03-14T05:43:00.7455486Z 2025-03-14T05:43:00.7456327Z  2025-03-14T05:43:00.7456811Z  2025-03-14T05:43:00.7457191Z  2025-03-14T05:43:00.7457592Z  2025-03-14T05:43:00.7457972Z  2025-03-14T05:43:00.7458366Z  2025-03-14T05:43:00.7458752Z  2025-03-14T05:43:00.7459248Z  2025-03-14T05:43:00.7459801Z [9,849 / 15,235] 48 actions running 2025-03-14T05:43:00.7460664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T05:43:00.7461602Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T05:43:00.7462598Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T05:43:00.7463489Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T05:43:00.7464367Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T05:43:00.7465754Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T05:43:00.7466763Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local 2025-03-14T05:43:00.7467598Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local ... 2025-03-14T05:43:00.9902452Z 2025-03-14T05:43:00.9903224Z  2025-03-14T05:43:00.9903698Z  2025-03-14T05:43:00.9904099Z  2025-03-14T05:43:00.9904487Z  2025-03-14T05:43:00.9904908Z  2025-03-14T05:43:00.9905311Z  2025-03-14T05:43:00.9905709Z  2025-03-14T05:43:00.9906123Z  2025-03-14T05:43:00.9906665Z [9,850 / 15,235] 48 actions, 47 running 2025-03-14T05:43:00.9908067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T05:43:00.9909049Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T05:43:00.9909960Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T05:43:00.9910944Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T05:43:00.9911881Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T05:43:00.9912994Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T05:43:00.9913994Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2025-03-14T05:43:00.9914822Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local ... 2025-03-14T05:43:01.3461957Z 2025-03-14T05:43:01.3462807Z  2025-03-14T05:43:01.3463307Z  2025-03-14T05:43:01.3463716Z  2025-03-14T05:43:01.3464130Z  2025-03-14T05:43:01.3464517Z  2025-03-14T05:43:01.3464905Z  2025-03-14T05:43:01.3465266Z  2025-03-14T05:43:01.3465954Z  2025-03-14T05:43:01.3466506Z [9,850 / 15,235] 48 actions running 2025-03-14T05:43:01.3467435Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T05:43:01.3468404Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T05:43:01.3469320Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T05:43:01.3470244Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T05:43:01.3471159Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T05:43:01.3472322Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T05:43:01.3473316Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2025-03-14T05:43:01.3474132Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local ... 2025-03-14T05:43:01.5466683Z 2025-03-14T05:43:01.5467519Z  2025-03-14T05:43:01.5468028Z  2025-03-14T05:43:01.5468448Z  2025-03-14T05:43:01.5468879Z  2025-03-14T05:43:01.5469355Z  2025-03-14T05:43:01.5470094Z  2025-03-14T05:43:01.5470520Z  2025-03-14T05:43:01.5470946Z  2025-03-14T05:43:01.5471518Z [9,852 / 15,235] 48 actions running 2025-03-14T05:43:01.5472479Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T05:43:01.5473531Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T05:43:01.5474563Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T05:43:01.5475530Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T05:43:01.5476488Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2025-03-14T05:43:01.5477706Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T05:43:01.5478793Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2025-03-14T05:43:01.5479716Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local ... 2025-03-14T05:43:01.8677724Z 2025-03-14T05:43:01.8678627Z  2025-03-14T05:43:01.8679154Z  2025-03-14T05:43:01.8679588Z  2025-03-14T05:43:01.8680045Z  2025-03-14T05:43:01.8680441Z  2025-03-14T05:43:01.8680890Z  2025-03-14T05:43:01.8681301Z  2025-03-14T05:43:01.8681752Z  2025-03-14T05:43:01.8682364Z [9,853 / 15,235] 48 actions, 47 running 2025-03-14T05:43:01.8683303Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T05:43:01.8684341Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T05:43:01.8685497Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T05:43:01.8686435Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T05:43:01.8687389Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2025-03-14T05:43:01.8688542Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T05:43:01.8689928Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2025-03-14T05:43:01.8690817Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local ... 2025-03-14T05:43:02.1472988Z 2025-03-14T05:43:02.1473855Z  2025-03-14T05:43:02.1474313Z  2025-03-14T05:43:02.1474685Z  2025-03-14T05:43:02.1475080Z  2025-03-14T05:43:02.1475470Z  2025-03-14T05:43:02.1475881Z  2025-03-14T05:43:02.1476292Z  2025-03-14T05:43:02.1476705Z  2025-03-14T05:43:02.1477287Z [9,855 / 15,235] 48 actions running 2025-03-14T05:43:02.1478316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T05:43:02.1479290Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T05:43:02.1480242Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T05:43:02.1481242Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T05:43:02.1482149Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T05:43:02.1483187Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2025-03-14T05:43:02.1484028Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local 2025-03-14T05:43:02.1494307Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local ... 2025-03-14T05:43:02.6490958Z 2025-03-14T05:43:02.6491774Z  2025-03-14T05:43:02.6492315Z  2025-03-14T05:43:02.6492741Z  2025-03-14T05:43:02.6493155Z  2025-03-14T05:43:02.6493569Z  2025-03-14T05:43:02.6493978Z  2025-03-14T05:43:02.6494381Z  2025-03-14T05:43:02.6494800Z  2025-03-14T05:43:02.6495424Z [9,856 / 15,235] 48 actions, 47 running 2025-03-14T05:43:02.6496370Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T05:43:02.6497411Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T05:43:02.6498435Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T05:43:02.6499435Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T05:43:02.6500339Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T05:43:02.6501814Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2025-03-14T05:43:02.6502657Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2025-03-14T05:43:02.6503562Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local ... 2025-03-14T05:43:02.9489985Z 2025-03-14T05:43:02.9490830Z  2025-03-14T05:43:02.9491405Z  2025-03-14T05:43:02.9491883Z  2025-03-14T05:43:02.9492338Z  2025-03-14T05:43:02.9492809Z  2025-03-14T05:43:02.9493266Z  2025-03-14T05:43:02.9493631Z  2025-03-14T05:43:02.9493989Z  2025-03-14T05:43:02.9494563Z [9,856 / 15,235] 48 actions running 2025-03-14T05:43:02.9495463Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T05:43:02.9496380Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T05:43:02.9497237Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T05:43:02.9498082Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T05:43:02.9498893Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T05:43:02.9499843Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local 2025-03-14T05:43:02.9504218Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2025-03-14T05:43:02.9505107Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2025-03-14T05:43:03.3495931Z 2025-03-14T05:43:03.3496739Z  2025-03-14T05:43:03.3497253Z  2025-03-14T05:43:03.3497696Z  2025-03-14T05:43:03.3498121Z  2025-03-14T05:43:03.3498515Z  2025-03-14T05:43:03.3498908Z  2025-03-14T05:43:03.3499306Z  2025-03-14T05:43:03.3499717Z  2025-03-14T05:43:03.3500315Z [9,857 / 15,235] 48 actions running 2025-03-14T05:43:03.3501653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T05:43:03.3502702Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T05:43:03.3503688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T05:43:03.3504656Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T05:43:03.3505643Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T05:43:03.3506720Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2025-03-14T05:43:03.3507658Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2025-03-14T05:43:03.3508668Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local ... 2025-03-14T05:43:03.5511929Z 2025-03-14T05:43:03.5512759Z  2025-03-14T05:43:03.5513239Z  2025-03-14T05:43:03.5513650Z  2025-03-14T05:43:03.5514053Z  2025-03-14T05:43:03.5514455Z  2025-03-14T05:43:03.5514852Z  2025-03-14T05:43:03.5515257Z  2025-03-14T05:43:03.5515658Z  2025-03-14T05:43:03.5516296Z [9,858 / 15,235] 48 actions, 47 running 2025-03-14T05:43:03.5517254Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T05:43:03.5518320Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T05:43:03.5519338Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T05:43:03.5520304Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T05:43:03.5521274Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T05:43:03.5522301Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T05:43:03.5523246Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2025-03-14T05:43:03.5524282Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local ... 2025-03-14T05:43:03.9500435Z 2025-03-14T05:43:03.9501293Z  2025-03-14T05:43:03.9501812Z  2025-03-14T05:43:03.9502256Z  2025-03-14T05:43:03.9502690Z  2025-03-14T05:43:03.9503162Z  2025-03-14T05:43:03.9503597Z  2025-03-14T05:43:03.9504365Z  2025-03-14T05:43:03.9504792Z  2025-03-14T05:43:03.9505382Z [9,858 / 15,235] 48 actions running 2025-03-14T05:43:03.9506281Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T05:43:03.9507235Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T05:43:03.9511577Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T05:43:03.9512585Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T05:43:03.9513573Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T05:43:03.9514624Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T05:43:03.9515590Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2025-03-14T05:43:03.9516659Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local ... 2025-03-14T05:43:04.1506545Z 2025-03-14T05:43:04.1507375Z  2025-03-14T05:43:04.1507893Z  2025-03-14T05:43:04.1508323Z  2025-03-14T05:43:04.1508752Z  2025-03-14T05:43:04.1509163Z  2025-03-14T05:43:04.1509582Z  2025-03-14T05:43:04.1510016Z  2025-03-14T05:43:04.1510408Z  2025-03-14T05:43:04.1511006Z [9,860 / 15,235] 48 actions running 2025-03-14T05:43:04.1511971Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T05:43:04.1513042Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T05:43:04.1514101Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T05:43:04.1515046Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T05:43:04.1515967Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T05:43:04.1516953Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T05:43:04.1517875Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2025-03-14T05:43:04.1519289Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local ... 2025-03-14T05:43:04.3629983Z 2025-03-14T05:43:04.3630836Z  2025-03-14T05:43:04.3631355Z  2025-03-14T05:43:04.3631799Z  2025-03-14T05:43:04.3632230Z  2025-03-14T05:43:04.3632658Z  2025-03-14T05:43:04.3633088Z  2025-03-14T05:43:04.3633501Z  2025-03-14T05:43:04.3633897Z  2025-03-14T05:43:04.3634518Z [9,863 / 15,235] 48 actions, 47 running 2025-03-14T05:43:04.3635476Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T05:43:04.3636541Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T05:43:04.3637583Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T05:43:04.3638576Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T05:43:04.3639566Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T05:43:04.3640630Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T05:43:04.3641588Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2025-03-14T05:43:04.3642667Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local ... 2025-03-14T05:43:04.6848666Z 2025-03-14T05:43:04.6849507Z  2025-03-14T05:43:04.6849978Z  2025-03-14T05:43:04.6850394Z  2025-03-14T05:43:04.6850810Z  2025-03-14T05:43:04.6851222Z  2025-03-14T05:43:04.6851603Z  2025-03-14T05:43:04.6852006Z  2025-03-14T05:43:04.6852435Z  2025-03-14T05:43:04.6853029Z [9,865 / 15,235] 48 actions, 47 running 2025-03-14T05:43:04.6853965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T05:43:04.6854999Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T05:43:04.6855949Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T05:43:04.6856847Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T05:43:04.6857842Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T05:43:04.6859144Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T05:43:04.6860030Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2025-03-14T05:43:04.6861053Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local ... 2025-03-14T05:43:04.9512677Z 2025-03-14T05:43:04.9513533Z  2025-03-14T05:43:04.9514131Z  2025-03-14T05:43:04.9514639Z  2025-03-14T05:43:04.9515091Z  2025-03-14T05:43:04.9515491Z  2025-03-14T05:43:04.9515890Z  2025-03-14T05:43:04.9516397Z  2025-03-14T05:43:04.9516800Z  2025-03-14T05:43:04.9517389Z [9,865 / 15,235] 48 actions running 2025-03-14T05:43:04.9518357Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T05:43:04.9519343Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T05:43:04.9520383Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T05:43:04.9521339Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T05:43:04.9522260Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T05:43:04.9523374Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T05:43:04.9524284Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2025-03-14T05:43:04.9525526Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local ... 2025-03-14T05:43:05.1517702Z 2025-03-14T05:43:05.1518553Z  2025-03-14T05:43:05.1519062Z  2025-03-14T05:43:05.1519492Z  2025-03-14T05:43:05.1519896Z  2025-03-14T05:43:05.1520317Z  2025-03-14T05:43:05.1520749Z  2025-03-14T05:43:05.1521139Z  2025-03-14T05:43:05.1521540Z  2025-03-14T05:43:05.1522129Z [9,866 / 15,235] 48 actions running 2025-03-14T05:43:05.1523416Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T05:43:05.1524473Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T05:43:05.1525615Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T05:43:05.1526557Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T05:43:05.1527507Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T05:43:05.1528498Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T05:43:05.1529397Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2025-03-14T05:43:05.1530409Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local ... 2025-03-14T05:43:06.1526447Z 2025-03-14T05:43:06.1527289Z  2025-03-14T05:43:06.1527766Z  2025-03-14T05:43:06.1528170Z  2025-03-14T05:43:06.1528575Z  2025-03-14T05:43:06.1528939Z  2025-03-14T05:43:06.1529319Z  2025-03-14T05:43:06.1529698Z  2025-03-14T05:43:06.1530105Z  2025-03-14T05:43:06.1530711Z [9,866 / 15,235] 48 actions running 2025-03-14T05:43:06.1531641Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T05:43:06.1532627Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2025-03-14T05:43:06.1533611Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T05:43:06.1534534Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T05:43:06.1535466Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T05:43:06.1536418Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2025-03-14T05:43:06.1537329Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2025-03-14T05:43:06.1538305Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local ... 2025-03-14T05:43:06.6435966Z 2025-03-14T05:43:06.6436829Z  2025-03-14T05:43:06.6437326Z  2025-03-14T05:43:06.6437741Z  2025-03-14T05:43:06.6438141Z  2025-03-14T05:43:06.6438598Z  2025-03-14T05:43:06.6439002Z  2025-03-14T05:43:06.6439748Z  2025-03-14T05:43:06.6440162Z  2025-03-14T05:43:06.6440756Z [9,867 / 15,235] 48 actions, 47 running 2025-03-14T05:43:06.6441680Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T05:43:06.6442658Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T05:43:06.6443622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T05:43:06.6444551Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T05:43:06.6445618Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T05:43:06.6446598Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T05:43:06.6447492Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2025-03-14T05:43:06.6448477Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local ... 2025-03-14T05:43:06.8877418Z 2025-03-14T05:43:06.8878407Z  2025-03-14T05:43:06.8878847Z  2025-03-14T05:43:06.8879249Z  2025-03-14T05:43:06.8879606Z  2025-03-14T05:43:06.8879932Z  2025-03-14T05:43:06.8880283Z  2025-03-14T05:43:06.8880648Z  2025-03-14T05:43:06.8880997Z  2025-03-14T05:43:06.8881559Z [9,870 / 15,235] 48 actions, 47 running 2025-03-14T05:43:06.8882378Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T05:43:06.8883322Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T05:43:06.8884216Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T05:43:06.8885242Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T05:43:06.8886103Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T05:43:06.8887005Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T05:43:06.8887829Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2025-03-14T05:43:06.8889334Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local ... 2025-03-14T05:43:07.1536034Z 2025-03-14T05:43:07.1536858Z  2025-03-14T05:43:07.1537342Z  2025-03-14T05:43:07.1537763Z  2025-03-14T05:43:07.1538184Z  2025-03-14T05:43:07.1538594Z  2025-03-14T05:43:07.1539002Z  2025-03-14T05:43:07.1539419Z  2025-03-14T05:43:07.1539815Z  2025-03-14T05:43:07.1540390Z [9,870 / 15,235] 48 actions running 2025-03-14T05:43:07.1541343Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T05:43:07.1542373Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T05:43:07.1543303Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T05:43:07.1544237Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T05:43:07.1545156Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T05:43:07.1546310Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T05:43:07.1547267Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2025-03-14T05:43:07.1548317Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local ... 2025-03-14T05:43:07.4455380Z 2025-03-14T05:43:07.4456234Z  2025-03-14T05:43:07.4456699Z  2025-03-14T05:43:07.4457097Z  2025-03-14T05:43:07.4457511Z  2025-03-14T05:43:07.4457911Z  2025-03-14T05:43:07.4458320Z  2025-03-14T05:43:07.4458698Z  2025-03-14T05:43:07.4459110Z  2025-03-14T05:43:07.4459711Z [9,872 / 15,235] 48 actions, 47 running 2025-03-14T05:43:07.4460677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T05:43:07.4461855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T05:43:07.4462822Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T05:43:07.4463798Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T05:43:07.4464823Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T05:43:07.4466488Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2025-03-14T05:43:07.4467479Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T05:43:07.4468676Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local ... 2025-03-14T05:43:07.7542260Z 2025-03-14T05:43:07.7543068Z  2025-03-14T05:43:07.7543559Z  2025-03-14T05:43:07.7543970Z  2025-03-14T05:43:07.7544375Z  2025-03-14T05:43:07.7544796Z  2025-03-14T05:43:07.7545223Z  2025-03-14T05:43:07.7545642Z  2025-03-14T05:43:07.7546052Z  2025-03-14T05:43:07.7546619Z [9,872 / 15,235] 48 actions running 2025-03-14T05:43:07.7547540Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T05:43:07.7548679Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T05:43:07.7549693Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T05:43:07.7550650Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T05:43:07.7551580Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T05:43:07.7552425Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2025-03-14T05:43:07.7553379Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T05:43:07.7554405Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local ... 2025-03-14T05:43:07.9546726Z 2025-03-14T05:43:07.9547752Z  2025-03-14T05:43:07.9548320Z  2025-03-14T05:43:07.9548812Z  2025-03-14T05:43:07.9549293Z  2025-03-14T05:43:07.9549750Z  2025-03-14T05:43:07.9550224Z  2025-03-14T05:43:07.9550702Z  2025-03-14T05:43:07.9551172Z  2025-03-14T05:43:07.9551923Z [9,875 / 15,235] 48 actions running 2025-03-14T05:43:07.9553316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T05:43:07.9554720Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T05:43:07.9555662Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T05:43:07.9556582Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T05:43:07.9557452Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T05:43:07.9558146Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2025-03-14T05:43:07.9558917Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T05:43:07.9559703Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local ... 2025-03-14T05:43:08.1925062Z 2025-03-14T05:43:08.1925835Z  2025-03-14T05:43:08.1926328Z  2025-03-14T05:43:08.1926754Z  2025-03-14T05:43:08.1927176Z  2025-03-14T05:43:08.1927565Z  2025-03-14T05:43:08.1927903Z  2025-03-14T05:43:08.1928304Z  2025-03-14T05:43:08.1928692Z  2025-03-14T05:43:08.1929261Z [9,877 / 15,235] 48 actions, 47 running 2025-03-14T05:43:08.1930204Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T05:43:08.1931321Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T05:43:08.1932202Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T05:43:08.1933119Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T05:43:08.1934027Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T05:43:08.1934865Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2025-03-14T05:43:08.1935815Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T05:43:08.1936775Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local ... 2025-03-14T05:43:08.4091431Z 2025-03-14T05:43:08.4092214Z  2025-03-14T05:43:08.4092690Z  2025-03-14T05:43:08.4093109Z  2025-03-14T05:43:08.4093548Z  2025-03-14T05:43:08.4093948Z  2025-03-14T05:43:08.4094664Z  2025-03-14T05:43:08.4095072Z  2025-03-14T05:43:08.4095470Z  2025-03-14T05:43:08.4096057Z [9,880 / 15,235] 48 actions, 47 running 2025-03-14T05:43:08.4097002Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T05:43:08.4098148Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T05:43:08.4099088Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T05:43:08.4100024Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T05:43:08.4100942Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T05:43:08.4101804Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2025-03-14T05:43:08.4102790Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2025-03-14T05:43:08.4103821Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local ... 2025-03-14T05:43:08.6772991Z 2025-03-14T05:43:08.6773848Z  2025-03-14T05:43:08.6774425Z  2025-03-14T05:43:08.6774863Z  2025-03-14T05:43:08.6775327Z  2025-03-14T05:43:08.6775762Z  2025-03-14T05:43:08.6776190Z  2025-03-14T05:43:08.6776648Z  2025-03-14T05:43:08.6777078Z  2025-03-14T05:43:08.6777729Z [9,882 / 15,235] 48 actions, 47 running 2025-03-14T05:43:08.6778719Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T05:43:08.6779926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T05:43:08.6780891Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T05:43:08.6781826Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T05:43:08.6782883Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T05:43:08.6783829Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2025-03-14T05:43:08.6785141Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2025-03-14T05:43:08.6786177Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local ... 2025-03-14T05:43:08.9554262Z 2025-03-14T05:43:08.9555088Z  2025-03-14T05:43:08.9555574Z  2025-03-14T05:43:08.9555988Z  2025-03-14T05:43:08.9556420Z  2025-03-14T05:43:08.9556823Z  2025-03-14T05:43:08.9557227Z  2025-03-14T05:43:08.9557654Z  2025-03-14T05:43:08.9558066Z  2025-03-14T05:43:08.9558637Z [9,883 / 15,235] 48 actions running 2025-03-14T05:43:08.9559589Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T05:43:08.9560763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T05:43:08.9561721Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T05:43:08.9562649Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T05:43:08.9563678Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T05:43:08.9564547Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2025-03-14T05:43:08.9565904Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2025-03-14T05:43:08.9566915Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local ... 2025-03-14T05:43:09.1558291Z 2025-03-14T05:43:09.1559127Z  2025-03-14T05:43:09.1559634Z  2025-03-14T05:43:09.1560027Z  2025-03-14T05:43:09.1560427Z  2025-03-14T05:43:09.1560828Z  2025-03-14T05:43:09.1561226Z  2025-03-14T05:43:09.1561624Z  2025-03-14T05:43:09.1562019Z  2025-03-14T05:43:09.1562592Z [9,884 / 15,235] 48 actions running 2025-03-14T05:43:09.1563502Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T05:43:09.1564836Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T05:43:09.1566005Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T05:43:09.1567006Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T05:43:09.1568390Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T05:43:09.1569294Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2025-03-14T05:43:09.1570277Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2025-03-14T05:43:09.1571223Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local ... 2025-03-14T05:43:09.5194215Z 2025-03-14T05:43:09.5195096Z  2025-03-14T05:43:09.5195604Z  2025-03-14T05:43:09.5196012Z  2025-03-14T05:43:09.5196427Z  2025-03-14T05:43:09.5196794Z  2025-03-14T05:43:09.5197176Z  2025-03-14T05:43:09.5197575Z  2025-03-14T05:43:09.5197992Z  2025-03-14T05:43:09.5198582Z [9,887 / 15,235] 48 actions, 47 running 2025-03-14T05:43:09.5199496Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T05:43:09.5200664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T05:43:09.5201605Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T05:43:09.5202553Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T05:43:09.5203550Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T05:43:09.5204451Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2025-03-14T05:43:09.5205624Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T05:43:09.5206636Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local ... 2025-03-14T05:43:09.7565216Z 2025-03-14T05:43:09.7566254Z  2025-03-14T05:43:09.7566764Z  2025-03-14T05:43:09.7567167Z  2025-03-14T05:43:09.7567584Z  2025-03-14T05:43:09.7567973Z  2025-03-14T05:43:09.7568367Z  2025-03-14T05:43:09.7568742Z  2025-03-14T05:43:09.7569139Z  2025-03-14T05:43:09.7570024Z [9,887 / 15,235] 48 actions running 2025-03-14T05:43:09.7570957Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T05:43:09.7572069Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T05:43:09.7573007Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T05:43:09.7573902Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T05:43:09.7574934Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T05:43:09.7575818Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2025-03-14T05:43:09.7576788Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T05:43:09.7577764Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local ... 2025-03-14T05:43:09.9571649Z 2025-03-14T05:43:09.9572474Z  2025-03-14T05:43:09.9572979Z  2025-03-14T05:43:09.9573411Z  2025-03-14T05:43:09.9573849Z  2025-03-14T05:43:09.9574285Z  2025-03-14T05:43:09.9574918Z  2025-03-14T05:43:09.9575350Z  2025-03-14T05:43:09.9575786Z  2025-03-14T05:43:09.9576387Z [9,888 / 15,235] 48 actions running 2025-03-14T05:43:09.9577317Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T05:43:09.9578532Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T05:43:09.9579496Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T05:43:09.9580444Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T05:43:09.9581486Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T05:43:09.9582426Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2025-03-14T05:43:09.9583482Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T05:43:09.9584470Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local ... 2025-03-14T05:43:10.3575475Z 2025-03-14T05:43:10.3576295Z  2025-03-14T05:43:10.3576839Z  2025-03-14T05:43:10.3577285Z  2025-03-14T05:43:10.3577999Z  2025-03-14T05:43:10.3578409Z  2025-03-14T05:43:10.3578809Z  2025-03-14T05:43:10.3579198Z  2025-03-14T05:43:10.3579564Z  2025-03-14T05:43:10.3580100Z [9,891 / 15,235] 48 actions running 2025-03-14T05:43:10.3581043Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T05:43:10.3582219Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T05:43:10.3583156Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T05:43:10.3584084Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T05:43:10.3585077Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T05:43:10.3586014Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2025-03-14T05:43:10.3587040Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T05:43:10.3588095Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local ... 2025-03-14T05:43:10.5666192Z 2025-03-14T05:43:10.5667060Z  2025-03-14T05:43:10.5667586Z  2025-03-14T05:43:10.5668016Z  2025-03-14T05:43:10.5668441Z  2025-03-14T05:43:10.5668846Z  2025-03-14T05:43:10.5669268Z  2025-03-14T05:43:10.5669699Z  2025-03-14T05:43:10.5670112Z  2025-03-14T05:43:10.5670729Z [9,893 / 15,235] 48 actions, 47 running 2025-03-14T05:43:10.5671689Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T05:43:10.5672863Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T05:43:10.5673830Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T05:43:10.5674778Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T05:43:10.5675781Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T05:43:10.5677135Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2025-03-14T05:43:10.5678149Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2025-03-14T05:43:10.5679303Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local ... 2025-03-14T05:43:10.8247179Z 2025-03-14T05:43:10.8248016Z  2025-03-14T05:43:10.8248545Z  2025-03-14T05:43:10.8248957Z  2025-03-14T05:43:10.8249366Z  2025-03-14T05:43:10.8249788Z  2025-03-14T05:43:10.8250218Z  2025-03-14T05:43:10.8250647Z  2025-03-14T05:43:10.8251080Z  2025-03-14T05:43:10.8251814Z [9,895 / 15,235] 48 actions, 47 running 2025-03-14T05:43:10.8252784Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T05:43:10.8253897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T05:43:10.8254840Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T05:43:10.8255826Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T05:43:10.8256792Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T05:43:10.8257733Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T05:43:10.8258738Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2025-03-14T05:43:10.8259743Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 20s local ... 2025-03-14T05:43:11.1582104Z 2025-03-14T05:43:11.1582916Z  2025-03-14T05:43:11.1583423Z  2025-03-14T05:43:11.1583849Z  2025-03-14T05:43:11.1584266Z  2025-03-14T05:43:11.1584658Z  2025-03-14T05:43:11.1585085Z  2025-03-14T05:43:11.1585507Z  2025-03-14T05:43:11.1585927Z  2025-03-14T05:43:11.1586510Z [9,898 / 15,235] 48 actions running 2025-03-14T05:43:11.1587498Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T05:43:11.1588698Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T05:43:11.1589670Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T05:43:11.1590891Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T05:43:11.1591852Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T05:43:11.1592740Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T05:43:11.1593739Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2025-03-14T05:43:11.1594721Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local ... 2025-03-14T05:43:11.4772508Z 2025-03-14T05:43:11.4773407Z  2025-03-14T05:43:11.4773928Z  2025-03-14T05:43:11.4774268Z  2025-03-14T05:43:11.4774657Z  2025-03-14T05:43:11.4775067Z  2025-03-14T05:43:11.4775486Z  2025-03-14T05:43:11.4775911Z  2025-03-14T05:43:11.4776330Z  2025-03-14T05:43:11.4776959Z [9,899 / 15,235] 48 actions, 47 running 2025-03-14T05:43:11.4778005Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T05:43:11.4779212Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T05:43:11.4780111Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T05:43:11.4781019Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T05:43:11.4781990Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T05:43:11.4782886Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T05:43:11.4783853Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2025-03-14T05:43:11.4784813Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local ... 2025-03-14T05:43:11.7588630Z 2025-03-14T05:43:11.7589471Z  2025-03-14T05:43:11.7589937Z  2025-03-14T05:43:11.7590357Z  2025-03-14T05:43:11.7590754Z  2025-03-14T05:43:11.7591136Z  2025-03-14T05:43:11.7591543Z  2025-03-14T05:43:11.7591947Z  2025-03-14T05:43:11.7592336Z  2025-03-14T05:43:11.7593240Z [9,900 / 15,235] 48 actions running 2025-03-14T05:43:11.7594206Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T05:43:11.7595335Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T05:43:11.7596219Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T05:43:11.7597145Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T05:43:11.7598140Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T05:43:11.7598992Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T05:43:11.7599937Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2025-03-14T05:43:11.7600850Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local ... 2025-03-14T05:43:11.9949046Z 2025-03-14T05:43:11.9949879Z  2025-03-14T05:43:11.9950386Z  2025-03-14T05:43:11.9950902Z  2025-03-14T05:43:11.9951280Z  2025-03-14T05:43:11.9951725Z  2025-03-14T05:43:11.9952125Z  2025-03-14T05:43:11.9952555Z  2025-03-14T05:43:11.9952965Z  2025-03-14T05:43:11.9953563Z [9,903 / 15,235] 48 actions, 47 running 2025-03-14T05:43:11.9954489Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T05:43:11.9955703Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T05:43:11.9956458Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T05:43:11.9957326Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T05:43:11.9958308Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T05:43:11.9959175Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T05:43:11.9960135Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2025-03-14T05:43:11.9961065Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local ... 2025-03-14T05:43:12.2272179Z 2025-03-14T05:43:12.2273081Z  2025-03-14T05:43:12.2273561Z  2025-03-14T05:43:12.2274288Z  2025-03-14T05:43:12.2274655Z  2025-03-14T05:43:12.2275004Z  2025-03-14T05:43:12.2275410Z  2025-03-14T05:43:12.2275827Z  2025-03-14T05:43:12.2276235Z  2025-03-14T05:43:12.2276825Z [9,905 / 15,235] 48 actions, 47 running 2025-03-14T05:43:12.2277751Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T05:43:12.2278928Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T05:43:12.2279785Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T05:43:12.2280658Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T05:43:12.2281608Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T05:43:12.2282494Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T05:43:12.2283494Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2025-03-14T05:43:12.2284414Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 18s local ... 2025-03-14T05:43:12.5595482Z 2025-03-14T05:43:12.5596320Z  2025-03-14T05:43:12.5596801Z  2025-03-14T05:43:12.5597190Z  2025-03-14T05:43:12.5597597Z  2025-03-14T05:43:12.5597988Z  2025-03-14T05:43:12.5598380Z  2025-03-14T05:43:12.5598769Z  2025-03-14T05:43:12.5599168Z  2025-03-14T05:43:12.5599707Z [9,906 / 15,235] 48 actions running 2025-03-14T05:43:12.5600608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T05:43:12.5601759Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T05:43:12.5602646Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T05:43:12.5603553Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T05:43:12.5604501Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T05:43:12.5605949Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T05:43:12.5606873Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T05:43:12.5607753Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local ... 2025-03-14T05:43:12.9060988Z 2025-03-14T05:43:12.9061869Z  2025-03-14T05:43:12.9062379Z  2025-03-14T05:43:12.9062798Z  2025-03-14T05:43:12.9063208Z  2025-03-14T05:43:12.9063588Z  2025-03-14T05:43:12.9063969Z  2025-03-14T05:43:12.9064376Z  2025-03-14T05:43:12.9064757Z  2025-03-14T05:43:12.9065649Z [9,908 / 15,235] 48 actions, 47 running 2025-03-14T05:43:12.9066590Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T05:43:12.9067659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T05:43:12.9068580Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T05:43:12.9069489Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T05:43:12.9070441Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T05:43:12.9071308Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2025-03-14T05:43:12.9072220Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T05:43:12.9073118Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local ... 2025-03-14T05:43:13.1597638Z 2025-03-14T05:43:13.1598457Z  2025-03-14T05:43:13.1598886Z  2025-03-14T05:43:13.1599272Z  2025-03-14T05:43:13.1599644Z  2025-03-14T05:43:13.1600008Z  2025-03-14T05:43:13.1600364Z  2025-03-14T05:43:13.1600717Z  2025-03-14T05:43:13.1601090Z  2025-03-14T05:43:13.1601603Z [9,909 / 15,235] 48 actions running 2025-03-14T05:43:13.1602480Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T05:43:13.1603575Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T05:43:13.1604381Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T05:43:13.1605829Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T05:43:13.1606684Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T05:43:13.1607462Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2025-03-14T05:43:13.1608315Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T05:43:13.1609180Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local ... 2025-03-14T05:43:13.3602686Z 2025-03-14T05:43:13.3603513Z  2025-03-14T05:43:13.3603975Z  2025-03-14T05:43:13.3604351Z  2025-03-14T05:43:13.3604891Z  2025-03-14T05:43:13.3605297Z  2025-03-14T05:43:13.3605689Z  2025-03-14T05:43:13.3606088Z  2025-03-14T05:43:13.3606482Z  2025-03-14T05:43:13.3607025Z [9,910 / 15,235] 48 actions running 2025-03-14T05:43:13.3607975Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T05:43:13.3609098Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T05:43:13.3610002Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T05:43:13.3610923Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T05:43:13.3611887Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T05:43:13.3612675Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2025-03-14T05:43:13.3613667Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T05:43:13.3614595Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 19s local ... 2025-03-14T05:43:13.8476261Z 2025-03-14T05:43:13.8477332Z  2025-03-14T05:43:13.8477772Z  2025-03-14T05:43:13.8478147Z  2025-03-14T05:43:13.8478536Z  2025-03-14T05:43:13.8478902Z  2025-03-14T05:43:13.8479284Z  2025-03-14T05:43:13.8479643Z  2025-03-14T05:43:13.8480337Z  2025-03-14T05:43:13.8480906Z [9,911 / 15,235] 48 actions, 47 running 2025-03-14T05:43:13.8481779Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T05:43:13.8482803Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T05:43:13.8483641Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T05:43:13.8484442Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T05:43:13.8485485Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T05:43:13.8486275Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T05:43:13.8487153Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2025-03-14T05:43:13.8487989Z Compiling src/cpu/x64/jit_uni_pool_kernel.cpp; 20s local ... 2025-03-14T05:43:14.1611039Z 2025-03-14T05:43:14.1613101Z  2025-03-14T05:43:14.1613633Z  2025-03-14T05:43:14.1614054Z  2025-03-14T05:43:14.1614498Z  2025-03-14T05:43:14.1614901Z  2025-03-14T05:43:14.1615312Z  2025-03-14T05:43:14.1615709Z  2025-03-14T05:43:14.1616100Z  2025-03-14T05:43:14.1616682Z [9,912 / 15,235] 48 actions running 2025-03-14T05:43:14.1617646Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T05:43:14.1618800Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T05:43:14.1619750Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T05:43:14.1620693Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T05:43:14.1621673Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T05:43:14.1622576Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T05:43:14.1623538Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2025-03-14T05:43:14.1624526Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local ... 2025-03-14T05:43:14.3614843Z 2025-03-14T05:43:14.3615742Z  2025-03-14T05:43:14.3616547Z  2025-03-14T05:43:14.3616963Z  2025-03-14T05:43:14.3617352Z  2025-03-14T05:43:14.3617759Z  2025-03-14T05:43:14.3618153Z  2025-03-14T05:43:14.3618567Z  2025-03-14T05:43:14.3618970Z  2025-03-14T05:43:14.3619528Z [9,913 / 15,235] 48 actions running 2025-03-14T05:43:14.3620475Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T05:43:14.3621602Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T05:43:14.3622626Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T05:43:14.3623523Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T05:43:14.3624485Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T05:43:14.3625360Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T05:43:14.3626330Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2025-03-14T05:43:14.3627327Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local ... 2025-03-14T05:43:14.6512943Z 2025-03-14T05:43:14.6516883Z  2025-03-14T05:43:14.6517390Z  2025-03-14T05:43:14.6517833Z  2025-03-14T05:43:14.6518268Z  2025-03-14T05:43:14.6518695Z  2025-03-14T05:43:14.6519124Z  2025-03-14T05:43:14.6519559Z  2025-03-14T05:43:14.6519970Z  2025-03-14T05:43:14.6520618Z [9,916 / 15,235] 48 actions, 47 running 2025-03-14T05:43:14.6521620Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T05:43:14.6522871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T05:43:14.6523878Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T05:43:14.6524878Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T05:43:14.6526176Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T05:43:14.6527258Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T05:43:14.6528278Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2025-03-14T05:43:14.6529264Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local ... 2025-03-14T05:43:14.9406436Z 2025-03-14T05:43:14.9407400Z  2025-03-14T05:43:14.9409259Z  2025-03-14T05:43:14.9409696Z  2025-03-14T05:43:14.9410074Z  2025-03-14T05:43:14.9410435Z  2025-03-14T05:43:14.9410775Z  2025-03-14T05:43:14.9411124Z  2025-03-14T05:43:14.9411478Z  2025-03-14T05:43:14.9412021Z [9,920 / 15,235] 48 actions, 47 running 2025-03-14T05:43:14.9412847Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T05:43:14.9413869Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T05:43:14.9414704Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T05:43:14.9415658Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T05:43:14.9416544Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T05:43:14.9417353Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T05:43:14.9418227Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2025-03-14T05:43:14.9419111Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local ... 2025-03-14T05:43:15.1621584Z 2025-03-14T05:43:15.1622409Z  2025-03-14T05:43:15.1622881Z  2025-03-14T05:43:15.1623263Z  2025-03-14T05:43:15.1623654Z  2025-03-14T05:43:15.1624044Z  2025-03-14T05:43:15.1624429Z  2025-03-14T05:43:15.1624815Z  2025-03-14T05:43:15.1625250Z  2025-03-14T05:43:15.1625843Z [9,921 / 15,235] 48 actions running 2025-03-14T05:43:15.1626779Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T05:43:15.1627955Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T05:43:15.1629183Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T05:43:15.1630050Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T05:43:15.1630964Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T05:43:15.1631820Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T05:43:15.1632744Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2025-03-14T05:43:15.1633585Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local ... 2025-03-14T05:43:15.4669118Z 2025-03-14T05:43:15.4669979Z  2025-03-14T05:43:15.4670453Z  2025-03-14T05:43:15.4680697Z  2025-03-14T05:43:15.4681160Z  2025-03-14T05:43:15.4681548Z  2025-03-14T05:43:15.4681938Z  2025-03-14T05:43:15.4682326Z  2025-03-14T05:43:15.4682709Z  2025-03-14T05:43:15.4683277Z [9,924 / 15,235] 48 actions, 47 running 2025-03-14T05:43:15.4684805Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T05:43:15.4685934Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T05:43:15.4686792Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T05:43:15.4687660Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T05:43:15.4688578Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T05:43:15.4689441Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T05:43:15.4690373Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T05:43:15.4691214Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T05:43:15.7555584Z 2025-03-14T05:43:15.7556390Z  2025-03-14T05:43:15.7556897Z  2025-03-14T05:43:15.7557320Z  2025-03-14T05:43:15.7557722Z  2025-03-14T05:43:15.7558112Z  2025-03-14T05:43:15.7558528Z  2025-03-14T05:43:15.7559270Z  2025-03-14T05:43:15.7559831Z  2025-03-14T05:43:15.7560464Z [9,925 / 15,235] 48 actions, 47 running 2025-03-14T05:43:15.7561348Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T05:43:15.7562475Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T05:43:15.7563381Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T05:43:15.7564221Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T05:43:15.7565529Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T05:43:15.7566425Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T05:43:15.7567391Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T05:43:15.7568305Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T05:43:15.9629837Z 2025-03-14T05:43:15.9630634Z  2025-03-14T05:43:15.9631127Z  2025-03-14T05:43:15.9631569Z  2025-03-14T05:43:15.9631987Z  2025-03-14T05:43:15.9632406Z  2025-03-14T05:43:15.9632802Z  2025-03-14T05:43:15.9633196Z  2025-03-14T05:43:15.9633580Z  2025-03-14T05:43:15.9634129Z [9,925 / 15,235] 48 actions running 2025-03-14T05:43:15.9635041Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T05:43:15.9636186Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T05:43:15.9637217Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T05:43:15.9638130Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T05:43:15.9639069Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T05:43:15.9639917Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T05:43:15.9640832Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T05:43:15.9641766Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T05:43:16.1634278Z 2025-03-14T05:43:16.1635464Z  2025-03-14T05:43:16.1635951Z  2025-03-14T05:43:16.1636356Z  2025-03-14T05:43:16.1636760Z  2025-03-14T05:43:16.1637158Z  2025-03-14T05:43:16.1637582Z  2025-03-14T05:43:16.1637987Z  2025-03-14T05:43:16.1638387Z  2025-03-14T05:43:16.1638972Z [9,926 / 15,235] 48 actions running 2025-03-14T05:43:16.1639874Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T05:43:16.1641067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T05:43:16.1642007Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T05:43:16.1642962Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T05:43:16.1643934Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T05:43:16.1644963Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T05:43:16.1645984Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T05:43:16.1646950Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T05:43:16.3843588Z 2025-03-14T05:43:16.3844400Z  2025-03-14T05:43:16.3844986Z  2025-03-14T05:43:16.3845397Z  2025-03-14T05:43:16.3845771Z  2025-03-14T05:43:16.3846199Z  2025-03-14T05:43:16.3846609Z  2025-03-14T05:43:16.3847030Z  2025-03-14T05:43:16.3847446Z  2025-03-14T05:43:16.3848184Z [9,928 / 15,235] 48 actions, 47 running 2025-03-14T05:43:16.3849150Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T05:43:16.3850218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T05:43:16.3851097Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T05:43:16.3851952Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T05:43:16.3853259Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T05:43:16.3854251Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T05:43:16.3855270Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T05:43:16.3856123Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T05:43:16.6358959Z 2025-03-14T05:43:16.6359820Z  2025-03-14T05:43:16.6360298Z  2025-03-14T05:43:16.6360831Z  2025-03-14T05:43:16.6361246Z  2025-03-14T05:43:16.6361651Z  2025-03-14T05:43:16.6362067Z  2025-03-14T05:43:16.6362459Z  2025-03-14T05:43:16.6362855Z  2025-03-14T05:43:16.6363437Z [9,930 / 15,235] 48 actions, 47 running 2025-03-14T05:43:16.6364366Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T05:43:16.6365860Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T05:43:16.6366720Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T05:43:16.6367595Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T05:43:16.6368510Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T05:43:16.6369362Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T05:43:16.6370267Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T05:43:16.6371096Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local ... 2025-03-14T05:43:16.9641110Z 2025-03-14T05:43:16.9642599Z  2025-03-14T05:43:16.9643332Z  2025-03-14T05:43:16.9644032Z  2025-03-14T05:43:16.9645257Z  2025-03-14T05:43:16.9645700Z  2025-03-14T05:43:16.9646050Z  2025-03-14T05:43:16.9646410Z  2025-03-14T05:43:16.9646764Z  2025-03-14T05:43:16.9647400Z [9,930 / 15,235] 48 actions running 2025-03-14T05:43:16.9648236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T05:43:16.9649255Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T05:43:16.9650468Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T05:43:16.9651381Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T05:43:16.9652295Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T05:43:16.9653095Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T05:43:16.9654121Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T05:43:16.9655105Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local ... 2025-03-14T05:43:17.1656447Z 2025-03-14T05:43:17.1657312Z  2025-03-14T05:43:17.1657841Z  2025-03-14T05:43:17.1658267Z  2025-03-14T05:43:17.1658682Z  2025-03-14T05:43:17.1659066Z  2025-03-14T05:43:17.1659468Z  2025-03-14T05:43:17.1659866Z  2025-03-14T05:43:17.1660285Z  2025-03-14T05:43:17.1660925Z [9,932 / 15,235] 48 actions, 47 running 2025-03-14T05:43:17.1662025Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T05:43:17.1663088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T05:43:17.1663891Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T05:43:17.1664721Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T05:43:17.1665771Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T05:43:17.1666550Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T05:43:17.1667405Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T05:43:17.1668208Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local ... 2025-03-14T05:43:17.5648972Z 2025-03-14T05:43:17.5649895Z  2025-03-14T05:43:17.5651596Z  2025-03-14T05:43:17.5652039Z  2025-03-14T05:43:17.5652438Z  2025-03-14T05:43:17.5652797Z  2025-03-14T05:43:17.5653156Z  2025-03-14T05:43:17.5653812Z  2025-03-14T05:43:17.5654174Z  2025-03-14T05:43:17.5654703Z [9,932 / 15,235] 48 actions running 2025-03-14T05:43:17.5655560Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T05:43:17.5656622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T05:43:17.5657462Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T05:43:17.5658282Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T05:43:17.5659154Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T05:43:17.5659947Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T05:43:17.5660835Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T05:43:17.5661684Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local ... 2025-03-14T05:43:17.8655176Z 2025-03-14T05:43:17.8656000Z  2025-03-14T05:43:17.8656405Z  2025-03-14T05:43:17.8656741Z  2025-03-14T05:43:17.8657156Z  2025-03-14T05:43:17.8657554Z  2025-03-14T05:43:17.8657922Z  2025-03-14T05:43:17.8658295Z  2025-03-14T05:43:17.8658668Z  2025-03-14T05:43:17.8659237Z [9,933 / 15,235] 48 actions, 47 running 2025-03-14T05:43:17.8660118Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T05:43:17.8661201Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T05:43:17.8662118Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T05:43:17.8662993Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2025-03-14T05:43:17.8663902Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T05:43:17.8664770Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T05:43:17.8666004Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T05:43:17.8666736Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local ... 2025-03-14T05:43:18.1654838Z 2025-03-14T05:43:18.1655679Z  2025-03-14T05:43:18.1656610Z  2025-03-14T05:43:18.1657019Z  2025-03-14T05:43:18.1657417Z  2025-03-14T05:43:18.1657811Z  2025-03-14T05:43:18.1658203Z  2025-03-14T05:43:18.1658603Z  2025-03-14T05:43:18.1658999Z  2025-03-14T05:43:18.1659574Z [9,936 / 15,235] 48 actions running 2025-03-14T05:43:18.1660485Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T05:43:18.1661657Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T05:43:18.1662601Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T05:43:18.1663528Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2025-03-14T05:43:18.1664525Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T05:43:18.1665765Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T05:43:18.1666849Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T05:43:18.1667790Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local ... 2025-03-14T05:43:18.4741765Z 2025-03-14T05:43:18.4742641Z  2025-03-14T05:43:18.4743112Z  2025-03-14T05:43:18.4743505Z  2025-03-14T05:43:18.4743900Z  2025-03-14T05:43:18.4744297Z  2025-03-14T05:43:18.4744694Z  2025-03-14T05:43:18.4745085Z  2025-03-14T05:43:18.4745488Z  2025-03-14T05:43:18.4746099Z [9,937 / 15,235] 48 actions, 47 running 2025-03-14T05:43:18.4747021Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T05:43:18.4748158Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T05:43:18.4749053Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T05:43:18.4749938Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2025-03-14T05:43:18.4751266Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T05:43:18.4752166Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T05:43:18.4753127Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T05:43:18.4753991Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local ... 2025-03-14T05:43:18.7662258Z 2025-03-14T05:43:18.7663163Z  2025-03-14T05:43:18.7664904Z  2025-03-14T05:43:18.7665728Z  2025-03-14T05:43:18.7666175Z  2025-03-14T05:43:18.7666566Z  2025-03-14T05:43:18.7666945Z  2025-03-14T05:43:18.7667335Z  2025-03-14T05:43:18.7667745Z  2025-03-14T05:43:18.7668305Z [9,938 / 15,235] 48 actions running 2025-03-14T05:43:18.7669218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T05:43:18.7670331Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T05:43:18.7671226Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2025-03-14T05:43:18.7672172Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T05:43:18.7673136Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T05:43:18.7674037Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T05:43:18.7674973Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T05:43:18.7675864Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local ... 2025-03-14T05:43:19.0323953Z 2025-03-14T05:43:19.0324947Z  2025-03-14T05:43:19.0325442Z  2025-03-14T05:43:19.0325835Z  2025-03-14T05:43:19.0326246Z  2025-03-14T05:43:19.0326651Z  2025-03-14T05:43:19.0327056Z  2025-03-14T05:43:19.0327449Z  2025-03-14T05:43:19.0327849Z  2025-03-14T05:43:19.0328465Z [9,940 / 15,235] 48 actions, 47 running 2025-03-14T05:43:19.0329349Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T05:43:19.0330521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T05:43:19.0331398Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2025-03-14T05:43:19.0332621Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T05:43:19.0333564Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T05:43:19.0334474Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T05:43:19.0335295Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T05:43:19.0336075Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local ... 2025-03-14T05:43:19.3555439Z 2025-03-14T05:43:19.3556293Z  2025-03-14T05:43:19.3556759Z  2025-03-14T05:43:19.3557173Z  2025-03-14T05:43:19.3557572Z  2025-03-14T05:43:19.3557973Z  2025-03-14T05:43:19.3558371Z  2025-03-14T05:43:19.3558773Z  2025-03-14T05:43:19.3559179Z  2025-03-14T05:43:19.3559780Z [9,941 / 15,235] 48 actions, 47 running 2025-03-14T05:43:19.3560759Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T05:43:19.3561812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T05:43:19.3562611Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2025-03-14T05:43:19.3563461Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T05:43:19.3564441Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T05:43:19.3565655Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T05:43:19.3566555Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T05:43:19.3567541Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local ... 2025-03-14T05:43:19.5668358Z 2025-03-14T05:43:19.5669166Z  2025-03-14T05:43:19.5669669Z  2025-03-14T05:43:19.5670075Z  2025-03-14T05:43:19.5670489Z  2025-03-14T05:43:19.5670907Z  2025-03-14T05:43:19.5671341Z  2025-03-14T05:43:19.5671762Z  2025-03-14T05:43:19.5672495Z  2025-03-14T05:43:19.5673110Z [9,942 / 15,235] 48 actions running 2025-03-14T05:43:19.5674069Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T05:43:19.5675224Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T05:43:19.5676154Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T05:43:19.5677084Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T05:43:19.5678085Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T05:43:19.5679018Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T05:43:19.5679951Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T05:43:19.5681009Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local ... 2025-03-14T05:43:19.9058032Z 2025-03-14T05:43:19.9058896Z  2025-03-14T05:43:19.9059393Z  2025-03-14T05:43:19.9059802Z  2025-03-14T05:43:19.9060210Z  2025-03-14T05:43:19.9060619Z  2025-03-14T05:43:19.9061050Z  2025-03-14T05:43:19.9061431Z  2025-03-14T05:43:19.9061790Z  2025-03-14T05:43:19.9062392Z [9,943 / 15,235] 48 actions, 47 running 2025-03-14T05:43:19.9063245Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T05:43:19.9064390Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T05:43:19.9065591Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T05:43:19.9069578Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T05:43:19.9070482Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T05:43:19.9071271Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T05:43:19.9072177Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T05:43:19.9073070Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local ... 2025-03-14T05:43:20.1252035Z 2025-03-14T05:43:20.1252981Z  2025-03-14T05:43:20.1253802Z  2025-03-14T05:43:20.1255051Z  2025-03-14T05:43:20.1255463Z  2025-03-14T05:43:20.1255895Z  2025-03-14T05:43:20.1256305Z  2025-03-14T05:43:20.1256690Z  2025-03-14T05:43:20.1257106Z  2025-03-14T05:43:20.1257711Z [9,944 / 15,235] 48 actions, 47 running 2025-03-14T05:43:20.1258686Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T05:43:20.1259846Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T05:43:20.1260787Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T05:43:20.1261725Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T05:43:20.1262732Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T05:43:20.1263655Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T05:43:20.1264597Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T05:43:20.1265738Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local ... 2025-03-14T05:43:20.3344896Z 2025-03-14T05:43:20.3346229Z  2025-03-14T05:43:20.3346737Z  2025-03-14T05:43:20.3347157Z  2025-03-14T05:43:20.3347565Z  2025-03-14T05:43:20.3347940Z  2025-03-14T05:43:20.3348354Z  2025-03-14T05:43:20.3348769Z  2025-03-14T05:43:20.3349179Z  2025-03-14T05:43:20.3349764Z [9,948 / 15,235] 48 actions, 47 running 2025-03-14T05:43:20.3350740Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T05:43:20.3352077Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T05:43:20.3353064Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T05:43:20.3354057Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T05:43:20.3355105Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T05:43:20.3356364Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T05:43:20.3357160Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T05:43:20.3357878Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local ... 2025-03-14T05:43:20.5421081Z 2025-03-14T05:43:20.5422003Z  2025-03-14T05:43:20.5422493Z  2025-03-14T05:43:20.5424451Z  2025-03-14T05:43:20.5427293Z  2025-03-14T05:43:20.5430173Z  2025-03-14T05:43:20.5430833Z  2025-03-14T05:43:20.5431404Z  2025-03-14T05:43:20.5431958Z  2025-03-14T05:43:20.5432691Z [9,949 / 15,235] 48 actions, 47 running 2025-03-14T05:43:20.5433767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T05:43:20.5434990Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T05:43:20.5435998Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T05:43:20.5437107Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T05:43:20.5438247Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T05:43:20.5439214Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T05:43:20.5440201Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 24s local 2025-03-14T05:43:20.5441156Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local ... 2025-03-14T05:43:20.7677058Z 2025-03-14T05:43:20.7678264Z  2025-03-14T05:43:20.7678887Z  2025-03-14T05:43:20.7679922Z  2025-03-14T05:43:20.7680373Z  2025-03-14T05:43:20.7680788Z  2025-03-14T05:43:20.7681197Z  2025-03-14T05:43:20.7681589Z  2025-03-14T05:43:20.7681995Z  2025-03-14T05:43:20.7682563Z [9,950 / 15,235] 48 actions running 2025-03-14T05:43:20.7683512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T05:43:20.7684853Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T05:43:20.7685896Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T05:43:20.7687287Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T05:43:20.7688277Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T05:43:20.7689207Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T05:43:20.7690179Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T05:43:20.7691171Z Compiling xla/literal_comparison.cc; 12s local ... 2025-03-14T05:43:20.9683868Z 2025-03-14T05:43:20.9684885Z  2025-03-14T05:43:20.9685402Z  2025-03-14T05:43:20.9685810Z  2025-03-14T05:43:20.9686228Z  2025-03-14T05:43:20.9686639Z  2025-03-14T05:43:20.9687045Z  2025-03-14T05:43:20.9687469Z  2025-03-14T05:43:20.9687861Z  2025-03-14T05:43:20.9688426Z [9,952 / 15,235] 48 actions running 2025-03-14T05:43:20.9689377Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T05:43:20.9690633Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T05:43:20.9691601Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T05:43:20.9692537Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T05:43:20.9693574Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T05:43:20.9694491Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T05:43:20.9695492Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T05:43:20.9696399Z Compiling xla/literal_comparison.cc; 12s local ... 2025-03-14T05:43:21.2376194Z 2025-03-14T05:43:21.2377072Z  2025-03-14T05:43:21.2377579Z  2025-03-14T05:43:21.2378006Z  2025-03-14T05:43:21.2378421Z  2025-03-14T05:43:21.2378831Z  2025-03-14T05:43:21.2379258Z  2025-03-14T05:43:21.2379690Z  2025-03-14T05:43:21.2380102Z  2025-03-14T05:43:21.2381074Z [9,954 / 15,235] 48 actions, 47 running 2025-03-14T05:43:21.2382096Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T05:43:21.2383215Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T05:43:21.2384129Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T05:43:21.2385017Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T05:43:21.2386012Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T05:43:21.2387060Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T05:43:21.2388063Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T05:43:21.2388965Z Compiling xla/literal_comparison.cc; 13s local ... 2025-03-14T05:43:21.4522603Z 2025-03-14T05:43:21.4523433Z  2025-03-14T05:43:21.4523896Z  2025-03-14T05:43:21.4524278Z  2025-03-14T05:43:21.4524816Z  2025-03-14T05:43:21.4525260Z  2025-03-14T05:43:21.4525672Z  2025-03-14T05:43:21.4526110Z  2025-03-14T05:43:21.4526655Z  2025-03-14T05:43:21.4527297Z [9,957 / 15,235] 48 actions, 47 running 2025-03-14T05:43:21.4528248Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T05:43:21.4529473Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T05:43:21.4530483Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T05:43:21.4531451Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T05:43:21.4532475Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T05:43:21.4533412Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T05:43:21.4534358Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T05:43:21.4535207Z Compiling xla/literal_comparison.cc; 13s local ... 2025-03-14T05:43:21.7515031Z 2025-03-14T05:43:21.7516052Z  2025-03-14T05:43:21.7516619Z  2025-03-14T05:43:21.7517035Z  2025-03-14T05:43:21.7517800Z  2025-03-14T05:43:21.7518230Z  2025-03-14T05:43:21.7518657Z  2025-03-14T05:43:21.7519078Z  2025-03-14T05:43:21.7519475Z  2025-03-14T05:43:21.7520080Z [9,958 / 15,235] 48 actions, 47 running 2025-03-14T05:43:21.7521057Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T05:43:21.7522167Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T05:43:21.7523182Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T05:43:21.7524192Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T05:43:21.7525430Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T05:43:21.7526370Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T05:43:21.7527339Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T05:43:21.7528250Z Compiling xla/literal_comparison.cc; 13s local ... 2025-03-14T05:43:21.9588375Z 2025-03-14T05:43:21.9589209Z  2025-03-14T05:43:21.9589698Z  2025-03-14T05:43:21.9590121Z  2025-03-14T05:43:21.9590539Z  2025-03-14T05:43:21.9590927Z  2025-03-14T05:43:21.9591308Z  2025-03-14T05:43:21.9591700Z  2025-03-14T05:43:21.9592088Z  2025-03-14T05:43:21.9592681Z [9,960 / 15,235] 48 actions, 47 running 2025-03-14T05:43:21.9593626Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T05:43:21.9594718Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T05:43:21.9595614Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T05:43:21.9596486Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T05:43:21.9597427Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T05:43:21.9598635Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T05:43:21.9599566Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T05:43:21.9600379Z Compiling xla/literal_comparison.cc; 13s local ... 2025-03-14T05:43:22.1693341Z 2025-03-14T05:43:22.1694173Z  2025-03-14T05:43:22.1694648Z  2025-03-14T05:43:22.1695067Z  2025-03-14T05:43:22.1695476Z  2025-03-14T05:43:22.1695890Z  2025-03-14T05:43:22.1696297Z  2025-03-14T05:43:22.1696677Z  2025-03-14T05:43:22.1697089Z  2025-03-14T05:43:22.1697672Z [9,961 / 15,235] 48 actions running 2025-03-14T05:43:22.1698545Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T05:43:22.1699686Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T05:43:22.1700572Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T05:43:22.1701458Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T05:43:22.1702421Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T05:43:22.1703330Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T05:43:22.1704282Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T05:43:22.1705050Z Compiling xla/literal_comparison.cc; 13s local ... 2025-03-14T05:43:22.5701088Z 2025-03-14T05:43:22.5701936Z  2025-03-14T05:43:22.5702364Z  2025-03-14T05:43:22.5702714Z  2025-03-14T05:43:22.5703051Z  2025-03-14T05:43:22.5703381Z  2025-03-14T05:43:22.5703706Z  2025-03-14T05:43:22.5704037Z  2025-03-14T05:43:22.5704370Z  2025-03-14T05:43:22.5704830Z [9,962 / 15,235] 48 actions running 2025-03-14T05:43:22.5705574Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T05:43:22.5706464Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T05:43:22.5707309Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T05:43:22.5708004Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T05:43:22.5709093Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T05:43:22.5709756Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T05:43:22.5710460Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T05:43:22.5711086Z Compiling xla/literal_comparison.cc; 14s local ... 2025-03-14T05:43:23.0765455Z 2025-03-14T05:43:23.0766311Z  2025-03-14T05:43:23.0766799Z  2025-03-14T05:43:23.0767195Z  2025-03-14T05:43:23.0767598Z  2025-03-14T05:43:23.0768000Z  2025-03-14T05:43:23.0768409Z  2025-03-14T05:43:23.0768808Z  2025-03-14T05:43:23.0769212Z  2025-03-14T05:43:23.0769776Z [9,963 / 15,235] 48 actions, 47 running 2025-03-14T05:43:23.0770700Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T05:43:23.0771900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T05:43:23.0772810Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T05:43:23.0773705Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T05:43:23.0774658Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T05:43:23.0775604Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T05:43:23.0776514Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T05:43:23.0777375Z Compiling xla/literal_comparison.cc; 14s local ... 2025-03-14T05:43:23.2815061Z 2025-03-14T05:43:23.2815839Z  2025-03-14T05:43:23.2816295Z  2025-03-14T05:43:23.2816683Z  2025-03-14T05:43:23.2817062Z  2025-03-14T05:43:23.2817457Z  2025-03-14T05:43:23.2817942Z  2025-03-14T05:43:23.2818320Z  2025-03-14T05:43:23.2818691Z  2025-03-14T05:43:23.2819237Z [9,965 / 15,235] 48 actions, 47 running 2025-03-14T05:43:23.2820440Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T05:43:23.2821481Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T05:43:23.2822275Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T05:43:23.2823137Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T05:43:23.2824001Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T05:43:23.2824788Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T05:43:23.2825630Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T05:43:23.2826386Z Compiling xla/literal_comparison.cc; 15s local ... 2025-03-14T05:43:23.5710118Z 2025-03-14T05:43:23.5710986Z  2025-03-14T05:43:23.5711510Z  2025-03-14T05:43:23.5711930Z  2025-03-14T05:43:23.5712342Z  2025-03-14T05:43:23.5712764Z  2025-03-14T05:43:23.5713172Z  2025-03-14T05:43:23.5713614Z  2025-03-14T05:43:23.5714030Z  2025-03-14T05:43:23.5714620Z [9,966 / 15,235] 48 actions running 2025-03-14T05:43:23.5715563Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T05:43:23.5716727Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T05:43:23.5717691Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T05:43:23.5718611Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T05:43:23.5719590Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T05:43:23.5720692Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T05:43:23.5721633Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T05:43:23.5722444Z Compiling xla/literal_comparison.cc; 15s local ... 2025-03-14T05:43:23.9715283Z 2025-03-14T05:43:23.9716138Z  2025-03-14T05:43:23.9716631Z  2025-03-14T05:43:23.9717027Z  2025-03-14T05:43:23.9717473Z  2025-03-14T05:43:23.9717866Z  2025-03-14T05:43:23.9718619Z  2025-03-14T05:43:23.9719023Z  2025-03-14T05:43:23.9719413Z  2025-03-14T05:43:23.9719977Z [9,969 / 15,235] 48 actions running 2025-03-14T05:43:23.9720881Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T05:43:23.9721989Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T05:43:23.9722915Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T05:43:23.9723841Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T05:43:23.9724951Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T05:43:23.9725843Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T05:43:23.9726761Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T05:43:23.9727589Z Compiling xla/literal_comparison.cc; 15s local ... 2025-03-14T05:43:24.2294566Z 2025-03-14T05:43:24.2295367Z  2025-03-14T05:43:24.2295889Z  2025-03-14T05:43:24.2296287Z  2025-03-14T05:43:24.2296696Z  2025-03-14T05:43:24.2297104Z  2025-03-14T05:43:24.2297508Z  2025-03-14T05:43:24.2297915Z  2025-03-14T05:43:24.2298302Z  2025-03-14T05:43:24.2298892Z [9,970 / 15,235] 48 actions, 47 running 2025-03-14T05:43:24.2299824Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T05:43:24.2300983Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T05:43:24.2301891Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T05:43:24.2302802Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T05:43:24.2303753Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T05:43:24.2304632Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T05:43:24.2305918Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T05:43:24.2306786Z Compiling xla/literal_comparison.cc; 16s local ... 2025-03-14T05:43:24.4745952Z 2025-03-14T05:43:24.4746818Z  2025-03-14T05:43:24.4747301Z  2025-03-14T05:43:24.4747699Z  2025-03-14T05:43:24.4748081Z  2025-03-14T05:43:24.4748464Z  2025-03-14T05:43:24.4748857Z  2025-03-14T05:43:24.4749241Z  2025-03-14T05:43:24.4749644Z  2025-03-14T05:43:24.4750236Z [9,972 / 15,235] 48 actions, 47 running 2025-03-14T05:43:24.4751186Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T05:43:24.4752312Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T05:43:24.4753289Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T05:43:24.4754283Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T05:43:24.4755301Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T05:43:24.4756225Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T05:43:24.4757223Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T05:43:24.4758073Z Compiling xla/literal_comparison.cc; 16s local ... 2025-03-14T05:43:24.7723596Z 2025-03-14T05:43:24.7724435Z  2025-03-14T05:43:24.7725121Z  2025-03-14T05:43:24.7725545Z  2025-03-14T05:43:24.7725950Z  2025-03-14T05:43:24.7726362Z  2025-03-14T05:43:24.7726751Z  2025-03-14T05:43:24.7727118Z  2025-03-14T05:43:24.7727499Z  2025-03-14T05:43:24.7728013Z [9,973 / 15,235] 48 actions running 2025-03-14T05:43:24.7728926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T05:43:24.7730044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T05:43:24.7731002Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T05:43:24.7731989Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T05:43:24.7732977Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T05:43:24.7734273Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T05:43:24.7735185Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T05:43:24.7736016Z Compiling xla/literal_comparison.cc; 16s local ... 2025-03-14T05:43:24.9728382Z 2025-03-14T05:43:24.9729233Z  2025-03-14T05:43:24.9729749Z  2025-03-14T05:43:24.9730161Z  2025-03-14T05:43:24.9730547Z  2025-03-14T05:43:24.9730959Z  2025-03-14T05:43:24.9731369Z  2025-03-14T05:43:24.9731777Z  2025-03-14T05:43:24.9732172Z  2025-03-14T05:43:24.9732771Z [9,976 / 15,235] 48 actions running 2025-03-14T05:43:24.9733706Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T05:43:24.9734965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T05:43:24.9736077Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T05:43:24.9736995Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T05:43:24.9737962Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T05:43:24.9738821Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T05:43:24.9739769Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T05:43:24.9740592Z Compiling xla/literal_comparison.cc; 16s local ... 2025-03-14T05:43:25.2119098Z 2025-03-14T05:43:25.2119926Z  2025-03-14T05:43:25.2120406Z  2025-03-14T05:43:25.2120809Z  2025-03-14T05:43:25.2121192Z  2025-03-14T05:43:25.2121582Z  2025-03-14T05:43:25.2121975Z  2025-03-14T05:43:25.2122359Z  2025-03-14T05:43:25.2122764Z  2025-03-14T05:43:25.2123356Z [9,982 / 15,235] 48 actions, 47 running 2025-03-14T05:43:25.2124860Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T05:43:25.2126033Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T05:43:25.2126953Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T05:43:25.2127836Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T05:43:25.2128810Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T05:43:25.2129716Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T05:43:25.2130666Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T05:43:25.2131483Z Compiling xla/literal_comparison.cc; 17s local ... 2025-03-14T05:43:25.5191344Z 2025-03-14T05:43:25.5192149Z  2025-03-14T05:43:25.5192600Z  2025-03-14T05:43:25.5193007Z  2025-03-14T05:43:25.5193388Z  2025-03-14T05:43:25.5193787Z  2025-03-14T05:43:25.5194187Z  2025-03-14T05:43:25.5194582Z  2025-03-14T05:43:25.5194989Z  2025-03-14T05:43:25.5195613Z [9,986 / 15,235] 48 actions, 47 running 2025-03-14T05:43:25.5196575Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T05:43:25.5197717Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T05:43:25.5198634Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T05:43:25.5199376Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T05:43:25.5200261Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T05:43:25.5201198Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T05:43:25.5202034Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T05:43:25.5202875Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local ... 2025-03-14T05:43:25.7500923Z 2025-03-14T05:43:25.7501782Z  2025-03-14T05:43:25.7502258Z  2025-03-14T05:43:25.7502674Z  2025-03-14T05:43:25.7503090Z  2025-03-14T05:43:25.7503526Z  2025-03-14T05:43:25.7503984Z  2025-03-14T05:43:25.7504385Z  2025-03-14T05:43:25.7505164Z  2025-03-14T05:43:25.7505696Z [9,987 / 15,235] 48 actions, 47 running 2025-03-14T05:43:25.7506573Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T05:43:25.7507719Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T05:43:25.7508556Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T05:43:25.7509237Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T05:43:25.7510057Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T05:43:25.7510917Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T05:43:25.7511656Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T05:43:25.7512458Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local ... 2025-03-14T05:43:25.9737856Z 2025-03-14T05:43:25.9738738Z  2025-03-14T05:43:25.9739207Z  2025-03-14T05:43:25.9739778Z  2025-03-14T05:43:25.9740189Z  2025-03-14T05:43:25.9740593Z  2025-03-14T05:43:25.9740970Z  2025-03-14T05:43:25.9741379Z  2025-03-14T05:43:25.9741777Z  2025-03-14T05:43:25.9742305Z [9,988 / 15,235] 48 actions running 2025-03-14T05:43:25.9743227Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T05:43:25.9744360Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T05:43:25.9745269Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T05:43:25.9746016Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T05:43:25.9746876Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T05:43:25.9747802Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T05:43:25.9748612Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T05:43:25.9749896Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local ... 2025-03-14T05:43:26.2637792Z 2025-03-14T05:43:26.2638636Z  2025-03-14T05:43:26.2639096Z  2025-03-14T05:43:26.2639489Z  2025-03-14T05:43:26.2639851Z  2025-03-14T05:43:26.2640205Z  2025-03-14T05:43:26.2640566Z  2025-03-14T05:43:26.2640917Z  2025-03-14T05:43:26.2641270Z  2025-03-14T05:43:26.2641792Z [9,990 / 15,235] 48 actions, 47 running 2025-03-14T05:43:26.2642584Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T05:43:26.2643537Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T05:43:26.2644303Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T05:43:26.2645111Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T05:43:26.2645839Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T05:43:26.2646631Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2025-03-14T05:43:26.2647360Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T05:43:26.2648112Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local ... 2025-03-14T05:43:26.5743113Z 2025-03-14T05:43:26.5743953Z  2025-03-14T05:43:26.5744397Z  2025-03-14T05:43:26.5744745Z  2025-03-14T05:43:26.5745090Z  2025-03-14T05:43:26.5745441Z  2025-03-14T05:43:26.5745775Z  2025-03-14T05:43:26.5746166Z  2025-03-14T05:43:26.5746572Z  2025-03-14T05:43:26.5747131Z [9,991 / 15,235] 48 actions running 2025-03-14T05:43:26.5748050Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T05:43:26.5749176Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T05:43:26.5750133Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T05:43:26.5750787Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T05:43:26.5751542Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T05:43:26.5752407Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2025-03-14T05:43:26.5753583Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T05:43:26.5754290Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local ... 2025-03-14T05:43:26.7748308Z 2025-03-14T05:43:26.7749100Z  2025-03-14T05:43:26.7749558Z  2025-03-14T05:43:26.7749930Z  2025-03-14T05:43:26.7750299Z  2025-03-14T05:43:26.7750667Z  2025-03-14T05:43:26.7751030Z  2025-03-14T05:43:26.7751378Z  2025-03-14T05:43:26.7751744Z  2025-03-14T05:43:26.7752276Z [9,992 / 15,235] 48 actions running 2025-03-14T05:43:26.7753176Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T05:43:26.7754259Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T05:43:26.7755120Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T05:43:26.7755905Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T05:43:26.7756795Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T05:43:26.7757802Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T05:43:26.7758628Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2025-03-14T05:43:26.7759613Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local ... 2025-03-14T05:43:27.0390978Z 2025-03-14T05:43:27.0391856Z  2025-03-14T05:43:27.0392351Z  2025-03-14T05:43:27.0392765Z  2025-03-14T05:43:27.0393192Z  2025-03-14T05:43:27.0393592Z  2025-03-14T05:43:27.0393961Z  2025-03-14T05:43:27.0394355Z  2025-03-14T05:43:27.0394707Z  2025-03-14T05:43:27.0405399Z [9,994 / 15,235] 48 actions, 47 running 2025-03-14T05:43:27.0406635Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T05:43:27.0407825Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T05:43:27.0409157Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T05:43:27.0410000Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T05:43:27.0410943Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T05:43:27.0411947Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2025-03-14T05:43:27.0412953Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2025-03-14T05:43:27.0413788Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:43:27.3754834Z 2025-03-14T05:43:27.3755687Z  2025-03-14T05:43:27.3756153Z  2025-03-14T05:43:27.3756510Z  2025-03-14T05:43:27.3756884Z  2025-03-14T05:43:27.3757266Z  2025-03-14T05:43:27.3757647Z  2025-03-14T05:43:27.3758053Z  2025-03-14T05:43:27.3758427Z  2025-03-14T05:43:27.3758968Z [9,996 / 15,235] 48 actions running 2025-03-14T05:43:27.3759867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T05:43:27.3760995Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T05:43:27.3761850Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T05:43:27.3762585Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T05:43:27.3763462Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T05:43:27.3764391Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2025-03-14T05:43:27.3765695Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2025-03-14T05:43:27.3766445Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:43:27.5802096Z 2025-03-14T05:43:27.5802962Z  2025-03-14T05:43:27.5803440Z  2025-03-14T05:43:27.5803868Z  2025-03-14T05:43:27.5804254Z  2025-03-14T05:43:27.5804802Z  2025-03-14T05:43:27.5805191Z  2025-03-14T05:43:27.5805563Z  2025-03-14T05:43:27.5805910Z  2025-03-14T05:43:27.5806467Z [9,997 / 15,235] 48 actions, 47 running 2025-03-14T05:43:27.5807557Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T05:43:27.5809085Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T05:43:27.5809991Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T05:43:27.5810740Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T05:43:27.5811589Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T05:43:27.5812560Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2025-03-14T05:43:27.5813487Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2025-03-14T05:43:27.5814276Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T05:43:27.8464974Z 2025-03-14T05:43:27.8466078Z  2025-03-14T05:43:27.8466565Z  2025-03-14T05:43:27.8466961Z  2025-03-14T05:43:27.8467352Z  2025-03-14T05:43:27.8467733Z  2025-03-14T05:43:27.8468134Z  2025-03-14T05:43:27.8468545Z  2025-03-14T05:43:27.8468976Z  2025-03-14T05:43:27.8469588Z [9,999 / 15,235] 48 actions, 47 running 2025-03-14T05:43:27.8470550Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T05:43:27.8471688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T05:43:27.8472676Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T05:43:27.8473487Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T05:43:27.8474395Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T05:43:27.8475388Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2025-03-14T05:43:27.8476372Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2025-03-14T05:43:27.8477178Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:43:28.1763116Z 2025-03-14T05:43:28.1764175Z  2025-03-14T05:43:28.1764776Z  2025-03-14T05:43:28.1765146Z  2025-03-14T05:43:28.1765733Z  2025-03-14T05:43:28.1766490Z  2025-03-14T05:43:28.1766908Z  2025-03-14T05:43:28.1767322Z  2025-03-14T05:43:28.1767731Z  2025-03-14T05:43:28.1768310Z [10,000 / 15,235] 48 actions running 2025-03-14T05:43:28.1769276Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T05:43:28.1770464Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T05:43:28.1771430Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T05:43:28.1772215Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T05:43:28.1773138Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T05:43:28.1774097Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2025-03-14T05:43:28.1775100Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2025-03-14T05:43:28.1775937Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:43:28.5381744Z 2025-03-14T05:43:28.5382602Z  2025-03-14T05:43:28.5383129Z  2025-03-14T05:43:28.5383525Z  2025-03-14T05:43:28.5383958Z  2025-03-14T05:43:28.5384351Z  2025-03-14T05:43:28.5384767Z  2025-03-14T05:43:28.5385174Z  2025-03-14T05:43:28.5385597Z  2025-03-14T05:43:28.5386195Z [10,001 / 15,235] 48 actions, 47 running 2025-03-14T05:43:28.5387100Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T05:43:28.5388250Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T05:43:28.5389137Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2025-03-14T05:43:28.5389871Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T05:43:28.5390764Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T05:43:28.5391753Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2025-03-14T05:43:28.5392687Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T05:43:28.5393467Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T05:43:28.7770388Z 2025-03-14T05:43:28.7771516Z  2025-03-14T05:43:28.7772021Z  2025-03-14T05:43:28.7772452Z  2025-03-14T05:43:28.7772867Z  2025-03-14T05:43:28.7773298Z  2025-03-14T05:43:28.7773727Z  2025-03-14T05:43:28.7774162Z  2025-03-14T05:43:28.7774597Z  2025-03-14T05:43:28.7775203Z [10,001 / 15,235] 48 actions running 2025-03-14T05:43:28.7776204Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T05:43:28.7777457Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T05:43:28.7778396Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2025-03-14T05:43:28.7779142Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T05:43:28.7780016Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T05:43:28.7780990Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2025-03-14T05:43:28.7781975Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T05:43:28.7782672Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:43:29.1776577Z 2025-03-14T05:43:29.1777418Z  2025-03-14T05:43:29.1777925Z  2025-03-14T05:43:29.1778363Z  2025-03-14T05:43:29.1778783Z  2025-03-14T05:43:29.1779230Z  2025-03-14T05:43:29.1779651Z  2025-03-14T05:43:29.1780097Z  2025-03-14T05:43:29.1780512Z  2025-03-14T05:43:29.1781110Z [10,002 / 15,235] 48 actions running 2025-03-14T05:43:29.1782103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T05:43:29.1783240Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T05:43:29.1784247Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2025-03-14T05:43:29.1785048Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T05:43:29.1786011Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T05:43:29.1787400Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2025-03-14T05:43:29.1788425Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T05:43:29.1789379Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:43:29.4551270Z 2025-03-14T05:43:29.4552118Z  2025-03-14T05:43:29.4552633Z  2025-03-14T05:43:29.4553070Z  2025-03-14T05:43:29.4553509Z  2025-03-14T05:43:29.4553871Z  2025-03-14T05:43:29.4554233Z  2025-03-14T05:43:29.4554582Z  2025-03-14T05:43:29.4554961Z  2025-03-14T05:43:29.4555573Z [10,003 / 15,235] 48 actions, 47 running 2025-03-14T05:43:29.4556525Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T05:43:29.4557778Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T05:43:29.4558799Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2025-03-14T05:43:29.4559619Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T05:43:29.4560646Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T05:43:29.4561751Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2025-03-14T05:43:29.4562811Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T05:43:29.4563672Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T05:43:29.7782870Z 2025-03-14T05:43:29.7783704Z  2025-03-14T05:43:29.7784227Z  2025-03-14T05:43:29.7784663Z  2025-03-14T05:43:29.7785090Z  2025-03-14T05:43:29.7785519Z  2025-03-14T05:43:29.7785928Z  2025-03-14T05:43:29.7786361Z  2025-03-14T05:43:29.7786792Z  2025-03-14T05:43:29.7787366Z [10,003 / 15,235] 48 actions running 2025-03-14T05:43:29.7788373Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T05:43:29.7789586Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T05:43:29.7790602Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T05:43:29.7791393Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T05:43:29.7792663Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T05:43:29.7793670Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2025-03-14T05:43:29.7794682Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T05:43:29.7795524Z @onednn//:mkl_dnn; 15s local ... 2025-03-14T05:43:30.4444948Z 2025-03-14T05:43:30.4445879Z  2025-03-14T05:43:30.4446350Z  2025-03-14T05:43:30.4446761Z  2025-03-14T05:43:30.4447166Z  2025-03-14T05:43:30.4447602Z  2025-03-14T05:43:30.4448027Z  2025-03-14T05:43:30.4448408Z  2025-03-14T05:43:30.4448792Z  2025-03-14T05:43:30.4449378Z [10,004 / 15,235] 48 actions, 47 running 2025-03-14T05:43:30.4450313Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T05:43:30.4451528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T05:43:30.4452416Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T05:43:30.4453118Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T05:43:30.4453967Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T05:43:30.4454908Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2025-03-14T05:43:30.4455824Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T05:43:30.4456588Z @onednn//:mkl_dnn; 15s local ... 2025-03-14T05:43:30.7791663Z 2025-03-14T05:43:30.7792604Z  2025-03-14T05:43:30.7793115Z  2025-03-14T05:43:30.7793569Z  2025-03-14T05:43:30.7794020Z  2025-03-14T05:43:30.7794387Z  2025-03-14T05:43:30.7794795Z  2025-03-14T05:43:30.7795168Z  2025-03-14T05:43:30.7795566Z  2025-03-14T05:43:30.7796087Z [10,008 / 15,235] 48 actions running 2025-03-14T05:43:30.7797344Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T05:43:30.7798651Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T05:43:30.7799630Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T05:43:30.7800401Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T05:43:30.7801297Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T05:43:30.7802232Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2025-03-14T05:43:30.7803231Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T05:43:30.7804045Z @onednn//:mkl_dnn; 16s local ... 2025-03-14T05:43:30.9796919Z 2025-03-14T05:43:30.9797786Z  2025-03-14T05:43:30.9798303Z  2025-03-14T05:43:30.9798749Z  2025-03-14T05:43:30.9799193Z  2025-03-14T05:43:30.9799634Z  2025-03-14T05:43:30.9800030Z  2025-03-14T05:43:30.9800419Z  2025-03-14T05:43:30.9800817Z  2025-03-14T05:43:30.9801452Z [10,013 / 15,235] 48 actions running 2025-03-14T05:43:30.9802501Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T05:43:30.9803769Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T05:43:30.9804908Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T05:43:30.9805741Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T05:43:30.9806726Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T05:43:30.9807798Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2025-03-14T05:43:30.9808857Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T05:43:30.9809725Z @onednn//:mkl_dnn; 16s local ... 2025-03-14T05:43:31.4366936Z 2025-03-14T05:43:31.4367846Z  2025-03-14T05:43:31.4368344Z  2025-03-14T05:43:31.4368748Z  2025-03-14T05:43:31.4369148Z  2025-03-14T05:43:31.4369549Z  2025-03-14T05:43:31.4369981Z  2025-03-14T05:43:31.4370374Z  2025-03-14T05:43:31.4371096Z  2025-03-14T05:43:31.4371717Z [10,014 / 15,235] 48 actions, 47 running 2025-03-14T05:43:31.4372695Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T05:43:31.4373796Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T05:43:31.4374829Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T05:43:31.4375585Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T05:43:31.4376537Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T05:43:31.4377501Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2025-03-14T05:43:31.4378505Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T05:43:31.4379310Z @onednn//:mkl_dnn; 16s local ... 2025-03-14T05:43:31.7271874Z 2025-03-14T05:43:31.7272697Z  2025-03-14T05:43:31.7273228Z  2025-03-14T05:43:31.7273721Z  2025-03-14T05:43:31.7274164Z  2025-03-14T05:43:31.7274608Z  2025-03-14T05:43:31.7275026Z  2025-03-14T05:43:31.7275443Z  2025-03-14T05:43:31.7275859Z  2025-03-14T05:43:31.7276483Z [10,019 / 15,235] 48 actions, 47 running 2025-03-14T05:43:31.7277394Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T05:43:31.7278598Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T05:43:31.7279497Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T05:43:31.7280204Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T05:43:31.7281007Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T05:43:31.7281963Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2025-03-14T05:43:31.7282926Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T05:43:31.7283717Z @onednn//:mkl_dnn; 17s local ... 2025-03-14T05:43:31.9697092Z 2025-03-14T05:43:31.9697943Z  2025-03-14T05:43:31.9698487Z  2025-03-14T05:43:31.9698926Z  2025-03-14T05:43:31.9699350Z  2025-03-14T05:43:31.9699762Z  2025-03-14T05:43:31.9700177Z  2025-03-14T05:43:31.9700595Z  2025-03-14T05:43:31.9701011Z  2025-03-14T05:43:31.9701635Z [10,022 / 15,235] 47 actions, 46 running 2025-03-14T05:43:31.9702631Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T05:43:31.9703833Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T05:43:31.9704837Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T05:43:31.9705602Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T05:43:31.9706523Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T05:43:31.9707535Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2025-03-14T05:43:31.9708507Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T05:43:31.9709349Z @onednn//:mkl_dnn; 17s local ... 2025-03-14T05:43:32.1806896Z 2025-03-14T05:43:32.1807780Z  2025-03-14T05:43:32.1808254Z  2025-03-14T05:43:32.1808669Z  2025-03-14T05:43:32.1809083Z  2025-03-14T05:43:32.1809493Z  2025-03-14T05:43:32.1809891Z  2025-03-14T05:43:32.1810321Z  2025-03-14T05:43:32.1810753Z  2025-03-14T05:43:32.1811353Z [10,023 / 15,235] 48 actions running 2025-03-14T05:43:32.1812298Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T05:43:32.1813462Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T05:43:32.1814418Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T05:43:32.1815205Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T05:43:32.1816140Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T05:43:32.1817237Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2025-03-14T05:43:32.1818670Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T05:43:32.1819486Z @onednn//:mkl_dnn; 17s local ... 2025-03-14T05:43:32.4415448Z 2025-03-14T05:43:32.4416254Z  2025-03-14T05:43:32.4416743Z  2025-03-14T05:43:32.4417177Z  2025-03-14T05:43:32.4417619Z  2025-03-14T05:43:32.4418050Z  2025-03-14T05:43:32.4418461Z  2025-03-14T05:43:32.4418860Z  2025-03-14T05:43:32.4419262Z  2025-03-14T05:43:32.4419892Z [10,027 / 15,235] 48 actions, 47 running 2025-03-14T05:43:32.4420889Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T05:43:32.4422136Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T05:43:32.4423049Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T05:43:32.4423804Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T05:43:32.4424716Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T05:43:32.4425766Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T05:43:32.4426889Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2025-03-14T05:43:32.4427865Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T05:43:32.7813556Z 2025-03-14T05:43:32.7814418Z  2025-03-14T05:43:32.7814915Z  2025-03-14T05:43:32.7815327Z  2025-03-14T05:43:32.7815721Z  2025-03-14T05:43:32.7816095Z  2025-03-14T05:43:32.7816515Z  2025-03-14T05:43:32.7816934Z  2025-03-14T05:43:32.7817363Z  2025-03-14T05:43:32.7817958Z [10,027 / 15,235] 48 actions running 2025-03-14T05:43:32.7818914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T05:43:32.7819994Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T05:43:32.7821306Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T05:43:32.7822130Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T05:43:32.7823080Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T05:43:32.7824098Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T05:43:32.7825251Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2025-03-14T05:43:32.7826265Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T05:43:32.9818237Z 2025-03-14T05:43:32.9819053Z  2025-03-14T05:43:32.9819565Z  2025-03-14T05:43:32.9819966Z  2025-03-14T05:43:32.9820360Z  2025-03-14T05:43:32.9820796Z  2025-03-14T05:43:32.9821199Z  2025-03-14T05:43:32.9821580Z  2025-03-14T05:43:32.9822007Z  2025-03-14T05:43:32.9822604Z [10,029 / 15,235] 48 actions running 2025-03-14T05:43:32.9823525Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T05:43:32.9824712Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T05:43:32.9825654Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T05:43:32.9826491Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T05:43:32.9827391Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T05:43:32.9828375Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T05:43:32.9829507Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2025-03-14T05:43:32.9830412Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T05:43:33.3823626Z 2025-03-14T05:43:33.3824471Z  2025-03-14T05:43:33.3824921Z  2025-03-14T05:43:33.3825301Z  2025-03-14T05:43:33.3825663Z  2025-03-14T05:43:33.3826052Z  2025-03-14T05:43:33.3826409Z  2025-03-14T05:43:33.3826768Z  2025-03-14T05:43:33.3827119Z  2025-03-14T05:43:33.3827633Z [10,031 / 15,235] 48 actions running 2025-03-14T05:43:33.3828509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T05:43:33.3829885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T05:43:33.3830796Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T05:43:33.3831422Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T05:43:33.3832182Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T05:43:33.3832998Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T05:43:33.3833924Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2025-03-14T05:43:33.3834738Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T05:43:33.5829267Z 2025-03-14T05:43:33.5830138Z  2025-03-14T05:43:33.5830551Z  2025-03-14T05:43:33.5830879Z  2025-03-14T05:43:33.5831224Z  2025-03-14T05:43:33.5831587Z  2025-03-14T05:43:33.5831912Z  2025-03-14T05:43:33.5832312Z  2025-03-14T05:43:33.5832670Z  2025-03-14T05:43:33.5833188Z [10,032 / 15,235] 48 actions running 2025-03-14T05:43:33.5834005Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T05:43:33.5835020Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T05:43:33.5835906Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T05:43:33.5836633Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T05:43:33.5837477Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T05:43:33.5838353Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T05:43:33.5839346Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2025-03-14T05:43:33.5840304Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T05:43:33.9565445Z 2025-03-14T05:43:33.9566249Z  2025-03-14T05:43:33.9566640Z  2025-03-14T05:43:33.9566960Z  2025-03-14T05:43:33.9567600Z  2025-03-14T05:43:33.9567918Z  2025-03-14T05:43:33.9568254Z  2025-03-14T05:43:33.9568561Z  2025-03-14T05:43:33.9568869Z  2025-03-14T05:43:33.9569335Z [10,034 / 15,235] 48 actions, 47 running 2025-03-14T05:43:33.9570055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T05:43:33.9570904Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T05:43:33.9571588Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T05:43:33.9572151Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T05:43:33.9572807Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T05:43:33.9573534Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T05:43:33.9574337Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2025-03-14T05:43:33.9575029Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T05:43:34.1835879Z 2025-03-14T05:43:34.1836726Z  2025-03-14T05:43:34.1837173Z  2025-03-14T05:43:34.1837560Z  2025-03-14T05:43:34.1837973Z  2025-03-14T05:43:34.1838371Z  2025-03-14T05:43:34.1838782Z  2025-03-14T05:43:34.1839191Z  2025-03-14T05:43:34.1839542Z  2025-03-14T05:43:34.1840083Z [10,035 / 15,235] 48 actions running 2025-03-14T05:43:34.1840917Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T05:43:34.1842046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T05:43:34.1842941Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T05:43:34.1843721Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T05:43:34.1844979Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T05:43:34.1846065Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T05:43:34.1847231Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2025-03-14T05:43:34.1848480Z @onednn//:onednn_autogen; 12s local ... 2025-03-14T05:43:34.7332880Z 2025-03-14T05:43:34.7333724Z  2025-03-14T05:43:34.7334249Z  2025-03-14T05:43:34.7334679Z  2025-03-14T05:43:34.7335096Z  2025-03-14T05:43:34.7335522Z  2025-03-14T05:43:34.7335940Z  2025-03-14T05:43:34.7336352Z  2025-03-14T05:43:34.7336753Z  2025-03-14T05:43:34.7337363Z [10,036 / 15,235] 48 actions, 47 running 2025-03-14T05:43:34.7338252Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T05:43:34.7339379Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T05:43:34.7340365Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T05:43:34.7341150Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T05:43:34.7342096Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T05:43:34.7343113Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T05:43:34.7344278Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T05:43:34.7345278Z @onednn//:onednn_autogen; 12s local ... 2025-03-14T05:43:34.9843782Z 2025-03-14T05:43:34.9844802Z  2025-03-14T05:43:34.9845339Z  2025-03-14T05:43:34.9845745Z  2025-03-14T05:43:34.9846155Z  2025-03-14T05:43:34.9846555Z  2025-03-14T05:43:34.9846937Z  2025-03-14T05:43:34.9847386Z  2025-03-14T05:43:34.9847826Z  2025-03-14T05:43:34.9848446Z [10,037 / 15,235] 48 actions running 2025-03-14T05:43:34.9849498Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T05:43:34.9850728Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T05:43:34.9851669Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T05:43:34.9852453Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T05:43:34.9853779Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T05:43:34.9854748Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T05:43:34.9855827Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T05:43:34.9856777Z @onednn//:onednn_autogen; 12s local ... 2025-03-14T05:43:35.2725477Z 2025-03-14T05:43:35.2726251Z  2025-03-14T05:43:35.2726726Z  2025-03-14T05:43:35.2727116Z  2025-03-14T05:43:35.2727517Z  2025-03-14T05:43:35.2727934Z  2025-03-14T05:43:35.2728390Z  2025-03-14T05:43:35.2728800Z  2025-03-14T05:43:35.2729217Z  2025-03-14T05:43:35.2729857Z [10,038 / 15,235] 48 actions, 47 running 2025-03-14T05:43:35.2730859Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T05:43:35.2732133Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T05:43:35.2733163Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T05:43:35.2733989Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T05:43:35.2734890Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T05:43:35.2735859Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T05:43:35.2736907Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T05:43:35.2737871Z @onednn//:onednn_autogen; 13s local ... 2025-03-14T05:43:35.5851940Z 2025-03-14T05:43:35.5852762Z  2025-03-14T05:43:35.5853303Z  2025-03-14T05:43:35.5853700Z  2025-03-14T05:43:35.5854083Z  2025-03-14T05:43:35.5854464Z  2025-03-14T05:43:35.5854825Z  2025-03-14T05:43:35.5855206Z  2025-03-14T05:43:35.5855602Z  2025-03-14T05:43:35.5856207Z [10,038 / 15,235] 48 actions running 2025-03-14T05:43:35.5857222Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T05:43:35.5858485Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T05:43:35.5859825Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T05:43:35.5860647Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T05:43:35.5861607Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T05:43:35.5862599Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T05:43:35.5863682Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T05:43:35.5864591Z @onednn//:onednn_autogen; 13s local ... 2025-03-14T05:43:36.1956758Z 2025-03-14T05:43:36.1957616Z  2025-03-14T05:43:36.1958126Z  2025-03-14T05:43:36.1958578Z  2025-03-14T05:43:36.1959005Z  2025-03-14T05:43:36.1959436Z  2025-03-14T05:43:36.1959877Z  2025-03-14T05:43:36.1960313Z  2025-03-14T05:43:36.1960745Z  2025-03-14T05:43:36.1961425Z [10,039 / 15,235] 48 actions, 47 running 2025-03-14T05:43:36.1962462Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T05:43:36.1963748Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T05:43:36.1964905Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T05:43:36.1965988Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T05:43:36.1966960Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T05:43:36.1968043Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T05:43:36.1969252Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T05:43:36.1970300Z @onednn//:onednn_autogen; 14s local ... 2025-03-14T05:43:36.5860693Z 2025-03-14T05:43:36.5861713Z  2025-03-14T05:43:36.5862231Z  2025-03-14T05:43:36.5862672Z  2025-03-14T05:43:36.5863283Z  2025-03-14T05:43:36.5863715Z  2025-03-14T05:43:36.5864156Z  2025-03-14T05:43:36.5864920Z  2025-03-14T05:43:36.5865629Z  2025-03-14T05:43:36.5866288Z [10,042 / 15,235] 48 actions running 2025-03-14T05:43:36.5867314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T05:43:36.5868532Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T05:43:36.5869509Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T05:43:36.5870303Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T05:43:36.5871267Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T05:43:36.5872299Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T05:43:36.5873475Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T05:43:36.5874479Z @onednn//:onednn_autogen; 13s local ... 2025-03-14T05:43:36.7865704Z 2025-03-14T05:43:36.7866532Z  2025-03-14T05:43:36.7867035Z  2025-03-14T05:43:36.7867521Z  2025-03-14T05:43:36.7867950Z  2025-03-14T05:43:36.7868387Z  2025-03-14T05:43:36.7868820Z  2025-03-14T05:43:36.7869260Z  2025-03-14T05:43:36.7869699Z  2025-03-14T05:43:36.7870298Z [10,043 / 15,235] 48 actions running 2025-03-14T05:43:36.7871294Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T05:43:36.7872541Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T05:43:36.7873526Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T05:43:36.7874325Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T05:43:36.7875289Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T05:43:36.7876305Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T05:43:36.7877159Z @onednn//:onednn_autogen; 13s local 2025-03-14T05:43:36.7877822Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T05:43:37.1272242Z 2025-03-14T05:43:37.1273151Z  2025-03-14T05:43:37.1273924Z  2025-03-14T05:43:37.1274299Z  2025-03-14T05:43:37.1274660Z  2025-03-14T05:43:37.1275025Z  2025-03-14T05:43:37.1275382Z  2025-03-14T05:43:37.1275742Z  2025-03-14T05:43:37.1276095Z  2025-03-14T05:43:37.1276655Z [10,046 / 15,235] 48 actions, 47 running 2025-03-14T05:43:37.1277514Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T05:43:37.1278587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T05:43:37.1279448Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T05:43:37.1280111Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T05:43:37.1280928Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T05:43:37.1281844Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T05:43:37.1282579Z @onednn//:onednn_autogen; 13s local 2025-03-14T05:43:37.1283177Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T05:43:37.3871960Z 2025-03-14T05:43:37.3872796Z  2025-03-14T05:43:37.3873241Z  2025-03-14T05:43:37.3873602Z  2025-03-14T05:43:37.3873968Z  2025-03-14T05:43:37.3874332Z  2025-03-14T05:43:37.3874697Z  2025-03-14T05:43:37.3875049Z  2025-03-14T05:43:37.3875405Z  2025-03-14T05:43:37.3875928Z [10,048 / 15,235] 48 actions running 2025-03-14T05:43:37.3876792Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T05:43:37.3877823Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T05:43:37.3878674Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T05:43:37.3879348Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T05:43:37.3880161Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T05:43:37.3881429Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T05:43:37.3882133Z @onednn//:onednn_autogen; 14s local 2025-03-14T05:43:37.3882704Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T05:43:37.5878790Z 2025-03-14T05:43:37.5879985Z  2025-03-14T05:43:37.5880839Z  2025-03-14T05:43:37.5881461Z  2025-03-14T05:43:37.5881890Z  2025-03-14T05:43:37.5882524Z  2025-03-14T05:43:37.5883094Z  2025-03-14T05:43:37.5883513Z  2025-03-14T05:43:37.5884141Z  2025-03-14T05:43:37.5884991Z [10,049 / 15,235] 48 actions running 2025-03-14T05:43:37.5886310Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T05:43:37.5887812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T05:43:37.5888944Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T05:43:37.5890046Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T05:43:37.5891200Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T05:43:37.5892685Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T05:43:37.5893723Z @onednn//:onednn_autogen; 14s local 2025-03-14T05:43:37.5894684Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T05:43:37.8037902Z 2025-03-14T05:43:37.8038780Z  2025-03-14T05:43:37.8039227Z  2025-03-14T05:43:37.8039620Z  2025-03-14T05:43:37.8040012Z  2025-03-14T05:43:37.8040499Z  2025-03-14T05:43:37.8040934Z  2025-03-14T05:43:37.8041325Z  2025-03-14T05:43:37.8041734Z  2025-03-14T05:43:37.8042320Z [10,054 / 15,235] 48 actions, 47 running 2025-03-14T05:43:37.8043350Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T05:43:37.8044472Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T05:43:37.8045559Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T05:43:37.8046365Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T05:43:37.8047235Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2025-03-14T05:43:37.8048656Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T05:43:37.8049459Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:37.8050082Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T05:43:38.1809632Z 2025-03-14T05:43:38.1810589Z  2025-03-14T05:43:38.1811075Z  2025-03-14T05:43:38.1811482Z  2025-03-14T05:43:38.1811856Z  2025-03-14T05:43:38.1812250Z  2025-03-14T05:43:38.1812660Z  2025-03-14T05:43:38.1813071Z  2025-03-14T05:43:38.1813474Z  2025-03-14T05:43:38.1814073Z [10,057 / 15,235] 47 actions, 46 running 2025-03-14T05:43:38.1814965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T05:43:38.1816091Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T05:43:38.1817028Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T05:43:38.1817780Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T05:43:38.1818650Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T05:43:38.1819413Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:38.1820006Z @onednn//:onednn_autogen; 7s local 2025-03-14T05:43:38.1820609Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T05:43:38.3883979Z 2025-03-14T05:43:38.3885063Z  2025-03-14T05:43:38.3885587Z  2025-03-14T05:43:38.3885973Z  2025-03-14T05:43:38.3886519Z  2025-03-14T05:43:38.3886936Z  2025-03-14T05:43:38.3887338Z  2025-03-14T05:43:38.3887719Z  2025-03-14T05:43:38.3888095Z  2025-03-14T05:43:38.3888651Z [10,058 / 15,235] 48 actions running 2025-03-14T05:43:38.3889585Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T05:43:38.3890681Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T05:43:38.3892038Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T05:43:38.3892803Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T05:43:38.3893530Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T05:43:38.3894283Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:38.3894891Z @onednn//:onednn_autogen; 7s local 2025-03-14T05:43:38.3895455Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T05:43:38.5888949Z 2025-03-14T05:43:38.5889822Z  2025-03-14T05:43:38.5890360Z  2025-03-14T05:43:38.5890787Z  2025-03-14T05:43:38.5891195Z  2025-03-14T05:43:38.5891609Z  2025-03-14T05:43:38.5892015Z  2025-03-14T05:43:38.5892440Z  2025-03-14T05:43:38.5892853Z  2025-03-14T05:43:38.5893439Z [10,059 / 15,235] 48 actions running 2025-03-14T05:43:38.5894370Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T05:43:38.5895582Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T05:43:38.5896565Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2025-03-14T05:43:38.5897329Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T05:43:38.5898235Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T05:43:38.5899059Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:38.5899667Z @onednn//:onednn_autogen; 8s local 2025-03-14T05:43:38.5900305Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T05:43:39.0608388Z 2025-03-14T05:43:39.0609952Z  2025-03-14T05:43:39.0610940Z  2025-03-14T05:43:39.0611663Z  2025-03-14T05:43:39.0612600Z  2025-03-14T05:43:39.0613011Z  2025-03-14T05:43:39.0613385Z  2025-03-14T05:43:39.0613755Z  2025-03-14T05:43:39.0614250Z  2025-03-14T05:43:39.0614837Z [10,060 / 15,235] 48 actions, 47 running 2025-03-14T05:43:39.0615773Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T05:43:39.0616924Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T05:43:39.0618164Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2025-03-14T05:43:39.0618911Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T05:43:39.0619792Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T05:43:39.0620566Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:39.0621194Z @onednn//:onednn_autogen; 8s local 2025-03-14T05:43:39.0621814Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T05:43:39.3893990Z 2025-03-14T05:43:39.3894909Z  2025-03-14T05:43:39.3895411Z  2025-03-14T05:43:39.3895851Z  2025-03-14T05:43:39.3896255Z  2025-03-14T05:43:39.3896683Z  2025-03-14T05:43:39.3897098Z  2025-03-14T05:43:39.3897513Z  2025-03-14T05:43:39.3897938Z  2025-03-14T05:43:39.3898526Z [10,061 / 15,235] 48 actions running 2025-03-14T05:43:39.3899534Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2025-03-14T05:43:39.3900753Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T05:43:39.3901720Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2025-03-14T05:43:39.3902574Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T05:43:39.3903502Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T05:43:39.3904297Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:39.3904907Z @onednn//:onednn_autogen; 8s local 2025-03-14T05:43:39.3905531Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T05:43:39.7902076Z 2025-03-14T05:43:39.7902909Z  2025-03-14T05:43:39.7903349Z  2025-03-14T05:43:39.7903735Z  2025-03-14T05:43:39.7904096Z  2025-03-14T05:43:39.7904447Z  2025-03-14T05:43:39.7904799Z  2025-03-14T05:43:39.7905141Z  2025-03-14T05:43:39.7905484Z  2025-03-14T05:43:39.7908285Z [10,065 / 15,235] 46 actions running 2025-03-14T05:43:39.7909241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2025-03-14T05:43:39.7910218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T05:43:39.7911005Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T05:43:39.7911667Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T05:43:39.7912308Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:39.7912836Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:39.7913372Z @onednn//:onednn_autogen; 8s local 2025-03-14T05:43:39.7913906Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T05:43:39.9905189Z 2025-03-14T05:43:39.9906079Z  2025-03-14T05:43:39.9906565Z  2025-03-14T05:43:39.9907012Z  2025-03-14T05:43:39.9907436Z  2025-03-14T05:43:39.9907831Z  2025-03-14T05:43:39.9908236Z  2025-03-14T05:43:39.9908648Z  2025-03-14T05:43:39.9909083Z  2025-03-14T05:43:39.9909697Z [10,068 / 15,235] 48 actions running 2025-03-14T05:43:39.9910657Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2025-03-14T05:43:39.9911806Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T05:43:39.9912770Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T05:43:39.9913416Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T05:43:39.9914109Z @onednn//:onednn_autogen; 12s local 2025-03-14T05:43:39.9914711Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:39.9915282Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:39.9915924Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T05:43:40.3779888Z 2025-03-14T05:43:40.3781446Z  2025-03-14T05:43:40.3781951Z  2025-03-14T05:43:40.3782366Z  2025-03-14T05:43:40.3782781Z  2025-03-14T05:43:40.3783194Z  2025-03-14T05:43:40.3783587Z  2025-03-14T05:43:40.3783989Z  2025-03-14T05:43:40.3784425Z  2025-03-14T05:43:40.3785026Z [10,070 / 15,235] 48 actions, 47 running 2025-03-14T05:43:40.3786406Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T05:43:40.3787528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T05:43:40.3788426Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T05:43:40.3789110Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T05:43:40.3789801Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:40.3790390Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:40.3790954Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:40.5912356Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T05:43:40.5912878Z 2025-03-14T05:43:40.5913362Z  2025-03-14T05:43:40.5913766Z  2025-03-14T05:43:40.5914188Z  2025-03-14T05:43:40.5914581Z  2025-03-14T05:43:40.5914985Z  2025-03-14T05:43:40.5915372Z  2025-03-14T05:43:40.5915783Z  2025-03-14T05:43:40.5916153Z  2025-03-14T05:43:40.5916680Z [10,070 / 15,235] 48 actions running 2025-03-14T05:43:40.5917553Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T05:43:40.5918651Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T05:43:40.5929110Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T05:43:40.5930169Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T05:43:40.5930998Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:40.5931580Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:40.5932162Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:40.5932754Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T05:43:40.7915905Z 2025-03-14T05:43:40.7916748Z  2025-03-14T05:43:40.7917261Z  2025-03-14T05:43:40.7917712Z  2025-03-14T05:43:40.7918136Z  2025-03-14T05:43:40.7918554Z  2025-03-14T05:43:40.7919357Z  2025-03-14T05:43:40.7919810Z  2025-03-14T05:43:40.7920263Z  2025-03-14T05:43:40.7920830Z [10,073 / 15,235] 48 actions running 2025-03-14T05:43:40.7921695Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T05:43:40.7922867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T05:43:40.7923829Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T05:43:40.7924777Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T05:43:40.7925507Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:40.7926121Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:40.7926685Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:40.7927266Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T05:43:41.0716421Z 2025-03-14T05:43:41.0717321Z  2025-03-14T05:43:41.0718319Z  2025-03-14T05:43:41.0718910Z  2025-03-14T05:43:41.0719441Z  2025-03-14T05:43:41.0719999Z  2025-03-14T05:43:41.0720536Z  2025-03-14T05:43:41.0721074Z  2025-03-14T05:43:41.0721590Z  2025-03-14T05:43:41.0722314Z [10,076 / 15,235] 48 actions, 47 running 2025-03-14T05:43:41.0723376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T05:43:41.0724530Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T05:43:41.0725711Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T05:43:41.0726613Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T05:43:41.0727439Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.0728135Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.0728841Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.0729555Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T05:43:41.3319128Z 2025-03-14T05:43:41.3319981Z  2025-03-14T05:43:41.3320515Z  2025-03-14T05:43:41.3320928Z  2025-03-14T05:43:41.3321410Z  2025-03-14T05:43:41.3321831Z  2025-03-14T05:43:41.3322710Z  2025-03-14T05:43:41.3323109Z  2025-03-14T05:43:41.3323535Z  2025-03-14T05:43:41.3324177Z [10,077 / 15,235] 48 actions, 47 running 2025-03-14T05:43:41.3325850Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T05:43:41.3327182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T05:43:41.3328272Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T05:43:41.3329180Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T05:43:41.3330100Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.3330829Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.3331666Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.3332361Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T05:43:41.5925198Z 2025-03-14T05:43:41.5926141Z  2025-03-14T05:43:41.5928966Z  2025-03-14T05:43:41.5929499Z  2025-03-14T05:43:41.5929940Z  2025-03-14T05:43:41.5930400Z  2025-03-14T05:43:41.5930826Z  2025-03-14T05:43:41.5931264Z  2025-03-14T05:43:41.5931686Z  2025-03-14T05:43:41.5932255Z [10,081 / 15,235] 48 actions running 2025-03-14T05:43:41.5933223Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T05:43:41.5934456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T05:43:41.5935403Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T05:43:41.5936185Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T05:43:41.5937036Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:41.5937668Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.5938290Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.5938921Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T05:43:41.8504589Z 2025-03-14T05:43:41.8505493Z  2025-03-14T05:43:41.8506327Z  2025-03-14T05:43:41.8506757Z  2025-03-14T05:43:41.8507177Z  2025-03-14T05:43:41.8507560Z  2025-03-14T05:43:41.8507943Z  2025-03-14T05:43:41.8508334Z  2025-03-14T05:43:41.8508723Z  2025-03-14T05:43:41.8509324Z [10,086 / 15,235] 48 actions, 47 running 2025-03-14T05:43:41.8510273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T05:43:41.8511376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T05:43:41.8512299Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T05:43:41.8513031Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T05:43:41.8513723Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:41.8514333Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:41.8514930Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:41.8515494Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T05:43:42.1399485Z 2025-03-14T05:43:42.1400392Z  2025-03-14T05:43:42.1401253Z  2025-03-14T05:43:42.1401833Z  2025-03-14T05:43:42.1402401Z  2025-03-14T05:43:42.1402929Z  2025-03-14T05:43:42.1403371Z  2025-03-14T05:43:42.1404527Z  2025-03-14T05:43:42.1405048Z  2025-03-14T05:43:42.1405609Z [10,089 / 15,235] 48 actions, 47 running 2025-03-14T05:43:42.1406534Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T05:43:42.1407642Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T05:43:42.1408555Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T05:43:42.1409314Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T05:43:42.1410008Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.1410624Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.1411214Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.1411830Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T05:43:42.3566195Z 2025-03-14T05:43:42.3567047Z  2025-03-14T05:43:42.3567904Z  2025-03-14T05:43:42.3568319Z  2025-03-14T05:43:42.3568705Z  2025-03-14T05:43:42.3569088Z  2025-03-14T05:43:42.3569491Z  2025-03-14T05:43:42.3569872Z  2025-03-14T05:43:42.3570265Z  2025-03-14T05:43:42.3570875Z [10,100 / 15,235] 48 actions, 47 running 2025-03-14T05:43:42.3571780Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T05:43:42.3572861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T05:43:42.3573788Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T05:43:42.3574518Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T05:43:42.3575200Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.3575776Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.3576365Z @onednn//:onednn_autogen; 10s local 2025-03-14T05:43:42.3576998Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T05:43:42.5695371Z 2025-03-14T05:43:42.5696186Z  2025-03-14T05:43:42.5696661Z  2025-03-14T05:43:42.5697023Z  2025-03-14T05:43:42.5697427Z  2025-03-14T05:43:42.5697802Z  2025-03-14T05:43:42.5698168Z  2025-03-14T05:43:42.5698534Z  2025-03-14T05:43:42.5698920Z  2025-03-14T05:43:42.5699500Z [10,107 / 15,235] 47 actions, 46 running 2025-03-14T05:43:42.5700375Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T05:43:42.5701488Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T05:43:42.5702357Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T05:43:42.5703079Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T05:43:42.5703763Z @onednn//:onednn_autogen; 12s local 2025-03-14T05:43:42.5704327Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.5705292Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.5705894Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T05:43:42.7935495Z 2025-03-14T05:43:42.7936296Z  2025-03-14T05:43:42.7936722Z  2025-03-14T05:43:42.7937185Z  2025-03-14T05:43:42.7937541Z  2025-03-14T05:43:42.7937888Z  2025-03-14T05:43:42.7938242Z  2025-03-14T05:43:42.7938604Z  2025-03-14T05:43:42.7938960Z  2025-03-14T05:43:42.7939452Z [10,110 / 15,235] 48 actions running 2025-03-14T05:43:42.7940259Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T05:43:42.7941229Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T05:43:42.7942032Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T05:43:42.7942671Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T05:43:42.7943271Z @onednn//:onednn_autogen; 12s local 2025-03-14T05:43:42.7943783Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.7944326Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:42.7944861Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T05:43:42.9997575Z 2025-03-14T05:43:42.9998374Z  2025-03-14T05:43:42.9998822Z  2025-03-14T05:43:42.9999168Z  2025-03-14T05:43:42.9999530Z  2025-03-14T05:43:42.9999878Z  2025-03-14T05:43:43.0000234Z  2025-03-14T05:43:43.0000585Z  2025-03-14T05:43:43.0000980Z  2025-03-14T05:43:43.0001496Z [10,117 / 15,235] 48 actions, 47 running 2025-03-14T05:43:43.0002287Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T05:43:43.0003246Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T05:43:43.0004030Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T05:43:43.0004798Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T05:43:43.0005392Z @onednn//:onednn_autogen; 12s local 2025-03-14T05:43:43.0005946Z @onednn//:onednn_autogen; 11s local 2025-03-14T05:43:43.0006483Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:43.0007343Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T05:43:43.2034016Z 2025-03-14T05:43:43.2034999Z  2025-03-14T05:43:43.2035681Z  2025-03-14T05:43:43.2036755Z  2025-03-14T05:43:43.2037240Z  2025-03-14T05:43:43.2037642Z  2025-03-14T05:43:43.2038051Z  2025-03-14T05:43:43.2038468Z  2025-03-14T05:43:43.2038891Z  2025-03-14T05:43:43.2039530Z [10,136 / 15,235] 48 actions, 47 running 2025-03-14T05:43:43.2040506Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T05:43:43.2041635Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T05:43:43.2042608Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T05:43:43.2043418Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T05:43:43.2044169Z @onednn//:onednn_autogen; 12s local 2025-03-14T05:43:43.2045037Z @onednn//:onednn_autogen; 9s local 2025-03-14T05:43:43.2046331Z @onednn//:onednn_autogen; 6s local 2025-03-14T05:43:43.2047077Z Compiling xla/frontend_attributes.cc; 6s local ... 2025-03-14T05:43:43.4089379Z 2025-03-14T05:43:43.4090551Z  2025-03-14T05:43:43.4091806Z  2025-03-14T05:43:43.4092276Z  2025-03-14T05:43:43.4092711Z  2025-03-14T05:43:43.4093117Z  2025-03-14T05:43:43.4093534Z  2025-03-14T05:43:43.4093977Z  2025-03-14T05:43:43.4094395Z  2025-03-14T05:43:43.4095035Z [10,152 / 15,235] 48 actions, 47 running 2025-03-14T05:43:43.4096046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T05:43:43.4097334Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T05:43:43.4098297Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T05:43:43.4099110Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T05:43:43.4100361Z @onednn//:onednn_autogen; 12s local 2025-03-14T05:43:43.4101075Z @onednn//:onednn_autogen; 7s local 2025-03-14T05:43:43.4101821Z Compiling xla/frontend_attributes.cc; 6s local 2025-03-14T05:43:43.4102664Z Compiling xla/service/float_support.cc; 6s local ... 2025-03-14T05:43:43.6180302Z 2025-03-14T05:43:43.6181135Z  2025-03-14T05:43:43.6181628Z  2025-03-14T05:43:43.6182027Z  2025-03-14T05:43:43.6182386Z  2025-03-14T05:43:43.6182736Z  2025-03-14T05:43:43.6183100Z  2025-03-14T05:43:43.6183460Z  2025-03-14T05:43:43.6183845Z  2025-03-14T05:43:43.6184430Z [10,170 / 15,235] 48 actions, 47 running 2025-03-14T05:43:43.6185446Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T05:43:43.6186531Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T05:43:43.6187409Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T05:43:43.6188142Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T05:43:43.6188801Z @onednn//:onednn_autogen; 13s local 2025-03-14T05:43:43.6189475Z Compiling xla/frontend_attributes.cc; 6s local 2025-03-14T05:43:43.6190200Z Compiling xla/service/float_support.cc; 6s local 2025-03-14T05:43:43.6191003Z Compiling xla/service/batchnorm_expander.cc; 6s local ... 2025-03-14T05:43:43.8347571Z 2025-03-14T05:43:43.8348409Z  2025-03-14T05:43:43.8348895Z  2025-03-14T05:43:43.8349335Z  2025-03-14T05:43:43.8349684Z  2025-03-14T05:43:43.8350056Z  2025-03-14T05:43:43.8350455Z  2025-03-14T05:43:43.8350817Z  2025-03-14T05:43:43.8351196Z  2025-03-14T05:43:43.8351799Z [10,192 / 15,235] 48 actions, 47 running 2025-03-14T05:43:43.8352741Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T05:43:43.8353815Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T05:43:43.8354802Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T05:43:43.8355514Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T05:43:43.8356555Z @onednn//:onednn_autogen; 13s local 2025-03-14T05:43:43.8357195Z Compiling xla/frontend_attributes.cc; 7s local 2025-03-14T05:43:43.8357952Z Compiling xla/service/float_support.cc; 6s local 2025-03-14T05:43:43.8358763Z Compiling xla/service/batchnorm_expander.cc; 6s local ... 2025-03-14T05:43:44.0554293Z 2025-03-14T05:43:44.0555137Z  2025-03-14T05:43:44.0555602Z  2025-03-14T05:43:44.0556011Z  2025-03-14T05:43:44.0556401Z  2025-03-14T05:43:44.0556782Z  2025-03-14T05:43:44.0557154Z  2025-03-14T05:43:44.0557537Z  2025-03-14T05:43:44.0557916Z  2025-03-14T05:43:44.0558452Z [10,206 / 15,235] 48 actions, 47 running 2025-03-14T05:43:44.0559342Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T05:43:44.0560537Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T05:43:44.0561395Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T05:43:44.0562084Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T05:43:44.0562617Z @onednn//:onednn_autogen; 13s local 2025-03-14T05:43:44.0563200Z Compiling xla/frontend_attributes.cc; 7s local 2025-03-14T05:43:44.0563861Z Compiling xla/service/float_support.cc; 7s local 2025-03-14T05:43:44.0564752Z Compiling xla/service/batchnorm_expander.cc; 7s local ... 2025-03-14T05:43:44.2657741Z 2025-03-14T05:43:44.2658599Z  2025-03-14T05:43:44.2659055Z  2025-03-14T05:43:44.2659413Z  2025-03-14T05:43:44.2659771Z  2025-03-14T05:43:44.2660161Z  2025-03-14T05:43:44.2660548Z  2025-03-14T05:43:44.2660901Z  2025-03-14T05:43:44.2661272Z  2025-03-14T05:43:44.2661796Z [10,230 / 15,235] 47 actions, 46 running 2025-03-14T05:43:44.2662983Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T05:43:44.2664000Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T05:43:44.2664805Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T05:43:44.2665706Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T05:43:44.2666433Z @onednn//:onednn_autogen; 13s local 2025-03-14T05:43:44.2667000Z Compiling xla/frontend_attributes.cc; 7s local 2025-03-14T05:43:44.2667650Z Compiling xla/service/float_support.cc; 7s local 2025-03-14T05:43:44.2668356Z Compiling xla/service/batchnorm_expander.cc; 7s local ... 2025-03-14T05:43:44.4668850Z 2025-03-14T05:43:44.4669697Z  2025-03-14T05:43:44.4670189Z  2025-03-14T05:43:44.4670595Z  2025-03-14T05:43:44.4670982Z  2025-03-14T05:43:44.4671397Z  2025-03-14T05:43:44.4671789Z  2025-03-14T05:43:44.4672183Z  2025-03-14T05:43:44.4672554Z  2025-03-14T05:43:44.4673143Z [10,255 / 15,235] 48 actions, 47 running 2025-03-14T05:43:44.4674103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T05:43:44.4675234Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T05:43:44.4676125Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T05:43:44.4676855Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T05:43:44.4677525Z @onednn//:onednn_autogen; 13s local 2025-03-14T05:43:44.4678158Z Compiling xla/frontend_attributes.cc; 7s local 2025-03-14T05:43:44.4678891Z Compiling xla/service/float_support.cc; 7s local 2025-03-14T05:43:44.4679659Z Compiling xla/service/batchnorm_expander.cc; 7s local ... 2025-03-14T05:43:44.6867252Z 2025-03-14T05:43:44.6868111Z  2025-03-14T05:43:44.6868627Z  2025-03-14T05:43:44.6869058Z  2025-03-14T05:43:44.6869459Z  2025-03-14T05:43:44.6869846Z  2025-03-14T05:43:44.6870264Z  2025-03-14T05:43:44.6870677Z  2025-03-14T05:43:44.6871101Z  2025-03-14T05:43:44.6871766Z [10,275 / 15,235] 48 actions, 47 running 2025-03-14T05:43:44.6873152Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T05:43:44.6874294Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T05:43:44.6875266Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T05:43:44.6876023Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T05:43:44.6876775Z @onednn//:onednn_autogen; 14s local 2025-03-14T05:43:44.6877492Z Compiling xla/frontend_attributes.cc; 7s local 2025-03-14T05:43:44.6878274Z Compiling xla/service/float_support.cc; 7s local 2025-03-14T05:43:44.6879166Z Compiling xla/service/batchnorm_expander.cc; 7s local ... 2025-03-14T05:43:44.8957233Z 2025-03-14T05:43:44.8958006Z  2025-03-14T05:43:44.8958416Z  2025-03-14T05:43:44.8958787Z  2025-03-14T05:43:44.8959104Z  2025-03-14T05:43:44.8959419Z  2025-03-14T05:43:44.8959769Z  2025-03-14T05:43:44.8960178Z  2025-03-14T05:43:44.8960512Z  2025-03-14T05:43:44.8961025Z [10,281 / 15,235] 48 actions, 47 running 2025-03-14T05:43:44.8961968Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T05:43:44.8963186Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T05:43:44.8964093Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T05:43:44.8965021Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T05:43:44.8969390Z Compiling xla/service/float_support.cc; 8s local 2025-03-14T05:43:44.8970173Z Compiling xla/service/batchnorm_expander.cc; 8s local 2025-03-14T05:43:44.8970919Z Compiling xla/service/sharding_remover.cc; 7s local 2025-03-14T05:43:44.8971744Z Compiling xla/service/transpose_folding.cc; 7s local ... 2025-03-14T05:43:45.0991195Z 2025-03-14T05:43:45.0992086Z  2025-03-14T05:43:45.0992582Z  2025-03-14T05:43:45.0993000Z  2025-03-14T05:43:45.0993879Z  2025-03-14T05:43:45.0994303Z  2025-03-14T05:43:45.0994742Z  2025-03-14T05:43:45.0995169Z  2025-03-14T05:43:45.0995586Z  2025-03-14T05:43:45.0996201Z [10,284 / 15,235] 48 actions, 47 running 2025-03-14T05:43:45.0997142Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T05:43:45.0998329Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T05:43:45.0999280Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T05:43:45.1000042Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T05:43:45.1000833Z Compiling xla/service/float_support.cc; 8s local 2025-03-14T05:43:45.1001636Z Compiling xla/service/batchnorm_expander.cc; 8s local 2025-03-14T05:43:45.1002451Z Compiling xla/service/sharding_remover.cc; 7s local 2025-03-14T05:43:45.1003246Z Compiling xla/service/transpose_folding.cc; 7s local ... 2025-03-14T05:43:45.3775510Z 2025-03-14T05:43:45.3776424Z  2025-03-14T05:43:45.3776923Z  2025-03-14T05:43:45.3777339Z  2025-03-14T05:43:45.3777746Z  2025-03-14T05:43:45.3778157Z  2025-03-14T05:43:45.3778560Z  2025-03-14T05:43:45.3778942Z  2025-03-14T05:43:45.3779306Z  2025-03-14T05:43:45.3779896Z [10,286 / 15,235] 48 actions, 47 running 2025-03-14T05:43:45.3780850Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T05:43:45.3781979Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T05:43:45.3782865Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T05:43:45.3783611Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T05:43:45.3784356Z Compiling xla/service/float_support.cc; 8s local 2025-03-14T05:43:45.3785169Z Compiling xla/service/batchnorm_expander.cc; 8s local 2025-03-14T05:43:45.3786016Z Compiling xla/service/sharding_remover.cc; 8s local 2025-03-14T05:43:45.3786922Z Compiling xla/service/transpose_folding.cc; 8s local ... 2025-03-14T05:43:45.5815987Z 2025-03-14T05:43:45.5816777Z  2025-03-14T05:43:45.5817245Z  2025-03-14T05:43:45.5817650Z  2025-03-14T05:43:45.5818050Z  2025-03-14T05:43:45.5818457Z  2025-03-14T05:43:45.5818862Z  2025-03-14T05:43:45.5819259Z  2025-03-14T05:43:45.5819769Z  2025-03-14T05:43:45.5820382Z [10,290 / 15,235] 48 actions, 47 running 2025-03-14T05:43:45.5821396Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T05:43:45.5822560Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T05:43:45.5823482Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T05:43:45.5824238Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T05:43:45.5825096Z Compiling xla/service/batchnorm_expander.cc; 8s local 2025-03-14T05:43:45.5825941Z Compiling xla/service/sharding_remover.cc; 8s local 2025-03-14T05:43:45.5826823Z Compiling xla/service/transpose_folding.cc; 8s local 2025-03-14T05:43:45.5827611Z Compiling xla/pjrt/transpose.cc; 5s local ... 2025-03-14T05:43:45.7970921Z 2025-03-14T05:43:45.7971795Z  2025-03-14T05:43:45.7972263Z  2025-03-14T05:43:45.7972665Z  2025-03-14T05:43:45.7973064Z  2025-03-14T05:43:45.7973455Z  2025-03-14T05:43:45.7973835Z  2025-03-14T05:43:45.7974232Z  2025-03-14T05:43:45.7974626Z  2025-03-14T05:43:45.7975185Z [10,291 / 15,235] 48 actions running 2025-03-14T05:43:45.7976092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T05:43:45.7977225Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T05:43:45.7978136Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T05:43:45.7978884Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T05:43:45.7979669Z Compiling xla/service/batchnorm_expander.cc; 8s local 2025-03-14T05:43:45.7980860Z Compiling xla/service/sharding_remover.cc; 8s local 2025-03-14T05:43:45.7981669Z Compiling xla/service/transpose_folding.cc; 8s local 2025-03-14T05:43:45.7982422Z Compiling xla/pjrt/transpose.cc; 5s local ... 2025-03-14T05:43:45.9975253Z 2025-03-14T05:43:45.9976083Z  2025-03-14T05:43:45.9976562Z  2025-03-14T05:43:45.9976962Z  2025-03-14T05:43:45.9977357Z  2025-03-14T05:43:45.9977754Z  2025-03-14T05:43:45.9978155Z  2025-03-14T05:43:45.9978556Z  2025-03-14T05:43:45.9978949Z  2025-03-14T05:43:45.9979514Z [10,294 / 15,235] 48 actions running 2025-03-14T05:43:45.9980459Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T05:43:45.9981609Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T05:43:45.9982525Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T05:43:45.9983263Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T05:43:45.9984109Z Compiling xla/service/batchnorm_expander.cc; 9s local 2025-03-14T05:43:45.9984918Z Compiling xla/service/sharding_remover.cc; 8s local 2025-03-14T05:43:45.9985702Z Compiling xla/service/transpose_folding.cc; 8s local 2025-03-14T05:43:45.9986437Z Compiling xla/pjrt/transpose.cc; 5s local ... 2025-03-14T05:43:46.2114558Z 2025-03-14T05:43:46.2115420Z  2025-03-14T05:43:46.2115919Z  2025-03-14T05:43:46.2116340Z  2025-03-14T05:43:46.2116769Z  2025-03-14T05:43:46.2117147Z  2025-03-14T05:43:46.2117530Z  2025-03-14T05:43:46.2117950Z  2025-03-14T05:43:46.2118349Z  2025-03-14T05:43:46.2118966Z [10,297 / 15,235] 48 actions, 47 running 2025-03-14T05:43:46.2120017Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T05:43:46.2121167Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T05:43:46.2122133Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T05:43:46.2122910Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T05:43:46.2124041Z Compiling xla/service/batchnorm_expander.cc; 9s local 2025-03-14T05:43:46.2124943Z Compiling xla/service/sharding_remover.cc; 9s local 2025-03-14T05:43:46.2125713Z Compiling xla/service/transpose_folding.cc; 8s local 2025-03-14T05:43:46.2126470Z Compiling xla/pjrt/transpose.cc; 6s local ... 2025-03-14T05:43:46.5514146Z 2025-03-14T05:43:46.5514987Z  2025-03-14T05:43:46.5515490Z  2025-03-14T05:43:46.5515911Z  2025-03-14T05:43:46.5516339Z  2025-03-14T05:43:46.5516759Z  2025-03-14T05:43:46.5517194Z  2025-03-14T05:43:46.5517576Z  2025-03-14T05:43:46.5517965Z  2025-03-14T05:43:46.5518561Z [10,302 / 15,235] 48 actions, 47 running 2025-03-14T05:43:46.5519528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T05:43:46.5520714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T05:43:46.5521621Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T05:43:46.5522371Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T05:43:46.5523137Z Compiling xla/service/batchnorm_expander.cc; 9s local 2025-03-14T05:43:46.5523933Z Compiling xla/service/sharding_remover.cc; 9s local 2025-03-14T05:43:46.5524874Z Compiling xla/service/transpose_folding.cc; 9s local 2025-03-14T05:43:46.5525623Z Compiling xla/pjrt/transpose.cc; 6s local ... 2025-03-14T05:43:46.7743389Z 2025-03-14T05:43:46.7744210Z  2025-03-14T05:43:46.7744695Z  2025-03-14T05:43:46.7745104Z  2025-03-14T05:43:46.7745489Z  2025-03-14T05:43:46.7745882Z  2025-03-14T05:43:46.7746277Z  2025-03-14T05:43:46.7746672Z  2025-03-14T05:43:46.7747069Z  2025-03-14T05:43:46.7747656Z [10,303 / 15,235] 48 actions, 47 running 2025-03-14T05:43:46.7748932Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T05:43:46.7750067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T05:43:46.7750991Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T05:43:46.7751705Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T05:43:46.7752495Z Compiling xla/service/batchnorm_expander.cc; 9s local 2025-03-14T05:43:46.7753271Z Compiling xla/service/sharding_remover.cc; 9s local 2025-03-14T05:43:46.7754051Z Compiling xla/service/transpose_folding.cc; 9s local 2025-03-14T05:43:46.7754796Z Compiling xla/pjrt/transpose.cc; 6s local ... 2025-03-14T05:43:46.9984353Z 2025-03-14T05:43:46.9985167Z  2025-03-14T05:43:46.9985666Z  2025-03-14T05:43:46.9986099Z  2025-03-14T05:43:46.9986528Z  2025-03-14T05:43:46.9986958Z  2025-03-14T05:43:46.9987374Z  2025-03-14T05:43:46.9987782Z  2025-03-14T05:43:46.9988195Z  2025-03-14T05:43:46.9988819Z [10,306 / 15,235] 48 actions running 2025-03-14T05:43:46.9989738Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T05:43:46.9990806Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T05:43:46.9991652Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T05:43:46.9992367Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T05:43:46.9993106Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T05:43:46.9993841Z Compiling xla/service/sharding_remover.cc; 9s local 2025-03-14T05:43:46.9994593Z Compiling xla/service/transpose_folding.cc; 9s local 2025-03-14T05:43:46.9995325Z Compiling xla/pjrt/transpose.cc; 6s local ... 2025-03-14T05:43:47.2080981Z 2025-03-14T05:43:47.2081775Z  2025-03-14T05:43:47.2082264Z  2025-03-14T05:43:47.2082673Z  2025-03-14T05:43:47.2083079Z  2025-03-14T05:43:47.2083502Z  2025-03-14T05:43:47.2083908Z  2025-03-14T05:43:47.2084329Z  2025-03-14T05:43:47.2084975Z  2025-03-14T05:43:47.2085562Z [10,310 / 15,235] 48 actions running 2025-03-14T05:43:47.2086946Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T05:43:47.2088191Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T05:43:47.2089123Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T05:43:47.2089938Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T05:43:47.2090768Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T05:43:47.2091663Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T05:43:47.2092474Z Compiling xla/service/transpose_folding.cc; 9s local 2025-03-14T05:43:47.2093303Z Compiling xla/pjrt/transpose.cc; 7s local ... 2025-03-14T05:43:47.4084808Z 2025-03-14T05:43:47.4085614Z  2025-03-14T05:43:47.4086104Z  2025-03-14T05:43:47.4086646Z  2025-03-14T05:43:47.4087088Z  2025-03-14T05:43:47.4087565Z  2025-03-14T05:43:47.4088001Z  2025-03-14T05:43:47.4088454Z  2025-03-14T05:43:47.4088883Z  2025-03-14T05:43:47.4089485Z [10,311 / 15,235] 48 actions running 2025-03-14T05:43:47.4090468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T05:43:47.4091659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T05:43:47.4092615Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T05:43:47.4093378Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T05:43:47.4094246Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T05:43:47.4095108Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T05:43:47.4095955Z Compiling xla/service/transpose_folding.cc; 10s local 2025-03-14T05:43:47.4096798Z Compiling xla/pjrt/transpose.cc; 7s local ... 2025-03-14T05:43:47.6349949Z 2025-03-14T05:43:47.6350920Z  2025-03-14T05:43:47.6351344Z  2025-03-14T05:43:47.6352020Z  2025-03-14T05:43:47.6352458Z  2025-03-14T05:43:47.6352875Z  2025-03-14T05:43:47.6353248Z  2025-03-14T05:43:47.6353625Z  2025-03-14T05:43:47.6354019Z  2025-03-14T05:43:47.6354636Z [10,315 / 15,235] 48 actions, 47 running 2025-03-14T05:43:47.6355606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T05:43:47.6356770Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T05:43:47.6357721Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T05:43:47.6358440Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T05:43:47.6359247Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T05:43:47.6360036Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T05:43:47.6360825Z Compiling xla/service/transpose_folding.cc; 10s local 2025-03-14T05:43:47.6361581Z Compiling xla/pjrt/transpose.cc; 7s local ... 2025-03-14T05:43:48.0086509Z 2025-03-14T05:43:48.0087349Z  2025-03-14T05:43:48.0087852Z  2025-03-14T05:43:48.0088281Z  2025-03-14T05:43:48.0088688Z  2025-03-14T05:43:48.0089094Z  2025-03-14T05:43:48.0089498Z  2025-03-14T05:43:48.0089899Z  2025-03-14T05:43:48.0090297Z  2025-03-14T05:43:48.0090868Z [10,317 / 15,235] 48 actions running 2025-03-14T05:43:48.0091817Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T05:43:48.0092984Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T05:43:48.0093923Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T05:43:48.0094647Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T05:43:48.0095441Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T05:43:48.0096247Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T05:43:48.0097034Z Compiling xla/service/transpose_folding.cc; 10s local 2025-03-14T05:43:48.0097746Z Compiling xla/pjrt/transpose.cc; 7s local ... 2025-03-14T05:43:48.2680798Z 2025-03-14T05:43:48.2681606Z  2025-03-14T05:43:48.2682104Z  2025-03-14T05:43:48.2682513Z  2025-03-14T05:43:48.2682916Z  2025-03-14T05:43:48.2683295Z  2025-03-14T05:43:48.2683703Z  2025-03-14T05:43:48.2684109Z  2025-03-14T05:43:48.2684510Z  2025-03-14T05:43:48.2685281Z [10,318 / 15,235] 48 actions, 47 running 2025-03-14T05:43:48.2686245Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T05:43:48.2687393Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T05:43:48.2688311Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T05:43:48.2689066Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T05:43:48.2689878Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T05:43:48.2690717Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T05:43:48.2691530Z Compiling xla/service/transpose_folding.cc; 10s local 2025-03-14T05:43:48.2692339Z Compiling xla/pjrt/transpose.cc; 8s local ... 2025-03-14T05:43:48.5492975Z 2025-03-14T05:43:48.5493828Z  2025-03-14T05:43:48.5494344Z  2025-03-14T05:43:48.5494780Z  2025-03-14T05:43:48.5495199Z  2025-03-14T05:43:48.5495613Z  2025-03-14T05:43:48.5496131Z  2025-03-14T05:43:48.5496562Z  2025-03-14T05:43:48.5496987Z  2025-03-14T05:43:48.5497605Z [10,322 / 15,235] 48 actions, 47 running 2025-03-14T05:43:48.5498596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T05:43:48.5499822Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T05:43:48.5500822Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T05:43:48.5501627Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T05:43:48.5502874Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T05:43:48.5503739Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T05:43:48.5504583Z Compiling xla/service/transpose_folding.cc; 11s local 2025-03-14T05:43:48.5505393Z Compiling xla/pjrt/transpose.cc; 8s local ... 2025-03-14T05:43:48.7805146Z 2025-03-14T05:43:48.7805945Z  2025-03-14T05:43:48.7806398Z  2025-03-14T05:43:48.7806770Z  2025-03-14T05:43:48.7807144Z  2025-03-14T05:43:48.7807508Z  2025-03-14T05:43:48.7807869Z  2025-03-14T05:43:48.7808240Z  2025-03-14T05:43:48.7808608Z  2025-03-14T05:43:48.7809166Z [10,324 / 15,235] 48 actions, 47 running 2025-03-14T05:43:48.7810184Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T05:43:48.7811261Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T05:43:48.7812146Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T05:43:48.7812891Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T05:43:48.7813686Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T05:43:48.7814433Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T05:43:48.7815136Z Compiling xla/service/transpose_folding.cc; 11s local 2025-03-14T05:43:48.7815850Z Compiling xla/pjrt/transpose.cc; 8s local ... 2025-03-14T05:43:49.0099463Z 2025-03-14T05:43:49.0100314Z  2025-03-14T05:43:49.0100751Z  2025-03-14T05:43:49.0101124Z  2025-03-14T05:43:49.0101500Z  2025-03-14T05:43:49.0101885Z  2025-03-14T05:43:49.0102260Z  2025-03-14T05:43:49.0102668Z  2025-03-14T05:43:49.0103073Z  2025-03-14T05:43:49.0103609Z [10,327 / 15,235] 48 actions running 2025-03-14T05:43:49.0104548Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T05:43:49.0105659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T05:43:49.0106635Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T05:43:49.0107795Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T05:43:49.0108613Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T05:43:49.0109423Z Compiling xla/service/transpose_folding.cc; 11s local 2025-03-14T05:43:49.0110153Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T05:43:49.0110905Z Compiling xla/service/cpu/cpu_options.cc; 7s local ... 2025-03-14T05:43:49.2850139Z 2025-03-14T05:43:49.2851046Z  2025-03-14T05:43:49.2851549Z  2025-03-14T05:43:49.2851995Z  2025-03-14T05:43:49.2852426Z  2025-03-14T05:43:49.2852853Z  2025-03-14T05:43:49.2853288Z  2025-03-14T05:43:49.2853719Z  2025-03-14T05:43:49.2854137Z  2025-03-14T05:43:49.2854758Z [10,331 / 15,235] 48 actions, 47 running 2025-03-14T05:43:49.2855763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T05:43:49.2857015Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T05:43:49.2858025Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T05:43:49.2858826Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T05:43:49.2859712Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T05:43:49.2860578Z Compiling xla/service/transpose_folding.cc; 11s local 2025-03-14T05:43:49.2861366Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T05:43:49.2862137Z Compiling xla/service/cpu/cpu_options.cc; 7s local ... 2025-03-14T05:43:49.6149425Z 2025-03-14T05:43:49.6150245Z  2025-03-14T05:43:49.6150700Z  2025-03-14T05:43:49.6151093Z  2025-03-14T05:43:49.6151464Z  2025-03-14T05:43:49.6151848Z  2025-03-14T05:43:49.6152205Z  2025-03-14T05:43:49.6152581Z  2025-03-14T05:43:49.6152954Z  2025-03-14T05:43:49.6153500Z [10,333 / 15,235] 47 actions running 2025-03-14T05:43:49.6154754Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T05:43:49.6155948Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T05:43:49.6156759Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T05:43:49.6157429Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T05:43:49.6158150Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T05:43:49.6158891Z Compiling xla/service/transpose_folding.cc; 12s local 2025-03-14T05:43:49.6159570Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T05:43:49.6160242Z Compiling xla/service/cpu/cpu_options.cc; 7s local ... 2025-03-14T05:43:49.9788490Z 2025-03-14T05:43:49.9789297Z  2025-03-14T05:43:49.9789797Z  2025-03-14T05:43:49.9790233Z  2025-03-14T05:43:49.9790636Z  2025-03-14T05:43:49.9791012Z  2025-03-14T05:43:49.9791416Z  2025-03-14T05:43:49.9791810Z  2025-03-14T05:43:49.9792174Z  2025-03-14T05:43:49.9792870Z [10,336 / 15,235] 48 actions, 47 running 2025-03-14T05:43:49.9793819Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T05:43:49.9795004Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T05:43:49.9795954Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T05:43:49.9796739Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T05:43:49.9797578Z Compiling xla/service/batchnorm_expander.cc; 13s local 2025-03-14T05:43:49.9798318Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T05:43:49.9799098Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 8s local 2025-03-14T05:43:49.9800033Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2025-03-14T05:43:50.2074872Z 2025-03-14T05:43:50.2075768Z  2025-03-14T05:43:50.2076286Z  2025-03-14T05:43:50.2076716Z  2025-03-14T05:43:50.2077189Z  2025-03-14T05:43:50.2077656Z  2025-03-14T05:43:50.2078121Z  2025-03-14T05:43:50.2078604Z  2025-03-14T05:43:50.2079457Z  2025-03-14T05:43:50.2080073Z [10,339 / 15,235] 48 actions, 47 running 2025-03-14T05:43:50.2081235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T05:43:50.2082443Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T05:43:50.2083327Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T05:43:50.2084115Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T05:43:50.2085227Z Compiling xla/service/batchnorm_expander.cc; 13s local 2025-03-14T05:43:50.2085991Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T05:43:50.2086897Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 8s local 2025-03-14T05:43:50.2087670Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2025-03-14T05:43:50.4189489Z 2025-03-14T05:43:50.4190297Z  2025-03-14T05:43:50.4190771Z  2025-03-14T05:43:50.4191171Z  2025-03-14T05:43:50.4191601Z  2025-03-14T05:43:50.4191993Z  2025-03-14T05:43:50.4192356Z  2025-03-14T05:43:50.4192741Z  2025-03-14T05:43:50.4193097Z  2025-03-14T05:43:50.4193634Z [10,341 / 15,235] 48 actions, 47 running 2025-03-14T05:43:50.4194547Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T05:43:50.4195653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T05:43:50.4196654Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T05:43:50.4197422Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T05:43:50.4198180Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T05:43:50.4198979Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 8s local 2025-03-14T05:43:50.4199822Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T05:43:50.4200677Z Compiling xla/tsl/profiler/rpc/profiler_server.cc; 4s local ... 2025-03-14T05:43:50.6482245Z 2025-03-14T05:43:50.6483503Z  2025-03-14T05:43:50.6484055Z  2025-03-14T05:43:50.6484456Z  2025-03-14T05:43:50.6485007Z  2025-03-14T05:43:50.6485406Z  2025-03-14T05:43:50.6485781Z  2025-03-14T05:43:50.6486173Z  2025-03-14T05:43:50.6486546Z  2025-03-14T05:43:50.6487229Z [10,343 / 15,235] 48 actions running 2025-03-14T05:43:50.6488157Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T05:43:50.6489365Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T05:43:50.6490324Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T05:43:50.6491068Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T05:43:50.6491859Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T05:43:50.6492708Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 8s local 2025-03-14T05:43:50.6493516Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T05:43:50.6494398Z Compiling xla/tsl/profiler/rpc/profiler_server.cc; 5s local ... 2025-03-14T05:43:50.8487949Z 2025-03-14T05:43:50.8488762Z  2025-03-14T05:43:50.8489233Z  2025-03-14T05:43:50.8489666Z  2025-03-14T05:43:50.8490067Z  2025-03-14T05:43:50.8490477Z  2025-03-14T05:43:50.8490899Z  2025-03-14T05:43:50.8491305Z  2025-03-14T05:43:50.8491706Z  2025-03-14T05:43:50.8492298Z [10,346 / 15,235] 48 actions running 2025-03-14T05:43:50.8493194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T05:43:50.8494376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T05:43:50.8495378Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T05:43:50.8496147Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T05:43:50.8496908Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T05:43:50.8497679Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 8s local 2025-03-14T05:43:50.8498511Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T05:43:50.8499725Z Compiling xla/tsl/profiler/rpc/profiler_server.cc; 5s local ... 2025-03-14T05:43:51.0878712Z 2025-03-14T05:43:51.0879545Z  2025-03-14T05:43:51.0880136Z  2025-03-14T05:43:51.0890186Z  2025-03-14T05:43:51.0890659Z  2025-03-14T05:43:51.0891056Z  2025-03-14T05:43:51.0891443Z  2025-03-14T05:43:51.0891825Z  2025-03-14T05:43:51.0892239Z  2025-03-14T05:43:51.0892836Z [10,349 / 15,235] 48 actions, 47 running 2025-03-14T05:43:51.0893737Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T05:43:51.0894836Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T05:43:51.0895768Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T05:43:51.0896504Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T05:43:51.0897271Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T05:43:51.0898157Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local 2025-03-14T05:43:51.0899012Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T05:43:51.0899842Z Compiling xla/tsl/profiler/rpc/profiler_server.cc; 5s local ... 2025-03-14T05:43:51.3130030Z 2025-03-14T05:43:51.3130882Z  2025-03-14T05:43:51.3131391Z  2025-03-14T05:43:51.3131834Z  2025-03-14T05:43:51.3132267Z  2025-03-14T05:43:51.3132777Z  2025-03-14T05:43:51.3133119Z  2025-03-14T05:43:51.3133498Z  2025-03-14T05:43:51.3133869Z  2025-03-14T05:43:51.3134517Z [10,353 / 15,235] 48 actions, 47 running 2025-03-14T05:43:51.3135444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T05:43:51.3136564Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T05:43:51.3137469Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T05:43:51.3138559Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T05:43:51.3139288Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T05:43:51.3140073Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local 2025-03-14T05:43:51.3140824Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T05:43:51.3141677Z Compiling xla/tsl/profiler/rpc/profiler_service_impl.cc; 5s local ... 2025-03-14T05:43:51.6494168Z 2025-03-14T05:43:51.6494992Z  2025-03-14T05:43:51.6495482Z  2025-03-14T05:43:51.6495858Z  2025-03-14T05:43:51.6496211Z  2025-03-14T05:43:51.6496584Z  2025-03-14T05:43:51.6496989Z  2025-03-14T05:43:51.6497376Z  2025-03-14T05:43:51.6497786Z  2025-03-14T05:43:51.6498367Z [10,355 / 15,235] 48 actions running 2025-03-14T05:43:51.6499295Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T05:43:51.6500500Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T05:43:51.6501482Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T05:43:51.6502279Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T05:43:51.6503050Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T05:43:51.6503872Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local 2025-03-14T05:43:51.6504728Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T05:43:51.6505646Z Compiling xla/tsl/profiler/rpc/profiler_service_impl.cc; 5s local ... 2025-03-14T05:43:51.8498581Z 2025-03-14T05:43:51.8499416Z  2025-03-14T05:43:51.8499925Z  2025-03-14T05:43:51.8500381Z  2025-03-14T05:43:51.8500793Z  2025-03-14T05:43:51.8501203Z  2025-03-14T05:43:51.8501612Z  2025-03-14T05:43:51.8502015Z  2025-03-14T05:43:51.8502399Z  2025-03-14T05:43:51.8502961Z [10,357 / 15,235] 48 actions running 2025-03-14T05:43:51.8503854Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T05:43:51.8504948Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T05:43:51.8506263Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T05:43:51.8507026Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T05:43:51.8507783Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T05:43:51.8508577Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 9s local 2025-03-14T05:43:51.8509418Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T05:43:51.8510260Z Compiling xla/tsl/profiler/rpc/profiler_service_impl.cc; 5s local ... 2025-03-14T05:43:52.0535473Z 2025-03-14T05:43:52.0536237Z  2025-03-14T05:43:52.0536721Z  2025-03-14T05:43:52.0537138Z  2025-03-14T05:43:52.0537538Z  2025-03-14T05:43:52.0537939Z  2025-03-14T05:43:52.0538346Z  2025-03-14T05:43:52.0538750Z  2025-03-14T05:43:52.0539134Z  2025-03-14T05:43:52.0539740Z [10,360 / 15,235] 48 actions, 47 running 2025-03-14T05:43:52.0540745Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T05:43:52.0541936Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T05:43:52.0542852Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T05:43:52.0543603Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T05:43:52.0544357Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T05:43:52.0545186Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local 2025-03-14T05:43:52.0546033Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T05:43:52.0546934Z Compiling xla/tsl/profiler/rpc/client/capture_profile.cc; 6s local ... 2025-03-14T05:43:52.4747488Z 2025-03-14T05:43:52.4748335Z  2025-03-14T05:43:52.4748813Z  2025-03-14T05:43:52.4749196Z  2025-03-14T05:43:52.4749595Z  2025-03-14T05:43:52.4750006Z  2025-03-14T05:43:52.4750533Z  2025-03-14T05:43:52.4750898Z  2025-03-14T05:43:52.4751627Z  2025-03-14T05:43:52.4752259Z [10,363 / 15,235] 48 actions, 47 running 2025-03-14T05:43:52.4753212Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T05:43:52.4754280Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T05:43:52.4755166Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T05:43:52.4755852Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T05:43:52.4756534Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T05:43:52.4757383Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local 2025-03-14T05:43:52.4758125Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T05:43:52.4758927Z Compiling external/tsl/.../protobuf/trace_events.pb.cc; 5s local ... 2025-03-14T05:43:52.6506048Z 2025-03-14T05:43:52.6506869Z  2025-03-14T05:43:52.6507491Z  2025-03-14T05:43:52.6507927Z  2025-03-14T05:43:52.6508345Z  2025-03-14T05:43:52.6508824Z  2025-03-14T05:43:52.6509250Z  2025-03-14T05:43:52.6509684Z  2025-03-14T05:43:52.6510107Z  2025-03-14T05:43:52.6510720Z [10,366 / 15,235] 48 actions running 2025-03-14T05:43:52.6511548Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T05:43:52.6512615Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T05:43:52.6513498Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T05:43:52.6514227Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T05:43:52.6514948Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T05:43:52.6515737Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 10s local 2025-03-14T05:43:52.6516697Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T05:43:52.6517471Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local ... 2025-03-14T05:43:52.9666148Z 2025-03-14T05:43:52.9666991Z  2025-03-14T05:43:52.9667464Z  2025-03-14T05:43:52.9667881Z  2025-03-14T05:43:52.9668284Z  2025-03-14T05:43:52.9669002Z  2025-03-14T05:43:52.9669412Z  2025-03-14T05:43:52.9669791Z  2025-03-14T05:43:52.9670183Z  2025-03-14T05:43:52.9670762Z [10,367 / 15,235] 48 actions, 47 running 2025-03-14T05:43:52.9671671Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T05:43:52.9672749Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T05:43:52.9673638Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T05:43:52.9674389Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T05:43:52.9675116Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T05:43:52.9675908Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local 2025-03-14T05:43:52.9676806Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:43:52.9677592Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local ... 2025-03-14T05:43:53.2034187Z 2025-03-14T05:43:53.2034985Z  2025-03-14T05:43:53.2035451Z  2025-03-14T05:43:53.2035791Z  2025-03-14T05:43:53.2036161Z  2025-03-14T05:43:53.2036538Z  2025-03-14T05:43:53.2036926Z  2025-03-14T05:43:53.2037318Z  2025-03-14T05:43:53.2037718Z  2025-03-14T05:43:53.2038330Z [10,368 / 15,235] 48 actions, 47 running 2025-03-14T05:43:53.2039220Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T05:43:53.2040323Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T05:43:53.2041246Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T05:43:53.2042023Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T05:43:53.2042756Z Compiling xla/pjrt/transpose.cc; 13s local 2025-03-14T05:43:53.2043563Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local 2025-03-14T05:43:53.2044398Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:43:53.2045776Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local ... 2025-03-14T05:43:53.4267878Z 2025-03-14T05:43:53.4268695Z  2025-03-14T05:43:53.4269156Z  2025-03-14T05:43:53.4269532Z  2025-03-14T05:43:53.4269919Z  2025-03-14T05:43:53.4270310Z  2025-03-14T05:43:53.4270693Z  2025-03-14T05:43:53.4271078Z  2025-03-14T05:43:53.4271459Z  2025-03-14T05:43:53.4272028Z [10,369 / 15,235] 48 actions, 47 running 2025-03-14T05:43:53.4272912Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T05:43:53.4273980Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T05:43:53.4274852Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T05:43:53.4275523Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T05:43:53.4276277Z Compiling xla/pjrt/transpose.cc; 13s local 2025-03-14T05:43:53.4277050Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local 2025-03-14T05:43:53.4277786Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:43:53.4278748Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 5s local ... 2025-03-14T05:43:53.6554764Z 2025-03-14T05:43:53.6555608Z  2025-03-14T05:43:53.6556094Z  2025-03-14T05:43:53.6556539Z  2025-03-14T05:43:53.6556958Z  2025-03-14T05:43:53.6557334Z  2025-03-14T05:43:53.6557726Z  2025-03-14T05:43:53.6558195Z  2025-03-14T05:43:53.6558546Z  2025-03-14T05:43:53.6559040Z [10,377 / 15,235] 48 actions running 2025-03-14T05:43:53.6559917Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T05:43:53.6561071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T05:43:53.6561948Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T05:43:53.6562723Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T05:43:53.6563634Z Compiling xla/tsl/platform/cloud/gcs_file_system.cc; 11s local 2025-03-14T05:43:53.6565061Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:43:53.6566058Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2025-03-14T05:43:53.6567001Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 6s local ... 2025-03-14T05:43:53.8559783Z 2025-03-14T05:43:53.8560605Z  2025-03-14T05:43:53.8561072Z  2025-03-14T05:43:53.8561483Z  2025-03-14T05:43:53.8561883Z  2025-03-14T05:43:53.8562294Z  2025-03-14T05:43:53.8562686Z  2025-03-14T05:43:53.8563074Z  2025-03-14T05:43:53.8563478Z  2025-03-14T05:43:53.8564045Z [10,381 / 15,235] 48 actions running 2025-03-14T05:43:53.8565063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T05:43:53.8566557Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T05:43:53.8567509Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T05:43:53.8568277Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T05:43:53.8569061Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:43:53.8569876Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2025-03-14T05:43:53.8570898Z Compiling xla/tsl/profiler/rpc/client/profiler_client.cc; 5s local 2025-03-14T05:43:53.8572084Z @tsl//tsl/profiler/protobuf:profiler_analysis_cc_grpc_proto; 5s local ... 2025-03-14T05:43:54.0614622Z 2025-03-14T05:43:54.0615383Z  2025-03-14T05:43:54.0615851Z  2025-03-14T05:43:54.0616273Z  2025-03-14T05:43:54.0616699Z  2025-03-14T05:43:54.0617115Z  2025-03-14T05:43:54.0617516Z  2025-03-14T05:43:54.0617944Z  2025-03-14T05:43:54.0618368Z  2025-03-14T05:43:54.0619004Z [10,385 / 15,235] 48 actions, 47 running 2025-03-14T05:43:54.0620024Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T05:43:54.0621538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T05:43:54.0622572Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T05:43:54.0623346Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T05:43:54.0624109Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:43:54.0624894Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2025-03-14T05:43:54.0625859Z Compiling xla/tsl/profiler/rpc/client/profiler_client.cc; 5s local 2025-03-14T05:43:54.0626998Z @tsl//tsl/profiler/protobuf:profiler_analysis_cc_grpc_proto; 5s local ... 2025-03-14T05:43:54.2619419Z 2025-03-14T05:43:54.2620248Z  2025-03-14T05:43:54.2620753Z  2025-03-14T05:43:54.2621154Z  2025-03-14T05:43:54.2621570Z  2025-03-14T05:43:54.2621983Z  2025-03-14T05:43:54.2622393Z  2025-03-14T05:43:54.2622808Z  2025-03-14T05:43:54.2623210Z  2025-03-14T05:43:54.2623788Z [10,389 / 15,235] 48 actions running 2025-03-14T05:43:54.2624809Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T05:43:54.2626039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T05:43:54.2626998Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T05:43:54.2627722Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T05:43:54.2628459Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:43:54.2629241Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 6s local 2025-03-14T05:43:54.2630295Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 5s local 2025-03-14T05:43:54.2631466Z @tsl//tsl/profiler/protobuf:profiler_service_cc_grpc_proto; 5s local ... 2025-03-14T05:43:54.5924867Z 2025-03-14T05:43:54.5925812Z  2025-03-14T05:43:54.5926279Z  2025-03-14T05:43:54.5926696Z  2025-03-14T05:43:54.5927068Z  2025-03-14T05:43:54.5927464Z  2025-03-14T05:43:54.5927859Z  2025-03-14T05:43:54.5928253Z  2025-03-14T05:43:54.5928677Z  2025-03-14T05:43:54.5929278Z [10,393 / 15,235] 48 actions, 47 running 2025-03-14T05:43:54.5930595Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T05:43:54.5931757Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T05:43:54.5932675Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T05:43:54.5933414Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T05:43:54.5934147Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:43:54.5934946Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2025-03-14T05:43:54.5936002Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 6s local 2025-03-14T05:43:54.5937156Z @tsl//tsl/profiler/protobuf:profiler_service_cc_grpc_proto; 5s local ... 2025-03-14T05:43:54.8626145Z 2025-03-14T05:43:54.8627089Z  2025-03-14T05:43:54.8627584Z  2025-03-14T05:43:54.8627946Z  2025-03-14T05:43:54.8628354Z  2025-03-14T05:43:54.8628715Z  2025-03-14T05:43:54.8629140Z  2025-03-14T05:43:54.8629511Z  2025-03-14T05:43:54.8629908Z  2025-03-14T05:43:54.8630449Z [10,396 / 15,235] 48 actions running 2025-03-14T05:43:54.8631361Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T05:43:54.8632470Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T05:43:54.8633340Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T05:43:54.8634075Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T05:43:54.8634812Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:43:54.8635568Z Compiling xla/tsl/profiler/utils/xplane_utils.cc; 7s local 2025-03-14T05:43:54.8636558Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 6s local 2025-03-14T05:43:54.8637692Z @tsl//tsl/profiler/protobuf:profiler_service_cc_grpc_proto; 6s local ... 2025-03-14T05:43:55.1949324Z 2025-03-14T05:43:55.1950157Z  2025-03-14T05:43:55.1950654Z  2025-03-14T05:43:55.1951067Z  2025-03-14T05:43:55.1951468Z  2025-03-14T05:43:55.1951878Z  2025-03-14T05:43:55.1952414Z  2025-03-14T05:43:55.1952835Z  2025-03-14T05:43:55.1953255Z  2025-03-14T05:43:55.1953872Z [10,399 / 15,235] 48 actions, 47 running 2025-03-14T05:43:55.1954853Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T05:43:55.1956066Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T05:43:55.1957033Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T05:43:55.1957804Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T05:43:55.1958477Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T05:43:55.1959328Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 6s local 2025-03-14T05:43:55.1960477Z Compiling external/tsl/.../protobuf/profiler_service.grpc.pb.cc; 6s local 2025-03-14T05:43:55.1961532Z Compiling .../preemption/preemption_sync_manager.cc; 6s local ... 2025-03-14T05:43:55.4181061Z 2025-03-14T05:43:55.4181892Z  2025-03-14T05:43:55.4182390Z  2025-03-14T05:43:55.4182793Z  2025-03-14T05:43:55.4183215Z  2025-03-14T05:43:55.4183596Z  2025-03-14T05:43:55.4184031Z  2025-03-14T05:43:55.4184430Z  2025-03-14T05:43:55.4184828Z  2025-03-14T05:43:55.4185456Z [10,404 / 15,235] 48 actions, 47 running 2025-03-14T05:43:55.4186443Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T05:43:55.4187628Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T05:43:55.4188556Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T05:43:55.4189352Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T05:43:55.4190146Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T05:43:55.4190857Z Compiling xla/pjrt/distributed/client.cc; 6s local 2025-03-14T05:43:55.4192126Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 6s local 2025-03-14T05:43:55.4193160Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 5s local ... 2025-03-14T05:43:55.6612455Z 2025-03-14T05:43:55.6613294Z  2025-03-14T05:43:55.6613807Z  2025-03-14T05:43:55.6614207Z  2025-03-14T05:43:55.6614598Z  2025-03-14T05:43:55.6615009Z  2025-03-14T05:43:55.6615411Z  2025-03-14T05:43:55.6615808Z  2025-03-14T05:43:55.6616194Z  2025-03-14T05:43:55.6616835Z [10,412 / 15,235] 48 actions, 47 running 2025-03-14T05:43:55.6617776Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T05:43:55.6618927Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T05:43:55.6619864Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T05:43:55.6620649Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T05:43:55.6621402Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T05:43:55.6622257Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 6s local 2025-03-14T05:43:55.6623318Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T05:43:55.6624354Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 5s local ... 2025-03-14T05:43:55.8635052Z 2025-03-14T05:43:55.8635861Z  2025-03-14T05:43:55.8636390Z  2025-03-14T05:43:55.8636815Z  2025-03-14T05:43:55.8637248Z  2025-03-14T05:43:55.8637654Z  2025-03-14T05:43:55.8638077Z  2025-03-14T05:43:55.8638491Z  2025-03-14T05:43:55.8638915Z  2025-03-14T05:43:55.8639514Z [10,415 / 15,235] 48 actions running 2025-03-14T05:43:55.8640523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T05:43:55.8641754Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T05:43:55.8643105Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T05:43:55.8643945Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T05:43:55.8644897Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T05:43:55.8645762Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 6s local 2025-03-14T05:43:55.8646889Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T05:43:55.8647968Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 5s local ... 2025-03-14T05:43:56.0818341Z 2025-03-14T05:43:56.0819155Z  2025-03-14T05:43:56.0819659Z  2025-03-14T05:43:56.0820112Z  2025-03-14T05:43:56.0820555Z  2025-03-14T05:43:56.0821000Z  2025-03-14T05:43:56.0821448Z  2025-03-14T05:43:56.0821886Z  2025-03-14T05:43:56.0822256Z  2025-03-14T05:43:56.0822867Z [10,422 / 15,235] 48 actions, 47 running 2025-03-14T05:43:56.0823854Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T05:43:56.0824985Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T05:43:56.0825929Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T05:43:56.0826706Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T05:43:56.0827507Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:43:56.0828427Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 6s local 2025-03-14T05:43:56.0829590Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T05:43:56.0830757Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 5s local ... 2025-03-14T05:43:56.2794819Z 2025-03-14T05:43:56.2795823Z  2025-03-14T05:43:56.2796319Z  2025-03-14T05:43:56.2796743Z  2025-03-14T05:43:56.2797162Z  2025-03-14T05:43:56.2797575Z  2025-03-14T05:43:56.2797996Z  2025-03-14T05:43:56.2798411Z  2025-03-14T05:43:56.2798824Z  2025-03-14T05:43:56.2799485Z [10,432 / 15,235] 48 actions, 47 running 2025-03-14T05:43:56.2800824Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T05:43:56.2802007Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T05:43:56.2802960Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T05:43:56.2803709Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T05:43:56.2804461Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:43:56.2805482Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 6s local 2025-03-14T05:43:56.2806369Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T05:43:56.2807260Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 5s local ... 2025-03-14T05:43:56.4891979Z 2025-03-14T05:43:56.4892788Z  2025-03-14T05:43:56.4893315Z  2025-03-14T05:43:56.4893750Z  2025-03-14T05:43:56.4894171Z  2025-03-14T05:43:56.4894639Z  2025-03-14T05:43:56.4895070Z  2025-03-14T05:43:56.4895616Z  2025-03-14T05:43:56.4896034Z  2025-03-14T05:43:56.4896656Z [10,442 / 15,235] 48 actions, 47 running 2025-03-14T05:43:56.4897638Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T05:43:56.4898807Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T05:43:56.4899667Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T05:43:56.4900402Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T05:43:56.4901151Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:43:56.4902009Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 7s local 2025-03-14T05:43:56.4903071Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T05:43:56.4904084Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 6s local ... 2025-03-14T05:43:56.7000385Z 2025-03-14T05:43:56.7001305Z  2025-03-14T05:43:56.7002283Z  2025-03-14T05:43:56.7002782Z  2025-03-14T05:43:56.7003194Z  2025-03-14T05:43:56.7003599Z  2025-03-14T05:43:56.7003988Z  2025-03-14T05:43:56.7004374Z  2025-03-14T05:43:56.7004924Z  2025-03-14T05:43:56.7005562Z [10,458 / 15,235] 48 actions, 47 running 2025-03-14T05:43:56.7006506Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T05:43:56.7007698Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T05:43:56.7008620Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T05:43:56.7009373Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T05:43:56.7010102Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:43:56.7010980Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 7s local 2025-03-14T05:43:56.7012069Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2025-03-14T05:43:56.7013163Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 6s local ... 2025-03-14T05:43:56.9058778Z 2025-03-14T05:43:56.9059605Z  2025-03-14T05:43:56.9060064Z  2025-03-14T05:43:56.9060469Z  2025-03-14T05:43:56.9060857Z  2025-03-14T05:43:56.9061242Z  2025-03-14T05:43:56.9061625Z  2025-03-14T05:43:56.9062012Z  2025-03-14T05:43:56.9062407Z  2025-03-14T05:43:56.9062998Z [10,460 / 15,235] 48 actions, 47 running 2025-03-14T05:43:56.9063820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T05:43:56.9064880Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T05:43:56.9066177Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T05:43:56.9066882Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T05:43:56.9067561Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:43:56.9068414Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2025-03-14T05:43:56.9069419Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 6s local 2025-03-14T05:43:56.9070740Z Compiling xla/client/executable_build_options.cc; 5s local ... 2025-03-14T05:43:57.1287465Z 2025-03-14T05:43:57.1288336Z  2025-03-14T05:43:57.1288834Z  2025-03-14T05:43:57.1289267Z  2025-03-14T05:43:57.1289685Z  2025-03-14T05:43:57.1290081Z  2025-03-14T05:43:57.1290506Z  2025-03-14T05:43:57.1290936Z  2025-03-14T05:43:57.1291347Z  2025-03-14T05:43:57.1291971Z [10,467 / 15,235] 48 actions, 47 running 2025-03-14T05:43:57.1292947Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T05:43:57.1294132Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T05:43:57.1295108Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T05:43:57.1295876Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T05:43:57.1296690Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:43:57.1297488Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2025-03-14T05:43:57.1298440Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 6s local 2025-03-14T05:43:57.1299366Z Compiling xla/client/executable_build_options.cc; 5s local ... 2025-03-14T05:43:57.4131599Z 2025-03-14T05:43:57.4132462Z  2025-03-14T05:43:57.4132933Z  2025-03-14T05:43:57.4133332Z  2025-03-14T05:43:57.4133710Z  2025-03-14T05:43:57.4134128Z  2025-03-14T05:43:57.4134548Z  2025-03-14T05:43:57.4134937Z  2025-03-14T05:43:57.4135300Z  2025-03-14T05:43:57.4135923Z [10,475 / 15,235] 48 actions, 47 running 2025-03-14T05:43:57.4136767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T05:43:57.4137797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T05:43:57.4139063Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T05:43:57.4139841Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T05:43:57.4140564Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:43:57.4141414Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2025-03-14T05:43:57.4142413Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 6s local 2025-03-14T05:43:57.4143394Z Compiling xla/client/executable_build_options.cc; 6s local ... 2025-03-14T05:43:57.6105207Z 2025-03-14T05:43:57.6106012Z  2025-03-14T05:43:57.6106507Z  2025-03-14T05:43:57.6106933Z  2025-03-14T05:43:57.6107333Z  2025-03-14T05:43:57.6107728Z  2025-03-14T05:43:57.6108130Z  2025-03-14T05:43:57.6108505Z  2025-03-14T05:43:57.6108910Z  2025-03-14T05:43:57.6109507Z [10,489 / 15,235] 48 actions, 47 running 2025-03-14T05:43:57.6110477Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T05:43:57.6111479Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T05:43:57.6112271Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T05:43:57.6112972Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:43:57.6113830Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2025-03-14T05:43:57.6114871Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 7s local 2025-03-14T05:43:57.6115812Z Compiling xla/client/executable_build_options.cc; 6s local 2025-03-14T05:43:57.6116846Z Compiling .../coordination/coordination_service.cc; 6s local ... 2025-03-14T05:43:57.8649488Z 2025-03-14T05:43:57.8650351Z  2025-03-14T05:43:57.8650847Z  2025-03-14T05:43:57.8651257Z  2025-03-14T05:43:57.8651679Z  2025-03-14T05:43:57.8652111Z  2025-03-14T05:43:57.8652529Z  2025-03-14T05:43:57.8652938Z  2025-03-14T05:43:57.8653347Z  2025-03-14T05:43:57.8653946Z [10,509 / 15,235] 48 actions running 2025-03-14T05:43:57.8654937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T05:43:57.8656292Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T05:43:57.8657085Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T05:43:57.8657869Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:43:57.8658691Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 7s local 2025-03-14T05:43:57.8659677Z Compiling xla/client/executable_build_options.cc; 6s local 2025-03-14T05:43:57.8660607Z Compiling .../coordination/coordination_service.cc; 6s local 2025-03-14T05:43:57.8661646Z Compiling .../coordination/grpc_coordination_service_impl.cc; 6s local ... 2025-03-14T05:43:58.0956553Z 2025-03-14T05:43:58.0957371Z  2025-03-14T05:43:58.0957859Z  2025-03-14T05:43:58.0958278Z  2025-03-14T05:43:58.0958697Z  2025-03-14T05:43:58.0959134Z  2025-03-14T05:43:58.0959552Z  2025-03-14T05:43:58.0959961Z  2025-03-14T05:43:58.0960403Z  2025-03-14T05:43:58.0960988Z [10,514 / 15,235] 48 actions, 47 running 2025-03-14T05:43:58.0961952Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T05:43:58.0962879Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T05:43:58.0963632Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T05:43:58.0964375Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:43:58.0965553Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 7s local 2025-03-14T05:43:58.0966502Z Compiling xla/client/executable_build_options.cc; 6s local 2025-03-14T05:43:58.0967472Z Compiling .../coordination/coordination_service.cc; 6s local 2025-03-14T05:43:58.0968459Z Compiling .../coordination/grpc_coordination_service_impl.cc; 6s local ... 2025-03-14T05:43:58.3880701Z 2025-03-14T05:43:58.3881539Z  2025-03-14T05:43:58.3882021Z  2025-03-14T05:43:58.3882420Z  2025-03-14T05:43:58.3882805Z  2025-03-14T05:43:58.3883545Z  2025-03-14T05:43:58.3883965Z  2025-03-14T05:43:58.3884375Z  2025-03-14T05:43:58.3884913Z  2025-03-14T05:43:58.3885492Z [10,518 / 15,235] 48 actions, 47 running 2025-03-14T05:43:58.3886405Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T05:43:58.3887313Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T05:43:58.3888000Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T05:43:58.3888707Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:43:58.3889500Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 7s local 2025-03-14T05:43:58.3890412Z Compiling xla/client/executable_build_options.cc; 7s local 2025-03-14T05:43:58.3891274Z Compiling .../coordination/coordination_service.cc; 6s local 2025-03-14T05:43:58.3892314Z Compiling .../coordination/grpc_coordination_service_impl.cc; 6s local ... 2025-03-14T05:43:58.5927264Z 2025-03-14T05:43:58.5928104Z  2025-03-14T05:43:58.5928645Z  2025-03-14T05:43:58.5929080Z  2025-03-14T05:43:58.5929527Z  2025-03-14T05:43:58.5929957Z  2025-03-14T05:43:58.5930377Z  2025-03-14T05:43:58.5930767Z  2025-03-14T05:43:58.5931193Z  2025-03-14T05:43:58.5931814Z [10,523 / 15,235] 48 actions, 47 running 2025-03-14T05:43:58.5932812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T05:43:58.5933783Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T05:43:58.5934572Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T05:43:58.5935357Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:43:58.5936173Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 8s local 2025-03-14T05:43:58.5937181Z Compiling xla/client/executable_build_options.cc; 7s local 2025-03-14T05:43:58.5938157Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T05:43:58.5939248Z Compiling .../coordination/grpc_coordination_service_impl.cc; 6s local ... 2025-03-14T05:43:58.8659850Z 2025-03-14T05:43:58.8660681Z  2025-03-14T05:43:58.8661189Z  2025-03-14T05:43:58.8661617Z  2025-03-14T05:43:58.8662054Z  2025-03-14T05:43:58.8662472Z  2025-03-14T05:43:58.8662888Z  2025-03-14T05:43:58.8663303Z  2025-03-14T05:43:58.8663697Z  2025-03-14T05:43:58.8664270Z [10,529 / 15,235] 48 actions running 2025-03-14T05:43:58.8665229Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T05:43:58.8666324Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T05:43:58.8667110Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T05:43:58.8667877Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:43:58.8668699Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 8s local 2025-03-14T05:43:58.8669760Z Compiling xla/client/executable_build_options.cc; 7s local 2025-03-14T05:43:58.8670745Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T05:43:58.8671832Z Compiling .../coordination/grpc_coordination_service_impl.cc; 7s local ... 2025-03-14T05:43:59.1101211Z 2025-03-14T05:43:59.1102040Z  2025-03-14T05:43:59.1102556Z  2025-03-14T05:43:59.1102996Z  2025-03-14T05:43:59.1103429Z  2025-03-14T05:43:59.1103852Z  2025-03-14T05:43:59.1104278Z  2025-03-14T05:43:59.1104702Z  2025-03-14T05:43:59.1105112Z  2025-03-14T05:43:59.1105739Z [10,542 / 15,235] 48 actions, 47 running 2025-03-14T05:43:59.1106849Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T05:43:59.1107852Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T05:43:59.1108811Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T05:43:59.1109589Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T05:43:59.1110440Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 8s local 2025-03-14T05:43:59.1111951Z Compiling xla/client/executable_build_options.cc; 7s local 2025-03-14T05:43:59.1113036Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T05:43:59.1114115Z Compiling .../coordination/grpc_coordination_service_impl.cc; 7s local ... 2025-03-14T05:43:59.3140723Z 2025-03-14T05:43:59.3141558Z  2025-03-14T05:43:59.3142052Z  2025-03-14T05:43:59.3142483Z  2025-03-14T05:43:59.3142886Z  2025-03-14T05:43:59.3143303Z  2025-03-14T05:43:59.3143712Z  2025-03-14T05:43:59.3144129Z  2025-03-14T05:43:59.3145058Z  2025-03-14T05:43:59.3145772Z [10,549 / 15,235] 48 actions, 47 running 2025-03-14T05:43:59.3146816Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T05:43:59.3147931Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T05:43:59.3148645Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T05:43:59.3149412Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T05:43:59.3150171Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 8s local 2025-03-14T05:43:59.3151126Z Compiling xla/client/executable_build_options.cc; 8s local 2025-03-14T05:43:59.3152042Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T05:43:59.3153092Z Compiling .../coordination/grpc_coordination_service_impl.cc; 7s local ... 2025-03-14T05:43:59.5675663Z 2025-03-14T05:43:59.5676472Z  2025-03-14T05:43:59.5676960Z  2025-03-14T05:43:59.5677381Z  2025-03-14T05:43:59.5677759Z  2025-03-14T05:43:59.5678141Z  2025-03-14T05:43:59.5678544Z  2025-03-14T05:43:59.5678933Z  2025-03-14T05:43:59.5679315Z  2025-03-14T05:43:59.5679896Z [10,554 / 15,235] 48 actions, 47 running 2025-03-14T05:43:59.5680830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T05:43:59.5681773Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T05:43:59.5682540Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T05:43:59.5683609Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T05:43:59.5684346Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 9s local 2025-03-14T05:43:59.5685365Z Compiling xla/client/executable_build_options.cc; 8s local 2025-03-14T05:43:59.5686174Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T05:43:59.5687162Z Compiling .../coordination/grpc_coordination_service_impl.cc; 7s local ... 2025-03-14T05:43:59.7655888Z 2025-03-14T05:43:59.7656720Z  2025-03-14T05:43:59.7657212Z  2025-03-14T05:43:59.7657623Z  2025-03-14T05:43:59.7658011Z  2025-03-14T05:43:59.7658402Z  2025-03-14T05:43:59.7658769Z  2025-03-14T05:43:59.7659176Z  2025-03-14T05:43:59.7659576Z  2025-03-14T05:43:59.7660170Z [10,561 / 15,235] 48 actions, 47 running 2025-03-14T05:43:59.7661064Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T05:43:59.7662005Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T05:43:59.7662776Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T05:43:59.7663456Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T05:43:59.7664227Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 9s local 2025-03-14T05:43:59.7665150Z Compiling xla/client/executable_build_options.cc; 8s local 2025-03-14T05:43:59.7666308Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T05:43:59.7667243Z Compiling .../coordination/grpc_coordination_service_impl.cc; 7s local ... 2025-03-14T05:43:59.9678001Z 2025-03-14T05:43:59.9678812Z  2025-03-14T05:43:59.9679395Z  2025-03-14T05:43:59.9679809Z  2025-03-14T05:43:59.9680193Z  2025-03-14T05:43:59.9680569Z  2025-03-14T05:43:59.9680960Z  2025-03-14T05:43:59.9681320Z  2025-03-14T05:43:59.9681680Z  2025-03-14T05:43:59.9682604Z [10,575 / 15,235] 48 actions, 47 running 2025-03-14T05:43:59.9683553Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T05:43:59.9684448Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T05:43:59.9685324Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T05:43:59.9686046Z @llvm-project//llvm:llvm-tblgen; 15s local 2025-03-14T05:43:59.9686821Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 9s local 2025-03-14T05:43:59.9687706Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T05:43:59.9688667Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 8s local 2025-03-14T05:43:59.9689707Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2025-03-14T05:44:00.1677882Z 2025-03-14T05:44:00.1678749Z  2025-03-14T05:44:00.1679260Z  2025-03-14T05:44:00.1679663Z  2025-03-14T05:44:00.1680113Z  2025-03-14T05:44:00.1680547Z  2025-03-14T05:44:00.1681029Z  2025-03-14T05:44:00.1681455Z  2025-03-14T05:44:00.1681870Z  2025-03-14T05:44:00.1682458Z [10,591 / 15,235] 47 actions, 46 running 2025-03-14T05:44:00.1683405Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T05:44:00.1684412Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T05:44:00.1685371Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T05:44:00.1686106Z @llvm-project//llvm:llvm-tblgen; 15s local 2025-03-14T05:44:00.1686946Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 9s local 2025-03-14T05:44:00.1687889Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T05:44:00.1688936Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 8s local 2025-03-14T05:44:00.1690081Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2025-03-14T05:44:00.3737297Z 2025-03-14T05:44:00.3738158Z  2025-03-14T05:44:00.3738684Z  2025-03-14T05:44:00.3739153Z  2025-03-14T05:44:00.3739589Z  2025-03-14T05:44:00.3740298Z  2025-03-14T05:44:00.3740734Z  2025-03-14T05:44:00.3741162Z  2025-03-14T05:44:00.3741598Z  2025-03-14T05:44:00.3742239Z [10,602 / 15,235] 48 actions, 47 running 2025-03-14T05:44:00.3743238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T05:44:00.3744244Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T05:44:00.3745014Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T05:44:00.3745802Z @llvm-project//llvm:llvm-tblgen; 15s local 2025-03-14T05:44:00.3746680Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 9s local 2025-03-14T05:44:00.3747703Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T05:44:00.3748786Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 8s local 2025-03-14T05:44:00.3749992Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2025-03-14T05:44:00.6120728Z 2025-03-14T05:44:00.6121584Z  2025-03-14T05:44:00.6122118Z  2025-03-14T05:44:00.6122528Z  2025-03-14T05:44:00.6123031Z  2025-03-14T05:44:00.6123441Z  2025-03-14T05:44:00.6123848Z  2025-03-14T05:44:00.6124250Z  2025-03-14T05:44:00.6124818Z  2025-03-14T05:44:00.6125476Z [10,611 / 15,235] 48 actions, 47 running 2025-03-14T05:44:00.6126436Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T05:44:00.6127369Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T05:44:00.6128130Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T05:44:00.6129059Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T05:44:00.6130013Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T05:44:00.6131049Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 8s local 2025-03-14T05:44:00.6132555Z Compiling .../coordination/coordination_service_agent.cc; 8s local 2025-03-14T05:44:00.6133732Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 6s local ... 2025-03-14T05:44:00.8373819Z 2025-03-14T05:44:00.8374672Z  2025-03-14T05:44:00.8375197Z  2025-03-14T05:44:00.8375632Z  2025-03-14T05:44:00.8376059Z  2025-03-14T05:44:00.8376472Z  2025-03-14T05:44:00.8376892Z  2025-03-14T05:44:00.8377304Z  2025-03-14T05:44:00.8377699Z  2025-03-14T05:44:00.8378328Z [10,624 / 15,235] 48 actions, 47 running 2025-03-14T05:44:00.8379323Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T05:44:00.8380303Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T05:44:00.8381099Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T05:44:00.8382006Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T05:44:00.8383025Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T05:44:00.8384197Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2025-03-14T05:44:00.8385336Z Compiling .../coordination/coordination_service_agent.cc; 8s local 2025-03-14T05:44:00.8386408Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T05:44:01.0623443Z 2025-03-14T05:44:01.0624287Z  2025-03-14T05:44:01.0624769Z  2025-03-14T05:44:01.0625192Z  2025-03-14T05:44:01.0625620Z  2025-03-14T05:44:01.0626048Z  2025-03-14T05:44:01.0626465Z  2025-03-14T05:44:01.0626871Z  2025-03-14T05:44:01.0627292Z  2025-03-14T05:44:01.0627923Z [10,636 / 15,235] 48 actions, 47 running 2025-03-14T05:44:01.0628855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T05:44:01.0629823Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T05:44:01.0630635Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T05:44:01.0631374Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T05:44:01.0632725Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T05:44:01.0633793Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2025-03-14T05:44:01.0634924Z Compiling .../coordination/coordination_service_agent.cc; 9s local 2025-03-14T05:44:01.0636022Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T05:44:01.2733794Z 2025-03-14T05:44:01.2734596Z  2025-03-14T05:44:01.2735034Z  2025-03-14T05:44:01.2735397Z  2025-03-14T05:44:01.2735754Z  2025-03-14T05:44:01.2736115Z  2025-03-14T05:44:01.2736475Z  2025-03-14T05:44:01.2736828Z  2025-03-14T05:44:01.2737173Z  2025-03-14T05:44:01.2737727Z [10,653 / 15,235] 48 actions, 47 running 2025-03-14T05:44:01.2738559Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T05:44:01.2739443Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T05:44:01.2748779Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T05:44:01.2749836Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T05:44:01.2750735Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T05:44:01.2751791Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2025-03-14T05:44:01.2752830Z Compiling .../coordination/coordination_service_agent.cc; 9s local 2025-03-14T05:44:01.2753888Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T05:44:01.4768679Z 2025-03-14T05:44:01.4769505Z  2025-03-14T05:44:01.4770029Z  2025-03-14T05:44:01.4770475Z  2025-03-14T05:44:01.4770912Z  2025-03-14T05:44:01.4771352Z  2025-03-14T05:44:01.4771777Z  2025-03-14T05:44:01.4772206Z  2025-03-14T05:44:01.4772621Z  2025-03-14T05:44:01.4773573Z [10,665 / 15,235] 48 actions, 47 running 2025-03-14T05:44:01.4774613Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T05:44:01.4775645Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T05:44:01.4776412Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T05:44:01.4777333Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 11s local 2025-03-14T05:44:01.4778357Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T05:44:01.4779468Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2025-03-14T05:44:01.4780603Z Compiling .../coordination/coordination_service_agent.cc; 9s local 2025-03-14T05:44:01.4781741Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T05:44:01.6901298Z 2025-03-14T05:44:01.6902157Z  2025-03-14T05:44:01.6902685Z  2025-03-14T05:44:01.6903096Z  2025-03-14T05:44:01.6903510Z  2025-03-14T05:44:01.6903989Z  2025-03-14T05:44:01.6904446Z  2025-03-14T05:44:01.6904896Z  2025-03-14T05:44:01.6905331Z  2025-03-14T05:44:01.6905968Z [10,671 / 15,235] 48 actions, 47 running 2025-03-14T05:44:01.6906936Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T05:44:01.6907933Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T05:44:01.6908727Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T05:44:01.6909631Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 11s local 2025-03-14T05:44:01.6910647Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T05:44:01.6911749Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2025-03-14T05:44:01.6912854Z Compiling .../coordination/coordination_service_agent.cc; 9s local 2025-03-14T05:44:01.6914119Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T05:44:01.8929693Z 2025-03-14T05:44:01.8930578Z  2025-03-14T05:44:01.8931115Z  2025-03-14T05:44:01.8931912Z  2025-03-14T05:44:01.8932336Z  2025-03-14T05:44:01.8932755Z  2025-03-14T05:44:01.8933183Z  2025-03-14T05:44:01.8933607Z  2025-03-14T05:44:01.8934022Z  2025-03-14T05:44:01.8934637Z [10,676 / 15,235] 48 actions, 47 running 2025-03-14T05:44:01.8935599Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T05:44:01.8936564Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T05:44:01.8937358Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T05:44:01.8938322Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 11s local 2025-03-14T05:44:01.8939412Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T05:44:01.8940435Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T05:44:01.8941617Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2025-03-14T05:44:01.8942559Z @com_google_protobuf//:protobuf; 4s local ... 2025-03-14T05:44:02.1083126Z 2025-03-14T05:44:02.1083989Z  2025-03-14T05:44:02.1084478Z  2025-03-14T05:44:02.1085036Z  2025-03-14T05:44:02.1085414Z  2025-03-14T05:44:02.1085797Z  2025-03-14T05:44:02.1086197Z  2025-03-14T05:44:02.1086577Z  2025-03-14T05:44:02.1086995Z  2025-03-14T05:44:02.1087585Z [10,683 / 15,235] 48 actions, 47 running 2025-03-14T05:44:02.1088486Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T05:44:02.1089424Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T05:44:02.1090118Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T05:44:02.1090932Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T05:44:02.1091915Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T05:44:02.1093348Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2025-03-14T05:44:02.1094482Z Compiling src/google/protobuf/generated_message_reflection.cc; 4s local 2025-03-14T05:44:02.1095502Z @com_github_grpc_grpc//:grpc_client_channel; 1s local ... 2025-03-14T05:44:02.3198670Z 2025-03-14T05:44:02.3199467Z  2025-03-14T05:44:02.3199978Z  2025-03-14T05:44:02.3200406Z  2025-03-14T05:44:02.3200842Z  2025-03-14T05:44:02.3201263Z  2025-03-14T05:44:02.3201667Z  2025-03-14T05:44:02.3202085Z  2025-03-14T05:44:02.3202483Z  2025-03-14T05:44:02.3203127Z [10,697 / 15,235] 48 actions, 47 running 2025-03-14T05:44:02.3204096Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T05:44:02.3205226Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T05:44:02.3206017Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T05:44:02.3206978Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T05:44:02.3208024Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T05:44:02.3209128Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2025-03-14T05:44:02.3210225Z Compiling src/google/protobuf/generated_message_reflection.cc; 4s local 2025-03-14T05:44:02.3211280Z @com_github_grpc_grpc//:grpc_client_channel; 2s local ... 2025-03-14T05:44:02.5192194Z 2025-03-14T05:44:02.5193072Z  2025-03-14T05:44:02.5193590Z  2025-03-14T05:44:02.5194007Z  2025-03-14T05:44:02.5194435Z  2025-03-14T05:44:02.5194874Z  2025-03-14T05:44:02.5195291Z  2025-03-14T05:44:02.5195690Z  2025-03-14T05:44:02.5196062Z  2025-03-14T05:44:02.5196696Z [10,720 / 15,235] 48 actions, 47 running 2025-03-14T05:44:02.5197615Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T05:44:02.5198545Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T05:44:02.5199317Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T05:44:02.5200496Z Compiling .../coordination/coordination_service.cc; 11s local 2025-03-14T05:44:02.5201536Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T05:44:02.5202643Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2025-03-14T05:44:02.5203730Z Compiling src/google/protobuf/generated_message_reflection.cc; 4s local 2025-03-14T05:44:02.5204817Z @com_github_grpc_grpc//:grpc_client_channel; 2s local ... 2025-03-14T05:44:02.7531841Z 2025-03-14T05:44:02.7533186Z  2025-03-14T05:44:02.7534025Z  2025-03-14T05:44:02.7534639Z  2025-03-14T05:44:02.7535308Z  2025-03-14T05:44:02.7538394Z  2025-03-14T05:44:02.7539155Z  2025-03-14T05:44:02.7539651Z  2025-03-14T05:44:02.7540207Z  2025-03-14T05:44:02.7541090Z [10,733 / 15,235] 48 actions running 2025-03-14T05:44:02.7542608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T05:44:02.7543670Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T05:44:02.7544415Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T05:44:02.7545483Z Compiling .../coordination/coordination_service.cc; 11s local 2025-03-14T05:44:02.7546560Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T05:44:02.7547737Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T05:44:02.7548904Z Compiling src/google/protobuf/generated_message_reflection.cc; 5s local 2025-03-14T05:44:02.7549990Z @com_github_grpc_grpc//:grpc_client_channel; 2s local ... 2025-03-14T05:44:02.9674749Z 2025-03-14T05:44:02.9675548Z  2025-03-14T05:44:02.9676059Z  2025-03-14T05:44:02.9676511Z  2025-03-14T05:44:02.9676955Z  2025-03-14T05:44:02.9677382Z  2025-03-14T05:44:02.9677819Z  2025-03-14T05:44:02.9678267Z  2025-03-14T05:44:02.9679036Z  2025-03-14T05:44:02.9679709Z [10,743 / 15,235] 48 actions, 47 running 2025-03-14T05:44:02.9680793Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T05:44:02.9681853Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T05:44:02.9682685Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T05:44:02.9683655Z Compiling .../coordination/coordination_service.cc; 11s local 2025-03-14T05:44:03.1800082Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T05:44:03.1801236Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T05:44:03.1802417Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 2s local 2025-03-14T05:44:03.1803398Z @llvm-project//llvm:llvm-tblgen; 2s local ... 2025-03-14T05:44:03.1803882Z 2025-03-14T05:44:03.1804290Z  2025-03-14T05:44:03.1804864Z  2025-03-14T05:44:03.1805306Z  2025-03-14T05:44:03.1805812Z  2025-03-14T05:44:03.1806241Z  2025-03-14T05:44:03.1806679Z  2025-03-14T05:44:03.1807100Z  2025-03-14T05:44:03.1807514Z  2025-03-14T05:44:03.1808118Z [10,759 / 15,235] 48 actions, 47 running 2025-03-14T05:44:03.1809097Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T05:44:03.1810110Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T05:44:03.1810916Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T05:44:03.1811928Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T05:44:03.1813039Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T05:44:03.1814561Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2025-03-14T05:44:03.1815606Z @llvm-project//llvm:llvm-tblgen; 2s local 2025-03-14T05:44:03.1816445Z @com_github_grpc_grpc//:grpc_transport_chttp2; 2s local ... 2025-03-14T05:44:03.3861159Z 2025-03-14T05:44:03.3862165Z  2025-03-14T05:44:03.3863082Z  2025-03-14T05:44:03.3863506Z  2025-03-14T05:44:03.3863915Z  2025-03-14T05:44:03.3864319Z  2025-03-14T05:44:03.3864753Z  2025-03-14T05:44:03.3865199Z  2025-03-14T05:44:03.3865838Z  2025-03-14T05:44:03.3866488Z [10,781 / 15,235] 48 actions, 47 running 2025-03-14T05:44:03.3867508Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T05:44:03.3868537Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T05:44:03.3869357Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T05:44:03.3870378Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T05:44:03.3871530Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T05:44:03.3872725Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2025-03-14T05:44:03.3873841Z @com_github_grpc_grpc//:grpc_transport_chttp2; 2s local 2025-03-14T05:44:03.3874786Z @xla//xla/hlo/transforms:sub_byte_normalization; 1s local ... 2025-03-14T05:44:03.6027856Z 2025-03-14T05:44:03.6028690Z  2025-03-14T05:44:03.6029214Z  2025-03-14T05:44:03.6029620Z  2025-03-14T05:44:03.6030039Z  2025-03-14T05:44:03.6030450Z  2025-03-14T05:44:03.6030866Z  2025-03-14T05:44:03.6031286Z  2025-03-14T05:44:03.6031704Z  2025-03-14T05:44:03.6032310Z [10,793 / 15,235] 48 actions, 47 running 2025-03-14T05:44:03.6033273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T05:44:03.6034246Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T05:44:03.6035035Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T05:44:03.6035995Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T05:44:03.6037130Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T05:44:03.6038747Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2025-03-14T05:44:03.6040025Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 1s local 2025-03-14T05:44:03.6041126Z Compiling src/core/lib/iomgr/ev_epollex_linux.cc; 1s local ... 2025-03-14T05:44:03.8053212Z 2025-03-14T05:44:03.8054063Z  2025-03-14T05:44:03.8054577Z  2025-03-14T05:44:03.8055009Z  2025-03-14T05:44:03.8055394Z  2025-03-14T05:44:03.8055815Z  2025-03-14T05:44:03.8056236Z  2025-03-14T05:44:03.8056642Z  2025-03-14T05:44:03.8057056Z  2025-03-14T05:44:03.8057671Z [10,800 / 15,235] 48 actions, 47 running 2025-03-14T05:44:03.8058703Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T05:44:03.8059683Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T05:44:03.8060438Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T05:44:03.8061446Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T05:44:03.8062627Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T05:44:03.8063744Z Compiling src/core/ext/filters/client_channel/client_channel.cc; 3s local 2025-03-14T05:44:03.8064936Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 1s local 2025-03-14T05:44:03.8071327Z Compiling src/google/protobuf/generated_message_bases.cc; 0s local ... 2025-03-14T05:44:04.0319044Z 2025-03-14T05:44:04.0319854Z  2025-03-14T05:44:04.0320354Z  2025-03-14T05:44:04.0320743Z  2025-03-14T05:44:04.0321155Z  2025-03-14T05:44:04.0321585Z  2025-03-14T05:44:04.0322025Z  2025-03-14T05:44:04.0322437Z  2025-03-14T05:44:04.0322867Z  2025-03-14T05:44:04.0323447Z [10,816 / 15,235] 48 actions, 47 running 2025-03-14T05:44:04.0324419Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T05:44:04.0325592Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T05:44:04.0326861Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T05:44:04.0327864Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T05:44:04.0328979Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T05:44:04.0330142Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 1s local 2025-03-14T05:44:04.0331285Z Compiling src/google/protobuf/generated_message_bases.cc; 1s local 2025-03-14T05:44:04.0332343Z Compiling src/core/lib/iomgr/tcp_custom.cc; 0s local ... 2025-03-14T05:44:04.2337033Z 2025-03-14T05:44:04.2337912Z  2025-03-14T05:44:04.2338412Z  2025-03-14T05:44:04.2338835Z  2025-03-14T05:44:04.2339246Z  2025-03-14T05:44:04.2339638Z  2025-03-14T05:44:04.2340028Z  2025-03-14T05:44:04.2340428Z  2025-03-14T05:44:04.2340839Z  2025-03-14T05:44:04.2341503Z [10,840 / 15,235] 48 actions, 47 running 2025-03-14T05:44:04.2342500Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T05:44:04.2343505Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T05:44:04.2344297Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T05:44:04.2345261Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T05:44:04.2346345Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T05:44:04.2347444Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 2s local 2025-03-14T05:44:04.2348521Z Compiling src/google/protobuf/generated_message_bases.cc; 1s local 2025-03-14T05:44:04.2349502Z Compiling src/core/lib/iomgr/tcp_posix.cc; 1s local ... 2025-03-14T05:44:04.4383611Z 2025-03-14T05:44:04.4384471Z  2025-03-14T05:44:04.4384975Z  2025-03-14T05:44:04.4385394Z  2025-03-14T05:44:04.4385814Z  2025-03-14T05:44:04.4386226Z  2025-03-14T05:44:04.4386964Z  2025-03-14T05:44:04.4387403Z  2025-03-14T05:44:04.4387834Z  2025-03-14T05:44:04.4388457Z [10,865 / 15,235] 48 actions, 47 running 2025-03-14T05:44:04.4389431Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T05:44:04.4390410Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T05:44:04.4390994Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T05:44:04.4391794Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T05:44:04.4392922Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T05:44:04.4394079Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 2s local 2025-03-14T05:44:04.4395086Z Compiling src/core/lib/iomgr/tcp_posix.cc; 1s local 2025-03-14T05:44:04.4395895Z @llvm-project//llvm:llvm-tblgen; 1s local ... 2025-03-14T05:44:04.6540864Z 2025-03-14T05:44:04.6541668Z  2025-03-14T05:44:04.6542213Z  2025-03-14T05:44:04.6542649Z  2025-03-14T05:44:04.6543091Z  2025-03-14T05:44:04.6543500Z  2025-03-14T05:44:04.6543926Z  2025-03-14T05:44:04.6544348Z  2025-03-14T05:44:04.6544779Z  2025-03-14T05:44:04.6545406Z [10,883 / 15,235] 48 actions, 47 running 2025-03-14T05:44:04.6546384Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T05:44:04.6547373Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T05:44:04.6548163Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T05:44:04.6549081Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T05:44:04.6550199Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T05:44:04.6551354Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 2s local 2025-03-14T05:44:04.6552244Z @llvm-project//llvm:llvm-tblgen; 1s local 2025-03-14T05:44:04.6553013Z Compiling src/core/lib/surface/call.cc; 1s local ... 2025-03-14T05:44:04.9549730Z 2025-03-14T05:44:04.9550578Z  2025-03-14T05:44:04.9551112Z  2025-03-14T05:44:04.9551551Z  2025-03-14T05:44:04.9551964Z  2025-03-14T05:44:04.9552390Z  2025-03-14T05:44:04.9552804Z  2025-03-14T05:44:04.9553217Z  2025-03-14T05:44:04.9553641Z  2025-03-14T05:44:04.9554236Z [10,897 / 15,235] 48 actions running 2025-03-14T05:44:04.9555210Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T05:44:04.9556184Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T05:44:04.9557126Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T05:44:04.9558106Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2025-03-14T05:44:04.9559227Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T05:44:04.9560413Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 2s local 2025-03-14T05:44:04.9561366Z @llvm-project//llvm:llvm-tblgen; 1s local 2025-03-14T05:44:04.9562114Z Compiling src/core/lib/surface/call.cc; 1s local ... 2025-03-14T05:44:05.1657422Z 2025-03-14T05:44:05.1658256Z  2025-03-14T05:44:05.1658761Z  2025-03-14T05:44:05.1659190Z  2025-03-14T05:44:05.1659597Z  2025-03-14T05:44:05.1660017Z  2025-03-14T05:44:05.1660425Z  2025-03-14T05:44:05.1660848Z  2025-03-14T05:44:05.1661266Z  2025-03-14T05:44:05.1661872Z [10,905 / 15,235] 48 actions, 47 running 2025-03-14T05:44:05.1662861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T05:44:05.1663843Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T05:44:05.1664622Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T05:44:05.1665912Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2025-03-14T05:44:05.1667360Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T05:44:05.1668478Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 3s local 2025-03-14T05:44:05.1669414Z @llvm-project//llvm:llvm-tblgen; 1s local 2025-03-14T05:44:05.1670159Z Compiling src/core/lib/surface/call.cc; 1s local ... 2025-03-14T05:44:05.3712875Z 2025-03-14T05:44:05.3713687Z  2025-03-14T05:44:05.3714205Z  2025-03-14T05:44:05.3714635Z  2025-03-14T05:44:05.3715062Z  2025-03-14T05:44:05.3715483Z  2025-03-14T05:44:05.3715906Z  2025-03-14T05:44:05.3716335Z  2025-03-14T05:44:05.3716757Z  2025-03-14T05:44:05.3717380Z [10,914 / 15,235] 47 actions, 46 running 2025-03-14T05:44:05.3718365Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T05:44:05.3719341Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T05:44:05.3720105Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T05:44:05.3721115Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2025-03-14T05:44:05.3722279Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T05:44:05.3723423Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 3s local 2025-03-14T05:44:05.3724324Z @llvm-project//llvm:llvm-tblgen; 2s local 2025-03-14T05:44:05.3725189Z Compiling src/core/lib/surface/server.cc; 1s local ... 2025-03-14T05:44:05.5765759Z 2025-03-14T05:44:05.5766648Z  2025-03-14T05:44:05.5767124Z  2025-03-14T05:44:05.5767532Z  2025-03-14T05:44:05.5767929Z  2025-03-14T05:44:05.5768332Z  2025-03-14T05:44:05.5768767Z  2025-03-14T05:44:05.5769189Z  2025-03-14T05:44:05.5769593Z  2025-03-14T05:44:05.5770176Z [10,929 / 15,235] 48 actions, 47 running 2025-03-14T05:44:05.5771042Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T05:44:05.5772004Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T05:44:05.5772759Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T05:44:05.5773858Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2025-03-14T05:44:05.5774736Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T05:44:05.5775831Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 3s local 2025-03-14T05:44:05.5776743Z @llvm-project//llvm:llvm-tblgen; 2s local 2025-03-14T05:44:05.5777608Z Compiling src/core/lib/transport/static_metadata.cc; 1s local ... 2025-03-14T05:44:05.7768811Z 2025-03-14T05:44:05.7769640Z  2025-03-14T05:44:05.7770157Z  2025-03-14T05:44:05.7770575Z  2025-03-14T05:44:05.7770976Z  2025-03-14T05:44:05.7771387Z  2025-03-14T05:44:05.7771787Z  2025-03-14T05:44:05.7772195Z  2025-03-14T05:44:05.7772614Z  2025-03-14T05:44:05.7773218Z [10,955 / 15,235] 48 actions, 47 running 2025-03-14T05:44:05.7774143Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T05:44:05.7775070Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T05:44:05.7775809Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T05:44:05.7776712Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2025-03-14T05:44:05.7777781Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T05:44:05.7778849Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 3s local 2025-03-14T05:44:05.7779791Z @llvm-project//llvm:llvm-tblgen; 2s local 2025-03-14T05:44:05.7780660Z Compiling src/core/lib/transport/static_metadata.cc; 1s local ... 2025-03-14T05:44:05.9881170Z 2025-03-14T05:44:05.9882021Z  2025-03-14T05:44:05.9882504Z  2025-03-14T05:44:05.9882855Z  2025-03-14T05:44:05.9883225Z  2025-03-14T05:44:05.9883588Z  2025-03-14T05:44:05.9883980Z  2025-03-14T05:44:05.9884366Z  2025-03-14T05:44:05.9885325Z  2025-03-14T05:44:05.9885960Z [11,002 / 15,235] 48 actions, 46 running 2025-03-14T05:44:05.9886891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T05:44:05.9887822Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T05:44:05.9888584Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T05:44:05.9889537Z Compiling .../coordination/grpc_coordination_service_impl.cc; 14s local 2025-03-14T05:44:05.9890630Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T05:44:05.9891727Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 3s local 2025-03-14T05:44:05.9892626Z @llvm-project//llvm:llvm-tblgen; 2s local 2025-03-14T05:44:05.9893472Z Compiling src/core/lib/transport/static_metadata.cc; 1s local ... 2025-03-14T05:44:06.1942849Z 2025-03-14T05:44:06.1943724Z  2025-03-14T05:44:06.1944218Z  2025-03-14T05:44:06.1944636Z  2025-03-14T05:44:06.1945081Z  2025-03-14T05:44:06.1945490Z  2025-03-14T05:44:06.1945942Z  2025-03-14T05:44:06.1946323Z  2025-03-14T05:44:06.1946741Z  2025-03-14T05:44:06.1947343Z [11,045 / 15,235] 48 actions, 47 running 2025-03-14T05:44:06.1948274Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T05:44:06.1949288Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T05:44:06.1950122Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T05:44:06.1951030Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T05:44:06.1952029Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 4s local 2025-03-14T05:44:06.1952869Z @llvm-project//llvm:llvm-tblgen; 2s local 2025-03-14T05:44:06.1953626Z Compiling src/core/lib/transport/static_metadata.cc; 2s local 2025-03-14T05:44:06.1954458Z Compiling src/ssl/extensions.cc; 1s local ... 2025-03-14T05:44:06.3984947Z 2025-03-14T05:44:06.3985831Z  2025-03-14T05:44:06.3986295Z  2025-03-14T05:44:06.3986999Z  2025-03-14T05:44:06.3987382Z  2025-03-14T05:44:06.3987764Z  2025-03-14T05:44:06.3988156Z  2025-03-14T05:44:06.3988600Z  2025-03-14T05:44:06.3988991Z  2025-03-14T05:44:06.3989586Z [11,089 / 15,235] 48 actions, 46 running 2025-03-14T05:44:06.3990536Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T05:44:06.3991474Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T05:44:06.3992155Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T05:44:06.3992978Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T05:44:06.3994081Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 4s local 2025-03-14T05:44:06.3994973Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T05:44:06.3995792Z Compiling src/core/lib/transport/static_metadata.cc; 2s local 2025-03-14T05:44:06.3996714Z Compiling src/ssl/extensions.cc; 1s local ... 2025-03-14T05:44:06.6171173Z 2025-03-14T05:44:06.6172028Z  2025-03-14T05:44:06.6172499Z  2025-03-14T05:44:06.6172908Z  2025-03-14T05:44:06.6173304Z  2025-03-14T05:44:06.6173696Z  2025-03-14T05:44:06.6174086Z  2025-03-14T05:44:06.6174462Z  2025-03-14T05:44:06.6174831Z  2025-03-14T05:44:06.6175408Z [11,135 / 15,235] 48 actions, 47 running 2025-03-14T05:44:06.6176318Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T05:44:06.6177170Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T05:44:06.6177892Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T05:44:06.6178756Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T05:44:06.6179735Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 4s local 2025-03-14T05:44:06.6180923Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T05:44:06.6181632Z Compiling src/ssl/extensions.cc; 2s local 2025-03-14T05:44:06.6182250Z Compiling src/ssl/ssl_lib.cc; 1s local ... 2025-03-14T05:44:06.8153975Z 2025-03-14T05:44:06.8155342Z  2025-03-14T05:44:06.8155846Z  2025-03-14T05:44:06.8156253Z  2025-03-14T05:44:06.8156654Z  2025-03-14T05:44:06.8157066Z  2025-03-14T05:44:06.8157468Z  2025-03-14T05:44:06.8157873Z  2025-03-14T05:44:06.8158258Z  2025-03-14T05:44:06.8158838Z [11,294 / 15,235] 45 actions, 40 running 2025-03-14T05:44:06.8159778Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T05:44:06.8160760Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T05:44:06.8161534Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T05:44:06.8162440Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T05:44:06.8163555Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 4s local 2025-03-14T05:44:06.8164474Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T05:44:06.8165276Z Compiling src/ssl/ssl_lib.cc; 2s local 2025-03-14T05:44:06.8166306Z Compiling src/crypto/curve25519/curve25519.c; 0s local ... 2025-03-14T05:44:07.0580504Z 2025-03-14T05:44:07.0581131Z  2025-03-14T05:44:07.0581769Z  2025-03-14T05:44:07.0582306Z  2025-03-14T05:44:07.0582850Z  2025-03-14T05:44:07.0583357Z  2025-03-14T05:44:07.0583867Z  2025-03-14T05:44:07.0584376Z  2025-03-14T05:44:07.0584910Z  2025-03-14T05:44:07.0585623Z [11,305 / 15,235] 48 actions, 47 running 2025-03-14T05:44:07.0586638Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T05:44:07.0587751Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T05:44:07.0588661Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T05:44:07.0589756Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T05:44:07.0591041Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 5s local 2025-03-14T05:44:07.0592471Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T05:44:07.0593352Z Compiling src/crypto/curve25519/curve25519.c; 1s local 2025-03-14T05:44:07.0594468Z Compiling src/google/protobuf/extension_set_heavy.cc; 1s local ... 2025-03-14T05:44:07.3562001Z 2025-03-14T05:44:07.3562861Z  2025-03-14T05:44:07.3563323Z  2025-03-14T05:44:07.3563702Z  2025-03-14T05:44:07.3564127Z  2025-03-14T05:44:07.3564537Z  2025-03-14T05:44:07.3565064Z  2025-03-14T05:44:07.3569202Z  2025-03-14T05:44:07.3569633Z  2025-03-14T05:44:07.3570182Z [11,308 / 15,235] 48 actions running 2025-03-14T05:44:07.3571071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T05:44:07.3571946Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T05:44:07.3572697Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T05:44:07.3573561Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T05:44:07.3574531Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 5s local 2025-03-14T05:44:07.3575337Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T05:44:07.3575982Z Compiling src/crypto/curve25519/curve25519.c; 1s local 2025-03-14T05:44:07.3576815Z Compiling src/google/protobuf/extension_set_heavy.cc; 1s local ... 2025-03-14T05:44:07.6507924Z 2025-03-14T05:44:07.6508753Z  2025-03-14T05:44:07.6509271Z  2025-03-14T05:44:07.6509714Z  2025-03-14T05:44:07.6510184Z  2025-03-14T05:44:07.6510619Z  2025-03-14T05:44:07.6510986Z  2025-03-14T05:44:07.6511385Z  2025-03-14T05:44:07.6511817Z  2025-03-14T05:44:07.6512472Z [11,310 / 15,235] 48 actions, 47 running 2025-03-14T05:44:07.6513861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T05:44:07.6514893Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T05:44:07.6515725Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T05:44:07.6516749Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T05:44:07.6518017Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 5s local 2025-03-14T05:44:07.6519047Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T05:44:07.6519963Z Compiling src/google/protobuf/extension_set_heavy.cc; 1s local 2025-03-14T05:44:07.6520947Z Compiling src/crypto/fipsmodule/bcm.c; 1s local ... 2025-03-14T05:44:07.8571321Z 2025-03-14T05:44:07.8572201Z  2025-03-14T05:44:07.8572685Z  2025-03-14T05:44:07.8573100Z  2025-03-14T05:44:07.8573471Z  2025-03-14T05:44:07.8573866Z  2025-03-14T05:44:07.8574250Z  2025-03-14T05:44:07.8574746Z  2025-03-14T05:44:07.8575131Z  2025-03-14T05:44:07.8575750Z [11,313 / 15,235] 48 actions, 47 running 2025-03-14T05:44:07.8576730Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T05:44:07.8577677Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T05:44:07.8578384Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T05:44:07.8579295Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T05:44:07.8580369Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 5s local 2025-03-14T05:44:07.8581282Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T05:44:07.8582137Z Compiling src/google/protobuf/extension_set_heavy.cc; 1s local 2025-03-14T05:44:07.8583083Z Compiling src/crypto/fipsmodule/bcm.c; 1s local ... 2025-03-14T05:44:08.1050156Z 2025-03-14T05:44:08.1051114Z  2025-03-14T05:44:08.1051611Z  2025-03-14T05:44:08.1052007Z  2025-03-14T05:44:08.1052412Z  2025-03-14T05:44:08.1052805Z  2025-03-14T05:44:08.1053178Z  2025-03-14T05:44:08.1053597Z  2025-03-14T05:44:08.1054012Z  2025-03-14T05:44:08.1054931Z [11,315 / 15,235] 48 actions, 47 running 2025-03-14T05:44:08.1055730Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T05:44:08.1056579Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T05:44:08.1057252Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T05:44:08.1058117Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T05:44:08.1059158Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 6s local 2025-03-14T05:44:08.1060029Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T05:44:08.1060808Z Compiling src/google/protobuf/extension_set_heavy.cc; 2s local 2025-03-14T05:44:08.1061647Z Compiling src/crypto/fipsmodule/bcm.c; 2s local ... 2025-03-14T05:44:08.3219934Z 2025-03-14T05:44:08.3220814Z  2025-03-14T05:44:08.3221409Z  2025-03-14T05:44:08.3221861Z  2025-03-14T05:44:08.3222272Z  2025-03-14T05:44:08.3222712Z  2025-03-14T05:44:08.3223132Z  2025-03-14T05:44:08.3223558Z  2025-03-14T05:44:08.3223963Z  2025-03-14T05:44:08.3224571Z [11,317 / 15,235] 48 actions, 47 running 2025-03-14T05:44:08.3225529Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T05:44:08.3226515Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T05:44:08.3227282Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T05:44:08.3228251Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T05:44:08.3229341Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 6s local 2025-03-14T05:44:08.3230210Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T05:44:08.3230982Z Compiling src/google/protobuf/extension_set_heavy.cc; 2s local 2025-03-14T05:44:08.3231843Z Compiling src/crypto/fipsmodule/bcm.c; 2s local ... 2025-03-14T05:44:08.5572855Z 2025-03-14T05:44:08.5573725Z  2025-03-14T05:44:08.5574240Z  2025-03-14T05:44:08.5574638Z  2025-03-14T05:44:08.5575042Z  2025-03-14T05:44:08.5575443Z  2025-03-14T05:44:08.5575840Z  2025-03-14T05:44:08.5576230Z  2025-03-14T05:44:08.5576733Z  2025-03-14T05:44:08.5577309Z [11,323 / 15,235] 48 actions running 2025-03-14T05:44:08.5578233Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T05:44:08.5579123Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T05:44:08.5579833Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T05:44:08.5580711Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T05:44:08.5581759Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 6s local 2025-03-14T05:44:08.5582637Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T05:44:08.5583325Z Compiling src/crypto/fipsmodule/bcm.c; 2s local 2025-03-14T05:44:08.5584074Z Compiling torch_xla/csrc/runtime/sys_util.cc; 1s local ... 2025-03-14T05:44:08.8917334Z 2025-03-14T05:44:08.8918111Z  2025-03-14T05:44:08.8918616Z  2025-03-14T05:44:08.8919063Z  2025-03-14T05:44:08.8919497Z  2025-03-14T05:44:08.8919935Z  2025-03-14T05:44:08.8920369Z  2025-03-14T05:44:08.8920807Z  2025-03-14T05:44:08.8921247Z  2025-03-14T05:44:08.8921870Z [11,325 / 15,235] 48 actions, 47 running 2025-03-14T05:44:08.8922900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T05:44:08.8923850Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T05:44:08.8924750Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T05:44:08.8925713Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T05:44:08.8926893Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 6s local 2025-03-14T05:44:08.8927850Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T05:44:08.8928815Z Compiling src/crypto/fipsmodule/bcm.c; 2s local 2025-03-14T05:44:08.8929575Z Compiling xla/service/hlo_execution_profile.cc; 2s local ... 2025-03-14T05:44:09.1581114Z 2025-03-14T05:44:09.1581913Z  2025-03-14T05:44:09.1582396Z  2025-03-14T05:44:09.1582776Z  2025-03-14T05:44:09.1583186Z  2025-03-14T05:44:09.1583581Z  2025-03-14T05:44:09.1583998Z  2025-03-14T05:44:09.1584389Z  2025-03-14T05:44:09.1584755Z  2025-03-14T05:44:09.1585340Z [11,329 / 15,235] 48 actions running 2025-03-14T05:44:09.1586297Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T05:44:09.1587364Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T05:44:09.1588208Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T05:44:09.1589239Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T05:44:09.1590510Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 7s local 2025-03-14T05:44:09.1591422Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T05:44:09.1592159Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2025-03-14T05:44:09.1593055Z Compiling xla/service/hlo_execution_profile.cc; 2s local ... 2025-03-14T05:44:09.3585428Z 2025-03-14T05:44:09.3586265Z  2025-03-14T05:44:09.3586766Z  2025-03-14T05:44:09.3587200Z  2025-03-14T05:44:09.3587635Z  2025-03-14T05:44:09.3588069Z  2025-03-14T05:44:09.3588506Z  2025-03-14T05:44:09.3588915Z  2025-03-14T05:44:09.3589315Z  2025-03-14T05:44:09.3589905Z [11,330 / 15,235] 48 actions running 2025-03-14T05:44:09.3590840Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T05:44:09.3591800Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T05:44:09.3592581Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T05:44:09.3593911Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T05:44:09.3595110Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 7s local 2025-03-14T05:44:09.3596027Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T05:44:09.3596783Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2025-03-14T05:44:09.3597673Z Compiling xla/service/hlo_execution_profile.cc; 2s local ... 2025-03-14T05:44:09.5881216Z 2025-03-14T05:44:09.5882054Z  2025-03-14T05:44:09.5882572Z  2025-03-14T05:44:09.5882999Z  2025-03-14T05:44:09.5883409Z  2025-03-14T05:44:09.5883831Z  2025-03-14T05:44:09.5884242Z  2025-03-14T05:44:09.5884788Z  2025-03-14T05:44:09.5885217Z  2025-03-14T05:44:09.5885827Z [11,331 / 15,235] 48 actions, 47 running 2025-03-14T05:44:09.5886809Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T05:44:09.5887822Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T05:44:09.5888613Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T05:44:09.5889568Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T05:44:09.5890684Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 7s local 2025-03-14T05:44:09.5891604Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T05:44:09.5892320Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2025-03-14T05:44:09.5893180Z Compiling xla/service/hlo_execution_profile.cc; 2s local ... 2025-03-14T05:44:09.8369073Z 2025-03-14T05:44:09.8369925Z  2025-03-14T05:44:09.8370419Z  2025-03-14T05:44:09.8370830Z  2025-03-14T05:44:09.8371249Z  2025-03-14T05:44:09.8371658Z  2025-03-14T05:44:09.8372067Z  2025-03-14T05:44:09.8372478Z  2025-03-14T05:44:09.8372930Z  2025-03-14T05:44:09.8373554Z [11,337 / 15,235] 48 actions, 47 running 2025-03-14T05:44:09.8374549Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T05:44:09.8375919Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T05:44:09.8376671Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T05:44:09.8377603Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T05:44:09.8378737Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 7s local 2025-03-14T05:44:09.8379781Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T05:44:09.8380464Z Compiling src/crypto/fipsmodule/bcm.c; 3s local 2025-03-14T05:44:09.8381294Z Compiling xla/service/hlo_execution_profile.cc; 3s local ... 2025-03-14T05:44:10.1590982Z 2025-03-14T05:44:10.1591781Z  2025-03-14T05:44:10.1592307Z  2025-03-14T05:44:10.1592725Z  2025-03-14T05:44:10.1593135Z  2025-03-14T05:44:10.1593520Z  2025-03-14T05:44:10.1593919Z  2025-03-14T05:44:10.1594326Z  2025-03-14T05:44:10.1594735Z  2025-03-14T05:44:10.1595378Z [11,340 / 15,235] 48 actions running 2025-03-14T05:44:10.1596328Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T05:44:10.1597286Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T05:44:10.1598019Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T05:44:10.1598911Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T05:44:10.1599991Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 8s local 2025-03-14T05:44:10.1600902Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T05:44:10.1601588Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2025-03-14T05:44:10.1602412Z Compiling xla/service/hlo_execution_profile.cc; 3s local ... 2025-03-14T05:44:10.3599980Z 2025-03-14T05:44:10.3600834Z  2025-03-14T05:44:10.3601336Z  2025-03-14T05:44:10.3601751Z  2025-03-14T05:44:10.3602147Z  2025-03-14T05:44:10.3602569Z  2025-03-14T05:44:10.3603344Z  2025-03-14T05:44:10.3603770Z  2025-03-14T05:44:10.3604206Z  2025-03-14T05:44:10.3604939Z [11,342 / 15,235] 48 actions running 2025-03-14T05:44:10.3605942Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T05:44:10.3606934Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T05:44:10.3607710Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T05:44:10.3608811Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T05:44:10.3609922Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 8s local 2025-03-14T05:44:10.3611110Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T05:44:10.3611880Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2025-03-14T05:44:10.3612791Z Compiling xla/service/hlo_execution_profile.cc; 3s local ... 2025-03-14T05:44:10.5742558Z 2025-03-14T05:44:10.5743447Z  2025-03-14T05:44:10.5743917Z  2025-03-14T05:44:10.5744348Z  2025-03-14T05:44:10.5744756Z  2025-03-14T05:44:10.5745188Z  2025-03-14T05:44:10.5745614Z  2025-03-14T05:44:10.5746052Z  2025-03-14T05:44:10.5746468Z  2025-03-14T05:44:10.5747104Z [11,349 / 15,235] 48 actions, 47 running 2025-03-14T05:44:10.5748050Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T05:44:10.5748956Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T05:44:10.5749757Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T05:44:10.5750597Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T05:44:10.5751610Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 8s local 2025-03-14T05:44:10.5752514Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T05:44:10.5753232Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2025-03-14T05:44:10.5754000Z Compiling xla/service/hlo_execution_profile.cc; 3s local ... 2025-03-14T05:44:10.8253422Z 2025-03-14T05:44:10.8254241Z  2025-03-14T05:44:10.8255150Z  2025-03-14T05:44:10.8255581Z  2025-03-14T05:44:10.8255987Z  2025-03-14T05:44:10.8256402Z  2025-03-14T05:44:10.8256819Z  2025-03-14T05:44:10.8257249Z  2025-03-14T05:44:10.8257682Z  2025-03-14T05:44:10.8258326Z [11,351 / 15,235] 48 actions, 47 running 2025-03-14T05:44:10.8259314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T05:44:10.8260356Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T05:44:10.8261096Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T05:44:10.8261955Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T05:44:10.8263084Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 8s local 2025-03-14T05:44:10.8264016Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T05:44:10.8264757Z Compiling src/crypto/fipsmodule/bcm.c; 4s local 2025-03-14T05:44:10.8265831Z Compiling xla/service/hlo_execution_profile.cc; 4s local ... 2025-03-14T05:44:11.0475322Z 2025-03-14T05:44:11.0476183Z  2025-03-14T05:44:11.0476680Z  2025-03-14T05:44:11.0477100Z  2025-03-14T05:44:11.0477522Z  2025-03-14T05:44:11.0477923Z  2025-03-14T05:44:11.0478347Z  2025-03-14T05:44:11.0478728Z  2025-03-14T05:44:11.0479138Z  2025-03-14T05:44:11.0479761Z [11,354 / 15,235] 48 actions, 47 running 2025-03-14T05:44:11.0480706Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T05:44:11.0481683Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T05:44:11.0482437Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T05:44:11.0483319Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T05:44:11.0484406Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 8s local 2025-03-14T05:44:11.0485870Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T05:44:11.0486620Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2025-03-14T05:44:11.0487429Z Compiling xla/service/hlo_execution_profile.cc; 4s local ... 2025-03-14T05:44:11.2896333Z 2025-03-14T05:44:11.2897204Z  2025-03-14T05:44:11.2897704Z  2025-03-14T05:44:11.2906986Z  2025-03-14T05:44:11.2907456Z  2025-03-14T05:44:11.2907897Z  2025-03-14T05:44:11.2908335Z  2025-03-14T05:44:11.2908766Z  2025-03-14T05:44:11.2909183Z  2025-03-14T05:44:11.2909819Z [11,358 / 15,235] 48 actions, 47 running 2025-03-14T05:44:11.2910815Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T05:44:11.2911833Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T05:44:11.2912644Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T05:44:11.2913642Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T05:44:11.2914727Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 9s local 2025-03-14T05:44:11.2915704Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T05:44:11.2916461Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2025-03-14T05:44:11.2917334Z Compiling xla/service/hlo_execution_profile.cc; 4s local ... 2025-03-14T05:44:11.5350310Z 2025-03-14T05:44:11.5351158Z  2025-03-14T05:44:11.5351648Z  2025-03-14T05:44:11.5352050Z  2025-03-14T05:44:11.5352444Z  2025-03-14T05:44:11.5352861Z  2025-03-14T05:44:11.5353255Z  2025-03-14T05:44:11.5353640Z  2025-03-14T05:44:11.5354043Z  2025-03-14T05:44:11.5354651Z [11,364 / 15,235] 48 actions, 47 running 2025-03-14T05:44:11.5355618Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T05:44:11.5356602Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T05:44:11.5357359Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T05:44:11.5358309Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T05:44:11.5359912Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 9s local 2025-03-14T05:44:11.5360853Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:44:11.5361547Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2025-03-14T05:44:11.5362411Z Compiling xla/service/hlo_execution_profile.cc; 4s local ... 2025-03-14T05:44:11.7610414Z 2025-03-14T05:44:11.7611315Z  2025-03-14T05:44:11.7611824Z  2025-03-14T05:44:11.7612238Z  2025-03-14T05:44:11.7612619Z  2025-03-14T05:44:11.7613014Z  2025-03-14T05:44:11.7613423Z  2025-03-14T05:44:11.7613839Z  2025-03-14T05:44:11.7614250Z  2025-03-14T05:44:11.7614843Z [11,367 / 15,235] 48 actions running 2025-03-14T05:44:11.7615783Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T05:44:11.7616802Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T05:44:11.7617524Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T05:44:11.7618460Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2025-03-14T05:44:11.7619572Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 9s local 2025-03-14T05:44:11.7620537Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:44:11.7621275Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2025-03-14T05:44:11.7622152Z Compiling xla/service/hlo_execution_profile.cc; 4s local ... 2025-03-14T05:44:11.9615756Z 2025-03-14T05:44:11.9616609Z  2025-03-14T05:44:11.9617122Z  2025-03-14T05:44:11.9617547Z  2025-03-14T05:44:11.9617951Z  2025-03-14T05:44:11.9618355Z  2025-03-14T05:44:11.9618741Z  2025-03-14T05:44:11.9619155Z  2025-03-14T05:44:11.9619543Z  2025-03-14T05:44:11.9620101Z [11,368 / 15,235] 48 actions running 2025-03-14T05:44:11.9621438Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2025-03-14T05:44:11.9622455Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T05:44:11.9623214Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T05:44:11.9624149Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2025-03-14T05:44:11.9625250Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 9s local 2025-03-14T05:44:11.9626173Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:44:11.9626901Z Compiling src/crypto/fipsmodule/bcm.c; 5s local 2025-03-14T05:44:11.9627732Z Compiling xla/service/hlo_execution_profile.cc; 5s local ... 2025-03-14T05:44:12.1822040Z 2025-03-14T05:44:12.1822947Z  2025-03-14T05:44:12.1823499Z  2025-03-14T05:44:12.1823955Z  2025-03-14T05:44:12.1824402Z  2025-03-14T05:44:12.1824893Z  2025-03-14T05:44:12.1825363Z  2025-03-14T05:44:12.1825814Z  2025-03-14T05:44:12.1826229Z  2025-03-14T05:44:12.1826841Z [11,375 / 15,235] 48 actions, 47 running 2025-03-14T05:44:12.1827538Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T05:44:12.1828303Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T05:44:12.1829320Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 10s local 2025-03-14T05:44:12.1830210Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T05:44:12.1830920Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2025-03-14T05:44:12.1831723Z Compiling xla/service/hlo_execution_profile.cc; 5s local 2025-03-14T05:44:12.1832553Z Compiling xla/service/compilation_stats.cc; 5s local 2025-03-14T05:44:12.1833482Z Compiling .../memory_space_assignment/tuning_utils.cc; 5s local ... 2025-03-14T05:44:12.3944106Z 2025-03-14T05:44:12.3945090Z  2025-03-14T05:44:12.3945639Z  2025-03-14T05:44:12.3946089Z  2025-03-14T05:44:12.3946534Z  2025-03-14T05:44:12.3946946Z  2025-03-14T05:44:12.3947410Z  2025-03-14T05:44:12.3947862Z  2025-03-14T05:44:12.3948240Z  2025-03-14T05:44:12.3949201Z [11,381 / 15,235] 48 actions, 47 running 2025-03-14T05:44:12.3949942Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T05:44:12.3950715Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T05:44:12.3951673Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 10s local 2025-03-14T05:44:12.3952596Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:44:12.3953255Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2025-03-14T05:44:12.3953979Z Compiling xla/service/hlo_execution_profile.cc; 5s local 2025-03-14T05:44:12.3954827Z Compiling xla/service/compilation_stats.cc; 5s local 2025-03-14T05:44:12.3955743Z Compiling .../memory_space_assignment/tuning_utils.cc; 5s local ... 2025-03-14T05:44:12.6442881Z 2025-03-14T05:44:12.6443819Z  2025-03-14T05:44:12.6444362Z  2025-03-14T05:44:12.6444895Z  2025-03-14T05:44:12.6445378Z  2025-03-14T05:44:12.6445799Z  2025-03-14T05:44:12.6446174Z  2025-03-14T05:44:12.6446528Z  2025-03-14T05:44:12.6446873Z  2025-03-14T05:44:12.6447438Z [11,385 / 15,235] 48 actions, 47 running 2025-03-14T05:44:12.6448043Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T05:44:12.6448744Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T05:44:12.6449587Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 10s local 2025-03-14T05:44:12.6450388Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:44:12.6451027Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2025-03-14T05:44:12.6451731Z Compiling xla/service/hlo_execution_profile.cc; 5s local 2025-03-14T05:44:12.6452625Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 5s local 2025-03-14T05:44:12.6453619Z Compiling xla/service/memory_space_assignment/utils.cc; 5s local ... 2025-03-14T05:44:12.8524103Z 2025-03-14T05:44:12.8525474Z  2025-03-14T05:44:12.8526052Z  2025-03-14T05:44:12.8526530Z  2025-03-14T05:44:12.8526969Z  2025-03-14T05:44:12.8527342Z  2025-03-14T05:44:12.8527699Z  2025-03-14T05:44:12.8528059Z  2025-03-14T05:44:12.8528414Z  2025-03-14T05:44:12.8528940Z [11,386 / 15,235] 48 actions, 47 running 2025-03-14T05:44:12.8529639Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T05:44:12.8530290Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T05:44:12.8531166Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 10s local 2025-03-14T05:44:12.8532021Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:44:12.8532675Z Compiling src/crypto/fipsmodule/bcm.c; 6s local 2025-03-14T05:44:12.8533412Z Compiling xla/service/hlo_execution_profile.cc; 6s local 2025-03-14T05:44:12.8534325Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 6s local 2025-03-14T05:44:12.8535347Z Compiling xla/service/memory_space_assignment/utils.cc; 6s local ... 2025-03-14T05:44:13.0771751Z 2025-03-14T05:44:13.0772756Z  2025-03-14T05:44:13.0773298Z  2025-03-14T05:44:13.0773752Z  2025-03-14T05:44:13.0774188Z  2025-03-14T05:44:13.0774593Z  2025-03-14T05:44:13.0775051Z  2025-03-14T05:44:13.0775476Z  2025-03-14T05:44:13.0775790Z  2025-03-14T05:44:13.0776261Z [11,392 / 15,235] 48 actions, 47 running 2025-03-14T05:44:13.0776945Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T05:44:13.0777514Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T05:44:13.0778232Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 11s local 2025-03-14T05:44:13.0778924Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:44:13.0779458Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T05:44:13.0780060Z Compiling xla/service/hlo_execution_profile.cc; 6s local 2025-03-14T05:44:13.0780820Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 6s local 2025-03-14T05:44:13.0782007Z Compiling xla/service/memory_space_assignment/utils.cc; 6s local ... 2025-03-14T05:44:13.2760809Z 2025-03-14T05:44:13.2761763Z  2025-03-14T05:44:13.2762300Z  2025-03-14T05:44:13.2762740Z  2025-03-14T05:44:13.2763175Z  2025-03-14T05:44:13.2763595Z  2025-03-14T05:44:13.2763949Z  2025-03-14T05:44:13.2764318Z  2025-03-14T05:44:13.2764813Z  2025-03-14T05:44:13.2765514Z [11,398 / 15,235] 48 actions running 2025-03-14T05:44:13.2766334Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T05:44:13.2767110Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T05:44:13.2768072Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 11s local 2025-03-14T05:44:13.2769034Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T05:44:13.2769757Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T05:44:13.2770570Z Compiling xla/service/hlo_execution_profile.cc; 6s local 2025-03-14T05:44:13.2771597Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 6s local 2025-03-14T05:44:13.2772696Z Compiling xla/service/memory_space_assignment/utils.cc; 6s local ... 2025-03-14T05:44:13.4999797Z 2025-03-14T05:44:13.5000765Z  2025-03-14T05:44:13.5001320Z  2025-03-14T05:44:13.5001773Z  2025-03-14T05:44:13.5002227Z  2025-03-14T05:44:13.5002660Z  2025-03-14T05:44:13.5003118Z  2025-03-14T05:44:13.5003543Z  2025-03-14T05:44:13.5003933Z  2025-03-14T05:44:13.5004491Z [11,406 / 15,235] 48 actions, 47 running 2025-03-14T05:44:13.5005360Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T05:44:13.5006093Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 89s local 2025-03-14T05:44:13.5007044Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 11s local 2025-03-14T05:44:13.5008303Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T05:44:13.5008995Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T05:44:13.5009740Z Compiling xla/service/hlo_execution_profile.cc; 6s local 2025-03-14T05:44:13.5010658Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 6s local 2025-03-14T05:44:13.5011739Z Compiling xla/service/memory_space_assignment/utils.cc; 6s local ... 2025-03-14T05:44:13.7623010Z 2025-03-14T05:44:13.7623884Z  2025-03-14T05:44:13.7624371Z  2025-03-14T05:44:13.7624776Z  2025-03-14T05:44:13.7625189Z  2025-03-14T05:44:13.7625586Z  2025-03-14T05:44:13.7625990Z  2025-03-14T05:44:13.7626355Z  2025-03-14T05:44:13.7626744Z  2025-03-14T05:44:13.7627322Z [11,410 / 15,235] 48 actions running 2025-03-14T05:44:13.7628035Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T05:44:13.7628754Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 89s local 2025-03-14T05:44:13.7629683Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 11s local 2025-03-14T05:44:13.7630595Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T05:44:13.7631865Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T05:44:13.7632814Z Compiling xla/service/hlo_execution_profile.cc; 6s local 2025-03-14T05:44:13.7633886Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 6s local 2025-03-14T05:44:13.7635083Z Compiling xla/service/memory_space_assignment/utils.cc; 6s local ... 2025-03-14T05:44:14.0151676Z 2025-03-14T05:44:14.0152578Z  2025-03-14T05:44:14.0153065Z  2025-03-14T05:44:14.0153454Z  2025-03-14T05:44:14.0153836Z  2025-03-14T05:44:14.0154239Z  2025-03-14T05:44:14.0154606Z  2025-03-14T05:44:14.0154949Z  2025-03-14T05:44:14.0155315Z  2025-03-14T05:44:14.0155882Z [11,415 / 15,235] 48 actions, 47 running 2025-03-14T05:44:14.0156671Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T05:44:14.0157457Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 89s local 2025-03-14T05:44:14.0158785Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 11s local 2025-03-14T05:44:14.0159683Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T05:44:14.0160346Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T05:44:14.0161098Z Compiling xla/service/hlo_execution_profile.cc; 7s local 2025-03-14T05:44:14.0162088Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 7s local 2025-03-14T05:44:14.0163249Z Compiling xla/service/memory_space_assignment/utils.cc; 7s local ... 2025-03-14T05:44:14.2272977Z 2025-03-14T05:44:14.2273925Z  2025-03-14T05:44:14.2274384Z  2025-03-14T05:44:14.2274769Z  2025-03-14T05:44:14.2275103Z  2025-03-14T05:44:14.2275476Z  2025-03-14T05:44:14.2275820Z  2025-03-14T05:44:14.2276148Z  2025-03-14T05:44:14.2276515Z  2025-03-14T05:44:14.2277251Z [11,421 / 15,235] 48 actions, 47 running 2025-03-14T05:44:14.2277983Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T05:44:14.2278997Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 12s local 2025-03-14T05:44:14.2279963Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T05:44:14.2280708Z Compiling src/crypto/fipsmodule/bcm.c; 8s local 2025-03-14T05:44:14.2281570Z Compiling xla/service/hlo_execution_profile.cc; 7s local 2025-03-14T05:44:14.2282628Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 7s local 2025-03-14T05:44:14.2283932Z Compiling xla/service/memory_space_assignment/utils.cc; 7s local 2025-03-14T05:44:14.2285106Z Compiling xla/service/memory_space_assignment/allocation.cc; 7s local ... 2025-03-14T05:44:14.4214052Z 2025-03-14T05:44:14.4214998Z  2025-03-14T05:44:14.4215549Z  2025-03-14T05:44:14.4215995Z  2025-03-14T05:44:14.4216438Z  2025-03-14T05:44:14.4216878Z  2025-03-14T05:44:14.4217309Z  2025-03-14T05:44:14.4218147Z  2025-03-14T05:44:14.4218648Z  2025-03-14T05:44:14.4219247Z [11,425 / 15,235] 48 actions, 47 running 2025-03-14T05:44:14.4219912Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T05:44:14.4220841Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 12s local 2025-03-14T05:44:14.4221809Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:44:14.4222617Z Compiling xla/service/hlo_execution_profile.cc; 7s local 2025-03-14T05:44:14.4223652Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 7s local 2025-03-14T05:44:14.4224736Z Compiling xla/service/memory_space_assignment/utils.cc; 7s local 2025-03-14T05:44:14.4225818Z Compiling xla/service/memory_space_assignment/allocation.cc; 7s local 2025-03-14T05:44:14.4226889Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 7s local ... 2025-03-14T05:44:14.6435644Z 2025-03-14T05:44:14.6436648Z  2025-03-14T05:44:14.6437194Z  2025-03-14T05:44:14.6438728Z  2025-03-14T05:44:14.6441819Z  2025-03-14T05:44:14.6445135Z  2025-03-14T05:44:14.6448191Z  2025-03-14T05:44:14.6449253Z  2025-03-14T05:44:14.6449835Z  2025-03-14T05:44:14.6450605Z [11,430 / 15,235] 48 actions, 47 running 2025-03-14T05:44:14.6451496Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T05:44:14.6452587Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 12s local 2025-03-14T05:44:14.6453816Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:44:14.6454808Z Compiling xla/service/hlo_execution_profile.cc; 7s local 2025-03-14T05:44:14.6456007Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 7s local 2025-03-14T05:44:14.6457141Z Compiling xla/service/memory_space_assignment/utils.cc; 7s local 2025-03-14T05:44:14.6458236Z Compiling xla/service/memory_space_assignment/allocation.cc; 7s local 2025-03-14T05:44:14.6459179Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 7s local ... 2025-03-14T05:44:14.9245685Z 2025-03-14T05:44:14.9247033Z  2025-03-14T05:44:14.9247574Z  2025-03-14T05:44:14.9248020Z  2025-03-14T05:44:14.9248534Z  2025-03-14T05:44:14.9248975Z  2025-03-14T05:44:14.9249397Z  2025-03-14T05:44:14.9249773Z  2025-03-14T05:44:14.9250131Z  2025-03-14T05:44:14.9250725Z [11,434 / 15,235] 48 actions, 47 running 2025-03-14T05:44:14.9251406Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T05:44:14.9252090Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:44:14.9252829Z Compiling xla/service/hlo_execution_profile.cc; 8s local 2025-03-14T05:44:14.9253776Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 8s local 2025-03-14T05:44:14.9254818Z Compiling xla/service/memory_space_assignment/utils.cc; 8s local 2025-03-14T05:44:14.9255821Z Compiling xla/service/memory_space_assignment/allocation.cc; 8s local 2025-03-14T05:44:14.9257035Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2025-03-14T05:44:14.9258107Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 8s local ... 2025-03-14T05:44:15.1549710Z 2025-03-14T05:44:15.1550641Z  2025-03-14T05:44:15.1551197Z  2025-03-14T05:44:15.1551650Z  2025-03-14T05:44:15.1552078Z  2025-03-14T05:44:15.1552496Z  2025-03-14T05:44:15.1552945Z  2025-03-14T05:44:15.1553385Z  2025-03-14T05:44:15.1553771Z  2025-03-14T05:44:15.1554359Z [11,445 / 15,235] 48 actions, 47 running 2025-03-14T05:44:15.1555140Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T05:44:15.1555845Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:44:15.1556540Z Compiling xla/service/hlo_execution_profile.cc; 8s local 2025-03-14T05:44:15.1557560Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 8s local 2025-03-14T05:44:15.1559016Z Compiling xla/service/memory_space_assignment/utils.cc; 8s local 2025-03-14T05:44:15.1560016Z Compiling xla/service/memory_space_assignment/allocation.cc; 8s local 2025-03-14T05:44:15.1561101Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2025-03-14T05:44:15.1562172Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 8s local ... 2025-03-14T05:44:15.3636431Z 2025-03-14T05:44:15.3637439Z  2025-03-14T05:44:15.3637975Z  2025-03-14T05:44:15.3638428Z  2025-03-14T05:44:15.3638871Z  2025-03-14T05:44:15.3639301Z  2025-03-14T05:44:15.3639753Z  2025-03-14T05:44:15.3640178Z  2025-03-14T05:44:15.3640638Z  2025-03-14T05:44:15.3641150Z [11,448 / 15,235] 48 actions running 2025-03-14T05:44:15.3641890Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T05:44:15.3642582Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:15.3643295Z Compiling xla/service/hlo_execution_profile.cc; 8s local 2025-03-14T05:44:15.3644379Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 8s local 2025-03-14T05:44:15.3645589Z Compiling xla/service/memory_space_assignment/utils.cc; 8s local 2025-03-14T05:44:15.3646607Z Compiling xla/service/memory_space_assignment/allocation.cc; 8s local 2025-03-14T05:44:15.3647676Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2025-03-14T05:44:15.3648811Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 8s local ... 2025-03-14T05:44:15.6369943Z 2025-03-14T05:44:15.6370791Z  2025-03-14T05:44:15.6371343Z  2025-03-14T05:44:15.6371789Z  2025-03-14T05:44:15.6372238Z  2025-03-14T05:44:15.6372679Z  2025-03-14T05:44:15.6373121Z  2025-03-14T05:44:15.6373552Z  2025-03-14T05:44:15.6374019Z  2025-03-14T05:44:15.6374644Z [11,454 / 15,235] 48 actions, 47 running 2025-03-14T05:44:15.6375364Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T05:44:15.6376165Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:15.6376996Z Compiling xla/service/hlo_execution_profile.cc; 8s local 2025-03-14T05:44:15.6378348Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 8s local 2025-03-14T05:44:15.6379434Z Compiling xla/service/memory_space_assignment/utils.cc; 8s local 2025-03-14T05:44:15.6380516Z Compiling xla/service/memory_space_assignment/allocation.cc; 8s local 2025-03-14T05:44:15.6381664Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2025-03-14T05:44:15.6382807Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 8s local ... 2025-03-14T05:44:15.8435475Z 2025-03-14T05:44:15.8436387Z  2025-03-14T05:44:15.8436898Z  2025-03-14T05:44:15.8437372Z  2025-03-14T05:44:15.8437825Z  2025-03-14T05:44:15.8438273Z  2025-03-14T05:44:15.8438720Z  2025-03-14T05:44:15.8439149Z  2025-03-14T05:44:15.8439609Z  2025-03-14T05:44:15.8440275Z [11,463 / 15,235] 48 actions, 47 running 2025-03-14T05:44:15.8441018Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T05:44:15.8441727Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:15.8442540Z Compiling xla/service/hlo_execution_profile.cc; 9s local 2025-03-14T05:44:15.8443588Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 9s local 2025-03-14T05:44:15.8444853Z Compiling xla/service/memory_space_assignment/utils.cc; 9s local 2025-03-14T05:44:15.8445961Z Compiling xla/service/memory_space_assignment/allocation.cc; 9s local 2025-03-14T05:44:15.8447186Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2025-03-14T05:44:15.8448352Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 9s local ... 2025-03-14T05:44:16.0682186Z 2025-03-14T05:44:16.0683197Z  2025-03-14T05:44:16.0683698Z  2025-03-14T05:44:16.0684151Z  2025-03-14T05:44:16.0684701Z  2025-03-14T05:44:16.0685146Z  2025-03-14T05:44:16.0685586Z  2025-03-14T05:44:16.0686435Z  2025-03-14T05:44:16.0686842Z  2025-03-14T05:44:16.0687424Z [11,465 / 15,235] 48 actions, 47 running 2025-03-14T05:44:16.0688119Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T05:44:16.0688873Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:16.0689746Z Compiling xla/service/hlo_execution_profile.cc; 9s local 2025-03-14T05:44:16.0690745Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 9s local 2025-03-14T05:44:16.0691835Z Compiling xla/service/memory_space_assignment/utils.cc; 9s local 2025-03-14T05:44:16.0692938Z Compiling xla/service/memory_space_assignment/allocation.cc; 9s local 2025-03-14T05:44:16.0694038Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2025-03-14T05:44:16.0695159Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 9s local ... 2025-03-14T05:44:16.2805580Z 2025-03-14T05:44:16.2806547Z  2025-03-14T05:44:16.2807054Z  2025-03-14T05:44:16.2807552Z  2025-03-14T05:44:16.2807986Z  2025-03-14T05:44:16.2808427Z  2025-03-14T05:44:16.2808853Z  2025-03-14T05:44:16.2809277Z  2025-03-14T05:44:16.2809746Z  2025-03-14T05:44:16.2810292Z [11,471 / 15,235] 48 actions, 47 running 2025-03-14T05:44:16.2810994Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T05:44:16.2811667Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:16.2812415Z Compiling xla/service/hlo_execution_profile.cc; 9s local 2025-03-14T05:44:16.2813366Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 9s local 2025-03-14T05:44:16.2814367Z Compiling xla/service/memory_space_assignment/utils.cc; 9s local 2025-03-14T05:44:16.2815447Z Compiling xla/service/memory_space_assignment/allocation.cc; 9s local 2025-03-14T05:44:16.2816688Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2025-03-14T05:44:16.2817766Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 9s local ... 2025-03-14T05:44:16.5188737Z 2025-03-14T05:44:16.5189691Z  2025-03-14T05:44:16.5190543Z  2025-03-14T05:44:16.5191086Z  2025-03-14T05:44:16.5191649Z  2025-03-14T05:44:16.5192163Z  2025-03-14T05:44:16.5192651Z  2025-03-14T05:44:16.5193190Z  2025-03-14T05:44:16.5193691Z  2025-03-14T05:44:16.5194408Z [11,477 / 15,235] 48 actions, 47 running 2025-03-14T05:44:16.5195275Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2025-03-14T05:44:16.5196096Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:44:16.5196953Z Compiling xla/service/hlo_execution_profile.cc; 9s local 2025-03-14T05:44:16.5198002Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 9s local 2025-03-14T05:44:16.5199112Z Compiling xla/service/memory_space_assignment/utils.cc; 9s local 2025-03-14T05:44:16.5200293Z Compiling xla/service/memory_space_assignment/allocation.cc; 9s local 2025-03-14T05:44:16.5201528Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 9s local 2025-03-14T05:44:16.5202574Z Compiling xla/service/tuple_util.cc; 9s local ... 2025-03-14T05:44:16.7652349Z 2025-03-14T05:44:16.7653445Z  2025-03-14T05:44:16.7653985Z  2025-03-14T05:44:16.7654396Z  2025-03-14T05:44:16.7654823Z  2025-03-14T05:44:16.7655241Z  2025-03-14T05:44:16.7655670Z  2025-03-14T05:44:16.7656095Z  2025-03-14T05:44:16.7656523Z  2025-03-14T05:44:16.7657154Z [11,485 / 15,235] 48 actions, 47 running 2025-03-14T05:44:16.7657916Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2025-03-14T05:44:16.7658630Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:44:16.7659431Z Compiling xla/service/hlo_execution_profile.cc; 9s local 2025-03-14T05:44:16.7660486Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 9s local 2025-03-14T05:44:16.7661587Z Compiling xla/service/memory_space_assignment/utils.cc; 9s local 2025-03-14T05:44:16.7662990Z Compiling xla/service/memory_space_assignment/allocation.cc; 9s local 2025-03-14T05:44:16.7664184Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 9s local 2025-03-14T05:44:16.7665277Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 9s local ... 2025-03-14T05:44:16.9648802Z 2025-03-14T05:44:16.9650045Z  2025-03-14T05:44:16.9650592Z  2025-03-14T05:44:16.9651045Z  2025-03-14T05:44:16.9651505Z  2025-03-14T05:44:16.9651907Z  2025-03-14T05:44:16.9652287Z  2025-03-14T05:44:16.9652707Z  2025-03-14T05:44:16.9653117Z  2025-03-14T05:44:16.9653679Z [11,492 / 15,235] 48 actions running 2025-03-14T05:44:16.9654345Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2025-03-14T05:44:16.9655057Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:44:16.9655814Z Compiling xla/service/hlo_execution_profile.cc; 10s local 2025-03-14T05:44:16.9656783Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 10s local 2025-03-14T05:44:16.9657845Z Compiling xla/service/memory_space_assignment/utils.cc; 10s local 2025-03-14T05:44:16.9658862Z Compiling xla/service/memory_space_assignment/allocation.cc; 10s local 2025-03-14T05:44:16.9659882Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local 2025-03-14T05:44:16.9660915Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 10s local ... 2025-03-14T05:44:17.1653587Z 2025-03-14T05:44:17.1654597Z  2025-03-14T05:44:17.1655158Z  2025-03-14T05:44:17.1655555Z  2025-03-14T05:44:17.1655956Z  2025-03-14T05:44:17.1656390Z  2025-03-14T05:44:17.1656831Z  2025-03-14T05:44:17.1657275Z  2025-03-14T05:44:17.1657713Z  2025-03-14T05:44:17.1658337Z [11,501 / 15,235] 48 actions running 2025-03-14T05:44:17.1659136Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2025-03-14T05:44:17.1659918Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:44:17.1660826Z Compiling xla/service/hlo_execution_profile.cc; 10s local 2025-03-14T05:44:17.1662315Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 10s local 2025-03-14T05:44:17.1663497Z Compiling xla/service/memory_space_assignment/utils.cc; 10s local 2025-03-14T05:44:17.1664690Z Compiling xla/service/memory_space_assignment/allocation.cc; 10s local 2025-03-14T05:44:17.1665992Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local 2025-03-14T05:44:17.1667057Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 10s local ... 2025-03-14T05:44:17.4074503Z 2025-03-14T05:44:17.4075388Z  2025-03-14T05:44:17.4075877Z  2025-03-14T05:44:17.4076312Z  2025-03-14T05:44:17.4076713Z  2025-03-14T05:44:17.4077147Z  2025-03-14T05:44:17.4077572Z  2025-03-14T05:44:17.4078012Z  2025-03-14T05:44:17.4078436Z  2025-03-14T05:44:17.4079089Z [11,506 / 15,235] 48 actions, 47 running 2025-03-14T05:44:17.4079850Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2025-03-14T05:44:17.4080709Z Compiling xla/service/hlo_execution_profile.cc; 10s local 2025-03-14T05:44:17.4081696Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 10s local 2025-03-14T05:44:17.4082786Z Compiling xla/service/memory_space_assignment/utils.cc; 10s local 2025-03-14T05:44:17.4083884Z Compiling xla/service/memory_space_assignment/allocation.cc; 10s local 2025-03-14T05:44:17.4085142Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local 2025-03-14T05:44:17.4086214Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 10s local 2025-03-14T05:44:17.4087290Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 10s local ... 2025-03-14T05:44:17.7689755Z 2025-03-14T05:44:17.7690655Z  2025-03-14T05:44:17.7691199Z  2025-03-14T05:44:17.7691650Z  2025-03-14T05:44:17.7692052Z  2025-03-14T05:44:17.7692424Z  2025-03-14T05:44:17.7692783Z  2025-03-14T05:44:17.7693489Z  2025-03-14T05:44:17.7693892Z  2025-03-14T05:44:17.7694442Z [11,510 / 15,235] 48 actions running 2025-03-14T05:44:17.7695085Z Compiling src/cpu/rnn/ref_rnn.cpp; 113s local 2025-03-14T05:44:17.7695821Z Compiling xla/service/hlo_execution_profile.cc; 10s local 2025-03-14T05:44:17.7696727Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 10s local 2025-03-14T05:44:17.7697702Z Compiling xla/service/memory_space_assignment/utils.cc; 10s local 2025-03-14T05:44:17.7698674Z Compiling xla/service/memory_space_assignment/allocation.cc; 10s local 2025-03-14T05:44:17.7699664Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local 2025-03-14T05:44:17.7700602Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 10s local 2025-03-14T05:44:17.7701523Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 10s local ... 2025-03-14T05:44:17.9666117Z 2025-03-14T05:44:17.9666942Z  2025-03-14T05:44:17.9667400Z  2025-03-14T05:44:17.9667815Z  2025-03-14T05:44:17.9668184Z  2025-03-14T05:44:17.9668589Z  2025-03-14T05:44:17.9668959Z  2025-03-14T05:44:17.9669329Z  2025-03-14T05:44:17.9669684Z  2025-03-14T05:44:17.9670202Z [11,511 / 15,235] 48 actions running 2025-03-14T05:44:17.9670855Z Compiling src/cpu/rnn/ref_rnn.cpp; 113s local 2025-03-14T05:44:17.9671584Z Compiling xla/service/hlo_execution_profile.cc; 11s local 2025-03-14T05:44:17.9672481Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 11s local 2025-03-14T05:44:17.9673487Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local 2025-03-14T05:44:17.9674444Z Compiling xla/service/memory_space_assignment/allocation.cc; 11s local 2025-03-14T05:44:17.9675431Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T05:44:17.9676307Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T05:44:17.9677267Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 11s local ... 2025-03-14T05:44:18.2074473Z 2025-03-14T05:44:18.2075365Z  2025-03-14T05:44:18.2075825Z  2025-03-14T05:44:18.2076245Z  2025-03-14T05:44:18.2076747Z  2025-03-14T05:44:18.2077261Z  2025-03-14T05:44:18.2077751Z  2025-03-14T05:44:18.2078184Z  2025-03-14T05:44:18.2078634Z  2025-03-14T05:44:18.2079180Z [11,514 / 15,235] 48 actions, 47 running 2025-03-14T05:44:18.2079876Z Compiling src/cpu/rnn/ref_rnn.cpp; 113s local 2025-03-14T05:44:18.2080658Z Compiling xla/service/hlo_execution_profile.cc; 11s local 2025-03-14T05:44:18.2081769Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 11s local 2025-03-14T05:44:18.2082874Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local 2025-03-14T05:44:18.2083980Z Compiling xla/service/memory_space_assignment/allocation.cc; 11s local 2025-03-14T05:44:18.2085297Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T05:44:18.2086380Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T05:44:18.2087451Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 11s local ... 2025-03-14T05:44:18.4377831Z 2025-03-14T05:44:18.4378704Z  2025-03-14T05:44:18.4379208Z  2025-03-14T05:44:18.4379627Z  2025-03-14T05:44:18.4380035Z  2025-03-14T05:44:18.4380472Z  2025-03-14T05:44:18.4380895Z  2025-03-14T05:44:18.4381310Z  2025-03-14T05:44:18.4381715Z  2025-03-14T05:44:18.4382332Z [11,518 / 15,235] 48 actions, 47 running 2025-03-14T05:44:18.4383155Z Compiling xla/service/hlo_execution_profile.cc; 11s local 2025-03-14T05:44:18.4384179Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 11s local 2025-03-14T05:44:18.4385303Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local 2025-03-14T05:44:18.4386419Z Compiling xla/service/memory_space_assignment/allocation.cc; 11s local 2025-03-14T05:44:18.4387889Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T05:44:18.4388915Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T05:44:18.4389994Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T05:44:18.4391187Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 3s local ... 2025-03-14T05:44:18.6857594Z 2025-03-14T05:44:18.6858400Z  2025-03-14T05:44:18.6858884Z  2025-03-14T05:44:18.6859294Z  2025-03-14T05:44:18.6859711Z  2025-03-14T05:44:18.6860128Z  2025-03-14T05:44:18.6860542Z  2025-03-14T05:44:18.6860966Z  2025-03-14T05:44:18.6861383Z  2025-03-14T05:44:18.6862011Z [11,519 / 15,235] 48 actions, 47 running 2025-03-14T05:44:18.6862828Z Compiling xla/service/hlo_execution_profile.cc; 11s local 2025-03-14T05:44:18.6863849Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 11s local 2025-03-14T05:44:18.6865030Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local 2025-03-14T05:44:18.6866341Z Compiling xla/service/memory_space_assignment/allocation.cc; 11s local 2025-03-14T05:44:18.6867385Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T05:44:18.6868424Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T05:44:18.6869534Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T05:44:18.6870724Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 3s local ... 2025-03-14T05:44:18.9672245Z 2025-03-14T05:44:18.9673123Z  2025-03-14T05:44:18.9673586Z  2025-03-14T05:44:18.9674021Z  2025-03-14T05:44:18.9674446Z  2025-03-14T05:44:18.9674868Z  2025-03-14T05:44:18.9675291Z  2025-03-14T05:44:18.9675690Z  2025-03-14T05:44:18.9676087Z  2025-03-14T05:44:18.9676810Z [11,520 / 15,235] 48 actions running 2025-03-14T05:44:18.9677638Z Compiling xla/service/hlo_execution_profile.cc; 12s local 2025-03-14T05:44:18.9679032Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 12s local 2025-03-14T05:44:18.9680131Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local 2025-03-14T05:44:18.9681238Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local 2025-03-14T05:44:18.9682360Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T05:44:18.9683458Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 12s local 2025-03-14T05:44:18.9684731Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T05:44:18.9685987Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 4s local ... 2025-03-14T05:44:19.2560650Z 2025-03-14T05:44:19.2561483Z  2025-03-14T05:44:19.2561987Z  2025-03-14T05:44:19.2562400Z  2025-03-14T05:44:19.2562817Z  2025-03-14T05:44:19.2563195Z  2025-03-14T05:44:19.2563631Z  2025-03-14T05:44:19.2564027Z  2025-03-14T05:44:19.2564460Z  2025-03-14T05:44:19.2565228Z [11,523 / 15,235] 48 actions, 47 running 2025-03-14T05:44:19.2566280Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 12s local 2025-03-14T05:44:19.2567294Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local 2025-03-14T05:44:19.2568330Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local 2025-03-14T05:44:19.2569362Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T05:44:19.2570386Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T05:44:19.2571512Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 4s local 2025-03-14T05:44:19.2572497Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 3s local 2025-03-14T05:44:19.2573331Z Compiling llvm/lib/Support/YAMLParser.cpp; 3s local ... 2025-03-14T05:44:19.5680505Z 2025-03-14T05:44:19.5681728Z  2025-03-14T05:44:19.5682367Z  2025-03-14T05:44:19.5682785Z  2025-03-14T05:44:19.5683186Z  2025-03-14T05:44:19.5683551Z  2025-03-14T05:44:19.5683942Z  2025-03-14T05:44:19.5684343Z  2025-03-14T05:44:19.5684870Z  2025-03-14T05:44:19.5685437Z [11,525 / 15,235] 48 actions running 2025-03-14T05:44:19.5686472Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 12s local 2025-03-14T05:44:19.5687533Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local 2025-03-14T05:44:19.5688572Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local 2025-03-14T05:44:19.5689674Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T05:44:19.5690747Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T05:44:19.5691900Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 4s local 2025-03-14T05:44:19.5692945Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 3s local 2025-03-14T05:44:19.5693926Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2025-03-14T05:44:19.7685220Z 2025-03-14T05:44:19.7686079Z  2025-03-14T05:44:19.7686584Z  2025-03-14T05:44:19.7686976Z  2025-03-14T05:44:19.7687356Z  2025-03-14T05:44:19.7687732Z  2025-03-14T05:44:19.7688140Z  2025-03-14T05:44:19.7688523Z  2025-03-14T05:44:19.7688896Z  2025-03-14T05:44:19.7689442Z [11,527 / 15,235] 48 actions running 2025-03-14T05:44:19.7690316Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 12s local 2025-03-14T05:44:19.7691379Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local 2025-03-14T05:44:19.7692463Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local 2025-03-14T05:44:19.7693493Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T05:44:19.7694533Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T05:44:19.7696066Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 4s local 2025-03-14T05:44:19.7697084Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 4s local 2025-03-14T05:44:19.7698029Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2025-03-14T05:44:20.0151509Z 2025-03-14T05:44:20.0152342Z  2025-03-14T05:44:20.0152847Z  2025-03-14T05:44:20.0153263Z  2025-03-14T05:44:20.0153690Z  2025-03-14T05:44:20.0154089Z  2025-03-14T05:44:20.0154456Z  2025-03-14T05:44:20.0154827Z  2025-03-14T05:44:20.0155227Z  2025-03-14T05:44:20.0155806Z [11,529 / 15,235] 48 actions, 47 running 2025-03-14T05:44:20.0156727Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T05:44:20.0157800Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T05:44:20.0158879Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2025-03-14T05:44:20.0159939Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T05:44:20.0160988Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T05:44:20.0162085Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 5s local 2025-03-14T05:44:20.0163124Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 4s local 2025-03-14T05:44:20.0164082Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2025-03-14T05:44:20.2365923Z 2025-03-14T05:44:20.2366754Z  2025-03-14T05:44:20.2367209Z  2025-03-14T05:44:20.2367588Z  2025-03-14T05:44:20.2367977Z  2025-03-14T05:44:20.2368334Z  2025-03-14T05:44:20.2368706Z  2025-03-14T05:44:20.2369052Z  2025-03-14T05:44:20.2369424Z  2025-03-14T05:44:20.2369960Z [11,530 / 15,235] 48 actions, 47 running 2025-03-14T05:44:20.2371113Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T05:44:20.2372215Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T05:44:20.2373191Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2025-03-14T05:44:20.2374165Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T05:44:20.2375144Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T05:44:20.2376193Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 5s local 2025-03-14T05:44:20.2377138Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 4s local 2025-03-14T05:44:20.2378070Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2025-03-14T05:44:20.4886181Z 2025-03-14T05:44:20.4887596Z  2025-03-14T05:44:20.4888278Z  2025-03-14T05:44:20.4888942Z  2025-03-14T05:44:20.4889996Z  2025-03-14T05:44:20.4890479Z  2025-03-14T05:44:20.4890901Z  2025-03-14T05:44:20.4891305Z  2025-03-14T05:44:20.4891766Z  2025-03-14T05:44:20.4892383Z [11,531 / 15,235] 48 actions, 47 running 2025-03-14T05:44:20.4893330Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T05:44:20.4894415Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T05:44:20.4895487Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2025-03-14T05:44:20.4896573Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T05:44:20.4897688Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T05:44:20.4898801Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 5s local 2025-03-14T05:44:20.4899850Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 4s local 2025-03-14T05:44:20.4900780Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2025-03-14T05:44:20.7693547Z 2025-03-14T05:44:20.7694402Z  2025-03-14T05:44:20.7694936Z  2025-03-14T05:44:20.7695344Z  2025-03-14T05:44:20.7696214Z  2025-03-14T05:44:20.7696609Z  2025-03-14T05:44:20.7696986Z  2025-03-14T05:44:20.7697400Z  2025-03-14T05:44:20.7697767Z  2025-03-14T05:44:20.7698346Z [11,531 / 15,235] 48 actions running 2025-03-14T05:44:20.7699177Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T05:44:20.7700229Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T05:44:20.7701194Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2025-03-14T05:44:20.7702190Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T05:44:20.7703241Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T05:44:20.7704328Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 5s local 2025-03-14T05:44:20.7705325Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local 2025-03-14T05:44:20.7706267Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 4s local ... 2025-03-14T05:44:21.1432357Z 2025-03-14T05:44:21.1433271Z  2025-03-14T05:44:21.1435140Z  2025-03-14T05:44:21.1435624Z  2025-03-14T05:44:21.1436029Z  2025-03-14T05:44:21.1436459Z  2025-03-14T05:44:21.1436886Z  2025-03-14T05:44:21.1437279Z  2025-03-14T05:44:21.1437675Z  2025-03-14T05:44:21.1438287Z [11,535 / 15,235] 48 actions, 47 running 2025-03-14T05:44:21.1439162Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T05:44:21.1440289Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T05:44:21.1441406Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T05:44:21.1442648Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 6s local 2025-03-14T05:44:21.1443771Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local 2025-03-14T05:44:21.1445315Z Compiling xla/service/hlo_cost_analysis.cc; 4s local 2025-03-14T05:44:21.1446290Z Compiling xla/service/memory_space_assignment/slice.cc; 4s local 2025-03-14T05:44:21.1447343Z Compiling xla/service/heap_simulator/heap_simulator.cc; 4s local ... 2025-03-14T05:44:21.3699322Z 2025-03-14T05:44:21.3700136Z  2025-03-14T05:44:21.3700597Z  2025-03-14T05:44:21.3701000Z  2025-03-14T05:44:21.3701394Z  2025-03-14T05:44:21.3701787Z  2025-03-14T05:44:21.3702170Z  2025-03-14T05:44:21.3702562Z  2025-03-14T05:44:21.3702941Z  2025-03-14T05:44:21.3703478Z [11,536 / 15,235] 48 actions running 2025-03-14T05:44:21.3704359Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T05:44:21.3705873Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T05:44:21.3706969Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T05:44:21.3708120Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 6s local 2025-03-14T05:44:21.3709411Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local 2025-03-14T05:44:21.3710368Z Compiling xla/service/hlo_cost_analysis.cc; 4s local 2025-03-14T05:44:21.3711240Z Compiling xla/service/memory_space_assignment/slice.cc; 4s local 2025-03-14T05:44:21.3712367Z Compiling xla/service/heap_simulator/heap_simulator.cc; 4s local ... 2025-03-14T05:44:21.5704631Z 2025-03-14T05:44:21.5705549Z  2025-03-14T05:44:21.5706042Z  2025-03-14T05:44:21.5706462Z  2025-03-14T05:44:21.5706892Z  2025-03-14T05:44:21.5707305Z  2025-03-14T05:44:21.5707712Z  2025-03-14T05:44:21.5708137Z  2025-03-14T05:44:21.5708562Z  2025-03-14T05:44:21.5718097Z [11,539 / 15,235] 48 actions running 2025-03-14T05:44:21.5719252Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T05:44:21.5720422Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T05:44:21.5721532Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T05:44:21.5723149Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 6s local 2025-03-14T05:44:21.5724205Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local 2025-03-14T05:44:21.5725264Z Compiling xla/service/hlo_cost_analysis.cc; 4s local 2025-03-14T05:44:21.5726180Z Compiling xla/service/memory_space_assignment/slice.cc; 4s local 2025-03-14T05:44:21.5727242Z Compiling xla/service/heap_simulator/heap_simulator.cc; 4s local ... 2025-03-14T05:44:22.1163653Z 2025-03-14T05:44:22.1164462Z  2025-03-14T05:44:22.1165086Z  2025-03-14T05:44:22.1165660Z  2025-03-14T05:44:22.1166016Z  2025-03-14T05:44:22.1166347Z  2025-03-14T05:44:22.1166699Z  2025-03-14T05:44:22.1167055Z  2025-03-14T05:44:22.1167463Z  2025-03-14T05:44:22.1168251Z [11,540 / 15,235] 48 actions, 47 running 2025-03-14T05:44:22.1169078Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T05:44:22.1170169Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T05:44:22.1171043Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T05:44:22.1172114Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 7s local 2025-03-14T05:44:22.1173091Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2025-03-14T05:44:22.1173895Z Compiling xla/service/hlo_cost_analysis.cc; 5s local 2025-03-14T05:44:22.1174795Z Compiling xla/service/memory_space_assignment/slice.cc; 5s local 2025-03-14T05:44:22.1175989Z Compiling xla/service/heap_simulator/heap_simulator.cc; 5s local ... 2025-03-14T05:44:22.3712145Z 2025-03-14T05:44:22.3713117Z  2025-03-14T05:44:22.3713609Z  2025-03-14T05:44:22.3714036Z  2025-03-14T05:44:22.3715583Z  2025-03-14T05:44:22.3716081Z  2025-03-14T05:44:22.3717470Z  2025-03-14T05:44:22.3717922Z  2025-03-14T05:44:22.3718361Z  2025-03-14T05:44:22.3718940Z [11,541 / 15,235] 48 actions running 2025-03-14T05:44:22.3719984Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T05:44:22.3721084Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T05:44:22.3722201Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T05:44:22.3723194Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 7s local 2025-03-14T05:44:22.3724335Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2025-03-14T05:44:22.3725331Z Compiling xla/service/hlo_cost_analysis.cc; 5s local 2025-03-14T05:44:22.3726270Z Compiling xla/service/memory_space_assignment/slice.cc; 5s local 2025-03-14T05:44:22.3727379Z Compiling xla/service/heap_simulator/heap_simulator.cc; 5s local ... 2025-03-14T05:44:22.7717987Z 2025-03-14T05:44:22.7718802Z  2025-03-14T05:44:22.7719280Z  2025-03-14T05:44:22.7719734Z  2025-03-14T05:44:22.7720163Z  2025-03-14T05:44:22.7720588Z  2025-03-14T05:44:22.7721017Z  2025-03-14T05:44:22.7721430Z  2025-03-14T05:44:22.7721799Z  2025-03-14T05:44:22.7722378Z [11,542 / 15,235] 48 actions running 2025-03-14T05:44:22.7723300Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T05:44:22.7724344Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T05:44:22.7725621Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T05:44:22.7726838Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 7s local 2025-03-14T05:44:22.7727885Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2025-03-14T05:44:22.7728792Z Compiling xla/service/hlo_cost_analysis.cc; 6s local 2025-03-14T05:44:22.7729756Z Compiling xla/service/memory_space_assignment/slice.cc; 6s local 2025-03-14T05:44:22.7730808Z Compiling xla/service/heap_simulator/heap_simulator.cc; 6s local ... 2025-03-14T05:44:22.9721843Z 2025-03-14T05:44:22.9722693Z  2025-03-14T05:44:22.9723116Z  2025-03-14T05:44:22.9723451Z  2025-03-14T05:44:22.9723792Z  2025-03-14T05:44:22.9724138Z  2025-03-14T05:44:22.9724481Z  2025-03-14T05:44:22.9725002Z  2025-03-14T05:44:22.9725411Z  2025-03-14T05:44:22.9725958Z [11,543 / 15,235] 48 actions running 2025-03-14T05:44:22.9726891Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2025-03-14T05:44:22.9727908Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 16s local 2025-03-14T05:44:22.9728981Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T05:44:22.9730172Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 8s local 2025-03-14T05:44:22.9731200Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2025-03-14T05:44:22.9732037Z Compiling xla/service/hlo_cost_analysis.cc; 6s local 2025-03-14T05:44:22.9732903Z Compiling xla/service/memory_space_assignment/slice.cc; 6s local 2025-03-14T05:44:22.9733892Z Compiling xla/service/heap_simulator/heap_simulator.cc; 6s local ... 2025-03-14T05:44:23.3727535Z 2025-03-14T05:44:23.3728373Z  2025-03-14T05:44:23.3728864Z  2025-03-14T05:44:23.3729265Z  2025-03-14T05:44:23.3729651Z  2025-03-14T05:44:23.3730070Z  2025-03-14T05:44:23.3730489Z  2025-03-14T05:44:23.3730919Z  2025-03-14T05:44:23.3731359Z  2025-03-14T05:44:23.3731958Z [11,544 / 15,235] 48 actions running 2025-03-14T05:44:23.3732939Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2025-03-14T05:44:23.3734139Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T05:44:23.3735520Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 8s local 2025-03-14T05:44:23.3737153Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2025-03-14T05:44:23.3738105Z Compiling xla/service/hlo_cost_analysis.cc; 6s local 2025-03-14T05:44:23.3739101Z Compiling xla/service/memory_space_assignment/slice.cc; 6s local 2025-03-14T05:44:23.3740207Z Compiling xla/service/heap_simulator/heap_simulator.cc; 6s local 2025-03-14T05:44:23.3741231Z Compiling xla/hlo/utils/hlo_live_range.cc; 6s local ... 2025-03-14T05:44:23.7436817Z 2025-03-14T05:44:23.7438131Z  2025-03-14T05:44:23.7438589Z  2025-03-14T05:44:23.7438936Z  2025-03-14T05:44:23.7439283Z  2025-03-14T05:44:23.7439656Z  2025-03-14T05:44:23.7440010Z  2025-03-14T05:44:23.7440370Z  2025-03-14T05:44:23.7440742Z  2025-03-14T05:44:23.7441319Z [11,547 / 15,235] 48 actions, 47 running 2025-03-14T05:44:23.7442163Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2025-03-14T05:44:23.7443274Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 8s local 2025-03-14T05:44:23.7444215Z Compiling xla/service/hlo_cost_analysis.cc; 7s local 2025-03-14T05:44:23.7445181Z Compiling xla/service/memory_space_assignment/slice.cc; 7s local 2025-03-14T05:44:23.7446102Z Compiling xla/service/heap_simulator/heap_simulator.cc; 6s local 2025-03-14T05:44:23.7446876Z Compiling xla/hlo/utils/hlo_live_range.cc; 6s local 2025-03-14T05:44:23.7447599Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 6s local 2025-03-14T05:44:23.7448391Z Compiling xla/hlo/analysis/hlo_ordering.cc; 6s local ... 2025-03-14T05:44:23.9733093Z 2025-03-14T05:44:23.9734007Z  2025-03-14T05:44:23.9734460Z  2025-03-14T05:44:23.9734816Z  2025-03-14T05:44:23.9735150Z  2025-03-14T05:44:23.9735527Z  2025-03-14T05:44:23.9735881Z  2025-03-14T05:44:23.9736244Z  2025-03-14T05:44:23.9736670Z  2025-03-14T05:44:23.9737255Z [11,550 / 15,235] 48 actions running 2025-03-14T05:44:23.9738182Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local 2025-03-14T05:44:23.9739543Z Compiling xla/service/hlo_cost_analysis.cc; 7s local 2025-03-14T05:44:23.9740429Z Compiling xla/service/memory_space_assignment/slice.cc; 7s local 2025-03-14T05:44:23.9741334Z Compiling xla/service/heap_simulator/heap_simulator.cc; 7s local 2025-03-14T05:44:23.9742188Z Compiling xla/hlo/utils/hlo_live_range.cc; 7s local 2025-03-14T05:44:23.9742921Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 7s local 2025-03-14T05:44:23.9743789Z Compiling xla/hlo/analysis/hlo_ordering.cc; 7s local 2025-03-14T05:44:23.9744702Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 7s local ... 2025-03-14T05:44:24.3093425Z 2025-03-14T05:44:24.3094306Z  2025-03-14T05:44:24.3094783Z  2025-03-14T05:44:24.3095187Z  2025-03-14T05:44:24.3095588Z  2025-03-14T05:44:24.3095986Z  2025-03-14T05:44:24.3096373Z  2025-03-14T05:44:24.3096769Z  2025-03-14T05:44:24.3097209Z  2025-03-14T05:44:24.3097836Z [11,551 / 15,235] 48 actions, 47 running 2025-03-14T05:44:24.3098757Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local 2025-03-14T05:44:24.3099728Z Compiling xla/service/hlo_cost_analysis.cc; 7s local 2025-03-14T05:44:24.3100609Z Compiling xla/service/memory_space_assignment/slice.cc; 7s local 2025-03-14T05:44:24.3101606Z Compiling xla/service/heap_simulator/heap_simulator.cc; 7s local 2025-03-14T05:44:24.3102505Z Compiling xla/hlo/utils/hlo_live_range.cc; 7s local 2025-03-14T05:44:24.3103319Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 7s local 2025-03-14T05:44:24.3104171Z Compiling xla/hlo/analysis/hlo_ordering.cc; 7s local 2025-03-14T05:44:24.3105059Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 7s local ... 2025-03-14T05:44:24.5738652Z 2025-03-14T05:44:24.5739602Z  2025-03-14T05:44:24.5740192Z  2025-03-14T05:44:24.5740603Z  2025-03-14T05:44:24.5741389Z  2025-03-14T05:44:24.5741813Z  2025-03-14T05:44:24.5742245Z  2025-03-14T05:44:24.5742631Z  2025-03-14T05:44:24.5743030Z  2025-03-14T05:44:24.5743610Z [11,551 / 15,235] 48 actions running 2025-03-14T05:44:24.5744554Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local 2025-03-14T05:44:24.5745513Z Compiling xla/service/hlo_cost_analysis.cc; 7s local 2025-03-14T05:44:24.5746358Z Compiling xla/service/memory_space_assignment/slice.cc; 7s local 2025-03-14T05:44:24.5747349Z Compiling xla/service/heap_simulator/heap_simulator.cc; 7s local 2025-03-14T05:44:24.5748218Z Compiling xla/hlo/utils/hlo_live_range.cc; 7s local 2025-03-14T05:44:24.5749057Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 7s local 2025-03-14T05:44:24.5749900Z Compiling xla/hlo/analysis/hlo_ordering.cc; 7s local 2025-03-14T05:44:24.5750762Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 7s local ... 2025-03-14T05:44:24.7743237Z 2025-03-14T05:44:24.7744203Z  2025-03-14T05:44:24.7744757Z  2025-03-14T05:44:24.7745115Z  2025-03-14T05:44:24.7745471Z  2025-03-14T05:44:24.7745839Z  2025-03-14T05:44:24.7746232Z  2025-03-14T05:44:24.7746613Z  2025-03-14T05:44:24.7747023Z  2025-03-14T05:44:24.7747559Z [11,553 / 15,235] 48 actions running 2025-03-14T05:44:24.7748457Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local 2025-03-14T05:44:24.7749415Z Compiling xla/service/hlo_cost_analysis.cc; 8s local 2025-03-14T05:44:24.7750310Z Compiling xla/service/memory_space_assignment/slice.cc; 8s local 2025-03-14T05:44:24.7751312Z Compiling xla/service/heap_simulator/heap_simulator.cc; 8s local 2025-03-14T05:44:24.7752160Z Compiling xla/hlo/utils/hlo_live_range.cc; 7s local 2025-03-14T05:44:24.7752951Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 7s local 2025-03-14T05:44:24.7753792Z Compiling xla/hlo/analysis/hlo_ordering.cc; 7s local 2025-03-14T05:44:24.7754674Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 7s local ... 2025-03-14T05:44:25.1216659Z 2025-03-14T05:44:25.1217508Z  2025-03-14T05:44:25.1217930Z  2025-03-14T05:44:25.1218278Z  2025-03-14T05:44:25.1218625Z  2025-03-14T05:44:25.1218977Z  2025-03-14T05:44:25.1219334Z  2025-03-14T05:44:25.1219690Z  2025-03-14T05:44:25.1220033Z  2025-03-14T05:44:25.1220561Z [11,555 / 15,235] 48 actions, 47 running 2025-03-14T05:44:25.1221367Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 10s local 2025-03-14T05:44:25.1222196Z Compiling xla/service/hlo_cost_analysis.cc; 8s local 2025-03-14T05:44:25.1222965Z Compiling xla/service/memory_space_assignment/slice.cc; 8s local 2025-03-14T05:44:25.1223840Z Compiling xla/service/heap_simulator/heap_simulator.cc; 8s local 2025-03-14T05:44:25.1224674Z Compiling xla/hlo/utils/hlo_live_range.cc; 8s local 2025-03-14T05:44:25.1225441Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 8s local 2025-03-14T05:44:25.1226183Z Compiling xla/hlo/analysis/hlo_ordering.cc; 8s local 2025-03-14T05:44:25.1226963Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 8s local ... 2025-03-14T05:44:25.3749301Z 2025-03-14T05:44:25.3750116Z  2025-03-14T05:44:25.3750545Z  2025-03-14T05:44:25.3750921Z  2025-03-14T05:44:25.3751304Z  2025-03-14T05:44:25.3751711Z  2025-03-14T05:44:25.3752107Z  2025-03-14T05:44:25.3752501Z  2025-03-14T05:44:25.3752860Z  2025-03-14T05:44:25.3753381Z [11,556 / 15,235] 48 actions running 2025-03-14T05:44:25.3754301Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 10s local 2025-03-14T05:44:25.3755241Z Compiling xla/service/hlo_cost_analysis.cc; 8s local 2025-03-14T05:44:25.3756149Z Compiling xla/service/memory_space_assignment/slice.cc; 8s local 2025-03-14T05:44:25.3757587Z Compiling xla/service/heap_simulator/heap_simulator.cc; 8s local 2025-03-14T05:44:25.3758519Z Compiling xla/hlo/utils/hlo_live_range.cc; 8s local 2025-03-14T05:44:25.3759363Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 8s local 2025-03-14T05:44:25.3760137Z Compiling xla/hlo/analysis/hlo_ordering.cc; 8s local 2025-03-14T05:44:25.3760992Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 8s local ... 2025-03-14T05:44:25.5754989Z 2025-03-14T05:44:25.5756271Z  2025-03-14T05:44:25.5757087Z  2025-03-14T05:44:25.5757747Z  2025-03-14T05:44:25.5758428Z  2025-03-14T05:44:25.5758904Z  2025-03-14T05:44:25.5759328Z  2025-03-14T05:44:25.5759712Z  2025-03-14T05:44:25.5760069Z  2025-03-14T05:44:25.5760596Z [11,559 / 15,235] 48 actions running 2025-03-14T05:44:25.5761505Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 10s local 2025-03-14T05:44:25.5762512Z Compiling xla/service/hlo_cost_analysis.cc; 8s local 2025-03-14T05:44:25.5763417Z Compiling xla/service/memory_space_assignment/slice.cc; 8s local 2025-03-14T05:44:25.5764436Z Compiling xla/service/heap_simulator/heap_simulator.cc; 8s local 2025-03-14T05:44:25.5765747Z Compiling xla/hlo/utils/hlo_live_range.cc; 8s local 2025-03-14T05:44:25.5766459Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 8s local 2025-03-14T05:44:25.5767202Z Compiling xla/hlo/analysis/hlo_ordering.cc; 8s local 2025-03-14T05:44:25.5768069Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 8s local ... 2025-03-14T05:44:25.9820426Z 2025-03-14T05:44:25.9821242Z  2025-03-14T05:44:25.9821712Z  2025-03-14T05:44:25.9822124Z  2025-03-14T05:44:25.9822526Z  2025-03-14T05:44:25.9822934Z  2025-03-14T05:44:25.9823336Z  2025-03-14T05:44:25.9823758Z  2025-03-14T05:44:25.9824146Z  2025-03-14T05:44:25.9824763Z [11,560 / 15,235] 48 actions, 47 running 2025-03-14T05:44:25.9825686Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T05:44:25.9826685Z Compiling xla/service/hlo_cost_analysis.cc; 9s local 2025-03-14T05:44:25.9827921Z Compiling xla/service/memory_space_assignment/slice.cc; 9s local 2025-03-14T05:44:25.9828881Z Compiling xla/service/heap_simulator/heap_simulator.cc; 9s local 2025-03-14T05:44:25.9829752Z Compiling xla/hlo/utils/hlo_live_range.cc; 9s local 2025-03-14T05:44:25.9830598Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 9s local 2025-03-14T05:44:25.9831461Z Compiling xla/hlo/analysis/hlo_ordering.cc; 9s local 2025-03-14T05:44:25.9832345Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 9s local ... 2025-03-14T05:44:26.2102994Z 2025-03-14T05:44:26.2103828Z  2025-03-14T05:44:26.2104297Z  2025-03-14T05:44:26.2104691Z  2025-03-14T05:44:26.2105104Z  2025-03-14T05:44:26.2105511Z  2025-03-14T05:44:26.2105913Z  2025-03-14T05:44:26.2106310Z  2025-03-14T05:44:26.2106705Z  2025-03-14T05:44:26.2107365Z [11,565 / 15,235] 48 actions, 46 running 2025-03-14T05:44:26.2108298Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T05:44:26.2109296Z Compiling xla/service/hlo_cost_analysis.cc; 9s local 2025-03-14T05:44:26.2110175Z Compiling xla/service/memory_space_assignment/slice.cc; 9s local 2025-03-14T05:44:26.2111150Z Compiling xla/service/heap_simulator/heap_simulator.cc; 9s local 2025-03-14T05:44:26.2112027Z Compiling xla/hlo/utils/hlo_live_range.cc; 9s local 2025-03-14T05:44:26.2112852Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 9s local 2025-03-14T05:44:26.2113687Z Compiling xla/hlo/analysis/hlo_ordering.cc; 9s local 2025-03-14T05:44:26.2114573Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 9s local ... 2025-03-14T05:44:26.5761707Z 2025-03-14T05:44:26.5762557Z  2025-03-14T05:44:26.5763030Z  2025-03-14T05:44:26.5763427Z  2025-03-14T05:44:26.5763821Z  2025-03-14T05:44:26.5764201Z  2025-03-14T05:44:26.5765120Z  2025-03-14T05:44:26.5765848Z  2025-03-14T05:44:26.5766239Z  2025-03-14T05:44:26.5766816Z [11,567 / 15,235] 48 actions running 2025-03-14T05:44:26.5767734Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T05:44:26.5768693Z Compiling xla/service/hlo_cost_analysis.cc; 9s local 2025-03-14T05:44:26.5769618Z Compiling xla/service/memory_space_assignment/slice.cc; 9s local 2025-03-14T05:44:26.5770569Z Compiling xla/service/heap_simulator/heap_simulator.cc; 9s local 2025-03-14T05:44:26.5771471Z Compiling xla/hlo/utils/hlo_live_range.cc; 9s local 2025-03-14T05:44:26.5772333Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 9s local 2025-03-14T05:44:26.5773108Z Compiling xla/hlo/analysis/hlo_ordering.cc; 9s local 2025-03-14T05:44:26.5773890Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 9s local ... 2025-03-14T05:44:26.9757997Z 2025-03-14T05:44:26.9758900Z  2025-03-14T05:44:26.9759435Z  2025-03-14T05:44:26.9759928Z  2025-03-14T05:44:26.9760343Z  2025-03-14T05:44:26.9760792Z  2025-03-14T05:44:26.9761215Z  2025-03-14T05:44:26.9761657Z  2025-03-14T05:44:26.9762091Z  2025-03-14T05:44:26.9762789Z [11,568 / 15,235] 48 actions, 47 running 2025-03-14T05:44:26.9763640Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 12s local 2025-03-14T05:44:26.9764715Z Compiling xla/service/hlo_cost_analysis.cc; 10s local 2025-03-14T05:44:26.9765746Z Compiling xla/service/memory_space_assignment/slice.cc; 10s local 2025-03-14T05:44:26.9766705Z Compiling xla/service/heap_simulator/heap_simulator.cc; 10s local 2025-03-14T05:44:26.9767564Z Compiling xla/hlo/utils/hlo_live_range.cc; 10s local 2025-03-14T05:44:26.9768368Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local 2025-03-14T05:44:26.9769133Z Compiling xla/hlo/analysis/hlo_ordering.cc; 10s local 2025-03-14T05:44:26.9770048Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local ... 2025-03-14T05:44:27.1768751Z 2025-03-14T05:44:27.1770183Z  2025-03-14T05:44:27.1770704Z  2025-03-14T05:44:27.1771159Z  2025-03-14T05:44:27.1771562Z  2025-03-14T05:44:27.1772013Z  2025-03-14T05:44:27.1772437Z  2025-03-14T05:44:27.1772774Z  2025-03-14T05:44:27.1773143Z  2025-03-14T05:44:27.1773664Z [11,571 / 15,235] 48 actions running 2025-03-14T05:44:27.1774384Z Compiling xla/service/hlo_cost_analysis.cc; 10s local 2025-03-14T05:44:27.1775254Z Compiling xla/service/memory_space_assignment/slice.cc; 10s local 2025-03-14T05:44:27.1776185Z Compiling xla/service/heap_simulator/heap_simulator.cc; 10s local 2025-03-14T05:44:27.1777033Z Compiling xla/hlo/utils/hlo_live_range.cc; 10s local 2025-03-14T05:44:27.1777773Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local 2025-03-14T05:44:27.1778595Z Compiling xla/hlo/analysis/hlo_ordering.cc; 10s local 2025-03-14T05:44:27.1779498Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2025-03-14T05:44:27.1780336Z Compiling xla/service/hlo_phi_graph.cc; 10s local ... 2025-03-14T05:44:27.3773613Z 2025-03-14T05:44:27.3774580Z  2025-03-14T05:44:27.3775126Z  2025-03-14T05:44:27.3775578Z  2025-03-14T05:44:27.3776018Z  2025-03-14T05:44:27.3776457Z  2025-03-14T05:44:27.3776909Z  2025-03-14T05:44:27.3777356Z  2025-03-14T05:44:27.3777821Z  2025-03-14T05:44:27.3778470Z [11,574 / 15,235] 48 actions running 2025-03-14T05:44:27.3779192Z Compiling xla/service/hlo_cost_analysis.cc; 10s local 2025-03-14T05:44:27.3780035Z Compiling xla/service/memory_space_assignment/slice.cc; 10s local 2025-03-14T05:44:27.3780994Z Compiling xla/service/heap_simulator/heap_simulator.cc; 10s local 2025-03-14T05:44:27.3781904Z Compiling xla/hlo/utils/hlo_live_range.cc; 10s local 2025-03-14T05:44:27.3782743Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local 2025-03-14T05:44:27.3784028Z Compiling xla/hlo/analysis/hlo_ordering.cc; 10s local 2025-03-14T05:44:27.3784930Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2025-03-14T05:44:27.3785817Z Compiling xla/service/hlo_phi_graph.cc; 10s local ... 2025-03-14T05:44:27.5886913Z 2025-03-14T05:44:27.5887810Z  2025-03-14T05:44:27.5888308Z  2025-03-14T05:44:27.5888718Z  2025-03-14T05:44:27.5889096Z  2025-03-14T05:44:27.5889477Z  2025-03-14T05:44:27.5889843Z  2025-03-14T05:44:27.5890206Z  2025-03-14T05:44:27.5890562Z  2025-03-14T05:44:27.5891113Z [11,576 / 15,235] 48 actions, 47 running 2025-03-14T05:44:27.5891818Z Compiling xla/service/hlo_cost_analysis.cc; 10s local 2025-03-14T05:44:27.5892741Z Compiling xla/service/memory_space_assignment/slice.cc; 10s local 2025-03-14T05:44:27.5893781Z Compiling xla/service/heap_simulator/heap_simulator.cc; 10s local 2025-03-14T05:44:27.5894649Z Compiling xla/hlo/utils/hlo_live_range.cc; 10s local 2025-03-14T05:44:27.5895456Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local 2025-03-14T05:44:27.5896337Z Compiling xla/hlo/analysis/hlo_ordering.cc; 10s local 2025-03-14T05:44:27.5897243Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2025-03-14T05:44:27.5898127Z Compiling xla/service/hlo_phi_graph.cc; 10s local ... 2025-03-14T05:44:27.8222659Z 2025-03-14T05:44:27.8223452Z  2025-03-14T05:44:27.8223910Z  2025-03-14T05:44:27.8224283Z  2025-03-14T05:44:27.8224648Z  2025-03-14T05:44:27.8224993Z  2025-03-14T05:44:27.8225345Z  2025-03-14T05:44:27.8225693Z  2025-03-14T05:44:27.8226044Z  2025-03-14T05:44:27.8226611Z [11,578 / 15,235] 48 actions, 47 running 2025-03-14T05:44:27.8227335Z Compiling xla/service/hlo_cost_analysis.cc; 11s local 2025-03-14T05:44:27.8228118Z Compiling xla/service/memory_space_assignment/slice.cc; 11s local 2025-03-14T05:44:27.8229036Z Compiling xla/service/heap_simulator/heap_simulator.cc; 11s local 2025-03-14T05:44:27.8230152Z Compiling xla/hlo/utils/hlo_live_range.cc; 10s local 2025-03-14T05:44:27.8230902Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local 2025-03-14T05:44:27.8231678Z Compiling xla/hlo/analysis/hlo_ordering.cc; 10s local 2025-03-14T05:44:27.8232464Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2025-03-14T05:44:27.8233248Z Compiling xla/service/hlo_phi_graph.cc; 10s local ... 2025-03-14T05:44:28.0350227Z 2025-03-14T05:44:28.0351101Z  2025-03-14T05:44:28.0351571Z  2025-03-14T05:44:28.0351971Z  2025-03-14T05:44:28.0352369Z  2025-03-14T05:44:28.0352742Z  2025-03-14T05:44:28.0353140Z  2025-03-14T05:44:28.0353517Z  2025-03-14T05:44:28.0353911Z  2025-03-14T05:44:28.0354521Z [11,580 / 15,235] 48 actions, 47 running 2025-03-14T05:44:28.0355293Z Compiling xla/service/hlo_cost_analysis.cc; 11s local 2025-03-14T05:44:28.0356219Z Compiling xla/service/memory_space_assignment/slice.cc; 11s local 2025-03-14T05:44:28.0357209Z Compiling xla/service/heap_simulator/heap_simulator.cc; 11s local 2025-03-14T05:44:28.0358083Z Compiling xla/hlo/utils/hlo_live_range.cc; 11s local 2025-03-14T05:44:28.0358918Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2025-03-14T05:44:28.0359856Z Compiling xla/hlo/analysis/hlo_ordering.cc; 11s local 2025-03-14T05:44:28.0360730Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2025-03-14T05:44:28.0361618Z Compiling xla/service/hlo_phi_graph.cc; 11s local ... 2025-03-14T05:44:28.3782570Z 2025-03-14T05:44:28.3783442Z  2025-03-14T05:44:28.3783929Z  2025-03-14T05:44:28.3784318Z  2025-03-14T05:44:28.3784719Z  2025-03-14T05:44:28.3785124Z  2025-03-14T05:44:28.3785500Z  2025-03-14T05:44:28.3785891Z  2025-03-14T05:44:28.3786288Z  2025-03-14T05:44:28.3787220Z [11,582 / 15,235] 48 actions running 2025-03-14T05:44:28.3788018Z Compiling xla/service/hlo_cost_analysis.cc; 11s local 2025-03-14T05:44:28.3788909Z Compiling xla/service/memory_space_assignment/slice.cc; 11s local 2025-03-14T05:44:28.3789881Z Compiling xla/service/heap_simulator/heap_simulator.cc; 11s local 2025-03-14T05:44:28.3790759Z Compiling xla/hlo/utils/hlo_live_range.cc; 11s local 2025-03-14T05:44:28.3791592Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2025-03-14T05:44:28.3792417Z Compiling xla/hlo/analysis/hlo_ordering.cc; 11s local 2025-03-14T05:44:28.3793270Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2025-03-14T05:44:28.3794136Z Compiling xla/service/hlo_phi_graph.cc; 11s local ... 2025-03-14T05:44:28.7265551Z 2025-03-14T05:44:28.7266391Z  2025-03-14T05:44:28.7266863Z  2025-03-14T05:44:28.7267221Z  2025-03-14T05:44:28.7267586Z  2025-03-14T05:44:28.7267975Z  2025-03-14T05:44:28.7268351Z  2025-03-14T05:44:28.7268783Z  2025-03-14T05:44:28.7269163Z  2025-03-14T05:44:28.7269795Z [11,584 / 15,235] 48 actions, 47 running 2025-03-14T05:44:28.7270580Z Compiling xla/service/hlo_cost_analysis.cc; 12s local 2025-03-14T05:44:28.7271500Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2025-03-14T05:44:28.7272581Z Compiling xla/service/heap_simulator/heap_simulator.cc; 11s local 2025-03-14T05:44:28.7273473Z Compiling xla/hlo/utils/hlo_live_range.cc; 11s local 2025-03-14T05:44:28.7274350Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2025-03-14T05:44:28.7275250Z Compiling xla/hlo/analysis/hlo_ordering.cc; 11s local 2025-03-14T05:44:28.7276100Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2025-03-14T05:44:28.7277008Z Compiling xla/service/hlo_phi_graph.cc; 11s local ... 2025-03-14T05:44:28.9340989Z 2025-03-14T05:44:28.9341962Z  2025-03-14T05:44:28.9342474Z  2025-03-14T05:44:28.9342897Z  2025-03-14T05:44:28.9343332Z  2025-03-14T05:44:28.9343735Z  2025-03-14T05:44:28.9344448Z  2025-03-14T05:44:28.9344805Z  2025-03-14T05:44:28.9345205Z  2025-03-14T05:44:28.9345814Z [11,588 / 15,235] 48 actions, 47 running 2025-03-14T05:44:28.9346903Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2025-03-14T05:44:28.9348100Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local 2025-03-14T05:44:28.9349136Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local 2025-03-14T05:44:28.9349994Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T05:44:28.9350779Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T05:44:28.9351559Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2025-03-14T05:44:28.9352362Z Compiling xla/service/hlo_value.cc; 11s local 2025-03-14T05:44:28.9353093Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local ... 2025-03-14T05:44:29.1787816Z 2025-03-14T05:44:29.1788765Z  2025-03-14T05:44:29.1789259Z  2025-03-14T05:44:29.1789680Z  2025-03-14T05:44:29.1790189Z  2025-03-14T05:44:29.1790609Z  2025-03-14T05:44:29.1791022Z  2025-03-14T05:44:29.1791432Z  2025-03-14T05:44:29.1791835Z  2025-03-14T05:44:29.1792427Z [11,588 / 15,235] 48 actions running 2025-03-14T05:44:29.1793328Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2025-03-14T05:44:29.1794374Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local 2025-03-14T05:44:29.1795271Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local 2025-03-14T05:44:29.1796128Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T05:44:29.1796992Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T05:44:29.1797877Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2025-03-14T05:44:29.1798721Z Compiling xla/service/hlo_value.cc; 12s local 2025-03-14T05:44:29.1799878Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local ... 2025-03-14T05:44:29.3792145Z 2025-03-14T05:44:29.3793007Z  2025-03-14T05:44:29.3793502Z  2025-03-14T05:44:29.3793924Z  2025-03-14T05:44:29.3794319Z  2025-03-14T05:44:29.3794745Z  2025-03-14T05:44:29.3795168Z  2025-03-14T05:44:29.3795594Z  2025-03-14T05:44:29.3796018Z  2025-03-14T05:44:29.3796613Z [11,590 / 15,235] 48 actions running 2025-03-14T05:44:29.3797567Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2025-03-14T05:44:29.3798690Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local 2025-03-14T05:44:29.3799697Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local 2025-03-14T05:44:29.3800597Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T05:44:29.3801562Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T05:44:29.3802509Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2025-03-14T05:44:29.3803415Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2025-03-14T05:44:29.3804251Z Compiling xla/service/call_graph.cc; 11s local ... 2025-03-14T05:44:29.6259500Z 2025-03-14T05:44:29.6260376Z  2025-03-14T05:44:29.6260902Z  2025-03-14T05:44:29.6261335Z  2025-03-14T05:44:29.6261739Z  2025-03-14T05:44:29.6262121Z  2025-03-14T05:44:29.6262527Z  2025-03-14T05:44:29.6262910Z  2025-03-14T05:44:29.6263276Z  2025-03-14T05:44:29.6263853Z [11,595 / 15,235] 48 actions, 47 running 2025-03-14T05:44:29.6264697Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local 2025-03-14T05:44:29.6266071Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local 2025-03-14T05:44:29.6266988Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local 2025-03-14T05:44:29.6267848Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T05:44:29.6268758Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T05:44:29.6270120Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2025-03-14T05:44:29.6270934Z Compiling xla/service/call_graph.cc; 11s local 2025-03-14T05:44:29.6271758Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local ... 2025-03-14T05:44:29.8420838Z 2025-03-14T05:44:29.8421682Z  2025-03-14T05:44:29.8422262Z  2025-03-14T05:44:29.8422801Z  2025-03-14T05:44:29.8423242Z  2025-03-14T05:44:29.8423654Z  2025-03-14T05:44:29.8424084Z  2025-03-14T05:44:29.8424521Z  2025-03-14T05:44:29.8424931Z  2025-03-14T05:44:29.8425528Z [11,598 / 15,235] 48 actions, 47 running 2025-03-14T05:44:29.8426396Z Compiling xla/service/memory_space_assignment/slice.cc; 13s local 2025-03-14T05:44:29.8427417Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2025-03-14T05:44:29.8428325Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local 2025-03-14T05:44:29.8429241Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T05:44:29.8430134Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T05:44:29.8430976Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2025-03-14T05:44:29.8431835Z Compiling xla/service/call_graph.cc; 11s local 2025-03-14T05:44:29.8432624Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local ... 2025-03-14T05:44:30.1674466Z 2025-03-14T05:44:30.1675514Z  2025-03-14T05:44:30.1676038Z  2025-03-14T05:44:30.1676433Z  2025-03-14T05:44:30.1676839Z  2025-03-14T05:44:30.1677253Z  2025-03-14T05:44:30.1677674Z  2025-03-14T05:44:30.1678094Z  2025-03-14T05:44:30.1678489Z  2025-03-14T05:44:30.1679122Z [11,601 / 15,235] 48 actions, 47 running 2025-03-14T05:44:30.1680009Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2025-03-14T05:44:30.1680905Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2025-03-14T05:44:30.1682073Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T05:44:30.1682954Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2025-03-14T05:44:30.1683847Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2025-03-14T05:44:30.1684855Z Compiling xla/service/call_graph.cc; 12s local 2025-03-14T05:44:30.1685630Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2025-03-14T05:44:30.1686654Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local ... 2025-03-14T05:44:30.3800685Z 2025-03-14T05:44:30.3801595Z  2025-03-14T05:44:30.3802098Z  2025-03-14T05:44:30.3802524Z  2025-03-14T05:44:30.3802914Z  2025-03-14T05:44:30.3803301Z  2025-03-14T05:44:30.3803707Z  2025-03-14T05:44:30.3804116Z  2025-03-14T05:44:30.3804500Z  2025-03-14T05:44:30.3805230Z [11,603 / 15,235] 48 actions running 2025-03-14T05:44:30.3806144Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2025-03-14T05:44:30.3807115Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2025-03-14T05:44:30.3808005Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T05:44:30.3808881Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2025-03-14T05:44:30.3809872Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2025-03-14T05:44:30.3810708Z Compiling xla/service/call_graph.cc; 12s local 2025-03-14T05:44:30.3811483Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2025-03-14T05:44:30.3812411Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local ... 2025-03-14T05:44:30.6343036Z 2025-03-14T05:44:30.6343948Z  2025-03-14T05:44:30.6344473Z  2025-03-14T05:44:30.6344917Z  2025-03-14T05:44:30.6345332Z  2025-03-14T05:44:30.6345720Z  2025-03-14T05:44:30.6346119Z  2025-03-14T05:44:30.6346538Z  2025-03-14T05:44:30.6346945Z  2025-03-14T05:44:30.6347608Z [11,604 / 15,235] 48 actions, 47 running 2025-03-14T05:44:30.6348519Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2025-03-14T05:44:30.6349824Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2025-03-14T05:44:30.6350701Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T05:44:30.6351549Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2025-03-14T05:44:30.6352448Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2025-03-14T05:44:30.6353380Z Compiling xla/service/call_graph.cc; 12s local 2025-03-14T05:44:30.6354121Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2025-03-14T05:44:30.6354972Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local ... 2025-03-14T05:44:30.9807831Z 2025-03-14T05:44:30.9808627Z  2025-03-14T05:44:30.9809154Z  2025-03-14T05:44:30.9809478Z  2025-03-14T05:44:30.9809797Z  2025-03-14T05:44:30.9810124Z  2025-03-14T05:44:30.9810445Z  2025-03-14T05:44:30.9810793Z  2025-03-14T05:44:30.9811091Z  2025-03-14T05:44:30.9811573Z [11,604 / 15,235] 48 actions running 2025-03-14T05:44:30.9812268Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2025-03-14T05:44:30.9812992Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2025-03-14T05:44:30.9813658Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T05:44:30.9814336Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local 2025-03-14T05:44:30.9815034Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T05:44:30.9815710Z Compiling xla/service/call_graph.cc; 12s local 2025-03-14T05:44:30.9816295Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2025-03-14T05:44:30.9817025Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local ... 2025-03-14T05:44:31.3473400Z 2025-03-14T05:44:31.3474338Z  2025-03-14T05:44:31.3474859Z  2025-03-14T05:44:31.3475307Z  2025-03-14T05:44:31.3476088Z  2025-03-14T05:44:31.3476548Z  2025-03-14T05:44:31.3476972Z  2025-03-14T05:44:31.3477373Z  2025-03-14T05:44:31.3477764Z  2025-03-14T05:44:31.3478378Z [11,605 / 15,235] 48 actions, 47 running 2025-03-14T05:44:31.3479257Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2025-03-14T05:44:31.3480164Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2025-03-14T05:44:31.3481007Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T05:44:31.3481867Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local 2025-03-14T05:44:31.3482749Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T05:44:31.3483595Z Compiling xla/service/call_graph.cc; 13s local 2025-03-14T05:44:31.3484353Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2025-03-14T05:44:31.3485450Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local ... 2025-03-14T05:44:31.5816600Z 2025-03-14T05:44:31.5817482Z  2025-03-14T05:44:31.5817954Z  2025-03-14T05:44:31.5818368Z  2025-03-14T05:44:31.5818784Z  2025-03-14T05:44:31.5819172Z  2025-03-14T05:44:31.5819554Z  2025-03-14T05:44:31.5819973Z  2025-03-14T05:44:31.5820392Z  2025-03-14T05:44:31.5820984Z [11,605 / 15,235] 48 actions running 2025-03-14T05:44:31.5821901Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2025-03-14T05:44:31.5822762Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2025-03-14T05:44:31.5823557Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T05:44:31.5824434Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local 2025-03-14T05:44:31.5825335Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T05:44:31.5826150Z Compiling xla/service/call_graph.cc; 13s local 2025-03-14T05:44:31.5826878Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2025-03-14T05:44:31.5827977Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local ... 2025-03-14T05:44:31.8792757Z 2025-03-14T05:44:31.8793625Z  2025-03-14T05:44:31.8794143Z  2025-03-14T05:44:31.8794520Z  2025-03-14T05:44:31.8794902Z  2025-03-14T05:44:31.8795272Z  2025-03-14T05:44:31.8795694Z  2025-03-14T05:44:31.8796083Z  2025-03-14T05:44:31.8796495Z  2025-03-14T05:44:31.8797066Z [11,608 / 15,235] 48 actions, 47 running 2025-03-14T05:44:31.8797930Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2025-03-14T05:44:31.8798818Z Compiling xla/hlo/utils/hlo_live_range.cc; 15s local 2025-03-14T05:44:31.8799703Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2025-03-14T05:44:31.8800651Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T05:44:31.8801484Z Compiling xla/service/call_graph.cc; 13s local 2025-03-14T05:44:31.8802214Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2025-03-14T05:44:31.8803116Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2025-03-14T05:44:31.8804045Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local ... 2025-03-14T05:44:32.1824096Z 2025-03-14T05:44:32.1824951Z  2025-03-14T05:44:32.1825452Z  2025-03-14T05:44:32.1825871Z  2025-03-14T05:44:32.1826281Z  2025-03-14T05:44:32.1826691Z  2025-03-14T05:44:32.1827092Z  2025-03-14T05:44:32.1827501Z  2025-03-14T05:44:32.1827900Z  2025-03-14T05:44:32.1828480Z [11,613 / 15,235] 48 actions running 2025-03-14T05:44:32.1829354Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2025-03-14T05:44:32.1830350Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2025-03-14T05:44:32.1831294Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T05:44:32.1832111Z Compiling xla/service/call_graph.cc; 14s local 2025-03-14T05:44:32.1833316Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2025-03-14T05:44:32.1834144Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T05:44:32.1834943Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local 2025-03-14T05:44:32.1835671Z Compiling xla/hlo/ir/hlo_module.cc; 12s local ... 2025-03-14T05:44:32.3828473Z 2025-03-14T05:44:32.3829345Z  2025-03-14T05:44:32.3829850Z  2025-03-14T05:44:32.3830279Z  2025-03-14T05:44:32.3830703Z  2025-03-14T05:44:32.3831116Z  2025-03-14T05:44:32.3831519Z  2025-03-14T05:44:32.3831883Z  2025-03-14T05:44:32.3832279Z  2025-03-14T05:44:32.3832839Z [11,615 / 15,235] 48 actions running 2025-03-14T05:44:32.3833742Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2025-03-14T05:44:32.3834768Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2025-03-14T05:44:32.3835726Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T05:44:32.3836588Z Compiling xla/service/call_graph.cc; 14s local 2025-03-14T05:44:32.3837263Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2025-03-14T05:44:32.3837974Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T05:44:32.3838741Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local 2025-03-14T05:44:32.3839503Z Compiling xla/hlo/ir/hlo_module.cc; 12s local ... 2025-03-14T05:44:32.7833058Z 2025-03-14T05:44:32.7833834Z  2025-03-14T05:44:32.7834237Z  2025-03-14T05:44:32.7834646Z  2025-03-14T05:44:32.7835080Z  2025-03-14T05:44:32.7835483Z  2025-03-14T05:44:32.7835857Z  2025-03-14T05:44:32.7836219Z  2025-03-14T05:44:32.7836629Z  2025-03-14T05:44:32.7837172Z [11,620 / 15,235] 47 actions running 2025-03-14T05:44:32.7838016Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2025-03-14T05:44:32.7839125Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T05:44:32.7839928Z Compiling xla/service/call_graph.cc; 14s local 2025-03-14T05:44:32.7840651Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2025-03-14T05:44:32.7841850Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T05:44:32.7842559Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2025-03-14T05:44:32.7843308Z Compiling xla/hlo/ir/hlo_module.cc; 13s local 2025-03-14T05:44:32.7843999Z Compiling xla/hlo/ir/hlo_schedule.cc; 12s local ... 2025-03-14T05:44:32.9836594Z 2025-03-14T05:44:32.9837373Z  2025-03-14T05:44:32.9837762Z  2025-03-14T05:44:32.9838071Z  2025-03-14T05:44:32.9838384Z  2025-03-14T05:44:32.9838696Z  2025-03-14T05:44:32.9839008Z  2025-03-14T05:44:32.9839318Z  2025-03-14T05:44:32.9839628Z  2025-03-14T05:44:32.9840070Z [11,621 / 15,235] 48 actions running 2025-03-14T05:44:32.9840744Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2025-03-14T05:44:32.9841576Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T05:44:32.9842319Z Compiling xla/service/call_graph.cc; 14s local 2025-03-14T05:44:32.9842975Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2025-03-14T05:44:32.9843576Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T05:44:32.9844183Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2025-03-14T05:44:32.9845051Z Compiling xla/hlo/ir/hlo_module.cc; 13s local 2025-03-14T05:44:32.9845663Z Compiling xla/hlo/ir/hlo_schedule.cc; 12s local ... 2025-03-14T05:44:33.1857801Z 2025-03-14T05:44:33.1858662Z  2025-03-14T05:44:33.1859143Z  2025-03-14T05:44:33.1859537Z  2025-03-14T05:44:33.1859911Z  2025-03-14T05:44:33.1860305Z  2025-03-14T05:44:33.1860708Z  2025-03-14T05:44:33.1861076Z  2025-03-14T05:44:33.1861460Z  2025-03-14T05:44:33.1862052Z [11,625 / 15,235] 48 actions, 47 running 2025-03-14T05:44:33.1862873Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2025-03-14T05:44:33.1864222Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T05:44:33.1865156Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T05:44:33.1866129Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T05:44:33.1866842Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T05:44:33.1867553Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2025-03-14T05:44:33.1868230Z Compiling xla/hlo/ir/hlo_module.cc; 13s local 2025-03-14T05:44:33.1868976Z Compiling xla/hlo/ir/hlo_schedule.cc; 12s local ... 2025-03-14T05:44:33.5273275Z 2025-03-14T05:44:33.5274144Z  2025-03-14T05:44:33.5274634Z  2025-03-14T05:44:33.5275125Z  2025-03-14T05:44:33.5275533Z  2025-03-14T05:44:33.5275927Z  2025-03-14T05:44:33.5276352Z  2025-03-14T05:44:33.5276769Z  2025-03-14T05:44:33.5277142Z  2025-03-14T05:44:33.5277725Z [11,629 / 15,235] 48 actions, 47 running 2025-03-14T05:44:33.5278605Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2025-03-14T05:44:33.5279572Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T05:44:33.5280438Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T05:44:33.5281233Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T05:44:33.5282028Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T05:44:33.5282885Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T05:44:33.5283643Z Compiling xla/hlo/ir/hlo_module.cc; 13s local 2025-03-14T05:44:33.5284439Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local ... 2025-03-14T05:44:33.7844524Z 2025-03-14T05:44:33.7845512Z  2025-03-14T05:44:33.7845995Z  2025-03-14T05:44:33.7846388Z  2025-03-14T05:44:33.7846804Z  2025-03-14T05:44:33.7847214Z  2025-03-14T05:44:33.7847607Z  2025-03-14T05:44:33.7847998Z  2025-03-14T05:44:33.7848401Z  2025-03-14T05:44:33.7849015Z [11,635 / 15,235] 48 actions running 2025-03-14T05:44:33.7850386Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T05:44:33.7851485Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T05:44:33.7852390Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T05:44:33.7853185Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T05:44:33.7863515Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T05:44:33.7864323Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T05:44:33.7865093Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T05:44:33.7866069Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local ... 2025-03-14T05:44:33.9848277Z 2025-03-14T05:44:33.9849081Z  2025-03-14T05:44:33.9849525Z  2025-03-14T05:44:33.9849911Z  2025-03-14T05:44:33.9850314Z  2025-03-14T05:44:33.9850718Z  2025-03-14T05:44:33.9851144Z  2025-03-14T05:44:33.9851588Z  2025-03-14T05:44:33.9852021Z  2025-03-14T05:44:33.9852640Z [11,636 / 15,235] 48 actions running 2025-03-14T05:44:33.9853568Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T05:44:33.9854603Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T05:44:33.9855519Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T05:44:33.9856282Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T05:44:33.9857193Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T05:44:33.9858009Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T05:44:33.9858759Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T05:44:33.9859490Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local ... 2025-03-14T05:44:34.2234243Z 2025-03-14T05:44:34.2235100Z  2025-03-14T05:44:34.2235574Z  2025-03-14T05:44:34.2235991Z  2025-03-14T05:44:34.2236400Z  2025-03-14T05:44:34.2237157Z  2025-03-14T05:44:34.2237600Z  2025-03-14T05:44:34.2238027Z  2025-03-14T05:44:34.2238445Z  2025-03-14T05:44:34.2239108Z [11,640 / 15,235] 48 actions, 47 running 2025-03-14T05:44:34.2240116Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T05:44:34.2241177Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T05:44:34.2242041Z Compiling xla/service/call_graph.cc; 16s local 2025-03-14T05:44:34.2242852Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T05:44:34.2243687Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T05:44:34.2244500Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T05:44:34.2245446Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T05:44:34.2246206Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local ... 2025-03-14T05:44:34.4638112Z 2025-03-14T05:44:34.4638982Z  2025-03-14T05:44:34.4639515Z  2025-03-14T05:44:34.4640000Z  2025-03-14T05:44:34.4640428Z  2025-03-14T05:44:34.4640867Z  2025-03-14T05:44:34.4641258Z  2025-03-14T05:44:34.4641651Z  2025-03-14T05:44:34.4642085Z  2025-03-14T05:44:34.4642764Z [11,642 / 15,235] 48 actions, 47 running 2025-03-14T05:44:34.4643637Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T05:44:34.4644812Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T05:44:34.4645644Z Compiling xla/service/call_graph.cc; 16s local 2025-03-14T05:44:34.4646441Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T05:44:34.4647224Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T05:44:34.4648034Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T05:44:34.4648820Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T05:44:34.4649571Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2025-03-14T05:44:34.6851525Z 2025-03-14T05:44:34.6852439Z  2025-03-14T05:44:34.6852931Z  2025-03-14T05:44:34.6853686Z  2025-03-14T05:44:34.6854096Z  2025-03-14T05:44:34.6854511Z  2025-03-14T05:44:34.6854924Z  2025-03-14T05:44:34.6855383Z  2025-03-14T05:44:34.6855905Z  2025-03-14T05:44:34.6856636Z [11,648 / 15,235] 48 actions, 47 running 2025-03-14T05:44:34.6857542Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T05:44:34.6858569Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T05:44:34.6859462Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T05:44:34.6860299Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T05:44:34.6861102Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T05:44:34.6861863Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T05:44:34.6862595Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local 2025-03-14T05:44:34.6863369Z Compiling xla/literal_util.cc; 13s local ... 2025-03-14T05:44:34.8937402Z 2025-03-14T05:44:34.8938305Z  2025-03-14T05:44:34.8938854Z  2025-03-14T05:44:34.8939303Z  2025-03-14T05:44:34.8939731Z  2025-03-14T05:44:34.8940179Z  2025-03-14T05:44:34.8940609Z  2025-03-14T05:44:34.8941039Z  2025-03-14T05:44:34.8941470Z  2025-03-14T05:44:34.8942127Z [11,650 / 15,235] 48 actions, 47 running 2025-03-14T05:44:34.8943107Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T05:44:34.8944219Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T05:44:34.8945190Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T05:44:34.8946049Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T05:44:34.8946915Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T05:44:34.8947737Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2025-03-14T05:44:34.8948881Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local 2025-03-14T05:44:34.8949671Z Compiling xla/literal_util.cc; 13s local ... 2025-03-14T05:44:35.1358333Z 2025-03-14T05:44:35.1359340Z  2025-03-14T05:44:35.1360043Z  2025-03-14T05:44:35.1360592Z  2025-03-14T05:44:35.1361034Z  2025-03-14T05:44:35.1361620Z  2025-03-14T05:44:35.1362199Z  2025-03-14T05:44:35.1362623Z  2025-03-14T05:44:35.1363060Z  2025-03-14T05:44:35.1363703Z [11,657 / 15,235] 48 actions, 47 running 2025-03-14T05:44:35.1364737Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T05:44:35.1365998Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T05:44:35.1366941Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T05:44:35.1367758Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T05:44:35.1368577Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T05:44:35.1369419Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2025-03-14T05:44:35.1370187Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local 2025-03-14T05:44:35.1370940Z Compiling xla/literal_util.cc; 13s local ... 2025-03-14T05:44:35.3855061Z 2025-03-14T05:44:35.3856149Z  2025-03-14T05:44:35.3856946Z  2025-03-14T05:44:35.3857694Z  2025-03-14T05:44:35.3858894Z  2025-03-14T05:44:35.3859620Z  2025-03-14T05:44:35.3860238Z  2025-03-14T05:44:35.3860718Z  2025-03-14T05:44:35.3861355Z  2025-03-14T05:44:35.3861987Z [11,659 / 15,235] 48 actions running 2025-03-14T05:44:35.3862923Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T05:44:35.3864001Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T05:44:35.3864959Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T05:44:35.3867495Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T05:44:35.3868387Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T05:44:35.3869174Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2025-03-14T05:44:35.3870329Z Compiling xla/hlo/ir/hlo_schedule.cc; 15s local 2025-03-14T05:44:35.3871093Z Compiling xla/literal_util.cc; 14s local ... 2025-03-14T05:44:35.5982259Z 2025-03-14T05:44:35.5983087Z  2025-03-14T05:44:35.5983573Z  2025-03-14T05:44:35.5983982Z  2025-03-14T05:44:35.5984381Z  2025-03-14T05:44:35.5984772Z  2025-03-14T05:44:35.5985153Z  2025-03-14T05:44:35.5985553Z  2025-03-14T05:44:35.5985950Z  2025-03-14T05:44:35.5986569Z [11,662 / 15,235] 48 actions, 47 running 2025-03-14T05:44:35.5987427Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T05:44:35.5988413Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T05:44:35.5989283Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T05:44:35.5990076Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T05:44:35.5990853Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T05:44:35.5991614Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2025-03-14T05:44:35.5992299Z Compiling xla/literal_util.cc; 14s local 2025-03-14T05:44:35.5992940Z Compiling xla/literal.cc; 11s local ... 2025-03-14T05:44:35.8017619Z 2025-03-14T05:44:35.8018455Z  2025-03-14T05:44:35.8019069Z  2025-03-14T05:44:35.8019483Z  2025-03-14T05:44:35.8019851Z  2025-03-14T05:44:35.8020251Z  2025-03-14T05:44:35.8020644Z  2025-03-14T05:44:35.8021040Z  2025-03-14T05:44:35.8021472Z  2025-03-14T05:44:35.8022160Z [11,668 / 15,235] 48 actions, 46 running 2025-03-14T05:44:35.8023219Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T05:44:35.8024432Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T05:44:35.8025501Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T05:44:35.8026771Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T05:44:35.8027686Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T05:44:35.8028468Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T05:44:35.8029172Z Compiling xla/literal_util.cc; 14s local 2025-03-14T05:44:35.8029924Z Compiling xla/literal.cc; 12s local ... 2025-03-14T05:44:36.0475520Z 2025-03-14T05:44:36.0476402Z  2025-03-14T05:44:36.0476901Z  2025-03-14T05:44:36.0477312Z  2025-03-14T05:44:36.0477739Z  2025-03-14T05:44:36.0478162Z  2025-03-14T05:44:36.0478584Z  2025-03-14T05:44:36.0478995Z  2025-03-14T05:44:36.0479380Z  2025-03-14T05:44:36.0480002Z [11,673 / 15,235] 48 actions, 47 running 2025-03-14T05:44:36.0480911Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T05:44:36.0481948Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2025-03-14T05:44:36.0482816Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T05:44:36.0483662Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T05:44:36.0484454Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T05:44:36.0485373Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T05:44:36.0486071Z Compiling xla/literal_util.cc; 14s local 2025-03-14T05:44:36.0486737Z Compiling xla/literal.cc; 12s local ... 2025-03-14T05:44:36.2587840Z 2025-03-14T05:44:36.2588705Z  2025-03-14T05:44:36.2589236Z  2025-03-14T05:44:36.2589654Z  2025-03-14T05:44:36.2590082Z  2025-03-14T05:44:36.2590507Z  2025-03-14T05:44:36.2590906Z  2025-03-14T05:44:36.2591355Z  2025-03-14T05:44:36.2591764Z  2025-03-14T05:44:36.2592412Z [11,684 / 15,235] 48 actions, 47 running 2025-03-14T05:44:36.2593326Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T05:44:36.2594326Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T05:44:36.2595142Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T05:44:36.2596346Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T05:44:36.2597116Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T05:44:36.2597794Z Compiling xla/literal.cc; 12s local 2025-03-14T05:44:36.2598536Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T05:44:36.2599385Z Compiling xla/debug_options_flags.cc; 9s local ... 2025-03-14T05:44:36.4699241Z 2025-03-14T05:44:36.4700129Z  2025-03-14T05:44:36.4700596Z  2025-03-14T05:44:36.4700978Z  2025-03-14T05:44:36.4701333Z  2025-03-14T05:44:36.4701719Z  2025-03-14T05:44:36.4702109Z  2025-03-14T05:44:36.4702514Z  2025-03-14T05:44:36.4702985Z  2025-03-14T05:44:36.4703600Z [11,690 / 15,235] 48 actions, 47 running 2025-03-14T05:44:36.4704438Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T05:44:36.4705383Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T05:44:36.4706139Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T05:44:36.4706884Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T05:44:36.4707614Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T05:44:36.4708275Z Compiling xla/literal.cc; 12s local 2025-03-14T05:44:36.4709005Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T05:44:36.4709814Z Compiling xla/debug_options_flags.cc; 10s local ... 2025-03-14T05:44:36.6972784Z 2025-03-14T05:44:36.6973652Z  2025-03-14T05:44:36.6974165Z  2025-03-14T05:44:36.6974600Z  2025-03-14T05:44:36.6975033Z  2025-03-14T05:44:36.6975445Z  2025-03-14T05:44:36.6975855Z  2025-03-14T05:44:36.6976274Z  2025-03-14T05:44:36.6976687Z  2025-03-14T05:44:36.6977319Z [11,702 / 15,235] 48 actions, 47 running 2025-03-14T05:44:36.6978567Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T05:44:36.6979557Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T05:44:36.6980368Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T05:44:36.6981202Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T05:44:36.6981986Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T05:44:36.6982690Z Compiling xla/literal.cc; 12s local 2025-03-14T05:44:36.6983435Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T05:44:36.6984312Z Compiling xla/debug_options_flags.cc; 10s local ... 2025-03-14T05:44:36.9202786Z 2025-03-14T05:44:36.9204284Z  2025-03-14T05:44:36.9205129Z  2025-03-14T05:44:36.9205755Z  2025-03-14T05:44:36.9206882Z  2025-03-14T05:44:36.9207379Z  2025-03-14T05:44:36.9207837Z  2025-03-14T05:44:36.9208285Z  2025-03-14T05:44:36.9208742Z  2025-03-14T05:44:36.9209456Z [11,714 / 15,235] 48 actions, 47 running 2025-03-14T05:44:36.9210438Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T05:44:36.9211490Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T05:44:36.9212334Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T05:44:36.9213205Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T05:44:36.9214020Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T05:44:36.9214767Z Compiling xla/literal.cc; 13s local 2025-03-14T05:44:36.9215540Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T05:44:36.9216448Z Compiling xla/debug_options_flags.cc; 10s local ... 2025-03-14T05:44:37.1208994Z 2025-03-14T05:44:37.1209921Z  2025-03-14T05:44:37.1210712Z  2025-03-14T05:44:37.1211285Z  2025-03-14T05:44:37.1211862Z  2025-03-14T05:44:37.1212425Z  2025-03-14T05:44:37.1212980Z  2025-03-14T05:44:37.1213541Z  2025-03-14T05:44:37.1214086Z  2025-03-14T05:44:37.1214878Z [11,720 / 15,235] 48 actions, 47 running 2025-03-14T05:44:37.1216389Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T05:44:37.1217489Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T05:44:37.1218438Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T05:44:37.1219369Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T05:44:37.1220268Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T05:44:37.1221063Z Compiling xla/literal.cc; 13s local 2025-03-14T05:44:37.1221958Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T05:44:37.1223031Z Compiling xla/debug_options_flags.cc; 10s local ... 2025-03-14T05:44:37.3868868Z 2025-03-14T05:44:37.3869736Z  2025-03-14T05:44:37.3870241Z  2025-03-14T05:44:37.3870642Z  2025-03-14T05:44:37.3871042Z  2025-03-14T05:44:37.3871464Z  2025-03-14T05:44:37.3871882Z  2025-03-14T05:44:37.3872320Z  2025-03-14T05:44:37.3872739Z  2025-03-14T05:44:37.3873375Z [11,721 / 15,235] 48 actions running 2025-03-14T05:44:37.3874274Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T05:44:37.3875227Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T05:44:37.3876224Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T05:44:37.3877216Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T05:44:37.3878042Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T05:44:37.3878754Z Compiling xla/literal.cc; 13s local 2025-03-14T05:44:37.3879513Z Compiling src/google/protobuf/descriptor.cc; 12s local 2025-03-14T05:44:37.3880370Z Compiling xla/debug_options_flags.cc; 11s local ... 2025-03-14T05:44:37.5873314Z 2025-03-14T05:44:37.5874124Z  2025-03-14T05:44:37.5874630Z  2025-03-14T05:44:37.5875070Z  2025-03-14T05:44:37.5875500Z  2025-03-14T05:44:37.5875927Z  2025-03-14T05:44:37.5876699Z  2025-03-14T05:44:37.5877121Z  2025-03-14T05:44:37.5877506Z  2025-03-14T05:44:37.5878094Z [11,724 / 15,235] 48 actions running 2025-03-14T05:44:37.5879010Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T05:44:37.5879974Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T05:44:37.5880813Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T05:44:37.5881632Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T05:44:37.5882436Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T05:44:37.5883151Z Compiling xla/literal.cc; 13s local 2025-03-14T05:44:37.5883937Z Compiling src/google/protobuf/descriptor.cc; 12s local 2025-03-14T05:44:37.5884976Z Compiling xla/debug_options_flags.cc; 11s local ... 2025-03-14T05:44:37.8976748Z 2025-03-14T05:44:37.8977599Z  2025-03-14T05:44:37.8978134Z  2025-03-14T05:44:37.8978551Z  2025-03-14T05:44:37.8978993Z  2025-03-14T05:44:37.8979416Z  2025-03-14T05:44:37.8979854Z  2025-03-14T05:44:37.8980252Z  2025-03-14T05:44:37.8980660Z  2025-03-14T05:44:37.8981198Z [11,730 / 15,235] 48 actions, 47 running 2025-03-14T05:44:37.8982065Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T05:44:37.8982962Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T05:44:37.8983720Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T05:44:37.8984479Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T05:44:37.8985232Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T05:44:37.8985925Z Compiling xla/literal.cc; 14s local 2025-03-14T05:44:37.8986661Z Compiling src/google/protobuf/descriptor.cc; 12s local 2025-03-14T05:44:37.8987504Z Compiling xla/debug_options_flags.cc; 11s local ... 2025-03-14T05:44:38.1221421Z 2025-03-14T05:44:38.1222240Z  2025-03-14T05:44:38.1222741Z  2025-03-14T05:44:38.1223145Z  2025-03-14T05:44:38.1223851Z  2025-03-14T05:44:38.1224225Z  2025-03-14T05:44:38.1224605Z  2025-03-14T05:44:38.1224992Z  2025-03-14T05:44:38.1225369Z  2025-03-14T05:44:38.1225925Z [11,736 / 15,235] 48 actions, 47 running 2025-03-14T05:44:38.1226757Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T05:44:38.1227604Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T05:44:38.1228292Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T05:44:38.1229071Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T05:44:38.1229940Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T05:44:38.1230639Z Compiling xla/literal.cc; 14s local 2025-03-14T05:44:38.1231375Z Compiling src/google/protobuf/descriptor.cc; 12s local 2025-03-14T05:44:38.1232137Z Compiling xla/debug_options_flags.cc; 11s local ... 2025-03-14T05:44:38.3873763Z 2025-03-14T05:44:38.3874672Z  2025-03-14T05:44:38.3875180Z  2025-03-14T05:44:38.3875611Z  2025-03-14T05:44:38.3876014Z  2025-03-14T05:44:38.3876414Z  2025-03-14T05:44:38.3876806Z  2025-03-14T05:44:38.3877221Z  2025-03-14T05:44:38.3877619Z  2025-03-14T05:44:38.3878221Z [11,741 / 15,235] 48 actions, 47 running 2025-03-14T05:44:38.3879090Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T05:44:38.3880004Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T05:44:38.3880768Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T05:44:38.3881582Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T05:44:38.3882292Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T05:44:38.3882939Z Compiling xla/literal.cc; 14s local 2025-03-14T05:44:38.3883570Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T05:44:38.3884978Z Compiling xla/debug_options_flags.cc; 12s local ... 2025-03-14T05:44:38.5879707Z 2025-03-14T05:44:38.5880527Z  2025-03-14T05:44:38.5881048Z  2025-03-14T05:44:38.5881495Z  2025-03-14T05:44:38.5881936Z  2025-03-14T05:44:38.5882370Z  2025-03-14T05:44:38.5882800Z  2025-03-14T05:44:38.5883240Z  2025-03-14T05:44:38.5883664Z  2025-03-14T05:44:38.5884269Z [11,749 / 15,235] 48 actions running 2025-03-14T05:44:38.5885338Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T05:44:38.5886333Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T05:44:38.5887173Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T05:44:38.5888024Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T05:44:38.5888830Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T05:44:38.5889520Z Compiling xla/literal.cc; 14s local 2025-03-14T05:44:38.5890282Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T05:44:38.5891175Z Compiling xla/debug_options_flags.cc; 12s local ... 2025-03-14T05:44:38.7884011Z 2025-03-14T05:44:38.7885000Z  2025-03-14T05:44:38.7885510Z  2025-03-14T05:44:38.7885944Z  2025-03-14T05:44:38.7886364Z  2025-03-14T05:44:38.7886789Z  2025-03-14T05:44:38.7887224Z  2025-03-14T05:44:38.7887622Z  2025-03-14T05:44:38.7887985Z  2025-03-14T05:44:38.7888550Z [11,757 / 15,235] 48 actions running 2025-03-14T05:44:38.7889439Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T05:44:38.7890397Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T05:44:38.7891182Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T05:44:38.7892004Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T05:44:38.7892792Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T05:44:38.7893492Z Compiling xla/literal.cc; 15s local 2025-03-14T05:44:38.7894263Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T05:44:38.7895411Z Compiling xla/debug_options_flags.cc; 12s local ... 2025-03-14T05:44:39.0166309Z 2025-03-14T05:44:39.0167257Z  2025-03-14T05:44:39.0167739Z  2025-03-14T05:44:39.0168155Z  2025-03-14T05:44:39.0168580Z  2025-03-14T05:44:39.0169003Z  2025-03-14T05:44:39.0169462Z  2025-03-14T05:44:39.0169875Z  2025-03-14T05:44:39.0170321Z  2025-03-14T05:44:39.0170955Z [11,763 / 15,235] 48 actions, 47 running 2025-03-14T05:44:39.0171866Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T05:44:39.0172722Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T05:44:39.0173534Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T05:44:39.0174300Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T05:44:39.0175074Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T05:44:39.0175772Z Compiling xla/literal.cc; 15s local 2025-03-14T05:44:39.0176471Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T05:44:39.0177294Z Compiling xla/debug_options_flags.cc; 12s local ... 2025-03-14T05:44:39.2180827Z 2025-03-14T05:44:39.2181696Z  2025-03-14T05:44:39.2182172Z  2025-03-14T05:44:39.2182583Z  2025-03-14T05:44:39.2182973Z  2025-03-14T05:44:39.2183381Z  2025-03-14T05:44:39.2183792Z  2025-03-14T05:44:39.2184201Z  2025-03-14T05:44:39.2184648Z  2025-03-14T05:44:39.2185284Z [11,771 / 15,235] 48 actions, 47 running 2025-03-14T05:44:39.2186204Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T05:44:39.2187144Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T05:44:39.2187958Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T05:44:39.2188763Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T05:44:39.2189886Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T05:44:39.2190617Z Compiling xla/literal.cc; 15s local 2025-03-14T05:44:39.2191419Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T05:44:39.2192314Z Compiling xla/debug_options_flags.cc; 12s local ... 2025-03-14T05:44:39.4325648Z 2025-03-14T05:44:39.4326539Z  2025-03-14T05:44:39.4327041Z  2025-03-14T05:44:39.4327447Z  2025-03-14T05:44:39.4327891Z  2025-03-14T05:44:39.4328328Z  2025-03-14T05:44:39.4328729Z  2025-03-14T05:44:39.4329148Z  2025-03-14T05:44:39.4329535Z  2025-03-14T05:44:39.4330160Z [11,779 / 15,235] 48 actions, 47 running 2025-03-14T05:44:39.4331095Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T05:44:39.4332019Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T05:44:39.4332848Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T05:44:39.4333679Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T05:44:39.4334508Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T05:44:39.4335227Z Compiling xla/literal.cc; 15s local 2025-03-14T05:44:39.4335958Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T05:44:39.4336784Z Compiling xla/debug_options_flags.cc; 13s local ... 2025-03-14T05:44:39.7017466Z 2025-03-14T05:44:39.7018384Z  2025-03-14T05:44:39.7018946Z  2025-03-14T05:44:39.7019399Z  2025-03-14T05:44:39.7019874Z  2025-03-14T05:44:39.7020343Z  2025-03-14T05:44:39.7020798Z  2025-03-14T05:44:39.7021232Z  2025-03-14T05:44:39.7021657Z  2025-03-14T05:44:39.7022412Z [11,784 / 15,235] 48 actions, 47 running 2025-03-14T05:44:39.7023580Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T05:44:39.7024556Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T05:44:39.7025385Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T05:44:39.7026187Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T05:44:39.7027312Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T05:44:39.7027989Z Compiling xla/literal.cc; 15s local 2025-03-14T05:44:39.7028661Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T05:44:39.7029489Z Compiling xla/debug_options_flags.cc; 13s local ... 2025-03-14T05:44:39.9030557Z 2025-03-14T05:44:39.9031396Z  2025-03-14T05:44:39.9031893Z  2025-03-14T05:44:39.9032287Z  2025-03-14T05:44:39.9032713Z  2025-03-14T05:44:39.9033166Z  2025-03-14T05:44:39.9033585Z  2025-03-14T05:44:39.9033992Z  2025-03-14T05:44:39.9034369Z  2025-03-14T05:44:39.9034978Z [11,795 / 15,235] 48 actions, 47 running 2025-03-14T05:44:39.9035819Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T05:44:39.9036630Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T05:44:39.9037416Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T05:44:39.9038157Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T05:44:39.9038929Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T05:44:39.9039586Z Compiling xla/literal.cc; 16s local 2025-03-14T05:44:39.9040290Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T05:44:39.9041067Z Compiling xla/debug_options_flags.cc; 13s local ... 2025-03-14T05:44:40.1112595Z 2025-03-14T05:44:40.1113435Z  2025-03-14T05:44:40.1113923Z  2025-03-14T05:44:40.1114333Z  2025-03-14T05:44:40.1114735Z  2025-03-14T05:44:40.1115208Z  2025-03-14T05:44:40.1115617Z  2025-03-14T05:44:40.1116047Z  2025-03-14T05:44:40.1116443Z  2025-03-14T05:44:40.1117092Z [11,808 / 15,235] 48 actions, 47 running 2025-03-14T05:44:40.1117950Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T05:44:40.1119263Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T05:44:40.1120123Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T05:44:40.1120990Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T05:44:40.1121780Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T05:44:40.1122483Z Compiling xla/literal.cc; 16s local 2025-03-14T05:44:40.1123243Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T05:44:40.1124065Z Compiling xla/debug_options_flags.cc; 13s local ... 2025-03-14T05:44:40.3168207Z 2025-03-14T05:44:40.3169077Z  2025-03-14T05:44:40.3169598Z  2025-03-14T05:44:40.3170018Z  2025-03-14T05:44:40.3170430Z  2025-03-14T05:44:40.3170854Z  2025-03-14T05:44:40.3171279Z  2025-03-14T05:44:40.3171656Z  2025-03-14T05:44:40.3172067Z  2025-03-14T05:44:40.3172708Z [11,812 / 15,235] 48 actions, 47 running 2025-03-14T05:44:40.3173595Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T05:44:40.3174543Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T05:44:40.3175340Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T05:44:40.3176121Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T05:44:40.3176835Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T05:44:40.3177499Z Compiling xla/literal.cc; 16s local 2025-03-14T05:44:40.3178173Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T05:44:40.3178957Z Compiling xla/debug_options_flags.cc; 14s local ... 2025-03-14T05:44:40.5668077Z 2025-03-14T05:44:40.5668909Z  2025-03-14T05:44:40.5669423Z  2025-03-14T05:44:40.5669847Z  2025-03-14T05:44:40.5670280Z  2025-03-14T05:44:40.5670692Z  2025-03-14T05:44:40.5671095Z  2025-03-14T05:44:40.5671500Z  2025-03-14T05:44:40.5671896Z  2025-03-14T05:44:40.5672523Z [11,825 / 15,235] 48 actions, 47 running 2025-03-14T05:44:40.5673499Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T05:44:40.5674816Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T05:44:40.5675604Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T05:44:40.5676400Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T05:44:40.5677161Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T05:44:40.5677847Z Compiling xla/literal.cc; 16s local 2025-03-14T05:44:40.5678538Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T05:44:40.5679389Z Compiling xla/debug_options_flags.cc; 14s local ... 2025-03-14T05:44:40.7766409Z 2025-03-14T05:44:40.7767330Z  2025-03-14T05:44:40.7767822Z  2025-03-14T05:44:40.7768238Z  2025-03-14T05:44:40.7768669Z  2025-03-14T05:44:40.7769069Z  2025-03-14T05:44:40.7769590Z  2025-03-14T05:44:40.7769997Z  2025-03-14T05:44:40.7770566Z  2025-03-14T05:44:40.7771209Z [11,833 / 15,235] 48 actions, 47 running 2025-03-14T05:44:40.7772085Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T05:44:40.7773025Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T05:44:40.7773811Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T05:44:40.7774605Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T05:44:40.7775374Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T05:44:40.7776064Z Compiling xla/literal.cc; 17s local 2025-03-14T05:44:40.7776786Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T05:44:40.7777768Z Compiling absl/time/internal/cctz/src/time_zone_info.cc; 2s local ... 2025-03-14T05:44:40.9897946Z 2025-03-14T05:44:40.9899034Z  2025-03-14T05:44:40.9899840Z  2025-03-14T05:44:40.9900594Z  2025-03-14T05:44:40.9901206Z  2025-03-14T05:44:40.9901648Z  2025-03-14T05:44:40.9902092Z  2025-03-14T05:44:40.9902538Z  2025-03-14T05:44:40.9902981Z  2025-03-14T05:44:40.9903961Z [11,838 / 15,235] 48 actions running 2025-03-14T05:44:40.9904839Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T05:44:40.9905708Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T05:44:40.9906495Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T05:44:40.9907230Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T05:44:40.9907930Z Compiling xla/literal.cc; 17s local 2025-03-14T05:44:40.9908616Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T05:44:40.9909568Z Compiling absl/time/internal/cctz/src/time_zone_info.cc; 2s local 2025-03-14T05:44:40.9910605Z @xla//xla/hlo/transforms:simplify_fp_conversions; 2s local ... 2025-03-14T05:44:41.1902264Z 2025-03-14T05:44:41.1903386Z  2025-03-14T05:44:41.1904167Z  2025-03-14T05:44:41.1904865Z  2025-03-14T05:44:41.1905592Z  2025-03-14T05:44:41.1905996Z  2025-03-14T05:44:41.1906489Z  2025-03-14T05:44:41.1906926Z  2025-03-14T05:44:41.1907390Z  2025-03-14T05:44:41.1908021Z [11,840 / 15,235] 48 actions running 2025-03-14T05:44:41.1908836Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T05:44:41.1909715Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T05:44:41.1910513Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T05:44:41.1911242Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T05:44:41.1911925Z Compiling xla/literal.cc; 17s local 2025-03-14T05:44:41.1912661Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T05:44:41.1913688Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 2s local 2025-03-14T05:44:41.1914888Z Compiling llvm/utils/TableGen/CTagsEmitter.cpp [for tool]; 1s local ... 2025-03-14T05:44:41.4413897Z 2025-03-14T05:44:41.4414998Z  2025-03-14T05:44:41.4415726Z  2025-03-14T05:44:41.4416457Z  2025-03-14T05:44:41.4417160Z  2025-03-14T05:44:41.4418008Z  2025-03-14T05:44:41.4418457Z  2025-03-14T05:44:41.4418908Z  2025-03-14T05:44:41.4419351Z  2025-03-14T05:44:41.4419926Z [11,845 / 15,235] 48 actions, 47 running 2025-03-14T05:44:41.4420754Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T05:44:41.4421573Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T05:44:41.4422322Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T05:44:41.4423030Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T05:44:41.4423637Z Compiling xla/literal.cc; 17s local 2025-03-14T05:44:41.4424456Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 2s local 2025-03-14T05:44:41.4425522Z Compiling llvm/utils/TableGen/CTagsEmitter.cpp [for tool]; 1s local 2025-03-14T05:44:41.4426394Z Compiling src/google/protobuf/any.pb.cc; 1s local ... 2025-03-14T05:44:41.6968088Z 2025-03-14T05:44:41.6969069Z  2025-03-14T05:44:41.6969615Z  2025-03-14T05:44:41.6970103Z  2025-03-14T05:44:41.6970550Z  2025-03-14T05:44:41.6970981Z  2025-03-14T05:44:41.6971315Z  2025-03-14T05:44:41.6971716Z  2025-03-14T05:44:41.6972107Z  2025-03-14T05:44:41.6972717Z [11,849 / 15,235] 48 actions, 47 running 2025-03-14T05:44:41.6973602Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T05:44:41.6974533Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T05:44:41.6975338Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T05:44:41.6976052Z Compiling xla/literal.cc; 17s local 2025-03-14T05:44:41.6976962Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 2s local 2025-03-14T05:44:41.6978172Z Compiling llvm/utils/TableGen/CTagsEmitter.cpp [for tool]; 1s local 2025-03-14T05:44:41.6979172Z Compiling src/google/protobuf/api.pb.cc; 1s local 2025-03-14T05:44:41.6980412Z Compiling src/google/protobuf/compiler/importer.cc; 1s local ... 2025-03-14T05:44:41.9416648Z 2025-03-14T05:44:41.9417533Z  2025-03-14T05:44:41.9418095Z  2025-03-14T05:44:41.9418545Z  2025-03-14T05:44:41.9418987Z  2025-03-14T05:44:41.9419428Z  2025-03-14T05:44:41.9419827Z  2025-03-14T05:44:41.9420196Z  2025-03-14T05:44:41.9420592Z  2025-03-14T05:44:41.9421181Z [11,851 / 15,235] 48 actions, 47 running 2025-03-14T05:44:41.9422075Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T05:44:41.9423050Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T05:44:41.9423882Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T05:44:41.9424648Z Compiling xla/literal.cc; 18s local 2025-03-14T05:44:41.9425564Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 2s local 2025-03-14T05:44:41.9426635Z Compiling src/google/protobuf/api.pb.cc; 1s local 2025-03-14T05:44:41.9427578Z Compiling src/google/protobuf/compiler/importer.cc; 1s local 2025-03-14T05:44:41.9428530Z Compiling src/google/protobuf/compiler/parser.cc; 1s local ... 2025-03-14T05:44:42.1778654Z 2025-03-14T05:44:42.1782393Z  2025-03-14T05:44:42.1783069Z  2025-03-14T05:44:42.1783658Z  2025-03-14T05:44:42.1784045Z  2025-03-14T05:44:42.1784495Z  2025-03-14T05:44:42.1784959Z  2025-03-14T05:44:42.1785412Z  2025-03-14T05:44:42.1785849Z  2025-03-14T05:44:42.1786440Z [11,853 / 15,235] 48 actions, 47 running 2025-03-14T05:44:42.1787243Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T05:44:42.1787957Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T05:44:42.1788519Z Compiling xla/literal.cc; 18s local 2025-03-14T05:44:42.1789273Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 3s local 2025-03-14T05:44:42.1790217Z Compiling src/google/protobuf/api.pb.cc; 2s local 2025-03-14T05:44:42.1790910Z Compiling src/google/protobuf/compiler/importer.cc; 2s local 2025-03-14T05:44:42.1792173Z Compiling src/google/protobuf/compiler/parser.cc; 2s local 2025-03-14T05:44:42.1792973Z Compiling xla/stream_executor/dnn.cc; 2s local ... 2025-03-14T05:44:42.3910957Z 2025-03-14T05:44:42.3912192Z  2025-03-14T05:44:42.3912714Z  2025-03-14T05:44:42.3913158Z  2025-03-14T05:44:42.3913605Z  2025-03-14T05:44:42.3914001Z  2025-03-14T05:44:42.3914353Z  2025-03-14T05:44:42.3914730Z  2025-03-14T05:44:42.3915114Z  2025-03-14T05:44:42.3915680Z [11,860 / 15,235] 48 actions running 2025-03-14T05:44:42.3916573Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T05:44:42.3917491Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T05:44:42.3918176Z Compiling xla/literal.cc; 18s local 2025-03-14T05:44:42.3919053Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 3s local 2025-03-14T05:44:42.3920091Z Compiling src/google/protobuf/compiler/parser.cc; 2s local 2025-03-14T05:44:42.3921031Z Compiling xla/stream_executor/dnn.cc; 2s local 2025-03-14T05:44:42.3921880Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 2s local 2025-03-14T05:44:42.3922905Z @xla//xla/stream_executor:stream_executor_memory_allocator; 2s local ... 2025-03-14T05:44:42.6450780Z 2025-03-14T05:44:42.6451934Z  2025-03-14T05:44:42.6452659Z  2025-03-14T05:44:42.6453361Z  2025-03-14T05:44:42.6454009Z  2025-03-14T05:44:42.6454468Z  2025-03-14T05:44:42.6454910Z  2025-03-14T05:44:42.6455353Z  2025-03-14T05:44:42.6455789Z  2025-03-14T05:44:42.6456392Z [11,862 / 15,235] 48 actions, 47 running 2025-03-14T05:44:42.6457127Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T05:44:42.6457922Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T05:44:42.6458894Z Compiling xla/literal.cc; 18s local 2025-03-14T05:44:42.6459606Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 3s local 2025-03-14T05:44:42.6460462Z Compiling src/google/protobuf/compiler/parser.cc; 2s local 2025-03-14T05:44:42.6461152Z Compiling xla/stream_executor/dnn.cc; 2s local 2025-03-14T05:44:42.6461837Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 2s local 2025-03-14T05:44:42.6462687Z @xla//xla/stream_executor:stream_executor_memory_allocator; 2s local ... 2025-03-14T05:44:42.8522790Z 2025-03-14T05:44:42.8523796Z  2025-03-14T05:44:42.8524490Z  2025-03-14T05:44:42.8525285Z  2025-03-14T05:44:42.8525890Z  2025-03-14T05:44:42.8526326Z  2025-03-14T05:44:42.8526781Z  2025-03-14T05:44:42.8527229Z  2025-03-14T05:44:42.8527679Z  2025-03-14T05:44:42.8528355Z [11,865 / 15,235] 48 actions, 47 running 2025-03-14T05:44:42.8529169Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T05:44:42.8530140Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T05:44:42.8530923Z Compiling xla/literal.cc; 19s local 2025-03-14T05:44:42.8531820Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 3s local 2025-03-14T05:44:42.8532969Z Compiling src/google/protobuf/compiler/parser.cc; 2s local 2025-03-14T05:44:42.8533837Z Compiling xla/stream_executor/dnn.cc; 2s local 2025-03-14T05:44:42.8534701Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 2s local 2025-03-14T05:44:42.8535735Z @xla//xla/stream_executor:stream_executor_memory_allocator; 2s local ... 2025-03-14T05:44:43.1099003Z 2025-03-14T05:44:43.1099832Z  2025-03-14T05:44:43.1100376Z  2025-03-14T05:44:43.1100814Z  2025-03-14T05:44:43.1101258Z  2025-03-14T05:44:43.1101685Z  2025-03-14T05:44:43.1102073Z  2025-03-14T05:44:43.1102441Z  2025-03-14T05:44:43.1102794Z  2025-03-14T05:44:43.1103377Z [11,868 / 15,235] 48 actions, 47 running 2025-03-14T05:44:43.1104400Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T05:44:43.1105649Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T05:44:43.1106323Z Compiling xla/literal.cc; 19s local 2025-03-14T05:44:43.1107163Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 4s local 2025-03-14T05:44:43.1108196Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T05:44:43.1109148Z Compiling xla/stream_executor/dnn.cc; 3s local 2025-03-14T05:44:43.1110011Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 2s local 2025-03-14T05:44:43.1111054Z @xla//xla/stream_executor:stream_executor_memory_allocator; 2s local ... 2025-03-14T05:44:43.3250676Z 2025-03-14T05:44:43.3251825Z  2025-03-14T05:44:43.3252484Z  2025-03-14T05:44:43.3253163Z  2025-03-14T05:44:43.3253842Z  2025-03-14T05:44:43.3254312Z  2025-03-14T05:44:43.3254756Z  2025-03-14T05:44:43.3255243Z  2025-03-14T05:44:43.3255686Z  2025-03-14T05:44:43.3256337Z [11,869 / 15,235] 48 actions, 47 running 2025-03-14T05:44:43.3257213Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T05:44:43.3258165Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T05:44:43.3258900Z Compiling xla/literal.cc; 19s local 2025-03-14T05:44:43.3259792Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 4s local 2025-03-14T05:44:43.3260904Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T05:44:43.3261745Z Compiling xla/stream_executor/dnn.cc; 3s local 2025-03-14T05:44:43.3262636Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 3s local 2025-03-14T05:44:43.3263805Z @xla//xla/stream_executor:stream_executor_memory_allocator; 3s local ... 2025-03-14T05:44:43.5921568Z 2025-03-14T05:44:43.5922416Z  2025-03-14T05:44:43.5922953Z  2025-03-14T05:44:43.5923407Z  2025-03-14T05:44:43.5924298Z  2025-03-14T05:44:43.5924794Z  2025-03-14T05:44:43.5925201Z  2025-03-14T05:44:43.5925619Z  2025-03-14T05:44:43.5926025Z  2025-03-14T05:44:43.5926624Z [11,871 / 15,235] 48 actions running 2025-03-14T05:44:43.5927537Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T05:44:43.5928526Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T05:44:43.5929274Z Compiling xla/literal.cc; 19s local 2025-03-14T05:44:43.5930287Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 4s local 2025-03-14T05:44:43.5931370Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T05:44:43.5932216Z Compiling xla/stream_executor/dnn.cc; 3s local 2025-03-14T05:44:43.5933072Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 3s local 2025-03-14T05:44:43.5934109Z @xla//xla/stream_executor:stream_executor_memory_allocator; 3s local ... 2025-03-14T05:44:43.8505237Z 2025-03-14T05:44:43.8506151Z  2025-03-14T05:44:43.8506707Z  2025-03-14T05:44:43.8507170Z  2025-03-14T05:44:43.8507612Z  2025-03-14T05:44:43.8508041Z  2025-03-14T05:44:43.8518875Z  2025-03-14T05:44:43.8519368Z  2025-03-14T05:44:43.8519761Z  2025-03-14T05:44:43.8520375Z [11,876 / 15,235] 48 actions, 47 running 2025-03-14T05:44:43.8521256Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T05:44:43.8522177Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T05:44:43.8522837Z Compiling xla/literal.cc; 20s local 2025-03-14T05:44:43.8523656Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 4s local 2025-03-14T05:44:43.8524763Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T05:44:43.8525572Z Compiling xla/stream_executor/dnn.cc; 3s local 2025-03-14T05:44:43.8526430Z @xla//xla/stream_executor:stream_executor_memory_allocator; 3s local 2025-03-14T05:44:43.8527303Z Compiling xla/hlo/builder/padding.cc; 3s local ... 2025-03-14T05:44:44.1928598Z 2025-03-14T05:44:44.1929569Z  2025-03-14T05:44:44.1930148Z  2025-03-14T05:44:44.1930556Z  2025-03-14T05:44:44.1930958Z  2025-03-14T05:44:44.1931366Z  2025-03-14T05:44:44.1931775Z  2025-03-14T05:44:44.1932214Z  2025-03-14T05:44:44.1932649Z  2025-03-14T05:44:44.1933186Z [11,881 / 15,235] 48 actions running 2025-03-14T05:44:44.1934129Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T05:44:44.1935183Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T05:44:44.1935919Z Compiling xla/literal.cc; 20s local 2025-03-14T05:44:44.1936776Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 5s local 2025-03-14T05:44:44.1937852Z Compiling src/google/protobuf/compiler/parser.cc; 4s local 2025-03-14T05:44:44.1938736Z Compiling xla/stream_executor/dnn.cc; 4s local 2025-03-14T05:44:44.1939732Z @xla//xla/stream_executor:stream_executor_memory_allocator; 4s local 2025-03-14T05:44:44.1940732Z Compiling xla/hlo/builder/padding.cc; 4s local ... 2025-03-14T05:44:44.3933729Z 2025-03-14T05:44:44.3934771Z  2025-03-14T05:44:44.3935338Z  2025-03-14T05:44:44.3935740Z  2025-03-14T05:44:44.3936117Z  2025-03-14T05:44:44.3936523Z  2025-03-14T05:44:44.3936939Z  2025-03-14T05:44:44.3937336Z  2025-03-14T05:44:44.3937735Z  2025-03-14T05:44:44.3938327Z [11,882 / 15,235] 48 actions running 2025-03-14T05:44:44.3939137Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T05:44:44.3940079Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T05:44:44.3940856Z Compiling xla/literal.cc; 20s local 2025-03-14T05:44:44.3941704Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 5s local 2025-03-14T05:44:44.3942753Z Compiling src/google/protobuf/compiler/parser.cc; 4s local 2025-03-14T05:44:44.3944123Z Compiling xla/stream_executor/dnn.cc; 4s local 2025-03-14T05:44:44.3945072Z @xla//xla/stream_executor:stream_executor_memory_allocator; 4s local 2025-03-14T05:44:44.3945990Z Compiling xla/hlo/builder/padding.cc; 4s local ... 2025-03-14T05:44:44.6297050Z 2025-03-14T05:44:44.6298027Z  2025-03-14T05:44:44.6298577Z  2025-03-14T05:44:44.6298939Z  2025-03-14T05:44:44.6299328Z  2025-03-14T05:44:44.6299727Z  2025-03-14T05:44:44.6300114Z  2025-03-14T05:44:44.6300588Z  2025-03-14T05:44:44.6300970Z  2025-03-14T05:44:44.6301523Z [11,886 / 15,235] 48 actions, 47 running 2025-03-14T05:44:44.6302365Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T05:44:44.6303155Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T05:44:44.6303743Z Compiling xla/literal.cc; 20s local 2025-03-14T05:44:44.6304663Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 5s local 2025-03-14T05:44:44.6305519Z Compiling xla/stream_executor/dnn.cc; 4s local 2025-03-14T05:44:44.6306384Z @xla//xla/stream_executor:stream_executor_memory_allocator; 4s local 2025-03-14T05:44:44.6307215Z Compiling xla/service/shape_inference.cc; 4s local 2025-03-14T05:44:44.6307947Z Compiling llvm/lib/IR/Verifier.cpp; 4s local ... 2025-03-14T05:44:44.9701319Z 2025-03-14T05:44:44.9702318Z  2025-03-14T05:44:44.9702893Z  2025-03-14T05:44:44.9703282Z  2025-03-14T05:44:44.9703656Z  2025-03-14T05:44:44.9704042Z  2025-03-14T05:44:44.9704424Z  2025-03-14T05:44:44.9704780Z  2025-03-14T05:44:44.9705149Z  2025-03-14T05:44:44.9705729Z [11,889 / 15,235] 48 actions, 47 running 2025-03-14T05:44:44.9706412Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T05:44:44.9707040Z Compiling xla/literal.cc; 21s local 2025-03-14T05:44:44.9707885Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 6s local 2025-03-14T05:44:44.9708747Z Compiling xla/stream_executor/dnn.cc; 4s local 2025-03-14T05:44:44.9709896Z @xla//xla/stream_executor:stream_executor_memory_allocator; 4s local 2025-03-14T05:44:44.9710727Z Compiling xla/service/shape_inference.cc; 4s local 2025-03-14T05:44:44.9711367Z Compiling llvm/lib/IR/Verifier.cpp; 4s local 2025-03-14T05:44:44.9712106Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 4s local ... 2025-03-14T05:44:45.1746732Z 2025-03-14T05:44:45.1747695Z  2025-03-14T05:44:45.1748238Z  2025-03-14T05:44:45.1748597Z  2025-03-14T05:44:45.1748940Z  2025-03-14T05:44:45.1749301Z  2025-03-14T05:44:45.1749651Z  2025-03-14T05:44:45.1749997Z  2025-03-14T05:44:45.1750317Z  2025-03-14T05:44:45.1750841Z [11,891 / 15,235] 48 actions, 47 running 2025-03-14T05:44:45.1751520Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T05:44:45.1752125Z Compiling xla/literal.cc; 21s local 2025-03-14T05:44:45.1752900Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 6s local 2025-03-14T05:44:45.1753720Z Compiling xla/stream_executor/dnn.cc; 5s local 2025-03-14T05:44:45.1754456Z @xla//xla/stream_executor:stream_executor_memory_allocator; 4s local 2025-03-14T05:44:45.1755217Z Compiling xla/service/shape_inference.cc; 4s local 2025-03-14T05:44:45.1755855Z Compiling llvm/lib/IR/Verifier.cpp; 4s local 2025-03-14T05:44:45.1756570Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 4s local ... 2025-03-14T05:44:45.3914424Z 2025-03-14T05:44:45.3915363Z  2025-03-14T05:44:45.3915920Z  2025-03-14T05:44:45.3916299Z  2025-03-14T05:44:45.3916620Z  2025-03-14T05:44:45.3916939Z  2025-03-14T05:44:45.3917262Z  2025-03-14T05:44:45.3917575Z  2025-03-14T05:44:45.3917887Z  2025-03-14T05:44:45.3918355Z [11,893 / 15,235] 48 actions, 47 running 2025-03-14T05:44:45.3919267Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T05:44:45.3919826Z Compiling xla/literal.cc; 21s local 2025-03-14T05:44:45.3920517Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 6s local 2025-03-14T05:44:45.3921270Z Compiling xla/stream_executor/dnn.cc; 5s local 2025-03-14T05:44:45.3921960Z @xla//xla/stream_executor:stream_executor_memory_allocator; 5s local 2025-03-14T05:44:45.3922695Z Compiling xla/service/shape_inference.cc; 5s local 2025-03-14T05:44:45.3923308Z Compiling llvm/lib/IR/Verifier.cpp; 5s local 2025-03-14T05:44:45.3923980Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 4s local ... 2025-03-14T05:44:45.5941222Z 2025-03-14T05:44:45.5942222Z  2025-03-14T05:44:45.5942774Z  2025-03-14T05:44:45.5943161Z  2025-03-14T05:44:45.5943529Z  2025-03-14T05:44:45.5943926Z  2025-03-14T05:44:45.5944320Z  2025-03-14T05:44:45.5944711Z  2025-03-14T05:44:45.5945089Z  2025-03-14T05:44:45.5945665Z [11,894 / 15,235] 48 actions running 2025-03-14T05:44:45.5946359Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T05:44:45.5946999Z Compiling xla/literal.cc; 21s local 2025-03-14T05:44:45.5947756Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 6s local 2025-03-14T05:44:45.5948623Z Compiling xla/stream_executor/dnn.cc; 5s local 2025-03-14T05:44:45.5949548Z @xla//xla/stream_executor:stream_executor_memory_allocator; 5s local 2025-03-14T05:44:45.5950328Z Compiling xla/service/shape_inference.cc; 5s local 2025-03-14T05:44:45.5950896Z Compiling llvm/lib/IR/Verifier.cpp; 5s local 2025-03-14T05:44:45.5951538Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 5s local ... 2025-03-14T05:44:45.8952862Z 2025-03-14T05:44:45.8953890Z  2025-03-14T05:44:45.8954451Z  2025-03-14T05:44:45.8954821Z  2025-03-14T05:44:45.8955223Z  2025-03-14T05:44:45.8955565Z  2025-03-14T05:44:45.8956073Z  2025-03-14T05:44:45.8956462Z  2025-03-14T05:44:45.8956892Z  2025-03-14T05:44:45.8957514Z [11,897 / 15,235] 48 actions, 47 running 2025-03-14T05:44:45.8958698Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T05:44:45.8959396Z Compiling xla/literal.cc; 22s local 2025-03-14T05:44:45.8960243Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 6s local 2025-03-14T05:44:45.8961190Z Compiling xla/stream_executor/dnn.cc; 5s local 2025-03-14T05:44:45.8961886Z Compiling xla/service/shape_inference.cc; 5s local 2025-03-14T05:44:45.8962569Z Compiling llvm/lib/IR/Verifier.cpp; 5s local 2025-03-14T05:44:45.8963363Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 5s local 2025-03-14T05:44:45.8964219Z Compiling xla/service/hlo_domain_map.cc; 5s local ... 2025-03-14T05:44:46.1317828Z 2025-03-14T05:44:46.1318752Z  2025-03-14T05:44:46.1319318Z  2025-03-14T05:44:46.1319721Z  2025-03-14T05:44:46.1320119Z  2025-03-14T05:44:46.1320490Z  2025-03-14T05:44:46.1320879Z  2025-03-14T05:44:46.1321280Z  2025-03-14T05:44:46.1321697Z  2025-03-14T05:44:46.1322298Z [11,899 / 15,235] 48 actions, 47 running 2025-03-14T05:44:46.1323067Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T05:44:46.1323778Z Compiling xla/literal.cc; 22s local 2025-03-14T05:44:46.1324746Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 7s local 2025-03-14T05:44:46.1325728Z Compiling xla/stream_executor/dnn.cc; 6s local 2025-03-14T05:44:46.1326428Z Compiling xla/service/shape_inference.cc; 5s local 2025-03-14T05:44:46.1327122Z Compiling llvm/lib/IR/Verifier.cpp; 5s local 2025-03-14T05:44:46.1327876Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 5s local 2025-03-14T05:44:46.1328657Z Compiling xla/service/hlo_domain_map.cc; 5s local ... 2025-03-14T05:44:46.3948272Z 2025-03-14T05:44:46.3949253Z  2025-03-14T05:44:46.3949817Z  2025-03-14T05:44:46.3950183Z  2025-03-14T05:44:46.3950566Z  2025-03-14T05:44:46.3951293Z  2025-03-14T05:44:46.3951688Z  2025-03-14T05:44:46.3952091Z  2025-03-14T05:44:46.3952494Z  2025-03-14T05:44:46.3953057Z [11,902 / 15,235] 48 actions running 2025-03-14T05:44:46.3953786Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T05:44:46.3954458Z Compiling xla/literal.cc; 22s local 2025-03-14T05:44:46.3955304Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 7s local 2025-03-14T05:44:46.3956234Z Compiling xla/stream_executor/dnn.cc; 6s local 2025-03-14T05:44:46.3956961Z Compiling xla/service/shape_inference.cc; 6s local 2025-03-14T05:44:46.3957715Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2025-03-14T05:44:46.3958478Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 5s local 2025-03-14T05:44:46.3959316Z Compiling xla/service/hlo_domain_map.cc; 5s local ... 2025-03-14T05:44:46.5952615Z 2025-03-14T05:44:46.5953542Z  2025-03-14T05:44:46.5954101Z  2025-03-14T05:44:46.5954518Z  2025-03-14T05:44:46.5954886Z  2025-03-14T05:44:46.5955283Z  2025-03-14T05:44:46.5955658Z  2025-03-14T05:44:46.5956046Z  2025-03-14T05:44:46.5956422Z  2025-03-14T05:44:46.5956957Z [11,904 / 15,235] 48 actions running 2025-03-14T05:44:46.5957633Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T05:44:46.5958276Z Compiling xla/literal.cc; 22s local 2025-03-14T05:44:46.5959072Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 7s local 2025-03-14T05:44:46.5959943Z Compiling xla/stream_executor/dnn.cc; 6s local 2025-03-14T05:44:46.5960626Z Compiling xla/service/shape_inference.cc; 6s local 2025-03-14T05:44:46.5961306Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2025-03-14T05:44:46.5962027Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T05:44:46.5962797Z Compiling xla/service/hlo_domain_map.cc; 6s local ... 2025-03-14T05:44:46.9420872Z 2025-03-14T05:44:46.9421926Z  2025-03-14T05:44:46.9422480Z  2025-03-14T05:44:46.9423222Z  2025-03-14T05:44:46.9423622Z  2025-03-14T05:44:46.9423993Z  2025-03-14T05:44:46.9424385Z  2025-03-14T05:44:46.9424777Z  2025-03-14T05:44:46.9425165Z  2025-03-14T05:44:46.9425792Z [11,906 / 15,235] 48 actions, 47 running 2025-03-14T05:44:46.9426533Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T05:44:46.9427241Z Compiling xla/literal.cc; 23s local 2025-03-14T05:44:46.9428042Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 7s local 2025-03-14T05:44:46.9428920Z Compiling xla/stream_executor/dnn.cc; 6s local 2025-03-14T05:44:46.9429612Z Compiling xla/service/shape_inference.cc; 6s local 2025-03-14T05:44:46.9430311Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2025-03-14T05:44:46.9431100Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T05:44:46.9431956Z Compiling xla/service/hlo_domain_map.cc; 6s local ... 2025-03-14T05:44:47.1958980Z 2025-03-14T05:44:47.1960064Z  2025-03-14T05:44:47.1960575Z  2025-03-14T05:44:47.1960958Z  2025-03-14T05:44:47.1961329Z  2025-03-14T05:44:47.1961687Z  2025-03-14T05:44:47.1962010Z  2025-03-14T05:44:47.1962397Z  2025-03-14T05:44:47.1962762Z  2025-03-14T05:44:47.1963316Z [11,907 / 15,235] 48 actions running 2025-03-14T05:44:47.1964038Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T05:44:47.1964891Z Compiling xla/literal.cc; 23s local 2025-03-14T05:44:47.1965943Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 8s local 2025-03-14T05:44:47.1966875Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T05:44:47.1967622Z Compiling xla/service/shape_inference.cc; 6s local 2025-03-14T05:44:47.1968353Z Compiling llvm/lib/IR/Verifier.cpp; 6s local 2025-03-14T05:44:47.1969073Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T05:44:47.1970307Z Compiling xla/service/hlo_domain_map.cc; 6s local ... 2025-03-14T05:44:47.3964239Z 2025-03-14T05:44:47.3965575Z  2025-03-14T05:44:47.3966131Z  2025-03-14T05:44:47.3966489Z  2025-03-14T05:44:47.3966868Z  2025-03-14T05:44:47.3967242Z  2025-03-14T05:44:47.3967627Z  2025-03-14T05:44:47.3967994Z  2025-03-14T05:44:47.3968391Z  2025-03-14T05:44:47.3968930Z [11,908 / 15,235] 48 actions running 2025-03-14T05:44:47.3969671Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T05:44:47.3970327Z Compiling xla/literal.cc; 23s local 2025-03-14T05:44:47.3971141Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 8s local 2025-03-14T05:44:47.3972062Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T05:44:47.3972804Z Compiling xla/service/shape_inference.cc; 7s local 2025-03-14T05:44:47.3973520Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2025-03-14T05:44:47.3974200Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T05:44:47.3974858Z Compiling xla/service/hlo_domain_map.cc; 6s local ... 2025-03-14T05:44:47.6530435Z 2025-03-14T05:44:47.6531408Z  2025-03-14T05:44:47.6531849Z  2025-03-14T05:44:47.6532215Z  2025-03-14T05:44:47.6532589Z  2025-03-14T05:44:47.6532967Z  2025-03-14T05:44:47.6533475Z  2025-03-14T05:44:47.6533873Z  2025-03-14T05:44:47.6534278Z  2025-03-14T05:44:47.6534917Z [11,911 / 15,235] 48 actions, 47 running 2025-03-14T05:44:47.6535646Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T05:44:47.6536349Z Compiling xla/literal.cc; 23s local 2025-03-14T05:44:47.6537179Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 8s local 2025-03-14T05:44:47.6538157Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T05:44:47.6538921Z Compiling xla/service/shape_inference.cc; 7s local 2025-03-14T05:44:47.6539723Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2025-03-14T05:44:47.6540469Z Compiling xla/service/hlo_domain_map.cc; 7s local 2025-03-14T05:44:47.6541986Z Compiling xla/service/custom_call_sharding_helper.cc; 7s local ... 2025-03-14T05:44:47.9969101Z 2025-03-14T05:44:47.9970174Z  2025-03-14T05:44:47.9970666Z  2025-03-14T05:44:47.9971066Z  2025-03-14T05:44:47.9971470Z  2025-03-14T05:44:47.9971888Z  2025-03-14T05:44:47.9972284Z  2025-03-14T05:44:47.9972686Z  2025-03-14T05:44:47.9973095Z  2025-03-14T05:44:47.9973687Z [11,915 / 15,235] 48 actions running 2025-03-14T05:44:47.9974462Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T05:44:47.9975222Z Compiling xla/literal.cc; 24s local 2025-03-14T05:44:47.9976159Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 9s local 2025-03-14T05:44:47.9977181Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T05:44:47.9977993Z Compiling xla/service/shape_inference.cc; 7s local 2025-03-14T05:44:47.9978735Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2025-03-14T05:44:47.9979526Z Compiling xla/service/hlo_domain_map.cc; 7s local 2025-03-14T05:44:47.9980475Z Compiling xla/service/custom_call_sharding_helper.cc; 7s local ... 2025-03-14T05:44:48.1973908Z 2025-03-14T05:44:48.1974789Z  2025-03-14T05:44:48.1975287Z  2025-03-14T05:44:48.1975680Z  2025-03-14T05:44:48.1976081Z  2025-03-14T05:44:48.1976492Z  2025-03-14T05:44:48.1976877Z  2025-03-14T05:44:48.1977244Z  2025-03-14T05:44:48.1977617Z  2025-03-14T05:44:48.1978204Z [11,917 / 15,235] 48 actions running 2025-03-14T05:44:48.1978917Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T05:44:48.1979593Z Compiling xla/literal.cc; 24s local 2025-03-14T05:44:48.1980375Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 9s local 2025-03-14T05:44:48.1981640Z Compiling xla/stream_executor/dnn.cc; 8s local 2025-03-14T05:44:48.1982359Z Compiling xla/service/shape_inference.cc; 7s local 2025-03-14T05:44:48.1983099Z Compiling llvm/lib/IR/Verifier.cpp; 7s local 2025-03-14T05:44:48.1983807Z Compiling xla/service/hlo_domain_map.cc; 7s local 2025-03-14T05:44:48.1984637Z Compiling xla/service/custom_call_sharding_helper.cc; 7s local ... 2025-03-14T05:44:48.5978440Z 2025-03-14T05:44:48.5979368Z  2025-03-14T05:44:48.5979854Z  2025-03-14T05:44:48.5980264Z  2025-03-14T05:44:48.5980680Z  2025-03-14T05:44:48.5981071Z  2025-03-14T05:44:48.5981481Z  2025-03-14T05:44:48.5981889Z  2025-03-14T05:44:48.5982308Z  2025-03-14T05:44:48.5982897Z [11,918 / 15,235] 48 actions running 2025-03-14T05:44:48.5983676Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T05:44:48.5984406Z Compiling xla/literal.cc; 24s local 2025-03-14T05:44:48.5985290Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 9s local 2025-03-14T05:44:48.5986303Z Compiling xla/stream_executor/dnn.cc; 8s local 2025-03-14T05:44:48.5987192Z Compiling xla/service/shape_inference.cc; 8s local 2025-03-14T05:44:48.5987920Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2025-03-14T05:44:48.5988651Z Compiling xla/service/hlo_domain_map.cc; 8s local 2025-03-14T05:44:48.5989539Z Compiling xla/service/custom_call_sharding_helper.cc; 8s local ... 2025-03-14T05:44:48.7983327Z 2025-03-14T05:44:48.7984224Z  2025-03-14T05:44:48.7984708Z  2025-03-14T05:44:48.7985083Z  2025-03-14T05:44:48.7985501Z  2025-03-14T05:44:48.7985861Z  2025-03-14T05:44:48.7986295Z  2025-03-14T05:44:48.7986717Z  2025-03-14T05:44:48.7987125Z  2025-03-14T05:44:48.7987702Z [11,919 / 15,235] 48 actions running 2025-03-14T05:44:48.7988454Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T05:44:48.7989079Z Compiling xla/literal.cc; 25s local 2025-03-14T05:44:48.7989930Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 9s local 2025-03-14T05:44:48.7991310Z Compiling xla/stream_executor/dnn.cc; 8s local 2025-03-14T05:44:48.7992105Z Compiling xla/service/shape_inference.cc; 8s local 2025-03-14T05:44:48.7992799Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2025-03-14T05:44:48.7993531Z Compiling xla/service/hlo_domain_map.cc; 8s local 2025-03-14T05:44:48.7994269Z Compiling xla/service/hlo_cse.cc; 8s local ... 2025-03-14T05:44:49.0208710Z 2025-03-14T05:44:49.0209687Z  2025-03-14T05:44:49.0210138Z  2025-03-14T05:44:49.0210551Z  2025-03-14T05:44:49.0210981Z  2025-03-14T05:44:49.0211369Z  2025-03-14T05:44:49.0211737Z  2025-03-14T05:44:49.0212135Z  2025-03-14T05:44:49.0212511Z  2025-03-14T05:44:49.0213096Z [11,921 / 15,235] 48 actions, 47 running 2025-03-14T05:44:49.0213823Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T05:44:49.0214500Z Compiling xla/literal.cc; 25s local 2025-03-14T05:44:49.0215299Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 10s local 2025-03-14T05:44:49.0216187Z Compiling xla/service/shape_inference.cc; 8s local 2025-03-14T05:44:49.0216918Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2025-03-14T05:44:49.0217600Z Compiling xla/service/hlo_domain_map.cc; 8s local 2025-03-14T05:44:49.0218316Z Compiling xla/service/hlo_cse.cc; 8s local 2025-03-14T05:44:49.0219216Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 8s local ... 2025-03-14T05:44:49.2357994Z 2025-03-14T05:44:49.2358990Z  2025-03-14T05:44:49.2359418Z  2025-03-14T05:44:49.2359758Z  2025-03-14T05:44:49.2360109Z  2025-03-14T05:44:49.2360461Z  2025-03-14T05:44:49.2360813Z  2025-03-14T05:44:49.2361158Z  2025-03-14T05:44:49.2361504Z  2025-03-14T05:44:49.2362027Z [11,924 / 15,235] 48 actions, 47 running 2025-03-14T05:44:49.2363039Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T05:44:49.2363676Z Compiling xla/literal.cc; 25s local 2025-03-14T05:44:49.2364457Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 10s local 2025-03-14T05:44:49.2365628Z Compiling xla/service/shape_inference.cc; 8s local 2025-03-14T05:44:49.2366261Z Compiling llvm/lib/IR/Verifier.cpp; 8s local 2025-03-14T05:44:49.2366902Z Compiling xla/service/hlo_domain_map.cc; 8s local 2025-03-14T05:44:49.2367530Z Compiling xla/service/hlo_cse.cc; 8s local 2025-03-14T05:44:49.2368492Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 8s local ... 2025-03-14T05:44:49.5284929Z 2025-03-14T05:44:49.5285836Z  2025-03-14T05:44:49.5286263Z  2025-03-14T05:44:49.5286619Z  2025-03-14T05:44:49.5286973Z  2025-03-14T05:44:49.5287305Z  2025-03-14T05:44:49.5287645Z  2025-03-14T05:44:49.5287989Z  2025-03-14T05:44:49.5288326Z  2025-03-14T05:44:49.5288896Z [11,927 / 15,235] 48 actions, 47 running 2025-03-14T05:44:49.5289658Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T05:44:49.5290254Z Compiling xla/literal.cc; 25s local 2025-03-14T05:44:49.5290962Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 10s local 2025-03-14T05:44:49.5291773Z Compiling xla/service/shape_inference.cc; 9s local 2025-03-14T05:44:49.5292382Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2025-03-14T05:44:49.5292977Z Compiling xla/service/hlo_domain_map.cc; 9s local 2025-03-14T05:44:49.5293567Z Compiling xla/service/hlo_cse.cc; 9s local 2025-03-14T05:44:49.5294331Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local ... 2025-03-14T05:44:49.7989614Z 2025-03-14T05:44:49.7990608Z  2025-03-14T05:44:49.7991088Z  2025-03-14T05:44:49.7991462Z  2025-03-14T05:44:49.7991881Z  2025-03-14T05:44:49.7992277Z  2025-03-14T05:44:49.7992658Z  2025-03-14T05:44:49.7993046Z  2025-03-14T05:44:49.7993485Z  2025-03-14T05:44:49.7994065Z [11,928 / 15,235] 48 actions running 2025-03-14T05:44:49.7995218Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T05:44:49.7996048Z Compiling xla/literal.cc; 26s local 2025-03-14T05:44:49.7996866Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 10s local 2025-03-14T05:44:49.7997843Z Compiling xla/service/shape_inference.cc; 9s local 2025-03-14T05:44:49.7998555Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2025-03-14T05:44:49.7999240Z Compiling xla/service/hlo_domain_map.cc; 9s local 2025-03-14T05:44:49.7999926Z Compiling xla/service/hlo_cse.cc; 9s local 2025-03-14T05:44:49.8000818Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local ... 2025-03-14T05:44:49.9993751Z 2025-03-14T05:44:49.9994708Z  2025-03-14T05:44:49.9995225Z  2025-03-14T05:44:49.9995640Z  2025-03-14T05:44:49.9996060Z  2025-03-14T05:44:49.9996431Z  2025-03-14T05:44:49.9996867Z  2025-03-14T05:44:49.9997258Z  2025-03-14T05:44:49.9997656Z  2025-03-14T05:44:49.9998231Z [11,929 / 15,235] 48 actions running 2025-03-14T05:44:49.9998978Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T05:44:49.9999665Z Compiling xla/literal.cc; 26s local 2025-03-14T05:44:50.0000557Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 11s local 2025-03-14T05:44:50.0001497Z Compiling xla/service/shape_inference.cc; 9s local 2025-03-14T05:44:50.0002265Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2025-03-14T05:44:50.0003025Z Compiling xla/service/hlo_domain_map.cc; 9s local 2025-03-14T05:44:50.0003784Z Compiling xla/service/hlo_cse.cc; 9s local 2025-03-14T05:44:50.0004878Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local ... 2025-03-14T05:44:50.2107661Z 2025-03-14T05:44:50.2108498Z  2025-03-14T05:44:50.2108987Z  2025-03-14T05:44:50.2109382Z  2025-03-14T05:44:50.2110157Z  2025-03-14T05:44:50.2110590Z  2025-03-14T05:44:50.2111007Z  2025-03-14T05:44:50.2111424Z  2025-03-14T05:44:50.2111812Z  2025-03-14T05:44:50.2112472Z [11,931 / 15,235] 48 actions, 47 running 2025-03-14T05:44:50.2113791Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T05:44:50.2114623Z Compiling xla/literal.cc; 26s local 2025-03-14T05:44:50.2115585Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 11s local 2025-03-14T05:44:50.2116658Z Compiling xla/service/shape_inference.cc; 9s local 2025-03-14T05:44:50.2117518Z Compiling llvm/lib/IR/Verifier.cpp; 9s local 2025-03-14T05:44:50.2118324Z Compiling xla/service/hlo_domain_map.cc; 9s local 2025-03-14T05:44:50.2119066Z Compiling xla/service/hlo_cse.cc; 9s local 2025-03-14T05:44:50.2119998Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local ... 2025-03-14T05:44:50.5444725Z 2025-03-14T05:44:50.5445625Z  2025-03-14T05:44:50.5446168Z  2025-03-14T05:44:50.5446590Z  2025-03-14T05:44:50.5447015Z  2025-03-14T05:44:50.5447417Z  2025-03-14T05:44:50.5447794Z  2025-03-14T05:44:50.5448187Z  2025-03-14T05:44:50.5448587Z  2025-03-14T05:44:50.5449191Z [11,932 / 15,235] 48 actions, 47 running 2025-03-14T05:44:50.5449917Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T05:44:50.5450593Z Compiling xla/literal.cc; 26s local 2025-03-14T05:44:50.5451456Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 11s local 2025-03-14T05:44:50.5452391Z Compiling xla/service/shape_inference.cc; 10s local 2025-03-14T05:44:50.5453161Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T05:44:50.5453913Z Compiling xla/service/hlo_domain_map.cc; 10s local 2025-03-14T05:44:50.5454639Z Compiling xla/service/hlo_cse.cc; 10s local 2025-03-14T05:44:50.5455519Z Compiling .../transforms/simplifiers/tuple_simplifier.cc; 10s local ... 2025-03-14T05:44:50.8000583Z 2025-03-14T05:44:50.8001457Z  2025-03-14T05:44:50.8002328Z  2025-03-14T05:44:50.8002722Z  2025-03-14T05:44:50.8003114Z  2025-03-14T05:44:50.8003490Z  2025-03-14T05:44:50.8003885Z  2025-03-14T05:44:50.8004271Z  2025-03-14T05:44:50.8004853Z  2025-03-14T05:44:50.8005419Z [11,935 / 15,235] 48 actions running 2025-03-14T05:44:50.8006157Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T05:44:50.8006876Z Compiling xla/literal.cc; 27s local 2025-03-14T05:44:50.8007535Z Compiling xla/service/shape_inference.cc; 10s local 2025-03-14T05:44:50.8008329Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T05:44:50.8009061Z Compiling xla/service/hlo_domain_map.cc; 10s local 2025-03-14T05:44:50.8009758Z Compiling xla/service/hlo_cse.cc; 10s local 2025-03-14T05:44:50.8010590Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T05:44:50.8011813Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local ... 2025-03-14T05:44:51.1321848Z 2025-03-14T05:44:51.1322840Z  2025-03-14T05:44:51.1323352Z  2025-03-14T05:44:51.1323800Z  2025-03-14T05:44:51.1324278Z  2025-03-14T05:44:51.1324831Z  2025-03-14T05:44:51.1325182Z  2025-03-14T05:44:51.1325552Z  2025-03-14T05:44:51.1325932Z  2025-03-14T05:44:51.1326504Z [11,937 / 15,235] 48 actions, 47 running 2025-03-14T05:44:51.1327182Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T05:44:51.1327869Z Compiling xla/literal.cc; 27s local 2025-03-14T05:44:51.1328510Z Compiling xla/service/shape_inference.cc; 10s local 2025-03-14T05:44:51.1329284Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T05:44:51.1330032Z Compiling xla/service/hlo_domain_map.cc; 10s local 2025-03-14T05:44:51.1330729Z Compiling xla/service/hlo_cse.cc; 10s local 2025-03-14T05:44:51.1332002Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T05:44:51.1333089Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local ... 2025-03-14T05:44:51.4006648Z 2025-03-14T05:44:51.4007959Z  2025-03-14T05:44:51.4008457Z  2025-03-14T05:44:51.4008872Z  2025-03-14T05:44:51.4009256Z  2025-03-14T05:44:51.4009622Z  2025-03-14T05:44:51.4010026Z  2025-03-14T05:44:51.4010445Z  2025-03-14T05:44:51.4010872Z  2025-03-14T05:44:51.4011472Z [11,937 / 15,235] 48 actions running 2025-03-14T05:44:51.4012279Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T05:44:51.4013027Z Compiling xla/literal.cc; 27s local 2025-03-14T05:44:51.4013647Z Compiling xla/service/shape_inference.cc; 11s local 2025-03-14T05:44:51.4014362Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T05:44:51.4015122Z Compiling xla/service/hlo_domain_map.cc; 10s local 2025-03-14T05:44:51.4015865Z Compiling xla/service/hlo_cse.cc; 10s local 2025-03-14T05:44:51.4016817Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T05:44:51.4017988Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local ... 2025-03-14T05:44:51.6011201Z 2025-03-14T05:44:51.6012039Z  2025-03-14T05:44:51.6012540Z  2025-03-14T05:44:51.6012933Z  2025-03-14T05:44:51.6013307Z  2025-03-14T05:44:51.6013690Z  2025-03-14T05:44:51.6014084Z  2025-03-14T05:44:51.6014473Z  2025-03-14T05:44:51.6014845Z  2025-03-14T05:44:51.6015398Z [11,938 / 15,235] 48 actions running 2025-03-14T05:44:51.6016164Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T05:44:51.6016836Z Compiling xla/literal.cc; 27s local 2025-03-14T05:44:51.6017497Z Compiling xla/service/shape_inference.cc; 11s local 2025-03-14T05:44:51.6018241Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T05:44:51.6018973Z Compiling xla/service/hlo_domain_map.cc; 11s local 2025-03-14T05:44:51.6019699Z Compiling xla/service/hlo_cse.cc; 11s local 2025-03-14T05:44:51.6020922Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 11s local 2025-03-14T05:44:51.6022001Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local ... 2025-03-14T05:44:51.8199341Z 2025-03-14T05:44:51.8200287Z  2025-03-14T05:44:51.8200781Z  2025-03-14T05:44:51.8201175Z  2025-03-14T05:44:51.8201541Z  2025-03-14T05:44:51.8201909Z  2025-03-14T05:44:51.8202259Z  2025-03-14T05:44:51.8202628Z  2025-03-14T05:44:51.8203005Z  2025-03-14T05:44:51.8203588Z [11,942 / 15,235] 48 actions, 47 running 2025-03-14T05:44:51.8204328Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T05:44:51.8205178Z Compiling xla/literal.cc; 28s local 2025-03-14T05:44:51.8205800Z Compiling xla/service/shape_inference.cc; 11s local 2025-03-14T05:44:51.8206481Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T05:44:51.8207176Z Compiling xla/service/hlo_domain_map.cc; 11s local 2025-03-14T05:44:51.8207841Z Compiling xla/service/hlo_cse.cc; 11s local 2025-03-14T05:44:51.8208630Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T05:44:51.8209646Z Compiling xla/hlo/transforms/expanders/op_expander_pass.cc; 11s local ... 2025-03-14T05:44:52.1085642Z 2025-03-14T05:44:52.1087078Z  2025-03-14T05:44:52.1087576Z  2025-03-14T05:44:52.1087976Z  2025-03-14T05:44:52.1088375Z  2025-03-14T05:44:52.1088765Z  2025-03-14T05:44:52.1089154Z  2025-03-14T05:44:52.1089524Z  2025-03-14T05:44:52.1089897Z  2025-03-14T05:44:52.1090474Z [11,946 / 15,235] 48 actions, 47 running 2025-03-14T05:44:52.1091206Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T05:44:52.1091905Z Compiling xla/literal.cc; 28s local 2025-03-14T05:44:52.1092573Z Compiling xla/service/shape_inference.cc; 11s local 2025-03-14T05:44:52.1093734Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T05:44:52.1094501Z Compiling xla/service/hlo_domain_map.cc; 11s local 2025-03-14T05:44:52.1095219Z Compiling xla/service/hlo_cse.cc; 11s local 2025-03-14T05:44:52.1096186Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T05:44:52.1097246Z Compiling .../transforms/simplifiers/float_normalization.cc; 11s local ... 2025-03-14T05:44:52.3691011Z 2025-03-14T05:44:52.3692173Z  2025-03-14T05:44:52.3693041Z  2025-03-14T05:44:52.3693810Z  2025-03-14T05:44:52.3694805Z  2025-03-14T05:44:52.3695260Z  2025-03-14T05:44:52.3695715Z  2025-03-14T05:44:52.3696207Z  2025-03-14T05:44:52.3696595Z  2025-03-14T05:44:52.3697380Z [11,948 / 15,235] 48 actions, 47 running 2025-03-14T05:44:52.3698489Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T05:44:52.3699529Z Compiling xla/literal.cc; 28s local 2025-03-14T05:44:52.3700702Z Compiling xla/service/shape_inference.cc; 12s local 2025-03-14T05:44:52.3701788Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T05:44:52.3702868Z Compiling xla/service/hlo_domain_map.cc; 11s local 2025-03-14T05:44:52.3703901Z Compiling xla/service/hlo_cse.cc; 11s local 2025-03-14T05:44:52.3705098Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T05:44:52.3706647Z Compiling .../transforms/simplifiers/float_normalization.cc; 11s local ... 2025-03-14T05:44:52.5802981Z 2025-03-14T05:44:52.5804074Z  2025-03-14T05:44:52.5804750Z  2025-03-14T05:44:52.5805222Z  2025-03-14T05:44:52.5805637Z  2025-03-14T05:44:52.5806058Z  2025-03-14T05:44:52.5806480Z  2025-03-14T05:44:52.5806889Z  2025-03-14T05:44:52.5807263Z  2025-03-14T05:44:52.5807833Z [11,951 / 15,235] 48 actions, 47 running 2025-03-14T05:44:52.5808578Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T05:44:52.5809271Z Compiling xla/literal.cc; 28s local 2025-03-14T05:44:52.5810112Z Compiling xla/service/shape_inference.cc; 12s local 2025-03-14T05:44:52.5811213Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T05:44:52.5811925Z Compiling xla/service/hlo_cse.cc; 12s local 2025-03-14T05:44:52.5812714Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T05:44:52.5813775Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 11s local 2025-03-14T05:44:52.5814791Z Compiling xla/hlo/builder/xla_builder.cc; 11s local ... 2025-03-14T05:44:52.8020909Z 2025-03-14T05:44:52.8021757Z  2025-03-14T05:44:52.8022195Z  2025-03-14T05:44:52.8022554Z  2025-03-14T05:44:52.8022928Z  2025-03-14T05:44:52.8023309Z  2025-03-14T05:44:52.8023688Z  2025-03-14T05:44:52.8024061Z  2025-03-14T05:44:52.8024396Z  2025-03-14T05:44:52.8024883Z [11,952 / 15,235] 48 actions running 2025-03-14T05:44:52.8025598Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T05:44:52.8026281Z Compiling xla/literal.cc; 29s local 2025-03-14T05:44:52.8026921Z Compiling xla/service/shape_inference.cc; 12s local 2025-03-14T05:44:52.8027560Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T05:44:52.8028338Z Compiling xla/service/hlo_cse.cc; 12s local 2025-03-14T05:44:52.8029164Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 12s local 2025-03-14T05:44:52.8030304Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T05:44:52.8031244Z Compiling xla/hlo/builder/xla_builder.cc; 12s local ... 2025-03-14T05:44:53.0024591Z 2025-03-14T05:44:53.0025377Z  2025-03-14T05:44:53.0025869Z  2025-03-14T05:44:53.0026273Z  2025-03-14T05:44:53.0026683Z  2025-03-14T05:44:53.0027110Z  2025-03-14T05:44:53.0027512Z  2025-03-14T05:44:53.0027920Z  2025-03-14T05:44:53.0028326Z  2025-03-14T05:44:53.0028862Z [11,953 / 15,235] 48 actions running 2025-03-14T05:44:53.0030301Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T05:44:53.0031065Z Compiling xla/literal.cc; 29s local 2025-03-14T05:44:53.0031751Z Compiling xla/service/shape_inference.cc; 12s local 2025-03-14T05:44:53.0032547Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T05:44:53.0033259Z Compiling xla/service/hlo_cse.cc; 12s local 2025-03-14T05:44:53.0034230Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T05:44:53.0035285Z Compiling xla/hlo/builder/xla_builder.cc; 12s local 2025-03-14T05:44:53.0036116Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local ... 2025-03-14T05:44:53.2210583Z 2025-03-14T05:44:53.2211485Z  2025-03-14T05:44:53.2211982Z  2025-03-14T05:44:53.2212431Z  2025-03-14T05:44:53.2212851Z  2025-03-14T05:44:53.2213285Z  2025-03-14T05:44:53.2213706Z  2025-03-14T05:44:53.2214139Z  2025-03-14T05:44:53.2214556Z  2025-03-14T05:44:53.2215177Z [11,955 / 15,235] 48 actions, 47 running 2025-03-14T05:44:53.2216013Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T05:44:53.2216753Z Compiling xla/literal.cc; 29s local 2025-03-14T05:44:53.2217370Z Compiling xla/service/shape_inference.cc; 12s local 2025-03-14T05:44:53.2218069Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T05:44:53.2218703Z Compiling xla/service/hlo_cse.cc; 12s local 2025-03-14T05:44:53.2219644Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T05:44:53.2220627Z Compiling xla/hlo/builder/xla_builder.cc; 12s local 2025-03-14T05:44:53.2221459Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local ... 2025-03-14T05:44:53.6030317Z 2025-03-14T05:44:53.6031175Z  2025-03-14T05:44:53.6031638Z  2025-03-14T05:44:53.6032043Z  2025-03-14T05:44:53.6032438Z  2025-03-14T05:44:53.6032823Z  2025-03-14T05:44:53.6033205Z  2025-03-14T05:44:53.6033588Z  2025-03-14T05:44:53.6034003Z  2025-03-14T05:44:53.6034547Z [11,956 / 15,235] 48 actions running 2025-03-14T05:44:53.6035622Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T05:44:53.6036334Z Compiling xla/literal.cc; 29s local 2025-03-14T05:44:53.6037174Z Compiling xla/service/shape_inference.cc; 13s local 2025-03-14T05:44:53.6037944Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T05:44:53.6038673Z Compiling xla/service/hlo_cse.cc; 13s local 2025-03-14T05:44:53.6039697Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T05:44:53.6040759Z Compiling xla/hlo/builder/xla_builder.cc; 12s local 2025-03-14T05:44:53.6041596Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local ... 2025-03-14T05:44:54.0035930Z 2025-03-14T05:44:54.0036829Z  2025-03-14T05:44:54.0037313Z  2025-03-14T05:44:54.0037715Z  2025-03-14T05:44:54.0038097Z  2025-03-14T05:44:54.0038516Z  2025-03-14T05:44:54.0038975Z  2025-03-14T05:44:54.0039392Z  2025-03-14T05:44:54.0039823Z  2025-03-14T05:44:54.0040371Z [11,957 / 15,235] 48 actions running 2025-03-14T05:44:54.0041091Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T05:44:54.0041830Z Compiling xla/literal.cc; 30s local 2025-03-14T05:44:54.0042501Z Compiling xla/service/shape_inference.cc; 13s local 2025-03-14T05:44:54.0043261Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T05:44:54.0043959Z Compiling xla/service/hlo_cse.cc; 13s local 2025-03-14T05:44:54.0045071Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2025-03-14T05:44:54.0046154Z Compiling xla/hlo/builder/xla_builder.cc; 13s local 2025-03-14T05:44:54.0046978Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local ... 2025-03-14T05:44:54.2099962Z 2025-03-14T05:44:54.2100823Z  2025-03-14T05:44:54.2101312Z  2025-03-14T05:44:54.2101664Z  2025-03-14T05:44:54.2102052Z  2025-03-14T05:44:54.2102817Z  2025-03-14T05:44:54.2103276Z  2025-03-14T05:44:54.2103696Z  2025-03-14T05:44:54.2104047Z  2025-03-14T05:44:54.2104671Z [11,959 / 15,235] 48 actions, 47 running 2025-03-14T05:44:54.2105461Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T05:44:54.2106207Z Compiling xla/literal.cc; 30s local 2025-03-14T05:44:54.2106915Z Compiling xla/service/shape_inference.cc; 13s local 2025-03-14T05:44:54.2107712Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T05:44:54.2108743Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2025-03-14T05:44:54.2109794Z Compiling xla/hlo/builder/xla_builder.cc; 13s local 2025-03-14T05:44:54.2110563Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2025-03-14T05:44:54.2111413Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 10s local ... 2025-03-14T05:44:54.5582776Z 2025-03-14T05:44:54.5583582Z  2025-03-14T05:44:54.5584118Z  2025-03-14T05:44:54.5584484Z  2025-03-14T05:44:54.5584851Z  2025-03-14T05:44:54.5585252Z  2025-03-14T05:44:54.5585752Z  2025-03-14T05:44:54.5586155Z  2025-03-14T05:44:54.5586567Z  2025-03-14T05:44:54.5587192Z [11,961 / 15,235] 48 actions, 47 running 2025-03-14T05:44:54.5587974Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T05:44:54.5588649Z Compiling xla/literal.cc; 30s local 2025-03-14T05:44:54.5589317Z Compiling xla/service/shape_inference.cc; 14s local 2025-03-14T05:44:54.5590030Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T05:44:54.5590729Z Compiling xla/hlo/builder/xla_builder.cc; 13s local 2025-03-14T05:44:54.5591534Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2025-03-14T05:44:54.5592328Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 10s local 2025-03-14T05:44:54.5593414Z Compiling .../transforms/expanders/comparison_expander.cc; 10s local ... 2025-03-14T05:44:54.8045914Z 2025-03-14T05:44:54.8046796Z  2025-03-14T05:44:54.8047652Z  2025-03-14T05:44:54.8048051Z  2025-03-14T05:44:54.8048436Z  2025-03-14T05:44:54.8048808Z  2025-03-14T05:44:54.8049206Z  2025-03-14T05:44:54.8049586Z  2025-03-14T05:44:54.8049982Z  2025-03-14T05:44:54.8050542Z [11,963 / 15,235] 48 actions running 2025-03-14T05:44:54.8051275Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T05:44:54.8051979Z Compiling xla/literal.cc; 31s local 2025-03-14T05:44:54.8052647Z Compiling xla/service/shape_inference.cc; 14s local 2025-03-14T05:44:54.8053393Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T05:44:54.8054110Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2025-03-14T05:44:54.8054845Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2025-03-14T05:44:54.8055680Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 11s local 2025-03-14T05:44:54.8056749Z Compiling .../transforms/expanders/comparison_expander.cc; 10s local ... 2025-03-14T05:44:55.1392081Z 2025-03-14T05:44:55.1392935Z  2025-03-14T05:44:55.1393335Z  2025-03-14T05:44:55.1393725Z  2025-03-14T05:44:55.1394086Z  2025-03-14T05:44:55.1394452Z  2025-03-14T05:44:55.1394785Z  2025-03-14T05:44:55.1395112Z  2025-03-14T05:44:55.1395448Z  2025-03-14T05:44:55.1396045Z [11,964 / 15,235] 48 actions, 47 running 2025-03-14T05:44:55.1396783Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T05:44:55.1397349Z Compiling xla/literal.cc; 31s local 2025-03-14T05:44:55.1406810Z Compiling xla/service/shape_inference.cc; 14s local 2025-03-14T05:44:55.1407741Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T05:44:55.1408554Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2025-03-14T05:44:55.1409330Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2025-03-14T05:44:55.1411448Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 11s local 2025-03-14T05:44:55.1412544Z Compiling .../transforms/expanders/comparison_expander.cc; 10s local ... 2025-03-14T05:44:55.3420279Z 2025-03-14T05:44:55.3421140Z  2025-03-14T05:44:55.3421628Z  2025-03-14T05:44:55.3422078Z  2025-03-14T05:44:55.3422489Z  2025-03-14T05:44:55.3422880Z  2025-03-14T05:44:55.3423318Z  2025-03-14T05:44:55.3423752Z  2025-03-14T05:44:55.3424194Z  2025-03-14T05:44:55.3424842Z [11,966 / 15,235] 48 actions, 47 running 2025-03-14T05:44:55.3425755Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T05:44:55.3426490Z Compiling xla/literal.cc; 31s local 2025-03-14T05:44:55.3427152Z Compiling xla/service/shape_inference.cc; 14s local 2025-03-14T05:44:55.3427865Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T05:44:55.3428576Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2025-03-14T05:44:55.3429379Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2025-03-14T05:44:55.3430254Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 11s local 2025-03-14T05:44:55.3431400Z Compiling .../transforms/expanders/comparison_expander.cc; 11s local ... 2025-03-14T05:44:55.5605375Z 2025-03-14T05:44:55.5606180Z  2025-03-14T05:44:55.5606701Z  2025-03-14T05:44:55.5607152Z  2025-03-14T05:44:55.5607550Z  2025-03-14T05:44:55.5607978Z  2025-03-14T05:44:55.5608407Z  2025-03-14T05:44:55.5608839Z  2025-03-14T05:44:55.5609271Z  2025-03-14T05:44:55.5609885Z [11,969 / 15,235] 48 actions, 47 running 2025-03-14T05:44:55.5610672Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T05:44:55.5611419Z Compiling xla/literal.cc; 31s local 2025-03-14T05:44:55.5612102Z Compiling xla/service/shape_inference.cc; 15s local 2025-03-14T05:44:55.5612879Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T05:44:55.5613655Z Compiling xla/hlo/builder/xla_builder.cc; 14s local 2025-03-14T05:44:55.5614502Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2025-03-14T05:44:55.5615855Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T05:44:55.5616874Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T05:44:55.8052962Z 2025-03-14T05:44:55.8053755Z  2025-03-14T05:44:55.8054241Z  2025-03-14T05:44:55.8054661Z  2025-03-14T05:44:55.8055079Z  2025-03-14T05:44:55.8055496Z  2025-03-14T05:44:55.8055905Z  2025-03-14T05:44:55.8056323Z  2025-03-14T05:44:55.8056831Z  2025-03-14T05:44:55.8057403Z [11,970 / 15,235] 48 actions running 2025-03-14T05:44:55.8058459Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T05:44:55.8059175Z Compiling xla/literal.cc; 32s local 2025-03-14T05:44:55.8059871Z Compiling xla/service/shape_inference.cc; 15s local 2025-03-14T05:44:55.8060628Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T05:44:55.8061405Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2025-03-14T05:44:55.8062210Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2025-03-14T05:44:55.8063194Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T05:44:55.8064173Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T05:44:56.0136309Z 2025-03-14T05:44:56.0137186Z  2025-03-14T05:44:56.0137672Z  2025-03-14T05:44:56.0138094Z  2025-03-14T05:44:56.0138509Z  2025-03-14T05:44:56.0138895Z  2025-03-14T05:44:56.0139288Z  2025-03-14T05:44:56.0139692Z  2025-03-14T05:44:56.0140090Z  2025-03-14T05:44:56.0140694Z [11,973 / 15,235] 48 actions, 47 running 2025-03-14T05:44:56.0141418Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T05:44:56.0142131Z Compiling xla/literal.cc; 32s local 2025-03-14T05:44:56.0142841Z Compiling xla/service/shape_inference.cc; 15s local 2025-03-14T05:44:56.0143926Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T05:44:56.0144683Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2025-03-14T05:44:56.0145485Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2025-03-14T05:44:56.0146506Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T05:44:56.0147498Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T05:44:56.2279788Z 2025-03-14T05:44:56.2280584Z  2025-03-14T05:44:56.2281078Z  2025-03-14T05:44:56.2281484Z  2025-03-14T05:44:56.2281866Z  2025-03-14T05:44:56.2282242Z  2025-03-14T05:44:56.2282640Z  2025-03-14T05:44:56.2282965Z  2025-03-14T05:44:56.2283328Z  2025-03-14T05:44:56.2283875Z [11,975 / 15,235] 48 actions, 47 running 2025-03-14T05:44:56.2284874Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T05:44:56.2285573Z Compiling xla/literal.cc; 32s local 2025-03-14T05:44:56.2286306Z Compiling xla/service/shape_inference.cc; 15s local 2025-03-14T05:44:56.2287024Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T05:44:56.2287821Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2025-03-14T05:44:56.2288614Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2025-03-14T05:44:56.2289276Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:44:56.2290013Z @xla//xla/hlo/transforms:dynamic_index_splitter; 11s local ... 2025-03-14T05:44:56.5979405Z 2025-03-14T05:44:56.5980209Z  2025-03-14T05:44:56.5980710Z  2025-03-14T05:44:56.5981129Z  2025-03-14T05:44:56.5981547Z  2025-03-14T05:44:56.5981959Z  2025-03-14T05:44:56.5982296Z  2025-03-14T05:44:56.5982651Z  2025-03-14T05:44:56.5983095Z  2025-03-14T05:44:56.5983656Z [11,978 / 15,235] 48 actions, 47 running 2025-03-14T05:44:56.5984426Z Compiling xla/hlo/ir/hlo_instruction.cc; 37s local 2025-03-14T05:44:56.5985133Z Compiling xla/literal.cc; 32s local 2025-03-14T05:44:56.5985897Z Compiling xla/service/shape_inference.cc; 16s local 2025-03-14T05:44:56.5986985Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T05:44:56.5987687Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2025-03-14T05:44:56.5988452Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2025-03-14T05:44:56.5989164Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:44:56.5989928Z @xla//xla/hlo/transforms:dynamic_index_splitter; 11s local ... 2025-03-14T05:44:56.8063597Z 2025-03-14T05:44:56.8064452Z  2025-03-14T05:44:56.8064940Z  2025-03-14T05:44:56.8065540Z  2025-03-14T05:44:56.8065959Z  2025-03-14T05:44:56.8066364Z  2025-03-14T05:44:56.8066754Z  2025-03-14T05:44:56.8067156Z  2025-03-14T05:44:56.8067563Z  2025-03-14T05:44:56.8068138Z [11,982 / 15,235] 48 actions running 2025-03-14T05:44:56.8068949Z Compiling xla/literal.cc; 33s local 2025-03-14T05:44:56.8069675Z Compiling xla/service/shape_inference.cc; 16s local 2025-03-14T05:44:56.8070413Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T05:44:56.8071171Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2025-03-14T05:44:56.8071930Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2025-03-14T05:44:56.8072638Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T05:44:56.8073510Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 11s local 2025-03-14T05:44:56.8074593Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 9s local ... 2025-03-14T05:44:57.1314524Z 2025-03-14T05:44:57.1315386Z  2025-03-14T05:44:57.1315888Z  2025-03-14T05:44:57.1316316Z  2025-03-14T05:44:57.1316744Z  2025-03-14T05:44:57.1317157Z  2025-03-14T05:44:57.1317579Z  2025-03-14T05:44:57.1317989Z  2025-03-14T05:44:57.1318414Z  2025-03-14T05:44:57.1319033Z [11,987 / 15,235] 48 actions, 47 running 2025-03-14T05:44:57.1319714Z Compiling xla/literal.cc; 33s local 2025-03-14T05:44:57.1320766Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T05:44:57.1321538Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2025-03-14T05:44:57.1322302Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2025-03-14T05:44:57.1323010Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:57.1323852Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2025-03-14T05:44:57.1324911Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T05:44:57.1325713Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local ... 2025-03-14T05:44:57.4071023Z 2025-03-14T05:44:57.4071993Z  2025-03-14T05:44:57.4072441Z  2025-03-14T05:44:57.4072805Z  2025-03-14T05:44:57.4073167Z  2025-03-14T05:44:57.4073538Z  2025-03-14T05:44:57.4073956Z  2025-03-14T05:44:57.4074344Z  2025-03-14T05:44:57.4074723Z  2025-03-14T05:44:57.4075280Z [11,989 / 15,235] 48 actions running 2025-03-14T05:44:57.4075979Z Compiling xla/literal.cc; 33s local 2025-03-14T05:44:57.4076659Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T05:44:57.4077365Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2025-03-14T05:44:57.4078112Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2025-03-14T05:44:57.4078825Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:57.4079710Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2025-03-14T05:44:57.4080644Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T05:44:57.4081462Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local ... 2025-03-14T05:44:57.6077648Z 2025-03-14T05:44:57.6078480Z  2025-03-14T05:44:57.6078990Z  2025-03-14T05:44:57.6079395Z  2025-03-14T05:44:57.6079796Z  2025-03-14T05:44:57.6080218Z  2025-03-14T05:44:57.6080614Z  2025-03-14T05:44:57.6081033Z  2025-03-14T05:44:57.6081441Z  2025-03-14T05:44:57.6082055Z [11,990 / 15,235] 48 actions running 2025-03-14T05:44:57.6082750Z Compiling xla/literal.cc; 33s local 2025-03-14T05:44:57.6083764Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T05:44:57.6084750Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2025-03-14T05:44:57.6085470Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2025-03-14T05:44:57.6086192Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:57.6086999Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local 2025-03-14T05:44:57.6087859Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T05:44:57.6088641Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local ... 2025-03-14T05:44:57.9097326Z 2025-03-14T05:44:57.9098208Z  2025-03-14T05:44:57.9098715Z  2025-03-14T05:44:57.9099128Z  2025-03-14T05:44:57.9099540Z  2025-03-14T05:44:57.9099964Z  2025-03-14T05:44:57.9100381Z  2025-03-14T05:44:57.9100798Z  2025-03-14T05:44:57.9101184Z  2025-03-14T05:44:57.9101825Z [11,993 / 15,235] 48 actions, 47 running 2025-03-14T05:44:57.9102538Z Compiling xla/literal.cc; 34s local 2025-03-14T05:44:57.9103187Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T05:44:57.9103842Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2025-03-14T05:44:57.9104627Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T05:44:57.9105337Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:44:57.9105980Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T05:44:57.9106708Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T05:44:57.9107586Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 10s local ... 2025-03-14T05:44:58.2080810Z 2025-03-14T05:44:58.2081625Z  2025-03-14T05:44:58.2082141Z  2025-03-14T05:44:58.2082581Z  2025-03-14T05:44:58.2083022Z  2025-03-14T05:44:58.2083457Z  2025-03-14T05:44:58.2083884Z  2025-03-14T05:44:58.2084311Z  2025-03-14T05:44:58.2085366Z  2025-03-14T05:44:58.2086100Z [11,995 / 15,235] 48 actions running 2025-03-14T05:44:58.2086819Z Compiling xla/literal.cc; 34s local 2025-03-14T05:44:58.2087501Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T05:44:58.2088297Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2025-03-14T05:44:58.2089068Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T05:44:58.2089834Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T05:44:58.2090643Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T05:44:58.2091617Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 10s local 2025-03-14T05:44:58.2092594Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T05:44:58.4084732Z 2025-03-14T05:44:58.4085606Z  2025-03-14T05:44:58.4086029Z  2025-03-14T05:44:58.4086382Z  2025-03-14T05:44:58.4086742Z  2025-03-14T05:44:58.4087109Z  2025-03-14T05:44:58.4087451Z  2025-03-14T05:44:58.4087840Z  2025-03-14T05:44:58.4088203Z  2025-03-14T05:44:58.4088717Z [11,996 / 15,235] 48 actions running 2025-03-14T05:44:58.4089333Z Compiling xla/literal.cc; 34s local 2025-03-14T05:44:58.4089944Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T05:44:58.4090618Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2025-03-14T05:44:58.4091319Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T05:44:58.4092007Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T05:44:58.4092695Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T05:44:58.4093560Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 10s local 2025-03-14T05:44:58.4094405Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T05:44:58.6707329Z 2025-03-14T05:44:58.6708172Z  2025-03-14T05:44:58.6708644Z  2025-03-14T05:44:58.6709047Z  2025-03-14T05:44:58.6709435Z  2025-03-14T05:44:58.6709830Z  2025-03-14T05:44:58.6710190Z  2025-03-14T05:44:58.6710870Z  2025-03-14T05:44:58.6711240Z  2025-03-14T05:44:58.6711807Z [11,998 / 15,235] 48 actions, 47 running 2025-03-14T05:44:58.6712466Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T05:44:58.6713166Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2025-03-14T05:44:58.6713961Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T05:44:58.6714656Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T05:44:58.6715377Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T05:44:58.6716291Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 10s local 2025-03-14T05:44:58.6717399Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 10s local 2025-03-14T05:44:58.6718304Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T05:44:58.9514832Z 2025-03-14T05:44:58.9515722Z  2025-03-14T05:44:58.9516220Z  2025-03-14T05:44:58.9516652Z  2025-03-14T05:44:58.9517048Z  2025-03-14T05:44:58.9517436Z  2025-03-14T05:44:58.9517814Z  2025-03-14T05:44:58.9518203Z  2025-03-14T05:44:58.9518587Z  2025-03-14T05:44:58.9519204Z [11,999 / 15,235] 48 actions, 47 running 2025-03-14T05:44:58.9519939Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T05:44:58.9520676Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2025-03-14T05:44:58.9521474Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T05:44:58.9522225Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T05:44:58.9522990Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T05:44:58.9523926Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 11s local 2025-03-14T05:44:58.9525169Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 10s local 2025-03-14T05:44:58.9526120Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T05:44:59.2091756Z 2025-03-14T05:44:59.2092648Z  2025-03-14T05:44:59.2093302Z  2025-03-14T05:44:59.2093768Z  2025-03-14T05:44:59.2094170Z  2025-03-14T05:44:59.2094541Z  2025-03-14T05:44:59.2094923Z  2025-03-14T05:44:59.2095302Z  2025-03-14T05:44:59.2095691Z  2025-03-14T05:44:59.2096285Z [12,001 / 15,235] 48 actions running 2025-03-14T05:44:59.2096994Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T05:44:59.2097739Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2025-03-14T05:44:59.2098537Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T05:44:59.2099198Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T05:44:59.2099972Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T05:44:59.2101095Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 11s local 2025-03-14T05:44:59.2102233Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 11s local 2025-03-14T05:44:59.2103277Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T05:44:59.4599155Z 2025-03-14T05:44:59.4600048Z  2025-03-14T05:44:59.4600563Z  2025-03-14T05:44:59.4600976Z  2025-03-14T05:44:59.4601501Z  2025-03-14T05:44:59.4601999Z  2025-03-14T05:44:59.4602397Z  2025-03-14T05:44:59.4602799Z  2025-03-14T05:44:59.4603191Z  2025-03-14T05:44:59.4603790Z [12,002 / 15,235] 48 actions, 47 running 2025-03-14T05:44:59.4604513Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2025-03-14T05:44:59.4605437Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2025-03-14T05:44:59.4606253Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T05:44:59.4607015Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T05:44:59.4607948Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T05:44:59.4608958Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 11s local 2025-03-14T05:44:59.4610261Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 11s local 2025-03-14T05:44:59.4611809Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T05:44:59.7745913Z 2025-03-14T05:44:59.7746702Z  2025-03-14T05:44:59.7747204Z  2025-03-14T05:44:59.7747612Z  2025-03-14T05:44:59.7748001Z  2025-03-14T05:44:59.7748440Z  2025-03-14T05:44:59.7748822Z  2025-03-14T05:44:59.7749220Z  2025-03-14T05:44:59.7749580Z  2025-03-14T05:44:59.7750187Z [12,003 / 15,235] 48 actions, 47 running 2025-03-14T05:44:59.7750893Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2025-03-14T05:44:59.7751619Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T05:44:59.7752425Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T05:44:59.7753182Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T05:44:59.7753957Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T05:44:59.7754982Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 12s local 2025-03-14T05:44:59.7756115Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 11s local 2025-03-14T05:44:59.7757016Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T05:45:00.0098394Z 2025-03-14T05:45:00.0099225Z  2025-03-14T05:45:00.0099743Z  2025-03-14T05:45:00.0100159Z  2025-03-14T05:45:00.0100587Z  2025-03-14T05:45:00.0101002Z  2025-03-14T05:45:00.0101417Z  2025-03-14T05:45:00.0101834Z  2025-03-14T05:45:00.0102222Z  2025-03-14T05:45:00.0102794Z [12,005 / 15,235] 48 actions running 2025-03-14T05:45:00.0103523Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2025-03-14T05:45:00.0104260Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T05:45:00.0105067Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T05:45:00.0105846Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T05:45:00.0107023Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T05:45:00.0107964Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 12s local 2025-03-14T05:45:00.0109100Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 11s local 2025-03-14T05:45:00.0110095Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T05:45:00.3181615Z 2025-03-14T05:45:00.3182487Z  2025-03-14T05:45:00.3183029Z  2025-03-14T05:45:00.3183490Z  2025-03-14T05:45:00.3183916Z  2025-03-14T05:45:00.3184343Z  2025-03-14T05:45:00.3184752Z  2025-03-14T05:45:00.3185169Z  2025-03-14T05:45:00.3185579Z  2025-03-14T05:45:00.3186211Z [12,010 / 15,235] 48 actions, 47 running 2025-03-14T05:45:00.3187000Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T05:45:00.3187802Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T05:45:00.3188535Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2025-03-14T05:45:00.3189368Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T05:45:00.3190369Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 12s local 2025-03-14T05:45:00.3191514Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 12s local 2025-03-14T05:45:00.3192489Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:45:00.3193425Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 11s local ... 2025-03-14T05:45:00.6104647Z 2025-03-14T05:45:00.6105546Z  2025-03-14T05:45:00.6106045Z  2025-03-14T05:45:00.6106474Z  2025-03-14T05:45:00.6106880Z  2025-03-14T05:45:00.6107309Z  2025-03-14T05:45:00.6107730Z  2025-03-14T05:45:00.6108158Z  2025-03-14T05:45:00.6108550Z  2025-03-14T05:45:00.6109131Z [12,011 / 15,235] 48 actions running 2025-03-14T05:45:00.6109890Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T05:45:00.6110708Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T05:45:00.6111480Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2025-03-14T05:45:00.6112700Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T05:45:00.6113776Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 12s local 2025-03-14T05:45:00.6114986Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 12s local 2025-03-14T05:45:00.6116004Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:45:00.6116985Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 11s local ... 2025-03-14T05:45:00.8933353Z 2025-03-14T05:45:00.8934168Z  2025-03-14T05:45:00.8934599Z  2025-03-14T05:45:00.8934997Z  2025-03-14T05:45:00.8935373Z  2025-03-14T05:45:00.8935748Z  2025-03-14T05:45:00.8936133Z  2025-03-14T05:45:00.8936509Z  2025-03-14T05:45:00.8936901Z  2025-03-14T05:45:00.8937448Z [12,013 / 15,235] 48 actions, 47 running 2025-03-14T05:45:00.8938183Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T05:45:00.8938906Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T05:45:00.8939660Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T05:45:00.8940534Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2025-03-14T05:45:00.8941543Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 12s local 2025-03-14T05:45:00.8942401Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:45:00.8943188Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T05:45:00.8944100Z @xla//xla/hlo/transforms:reduce_window_rewriter; 12s local ... 2025-03-14T05:45:01.2028787Z 2025-03-14T05:45:01.2029634Z  2025-03-14T05:45:01.2030216Z  2025-03-14T05:45:01.2030720Z  2025-03-14T05:45:01.2031098Z  2025-03-14T05:45:01.2031538Z  2025-03-14T05:45:01.2031991Z  2025-03-14T05:45:01.2032428Z  2025-03-14T05:45:01.2032854Z  2025-03-14T05:45:01.2033899Z [12,017 / 15,235] 48 actions, 47 running 2025-03-14T05:45:01.2034637Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T05:45:01.2035333Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T05:45:01.2036050Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T05:45:01.2036916Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2025-03-14T05:45:01.2037968Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:01.2038859Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T05:45:01.2039699Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T05:45:01.2040679Z @xla//xla/hlo/transforms:reduce_window_rewriter; 12s local ... 2025-03-14T05:45:01.4111359Z 2025-03-14T05:45:01.4112185Z  2025-03-14T05:45:01.4112583Z  2025-03-14T05:45:01.4112917Z  2025-03-14T05:45:01.4113254Z  2025-03-14T05:45:01.4113664Z  2025-03-14T05:45:01.4114059Z  2025-03-14T05:45:01.4114471Z  2025-03-14T05:45:01.4114853Z  2025-03-14T05:45:01.4115398Z [12,017 / 15,235] 48 actions running 2025-03-14T05:45:01.4116180Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T05:45:01.4116847Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T05:45:01.4117593Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T05:45:01.4118512Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2025-03-14T05:45:01.4119675Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:01.4120596Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:45:01.4121397Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T05:45:01.4122369Z @xla//xla/hlo/transforms:reduce_window_rewriter; 12s local ... 2025-03-14T05:45:01.6115684Z 2025-03-14T05:45:01.6116519Z  2025-03-14T05:45:01.6117068Z  2025-03-14T05:45:01.6117861Z  2025-03-14T05:45:01.6118248Z  2025-03-14T05:45:01.6118621Z  2025-03-14T05:45:01.6119100Z  2025-03-14T05:45:01.6119483Z  2025-03-14T05:45:01.6119874Z  2025-03-14T05:45:01.6120405Z [12,018 / 15,235] 48 actions running 2025-03-14T05:45:01.6121141Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T05:45:01.6121868Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T05:45:01.6122628Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T05:45:01.6123550Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 13s local 2025-03-14T05:45:01.6124831Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:01.6125765Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:45:01.6126616Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T05:45:01.6127725Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 11s local ... 2025-03-14T05:45:01.8889333Z 2025-03-14T05:45:01.8890201Z  2025-03-14T05:45:01.8890749Z  2025-03-14T05:45:01.8891223Z  2025-03-14T05:45:01.8891691Z  2025-03-14T05:45:01.8892163Z  2025-03-14T05:45:01.8892642Z  2025-03-14T05:45:01.8893107Z  2025-03-14T05:45:01.8893584Z  2025-03-14T05:45:01.8894417Z [12,022 / 15,235] 48 actions, 47 running 2025-03-14T05:45:01.8895243Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T05:45:01.8896076Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T05:45:01.8896748Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T05:45:01.8897529Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 14s local 2025-03-14T05:45:01.8898439Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:01.8899204Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:45:01.8900430Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 13s local 2025-03-14T05:45:01.8901553Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 11s local ... 2025-03-14T05:45:02.0905088Z 2025-03-14T05:45:02.0905932Z  2025-03-14T05:45:02.0906546Z  2025-03-14T05:45:02.0906988Z  2025-03-14T05:45:02.0907438Z  2025-03-14T05:45:02.0907885Z  2025-03-14T05:45:02.0908315Z  2025-03-14T05:45:02.0908722Z  2025-03-14T05:45:02.0909127Z  2025-03-14T05:45:02.0909743Z [12,024 / 15,235] 48 actions, 47 running 2025-03-14T05:45:02.0910540Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T05:45:02.0911354Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T05:45:02.0912172Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T05:45:02.0913169Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 14s local 2025-03-14T05:45:02.0914470Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:02.0915511Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T05:45:02.0916433Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 11s local 2025-03-14T05:45:02.0917536Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 10s local ... 2025-03-14T05:45:02.4123130Z 2025-03-14T05:45:02.4123914Z  2025-03-14T05:45:02.4124356Z  2025-03-14T05:45:02.4124882Z  2025-03-14T05:45:02.4125254Z  2025-03-14T05:45:02.4125648Z  2025-03-14T05:45:02.4126019Z  2025-03-14T05:45:02.4126381Z  2025-03-14T05:45:02.4126734Z  2025-03-14T05:45:02.4127257Z [12,026 / 15,235] 48 actions running 2025-03-14T05:45:02.4127933Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T05:45:02.4128640Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T05:45:02.4129376Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T05:45:02.4130279Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 14s local 2025-03-14T05:45:02.4131684Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 14s local 2025-03-14T05:45:02.4132558Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T05:45:02.4133359Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 11s local 2025-03-14T05:45:02.4134299Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 10s local ... 2025-03-14T05:45:02.6127541Z 2025-03-14T05:45:02.6128386Z  2025-03-14T05:45:02.6128832Z  2025-03-14T05:45:02.6129208Z  2025-03-14T05:45:02.6129560Z  2025-03-14T05:45:02.6129935Z  2025-03-14T05:45:02.6130306Z  2025-03-14T05:45:02.6130668Z  2025-03-14T05:45:02.6131035Z  2025-03-14T05:45:02.6131561Z [12,028 / 15,235] 48 actions running 2025-03-14T05:45:02.6132244Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T05:45:02.6132988Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T05:45:02.6133706Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T05:45:02.6134584Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 14s local 2025-03-14T05:45:02.6135636Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 14s local 2025-03-14T05:45:02.6136493Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T05:45:02.6137296Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 12s local 2025-03-14T05:45:02.6138225Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 11s local ... 2025-03-14T05:45:02.8174833Z 2025-03-14T05:45:02.8175636Z  2025-03-14T05:45:02.8176244Z  2025-03-14T05:45:02.8176674Z  2025-03-14T05:45:02.8177075Z  2025-03-14T05:45:02.8177484Z  2025-03-14T05:45:02.8177880Z  2025-03-14T05:45:02.8178281Z  2025-03-14T05:45:02.8178657Z  2025-03-14T05:45:02.8179279Z [12,029 / 15,235] 48 actions, 47 running 2025-03-14T05:45:02.8180335Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T05:45:02.8181051Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T05:45:02.8181777Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T05:45:02.8182679Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2025-03-14T05:45:02.8183805Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 14s local 2025-03-14T05:45:02.8184741Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T05:45:02.8185607Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 12s local 2025-03-14T05:45:02.8186778Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 11s local ... 2025-03-14T05:45:03.2055209Z 2025-03-14T05:45:03.2056071Z  2025-03-14T05:45:03.2056568Z  2025-03-14T05:45:03.2057000Z  2025-03-14T05:45:03.2057399Z  2025-03-14T05:45:03.2057806Z  2025-03-14T05:45:03.2058218Z  2025-03-14T05:45:03.2058637Z  2025-03-14T05:45:03.2059091Z  2025-03-14T05:45:03.2059706Z [12,031 / 15,235] 48 actions, 47 running 2025-03-14T05:45:03.2060506Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T05:45:03.2061298Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T05:45:03.2062114Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T05:45:03.2063118Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2025-03-14T05:45:03.2064316Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2025-03-14T05:45:03.2065262Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T05:45:03.2066399Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 12s local 2025-03-14T05:45:03.2067320Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 11s local ... 2025-03-14T05:45:03.4134000Z 2025-03-14T05:45:03.4134859Z  2025-03-14T05:45:03.4135361Z  2025-03-14T05:45:03.4135790Z  2025-03-14T05:45:03.4136223Z  2025-03-14T05:45:03.4136680Z  2025-03-14T05:45:03.4137059Z  2025-03-14T05:45:03.4137816Z  2025-03-14T05:45:03.4138235Z  2025-03-14T05:45:03.4138822Z [12,034 / 15,235] 48 actions running 2025-03-14T05:45:03.4139609Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T05:45:03.4140361Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T05:45:03.4141136Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T05:45:03.4142127Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2025-03-14T05:45:03.4143337Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2025-03-14T05:45:03.4144324Z @llvm-project//llvm:llvm-tblgen; 15s local 2025-03-14T05:45:03.4145172Z Compiling xla/hlo/transforms/expanders/dot_decomposer.cc; 12s local 2025-03-14T05:45:03.4146281Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 11s local ... 2025-03-14T05:45:03.6137975Z 2025-03-14T05:45:03.6138823Z  2025-03-14T05:45:03.6139299Z  2025-03-14T05:45:03.6139727Z  2025-03-14T05:45:03.6140109Z  2025-03-14T05:45:03.6140509Z  2025-03-14T05:45:03.6140882Z  2025-03-14T05:45:03.6141237Z  2025-03-14T05:45:03.6141615Z  2025-03-14T05:45:03.6142176Z [12,036 / 15,235] 48 actions running 2025-03-14T05:45:03.6142922Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T05:45:03.6143673Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T05:45:03.6144428Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T05:45:03.6145271Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 15s local 2025-03-14T05:45:03.6146545Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2025-03-14T05:45:03.6147498Z @llvm-project//llvm:llvm-tblgen; 15s local 2025-03-14T05:45:03.6148371Z Compiling xla/service/batched_gather_scatter_normalizer.cc; 11s local 2025-03-14T05:45:03.6149755Z Compiling xla/hlo/builder/lib/constants.cc; 9s local ... 2025-03-14T05:45:03.8565749Z 2025-03-14T05:45:03.8566605Z  2025-03-14T05:45:03.8567104Z  2025-03-14T05:45:03.8567516Z  2025-03-14T05:45:03.8567932Z  2025-03-14T05:45:03.8568338Z  2025-03-14T05:45:03.8568736Z  2025-03-14T05:45:03.8569140Z  2025-03-14T05:45:03.8569541Z  2025-03-14T05:45:03.8570152Z [12,039 / 15,235] 48 actions, 47 running 2025-03-14T05:45:03.8570857Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T05:45:03.8571650Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T05:45:03.8572437Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T05:45:03.8573388Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2025-03-14T05:45:03.8574517Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2025-03-14T05:45:03.8575603Z Compiling xla/service/batched_gather_scatter_normalizer.cc; 11s local 2025-03-14T05:45:03.8576442Z Compiling xla/hlo/builder/lib/constants.cc; 9s local 2025-03-14T05:45:03.8577123Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2025-03-14T05:45:04.0601676Z 2025-03-14T05:45:04.0602393Z  2025-03-14T05:45:04.0602841Z  2025-03-14T05:45:04.0603258Z  2025-03-14T05:45:04.0603670Z  2025-03-14T05:45:04.0604067Z  2025-03-14T05:45:04.0604456Z  2025-03-14T05:45:04.0604974Z  2025-03-14T05:45:04.0605375Z  2025-03-14T05:45:04.0605948Z [12,045 / 15,235] 48 actions, 47 running 2025-03-14T05:45:04.0606724Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T05:45:04.0607501Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T05:45:04.0608304Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T05:45:04.0609239Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2025-03-14T05:45:04.0610471Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 15s local 2025-03-14T05:45:04.0611993Z Compiling xla/service/batched_gather_scatter_normalizer.cc; 12s local 2025-03-14T05:45:04.0612985Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2025-03-14T05:45:04.0613879Z Compiling xla/service/hlo_creation_utils.cc; 8s local ... 2025-03-14T05:45:04.3361049Z 2025-03-14T05:45:04.3361922Z  2025-03-14T05:45:04.3362432Z  2025-03-14T05:45:04.3362868Z  2025-03-14T05:45:04.3363292Z  2025-03-14T05:45:04.3363725Z  2025-03-14T05:45:04.3364135Z  2025-03-14T05:45:04.3364710Z  2025-03-14T05:45:04.3365138Z  2025-03-14T05:45:04.3365964Z [12,048 / 15,235] 48 actions, 47 running 2025-03-14T05:45:04.3366746Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T05:45:04.3367555Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T05:45:04.3368332Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T05:45:04.3369342Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2025-03-14T05:45:04.3370544Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 16s local 2025-03-14T05:45:04.3371608Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2025-03-14T05:45:04.3372431Z Compiling xla/service/hlo_creation_utils.cc; 8s local 2025-03-14T05:45:04.3373385Z Compiling xla/hlo/translate/mhlo_to_hlo/layout_util.cc; 8s local ... 2025-03-14T05:45:04.5708985Z 2025-03-14T05:45:04.5709843Z  2025-03-14T05:45:04.5710333Z  2025-03-14T05:45:04.5710761Z  2025-03-14T05:45:04.5711178Z  2025-03-14T05:45:04.5711613Z  2025-03-14T05:45:04.5712034Z  2025-03-14T05:45:04.5712430Z  2025-03-14T05:45:04.5712845Z  2025-03-14T05:45:04.5713462Z [12,049 / 15,235] 48 actions, 47 running 2025-03-14T05:45:04.5714276Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T05:45:04.5715453Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T05:45:04.5716245Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T05:45:04.5717202Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 16s local 2025-03-14T05:45:04.5718331Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 16s local 2025-03-14T05:45:04.5719397Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local 2025-03-14T05:45:04.5720272Z Compiling xla/service/hlo_creation_utils.cc; 9s local 2025-03-14T05:45:04.5721237Z Compiling xla/hlo/translate/mhlo_to_hlo/layout_util.cc; 9s local ... 2025-03-14T05:45:04.8146128Z 2025-03-14T05:45:04.8146942Z  2025-03-14T05:45:04.8147418Z  2025-03-14T05:45:04.8147799Z  2025-03-14T05:45:04.8148201Z  2025-03-14T05:45:04.8148607Z  2025-03-14T05:45:04.8149006Z  2025-03-14T05:45:04.8149394Z  2025-03-14T05:45:04.8149790Z  2025-03-14T05:45:04.8150386Z [12,051 / 15,235] 48 actions running 2025-03-14T05:45:04.8151157Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T05:45:04.8151953Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T05:45:04.8152751Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T05:45:04.8153707Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 17s local 2025-03-14T05:45:04.8154821Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 16s local 2025-03-14T05:45:04.8155878Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2025-03-14T05:45:04.8156686Z Compiling xla/service/hlo_creation_utils.cc; 9s local 2025-03-14T05:45:04.8157603Z Compiling xla/hlo/translate/mhlo_to_hlo/layout_util.cc; 9s local ... 2025-03-14T05:45:05.0605290Z 2025-03-14T05:45:05.0605885Z  2025-03-14T05:45:05.0606278Z  2025-03-14T05:45:05.0606632Z  2025-03-14T05:45:05.0606964Z  2025-03-14T05:45:05.0607309Z  2025-03-14T05:45:05.0607661Z  2025-03-14T05:45:05.0608129Z  2025-03-14T05:45:05.0608515Z  2025-03-14T05:45:05.0609033Z [12,054 / 15,235] 48 actions, 47 running 2025-03-14T05:45:05.0610042Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T05:45:05.0610707Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T05:45:05.0611386Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T05:45:05.0612199Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 17s local 2025-03-14T05:45:05.0613177Z Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp [for tool]; 16s local 2025-03-14T05:45:05.0614060Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2025-03-14T05:45:05.0614760Z Compiling xla/service/hlo_creation_utils.cc; 9s local 2025-03-14T05:45:05.0615571Z @xla//xla/hlo/transforms:optimization_barrier_expander; 8s local ... 2025-03-14T05:45:05.3088595Z 2025-03-14T05:45:05.3089495Z  2025-03-14T05:45:05.3090009Z  2025-03-14T05:45:05.3090428Z  2025-03-14T05:45:05.3090880Z  2025-03-14T05:45:05.3091302Z  2025-03-14T05:45:05.3091750Z  2025-03-14T05:45:05.3092123Z  2025-03-14T05:45:05.3092546Z  2025-03-14T05:45:05.3093143Z [12,058 / 15,235] 48 actions, 47 running 2025-03-14T05:45:05.3093877Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T05:45:05.3094637Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T05:45:05.3095446Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T05:45:05.3096414Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 17s local 2025-03-14T05:45:05.3097416Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2025-03-14T05:45:05.3098256Z Compiling xla/service/hlo_creation_utils.cc; 9s local 2025-03-14T05:45:05.3099165Z @xla//xla/hlo/transforms:optimization_barrier_expander; 9s local 2025-03-14T05:45:05.3100008Z @llvm-project//llvm:llvm-tblgen; 8s local ... 2025-03-14T05:45:05.6153989Z 2025-03-14T05:45:05.6154850Z  2025-03-14T05:45:05.6155756Z  2025-03-14T05:45:05.6156204Z  2025-03-14T05:45:05.6156589Z  2025-03-14T05:45:05.6156958Z  2025-03-14T05:45:05.6157335Z  2025-03-14T05:45:05.6157735Z  2025-03-14T05:45:05.6158134Z  2025-03-14T05:45:05.6158725Z [12,058 / 15,235] 48 actions running 2025-03-14T05:45:05.6159481Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T05:45:05.6160252Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T05:45:05.6161041Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T05:45:05.6162014Z Compiling .../transforms/simplifiers/hlo_memory_scheduler.cc; 17s local 2025-03-14T05:45:05.6163034Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local 2025-03-14T05:45:05.6163875Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2025-03-14T05:45:05.6164944Z @xla//xla/hlo/transforms:optimization_barrier_expander; 9s local 2025-03-14T05:45:05.6166043Z @llvm-project//llvm:llvm-tblgen; 9s local ... 2025-03-14T05:45:05.8158137Z 2025-03-14T05:45:05.8159061Z  2025-03-14T05:45:05.8159605Z  2025-03-14T05:45:05.8160042Z  2025-03-14T05:45:05.8160492Z  2025-03-14T05:45:05.8160898Z  2025-03-14T05:45:05.8161485Z  2025-03-14T05:45:05.8162049Z  2025-03-14T05:45:05.8162453Z  2025-03-14T05:45:05.8163043Z [12,059 / 15,235] 48 actions running 2025-03-14T05:45:05.8163815Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T05:45:05.8164776Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T05:45:05.8165907Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T05:45:05.8166744Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2025-03-14T05:45:05.8167574Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2025-03-14T05:45:05.8168479Z @xla//xla/hlo/transforms:optimization_barrier_expander; 9s local 2025-03-14T05:45:05.8169592Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 9s local 2025-03-14T05:45:05.8171063Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local ... 2025-03-14T05:45:06.0566021Z 2025-03-14T05:45:06.0566831Z  2025-03-14T05:45:06.0567337Z  2025-03-14T05:45:06.0567676Z  2025-03-14T05:45:06.0568054Z  2025-03-14T05:45:06.0568464Z  2025-03-14T05:45:06.0568872Z  2025-03-14T05:45:06.0569272Z  2025-03-14T05:45:06.0569681Z  2025-03-14T05:45:06.0570312Z [12,061 / 15,235] 48 actions, 47 running 2025-03-14T05:45:06.0571075Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T05:45:06.0571843Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T05:45:06.0572506Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T05:45:06.0573156Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2025-03-14T05:45:06.0573857Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2025-03-14T05:45:06.0574794Z @xla//xla/hlo/transforms:optimization_barrier_expander; 9s local 2025-03-14T05:45:06.0575877Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 9s local 2025-03-14T05:45:06.0576997Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local ... 2025-03-14T05:45:06.3302623Z 2025-03-14T05:45:06.3303554Z  2025-03-14T05:45:06.3304088Z  2025-03-14T05:45:06.3314777Z  2025-03-14T05:45:06.3315249Z  2025-03-14T05:45:06.3315672Z  2025-03-14T05:45:06.3316075Z  2025-03-14T05:45:06.3316443Z  2025-03-14T05:45:06.3316864Z  2025-03-14T05:45:06.3317484Z [12,063 / 15,235] 48 actions, 47 running 2025-03-14T05:45:06.3318218Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T05:45:06.3319010Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T05:45:06.3319808Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T05:45:06.3320609Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2025-03-14T05:45:06.3321906Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2025-03-14T05:45:06.3322852Z @xla//xla/hlo/transforms:optimization_barrier_expander; 10s local 2025-03-14T05:45:06.3323897Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 9s local 2025-03-14T05:45:06.3325087Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local ... 2025-03-14T05:45:06.5513147Z 2025-03-14T05:45:06.5513944Z  2025-03-14T05:45:06.5514443Z  2025-03-14T05:45:06.5514857Z  2025-03-14T05:45:06.5515282Z  2025-03-14T05:45:06.5515699Z  2025-03-14T05:45:06.5516107Z  2025-03-14T05:45:06.5516523Z  2025-03-14T05:45:06.5516918Z  2025-03-14T05:45:06.5517517Z [12,069 / 15,235] 48 actions, 47 running 2025-03-14T05:45:06.5518282Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T05:45:06.5519089Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T05:45:06.5519970Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2025-03-14T05:45:06.5520892Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2025-03-14T05:45:06.5521718Z @xla//xla/hlo/transforms:optimization_barrier_expander; 10s local 2025-03-14T05:45:06.5522832Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 9s local 2025-03-14T05:45:06.5523847Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 9s local 2025-03-14T05:45:06.5524815Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local ... 2025-03-14T05:45:06.8165145Z 2025-03-14T05:45:06.8166249Z  2025-03-14T05:45:06.8166764Z  2025-03-14T05:45:06.8167179Z  2025-03-14T05:45:06.8167583Z  2025-03-14T05:45:06.8168010Z  2025-03-14T05:45:06.8168404Z  2025-03-14T05:45:06.8168800Z  2025-03-14T05:45:06.8169208Z  2025-03-14T05:45:06.8169781Z [12,071 / 15,235] 48 actions running 2025-03-14T05:45:06.8170542Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T05:45:06.8171381Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T05:45:06.8172599Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 12s local 2025-03-14T05:45:06.8173429Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2025-03-14T05:45:06.8174171Z @xla//xla/hlo/transforms:optimization_barrier_expander; 10s local 2025-03-14T05:45:06.8175125Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 10s local 2025-03-14T05:45:06.8176010Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2025-03-14T05:45:06.8176751Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local ... 2025-03-14T05:45:07.0256029Z 2025-03-14T05:45:07.0256863Z  2025-03-14T05:45:07.0257352Z  2025-03-14T05:45:07.0257746Z  2025-03-14T05:45:07.0258131Z  2025-03-14T05:45:07.0258505Z  2025-03-14T05:45:07.0258878Z  2025-03-14T05:45:07.0259311Z  2025-03-14T05:45:07.0259698Z  2025-03-14T05:45:07.0260287Z [12,074 / 15,235] 48 actions, 47 running 2025-03-14T05:45:07.0261069Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T05:45:07.0261833Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T05:45:07.0262581Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2025-03-14T05:45:07.0263492Z @xla//xla/hlo/transforms:optimization_barrier_expander; 10s local 2025-03-14T05:45:07.0264611Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 10s local 2025-03-14T05:45:07.0266015Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2025-03-14T05:45:07.0266862Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2025-03-14T05:45:07.0267691Z Compiling xla/hlo/builder/lib/pooling.cc; 9s local ... 2025-03-14T05:45:07.2406114Z 2025-03-14T05:45:07.2407017Z  2025-03-14T05:45:07.2407512Z  2025-03-14T05:45:07.2407911Z  2025-03-14T05:45:07.2408347Z  2025-03-14T05:45:07.2408757Z  2025-03-14T05:45:07.2409157Z  2025-03-14T05:45:07.2409559Z  2025-03-14T05:45:07.2410314Z  2025-03-14T05:45:07.2410965Z [12,076 / 15,235] 48 actions, 47 running 2025-03-14T05:45:07.2411752Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T05:45:07.2412686Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T05:45:07.2413523Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2025-03-14T05:45:07.2414484Z @xla//xla/hlo/transforms:optimization_barrier_expander; 11s local 2025-03-14T05:45:07.2415617Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 10s local 2025-03-14T05:45:07.2416692Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2025-03-14T05:45:07.2417453Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2025-03-14T05:45:07.2418199Z Compiling xla/hlo/builder/lib/pooling.cc; 9s local ... 2025-03-14T05:45:07.6092020Z 2025-03-14T05:45:07.6092854Z  2025-03-14T05:45:07.6093295Z  2025-03-14T05:45:07.6093671Z  2025-03-14T05:45:07.6094013Z  2025-03-14T05:45:07.6094423Z  2025-03-14T05:45:07.6094789Z  2025-03-14T05:45:07.6095159Z  2025-03-14T05:45:07.6095519Z  2025-03-14T05:45:07.6096076Z [12,079 / 15,235] 48 actions, 47 running 2025-03-14T05:45:07.6096766Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T05:45:07.6097540Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T05:45:07.6098285Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2025-03-14T05:45:07.6099225Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 11s local 2025-03-14T05:45:07.6100232Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local 2025-03-14T05:45:07.6100981Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2025-03-14T05:45:07.6101712Z Compiling xla/hlo/builder/lib/pooling.cc; 9s local 2025-03-14T05:45:07.6102525Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local ... 2025-03-14T05:45:07.8133715Z 2025-03-14T05:45:07.8134487Z  2025-03-14T05:45:07.8134956Z  2025-03-14T05:45:07.8135365Z  2025-03-14T05:45:07.8136083Z  2025-03-14T05:45:07.8136443Z  2025-03-14T05:45:07.8136849Z  2025-03-14T05:45:07.8137247Z  2025-03-14T05:45:07.8137641Z  2025-03-14T05:45:07.8138204Z [12,081 / 15,235] 48 actions, 47 running 2025-03-14T05:45:07.8138909Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T05:45:07.8139675Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T05:45:07.8140409Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2025-03-14T05:45:07.8141359Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 11s local 2025-03-14T05:45:07.8142369Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2025-03-14T05:45:07.8143128Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2025-03-14T05:45:07.8143846Z Compiling xla/hlo/builder/lib/pooling.cc; 10s local 2025-03-14T05:45:07.8144730Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local ... 2025-03-14T05:45:08.0174807Z 2025-03-14T05:45:08.0175691Z  2025-03-14T05:45:08.0176126Z  2025-03-14T05:45:08.0176497Z  2025-03-14T05:45:08.0176855Z  2025-03-14T05:45:08.0177225Z  2025-03-14T05:45:08.0177585Z  2025-03-14T05:45:08.0177925Z  2025-03-14T05:45:08.0178288Z  2025-03-14T05:45:08.0178792Z [12,082 / 15,235] 48 actions running 2025-03-14T05:45:08.0179460Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T05:45:08.0180185Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T05:45:08.0180933Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2025-03-14T05:45:08.0181890Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 11s local 2025-03-14T05:45:08.0182853Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2025-03-14T05:45:08.0183581Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2025-03-14T05:45:08.0184583Z Compiling xla/hlo/builder/lib/pooling.cc; 10s local 2025-03-14T05:45:08.0185420Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local ... 2025-03-14T05:45:08.3125940Z 2025-03-14T05:45:08.3126807Z  2025-03-14T05:45:08.3127251Z  2025-03-14T05:45:08.3127785Z  2025-03-14T05:45:08.3128285Z  2025-03-14T05:45:08.3128650Z  2025-03-14T05:45:08.3129021Z  2025-03-14T05:45:08.3129405Z  2025-03-14T05:45:08.3129801Z  2025-03-14T05:45:08.3130391Z [12,088 / 15,235] 48 actions, 47 running 2025-03-14T05:45:08.3131062Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T05:45:08.3131661Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T05:45:08.3132328Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2025-03-14T05:45:08.3133268Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 11s local 2025-03-14T05:45:08.3134259Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2025-03-14T05:45:08.3134915Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T05:45:08.3135627Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T05:45:08.3136376Z Compiling xla/hlo/builder/lib/loops.cc; 10s local ... 2025-03-14T05:45:08.5157918Z 2025-03-14T05:45:08.5158779Z  2025-03-14T05:45:08.5159294Z  2025-03-14T05:45:08.5159722Z  2025-03-14T05:45:08.5160099Z  2025-03-14T05:45:08.5160498Z  2025-03-14T05:45:08.5160886Z  2025-03-14T05:45:08.5161299Z  2025-03-14T05:45:08.5161696Z  2025-03-14T05:45:08.5162260Z [12,090 / 15,235] 48 actions, 47 running 2025-03-14T05:45:08.5162983Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T05:45:08.5163795Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T05:45:08.5164742Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2025-03-14T05:45:08.5165933Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 11s local 2025-03-14T05:45:08.5167005Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2025-03-14T05:45:08.5168170Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T05:45:08.5169070Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T05:45:08.5169952Z Compiling xla/hlo/builder/lib/prng.cc; 10s local ... 2025-03-14T05:45:08.8181736Z 2025-03-14T05:45:08.8182569Z  2025-03-14T05:45:08.8183056Z  2025-03-14T05:45:08.8183452Z  2025-03-14T05:45:08.8183873Z  2025-03-14T05:45:08.8184251Z  2025-03-14T05:45:08.8184662Z  2025-03-14T05:45:08.8185058Z  2025-03-14T05:45:08.8185449Z  2025-03-14T05:45:08.8185999Z [12,091 / 15,235] 48 actions running 2025-03-14T05:45:08.8186685Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T05:45:08.8187450Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T05:45:08.8188261Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2025-03-14T05:45:08.8189267Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 12s local 2025-03-14T05:45:08.8190275Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2025-03-14T05:45:08.8191001Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T05:45:08.8191866Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T05:45:08.8192780Z Compiling xla/hlo/builder/lib/prng.cc; 10s local ... 2025-03-14T05:45:09.1127043Z 2025-03-14T05:45:09.1127897Z  2025-03-14T05:45:09.1128365Z  2025-03-14T05:45:09.1128762Z  2025-03-14T05:45:09.1129150Z  2025-03-14T05:45:09.1129537Z  2025-03-14T05:45:09.1130026Z  2025-03-14T05:45:09.1130409Z  2025-03-14T05:45:09.1130805Z  2025-03-14T05:45:09.1131397Z [12,093 / 15,235] 47 actions, 46 running 2025-03-14T05:45:09.1132127Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T05:45:09.1132890Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T05:45:09.1134081Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2025-03-14T05:45:09.1135116Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 12s local 2025-03-14T05:45:09.1136150Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2025-03-14T05:45:09.1136949Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T05:45:09.1137819Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T05:45:09.1138736Z Compiling xla/hlo/builder/lib/prng.cc; 11s local ... 2025-03-14T05:45:09.4012710Z 2025-03-14T05:45:09.4013552Z  2025-03-14T05:45:09.4014034Z  2025-03-14T05:45:09.4014420Z  2025-03-14T05:45:09.4014795Z  2025-03-14T05:45:09.4015162Z  2025-03-14T05:45:09.4015545Z  2025-03-14T05:45:09.4015933Z  2025-03-14T05:45:09.4016330Z  2025-03-14T05:45:09.4016905Z [12,097 / 15,235] 48 actions, 47 running 2025-03-14T05:45:09.4017703Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T05:45:09.4018440Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T05:45:09.4019186Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2025-03-14T05:45:09.4020149Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 12s local 2025-03-14T05:45:09.4021133Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2025-03-14T05:45:09.4021930Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T05:45:09.4022817Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T05:45:09.4023692Z Compiling xla/hlo/builder/lib/prng.cc; 11s local ... 2025-03-14T05:45:09.6205239Z 2025-03-14T05:45:09.6206144Z  2025-03-14T05:45:09.6206662Z  2025-03-14T05:45:09.6207101Z  2025-03-14T05:45:09.6207537Z  2025-03-14T05:45:09.6207921Z  2025-03-14T05:45:09.6208348Z  2025-03-14T05:45:09.6208796Z  2025-03-14T05:45:09.6209239Z  2025-03-14T05:45:09.6210142Z [12,100 / 15,235] 48 actions, 47 running 2025-03-14T05:45:09.6210907Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T05:45:09.6212033Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T05:45:09.6213050Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:09.6214097Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2025-03-14T05:45:09.6214927Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T05:45:09.6215843Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T05:45:09.6216709Z Compiling xla/hlo/builder/lib/prng.cc; 11s local 2025-03-14T05:45:09.6217613Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 9s local ... 2025-03-14T05:45:09.9083352Z 2025-03-14T05:45:09.9084182Z  2025-03-14T05:45:09.9084910Z  2025-03-14T05:45:09.9085324Z  2025-03-14T05:45:09.9085722Z  2025-03-14T05:45:09.9086115Z  2025-03-14T05:45:09.9086520Z  2025-03-14T05:45:09.9086932Z  2025-03-14T05:45:09.9087318Z  2025-03-14T05:45:09.9087926Z [12,103 / 15,235] 48 actions running 2025-03-14T05:45:09.9088696Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T05:45:09.9089447Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T05:45:09.9090410Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:09.9091403Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2025-03-14T05:45:09.9092197Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T05:45:09.9093112Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T05:45:09.9093986Z Compiling xla/hlo/builder/lib/prng.cc; 11s local 2025-03-14T05:45:09.9094936Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 9s local ... 2025-03-14T05:45:10.1086186Z 2025-03-14T05:45:10.1087047Z  2025-03-14T05:45:10.1087526Z  2025-03-14T05:45:10.1087956Z  2025-03-14T05:45:10.1088742Z  2025-03-14T05:45:10.1089193Z  2025-03-14T05:45:10.1089651Z  2025-03-14T05:45:10.1090080Z  2025-03-14T05:45:10.1090514Z  2025-03-14T05:45:10.1091106Z [12,105 / 15,235] 48 actions running 2025-03-14T05:45:10.1091894Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T05:45:10.1092727Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T05:45:10.1093750Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:10.1094847Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2025-03-14T05:45:10.1095712Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T05:45:10.1096645Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T05:45:10.1097694Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T05:45:10.1098693Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local ... 2025-03-14T05:45:10.3102971Z 2025-03-14T05:45:10.3103863Z  2025-03-14T05:45:10.3104343Z  2025-03-14T05:45:10.3104773Z  2025-03-14T05:45:10.3105163Z  2025-03-14T05:45:10.3105558Z  2025-03-14T05:45:10.3105957Z  2025-03-14T05:45:10.3106359Z  2025-03-14T05:45:10.3106769Z  2025-03-14T05:45:10.3107372Z [12,107 / 15,235] 48 actions, 47 running 2025-03-14T05:45:10.3108089Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T05:45:10.3108942Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T05:45:10.3109897Z Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp [for tool]; 13s local 2025-03-14T05:45:10.3110931Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2025-03-14T05:45:10.3111710Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T05:45:10.3112580Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T05:45:10.3113509Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T05:45:10.3114515Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local ... 2025-03-14T05:45:10.6616678Z 2025-03-14T05:45:10.6617554Z  2025-03-14T05:45:10.6618027Z  2025-03-14T05:45:10.6618446Z  2025-03-14T05:45:10.6618848Z  2025-03-14T05:45:10.6619248Z  2025-03-14T05:45:10.6619664Z  2025-03-14T05:45:10.6620046Z  2025-03-14T05:45:10.6620448Z  2025-03-14T05:45:10.6621076Z [12,110 / 15,235] 48 actions, 47 running 2025-03-14T05:45:10.6621861Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T05:45:10.6622649Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T05:45:10.6623492Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2025-03-14T05:45:10.6624302Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T05:45:10.6625166Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T05:45:10.6626149Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T05:45:10.6627094Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local 2025-03-14T05:45:10.6627946Z Compiling xla/hlo/builder/lib/math.cc; 10s local ... 2025-03-14T05:45:10.8659820Z 2025-03-14T05:45:10.8660666Z  2025-03-14T05:45:10.8661158Z  2025-03-14T05:45:10.8661573Z  2025-03-14T05:45:10.8662000Z  2025-03-14T05:45:10.8662431Z  2025-03-14T05:45:10.8662838Z  2025-03-14T05:45:10.8663265Z  2025-03-14T05:45:10.8663692Z  2025-03-14T05:45:10.8664335Z [12,115 / 15,235] 48 actions, 47 running 2025-03-14T05:45:10.8665125Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T05:45:10.8666853Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T05:45:10.8667772Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2025-03-14T05:45:10.8668607Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T05:45:10.8669533Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T05:45:10.8670873Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T05:45:10.8671837Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 10s local 2025-03-14T05:45:10.8672687Z Compiling xla/hlo/builder/lib/math.cc; 10s local ... 2025-03-14T05:45:11.0927069Z 2025-03-14T05:45:11.0927885Z  2025-03-14T05:45:11.0928358Z  2025-03-14T05:45:11.0928747Z  2025-03-14T05:45:11.0929151Z  2025-03-14T05:45:11.0929537Z  2025-03-14T05:45:11.0929944Z  2025-03-14T05:45:11.0930339Z  2025-03-14T05:45:11.0930714Z  2025-03-14T05:45:11.0931305Z [12,117 / 15,235] 48 actions, 47 running 2025-03-14T05:45:11.0932017Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T05:45:11.0932798Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T05:45:11.0933635Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2025-03-14T05:45:11.0934450Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T05:45:11.0935364Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T05:45:11.0936429Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T05:45:11.0937252Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2025-03-14T05:45:11.0938031Z Compiling xla/hlo/builder/lib/math.cc; 10s local ... 2025-03-14T05:45:11.2905445Z 2025-03-14T05:45:11.2906330Z  2025-03-14T05:45:11.2906821Z  2025-03-14T05:45:11.2907242Z  2025-03-14T05:45:11.2907661Z  2025-03-14T05:45:11.2908069Z  2025-03-14T05:45:11.2908473Z  2025-03-14T05:45:11.2908862Z  2025-03-14T05:45:11.2909263Z  2025-03-14T05:45:11.2909860Z [12,121 / 15,235] 48 actions, 47 running 2025-03-14T05:45:11.2910644Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T05:45:11.2911472Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T05:45:11.2912362Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2025-03-14T05:45:11.2913187Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T05:45:11.2914415Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T05:45:11.2915419Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T05:45:11.2916331Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2025-03-14T05:45:11.2917165Z Compiling xla/hlo/builder/lib/math.cc; 10s local ... 2025-03-14T05:45:11.5095115Z 2025-03-14T05:45:11.5095972Z  2025-03-14T05:45:11.5096469Z  2025-03-14T05:45:11.5096877Z  2025-03-14T05:45:11.5097277Z  2025-03-14T05:45:11.5097681Z  2025-03-14T05:45:11.5098072Z  2025-03-14T05:45:11.5098469Z  2025-03-14T05:45:11.5098864Z  2025-03-14T05:45:11.5099434Z [12,122 / 15,235] 48 actions running 2025-03-14T05:45:11.5100187Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T05:45:11.5101008Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local 2025-03-14T05:45:11.5101832Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2025-03-14T05:45:11.5102672Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T05:45:11.5103552Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T05:45:11.5104506Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T05:45:11.5105376Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2025-03-14T05:45:11.5106206Z Compiling xla/hlo/builder/lib/math.cc; 11s local ... 2025-03-14T05:45:11.7742248Z 2025-03-14T05:45:11.7743095Z  2025-03-14T05:45:11.7743563Z  2025-03-14T05:45:11.7743929Z  2025-03-14T05:45:11.7744336Z  2025-03-14T05:45:11.7744718Z  2025-03-14T05:45:11.7745122Z  2025-03-14T05:45:11.7745518Z  2025-03-14T05:45:11.7746026Z  2025-03-14T05:45:11.7746629Z [12,125 / 15,235] 48 actions, 47 running 2025-03-14T05:45:11.7747785Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T05:45:11.7748748Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2025-03-14T05:45:11.7749572Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T05:45:11.7750523Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T05:45:11.7751527Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T05:45:11.7752404Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2025-03-14T05:45:11.7753260Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2025-03-14T05:45:11.7754270Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 10s local ... 2025-03-14T05:45:11.9926308Z 2025-03-14T05:45:11.9927175Z  2025-03-14T05:45:11.9927659Z  2025-03-14T05:45:11.9928092Z  2025-03-14T05:45:11.9928483Z  2025-03-14T05:45:11.9928890Z  2025-03-14T05:45:11.9929289Z  2025-03-14T05:45:11.9929690Z  2025-03-14T05:45:11.9930097Z  2025-03-14T05:45:11.9930744Z [12,129 / 15,235] 48 actions, 47 running 2025-03-14T05:45:11.9931520Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T05:45:11.9932368Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2025-03-14T05:45:11.9933150Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T05:45:11.9933975Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T05:45:11.9934987Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T05:45:11.9935853Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 11s local 2025-03-14T05:45:11.9936640Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2025-03-14T05:45:11.9937608Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 10s local ... 2025-03-14T05:45:12.2908373Z 2025-03-14T05:45:12.2909200Z  2025-03-14T05:45:12.2909687Z  2025-03-14T05:45:12.2910101Z  2025-03-14T05:45:12.2910506Z  2025-03-14T05:45:12.2910915Z  2025-03-14T05:45:12.2911354Z  2025-03-14T05:45:12.2911752Z  2025-03-14T05:45:12.2917589Z  2025-03-14T05:45:12.2918207Z [12,133 / 15,235] 48 actions, 47 running 2025-03-14T05:45:12.2918983Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T05:45:12.2919802Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2025-03-14T05:45:12.2920606Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T05:45:12.2921516Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T05:45:12.2922522Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local 2025-03-14T05:45:12.2923445Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2025-03-14T05:45:12.2924245Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2025-03-14T05:45:12.2925231Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 10s local ... 2025-03-14T05:45:12.5100758Z 2025-03-14T05:45:12.5101929Z  2025-03-14T05:45:12.5102834Z  2025-03-14T05:45:12.5103626Z  2025-03-14T05:45:12.5104716Z  2025-03-14T05:45:12.5105250Z  2025-03-14T05:45:12.5105636Z  2025-03-14T05:45:12.5106045Z  2025-03-14T05:45:12.5106461Z  2025-03-14T05:45:12.5107063Z [12,139 / 15,235] 48 actions running 2025-03-14T05:45:12.5107757Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T05:45:12.5108545Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2025-03-14T05:45:12.5109402Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T05:45:12.5110305Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T05:45:12.5111288Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local 2025-03-14T05:45:12.5112238Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2025-03-14T05:45:12.5113074Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T05:45:12.5114042Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local ... 2025-03-14T05:45:12.7105464Z 2025-03-14T05:45:12.7106325Z  2025-03-14T05:45:12.7106829Z  2025-03-14T05:45:12.7107237Z  2025-03-14T05:45:12.7107654Z  2025-03-14T05:45:12.7108067Z  2025-03-14T05:45:12.7108481Z  2025-03-14T05:45:12.7108882Z  2025-03-14T05:45:12.7109280Z  2025-03-14T05:45:12.7109859Z [12,141 / 15,235] 48 actions running 2025-03-14T05:45:12.7110635Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T05:45:12.7111373Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2025-03-14T05:45:12.7112113Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T05:45:12.7112951Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T05:45:12.7113897Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local 2025-03-14T05:45:12.7114788Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2025-03-14T05:45:12.7115575Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T05:45:12.7116523Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local ... 2025-03-14T05:45:12.9241835Z 2025-03-14T05:45:12.9242695Z  2025-03-14T05:45:12.9243194Z  2025-03-14T05:45:12.9243619Z  2025-03-14T05:45:12.9244017Z  2025-03-14T05:45:12.9244433Z  2025-03-14T05:45:12.9245039Z  2025-03-14T05:45:12.9245478Z  2025-03-14T05:45:12.9246033Z  2025-03-14T05:45:12.9246618Z [12,143 / 15,235] 48 actions, 47 running 2025-03-14T05:45:12.9247360Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T05:45:12.9248150Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T05:45:12.9249076Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T05:45:12.9249994Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local 2025-03-14T05:45:12.9250782Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T05:45:12.9251772Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local 2025-03-14T05:45:12.9252840Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 9s local 2025-03-14T05:45:12.9254240Z Compiling xla/service/all_to_all_decomposer.cc; 8s local ... 2025-03-14T05:45:13.3110376Z 2025-03-14T05:45:13.3111243Z  2025-03-14T05:45:13.3111768Z  2025-03-14T05:45:13.3112184Z  2025-03-14T05:45:13.3112593Z  2025-03-14T05:45:13.3112964Z  2025-03-14T05:45:13.3113393Z  2025-03-14T05:45:13.3113785Z  2025-03-14T05:45:13.3114190Z  2025-03-14T05:45:13.3114745Z [12,143 / 15,235] 48 actions running 2025-03-14T05:45:13.3115488Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T05:45:13.3116274Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T05:45:13.3117174Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T05:45:13.3118118Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2025-03-14T05:45:13.3118947Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T05:45:13.3119919Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local 2025-03-14T05:45:13.3121042Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 9s local 2025-03-14T05:45:13.3122115Z Compiling xla/service/all_to_all_decomposer.cc; 9s local ... 2025-03-14T05:45:13.5114628Z 2025-03-14T05:45:13.5115619Z  2025-03-14T05:45:13.5116085Z  2025-03-14T05:45:13.5116516Z  2025-03-14T05:45:13.5116930Z  2025-03-14T05:45:13.5117309Z  2025-03-14T05:45:13.5117669Z  2025-03-14T05:45:13.5118054Z  2025-03-14T05:45:13.5118457Z  2025-03-14T05:45:13.5119167Z [12,145 / 15,235] 48 actions running 2025-03-14T05:45:13.5120080Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T05:45:13.5120841Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T05:45:13.5121644Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T05:45:13.5122926Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2025-03-14T05:45:13.5123795Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T05:45:13.5124864Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2025-03-14T05:45:13.5126015Z Compiling xla/service/all_to_all_decomposer.cc; 9s local 2025-03-14T05:45:13.5126950Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 8s local ... 2025-03-14T05:45:13.7575307Z 2025-03-14T05:45:13.7576172Z  2025-03-14T05:45:13.7576668Z  2025-03-14T05:45:13.7577093Z  2025-03-14T05:45:13.7577541Z  2025-03-14T05:45:13.7577904Z  2025-03-14T05:45:13.7578316Z  2025-03-14T05:45:13.7578742Z  2025-03-14T05:45:13.7579183Z  2025-03-14T05:45:13.7579728Z [12,148 / 15,235] 48 actions, 47 running 2025-03-14T05:45:13.7580461Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T05:45:13.7581242Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T05:45:13.7582171Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T05:45:13.7582957Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2025-03-14T05:45:13.7583709Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T05:45:13.7584687Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2025-03-14T05:45:13.7585715Z Compiling xla/service/all_to_all_decomposer.cc; 9s local 2025-03-14T05:45:13.7586728Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 8s local ... 2025-03-14T05:45:13.9653175Z 2025-03-14T05:45:13.9654291Z  2025-03-14T05:45:13.9654721Z  2025-03-14T05:45:13.9655087Z  2025-03-14T05:45:13.9655441Z  2025-03-14T05:45:13.9655808Z  2025-03-14T05:45:13.9656134Z  2025-03-14T05:45:13.9656470Z  2025-03-14T05:45:13.9656823Z  2025-03-14T05:45:13.9657431Z [12,153 / 15,235] 48 actions, 47 running 2025-03-14T05:45:13.9658240Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T05:45:13.9658989Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T05:45:13.9660291Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T05:45:13.9661226Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local 2025-03-14T05:45:13.9662034Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T05:45:13.9662985Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2025-03-14T05:45:13.9663921Z Compiling xla/service/all_to_all_decomposer.cc; 9s local 2025-03-14T05:45:13.9664879Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 8s local ... 2025-03-14T05:45:14.1847093Z 2025-03-14T05:45:14.1848002Z  2025-03-14T05:45:14.1848524Z  2025-03-14T05:45:14.1848950Z  2025-03-14T05:45:14.1849362Z  2025-03-14T05:45:14.1849760Z  2025-03-14T05:45:14.1850165Z  2025-03-14T05:45:14.1850568Z  2025-03-14T05:45:14.1850986Z  2025-03-14T05:45:14.1851629Z [12,155 / 15,235] 48 actions, 47 running 2025-03-14T05:45:14.1852417Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T05:45:14.1853174Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T05:45:14.1854041Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T05:45:14.1854928Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2025-03-14T05:45:14.1855766Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T05:45:14.1856723Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2025-03-14T05:45:14.1857773Z Compiling xla/service/all_to_all_decomposer.cc; 10s local 2025-03-14T05:45:14.1858782Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 9s local ... 2025-03-14T05:45:14.4551177Z 2025-03-14T05:45:14.4552200Z  2025-03-14T05:45:14.4552963Z  2025-03-14T05:45:14.4554177Z  2025-03-14T05:45:14.4554653Z  2025-03-14T05:45:14.4555077Z  2025-03-14T05:45:14.4555854Z  2025-03-14T05:45:14.4556259Z  2025-03-14T05:45:14.4556660Z  2025-03-14T05:45:14.4557228Z [12,159 / 15,235] 48 actions, 47 running 2025-03-14T05:45:14.4557942Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T05:45:14.4558806Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T05:45:14.4559771Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2025-03-14T05:45:14.4560649Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T05:45:14.4561656Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T05:45:14.4562749Z Compiling xla/service/all_to_all_decomposer.cc; 10s local 2025-03-14T05:45:14.4563804Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 9s local 2025-03-14T05:45:14.4565053Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local ... 2025-03-14T05:45:14.6682375Z 2025-03-14T05:45:14.6683674Z  2025-03-14T05:45:14.6684322Z  2025-03-14T05:45:14.6685210Z  2025-03-14T05:45:14.6686394Z  2025-03-14T05:45:14.6686890Z  2025-03-14T05:45:14.6687323Z  2025-03-14T05:45:14.6687755Z  2025-03-14T05:45:14.6688202Z  2025-03-14T05:45:14.6688855Z [12,162 / 15,235] 48 actions, 47 running 2025-03-14T05:45:14.6689658Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T05:45:14.6690624Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T05:45:14.6691652Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2025-03-14T05:45:14.6692517Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T05:45:14.6693547Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T05:45:14.6694639Z Compiling xla/service/all_to_all_decomposer.cc; 10s local 2025-03-14T05:45:14.6695638Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 9s local 2025-03-14T05:45:14.6696737Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local ... 2025-03-14T05:45:14.9124378Z 2025-03-14T05:45:14.9125821Z  2025-03-14T05:45:14.9126259Z  2025-03-14T05:45:14.9126648Z  2025-03-14T05:45:14.9127527Z  2025-03-14T05:45:14.9127928Z  2025-03-14T05:45:14.9128503Z  2025-03-14T05:45:14.9129041Z  2025-03-14T05:45:14.9129511Z  2025-03-14T05:45:14.9130190Z [12,163 / 15,235] 48 actions running 2025-03-14T05:45:14.9131064Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T05:45:14.9132095Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T05:45:14.9133100Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2025-03-14T05:45:14.9134037Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T05:45:14.9135123Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T05:45:14.9136268Z Compiling xla/service/all_to_all_decomposer.cc; 10s local 2025-03-14T05:45:14.9137503Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 9s local 2025-03-14T05:45:14.9138721Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local ... 2025-03-14T05:45:15.1917405Z 2025-03-14T05:45:15.1918273Z  2025-03-14T05:45:15.1918767Z  2025-03-14T05:45:15.1919169Z  2025-03-14T05:45:15.1919590Z  2025-03-14T05:45:15.1920023Z  2025-03-14T05:45:15.1920445Z  2025-03-14T05:45:15.1920861Z  2025-03-14T05:45:15.1921286Z  2025-03-14T05:45:15.1921904Z [12,164 / 15,235] 48 actions, 47 running 2025-03-14T05:45:15.1922689Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T05:45:15.1923678Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T05:45:15.1924833Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2025-03-14T05:45:15.1925667Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T05:45:15.1926977Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T05:45:15.1928025Z Compiling xla/service/all_to_all_decomposer.cc; 11s local 2025-03-14T05:45:15.1928987Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local 2025-03-14T05:45:15.1930086Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local ... 2025-03-14T05:45:15.5130391Z 2025-03-14T05:45:15.5131207Z  2025-03-14T05:45:15.5131664Z  2025-03-14T05:45:15.5132199Z  2025-03-14T05:45:15.5132729Z  2025-03-14T05:45:15.5133105Z  2025-03-14T05:45:15.5133500Z  2025-03-14T05:45:15.5133929Z  2025-03-14T05:45:15.5134320Z  2025-03-14T05:45:15.5134910Z [12,167 / 15,235] 48 actions running 2025-03-14T05:45:15.5135680Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T05:45:15.5136608Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T05:45:15.5137549Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2025-03-14T05:45:15.5138404Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2025-03-14T05:45:15.5139400Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T05:45:15.5140496Z Compiling xla/service/all_to_all_decomposer.cc; 11s local 2025-03-14T05:45:15.5141500Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local 2025-03-14T05:45:15.5142619Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local ... 2025-03-14T05:45:15.8223640Z 2025-03-14T05:45:15.8226908Z  2025-03-14T05:45:15.8227450Z  2025-03-14T05:45:15.8227883Z  2025-03-14T05:45:15.8228293Z  2025-03-14T05:45:15.8228687Z  2025-03-14T05:45:15.8229100Z  2025-03-14T05:45:15.8229472Z  2025-03-14T05:45:15.8229902Z  2025-03-14T05:45:15.8230521Z [12,170 / 15,235] 48 actions, 47 running 2025-03-14T05:45:15.8231292Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T05:45:15.8232134Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T05:45:15.8233067Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2025-03-14T05:45:15.8234195Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2025-03-14T05:45:15.8235111Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T05:45:15.8236151Z Compiling xla/service/all_to_all_decomposer.cc; 11s local 2025-03-14T05:45:15.8237096Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local 2025-03-14T05:45:15.8238191Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local ... 2025-03-14T05:45:16.1137575Z 2025-03-14T05:45:16.1138484Z  2025-03-14T05:45:16.1139007Z  2025-03-14T05:45:16.1139437Z  2025-03-14T05:45:16.1139832Z  2025-03-14T05:45:16.1140256Z  2025-03-14T05:45:16.1140686Z  2025-03-14T05:45:16.1141102Z  2025-03-14T05:45:16.1141510Z  2025-03-14T05:45:16.1142112Z [12,176 / 15,235] 48 actions running 2025-03-14T05:45:16.1142907Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T05:45:16.1143850Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T05:45:16.1144849Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T05:45:16.1145861Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T05:45:16.1147019Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T05:45:16.1148068Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2025-03-14T05:45:16.1149004Z Compiling xla/service/topk_rewriter.cc; 8s local 2025-03-14T05:45:16.1149807Z Compiling xla/pjrt/layout_mode.cc; 7s local ... 2025-03-14T05:45:16.3140507Z 2025-03-14T05:45:16.3141841Z  2025-03-14T05:45:16.3142371Z  2025-03-14T05:45:16.3142806Z  2025-03-14T05:45:16.3143230Z  2025-03-14T05:45:16.3143660Z  2025-03-14T05:45:16.3144083Z  2025-03-14T05:45:16.3144508Z  2025-03-14T05:45:16.3144917Z  2025-03-14T05:45:16.3145872Z [12,180 / 15,235] 48 actions running 2025-03-14T05:45:16.3146682Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T05:45:16.3147634Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T05:45:16.3148610Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T05:45:16.3149560Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T05:45:16.3150658Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T05:45:16.3151709Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T05:45:16.3152667Z Compiling xla/service/topk_rewriter.cc; 9s local 2025-03-14T05:45:16.3153457Z Compiling xla/pjrt/layout_mode.cc; 8s local ... 2025-03-14T05:45:16.5956160Z 2025-03-14T05:45:16.5957218Z  2025-03-14T05:45:16.5957778Z  2025-03-14T05:45:16.5958181Z  2025-03-14T05:45:16.5958643Z  2025-03-14T05:45:16.5959114Z  2025-03-14T05:45:16.5959565Z  2025-03-14T05:45:16.5959989Z  2025-03-14T05:45:16.5960475Z  2025-03-14T05:45:16.5961126Z [12,186 / 15,235] 48 actions, 47 running 2025-03-14T05:45:16.5961932Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T05:45:16.5962848Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T05:45:16.5963812Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T05:45:16.5964957Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 13s local 2025-03-14T05:45:16.5966248Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T05:45:16.5967286Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T05:45:16.5968181Z Compiling xla/service/topk_rewriter.cc; 9s local 2025-03-14T05:45:16.5969010Z Compiling xla/pjrt/layout_mode.cc; 8s local ... 2025-03-14T05:45:16.9146241Z 2025-03-14T05:45:16.9147615Z  2025-03-14T05:45:16.9148158Z  2025-03-14T05:45:16.9148702Z  2025-03-14T05:45:16.9149245Z  2025-03-14T05:45:16.9150185Z  2025-03-14T05:45:16.9150727Z  2025-03-14T05:45:16.9151173Z  2025-03-14T05:45:16.9151692Z  2025-03-14T05:45:16.9152330Z [12,190 / 15,235] 48 actions running 2025-03-14T05:45:16.9153151Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T05:45:16.9154097Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T05:45:16.9155101Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T05:45:16.9156055Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 13s local 2025-03-14T05:45:16.9157132Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T05:45:16.9158204Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T05:45:16.9159085Z Compiling xla/service/topk_rewriter.cc; 9s local 2025-03-14T05:45:16.9159902Z Compiling xla/pjrt/layout_mode.cc; 8s local ... 2025-03-14T05:45:17.1151179Z 2025-03-14T05:45:17.1152130Z  2025-03-14T05:45:17.1152619Z  2025-03-14T05:45:17.1153019Z  2025-03-14T05:45:17.1153441Z  2025-03-14T05:45:17.1153845Z  2025-03-14T05:45:17.1154250Z  2025-03-14T05:45:17.1154659Z  2025-03-14T05:45:17.1155081Z  2025-03-14T05:45:17.1155692Z [12,191 / 15,235] 48 actions running 2025-03-14T05:45:17.1167102Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T05:45:17.1168089Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T05:45:17.1169024Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T05:45:17.1170018Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 13s local 2025-03-14T05:45:17.1171183Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T05:45:17.1172256Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T05:45:17.1173513Z Compiling xla/service/topk_rewriter.cc; 9s local 2025-03-14T05:45:17.1174440Z Compiling xla/pjrt/layout_mode.cc; 8s local ... 2025-03-14T05:45:17.3855548Z 2025-03-14T05:45:17.3856900Z  2025-03-14T05:45:17.3857465Z  2025-03-14T05:45:17.3857838Z  2025-03-14T05:45:17.3858272Z  2025-03-14T05:45:17.3858704Z  2025-03-14T05:45:17.3859099Z  2025-03-14T05:45:17.3859527Z  2025-03-14T05:45:17.3859976Z  2025-03-14T05:45:17.3860648Z [12,198 / 15,235] 48 actions, 47 running 2025-03-14T05:45:17.3861478Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T05:45:17.3862304Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T05:45:17.3863213Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T05:45:17.3864175Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T05:45:17.3865244Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T05:45:17.3866379Z Compiling xla/service/topk_rewriter.cc; 10s local 2025-03-14T05:45:17.3867083Z Compiling xla/pjrt/layout_mode.cc; 9s local 2025-03-14T05:45:17.3867680Z Compiling xla/hlo/builder/lib/matrix.cc; 9s local ... 2025-03-14T05:45:17.6553813Z 2025-03-14T05:45:17.6554746Z  2025-03-14T05:45:17.6555259Z  2025-03-14T05:45:17.6555670Z  2025-03-14T05:45:17.6556085Z  2025-03-14T05:45:17.6556480Z  2025-03-14T05:45:17.6556924Z  2025-03-14T05:45:17.6557340Z  2025-03-14T05:45:17.6557735Z  2025-03-14T05:45:17.6558384Z [12,200 / 15,235] 48 actions, 47 running 2025-03-14T05:45:17.6559127Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T05:45:17.6560039Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T05:45:17.6560977Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T05:45:17.6561939Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T05:45:17.6563011Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T05:45:17.6564319Z Compiling xla/service/topk_rewriter.cc; 10s local 2025-03-14T05:45:17.6565222Z Compiling xla/pjrt/layout_mode.cc; 9s local 2025-03-14T05:45:17.6566224Z Compiling xla/hlo/builder/lib/matrix.cc; 9s local ... 2025-03-14T05:45:17.9158497Z 2025-03-14T05:45:17.9159478Z  2025-03-14T05:45:17.9160184Z  2025-03-14T05:45:17.9160793Z  2025-03-14T05:45:17.9161374Z  2025-03-14T05:45:17.9161762Z  2025-03-14T05:45:17.9162340Z  2025-03-14T05:45:17.9162913Z  2025-03-14T05:45:17.9163353Z  2025-03-14T05:45:17.9164318Z [12,201 / 15,235] 48 actions running 2025-03-14T05:45:17.9165282Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T05:45:17.9166523Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T05:45:17.9167544Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T05:45:17.9169066Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T05:45:17.9170103Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T05:45:17.9170965Z Compiling xla/service/topk_rewriter.cc; 10s local 2025-03-14T05:45:17.9171665Z Compiling xla/pjrt/layout_mode.cc; 9s local 2025-03-14T05:45:17.9172423Z Compiling xla/hlo/builder/lib/matrix.cc; 9s local ... 2025-03-14T05:45:18.1162521Z 2025-03-14T05:45:18.1163373Z  2025-03-14T05:45:18.1163861Z  2025-03-14T05:45:18.1164297Z  2025-03-14T05:45:18.1164838Z  2025-03-14T05:45:18.1165244Z  2025-03-14T05:45:18.1165832Z  2025-03-14T05:45:18.1166254Z  2025-03-14T05:45:18.1166679Z  2025-03-14T05:45:18.1167259Z [12,202 / 15,235] 48 actions running 2025-03-14T05:45:18.1168035Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T05:45:18.1168832Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T05:45:18.1169976Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T05:45:18.1170967Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 13s local 2025-03-14T05:45:18.1172000Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T05:45:18.1172903Z Compiling xla/service/topk_rewriter.cc; 10s local 2025-03-14T05:45:18.1173603Z Compiling xla/pjrt/layout_mode.cc; 9s local 2025-03-14T05:45:18.1174341Z Compiling xla/hlo/builder/lib/matrix.cc; 9s local ... 2025-03-14T05:45:18.4437620Z 2025-03-14T05:45:18.4438510Z  2025-03-14T05:45:18.4438994Z  2025-03-14T05:45:18.4439412Z  2025-03-14T05:45:18.4439800Z  2025-03-14T05:45:18.4440252Z  2025-03-14T05:45:18.4440691Z  2025-03-14T05:45:18.4441135Z  2025-03-14T05:45:18.4441579Z  2025-03-14T05:45:18.4442204Z [12,207 / 15,235] 48 actions, 47 running 2025-03-14T05:45:18.4443041Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T05:45:18.4443997Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T05:45:18.4445057Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T05:45:18.4445994Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T05:45:18.4447014Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T05:45:18.4447798Z Compiling xla/pjrt/layout_mode.cc; 10s local 2025-03-14T05:45:18.4448485Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local 2025-03-14T05:45:18.4449289Z Compiling xla/service/collective_ops_utils.cc; 9s local ... 2025-03-14T05:45:18.7166798Z 2025-03-14T05:45:18.7167673Z  2025-03-14T05:45:18.7168161Z  2025-03-14T05:45:18.7168569Z  2025-03-14T05:45:18.7168966Z  2025-03-14T05:45:18.7169377Z  2025-03-14T05:45:18.7169784Z  2025-03-14T05:45:18.7170202Z  2025-03-14T05:45:18.7170608Z  2025-03-14T05:45:18.7171187Z [12,210 / 15,235] 47 actions running 2025-03-14T05:45:18.7171992Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T05:45:18.7173251Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T05:45:18.7174215Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T05:45:18.7175160Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T05:45:18.7176063Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T05:45:18.7176806Z Compiling xla/pjrt/layout_mode.cc; 10s local 2025-03-14T05:45:18.7177539Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local 2025-03-14T05:45:18.7178414Z Compiling xla/service/collective_ops_utils.cc; 10s local ... 2025-03-14T05:45:18.9171036Z 2025-03-14T05:45:18.9171876Z  2025-03-14T05:45:18.9172332Z  2025-03-14T05:45:18.9172713Z  2025-03-14T05:45:18.9173102Z  2025-03-14T05:45:18.9173520Z  2025-03-14T05:45:18.9173943Z  2025-03-14T05:45:18.9174368Z  2025-03-14T05:45:18.9174770Z  2025-03-14T05:45:18.9175357Z [12,211 / 15,235] 48 actions running 2025-03-14T05:45:18.9176084Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T05:45:18.9176906Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T05:45:18.9177803Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T05:45:18.9178689Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T05:45:18.9179504Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T05:45:18.9180177Z Compiling xla/pjrt/layout_mode.cc; 10s local 2025-03-14T05:45:18.9180870Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local 2025-03-14T05:45:18.9181675Z Compiling xla/service/collective_ops_utils.cc; 10s local ... 2025-03-14T05:45:19.1190878Z 2025-03-14T05:45:19.1191756Z  2025-03-14T05:45:19.1192152Z  2025-03-14T05:45:19.1192473Z  2025-03-14T05:45:19.1192793Z  2025-03-14T05:45:19.1193112Z  2025-03-14T05:45:19.1193804Z  2025-03-14T05:45:19.1194144Z  2025-03-14T05:45:19.1194462Z  2025-03-14T05:45:19.1194943Z [12,214 / 15,235] 48 actions, 47 running 2025-03-14T05:45:19.1195658Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T05:45:19.1196337Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T05:45:19.1197034Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T05:45:19.1197739Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T05:45:19.1198415Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T05:45:19.1199017Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local 2025-03-14T05:45:19.1199631Z Compiling xla/service/collective_ops_utils.cc; 10s local 2025-03-14T05:45:19.1200331Z @xla//xla/hlo/transforms:batch_dot_simplification; 10s local ... 2025-03-14T05:45:19.5177399Z 2025-03-14T05:45:19.5178305Z  2025-03-14T05:45:19.5178821Z  2025-03-14T05:45:19.5179253Z  2025-03-14T05:45:19.5179648Z  2025-03-14T05:45:19.5180007Z  2025-03-14T05:45:19.5180351Z  2025-03-14T05:45:19.5180695Z  2025-03-14T05:45:19.5181053Z  2025-03-14T05:45:19.5181630Z [12,216 / 15,235] 48 actions running 2025-03-14T05:45:19.5182368Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T05:45:19.5183273Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T05:45:19.5184175Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T05:45:19.5184948Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 14s local 2025-03-14T05:45:19.5185659Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T05:45:19.5186279Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T05:45:19.5186935Z Compiling xla/service/collective_ops_utils.cc; 10s local 2025-03-14T05:45:19.5187746Z @xla//xla/hlo/transforms:batch_dot_simplification; 10s local ... 2025-03-14T05:45:19.7181590Z 2025-03-14T05:45:19.7182530Z  2025-03-14T05:45:19.7183037Z  2025-03-14T05:45:19.7183803Z  2025-03-14T05:45:19.7184227Z  2025-03-14T05:45:19.7184616Z  2025-03-14T05:45:19.7184977Z  2025-03-14T05:45:19.7185384Z  2025-03-14T05:45:19.7185715Z  2025-03-14T05:45:19.7186260Z [12,217 / 15,235] 48 actions running 2025-03-14T05:45:19.7186999Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T05:45:19.7187857Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T05:45:19.7188811Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T05:45:19.7189762Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 14s local 2025-03-14T05:45:19.7190670Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T05:45:19.7191454Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T05:45:19.7192211Z Compiling xla/service/collective_ops_utils.cc; 11s local 2025-03-14T05:45:19.7193165Z @xla//xla/hlo/transforms:batch_dot_simplification; 10s local ... 2025-03-14T05:45:19.9724735Z 2025-03-14T05:45:19.9725970Z  2025-03-14T05:45:19.9726487Z  2025-03-14T05:45:19.9726902Z  2025-03-14T05:45:19.9727318Z  2025-03-14T05:45:19.9727719Z  2025-03-14T05:45:19.9728105Z  2025-03-14T05:45:19.9728512Z  2025-03-14T05:45:19.9728959Z  2025-03-14T05:45:19.9729557Z [12,220 / 15,235] 48 actions, 47 running 2025-03-14T05:45:19.9730328Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2025-03-14T05:45:19.9731244Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T05:45:19.9732195Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T05:45:19.9733001Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T05:45:19.9733795Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T05:45:19.9734639Z Compiling xla/service/collective_ops_utils.cc; 11s local 2025-03-14T05:45:19.9737710Z @xla//xla/hlo/transforms:batch_dot_simplification; 10s local 2025-03-14T05:45:19.9739013Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 10s local ... 2025-03-14T05:45:20.3186993Z 2025-03-14T05:45:20.3188446Z  2025-03-14T05:45:20.3188946Z  2025-03-14T05:45:20.3189343Z  2025-03-14T05:45:20.3189735Z  2025-03-14T05:45:20.3190155Z  2025-03-14T05:45:20.3190537Z  2025-03-14T05:45:20.3190931Z  2025-03-14T05:45:20.3191318Z  2025-03-14T05:45:20.3191866Z [12,221 / 15,235] 48 actions running 2025-03-14T05:45:20.3192589Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2025-03-14T05:45:20.3193456Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T05:45:20.3194364Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2025-03-14T05:45:20.3195190Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T05:45:20.3195973Z Compiling xla/hlo/builder/lib/matrix.cc; 12s local 2025-03-14T05:45:20.3196876Z Compiling xla/service/collective_ops_utils.cc; 11s local 2025-03-14T05:45:20.3197779Z @xla//xla/hlo/transforms:batch_dot_simplification; 11s local 2025-03-14T05:45:20.3198789Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 10s local ... 2025-03-14T05:45:20.5344581Z 2025-03-14T05:45:20.5345545Z  2025-03-14T05:45:20.5345997Z  2025-03-14T05:45:20.5346379Z  2025-03-14T05:45:20.5346737Z  2025-03-14T05:45:20.5347093Z  2025-03-14T05:45:20.5347427Z  2025-03-14T05:45:20.5347774Z  2025-03-14T05:45:20.5348119Z  2025-03-14T05:45:20.5348651Z [12,227 / 15,235] 48 actions, 47 running 2025-03-14T05:45:20.5349422Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T05:45:20.5350215Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2025-03-14T05:45:20.5350927Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T05:45:20.5351651Z Compiling xla/hlo/builder/lib/matrix.cc; 12s local 2025-03-14T05:45:20.5352345Z Compiling xla/service/collective_ops_utils.cc; 12s local 2025-03-14T05:45:20.5353605Z @xla//xla/hlo/transforms:batch_dot_simplification; 11s local 2025-03-14T05:45:20.5354476Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T05:45:20.5355301Z Compiling xla/hlo/utils/hlo_query.cc; 10s local ... 2025-03-14T05:45:20.9192367Z 2025-03-14T05:45:20.9193209Z  2025-03-14T05:45:20.9193672Z  2025-03-14T05:45:20.9194071Z  2025-03-14T05:45:20.9194444Z  2025-03-14T05:45:20.9194810Z  2025-03-14T05:45:20.9195176Z  2025-03-14T05:45:20.9195535Z  2025-03-14T05:45:20.9195906Z  2025-03-14T05:45:20.9196440Z [12,230 / 15,235] 48 actions running 2025-03-14T05:45:20.9197236Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T05:45:20.9198113Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2025-03-14T05:45:20.9198905Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T05:45:20.9199678Z Compiling xla/service/collective_ops_utils.cc; 12s local 2025-03-14T05:45:20.9200528Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T05:45:20.9201532Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2025-03-14T05:45:20.9202384Z Compiling xla/hlo/transforms/simplifiers/flatten_call_graph.cc; 10s local 2025-03-14T05:45:20.9203261Z Compiling llvm/lib/IR/Constants.cpp; 9s local ... 2025-03-14T05:45:21.2620000Z 2025-03-14T05:45:21.2620808Z  2025-03-14T05:45:21.2621273Z  2025-03-14T05:45:21.2621668Z  2025-03-14T05:45:21.2622080Z  2025-03-14T05:45:21.2622479Z  2025-03-14T05:45:21.2622854Z  2025-03-14T05:45:21.2623230Z  2025-03-14T05:45:21.2623636Z  2025-03-14T05:45:21.2624201Z [12,234 / 15,235] 48 actions, 47 running 2025-03-14T05:45:21.2625025Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T05:45:21.2626313Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T05:45:21.2627117Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T05:45:21.2627895Z Compiling xla/service/collective_ops_utils.cc; 12s local 2025-03-14T05:45:21.2628790Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T05:45:21.2629629Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2025-03-14T05:45:21.2630564Z Compiling xla/hlo/transforms/simplifiers/flatten_call_graph.cc; 10s local 2025-03-14T05:45:21.2631533Z Compiling llvm/lib/IR/Constants.cpp; 10s local ... 2025-03-14T05:45:21.4738477Z 2025-03-14T05:45:21.4739371Z  2025-03-14T05:45:21.4739842Z  2025-03-14T05:45:21.4740243Z  2025-03-14T05:45:21.4740635Z  2025-03-14T05:45:21.4741011Z  2025-03-14T05:45:21.4741404Z  2025-03-14T05:45:21.4741792Z  2025-03-14T05:45:21.4742167Z  2025-03-14T05:45:21.4742804Z [12,238 / 15,235] 48 actions, 47 running 2025-03-14T05:45:21.4743645Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T05:45:21.4744561Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T05:45:21.4745331Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T05:45:21.4746101Z Compiling xla/service/collective_ops_utils.cc; 12s local 2025-03-14T05:45:21.4746887Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2025-03-14T05:45:21.4747836Z Compiling xla/hlo/transforms/simplifiers/flatten_call_graph.cc; 11s local 2025-03-14T05:45:21.4748788Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T05:45:21.4749539Z Compiling xla/service/hlo_graph_dumper.cc; 9s local ... 2025-03-14T05:45:21.7199051Z 2025-03-14T05:45:21.7199907Z  2025-03-14T05:45:21.7200393Z  2025-03-14T05:45:21.7200817Z  2025-03-14T05:45:21.7201248Z  2025-03-14T05:45:21.7201644Z  2025-03-14T05:45:21.7202047Z  2025-03-14T05:45:21.7202452Z  2025-03-14T05:45:21.7202868Z  2025-03-14T05:45:21.7203460Z [12,243 / 15,235] 48 actions running 2025-03-14T05:45:21.7204948Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T05:45:21.7205836Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T05:45:21.7206624Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T05:45:21.7207418Z Compiling xla/service/collective_ops_utils.cc; 13s local 2025-03-14T05:45:21.7208177Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2025-03-14T05:45:21.7209094Z Compiling xla/hlo/transforms/simplifiers/flatten_call_graph.cc; 11s local 2025-03-14T05:45:21.7210085Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T05:45:21.7210923Z Compiling xla/service/hlo_graph_dumper.cc; 9s local ... 2025-03-14T05:45:21.9202483Z 2025-03-14T05:45:21.9203333Z  2025-03-14T05:45:21.9203806Z  2025-03-14T05:45:21.9204192Z  2025-03-14T05:45:21.9204784Z  2025-03-14T05:45:21.9205223Z  2025-03-14T05:45:21.9205615Z  2025-03-14T05:45:21.9206036Z  2025-03-14T05:45:21.9206420Z  2025-03-14T05:45:21.9206974Z [12,245 / 15,235] 48 actions running 2025-03-14T05:45:21.9207845Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T05:45:21.9208758Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T05:45:21.9209568Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T05:45:21.9210376Z Compiling xla/service/collective_ops_utils.cc; 13s local 2025-03-14T05:45:21.9211430Z Compiling xla/hlo/transforms/simplifiers/flatten_call_graph.cc; 11s local 2025-03-14T05:45:21.9212363Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T05:45:21.9213127Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T05:45:21.9213943Z Compiling xla/hlo/builder/lib/sorting.cc; 9s local ... 2025-03-14T05:45:22.1924403Z 2025-03-14T05:45:22.1925441Z  2025-03-14T05:45:22.1926259Z  2025-03-14T05:45:22.1926656Z  2025-03-14T05:45:22.1927021Z  2025-03-14T05:45:22.1927385Z  2025-03-14T05:45:22.1927754Z  2025-03-14T05:45:22.1928127Z  2025-03-14T05:45:22.1928488Z  2025-03-14T05:45:22.1929048Z [12,247 / 15,235] 48 actions, 47 running 2025-03-14T05:45:22.1929860Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T05:45:22.1930732Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T05:45:22.1931498Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T05:45:22.1932299Z Compiling xla/service/collective_ops_utils.cc; 13s local 2025-03-14T05:45:22.1933044Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T05:45:22.1933748Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T05:45:22.1934459Z Compiling xla/hlo/builder/lib/sorting.cc; 9s local 2025-03-14T05:45:22.1935205Z Compiling xla/service/host_offload_utils.cc; 9s local ... 2025-03-14T05:45:22.4593370Z 2025-03-14T05:45:22.4595354Z  2025-03-14T05:45:22.4595855Z  2025-03-14T05:45:22.4596266Z  2025-03-14T05:45:22.4596728Z  2025-03-14T05:45:22.4597132Z  2025-03-14T05:45:22.4597519Z  2025-03-14T05:45:22.4597911Z  2025-03-14T05:45:22.4598308Z  2025-03-14T05:45:22.4599034Z [12,249 / 15,235] 48 actions, 47 running 2025-03-14T05:45:22.4599910Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T05:45:22.4600854Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T05:45:22.4601686Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T05:45:22.4602522Z Compiling xla/service/collective_ops_utils.cc; 13s local 2025-03-14T05:45:22.4603364Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T05:45:22.4604172Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T05:45:22.4605077Z Compiling xla/hlo/builder/lib/sorting.cc; 10s local 2025-03-14T05:45:22.4605927Z Compiling xla/service/host_offload_utils.cc; 9s local ... 2025-03-14T05:45:22.6800375Z 2025-03-14T05:45:22.6801229Z  2025-03-14T05:45:22.6801720Z  2025-03-14T05:45:22.6802107Z  2025-03-14T05:45:22.6802488Z  2025-03-14T05:45:22.6802871Z  2025-03-14T05:45:22.6803228Z  2025-03-14T05:45:22.6803604Z  2025-03-14T05:45:22.6803978Z  2025-03-14T05:45:22.6804705Z [12,251 / 15,235] 48 actions, 47 running 2025-03-14T05:45:22.6805668Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T05:45:22.6806585Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T05:45:22.6807416Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T05:45:22.6808255Z Compiling xla/service/collective_ops_utils.cc; 14s local 2025-03-14T05:45:22.6809046Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T05:45:22.6809832Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T05:45:22.6810660Z Compiling xla/hlo/builder/lib/sorting.cc; 10s local 2025-03-14T05:45:22.6811486Z Compiling xla/service/host_offload_utils.cc; 9s local ... 2025-03-14T05:45:22.9212748Z 2025-03-14T05:45:22.9213596Z  2025-03-14T05:45:22.9214085Z  2025-03-14T05:45:22.9214493Z  2025-03-14T05:45:22.9214925Z  2025-03-14T05:45:22.9215355Z  2025-03-14T05:45:22.9215775Z  2025-03-14T05:45:22.9216179Z  2025-03-14T05:45:22.9216578Z  2025-03-14T05:45:22.9217165Z [12,253 / 15,235] 48 actions running 2025-03-14T05:45:22.9218075Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T05:45:22.9219057Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T05:45:22.9219898Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T05:45:22.9220731Z Compiling xla/service/collective_ops_utils.cc; 14s local 2025-03-14T05:45:22.9221572Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T05:45:22.9222814Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T05:45:22.9223732Z Compiling xla/service/host_offload_utils.cc; 10s local 2025-03-14T05:45:22.9224791Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 9s local ... 2025-03-14T05:45:23.2154821Z 2025-03-14T05:45:23.2155644Z  2025-03-14T05:45:23.2156118Z  2025-03-14T05:45:23.2156501Z  2025-03-14T05:45:23.2156884Z  2025-03-14T05:45:23.2157289Z  2025-03-14T05:45:23.2157717Z  2025-03-14T05:45:23.2158143Z  2025-03-14T05:45:23.2158575Z  2025-03-14T05:45:23.2159203Z [12,256 / 15,235] 48 actions, 47 running 2025-03-14T05:45:23.2160079Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T05:45:23.2161057Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 23s local 2025-03-14T05:45:23.2161922Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T05:45:23.2162824Z Compiling xla/service/collective_ops_utils.cc; 14s local 2025-03-14T05:45:23.2163633Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T05:45:23.2164625Z Compiling xla/service/host_offload_utils.cc; 10s local 2025-03-14T05:45:23.2165792Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 9s local 2025-03-14T05:45:23.2166627Z Compiling llvm/lib/IR/Core.cpp; 9s local ... 2025-03-14T05:45:23.5099379Z 2025-03-14T05:45:23.5100264Z  2025-03-14T05:45:23.5100760Z  2025-03-14T05:45:23.5101168Z  2025-03-14T05:45:23.5101539Z  2025-03-14T05:45:23.5101899Z  2025-03-14T05:45:23.5102280Z  2025-03-14T05:45:23.5102686Z  2025-03-14T05:45:23.5103093Z  2025-03-14T05:45:23.5103674Z [12,258 / 15,235] 48 actions, 47 running 2025-03-14T05:45:23.5104435Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T05:45:23.5105365Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 23s local 2025-03-14T05:45:23.5106213Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T05:45:23.5107001Z Compiling xla/service/collective_ops_utils.cc; 14s local 2025-03-14T05:45:23.5108233Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T05:45:23.5109105Z Compiling xla/service/host_offload_utils.cc; 10s local 2025-03-14T05:45:23.5109980Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 10s local 2025-03-14T05:45:23.5110913Z Compiling xla/service/hlo_verifier.cc; 7s local ... 2025-03-14T05:45:23.7218123Z 2025-03-14T05:45:23.7218971Z  2025-03-14T05:45:23.7219481Z  2025-03-14T05:45:23.7219893Z  2025-03-14T05:45:23.7220291Z  2025-03-14T05:45:23.7220714Z  2025-03-14T05:45:23.7221135Z  2025-03-14T05:45:23.7221559Z  2025-03-14T05:45:23.7221983Z  2025-03-14T05:45:23.7222606Z [12,261 / 15,235] 48 actions, 47 running 2025-03-14T05:45:23.7223512Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T05:45:23.7224603Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T05:45:23.7225435Z Compiling xla/service/collective_ops_utils.cc; 15s local 2025-03-14T05:45:23.7226257Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T05:45:23.7227081Z Compiling xla/service/host_offload_utils.cc; 10s local 2025-03-14T05:45:23.7228103Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 10s local 2025-03-14T05:45:23.7229110Z Compiling xla/service/hlo_verifier.cc; 7s local 2025-03-14T05:45:23.7230062Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local ... 2025-03-14T05:45:23.9222678Z 2025-03-14T05:45:23.9223539Z  2025-03-14T05:45:23.9224036Z  2025-03-14T05:45:23.9224443Z  2025-03-14T05:45:23.9224839Z  2025-03-14T05:45:23.9225249Z  2025-03-14T05:45:23.9225643Z  2025-03-14T05:45:23.9226034Z  2025-03-14T05:45:23.9226425Z  2025-03-14T05:45:23.9227022Z [12,261 / 15,235] 48 actions running 2025-03-14T05:45:23.9228316Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T05:45:23.9229234Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T05:45:23.9230055Z Compiling xla/service/collective_ops_utils.cc; 15s local 2025-03-14T05:45:23.9230889Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T05:45:23.9231735Z Compiling xla/service/host_offload_utils.cc; 11s local 2025-03-14T05:45:23.9232766Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 10s local 2025-03-14T05:45:23.9233729Z Compiling xla/service/hlo_verifier.cc; 7s local 2025-03-14T05:45:23.9234588Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local ... 2025-03-14T05:45:24.1598206Z 2025-03-14T05:45:24.1599116Z  2025-03-14T05:45:24.1599615Z  2025-03-14T05:45:24.1600038Z  2025-03-14T05:45:24.1600402Z  2025-03-14T05:45:24.1600793Z  2025-03-14T05:45:24.1601190Z  2025-03-14T05:45:24.1601563Z  2025-03-14T05:45:24.1601982Z  2025-03-14T05:45:24.1602594Z [12,262 / 15,235] 48 actions, 47 running 2025-03-14T05:45:24.1603505Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T05:45:24.1604407Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T05:45:24.1605367Z Compiling xla/service/collective_ops_utils.cc; 15s local 2025-03-14T05:45:24.1606184Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T05:45:24.1607016Z Compiling xla/service/host_offload_utils.cc; 11s local 2025-03-14T05:45:24.1607968Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 10s local 2025-03-14T05:45:24.1608891Z Compiling xla/service/hlo_verifier.cc; 8s local 2025-03-14T05:45:24.1609805Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2025-03-14T05:45:24.5024615Z 2025-03-14T05:45:24.5025434Z  2025-03-14T05:45:24.5025915Z  2025-03-14T05:45:24.5026303Z  2025-03-14T05:45:24.5026705Z  2025-03-14T05:45:24.5027152Z  2025-03-14T05:45:24.5027544Z  2025-03-14T05:45:24.5028264Z  2025-03-14T05:45:24.5028655Z  2025-03-14T05:45:24.5029250Z [12,268 / 15,235] 48 actions, 47 running 2025-03-14T05:45:24.5030099Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T05:45:24.5030951Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T05:45:24.5031753Z Compiling xla/service/collective_ops_utils.cc; 15s local 2025-03-14T05:45:24.5032550Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T05:45:24.5033351Z Compiling xla/service/host_offload_utils.cc; 11s local 2025-03-14T05:45:24.5034259Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 11s local 2025-03-14T05:45:24.5035241Z Compiling xla/service/hlo_verifier.cc; 8s local 2025-03-14T05:45:24.5036117Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2025-03-14T05:45:24.7230723Z 2025-03-14T05:45:24.7231547Z  2025-03-14T05:45:24.7232078Z  2025-03-14T05:45:24.7232530Z  2025-03-14T05:45:24.7232987Z  2025-03-14T05:45:24.7233386Z  2025-03-14T05:45:24.7233794Z  2025-03-14T05:45:24.7234211Z  2025-03-14T05:45:24.7234588Z  2025-03-14T05:45:24.7235298Z [12,269 / 15,235] 48 actions running 2025-03-14T05:45:24.7236183Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T05:45:24.7237130Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T05:45:24.7237974Z Compiling xla/service/collective_ops_utils.cc; 16s local 2025-03-14T05:45:24.7238800Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T05:45:24.7239643Z Compiling xla/service/host_offload_utils.cc; 11s local 2025-03-14T05:45:24.7240636Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 11s local 2025-03-14T05:45:24.7241522Z Compiling xla/service/hlo_verifier.cc; 8s local 2025-03-14T05:45:24.7242738Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2025-03-14T05:45:25.0024887Z 2025-03-14T05:45:25.0025845Z  2025-03-14T05:45:25.0026337Z  2025-03-14T05:45:25.0026718Z  2025-03-14T05:45:25.0027122Z  2025-03-14T05:45:25.0027506Z  2025-03-14T05:45:25.0027895Z  2025-03-14T05:45:25.0028318Z  2025-03-14T05:45:25.0028694Z  2025-03-14T05:45:25.0029186Z [12,270 / 15,235] 48 actions, 47 running 2025-03-14T05:45:25.0029995Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T05:45:25.0030801Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T05:45:25.0031572Z Compiling xla/service/collective_ops_utils.cc; 16s local 2025-03-14T05:45:25.0032255Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T05:45:25.0032941Z Compiling xla/service/host_offload_utils.cc; 12s local 2025-03-14T05:45:25.0033754Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 11s local 2025-03-14T05:45:25.0034526Z Compiling xla/service/hlo_verifier.cc; 9s local 2025-03-14T05:45:25.0035472Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2025-03-14T05:45:25.2633893Z 2025-03-14T05:45:25.2634736Z  2025-03-14T05:45:25.2635427Z  2025-03-14T05:45:25.2635904Z  2025-03-14T05:45:25.2636379Z  2025-03-14T05:45:25.2636854Z  2025-03-14T05:45:25.2637313Z  2025-03-14T05:45:25.2637786Z  2025-03-14T05:45:25.2638171Z  2025-03-14T05:45:25.2638750Z [12,274 / 15,235] 48 actions, 47 running 2025-03-14T05:45:25.2639689Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T05:45:25.2640613Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T05:45:25.2641447Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T05:45:25.2642254Z Compiling xla/service/host_offload_utils.cc; 12s local 2025-03-14T05:45:25.2643196Z @llvm-project//llvm:X86CommonTableGen__gen_subtarget_genrule; 11s local 2025-03-14T05:45:25.2644082Z Compiling xla/service/hlo_verifier.cc; 9s local 2025-03-14T05:45:25.2645363Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T05:45:25.2646137Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2025-03-14T05:45:25.4847134Z 2025-03-14T05:45:25.4848029Z  2025-03-14T05:45:25.4848501Z  2025-03-14T05:45:25.4848892Z  2025-03-14T05:45:25.4849494Z  2025-03-14T05:45:25.4849963Z  2025-03-14T05:45:25.4850348Z  2025-03-14T05:45:25.4850698Z  2025-03-14T05:45:25.4851155Z  2025-03-14T05:45:25.4851731Z [12,276 / 15,235] 48 actions, 47 running 2025-03-14T05:45:25.4852568Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T05:45:25.4853406Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T05:45:25.4854090Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T05:45:25.4854819Z Compiling xla/service/host_offload_utils.cc; 12s local 2025-03-14T05:45:25.4855618Z Compiling xla/service/hlo_verifier.cc; 9s local 2025-03-14T05:45:25.4856369Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T05:45:25.4857105Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T05:45:25.4857786Z @llvm-project//mlir:mlir-tblgen; 7s local ... 2025-03-14T05:45:25.7240953Z 2025-03-14T05:45:25.7241806Z  2025-03-14T05:45:25.7242323Z  2025-03-14T05:45:25.7242724Z  2025-03-14T05:45:25.7243124Z  2025-03-14T05:45:25.7243523Z  2025-03-14T05:45:25.7243920Z  2025-03-14T05:45:25.7244324Z  2025-03-14T05:45:25.7244861Z  2025-03-14T05:45:25.7245426Z [12,279 / 15,235] 48 actions running 2025-03-14T05:45:25.7246281Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T05:45:25.7247171Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T05:45:25.7247944Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T05:45:25.7249049Z Compiling xla/service/hlo_verifier.cc; 9s local 2025-03-14T05:45:25.7250042Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T05:45:25.7250904Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T05:45:25.7251848Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 8s local 2025-03-14T05:45:25.7252919Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2025-03-14T05:45:25.9243974Z 2025-03-14T05:45:25.9245026Z  2025-03-14T05:45:25.9245534Z  2025-03-14T05:45:25.9245973Z  2025-03-14T05:45:25.9246407Z  2025-03-14T05:45:25.9246836Z  2025-03-14T05:45:25.9247261Z  2025-03-14T05:45:25.9247680Z  2025-03-14T05:45:25.9248112Z  2025-03-14T05:45:25.9248704Z [12,281 / 15,235] 48 actions running 2025-03-14T05:45:25.9249600Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T05:45:25.9250539Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T05:45:25.9251411Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T05:45:25.9252189Z Compiling xla/service/hlo_verifier.cc; 9s local 2025-03-14T05:45:25.9253066Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T05:45:25.9253949Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T05:45:25.9254884Z Compiling mlir/tools/mlir-tblgen/AttrOrTypeDefGen.cpp [for tool]; 8s local 2025-03-14T05:45:25.9255949Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2025-03-14T05:45:26.1372737Z 2025-03-14T05:45:26.1373616Z  2025-03-14T05:45:26.1374218Z  2025-03-14T05:45:26.1374839Z  2025-03-14T05:45:26.1375230Z  2025-03-14T05:45:26.1375687Z  2025-03-14T05:45:26.1376134Z  2025-03-14T05:45:26.1376519Z  2025-03-14T05:45:26.1376908Z  2025-03-14T05:45:26.1377554Z [12,283 / 15,235] 48 actions, 47 running 2025-03-14T05:45:26.1378528Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T05:45:26.1379398Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T05:45:26.1380525Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T05:45:26.1381284Z Compiling xla/service/hlo_verifier.cc; 10s local 2025-03-14T05:45:26.1382109Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T05:45:26.1382990Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T05:45:26.1383789Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2025-03-14T05:45:26.1384639Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 8s local ... 2025-03-14T05:45:26.4094931Z 2025-03-14T05:45:26.4095766Z  2025-03-14T05:45:26.4096253Z  2025-03-14T05:45:26.4096690Z  2025-03-14T05:45:26.4097104Z  2025-03-14T05:45:26.4097491Z  2025-03-14T05:45:26.4097858Z  2025-03-14T05:45:26.4098231Z  2025-03-14T05:45:26.4098615Z  2025-03-14T05:45:26.4099233Z [12,284 / 15,235] 48 actions, 47 running 2025-03-14T05:45:26.4100089Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T05:45:26.4101017Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T05:45:26.4101796Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T05:45:26.4102528Z Compiling xla/service/hlo_verifier.cc; 10s local 2025-03-14T05:45:26.4103350Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T05:45:26.4104210Z Compiling llvm/lib/IR/DebugInfo.cpp; 9s local 2025-03-14T05:45:26.4104959Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2025-03-14T05:45:26.4105872Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 8s local ... 2025-03-14T05:45:26.6676046Z 2025-03-14T05:45:26.6676934Z  2025-03-14T05:45:26.6677492Z  2025-03-14T05:45:26.6677971Z  2025-03-14T05:45:26.6678459Z  2025-03-14T05:45:26.6678930Z  2025-03-14T05:45:26.6679408Z  2025-03-14T05:45:26.6679880Z  2025-03-14T05:45:26.6680719Z  2025-03-14T05:45:26.6681450Z [12,289 / 15,235] 48 actions, 47 running 2025-03-14T05:45:26.6682517Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T05:45:26.6683582Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T05:45:26.6684640Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T05:45:26.6685557Z Compiling xla/service/hlo_verifier.cc; 10s local 2025-03-14T05:45:26.6686594Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T05:45:26.6687676Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2025-03-14T05:45:26.6688837Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 8s local 2025-03-14T05:45:26.6690097Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 8s local ... 2025-03-14T05:45:26.9023193Z 2025-03-14T05:45:26.9024121Z  2025-03-14T05:45:26.9024628Z  2025-03-14T05:45:26.9025049Z  2025-03-14T05:45:26.9025478Z  2025-03-14T05:45:26.9025946Z  2025-03-14T05:45:26.9026372Z  2025-03-14T05:45:26.9026778Z  2025-03-14T05:45:26.9027296Z  2025-03-14T05:45:26.9028029Z [12,290 / 15,235] 48 actions, 47 running 2025-03-14T05:45:26.9028729Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T05:45:26.9029529Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T05:45:26.9030298Z Compiling xla/service/hlo_verifier.cc; 10s local 2025-03-14T05:45:26.9031204Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T05:45:26.9032174Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2025-03-14T05:45:26.9033170Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 8s local 2025-03-14T05:45:26.9034264Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 8s local 2025-03-14T05:45:26.9035112Z Compiling xla/service/map_inliner.cc; 8s local ... 2025-03-14T05:45:27.1255089Z 2025-03-14T05:45:27.1255954Z  2025-03-14T05:45:27.1256489Z  2025-03-14T05:45:27.1256934Z  2025-03-14T05:45:27.1257680Z  2025-03-14T05:45:27.1258142Z  2025-03-14T05:45:27.1258504Z  2025-03-14T05:45:27.1258922Z  2025-03-14T05:45:27.1259322Z  2025-03-14T05:45:27.1259965Z [12,295 / 15,235] 48 actions running 2025-03-14T05:45:27.1260743Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T05:45:27.1261537Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T05:45:27.1262477Z Compiling xla/service/hlo_verifier.cc; 11s local 2025-03-14T05:45:27.1263445Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T05:45:27.1264385Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2025-03-14T05:45:27.1265707Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 8s local 2025-03-14T05:45:27.1266857Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 8s local 2025-03-14T05:45:27.1267756Z Compiling xla/service/map_inliner.cc; 8s local ... 2025-03-14T05:45:27.5967710Z 2025-03-14T05:45:27.5968864Z  2025-03-14T05:45:27.5969317Z  2025-03-14T05:45:27.5969679Z  2025-03-14T05:45:27.5970040Z  2025-03-14T05:45:27.5970395Z  2025-03-14T05:45:27.5970721Z  2025-03-14T05:45:27.5971039Z  2025-03-14T05:45:27.5971380Z  2025-03-14T05:45:27.5971968Z [12,296 / 15,235] 48 actions, 47 running 2025-03-14T05:45:27.5972693Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T05:45:27.5973420Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T05:45:27.5974200Z Compiling xla/service/hlo_verifier.cc; 11s local 2025-03-14T05:45:27.5975113Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2025-03-14T05:45:27.5976048Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2025-03-14T05:45:27.5977066Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 9s local 2025-03-14T05:45:27.5978467Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 9s local 2025-03-14T05:45:27.5979343Z Compiling xla/service/map_inliner.cc; 9s local ... 2025-03-14T05:45:27.8009585Z 2025-03-14T05:45:27.8010423Z  2025-03-14T05:45:27.8010914Z  2025-03-14T05:45:27.8011340Z  2025-03-14T05:45:27.8011761Z  2025-03-14T05:45:27.8012172Z  2025-03-14T05:45:27.8012582Z  2025-03-14T05:45:27.8012996Z  2025-03-14T05:45:27.8013354Z  2025-03-14T05:45:27.8013957Z [12,298 / 15,235] 48 actions, 47 running 2025-03-14T05:45:27.8014759Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T05:45:27.8015568Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T05:45:27.8016371Z Compiling xla/service/hlo_verifier.cc; 11s local 2025-03-14T05:45:27.8017179Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2025-03-14T05:45:27.8018205Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 9s local 2025-03-14T05:45:27.8019323Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 9s local 2025-03-14T05:45:27.8020215Z Compiling xla/service/map_inliner.cc; 9s local 2025-03-14T05:45:27.8020981Z Compiling llvm/lib/IR/Dominators.cpp; 7s local ... 2025-03-14T05:45:28.1263805Z 2025-03-14T05:45:28.1264652Z  2025-03-14T05:45:28.1265152Z  2025-03-14T05:45:28.1265777Z  2025-03-14T05:45:28.1266152Z  2025-03-14T05:45:28.1266549Z  2025-03-14T05:45:28.1266960Z  2025-03-14T05:45:28.1267370Z  2025-03-14T05:45:28.1267764Z  2025-03-14T05:45:28.1268349Z [12,299 / 15,235] 48 actions running 2025-03-14T05:45:28.1269090Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T05:45:28.1269835Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T05:45:28.1270613Z Compiling xla/service/hlo_verifier.cc; 12s local 2025-03-14T05:45:28.1271382Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2025-03-14T05:45:28.1272412Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 9s local 2025-03-14T05:45:28.1273833Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 9s local 2025-03-14T05:45:28.1274782Z Compiling xla/service/map_inliner.cc; 9s local 2025-03-14T05:45:28.1275560Z Compiling llvm/lib/IR/Dominators.cpp; 8s local ... 2025-03-14T05:45:28.3397284Z 2025-03-14T05:45:28.3398138Z  2025-03-14T05:45:28.3398640Z  2025-03-14T05:45:28.3399055Z  2025-03-14T05:45:28.3399440Z  2025-03-14T05:45:28.3399817Z  2025-03-14T05:45:28.3400138Z  2025-03-14T05:45:28.3400443Z  2025-03-14T05:45:28.3400754Z  2025-03-14T05:45:28.3401270Z [12,302 / 15,235] 48 actions, 47 running 2025-03-14T05:45:28.3402010Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T05:45:28.3402805Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T05:45:28.3403569Z Compiling xla/service/hlo_verifier.cc; 12s local 2025-03-14T05:45:28.3404378Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2025-03-14T05:45:28.3405514Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T05:45:28.3406518Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 10s local 2025-03-14T05:45:28.3417852Z Compiling xla/service/map_inliner.cc; 10s local 2025-03-14T05:45:28.3418927Z Compiling llvm/lib/IR/Dominators.cpp; 8s local ... 2025-03-14T05:45:28.5622081Z 2025-03-14T05:45:28.5622940Z  2025-03-14T05:45:28.5623430Z  2025-03-14T05:45:28.5623864Z  2025-03-14T05:45:28.5624291Z  2025-03-14T05:45:28.5624702Z  2025-03-14T05:45:28.5625102Z  2025-03-14T05:45:28.5625503Z  2025-03-14T05:45:28.5625913Z  2025-03-14T05:45:28.5626505Z [12,304 / 15,235] 48 actions, 47 running 2025-03-14T05:45:28.5627228Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T05:45:28.5627982Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T05:45:28.5629096Z Compiling xla/service/hlo_verifier.cc; 12s local 2025-03-14T05:45:28.5629886Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2025-03-14T05:45:28.5630858Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T05:45:28.5631875Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 10s local 2025-03-14T05:45:28.5632699Z Compiling xla/service/map_inliner.cc; 10s local 2025-03-14T05:45:28.5633451Z Compiling llvm/lib/IR/Dominators.cpp; 8s local ... 2025-03-14T05:45:28.9271758Z 2025-03-14T05:45:28.9272625Z  2025-03-14T05:45:28.9273083Z  2025-03-14T05:45:28.9273436Z  2025-03-14T05:45:28.9273798Z  2025-03-14T05:45:28.9274151Z  2025-03-14T05:45:28.9274496Z  2025-03-14T05:45:28.9274823Z  2025-03-14T05:45:28.9275176Z  2025-03-14T05:45:28.9275702Z [12,306 / 15,235] 48 actions running 2025-03-14T05:45:28.9276360Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T05:45:28.9277095Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T05:45:28.9277785Z Compiling xla/service/hlo_verifier.cc; 12s local 2025-03-14T05:45:28.9278506Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2025-03-14T05:45:28.9279383Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T05:45:28.9280284Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 10s local 2025-03-14T05:45:28.9281019Z Compiling xla/service/map_inliner.cc; 10s local 2025-03-14T05:45:28.9281679Z Compiling llvm/lib/IR/Dominators.cpp; 9s local ... 2025-03-14T05:45:29.3127811Z 2025-03-14T05:45:29.3128583Z  2025-03-14T05:45:29.3128983Z  2025-03-14T05:45:29.3129307Z  2025-03-14T05:45:29.3129628Z  2025-03-14T05:45:29.3129948Z  2025-03-14T05:45:29.3130266Z  2025-03-14T05:45:29.3130595Z  2025-03-14T05:45:29.3130922Z  2025-03-14T05:45:29.3131409Z [12,309 / 15,235] 48 actions, 47 running 2025-03-14T05:45:29.3132047Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T05:45:29.3133045Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T05:45:29.3133644Z Compiling xla/service/hlo_verifier.cc; 13s local 2025-03-14T05:45:29.3134264Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2025-03-14T05:45:29.3135215Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2025-03-14T05:45:29.3136057Z Compiling xla/service/cpu_gpu_shape_verifier.cc; 11s local 2025-03-14T05:45:29.3136718Z Compiling xla/service/map_inliner.cc; 11s local 2025-03-14T05:45:29.3137334Z Compiling llvm/lib/IR/Dominators.cpp; 9s local ... 2025-03-14T05:45:29.5276732Z 2025-03-14T05:45:29.5277600Z  2025-03-14T05:45:29.5278102Z  2025-03-14T05:45:29.5278507Z  2025-03-14T05:45:29.5278925Z  2025-03-14T05:45:29.5279313Z  2025-03-14T05:45:29.5279726Z  2025-03-14T05:45:29.5280123Z  2025-03-14T05:45:29.5280500Z  2025-03-14T05:45:29.5281124Z [12,313 / 15,235] 48 actions running 2025-03-14T05:45:29.5281905Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T05:45:29.5282703Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T05:45:29.5283463Z Compiling xla/service/hlo_verifier.cc; 13s local 2025-03-14T05:45:29.5284263Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2025-03-14T05:45:29.5285401Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2025-03-14T05:45:29.5286362Z Compiling xla/service/map_inliner.cc; 11s local 2025-03-14T05:45:29.5287150Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T05:45:29.5288086Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local ... 2025-03-14T05:45:29.8147885Z 2025-03-14T05:45:29.8148847Z  2025-03-14T05:45:29.8149344Z  2025-03-14T05:45:29.8149753Z  2025-03-14T05:45:29.8150205Z  2025-03-14T05:45:29.8150605Z  2025-03-14T05:45:29.8151017Z  2025-03-14T05:45:29.8151904Z  2025-03-14T05:45:29.8152362Z  2025-03-14T05:45:29.8153007Z [12,314 / 15,235] 48 actions, 47 running 2025-03-14T05:45:29.8153771Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T05:45:29.8154580Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T05:45:29.8155396Z Compiling xla/service/hlo_verifier.cc; 13s local 2025-03-14T05:45:29.8156177Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2025-03-14T05:45:29.8157178Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2025-03-14T05:45:29.8158156Z Compiling xla/service/map_inliner.cc; 11s local 2025-03-14T05:45:29.8158914Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T05:45:29.8159808Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local ... 2025-03-14T05:45:30.0157677Z 2025-03-14T05:45:30.0158503Z  2025-03-14T05:45:30.0159009Z  2025-03-14T05:45:30.0159412Z  2025-03-14T05:45:30.0159843Z  2025-03-14T05:45:30.0160223Z  2025-03-14T05:45:30.0160638Z  2025-03-14T05:45:30.0161032Z  2025-03-14T05:45:30.0161425Z  2025-03-14T05:45:30.0162000Z [12,316 / 15,235] 48 actions, 47 running 2025-03-14T05:45:30.0162760Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T05:45:30.0163541Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T05:45:30.0164259Z Compiling xla/service/hlo_verifier.cc; 14s local 2025-03-14T05:45:30.0165120Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2025-03-14T05:45:30.0166250Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2025-03-14T05:45:30.0167244Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T05:45:30.0168139Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local 2025-03-14T05:45:30.0169100Z @xla//xla/hlo/transforms:convolution_group_converter; 9s local ... 2025-03-14T05:45:30.2586092Z 2025-03-14T05:45:30.2586960Z  2025-03-14T05:45:30.2587428Z  2025-03-14T05:45:30.2588208Z  2025-03-14T05:45:30.2588605Z  2025-03-14T05:45:30.2589015Z  2025-03-14T05:45:30.2589413Z  2025-03-14T05:45:30.2589792Z  2025-03-14T05:45:30.2590191Z  2025-03-14T05:45:30.2590792Z [12,319 / 15,235] 48 actions, 47 running 2025-03-14T05:45:30.2591565Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T05:45:30.2592344Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T05:45:30.2593127Z Compiling xla/service/hlo_verifier.cc; 14s local 2025-03-14T05:45:30.2594051Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 12s local 2025-03-14T05:45:30.2595100Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T05:45:30.2595991Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local 2025-03-14T05:45:30.2596939Z @xla//xla/hlo/transforms:convolution_group_converter; 9s local 2025-03-14T05:45:30.2597946Z Compiling xla/service/triangular_solve_expander.cc; 9s local ... 2025-03-14T05:45:30.4826206Z 2025-03-14T05:45:30.4827023Z  2025-03-14T05:45:30.4827514Z  2025-03-14T05:45:30.4827923Z  2025-03-14T05:45:30.4828322Z  2025-03-14T05:45:30.4828689Z  2025-03-14T05:45:30.4829052Z  2025-03-14T05:45:30.4829416Z  2025-03-14T05:45:30.4829786Z  2025-03-14T05:45:30.4830346Z [12,324 / 15,235] 48 actions, 47 running 2025-03-14T05:45:30.4831096Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T05:45:30.4831827Z Compiling xla/service/hlo_verifier.cc; 14s local 2025-03-14T05:45:30.4832786Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 12s local 2025-03-14T05:45:30.4833780Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T05:45:30.4834634Z Compiling xla/service/cpu/in_process_collectives.cc; 9s local 2025-03-14T05:45:30.4835915Z @xla//xla/hlo/transforms:convolution_group_converter; 9s local 2025-03-14T05:45:30.4836864Z Compiling xla/service/triangular_solve_expander.cc; 9s local 2025-03-14T05:45:30.4837765Z Compiling llvm/lib/Object/ELF.cpp; 9s local ... 2025-03-14T05:45:30.7286076Z 2025-03-14T05:45:30.7286871Z  2025-03-14T05:45:30.7287346Z  2025-03-14T05:45:30.7287769Z  2025-03-14T05:45:30.7288148Z  2025-03-14T05:45:30.7288561Z  2025-03-14T05:45:30.7288958Z  2025-03-14T05:45:30.7289356Z  2025-03-14T05:45:30.7289719Z  2025-03-14T05:45:30.7290266Z [12,326 / 15,235] 48 actions running 2025-03-14T05:45:30.7291005Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T05:45:30.7291788Z Compiling xla/service/hlo_verifier.cc; 14s local 2025-03-14T05:45:30.7292693Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 12s local 2025-03-14T05:45:30.7293684Z Compiling xla/service/sharding_propagation.cc; 10s local 2025-03-14T05:45:30.7294568Z Compiling xla/service/cpu/in_process_collectives.cc; 10s local 2025-03-14T05:45:30.7295559Z @xla//xla/hlo/transforms:convolution_group_converter; 10s local 2025-03-14T05:45:30.7296461Z Compiling xla/service/triangular_solve_expander.cc; 10s local 2025-03-14T05:45:30.7297235Z Compiling llvm/lib/Object/ELF.cpp; 9s local ... 2025-03-14T05:45:30.9710276Z 2025-03-14T05:45:30.9711085Z  2025-03-14T05:45:30.9711558Z  2025-03-14T05:45:30.9711965Z  2025-03-14T05:45:30.9712354Z  2025-03-14T05:45:30.9712693Z  2025-03-14T05:45:30.9713152Z  2025-03-14T05:45:30.9713601Z  2025-03-14T05:45:30.9713981Z  2025-03-14T05:45:30.9714600Z [12,329 / 15,235] 48 actions, 47 running 2025-03-14T05:45:30.9715402Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T05:45:30.9716235Z Compiling xla/service/hlo_verifier.cc; 15s local 2025-03-14T05:45:30.9717110Z Compiling xla/service/sharding_propagation.cc; 10s local 2025-03-14T05:45:30.9718136Z Compiling xla/service/cpu/in_process_collectives.cc; 10s local 2025-03-14T05:45:30.9719491Z @xla//xla/hlo/transforms:convolution_group_converter; 10s local 2025-03-14T05:45:30.9720554Z Compiling xla/service/triangular_solve_expander.cc; 10s local 2025-03-14T05:45:30.9721454Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T05:45:30.9722472Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 9s local ... 2025-03-14T05:45:31.2559313Z 2025-03-14T05:45:31.2560354Z  2025-03-14T05:45:31.2561575Z  2025-03-14T05:45:31.2562924Z  2025-03-14T05:45:31.2564570Z  2025-03-14T05:45:31.2566573Z  2025-03-14T05:45:31.2566955Z  2025-03-14T05:45:31.2567293Z  2025-03-14T05:45:31.2567650Z  2025-03-14T05:45:31.2568144Z [12,332 / 15,235] 48 actions, 47 running 2025-03-14T05:45:31.2568885Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T05:45:31.2569645Z Compiling xla/service/hlo_verifier.cc; 15s local 2025-03-14T05:45:31.2570458Z Compiling xla/service/sharding_propagation.cc; 10s local 2025-03-14T05:45:31.2571191Z Compiling xla/service/cpu/in_process_collectives.cc; 10s local 2025-03-14T05:45:31.2572031Z @xla//xla/hlo/transforms:convolution_group_converter; 10s local 2025-03-14T05:45:31.2572805Z Compiling xla/service/triangular_solve_expander.cc; 10s local 2025-03-14T05:45:31.2573562Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T05:45:31.2574322Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 9s local ... 2025-03-14T05:45:31.5141675Z 2025-03-14T05:45:31.5142533Z  2025-03-14T05:45:31.5143006Z  2025-03-14T05:45:31.5143409Z  2025-03-14T05:45:31.5143801Z  2025-03-14T05:45:31.5144199Z  2025-03-14T05:45:31.5144591Z  2025-03-14T05:45:31.5144988Z  2025-03-14T05:45:31.5145377Z  2025-03-14T05:45:31.5145973Z [12,334 / 15,235] 48 actions, 47 running 2025-03-14T05:45:31.5147074Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T05:45:31.5147833Z Compiling xla/service/hlo_verifier.cc; 15s local 2025-03-14T05:45:31.5148610Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T05:45:31.5149456Z Compiling xla/service/cpu/in_process_collectives.cc; 10s local 2025-03-14T05:45:31.5150428Z @xla//xla/hlo/transforms:convolution_group_converter; 10s local 2025-03-14T05:45:31.5151403Z Compiling xla/service/triangular_solve_expander.cc; 10s local 2025-03-14T05:45:31.5152251Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T05:45:31.5153148Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local ... 2025-03-14T05:45:31.7293273Z 2025-03-14T05:45:31.7294111Z  2025-03-14T05:45:31.7294629Z  2025-03-14T05:45:31.7295056Z  2025-03-14T05:45:31.7295474Z  2025-03-14T05:45:31.7295885Z  2025-03-14T05:45:31.7296252Z  2025-03-14T05:45:31.7296648Z  2025-03-14T05:45:31.7297058Z  2025-03-14T05:45:31.7297682Z [12,336 / 15,235] 47 actions running 2025-03-14T05:45:31.7298462Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T05:45:31.7299263Z Compiling xla/service/hlo_verifier.cc; 15s local 2025-03-14T05:45:31.7300156Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T05:45:31.7301049Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2025-03-14T05:45:31.7302051Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local 2025-03-14T05:45:31.7303034Z Compiling xla/service/triangular_solve_expander.cc; 11s local 2025-03-14T05:45:31.7303872Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T05:45:31.7304826Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local ... 2025-03-14T05:45:31.9615883Z 2025-03-14T05:45:31.9616712Z  2025-03-14T05:45:31.9617336Z  2025-03-14T05:45:31.9617878Z  2025-03-14T05:45:31.9618283Z  2025-03-14T05:45:31.9618670Z  2025-03-14T05:45:31.9619102Z  2025-03-14T05:45:31.9619474Z  2025-03-14T05:45:31.9620202Z  2025-03-14T05:45:31.9620797Z [12,340 / 15,235] 48 actions, 47 running 2025-03-14T05:45:31.9621650Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2025-03-14T05:45:31.9622415Z Compiling xla/service/hlo_verifier.cc; 16s local 2025-03-14T05:45:31.9623207Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T05:45:31.9624116Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2025-03-14T05:45:31.9625083Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local 2025-03-14T05:45:31.9626062Z Compiling xla/service/triangular_solve_expander.cc; 11s local 2025-03-14T05:45:31.9626906Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T05:45:31.9627847Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local ... 2025-03-14T05:45:32.1625447Z 2025-03-14T05:45:32.1626310Z  2025-03-14T05:45:32.1626805Z  2025-03-14T05:45:32.1627232Z  2025-03-14T05:45:32.1627678Z  2025-03-14T05:45:32.1628099Z  2025-03-14T05:45:32.1628507Z  2025-03-14T05:45:32.1628899Z  2025-03-14T05:45:32.1629315Z  2025-03-14T05:45:32.1629911Z [12,343 / 15,235] 48 actions, 47 running 2025-03-14T05:45:32.1630706Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2025-03-14T05:45:32.1631535Z Compiling xla/service/hlo_verifier.cc; 16s local 2025-03-14T05:45:32.1632450Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T05:45:32.1633383Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2025-03-14T05:45:32.1634398Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local 2025-03-14T05:45:32.1635376Z Compiling xla/service/triangular_solve_expander.cc; 11s local 2025-03-14T05:45:32.1636225Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T05:45:32.1637191Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local ... 2025-03-14T05:45:32.3971509Z 2025-03-14T05:45:32.3972454Z  2025-03-14T05:45:32.3972900Z  2025-03-14T05:45:32.3973274Z  2025-03-14T05:45:32.3973606Z  2025-03-14T05:45:32.3973955Z  2025-03-14T05:45:32.3974286Z  2025-03-14T05:45:32.3974618Z  2025-03-14T05:45:32.3974991Z  2025-03-14T05:45:32.3975609Z [12,347 / 15,235] 48 actions, 47 running 2025-03-14T05:45:32.3976359Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2025-03-14T05:45:32.3977129Z Compiling xla/service/hlo_verifier.cc; 16s local 2025-03-14T05:45:32.3977945Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T05:45:32.3978903Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2025-03-14T05:45:32.3979875Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local 2025-03-14T05:45:32.3980739Z Compiling xla/service/triangular_solve_expander.cc; 11s local 2025-03-14T05:45:32.3981587Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T05:45:32.3982506Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local ... 2025-03-14T05:45:32.6705525Z 2025-03-14T05:45:32.6706421Z  2025-03-14T05:45:32.6706918Z  2025-03-14T05:45:32.6707318Z  2025-03-14T05:45:32.6707708Z  2025-03-14T05:45:32.6708108Z  2025-03-14T05:45:32.6708526Z  2025-03-14T05:45:32.6708936Z  2025-03-14T05:45:32.6709356Z  2025-03-14T05:45:32.6709975Z [12,349 / 15,235] 48 actions, 47 running 2025-03-14T05:45:32.6710714Z Compiling xla/service/hlo_verifier.cc; 16s local 2025-03-14T05:45:32.6711557Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T05:45:32.6712456Z Compiling xla/service/cpu/in_process_collectives.cc; 12s local 2025-03-14T05:45:32.6713444Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T05:45:32.6714462Z Compiling xla/service/triangular_solve_expander.cc; 11s local 2025-03-14T05:45:32.6715346Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T05:45:32.6716772Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T05:45:32.6717838Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local ... 2025-03-14T05:45:32.9304069Z 2025-03-14T05:45:32.9304924Z  2025-03-14T05:45:32.9305429Z  2025-03-14T05:45:32.9305866Z  2025-03-14T05:45:32.9306260Z  2025-03-14T05:45:32.9306684Z  2025-03-14T05:45:32.9307053Z  2025-03-14T05:45:32.9307424Z  2025-03-14T05:45:32.9307843Z  2025-03-14T05:45:32.9308438Z [12,350 / 15,235] 48 actions running 2025-03-14T05:45:32.9309236Z Compiling xla/service/hlo_verifier.cc; 16s local 2025-03-14T05:45:32.9310083Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T05:45:32.9311030Z Compiling xla/service/cpu/in_process_collectives.cc; 12s local 2025-03-14T05:45:32.9312058Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T05:45:32.9313113Z Compiling xla/service/triangular_solve_expander.cc; 12s local 2025-03-14T05:45:32.9314026Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T05:45:32.9314939Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T05:45:32.9315975Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local ... 2025-03-14T05:45:33.1609075Z 2025-03-14T05:45:33.1609898Z  2025-03-14T05:45:33.1610382Z  2025-03-14T05:45:33.1610772Z  2025-03-14T05:45:33.1611169Z  2025-03-14T05:45:33.1611574Z  2025-03-14T05:45:33.1611971Z  2025-03-14T05:45:33.1612358Z  2025-03-14T05:45:33.1612736Z  2025-03-14T05:45:33.1613321Z [12,352 / 15,235] 48 actions, 47 running 2025-03-14T05:45:33.1614015Z Compiling xla/service/hlo_verifier.cc; 17s local 2025-03-14T05:45:33.1614867Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T05:45:33.1616126Z Compiling xla/service/cpu/in_process_collectives.cc; 12s local 2025-03-14T05:45:33.1617077Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T05:45:33.1618080Z Compiling xla/service/triangular_solve_expander.cc; 12s local 2025-03-14T05:45:33.1618877Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T05:45:33.1619770Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T05:45:33.1620808Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local ... 2025-03-14T05:45:33.5307807Z 2025-03-14T05:45:33.5308652Z  2025-03-14T05:45:33.5309130Z  2025-03-14T05:45:33.5309537Z  2025-03-14T05:45:33.5309938Z  2025-03-14T05:45:33.5310328Z  2025-03-14T05:45:33.5310742Z  2025-03-14T05:45:33.5311142Z  2025-03-14T05:45:33.5311533Z  2025-03-14T05:45:33.5312161Z [12,353 / 15,235] 48 actions running 2025-03-14T05:45:33.5313071Z Compiling xla/service/hlo_verifier.cc; 17s local 2025-03-14T05:45:33.5314097Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T05:45:33.5315099Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2025-03-14T05:45:33.5316060Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T05:45:33.5317122Z Compiling xla/service/triangular_solve_expander.cc; 12s local 2025-03-14T05:45:33.5317931Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T05:45:33.5318742Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 12s local 2025-03-14T05:45:33.5319798Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local ... 2025-03-14T05:45:33.7312522Z 2025-03-14T05:45:33.7313362Z  2025-03-14T05:45:33.7313869Z  2025-03-14T05:45:33.7314300Z  2025-03-14T05:45:33.7314737Z  2025-03-14T05:45:33.7315157Z  2025-03-14T05:45:33.7315591Z  2025-03-14T05:45:33.7316032Z  2025-03-14T05:45:33.7316450Z  2025-03-14T05:45:33.7317010Z [12,356 / 15,235] 48 actions running 2025-03-14T05:45:33.7317808Z Compiling xla/service/hlo_verifier.cc; 17s local 2025-03-14T05:45:33.7318891Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T05:45:33.7319674Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2025-03-14T05:45:33.7320636Z @xla//xla/hlo/transforms:convolution_group_converter; 13s local 2025-03-14T05:45:33.7321604Z Compiling xla/service/triangular_solve_expander.cc; 13s local 2025-03-14T05:45:33.7322432Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T05:45:33.7323318Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 12s local 2025-03-14T05:45:33.7324338Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local ... 2025-03-14T05:45:34.0705269Z 2025-03-14T05:45:34.0706054Z  2025-03-14T05:45:34.0706542Z  2025-03-14T05:45:34.0706937Z  2025-03-14T05:45:34.0707336Z  2025-03-14T05:45:34.0707725Z  2025-03-14T05:45:34.0708118Z  2025-03-14T05:45:34.0708477Z  2025-03-14T05:45:34.0708893Z  2025-03-14T05:45:34.0709496Z [12,363 / 15,235] 48 actions, 47 running 2025-03-14T05:45:34.0710242Z Compiling xla/service/hlo_verifier.cc; 18s local 2025-03-14T05:45:34.0711045Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T05:45:34.0711938Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2025-03-14T05:45:34.0712799Z Compiling xla/service/triangular_solve_expander.cc; 13s local 2025-03-14T05:45:34.0713541Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T05:45:34.0714253Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T05:45:34.0715128Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 9s local 2025-03-14T05:45:34.0716160Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local ... 2025-03-14T05:45:34.3319931Z 2025-03-14T05:45:34.3320745Z  2025-03-14T05:45:34.3321256Z  2025-03-14T05:45:34.3321689Z  2025-03-14T05:45:34.3322119Z  2025-03-14T05:45:34.3322953Z  2025-03-14T05:45:34.3323401Z  2025-03-14T05:45:34.3323839Z  2025-03-14T05:45:34.3324230Z  2025-03-14T05:45:34.3324958Z [12,365 / 15,235] 48 actions running 2025-03-14T05:45:34.3325728Z Compiling xla/service/hlo_verifier.cc; 18s local 2025-03-14T05:45:34.3326578Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T05:45:34.3327552Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2025-03-14T05:45:34.3328478Z Compiling xla/service/triangular_solve_expander.cc; 13s local 2025-03-14T05:45:34.3329318Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T05:45:34.3330038Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T05:45:34.3330973Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local 2025-03-14T05:45:34.3331973Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local ... 2025-03-14T05:45:34.5323095Z 2025-03-14T05:45:34.5323908Z  2025-03-14T05:45:34.5324401Z  2025-03-14T05:45:34.5324965Z  2025-03-14T05:45:34.5325377Z  2025-03-14T05:45:34.5325760Z  2025-03-14T05:45:34.5326169Z  2025-03-14T05:45:34.5326558Z  2025-03-14T05:45:34.5326941Z  2025-03-14T05:45:34.5327527Z [12,367 / 15,235] 48 actions running 2025-03-14T05:45:34.5328255Z Compiling xla/service/hlo_verifier.cc; 18s local 2025-03-14T05:45:34.5329063Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T05:45:34.5329953Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2025-03-14T05:45:34.5330868Z Compiling xla/service/triangular_solve_expander.cc; 13s local 2025-03-14T05:45:34.5331632Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T05:45:34.5332399Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T05:45:34.5333330Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local 2025-03-14T05:45:34.5334320Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local ... 2025-03-14T05:45:34.9012098Z 2025-03-14T05:45:34.9012968Z  2025-03-14T05:45:34.9013894Z  2025-03-14T05:45:34.9014277Z  2025-03-14T05:45:34.9014668Z  2025-03-14T05:45:34.9015043Z  2025-03-14T05:45:34.9015421Z  2025-03-14T05:45:34.9015806Z  2025-03-14T05:45:34.9016199Z  2025-03-14T05:45:34.9016786Z [12,371 / 15,235] 48 actions, 47 running 2025-03-14T05:45:34.9017496Z Compiling xla/service/hlo_verifier.cc; 18s local 2025-03-14T05:45:34.9018292Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T05:45:34.9019177Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2025-03-14T05:45:34.9020110Z Compiling xla/service/triangular_solve_expander.cc; 14s local 2025-03-14T05:45:34.9020929Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T05:45:34.9021683Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T05:45:34.9022632Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local 2025-03-14T05:45:34.9023607Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local ... 2025-03-14T05:45:35.1322640Z 2025-03-14T05:45:35.1323511Z  2025-03-14T05:45:35.1324015Z  2025-03-14T05:45:35.1324413Z  2025-03-14T05:45:35.1324975Z  2025-03-14T05:45:35.1325388Z  2025-03-14T05:45:35.1325813Z  2025-03-14T05:45:35.1326236Z  2025-03-14T05:45:35.1326633Z  2025-03-14T05:45:35.1327247Z [12,374 / 15,235] 48 actions, 47 running 2025-03-14T05:45:35.1328033Z Compiling xla/service/hlo_verifier.cc; 19s local 2025-03-14T05:45:35.1328807Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T05:45:35.1329720Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2025-03-14T05:45:35.1330705Z Compiling xla/service/triangular_solve_expander.cc; 14s local 2025-03-14T05:45:35.1331451Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T05:45:35.1332619Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T05:45:35.1333613Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 10s local 2025-03-14T05:45:35.1334711Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local ... 2025-03-14T05:45:35.5331212Z 2025-03-14T05:45:35.5332110Z  2025-03-14T05:45:35.5333963Z  2025-03-14T05:45:35.5334485Z  2025-03-14T05:45:35.5334894Z  2025-03-14T05:45:35.5335310Z  2025-03-14T05:45:35.5335741Z  2025-03-14T05:45:35.5336185Z  2025-03-14T05:45:35.5336639Z  2025-03-14T05:45:35.5337281Z [12,376 / 15,235] 48 actions running 2025-03-14T05:45:35.5338092Z Compiling xla/service/hlo_verifier.cc; 19s local 2025-03-14T05:45:35.5339004Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T05:45:35.5340040Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2025-03-14T05:45:35.5340933Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T05:45:35.5341816Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T05:45:35.5342915Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local 2025-03-14T05:45:35.5344052Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 10s local 2025-03-14T05:45:35.5345027Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local ... 2025-03-14T05:45:35.7835925Z 2025-03-14T05:45:35.7836775Z  2025-03-14T05:45:35.7837271Z  2025-03-14T05:45:35.7837677Z  2025-03-14T05:45:35.7838068Z  2025-03-14T05:45:35.7838462Z  2025-03-14T05:45:35.7838838Z  2025-03-14T05:45:35.7839229Z  2025-03-14T05:45:35.7839627Z  2025-03-14T05:45:35.7840231Z [12,379 / 15,235] 48 actions, 47 running 2025-03-14T05:45:35.7840984Z Compiling xla/service/hlo_verifier.cc; 19s local 2025-03-14T05:45:35.7841801Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T05:45:35.7842704Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2025-03-14T05:45:35.7843579Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T05:45:35.7844849Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T05:45:35.7845831Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local 2025-03-14T05:45:35.7846764Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2025-03-14T05:45:35.7847527Z Compiling llvm/lib/IR/Metadata.cpp; 7s local ... 2025-03-14T05:45:35.9976085Z 2025-03-14T05:45:35.9977075Z  2025-03-14T05:45:35.9978975Z  2025-03-14T05:45:35.9979469Z  2025-03-14T05:45:35.9979913Z  2025-03-14T05:45:35.9980347Z  2025-03-14T05:45:35.9980757Z  2025-03-14T05:45:35.9981193Z  2025-03-14T05:45:35.9981621Z  2025-03-14T05:45:35.9982259Z [12,383 / 15,235] 48 actions, 47 running 2025-03-14T05:45:35.9983072Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T05:45:35.9983977Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T05:45:35.9985060Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2025-03-14T05:45:35.9986026Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T05:45:35.9986886Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T05:45:35.9987964Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 11s local 2025-03-14T05:45:35.9989021Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2025-03-14T05:45:35.9989845Z Compiling llvm/lib/IR/Metadata.cpp; 7s local ... 2025-03-14T05:45:36.3338507Z 2025-03-14T05:45:36.3339336Z  2025-03-14T05:45:36.3339873Z  2025-03-14T05:45:36.3340288Z  2025-03-14T05:45:36.3340716Z  2025-03-14T05:45:36.3341185Z  2025-03-14T05:45:36.3341621Z  2025-03-14T05:45:36.3342037Z  2025-03-14T05:45:36.3342445Z  2025-03-14T05:45:36.3343079Z [12,383 / 15,235] 48 actions running 2025-03-14T05:45:36.3343870Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T05:45:36.3345144Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T05:45:36.3346189Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2025-03-14T05:45:36.3347102Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T05:45:36.3347893Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 13s local 2025-03-14T05:45:36.3348956Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2025-03-14T05:45:36.3349959Z Compiling xla/service/cpu/cpu_runtime.cc; 9s local 2025-03-14T05:45:36.3350797Z Compiling llvm/lib/IR/Metadata.cpp; 7s local ... 2025-03-14T05:45:36.5342984Z 2025-03-14T05:45:36.5343868Z  2025-03-14T05:45:36.5344386Z  2025-03-14T05:45:36.5344785Z  2025-03-14T05:45:36.5345252Z  2025-03-14T05:45:36.5345680Z  2025-03-14T05:45:36.5346076Z  2025-03-14T05:45:36.5346498Z  2025-03-14T05:45:36.5346887Z  2025-03-14T05:45:36.5347531Z [12,386 / 15,235] 48 actions running 2025-03-14T05:45:36.5348335Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T05:45:36.5349122Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T05:45:36.5350131Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2025-03-14T05:45:36.5350990Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T05:45:36.5351823Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2025-03-14T05:45:36.5352916Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2025-03-14T05:45:36.5353683Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T05:45:36.5354453Z Compiling xla/service/cpu/cpu_xfeed.cc; 7s local ... 2025-03-14T05:45:36.7384049Z 2025-03-14T05:45:36.7384860Z  2025-03-14T05:45:36.7385365Z  2025-03-14T05:45:36.7385796Z  2025-03-14T05:45:36.7386224Z  2025-03-14T05:45:36.7386655Z  2025-03-14T05:45:36.7387078Z  2025-03-14T05:45:36.7387494Z  2025-03-14T05:45:36.7387898Z  2025-03-14T05:45:36.7388581Z [12,388 / 15,235] 48 actions, 47 running 2025-03-14T05:45:36.7389872Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T05:45:36.7390667Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T05:45:36.7391542Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2025-03-14T05:45:36.7392368Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T05:45:36.7393240Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2025-03-14T05:45:36.7394187Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2025-03-14T05:45:36.7394941Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T05:45:36.7395693Z Compiling xla/service/cpu/cpu_xfeed.cc; 7s local ... 2025-03-14T05:45:36.9891291Z 2025-03-14T05:45:36.9892189Z  2025-03-14T05:45:36.9892681Z  2025-03-14T05:45:36.9893095Z  2025-03-14T05:45:36.9893517Z  2025-03-14T05:45:36.9893922Z  2025-03-14T05:45:36.9894373Z  2025-03-14T05:45:36.9894786Z  2025-03-14T05:45:36.9895218Z  2025-03-14T05:45:36.9895814Z [12,391 / 15,235] 48 actions, 47 running 2025-03-14T05:45:36.9896647Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T05:45:36.9897528Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2025-03-14T05:45:36.9898383Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T05:45:36.9899306Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 12s local 2025-03-14T05:45:36.9900282Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2025-03-14T05:45:36.9901152Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T05:45:36.9901856Z Compiling xla/service/cpu/cpu_xfeed.cc; 7s local 2025-03-14T05:45:36.9902785Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 6s local ... 2025-03-14T05:45:37.3348969Z 2025-03-14T05:45:37.3349852Z  2025-03-14T05:45:37.3350336Z  2025-03-14T05:45:37.3351175Z  2025-03-14T05:45:37.3351651Z  2025-03-14T05:45:37.3352092Z  2025-03-14T05:45:37.3352504Z  2025-03-14T05:45:37.3352898Z  2025-03-14T05:45:37.3353328Z  2025-03-14T05:45:37.3353915Z [12,392 / 15,235] 48 actions running 2025-03-14T05:45:37.3354719Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T05:45:37.3355692Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2025-03-14T05:45:37.3356502Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T05:45:37.3357408Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2025-03-14T05:45:37.3358414Z Compiling xla/service/cpu/cpu_runtime.cc; 10s local 2025-03-14T05:45:37.3359180Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T05:45:37.3359895Z Compiling xla/service/cpu/cpu_xfeed.cc; 7s local 2025-03-14T05:45:37.3360896Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 7s local ... 2025-03-14T05:45:37.5353125Z 2025-03-14T05:45:37.5353955Z  2025-03-14T05:45:37.5354405Z  2025-03-14T05:45:37.5354781Z  2025-03-14T05:45:37.5355123Z  2025-03-14T05:45:37.5355497Z  2025-03-14T05:45:37.5355879Z  2025-03-14T05:45:37.5356263Z  2025-03-14T05:45:37.5356634Z  2025-03-14T05:45:37.5357153Z [12,393 / 15,235] 48 actions running 2025-03-14T05:45:37.5357863Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T05:45:37.5359119Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T05:45:37.5359957Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T05:45:37.5360841Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2025-03-14T05:45:37.5361787Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2025-03-14T05:45:37.5362542Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T05:45:37.5363278Z Compiling xla/service/cpu/cpu_xfeed.cc; 8s local 2025-03-14T05:45:37.5364210Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 7s local ... 2025-03-14T05:45:37.8478287Z 2025-03-14T05:45:37.8479111Z  2025-03-14T05:45:37.8479547Z  2025-03-14T05:45:37.8479907Z  2025-03-14T05:45:37.8480420Z  2025-03-14T05:45:37.8480789Z  2025-03-14T05:45:37.8481161Z  2025-03-14T05:45:37.8481546Z  2025-03-14T05:45:37.8481908Z  2025-03-14T05:45:37.8482465Z [12,395 / 15,235] 48 actions, 47 running 2025-03-14T05:45:37.8483209Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T05:45:37.8484074Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T05:45:37.8485060Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T05:45:37.8485904Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2025-03-14T05:45:37.8486734Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2025-03-14T05:45:37.8487373Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T05:45:37.8488072Z Compiling xla/service/cpu/cpu_xfeed.cc; 8s local 2025-03-14T05:45:37.8488925Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 7s local ... 2025-03-14T05:45:38.0743114Z 2025-03-14T05:45:38.0744040Z  2025-03-14T05:45:38.0746144Z  2025-03-14T05:45:38.0746661Z  2025-03-14T05:45:38.0747119Z  2025-03-14T05:45:38.0747559Z  2025-03-14T05:45:38.0748003Z  2025-03-14T05:45:38.0748433Z  2025-03-14T05:45:38.0748897Z  2025-03-14T05:45:38.0749613Z [12,398 / 15,235] 48 actions, 47 running 2025-03-14T05:45:38.0750555Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T05:45:38.0751657Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T05:45:38.0752639Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T05:45:38.0753730Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 13s local 2025-03-14T05:45:38.0755221Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2025-03-14T05:45:38.0756123Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T05:45:38.0757007Z Compiling xla/service/cpu/cpu_xfeed.cc; 8s local 2025-03-14T05:45:38.0758130Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 8s local ... 2025-03-14T05:45:38.3225657Z 2025-03-14T05:45:38.3226501Z  2025-03-14T05:45:38.3226968Z  2025-03-14T05:45:38.3227379Z  2025-03-14T05:45:38.3227798Z  2025-03-14T05:45:38.3228204Z  2025-03-14T05:45:38.3228585Z  2025-03-14T05:45:38.3228989Z  2025-03-14T05:45:38.3229512Z  2025-03-14T05:45:38.3230116Z [12,403 / 15,235] 47 actions, 46 running 2025-03-14T05:45:38.3230949Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T05:45:38.3231736Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T05:45:38.3232660Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2025-03-14T05:45:38.3233640Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local 2025-03-14T05:45:38.3234392Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T05:45:38.3235125Z Compiling xla/service/cpu/cpu_xfeed.cc; 8s local 2025-03-14T05:45:38.3236081Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 8s local 2025-03-14T05:45:38.3237185Z Compiling xla/hlo/transforms/operand_upcaster.cc; 7s local ... 2025-03-14T05:45:38.5256850Z 2025-03-14T05:45:38.5257734Z  2025-03-14T05:45:38.5258324Z  2025-03-14T05:45:38.5258719Z  2025-03-14T05:45:38.5259106Z  2025-03-14T05:45:38.5259495Z  2025-03-14T05:45:38.5259990Z  2025-03-14T05:45:38.5260348Z  2025-03-14T05:45:38.5260728Z  2025-03-14T05:45:38.5261335Z [12,406 / 15,235] 48 actions, 47 running 2025-03-14T05:45:38.5262185Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T05:45:38.5262978Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T05:45:38.5263989Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2025-03-14T05:45:38.5265538Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T05:45:38.5266370Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T05:45:38.5267069Z Compiling xla/service/cpu/cpu_xfeed.cc; 9s local 2025-03-14T05:45:38.5268027Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 8s local 2025-03-14T05:45:38.5269020Z Compiling xla/hlo/transforms/operand_upcaster.cc; 7s local ... 2025-03-14T05:45:38.7365833Z 2025-03-14T05:45:38.7366632Z  2025-03-14T05:45:38.7367117Z  2025-03-14T05:45:38.7367522Z  2025-03-14T05:45:38.7367948Z  2025-03-14T05:45:38.7368359Z  2025-03-14T05:45:38.7368774Z  2025-03-14T05:45:38.7369183Z  2025-03-14T05:45:38.7369603Z  2025-03-14T05:45:38.7370179Z [12,406 / 15,235] 48 actions running 2025-03-14T05:45:38.7371030Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T05:45:38.7371903Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T05:45:38.7372775Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2025-03-14T05:45:38.7373786Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T05:45:38.7374589Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T05:45:38.7375354Z Compiling xla/service/cpu/cpu_xfeed.cc; 9s local 2025-03-14T05:45:38.7376337Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 8s local 2025-03-14T05:45:38.7377453Z Compiling xla/hlo/transforms/operand_upcaster.cc; 7s local ... 2025-03-14T05:45:38.9819436Z 2025-03-14T05:45:38.9820947Z  2025-03-14T05:45:38.9821446Z  2025-03-14T05:45:38.9823026Z  2025-03-14T05:45:38.9824007Z  2025-03-14T05:45:38.9825151Z  2025-03-14T05:45:38.9826398Z  2025-03-14T05:45:38.9827987Z  2025-03-14T05:45:38.9829244Z  2025-03-14T05:45:38.9830925Z [12,408 / 15,235] 48 actions, 47 running 2025-03-14T05:45:38.9831800Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T05:45:38.9832696Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T05:45:38.9833686Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 14s local 2025-03-14T05:45:38.9834690Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T05:45:38.9835464Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T05:45:38.9836148Z Compiling xla/service/cpu/cpu_xfeed.cc; 9s local 2025-03-14T05:45:38.9837106Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 8s local 2025-03-14T05:45:38.9838116Z Compiling xla/hlo/transforms/operand_upcaster.cc; 8s local ... 2025-03-14T05:45:39.1833905Z 2025-03-14T05:45:39.1835318Z  2025-03-14T05:45:39.1835854Z  2025-03-14T05:45:39.1837377Z  2025-03-14T05:45:39.1838424Z  2025-03-14T05:45:39.1839648Z  2025-03-14T05:45:39.1840927Z  2025-03-14T05:45:39.1842091Z  2025-03-14T05:45:39.1843368Z  2025-03-14T05:45:39.1844895Z [12,411 / 15,235] 48 actions, 47 running 2025-03-14T05:45:39.1845850Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T05:45:39.1847082Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T05:45:39.1848411Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 15s local 2025-03-14T05:45:39.1849342Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T05:45:39.1850515Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T05:45:39.1851774Z Compiling xla/service/cpu/cpu_xfeed.cc; 9s local 2025-03-14T05:45:39.1853160Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 9s local 2025-03-14T05:45:39.1854290Z Compiling xla/hlo/transforms/operand_upcaster.cc; 8s local ... 2025-03-14T05:45:39.4066406Z 2025-03-14T05:45:39.4067783Z  2025-03-14T05:45:39.4068298Z  2025-03-14T05:45:39.4069676Z  2025-03-14T05:45:39.4070654Z  2025-03-14T05:45:39.4071719Z  2025-03-14T05:45:39.4072950Z  2025-03-14T05:45:39.4074138Z  2025-03-14T05:45:39.4075430Z  2025-03-14T05:45:39.4076779Z [12,417 / 15,235] 48 actions, 47 running 2025-03-14T05:45:39.4078192Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T05:45:39.4078977Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T05:45:39.4080440Z @llvm-project//llvm:X86CommonTableGen__gen_instr_info_genrule; 15s local 2025-03-14T05:45:39.4081305Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T05:45:39.4082550Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T05:45:39.4083574Z Compiling xla/service/cpu/cpu_xfeed.cc; 9s local 2025-03-14T05:45:39.4085180Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 9s local 2025-03-14T05:45:39.4086217Z Compiling xla/hlo/transforms/operand_upcaster.cc; 8s local ... 2025-03-14T05:45:39.6739609Z 2025-03-14T05:45:39.6740500Z  2025-03-14T05:45:39.6741106Z  2025-03-14T05:45:39.6741487Z  2025-03-14T05:45:39.6741896Z  2025-03-14T05:45:39.6751863Z  2025-03-14T05:45:39.6752701Z  2025-03-14T05:45:39.6753114Z  2025-03-14T05:45:39.6753519Z  2025-03-14T05:45:39.6754117Z [12,420 / 15,235] 48 actions, 47 running 2025-03-14T05:45:39.6754930Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T05:45:39.6755723Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T05:45:39.6756483Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2025-03-14T05:45:39.6757213Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T05:45:39.6757938Z Compiling xla/service/cpu/cpu_xfeed.cc; 10s local 2025-03-14T05:45:39.6758813Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 9s local 2025-03-14T05:45:39.6759837Z Compiling xla/hlo/transforms/operand_upcaster.cc; 8s local 2025-03-14T05:45:39.6761084Z Compiling xla/service/hlo_domain_verifier.cc; 7s local ... 2025-03-14T05:45:39.9133503Z 2025-03-14T05:45:39.9134324Z  2025-03-14T05:45:39.9134912Z  2025-03-14T05:45:39.9135342Z  2025-03-14T05:45:39.9135716Z  2025-03-14T05:45:39.9136089Z  2025-03-14T05:45:39.9136451Z  2025-03-14T05:45:39.9136835Z  2025-03-14T05:45:39.9137212Z  2025-03-14T05:45:39.9137833Z [12,422 / 15,235] 48 actions, 47 running 2025-03-14T05:45:39.9138618Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T05:45:39.9139365Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T05:45:39.9140066Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2025-03-14T05:45:39.9140762Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T05:45:39.9141482Z Compiling xla/service/cpu/cpu_xfeed.cc; 10s local 2025-03-14T05:45:39.9142423Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 9s local 2025-03-14T05:45:39.9143389Z Compiling xla/hlo/transforms/operand_upcaster.cc; 9s local 2025-03-14T05:45:39.9144290Z Compiling xla/service/hlo_domain_verifier.cc; 8s local ... 2025-03-14T05:45:40.1373186Z 2025-03-14T05:45:40.1374152Z  2025-03-14T05:45:40.1374664Z  2025-03-14T05:45:40.1375062Z  2025-03-14T05:45:40.1375460Z  2025-03-14T05:45:40.1375849Z  2025-03-14T05:45:40.1376265Z  2025-03-14T05:45:40.1376689Z  2025-03-14T05:45:40.1377088Z  2025-03-14T05:45:40.1377694Z [12,424 / 15,235] 48 actions running 2025-03-14T05:45:40.1378528Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T05:45:40.1379366Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T05:45:40.1380095Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2025-03-14T05:45:40.1380837Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T05:45:40.1381590Z Compiling xla/service/cpu/cpu_xfeed.cc; 10s local 2025-03-14T05:45:40.1382529Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 10s local 2025-03-14T05:45:40.1383593Z Compiling xla/hlo/transforms/operand_upcaster.cc; 9s local 2025-03-14T05:45:40.1384940Z Compiling xla/service/hlo_domain_verifier.cc; 8s local ... 2025-03-14T05:45:40.3713629Z 2025-03-14T05:45:40.3714766Z  2025-03-14T05:45:40.3715467Z  2025-03-14T05:45:40.3716055Z  2025-03-14T05:45:40.3716437Z  2025-03-14T05:45:40.3716892Z  2025-03-14T05:45:40.3717318Z  2025-03-14T05:45:40.3717683Z  2025-03-14T05:45:40.3718080Z  2025-03-14T05:45:40.3718680Z [12,426 / 15,235] 48 actions, 47 running 2025-03-14T05:45:40.3719457Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T05:45:40.3720188Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2025-03-14T05:45:40.3720945Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2025-03-14T05:45:40.3721706Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T05:45:40.3722607Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 10s local 2025-03-14T05:45:40.3723616Z Compiling xla/hlo/transforms/operand_upcaster.cc; 9s local 2025-03-14T05:45:40.3724712Z Compiling xla/service/hlo_domain_verifier.cc; 8s local 2025-03-14T05:45:40.3725711Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 8s local ... 2025-03-14T05:45:40.7379413Z 2025-03-14T05:45:40.7380212Z  2025-03-14T05:45:40.7380711Z  2025-03-14T05:45:40.7381173Z  2025-03-14T05:45:40.7381591Z  2025-03-14T05:45:40.7382014Z  2025-03-14T05:45:40.7382428Z  2025-03-14T05:45:40.7382815Z  2025-03-14T05:45:40.7383230Z  2025-03-14T05:45:40.7383801Z [12,427 / 15,235] 48 actions running 2025-03-14T05:45:40.7384618Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T05:45:40.7385442Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2025-03-14T05:45:40.7386214Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T05:45:40.7386980Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T05:45:40.7388356Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 10s local 2025-03-14T05:45:40.7389455Z Compiling xla/hlo/transforms/operand_upcaster.cc; 9s local 2025-03-14T05:45:40.7390389Z Compiling xla/service/hlo_domain_verifier.cc; 8s local 2025-03-14T05:45:40.7391431Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 8s local ... 2025-03-14T05:45:40.9382951Z 2025-03-14T05:45:40.9384366Z  2025-03-14T05:45:40.9384870Z  2025-03-14T05:45:40.9386310Z  2025-03-14T05:45:40.9387250Z  2025-03-14T05:45:40.9388430Z  2025-03-14T05:45:40.9389640Z  2025-03-14T05:45:40.9390778Z  2025-03-14T05:45:40.9391999Z  2025-03-14T05:45:40.9393388Z [12,429 / 15,235] 48 actions running 2025-03-14T05:45:40.9394303Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T05:45:40.9395498Z Compiling llvm/lib/Object/ELF.cpp; 19s local 2025-03-14T05:45:40.9396728Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T05:45:40.9397869Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T05:45:40.9399262Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 10s local 2025-03-14T05:45:40.9400464Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local 2025-03-14T05:45:40.9401413Z Compiling xla/service/hlo_domain_verifier.cc; 9s local 2025-03-14T05:45:40.9402433Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 8s local ... 2025-03-14T05:45:41.1821088Z 2025-03-14T05:45:41.1822607Z  2025-03-14T05:45:41.1823779Z  2025-03-14T05:45:41.1824615Z  2025-03-14T05:45:41.1825942Z  2025-03-14T05:45:41.1827315Z  2025-03-14T05:45:41.1828515Z  2025-03-14T05:45:41.1829796Z  2025-03-14T05:45:41.1830862Z  2025-03-14T05:45:41.1832331Z [12,432 / 15,235] 48 actions, 47 running 2025-03-14T05:45:41.1833394Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T05:45:41.1834594Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T05:45:41.1835729Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T05:45:41.1836730Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 11s local 2025-03-14T05:45:41.1837871Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local 2025-03-14T05:45:41.1838846Z Compiling xla/service/hlo_domain_verifier.cc; 9s local 2025-03-14T05:45:41.1839811Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 9s local 2025-03-14T05:45:41.1840748Z @llvm-project//mlir:mlir-tblgen; 8s local ... 2025-03-14T05:45:41.4300451Z 2025-03-14T05:45:41.4301333Z  2025-03-14T05:45:41.4301838Z  2025-03-14T05:45:41.4302256Z  2025-03-14T05:45:41.4302667Z  2025-03-14T05:45:41.4303080Z  2025-03-14T05:45:41.4303483Z  2025-03-14T05:45:41.4303887Z  2025-03-14T05:45:41.4304327Z  2025-03-14T05:45:41.4304907Z [12,438 / 15,235] 48 actions, 47 running 2025-03-14T05:45:41.4305765Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T05:45:41.4306645Z Compiling xla/service/cpu/cpu_runtime.cc; 15s local 2025-03-14T05:45:41.4307396Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T05:45:41.4308248Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local 2025-03-14T05:45:41.4309175Z Compiling xla/service/hlo_domain_verifier.cc; 9s local 2025-03-14T05:45:41.4310017Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 9s local 2025-03-14T05:45:41.4310815Z @llvm-project//mlir:mlir-tblgen; 9s local 2025-03-14T05:45:41.4311702Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local ... 2025-03-14T05:45:41.6366167Z 2025-03-14T05:45:41.6366989Z  2025-03-14T05:45:41.6367500Z  2025-03-14T05:45:41.6367924Z  2025-03-14T05:45:41.6368342Z  2025-03-14T05:45:41.6368700Z  2025-03-14T05:45:41.6369113Z  2025-03-14T05:45:41.6369500Z  2025-03-14T05:45:41.6369863Z  2025-03-14T05:45:41.6370856Z [12,441 / 15,235] 48 actions, 47 running 2025-03-14T05:45:41.6371755Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T05:45:41.6372592Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T05:45:41.6373450Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local 2025-03-14T05:45:41.6374350Z Compiling xla/service/hlo_domain_verifier.cc; 9s local 2025-03-14T05:45:41.6375265Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 9s local 2025-03-14T05:45:41.6376094Z @llvm-project//mlir:mlir-tblgen; 9s local 2025-03-14T05:45:41.6377084Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T05:45:41.6378057Z Compiling xla/service/layout_assignment.cc; 8s local ... 2025-03-14T05:45:41.9056540Z 2025-03-14T05:45:41.9057440Z  2025-03-14T05:45:41.9058038Z  2025-03-14T05:45:41.9058431Z  2025-03-14T05:45:41.9058823Z  2025-03-14T05:45:41.9059265Z  2025-03-14T05:45:41.9059762Z  2025-03-14T05:45:41.9060144Z  2025-03-14T05:45:41.9060572Z  2025-03-14T05:45:41.9061176Z [12,443 / 15,235] 48 actions, 47 running 2025-03-14T05:45:41.9061986Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T05:45:41.9062919Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T05:45:41.9063756Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T05:45:41.9064714Z Compiling xla/service/hlo_domain_verifier.cc; 10s local 2025-03-14T05:45:41.9065809Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 9s local 2025-03-14T05:45:41.9066610Z @llvm-project//mlir:mlir-tblgen; 9s local 2025-03-14T05:45:41.9067531Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T05:45:41.9068471Z Compiling xla/service/layout_assignment.cc; 9s local ... 2025-03-14T05:45:42.1391522Z 2025-03-14T05:45:42.1392381Z  2025-03-14T05:45:42.1392839Z  2025-03-14T05:45:42.1393293Z  2025-03-14T05:45:42.1393707Z  2025-03-14T05:45:42.1394133Z  2025-03-14T05:45:42.1394907Z  2025-03-14T05:45:42.1395277Z  2025-03-14T05:45:42.1395693Z  2025-03-14T05:45:42.1396297Z [12,446 / 15,235] 48 actions running 2025-03-14T05:45:42.1397063Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T05:45:42.1397884Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T05:45:42.1398746Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T05:45:42.1399743Z Compiling xla/service/hlo_domain_verifier.cc; 10s local 2025-03-14T05:45:42.1400638Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 10s local 2025-03-14T05:45:42.1401472Z @llvm-project//mlir:mlir-tblgen; 9s local 2025-03-14T05:45:42.1402321Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T05:45:42.1403232Z Compiling xla/service/layout_assignment.cc; 9s local ... 2025-03-14T05:45:42.5074339Z 2025-03-14T05:45:42.5075212Z  2025-03-14T05:45:42.5075695Z  2025-03-14T05:45:42.5076132Z  2025-03-14T05:45:42.5076513Z  2025-03-14T05:45:42.5076868Z  2025-03-14T05:45:42.5077260Z  2025-03-14T05:45:42.5077662Z  2025-03-14T05:45:42.5078064Z  2025-03-14T05:45:42.5078645Z [12,447 / 15,235] 48 actions, 47 running 2025-03-14T05:45:42.5079435Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T05:45:42.5080235Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T05:45:42.5081015Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T05:45:42.5081773Z Compiling xla/service/hlo_domain_verifier.cc; 10s local 2025-03-14T05:45:42.5082641Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 10s local 2025-03-14T05:45:42.5083454Z @llvm-project//mlir:mlir-tblgen; 10s local 2025-03-14T05:45:42.5084272Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T05:45:42.5085753Z Compiling xla/service/layout_assignment.cc; 9s local ... 2025-03-14T05:45:42.7182793Z 2025-03-14T05:45:42.7183628Z  2025-03-14T05:45:42.7184125Z  2025-03-14T05:45:42.7184537Z  2025-03-14T05:45:42.7184946Z  2025-03-14T05:45:42.7185471Z  2025-03-14T05:45:42.7185866Z  2025-03-14T05:45:42.7186262Z  2025-03-14T05:45:42.7186654Z  2025-03-14T05:45:42.7187252Z [12,448 / 15,235] 48 actions, 47 running 2025-03-14T05:45:42.7188070Z Compiling xla/service/sharding_propagation.cc; 22s local 2025-03-14T05:45:42.7188849Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T05:45:42.7189630Z Compiling xla/service/hlo_domain_verifier.cc; 10s local 2025-03-14T05:45:42.7190533Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 10s local 2025-03-14T05:45:42.7191381Z @llvm-project//mlir:mlir-tblgen; 10s local 2025-03-14T05:45:42.7192206Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T05:45:42.7193142Z Compiling xla/service/layout_assignment.cc; 10s local 2025-03-14T05:45:42.7194151Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 8s local ... 2025-03-14T05:45:42.9399365Z 2025-03-14T05:45:42.9400211Z  2025-03-14T05:45:42.9400678Z  2025-03-14T05:45:42.9401078Z  2025-03-14T05:45:42.9401471Z  2025-03-14T05:45:42.9401842Z  2025-03-14T05:45:42.9402217Z  2025-03-14T05:45:42.9402602Z  2025-03-14T05:45:42.9402992Z  2025-03-14T05:45:42.9403566Z [12,449 / 15,235] 48 actions running 2025-03-14T05:45:42.9404315Z Compiling xla/service/sharding_propagation.cc; 22s local 2025-03-14T05:45:42.9405212Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T05:45:42.9405972Z Compiling xla/service/hlo_domain_verifier.cc; 11s local 2025-03-14T05:45:42.9406879Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 10s local 2025-03-14T05:45:42.9407874Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T05:45:42.9408811Z Compiling xla/service/layout_assignment.cc; 10s local 2025-03-14T05:45:42.9410276Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local 2025-03-14T05:45:42.9411456Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 9s local ... 2025-03-14T05:45:43.1402368Z 2025-03-14T05:45:43.1403156Z  2025-03-14T05:45:43.1403653Z  2025-03-14T05:45:43.1404057Z  2025-03-14T05:45:43.1404604Z  2025-03-14T05:45:43.1405019Z  2025-03-14T05:45:43.1405446Z  2025-03-14T05:45:43.1405880Z  2025-03-14T05:45:43.1406296Z  2025-03-14T05:45:43.1406891Z [12,451 / 15,235] 48 actions running 2025-03-14T05:45:43.1407730Z Compiling xla/service/sharding_propagation.cc; 22s local 2025-03-14T05:45:43.1408600Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T05:45:43.1409393Z Compiling xla/service/hlo_domain_verifier.cc; 11s local 2025-03-14T05:45:43.1410399Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 11s local 2025-03-14T05:45:43.1411337Z Compiling xla/service/layout_assignment.cc; 10s local 2025-03-14T05:45:43.1412395Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local 2025-03-14T05:45:43.1413603Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 9s local 2025-03-14T05:45:43.1414836Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 7s local ... 2025-03-14T05:45:43.5407324Z 2025-03-14T05:45:43.5408299Z  2025-03-14T05:45:43.5408779Z  2025-03-14T05:45:43.5409294Z  2025-03-14T05:45:43.5409678Z  2025-03-14T05:45:43.5410067Z  2025-03-14T05:45:43.5410482Z  2025-03-14T05:45:43.5410917Z  2025-03-14T05:45:43.5411281Z  2025-03-14T05:45:43.5411831Z [12,454 / 15,235] 48 actions running 2025-03-14T05:45:43.5412507Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T05:45:43.5413289Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2025-03-14T05:45:43.5414444Z Compiling xla/service/hlo_domain_verifier.cc; 11s local 2025-03-14T05:45:43.5415319Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 11s local 2025-03-14T05:45:43.5416211Z Compiling xla/service/layout_assignment.cc; 10s local 2025-03-14T05:45:43.5417106Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local 2025-03-14T05:45:43.5418314Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 9s local 2025-03-14T05:45:43.5419397Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 8s local ... 2025-03-14T05:45:43.7411122Z 2025-03-14T05:45:43.7412065Z  2025-03-14T05:45:43.7412510Z  2025-03-14T05:45:43.7412870Z  2025-03-14T05:45:43.7413251Z  2025-03-14T05:45:43.7413656Z  2025-03-14T05:45:43.7414054Z  2025-03-14T05:45:43.7414417Z  2025-03-14T05:45:43.7414809Z  2025-03-14T05:45:43.7415423Z [12,458 / 15,235] 48 actions running 2025-03-14T05:45:43.7416251Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T05:45:43.7417076Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2025-03-14T05:45:43.7417928Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 11s local 2025-03-14T05:45:43.7418916Z Compiling xla/service/layout_assignment.cc; 11s local 2025-03-14T05:45:43.7419945Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local 2025-03-14T05:45:43.7421109Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 9s local 2025-03-14T05:45:43.7422224Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 8s local 2025-03-14T05:45:43.7423272Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local ... 2025-03-14T05:45:43.9675527Z 2025-03-14T05:45:43.9676463Z  2025-03-14T05:45:43.9676956Z  2025-03-14T05:45:43.9677342Z  2025-03-14T05:45:43.9677732Z  2025-03-14T05:45:43.9678147Z  2025-03-14T05:45:43.9678550Z  2025-03-14T05:45:43.9678952Z  2025-03-14T05:45:43.9679366Z  2025-03-14T05:45:43.9680030Z [12,462 / 15,235] 48 actions, 47 running 2025-03-14T05:45:43.9681281Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T05:45:43.9682067Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2025-03-14T05:45:43.9682932Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 11s local 2025-03-14T05:45:43.9683850Z Compiling xla/service/layout_assignment.cc; 11s local 2025-03-14T05:45:43.9684967Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T05:45:43.9686140Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 10s local 2025-03-14T05:45:43.9687319Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 8s local 2025-03-14T05:45:43.9688309Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local ... 2025-03-14T05:45:44.3339659Z 2025-03-14T05:45:44.3340529Z  2025-03-14T05:45:44.3341099Z  2025-03-14T05:45:44.3341502Z  2025-03-14T05:45:44.3341946Z  2025-03-14T05:45:44.3342385Z  2025-03-14T05:45:44.3342774Z  2025-03-14T05:45:44.3343197Z  2025-03-14T05:45:44.3343593Z  2025-03-14T05:45:44.3344222Z [12,465 / 15,235] 48 actions, 47 running 2025-03-14T05:45:44.3345104Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T05:45:44.3346123Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2025-03-14T05:45:44.3347106Z Compiling xla/service/layout_assignment.cc; 11s local 2025-03-14T05:45:44.3348079Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T05:45:44.3349285Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 10s local 2025-03-14T05:45:44.3350322Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 9s local 2025-03-14T05:45:44.3351304Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2025-03-14T05:45:44.3352369Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local ... 2025-03-14T05:45:44.5417773Z 2025-03-14T05:45:44.5419062Z  2025-03-14T05:45:44.5419641Z  2025-03-14T05:45:44.5420058Z  2025-03-14T05:45:44.5420441Z  2025-03-14T05:45:44.5420887Z  2025-03-14T05:45:44.5421347Z  2025-03-14T05:45:44.5421757Z  2025-03-14T05:45:44.5422140Z  2025-03-14T05:45:44.5422764Z [12,468 / 15,235] 48 actions running 2025-03-14T05:45:44.5423604Z Compiling xla/service/sharding_propagation.cc; 24s local 2025-03-14T05:45:44.5424458Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2025-03-14T05:45:44.5425409Z Compiling xla/service/layout_assignment.cc; 11s local 2025-03-14T05:45:44.5426355Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T05:45:44.5427574Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 10s local 2025-03-14T05:45:44.5428702Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 9s local 2025-03-14T05:45:44.5429742Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2025-03-14T05:45:44.5430687Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local ... 2025-03-14T05:45:44.7421474Z 2025-03-14T05:45:44.7422446Z  2025-03-14T05:45:44.7422925Z  2025-03-14T05:45:44.7423319Z  2025-03-14T05:45:44.7423759Z  2025-03-14T05:45:44.7424150Z  2025-03-14T05:45:44.7424550Z  2025-03-14T05:45:44.7424960Z  2025-03-14T05:45:44.7425370Z  2025-03-14T05:45:44.7425972Z [12,471 / 15,235] 48 actions running 2025-03-14T05:45:44.7426857Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2025-03-14T05:45:44.7427789Z Compiling xla/service/layout_assignment.cc; 12s local 2025-03-14T05:45:44.7428879Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T05:45:44.7430043Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 10s local 2025-03-14T05:45:44.7431157Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 9s local 2025-03-14T05:45:44.7432159Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T05:45:44.7433393Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local 2025-03-14T05:45:44.7434266Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local ... 2025-03-14T05:45:45.0688548Z 2025-03-14T05:45:45.0689486Z  2025-03-14T05:45:45.0689930Z  2025-03-14T05:45:45.0690301Z  2025-03-14T05:45:45.0690707Z  2025-03-14T05:45:45.0691099Z  2025-03-14T05:45:45.0691481Z  2025-03-14T05:45:45.0691865Z  2025-03-14T05:45:45.0692267Z  2025-03-14T05:45:45.0692887Z [12,474 / 15,235] 48 actions, 47 running 2025-03-14T05:45:45.0693764Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T05:45:45.0694636Z Compiling xla/service/layout_assignment.cc; 12s local 2025-03-14T05:45:45.0695597Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T05:45:45.0696700Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 11s local 2025-03-14T05:45:45.0697752Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 9s local 2025-03-14T05:45:45.0698715Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T05:45:45.0699569Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local 2025-03-14T05:45:45.0700428Z Compiling xla/service/instruction_fusion.cc; 8s local ... 2025-03-14T05:45:45.3428447Z 2025-03-14T05:45:45.3429414Z  2025-03-14T05:45:45.3429914Z  2025-03-14T05:45:45.3430321Z  2025-03-14T05:45:45.3430743Z  2025-03-14T05:45:45.3431093Z  2025-03-14T05:45:45.3431484Z  2025-03-14T05:45:45.3431873Z  2025-03-14T05:45:45.3432259Z  2025-03-14T05:45:45.3432779Z [12,476 / 15,235] 48 actions running 2025-03-14T05:45:45.3433632Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T05:45:45.3434471Z Compiling xla/service/layout_assignment.cc; 12s local 2025-03-14T05:45:45.3435789Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T05:45:45.3436924Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 11s local 2025-03-14T05:45:45.3438061Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 10s local 2025-03-14T05:45:45.3439011Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T05:45:45.3439824Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local 2025-03-14T05:45:45.3440651Z Compiling xla/service/instruction_fusion.cc; 8s local ... 2025-03-14T05:45:45.5432034Z 2025-03-14T05:45:45.5432935Z  2025-03-14T05:45:45.5433408Z  2025-03-14T05:45:45.5433802Z  2025-03-14T05:45:45.5434200Z  2025-03-14T05:45:45.5434592Z  2025-03-14T05:45:45.5434973Z  2025-03-14T05:45:45.5435315Z  2025-03-14T05:45:45.5435724Z  2025-03-14T05:45:45.5436289Z [12,477 / 15,235] 48 actions running 2025-03-14T05:45:45.5437208Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T05:45:45.5438131Z Compiling xla/service/layout_assignment.cc; 12s local 2025-03-14T05:45:45.5439111Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T05:45:45.5440264Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 11s local 2025-03-14T05:45:45.5441374Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 10s local 2025-03-14T05:45:45.5442356Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T05:45:45.5443192Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local 2025-03-14T05:45:45.5444017Z Compiling xla/service/instruction_fusion.cc; 8s local ... 2025-03-14T05:45:45.8172572Z 2025-03-14T05:45:45.8173438Z  2025-03-14T05:45:45.8173920Z  2025-03-14T05:45:45.8174361Z  2025-03-14T05:45:45.8174822Z  2025-03-14T05:45:45.8175370Z  2025-03-14T05:45:45.8175782Z  2025-03-14T05:45:45.8176198Z  2025-03-14T05:45:45.8176611Z  2025-03-14T05:45:45.8177282Z [12,483 / 15,235] 48 actions, 47 running 2025-03-14T05:45:45.8178565Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T05:45:45.8179548Z Compiling xla/service/layout_assignment.cc; 13s local 2025-03-14T05:45:45.8180595Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 12s local 2025-03-14T05:45:45.8181737Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 10s local 2025-03-14T05:45:45.8182732Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2025-03-14T05:45:45.8183605Z Compiling llvm/lib/SandboxIR/Context.cpp; 9s local 2025-03-14T05:45:45.8184450Z Compiling xla/service/instruction_fusion.cc; 8s local 2025-03-14T05:45:45.8185492Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 7s local ... 2025-03-14T05:45:46.0424074Z 2025-03-14T05:45:46.0424959Z  2025-03-14T05:45:46.0425430Z  2025-03-14T05:45:46.0425858Z  2025-03-14T05:45:46.0426321Z  2025-03-14T05:45:46.0426809Z  2025-03-14T05:45:46.0427230Z  2025-03-14T05:45:46.0427677Z  2025-03-14T05:45:46.0428115Z  2025-03-14T05:45:46.0428757Z [12,487 / 15,235] 48 actions, 47 running 2025-03-14T05:45:46.0429674Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 14s local 2025-03-14T05:45:46.0430572Z Compiling xla/service/layout_assignment.cc; 13s local 2025-03-14T05:45:46.0431581Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 12s local 2025-03-14T05:45:46.0432789Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 10s local 2025-03-14T05:45:46.0433825Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2025-03-14T05:45:46.0434714Z Compiling xla/service/instruction_fusion.cc; 9s local 2025-03-14T05:45:46.0435614Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 7s local 2025-03-14T05:45:46.0436643Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 6s local ... 2025-03-14T05:45:46.2747204Z 2025-03-14T05:45:46.2748589Z  2025-03-14T05:45:46.2749084Z  2025-03-14T05:45:46.2749504Z  2025-03-14T05:45:46.2749892Z  2025-03-14T05:45:46.2750303Z  2025-03-14T05:45:46.2750759Z  2025-03-14T05:45:46.2751141Z  2025-03-14T05:45:46.2751551Z  2025-03-14T05:45:46.2752149Z [12,488 / 15,235] 48 actions, 47 running 2025-03-14T05:45:46.2753019Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 14s local 2025-03-14T05:45:46.2753952Z Compiling xla/service/layout_assignment.cc; 13s local 2025-03-14T05:45:46.2754917Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 11s local 2025-03-14T05:45:46.2755905Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2025-03-14T05:45:46.2756714Z Compiling xla/service/instruction_fusion.cc; 9s local 2025-03-14T05:45:46.2757570Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 8s local 2025-03-14T05:45:46.2758494Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 6s local 2025-03-14T05:45:46.2759525Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 6s local ... 2025-03-14T05:45:46.5214889Z 2025-03-14T05:45:46.5215813Z  2025-03-14T05:45:46.5216345Z  2025-03-14T05:45:46.5216767Z  2025-03-14T05:45:46.5217172Z  2025-03-14T05:45:46.5217577Z  2025-03-14T05:45:46.5217975Z  2025-03-14T05:45:46.5218383Z  2025-03-14T05:45:46.5218812Z  2025-03-14T05:45:46.5219446Z [12,493 / 15,235] 48 actions, 47 running 2025-03-14T05:45:46.5220276Z Compiling xla/service/layout_assignment.cc; 13s local 2025-03-14T05:45:46.5221286Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 11s local 2025-03-14T05:45:46.5222357Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2025-03-14T05:45:46.5223261Z Compiling xla/service/instruction_fusion.cc; 9s local 2025-03-14T05:45:46.5224110Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 8s local 2025-03-14T05:45:46.5225112Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 6s local 2025-03-14T05:45:46.5226142Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 6s local 2025-03-14T05:45:46.5227534Z Compiling llvm/lib/Transforms/Utils/ValueMapper.cpp; 5s local ... 2025-03-14T05:45:46.7440447Z 2025-03-14T05:45:46.7441401Z  2025-03-14T05:45:46.7441881Z  2025-03-14T05:45:46.7442286Z  2025-03-14T05:45:46.7442666Z  2025-03-14T05:45:46.7443041Z  2025-03-14T05:45:46.7443417Z  2025-03-14T05:45:46.7443823Z  2025-03-14T05:45:46.7444235Z  2025-03-14T05:45:46.7444962Z [12,494 / 15,235] 48 actions running 2025-03-14T05:45:46.7445700Z Compiling xla/service/layout_assignment.cc; 14s local 2025-03-14T05:45:46.7446613Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 11s local 2025-03-14T05:45:46.7447604Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T05:45:46.7448474Z Compiling xla/service/instruction_fusion.cc; 9s local 2025-03-14T05:45:46.7449344Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 8s local 2025-03-14T05:45:46.7450276Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 7s local 2025-03-14T05:45:46.7451301Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 7s local 2025-03-14T05:45:46.7452314Z Compiling llvm/lib/Transforms/Utils/ValueMapper.cpp; 5s local ... 2025-03-14T05:45:47.2570082Z 2025-03-14T05:45:47.2572320Z  2025-03-14T05:45:47.2572881Z  2025-03-14T05:45:47.2573346Z  2025-03-14T05:45:47.2573813Z  2025-03-14T05:45:47.2575506Z  2025-03-14T05:45:47.2576006Z  2025-03-14T05:45:47.2576668Z  2025-03-14T05:45:47.2578480Z  2025-03-14T05:45:47.2579204Z [12,495 / 15,235] 48 actions, 47 running 2025-03-14T05:45:47.2580079Z Compiling xla/service/layout_assignment.cc; 14s local 2025-03-14T05:45:47.2581134Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T05:45:47.2582232Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T05:45:47.2583589Z Compiling xla/service/instruction_fusion.cc; 10s local 2025-03-14T05:45:47.2584551Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2025-03-14T05:45:47.2585566Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 7s local 2025-03-14T05:45:47.2586646Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 7s local 2025-03-14T05:45:47.2587662Z Compiling llvm/lib/Transforms/Utils/ValueMapper.cpp; 5s local ... 2025-03-14T05:45:47.4872702Z 2025-03-14T05:45:47.4873697Z  2025-03-14T05:45:47.4874252Z  2025-03-14T05:45:47.4875947Z  2025-03-14T05:45:47.4876424Z  2025-03-14T05:45:47.4878005Z  2025-03-14T05:45:47.4878504Z  2025-03-14T05:45:47.4880059Z  2025-03-14T05:45:47.4880557Z  2025-03-14T05:45:47.4882375Z [12,499 / 15,235] 48 actions, 47 running 2025-03-14T05:45:47.4883191Z Compiling xla/service/layout_assignment.cc; 14s local 2025-03-14T05:45:47.4884224Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T05:45:47.4885230Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T05:45:47.4886156Z Compiling xla/service/instruction_fusion.cc; 10s local 2025-03-14T05:45:47.4886911Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2025-03-14T05:45:47.4887767Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 7s local 2025-03-14T05:45:47.4888739Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 7s local 2025-03-14T05:45:47.4889726Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 6s local ... 2025-03-14T05:45:47.7028225Z 2025-03-14T05:45:47.7029138Z  2025-03-14T05:45:47.7029675Z  2025-03-14T05:45:47.7030081Z  2025-03-14T05:45:47.7030485Z  2025-03-14T05:45:47.7030887Z  2025-03-14T05:45:47.7031311Z  2025-03-14T05:45:47.7031728Z  2025-03-14T05:45:47.7032167Z  2025-03-14T05:45:47.7032793Z [12,501 / 15,235] 48 actions, 47 running 2025-03-14T05:45:47.7033652Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T05:45:47.7035005Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T05:45:47.7035983Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T05:45:47.7036847Z Compiling xla/service/instruction_fusion.cc; 10s local 2025-03-14T05:45:47.7037709Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2025-03-14T05:45:47.7038760Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2025-03-14T05:45:47.7039786Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 8s local 2025-03-14T05:45:47.7040788Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 6s local ... 2025-03-14T05:45:47.9450029Z 2025-03-14T05:45:47.9450971Z  2025-03-14T05:45:47.9451460Z  2025-03-14T05:45:47.9451870Z  2025-03-14T05:45:47.9452345Z  2025-03-14T05:45:47.9452725Z  2025-03-14T05:45:47.9453097Z  2025-03-14T05:45:47.9453544Z  2025-03-14T05:45:47.9454010Z  2025-03-14T05:45:47.9454599Z [12,506 / 15,235] 48 actions running 2025-03-14T05:45:47.9455365Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T05:45:47.9456300Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T05:45:47.9457319Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T05:45:47.9458175Z Compiling xla/service/instruction_fusion.cc; 10s local 2025-03-14T05:45:47.9459000Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 9s local 2025-03-14T05:45:47.9459919Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2025-03-14T05:45:47.9460915Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 8s local 2025-03-14T05:45:47.9461937Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 6s local ... 2025-03-14T05:45:48.3455525Z 2025-03-14T05:45:48.3456376Z  2025-03-14T05:45:48.3456849Z  2025-03-14T05:45:48.3457265Z  2025-03-14T05:45:48.3457662Z  2025-03-14T05:45:48.3458385Z  2025-03-14T05:45:48.3458825Z  2025-03-14T05:45:48.3459216Z  2025-03-14T05:45:48.3459602Z  2025-03-14T05:45:48.3460136Z [12,507 / 15,235] 48 actions running 2025-03-14T05:45:48.3460862Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T05:45:48.3461729Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T05:45:48.3462650Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T05:45:48.3463494Z Compiling xla/service/instruction_fusion.cc; 11s local 2025-03-14T05:45:48.3464350Z Compiling llvm/lib/SandboxIR/Instruction.cpp; 10s local 2025-03-14T05:45:48.3465259Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2025-03-14T05:45:48.3466467Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 8s local 2025-03-14T05:45:48.3467413Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local ... 2025-03-14T05:45:48.6032556Z 2025-03-14T05:45:48.6033422Z  2025-03-14T05:45:48.6033986Z  2025-03-14T05:45:48.6034355Z  2025-03-14T05:45:48.6034787Z  2025-03-14T05:45:48.6035154Z  2025-03-14T05:45:48.6035529Z  2025-03-14T05:45:48.6035898Z  2025-03-14T05:45:48.6036269Z  2025-03-14T05:45:48.6036858Z [12,511 / 15,235] 48 actions, 47 running 2025-03-14T05:45:48.6037642Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T05:45:48.6038552Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T05:45:48.6039503Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T05:45:48.6040343Z Compiling xla/service/instruction_fusion.cc; 11s local 2025-03-14T05:45:48.6041218Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2025-03-14T05:45:48.6042178Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2025-03-14T05:45:48.6043118Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local 2025-03-14T05:45:48.6043998Z Compiling llvm/lib/ObjectYAML/ObjectYAML.cpp; 7s local ... 2025-03-14T05:45:48.8570335Z 2025-03-14T05:45:48.8571588Z  2025-03-14T05:45:48.8572408Z  2025-03-14T05:45:48.8573409Z  2025-03-14T05:45:48.8573884Z  2025-03-14T05:45:48.8574314Z  2025-03-14T05:45:48.8574743Z  2025-03-14T05:45:48.8575176Z  2025-03-14T05:45:48.8575591Z  2025-03-14T05:45:48.8576252Z [12,514 / 15,235] 48 actions, 47 running 2025-03-14T05:45:48.8577101Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T05:45:48.8578118Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T05:45:48.8579219Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T05:45:48.8580194Z Compiling xla/service/instruction_fusion.cc; 11s local 2025-03-14T05:45:48.8581152Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2025-03-14T05:45:48.8582194Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2025-03-14T05:45:48.8583271Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local 2025-03-14T05:45:48.8584370Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 6s local ... 2025-03-14T05:45:49.1463253Z 2025-03-14T05:45:49.1464151Z  2025-03-14T05:45:49.1464680Z  2025-03-14T05:45:49.1465106Z  2025-03-14T05:45:49.1465788Z  2025-03-14T05:45:49.1466192Z  2025-03-14T05:45:49.1466595Z  2025-03-14T05:45:49.1467006Z  2025-03-14T05:45:49.1467420Z  2025-03-14T05:45:49.1468030Z [12,519 / 15,235] 48 actions running 2025-03-14T05:45:49.1468845Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T05:45:49.1469854Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T05:45:49.1470821Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T05:45:49.1471699Z Compiling xla/service/instruction_fusion.cc; 12s local 2025-03-14T05:45:49.1473054Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2025-03-14T05:45:49.1474110Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2025-03-14T05:45:49.1475092Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 7s local 2025-03-14T05:45:49.1476123Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local ... 2025-03-14T05:45:49.4258919Z 2025-03-14T05:45:49.4260164Z  2025-03-14T05:45:49.4261029Z  2025-03-14T05:45:49.4262034Z  2025-03-14T05:45:49.4262526Z  2025-03-14T05:45:49.4262950Z  2025-03-14T05:45:49.4263386Z  2025-03-14T05:45:49.4263782Z  2025-03-14T05:45:49.4264218Z  2025-03-14T05:45:49.4264845Z [12,522 / 15,235] 48 actions, 47 running 2025-03-14T05:45:49.4265913Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T05:45:49.4267055Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T05:45:49.4268056Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T05:45:49.4268932Z Compiling xla/service/instruction_fusion.cc; 12s local 2025-03-14T05:45:49.4269933Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2025-03-14T05:45:49.4270955Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local 2025-03-14T05:45:49.4271979Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2025-03-14T05:45:49.4273014Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local ... 2025-03-14T05:45:49.6302653Z 2025-03-14T05:45:49.6303528Z  2025-03-14T05:45:49.6304028Z  2025-03-14T05:45:49.6304474Z  2025-03-14T05:45:49.6304895Z  2025-03-14T05:45:49.6305321Z  2025-03-14T05:45:49.6305750Z  2025-03-14T05:45:49.6306179Z  2025-03-14T05:45:49.6306631Z  2025-03-14T05:45:49.6307208Z [12,524 / 15,235] 48 actions, 47 running 2025-03-14T05:45:49.6307960Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T05:45:49.6309015Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T05:45:49.6309978Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T05:45:49.6311291Z Compiling xla/service/instruction_fusion.cc; 12s local 2025-03-14T05:45:49.6312253Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2025-03-14T05:45:49.6313216Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2025-03-14T05:45:49.6314152Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2025-03-14T05:45:49.6315092Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local ... 2025-03-14T05:45:49.9035992Z 2025-03-14T05:45:49.9036839Z  2025-03-14T05:45:49.9037313Z  2025-03-14T05:45:49.9037734Z  2025-03-14T05:45:49.9038110Z  2025-03-14T05:45:49.9038504Z  2025-03-14T05:45:49.9038902Z  2025-03-14T05:45:49.9039315Z  2025-03-14T05:45:49.9039693Z  2025-03-14T05:45:49.9040284Z [12,527 / 15,235] 48 actions, 47 running 2025-03-14T05:45:49.9041099Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T05:45:49.9042057Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T05:45:49.9043040Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T05:45:49.9043909Z Compiling xla/service/instruction_fusion.cc; 12s local 2025-03-14T05:45:49.9044987Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2025-03-14T05:45:49.9045955Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2025-03-14T05:45:49.9046948Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2025-03-14T05:45:49.9047942Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local ... 2025-03-14T05:45:50.1470985Z 2025-03-14T05:45:50.1471809Z  2025-03-14T05:45:50.1472236Z  2025-03-14T05:45:50.1472602Z  2025-03-14T05:45:50.1472938Z  2025-03-14T05:45:50.1473269Z  2025-03-14T05:45:50.1473607Z  2025-03-14T05:45:50.1473954Z  2025-03-14T05:45:50.1474669Z  2025-03-14T05:45:50.1475218Z [12,531 / 15,235] 48 actions running 2025-03-14T05:45:50.1475965Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T05:45:50.1476846Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T05:45:50.1477887Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T05:45:50.1478704Z Compiling xla/service/instruction_fusion.cc; 13s local 2025-03-14T05:45:50.1479552Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2025-03-14T05:45:50.1480484Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2025-03-14T05:45:50.1481415Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 8s local 2025-03-14T05:45:50.1482384Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 7s local ... 2025-03-14T05:45:50.5475208Z 2025-03-14T05:45:50.5476082Z  2025-03-14T05:45:50.5476529Z  2025-03-14T05:45:50.5476906Z  2025-03-14T05:45:50.5477280Z  2025-03-14T05:45:50.5477664Z  2025-03-14T05:45:50.5478038Z  2025-03-14T05:45:50.5478435Z  2025-03-14T05:45:50.5478804Z  2025-03-14T05:45:50.5479334Z [12,534 / 15,235] 48 actions running 2025-03-14T05:45:50.5480053Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T05:45:50.5480931Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T05:45:50.5481832Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T05:45:50.5482616Z Compiling xla/service/instruction_fusion.cc; 13s local 2025-03-14T05:45:50.5483432Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2025-03-14T05:45:50.5484325Z Compiling llvm/lib/Analysis/BasicAliasAnalysis.cpp; 9s local 2025-03-14T05:45:50.5485301Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 7s local 2025-03-14T05:45:50.5486086Z Compiling xla/service/hlo_domain_remover.cc; 6s local ... 2025-03-14T05:45:50.7507688Z 2025-03-14T05:45:50.7508568Z  2025-03-14T05:45:50.7509076Z  2025-03-14T05:45:50.7509865Z  2025-03-14T05:45:50.7510284Z  2025-03-14T05:45:50.7510685Z  2025-03-14T05:45:50.7511104Z  2025-03-14T05:45:50.7511546Z  2025-03-14T05:45:50.7511952Z  2025-03-14T05:45:50.7512571Z [12,536 / 15,235] 48 actions, 47 running 2025-03-14T05:45:50.7513387Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T05:45:50.7514489Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T05:45:50.7515475Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T05:45:50.7516303Z Compiling xla/service/instruction_fusion.cc; 13s local 2025-03-14T05:45:50.7517186Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2025-03-14T05:45:50.7518117Z Compiling llvm/lib/ProfileData/SampleProf.cpp; 7s local 2025-03-14T05:45:50.7518975Z Compiling xla/service/hlo_domain_remover.cc; 7s local 2025-03-14T05:45:50.7519791Z @llvm-project//llvm:ProfileData; 7s local ... 2025-03-14T05:45:50.9699391Z 2025-03-14T05:45:50.9700238Z  2025-03-14T05:45:50.9700732Z  2025-03-14T05:45:50.9701138Z  2025-03-14T05:45:50.9701555Z  2025-03-14T05:45:50.9702048Z  2025-03-14T05:45:50.9702577Z  2025-03-14T05:45:50.9703039Z  2025-03-14T05:45:50.9703458Z  2025-03-14T05:45:50.9704094Z [12,541 / 15,235] 48 actions, 47 running 2025-03-14T05:45:50.9704891Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T05:45:50.9705861Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T05:45:50.9716580Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T05:45:50.9717772Z Compiling xla/service/instruction_fusion.cc; 13s local 2025-03-14T05:45:50.9718736Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2025-03-14T05:45:50.9719663Z Compiling xla/service/hlo_domain_remover.cc; 7s local 2025-03-14T05:45:50.9721077Z Compiling llvm/lib/ProfileData/ItaniumManglingCanonicalizer.cpp; 7s local 2025-03-14T05:45:50.9722360Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 6s local ... 2025-03-14T05:45:51.2215293Z 2025-03-14T05:45:51.2216207Z  2025-03-14T05:45:51.2216723Z  2025-03-14T05:45:51.2217107Z  2025-03-14T05:45:51.2217452Z  2025-03-14T05:45:51.2217865Z  2025-03-14T05:45:51.2218251Z  2025-03-14T05:45:51.2218650Z  2025-03-14T05:45:51.2219061Z  2025-03-14T05:45:51.2219699Z [12,544 / 15,235] 48 actions, 47 running 2025-03-14T05:45:51.2220507Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T05:45:51.2221455Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T05:45:51.2222438Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T05:45:51.2223288Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T05:45:51.2224265Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2025-03-14T05:45:51.2225173Z Compiling xla/service/hlo_domain_remover.cc; 7s local 2025-03-14T05:45:51.2226177Z Compiling llvm/lib/ProfileData/ItaniumManglingCanonicalizer.cpp; 7s local 2025-03-14T05:45:51.2227415Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 6s local ... 2025-03-14T05:45:51.5274880Z 2025-03-14T05:45:51.5275849Z  2025-03-14T05:45:51.5276314Z  2025-03-14T05:45:51.5276710Z  2025-03-14T05:45:51.5277087Z  2025-03-14T05:45:51.5277436Z  2025-03-14T05:45:51.5277806Z  2025-03-14T05:45:51.5278202Z  2025-03-14T05:45:51.5278581Z  2025-03-14T05:45:51.5279195Z [12,547 / 15,235] 48 actions, 47 running 2025-03-14T05:45:51.5279971Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T05:45:51.5280813Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T05:45:51.5281677Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T05:45:51.5282585Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2025-03-14T05:45:51.5284082Z Compiling xla/service/hlo_domain_remover.cc; 7s local 2025-03-14T05:45:51.5285473Z Compiling llvm/lib/ProfileData/ItaniumManglingCanonicalizer.cpp; 7s local 2025-03-14T05:45:51.5286689Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 7s local 2025-03-14T05:45:51.5287732Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 6s local ... 2025-03-14T05:45:51.7322426Z 2025-03-14T05:45:51.7323275Z  2025-03-14T05:45:51.7323768Z  2025-03-14T05:45:51.7324194Z  2025-03-14T05:45:51.7324777Z  2025-03-14T05:45:51.7325207Z  2025-03-14T05:45:51.7325620Z  2025-03-14T05:45:51.7326059Z  2025-03-14T05:45:51.7326480Z  2025-03-14T05:45:51.7327109Z [12,550 / 15,235] 48 actions, 47 running 2025-03-14T05:45:51.7327897Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T05:45:51.7328761Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T05:45:51.7329632Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T05:45:51.7331067Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2025-03-14T05:45:51.7332157Z Compiling xla/service/hlo_domain_remover.cc; 8s local 2025-03-14T05:45:51.7333291Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 7s local 2025-03-14T05:45:51.7334516Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 6s local 2025-03-14T05:45:51.7335694Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 6s local ... 2025-03-14T05:45:51.9485513Z 2025-03-14T05:45:51.9486341Z  2025-03-14T05:45:51.9486815Z  2025-03-14T05:45:51.9487201Z  2025-03-14T05:45:51.9487595Z  2025-03-14T05:45:51.9487995Z  2025-03-14T05:45:51.9488384Z  2025-03-14T05:45:51.9488771Z  2025-03-14T05:45:51.9489164Z  2025-03-14T05:45:51.9489721Z [12,551 / 15,235] 48 actions running 2025-03-14T05:45:51.9490906Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T05:45:51.9491813Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T05:45:51.9492648Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T05:45:51.9493502Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2025-03-14T05:45:51.9494396Z Compiling xla/service/hlo_domain_remover.cc; 8s local 2025-03-14T05:45:51.9495318Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 7s local 2025-03-14T05:45:51.9496359Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 7s local 2025-03-14T05:45:51.9497363Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 7s local ... 2025-03-14T05:45:52.3244761Z 2025-03-14T05:45:52.3245662Z  2025-03-14T05:45:52.3246127Z  2025-03-14T05:45:52.3246514Z  2025-03-14T05:45:52.3246911Z  2025-03-14T05:45:52.3247311Z  2025-03-14T05:45:52.3247700Z  2025-03-14T05:45:52.3248100Z  2025-03-14T05:45:52.3248483Z  2025-03-14T05:45:52.3249123Z [12,554 / 15,235] 48 actions, 47 running 2025-03-14T05:45:52.3249899Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T05:45:52.3250652Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T05:45:52.3251462Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T05:45:52.3252269Z Compiling xla/service/hlo_domain_remover.cc; 8s local 2025-03-14T05:45:52.3253136Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 7s local 2025-03-14T05:45:52.3254256Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 7s local 2025-03-14T05:45:52.3255155Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 7s local 2025-03-14T05:45:52.3256101Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 6s local ... 2025-03-14T05:45:52.5491400Z 2025-03-14T05:45:52.5492319Z  2025-03-14T05:45:52.5492853Z  2025-03-14T05:45:52.5494565Z  2025-03-14T05:45:52.5495091Z  2025-03-14T05:45:52.5496522Z  2025-03-14T05:45:52.5497380Z  2025-03-14T05:45:52.5497815Z  2025-03-14T05:45:52.5499533Z  2025-03-14T05:45:52.5500190Z [12,555 / 15,235] 48 actions running 2025-03-14T05:45:52.5501012Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T05:45:52.5501934Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T05:45:52.5502862Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T05:45:52.5503749Z Compiling xla/service/hlo_domain_remover.cc; 8s local 2025-03-14T05:45:52.5504678Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 8s local 2025-03-14T05:45:52.5505908Z Compiling llvm/lib/Analysis/BranchProbabilityInfo.cpp; 7s local 2025-03-14T05:45:52.5506891Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 7s local 2025-03-14T05:45:52.5507714Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local ... 2025-03-14T05:45:52.8258722Z 2025-03-14T05:45:52.8259979Z  2025-03-14T05:45:52.8260466Z  2025-03-14T05:45:52.8260848Z  2025-03-14T05:45:52.8261312Z  2025-03-14T05:45:52.8261678Z  2025-03-14T05:45:52.8262064Z  2025-03-14T05:45:52.8262452Z  2025-03-14T05:45:52.8262845Z  2025-03-14T05:45:52.8263409Z [12,560 / 15,235] 48 actions, 47 running 2025-03-14T05:45:52.8264125Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T05:45:52.8264951Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T05:45:52.8265977Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T05:45:52.8266775Z Compiling xla/service/hlo_domain_remover.cc; 9s local 2025-03-14T05:45:52.8267689Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 8s local 2025-03-14T05:45:52.8268679Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 7s local 2025-03-14T05:45:52.8269915Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local 2025-03-14T05:45:52.8270954Z Compiling .../cpu/codegen/target_machine_features.cc; 7s local ... 2025-03-14T05:45:53.0264502Z 2025-03-14T05:45:53.0265776Z  2025-03-14T05:45:53.0266241Z  2025-03-14T05:45:53.0266620Z  2025-03-14T05:45:53.0267020Z  2025-03-14T05:45:53.0267403Z  2025-03-14T05:45:53.0267797Z  2025-03-14T05:45:53.0268181Z  2025-03-14T05:45:53.0268573Z  2025-03-14T05:45:53.0269172Z [12,563 / 15,235] 48 actions, 47 running 2025-03-14T05:45:53.0269931Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T05:45:53.0270758Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T05:45:53.0271613Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T05:45:53.0272406Z Compiling xla/service/hlo_domain_remover.cc; 9s local 2025-03-14T05:45:53.0273361Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 8s local 2025-03-14T05:45:53.0274472Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local 2025-03-14T05:45:53.0275468Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local 2025-03-14T05:45:53.0276457Z Compiling .../cpu/codegen/target_machine_features.cc; 7s local ... 2025-03-14T05:45:53.3497299Z 2025-03-14T05:45:53.3498659Z  2025-03-14T05:45:53.3499159Z  2025-03-14T05:45:53.3499586Z  2025-03-14T05:45:53.3500011Z  2025-03-14T05:45:53.3500439Z  2025-03-14T05:45:53.3500867Z  2025-03-14T05:45:53.3501324Z  2025-03-14T05:45:53.3501765Z  2025-03-14T05:45:53.3502352Z [12,565 / 15,235] 48 actions running 2025-03-14T05:45:53.3503175Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T05:45:53.3504086Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T05:45:53.3505011Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T05:45:53.3505907Z Compiling xla/service/hlo_domain_remover.cc; 9s local 2025-03-14T05:45:53.3506928Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 8s local 2025-03-14T05:45:53.3508425Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local 2025-03-14T05:45:53.3509455Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local 2025-03-14T05:45:53.3510507Z Compiling .../cpu/codegen/target_machine_features.cc; 7s local ... 2025-03-14T05:45:53.5500822Z 2025-03-14T05:45:53.5501667Z  2025-03-14T05:45:53.5502135Z  2025-03-14T05:45:53.5502527Z  2025-03-14T05:45:53.5502922Z  2025-03-14T05:45:53.5503325Z  2025-03-14T05:45:53.5503715Z  2025-03-14T05:45:53.5504109Z  2025-03-14T05:45:53.5504500Z  2025-03-14T05:45:53.5505071Z [12,570 / 15,235] 48 actions running 2025-03-14T05:45:53.5505825Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T05:45:53.5506660Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T05:45:53.5507551Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T05:45:53.5508340Z Compiling xla/service/hlo_domain_remover.cc; 9s local 2025-03-14T05:45:53.5509431Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 9s local 2025-03-14T05:45:53.5510505Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 8s local 2025-03-14T05:45:53.5511404Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local 2025-03-14T05:45:53.5512351Z Compiling .../cpu/codegen/target_machine_features.cc; 7s local ... 2025-03-14T05:45:53.9505246Z 2025-03-14T05:45:53.9506062Z  2025-03-14T05:45:53.9506528Z  2025-03-14T05:45:53.9506920Z  2025-03-14T05:45:53.9507328Z  2025-03-14T05:45:53.9507732Z  2025-03-14T05:45:53.9508110Z  2025-03-14T05:45:53.9508523Z  2025-03-14T05:45:53.9508929Z  2025-03-14T05:45:53.9509511Z [12,572 / 15,235] 48 actions running 2025-03-14T05:45:53.9510274Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T05:45:53.9511500Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2025-03-14T05:45:53.9512381Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T05:45:53.9513184Z Compiling xla/service/hlo_domain_remover.cc; 10s local 2025-03-14T05:45:53.9514151Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 9s local 2025-03-14T05:45:53.9515165Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2025-03-14T05:45:53.9516126Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local 2025-03-14T05:45:53.9517040Z Compiling xla/hlo/builder/lib/logdet.cc; 7s local ... 2025-03-14T05:45:54.2099799Z 2025-03-14T05:45:54.2100688Z  2025-03-14T05:45:54.2101178Z  2025-03-14T05:45:54.2101612Z  2025-03-14T05:45:54.2101988Z  2025-03-14T05:45:54.2102398Z  2025-03-14T05:45:54.2102805Z  2025-03-14T05:45:54.2103215Z  2025-03-14T05:45:54.2103632Z  2025-03-14T05:45:54.2104258Z [12,575 / 15,235] 48 actions, 47 running 2025-03-14T05:45:54.2105047Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T05:45:54.2105906Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2025-03-14T05:45:54.2106741Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T05:45:54.2107599Z Compiling xla/service/hlo_domain_remover.cc; 10s local 2025-03-14T05:45:54.2108412Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 9s local 2025-03-14T05:45:54.2109262Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2025-03-14T05:45:54.2110157Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local 2025-03-14T05:45:54.2111003Z Compiling xla/hlo/builder/lib/logdet.cc; 7s local ... 2025-03-14T05:45:54.4595941Z 2025-03-14T05:45:54.4597328Z  2025-03-14T05:45:54.4597843Z  2025-03-14T05:45:54.4598210Z  2025-03-14T05:45:54.4598584Z  2025-03-14T05:45:54.4598979Z  2025-03-14T05:45:54.4599392Z  2025-03-14T05:45:54.4599774Z  2025-03-14T05:45:54.4600214Z  2025-03-14T05:45:54.4600826Z [12,580 / 15,235] 48 actions, 47 running 2025-03-14T05:45:54.4601962Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T05:45:54.4602826Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T05:45:54.4603630Z Compiling xla/service/hlo_domain_remover.cc; 10s local 2025-03-14T05:45:54.4604747Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 10s local 2025-03-14T05:45:54.4605795Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2025-03-14T05:45:54.4606717Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2025-03-14T05:45:54.4607592Z Compiling xla/hlo/builder/lib/logdet.cc; 7s local 2025-03-14T05:45:54.4608364Z @llvm-project//llvm:InstCombine; 7s local ... 2025-03-14T05:45:54.7512742Z 2025-03-14T05:45:54.7513702Z  2025-03-14T05:45:54.7514192Z  2025-03-14T05:45:54.7514613Z  2025-03-14T05:45:54.7515023Z  2025-03-14T05:45:54.7515469Z  2025-03-14T05:45:54.7515879Z  2025-03-14T05:45:54.7516303Z  2025-03-14T05:45:54.7516707Z  2025-03-14T05:45:54.7517292Z [12,580 / 15,235] 48 actions running 2025-03-14T05:45:54.7518091Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T05:45:54.7518948Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T05:45:54.7519790Z Compiling xla/service/hlo_domain_remover.cc; 11s local 2025-03-14T05:45:54.7520766Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 10s local 2025-03-14T05:45:54.7521813Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local 2025-03-14T05:45:54.7522786Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2025-03-14T05:45:54.7523666Z Compiling xla/hlo/builder/lib/logdet.cc; 8s local 2025-03-14T05:45:54.7524420Z @llvm-project//llvm:InstCombine; 8s local ... 2025-03-14T05:45:55.1518810Z 2025-03-14T05:45:55.1519989Z  2025-03-14T05:45:55.1522218Z  2025-03-14T05:45:55.1523832Z  2025-03-14T05:45:55.1525579Z  2025-03-14T05:45:55.1527081Z  2025-03-14T05:45:55.1528163Z  2025-03-14T05:45:55.1528841Z  2025-03-14T05:45:55.1529329Z  2025-03-14T05:45:55.1529889Z [12,581 / 15,235] 48 actions running 2025-03-14T05:45:55.1530555Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T05:45:55.1531298Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T05:45:55.1532092Z Compiling xla/service/hlo_domain_remover.cc; 11s local 2025-03-14T05:45:55.1532985Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 10s local 2025-03-14T05:45:55.1534013Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2025-03-14T05:45:55.1534936Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2025-03-14T05:45:55.1535808Z Compiling xla/hlo/builder/lib/logdet.cc; 8s local 2025-03-14T05:45:55.1536538Z @llvm-project//llvm:InstCombine; 8s local ... 2025-03-14T05:45:55.3522429Z 2025-03-14T05:45:55.3523358Z  2025-03-14T05:45:55.3523784Z  2025-03-14T05:45:55.3524112Z  2025-03-14T05:45:55.3524578Z  2025-03-14T05:45:55.3525162Z  2025-03-14T05:45:55.3525548Z  2025-03-14T05:45:55.3525995Z  2025-03-14T05:45:55.3526481Z  2025-03-14T05:45:55.3527137Z [12,583 / 15,235] 48 actions running 2025-03-14T05:45:55.3527889Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T05:45:55.3528732Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T05:45:55.3529725Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 10s local 2025-03-14T05:45:55.3530747Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2025-03-14T05:45:55.3531712Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2025-03-14T05:45:55.3532601Z Compiling xla/hlo/builder/lib/logdet.cc; 8s local 2025-03-14T05:45:55.3533358Z @llvm-project//llvm:InstCombine; 8s local 2025-03-14T05:45:55.3534213Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 6s local ... 2025-03-14T05:45:55.5533400Z 2025-03-14T05:45:55.5535341Z  2025-03-14T05:45:55.5536857Z  2025-03-14T05:45:55.5538393Z  2025-03-14T05:45:55.5539803Z  2025-03-14T05:45:55.5541215Z  2025-03-14T05:45:55.5542618Z  2025-03-14T05:45:55.5543991Z  2025-03-14T05:45:55.5545415Z  2025-03-14T05:45:55.5547053Z [12,585 / 15,235] 48 actions, 47 running 2025-03-14T05:45:55.5548879Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T05:45:55.5550727Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T05:45:55.5552725Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 11s local 2025-03-14T05:45:55.5554791Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2025-03-14T05:45:55.5556805Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2025-03-14T05:45:55.5559450Z Compiling xla/hlo/builder/lib/logdet.cc; 9s local 2025-03-14T05:45:55.5561748Z @llvm-project//llvm:InstCombine; 8s local 2025-03-14T05:45:55.5564178Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 7s local ... 2025-03-14T05:45:55.7788687Z 2025-03-14T05:45:55.7791284Z  2025-03-14T05:45:55.7793627Z  2025-03-14T05:45:55.7795763Z  2025-03-14T05:45:55.7797895Z  2025-03-14T05:45:55.7800008Z  2025-03-14T05:45:55.7802153Z  2025-03-14T05:45:55.7804261Z  2025-03-14T05:45:55.7806567Z  2025-03-14T05:45:55.7808841Z [12,587 / 15,235] 48 actions, 47 running 2025-03-14T05:45:55.7811362Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T05:45:55.7813924Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T05:45:55.7816621Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 11s local 2025-03-14T05:45:55.7819342Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2025-03-14T05:45:55.7822406Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2025-03-14T05:45:55.7825115Z Compiling xla/hlo/builder/lib/logdet.cc; 9s local 2025-03-14T05:45:55.7827585Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:45:55.7830047Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 7s local ... 2025-03-14T05:45:56.1532359Z 2025-03-14T05:45:56.1533150Z  2025-03-14T05:45:56.1533633Z  2025-03-14T05:45:56.1534029Z  2025-03-14T05:45:56.1534438Z  2025-03-14T05:45:56.1534845Z  2025-03-14T05:45:56.1535225Z  2025-03-14T05:45:56.1535620Z  2025-03-14T05:45:56.1536023Z  2025-03-14T05:45:56.1536593Z [12,590 / 15,235] 48 actions running 2025-03-14T05:45:56.1537368Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T05:45:56.1538230Z Compiling xla/service/instruction_fusion.cc; 19s local 2025-03-14T05:45:56.1539259Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 11s local 2025-03-14T05:45:56.1540350Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T05:45:56.1541514Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2025-03-14T05:45:56.1542323Z Compiling xla/hlo/builder/lib/logdet.cc; 9s local 2025-03-14T05:45:56.1542978Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:45:56.1543752Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 7s local ... 2025-03-14T05:45:56.3536899Z 2025-03-14T05:45:56.3537723Z  2025-03-14T05:45:56.3538216Z  2025-03-14T05:45:56.3538625Z  2025-03-14T05:45:56.3539039Z  2025-03-14T05:45:56.3539438Z  2025-03-14T05:45:56.3539805Z  2025-03-14T05:45:56.3540187Z  2025-03-14T05:45:56.3540561Z  2025-03-14T05:45:56.3541118Z [12,591 / 15,235] 48 actions running 2025-03-14T05:45:56.3541852Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T05:45:56.3542728Z Compiling xla/service/instruction_fusion.cc; 19s local 2025-03-14T05:45:56.3543686Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 11s local 2025-03-14T05:45:56.3545101Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T05:45:56.3546065Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2025-03-14T05:45:56.3546891Z Compiling xla/hlo/builder/lib/logdet.cc; 9s local 2025-03-14T05:45:56.3547563Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:45:56.3548400Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 7s local ... 2025-03-14T05:45:56.6477038Z 2025-03-14T05:45:56.6477869Z  2025-03-14T05:45:56.6478297Z  2025-03-14T05:45:56.6478653Z  2025-03-14T05:45:56.6478978Z  2025-03-14T05:45:56.6479306Z  2025-03-14T05:45:56.6479643Z  2025-03-14T05:45:56.6479960Z  2025-03-14T05:45:56.6480304Z  2025-03-14T05:45:56.6480825Z [12,595 / 15,235] 48 actions, 47 running 2025-03-14T05:45:56.6481513Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T05:45:56.6482327Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 12s local 2025-03-14T05:45:56.6483167Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T05:45:56.6483950Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2025-03-14T05:45:56.6484880Z Compiling xla/hlo/builder/lib/logdet.cc; 10s local 2025-03-14T05:45:56.6485589Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:45:56.6486257Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 8s local 2025-03-14T05:45:56.6487036Z Compiling xla/service/cpu/ir_emission_utils.cc; 8s local ... 2025-03-14T05:45:56.9544704Z 2025-03-14T05:45:56.9545510Z  2025-03-14T05:45:56.9545972Z  2025-03-14T05:45:56.9546385Z  2025-03-14T05:45:56.9546753Z  2025-03-14T05:45:56.9547128Z  2025-03-14T05:45:56.9547505Z  2025-03-14T05:45:56.9547885Z  2025-03-14T05:45:56.9548266Z  2025-03-14T05:45:56.9549174Z [12,597 / 15,235] 48 actions running 2025-03-14T05:45:56.9550005Z Compiling xla/service/layout_assignment.cc; 24s local 2025-03-14T05:45:56.9551053Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 12s local 2025-03-14T05:45:56.9552025Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2025-03-14T05:45:56.9552880Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2025-03-14T05:45:56.9553669Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:45:56.9554468Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 8s local 2025-03-14T05:45:56.9555377Z Compiling xla/service/cpu/ir_emission_utils.cc; 8s local 2025-03-14T05:45:56.9556246Z Compiling xla/service/cpu/conv_canonicalization.cc; 7s local ... 2025-03-14T05:45:57.1548929Z 2025-03-14T05:45:57.1549810Z  2025-03-14T05:45:57.1550302Z  2025-03-14T05:45:57.1550697Z  2025-03-14T05:45:57.1551087Z  2025-03-14T05:45:57.1551477Z  2025-03-14T05:45:57.1551889Z  2025-03-14T05:45:57.1552270Z  2025-03-14T05:45:57.1552684Z  2025-03-14T05:45:57.1553255Z [12,599 / 15,235] 48 actions running 2025-03-14T05:45:57.1554162Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 12s local 2025-03-14T05:45:57.1555166Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2025-03-14T05:45:57.1556133Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2025-03-14T05:45:57.1556958Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:45:57.1557700Z Compiling xla/service/cpu/ir_emission_utils.cc; 8s local 2025-03-14T05:45:57.1558589Z Compiling xla/service/cpu/conv_canonicalization.cc; 7s local 2025-03-14T05:45:57.1559525Z Compiling llvm/lib/Analysis/CGSCCPassManager.cpp; 7s local 2025-03-14T05:45:57.1560571Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 6s local ... 2025-03-14T05:45:57.4032869Z 2025-03-14T05:45:57.4033729Z  2025-03-14T05:45:57.4034265Z  2025-03-14T05:45:57.4034675Z  2025-03-14T05:45:57.4035416Z  2025-03-14T05:45:57.4035834Z  2025-03-14T05:45:57.4036224Z  2025-03-14T05:45:57.4036605Z  2025-03-14T05:45:57.4036994Z  2025-03-14T05:45:57.4037574Z [12,602 / 15,235] 48 actions, 47 running 2025-03-14T05:45:57.4038601Z Compiling mlir/tools/mlir-tblgen/OpFormatGen.cpp [for tool]; 12s local 2025-03-14T05:45:57.4039652Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2025-03-14T05:45:57.4040509Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:45:57.4041247Z Compiling xla/service/cpu/ir_emission_utils.cc; 8s local 2025-03-14T05:45:57.4042144Z Compiling xla/service/cpu/conv_canonicalization.cc; 7s local 2025-03-14T05:45:57.4043075Z Compiling llvm/lib/Analysis/CGSCCPassManager.cpp; 7s local 2025-03-14T05:45:57.4044126Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 6s local 2025-03-14T05:45:57.4045479Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 6s local ... 2025-03-14T05:45:57.6316895Z 2025-03-14T05:45:57.6317762Z  2025-03-14T05:45:57.6318240Z  2025-03-14T05:45:57.6318627Z  2025-03-14T05:45:57.6319029Z  2025-03-14T05:45:57.6319425Z  2025-03-14T05:45:57.6319802Z  2025-03-14T05:45:57.6320307Z  2025-03-14T05:45:57.6320712Z  2025-03-14T05:45:57.6321339Z [12,606 / 15,235] 48 actions, 47 running 2025-03-14T05:45:57.6322264Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2025-03-14T05:45:57.6323144Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:45:57.6323910Z Compiling xla/service/cpu/ir_emission_utils.cc; 9s local 2025-03-14T05:45:57.6324976Z Compiling xla/service/cpu/conv_canonicalization.cc; 7s local 2025-03-14T05:45:57.6326077Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 6s local 2025-03-14T05:45:57.6327733Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 6s local 2025-03-14T05:45:57.6328990Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 6s local 2025-03-14T05:45:57.6330009Z Compiling llvm/lib/Linker/IRMover.cpp; 4s local ... 2025-03-14T05:45:57.9556153Z 2025-03-14T05:45:57.9557002Z  2025-03-14T05:45:57.9557468Z  2025-03-14T05:45:57.9557869Z  2025-03-14T05:45:57.9558250Z  2025-03-14T05:45:57.9558634Z  2025-03-14T05:45:57.9559017Z  2025-03-14T05:45:57.9559402Z  2025-03-14T05:45:57.9559779Z  2025-03-14T05:45:57.9560316Z [12,607 / 15,235] 48 actions running 2025-03-14T05:45:57.9561161Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2025-03-14T05:45:57.9561969Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:45:57.9562705Z Compiling xla/service/cpu/ir_emission_utils.cc; 9s local 2025-03-14T05:45:57.9563561Z Compiling xla/service/cpu/conv_canonicalization.cc; 8s local 2025-03-14T05:45:57.9564681Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local 2025-03-14T05:45:57.9566554Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 6s local 2025-03-14T05:45:57.9567647Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 6s local 2025-03-14T05:45:57.9568557Z Compiling llvm/lib/Linker/IRMover.cpp; 5s local ... 2025-03-14T05:45:58.3561001Z 2025-03-14T05:45:58.3561834Z  2025-03-14T05:45:58.3562274Z  2025-03-14T05:45:58.3562653Z  2025-03-14T05:45:58.3563027Z  2025-03-14T05:45:58.3563409Z  2025-03-14T05:45:58.3563786Z  2025-03-14T05:45:58.3564143Z  2025-03-14T05:45:58.3564626Z  2025-03-14T05:45:58.3565141Z [12,608 / 15,235] 48 actions running 2025-03-14T05:45:58.3566684Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2025-03-14T05:45:58.3567443Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:45:58.3568127Z Compiling xla/service/cpu/ir_emission_utils.cc; 9s local 2025-03-14T05:45:58.3568994Z Compiling xla/service/cpu/conv_canonicalization.cc; 8s local 2025-03-14T05:45:58.3570283Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local 2025-03-14T05:45:58.3571325Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 7s local 2025-03-14T05:45:58.3572368Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 6s local 2025-03-14T05:45:58.3573252Z Compiling llvm/lib/Linker/IRMover.cpp; 5s local ... 2025-03-14T05:45:58.5565491Z 2025-03-14T05:45:58.5566896Z  2025-03-14T05:45:58.5567304Z  2025-03-14T05:45:58.5567642Z  2025-03-14T05:45:58.5567977Z  2025-03-14T05:45:58.5568324Z  2025-03-14T05:45:58.5568668Z  2025-03-14T05:45:58.5569013Z  2025-03-14T05:45:58.5569368Z  2025-03-14T05:45:58.5569859Z [12,611 / 15,235] 48 actions running 2025-03-14T05:45:58.5570619Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2025-03-14T05:45:58.5571411Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:45:58.5572102Z Compiling xla/service/cpu/ir_emission_utils.cc; 10s local 2025-03-14T05:45:58.5572909Z Compiling xla/service/cpu/conv_canonicalization.cc; 8s local 2025-03-14T05:45:58.5573785Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 7s local 2025-03-14T05:45:58.5580906Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 6s local 2025-03-14T05:45:58.5581722Z Compiling llvm/lib/Linker/IRMover.cpp; 5s local 2025-03-14T05:45:58.5582332Z @llvm-project//llvm:InstCombine; 5s local ... 2025-03-14T05:45:59.1846108Z 2025-03-14T05:45:59.1846989Z  2025-03-14T05:45:59.1847487Z  2025-03-14T05:45:59.1847909Z  2025-03-14T05:45:59.1848309Z  2025-03-14T05:45:59.1848715Z  2025-03-14T05:45:59.1849131Z  2025-03-14T05:45:59.1849526Z  2025-03-14T05:45:59.1849926Z  2025-03-14T05:45:59.1850497Z [12,612 / 15,235] 48 actions, 47 running 2025-03-14T05:45:59.1851777Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2025-03-14T05:45:59.1852714Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:45:59.1853483Z Compiling xla/service/cpu/ir_emission_utils.cc; 10s local 2025-03-14T05:45:59.1854461Z Compiling xla/service/cpu/conv_canonicalization.cc; 9s local 2025-03-14T05:45:59.1855443Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 7s local 2025-03-14T05:45:59.1856701Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 7s local 2025-03-14T05:45:59.1857700Z Compiling llvm/lib/Linker/IRMover.cpp; 6s local 2025-03-14T05:45:59.1858468Z @llvm-project//llvm:InstCombine; 6s local ... 2025-03-14T05:45:59.5574645Z 2025-03-14T05:45:59.5575497Z  2025-03-14T05:45:59.5575982Z  2025-03-14T05:45:59.5576416Z  2025-03-14T05:45:59.5576830Z  2025-03-14T05:45:59.5577327Z  2025-03-14T05:45:59.5577714Z  2025-03-14T05:45:59.5578140Z  2025-03-14T05:45:59.5578573Z  2025-03-14T05:45:59.5579145Z [12,612 / 15,235] 48 actions running 2025-03-14T05:45:59.5580004Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T05:45:59.5580871Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:45:59.5581619Z Compiling xla/service/cpu/ir_emission_utils.cc; 11s local 2025-03-14T05:45:59.5582557Z Compiling xla/service/cpu/conv_canonicalization.cc; 9s local 2025-03-14T05:45:59.5583578Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 8s local 2025-03-14T05:45:59.5584790Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 7s local 2025-03-14T05:45:59.5585814Z Compiling llvm/lib/Linker/IRMover.cpp; 6s local 2025-03-14T05:45:59.5586596Z @llvm-project//llvm:InstCombine; 6s local ... 2025-03-14T05:45:59.9485957Z 2025-03-14T05:45:59.9486935Z  2025-03-14T05:45:59.9487704Z  2025-03-14T05:45:59.9488364Z  2025-03-14T05:45:59.9488995Z  2025-03-14T05:45:59.9489657Z  2025-03-14T05:45:59.9490277Z  2025-03-14T05:45:59.9491263Z  2025-03-14T05:45:59.9491883Z  2025-03-14T05:45:59.9492726Z [12,615 / 15,235] 48 actions, 47 running 2025-03-14T05:45:59.9493867Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T05:45:59.9495093Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:45:59.9495946Z Compiling xla/service/cpu/ir_emission_utils.cc; 11s local 2025-03-14T05:45:59.9496977Z Compiling xla/service/cpu/conv_canonicalization.cc; 10s local 2025-03-14T05:45:59.9498202Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 8s local 2025-03-14T05:45:59.9499564Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 8s local 2025-03-14T05:45:59.9500732Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local 2025-03-14T05:45:59.9501620Z @llvm-project//llvm:InstCombine; 7s local ... 2025-03-14T05:46:00.1575530Z 2025-03-14T05:46:00.1576455Z  2025-03-14T05:46:00.1577035Z  2025-03-14T05:46:00.1577434Z  2025-03-14T05:46:00.1577871Z  2025-03-14T05:46:00.1578252Z  2025-03-14T05:46:00.1578661Z  2025-03-14T05:46:00.1579070Z  2025-03-14T05:46:00.1579553Z  2025-03-14T05:46:00.1580140Z [12,618 / 15,235] 48 actions running 2025-03-14T05:46:00.1580993Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T05:46:00.1581842Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:00.1582599Z Compiling xla/service/cpu/ir_emission_utils.cc; 11s local 2025-03-14T05:46:00.1583497Z Compiling xla/service/cpu/conv_canonicalization.cc; 10s local 2025-03-14T05:46:00.1584531Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 8s local 2025-03-14T05:46:00.1585728Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 8s local 2025-03-14T05:46:00.1586713Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local 2025-03-14T05:46:00.1587861Z @llvm-project//llvm:InstCombine; 7s local ... 2025-03-14T05:46:00.5581252Z 2025-03-14T05:46:00.5582275Z  2025-03-14T05:46:00.5582776Z  2025-03-14T05:46:00.5583187Z  2025-03-14T05:46:00.5583931Z  2025-03-14T05:46:00.5584340Z  2025-03-14T05:46:00.5584741Z  2025-03-14T05:46:00.5585150Z  2025-03-14T05:46:00.5585534Z  2025-03-14T05:46:00.5586039Z [12,619 / 15,235] 48 actions running 2025-03-14T05:46:00.5586897Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2025-03-14T05:46:00.5587748Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:00.5588529Z Compiling xla/service/cpu/ir_emission_utils.cc; 12s local 2025-03-14T05:46:00.5589477Z Compiling xla/service/cpu/conv_canonicalization.cc; 10s local 2025-03-14T05:46:00.5590530Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 9s local 2025-03-14T05:46:00.5591754Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 8s local 2025-03-14T05:46:00.5592819Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local 2025-03-14T05:46:00.5593556Z @llvm-project//llvm:InstCombine; 7s local ... 2025-03-14T05:46:01.1073555Z 2025-03-14T05:46:01.1074410Z  2025-03-14T05:46:01.1074917Z  2025-03-14T05:46:01.1075330Z  2025-03-14T05:46:01.1075740Z  2025-03-14T05:46:01.1076145Z  2025-03-14T05:46:01.1076538Z  2025-03-14T05:46:01.1076956Z  2025-03-14T05:46:01.1077364Z  2025-03-14T05:46:01.1077979Z [12,620 / 15,235] 48 actions, 47 running 2025-03-14T05:46:01.1078849Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2025-03-14T05:46:01.1079668Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:01.1080521Z Compiling xla/service/cpu/ir_emission_utils.cc; 12s local 2025-03-14T05:46:01.1081392Z Compiling xla/service/cpu/conv_canonicalization.cc; 11s local 2025-03-14T05:46:01.1082477Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 9s local 2025-03-14T05:46:01.1083725Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2025-03-14T05:46:01.1085270Z Compiling llvm/lib/Linker/IRMover.cpp; 8s local 2025-03-14T05:46:01.1086042Z @llvm-project//llvm:InstCombine; 8s local ... 2025-03-14T05:46:01.3582115Z 2025-03-14T05:46:01.3583005Z  2025-03-14T05:46:01.3583473Z  2025-03-14T05:46:01.3583872Z  2025-03-14T05:46:01.3584274Z  2025-03-14T05:46:01.3584665Z  2025-03-14T05:46:01.3585131Z  2025-03-14T05:46:01.3585516Z  2025-03-14T05:46:01.3585911Z  2025-03-14T05:46:01.3586503Z [12,624 / 15,235] 48 actions, 47 running 2025-03-14T05:46:01.3587383Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2025-03-14T05:46:01.3588198Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:01.3588974Z Compiling xla/service/cpu/ir_emission_utils.cc; 12s local 2025-03-14T05:46:01.3589851Z Compiling xla/service/cpu/conv_canonicalization.cc; 11s local 2025-03-14T05:46:01.3590848Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 10s local 2025-03-14T05:46:01.3592109Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2025-03-14T05:46:01.3593052Z @llvm-project//llvm:InstCombine; 8s local 2025-03-14T05:46:01.3593743Z @llvm-project//llvm:InstCombine; 8s local ... 2025-03-14T05:46:01.5590078Z 2025-03-14T05:46:01.5590752Z  2025-03-14T05:46:01.5591217Z  2025-03-14T05:46:01.5591648Z  2025-03-14T05:46:01.5592096Z  2025-03-14T05:46:01.5592535Z  2025-03-14T05:46:01.5592974Z  2025-03-14T05:46:01.5593410Z  2025-03-14T05:46:01.5593849Z  2025-03-14T05:46:01.5594453Z [12,625 / 15,235] 48 actions running 2025-03-14T05:46:01.5595400Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T05:46:01.5596323Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:01.5597597Z Compiling xla/service/cpu/ir_emission_utils.cc; 13s local 2025-03-14T05:46:01.5598590Z Compiling xla/service/cpu/conv_canonicalization.cc; 11s local 2025-03-14T05:46:01.5599742Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 10s local 2025-03-14T05:46:01.5601027Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 9s local 2025-03-14T05:46:01.5602066Z @llvm-project//llvm:InstCombine; 8s local 2025-03-14T05:46:01.5602803Z @llvm-project//llvm:InstCombine; 8s local ... 2025-03-14T05:46:01.7595761Z 2025-03-14T05:46:01.7596620Z  2025-03-14T05:46:01.7597101Z  2025-03-14T05:46:01.7597520Z  2025-03-14T05:46:01.7597936Z  2025-03-14T05:46:01.7598333Z  2025-03-14T05:46:01.7598743Z  2025-03-14T05:46:01.7599162Z  2025-03-14T05:46:01.7599583Z  2025-03-14T05:46:01.7600146Z [12,626 / 15,235] 48 actions running 2025-03-14T05:46:01.7601067Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T05:46:01.7602109Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T05:46:01.7602887Z Compiling xla/service/cpu/ir_emission_utils.cc; 13s local 2025-03-14T05:46:01.7603701Z Compiling xla/service/cpu/conv_canonicalization.cc; 12s local 2025-03-14T05:46:01.7604888Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 10s local 2025-03-14T05:46:01.7606077Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2025-03-14T05:46:01.7607046Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:46:01.7607757Z @llvm-project//llvm:InstCombine; 8s local ... 2025-03-14T05:46:02.1196951Z 2025-03-14T05:46:02.1197823Z  2025-03-14T05:46:02.1198237Z  2025-03-14T05:46:02.1198588Z  2025-03-14T05:46:02.1198961Z  2025-03-14T05:46:02.1199322Z  2025-03-14T05:46:02.1199680Z  2025-03-14T05:46:02.1200031Z  2025-03-14T05:46:02.1200409Z  2025-03-14T05:46:02.1200974Z [12,627 / 15,235] 48 actions, 47 running 2025-03-14T05:46:02.1201853Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T05:46:02.1202978Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T05:46:02.1203639Z Compiling xla/service/cpu/ir_emission_utils.cc; 13s local 2025-03-14T05:46:02.1204552Z Compiling xla/service/cpu/conv_canonicalization.cc; 12s local 2025-03-14T05:46:02.1205407Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 10s local 2025-03-14T05:46:02.1206388Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2025-03-14T05:46:02.1207295Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:46:02.1207845Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:02.3598568Z 2025-03-14T05:46:02.3599449Z  2025-03-14T05:46:02.3599895Z  2025-03-14T05:46:02.3600324Z  2025-03-14T05:46:02.3600714Z  2025-03-14T05:46:02.3601183Z  2025-03-14T05:46:02.3601712Z  2025-03-14T05:46:02.3602136Z  2025-03-14T05:46:02.3602511Z  2025-03-14T05:46:02.3603134Z [12,629 / 15,235] 48 actions running 2025-03-14T05:46:02.3603996Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T05:46:02.3605115Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T05:46:02.3605889Z Compiling xla/service/cpu/ir_emission_utils.cc; 13s local 2025-03-14T05:46:02.3606800Z Compiling xla/service/cpu/conv_canonicalization.cc; 12s local 2025-03-14T05:46:02.3607835Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 11s local 2025-03-14T05:46:02.3608961Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 10s local 2025-03-14T05:46:02.3609887Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:46:02.3610558Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:02.7103910Z 2025-03-14T05:46:02.7104738Z  2025-03-14T05:46:02.7105188Z  2025-03-14T05:46:02.7105582Z  2025-03-14T05:46:02.7105956Z  2025-03-14T05:46:02.7106347Z  2025-03-14T05:46:02.7107059Z  2025-03-14T05:46:02.7107456Z  2025-03-14T05:46:02.7107850Z  2025-03-14T05:46:02.7108380Z [12,630 / 15,235] 48 actions, 47 running 2025-03-14T05:46:02.7109151Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2025-03-14T05:46:02.7109894Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T05:46:02.7110610Z Compiling xla/service/cpu/ir_emission_utils.cc; 14s local 2025-03-14T05:46:02.7111484Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2025-03-14T05:46:02.7112390Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 11s local 2025-03-14T05:46:02.7113485Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2025-03-14T05:46:02.7114372Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:46:02.7114969Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:02.9150210Z 2025-03-14T05:46:02.9151071Z  2025-03-14T05:46:02.9151584Z  2025-03-14T05:46:02.9152053Z  2025-03-14T05:46:02.9152475Z  2025-03-14T05:46:02.9152918Z  2025-03-14T05:46:02.9153318Z  2025-03-14T05:46:02.9153687Z  2025-03-14T05:46:02.9154034Z  2025-03-14T05:46:02.9154604Z [12,631 / 15,235] 48 actions, 47 running 2025-03-14T05:46:02.9155325Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T05:46:02.9156120Z Compiling xla/service/cpu/ir_emission_utils.cc; 14s local 2025-03-14T05:46:02.9157106Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2025-03-14T05:46:02.9158217Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 11s local 2025-03-14T05:46:02.9159408Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2025-03-14T05:46:02.9160538Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:46:02.9161489Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 10s local 2025-03-14T05:46:02.9162687Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local ... 2025-03-14T05:46:03.1605353Z 2025-03-14T05:46:03.1606157Z  2025-03-14T05:46:03.1606633Z  2025-03-14T05:46:03.1607059Z  2025-03-14T05:46:03.1607469Z  2025-03-14T05:46:03.1607850Z  2025-03-14T05:46:03.1608235Z  2025-03-14T05:46:03.1608622Z  2025-03-14T05:46:03.1608984Z  2025-03-14T05:46:03.1609529Z [12,632 / 15,235] 48 actions running 2025-03-14T05:46:03.1610222Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T05:46:03.1611012Z Compiling xla/service/cpu/ir_emission_utils.cc; 14s local 2025-03-14T05:46:03.1611925Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2025-03-14T05:46:03.1612989Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 11s local 2025-03-14T05:46:03.1614163Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2025-03-14T05:46:03.1615154Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:46:03.1616087Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 10s local 2025-03-14T05:46:03.1617268Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local ... 2025-03-14T05:46:03.3786691Z 2025-03-14T05:46:03.3787518Z  2025-03-14T05:46:03.3788003Z  2025-03-14T05:46:03.3788522Z  2025-03-14T05:46:03.3788995Z  2025-03-14T05:46:03.3789411Z  2025-03-14T05:46:03.3789806Z  2025-03-14T05:46:03.3790208Z  2025-03-14T05:46:03.3790567Z  2025-03-14T05:46:03.3791167Z [12,634 / 15,235] 48 actions, 47 running 2025-03-14T05:46:03.3791954Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T05:46:03.3792757Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2025-03-14T05:46:03.3793733Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T05:46:03.3794843Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 11s local 2025-03-14T05:46:03.3796176Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:46:03.3797098Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 10s local 2025-03-14T05:46:03.3808036Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2025-03-14T05:46:03.3809255Z @llvm-project//llvm:InstCombine; 10s local ... 2025-03-14T05:46:03.6102164Z 2025-03-14T05:46:03.6103121Z  2025-03-14T05:46:03.6104730Z  2025-03-14T05:46:03.6105243Z  2025-03-14T05:46:03.6105702Z  2025-03-14T05:46:03.6106148Z  2025-03-14T05:46:03.6106592Z  2025-03-14T05:46:03.6107016Z  2025-03-14T05:46:03.6107457Z  2025-03-14T05:46:03.6108125Z [12,637 / 15,235] 48 actions, 47 running 2025-03-14T05:46:03.6108991Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T05:46:03.6109775Z Compiling xla/service/cpu/conv_canonicalization.cc; 13s local 2025-03-14T05:46:03.6110828Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T05:46:03.6112105Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 12s local 2025-03-14T05:46:03.6113203Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:46:03.6114207Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 10s local 2025-03-14T05:46:03.6115445Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2025-03-14T05:46:03.6116439Z @llvm-project//llvm:InstCombine; 10s local ... 2025-03-14T05:46:03.9202782Z 2025-03-14T05:46:03.9203632Z  2025-03-14T05:46:03.9204130Z  2025-03-14T05:46:03.9204727Z  2025-03-14T05:46:03.9205137Z  2025-03-14T05:46:03.9205526Z  2025-03-14T05:46:03.9205932Z  2025-03-14T05:46:03.9206335Z  2025-03-14T05:46:03.9206726Z  2025-03-14T05:46:03.9207320Z [12,640 / 15,235] 48 actions, 47 running 2025-03-14T05:46:03.9208136Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T05:46:03.9208962Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2025-03-14T05:46:03.9210062Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T05:46:03.9211689Z Compiling llvm/lib/Transforms/InstCombine/InstCombineAddSub.cpp; 12s local 2025-03-14T05:46:03.9212696Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:46:03.9213640Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2025-03-14T05:46:03.9214645Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:46:03.9215345Z @llvm-project//mlir:mlir-tblgen; 10s local ... 2025-03-14T05:46:04.1613436Z 2025-03-14T05:46:04.1614237Z  2025-03-14T05:46:04.1614698Z  2025-03-14T05:46:04.1615092Z  2025-03-14T05:46:04.1615509Z  2025-03-14T05:46:04.1615897Z  2025-03-14T05:46:04.1616288Z  2025-03-14T05:46:04.1616689Z  2025-03-14T05:46:04.1617080Z  2025-03-14T05:46:04.1617636Z [12,643 / 15,235] 48 actions running 2025-03-14T05:46:04.1618373Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T05:46:04.1619196Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2025-03-14T05:46:04.1620233Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T05:46:04.1621119Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:46:04.1622045Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2025-03-14T05:46:04.1622973Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:46:04.1623653Z @llvm-project//mlir:mlir-tblgen; 10s local 2025-03-14T05:46:04.1624358Z Compiling xla/hlo/builder/lib/svd.cc; 10s local ... 2025-03-14T05:46:04.4462419Z 2025-03-14T05:46:04.4463292Z  2025-03-14T05:46:04.4463805Z  2025-03-14T05:46:04.4464222Z  2025-03-14T05:46:04.4464637Z  2025-03-14T05:46:04.4465067Z  2025-03-14T05:46:04.4466276Z  2025-03-14T05:46:04.4466680Z  2025-03-14T05:46:04.4467091Z  2025-03-14T05:46:04.4468159Z [12,647 / 15,235] 47 actions, 46 running 2025-03-14T05:46:04.4468889Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T05:46:04.4469742Z Compiling xla/service/cpu/conv_canonicalization.cc; 14s local 2025-03-14T05:46:04.4470804Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 13s local 2025-03-14T05:46:04.4471745Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:46:04.4472666Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2025-03-14T05:46:04.4473688Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:46:04.4474355Z @llvm-project//mlir:mlir-tblgen; 10s local 2025-03-14T05:46:04.4475044Z Compiling xla/hlo/builder/lib/svd.cc; 10s local ... 2025-03-14T05:46:04.7620258Z 2025-03-14T05:46:04.7621179Z  2025-03-14T05:46:04.7621675Z  2025-03-14T05:46:04.7622116Z  2025-03-14T05:46:04.7622523Z  2025-03-14T05:46:04.7622946Z  2025-03-14T05:46:04.7623348Z  2025-03-14T05:46:04.7623732Z  2025-03-14T05:46:04.7624153Z  2025-03-14T05:46:04.7624674Z [12,650 / 15,235] 48 actions running 2025-03-14T05:46:04.7625338Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T05:46:04.7626053Z Compiling xla/service/cpu/conv_canonicalization.cc; 15s local 2025-03-14T05:46:04.7626938Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 13s local 2025-03-14T05:46:04.7627707Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:46:04.7628470Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 11s local 2025-03-14T05:46:04.7629232Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:46:04.7629763Z @llvm-project//mlir:mlir-tblgen; 11s local 2025-03-14T05:46:04.7630327Z Compiling xla/hlo/builder/lib/svd.cc; 10s local ... 2025-03-14T05:46:04.9624084Z 2025-03-14T05:46:04.9624872Z  2025-03-14T05:46:04.9625354Z  2025-03-14T05:46:04.9625779Z  2025-03-14T05:46:04.9626180Z  2025-03-14T05:46:04.9626595Z  2025-03-14T05:46:04.9627017Z  2025-03-14T05:46:04.9627400Z  2025-03-14T05:46:04.9628271Z  2025-03-14T05:46:04.9628847Z [12,651 / 15,235] 48 actions running 2025-03-14T05:46:04.9629543Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T05:46:04.9630385Z Compiling xla/service/cpu/conv_canonicalization.cc; 15s local 2025-03-14T05:46:04.9631430Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 13s local 2025-03-14T05:46:04.9632346Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:46:04.9633281Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2025-03-14T05:46:04.9634257Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:46:04.9634907Z @llvm-project//mlir:mlir-tblgen; 11s local 2025-03-14T05:46:04.9635622Z Compiling xla/hlo/builder/lib/svd.cc; 10s local ... 2025-03-14T05:46:05.3028008Z 2025-03-14T05:46:05.3028839Z  2025-03-14T05:46:05.3029375Z  2025-03-14T05:46:05.3029839Z  2025-03-14T05:46:05.3030320Z  2025-03-14T05:46:05.3030727Z  2025-03-14T05:46:05.3031160Z  2025-03-14T05:46:05.3031538Z  2025-03-14T05:46:05.3031936Z  2025-03-14T05:46:05.3032567Z [12,654 / 15,235] 48 actions, 47 running 2025-03-14T05:46:05.3033299Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T05:46:05.3034043Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:46:05.3035061Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2025-03-14T05:46:05.3036058Z @llvm-project//llvm:InstCombine; 11s local 2025-03-14T05:46:05.3036735Z @llvm-project//mlir:mlir-tblgen; 11s local 2025-03-14T05:46:05.3037471Z Compiling xla/hlo/builder/lib/svd.cc; 11s local 2025-03-14T05:46:05.3038320Z Compiling xla/service/hlo_domain_isolator.cc; 10s local 2025-03-14T05:46:05.3039184Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local ... 2025-03-14T05:46:05.5630176Z 2025-03-14T05:46:05.5631046Z  2025-03-14T05:46:05.5631919Z  2025-03-14T05:46:05.5632353Z  2025-03-14T05:46:05.5632791Z  2025-03-14T05:46:05.5633207Z  2025-03-14T05:46:05.5633585Z  2025-03-14T05:46:05.5633982Z  2025-03-14T05:46:05.5634385Z  2025-03-14T05:46:05.5634978Z [12,656 / 15,235] 48 actions running 2025-03-14T05:46:05.5635702Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T05:46:05.5636398Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:46:05.5637339Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2025-03-14T05:46:05.5638327Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:46:05.5639042Z @llvm-project//mlir:mlir-tblgen; 12s local 2025-03-14T05:46:05.5639772Z Compiling xla/hlo/builder/lib/svd.cc; 11s local 2025-03-14T05:46:05.5640608Z Compiling xla/service/hlo_domain_isolator.cc; 10s local 2025-03-14T05:46:05.5641550Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local ... 2025-03-14T05:46:05.8235862Z 2025-03-14T05:46:05.8236701Z  2025-03-14T05:46:05.8237184Z  2025-03-14T05:46:05.8237608Z  2025-03-14T05:46:05.8238046Z  2025-03-14T05:46:05.8238435Z  2025-03-14T05:46:05.8238845Z  2025-03-14T05:46:05.8239236Z  2025-03-14T05:46:05.8239666Z  2025-03-14T05:46:05.8240270Z [12,657 / 15,235] 48 actions, 47 running 2025-03-14T05:46:05.8240973Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T05:46:05.8241643Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:05.8242594Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 12s local 2025-03-14T05:46:05.8243555Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:46:05.8244249Z @llvm-project//mlir:mlir-tblgen; 12s local 2025-03-14T05:46:05.8245136Z Compiling xla/hlo/builder/lib/svd.cc; 11s local 2025-03-14T05:46:05.8245955Z Compiling xla/service/hlo_domain_isolator.cc; 10s local 2025-03-14T05:46:05.8246946Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local ... 2025-03-14T05:46:06.1638340Z 2025-03-14T05:46:06.1639468Z  2025-03-14T05:46:06.1639908Z  2025-03-14T05:46:06.1640288Z  2025-03-14T05:46:06.1640642Z  2025-03-14T05:46:06.1641006Z  2025-03-14T05:46:06.1641363Z  2025-03-14T05:46:06.1641709Z  2025-03-14T05:46:06.1642079Z  2025-03-14T05:46:06.1642628Z [12,658 / 15,235] 48 actions running 2025-03-14T05:46:06.1643242Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T05:46:06.1643836Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:06.1644882Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2025-03-14T05:46:06.1645846Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:46:06.1646507Z @llvm-project//mlir:mlir-tblgen; 12s local 2025-03-14T05:46:06.1647207Z Compiling xla/hlo/builder/lib/svd.cc; 12s local 2025-03-14T05:46:06.1647973Z Compiling xla/service/hlo_domain_isolator.cc; 10s local 2025-03-14T05:46:06.1648897Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local ... 2025-03-14T05:46:06.4454775Z 2025-03-14T05:46:06.4455611Z  2025-03-14T05:46:06.4456081Z  2025-03-14T05:46:06.4456474Z  2025-03-14T05:46:06.4456903Z  2025-03-14T05:46:06.4457288Z  2025-03-14T05:46:06.4457661Z  2025-03-14T05:46:06.4458039Z  2025-03-14T05:46:06.4458418Z  2025-03-14T05:46:06.4459016Z [12,659 / 15,235] 48 actions, 47 running 2025-03-14T05:46:06.4459715Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T05:46:06.4460382Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:06.4461298Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2025-03-14T05:46:06.4462215Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T05:46:06.4462862Z @llvm-project//mlir:mlir-tblgen; 12s local 2025-03-14T05:46:06.4463562Z Compiling xla/hlo/builder/lib/svd.cc; 12s local 2025-03-14T05:46:06.4466698Z Compiling xla/service/hlo_domain_isolator.cc; 11s local 2025-03-14T05:46:06.4467779Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local ... 2025-03-14T05:46:06.6585868Z 2025-03-14T05:46:06.6586714Z  2025-03-14T05:46:06.6587198Z  2025-03-14T05:46:06.6587596Z  2025-03-14T05:46:06.6587989Z  2025-03-14T05:46:06.6588412Z  2025-03-14T05:46:06.6588823Z  2025-03-14T05:46:06.6589220Z  2025-03-14T05:46:06.6589631Z  2025-03-14T05:46:06.6590238Z [12,661 / 15,235] 48 actions, 47 running 2025-03-14T05:46:06.6590973Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T05:46:06.6591693Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:06.6592708Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 13s local 2025-03-14T05:46:06.6593742Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:06.6594379Z @llvm-project//mlir:mlir-tblgen; 13s local 2025-03-14T05:46:06.6595093Z Compiling xla/hlo/builder/lib/svd.cc; 12s local 2025-03-14T05:46:06.6595918Z Compiling xla/service/hlo_domain_isolator.cc; 11s local 2025-03-14T05:46:06.6596832Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local ... 2025-03-14T05:46:06.9387193Z 2025-03-14T05:46:06.9388055Z  2025-03-14T05:46:06.9388555Z  2025-03-14T05:46:06.9388964Z  2025-03-14T05:46:06.9389388Z  2025-03-14T05:46:06.9389763Z  2025-03-14T05:46:06.9390138Z  2025-03-14T05:46:06.9390529Z  2025-03-14T05:46:06.9390922Z  2025-03-14T05:46:06.9391501Z [12,665 / 15,235] 48 actions, 47 running 2025-03-14T05:46:06.9392227Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T05:46:06.9392884Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:06.9393845Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2025-03-14T05:46:06.9394853Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:06.9395619Z @llvm-project//mlir:mlir-tblgen; 13s local 2025-03-14T05:46:06.9396390Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2025-03-14T05:46:06.9397704Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2025-03-14T05:46:06.9398549Z Compiling xla/service/call_inliner.cc; 9s local ... 2025-03-14T05:46:07.1458642Z 2025-03-14T05:46:07.1459504Z  2025-03-14T05:46:07.1459979Z  2025-03-14T05:46:07.1460363Z  2025-03-14T05:46:07.1460765Z  2025-03-14T05:46:07.1461148Z  2025-03-14T05:46:07.1461533Z  2025-03-14T05:46:07.1461934Z  2025-03-14T05:46:07.1462326Z  2025-03-14T05:46:07.1462919Z [12,668 / 15,235] 48 actions, 47 running 2025-03-14T05:46:07.1463626Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:07.1464528Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2025-03-14T05:46:07.1465678Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:07.1466312Z @llvm-project//mlir:mlir-tblgen; 13s local 2025-03-14T05:46:07.1467090Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2025-03-14T05:46:07.1467912Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2025-03-14T05:46:07.1468709Z Compiling xla/service/call_inliner.cc; 10s local 2025-03-14T05:46:07.1469419Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:07.3645857Z 2025-03-14T05:46:07.3646832Z  2025-03-14T05:46:07.3647293Z  2025-03-14T05:46:07.3647718Z  2025-03-14T05:46:07.3648114Z  2025-03-14T05:46:07.3648495Z  2025-03-14T05:46:07.3648905Z  2025-03-14T05:46:07.3649330Z  2025-03-14T05:46:07.3649734Z  2025-03-14T05:46:07.3650335Z [12,669 / 15,235] 48 actions running 2025-03-14T05:46:07.3651079Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:07.3652076Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2025-03-14T05:46:07.3653063Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T05:46:07.3654143Z @llvm-project//mlir:mlir-tblgen; 13s local 2025-03-14T05:46:07.3654955Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2025-03-14T05:46:07.3655824Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2025-03-14T05:46:07.3656613Z Compiling xla/service/call_inliner.cc; 10s local 2025-03-14T05:46:07.3657348Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:07.6224879Z 2025-03-14T05:46:07.6225852Z  2025-03-14T05:46:07.6226268Z  2025-03-14T05:46:07.6226634Z  2025-03-14T05:46:07.6226993Z  2025-03-14T05:46:07.6227348Z  2025-03-14T05:46:07.6227701Z  2025-03-14T05:46:07.6228054Z  2025-03-14T05:46:07.6228411Z  2025-03-14T05:46:07.6228965Z [12,673 / 15,235] 48 actions, 47 running 2025-03-14T05:46:07.6229855Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 14s local 2025-03-14T05:46:07.6230747Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:07.6231391Z @llvm-project//mlir:mlir-tblgen; 14s local 2025-03-14T05:46:07.6232103Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2025-03-14T05:46:07.6232872Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2025-03-14T05:46:07.6233596Z Compiling xla/service/call_inliner.cc; 10s local 2025-03-14T05:46:07.6234276Z @llvm-project//llvm:InstCombine; 9s local 2025-03-14T05:46:07.6234955Z Compiling xla/service/while_util.cc; 7s local ... 2025-03-14T05:46:07.9651357Z 2025-03-14T05:46:07.9652182Z  2025-03-14T05:46:07.9652660Z  2025-03-14T05:46:07.9653065Z  2025-03-14T05:46:07.9653474Z  2025-03-14T05:46:07.9653874Z  2025-03-14T05:46:07.9654264Z  2025-03-14T05:46:07.9654673Z  2025-03-14T05:46:07.9655103Z  2025-03-14T05:46:07.9655681Z [12,673 / 15,235] 48 actions running 2025-03-14T05:46:07.9656668Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2025-03-14T05:46:07.9657694Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:07.9658356Z @llvm-project//mlir:mlir-tblgen; 14s local 2025-03-14T05:46:07.9659594Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2025-03-14T05:46:07.9660423Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2025-03-14T05:46:07.9661201Z Compiling xla/service/call_inliner.cc; 10s local 2025-03-14T05:46:07.9661918Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T05:46:07.9662626Z Compiling xla/service/while_util.cc; 7s local ... 2025-03-14T05:46:08.2228985Z 2025-03-14T05:46:08.2229896Z  2025-03-14T05:46:08.2230447Z  2025-03-14T05:46:08.2230925Z  2025-03-14T05:46:08.2231373Z  2025-03-14T05:46:08.2231832Z  2025-03-14T05:46:08.2232288Z  2025-03-14T05:46:08.2232721Z  2025-03-14T05:46:08.2233186Z  2025-03-14T05:46:08.2233842Z [12,676 / 15,235] 48 actions, 47 running 2025-03-14T05:46:08.2234842Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2025-03-14T05:46:08.2235825Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T05:46:08.2236555Z @llvm-project//mlir:mlir-tblgen; 14s local 2025-03-14T05:46:08.2237344Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2025-03-14T05:46:08.2238148Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2025-03-14T05:46:08.2239068Z Compiling xla/service/call_inliner.cc; 11s local 2025-03-14T05:46:08.2239749Z Compiling xla/service/while_util.cc; 8s local 2025-03-14T05:46:08.2240562Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 6s local ... 2025-03-14T05:46:08.5241468Z 2025-03-14T05:46:08.5242304Z  2025-03-14T05:46:08.5242794Z  2025-03-14T05:46:08.5243201Z  2025-03-14T05:46:08.5243614Z  2025-03-14T05:46:08.5244041Z  2025-03-14T05:46:08.5244596Z  2025-03-14T05:46:08.5245020Z  2025-03-14T05:46:08.5245399Z  2025-03-14T05:46:08.5246011Z [12,677 / 15,235] 48 actions, 47 running 2025-03-14T05:46:08.5247557Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2025-03-14T05:46:08.5248635Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T05:46:08.5249345Z @llvm-project//mlir:mlir-tblgen; 14s local 2025-03-14T05:46:08.5250086Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T05:46:08.5250904Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2025-03-14T05:46:08.5251665Z Compiling xla/service/call_inliner.cc; 11s local 2025-03-14T05:46:08.5252319Z Compiling xla/service/while_util.cc; 8s local 2025-03-14T05:46:08.5253238Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 7s local ... 2025-03-14T05:46:08.7658874Z 2025-03-14T05:46:08.7660314Z  2025-03-14T05:46:08.7660775Z  2025-03-14T05:46:08.7662431Z  2025-03-14T05:46:08.7663537Z  2025-03-14T05:46:08.7664654Z  2025-03-14T05:46:08.7666031Z  2025-03-14T05:46:08.7667318Z  2025-03-14T05:46:08.7667791Z  2025-03-14T05:46:08.7668458Z [12,678 / 15,235] 48 actions running 2025-03-14T05:46:08.7669386Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 15s local 2025-03-14T05:46:08.7670309Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T05:46:08.7670931Z @llvm-project//mlir:mlir-tblgen; 15s local 2025-03-14T05:46:08.7671678Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T05:46:08.7672463Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2025-03-14T05:46:08.7673194Z Compiling xla/service/call_inliner.cc; 11s local 2025-03-14T05:46:08.7673909Z Compiling xla/service/while_util.cc; 8s local 2025-03-14T05:46:08.7674778Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 7s local ... 2025-03-14T05:46:08.9662770Z 2025-03-14T05:46:08.9663591Z  2025-03-14T05:46:08.9664024Z  2025-03-14T05:46:08.9664378Z  2025-03-14T05:46:08.9664727Z  2025-03-14T05:46:08.9665084Z  2025-03-14T05:46:08.9665746Z  2025-03-14T05:46:08.9666138Z  2025-03-14T05:46:08.9666470Z  2025-03-14T05:46:08.9667366Z [12,679 / 15,235] 48 actions running 2025-03-14T05:46:08.9668276Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2025-03-14T05:46:08.9669134Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T05:46:08.9669785Z @llvm-project//mlir:mlir-tblgen; 15s local 2025-03-14T05:46:08.9670497Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T05:46:08.9671263Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2025-03-14T05:46:09.2075093Z Compiling xla/service/call_inliner.cc; 11s local 2025-03-14T05:46:09.2075845Z Compiling xla/service/while_util.cc; 8s local 2025-03-14T05:46:09.2076657Z Compiling llvm/lib/Analysis/DependenceAnalysis.cpp; 7s local ... 2025-03-14T05:46:09.2077291Z 2025-03-14T05:46:09.2077731Z  2025-03-14T05:46:09.2078144Z  2025-03-14T05:46:09.2078562Z  2025-03-14T05:46:09.2078953Z  2025-03-14T05:46:09.2079379Z  2025-03-14T05:46:09.2079779Z  2025-03-14T05:46:09.2080202Z  2025-03-14T05:46:09.2080592Z  2025-03-14T05:46:09.2081153Z [12,681 / 15,235] 48 actions, 47 running 2025-03-14T05:46:09.2082108Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2025-03-14T05:46:09.2083056Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T05:46:09.2083756Z @llvm-project//mlir:mlir-tblgen; 15s local 2025-03-14T05:46:09.2084632Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T05:46:09.2085443Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2025-03-14T05:46:09.2086202Z Compiling xla/service/call_inliner.cc; 12s local 2025-03-14T05:46:09.2086907Z Compiling xla/service/while_util.cc; 9s local 2025-03-14T05:46:09.2087790Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 7s local ... 2025-03-14T05:46:09.4329397Z 2025-03-14T05:46:09.4330389Z  2025-03-14T05:46:09.4330874Z  2025-03-14T05:46:09.4331595Z  2025-03-14T05:46:09.4331991Z  2025-03-14T05:46:09.4332407Z  2025-03-14T05:46:09.4332777Z  2025-03-14T05:46:09.4333183Z  2025-03-14T05:46:09.4333564Z  2025-03-14T05:46:09.4334142Z [12,683 / 15,235] 48 actions, 47 running 2025-03-14T05:46:09.4335059Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2025-03-14T05:46:09.4336050Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T05:46:09.4336684Z @llvm-project//mlir:mlir-tblgen; 15s local 2025-03-14T05:46:09.4337507Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T05:46:09.4338419Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2025-03-14T05:46:09.4339267Z Compiling xla/service/call_inliner.cc; 12s local 2025-03-14T05:46:09.4340069Z Compiling xla/service/while_util.cc; 9s local 2025-03-14T05:46:09.4341053Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local ... 2025-03-14T05:46:09.7670115Z 2025-03-14T05:46:09.7671042Z  2025-03-14T05:46:09.7671498Z  2025-03-14T05:46:09.7671908Z  2025-03-14T05:46:09.7672297Z  2025-03-14T05:46:09.7672727Z  2025-03-14T05:46:09.7673132Z  2025-03-14T05:46:09.7673551Z  2025-03-14T05:46:09.7673970Z  2025-03-14T05:46:09.7674567Z [12,683 / 15,235] 48 actions running 2025-03-14T05:46:09.7675575Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 16s local 2025-03-14T05:46:09.7676547Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T05:46:09.7677263Z @llvm-project//mlir:mlir-tblgen; 16s local 2025-03-14T05:46:09.7678082Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2025-03-14T05:46:09.7678960Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2025-03-14T05:46:09.7679778Z Compiling xla/service/call_inliner.cc; 12s local 2025-03-14T05:46:09.7680568Z Compiling xla/service/while_util.cc; 9s local 2025-03-14T05:46:09.7681576Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local ... 2025-03-14T05:46:09.9674354Z 2025-03-14T05:46:09.9675195Z  2025-03-14T05:46:09.9675814Z  2025-03-14T05:46:09.9676201Z  2025-03-14T05:46:09.9676583Z  2025-03-14T05:46:09.9676979Z  2025-03-14T05:46:09.9677425Z  2025-03-14T05:46:09.9677829Z  2025-03-14T05:46:09.9678215Z  2025-03-14T05:46:09.9678702Z [12,684 / 15,235] 48 actions running 2025-03-14T05:46:09.9679683Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2025-03-14T05:46:09.9680666Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T05:46:09.9681286Z @llvm-project//mlir:mlir-tblgen; 16s local 2025-03-14T05:46:09.9681975Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2025-03-14T05:46:09.9682732Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2025-03-14T05:46:09.9683492Z Compiling xla/service/call_inliner.cc; 12s local 2025-03-14T05:46:09.9684287Z Compiling xla/service/while_util.cc; 9s local 2025-03-14T05:46:09.9685329Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local ... 2025-03-14T05:46:10.3679522Z 2025-03-14T05:46:10.3680361Z  2025-03-14T05:46:10.3680837Z  2025-03-14T05:46:10.3681241Z  2025-03-14T05:46:10.3681615Z  2025-03-14T05:46:10.3682002Z  2025-03-14T05:46:10.3682404Z  2025-03-14T05:46:10.3682800Z  2025-03-14T05:46:10.3683177Z  2025-03-14T05:46:10.3683730Z [12,687 / 15,235] 48 actions running 2025-03-14T05:46:10.3684872Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2025-03-14T05:46:10.3685877Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T05:46:10.3686544Z @llvm-project//mlir:mlir-tblgen; 16s local 2025-03-14T05:46:10.3687255Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2025-03-14T05:46:10.3688034Z Compiling xla/service/call_inliner.cc; 13s local 2025-03-14T05:46:10.3689186Z Compiling xla/service/while_util.cc; 10s local 2025-03-14T05:46:10.3690121Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2025-03-14T05:46:10.3691192Z Compiling xla/service/dynamic_dimension_inference.cc; 8s local ... 2025-03-14T05:46:10.5683479Z 2025-03-14T05:46:10.5684327Z  2025-03-14T05:46:10.5685021Z  2025-03-14T05:46:10.5685471Z  2025-03-14T05:46:10.5685829Z  2025-03-14T05:46:10.5686199Z  2025-03-14T05:46:10.5686557Z  2025-03-14T05:46:10.5686941Z  2025-03-14T05:46:10.5687324Z  2025-03-14T05:46:10.5687907Z [12,689 / 15,235] 48 actions running 2025-03-14T05:46:10.5688879Z Compiling llvm/lib/Transforms/InstCombine/InstCombineCalls.cpp; 17s local 2025-03-14T05:46:10.5689870Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T05:46:10.5690571Z @llvm-project//mlir:mlir-tblgen; 17s local 2025-03-14T05:46:10.5691344Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2025-03-14T05:46:10.5692180Z Compiling xla/service/while_util.cc; 10s local 2025-03-14T05:46:10.5693060Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2025-03-14T05:46:10.5694152Z Compiling xla/service/dynamic_dimension_inference.cc; 8s local 2025-03-14T05:46:10.5695260Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local ... 2025-03-14T05:46:10.8226199Z 2025-03-14T05:46:10.8227133Z  2025-03-14T05:46:10.8227716Z  2025-03-14T05:46:10.8228119Z  2025-03-14T05:46:10.8228498Z  2025-03-14T05:46:10.8228897Z  2025-03-14T05:46:10.8229292Z  2025-03-14T05:46:10.8229771Z  2025-03-14T05:46:10.8230276Z  2025-03-14T05:46:10.8230874Z [12,695 / 15,235] 48 actions, 47 running 2025-03-14T05:46:10.8231611Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T05:46:10.8232290Z @llvm-project//mlir:mlir-tblgen; 17s local 2025-03-14T05:46:10.8232976Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2025-03-14T05:46:10.8233711Z Compiling xla/service/while_util.cc; 10s local 2025-03-14T05:46:10.8234573Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2025-03-14T05:46:10.8236030Z Compiling xla/service/dynamic_dimension_inference.cc; 9s local 2025-03-14T05:46:10.8237154Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 8s local 2025-03-14T05:46:10.8238315Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 7s local ... 2025-03-14T05:46:11.1689795Z 2025-03-14T05:46:11.1691388Z  2025-03-14T05:46:11.1691932Z  2025-03-14T05:46:11.1693447Z  2025-03-14T05:46:11.1694492Z  2025-03-14T05:46:11.1695769Z  2025-03-14T05:46:11.1696997Z  2025-03-14T05:46:11.1698287Z  2025-03-14T05:46:11.1699714Z  2025-03-14T05:46:11.1701275Z [12,697 / 15,235] 48 actions running 2025-03-14T05:46:11.1702483Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T05:46:11.1703677Z @llvm-project//mlir:mlir-tblgen; 17s local 2025-03-14T05:46:11.1705076Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2025-03-14T05:46:11.1706207Z Compiling xla/service/while_util.cc; 11s local 2025-03-14T05:46:11.1707676Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local 2025-03-14T05:46:11.1708876Z Compiling xla/service/dynamic_dimension_inference.cc; 9s local 2025-03-14T05:46:11.1710047Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 9s local 2025-03-14T05:46:11.1711251Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 7s local ... 2025-03-14T05:46:11.3693598Z 2025-03-14T05:46:11.3695731Z  2025-03-14T05:46:11.3696243Z  2025-03-14T05:46:11.3696658Z  2025-03-14T05:46:11.3697035Z  2025-03-14T05:46:11.3697442Z  2025-03-14T05:46:11.3697787Z  2025-03-14T05:46:11.3698176Z  2025-03-14T05:46:11.3698567Z  2025-03-14T05:46:11.3699155Z [12,698 / 15,235] 48 actions running 2025-03-14T05:46:11.3699873Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T05:46:11.3700955Z @llvm-project//mlir:mlir-tblgen; 17s local 2025-03-14T05:46:11.3701736Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T05:46:11.3702437Z Compiling xla/service/while_util.cc; 11s local 2025-03-14T05:46:11.3703304Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local 2025-03-14T05:46:11.3704273Z Compiling xla/service/dynamic_dimension_inference.cc; 9s local 2025-03-14T05:46:11.3705336Z Compiling llvm/lib/Transforms/InstCombine/InstCombinePHI.cpp; 9s local 2025-03-14T05:46:11.3706558Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 8s local ... 2025-03-14T05:46:11.6417949Z 2025-03-14T05:46:11.6418869Z  2025-03-14T05:46:11.6419357Z  2025-03-14T05:46:11.6419767Z  2025-03-14T05:46:11.6420175Z  2025-03-14T05:46:11.6420565Z  2025-03-14T05:46:11.6420971Z  2025-03-14T05:46:11.6421382Z  2025-03-14T05:46:11.6421778Z  2025-03-14T05:46:11.6422408Z [12,701 / 15,235] 48 actions, 47 running 2025-03-14T05:46:11.6423079Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T05:46:11.6423735Z @llvm-project//mlir:mlir-tblgen; 18s local 2025-03-14T05:46:11.6424409Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T05:46:11.6425137Z Compiling xla/service/while_util.cc; 11s local 2025-03-14T05:46:11.6426015Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local 2025-03-14T05:46:11.6426987Z Compiling xla/service/dynamic_dimension_inference.cc; 10s local 2025-03-14T05:46:11.6427969Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_uint8.cc; 8s local 2025-03-14T05:46:11.6428937Z @llvm-project//llvm:InstCombine; 8s local ... 2025-03-14T05:46:11.9700220Z 2025-03-14T05:46:11.9701101Z  2025-03-14T05:46:11.9701569Z  2025-03-14T05:46:11.9701967Z  2025-03-14T05:46:11.9702365Z  2025-03-14T05:46:11.9702747Z  2025-03-14T05:46:11.9703112Z  2025-03-14T05:46:11.9703524Z  2025-03-14T05:46:11.9703895Z  2025-03-14T05:46:11.9704787Z [12,703 / 15,235] 48 actions running 2025-03-14T05:46:11.9705417Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T05:46:11.9706167Z @llvm-project//mlir:mlir-tblgen; 18s local 2025-03-14T05:46:11.9706794Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T05:46:11.9707455Z Compiling xla/service/while_util.cc; 11s local 2025-03-14T05:46:11.9708211Z Compiling xla/service/dynamic_dimension_inference.cc; 10s local 2025-03-14T05:46:11.9709139Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_uint8.cc; 8s local 2025-03-14T05:46:11.9710223Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 8s local 2025-03-14T05:46:11.9711270Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 8s local ... 2025-03-14T05:46:12.1704051Z 2025-03-14T05:46:12.1704925Z  2025-03-14T05:46:12.1705345Z  2025-03-14T05:46:12.1705664Z  2025-03-14T05:46:12.1706014Z  2025-03-14T05:46:12.1706319Z  2025-03-14T05:46:12.1706663Z  2025-03-14T05:46:12.1706967Z  2025-03-14T05:46:12.1707271Z  2025-03-14T05:46:12.1707731Z [12,704 / 15,235] 48 actions running 2025-03-14T05:46:12.1708285Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T05:46:12.1708810Z @llvm-project//mlir:mlir-tblgen; 18s local 2025-03-14T05:46:12.1709368Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T05:46:12.1709968Z Compiling xla/service/while_util.cc; 12s local 2025-03-14T05:46:12.1710620Z Compiling xla/service/dynamic_dimension_inference.cc; 10s local 2025-03-14T05:46:12.1711446Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_uint8.cc; 8s local 2025-03-14T05:46:12.1712374Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 8s local 2025-03-14T05:46:12.1713306Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 8s local ... 2025-03-14T05:46:12.4584462Z 2025-03-14T05:46:12.4586328Z  2025-03-14T05:46:12.4586844Z  2025-03-14T05:46:12.4587265Z  2025-03-14T05:46:12.4587623Z  2025-03-14T05:46:12.4587968Z  2025-03-14T05:46:12.4588317Z  2025-03-14T05:46:12.4588661Z  2025-03-14T05:46:12.4589029Z  2025-03-14T05:46:12.4589611Z [12,706 / 15,235] 48 actions, 47 running 2025-03-14T05:46:12.4590341Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T05:46:12.4591007Z @llvm-project//mlir:mlir-tblgen; 18s local 2025-03-14T05:46:12.4591765Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2025-03-14T05:46:12.4592513Z Compiling xla/service/while_util.cc; 12s local 2025-03-14T05:46:12.4593376Z Compiling xla/service/dynamic_dimension_inference.cc; 10s local 2025-03-14T05:46:12.4594480Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_uint8.cc; 9s local 2025-03-14T05:46:12.4595696Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 8s local 2025-03-14T05:46:12.4596887Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 8s local ... 2025-03-14T05:46:12.7710279Z 2025-03-14T05:46:12.7711252Z  2025-03-14T05:46:12.7711773Z  2025-03-14T05:46:12.7712200Z  2025-03-14T05:46:12.7712595Z  2025-03-14T05:46:12.7712962Z  2025-03-14T05:46:12.7713343Z  2025-03-14T05:46:12.7713719Z  2025-03-14T05:46:12.7714102Z  2025-03-14T05:46:12.7714671Z [12,706 / 15,235] 48 actions running 2025-03-14T05:46:12.7715394Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T05:46:12.7716055Z @llvm-project//mlir:mlir-tblgen; 19s local 2025-03-14T05:46:12.7716818Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2025-03-14T05:46:12.7717606Z Compiling xla/service/while_util.cc; 12s local 2025-03-14T05:46:12.7718458Z Compiling xla/service/dynamic_dimension_inference.cc; 11s local 2025-03-14T05:46:12.7719655Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_uint8.cc; 9s local 2025-03-14T05:46:12.7720877Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 9s local 2025-03-14T05:46:12.7722379Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 9s local ... 2025-03-14T05:46:12.9714437Z 2025-03-14T05:46:12.9715474Z  2025-03-14T05:46:12.9716852Z  2025-03-14T05:46:12.9717701Z  2025-03-14T05:46:12.9718494Z  2025-03-14T05:46:12.9719698Z  2025-03-14T05:46:12.9720383Z  2025-03-14T05:46:12.9721060Z  2025-03-14T05:46:12.9721527Z  2025-03-14T05:46:12.9722108Z [12,707 / 15,235] 48 actions running 2025-03-14T05:46:12.9722857Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T05:46:12.9723662Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2025-03-14T05:46:12.9724780Z Compiling xla/service/while_util.cc; 12s local 2025-03-14T05:46:12.9725646Z Compiling xla/service/dynamic_dimension_inference.cc; 11s local 2025-03-14T05:46:12.9726847Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_uint8.cc; 9s local 2025-03-14T05:46:12.9728256Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 9s local 2025-03-14T05:46:12.9729522Z Compiling xla/hlo/transforms/simplifiers/algebraic_simplifier.cc; 9s local 2025-03-14T05:46:12.9730531Z @llvm-project//llvm:InstCombine; 8s local ... 2025-03-14T05:46:13.1843331Z 2025-03-14T05:46:13.1844347Z  2025-03-14T05:46:13.1845123Z  2025-03-14T05:46:13.1845636Z  2025-03-14T05:46:13.1846133Z  2025-03-14T05:46:13.1846640Z  2025-03-14T05:46:13.1847129Z  2025-03-14T05:46:13.1847637Z  2025-03-14T05:46:13.1848117Z  2025-03-14T05:46:13.1848867Z [12,714 / 15,235] 48 actions, 47 running 2025-03-14T05:46:13.1849679Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T05:46:13.1850492Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2025-03-14T05:46:13.1851448Z Compiling xla/service/while_util.cc; 13s local 2025-03-14T05:46:13.1852891Z Compiling xla/service/dynamic_dimension_inference.cc; 11s local 2025-03-14T05:46:13.1854180Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_uint8.cc; 9s local 2025-03-14T05:46:13.1855519Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 9s local 2025-03-14T05:46:13.1856900Z Compiling xla/hlo/transforms/simplifiers/algebraic_simplifier.cc; 9s local 2025-03-14T05:46:13.1858012Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:13.3928861Z 2025-03-14T05:46:13.3929763Z  2025-03-14T05:46:13.3930253Z  2025-03-14T05:46:13.3930662Z  2025-03-14T05:46:13.3930994Z  2025-03-14T05:46:13.3931304Z  2025-03-14T05:46:13.3931674Z  2025-03-14T05:46:13.3932075Z  2025-03-14T05:46:13.3932524Z  2025-03-14T05:46:13.3933206Z [12,721 / 15,235] 48 actions, 47 running 2025-03-14T05:46:13.3933856Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T05:46:13.3934601Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T05:46:13.3935268Z Compiling xla/service/while_util.cc; 13s local 2025-03-14T05:46:13.3936074Z Compiling xla/service/dynamic_dimension_inference.cc; 11s local 2025-03-14T05:46:13.3936813Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 10s local 2025-03-14T05:46:13.3937728Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 9s local 2025-03-14T05:46:13.3938894Z Compiling xla/hlo/transforms/simplifiers/algebraic_simplifier.cc; 9s local 2025-03-14T05:46:13.3939705Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:13.5992146Z 2025-03-14T05:46:13.5993133Z  2025-03-14T05:46:13.5993622Z  2025-03-14T05:46:13.5994025Z  2025-03-14T05:46:13.5994542Z  2025-03-14T05:46:13.5995055Z  2025-03-14T05:46:13.5995572Z  2025-03-14T05:46:13.5996098Z  2025-03-14T05:46:13.5996491Z  2025-03-14T05:46:13.5997110Z [12,728 / 15,235] 48 actions, 47 running 2025-03-14T05:46:13.5997887Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T05:46:13.5998997Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T05:46:13.5999766Z Compiling xla/service/while_util.cc; 13s local 2025-03-14T05:46:13.6000611Z Compiling xla/service/dynamic_dimension_inference.cc; 11s local 2025-03-14T05:46:13.6001615Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 10s local 2025-03-14T05:46:13.6002801Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2025-03-14T05:46:13.6004108Z Compiling xla/hlo/transforms/simplifiers/algebraic_simplifier.cc; 9s local 2025-03-14T05:46:13.6005221Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:13.8126521Z 2025-03-14T05:46:13.8127524Z  2025-03-14T05:46:13.8127994Z  2025-03-14T05:46:13.8128313Z  2025-03-14T05:46:13.8128602Z  2025-03-14T05:46:13.8128905Z  2025-03-14T05:46:13.8129272Z  2025-03-14T05:46:13.8129649Z  2025-03-14T05:46:13.8130098Z  2025-03-14T05:46:13.8130721Z [12,734 / 15,235] 48 actions, 47 running 2025-03-14T05:46:13.8131482Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T05:46:13.8132281Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T05:46:13.8133037Z Compiling xla/service/while_util.cc; 13s local 2025-03-14T05:46:13.8133930Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2025-03-14T05:46:13.8134985Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 10s local 2025-03-14T05:46:13.8136224Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2025-03-14T05:46:13.8137462Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 10s local 2025-03-14T05:46:13.8138250Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T05:46:14.0554285Z 2025-03-14T05:46:14.0555291Z  2025-03-14T05:46:14.0556720Z  2025-03-14T05:46:14.0557633Z  2025-03-14T05:46:14.0558385Z  2025-03-14T05:46:14.0559189Z  2025-03-14T05:46:14.0559623Z  2025-03-14T05:46:14.0560051Z  2025-03-14T05:46:14.0560427Z  2025-03-14T05:46:14.0561068Z [12,741 / 15,235] 48 actions, 47 running 2025-03-14T05:46:14.0561774Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T05:46:14.0562544Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T05:46:14.0563288Z Compiling xla/service/while_util.cc; 14s local 2025-03-14T05:46:14.0564189Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2025-03-14T05:46:14.0565626Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 10s local 2025-03-14T05:46:14.0566770Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2025-03-14T05:46:14.0568217Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 10s local 2025-03-14T05:46:14.0569372Z @llvm-project//llvm:InstCombine; 10s local ... 2025-03-14T05:46:14.2598231Z 2025-03-14T05:46:14.2599113Z  2025-03-14T05:46:14.2599542Z  2025-03-14T05:46:14.2599918Z  2025-03-14T05:46:14.2600292Z  2025-03-14T05:46:14.2600668Z  2025-03-14T05:46:14.2601045Z  2025-03-14T05:46:14.2601425Z  2025-03-14T05:46:14.2601913Z  2025-03-14T05:46:14.2602486Z [12,756 / 15,235] 48 actions, 47 running 2025-03-14T05:46:14.2603134Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T05:46:14.2603826Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T05:46:14.2604670Z Compiling xla/service/while_util.cc; 14s local 2025-03-14T05:46:14.2605414Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2025-03-14T05:46:14.2606301Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 10s local 2025-03-14T05:46:14.2607314Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2025-03-14T05:46:14.2608375Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 10s local 2025-03-14T05:46:14.2609376Z Compiling llvm/lib/Transforms/Utils/Debugify.cpp; 9s local ... 2025-03-14T05:46:14.4731443Z 2025-03-14T05:46:14.4732282Z  2025-03-14T05:46:14.4732698Z  2025-03-14T05:46:14.4733066Z  2025-03-14T05:46:14.4733417Z  2025-03-14T05:46:14.4733747Z  2025-03-14T05:46:14.4734104Z  2025-03-14T05:46:14.4734463Z  2025-03-14T05:46:14.4734823Z  2025-03-14T05:46:14.4735373Z [12,768 / 15,235] 48 actions, 47 running 2025-03-14T05:46:14.4736022Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T05:46:14.4736682Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2025-03-14T05:46:14.4737353Z Compiling xla/service/while_util.cc; 14s local 2025-03-14T05:46:14.4738157Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2025-03-14T05:46:14.4739041Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 11s local 2025-03-14T05:46:14.4740095Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 10s local 2025-03-14T05:46:14.4741182Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 10s local 2025-03-14T05:46:14.4742204Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 9s local ... 2025-03-14T05:46:14.7013430Z 2025-03-14T05:46:14.7015250Z  2025-03-14T05:46:14.7025611Z  2025-03-14T05:46:14.7026362Z  2025-03-14T05:46:14.7026722Z  2025-03-14T05:46:14.7027082Z  2025-03-14T05:46:14.7027423Z  2025-03-14T05:46:14.7027751Z  2025-03-14T05:46:14.7028092Z  2025-03-14T05:46:14.7028602Z [12,779 / 15,235] 48 actions, 47 running 2025-03-14T05:46:14.7029262Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2025-03-14T05:46:14.7029906Z Compiling xla/service/while_util.cc; 14s local 2025-03-14T05:46:14.7030610Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2025-03-14T05:46:14.7031469Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 11s local 2025-03-14T05:46:14.7032781Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 11s local 2025-03-14T05:46:14.7033784Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 10s local 2025-03-14T05:46:14.7034715Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 9s local 2025-03-14T05:46:14.7035573Z Compiling xla/service/conditional_simplifier.cc; 9s local ... 2025-03-14T05:46:14.9200449Z 2025-03-14T05:46:14.9201270Z  2025-03-14T05:46:14.9201897Z  2025-03-14T05:46:14.9202313Z  2025-03-14T05:46:14.9202739Z  2025-03-14T05:46:14.9203216Z  2025-03-14T05:46:14.9203627Z  2025-03-14T05:46:14.9204094Z  2025-03-14T05:46:14.9204682Z  2025-03-14T05:46:14.9205361Z [12,794 / 15,235] 48 actions, 47 running 2025-03-14T05:46:14.9206104Z Compiling xla/service/while_util.cc; 14s local 2025-03-14T05:46:14.9207036Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2025-03-14T05:46:14.9208104Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 11s local 2025-03-14T05:46:14.9209301Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 11s local 2025-03-14T05:46:14.9210447Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 11s local 2025-03-14T05:46:14.9211569Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 9s local 2025-03-14T05:46:14.9212599Z Compiling xla/service/conditional_simplifier.cc; 9s local 2025-03-14T05:46:14.9213611Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 9s local ... 2025-03-14T05:46:15.1305171Z 2025-03-14T05:46:15.1306003Z  2025-03-14T05:46:15.1306492Z  2025-03-14T05:46:15.1306905Z  2025-03-14T05:46:15.1307300Z  2025-03-14T05:46:15.1307676Z  2025-03-14T05:46:15.1308082Z  2025-03-14T05:46:15.1308488Z  2025-03-14T05:46:15.1308885Z  2025-03-14T05:46:15.1309487Z [12,806 / 15,235] 48 actions, 47 running 2025-03-14T05:46:15.1310274Z Compiling xla/service/while_util.cc; 15s local 2025-03-14T05:46:15.1311515Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2025-03-14T05:46:15.1312561Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 11s local 2025-03-14T05:46:15.1313730Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 11s local 2025-03-14T05:46:15.1314936Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 11s local 2025-03-14T05:46:15.1316063Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2025-03-14T05:46:15.1317068Z Compiling xla/service/conditional_simplifier.cc; 9s local 2025-03-14T05:46:15.1318207Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 9s local ... 2025-03-14T05:46:15.3729803Z 2025-03-14T05:46:15.3730641Z  2025-03-14T05:46:15.3731121Z  2025-03-14T05:46:15.3731516Z  2025-03-14T05:46:15.3731899Z  2025-03-14T05:46:15.3732309Z  2025-03-14T05:46:15.3732723Z  2025-03-14T05:46:15.3733161Z  2025-03-14T05:46:15.3733560Z  2025-03-14T05:46:15.3734126Z [12,809 / 15,235] 48 actions running 2025-03-14T05:46:15.3734872Z Compiling xla/service/while_util.cc; 15s local 2025-03-14T05:46:15.3735714Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2025-03-14T05:46:15.3736662Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 12s local 2025-03-14T05:46:15.3737783Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 11s local 2025-03-14T05:46:15.3739029Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 11s local 2025-03-14T05:46:15.3740138Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2025-03-14T05:46:15.3741138Z Compiling xla/service/conditional_simplifier.cc; 10s local 2025-03-14T05:46:15.3742104Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 10s local ... 2025-03-14T05:46:15.5733332Z 2025-03-14T05:46:15.5734299Z  2025-03-14T05:46:15.5734766Z  2025-03-14T05:46:15.5735505Z  2025-03-14T05:46:15.5735947Z  2025-03-14T05:46:15.5736347Z  2025-03-14T05:46:15.5736740Z  2025-03-14T05:46:15.5737128Z  2025-03-14T05:46:15.5737589Z  2025-03-14T05:46:15.5738124Z [12,810 / 15,235] 48 actions running 2025-03-14T05:46:15.5738837Z Compiling xla/service/while_util.cc; 15s local 2025-03-14T05:46:15.5739647Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2025-03-14T05:46:15.5740647Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 12s local 2025-03-14T05:46:15.5741773Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2025-03-14T05:46:15.5742910Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 11s local 2025-03-14T05:46:15.5744131Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2025-03-14T05:46:15.5745136Z Compiling xla/service/conditional_simplifier.cc; 10s local 2025-03-14T05:46:15.5746175Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 10s local ... 2025-03-14T05:46:15.8671037Z 2025-03-14T05:46:15.8671868Z  2025-03-14T05:46:15.8672367Z  2025-03-14T05:46:15.8672776Z  2025-03-14T05:46:15.8673141Z  2025-03-14T05:46:15.8673518Z  2025-03-14T05:46:15.8673905Z  2025-03-14T05:46:15.8674283Z  2025-03-14T05:46:15.8674672Z  2025-03-14T05:46:15.8675287Z [12,812 / 15,235] 48 actions, 47 running 2025-03-14T05:46:15.8676143Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2025-03-14T05:46:15.8677158Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 12s local 2025-03-14T05:46:15.8678352Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2025-03-14T05:46:15.8679550Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 12s local 2025-03-14T05:46:15.8680675Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 10s local 2025-03-14T05:46:15.8681768Z Compiling xla/service/conditional_simplifier.cc; 10s local 2025-03-14T05:46:15.8683163Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 10s local 2025-03-14T05:46:15.8684073Z Compiling xla/service/dynamic_padder.cc; 9s local ... 2025-03-14T05:46:16.1739682Z 2025-03-14T05:46:16.1740521Z  2025-03-14T05:46:16.1741026Z  2025-03-14T05:46:16.1741466Z  2025-03-14T05:46:16.1741854Z  2025-03-14T05:46:16.1742233Z  2025-03-14T05:46:16.1742636Z  2025-03-14T05:46:16.1743005Z  2025-03-14T05:46:16.1743419Z  2025-03-14T05:46:16.1743999Z [12,812 / 15,235] 48 actions running 2025-03-14T05:46:16.1744832Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2025-03-14T05:46:16.1745940Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 12s local 2025-03-14T05:46:16.1747181Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2025-03-14T05:46:16.1748467Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 12s local 2025-03-14T05:46:16.1749607Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2025-03-14T05:46:16.1750570Z Compiling xla/service/conditional_simplifier.cc; 11s local 2025-03-14T05:46:16.1751479Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 10s local 2025-03-14T05:46:16.1752501Z Compiling xla/service/dynamic_padder.cc; 9s local ... 2025-03-14T05:46:16.3742555Z 2025-03-14T05:46:16.3743393Z  2025-03-14T05:46:16.3743872Z  2025-03-14T05:46:16.3744274Z  2025-03-14T05:46:16.3744667Z  2025-03-14T05:46:16.3745076Z  2025-03-14T05:46:16.3745473Z  2025-03-14T05:46:16.3745872Z  2025-03-14T05:46:16.3746276Z  2025-03-14T05:46:16.3746831Z [12,815 / 15,235] 48 actions running 2025-03-14T05:46:16.3747687Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2025-03-14T05:46:16.3749139Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2025-03-14T05:46:16.3750337Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2025-03-14T05:46:16.3751529Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 12s local 2025-03-14T05:46:16.3752648Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2025-03-14T05:46:16.3754107Z Compiling xla/service/conditional_simplifier.cc; 11s local 2025-03-14T05:46:16.3755191Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 11s local 2025-03-14T05:46:16.3756173Z Compiling xla/service/dynamic_padder.cc; 9s local ... 2025-03-14T05:46:16.9177369Z 2025-03-14T05:46:16.9178236Z  2025-03-14T05:46:16.9178735Z  2025-03-14T05:46:16.9179137Z  2025-03-14T05:46:16.9179529Z  2025-03-14T05:46:16.9179979Z  2025-03-14T05:46:16.9180364Z  2025-03-14T05:46:16.9180743Z  2025-03-14T05:46:16.9181157Z  2025-03-14T05:46:16.9181755Z [12,816 / 15,235] 48 actions, 47 running 2025-03-14T05:46:16.9182621Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2025-03-14T05:46:16.9183610Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2025-03-14T05:46:16.9184728Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2025-03-14T05:46:16.9185872Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2025-03-14T05:46:16.9186969Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 11s local 2025-03-14T05:46:16.9187993Z Compiling xla/service/conditional_simplifier.cc; 11s local 2025-03-14T05:46:16.9188843Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 11s local 2025-03-14T05:46:16.9189696Z Compiling xla/service/dynamic_padder.cc; 10s local ... 2025-03-14T05:46:17.1751839Z 2025-03-14T05:46:17.1752878Z  2025-03-14T05:46:17.1753335Z  2025-03-14T05:46:17.1753760Z  2025-03-14T05:46:17.1754157Z  2025-03-14T05:46:17.1754550Z  2025-03-14T05:46:17.1754986Z  2025-03-14T05:46:17.1755355Z  2025-03-14T05:46:17.1756114Z  2025-03-14T05:46:17.1756669Z [12,816 / 15,235] 48 actions running 2025-03-14T05:46:17.1757468Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2025-03-14T05:46:17.1758394Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 13s local 2025-03-14T05:46:17.1759446Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2025-03-14T05:46:17.1760626Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2025-03-14T05:46:17.1761705Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2025-03-14T05:46:17.1762709Z Compiling xla/service/conditional_simplifier.cc; 12s local 2025-03-14T05:46:17.1763645Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 11s local 2025-03-14T05:46:17.1764648Z Compiling xla/service/dynamic_padder.cc; 10s local ... 2025-03-14T05:46:17.5670978Z 2025-03-14T05:46:17.5672032Z  2025-03-14T05:46:17.5672731Z  2025-03-14T05:46:17.5673181Z  2025-03-14T05:46:17.5673593Z  2025-03-14T05:46:17.5674002Z  2025-03-14T05:46:17.5674609Z  2025-03-14T05:46:17.5675154Z  2025-03-14T05:46:17.5675637Z  2025-03-14T05:46:17.5676358Z [12,820 / 15,235] 48 actions, 47 running 2025-03-14T05:46:17.5677302Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2025-03-14T05:46:17.5678439Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2025-03-14T05:46:17.5679624Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2025-03-14T05:46:17.5680863Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2025-03-14T05:46:17.5681942Z Compiling xla/service/conditional_simplifier.cc; 12s local 2025-03-14T05:46:17.5683028Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 12s local 2025-03-14T05:46:17.5684596Z Compiling xla/service/dynamic_padder.cc; 10s local 2025-03-14T05:46:17.5685561Z @llvm-project//llvm:InstCombine; 10s local ... 2025-03-14T05:46:17.7756939Z 2025-03-14T05:46:17.7757985Z  2025-03-14T05:46:17.7758617Z  2025-03-14T05:46:17.7759030Z  2025-03-14T05:46:17.7759449Z  2025-03-14T05:46:17.7759852Z  2025-03-14T05:46:17.7760256Z  2025-03-14T05:46:17.7760648Z  2025-03-14T05:46:17.7761026Z  2025-03-14T05:46:17.7761616Z [12,821 / 15,235] 48 actions running 2025-03-14T05:46:17.7762453Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2025-03-14T05:46:17.7763488Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2025-03-14T05:46:17.7764712Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2025-03-14T05:46:17.7766071Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 12s local 2025-03-14T05:46:17.7767102Z Compiling xla/service/conditional_simplifier.cc; 12s local 2025-03-14T05:46:17.7768091Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 12s local 2025-03-14T05:46:17.7769006Z Compiling xla/service/dynamic_padder.cc; 11s local 2025-03-14T05:46:17.7769770Z @llvm-project//llvm:InstCombine; 10s local ... 2025-03-14T05:46:18.2274319Z 2025-03-14T05:46:18.2275622Z  2025-03-14T05:46:18.2276130Z  2025-03-14T05:46:18.2276566Z  2025-03-14T05:46:18.2276989Z  2025-03-14T05:46:18.2277408Z  2025-03-14T05:46:18.2277789Z  2025-03-14T05:46:18.2278206Z  2025-03-14T05:46:18.2278600Z  2025-03-14T05:46:18.2279187Z [12,822 / 15,235] 48 actions, 47 running 2025-03-14T05:46:18.2280098Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2025-03-14T05:46:18.2281097Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 14s local 2025-03-14T05:46:18.2282130Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2025-03-14T05:46:18.2283316Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2025-03-14T05:46:18.2284396Z Compiling xla/service/conditional_simplifier.cc; 13s local 2025-03-14T05:46:18.2286047Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 12s local 2025-03-14T05:46:18.2286974Z Compiling xla/service/dynamic_padder.cc; 11s local 2025-03-14T05:46:18.2287789Z Compiling xla/service/gather_expander.cc; 10s local ... 2025-03-14T05:46:18.5764003Z 2025-03-14T05:46:18.5765060Z  2025-03-14T05:46:18.5765790Z  2025-03-14T05:46:18.5766233Z  2025-03-14T05:46:18.5766648Z  2025-03-14T05:46:18.5767065Z  2025-03-14T05:46:18.5767485Z  2025-03-14T05:46:18.5767880Z  2025-03-14T05:46:18.5768298Z  2025-03-14T05:46:18.5768887Z [12,823 / 15,235] 48 actions running 2025-03-14T05:46:18.5769830Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2025-03-14T05:46:18.5770934Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 15s local 2025-03-14T05:46:18.5772143Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2025-03-14T05:46:18.5773361Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2025-03-14T05:46:18.5774350Z Compiling xla/service/conditional_simplifier.cc; 13s local 2025-03-14T05:46:18.5775344Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local 2025-03-14T05:46:18.5776418Z Compiling xla/service/dynamic_padder.cc; 11s local 2025-03-14T05:46:18.5777286Z Compiling xla/service/gather_expander.cc; 10s local ... 2025-03-14T05:46:18.8593303Z 2025-03-14T05:46:18.8594102Z  2025-03-14T05:46:18.8594569Z  2025-03-14T05:46:18.8594954Z  2025-03-14T05:46:18.8595347Z  2025-03-14T05:46:18.8595738Z  2025-03-14T05:46:18.8596122Z  2025-03-14T05:46:18.8596511Z  2025-03-14T05:46:18.8596862Z  2025-03-14T05:46:18.8597424Z [12,824 / 15,235] 48 actions, 47 running 2025-03-14T05:46:18.8598689Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2025-03-14T05:46:18.8599703Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 15s local 2025-03-14T05:46:18.8600793Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T05:46:18.8601901Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2025-03-14T05:46:18.8602854Z Compiling xla/service/conditional_simplifier.cc; 13s local 2025-03-14T05:46:18.8603727Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local 2025-03-14T05:46:18.8604774Z Compiling xla/service/dynamic_padder.cc; 12s local 2025-03-14T05:46:18.8605528Z Compiling xla/service/gather_expander.cc; 11s local ... 2025-03-14T05:46:19.0608572Z 2025-03-14T05:46:19.0609303Z  2025-03-14T05:46:19.0609800Z  2025-03-14T05:46:19.0610247Z  2025-03-14T05:46:19.0610686Z  2025-03-14T05:46:19.0611113Z  2025-03-14T05:46:19.0611545Z  2025-03-14T05:46:19.0611984Z  2025-03-14T05:46:19.0612460Z  2025-03-14T05:46:19.0613110Z [12,826 / 15,235] 48 actions, 47 running 2025-03-14T05:46:19.0614068Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2025-03-14T05:46:19.0615187Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 15s local 2025-03-14T05:46:19.0616173Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T05:46:19.0617155Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2025-03-14T05:46:19.0618044Z Compiling xla/service/conditional_simplifier.cc; 13s local 2025-03-14T05:46:19.0618834Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 13s local 2025-03-14T05:46:19.0619559Z Compiling xla/service/dynamic_padder.cc; 12s local 2025-03-14T05:46:19.0620244Z Compiling xla/service/gather_expander.cc; 11s local ... 2025-03-14T05:46:19.3773127Z 2025-03-14T05:46:19.3773997Z  2025-03-14T05:46:19.3774472Z  2025-03-14T05:46:19.3774882Z  2025-03-14T05:46:19.3775305Z  2025-03-14T05:46:19.3775687Z  2025-03-14T05:46:19.3776444Z  2025-03-14T05:46:19.3776837Z  2025-03-14T05:46:19.3777230Z  2025-03-14T05:46:19.3777814Z [12,827 / 15,235] 48 actions running 2025-03-14T05:46:19.3778666Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2025-03-14T05:46:19.3779692Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint8.cc; 16s local 2025-03-14T05:46:19.3780801Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T05:46:19.3781922Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2025-03-14T05:46:19.3782920Z Compiling xla/service/conditional_simplifier.cc; 14s local 2025-03-14T05:46:19.3783832Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local 2025-03-14T05:46:19.3784710Z Compiling xla/service/dynamic_padder.cc; 12s local 2025-03-14T05:46:19.3785504Z Compiling xla/service/gather_expander.cc; 11s local ... 2025-03-14T05:46:19.6661585Z 2025-03-14T05:46:19.6662427Z  2025-03-14T05:46:19.6662924Z  2025-03-14T05:46:19.6663312Z  2025-03-14T05:46:19.6663714Z  2025-03-14T05:46:19.6664104Z  2025-03-14T05:46:19.6664482Z  2025-03-14T05:46:19.6664855Z  2025-03-14T05:46:19.6665220Z  2025-03-14T05:46:19.6666060Z [12,830 / 15,235] 48 actions, 47 running 2025-03-14T05:46:19.6666889Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T05:46:19.6667896Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T05:46:19.6668855Z Compiling xla/service/conditional_simplifier.cc; 14s local 2025-03-14T05:46:19.6669714Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local 2025-03-14T05:46:19.6670565Z Compiling xla/service/dynamic_padder.cc; 12s local 2025-03-14T05:46:19.6671287Z Compiling xla/tools/hlo_extractor.cc; 11s local 2025-03-14T05:46:19.6672464Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2025-03-14T05:46:19.6673444Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local ... 2025-03-14T05:46:19.9778454Z 2025-03-14T05:46:19.9779324Z  2025-03-14T05:46:19.9779810Z  2025-03-14T05:46:19.9780200Z  2025-03-14T05:46:19.9780576Z  2025-03-14T05:46:19.9780928Z  2025-03-14T05:46:19.9781292Z  2025-03-14T05:46:19.9781686Z  2025-03-14T05:46:19.9782056Z  2025-03-14T05:46:19.9782592Z [12,830 / 15,235] 48 actions running 2025-03-14T05:46:19.9783422Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T05:46:19.9784453Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2025-03-14T05:46:19.9785455Z Compiling xla/service/conditional_simplifier.cc; 14s local 2025-03-14T05:46:19.9786382Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local 2025-03-14T05:46:19.9787239Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T05:46:19.9787990Z Compiling xla/tools/hlo_extractor.cc; 11s local 2025-03-14T05:46:19.9788723Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2025-03-14T05:46:19.9789601Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local ... 2025-03-14T05:46:20.2240456Z 2025-03-14T05:46:20.2241275Z  2025-03-14T05:46:20.2241768Z  2025-03-14T05:46:20.2242144Z  2025-03-14T05:46:20.2242497Z  2025-03-14T05:46:20.2242848Z  2025-03-14T05:46:20.2243210Z  2025-03-14T05:46:20.2243562Z  2025-03-14T05:46:20.2243876Z  2025-03-14T05:46:20.2244397Z [12,831 / 15,235] 48 actions, 47 running 2025-03-14T05:46:20.2245235Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T05:46:20.2246095Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2025-03-14T05:46:20.2246964Z Compiling xla/service/conditional_simplifier.cc; 15s local 2025-03-14T05:46:20.2247812Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 14s local 2025-03-14T05:46:20.2248993Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T05:46:20.2249699Z Compiling xla/tools/hlo_extractor.cc; 12s local 2025-03-14T05:46:20.2250516Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2025-03-14T05:46:20.2251438Z Compiling xla/service/conditional_to_select.cc; 10s local ... 2025-03-14T05:46:20.5784222Z 2025-03-14T05:46:20.5785068Z  2025-03-14T05:46:20.5785520Z  2025-03-14T05:46:20.5786061Z  2025-03-14T05:46:20.5786492Z  2025-03-14T05:46:20.5786875Z  2025-03-14T05:46:20.5787257Z  2025-03-14T05:46:20.5787671Z  2025-03-14T05:46:20.5788072Z  2025-03-14T05:46:20.5788640Z [12,831 / 15,235] 48 actions running 2025-03-14T05:46:20.5789521Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T05:46:20.5790559Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2025-03-14T05:46:20.5791622Z Compiling xla/service/conditional_simplifier.cc; 15s local 2025-03-14T05:46:20.5792600Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local 2025-03-14T05:46:20.5793479Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T05:46:20.5794399Z Compiling xla/tools/hlo_extractor.cc; 12s local 2025-03-14T05:46:20.5795299Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2025-03-14T05:46:20.5796262Z Compiling xla/service/conditional_to_select.cc; 10s local ... 2025-03-14T05:46:20.9592390Z 2025-03-14T05:46:20.9593263Z  2025-03-14T05:46:20.9593707Z  2025-03-14T05:46:20.9594104Z  2025-03-14T05:46:20.9594494Z  2025-03-14T05:46:20.9594877Z  2025-03-14T05:46:20.9595291Z  2025-03-14T05:46:20.9595701Z  2025-03-14T05:46:20.9596098Z  2025-03-14T05:46:20.9596685Z [12,834 / 15,235] 48 actions, 47 running 2025-03-14T05:46:20.9597908Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2025-03-14T05:46:20.9599028Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2025-03-14T05:46:20.9600105Z Compiling xla/service/conditional_simplifier.cc; 15s local 2025-03-14T05:46:20.9601070Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local 2025-03-14T05:46:20.9601946Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T05:46:20.9602713Z Compiling xla/tools/hlo_extractor.cc; 12s local 2025-03-14T05:46:20.9603612Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2025-03-14T05:46:20.9604866Z Compiling xla/service/conditional_to_select.cc; 10s local ... 2025-03-14T05:46:21.1604086Z 2025-03-14T05:46:21.1605019Z  2025-03-14T05:46:21.1605556Z  2025-03-14T05:46:21.1605981Z  2025-03-14T05:46:21.1606404Z  2025-03-14T05:46:21.1606818Z  2025-03-14T05:46:21.1607234Z  2025-03-14T05:46:21.1607661Z  2025-03-14T05:46:21.1608055Z  2025-03-14T05:46:21.1608728Z [12,837 / 15,235] 48 actions, 47 running 2025-03-14T05:46:21.1609609Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2025-03-14T05:46:21.1610695Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2025-03-14T05:46:21.1611779Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 15s local 2025-03-14T05:46:21.1612707Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T05:46:21.1613491Z Compiling xla/tools/hlo_extractor.cc; 13s local 2025-03-14T05:46:21.1614361Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2025-03-14T05:46:21.1615330Z Compiling xla/service/conditional_to_select.cc; 11s local 2025-03-14T05:46:21.1616213Z Compiling xla/service/scatter_utils.cc; 10s local ... 2025-03-14T05:46:21.3790116Z 2025-03-14T05:46:21.3790989Z  2025-03-14T05:46:21.3791479Z  2025-03-14T05:46:21.3791901Z  2025-03-14T05:46:21.3792319Z  2025-03-14T05:46:21.3792752Z  2025-03-14T05:46:21.3793188Z  2025-03-14T05:46:21.3793610Z  2025-03-14T05:46:21.3794402Z  2025-03-14T05:46:21.3794997Z [12,838 / 15,235] 48 actions running 2025-03-14T05:46:21.3795894Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2025-03-14T05:46:21.3797453Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2025-03-14T05:46:21.3798553Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2025-03-14T05:46:21.3799511Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T05:46:21.3800438Z Compiling xla/tools/hlo_extractor.cc; 13s local 2025-03-14T05:46:21.3801501Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T05:46:21.3802613Z Compiling xla/service/conditional_to_select.cc; 11s local 2025-03-14T05:46:21.3803606Z Compiling xla/service/scatter_utils.cc; 10s local ... 2025-03-14T05:46:21.6433157Z 2025-03-14T05:46:21.6434051Z  2025-03-14T05:46:21.6434589Z  2025-03-14T05:46:21.6435013Z  2025-03-14T05:46:21.6435489Z  2025-03-14T05:46:21.6435881Z  2025-03-14T05:46:21.6436282Z  2025-03-14T05:46:21.6436677Z  2025-03-14T05:46:21.6437076Z  2025-03-14T05:46:21.6437680Z [12,840 / 15,235] 48 actions, 47 running 2025-03-14T05:46:21.6438574Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T05:46:21.6439696Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2025-03-14T05:46:21.6440794Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2025-03-14T05:46:21.6441743Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T05:46:21.6442574Z Compiling xla/tools/hlo_extractor.cc; 13s local 2025-03-14T05:46:21.6443548Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T05:46:21.6444736Z Compiling xla/service/conditional_to_select.cc; 11s local 2025-03-14T05:46:21.6446006Z Compiling xla/service/scatter_utils.cc; 11s local ... 2025-03-14T05:46:21.9359423Z 2025-03-14T05:46:21.9360352Z  2025-03-14T05:46:21.9360851Z  2025-03-14T05:46:21.9361258Z  2025-03-14T05:46:21.9361672Z  2025-03-14T05:46:21.9362072Z  2025-03-14T05:46:21.9362484Z  2025-03-14T05:46:21.9362891Z  2025-03-14T05:46:21.9363804Z  2025-03-14T05:46:21.9364718Z [12,843 / 15,235] 48 actions, 47 running 2025-03-14T05:46:21.9366087Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T05:46:21.9367303Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T05:46:21.9368519Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2025-03-14T05:46:21.9369471Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T05:46:21.9370380Z Compiling xla/tools/hlo_extractor.cc; 13s local 2025-03-14T05:46:21.9371436Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T05:46:21.9372519Z Compiling xla/service/scatter_utils.cc; 11s local 2025-03-14T05:46:21.9373492Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local ... 2025-03-14T05:46:22.1798146Z 2025-03-14T05:46:22.1799859Z  2025-03-14T05:46:22.1800323Z  2025-03-14T05:46:22.1800699Z  2025-03-14T05:46:22.1801059Z  2025-03-14T05:46:22.1801433Z  2025-03-14T05:46:22.1801818Z  2025-03-14T05:46:22.1802200Z  2025-03-14T05:46:22.1802568Z  2025-03-14T05:46:22.1803141Z [12,845 / 15,235] 48 actions running 2025-03-14T05:46:22.1803994Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T05:46:22.1805159Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T05:46:22.1806168Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 16s local 2025-03-14T05:46:22.1807038Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T05:46:22.1807816Z Compiling xla/tools/hlo_extractor.cc; 14s local 2025-03-14T05:46:22.1808843Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T05:46:22.1810215Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2025-03-14T05:46:22.1811151Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 11s local ... 2025-03-14T05:46:22.5094716Z 2025-03-14T05:46:22.5095519Z  2025-03-14T05:46:22.5096025Z  2025-03-14T05:46:22.5096454Z  2025-03-14T05:46:22.5096867Z  2025-03-14T05:46:22.5097303Z  2025-03-14T05:46:22.5097720Z  2025-03-14T05:46:22.5098147Z  2025-03-14T05:46:22.5098574Z  2025-03-14T05:46:22.5099198Z [12,846 / 15,235] 48 actions, 47 running 2025-03-14T05:46:22.5100085Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T05:46:22.5101180Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T05:46:22.5102301Z Compiling xla/hlo/analysis/indexed_array_analysis.cc; 17s local 2025-03-14T05:46:22.5103255Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T05:46:22.5103954Z Compiling xla/tools/hlo_extractor.cc; 14s local 2025-03-14T05:46:22.5104839Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T05:46:22.5105844Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local 2025-03-14T05:46:22.5106706Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 11s local ... 2025-03-14T05:46:22.7128939Z 2025-03-14T05:46:22.7129823Z  2025-03-14T05:46:22.7130334Z  2025-03-14T05:46:22.7130742Z  2025-03-14T05:46:22.7131151Z  2025-03-14T05:46:22.7131574Z  2025-03-14T05:46:22.7132001Z  2025-03-14T05:46:22.7132427Z  2025-03-14T05:46:22.7132856Z  2025-03-14T05:46:22.7133508Z [12,848 / 15,235] 48 actions, 47 running 2025-03-14T05:46:22.7134456Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2025-03-14T05:46:22.7135936Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T05:46:22.7136966Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T05:46:22.7137779Z Compiling xla/tools/hlo_extractor.cc; 14s local 2025-03-14T05:46:22.7138727Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T05:46:22.7139768Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2025-03-14T05:46:22.7140735Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 11s local 2025-03-14T05:46:22.7141787Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local ... 2025-03-14T05:46:22.9805050Z 2025-03-14T05:46:22.9805852Z  2025-03-14T05:46:22.9806263Z  2025-03-14T05:46:22.9806605Z  2025-03-14T05:46:22.9806963Z  2025-03-14T05:46:22.9807315Z  2025-03-14T05:46:22.9807725Z  2025-03-14T05:46:22.9808125Z  2025-03-14T05:46:22.9808521Z  2025-03-14T05:46:22.9809046Z [12,848 / 15,235] 48 actions running 2025-03-14T05:46:22.9809939Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2025-03-14T05:46:22.9811023Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T05:46:22.9811975Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T05:46:22.9812751Z Compiling xla/tools/hlo_extractor.cc; 14s local 2025-03-14T05:46:22.9813679Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T05:46:22.9814626Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2025-03-14T05:46:22.9815690Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 12s local 2025-03-14T05:46:22.9816766Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local ... 2025-03-14T05:46:23.3247418Z 2025-03-14T05:46:23.3248249Z  2025-03-14T05:46:23.3248679Z  2025-03-14T05:46:23.3249052Z  2025-03-14T05:46:23.3249422Z  2025-03-14T05:46:23.3249789Z  2025-03-14T05:46:23.3250150Z  2025-03-14T05:46:23.3250513Z  2025-03-14T05:46:23.3250973Z  2025-03-14T05:46:23.3251586Z [12,849 / 15,235] 48 actions, 47 running 2025-03-14T05:46:23.3252785Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2025-03-14T05:46:23.3253792Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T05:46:23.3254755Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T05:46:23.3255437Z Compiling xla/tools/hlo_extractor.cc; 15s local 2025-03-14T05:46:23.3256300Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T05:46:23.3257177Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2025-03-14T05:46:23.3258074Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 12s local 2025-03-14T05:46:23.3259069Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local ... 2025-03-14T05:46:23.5811316Z 2025-03-14T05:46:23.5812142Z  2025-03-14T05:46:23.5812532Z  2025-03-14T05:46:23.5812833Z  2025-03-14T05:46:23.5813157Z  2025-03-14T05:46:23.5813575Z  2025-03-14T05:46:23.5813940Z  2025-03-14T05:46:23.5814304Z  2025-03-14T05:46:23.5814654Z  2025-03-14T05:46:23.5815167Z [12,851 / 15,235] 48 actions running 2025-03-14T05:46:23.5815942Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2025-03-14T05:46:23.5816884Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T05:46:23.5817746Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T05:46:23.5818418Z Compiling xla/tools/hlo_extractor.cc; 15s local 2025-03-14T05:46:23.5819229Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T05:46:23.5820098Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2025-03-14T05:46:23.5820885Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 12s local 2025-03-14T05:46:23.5821787Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local ... 2025-03-14T05:46:23.9817323Z 2025-03-14T05:46:23.9818479Z  2025-03-14T05:46:23.9818945Z  2025-03-14T05:46:23.9819346Z  2025-03-14T05:46:23.9819718Z  2025-03-14T05:46:23.9820070Z  2025-03-14T05:46:23.9820442Z  2025-03-14T05:46:23.9820810Z  2025-03-14T05:46:23.9821175Z  2025-03-14T05:46:23.9821691Z [12,854 / 15,235] 48 actions running 2025-03-14T05:46:23.9822447Z Compiling xla/service/dynamic_dimension_inference.cc; 22s local 2025-03-14T05:46:23.9823329Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T05:46:23.9824127Z Compiling xla/service/dynamic_padder.cc; 17s local 2025-03-14T05:46:23.9824772Z Compiling xla/tools/hlo_extractor.cc; 15s local 2025-03-14T05:46:23.9825522Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T05:46:23.9826336Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2025-03-14T05:46:23.9827094Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local 2025-03-14T05:46:23.9827950Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local ... 2025-03-14T05:46:24.3291118Z 2025-03-14T05:46:24.3291939Z  2025-03-14T05:46:24.3292418Z  2025-03-14T05:46:24.3292806Z  2025-03-14T05:46:24.3293208Z  2025-03-14T05:46:24.3293592Z  2025-03-14T05:46:24.3293969Z  2025-03-14T05:46:24.3294356Z  2025-03-14T05:46:24.3294743Z  2025-03-14T05:46:24.3295344Z [12,856 / 15,235] 48 actions, 47 running 2025-03-14T05:46:24.3296203Z Compiling xla/service/dynamic_dimension_inference.cc; 22s local 2025-03-14T05:46:24.3297219Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T05:46:24.3298164Z Compiling xla/service/dynamic_padder.cc; 17s local 2025-03-14T05:46:24.3298893Z Compiling xla/tools/hlo_extractor.cc; 16s local 2025-03-14T05:46:24.3299747Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T05:46:24.3300743Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2025-03-14T05:46:24.3301622Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local 2025-03-14T05:46:24.3303090Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local ... 2025-03-14T05:46:24.5543270Z 2025-03-14T05:46:24.5544128Z  2025-03-14T05:46:24.5544558Z  2025-03-14T05:46:24.5544909Z  2025-03-14T05:46:24.5545240Z  2025-03-14T05:46:24.5545650Z  2025-03-14T05:46:24.5546060Z  2025-03-14T05:46:24.5546466Z  2025-03-14T05:46:24.5546952Z  2025-03-14T05:46:24.5547536Z [12,857 / 15,235] 48 actions, 47 running 2025-03-14T05:46:24.5548364Z Compiling xla/service/dynamic_dimension_inference.cc; 22s local 2025-03-14T05:46:24.5549389Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T05:46:24.5550330Z Compiling xla/service/dynamic_padder.cc; 17s local 2025-03-14T05:46:24.5551069Z Compiling xla/tools/hlo_extractor.cc; 16s local 2025-03-14T05:46:24.5551968Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T05:46:24.5552919Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2025-03-14T05:46:24.5553920Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 13s local 2025-03-14T05:46:24.5554937Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local ... 2025-03-14T05:46:24.7700795Z 2025-03-14T05:46:24.7701613Z  2025-03-14T05:46:24.7702210Z  2025-03-14T05:46:24.7702594Z  2025-03-14T05:46:24.7702987Z  2025-03-14T05:46:24.7703388Z  2025-03-14T05:46:24.7703803Z  2025-03-14T05:46:24.7704221Z  2025-03-14T05:46:24.7704646Z  2025-03-14T05:46:24.7705264Z [12,860 / 15,235] 48 actions, 47 running 2025-03-14T05:46:24.7706222Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T05:46:24.7707266Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T05:46:24.7708678Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T05:46:24.7709703Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2025-03-14T05:46:24.7710626Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2025-03-14T05:46:24.7711648Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T05:46:24.7712553Z @llvm-project//llvm:Instrumentation; 10s local 2025-03-14T05:46:24.7713463Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local ... 2025-03-14T05:46:24.9824378Z 2025-03-14T05:46:24.9825232Z  2025-03-14T05:46:24.9825745Z  2025-03-14T05:46:24.9826184Z  2025-03-14T05:46:24.9826575Z  2025-03-14T05:46:24.9826961Z  2025-03-14T05:46:24.9827359Z  2025-03-14T05:46:24.9827750Z  2025-03-14T05:46:24.9828151Z  2025-03-14T05:46:24.9828697Z [12,861 / 15,235] 48 actions running 2025-03-14T05:46:24.9829697Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T05:46:24.9830714Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T05:46:24.9831595Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T05:46:24.9832494Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2025-03-14T05:46:24.9833295Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2025-03-14T05:46:24.9834178Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T05:46:24.9835060Z @llvm-project//llvm:Instrumentation; 10s local 2025-03-14T05:46:24.9835892Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local ... 2025-03-14T05:46:25.2452982Z 2025-03-14T05:46:25.2454045Z  2025-03-14T05:46:25.2454542Z  2025-03-14T05:46:25.2454977Z  2025-03-14T05:46:25.2455405Z  2025-03-14T05:46:25.2455828Z  2025-03-14T05:46:25.2456250Z  2025-03-14T05:46:25.2456657Z  2025-03-14T05:46:25.2457063Z  2025-03-14T05:46:25.2457720Z [12,864 / 15,235] 48 actions, 47 running 2025-03-14T05:46:25.2458672Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T05:46:25.2461271Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T05:46:25.2462216Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2025-03-14T05:46:25.2463115Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2025-03-14T05:46:25.2464084Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T05:46:25.2464990Z @llvm-project//llvm:Instrumentation; 11s local 2025-03-14T05:46:25.2466125Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 10s local 2025-03-14T05:46:25.2467122Z Compiling .../memory_space_assignment/cost_analysis.cc; 10s local ... 2025-03-14T05:46:25.4996875Z 2025-03-14T05:46:25.4997692Z  2025-03-14T05:46:25.4998303Z  2025-03-14T05:46:25.4998725Z  2025-03-14T05:46:25.4999152Z  2025-03-14T05:46:25.4999616Z  2025-03-14T05:46:25.5000030Z  2025-03-14T05:46:25.5000505Z  2025-03-14T05:46:25.5000931Z  2025-03-14T05:46:25.5001543Z [12,866 / 15,235] 48 actions, 47 running 2025-03-14T05:46:25.5002523Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T05:46:25.5003541Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T05:46:25.5004642Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2025-03-14T05:46:25.5005589Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local 2025-03-14T05:46:25.5006632Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T05:46:25.5007603Z @llvm-project//llvm:Instrumentation; 11s local 2025-03-14T05:46:25.5008499Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2025-03-14T05:46:25.5009489Z Compiling .../memory_space_assignment/cost_analysis.cc; 10s local ... 2025-03-14T05:46:25.7831341Z 2025-03-14T05:46:25.7832225Z  2025-03-14T05:46:25.7832709Z  2025-03-14T05:46:25.7833493Z  2025-03-14T05:46:25.7833922Z  2025-03-14T05:46:25.7834344Z  2025-03-14T05:46:25.7834735Z  2025-03-14T05:46:25.7835175Z  2025-03-14T05:46:25.7835709Z  2025-03-14T05:46:25.7836269Z [12,867 / 15,235] 48 actions running 2025-03-14T05:46:25.7837239Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T05:46:25.7838192Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T05:46:25.7838976Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 15s local 2025-03-14T05:46:25.7839867Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local 2025-03-14T05:46:25.7840836Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T05:46:25.7841746Z @llvm-project//llvm:Instrumentation; 11s local 2025-03-14T05:46:25.7842621Z Compiling llvm/lib/Transforms/Utils/LoopUtils.cpp; 11s local 2025-03-14T05:46:25.7843625Z Compiling .../memory_space_assignment/cost_analysis.cc; 11s local ... 2025-03-14T05:46:26.0728986Z 2025-03-14T05:46:26.0729805Z  2025-03-14T05:46:26.0730337Z  2025-03-14T05:46:26.0730784Z  2025-03-14T05:46:26.0731201Z  2025-03-14T05:46:26.0731609Z  2025-03-14T05:46:26.0732021Z  2025-03-14T05:46:26.0732416Z  2025-03-14T05:46:26.0732818Z  2025-03-14T05:46:26.0733411Z [12,872 / 15,235] 48 actions, 47 running 2025-03-14T05:46:26.0734319Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T05:46:26.0735329Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T05:46:26.0736269Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local 2025-03-14T05:46:26.0737198Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T05:46:26.0737981Z @llvm-project//llvm:Instrumentation; 12s local 2025-03-14T05:46:26.0738894Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 11s local 2025-03-14T05:46:26.0739933Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2025-03-14T05:46:26.0741399Z Compiling xla/service/while_loop_constant_sinking.cc; 10s local ... 2025-03-14T05:46:26.2831045Z 2025-03-14T05:46:26.2831902Z  2025-03-14T05:46:26.2832396Z  2025-03-14T05:46:26.2832803Z  2025-03-14T05:46:26.2833206Z  2025-03-14T05:46:26.2833606Z  2025-03-14T05:46:26.2834003Z  2025-03-14T05:46:26.2834368Z  2025-03-14T05:46:26.2834767Z  2025-03-14T05:46:26.2835353Z [12,875 / 15,235] 48 actions, 47 running 2025-03-14T05:46:26.2836250Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T05:46:26.2837123Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T05:46:26.2838093Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local 2025-03-14T05:46:26.2838947Z @llvm-project//llvm:Instrumentation; 12s local 2025-03-14T05:46:26.2839932Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 11s local 2025-03-14T05:46:26.2841039Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2025-03-14T05:46:26.2842078Z Compiling xla/service/while_loop_constant_sinking.cc; 10s local 2025-03-14T05:46:26.2843071Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local ... 2025-03-14T05:46:26.5838297Z 2025-03-14T05:46:26.5839178Z  2025-03-14T05:46:26.5839662Z  2025-03-14T05:46:26.5840049Z  2025-03-14T05:46:26.5840431Z  2025-03-14T05:46:26.5840811Z  2025-03-14T05:46:26.5841201Z  2025-03-14T05:46:26.5841671Z  2025-03-14T05:46:26.5842041Z  2025-03-14T05:46:26.5842504Z [12,875 / 15,235] 48 actions running 2025-03-14T05:46:26.5843283Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T05:46:26.5844305Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T05:46:26.5845243Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local 2025-03-14T05:46:26.5846545Z @llvm-project//llvm:Instrumentation; 12s local 2025-03-14T05:46:26.5847498Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 12s local 2025-03-14T05:46:26.5848593Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 11s local 2025-03-14T05:46:26.5849555Z Compiling xla/service/while_loop_constant_sinking.cc; 10s local 2025-03-14T05:46:26.5850479Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local ... 2025-03-14T05:46:26.7842543Z 2025-03-14T05:46:26.7843404Z  2025-03-14T05:46:26.7843951Z  2025-03-14T05:46:26.7844423Z  2025-03-14T05:46:26.7845002Z  2025-03-14T05:46:26.7845463Z  2025-03-14T05:46:26.7845927Z  2025-03-14T05:46:26.7856282Z  2025-03-14T05:46:26.7857178Z  2025-03-14T05:46:26.7857774Z [12,876 / 15,235] 48 actions, 47 running 2025-03-14T05:46:26.7858678Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T05:46:26.7859733Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2025-03-14T05:46:26.7860612Z @llvm-project//llvm:Instrumentation; 12s local 2025-03-14T05:46:26.7861557Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 12s local 2025-03-14T05:46:26.7862619Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2025-03-14T05:46:26.7863601Z Compiling xla/service/while_loop_constant_sinking.cc; 11s local 2025-03-14T05:46:26.7864599Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2025-03-14T05:46:26.7865790Z Compiling llvm/lib/Analysis/LoopInfo.cpp; 9s local ... 2025-03-14T05:46:27.1277551Z 2025-03-14T05:46:27.1278516Z  2025-03-14T05:46:27.1279006Z  2025-03-14T05:46:27.1279537Z  2025-03-14T05:46:27.1279922Z  2025-03-14T05:46:27.1280307Z  2025-03-14T05:46:27.1280666Z  2025-03-14T05:46:27.1281060Z  2025-03-14T05:46:27.1281480Z  2025-03-14T05:46:27.1282119Z [12,878 / 15,235] 48 actions, 47 running 2025-03-14T05:46:27.1283093Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T05:46:27.1284713Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2025-03-14T05:46:27.1285585Z @llvm-project//llvm:Instrumentation; 13s local 2025-03-14T05:46:27.1286599Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 12s local 2025-03-14T05:46:27.1287661Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2025-03-14T05:46:27.1288796Z Compiling xla/service/while_loop_constant_sinking.cc; 11s local 2025-03-14T05:46:27.1289762Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2025-03-14T05:46:27.1290811Z Compiling xla/service/memory_space_assignment/simulator.cc; 9s local ... 2025-03-14T05:46:27.3850877Z 2025-03-14T05:46:27.3851725Z  2025-03-14T05:46:27.3852221Z  2025-03-14T05:46:27.3852632Z  2025-03-14T05:46:27.3853103Z  2025-03-14T05:46:27.3853511Z  2025-03-14T05:46:27.3853885Z  2025-03-14T05:46:27.3854305Z  2025-03-14T05:46:27.3854733Z  2025-03-14T05:46:27.3855420Z [12,878 / 15,235] 48 actions running 2025-03-14T05:46:27.3856361Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T05:46:27.3857413Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2025-03-14T05:46:27.3858290Z @llvm-project//llvm:Instrumentation; 13s local 2025-03-14T05:46:27.3859240Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 12s local 2025-03-14T05:46:27.3860405Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2025-03-14T05:46:27.3861462Z Compiling xla/service/while_loop_constant_sinking.cc; 11s local 2025-03-14T05:46:27.3862529Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T05:46:27.3863565Z Compiling xla/service/memory_space_assignment/simulator.cc; 10s local ... 2025-03-14T05:46:27.6195747Z 2025-03-14T05:46:27.6196625Z  2025-03-14T05:46:27.6197590Z  2025-03-14T05:46:27.6197944Z  2025-03-14T05:46:27.6198357Z  2025-03-14T05:46:27.6198729Z  2025-03-14T05:46:27.6199119Z  2025-03-14T05:46:27.6199526Z  2025-03-14T05:46:27.6199920Z  2025-03-14T05:46:27.6200462Z [12,879 / 15,235] 48 actions, 47 running 2025-03-14T05:46:27.6201271Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T05:46:27.6202145Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local 2025-03-14T05:46:27.6203000Z @llvm-project//llvm:Instrumentation; 13s local 2025-03-14T05:46:27.6203933Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 13s local 2025-03-14T05:46:27.6205136Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 12s local 2025-03-14T05:46:27.6206116Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T05:46:27.6207144Z Compiling xla/service/memory_space_assignment/simulator.cc; 10s local 2025-03-14T05:46:27.6208337Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local ... 2025-03-14T05:46:27.9855929Z 2025-03-14T05:46:27.9856716Z  2025-03-14T05:46:27.9857157Z  2025-03-14T05:46:27.9857530Z  2025-03-14T05:46:27.9857949Z  2025-03-14T05:46:27.9858320Z  2025-03-14T05:46:27.9858719Z  2025-03-14T05:46:27.9859104Z  2025-03-14T05:46:27.9859447Z  2025-03-14T05:46:27.9859947Z [12,882 / 15,235] 48 actions running 2025-03-14T05:46:27.9860715Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T05:46:27.9861653Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2025-03-14T05:46:27.9862451Z @llvm-project//llvm:Instrumentation; 13s local 2025-03-14T05:46:27.9863270Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 13s local 2025-03-14T05:46:27.9864351Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2025-03-14T05:46:27.9865211Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T05:46:27.9866810Z Compiling xla/service/memory_space_assignment/simulator.cc; 10s local 2025-03-14T05:46:27.9867772Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local ... 2025-03-14T05:46:28.2174976Z 2025-03-14T05:46:28.2175782Z  2025-03-14T05:46:28.2176259Z  2025-03-14T05:46:28.2176665Z  2025-03-14T05:46:28.2177060Z  2025-03-14T05:46:28.2177473Z  2025-03-14T05:46:28.2177868Z  2025-03-14T05:46:28.2178274Z  2025-03-14T05:46:28.2178647Z  2025-03-14T05:46:28.2179232Z [12,883 / 15,235] 48 actions, 47 running 2025-03-14T05:46:28.2180119Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T05:46:28.2181091Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local 2025-03-14T05:46:28.2181879Z @llvm-project//llvm:Instrumentation; 14s local 2025-03-14T05:46:28.2182824Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 13s local 2025-03-14T05:46:28.2183883Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2025-03-14T05:46:28.2184867Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T05:46:28.2185808Z Compiling xla/service/memory_space_assignment/simulator.cc; 10s local 2025-03-14T05:46:28.2186795Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 9s local ... 2025-03-14T05:46:28.4584167Z 2025-03-14T05:46:28.4585021Z  2025-03-14T05:46:28.4585575Z  2025-03-14T05:46:28.4585974Z  2025-03-14T05:46:28.4586336Z  2025-03-14T05:46:28.4586719Z  2025-03-14T05:46:28.4587128Z  2025-03-14T05:46:28.4587509Z  2025-03-14T05:46:28.4587867Z  2025-03-14T05:46:28.4588409Z [12,885 / 15,235] 48 actions, 47 running 2025-03-14T05:46:28.4589255Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T05:46:28.4590224Z @llvm-project//llvm:Instrumentation; 14s local 2025-03-14T05:46:28.4591658Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 13s local 2025-03-14T05:46:28.4592841Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local 2025-03-14T05:46:28.4593845Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T05:46:28.4594896Z Compiling xla/service/memory_space_assignment/simulator.cc; 11s local 2025-03-14T05:46:28.4595961Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2025-03-14T05:46:28.4596977Z @xla//xla/hlo/evaluator:hlo_evaluator; 8s local ... 2025-03-14T05:46:28.7862924Z 2025-03-14T05:46:28.7863824Z  2025-03-14T05:46:28.7864336Z  2025-03-14T05:46:28.7864737Z  2025-03-14T05:46:28.7865134Z  2025-03-14T05:46:28.7865770Z  2025-03-14T05:46:28.7866183Z  2025-03-14T05:46:28.7866557Z  2025-03-14T05:46:28.7866964Z  2025-03-14T05:46:28.7867501Z [12,886 / 15,235] 48 actions running 2025-03-14T05:46:28.7868390Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T05:46:28.7869387Z @llvm-project//llvm:Instrumentation; 14s local 2025-03-14T05:46:28.7870330Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2025-03-14T05:46:28.7871366Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2025-03-14T05:46:28.7872264Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T05:46:28.7873206Z Compiling xla/service/memory_space_assignment/simulator.cc; 11s local 2025-03-14T05:46:28.7874232Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2025-03-14T05:46:28.7875119Z @xla//xla/hlo/evaluator:hlo_evaluator; 9s local ... 2025-03-14T05:46:29.1271285Z 2025-03-14T05:46:29.1272113Z  2025-03-14T05:46:29.1272618Z  2025-03-14T05:46:29.1272995Z  2025-03-14T05:46:29.1273396Z  2025-03-14T05:46:29.1273773Z  2025-03-14T05:46:29.1274160Z  2025-03-14T05:46:29.1274562Z  2025-03-14T05:46:29.1275107Z  2025-03-14T05:46:29.1276100Z [12,888 / 15,235] 48 actions, 47 running 2025-03-14T05:46:29.1276995Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T05:46:29.1277919Z @llvm-project//llvm:Instrumentation; 15s local 2025-03-14T05:46:29.1278789Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2025-03-14T05:46:29.1279771Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2025-03-14T05:46:29.1280704Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T05:46:29.1281668Z Compiling xla/service/memory_space_assignment/simulator.cc; 11s local 2025-03-14T05:46:29.1282712Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2025-03-14T05:46:29.1283629Z @xla//xla/hlo/evaluator:hlo_evaluator; 9s local ... 2025-03-14T05:46:29.3320090Z 2025-03-14T05:46:29.3320879Z  2025-03-14T05:46:29.3321351Z  2025-03-14T05:46:29.3321778Z  2025-03-14T05:46:29.3322157Z  2025-03-14T05:46:29.3322525Z  2025-03-14T05:46:29.3322898Z  2025-03-14T05:46:29.3323281Z  2025-03-14T05:46:29.3323671Z  2025-03-14T05:46:29.3324268Z [12,902 / 15,235] 48 actions, 47 running 2025-03-14T05:46:29.3325342Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T05:46:29.3326458Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2025-03-14T05:46:29.3327514Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2025-03-14T05:46:29.3328459Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T05:46:29.3329484Z Compiling xla/service/memory_space_assignment/simulator.cc; 12s local 2025-03-14T05:46:29.3330521Z Compiling llvm/lib/Transforms/Utils/SimplifyLibCalls.cpp; 10s local 2025-03-14T05:46:29.3331570Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 9s local 2025-03-14T05:46:29.3332991Z Compiling xla/service/select_and_scatter_expander.cc; 9s local ... 2025-03-14T05:46:29.5404125Z 2025-03-14T05:46:29.5405141Z  2025-03-14T05:46:29.5405617Z  2025-03-14T05:46:29.5406026Z  2025-03-14T05:46:29.5406417Z  2025-03-14T05:46:29.5406835Z  2025-03-14T05:46:29.5407213Z  2025-03-14T05:46:29.5407620Z  2025-03-14T05:46:29.5408017Z  2025-03-14T05:46:29.5408612Z [12,915 / 15,235] 48 actions, 47 running 2025-03-14T05:46:29.5409527Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T05:46:29.5410595Z Compiling xla/service/memory_space_assignment/cost_analysis.cc; 14s local 2025-03-14T05:46:29.5411622Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2025-03-14T05:46:29.5412581Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T05:46:29.5413548Z Compiling xla/service/memory_space_assignment/simulator.cc; 12s local 2025-03-14T05:46:29.5414656Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 10s local 2025-03-14T05:46:29.5415803Z Compiling xla/service/select_and_scatter_expander.cc; 9s local 2025-03-14T05:46:29.5416665Z Compiling xla/service/scatter_expander.cc; 8s local ... 2025-03-14T05:46:29.7815235Z 2025-03-14T05:46:29.7816037Z  2025-03-14T05:46:29.7816494Z  2025-03-14T05:46:29.7816875Z  2025-03-14T05:46:29.7817247Z  2025-03-14T05:46:29.7817630Z  2025-03-14T05:46:29.7818025Z  2025-03-14T05:46:29.7818408Z  2025-03-14T05:46:29.7818779Z  2025-03-14T05:46:29.7819364Z [12,923 / 15,235] 48 actions, 47 running 2025-03-14T05:46:29.7820279Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T05:46:29.7821330Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T05:46:29.7822297Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T05:46:29.7823358Z Compiling xla/service/memory_space_assignment/simulator.cc; 12s local 2025-03-14T05:46:29.7824839Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 10s local 2025-03-14T05:46:29.7825854Z Compiling xla/service/select_and_scatter_expander.cc; 10s local 2025-03-14T05:46:29.7826707Z Compiling xla/service/scatter_expander.cc; 8s local 2025-03-14T05:46:29.7827457Z @llvm-project//llvm:Vectorize; 8s local ... 2025-03-14T05:46:29.9871939Z 2025-03-14T05:46:29.9872775Z  2025-03-14T05:46:29.9873209Z  2025-03-14T05:46:29.9873582Z  2025-03-14T05:46:29.9873939Z  2025-03-14T05:46:29.9874286Z  2025-03-14T05:46:29.9874638Z  2025-03-14T05:46:29.9875006Z  2025-03-14T05:46:29.9875361Z  2025-03-14T05:46:29.9875892Z [12,935 / 15,235] 48 actions running 2025-03-14T05:46:29.9876756Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T05:46:29.9877732Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T05:46:29.9878699Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T05:46:29.9879662Z Compiling xla/service/memory_space_assignment/simulator.cc; 12s local 2025-03-14T05:46:29.9880661Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 10s local 2025-03-14T05:46:29.9881564Z Compiling xla/service/select_and_scatter_expander.cc; 10s local 2025-03-14T05:46:29.9882410Z Compiling xla/service/scatter_expander.cc; 8s local 2025-03-14T05:46:29.9883314Z Compiling .../transforms/while_loop_trip_count_annotator.cc; 8s local ... 2025-03-14T05:46:30.2072931Z 2025-03-14T05:46:30.2073723Z  2025-03-14T05:46:30.2074120Z  2025-03-14T05:46:30.2074445Z  2025-03-14T05:46:30.2074759Z  2025-03-14T05:46:30.2075069Z  2025-03-14T05:46:30.2075388Z  2025-03-14T05:46:30.2075699Z  2025-03-14T05:46:30.2076011Z  2025-03-14T05:46:30.2076488Z [12,947 / 15,235] 48 actions, 47 running 2025-03-14T05:46:30.2077599Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T05:46:30.2078429Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T05:46:30.2079162Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T05:46:30.2079907Z Compiling xla/service/memory_space_assignment/simulator.cc; 12s local 2025-03-14T05:46:30.2080703Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 10s local 2025-03-14T05:46:30.2081465Z Compiling xla/service/select_and_scatter_expander.cc; 10s local 2025-03-14T05:46:30.2082106Z Compiling xla/service/scatter_expander.cc; 9s local 2025-03-14T05:46:30.2082821Z Compiling .../transforms/while_loop_trip_count_annotator.cc; 8s local ... 2025-03-14T05:46:30.4409764Z 2025-03-14T05:46:30.4410648Z  2025-03-14T05:46:30.4411110Z  2025-03-14T05:46:30.4411517Z  2025-03-14T05:46:30.4411909Z  2025-03-14T05:46:30.4412296Z  2025-03-14T05:46:30.4412670Z  2025-03-14T05:46:30.4413100Z  2025-03-14T05:46:30.4413497Z  2025-03-14T05:46:30.4414113Z [12,959 / 15,235] 48 actions, 47 running 2025-03-14T05:46:30.4415039Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T05:46:30.4416210Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T05:46:30.4417169Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 14s local 2025-03-14T05:46:30.4418160Z Compiling xla/service/memory_space_assignment/simulator.cc; 13s local 2025-03-14T05:46:30.4419215Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 10s local 2025-03-14T05:46:30.4420229Z Compiling xla/service/select_and_scatter_expander.cc; 10s local 2025-03-14T05:46:30.4421086Z Compiling xla/service/scatter_expander.cc; 9s local 2025-03-14T05:46:30.4421982Z Compiling .../transforms/while_loop_trip_count_annotator.cc; 8s local ... 2025-03-14T05:46:30.6404909Z 2025-03-14T05:46:30.6405758Z  2025-03-14T05:46:30.6406317Z  2025-03-14T05:46:30.6406727Z  2025-03-14T05:46:30.6407642Z  2025-03-14T05:46:30.6408033Z  2025-03-14T05:46:30.6408420Z  2025-03-14T05:46:30.6408800Z  2025-03-14T05:46:30.6409173Z  2025-03-14T05:46:30.6409777Z [12,974 / 15,235] 48 actions, 47 running 2025-03-14T05:46:30.6410677Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T05:46:30.6411700Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T05:46:30.6412684Z Compiling xla/service/memory_space_assignment/simulator.cc; 13s local 2025-03-14T05:46:30.6413733Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 11s local 2025-03-14T05:46:30.6414720Z Compiling xla/service/select_and_scatter_expander.cc; 10s local 2025-03-14T05:46:30.6415574Z Compiling xla/service/scatter_expander.cc; 9s local 2025-03-14T05:46:30.6416527Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 8s local 2025-03-14T05:46:30.6417676Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 8s local ... 2025-03-14T05:46:30.8446389Z 2025-03-14T05:46:30.8447202Z  2025-03-14T05:46:30.8447696Z  2025-03-14T05:46:30.8448099Z  2025-03-14T05:46:30.8448498Z  2025-03-14T05:46:30.8448883Z  2025-03-14T05:46:30.8449272Z  2025-03-14T05:46:30.8449634Z  2025-03-14T05:46:30.8450004Z  2025-03-14T05:46:30.8450593Z [12,982 / 15,235] 48 actions, 47 running 2025-03-14T05:46:30.8451490Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T05:46:30.8452545Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2025-03-14T05:46:30.8453571Z Compiling xla/service/memory_space_assignment/simulator.cc; 13s local 2025-03-14T05:46:30.8454616Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 11s local 2025-03-14T05:46:30.8455967Z Compiling xla/service/select_and_scatter_expander.cc; 11s local 2025-03-14T05:46:30.8456893Z Compiling xla/service/scatter_expander.cc; 9s local 2025-03-14T05:46:30.8457880Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 9s local 2025-03-14T05:46:30.8459012Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 8s local ... 2025-03-14T05:46:31.0558781Z 2025-03-14T05:46:31.0562656Z  2025-03-14T05:46:31.0563194Z  2025-03-14T05:46:31.0563586Z  2025-03-14T05:46:31.0563977Z  2025-03-14T05:46:31.0564380Z  2025-03-14T05:46:31.0564981Z  2025-03-14T05:46:31.0565630Z  2025-03-14T05:46:31.0566054Z  2025-03-14T05:46:31.0566679Z [12,994 / 15,235] 48 actions, 47 running 2025-03-14T05:46:31.0567603Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T05:46:31.0568657Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2025-03-14T05:46:31.0569656Z Compiling xla/service/memory_space_assignment/simulator.cc; 13s local 2025-03-14T05:46:31.0570739Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 11s local 2025-03-14T05:46:31.0571774Z Compiling xla/service/select_and_scatter_expander.cc; 11s local 2025-03-14T05:46:31.0572600Z Compiling xla/service/scatter_expander.cc; 9s local 2025-03-14T05:46:31.0573492Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 9s local 2025-03-14T05:46:31.0574777Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 8s local ... 2025-03-14T05:46:31.2783598Z 2025-03-14T05:46:31.2784674Z  2025-03-14T05:46:31.2785177Z  2025-03-14T05:46:31.2785674Z  2025-03-14T05:46:31.2786099Z  2025-03-14T05:46:31.2793292Z  2025-03-14T05:46:31.2793812Z  2025-03-14T05:46:31.2794189Z  2025-03-14T05:46:31.2794598Z  2025-03-14T05:46:31.2795210Z [13,007 / 15,235] 48 actions, 47 running 2025-03-14T05:46:31.2796172Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T05:46:31.2797575Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2025-03-14T05:46:31.2799043Z Compiling xla/service/memory_space_assignment/simulator.cc; 14s local 2025-03-14T05:46:31.2800073Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 11s local 2025-03-14T05:46:31.2801071Z Compiling xla/service/select_and_scatter_expander.cc; 11s local 2025-03-14T05:46:31.2801918Z Compiling xla/service/scatter_expander.cc; 10s local 2025-03-14T05:46:31.2802975Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 9s local 2025-03-14T05:46:31.2804171Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 8s local ... 2025-03-14T05:46:31.4881105Z 2025-03-14T05:46:31.4881965Z  2025-03-14T05:46:31.4882473Z  2025-03-14T05:46:31.4882912Z  2025-03-14T05:46:31.4883335Z  2025-03-14T05:46:31.4883759Z  2025-03-14T05:46:31.4884150Z  2025-03-14T05:46:31.4884715Z  2025-03-14T05:46:31.4885146Z  2025-03-14T05:46:31.4885836Z [13,015 / 15,235] 48 actions, 47 running 2025-03-14T05:46:31.4886826Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T05:46:31.4887991Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2025-03-14T05:46:31.4889071Z Compiling xla/service/memory_space_assignment/simulator.cc; 14s local 2025-03-14T05:46:31.4890396Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 11s local 2025-03-14T05:46:31.4891447Z Compiling xla/service/select_and_scatter_expander.cc; 11s local 2025-03-14T05:46:31.4892872Z Compiling xla/service/scatter_expander.cc; 10s local 2025-03-14T05:46:31.4893774Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 9s local 2025-03-14T05:46:31.4895197Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 8s local ... 2025-03-14T05:46:31.7042740Z 2025-03-14T05:46:31.7043577Z  2025-03-14T05:46:31.7044151Z  2025-03-14T05:46:31.7044738Z  2025-03-14T05:46:31.7045444Z  2025-03-14T05:46:31.7045835Z  2025-03-14T05:46:31.7046292Z  2025-03-14T05:46:31.7046619Z  2025-03-14T05:46:31.7047015Z  2025-03-14T05:46:31.7047651Z [13,024 / 15,235] 48 actions, 47 running 2025-03-14T05:46:31.7048609Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T05:46:31.7049680Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2025-03-14T05:46:31.7050809Z Compiling xla/service/memory_space_assignment/simulator.cc; 14s local 2025-03-14T05:46:31.7051830Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2025-03-14T05:46:31.7052863Z Compiling xla/service/select_and_scatter_expander.cc; 12s local 2025-03-14T05:46:31.7053837Z Compiling xla/service/scatter_expander.cc; 10s local 2025-03-14T05:46:31.7054805Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 9s local 2025-03-14T05:46:31.7056100Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 9s local ... 2025-03-14T05:46:31.9197200Z 2025-03-14T05:46:31.9198080Z  2025-03-14T05:46:31.9198586Z  2025-03-14T05:46:31.9198980Z  2025-03-14T05:46:31.9199341Z  2025-03-14T05:46:31.9199726Z  2025-03-14T05:46:31.9200123Z  2025-03-14T05:46:31.9200526Z  2025-03-14T05:46:31.9200922Z  2025-03-14T05:46:31.9201551Z [13,038 / 15,235] 48 actions, 47 running 2025-03-14T05:46:31.9202474Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T05:46:31.9203592Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2025-03-14T05:46:31.9204868Z Compiling xla/service/memory_space_assignment/simulator.cc; 14s local 2025-03-14T05:46:31.9205947Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2025-03-14T05:46:31.9207011Z Compiling xla/service/select_and_scatter_expander.cc; 12s local 2025-03-14T05:46:31.9207962Z Compiling xla/service/scatter_expander.cc; 10s local 2025-03-14T05:46:31.9209159Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 10s local 2025-03-14T05:46:31.9213017Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 9s local ... 2025-03-14T05:46:32.1237437Z 2025-03-14T05:46:32.1239223Z  2025-03-14T05:46:32.1241309Z  2025-03-14T05:46:32.1241724Z  2025-03-14T05:46:32.1242120Z  2025-03-14T05:46:32.1242497Z  2025-03-14T05:46:32.1242909Z  2025-03-14T05:46:32.1243318Z  2025-03-14T05:46:32.1243736Z  2025-03-14T05:46:32.1244356Z [13,051 / 15,235] 48 actions, 47 running 2025-03-14T05:46:32.1245514Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T05:46:32.1246630Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2025-03-14T05:46:32.1247760Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2025-03-14T05:46:32.1248882Z Compiling xla/service/select_and_scatter_expander.cc; 12s local 2025-03-14T05:46:32.1249895Z Compiling xla/service/scatter_expander.cc; 10s local 2025-03-14T05:46:32.1250910Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 10s local 2025-03-14T05:46:32.1252151Z Compiling llvm/lib/Analysis/MemoryDependenceAnalysis.cpp; 9s local 2025-03-14T05:46:32.1253258Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 9s local ... 2025-03-14T05:46:32.3421741Z 2025-03-14T05:46:32.3422601Z  2025-03-14T05:46:32.3423080Z  2025-03-14T05:46:32.3423524Z  2025-03-14T05:46:32.3423934Z  2025-03-14T05:46:32.3424349Z  2025-03-14T05:46:32.3424718Z  2025-03-14T05:46:32.3425124Z  2025-03-14T05:46:32.3425527Z  2025-03-14T05:46:32.3426119Z [13,059 / 15,235] 48 actions, 47 running 2025-03-14T05:46:32.3427051Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T05:46:32.3428556Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2025-03-14T05:46:32.3429617Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2025-03-14T05:46:32.3430677Z Compiling xla/service/select_and_scatter_expander.cc; 12s local 2025-03-14T05:46:32.3431521Z Compiling xla/service/scatter_expander.cc; 11s local 2025-03-14T05:46:32.3432500Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 10s local 2025-03-14T05:46:32.3433697Z Compiling xla/hlo/transforms/simplifiers/hlo_constant_folding.cc; 9s local 2025-03-14T05:46:32.3434766Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local ... 2025-03-14T05:46:32.5565799Z 2025-03-14T05:46:32.5566672Z  2025-03-14T05:46:32.5567186Z  2025-03-14T05:46:32.5567603Z  2025-03-14T05:46:32.5568027Z  2025-03-14T05:46:32.5568456Z  2025-03-14T05:46:32.5568841Z  2025-03-14T05:46:32.5569235Z  2025-03-14T05:46:32.5569633Z  2025-03-14T05:46:32.5570294Z [13,069 / 15,235] 48 actions, 47 running 2025-03-14T05:46:32.5571249Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T05:46:32.5572322Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2025-03-14T05:46:32.5573464Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2025-03-14T05:46:32.5574405Z Compiling xla/service/scatter_expander.cc; 11s local 2025-03-14T05:46:32.5575364Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 10s local 2025-03-14T05:46:32.5576609Z Compiling xla/hlo/transforms/simplifiers/hlo_constant_folding.cc; 9s local 2025-03-14T05:46:32.5577674Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local 2025-03-14T05:46:32.5578554Z Compiling llvm/lib/Analysis/MemorySSAUpdater.cpp; 7s local ... 2025-03-14T05:46:32.7668246Z 2025-03-14T05:46:32.7669163Z  2025-03-14T05:46:32.7669655Z  2025-03-14T05:46:32.7670060Z  2025-03-14T05:46:32.7670486Z  2025-03-14T05:46:32.7670900Z  2025-03-14T05:46:32.7671360Z  2025-03-14T05:46:32.7671775Z  2025-03-14T05:46:32.7672594Z  2025-03-14T05:46:32.7673207Z [13,076 / 15,235] 48 actions, 47 running 2025-03-14T05:46:32.7674155Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T05:46:32.7675261Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T05:46:32.7676356Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2025-03-14T05:46:32.7677339Z Compiling xla/service/scatter_expander.cc; 11s local 2025-03-14T05:46:32.7678379Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 10s local 2025-03-14T05:46:32.7679577Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 10s local 2025-03-14T05:46:32.7680585Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local 2025-03-14T05:46:32.7681550Z Compiling llvm/lib/Analysis/MemorySSAUpdater.cpp; 8s local ... 2025-03-14T05:46:32.9685319Z 2025-03-14T05:46:32.9686232Z  2025-03-14T05:46:32.9686868Z  2025-03-14T05:46:32.9687304Z  2025-03-14T05:46:32.9687686Z  2025-03-14T05:46:32.9688066Z  2025-03-14T05:46:32.9688435Z  2025-03-14T05:46:32.9689329Z  2025-03-14T05:46:32.9689886Z  2025-03-14T05:46:32.9690694Z [13,086 / 15,235] 48 actions, 47 running 2025-03-14T05:46:32.9691812Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T05:46:32.9693043Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T05:46:32.9694291Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2025-03-14T05:46:32.9695452Z Compiling xla/service/scatter_expander.cc; 11s local 2025-03-14T05:46:32.9696639Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 11s local 2025-03-14T05:46:32.9697866Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 10s local 2025-03-14T05:46:32.9699244Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local 2025-03-14T05:46:32.9700236Z Compiling llvm/lib/Analysis/MemorySSAUpdater.cpp; 8s local ... 2025-03-14T05:46:33.1888947Z 2025-03-14T05:46:33.1889796Z  2025-03-14T05:46:33.1890287Z  2025-03-14T05:46:33.1890690Z  2025-03-14T05:46:33.1891070Z  2025-03-14T05:46:33.1891458Z  2025-03-14T05:46:33.1891858Z  2025-03-14T05:46:33.1892241Z  2025-03-14T05:46:33.1892608Z  2025-03-14T05:46:33.1893169Z [13,094 / 15,235] 48 actions running 2025-03-14T05:46:33.1894080Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T05:46:33.1895068Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T05:46:33.1895838Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2025-03-14T05:46:33.1896540Z Compiling xla/service/scatter_expander.cc; 12s local 2025-03-14T05:46:33.1897324Z Compiling xla/hlo/transforms/while_loop_trip_count_annotator.cc; 11s local 2025-03-14T05:46:33.1898195Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 10s local 2025-03-14T05:46:33.1898973Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 8s local 2025-03-14T05:46:33.1899805Z Compiling llvm/lib/Analysis/MemorySSAUpdater.cpp; 8s local ... 2025-03-14T05:46:33.3893954Z 2025-03-14T05:46:33.3894789Z  2025-03-14T05:46:33.3895161Z  2025-03-14T05:46:33.3895473Z  2025-03-14T05:46:33.3895790Z  2025-03-14T05:46:33.3896096Z  2025-03-14T05:46:33.3896403Z  2025-03-14T05:46:33.3896722Z  2025-03-14T05:46:33.3897045Z  2025-03-14T05:46:33.3897510Z [13,101 / 15,235] 48 actions running 2025-03-14T05:46:33.3898219Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T05:46:33.3899043Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T05:46:33.3899831Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2025-03-14T05:46:33.3900592Z Compiling xla/service/scatter_expander.cc; 12s local 2025-03-14T05:46:33.3901660Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 10s local 2025-03-14T05:46:33.3902375Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T05:46:33.3903024Z Compiling llvm/lib/Analysis/MemorySSAUpdater.cpp; 8s local 2025-03-14T05:46:33.3903715Z Compiling llvm/lib/Transforms/Scalar/ADCE.cpp; 8s local ... 2025-03-14T05:46:33.6196774Z 2025-03-14T05:46:33.6197671Z  2025-03-14T05:46:33.6198131Z  2025-03-14T05:46:33.6198520Z  2025-03-14T05:46:33.6198929Z  2025-03-14T05:46:33.6199362Z  2025-03-14T05:46:33.6199776Z  2025-03-14T05:46:33.6200170Z  2025-03-14T05:46:33.6200590Z  2025-03-14T05:46:33.6201190Z [13,112 / 15,235] 48 actions, 47 running 2025-03-14T05:46:33.6202128Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T05:46:33.6203276Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T05:46:33.6204372Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2025-03-14T05:46:33.6205450Z Compiling xla/service/scatter_expander.cc; 12s local 2025-03-14T05:46:33.6206401Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 10s local 2025-03-14T05:46:33.6207361Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T05:46:33.6208209Z Compiling llvm/lib/Transforms/Scalar/ADCE.cpp; 8s local 2025-03-14T05:46:33.6209033Z @llvm-project//llvm:TransformUtils; 8s local ... 2025-03-14T05:46:33.8497099Z 2025-03-14T05:46:33.8497983Z  2025-03-14T05:46:33.8498494Z  2025-03-14T05:46:33.8498934Z  2025-03-14T05:46:33.8499367Z  2025-03-14T05:46:33.8499803Z  2025-03-14T05:46:33.8500232Z  2025-03-14T05:46:33.8500645Z  2025-03-14T05:46:33.8501074Z  2025-03-14T05:46:33.8501688Z [13,121 / 15,235] 48 actions, 47 running 2025-03-14T05:46:33.8502998Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T05:46:33.8504136Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2025-03-14T05:46:33.8505221Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2025-03-14T05:46:33.8506209Z Compiling xla/service/scatter_expander.cc; 12s local 2025-03-14T05:46:33.8507205Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 11s local 2025-03-14T05:46:33.8508192Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T05:46:33.8509037Z Compiling llvm/lib/Transforms/Scalar/ADCE.cpp; 9s local 2025-03-14T05:46:33.8509877Z @llvm-project//llvm:TransformUtils; 9s local ... 2025-03-14T05:46:34.0666253Z 2025-03-14T05:46:34.0667081Z  2025-03-14T05:46:34.0667583Z  2025-03-14T05:46:34.0667990Z  2025-03-14T05:46:34.0668400Z  2025-03-14T05:46:34.0668794Z  2025-03-14T05:46:34.0669196Z  2025-03-14T05:46:34.0669616Z  2025-03-14T05:46:34.0670092Z  2025-03-14T05:46:34.0670701Z [13,133 / 15,235] 48 actions, 47 running 2025-03-14T05:46:34.0671680Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T05:46:34.0672856Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2025-03-14T05:46:34.0673902Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2025-03-14T05:46:34.0675026Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 11s local 2025-03-14T05:46:34.0676047Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T05:46:34.0676914Z Compiling llvm/lib/Transforms/Scalar/ADCE.cpp; 9s local 2025-03-14T05:46:34.0678041Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 9s local 2025-03-14T05:46:34.0679300Z Compiling xla/service/while_loop_invariant_code_motion.cc; 9s local ... 2025-03-14T05:46:34.2686393Z 2025-03-14T05:46:34.2687184Z  2025-03-14T05:46:34.2687658Z  2025-03-14T05:46:34.2688098Z  2025-03-14T05:46:34.2688837Z  2025-03-14T05:46:34.2689233Z  2025-03-14T05:46:34.2689615Z  2025-03-14T05:46:34.2690000Z  2025-03-14T05:46:34.2690417Z  2025-03-14T05:46:34.2691014Z [13,144 / 15,235] 48 actions, 47 running 2025-03-14T05:46:34.2691914Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T05:46:34.2692989Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2025-03-14T05:46:34.2694021Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2025-03-14T05:46:34.2695084Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 11s local 2025-03-14T05:46:34.2696001Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T05:46:34.2696975Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 9s local 2025-03-14T05:46:34.2698056Z Compiling xla/service/while_loop_invariant_code_motion.cc; 9s local 2025-03-14T05:46:34.2699148Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 9s local ... 2025-03-14T05:46:34.4810013Z 2025-03-14T05:46:34.4810853Z  2025-03-14T05:46:34.4811357Z  2025-03-14T05:46:34.4811774Z  2025-03-14T05:46:34.4812199Z  2025-03-14T05:46:34.4812616Z  2025-03-14T05:46:34.4813028Z  2025-03-14T05:46:34.4813433Z  2025-03-14T05:46:34.4813847Z  2025-03-14T05:46:34.4814452Z [13,153 / 15,235] 48 actions, 47 running 2025-03-14T05:46:34.4815320Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T05:46:34.4816354Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2025-03-14T05:46:34.4817402Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2025-03-14T05:46:34.4818508Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 11s local 2025-03-14T05:46:34.4819457Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T05:46:34.4820898Z Compiling llvm/lib/Transforms/Utils/PromoteMemoryToRegister.cpp; 9s local 2025-03-14T05:46:34.4822062Z Compiling xla/service/while_loop_invariant_code_motion.cc; 9s local 2025-03-14T05:46:34.4823130Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 9s local ... 2025-03-14T05:46:34.6840818Z 2025-03-14T05:46:34.6841700Z  2025-03-14T05:46:34.6842190Z  2025-03-14T05:46:34.6842628Z  2025-03-14T05:46:34.6843011Z  2025-03-14T05:46:34.6843416Z  2025-03-14T05:46:34.6843841Z  2025-03-14T05:46:34.6844250Z  2025-03-14T05:46:34.6844779Z  2025-03-14T05:46:34.6845385Z [13,163 / 15,235] 48 actions, 47 running 2025-03-14T05:46:34.6846312Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T05:46:34.6847432Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2025-03-14T05:46:34.6848488Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2025-03-14T05:46:34.6849624Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 11s local 2025-03-14T05:46:34.6850677Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T05:46:34.6851627Z Compiling xla/service/while_loop_invariant_code_motion.cc; 9s local 2025-03-14T05:46:34.6852720Z Compiling llvm/lib/Transforms/Utils/SCCPSolver.cpp; 9s local 2025-03-14T05:46:34.6853649Z @llvm-project//llvm:TransformUtils; 8s local ... 2025-03-14T05:46:34.9243214Z 2025-03-14T05:46:34.9244079Z  2025-03-14T05:46:34.9244679Z  2025-03-14T05:46:34.9245109Z  2025-03-14T05:46:34.9245521Z  2025-03-14T05:46:34.9245914Z  2025-03-14T05:46:34.9246332Z  2025-03-14T05:46:34.9246749Z  2025-03-14T05:46:34.9247175Z  2025-03-14T05:46:34.9247809Z [13,172 / 15,235] 48 actions, 47 running 2025-03-14T05:46:34.9248863Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T05:46:34.9249995Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2025-03-14T05:46:34.9251065Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2025-03-14T05:46:34.9252558Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 12s local 2025-03-14T05:46:34.9253502Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T05:46:34.9254458Z Compiling xla/service/while_loop_invariant_code_motion.cc; 10s local 2025-03-14T05:46:34.9255671Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 8s local 2025-03-14T05:46:34.9256876Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 8s local ... 2025-03-14T05:46:35.1454812Z 2025-03-14T05:46:35.1455674Z  2025-03-14T05:46:35.1456174Z  2025-03-14T05:46:35.1456594Z  2025-03-14T05:46:35.1457011Z  2025-03-14T05:46:35.1457440Z  2025-03-14T05:46:35.1457834Z  2025-03-14T05:46:35.1458232Z  2025-03-14T05:46:35.1458652Z  2025-03-14T05:46:35.1459301Z [13,182 / 15,235] 48 actions, 47 running 2025-03-14T05:46:35.1460194Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T05:46:35.1461308Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2025-03-14T05:46:35.1462391Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2025-03-14T05:46:35.1463479Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 12s local 2025-03-14T05:46:35.1464561Z Compiling xla/service/while_loop_invariant_code_motion.cc; 10s local 2025-03-14T05:46:35.1465936Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2025-03-14T05:46:35.1467016Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 8s local 2025-03-14T05:46:35.1468032Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 8s local ... 2025-03-14T05:46:35.3646558Z 2025-03-14T05:46:35.3647443Z  2025-03-14T05:46:35.3647917Z  2025-03-14T05:46:35.3648342Z  2025-03-14T05:46:35.3648763Z  2025-03-14T05:46:35.3649550Z  2025-03-14T05:46:35.3649997Z  2025-03-14T05:46:35.3650423Z  2025-03-14T05:46:35.3650829Z  2025-03-14T05:46:35.3651452Z [13,190 / 15,235] 48 actions, 47 running 2025-03-14T05:46:35.3652378Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T05:46:35.3653483Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2025-03-14T05:46:35.3654571Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2025-03-14T05:46:35.3655652Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 12s local 2025-03-14T05:46:35.3656755Z Compiling xla/service/while_loop_invariant_code_motion.cc; 10s local 2025-03-14T05:46:35.3657860Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2025-03-14T05:46:35.3659110Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 9s local 2025-03-14T05:46:35.3660218Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local ... 2025-03-14T05:46:35.5812672Z 2025-03-14T05:46:35.5813536Z  2025-03-14T05:46:35.5814029Z  2025-03-14T05:46:35.5814455Z  2025-03-14T05:46:35.5814851Z  2025-03-14T05:46:35.5815262Z  2025-03-14T05:46:35.5815639Z  2025-03-14T05:46:35.5816025Z  2025-03-14T05:46:35.5816564Z  2025-03-14T05:46:35.5817194Z [13,200 / 15,235] 48 actions, 47 running 2025-03-14T05:46:35.5818190Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T05:46:35.5819347Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2025-03-14T05:46:35.5820324Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 16s local 2025-03-14T05:46:35.5821426Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 12s local 2025-03-14T05:46:35.5822523Z Compiling xla/service/while_loop_invariant_code_motion.cc; 10s local 2025-03-14T05:46:35.5823698Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2025-03-14T05:46:35.5824883Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 9s local 2025-03-14T05:46:35.5826377Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local ... 2025-03-14T05:46:35.7908001Z 2025-03-14T05:46:35.7908858Z  2025-03-14T05:46:35.7909346Z  2025-03-14T05:46:35.7909735Z  2025-03-14T05:46:35.7910154Z  2025-03-14T05:46:35.7910533Z  2025-03-14T05:46:35.7910935Z  2025-03-14T05:46:35.7911364Z  2025-03-14T05:46:35.7911767Z  2025-03-14T05:46:35.7912353Z [13,207 / 15,235] 48 actions running 2025-03-14T05:46:35.7913308Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T05:46:35.7914398Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2025-03-14T05:46:35.7915494Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 16s local 2025-03-14T05:46:35.7916684Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2025-03-14T05:46:35.7917917Z Compiling xla/service/while_loop_invariant_code_motion.cc; 11s local 2025-03-14T05:46:35.7919061Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 9s local 2025-03-14T05:46:35.7920142Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 9s local 2025-03-14T05:46:35.7921146Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local ... 2025-03-14T05:46:35.9912640Z 2025-03-14T05:46:35.9913498Z  2025-03-14T05:46:35.9913982Z  2025-03-14T05:46:35.9914379Z  2025-03-14T05:46:35.9914788Z  2025-03-14T05:46:35.9915186Z  2025-03-14T05:46:35.9915581Z  2025-03-14T05:46:35.9916000Z  2025-03-14T05:46:35.9916381Z  2025-03-14T05:46:35.9916921Z [13,215 / 15,235] 48 actions running 2025-03-14T05:46:35.9917814Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T05:46:35.9919271Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2025-03-14T05:46:35.9920335Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2025-03-14T05:46:35.9921476Z Compiling xla/service/while_loop_invariant_code_motion.cc; 11s local 2025-03-14T05:46:35.9922585Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2025-03-14T05:46:35.9923708Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 9s local 2025-03-14T05:46:35.9924868Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2025-03-14T05:46:35.9925832Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 9s local ... 2025-03-14T05:46:36.2089668Z 2025-03-14T05:46:36.2090474Z  2025-03-14T05:46:36.2090957Z  2025-03-14T05:46:36.2091361Z  2025-03-14T05:46:36.2091747Z  2025-03-14T05:46:36.2092148Z  2025-03-14T05:46:36.2092546Z  2025-03-14T05:46:36.2092946Z  2025-03-14T05:46:36.2093346Z  2025-03-14T05:46:36.2093946Z [13,227 / 15,235] 48 actions, 47 running 2025-03-14T05:46:36.2094915Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T05:46:36.2096025Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2025-03-14T05:46:36.2097056Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2025-03-14T05:46:36.2098128Z Compiling xla/service/while_loop_invariant_code_motion.cc; 11s local 2025-03-14T05:46:36.2099271Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2025-03-14T05:46:36.2100388Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2025-03-14T05:46:36.2101405Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2025-03-14T05:46:36.2102363Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 9s local ... 2025-03-14T05:46:36.4609342Z 2025-03-14T05:46:36.4610244Z  2025-03-14T05:46:36.4610778Z  2025-03-14T05:46:36.4611159Z  2025-03-14T05:46:36.4611678Z  2025-03-14T05:46:36.4612074Z  2025-03-14T05:46:36.4612508Z  2025-03-14T05:46:36.4612964Z  2025-03-14T05:46:36.4613812Z  2025-03-14T05:46:36.4614449Z [13,234 / 15,235] 48 actions, 47 running 2025-03-14T05:46:36.4615343Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T05:46:36.4616367Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2025-03-14T05:46:36.4617390Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2025-03-14T05:46:36.4618501Z Compiling xla/service/while_loop_invariant_code_motion.cc; 11s local 2025-03-14T05:46:36.4619700Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2025-03-14T05:46:36.4620828Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2025-03-14T05:46:36.4621848Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2025-03-14T05:46:36.4622838Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 9s local ... 2025-03-14T05:46:36.6772986Z 2025-03-14T05:46:36.6773887Z  2025-03-14T05:46:36.6774419Z  2025-03-14T05:46:36.6774971Z  2025-03-14T05:46:36.6775370Z  2025-03-14T05:46:36.6775794Z  2025-03-14T05:46:36.6776194Z  2025-03-14T05:46:36.6776582Z  2025-03-14T05:46:36.6776990Z  2025-03-14T05:46:36.6777606Z [13,242 / 15,235] 48 actions, 47 running 2025-03-14T05:46:36.6778582Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T05:46:36.6779696Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2025-03-14T05:46:36.6780764Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 13s local 2025-03-14T05:46:36.6781816Z Compiling xla/service/while_loop_invariant_code_motion.cc; 11s local 2025-03-14T05:46:36.6792957Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2025-03-14T05:46:36.6794490Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2025-03-14T05:46:36.6795921Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2025-03-14T05:46:36.6796983Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 9s local ... 2025-03-14T05:46:36.8790478Z 2025-03-14T05:46:36.8791297Z  2025-03-14T05:46:36.8791800Z  2025-03-14T05:46:36.8792218Z  2025-03-14T05:46:36.8792626Z  2025-03-14T05:46:36.8793030Z  2025-03-14T05:46:36.8793435Z  2025-03-14T05:46:36.8793852Z  2025-03-14T05:46:36.8794274Z  2025-03-14T05:46:36.8794882Z [13,252 / 15,235] 48 actions, 47 running 2025-03-14T05:46:36.8795838Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2025-03-14T05:46:36.8796943Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2025-03-14T05:46:36.8797997Z Compiling .../transforms/simplifiers/hlo_constant_folding.cc; 14s local 2025-03-14T05:46:36.8799208Z Compiling xla/service/while_loop_invariant_code_motion.cc; 12s local 2025-03-14T05:46:36.8800413Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 10s local 2025-03-14T05:46:36.8801547Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2025-03-14T05:46:36.8802562Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2025-03-14T05:46:36.8803553Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 10s local ... 2025-03-14T05:46:37.1077835Z 2025-03-14T05:46:37.1078714Z  2025-03-14T05:46:37.1079203Z  2025-03-14T05:46:37.1079632Z  2025-03-14T05:46:37.1080096Z  2025-03-14T05:46:37.1080619Z  2025-03-14T05:46:37.1081119Z  2025-03-14T05:46:37.1081644Z  2025-03-14T05:46:37.1082054Z  2025-03-14T05:46:37.1082647Z [13,262 / 15,235] 48 actions, 47 running 2025-03-14T05:46:37.1083543Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2025-03-14T05:46:37.1084776Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2025-03-14T05:46:37.1085894Z Compiling xla/service/while_loop_invariant_code_motion.cc; 12s local 2025-03-14T05:46:37.1087601Z Compiling llvm/lib/Transforms/Utils/ScalarEvolutionExpander.cpp; 11s local 2025-03-14T05:46:37.1088799Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 10s local 2025-03-14T05:46:37.1089892Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2025-03-14T05:46:37.1090905Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 10s local 2025-03-14T05:46:37.1091919Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local ... 2025-03-14T05:46:37.3155764Z 2025-03-14T05:46:37.3156570Z  2025-03-14T05:46:37.3157076Z  2025-03-14T05:46:37.3157506Z  2025-03-14T05:46:37.3157925Z  2025-03-14T05:46:37.3158346Z  2025-03-14T05:46:37.3158769Z  2025-03-14T05:46:37.3159190Z  2025-03-14T05:46:37.3159605Z  2025-03-14T05:46:37.3160352Z [13,277 / 15,235] 48 actions, 47 running 2025-03-14T05:46:37.3161308Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2025-03-14T05:46:37.3162440Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2025-03-14T05:46:37.3163454Z Compiling xla/service/while_loop_invariant_code_motion.cc; 12s local 2025-03-14T05:46:37.3164395Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2025-03-14T05:46:37.3165577Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T05:46:37.3166491Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 10s local 2025-03-14T05:46:37.3167425Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2025-03-14T05:46:37.3168401Z Compiling xla/service/while_loop_simplifier.cc; 9s local ... 2025-03-14T05:46:37.5321404Z 2025-03-14T05:46:37.5322241Z  2025-03-14T05:46:37.5322688Z  2025-03-14T05:46:37.5323041Z  2025-03-14T05:46:37.5323397Z  2025-03-14T05:46:37.5323761Z  2025-03-14T05:46:37.5324122Z  2025-03-14T05:46:37.5324660Z  2025-03-14T05:46:37.5325024Z  2025-03-14T05:46:37.5326035Z [13,286 / 15,235] 48 actions, 47 running 2025-03-14T05:46:37.5326896Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2025-03-14T05:46:37.5327893Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2025-03-14T05:46:37.5328825Z Compiling xla/service/while_loop_invariant_code_motion.cc; 12s local 2025-03-14T05:46:37.5329740Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2025-03-14T05:46:37.5330661Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T05:46:37.5331506Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 10s local 2025-03-14T05:46:37.5332305Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2025-03-14T05:46:37.5333184Z Compiling xla/service/while_loop_simplifier.cc; 9s local ... 2025-03-14T05:46:37.7338825Z 2025-03-14T05:46:37.7339767Z  2025-03-14T05:46:37.7340188Z  2025-03-14T05:46:37.7340534Z  2025-03-14T05:46:37.7340913Z  2025-03-14T05:46:37.7341274Z  2025-03-14T05:46:37.7341640Z  2025-03-14T05:46:37.7341986Z  2025-03-14T05:46:37.7342322Z  2025-03-14T05:46:37.7342847Z [13,297 / 15,235] 48 actions, 47 running 2025-03-14T05:46:37.7343622Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T05:46:37.7344531Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2025-03-14T05:46:37.7345407Z Compiling xla/service/while_loop_invariant_code_motion.cc; 12s local 2025-03-14T05:46:37.7346293Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2025-03-14T05:46:37.7347180Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T05:46:37.7347999Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 10s local 2025-03-14T05:46:37.7348817Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2025-03-14T05:46:37.7349609Z Compiling xla/service/while_loop_simplifier.cc; 10s local ... 2025-03-14T05:46:37.9466979Z 2025-03-14T05:46:37.9467810Z  2025-03-14T05:46:37.9468804Z  2025-03-14T05:46:37.9469217Z  2025-03-14T05:46:37.9469563Z  2025-03-14T05:46:37.9469884Z  2025-03-14T05:46:37.9470209Z  2025-03-14T05:46:37.9470589Z  2025-03-14T05:46:37.9470926Z  2025-03-14T05:46:37.9471415Z [13,308 / 15,235] 48 actions, 47 running 2025-03-14T05:46:37.9472361Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T05:46:37.9473478Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2025-03-14T05:46:37.9474572Z Compiling xla/service/while_loop_invariant_code_motion.cc; 13s local 2025-03-14T05:46:37.9475602Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2025-03-14T05:46:37.9476677Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T05:46:37.9477579Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 11s local 2025-03-14T05:46:37.9478495Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2025-03-14T05:46:37.9479381Z Compiling xla/service/while_loop_simplifier.cc; 10s local ... 2025-03-14T05:46:38.1502963Z 2025-03-14T05:46:38.1503766Z  2025-03-14T05:46:38.1504222Z  2025-03-14T05:46:38.1504603Z  2025-03-14T05:46:38.1504997Z  2025-03-14T05:46:38.1505401Z  2025-03-14T05:46:38.1505794Z  2025-03-14T05:46:38.1506188Z  2025-03-14T05:46:38.1506554Z  2025-03-14T05:46:38.1507150Z [13,315 / 15,235] 48 actions, 47 running 2025-03-14T05:46:38.1508054Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T05:46:38.1509120Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2025-03-14T05:46:38.1510121Z Compiling xla/service/while_loop_invariant_code_motion.cc; 13s local 2025-03-14T05:46:38.1511180Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local 2025-03-14T05:46:38.1512559Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T05:46:38.1513531Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 11s local 2025-03-14T05:46:38.1514426Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T05:46:38.1515399Z Compiling xla/service/while_loop_simplifier.cc; 10s local ... 2025-03-14T05:46:38.3540660Z 2025-03-14T05:46:38.3541482Z  2025-03-14T05:46:38.3541939Z  2025-03-14T05:46:38.3542332Z  2025-03-14T05:46:38.3542717Z  2025-03-14T05:46:38.3543095Z  2025-03-14T05:46:38.3543502Z  2025-03-14T05:46:38.3543882Z  2025-03-14T05:46:38.3544269Z  2025-03-14T05:46:38.3544886Z [13,328 / 15,235] 48 actions, 47 running 2025-03-14T05:46:38.3545782Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T05:46:38.3546943Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2025-03-14T05:46:38.3547867Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2025-03-14T05:46:38.3548909Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T05:46:38.3549992Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 11s local 2025-03-14T05:46:38.3550881Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T05:46:38.3551809Z Compiling xla/service/while_loop_simplifier.cc; 10s local 2025-03-14T05:46:38.3552665Z @xla//xla/hlo/evaluator:hlo_evaluator; 9s local ... 2025-03-14T05:46:38.5556579Z 2025-03-14T05:46:38.5557443Z  2025-03-14T05:46:38.5557933Z  2025-03-14T05:46:38.5558351Z  2025-03-14T05:46:38.5558732Z  2025-03-14T05:46:38.5559116Z  2025-03-14T05:46:38.5559519Z  2025-03-14T05:46:38.5559907Z  2025-03-14T05:46:38.5560308Z  2025-03-14T05:46:38.5560899Z [13,339 / 15,235] 48 actions, 47 running 2025-03-14T05:46:38.5561827Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T05:46:38.5562891Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2025-03-14T05:46:38.5564327Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2025-03-14T05:46:38.5565789Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T05:46:38.5566644Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 11s local 2025-03-14T05:46:38.5567546Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T05:46:38.5568464Z Compiling xla/service/while_loop_simplifier.cc; 10s local 2025-03-14T05:46:38.5569270Z @xla//xla/hlo/evaluator:hlo_evaluator; 10s local ... 2025-03-14T05:46:38.7928100Z 2025-03-14T05:46:38.7928959Z  2025-03-14T05:46:38.7929452Z  2025-03-14T05:46:38.7929830Z  2025-03-14T05:46:38.7930212Z  2025-03-14T05:46:38.7930606Z  2025-03-14T05:46:38.7931009Z  2025-03-14T05:46:38.7931402Z  2025-03-14T05:46:38.7931781Z  2025-03-14T05:46:38.7932344Z [13,347 / 15,235] 48 actions running 2025-03-14T05:46:38.7933312Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2025-03-14T05:46:38.7934410Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2025-03-14T05:46:38.7935420Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2025-03-14T05:46:38.7936403Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T05:46:38.7937309Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local 2025-03-14T05:46:38.7938183Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T05:46:38.7939062Z Compiling xla/service/while_loop_simplifier.cc; 11s local 2025-03-14T05:46:38.7939848Z @xla//xla/hlo/evaluator:hlo_evaluator; 10s local ... 2025-03-14T05:46:39.2862178Z 2025-03-14T05:46:39.2862953Z  2025-03-14T05:46:39.2863370Z  2025-03-14T05:46:39.2863706Z  2025-03-14T05:46:39.2864115Z  2025-03-14T05:46:39.2864445Z  2025-03-14T05:46:39.2864775Z  2025-03-14T05:46:39.2865736Z  2025-03-14T05:46:39.2866129Z  2025-03-14T05:46:39.2866762Z [13,348 / 15,235] 48 actions, 47 running 2025-03-14T05:46:39.2867761Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2025-03-14T05:46:39.2868854Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2025-03-14T05:46:39.2869768Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2025-03-14T05:46:39.2870995Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T05:46:39.2872187Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local 2025-03-14T05:46:39.2873188Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T05:46:39.2874145Z Compiling xla/service/while_loop_simplifier.cc; 11s local 2025-03-14T05:46:39.2875009Z @xla//xla/hlo/evaluator:hlo_evaluator; 10s local ... 2025-03-14T05:46:39.5936162Z 2025-03-14T05:46:39.5937012Z  2025-03-14T05:46:39.5937492Z  2025-03-14T05:46:39.5937885Z  2025-03-14T05:46:39.5938320Z  2025-03-14T05:46:39.5938745Z  2025-03-14T05:46:39.5939141Z  2025-03-14T05:46:39.5939547Z  2025-03-14T05:46:39.5939945Z  2025-03-14T05:46:39.5940516Z [13,350 / 15,235] 48 actions running 2025-03-14T05:46:39.5941426Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2025-03-14T05:46:39.5942523Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2025-03-14T05:46:39.5943565Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2025-03-14T05:46:39.5944566Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local 2025-03-14T05:46:39.5945533Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 12s local 2025-03-14T05:46:39.5946462Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T05:46:39.5947385Z Compiling xla/service/while_loop_simplifier.cc; 11s local 2025-03-14T05:46:39.5948359Z @xla//xla/hlo/evaluator:hlo_evaluator; 11s local ... 2025-03-14T05:46:39.8149079Z 2025-03-14T05:46:39.8149914Z  2025-03-14T05:46:39.8150740Z  2025-03-14T05:46:39.8151176Z  2025-03-14T05:46:39.8151593Z  2025-03-14T05:46:39.8151949Z  2025-03-14T05:46:39.8152296Z  2025-03-14T05:46:39.8152720Z  2025-03-14T05:46:39.8153083Z  2025-03-14T05:46:39.8153661Z [13,351 / 15,235] 48 actions, 47 running 2025-03-14T05:46:39.8154552Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T05:46:39.8155578Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2025-03-14T05:46:39.8156604Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2025-03-14T05:46:39.8157538Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2025-03-14T05:46:39.8158460Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T05:46:39.8159419Z Compiling xla/service/while_loop_simplifier.cc; 12s local 2025-03-14T05:46:39.8160422Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 11s local 2025-03-14T05:46:39.8161553Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 11s local ... 2025-03-14T05:46:40.1291545Z 2025-03-14T05:46:40.1292382Z  2025-03-14T05:46:40.1292820Z  2025-03-14T05:46:40.1293203Z  2025-03-14T05:46:40.1293596Z  2025-03-14T05:46:40.1293943Z  2025-03-14T05:46:40.1294312Z  2025-03-14T05:46:40.1294687Z  2025-03-14T05:46:40.1295053Z  2025-03-14T05:46:40.1295612Z [13,353 / 15,235] 48 actions, 47 running 2025-03-14T05:46:40.1296501Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T05:46:40.1297514Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2025-03-14T05:46:40.1298489Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2025-03-14T05:46:40.1299313Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2025-03-14T05:46:40.1300445Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T05:46:40.1301293Z Compiling xla/service/while_loop_simplifier.cc; 12s local 2025-03-14T05:46:40.1302214Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 11s local 2025-03-14T05:46:40.1303264Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 11s local ... 2025-03-14T05:46:40.3944579Z 2025-03-14T05:46:40.3945399Z  2025-03-14T05:46:40.3945830Z  2025-03-14T05:46:40.3946193Z  2025-03-14T05:46:40.3946570Z  2025-03-14T05:46:40.3946943Z  2025-03-14T05:46:40.3947299Z  2025-03-14T05:46:40.3947655Z  2025-03-14T05:46:40.3948014Z  2025-03-14T05:46:40.3948520Z [13,354 / 15,235] 48 actions running 2025-03-14T05:46:40.3949320Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T05:46:40.3950275Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2025-03-14T05:46:40.3951213Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2025-03-14T05:46:40.3952020Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 13s local 2025-03-14T05:46:40.3952860Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T05:46:40.3953688Z Compiling xla/service/while_loop_simplifier.cc; 12s local 2025-03-14T05:46:40.3954567Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 11s local 2025-03-14T05:46:40.3955513Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 11s local ... 2025-03-14T05:46:40.8714150Z 2025-03-14T05:46:40.8714946Z  2025-03-14T05:46:40.8715410Z  2025-03-14T05:46:40.8715796Z  2025-03-14T05:46:40.8716137Z  2025-03-14T05:46:40.8716510Z  2025-03-14T05:46:40.8716894Z  2025-03-14T05:46:40.8717280Z  2025-03-14T05:46:40.8717646Z  2025-03-14T05:46:40.8718341Z [13,355 / 15,235] 48 actions, 47 running 2025-03-14T05:46:40.8719261Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T05:46:40.8720327Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2025-03-14T05:46:40.8721752Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2025-03-14T05:46:40.8722599Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2025-03-14T05:46:40.8723479Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T05:46:40.8724371Z Compiling xla/service/while_loop_simplifier.cc; 13s local 2025-03-14T05:46:40.8725487Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 12s local 2025-03-14T05:46:40.8726629Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 12s local ... 2025-03-14T05:46:41.1949886Z 2025-03-14T05:46:41.1950789Z  2025-03-14T05:46:41.1951275Z  2025-03-14T05:46:41.1951680Z  2025-03-14T05:46:41.1952096Z  2025-03-14T05:46:41.1952502Z  2025-03-14T05:46:41.1952909Z  2025-03-14T05:46:41.1953326Z  2025-03-14T05:46:41.1953738Z  2025-03-14T05:46:41.1954358Z [13,356 / 15,235] 48 actions running 2025-03-14T05:46:41.1955257Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T05:46:41.1956355Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2025-03-14T05:46:41.1957481Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T05:46:41.1958347Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2025-03-14T05:46:41.1959161Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T05:46:41.1960020Z Compiling xla/service/while_loop_simplifier.cc; 13s local 2025-03-14T05:46:41.1960962Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 12s local 2025-03-14T05:46:41.1962038Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 12s local ... 2025-03-14T05:46:41.3954577Z 2025-03-14T05:46:41.3955405Z  2025-03-14T05:46:41.3955907Z  2025-03-14T05:46:41.3956342Z  2025-03-14T05:46:41.3957157Z  2025-03-14T05:46:41.3957579Z  2025-03-14T05:46:41.3958028Z  2025-03-14T05:46:41.3958425Z  2025-03-14T05:46:41.3958843Z  2025-03-14T05:46:41.3959559Z [13,358 / 15,235] 48 actions running 2025-03-14T05:46:41.3960450Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T05:46:41.3961515Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2025-03-14T05:46:41.3962527Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T05:46:41.3963447Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2025-03-14T05:46:41.3964344Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T05:46:41.3965685Z Compiling xla/service/while_loop_simplifier.cc; 13s local 2025-03-14T05:46:41.3966697Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 12s local 2025-03-14T05:46:41.3967801Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 12s local ... 2025-03-14T05:46:41.6324594Z 2025-03-14T05:46:41.6325500Z  2025-03-14T05:46:41.6326019Z  2025-03-14T05:46:41.6326441Z  2025-03-14T05:46:41.6326835Z  2025-03-14T05:46:41.6327238Z  2025-03-14T05:46:41.6327650Z  2025-03-14T05:46:41.6328067Z  2025-03-14T05:46:41.6328422Z  2025-03-14T05:46:41.6329020Z [13,359 / 15,235] 48 actions, 47 running 2025-03-14T05:46:41.6329896Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T05:46:41.6330904Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2025-03-14T05:46:41.6331898Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T05:46:41.6332809Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 14s local 2025-03-14T05:46:41.6333706Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T05:46:41.6334599Z Compiling xla/service/while_loop_simplifier.cc; 14s local 2025-03-14T05:46:41.6335656Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 13s local 2025-03-14T05:46:41.6337206Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 13s local ... 2025-03-14T05:46:41.8862007Z 2025-03-14T05:46:41.8862900Z  2025-03-14T05:46:41.8863411Z  2025-03-14T05:46:41.8863778Z  2025-03-14T05:46:41.8864170Z  2025-03-14T05:46:41.8864590Z  2025-03-14T05:46:41.8865008Z  2025-03-14T05:46:41.8865714Z  2025-03-14T05:46:41.8866132Z  2025-03-14T05:46:41.8866666Z [13,360 / 15,235] 48 actions, 47 running 2025-03-14T05:46:41.8867551Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T05:46:41.8868547Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2025-03-14T05:46:41.8869495Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T05:46:41.8870409Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2025-03-14T05:46:41.8871314Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T05:46:41.8872180Z Compiling xla/service/while_loop_simplifier.cc; 14s local 2025-03-14T05:46:41.8873146Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 13s local 2025-03-14T05:46:41.8874189Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 13s local ... 2025-03-14T05:46:42.1177434Z 2025-03-14T05:46:42.1178234Z  2025-03-14T05:46:42.1178686Z  2025-03-14T05:46:42.1179023Z  2025-03-14T05:46:42.1179356Z  2025-03-14T05:46:42.1179713Z  2025-03-14T05:46:42.1180058Z  2025-03-14T05:46:42.1180397Z  2025-03-14T05:46:42.1180730Z  2025-03-14T05:46:42.1181250Z [13,361 / 15,235] 48 actions, 47 running 2025-03-14T05:46:42.1182061Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T05:46:42.1182992Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2025-03-14T05:46:42.1184225Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T05:46:42.1185058Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2025-03-14T05:46:42.1185814Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T05:46:42.1186572Z Compiling xla/service/while_loop_simplifier.cc; 14s local 2025-03-14T05:46:42.1187396Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 13s local 2025-03-14T05:46:42.1188362Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 13s local ... 2025-03-14T05:46:42.3116407Z 2025-03-14T05:46:42.3117280Z  2025-03-14T05:46:42.3117739Z  2025-03-14T05:46:42.3118146Z  2025-03-14T05:46:42.3118544Z  2025-03-14T05:46:42.3118964Z  2025-03-14T05:46:42.3119363Z  2025-03-14T05:46:42.3119757Z  2025-03-14T05:46:42.3120169Z  2025-03-14T05:46:42.3120764Z [13,363 / 15,235] 48 actions, 47 running 2025-03-14T05:46:42.3121723Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T05:46:42.3122793Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2025-03-14T05:46:42.3123805Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2025-03-14T05:46:42.3124846Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2025-03-14T05:46:42.3125659Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T05:46:42.3126554Z Compiling xla/service/while_loop_simplifier.cc; 14s local 2025-03-14T05:46:42.3127560Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 13s local 2025-03-14T05:46:42.3128600Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 13s local ... 2025-03-14T05:46:42.5963458Z 2025-03-14T05:46:42.5964312Z  2025-03-14T05:46:42.5964990Z  2025-03-14T05:46:42.5967898Z  2025-03-14T05:46:42.5968517Z  2025-03-14T05:46:42.5968929Z  2025-03-14T05:46:42.5969337Z  2025-03-14T05:46:42.5969738Z  2025-03-14T05:46:42.5970203Z  2025-03-14T05:46:42.5970763Z [13,363 / 15,235] 48 actions running 2025-03-14T05:46:42.5972126Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T05:46:42.5973186Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2025-03-14T05:46:42.5974124Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2025-03-14T05:46:42.5975028Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 15s local 2025-03-14T05:46:42.5975914Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T05:46:42.5976800Z Compiling xla/service/while_loop_simplifier.cc; 14s local 2025-03-14T05:46:42.5977751Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2025-03-14T05:46:42.5978933Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 14s local ... 2025-03-14T05:46:42.9301413Z 2025-03-14T05:46:42.9302238Z  2025-03-14T05:46:42.9302752Z  2025-03-14T05:46:42.9303158Z  2025-03-14T05:46:42.9303594Z  2025-03-14T05:46:42.9304021Z  2025-03-14T05:46:42.9304420Z  2025-03-14T05:46:42.9304810Z  2025-03-14T05:46:42.9305203Z  2025-03-14T05:46:42.9305808Z [13,366 / 15,235] 48 actions, 47 running 2025-03-14T05:46:42.9306689Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T05:46:42.9307753Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2025-03-14T05:46:42.9308862Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2025-03-14T05:46:42.9309759Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2025-03-14T05:46:42.9310621Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T05:46:42.9311500Z Compiling xla/service/while_loop_simplifier.cc; 15s local 2025-03-14T05:46:42.9312416Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2025-03-14T05:46:42.9313913Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 14s local ... 2025-03-14T05:46:43.1969877Z 2025-03-14T05:46:43.1970761Z  2025-03-14T05:46:43.1971226Z  2025-03-14T05:46:43.1971581Z  2025-03-14T05:46:43.1971957Z  2025-03-14T05:46:43.1972330Z  2025-03-14T05:46:43.1972691Z  2025-03-14T05:46:43.1973050Z  2025-03-14T05:46:43.1973414Z  2025-03-14T05:46:43.1973918Z [13,368 / 15,235] 48 actions running 2025-03-14T05:46:43.1974709Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T05:46:43.1975622Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2025-03-14T05:46:43.1976517Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T05:46:43.1977351Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2025-03-14T05:46:43.1978301Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T05:46:43.1979133Z Compiling xla/service/while_loop_simplifier.cc; 15s local 2025-03-14T05:46:43.1980067Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2025-03-14T05:46:43.1981115Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 14s local ... 2025-03-14T05:46:43.4503481Z 2025-03-14T05:46:43.4504346Z  2025-03-14T05:46:43.4505114Z  2025-03-14T05:46:43.4505670Z  2025-03-14T05:46:43.4506171Z  2025-03-14T05:46:43.4506700Z  2025-03-14T05:46:43.4507224Z  2025-03-14T05:46:43.4507719Z  2025-03-14T05:46:43.4508239Z  2025-03-14T05:46:43.4508925Z [13,369 / 15,235] 48 actions, 47 running 2025-03-14T05:46:43.4509937Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T05:46:43.4511069Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2025-03-14T05:46:43.4512240Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T05:46:43.4513310Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2025-03-14T05:46:43.4514416Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T05:46:43.4515931Z Compiling xla/service/while_loop_simplifier.cc; 15s local 2025-03-14T05:46:43.4517082Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 14s local 2025-03-14T05:46:43.4518335Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 14s local ... 2025-03-14T05:46:43.6519476Z 2025-03-14T05:46:43.6520380Z  2025-03-14T05:46:43.6520861Z  2025-03-14T05:46:43.6521299Z  2025-03-14T05:46:43.6521718Z  2025-03-14T05:46:43.6522121Z  2025-03-14T05:46:43.6522509Z  2025-03-14T05:46:43.6522925Z  2025-03-14T05:46:43.6523308Z  2025-03-14T05:46:43.6523919Z [13,378 / 15,235] 48 actions, 47 running 2025-03-14T05:46:43.6525035Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T05:46:43.6526210Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2025-03-14T05:46:43.6527248Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T05:46:43.6528123Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 16s local 2025-03-14T05:46:43.6528976Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T05:46:43.6529842Z Compiling xla/service/while_loop_simplifier.cc; 16s local 2025-03-14T05:46:43.6530761Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2025-03-14T05:46:43.6531782Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 15s local ... 2025-03-14T05:46:43.8915370Z 2025-03-14T05:46:43.8916395Z  2025-03-14T05:46:43.8916899Z  2025-03-14T05:46:43.8917333Z  2025-03-14T05:46:43.8917748Z  2025-03-14T05:46:43.8918180Z  2025-03-14T05:46:43.8918608Z  2025-03-14T05:46:43.8919052Z  2025-03-14T05:46:43.8919461Z  2025-03-14T05:46:43.8920090Z [13,387 / 15,235] 48 actions, 47 running 2025-03-14T05:46:43.8921404Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T05:46:43.8922494Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2025-03-14T05:46:43.8923498Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T05:46:43.8924388Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2025-03-14T05:46:43.8925487Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T05:46:43.8926422Z Compiling xla/service/while_loop_simplifier.cc; 16s local 2025-03-14T05:46:43.8927410Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2025-03-14T05:46:43.8928530Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 15s local ... 2025-03-14T05:46:44.1233729Z 2025-03-14T05:46:44.1234614Z  2025-03-14T05:46:44.1235122Z  2025-03-14T05:46:44.1235547Z  2025-03-14T05:46:44.1235980Z  2025-03-14T05:46:44.1236393Z  2025-03-14T05:46:44.1236825Z  2025-03-14T05:46:44.1237254Z  2025-03-14T05:46:44.1237727Z  2025-03-14T05:46:44.1238335Z [13,392 / 15,235] 48 actions, 47 running 2025-03-14T05:46:44.1239275Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T05:46:44.1240343Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2025-03-14T05:46:44.1241322Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T05:46:44.1242228Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2025-03-14T05:46:44.1243145Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T05:46:44.1244090Z Compiling xla/service/while_loop_simplifier.cc; 16s local 2025-03-14T05:46:44.1245157Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2025-03-14T05:46:44.1246286Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bool.cc; 15s local ... 2025-03-14T05:46:44.3309016Z 2025-03-14T05:46:44.3309855Z  2025-03-14T05:46:44.3310350Z  2025-03-14T05:46:44.3310919Z  2025-03-14T05:46:44.3311308Z  2025-03-14T05:46:44.3312117Z  2025-03-14T05:46:44.3312514Z  2025-03-14T05:46:44.3312898Z  2025-03-14T05:46:44.3313287Z  2025-03-14T05:46:44.3313843Z [13,395 / 15,235] 48 actions, 47 running 2025-03-14T05:46:44.3314778Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T05:46:44.3315841Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2025-03-14T05:46:44.3316867Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T05:46:44.3317820Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2025-03-14T05:46:44.3318722Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T05:46:44.3319662Z Compiling xla/service/while_loop_simplifier.cc; 16s local 2025-03-14T05:46:44.3320627Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 15s local 2025-03-14T05:46:44.3321789Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local ... 2025-03-14T05:46:44.5381093Z 2025-03-14T05:46:44.5382076Z  2025-03-14T05:46:44.5382529Z  2025-03-14T05:46:44.5382928Z  2025-03-14T05:46:44.5383355Z  2025-03-14T05:46:44.5383763Z  2025-03-14T05:46:44.5384175Z  2025-03-14T05:46:44.5384581Z  2025-03-14T05:46:44.5385110Z  2025-03-14T05:46:44.5385671Z [13,398 / 15,235] 48 actions, 47 running 2025-03-14T05:46:44.5386544Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T05:46:44.5387637Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2025-03-14T05:46:44.5388665Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T05:46:44.5389589Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2025-03-14T05:46:44.5390463Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T05:46:44.5391797Z Compiling xla/service/while_loop_simplifier.cc; 16s local 2025-03-14T05:46:44.5392799Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 16s local 2025-03-14T05:46:44.5393978Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local ... 2025-03-14T05:46:44.7464690Z 2025-03-14T05:46:44.7465826Z  2025-03-14T05:46:44.7466449Z  2025-03-14T05:46:44.7466966Z  2025-03-14T05:46:44.7467340Z  2025-03-14T05:46:44.7467855Z  2025-03-14T05:46:44.7468224Z  2025-03-14T05:46:44.7468739Z  2025-03-14T05:46:44.7469233Z  2025-03-14T05:46:44.7469945Z [13,405 / 15,235] 48 actions, 47 running 2025-03-14T05:46:44.7470922Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T05:46:44.7472005Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T05:46:44.7473133Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T05:46:44.7474080Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 17s local 2025-03-14T05:46:44.7475021Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T05:46:44.7476022Z Compiling xla/service/while_loop_simplifier.cc; 17s local 2025-03-14T05:46:44.7476928Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 16s local 2025-03-14T05:46:44.7477971Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local ... 2025-03-14T05:46:44.9652378Z 2025-03-14T05:46:44.9653514Z  2025-03-14T05:46:44.9654001Z  2025-03-14T05:46:44.9654563Z  2025-03-14T05:46:44.9655127Z  2025-03-14T05:46:44.9655549Z  2025-03-14T05:46:44.9656113Z  2025-03-14T05:46:44.9656704Z  2025-03-14T05:46:44.9657146Z  2025-03-14T05:46:44.9658117Z [13,415 / 15,235] 48 actions, 47 running 2025-03-14T05:46:44.9659187Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T05:46:44.9660535Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T05:46:44.9661967Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T05:46:44.9663693Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2025-03-14T05:46:44.9664852Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T05:46:44.9666405Z Compiling xla/service/while_loop_simplifier.cc; 17s local 2025-03-14T05:46:44.9667611Z Compiling .../evaluator/hlo_evaluator_typed_visitor_bfloat16.cc; 16s local 2025-03-14T05:46:44.9669014Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local ... 2025-03-14T05:46:45.1691853Z 2025-03-14T05:46:45.1692881Z  2025-03-14T05:46:45.1693551Z  2025-03-14T05:46:45.1694128Z  2025-03-14T05:46:45.1694533Z  2025-03-14T05:46:45.1695115Z  2025-03-14T05:46:45.1695692Z  2025-03-14T05:46:45.1696222Z  2025-03-14T05:46:45.1696651Z  2025-03-14T05:46:45.1697425Z [13,421 / 15,235] 48 actions, 47 running 2025-03-14T05:46:45.1698828Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T05:46:45.1700333Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T05:46:45.1701925Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T05:46:45.1703076Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2025-03-14T05:46:45.1703970Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T05:46:45.1704840Z Compiling xla/service/while_loop_simplifier.cc; 17s local 2025-03-14T05:46:45.1705900Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2025-03-14T05:46:45.1706990Z .../memory_space_assignment:prefetch_interval_picker; 13s local ... 2025-03-14T05:46:45.3987076Z 2025-03-14T05:46:45.3988037Z  2025-03-14T05:46:45.3988522Z  2025-03-14T05:46:45.3988975Z  2025-03-14T05:46:45.3989480Z  2025-03-14T05:46:45.3989877Z  2025-03-14T05:46:45.3990300Z  2025-03-14T05:46:45.3990732Z  2025-03-14T05:46:45.3991587Z  2025-03-14T05:46:45.3992223Z [13,425 / 15,235] 48 actions running 2025-03-14T05:46:45.3993126Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T05:46:45.3994216Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T05:46:45.3995176Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2025-03-14T05:46:45.3996132Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2025-03-14T05:46:45.3997099Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T05:46:45.3998108Z Compiling xla/service/while_loop_simplifier.cc; 17s local 2025-03-14T05:46:45.3999077Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2025-03-14T05:46:45.4000234Z .../memory_space_assignment:prefetch_interval_picker; 13s local ... 2025-03-14T05:46:45.6688366Z 2025-03-14T05:46:45.6689281Z  2025-03-14T05:46:45.6689740Z  2025-03-14T05:46:45.6690184Z  2025-03-14T05:46:45.6690576Z  2025-03-14T05:46:45.6690996Z  2025-03-14T05:46:45.6691399Z  2025-03-14T05:46:45.6691783Z  2025-03-14T05:46:45.6692157Z  2025-03-14T05:46:45.6692755Z [13,428 / 15,235] 48 actions, 47 running 2025-03-14T05:46:45.6693665Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T05:46:45.6694703Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T05:46:45.6695709Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2025-03-14T05:46:45.6696621Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 18s local 2025-03-14T05:46:45.6697516Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T05:46:45.6698409Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2025-03-14T05:46:45.6699376Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2025-03-14T05:46:45.6700450Z .../memory_space_assignment:prefetch_interval_picker; 13s local ... 2025-03-14T05:46:45.9765224Z 2025-03-14T05:46:45.9766617Z  2025-03-14T05:46:45.9767118Z  2025-03-14T05:46:45.9767541Z  2025-03-14T05:46:45.9767963Z  2025-03-14T05:46:45.9768376Z  2025-03-14T05:46:45.9768797Z  2025-03-14T05:46:45.9769203Z  2025-03-14T05:46:45.9769596Z  2025-03-14T05:46:45.9770215Z [13,440 / 15,235] 48 actions, 47 running 2025-03-14T05:46:45.9771088Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T05:46:45.9772146Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2025-03-14T05:46:45.9773158Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2025-03-14T05:46:45.9774114Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2025-03-14T05:46:45.9775051Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T05:46:45.9776022Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2025-03-14T05:46:45.9777117Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2025-03-14T05:46:45.9778257Z .../memory_space_assignment:prefetch_interval_picker; 13s local ... 2025-03-14T05:46:46.1994800Z 2025-03-14T05:46:46.1995619Z  2025-03-14T05:46:46.1996127Z  2025-03-14T05:46:46.1996567Z  2025-03-14T05:46:46.1996988Z  2025-03-14T05:46:46.1997406Z  2025-03-14T05:46:46.1997841Z  2025-03-14T05:46:46.1998252Z  2025-03-14T05:46:46.1998672Z  2025-03-14T05:46:46.1999288Z [13,440 / 15,235] 48 actions running 2025-03-14T05:46:46.2000272Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T05:46:46.2001409Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2025-03-14T05:46:46.2002453Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T05:46:46.2003461Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2025-03-14T05:46:46.2005000Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T05:46:46.2006036Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2025-03-14T05:46:46.2007132Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2025-03-14T05:46:46.2008272Z .../memory_space_assignment:prefetch_interval_picker; 14s local ... 2025-03-14T05:46:46.4563823Z 2025-03-14T05:46:46.4564739Z  2025-03-14T05:46:46.4565558Z  2025-03-14T05:46:46.4566024Z  2025-03-14T05:46:46.4566475Z  2025-03-14T05:46:46.4566918Z  2025-03-14T05:46:46.4567368Z  2025-03-14T05:46:46.4567810Z  2025-03-14T05:46:46.4568235Z  2025-03-14T05:46:46.4568889Z [13,443 / 15,235] 48 actions, 47 running 2025-03-14T05:46:46.4569911Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T05:46:46.4571155Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T05:46:46.4572339Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2025-03-14T05:46:46.4573326Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T05:46:46.4574359Z Compiling xla/service/while_loop_simplifier.cc; 18s local 2025-03-14T05:46:46.4575441Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2025-03-14T05:46:46.4576464Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local 2025-03-14T05:46:46.4577514Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local ... 2025-03-14T05:46:46.6776278Z 2025-03-14T05:46:46.6777081Z  2025-03-14T05:46:46.6777578Z  2025-03-14T05:46:46.6777971Z  2025-03-14T05:46:46.6778350Z  2025-03-14T05:46:46.6778723Z  2025-03-14T05:46:46.6779111Z  2025-03-14T05:46:46.6779490Z  2025-03-14T05:46:46.6779839Z  2025-03-14T05:46:46.6780408Z [13,444 / 15,235] 48 actions, 47 running 2025-03-14T05:46:46.6781289Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T05:46:46.6782347Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T05:46:46.6783601Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2025-03-14T05:46:46.6784467Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T05:46:46.6785354Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2025-03-14T05:46:46.6786302Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2025-03-14T05:46:46.6787177Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local 2025-03-14T05:46:46.6788060Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local ... 2025-03-14T05:46:47.1406052Z 2025-03-14T05:46:47.1406891Z  2025-03-14T05:46:47.1407381Z  2025-03-14T05:46:47.1407796Z  2025-03-14T05:46:47.1408221Z  2025-03-14T05:46:47.1408645Z  2025-03-14T05:46:47.1409050Z  2025-03-14T05:46:47.1409463Z  2025-03-14T05:46:47.1409888Z  2025-03-14T05:46:47.1410523Z [13,444 / 15,235] 48 actions running 2025-03-14T05:46:47.1411492Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2025-03-14T05:46:47.1412574Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T05:46:47.1413597Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2025-03-14T05:46:47.1414539Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T05:46:47.1415438Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2025-03-14T05:46:47.1416510Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2025-03-14T05:46:47.1417500Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local 2025-03-14T05:46:47.1418420Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local ... 2025-03-14T05:46:47.5412628Z 2025-03-14T05:46:47.5413495Z  2025-03-14T05:46:47.5413998Z  2025-03-14T05:46:47.5414428Z  2025-03-14T05:46:47.5414828Z  2025-03-14T05:46:47.5415245Z  2025-03-14T05:46:47.5416006Z  2025-03-14T05:46:47.5416467Z  2025-03-14T05:46:47.5416916Z  2025-03-14T05:46:47.5417493Z [13,445 / 15,235] 48 actions running 2025-03-14T05:46:47.5418362Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2025-03-14T05:46:47.5419314Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T05:46:47.5420094Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2025-03-14T05:46:47.5420930Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T05:46:47.5421910Z Compiling xla/service/while_loop_simplifier.cc; 19s local 2025-03-14T05:46:47.5422908Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2025-03-14T05:46:47.5423871Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local 2025-03-14T05:46:47.5424892Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local ... 2025-03-14T05:46:47.7417478Z 2025-03-14T05:46:47.7418334Z  2025-03-14T05:46:47.7418835Z  2025-03-14T05:46:47.7419253Z  2025-03-14T05:46:47.7419683Z  2025-03-14T05:46:47.7420091Z  2025-03-14T05:46:47.7420480Z  2025-03-14T05:46:47.7420867Z  2025-03-14T05:46:47.7421260Z  2025-03-14T05:46:47.7421814Z [13,447 / 15,235] 48 actions running 2025-03-14T05:46:47.7422709Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T05:46:47.7423774Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T05:46:47.7424828Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2025-03-14T05:46:47.7425658Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T05:46:47.7426584Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2025-03-14T05:46:47.7427606Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2025-03-14T05:46:47.7428552Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local 2025-03-14T05:46:47.7429611Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local ... 2025-03-14T05:46:48.0922061Z 2025-03-14T05:46:48.0922865Z  2025-03-14T05:46:48.0923347Z  2025-03-14T05:46:48.0932650Z  2025-03-14T05:46:48.0933098Z  2025-03-14T05:46:48.0933456Z  2025-03-14T05:46:48.0933803Z  2025-03-14T05:46:48.0934159Z  2025-03-14T05:46:48.0934506Z  2025-03-14T05:46:48.0935072Z [13,449 / 15,235] 48 actions, 47 running 2025-03-14T05:46:48.0935987Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T05:46:48.0937071Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T05:46:48.0937977Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T05:46:48.0938874Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T05:46:48.0939690Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2025-03-14T05:46:48.0940665Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2025-03-14T05:46:48.0941577Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local 2025-03-14T05:46:48.0942512Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local ... 2025-03-14T05:46:48.3424023Z 2025-03-14T05:46:48.3424837Z  2025-03-14T05:46:48.3425318Z  2025-03-14T05:46:48.3425737Z  2025-03-14T05:46:48.3426162Z  2025-03-14T05:46:48.3426558Z  2025-03-14T05:46:48.3426946Z  2025-03-14T05:46:48.3427335Z  2025-03-14T05:46:48.3427745Z  2025-03-14T05:46:48.3428324Z [13,449 / 15,235] 48 actions running 2025-03-14T05:46:48.3429268Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T05:46:48.3430305Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T05:46:48.3431234Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T05:46:48.3432157Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T05:46:48.3433484Z Compiling xla/service/while_loop_simplifier.cc; 20s local 2025-03-14T05:46:48.3434565Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2025-03-14T05:46:48.3435528Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local 2025-03-14T05:46:48.3436522Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local ... 2025-03-14T05:46:48.5502798Z 2025-03-14T05:46:48.5503653Z  2025-03-14T05:46:48.5504142Z  2025-03-14T05:46:48.5504550Z  2025-03-14T05:46:48.5504964Z  2025-03-14T05:46:48.5505387Z  2025-03-14T05:46:48.5505803Z  2025-03-14T05:46:48.5506189Z  2025-03-14T05:46:48.5506549Z  2025-03-14T05:46:48.5507165Z [13,451 / 15,235] 48 actions, 47 running 2025-03-14T05:46:48.5508059Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T05:46:48.5509106Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T05:46:48.5510043Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T05:46:48.5510906Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T05:46:48.5511944Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2025-03-14T05:46:48.5513072Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T05:46:48.5514137Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 14s local 2025-03-14T05:46:48.5515198Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local ... 2025-03-14T05:46:48.9431102Z 2025-03-14T05:46:48.9431988Z  2025-03-14T05:46:48.9432494Z  2025-03-14T05:46:48.9432921Z  2025-03-14T05:46:48.9433319Z  2025-03-14T05:46:48.9433729Z  2025-03-14T05:46:48.9434182Z  2025-03-14T05:46:48.9434589Z  2025-03-14T05:46:48.9434986Z  2025-03-14T05:46:48.9435550Z [13,452 / 15,235] 48 actions running 2025-03-14T05:46:48.9436502Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T05:46:48.9438102Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T05:46:48.9439148Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T05:46:48.9440062Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T05:46:48.9441088Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2025-03-14T05:46:48.9442213Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T05:46:48.9443347Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 15s local 2025-03-14T05:46:48.9444606Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local ... 2025-03-14T05:46:49.1435968Z 2025-03-14T05:46:49.1436801Z  2025-03-14T05:46:49.1437498Z  2025-03-14T05:46:49.1437923Z  2025-03-14T05:46:49.1438407Z  2025-03-14T05:46:49.1438820Z  2025-03-14T05:46:49.1439237Z  2025-03-14T05:46:49.1439642Z  2025-03-14T05:46:49.1440125Z  2025-03-14T05:46:49.1440741Z [13,454 / 15,235] 48 actions running 2025-03-14T05:46:49.1441704Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T05:46:49.1442882Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T05:46:49.1443868Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T05:46:49.1444855Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T05:46:49.1445859Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2025-03-14T05:46:49.1447056Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T05:46:49.1448177Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 15s local 2025-03-14T05:46:49.1449168Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local ... 2025-03-14T05:46:49.5572187Z 2025-03-14T05:46:49.5573122Z  2025-03-14T05:46:49.5573621Z  2025-03-14T05:46:49.5574452Z  2025-03-14T05:46:49.5574889Z  2025-03-14T05:46:49.5575308Z  2025-03-14T05:46:49.5575716Z  2025-03-14T05:46:49.5576131Z  2025-03-14T05:46:49.5576546Z  2025-03-14T05:46:49.5577164Z [13,455 / 15,235] 48 actions, 47 running 2025-03-14T05:46:49.5578096Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T05:46:49.5579112Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T05:46:49.5580042Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T05:46:49.5581105Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2025-03-14T05:46:49.5582207Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T05:46:49.5583234Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 15s local 2025-03-14T05:46:49.5584276Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T05:46:49.5585169Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2025-03-14T05:46:49.7576120Z 2025-03-14T05:46:49.7577004Z  2025-03-14T05:46:49.7577486Z  2025-03-14T05:46:49.7577897Z  2025-03-14T05:46:49.7578305Z  2025-03-14T05:46:49.7578669Z  2025-03-14T05:46:49.7579090Z  2025-03-14T05:46:49.7579487Z  2025-03-14T05:46:49.7579887Z  2025-03-14T05:46:49.7580504Z [13,459 / 15,235] 48 actions, 47 running 2025-03-14T05:46:49.7581449Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T05:46:49.7582513Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T05:46:49.7583449Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T05:46:49.7584526Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2025-03-14T05:46:49.7585651Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T05:46:49.7586845Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 15s local 2025-03-14T05:46:49.7587900Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T05:46:49.7589165Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2025-03-14T05:46:50.1443031Z 2025-03-14T05:46:50.1444066Z  2025-03-14T05:46:50.1444735Z  2025-03-14T05:46:50.1445210Z  2025-03-14T05:46:50.1445631Z  2025-03-14T05:46:50.1446047Z  2025-03-14T05:46:50.1446479Z  2025-03-14T05:46:50.1446894Z  2025-03-14T05:46:50.1447332Z  2025-03-14T05:46:50.1447922Z [13,460 / 15,235] 48 actions running 2025-03-14T05:46:50.1448902Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T05:46:50.1449995Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T05:46:50.1450929Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T05:46:50.1451991Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2025-03-14T05:46:50.1453216Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T05:46:50.1454408Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 16s local 2025-03-14T05:46:50.1455503Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T05:46:50.1456421Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T05:46:50.5447553Z 2025-03-14T05:46:50.5448418Z  2025-03-14T05:46:50.5448914Z  2025-03-14T05:46:50.5449330Z  2025-03-14T05:46:50.5449733Z  2025-03-14T05:46:50.5450147Z  2025-03-14T05:46:50.5450536Z  2025-03-14T05:46:50.5451002Z  2025-03-14T05:46:50.5451525Z  2025-03-14T05:46:50.5452174Z [13,461 / 15,235] 48 actions running 2025-03-14T05:46:50.5453174Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T05:46:50.5454221Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T05:46:50.5455571Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T05:46:50.5456799Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2025-03-14T05:46:50.5457913Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T05:46:50.5459044Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 16s local 2025-03-14T05:46:50.5460120Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T05:46:50.5460912Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T05:46:50.7679583Z 2025-03-14T05:46:50.7680623Z  2025-03-14T05:46:50.7681075Z  2025-03-14T05:46:50.7681430Z  2025-03-14T05:46:50.7681913Z  2025-03-14T05:46:50.7682422Z  2025-03-14T05:46:50.7682824Z  2025-03-14T05:46:50.7683230Z  2025-03-14T05:46:50.7683619Z  2025-03-14T05:46:50.7684232Z [13,462 / 15,235] 48 actions, 47 running 2025-03-14T05:46:50.7685339Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T05:46:50.7686339Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T05:46:50.7687294Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T05:46:50.7688434Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2025-03-14T05:46:50.7689592Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T05:46:50.7690774Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 16s local 2025-03-14T05:46:50.7691824Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T05:46:50.7692730Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T05:46:51.0154949Z 2025-03-14T05:46:51.0155934Z  2025-03-14T05:46:51.0156423Z  2025-03-14T05:46:51.0156853Z  2025-03-14T05:46:51.0157279Z  2025-03-14T05:46:51.0157709Z  2025-03-14T05:46:51.0158113Z  2025-03-14T05:46:51.0158539Z  2025-03-14T05:46:51.0158929Z  2025-03-14T05:46:51.0159591Z [13,465 / 15,235] 48 actions, 47 running 2025-03-14T05:46:51.0160884Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T05:46:51.0161944Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T05:46:51.0162928Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2025-03-14T05:46:51.0163993Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2025-03-14T05:46:51.0165542Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T05:46:51.0166681Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 17s local 2025-03-14T05:46:51.0167732Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T05:46:51.0168621Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T05:46:51.2703826Z 2025-03-14T05:46:51.2704755Z  2025-03-14T05:46:51.2706556Z  2025-03-14T05:46:51.2707036Z  2025-03-14T05:46:51.2707493Z  2025-03-14T05:46:51.2707907Z  2025-03-14T05:46:51.2708327Z  2025-03-14T05:46:51.2708742Z  2025-03-14T05:46:51.2709152Z  2025-03-14T05:46:51.2709797Z [13,466 / 15,235] 48 actions, 47 running 2025-03-14T05:46:51.2710747Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T05:46:51.2711761Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T05:46:51.2712796Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2025-03-14T05:46:51.2713968Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2025-03-14T05:46:51.2715119Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 17s local 2025-03-14T05:46:51.2716161Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T05:46:51.2717205Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint32.cc; 15s local 2025-03-14T05:46:51.2718620Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T05:46:51.5457075Z 2025-03-14T05:46:51.5457969Z  2025-03-14T05:46:51.5458454Z  2025-03-14T05:46:51.5458873Z  2025-03-14T05:46:51.5459258Z  2025-03-14T05:46:51.5459663Z  2025-03-14T05:46:51.5460066Z  2025-03-14T05:46:51.5460459Z  2025-03-14T05:46:51.5460831Z  2025-03-14T05:46:51.5461395Z [13,466 / 15,235] 48 actions running 2025-03-14T05:46:51.5462256Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T05:46:51.5463280Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T05:46:51.5464210Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2025-03-14T05:46:51.5465563Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2025-03-14T05:46:51.5466590Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 17s local 2025-03-14T05:46:51.5467598Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T05:46:51.5468632Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint32.cc; 15s local 2025-03-14T05:46:51.5469539Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T05:46:51.9462402Z 2025-03-14T05:46:51.9463211Z  2025-03-14T05:46:51.9463686Z  2025-03-14T05:46:51.9464083Z  2025-03-14T05:46:51.9464511Z  2025-03-14T05:46:51.9464907Z  2025-03-14T05:46:51.9465490Z  2025-03-14T05:46:51.9465891Z  2025-03-14T05:46:51.9466311Z  2025-03-14T05:46:51.9466894Z [13,467 / 15,235] 48 actions running 2025-03-14T05:46:51.9467800Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T05:46:51.9468789Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T05:46:51.9469759Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2025-03-14T05:46:51.9470933Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2025-03-14T05:46:51.9472124Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2025-03-14T05:46:51.9473581Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T05:46:51.9474629Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint32.cc; 16s local 2025-03-14T05:46:51.9475582Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T05:46:52.2665782Z 2025-03-14T05:46:52.2666627Z  2025-03-14T05:46:52.2667115Z  2025-03-14T05:46:52.2667506Z  2025-03-14T05:46:52.2667889Z  2025-03-14T05:46:52.2668270Z  2025-03-14T05:46:52.2668639Z  2025-03-14T05:46:52.2669012Z  2025-03-14T05:46:52.2669387Z  2025-03-14T05:46:52.2669952Z [13,469 / 15,235] 48 actions, 47 running 2025-03-14T05:46:52.2670798Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T05:46:52.2671702Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T05:46:52.2672624Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T05:46:52.2673650Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T05:46:52.2674631Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2025-03-14T05:46:52.2675521Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T05:46:52.2676254Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local 2025-03-14T05:46:52.2677155Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local ... 2025-03-14T05:46:52.4941088Z 2025-03-14T05:46:52.4941910Z  2025-03-14T05:46:52.4942409Z  2025-03-14T05:46:52.4942864Z  2025-03-14T05:46:52.4943249Z  2025-03-14T05:46:52.4943663Z  2025-03-14T05:46:52.4944088Z  2025-03-14T05:46:52.4944502Z  2025-03-14T05:46:52.4944932Z  2025-03-14T05:46:52.4945555Z [13,470 / 15,235] 48 actions, 47 running 2025-03-14T05:46:52.4946853Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T05:46:52.4947950Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T05:46:52.4949002Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T05:46:52.4950210Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T05:46:52.4951376Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2025-03-14T05:46:52.4952475Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T05:46:52.4953344Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local 2025-03-14T05:46:52.4954405Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local ... 2025-03-14T05:46:52.7426621Z 2025-03-14T05:46:52.7427404Z  2025-03-14T05:46:52.7427906Z  2025-03-14T05:46:52.7428338Z  2025-03-14T05:46:52.7428766Z  2025-03-14T05:46:52.7429200Z  2025-03-14T05:46:52.7429634Z  2025-03-14T05:46:52.7430026Z  2025-03-14T05:46:52.7430440Z  2025-03-14T05:46:52.7431049Z [13,474 / 15,235] 48 actions, 47 running 2025-03-14T05:46:52.7432053Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T05:46:52.7433116Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T05:46:52.7434126Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T05:46:52.7435301Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T05:46:52.7436429Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 18s local 2025-03-14T05:46:52.7437527Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T05:46:52.7438655Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2025-03-14T05:46:52.7439704Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T05:46:52.9470545Z 2025-03-14T05:46:52.9471360Z  2025-03-14T05:46:52.9471827Z  2025-03-14T05:46:52.9472259Z  2025-03-14T05:46:52.9472647Z  2025-03-14T05:46:52.9473409Z  2025-03-14T05:46:52.9473774Z  2025-03-14T05:46:52.9474144Z  2025-03-14T05:46:52.9474523Z  2025-03-14T05:46:52.9475049Z [13,476 / 15,235] 48 actions running 2025-03-14T05:46:52.9475882Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T05:46:52.9476845Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T05:46:52.9477799Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T05:46:52.9478898Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T05:46:52.9479985Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2025-03-14T05:46:52.9480986Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T05:46:52.9481995Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 15s local 2025-03-14T05:46:52.9483001Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T05:46:53.3297282Z 2025-03-14T05:46:53.3298097Z  2025-03-14T05:46:53.3298559Z  2025-03-14T05:46:53.3298938Z  2025-03-14T05:46:53.3299271Z  2025-03-14T05:46:53.3299608Z  2025-03-14T05:46:53.3299967Z  2025-03-14T05:46:53.3300305Z  2025-03-14T05:46:53.3300646Z  2025-03-14T05:46:53.3301144Z [13,477 / 15,235] 48 actions, 47 running 2025-03-14T05:46:53.3301930Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T05:46:53.3302755Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T05:46:53.3303613Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2025-03-14T05:46:53.3304597Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T05:46:53.3305625Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2025-03-14T05:46:53.3306949Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T05:46:53.3307959Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2025-03-14T05:46:53.3309129Z Compiling xla/service/memory_space_assignment/algorithm.cc; 15s local ... 2025-03-14T05:46:53.5477214Z 2025-03-14T05:46:53.5478027Z  2025-03-14T05:46:53.5478429Z  2025-03-14T05:46:53.5478766Z  2025-03-14T05:46:53.5479094Z  2025-03-14T05:46:53.5479417Z  2025-03-14T05:46:53.5479746Z  2025-03-14T05:46:53.5480070Z  2025-03-14T05:46:53.5480403Z  2025-03-14T05:46:53.5480987Z [13,477 / 15,235] 48 actions running 2025-03-14T05:46:53.5481730Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T05:46:53.5482524Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T05:46:53.5483285Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2025-03-14T05:46:53.5484185Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T05:46:53.5485162Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2025-03-14T05:46:53.5485972Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T05:46:53.5486768Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2025-03-14T05:46:53.5487646Z Compiling xla/service/memory_space_assignment/algorithm.cc; 15s local ... 2025-03-14T05:46:53.7481702Z 2025-03-14T05:46:53.7482548Z  2025-03-14T05:46:53.7483024Z  2025-03-14T05:46:53.7483427Z  2025-03-14T05:46:53.7483818Z  2025-03-14T05:46:53.7484226Z  2025-03-14T05:46:53.7484737Z  2025-03-14T05:46:53.7485148Z  2025-03-14T05:46:53.7485483Z  2025-03-14T05:46:53.7486154Z [13,479 / 15,235] 48 actions running 2025-03-14T05:46:53.7487093Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T05:46:53.7488092Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T05:46:53.7489090Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2025-03-14T05:46:53.7490565Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T05:46:53.7491581Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2025-03-14T05:46:53.7492590Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2025-03-14T05:46:53.7493582Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 16s local 2025-03-14T05:46:53.7494732Z Compiling xla/service/memory_space_assignment/algorithm.cc; 15s local ... 2025-03-14T05:46:54.3808449Z 2025-03-14T05:46:54.3809252Z  2025-03-14T05:46:54.3809689Z  2025-03-14T05:46:54.3810056Z  2025-03-14T05:46:54.3810429Z  2025-03-14T05:46:54.3810784Z  2025-03-14T05:46:54.3811174Z  2025-03-14T05:46:54.3811558Z  2025-03-14T05:46:54.3811914Z  2025-03-14T05:46:54.3812496Z [13,480 / 15,235] 48 actions, 47 running 2025-03-14T05:46:54.3813432Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T05:46:54.3814417Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2025-03-14T05:46:54.3815389Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2025-03-14T05:46:54.3816499Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T05:46:54.3817616Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2025-03-14T05:46:54.3818659Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2025-03-14T05:46:54.3819704Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2025-03-14T05:46:54.3820861Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2025-03-14T05:46:54.7489428Z 2025-03-14T05:46:54.7490213Z  2025-03-14T05:46:54.7490694Z  2025-03-14T05:46:54.7491096Z  2025-03-14T05:46:54.7491520Z  2025-03-14T05:46:54.7491930Z  2025-03-14T05:46:54.7492686Z  2025-03-14T05:46:54.7493104Z  2025-03-14T05:46:54.7493498Z  2025-03-14T05:46:54.7494057Z [13,481 / 15,235] 48 actions running 2025-03-14T05:46:54.7494966Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T05:46:54.7495953Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2025-03-14T05:46:54.7496950Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2025-03-14T05:46:54.7498050Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T05:46:54.7499144Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2025-03-14T05:46:54.7500174Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T05:46:54.7501225Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2025-03-14T05:46:54.7502397Z Compiling xla/service/memory_space_assignment/algorithm.cc; 16s local ... 2025-03-14T05:46:54.9494059Z 2025-03-14T05:46:54.9494871Z  2025-03-14T05:46:54.9495346Z  2025-03-14T05:46:54.9495727Z  2025-03-14T05:46:54.9496109Z  2025-03-14T05:46:54.9496496Z  2025-03-14T05:46:54.9496868Z  2025-03-14T05:46:54.9497244Z  2025-03-14T05:46:54.9497622Z  2025-03-14T05:46:54.9498161Z [13,482 / 15,235] 48 actions running 2025-03-14T05:46:54.9498988Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T05:46:54.9499900Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T05:46:54.9500806Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2025-03-14T05:46:54.9501850Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T05:46:54.9502879Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 21s local 2025-03-14T05:46:54.9503814Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T05:46:54.9504760Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 17s local 2025-03-14T05:46:54.9506334Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local ... 2025-03-14T05:46:55.2481136Z 2025-03-14T05:46:55.2481976Z  2025-03-14T05:46:55.2482503Z  2025-03-14T05:46:55.2482944Z  2025-03-14T05:46:55.2483369Z  2025-03-14T05:46:55.2483805Z  2025-03-14T05:46:55.2484227Z  2025-03-14T05:46:55.2484816Z  2025-03-14T05:46:55.2485350Z  2025-03-14T05:46:55.2485982Z [13,486 / 15,235] 48 actions, 47 running 2025-03-14T05:46:55.2486931Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T05:46:55.2487966Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T05:46:55.2488998Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2025-03-14T05:46:55.2490176Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T05:46:55.2491374Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 21s local 2025-03-14T05:46:55.2492475Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T05:46:55.2493544Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2025-03-14T05:46:55.2494758Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local ... 2025-03-14T05:46:55.4987311Z 2025-03-14T05:46:55.4988217Z  2025-03-14T05:46:55.4988712Z  2025-03-14T05:46:55.4989129Z  2025-03-14T05:46:55.4989553Z  2025-03-14T05:46:55.4989968Z  2025-03-14T05:46:55.4990387Z  2025-03-14T05:46:55.4990810Z  2025-03-14T05:46:55.4991219Z  2025-03-14T05:46:55.4991834Z [13,489 / 15,235] 48 actions, 47 running 2025-03-14T05:46:55.4992751Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T05:46:55.4993749Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T05:46:55.4995100Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2025-03-14T05:46:55.4996202Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T05:46:55.4997238Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2025-03-14T05:46:55.4998376Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2025-03-14T05:46:55.4999488Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2025-03-14T05:46:55.5000611Z .../service/memory_space_assignment:memory_space_assignment; 17s local ... 2025-03-14T05:46:55.7500839Z 2025-03-14T05:46:55.7501709Z  2025-03-14T05:46:55.7502204Z  2025-03-14T05:46:55.7502625Z  2025-03-14T05:46:55.7503015Z  2025-03-14T05:46:55.7503433Z  2025-03-14T05:46:55.7503845Z  2025-03-14T05:46:55.7504236Z  2025-03-14T05:46:55.7504643Z  2025-03-14T05:46:55.7505219Z [13,490 / 15,235] 48 actions running 2025-03-14T05:46:55.7506160Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T05:46:55.7507265Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T05:46:55.7508172Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2025-03-14T05:46:55.7509118Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T05:46:55.7510043Z Compiling llvm/lib/Transforms/Scalar/SimpleLoopUnswitch.cpp; 18s local 2025-03-14T05:46:55.7511172Z Compiling xla/service/memory_space_assignment/algorithm.cc; 17s local 2025-03-14T05:46:55.7512261Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2025-03-14T05:46:55.7513327Z .../service/memory_space_assignment:memory_space_assignment; 17s local ... 2025-03-14T05:46:56.1001307Z 2025-03-14T05:46:56.1002312Z  2025-03-14T05:46:56.1002803Z  2025-03-14T05:46:56.1003238Z  2025-03-14T05:46:56.1003651Z  2025-03-14T05:46:56.1004037Z  2025-03-14T05:46:56.1004430Z  2025-03-14T05:46:56.1004999Z  2025-03-14T05:46:56.1005407Z  2025-03-14T05:46:56.1006363Z [13,491 / 15,235] 48 actions, 47 running 2025-03-14T05:46:56.1007301Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T05:46:56.1008304Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T05:46:56.1009313Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2025-03-14T05:46:56.1010351Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T05:46:56.1011366Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2025-03-14T05:46:56.1012461Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 17s local 2025-03-14T05:46:56.1013609Z .../xla/service/memory_space_assignment:memory_space_assignment; 17s local 2025-03-14T05:46:56.1014792Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local ... 2025-03-14T05:46:56.3509244Z 2025-03-14T05:46:56.3510257Z  2025-03-14T05:46:56.3510830Z  2025-03-14T05:46:56.3511236Z  2025-03-14T05:46:56.3511654Z  2025-03-14T05:46:56.3512050Z  2025-03-14T05:46:56.3512419Z  2025-03-14T05:46:56.3512810Z  2025-03-14T05:46:56.3513271Z  2025-03-14T05:46:56.3513885Z [13,492 / 15,235] 48 actions running 2025-03-14T05:46:56.3514762Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T05:46:56.3515704Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T05:46:56.3516898Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2025-03-14T05:46:56.3517901Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T05:46:56.3518922Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2025-03-14T05:46:56.3519981Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2025-03-14T05:46:56.3521495Z .../xla/service/memory_space_assignment:memory_space_assignment; 17s local 2025-03-14T05:46:56.3522628Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local ... 2025-03-14T05:46:56.5512686Z 2025-03-14T05:46:56.5513568Z  2025-03-14T05:46:56.5514087Z  2025-03-14T05:46:56.5514536Z  2025-03-14T05:46:56.5514948Z  2025-03-14T05:46:56.5515339Z  2025-03-14T05:46:56.5515738Z  2025-03-14T05:46:56.5516134Z  2025-03-14T05:46:56.5516545Z  2025-03-14T05:46:56.5517102Z [13,496 / 15,235] 48 actions running 2025-03-14T05:46:56.5518061Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T05:46:56.5519046Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T05:46:56.5520015Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2025-03-14T05:46:56.5521081Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T05:46:56.5522223Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local 2025-03-14T05:46:56.5523471Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2025-03-14T05:46:56.5524698Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2025-03-14T05:46:56.5525826Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 16s local ... 2025-03-14T05:46:56.8992701Z 2025-03-14T05:46:56.8993789Z  2025-03-14T05:46:56.8994314Z  2025-03-14T05:46:56.8994711Z  2025-03-14T05:46:56.8995135Z  2025-03-14T05:46:56.8995575Z  2025-03-14T05:46:56.8995965Z  2025-03-14T05:46:56.8996354Z  2025-03-14T05:46:56.8996758Z  2025-03-14T05:46:56.8997351Z [13,497 / 15,235] 48 actions, 47 running 2025-03-14T05:46:56.8998277Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T05:46:56.8999199Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T05:46:56.9000197Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2025-03-14T05:46:56.9001234Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T05:46:56.9002669Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2025-03-14T05:46:56.9003805Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2025-03-14T05:46:56.9005049Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2025-03-14T05:46:56.9006120Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local ... 2025-03-14T05:46:57.1518718Z 2025-03-14T05:46:57.1519502Z  2025-03-14T05:46:57.1519928Z  2025-03-14T05:46:57.1520305Z  2025-03-14T05:46:57.1520624Z  2025-03-14T05:46:57.1520952Z  2025-03-14T05:46:57.1521285Z  2025-03-14T05:46:57.1521613Z  2025-03-14T05:46:57.1521935Z  2025-03-14T05:46:57.1522398Z [13,497 / 15,235] 48 actions running 2025-03-14T05:46:57.1523233Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T05:46:57.1524276Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T05:46:57.1525437Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2025-03-14T05:46:57.1526465Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T05:46:57.1527435Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2025-03-14T05:46:57.1528510Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 18s local 2025-03-14T05:46:57.1529571Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2025-03-14T05:46:57.1530712Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local ... 2025-03-14T05:46:57.3523680Z 2025-03-14T05:46:57.3525149Z  2025-03-14T05:46:57.3525646Z  2025-03-14T05:46:57.3526037Z  2025-03-14T05:46:57.3526427Z  2025-03-14T05:46:57.3526832Z  2025-03-14T05:46:57.3527235Z  2025-03-14T05:46:57.3527639Z  2025-03-14T05:46:57.3528527Z  2025-03-14T05:46:57.3529101Z [13,499 / 15,235] 48 actions running 2025-03-14T05:46:57.3530005Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T05:46:57.3530937Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T05:46:57.3531832Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T05:46:57.3532766Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T05:46:57.3533671Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2025-03-14T05:46:57.3534786Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2025-03-14T05:46:57.3535883Z .../xla/service/memory_space_assignment:memory_space_assignment; 18s local 2025-03-14T05:46:57.3536940Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local ... 2025-03-14T05:46:57.6215323Z 2025-03-14T05:46:57.6216168Z  2025-03-14T05:46:57.6216613Z  2025-03-14T05:46:57.6217007Z  2025-03-14T05:46:57.6217365Z  2025-03-14T05:46:57.6217731Z  2025-03-14T05:46:57.6218090Z  2025-03-14T05:46:57.6218452Z  2025-03-14T05:46:57.6218820Z  2025-03-14T05:46:57.6219345Z [13,500 / 15,235] 48 actions, 47 running 2025-03-14T05:46:57.6220174Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T05:46:57.6221209Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T05:46:57.6222086Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T05:46:57.6223011Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T05:46:57.6224119Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local 2025-03-14T05:46:57.6225222Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2025-03-14T05:46:57.6226412Z .../xla/service/memory_space_assignment:memory_space_assignment; 19s local 2025-03-14T05:46:57.6227528Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 17s local ... 2025-03-14T05:46:57.9531778Z 2025-03-14T05:46:57.9532674Z  2025-03-14T05:46:57.9534225Z  2025-03-14T05:46:57.9535228Z  2025-03-14T05:46:57.9535977Z  2025-03-14T05:46:57.9536405Z  2025-03-14T05:46:57.9536803Z  2025-03-14T05:46:57.9537167Z  2025-03-14T05:46:57.9537532Z  2025-03-14T05:46:57.9538152Z [13,500 / 15,235] 48 actions running 2025-03-14T05:46:57.9539052Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T05:46:57.9539995Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T05:46:57.9541016Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T05:46:57.9542113Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T05:46:57.9543069Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2025-03-14T05:46:57.9544243Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 19s local 2025-03-14T05:46:57.9545417Z .../xla/service/memory_space_assignment:memory_space_assignment; 19s local 2025-03-14T05:46:57.9546660Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local ... 2025-03-14T05:46:58.4552752Z 2025-03-14T05:46:58.4553719Z  2025-03-14T05:46:58.4555083Z  2025-03-14T05:46:58.4555883Z  2025-03-14T05:46:58.4556536Z  2025-03-14T05:46:58.4556942Z  2025-03-14T05:46:58.4557361Z  2025-03-14T05:46:58.4557747Z  2025-03-14T05:46:58.4558139Z  2025-03-14T05:46:58.4558725Z [13,501 / 15,235] 48 actions, 47 running 2025-03-14T05:46:58.4559792Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T05:46:58.4560725Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T05:46:58.4561681Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T05:46:58.4563046Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T05:46:58.4564045Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2025-03-14T05:46:58.4565543Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2025-03-14T05:46:58.4566689Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2025-03-14T05:46:58.4567789Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local ... 2025-03-14T05:46:58.7539166Z 2025-03-14T05:46:58.7540118Z  2025-03-14T05:46:58.7540545Z  2025-03-14T05:46:58.7540894Z  2025-03-14T05:46:58.7541273Z  2025-03-14T05:46:58.7541605Z  2025-03-14T05:46:58.7541944Z  2025-03-14T05:46:58.7542378Z  2025-03-14T05:46:58.7542779Z  2025-03-14T05:46:58.7543295Z [13,503 / 15,235] 48 actions running 2025-03-14T05:46:58.7544264Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 55s local 2025-03-14T05:46:58.7545248Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T05:46:58.7546210Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T05:46:58.7547162Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T05:46:58.7548151Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2025-03-14T05:46:58.7549207Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2025-03-14T05:46:58.7550285Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2025-03-14T05:46:58.7551397Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 18s local ... 2025-03-14T05:46:58.9543275Z 2025-03-14T05:46:58.9544148Z  2025-03-14T05:46:58.9544593Z  2025-03-14T05:46:59.1845881Z  2025-03-14T05:46:59.1846401Z  2025-03-14T05:46:59.1846840Z  2025-03-14T05:46:59.1847262Z  2025-03-14T05:46:59.1847684Z  2025-03-14T05:46:59.1848107Z  2025-03-14T05:46:59.1848745Z [13,506 / 15,235] 48 actions running 2025-03-14T05:46:59.1849885Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T05:46:59.1850957Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T05:46:59.1852088Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T05:46:59.1853157Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2025-03-14T05:46:59.1854270Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2025-03-14T05:46:59.1855430Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2025-03-14T05:46:59.1856632Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2025-03-14T05:46:59.1857704Z Compiling xla/service/buffer_assignment.cc; 17s local ... 2025-03-14T05:46:59.1858311Z 2025-03-14T05:46:59.1858629Z  2025-03-14T05:46:59.1859069Z  2025-03-14T05:46:59.1859492Z  2025-03-14T05:46:59.1859939Z  2025-03-14T05:46:59.1860367Z  2025-03-14T05:46:59.1860796Z  2025-03-14T05:46:59.1861213Z  2025-03-14T05:46:59.1861634Z  2025-03-14T05:46:59.1862260Z [13,510 / 15,235] 48 actions, 47 running 2025-03-14T05:46:59.1863089Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T05:46:59.1864145Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T05:46:59.1865231Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T05:46:59.1866417Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2025-03-14T05:46:59.1867553Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 20s local 2025-03-14T05:46:59.1868767Z .../xla/service/memory_space_assignment:memory_space_assignment; 20s local 2025-03-14T05:46:59.1869984Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2025-03-14T05:46:59.1871344Z Compiling xla/service/buffer_assignment.cc; 17s local ... 2025-03-14T05:46:59.3884824Z 2025-03-14T05:46:59.3885926Z  2025-03-14T05:46:59.3886407Z  2025-03-14T05:46:59.3886866Z  2025-03-14T05:46:59.3887299Z  2025-03-14T05:46:59.3887710Z  2025-03-14T05:46:59.3888115Z  2025-03-14T05:46:59.3888530Z  2025-03-14T05:46:59.3888952Z  2025-03-14T05:46:59.3889604Z [13,511 / 15,235] 48 actions, 47 running 2025-03-14T05:46:59.3890445Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T05:46:59.3891457Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T05:46:59.3892505Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T05:46:59.3893545Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2025-03-14T05:46:59.3894685Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2025-03-14T05:46:59.3895882Z .../xla/service/memory_space_assignment:memory_space_assignment; 21s local 2025-03-14T05:46:59.3897094Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2025-03-14T05:46:59.3898186Z Compiling xla/service/buffer_assignment.cc; 18s local ... 2025-03-14T05:46:59.7550172Z 2025-03-14T05:46:59.7551019Z  2025-03-14T05:46:59.7551530Z  2025-03-14T05:46:59.7551902Z  2025-03-14T05:46:59.7552281Z  2025-03-14T05:46:59.7552700Z  2025-03-14T05:46:59.7553114Z  2025-03-14T05:46:59.7553474Z  2025-03-14T05:46:59.7553885Z  2025-03-14T05:46:59.7554478Z [13,514 / 15,235] 48 actions running 2025-03-14T05:46:59.7555246Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T05:46:59.7556318Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T05:46:59.7557406Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T05:46:59.7558445Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2025-03-14T05:46:59.7559581Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2025-03-14T05:46:59.7561120Z .../xla/service/memory_space_assignment:memory_space_assignment; 21s local 2025-03-14T05:46:59.7562263Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local 2025-03-14T05:46:59.7563276Z Compiling xla/service/buffer_assignment.cc; 18s local ... 2025-03-14T05:46:59.9555037Z 2025-03-14T05:46:59.9556071Z  2025-03-14T05:46:59.9556585Z  2025-03-14T05:46:59.9556967Z  2025-03-14T05:46:59.9557331Z  2025-03-14T05:46:59.9557691Z  2025-03-14T05:46:59.9558070Z  2025-03-14T05:46:59.9558522Z  2025-03-14T05:46:59.9559049Z  2025-03-14T05:46:59.9559769Z [13,515 / 15,235] 48 actions running 2025-03-14T05:46:59.9560719Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T05:46:59.9561712Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T05:46:59.9562927Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T05:46:59.9563886Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2025-03-14T05:46:59.9565111Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2025-03-14T05:46:59.9566366Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2025-03-14T05:46:59.9567267Z Compiling xla/service/buffer_assignment.cc; 18s local 2025-03-14T05:46:59.9567981Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T05:47:00.2112375Z 2025-03-14T05:47:00.2113361Z  2025-03-14T05:47:00.2113835Z  2025-03-14T05:47:00.2114264Z  2025-03-14T05:47:00.2114691Z  2025-03-14T05:47:00.2115112Z  2025-03-14T05:47:00.2115531Z  2025-03-14T05:47:00.2115954Z  2025-03-14T05:47:00.2116379Z  2025-03-14T05:47:00.2116983Z [13,518 / 15,235] 48 actions, 47 running 2025-03-14T05:47:00.2117811Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T05:47:00.2119140Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T05:47:00.2120222Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T05:47:00.2121230Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2025-03-14T05:47:00.2122333Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 21s local 2025-03-14T05:47:00.2123459Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2025-03-14T05:47:00.2124718Z Compiling xla/service/buffer_assignment.cc; 18s local 2025-03-14T05:47:00.2125552Z @xla//xla/hlo/evaluator:hlo_evaluator; 16s local ... 2025-03-14T05:47:00.5560501Z 2025-03-14T05:47:00.5561388Z  2025-03-14T05:47:00.5561924Z  2025-03-14T05:47:00.5562369Z  2025-03-14T05:47:00.5562810Z  2025-03-14T05:47:00.5563246Z  2025-03-14T05:47:00.5563673Z  2025-03-14T05:47:00.5564098Z  2025-03-14T05:47:00.5575354Z  2025-03-14T05:47:00.5576077Z [13,519 / 15,235] 48 actions running 2025-03-14T05:47:00.5576959Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T05:47:00.5578025Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T05:47:00.5579163Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T05:47:00.5580231Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2025-03-14T05:47:00.5581413Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2025-03-14T05:47:00.5582607Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2025-03-14T05:47:00.5583647Z Compiling xla/service/buffer_assignment.cc; 19s local 2025-03-14T05:47:00.5584693Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local ... 2025-03-14T05:47:00.8060398Z 2025-03-14T05:47:00.8061230Z  2025-03-14T05:47:00.8061751Z  2025-03-14T05:47:00.8062189Z  2025-03-14T05:47:00.8062600Z  2025-03-14T05:47:00.8063061Z  2025-03-14T05:47:00.8063490Z  2025-03-14T05:47:00.8064281Z  2025-03-14T05:47:00.8064716Z  2025-03-14T05:47:00.8065602Z [13,520 / 15,235] 48 actions, 47 running 2025-03-14T05:47:00.8066400Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T05:47:00.8067405Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T05:47:00.8068559Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T05:47:00.8069552Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T05:47:00.8070501Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2025-03-14T05:47:00.8071635Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local 2025-03-14T05:47:00.8072631Z Compiling xla/service/buffer_assignment.cc; 19s local 2025-03-14T05:47:00.8073570Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local ... 2025-03-14T05:47:01.1569175Z 2025-03-14T05:47:01.1570012Z  2025-03-14T05:47:01.1570528Z  2025-03-14T05:47:01.1570939Z  2025-03-14T05:47:01.1571345Z  2025-03-14T05:47:01.1571754Z  2025-03-14T05:47:01.1572160Z  2025-03-14T05:47:01.1572567Z  2025-03-14T05:47:01.1572983Z  2025-03-14T05:47:01.1573535Z [13,521 / 15,235] 48 actions running 2025-03-14T05:47:01.1574282Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T05:47:01.1575267Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T05:47:01.1576336Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T05:47:01.1577355Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T05:47:01.1578597Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 22s local 2025-03-14T05:47:01.1579709Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2025-03-14T05:47:01.1581141Z Compiling xla/service/buffer_assignment.cc; 19s local 2025-03-14T05:47:01.1582254Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 16s local ... 2025-03-14T05:47:01.4416251Z 2025-03-14T05:47:01.4417059Z  2025-03-14T05:47:01.4417550Z  2025-03-14T05:47:01.4417974Z  2025-03-14T05:47:01.4418390Z  2025-03-14T05:47:01.4418809Z  2025-03-14T05:47:01.4419224Z  2025-03-14T05:47:01.4419634Z  2025-03-14T05:47:01.4420044Z  2025-03-14T05:47:01.4420678Z [13,522 / 15,235] 48 actions, 47 running 2025-03-14T05:47:01.4421445Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T05:47:01.4422377Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2025-03-14T05:47:01.4423386Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T05:47:01.4424349Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T05:47:01.4425423Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2025-03-14T05:47:01.4426459Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2025-03-14T05:47:01.4427413Z Compiling xla/service/buffer_assignment.cc; 20s local 2025-03-14T05:47:01.4428370Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local ... 2025-03-14T05:47:01.7574827Z 2025-03-14T05:47:01.7575658Z  2025-03-14T05:47:01.7576106Z  2025-03-14T05:47:01.7576456Z  2025-03-14T05:47:01.7576810Z  2025-03-14T05:47:01.7577165Z  2025-03-14T05:47:01.7577518Z  2025-03-14T05:47:01.7577877Z  2025-03-14T05:47:01.7578246Z  2025-03-14T05:47:01.7578761Z [13,522 / 15,235] 48 actions running 2025-03-14T05:47:01.7579447Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T05:47:01.7580345Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2025-03-14T05:47:01.7581282Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T05:47:01.7582133Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T05:47:01.7583456Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2025-03-14T05:47:01.7584492Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local 2025-03-14T05:47:01.7585312Z Compiling xla/service/buffer_assignment.cc; 20s local 2025-03-14T05:47:01.7586146Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local ... 2025-03-14T05:47:02.0069443Z 2025-03-14T05:47:02.0070280Z  2025-03-14T05:47:02.0070682Z  2025-03-14T05:47:02.0071011Z  2025-03-14T05:47:02.0071334Z  2025-03-14T05:47:02.0071665Z  2025-03-14T05:47:02.0071993Z  2025-03-14T05:47:02.0072316Z  2025-03-14T05:47:02.0072641Z  2025-03-14T05:47:02.0073126Z [13,525 / 15,235] 48 actions, 47 running 2025-03-14T05:47:02.0073749Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T05:47:02.0074481Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T05:47:02.0075275Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T05:47:02.0076127Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2025-03-14T05:47:02.0076978Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2025-03-14T05:47:02.0077744Z Compiling xla/service/buffer_assignment.cc; 20s local 2025-03-14T05:47:02.0078511Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 17s local 2025-03-14T05:47:02.0079394Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 13s local ... 2025-03-14T05:47:02.3361924Z 2025-03-14T05:47:02.3362810Z  2025-03-14T05:47:02.3363205Z  2025-03-14T05:47:02.3363788Z  2025-03-14T05:47:02.3364200Z  2025-03-14T05:47:02.3364796Z  2025-03-14T05:47:02.3365216Z  2025-03-14T05:47:02.3365878Z  2025-03-14T05:47:02.3367772Z  2025-03-14T05:47:02.3368816Z [13,526 / 15,235] 48 actions, 47 running 2025-03-14T05:47:02.3369723Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T05:47:02.3370708Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T05:47:02.3371828Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T05:47:02.3373008Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 23s local 2025-03-14T05:47:02.3374200Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2025-03-14T05:47:02.3374941Z Compiling xla/service/buffer_assignment.cc; 20s local 2025-03-14T05:47:02.3375685Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int2.cc; 18s local 2025-03-14T05:47:02.3376538Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 13s local ... 2025-03-14T05:47:02.5580710Z 2025-03-14T05:47:02.5581725Z  2025-03-14T05:47:02.5582212Z  2025-03-14T05:47:02.5582657Z  2025-03-14T05:47:02.5583027Z  2025-03-14T05:47:02.5583457Z  2025-03-14T05:47:02.5583840Z  2025-03-14T05:47:02.5584219Z  2025-03-14T05:47:02.5584614Z  2025-03-14T05:47:02.5585164Z [13,529 / 15,235] 48 actions running 2025-03-14T05:47:02.5585912Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T05:47:02.5586800Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T05:47:02.5587761Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T05:47:02.5588822Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2025-03-14T05:47:02.5589876Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local 2025-03-14T05:47:02.5590863Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T05:47:02.5591773Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 14s local 2025-03-14T05:47:02.5592788Z Compiling xla/service/hlo_proto_util.cc; 14s local ... 2025-03-14T05:47:02.9585877Z 2025-03-14T05:47:02.9587247Z  2025-03-14T05:47:02.9587734Z  2025-03-14T05:47:02.9588112Z  2025-03-14T05:47:02.9588480Z  2025-03-14T05:47:02.9588854Z  2025-03-14T05:47:02.9589235Z  2025-03-14T05:47:02.9589602Z  2025-03-14T05:47:02.9589993Z  2025-03-14T05:47:02.9590592Z [13,530 / 15,235] 48 actions running 2025-03-14T05:47:02.9591369Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T05:47:02.9592244Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T05:47:02.9593200Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T05:47:02.9594260Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2025-03-14T05:47:02.9595324Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2025-03-14T05:47:02.9596265Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T05:47:02.9597273Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 14s local 2025-03-14T05:47:02.9598255Z Compiling xla/service/hlo_proto_util.cc; 14s local ... 2025-03-14T05:47:03.1590820Z 2025-03-14T05:47:03.1591773Z  2025-03-14T05:47:03.1592317Z  2025-03-14T05:47:03.1592715Z  2025-03-14T05:47:03.1593110Z  2025-03-14T05:47:03.1593514Z  2025-03-14T05:47:03.1593904Z  2025-03-14T05:47:03.1594290Z  2025-03-14T05:47:03.1594672Z  2025-03-14T05:47:03.1595239Z [13,532 / 15,235] 48 actions running 2025-03-14T05:47:03.1596134Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T05:47:03.1597037Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T05:47:03.1598041Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T05:47:03.1599130Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 24s local 2025-03-14T05:47:03.1600704Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2025-03-14T05:47:03.1601699Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T05:47:03.1602681Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 14s local 2025-03-14T05:47:03.1603657Z Compiling xla/service/hlo_proto_util.cc; 14s local ... 2025-03-14T05:47:03.4576450Z 2025-03-14T05:47:03.4577479Z  2025-03-14T05:47:03.4578098Z  2025-03-14T05:47:03.4578476Z  2025-03-14T05:47:03.4578855Z  2025-03-14T05:47:03.4579251Z  2025-03-14T05:47:03.4579650Z  2025-03-14T05:47:03.4580131Z  2025-03-14T05:47:03.4580547Z  2025-03-14T05:47:03.4581148Z [13,534 / 15,235] 48 actions, 47 running 2025-03-14T05:47:03.4581923Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T05:47:03.4582810Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T05:47:03.4583853Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T05:47:03.4585013Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2025-03-14T05:47:03.4586160Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2025-03-14T05:47:03.4587133Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T05:47:03.4588157Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local 2025-03-14T05:47:03.4589233Z Compiling xla/service/hlo_proto_util.cc; 14s local ... 2025-03-14T05:47:03.7597519Z 2025-03-14T05:47:03.7598391Z  2025-03-14T05:47:03.7598960Z  2025-03-14T05:47:03.7599347Z  2025-03-14T05:47:03.7599736Z  2025-03-14T05:47:03.7600122Z  2025-03-14T05:47:03.7600505Z  2025-03-14T05:47:03.7600859Z  2025-03-14T05:47:03.7601236Z  2025-03-14T05:47:03.7601802Z [13,535 / 15,235] 48 actions running 2025-03-14T05:47:03.7602592Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T05:47:03.7603507Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T05:47:03.7605027Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T05:47:03.7606152Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2025-03-14T05:47:03.7607286Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local 2025-03-14T05:47:03.7608178Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T05:47:03.7609228Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local 2025-03-14T05:47:03.7610302Z Compiling xla/service/hlo_proto_util.cc; 15s local ... 2025-03-14T05:47:04.0867014Z 2025-03-14T05:47:04.0868076Z  2025-03-14T05:47:04.0868498Z  2025-03-14T05:47:04.0868869Z  2025-03-14T05:47:04.0869234Z  2025-03-14T05:47:04.0869611Z  2025-03-14T05:47:04.0870008Z  2025-03-14T05:47:04.0870385Z  2025-03-14T05:47:04.0870787Z  2025-03-14T05:47:04.0871444Z [13,536 / 15,235] 48 actions, 47 running 2025-03-14T05:47:04.0872243Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T05:47:04.0873046Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T05:47:04.0873973Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T05:47:04.0875009Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 25s local 2025-03-14T05:47:04.0876017Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2025-03-14T05:47:04.0876916Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T05:47:04.0877836Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local 2025-03-14T05:47:04.0878885Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int8.cc; 14s local ... 2025-03-14T05:47:04.3603561Z 2025-03-14T05:47:04.3604594Z  2025-03-14T05:47:04.3605148Z  2025-03-14T05:47:04.3605629Z  2025-03-14T05:47:04.3605983Z  2025-03-14T05:47:04.3606634Z  2025-03-14T05:47:04.3606992Z  2025-03-14T05:47:04.3607383Z  2025-03-14T05:47:04.3607751Z  2025-03-14T05:47:04.3608297Z [13,536 / 15,235] 48 actions running 2025-03-14T05:47:04.3609014Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T05:47:04.3609869Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T05:47:04.3610766Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T05:47:04.3611799Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2025-03-14T05:47:04.3612917Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2025-03-14T05:47:04.3613937Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T05:47:04.3615104Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 15s local 2025-03-14T05:47:04.3616361Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int8.cc; 14s local ... 2025-03-14T05:47:04.6991150Z 2025-03-14T05:47:04.6992140Z  2025-03-14T05:47:04.6992638Z  2025-03-14T05:47:04.6993026Z  2025-03-14T05:47:04.6993428Z  2025-03-14T05:47:04.6993842Z  2025-03-14T05:47:04.6994231Z  2025-03-14T05:47:04.6994628Z  2025-03-14T05:47:04.6995025Z  2025-03-14T05:47:04.6995625Z [13,539 / 15,235] 48 actions, 47 running 2025-03-14T05:47:04.6996403Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T05:47:04.6997268Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T05:47:04.6998251Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T05:47:04.6999323Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2025-03-14T05:47:04.7000410Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local 2025-03-14T05:47:04.7001501Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T05:47:04.7002493Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 16s local 2025-03-14T05:47:04.7003942Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int8.cc; 14s local ... 2025-03-14T05:47:04.9534904Z 2025-03-14T05:47:04.9536032Z  2025-03-14T05:47:04.9536570Z  2025-03-14T05:47:04.9537050Z  2025-03-14T05:47:04.9537447Z  2025-03-14T05:47:04.9537837Z  2025-03-14T05:47:04.9538220Z  2025-03-14T05:47:04.9538597Z  2025-03-14T05:47:04.9538966Z  2025-03-14T05:47:04.9539565Z [13,542 / 15,235] 47 actions, 46 running 2025-03-14T05:47:04.9540336Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T05:47:04.9541195Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T05:47:04.9542133Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2025-03-14T05:47:04.9543188Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2025-03-14T05:47:04.9544196Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2025-03-14T05:47:04.9544923Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T05:47:04.9545643Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 16s local 2025-03-14T05:47:04.9546585Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int8.cc; 15s local ... 2025-03-14T05:47:05.1609953Z 2025-03-14T05:47:05.1610936Z  2025-03-14T05:47:05.1611414Z  2025-03-14T05:47:05.1611791Z  2025-03-14T05:47:05.1612164Z  2025-03-14T05:47:05.1612530Z  2025-03-14T05:47:05.1612927Z  2025-03-14T05:47:05.1613331Z  2025-03-14T05:47:05.1613728Z  2025-03-14T05:47:05.1614261Z [13,544 / 15,235] 48 actions running 2025-03-14T05:47:05.1615012Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T05:47:05.1615912Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T05:47:05.1617256Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2025-03-14T05:47:05.1618343Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 26s local 2025-03-14T05:47:05.1619430Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2025-03-14T05:47:05.1620389Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T05:47:05.1621355Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 16s local 2025-03-14T05:47:05.1622447Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int8.cc; 15s local ... 2025-03-14T05:47:05.5615712Z 2025-03-14T05:47:05.5616685Z  2025-03-14T05:47:05.5617174Z  2025-03-14T05:47:05.5617591Z  2025-03-14T05:47:05.5618023Z  2025-03-14T05:47:05.5618421Z  2025-03-14T05:47:05.5618845Z  2025-03-14T05:47:05.5619243Z  2025-03-14T05:47:05.5619646Z  2025-03-14T05:47:05.5620214Z [13,545 / 15,235] 48 actions running 2025-03-14T05:47:05.5621024Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T05:47:05.5621912Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2025-03-14T05:47:05.5622861Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2025-03-14T05:47:05.5623914Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2025-03-14T05:47:05.5625022Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local 2025-03-14T05:47:05.5626004Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T05:47:05.5627031Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2025-03-14T05:47:05.5628190Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int8.cc; 15s local ... 2025-03-14T05:47:05.8953416Z 2025-03-14T05:47:05.8954280Z  2025-03-14T05:47:05.8954743Z  2025-03-14T05:47:05.8955124Z  2025-03-14T05:47:05.8955514Z  2025-03-14T05:47:05.8955907Z  2025-03-14T05:47:05.8956292Z  2025-03-14T05:47:05.8956677Z  2025-03-14T05:47:05.8957079Z  2025-03-14T05:47:05.8957673Z [13,547 / 15,235] 48 actions, 47 running 2025-03-14T05:47:05.8958798Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T05:47:05.8959712Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T05:47:05.8960780Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2025-03-14T05:47:05.8961799Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2025-03-14T05:47:05.8962751Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T05:47:05.8963700Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2025-03-14T05:47:05.8964904Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 15s local 2025-03-14T05:47:05.8966009Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2025-03-14T05:47:06.1621980Z 2025-03-14T05:47:06.1622827Z  2025-03-14T05:47:06.1623255Z  2025-03-14T05:47:06.1623661Z  2025-03-14T05:47:06.1624059Z  2025-03-14T05:47:06.1624484Z  2025-03-14T05:47:06.1624889Z  2025-03-14T05:47:06.1625261Z  2025-03-14T05:47:06.1625669Z  2025-03-14T05:47:06.1626272Z [13,547 / 15,235] 48 actions running 2025-03-14T05:47:06.1627045Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T05:47:06.1628025Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T05:47:06.1629054Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 27s local 2025-03-14T05:47:06.1630139Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2025-03-14T05:47:06.1631092Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T05:47:06.1632104Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 17s local 2025-03-14T05:47:06.1633090Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int64.cc; 16s local 2025-03-14T05:47:06.1634300Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T05:47:06.5627964Z 2025-03-14T05:47:06.5628943Z  2025-03-14T05:47:06.5629467Z  2025-03-14T05:47:06.5629915Z  2025-03-14T05:47:06.5630351Z  2025-03-14T05:47:06.5630784Z  2025-03-14T05:47:06.5631210Z  2025-03-14T05:47:06.5631623Z  2025-03-14T05:47:06.5632039Z  2025-03-14T05:47:06.5632646Z [13,549 / 15,235] 48 actions running 2025-03-14T05:47:06.5633574Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T05:47:06.5634608Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T05:47:06.5635750Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2025-03-14T05:47:06.5636919Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2025-03-14T05:47:06.5637948Z Compiling xla/service/buffer_assignment.cc; 25s local 2025-03-14T05:47:06.5638966Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 18s local 2025-03-14T05:47:06.5640073Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2025-03-14T05:47:06.5641112Z Compiling xla/backends/cpu/runtime/thunk.cc; 14s local ... 2025-03-14T05:47:06.7632082Z 2025-03-14T05:47:06.7632954Z  2025-03-14T05:47:06.7633529Z  2025-03-14T05:47:06.7633910Z  2025-03-14T05:47:06.7634322Z  2025-03-14T05:47:06.7634726Z  2025-03-14T05:47:06.7635121Z  2025-03-14T05:47:06.7635519Z  2025-03-14T05:47:06.7635950Z  2025-03-14T05:47:06.7636549Z [13,550 / 15,235] 48 actions running 2025-03-14T05:47:06.7637374Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T05:47:06.7638315Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T05:47:06.7639421Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2025-03-14T05:47:06.7640609Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local 2025-03-14T05:47:06.7641753Z Compiling xla/service/buffer_assignment.cc; 25s local 2025-03-14T05:47:06.7643172Z Compiling xla/hlo/evaluator/hlo_evaluator_typed_visitor_int4.cc; 18s local 2025-03-14T05:47:06.7644316Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 14s local 2025-03-14T05:47:06.7645624Z Compiling xla/backends/cpu/runtime/thunk.cc; 14s local ... 2025-03-14T05:47:07.1164755Z 2025-03-14T05:47:07.1167148Z  2025-03-14T05:47:07.1167667Z  2025-03-14T05:47:07.1168124Z  2025-03-14T05:47:07.1168563Z  2025-03-14T05:47:07.1168987Z  2025-03-14T05:47:07.1169413Z  2025-03-14T05:47:07.1169841Z  2025-03-14T05:47:07.1170256Z  2025-03-14T05:47:07.1170904Z [13,554 / 15,235] 48 actions, 47 running 2025-03-14T05:47:07.1171732Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T05:47:07.1172843Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T05:47:07.1174003Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 28s local 2025-03-14T05:47:07.1175147Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2025-03-14T05:47:07.1176106Z Compiling xla/service/buffer_assignment.cc; 25s local 2025-03-14T05:47:07.1176864Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 15s local 2025-03-14T05:47:07.1177856Z Compiling xla/backends/cpu/runtime/thunk.cc; 14s local 2025-03-14T05:47:07.1178749Z Compiling xla/service/cpu/buffer_info_util.cc; 11s local ... 2025-03-14T05:47:07.3637936Z 2025-03-14T05:47:07.3638917Z  2025-03-14T05:47:07.3639456Z  2025-03-14T05:47:07.3639935Z  2025-03-14T05:47:07.3640408Z  2025-03-14T05:47:07.3640776Z  2025-03-14T05:47:07.3641159Z  2025-03-14T05:47:07.3641544Z  2025-03-14T05:47:07.3641914Z  2025-03-14T05:47:07.3642488Z [13,554 / 15,235] 48 actions running 2025-03-14T05:47:07.3643731Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T05:47:07.3644867Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T05:47:07.3646000Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2025-03-14T05:47:07.3647073Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2025-03-14T05:47:07.3648033Z Compiling xla/service/buffer_assignment.cc; 25s local 2025-03-14T05:47:07.3648964Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 15s local 2025-03-14T05:47:07.3650065Z Compiling xla/backends/cpu/runtime/thunk.cc; 14s local 2025-03-14T05:47:07.3651038Z Compiling xla/service/cpu/buffer_info_util.cc; 12s local ... 2025-03-14T05:47:07.5642484Z 2025-03-14T05:47:07.5643402Z  2025-03-14T05:47:07.5643935Z  2025-03-14T05:47:07.5644320Z  2025-03-14T05:47:07.5644826Z  2025-03-14T05:47:07.5645226Z  2025-03-14T05:47:07.5645664Z  2025-03-14T05:47:07.5646078Z  2025-03-14T05:47:07.5646505Z  2025-03-14T05:47:07.5647060Z [13,556 / 15,235] 48 actions running 2025-03-14T05:47:07.5647843Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T05:47:07.5648873Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T05:47:07.5649993Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2025-03-14T05:47:07.5651110Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2025-03-14T05:47:07.5652061Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T05:47:07.5652976Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint16.cc; 15s local 2025-03-14T05:47:07.5653872Z Compiling xla/backends/cpu/runtime/thunk.cc; 15s local 2025-03-14T05:47:07.5654767Z Compiling xla/service/cpu/buffer_info_util.cc; 12s local ... 2025-03-14T05:47:07.9023940Z 2025-03-14T05:47:07.9025067Z  2025-03-14T05:47:07.9025511Z  2025-03-14T05:47:07.9025899Z  2025-03-14T05:47:07.9026347Z  2025-03-14T05:47:07.9026790Z  2025-03-14T05:47:07.9027583Z  2025-03-14T05:47:07.9028016Z  2025-03-14T05:47:07.9028424Z  2025-03-14T05:47:07.9029054Z [13,557 / 15,235] 48 actions, 47 running 2025-03-14T05:47:07.9029872Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T05:47:07.9030900Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T05:47:07.9032026Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2025-03-14T05:47:07.9033191Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2025-03-14T05:47:07.9034262Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T05:47:07.9035062Z Compiling xla/backends/cpu/runtime/thunk.cc; 15s local 2025-03-14T05:47:07.9035912Z Compiling xla/service/cpu/buffer_info_util.cc; 12s local 2025-03-14T05:47:07.9036779Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local ... 2025-03-14T05:47:08.1133738Z 2025-03-14T05:47:08.1134644Z  2025-03-14T05:47:08.1135125Z  2025-03-14T05:47:08.1135546Z  2025-03-14T05:47:08.1136046Z  2025-03-14T05:47:08.1136493Z  2025-03-14T05:47:08.1136897Z  2025-03-14T05:47:08.1137336Z  2025-03-14T05:47:08.1137745Z  2025-03-14T05:47:08.1138405Z [13,560 / 15,235] 48 actions, 47 running 2025-03-14T05:47:08.1139194Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T05:47:08.1140161Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T05:47:08.1141227Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 29s local 2025-03-14T05:47:08.1142310Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2025-03-14T05:47:08.1143323Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T05:47:08.1144050Z Compiling xla/backends/cpu/runtime/thunk.cc; 15s local 2025-03-14T05:47:08.1145250Z Compiling xla/service/cpu/buffer_info_util.cc; 12s local 2025-03-14T05:47:08.1146111Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local ... 2025-03-14T05:47:08.3649438Z 2025-03-14T05:47:08.3650368Z  2025-03-14T05:47:08.3650863Z  2025-03-14T05:47:08.3651254Z  2025-03-14T05:47:08.3651669Z  2025-03-14T05:47:08.3652058Z  2025-03-14T05:47:08.3652451Z  2025-03-14T05:47:08.3652843Z  2025-03-14T05:47:08.3653227Z  2025-03-14T05:47:08.3653775Z [13,563 / 15,235] 48 actions running 2025-03-14T05:47:08.3654589Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T05:47:08.3655556Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T05:47:08.3656621Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2025-03-14T05:47:08.3657721Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2025-03-14T05:47:08.3658735Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T05:47:08.3659559Z Compiling xla/backends/cpu/runtime/thunk.cc; 15s local 2025-03-14T05:47:08.3660459Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local 2025-03-14T05:47:08.3661441Z Compiling llvm/lib/CodeGen/AsmPrinter/AccelTable.cpp; 9s local ... 2025-03-14T05:47:08.5653756Z 2025-03-14T05:47:08.5654600Z  2025-03-14T05:47:08.5655076Z  2025-03-14T05:47:08.5655509Z  2025-03-14T05:47:08.5655957Z  2025-03-14T05:47:08.5656367Z  2025-03-14T05:47:08.5656787Z  2025-03-14T05:47:08.5657167Z  2025-03-14T05:47:08.5657551Z  2025-03-14T05:47:08.5658140Z [13,564 / 15,235] 48 actions running 2025-03-14T05:47:08.5658946Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T05:47:08.5659954Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T05:47:08.5661058Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2025-03-14T05:47:08.5662250Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2025-03-14T05:47:08.5663702Z Compiling xla/service/buffer_assignment.cc; 27s local 2025-03-14T05:47:08.5664560Z Compiling xla/backends/cpu/runtime/thunk.cc; 16s local 2025-03-14T05:47:08.5665675Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local 2025-03-14T05:47:08.5666675Z Compiling llvm/lib/CodeGen/AsmPrinter/AccelTable.cpp; 10s local ... 2025-03-14T05:47:08.9659763Z 2025-03-14T05:47:08.9660650Z  2025-03-14T05:47:08.9661142Z  2025-03-14T05:47:08.9661550Z  2025-03-14T05:47:08.9661923Z  2025-03-14T05:47:08.9662369Z  2025-03-14T05:47:08.9662771Z  2025-03-14T05:47:08.9663178Z  2025-03-14T05:47:08.9663561Z  2025-03-14T05:47:08.9664163Z [13,565 / 15,235] 48 actions running 2025-03-14T05:47:08.9665104Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T05:47:08.9666416Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2025-03-14T05:47:08.9667550Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 30s local 2025-03-14T05:47:08.9668696Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2025-03-14T05:47:08.9669748Z Compiling xla/service/buffer_assignment.cc; 27s local 2025-03-14T05:47:08.9670582Z Compiling xla/backends/cpu/runtime/thunk.cc; 16s local 2025-03-14T05:47:08.9671419Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local 2025-03-14T05:47:08.9672408Z Compiling llvm/lib/CodeGen/AsmPrinter/AccelTable.cpp; 10s local ... 2025-03-14T05:47:09.4235787Z 2025-03-14T05:47:09.4236645Z  2025-03-14T05:47:09.4237106Z  2025-03-14T05:47:09.4237496Z  2025-03-14T05:47:09.4237902Z  2025-03-14T05:47:09.4238300Z  2025-03-14T05:47:09.4238695Z  2025-03-14T05:47:09.4239070Z  2025-03-14T05:47:09.4239446Z  2025-03-14T05:47:09.4239996Z [13,566 / 15,235] 48 actions, 47 running 2025-03-14T05:47:09.4241112Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T05:47:09.4242114Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2025-03-14T05:47:09.4243296Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2025-03-14T05:47:09.4244350Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2025-03-14T05:47:09.4245323Z Compiling xla/service/buffer_assignment.cc; 28s local 2025-03-14T05:47:09.4245942Z Compiling xla/backends/cpu/runtime/thunk.cc; 16s local 2025-03-14T05:47:09.4246565Z Compiling xla/service/cpu/buffer_info_util.cc; 14s local 2025-03-14T05:47:09.4247471Z Compiling llvm/lib/CodeGen/AsmPrinter/AccelTable.cpp; 10s local ... 2025-03-14T05:47:09.7667292Z 2025-03-14T05:47:09.7668138Z  2025-03-14T05:47:09.7668621Z  2025-03-14T05:47:09.7669042Z  2025-03-14T05:47:09.7669458Z  2025-03-14T05:47:09.7669853Z  2025-03-14T05:47:09.7670277Z  2025-03-14T05:47:09.7670725Z  2025-03-14T05:47:09.7671144Z  2025-03-14T05:47:09.7671753Z [13,568 / 15,235] 48 actions running 2025-03-14T05:47:09.7672570Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T05:47:09.7673565Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2025-03-14T05:47:09.7674695Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2025-03-14T05:47:09.7675830Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2025-03-14T05:47:09.7676842Z Compiling xla/service/buffer_assignment.cc; 28s local 2025-03-14T05:47:09.7677704Z Compiling xla/service/cpu/buffer_info_util.cc; 14s local 2025-03-14T05:47:09.7678787Z Compiling llvm/lib/CodeGen/AsmPrinter/AccelTable.cpp; 11s local 2025-03-14T05:47:09.7679837Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 10s local ... 2025-03-14T05:47:09.9671991Z 2025-03-14T05:47:09.9672812Z  2025-03-14T05:47:09.9673236Z  2025-03-14T05:47:09.9673668Z  2025-03-14T05:47:09.9674368Z  2025-03-14T05:47:09.9674724Z  2025-03-14T05:47:09.9675074Z  2025-03-14T05:47:09.9675428Z  2025-03-14T05:47:09.9675783Z  2025-03-14T05:47:09.9676261Z [13,570 / 15,235] 48 actions running 2025-03-14T05:47:09.9676946Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T05:47:09.9677774Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T05:47:09.9678719Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2025-03-14T05:47:09.9679762Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2025-03-14T05:47:09.9680595Z Compiling xla/service/buffer_assignment.cc; 28s local 2025-03-14T05:47:09.9681368Z Compiling llvm/lib/CodeGen/AsmPrinter/AccelTable.cpp; 11s local 2025-03-14T05:47:09.9682213Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 10s local 2025-03-14T05:47:09.9683116Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 9s local ... 2025-03-14T05:47:10.3568746Z 2025-03-14T05:47:10.3569588Z  2025-03-14T05:47:10.3570002Z  2025-03-14T05:47:10.3570358Z  2025-03-14T05:47:10.3570721Z  2025-03-14T05:47:10.3571071Z  2025-03-14T05:47:10.3572182Z  2025-03-14T05:47:10.3572678Z  2025-03-14T05:47:10.3573122Z  2025-03-14T05:47:10.3573774Z [13,574 / 15,235] 48 actions, 47 running 2025-03-14T05:47:10.3574611Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T05:47:10.3575658Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T05:47:10.3576913Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 32s local 2025-03-14T05:47:10.3578079Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2025-03-14T05:47:10.3579218Z Compiling xla/service/buffer_assignment.cc; 28s local 2025-03-14T05:47:10.3581739Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 11s local 2025-03-14T05:47:10.3582927Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 10s local 2025-03-14T05:47:10.3584050Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 9s local ... 2025-03-14T05:47:10.5673831Z 2025-03-14T05:47:10.5674728Z  2025-03-14T05:47:10.5675137Z  2025-03-14T05:47:10.5675487Z  2025-03-14T05:47:10.5675839Z  2025-03-14T05:47:10.5676189Z  2025-03-14T05:47:10.5676545Z  2025-03-14T05:47:10.5676891Z  2025-03-14T05:47:10.5677242Z  2025-03-14T05:47:10.5677778Z [13,577 / 15,235] 48 actions, 47 running 2025-03-14T05:47:10.5678488Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T05:47:10.5679350Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T05:47:10.5680386Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2025-03-14T05:47:10.5681470Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 11s local 2025-03-14T05:47:10.5682471Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 10s local 2025-03-14T05:47:10.5683586Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 9s local 2025-03-14T05:47:10.5684717Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 9s local 2025-03-14T05:47:10.5685605Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 8s local ... 2025-03-14T05:47:10.7925544Z 2025-03-14T05:47:10.7926518Z  2025-03-14T05:47:10.7927006Z  2025-03-14T05:47:10.7927426Z  2025-03-14T05:47:10.7927790Z  2025-03-14T05:47:10.7928138Z  2025-03-14T05:47:10.7928543Z  2025-03-14T05:47:10.7928933Z  2025-03-14T05:47:10.7929425Z  2025-03-14T05:47:10.7930149Z [13,579 / 15,235] 48 actions, 47 running 2025-03-14T05:47:10.7930993Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T05:47:10.7932030Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T05:47:10.7933167Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2025-03-14T05:47:10.7934743Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 11s local 2025-03-14T05:47:10.7935734Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 10s local 2025-03-14T05:47:10.7936825Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 9s local 2025-03-14T05:47:10.7937895Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 9s local 2025-03-14T05:47:10.7938847Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 8s local ... 2025-03-14T05:47:11.1680659Z 2025-03-14T05:47:11.1681464Z  2025-03-14T05:47:11.1681984Z  2025-03-14T05:47:11.1682340Z  2025-03-14T05:47:11.1682717Z  2025-03-14T05:47:11.1683098Z  2025-03-14T05:47:11.1683494Z  2025-03-14T05:47:11.1683948Z  2025-03-14T05:47:11.1684332Z  2025-03-14T05:47:11.1685040Z [13,579 / 15,235] 48 actions running 2025-03-14T05:47:11.1685832Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T05:47:11.1686778Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T05:47:11.1687928Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2025-03-14T05:47:11.1688952Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 12s local 2025-03-14T05:47:11.1689964Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 10s local 2025-03-14T05:47:11.1691015Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 10s local 2025-03-14T05:47:11.1691970Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 9s local 2025-03-14T05:47:11.1692911Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 8s local ... 2025-03-14T05:47:11.4070630Z 2025-03-14T05:47:11.4071502Z  2025-03-14T05:47:11.4072026Z  2025-03-14T05:47:11.4072426Z  2025-03-14T05:47:11.4072867Z  2025-03-14T05:47:11.4073298Z  2025-03-14T05:47:11.4073739Z  2025-03-14T05:47:11.4074118Z  2025-03-14T05:47:11.4074941Z  2025-03-14T05:47:11.4075597Z [13,580 / 15,235] 48 actions, 47 running 2025-03-14T05:47:11.4076538Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T05:47:11.4077476Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T05:47:11.4078610Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2025-03-14T05:47:11.4079574Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 12s local 2025-03-14T05:47:11.4080589Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 11s local 2025-03-14T05:47:11.4081536Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 10s local 2025-03-14T05:47:11.4082456Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 9s local 2025-03-14T05:47:11.4083395Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 8s local ... 2025-03-14T05:47:11.7686895Z 2025-03-14T05:47:11.7687809Z  2025-03-14T05:47:11.7688289Z  2025-03-14T05:47:11.7688685Z  2025-03-14T05:47:11.7689086Z  2025-03-14T05:47:11.7689593Z  2025-03-14T05:47:11.7690039Z  2025-03-14T05:47:11.7690429Z  2025-03-14T05:47:11.7690779Z  2025-03-14T05:47:11.7691363Z [13,580 / 15,235] 48 actions running 2025-03-14T05:47:11.7692197Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T05:47:11.7693232Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T05:47:11.7694342Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2025-03-14T05:47:11.7695425Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 12s local 2025-03-14T05:47:11.7696436Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 11s local 2025-03-14T05:47:11.7697485Z Compiling llvm/lib/Transforms/Scalar/JumpThreading.cpp; 10s local 2025-03-14T05:47:11.7698369Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 10s local 2025-03-14T05:47:11.7699406Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local ... 2025-03-14T05:47:11.9929140Z 2025-03-14T05:47:11.9929999Z  2025-03-14T05:47:11.9930921Z  2025-03-14T05:47:11.9931346Z  2025-03-14T05:47:11.9931759Z  2025-03-14T05:47:11.9932168Z  2025-03-14T05:47:11.9932586Z  2025-03-14T05:47:11.9932993Z  2025-03-14T05:47:11.9933403Z  2025-03-14T05:47:11.9933994Z [13,581 / 15,235] 48 actions, 47 running 2025-03-14T05:47:11.9934792Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2025-03-14T05:47:11.9935815Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T05:47:11.9936908Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2025-03-14T05:47:11.9938006Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 12s local 2025-03-14T05:47:11.9939026Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 11s local 2025-03-14T05:47:11.9939977Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 10s local 2025-03-14T05:47:11.9940874Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local 2025-03-14T05:47:11.9941867Z Compiling llvm/lib/Transforms/Scalar/Scalarizer.cpp; 9s local ... 2025-03-14T05:47:12.3031078Z 2025-03-14T05:47:12.3031884Z  2025-03-14T05:47:12.3032370Z  2025-03-14T05:47:12.3032840Z  2025-03-14T05:47:12.3033239Z  2025-03-14T05:47:12.3033652Z  2025-03-14T05:47:12.3034075Z  2025-03-14T05:47:12.3034491Z  2025-03-14T05:47:12.3034853Z  2025-03-14T05:47:12.3035465Z [13,582 / 15,235] 48 actions, 47 running 2025-03-14T05:47:12.3036226Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2025-03-14T05:47:12.3037191Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T05:47:12.3038274Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2025-03-14T05:47:12.3039378Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 13s local 2025-03-14T05:47:12.3040790Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 11s local 2025-03-14T05:47:12.3041756Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 10s local 2025-03-14T05:47:12.3042622Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 9s local 2025-03-14T05:47:12.3043574Z Compiling llvm/lib/Transforms/Scalar/Scalarizer.cpp; 9s local ... 2025-03-14T05:47:12.5693126Z 2025-03-14T05:47:12.5693986Z  2025-03-14T05:47:12.5694479Z  2025-03-14T05:47:12.5694873Z  2025-03-14T05:47:12.5695252Z  2025-03-14T05:47:12.5695638Z  2025-03-14T05:47:12.5696035Z  2025-03-14T05:47:12.5696442Z  2025-03-14T05:47:12.5696830Z  2025-03-14T05:47:12.5697371Z [13,584 / 15,235] 48 actions running 2025-03-14T05:47:12.5698145Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2025-03-14T05:47:12.5699496Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T05:47:12.5700764Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local 2025-03-14T05:47:12.5702010Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 13s local 2025-03-14T05:47:12.5706728Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 12s local 2025-03-14T05:47:12.5707794Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 11s local 2025-03-14T05:47:12.5708790Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2025-03-14T05:47:12.5710093Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 9s local ... 2025-03-14T05:47:12.9935529Z 2025-03-14T05:47:12.9936364Z  2025-03-14T05:47:12.9936795Z  2025-03-14T05:47:12.9937436Z  2025-03-14T05:47:12.9937797Z  2025-03-14T05:47:12.9938249Z  2025-03-14T05:47:12.9938707Z  2025-03-14T05:47:12.9939177Z  2025-03-14T05:47:12.9939633Z  2025-03-14T05:47:12.9940250Z [13,585 / 15,235] 48 actions, 47 running 2025-03-14T05:47:12.9941057Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2025-03-14T05:47:12.9942041Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T05:47:12.9943460Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2025-03-14T05:47:12.9944471Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 13s local 2025-03-14T05:47:12.9945441Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 12s local 2025-03-14T05:47:12.9946310Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 11s local 2025-03-14T05:47:12.9947202Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2025-03-14T05:47:12.9948160Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 9s local ... 2025-03-14T05:47:13.2847664Z 2025-03-14T05:47:13.2848579Z  2025-03-14T05:47:13.2849065Z  2025-03-14T05:47:13.2849443Z  2025-03-14T05:47:13.2849812Z  2025-03-14T05:47:13.2850218Z  2025-03-14T05:47:13.2850579Z  2025-03-14T05:47:13.2850958Z  2025-03-14T05:47:13.2851343Z  2025-03-14T05:47:13.2851966Z [13,586 / 15,235] 48 actions, 47 running 2025-03-14T05:47:13.2862179Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2025-03-14T05:47:13.2863159Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T05:47:13.2864221Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2025-03-14T05:47:13.2865251Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 14s local 2025-03-14T05:47:13.2866397Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 12s local 2025-03-14T05:47:13.2867240Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 11s local 2025-03-14T05:47:13.2868068Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 10s local 2025-03-14T05:47:13.2868990Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 10s local ... 2025-03-14T05:47:13.5700939Z 2025-03-14T05:47:13.5701732Z  2025-03-14T05:47:13.5702193Z  2025-03-14T05:47:13.5702606Z  2025-03-14T05:47:13.5703003Z  2025-03-14T05:47:13.5703389Z  2025-03-14T05:47:13.5704164Z  2025-03-14T05:47:13.5704596Z  2025-03-14T05:47:13.5704990Z  2025-03-14T05:47:13.5705562Z [13,586 / 15,235] 48 actions running 2025-03-14T05:47:13.5706325Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2025-03-14T05:47:13.5707266Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T05:47:13.5708326Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2025-03-14T05:47:13.5709386Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 14s local 2025-03-14T05:47:13.5710389Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 13s local 2025-03-14T05:47:13.5711413Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 12s local 2025-03-14T05:47:13.5712328Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2025-03-14T05:47:13.5713308Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 10s local ... 2025-03-14T05:47:13.9705803Z 2025-03-14T05:47:13.9707020Z  2025-03-14T05:47:13.9707501Z  2025-03-14T05:47:13.9707915Z  2025-03-14T05:47:13.9708310Z  2025-03-14T05:47:13.9708692Z  2025-03-14T05:47:13.9709092Z  2025-03-14T05:47:13.9709464Z  2025-03-14T05:47:13.9709858Z  2025-03-14T05:47:13.9710421Z [13,588 / 15,235] 48 actions running 2025-03-14T05:47:13.9711155Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T05:47:13.9712057Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T05:47:13.9713080Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2025-03-14T05:47:13.9714102Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 14s local 2025-03-14T05:47:13.9715013Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 13s local 2025-03-14T05:47:13.9715910Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 12s local 2025-03-14T05:47:13.9716824Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2025-03-14T05:47:13.9717785Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 10s local ... 2025-03-14T05:47:14.3711582Z 2025-03-14T05:47:14.3712902Z  2025-03-14T05:47:14.3713370Z  2025-03-14T05:47:14.3713759Z  2025-03-14T05:47:14.3714195Z  2025-03-14T05:47:14.3714599Z  2025-03-14T05:47:14.3715011Z  2025-03-14T05:47:14.3715450Z  2025-03-14T05:47:14.3715839Z  2025-03-14T05:47:14.3716413Z [13,591 / 15,235] 48 actions running 2025-03-14T05:47:14.3717288Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T05:47:14.3718345Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T05:47:14.3719547Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2025-03-14T05:47:14.3720855Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 15s local 2025-03-14T05:47:14.3721926Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 14s local 2025-03-14T05:47:14.3722863Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 12s local 2025-03-14T05:47:14.3723787Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 11s local 2025-03-14T05:47:14.3725006Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 11s local ... 2025-03-14T05:47:14.6112742Z 2025-03-14T05:47:14.6113559Z  2025-03-14T05:47:14.6114055Z  2025-03-14T05:47:14.6114487Z  2025-03-14T05:47:14.6114893Z  2025-03-14T05:47:14.6115285Z  2025-03-14T05:47:14.6115676Z  2025-03-14T05:47:14.6116070Z  2025-03-14T05:47:14.6116478Z  2025-03-14T05:47:14.6117075Z [13,592 / 15,235] 48 actions, 47 running 2025-03-14T05:47:14.6117889Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T05:47:14.6118908Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T05:47:14.6120094Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2025-03-14T05:47:14.6121542Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 15s local 2025-03-14T05:47:14.6122616Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 14s local 2025-03-14T05:47:14.6123634Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 13s local 2025-03-14T05:47:14.6124336Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2025-03-14T05:47:14.6125467Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 11s local ... 2025-03-14T05:47:14.9717574Z 2025-03-14T05:47:14.9718427Z  2025-03-14T05:47:14.9718946Z  2025-03-14T05:47:14.9719395Z  2025-03-14T05:47:14.9719776Z  2025-03-14T05:47:14.9720172Z  2025-03-14T05:47:14.9720582Z  2025-03-14T05:47:14.9720981Z  2025-03-14T05:47:14.9721393Z  2025-03-14T05:47:14.9721993Z [13,597 / 15,235] 48 actions running 2025-03-14T05:47:14.9722758Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T05:47:14.9723745Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2025-03-14T05:47:14.9724997Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2025-03-14T05:47:14.9726062Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 15s local 2025-03-14T05:47:14.9727059Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 14s local 2025-03-14T05:47:14.9727955Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 13s local 2025-03-14T05:47:14.9728841Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local 2025-03-14T05:47:14.9729817Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 11s local ... 2025-03-14T05:47:15.5724727Z 2025-03-14T05:47:15.5725537Z  2025-03-14T05:47:15.5726168Z  2025-03-14T05:47:15.5726575Z  2025-03-14T05:47:15.5727048Z  2025-03-14T05:47:15.5727466Z  2025-03-14T05:47:15.5727920Z  2025-03-14T05:47:15.5728503Z  2025-03-14T05:47:15.5728977Z  2025-03-14T05:47:15.5729605Z [13,598 / 15,235] 47 actions running 2025-03-14T05:47:15.5730478Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T05:47:15.5731796Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2025-03-14T05:47:15.5732902Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2025-03-14T05:47:15.5734029Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local 2025-03-14T05:47:15.5735020Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 15s local 2025-03-14T05:47:15.5736013Z Compiling llvm/lib/Transforms/Scalar/LICM.cpp; 14s local 2025-03-14T05:47:15.5736929Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local 2025-03-14T05:47:15.5738025Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 12s local ... 2025-03-14T05:47:15.7736748Z 2025-03-14T05:47:15.7737691Z  2025-03-14T05:47:15.7738120Z  2025-03-14T05:47:15.7738468Z  2025-03-14T05:47:15.7738805Z  2025-03-14T05:47:15.7739129Z  2025-03-14T05:47:15.7739487Z  2025-03-14T05:47:15.7739860Z  2025-03-14T05:47:15.7740201Z  2025-03-14T05:47:15.7740729Z [13,603 / 15,235] 48 actions, 47 running 2025-03-14T05:47:15.7741385Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T05:47:15.7742197Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T05:47:15.7743131Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2025-03-14T05:47:15.7743999Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 16s local 2025-03-14T05:47:15.7744975Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 15s local 2025-03-14T05:47:15.7745900Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 12s local 2025-03-14T05:47:15.7746862Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 12s local 2025-03-14T05:47:15.7747750Z Compiling xla/service/xla_debug_info_manager.cc; 11s local ... 2025-03-14T05:47:16.1157512Z 2025-03-14T05:47:16.1159064Z  2025-03-14T05:47:16.1159567Z  2025-03-14T05:47:16.1160363Z  2025-03-14T05:47:16.1160793Z  2025-03-14T05:47:16.1161340Z  2025-03-14T05:47:16.1161710Z  2025-03-14T05:47:16.1162091Z  2025-03-14T05:47:16.1162475Z  2025-03-14T05:47:16.1163061Z [13,604 / 15,235] 48 actions, 47 running 2025-03-14T05:47:16.1163863Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T05:47:16.1164965Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T05:47:16.1166327Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2025-03-14T05:47:16.1167384Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local 2025-03-14T05:47:16.1168359Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 15s local 2025-03-14T05:47:16.1169352Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 13s local 2025-03-14T05:47:16.1170365Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 12s local 2025-03-14T05:47:16.1171515Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T05:47:16.3208648Z 2025-03-14T05:47:16.3210052Z  2025-03-14T05:47:16.3210538Z  2025-03-14T05:47:16.3210925Z  2025-03-14T05:47:16.3211283Z  2025-03-14T05:47:16.3211670Z  2025-03-14T05:47:16.3212049Z  2025-03-14T05:47:16.3212449Z  2025-03-14T05:47:16.3212829Z  2025-03-14T05:47:16.3213445Z [13,606 / 15,235] 48 actions, 47 running 2025-03-14T05:47:16.3214242Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T05:47:16.3215139Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T05:47:16.3216184Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2025-03-14T05:47:16.3217292Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local 2025-03-14T05:47:16.3218216Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 15s local 2025-03-14T05:47:16.3219210Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 13s local 2025-03-14T05:47:16.3220657Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 12s local 2025-03-14T05:47:16.3221580Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T05:47:16.5732275Z 2025-03-14T05:47:16.5733631Z  2025-03-14T05:47:16.5734110Z  2025-03-14T05:47:16.5734527Z  2025-03-14T05:47:16.5734904Z  2025-03-14T05:47:16.5735278Z  2025-03-14T05:47:16.5735676Z  2025-03-14T05:47:16.5736072Z  2025-03-14T05:47:16.5736479Z  2025-03-14T05:47:16.5737044Z [13,606 / 15,235] 48 actions running 2025-03-14T05:47:16.5737796Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T05:47:16.5738744Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T05:47:16.5739867Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2025-03-14T05:47:16.5741010Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local 2025-03-14T05:47:16.5741988Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local 2025-03-14T05:47:16.5743010Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 13s local 2025-03-14T05:47:16.5744083Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 12s local 2025-03-14T05:47:16.5745087Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T05:47:16.8935761Z 2025-03-14T05:47:16.8937138Z  2025-03-14T05:47:16.8937742Z  2025-03-14T05:47:16.8938166Z  2025-03-14T05:47:16.8938548Z  2025-03-14T05:47:16.8938970Z  2025-03-14T05:47:16.8939498Z  2025-03-14T05:47:16.8939890Z  2025-03-14T05:47:16.8940340Z  2025-03-14T05:47:16.8940995Z [13,607 / 15,235] 48 actions, 47 running 2025-03-14T05:47:16.8941858Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T05:47:16.8942801Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T05:47:16.8944323Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T05:47:16.8945395Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 17s local 2025-03-14T05:47:16.8946571Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local 2025-03-14T05:47:16.8947604Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 13s local 2025-03-14T05:47:16.8948661Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 13s local 2025-03-14T05:47:16.8949661Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T05:47:17.1738788Z 2025-03-14T05:47:17.1739617Z  2025-03-14T05:47:17.1740038Z  2025-03-14T05:47:17.1740498Z  2025-03-14T05:47:17.1740843Z  2025-03-14T05:47:17.1741188Z  2025-03-14T05:47:17.1741533Z  2025-03-14T05:47:17.1741875Z  2025-03-14T05:47:17.1742214Z  2025-03-14T05:47:17.1742733Z [13,608 / 15,235] 48 actions running 2025-03-14T05:47:17.1743489Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T05:47:17.1744345Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T05:47:17.1745266Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T05:47:17.1746201Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local 2025-03-14T05:47:17.1747041Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local 2025-03-14T05:47:17.1747927Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local 2025-03-14T05:47:17.1748797Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 13s local 2025-03-14T05:47:17.1749621Z Compiling xla/service/xla_debug_info_manager.cc; 13s local ... 2025-03-14T05:47:17.6040017Z 2025-03-14T05:47:17.6041305Z  2025-03-14T05:47:17.6041794Z  2025-03-14T05:47:17.6042215Z  2025-03-14T05:47:17.6042611Z  2025-03-14T05:47:17.6043053Z  2025-03-14T05:47:17.6043463Z  2025-03-14T05:47:17.6043891Z  2025-03-14T05:47:17.6044293Z  2025-03-14T05:47:17.6045452Z [13,609 / 15,235] 48 actions, 47 running 2025-03-14T05:47:17.6046267Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T05:47:17.6047353Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T05:47:17.6048455Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T05:47:17.6049537Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local 2025-03-14T05:47:17.6050550Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 17s local 2025-03-14T05:47:17.6051564Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local 2025-03-14T05:47:17.6052498Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 13s local 2025-03-14T05:47:17.6053350Z Compiling xla/service/xla_debug_info_manager.cc; 13s local ... 2025-03-14T05:47:17.9747186Z 2025-03-14T05:47:17.9748688Z  2025-03-14T05:47:17.9749231Z  2025-03-14T05:47:17.9749752Z  2025-03-14T05:47:17.9750221Z  2025-03-14T05:47:17.9750716Z  2025-03-14T05:47:17.9751088Z  2025-03-14T05:47:17.9751464Z  2025-03-14T05:47:17.9751842Z  2025-03-14T05:47:17.9752417Z [13,611 / 15,235] 48 actions running 2025-03-14T05:47:17.9753215Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2025-03-14T05:47:17.9754199Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T05:47:17.9755428Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T05:47:17.9756442Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 18s local 2025-03-14T05:47:17.9757387Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 17s local 2025-03-14T05:47:17.9758356Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local 2025-03-14T05:47:17.9759358Z Compiling xla/service/xla_debug_info_manager.cc; 13s local 2025-03-14T05:47:17.9760795Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 11s local ... 2025-03-14T05:47:18.4058571Z 2025-03-14T05:47:18.4059575Z  2025-03-14T05:47:18.4060152Z  2025-03-14T05:47:18.4060648Z  2025-03-14T05:47:18.4061090Z  2025-03-14T05:47:18.4061452Z  2025-03-14T05:47:18.4061819Z  2025-03-14T05:47:18.4062214Z  2025-03-14T05:47:18.4062589Z  2025-03-14T05:47:18.4063155Z [13,612 / 15,235] 48 actions, 47 running 2025-03-14T05:47:18.4063911Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2025-03-14T05:47:18.4064828Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T05:47:18.4066129Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T05:47:18.4067160Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local 2025-03-14T05:47:18.4068199Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 18s local 2025-03-14T05:47:18.4069234Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local 2025-03-14T05:47:18.4070154Z Compiling xla/service/xla_debug_info_manager.cc; 14s local 2025-03-14T05:47:18.4071158Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local ... 2025-03-14T05:47:18.6274788Z 2025-03-14T05:47:18.6275814Z  2025-03-14T05:47:18.6276299Z  2025-03-14T05:47:18.6276679Z  2025-03-14T05:47:18.6277144Z  2025-03-14T05:47:18.6277599Z  2025-03-14T05:47:18.6278081Z  2025-03-14T05:47:18.6278437Z  2025-03-14T05:47:18.6278814Z  2025-03-14T05:47:18.6279373Z [13,614 / 15,235] 48 actions, 47 running 2025-03-14T05:47:18.6280151Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2025-03-14T05:47:18.6281080Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T05:47:18.6282115Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T05:47:18.6283226Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local 2025-03-14T05:47:18.6284207Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 18s local 2025-03-14T05:47:18.6285856Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local 2025-03-14T05:47:18.6286777Z Compiling xla/service/xla_debug_info_manager.cc; 14s local 2025-03-14T05:47:18.6287768Z Compiling llvm/lib/Transforms/Vectorize/VPlanRecipes.cpp; 12s local ... 2025-03-14T05:47:18.9108069Z 2025-03-14T05:47:18.9109032Z  2025-03-14T05:47:18.9109468Z  2025-03-14T05:47:18.9109825Z  2025-03-14T05:47:18.9110182Z  2025-03-14T05:47:18.9110531Z  2025-03-14T05:47:18.9110871Z  2025-03-14T05:47:18.9111212Z  2025-03-14T05:47:18.9111549Z  2025-03-14T05:47:18.9112060Z [13,617 / 15,235] 48 actions, 47 running 2025-03-14T05:47:18.9112742Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T05:47:18.9113565Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T05:47:18.9114554Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T05:47:18.9115472Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 19s local 2025-03-14T05:47:18.9116349Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local 2025-03-14T05:47:18.9117237Z Compiling xla/service/xla_debug_info_manager.cc; 14s local 2025-03-14T05:47:18.9118062Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 12s local 2025-03-14T05:47:18.9119028Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 12s local ... 2025-03-14T05:47:19.1756566Z 2025-03-14T05:47:19.1757374Z  2025-03-14T05:47:19.1757908Z  2025-03-14T05:47:19.1758313Z  2025-03-14T05:47:19.1758745Z  2025-03-14T05:47:19.1759180Z  2025-03-14T05:47:19.1759616Z  2025-03-14T05:47:19.1760029Z  2025-03-14T05:47:19.1760426Z  2025-03-14T05:47:19.1760995Z [13,619 / 15,235] 48 actions running 2025-03-14T05:47:19.1762320Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T05:47:19.1763359Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T05:47:19.1764461Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T05:47:19.1765936Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2025-03-14T05:47:19.1767039Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2025-03-14T05:47:19.1768066Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 12s local 2025-03-14T05:47:19.1769033Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 12s local 2025-03-14T05:47:19.1770064Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 12s local ... 2025-03-14T05:47:19.3761020Z 2025-03-14T05:47:19.3762345Z  2025-03-14T05:47:19.3762788Z  2025-03-14T05:47:19.3763156Z  2025-03-14T05:47:19.3763547Z  2025-03-14T05:47:19.3763921Z  2025-03-14T05:47:19.3764275Z  2025-03-14T05:47:19.3764787Z  2025-03-14T05:47:19.3765218Z  2025-03-14T05:47:19.3766011Z [13,621 / 15,235] 48 actions running 2025-03-14T05:47:19.3766765Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T05:47:19.3767695Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T05:47:19.3768738Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T05:47:19.3769760Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2025-03-14T05:47:19.3770817Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2025-03-14T05:47:19.3771757Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 12s local 2025-03-14T05:47:19.3772633Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 12s local 2025-03-14T05:47:19.3773554Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 12s local ... 2025-03-14T05:47:19.7373832Z 2025-03-14T05:47:19.7375217Z  2025-03-14T05:47:19.7375802Z  2025-03-14T05:47:19.7376294Z  2025-03-14T05:47:19.7376714Z  2025-03-14T05:47:19.7377587Z  2025-03-14T05:47:19.7378020Z  2025-03-14T05:47:19.7378451Z  2025-03-14T05:47:19.7378864Z  2025-03-14T05:47:19.7379495Z [13,623 / 15,235] 48 actions, 47 running 2025-03-14T05:47:19.7380297Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T05:47:19.7381300Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T05:47:19.7382441Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T05:47:19.7383705Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2025-03-14T05:47:19.7384826Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2025-03-14T05:47:19.7385830Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 13s local 2025-03-14T05:47:19.7386766Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 12s local 2025-03-14T05:47:19.7387820Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 12s local ... 2025-03-14T05:47:19.9767176Z 2025-03-14T05:47:19.9768120Z  2025-03-14T05:47:19.9768707Z  2025-03-14T05:47:19.9769101Z  2025-03-14T05:47:19.9769496Z  2025-03-14T05:47:19.9769889Z  2025-03-14T05:47:19.9770382Z  2025-03-14T05:47:19.9770779Z  2025-03-14T05:47:19.9771227Z  2025-03-14T05:47:19.9771842Z [13,624 / 15,235] 48 actions running 2025-03-14T05:47:19.9772644Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T05:47:19.9773637Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T05:47:19.9774813Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T05:47:19.9775939Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local 2025-03-14T05:47:19.9777034Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2025-03-14T05:47:19.9778185Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 13s local 2025-03-14T05:47:19.9779473Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 13s local 2025-03-14T05:47:19.9780572Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 13s local ... 2025-03-14T05:47:20.1771549Z 2025-03-14T05:47:20.1772530Z  2025-03-14T05:47:20.1772983Z  2025-03-14T05:47:20.1773375Z  2025-03-14T05:47:20.1773770Z  2025-03-14T05:47:20.1774185Z  2025-03-14T05:47:20.1774581Z  2025-03-14T05:47:20.1774985Z  2025-03-14T05:47:20.1775375Z  2025-03-14T05:47:20.1775921Z [13,627 / 15,235] 48 actions running 2025-03-14T05:47:20.1776716Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T05:47:20.1777722Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T05:47:20.1778763Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T05:47:20.1779769Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2025-03-14T05:47:20.1780800Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 13s local 2025-03-14T05:47:20.1781753Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 13s local 2025-03-14T05:47:20.1782643Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 13s local 2025-03-14T05:47:20.1783687Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 12s local ... 2025-03-14T05:47:20.4720317Z 2025-03-14T05:47:20.4721724Z  2025-03-14T05:47:20.4722236Z  2025-03-14T05:47:20.4722646Z  2025-03-14T05:47:20.4723050Z  2025-03-14T05:47:20.4723428Z  2025-03-14T05:47:20.4723825Z  2025-03-14T05:47:20.4724236Z  2025-03-14T05:47:20.4724835Z  2025-03-14T05:47:20.4725467Z [13,630 / 15,235] 48 actions, 47 running 2025-03-14T05:47:20.4726291Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T05:47:20.4727274Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T05:47:20.4728647Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T05:47:20.4729776Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2025-03-14T05:47:20.4731176Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 13s local 2025-03-14T05:47:20.4732081Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 13s local 2025-03-14T05:47:20.4733001Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 13s local 2025-03-14T05:47:20.4734033Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 12s local ... 2025-03-14T05:47:20.7665027Z 2025-03-14T05:47:20.7666038Z  2025-03-14T05:47:20.7666513Z  2025-03-14T05:47:20.7666904Z  2025-03-14T05:47:20.7667273Z  2025-03-14T05:47:20.7667760Z  2025-03-14T05:47:20.7668167Z  2025-03-14T05:47:20.7668564Z  2025-03-14T05:47:20.7668968Z  2025-03-14T05:47:20.7669571Z [13,633 / 15,235] 48 actions, 47 running 2025-03-14T05:47:20.7670372Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T05:47:20.7671351Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T05:47:20.7672559Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T05:47:20.7673638Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2025-03-14T05:47:20.7674599Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 14s local 2025-03-14T05:47:20.7675522Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 13s local 2025-03-14T05:47:20.7676443Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 13s local 2025-03-14T05:47:20.7677457Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 12s local ... 2025-03-14T05:47:20.9749320Z 2025-03-14T05:47:20.9750286Z  2025-03-14T05:47:20.9750761Z  2025-03-14T05:47:20.9751168Z  2025-03-14T05:47:20.9751559Z  2025-03-14T05:47:20.9751967Z  2025-03-14T05:47:20.9752371Z  2025-03-14T05:47:20.9752758Z  2025-03-14T05:47:20.9753163Z  2025-03-14T05:47:20.9754270Z [13,634 / 15,235] 48 actions, 47 running 2025-03-14T05:47:20.9755101Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 54s local 2025-03-14T05:47:20.9756100Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T05:47:20.9757223Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2025-03-14T05:47:20.9758251Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 14s local 2025-03-14T05:47:20.9759169Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local 2025-03-14T05:47:20.9760080Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 14s local 2025-03-14T05:47:20.9761020Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 13s local 2025-03-14T05:47:20.9762103Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 12s local ... 2025-03-14T05:47:21.1779218Z 2025-03-14T05:47:21.1780004Z  2025-03-14T05:47:21.1780476Z  2025-03-14T05:47:21.1780884Z  2025-03-14T05:47:21.1781305Z  2025-03-14T05:47:21.1781742Z  2025-03-14T05:47:21.1782128Z  2025-03-14T05:47:21.1782530Z  2025-03-14T05:47:21.1782929Z  2025-03-14T05:47:21.1783501Z [13,634 / 15,235] 48 actions running 2025-03-14T05:47:21.1784292Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 54s local 2025-03-14T05:47:21.1785247Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T05:47:21.1786308Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2025-03-14T05:47:21.1787281Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 14s local 2025-03-14T05:47:21.1788166Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local 2025-03-14T05:47:21.1789110Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 14s local 2025-03-14T05:47:21.1790039Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 13s local 2025-03-14T05:47:21.1791074Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local ... 2025-03-14T05:47:21.4904490Z 2025-03-14T05:47:21.4905401Z  2025-03-14T05:47:21.4905915Z  2025-03-14T05:47:21.4906730Z  2025-03-14T05:47:21.4907132Z  2025-03-14T05:47:21.4907513Z  2025-03-14T05:47:21.4907903Z  2025-03-14T05:47:21.4908296Z  2025-03-14T05:47:21.4908709Z  2025-03-14T05:47:21.4909311Z [13,635 / 15,235] 48 actions, 47 running 2025-03-14T05:47:21.4910113Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 54s local 2025-03-14T05:47:21.4911087Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T05:47:21.4912179Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2025-03-14T05:47:21.4913183Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 14s local 2025-03-14T05:47:21.4914098Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local 2025-03-14T05:47:21.4915113Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 14s local 2025-03-14T05:47:21.4916130Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 13s local 2025-03-14T05:47:21.4917281Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local ... 2025-03-14T05:47:21.7311986Z 2025-03-14T05:47:21.7312820Z  2025-03-14T05:47:21.7313285Z  2025-03-14T05:47:21.7313680Z  2025-03-14T05:47:21.7314087Z  2025-03-14T05:47:21.7314523Z  2025-03-14T05:47:21.7314932Z  2025-03-14T05:47:21.7315358Z  2025-03-14T05:47:21.7315775Z  2025-03-14T05:47:21.7316384Z [13,637 / 15,235] 48 actions, 47 running 2025-03-14T05:47:21.7317384Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T05:47:21.7318586Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2025-03-14T05:47:21.7319685Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 15s local 2025-03-14T05:47:21.7321314Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local 2025-03-14T05:47:21.7322349Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 14s local 2025-03-14T05:47:21.7323770Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 13s local 2025-03-14T05:47:21.7325170Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2025-03-14T05:47:21.7326342Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 12s local ... 2025-03-14T05:47:21.9785899Z 2025-03-14T05:47:21.9787062Z  2025-03-14T05:47:21.9788980Z  2025-03-14T05:47:21.9789957Z  2025-03-14T05:47:21.9791878Z  2025-03-14T05:47:21.9793391Z  2025-03-14T05:47:21.9794855Z  2025-03-14T05:47:21.9796279Z  2025-03-14T05:47:21.9797830Z  2025-03-14T05:47:21.9799507Z [13,637 / 15,235] 48 actions running 2025-03-14T05:47:21.9800952Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T05:47:21.9802269Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2025-03-14T05:47:21.9803519Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 15s local 2025-03-14T05:47:21.9804902Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2025-03-14T05:47:21.9806119Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 15s local 2025-03-14T05:47:21.9807351Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 14s local 2025-03-14T05:47:21.9808599Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 13s local 2025-03-14T05:47:21.9809868Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 12s local ... 2025-03-14T05:47:22.3711952Z 2025-03-14T05:47:22.3713325Z  2025-03-14T05:47:22.3713863Z  2025-03-14T05:47:22.3714249Z  2025-03-14T05:47:22.3714634Z  2025-03-14T05:47:22.3715052Z  2025-03-14T05:47:22.3715447Z  2025-03-14T05:47:22.3715795Z  2025-03-14T05:47:22.3716164Z  2025-03-14T05:47:22.3716756Z [13,640 / 15,235] 48 actions, 47 running 2025-03-14T05:47:22.3717711Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T05:47:22.3718902Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2025-03-14T05:47:22.3720391Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2025-03-14T05:47:22.3721339Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 15s local 2025-03-14T05:47:22.3722341Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 14s local 2025-03-14T05:47:22.3723430Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2025-03-14T05:47:22.3724658Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 12s local 2025-03-14T05:47:22.3725740Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 12s local ... 2025-03-14T05:47:22.5790836Z 2025-03-14T05:47:22.5791879Z  2025-03-14T05:47:22.5792377Z  2025-03-14T05:47:22.5792775Z  2025-03-14T05:47:22.5793195Z  2025-03-14T05:47:22.5793625Z  2025-03-14T05:47:22.5794054Z  2025-03-14T05:47:22.5794481Z  2025-03-14T05:47:22.5794907Z  2025-03-14T05:47:22.5795571Z [13,643 / 15,235] 48 actions running 2025-03-14T05:47:22.5796571Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T05:47:22.5797779Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2025-03-14T05:47:22.5798792Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2025-03-14T05:47:22.5799729Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 15s local 2025-03-14T05:47:22.5800625Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 14s local 2025-03-14T05:47:22.5801681Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2025-03-14T05:47:22.5802774Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 13s local 2025-03-14T05:47:22.5803866Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 13s local ... 2025-03-14T05:47:22.7811445Z 2025-03-14T05:47:22.7812325Z  2025-03-14T05:47:22.7812821Z  2025-03-14T05:47:22.7813254Z  2025-03-14T05:47:22.7813685Z  2025-03-14T05:47:22.7814104Z  2025-03-14T05:47:22.7814890Z  2025-03-14T05:47:22.7815345Z  2025-03-14T05:47:22.7815809Z  2025-03-14T05:47:22.7816447Z [13,647 / 15,235] 48 actions, 47 running 2025-03-14T05:47:22.7817454Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T05:47:22.7818656Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2025-03-14T05:47:22.7819724Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2025-03-14T05:47:22.7820731Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 15s local 2025-03-14T05:47:22.7821757Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 14s local 2025-03-14T05:47:22.7822815Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 14s local 2025-03-14T05:47:22.7823870Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 13s local 2025-03-14T05:47:22.7824971Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 13s local ... 2025-03-14T05:47:23.1797056Z 2025-03-14T05:47:23.1798081Z  2025-03-14T05:47:23.1798565Z  2025-03-14T05:47:23.1800524Z  2025-03-14T05:47:23.1800938Z  2025-03-14T05:47:23.1802721Z  2025-03-14T05:47:23.1803144Z  2025-03-14T05:47:23.1805116Z  2025-03-14T05:47:23.1805558Z  2025-03-14T05:47:23.1807447Z [13,647 / 15,235] 48 actions running 2025-03-14T05:47:23.1808387Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T05:47:23.1809479Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 20s local 2025-03-14T05:47:23.1810487Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2025-03-14T05:47:23.1811550Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local 2025-03-14T05:47:23.1812540Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 15s local 2025-03-14T05:47:23.1813581Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2025-03-14T05:47:23.1814630Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 13s local 2025-03-14T05:47:23.1815727Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 13s local ... 2025-03-14T05:47:23.3802252Z 2025-03-14T05:47:23.3803582Z  2025-03-14T05:47:23.3805740Z  2025-03-14T05:47:23.3806534Z  2025-03-14T05:47:23.3807588Z  2025-03-14T05:47:23.3808154Z  2025-03-14T05:47:23.3808581Z  2025-03-14T05:47:23.3809009Z  2025-03-14T05:47:23.3809449Z  2025-03-14T05:47:23.3810036Z [13,648 / 15,235] 48 actions running 2025-03-14T05:47:23.3811011Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T05:47:23.3812112Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2025-03-14T05:47:23.3813101Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local 2025-03-14T05:47:23.3814171Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 15s local 2025-03-14T05:47:23.3815277Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2025-03-14T05:47:23.3816312Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 13s local 2025-03-14T05:47:23.3817309Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 13s local 2025-03-14T05:47:23.3818388Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 13s local ... 2025-03-14T05:47:23.5829798Z 2025-03-14T05:47:23.5830817Z  2025-03-14T05:47:23.5831295Z  2025-03-14T05:47:23.5831696Z  2025-03-14T05:47:23.5832098Z  2025-03-14T05:47:23.5832439Z  2025-03-14T05:47:23.5832759Z  2025-03-14T05:47:23.5833083Z  2025-03-14T05:47:23.5833459Z  2025-03-14T05:47:23.5834063Z [13,650 / 15,235] 48 actions, 47 running 2025-03-14T05:47:23.5834994Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T05:47:23.5836045Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2025-03-14T05:47:23.5837004Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 16s local 2025-03-14T05:47:23.5838893Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 15s local 2025-03-14T05:47:23.5840007Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2025-03-14T05:47:23.5841023Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 14s local 2025-03-14T05:47:23.5842006Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 14s local 2025-03-14T05:47:23.5843088Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 13s local ... 2025-03-14T05:47:23.9807114Z 2025-03-14T05:47:23.9808137Z  2025-03-14T05:47:23.9808722Z  2025-03-14T05:47:23.9809097Z  2025-03-14T05:47:23.9809473Z  2025-03-14T05:47:23.9809854Z  2025-03-14T05:47:23.9810244Z  2025-03-14T05:47:23.9810620Z  2025-03-14T05:47:23.9810990Z  2025-03-14T05:47:23.9811583Z [13,651 / 15,235] 48 actions running 2025-03-14T05:47:23.9812590Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T05:47:23.9813633Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T05:47:23.9814543Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 17s local 2025-03-14T05:47:23.9815549Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 15s local 2025-03-14T05:47:23.9816463Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 14s local 2025-03-14T05:47:23.9817409Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 14s local 2025-03-14T05:47:23.9818403Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local 2025-03-14T05:47:23.9819270Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 13s local ... 2025-03-14T05:47:24.1811079Z 2025-03-14T05:47:24.1811937Z  2025-03-14T05:47:24.1812435Z  2025-03-14T05:47:24.1812827Z  2025-03-14T05:47:24.1813235Z  2025-03-14T05:47:24.1813623Z  2025-03-14T05:47:24.1814008Z  2025-03-14T05:47:24.1814383Z  2025-03-14T05:47:24.1814780Z  2025-03-14T05:47:24.1815384Z [13,652 / 15,235] 48 actions running 2025-03-14T05:47:24.1816266Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T05:47:24.1817698Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T05:47:24.1818591Z Compiling xla/backends/cpu/runtime/while_thunk.cc; 17s local 2025-03-14T05:47:24.1819588Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2025-03-14T05:47:24.1820613Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 14s local 2025-03-14T05:47:24.1821501Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 14s local 2025-03-14T05:47:24.1822486Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local 2025-03-14T05:47:24.1823489Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 13s local ... 2025-03-14T05:47:24.5816277Z 2025-03-14T05:47:24.5818306Z  2025-03-14T05:47:24.5819448Z  2025-03-14T05:47:24.5819947Z  2025-03-14T05:47:24.5821052Z  2025-03-14T05:47:24.5822643Z  2025-03-14T05:47:24.5823164Z  2025-03-14T05:47:24.5824087Z  2025-03-14T05:47:24.5824772Z  2025-03-14T05:47:24.5825313Z [13,653 / 15,235] 48 actions running 2025-03-14T05:47:24.5826164Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T05:47:24.5827102Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T05:47:24.5827985Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2025-03-14T05:47:24.5828916Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 15s local 2025-03-14T05:47:24.5829800Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 15s local 2025-03-14T05:47:24.5830729Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local 2025-03-14T05:47:24.5831609Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 14s local 2025-03-14T05:47:24.5832516Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 10s local ... 2025-03-14T05:47:24.9166151Z 2025-03-14T05:47:24.9167106Z  2025-03-14T05:47:24.9167929Z  2025-03-14T05:47:24.9168312Z  2025-03-14T05:47:24.9170169Z  2025-03-14T05:47:24.9170503Z  2025-03-14T05:47:24.9172304Z  2025-03-14T05:47:24.9172625Z  2025-03-14T05:47:24.9174350Z  2025-03-14T05:47:24.9174843Z [13,656 / 15,235] 48 actions, 47 running 2025-03-14T05:47:24.9175623Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T05:47:24.9176895Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T05:47:24.9178180Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 16s local 2025-03-14T05:47:24.9179353Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 15s local 2025-03-14T05:47:24.9180366Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 15s local 2025-03-14T05:47:24.9181611Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local 2025-03-14T05:47:24.9182816Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 14s local 2025-03-14T05:47:24.9184087Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 11s local ... 2025-03-14T05:47:25.1638860Z 2025-03-14T05:47:25.1639734Z  2025-03-14T05:47:25.1640211Z  2025-03-14T05:47:25.1640627Z  2025-03-14T05:47:25.1641030Z  2025-03-14T05:47:25.1641441Z  2025-03-14T05:47:25.1641859Z  2025-03-14T05:47:25.1642248Z  2025-03-14T05:47:25.1642650Z  2025-03-14T05:47:25.1643277Z [13,658 / 15,235] 48 actions, 47 running 2025-03-14T05:47:25.1644240Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T05:47:25.1645415Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T05:47:25.1646755Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2025-03-14T05:47:25.1647898Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 15s local 2025-03-14T05:47:25.1649136Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 15s local 2025-03-14T05:47:25.1650318Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local 2025-03-14T05:47:25.1651830Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 14s local 2025-03-14T05:47:25.1652910Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 11s local ... 2025-03-14T05:47:25.3822515Z 2025-03-14T05:47:25.3823376Z  2025-03-14T05:47:25.3823858Z  2025-03-14T05:47:25.3824258Z  2025-03-14T05:47:25.3824649Z  2025-03-14T05:47:25.3825048Z  2025-03-14T05:47:25.3825437Z  2025-03-14T05:47:25.3825826Z  2025-03-14T05:47:25.3826222Z  2025-03-14T05:47:25.3826782Z [13,658 / 15,235] 48 actions running 2025-03-14T05:47:25.3827634Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T05:47:25.3828648Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T05:47:25.3829588Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2025-03-14T05:47:25.3831173Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 15s local 2025-03-14T05:47:25.3832134Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 15s local 2025-03-14T05:47:25.3833093Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local 2025-03-14T05:47:25.3834304Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 14s local 2025-03-14T05:47:25.3835391Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 11s local ... 2025-03-14T05:47:25.6027469Z 2025-03-14T05:47:25.6029301Z  2025-03-14T05:47:25.6030616Z  2025-03-14T05:47:25.6031885Z  2025-03-14T05:47:25.6033081Z  2025-03-14T05:47:25.6034279Z  2025-03-14T05:47:25.6035473Z  2025-03-14T05:47:25.6036663Z  2025-03-14T05:47:25.6037930Z  2025-03-14T05:47:25.6039324Z [13,662 / 15,235] 48 actions, 47 running 2025-03-14T05:47:25.6040945Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T05:47:25.6042979Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T05:47:25.6044855Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2025-03-14T05:47:25.6046608Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local 2025-03-14T05:47:25.6048269Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local 2025-03-14T05:47:25.6049880Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 12s local 2025-03-14T05:47:25.6051522Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 10s local 2025-03-14T05:47:25.6053248Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 10s local ... 2025-03-14T05:47:25.8419919Z 2025-03-14T05:47:25.8421843Z  2025-03-14T05:47:25.8423511Z  2025-03-14T05:47:25.8424985Z  2025-03-14T05:47:25.8426416Z  2025-03-14T05:47:25.8427883Z  2025-03-14T05:47:25.8429272Z  2025-03-14T05:47:25.8430651Z  2025-03-14T05:47:25.8432074Z  2025-03-14T05:47:25.8434203Z [13,665 / 15,235] 48 actions, 47 running 2025-03-14T05:47:25.8436645Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T05:47:25.8449706Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T05:47:25.8452453Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 17s local 2025-03-14T05:47:25.8455081Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local 2025-03-14T05:47:25.8457563Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 12s local 2025-03-14T05:47:25.8460018Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 11s local 2025-03-14T05:47:25.8462646Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 10s local 2025-03-14T05:47:25.8465263Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 10s local ... 2025-03-14T05:47:26.1832190Z 2025-03-14T05:47:26.1833062Z  2025-03-14T05:47:26.1833565Z  2025-03-14T05:47:26.1833957Z  2025-03-14T05:47:26.1834331Z  2025-03-14T05:47:26.1834731Z  2025-03-14T05:47:26.1835150Z  2025-03-14T05:47:26.1835525Z  2025-03-14T05:47:26.1836335Z  2025-03-14T05:47:26.1836897Z [13,665 / 15,235] 48 actions running 2025-03-14T05:47:26.1837818Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T05:47:26.1838810Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T05:47:26.1839798Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2025-03-14T05:47:26.1840779Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local 2025-03-14T05:47:26.1841720Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 12s local 2025-03-14T05:47:26.1842600Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 11s local 2025-03-14T05:47:26.1843491Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 10s local 2025-03-14T05:47:26.1844468Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 10s local ... 2025-03-14T05:47:26.6662724Z 2025-03-14T05:47:26.6663537Z  2025-03-14T05:47:26.6664064Z  2025-03-14T05:47:26.6664457Z  2025-03-14T05:47:26.6664887Z  2025-03-14T05:47:26.6665517Z  2025-03-14T05:47:26.6665933Z  2025-03-14T05:47:26.6666331Z  2025-03-14T05:47:26.6666751Z  2025-03-14T05:47:26.6667363Z [13,666 / 15,235] 48 actions, 47 running 2025-03-14T05:47:26.6668291Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T05:47:26.6669311Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T05:47:26.6670305Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2025-03-14T05:47:26.6671465Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2025-03-14T05:47:26.6672363Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 13s local 2025-03-14T05:47:26.6673235Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 11s local 2025-03-14T05:47:26.6674209Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 11s local 2025-03-14T05:47:26.6675773Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 10s local ... 2025-03-14T05:47:26.8975388Z 2025-03-14T05:47:26.8976255Z  2025-03-14T05:47:26.8976727Z  2025-03-14T05:47:26.8977145Z  2025-03-14T05:47:26.8977531Z  2025-03-14T05:47:26.8977957Z  2025-03-14T05:47:26.8978366Z  2025-03-14T05:47:26.8978781Z  2025-03-14T05:47:26.8979199Z  2025-03-14T05:47:26.8979802Z [13,667 / 15,235] 48 actions, 47 running 2025-03-14T05:47:26.8980730Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T05:47:26.8981740Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T05:47:26.8982742Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2025-03-14T05:47:26.8983858Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2025-03-14T05:47:26.8984796Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 13s local 2025-03-14T05:47:26.8985767Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 12s local 2025-03-14T05:47:26.8986797Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 11s local 2025-03-14T05:47:26.8987992Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 11s local ... 2025-03-14T05:47:27.1186126Z 2025-03-14T05:47:27.1187039Z  2025-03-14T05:47:27.1187502Z  2025-03-14T05:47:27.1188010Z  2025-03-14T05:47:27.1188412Z  2025-03-14T05:47:27.1188803Z  2025-03-14T05:47:27.1189175Z  2025-03-14T05:47:27.1189583Z  2025-03-14T05:47:27.1189982Z  2025-03-14T05:47:27.1190564Z [13,669 / 15,235] 48 actions, 47 running 2025-03-14T05:47:27.1191466Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T05:47:27.1192531Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T05:47:27.1193561Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local 2025-03-14T05:47:27.1194649Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2025-03-14T05:47:27.1196052Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 13s local 2025-03-14T05:47:27.1196935Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 12s local 2025-03-14T05:47:27.1197946Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 11s local 2025-03-14T05:47:27.1199268Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 11s local ... 2025-03-14T05:47:27.3841496Z 2025-03-14T05:47:27.3842302Z  2025-03-14T05:47:27.3842787Z  2025-03-14T05:47:27.3843187Z  2025-03-14T05:47:27.3843582Z  2025-03-14T05:47:27.3843959Z  2025-03-14T05:47:27.3844612Z  2025-03-14T05:47:27.3844986Z  2025-03-14T05:47:27.3845328Z  2025-03-14T05:47:27.3845868Z [13,669 / 15,235] 48 actions running 2025-03-14T05:47:27.3846768Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T05:47:27.3847798Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T05:47:27.3848795Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2025-03-14T05:47:27.3849780Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2025-03-14T05:47:27.3850655Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 13s local 2025-03-14T05:47:27.3851580Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 12s local 2025-03-14T05:47:27.3852535Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 11s local 2025-03-14T05:47:27.3853708Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 11s local ... 2025-03-14T05:47:27.7806647Z 2025-03-14T05:47:27.7807538Z  2025-03-14T05:47:27.7808108Z  2025-03-14T05:47:27.7808595Z  2025-03-14T05:47:27.7809094Z  2025-03-14T05:47:27.7809563Z  2025-03-14T05:47:27.7810164Z  2025-03-14T05:47:27.7810637Z  2025-03-14T05:47:27.7811115Z  2025-03-14T05:47:27.7812207Z [13,670 / 15,235] 48 actions, 47 running 2025-03-14T05:47:27.7813247Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T05:47:27.7814407Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T05:47:27.7815494Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2025-03-14T05:47:27.7816599Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T05:47:27.7817642Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local 2025-03-14T05:47:27.7818439Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local 2025-03-14T05:47:27.7819198Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 12s local 2025-03-14T05:47:27.7820059Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 12s local ... 2025-03-14T05:47:27.9845609Z 2025-03-14T05:47:27.9846438Z  2025-03-14T05:47:27.9846921Z  2025-03-14T05:47:27.9847306Z  2025-03-14T05:47:27.9847696Z  2025-03-14T05:47:27.9848106Z  2025-03-14T05:47:27.9848542Z  2025-03-14T05:47:27.9848961Z  2025-03-14T05:47:27.9849388Z  2025-03-14T05:47:27.9849954Z [13,670 / 15,235] 48 actions running 2025-03-14T05:47:27.9850930Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T05:47:27.9852044Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T05:47:27.9853065Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local 2025-03-14T05:47:27.9854167Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T05:47:27.9855142Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local 2025-03-14T05:47:27.9856110Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local 2025-03-14T05:47:27.9857193Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 12s local 2025-03-14T05:47:27.9858445Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 12s local ... 2025-03-14T05:47:28.2073296Z 2025-03-14T05:47:28.2074229Z  2025-03-14T05:47:28.2074719Z  2025-03-14T05:47:28.2075468Z  2025-03-14T05:47:28.2075879Z  2025-03-14T05:47:28.2076313Z  2025-03-14T05:47:28.2076731Z  2025-03-14T05:47:28.2077139Z  2025-03-14T05:47:28.2077570Z  2025-03-14T05:47:28.2078203Z [13,673 / 15,235] 48 actions, 47 running 2025-03-14T05:47:28.2079151Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T05:47:28.2080335Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T05:47:28.2081344Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2025-03-14T05:47:28.2082404Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T05:47:28.2083421Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local 2025-03-14T05:47:28.2085037Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local 2025-03-14T05:47:28.2086084Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 12s local 2025-03-14T05:47:28.2087439Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfCompileUnit.cpp; 12s local ... 2025-03-14T05:47:28.5853206Z 2025-03-14T05:47:28.5854084Z  2025-03-14T05:47:28.5854574Z  2025-03-14T05:47:28.5854994Z  2025-03-14T05:47:28.5855449Z  2025-03-14T05:47:28.5855870Z  2025-03-14T05:47:28.5856316Z  2025-03-14T05:47:28.5856678Z  2025-03-14T05:47:28.5857084Z  2025-03-14T05:47:28.5857659Z [13,674 / 15,235] 48 actions running 2025-03-14T05:47:28.5858585Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T05:47:28.5859650Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T05:47:28.5860844Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2025-03-14T05:47:28.5861896Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2025-03-14T05:47:28.5862926Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 14s local 2025-03-14T05:47:28.5864327Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 13s local 2025-03-14T05:47:28.5865803Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 13s local 2025-03-14T05:47:28.5866929Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 9s local ... 2025-03-14T05:47:28.9799406Z 2025-03-14T05:47:28.9800212Z  2025-03-14T05:47:28.9800692Z  2025-03-14T05:47:28.9801124Z  2025-03-14T05:47:28.9801535Z  2025-03-14T05:47:28.9801983Z  2025-03-14T05:47:28.9802401Z  2025-03-14T05:47:28.9802812Z  2025-03-14T05:47:28.9803230Z  2025-03-14T05:47:28.9803842Z [13,677 / 15,235] 48 actions, 47 running 2025-03-14T05:47:28.9804921Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T05:47:28.9806078Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T05:47:28.9807050Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local 2025-03-14T05:47:28.9808069Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2025-03-14T05:47:28.9809004Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local 2025-03-14T05:47:28.9809904Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2025-03-14T05:47:28.9810879Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 13s local 2025-03-14T05:47:28.9812008Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 10s local ... 2025-03-14T05:47:29.1858409Z 2025-03-14T05:47:29.1859249Z  2025-03-14T05:47:29.1859712Z  2025-03-14T05:47:29.1860107Z  2025-03-14T05:47:29.1860497Z  2025-03-14T05:47:29.1860868Z  2025-03-14T05:47:29.1861263Z  2025-03-14T05:47:29.1861656Z  2025-03-14T05:47:29.1862048Z  2025-03-14T05:47:29.1862612Z [13,677 / 15,235] 48 actions running 2025-03-14T05:47:29.1863525Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T05:47:29.1864571Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T05:47:29.1865780Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 21s local 2025-03-14T05:47:29.1867217Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2025-03-14T05:47:29.1868148Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local 2025-03-14T05:47:29.1869166Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2025-03-14T05:47:29.1870203Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 13s local 2025-03-14T05:47:29.1871334Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 10s local ... 2025-03-14T05:47:29.3863055Z 2025-03-14T05:47:29.3863900Z  2025-03-14T05:47:29.3864332Z  2025-03-14T05:47:29.3864759Z  2025-03-14T05:47:29.3865205Z  2025-03-14T05:47:29.3865795Z  2025-03-14T05:47:29.3866226Z  2025-03-14T05:47:29.3866604Z  2025-03-14T05:47:29.3866948Z  2025-03-14T05:47:29.3867445Z [13,678 / 15,235] 48 actions running 2025-03-14T05:47:29.3868306Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T05:47:29.3869413Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T05:47:29.3870438Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 21s local 2025-03-14T05:47:29.3871432Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2025-03-14T05:47:29.3872339Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local 2025-03-14T05:47:29.3873279Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2025-03-14T05:47:29.3874282Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 13s local 2025-03-14T05:47:29.3875449Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 10s local ... 2025-03-14T05:47:29.5928893Z 2025-03-14T05:47:29.5929777Z  2025-03-14T05:47:29.5930385Z  2025-03-14T05:47:29.5930761Z  2025-03-14T05:47:29.5931113Z  2025-03-14T05:47:29.5931481Z  2025-03-14T05:47:29.5932240Z  2025-03-14T05:47:29.5932645Z  2025-03-14T05:47:29.5933055Z  2025-03-14T05:47:29.5933661Z [13,680 / 15,235] 48 actions, 47 running 2025-03-14T05:47:29.5934563Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T05:47:29.5935596Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T05:47:29.5936495Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 19s local 2025-03-14T05:47:29.5937396Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local 2025-03-14T05:47:29.5938263Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 14s local 2025-03-14T05:47:29.5939321Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 14s local 2025-03-14T05:47:29.5940456Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 10s local 2025-03-14T05:47:29.5941558Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 10s local ... 2025-03-14T05:47:29.9869401Z 2025-03-14T05:47:29.9870386Z  2025-03-14T05:47:29.9870922Z  2025-03-14T05:47:29.9871319Z  2025-03-14T05:47:29.9871727Z  2025-03-14T05:47:29.9872106Z  2025-03-14T05:47:29.9872484Z  2025-03-14T05:47:29.9872900Z  2025-03-14T05:47:29.9873303Z  2025-03-14T05:47:29.9874003Z [13,681 / 15,235] 48 actions running 2025-03-14T05:47:29.9874990Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T05:47:29.9876111Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2025-03-14T05:47:29.9877042Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 19s local 2025-03-14T05:47:29.9877989Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2025-03-14T05:47:29.9879078Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 14s local 2025-03-14T05:47:29.9880134Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 11s local 2025-03-14T05:47:29.9881082Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 11s local 2025-03-14T05:47:29.9882067Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 11s local ... 2025-03-14T05:47:30.1873974Z 2025-03-14T05:47:30.1874850Z  2025-03-14T05:47:30.1875462Z  2025-03-14T05:47:30.1875879Z  2025-03-14T05:47:30.1876260Z  2025-03-14T05:47:30.1876649Z  2025-03-14T05:47:30.1877085Z  2025-03-14T05:47:30.1877482Z  2025-03-14T05:47:30.1877892Z  2025-03-14T05:47:30.1878468Z [13,682 / 15,235] 48 actions running 2025-03-14T05:47:30.1879377Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T05:47:30.1880397Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2025-03-14T05:47:30.1881445Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 19s local 2025-03-14T05:47:30.1882386Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2025-03-14T05:47:30.1883401Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 14s local 2025-03-14T05:47:30.1884725Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 11s local 2025-03-14T05:47:30.1885892Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 11s local 2025-03-14T05:47:30.1886787Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 11s local ... 2025-03-14T05:47:30.4014744Z 2025-03-14T05:47:30.4015617Z  2025-03-14T05:47:30.4016207Z  2025-03-14T05:47:30.4016589Z  2025-03-14T05:47:30.4016942Z  2025-03-14T05:47:30.4017302Z  2025-03-14T05:47:30.4017673Z  2025-03-14T05:47:30.4018040Z  2025-03-14T05:47:30.4018406Z  2025-03-14T05:47:30.4018964Z [13,685 / 15,235] 48 actions, 47 running 2025-03-14T05:47:30.4019807Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T05:47:30.4020770Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2025-03-14T05:47:30.4021707Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 19s local 2025-03-14T05:47:30.4022995Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2025-03-14T05:47:30.4023953Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 14s local 2025-03-14T05:47:30.4025103Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 11s local 2025-03-14T05:47:30.4026035Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 11s local 2025-03-14T05:47:30.4026874Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 11s local ... 2025-03-14T05:47:30.6620453Z 2025-03-14T05:47:30.6621385Z  2025-03-14T05:47:30.6621805Z  2025-03-14T05:47:30.6622141Z  2025-03-14T05:47:30.6622465Z  2025-03-14T05:47:30.6623049Z  2025-03-14T05:47:30.6623531Z  2025-03-14T05:47:30.6624004Z  2025-03-14T05:47:30.6624465Z  2025-03-14T05:47:30.6625134Z [13,688 / 15,235] 48 actions, 47 running 2025-03-14T05:47:30.6626025Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T05:47:30.6626977Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2025-03-14T05:47:30.6627880Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 20s local 2025-03-14T05:47:30.6628769Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 15s local 2025-03-14T05:47:30.6629733Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 15s local 2025-03-14T05:47:30.6630731Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 12s local 2025-03-14T05:47:30.6631656Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 11s local 2025-03-14T05:47:30.6632489Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 11s local ... 2025-03-14T05:47:30.9880170Z 2025-03-14T05:47:30.9881008Z  2025-03-14T05:47:30.9881563Z  2025-03-14T05:47:30.9881989Z  2025-03-14T05:47:30.9882354Z  2025-03-14T05:47:30.9882716Z  2025-03-14T05:47:30.9883084Z  2025-03-14T05:47:30.9883470Z  2025-03-14T05:47:30.9883853Z  2025-03-14T05:47:30.9884384Z [13,690 / 15,235] 48 actions running 2025-03-14T05:47:30.9885415Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2025-03-14T05:47:30.9886818Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T05:47:30.9887838Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 16s local 2025-03-14T05:47:30.9888819Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 15s local 2025-03-14T05:47:30.9889919Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 12s local 2025-03-14T05:47:30.9890938Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 12s local 2025-03-14T05:47:30.9891829Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 12s local 2025-03-14T05:47:30.9892849Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local ... 2025-03-14T05:47:31.4077133Z 2025-03-14T05:47:31.4078126Z  2025-03-14T05:47:31.4078629Z  2025-03-14T05:47:31.4079030Z  2025-03-14T05:47:31.4079462Z  2025-03-14T05:47:31.4079886Z  2025-03-14T05:47:31.4080260Z  2025-03-14T05:47:31.4080656Z  2025-03-14T05:47:31.4081090Z  2025-03-14T05:47:31.4081735Z [13,691 / 15,235] 48 actions, 47 running 2025-03-14T05:47:31.4082622Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2025-03-14T05:47:31.4083557Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T05:47:31.4084622Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 15s local 2025-03-14T05:47:31.4085620Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 12s local 2025-03-14T05:47:31.4086537Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 12s local 2025-03-14T05:47:31.4087445Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 12s local 2025-03-14T05:47:31.4088573Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2025-03-14T05:47:31.4089475Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local ... 2025-03-14T05:47:31.6606061Z 2025-03-14T05:47:31.6607050Z  2025-03-14T05:47:31.6607581Z  2025-03-14T05:47:31.6608285Z  2025-03-14T05:47:31.6608691Z  2025-03-14T05:47:31.6609076Z  2025-03-14T05:47:31.6609473Z  2025-03-14T05:47:31.6609854Z  2025-03-14T05:47:31.6610218Z  2025-03-14T05:47:31.6610799Z [13,692 / 15,235] 48 actions, 47 running 2025-03-14T05:47:31.6611722Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2025-03-14T05:47:31.6612737Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T05:47:31.6613763Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 16s local 2025-03-14T05:47:31.6614867Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 13s local 2025-03-14T05:47:31.6615868Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 12s local 2025-03-14T05:47:31.6616787Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 12s local 2025-03-14T05:47:31.6617738Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2025-03-14T05:47:31.6618726Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local ... 2025-03-14T05:47:31.9888867Z 2025-03-14T05:47:31.9889911Z  2025-03-14T05:47:31.9890464Z  2025-03-14T05:47:31.9890824Z  2025-03-14T05:47:31.9891199Z  2025-03-14T05:47:31.9891601Z  2025-03-14T05:47:31.9892059Z  2025-03-14T05:47:31.9892476Z  2025-03-14T05:47:31.9892850Z  2025-03-14T05:47:31.9893409Z [13,693 / 15,235] 48 actions running 2025-03-14T05:47:31.9894305Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T05:47:31.9895340Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T05:47:31.9896398Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 16s local 2025-03-14T05:47:31.9897428Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 13s local 2025-03-14T05:47:31.9898356Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 13s local 2025-03-14T05:47:31.9899414Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 13s local 2025-03-14T05:47:31.9900332Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2025-03-14T05:47:31.9901763Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 11s local ... 2025-03-14T05:47:32.1892944Z 2025-03-14T05:47:32.1893911Z  2025-03-14T05:47:32.1894415Z  2025-03-14T05:47:32.1894830Z  2025-03-14T05:47:32.1895211Z  2025-03-14T05:47:32.1895621Z  2025-03-14T05:47:32.1896032Z  2025-03-14T05:47:32.1896454Z  2025-03-14T05:47:32.1896858Z  2025-03-14T05:47:32.1897426Z [13,694 / 15,235] 48 actions running 2025-03-14T05:47:32.1898347Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T05:47:32.1899378Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T05:47:32.1900424Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 16s local 2025-03-14T05:47:32.1901595Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 13s local 2025-03-14T05:47:32.1902628Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 13s local 2025-03-14T05:47:32.1903585Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 13s local 2025-03-14T05:47:32.1904570Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2025-03-14T05:47:32.1905582Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local ... 2025-03-14T05:47:32.4489404Z 2025-03-14T05:47:32.4490337Z  2025-03-14T05:47:32.4490824Z  2025-03-14T05:47:32.4491210Z  2025-03-14T05:47:32.4491621Z  2025-03-14T05:47:32.4492019Z  2025-03-14T05:47:32.4492437Z  2025-03-14T05:47:32.4492834Z  2025-03-14T05:47:32.4493253Z  2025-03-14T05:47:32.4493873Z [13,696 / 15,235] 48 actions, 47 running 2025-03-14T05:47:32.4494834Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T05:47:32.4495940Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T05:47:32.4497393Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 16s local 2025-03-14T05:47:32.4498602Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 13s local 2025-03-14T05:47:32.4499640Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 13s local 2025-03-14T05:47:32.4500661Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 13s local 2025-03-14T05:47:32.4501670Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2025-03-14T05:47:32.4502705Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local ... 2025-03-14T05:47:32.7898085Z 2025-03-14T05:47:32.7899045Z  2025-03-14T05:47:32.7899572Z  2025-03-14T05:47:32.7900078Z  2025-03-14T05:47:32.7900466Z  2025-03-14T05:47:32.7900909Z  2025-03-14T05:47:32.7901344Z  2025-03-14T05:47:32.7901729Z  2025-03-14T05:47:32.7902129Z  2025-03-14T05:47:32.7902703Z [13,696 / 15,235] 48 actions running 2025-03-14T05:47:32.7903619Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T05:47:32.7904673Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T05:47:32.7905751Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local 2025-03-14T05:47:32.7906845Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local 2025-03-14T05:47:32.7907917Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 14s local 2025-03-14T05:47:32.7908905Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 13s local 2025-03-14T05:47:32.7909811Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2025-03-14T05:47:32.7910722Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local ... 2025-03-14T05:47:32.9902279Z 2025-03-14T05:47:32.9903225Z  2025-03-14T05:47:32.9903679Z  2025-03-14T05:47:32.9904088Z  2025-03-14T05:47:32.9904468Z  2025-03-14T05:47:32.9904916Z  2025-03-14T05:47:32.9905400Z  2025-03-14T05:47:32.9905840Z  2025-03-14T05:47:32.9906233Z  2025-03-14T05:47:32.9906850Z [13,697 / 15,235] 48 actions running 2025-03-14T05:47:32.9908196Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T05:47:32.9909255Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T05:47:32.9910392Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local 2025-03-14T05:47:32.9911538Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local 2025-03-14T05:47:32.9912441Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 14s local 2025-03-14T05:47:32.9913339Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 14s local 2025-03-14T05:47:32.9914427Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2025-03-14T05:47:32.9915615Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 12s local ... 2025-03-14T05:47:33.2668880Z 2025-03-14T05:47:33.2669848Z  2025-03-14T05:47:33.2670330Z  2025-03-14T05:47:33.2670754Z  2025-03-14T05:47:33.2671213Z  2025-03-14T05:47:33.2671635Z  2025-03-14T05:47:33.2672073Z  2025-03-14T05:47:33.2672466Z  2025-03-14T05:47:33.2672884Z  2025-03-14T05:47:33.2673500Z [13,698 / 15,235] 48 actions, 47 running 2025-03-14T05:47:33.2674421Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T05:47:33.2675489Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T05:47:33.2676512Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local 2025-03-14T05:47:33.2677580Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local 2025-03-14T05:47:33.2678668Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 14s local 2025-03-14T05:47:33.2679577Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 14s local 2025-03-14T05:47:33.2680524Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2025-03-14T05:47:33.2681504Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local ... 2025-03-14T05:47:33.5248102Z 2025-03-14T05:47:33.5249010Z  2025-03-14T05:47:33.5249516Z  2025-03-14T05:47:33.5249898Z  2025-03-14T05:47:33.5250305Z  2025-03-14T05:47:33.5250731Z  2025-03-14T05:47:33.5251097Z  2025-03-14T05:47:33.5251473Z  2025-03-14T05:47:33.5251860Z  2025-03-14T05:47:33.5252451Z [13,700 / 15,235] 48 actions, 47 running 2025-03-14T05:47:33.5253360Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T05:47:33.5254509Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T05:47:33.5255544Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local 2025-03-14T05:47:33.5256650Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 14s local 2025-03-14T05:47:33.5257681Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 14s local 2025-03-14T05:47:33.5258653Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 14s local 2025-03-14T05:47:33.5259696Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2025-03-14T05:47:33.5260713Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local ... 2025-03-14T05:47:33.7909324Z 2025-03-14T05:47:33.7910250Z  2025-03-14T05:47:33.7910726Z  2025-03-14T05:47:33.7911116Z  2025-03-14T05:47:33.7911510Z  2025-03-14T05:47:33.7911906Z  2025-03-14T05:47:33.7912281Z  2025-03-14T05:47:33.7912785Z  2025-03-14T05:47:33.7913200Z  2025-03-14T05:47:33.7913787Z [13,700 / 15,235] 48 actions running 2025-03-14T05:47:33.7914729Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T05:47:33.7915801Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T05:47:33.7916860Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local 2025-03-14T05:47:33.7917986Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local 2025-03-14T05:47:33.7919021Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 15s local 2025-03-14T05:47:33.7920375Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 14s local 2025-03-14T05:47:33.7921329Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2025-03-14T05:47:33.7922346Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local ... 2025-03-14T05:47:33.9913553Z 2025-03-14T05:47:33.9914448Z  2025-03-14T05:47:33.9914910Z  2025-03-14T05:47:33.9915309Z  2025-03-14T05:47:33.9915699Z  2025-03-14T05:47:33.9916088Z  2025-03-14T05:47:33.9916476Z  2025-03-14T05:47:33.9916842Z  2025-03-14T05:47:33.9917342Z  2025-03-14T05:47:33.9917867Z [13,702 / 15,235] 48 actions running 2025-03-14T05:47:33.9918697Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T05:47:33.9919667Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T05:47:33.9920610Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local 2025-03-14T05:47:33.9921634Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local 2025-03-14T05:47:33.9922581Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 15s local 2025-03-14T05:47:33.9923507Z Compiling xla/backends/cpu/runtime/call_thunk.cc; 15s local 2025-03-14T05:47:33.9924336Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2025-03-14T05:47:33.9925352Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 13s local ... 2025-03-14T05:47:34.3870770Z 2025-03-14T05:47:34.3871738Z  2025-03-14T05:47:34.3872298Z  2025-03-14T05:47:34.3872622Z  2025-03-14T05:47:34.3872937Z  2025-03-14T05:47:34.3873248Z  2025-03-14T05:47:34.3873560Z  2025-03-14T05:47:34.3873864Z  2025-03-14T05:47:34.3874173Z  2025-03-14T05:47:34.3874637Z [13,704 / 15,235] 48 actions, 47 running 2025-03-14T05:47:34.3875353Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T05:47:34.3876480Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T05:47:34.3877282Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local 2025-03-14T05:47:34.3878088Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local 2025-03-14T05:47:34.3878821Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 15s local 2025-03-14T05:47:34.3879554Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2025-03-14T05:47:34.3880257Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2025-03-14T05:47:34.3880862Z @llvm-project//llvm:Scalar; 14s local ... 2025-03-14T05:47:34.5918983Z 2025-03-14T05:47:34.5919908Z  2025-03-14T05:47:34.5920484Z  2025-03-14T05:47:34.5920868Z  2025-03-14T05:47:34.5921242Z  2025-03-14T05:47:34.5921623Z  2025-03-14T05:47:34.5922007Z  2025-03-14T05:47:34.5922375Z  2025-03-14T05:47:34.5922746Z  2025-03-14T05:47:34.5923310Z [13,704 / 15,235] 48 actions running 2025-03-14T05:47:34.5924179Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T05:47:34.5925349Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T05:47:34.5926342Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2025-03-14T05:47:34.5927394Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 15s local 2025-03-14T05:47:34.5928341Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 15s local 2025-03-14T05:47:34.5929230Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2025-03-14T05:47:34.5930143Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2025-03-14T05:47:34.5930867Z @llvm-project//llvm:Scalar; 14s local ... 2025-03-14T05:47:34.7923324Z 2025-03-14T05:47:34.7924256Z  2025-03-14T05:47:34.7924903Z  2025-03-14T05:47:34.7925288Z  2025-03-14T05:47:34.7925651Z  2025-03-14T05:47:34.7926074Z  2025-03-14T05:47:34.7926762Z  2025-03-14T05:47:34.7927139Z  2025-03-14T05:47:34.7927901Z  2025-03-14T05:47:34.7928435Z [13,705 / 15,235] 48 actions running 2025-03-14T05:47:34.7929288Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T05:47:34.7930292Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T05:47:34.7931272Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2025-03-14T05:47:34.7932320Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local 2025-03-14T05:47:34.7933266Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 16s local 2025-03-14T05:47:34.7934196Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2025-03-14T05:47:34.7935289Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 14s local 2025-03-14T05:47:34.7935993Z @llvm-project//llvm:Scalar; 14s local ... 2025-03-14T05:47:35.1929379Z 2025-03-14T05:47:35.1930271Z  2025-03-14T05:47:35.1930770Z  2025-03-14T05:47:35.1931246Z  2025-03-14T05:47:35.1931665Z  2025-03-14T05:47:35.1932104Z  2025-03-14T05:47:35.1932510Z  2025-03-14T05:47:35.1932933Z  2025-03-14T05:47:35.1933343Z  2025-03-14T05:47:35.1933914Z [13,706 / 15,235] 48 actions running 2025-03-14T05:47:35.1934871Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T05:47:35.1935946Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T05:47:35.1937000Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2025-03-14T05:47:35.1938090Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 16s local 2025-03-14T05:47:35.1939078Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 16s local 2025-03-14T05:47:35.1940107Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2025-03-14T05:47:35.1941096Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2025-03-14T05:47:35.1942419Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 13s local ... 2025-03-14T05:47:35.6173119Z 2025-03-14T05:47:35.6174156Z  2025-03-14T05:47:35.6174695Z  2025-03-14T05:47:35.6175077Z  2025-03-14T05:47:35.6175465Z  2025-03-14T05:47:35.6175833Z  2025-03-14T05:47:35.6176231Z  2025-03-14T05:47:35.6176636Z  2025-03-14T05:47:35.6177055Z  2025-03-14T05:47:35.6177674Z [13,707 / 15,235] 48 actions, 47 running 2025-03-14T05:47:35.6178564Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T05:47:35.6179537Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T05:47:35.6180562Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2025-03-14T05:47:35.6181579Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local 2025-03-14T05:47:35.6182562Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 16s local 2025-03-14T05:47:35.6183579Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2025-03-14T05:47:35.6184532Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2025-03-14T05:47:35.6185445Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 13s local ... 2025-03-14T05:47:35.9935936Z 2025-03-14T05:47:35.9936898Z  2025-03-14T05:47:35.9937462Z  2025-03-14T05:47:35.9937817Z  2025-03-14T05:47:35.9938196Z  2025-03-14T05:47:35.9938571Z  2025-03-14T05:47:35.9938964Z  2025-03-14T05:47:35.9939357Z  2025-03-14T05:47:35.9939733Z  2025-03-14T05:47:35.9940285Z [13,707 / 15,235] 48 actions running 2025-03-14T05:47:35.9941165Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2025-03-14T05:47:35.9942356Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2025-03-14T05:47:35.9943374Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2025-03-14T05:47:35.9944466Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local 2025-03-14T05:47:35.9945520Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 17s local 2025-03-14T05:47:35.9946914Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2025-03-14T05:47:35.9947811Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 15s local 2025-03-14T05:47:35.9948755Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 13s local ... 2025-03-14T05:47:36.3707812Z 2025-03-14T05:47:36.3708857Z  2025-03-14T05:47:36.3709420Z  2025-03-14T05:47:36.3709791Z  2025-03-14T05:47:36.3710142Z  2025-03-14T05:47:36.3710515Z  2025-03-14T05:47:36.3710922Z  2025-03-14T05:47:36.3711329Z  2025-03-14T05:47:36.3711733Z  2025-03-14T05:47:36.3712321Z [13,709 / 15,235] 48 actions, 47 running 2025-03-14T05:47:36.3713187Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2025-03-14T05:47:36.3714126Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2025-03-14T05:47:36.3715191Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2025-03-14T05:47:36.3716261Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local 2025-03-14T05:47:36.3717167Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 17s local 2025-03-14T05:47:36.3718066Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2025-03-14T05:47:36.3718992Z Compiling llvm/lib/Transforms/Scalar/SROA.cpp; 16s local 2025-03-14T05:47:36.3719838Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local ... 2025-03-14T05:47:36.5941864Z 2025-03-14T05:47:36.5942880Z  2025-03-14T05:47:36.5943454Z  2025-03-14T05:47:36.5943846Z  2025-03-14T05:47:36.5944211Z  2025-03-14T05:47:36.5944575Z  2025-03-14T05:47:36.5944944Z  2025-03-14T05:47:36.5945316Z  2025-03-14T05:47:36.5945703Z  2025-03-14T05:47:36.5946392Z [13,710 / 15,235] 48 actions running 2025-03-14T05:47:36.5947775Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2025-03-14T05:47:36.5948888Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2025-03-14T05:47:36.5950056Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 21s local 2025-03-14T05:47:36.5951060Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 17s local 2025-03-14T05:47:36.5952141Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 17s local 2025-03-14T05:47:36.5953166Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2025-03-14T05:47:36.5954198Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local 2025-03-14T05:47:36.5955201Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local ... 2025-03-14T05:47:36.8538122Z 2025-03-14T05:47:36.8539084Z  2025-03-14T05:47:36.8539637Z  2025-03-14T05:47:36.8540016Z  2025-03-14T05:47:36.8540366Z  2025-03-14T05:47:36.8540738Z  2025-03-14T05:47:36.8541175Z  2025-03-14T05:47:36.8541709Z  2025-03-14T05:47:36.8542251Z  2025-03-14T05:47:36.8542898Z [13,712 / 15,235] 48 actions, 47 running 2025-03-14T05:47:36.8543815Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T05:47:36.8544955Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T05:47:36.8545954Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local 2025-03-14T05:47:36.8546964Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 18s local 2025-03-14T05:47:36.8547859Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2025-03-14T05:47:36.8548904Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local 2025-03-14T05:47:36.8549890Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local 2025-03-14T05:47:36.8550824Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 13s local ... 2025-03-14T05:47:37.1948368Z 2025-03-14T05:47:37.1949275Z  2025-03-14T05:47:37.1949746Z  2025-03-14T05:47:37.1950145Z  2025-03-14T05:47:37.1950561Z  2025-03-14T05:47:37.1951039Z  2025-03-14T05:47:37.1951762Z  2025-03-14T05:47:37.1952150Z  2025-03-14T05:47:37.1952524Z  2025-03-14T05:47:37.1953103Z [13,712 / 15,235] 48 actions running 2025-03-14T05:47:37.1953998Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T05:47:37.1955053Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T05:47:37.1955991Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local 2025-03-14T05:47:37.1956963Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 18s local 2025-03-14T05:47:37.1957953Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2025-03-14T05:47:37.1958948Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local 2025-03-14T05:47:37.1959859Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local 2025-03-14T05:47:37.1960938Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 13s local ... 2025-03-14T05:47:37.3952136Z 2025-03-14T05:47:37.3953220Z  2025-03-14T05:47:37.3953779Z  2025-03-14T05:47:37.3954103Z  2025-03-14T05:47:37.3954441Z  2025-03-14T05:47:37.3954765Z  2025-03-14T05:47:37.3955085Z  2025-03-14T05:47:37.3955411Z  2025-03-14T05:47:37.3955747Z  2025-03-14T05:47:37.3956227Z [13,714 / 15,235] 48 actions running 2025-03-14T05:47:37.3956994Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T05:47:37.3957832Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T05:47:37.3958617Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local 2025-03-14T05:47:37.3959411Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 18s local 2025-03-14T05:47:37.3960211Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2025-03-14T05:47:37.3960998Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local 2025-03-14T05:47:37.3962173Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 13s local 2025-03-14T05:47:37.3962974Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 13s local ... 2025-03-14T05:47:37.7958326Z 2025-03-14T05:47:37.7959111Z  2025-03-14T05:47:37.7959589Z  2025-03-14T05:47:37.7959979Z  2025-03-14T05:47:37.7960362Z  2025-03-14T05:47:37.7960764Z  2025-03-14T05:47:37.7961150Z  2025-03-14T05:47:37.7961548Z  2025-03-14T05:47:37.7961935Z  2025-03-14T05:47:37.7962497Z [13,716 / 15,235] 48 actions running 2025-03-14T05:47:37.7963405Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T05:47:37.7964401Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T05:47:37.7965707Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local 2025-03-14T05:47:37.7966655Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 19s local 2025-03-14T05:47:37.7967638Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2025-03-14T05:47:37.7968617Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local 2025-03-14T05:47:37.7969506Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local 2025-03-14T05:47:37.7970469Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 14s local ... 2025-03-14T05:47:38.0798078Z 2025-03-14T05:47:38.0799107Z  2025-03-14T05:47:38.0799868Z  2025-03-14T05:47:38.0800456Z  2025-03-14T05:47:38.0801056Z  2025-03-14T05:47:38.0801642Z  2025-03-14T05:47:38.0802099Z  2025-03-14T05:47:38.0802681Z  2025-03-14T05:47:38.0803367Z  2025-03-14T05:47:38.0804152Z [13,717 / 15,235] 48 actions, 47 running 2025-03-14T05:47:38.0805287Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T05:47:38.0806700Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T05:47:38.0808032Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local 2025-03-14T05:47:38.0809367Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 19s local 2025-03-14T05:47:38.0811177Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2025-03-14T05:47:38.0812501Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local 2025-03-14T05:47:38.0813497Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local 2025-03-14T05:47:38.0814574Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 14s local ... 2025-03-14T05:47:38.2975995Z 2025-03-14T05:47:38.2976907Z  2025-03-14T05:47:38.2977322Z  2025-03-14T05:47:38.2977657Z  2025-03-14T05:47:38.2977987Z  2025-03-14T05:47:38.2978324Z  2025-03-14T05:47:38.2978682Z  2025-03-14T05:47:38.2979047Z  2025-03-14T05:47:38.2979530Z  2025-03-14T05:47:38.2980076Z [13,719 / 15,235] 48 actions, 47 running 2025-03-14T05:47:38.2980936Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T05:47:38.2981933Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T05:47:38.2982863Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local 2025-03-14T05:47:38.2983757Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 19s local 2025-03-14T05:47:38.2984651Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2025-03-14T05:47:38.2994067Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2025-03-14T05:47:38.2995134Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 14s local 2025-03-14T05:47:38.2996050Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 14s local ... 2025-03-14T05:47:38.5963994Z 2025-03-14T05:47:38.5965027Z  2025-03-14T05:47:38.5965656Z  2025-03-14T05:47:38.5966047Z  2025-03-14T05:47:38.5966424Z  2025-03-14T05:47:38.5966797Z  2025-03-14T05:47:38.5967166Z  2025-03-14T05:47:38.5967555Z  2025-03-14T05:47:38.5967925Z  2025-03-14T05:47:38.5968861Z [13,719 / 15,235] 48 actions running 2025-03-14T05:47:38.5969751Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T05:47:38.5970700Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T05:47:38.5971597Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local 2025-03-14T05:47:38.5972488Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 19s local 2025-03-14T05:47:38.5973390Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2025-03-14T05:47:38.5974290Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2025-03-14T05:47:38.5975125Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local 2025-03-14T05:47:38.5976163Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 14s local ... 2025-03-14T05:47:38.8406718Z 2025-03-14T05:47:38.8407699Z  2025-03-14T05:47:38.8408122Z  2025-03-14T05:47:38.8408505Z  2025-03-14T05:47:38.8408848Z  2025-03-14T05:47:38.8409256Z  2025-03-14T05:47:38.8409623Z  2025-03-14T05:47:38.8409981Z  2025-03-14T05:47:38.8410348Z  2025-03-14T05:47:38.8410890Z [13,720 / 15,235] 48 actions, 47 running 2025-03-14T05:47:38.8411671Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T05:47:38.8412533Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2025-03-14T05:47:38.8413349Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2025-03-14T05:47:38.8414197Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2025-03-14T05:47:38.8414982Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2025-03-14T05:47:38.8415736Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2025-03-14T05:47:38.8416472Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local 2025-03-14T05:47:38.8417312Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 15s local ... 2025-03-14T05:47:39.1482005Z 2025-03-14T05:47:39.1482971Z  2025-03-14T05:47:39.1483478Z  2025-03-14T05:47:39.1484188Z  2025-03-14T05:47:39.1484695Z  2025-03-14T05:47:39.1485106Z  2025-03-14T05:47:39.1485511Z  2025-03-14T05:47:39.1485896Z  2025-03-14T05:47:39.1486303Z  2025-03-14T05:47:39.1486879Z [13,722 / 15,235] 48 actions, 47 running 2025-03-14T05:47:39.1487700Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T05:47:39.1488612Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2025-03-14T05:47:39.1489491Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2025-03-14T05:47:39.1490372Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2025-03-14T05:47:39.1491260Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2025-03-14T05:47:39.1492118Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local 2025-03-14T05:47:39.1492987Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 15s local 2025-03-14T05:47:39.1493932Z Compiling xla/backends/cpu/runtime/conditional_thunk.cc; 14s local ... 2025-03-14T05:47:39.3972545Z 2025-03-14T05:47:39.3973348Z  2025-03-14T05:47:39.3973813Z  2025-03-14T05:47:39.3974218Z  2025-03-14T05:47:39.3974610Z  2025-03-14T05:47:39.3975009Z  2025-03-14T05:47:39.3975402Z  2025-03-14T05:47:39.3975783Z  2025-03-14T05:47:39.3976174Z  2025-03-14T05:47:39.3976748Z [13,722 / 15,235] 48 actions running 2025-03-14T05:47:39.3977663Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T05:47:39.3978632Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2025-03-14T05:47:39.3979571Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local 2025-03-14T05:47:39.3980564Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2025-03-14T05:47:39.3981531Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2025-03-14T05:47:39.3982894Z Compiling llvm/lib/Transforms/Scalar/NewGVN.cpp; 15s local 2025-03-14T05:47:39.3983854Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 15s local 2025-03-14T05:47:39.3984928Z Compiling xla/backends/cpu/runtime/conditional_thunk.cc; 15s local ... 2025-03-14T05:47:39.6698809Z 2025-03-14T05:47:39.6699709Z  2025-03-14T05:47:39.6700532Z  2025-03-14T05:47:39.6701080Z  2025-03-14T05:47:39.6701632Z  2025-03-14T05:47:39.6702163Z  2025-03-14T05:47:39.6702684Z  2025-03-14T05:47:39.6703184Z  2025-03-14T05:47:39.6703688Z  2025-03-14T05:47:39.6704427Z [13,724 / 15,235] 48 actions, 47 running 2025-03-14T05:47:39.6705444Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T05:47:39.6706645Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2025-03-14T05:47:39.6707722Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2025-03-14T05:47:39.6708917Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2025-03-14T05:47:39.6710091Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2025-03-14T05:47:39.6711291Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 16s local 2025-03-14T05:47:39.6712603Z Compiling xla/backends/cpu/runtime/conditional_thunk.cc; 15s local 2025-03-14T05:47:39.6713834Z Compiling xla/backends/cpu/runtime/reduce_scatter_thunk.cc; 14s local ... 2025-03-14T05:47:39.9976825Z 2025-03-14T05:47:39.9977777Z  2025-03-14T05:47:39.9978219Z  2025-03-14T05:47:39.9978593Z  2025-03-14T05:47:39.9978940Z  2025-03-14T05:47:39.9979333Z  2025-03-14T05:47:39.9979677Z  2025-03-14T05:47:39.9980022Z  2025-03-14T05:47:39.9980354Z  2025-03-14T05:47:39.9980836Z [13,725 / 15,235] 48 actions running 2025-03-14T05:47:39.9981711Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T05:47:39.9982765Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T05:47:39.9984047Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2025-03-14T05:47:39.9985322Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2025-03-14T05:47:39.9986250Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2025-03-14T05:47:39.9987188Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 16s local 2025-03-14T05:47:39.9988257Z Compiling xla/backends/cpu/runtime/conditional_thunk.cc; 15s local 2025-03-14T05:47:39.9989299Z Compiling xla/backends/cpu/runtime/reduce_scatter_thunk.cc; 14s local ... 2025-03-14T05:47:40.2068922Z 2025-03-14T05:47:40.2071401Z  2025-03-14T05:47:40.2071885Z  2025-03-14T05:47:40.2072272Z  2025-03-14T05:47:40.2072684Z  2025-03-14T05:47:40.2073086Z  2025-03-14T05:47:40.2073483Z  2025-03-14T05:47:40.2073884Z  2025-03-14T05:47:40.2074282Z  2025-03-14T05:47:40.2074945Z [13,726 / 15,235] 48 actions, 47 running 2025-03-14T05:47:40.2075929Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T05:47:40.2077010Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T05:47:40.2078002Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2025-03-14T05:47:40.2078989Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2025-03-14T05:47:40.2080039Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T05:47:40.2081195Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 16s local 2025-03-14T05:47:40.2082385Z Compiling xla/backends/cpu/runtime/conditional_thunk.cc; 15s local 2025-03-14T05:47:40.2083525Z Compiling xla/backends/cpu/runtime/reduce_scatter_thunk.cc; 14s local ... 2025-03-14T05:47:40.4354362Z 2025-03-14T05:47:40.4355247Z  2025-03-14T05:47:40.4355780Z  2025-03-14T05:47:40.4356250Z  2025-03-14T05:47:40.4356715Z  2025-03-14T05:47:40.4357508Z  2025-03-14T05:47:40.4357987Z  2025-03-14T05:47:40.4358463Z  2025-03-14T05:47:40.4358918Z  2025-03-14T05:47:40.4359552Z [13,730 / 15,235] 48 actions, 47 running 2025-03-14T05:47:40.4360496Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T05:47:40.4361605Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T05:47:40.4362650Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local 2025-03-14T05:47:40.4363719Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2025-03-14T05:47:40.4364894Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T05:47:40.4366196Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 16s local 2025-03-14T05:47:40.4367323Z Compiling xla/backends/cpu/runtime/reduce_scatter_thunk.cc; 14s local 2025-03-14T05:47:40.4368480Z Compiling xla/backends/cpu/runtime/all_gather_thunk.cc; 14s local ... 2025-03-14T05:47:40.7983462Z 2025-03-14T05:47:40.7984480Z  2025-03-14T05:47:40.7985142Z  2025-03-14T05:47:40.7985603Z  2025-03-14T05:47:40.7986051Z  2025-03-14T05:47:40.7986426Z  2025-03-14T05:47:40.7986961Z  2025-03-14T05:47:40.7987489Z  2025-03-14T05:47:40.7987937Z  2025-03-14T05:47:40.7988462Z [13,733 / 15,235] 48 actions running 2025-03-14T05:47:40.7989284Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T05:47:40.7990249Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T05:47:40.7991421Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2025-03-14T05:47:40.7992277Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2025-03-14T05:47:40.7993276Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T05:47:40.7994288Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 17s local 2025-03-14T05:47:40.7995362Z Compiling xla/backends/cpu/runtime/reduce_scatter_thunk.cc; 15s local 2025-03-14T05:47:40.7996853Z Compiling xla/backends/cpu/runtime/all_gather_thunk.cc; 15s local ... 2025-03-14T05:47:41.0890257Z 2025-03-14T05:47:41.0891229Z  2025-03-14T05:47:41.0891735Z  2025-03-14T05:47:41.0892199Z  2025-03-14T05:47:41.0892574Z  2025-03-14T05:47:41.0892974Z  2025-03-14T05:47:41.0893479Z  2025-03-14T05:47:41.0893876Z  2025-03-14T05:47:41.0894268Z  2025-03-14T05:47:41.0894944Z [13,734 / 15,235] 48 actions, 47 running 2025-03-14T05:47:41.0895868Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T05:47:41.0896864Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T05:47:41.0897810Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2025-03-14T05:47:41.0898804Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2025-03-14T05:47:41.0899911Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T05:47:41.0901043Z Compiling xla/backends/cpu/runtime/reduce_scatter_thunk.cc; 15s local 2025-03-14T05:47:41.0902144Z Compiling xla/backends/cpu/runtime/all_gather_thunk.cc; 15s local 2025-03-14T05:47:41.0903133Z Compiling .../cpu/runtime/collective_permute_thunk.cc; 15s local ... 2025-03-14T05:47:41.2911212Z 2025-03-14T05:47:41.2912254Z  2025-03-14T05:47:41.2912751Z  2025-03-14T05:47:41.2913231Z  2025-03-14T05:47:41.2913679Z  2025-03-14T05:47:41.2914139Z  2025-03-14T05:47:41.2914582Z  2025-03-14T05:47:41.2915005Z  2025-03-14T05:47:41.2915380Z  2025-03-14T05:47:41.2915995Z [13,735 / 15,235] 48 actions, 47 running 2025-03-14T05:47:41.2917044Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T05:47:41.2918214Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T05:47:41.2919584Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2025-03-14T05:47:41.2920566Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2025-03-14T05:47:41.2921477Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2025-03-14T05:47:41.2922525Z Compiling xla/backends/cpu/runtime/all_gather_thunk.cc; 15s local 2025-03-14T05:47:41.2923554Z Compiling xla/backends/cpu/runtime/collective_permute_thunk.cc; 15s local 2025-03-14T05:47:41.2924761Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 15s local ... 2025-03-14T05:47:41.5761845Z 2025-03-14T05:47:41.5762827Z  2025-03-14T05:47:41.5763366Z  2025-03-14T05:47:41.5763821Z  2025-03-14T05:47:41.5764189Z  2025-03-14T05:47:41.5764736Z  2025-03-14T05:47:41.5765144Z  2025-03-14T05:47:41.5765741Z  2025-03-14T05:47:41.5766136Z  2025-03-14T05:47:41.5766745Z [13,737 / 15,235] 48 actions, 47 running 2025-03-14T05:47:41.5767739Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T05:47:41.5768783Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T05:47:41.5769769Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local 2025-03-14T05:47:41.5770747Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2025-03-14T05:47:41.5771774Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2025-03-14T05:47:41.5772800Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 15s local 2025-03-14T05:47:41.5774068Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 13s local 2025-03-14T05:47:41.5775178Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 13s local ... 2025-03-14T05:47:41.7992200Z 2025-03-14T05:47:41.7993076Z  2025-03-14T05:47:41.7993510Z  2025-03-14T05:47:41.7993877Z  2025-03-14T05:47:41.7994247Z  2025-03-14T05:47:41.7994579Z  2025-03-14T05:47:41.7994945Z  2025-03-14T05:47:41.7995322Z  2025-03-14T05:47:41.7995729Z  2025-03-14T05:47:41.7996322Z [13,737 / 15,235] 48 actions running 2025-03-14T05:47:41.7997517Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T05:47:41.7998679Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T05:47:41.7999609Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2025-03-14T05:47:41.8000618Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2025-03-14T05:47:41.8001589Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2025-03-14T05:47:41.8002533Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local 2025-03-14T05:47:41.8003350Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 13s local 2025-03-14T05:47:41.8004295Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 13s local ... 2025-03-14T05:47:42.0471004Z 2025-03-14T05:47:42.0471787Z  2025-03-14T05:47:42.0472240Z  2025-03-14T05:47:42.0472624Z  2025-03-14T05:47:42.0473068Z  2025-03-14T05:47:42.0473427Z  2025-03-14T05:47:42.0473800Z  2025-03-14T05:47:42.0474237Z  2025-03-14T05:47:42.0474715Z  2025-03-14T05:47:42.0475446Z [13,741 / 15,235] 48 actions, 47 running 2025-03-14T05:47:42.0476322Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T05:47:42.0477257Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T05:47:42.0478198Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2025-03-14T05:47:42.0479166Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2025-03-14T05:47:42.0480000Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local 2025-03-14T05:47:42.0480943Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 13s local 2025-03-14T05:47:42.0482780Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 13s local 2025-03-14T05:47:42.0483810Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 12s local ... 2025-03-14T05:47:42.2668238Z 2025-03-14T05:47:42.2669095Z  2025-03-14T05:47:42.2669600Z  2025-03-14T05:47:42.2669990Z  2025-03-14T05:47:42.2670341Z  2025-03-14T05:47:42.2670711Z  2025-03-14T05:47:42.2671098Z  2025-03-14T05:47:42.2671488Z  2025-03-14T05:47:42.2671881Z  2025-03-14T05:47:42.2672466Z [13,743 / 15,235] 48 actions, 47 running 2025-03-14T05:47:42.2673334Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T05:47:42.2674337Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T05:47:42.2675249Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local 2025-03-14T05:47:42.2676216Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2025-03-14T05:47:42.2677123Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local 2025-03-14T05:47:42.2678042Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 14s local 2025-03-14T05:47:42.2679043Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 14s local 2025-03-14T05:47:42.2680044Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 12s local ... 2025-03-14T05:47:42.5184497Z 2025-03-14T05:47:42.5185368Z  2025-03-14T05:47:42.5185839Z  2025-03-14T05:47:42.5186225Z  2025-03-14T05:47:42.5186611Z  2025-03-14T05:47:42.5186910Z  2025-03-14T05:47:42.5187221Z  2025-03-14T05:47:42.5187531Z  2025-03-14T05:47:42.5187902Z  2025-03-14T05:47:42.5188584Z [13,745 / 15,235] 48 actions, 47 running 2025-03-14T05:47:42.5189493Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T05:47:42.5190514Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T05:47:42.5191420Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2025-03-14T05:47:42.5192368Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local 2025-03-14T05:47:42.5193352Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 14s local 2025-03-14T05:47:42.5194762Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 14s local 2025-03-14T05:47:42.5195753Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 12s local 2025-03-14T05:47:42.5196792Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 12s local ... 2025-03-14T05:47:42.8001515Z 2025-03-14T05:47:42.8002509Z  2025-03-14T05:47:42.8003179Z  2025-03-14T05:47:42.8003599Z  2025-03-14T05:47:42.8004012Z  2025-03-14T05:47:42.8004473Z  2025-03-14T05:47:42.8005119Z  2025-03-14T05:47:42.8005569Z  2025-03-14T05:47:42.8005957Z  2025-03-14T05:47:42.8006626Z [13,749 / 15,235] 48 actions running 2025-03-14T05:47:42.8007593Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T05:47:42.8008730Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T05:47:42.8009759Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T05:47:42.8010787Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 17s local 2025-03-14T05:47:42.8011759Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 14s local 2025-03-14T05:47:42.8012836Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 14s local 2025-03-14T05:47:42.8013929Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 13s local 2025-03-14T05:47:42.8015005Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 13s local ... 2025-03-14T05:47:43.0006412Z 2025-03-14T05:47:43.0007265Z  2025-03-14T05:47:43.0007707Z  2025-03-14T05:47:43.0008126Z  2025-03-14T05:47:43.0008530Z  2025-03-14T05:47:43.0008903Z  2025-03-14T05:47:43.0009261Z  2025-03-14T05:47:43.0009750Z  2025-03-14T05:47:43.0010265Z  2025-03-14T05:47:43.0010955Z [13,751 / 15,235] 47 actions running 2025-03-14T05:47:43.0011927Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T05:47:43.0013304Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2025-03-14T05:47:43.0014345Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T05:47:43.0015440Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 17s local 2025-03-14T05:47:43.0016375Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 14s local 2025-03-14T05:47:43.0017322Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 14s local 2025-03-14T05:47:43.0018290Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 13s local 2025-03-14T05:47:43.0019300Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 13s local ... 2025-03-14T05:47:43.4009160Z 2025-03-14T05:47:43.4010131Z  2025-03-14T05:47:43.4010673Z  2025-03-14T05:47:43.4011126Z  2025-03-14T05:47:43.4011563Z  2025-03-14T05:47:43.4012056Z  2025-03-14T05:47:43.4012469Z  2025-03-14T05:47:43.4012848Z  2025-03-14T05:47:43.4013221Z  2025-03-14T05:47:43.4013834Z [13,754 / 15,235] 48 actions running 2025-03-14T05:47:43.4014792Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T05:47:43.4015847Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2025-03-14T05:47:43.4016806Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T05:47:43.4017819Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 15s local 2025-03-14T05:47:43.4018819Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 15s local 2025-03-14T05:47:43.4019845Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 13s local 2025-03-14T05:47:43.4020791Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 13s local 2025-03-14T05:47:43.4021909Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 13s local ... 2025-03-14T05:47:43.6786033Z 2025-03-14T05:47:43.6786983Z  2025-03-14T05:47:43.6787510Z  2025-03-14T05:47:43.6788106Z  2025-03-14T05:47:43.6788517Z  2025-03-14T05:47:43.6789044Z  2025-03-14T05:47:43.6789453Z  2025-03-14T05:47:43.6790215Z  2025-03-14T05:47:43.6790614Z  2025-03-14T05:47:43.6791228Z [13,755 / 15,235] 48 actions, 47 running 2025-03-14T05:47:43.6792181Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T05:47:43.6793245Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2025-03-14T05:47:43.6794195Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T05:47:43.6795185Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 15s local 2025-03-14T05:47:43.6796164Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 15s local 2025-03-14T05:47:43.6797198Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 14s local 2025-03-14T05:47:43.6798198Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 14s local 2025-03-14T05:47:43.6799222Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 13s local ... 2025-03-14T05:47:44.0015378Z 2025-03-14T05:47:44.0016321Z  2025-03-14T05:47:44.0016868Z  2025-03-14T05:47:44.0017295Z  2025-03-14T05:47:44.0017708Z  2025-03-14T05:47:44.0018176Z  2025-03-14T05:47:44.0018577Z  2025-03-14T05:47:44.0018949Z  2025-03-14T05:47:44.0019307Z  2025-03-14T05:47:44.0019847Z [13,755 / 15,235] 48 actions running 2025-03-14T05:47:44.0020748Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T05:47:44.0021728Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T05:47:44.0022639Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2025-03-14T05:47:44.0023553Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 15s local 2025-03-14T05:47:44.0024490Z Compiling xla/backends/cpu/runtime/all_to_all_thunk.cc; 15s local 2025-03-14T05:47:44.0025472Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 14s local 2025-03-14T05:47:44.0026819Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 14s local 2025-03-14T05:47:44.0027933Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 13s local ... 2025-03-14T05:47:44.2353571Z 2025-03-14T05:47:44.2354464Z  2025-03-14T05:47:44.2355029Z  2025-03-14T05:47:44.2355514Z  2025-03-14T05:47:44.2355981Z  2025-03-14T05:47:44.2356467Z  2025-03-14T05:47:44.2356939Z  2025-03-14T05:47:44.2357395Z  2025-03-14T05:47:44.2357854Z  2025-03-14T05:47:44.2358537Z [13,759 / 15,235] 48 actions, 47 running 2025-03-14T05:47:44.2359467Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T05:47:44.2360606Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T05:47:44.2361634Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2025-03-14T05:47:44.2362448Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local 2025-03-14T05:47:44.2363291Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 14s local 2025-03-14T05:47:44.2364086Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 14s local 2025-03-14T05:47:44.2365162Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 14s local 2025-03-14T05:47:44.2366375Z Compiling llvm/lib/Passes/PassBuilder.cpp; 13s local ... 2025-03-14T05:47:44.4366470Z 2025-03-14T05:47:44.4367247Z  2025-03-14T05:47:44.4367663Z  2025-03-14T05:47:44.4367997Z  2025-03-14T05:47:44.4368333Z  2025-03-14T05:47:44.4368665Z  2025-03-14T05:47:44.4368998Z  2025-03-14T05:47:44.4369328Z  2025-03-14T05:47:44.4369657Z  2025-03-14T05:47:44.4370159Z [13,761 / 15,235] 48 actions, 47 running 2025-03-14T05:47:44.4370934Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T05:47:44.4371788Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T05:47:44.4372553Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2025-03-14T05:47:44.4373389Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local 2025-03-14T05:47:44.4374484Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 14s local 2025-03-14T05:47:44.4375284Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 14s local 2025-03-14T05:47:44.4376120Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 14s local 2025-03-14T05:47:44.4376954Z Compiling llvm/lib/Passes/PassBuilder.cpp; 14s local ... 2025-03-14T05:47:44.8022211Z 2025-03-14T05:47:44.8023179Z  2025-03-14T05:47:44.8023669Z  2025-03-14T05:47:44.8024092Z  2025-03-14T05:47:44.8024513Z  2025-03-14T05:47:44.8024923Z  2025-03-14T05:47:44.8025328Z  2025-03-14T05:47:44.8025733Z  2025-03-14T05:47:44.8026121Z  2025-03-14T05:47:44.8026727Z [13,764 / 15,235] 48 actions running 2025-03-14T05:47:44.8027749Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T05:47:44.8028847Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T05:47:44.8029762Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2025-03-14T05:47:44.8030650Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local 2025-03-14T05:47:44.8031595Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 15s local 2025-03-14T05:47:44.8032577Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 15s local 2025-03-14T05:47:44.8033576Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 14s local 2025-03-14T05:47:44.8034548Z Compiling llvm/lib/Passes/PassBuilder.cpp; 14s local ... 2025-03-14T05:47:45.0330771Z 2025-03-14T05:47:45.0331777Z  2025-03-14T05:47:45.0332290Z  2025-03-14T05:47:45.0332736Z  2025-03-14T05:47:45.0333152Z  2025-03-14T05:47:45.0333613Z  2025-03-14T05:47:45.0333997Z  2025-03-14T05:47:45.0334408Z  2025-03-14T05:47:45.0334817Z  2025-03-14T05:47:45.0335789Z [13,765 / 15,235] 48 actions, 47 running 2025-03-14T05:47:45.0336763Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T05:47:45.0337849Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T05:47:45.0338865Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2025-03-14T05:47:45.0339902Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local 2025-03-14T05:47:45.0340856Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 15s local 2025-03-14T05:47:45.0341891Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 15s local 2025-03-14T05:47:45.0342914Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 14s local 2025-03-14T05:47:45.0343937Z Compiling llvm/lib/Passes/PassBuilder.cpp; 14s local ... 2025-03-14T05:47:45.2625693Z 2025-03-14T05:47:45.2626528Z  2025-03-14T05:47:45.2626985Z  2025-03-14T05:47:45.2627394Z  2025-03-14T05:47:45.2627804Z  2025-03-14T05:47:45.2628140Z  2025-03-14T05:47:45.2628533Z  2025-03-14T05:47:45.2628907Z  2025-03-14T05:47:45.2629298Z  2025-03-14T05:47:45.2629887Z [13,766 / 15,235] 48 actions, 47 running 2025-03-14T05:47:45.2630837Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T05:47:45.2631746Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T05:47:45.2632621Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2025-03-14T05:47:45.2633490Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local 2025-03-14T05:47:45.2634347Z Compiling xla/backends/cpu/runtime/all_reduce_thunk.cc; 15s local 2025-03-14T05:47:45.2635258Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 15s local 2025-03-14T05:47:45.2636225Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 15s local 2025-03-14T05:47:45.2637177Z Compiling llvm/lib/Passes/PassBuilder.cpp; 14s local ... 2025-03-14T05:47:45.5073048Z 2025-03-14T05:47:45.5073980Z  2025-03-14T05:47:45.5074479Z  2025-03-14T05:47:45.5075256Z  2025-03-14T05:47:45.5075636Z  2025-03-14T05:47:45.5076033Z  2025-03-14T05:47:45.5076434Z  2025-03-14T05:47:45.5076824Z  2025-03-14T05:47:45.5077210Z  2025-03-14T05:47:45.5077768Z [13,767 / 15,235] 48 actions, 47 running 2025-03-14T05:47:45.5078680Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T05:47:45.5079705Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T05:47:45.5080609Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2025-03-14T05:47:45.5081550Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local 2025-03-14T05:47:45.5082383Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 15s local 2025-03-14T05:47:45.5083310Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 15s local 2025-03-14T05:47:45.5084283Z Compiling llvm/lib/Passes/PassBuilder.cpp; 15s local 2025-03-14T05:47:45.5085336Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 15s local ... 2025-03-14T05:47:45.7436656Z 2025-03-14T05:47:45.7437444Z  2025-03-14T05:47:45.7437928Z  2025-03-14T05:47:45.7438316Z  2025-03-14T05:47:45.7438712Z  2025-03-14T05:47:45.7439120Z  2025-03-14T05:47:45.7439512Z  2025-03-14T05:47:45.7439919Z  2025-03-14T05:47:45.7440303Z  2025-03-14T05:47:45.7440920Z [13,770 / 15,235] 48 actions, 47 running 2025-03-14T05:47:45.7441852Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T05:47:45.7442919Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T05:47:45.7443857Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2025-03-14T05:47:45.7444969Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local 2025-03-14T05:47:45.7445961Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local 2025-03-14T05:47:45.7447208Z Compiling llvm/lib/Passes/PassBuilder.cpp; 15s local 2025-03-14T05:47:45.7448115Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 15s local 2025-03-14T05:47:45.7449084Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2025-03-14T05:47:46.0032217Z 2025-03-14T05:47:46.0033152Z  2025-03-14T05:47:46.0033649Z  2025-03-14T05:47:46.0034019Z  2025-03-14T05:47:46.0034424Z  2025-03-14T05:47:46.0034838Z  2025-03-14T05:47:46.0035239Z  2025-03-14T05:47:46.0035650Z  2025-03-14T05:47:46.0036071Z  2025-03-14T05:47:46.0036649Z [13,771 / 15,235] 48 actions running 2025-03-14T05:47:46.0037588Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T05:47:46.0038626Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T05:47:46.0039660Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2025-03-14T05:47:46.0040673Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local 2025-03-14T05:47:46.0041636Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local 2025-03-14T05:47:46.0042576Z Compiling llvm/lib/Passes/PassBuilder.cpp; 15s local 2025-03-14T05:47:46.0043659Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 15s local 2025-03-14T05:47:46.0044886Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2025-03-14T05:47:46.2045500Z 2025-03-14T05:47:46.2046361Z  2025-03-14T05:47:46.2046853Z  2025-03-14T05:47:46.2047267Z  2025-03-14T05:47:46.2047654Z  2025-03-14T05:47:46.2048043Z  2025-03-14T05:47:46.2048411Z  2025-03-14T05:47:46.2048825Z  2025-03-14T05:47:46.2049253Z  2025-03-14T05:47:46.2049823Z [13,773 / 15,235] 48 actions, 47 running 2025-03-14T05:47:46.2050747Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T05:47:46.2051695Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T05:47:46.2052599Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2025-03-14T05:47:46.2053963Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2025-03-14T05:47:46.2054916Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local 2025-03-14T05:47:46.2055778Z Compiling llvm/lib/Passes/PassBuilder.cpp; 15s local 2025-03-14T05:47:46.2056646Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 15s local 2025-03-14T05:47:46.2057612Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2025-03-14T05:47:46.6037312Z 2025-03-14T05:47:46.6038202Z  2025-03-14T05:47:46.6038731Z  2025-03-14T05:47:46.6039178Z  2025-03-14T05:47:46.6039619Z  2025-03-14T05:47:46.6040057Z  2025-03-14T05:47:46.6040524Z  2025-03-14T05:47:46.6040972Z  2025-03-14T05:47:46.6041377Z  2025-03-14T05:47:46.6041937Z [13,773 / 15,235] 48 actions running 2025-03-14T05:47:46.6042938Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T05:47:46.6044144Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T05:47:46.6045286Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2025-03-14T05:47:46.6046277Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2025-03-14T05:47:46.6047262Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local 2025-03-14T05:47:46.6048158Z Compiling llvm/lib/Passes/PassBuilder.cpp; 16s local 2025-03-14T05:47:46.6048934Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 16s local 2025-03-14T05:47:46.6049784Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local ... 2025-03-14T05:47:46.8042357Z 2025-03-14T05:47:46.8043302Z  2025-03-14T05:47:46.8043821Z  2025-03-14T05:47:46.8044266Z  2025-03-14T05:47:46.8044819Z  2025-03-14T05:47:46.8045275Z  2025-03-14T05:47:46.8045726Z  2025-03-14T05:47:46.8046091Z  2025-03-14T05:47:46.8046807Z  2025-03-14T05:47:46.8047296Z [13,774 / 15,235] 48 actions running 2025-03-14T05:47:46.8048120Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T05:47:46.8049016Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T05:47:46.8049837Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2025-03-14T05:47:46.8050699Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2025-03-14T05:47:46.8051590Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 17s local 2025-03-14T05:47:46.8052431Z Compiling llvm/lib/Passes/PassBuilder.cpp; 16s local 2025-03-14T05:47:46.8053238Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 16s local 2025-03-14T05:47:46.8054139Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local ... 2025-03-14T05:47:47.3038082Z 2025-03-14T05:47:47.3039017Z  2025-03-14T05:47:47.3039554Z  2025-03-14T05:47:47.3040001Z  2025-03-14T05:47:47.3040471Z  2025-03-14T05:47:47.3040953Z  2025-03-14T05:47:47.3041350Z  2025-03-14T05:47:47.3041718Z  2025-03-14T05:47:47.3042105Z  2025-03-14T05:47:47.3042691Z [13,775 / 15,235] 48 actions, 47 running 2025-03-14T05:47:47.3043615Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T05:47:47.3044815Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T05:47:47.3045730Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2025-03-14T05:47:47.3046659Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2025-03-14T05:47:47.3047725Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 17s local 2025-03-14T05:47:47.3048620Z Compiling llvm/lib/Passes/PassBuilder.cpp; 17s local 2025-03-14T05:47:47.3049481Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 16s local 2025-03-14T05:47:47.3050425Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local ... 2025-03-14T05:47:47.6049909Z 2025-03-14T05:47:47.6050853Z  2025-03-14T05:47:47.6051730Z  2025-03-14T05:47:47.6052156Z  2025-03-14T05:47:47.6052594Z  2025-03-14T05:47:47.6053015Z  2025-03-14T05:47:47.6053397Z  2025-03-14T05:47:47.6053774Z  2025-03-14T05:47:47.6054157Z  2025-03-14T05:47:47.6054727Z [13,776 / 15,235] 48 actions running 2025-03-14T05:47:47.6055642Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T05:47:47.6056639Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T05:47:47.6057535Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2025-03-14T05:47:47.6058446Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2025-03-14T05:47:47.6059402Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 17s local 2025-03-14T05:47:47.6060253Z Compiling llvm/lib/Passes/PassBuilder.cpp; 17s local 2025-03-14T05:47:47.6061109Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 17s local 2025-03-14T05:47:47.6062092Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local ... 2025-03-14T05:47:47.8053498Z 2025-03-14T05:47:47.8054454Z  2025-03-14T05:47:47.8054978Z  2025-03-14T05:47:47.8055423Z  2025-03-14T05:47:47.8055959Z  2025-03-14T05:47:47.8056443Z  2025-03-14T05:47:47.8056848Z  2025-03-14T05:47:47.8057248Z  2025-03-14T05:47:47.8057623Z  2025-03-14T05:47:47.8058182Z [13,778 / 15,235] 47 actions running 2025-03-14T05:47:47.8059061Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T05:47:47.8060073Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T05:47:47.8061003Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local 2025-03-14T05:47:47.8061969Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2025-03-14T05:47:47.8062961Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local 2025-03-14T05:47:47.8064329Z Compiling llvm/lib/Passes/PassBuilder.cpp; 17s local 2025-03-14T05:47:47.8065262Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 17s local 2025-03-14T05:47:47.8066521Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local ... 2025-03-14T05:47:48.0412321Z 2025-03-14T05:47:48.0413215Z  2025-03-14T05:47:48.0413727Z  2025-03-14T05:47:48.0414202Z  2025-03-14T05:47:48.0414608Z  2025-03-14T05:47:48.0415077Z  2025-03-14T05:47:48.0415488Z  2025-03-14T05:47:48.0415885Z  2025-03-14T05:47:48.0416239Z  2025-03-14T05:47:48.0416818Z [13,780 / 15,235] 48 actions, 47 running 2025-03-14T05:47:48.0417711Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2025-03-14T05:47:48.0418728Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T05:47:48.0419554Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local 2025-03-14T05:47:48.0420448Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2025-03-14T05:47:48.0421373Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local 2025-03-14T05:47:48.0422152Z Compiling llvm/lib/Passes/PassBuilder.cpp; 17s local 2025-03-14T05:47:48.0422966Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 17s local 2025-03-14T05:47:48.0423932Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local ... 2025-03-14T05:47:48.4059966Z 2025-03-14T05:47:48.4060918Z  2025-03-14T05:47:48.4061442Z  2025-03-14T05:47:48.4061899Z  2025-03-14T05:47:48.4062295Z  2025-03-14T05:47:48.4062768Z  2025-03-14T05:47:48.4063277Z  2025-03-14T05:47:48.4063637Z  2025-03-14T05:47:48.4064039Z  2025-03-14T05:47:48.4064600Z [13,781 / 15,235] 48 actions running 2025-03-14T05:47:48.4065660Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2025-03-14T05:47:48.4066666Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T05:47:48.4067504Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local 2025-03-14T05:47:48.4068802Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2025-03-14T05:47:48.4069755Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local 2025-03-14T05:47:48.4070615Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local 2025-03-14T05:47:48.4071544Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 17s local 2025-03-14T05:47:48.4072543Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local ... 2025-03-14T05:47:48.6063928Z 2025-03-14T05:47:48.6064857Z  2025-03-14T05:47:48.6065522Z  2025-03-14T05:47:48.6065940Z  2025-03-14T05:47:48.6066349Z  2025-03-14T05:47:48.6066733Z  2025-03-14T05:47:48.6067138Z  2025-03-14T05:47:48.6067545Z  2025-03-14T05:47:48.6067928Z  2025-03-14T05:47:48.6068462Z [13,782 / 15,235] 48 actions running 2025-03-14T05:47:48.6069348Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2025-03-14T05:47:48.6070343Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T05:47:48.6071196Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local 2025-03-14T05:47:48.6072109Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2025-03-14T05:47:48.6072989Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local 2025-03-14T05:47:48.6073695Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local 2025-03-14T05:47:48.6074556Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 18s local 2025-03-14T05:47:48.6075547Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local ... 2025-03-14T05:47:48.8732566Z 2025-03-14T05:47:48.8733452Z  2025-03-14T05:47:48.8733902Z  2025-03-14T05:47:48.8734254Z  2025-03-14T05:47:48.8734620Z  2025-03-14T05:47:48.8734981Z  2025-03-14T05:47:48.8735333Z  2025-03-14T05:47:48.8735678Z  2025-03-14T05:47:48.8736419Z  2025-03-14T05:47:48.8736989Z [13,784 / 15,235] 48 actions, 47 running 2025-03-14T05:47:48.8737834Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T05:47:48.8738754Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T05:47:48.8739551Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T05:47:48.8740389Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2025-03-14T05:47:48.8741231Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 19s local 2025-03-14T05:47:48.8742017Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local 2025-03-14T05:47:48.8742771Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 18s local 2025-03-14T05:47:48.8743643Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local ... 2025-03-14T05:47:49.1823832Z 2025-03-14T05:47:49.1824734Z  2025-03-14T05:47:49.1825210Z  2025-03-14T05:47:49.1825626Z  2025-03-14T05:47:49.1826014Z  2025-03-14T05:47:49.1826411Z  2025-03-14T05:47:49.1826777Z  2025-03-14T05:47:49.1827145Z  2025-03-14T05:47:49.1827513Z  2025-03-14T05:47:49.1828064Z [13,786 / 15,235] 47 actions, 46 running 2025-03-14T05:47:49.1828923Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T05:47:49.1829870Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T05:47:49.1830772Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T05:47:49.1831665Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2025-03-14T05:47:49.1832592Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 19s local 2025-03-14T05:47:49.1833413Z Compiling llvm/lib/Passes/PassBuilder.cpp; 18s local 2025-03-14T05:47:49.1834242Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 18s local 2025-03-14T05:47:49.1835220Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local ... 2025-03-14T05:47:49.4071267Z 2025-03-14T05:47:49.4072575Z  2025-03-14T05:47:49.4073092Z  2025-03-14T05:47:49.4073514Z  2025-03-14T05:47:49.4073972Z  2025-03-14T05:47:49.4074382Z  2025-03-14T05:47:49.4074746Z  2025-03-14T05:47:49.4075116Z  2025-03-14T05:47:49.4075486Z  2025-03-14T05:47:49.4076045Z [13,787 / 15,235] 48 actions running 2025-03-14T05:47:49.4076945Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T05:47:49.4077949Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T05:47:49.4078876Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T05:47:49.4079835Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2025-03-14T05:47:49.4080788Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 19s local 2025-03-14T05:47:49.4081669Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local 2025-03-14T05:47:49.4082572Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 18s local 2025-03-14T05:47:49.4083392Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local ... 2025-03-14T05:47:49.6723697Z 2025-03-14T05:47:49.6724812Z  2025-03-14T05:47:49.6725346Z  2025-03-14T05:47:49.6725796Z  2025-03-14T05:47:49.6726209Z  2025-03-14T05:47:49.6726683Z  2025-03-14T05:47:49.6727077Z  2025-03-14T05:47:49.6727442Z  2025-03-14T05:47:49.6727826Z  2025-03-14T05:47:49.6728401Z [13,788 / 15,235] 48 actions, 47 running 2025-03-14T05:47:49.6729252Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T05:47:49.6730263Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T05:47:49.6731166Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T05:47:49.6732091Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2025-03-14T05:47:49.6733484Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2025-03-14T05:47:49.6734417Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local 2025-03-14T05:47:49.6735257Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 19s local 2025-03-14T05:47:49.6736227Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local ... 2025-03-14T05:47:49.9668208Z 2025-03-14T05:47:49.9669150Z  2025-03-14T05:47:49.9669666Z  2025-03-14T05:47:49.9670104Z  2025-03-14T05:47:49.9670522Z  2025-03-14T05:47:49.9670986Z  2025-03-14T05:47:49.9671398Z  2025-03-14T05:47:49.9671789Z  2025-03-14T05:47:49.9672172Z  2025-03-14T05:47:49.9672745Z [13,790 / 15,235] 48 actions, 47 running 2025-03-14T05:47:49.9673632Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T05:47:49.9674520Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T05:47:49.9675475Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T05:47:49.9676467Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2025-03-14T05:47:49.9677358Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2025-03-14T05:47:49.9678108Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local 2025-03-14T05:47:49.9678847Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 19s local 2025-03-14T05:47:49.9679704Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local ... 2025-03-14T05:47:50.2079712Z 2025-03-14T05:47:50.2080517Z  2025-03-14T05:47:50.2080992Z  2025-03-14T05:47:50.2090739Z  2025-03-14T05:47:50.2091196Z  2025-03-14T05:47:50.2091587Z  2025-03-14T05:47:50.2091994Z  2025-03-14T05:47:50.2092394Z  2025-03-14T05:47:50.2092787Z  2025-03-14T05:47:50.2093470Z [13,790 / 15,235] 48 actions running 2025-03-14T05:47:50.2094456Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T05:47:50.2095539Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T05:47:50.2096901Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T05:47:50.2097903Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2025-03-14T05:47:50.2098921Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2025-03-14T05:47:50.2099849Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local 2025-03-14T05:47:50.2100769Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 19s local 2025-03-14T05:47:50.2101796Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local ... 2025-03-14T05:47:50.7185300Z 2025-03-14T05:47:50.7186216Z  2025-03-14T05:47:50.7186806Z  2025-03-14T05:47:50.7187311Z  2025-03-14T05:47:50.7187791Z  2025-03-14T05:47:50.7188282Z  2025-03-14T05:47:50.7188778Z  2025-03-14T05:47:50.7189219Z  2025-03-14T05:47:50.7189754Z  2025-03-14T05:47:50.7190383Z [13,791 / 15,235] 48 actions, 47 running 2025-03-14T05:47:50.7191361Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T05:47:50.7192460Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T05:47:50.7193432Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T05:47:50.7194462Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2025-03-14T05:47:50.7195491Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local 2025-03-14T05:47:50.7196418Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2025-03-14T05:47:50.7197289Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 20s local 2025-03-14T05:47:50.7198293Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local ... 2025-03-14T05:47:51.0084114Z 2025-03-14T05:47:51.0085192Z  2025-03-14T05:47:51.0085707Z  2025-03-14T05:47:51.0086166Z  2025-03-14T05:47:51.0086598Z  2025-03-14T05:47:51.0087079Z  2025-03-14T05:47:51.0087488Z  2025-03-14T05:47:51.0088183Z  2025-03-14T05:47:51.0088569Z  2025-03-14T05:47:51.0089075Z [13,791 / 15,235] 48 actions running 2025-03-14T05:47:51.0089913Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T05:47:51.0090869Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T05:47:51.0091857Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T05:47:51.0092761Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2025-03-14T05:47:51.0093620Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local 2025-03-14T05:47:51.0094370Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2025-03-14T05:47:51.0095103Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 20s local 2025-03-14T05:47:51.0095952Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local ... 2025-03-14T05:47:51.3081560Z 2025-03-14T05:47:51.3082388Z  2025-03-14T05:47:51.3082780Z  2025-03-14T05:47:51.3083143Z  2025-03-14T05:47:51.3083479Z  2025-03-14T05:47:51.3083786Z  2025-03-14T05:47:51.3084089Z  2025-03-14T05:47:51.3084396Z  2025-03-14T05:47:51.3084797Z  2025-03-14T05:47:51.3085265Z [13,793 / 15,235] 48 actions, 47 running 2025-03-14T05:47:51.3085966Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T05:47:51.3086723Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T05:47:51.3087416Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T05:47:51.3088119Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2025-03-14T05:47:51.3088821Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local 2025-03-14T05:47:51.3089481Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T05:47:51.3090135Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 20s local 2025-03-14T05:47:51.3090896Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local ... 2025-03-14T05:47:51.5211938Z 2025-03-14T05:47:51.5212902Z  2025-03-14T05:47:51.5213351Z  2025-03-14T05:47:51.5213758Z  2025-03-14T05:47:51.5214163Z  2025-03-14T05:47:51.5214567Z  2025-03-14T05:47:51.5214936Z  2025-03-14T05:47:51.5215328Z  2025-03-14T05:47:51.5215693Z  2025-03-14T05:47:51.5216373Z [13,795 / 15,235] 48 actions, 47 running 2025-03-14T05:47:51.5217248Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T05:47:51.5218234Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T05:47:51.5219144Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T05:47:51.5220066Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2025-03-14T05:47:51.5220986Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local 2025-03-14T05:47:51.5221925Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T05:47:51.5222783Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 21s local 2025-03-14T05:47:51.5223789Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local ... 2025-03-14T05:47:51.8091146Z 2025-03-14T05:47:51.8092083Z  2025-03-14T05:47:51.8092604Z  2025-03-14T05:47:51.8093046Z  2025-03-14T05:47:51.8093465Z  2025-03-14T05:47:51.8093912Z  2025-03-14T05:47:51.8094328Z  2025-03-14T05:47:51.8094705Z  2025-03-14T05:47:51.8095107Z  2025-03-14T05:47:51.8095680Z [13,796 / 15,235] 48 actions running 2025-03-14T05:47:51.8096647Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T05:47:51.8097650Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T05:47:51.8098616Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T05:47:51.8099545Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2025-03-14T05:47:51.8100884Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2025-03-14T05:47:51.8101877Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T05:47:51.8102803Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 21s local 2025-03-14T05:47:51.8103994Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local ... 2025-03-14T05:47:52.0143411Z 2025-03-14T05:47:52.0144329Z  2025-03-14T05:47:52.0144842Z  2025-03-14T05:47:52.0145298Z  2025-03-14T05:47:52.0145729Z  2025-03-14T05:47:52.0146181Z  2025-03-14T05:47:52.0146617Z  2025-03-14T05:47:52.0147030Z  2025-03-14T05:47:52.0147449Z  2025-03-14T05:47:52.0148033Z [13,799 / 15,235] 48 actions, 47 running 2025-03-14T05:47:52.0149013Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T05:47:52.0150138Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T05:47:52.0151196Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T05:47:52.0152186Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2025-03-14T05:47:52.0153192Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2025-03-14T05:47:52.0154164Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T05:47:52.0155089Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 21s local 2025-03-14T05:47:52.0156163Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local ... 2025-03-14T05:47:52.2441620Z 2025-03-14T05:47:52.2442544Z  2025-03-14T05:47:52.2443015Z  2025-03-14T05:47:52.2443418Z  2025-03-14T05:47:52.2443798Z  2025-03-14T05:47:52.2444185Z  2025-03-14T05:47:52.2444563Z  2025-03-14T05:47:52.2445103Z  2025-03-14T05:47:52.2445480Z  2025-03-14T05:47:52.2446032Z [13,800 / 15,235] 48 actions, 47 running 2025-03-14T05:47:52.2446934Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T05:47:52.2448026Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T05:47:52.2449273Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T05:47:52.2450184Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T05:47:52.2451112Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2025-03-14T05:47:52.2452059Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T05:47:52.2452941Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 21s local 2025-03-14T05:47:52.2453907Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local ... 2025-03-14T05:47:52.4889764Z 2025-03-14T05:47:52.4890735Z  2025-03-14T05:47:52.4891195Z  2025-03-14T05:47:52.4891606Z  2025-03-14T05:47:52.4892019Z  2025-03-14T05:47:52.4892432Z  2025-03-14T05:47:52.4892836Z  2025-03-14T05:47:52.4893310Z  2025-03-14T05:47:52.4893728Z  2025-03-14T05:47:52.4894401Z [13,801 / 15,235] 48 actions, 47 running 2025-03-14T05:47:52.4895395Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T05:47:52.4896488Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T05:47:52.4897483Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T05:47:52.4898513Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T05:47:52.4899536Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2025-03-14T05:47:52.4900458Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T05:47:52.4901372Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 22s local 2025-03-14T05:47:52.4902471Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local ... 2025-03-14T05:47:52.8099127Z 2025-03-14T05:47:52.8100040Z  2025-03-14T05:47:52.8100586Z  2025-03-14T05:47:52.8101040Z  2025-03-14T05:47:52.8101478Z  2025-03-14T05:47:52.8101968Z  2025-03-14T05:47:52.8102702Z  2025-03-14T05:47:52.8103149Z  2025-03-14T05:47:52.8103515Z  2025-03-14T05:47:52.8104100Z [13,802 / 15,235] 48 actions running 2025-03-14T05:47:52.8105055Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T05:47:52.8106197Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2025-03-14T05:47:52.8107150Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T05:47:52.8108168Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T05:47:52.8109204Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2025-03-14T05:47:52.8110063Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T05:47:52.8111017Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 22s local 2025-03-14T05:47:52.8112076Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local ... 2025-03-14T05:47:53.0102820Z 2025-03-14T05:47:53.0103785Z  2025-03-14T05:47:53.0104315Z  2025-03-14T05:47:53.0104781Z  2025-03-14T05:47:53.0105202Z  2025-03-14T05:47:53.0105661Z  2025-03-14T05:47:53.0106064Z  2025-03-14T05:47:53.0106454Z  2025-03-14T05:47:53.0106850Z  2025-03-14T05:47:53.0107401Z [13,804 / 15,235] 48 actions running 2025-03-14T05:47:53.0108333Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2025-03-14T05:47:53.0109422Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2025-03-14T05:47:53.0110390Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T05:47:53.0111393Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T05:47:53.0112390Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2025-03-14T05:47:53.0113281Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T05:47:53.0114190Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 22s local 2025-03-14T05:47:53.0115245Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local ... 2025-03-14T05:47:53.2304819Z 2025-03-14T05:47:53.2305736Z  2025-03-14T05:47:53.2306275Z  2025-03-14T05:47:53.2306731Z  2025-03-14T05:47:53.2307188Z  2025-03-14T05:47:53.2307665Z  2025-03-14T05:47:53.2308054Z  2025-03-14T05:47:53.2308460Z  2025-03-14T05:47:53.2308845Z  2025-03-14T05:47:53.2309449Z [13,806 / 15,235] 48 actions, 47 running 2025-03-14T05:47:53.2310406Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2025-03-14T05:47:53.2311479Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2025-03-14T05:47:53.2312458Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T05:47:53.2313497Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T05:47:53.2314546Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2025-03-14T05:47:53.2315480Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T05:47:53.2316416Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 22s local 2025-03-14T05:47:53.2317432Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local ... 2025-03-14T05:47:53.6110080Z 2025-03-14T05:47:53.6110984Z  2025-03-14T05:47:53.6111418Z  2025-03-14T05:47:53.6111785Z  2025-03-14T05:47:53.6112142Z  2025-03-14T05:47:53.6112494Z  2025-03-14T05:47:53.6112844Z  2025-03-14T05:47:53.6113195Z  2025-03-14T05:47:53.6113547Z  2025-03-14T05:47:53.6114045Z [13,806 / 15,235] 48 actions running 2025-03-14T05:47:53.6114861Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2025-03-14T05:47:53.6115774Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2025-03-14T05:47:53.6116594Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T05:47:53.6117761Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T05:47:53.6118604Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2025-03-14T05:47:53.6119397Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T05:47:53.6120173Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 23s local 2025-03-14T05:47:53.6121075Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local ... 2025-03-14T05:47:53.8112991Z 2025-03-14T05:47:53.8113902Z  2025-03-14T05:47:53.8114427Z  2025-03-14T05:47:53.8114997Z  2025-03-14T05:47:53.8115424Z  2025-03-14T05:47:53.8115915Z  2025-03-14T05:47:53.8116339Z  2025-03-14T05:47:53.8116707Z  2025-03-14T05:47:53.8117077Z  2025-03-14T05:47:53.8117601Z [13,810 / 15,235] 48 actions running 2025-03-14T05:47:53.8118364Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T05:47:53.8119235Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T05:47:53.8120160Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T05:47:53.8121074Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2025-03-14T05:47:53.8121908Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T05:47:53.8122725Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 23s local 2025-03-14T05:47:53.8123623Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T05:47:53.8124474Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local ... 2025-03-14T05:47:54.0682889Z 2025-03-14T05:47:54.0683726Z  2025-03-14T05:47:54.0684220Z  2025-03-14T05:47:54.0684741Z  2025-03-14T05:47:54.0685185Z  2025-03-14T05:47:54.0685622Z  2025-03-14T05:47:54.0686051Z  2025-03-14T05:47:54.0686582Z  2025-03-14T05:47:54.0687045Z  2025-03-14T05:47:54.0687558Z [13,813 / 15,235] 48 actions, 47 running 2025-03-14T05:47:54.0688307Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T05:47:54.0689115Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T05:47:54.0690336Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T05:47:54.0691653Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2025-03-14T05:47:54.0692734Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T05:47:54.0693469Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 23s local 2025-03-14T05:47:54.0694294Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T05:47:54.0695100Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local ... 2025-03-14T05:47:54.4118145Z 2025-03-14T05:47:54.4119032Z  2025-03-14T05:47:54.4119515Z  2025-03-14T05:47:54.4119889Z  2025-03-14T05:47:54.4120318Z  2025-03-14T05:47:54.4120742Z  2025-03-14T05:47:54.4121172Z  2025-03-14T05:47:54.4121574Z  2025-03-14T05:47:54.4121949Z  2025-03-14T05:47:54.4122569Z [13,814 / 15,235] 48 actions running 2025-03-14T05:47:54.4123462Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T05:47:54.4124477Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T05:47:54.4125672Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2025-03-14T05:47:54.4126725Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2025-03-14T05:47:54.4127631Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T05:47:54.4128523Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local 2025-03-14T05:47:54.4129533Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T05:47:54.4130540Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local ... 2025-03-14T05:47:54.6122317Z 2025-03-14T05:47:54.6123149Z  2025-03-14T05:47:54.6123642Z  2025-03-14T05:47:54.6124039Z  2025-03-14T05:47:54.6124433Z  2025-03-14T05:47:54.6125494Z  2025-03-14T05:47:54.6125907Z  2025-03-14T05:47:54.6126327Z  2025-03-14T05:47:54.6126719Z  2025-03-14T05:47:54.6127257Z [13,815 / 15,235] 48 actions running 2025-03-14T05:47:54.6128133Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T05:47:54.6129144Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T05:47:54.6130145Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2025-03-14T05:47:54.6131151Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2025-03-14T05:47:54.6132050Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T05:47:54.6133000Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local 2025-03-14T05:47:54.6134028Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T05:47:54.6135147Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local ... 2025-03-14T05:47:54.8895173Z 2025-03-14T05:47:54.8896149Z  2025-03-14T05:47:54.8896650Z  2025-03-14T05:47:54.8897077Z  2025-03-14T05:47:54.8897455Z  2025-03-14T05:47:54.8897871Z  2025-03-14T05:47:54.8898290Z  2025-03-14T05:47:54.8898717Z  2025-03-14T05:47:54.8899133Z  2025-03-14T05:47:54.8899768Z [13,817 / 15,235] 48 actions, 47 running 2025-03-14T05:47:54.8900644Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2025-03-14T05:47:54.8901645Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T05:47:54.8902557Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2025-03-14T05:47:54.8903559Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2025-03-14T05:47:54.8904442Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T05:47:54.8905372Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local 2025-03-14T05:47:54.8906380Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T05:47:54.8907399Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local ... 2025-03-14T05:47:55.2116540Z 2025-03-14T05:47:55.2117524Z  2025-03-14T05:47:55.2118072Z  2025-03-14T05:47:55.2119664Z  2025-03-14T05:47:55.2122434Z  2025-03-14T05:47:55.2125233Z  2025-03-14T05:47:55.2125911Z  2025-03-14T05:47:55.2126508Z  2025-03-14T05:47:55.2126943Z  2025-03-14T05:47:55.2127591Z [13,818 / 15,235] 48 actions, 47 running 2025-03-14T05:47:55.2128496Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2025-03-14T05:47:55.2129525Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T05:47:55.2130389Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T05:47:55.2131322Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2025-03-14T05:47:55.2132117Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T05:47:55.2132921Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local 2025-03-14T05:47:55.2133896Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T05:47:55.4131644Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local ... 2025-03-14T05:47:55.4132341Z 2025-03-14T05:47:55.4132831Z  2025-03-14T05:47:55.4133272Z  2025-03-14T05:47:55.4133716Z  2025-03-14T05:47:55.4134150Z  2025-03-14T05:47:55.4134590Z  2025-03-14T05:47:55.4135030Z  2025-03-14T05:47:55.4135484Z  2025-03-14T05:47:55.4135875Z  2025-03-14T05:47:55.4136422Z [13,819 / 15,235] 48 actions running 2025-03-14T05:47:55.4137171Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2025-03-14T05:47:55.4138055Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T05:47:55.4138982Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T05:47:55.4139875Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2025-03-14T05:47:55.4141142Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T05:47:55.4142025Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local 2025-03-14T05:47:55.4142953Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T05:47:55.4143918Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local ... 2025-03-14T05:47:55.8135592Z 2025-03-14T05:47:55.8136529Z  2025-03-14T05:47:55.8137088Z  2025-03-14T05:47:55.8137535Z  2025-03-14T05:47:55.8137970Z  2025-03-14T05:47:55.8138404Z  2025-03-14T05:47:55.8138825Z  2025-03-14T05:47:55.8139266Z  2025-03-14T05:47:55.8139663Z  2025-03-14T05:47:55.8140195Z [13,820 / 15,235] 48 actions running 2025-03-14T05:47:55.8140964Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T05:47:55.8141873Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T05:47:55.8142824Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T05:47:55.8143744Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2025-03-14T05:47:55.8144651Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T05:47:55.8145479Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local 2025-03-14T05:47:55.8146425Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T05:47:55.8147355Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local ... 2025-03-14T05:47:56.0785339Z 2025-03-14T05:47:56.0786260Z  2025-03-14T05:47:56.0786797Z  2025-03-14T05:47:56.0787255Z  2025-03-14T05:47:56.0787819Z  2025-03-14T05:47:56.0788295Z  2025-03-14T05:47:56.0788678Z  2025-03-14T05:47:56.0789040Z  2025-03-14T05:47:56.0789410Z  2025-03-14T05:47:56.0789954Z [13,823 / 15,235] 48 actions, 47 running 2025-03-14T05:47:56.0790716Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T05:47:56.0791621Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T05:47:56.0792952Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T05:47:56.0793755Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2025-03-14T05:47:56.0794607Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T05:47:56.0795431Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local 2025-03-14T05:47:56.0796415Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T05:47:56.0797394Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local ... 2025-03-14T05:47:56.3424936Z 2025-03-14T05:47:56.3425879Z  2025-03-14T05:47:56.3426450Z  2025-03-14T05:47:56.3426949Z  2025-03-14T05:47:56.3427422Z  2025-03-14T05:47:56.3427935Z  2025-03-14T05:47:56.3428487Z  2025-03-14T05:47:56.3428810Z  2025-03-14T05:47:56.3429113Z  2025-03-14T05:47:56.3429794Z [13,825 / 15,235] 48 actions, 47 running 2025-03-14T05:47:56.3430588Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T05:47:56.3431446Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T05:47:56.3432305Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T05:47:56.3433216Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2025-03-14T05:47:56.3434012Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T05:47:56.3434808Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local 2025-03-14T05:47:56.3435698Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T05:47:56.3436689Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local ... 2025-03-14T05:47:56.6142678Z 2025-03-14T05:47:56.6143751Z  2025-03-14T05:47:56.6144270Z  2025-03-14T05:47:56.6144708Z  2025-03-14T05:47:56.6145100Z  2025-03-14T05:47:56.6145958Z  2025-03-14T05:47:56.6146359Z  2025-03-14T05:47:56.6146771Z  2025-03-14T05:47:56.6147158Z  2025-03-14T05:47:56.6147730Z [13,826 / 15,235] 48 actions running 2025-03-14T05:47:56.6148578Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T05:47:56.6149568Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T05:47:56.6150584Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T05:47:56.6151566Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2025-03-14T05:47:56.6152451Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T05:47:56.6153364Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T05:47:56.6154352Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T05:47:56.6155362Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local ... 2025-03-14T05:47:56.9090134Z 2025-03-14T05:47:56.9091065Z  2025-03-14T05:47:56.9091626Z  2025-03-14T05:47:56.9092095Z  2025-03-14T05:47:56.9092524Z  2025-03-14T05:47:56.9092987Z  2025-03-14T05:47:56.9093365Z  2025-03-14T05:47:56.9093774Z  2025-03-14T05:47:56.9094171Z  2025-03-14T05:47:56.9094762Z [13,828 / 15,235] 48 actions, 47 running 2025-03-14T05:47:56.9095590Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T05:47:56.9096557Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T05:47:56.9097613Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T05:47:56.9098627Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2025-03-14T05:47:56.9099563Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T05:47:56.9100450Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T05:47:56.9101501Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T05:47:56.9102576Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local ... 2025-03-14T05:47:57.1223190Z 2025-03-14T05:47:57.1224138Z  2025-03-14T05:47:57.1224671Z  2025-03-14T05:47:57.1225129Z  2025-03-14T05:47:57.1225568Z  2025-03-14T05:47:57.1226033Z  2025-03-14T05:47:57.1226409Z  2025-03-14T05:47:57.1226768Z  2025-03-14T05:47:57.1227168Z  2025-03-14T05:47:57.1227743Z [13,830 / 15,235] 48 actions, 47 running 2025-03-14T05:47:57.1228578Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T05:47:57.1229560Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T05:47:57.1230558Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T05:47:57.1231563Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2025-03-14T05:47:57.1232446Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T05:47:57.1233405Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T05:47:57.1234430Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T05:47:57.1235462Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local ... 2025-03-14T05:47:57.3243508Z 2025-03-14T05:47:57.3244539Z  2025-03-14T05:47:57.3245214Z  2025-03-14T05:47:57.3245668Z  2025-03-14T05:47:57.3246086Z  2025-03-14T05:47:57.3246542Z  2025-03-14T05:47:57.3246939Z  2025-03-14T05:47:57.3247355Z  2025-03-14T05:47:57.3247720Z  2025-03-14T05:47:57.3248317Z [13,832 / 15,235] 47 actions, 46 running 2025-03-14T05:47:57.3249120Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T05:47:57.3250039Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T05:47:57.3250981Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2025-03-14T05:47:57.3251956Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2025-03-14T05:47:57.3253274Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2025-03-14T05:47:57.3254247Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T05:47:57.3255243Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T05:47:57.3256292Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local ... 2025-03-14T05:47:57.6150472Z 2025-03-14T05:47:57.6151394Z  2025-03-14T05:47:57.6151920Z  2025-03-14T05:47:57.6152357Z  2025-03-14T05:47:57.6152769Z  2025-03-14T05:47:57.6153226Z  2025-03-14T05:47:57.6153628Z  2025-03-14T05:47:57.6153992Z  2025-03-14T05:47:57.6154383Z  2025-03-14T05:47:57.6154924Z [13,834 / 15,235] 48 actions running 2025-03-14T05:47:57.6155708Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T05:47:57.6156649Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T05:47:57.6157656Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2025-03-14T05:47:57.6158628Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2025-03-14T05:47:57.6159515Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2025-03-14T05:47:57.6160426Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T05:47:57.6161412Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2025-03-14T05:47:57.6162394Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local ... 2025-03-14T05:47:58.2072912Z 2025-03-14T05:47:58.2073812Z  2025-03-14T05:47:58.2074346Z  2025-03-14T05:47:58.2074793Z  2025-03-14T05:47:58.2075213Z  2025-03-14T05:47:58.2075681Z  2025-03-14T05:47:58.2076082Z  2025-03-14T05:47:58.2076447Z  2025-03-14T05:47:58.2076833Z  2025-03-14T05:47:58.2077443Z [13,835 / 15,235] 48 actions, 47 running 2025-03-14T05:47:58.2078299Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T05:47:58.2079304Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T05:47:58.2080742Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2025-03-14T05:47:58.2081722Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T05:47:58.2082638Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2025-03-14T05:47:58.2083555Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T05:47:58.2085455Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2025-03-14T05:47:58.2086449Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local ... 2025-03-14T05:47:58.4157946Z 2025-03-14T05:47:58.4158842Z  2025-03-14T05:47:58.4159390Z  2025-03-14T05:47:58.4159837Z  2025-03-14T05:47:58.4160295Z  2025-03-14T05:47:58.4160765Z  2025-03-14T05:47:58.4161175Z  2025-03-14T05:47:58.4161532Z  2025-03-14T05:47:58.4161867Z  2025-03-14T05:47:58.4162450Z [13,835 / 15,235] 48 actions running 2025-03-14T05:47:58.4163255Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T05:47:58.4164175Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T05:47:58.4165682Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2025-03-14T05:47:58.4166771Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T05:47:58.4167633Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T05:47:58.4168561Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2025-03-14T05:47:58.4169595Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2025-03-14T05:47:58.4170634Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local ... 2025-03-14T05:47:58.6162045Z 2025-03-14T05:47:58.6162995Z  2025-03-14T05:47:58.6163513Z  2025-03-14T05:47:58.6163965Z  2025-03-14T05:47:58.6164386Z  2025-03-14T05:47:58.6164979Z  2025-03-14T05:47:58.6165920Z  2025-03-14T05:47:58.6166357Z  2025-03-14T05:47:58.6166751Z  2025-03-14T05:47:58.6167394Z [13,837 / 15,235] 48 actions running 2025-03-14T05:47:58.6168190Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T05:47:58.6169125Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T05:47:58.6170071Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2025-03-14T05:47:58.6170978Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T05:47:58.6171859Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T05:47:58.6172755Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2025-03-14T05:47:58.6173678Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T05:47:58.6174624Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local ... 2025-03-14T05:47:59.0167907Z 2025-03-14T05:47:59.0168704Z  2025-03-14T05:47:59.0169172Z  2025-03-14T05:47:59.0169526Z  2025-03-14T05:47:59.0169880Z  2025-03-14T05:47:59.0170245Z  2025-03-14T05:47:59.0170619Z  2025-03-14T05:47:59.0170996Z  2025-03-14T05:47:59.0171368Z  2025-03-14T05:47:59.0171950Z [13,838 / 15,235] 48 actions running 2025-03-14T05:47:59.0172678Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2025-03-14T05:47:59.0173482Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T05:47:59.0174336Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2025-03-14T05:47:59.0175268Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2025-03-14T05:47:59.0176090Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T05:47:59.0176840Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2025-03-14T05:47:59.0177747Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T05:47:59.0178667Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2025-03-14T05:47:59.4171815Z 2025-03-14T05:47:59.4172585Z  2025-03-14T05:47:59.4173006Z  2025-03-14T05:47:59.4173356Z  2025-03-14T05:47:59.4173709Z  2025-03-14T05:47:59.4174062Z  2025-03-14T05:47:59.4174405Z  2025-03-14T05:47:59.4174729Z  2025-03-14T05:47:59.4175084Z  2025-03-14T05:47:59.4175581Z [13,841 / 15,235] 48 actions running 2025-03-14T05:47:59.4176281Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2025-03-14T05:47:59.4177088Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T05:47:59.4178113Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T05:47:59.4179189Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2025-03-14T05:47:59.4180243Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T05:47:59.4181454Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T05:47:59.4182371Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T05:47:59.4183157Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2025-03-14T05:47:59.6444018Z 2025-03-14T05:47:59.6445026Z  2025-03-14T05:47:59.6445535Z  2025-03-14T05:47:59.6445944Z  2025-03-14T05:47:59.6446360Z  2025-03-14T05:47:59.6446763Z  2025-03-14T05:47:59.6447150Z  2025-03-14T05:47:59.6447537Z  2025-03-14T05:47:59.6447907Z  2025-03-14T05:47:59.6448477Z [13,843 / 15,235] 48 actions, 47 running 2025-03-14T05:47:59.6449239Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2025-03-14T05:47:59.6450052Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T05:47:59.6450963Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T05:47:59.6451918Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T05:47:59.6453323Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T05:47:59.6454283Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T05:47:59.6455275Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2025-03-14T05:47:59.6456333Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local ... 2025-03-14T05:47:59.8559419Z 2025-03-14T05:47:59.8560213Z  2025-03-14T05:47:59.8560706Z  2025-03-14T05:47:59.8561127Z  2025-03-14T05:47:59.8561523Z  2025-03-14T05:47:59.8561906Z  2025-03-14T05:47:59.8562314Z  2025-03-14T05:47:59.8562686Z  2025-03-14T05:47:59.8563105Z  2025-03-14T05:47:59.8563744Z [13,845 / 15,235] 48 actions, 47 running 2025-03-14T05:47:59.8564778Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T05:47:59.8566064Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T05:47:59.8567208Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T05:47:59.8568225Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T05:47:59.8569185Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T05:47:59.8570044Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T05:47:59.8571030Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2025-03-14T05:47:59.8572067Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local ... 2025-03-14T05:48:00.0671922Z 2025-03-14T05:48:00.0672758Z  2025-03-14T05:48:00.0673262Z  2025-03-14T05:48:00.0673659Z  2025-03-14T05:48:00.0674085Z  2025-03-14T05:48:00.0674567Z  2025-03-14T05:48:00.0675019Z  2025-03-14T05:48:00.0675431Z  2025-03-14T05:48:00.0675849Z  2025-03-14T05:48:00.0676445Z [13,849 / 15,235] 48 actions, 47 running 2025-03-14T05:48:00.0677254Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T05:48:00.0678235Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T05:48:00.0679589Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T05:48:00.0680603Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T05:48:00.0681566Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T05:48:00.0682508Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T05:48:00.0683536Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2025-03-14T05:48:00.0684723Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local ... 2025-03-14T05:48:00.3356255Z 2025-03-14T05:48:00.3357151Z  2025-03-14T05:48:00.3357667Z  2025-03-14T05:48:00.3358099Z  2025-03-14T05:48:00.3358500Z  2025-03-14T05:48:00.3358926Z  2025-03-14T05:48:00.3359297Z  2025-03-14T05:48:00.3359683Z  2025-03-14T05:48:00.3360123Z  2025-03-14T05:48:00.3360901Z [13,854 / 15,235] 48 actions, 47 running 2025-03-14T05:48:00.3361704Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T05:48:00.3362619Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T05:48:00.3363610Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T05:48:00.3364837Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T05:48:00.3365937Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T05:48:00.3366840Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T05:48:00.3367797Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T05:48:00.3368823Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local ... 2025-03-14T05:48:00.6180591Z 2025-03-14T05:48:00.6181424Z  2025-03-14T05:48:00.6181912Z  2025-03-14T05:48:00.6182343Z  2025-03-14T05:48:00.6182788Z  2025-03-14T05:48:00.6183212Z  2025-03-14T05:48:00.6183988Z  2025-03-14T05:48:00.6184440Z  2025-03-14T05:48:00.6184883Z  2025-03-14T05:48:00.6185461Z [13,854 / 15,235] 48 actions running 2025-03-14T05:48:00.6186321Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T05:48:00.6187323Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T05:48:00.6188338Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T05:48:00.6189349Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T05:48:00.6190298Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T05:48:00.6191219Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T05:48:00.6192217Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T05:48:00.6193253Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local ... 2025-03-14T05:48:00.8184567Z 2025-03-14T05:48:00.8185446Z  2025-03-14T05:48:00.8185977Z  2025-03-14T05:48:00.8186411Z  2025-03-14T05:48:00.8186968Z  2025-03-14T05:48:00.8187352Z  2025-03-14T05:48:00.8187834Z  2025-03-14T05:48:00.8188256Z  2025-03-14T05:48:00.8188650Z  2025-03-14T05:48:00.8189232Z [13,856 / 15,235] 48 actions running 2025-03-14T05:48:00.8190121Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T05:48:00.8191203Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T05:48:00.8192194Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T05:48:00.8193296Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T05:48:00.8194191Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T05:48:00.8195064Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T05:48:00.8196033Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T05:48:00.8197196Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local ... 2025-03-14T05:48:01.0922002Z 2025-03-14T05:48:01.0922845Z  2025-03-14T05:48:01.0923369Z  2025-03-14T05:48:01.0923878Z  2025-03-14T05:48:01.0924379Z  2025-03-14T05:48:01.0924904Z  2025-03-14T05:48:01.0925286Z  2025-03-14T05:48:01.0925667Z  2025-03-14T05:48:01.0926027Z  2025-03-14T05:48:01.0926624Z [13,859 / 15,235] 48 actions, 47 running 2025-03-14T05:48:01.0927451Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T05:48:01.0928375Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T05:48:01.0929285Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T05:48:01.0930237Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T05:48:01.0931120Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T05:48:01.0932052Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T05:48:01.0933180Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T05:48:01.0934237Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local ... 2025-03-14T05:48:01.4191736Z 2025-03-14T05:48:01.4192622Z  2025-03-14T05:48:01.4193126Z  2025-03-14T05:48:01.4193534Z  2025-03-14T05:48:01.4193935Z  2025-03-14T05:48:01.4194330Z  2025-03-14T05:48:01.4194744Z  2025-03-14T05:48:01.4195233Z  2025-03-14T05:48:01.4195630Z  2025-03-14T05:48:01.4196208Z [13,859 / 15,235] 48 actions running 2025-03-14T05:48:01.4197056Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T05:48:01.4198017Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T05:48:01.4198987Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T05:48:01.4199920Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T05:48:01.4201174Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T05:48:01.4202199Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T05:48:01.4203163Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T05:48:01.4204118Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local ... 2025-03-14T05:48:01.6194384Z 2025-03-14T05:48:01.6195230Z  2025-03-14T05:48:01.6195748Z  2025-03-14T05:48:01.6196174Z  2025-03-14T05:48:01.6196598Z  2025-03-14T05:48:01.6197027Z  2025-03-14T05:48:01.6197566Z  2025-03-14T05:48:01.6197973Z  2025-03-14T05:48:01.6198378Z  2025-03-14T05:48:01.6198965Z [13,860 / 15,235] 48 actions running 2025-03-14T05:48:01.6199800Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T05:48:01.6200768Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T05:48:01.6201792Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T05:48:01.6202794Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T05:48:01.6203724Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T05:48:01.6204726Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T05:48:01.6205630Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T05:48:01.6206661Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local ... 2025-03-14T05:48:02.1097486Z 2025-03-14T05:48:02.1098285Z  2025-03-14T05:48:02.1098791Z  2025-03-14T05:48:02.1099175Z  2025-03-14T05:48:02.1099574Z  2025-03-14T05:48:02.1099961Z  2025-03-14T05:48:02.1100368Z  2025-03-14T05:48:02.1100766Z  2025-03-14T05:48:02.1101133Z  2025-03-14T05:48:02.1101719Z [13,861 / 15,235] 48 actions, 47 running 2025-03-14T05:48:02.1102561Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T05:48:02.1103522Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T05:48:02.1105033Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T05:48:02.1106037Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T05:48:02.1106968Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T05:48:02.1107810Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T05:48:02.1108715Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T05:48:02.1109669Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local ... 2025-03-14T05:48:02.4200393Z 2025-03-14T05:48:02.4201243Z  2025-03-14T05:48:02.4201705Z  2025-03-14T05:48:02.4202083Z  2025-03-14T05:48:02.4202469Z  2025-03-14T05:48:02.4202861Z  2025-03-14T05:48:02.4203238Z  2025-03-14T05:48:02.4203640Z  2025-03-14T05:48:02.4204026Z  2025-03-14T05:48:02.4213417Z [13,861 / 15,235] 48 actions running 2025-03-14T05:48:02.4214220Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T05:48:02.4215062Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T05:48:02.4215893Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T05:48:02.4216697Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T05:48:02.4217469Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T05:48:02.4218214Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T05:48:02.4219069Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T05:48:02.4219937Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local ... 2025-03-14T05:48:02.6204474Z 2025-03-14T05:48:02.6205415Z  2025-03-14T05:48:02.6205903Z  2025-03-14T05:48:02.6206289Z  2025-03-14T05:48:02.6206668Z  2025-03-14T05:48:02.6207063Z  2025-03-14T05:48:02.6207842Z  2025-03-14T05:48:02.6208256Z  2025-03-14T05:48:02.6208651Z  2025-03-14T05:48:02.6209240Z [13,863 / 15,235] 48 actions, 47 running 2025-03-14T05:48:02.6210024Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T05:48:02.6210895Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T05:48:02.6211792Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T05:48:02.6212682Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T05:48:02.6213483Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T05:48:02.6214294Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T05:48:02.6215198Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T05:48:02.6216166Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local ... 2025-03-14T05:48:03.0210254Z 2025-03-14T05:48:03.0211088Z  2025-03-14T05:48:03.0211614Z  2025-03-14T05:48:03.0212016Z  2025-03-14T05:48:03.0212415Z  2025-03-14T05:48:03.0212799Z  2025-03-14T05:48:03.0213199Z  2025-03-14T05:48:03.0213587Z  2025-03-14T05:48:03.0213964Z  2025-03-14T05:48:03.0214546Z [13,863 / 15,235] 48 actions running 2025-03-14T05:48:03.0215352Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T05:48:03.0216288Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T05:48:03.0217290Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T05:48:03.0218180Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T05:48:03.0219058Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T05:48:03.0219970Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T05:48:03.0220932Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T05:48:03.0221891Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local ... 2025-03-14T05:48:03.2213306Z 2025-03-14T05:48:03.2214096Z  2025-03-14T05:48:03.2214572Z  2025-03-14T05:48:03.2214994Z  2025-03-14T05:48:03.2215412Z  2025-03-14T05:48:03.2215829Z  2025-03-14T05:48:03.2216375Z  2025-03-14T05:48:03.2216778Z  2025-03-14T05:48:03.2217181Z  2025-03-14T05:48:03.2217746Z [13,864 / 15,235] 48 actions running 2025-03-14T05:48:03.2218602Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T05:48:03.2219570Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T05:48:03.2220590Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T05:48:03.2221557Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T05:48:03.2222449Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T05:48:03.2223403Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T05:48:03.2224435Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T05:48:03.2225485Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local ... 2025-03-14T05:48:03.6008354Z 2025-03-14T05:48:03.6009230Z  2025-03-14T05:48:03.6009677Z  2025-03-14T05:48:03.6010023Z  2025-03-14T05:48:03.6010389Z  2025-03-14T05:48:03.6010760Z  2025-03-14T05:48:03.6011156Z  2025-03-14T05:48:03.6011516Z  2025-03-14T05:48:03.6011966Z  2025-03-14T05:48:03.6012472Z [13,865 / 15,235] 48 actions, 47 running 2025-03-14T05:48:03.6013284Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T05:48:03.6014054Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T05:48:03.6014840Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T05:48:03.6015619Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T05:48:03.6016773Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T05:48:03.6017525Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T05:48:03.6018294Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T05:48:03.6019213Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local ... 2025-03-14T05:48:03.8220910Z 2025-03-14T05:48:03.8221777Z  2025-03-14T05:48:03.8222260Z  2025-03-14T05:48:03.8222684Z  2025-03-14T05:48:03.8223109Z  2025-03-14T05:48:03.8223487Z  2025-03-14T05:48:03.8223885Z  2025-03-14T05:48:03.8224273Z  2025-03-14T05:48:03.8224669Z  2025-03-14T05:48:03.8225248Z [13,866 / 15,235] 48 actions running 2025-03-14T05:48:03.8226092Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T05:48:03.8227094Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T05:48:03.8228112Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T05:48:03.8229070Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T05:48:03.8229973Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T05:48:03.8230900Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T05:48:03.8231886Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2025-03-14T05:48:03.8232889Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local ... 2025-03-14T05:48:04.0222903Z 2025-03-14T05:48:04.0223745Z  2025-03-14T05:48:04.0224241Z  2025-03-14T05:48:04.0224668Z  2025-03-14T05:48:04.0225080Z  2025-03-14T05:48:04.0225489Z  2025-03-14T05:48:04.0225909Z  2025-03-14T05:48:04.0226305Z  2025-03-14T05:48:04.0226735Z  2025-03-14T05:48:04.0227289Z [13,869 / 15,235] 48 actions running 2025-03-14T05:48:04.0228157Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T05:48:04.0229158Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T05:48:04.0230507Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T05:48:04.0231445Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T05:48:04.0232349Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T05:48:04.0233256Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T05:48:04.0234258Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2025-03-14T05:48:04.0235301Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local ... 2025-03-14T05:48:04.2830764Z 2025-03-14T05:48:04.2831626Z  2025-03-14T05:48:04.2832114Z  2025-03-14T05:48:04.2832510Z  2025-03-14T05:48:04.2832921Z  2025-03-14T05:48:04.2833322Z  2025-03-14T05:48:04.2833741Z  2025-03-14T05:48:04.2834139Z  2025-03-14T05:48:04.2834548Z  2025-03-14T05:48:04.2835186Z [13,871 / 15,235] 48 actions, 47 running 2025-03-14T05:48:04.2836250Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T05:48:04.2837257Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T05:48:04.2838221Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T05:48:04.2839121Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T05:48:04.2839992Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T05:48:04.2840851Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T05:48:04.2841705Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2025-03-14T05:48:04.2842712Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local ... 2025-03-14T05:48:04.6229149Z 2025-03-14T05:48:04.6229963Z  2025-03-14T05:48:04.6230486Z  2025-03-14T05:48:04.6230920Z  2025-03-14T05:48:04.6231327Z  2025-03-14T05:48:04.6231751Z  2025-03-14T05:48:04.6232535Z  2025-03-14T05:48:04.6232972Z  2025-03-14T05:48:04.6233375Z  2025-03-14T05:48:04.6233964Z [13,872 / 15,235] 48 actions running 2025-03-14T05:48:04.6234827Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T05:48:04.6235824Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T05:48:04.6236849Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T05:48:04.6237854Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T05:48:04.6238789Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T05:48:04.6239652Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T05:48:04.6240565Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2025-03-14T05:48:04.6241442Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local ... 2025-03-14T05:48:04.8233562Z 2025-03-14T05:48:04.8234400Z  2025-03-14T05:48:04.8234932Z  2025-03-14T05:48:04.8235430Z  2025-03-14T05:48:04.8235814Z  2025-03-14T05:48:04.8236222Z  2025-03-14T05:48:04.8236614Z  2025-03-14T05:48:04.8237001Z  2025-03-14T05:48:04.8237381Z  2025-03-14T05:48:04.8237927Z [13,874 / 15,235] 48 actions running 2025-03-14T05:48:04.8238686Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T05:48:04.8239588Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T05:48:04.8240530Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T05:48:04.8241439Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T05:48:04.8242282Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T05:48:04.8243172Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T05:48:04.8244109Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T05:48:04.8245224Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local ... 2025-03-14T05:48:05.0593174Z 2025-03-14T05:48:05.0594029Z  2025-03-14T05:48:05.0594555Z  2025-03-14T05:48:05.0594980Z  2025-03-14T05:48:05.0595463Z  2025-03-14T05:48:05.0595879Z  2025-03-14T05:48:05.0596277Z  2025-03-14T05:48:05.0596695Z  2025-03-14T05:48:05.0597111Z  2025-03-14T05:48:05.0597718Z [13,876 / 15,235] 48 actions, 47 running 2025-03-14T05:48:05.0598568Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T05:48:05.0599501Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T05:48:05.0600555Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T05:48:05.0601611Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T05:48:05.0602526Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T05:48:05.0603426Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T05:48:05.0604364Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T05:48:05.0605544Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local ... 2025-03-14T05:48:05.2838010Z 2025-03-14T05:48:05.2838862Z  2025-03-14T05:48:05.2839397Z  2025-03-14T05:48:05.2839816Z  2025-03-14T05:48:05.2840188Z  2025-03-14T05:48:05.2840546Z  2025-03-14T05:48:05.2840930Z  2025-03-14T05:48:05.2841296Z  2025-03-14T05:48:05.2841612Z  2025-03-14T05:48:05.2842170Z [13,877 / 15,235] 48 actions, 47 running 2025-03-14T05:48:05.2843001Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T05:48:05.2843974Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T05:48:05.2845027Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2025-03-14T05:48:05.2846048Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T05:48:05.2847354Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T05:48:05.2848327Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T05:48:05.2849309Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T05:48:05.2850249Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local ... 2025-03-14T05:48:05.6240486Z 2025-03-14T05:48:05.6241343Z  2025-03-14T05:48:05.6241801Z  2025-03-14T05:48:05.6242225Z  2025-03-14T05:48:05.6242633Z  2025-03-14T05:48:05.6243044Z  2025-03-14T05:48:05.6243399Z  2025-03-14T05:48:05.6243793Z  2025-03-14T05:48:05.6244338Z  2025-03-14T05:48:05.6245093Z [13,877 / 15,235] 48 actions running 2025-03-14T05:48:05.6245947Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T05:48:05.6246921Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T05:48:05.6247970Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2025-03-14T05:48:05.6248973Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T05:48:05.6249952Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T05:48:05.6250813Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T05:48:05.6251788Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T05:48:05.6252820Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local ... 2025-03-14T05:48:05.8244720Z 2025-03-14T05:48:05.8245561Z  2025-03-14T05:48:05.8246061Z  2025-03-14T05:48:05.8246448Z  2025-03-14T05:48:05.8246843Z  2025-03-14T05:48:05.8247241Z  2025-03-14T05:48:05.8247626Z  2025-03-14T05:48:05.8248040Z  2025-03-14T05:48:05.8248425Z  2025-03-14T05:48:05.8249000Z [13,879 / 15,235] 48 actions, 47 running 2025-03-14T05:48:05.8249824Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T05:48:05.8250892Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T05:48:05.8252142Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2025-03-14T05:48:05.8253212Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T05:48:05.8253989Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T05:48:05.8254795Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T05:48:05.8255719Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T05:48:05.8256545Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local ... 2025-03-14T05:48:06.2248055Z 2025-03-14T05:48:06.2248946Z  2025-03-14T05:48:06.2249436Z  2025-03-14T05:48:06.2249837Z  2025-03-14T05:48:06.2250241Z  2025-03-14T05:48:06.2250633Z  2025-03-14T05:48:06.2251011Z  2025-03-14T05:48:06.2251392Z  2025-03-14T05:48:06.2251791Z  2025-03-14T05:48:06.2252381Z [13,880 / 15,235] 48 actions running 2025-03-14T05:48:06.2253184Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T05:48:06.2254140Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T05:48:06.2255082Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T05:48:06.2255983Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T05:48:06.2256873Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T05:48:06.2257724Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T05:48:06.2258635Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T05:48:06.2259598Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local ... 2025-03-14T05:48:06.5120944Z 2025-03-14T05:48:06.5121803Z  2025-03-14T05:48:06.5122300Z  2025-03-14T05:48:06.5122694Z  2025-03-14T05:48:06.5123078Z  2025-03-14T05:48:06.5123453Z  2025-03-14T05:48:06.5124259Z  2025-03-14T05:48:06.5124904Z  2025-03-14T05:48:06.5125331Z  2025-03-14T05:48:06.5125917Z [13,881 / 15,235] 48 actions, 47 running 2025-03-14T05:48:06.5126708Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T05:48:06.5127656Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T05:48:06.5128558Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T05:48:06.5129513Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T05:48:06.5130360Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T05:48:06.5131198Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T05:48:06.5132171Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T05:48:06.5133139Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local ... 2025-03-14T05:48:06.7665887Z 2025-03-14T05:48:06.7666782Z  2025-03-14T05:48:06.7667299Z  2025-03-14T05:48:06.7667706Z  2025-03-14T05:48:06.7668100Z  2025-03-14T05:48:06.7668508Z  2025-03-14T05:48:06.7668899Z  2025-03-14T05:48:06.7669298Z  2025-03-14T05:48:06.7669682Z  2025-03-14T05:48:06.7670292Z [13,883 / 15,235] 48 actions, 47 running 2025-03-14T05:48:06.7671313Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T05:48:06.7672739Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T05:48:06.7673827Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T05:48:06.7674957Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T05:48:06.7676004Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T05:48:06.7677034Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T05:48:06.7678086Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T05:48:06.7679341Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local ... 2025-03-14T05:48:07.0255806Z 2025-03-14T05:48:07.0257880Z  2025-03-14T05:48:07.0258427Z  2025-03-14T05:48:07.0258846Z  2025-03-14T05:48:07.0259255Z  2025-03-14T05:48:07.0259654Z  2025-03-14T05:48:07.0260064Z  2025-03-14T05:48:07.0260464Z  2025-03-14T05:48:07.0260857Z  2025-03-14T05:48:07.0261418Z [13,883 / 15,235] 48 actions running 2025-03-14T05:48:07.0262243Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T05:48:07.0263188Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T05:48:07.0264116Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T05:48:07.0265127Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T05:48:07.0266403Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T05:48:07.0267277Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T05:48:07.0268244Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T05:48:07.0269238Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local ... 2025-03-14T05:48:07.2997667Z 2025-03-14T05:48:07.2998510Z  2025-03-14T05:48:07.2998983Z  2025-03-14T05:48:07.2999387Z  2025-03-14T05:48:07.2999787Z  2025-03-14T05:48:07.3000174Z  2025-03-14T05:48:07.3000575Z  2025-03-14T05:48:07.3000984Z  2025-03-14T05:48:07.3001389Z  2025-03-14T05:48:07.3002013Z [13,885 / 15,235] 48 actions, 47 running 2025-03-14T05:48:07.3002846Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T05:48:07.3003776Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T05:48:07.3004866Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T05:48:07.3005822Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T05:48:07.3007025Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T05:48:07.3007935Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T05:48:07.3008873Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T05:48:07.3009815Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local ... 2025-03-14T05:48:07.5042484Z 2025-03-14T05:48:07.5043318Z  2025-03-14T05:48:07.5043810Z  2025-03-14T05:48:07.5044229Z  2025-03-14T05:48:07.5044761Z  2025-03-14T05:48:07.5045178Z  2025-03-14T05:48:07.5045585Z  2025-03-14T05:48:07.5045997Z  2025-03-14T05:48:07.5046407Z  2025-03-14T05:48:07.5047032Z [13,889 / 15,235] 48 actions, 47 running 2025-03-14T05:48:07.5047894Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T05:48:07.5048861Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T05:48:07.5049908Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T05:48:07.5050887Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T05:48:07.5051833Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T05:48:07.5052734Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T05:48:07.5053694Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T05:48:07.5054721Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local ... 2025-03-14T05:48:07.7148264Z 2025-03-14T05:48:07.7149058Z  2025-03-14T05:48:07.7149570Z  2025-03-14T05:48:07.7149996Z  2025-03-14T05:48:07.7150398Z  2025-03-14T05:48:07.7150758Z  2025-03-14T05:48:07.7151148Z  2025-03-14T05:48:07.7151563Z  2025-03-14T05:48:07.7151950Z  2025-03-14T05:48:07.7152572Z [13,891 / 15,235] 48 actions, 47 running 2025-03-14T05:48:07.7153421Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T05:48:07.7154384Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T05:48:07.7155730Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T05:48:07.7156717Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T05:48:07.7157635Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T05:48:07.7158492Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T05:48:07.7159429Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T05:48:07.7160410Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local ... 2025-03-14T05:48:07.9467601Z 2025-03-14T05:48:07.9468398Z  2025-03-14T05:48:07.9468842Z  2025-03-14T05:48:07.9469229Z  2025-03-14T05:48:07.9469594Z  2025-03-14T05:48:07.9469962Z  2025-03-14T05:48:07.9470312Z  2025-03-14T05:48:07.9470661Z  2025-03-14T05:48:07.9471010Z  2025-03-14T05:48:07.9471708Z [13,893 / 15,235] 48 actions, 47 running 2025-03-14T05:48:07.9472442Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T05:48:07.9473265Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T05:48:07.9474089Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T05:48:07.9474910Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T05:48:07.9475689Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T05:48:07.9476457Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T05:48:07.9477288Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T05:48:07.9478167Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local ... 2025-03-14T05:48:08.1831171Z 2025-03-14T05:48:08.1832167Z  2025-03-14T05:48:08.1832712Z  2025-03-14T05:48:08.1833177Z  2025-03-14T05:48:08.1833654Z  2025-03-14T05:48:08.1834115Z  2025-03-14T05:48:08.1834979Z  2025-03-14T05:48:08.1835500Z  2025-03-14T05:48:08.1835982Z  2025-03-14T05:48:08.1836572Z [13,897 / 15,235] 48 actions, 47 running 2025-03-14T05:48:08.1837357Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T05:48:08.1838269Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T05:48:08.1839230Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T05:48:08.1840246Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T05:48:08.1841142Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T05:48:08.1842060Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T05:48:08.1843030Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T05:48:08.1844067Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local ... 2025-03-14T05:48:08.4265743Z 2025-03-14T05:48:08.4266560Z  2025-03-14T05:48:08.4267135Z  2025-03-14T05:48:08.4267601Z  2025-03-14T05:48:08.4268043Z  2025-03-14T05:48:08.4268444Z  2025-03-14T05:48:08.4268867Z  2025-03-14T05:48:08.4269307Z  2025-03-14T05:48:08.4269718Z  2025-03-14T05:48:08.4270294Z [13,899 / 15,235] 48 actions running 2025-03-14T05:48:08.4271159Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T05:48:08.4272167Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T05:48:08.4273185Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T05:48:08.4274209Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T05:48:08.4275171Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T05:48:08.4276080Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T05:48:08.4277078Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T05:48:08.4278160Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local ... 2025-03-14T05:48:08.7366364Z 2025-03-14T05:48:08.7367185Z  2025-03-14T05:48:08.7367717Z  2025-03-14T05:48:08.7368213Z  2025-03-14T05:48:08.7368614Z  2025-03-14T05:48:08.7369027Z  2025-03-14T05:48:08.7369408Z  2025-03-14T05:48:08.7369901Z  2025-03-14T05:48:08.7370281Z  2025-03-14T05:48:08.7370883Z [13,900 / 15,235] 48 actions, 47 running 2025-03-14T05:48:08.7371727Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T05:48:08.7372742Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T05:48:08.7373703Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T05:48:08.7374764Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2025-03-14T05:48:08.7375708Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T05:48:08.7376631Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T05:48:08.7377665Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T05:48:08.7378672Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local ... 2025-03-14T05:48:09.0127254Z 2025-03-14T05:48:09.0128116Z  2025-03-14T05:48:09.0128628Z  2025-03-14T05:48:09.0129028Z  2025-03-14T05:48:09.0129449Z  2025-03-14T05:48:09.0129837Z  2025-03-14T05:48:09.0130260Z  2025-03-14T05:48:09.0130663Z  2025-03-14T05:48:09.0131066Z  2025-03-14T05:48:09.0131673Z [13,902 / 15,235] 48 actions, 47 running 2025-03-14T05:48:09.0132394Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T05:48:09.0133312Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T05:48:09.0134399Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T05:48:09.0135350Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2025-03-14T05:48:09.0136606Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T05:48:09.0137523Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T05:48:09.0138355Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T05:48:09.0139321Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local ... 2025-03-14T05:48:09.2272740Z 2025-03-14T05:48:09.2273554Z  2025-03-14T05:48:09.2274047Z  2025-03-14T05:48:09.2274487Z  2025-03-14T05:48:09.2274892Z  2025-03-14T05:48:09.2275261Z  2025-03-14T05:48:09.2275630Z  2025-03-14T05:48:09.2276026Z  2025-03-14T05:48:09.2276414Z  2025-03-14T05:48:09.2277009Z [13,902 / 15,235] 48 actions running 2025-03-14T05:48:09.2277832Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T05:48:09.2278770Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T05:48:09.2279814Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2025-03-14T05:48:09.2280741Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2025-03-14T05:48:09.2281618Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T05:48:09.2282468Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T05:48:09.2283397Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T05:48:09.2284334Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local ... 2025-03-14T05:48:09.6277208Z 2025-03-14T05:48:09.6278083Z  2025-03-14T05:48:09.6278578Z  2025-03-14T05:48:09.6278973Z  2025-03-14T05:48:09.6279357Z  2025-03-14T05:48:09.6279752Z  2025-03-14T05:48:09.6280140Z  2025-03-14T05:48:09.6280500Z  2025-03-14T05:48:09.6280860Z  2025-03-14T05:48:09.6281377Z [13,903 / 15,235] 48 actions running 2025-03-14T05:48:09.6282172Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T05:48:09.6283131Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T05:48:09.6284479Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2025-03-14T05:48:09.6285597Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T05:48:09.6286495Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T05:48:09.6287414Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T05:48:09.6288412Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T05:48:09.6289422Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local ... 2025-03-14T05:48:09.8281016Z 2025-03-14T05:48:09.8281840Z  2025-03-14T05:48:09.8282344Z  2025-03-14T05:48:09.8282765Z  2025-03-14T05:48:09.8283179Z  2025-03-14T05:48:09.8283595Z  2025-03-14T05:48:09.8284003Z  2025-03-14T05:48:09.8284358Z  2025-03-14T05:48:09.8284886Z  2025-03-14T05:48:09.8285476Z [13,906 / 15,235] 48 actions running 2025-03-14T05:48:09.8286279Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T05:48:09.8287325Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T05:48:09.8288285Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2025-03-14T05:48:09.8289288Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T05:48:09.8290161Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T05:48:09.8291058Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T05:48:09.8292057Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T05:48:09.8293095Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local ... 2025-03-14T05:48:10.1982854Z 2025-03-14T05:48:10.1983652Z  2025-03-14T05:48:10.1984147Z  2025-03-14T05:48:10.1984562Z  2025-03-14T05:48:10.1984984Z  2025-03-14T05:48:10.1985377Z  2025-03-14T05:48:10.1986169Z  2025-03-14T05:48:10.1986651Z  2025-03-14T05:48:10.1987075Z  2025-03-14T05:48:10.1987699Z [13,907 / 15,235] 48 actions, 47 running 2025-03-14T05:48:10.1988536Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T05:48:10.1989478Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T05:48:10.1990400Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T05:48:10.1991390Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T05:48:10.1992283Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T05:48:10.1993217Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T05:48:10.1994176Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T05:48:10.1995138Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local ... 2025-03-14T05:48:10.4007629Z 2025-03-14T05:48:10.4008470Z  2025-03-14T05:48:10.4009000Z  2025-03-14T05:48:10.4009386Z  2025-03-14T05:48:10.4009778Z  2025-03-14T05:48:10.4010115Z  2025-03-14T05:48:10.4010488Z  2025-03-14T05:48:10.4010880Z  2025-03-14T05:48:10.4011340Z  2025-03-14T05:48:10.4012077Z [13,908 / 15,235] 48 actions, 47 running 2025-03-14T05:48:10.4012965Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T05:48:10.4013922Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T05:48:10.4014904Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T05:48:10.4015895Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T05:48:10.4016779Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T05:48:10.4017616Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T05:48:10.4018536Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T05:48:10.4019521Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local ... 2025-03-14T05:48:10.6288132Z 2025-03-14T05:48:10.6288970Z  2025-03-14T05:48:10.6289433Z  2025-03-14T05:48:10.6289836Z  2025-03-14T05:48:10.6290257Z  2025-03-14T05:48:10.6290668Z  2025-03-14T05:48:10.6291077Z  2025-03-14T05:48:10.6291477Z  2025-03-14T05:48:10.6291888Z  2025-03-14T05:48:10.6292598Z [13,909 / 15,235] 48 actions running 2025-03-14T05:48:10.6293439Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T05:48:10.6294410Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T05:48:10.6295423Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T05:48:10.6296320Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T05:48:10.6297185Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T05:48:10.6298199Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2025-03-14T05:48:10.6299143Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T05:48:10.6300168Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local ... 2025-03-14T05:48:11.1640346Z 2025-03-14T05:48:11.1641087Z  2025-03-14T05:48:11.1641517Z  2025-03-14T05:48:11.1641874Z  2025-03-14T05:48:11.1642232Z  2025-03-14T05:48:11.1642573Z  2025-03-14T05:48:11.1642934Z  2025-03-14T05:48:11.1643301Z  2025-03-14T05:48:11.1643647Z  2025-03-14T05:48:11.1644176Z [13,910 / 15,235] 48 actions, 47 running 2025-03-14T05:48:11.1645045Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T05:48:11.1645903Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2025-03-14T05:48:11.1646772Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T05:48:11.1647611Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T05:48:11.1648741Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T05:48:11.1649576Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2025-03-14T05:48:11.1650450Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2025-03-14T05:48:11.1651276Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local ... 2025-03-14T05:48:11.4295725Z 2025-03-14T05:48:11.4296575Z  2025-03-14T05:48:11.4297046Z  2025-03-14T05:48:11.4297445Z  2025-03-14T05:48:11.4297840Z  2025-03-14T05:48:11.4298348Z  2025-03-14T05:48:11.4298854Z  2025-03-14T05:48:11.4299317Z  2025-03-14T05:48:11.4299696Z  2025-03-14T05:48:11.4300265Z [13,913 / 15,235] 48 actions running 2025-03-14T05:48:11.4301040Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T05:48:11.4302084Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2025-03-14T05:48:11.4303255Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T05:48:11.4304258Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T05:48:11.4305129Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T05:48:11.4305970Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T05:48:11.4307008Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2025-03-14T05:48:11.4307895Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local ... 2025-03-14T05:48:11.8042231Z 2025-03-14T05:48:11.8043075Z  2025-03-14T05:48:11.8043589Z  2025-03-14T05:48:11.8044022Z  2025-03-14T05:48:11.8044452Z  2025-03-14T05:48:11.8044990Z  2025-03-14T05:48:11.8045409Z  2025-03-14T05:48:11.8045844Z  2025-03-14T05:48:11.8046271Z  2025-03-14T05:48:11.8046911Z [13,916 / 15,235] 48 actions, 47 running 2025-03-14T05:48:11.8047816Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T05:48:11.8048892Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2025-03-14T05:48:11.8050276Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T05:48:11.8051344Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2025-03-14T05:48:11.8052339Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T05:48:11.8053109Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T05:48:11.8054065Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T05:48:11.8055037Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local ... 2025-03-14T05:48:12.0302188Z 2025-03-14T05:48:12.0302985Z  2025-03-14T05:48:12.0303487Z  2025-03-14T05:48:12.0303902Z  2025-03-14T05:48:12.0304308Z  2025-03-14T05:48:12.0304719Z  2025-03-14T05:48:12.0305156Z  2025-03-14T05:48:12.0305588Z  2025-03-14T05:48:12.0305999Z  2025-03-14T05:48:12.0306633Z [13,917 / 15,235] 48 actions running 2025-03-14T05:48:12.0307476Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2025-03-14T05:48:12.0308504Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2025-03-14T05:48:12.0309522Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T05:48:12.0310487Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2025-03-14T05:48:12.0311443Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T05:48:12.0312355Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T05:48:12.0313233Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T05:48:12.0314105Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local ... 2025-03-14T05:48:12.7508411Z 2025-03-14T05:48:12.7509355Z  2025-03-14T05:48:12.7509833Z  2025-03-14T05:48:12.7510234Z  2025-03-14T05:48:12.7510663Z  2025-03-14T05:48:12.7511045Z  2025-03-14T05:48:12.7511742Z  2025-03-14T05:48:12.7512146Z  2025-03-14T05:48:12.7512584Z  2025-03-14T05:48:12.7513198Z [13,918 / 15,235] 48 actions, 47 running 2025-03-14T05:48:12.7513996Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2025-03-14T05:48:12.7514891Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T05:48:12.7515853Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T05:48:12.7516817Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T05:48:12.7517682Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T05:48:12.7518586Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2025-03-14T05:48:12.7519548Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T05:48:12.7520541Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local ... 2025-03-14T05:48:13.0310555Z 2025-03-14T05:48:13.0311366Z  2025-03-14T05:48:13.0311899Z  2025-03-14T05:48:13.0312333Z  2025-03-14T05:48:13.0312803Z  2025-03-14T05:48:13.0313182Z  2025-03-14T05:48:13.0313647Z  2025-03-14T05:48:13.0314052Z  2025-03-14T05:48:13.0314422Z  2025-03-14T05:48:13.0315018Z [13,920 / 15,235] 47 actions running 2025-03-14T05:48:13.0315839Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T05:48:13.0316783Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T05:48:13.0317815Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T05:48:13.0318775Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T05:48:13.0319674Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T05:48:13.0320618Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2025-03-14T05:48:13.0321613Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T05:48:13.0322656Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local ... 2025-03-14T05:48:13.2314177Z 2025-03-14T05:48:13.2315053Z  2025-03-14T05:48:13.2315503Z  2025-03-14T05:48:13.2315862Z  2025-03-14T05:48:13.2316206Z  2025-03-14T05:48:13.2316564Z  2025-03-14T05:48:13.2317143Z  2025-03-14T05:48:13.2317670Z  2025-03-14T05:48:13.2318198Z  2025-03-14T05:48:13.2318811Z [13,921 / 15,235] 48 actions running 2025-03-14T05:48:13.2319603Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T05:48:13.2320563Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T05:48:13.2321502Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T05:48:13.2322460Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T05:48:13.2323354Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T05:48:13.2324243Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2025-03-14T05:48:13.2325475Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T05:48:13.2326425Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local ... 2025-03-14T05:48:13.6320040Z 2025-03-14T05:48:13.6320882Z  2025-03-14T05:48:13.6321502Z  2025-03-14T05:48:13.6321898Z  2025-03-14T05:48:13.6322293Z  2025-03-14T05:48:13.6322658Z  2025-03-14T05:48:13.6323023Z  2025-03-14T05:48:13.6323403Z  2025-03-14T05:48:13.6323798Z  2025-03-14T05:48:13.6324342Z [13,922 / 15,235] 48 actions running 2025-03-14T05:48:13.6325309Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T05:48:13.6326265Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T05:48:13.6327254Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T05:48:13.6328148Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T05:48:13.6329412Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T05:48:13.6330320Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T05:48:13.6331253Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T05:48:13.6332232Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local ... 2025-03-14T05:48:13.8324697Z 2025-03-14T05:48:13.8325589Z  2025-03-14T05:48:13.8326013Z  2025-03-14T05:48:13.8326337Z  2025-03-14T05:48:13.8326671Z  2025-03-14T05:48:13.8326996Z  2025-03-14T05:48:13.8327333Z  2025-03-14T05:48:13.8327670Z  2025-03-14T05:48:13.8328012Z  2025-03-14T05:48:13.8328499Z [13,924 / 15,235] 48 actions running 2025-03-14T05:48:13.8329207Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T05:48:13.8329988Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T05:48:13.8330857Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T05:48:13.8331771Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T05:48:13.8332665Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T05:48:13.8333560Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T05:48:13.8334459Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T05:48:13.8335443Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local ... 2025-03-14T05:48:14.0842725Z 2025-03-14T05:48:14.0843568Z  2025-03-14T05:48:14.0844059Z  2025-03-14T05:48:14.0844472Z  2025-03-14T05:48:14.0844995Z  2025-03-14T05:48:14.0845392Z  2025-03-14T05:48:14.0845786Z  2025-03-14T05:48:14.0846177Z  2025-03-14T05:48:14.0846573Z  2025-03-14T05:48:14.0847178Z [13,926 / 15,235] 48 actions, 47 running 2025-03-14T05:48:14.0847990Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T05:48:14.0849014Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T05:48:14.0850338Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T05:48:14.0851299Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T05:48:14.0852192Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T05:48:14.0853052Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T05:48:14.0854060Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T05:48:14.0855008Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local ... 2025-03-14T05:48:14.4329835Z 2025-03-14T05:48:14.4330639Z  2025-03-14T05:48:14.4331148Z  2025-03-14T05:48:14.4331567Z  2025-03-14T05:48:14.4331986Z  2025-03-14T05:48:14.4332405Z  2025-03-14T05:48:14.4332826Z  2025-03-14T05:48:14.4333237Z  2025-03-14T05:48:14.4333671Z  2025-03-14T05:48:14.4334312Z [13,927 / 15,235] 48 actions running 2025-03-14T05:48:14.4335169Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T05:48:14.4336168Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T05:48:14.4337161Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2025-03-14T05:48:14.4338057Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T05:48:14.4338985Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2025-03-14T05:48:14.4339915Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2025-03-14T05:48:14.4340918Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T05:48:14.4341933Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local ... 2025-03-14T05:48:14.6334229Z 2025-03-14T05:48:14.6335059Z  2025-03-14T05:48:14.6335493Z  2025-03-14T05:48:14.6335849Z  2025-03-14T05:48:14.6336220Z  2025-03-14T05:48:14.6336595Z  2025-03-14T05:48:14.6337302Z  2025-03-14T05:48:14.6337718Z  2025-03-14T05:48:14.6338124Z  2025-03-14T05:48:14.6338789Z [13,929 / 15,235] 48 actions running 2025-03-14T05:48:14.6339615Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T05:48:14.6340611Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T05:48:14.6350515Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2025-03-14T05:48:14.6351763Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T05:48:14.6352681Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2025-03-14T05:48:14.6353588Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2025-03-14T05:48:14.6354573Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T05:48:14.6355744Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local ... 2025-03-14T05:48:15.6343020Z 2025-03-14T05:48:15.6343905Z  2025-03-14T05:48:15.6344434Z  2025-03-14T05:48:15.6344832Z  2025-03-14T05:48:15.6345258Z  2025-03-14T05:48:15.6345723Z  2025-03-14T05:48:15.6346126Z  2025-03-14T05:48:15.6346533Z  2025-03-14T05:48:15.6346961Z  2025-03-14T05:48:15.6347605Z [13,929 / 15,235] 48 actions running 2025-03-14T05:48:15.6348455Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2025-03-14T05:48:15.6349466Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T05:48:15.6350474Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T05:48:15.6351473Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T05:48:15.6352364Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T05:48:15.6353260Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T05:48:15.6354214Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2025-03-14T05:48:15.6355271Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local ... 2025-03-14T05:48:16.0347873Z 2025-03-14T05:48:16.0348743Z  2025-03-14T05:48:16.0349246Z  2025-03-14T05:48:16.0349676Z  2025-03-14T05:48:16.0350108Z  2025-03-14T05:48:16.0350516Z  2025-03-14T05:48:16.0350930Z  2025-03-14T05:48:16.0351350Z  2025-03-14T05:48:16.0351767Z  2025-03-14T05:48:16.0352352Z [13,930 / 15,235] 48 actions running 2025-03-14T05:48:16.0353218Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2025-03-14T05:48:16.0354171Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T05:48:16.0355226Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T05:48:16.0356203Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T05:48:16.0357160Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T05:48:16.0358112Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T05:48:16.0359031Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T05:48:16.0360033Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local ... 2025-03-14T05:48:16.2352092Z 2025-03-14T05:48:16.2352907Z  2025-03-14T05:48:16.2353516Z  2025-03-14T05:48:16.2354043Z  2025-03-14T05:48:16.2354497Z  2025-03-14T05:48:16.2354898Z  2025-03-14T05:48:16.2355289Z  2025-03-14T05:48:16.2355697Z  2025-03-14T05:48:16.2356118Z  2025-03-14T05:48:16.2356704Z [13,931 / 15,235] 48 actions running 2025-03-14T05:48:16.2357511Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2025-03-14T05:48:16.2358471Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T05:48:16.2359507Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2025-03-14T05:48:16.2360547Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T05:48:16.2361885Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T05:48:16.2362841Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T05:48:16.2363913Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T05:48:16.2365121Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local ... 2025-03-14T05:48:16.5759658Z 2025-03-14T05:48:16.5760572Z  2025-03-14T05:48:16.5761212Z  2025-03-14T05:48:16.5761635Z  2025-03-14T05:48:16.5762026Z  2025-03-14T05:48:16.5762417Z  2025-03-14T05:48:16.5762753Z  2025-03-14T05:48:16.5763121Z  2025-03-14T05:48:16.5763505Z  2025-03-14T05:48:16.5764094Z [13,934 / 15,235] 48 actions, 47 running 2025-03-14T05:48:16.5765093Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2025-03-14T05:48:16.5771854Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T05:48:16.5772803Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2025-03-14T05:48:16.5773835Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T05:48:16.5775090Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T05:48:16.5775929Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T05:48:16.5776918Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T05:48:16.5777963Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local ... 2025-03-14T05:48:16.8359531Z 2025-03-14T05:48:16.8360410Z  2025-03-14T05:48:16.8360896Z  2025-03-14T05:48:16.8361313Z  2025-03-14T05:48:16.8361707Z  2025-03-14T05:48:16.8362103Z  2025-03-14T05:48:16.8362514Z  2025-03-14T05:48:16.8362943Z  2025-03-14T05:48:16.8363336Z  2025-03-14T05:48:16.8363880Z [13,934 / 15,235] 48 actions running 2025-03-14T05:48:16.8364899Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T05:48:16.8366089Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T05:48:16.8367307Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2025-03-14T05:48:16.8368281Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T05:48:16.8369152Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T05:48:16.8370114Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T05:48:16.8371306Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T05:48:16.8372504Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local ... 2025-03-14T05:48:17.0363004Z 2025-03-14T05:48:17.0363837Z  2025-03-14T05:48:17.0364271Z  2025-03-14T05:48:17.0364818Z  2025-03-14T05:48:17.0365233Z  2025-03-14T05:48:17.0365845Z  2025-03-14T05:48:17.0366270Z  2025-03-14T05:48:17.0366673Z  2025-03-14T05:48:17.0367098Z  2025-03-14T05:48:17.0367702Z [13,936 / 15,235] 48 actions running 2025-03-14T05:48:17.0368593Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T05:48:17.0369524Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T05:48:17.0370598Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2025-03-14T05:48:17.0371635Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T05:48:17.0372631Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T05:48:17.0373546Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T05:48:17.0374504Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T05:48:17.0375532Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local ... 2025-03-14T05:48:17.3236715Z 2025-03-14T05:48:17.3237778Z  2025-03-14T05:48:17.3238404Z  2025-03-14T05:48:17.3238917Z  2025-03-14T05:48:17.3239327Z  2025-03-14T05:48:17.3239730Z  2025-03-14T05:48:17.3240118Z  2025-03-14T05:48:17.3240860Z  2025-03-14T05:48:17.3241279Z  2025-03-14T05:48:17.3242052Z [13,941 / 15,235] 48 actions, 47 running 2025-03-14T05:48:17.3242983Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T05:48:17.3244084Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T05:48:17.3245170Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T05:48:17.3246112Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T05:48:17.3247008Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T05:48:17.3248078Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T05:48:17.3249093Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T05:48:17.3250036Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local ... 2025-03-14T05:48:17.5423832Z 2025-03-14T05:48:17.5424841Z  2025-03-14T05:48:17.5425426Z  2025-03-14T05:48:17.5425901Z  2025-03-14T05:48:17.5426270Z  2025-03-14T05:48:17.5426659Z  2025-03-14T05:48:17.5427054Z  2025-03-14T05:48:17.5427454Z  2025-03-14T05:48:17.5427835Z  2025-03-14T05:48:17.5428541Z [13,942 / 15,235] 48 actions, 47 running 2025-03-14T05:48:17.5429480Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T05:48:17.5430423Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T05:48:17.5431428Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T05:48:17.5432481Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T05:48:17.5433325Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T05:48:17.5434296Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T05:48:17.5435284Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2025-03-14T05:48:17.5436408Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local ... 2025-03-14T05:48:17.8368111Z 2025-03-14T05:48:17.8398700Z  2025-03-14T05:48:17.8399270Z  2025-03-14T05:48:17.8399696Z  2025-03-14T05:48:17.8400092Z  2025-03-14T05:48:17.8400534Z  2025-03-14T05:48:17.8401030Z  2025-03-14T05:48:17.8401454Z  2025-03-14T05:48:17.8401857Z  2025-03-14T05:48:17.8402508Z [13,942 / 15,235] 48 actions running 2025-03-14T05:48:17.8403367Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2025-03-14T05:48:17.8404352Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T05:48:17.8405582Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T05:48:17.8406537Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T05:48:17.8407455Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T05:48:17.8408476Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2025-03-14T05:48:17.8409416Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2025-03-14T05:48:17.8410440Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local ... 2025-03-14T05:48:18.0747331Z 2025-03-14T05:48:18.0748355Z  2025-03-14T05:48:18.0748838Z  2025-03-14T05:48:18.0749239Z  2025-03-14T05:48:18.0749653Z  2025-03-14T05:48:18.0750074Z  2025-03-14T05:48:18.0750471Z  2025-03-14T05:48:18.0750864Z  2025-03-14T05:48:18.0751261Z  2025-03-14T05:48:18.0751850Z [13,943 / 15,235] 48 actions, 47 running 2025-03-14T05:48:18.0752678Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2025-03-14T05:48:18.0753646Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T05:48:18.0754614Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T05:48:18.0755713Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T05:48:18.0756891Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T05:48:18.0757842Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2025-03-14T05:48:18.0758739Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2025-03-14T05:48:18.0759655Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local ... 2025-03-14T05:48:18.4374879Z 2025-03-14T05:48:18.4375866Z  2025-03-14T05:48:18.4376339Z  2025-03-14T05:48:18.4376739Z  2025-03-14T05:48:18.4377143Z  2025-03-14T05:48:18.4377586Z  2025-03-14T05:48:18.4378019Z  2025-03-14T05:48:18.4378445Z  2025-03-14T05:48:18.4378861Z  2025-03-14T05:48:18.4379502Z [13,945 / 15,235] 48 actions running 2025-03-14T05:48:18.4380365Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2025-03-14T05:48:18.4381389Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T05:48:18.4382733Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T05:48:18.4383661Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2025-03-14T05:48:18.4384557Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T05:48:18.4385519Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2025-03-14T05:48:18.4386491Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2025-03-14T05:48:18.4387479Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local ... 2025-03-14T05:48:18.8379325Z 2025-03-14T05:48:18.8380283Z  2025-03-14T05:48:18.8380811Z  2025-03-14T05:48:18.8381270Z  2025-03-14T05:48:18.8381792Z  2025-03-14T05:48:18.8382283Z  2025-03-14T05:48:18.8382643Z  2025-03-14T05:48:18.8383031Z  2025-03-14T05:48:18.8383416Z  2025-03-14T05:48:18.8383988Z [13,946 / 15,235] 48 actions running 2025-03-14T05:48:18.8384854Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T05:48:18.8385805Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T05:48:18.8387129Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T05:48:18.8388013Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2025-03-14T05:48:18.8388919Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T05:48:18.8389909Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T05:48:18.8390841Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2025-03-14T05:48:18.8391840Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local ... 2025-03-14T05:48:19.1481658Z 2025-03-14T05:48:19.1482724Z  2025-03-14T05:48:19.1483199Z  2025-03-14T05:48:19.1483591Z  2025-03-14T05:48:19.1483990Z  2025-03-14T05:48:19.1484406Z  2025-03-14T05:48:19.1484936Z  2025-03-14T05:48:19.1485355Z  2025-03-14T05:48:19.1485730Z  2025-03-14T05:48:19.1486331Z [13,947 / 15,235] 48 actions, 47 running 2025-03-14T05:48:19.1487152Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T05:48:19.1488163Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T05:48:19.1489125Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T05:48:19.1490013Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2025-03-14T05:48:19.1490926Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T05:48:19.1491886Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T05:48:19.1492673Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T05:48:19.1493669Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local ... 2025-03-14T05:48:19.3499668Z 2025-03-14T05:48:19.3500685Z  2025-03-14T05:48:19.3501256Z  2025-03-14T05:48:19.3501664Z  2025-03-14T05:48:19.3502060Z  2025-03-14T05:48:19.3502444Z  2025-03-14T05:48:19.3502835Z  2025-03-14T05:48:19.3503547Z  2025-03-14T05:48:19.3503982Z  2025-03-14T05:48:19.3504617Z [13,948 / 15,235] 48 actions, 47 running 2025-03-14T05:48:19.3505449Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T05:48:19.3506390Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T05:48:19.3507468Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T05:48:19.3508351Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T05:48:19.3509178Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T05:48:19.3510106Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T05:48:19.3511032Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T05:48:19.3512017Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local ... 2025-03-14T05:48:19.6386401Z 2025-03-14T05:48:19.6387289Z  2025-03-14T05:48:19.6387820Z  2025-03-14T05:48:19.6388328Z  2025-03-14T05:48:19.6388766Z  2025-03-14T05:48:19.6389213Z  2025-03-14T05:48:19.6389643Z  2025-03-14T05:48:19.6390066Z  2025-03-14T05:48:19.6390466Z  2025-03-14T05:48:19.6391083Z [13,949 / 15,235] 48 actions running 2025-03-14T05:48:19.6391939Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T05:48:19.6392949Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T05:48:19.6393963Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T05:48:19.6394926Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T05:48:19.6395863Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T05:48:19.6396965Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T05:48:19.6397976Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T05:48:19.6398985Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local ... 2025-03-14T05:48:19.8390443Z 2025-03-14T05:48:19.8391545Z  2025-03-14T05:48:19.8392053Z  2025-03-14T05:48:19.8392507Z  2025-03-14T05:48:19.8392935Z  2025-03-14T05:48:19.8393373Z  2025-03-14T05:48:19.8393790Z  2025-03-14T05:48:19.8394210Z  2025-03-14T05:48:19.8394638Z  2025-03-14T05:48:19.8395235Z [13,951 / 15,235] 47 actions running 2025-03-14T05:48:19.8396096Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T05:48:19.8397073Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T05:48:19.8398079Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T05:48:19.8399034Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T05:48:19.8399953Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T05:48:19.8400984Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T05:48:19.8401992Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T05:48:19.8403025Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local ... 2025-03-14T05:48:20.0421474Z 2025-03-14T05:48:20.0422330Z  2025-03-14T05:48:20.0422829Z  2025-03-14T05:48:20.0423240Z  2025-03-14T05:48:20.0423670Z  2025-03-14T05:48:20.0424091Z  2025-03-14T05:48:20.0424506Z  2025-03-14T05:48:20.0424928Z  2025-03-14T05:48:20.0425349Z  2025-03-14T05:48:20.0425965Z [13,953 / 15,235] 48 actions, 47 running 2025-03-14T05:48:20.0426727Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T05:48:20.0427625Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T05:48:20.0428568Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T05:48:20.0429529Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T05:48:20.0430768Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T05:48:20.0431871Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T05:48:20.0432901Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2025-03-14T05:48:20.0433948Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local ... 2025-03-14T05:48:20.3191822Z 2025-03-14T05:48:20.3192674Z  2025-03-14T05:48:20.3193151Z  2025-03-14T05:48:20.3193567Z  2025-03-14T05:48:20.3193983Z  2025-03-14T05:48:20.3194393Z  2025-03-14T05:48:20.3194816Z  2025-03-14T05:48:20.3195233Z  2025-03-14T05:48:20.3195669Z  2025-03-14T05:48:20.3196307Z [13,954 / 15,235] 48 actions, 47 running 2025-03-14T05:48:20.3197177Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T05:48:20.3198171Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T05:48:20.3199443Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T05:48:20.3200394Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T05:48:20.3201302Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T05:48:20.3202304Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T05:48:20.3203301Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2025-03-14T05:48:20.3204339Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local ... 2025-03-14T05:48:20.5202340Z 2025-03-14T05:48:20.5203147Z  2025-03-14T05:48:20.5203650Z  2025-03-14T05:48:20.5204054Z  2025-03-14T05:48:20.5204470Z  2025-03-14T05:48:20.5204974Z  2025-03-14T05:48:20.5205351Z  2025-03-14T05:48:20.5205712Z  2025-03-14T05:48:20.5206122Z  2025-03-14T05:48:20.5206800Z [13,957 / 15,235] 48 actions, 47 running 2025-03-14T05:48:20.5207647Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T05:48:20.5208628Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T05:48:20.5209592Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T05:48:20.5210747Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T05:48:20.5211624Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T05:48:20.5212575Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T05:48:20.5213499Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2025-03-14T05:48:20.5214510Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local ... 2025-03-14T05:48:20.7968866Z 2025-03-14T05:48:20.7969660Z  2025-03-14T05:48:20.7970182Z  2025-03-14T05:48:20.7970786Z  2025-03-14T05:48:20.7971158Z  2025-03-14T05:48:20.7971526Z  2025-03-14T05:48:20.7971904Z  2025-03-14T05:48:20.7972425Z  2025-03-14T05:48:20.7972857Z  2025-03-14T05:48:20.7973526Z [13,959 / 15,235] 48 actions, 47 running 2025-03-14T05:48:20.7974432Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T05:48:20.7975424Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T05:48:20.7976466Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T05:48:20.7977340Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T05:48:20.7978237Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T05:48:20.7979182Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T05:48:20.7980118Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2025-03-14T05:48:20.7981279Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local ... 2025-03-14T05:48:21.0399512Z 2025-03-14T05:48:21.0400318Z  2025-03-14T05:48:21.0400814Z  2025-03-14T05:48:21.0401241Z  2025-03-14T05:48:21.0401745Z  2025-03-14T05:48:21.0402192Z  2025-03-14T05:48:21.0402587Z  2025-03-14T05:48:21.0403041Z  2025-03-14T05:48:21.0403838Z  2025-03-14T05:48:21.0404444Z [13,960 / 15,235] 48 actions running 2025-03-14T05:48:21.0405390Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T05:48:21.0406362Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T05:48:21.0407354Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T05:48:21.0408264Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T05:48:21.0409219Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T05:48:21.0410194Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T05:48:21.0411129Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T05:48:21.0412142Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local ... 2025-03-14T05:48:21.2814771Z 2025-03-14T05:48:21.2815663Z  2025-03-14T05:48:21.2816202Z  2025-03-14T05:48:21.2816631Z  2025-03-14T05:48:21.2817138Z  2025-03-14T05:48:21.2817563Z  2025-03-14T05:48:21.2817991Z  2025-03-14T05:48:21.2818451Z  2025-03-14T05:48:21.2818868Z  2025-03-14T05:48:21.2819493Z [13,961 / 15,235] 48 actions, 47 running 2025-03-14T05:48:21.2820395Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T05:48:21.2821421Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T05:48:21.2822462Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T05:48:21.2823363Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T05:48:21.2824312Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T05:48:21.2825239Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T05:48:21.2826134Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T05:48:21.2827116Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local ... 2025-03-14T05:48:21.6404921Z 2025-03-14T05:48:21.6405776Z  2025-03-14T05:48:21.6406484Z  2025-03-14T05:48:21.6406885Z  2025-03-14T05:48:21.6407277Z  2025-03-14T05:48:21.6407632Z  2025-03-14T05:48:21.6407949Z  2025-03-14T05:48:21.6408278Z  2025-03-14T05:48:21.6408657Z  2025-03-14T05:48:21.6409179Z [13,961 / 15,235] 48 actions running 2025-03-14T05:48:21.6409941Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T05:48:21.6410832Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T05:48:21.6411738Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T05:48:21.6412693Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T05:48:21.6413487Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T05:48:21.6414283Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T05:48:21.6415096Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T05:48:21.6415902Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local ... 2025-03-14T05:48:21.9774230Z 2025-03-14T05:48:21.9775075Z  2025-03-14T05:48:21.9775575Z  2025-03-14T05:48:21.9776017Z  2025-03-14T05:48:21.9776454Z  2025-03-14T05:48:21.9776882Z  2025-03-14T05:48:21.9777330Z  2025-03-14T05:48:21.9777759Z  2025-03-14T05:48:21.9778187Z  2025-03-14T05:48:21.9779265Z [13,963 / 15,235] 48 actions, 47 running 2025-03-14T05:48:21.9780315Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T05:48:21.9781470Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T05:48:21.9782649Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T05:48:21.9783652Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T05:48:21.9784745Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T05:48:21.9786253Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2025-03-14T05:48:21.9787445Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T05:48:21.9788611Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 22s local ... 2025-03-14T05:48:22.2411745Z 2025-03-14T05:48:22.2412572Z  2025-03-14T05:48:22.2413000Z  2025-03-14T05:48:22.2413353Z  2025-03-14T05:48:22.2413703Z  2025-03-14T05:48:22.2414051Z  2025-03-14T05:48:22.2414390Z  2025-03-14T05:48:22.2414735Z  2025-03-14T05:48:22.2415092Z  2025-03-14T05:48:22.2415599Z [13,963 / 15,235] 48 actions running 2025-03-14T05:48:22.2416319Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T05:48:22.2417169Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T05:48:22.2418475Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T05:48:22.2419389Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T05:48:22.2420161Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T05:48:22.2421011Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2025-03-14T05:48:22.2421876Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T05:48:22.2422806Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 22s local ... 2025-03-14T05:48:22.6417458Z 2025-03-14T05:48:22.6418277Z  2025-03-14T05:48:22.6418743Z  2025-03-14T05:48:22.6419140Z  2025-03-14T05:48:22.6419545Z  2025-03-14T05:48:22.6419930Z  2025-03-14T05:48:22.6420323Z  2025-03-14T05:48:22.6420796Z  2025-03-14T05:48:22.6421312Z  2025-03-14T05:48:22.6422015Z [13,966 / 15,235] 48 actions running 2025-03-14T05:48:22.6422781Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T05:48:22.6423716Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T05:48:22.6424928Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2025-03-14T05:48:22.6426095Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2025-03-14T05:48:22.6426926Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T05:48:22.6427790Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2025-03-14T05:48:22.6428749Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T05:48:22.6429833Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local ... 2025-03-14T05:48:22.8421281Z 2025-03-14T05:48:22.8422191Z  2025-03-14T05:48:22.8422732Z  2025-03-14T05:48:22.8423122Z  2025-03-14T05:48:22.8423503Z  2025-03-14T05:48:22.8423931Z  2025-03-14T05:48:22.8424325Z  2025-03-14T05:48:22.8424713Z  2025-03-14T05:48:22.8425114Z  2025-03-14T05:48:22.8425641Z [13,967 / 15,235] 48 actions running 2025-03-14T05:48:22.8426486Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T05:48:22.8427585Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T05:48:22.8428527Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2025-03-14T05:48:22.8429422Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2025-03-14T05:48:22.8430308Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T05:48:22.8431314Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T05:48:22.8432384Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T05:48:22.8433362Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local ... 2025-03-14T05:48:23.1081271Z 2025-03-14T05:48:23.1082098Z  2025-03-14T05:48:23.1082584Z  2025-03-14T05:48:23.1083000Z  2025-03-14T05:48:23.1083443Z  2025-03-14T05:48:23.1083859Z  2025-03-14T05:48:23.1084269Z  2025-03-14T05:48:23.1084790Z  2025-03-14T05:48:23.1085529Z  2025-03-14T05:48:23.1086174Z [13,971 / 15,235] 48 actions, 47 running 2025-03-14T05:48:23.1087048Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T05:48:23.1088029Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T05:48:23.1089018Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2025-03-14T05:48:23.1089943Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2025-03-14T05:48:23.1090941Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T05:48:23.1091889Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T05:48:23.1092837Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T05:48:23.1093904Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 23s local ... 2025-03-14T05:48:23.4426292Z 2025-03-14T05:48:23.4427175Z  2025-03-14T05:48:23.4427670Z  2025-03-14T05:48:23.4428100Z  2025-03-14T05:48:23.4428550Z  2025-03-14T05:48:23.4428955Z  2025-03-14T05:48:23.4429392Z  2025-03-14T05:48:23.4429777Z  2025-03-14T05:48:23.4430201Z  2025-03-14T05:48:23.4430782Z [13,972 / 15,235] 48 actions running 2025-03-14T05:48:23.4432084Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T05:48:23.4433081Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2025-03-14T05:48:23.4434204Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2025-03-14T05:48:23.4435244Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T05:48:23.4436286Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T05:48:23.4437391Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T05:48:23.4438489Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T05:48:23.4439734Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 23s local ... 2025-03-14T05:48:23.6430160Z 2025-03-14T05:48:23.6430964Z  2025-03-14T05:48:23.6431658Z  2025-03-14T05:48:23.6432017Z  2025-03-14T05:48:23.6432387Z  2025-03-14T05:48:23.6432760Z  2025-03-14T05:48:23.6433127Z  2025-03-14T05:48:23.6433476Z  2025-03-14T05:48:23.6433819Z  2025-03-14T05:48:23.6434352Z [13,975 / 15,235] 48 actions running 2025-03-14T05:48:23.6435098Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T05:48:23.6435948Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2025-03-14T05:48:23.6436822Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T05:48:23.6437636Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T05:48:23.6438429Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T05:48:23.6439312Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T05:48:23.6440174Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T05:48:23.6441141Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local ... 2025-03-14T05:48:23.9888655Z 2025-03-14T05:48:23.9889485Z  2025-03-14T05:48:23.9889949Z  2025-03-14T05:48:23.9890345Z  2025-03-14T05:48:23.9890735Z  2025-03-14T05:48:23.9891112Z  2025-03-14T05:48:23.9891502Z  2025-03-14T05:48:23.9891885Z  2025-03-14T05:48:23.9892276Z  2025-03-14T05:48:23.9892853Z [13,976 / 15,235] 48 actions, 47 running 2025-03-14T05:48:23.9893663Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T05:48:23.9894594Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2025-03-14T05:48:23.9895536Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T05:48:23.9896445Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T05:48:23.9897603Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T05:48:23.9899020Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T05:48:23.9900062Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T05:48:23.9901196Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local ... 2025-03-14T05:48:24.2436810Z 2025-03-14T05:48:24.2437654Z  2025-03-14T05:48:24.2438157Z  2025-03-14T05:48:24.2438581Z  2025-03-14T05:48:24.2438987Z  2025-03-14T05:48:24.2439400Z  2025-03-14T05:48:24.2439795Z  2025-03-14T05:48:24.2440208Z  2025-03-14T05:48:24.2440599Z  2025-03-14T05:48:24.2441197Z [13,979 / 15,235] 48 actions running 2025-03-14T05:48:24.2442008Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T05:48:24.2442957Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T05:48:24.2444175Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T05:48:24.2445230Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T05:48:24.2446085Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T05:48:24.2447006Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T05:48:24.2447889Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T05:48:24.2448896Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local ... 2025-03-14T05:48:24.4441676Z 2025-03-14T05:48:24.4442738Z  2025-03-14T05:48:24.4443296Z  2025-03-14T05:48:24.4443779Z  2025-03-14T05:48:24.4444210Z  2025-03-14T05:48:24.4444733Z  2025-03-14T05:48:24.4445144Z  2025-03-14T05:48:24.4445545Z  2025-03-14T05:48:24.4445931Z  2025-03-14T05:48:24.4446500Z [13,980 / 15,235] 48 actions running 2025-03-14T05:48:24.4447227Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T05:48:24.4448195Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T05:48:24.4449199Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T05:48:24.4450355Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T05:48:24.4451148Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T05:48:24.4452013Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T05:48:24.4452913Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T05:48:24.4453921Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local ... 2025-03-14T05:48:24.7567104Z 2025-03-14T05:48:24.7568721Z  2025-03-14T05:48:24.7569187Z  2025-03-14T05:48:24.7569577Z  2025-03-14T05:48:24.7569965Z  2025-03-14T05:48:24.7570347Z  2025-03-14T05:48:24.7570714Z  2025-03-14T05:48:24.7571117Z  2025-03-14T05:48:24.7571507Z  2025-03-14T05:48:24.7572086Z [13,984 / 15,235] 48 actions, 47 running 2025-03-14T05:48:24.7572905Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T05:48:24.7573839Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T05:48:24.7574774Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T05:48:24.7575632Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T05:48:24.7576487Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T05:48:24.7577386Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T05:48:24.7578299Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T05:48:24.7579319Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local ... 2025-03-14T05:48:25.0210359Z 2025-03-14T05:48:25.0211285Z  2025-03-14T05:48:25.0211799Z  2025-03-14T05:48:25.0212355Z  2025-03-14T05:48:25.0212723Z  2025-03-14T05:48:25.0213085Z  2025-03-14T05:48:25.0213435Z  2025-03-14T05:48:25.0214131Z  2025-03-14T05:48:25.0214496Z  2025-03-14T05:48:25.0215047Z [13,987 / 15,235] 48 actions, 47 running 2025-03-14T05:48:25.0215766Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T05:48:25.0216604Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T05:48:25.0217464Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T05:48:25.0218252Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T05:48:25.0219025Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T05:48:25.0219862Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T05:48:25.0220708Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T05:48:25.0221643Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local ... 2025-03-14T05:48:25.2333868Z 2025-03-14T05:48:25.2334845Z  2025-03-14T05:48:25.2335359Z  2025-03-14T05:48:25.2335802Z  2025-03-14T05:48:25.2336198Z  2025-03-14T05:48:25.2336578Z  2025-03-14T05:48:25.2336985Z  2025-03-14T05:48:25.2337368Z  2025-03-14T05:48:25.2337747Z  2025-03-14T05:48:25.2338346Z [13,989 / 15,235] 48 actions, 47 running 2025-03-14T05:48:25.2339175Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T05:48:25.2340109Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 57s local 2025-03-14T05:48:25.2341059Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T05:48:25.2341952Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T05:48:25.2342808Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T05:48:25.2343763Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T05:48:25.2344724Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T05:48:25.2345784Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local ... 2025-03-14T05:48:25.4449229Z 2025-03-14T05:48:25.4451481Z  2025-03-14T05:48:25.4451994Z  2025-03-14T05:48:25.4453247Z  2025-03-14T05:48:25.4454579Z  2025-03-14T05:48:25.4455993Z  2025-03-14T05:48:25.4457370Z  2025-03-14T05:48:25.4458765Z  2025-03-14T05:48:25.4460163Z  2025-03-14T05:48:25.4461719Z [13,989 / 15,235] 48 actions running 2025-03-14T05:48:25.4463064Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T05:48:25.4464146Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 57s local 2025-03-14T05:48:25.4465226Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T05:48:25.4466627Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T05:48:25.4467548Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T05:48:25.4468581Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T05:48:25.4469643Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T05:48:25.4470613Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local ... 2025-03-14T05:48:25.6452359Z 2025-03-14T05:48:25.6453279Z  2025-03-14T05:48:25.6453696Z  2025-03-14T05:48:25.6454037Z  2025-03-14T05:48:25.6454373Z  2025-03-14T05:48:25.6455020Z  2025-03-14T05:48:25.6455404Z  2025-03-14T05:48:25.6455872Z  2025-03-14T05:48:25.6456376Z  2025-03-14T05:48:25.6457056Z [13,992 / 15,235] 48 actions running 2025-03-14T05:48:25.6457899Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T05:48:25.6458819Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 57s local 2025-03-14T05:48:25.6459745Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T05:48:25.6460632Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T05:48:25.6461848Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T05:48:25.6462789Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T05:48:25.6463732Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T05:48:25.6464702Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local ... 2025-03-14T05:48:26.0457537Z 2025-03-14T05:48:26.0458468Z  2025-03-14T05:48:26.0458957Z  2025-03-14T05:48:26.0459641Z  2025-03-14T05:48:26.0460059Z  2025-03-14T05:48:26.0460564Z  2025-03-14T05:48:26.0461080Z  2025-03-14T05:48:26.0461579Z  2025-03-14T05:48:26.0462071Z  2025-03-14T05:48:26.0462701Z [13,995 / 15,235] 48 actions running 2025-03-14T05:48:26.0463720Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T05:48:26.0464735Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T05:48:26.0466223Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T05:48:26.0467218Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T05:48:26.0468282Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T05:48:26.0469326Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2025-03-14T05:48:26.0470440Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T05:48:26.0471647Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local ... 2025-03-14T05:48:26.3917846Z 2025-03-14T05:48:26.3918812Z  2025-03-14T05:48:26.3919295Z  2025-03-14T05:48:26.3990509Z  2025-03-14T05:48:26.3991535Z  2025-03-14T05:48:26.3991982Z  2025-03-14T05:48:26.3995665Z  2025-03-14T05:48:26.3996130Z  2025-03-14T05:48:26.3996541Z  2025-03-14T05:48:26.3997179Z [13,996 / 15,235] 48 actions, 47 running 2025-03-14T05:48:26.3998098Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T05:48:26.3999104Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T05:48:26.4000325Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T05:48:26.4001270Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T05:48:26.4002271Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T05:48:26.4003297Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2025-03-14T05:48:26.4004380Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T05:48:26.4005697Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local ... 2025-03-14T05:48:26.5983912Z 2025-03-14T05:48:26.5984734Z  2025-03-14T05:48:26.5985118Z  2025-03-14T05:48:26.5985435Z  2025-03-14T05:48:26.5985756Z  2025-03-14T05:48:26.5986064Z  2025-03-14T05:48:26.5986440Z  2025-03-14T05:48:26.5986792Z  2025-03-14T05:48:26.5987147Z  2025-03-14T05:48:26.5987742Z [14,000 / 15,235] 48 actions, 47 running 2025-03-14T05:48:26.5988529Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T05:48:26.5989493Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T05:48:26.5990372Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T05:48:26.5991261Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T05:48:26.5992209Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T05:48:26.5993186Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2025-03-14T05:48:26.5994146Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T05:48:26.5995291Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local ... 2025-03-14T05:48:26.8466494Z 2025-03-14T05:48:26.8467274Z  2025-03-14T05:48:26.8467802Z  2025-03-14T05:48:26.8468247Z  2025-03-14T05:48:26.8468673Z  2025-03-14T05:48:26.8469097Z  2025-03-14T05:48:26.8469836Z  2025-03-14T05:48:26.8470285Z  2025-03-14T05:48:26.8470685Z  2025-03-14T05:48:26.8471284Z [14,004 / 15,235] 48 actions running 2025-03-14T05:48:26.8472151Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T05:48:26.8473155Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2025-03-14T05:48:26.8474107Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T05:48:26.8475042Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T05:48:26.8476065Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T05:48:26.8476972Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2025-03-14T05:48:26.8478131Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 22s local 2025-03-14T05:48:26.8479708Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local ... 2025-03-14T05:48:27.1254015Z 2025-03-14T05:48:27.1254894Z  2025-03-14T05:48:27.1255399Z  2025-03-14T05:48:27.1255814Z  2025-03-14T05:48:27.1256212Z  2025-03-14T05:48:27.1256604Z  2025-03-14T05:48:27.1257015Z  2025-03-14T05:48:27.1257421Z  2025-03-14T05:48:27.1257822Z  2025-03-14T05:48:27.1258417Z [14,007 / 15,235] 48 actions, 47 running 2025-03-14T05:48:27.1259212Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T05:48:27.1259958Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2025-03-14T05:48:27.1260837Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T05:48:27.1261715Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T05:48:27.1262673Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T05:48:27.1263707Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2025-03-14T05:48:27.1264749Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 22s local 2025-03-14T05:48:27.1266088Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local ... 2025-03-14T05:48:27.4192406Z 2025-03-14T05:48:27.4193287Z  2025-03-14T05:48:27.4193768Z  2025-03-14T05:48:27.4194101Z  2025-03-14T05:48:27.4194514Z  2025-03-14T05:48:27.4194915Z  2025-03-14T05:48:27.4195329Z  2025-03-14T05:48:27.4195701Z  2025-03-14T05:48:27.4196093Z  2025-03-14T05:48:27.4196699Z [14,009 / 15,235] 48 actions, 47 running 2025-03-14T05:48:27.4197522Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T05:48:27.4198461Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2025-03-14T05:48:27.4199397Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T05:48:27.4200294Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T05:48:27.4201301Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T05:48:27.4202249Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2025-03-14T05:48:27.4203253Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 22s local 2025-03-14T05:48:27.4204308Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 20s local ... 2025-03-14T05:48:27.6473080Z 2025-03-14T05:48:27.6473874Z  2025-03-14T05:48:27.6474367Z  2025-03-14T05:48:27.6474800Z  2025-03-14T05:48:27.6475188Z  2025-03-14T05:48:27.6475579Z  2025-03-14T05:48:27.6475992Z  2025-03-14T05:48:27.6476479Z  2025-03-14T05:48:27.6476910Z  2025-03-14T05:48:27.6477544Z [14,009 / 15,235] 48 actions running 2025-03-14T05:48:27.6478376Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T05:48:27.6479385Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T05:48:27.6480301Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T05:48:27.6481191Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T05:48:27.6482512Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T05:48:27.6483643Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2025-03-14T05:48:27.6484853Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 22s local 2025-03-14T05:48:27.6485973Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 20s local ... 2025-03-14T05:48:27.8687742Z 2025-03-14T05:48:27.8688579Z  2025-03-14T05:48:27.8689078Z  2025-03-14T05:48:27.8689475Z  2025-03-14T05:48:27.8689903Z  2025-03-14T05:48:27.8690322Z  2025-03-14T05:48:27.8690710Z  2025-03-14T05:48:27.8691103Z  2025-03-14T05:48:27.8691509Z  2025-03-14T05:48:27.8692128Z [14,011 / 15,235] 48 actions, 47 running 2025-03-14T05:48:27.8692934Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T05:48:27.8694180Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T05:48:27.8695092Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T05:48:27.8696023Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T05:48:27.8696884Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T05:48:27.8697812Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 57s local 2025-03-14T05:48:27.8698782Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 20s local 2025-03-14T05:48:27.8699774Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 17s local ... 2025-03-14T05:48:28.2478488Z 2025-03-14T05:48:28.2479351Z  2025-03-14T05:48:28.2479824Z  2025-03-14T05:48:28.2480216Z  2025-03-14T05:48:28.2480584Z  2025-03-14T05:48:28.2480932Z  2025-03-14T05:48:28.2481282Z  2025-03-14T05:48:28.2481680Z  2025-03-14T05:48:28.2482101Z  2025-03-14T05:48:28.2482705Z [14,012 / 15,235] 48 actions running 2025-03-14T05:48:28.2483507Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T05:48:28.2484438Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T05:48:28.2485862Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T05:48:28.2486771Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T05:48:28.2487764Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T05:48:28.2488732Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 57s local 2025-03-14T05:48:28.2489795Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local 2025-03-14T05:48:28.2491647Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 10s local ... 2025-03-14T05:48:28.4482530Z 2025-03-14T05:48:28.4483391Z  2025-03-14T05:48:28.4483862Z  2025-03-14T05:48:28.4484249Z  2025-03-14T05:48:28.4484762Z  2025-03-14T05:48:28.4485218Z  2025-03-14T05:48:28.4485612Z  2025-03-14T05:48:28.4485984Z  2025-03-14T05:48:28.4486386Z  2025-03-14T05:48:28.4486981Z [14,016 / 15,235] 48 actions running 2025-03-14T05:48:28.4487826Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T05:48:28.4488661Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T05:48:28.4489557Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T05:48:28.4490493Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T05:48:28.4491394Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 57s local 2025-03-14T05:48:28.4492442Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local 2025-03-14T05:48:28.4493423Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 10s local 2025-03-14T05:48:28.4494428Z Compiling llvm/lib/Target/X86/X86CompressEVEX.cpp; 8s local ... 2025-03-14T05:48:28.8295710Z 2025-03-14T05:48:28.8296585Z  2025-03-14T05:48:28.8297049Z  2025-03-14T05:48:28.8297442Z  2025-03-14T05:48:28.8297840Z  2025-03-14T05:48:28.8298630Z  2025-03-14T05:48:28.8299056Z  2025-03-14T05:48:28.8299458Z  2025-03-14T05:48:28.8299867Z  2025-03-14T05:48:28.8300446Z [14,017 / 15,235] 48 actions, 47 running 2025-03-14T05:48:28.8301287Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T05:48:28.8302192Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T05:48:28.8303126Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T05:48:28.8304119Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2025-03-14T05:48:28.8305054Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 57s local 2025-03-14T05:48:28.8306072Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local 2025-03-14T05:48:28.8307739Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 10s local 2025-03-14T05:48:28.8309061Z Compiling llvm/lib/Target/X86/X86CompressEVEX.cpp; 8s local ... 2025-03-14T05:48:29.0489242Z 2025-03-14T05:48:29.0490315Z  2025-03-14T05:48:29.0490819Z  2025-03-14T05:48:29.0491265Z  2025-03-14T05:48:29.0491694Z  2025-03-14T05:48:29.0492124Z  2025-03-14T05:48:29.0492541Z  2025-03-14T05:48:29.0492980Z  2025-03-14T05:48:29.0493394Z  2025-03-14T05:48:29.0493981Z [14,018 / 15,235] 48 actions running 2025-03-14T05:48:29.0494869Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T05:48:29.0495867Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T05:48:29.0496856Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T05:48:29.0497813Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2025-03-14T05:48:29.0498804Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 58s local 2025-03-14T05:48:29.0499969Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 18s local 2025-03-14T05:48:29.0501104Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 10s local 2025-03-14T05:48:29.0502215Z Compiling llvm/lib/Target/X86/X86CompressEVEX.cpp; 9s local ... 2025-03-14T05:48:29.5670862Z 2025-03-14T05:48:29.5671688Z  2025-03-14T05:48:29.5672117Z  2025-03-14T05:48:29.5672468Z  2025-03-14T05:48:29.5672812Z  2025-03-14T05:48:29.5673170Z  2025-03-14T05:48:29.5673528Z  2025-03-14T05:48:29.5673892Z  2025-03-14T05:48:29.5674241Z  2025-03-14T05:48:29.5674771Z [14,019 / 15,235] 48 actions, 47 running 2025-03-14T05:48:29.5675483Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T05:48:29.5676238Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T05:48:29.5676994Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T05:48:29.5677810Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2025-03-14T05:48:29.5678672Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 58s local 2025-03-14T05:48:29.5679554Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local 2025-03-14T05:48:29.5680521Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 11s local 2025-03-14T05:48:29.5681507Z Compiling llvm/lib/CodeGen/TargetLoweringObjectFileImpl.cpp; 9s local ... 2025-03-14T05:48:29.8498953Z 2025-03-14T05:48:29.8499767Z  2025-03-14T05:48:29.8500179Z  2025-03-14T05:48:29.8500533Z  2025-03-14T05:48:29.8500878Z  2025-03-14T05:48:29.8501224Z  2025-03-14T05:48:29.8501562Z  2025-03-14T05:48:29.8502015Z  2025-03-14T05:48:29.8502368Z  2025-03-14T05:48:29.8502894Z [14,019 / 15,235] 48 actions running 2025-03-14T05:48:29.8503626Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T05:48:29.8504403Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T05:48:29.8505220Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T05:48:29.8506466Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 59s local 2025-03-14T05:48:29.8507334Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 59s local 2025-03-14T05:48:29.8508216Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local 2025-03-14T05:48:29.8509140Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 11s local 2025-03-14T05:48:29.8510144Z Compiling llvm/lib/CodeGen/TargetLoweringObjectFileImpl.cpp; 9s local ... 2025-03-14T05:48:30.0842632Z 2025-03-14T05:48:30.0843459Z  2025-03-14T05:48:30.0843922Z  2025-03-14T05:48:30.0844321Z  2025-03-14T05:48:30.0844858Z  2025-03-14T05:48:30.0845259Z  2025-03-14T05:48:30.0845651Z  2025-03-14T05:48:30.0846046Z  2025-03-14T05:48:30.0846437Z  2025-03-14T05:48:30.0847039Z [14,023 / 15,235] 48 actions, 47 running 2025-03-14T05:48:30.0848155Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T05:48:30.0849046Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T05:48:30.0849934Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T05:48:30.0850893Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 59s local 2025-03-14T05:48:30.0851839Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 59s local 2025-03-14T05:48:30.0852862Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local 2025-03-14T05:48:30.0853948Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 12s local 2025-03-14T05:48:30.0855103Z Compiling llvm/lib/CodeGen/TargetLoweringObjectFileImpl.cpp; 9s local ... 2025-03-14T05:48:30.2921457Z 2025-03-14T05:48:30.2922351Z  2025-03-14T05:48:30.2922839Z  2025-03-14T05:48:30.2923229Z  2025-03-14T05:48:30.2923619Z  2025-03-14T05:48:30.2924088Z  2025-03-14T05:48:30.2924456Z  2025-03-14T05:48:30.2925003Z  2025-03-14T05:48:30.2925393Z  2025-03-14T05:48:30.2925995Z [14,029 / 15,235] 48 actions, 47 running 2025-03-14T05:48:30.2926848Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T05:48:30.2927965Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T05:48:30.2928827Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T05:48:30.2929719Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 59s local 2025-03-14T05:48:30.2930669Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2025-03-14T05:48:30.2931702Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 12s local 2025-03-14T05:48:30.2932591Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 9s local 2025-03-14T05:48:30.2933396Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 9s local ... 2025-03-14T05:48:30.5203858Z 2025-03-14T05:48:30.5204791Z  2025-03-14T05:48:30.5205227Z  2025-03-14T05:48:30.5205630Z  2025-03-14T05:48:30.5205979Z  2025-03-14T05:48:30.5206351Z  2025-03-14T05:48:30.5206720Z  2025-03-14T05:48:30.5207095Z  2025-03-14T05:48:30.5207459Z  2025-03-14T05:48:30.5208036Z [14,033 / 15,235] 48 actions, 47 running 2025-03-14T05:48:30.5208770Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T05:48:30.5209577Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T05:48:30.5210368Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T05:48:30.5211225Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 59s local 2025-03-14T05:48:30.5212142Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2025-03-14T05:48:30.5213184Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 12s local 2025-03-14T05:48:30.5214021Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 9s local 2025-03-14T05:48:30.5214778Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 9s local ... 2025-03-14T05:48:30.7394480Z 2025-03-14T05:48:30.7395348Z  2025-03-14T05:48:30.7395792Z  2025-03-14T05:48:30.7396528Z  2025-03-14T05:48:30.7396937Z  2025-03-14T05:48:30.7397328Z  2025-03-14T05:48:30.7397683Z  2025-03-14T05:48:30.7398047Z  2025-03-14T05:48:30.7398429Z  2025-03-14T05:48:30.7399004Z [14,037 / 15,235] 48 actions, 47 running 2025-03-14T05:48:30.7399798Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T05:48:30.7400662Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T05:48:30.7401667Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T05:48:30.7402744Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2025-03-14T05:48:30.7403929Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 12s local 2025-03-14T05:48:30.7405268Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 10s local 2025-03-14T05:48:30.7406307Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 9s local 2025-03-14T05:48:30.7407299Z Compiling llvm/lib/CodeGen/InterleavedAccessPass.cpp; 9s local ... 2025-03-14T05:48:30.9550265Z 2025-03-14T05:48:30.9551158Z  2025-03-14T05:48:30.9551660Z  2025-03-14T05:48:30.9552056Z  2025-03-14T05:48:30.9552466Z  2025-03-14T05:48:30.9552841Z  2025-03-14T05:48:30.9553228Z  2025-03-14T05:48:30.9553732Z  2025-03-14T05:48:30.9554126Z  2025-03-14T05:48:30.9554740Z [14,039 / 15,235] 48 actions, 47 running 2025-03-14T05:48:30.9555594Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T05:48:30.9556503Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T05:48:30.9557442Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T05:48:30.9558529Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2025-03-14T05:48:30.9559726Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 12s local 2025-03-14T05:48:30.9560848Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 10s local 2025-03-14T05:48:30.9561819Z Compiling llvm/lib/CodeGen/InlineSpiller.cpp; 10s local 2025-03-14T05:48:30.9563201Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 8s local ... 2025-03-14T05:48:31.1676101Z 2025-03-14T05:48:31.1676891Z  2025-03-14T05:48:31.1677313Z  2025-03-14T05:48:31.1677681Z  2025-03-14T05:48:31.1678044Z  2025-03-14T05:48:31.1678411Z  2025-03-14T05:48:31.1678780Z  2025-03-14T05:48:31.1679144Z  2025-03-14T05:48:31.1679501Z  2025-03-14T05:48:31.1680028Z [14,042 / 15,235] 48 actions, 47 running 2025-03-14T05:48:31.1680755Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T05:48:31.1681526Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T05:48:31.1682400Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T05:48:31.1683375Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2025-03-14T05:48:31.1684375Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local 2025-03-14T05:48:31.1685421Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 10s local 2025-03-14T05:48:31.1686400Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 8s local 2025-03-14T05:48:31.1687533Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 8s local ... 2025-03-14T05:48:31.4509415Z 2025-03-14T05:48:31.4510283Z  2025-03-14T05:48:31.4510774Z  2025-03-14T05:48:31.4511193Z  2025-03-14T05:48:31.4511600Z  2025-03-14T05:48:31.4512010Z  2025-03-14T05:48:31.4512422Z  2025-03-14T05:48:31.4512813Z  2025-03-14T05:48:31.4513212Z  2025-03-14T05:48:31.4513774Z [14,042 / 15,235] 48 actions running 2025-03-14T05:48:31.4514616Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T05:48:31.4515575Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T05:48:31.4516497Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2025-03-14T05:48:31.4517928Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2025-03-14T05:48:31.4519094Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local 2025-03-14T05:48:31.4520120Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 10s local 2025-03-14T05:48:31.4521154Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 9s local 2025-03-14T05:48:31.4522294Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 9s local ... 2025-03-14T05:48:31.8515078Z 2025-03-14T05:48:31.8515901Z  2025-03-14T05:48:31.8516408Z  2025-03-14T05:48:31.8516844Z  2025-03-14T05:48:31.8517258Z  2025-03-14T05:48:31.8517683Z  2025-03-14T05:48:31.8518052Z  2025-03-14T05:48:31.8518422Z  2025-03-14T05:48:31.8518787Z  2025-03-14T05:48:31.8519421Z [14,043 / 15,235] 48 actions running 2025-03-14T05:48:31.8520750Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T05:48:31.8521774Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T05:48:31.8522630Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2025-03-14T05:48:31.8523706Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2025-03-14T05:48:31.8524901Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local 2025-03-14T05:48:31.8525906Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 11s local 2025-03-14T05:48:31.8526882Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 9s local 2025-03-14T05:48:31.8528212Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 9s local ... 2025-03-14T05:48:32.0743446Z 2025-03-14T05:48:32.0744322Z  2025-03-14T05:48:32.0744826Z  2025-03-14T05:48:32.0745257Z  2025-03-14T05:48:32.0745645Z  2025-03-14T05:48:32.0746037Z  2025-03-14T05:48:32.0746483Z  2025-03-14T05:48:32.0746878Z  2025-03-14T05:48:32.0747289Z  2025-03-14T05:48:32.0747940Z [14,045 / 15,235] 48 actions, 47 running 2025-03-14T05:48:32.0749059Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T05:48:32.0749983Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T05:48:32.0750893Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2025-03-14T05:48:32.0751996Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2025-03-14T05:48:32.0753162Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local 2025-03-14T05:48:32.0754218Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 11s local 2025-03-14T05:48:32.0755275Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 9s local 2025-03-14T05:48:32.0756483Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 9s local ... 2025-03-14T05:48:32.3706557Z 2025-03-14T05:48:32.3707449Z  2025-03-14T05:48:32.3707983Z  2025-03-14T05:48:32.3708380Z  2025-03-14T05:48:32.3708777Z  2025-03-14T05:48:32.3709210Z  2025-03-14T05:48:32.3709613Z  2025-03-14T05:48:32.3710018Z  2025-03-14T05:48:32.3710428Z  2025-03-14T05:48:32.3711049Z [14,048 / 15,235] 48 actions, 47 running 2025-03-14T05:48:32.3711873Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T05:48:32.3712769Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T05:48:32.3713654Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2025-03-14T05:48:32.3714712Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local 2025-03-14T05:48:32.3715682Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 11s local 2025-03-14T05:48:32.3716743Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 10s local 2025-03-14T05:48:32.3717877Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 10s local 2025-03-14T05:48:32.3719037Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 9s local ... 2025-03-14T05:48:32.6522126Z 2025-03-14T05:48:32.6523428Z  2025-03-14T05:48:32.6523990Z  2025-03-14T05:48:32.6524408Z  2025-03-14T05:48:32.6524927Z  2025-03-14T05:48:32.6525345Z  2025-03-14T05:48:32.6525755Z  2025-03-14T05:48:32.6526131Z  2025-03-14T05:48:32.6526511Z  2025-03-14T05:48:32.6527040Z [14,050 / 15,235] 48 actions running 2025-03-14T05:48:32.6527896Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T05:48:32.6528775Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T05:48:32.6529510Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2025-03-14T05:48:32.6530704Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local 2025-03-14T05:48:32.6531756Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 12s local 2025-03-14T05:48:32.6532760Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 10s local 2025-03-14T05:48:32.6534288Z Compiling llvm/lib/CodeGen/InterleavedLoadCombinePass.cpp; 10s local 2025-03-14T05:48:32.6535380Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 9s local ... 2025-03-14T05:48:32.8526479Z 2025-03-14T05:48:32.8527331Z  2025-03-14T05:48:32.8527809Z  2025-03-14T05:48:32.8528212Z  2025-03-14T05:48:32.8528593Z  2025-03-14T05:48:32.8529028Z  2025-03-14T05:48:32.8529534Z  2025-03-14T05:48:32.8529936Z  2025-03-14T05:48:32.8530409Z  2025-03-14T05:48:32.8531124Z [14,053 / 15,235] 48 actions, 47 running 2025-03-14T05:48:32.8532041Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T05:48:32.8532966Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T05:48:32.8534041Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2025-03-14T05:48:32.8535140Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local 2025-03-14T05:48:32.8536200Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 12s local 2025-03-14T05:48:32.8537347Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 10s local 2025-03-14T05:48:32.8538813Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 9s local 2025-03-14T05:48:32.8539973Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local ... 2025-03-14T05:48:33.0623963Z 2025-03-14T05:48:33.0624796Z  2025-03-14T05:48:33.0625296Z  2025-03-14T05:48:33.0625732Z  2025-03-14T05:48:33.0626147Z  2025-03-14T05:48:33.0626534Z  2025-03-14T05:48:33.0626922Z  2025-03-14T05:48:33.0627318Z  2025-03-14T05:48:33.0627723Z  2025-03-14T05:48:33.0628328Z [14,055 / 15,235] 48 actions, 47 running 2025-03-14T05:48:33.0629143Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T05:48:33.0630023Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T05:48:33.0630923Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2025-03-14T05:48:33.0632006Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local 2025-03-14T05:48:33.0633039Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 12s local 2025-03-14T05:48:33.0634006Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 10s local 2025-03-14T05:48:33.0635084Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 9s local 2025-03-14T05:48:33.0635957Z @llvm-project//llvm:CodeGen; 8s local ... 2025-03-14T05:48:33.4532458Z 2025-03-14T05:48:33.4533312Z  2025-03-14T05:48:33.4533835Z  2025-03-14T05:48:33.4534221Z  2025-03-14T05:48:33.4534619Z  2025-03-14T05:48:33.4535029Z  2025-03-14T05:48:33.4535440Z  2025-03-14T05:48:33.4535841Z  2025-03-14T05:48:33.4536221Z  2025-03-14T05:48:33.4536787Z [14,058 / 15,235] 48 actions running 2025-03-14T05:48:33.4537632Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T05:48:33.4538628Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T05:48:33.4539947Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2025-03-14T05:48:33.4541084Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local 2025-03-14T05:48:33.4542120Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 12s local 2025-03-14T05:48:33.4543240Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 11s local 2025-03-14T05:48:33.4544409Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 10s local 2025-03-14T05:48:33.4545214Z @llvm-project//llvm:CodeGen; 8s local ... 2025-03-14T05:48:33.6715138Z 2025-03-14T05:48:33.6716012Z  2025-03-14T05:48:33.6716487Z  2025-03-14T05:48:33.6716900Z  2025-03-14T05:48:33.6717286Z  2025-03-14T05:48:33.6717694Z  2025-03-14T05:48:33.6718086Z  2025-03-14T05:48:33.6718595Z  2025-03-14T05:48:33.6718972Z  2025-03-14T05:48:33.6719903Z [14,059 / 15,235] 48 actions, 47 running 2025-03-14T05:48:33.6720739Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T05:48:33.6721616Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T05:48:33.6722507Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2025-03-14T05:48:33.6723582Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local 2025-03-14T05:48:33.6724580Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 13s local 2025-03-14T05:48:33.6725761Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 11s local 2025-03-14T05:48:33.6726861Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 10s local 2025-03-14T05:48:33.6727772Z @llvm-project//llvm:CodeGen; 8s local ... 2025-03-14T05:48:33.8763095Z 2025-03-14T05:48:33.8763891Z  2025-03-14T05:48:33.8764312Z  2025-03-14T05:48:33.8764796Z  2025-03-14T05:48:33.8765130Z  2025-03-14T05:48:33.8765699Z  2025-03-14T05:48:33.8766072Z  2025-03-14T05:48:33.8766429Z  2025-03-14T05:48:33.8766786Z  2025-03-14T05:48:33.8767348Z [14,061 / 15,235] 48 actions, 47 running 2025-03-14T05:48:33.8768358Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2025-03-14T05:48:33.8769129Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T05:48:33.8769943Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2025-03-14T05:48:33.8770851Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local 2025-03-14T05:48:33.8771743Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 13s local 2025-03-14T05:48:33.8772656Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 11s local 2025-03-14T05:48:33.8773699Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 10s local 2025-03-14T05:48:33.8774478Z @llvm-project//llvm:CodeGen; 8s local ... 2025-03-14T05:48:34.2539395Z 2025-03-14T05:48:34.2540222Z  2025-03-14T05:48:34.2540682Z  2025-03-14T05:48:34.2541054Z  2025-03-14T05:48:34.2541412Z  2025-03-14T05:48:34.2541773Z  2025-03-14T05:48:34.2542154Z  2025-03-14T05:48:34.2542547Z  2025-03-14T05:48:34.2542909Z  2025-03-14T05:48:34.2543411Z [14,061 / 15,235] 48 actions running 2025-03-14T05:48:34.2544124Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2025-03-14T05:48:34.2544880Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T05:48:34.2545633Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2025-03-14T05:48:34.2546490Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2025-03-14T05:48:34.2547341Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 13s local 2025-03-14T05:48:34.2548210Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 11s local 2025-03-14T05:48:34.2549149Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 11s local 2025-03-14T05:48:34.2549904Z @llvm-project//llvm:CodeGen; 9s local ... 2025-03-14T05:48:34.6350971Z 2025-03-14T05:48:34.6351835Z  2025-03-14T05:48:34.6352675Z  2025-03-14T05:48:34.6353114Z  2025-03-14T05:48:34.6353513Z  2025-03-14T05:48:34.6353915Z  2025-03-14T05:48:34.6354309Z  2025-03-14T05:48:34.6354686Z  2025-03-14T05:48:34.6355083Z  2025-03-14T05:48:34.6355687Z [14,063 / 15,235] 48 actions, 47 running 2025-03-14T05:48:34.6356507Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2025-03-14T05:48:34.6357356Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T05:48:34.6358246Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2025-03-14T05:48:34.6359207Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 14s local 2025-03-14T05:48:34.6360229Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 12s local 2025-03-14T05:48:34.6361365Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 11s local 2025-03-14T05:48:34.6362896Z Compiling llvm/lib/CodeGen/LiveDebugValues/InstrRefBasedImpl.cpp; 9s local 2025-03-14T05:48:34.6363881Z @llvm-project//llvm:CodeGen; 9s local ... 2025-03-14T05:48:34.8545803Z 2025-03-14T05:48:34.8546625Z  2025-03-14T05:48:34.8547115Z  2025-03-14T05:48:34.8547495Z  2025-03-14T05:48:34.8547897Z  2025-03-14T05:48:34.8548279Z  2025-03-14T05:48:34.8548668Z  2025-03-14T05:48:34.8549041Z  2025-03-14T05:48:34.8549436Z  2025-03-14T05:48:34.8550002Z [14,064 / 15,235] 48 actions running 2025-03-14T05:48:34.8550762Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T05:48:34.8551575Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T05:48:34.8552448Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2025-03-14T05:48:34.8553425Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 14s local 2025-03-14T05:48:34.8554450Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 12s local 2025-03-14T05:48:34.8555604Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 11s local 2025-03-14T05:48:34.8556764Z Compiling llvm/lib/CodeGen/LiveDebugValues/InstrRefBasedImpl.cpp; 9s local 2025-03-14T05:48:34.8558002Z @llvm-project//llvm:CodeGen; 9s local ... 2025-03-14T05:48:35.1504614Z 2025-03-14T05:48:35.1505446Z  2025-03-14T05:48:35.1505874Z  2025-03-14T05:48:35.1506235Z  2025-03-14T05:48:35.1506594Z  2025-03-14T05:48:35.1506953Z  2025-03-14T05:48:35.1507316Z  2025-03-14T05:48:35.1507674Z  2025-03-14T05:48:35.1508028Z  2025-03-14T05:48:35.1508572Z [14,067 / 15,235] 48 actions, 47 running 2025-03-14T05:48:35.1509301Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T05:48:35.1510077Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T05:48:35.1510900Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T05:48:35.1511860Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 14s local 2025-03-14T05:48:35.1512914Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 12s local 2025-03-14T05:48:35.1513857Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 12s local 2025-03-14T05:48:35.1514593Z @llvm-project//llvm:CodeGen; 10s local 2025-03-14T05:48:35.1515140Z @llvm-project//llvm:CodeGen; 9s local ... 2025-03-14T05:48:35.4553357Z 2025-03-14T05:48:35.4554230Z  2025-03-14T05:48:35.4554707Z  2025-03-14T05:48:35.4555097Z  2025-03-14T05:48:35.4555487Z  2025-03-14T05:48:35.4555889Z  2025-03-14T05:48:35.4556267Z  2025-03-14T05:48:35.4556656Z  2025-03-14T05:48:35.4557054Z  2025-03-14T05:48:35.4557619Z [14,070 / 15,235] 48 actions running 2025-03-14T05:48:35.4558425Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T05:48:35.4559272Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T05:48:35.4560233Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T05:48:35.4561633Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 14s local 2025-03-14T05:48:35.4562659Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local 2025-03-14T05:48:35.4563728Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 12s local 2025-03-14T05:48:35.4564548Z @llvm-project//llvm:CodeGen; 10s local 2025-03-14T05:48:35.4565523Z @llvm-project//llvm:CodeGen; 9s local ... 2025-03-14T05:48:35.6557771Z 2025-03-14T05:48:35.6558604Z  2025-03-14T05:48:35.6559083Z  2025-03-14T05:48:35.6559480Z  2025-03-14T05:48:35.6559888Z  2025-03-14T05:48:35.6560294Z  2025-03-14T05:48:35.6560691Z  2025-03-14T05:48:35.6561079Z  2025-03-14T05:48:35.6561462Z  2025-03-14T05:48:35.6562028Z [14,071 / 15,235] 48 actions running 2025-03-14T05:48:35.6562853Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T05:48:35.6564045Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T05:48:35.6565183Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T05:48:35.6566379Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 15s local 2025-03-14T05:48:35.6567367Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local 2025-03-14T05:48:35.6568470Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 12s local 2025-03-14T05:48:35.6569277Z @llvm-project//llvm:CodeGen; 10s local 2025-03-14T05:48:35.6569872Z @llvm-project//llvm:CodeGen; 10s local ... 2025-03-14T05:48:35.8705824Z 2025-03-14T05:48:35.8706683Z  2025-03-14T05:48:35.8707124Z  2025-03-14T05:48:35.8707509Z  2025-03-14T05:48:35.8707897Z  2025-03-14T05:48:35.8708275Z  2025-03-14T05:48:35.8708654Z  2025-03-14T05:48:35.8709024Z  2025-03-14T05:48:35.8709385Z  2025-03-14T05:48:35.8709979Z [14,074 / 15,235] 48 actions, 47 running 2025-03-14T05:48:35.8710740Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T05:48:35.8711601Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T05:48:35.8712791Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T05:48:35.8713834Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 15s local 2025-03-14T05:48:35.8714895Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local 2025-03-14T05:48:35.8716025Z Compiling llvm/lib/Target/X86/X86DiscriminateMemOps.cpp; 12s local 2025-03-14T05:48:35.8716923Z @llvm-project//llvm:CodeGen; 10s local 2025-03-14T05:48:35.8717555Z @llvm-project//llvm:CodeGen; 10s local ... 2025-03-14T05:48:36.1565741Z 2025-03-14T05:48:36.1566605Z  2025-03-14T05:48:36.1567082Z  2025-03-14T05:48:36.1567531Z  2025-03-14T05:48:36.1567937Z  2025-03-14T05:48:36.1568327Z  2025-03-14T05:48:36.1568755Z  2025-03-14T05:48:36.1569150Z  2025-03-14T05:48:36.1569518Z  2025-03-14T05:48:36.1570144Z [14,078 / 15,235] 47 actions, 46 running 2025-03-14T05:48:36.1570954Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T05:48:36.1571874Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T05:48:36.1572881Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2025-03-14T05:48:36.1573981Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 15s local 2025-03-14T05:48:36.1575086Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 13s local 2025-03-14T05:48:36.1576011Z @llvm-project//llvm:CodeGen; 11s local 2025-03-14T05:48:36.1576938Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 10s local 2025-03-14T05:48:36.1578070Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 10s local ... 2025-03-14T05:48:36.4569568Z 2025-03-14T05:48:36.4570453Z  2025-03-14T05:48:36.4570957Z  2025-03-14T05:48:36.4571428Z  2025-03-14T05:48:36.4571858Z  2025-03-14T05:48:36.4572281Z  2025-03-14T05:48:36.4572710Z  2025-03-14T05:48:36.4573465Z  2025-03-14T05:48:36.4573878Z  2025-03-14T05:48:36.4574427Z [14,079 / 15,235] 48 actions running 2025-03-14T05:48:36.4575382Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T05:48:36.4576358Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T05:48:36.4577267Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2025-03-14T05:48:36.4578277Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 15s local 2025-03-14T05:48:36.4579254Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local 2025-03-14T05:48:36.4580214Z @llvm-project//llvm:CodeGen; 11s local 2025-03-14T05:48:36.4581109Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 10s local 2025-03-14T05:48:36.4582221Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 10s local ... 2025-03-14T05:48:36.8568281Z 2025-03-14T05:48:36.8569209Z  2025-03-14T05:48:36.8569707Z  2025-03-14T05:48:36.8570145Z  2025-03-14T05:48:36.8570560Z  2025-03-14T05:48:36.8570978Z  2025-03-14T05:48:36.8571400Z  2025-03-14T05:48:36.8571797Z  2025-03-14T05:48:36.8572209Z  2025-03-14T05:48:36.8572807Z [14,080 / 15,235] 48 actions running 2025-03-14T05:48:36.8573682Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T05:48:36.8574621Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T05:48:36.8575633Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2025-03-14T05:48:36.8576685Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2025-03-14T05:48:36.8577842Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local 2025-03-14T05:48:36.8578785Z @llvm-project//llvm:CodeGen; 11s local 2025-03-14T05:48:36.8579793Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 11s local 2025-03-14T05:48:36.8581037Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 11s local ... 2025-03-14T05:48:37.1422055Z 2025-03-14T05:48:37.1423188Z  2025-03-14T05:48:37.1423724Z  2025-03-14T05:48:37.1424176Z  2025-03-14T05:48:37.1424621Z  2025-03-14T05:48:37.1425041Z  2025-03-14T05:48:37.1425467Z  2025-03-14T05:48:37.1425908Z  2025-03-14T05:48:37.1426346Z  2025-03-14T05:48:37.1426982Z [14,081 / 15,235] 48 actions, 47 running 2025-03-14T05:48:37.1427851Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T05:48:37.1428760Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T05:48:37.1429763Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T05:48:37.1430868Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2025-03-14T05:48:37.1431998Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 14s local 2025-03-14T05:48:37.1432932Z @llvm-project//llvm:CodeGen; 12s local 2025-03-14T05:48:37.1433873Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 11s local 2025-03-14T05:48:37.1434903Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 11s local ... 2025-03-14T05:48:37.4573458Z 2025-03-14T05:48:37.4574464Z  2025-03-14T05:48:37.4574999Z  2025-03-14T05:48:37.4575439Z  2025-03-14T05:48:37.4575849Z  2025-03-14T05:48:37.4576238Z  2025-03-14T05:48:37.4576603Z  2025-03-14T05:48:37.4577008Z  2025-03-14T05:48:37.4577416Z  2025-03-14T05:48:37.4578032Z [14,082 / 15,235] 48 actions running 2025-03-14T05:48:37.4578891Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T05:48:37.4579830Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T05:48:37.4580845Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T05:48:37.4581980Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 16s local 2025-03-14T05:48:37.4583411Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local 2025-03-14T05:48:37.4584328Z @llvm-project//llvm:CodeGen; 12s local 2025-03-14T05:48:37.4585279Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 11s local 2025-03-14T05:48:37.4586471Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 11s local ... 2025-03-14T05:48:37.6875042Z 2025-03-14T05:48:37.6875961Z  2025-03-14T05:48:37.6876494Z  2025-03-14T05:48:37.6876960Z  2025-03-14T05:48:37.6877408Z  2025-03-14T05:48:37.6877809Z  2025-03-14T05:48:37.6878184Z  2025-03-14T05:48:37.6878549Z  2025-03-14T05:48:37.6878914Z  2025-03-14T05:48:37.6879587Z [14,085 / 15,235] 48 actions, 47 running 2025-03-14T05:48:37.6880382Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T05:48:37.6881221Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T05:48:37.6882373Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T05:48:37.6883403Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2025-03-14T05:48:37.6884391Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local 2025-03-14T05:48:37.6885457Z @llvm-project//llvm:CodeGen; 12s local 2025-03-14T05:48:37.6886372Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 12s local 2025-03-14T05:48:37.6887516Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 11s local ... 2025-03-14T05:48:38.0508643Z 2025-03-14T05:48:38.0509639Z  2025-03-14T05:48:38.0510084Z  2025-03-14T05:48:38.0510459Z  2025-03-14T05:48:38.0510861Z  2025-03-14T05:48:38.0511248Z  2025-03-14T05:48:38.0511645Z  2025-03-14T05:48:38.0512015Z  2025-03-14T05:48:38.0512413Z  2025-03-14T05:48:38.0512957Z [14,087 / 15,235] 48 actions, 47 running 2025-03-14T05:48:38.0513743Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2025-03-14T05:48:38.0514595Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T05:48:38.0515472Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T05:48:38.0516775Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2025-03-14T05:48:38.0517690Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local 2025-03-14T05:48:38.0518485Z @llvm-project//llvm:CodeGen; 13s local 2025-03-14T05:48:38.0519363Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 12s local 2025-03-14T05:48:38.0520483Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 12s local ... 2025-03-14T05:48:38.2580895Z 2025-03-14T05:48:38.2581836Z  2025-03-14T05:48:38.2582356Z  2025-03-14T05:48:38.2582752Z  2025-03-14T05:48:38.2583120Z  2025-03-14T05:48:38.2583490Z  2025-03-14T05:48:38.2583844Z  2025-03-14T05:48:38.2584199Z  2025-03-14T05:48:38.2584585Z  2025-03-14T05:48:38.2595119Z [14,088 / 15,235] 48 actions running 2025-03-14T05:48:38.2595940Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2025-03-14T05:48:38.2596731Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T05:48:38.2597693Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T05:48:38.2598546Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 17s local 2025-03-14T05:48:38.2599442Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 15s local 2025-03-14T05:48:38.2600244Z @llvm-project//llvm:CodeGen; 13s local 2025-03-14T05:48:38.2601039Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 12s local 2025-03-14T05:48:38.2602045Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 12s local ... 2025-03-14T05:48:38.6586067Z 2025-03-14T05:48:38.6587029Z  2025-03-14T05:48:38.6587432Z  2025-03-14T05:48:38.6587762Z  2025-03-14T05:48:38.6588117Z  2025-03-14T05:48:38.6588444Z  2025-03-14T05:48:38.6588764Z  2025-03-14T05:48:38.6589087Z  2025-03-14T05:48:38.6589412Z  2025-03-14T05:48:38.6590229Z [14,089 / 15,235] 48 actions running 2025-03-14T05:48:38.6590918Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2025-03-14T05:48:38.6591614Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T05:48:38.6592349Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T05:48:38.6593127Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2025-03-14T05:48:38.6593913Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local 2025-03-14T05:48:38.6594614Z @llvm-project//llvm:CodeGen; 13s local 2025-03-14T05:48:38.6595309Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 13s local 2025-03-14T05:48:38.6596195Z Compiling llvm/lib/CodeGen/LiveDebugVariables.cpp; 12s local ... 2025-03-14T05:48:39.0591177Z 2025-03-14T05:48:39.0592408Z  2025-03-14T05:48:39.0592978Z  2025-03-14T05:48:39.0593345Z  2025-03-14T05:48:39.0593704Z  2025-03-14T05:48:39.0594096Z  2025-03-14T05:48:39.0594467Z  2025-03-14T05:48:39.0594857Z  2025-03-14T05:48:39.0595231Z  2025-03-14T05:48:39.0595777Z [14,091 / 15,235] 48 actions running 2025-03-14T05:48:39.0596520Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T05:48:39.0597305Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T05:48:39.0598108Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T05:48:39.0599005Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2025-03-14T05:48:39.0599992Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local 2025-03-14T05:48:39.0600848Z @llvm-project//llvm:CodeGen; 14s local 2025-03-14T05:48:39.0601673Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 13s local 2025-03-14T05:48:39.0602613Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local ... 2025-03-14T05:48:39.4596113Z 2025-03-14T05:48:39.4596927Z  2025-03-14T05:48:39.4597433Z  2025-03-14T05:48:39.4598170Z  2025-03-14T05:48:39.4598563Z  2025-03-14T05:48:39.4598976Z  2025-03-14T05:48:39.4599377Z  2025-03-14T05:48:39.4599764Z  2025-03-14T05:48:39.4600176Z  2025-03-14T05:48:39.4600724Z [14,092 / 15,235] 48 actions running 2025-03-14T05:48:39.4601518Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T05:48:39.4602415Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T05:48:39.4603394Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T05:48:39.4604370Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local 2025-03-14T05:48:39.4605544Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2025-03-14T05:48:39.4606492Z @llvm-project//llvm:CodeGen; 14s local 2025-03-14T05:48:39.4607429Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 13s local 2025-03-14T05:48:39.4608471Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local ... 2025-03-14T05:48:39.6640926Z 2025-03-14T05:48:39.6641788Z  2025-03-14T05:48:39.6642258Z  2025-03-14T05:48:39.6642663Z  2025-03-14T05:48:39.6643065Z  2025-03-14T05:48:39.6643469Z  2025-03-14T05:48:39.6643885Z  2025-03-14T05:48:39.6644296Z  2025-03-14T05:48:39.6644809Z  2025-03-14T05:48:39.6645424Z [14,095 / 15,235] 48 actions, 47 running 2025-03-14T05:48:39.6646377Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T05:48:39.6647287Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T05:48:39.6648235Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T05:48:39.6649253Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2025-03-14T05:48:39.6650365Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2025-03-14T05:48:39.6651316Z @llvm-project//llvm:CodeGen; 14s local 2025-03-14T05:48:39.6652622Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 14s local 2025-03-14T05:48:39.6653692Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local ... 2025-03-14T05:48:39.9120828Z 2025-03-14T05:48:39.9121699Z  2025-03-14T05:48:39.9122188Z  2025-03-14T05:48:39.9122621Z  2025-03-14T05:48:39.9123025Z  2025-03-14T05:48:39.9123425Z  2025-03-14T05:48:39.9123820Z  2025-03-14T05:48:39.9124255Z  2025-03-14T05:48:39.9124832Z  2025-03-14T05:48:39.9125493Z [14,099 / 15,235] 48 actions, 47 running 2025-03-14T05:48:39.9126370Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2025-03-14T05:48:39.9127269Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T05:48:39.9128264Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T05:48:39.9129645Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2025-03-14T05:48:39.9130766Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2025-03-14T05:48:39.9131745Z @llvm-project//llvm:CodeGen; 14s local 2025-03-14T05:48:39.9132727Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 14s local 2025-03-14T05:48:39.9133805Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local ... 2025-03-14T05:48:40.1702402Z 2025-03-14T05:48:40.1703209Z  2025-03-14T05:48:40.1703694Z  2025-03-14T05:48:40.1704109Z  2025-03-14T05:48:40.1704524Z  2025-03-14T05:48:40.1704940Z  2025-03-14T05:48:40.1705338Z  2025-03-14T05:48:40.1705742Z  2025-03-14T05:48:40.1706275Z  2025-03-14T05:48:40.1706886Z [14,103 / 15,235] 48 actions, 47 running 2025-03-14T05:48:40.1707795Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2025-03-14T05:48:40.1708741Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T05:48:40.1709778Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 22s local 2025-03-14T05:48:40.1710859Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2025-03-14T05:48:40.1712251Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2025-03-14T05:48:40.1713224Z @llvm-project//llvm:CodeGen; 15s local 2025-03-14T05:48:40.1714205Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 14s local 2025-03-14T05:48:40.1715286Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local ... 2025-03-14T05:48:40.4604428Z 2025-03-14T05:48:40.4605401Z  2025-03-14T05:48:40.4605884Z  2025-03-14T05:48:40.4606361Z  2025-03-14T05:48:40.4606748Z  2025-03-14T05:48:40.4607137Z  2025-03-14T05:48:40.4607523Z  2025-03-14T05:48:40.4607935Z  2025-03-14T05:48:40.4608354Z  2025-03-14T05:48:40.4608936Z [14,105 / 15,235] 48 actions running 2025-03-14T05:48:40.4609856Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2025-03-14T05:48:40.4610721Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T05:48:40.4611531Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local 2025-03-14T05:48:40.4612515Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2025-03-14T05:48:40.4613451Z @llvm-project//llvm:CodeGen; 15s local 2025-03-14T05:48:40.4614500Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 14s local 2025-03-14T05:48:40.4615538Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T05:48:40.4616405Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 12s local ... 2025-03-14T05:48:40.7566368Z 2025-03-14T05:48:40.7567202Z  2025-03-14T05:48:40.7567717Z  2025-03-14T05:48:40.7568124Z  2025-03-14T05:48:40.7568535Z  2025-03-14T05:48:40.7568925Z  2025-03-14T05:48:40.7569300Z  2025-03-14T05:48:40.7569709Z  2025-03-14T05:48:40.7570106Z  2025-03-14T05:48:40.7570853Z [14,108 / 15,235] 48 actions, 47 running 2025-03-14T05:48:40.7572098Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T05:48:40.7573123Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2025-03-14T05:48:40.7574214Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2025-03-14T05:48:40.7575174Z @llvm-project//llvm:CodeGen; 15s local 2025-03-14T05:48:40.7576117Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 15s local 2025-03-14T05:48:40.7577151Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T05:48:40.7577933Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 12s local 2025-03-14T05:48:40.7578848Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local ... 2025-03-14T05:48:40.9666151Z 2025-03-14T05:48:40.9667010Z  2025-03-14T05:48:40.9667540Z  2025-03-14T05:48:40.9667991Z  2025-03-14T05:48:40.9668435Z  2025-03-14T05:48:40.9668869Z  2025-03-14T05:48:40.9669738Z  2025-03-14T05:48:40.9670099Z  2025-03-14T05:48:40.9670469Z  2025-03-14T05:48:40.9671119Z [14,110 / 15,235] 48 actions, 47 running 2025-03-14T05:48:40.9671933Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T05:48:40.9672791Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2025-03-14T05:48:40.9673951Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2025-03-14T05:48:40.9674827Z @llvm-project//llvm:CodeGen; 15s local 2025-03-14T05:48:40.9675705Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 15s local 2025-03-14T05:48:40.9676723Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2025-03-14T05:48:40.9677587Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 10s local 2025-03-14T05:48:40.9678551Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 7s local ... 2025-03-14T05:48:41.2611359Z 2025-03-14T05:48:41.2612410Z  2025-03-14T05:48:41.2612956Z  2025-03-14T05:48:41.2613446Z  2025-03-14T05:48:41.2613897Z  2025-03-14T05:48:41.2614345Z  2025-03-14T05:48:41.2614781Z  2025-03-14T05:48:41.2615231Z  2025-03-14T05:48:41.2615969Z  2025-03-14T05:48:41.2616512Z [14,110 / 15,235] 48 actions running 2025-03-14T05:48:41.2617310Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T05:48:41.2618241Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2025-03-14T05:48:41.2619303Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2025-03-14T05:48:41.2620269Z @llvm-project//llvm:CodeGen; 16s local 2025-03-14T05:48:41.2621232Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 15s local 2025-03-14T05:48:41.2622337Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2025-03-14T05:48:41.2623295Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 10s local 2025-03-14T05:48:41.2624317Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 7s local ... 2025-03-14T05:48:41.5860116Z 2025-03-14T05:48:41.5861164Z  2025-03-14T05:48:41.5861655Z  2025-03-14T05:48:41.5862131Z  2025-03-14T05:48:41.5862552Z  2025-03-14T05:48:41.5863002Z  2025-03-14T05:48:41.5863424Z  2025-03-14T05:48:41.5863847Z  2025-03-14T05:48:41.5864263Z  2025-03-14T05:48:41.5864874Z [14,111 / 15,235] 48 actions, 47 running 2025-03-14T05:48:41.5865751Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T05:48:41.5866564Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2025-03-14T05:48:41.5867572Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2025-03-14T05:48:41.5868473Z @llvm-project//llvm:CodeGen; 16s local 2025-03-14T05:48:41.5869400Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 16s local 2025-03-14T05:48:41.5870410Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2025-03-14T05:48:41.5871262Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 10s local 2025-03-14T05:48:41.5872560Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 7s local ... 2025-03-14T05:48:41.8356566Z 2025-03-14T05:48:41.8357767Z  2025-03-14T05:48:41.8358300Z  2025-03-14T05:48:41.8358847Z  2025-03-14T05:48:41.8359610Z  2025-03-14T05:48:41.8360177Z  2025-03-14T05:48:41.8360585Z  2025-03-14T05:48:41.8361023Z  2025-03-14T05:48:41.8361456Z  2025-03-14T05:48:41.8362088Z [14,112 / 15,235] 48 actions, 47 running 2025-03-14T05:48:41.8362923Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T05:48:41.8363805Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2025-03-14T05:48:41.8364932Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2025-03-14T05:48:41.8366161Z @llvm-project//llvm:CodeGen; 16s local 2025-03-14T05:48:41.8367099Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 16s local 2025-03-14T05:48:41.8368496Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2025-03-14T05:48:41.8369483Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 11s local 2025-03-14T05:48:41.8370480Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 7s local ... 2025-03-14T05:48:42.0617562Z 2025-03-14T05:48:42.0618687Z  2025-03-14T05:48:42.0619212Z  2025-03-14T05:48:42.0620578Z  2025-03-14T05:48:42.0621749Z  2025-03-14T05:48:42.0622516Z  2025-03-14T05:48:42.0623339Z  2025-03-14T05:48:42.0623851Z  2025-03-14T05:48:42.0624343Z  2025-03-14T05:48:42.0624882Z [14,112 / 15,235] 48 actions running 2025-03-14T05:48:42.0625629Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T05:48:42.0626471Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2025-03-14T05:48:42.0627471Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2025-03-14T05:48:42.0628366Z @llvm-project//llvm:CodeGen; 17s local 2025-03-14T05:48:42.0629408Z Compiling llvm/lib/CodeGen/LiveDebugValues/VarLocBasedImpl.cpp; 16s local 2025-03-14T05:48:42.0630532Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2025-03-14T05:48:42.0631731Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 11s local 2025-03-14T05:48:42.0632682Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 8s local ... 2025-03-14T05:48:42.3233519Z 2025-03-14T05:48:42.3234588Z  2025-03-14T05:48:42.3235176Z  2025-03-14T05:48:42.3235658Z  2025-03-14T05:48:42.3236095Z  2025-03-14T05:48:42.3236463Z  2025-03-14T05:48:42.3236943Z  2025-03-14T05:48:42.3237383Z  2025-03-14T05:48:42.3237768Z  2025-03-14T05:48:42.3238376Z [14,113 / 15,235] 48 actions, 47 running 2025-03-14T05:48:42.3239090Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T05:48:42.3240036Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2025-03-14T05:48:42.3241044Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2025-03-14T05:48:42.3241969Z @llvm-project//llvm:CodeGen; 17s local 2025-03-14T05:48:42.3242700Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2025-03-14T05:48:42.3243675Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 11s local 2025-03-14T05:48:42.3244645Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 8s local 2025-03-14T05:48:42.3245773Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 7s local ... 2025-03-14T05:48:42.6524150Z 2025-03-14T05:48:42.6525190Z  2025-03-14T05:48:42.6525709Z  2025-03-14T05:48:42.6526094Z  2025-03-14T05:48:42.6526475Z  2025-03-14T05:48:42.6526838Z  2025-03-14T05:48:42.6527205Z  2025-03-14T05:48:42.6527570Z  2025-03-14T05:48:42.6527923Z  2025-03-14T05:48:42.6528483Z [14,114 / 15,235] 48 actions, 47 running 2025-03-14T05:48:42.6529256Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T05:48:42.6530142Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2025-03-14T05:48:42.6531693Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2025-03-14T05:48:42.6532606Z @llvm-project//llvm:CodeGen; 17s local 2025-03-14T05:48:42.6533345Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2025-03-14T05:48:42.6534174Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 11s local 2025-03-14T05:48:42.6535111Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 8s local 2025-03-14T05:48:42.6536087Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 8s local ... 2025-03-14T05:48:42.8625790Z 2025-03-14T05:48:42.8626701Z  2025-03-14T05:48:42.8627196Z  2025-03-14T05:48:42.8627580Z  2025-03-14T05:48:42.8628000Z  2025-03-14T05:48:42.8628414Z  2025-03-14T05:48:42.8628787Z  2025-03-14T05:48:42.8629173Z  2025-03-14T05:48:42.8629576Z  2025-03-14T05:48:42.8630138Z [14,114 / 15,235] 48 actions running 2025-03-14T05:48:42.8631199Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T05:48:42.8632104Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2025-03-14T05:48:42.8633149Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2025-03-14T05:48:42.8633992Z @llvm-project//llvm:CodeGen; 17s local 2025-03-14T05:48:42.8634674Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2025-03-14T05:48:42.8635551Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 12s local 2025-03-14T05:48:42.8636523Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 8s local 2025-03-14T05:48:42.8637483Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 8s local ... 2025-03-14T05:48:43.1294383Z 2025-03-14T05:48:43.1295350Z  2025-03-14T05:48:43.1295817Z  2025-03-14T05:48:43.1296306Z  2025-03-14T05:48:43.1296674Z  2025-03-14T05:48:43.1297042Z  2025-03-14T05:48:43.1297404Z  2025-03-14T05:48:43.1297822Z  2025-03-14T05:48:43.1298196Z  2025-03-14T05:48:43.1298761Z [14,115 / 15,235] 48 actions, 47 running 2025-03-14T05:48:43.1299540Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T05:48:43.1300617Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2025-03-14T05:48:43.1301548Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2025-03-14T05:48:43.1302417Z @llvm-project//llvm:CodeGen; 18s local 2025-03-14T05:48:43.1303076Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T05:48:43.1303942Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 12s local 2025-03-14T05:48:43.1304707Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 9s local 2025-03-14T05:48:43.1305503Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 8s local ... 2025-03-14T05:48:43.4630506Z 2025-03-14T05:48:43.4631725Z  2025-03-14T05:48:43.4632301Z  2025-03-14T05:48:43.4632685Z  2025-03-14T05:48:43.4633171Z  2025-03-14T05:48:43.4633581Z  2025-03-14T05:48:43.4634012Z  2025-03-14T05:48:43.4634394Z  2025-03-14T05:48:43.4634832Z  2025-03-14T05:48:43.4635381Z [14,116 / 15,235] 48 actions running 2025-03-14T05:48:43.4636196Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T05:48:43.4637099Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2025-03-14T05:48:43.4638092Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2025-03-14T05:48:43.4639030Z @llvm-project//llvm:CodeGen; 18s local 2025-03-14T05:48:43.4639788Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T05:48:43.4640701Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 12s local 2025-03-14T05:48:43.4641633Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 9s local 2025-03-14T05:48:43.4642627Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 8s local ... 2025-03-14T05:48:43.8028390Z 2025-03-14T05:48:43.8029345Z  2025-03-14T05:48:43.8029871Z  2025-03-14T05:48:43.8030298Z  2025-03-14T05:48:43.8030703Z  2025-03-14T05:48:43.8031447Z  2025-03-14T05:48:43.8031884Z  2025-03-14T05:48:43.8032305Z  2025-03-14T05:48:43.8032692Z  2025-03-14T05:48:43.8033320Z [14,117 / 15,235] 48 actions, 47 running 2025-03-14T05:48:43.8034092Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T05:48:43.8034920Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2025-03-14T05:48:43.8036093Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2025-03-14T05:48:43.8037092Z @llvm-project//llvm:CodeGen; 18s local 2025-03-14T05:48:43.8037958Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T05:48:43.8038851Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 13s local 2025-03-14T05:48:43.8039752Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 9s local 2025-03-14T05:48:43.8040975Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 9s local ... 2025-03-14T05:48:44.0637854Z 2025-03-14T05:48:44.0638762Z  2025-03-14T05:48:44.0639312Z  2025-03-14T05:48:44.0639725Z  2025-03-14T05:48:44.0640154Z  2025-03-14T05:48:44.0640573Z  2025-03-14T05:48:44.0640920Z  2025-03-14T05:48:44.0641320Z  2025-03-14T05:48:44.0641711Z  2025-03-14T05:48:44.0642304Z [14,121 / 15,235] 48 actions running 2025-03-14T05:48:44.0643097Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T05:48:44.0643995Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2025-03-14T05:48:44.0645152Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2025-03-14T05:48:44.0646142Z @llvm-project//llvm:CodeGen; 19s local 2025-03-14T05:48:44.0646856Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T05:48:44.0647730Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 13s local 2025-03-14T05:48:44.0648720Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 10s local 2025-03-14T05:48:44.0649752Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 9s local ... 2025-03-14T05:48:44.2917120Z 2025-03-14T05:48:44.2918054Z  2025-03-14T05:48:44.2918580Z  2025-03-14T05:48:44.2918978Z  2025-03-14T05:48:44.2919367Z  2025-03-14T05:48:44.2919728Z  2025-03-14T05:48:44.2920102Z  2025-03-14T05:48:44.2920515Z  2025-03-14T05:48:44.2920869Z  2025-03-14T05:48:44.2921460Z [14,122 / 15,235] 48 actions, 47 running 2025-03-14T05:48:44.2922230Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T05:48:44.2923101Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2025-03-14T05:48:44.2924144Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2025-03-14T05:48:44.2925230Z @llvm-project//llvm:CodeGen; 19s local 2025-03-14T05:48:44.2925966Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T05:48:44.2926913Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 13s local 2025-03-14T05:48:44.2927725Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 10s local 2025-03-14T05:48:44.2928670Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 9s local ... 2025-03-14T05:48:44.6644096Z 2025-03-14T05:48:44.6645125Z  2025-03-14T05:48:44.6645636Z  2025-03-14T05:48:44.6646057Z  2025-03-14T05:48:44.6646470Z  2025-03-14T05:48:44.6646891Z  2025-03-14T05:48:44.6647264Z  2025-03-14T05:48:44.6647687Z  2025-03-14T05:48:44.6648135Z  2025-03-14T05:48:44.6648844Z [14,122 / 15,235] 48 actions running 2025-03-14T05:48:44.6649782Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T05:48:44.6650729Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2025-03-14T05:48:44.6651769Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2025-03-14T05:48:44.6652722Z @llvm-project//llvm:CodeGen; 19s local 2025-03-14T05:48:44.6653487Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T05:48:44.6654762Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 13s local 2025-03-14T05:48:44.6655783Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 10s local 2025-03-14T05:48:44.6656825Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 10s local ... 2025-03-14T05:48:45.0649674Z 2025-03-14T05:48:45.0650703Z  2025-03-14T05:48:45.0651232Z  2025-03-14T05:48:45.0651611Z  2025-03-14T05:48:45.0651997Z  2025-03-14T05:48:45.0652394Z  2025-03-14T05:48:45.0652925Z  2025-03-14T05:48:45.0653360Z  2025-03-14T05:48:45.0653792Z  2025-03-14T05:48:45.0654308Z [14,124 / 15,235] 48 actions running 2025-03-14T05:48:45.0655087Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T05:48:45.0656096Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2025-03-14T05:48:45.0657308Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2025-03-14T05:48:45.0658158Z @llvm-project//llvm:CodeGen; 20s local 2025-03-14T05:48:45.0658850Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T05:48:45.0659710Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 14s local 2025-03-14T05:48:45.0660617Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2025-03-14T05:48:45.0661600Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 10s local ... 2025-03-14T05:48:45.2654008Z 2025-03-14T05:48:45.2654910Z  2025-03-14T05:48:45.2655419Z  2025-03-14T05:48:45.2655826Z  2025-03-14T05:48:45.2656218Z  2025-03-14T05:48:45.2656614Z  2025-03-14T05:48:45.2657012Z  2025-03-14T05:48:45.2657418Z  2025-03-14T05:48:45.2657805Z  2025-03-14T05:48:45.2658383Z [14,126 / 15,235] 48 actions running 2025-03-14T05:48:45.2659163Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T05:48:45.2660127Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2025-03-14T05:48:45.2661144Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2025-03-14T05:48:45.2662315Z @llvm-project//llvm:CodeGen; 20s local 2025-03-14T05:48:45.2663049Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T05:48:45.2663874Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 14s local 2025-03-14T05:48:45.2664779Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2025-03-14T05:48:45.2665996Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 10s local ... 2025-03-14T05:48:45.6661730Z 2025-03-14T05:48:45.6662601Z  2025-03-14T05:48:45.6663122Z  2025-03-14T05:48:45.6663528Z  2025-03-14T05:48:45.6663943Z  2025-03-14T05:48:45.6664349Z  2025-03-14T05:48:45.6664774Z  2025-03-14T05:48:45.6665187Z  2025-03-14T05:48:45.6665831Z  2025-03-14T05:48:45.6666524Z [14,127 / 15,235] 48 actions running 2025-03-14T05:48:45.6667322Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2025-03-14T05:48:45.6668230Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2025-03-14T05:48:45.6669280Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2025-03-14T05:48:45.6670203Z @llvm-project//llvm:CodeGen; 20s local 2025-03-14T05:48:45.6670930Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T05:48:45.6671839Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 14s local 2025-03-14T05:48:45.6672798Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2025-03-14T05:48:45.6673715Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 11s local ... 2025-03-14T05:48:45.8663241Z 2025-03-14T05:48:45.8664119Z  2025-03-14T05:48:45.8664642Z  2025-03-14T05:48:45.8665063Z  2025-03-14T05:48:45.8665681Z  2025-03-14T05:48:45.8666118Z  2025-03-14T05:48:45.8666543Z  2025-03-14T05:48:45.8666996Z  2025-03-14T05:48:45.8667417Z  2025-03-14T05:48:45.8668031Z [14,128 / 15,235] 48 actions running 2025-03-14T05:48:45.8669170Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2025-03-14T05:48:45.8670123Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2025-03-14T05:48:45.8671242Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2025-03-14T05:48:45.8672226Z @llvm-project//llvm:CodeGen; 20s local 2025-03-14T05:48:45.8673010Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T05:48:45.8673987Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 15s local 2025-03-14T05:48:45.8675021Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 11s local 2025-03-14T05:48:45.8676085Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 11s local ... 2025-03-14T05:48:46.1147268Z 2025-03-14T05:48:46.1148159Z  2025-03-14T05:48:46.1148669Z  2025-03-14T05:48:46.1149160Z  2025-03-14T05:48:46.1149833Z  2025-03-14T05:48:46.1150248Z  2025-03-14T05:48:46.1150645Z  2025-03-14T05:48:46.1151037Z  2025-03-14T05:48:46.1151456Z  2025-03-14T05:48:46.1152073Z [14,129 / 15,235] 48 actions, 47 running 2025-03-14T05:48:46.1152886Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2025-03-14T05:48:46.1153654Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2025-03-14T05:48:46.1154656Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2025-03-14T05:48:46.1155573Z @llvm-project//llvm:CodeGen; 21s local 2025-03-14T05:48:46.1156416Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T05:48:46.1157324Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 15s local 2025-03-14T05:48:46.1158316Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 12s local 2025-03-14T05:48:46.1159379Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 11s local ... 2025-03-14T05:48:46.4671024Z 2025-03-14T05:48:46.4672210Z  2025-03-14T05:48:46.4673024Z  2025-03-14T05:48:46.4673753Z  2025-03-14T05:48:46.4674718Z  2025-03-14T05:48:46.4675256Z  2025-03-14T05:48:46.4675688Z  2025-03-14T05:48:46.4676356Z  2025-03-14T05:48:46.4676788Z  2025-03-14T05:48:46.4677440Z [14,129 / 15,235] 48 actions running 2025-03-14T05:48:46.4678284Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T05:48:46.4679247Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2025-03-14T05:48:46.4680403Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2025-03-14T05:48:46.4681420Z @llvm-project//llvm:CodeGen; 21s local 2025-03-14T05:48:46.4682224Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T05:48:46.4683158Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 15s local 2025-03-14T05:48:46.4684206Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 12s local 2025-03-14T05:48:46.4685486Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 11s local ... 2025-03-14T05:48:46.6674250Z 2025-03-14T05:48:46.6675558Z  2025-03-14T05:48:46.6676128Z  2025-03-14T05:48:46.6676534Z  2025-03-14T05:48:46.6677044Z  2025-03-14T05:48:46.6677437Z  2025-03-14T05:48:46.6677813Z  2025-03-14T05:48:46.6678187Z  2025-03-14T05:48:46.6678606Z  2025-03-14T05:48:46.6679219Z [14,130 / 15,235] 48 actions running 2025-03-14T05:48:46.6680128Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T05:48:46.6681005Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2025-03-14T05:48:46.6682001Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2025-03-14T05:48:46.6682988Z @llvm-project//llvm:CodeGen; 21s local 2025-03-14T05:48:46.6683760Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T05:48:46.6684645Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 15s local 2025-03-14T05:48:46.6685852Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 12s local 2025-03-14T05:48:46.6687282Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 12s local ... 2025-03-14T05:48:46.9533157Z 2025-03-14T05:48:46.9534134Z  2025-03-14T05:48:46.9534653Z  2025-03-14T05:48:46.9535075Z  2025-03-14T05:48:46.9535498Z  2025-03-14T05:48:46.9535913Z  2025-03-14T05:48:46.9536293Z  2025-03-14T05:48:46.9536651Z  2025-03-14T05:48:46.9537024Z  2025-03-14T05:48:46.9537582Z [14,132 / 15,235] 48 actions, 47 running 2025-03-14T05:48:46.9538390Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T05:48:46.9539233Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2025-03-14T05:48:46.9540223Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2025-03-14T05:48:46.9541146Z @llvm-project//llvm:CodeGen; 21s local 2025-03-14T05:48:46.9541832Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T05:48:46.9543050Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 16s local 2025-03-14T05:48:46.9544026Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 13s local 2025-03-14T05:48:46.9545018Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 12s local ... 2025-03-14T05:48:47.1606566Z 2025-03-14T05:48:47.1607429Z  2025-03-14T05:48:47.1607920Z  2025-03-14T05:48:47.1608285Z  2025-03-14T05:48:47.1608655Z  2025-03-14T05:48:47.1609024Z  2025-03-14T05:48:47.1609381Z  2025-03-14T05:48:47.1609736Z  2025-03-14T05:48:47.1610126Z  2025-03-14T05:48:47.1610733Z [14,132 / 15,235] 48 actions, 47 running 2025-03-14T05:48:47.1611443Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T05:48:47.1612314Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2025-03-14T05:48:47.1613537Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2025-03-14T05:48:47.1614495Z @llvm-project//llvm:CodeGen; 22s local 2025-03-14T05:48:47.1615262Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T05:48:47.1616166Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 16s local 2025-03-14T05:48:47.1617380Z Compiling llvm/lib/CodeGen/MIRParser/MIParser.cpp; 13s local 2025-03-14T05:48:47.1618400Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 12s local ... 2025-03-14T05:48:47.5610047Z 2025-03-14T05:48:47.5611059Z  2025-03-14T05:48:47.5611622Z  2025-03-14T05:48:47.5612016Z  2025-03-14T05:48:47.5612420Z  2025-03-14T05:48:47.5612813Z  2025-03-14T05:48:47.5613201Z  2025-03-14T05:48:47.5613588Z  2025-03-14T05:48:47.5613993Z  2025-03-14T05:48:47.5614591Z [14,137 / 15,235] 48 actions running 2025-03-14T05:48:47.5615351Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T05:48:47.5616222Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2025-03-14T05:48:47.5617286Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T05:48:47.5618218Z @llvm-project//llvm:CodeGen; 22s local 2025-03-14T05:48:47.5618946Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T05:48:47.5619858Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 16s local 2025-03-14T05:48:47.5620785Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 12s local 2025-03-14T05:48:47.5621712Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 12s local ... 2025-03-14T05:48:47.7614018Z 2025-03-14T05:48:47.7615028Z  2025-03-14T05:48:47.7615589Z  2025-03-14T05:48:47.7615969Z  2025-03-14T05:48:47.7616382Z  2025-03-14T05:48:47.7616800Z  2025-03-14T05:48:47.7617204Z  2025-03-14T05:48:47.7617616Z  2025-03-14T05:48:47.7618025Z  2025-03-14T05:48:47.7618606Z [14,138 / 15,235] 48 actions running 2025-03-14T05:48:47.7619394Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T05:48:47.7620255Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2025-03-14T05:48:47.7621607Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T05:48:47.7622705Z @llvm-project//llvm:CodeGen; 22s local 2025-03-14T05:48:47.7623612Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T05:48:47.7624587Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local 2025-03-14T05:48:47.7625649Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2025-03-14T05:48:47.7626519Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local ... 2025-03-14T05:48:48.0271298Z 2025-03-14T05:48:48.0272295Z  2025-03-14T05:48:48.0272865Z  2025-03-14T05:48:48.0273245Z  2025-03-14T05:48:48.0273642Z  2025-03-14T05:48:48.0274060Z  2025-03-14T05:48:48.0274386Z  2025-03-14T05:48:48.0274749Z  2025-03-14T05:48:48.0275128Z  2025-03-14T05:48:48.0275721Z [14,140 / 15,235] 48 actions, 47 running 2025-03-14T05:48:48.0276907Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T05:48:48.0277865Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2025-03-14T05:48:48.0278987Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T05:48:48.0279944Z @llvm-project//llvm:CodeGen; 23s local 2025-03-14T05:48:48.0280699Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T05:48:48.0281627Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local 2025-03-14T05:48:48.0282619Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2025-03-14T05:48:48.0283535Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local ... 2025-03-14T05:48:48.3619774Z 2025-03-14T05:48:48.3620764Z  2025-03-14T05:48:48.3621303Z  2025-03-14T05:48:48.3621709Z  2025-03-14T05:48:48.3622113Z  2025-03-14T05:48:48.3622527Z  2025-03-14T05:48:48.3622926Z  2025-03-14T05:48:48.3623363Z  2025-03-14T05:48:48.3623752Z  2025-03-14T05:48:48.3624337Z [14,142 / 15,235] 48 actions running 2025-03-14T05:48:48.3625138Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T05:48:48.3626289Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2025-03-14T05:48:48.3627394Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T05:48:48.3628352Z @llvm-project//llvm:CodeGen; 23s local 2025-03-14T05:48:48.3629097Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T05:48:48.3629975Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local 2025-03-14T05:48:48.3630953Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2025-03-14T05:48:48.3631871Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local ... 2025-03-14T05:48:48.5624836Z 2025-03-14T05:48:48.5625851Z  2025-03-14T05:48:48.5626406Z  2025-03-14T05:48:48.5626890Z  2025-03-14T05:48:48.5627436Z  2025-03-14T05:48:48.5627918Z  2025-03-14T05:48:48.5628392Z  2025-03-14T05:48:48.5628845Z  2025-03-14T05:48:48.5629326Z  2025-03-14T05:48:48.5629965Z [14,143 / 15,235] 48 actions running 2025-03-14T05:48:48.5630851Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T05:48:48.5631674Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2025-03-14T05:48:48.5632615Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T05:48:48.5633475Z @llvm-project//llvm:CodeGen; 23s local 2025-03-14T05:48:48.5634200Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T05:48:48.5635095Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 17s local 2025-03-14T05:48:48.5636023Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 13s local 2025-03-14T05:48:48.5636958Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 13s local ... 2025-03-14T05:48:48.9275675Z 2025-03-14T05:48:48.9276534Z  2025-03-14T05:48:48.9277060Z  2025-03-14T05:48:48.9277461Z  2025-03-14T05:48:48.9277874Z  2025-03-14T05:48:48.9278277Z  2025-03-14T05:48:48.9279021Z  2025-03-14T05:48:48.9279478Z  2025-03-14T05:48:48.9280006Z  2025-03-14T05:48:48.9280584Z [14,145 / 15,235] 48 actions, 47 running 2025-03-14T05:48:48.9281341Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T05:48:48.9282229Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2025-03-14T05:48:48.9283294Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T05:48:48.9284230Z @llvm-project//llvm:CodeGen; 23s local 2025-03-14T05:48:48.9285175Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T05:48:48.9286104Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2025-03-14T05:48:48.9287097Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 14s local 2025-03-14T05:48:48.9288042Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 14s local ... 2025-03-14T05:48:49.1631005Z 2025-03-14T05:48:49.1631879Z  2025-03-14T05:48:49.1632400Z  2025-03-14T05:48:49.1632829Z  2025-03-14T05:48:49.1633239Z  2025-03-14T05:48:49.1633646Z  2025-03-14T05:48:49.1634038Z  2025-03-14T05:48:49.1634428Z  2025-03-14T05:48:49.1634833Z  2025-03-14T05:48:49.1635401Z [14,146 / 15,235] 48 actions running 2025-03-14T05:48:49.1636179Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T05:48:49.1637082Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2025-03-14T05:48:49.1638138Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T05:48:49.1639047Z @llvm-project//llvm:CodeGen; 24s local 2025-03-14T05:48:49.1639813Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T05:48:49.1640731Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2025-03-14T05:48:49.1641684Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 14s local 2025-03-14T05:48:49.1642605Z Compiling llvm/lib/CodeGen/MIRPrinter.cpp; 14s local ... 2025-03-14T05:48:49.3635267Z 2025-03-14T05:48:49.3636136Z  2025-03-14T05:48:49.3636911Z  2025-03-14T05:48:49.3637342Z  2025-03-14T05:48:49.3637796Z  2025-03-14T05:48:49.3638228Z  2025-03-14T05:48:49.3638608Z  2025-03-14T05:48:49.3639027Z  2025-03-14T05:48:49.3639452Z  2025-03-14T05:48:49.3640049Z [14,148 / 15,235] 48 actions running 2025-03-14T05:48:49.3640842Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T05:48:49.3641751Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2025-03-14T05:48:49.3642850Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T05:48:49.3643781Z @llvm-project//llvm:CodeGen; 24s local 2025-03-14T05:48:49.3644529Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T05:48:49.3645636Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 18s local 2025-03-14T05:48:49.3646617Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 14s local 2025-03-14T05:48:49.3647646Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local ... 2025-03-14T05:48:49.7638625Z 2025-03-14T05:48:49.7639577Z  2025-03-14T05:48:49.7640145Z  2025-03-14T05:48:49.7640529Z  2025-03-14T05:48:49.7641020Z  2025-03-14T05:48:49.7641453Z  2025-03-14T05:48:49.7641803Z  2025-03-14T05:48:49.7642177Z  2025-03-14T05:48:49.7642539Z  2025-03-14T05:48:49.7643076Z [14,149 / 15,235] 48 actions running 2025-03-14T05:48:49.7643853Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T05:48:49.7644661Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2025-03-14T05:48:49.7645775Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T05:48:49.7646587Z @llvm-project//llvm:CodeGen; 24s local 2025-03-14T05:48:49.7647284Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T05:48:49.7648492Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2025-03-14T05:48:49.7649440Z Compiling llvm/lib/CodeGen/MIRParser/MIRParser.cpp; 15s local 2025-03-14T05:48:49.7650384Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local ... 2025-03-14T05:48:49.9642951Z 2025-03-14T05:48:49.9643973Z  2025-03-14T05:48:49.9644542Z  2025-03-14T05:48:49.9645042Z  2025-03-14T05:48:49.9645459Z  2025-03-14T05:48:49.9645868Z  2025-03-14T05:48:49.9646261Z  2025-03-14T05:48:49.9646644Z  2025-03-14T05:48:49.9647030Z  2025-03-14T05:48:49.9647595Z [14,150 / 15,235] 48 actions running 2025-03-14T05:48:49.9648385Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T05:48:49.9649297Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2025-03-14T05:48:49.9650341Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T05:48:49.9651585Z @llvm-project//llvm:CodeGen; 24s local 2025-03-14T05:48:49.9652374Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T05:48:49.9653325Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2025-03-14T05:48:49.9654312Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T05:48:49.9655305Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 13s local ... 2025-03-14T05:48:50.1656889Z 2025-03-14T05:48:50.1657826Z  2025-03-14T05:48:50.1658403Z  2025-03-14T05:48:50.1658799Z  2025-03-14T05:48:50.1659153Z  2025-03-14T05:48:50.1659530Z  2025-03-14T05:48:50.1659953Z  2025-03-14T05:48:50.1660346Z  2025-03-14T05:48:50.1660714Z  2025-03-14T05:48:50.1661315Z [14,151 / 15,235] 48 actions, 47 running 2025-03-14T05:48:50.1662090Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T05:48:50.1662991Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2025-03-14T05:48:50.1664273Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T05:48:50.1665177Z @llvm-project//llvm:CodeGen; 25s local 2025-03-14T05:48:50.1666646Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T05:48:50.1667663Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2025-03-14T05:48:50.1668631Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T05:48:50.1669624Z Compiling llvm/lib/CodeGen/MachineBlockPlacement.cpp; 13s local ... 2025-03-14T05:48:50.4525890Z 2025-03-14T05:48:50.4526886Z  2025-03-14T05:48:50.4527467Z  2025-03-14T05:48:50.4527980Z  2025-03-14T05:48:50.4528370Z  2025-03-14T05:48:50.4528748Z  2025-03-14T05:48:50.4529138Z  2025-03-14T05:48:50.4529535Z  2025-03-14T05:48:50.4529935Z  2025-03-14T05:48:50.4530547Z [14,152 / 15,235] 48 actions, 47 running 2025-03-14T05:48:50.4531239Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T05:48:50.4532101Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2025-03-14T05:48:50.4533140Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T05:48:50.4533879Z @llvm-project//llvm:CodeGen; 25s local 2025-03-14T05:48:50.4534598Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T05:48:50.4546235Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2025-03-14T05:48:50.4547239Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T05:48:50.4548212Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local ... 2025-03-14T05:48:50.6785216Z 2025-03-14T05:48:50.6786170Z  2025-03-14T05:48:50.6786766Z  2025-03-14T05:48:50.6787176Z  2025-03-14T05:48:50.6787586Z  2025-03-14T05:48:50.6787913Z  2025-03-14T05:48:50.6788266Z  2025-03-14T05:48:50.6788670Z  2025-03-14T05:48:50.6789109Z  2025-03-14T05:48:50.6789732Z [14,155 / 15,235] 48 actions, 47 running 2025-03-14T05:48:50.6790851Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T05:48:50.6791902Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T05:48:50.6792850Z @llvm-project//llvm:CodeGen; 25s local 2025-03-14T05:48:50.6793592Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T05:48:50.6794501Z Compiling llvm/lib/Target/X86/X86TargetMachine.cpp; 19s local 2025-03-14T05:48:50.6795564Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T05:48:50.6796470Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2025-03-14T05:48:50.6797341Z @llvm-project//mlir:ControlFlowDialect; 12s local ... 2025-03-14T05:48:50.9652551Z 2025-03-14T05:48:50.9653363Z  2025-03-14T05:48:50.9653811Z  2025-03-14T05:48:50.9654195Z  2025-03-14T05:48:50.9654553Z  2025-03-14T05:48:50.9655162Z  2025-03-14T05:48:50.9655524Z  2025-03-14T05:48:50.9655885Z  2025-03-14T05:48:50.9656241Z  2025-03-14T05:48:50.9656797Z [14,156 / 15,235] 48 actions running 2025-03-14T05:48:50.9657502Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T05:48:50.9658400Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T05:48:50.9659227Z @llvm-project//llvm:CodeGen; 25s local 2025-03-14T05:48:50.9659873Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T05:48:50.9660643Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T05:48:50.9661479Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2025-03-14T05:48:50.9662440Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2025-03-14T05:48:50.9663385Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 11s local ... 2025-03-14T05:48:51.3658133Z 2025-03-14T05:48:51.3658931Z  2025-03-14T05:48:51.3659464Z  2025-03-14T05:48:51.3659899Z  2025-03-14T05:48:51.3660300Z  2025-03-14T05:48:51.3660681Z  2025-03-14T05:48:51.3661108Z  2025-03-14T05:48:51.3661527Z  2025-03-14T05:48:51.3664160Z  2025-03-14T05:48:51.3664755Z [14,158 / 15,235] 48 actions running 2025-03-14T05:48:51.3665849Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T05:48:51.3666875Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T05:48:51.3667950Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T05:48:51.3668886Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T05:48:51.3669824Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2025-03-14T05:48:51.3670889Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 12s local 2025-03-14T05:48:51.3671995Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 11s local 2025-03-14T05:48:51.3672797Z Compiling xla/pjrt/utils.cc; 11s local ... 2025-03-14T05:48:51.6657746Z 2025-03-14T05:48:51.6658587Z  2025-03-14T05:48:51.6659057Z  2025-03-14T05:48:51.6659497Z  2025-03-14T05:48:51.6659894Z  2025-03-14T05:48:51.6660304Z  2025-03-14T05:48:51.6660692Z  2025-03-14T05:48:51.6661094Z  2025-03-14T05:48:51.6661490Z  2025-03-14T05:48:51.6662081Z [14,160 / 15,235] 48 actions, 47 running 2025-03-14T05:48:51.6662866Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T05:48:51.6663833Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T05:48:51.6664827Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T05:48:51.6665987Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T05:48:51.6666913Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2025-03-14T05:48:51.6667961Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2025-03-14T05:48:51.6669017Z Compiling llvm/lib/CodeGen/MachineFunction.cpp; 11s local 2025-03-14T05:48:51.6670161Z Compiling xla/pjrt/utils.cc; 11s local ... 2025-03-14T05:48:51.8804302Z 2025-03-14T05:48:51.8805282Z  2025-03-14T05:48:51.8805792Z  2025-03-14T05:48:51.8806119Z  2025-03-14T05:48:51.8806540Z  2025-03-14T05:48:51.8806927Z  2025-03-14T05:48:51.8807328Z  2025-03-14T05:48:51.8807711Z  2025-03-14T05:48:51.8808110Z  2025-03-14T05:48:51.8808727Z [14,162 / 15,235] 48 actions, 47 running 2025-03-14T05:48:51.8809525Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T05:48:51.8810511Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T05:48:51.8811566Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T05:48:51.8812428Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T05:48:51.8813399Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2025-03-14T05:48:51.8814743Z Compiling mlir/lib/Dialect/ControlFlow/IR/ControlFlowOps.cpp; 13s local 2025-03-14T05:48:51.8815720Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T05:48:51.8816524Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local ... 2025-03-14T05:48:52.1107242Z 2025-03-14T05:48:52.1108111Z  2025-03-14T05:48:52.1108638Z  2025-03-14T05:48:52.1109025Z  2025-03-14T05:48:52.1109443Z  2025-03-14T05:48:52.1109844Z  2025-03-14T05:48:52.1110198Z  2025-03-14T05:48:52.1110595Z  2025-03-14T05:48:52.1110973Z  2025-03-14T05:48:52.1111585Z [14,166 / 15,235] 48 actions, 47 running 2025-03-14T05:48:52.1112400Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T05:48:52.1113456Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T05:48:52.1114448Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T05:48:52.1115329Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T05:48:52.1116365Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2025-03-14T05:48:52.1117219Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T05:48:52.1118212Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T05:48:52.1119087Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 11s local ... 2025-03-14T05:48:52.3665579Z 2025-03-14T05:48:52.3666374Z  2025-03-14T05:48:52.3666811Z  2025-03-14T05:48:52.3667194Z  2025-03-14T05:48:52.3667593Z  2025-03-14T05:48:52.3667989Z  2025-03-14T05:48:52.3668361Z  2025-03-14T05:48:52.3668721Z  2025-03-14T05:48:52.3669093Z  2025-03-14T05:48:52.3669611Z [14,169 / 15,235] 48 actions running 2025-03-14T05:48:52.3670351Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T05:48:52.3671305Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T05:48:52.3672260Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2025-03-14T05:48:52.3673094Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T05:48:52.3673978Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2025-03-14T05:48:52.3674747Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T05:48:52.3675368Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T05:48:52.3676240Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 12s local ... 2025-03-14T05:48:52.6529497Z 2025-03-14T05:48:52.6530355Z  2025-03-14T05:48:52.6530744Z  2025-03-14T05:48:52.6531063Z  2025-03-14T05:48:52.6531379Z  2025-03-14T05:48:52.6531697Z  2025-03-14T05:48:52.6532011Z  2025-03-14T05:48:52.6532325Z  2025-03-14T05:48:52.6532620Z  2025-03-14T05:48:52.6533102Z [14,171 / 15,235] 48 actions, 47 running 2025-03-14T05:48:52.6533714Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T05:48:52.6534495Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T05:48:52.6535656Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T05:48:52.6536401Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2025-03-14T05:48:52.6537029Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T05:48:52.6537572Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T05:48:52.6538236Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 12s local 2025-03-14T05:48:52.6538976Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local ... 2025-03-14T05:48:52.9671714Z 2025-03-14T05:48:52.9672535Z  2025-03-14T05:48:52.9673003Z  2025-03-14T05:48:52.9673404Z  2025-03-14T05:48:52.9673804Z  2025-03-14T05:48:52.9674305Z  2025-03-14T05:48:52.9674693Z  2025-03-14T05:48:52.9675077Z  2025-03-14T05:48:52.9675454Z  2025-03-14T05:48:52.9676021Z [14,171 / 15,235] 48 actions running 2025-03-14T05:48:52.9677141Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T05:48:52.9678093Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T05:48:52.9679371Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T05:48:52.9680377Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2025-03-14T05:48:52.9681194Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T05:48:52.9681918Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T05:48:52.9682825Z Compiling llvm/lib/Target/X86/X86ExpandPseudo.cpp; 12s local 2025-03-14T05:48:52.9683850Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local ... 2025-03-14T05:48:53.1763219Z 2025-03-14T05:48:53.1764089Z  2025-03-14T05:48:53.1764595Z  2025-03-14T05:48:53.1765168Z  2025-03-14T05:48:53.1765820Z  2025-03-14T05:48:53.1766213Z  2025-03-14T05:48:53.1766698Z  2025-03-14T05:48:53.1767217Z  2025-03-14T05:48:53.1767744Z  2025-03-14T05:48:53.1768396Z [14,172 / 15,235] 48 actions, 47 running 2025-03-14T05:48:53.1769193Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T05:48:53.1770444Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T05:48:53.1771711Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T05:48:53.1772608Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2025-03-14T05:48:53.1773402Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T05:48:53.1774083Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T05:48:53.1774939Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2025-03-14T05:48:53.1775962Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 12s local ... 2025-03-14T05:48:53.4050963Z 2025-03-14T05:48:53.4051767Z  2025-03-14T05:48:53.4052269Z  2025-03-14T05:48:53.4052678Z  2025-03-14T05:48:53.4053098Z  2025-03-14T05:48:53.4053526Z  2025-03-14T05:48:53.4053936Z  2025-03-14T05:48:53.4054345Z  2025-03-14T05:48:53.4054721Z  2025-03-14T05:48:53.4055320Z [14,173 / 15,235] 48 actions, 47 running 2025-03-14T05:48:53.4056098Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T05:48:53.4057046Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T05:48:53.4058037Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T05:48:53.4058933Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2025-03-14T05:48:53.4059714Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T05:48:53.4060399Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T05:48:53.4061207Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T05:48:53.4062123Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 12s local ... 2025-03-14T05:48:53.7678194Z 2025-03-14T05:48:53.7679039Z  2025-03-14T05:48:53.7679556Z  2025-03-14T05:48:53.7679943Z  2025-03-14T05:48:53.7680385Z  2025-03-14T05:48:53.7680879Z  2025-03-14T05:48:53.7681794Z  2025-03-14T05:48:53.7682233Z  2025-03-14T05:48:53.7682604Z  2025-03-14T05:48:53.7683180Z [14,175 / 15,235] 48 actions, 47 running 2025-03-14T05:48:53.7684054Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T05:48:53.7685236Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T05:48:53.7686281Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T05:48:53.7687332Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2025-03-14T05:48:53.7688248Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T05:48:53.7688959Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T05:48:53.7689739Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T05:48:53.7690629Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 13s local ... 2025-03-14T05:48:53.9682400Z 2025-03-14T05:48:53.9683253Z  2025-03-14T05:48:53.9683725Z  2025-03-14T05:48:53.9684175Z  2025-03-14T05:48:53.9684592Z  2025-03-14T05:48:53.9685151Z  2025-03-14T05:48:53.9685558Z  2025-03-14T05:48:53.9685963Z  2025-03-14T05:48:53.9686366Z  2025-03-14T05:48:53.9686948Z [14,175 / 15,235] 48 actions running 2025-03-14T05:48:53.9687709Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T05:48:53.9688737Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T05:48:53.9689822Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T05:48:53.9690785Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2025-03-14T05:48:53.9691585Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T05:48:53.9692308Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T05:48:53.9693151Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T05:48:53.9694081Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 13s local ... 2025-03-14T05:48:54.2049433Z 2025-03-14T05:48:54.2050234Z  2025-03-14T05:48:54.2051036Z  2025-03-14T05:48:54.2051430Z  2025-03-14T05:48:54.2051821Z  2025-03-14T05:48:54.2052213Z  2025-03-14T05:48:54.2052600Z  2025-03-14T05:48:54.2052966Z  2025-03-14T05:48:54.2053358Z  2025-03-14T05:48:54.2054026Z [14,177 / 15,235] 48 actions, 47 running 2025-03-14T05:48:54.2054840Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T05:48:54.2055741Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T05:48:54.2056659Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T05:48:54.2057553Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2025-03-14T05:48:54.2058328Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T05:48:54.2059015Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T05:48:54.2059780Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T05:48:54.2060659Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 13s local ... 2025-03-14T05:48:54.5688014Z 2025-03-14T05:48:54.5688812Z  2025-03-14T05:48:54.5689288Z  2025-03-14T05:48:54.5689669Z  2025-03-14T05:48:54.5690041Z  2025-03-14T05:48:54.5690434Z  2025-03-14T05:48:54.5690804Z  2025-03-14T05:48:54.5691182Z  2025-03-14T05:48:54.5691568Z  2025-03-14T05:48:54.5692103Z [14,178 / 15,235] 48 actions running 2025-03-14T05:48:54.5692868Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2025-03-14T05:48:54.5693818Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T05:48:54.5694827Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T05:48:54.5695632Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T05:48:54.5696387Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T05:48:54.5697550Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T05:48:54.5698427Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 14s local 2025-03-14T05:48:54.5699306Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 10s local ... 2025-03-14T05:48:54.9629962Z 2025-03-14T05:48:54.9630789Z  2025-03-14T05:48:54.9631203Z  2025-03-14T05:48:54.9631578Z  2025-03-14T05:48:54.9631940Z  2025-03-14T05:48:54.9632340Z  2025-03-14T05:48:54.9632699Z  2025-03-14T05:48:54.9633046Z  2025-03-14T05:48:54.9633398Z  2025-03-14T05:48:54.9633913Z [14,180 / 15,235] 48 actions, 47 running 2025-03-14T05:48:54.9634597Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2025-03-14T05:48:54.9635486Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T05:48:54.9636461Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T05:48:54.9637471Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T05:48:54.9638157Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T05:48:54.9638910Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T05:48:54.9639751Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 14s local 2025-03-14T05:48:54.9640973Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 11s local ... 2025-03-14T05:48:55.1691872Z 2025-03-14T05:48:55.1692701Z  2025-03-14T05:48:55.1693138Z  2025-03-14T05:48:55.1693496Z  2025-03-14T05:48:55.1693868Z  2025-03-14T05:48:55.1694223Z  2025-03-14T05:48:55.1694569Z  2025-03-14T05:48:55.1694905Z  2025-03-14T05:48:55.1695260Z  2025-03-14T05:48:55.1695778Z [14,180 / 15,235] 48 actions running 2025-03-14T05:48:55.1696477Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2025-03-14T05:48:55.1697318Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T05:48:55.1698273Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T05:48:55.1698971Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T05:48:55.1699870Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T05:48:55.1700613Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T05:48:55.1701380Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 14s local 2025-03-14T05:48:55.1702187Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 11s local ... 2025-03-14T05:48:55.5696196Z 2025-03-14T05:48:55.5696951Z  2025-03-14T05:48:55.5697375Z  2025-03-14T05:48:55.5697767Z  2025-03-14T05:48:55.5698125Z  2025-03-14T05:48:55.5698510Z  2025-03-14T05:48:55.5698906Z  2025-03-14T05:48:55.5699290Z  2025-03-14T05:48:55.5699673Z  2025-03-14T05:48:55.5700264Z [14,181 / 15,235] 48 actions running 2025-03-14T05:48:55.5701167Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T05:48:55.5702369Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T05:48:55.5703335Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T05:48:55.5704084Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T05:48:55.5704875Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T05:48:55.5705739Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2025-03-14T05:48:55.5706563Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 11s local 2025-03-14T05:48:55.5707475Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 11s local ... 2025-03-14T05:48:55.7701432Z 2025-03-14T05:48:55.7702427Z  2025-03-14T05:48:55.7702894Z  2025-03-14T05:48:55.7703305Z  2025-03-14T05:48:55.7703692Z  2025-03-14T05:48:55.7704719Z  2025-03-14T05:48:55.7705100Z  2025-03-14T05:48:55.7705500Z  2025-03-14T05:48:55.7705902Z  2025-03-14T05:48:55.7706481Z [14,182 / 15,235] 48 actions running 2025-03-14T05:48:55.7707429Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T05:48:55.7708944Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T05:48:55.7709824Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T05:48:55.7710532Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T05:48:55.7711414Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T05:48:55.7712308Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2025-03-14T05:48:55.7713181Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 11s local 2025-03-14T05:48:55.7714179Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 11s local ... 2025-03-14T05:48:56.0638943Z 2025-03-14T05:48:56.0639744Z  2025-03-14T05:48:56.0640207Z  2025-03-14T05:48:56.0640601Z  2025-03-14T05:48:56.0640989Z  2025-03-14T05:48:56.0641394Z  2025-03-14T05:48:56.0641744Z  2025-03-14T05:48:56.0642447Z  2025-03-14T05:48:56.0642833Z  2025-03-14T05:48:56.0643473Z [14,183 / 15,235] 48 actions, 47 running 2025-03-14T05:48:56.0644392Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T05:48:56.0645720Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T05:48:56.0646553Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T05:48:56.0647327Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T05:48:56.0648186Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2025-03-14T05:48:56.0649002Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local 2025-03-14T05:48:56.0649925Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 11s local 2025-03-14T05:48:56.0650872Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 10s local ... 2025-03-14T05:48:56.2772970Z 2025-03-14T05:48:56.2773934Z  2025-03-14T05:48:56.2774413Z  2025-03-14T05:48:56.2774881Z  2025-03-14T05:48:56.2775305Z  2025-03-14T05:48:56.2776281Z  2025-03-14T05:48:56.2776698Z  2025-03-14T05:48:56.2777103Z  2025-03-14T05:48:56.2777528Z  2025-03-14T05:48:56.2778411Z [14,184 / 15,235] 48 actions, 47 running 2025-03-14T05:48:56.2779460Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T05:48:56.2780553Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T05:48:56.2781338Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T05:48:56.2782049Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T05:48:56.2782900Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 15s local 2025-03-14T05:48:56.2783833Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local 2025-03-14T05:48:56.2784784Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 11s local 2025-03-14T05:48:56.2785772Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 10s local ... 2025-03-14T05:48:56.5707015Z 2025-03-14T05:48:56.5707780Z  2025-03-14T05:48:56.5708249Z  2025-03-14T05:48:56.5708664Z  2025-03-14T05:48:56.5709117Z  2025-03-14T05:48:56.5709850Z  2025-03-14T05:48:56.5710408Z  2025-03-14T05:48:56.5710939Z  2025-03-14T05:48:56.5711471Z  2025-03-14T05:48:56.5712187Z [14,185 / 15,235] 48 actions running 2025-03-14T05:48:56.5713264Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T05:48:56.5714488Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T05:48:56.5715440Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T05:48:56.5716349Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T05:48:56.5717407Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2025-03-14T05:48:56.5718423Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local 2025-03-14T05:48:56.5719468Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2025-03-14T05:48:56.5720510Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 10s local ... 2025-03-14T05:48:56.7712239Z 2025-03-14T05:48:56.7713641Z  2025-03-14T05:48:56.7714332Z  2025-03-14T05:48:56.7714756Z  2025-03-14T05:48:56.7715167Z  2025-03-14T05:48:56.7715554Z  2025-03-14T05:48:56.7715956Z  2025-03-14T05:48:56.7716339Z  2025-03-14T05:48:56.7716699Z  2025-03-14T05:48:56.7717253Z [14,187 / 15,235] 48 actions running 2025-03-14T05:48:56.7718113Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T05:48:56.7719113Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T05:48:56.7719846Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T05:48:56.7720588Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T05:48:56.7721424Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2025-03-14T05:48:56.7722266Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 12s local 2025-03-14T05:48:56.7723392Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2025-03-14T05:48:56.7724377Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 10s local ... 2025-03-14T05:48:57.0142008Z 2025-03-14T05:48:57.0142970Z  2025-03-14T05:48:57.0144801Z  2025-03-14T05:48:57.0145319Z  2025-03-14T05:48:57.0145751Z  2025-03-14T05:48:57.0146173Z  2025-03-14T05:48:57.0146567Z  2025-03-14T05:48:57.0147090Z  2025-03-14T05:48:57.0147536Z  2025-03-14T05:48:57.0148160Z [14,191 / 15,235] 48 actions, 47 running 2025-03-14T05:48:57.0149134Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T05:48:57.0150351Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T05:48:57.0151260Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T05:48:57.0152144Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T05:48:57.0153056Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2025-03-14T05:48:57.0154050Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local 2025-03-14T05:48:57.0155060Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2025-03-14T05:48:57.0156449Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 11s local ... 2025-03-14T05:48:57.2363600Z 2025-03-14T05:48:57.2364465Z  2025-03-14T05:48:57.2365058Z  2025-03-14T05:48:57.2365670Z  2025-03-14T05:48:57.2366083Z  2025-03-14T05:48:57.2366488Z  2025-03-14T05:48:57.2366880Z  2025-03-14T05:48:57.2367285Z  2025-03-14T05:48:57.2367676Z  2025-03-14T05:48:57.2368286Z [14,192 / 15,235] 48 actions, 47 running 2025-03-14T05:48:57.2369248Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T05:48:57.2370317Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T05:48:57.2371106Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T05:48:57.2372394Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T05:48:57.2373303Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2025-03-14T05:48:57.2374291Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local 2025-03-14T05:48:57.2375301Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 12s local 2025-03-14T05:48:57.2376347Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 11s local ... 2025-03-14T05:48:57.4729867Z 2025-03-14T05:48:57.4730844Z  2025-03-14T05:48:57.4731297Z  2025-03-14T05:48:57.4731727Z  2025-03-14T05:48:57.4732092Z  2025-03-14T05:48:57.4732482Z  2025-03-14T05:48:57.4732833Z  2025-03-14T05:48:57.4733171Z  2025-03-14T05:48:57.4733528Z  2025-03-14T05:48:57.4734085Z [14,196 / 15,235] 48 actions, 47 running 2025-03-14T05:48:57.4734949Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T05:48:57.4735935Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T05:48:57.4736695Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T05:48:57.4737752Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T05:48:57.4738584Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 16s local 2025-03-14T05:48:57.4739366Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local 2025-03-14T05:48:57.4740190Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 13s local 2025-03-14T05:48:57.4741041Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 11s local ... 2025-03-14T05:48:57.7083416Z 2025-03-14T05:48:57.7084288Z  2025-03-14T05:48:57.7084975Z  2025-03-14T05:48:57.7085422Z  2025-03-14T05:48:57.7085824Z  2025-03-14T05:48:57.7086261Z  2025-03-14T05:48:57.7086656Z  2025-03-14T05:48:57.7087066Z  2025-03-14T05:48:57.7087483Z  2025-03-14T05:48:57.7088113Z [14,198 / 15,235] 48 actions, 47 running 2025-03-14T05:48:57.7089186Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T05:48:57.7090503Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T05:48:57.7091332Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T05:48:57.7092134Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T05:48:57.7093037Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2025-03-14T05:48:57.7093921Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 13s local 2025-03-14T05:48:57.7094868Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 13s local 2025-03-14T05:48:57.7095799Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 11s local ... 2025-03-14T05:48:57.9723241Z 2025-03-14T05:48:57.9724070Z  2025-03-14T05:48:57.9724535Z  2025-03-14T05:48:57.9725091Z  2025-03-14T05:48:57.9725526Z  2025-03-14T05:48:57.9725966Z  2025-03-14T05:48:57.9726362Z  2025-03-14T05:48:57.9726771Z  2025-03-14T05:48:57.9727194Z  2025-03-14T05:48:57.9727819Z [14,198 / 15,235] 48 actions running 2025-03-14T05:48:57.9728821Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T05:48:57.9729967Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T05:48:57.9731126Z Compiling xla/pjrt/utils.cc; 18s local 2025-03-14T05:48:57.9731945Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T05:48:57.9732863Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2025-03-14T05:48:57.9733786Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2025-03-14T05:48:57.9734776Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 13s local 2025-03-14T05:48:57.9735814Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 12s local ... 2025-03-14T05:48:58.1945606Z 2025-03-14T05:48:58.1946411Z  2025-03-14T05:48:58.1946880Z  2025-03-14T05:48:58.1947258Z  2025-03-14T05:48:58.1947656Z  2025-03-14T05:48:58.1948091Z  2025-03-14T05:48:58.1948524Z  2025-03-14T05:48:58.1948877Z  2025-03-14T05:48:58.1949258Z  2025-03-14T05:48:58.1949871Z [14,199 / 15,235] 48 actions, 47 running 2025-03-14T05:48:58.1950866Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T05:48:58.1951753Z Compiling xla/pjrt/utils.cc; 18s local 2025-03-14T05:48:58.1952493Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T05:48:58.1953352Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2025-03-14T05:48:58.1954366Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2025-03-14T05:48:58.1955269Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 13s local 2025-03-14T05:48:58.1956171Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 12s local 2025-03-14T05:48:58.1957037Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 12s local ... 2025-03-14T05:48:58.4795588Z 2025-03-14T05:48:58.4796447Z  2025-03-14T05:48:58.4797071Z  2025-03-14T05:48:58.4797534Z  2025-03-14T05:48:58.4797941Z  2025-03-14T05:48:58.4798375Z  2025-03-14T05:48:58.4798781Z  2025-03-14T05:48:58.4799521Z  2025-03-14T05:48:58.4799969Z  2025-03-14T05:48:58.4800625Z [14,200 / 15,235] 48 actions, 47 running 2025-03-14T05:48:58.4801631Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T05:48:58.4802599Z Compiling xla/pjrt/utils.cc; 18s local 2025-03-14T05:48:58.4803389Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T05:48:58.4804334Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 17s local 2025-03-14T05:48:58.4805391Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2025-03-14T05:48:58.4806330Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local 2025-03-14T05:48:58.4807320Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 12s local 2025-03-14T05:48:58.4808243Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 12s local ... 2025-03-14T05:48:58.7578054Z 2025-03-14T05:48:58.7578927Z  2025-03-14T05:48:58.7579411Z  2025-03-14T05:48:58.7579803Z  2025-03-14T05:48:58.7580210Z  2025-03-14T05:48:58.7580614Z  2025-03-14T05:48:58.7580998Z  2025-03-14T05:48:58.7581345Z  2025-03-14T05:48:58.7581730Z  2025-03-14T05:48:58.7582307Z [14,202 / 15,235] 48 actions, 47 running 2025-03-14T05:48:58.7583194Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T05:48:58.7584310Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T05:48:58.7585215Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2025-03-14T05:48:58.7586082Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 14s local 2025-03-14T05:48:58.7587039Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local 2025-03-14T05:48:58.7588025Z Compiling llvm/lib/CodeGen/MachineScheduler.cpp; 12s local 2025-03-14T05:48:58.7588932Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 12s local 2025-03-14T05:48:58.7589899Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 11s local ... 2025-03-14T05:48:58.9731760Z 2025-03-14T05:48:58.9732571Z  2025-03-14T05:48:58.9733307Z  2025-03-14T05:48:58.9733695Z  2025-03-14T05:48:58.9734071Z  2025-03-14T05:48:58.9734479Z  2025-03-14T05:48:58.9734857Z  2025-03-14T05:48:58.9735244Z  2025-03-14T05:48:58.9735656Z  2025-03-14T05:48:58.9736265Z [14,204 / 15,235] 48 actions running 2025-03-14T05:48:58.9737199Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T05:48:58.9738280Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T05:48:58.9739222Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2025-03-14T05:48:58.9740115Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local 2025-03-14T05:48:58.9741021Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local 2025-03-14T05:48:58.9742050Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 12s local 2025-03-14T05:48:58.9742973Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T05:48:58.9743985Z Compiling llvm/lib/Target/X86/X86FastPreTileConfig.cpp; 11s local ... 2025-03-14T05:48:59.1737474Z 2025-03-14T05:48:59.1738300Z  2025-03-14T05:48:59.1738768Z  2025-03-14T05:48:59.1739184Z  2025-03-14T05:48:59.1739584Z  2025-03-14T05:48:59.1739984Z  2025-03-14T05:48:59.1740401Z  2025-03-14T05:48:59.1740796Z  2025-03-14T05:48:59.1741179Z  2025-03-14T05:48:59.1741736Z [14,205 / 15,235] 48 actions running 2025-03-14T05:48:59.1742697Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T05:48:59.1743800Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T05:48:59.1744692Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2025-03-14T05:48:59.1745587Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local 2025-03-14T05:48:59.1746555Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 14s local 2025-03-14T05:48:59.1747911Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 13s local 2025-03-14T05:48:59.1748800Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T05:48:59.1749955Z Compiling llvm/lib/Target/X86/X86FastPreTileConfig.cpp; 11s local ... 2025-03-14T05:48:59.4342777Z 2025-03-14T05:48:59.4343631Z  2025-03-14T05:48:59.4344120Z  2025-03-14T05:48:59.4344535Z  2025-03-14T05:48:59.4344892Z  2025-03-14T05:48:59.4345241Z  2025-03-14T05:48:59.4345581Z  2025-03-14T05:48:59.4345921Z  2025-03-14T05:48:59.4346265Z  2025-03-14T05:48:59.4346780Z [14,207 / 15,235] 48 actions, 47 running 2025-03-14T05:48:59.4347576Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T05:48:59.4348467Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T05:48:59.4349458Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 18s local 2025-03-14T05:48:59.4350207Z Compiling llvm/lib/CodeGen/MachineOutliner.cpp; 15s local 2025-03-14T05:48:59.4350951Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2025-03-14T05:48:59.4351667Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 13s local 2025-03-14T05:48:59.4352353Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T05:48:59.4353100Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 12s local ... 2025-03-14T05:48:59.7072465Z 2025-03-14T05:48:59.7073332Z  2025-03-14T05:48:59.7073834Z  2025-03-14T05:48:59.7074268Z  2025-03-14T05:48:59.7074684Z  2025-03-14T05:48:59.7075077Z  2025-03-14T05:48:59.7075476Z  2025-03-14T05:48:59.7075870Z  2025-03-14T05:48:59.7076269Z  2025-03-14T05:48:59.7076862Z [14,209 / 15,235] 48 actions, 47 running 2025-03-14T05:48:59.7077807Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T05:48:59.7078868Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T05:48:59.7079769Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2025-03-14T05:48:59.7080944Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2025-03-14T05:48:59.7081800Z Compiling llvm/lib/CodeGen/MachineSink.cpp; 13s local 2025-03-14T05:48:59.7082650Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T05:48:59.7083536Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 12s local 2025-03-14T05:48:59.7084471Z Compiling llvm/lib/CodeGen/ModuloSchedule.cpp; 11s local ... 2025-03-14T05:48:59.9744560Z 2025-03-14T05:48:59.9745413Z  2025-03-14T05:48:59.9745902Z  2025-03-14T05:48:59.9746307Z  2025-03-14T05:48:59.9746712Z  2025-03-14T05:48:59.9747049Z  2025-03-14T05:48:59.9747377Z  2025-03-14T05:48:59.9747767Z  2025-03-14T05:48:59.9748160Z  2025-03-14T05:48:59.9748724Z [14,210 / 15,235] 48 actions running 2025-03-14T05:48:59.9749692Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T05:48:59.9750753Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T05:48:59.9751661Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2025-03-14T05:48:59.9752519Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2025-03-14T05:48:59.9753373Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T05:48:59.9754268Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 12s local 2025-03-14T05:48:59.9755195Z Compiling llvm/lib/CodeGen/ModuloSchedule.cpp; 12s local 2025-03-14T05:48:59.9756350Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 9s local ... 2025-03-14T05:49:00.1922179Z 2025-03-14T05:49:00.1923012Z  2025-03-14T05:49:00.1923484Z  2025-03-14T05:49:00.1923852Z  2025-03-14T05:49:00.1924243Z  2025-03-14T05:49:00.1924793Z  2025-03-14T05:49:00.1925193Z  2025-03-14T05:49:00.1925544Z  2025-03-14T05:49:00.1925907Z  2025-03-14T05:49:00.1926895Z [14,212 / 15,235] 48 actions, 47 running 2025-03-14T05:49:00.1927868Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T05:49:00.1928960Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T05:49:00.1929915Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 19s local 2025-03-14T05:49:00.1930826Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 15s local 2025-03-14T05:49:00.1931757Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T05:49:00.1932688Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 12s local 2025-03-14T05:49:00.1933621Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 10s local 2025-03-14T05:49:00.1934549Z Compiling llvm/lib/CodeGen/RDFGraph.cpp; 9s local ... 2025-03-14T05:49:00.5750924Z 2025-03-14T05:49:00.5751767Z  2025-03-14T05:49:00.5752216Z  2025-03-14T05:49:00.5752824Z  2025-03-14T05:49:00.5753207Z  2025-03-14T05:49:00.5753584Z  2025-03-14T05:49:00.5753970Z  2025-03-14T05:49:00.5754373Z  2025-03-14T05:49:00.5754749Z  2025-03-14T05:49:00.5755272Z [14,215 / 15,235] 48 actions running 2025-03-14T05:49:00.5756098Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2025-03-14T05:49:00.5757017Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T05:49:00.5757784Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2025-03-14T05:49:00.5758566Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2025-03-14T05:49:00.5759410Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T05:49:00.5760227Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local 2025-03-14T05:49:00.5761073Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 10s local 2025-03-14T05:49:00.5761959Z Compiling llvm/lib/CodeGen/RDFLiveness.cpp; 9s local ... 2025-03-14T05:49:00.9164147Z 2025-03-14T05:49:00.9164979Z  2025-03-14T05:49:00.9165472Z  2025-03-14T05:49:00.9165917Z  2025-03-14T05:49:00.9166290Z  2025-03-14T05:49:00.9166959Z  2025-03-14T05:49:00.9167364Z  2025-03-14T05:49:00.9167753Z  2025-03-14T05:49:00.9168225Z  2025-03-14T05:49:00.9168907Z [14,216 / 15,235] 48 actions, 47 running 2025-03-14T05:49:00.9169890Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2025-03-14T05:49:00.9171010Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T05:49:00.9171915Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2025-03-14T05:49:00.9172825Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2025-03-14T05:49:00.9173870Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T05:49:00.9174790Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local 2025-03-14T05:49:00.9175823Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 10s local 2025-03-14T05:49:00.9176795Z Compiling llvm/lib/CodeGen/RDFLiveness.cpp; 10s local ... 2025-03-14T05:49:01.1757261Z 2025-03-14T05:49:01.1758152Z  2025-03-14T05:49:01.1758648Z  2025-03-14T05:49:01.1759016Z  2025-03-14T05:49:01.1759340Z  2025-03-14T05:49:01.1759755Z  2025-03-14T05:49:01.1760186Z  2025-03-14T05:49:01.1760626Z  2025-03-14T05:49:01.1761058Z  2025-03-14T05:49:01.1761665Z [14,219 / 15,235] 48 actions running 2025-03-14T05:49:01.1762738Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2025-03-14T05:49:01.1763771Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T05:49:01.1764783Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 20s local 2025-03-14T05:49:01.1765874Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2025-03-14T05:49:01.1766781Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T05:49:01.1767701Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 13s local 2025-03-14T05:49:01.1769045Z Compiling llvm/lib/CodeGen/PrologEpilogInserter.cpp; 11s local 2025-03-14T05:49:01.1770055Z Compiling llvm/lib/Target/X86/X86Subtarget.cpp; 10s local ... 2025-03-14T05:49:01.5236534Z 2025-03-14T05:49:01.5237408Z  2025-03-14T05:49:01.5237995Z  2025-03-14T05:49:01.5238407Z  2025-03-14T05:49:01.5238807Z  2025-03-14T05:49:01.5239205Z  2025-03-14T05:49:01.5239613Z  2025-03-14T05:49:01.5240029Z  2025-03-14T05:49:01.5240442Z  2025-03-14T05:49:01.5241061Z [14,220 / 15,235] 48 actions, 47 running 2025-03-14T05:49:01.5242043Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 39s local 2025-03-14T05:49:01.5243125Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T05:49:01.5244047Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2025-03-14T05:49:01.5245502Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2025-03-14T05:49:01.5246467Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T05:49:01.5247433Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 14s local 2025-03-14T05:49:01.5248397Z Compiling llvm/lib/Target/X86/X86Subtarget.cpp; 10s local 2025-03-14T05:49:01.5249355Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 9s local ... 2025-03-14T05:49:01.7763364Z 2025-03-14T05:49:01.7764212Z  2025-03-14T05:49:01.7764877Z  2025-03-14T05:49:01.7765715Z  2025-03-14T05:49:01.7766163Z  2025-03-14T05:49:01.7766593Z  2025-03-14T05:49:01.7767011Z  2025-03-14T05:49:01.7767447Z  2025-03-14T05:49:01.7767874Z  2025-03-14T05:49:01.7768460Z [14,222 / 15,235] 48 actions running 2025-03-14T05:49:01.7769334Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T05:49:01.7770281Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 21s local 2025-03-14T05:49:01.7771251Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2025-03-14T05:49:01.7772163Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T05:49:01.7773113Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 14s local 2025-03-14T05:49:01.7774359Z Compiling llvm/lib/Target/X86/X86Subtarget.cpp; 10s local 2025-03-14T05:49:01.7775254Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 9s local 2025-03-14T05:49:01.7776175Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 9s local ... 2025-03-14T05:49:02.6707585Z 2025-03-14T05:49:02.6708929Z  2025-03-14T05:49:02.6709906Z  2025-03-14T05:49:02.6710823Z  2025-03-14T05:49:02.6711670Z  2025-03-14T05:49:02.6712518Z  2025-03-14T05:49:02.6713368Z  2025-03-14T05:49:02.6714329Z  2025-03-14T05:49:02.6715162Z  2025-03-14T05:49:02.6715998Z [14,223 / 15,235] 48 actions, 47 running 2025-03-14T05:49:02.6716858Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T05:49:02.6717784Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 22s local 2025-03-14T05:49:02.6718669Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2025-03-14T05:49:02.6719565Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T05:49:02.6720415Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2025-03-14T05:49:02.6721280Z Compiling llvm/lib/Target/X86/X86Subtarget.cpp; 11s local 2025-03-14T05:49:02.6722120Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 10s local 2025-03-14T05:49:02.9644115Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 10s local ... 2025-03-14T05:49:02.9644909Z 2025-03-14T05:49:02.9645429Z  2025-03-14T05:49:02.9645885Z  2025-03-14T05:49:02.9656875Z  2025-03-14T05:49:02.9657364Z  2025-03-14T05:49:02.9657739Z  2025-03-14T05:49:02.9658126Z  2025-03-14T05:49:02.9658484Z  2025-03-14T05:49:02.9658871Z  2025-03-14T05:49:02.9659425Z [14,227 / 15,235] 48 actions, 47 running 2025-03-14T05:49:02.9660265Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T05:49:02.9663579Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 22s local 2025-03-14T05:49:02.9664691Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2025-03-14T05:49:02.9665928Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T05:49:02.9666747Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2025-03-14T05:49:02.9667611Z Compiling llvm/lib/Target/X86/X86Subtarget.cpp; 12s local 2025-03-14T05:49:02.9668470Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 10s local 2025-03-14T05:49:02.9669358Z Compiling llvm/lib/CodeGen/RegAllocPBQP.cpp; 10s local ... 2025-03-14T05:49:03.1775074Z 2025-03-14T05:49:03.1775904Z  2025-03-14T05:49:03.1776464Z  2025-03-14T05:49:03.1776931Z  2025-03-14T05:49:03.1777390Z  2025-03-14T05:49:03.1777837Z  2025-03-14T05:49:03.1778283Z  2025-03-14T05:49:03.1778918Z  2025-03-14T05:49:03.1779291Z  2025-03-14T05:49:03.1779898Z [14,228 / 15,235] 48 actions running 2025-03-14T05:49:03.1780735Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T05:49:03.1781600Z Compiling llvm/lib/Target/X86/X86FastISel.cpp; 22s local 2025-03-14T05:49:03.1782635Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2025-03-14T05:49:03.1783543Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T05:49:03.1784538Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 15s local 2025-03-14T05:49:03.1785353Z Compiling llvm/lib/Target/X86/X86Subtarget.cpp; 12s local 2025-03-14T05:49:03.1786178Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 11s local 2025-03-14T05:49:03.1787124Z Compiling llvm/lib/Target/X86/X86FastTileConfig.cpp; 10s local ... 2025-03-14T05:49:03.5775734Z 2025-03-14T05:49:03.5777455Z  2025-03-14T05:49:03.5778400Z  2025-03-14T05:49:03.5779317Z  2025-03-14T05:49:03.5780163Z  2025-03-14T05:49:03.5780992Z  2025-03-14T05:49:03.5781808Z  2025-03-14T05:49:03.5782682Z  2025-03-14T05:49:03.5783522Z  2025-03-14T05:49:03.5785052Z [14,231 / 15,235] 48 actions running 2025-03-14T05:49:03.5786268Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T05:49:03.5787671Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2025-03-14T05:49:03.5789059Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T05:49:03.5790437Z Compiling llvm/lib/CodeGen/MachineVerifier.cpp; 16s local 2025-03-14T05:49:03.5791775Z Compiling llvm/lib/Target/X86/X86Subtarget.cpp; 12s local 2025-03-14T05:49:03.5793116Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 11s local 2025-03-14T05:49:03.5794505Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 9s local 2025-03-14T05:49:03.5796277Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 8s local ... 2025-03-14T05:49:03.7960072Z 2025-03-14T05:49:03.7961725Z  2025-03-14T05:49:03.7962521Z  2025-03-14T05:49:03.7963347Z  2025-03-14T05:49:03.7964272Z  2025-03-14T05:49:03.7965175Z  2025-03-14T05:49:03.7966050Z  2025-03-14T05:49:03.7966441Z  2025-03-14T05:49:03.7966880Z  2025-03-14T05:49:03.7967529Z [14,234 / 15,235] 48 actions, 47 running 2025-03-14T05:49:03.7968430Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T05:49:03.7969266Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2025-03-14T05:49:03.7970029Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T05:49:03.7970846Z Compiling llvm/lib/Target/X86/X86Subtarget.cpp; 12s local 2025-03-14T05:49:03.7971688Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 11s local 2025-03-14T05:49:03.7972529Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 9s local 2025-03-14T05:49:03.7973589Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 8s local 2025-03-14T05:49:03.7974701Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 7s local ... 2025-03-14T05:49:04.0112202Z 2025-03-14T05:49:04.0113169Z  2025-03-14T05:49:04.0113757Z  2025-03-14T05:49:04.0114208Z  2025-03-14T05:49:04.0114625Z  2025-03-14T05:49:04.0115011Z  2025-03-14T05:49:04.0115426Z  2025-03-14T05:49:04.0115950Z  2025-03-14T05:49:04.0116360Z  2025-03-14T05:49:04.0116988Z [14,236 / 15,235] 48 actions, 47 running 2025-03-14T05:49:04.0117858Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T05:49:04.0118844Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2025-03-14T05:49:04.0119774Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T05:49:04.0120686Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 11s local 2025-03-14T05:49:04.0121631Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 9s local 2025-03-14T05:49:04.0122899Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 8s local 2025-03-14T05:49:04.0124044Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 7s local 2025-03-14T05:49:04.0125174Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 7s local ... 2025-03-14T05:49:04.3783044Z 2025-03-14T05:49:04.3784071Z  2025-03-14T05:49:04.3784630Z  2025-03-14T05:49:04.3785088Z  2025-03-14T05:49:04.3785534Z  2025-03-14T05:49:04.3785969Z  2025-03-14T05:49:04.3786349Z  2025-03-14T05:49:04.3786741Z  2025-03-14T05:49:04.3787146Z  2025-03-14T05:49:04.3787731Z [14,236 / 15,235] 48 actions running 2025-03-14T05:49:04.3788511Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T05:49:04.3789387Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2025-03-14T05:49:04.3790296Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T05:49:04.3791236Z Compiling llvm/lib/CodeGen/RegAllocGreedy.cpp; 12s local 2025-03-14T05:49:04.3792130Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 10s local 2025-03-14T05:49:04.3793153Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 9s local 2025-03-14T05:49:04.3794440Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 8s local 2025-03-14T05:49:04.3795207Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 7s local ... 2025-03-14T05:49:04.6070140Z 2025-03-14T05:49:04.6070980Z  2025-03-14T05:49:04.6071534Z  2025-03-14T05:49:04.6071988Z  2025-03-14T05:49:04.6072425Z  2025-03-14T05:49:04.6072863Z  2025-03-14T05:49:04.6073231Z  2025-03-14T05:49:04.6073605Z  2025-03-14T05:49:04.6073998Z  2025-03-14T05:49:04.6074586Z [14,237 / 15,235] 48 actions, 47 running 2025-03-14T05:49:04.6075443Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T05:49:04.6076391Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2025-03-14T05:49:04.6077345Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T05:49:04.6078141Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 10s local 2025-03-14T05:49:04.6079109Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 9s local 2025-03-14T05:49:04.6080203Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 8s local 2025-03-14T05:49:04.6080893Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 7s local 2025-03-14T05:49:04.6081703Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 7s local ... 2025-03-14T05:49:04.9154929Z 2025-03-14T05:49:04.9155843Z  2025-03-14T05:49:04.9156339Z  2025-03-14T05:49:04.9156755Z  2025-03-14T05:49:04.9157180Z  2025-03-14T05:49:04.9157583Z  2025-03-14T05:49:04.9157958Z  2025-03-14T05:49:04.9158355Z  2025-03-14T05:49:04.9158763Z  2025-03-14T05:49:04.9159377Z [14,239 / 15,235] 48 actions, 47 running 2025-03-14T05:49:04.9160223Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T05:49:04.9161173Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2025-03-14T05:49:04.9162461Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T05:49:04.9163475Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 10s local 2025-03-14T05:49:04.9164345Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 9s local 2025-03-14T05:49:04.9165709Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 8s local 2025-03-14T05:49:04.9166586Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 7s local 2025-03-14T05:49:04.9167467Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 7s local ... 2025-03-14T05:49:05.1789577Z 2025-03-14T05:49:05.1790443Z  2025-03-14T05:49:05.1790988Z  2025-03-14T05:49:05.1791431Z  2025-03-14T05:49:05.1791864Z  2025-03-14T05:49:05.1792304Z  2025-03-14T05:49:05.1792688Z  2025-03-14T05:49:05.1793043Z  2025-03-14T05:49:05.1793409Z  2025-03-14T05:49:05.1794258Z [14,239 / 15,235] 48 actions running 2025-03-14T05:49:05.1795114Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T05:49:05.1796136Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2025-03-14T05:49:05.1797064Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T05:49:05.1797920Z Compiling llvm/lib/CodeGen/RegisterCoalescer.cpp; 10s local 2025-03-14T05:49:05.1798940Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 9s local 2025-03-14T05:49:05.1800025Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 9s local 2025-03-14T05:49:05.1800884Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 8s local 2025-03-14T05:49:05.1801766Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 7s local ... 2025-03-14T05:49:05.5058307Z 2025-03-14T05:49:05.5059213Z  2025-03-14T05:49:05.7796169Z  2025-03-14T05:49:05.7796688Z  2025-03-14T05:49:05.7797074Z  2025-03-14T05:49:05.7797515Z  2025-03-14T05:49:05.7797897Z  2025-03-14T05:49:05.7798280Z  2025-03-14T05:49:05.7798671Z  2025-03-14T05:49:05.7799273Z [14,240 / 15,235] 48 actions, 47 running 2025-03-14T05:49:05.7800308Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2025-03-14T05:49:05.7801214Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2025-03-14T05:49:05.7802091Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T05:49:05.7803059Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 10s local 2025-03-14T05:49:05.7804125Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 9s local 2025-03-14T05:49:05.7805144Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 8s local 2025-03-14T05:49:05.7805958Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 8s local 2025-03-14T05:49:05.7806998Z Compiling llvm/lib/CodeGen/TailDuplicator.cpp; 8s local ... 2025-03-14T05:49:05.7807555Z 2025-03-14T05:49:05.7808829Z  2025-03-14T05:49:05.7809494Z  2025-03-14T05:49:05.7810139Z  2025-03-14T05:49:05.7810677Z  2025-03-14T05:49:05.7811103Z  2025-03-14T05:49:05.7811555Z  2025-03-14T05:49:05.7811980Z  2025-03-14T05:49:05.7812386Z  2025-03-14T05:49:05.7812846Z [14,240 / 15,235] 48 actions running 2025-03-14T05:49:05.7813583Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2025-03-14T05:49:05.7814508Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2025-03-14T05:49:05.7815284Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T05:49:05.7816183Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 10s local 2025-03-14T05:49:05.7817226Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 9s local 2025-03-14T05:49:05.7818036Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 8s local 2025-03-14T05:49:05.7818834Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 8s local 2025-03-14T05:49:05.7819712Z Compiling llvm/lib/CodeGen/TailDuplicator.cpp; 8s local ... 2025-03-14T05:49:06.0345454Z 2025-03-14T05:49:06.0346403Z  2025-03-14T05:49:06.0347312Z  2025-03-14T05:49:06.0347767Z  2025-03-14T05:49:06.0348213Z  2025-03-14T05:49:06.0348571Z  2025-03-14T05:49:06.0348922Z  2025-03-14T05:49:06.0349272Z  2025-03-14T05:49:06.0349613Z  2025-03-14T05:49:06.0350154Z [14,243 / 15,235] 48 actions, 47 running 2025-03-14T05:49:06.0350908Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2025-03-14T05:49:06.0351681Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T05:49:06.0352569Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 10s local 2025-03-14T05:49:06.0353539Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 9s local 2025-03-14T05:49:06.0354315Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 9s local 2025-03-14T05:49:06.0355059Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 8s local 2025-03-14T05:49:06.0356023Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 7s local 2025-03-14T05:49:06.0356847Z Compiling llvm/lib/Target/X86/X86FixupInstTuning.cpp; 7s local ... 2025-03-14T05:49:06.3802583Z 2025-03-14T05:49:06.3803866Z  2025-03-14T05:49:06.3804383Z  2025-03-14T05:49:06.3804914Z  2025-03-14T05:49:06.3805320Z  2025-03-14T05:49:06.3805673Z  2025-03-14T05:49:06.3806030Z  2025-03-14T05:49:06.3806492Z  2025-03-14T05:49:06.3806855Z  2025-03-14T05:49:06.3807359Z [14,244 / 15,235] 48 actions running 2025-03-14T05:49:06.3808140Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T05:49:06.3808981Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T05:49:06.3809957Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 11s local 2025-03-14T05:49:06.3811020Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local 2025-03-14T05:49:06.3811879Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 9s local 2025-03-14T05:49:06.3812644Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 9s local 2025-03-14T05:49:06.3813485Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 7s local 2025-03-14T05:49:06.3814629Z Compiling llvm/lib/Target/X86/X86FixupInstTuning.cpp; 7s local ... 2025-03-14T05:49:06.7124520Z 2025-03-14T05:49:06.7125535Z  2025-03-14T05:49:06.7126054Z  2025-03-14T05:49:06.7126494Z  2025-03-14T05:49:06.7126933Z  2025-03-14T05:49:06.7127281Z  2025-03-14T05:49:06.7127615Z  2025-03-14T05:49:06.7127952Z  2025-03-14T05:49:06.7128295Z  2025-03-14T05:49:06.7128809Z [14,245 / 15,235] 48 actions, 47 running 2025-03-14T05:49:06.7129523Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T05:49:06.7130280Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T05:49:06.7131133Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 11s local 2025-03-14T05:49:06.7132091Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local 2025-03-14T05:49:06.7132864Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 9s local 2025-03-14T05:49:06.7133579Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 9s local 2025-03-14T05:49:06.7134321Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 8s local 2025-03-14T05:49:06.7135100Z Compiling llvm/lib/Target/X86/X86FixupInstTuning.cpp; 8s local ... 2025-03-14T05:49:06.9812716Z 2025-03-14T05:49:06.9813680Z  2025-03-14T05:49:06.9814256Z  2025-03-14T05:49:06.9814703Z  2025-03-14T05:49:06.9819788Z  2025-03-14T05:49:06.9820526Z  2025-03-14T05:49:06.9820928Z  2025-03-14T05:49:06.9821290Z  2025-03-14T05:49:06.9821648Z  2025-03-14T05:49:06.9822259Z [14,247 / 15,235] 48 actions running 2025-03-14T05:49:06.9823155Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T05:49:06.9824137Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T05:49:06.9825273Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 11s local 2025-03-14T05:49:06.9826676Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local 2025-03-14T05:49:06.9827678Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 10s local 2025-03-14T05:49:06.9828625Z Compiling llvm/lib/CodeGen/ScheduleDAGInstrs.cpp; 9s local 2025-03-14T05:49:06.9829604Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 8s local 2025-03-14T05:49:06.9830566Z Compiling llvm/lib/Target/X86/X86FixupInstTuning.cpp; 8s local ... 2025-03-14T05:49:07.2235949Z 2025-03-14T05:49:07.2236950Z  2025-03-14T05:49:07.2237498Z  2025-03-14T05:49:07.2237948Z  2025-03-14T05:49:07.2238390Z  2025-03-14T05:49:07.2238808Z  2025-03-14T05:49:07.2239177Z  2025-03-14T05:49:07.2239523Z  2025-03-14T05:49:07.2239882Z  2025-03-14T05:49:07.2240441Z [14,248 / 15,235] 48 actions, 47 running 2025-03-14T05:49:07.2241454Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T05:49:07.2242306Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T05:49:07.2243241Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2025-03-14T05:49:07.2244270Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local 2025-03-14T05:49:07.2245271Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 10s local 2025-03-14T05:49:07.2246038Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 8s local 2025-03-14T05:49:07.2246860Z Compiling llvm/lib/Target/X86/X86FixupInstTuning.cpp; 8s local 2025-03-14T05:49:07.2247822Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 8s local ... 2025-03-14T05:49:07.5839134Z 2025-03-14T05:49:07.5840436Z  2025-03-14T05:49:07.5841122Z  2025-03-14T05:49:07.5841741Z  2025-03-14T05:49:07.5842245Z  2025-03-14T05:49:07.5842685Z  2025-03-14T05:49:07.5843116Z  2025-03-14T05:49:07.5843582Z  2025-03-14T05:49:07.5844023Z  2025-03-14T05:49:07.5844524Z [14,249 / 15,235] 48 actions running 2025-03-14T05:49:07.5845376Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T05:49:07.5846538Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T05:49:07.5847530Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2025-03-14T05:49:07.5848592Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local 2025-03-14T05:49:07.5849486Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 10s local 2025-03-14T05:49:07.5850315Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 9s local 2025-03-14T05:49:07.5851238Z Compiling llvm/lib/Target/X86/X86FixupInstTuning.cpp; 9s local 2025-03-14T05:49:07.5852302Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 8s local ... 2025-03-14T05:49:07.7845088Z 2025-03-14T05:49:07.7845926Z  2025-03-14T05:49:07.7846430Z  2025-03-14T05:49:07.7846877Z  2025-03-14T05:49:07.7847285Z  2025-03-14T05:49:07.7847688Z  2025-03-14T05:49:07.7848073Z  2025-03-14T05:49:07.7848451Z  2025-03-14T05:49:07.7848836Z  2025-03-14T05:49:07.7849487Z [14,250 / 15,235] 48 actions, 47 running 2025-03-14T05:49:07.7850316Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T05:49:07.7851203Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T05:49:07.7852225Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2025-03-14T05:49:07.7853834Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local 2025-03-14T05:49:07.7854803Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 10s local 2025-03-14T05:49:07.7855639Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 9s local 2025-03-14T05:49:07.7856595Z Compiling llvm/lib/Target/X86/X86FixupInstTuning.cpp; 9s local 2025-03-14T05:49:07.7857653Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 9s local ... 2025-03-14T05:49:08.1015754Z 2025-03-14T05:49:08.1016619Z  2025-03-14T05:49:08.1017109Z  2025-03-14T05:49:08.1017784Z  2025-03-14T05:49:08.1018211Z  2025-03-14T05:49:08.1018635Z  2025-03-14T05:49:08.1019033Z  2025-03-14T05:49:08.1019430Z  2025-03-14T05:49:08.1019845Z  2025-03-14T05:49:08.1020468Z [14,251 / 15,235] 48 actions, 47 running 2025-03-14T05:49:08.1021317Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T05:49:08.1022223Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T05:49:08.1023169Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 12s local 2025-03-14T05:49:08.1024189Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2025-03-14T05:49:08.1025029Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local 2025-03-14T05:49:08.1025809Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 9s local 2025-03-14T05:49:08.1026961Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 9s local 2025-03-14T05:49:08.1027961Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 9s local ... 2025-03-14T05:49:08.3767122Z 2025-03-14T05:49:08.3768145Z  2025-03-14T05:49:08.3768687Z  2025-03-14T05:49:08.3769273Z  2025-03-14T05:49:08.3769651Z  2025-03-14T05:49:08.3770060Z  2025-03-14T05:49:08.3770432Z  2025-03-14T05:49:08.3770791Z  2025-03-14T05:49:08.3771203Z  2025-03-14T05:49:08.3771789Z [14,252 / 15,235] 48 actions, 47 running 2025-03-14T05:49:08.3772677Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T05:49:08.3773643Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T05:49:08.3774698Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 13s local 2025-03-14T05:49:08.3775790Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2025-03-14T05:49:08.3776749Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local 2025-03-14T05:49:08.3777629Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 9s local 2025-03-14T05:49:08.3778649Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 9s local 2025-03-14T05:49:08.3780103Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 9s local ... 2025-03-14T05:49:08.5850606Z 2025-03-14T05:49:08.5851594Z  2025-03-14T05:49:08.5852157Z  2025-03-14T05:49:08.5852595Z  2025-03-14T05:49:08.5852965Z  2025-03-14T05:49:08.5853342Z  2025-03-14T05:49:08.5853715Z  2025-03-14T05:49:08.5854109Z  2025-03-14T05:49:08.5854503Z  2025-03-14T05:49:08.5855090Z [14,252 / 15,235] 48 actions running 2025-03-14T05:49:08.5855915Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T05:49:08.5856834Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T05:49:08.5857862Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 13s local 2025-03-14T05:49:08.5859056Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2025-03-14T05:49:08.5859972Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local 2025-03-14T05:49:08.5860842Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 10s local 2025-03-14T05:49:08.5861830Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 9s local 2025-03-14T05:49:08.5862893Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 9s local ... 2025-03-14T05:49:08.7855730Z 2025-03-14T05:49:08.7856738Z  2025-03-14T05:49:08.7857304Z  2025-03-14T05:49:08.7857726Z  2025-03-14T05:49:08.7858094Z  2025-03-14T05:49:08.7858808Z  2025-03-14T05:49:08.7859244Z  2025-03-14T05:49:08.7859655Z  2025-03-14T05:49:08.7860064Z  2025-03-14T05:49:08.7860641Z [14,253 / 15,235] 48 actions running 2025-03-14T05:49:08.7861461Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T05:49:08.7862401Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T05:49:08.7863485Z Compiling mlir/lib/Dialect/X86Vector/IR/X86VectorDialect.cpp; 13s local 2025-03-14T05:49:08.7864812Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2025-03-14T05:49:08.7865932Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local 2025-03-14T05:49:08.7866751Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 10s local 2025-03-14T05:49:08.7867706Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 10s local 2025-03-14T05:49:08.7868824Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 10s local ... 2025-03-14T05:49:09.0009937Z 2025-03-14T05:49:09.0010929Z  2025-03-14T05:49:09.0011519Z  2025-03-14T05:49:09.0011892Z  2025-03-14T05:49:09.0012286Z  2025-03-14T05:49:09.0012701Z  2025-03-14T05:49:09.0013082Z  2025-03-14T05:49:09.0013475Z  2025-03-14T05:49:09.0013889Z  2025-03-14T05:49:09.0014497Z [14,257 / 15,235] 48 actions, 47 running 2025-03-14T05:49:09.0015625Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T05:49:09.0016559Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T05:49:09.0017494Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2025-03-14T05:49:09.0018416Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 12s local 2025-03-14T05:49:09.0019233Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 10s local 2025-03-14T05:49:09.0020207Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 10s local 2025-03-14T05:49:09.0021248Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 10s local 2025-03-14T05:49:09.0022383Z Compiling llvm/lib/CodeGen/SelectionDAG/InstrEmitter.cpp; 9s local ... 2025-03-14T05:49:09.3626186Z 2025-03-14T05:49:09.3627216Z  2025-03-14T05:49:09.3627813Z  2025-03-14T05:49:09.3628249Z  2025-03-14T05:49:09.3628655Z  2025-03-14T05:49:09.3629065Z  2025-03-14T05:49:09.3629506Z  2025-03-14T05:49:09.3629951Z  2025-03-14T05:49:09.3630365Z  2025-03-14T05:49:09.3631001Z [14,259 / 15,235] 48 actions, 47 running 2025-03-14T05:49:09.3631863Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T05:49:09.3633047Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T05:49:09.3634128Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T05:49:09.3635017Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 10s local 2025-03-14T05:49:09.3635909Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 10s local 2025-03-14T05:49:09.3636960Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 10s local 2025-03-14T05:49:09.3637939Z Compiling llvm/lib/Target/X86/X86FixupLEAs.cpp; 10s local 2025-03-14T05:49:09.3638906Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 9s local ... 2025-03-14T05:49:09.5862098Z 2025-03-14T05:49:09.5863023Z  2025-03-14T05:49:09.5863580Z  2025-03-14T05:49:09.5864026Z  2025-03-14T05:49:09.5864372Z  2025-03-14T05:49:09.5864735Z  2025-03-14T05:49:09.5865099Z  2025-03-14T05:49:09.5865647Z  2025-03-14T05:49:09.5866121Z  2025-03-14T05:49:09.5866707Z [14,260 / 15,235] 48 actions running 2025-03-14T05:49:09.5867520Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T05:49:09.5868467Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T05:49:09.5869407Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T05:49:09.5870656Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 11s local 2025-03-14T05:49:09.5871639Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 10s local 2025-03-14T05:49:09.5872682Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 10s local 2025-03-14T05:49:09.5873673Z Compiling llvm/lib/Target/X86/X86FixupLEAs.cpp; 10s local 2025-03-14T05:49:09.5874694Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 10s local ... 2025-03-14T05:49:09.9700759Z 2025-03-14T05:49:09.9701721Z  2025-03-14T05:49:09.9702270Z  2025-03-14T05:49:09.9702966Z  2025-03-14T05:49:09.9703395Z  2025-03-14T05:49:09.9703831Z  2025-03-14T05:49:09.9704214Z  2025-03-14T05:49:09.9704604Z  2025-03-14T05:49:09.9705007Z  2025-03-14T05:49:09.9705597Z [14,263 / 15,235] 48 actions, 47 running 2025-03-14T05:49:09.9706467Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T05:49:09.9707377Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T05:49:09.9708375Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T05:49:09.9709330Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 11s local 2025-03-14T05:49:09.9710338Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 11s local 2025-03-14T05:49:09.9711371Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 11s local 2025-03-14T05:49:09.9712768Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 10s local 2025-03-14T05:49:09.9713694Z @llvm-project//llvm:CodeGen; 10s local ... 2025-03-14T05:49:10.1868041Z 2025-03-14T05:49:10.1869186Z  2025-03-14T05:49:10.1869725Z  2025-03-14T05:49:10.1870154Z  2025-03-14T05:49:10.1870484Z  2025-03-14T05:49:10.1870810Z  2025-03-14T05:49:10.1871138Z  2025-03-14T05:49:10.1871472Z  2025-03-14T05:49:10.1871839Z  2025-03-14T05:49:10.1872380Z [14,264 / 15,235] 48 actions running 2025-03-14T05:49:10.1873194Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T05:49:10.1874063Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T05:49:10.1874925Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T05:49:10.1875791Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 11s local 2025-03-14T05:49:10.1876654Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 11s local 2025-03-14T05:49:10.1877549Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 11s local 2025-03-14T05:49:10.1878474Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 10s local 2025-03-14T05:49:10.1879749Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 10s local ... 2025-03-14T05:49:10.3872505Z 2025-03-14T05:49:10.3873306Z  2025-03-14T05:49:10.3873754Z  2025-03-14T05:49:10.3874160Z  2025-03-14T05:49:10.3874516Z  2025-03-14T05:49:10.3874848Z  2025-03-14T05:49:10.3875175Z  2025-03-14T05:49:10.3875537Z  2025-03-14T05:49:10.3875898Z  2025-03-14T05:49:10.3876495Z [14,265 / 15,235] 48 actions running 2025-03-14T05:49:10.3877172Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T05:49:10.3878021Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T05:49:10.3878956Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T05:49:10.3879743Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 11s local 2025-03-14T05:49:10.3880688Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 11s local 2025-03-14T05:49:10.3881538Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 11s local 2025-03-14T05:49:10.3882489Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 10s local 2025-03-14T05:49:10.3883516Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 10s local ... 2025-03-14T05:49:10.7876430Z 2025-03-14T05:49:10.7877310Z  2025-03-14T05:49:10.7877807Z  2025-03-14T05:49:10.7878267Z  2025-03-14T05:49:10.7879014Z  2025-03-14T05:49:10.7879454Z  2025-03-14T05:49:10.7879901Z  2025-03-14T05:49:10.7880327Z  2025-03-14T05:49:10.7880721Z  2025-03-14T05:49:10.7881280Z [14,266 / 15,235] 48 actions running 2025-03-14T05:49:10.7882105Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T05:49:10.7883009Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T05:49:10.7884052Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T05:49:10.7885496Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 12s local 2025-03-14T05:49:10.7886493Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 12s local 2025-03-14T05:49:10.7887553Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 12s local 2025-03-14T05:49:10.7888558Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 11s local 2025-03-14T05:49:10.7889666Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 11s local ... 2025-03-14T05:49:11.1245546Z 2025-03-14T05:49:11.1246381Z  2025-03-14T05:49:11.1246894Z  2025-03-14T05:49:11.1247269Z  2025-03-14T05:49:11.1247663Z  2025-03-14T05:49:11.1248054Z  2025-03-14T05:49:11.1248427Z  2025-03-14T05:49:11.1248947Z  2025-03-14T05:49:11.1249346Z  2025-03-14T05:49:11.1249928Z [14,267 / 15,235] 48 actions, 47 running 2025-03-14T05:49:11.1251121Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T05:49:11.1252028Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T05:49:11.1253217Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T05:49:11.1254219Z Compiling llvm/lib/CodeGen/SelectOptimize.cpp; 12s local 2025-03-14T05:49:11.1255173Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 12s local 2025-03-14T05:49:11.1256205Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 12s local 2025-03-14T05:49:11.1257292Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 11s local 2025-03-14T05:49:11.1258401Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 11s local ... 2025-03-14T05:49:11.3368845Z 2025-03-14T05:49:11.3369670Z  2025-03-14T05:49:11.3370168Z  2025-03-14T05:49:11.3370561Z  2025-03-14T05:49:11.3370956Z  2025-03-14T05:49:11.3371349Z  2025-03-14T05:49:11.3371786Z  2025-03-14T05:49:11.3372189Z  2025-03-14T05:49:11.3372534Z  2025-03-14T05:49:11.3373138Z [14,270 / 15,235] 48 actions, 47 running 2025-03-14T05:49:11.3374267Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T05:49:11.3375151Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T05:49:11.3376103Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T05:49:11.3377109Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 12s local 2025-03-14T05:49:11.3378152Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 12s local 2025-03-14T05:49:11.3379177Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 11s local 2025-03-14T05:49:11.3380225Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 11s local 2025-03-14T05:49:11.3381046Z @llvm-project//llvm:CodeGen; 11s local ... 2025-03-14T05:49:11.5884770Z 2025-03-14T05:49:11.5885669Z  2025-03-14T05:49:11.5886218Z  2025-03-14T05:49:11.5886629Z  2025-03-14T05:49:11.5887032Z  2025-03-14T05:49:11.5887420Z  2025-03-14T05:49:11.5887828Z  2025-03-14T05:49:11.5888241Z  2025-03-14T05:49:11.5888684Z  2025-03-14T05:49:11.5889271Z [14,271 / 15,235] 48 actions running 2025-03-14T05:49:11.5890122Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T05:49:11.5891036Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T05:49:11.5892015Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T05:49:11.5893345Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 12s local 2025-03-14T05:49:11.5894512Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 12s local 2025-03-14T05:49:11.5895571Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 12s local 2025-03-14T05:49:11.5896633Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 11s local 2025-03-14T05:49:11.5897552Z @llvm-project//llvm:CodeGen; 11s local ... 2025-03-14T05:49:11.8262107Z 2025-03-14T05:49:11.8262960Z  2025-03-14T05:49:11.8263774Z  2025-03-14T05:49:11.8264222Z  2025-03-14T05:49:11.8264746Z  2025-03-14T05:49:11.8265148Z  2025-03-14T05:49:11.8265747Z  2025-03-14T05:49:11.8266112Z  2025-03-14T05:49:11.8266496Z  2025-03-14T05:49:11.8267082Z [14,272 / 15,235] 48 actions, 47 running 2025-03-14T05:49:11.8267885Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T05:49:11.8268777Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T05:49:11.8269717Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T05:49:11.8270690Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local 2025-03-14T05:49:11.8271760Z Compiling llvm/lib/CodeGen/SelectionDAG/FastISel.cpp; 13s local 2025-03-14T05:49:11.8272704Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 12s local 2025-03-14T05:49:11.8273905Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local 2025-03-14T05:49:11.8274746Z @llvm-project//llvm:CodeGen; 12s local ... 2025-03-14T05:49:12.1892859Z 2025-03-14T05:49:12.1893723Z  2025-03-14T05:49:12.1894230Z  2025-03-14T05:49:12.1894652Z  2025-03-14T05:49:12.1895043Z  2025-03-14T05:49:12.1895450Z  2025-03-14T05:49:12.1895837Z  2025-03-14T05:49:12.1896234Z  2025-03-14T05:49:12.1896631Z  2025-03-14T05:49:12.1897197Z [14,275 / 15,235] 48 actions running 2025-03-14T05:49:12.1898042Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T05:49:12.1898866Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T05:49:12.1899779Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T05:49:12.1900797Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local 2025-03-14T05:49:12.1901874Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 12s local 2025-03-14T05:49:12.1902908Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local 2025-03-14T05:49:12.1903700Z @llvm-project//llvm:CodeGen; 12s local 2025-03-14T05:49:12.1904669Z @llvm-project//llvm:CodeGen; 11s local ... 2025-03-14T05:49:12.3897901Z 2025-03-14T05:49:12.3898762Z  2025-03-14T05:49:12.3899276Z  2025-03-14T05:49:12.3899687Z  2025-03-14T05:49:12.3900088Z  2025-03-14T05:49:12.3900452Z  2025-03-14T05:49:12.3900794Z  2025-03-14T05:49:12.3901188Z  2025-03-14T05:49:12.3901524Z  2025-03-14T05:49:12.3902139Z [14,276 / 15,235] 48 actions running 2025-03-14T05:49:12.3903029Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T05:49:12.3903932Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T05:49:12.3904890Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T05:49:12.3906018Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local 2025-03-14T05:49:12.3907102Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 12s local 2025-03-14T05:49:12.3908149Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local 2025-03-14T05:49:12.3908999Z @llvm-project//llvm:CodeGen; 12s local 2025-03-14T05:49:12.3909613Z @llvm-project//llvm:CodeGen; 12s local ... 2025-03-14T05:49:12.6758095Z 2025-03-14T05:49:12.6758938Z  2025-03-14T05:49:12.6759457Z  2025-03-14T05:49:12.6759858Z  2025-03-14T05:49:12.6760263Z  2025-03-14T05:49:12.6760678Z  2025-03-14T05:49:12.6761361Z  2025-03-14T05:49:12.6761804Z  2025-03-14T05:49:12.6762165Z  2025-03-14T05:49:12.6762773Z [14,278 / 15,235] 48 actions, 47 running 2025-03-14T05:49:12.6763592Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T05:49:12.6764449Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T05:49:12.6765809Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T05:49:12.6767005Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 13s local 2025-03-14T05:49:12.6768076Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 13s local 2025-03-14T05:49:12.6769112Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local 2025-03-14T05:49:12.6769941Z @llvm-project//llvm:CodeGen; 12s local 2025-03-14T05:49:12.6770571Z @llvm-project//llvm:CodeGen; 12s local ... 2025-03-14T05:49:12.9378622Z 2025-03-14T05:49:12.9379465Z  2025-03-14T05:49:12.9379942Z  2025-03-14T05:49:12.9380371Z  2025-03-14T05:49:12.9380771Z  2025-03-14T05:49:12.9381173Z  2025-03-14T05:49:12.9381567Z  2025-03-14T05:49:12.9381965Z  2025-03-14T05:49:12.9382358Z  2025-03-14T05:49:12.9382962Z [14,279 / 15,235] 48 actions, 47 running 2025-03-14T05:49:12.9383800Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T05:49:12.9384939Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T05:49:12.9385908Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T05:49:12.9386950Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local 2025-03-14T05:49:12.9388001Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 13s local 2025-03-14T05:49:12.9389051Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2025-03-14T05:49:12.9389908Z @llvm-project//llvm:CodeGen; 13s local 2025-03-14T05:49:12.9390551Z @llvm-project//llvm:CodeGen; 12s local ... 2025-03-14T05:49:13.1903771Z 2025-03-14T05:49:13.1904666Z  2025-03-14T05:49:13.1905103Z  2025-03-14T05:49:13.1905507Z  2025-03-14T05:49:13.1905869Z  2025-03-14T05:49:13.1906237Z  2025-03-14T05:49:13.1906564Z  2025-03-14T05:49:13.1906930Z  2025-03-14T05:49:13.1907278Z  2025-03-14T05:49:13.1907843Z [14,279 / 15,235] 48 actions running 2025-03-14T05:49:13.1908595Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T05:49:13.1909428Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T05:49:13.1910635Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T05:49:13.1911557Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local 2025-03-14T05:49:13.1912538Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 13s local 2025-03-14T05:49:13.1913490Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2025-03-14T05:49:13.1914289Z @llvm-project//llvm:CodeGen; 13s local 2025-03-14T05:49:13.1914928Z @llvm-project//llvm:CodeGen; 12s local ... 2025-03-14T05:49:13.4579724Z 2025-03-14T05:49:13.4580598Z  2025-03-14T05:49:13.4581089Z  2025-03-14T05:49:13.4581495Z  2025-03-14T05:49:13.4581909Z  2025-03-14T05:49:13.4582310Z  2025-03-14T05:49:13.4582698Z  2025-03-14T05:49:13.4583052Z  2025-03-14T05:49:13.4583383Z  2025-03-14T05:49:13.4583990Z [14,280 / 15,235] 48 actions, 47 running 2025-03-14T05:49:13.4584731Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T05:49:13.4585588Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T05:49:13.4586520Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T05:49:13.4587557Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local 2025-03-14T05:49:13.4591968Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 14s local 2025-03-14T05:49:13.4593285Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2025-03-14T05:49:13.4594116Z @llvm-project//llvm:CodeGen; 13s local 2025-03-14T05:49:13.4594719Z @llvm-project//llvm:CodeGen; 13s local ... 2025-03-14T05:49:13.7910285Z 2025-03-14T05:49:13.7911140Z  2025-03-14T05:49:13.7911619Z  2025-03-14T05:49:13.7912049Z  2025-03-14T05:49:13.7912446Z  2025-03-14T05:49:13.7912835Z  2025-03-14T05:49:13.7913199Z  2025-03-14T05:49:13.7913829Z  2025-03-14T05:49:13.7914255Z  2025-03-14T05:49:13.7914835Z [14,280 / 15,235] 48 actions running 2025-03-14T05:49:13.7915661Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T05:49:13.7916590Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T05:49:13.7917539Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T05:49:13.7918584Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2025-03-14T05:49:13.7919618Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 14s local 2025-03-14T05:49:13.7920689Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 14s local 2025-03-14T05:49:13.7921517Z @llvm-project//llvm:CodeGen; 13s local 2025-03-14T05:49:13.7922143Z @llvm-project//llvm:CodeGen; 13s local ... 2025-03-14T05:49:14.6340670Z 2025-03-14T05:49:14.6341526Z  2025-03-14T05:49:14.6341992Z  2025-03-14T05:49:14.6342371Z  2025-03-14T05:49:14.6342760Z  2025-03-14T05:49:14.6343136Z  2025-03-14T05:49:14.6343552Z  2025-03-14T05:49:14.6343921Z  2025-03-14T05:49:14.6344289Z  2025-03-14T05:49:14.6344827Z [14,281 / 15,235] 48 actions, 47 running 2025-03-14T05:49:14.6345597Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T05:49:14.6346480Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T05:49:14.6347378Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T05:49:14.6348401Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2025-03-14T05:49:14.6349423Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 15s local 2025-03-14T05:49:14.6350476Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 14s local 2025-03-14T05:49:14.6351537Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 14s local 2025-03-14T05:49:14.6352681Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 13s local ... 2025-03-14T05:49:14.9919381Z 2025-03-14T05:49:14.9920499Z  2025-03-14T05:49:14.9921159Z  2025-03-14T05:49:14.9921595Z  2025-03-14T05:49:14.9922011Z  2025-03-14T05:49:14.9922411Z  2025-03-14T05:49:14.9922789Z  2025-03-14T05:49:14.9923165Z  2025-03-14T05:49:14.9923526Z  2025-03-14T05:49:14.9924091Z [14,282 / 15,235] 48 actions running 2025-03-14T05:49:14.9925084Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T05:49:14.9925986Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T05:49:14.9926926Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T05:49:14.9928052Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2025-03-14T05:49:14.9928994Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 15s local 2025-03-14T05:49:14.9929976Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 15s local 2025-03-14T05:49:14.9931083Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 14s local 2025-03-14T05:49:14.9932226Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 13s local ... 2025-03-14T05:49:15.3602035Z 2025-03-14T05:49:15.3602829Z  2025-03-14T05:49:15.3603270Z  2025-03-14T05:49:15.3603641Z  2025-03-14T05:49:15.3603991Z  2025-03-14T05:49:15.3604351Z  2025-03-14T05:49:15.3604827Z  2025-03-14T05:49:15.3620210Z  2025-03-14T05:49:15.3621248Z  2025-03-14T05:49:15.3621848Z [14,288 / 15,235] 48 actions, 47 running 2025-03-14T05:49:15.3622662Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T05:49:15.3623534Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T05:49:15.3624446Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T05:49:15.3625502Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2025-03-14T05:49:15.3626690Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 15s local 2025-03-14T05:49:15.3627846Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2025-03-14T05:49:15.3628947Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 13s local 2025-03-14T05:49:15.3629792Z @llvm-project//llvm:CodeGen; 12s local ... 2025-03-14T05:49:15.5925711Z 2025-03-14T05:49:15.5926527Z  2025-03-14T05:49:15.5926949Z  2025-03-14T05:49:15.5927323Z  2025-03-14T05:49:15.5927711Z  2025-03-14T05:49:15.5928063Z  2025-03-14T05:49:15.5928420Z  2025-03-14T05:49:15.5928788Z  2025-03-14T05:49:15.5929134Z  2025-03-14T05:49:15.5929661Z [14,290 / 15,235] 48 actions running 2025-03-14T05:49:15.5930543Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T05:49:15.5931659Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T05:49:15.5932552Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T05:49:15.5933522Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2025-03-14T05:49:15.5934513Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local 2025-03-14T05:49:15.5935614Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2025-03-14T05:49:15.5936742Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 14s local 2025-03-14T05:49:15.5937597Z @llvm-project//llvm:CodeGen; 12s local ... 2025-03-14T05:49:15.8633409Z 2025-03-14T05:49:15.8634263Z  2025-03-14T05:49:15.8634730Z  2025-03-14T05:49:15.8635150Z  2025-03-14T05:49:15.8635514Z  2025-03-14T05:49:15.8635860Z  2025-03-14T05:49:15.8636179Z  2025-03-14T05:49:15.8636541Z  2025-03-14T05:49:15.8636922Z  2025-03-14T05:49:15.8637506Z [14,292 / 15,235] 48 actions, 47 running 2025-03-14T05:49:15.8638344Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T05:49:15.8639303Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T05:49:15.8640524Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T05:49:15.8641535Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2025-03-14T05:49:15.8642546Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local 2025-03-14T05:49:15.8643640Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2025-03-14T05:49:15.8644914Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 14s local 2025-03-14T05:49:15.8645780Z @llvm-project//llvm:CodeGen; 13s local ... 2025-03-14T05:49:16.1017876Z 2025-03-14T05:49:16.1018710Z  2025-03-14T05:49:16.1019188Z  2025-03-14T05:49:16.1019587Z  2025-03-14T05:49:16.1020117Z  2025-03-14T05:49:16.1020535Z  2025-03-14T05:49:16.1020935Z  2025-03-14T05:49:16.1021332Z  2025-03-14T05:49:16.1021720Z  2025-03-14T05:49:16.1022313Z [14,294 / 15,235] 48 actions, 47 running 2025-03-14T05:49:16.1023140Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T05:49:16.1024026Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T05:49:16.1024971Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T05:49:16.1026045Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2025-03-14T05:49:16.1027343Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local 2025-03-14T05:49:16.1028510Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 15s local 2025-03-14T05:49:16.1029641Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 14s local 2025-03-14T05:49:16.1030523Z @llvm-project//llvm:CodeGen; 13s local ... 2025-03-14T05:49:16.3793048Z 2025-03-14T05:49:16.3793936Z  2025-03-14T05:49:16.3794455Z  2025-03-14T05:49:16.3794888Z  2025-03-14T05:49:16.3795286Z  2025-03-14T05:49:16.3796004Z  2025-03-14T05:49:16.3796439Z  2025-03-14T05:49:16.3796840Z  2025-03-14T05:49:16.3797243Z  2025-03-14T05:49:16.3797851Z [14,296 / 15,235] 48 actions, 47 running 2025-03-14T05:49:16.3798696Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T05:49:16.3799614Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T05:49:16.3800631Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T05:49:16.3801640Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2025-03-14T05:49:16.3802669Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local 2025-03-14T05:49:16.3803814Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 16s local 2025-03-14T05:49:16.3805112Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 14s local 2025-03-14T05:49:16.3806243Z @llvm-project//llvm:CodeGen; 13s local ... 2025-03-14T05:49:16.5885884Z 2025-03-14T05:49:16.5886803Z  2025-03-14T05:49:16.5887292Z  2025-03-14T05:49:16.5887699Z  2025-03-14T05:49:16.5888107Z  2025-03-14T05:49:16.5888497Z  2025-03-14T05:49:16.5888888Z  2025-03-14T05:49:16.5889288Z  2025-03-14T05:49:16.5889673Z  2025-03-14T05:49:16.5890277Z [14,299 / 15,235] 48 actions, 47 running 2025-03-14T05:49:16.5891142Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T05:49:16.5892060Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T05:49:16.5893024Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T05:49:16.5894086Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2025-03-14T05:49:16.5895244Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2025-03-14T05:49:16.5896314Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 16s local 2025-03-14T05:49:16.5897465Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local 2025-03-14T05:49:16.5898351Z @llvm-project//llvm:CodeGen; 13s local ... 2025-03-14T05:49:16.7936398Z 2025-03-14T05:49:16.7937253Z  2025-03-14T05:49:16.7937721Z  2025-03-14T05:49:16.7938113Z  2025-03-14T05:49:16.7938517Z  2025-03-14T05:49:16.7938916Z  2025-03-14T05:49:16.7939303Z  2025-03-14T05:49:16.7939693Z  2025-03-14T05:49:16.7940077Z  2025-03-14T05:49:16.7940657Z [14,301 / 15,235] 48 actions running 2025-03-14T05:49:16.7941485Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T05:49:16.7942363Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T05:49:16.7943321Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T05:49:16.7944365Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2025-03-14T05:49:16.7945412Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2025-03-14T05:49:16.7946523Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 16s local 2025-03-14T05:49:16.7947645Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local 2025-03-14T05:49:16.7948513Z @llvm-project//llvm:CodeGen; 14s local ... 2025-03-14T05:49:17.1941265Z 2025-03-14T05:49:17.1942169Z  2025-03-14T05:49:17.1942666Z  2025-03-14T05:49:17.1943050Z  2025-03-14T05:49:17.1943444Z  2025-03-14T05:49:17.1943854Z  2025-03-14T05:49:17.1944539Z  2025-03-14T05:49:17.1944974Z  2025-03-14T05:49:17.1945375Z  2025-03-14T05:49:17.1945963Z [14,303 / 15,235] 48 actions running 2025-03-14T05:49:17.1946780Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T05:49:17.1947613Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T05:49:17.1948582Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T05:49:17.1949755Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2025-03-14T05:49:17.1950731Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2025-03-14T05:49:17.1951844Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 16s local 2025-03-14T05:49:17.1952948Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local 2025-03-14T05:49:17.1953842Z @llvm-project//llvm:CodeGen; 14s local ... 2025-03-14T05:49:17.3944838Z 2025-03-14T05:49:17.3945703Z  2025-03-14T05:49:17.3946231Z  2025-03-14T05:49:17.3946651Z  2025-03-14T05:49:17.3947063Z  2025-03-14T05:49:17.3947456Z  2025-03-14T05:49:17.3947848Z  2025-03-14T05:49:17.3948230Z  2025-03-14T05:49:17.3948601Z  2025-03-14T05:49:17.3949162Z [14,307 / 15,235] 48 actions running 2025-03-14T05:49:17.3949963Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T05:49:17.3951147Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T05:49:17.3952073Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T05:49:17.3953103Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2025-03-14T05:49:17.3954100Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2025-03-14T05:49:17.3955183Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 17s local 2025-03-14T05:49:17.3956219Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 15s local 2025-03-14T05:49:17.3957089Z @llvm-project//llvm:CodeGen; 14s local ... 2025-03-14T05:49:17.6912399Z 2025-03-14T05:49:17.6913246Z  2025-03-14T05:49:17.6913747Z  2025-03-14T05:49:17.6914145Z  2025-03-14T05:49:17.6914551Z  2025-03-14T05:49:17.6914940Z  2025-03-14T05:49:17.6915342Z  2025-03-14T05:49:17.6915728Z  2025-03-14T05:49:17.6916166Z  2025-03-14T05:49:17.6916790Z [14,308 / 15,235] 48 actions, 47 running 2025-03-14T05:49:17.6917649Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T05:49:17.6918753Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T05:49:17.6919677Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T05:49:17.6920669Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2025-03-14T05:49:17.6921696Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 18s local 2025-03-14T05:49:17.6922761Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2025-03-14T05:49:17.6923915Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 14s local 2025-03-14T05:49:17.6925010Z @llvm-project//llvm:CodeGen; 14s local ... 2025-03-14T05:49:17.8914713Z 2025-03-14T05:49:17.8915574Z  2025-03-14T05:49:17.8916082Z  2025-03-14T05:49:17.8916475Z  2025-03-14T05:49:17.8916888Z  2025-03-14T05:49:17.8917273Z  2025-03-14T05:49:17.8917664Z  2025-03-14T05:49:17.8918031Z  2025-03-14T05:49:17.8918436Z  2025-03-14T05:49:17.8919043Z [14,309 / 15,235] 48 actions, 47 running 2025-03-14T05:49:17.8919894Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T05:49:17.8920766Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T05:49:17.8921643Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T05:49:17.8922755Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2025-03-14T05:49:17.8924159Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2025-03-14T05:49:17.8925535Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 15s local 2025-03-14T05:49:17.8926714Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 15s local 2025-03-14T05:49:17.8927845Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2025-03-14T05:49:18.1952519Z 2025-03-14T05:49:18.1953350Z  2025-03-14T05:49:18.1953845Z  2025-03-14T05:49:18.1954663Z  2025-03-14T05:49:18.1955069Z  2025-03-14T05:49:18.1955471Z  2025-03-14T05:49:18.1955824Z  2025-03-14T05:49:18.1956181Z  2025-03-14T05:49:18.1956532Z  2025-03-14T05:49:18.1957066Z [14,311 / 15,235] 48 actions running 2025-03-14T05:49:18.1957836Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T05:49:18.1958686Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T05:49:18.1959617Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T05:49:18.1960633Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2025-03-14T05:49:18.1961791Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2025-03-14T05:49:18.1962997Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 15s local 2025-03-14T05:49:18.1964457Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 15s local 2025-03-14T05:49:18.1965959Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2025-03-14T05:49:18.4115582Z 2025-03-14T05:49:18.4116476Z  2025-03-14T05:49:18.4116956Z  2025-03-14T05:49:18.4117335Z  2025-03-14T05:49:18.4117719Z  2025-03-14T05:49:18.4118078Z  2025-03-14T05:49:18.4118474Z  2025-03-14T05:49:18.4118878Z  2025-03-14T05:49:18.4119257Z  2025-03-14T05:49:18.4119811Z [14,312 / 15,235] 48 actions, 47 running 2025-03-14T05:49:18.4120669Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T05:49:18.4121626Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T05:49:18.4122482Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T05:49:18.4123478Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2025-03-14T05:49:18.4124534Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2025-03-14T05:49:18.4125817Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 15s local 2025-03-14T05:49:18.4127464Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 15s local 2025-03-14T05:49:18.4128675Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2025-03-14T05:49:18.7699814Z 2025-03-14T05:49:18.7700630Z  2025-03-14T05:49:18.7701148Z  2025-03-14T05:49:18.7701577Z  2025-03-14T05:49:18.7701995Z  2025-03-14T05:49:18.7702408Z  2025-03-14T05:49:18.7702858Z  2025-03-14T05:49:18.7703260Z  2025-03-14T05:49:18.7703669Z  2025-03-14T05:49:18.7704303Z [14,313 / 15,235] 48 actions, 47 running 2025-03-14T05:49:18.7705248Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T05:49:18.7706156Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T05:49:18.7707130Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T05:49:18.7708151Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2025-03-14T05:49:18.7709224Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2025-03-14T05:49:18.7710399Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2025-03-14T05:49:18.7711596Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 15s local 2025-03-14T05:49:18.7712779Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2025-03-14T05:49:18.9830282Z 2025-03-14T05:49:18.9831352Z  2025-03-14T05:49:18.9831830Z  2025-03-14T05:49:18.9832196Z  2025-03-14T05:49:18.9832569Z  2025-03-14T05:49:18.9832924Z  2025-03-14T05:49:18.9833297Z  2025-03-14T05:49:18.9833655Z  2025-03-14T05:49:18.9834036Z  2025-03-14T05:49:18.9834564Z [14,314 / 15,235] 48 actions, 47 running 2025-03-14T05:49:18.9835301Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T05:49:18.9836284Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T05:49:18.9837138Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T05:49:18.9838075Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2025-03-14T05:49:18.9839007Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2025-03-14T05:49:18.9840030Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2025-03-14T05:49:18.9841228Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 16s local 2025-03-14T05:49:18.9842319Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local ... 2025-03-14T05:49:19.1959393Z 2025-03-14T05:49:19.1960225Z  2025-03-14T05:49:19.1960667Z  2025-03-14T05:49:19.1961042Z  2025-03-14T05:49:19.1961391Z  2025-03-14T05:49:19.1961751Z  2025-03-14T05:49:19.1962427Z  2025-03-14T05:49:19.1962779Z  2025-03-14T05:49:19.1963133Z  2025-03-14T05:49:19.1963663Z [14,314 / 15,235] 48 actions running 2025-03-14T05:49:19.1964379Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T05:49:19.1965491Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T05:49:19.1966339Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T05:49:19.1967248Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2025-03-14T05:49:19.1968211Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2025-03-14T05:49:19.1969288Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 16s local 2025-03-14T05:49:19.1970356Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 16s local 2025-03-14T05:49:19.1971403Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local ... 2025-03-14T05:49:19.7497420Z 2025-03-14T05:49:19.7498222Z  2025-03-14T05:49:19.7498616Z  2025-03-14T05:49:19.7498961Z  2025-03-14T05:49:19.7499275Z  2025-03-14T05:49:19.7499630Z  2025-03-14T05:49:19.7499938Z  2025-03-14T05:49:19.7500561Z  2025-03-14T05:49:19.7500872Z  2025-03-14T05:49:19.7501387Z [14,315 / 15,235] 48 actions, 47 running 2025-03-14T05:49:19.7502044Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2025-03-14T05:49:19.7502767Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T05:49:19.7503524Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T05:49:19.7504370Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2025-03-14T05:49:19.7505224Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2025-03-14T05:49:19.7506139Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2025-03-14T05:49:19.7507085Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 16s local 2025-03-14T05:49:19.7508061Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local ... 2025-03-14T05:49:19.9968279Z 2025-03-14T05:49:19.9969121Z  2025-03-14T05:49:19.9969618Z  2025-03-14T05:49:19.9970001Z  2025-03-14T05:49:19.9970395Z  2025-03-14T05:49:19.9970791Z  2025-03-14T05:49:19.9971198Z  2025-03-14T05:49:19.9971583Z  2025-03-14T05:49:19.9971979Z  2025-03-14T05:49:19.9972538Z [14,316 / 15,235] 48 actions running 2025-03-14T05:49:19.9973361Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2025-03-14T05:49:19.9974530Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 33s local 2025-03-14T05:49:19.9975481Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T05:49:19.9976500Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T05:49:19.9977611Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2025-03-14T05:49:19.9978772Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2025-03-14T05:49:19.9980125Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 17s local 2025-03-14T05:49:19.9981362Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local ... 2025-03-14T05:49:20.3316768Z 2025-03-14T05:49:20.3317572Z  2025-03-14T05:49:20.3318069Z  2025-03-14T05:49:20.3318477Z  2025-03-14T05:49:20.3318875Z  2025-03-14T05:49:20.3319248Z  2025-03-14T05:49:20.3319628Z  2025-03-14T05:49:20.3319981Z  2025-03-14T05:49:20.3320389Z  2025-03-14T05:49:20.3320958Z [14,319 / 15,235] 48 actions, 47 running 2025-03-14T05:49:20.3321774Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T05:49:20.3322636Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 33s local 2025-03-14T05:49:20.3323558Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T05:49:20.3324924Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T05:49:20.3325927Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2025-03-14T05:49:20.3327028Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2025-03-14T05:49:20.3328232Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 17s local 2025-03-14T05:49:20.3329347Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local ... 2025-03-14T05:49:20.5975995Z 2025-03-14T05:49:20.5976809Z  2025-03-14T05:49:20.5977285Z  2025-03-14T05:49:20.5977741Z  2025-03-14T05:49:20.5978162Z  2025-03-14T05:49:20.5978582Z  2025-03-14T05:49:20.5978999Z  2025-03-14T05:49:20.5979404Z  2025-03-14T05:49:20.5979805Z  2025-03-14T05:49:20.5980412Z [14,319 / 15,235] 48 actions running 2025-03-14T05:49:20.5981279Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T05:49:20.5982257Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 33s local 2025-03-14T05:49:20.5983280Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T05:49:20.5984714Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T05:49:20.5985857Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T05:49:20.5987089Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 17s local 2025-03-14T05:49:20.5988361Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 17s local 2025-03-14T05:49:20.5989615Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local ... 2025-03-14T05:49:20.8408531Z 2025-03-14T05:49:20.8409373Z  2025-03-14T05:49:20.8409811Z  2025-03-14T05:49:20.8410169Z  2025-03-14T05:49:20.8410550Z  2025-03-14T05:49:20.8410897Z  2025-03-14T05:49:20.8411264Z  2025-03-14T05:49:20.8411642Z  2025-03-14T05:49:20.8412027Z  2025-03-14T05:49:20.8412558Z [14,321 / 15,235] 48 actions, 47 running 2025-03-14T05:49:20.8413312Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T05:49:20.8414142Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 33s local 2025-03-14T05:49:20.8415009Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T05:49:20.8415926Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T05:49:20.8416854Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T05:49:20.8418120Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 18s local 2025-03-14T05:49:20.8419199Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 17s local 2025-03-14T05:49:20.8420237Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local ... 2025-03-14T05:49:21.1981271Z 2025-03-14T05:49:21.1982094Z  2025-03-14T05:49:21.1982603Z  2025-03-14T05:49:21.1983052Z  2025-03-14T05:49:21.1983455Z  2025-03-14T05:49:21.1983837Z  2025-03-14T05:49:21.1984211Z  2025-03-14T05:49:21.1984854Z  2025-03-14T05:49:21.1985271Z  2025-03-14T05:49:21.1985830Z [14,322 / 15,235] 48 actions running 2025-03-14T05:49:21.1986651Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T05:49:21.1987549Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 34s local 2025-03-14T05:49:21.1988475Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T05:49:21.1989490Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T05:49:21.1990530Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T05:49:21.1991666Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 18s local 2025-03-14T05:49:21.1992825Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 18s local 2025-03-14T05:49:21.1994116Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local ... 2025-03-14T05:49:21.7378480Z 2025-03-14T05:49:21.7379314Z  2025-03-14T05:49:21.7379832Z  2025-03-14T05:49:21.7380254Z  2025-03-14T05:49:21.7380683Z  2025-03-14T05:49:21.7381104Z  2025-03-14T05:49:21.7381519Z  2025-03-14T05:49:21.7381941Z  2025-03-14T05:49:21.7382365Z  2025-03-14T05:49:21.7382985Z [14,323 / 15,235] 48 actions, 47 running 2025-03-14T05:49:21.7383926Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T05:49:21.7384829Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 34s local 2025-03-14T05:49:21.7385812Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T05:49:21.7386917Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T05:49:21.7388009Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T05:49:21.7389163Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2025-03-14T05:49:21.7390329Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 18s local 2025-03-14T05:49:21.7391510Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local ... 2025-03-14T05:49:21.9988576Z 2025-03-14T05:49:21.9989415Z  2025-03-14T05:49:21.9989897Z  2025-03-14T05:49:21.9990319Z  2025-03-14T05:49:21.9990712Z  2025-03-14T05:49:21.9991130Z  2025-03-14T05:49:21.9991496Z  2025-03-14T05:49:21.9991894Z  2025-03-14T05:49:21.9992267Z  2025-03-14T05:49:21.9992864Z [14,324 / 15,235] 48 actions running 2025-03-14T05:49:21.9993718Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T05:49:21.9994701Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T05:49:21.9995786Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2025-03-14T05:49:21.9996852Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T05:49:21.9998011Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2025-03-14T05:49:21.9999207Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2025-03-14T05:49:22.0000390Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2025-03-14T05:49:22.0001269Z @llvm-project//llvm:IPO; 17s local ... 2025-03-14T05:49:22.2538608Z 2025-03-14T05:49:22.2539483Z  2025-03-14T05:49:22.2540003Z  2025-03-14T05:49:22.2540417Z  2025-03-14T05:49:22.2540818Z  2025-03-14T05:49:22.2541225Z  2025-03-14T05:49:22.2541909Z  2025-03-14T05:49:22.2542327Z  2025-03-14T05:49:22.2542735Z  2025-03-14T05:49:22.2543344Z [14,327 / 15,235] 47 actions, 46 running 2025-03-14T05:49:22.2544179Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T05:49:22.2545162Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T05:49:22.2546235Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2025-03-14T05:49:22.2547521Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T05:49:22.2548758Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2025-03-14T05:49:22.2549974Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2025-03-14T05:49:22.2551127Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2025-03-14T05:49:22.2552023Z @llvm-project//llvm:IPO; 17s local ... 2025-03-14T05:49:22.5152481Z 2025-03-14T05:49:22.5153325Z  2025-03-14T05:49:22.5153841Z  2025-03-14T05:49:22.5154252Z  2025-03-14T05:49:22.5154657Z  2025-03-14T05:49:22.5155062Z  2025-03-14T05:49:22.5155456Z  2025-03-14T05:49:22.5155839Z  2025-03-14T05:49:22.5156232Z  2025-03-14T05:49:22.5156805Z [14,329 / 15,235] 48 actions, 47 running 2025-03-14T05:49:22.5157908Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2025-03-14T05:49:22.5158896Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T05:49:22.5159955Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2025-03-14T05:49:22.5161113Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T05:49:22.5162271Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 19s local 2025-03-14T05:49:22.5163472Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2025-03-14T05:49:22.5164611Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2025-03-14T05:49:22.5165817Z @llvm-project//llvm:IPO; 17s local ... 2025-03-14T05:49:22.7994769Z 2025-03-14T05:49:22.7995602Z  2025-03-14T05:49:22.7996102Z  2025-03-14T05:49:22.7996518Z  2025-03-14T05:49:22.7996932Z  2025-03-14T05:49:22.7997339Z  2025-03-14T05:49:22.7997734Z  2025-03-14T05:49:22.7998163Z  2025-03-14T05:49:22.7998598Z  2025-03-14T05:49:22.7999197Z [14,330 / 15,235] 48 actions running 2025-03-14T05:49:22.8000042Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2025-03-14T05:49:22.8001303Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T05:49:22.8002359Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T05:49:22.8003435Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2025-03-14T05:49:22.8004635Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2025-03-14T05:49:22.8005988Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2025-03-14T05:49:22.8007116Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2025-03-14T05:49:22.8008039Z @llvm-project//llvm:IPO; 18s local ... 2025-03-14T05:49:23.0078806Z 2025-03-14T05:49:23.0079630Z  2025-03-14T05:49:23.0080135Z  2025-03-14T05:49:23.0080571Z  2025-03-14T05:49:23.0080958Z  2025-03-14T05:49:23.0081362Z  2025-03-14T05:49:23.0081755Z  2025-03-14T05:49:23.0082173Z  2025-03-14T05:49:23.0082536Z  2025-03-14T05:49:23.0083144Z [14,332 / 15,235] 48 actions, 47 running 2025-03-14T05:49:23.0083968Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2025-03-14T05:49:23.0085065Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T05:49:23.0086451Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T05:49:23.0087851Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2025-03-14T05:49:23.0089054Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2025-03-14T05:49:23.0090275Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2025-03-14T05:49:23.0091172Z @llvm-project//llvm:IPO; 18s local 2025-03-14T05:49:23.0092182Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 13s local ... 2025-03-14T05:49:23.3054216Z 2025-03-14T05:49:23.3055077Z  2025-03-14T05:49:23.3055973Z  2025-03-14T05:49:23.3056434Z  2025-03-14T05:49:23.3056814Z  2025-03-14T05:49:23.3057197Z  2025-03-14T05:49:23.3057572Z  2025-03-14T05:49:23.3057957Z  2025-03-14T05:49:23.3058320Z  2025-03-14T05:49:23.3058914Z [14,333 / 15,235] 48 actions, 47 running 2025-03-14T05:49:23.3059711Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 43s local 2025-03-14T05:49:23.3060657Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T05:49:23.3061662Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T05:49:23.3062671Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2025-03-14T05:49:23.3063787Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2025-03-14T05:49:23.3064930Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2025-03-14T05:49:23.3066285Z @llvm-project//llvm:IPO; 18s local 2025-03-14T05:49:23.3067083Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local ... 2025-03-14T05:49:23.6002660Z 2025-03-14T05:49:23.6003529Z  2025-03-14T05:49:23.6004025Z  2025-03-14T05:49:23.6004407Z  2025-03-14T05:49:23.6004920Z  2025-03-14T05:49:23.6005325Z  2025-03-14T05:49:23.6005715Z  2025-03-14T05:49:23.6006104Z  2025-03-14T05:49:23.6006481Z  2025-03-14T05:49:23.6007030Z [14,335 / 15,235] 48 actions running 2025-03-14T05:49:23.6007952Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T05:49:23.6009030Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T05:49:23.6010098Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T05:49:23.6011221Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 20s local 2025-03-14T05:49:23.6012402Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2025-03-14T05:49:23.6013309Z @llvm-project//llvm:IPO; 18s local 2025-03-14T05:49:23.6014105Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2025-03-14T05:49:23.6015416Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 13s local ... 2025-03-14T05:49:23.8006261Z 2025-03-14T05:49:23.8007150Z  2025-03-14T05:49:23.8007637Z  2025-03-14T05:49:23.8008036Z  2025-03-14T05:49:23.8008407Z  2025-03-14T05:49:23.8008766Z  2025-03-14T05:49:23.8009149Z  2025-03-14T05:49:23.8009566Z  2025-03-14T05:49:23.8009937Z  2025-03-14T05:49:23.8010494Z [14,336 / 15,235] 48 actions running 2025-03-14T05:49:23.8011317Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T05:49:23.8012286Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T05:49:23.8013293Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T05:49:23.8014394Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2025-03-14T05:49:23.8015464Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2025-03-14T05:49:23.8016300Z @llvm-project//llvm:IPO; 19s local 2025-03-14T05:49:23.8017020Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2025-03-14T05:49:23.8017890Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local ... 2025-03-14T05:49:24.1767003Z 2025-03-14T05:49:24.1767847Z  2025-03-14T05:49:24.1768261Z  2025-03-14T05:49:24.1768902Z  2025-03-14T05:49:24.1769253Z  2025-03-14T05:49:24.1769612Z  2025-03-14T05:49:24.1769946Z  2025-03-14T05:49:24.1770304Z  2025-03-14T05:49:24.1770639Z  2025-03-14T05:49:24.1771189Z [14,337 / 15,235] 48 actions, 47 running 2025-03-14T05:49:24.1772010Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T05:49:24.1773003Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T05:49:24.1774180Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T05:49:24.1775228Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2025-03-14T05:49:24.1776254Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2025-03-14T05:49:24.1777002Z @llvm-project//llvm:IPO; 19s local 2025-03-14T05:49:24.1777682Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2025-03-14T05:49:24.1778549Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local ... 2025-03-14T05:49:24.4012586Z 2025-03-14T05:49:24.4013460Z  2025-03-14T05:49:24.4013964Z  2025-03-14T05:49:24.4014350Z  2025-03-14T05:49:24.4014735Z  2025-03-14T05:49:24.4015122Z  2025-03-14T05:49:24.4015514Z  2025-03-14T05:49:24.4015907Z  2025-03-14T05:49:24.4016305Z  2025-03-14T05:49:24.4017219Z [14,338 / 15,235] 48 actions running 2025-03-14T05:49:24.4018098Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T05:49:24.4019265Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T05:49:24.4020349Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T05:49:24.4021479Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2025-03-14T05:49:24.4022576Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2025-03-14T05:49:24.4023446Z @llvm-project//llvm:IPO; 19s local 2025-03-14T05:49:24.4024227Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2025-03-14T05:49:24.4025102Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local ... 2025-03-14T05:49:24.7760971Z 2025-03-14T05:49:24.7761845Z  2025-03-14T05:49:24.7762351Z  2025-03-14T05:49:24.7762765Z  2025-03-14T05:49:24.7763194Z  2025-03-14T05:49:24.7763639Z  2025-03-14T05:49:24.7764070Z  2025-03-14T05:49:24.7764501Z  2025-03-14T05:49:24.7765023Z  2025-03-14T05:49:24.7765825Z [14,339 / 15,235] 48 actions, 47 running 2025-03-14T05:49:24.7767034Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T05:49:24.7768073Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T05:49:24.7769167Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T05:49:24.7770301Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2025-03-14T05:49:24.7771468Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2025-03-14T05:49:24.7772373Z @llvm-project//llvm:IPO; 20s local 2025-03-14T05:49:24.7773181Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2025-03-14T05:49:24.7774139Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local ... 2025-03-14T05:49:25.0018884Z 2025-03-14T05:49:25.0019724Z  2025-03-14T05:49:25.0020228Z  2025-03-14T05:49:25.0020630Z  2025-03-14T05:49:25.0021027Z  2025-03-14T05:49:25.0021477Z  2025-03-14T05:49:25.0021876Z  2025-03-14T05:49:25.0022288Z  2025-03-14T05:49:25.0022651Z  2025-03-14T05:49:25.0023205Z [14,340 / 15,235] 48 actions running 2025-03-14T05:49:25.0024080Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T05:49:25.0025163Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T05:49:25.0026466Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T05:49:25.0027606Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2025-03-14T05:49:25.0028753Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2025-03-14T05:49:25.0029577Z @llvm-project//llvm:IPO; 20s local 2025-03-14T05:49:25.0030334Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2025-03-14T05:49:25.0031321Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local ... 2025-03-14T05:49:25.3032995Z 2025-03-14T05:49:25.3034145Z  2025-03-14T05:49:25.3034716Z  2025-03-14T05:49:25.3035130Z  2025-03-14T05:49:25.3035532Z  2025-03-14T05:49:25.3035916Z  2025-03-14T05:49:25.3036288Z  2025-03-14T05:49:25.3036659Z  2025-03-14T05:49:25.3037027Z  2025-03-14T05:49:25.3037687Z [14,344 / 15,235] 48 actions, 47 running 2025-03-14T05:49:25.3038607Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T05:49:25.3039733Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T05:49:25.3040883Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2025-03-14T05:49:25.3042028Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2025-03-14T05:49:25.3042888Z @llvm-project//llvm:IPO; 20s local 2025-03-14T05:49:25.3043905Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T05:49:25.3044971Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T05:49:25.3045944Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local ... 2025-03-14T05:49:25.6025950Z 2025-03-14T05:49:25.6026807Z  2025-03-14T05:49:25.6027293Z  2025-03-14T05:49:25.6027713Z  2025-03-14T05:49:25.6028119Z  2025-03-14T05:49:25.6028535Z  2025-03-14T05:49:25.6028935Z  2025-03-14T05:49:25.6029331Z  2025-03-14T05:49:25.6029735Z  2025-03-14T05:49:25.6030364Z [14,345 / 15,235] 48 actions running 2025-03-14T05:49:25.6031303Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T05:49:25.6032411Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2025-03-14T05:49:25.6033573Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2025-03-14T05:49:25.6034856Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2025-03-14T05:49:25.6035734Z @llvm-project//llvm:IPO; 20s local 2025-03-14T05:49:25.6036516Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T05:49:25.6037767Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T05:49:25.6038745Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local ... 2025-03-14T05:49:26.6925261Z 2025-03-14T05:49:26.6926174Z  2025-03-14T05:49:26.6926680Z  2025-03-14T05:49:26.6927091Z  2025-03-14T05:49:26.6927495Z  2025-03-14T05:49:26.6927874Z  2025-03-14T05:49:26.6928274Z  2025-03-14T05:49:26.6928669Z  2025-03-14T05:49:26.6929068Z  2025-03-14T05:49:26.6929647Z [14,346 / 15,235] 48 actions, 47 running 2025-03-14T05:49:26.6930567Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2025-03-14T05:49:26.6931566Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2025-03-14T05:49:26.6932689Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2025-03-14T05:49:26.6933862Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2025-03-14T05:49:26.6934756Z @llvm-project//llvm:IPO; 21s local 2025-03-14T05:49:26.6935542Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T05:49:26.6936515Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T05:49:26.6937486Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local ... 2025-03-14T05:49:26.9509133Z 2025-03-14T05:49:26.9510276Z  2025-03-14T05:49:26.9510822Z  2025-03-14T05:49:26.9511256Z  2025-03-14T05:49:26.9511663Z  2025-03-14T05:49:26.9512091Z  2025-03-14T05:49:26.9512600Z  2025-03-14T05:49:26.9513019Z  2025-03-14T05:49:26.9513433Z  2025-03-14T05:49:26.9514048Z [14,348 / 15,235] 48 actions, 47 running 2025-03-14T05:49:26.9515009Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T05:49:26.9516353Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2025-03-14T05:49:26.9517552Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2025-03-14T05:49:26.9518802Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2025-03-14T05:49:26.9519726Z @llvm-project//llvm:IPO; 22s local 2025-03-14T05:49:26.9520576Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T05:49:26.9521586Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T05:49:26.9522638Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local ... 2025-03-14T05:49:27.2036864Z 2025-03-14T05:49:27.2037705Z  2025-03-14T05:49:27.2038193Z  2025-03-14T05:49:27.2038590Z  2025-03-14T05:49:27.2038996Z  2025-03-14T05:49:27.2039377Z  2025-03-14T05:49:27.2039792Z  2025-03-14T05:49:27.2040451Z  2025-03-14T05:49:27.2040868Z  2025-03-14T05:49:27.2041423Z [14,348 / 15,235] 48 actions running 2025-03-14T05:49:27.2042342Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T05:49:27.2043426Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2025-03-14T05:49:27.2044644Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2025-03-14T05:49:27.2045966Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2025-03-14T05:49:27.2046869Z @llvm-project//llvm:IPO; 22s local 2025-03-14T05:49:27.2047724Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 18s local 2025-03-14T05:49:27.2048801Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T05:49:27.2049835Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local ... 2025-03-14T05:49:27.5741651Z 2025-03-14T05:49:27.5742566Z  2025-03-14T05:49:27.5743023Z  2025-03-14T05:49:27.5743436Z  2025-03-14T05:49:27.5743815Z  2025-03-14T05:49:27.5744194Z  2025-03-14T05:49:27.5744545Z  2025-03-14T05:49:27.5744935Z  2025-03-14T05:49:27.5745306Z  2025-03-14T05:49:27.5746141Z [14,349 / 15,235] 48 actions, 47 running 2025-03-14T05:49:27.5747015Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T05:49:27.5748032Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T05:49:27.5749165Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2025-03-14T05:49:27.5750352Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2025-03-14T05:49:27.5751192Z @llvm-project//llvm:IPO; 22s local 2025-03-14T05:49:27.5751911Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T05:49:27.5752814Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T05:49:27.5753797Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local ... 2025-03-14T05:49:27.8043251Z 2025-03-14T05:49:27.8044042Z  2025-03-14T05:49:27.8044524Z  2025-03-14T05:49:27.8045072Z  2025-03-14T05:49:27.8045596Z  2025-03-14T05:49:27.8046037Z  2025-03-14T05:49:27.8046465Z  2025-03-14T05:49:27.8046886Z  2025-03-14T05:49:27.8047271Z  2025-03-14T05:49:27.8047852Z [14,350 / 15,235] 48 actions running 2025-03-14T05:49:27.8048762Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T05:49:27.8049832Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T05:49:27.8051199Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2025-03-14T05:49:27.8052424Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2025-03-14T05:49:27.8053360Z @llvm-project//llvm:IPO; 23s local 2025-03-14T05:49:27.8054120Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T05:49:27.8055113Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T05:49:27.8056326Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 17s local ... 2025-03-14T05:49:28.0154040Z 2025-03-14T05:49:28.0154947Z  2025-03-14T05:49:28.0155454Z  2025-03-14T05:49:28.0155864Z  2025-03-14T05:49:28.0156292Z  2025-03-14T05:49:28.0156695Z  2025-03-14T05:49:28.0157213Z  2025-03-14T05:49:28.0157628Z  2025-03-14T05:49:28.0158041Z  2025-03-14T05:49:28.0158653Z [14,352 / 15,235] 47 actions, 46 running 2025-03-14T05:49:28.0159598Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T05:49:28.0160717Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T05:49:28.0161891Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2025-03-14T05:49:28.0163078Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2025-03-14T05:49:28.0164376Z @llvm-project//llvm:IPO; 23s local 2025-03-14T05:49:28.0165238Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T05:49:28.0166342Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T05:49:28.0167320Z Compiling llvm/lib/Target/X86/X86FrameLowering.cpp; 18s local ... 2025-03-14T05:49:28.2487296Z 2025-03-14T05:49:28.2488169Z  2025-03-14T05:49:28.2488674Z  2025-03-14T05:49:28.2489071Z  2025-03-14T05:49:28.2489470Z  2025-03-14T05:49:28.2489882Z  2025-03-14T05:49:28.2490292Z  2025-03-14T05:49:28.2490674Z  2025-03-14T05:49:28.2491092Z  2025-03-14T05:49:28.2491662Z [14,354 / 15,235] 48 actions, 47 running 2025-03-14T05:49:28.2492563Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T05:49:28.2503575Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T05:49:28.2505024Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2025-03-14T05:49:28.2506229Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2025-03-14T05:49:28.2507145Z @llvm-project//llvm:IPO; 23s local 2025-03-14T05:49:28.2508174Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T05:49:28.2509168Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T05:49:28.2510192Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local ... 2025-03-14T05:49:28.4963241Z 2025-03-14T05:49:28.4964072Z  2025-03-14T05:49:28.4964583Z  2025-03-14T05:49:28.4965247Z  2025-03-14T05:49:28.4965891Z  2025-03-14T05:49:28.4966282Z  2025-03-14T05:49:28.4966691Z  2025-03-14T05:49:28.4967092Z  2025-03-14T05:49:28.4967484Z  2025-03-14T05:49:28.4968065Z [14,355 / 15,235] 48 actions, 47 running 2025-03-14T05:49:28.4968985Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T05:49:28.4970127Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T05:49:28.4971370Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2025-03-14T05:49:28.4972605Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2025-03-14T05:49:28.4973660Z @llvm-project//llvm:IPO; 23s local 2025-03-14T05:49:28.4974419Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T05:49:28.4975429Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T05:49:28.4976468Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local ... 2025-03-14T05:49:28.8078160Z 2025-03-14T05:49:28.8078989Z  2025-03-14T05:49:28.8079492Z  2025-03-14T05:49:28.8079934Z  2025-03-14T05:49:28.8080348Z  2025-03-14T05:49:28.8080759Z  2025-03-14T05:49:28.8081169Z  2025-03-14T05:49:28.8081577Z  2025-03-14T05:49:28.8081981Z  2025-03-14T05:49:28.8082577Z [14,357 / 15,235] 48 actions running 2025-03-14T05:49:28.8083588Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T05:49:28.8085093Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T05:49:28.8086347Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2025-03-14T05:49:28.8087631Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2025-03-14T05:49:28.8088567Z @llvm-project//llvm:IPO; 24s local 2025-03-14T05:49:28.8089301Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T05:49:28.8090271Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T05:49:28.8091336Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local ... 2025-03-14T05:49:29.0075229Z 2025-03-14T05:49:29.0076059Z  2025-03-14T05:49:29.0076577Z  2025-03-14T05:49:29.0076996Z  2025-03-14T05:49:29.0077396Z  2025-03-14T05:49:29.0077835Z  2025-03-14T05:49:29.0078519Z  2025-03-14T05:49:29.0078953Z  2025-03-14T05:49:29.0079392Z  2025-03-14T05:49:29.0080005Z [14,358 / 15,235] 48 actions running 2025-03-14T05:49:29.0080923Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T05:49:29.0082074Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T05:49:29.0083314Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2025-03-14T05:49:29.0084586Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2025-03-14T05:49:29.0085651Z @llvm-project//llvm:IPO; 24s local 2025-03-14T05:49:29.0086474Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T05:49:29.0087470Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T05:49:29.0088466Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local ... 2025-03-14T05:49:29.4079790Z 2025-03-14T05:49:29.4080662Z  2025-03-14T05:49:29.4081197Z  2025-03-14T05:49:29.4081613Z  2025-03-14T05:49:29.4082026Z  2025-03-14T05:49:29.4082411Z  2025-03-14T05:49:29.4082825Z  2025-03-14T05:49:29.4083218Z  2025-03-14T05:49:29.4083951Z  2025-03-14T05:49:29.4084522Z [14,360 / 15,235] 48 actions running 2025-03-14T05:49:29.4085524Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T05:49:29.4086642Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T05:49:29.4087836Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2025-03-14T05:49:29.4088966Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2025-03-14T05:49:29.4089856Z @llvm-project//llvm:IPO; 24s local 2025-03-14T05:49:29.4090575Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T05:49:29.4091546Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T05:49:29.4092691Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local ... 2025-03-14T05:49:29.6182975Z 2025-03-14T05:49:29.6183820Z  2025-03-14T05:49:29.6184337Z  2025-03-14T05:49:29.6184754Z  2025-03-14T05:49:29.6185169Z  2025-03-14T05:49:29.6185544Z  2025-03-14T05:49:29.6185923Z  2025-03-14T05:49:29.6186316Z  2025-03-14T05:49:29.6186695Z  2025-03-14T05:49:29.6187284Z [14,361 / 15,235] 48 actions, 47 running 2025-03-14T05:49:29.6188147Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T05:49:29.6189462Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2025-03-14T05:49:29.6190594Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2025-03-14T05:49:29.6191662Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2025-03-14T05:49:29.6192472Z @llvm-project//llvm:IPO; 24s local 2025-03-14T05:49:29.6193163Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T05:49:29.6194130Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T05:49:29.6195381Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local ... 2025-03-14T05:49:30.0086115Z 2025-03-14T05:49:30.0086920Z  2025-03-14T05:49:30.0087421Z  2025-03-14T05:49:30.0087838Z  2025-03-14T05:49:30.0088233Z  2025-03-14T05:49:30.0088639Z  2025-03-14T05:49:30.0089029Z  2025-03-14T05:49:30.0089449Z  2025-03-14T05:49:30.0089830Z  2025-03-14T05:49:30.0090417Z [14,362 / 15,235] 48 actions running 2025-03-14T05:49:30.0091343Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T05:49:30.0092486Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2025-03-14T05:49:30.0093632Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2025-03-14T05:49:30.0094843Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T05:49:30.0096034Z @llvm-project//llvm:IPO; 25s local 2025-03-14T05:49:30.0096796Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T05:49:30.0097741Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T05:49:30.0098699Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local ... 2025-03-14T05:49:30.3178738Z 2025-03-14T05:49:30.3179545Z  2025-03-14T05:49:30.3180068Z  2025-03-14T05:49:30.3180474Z  2025-03-14T05:49:30.3180886Z  2025-03-14T05:49:30.3181289Z  2025-03-14T05:49:30.3181721Z  2025-03-14T05:49:30.3182164Z  2025-03-14T05:49:30.3182561Z  2025-03-14T05:49:30.3183202Z [14,364 / 15,235] 48 actions, 47 running 2025-03-14T05:49:30.3184125Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T05:49:30.3185311Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2025-03-14T05:49:30.3186726Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2025-03-14T05:49:30.3187971Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T05:49:30.3188903Z @llvm-project//llvm:IPO; 25s local 2025-03-14T05:49:30.3189891Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T05:49:30.3190866Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T05:49:30.3191928Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local ... 2025-03-14T05:49:30.5562732Z 2025-03-14T05:49:30.5563538Z  2025-03-14T05:49:30.5563961Z  2025-03-14T05:49:30.5564349Z  2025-03-14T05:49:30.5564812Z  2025-03-14T05:49:30.5565156Z  2025-03-14T05:49:30.5565733Z  2025-03-14T05:49:30.5566074Z  2025-03-14T05:49:30.5566405Z  2025-03-14T05:49:30.5566920Z [14,365 / 15,235] 48 actions, 47 running 2025-03-14T05:49:30.5567655Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T05:49:30.5568548Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2025-03-14T05:49:30.5569533Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2025-03-14T05:49:30.5570558Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T05:49:30.5571292Z @llvm-project//llvm:IPO; 25s local 2025-03-14T05:49:30.5571907Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T05:49:30.5572700Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T05:49:30.5573837Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 20s local ... 2025-03-14T05:49:30.8095500Z 2025-03-14T05:49:30.8096445Z  2025-03-14T05:49:30.8096946Z  2025-03-14T05:49:30.8097375Z  2025-03-14T05:49:30.8097772Z  2025-03-14T05:49:30.8098199Z  2025-03-14T05:49:30.8098586Z  2025-03-14T05:49:30.8098987Z  2025-03-14T05:49:30.8099391Z  2025-03-14T05:49:30.8100022Z [14,365 / 15,235] 48 actions running 2025-03-14T05:49:30.8101251Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T05:49:30.8102506Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2025-03-14T05:49:30.8103830Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2025-03-14T05:49:30.8105192Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T05:49:30.8106193Z @llvm-project//llvm:IPO; 26s local 2025-03-14T05:49:30.8107052Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T05:49:30.8108093Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T05:49:30.8109116Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 20s local ... 2025-03-14T05:49:31.0098957Z 2025-03-14T05:49:31.0099842Z  2025-03-14T05:49:31.0100320Z  2025-03-14T05:49:31.0100681Z  2025-03-14T05:49:31.0101073Z  2025-03-14T05:49:31.0101792Z  2025-03-14T05:49:31.0102202Z  2025-03-14T05:49:31.0102635Z  2025-03-14T05:49:31.0103053Z  2025-03-14T05:49:31.0103657Z [14,367 / 15,235] 48 actions running 2025-03-14T05:49:31.0104601Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T05:49:31.0105747Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2025-03-14T05:49:31.0106997Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2025-03-14T05:49:31.0108245Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2025-03-14T05:49:31.0109137Z @llvm-project//llvm:IPO; 26s local 2025-03-14T05:49:31.0109901Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T05:49:31.0110821Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T05:49:31.0111942Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 18s local ... 2025-03-14T05:49:31.8808801Z 2025-03-14T05:49:31.8809662Z  2025-03-14T05:49:31.8810168Z  2025-03-14T05:49:31.8810592Z  2025-03-14T05:49:31.8811015Z  2025-03-14T05:49:31.8811472Z  2025-03-14T05:49:31.8811892Z  2025-03-14T05:49:31.8812557Z  2025-03-14T05:49:31.8812971Z  2025-03-14T05:49:31.8813586Z [14,368 / 15,235] 48 actions, 47 running 2025-03-14T05:49:31.8814526Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2025-03-14T05:49:31.8815648Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 30s local 2025-03-14T05:49:31.8816863Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2025-03-14T05:49:31.8818092Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2025-03-14T05:49:31.8819008Z @llvm-project//llvm:IPO; 27s local 2025-03-14T05:49:31.8819762Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T05:49:31.8820745Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T05:49:31.8821799Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local ... 2025-03-14T05:49:32.1945792Z 2025-03-14T05:49:32.1946761Z  2025-03-14T05:49:32.1947247Z  2025-03-14T05:49:32.1947611Z  2025-03-14T05:49:32.1948012Z  2025-03-14T05:49:32.1948371Z  2025-03-14T05:49:32.1948722Z  2025-03-14T05:49:32.1949110Z  2025-03-14T05:49:32.1949503Z  2025-03-14T05:49:32.1950064Z [14,371 / 15,235] 48 actions, 47 running 2025-03-14T05:49:32.1950877Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2025-03-14T05:49:32.1952137Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2025-03-14T05:49:32.1953209Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2025-03-14T05:49:32.1954031Z @llvm-project//llvm:IPO; 27s local 2025-03-14T05:49:32.1954683Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T05:49:32.1955559Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T05:49:32.1956564Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local 2025-03-14T05:49:32.1957480Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local ... 2025-03-14T05:49:32.4107795Z 2025-03-14T05:49:32.4108614Z  2025-03-14T05:49:32.4109081Z  2025-03-14T05:49:32.4109457Z  2025-03-14T05:49:32.4109843Z  2025-03-14T05:49:32.4110220Z  2025-03-14T05:49:32.4110595Z  2025-03-14T05:49:32.4110965Z  2025-03-14T05:49:32.4111327Z  2025-03-14T05:49:32.4111898Z [14,371 / 15,235] 48 actions running 2025-03-14T05:49:32.4112752Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2025-03-14T05:49:32.4113818Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2025-03-14T05:49:32.4114919Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2025-03-14T05:49:32.4116030Z @llvm-project//llvm:IPO; 27s local 2025-03-14T05:49:32.4116711Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T05:49:32.4117695Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T05:49:32.4118568Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local 2025-03-14T05:49:32.4119399Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local ... 2025-03-14T05:49:32.8112877Z 2025-03-14T05:49:32.8113720Z  2025-03-14T05:49:32.8114165Z  2025-03-14T05:49:32.8114516Z  2025-03-14T05:49:32.8114864Z  2025-03-14T05:49:32.8115211Z  2025-03-14T05:49:32.8115597Z  2025-03-14T05:49:32.8115941Z  2025-03-14T05:49:32.8116300Z  2025-03-14T05:49:32.8116804Z [14,372 / 15,235] 48 actions running 2025-03-14T05:49:32.8117604Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T05:49:32.8118629Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2025-03-14T05:49:32.8119665Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 29s local 2025-03-14T05:49:32.8120449Z @llvm-project//llvm:IPO; 28s local 2025-03-14T05:49:32.8121089Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T05:49:32.8122185Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T05:49:32.8123023Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2025-03-14T05:49:32.8123844Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local ... 2025-03-14T05:49:33.1788225Z 2025-03-14T05:49:33.1789102Z  2025-03-14T05:49:33.1789561Z  2025-03-14T05:49:33.1789942Z  2025-03-14T05:49:33.1790353Z  2025-03-14T05:49:33.1790764Z  2025-03-14T05:49:33.1791158Z  2025-03-14T05:49:33.1791501Z  2025-03-14T05:49:33.1791854Z  2025-03-14T05:49:33.1792581Z [14,373 / 15,235] 48 actions, 47 running 2025-03-14T05:49:33.1793410Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T05:49:33.1794502Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2025-03-14T05:49:33.1795564Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 29s local 2025-03-14T05:49:33.1796384Z @llvm-project//llvm:IPO; 28s local 2025-03-14T05:49:33.1797060Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T05:49:33.1797871Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T05:49:33.1798745Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2025-03-14T05:49:33.1799942Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local ... 2025-03-14T05:49:33.4119031Z 2025-03-14T05:49:33.4119853Z  2025-03-14T05:49:33.4120263Z  2025-03-14T05:49:33.4120625Z  2025-03-14T05:49:33.4120930Z  2025-03-14T05:49:33.4121270Z  2025-03-14T05:49:33.4121607Z  2025-03-14T05:49:33.4121931Z  2025-03-14T05:49:33.4122305Z  2025-03-14T05:49:33.4122779Z [14,373 / 15,235] 48 actions running 2025-03-14T05:49:33.4123796Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T05:49:33.4124868Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2025-03-14T05:49:33.4125829Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 29s local 2025-03-14T05:49:33.4126546Z @llvm-project//llvm:IPO; 28s local 2025-03-14T05:49:33.4127145Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T05:49:33.4127914Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T05:49:33.4128727Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2025-03-14T05:49:33.4129551Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local ... 2025-03-14T05:49:33.8102992Z 2025-03-14T05:49:33.8103866Z  2025-03-14T05:49:33.8104445Z  2025-03-14T05:49:33.8104872Z  2025-03-14T05:49:33.8105282Z  2025-03-14T05:49:33.8106029Z  2025-03-14T05:49:33.8106453Z  2025-03-14T05:49:33.8106865Z  2025-03-14T05:49:33.8107284Z  2025-03-14T05:49:33.8107918Z [14,375 / 15,235] 48 actions, 47 running 2025-03-14T05:49:33.8108831Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T05:49:33.8110154Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2025-03-14T05:49:33.8111140Z @llvm-project//llvm:IPO; 29s local 2025-03-14T05:49:33.8111861Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 24s local 2025-03-14T05:49:33.8112797Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T05:49:33.8113792Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2025-03-14T05:49:33.8114742Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2025-03-14T05:49:33.8115661Z @llvm-project//mlir:SparseTensorDialect; 18s local ... 2025-03-14T05:49:34.0128129Z 2025-03-14T05:49:34.0129364Z  2025-03-14T05:49:34.0129885Z  2025-03-14T05:49:34.0130312Z  2025-03-14T05:49:34.0130732Z  2025-03-14T05:49:34.0131174Z  2025-03-14T05:49:34.0131597Z  2025-03-14T05:49:34.0132225Z  2025-03-14T05:49:34.0132603Z  2025-03-14T05:49:34.0133213Z [14,376 / 15,235] 48 actions running 2025-03-14T05:49:34.0134163Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T05:49:34.0135374Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2025-03-14T05:49:34.0136484Z @llvm-project//llvm:IPO; 29s local 2025-03-14T05:49:34.0137305Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T05:49:34.0138296Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2025-03-14T05:49:34.0139251Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2025-03-14T05:49:34.0140072Z @llvm-project//mlir:SparseTensorDialect; 18s local 2025-03-14T05:49:34.0141206Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local ... 2025-03-14T05:49:34.2132999Z 2025-03-14T05:49:34.2133922Z  2025-03-14T05:49:34.2134478Z  2025-03-14T05:49:34.2134913Z  2025-03-14T05:49:34.2135317Z  2025-03-14T05:49:34.2135726Z  2025-03-14T05:49:34.2136135Z  2025-03-14T05:49:34.2136541Z  2025-03-14T05:49:34.2136947Z  2025-03-14T05:49:34.2137552Z [14,377 / 15,235] 48 actions running 2025-03-14T05:49:34.2138450Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T05:49:34.2139848Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2025-03-14T05:49:34.2140998Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T05:49:34.2141914Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2025-03-14T05:49:34.2142826Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2025-03-14T05:49:34.2143697Z @llvm-project//mlir:SparseTensorDialect; 18s local 2025-03-14T05:49:34.2144613Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T05:49:34.2145916Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 11s local ... 2025-03-14T05:49:34.5556642Z 2025-03-14T05:49:34.5557548Z  2025-03-14T05:49:34.5558085Z  2025-03-14T05:49:34.5558499Z  2025-03-14T05:49:34.5558868Z  2025-03-14T05:49:34.5559231Z  2025-03-14T05:49:34.5559628Z  2025-03-14T05:49:34.5560006Z  2025-03-14T05:49:34.5560396Z  2025-03-14T05:49:34.5561085Z [14,379 / 15,235] 48 actions, 47 running 2025-03-14T05:49:34.5561976Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T05:49:34.5563175Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2025-03-14T05:49:34.5564349Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T05:49:34.5565671Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2025-03-14T05:49:34.5566942Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2025-03-14T05:49:34.5567787Z @llvm-project//mlir:SparseTensorDialect; 19s local 2025-03-14T05:49:34.5568682Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T05:49:34.5569696Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local ... 2025-03-14T05:49:34.8138204Z 2025-03-14T05:49:34.8139062Z  2025-03-14T05:49:34.8139539Z  2025-03-14T05:49:34.8139940Z  2025-03-14T05:49:34.8140343Z  2025-03-14T05:49:34.8140749Z  2025-03-14T05:49:34.8141180Z  2025-03-14T05:49:34.8141586Z  2025-03-14T05:49:34.8141961Z  2025-03-14T05:49:34.8142516Z [14,381 / 15,235] 48 actions running 2025-03-14T05:49:34.8143439Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2025-03-14T05:49:34.8144551Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2025-03-14T05:49:34.8145703Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T05:49:34.8146693Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2025-03-14T05:49:34.8148362Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2025-03-14T05:49:34.8149392Z @llvm-project//mlir:SparseTensorDialect; 19s local 2025-03-14T05:49:34.8150396Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local 2025-03-14T05:49:34.8151620Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 12s local ... 2025-03-14T05:49:35.0142461Z 2025-03-14T05:49:35.0143296Z  2025-03-14T05:49:35.0143787Z  2025-03-14T05:49:35.0144365Z  2025-03-14T05:49:35.0144760Z  2025-03-14T05:49:35.0145263Z  2025-03-14T05:49:35.0145736Z  2025-03-14T05:49:35.0146205Z  2025-03-14T05:49:35.0146681Z  2025-03-14T05:49:35.0147897Z [14,382 / 15,235] 48 actions running 2025-03-14T05:49:35.0148748Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2025-03-14T05:49:35.0149850Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2025-03-14T05:49:35.0150903Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T05:49:35.0151770Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2025-03-14T05:49:35.0152595Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2025-03-14T05:49:35.0153359Z @llvm-project//mlir:SparseTensorDialect; 19s local 2025-03-14T05:49:35.0154305Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local 2025-03-14T05:49:35.0155605Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 12s local ... 2025-03-14T05:49:35.5292482Z 2025-03-14T05:49:35.5293372Z  2025-03-14T05:49:35.5293963Z  2025-03-14T05:49:35.5294398Z  2025-03-14T05:49:35.5294765Z  2025-03-14T05:49:35.5295155Z  2025-03-14T05:49:35.5295602Z  2025-03-14T05:49:35.5296045Z  2025-03-14T05:49:35.5296482Z  2025-03-14T05:49:35.5297120Z [14,383 / 15,235] 48 actions, 47 running 2025-03-14T05:49:35.5298252Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2025-03-14T05:49:35.5299401Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2025-03-14T05:49:35.5300492Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T05:49:35.5301437Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2025-03-14T05:49:35.5302363Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2025-03-14T05:49:35.5303074Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T05:49:35.5303898Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2025-03-14T05:49:35.5305042Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 13s local ... 2025-03-14T05:49:35.8149304Z 2025-03-14T05:49:35.8150261Z  2025-03-14T05:49:35.8151069Z  2025-03-14T05:49:35.8151893Z  2025-03-14T05:49:35.8152443Z  2025-03-14T05:49:35.8152958Z  2025-03-14T05:49:35.8153473Z  2025-03-14T05:49:35.8154006Z  2025-03-14T05:49:35.8154536Z  2025-03-14T05:49:35.8155259Z [14,383 / 15,235] 48 actions running 2025-03-14T05:49:35.8156280Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T05:49:35.8157560Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2025-03-14T05:49:35.8158849Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T05:49:35.8159982Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2025-03-14T05:49:35.8161049Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2025-03-14T05:49:35.8162027Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T05:49:35.8163055Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2025-03-14T05:49:35.8164284Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 13s local ... 2025-03-14T05:49:36.0153535Z 2025-03-14T05:49:36.0154434Z  2025-03-14T05:49:36.0154923Z  2025-03-14T05:49:36.0155367Z  2025-03-14T05:49:36.0155746Z  2025-03-14T05:49:36.0156455Z  2025-03-14T05:49:36.0156866Z  2025-03-14T05:49:36.0157257Z  2025-03-14T05:49:36.0157663Z  2025-03-14T05:49:36.0158242Z [14,384 / 15,235] 48 actions running 2025-03-14T05:49:36.0159195Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T05:49:36.0160748Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2025-03-14T05:49:36.0161987Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T05:49:36.0163194Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2025-03-14T05:49:36.0164225Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2025-03-14T05:49:36.0165485Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T05:49:36.0166580Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local 2025-03-14T05:49:36.0167785Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 13s local ... 2025-03-14T05:49:36.2899872Z 2025-03-14T05:49:36.2900749Z  2025-03-14T05:49:36.2901355Z  2025-03-14T05:49:36.2901828Z  2025-03-14T05:49:36.2902266Z  2025-03-14T05:49:36.2902769Z  2025-03-14T05:49:36.2903153Z  2025-03-14T05:49:36.2903555Z  2025-03-14T05:49:36.2904015Z  2025-03-14T05:49:36.2904636Z [14,385 / 15,235] 48 actions, 47 running 2025-03-14T05:49:36.2905824Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T05:49:36.2906989Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2025-03-14T05:49:36.2908115Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T05:49:36.2909119Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2025-03-14T05:49:36.2910006Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2025-03-14T05:49:36.2910998Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T05:49:36.2911943Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2025-03-14T05:49:36.2913123Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 13s local ... 2025-03-14T05:49:36.6162392Z 2025-03-14T05:49:36.6163286Z  2025-03-14T05:49:36.6163723Z  2025-03-14T05:49:36.6164235Z  2025-03-14T05:49:36.6164854Z  2025-03-14T05:49:36.6165465Z  2025-03-14T05:49:36.6165854Z  2025-03-14T05:49:36.6166254Z  2025-03-14T05:49:36.6166627Z  2025-03-14T05:49:36.6167307Z [14,385 / 15,235] 48 actions running 2025-03-14T05:49:36.6168206Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T05:49:36.6169390Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2025-03-14T05:49:36.6170533Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T05:49:36.6171600Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2025-03-14T05:49:36.6172435Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2025-03-14T05:49:36.6173283Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T05:49:36.6174199Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2025-03-14T05:49:36.6175387Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 14s local ... 2025-03-14T05:49:36.8166910Z 2025-03-14T05:49:36.8167762Z  2025-03-14T05:49:36.8168286Z  2025-03-14T05:49:36.8168933Z  2025-03-14T05:49:36.8169298Z  2025-03-14T05:49:36.8169671Z  2025-03-14T05:49:36.8170050Z  2025-03-14T05:49:36.8170528Z  2025-03-14T05:49:36.8170951Z  2025-03-14T05:49:36.8171502Z [14,387 / 15,235] 48 actions running 2025-03-14T05:49:36.8172440Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T05:49:36.8173677Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2025-03-14T05:49:36.8174544Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2025-03-14T05:49:36.8175709Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2025-03-14T05:49:36.8176495Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T05:49:36.8177387Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2025-03-14T05:49:36.8178413Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 14s local 2025-03-14T05:49:36.8179469Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 13s local ... 2025-03-14T05:49:37.3821742Z 2025-03-14T05:49:37.3822609Z  2025-03-14T05:49:37.3823192Z  2025-03-14T05:49:37.3823668Z  2025-03-14T05:49:37.3824136Z  2025-03-14T05:49:37.3824507Z  2025-03-14T05:49:37.3824971Z  2025-03-14T05:49:37.3825430Z  2025-03-14T05:49:37.3825932Z  2025-03-14T05:49:37.3826604Z [14,388 / 15,235] 48 actions, 47 running 2025-03-14T05:49:37.3827484Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T05:49:37.3828763Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2025-03-14T05:49:37.3829851Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2025-03-14T05:49:37.3830732Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2025-03-14T05:49:37.3831564Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T05:49:37.3832722Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T05:49:37.3833714Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local 2025-03-14T05:49:37.3834641Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 14s local ... 2025-03-14T05:49:37.6143048Z 2025-03-14T05:49:37.6143846Z  2025-03-14T05:49:37.6144280Z  2025-03-14T05:49:37.6144660Z  2025-03-14T05:49:37.6145057Z  2025-03-14T05:49:37.6145445Z  2025-03-14T05:49:37.6145815Z  2025-03-14T05:49:37.6146181Z  2025-03-14T05:49:37.6146817Z  2025-03-14T05:49:37.6147351Z [14,390 / 15,235] 48 actions, 47 running 2025-03-14T05:49:37.6148162Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T05:49:37.6149210Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2025-03-14T05:49:37.6150198Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2025-03-14T05:49:37.6151030Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2025-03-14T05:49:37.6151824Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T05:49:37.6152788Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T05:49:37.6153792Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local 2025-03-14T05:49:37.6154860Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 14s local ... 2025-03-14T05:49:37.8174081Z 2025-03-14T05:49:37.8174903Z  2025-03-14T05:49:37.8175300Z  2025-03-14T05:49:37.8175651Z  2025-03-14T05:49:37.8176044Z  2025-03-14T05:49:37.8176423Z  2025-03-14T05:49:37.8176747Z  2025-03-14T05:49:37.8177106Z  2025-03-14T05:49:37.8177468Z  2025-03-14T05:49:37.8177999Z [14,390 / 15,235] 48 actions running 2025-03-14T05:49:37.8178816Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T05:49:37.8179877Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2025-03-14T05:49:37.8180922Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2025-03-14T05:49:37.8181692Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2025-03-14T05:49:37.8182452Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T05:49:37.8183349Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T05:49:37.8184267Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local 2025-03-14T05:49:37.8185270Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 14s local ... 2025-03-14T05:49:38.2596690Z 2025-03-14T05:49:38.2597774Z  2025-03-14T05:49:38.2598277Z  2025-03-14T05:49:38.2598700Z  2025-03-14T05:49:38.2599131Z  2025-03-14T05:49:38.2599553Z  2025-03-14T05:49:38.2599971Z  2025-03-14T05:49:38.2600379Z  2025-03-14T05:49:38.2600816Z  2025-03-14T05:49:38.2601440Z [14,391 / 15,235] 48 actions, 47 running 2025-03-14T05:49:38.2602429Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T05:49:38.2603515Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2025-03-14T05:49:38.2604493Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2025-03-14T05:49:38.2605494Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T05:49:38.2606435Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T05:49:38.2607514Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 15s local 2025-03-14T05:49:38.2608669Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2025-03-14T05:49:38.2609754Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 14s local ... 2025-03-14T05:49:38.5000840Z 2025-03-14T05:49:38.5001640Z  2025-03-14T05:49:38.5002093Z  2025-03-14T05:49:38.5002538Z  2025-03-14T05:49:38.5002959Z  2025-03-14T05:49:38.5003353Z  2025-03-14T05:49:38.5003810Z  2025-03-14T05:49:38.5004358Z  2025-03-14T05:49:38.5005012Z  2025-03-14T05:49:38.5006023Z [14,393 / 15,235] 48 actions, 47 running 2025-03-14T05:49:38.5007140Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T05:49:38.5008255Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2025-03-14T05:49:38.5009218Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T05:49:38.5010207Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T05:49:38.5011354Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T05:49:38.5012374Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2025-03-14T05:49:38.5013432Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2025-03-14T05:49:38.5014410Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 15s local ... 2025-03-14T05:49:38.7002278Z 2025-03-14T05:49:38.7003154Z  2025-03-14T05:49:38.7003573Z  2025-03-14T05:49:38.7003929Z  2025-03-14T05:49:38.7004340Z  2025-03-14T05:49:38.7004849Z  2025-03-14T05:49:38.7005291Z  2025-03-14T05:49:38.7005808Z  2025-03-14T05:49:38.7006176Z  2025-03-14T05:49:38.7006820Z [14,395 / 15,235] 48 actions, 47 running 2025-03-14T05:49:38.7007701Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T05:49:38.7009050Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2025-03-14T05:49:38.7009990Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T05:49:38.7010782Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T05:49:38.7011644Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T05:49:38.7012646Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2025-03-14T05:49:38.7013607Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2025-03-14T05:49:38.7014525Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 15s local ... 2025-03-14T05:49:39.0189803Z 2025-03-14T05:49:39.0190631Z  2025-03-14T05:49:39.0191097Z  2025-03-14T05:49:39.0191505Z  2025-03-14T05:49:39.0191898Z  2025-03-14T05:49:39.0192295Z  2025-03-14T05:49:39.0192680Z  2025-03-14T05:49:39.0193054Z  2025-03-14T05:49:39.0193448Z  2025-03-14T05:49:39.0194000Z [14,396 / 15,235] 48 actions running 2025-03-14T05:49:39.0194920Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T05:49:39.0195979Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2025-03-14T05:49:39.0197257Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T05:49:39.0198093Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T05:49:39.0198991Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T05:49:39.0199989Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2025-03-14T05:49:39.0201034Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2025-03-14T05:49:39.0202034Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 15s local ... 2025-03-14T05:49:39.2193356Z 2025-03-14T05:49:39.2194208Z  2025-03-14T05:49:39.2194680Z  2025-03-14T05:49:39.2195122Z  2025-03-14T05:49:39.2195629Z  2025-03-14T05:49:39.2196129Z  2025-03-14T05:49:39.2196539Z  2025-03-14T05:49:39.2196892Z  2025-03-14T05:49:39.2197261Z  2025-03-14T05:49:39.2197879Z [14,398 / 15,235] 48 actions, 47 running 2025-03-14T05:49:39.2198723Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T05:49:39.2199690Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2025-03-14T05:49:39.2200588Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T05:49:39.2201466Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T05:49:39.2202541Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T05:49:39.2203956Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local 2025-03-14T05:49:39.2205241Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2025-03-14T05:49:39.2206295Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 15s local ... 2025-03-14T05:49:39.6177017Z 2025-03-14T05:49:39.6177886Z  2025-03-14T05:49:39.6178373Z  2025-03-14T05:49:39.6178760Z  2025-03-14T05:49:39.6179133Z  2025-03-14T05:49:39.6179538Z  2025-03-14T05:49:39.6180157Z  2025-03-14T05:49:39.6180554Z  2025-03-14T05:49:39.6180969Z  2025-03-14T05:49:39.6181589Z [14,401 / 15,235] 48 actions, 47 running 2025-03-14T05:49:39.6182456Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T05:49:39.6183467Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2025-03-14T05:49:39.6184340Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T05:49:39.6185173Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T05:49:39.6186078Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T05:49:39.6187129Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2025-03-14T05:49:39.6188198Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2025-03-14T05:49:39.6189433Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 16s local ... 2025-03-14T05:49:39.8199665Z 2025-03-14T05:49:39.8200462Z  2025-03-14T05:49:39.8200963Z  2025-03-14T05:49:39.8201354Z  2025-03-14T05:49:39.8201731Z  2025-03-14T05:49:39.8202103Z  2025-03-14T05:49:39.8202487Z  2025-03-14T05:49:39.8202899Z  2025-03-14T05:49:39.8203293Z  2025-03-14T05:49:39.8203875Z [14,401 / 15,235] 48 actions running 2025-03-14T05:49:39.8204913Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T05:49:39.8206064Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2025-03-14T05:49:39.8207060Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T05:49:39.8207988Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T05:49:39.8208920Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T05:49:39.8210006Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2025-03-14T05:49:39.8211183Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2025-03-14T05:49:39.8212295Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 16s local ... 2025-03-14T05:49:40.0203744Z 2025-03-14T05:49:40.0204571Z  2025-03-14T05:49:40.0205183Z  2025-03-14T05:49:40.0205576Z  2025-03-14T05:49:40.0205991Z  2025-03-14T05:49:40.0206437Z  2025-03-14T05:49:40.0206861Z  2025-03-14T05:49:40.0207247Z  2025-03-14T05:49:40.0207654Z  2025-03-14T05:49:40.0208252Z [14,404 / 15,235] 48 actions running 2025-03-14T05:49:40.0209160Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T05:49:40.0210192Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T05:49:40.0211099Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T05:49:40.0212064Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T05:49:40.0213166Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local 2025-03-14T05:49:40.0214298Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local 2025-03-14T05:49:40.0215322Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 16s local 2025-03-14T05:49:40.0216451Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local ... 2025-03-14T05:49:40.4785140Z 2025-03-14T05:49:40.4786058Z  2025-03-14T05:49:40.4786571Z  2025-03-14T05:49:40.4787046Z  2025-03-14T05:49:40.4787453Z  2025-03-14T05:49:40.4787831Z  2025-03-14T05:49:40.4788244Z  2025-03-14T05:49:40.4788975Z  2025-03-14T05:49:40.4789469Z  2025-03-14T05:49:40.4790168Z [14,405 / 15,235] 48 actions, 47 running 2025-03-14T05:49:40.4791116Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T05:49:40.4792137Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T05:49:40.4793019Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T05:49:40.4794054Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T05:49:40.4795419Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2025-03-14T05:49:40.4796552Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local 2025-03-14T05:49:40.4797604Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 16s local 2025-03-14T05:49:40.4798665Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local ... 2025-03-14T05:49:40.8211213Z 2025-03-14T05:49:40.8212058Z  2025-03-14T05:49:40.8212601Z  2025-03-14T05:49:40.8213118Z  2025-03-14T05:49:40.8213546Z  2025-03-14T05:49:40.8214052Z  2025-03-14T05:49:40.8214465Z  2025-03-14T05:49:40.8214976Z  2025-03-14T05:49:40.8215441Z  2025-03-14T05:49:40.8216002Z [14,407 / 15,235] 48 actions running 2025-03-14T05:49:40.8216898Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T05:49:40.8218271Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T05:49:40.8219180Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T05:49:40.8219952Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T05:49:40.8220837Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2025-03-14T05:49:40.8221822Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local 2025-03-14T05:49:40.8222835Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 17s local 2025-03-14T05:49:40.8223970Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local ... 2025-03-14T05:49:41.0214552Z 2025-03-14T05:49:41.0215456Z  2025-03-14T05:49:41.0215996Z  2025-03-14T05:49:41.0216378Z  2025-03-14T05:49:41.0216789Z  2025-03-14T05:49:41.0217206Z  2025-03-14T05:49:41.0217630Z  2025-03-14T05:49:41.0218099Z  2025-03-14T05:49:41.0218495Z  2025-03-14T05:49:41.0219114Z [14,409 / 15,235] 48 actions running 2025-03-14T05:49:41.0220078Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T05:49:41.0220990Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T05:49:41.0222060Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T05:49:41.0223022Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T05:49:41.0223956Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local 2025-03-14T05:49:41.0224998Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local 2025-03-14T05:49:41.0226172Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 17s local 2025-03-14T05:49:41.0227083Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local ... 2025-03-14T05:49:41.7945370Z 2025-03-14T05:49:41.7946249Z  2025-03-14T05:49:41.7946778Z  2025-03-14T05:49:41.7947170Z  2025-03-14T05:49:41.7947526Z  2025-03-14T05:49:41.7947923Z  2025-03-14T05:49:41.7948284Z  2025-03-14T05:49:41.7948662Z  2025-03-14T05:49:41.7949030Z  2025-03-14T05:49:41.7949750Z [14,410 / 15,235] 48 actions, 47 running 2025-03-14T05:49:41.7950587Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T05:49:41.7951507Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T05:49:41.7952304Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T05:49:41.7953297Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2025-03-14T05:49:41.7954710Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local 2025-03-14T05:49:41.7967469Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local 2025-03-14T05:49:41.7968782Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2025-03-14T05:49:41.7970020Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local ... 2025-03-14T05:49:42.0224465Z 2025-03-14T05:49:42.0225410Z  2025-03-14T05:49:42.0225913Z  2025-03-14T05:49:42.0226334Z  2025-03-14T05:49:42.0226757Z  2025-03-14T05:49:42.0227433Z  2025-03-14T05:49:42.0227865Z  2025-03-14T05:49:42.0228279Z  2025-03-14T05:49:42.0228675Z  2025-03-14T05:49:42.0229228Z [14,410 / 15,235] 48 actions running 2025-03-14T05:49:42.0230107Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T05:49:42.0231122Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T05:49:42.0231992Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T05:49:42.0232939Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2025-03-14T05:49:42.0233988Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local 2025-03-14T05:49:42.0235062Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 19s local 2025-03-14T05:49:42.0236072Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2025-03-14T05:49:42.0237312Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local ... 2025-03-14T05:49:42.2291671Z 2025-03-14T05:49:42.2292551Z  2025-03-14T05:49:42.2293070Z  2025-03-14T05:49:42.2293485Z  2025-03-14T05:49:42.2293877Z  2025-03-14T05:49:42.2294269Z  2025-03-14T05:49:42.2294657Z  2025-03-14T05:49:42.2295062Z  2025-03-14T05:49:42.2295451Z  2025-03-14T05:49:42.2296059Z [14,411 / 15,235] 48 actions, 47 running 2025-03-14T05:49:42.2296987Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T05:49:42.2298048Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T05:49:42.2298933Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T05:49:42.2299878Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2025-03-14T05:49:42.2300986Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 19s local 2025-03-14T05:49:42.2302033Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2025-03-14T05:49:42.2302970Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2025-03-14T05:49:42.2303975Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local ... 2025-03-14T05:49:42.4343653Z 2025-03-14T05:49:42.4344480Z  2025-03-14T05:49:42.4344911Z  2025-03-14T05:49:42.4345255Z  2025-03-14T05:49:42.4345628Z  2025-03-14T05:49:42.4346007Z  2025-03-14T05:49:42.4346379Z  2025-03-14T05:49:42.4346755Z  2025-03-14T05:49:42.4347126Z  2025-03-14T05:49:42.4347744Z [14,412 / 15,235] 48 actions, 47 running 2025-03-14T05:49:42.4348632Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T05:49:42.4349612Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T05:49:42.4350481Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T05:49:42.4351371Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T05:49:42.4352610Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 19s local 2025-03-14T05:49:42.4353644Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2025-03-14T05:49:42.4354651Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2025-03-14T05:49:42.4355701Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local ... 2025-03-14T05:49:42.7135626Z 2025-03-14T05:49:42.7136491Z  2025-03-14T05:49:42.7136933Z  2025-03-14T05:49:42.7137303Z  2025-03-14T05:49:42.7137667Z  2025-03-14T05:49:42.7138030Z  2025-03-14T05:49:42.7138652Z  2025-03-14T05:49:42.7139023Z  2025-03-14T05:49:42.7139392Z  2025-03-14T05:49:42.7139944Z [14,414 / 15,235] 48 actions, 47 running 2025-03-14T05:49:42.7140746Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T05:49:42.7141614Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T05:49:42.7142377Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T05:49:42.7143324Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T05:49:42.7144156Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2025-03-14T05:49:42.7144991Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2025-03-14T05:49:42.7145856Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2025-03-14T05:49:42.7146740Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 15s local ... 2025-03-14T05:49:43.0099198Z 2025-03-14T05:49:43.0100059Z  2025-03-14T05:49:43.0100550Z  2025-03-14T05:49:43.0100957Z  2025-03-14T05:49:43.0101344Z  2025-03-14T05:49:43.0101735Z  2025-03-14T05:49:43.0102125Z  2025-03-14T05:49:43.0102517Z  2025-03-14T05:49:43.0102909Z  2025-03-14T05:49:43.0103508Z [14,416 / 15,235] 48 actions, 47 running 2025-03-14T05:49:43.0104722Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2025-03-14T05:49:43.0105724Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T05:49:43.0106572Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T05:49:43.0107493Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T05:49:43.0108438Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2025-03-14T05:49:43.0109348Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T05:49:43.0110335Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 15s local 2025-03-14T05:49:43.0111335Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 14s local ... 2025-03-14T05:49:43.2233499Z 2025-03-14T05:49:43.2234327Z  2025-03-14T05:49:43.2234822Z  2025-03-14T05:49:43.2235253Z  2025-03-14T05:49:43.2235684Z  2025-03-14T05:49:43.2236049Z  2025-03-14T05:49:43.2236400Z  2025-03-14T05:49:43.2236810Z  2025-03-14T05:49:43.2237247Z  2025-03-14T05:49:43.2237766Z [14,416 / 15,235] 48 actions running 2025-03-14T05:49:43.2238484Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2025-03-14T05:49:43.2239755Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T05:49:43.2240559Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T05:49:43.2241424Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T05:49:43.2242344Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2025-03-14T05:49:43.2243199Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T05:49:43.2244160Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 15s local 2025-03-14T05:49:43.2245285Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 15s local ... 2025-03-14T05:49:43.4238078Z 2025-03-14T05:49:43.4238932Z  2025-03-14T05:49:43.4239443Z  2025-03-14T05:49:43.4239866Z  2025-03-14T05:49:43.4240334Z  2025-03-14T05:49:43.4240743Z  2025-03-14T05:49:43.4241160Z  2025-03-14T05:49:43.4241563Z  2025-03-14T05:49:43.4241987Z  2025-03-14T05:49:43.4242563Z [14,417 / 15,235] 48 actions running 2025-03-14T05:49:43.4243503Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2025-03-14T05:49:43.4244554Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T05:49:43.4245618Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T05:49:43.4246531Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2025-03-14T05:49:43.4247788Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2025-03-14T05:49:43.4248739Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T05:49:43.4249731Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 15s local 2025-03-14T05:49:43.4250744Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 15s local ... 2025-03-14T05:49:43.8136165Z 2025-03-14T05:49:43.8136978Z  2025-03-14T05:49:43.8137457Z  2025-03-14T05:49:43.8137863Z  2025-03-14T05:49:43.8138525Z  2025-03-14T05:49:43.8138943Z  2025-03-14T05:49:43.8139362Z  2025-03-14T05:49:43.8139778Z  2025-03-14T05:49:43.8140187Z  2025-03-14T05:49:43.8140799Z [14,418 / 15,235] 48 actions, 47 running 2025-03-14T05:49:43.8141707Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T05:49:43.8142733Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T05:49:43.8143627Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T05:49:43.8144562Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2025-03-14T05:49:43.8145547Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2025-03-14T05:49:43.8146466Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T05:49:43.8147452Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 16s local 2025-03-14T05:49:43.8148627Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 15s local ... 2025-03-14T05:49:44.0243397Z 2025-03-14T05:49:44.0244265Z  2025-03-14T05:49:44.0244946Z  2025-03-14T05:49:44.0245363Z  2025-03-14T05:49:44.0245787Z  2025-03-14T05:49:44.0246206Z  2025-03-14T05:49:44.0246603Z  2025-03-14T05:49:44.0247043Z  2025-03-14T05:49:44.0247453Z  2025-03-14T05:49:44.0248048Z [14,418 / 15,235] 48 actions running 2025-03-14T05:49:44.0248968Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T05:49:44.0250021Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T05:49:44.0250893Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T05:49:44.0251842Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2025-03-14T05:49:44.0252843Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2025-03-14T05:49:44.0253781Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T05:49:44.0254813Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 16s local 2025-03-14T05:49:44.0255951Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 16s local ... 2025-03-14T05:49:44.4176318Z 2025-03-14T05:49:44.4177172Z  2025-03-14T05:49:44.4177667Z  2025-03-14T05:49:44.4178107Z  2025-03-14T05:49:44.4178507Z  2025-03-14T05:49:44.4178899Z  2025-03-14T05:49:44.4179297Z  2025-03-14T05:49:44.4179710Z  2025-03-14T05:49:44.4180121Z  2025-03-14T05:49:44.4180752Z [14,419 / 15,235] 48 actions, 47 running 2025-03-14T05:49:44.4181647Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T05:49:44.4182639Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T05:49:44.4183479Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T05:49:44.4184288Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T05:49:44.4185294Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2025-03-14T05:49:44.4186346Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T05:49:44.4187320Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 16s local 2025-03-14T05:49:44.4188300Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 16s local ... 2025-03-14T05:49:44.6250907Z 2025-03-14T05:49:44.6251725Z  2025-03-14T05:49:44.6252231Z  2025-03-14T05:49:44.6252657Z  2025-03-14T05:49:44.6253072Z  2025-03-14T05:49:44.6253536Z  2025-03-14T05:49:44.6254301Z  2025-03-14T05:49:44.6254728Z  2025-03-14T05:49:44.6255128Z  2025-03-14T05:49:44.6255660Z [14,419 / 15,235] 48 actions running 2025-03-14T05:49:44.6256573Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T05:49:44.6257610Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T05:49:44.6258559Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T05:49:44.6259691Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T05:49:44.6260687Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2025-03-14T05:49:44.6261618Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T05:49:44.6262595Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 16s local 2025-03-14T05:49:44.6263693Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 16s local ... 2025-03-14T05:49:44.8254129Z 2025-03-14T05:49:44.8254984Z  2025-03-14T05:49:44.8255508Z  2025-03-14T05:49:44.8255903Z  2025-03-14T05:49:44.8256320Z  2025-03-14T05:49:44.8256742Z  2025-03-14T05:49:44.8257131Z  2025-03-14T05:49:44.8257498Z  2025-03-14T05:49:44.8257866Z  2025-03-14T05:49:44.8258388Z [14,420 / 15,235] 48 actions running 2025-03-14T05:49:44.8259393Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T05:49:44.8260732Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T05:49:44.8261647Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T05:49:44.8262590Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T05:49:44.8263573Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2025-03-14T05:49:44.8264516Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T05:49:44.8265908Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 17s local 2025-03-14T05:49:44.8267187Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 16s local ... 2025-03-14T05:49:45.2259270Z 2025-03-14T05:49:45.2260169Z  2025-03-14T05:49:45.2260687Z  2025-03-14T05:49:45.2261080Z  2025-03-14T05:49:45.2261493Z  2025-03-14T05:49:45.2261976Z  2025-03-14T05:49:45.2262481Z  2025-03-14T05:49:45.2262884Z  2025-03-14T05:49:45.2263424Z  2025-03-14T05:49:45.2264058Z [14,423 / 15,235] 48 actions running 2025-03-14T05:49:45.2265032Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T05:49:45.2266711Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T05:49:45.2267591Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T05:49:45.2268669Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T05:49:45.2269738Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2025-03-14T05:49:45.2270699Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T05:49:45.2271835Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 17s local 2025-03-14T05:49:45.2272931Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local ... 2025-03-14T05:49:45.6264425Z 2025-03-14T05:49:45.6265273Z  2025-03-14T05:49:45.6266017Z  2025-03-14T05:49:45.6266440Z  2025-03-14T05:49:45.6266795Z  2025-03-14T05:49:45.6267208Z  2025-03-14T05:49:45.6267581Z  2025-03-14T05:49:45.6267942Z  2025-03-14T05:49:45.6268321Z  2025-03-14T05:49:45.6268901Z [14,424 / 15,235] 48 actions running 2025-03-14T05:49:45.6269769Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T05:49:45.6270807Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T05:49:45.6271777Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T05:49:45.6272906Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T05:49:45.6274326Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 22s local 2025-03-14T05:49:45.6275337Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T05:49:45.6276460Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 17s local 2025-03-14T05:49:45.6277473Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local ... 2025-03-14T05:49:45.9301409Z 2025-03-14T05:49:45.9302280Z  2025-03-14T05:49:45.9302799Z  2025-03-14T05:49:45.9303238Z  2025-03-14T05:49:45.9303667Z  2025-03-14T05:49:45.9304329Z  2025-03-14T05:49:45.9304745Z  2025-03-14T05:49:45.9305152Z  2025-03-14T05:49:45.9305507Z  2025-03-14T05:49:45.9306082Z [14,425 / 15,235] 48 actions, 47 running 2025-03-14T05:49:45.9307028Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2025-03-14T05:49:45.9308106Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T05:49:45.9308969Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T05:49:45.9309832Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T05:49:45.9310666Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T05:49:45.9311830Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local 2025-03-14T05:49:45.9312985Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T05:49:45.9314138Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local ... 2025-03-14T05:49:46.2271112Z 2025-03-14T05:49:46.2272004Z  2025-03-14T05:49:46.2272619Z  2025-03-14T05:49:46.2273159Z  2025-03-14T05:49:46.2273563Z  2025-03-14T05:49:46.2274022Z  2025-03-14T05:49:46.2274488Z  2025-03-14T05:49:46.2274879Z  2025-03-14T05:49:46.2275252Z  2025-03-14T05:49:46.2275770Z [14,425 / 15,235] 48 actions running 2025-03-14T05:49:46.2276592Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2025-03-14T05:49:46.2277556Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T05:49:46.2278492Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T05:49:46.2279354Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T05:49:46.2280387Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T05:49:46.2281380Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local 2025-03-14T05:49:46.2282335Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T05:49:46.2283373Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 15s local ... 2025-03-14T05:49:46.4275602Z 2025-03-14T05:49:46.4276466Z  2025-03-14T05:49:46.4276922Z  2025-03-14T05:49:46.4277314Z  2025-03-14T05:49:46.4277724Z  2025-03-14T05:49:46.4278217Z  2025-03-14T05:49:46.4278712Z  2025-03-14T05:49:46.4279237Z  2025-03-14T05:49:46.4279656Z  2025-03-14T05:49:46.4280382Z [14,426 / 15,235] 48 actions running 2025-03-14T05:49:46.4281323Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2025-03-14T05:49:46.4282451Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T05:49:46.4283395Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T05:49:46.4284299Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2025-03-14T05:49:46.4285623Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T05:49:46.4286691Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local 2025-03-14T05:49:46.4287732Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T05:49:46.4288830Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local ... 2025-03-14T05:49:47.6283814Z 2025-03-14T05:49:47.6284810Z  2025-03-14T05:49:47.6285366Z  2025-03-14T05:49:47.6285800Z  2025-03-14T05:49:47.6286217Z  2025-03-14T05:49:47.6286629Z  2025-03-14T05:49:47.6287242Z  2025-03-14T05:49:47.6287663Z  2025-03-14T05:49:47.6288095Z  2025-03-14T05:49:47.6288787Z [14,426 / 15,235] 48 actions running 2025-03-14T05:49:47.6289760Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2025-03-14T05:49:47.6290847Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T05:49:47.6291735Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T05:49:47.6292946Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T05:49:47.6293978Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2025-03-14T05:49:47.6295000Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2025-03-14T05:49:47.6295885Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T05:49:47.6296828Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local ... 2025-03-14T05:49:47.8645785Z 2025-03-14T05:49:47.8646662Z  2025-03-14T05:49:47.8647157Z  2025-03-14T05:49:47.8647568Z  2025-03-14T05:49:47.8647987Z  2025-03-14T05:49:47.8648399Z  2025-03-14T05:49:47.8648790Z  2025-03-14T05:49:47.8649193Z  2025-03-14T05:49:47.8649591Z  2025-03-14T05:49:47.8650188Z [14,427 / 15,235] 48 actions, 47 running 2025-03-14T05:49:47.8651117Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T05:49:47.8652558Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T05:49:47.8653382Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T05:49:47.8654236Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T05:49:47.8655151Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T05:49:47.8656117Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2025-03-14T05:49:47.8657087Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T05:49:47.8658042Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local ... 2025-03-14T05:49:48.2289807Z 2025-03-14T05:49:48.2290655Z  2025-03-14T05:49:48.2291146Z  2025-03-14T05:49:48.2291551Z  2025-03-14T05:49:48.2291930Z  2025-03-14T05:49:48.2292323Z  2025-03-14T05:49:48.2292709Z  2025-03-14T05:49:48.2293116Z  2025-03-14T05:49:48.2293568Z  2025-03-14T05:49:48.2294135Z [14,427 / 15,235] 48 actions running 2025-03-14T05:49:48.2295006Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T05:49:48.2296304Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T05:49:48.2297119Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T05:49:48.2297971Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T05:49:48.2298940Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T05:49:48.2299818Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2025-03-14T05:49:48.2300772Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T05:49:48.2301722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local ... 2025-03-14T05:49:48.6040470Z 2025-03-14T05:49:48.6041275Z  2025-03-14T05:49:48.6041737Z  2025-03-14T05:49:48.6042179Z  2025-03-14T05:49:48.6042638Z  2025-03-14T05:49:48.6043055Z  2025-03-14T05:49:48.6043540Z  2025-03-14T05:49:48.6043938Z  2025-03-14T05:49:48.6044350Z  2025-03-14T05:49:48.6045087Z [14,428 / 15,235] 48 actions, 47 running 2025-03-14T05:49:48.6046165Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T05:49:48.6047147Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T05:49:48.6047983Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T05:49:48.6048930Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T05:49:48.6050219Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T05:49:48.6051139Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2025-03-14T05:49:48.6052208Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T05:49:48.6053109Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2025-03-14T05:49:48.8295570Z 2025-03-14T05:49:48.8296460Z  2025-03-14T05:49:48.8296955Z  2025-03-14T05:49:48.8297331Z  2025-03-14T05:49:48.8298002Z  2025-03-14T05:49:48.8298433Z  2025-03-14T05:49:48.8298804Z  2025-03-14T05:49:48.8299178Z  2025-03-14T05:49:48.8299564Z  2025-03-14T05:49:48.8300121Z [14,428 / 15,235] 48 actions running 2025-03-14T05:49:48.8300980Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T05:49:48.8301967Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T05:49:48.8302737Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T05:49:48.8303663Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T05:49:48.8304692Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T05:49:48.8305612Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2025-03-14T05:49:48.8306547Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T05:49:48.8307724Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2025-03-14T05:49:49.0967901Z 2025-03-14T05:49:49.0968731Z  2025-03-14T05:49:49.0969189Z  2025-03-14T05:49:49.0969565Z  2025-03-14T05:49:49.0969923Z  2025-03-14T05:49:49.0970296Z  2025-03-14T05:49:49.0970659Z  2025-03-14T05:49:49.0971002Z  2025-03-14T05:49:49.0971347Z  2025-03-14T05:49:49.0971880Z [14,429 / 15,235] 48 actions, 47 running 2025-03-14T05:49:49.0972661Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T05:49:49.0973558Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T05:49:49.0974324Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T05:49:49.0975115Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T05:49:49.0975959Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T05:49:49.0976822Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2025-03-14T05:49:49.0977674Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T05:49:49.0978535Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2025-03-14T05:49:49.4301680Z 2025-03-14T05:49:49.4302475Z  2025-03-14T05:49:49.4302896Z  2025-03-14T05:49:49.4303238Z  2025-03-14T05:49:49.4303585Z  2025-03-14T05:49:49.4303950Z  2025-03-14T05:49:49.4304319Z  2025-03-14T05:49:49.4304678Z  2025-03-14T05:49:49.4305043Z  2025-03-14T05:49:49.4305619Z [14,429 / 15,235] 48 actions running 2025-03-14T05:49:49.4306394Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T05:49:49.4307296Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T05:49:49.4308030Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T05:49:49.4308803Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2025-03-14T05:49:49.4309667Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T05:49:49.4310509Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2025-03-14T05:49:49.4311378Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T05:49:49.4312275Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local ... 2025-03-14T05:49:49.7176774Z 2025-03-14T05:49:49.7177517Z  2025-03-14T05:49:49.7177938Z  2025-03-14T05:49:49.7178282Z  2025-03-14T05:49:49.7178645Z  2025-03-14T05:49:49.7178996Z  2025-03-14T05:49:49.7179613Z  2025-03-14T05:49:49.7179970Z  2025-03-14T05:49:49.7180298Z  2025-03-14T05:49:49.7180822Z [14,430 / 15,235] 48 actions, 47 running 2025-03-14T05:49:49.7181609Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T05:49:49.7182490Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T05:49:49.7183268Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T05:49:49.7184244Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2025-03-14T05:49:49.7185261Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T05:49:49.7186271Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2025-03-14T05:49:49.7187143Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T05:49:49.7187988Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local ... 2025-03-14T05:49:50.0307944Z 2025-03-14T05:49:50.0308751Z  2025-03-14T05:49:50.0309225Z  2025-03-14T05:49:50.0309600Z  2025-03-14T05:49:50.0309986Z  2025-03-14T05:49:50.0310356Z  2025-03-14T05:49:50.0310727Z  2025-03-14T05:49:50.0311130Z  2025-03-14T05:49:50.0311518Z  2025-03-14T05:49:50.0312047Z [14,430 / 15,235] 48 actions running 2025-03-14T05:49:50.0313021Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2025-03-14T05:49:50.0314246Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T05:49:50.0315021Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T05:49:50.0315853Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2025-03-14T05:49:50.0316788Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T05:49:50.0317716Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2025-03-14T05:49:50.0318578Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T05:49:50.0319424Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local ... 2025-03-14T05:49:50.4312641Z 2025-03-14T05:49:50.4313443Z  2025-03-14T05:49:50.4313844Z  2025-03-14T05:49:50.4314178Z  2025-03-14T05:49:50.4314507Z  2025-03-14T05:49:50.4314833Z  2025-03-14T05:49:50.4315141Z  2025-03-14T05:49:50.4315469Z  2025-03-14T05:49:50.4315826Z  2025-03-14T05:49:50.4316295Z [14,431 / 15,235] 48 actions running 2025-03-14T05:49:50.4317041Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2025-03-14T05:49:50.4318101Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T05:49:50.4318781Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T05:49:50.4319501Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T05:49:50.4320285Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T05:49:50.4321065Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2025-03-14T05:49:50.4321823Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T05:49:50.4322572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local ... 2025-03-14T05:49:50.8725342Z 2025-03-14T05:49:50.8726196Z  2025-03-14T05:49:50.8726665Z  2025-03-14T05:49:50.8727132Z  2025-03-14T05:49:50.8727579Z  2025-03-14T05:49:50.8727958Z  2025-03-14T05:49:50.8728362Z  2025-03-14T05:49:50.8728746Z  2025-03-14T05:49:50.8729168Z  2025-03-14T05:49:50.8729761Z [14,432 / 15,235] 48 actions, 47 running 2025-03-14T05:49:50.8730654Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T05:49:50.8731583Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2025-03-14T05:49:50.8732429Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T05:49:50.8733438Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T05:49:50.8734668Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T05:49:50.8735632Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2025-03-14T05:49:50.8736591Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T05:49:50.8737598Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local ... 2025-03-14T05:49:51.2321101Z 2025-03-14T05:49:51.2321951Z  2025-03-14T05:49:51.2322456Z  2025-03-14T05:49:51.2322851Z  2025-03-14T05:49:51.2323524Z  2025-03-14T05:49:51.2323951Z  2025-03-14T05:49:51.2324390Z  2025-03-14T05:49:51.2324933Z  2025-03-14T05:49:51.2325321Z  2025-03-14T05:49:51.2325885Z [14,432 / 15,235] 48 actions running 2025-03-14T05:49:51.2326782Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T05:49:51.2327854Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2025-03-14T05:49:51.2328754Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T05:49:51.2329663Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T05:49:51.2330753Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T05:49:51.2331743Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2025-03-14T05:49:51.2332742Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T05:49:51.2333991Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local ... 2025-03-14T05:49:51.4406155Z 2025-03-14T05:49:51.4407003Z  2025-03-14T05:49:51.4407505Z  2025-03-14T05:49:51.4407924Z  2025-03-14T05:49:51.4408323Z  2025-03-14T05:49:51.4408669Z  2025-03-14T05:49:51.4409050Z  2025-03-14T05:49:51.4409418Z  2025-03-14T05:49:51.4409802Z  2025-03-14T05:49:51.4410385Z [14,433 / 15,235] 48 actions, 47 running 2025-03-14T05:49:51.4411289Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T05:49:51.4412242Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2025-03-14T05:49:51.4413051Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T05:49:51.4413998Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T05:49:51.4414974Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T05:49:51.4415936Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2025-03-14T05:49:51.4416904Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T05:49:51.4418249Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local ... 2025-03-14T05:49:51.6692967Z 2025-03-14T05:49:51.6693802Z  2025-03-14T05:49:51.6694388Z  2025-03-14T05:49:51.6694794Z  2025-03-14T05:49:51.6695160Z  2025-03-14T05:49:51.6695534Z  2025-03-14T05:49:51.6695916Z  2025-03-14T05:49:51.6696303Z  2025-03-14T05:49:51.6696687Z  2025-03-14T05:49:51.6697306Z [14,435 / 15,235] 48 actions, 47 running 2025-03-14T05:49:51.6698194Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T05:49:51.6699159Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T05:49:51.6699969Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T05:49:51.6700814Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T05:49:51.6701812Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T05:49:51.6702752Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2025-03-14T05:49:51.6703756Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T05:49:51.6704674Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local ... 2025-03-14T05:49:51.9578398Z 2025-03-14T05:49:51.9579208Z  2025-03-14T05:49:51.9579650Z  2025-03-14T05:49:51.9580026Z  2025-03-14T05:49:51.9580387Z  2025-03-14T05:49:51.9581058Z  2025-03-14T05:49:51.9581432Z  2025-03-14T05:49:51.9581767Z  2025-03-14T05:49:51.9582111Z  2025-03-14T05:49:51.9582600Z [14,438 / 15,235] 47 actions, 46 running 2025-03-14T05:49:51.9583332Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T05:49:51.9584093Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T05:49:51.9584846Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T05:49:51.9588767Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T05:49:51.9589772Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T05:49:51.9590679Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T05:49:51.9591544Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2025-03-14T05:49:51.9592298Z Compiling xla/service/dump.cc; 18s local ... 2025-03-14T05:49:52.1599943Z 2025-03-14T05:49:52.1600790Z  2025-03-14T05:49:52.1601297Z  2025-03-14T05:49:52.1601698Z  2025-03-14T05:49:52.1602100Z  2025-03-14T05:49:52.1602501Z  2025-03-14T05:49:52.1602898Z  2025-03-14T05:49:52.1603274Z  2025-03-14T05:49:52.1603635Z  2025-03-14T05:49:52.1604175Z [14,440 / 15,235] 48 actions, 47 running 2025-03-14T05:49:52.1605060Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T05:49:52.1606207Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T05:49:52.1607062Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T05:49:52.1608166Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T05:49:52.1609156Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T05:49:52.1610132Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T05:49:52.1611055Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local 2025-03-14T05:49:52.1611949Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2025-03-14T05:49:52.4329680Z 2025-03-14T05:49:52.4330480Z  2025-03-14T05:49:52.4330958Z  2025-03-14T05:49:52.4331367Z  2025-03-14T05:49:52.4331764Z  2025-03-14T05:49:52.4332168Z  2025-03-14T05:49:52.4332565Z  2025-03-14T05:49:52.4332976Z  2025-03-14T05:49:52.4333409Z  2025-03-14T05:49:52.4333982Z [14,442 / 15,235] 48 actions running 2025-03-14T05:49:52.4334849Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T05:49:52.4335976Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T05:49:52.4336865Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T05:49:52.4337859Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T05:49:52.4338822Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T05:49:52.4339799Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T05:49:52.4340746Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2025-03-14T05:49:52.4341658Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2025-03-14T05:49:52.7912140Z 2025-03-14T05:49:52.7913014Z  2025-03-14T05:49:52.7913478Z  2025-03-14T05:49:52.7913861Z  2025-03-14T05:49:52.7914257Z  2025-03-14T05:49:52.7914693Z  2025-03-14T05:49:52.7915073Z  2025-03-14T05:49:52.7915439Z  2025-03-14T05:49:52.7915823Z  2025-03-14T05:49:52.7916396Z [14,443 / 15,235] 48 actions, 47 running 2025-03-14T05:49:52.7917207Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T05:49:52.7918040Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T05:49:52.7918893Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T05:49:52.7919853Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T05:49:52.7921072Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T05:49:52.7922036Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T05:49:52.7922945Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2025-03-14T05:49:52.7923806Z Compiling xla/service/llvm_ir/llvm_util.cc; 18s local ... 2025-03-14T05:49:53.0012074Z 2025-03-14T05:49:53.0012944Z  2025-03-14T05:49:53.0013410Z  2025-03-14T05:49:53.0013811Z  2025-03-14T05:49:53.0014210Z  2025-03-14T05:49:53.0014862Z  2025-03-14T05:49:53.0015280Z  2025-03-14T05:49:53.0015701Z  2025-03-14T05:49:53.0016082Z  2025-03-14T05:49:53.0016637Z [14,444 / 15,235] 48 actions, 47 running 2025-03-14T05:49:53.0017447Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T05:49:53.0018295Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T05:49:53.0019135Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T05:49:53.0020096Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T05:49:53.0021006Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T05:49:53.0021957Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T05:49:53.0022869Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2025-03-14T05:49:53.0024025Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 14s local ... 2025-03-14T05:49:53.2337879Z 2025-03-14T05:49:53.2338749Z  2025-03-14T05:49:53.2339266Z  2025-03-14T05:49:53.2339679Z  2025-03-14T05:49:53.2340094Z  2025-03-14T05:49:53.2340500Z  2025-03-14T05:49:53.2340895Z  2025-03-14T05:49:53.2341308Z  2025-03-14T05:49:53.2341714Z  2025-03-14T05:49:53.2342291Z [14,445 / 15,235] 48 actions running 2025-03-14T05:49:53.2343155Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T05:49:53.2344045Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T05:49:53.2344980Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T05:49:53.2345997Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T05:49:53.2346943Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T05:49:53.2347903Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T05:49:53.2348885Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local 2025-03-14T05:49:53.2349913Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 14s local ... 2025-03-14T05:49:53.6342199Z 2025-03-14T05:49:53.6343069Z  2025-03-14T05:49:53.6343561Z  2025-03-14T05:49:53.6343940Z  2025-03-14T05:49:53.6344359Z  2025-03-14T05:49:53.6344761Z  2025-03-14T05:49:53.6345153Z  2025-03-14T05:49:53.6345545Z  2025-03-14T05:49:53.6345929Z  2025-03-14T05:49:53.6346512Z [14,446 / 15,235] 48 actions running 2025-03-14T05:49:53.6347360Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T05:49:53.6348244Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T05:49:53.6349180Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T05:49:53.6350170Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T05:49:53.6351080Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T05:49:53.6352048Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T05:49:53.6352979Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2025-03-14T05:49:53.6354000Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 15s local ... 2025-03-14T05:49:54.0640313Z 2025-03-14T05:49:54.0641190Z  2025-03-14T05:49:54.0641693Z  2025-03-14T05:49:54.0642105Z  2025-03-14T05:49:54.0642518Z  2025-03-14T05:49:54.0642908Z  2025-03-14T05:49:54.0643300Z  2025-03-14T05:49:54.0643963Z  2025-03-14T05:49:54.0644383Z  2025-03-14T05:49:54.0645180Z [14,447 / 15,235] 48 actions, 47 running 2025-03-14T05:49:54.0645980Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T05:49:54.0646763Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T05:49:54.0647636Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T05:49:54.0649023Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T05:49:54.0649985Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T05:49:54.0650994Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T05:49:54.0651985Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2025-03-14T05:49:54.0652993Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 15s local ... 2025-03-14T05:49:54.4350231Z 2025-03-14T05:49:54.4351092Z  2025-03-14T05:49:54.4351651Z  2025-03-14T05:49:54.4352042Z  2025-03-14T05:49:54.4352483Z  2025-03-14T05:49:54.4352794Z  2025-03-14T05:49:54.4353094Z  2025-03-14T05:49:54.4353396Z  2025-03-14T05:49:54.4353695Z  2025-03-14T05:49:54.4354137Z [14,447 / 15,235] 48 actions running 2025-03-14T05:49:54.4354770Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T05:49:54.4355650Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T05:49:54.4356341Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2025-03-14T05:49:54.4357207Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T05:49:54.4358078Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T05:49:54.4358977Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T05:49:54.4359760Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2025-03-14T05:49:54.4360640Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local ... 2025-03-14T05:49:54.6354015Z 2025-03-14T05:49:54.6354879Z  2025-03-14T05:49:54.6355354Z  2025-03-14T05:49:54.6355738Z  2025-03-14T05:49:54.6356110Z  2025-03-14T05:49:54.6356487Z  2025-03-14T05:49:54.6356877Z  2025-03-14T05:49:54.6357254Z  2025-03-14T05:49:54.6357681Z  2025-03-14T05:49:54.6358269Z [14,448 / 15,235] 48 actions running 2025-03-14T05:49:54.6359021Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T05:49:54.6359854Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T05:49:54.6361050Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2025-03-14T05:49:54.6362054Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T05:49:54.6362964Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T05:49:54.6363926Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T05:49:54.6365115Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2025-03-14T05:49:54.6366301Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local ... 2025-03-14T05:49:54.8546312Z 2025-03-14T05:49:54.8547171Z  2025-03-14T05:49:54.8547656Z  2025-03-14T05:49:54.8548080Z  2025-03-14T05:49:54.8548501Z  2025-03-14T05:49:54.8548893Z  2025-03-14T05:49:54.8549298Z  2025-03-14T05:49:54.8549632Z  2025-03-14T05:49:54.8549945Z  2025-03-14T05:49:54.8550452Z [14,449 / 15,235] 48 actions, 47 running 2025-03-14T05:49:54.8551094Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T05:49:54.8551878Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T05:49:54.8552689Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2025-03-14T05:49:54.8553666Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T05:49:54.8554920Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T05:49:54.8555870Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T05:49:54.8556866Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2025-03-14T05:49:54.8557871Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local ... 2025-03-14T05:49:55.1859034Z 2025-03-14T05:49:55.1859889Z  2025-03-14T05:49:55.1860375Z  2025-03-14T05:49:55.1860796Z  2025-03-14T05:49:55.1861455Z  2025-03-14T05:49:55.1861883Z  2025-03-14T05:49:55.1862281Z  2025-03-14T05:49:55.1862664Z  2025-03-14T05:49:55.1863051Z  2025-03-14T05:49:55.1863651Z [14,451 / 15,235] 48 actions, 47 running 2025-03-14T05:49:55.1864473Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T05:49:55.1865583Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T05:49:55.1866535Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2025-03-14T05:49:55.1867515Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T05:49:55.1868477Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T05:49:55.1869464Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T05:49:55.1870417Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2025-03-14T05:49:55.1871588Z Compiling .../cpu/codegen/polynomial_approximations.cc; 16s local ... 2025-03-14T05:49:55.4361275Z 2025-03-14T05:49:55.4362195Z  2025-03-14T05:49:55.4362605Z  2025-03-14T05:49:55.4362936Z  2025-03-14T05:49:55.4363257Z  2025-03-14T05:49:55.4363579Z  2025-03-14T05:49:55.4363897Z  2025-03-14T05:49:55.4364191Z  2025-03-14T05:49:55.4364503Z  2025-03-14T05:49:55.4365149Z [14,453 / 15,235] 48 actions running 2025-03-14T05:49:55.4366002Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T05:49:55.4366705Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T05:49:55.4367420Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2025-03-14T05:49:55.4368208Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T05:49:55.4369026Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T05:49:55.4369831Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T05:49:55.4370570Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2025-03-14T05:49:55.4371300Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2025-03-14T05:49:55.6366352Z 2025-03-14T05:49:55.6367200Z  2025-03-14T05:49:55.6367589Z  2025-03-14T05:49:55.6367890Z  2025-03-14T05:49:55.6368207Z  2025-03-14T05:49:55.6368522Z  2025-03-14T05:49:55.6368835Z  2025-03-14T05:49:55.6369143Z  2025-03-14T05:49:55.6369458Z  2025-03-14T05:49:55.6369934Z [14,454 / 15,235] 48 actions running 2025-03-14T05:49:55.6370581Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T05:49:55.6371247Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T05:49:55.6371987Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2025-03-14T05:49:55.6372919Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T05:49:55.6373848Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T05:49:55.6374812Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T05:49:55.6375621Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2025-03-14T05:49:55.6376417Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2025-03-14T05:49:55.9776767Z 2025-03-14T05:49:55.9777619Z  2025-03-14T05:49:55.9778108Z  2025-03-14T05:49:55.9778538Z  2025-03-14T05:49:55.9778955Z  2025-03-14T05:49:55.9779363Z  2025-03-14T05:49:55.9779771Z  2025-03-14T05:49:55.9780486Z  2025-03-14T05:49:55.9780945Z  2025-03-14T05:49:55.9781556Z [14,455 / 15,235] 48 actions, 47 running 2025-03-14T05:49:55.9782554Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T05:49:55.9783400Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T05:49:55.9784302Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2025-03-14T05:49:55.9785562Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 31s local 2025-03-14T05:49:55.9786488Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T05:49:55.9787438Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T05:49:55.9788397Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2025-03-14T05:49:55.9789167Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2025-03-14T05:49:56.2371910Z 2025-03-14T05:49:56.2372758Z  2025-03-14T05:49:56.2373247Z  2025-03-14T05:49:56.2373696Z  2025-03-14T05:49:56.2374077Z  2025-03-14T05:49:56.2374461Z  2025-03-14T05:49:56.2374846Z  2025-03-14T05:49:56.2375203Z  2025-03-14T05:49:56.2375598Z  2025-03-14T05:49:56.2376175Z [14,455 / 15,235] 48 actions running 2025-03-14T05:49:56.2376952Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T05:49:56.2378153Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T05:49:56.2379032Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2025-03-14T05:49:56.2380014Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 31s local 2025-03-14T05:49:56.2380985Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T05:49:56.2381939Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T05:49:56.2382875Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2025-03-14T05:49:56.2383819Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local ... 2025-03-14T05:49:56.6051312Z 2025-03-14T05:49:56.6052208Z  2025-03-14T05:49:56.6052701Z  2025-03-14T05:49:56.6053083Z  2025-03-14T05:49:56.6053463Z  2025-03-14T05:49:56.6053830Z  2025-03-14T05:49:56.6054186Z  2025-03-14T05:49:56.6054565Z  2025-03-14T05:49:56.6054969Z  2025-03-14T05:49:56.6055579Z [14,456 / 15,235] 48 actions, 47 running 2025-03-14T05:49:56.6056368Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T05:49:56.6057279Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T05:49:56.6058565Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T05:49:56.6059519Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 31s local 2025-03-14T05:49:56.6060445Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T05:49:56.6061352Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T05:49:56.6062267Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2025-03-14T05:49:56.6063075Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local ... 2025-03-14T05:49:56.8378111Z 2025-03-14T05:49:56.8378971Z  2025-03-14T05:49:56.8379468Z  2025-03-14T05:49:56.8379865Z  2025-03-14T05:49:56.8380248Z  2025-03-14T05:49:56.8380631Z  2025-03-14T05:49:56.8381050Z  2025-03-14T05:49:56.8381417Z  2025-03-14T05:49:56.8381808Z  2025-03-14T05:49:56.8382390Z [14,458 / 15,235] 48 actions running 2025-03-14T05:49:56.8383210Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T05:49:56.8384039Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T05:49:56.8384884Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T05:49:56.8385859Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 31s local 2025-03-14T05:49:56.8387115Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T05:49:56.8388092Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T05:49:56.8389028Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2025-03-14T05:49:56.8389915Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local ... 2025-03-14T05:49:57.2383183Z 2025-03-14T05:49:57.2384020Z  2025-03-14T05:49:57.2384499Z  2025-03-14T05:49:57.2384865Z  2025-03-14T05:49:57.2385253Z  2025-03-14T05:49:57.2385594Z  2025-03-14T05:49:57.2386258Z  2025-03-14T05:49:57.2386669Z  2025-03-14T05:49:57.2387040Z  2025-03-14T05:49:57.2387561Z [14,459 / 15,235] 48 actions running 2025-03-14T05:49:57.2388375Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T05:49:57.2389218Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T05:49:57.2390046Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T05:49:57.2391072Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 32s local 2025-03-14T05:49:57.2391979Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T05:49:57.2392958Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T05:49:57.2393802Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2025-03-14T05:49:57.2394666Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local ... 2025-03-14T05:49:57.5424657Z 2025-03-14T05:49:57.5425517Z  2025-03-14T05:49:57.5426061Z  2025-03-14T05:49:57.5426501Z  2025-03-14T05:49:57.5426895Z  2025-03-14T05:49:57.5427256Z  2025-03-14T05:49:57.5427614Z  2025-03-14T05:49:57.5427975Z  2025-03-14T05:49:57.5428364Z  2025-03-14T05:49:57.5428993Z [14,460 / 15,235] 48 actions, 47 running 2025-03-14T05:49:57.5429800Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T05:49:57.5430689Z @llvm-project//mlir:SparseTensorDialect; 42s local 2025-03-14T05:49:57.5431731Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T05:49:57.5432754Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T05:49:57.5433799Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T05:49:57.5434711Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T05:49:57.5435575Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2025-03-14T05:49:57.5436448Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 18s local ... 2025-03-14T05:49:57.8390610Z 2025-03-14T05:49:57.8391595Z  2025-03-14T05:49:57.8392088Z  2025-03-14T05:49:57.8392508Z  2025-03-14T05:49:57.8392887Z  2025-03-14T05:49:57.8393225Z  2025-03-14T05:49:57.8393615Z  2025-03-14T05:49:57.8394015Z  2025-03-14T05:49:57.8394396Z  2025-03-14T05:49:57.8394958Z [14,460 / 15,235] 48 actions running 2025-03-14T05:49:57.8395842Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T05:49:57.8396703Z @llvm-project//mlir:SparseTensorDialect; 42s local 2025-03-14T05:49:57.8397614Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T05:49:57.8398544Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T05:49:57.8399436Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T05:49:57.8400345Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T05:49:57.8401222Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2025-03-14T05:49:57.8402108Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 18s local ... 2025-03-14T05:49:58.2394791Z 2025-03-14T05:49:58.2395692Z  2025-03-14T05:49:58.2396205Z  2025-03-14T05:49:58.2396609Z  2025-03-14T05:49:58.2397016Z  2025-03-14T05:49:58.2397429Z  2025-03-14T05:49:58.2397808Z  2025-03-14T05:49:58.2398164Z  2025-03-14T05:49:58.2398838Z  2025-03-14T05:49:58.2399435Z [14,463 / 15,235] 48 actions running 2025-03-14T05:49:58.2400199Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T05:49:58.2401037Z @llvm-project//mlir:SparseTensorDialect; 42s local 2025-03-14T05:49:58.2402106Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T05:49:58.2403192Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T05:49:58.2404398Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T05:49:58.2405472Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T05:49:58.2406302Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 19s local 2025-03-14T05:49:58.2407209Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 18s local ... 2025-03-14T05:49:58.6399776Z 2025-03-14T05:49:58.6400611Z  2025-03-14T05:49:58.6401079Z  2025-03-14T05:49:58.6401489Z  2025-03-14T05:49:58.6401893Z  2025-03-14T05:49:58.6402309Z  2025-03-14T05:49:58.6402700Z  2025-03-14T05:49:58.6403091Z  2025-03-14T05:49:58.6403492Z  2025-03-14T05:49:58.6404064Z [14,465 / 15,235] 48 actions running 2025-03-14T05:49:58.6405090Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T05:49:58.6406028Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T05:49:58.6407256Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T05:49:58.6408360Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T05:49:58.6409525Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T05:49:58.6410511Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2025-03-14T05:49:58.6411417Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2025-03-14T05:49:58.6412221Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local ... 2025-03-14T05:49:59.0404737Z 2025-03-14T05:49:59.0405638Z  2025-03-14T05:49:59.0406064Z  2025-03-14T05:49:59.0406398Z  2025-03-14T05:49:59.0406737Z  2025-03-14T05:49:59.0407083Z  2025-03-14T05:49:59.0407433Z  2025-03-14T05:49:59.0407767Z  2025-03-14T05:49:59.0408095Z  2025-03-14T05:49:59.0408693Z [14,466 / 15,235] 48 actions running 2025-03-14T05:49:59.0409390Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T05:49:59.0410128Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T05:49:59.0410867Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T05:49:59.0411913Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T05:49:59.0412672Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T05:49:59.0413406Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2025-03-14T05:49:59.0414178Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2025-03-14T05:49:59.0415067Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local ... 2025-03-14T05:49:59.3771676Z 2025-03-14T05:49:59.3772556Z  2025-03-14T05:49:59.3773071Z  2025-03-14T05:49:59.3773483Z  2025-03-14T05:49:59.3773901Z  2025-03-14T05:49:59.3774325Z  2025-03-14T05:49:59.3774737Z  2025-03-14T05:49:59.3775181Z  2025-03-14T05:49:59.3775597Z  2025-03-14T05:49:59.3776216Z [14,467 / 15,235] 48 actions, 47 running 2025-03-14T05:49:59.3777061Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T05:49:59.3777962Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T05:49:59.3778913Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T05:49:59.3779970Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T05:49:59.3780967Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T05:49:59.3782148Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T05:49:59.3783245Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2025-03-14T05:49:59.3784294Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local ... 2025-03-14T05:49:59.6411664Z 2025-03-14T05:49:59.6412463Z  2025-03-14T05:49:59.6412966Z  2025-03-14T05:49:59.6413425Z  2025-03-14T05:49:59.6413837Z  2025-03-14T05:49:59.6414239Z  2025-03-14T05:49:59.6414630Z  2025-03-14T05:49:59.6415286Z  2025-03-14T05:49:59.6415706Z  2025-03-14T05:49:59.6416263Z [14,467 / 15,235] 48 actions running 2025-03-14T05:49:59.6417072Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2025-03-14T05:49:59.6417975Z @llvm-project//mlir:SparseTensorDialect; 44s local 2025-03-14T05:49:59.6418875Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T05:49:59.6419976Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T05:49:59.6421038Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T05:49:59.6422021Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T05:49:59.6423099Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local 2025-03-14T05:49:59.6424125Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local ... 2025-03-14T05:50:00.0902924Z 2025-03-14T05:50:00.0903788Z  2025-03-14T05:50:00.0904252Z  2025-03-14T05:50:00.0904671Z  2025-03-14T05:50:00.0905064Z  2025-03-14T05:50:00.0905451Z  2025-03-14T05:50:00.0905831Z  2025-03-14T05:50:00.0906203Z  2025-03-14T05:50:00.0906611Z  2025-03-14T05:50:00.0907237Z [14,468 / 15,235] 48 actions, 47 running 2025-03-14T05:50:00.0908084Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2025-03-14T05:50:00.0909120Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T05:50:00.0910148Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T05:50:00.0911087Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T05:50:00.0912190Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T05:50:00.0913141Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local 2025-03-14T05:50:00.0914223Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2025-03-14T05:50:00.0915243Z Compiling xla/service/copy_insertion.cc; 19s local ... 2025-03-14T05:50:00.4419151Z 2025-03-14T05:50:00.4419993Z  2025-03-14T05:50:00.4420489Z  2025-03-14T05:50:00.4420903Z  2025-03-14T05:50:00.4421313Z  2025-03-14T05:50:00.4421734Z  2025-03-14T05:50:00.4422157Z  2025-03-14T05:50:00.4422574Z  2025-03-14T05:50:00.4422998Z  2025-03-14T05:50:00.4423584Z [14,468 / 15,235] 48 actions running 2025-03-14T05:50:00.4424469Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2025-03-14T05:50:00.4425510Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T05:50:00.4426540Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T05:50:00.4427502Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T05:50:00.4428479Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2025-03-14T05:50:00.4429462Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2025-03-14T05:50:00.4430511Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2025-03-14T05:50:00.4431504Z Compiling xla/service/copy_insertion.cc; 19s local ... 2025-03-14T05:50:01.2275139Z 2025-03-14T05:50:01.2275986Z  2025-03-14T05:50:01.2276405Z  2025-03-14T05:50:01.2276756Z  2025-03-14T05:50:01.2277119Z  2025-03-14T05:50:01.2277478Z  2025-03-14T05:50:01.2277825Z  2025-03-14T05:50:01.2278172Z  2025-03-14T05:50:01.2278767Z  2025-03-14T05:50:01.2279317Z [14,469 / 15,235] 48 actions, 47 running 2025-03-14T05:50:01.2280064Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2025-03-14T05:50:01.2281004Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T05:50:01.2281919Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T05:50:01.2282832Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T05:50:01.2283888Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2025-03-14T05:50:01.2284860Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2025-03-14T05:50:01.2285775Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2025-03-14T05:50:01.2286632Z Compiling xla/service/copy_insertion.cc; 20s local ... 2025-03-14T05:50:01.4427112Z 2025-03-14T05:50:01.4427943Z  2025-03-14T05:50:01.4428425Z  2025-03-14T05:50:01.4428818Z  2025-03-14T05:50:01.4429260Z  2025-03-14T05:50:01.4429671Z  2025-03-14T05:50:01.4430076Z  2025-03-14T05:50:01.4430461Z  2025-03-14T05:50:01.4430836Z  2025-03-14T05:50:01.4431394Z [14,469 / 15,235] 48 actions running 2025-03-14T05:50:01.4432259Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2025-03-14T05:50:01.4433596Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T05:50:01.4434678Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T05:50:01.4435610Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T05:50:01.4436551Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T05:50:01.4437510Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T05:50:01.4438525Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2025-03-14T05:50:01.4439475Z Compiling xla/service/copy_insertion.cc; 20s local ... 2025-03-14T05:50:01.7134769Z 2025-03-14T05:50:01.7135606Z  2025-03-14T05:50:01.7136092Z  2025-03-14T05:50:01.7136514Z  2025-03-14T05:50:01.7136898Z  2025-03-14T05:50:01.7137327Z  2025-03-14T05:50:01.7137735Z  2025-03-14T05:50:01.7138110Z  2025-03-14T05:50:01.7138502Z  2025-03-14T05:50:01.7139108Z [14,470 / 15,235] 48 actions, 47 running 2025-03-14T05:50:01.7140006Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T05:50:01.7141071Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T05:50:01.7142382Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T05:50:01.7143398Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T05:50:01.7144405Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T05:50:01.7145420Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T05:50:01.7146469Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2025-03-14T05:50:01.7147491Z Compiling xla/service/copy_insertion.cc; 21s local ... 2025-03-14T05:50:02.0312722Z 2025-03-14T05:50:02.0313586Z  2025-03-14T05:50:02.0314088Z  2025-03-14T05:50:02.0314521Z  2025-03-14T05:50:02.0314943Z  2025-03-14T05:50:02.0315382Z  2025-03-14T05:50:02.0315846Z  2025-03-14T05:50:02.0316261Z  2025-03-14T05:50:02.0316704Z  2025-03-14T05:50:02.0317361Z [14,472 / 15,235] 48 actions, 47 running 2025-03-14T05:50:02.0318250Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T05:50:02.0319314Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T05:50:02.0320394Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T05:50:02.0321427Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T05:50:02.0322675Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T05:50:02.0323695Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T05:50:02.0324917Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T05:50:02.0325946Z Compiling xla/service/copy_insertion.cc; 21s local ... 2025-03-14T05:50:02.2433701Z 2025-03-14T05:50:02.2434548Z  2025-03-14T05:50:02.2435058Z  2025-03-14T05:50:02.2435459Z  2025-03-14T05:50:02.2435864Z  2025-03-14T05:50:02.2436513Z  2025-03-14T05:50:02.2436919Z  2025-03-14T05:50:02.2437356Z  2025-03-14T05:50:02.2437754Z  2025-03-14T05:50:02.2438335Z [14,474 / 15,235] 48 actions running 2025-03-14T05:50:02.2439187Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T05:50:02.2440171Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T05:50:02.2441161Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T05:50:02.2442118Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T05:50:02.2443125Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T05:50:02.2444093Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T05:50:02.2445316Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T05:50:02.2446530Z Compiling xla/service/copy_insertion.cc; 21s local ... 2025-03-14T05:50:02.6171819Z 2025-03-14T05:50:02.6172759Z  2025-03-14T05:50:02.6173232Z  2025-03-14T05:50:02.6173660Z  2025-03-14T05:50:02.6174083Z  2025-03-14T05:50:02.6174483Z  2025-03-14T05:50:02.6174893Z  2025-03-14T05:50:02.6175270Z  2025-03-14T05:50:02.6175687Z  2025-03-14T05:50:02.6176280Z [14,475 / 15,235] 48 actions, 47 running 2025-03-14T05:50:02.6177126Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T05:50:02.6178141Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T05:50:02.6179171Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T05:50:02.6180095Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T05:50:02.6181064Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T05:50:02.6182023Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T05:50:02.6183118Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T05:50:02.6184095Z Compiling xla/service/copy_insertion.cc; 21s local ... 2025-03-14T05:50:02.8439694Z 2025-03-14T05:50:02.8440587Z  2025-03-14T05:50:02.8441078Z  2025-03-14T05:50:02.8441468Z  2025-03-14T05:50:02.8441867Z  2025-03-14T05:50:02.8442259Z  2025-03-14T05:50:02.8442661Z  2025-03-14T05:50:02.8443105Z  2025-03-14T05:50:02.8443509Z  2025-03-14T05:50:02.8444074Z [14,475 / 15,235] 48 actions running 2025-03-14T05:50:02.8445045Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T05:50:02.8446027Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T05:50:02.8447049Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T05:50:02.8448025Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T05:50:02.8448983Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T05:50:02.8449926Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T05:50:02.8450967Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T05:50:02.8451948Z Compiling xla/service/copy_insertion.cc; 22s local ... 2025-03-14T05:50:03.0443895Z 2025-03-14T05:50:03.0444828Z  2025-03-14T05:50:03.0445352Z  2025-03-14T05:50:03.0445766Z  2025-03-14T05:50:03.0446191Z  2025-03-14T05:50:03.0446603Z  2025-03-14T05:50:03.0446997Z  2025-03-14T05:50:03.0447688Z  2025-03-14T05:50:03.0448117Z  2025-03-14T05:50:03.0448655Z [14,478 / 15,235] 48 actions running 2025-03-14T05:50:03.0449391Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T05:50:03.0450146Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T05:50:03.0450934Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T05:50:03.0452090Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T05:50:03.0453035Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T05:50:03.0454058Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T05:50:03.0455148Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2025-03-14T05:50:03.0456179Z Compiling xla/service/copy_insertion.cc; 22s local ... 2025-03-14T05:50:03.4452229Z 2025-03-14T05:50:03.4453084Z  2025-03-14T05:50:03.4453566Z  2025-03-14T05:50:03.4454029Z  2025-03-14T05:50:03.4454445Z  2025-03-14T05:50:03.4454850Z  2025-03-14T05:50:03.4455249Z  2025-03-14T05:50:03.4455661Z  2025-03-14T05:50:03.4456084Z  2025-03-14T05:50:03.4456663Z [14,479 / 15,235] 48 actions running 2025-03-14T05:50:03.4457505Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T05:50:03.4458821Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2025-03-14T05:50:03.4459901Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T05:50:03.4460902Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T05:50:03.4461864Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2025-03-14T05:50:03.4462827Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2025-03-14T05:50:03.4463842Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2025-03-14T05:50:03.4464910Z Compiling xla/service/copy_insertion.cc; 22s local ... 2025-03-14T05:50:04.2740917Z 2025-03-14T05:50:04.2741839Z  2025-03-14T05:50:04.2742322Z  2025-03-14T05:50:04.2742739Z  2025-03-14T05:50:04.2743135Z  2025-03-14T05:50:04.2743543Z  2025-03-14T05:50:04.2743947Z  2025-03-14T05:50:04.2744342Z  2025-03-14T05:50:04.2744748Z  2025-03-14T05:50:04.2745380Z [14,480 / 15,235] 48 actions, 47 running 2025-03-14T05:50:04.2746182Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2025-03-14T05:50:04.2747079Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T05:50:04.2748278Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T05:50:04.2749129Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2025-03-14T05:50:04.2749961Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2025-03-14T05:50:04.2750773Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2025-03-14T05:50:04.2751680Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T05:50:04.2752504Z Compiling xla/service/copy_insertion.cc; 23s local ... 2025-03-14T05:50:04.6456358Z 2025-03-14T05:50:04.6457185Z  2025-03-14T05:50:04.6457666Z  2025-03-14T05:50:04.6458037Z  2025-03-14T05:50:04.6458442Z  2025-03-14T05:50:04.6458865Z  2025-03-14T05:50:04.6459246Z  2025-03-14T05:50:04.6459685Z  2025-03-14T05:50:04.6460115Z  2025-03-14T05:50:04.6460736Z [14,480 / 15,235] 48 actions running 2025-03-14T05:50:04.6461604Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T05:50:04.6462579Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T05:50:04.6463610Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T05:50:04.6464588Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 36s local 2025-03-14T05:50:04.6466119Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T05:50:04.6466989Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2025-03-14T05:50:04.6467849Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T05:50:04.6468779Z Compiling xla/service/copy_insertion.cc; 23s local ... 2025-03-14T05:50:04.8497700Z 2025-03-14T05:50:04.8498591Z  2025-03-14T05:50:04.8499055Z  2025-03-14T05:50:04.8499514Z  2025-03-14T05:50:04.8499919Z  2025-03-14T05:50:04.8500659Z  2025-03-14T05:50:04.8501152Z  2025-03-14T05:50:04.8501563Z  2025-03-14T05:50:04.8501974Z  2025-03-14T05:50:04.8502577Z [14,482 / 15,235] 48 actions, 47 running 2025-03-14T05:50:04.8503441Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T05:50:04.8504455Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T05:50:04.8505542Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T05:50:04.8506581Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T05:50:04.8507641Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T05:50:04.8508619Z Compiling xla/service/copy_insertion.cc; 24s local 2025-03-14T05:50:04.8509412Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2025-03-14T05:50:04.8510570Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local ... 2025-03-14T05:50:05.2461168Z 2025-03-14T05:50:05.2462130Z  2025-03-14T05:50:05.2462627Z  2025-03-14T05:50:05.2463041Z  2025-03-14T05:50:05.2463469Z  2025-03-14T05:50:05.2463874Z  2025-03-14T05:50:05.2464254Z  2025-03-14T05:50:05.2464799Z  2025-03-14T05:50:05.2465235Z  2025-03-14T05:50:05.2466080Z [14,483 / 15,235] 48 actions running 2025-03-14T05:50:05.2466892Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T05:50:05.2467958Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T05:50:05.2469440Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T05:50:05.2470426Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T05:50:05.2471670Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T05:50:05.2472763Z Compiling xla/service/copy_insertion.cc; 24s local 2025-03-14T05:50:05.2473727Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T05:50:05.2474776Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local ... 2025-03-14T05:50:05.4616585Z 2025-03-14T05:50:05.4617452Z  2025-03-14T05:50:05.4617940Z  2025-03-14T05:50:05.4618330Z  2025-03-14T05:50:05.4618714Z  2025-03-14T05:50:05.4619109Z  2025-03-14T05:50:05.4619500Z  2025-03-14T05:50:05.4619914Z  2025-03-14T05:50:05.4620331Z  2025-03-14T05:50:05.4620927Z [14,484 / 15,235] 48 actions, 47 running 2025-03-14T05:50:05.4621766Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T05:50:05.4622758Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T05:50:05.4623764Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T05:50:05.4624692Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T05:50:05.4625754Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T05:50:05.4626649Z Compiling xla/service/copy_insertion.cc; 24s local 2025-03-14T05:50:05.4627397Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T05:50:05.4628240Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local ... 2025-03-14T05:50:05.7611569Z 2025-03-14T05:50:05.7612421Z  2025-03-14T05:50:05.7612879Z  2025-03-14T05:50:05.7613266Z  2025-03-14T05:50:05.7613647Z  2025-03-14T05:50:05.7614026Z  2025-03-14T05:50:05.7614411Z  2025-03-14T05:50:05.7615036Z  2025-03-14T05:50:05.7615448Z  2025-03-14T05:50:05.7616060Z [14,486 / 15,235] 48 actions, 47 running 2025-03-14T05:50:05.7616820Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T05:50:05.7617827Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T05:50:05.7618797Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T05:50:05.7619904Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T05:50:05.7620943Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T05:50:05.7621845Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T05:50:05.7622699Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2025-03-14T05:50:05.7623613Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 22s local ... 2025-03-14T05:50:06.0471444Z 2025-03-14T05:50:06.0472299Z  2025-03-14T05:50:06.0472761Z  2025-03-14T05:50:06.0473198Z  2025-03-14T05:50:06.0473605Z  2025-03-14T05:50:06.0474002Z  2025-03-14T05:50:06.0474371Z  2025-03-14T05:50:06.0474886Z  2025-03-14T05:50:06.0475269Z  2025-03-14T05:50:06.0475839Z [14,487 / 15,235] 48 actions running 2025-03-14T05:50:06.0476694Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T05:50:06.0477961Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T05:50:06.0479023Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T05:50:06.0480037Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T05:50:06.0481053Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T05:50:06.0481950Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T05:50:06.0482744Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2025-03-14T05:50:06.0483638Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 23s local ... 2025-03-14T05:50:06.2475592Z 2025-03-14T05:50:06.2476454Z  2025-03-14T05:50:06.2476955Z  2025-03-14T05:50:06.2477341Z  2025-03-14T05:50:06.2477708Z  2025-03-14T05:50:06.2478083Z  2025-03-14T05:50:06.2478453Z  2025-03-14T05:50:06.2478874Z  2025-03-14T05:50:06.2479240Z  2025-03-14T05:50:06.2479832Z [14,488 / 15,235] 48 actions running 2025-03-14T05:50:06.2480637Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T05:50:06.2481574Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T05:50:06.2482804Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T05:50:06.2483751Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T05:50:06.2484887Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T05:50:06.2485825Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T05:50:06.2486655Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2025-03-14T05:50:06.2487540Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 23s local ... 2025-03-14T05:50:06.7553291Z 2025-03-14T05:50:06.7554040Z  2025-03-14T05:50:06.7554468Z  2025-03-14T05:50:06.7554838Z  2025-03-14T05:50:06.7555183Z  2025-03-14T05:50:06.7555582Z  2025-03-14T05:50:06.7555927Z  2025-03-14T05:50:06.7556285Z  2025-03-14T05:50:06.7556605Z  2025-03-14T05:50:06.7557198Z [14,489 / 15,235] 48 actions, 47 running 2025-03-14T05:50:06.7557963Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T05:50:06.7558799Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T05:50:06.7559755Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T05:50:06.7560872Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T05:50:06.7562365Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T05:50:06.7563463Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T05:50:06.7564677Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T05:50:06.7565978Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 23s local ... 2025-03-14T05:50:07.0482079Z 2025-03-14T05:50:07.0482948Z  2025-03-14T05:50:07.0483436Z  2025-03-14T05:50:07.0483835Z  2025-03-14T05:50:07.0484243Z  2025-03-14T05:50:07.0485101Z  2025-03-14T05:50:07.0485528Z  2025-03-14T05:50:07.0485942Z  2025-03-14T05:50:07.0486333Z  2025-03-14T05:50:07.0486910Z [14,490 / 15,235] 48 actions running 2025-03-14T05:50:07.0487753Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T05:50:07.0488747Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T05:50:07.0489750Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T05:50:07.0490708Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T05:50:07.0491720Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2025-03-14T05:50:07.0492669Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2025-03-14T05:50:07.0493489Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T05:50:07.0494622Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 24s local ... 2025-03-14T05:50:07.3701082Z 2025-03-14T05:50:07.3702009Z  2025-03-14T05:50:07.3702502Z  2025-03-14T05:50:07.3702934Z  2025-03-14T05:50:07.3703312Z  2025-03-14T05:50:07.3703697Z  2025-03-14T05:50:07.3704080Z  2025-03-14T05:50:07.3704501Z  2025-03-14T05:50:07.3704882Z  2025-03-14T05:50:07.3705463Z [14,491 / 15,235] 48 actions, 47 running 2025-03-14T05:50:07.3706282Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T05:50:07.3707303Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T05:50:07.3708288Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T05:50:07.3709260Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T05:50:07.3710286Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2025-03-14T05:50:07.3711257Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2025-03-14T05:50:07.3712133Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T05:50:07.3713103Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 24s local ... 2025-03-14T05:50:07.6487471Z 2025-03-14T05:50:07.6488273Z  2025-03-14T05:50:07.6488725Z  2025-03-14T05:50:07.6489114Z  2025-03-14T05:50:07.6489494Z  2025-03-14T05:50:07.6489824Z  2025-03-14T05:50:07.6490185Z  2025-03-14T05:50:07.6490551Z  2025-03-14T05:50:07.6491016Z  2025-03-14T05:50:07.6491567Z [14,492 / 15,235] 48 actions running 2025-03-14T05:50:07.6492329Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T05:50:07.6493282Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T05:50:07.6494272Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T05:50:07.6495115Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T05:50:07.6495903Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2025-03-14T05:50:07.6496658Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T05:50:07.6497514Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 24s local 2025-03-14T05:50:07.6498356Z Compiling xla/service/elemental_ir_emitter.cc; 22s local ... 2025-03-14T05:50:07.8787716Z 2025-03-14T05:50:07.8788536Z  2025-03-14T05:50:07.8788968Z  2025-03-14T05:50:07.8789326Z  2025-03-14T05:50:07.8789682Z  2025-03-14T05:50:07.8790035Z  2025-03-14T05:50:07.8790399Z  2025-03-14T05:50:07.8790989Z  2025-03-14T05:50:07.8791343Z  2025-03-14T05:50:07.8791877Z [14,493 / 15,235] 48 actions, 47 running 2025-03-14T05:50:07.8792604Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T05:50:07.8793514Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T05:50:07.8794445Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T05:50:07.8795458Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T05:50:07.8796259Z Compiling xla/service/spmd/dot_handler.cc; 27s local 2025-03-14T05:50:07.8797029Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T05:50:07.8797845Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 24s local 2025-03-14T05:50:07.8798662Z Compiling xla/service/elemental_ir_emitter.cc; 23s local ... 2025-03-14T05:50:08.1516032Z 2025-03-14T05:50:08.1516802Z  2025-03-14T05:50:08.1517214Z  2025-03-14T05:50:08.1517572Z  2025-03-14T05:50:08.1517920Z  2025-03-14T05:50:08.1518265Z  2025-03-14T05:50:08.1518606Z  2025-03-14T05:50:08.1518941Z  2025-03-14T05:50:08.1519284Z  2025-03-14T05:50:08.1519784Z [14,495 / 15,235] 48 actions, 47 running 2025-03-14T05:50:08.1520479Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T05:50:08.1521586Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T05:50:08.1522468Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T05:50:08.1523279Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T05:50:08.1524087Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T05:50:08.1525032Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T05:50:08.1525770Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2025-03-14T05:50:08.1526552Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local ... 2025-03-14T05:50:08.4033256Z 2025-03-14T05:50:08.4034129Z  2025-03-14T05:50:08.4034642Z  2025-03-14T05:50:08.4035014Z  2025-03-14T05:50:08.4035398Z  2025-03-14T05:50:08.4035765Z  2025-03-14T05:50:08.4036169Z  2025-03-14T05:50:08.4036577Z  2025-03-14T05:50:08.4036953Z  2025-03-14T05:50:08.4037588Z [14,497 / 15,235] 48 actions, 47 running 2025-03-14T05:50:08.4038393Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T05:50:08.4039376Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T05:50:08.4040742Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T05:50:08.4041661Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T05:50:08.4042380Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T05:50:08.4043351Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T05:50:08.4044303Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2025-03-14T05:50:08.4045417Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local ... 2025-03-14T05:50:08.6497717Z 2025-03-14T05:50:08.6498598Z  2025-03-14T05:50:08.6499117Z  2025-03-14T05:50:08.6499546Z  2025-03-14T05:50:08.6499979Z  2025-03-14T05:50:08.6500446Z  2025-03-14T05:50:08.6500869Z  2025-03-14T05:50:08.6501264Z  2025-03-14T05:50:08.6501662Z  2025-03-14T05:50:08.6502265Z [14,497 / 15,235] 48 actions running 2025-03-14T05:50:08.6503084Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T05:50:08.6504104Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T05:50:08.6505124Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T05:50:08.6506225Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T05:50:08.6507432Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T05:50:08.6508352Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T05:50:08.6509278Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2025-03-14T05:50:08.6510143Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local ... 2025-03-14T05:50:08.9530463Z 2025-03-14T05:50:08.9531340Z  2025-03-14T05:50:08.9531824Z  2025-03-14T05:50:08.9532236Z  2025-03-14T05:50:08.9532561Z  2025-03-14T05:50:08.9533159Z  2025-03-14T05:50:08.9533583Z  2025-03-14T05:50:08.9534007Z  2025-03-14T05:50:08.9534406Z  2025-03-14T05:50:08.9534991Z [14,498 / 15,235] 48 actions, 47 running 2025-03-14T05:50:08.9535810Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T05:50:08.9536695Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T05:50:08.9537859Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2025-03-14T05:50:08.9538833Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T05:50:08.9539765Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T05:50:08.9540640Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T05:50:08.9541519Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2025-03-14T05:50:08.9542698Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local ... 2025-03-14T05:50:09.2503196Z 2025-03-14T05:50:09.2504084Z  2025-03-14T05:50:09.2504629Z  2025-03-14T05:50:09.2505107Z  2025-03-14T05:50:09.2505561Z  2025-03-14T05:50:09.2505932Z  2025-03-14T05:50:09.2506324Z  2025-03-14T05:50:09.2506745Z  2025-03-14T05:50:09.2507146Z  2025-03-14T05:50:09.2507770Z [14,499 / 15,235] 48 actions running 2025-03-14T05:50:09.2508601Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T05:50:09.2509590Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T05:50:09.2510643Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2025-03-14T05:50:09.2511629Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T05:50:09.2512515Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T05:50:09.2513250Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 26s local 2025-03-14T05:50:09.2514117Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2025-03-14T05:50:09.2515023Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local ... 2025-03-14T05:50:09.7377293Z 2025-03-14T05:50:09.7378140Z  2025-03-14T05:50:09.7378626Z  2025-03-14T05:50:09.7379056Z  2025-03-14T05:50:09.7379463Z  2025-03-14T05:50:09.7389780Z  2025-03-14T05:50:09.7390262Z  2025-03-14T05:50:09.7390688Z  2025-03-14T05:50:09.7391097Z  2025-03-14T05:50:09.7391719Z [14,500 / 15,235] 48 actions, 47 running 2025-03-14T05:50:09.7392622Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T05:50:09.7393660Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T05:50:09.7394630Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2025-03-14T05:50:09.7395481Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T05:50:09.7396187Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T05:50:09.7396965Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 26s local 2025-03-14T05:50:09.7397963Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T05:50:09.7398932Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local ... 2025-03-14T05:50:10.0510362Z 2025-03-14T05:50:10.0511242Z  2025-03-14T05:50:10.0511709Z  2025-03-14T05:50:10.0512111Z  2025-03-14T05:50:10.0512618Z  2025-03-14T05:50:10.0513016Z  2025-03-14T05:50:10.0513406Z  2025-03-14T05:50:10.0514118Z  2025-03-14T05:50:10.0514531Z  2025-03-14T05:50:10.0515123Z [14,501 / 15,235] 48 actions running 2025-03-14T05:50:10.0515981Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T05:50:10.0516914Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T05:50:10.0517922Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2025-03-14T05:50:10.0519125Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T05:50:10.0520076Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T05:50:10.0521029Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 27s local 2025-03-14T05:50:10.0521938Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T05:50:10.0522913Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local ... 2025-03-14T05:50:10.3185813Z 2025-03-14T05:50:10.3186683Z  2025-03-14T05:50:10.3187182Z  2025-03-14T05:50:10.3187634Z  2025-03-14T05:50:10.3188051Z  2025-03-14T05:50:10.3188454Z  2025-03-14T05:50:10.3188868Z  2025-03-14T05:50:10.3189293Z  2025-03-14T05:50:10.3189687Z  2025-03-14T05:50:10.3190287Z [14,502 / 15,235] 48 actions, 47 running 2025-03-14T05:50:10.3191115Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T05:50:10.3192392Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2025-03-14T05:50:10.3193374Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2025-03-14T05:50:10.3194334Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T05:50:10.3195227Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T05:50:10.3196107Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 27s local 2025-03-14T05:50:10.3196974Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T05:50:10.3197950Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local ... 2025-03-14T05:50:10.6515950Z 2025-03-14T05:50:10.6516738Z  2025-03-14T05:50:10.6517165Z  2025-03-14T05:50:10.6517536Z  2025-03-14T05:50:10.6517898Z  2025-03-14T05:50:10.6518262Z  2025-03-14T05:50:10.6518648Z  2025-03-14T05:50:10.6519027Z  2025-03-14T05:50:10.6519405Z  2025-03-14T05:50:10.6519976Z [14,503 / 15,235] 48 actions running 2025-03-14T05:50:10.6520708Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T05:50:10.6521583Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2025-03-14T05:50:10.6522794Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2025-03-14T05:50:10.6523636Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T05:50:10.6524647Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 27s local 2025-03-14T05:50:10.6525462Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T05:50:10.6526305Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T05:50:10.6527086Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local ... 2025-03-14T05:50:11.0521288Z 2025-03-14T05:50:11.0522164Z  2025-03-14T05:50:11.0522607Z  2025-03-14T05:50:11.0522990Z  2025-03-14T05:50:11.0523393Z  2025-03-14T05:50:11.0523839Z  2025-03-14T05:50:11.0524230Z  2025-03-14T05:50:11.0524738Z  2025-03-14T05:50:11.0525135Z  2025-03-14T05:50:11.0525688Z [14,504 / 15,235] 48 actions running 2025-03-14T05:50:11.0526510Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T05:50:11.0527458Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2025-03-14T05:50:11.0528428Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T05:50:11.0529349Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T05:50:11.0530515Z Compiling xla/service/elemental_ir_emitter.cc; 26s local 2025-03-14T05:50:11.0531376Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T05:50:11.0532287Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T05:50:11.0533281Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 15s local ... 2025-03-14T05:50:11.3412252Z 2025-03-14T05:50:11.3413146Z  2025-03-14T05:50:11.3413614Z  2025-03-14T05:50:11.3414024Z  2025-03-14T05:50:11.3414388Z  2025-03-14T05:50:11.3414745Z  2025-03-14T05:50:11.3415405Z  2025-03-14T05:50:11.3415867Z  2025-03-14T05:50:11.3416289Z  2025-03-14T05:50:11.3416933Z [14,505 / 15,235] 48 actions, 47 running 2025-03-14T05:50:11.3417763Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T05:50:11.3418711Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T05:50:11.3419757Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T05:50:11.3420669Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T05:50:11.3421546Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T05:50:11.3422447Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T05:50:11.3423427Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 15s local 2025-03-14T05:50:11.3424652Z Compiling xla/service/cpu/onednn_matmul.cc; 14s local ... 2025-03-14T05:50:11.5550057Z 2025-03-14T05:50:11.5550883Z  2025-03-14T05:50:11.5551398Z  2025-03-14T05:50:11.5551802Z  2025-03-14T05:50:11.5552221Z  2025-03-14T05:50:11.5552615Z  2025-03-14T05:50:11.5553018Z  2025-03-14T05:50:11.5553420Z  2025-03-14T05:50:11.5553803Z  2025-03-14T05:50:11.5554382Z [14,506 / 15,235] 48 actions, 47 running 2025-03-14T05:50:11.5555139Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2025-03-14T05:50:11.5556047Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T05:50:11.5557038Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T05:50:11.5557962Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T05:50:11.5558816Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T05:50:11.5559635Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T05:50:11.5560522Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 16s local 2025-03-14T05:50:11.5561581Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 14s local ... 2025-03-14T05:50:11.8529750Z 2025-03-14T05:50:11.8530586Z  2025-03-14T05:50:11.8531050Z  2025-03-14T05:50:11.8531455Z  2025-03-14T05:50:11.8531862Z  2025-03-14T05:50:11.8532246Z  2025-03-14T05:50:11.8532651Z  2025-03-14T05:50:11.8533038Z  2025-03-14T05:50:11.8533428Z  2025-03-14T05:50:11.8533988Z [14,506 / 15,235] 48 actions running 2025-03-14T05:50:11.8534818Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2025-03-14T05:50:11.8535835Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T05:50:11.8536835Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2025-03-14T05:50:11.8537740Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2025-03-14T05:50:11.8538647Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2025-03-14T05:50:11.8539504Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T05:50:11.8540367Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 16s local 2025-03-14T05:50:11.8541386Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 15s local ... 2025-03-14T05:50:12.7729518Z 2025-03-14T05:50:12.7730318Z  2025-03-14T05:50:12.7730804Z  2025-03-14T05:50:12.7731218Z  2025-03-14T05:50:12.7731632Z  2025-03-14T05:50:12.7732032Z  2025-03-14T05:50:12.7732430Z  2025-03-14T05:50:12.7732838Z  2025-03-14T05:50:12.7733514Z  2025-03-14T05:50:12.7734135Z [14,507 / 15,235] 48 actions, 47 running 2025-03-14T05:50:12.7735001Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T05:50:12.7736006Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T05:50:12.7737045Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T05:50:12.7738066Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T05:50:12.7739158Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T05:50:12.7740042Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2025-03-14T05:50:12.7740932Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 17s local 2025-03-14T05:50:12.7741931Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 16s local ... 2025-03-14T05:50:13.0535436Z 2025-03-14T05:50:13.0536300Z  2025-03-14T05:50:13.0536766Z  2025-03-14T05:50:13.0537165Z  2025-03-14T05:50:13.0537573Z  2025-03-14T05:50:13.0537960Z  2025-03-14T05:50:13.0538337Z  2025-03-14T05:50:13.0538734Z  2025-03-14T05:50:13.0539124Z  2025-03-14T05:50:13.0539691Z [14,508 / 15,235] 48 actions running 2025-03-14T05:50:13.0540499Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T05:50:13.0541829Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T05:50:13.0542851Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T05:50:13.0543761Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T05:50:13.0544721Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T05:50:13.0545532Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T05:50:13.0546399Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 17s local 2025-03-14T05:50:13.0547395Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 16s local ... 2025-03-14T05:50:13.4540752Z 2025-03-14T05:50:13.4541567Z  2025-03-14T05:50:13.4542029Z  2025-03-14T05:50:13.4542420Z  2025-03-14T05:50:13.4542802Z  2025-03-14T05:50:13.4543177Z  2025-03-14T05:50:13.4543559Z  2025-03-14T05:50:13.4543940Z  2025-03-14T05:50:13.4544296Z  2025-03-14T05:50:13.4544810Z [14,510 / 15,235] 48 actions running 2025-03-14T05:50:13.4545586Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T05:50:13.4546524Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T05:50:13.4547781Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T05:50:13.4548616Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T05:50:13.4549440Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T05:50:13.4550199Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T05:50:13.4550993Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T05:50:13.4551894Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 16s local ... 2025-03-14T05:50:14.0035849Z 2025-03-14T05:50:14.0036657Z  2025-03-14T05:50:14.0037034Z  2025-03-14T05:50:14.0037370Z  2025-03-14T05:50:14.0037700Z  2025-03-14T05:50:14.0038193Z  2025-03-14T05:50:14.0038539Z  2025-03-14T05:50:14.0038896Z  2025-03-14T05:50:14.0039220Z  2025-03-14T05:50:14.0039713Z [14,511 / 15,235] 48 actions, 47 running 2025-03-14T05:50:14.0040375Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T05:50:14.0041179Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T05:50:14.0041989Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T05:50:14.0042735Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2025-03-14T05:50:14.0043453Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2025-03-14T05:50:14.0044592Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T05:50:14.0045345Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T05:50:14.0046163Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 17s local ... 2025-03-14T05:50:14.2550488Z 2025-03-14T05:50:14.2551339Z  2025-03-14T05:50:14.2551862Z  2025-03-14T05:50:14.2552271Z  2025-03-14T05:50:14.2552692Z  2025-03-14T05:50:14.2553072Z  2025-03-14T05:50:14.2553743Z  2025-03-14T05:50:14.2554168Z  2025-03-14T05:50:14.2554577Z  2025-03-14T05:50:14.2555141Z [14,511 / 15,235] 48 actions running 2025-03-14T05:50:14.2555968Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T05:50:14.2556938Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T05:50:14.2557948Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T05:50:14.2558885Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2025-03-14T05:50:14.2559773Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2025-03-14T05:50:14.2560611Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T05:50:14.2561474Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T05:50:14.2562415Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 17s local ... 2025-03-14T05:50:14.4554392Z 2025-03-14T05:50:14.4555257Z  2025-03-14T05:50:14.4555733Z  2025-03-14T05:50:14.4556214Z  2025-03-14T05:50:14.4556611Z  2025-03-14T05:50:14.4557014Z  2025-03-14T05:50:14.4557417Z  2025-03-14T05:50:14.4557813Z  2025-03-14T05:50:14.4558207Z  2025-03-14T05:50:14.4558786Z [14,512 / 15,235] 48 actions running 2025-03-14T05:50:14.4559590Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T05:50:14.4560529Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T05:50:14.4561582Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T05:50:14.4562471Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2025-03-14T05:50:14.4563328Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2025-03-14T05:50:14.4564175Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T05:50:14.4565247Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T05:50:14.4566453Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 17s local ... 2025-03-14T05:50:15.0866579Z 2025-03-14T05:50:15.0867657Z  2025-03-14T05:50:15.0868090Z  2025-03-14T05:50:15.0868458Z  2025-03-14T05:50:15.0868811Z  2025-03-14T05:50:15.0869164Z  2025-03-14T05:50:15.0869516Z  2025-03-14T05:50:15.0869867Z  2025-03-14T05:50:15.0870213Z  2025-03-14T05:50:15.0870725Z [14,513 / 15,235] 48 actions, 47 running 2025-03-14T05:50:15.0871450Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2025-03-14T05:50:15.0872304Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T05:50:15.0873228Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T05:50:15.0874056Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2025-03-14T05:50:15.0874880Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2025-03-14T05:50:15.0875642Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T05:50:15.0876390Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T05:50:15.0877280Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 18s local ... 2025-03-14T05:50:15.4359316Z 2025-03-14T05:50:15.4360102Z  2025-03-14T05:50:15.4360548Z  2025-03-14T05:50:15.4360912Z  2025-03-14T05:50:15.4361257Z  2025-03-14T05:50:15.4361598Z  2025-03-14T05:50:15.4361946Z  2025-03-14T05:50:15.4362309Z  2025-03-14T05:50:15.4362884Z  2025-03-14T05:50:15.4363418Z [14,516 / 15,235] 48 actions, 47 running 2025-03-14T05:50:15.4364142Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2025-03-14T05:50:15.4365179Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T05:50:15.4366251Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T05:50:15.4367096Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2025-03-14T05:50:15.4368042Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2025-03-14T05:50:15.4368809Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T05:50:15.4369565Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T05:50:15.4370437Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 18s local ... 2025-03-14T05:50:15.6560515Z 2025-03-14T05:50:15.6561442Z  2025-03-14T05:50:15.6561969Z  2025-03-14T05:50:15.6562408Z  2025-03-14T05:50:15.6562830Z  2025-03-14T05:50:15.6563282Z  2025-03-14T05:50:15.6563659Z  2025-03-14T05:50:15.6564048Z  2025-03-14T05:50:15.6564615Z  2025-03-14T05:50:15.6565215Z [14,518 / 15,235] 48 actions running 2025-03-14T05:50:15.6566266Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T05:50:15.6567308Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T05:50:15.6568644Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T05:50:15.6569649Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2025-03-14T05:50:15.6570626Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T05:50:15.6571521Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T05:50:15.6572480Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local 2025-03-14T05:50:15.6573544Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local ... 2025-03-14T05:50:16.0686982Z 2025-03-14T05:50:16.0689220Z  2025-03-14T05:50:16.0689773Z  2025-03-14T05:50:16.0690155Z  2025-03-14T05:50:16.0690519Z  2025-03-14T05:50:16.0690889Z  2025-03-14T05:50:16.0691255Z  2025-03-14T05:50:16.0691628Z  2025-03-14T05:50:16.0691979Z  2025-03-14T05:50:16.0692528Z [14,519 / 15,235] 48 actions, 47 running 2025-03-14T05:50:16.0693286Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T05:50:16.0694136Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T05:50:16.0697175Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2025-03-14T05:50:16.0698015Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2025-03-14T05:50:16.0698818Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T05:50:16.0699607Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T05:50:16.0700437Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local 2025-03-14T05:50:16.0701371Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local ... 2025-03-14T05:50:16.4568292Z 2025-03-14T05:50:16.4569135Z  2025-03-14T05:50:16.4569635Z  2025-03-14T05:50:16.4570043Z  2025-03-14T05:50:16.4570449Z  2025-03-14T05:50:16.4570866Z  2025-03-14T05:50:16.4571258Z  2025-03-14T05:50:16.4571702Z  2025-03-14T05:50:16.4572108Z  2025-03-14T05:50:16.4572684Z [14,519 / 15,235] 48 actions running 2025-03-14T05:50:16.4573629Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T05:50:16.4574652Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T05:50:16.4575680Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2025-03-14T05:50:16.4576619Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2025-03-14T05:50:16.4577532Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T05:50:16.4578674Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T05:50:16.4579599Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T05:50:16.4580625Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local ... 2025-03-14T05:50:16.6571975Z 2025-03-14T05:50:16.6572800Z  2025-03-14T05:50:16.6573291Z  2025-03-14T05:50:16.6573724Z  2025-03-14T05:50:16.6574141Z  2025-03-14T05:50:16.6574544Z  2025-03-14T05:50:16.6574933Z  2025-03-14T05:50:16.6575681Z  2025-03-14T05:50:16.6576239Z  2025-03-14T05:50:16.6576892Z [14,521 / 15,235] 48 actions running 2025-03-14T05:50:16.6577791Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T05:50:16.6578798Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T05:50:16.6579843Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2025-03-14T05:50:16.6580964Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T05:50:16.6581866Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T05:50:16.6582809Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T05:50:16.6583831Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 20s local 2025-03-14T05:50:16.6584944Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local ... 2025-03-14T05:50:17.0577455Z 2025-03-14T05:50:17.0578318Z  2025-03-14T05:50:17.0578813Z  2025-03-14T05:50:17.0579247Z  2025-03-14T05:50:17.0579657Z  2025-03-14T05:50:17.0580054Z  2025-03-14T05:50:17.0580453Z  2025-03-14T05:50:17.0580841Z  2025-03-14T05:50:17.0581244Z  2025-03-14T05:50:17.0581811Z [14,522 / 15,235] 48 actions running 2025-03-14T05:50:17.0582616Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T05:50:17.0583599Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T05:50:17.0584765Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T05:50:17.0585747Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T05:50:17.0586590Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T05:50:17.0587448Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T05:50:17.0588562Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 20s local 2025-03-14T05:50:17.0589559Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 16s local ... 2025-03-14T05:50:17.3640758Z 2025-03-14T05:50:17.3642148Z  2025-03-14T05:50:17.3642638Z  2025-03-14T05:50:17.3642989Z  2025-03-14T05:50:17.3643359Z  2025-03-14T05:50:17.3643746Z  2025-03-14T05:50:17.3644134Z  2025-03-14T05:50:17.3644678Z  2025-03-14T05:50:17.3645068Z  2025-03-14T05:50:17.3645677Z [14,523 / 15,235] 48 actions, 47 running 2025-03-14T05:50:17.3646522Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T05:50:17.3647534Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T05:50:17.3648564Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T05:50:17.3649552Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T05:50:17.3650428Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T05:50:17.3651353Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T05:50:17.3652345Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 20s local 2025-03-14T05:50:17.3653404Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local ... 2025-03-14T05:50:17.6582032Z 2025-03-14T05:50:17.6582988Z  2025-03-14T05:50:17.6583538Z  2025-03-14T05:50:17.6584004Z  2025-03-14T05:50:17.6584386Z  2025-03-14T05:50:17.6584741Z  2025-03-14T05:50:17.6585119Z  2025-03-14T05:50:17.6585528Z  2025-03-14T05:50:17.6586238Z  2025-03-14T05:50:17.6586849Z [14,523 / 15,235] 48 actions running 2025-03-14T05:50:17.6587682Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T05:50:17.6588713Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T05:50:17.6589745Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T05:50:17.6590699Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T05:50:17.6591732Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T05:50:17.6592595Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T05:50:17.6593568Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2025-03-14T05:50:17.6594622Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local ... 2025-03-14T05:50:17.9214605Z 2025-03-14T05:50:17.9215599Z  2025-03-14T05:50:17.9216130Z  2025-03-14T05:50:17.9216612Z  2025-03-14T05:50:17.9217030Z  2025-03-14T05:50:17.9217428Z  2025-03-14T05:50:17.9217802Z  2025-03-14T05:50:17.9218194Z  2025-03-14T05:50:17.9218561Z  2025-03-14T05:50:17.9219149Z [14,524 / 15,235] 48 actions, 47 running 2025-03-14T05:50:17.9219992Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T05:50:17.9221195Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T05:50:17.9222197Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T05:50:17.9223176Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T05:50:17.9224067Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T05:50:17.9224945Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T05:50:17.9226026Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2025-03-14T05:50:17.9227079Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local ... 2025-03-14T05:50:18.2525751Z 2025-03-14T05:50:18.2526723Z  2025-03-14T05:50:18.2527265Z  2025-03-14T05:50:18.2527742Z  2025-03-14T05:50:18.2528127Z  2025-03-14T05:50:18.2528499Z  2025-03-14T05:50:18.2528865Z  2025-03-14T05:50:18.2529236Z  2025-03-14T05:50:18.2529630Z  2025-03-14T05:50:18.2530212Z [14,526 / 15,235] 48 actions, 47 running 2025-03-14T05:50:18.2531060Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T05:50:18.2532016Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T05:50:18.2533288Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T05:50:18.2534282Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T05:50:18.2535160Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2025-03-14T05:50:18.2536031Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T05:50:18.2537051Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2025-03-14T05:50:18.2538114Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local ... 2025-03-14T05:50:18.4587297Z 2025-03-14T05:50:18.4588235Z  2025-03-14T05:50:18.4588789Z  2025-03-14T05:50:18.4589254Z  2025-03-14T05:50:18.4589701Z  2025-03-14T05:50:18.4590125Z  2025-03-14T05:50:18.4590633Z  2025-03-14T05:50:18.4590982Z  2025-03-14T05:50:18.4591300Z  2025-03-14T05:50:18.4591769Z [14,526 / 15,235] 48 actions running 2025-03-14T05:50:18.4592431Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T05:50:18.4593214Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2025-03-14T05:50:18.4593992Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T05:50:18.4594743Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T05:50:18.4595696Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2025-03-14T05:50:18.4596404Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T05:50:18.4597154Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2025-03-14T05:50:18.4597929Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local ... 2025-03-14T05:50:19.0120509Z 2025-03-14T05:50:19.0121358Z  2025-03-14T05:50:19.0121859Z  2025-03-14T05:50:19.0122277Z  2025-03-14T05:50:19.0122679Z  2025-03-14T05:50:19.0123088Z  2025-03-14T05:50:19.0123855Z  2025-03-14T05:50:19.0124269Z  2025-03-14T05:50:19.0124856Z  2025-03-14T05:50:19.0125468Z [14,527 / 15,235] 48 actions, 47 running 2025-03-14T05:50:19.0126331Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T05:50:19.0127321Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2025-03-14T05:50:19.0128387Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2025-03-14T05:50:19.0129424Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T05:50:19.0130324Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T05:50:19.0131268Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T05:50:19.0132297Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2025-03-14T05:50:19.0133552Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local ... 2025-03-14T05:50:19.2595913Z 2025-03-14T05:50:19.2596789Z  2025-03-14T05:50:19.2597378Z  2025-03-14T05:50:19.2597849Z  2025-03-14T05:50:19.2598248Z  2025-03-14T05:50:19.2598626Z  2025-03-14T05:50:19.2599009Z  2025-03-14T05:50:19.2599394Z  2025-03-14T05:50:19.2599768Z  2025-03-14T05:50:19.2600332Z [14,527 / 15,235] 48 actions running 2025-03-14T05:50:19.2601122Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T05:50:19.2602086Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T05:50:19.2603058Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2025-03-14T05:50:19.2603966Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T05:50:19.2604943Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T05:50:19.2605776Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T05:50:19.2606709Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2025-03-14T05:50:19.2607725Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local ... 2025-03-14T05:50:19.6869461Z 2025-03-14T05:50:19.6870438Z  2025-03-14T05:50:19.6870899Z  2025-03-14T05:50:19.6871280Z  2025-03-14T05:50:19.6871637Z  2025-03-14T05:50:19.6872012Z  2025-03-14T05:50:19.6872488Z  2025-03-14T05:50:19.6872842Z  2025-03-14T05:50:19.6873309Z  2025-03-14T05:50:19.6874009Z [14,528 / 15,235] 48 actions, 47 running 2025-03-14T05:50:19.6874812Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T05:50:19.6875799Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T05:50:19.6876781Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2025-03-14T05:50:19.6877735Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T05:50:19.6878604Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T05:50:19.6879508Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2025-03-14T05:50:19.6880500Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2025-03-14T05:50:19.6881483Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local ... 2025-03-14T05:50:20.0601747Z 2025-03-14T05:50:20.0603159Z  2025-03-14T05:50:20.0603662Z  2025-03-14T05:50:20.0604080Z  2025-03-14T05:50:20.0604649Z  2025-03-14T05:50:20.0605023Z  2025-03-14T05:50:20.0605455Z  2025-03-14T05:50:20.0606139Z  2025-03-14T05:50:20.0606603Z  2025-03-14T05:50:20.0607185Z [14,528 / 15,235] 48 actions running 2025-03-14T05:50:20.0607997Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T05:50:20.0608990Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T05:50:20.0610057Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T05:50:20.0611425Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T05:50:20.0612313Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T05:50:20.0613208Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2025-03-14T05:50:20.0614200Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2025-03-14T05:50:20.0615242Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local ... 2025-03-14T05:50:20.2994204Z 2025-03-14T05:50:20.2995030Z  2025-03-14T05:50:20.2995460Z  2025-03-14T05:50:20.2995893Z  2025-03-14T05:50:20.2996297Z  2025-03-14T05:50:20.2996662Z  2025-03-14T05:50:20.2997092Z  2025-03-14T05:50:20.2997494Z  2025-03-14T05:50:20.2997895Z  2025-03-14T05:50:20.2998508Z [14,530 / 15,235] 48 actions, 47 running 2025-03-14T05:50:20.2999361Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T05:50:20.3000609Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T05:50:20.3001622Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T05:50:20.3002599Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T05:50:20.3003478Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T05:50:20.3004581Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2025-03-14T05:50:20.3005547Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2025-03-14T05:50:20.3006525Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local ... 2025-03-14T05:50:20.5946793Z 2025-03-14T05:50:20.5947649Z  2025-03-14T05:50:20.5948147Z  2025-03-14T05:50:20.5948572Z  2025-03-14T05:50:20.5948979Z  2025-03-14T05:50:20.5949354Z  2025-03-14T05:50:20.5949751Z  2025-03-14T05:50:20.5950157Z  2025-03-14T05:50:20.5950550Z  2025-03-14T05:50:20.5951161Z [14,532 / 15,235] 48 actions, 47 running 2025-03-14T05:50:20.5952006Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T05:50:20.5953066Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T05:50:20.5954339Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T05:50:20.5955342Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T05:50:20.5956244Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T05:50:20.5957169Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2025-03-14T05:50:20.5958199Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2025-03-14T05:50:20.5959316Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local ... 2025-03-14T05:50:20.8608864Z 2025-03-14T05:50:20.8609674Z  2025-03-14T05:50:20.8610129Z  2025-03-14T05:50:20.8610512Z  2025-03-14T05:50:20.8610931Z  2025-03-14T05:50:20.8611294Z  2025-03-14T05:50:20.8611652Z  2025-03-14T05:50:20.8612034Z  2025-03-14T05:50:20.8612430Z  2025-03-14T05:50:20.8612916Z [14,532 / 15,235] 48 actions running 2025-03-14T05:50:20.8613621Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T05:50:20.8614576Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T05:50:20.8615487Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T05:50:20.8616282Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T05:50:20.8617319Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T05:50:20.8618050Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2025-03-14T05:50:20.8618994Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2025-03-14T05:50:20.8619926Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local ... 2025-03-14T05:50:21.0612740Z 2025-03-14T05:50:21.0613657Z  2025-03-14T05:50:21.0614160Z  2025-03-14T05:50:21.0614599Z  2025-03-14T05:50:21.0615248Z  2025-03-14T05:50:21.0615667Z  2025-03-14T05:50:21.0616098Z  2025-03-14T05:50:21.0616512Z  2025-03-14T05:50:21.0616910Z  2025-03-14T05:50:21.0617465Z [14,533 / 15,235] 48 actions running 2025-03-14T05:50:21.0618342Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T05:50:21.0619409Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T05:50:21.0620508Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T05:50:21.0621523Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T05:50:21.0622424Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T05:50:21.0623389Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2025-03-14T05:50:21.0624403Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2025-03-14T05:50:21.0625745Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local ... 2025-03-14T05:50:21.3668594Z 2025-03-14T05:50:21.3669452Z  2025-03-14T05:50:21.3669974Z  2025-03-14T05:50:21.3670384Z  2025-03-14T05:50:21.3670808Z  2025-03-14T05:50:21.3671221Z  2025-03-14T05:50:21.3671637Z  2025-03-14T05:50:21.3672022Z  2025-03-14T05:50:21.3672363Z  2025-03-14T05:50:21.3672911Z [14,534 / 15,235] 48 actions, 47 running 2025-03-14T05:50:21.3673651Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T05:50:21.3674596Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T05:50:21.3675599Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T05:50:21.3676485Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T05:50:21.3677287Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T05:50:21.3678089Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2025-03-14T05:50:21.3679035Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2025-03-14T05:50:21.3680048Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 19s local ... 2025-03-14T05:50:21.6618562Z 2025-03-14T05:50:21.6619583Z  2025-03-14T05:50:21.6620078Z  2025-03-14T05:50:21.6620472Z  2025-03-14T05:50:21.6620879Z  2025-03-14T05:50:21.6621294Z  2025-03-14T05:50:21.6621693Z  2025-03-14T05:50:21.6622081Z  2025-03-14T05:50:21.6622437Z  2025-03-14T05:50:21.6622957Z [14,535 / 15,235] 48 actions running 2025-03-14T05:50:21.6623799Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T05:50:21.6624797Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T05:50:21.6625747Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T05:50:21.6626734Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T05:50:21.6627628Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T05:50:21.6628445Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2025-03-14T05:50:21.6629443Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2025-03-14T05:50:21.6630563Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 19s local ... 2025-03-14T05:50:21.8621720Z 2025-03-14T05:50:21.8622650Z  2025-03-14T05:50:21.8623169Z  2025-03-14T05:50:21.8623563Z  2025-03-14T05:50:21.8623969Z  2025-03-14T05:50:21.8624394Z  2025-03-14T05:50:21.8625060Z  2025-03-14T05:50:21.8625528Z  2025-03-14T05:50:21.8625918Z  2025-03-14T05:50:21.8626518Z [14,536 / 15,235] 48 actions running 2025-03-14T05:50:21.8627345Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T05:50:21.8628286Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T05:50:21.8629322Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T05:50:21.8630494Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T05:50:21.8631366Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T05:50:21.8632239Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2025-03-14T05:50:21.8633219Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2025-03-14T05:50:21.8634306Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2025-03-14T05:50:22.1251123Z 2025-03-14T05:50:22.1251968Z  2025-03-14T05:50:22.1252493Z  2025-03-14T05:50:22.1252950Z  2025-03-14T05:50:22.1253410Z  2025-03-14T05:50:22.1253866Z  2025-03-14T05:50:22.1254344Z  2025-03-14T05:50:22.1254784Z  2025-03-14T05:50:22.1255220Z  2025-03-14T05:50:22.1255875Z [14,537 / 15,235] 48 actions, 47 running 2025-03-14T05:50:22.1257071Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T05:50:22.1258135Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T05:50:22.1259208Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T05:50:22.1260232Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T05:50:22.1261148Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T05:50:22.1262061Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2025-03-14T05:50:22.1263104Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2025-03-14T05:50:22.1264254Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local ... 2025-03-14T05:50:22.3442047Z 2025-03-14T05:50:22.3443489Z  2025-03-14T05:50:22.3443961Z  2025-03-14T05:50:22.3444487Z  2025-03-14T05:50:22.3444866Z  2025-03-14T05:50:22.3445266Z  2025-03-14T05:50:22.3445676Z  2025-03-14T05:50:22.3446128Z  2025-03-14T05:50:22.3446532Z  2025-03-14T05:50:22.3447136Z [14,538 / 15,235] 48 actions, 47 running 2025-03-14T05:50:22.3447972Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T05:50:22.3449223Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T05:50:22.3450241Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T05:50:22.3451156Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T05:50:22.3452038Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T05:50:22.3453115Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2025-03-14T05:50:22.3454208Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2025-03-14T05:50:22.3455289Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local ... 2025-03-14T05:50:22.6629387Z 2025-03-14T05:50:22.6630262Z  2025-03-14T05:50:22.6630766Z  2025-03-14T05:50:22.6631210Z  2025-03-14T05:50:22.6631628Z  2025-03-14T05:50:22.6632055Z  2025-03-14T05:50:22.6632493Z  2025-03-14T05:50:22.6632924Z  2025-03-14T05:50:22.6633339Z  2025-03-14T05:50:22.6633925Z [14,538 / 15,235] 48 actions running 2025-03-14T05:50:22.6634787Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T05:50:22.6635989Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T05:50:22.6637048Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T05:50:22.6638345Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T05:50:22.6639242Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T05:50:22.6640127Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2025-03-14T05:50:22.6641164Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2025-03-14T05:50:22.6642225Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local ... 2025-03-14T05:50:22.8633219Z 2025-03-14T05:50:22.8634072Z  2025-03-14T05:50:22.8634526Z  2025-03-14T05:50:22.8635184Z  2025-03-14T05:50:22.8635560Z  2025-03-14T05:50:22.8635963Z  2025-03-14T05:50:22.8636324Z  2025-03-14T05:50:22.8636684Z  2025-03-14T05:50:22.8637058Z  2025-03-14T05:50:22.8637599Z [14,539 / 15,235] 48 actions running 2025-03-14T05:50:22.8638360Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T05:50:22.8639283Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T05:50:22.8640240Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T05:50:22.8641152Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T05:50:22.8641967Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T05:50:22.8642763Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2025-03-14T05:50:22.8643881Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2025-03-14T05:50:22.8644994Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2025-03-14T05:50:23.2603906Z 2025-03-14T05:50:23.2604913Z  2025-03-14T05:50:23.2605425Z  2025-03-14T05:50:23.2605868Z  2025-03-14T05:50:23.2606325Z  2025-03-14T05:50:23.2606762Z  2025-03-14T05:50:23.2607196Z  2025-03-14T05:50:23.2607639Z  2025-03-14T05:50:23.2608074Z  2025-03-14T05:50:23.2608712Z [14,541 / 15,235] 48 actions, 47 running 2025-03-14T05:50:23.2609611Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T05:50:23.2610659Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2025-03-14T05:50:23.2611752Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T05:50:23.2612793Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T05:50:23.2613715Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T05:50:23.2614630Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2025-03-14T05:50:23.2615687Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2025-03-14T05:50:23.2617043Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2025-03-14T05:50:23.4639124Z 2025-03-14T05:50:23.4639980Z  2025-03-14T05:50:23.4640433Z  2025-03-14T05:50:23.4640822Z  2025-03-14T05:50:23.4641200Z  2025-03-14T05:50:23.4641578Z  2025-03-14T05:50:23.4641962Z  2025-03-14T05:50:23.4642335Z  2025-03-14T05:50:23.4642706Z  2025-03-14T05:50:23.4643282Z [14,541 / 15,235] 48 actions running 2025-03-14T05:50:23.4644082Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2025-03-14T05:50:23.4645164Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2025-03-14T05:50:23.4646144Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T05:50:23.4647094Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T05:50:23.4647916Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T05:50:23.4648734Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2025-03-14T05:50:23.4649694Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2025-03-14T05:50:23.4650655Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2025-03-14T05:50:24.4648224Z 2025-03-14T05:50:24.4649100Z  2025-03-14T05:50:24.4649619Z  2025-03-14T05:50:24.4650045Z  2025-03-14T05:50:24.4650473Z  2025-03-14T05:50:24.4661873Z  2025-03-14T05:50:24.4662766Z  2025-03-14T05:50:24.4663184Z  2025-03-14T05:50:24.4663557Z  2025-03-14T05:50:24.4664091Z [14,541 / 15,235] 48 actions running 2025-03-14T05:50:24.4664928Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T05:50:24.4666175Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2025-03-14T05:50:24.4667248Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2025-03-14T05:50:24.4668406Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2025-03-14T05:50:24.4669309Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2025-03-14T05:50:24.4670165Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2025-03-14T05:50:24.4671190Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 24s local 2025-03-14T05:50:24.4672255Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local ... 2025-03-14T05:50:24.9957121Z 2025-03-14T05:50:24.9958126Z  2025-03-14T05:50:24.9958627Z  2025-03-14T05:50:24.9959045Z  2025-03-14T05:50:24.9959474Z  2025-03-14T05:50:24.9959884Z  2025-03-14T05:50:24.9960301Z  2025-03-14T05:50:24.9960698Z  2025-03-14T05:50:24.9961123Z  2025-03-14T05:50:24.9961771Z [14,542 / 15,235] 48 actions, 47 running 2025-03-14T05:50:24.9962912Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T05:50:24.9963899Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2025-03-14T05:50:24.9965091Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2025-03-14T05:50:24.9966236Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T05:50:24.9967037Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T05:50:24.9967863Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2025-03-14T05:50:24.9968871Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local 2025-03-14T05:50:24.9969812Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local ... 2025-03-14T05:50:25.2243389Z 2025-03-14T05:50:25.2244849Z  2025-03-14T05:50:25.2245507Z  2025-03-14T05:50:25.2245905Z  2025-03-14T05:50:25.2246281Z  2025-03-14T05:50:25.2246673Z  2025-03-14T05:50:25.2247034Z  2025-03-14T05:50:25.2247451Z  2025-03-14T05:50:25.2247843Z  2025-03-14T05:50:25.2248458Z [14,544 / 15,235] 47 actions, 46 running 2025-03-14T05:50:25.2249308Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T05:50:25.2250656Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2025-03-14T05:50:25.2251674Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2025-03-14T05:50:25.2252636Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T05:50:25.2253424Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T05:50:25.2254252Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2025-03-14T05:50:25.2255133Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local 2025-03-14T05:50:25.2256057Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local ... 2025-03-14T05:50:25.4376106Z 2025-03-14T05:50:25.4377010Z  2025-03-14T05:50:25.4377505Z  2025-03-14T05:50:25.4378847Z  2025-03-14T05:50:25.4379239Z  2025-03-14T05:50:25.4381600Z  2025-03-14T05:50:25.4384525Z  2025-03-14T05:50:25.4387463Z  2025-03-14T05:50:25.4390345Z  2025-03-14T05:50:25.4393399Z [14,545 / 15,235] 48 actions running 2025-03-14T05:50:25.4396795Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T05:50:25.4400348Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T05:50:25.4403921Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2025-03-14T05:50:25.4407448Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T05:50:25.4408669Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T05:50:25.4409716Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2025-03-14T05:50:25.4410855Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local 2025-03-14T05:50:25.4412052Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local ... 2025-03-14T05:50:25.6656222Z 2025-03-14T05:50:25.6657514Z  2025-03-14T05:50:25.6658174Z  2025-03-14T05:50:25.6659060Z  2025-03-14T05:50:25.6659640Z  2025-03-14T05:50:25.6660287Z  2025-03-14T05:50:25.6661454Z  2025-03-14T05:50:25.6661925Z  2025-03-14T05:50:25.6662323Z  2025-03-14T05:50:25.6662887Z [14,546 / 15,235] 48 actions running 2025-03-14T05:50:25.6663680Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T05:50:25.6664683Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T05:50:25.6666052Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2025-03-14T05:50:25.6667030Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T05:50:25.6667916Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T05:50:25.6668795Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2025-03-14T05:50:25.6670066Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local 2025-03-14T05:50:25.6671115Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local ... 2025-03-14T05:50:25.8660635Z 2025-03-14T05:50:25.8662010Z  2025-03-14T05:50:25.8662523Z  2025-03-14T05:50:25.8662918Z  2025-03-14T05:50:25.8663307Z  2025-03-14T05:50:25.8663720Z  2025-03-14T05:50:25.8664106Z  2025-03-14T05:50:25.8664471Z  2025-03-14T05:50:25.8664857Z  2025-03-14T05:50:25.8665662Z [14,547 / 15,235] 48 actions running 2025-03-14T05:50:25.8666512Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T05:50:25.8667464Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T05:50:25.8668479Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T05:50:25.8669442Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T05:50:25.8670307Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T05:50:25.8671166Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2025-03-14T05:50:25.8672134Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2025-03-14T05:50:25.8673450Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local ... 2025-03-14T05:50:26.3483887Z 2025-03-14T05:50:26.3485360Z  2025-03-14T05:50:26.3485826Z  2025-03-14T05:50:26.3486233Z  2025-03-14T05:50:26.3486632Z  2025-03-14T05:50:26.3487021Z  2025-03-14T05:50:26.3487409Z  2025-03-14T05:50:26.3487775Z  2025-03-14T05:50:26.3488164Z  2025-03-14T05:50:26.3488803Z [14,548 / 15,235] 48 actions, 47 running 2025-03-14T05:50:26.3489644Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T05:50:26.3490606Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T05:50:26.3491626Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T05:50:26.3492528Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T05:50:26.3493322Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2025-03-14T05:50:26.3494185Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2025-03-14T05:50:26.3495139Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2025-03-14T05:50:26.3496102Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local ... 2025-03-14T05:50:26.6667988Z 2025-03-14T05:50:26.6669489Z  2025-03-14T05:50:26.6669997Z  2025-03-14T05:50:26.6670395Z  2025-03-14T05:50:26.6670797Z  2025-03-14T05:50:26.6671511Z  2025-03-14T05:50:26.6671945Z  2025-03-14T05:50:26.6672342Z  2025-03-14T05:50:26.6672718Z  2025-03-14T05:50:26.6673278Z [14,549 / 15,235] 48 actions running 2025-03-14T05:50:26.6674094Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T05:50:26.6675063Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T05:50:26.6676104Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T05:50:26.6677293Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 38s local 2025-03-14T05:50:26.6678199Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2025-03-14T05:50:26.6679041Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2025-03-14T05:50:26.6679924Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2025-03-14T05:50:26.6680896Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local ... 2025-03-14T05:50:26.8672108Z 2025-03-14T05:50:26.8673453Z  2025-03-14T05:50:26.8673951Z  2025-03-14T05:50:26.8674332Z  2025-03-14T05:50:26.8674694Z  2025-03-14T05:50:26.8675044Z  2025-03-14T05:50:26.8675426Z  2025-03-14T05:50:26.8675798Z  2025-03-14T05:50:26.8676177Z  2025-03-14T05:50:26.8676708Z [14,550 / 15,235] 48 actions running 2025-03-14T05:50:26.8677824Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T05:50:26.8678842Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T05:50:26.8679887Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T05:50:26.8680858Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 38s local 2025-03-14T05:50:26.8681710Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2025-03-14T05:50:26.8682539Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2025-03-14T05:50:26.8683462Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2025-03-14T05:50:26.8684658Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local ... 2025-03-14T05:50:27.2523254Z 2025-03-14T05:50:27.2524604Z  2025-03-14T05:50:27.2525104Z  2025-03-14T05:50:27.2525515Z  2025-03-14T05:50:27.2525955Z  2025-03-14T05:50:27.2526331Z  2025-03-14T05:50:27.2526715Z  2025-03-14T05:50:27.2527137Z  2025-03-14T05:50:27.2527508Z  2025-03-14T05:50:27.2528093Z [14,552 / 15,235] 48 actions, 47 running 2025-03-14T05:50:27.2528936Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T05:50:27.2530185Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T05:50:27.2531207Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T05:50:27.2532142Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2025-03-14T05:50:27.2533078Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2025-03-14T05:50:27.2534055Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2025-03-14T05:50:27.2535087Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2025-03-14T05:50:27.2536179Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local ... 2025-03-14T05:50:27.4678805Z 2025-03-14T05:50:27.4679765Z  2025-03-14T05:50:27.4680285Z  2025-03-14T05:50:27.4680704Z  2025-03-14T05:50:27.4681109Z  2025-03-14T05:50:27.4681495Z  2025-03-14T05:50:27.4681894Z  2025-03-14T05:50:27.4682306Z  2025-03-14T05:50:27.4682694Z  2025-03-14T05:50:27.4683242Z [14,552 / 15,235] 48 actions running 2025-03-14T05:50:27.4684032Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2025-03-14T05:50:27.4685185Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T05:50:27.4686204Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T05:50:27.4687460Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2025-03-14T05:50:27.4688388Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2025-03-14T05:50:27.4689419Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2025-03-14T05:50:27.4690455Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2025-03-14T05:50:27.4691493Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local ... 2025-03-14T05:50:28.4389633Z 2025-03-14T05:50:28.4390870Z  2025-03-14T05:50:28.4391666Z  2025-03-14T05:50:28.4392088Z  2025-03-14T05:50:28.4392505Z  2025-03-14T05:50:28.4392889Z  2025-03-14T05:50:28.4393300Z  2025-03-14T05:50:28.4393701Z  2025-03-14T05:50:28.4394113Z  2025-03-14T05:50:28.4394700Z [14,553 / 15,235] 48 actions, 47 running 2025-03-14T05:50:28.4395554Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2025-03-14T05:50:28.4396643Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T05:50:28.4397670Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2025-03-14T05:50:28.4398696Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2025-03-14T05:50:28.4399687Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2025-03-14T05:50:28.4400683Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T05:50:28.4402206Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2025-03-14T05:50:28.4403354Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local ... 2025-03-14T05:50:28.6687807Z 2025-03-14T05:50:28.6688601Z  2025-03-14T05:50:28.6689075Z  2025-03-14T05:50:28.6689476Z  2025-03-14T05:50:28.6689874Z  2025-03-14T05:50:28.6690268Z  2025-03-14T05:50:28.6690655Z  2025-03-14T05:50:28.6691057Z  2025-03-14T05:50:28.6691453Z  2025-03-14T05:50:28.6691982Z [14,554 / 15,235] 48 actions running 2025-03-14T05:50:28.6692806Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T05:50:28.6693776Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T05:50:28.6694648Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2025-03-14T05:50:28.6695603Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2025-03-14T05:50:28.6696539Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2025-03-14T05:50:28.6697483Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T05:50:28.6698580Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2025-03-14T05:50:28.6699998Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local ... 2025-03-14T05:50:29.2788894Z 2025-03-14T05:50:29.2789757Z  2025-03-14T05:50:29.2790264Z  2025-03-14T05:50:29.2790736Z  2025-03-14T05:50:29.2791160Z  2025-03-14T05:50:29.2791583Z  2025-03-14T05:50:29.2791969Z  2025-03-14T05:50:29.2792409Z  2025-03-14T05:50:29.2792953Z  2025-03-14T05:50:29.2793565Z [14,555 / 15,235] 48 actions, 47 running 2025-03-14T05:50:29.2794394Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T05:50:29.2795365Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T05:50:29.2796340Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2025-03-14T05:50:29.2797306Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2025-03-14T05:50:29.2798266Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T05:50:29.2799225Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T05:50:29.2800199Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2025-03-14T05:50:29.2801227Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 21s local ... 2025-03-14T05:50:29.5331205Z 2025-03-14T05:50:29.5332053Z  2025-03-14T05:50:29.5332553Z  2025-03-14T05:50:29.5333198Z  2025-03-14T05:50:29.5333599Z  2025-03-14T05:50:29.5333976Z  2025-03-14T05:50:29.5334346Z  2025-03-14T05:50:29.5334775Z  2025-03-14T05:50:29.5335224Z  2025-03-14T05:50:29.5335842Z [14,557 / 15,235] 48 actions, 47 running 2025-03-14T05:50:29.5336626Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2025-03-14T05:50:29.5337578Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T05:50:29.5338809Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2025-03-14T05:50:29.5339734Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2025-03-14T05:50:29.5340646Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T05:50:29.5341550Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T05:50:29.5342504Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2025-03-14T05:50:29.5343528Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 22s local ... 2025-03-14T05:50:29.8695857Z 2025-03-14T05:50:29.8696738Z  2025-03-14T05:50:29.8697158Z  2025-03-14T05:50:29.8697490Z  2025-03-14T05:50:29.8697832Z  2025-03-14T05:50:29.8698164Z  2025-03-14T05:50:29.8698518Z  2025-03-14T05:50:29.8698851Z  2025-03-14T05:50:29.8699182Z  2025-03-14T05:50:29.8699978Z [14,557 / 15,235] 48 actions running 2025-03-14T05:50:29.8700681Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2025-03-14T05:50:29.8701473Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T05:50:29.8702319Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T05:50:29.8703078Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2025-03-14T05:50:29.8703828Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2025-03-14T05:50:29.8704626Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T05:50:29.8705421Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2025-03-14T05:50:29.8706210Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 22s local ... 2025-03-14T05:50:30.5172113Z 2025-03-14T05:50:30.5172982Z  2025-03-14T05:50:30.5173445Z  2025-03-14T05:50:30.5173846Z  2025-03-14T05:50:30.5174281Z  2025-03-14T05:50:30.5174677Z  2025-03-14T05:50:30.5175108Z  2025-03-14T05:50:30.5175504Z  2025-03-14T05:50:30.5175897Z  2025-03-14T05:50:30.5176484Z [14,558 / 15,235] 48 actions, 47 running 2025-03-14T05:50:30.5177555Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T05:50:30.5178463Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T05:50:30.5179470Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T05:50:30.5180403Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2025-03-14T05:50:30.5181309Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2025-03-14T05:50:30.5182287Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T05:50:30.5183244Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2025-03-14T05:50:30.5184315Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 23s local ... 2025-03-14T05:50:30.7440577Z 2025-03-14T05:50:30.7441450Z  2025-03-14T05:50:30.7442070Z  2025-03-14T05:50:30.7442515Z  2025-03-14T05:50:30.7442961Z  2025-03-14T05:50:30.7443374Z  2025-03-14T05:50:30.7443794Z  2025-03-14T05:50:30.7444190Z  2025-03-14T05:50:30.7444777Z  2025-03-14T05:50:30.7445388Z [14,559 / 15,235] 48 actions, 47 running 2025-03-14T05:50:30.7446231Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T05:50:30.7447236Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T05:50:30.7448508Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T05:50:30.7449479Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2025-03-14T05:50:30.7450392Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T05:50:30.7451309Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T05:50:30.7452205Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2025-03-14T05:50:30.7453263Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 23s local ... 2025-03-14T05:50:30.9475863Z 2025-03-14T05:50:30.9476718Z  2025-03-14T05:50:30.9477288Z  2025-03-14T05:50:30.9477686Z  2025-03-14T05:50:30.9478099Z  2025-03-14T05:50:30.9478525Z  2025-03-14T05:50:30.9478925Z  2025-03-14T05:50:30.9479333Z  2025-03-14T05:50:30.9479728Z  2025-03-14T05:50:30.9480302Z [14,560 / 15,235] 48 actions, 47 running 2025-03-14T05:50:30.9481168Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T05:50:30.9482187Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T05:50:30.9483222Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T05:50:30.9484227Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2025-03-14T05:50:30.9485403Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T05:50:30.9486736Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T05:50:30.9487757Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2025-03-14T05:50:30.9488823Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 23s local ... 2025-03-14T05:50:31.2494130Z 2025-03-14T05:50:31.2494994Z  2025-03-14T05:50:31.2495450Z  2025-03-14T05:50:31.2495844Z  2025-03-14T05:50:31.2496228Z  2025-03-14T05:50:31.2496627Z  2025-03-14T05:50:31.2497038Z  2025-03-14T05:50:31.2497569Z  2025-03-14T05:50:31.2497999Z  2025-03-14T05:50:31.2498625Z [14,562 / 15,235] 48 actions, 47 running 2025-03-14T05:50:31.2499475Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T05:50:31.2500540Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T05:50:31.2501547Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T05:50:31.2502608Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2025-03-14T05:50:31.2503597Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T05:50:31.2504492Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T05:50:31.2505700Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2025-03-14T05:50:31.2506642Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 23s local ... 2025-03-14T05:50:31.4707677Z 2025-03-14T05:50:31.4708533Z  2025-03-14T05:50:31.4709120Z  2025-03-14T05:50:31.4709500Z  2025-03-14T05:50:31.4709943Z  2025-03-14T05:50:31.4710342Z  2025-03-14T05:50:31.4710785Z  2025-03-14T05:50:31.4711162Z  2025-03-14T05:50:31.4711565Z  2025-03-14T05:50:31.4712100Z [14,564 / 15,235] 48 actions running 2025-03-14T05:50:31.4712893Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T05:50:31.4713790Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2025-03-14T05:50:31.4714810Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T05:50:31.4715918Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2025-03-14T05:50:31.4716785Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T05:50:31.4717681Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T05:50:31.4718552Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2025-03-14T05:50:31.4719506Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 24s local ... 2025-03-14T05:50:31.6709985Z 2025-03-14T05:50:31.6710875Z  2025-03-14T05:50:31.6711379Z  2025-03-14T05:50:31.6711785Z  2025-03-14T05:50:31.6712308Z  2025-03-14T05:50:31.6712713Z  2025-03-14T05:50:31.6713147Z  2025-03-14T05:50:31.6713540Z  2025-03-14T05:50:31.6713938Z  2025-03-14T05:50:31.6714534Z [14,565 / 15,235] 48 actions running 2025-03-14T05:50:31.6715415Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T05:50:31.6716629Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2025-03-14T05:50:31.6717691Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T05:50:31.6718658Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2025-03-14T05:50:31.6719590Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T05:50:31.6720586Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T05:50:31.6721576Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2025-03-14T05:50:31.6722626Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 24s local ... 2025-03-14T05:50:32.3228697Z 2025-03-14T05:50:32.3229607Z  2025-03-14T05:50:32.3230098Z  2025-03-14T05:50:32.3230527Z  2025-03-14T05:50:32.3231315Z  2025-03-14T05:50:32.3231860Z  2025-03-14T05:50:32.3232710Z  2025-03-14T05:50:32.3233230Z  2025-03-14T05:50:32.3233727Z  2025-03-14T05:50:32.3234459Z [14,566 / 15,235] 48 actions, 47 running 2025-03-14T05:50:32.3235415Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T05:50:32.3236482Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2025-03-14T05:50:32.3237591Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T05:50:32.3238753Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2025-03-14T05:50:32.3239833Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T05:50:32.3240971Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T05:50:32.3242043Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T05:50:32.3243183Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 24s local ... 2025-03-14T05:50:32.6718770Z 2025-03-14T05:50:32.6719710Z  2025-03-14T05:50:32.6720247Z  2025-03-14T05:50:32.6720649Z  2025-03-14T05:50:32.6721039Z  2025-03-14T05:50:32.6721441Z  2025-03-14T05:50:32.6721834Z  2025-03-14T05:50:32.6722214Z  2025-03-14T05:50:32.6722845Z  2025-03-14T05:50:32.6723424Z [14,566 / 15,235] 48 actions running 2025-03-14T05:50:32.6724210Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2025-03-14T05:50:32.6725355Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2025-03-14T05:50:32.6726357Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T05:50:32.6727318Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2025-03-14T05:50:32.6728245Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T05:50:32.6729176Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T05:50:32.6730117Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T05:50:32.6731111Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 25s local ... 2025-03-14T05:50:32.8722485Z 2025-03-14T05:50:32.8723418Z  2025-03-14T05:50:32.8723951Z  2025-03-14T05:50:32.8724473Z  2025-03-14T05:50:32.8724893Z  2025-03-14T05:50:32.8725277Z  2025-03-14T05:50:32.8725681Z  2025-03-14T05:50:32.8726066Z  2025-03-14T05:50:32.8726452Z  2025-03-14T05:50:32.8727011Z [14,567 / 15,235] 48 actions running 2025-03-14T05:50:32.8727821Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2025-03-14T05:50:32.8729062Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2025-03-14T05:50:32.8730122Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2025-03-14T05:50:32.8731037Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2025-03-14T05:50:32.8731959Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2025-03-14T05:50:32.8732902Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T05:50:32.8733871Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T05:50:32.8735091Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 25s local ... 2025-03-14T05:50:33.1293827Z 2025-03-14T05:50:33.1295083Z  2025-03-14T05:50:33.1295609Z  2025-03-14T05:50:33.1296005Z  2025-03-14T05:50:33.1296367Z  2025-03-14T05:50:33.1296754Z  2025-03-14T05:50:33.1297147Z  2025-03-14T05:50:33.1297519Z  2025-03-14T05:50:33.1297922Z  2025-03-14T05:50:33.1298508Z [14,568 / 15,235] 48 actions, 47 running 2025-03-14T05:50:33.1299376Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2025-03-14T05:50:33.1300375Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2025-03-14T05:50:33.1301351Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2025-03-14T05:50:33.1302346Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2025-03-14T05:50:33.1303621Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2025-03-14T05:50:33.1304577Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T05:50:33.1305538Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2025-03-14T05:50:33.1306519Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 25s local ... 2025-03-14T05:50:33.4727465Z 2025-03-14T05:50:33.4728351Z  2025-03-14T05:50:33.4728805Z  2025-03-14T05:50:33.4729218Z  2025-03-14T05:50:33.4729608Z  2025-03-14T05:50:33.4730002Z  2025-03-14T05:50:33.4730407Z  2025-03-14T05:50:33.4730824Z  2025-03-14T05:50:33.4731218Z  2025-03-14T05:50:33.4731796Z [14,569 / 15,235] 48 actions running 2025-03-14T05:50:33.4732575Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T05:50:33.4733472Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2025-03-14T05:50:33.4734444Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2025-03-14T05:50:33.4735334Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2025-03-14T05:50:33.4736268Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2025-03-14T05:50:33.4737586Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2025-03-14T05:50:33.4738607Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 26s local 2025-03-14T05:50:33.4739719Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local ... 2025-03-14T05:50:34.2034180Z 2025-03-14T05:50:34.2035046Z  2025-03-14T05:50:34.2035556Z  2025-03-14T05:50:34.2035977Z  2025-03-14T05:50:34.2036333Z  2025-03-14T05:50:34.2036708Z  2025-03-14T05:50:34.2037083Z  2025-03-14T05:50:34.2037498Z  2025-03-14T05:50:34.2037880Z  2025-03-14T05:50:34.2038460Z [14,570 / 15,235] 48 actions, 47 running 2025-03-14T05:50:34.2039276Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T05:50:34.2040256Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T05:50:34.2041190Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2025-03-14T05:50:34.2042060Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T05:50:34.2042988Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T05:50:34.2043939Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2025-03-14T05:50:34.2045120Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 26s local 2025-03-14T05:50:34.2046531Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2025-03-14T05:50:34.4736830Z 2025-03-14T05:50:34.4738093Z  2025-03-14T05:50:34.4738595Z  2025-03-14T05:50:34.4739020Z  2025-03-14T05:50:34.4739393Z  2025-03-14T05:50:34.4739794Z  2025-03-14T05:50:34.4740187Z  2025-03-14T05:50:34.4740616Z  2025-03-14T05:50:34.4741062Z  2025-03-14T05:50:34.4741644Z [14,571 / 15,235] 48 actions running 2025-03-14T05:50:34.4742764Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T05:50:34.4743789Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T05:50:34.4744905Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2025-03-14T05:50:34.4745855Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T05:50:34.4746786Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T05:50:34.4747761Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2025-03-14T05:50:34.4748705Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 27s local 2025-03-14T05:50:34.4749768Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2025-03-14T05:50:34.6740456Z 2025-03-14T05:50:34.6741684Z  2025-03-14T05:50:34.6742193Z  2025-03-14T05:50:34.6742616Z  2025-03-14T05:50:34.6743399Z  2025-03-14T05:50:34.6743812Z  2025-03-14T05:50:34.6744205Z  2025-03-14T05:50:34.6744601Z  2025-03-14T05:50:34.6745020Z  2025-03-14T05:50:34.6745576Z [14,572 / 15,235] 48 actions running 2025-03-14T05:50:34.6746455Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T05:50:34.6747314Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T05:50:34.6748246Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2025-03-14T05:50:34.6749182Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T05:50:34.6750121Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T05:50:34.6751005Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2025-03-14T05:50:34.6751954Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 27s local 2025-03-14T05:50:34.6753030Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local ... 2025-03-14T05:50:35.7216105Z 2025-03-14T05:50:35.7217373Z  2025-03-14T05:50:35.7217833Z  2025-03-14T05:50:35.7218236Z  2025-03-14T05:50:35.7218675Z  2025-03-14T05:50:35.7219058Z  2025-03-14T05:50:35.7219883Z  2025-03-14T05:50:35.7220274Z  2025-03-14T05:50:35.7220644Z  2025-03-14T05:50:35.7221202Z [14,573 / 15,235] 48 actions, 47 running 2025-03-14T05:50:35.7221998Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T05:50:35.7222956Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2025-03-14T05:50:35.7223893Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2025-03-14T05:50:35.7224844Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2025-03-14T05:50:35.7225790Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2025-03-14T05:50:35.7226687Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T05:50:35.7227649Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 28s local 2025-03-14T05:50:35.7228710Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local ... 2025-03-14T05:50:35.9304981Z 2025-03-14T05:50:35.9306028Z  2025-03-14T05:50:35.9306545Z  2025-03-14T05:50:35.9306954Z  2025-03-14T05:50:35.9307380Z  2025-03-14T05:50:35.9307802Z  2025-03-14T05:50:35.9308183Z  2025-03-14T05:50:35.9308588Z  2025-03-14T05:50:35.9308958Z  2025-03-14T05:50:35.9309558Z [14,574 / 15,235] 48 actions, 47 running 2025-03-14T05:50:35.9310709Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T05:50:35.9311831Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2025-03-14T05:50:35.9312735Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2025-03-14T05:50:35.9313662Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T05:50:35.9314606Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2025-03-14T05:50:35.9315554Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T05:50:35.9317177Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 28s local 2025-03-14T05:50:35.9318181Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 28s local ... 2025-03-14T05:50:36.1938899Z 2025-03-14T05:50:36.1939823Z  2025-03-14T05:50:36.1940330Z  2025-03-14T05:50:36.1940735Z  2025-03-14T05:50:36.1941156Z  2025-03-14T05:50:36.1941554Z  2025-03-14T05:50:36.1941946Z  2025-03-14T05:50:36.1942328Z  2025-03-14T05:50:36.1942727Z  2025-03-14T05:50:36.1943381Z [14,575 / 15,235] 48 actions, 47 running 2025-03-14T05:50:36.1944264Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T05:50:36.1945284Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2025-03-14T05:50:36.1946173Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2025-03-14T05:50:36.1947432Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T05:50:36.1948472Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T05:50:36.1949402Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T05:50:36.1950399Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 28s local 2025-03-14T05:50:36.1951359Z Compiling xla/service/cpu/ir_emitter.cc; 24s local ... 2025-03-14T05:50:36.4702450Z 2025-03-14T05:50:36.4703677Z  2025-03-14T05:50:36.4704176Z  2025-03-14T05:50:36.4704566Z  2025-03-14T05:50:36.4704957Z  2025-03-14T05:50:36.4705368Z  2025-03-14T05:50:36.4705751Z  2025-03-14T05:50:36.4706132Z  2025-03-14T05:50:36.4706548Z  2025-03-14T05:50:36.4707123Z [14,576 / 15,235] 48 actions, 47 running 2025-03-14T05:50:36.4707903Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T05:50:36.4708887Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2025-03-14T05:50:36.4709884Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2025-03-14T05:50:36.4710848Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T05:50:36.4712117Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T05:50:36.4713062Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T05:50:36.4714021Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local 2025-03-14T05:50:36.4714925Z Compiling xla/service/cpu/ir_emitter.cc; 24s local ... 2025-03-14T05:50:36.6754523Z 2025-03-14T05:50:36.6755479Z  2025-03-14T05:50:36.6755953Z  2025-03-14T05:50:36.6756367Z  2025-03-14T05:50:36.6756767Z  2025-03-14T05:50:36.6757175Z  2025-03-14T05:50:36.6757558Z  2025-03-14T05:50:36.6757947Z  2025-03-14T05:50:36.6758349Z  2025-03-14T05:50:36.6758898Z [14,576 / 15,235] 48 actions running 2025-03-14T05:50:36.6759722Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T05:50:36.6760613Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2025-03-14T05:50:36.6761505Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T05:50:36.6762429Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T05:50:36.6763298Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T05:50:36.6764180Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T05:50:36.6765800Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local 2025-03-14T05:50:36.6766742Z Compiling xla/service/cpu/ir_emitter.cc; 25s local ... 2025-03-14T05:50:37.0375668Z 2025-03-14T05:50:37.0376640Z  2025-03-14T05:50:37.0377128Z  2025-03-14T05:50:37.0377522Z  2025-03-14T05:50:37.0377924Z  2025-03-14T05:50:37.0378304Z  2025-03-14T05:50:37.0378698Z  2025-03-14T05:50:37.0379126Z  2025-03-14T05:50:37.0379529Z  2025-03-14T05:50:37.0380133Z [14,577 / 15,235] 48 actions, 47 running 2025-03-14T05:50:37.0381257Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T05:50:37.0382325Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T05:50:37.0383331Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T05:50:37.0384287Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T05:50:37.0385191Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T05:50:37.0386211Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T05:50:37.0387231Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local 2025-03-14T05:50:37.0388329Z Compiling xla/service/cpu/ir_emitter.cc; 25s local ... 2025-03-14T05:50:37.2760285Z 2025-03-14T05:50:37.2761252Z  2025-03-14T05:50:37.2761765Z  2025-03-14T05:50:37.2762443Z  2025-03-14T05:50:37.2762883Z  2025-03-14T05:50:37.2763358Z  2025-03-14T05:50:37.2763776Z  2025-03-14T05:50:37.2764182Z  2025-03-14T05:50:37.2764708Z  2025-03-14T05:50:37.2765489Z [14,577 / 15,235] 48 actions running 2025-03-14T05:50:37.2766324Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T05:50:37.2767306Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T05:50:37.2768446Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T05:50:37.2769357Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T05:50:37.2770337Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T05:50:37.2771288Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T05:50:37.2772224Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 29s local 2025-03-14T05:50:37.2773134Z Compiling xla/service/cpu/ir_emitter.cc; 25s local ... 2025-03-14T05:50:37.5311429Z 2025-03-14T05:50:37.5312664Z  2025-03-14T05:50:37.5313208Z  2025-03-14T05:50:37.5313628Z  2025-03-14T05:50:37.5314153Z  2025-03-14T05:50:37.5314547Z  2025-03-14T05:50:37.5315224Z  2025-03-14T05:50:37.5315589Z  2025-03-14T05:50:37.5315946Z  2025-03-14T05:50:37.5316516Z [14,578 / 15,235] 48 actions, 47 running 2025-03-14T05:50:37.5317322Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2025-03-14T05:50:37.5318278Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T05:50:37.5319384Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T05:50:37.5320327Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T05:50:37.5321258Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T05:50:37.5322149Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T05:50:37.5323174Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local 2025-03-14T05:50:37.5324105Z Compiling xla/service/cpu/ir_emitter.cc; 25s local ... 2025-03-14T05:50:37.8765091Z 2025-03-14T05:50:37.8766186Z  2025-03-14T05:50:37.8766688Z  2025-03-14T05:50:37.8767087Z  2025-03-14T05:50:37.8767507Z  2025-03-14T05:50:37.8767900Z  2025-03-14T05:50:37.8768300Z  2025-03-14T05:50:37.8768695Z  2025-03-14T05:50:37.8769141Z  2025-03-14T05:50:37.8769817Z [14,578 / 15,235] 48 actions running 2025-03-14T05:50:37.8770662Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2025-03-14T05:50:37.8771963Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T05:50:37.8772890Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2025-03-14T05:50:37.8773811Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T05:50:37.8774781Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T05:50:37.8775774Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T05:50:37.8776978Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local 2025-03-14T05:50:37.8777880Z Compiling xla/service/cpu/ir_emitter.cc; 26s local ... 2025-03-14T05:50:38.2772462Z 2025-03-14T05:50:38.2773411Z  2025-03-14T05:50:38.2773875Z  2025-03-14T05:50:38.2774275Z  2025-03-14T05:50:38.2774637Z  2025-03-14T05:50:38.2775006Z  2025-03-14T05:50:38.2775386Z  2025-03-14T05:50:38.2775726Z  2025-03-14T05:50:38.2776108Z  2025-03-14T05:50:38.2776709Z [14,580 / 15,235] 48 actions running 2025-03-14T05:50:38.2777547Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2025-03-14T05:50:38.2778514Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T05:50:38.2779469Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2025-03-14T05:50:38.2780466Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T05:50:38.2781791Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T05:50:38.2782784Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2025-03-14T05:50:38.2783782Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local 2025-03-14T05:50:38.2784703Z Compiling xla/service/cpu/ir_emitter.cc; 26s local ... 2025-03-14T05:50:38.6775086Z 2025-03-14T05:50:38.6776001Z  2025-03-14T05:50:38.6776452Z  2025-03-14T05:50:38.6776854Z  2025-03-14T05:50:38.6777624Z  2025-03-14T05:50:38.6778008Z  2025-03-14T05:50:38.6778627Z  2025-03-14T05:50:38.6779196Z  2025-03-14T05:50:38.6779715Z  2025-03-14T05:50:38.6780413Z [14,581 / 15,235] 48 actions running 2025-03-14T05:50:38.6781379Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T05:50:38.6782481Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T05:50:38.6783651Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T05:50:38.6784777Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T05:50:38.6786221Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T05:50:38.6787321Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2025-03-14T05:50:38.6788431Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2025-03-14T05:50:38.6789498Z Compiling xla/service/cpu/ir_emitter.cc; 27s local ... 2025-03-14T05:50:38.9305930Z 2025-03-14T05:50:38.9306854Z  2025-03-14T05:50:38.9307386Z  2025-03-14T05:50:38.9307778Z  2025-03-14T05:50:38.9308208Z  2025-03-14T05:50:38.9308649Z  2025-03-14T05:50:38.9309032Z  2025-03-14T05:50:38.9309412Z  2025-03-14T05:50:38.9309794Z  2025-03-14T05:50:38.9310375Z [14,582 / 15,235] 48 actions, 47 running 2025-03-14T05:50:38.9311190Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T05:50:38.9312156Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T05:50:38.9313121Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T05:50:38.9314213Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T05:50:38.9315192Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T05:50:38.9316125Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2025-03-14T05:50:38.9317185Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2025-03-14T05:50:38.9318448Z Compiling xla/service/cpu/ir_emitter.cc; 27s local ... 2025-03-14T05:50:39.2782238Z 2025-03-14T05:50:39.2783460Z  2025-03-14T05:50:39.2783961Z  2025-03-14T05:50:39.2784398Z  2025-03-14T05:50:39.2784837Z  2025-03-14T05:50:39.2785294Z  2025-03-14T05:50:39.2785738Z  2025-03-14T05:50:39.2786198Z  2025-03-14T05:50:39.2786622Z  2025-03-14T05:50:39.2787207Z [14,585 / 15,235] 48 actions running 2025-03-14T05:50:39.2788319Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T05:50:39.2789286Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T05:50:39.2790370Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T05:50:39.2791403Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T05:50:39.2792443Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T05:50:39.2793460Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2025-03-14T05:50:39.2794548Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2025-03-14T05:50:39.2795670Z Compiling xla/service/cpu/ir_emitter.cc; 27s local ... 2025-03-14T05:50:39.7899093Z 2025-03-14T05:50:39.7900338Z  2025-03-14T05:50:39.7900851Z  2025-03-14T05:50:39.7901251Z  2025-03-14T05:50:39.7901926Z  2025-03-14T05:50:39.7902338Z  2025-03-14T05:50:39.7902742Z  2025-03-14T05:50:39.7903247Z  2025-03-14T05:50:39.7914092Z  2025-03-14T05:50:39.7914739Z [14,586 / 15,235] 48 actions, 47 running 2025-03-14T05:50:39.7915596Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T05:50:39.7916571Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T05:50:39.7917513Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T05:50:39.7918408Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T05:50:39.7919371Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T05:50:39.7920386Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2025-03-14T05:50:39.7921317Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2025-03-14T05:50:39.7922239Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local ... 2025-03-14T05:50:39.9911334Z 2025-03-14T05:50:39.9912188Z  2025-03-14T05:50:39.9912694Z  2025-03-14T05:50:39.9913126Z  2025-03-14T05:50:39.9913567Z  2025-03-14T05:50:39.9913974Z  2025-03-14T05:50:39.9914664Z  2025-03-14T05:50:39.9915024Z  2025-03-14T05:50:39.9915413Z  2025-03-14T05:50:39.9916027Z [14,587 / 15,235] 48 actions, 47 running 2025-03-14T05:50:39.9916859Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T05:50:39.9917850Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T05:50:39.9918848Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T05:50:39.9919804Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T05:50:39.9920797Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T05:50:39.9921854Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2025-03-14T05:50:39.9922886Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2025-03-14T05:50:39.9923837Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local ... 2025-03-14T05:50:40.2790965Z 2025-03-14T05:50:40.2791912Z  2025-03-14T05:50:40.2792559Z  2025-03-14T05:50:40.2792930Z  2025-03-14T05:50:40.2793319Z  2025-03-14T05:50:40.2793728Z  2025-03-14T05:50:40.2794129Z  2025-03-14T05:50:40.2794523Z  2025-03-14T05:50:40.2794907Z  2025-03-14T05:50:40.2795467Z [14,587 / 15,235] 48 actions running 2025-03-14T05:50:40.2796304Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T05:50:40.2797519Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T05:50:40.2798519Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T05:50:40.2799450Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T05:50:40.2800369Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2025-03-14T05:50:40.2801445Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2025-03-14T05:50:40.2802566Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2025-03-14T05:50:40.2803536Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local ... 2025-03-14T05:50:40.6795475Z 2025-03-14T05:50:40.6796716Z  2025-03-14T05:50:40.6797221Z  2025-03-14T05:50:40.6797632Z  2025-03-14T05:50:40.6798042Z  2025-03-14T05:50:40.6798450Z  2025-03-14T05:50:40.6798842Z  2025-03-14T05:50:40.6799227Z  2025-03-14T05:50:40.6799603Z  2025-03-14T05:50:40.6800223Z [14,588 / 15,235] 48 actions running 2025-03-14T05:50:40.6801049Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T05:50:40.6802065Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T05:50:40.6803059Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T05:50:40.6804034Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T05:50:40.6805556Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2025-03-14T05:50:40.6806616Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local 2025-03-14T05:50:40.6807558Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T05:50:40.6808518Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local ... 2025-03-14T05:50:40.9853581Z 2025-03-14T05:50:40.9854830Z  2025-03-14T05:50:40.9855353Z  2025-03-14T05:50:40.9855733Z  2025-03-14T05:50:40.9856103Z  2025-03-14T05:50:40.9856533Z  2025-03-14T05:50:40.9856925Z  2025-03-14T05:50:40.9857378Z  2025-03-14T05:50:40.9857775Z  2025-03-14T05:50:40.9858377Z [14,589 / 15,235] 48 actions, 47 running 2025-03-14T05:50:40.9859211Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T05:50:40.9860149Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T05:50:40.9861130Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T05:50:40.9862032Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T05:50:40.9863287Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2025-03-14T05:50:40.9864323Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local 2025-03-14T05:50:40.9865236Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T05:50:40.9866469Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local ... 2025-03-14T05:50:41.2801099Z 2025-03-14T05:50:41.2802431Z  2025-03-14T05:50:41.2803032Z  2025-03-14T05:50:41.2803426Z  2025-03-14T05:50:41.2803810Z  2025-03-14T05:50:41.2804228Z  2025-03-14T05:50:41.2804824Z  2025-03-14T05:50:41.2805200Z  2025-03-14T05:50:41.2805626Z  2025-03-14T05:50:41.2806210Z [14,589 / 15,235] 48 actions running 2025-03-14T05:50:41.2807064Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T05:50:41.2808097Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T05:50:41.2809087Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T05:50:41.2810049Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T05:50:41.2810998Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2025-03-14T05:50:41.2811969Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local 2025-03-14T05:50:41.2812876Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T05:50:41.2814093Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local ... 2025-03-14T05:50:41.5145563Z 2025-03-14T05:50:41.5146388Z  2025-03-14T05:50:41.5146855Z  2025-03-14T05:50:41.5147298Z  2025-03-14T05:50:41.5147699Z  2025-03-14T05:50:41.5148088Z  2025-03-14T05:50:41.5148469Z  2025-03-14T05:50:41.5148892Z  2025-03-14T05:50:41.5149269Z  2025-03-14T05:50:41.5150312Z [14,590 / 15,235] 48 actions, 47 running 2025-03-14T05:50:41.5151632Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T05:50:41.5152822Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T05:50:41.5153951Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T05:50:41.5155030Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T05:50:41.5156129Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2025-03-14T05:50:41.5157297Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2025-03-14T05:50:41.5158371Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T05:50:41.5159385Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local ... 2025-03-14T05:50:41.8224390Z 2025-03-14T05:50:41.8225265Z  2025-03-14T05:50:41.8225760Z  2025-03-14T05:50:41.8226488Z  2025-03-14T05:50:41.8226920Z  2025-03-14T05:50:41.8227334Z  2025-03-14T05:50:41.8227732Z  2025-03-14T05:50:41.8228154Z  2025-03-14T05:50:41.8228540Z  2025-03-14T05:50:41.8229135Z [14,592 / 15,235] 48 actions, 47 running 2025-03-14T05:50:41.8229920Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T05:50:41.8230875Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T05:50:41.8231819Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T05:50:41.8232729Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T05:50:41.8233663Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2025-03-14T05:50:41.8234654Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2025-03-14T05:50:41.8235524Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2025-03-14T05:50:41.8236397Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local ... 2025-03-14T05:50:42.0809402Z 2025-03-14T05:50:42.0810283Z  2025-03-14T05:50:42.0810761Z  2025-03-14T05:50:42.0812914Z  2025-03-14T05:50:42.0816070Z  2025-03-14T05:50:42.0819295Z  2025-03-14T05:50:42.0822175Z  2025-03-14T05:50:42.0824977Z  2025-03-14T05:50:42.0827852Z  2025-03-14T05:50:42.0830863Z [14,593 / 15,235] 48 actions running 2025-03-14T05:50:42.0834196Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T05:50:42.0837439Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T05:50:42.0838781Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T05:50:42.0839807Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T05:50:42.0840946Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2025-03-14T05:50:42.0842090Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2025-03-14T05:50:42.0843139Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2025-03-14T05:50:42.0844527Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local ... 2025-03-14T05:50:42.2811400Z 2025-03-14T05:50:42.2812680Z  2025-03-14T05:50:42.2813423Z  2025-03-14T05:50:42.2814571Z  2025-03-14T05:50:42.2815017Z  2025-03-14T05:50:42.2815404Z  2025-03-14T05:50:42.2815804Z  2025-03-14T05:50:42.2816199Z  2025-03-14T05:50:42.2816578Z  2025-03-14T05:50:42.2817126Z [14,594 / 15,235] 48 actions running 2025-03-14T05:50:42.2818232Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T05:50:42.2819262Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T05:50:42.2820228Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T05:50:42.2821122Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T05:50:42.2822057Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T05:50:42.2823182Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2025-03-14T05:50:42.2824380Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2025-03-14T05:50:42.2825377Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local ... 2025-03-14T05:50:42.5637909Z 2025-03-14T05:50:42.5638772Z  2025-03-14T05:50:42.5639260Z  2025-03-14T05:50:42.5639695Z  2025-03-14T05:50:42.5640095Z  2025-03-14T05:50:42.5640482Z  2025-03-14T05:50:42.5640874Z  2025-03-14T05:50:42.5641261Z  2025-03-14T05:50:42.5641654Z  2025-03-14T05:50:42.5642277Z [14,595 / 15,235] 48 actions, 47 running 2025-03-14T05:50:42.5643114Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T05:50:42.5644066Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T05:50:42.5645163Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T05:50:42.5646355Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T05:50:42.5647312Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T05:50:42.5648331Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2025-03-14T05:50:42.5649229Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2025-03-14T05:50:42.5650150Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local ... 2025-03-14T05:50:42.8336370Z 2025-03-14T05:50:42.8337291Z  2025-03-14T05:50:42.8337792Z  2025-03-14T05:50:42.8338208Z  2025-03-14T05:50:42.8338590Z  2025-03-14T05:50:42.8339020Z  2025-03-14T05:50:42.8339396Z  2025-03-14T05:50:42.8339773Z  2025-03-14T05:50:42.8340145Z  2025-03-14T05:50:42.8340747Z [14,596 / 15,235] 48 actions, 47 running 2025-03-14T05:50:42.8341591Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T05:50:42.8342570Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T05:50:42.8343520Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T05:50:42.8344479Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T05:50:42.8345696Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T05:50:42.8346673Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2025-03-14T05:50:42.8347606Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2025-03-14T05:50:42.8348537Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local ... 2025-03-14T05:50:43.0819014Z 2025-03-14T05:50:43.0820332Z  2025-03-14T05:50:43.0820836Z  2025-03-14T05:50:43.0821239Z  2025-03-14T05:50:43.0821764Z  2025-03-14T05:50:43.0822174Z  2025-03-14T05:50:43.0822558Z  2025-03-14T05:50:43.0822952Z  2025-03-14T05:50:43.0823340Z  2025-03-14T05:50:43.0823858Z [14,597 / 15,235] 48 actions running 2025-03-14T05:50:43.0824716Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T05:50:43.0825680Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T05:50:43.0826654Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T05:50:43.0827549Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T05:50:43.0828479Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T05:50:43.0829533Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2025-03-14T05:50:43.0830830Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2025-03-14T05:50:43.0831813Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local ... 2025-03-14T05:50:43.6858786Z 2025-03-14T05:50:43.6861581Z  2025-03-14T05:50:43.6862975Z  2025-03-14T05:50:43.6863368Z  2025-03-14T05:50:43.6863737Z  2025-03-14T05:50:43.6864110Z  2025-03-14T05:50:43.6864524Z  2025-03-14T05:50:43.6864889Z  2025-03-14T05:50:43.6865258Z  2025-03-14T05:50:43.6866329Z [14,598 / 15,235] 48 actions, 47 running 2025-03-14T05:50:43.6867090Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2025-03-14T05:50:43.6867981Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T05:50:43.6868859Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T05:50:43.6869675Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T05:50:43.6870517Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2025-03-14T05:50:43.6871342Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2025-03-14T05:50:43.6872166Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2025-03-14T05:50:43.6873022Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2025-03-14T05:50:44.0827023Z 2025-03-14T05:50:44.0827871Z  2025-03-14T05:50:44.0828413Z  2025-03-14T05:50:44.0828986Z  2025-03-14T05:50:44.0829310Z  2025-03-14T05:50:44.0829632Z  2025-03-14T05:50:44.0829953Z  2025-03-14T05:50:44.0830293Z  2025-03-14T05:50:44.0830614Z  2025-03-14T05:50:44.0831084Z [14,599 / 15,235] 48 actions running 2025-03-14T05:50:44.0831720Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2025-03-14T05:50:44.0832467Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T05:50:44.0833206Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T05:50:44.0833930Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T05:50:44.0834654Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2025-03-14T05:50:44.0835326Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2025-03-14T05:50:44.0836013Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2025-03-14T05:50:44.0836758Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local ... 2025-03-14T05:50:44.3024517Z 2025-03-14T05:50:44.3025392Z  2025-03-14T05:50:44.3025858Z  2025-03-14T05:50:44.3026299Z  2025-03-14T05:50:44.3026690Z  2025-03-14T05:50:44.3027328Z  2025-03-14T05:50:44.3027704Z  2025-03-14T05:50:44.3028082Z  2025-03-14T05:50:44.3028457Z  2025-03-14T05:50:44.3029014Z [14,601 / 15,235] 48 actions, 47 running 2025-03-14T05:50:44.3029794Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2025-03-14T05:50:44.3030713Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T05:50:44.3031644Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T05:50:44.3032617Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T05:50:44.3033507Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T05:50:44.3034327Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2025-03-14T05:50:44.3035199Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T05:50:44.3036176Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local ... 2025-03-14T05:50:44.6835703Z 2025-03-14T05:50:44.6836612Z  2025-03-14T05:50:44.6837109Z  2025-03-14T05:50:44.6837536Z  2025-03-14T05:50:44.6837962Z  2025-03-14T05:50:44.6838475Z  2025-03-14T05:50:44.6838847Z  2025-03-14T05:50:44.6839196Z  2025-03-14T05:50:44.6839584Z  2025-03-14T05:50:44.6840106Z [14,602 / 15,235] 48 actions running 2025-03-14T05:50:44.6841016Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2025-03-14T05:50:44.6841752Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T05:50:44.6842586Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T05:50:44.6843492Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T05:50:44.6844592Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T05:50:44.6845536Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2025-03-14T05:50:44.6846642Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T05:50:44.6847605Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local ... 2025-03-14T05:50:44.9973404Z 2025-03-14T05:50:44.9974299Z  2025-03-14T05:50:44.9974778Z  2025-03-14T05:50:44.9975194Z  2025-03-14T05:50:44.9975606Z  2025-03-14T05:50:44.9975996Z  2025-03-14T05:50:44.9976408Z  2025-03-14T05:50:44.9976818Z  2025-03-14T05:50:44.9977198Z  2025-03-14T05:50:44.9977787Z [14,603 / 15,235] 48 actions, 47 running 2025-03-14T05:50:44.9978584Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2025-03-14T05:50:44.9979540Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2025-03-14T05:50:44.9980447Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T05:50:44.9981602Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T05:50:44.9982499Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T05:50:44.9983341Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2025-03-14T05:50:44.9984223Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T05:50:44.9985136Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local ... 2025-03-14T05:50:45.2841591Z 2025-03-14T05:50:45.2842536Z  2025-03-14T05:50:45.2843047Z  2025-03-14T05:50:45.2843486Z  2025-03-14T05:50:45.2843931Z  2025-03-14T05:50:45.2844360Z  2025-03-14T05:50:45.2844928Z  2025-03-14T05:50:45.2845365Z  2025-03-14T05:50:45.2845780Z  2025-03-14T05:50:45.2846377Z [14,603 / 15,235] 48 actions running 2025-03-14T05:50:45.2847106Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2025-03-14T05:50:45.2847848Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2025-03-14T05:50:45.2848605Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T05:50:45.2849352Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T05:50:45.2850722Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T05:50:45.2851602Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2025-03-14T05:50:45.2852546Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2025-03-14T05:50:45.2853489Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local ... 2025-03-14T05:50:45.4864419Z 2025-03-14T05:50:45.4865499Z  2025-03-14T05:50:45.4866043Z  2025-03-14T05:50:45.4866441Z  2025-03-14T05:50:45.4866844Z  2025-03-14T05:50:45.4867252Z  2025-03-14T05:50:45.4867636Z  2025-03-14T05:50:45.4867992Z  2025-03-14T05:50:45.4868369Z  2025-03-14T05:50:45.4868961Z [14,604 / 15,235] 48 actions, 47 running 2025-03-14T05:50:45.4869773Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T05:50:45.4870715Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2025-03-14T05:50:45.4871661Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T05:50:45.4872592Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T05:50:45.4873466Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T05:50:45.4874309Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2025-03-14T05:50:45.4875191Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2025-03-14T05:50:45.4876387Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local ... 2025-03-14T05:50:45.7846740Z 2025-03-14T05:50:45.7847586Z  2025-03-14T05:50:45.7848112Z  2025-03-14T05:50:45.7848572Z  2025-03-14T05:50:45.7848997Z  2025-03-14T05:50:45.7849400Z  2025-03-14T05:50:45.7849841Z  2025-03-14T05:50:45.7850248Z  2025-03-14T05:50:45.7850727Z  2025-03-14T05:50:45.7851344Z [14,606 / 15,235] 48 actions, 47 running 2025-03-14T05:50:45.7852427Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T05:50:45.7853426Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T05:50:45.7854440Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T05:50:45.7855463Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T05:50:45.7856402Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T05:50:45.7857246Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2025-03-14T05:50:45.7858057Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2025-03-14T05:50:45.7858977Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local ... 2025-03-14T05:50:46.0847876Z 2025-03-14T05:50:46.0848713Z  2025-03-14T05:50:46.0849281Z  2025-03-14T05:50:46.0849706Z  2025-03-14T05:50:46.0850456Z  2025-03-14T05:50:46.0850840Z  2025-03-14T05:50:46.0851200Z  2025-03-14T05:50:46.0851739Z  2025-03-14T05:50:46.0852183Z  2025-03-14T05:50:46.0852783Z [14,607 / 15,235] 48 actions running 2025-03-14T05:50:46.0853593Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T05:50:46.0854540Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T05:50:46.0855521Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T05:50:46.0856459Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T05:50:46.0857462Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T05:50:46.0858340Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2025-03-14T05:50:46.0859309Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2025-03-14T05:50:46.0860330Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local ... 2025-03-14T05:50:46.3420727Z 2025-03-14T05:50:46.3421583Z  2025-03-14T05:50:46.3422080Z  2025-03-14T05:50:46.3422486Z  2025-03-14T05:50:46.3422946Z  2025-03-14T05:50:46.3423401Z  2025-03-14T05:50:46.3424099Z  2025-03-14T05:50:46.3424456Z  2025-03-14T05:50:46.3424862Z  2025-03-14T05:50:46.3425487Z [14,608 / 15,235] 48 actions, 47 running 2025-03-14T05:50:46.3426333Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T05:50:46.3427308Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T05:50:46.3428339Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T05:50:46.3429275Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T05:50:46.3430243Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T05:50:46.3431295Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T05:50:46.3432303Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2025-03-14T05:50:46.3433180Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local ... 2025-03-14T05:50:46.5898538Z 2025-03-14T05:50:46.5899436Z  2025-03-14T05:50:46.5899907Z  2025-03-14T05:50:46.5900298Z  2025-03-14T05:50:46.5900666Z  2025-03-14T05:50:46.5901161Z  2025-03-14T05:50:46.5901577Z  2025-03-14T05:50:46.5901994Z  2025-03-14T05:50:46.5902387Z  2025-03-14T05:50:46.5902992Z [14,610 / 15,235] 48 actions, 47 running 2025-03-14T05:50:46.5903848Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T05:50:46.5905139Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T05:50:46.5906162Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T05:50:46.5907067Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T05:50:46.5908049Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T05:50:46.5909145Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T05:50:46.5910263Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2025-03-14T05:50:46.5911274Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local ... 2025-03-14T05:50:46.8690268Z 2025-03-14T05:50:46.8691122Z  2025-03-14T05:50:46.8691594Z  2025-03-14T05:50:46.8692004Z  2025-03-14T05:50:46.8692394Z  2025-03-14T05:50:46.8692784Z  2025-03-14T05:50:46.8693154Z  2025-03-14T05:50:46.8693570Z  2025-03-14T05:50:46.8693990Z  2025-03-14T05:50:46.8694617Z [14,612 / 15,235] 48 actions, 47 running 2025-03-14T05:50:46.8695428Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T05:50:46.8696312Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T05:50:46.8697200Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2025-03-14T05:50:46.8698312Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T05:50:46.8699229Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T05:50:46.8700187Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T05:50:46.8701095Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T05:50:46.8701999Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local ... 2025-03-14T05:50:47.0856149Z 2025-03-14T05:50:47.0857017Z  2025-03-14T05:50:47.0857512Z  2025-03-14T05:50:47.0857915Z  2025-03-14T05:50:47.0858299Z  2025-03-14T05:50:47.0858684Z  2025-03-14T05:50:47.0859094Z  2025-03-14T05:50:47.0859475Z  2025-03-14T05:50:47.0859868Z  2025-03-14T05:50:47.0860414Z [14,613 / 15,235] 48 actions running 2025-03-14T05:50:47.0861197Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T05:50:47.0862100Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T05:50:47.0863004Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2025-03-14T05:50:47.0863921Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T05:50:47.0865070Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T05:50:47.0866252Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T05:50:47.0867144Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T05:50:47.0868094Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local ... 2025-03-14T05:50:47.4860630Z 2025-03-14T05:50:47.4861502Z  2025-03-14T05:50:47.4861958Z  2025-03-14T05:50:47.4862347Z  2025-03-14T05:50:47.4862743Z  2025-03-14T05:50:47.4863120Z  2025-03-14T05:50:47.4863490Z  2025-03-14T05:50:47.4863865Z  2025-03-14T05:50:47.4864243Z  2025-03-14T05:50:47.4864782Z [14,614 / 15,235] 48 actions running 2025-03-14T05:50:47.4865877Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2025-03-14T05:50:47.4866805Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T05:50:47.4867705Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2025-03-14T05:50:47.4868550Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T05:50:47.4869444Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2025-03-14T05:50:47.4870371Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2025-03-14T05:50:47.4871600Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T05:50:47.4872525Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local ... 2025-03-14T05:50:48.4868416Z 2025-03-14T05:50:48.4869260Z  2025-03-14T05:50:48.4869709Z  2025-03-14T05:50:48.4870085Z  2025-03-14T05:50:48.4870453Z  2025-03-14T05:50:48.4870809Z  2025-03-14T05:50:48.4871169Z  2025-03-14T05:50:48.4871583Z  2025-03-14T05:50:48.4871943Z  2025-03-14T05:50:48.4872465Z [14,614 / 15,235] 48 actions running 2025-03-14T05:50:48.4873674Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T05:50:48.4874564Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2025-03-14T05:50:48.4875402Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2025-03-14T05:50:48.4876236Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2025-03-14T05:50:48.4877093Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T05:50:48.4878051Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2025-03-14T05:50:48.4878929Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2025-03-14T05:50:48.4879826Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local ... 2025-03-14T05:50:48.8271193Z 2025-03-14T05:50:48.8272066Z  2025-03-14T05:50:48.8272515Z  2025-03-14T05:50:48.8273285Z  2025-03-14T05:50:48.8273652Z  2025-03-14T05:50:48.8274026Z  2025-03-14T05:50:48.8274421Z  2025-03-14T05:50:48.8274840Z  2025-03-14T05:50:48.8275246Z  2025-03-14T05:50:48.8275832Z [14,617 / 15,235] 48 actions, 47 running 2025-03-14T05:50:48.8276480Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T05:50:48.8277301Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T05:50:48.8278172Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2025-03-14T05:50:48.8278987Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T05:50:48.8279819Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T05:50:48.8280709Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2025-03-14T05:50:48.8281549Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2025-03-14T05:50:48.8282492Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local ... 2025-03-14T05:50:49.0731780Z 2025-03-14T05:50:49.0732579Z  2025-03-14T05:50:49.0733044Z  2025-03-14T05:50:49.0733406Z  2025-03-14T05:50:49.0734006Z  2025-03-14T05:50:49.0734360Z  2025-03-14T05:50:49.0734717Z  2025-03-14T05:50:49.0735080Z  2025-03-14T05:50:49.0735421Z  2025-03-14T05:50:49.0735936Z [14,619 / 15,235] 48 actions, 47 running 2025-03-14T05:50:49.0736655Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T05:50:49.0737501Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T05:50:49.0738338Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2025-03-14T05:50:49.0739109Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T05:50:49.0739937Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T05:50:49.0740804Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2025-03-14T05:50:49.0741620Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2025-03-14T05:50:49.0742444Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local ... 2025-03-14T05:50:49.2874712Z 2025-03-14T05:50:49.2875572Z  2025-03-14T05:50:49.2876002Z  2025-03-14T05:50:49.2876358Z  2025-03-14T05:50:49.2876708Z  2025-03-14T05:50:49.2877052Z  2025-03-14T05:50:49.2877398Z  2025-03-14T05:50:49.2877738Z  2025-03-14T05:50:49.2878084Z  2025-03-14T05:50:49.2878577Z [14,619 / 15,235] 48 actions running 2025-03-14T05:50:49.2879535Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T05:50:49.2880358Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T05:50:49.2881165Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2025-03-14T05:50:49.2881926Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T05:50:49.2882723Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2025-03-14T05:50:49.2883702Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2025-03-14T05:50:49.2884693Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2025-03-14T05:50:49.2885507Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local ... 2025-03-14T05:50:50.0418574Z 2025-03-14T05:50:50.0419465Z  2025-03-14T05:50:50.0419955Z  2025-03-14T05:50:50.0420328Z  2025-03-14T05:50:50.0420699Z  2025-03-14T05:50:50.0421059Z  2025-03-14T05:50:50.0421445Z  2025-03-14T05:50:50.0421818Z  2025-03-14T05:50:50.0422184Z  2025-03-14T05:50:50.0422671Z [14,620 / 15,235] 48 actions, 47 running 2025-03-14T05:50:50.0423417Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2025-03-14T05:50:50.0424297Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2025-03-14T05:50:50.0425174Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T05:50:50.0426331Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T05:50:50.0427221Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2025-03-14T05:50:50.0428197Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2025-03-14T05:50:50.0429102Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T05:50:50.0429958Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local ... 2025-03-14T05:50:50.2882434Z 2025-03-14T05:50:50.2883274Z  2025-03-14T05:50:50.2883760Z  2025-03-14T05:50:50.2884190Z  2025-03-14T05:50:50.2884710Z  2025-03-14T05:50:50.2885069Z  2025-03-14T05:50:50.2885435Z  2025-03-14T05:50:50.2885815Z  2025-03-14T05:50:50.2886181Z  2025-03-14T05:50:50.2886737Z [14,620 / 15,235] 48 actions running 2025-03-14T05:50:50.2887523Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2025-03-14T05:50:50.2888436Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2025-03-14T05:50:50.2889360Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T05:50:50.2890589Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T05:50:50.2891454Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T05:50:50.2892413Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T05:50:50.2893318Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T05:50:50.2894332Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local ... 2025-03-14T05:50:50.4887458Z 2025-03-14T05:50:50.4888311Z  2025-03-14T05:50:50.4888755Z  2025-03-14T05:50:50.4889137Z  2025-03-14T05:50:50.4889513Z  2025-03-14T05:50:50.4889901Z  2025-03-14T05:50:50.4890290Z  2025-03-14T05:50:50.4890673Z  2025-03-14T05:50:50.4891040Z  2025-03-14T05:50:50.4891647Z [14,621 / 15,235] 48 actions, 47 running 2025-03-14T05:50:50.4892454Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T05:50:50.4893344Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2025-03-14T05:50:50.4894207Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T05:50:50.4895059Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T05:50:50.4895968Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T05:50:50.4896907Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T05:50:50.4898030Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T05:50:50.4898956Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local ... 2025-03-14T05:50:50.7227315Z 2025-03-14T05:50:50.7228190Z  2025-03-14T05:50:50.7228645Z  2025-03-14T05:50:50.7229009Z  2025-03-14T05:50:50.7229402Z  2025-03-14T05:50:50.7229829Z  2025-03-14T05:50:50.7230228Z  2025-03-14T05:50:50.7230596Z  2025-03-14T05:50:50.7230961Z  2025-03-14T05:50:50.7231784Z [14,622 / 15,235] 48 actions, 47 running 2025-03-14T05:50:50.7232623Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T05:50:50.7233543Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T05:50:50.7234446Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T05:50:50.7235327Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T05:50:50.7236216Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T05:50:50.7237108Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T05:50:50.7237978Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2025-03-14T05:50:50.7238765Z Compiling xla/pjrt/host_callback.cc; 22s local ... 2025-03-14T05:50:51.0892267Z 2025-03-14T05:50:51.0893416Z  2025-03-14T05:50:51.0893880Z  2025-03-14T05:50:51.0894252Z  2025-03-14T05:50:51.0894627Z  2025-03-14T05:50:51.0895025Z  2025-03-14T05:50:51.0895399Z  2025-03-14T05:50:51.0895792Z  2025-03-14T05:50:51.0896175Z  2025-03-14T05:50:51.0896725Z [14,624 / 15,235] 48 actions running 2025-03-14T05:50:51.0897503Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T05:50:51.0898394Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T05:50:51.0899271Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T05:50:51.0900174Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T05:50:51.0901009Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T05:50:51.0901954Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T05:50:51.0902838Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2025-03-14T05:50:51.0903612Z Compiling xla/pjrt/host_callback.cc; 22s local ... 2025-03-14T05:50:51.6476857Z 2025-03-14T05:50:51.6477727Z  2025-03-14T05:50:51.6478219Z  2025-03-14T05:50:51.6478609Z  2025-03-14T05:50:51.6479281Z  2025-03-14T05:50:51.6479675Z  2025-03-14T05:50:51.6480034Z  2025-03-14T05:50:51.6480409Z  2025-03-14T05:50:51.6480795Z  2025-03-14T05:50:51.6481375Z [14,625 / 15,235] 48 actions, 47 running 2025-03-14T05:50:51.6482173Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T05:50:51.6483083Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T05:50:51.6483935Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T05:50:51.6484909Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T05:50:51.6485783Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2025-03-14T05:50:51.6486728Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2025-03-14T05:50:51.6487591Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T05:50:51.6488342Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local ... 2025-03-14T05:50:51.8898606Z 2025-03-14T05:50:51.8899463Z  2025-03-14T05:50:51.8899904Z  2025-03-14T05:50:51.8900287Z  2025-03-14T05:50:51.8900670Z  2025-03-14T05:50:51.8901041Z  2025-03-14T05:50:51.8901440Z  2025-03-14T05:50:51.8901825Z  2025-03-14T05:50:51.8902262Z  2025-03-14T05:50:51.8902814Z [14,627 / 15,235] 48 actions, 47 running 2025-03-14T05:50:51.8903816Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T05:50:51.8904710Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T05:50:51.8905772Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T05:50:51.8906623Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T05:50:51.8907496Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2025-03-14T05:50:51.8908618Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2025-03-14T05:50:51.8909430Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T05:50:51.8910178Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local ... 2025-03-14T05:50:52.2900301Z 2025-03-14T05:50:52.2901222Z  2025-03-14T05:50:52.2901690Z  2025-03-14T05:50:52.2902092Z  2025-03-14T05:50:52.2902454Z  2025-03-14T05:50:52.2902856Z  2025-03-14T05:50:52.2903232Z  2025-03-14T05:50:52.2903598Z  2025-03-14T05:50:52.2904017Z  2025-03-14T05:50:52.2904590Z [14,628 / 15,235] 48 actions running 2025-03-14T05:50:52.2905387Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T05:50:52.2906298Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T05:50:52.2907295Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T05:50:52.2908562Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T05:50:52.2909442Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T05:50:52.2910427Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2025-03-14T05:50:52.2911268Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T05:50:52.2912037Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local ... 2025-03-14T05:50:52.5015722Z 2025-03-14T05:50:52.5016607Z  2025-03-14T05:50:52.5017102Z  2025-03-14T05:50:52.5017501Z  2025-03-14T05:50:52.5017940Z  2025-03-14T05:50:52.5018366Z  2025-03-14T05:50:52.5018774Z  2025-03-14T05:50:52.5019158Z  2025-03-14T05:50:52.5019529Z  2025-03-14T05:50:52.5020111Z [14,629 / 15,235] 48 actions, 47 running 2025-03-14T05:50:52.5021039Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T05:50:52.5022002Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T05:50:52.5023027Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T05:50:52.5023910Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T05:50:52.5025186Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T05:50:52.5026139Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2025-03-14T05:50:52.5027053Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local 2025-03-14T05:50:52.5027923Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local ... 2025-03-14T05:50:52.8727040Z 2025-03-14T05:50:52.8727897Z  2025-03-14T05:50:52.8728383Z  2025-03-14T05:50:52.8728807Z  2025-03-14T05:50:52.8729227Z  2025-03-14T05:50:52.8729647Z  2025-03-14T05:50:52.8730054Z  2025-03-14T05:50:52.8730463Z  2025-03-14T05:50:52.8730876Z  2025-03-14T05:50:52.8731491Z [14,630 / 15,235] 48 actions, 47 running 2025-03-14T05:50:52.8732369Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T05:50:52.8733355Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T05:50:52.8734344Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T05:50:52.8735296Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T05:50:52.8736251Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T05:50:52.8737177Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local 2025-03-14T05:50:52.8738305Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2025-03-14T05:50:52.8739203Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local ... 2025-03-14T05:50:53.0907518Z 2025-03-14T05:50:53.0908420Z  2025-03-14T05:50:53.0908921Z  2025-03-14T05:50:53.0909341Z  2025-03-14T05:50:53.0909771Z  2025-03-14T05:50:53.0910182Z  2025-03-14T05:50:53.0910589Z  2025-03-14T05:50:53.0911052Z  2025-03-14T05:50:53.0911562Z  2025-03-14T05:50:53.0912422Z [14,630 / 15,235] 48 actions running 2025-03-14T05:50:53.0913259Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T05:50:53.0914214Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T05:50:53.0915137Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T05:50:53.0916052Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T05:50:53.0916983Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T05:50:53.0917861Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local 2025-03-14T05:50:53.0918690Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2025-03-14T05:50:53.0919492Z Compiling xla/service/cpu/thunk_emitter.cc; 19s local ... 2025-03-14T05:50:53.3096687Z 2025-03-14T05:50:53.3097543Z  2025-03-14T05:50:53.3098033Z  2025-03-14T05:50:53.3098751Z  2025-03-14T05:50:53.3099146Z  2025-03-14T05:50:53.3099543Z  2025-03-14T05:50:53.3099909Z  2025-03-14T05:50:53.3100284Z  2025-03-14T05:50:53.3100652Z  2025-03-14T05:50:53.3101255Z [14,633 / 15,235] 48 actions, 47 running 2025-03-14T05:50:53.3102000Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T05:50:53.3102940Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T05:50:53.3103883Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T05:50:53.3104933Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T05:50:53.3105872Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2025-03-14T05:50:53.3106760Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local 2025-03-14T05:50:53.3107605Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2025-03-14T05:50:53.3108454Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local ... 2025-03-14T05:50:53.5489041Z 2025-03-14T05:50:53.5489939Z  2025-03-14T05:50:53.5490432Z  2025-03-14T05:50:53.5490849Z  2025-03-14T05:50:53.5491296Z  2025-03-14T05:50:53.5491971Z  2025-03-14T05:50:53.5492393Z  2025-03-14T05:50:53.5492807Z  2025-03-14T05:50:53.5493220Z  2025-03-14T05:50:53.5493828Z [14,635 / 15,235] 48 actions, 47 running 2025-03-14T05:50:53.5494719Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T05:50:53.5495716Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T05:50:53.5505602Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T05:50:53.5506811Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2025-03-14T05:50:53.5507756Z Compiling xla/pjrt/tracked_device_buffer.cc; 24s local 2025-03-14T05:50:53.5508610Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2025-03-14T05:50:53.5509461Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local 2025-03-14T05:50:53.5510260Z Compiling xla/service/backend.cc; 16s local ... 2025-03-14T05:50:53.7922658Z 2025-03-14T05:50:53.7923535Z  2025-03-14T05:50:53.7923998Z  2025-03-14T05:50:53.7924377Z  2025-03-14T05:50:53.7924908Z  2025-03-14T05:50:53.7925313Z  2025-03-14T05:50:53.7925697Z  2025-03-14T05:50:53.7926079Z  2025-03-14T05:50:53.7926429Z  2025-03-14T05:50:53.7926989Z [14,636 / 15,235] 48 actions, 47 running 2025-03-14T05:50:53.7927801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T05:50:53.7929066Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T05:50:53.7930021Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T05:50:53.7930983Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2025-03-14T05:50:53.7931851Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2025-03-14T05:50:53.7932666Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local 2025-03-14T05:50:53.7933336Z Compiling xla/service/backend.cc; 16s local 2025-03-14T05:50:53.7934240Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local ... 2025-03-14T05:50:54.0914526Z 2025-03-14T05:50:54.0915428Z  2025-03-14T05:50:54.0915942Z  2025-03-14T05:50:54.0916396Z  2025-03-14T05:50:54.0916840Z  2025-03-14T05:50:54.0917271Z  2025-03-14T05:50:54.0917723Z  2025-03-14T05:50:54.0918164Z  2025-03-14T05:50:54.0918602Z  2025-03-14T05:50:54.0919243Z [14,636 / 15,235] 48 actions running 2025-03-14T05:50:54.0920185Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T05:50:54.0921254Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T05:50:54.0922266Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T05:50:54.0923302Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2025-03-14T05:50:54.0924704Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2025-03-14T05:50:54.0925617Z Compiling xla/service/cpu/thunk_emitter.cc; 20s local 2025-03-14T05:50:54.0926434Z Compiling xla/service/backend.cc; 16s local 2025-03-14T05:50:54.0927290Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local ... 2025-03-14T05:50:54.5392738Z 2025-03-14T05:50:54.5393651Z  2025-03-14T05:50:54.5394128Z  2025-03-14T05:50:54.5394555Z  2025-03-14T05:50:54.5394953Z  2025-03-14T05:50:54.5395366Z  2025-03-14T05:50:54.5395764Z  2025-03-14T05:50:54.5396286Z  2025-03-14T05:50:54.5396728Z  2025-03-14T05:50:54.5397335Z [14,637 / 15,235] 48 actions, 47 running 2025-03-14T05:50:54.5398202Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T05:50:54.5399166Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T05:50:54.5400063Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T05:50:54.5401033Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T05:50:54.5401980Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T05:50:54.5403068Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2025-03-14T05:50:54.5403771Z Compiling xla/service/backend.cc; 17s local 2025-03-14T05:50:54.5404699Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local ... 2025-03-14T05:50:54.8921656Z 2025-03-14T05:50:54.8922554Z  2025-03-14T05:50:54.8923050Z  2025-03-14T05:50:54.8923479Z  2025-03-14T05:50:54.8924030Z  2025-03-14T05:50:54.8924452Z  2025-03-14T05:50:54.8925008Z  2025-03-14T05:50:54.8925397Z  2025-03-14T05:50:54.8925795Z  2025-03-14T05:50:54.8926361Z [14,638 / 15,235] 48 actions running 2025-03-14T05:50:54.8927086Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T05:50:54.8928044Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T05:50:54.8928969Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T05:50:54.8929932Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T05:50:54.8930891Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T05:50:54.8931710Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2025-03-14T05:50:54.8932437Z Compiling xla/service/backend.cc; 17s local 2025-03-14T05:50:54.8933220Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local ... 2025-03-14T05:50:55.0924662Z 2025-03-14T05:50:55.0925814Z  2025-03-14T05:50:55.0926270Z  2025-03-14T05:50:55.0926628Z  2025-03-14T05:50:55.0926997Z  2025-03-14T05:50:55.0927359Z  2025-03-14T05:50:55.0927714Z  2025-03-14T05:50:55.0928062Z  2025-03-14T05:50:55.0928412Z  2025-03-14T05:50:55.0928923Z [14,641 / 15,235] 48 actions running 2025-03-14T05:50:55.0929668Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T05:50:55.0930651Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T05:50:55.0931443Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T05:50:55.0932285Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T05:50:55.0933095Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T05:50:55.0933837Z Compiling xla/service/cpu/thunk_emitter.cc; 21s local 2025-03-14T05:50:55.0934555Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2025-03-14T05:50:55.0935314Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local ... 2025-03-14T05:50:55.3906295Z 2025-03-14T05:50:55.3907120Z  2025-03-14T05:50:55.3907579Z  2025-03-14T05:50:55.3907951Z  2025-03-14T05:50:55.3908338Z  2025-03-14T05:50:55.3908719Z  2025-03-14T05:50:55.3909100Z  2025-03-14T05:50:55.3909477Z  2025-03-14T05:50:55.3910164Z  2025-03-14T05:50:55.3910709Z [14,643 / 15,235] 48 actions, 47 running 2025-03-14T05:50:55.3911505Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T05:50:55.3912373Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T05:50:55.3913200Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T05:50:55.3914013Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T05:50:55.3914821Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2025-03-14T05:50:55.3915578Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T05:50:55.3916326Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local 2025-03-14T05:50:55.3917104Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 14s local ... 2025-03-14T05:50:55.6067036Z 2025-03-14T05:50:55.6067889Z  2025-03-14T05:50:55.6068336Z  2025-03-14T05:50:55.6068703Z  2025-03-14T05:50:55.6069101Z  2025-03-14T05:50:55.6069452Z  2025-03-14T05:50:55.6069802Z  2025-03-14T05:50:55.6070141Z  2025-03-14T05:50:55.6070500Z  2025-03-14T05:50:55.6071040Z [14,646 / 15,235] 48 actions, 47 running 2025-03-14T05:50:55.6072005Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T05:50:55.6072822Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T05:50:55.6073612Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T05:50:55.6074422Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T05:50:55.6075187Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2025-03-14T05:50:55.6075872Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T05:50:55.6076570Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local 2025-03-14T05:50:55.6077361Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 15s local ... 2025-03-14T05:50:55.8931241Z 2025-03-14T05:50:55.8932051Z  2025-03-14T05:50:55.8932460Z  2025-03-14T05:50:55.8932806Z  2025-03-14T05:50:55.8933148Z  2025-03-14T05:50:55.8933499Z  2025-03-14T05:50:55.8933845Z  2025-03-14T05:50:55.8934192Z  2025-03-14T05:50:55.8934527Z  2025-03-14T05:50:55.8934991Z [14,646 / 15,235] 48 actions running 2025-03-14T05:50:55.8935708Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T05:50:55.8936504Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T05:50:55.8937258Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T05:50:55.8938304Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T05:50:55.8939056Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2025-03-14T05:50:55.8939739Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T05:50:55.8940420Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local 2025-03-14T05:50:55.8941162Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 15s local ... 2025-03-14T05:50:56.0935200Z 2025-03-14T05:50:56.0936260Z  2025-03-14T05:50:56.0936703Z  2025-03-14T05:50:56.0937070Z  2025-03-14T05:50:56.0937421Z  2025-03-14T05:50:56.0937751Z  2025-03-14T05:50:56.0938097Z  2025-03-14T05:50:56.0938446Z  2025-03-14T05:50:56.0938809Z  2025-03-14T05:50:56.0939360Z [14,648 / 15,235] 48 actions running 2025-03-14T05:50:56.0940143Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T05:50:56.0940961Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T05:50:56.0941725Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T05:50:56.0942508Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T05:50:56.0943245Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2025-03-14T05:50:56.0943921Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T05:50:56.0944788Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local 2025-03-14T05:50:56.0945529Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 15s local ... 2025-03-14T05:50:56.5851651Z 2025-03-14T05:50:56.5852508Z  2025-03-14T05:50:56.5852929Z  2025-03-14T05:50:56.5853258Z  2025-03-14T05:50:56.5853649Z  2025-03-14T05:50:56.5853993Z  2025-03-14T05:50:56.5854334Z  2025-03-14T05:50:56.5854669Z  2025-03-14T05:50:56.5855006Z  2025-03-14T05:50:56.5855510Z [14,649 / 15,235] 48 actions, 47 running 2025-03-14T05:50:56.5856258Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T05:50:56.5857056Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T05:50:56.5857918Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T05:50:56.5858665Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T05:50:56.5859372Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2025-03-14T05:50:56.5860036Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T05:50:56.5860686Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local 2025-03-14T05:50:56.5861681Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 16s local ... 2025-03-14T05:50:56.8942380Z 2025-03-14T05:50:56.8943193Z  2025-03-14T05:50:56.8943668Z  2025-03-14T05:50:56.8944071Z  2025-03-14T05:50:56.8944475Z  2025-03-14T05:50:56.8944864Z  2025-03-14T05:50:56.8945343Z  2025-03-14T05:50:56.8945791Z  2025-03-14T05:50:56.8946201Z  2025-03-14T05:50:56.8946797Z [14,651 / 15,235] 48 actions running 2025-03-14T05:50:56.8947702Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T05:50:56.8948653Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T05:50:56.8949597Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T05:50:56.8950530Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T05:50:56.8951443Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2025-03-14T05:50:56.8952263Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T05:50:56.8953075Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local 2025-03-14T05:50:56.8953965Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 16s local ... 2025-03-14T05:50:57.0946163Z 2025-03-14T05:50:57.0947061Z  2025-03-14T05:50:57.0947576Z  2025-03-14T05:50:57.0948009Z  2025-03-14T05:50:57.0948725Z  2025-03-14T05:50:57.0949147Z  2025-03-14T05:50:57.0949576Z  2025-03-14T05:50:57.0949997Z  2025-03-14T05:50:57.0950432Z  2025-03-14T05:50:57.0951033Z [14,652 / 15,235] 48 actions running 2025-03-14T05:50:57.0951939Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T05:50:57.0953113Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T05:50:57.0954150Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T05:50:57.0955382Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T05:50:57.0956164Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2025-03-14T05:50:57.0956951Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T05:50:57.0957712Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2025-03-14T05:50:57.0958560Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 16s local ... 2025-03-14T05:50:57.4403965Z 2025-03-14T05:50:57.4405030Z  2025-03-14T05:50:57.4405531Z  2025-03-14T05:50:57.4405928Z  2025-03-14T05:50:57.4406324Z  2025-03-14T05:50:57.4406706Z  2025-03-14T05:50:57.4407073Z  2025-03-14T05:50:57.4407559Z  2025-03-14T05:50:57.4407930Z  2025-03-14T05:50:57.4408506Z [14,654 / 15,235] 48 actions, 47 running 2025-03-14T05:50:57.4409545Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T05:50:57.4410428Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T05:50:57.4411261Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T05:50:57.4412112Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T05:50:57.4412885Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T05:50:57.4413621Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T05:50:57.4414341Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2025-03-14T05:50:57.4415138Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 17s local ... 2025-03-14T05:50:57.6655614Z 2025-03-14T05:50:57.6656443Z  2025-03-14T05:50:57.6656916Z  2025-03-14T05:50:57.6657298Z  2025-03-14T05:50:57.6657678Z  2025-03-14T05:50:57.6658167Z  2025-03-14T05:50:57.6658547Z  2025-03-14T05:50:57.6658981Z  2025-03-14T05:50:57.6659414Z  2025-03-14T05:50:57.6659995Z [14,655 / 15,235] 48 actions, 47 running 2025-03-14T05:50:57.6660803Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T05:50:57.6662002Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2025-03-14T05:50:57.6662930Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T05:50:57.6663885Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T05:50:57.6664684Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T05:50:57.6665726Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T05:50:57.6666498Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2025-03-14T05:50:57.6667378Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 17s local ... 2025-03-14T05:50:57.8952293Z 2025-03-14T05:50:57.8953168Z  2025-03-14T05:50:57.8953669Z  2025-03-14T05:50:57.8954077Z  2025-03-14T05:50:57.8954508Z  2025-03-14T05:50:57.8954894Z  2025-03-14T05:50:57.8955283Z  2025-03-14T05:50:57.8955690Z  2025-03-14T05:50:57.8956108Z  2025-03-14T05:50:57.8956653Z [14,656 / 15,235] 48 actions running 2025-03-14T05:50:57.8957498Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T05:50:57.8958455Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2025-03-14T05:50:57.8959335Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T05:50:57.8960279Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T05:50:57.8961383Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T05:50:57.8962213Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T05:50:57.8963013Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local 2025-03-14T05:50:57.8963878Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 17s local ... 2025-03-14T05:50:58.0956560Z 2025-03-14T05:50:58.0957431Z  2025-03-14T05:50:58.0957909Z  2025-03-14T05:50:58.0958320Z  2025-03-14T05:50:58.0959016Z  2025-03-14T05:50:58.0959434Z  2025-03-14T05:50:58.0959848Z  2025-03-14T05:50:58.0960263Z  2025-03-14T05:50:58.0960663Z  2025-03-14T05:50:58.0961218Z [14,658 / 15,235] 48 actions running 2025-03-14T05:50:58.0962054Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T05:50:58.0963002Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2025-03-14T05:50:58.0963931Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T05:50:58.0965039Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T05:50:58.0966144Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T05:50:58.0966953Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T05:50:58.0967734Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2025-03-14T05:50:58.0968864Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 17s local ... 2025-03-14T05:50:58.3132835Z 2025-03-14T05:50:58.3133733Z  2025-03-14T05:50:58.3134215Z  2025-03-14T05:50:58.3134616Z  2025-03-14T05:50:58.3135019Z  2025-03-14T05:50:58.3135384Z  2025-03-14T05:50:58.3135774Z  2025-03-14T05:50:58.3136157Z  2025-03-14T05:50:58.3136558Z  2025-03-14T05:50:58.3137133Z [14,659 / 15,235] 48 actions, 47 running 2025-03-14T05:50:58.3137956Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T05:50:58.3138892Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2025-03-14T05:50:58.3139696Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T05:50:58.3140629Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T05:50:58.3141480Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2025-03-14T05:50:58.3142245Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T05:50:58.3143047Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2025-03-14T05:50:58.3143917Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 17s local ... 2025-03-14T05:50:58.6978862Z 2025-03-14T05:50:58.6979752Z  2025-03-14T05:50:58.6980241Z  2025-03-14T05:50:58.6980666Z  2025-03-14T05:50:58.6981066Z  2025-03-14T05:50:58.6981458Z  2025-03-14T05:50:58.6981836Z  2025-03-14T05:50:58.6982184Z  2025-03-14T05:50:58.6982566Z  2025-03-14T05:50:58.6983117Z [14,660 / 15,235] 48 actions running 2025-03-14T05:50:58.6983966Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T05:50:58.6984889Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T05:50:58.6985787Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T05:50:58.6986683Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2025-03-14T05:50:58.6987592Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2025-03-14T05:50:58.6988416Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local 2025-03-14T05:50:58.6989270Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local 2025-03-14T05:50:58.6990106Z @llvm-project//mlir:TransformDialect; 16s local ... 2025-03-14T05:50:59.0984625Z 2025-03-14T05:50:59.0985499Z  2025-03-14T05:50:59.0985975Z  2025-03-14T05:50:59.0986371Z  2025-03-14T05:50:59.0986758Z  2025-03-14T05:50:59.0987134Z  2025-03-14T05:50:59.0987534Z  2025-03-14T05:50:59.0987914Z  2025-03-14T05:50:59.0988608Z  2025-03-14T05:50:59.0989201Z [14,661 / 15,235] 47 actions running 2025-03-14T05:50:59.0990039Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T05:50:59.0991008Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T05:50:59.0991903Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T05:50:59.0992761Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2025-03-14T05:50:59.0993763Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2025-03-14T05:50:59.0994571Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2025-03-14T05:50:59.0995368Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local 2025-03-14T05:50:59.0996204Z @llvm-project//mlir:TransformDialect; 16s local ... 2025-03-14T05:50:59.4081470Z 2025-03-14T05:50:59.4082374Z  2025-03-14T05:50:59.4082871Z  2025-03-14T05:50:59.4083306Z  2025-03-14T05:50:59.4083709Z  2025-03-14T05:50:59.4084142Z  2025-03-14T05:50:59.4084687Z  2025-03-14T05:50:59.4085088Z  2025-03-14T05:50:59.4085489Z  2025-03-14T05:50:59.4086091Z [14,662 / 15,235] 48 actions, 47 running 2025-03-14T05:50:59.4086944Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T05:50:59.4087916Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T05:50:59.4089282Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T05:50:59.4090155Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2025-03-14T05:50:59.4090929Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T05:50:59.4091709Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2025-03-14T05:50:59.4092520Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2025-03-14T05:50:59.4093333Z @llvm-project//mlir:TransformDialect; 17s local ... 2025-03-14T05:50:59.6989535Z 2025-03-14T05:50:59.6990489Z  2025-03-14T05:50:59.6990988Z  2025-03-14T05:50:59.6991413Z  2025-03-14T05:50:59.6991855Z  2025-03-14T05:50:59.6992238Z  2025-03-14T05:50:59.6992633Z  2025-03-14T05:50:59.6993024Z  2025-03-14T05:50:59.6993420Z  2025-03-14T05:50:59.6993975Z [14,663 / 15,235] 48 actions running 2025-03-14T05:50:59.6994800Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T05:50:59.6995796Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T05:50:59.6996683Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T05:50:59.6997794Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2025-03-14T05:50:59.6998580Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T05:50:59.6999379Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2025-03-14T05:50:59.7000217Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2025-03-14T05:50:59.7001077Z @llvm-project//mlir:TransformDialect; 17s local ... 2025-03-14T05:51:00.0051121Z 2025-03-14T05:51:00.0051949Z  2025-03-14T05:51:00.0052442Z  2025-03-14T05:51:00.0052830Z  2025-03-14T05:51:00.0053238Z  2025-03-14T05:51:00.0053638Z  2025-03-14T05:51:00.0054080Z  2025-03-14T05:51:00.0054447Z  2025-03-14T05:51:00.0054868Z  2025-03-14T05:51:00.0055447Z [14,665 / 15,235] 48 actions, 47 running 2025-03-14T05:51:00.0056276Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T05:51:00.0057212Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2025-03-14T05:51:00.0058125Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T05:51:00.0058969Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2025-03-14T05:51:00.0059776Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T05:51:00.0060552Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T05:51:00.0061699Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2025-03-14T05:51:00.0062506Z @llvm-project//mlir:TransformDialect; 17s local ... 2025-03-14T05:51:00.2996292Z 2025-03-14T05:51:00.2997176Z  2025-03-14T05:51:00.2997654Z  2025-03-14T05:51:00.2998021Z  2025-03-14T05:51:00.2998410Z  2025-03-14T05:51:00.2998836Z  2025-03-14T05:51:00.2999204Z  2025-03-14T05:51:00.2999579Z  2025-03-14T05:51:00.2999949Z  2025-03-14T05:51:00.3000807Z [14,666 / 15,235] 48 actions running 2025-03-14T05:51:00.3001639Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T05:51:00.3002654Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2025-03-14T05:51:00.3003570Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T05:51:00.3004410Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T05:51:00.3005428Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T05:51:00.3006236Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T05:51:00.3007083Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local 2025-03-14T05:51:00.3007957Z @llvm-project//mlir:TransformDialect; 18s local ... 2025-03-14T05:51:00.8679965Z 2025-03-14T05:51:00.8680812Z  2025-03-14T05:51:00.8681567Z  2025-03-14T05:51:00.8681993Z  2025-03-14T05:51:00.8682423Z  2025-03-14T05:51:00.8682847Z  2025-03-14T05:51:00.8683278Z  2025-03-14T05:51:00.8683707Z  2025-03-14T05:51:00.8684135Z  2025-03-14T05:51:00.8684900Z [14,667 / 15,235] 48 actions, 47 running 2025-03-14T05:51:00.8685770Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T05:51:00.8686755Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T05:51:00.8687744Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T05:51:00.8688605Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T05:51:00.8689447Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2025-03-14T05:51:00.8690291Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T05:51:00.8691167Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2025-03-14T05:51:00.8692000Z @llvm-project//mlir:TransformDialect; 18s local ... 2025-03-14T05:51:01.1003315Z 2025-03-14T05:51:01.1004179Z  2025-03-14T05:51:01.1004838Z  2025-03-14T05:51:01.1005294Z  2025-03-14T05:51:01.1005711Z  2025-03-14T05:51:01.1006378Z  2025-03-14T05:51:01.1006771Z  2025-03-14T05:51:01.1007154Z  2025-03-14T05:51:01.1007543Z  2025-03-14T05:51:01.1008097Z [14,668 / 15,235] 48 actions running 2025-03-14T05:51:01.1008945Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T05:51:01.1009806Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T05:51:01.1010743Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T05:51:01.1011558Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T05:51:01.1012297Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2025-03-14T05:51:01.1013029Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2025-03-14T05:51:01.1013832Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2025-03-14T05:51:01.1014625Z @llvm-project//mlir:TransformDialect; 18s local ... 2025-03-14T05:51:01.3983331Z 2025-03-14T05:51:01.3984233Z  2025-03-14T05:51:01.3984745Z  2025-03-14T05:51:01.3985120Z  2025-03-14T05:51:01.3985481Z  2025-03-14T05:51:01.3985829Z  2025-03-14T05:51:01.3986214Z  2025-03-14T05:51:01.3986586Z  2025-03-14T05:51:01.3986966Z  2025-03-14T05:51:01.3987531Z [14,669 / 15,235] 48 actions, 47 running 2025-03-14T05:51:01.3988660Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T05:51:01.3989631Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T05:51:01.3990586Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T05:51:01.3991452Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2025-03-14T05:51:01.3992220Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T05:51:01.3993042Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2025-03-14T05:51:01.3994052Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local 2025-03-14T05:51:01.3994902Z @llvm-project//mlir:TransformDialect; 19s local ... 2025-03-14T05:51:01.7010073Z 2025-03-14T05:51:01.7010884Z  2025-03-14T05:51:01.7011354Z  2025-03-14T05:51:01.7011753Z  2025-03-14T05:51:01.7012153Z  2025-03-14T05:51:01.7012549Z  2025-03-14T05:51:01.7012926Z  2025-03-14T05:51:01.7013299Z  2025-03-14T05:51:01.7013670Z  2025-03-14T05:51:01.7014285Z [14,669 / 15,235] 48 actions running 2025-03-14T05:51:01.7015096Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T05:51:01.7015993Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T05:51:01.7016965Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T05:51:01.7017827Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2025-03-14T05:51:01.7018847Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T05:51:01.7019645Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2025-03-14T05:51:01.7020495Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2025-03-14T05:51:01.7021326Z @llvm-project//mlir:TransformDialect; 19s local ... 2025-03-14T05:51:01.9564799Z 2025-03-14T05:51:01.9565910Z  2025-03-14T05:51:01.9566428Z  2025-03-14T05:51:01.9566808Z  2025-03-14T05:51:01.9567182Z  2025-03-14T05:51:01.9567569Z  2025-03-14T05:51:01.9567954Z  2025-03-14T05:51:01.9568355Z  2025-03-14T05:51:01.9568732Z  2025-03-14T05:51:01.9569310Z [14,672 / 15,235] 48 actions, 47 running 2025-03-14T05:51:01.9570099Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T05:51:01.9570997Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T05:51:01.9571883Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T05:51:01.9572716Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2025-03-14T05:51:01.9573488Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T05:51:01.9574522Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2025-03-14T05:51:01.9575325Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2025-03-14T05:51:01.9576097Z @llvm-project//mlir:TransformDialect; 19s local ... 2025-03-14T05:51:02.3015980Z 2025-03-14T05:51:02.3016868Z  2025-03-14T05:51:02.3017350Z  2025-03-14T05:51:02.3017720Z  2025-03-14T05:51:02.3018141Z  2025-03-14T05:51:02.3018510Z  2025-03-14T05:51:02.3018880Z  2025-03-14T05:51:02.3019244Z  2025-03-14T05:51:02.3019610Z  2025-03-14T05:51:02.3020142Z [14,672 / 15,235] 48 actions running 2025-03-14T05:51:02.3020977Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T05:51:02.3021911Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T05:51:02.3022782Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T05:51:02.3023619Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2025-03-14T05:51:02.3024442Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T05:51:02.3025239Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2025-03-14T05:51:02.3026041Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2025-03-14T05:51:02.3026878Z @llvm-project//mlir:TransformDialect; 20s local ... 2025-03-14T05:51:02.5985200Z 2025-03-14T05:51:02.5986363Z  2025-03-14T05:51:02.5986824Z  2025-03-14T05:51:02.5987198Z  2025-03-14T05:51:02.5987555Z  2025-03-14T05:51:02.5987936Z  2025-03-14T05:51:02.5988304Z  2025-03-14T05:51:02.5988655Z  2025-03-14T05:51:02.5989011Z  2025-03-14T05:51:02.5989536Z [14,674 / 15,235] 48 actions, 47 running 2025-03-14T05:51:02.5990278Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T05:51:02.5991240Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T05:51:02.5992046Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T05:51:02.5992771Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2025-03-14T05:51:02.5993431Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T05:51:02.5994089Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2025-03-14T05:51:02.5994782Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2025-03-14T05:51:02.5995538Z @llvm-project//mlir:TransformDialect; 20s local ... 2025-03-14T05:51:02.8115505Z 2025-03-14T05:51:02.8116354Z  2025-03-14T05:51:02.8116842Z  2025-03-14T05:51:02.8117243Z  2025-03-14T05:51:02.8117640Z  2025-03-14T05:51:02.8118006Z  2025-03-14T05:51:02.8118366Z  2025-03-14T05:51:02.8119058Z  2025-03-14T05:51:02.8119445Z  2025-03-14T05:51:02.8119996Z [14,676 / 15,235] 48 actions, 47 running 2025-03-14T05:51:02.8120883Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T05:51:02.8121751Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2025-03-14T05:51:02.8122564Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T05:51:02.8123334Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2025-03-14T05:51:02.8124065Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T05:51:02.8124978Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2025-03-14T05:51:02.8125751Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2025-03-14T05:51:02.8126541Z @llvm-project//mlir:TransformDialect; 20s local ... 2025-03-14T05:51:03.0352605Z 2025-03-14T05:51:03.0353428Z  2025-03-14T05:51:03.0353865Z  2025-03-14T05:51:03.0354231Z  2025-03-14T05:51:03.0354628Z  2025-03-14T05:51:03.0355001Z  2025-03-14T05:51:03.0355359Z  2025-03-14T05:51:03.0355703Z  2025-03-14T05:51:03.0356057Z  2025-03-14T05:51:03.0356601Z [14,680 / 15,235] 48 actions, 47 running 2025-03-14T05:51:03.0357695Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T05:51:03.0358569Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2025-03-14T05:51:03.0359407Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T05:51:03.0360224Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T05:51:03.0361007Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2025-03-14T05:51:03.0361764Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2025-03-14T05:51:03.0362474Z Compiling xla/python/ifrt/client.cc; 20s local 2025-03-14T05:51:03.0363098Z Compiling xla/pjrt/pjrt_api.cc; 20s local ... 2025-03-14T05:51:03.3022086Z 2025-03-14T05:51:03.3023008Z  2025-03-14T05:51:03.3023426Z  2025-03-14T05:51:03.3023812Z  2025-03-14T05:51:03.3024159Z  2025-03-14T05:51:03.3024527Z  2025-03-14T05:51:03.3024894Z  2025-03-14T05:51:03.3025253Z  2025-03-14T05:51:03.3025577Z  2025-03-14T05:51:03.3026067Z [14,680 / 15,235] 48 actions running 2025-03-14T05:51:03.3026828Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T05:51:03.3027740Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2025-03-14T05:51:03.3028649Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T05:51:03.3029801Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T05:51:03.3030556Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2025-03-14T05:51:03.3031356Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2025-03-14T05:51:03.3032143Z Compiling xla/python/ifrt/client.cc; 20s local 2025-03-14T05:51:03.3032798Z Compiling xla/pjrt/pjrt_api.cc; 20s local ... 2025-03-14T05:51:03.8151175Z 2025-03-14T05:51:03.8152024Z  2025-03-14T05:51:03.8152440Z  2025-03-14T05:51:03.8153019Z  2025-03-14T05:51:03.8153496Z  2025-03-14T05:51:03.8153853Z  2025-03-14T05:51:03.8154195Z  2025-03-14T05:51:03.8154535Z  2025-03-14T05:51:03.8154874Z  2025-03-14T05:51:03.8155380Z [14,681 / 15,235] 48 actions, 47 running 2025-03-14T05:51:03.8156111Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T05:51:03.8156927Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T05:51:03.8157727Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T05:51:03.8158493Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T05:51:03.8159167Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2025-03-14T05:51:03.8159885Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2025-03-14T05:51:03.8160745Z Compiling xla/python/ifrt/client.cc; 20s local 2025-03-14T05:51:03.8161330Z Compiling xla/pjrt/pjrt_api.cc; 20s local ... 2025-03-14T05:51:04.1029466Z 2025-03-14T05:51:04.1030338Z  2025-03-14T05:51:04.1030866Z  2025-03-14T05:51:04.1031276Z  2025-03-14T05:51:04.1031688Z  2025-03-14T05:51:04.1032087Z  2025-03-14T05:51:04.1032482Z  2025-03-14T05:51:04.1032876Z  2025-03-14T05:51:04.1033293Z  2025-03-14T05:51:04.1033853Z [14,682 / 15,235] 48 actions running 2025-03-14T05:51:04.1034701Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T05:51:04.1035666Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T05:51:04.1036561Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T05:51:04.1037461Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T05:51:04.1038256Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 25s local 2025-03-14T05:51:04.1039091Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2025-03-14T05:51:04.1039939Z Compiling xla/python/ifrt/client.cc; 21s local 2025-03-14T05:51:04.1040638Z Compiling xla/pjrt/pjrt_api.cc; 21s local ... 2025-03-14T05:51:04.5034278Z 2025-03-14T05:51:04.5035154Z  2025-03-14T05:51:04.5035609Z  2025-03-14T05:51:04.5036014Z  2025-03-14T05:51:04.5036413Z  2025-03-14T05:51:04.5036811Z  2025-03-14T05:51:04.5037201Z  2025-03-14T05:51:04.5037577Z  2025-03-14T05:51:04.5037948Z  2025-03-14T05:51:04.5038532Z [14,684 / 15,235] 48 actions running 2025-03-14T05:51:04.5039348Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T05:51:04.5040416Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T05:51:04.5041331Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T05:51:04.5042189Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T05:51:04.5043051Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 25s local 2025-03-14T05:51:04.5043903Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2025-03-14T05:51:04.5044909Z Compiling xla/python/ifrt/client.cc; 21s local 2025-03-14T05:51:04.5045605Z Compiling xla/pjrt/pjrt_api.cc; 21s local ... 2025-03-14T05:51:04.7892364Z 2025-03-14T05:51:04.7893280Z  2025-03-14T05:51:04.7893783Z  2025-03-14T05:51:04.7894214Z  2025-03-14T05:51:04.7894616Z  2025-03-14T05:51:04.7895166Z  2025-03-14T05:51:04.7895615Z  2025-03-14T05:51:04.7896016Z  2025-03-14T05:51:04.7896759Z  2025-03-14T05:51:04.7897415Z [14,685 / 15,235] 48 actions, 47 running 2025-03-14T05:51:04.7898355Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2025-03-14T05:51:04.7899328Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T05:51:04.7900308Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T05:51:04.7901309Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T05:51:04.7902420Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2025-03-14T05:51:04.7903314Z Compiling xla/python/ifrt/client.cc; 21s local 2025-03-14T05:51:04.7904077Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T05:51:04.7904937Z Compiling torch_xla/csrc/runtime/computation_client.cc; 15s local ... 2025-03-14T05:51:05.1039417Z 2025-03-14T05:51:05.1040262Z  2025-03-14T05:51:05.1040772Z  2025-03-14T05:51:05.1041168Z  2025-03-14T05:51:05.1041559Z  2025-03-14T05:51:05.1041990Z  2025-03-14T05:51:05.1042397Z  2025-03-14T05:51:05.1042794Z  2025-03-14T05:51:05.1043196Z  2025-03-14T05:51:05.1043769Z [14,685 / 15,235] 48 actions running 2025-03-14T05:51:05.1044759Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2025-03-14T05:51:05.1045748Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T05:51:05.1046924Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T05:51:05.1047777Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T05:51:05.1048688Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2025-03-14T05:51:05.1049456Z Compiling xla/python/ifrt/client.cc; 22s local 2025-03-14T05:51:05.1050098Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2025-03-14T05:51:05.1050899Z Compiling torch_xla/csrc/runtime/computation_client.cc; 16s local ... 2025-03-14T05:51:05.9685110Z 2025-03-14T05:51:05.9686014Z  2025-03-14T05:51:05.9686516Z  2025-03-14T05:51:05.9686879Z  2025-03-14T05:51:05.9687282Z  2025-03-14T05:51:05.9687665Z  2025-03-14T05:51:05.9688051Z  2025-03-14T05:51:05.9688437Z  2025-03-14T05:51:05.9688846Z  2025-03-14T05:51:05.9689460Z [14,686 / 15,235] 48 actions, 47 running 2025-03-14T05:51:05.9690320Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T05:51:05.9691244Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T05:51:05.9692174Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2025-03-14T05:51:05.9693355Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T05:51:05.9694223Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2025-03-14T05:51:05.9695028Z Compiling xla/pjrt/pjrt_api.cc; 23s local 2025-03-14T05:51:05.9695808Z Compiling torch_xla/csrc/runtime/computation_client.cc; 17s local 2025-03-14T05:51:05.9696708Z Compiling xla/python/ifrt/compiler.cc; 16s local ... 2025-03-14T05:51:06.3048807Z 2025-03-14T05:51:06.3049657Z  2025-03-14T05:51:06.3050115Z  2025-03-14T05:51:06.3050485Z  2025-03-14T05:51:06.3050845Z  2025-03-14T05:51:06.3051244Z  2025-03-14T05:51:06.3051638Z  2025-03-14T05:51:06.3052003Z  2025-03-14T05:51:06.3052408Z  2025-03-14T05:51:06.3052936Z [14,688 / 15,235] 48 actions running 2025-03-14T05:51:06.3053699Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T05:51:06.3054545Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T05:51:06.3055586Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T05:51:06.3056479Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T05:51:06.3057364Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2025-03-14T05:51:06.3058570Z Compiling torch_xla/csrc/runtime/computation_client.cc; 17s local 2025-03-14T05:51:06.3059445Z Compiling xla/python/ifrt/compiler.cc; 17s local 2025-03-14T05:51:06.3060254Z Compiling xla/service/allocation_tracker.cc; 16s local ... 2025-03-14T05:51:06.7053129Z 2025-03-14T05:51:06.7054029Z  2025-03-14T05:51:06.7054529Z  2025-03-14T05:51:06.7054946Z  2025-03-14T05:51:06.7055362Z  2025-03-14T05:51:06.7055805Z  2025-03-14T05:51:06.7056188Z  2025-03-14T05:51:06.7056568Z  2025-03-14T05:51:06.7056953Z  2025-03-14T05:51:06.7057851Z [14,689 / 15,235] 48 actions running 2025-03-14T05:51:06.7058743Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T05:51:06.7059708Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T05:51:06.7060661Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T05:51:06.7061587Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2025-03-14T05:51:06.7062498Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2025-03-14T05:51:06.7063455Z Compiling torch_xla/csrc/runtime/computation_client.cc; 17s local 2025-03-14T05:51:06.7064336Z Compiling xla/python/ifrt/compiler.cc; 17s local 2025-03-14T05:51:06.7065114Z Compiling xla/service/allocation_tracker.cc; 16s local ... 2025-03-14T05:51:07.5110924Z 2025-03-14T05:51:07.5112085Z  2025-03-14T05:51:07.5112573Z  2025-03-14T05:51:07.5112977Z  2025-03-14T05:51:07.5113388Z  2025-03-14T05:51:07.5113819Z  2025-03-14T05:51:07.5114254Z  2025-03-14T05:51:07.5114678Z  2025-03-14T05:51:07.5115088Z  2025-03-14T05:51:07.5115693Z [14,690 / 15,235] 48 actions, 47 running 2025-03-14T05:51:07.5116560Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T05:51:07.5117507Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2025-03-14T05:51:07.5118430Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T05:51:07.5119391Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T05:51:07.5120306Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T05:51:07.5121292Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2025-03-14T05:51:07.5122185Z Compiling xla/python/ifrt/compiler.cc; 18s local 2025-03-14T05:51:07.5123040Z Compiling xla/service/allocation_tracker.cc; 17s local ... 2025-03-14T05:51:07.8676156Z 2025-03-14T05:51:07.8676972Z  2025-03-14T05:51:07.8677494Z  2025-03-14T05:51:07.8677901Z  2025-03-14T05:51:07.8678585Z  2025-03-14T05:51:07.8679031Z  2025-03-14T05:51:07.8679418Z  2025-03-14T05:51:07.8679804Z  2025-03-14T05:51:07.8680197Z  2025-03-14T05:51:07.8680778Z [14,691 / 15,235] 48 actions, 47 running 2025-03-14T05:51:07.8681622Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T05:51:07.8682612Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T05:51:07.8683555Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T05:51:07.8693888Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T05:51:07.8695010Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T05:51:07.8695927Z Compiling torch_xla/csrc/runtime/computation_client.cc; 18s local 2025-03-14T05:51:07.8696825Z Compiling xla/python/ifrt/compiler.cc; 18s local 2025-03-14T05:51:07.8697660Z Compiling xla/service/allocation_tracker.cc; 17s local ... 2025-03-14T05:51:08.0910990Z 2025-03-14T05:51:08.0911850Z  2025-03-14T05:51:08.0912326Z  2025-03-14T05:51:08.0912716Z  2025-03-14T05:51:08.0913084Z  2025-03-14T05:51:08.0913447Z  2025-03-14T05:51:08.0913844Z  2025-03-14T05:51:08.0914237Z  2025-03-14T05:51:08.0914625Z  2025-03-14T05:51:08.0915212Z [14,693 / 15,235] 48 actions, 47 running 2025-03-14T05:51:08.0916385Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T05:51:08.0917358Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T05:51:08.0918323Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T05:51:08.0919266Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T05:51:08.0920178Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T05:51:08.0921293Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2025-03-14T05:51:08.0922207Z Compiling xla/python/ifrt/compiler.cc; 18s local 2025-03-14T05:51:08.0923019Z Compiling torch_xla/csrc/unwrap_data.cpp; 17s local ... 2025-03-14T05:51:08.3064927Z 2025-03-14T05:51:08.3066067Z  2025-03-14T05:51:08.3066563Z  2025-03-14T05:51:08.3066931Z  2025-03-14T05:51:08.3067306Z  2025-03-14T05:51:08.3067677Z  2025-03-14T05:51:08.3068063Z  2025-03-14T05:51:08.3068441Z  2025-03-14T05:51:08.3068872Z  2025-03-14T05:51:08.3069484Z [14,693 / 15,235] 48 actions running 2025-03-14T05:51:08.3070347Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T05:51:08.3071340Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T05:51:08.3072289Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2025-03-14T05:51:08.3073486Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T05:51:08.3074405Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T05:51:08.3075399Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2025-03-14T05:51:08.3076291Z Compiling xla/python/ifrt/compiler.cc; 19s local 2025-03-14T05:51:08.3077072Z Compiling torch_xla/csrc/unwrap_data.cpp; 17s local ... 2025-03-14T05:51:08.6673545Z 2025-03-14T05:51:08.6674377Z  2025-03-14T05:51:08.6674874Z  2025-03-14T05:51:08.6675289Z  2025-03-14T05:51:08.6675673Z  2025-03-14T05:51:08.6676111Z  2025-03-14T05:51:08.6676541Z  2025-03-14T05:51:08.6676962Z  2025-03-14T05:51:08.6677413Z  2025-03-14T05:51:08.6678042Z [14,696 / 15,235] 48 actions, 47 running 2025-03-14T05:51:08.6678912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T05:51:08.6679957Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2025-03-14T05:51:08.6680971Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T05:51:08.6681956Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2025-03-14T05:51:08.6683196Z Compiling torch_xla/csrc/runtime/computation_client.cc; 19s local 2025-03-14T05:51:08.6684142Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2025-03-14T05:51:08.6685162Z Compiling xla/python/ifrt/remap_plan.cc; 13s local 2025-03-14T05:51:08.6685909Z Compiling xla/service/service.cc; 13s local ... 2025-03-14T05:51:08.9070229Z 2025-03-14T05:51:08.9071102Z  2025-03-14T05:51:08.9071594Z  2025-03-14T05:51:08.9071979Z  2025-03-14T05:51:08.9072340Z  2025-03-14T05:51:08.9072826Z  2025-03-14T05:51:08.9073210Z  2025-03-14T05:51:08.9073602Z  2025-03-14T05:51:08.9073987Z  2025-03-14T05:51:08.9074536Z [14,696 / 15,235] 48 actions running 2025-03-14T05:51:08.9075420Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T05:51:08.9076383Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2025-03-14T05:51:08.9077251Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T05:51:08.9078175Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2025-03-14T05:51:08.9079108Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2025-03-14T05:51:08.9079901Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2025-03-14T05:51:08.9080658Z Compiling xla/python/ifrt/remap_plan.cc; 13s local 2025-03-14T05:51:08.9081700Z Compiling xla/service/service.cc; 13s local ... 2025-03-14T05:51:09.2797354Z 2025-03-14T05:51:09.2798259Z  2025-03-14T05:51:09.2798762Z  2025-03-14T05:51:09.2799196Z  2025-03-14T05:51:09.2799628Z  2025-03-14T05:51:09.2800056Z  2025-03-14T05:51:09.2800474Z  2025-03-14T05:51:09.2800895Z  2025-03-14T05:51:09.2801313Z  2025-03-14T05:51:09.2801971Z [14,697 / 15,235] 48 actions, 47 running 2025-03-14T05:51:09.2803128Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T05:51:09.2804202Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T05:51:09.2805377Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T05:51:09.2806317Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2025-03-14T05:51:09.2807333Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2025-03-14T05:51:09.2808237Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2025-03-14T05:51:09.2808975Z Compiling xla/python/ifrt/remap_plan.cc; 14s local 2025-03-14T05:51:09.2809694Z Compiling xla/service/service.cc; 14s local ... 2025-03-14T05:51:09.5075363Z 2025-03-14T05:51:09.5076222Z  2025-03-14T05:51:09.5076706Z  2025-03-14T05:51:09.5077117Z  2025-03-14T05:51:09.5077532Z  2025-03-14T05:51:09.5078280Z  2025-03-14T05:51:09.5078658Z  2025-03-14T05:51:09.5079025Z  2025-03-14T05:51:09.5079418Z  2025-03-14T05:51:09.5080011Z [14,698 / 15,235] 48 actions running 2025-03-14T05:51:09.5080890Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T05:51:09.5081923Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T05:51:09.5082834Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T05:51:09.5083777Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2025-03-14T05:51:09.5084864Z Compiling torch_xla/csrc/unwrap_data.cpp; 18s local 2025-03-14T05:51:09.5085618Z Compiling xla/python/ifrt/remap_plan.cc; 14s local 2025-03-14T05:51:09.5086311Z Compiling xla/service/service.cc; 14s local 2025-03-14T05:51:09.5087087Z Compiling xla/python/ifrt/executable.cc; 14s local ... 2025-03-14T05:51:09.7223804Z 2025-03-14T05:51:09.7224604Z  2025-03-14T05:51:09.7225055Z  2025-03-14T05:51:09.7225463Z  2025-03-14T05:51:09.7225852Z  2025-03-14T05:51:09.7226305Z  2025-03-14T05:51:09.7226670Z  2025-03-14T05:51:09.7227127Z  2025-03-14T05:51:09.7227539Z  2025-03-14T05:51:09.7228341Z [14,699 / 15,235] 48 actions, 47 running 2025-03-14T05:51:09.7229123Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2025-03-14T05:51:09.7230053Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T05:51:09.7230903Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T05:51:09.7231784Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local 2025-03-14T05:51:09.7232633Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2025-03-14T05:51:09.7233369Z Compiling xla/python/ifrt/remap_plan.cc; 14s local 2025-03-14T05:51:09.7234043Z Compiling xla/service/service.cc; 14s local 2025-03-14T05:51:09.7234731Z Compiling xla/python/ifrt/executable.cc; 14s local ... 2025-03-14T05:51:10.1082249Z 2025-03-14T05:51:10.1083070Z  2025-03-14T05:51:10.1083547Z  2025-03-14T05:51:10.1083926Z  2025-03-14T05:51:10.1084369Z  2025-03-14T05:51:10.1084954Z  2025-03-14T05:51:10.1085387Z  2025-03-14T05:51:10.1085812Z  2025-03-14T05:51:10.1086249Z  2025-03-14T05:51:10.1086854Z [14,699 / 15,235] 48 actions running 2025-03-14T05:51:10.1087727Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2025-03-14T05:51:10.1088687Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T05:51:10.1089899Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T05:51:10.1090773Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2025-03-14T05:51:10.1091591Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2025-03-14T05:51:10.1092327Z Compiling xla/python/ifrt/remap_plan.cc; 15s local 2025-03-14T05:51:10.1093036Z Compiling xla/service/service.cc; 15s local 2025-03-14T05:51:10.1093798Z Compiling xla/python/ifrt/executable.cc; 14s local ... 2025-03-14T05:51:10.3085037Z 2025-03-14T05:51:10.3086144Z  2025-03-14T05:51:10.3086677Z  2025-03-14T05:51:10.3087135Z  2025-03-14T05:51:10.3087554Z  2025-03-14T05:51:10.3087956Z  2025-03-14T05:51:10.3088386Z  2025-03-14T05:51:10.3088803Z  2025-03-14T05:51:10.3089184Z  2025-03-14T05:51:10.3089735Z [14,701 / 15,235] 48 actions running 2025-03-14T05:51:10.3090563Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2025-03-14T05:51:10.3091609Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2025-03-14T05:51:10.3092574Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T05:51:10.3093480Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local 2025-03-14T05:51:10.3094383Z Compiling torch_xla/csrc/unwrap_data.cpp; 19s local 2025-03-14T05:51:10.3095205Z Compiling xla/python/ifrt/remap_plan.cc; 15s local 2025-03-14T05:51:10.3096167Z Compiling xla/service/service.cc; 15s local 2025-03-14T05:51:10.3096967Z Compiling xla/python/ifrt/executable.cc; 14s local ... 2025-03-14T05:51:11.0443726Z 2025-03-14T05:51:11.0444753Z  2025-03-14T05:51:11.0445264Z  2025-03-14T05:51:11.0445688Z  2025-03-14T05:51:11.0446083Z  2025-03-14T05:51:11.0446477Z  2025-03-14T05:51:11.0446881Z  2025-03-14T05:51:11.0447302Z  2025-03-14T05:51:11.0447741Z  2025-03-14T05:51:11.0448361Z [14,702 / 15,235] 48 actions, 47 running 2025-03-14T05:51:11.0449264Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T05:51:11.0450328Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2025-03-14T05:51:11.0451227Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2025-03-14T05:51:11.0452181Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2025-03-14T05:51:11.0453202Z Compiling torch_xla/csrc/unwrap_data.cpp; 20s local 2025-03-14T05:51:11.0453970Z Compiling xla/python/ifrt/remap_plan.cc; 16s local 2025-03-14T05:51:11.0454707Z Compiling xla/service/service.cc; 15s local 2025-03-14T05:51:11.0456035Z Compiling xla/python/ifrt/executable.cc; 15s local ... 2025-03-14T05:51:11.2649020Z 2025-03-14T05:51:11.2649888Z  2025-03-14T05:51:11.2650401Z  2025-03-14T05:51:11.2650835Z  2025-03-14T05:51:11.2651255Z  2025-03-14T05:51:11.2651673Z  2025-03-14T05:51:11.2652108Z  2025-03-14T05:51:11.2652548Z  2025-03-14T05:51:11.2652981Z  2025-03-14T05:51:11.2653649Z [14,704 / 15,235] 48 actions, 47 running 2025-03-14T05:51:11.2654526Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T05:51:11.2655557Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T05:51:11.2656481Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2025-03-14T05:51:11.2657452Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2025-03-14T05:51:11.2658383Z Compiling torch_xla/csrc/unwrap_data.cpp; 20s local 2025-03-14T05:51:11.2659163Z Compiling xla/python/ifrt/remap_plan.cc; 16s local 2025-03-14T05:51:11.2659939Z Compiling xla/service/service.cc; 16s local 2025-03-14T05:51:11.2660735Z Compiling xla/python/ifrt/executable.cc; 15s local ... 2025-03-14T05:51:11.5092378Z 2025-03-14T05:51:11.5093289Z  2025-03-14T05:51:11.5093776Z  2025-03-14T05:51:11.5094190Z  2025-03-14T05:51:11.5094597Z  2025-03-14T05:51:11.5094996Z  2025-03-14T05:51:11.5095741Z  2025-03-14T05:51:11.5096210Z  2025-03-14T05:51:11.5096677Z  2025-03-14T05:51:11.5097293Z [14,705 / 15,235] 48 actions running 2025-03-14T05:51:11.5098184Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T05:51:11.5099233Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T05:51:11.5100139Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2025-03-14T05:51:11.5101253Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2025-03-14T05:51:11.5102163Z Compiling torch_xla/csrc/unwrap_data.cpp; 20s local 2025-03-14T05:51:11.5102937Z Compiling xla/python/ifrt/remap_plan.cc; 16s local 2025-03-14T05:51:11.5103664Z Compiling xla/service/service.cc; 16s local 2025-03-14T05:51:11.5104419Z Compiling xla/python/ifrt/executable.cc; 16s local ... 2025-03-14T05:51:11.7098786Z 2025-03-14T05:51:11.7099647Z  2025-03-14T05:51:11.7100151Z  2025-03-14T05:51:11.7100564Z  2025-03-14T05:51:11.7101020Z  2025-03-14T05:51:11.7101443Z  2025-03-14T05:51:11.7101862Z  2025-03-14T05:51:11.7102274Z  2025-03-14T05:51:11.7102652Z  2025-03-14T05:51:11.7103234Z [14,706 / 15,235] 48 actions running 2025-03-14T05:51:11.7104012Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T05:51:11.7105377Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T05:51:11.7106340Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2025-03-14T05:51:11.7107228Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2025-03-14T05:51:11.7108043Z Compiling torch_xla/csrc/unwrap_data.cpp; 21s local 2025-03-14T05:51:11.7108830Z Compiling xla/service/service.cc; 16s local 2025-03-14T05:51:11.7109637Z Compiling xla/python/ifrt/executable.cc; 16s local 2025-03-14T05:51:11.7110544Z Compiling xla/service/local_service_utils.cc; 16s local ... 2025-03-14T05:51:12.1101121Z 2025-03-14T05:51:12.1101991Z  2025-03-14T05:51:12.1102497Z  2025-03-14T05:51:12.1102913Z  2025-03-14T05:51:12.1103328Z  2025-03-14T05:51:12.1103713Z  2025-03-14T05:51:12.1104106Z  2025-03-14T05:51:12.1104518Z  2025-03-14T05:51:12.1104931Z  2025-03-14T05:51:12.1105479Z [14,707 / 15,235] 48 actions running 2025-03-14T05:51:12.1106334Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T05:51:12.1107329Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T05:51:12.1108578Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2025-03-14T05:51:12.1109521Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2025-03-14T05:51:12.1110373Z Compiling torch_xla/csrc/unwrap_data.cpp; 21s local 2025-03-14T05:51:12.1111057Z Compiling xla/service/service.cc; 17s local 2025-03-14T05:51:12.1111760Z Compiling xla/python/ifrt/executable.cc; 16s local 2025-03-14T05:51:12.1112543Z Compiling torch_xla/csrc/lowering_context.cpp; 16s local ... 2025-03-14T05:51:13.1109165Z 2025-03-14T05:51:13.1110027Z  2025-03-14T05:51:13.1110539Z  2025-03-14T05:51:13.1110971Z  2025-03-14T05:51:13.1111404Z  2025-03-14T05:51:13.1111845Z  2025-03-14T05:51:13.1112288Z  2025-03-14T05:51:13.1112711Z  2025-03-14T05:51:13.1113178Z  2025-03-14T05:51:13.1113747Z [14,707 / 15,235] 48 actions running 2025-03-14T05:51:13.1114619Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T05:51:13.1115547Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2025-03-14T05:51:13.1116425Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2025-03-14T05:51:13.1117272Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2025-03-14T05:51:13.1118065Z Compiling torch_xla/csrc/unwrap_data.cpp; 22s local 2025-03-14T05:51:13.1118998Z Compiling xla/service/service.cc; 18s local 2025-03-14T05:51:13.1119675Z Compiling xla/python/ifrt/executable.cc; 17s local 2025-03-14T05:51:13.1120429Z Compiling torch_xla/csrc/lowering_context.cpp; 17s local ... 2025-03-14T05:51:13.3652535Z 2025-03-14T05:51:13.3653399Z  2025-03-14T05:51:13.3653866Z  2025-03-14T05:51:13.3654269Z  2025-03-14T05:51:13.3654680Z  2025-03-14T05:51:13.3655128Z  2025-03-14T05:51:13.3655530Z  2025-03-14T05:51:13.3655919Z  2025-03-14T05:51:13.3656381Z  2025-03-14T05:51:13.3657316Z [14,708 / 15,235] 48 actions, 47 running 2025-03-14T05:51:13.3658176Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T05:51:13.3659164Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T05:51:13.3660088Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T05:51:13.3661009Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2025-03-14T05:51:13.3661889Z Compiling torch_xla/csrc/unwrap_data.cpp; 22s local 2025-03-14T05:51:13.3662583Z Compiling xla/service/service.cc; 18s local 2025-03-14T05:51:13.3663326Z Compiling xla/python/ifrt/executable.cc; 17s local 2025-03-14T05:51:13.3664241Z Compiling torch_xla/csrc/lowering_context.cpp; 17s local ... 2025-03-14T05:51:13.6804399Z 2025-03-14T05:51:13.6805552Z  2025-03-14T05:51:13.6806333Z  2025-03-14T05:51:13.6806748Z  2025-03-14T05:51:13.6807143Z  2025-03-14T05:51:13.6807539Z  2025-03-14T05:51:13.6807942Z  2025-03-14T05:51:13.6808350Z  2025-03-14T05:51:13.6808761Z  2025-03-14T05:51:13.6809339Z [14,709 / 15,235] 48 actions, 47 running 2025-03-14T05:51:13.6810086Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T05:51:13.6811031Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T05:51:13.6811855Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T05:51:13.6812693Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2025-03-14T05:51:13.6813569Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2025-03-14T05:51:13.6814259Z Compiling xla/service/service.cc; 18s local 2025-03-14T05:51:13.6814929Z Compiling xla/python/ifrt/executable.cc; 18s local 2025-03-14T05:51:13.6815778Z Compiling torch_xla/csrc/lowering_context.cpp; 18s local ... 2025-03-14T05:51:13.9115561Z 2025-03-14T05:51:13.9116385Z  2025-03-14T05:51:13.9116870Z  2025-03-14T05:51:13.9117330Z  2025-03-14T05:51:13.9117751Z  2025-03-14T05:51:13.9118443Z  2025-03-14T05:51:13.9118852Z  2025-03-14T05:51:13.9119230Z  2025-03-14T05:51:13.9119694Z  2025-03-14T05:51:13.9120311Z [14,709 / 15,235] 48 actions running 2025-03-14T05:51:13.9121200Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T05:51:13.9122120Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T05:51:13.9123107Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T05:51:13.9124018Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2025-03-14T05:51:13.9125050Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2025-03-14T05:51:13.9125744Z Compiling xla/service/service.cc; 18s local 2025-03-14T05:51:13.9126495Z Compiling xla/python/ifrt/executable.cc; 18s local 2025-03-14T05:51:13.9127308Z Compiling torch_xla/csrc/lowering_context.cpp; 18s local ... 2025-03-14T05:51:14.1952189Z 2025-03-14T05:51:14.1953054Z  2025-03-14T05:51:14.1953545Z  2025-03-14T05:51:14.1953920Z  2025-03-14T05:51:14.1954392Z  2025-03-14T05:51:14.1954887Z  2025-03-14T05:51:14.1955406Z  2025-03-14T05:51:14.1955839Z  2025-03-14T05:51:14.1956238Z  2025-03-14T05:51:14.1956757Z [14,710 / 15,235] 48 actions, 47 running 2025-03-14T05:51:14.1957521Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T05:51:14.1958764Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2025-03-14T05:51:14.1959635Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T05:51:14.1960494Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2025-03-14T05:51:14.1961361Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2025-03-14T05:51:14.1962123Z Compiling xla/service/service.cc; 19s local 2025-03-14T05:51:14.1963001Z Compiling xla/python/ifrt/executable.cc; 18s local 2025-03-14T05:51:14.1963879Z Compiling torch_xla/csrc/lowering_context.cpp; 18s local ... 2025-03-14T05:51:14.4340142Z 2025-03-14T05:51:14.4341046Z  2025-03-14T05:51:14.4341552Z  2025-03-14T05:51:14.4341983Z  2025-03-14T05:51:14.4342363Z  2025-03-14T05:51:14.4342726Z  2025-03-14T05:51:14.4343122Z  2025-03-14T05:51:14.4343501Z  2025-03-14T05:51:14.4343997Z  2025-03-14T05:51:14.4344735Z [14,711 / 15,235] 48 actions, 47 running 2025-03-14T05:51:14.4345751Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T05:51:14.4346642Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2025-03-14T05:51:14.4347524Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T05:51:14.4348442Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2025-03-14T05:51:14.4349667Z Compiling torch_xla/csrc/unwrap_data.cpp; 23s local 2025-03-14T05:51:14.4350446Z Compiling xla/service/service.cc; 19s local 2025-03-14T05:51:14.4351179Z Compiling xla/python/ifrt/executable.cc; 19s local 2025-03-14T05:51:14.4352054Z Compiling torch_xla/csrc/lowering_context.cpp; 18s local ... 2025-03-14T05:51:14.7121937Z 2025-03-14T05:51:14.7122840Z  2025-03-14T05:51:14.7123346Z  2025-03-14T05:51:14.7123773Z  2025-03-14T05:51:14.7124192Z  2025-03-14T05:51:14.7124726Z  2025-03-14T05:51:14.7125118Z  2025-03-14T05:51:14.7125570Z  2025-03-14T05:51:14.7125959Z  2025-03-14T05:51:14.7126457Z [14,713 / 15,235] 48 actions running 2025-03-14T05:51:14.7127301Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T05:51:14.7128258Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2025-03-14T05:51:14.7129032Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T05:51:14.7129919Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2025-03-14T05:51:14.7130724Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2025-03-14T05:51:14.7131774Z Compiling xla/service/service.cc; 19s local 2025-03-14T05:51:14.7132455Z Compiling xla/python/ifrt/executable.cc; 19s local 2025-03-14T05:51:14.7133305Z Compiling torch_xla/csrc/lowering_context.cpp; 19s local ... 2025-03-14T05:51:15.2009042Z 2025-03-14T05:51:15.2009896Z  2025-03-14T05:51:15.2010389Z  2025-03-14T05:51:15.2010799Z  2025-03-14T05:51:15.2011171Z  2025-03-14T05:51:15.2011595Z  2025-03-14T05:51:15.2012041Z  2025-03-14T05:51:15.2012526Z  2025-03-14T05:51:15.2013017Z  2025-03-14T05:51:15.2013673Z [14,714 / 15,235] 48 actions, 47 running 2025-03-14T05:51:15.2014422Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T05:51:15.2015333Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T05:51:15.2016211Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T05:51:15.2017070Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2025-03-14T05:51:15.2017951Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2025-03-14T05:51:15.2018662Z Compiling xla/service/service.cc; 20s local 2025-03-14T05:51:15.2019435Z Compiling torch_xla/csrc/lowering_context.cpp; 19s local 2025-03-14T05:51:15.2020319Z Compiling xla/client/local_client.cc; 17s local ... 2025-03-14T05:51:15.4835027Z 2025-03-14T05:51:15.4835923Z  2025-03-14T05:51:15.4836723Z  2025-03-14T05:51:15.4837161Z  2025-03-14T05:51:15.4837592Z  2025-03-14T05:51:15.4838000Z  2025-03-14T05:51:15.4838428Z  2025-03-14T05:51:15.4838832Z  2025-03-14T05:51:15.4839263Z  2025-03-14T05:51:15.4839911Z [14,715 / 15,235] 48 actions, 47 running 2025-03-14T05:51:15.4840830Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T05:51:15.4842260Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T05:51:15.4843233Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T05:51:15.4844221Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2025-03-14T05:51:15.4845266Z Compiling torch_xla/csrc/unwrap_data.cpp; 24s local 2025-03-14T05:51:15.4846013Z Compiling xla/service/service.cc; 20s local 2025-03-14T05:51:15.4846827Z Compiling torch_xla/csrc/lowering_context.cpp; 19s local 2025-03-14T05:51:15.4847615Z Compiling xla/client/local_client.cc; 17s local ... 2025-03-14T05:51:15.7121000Z 2025-03-14T05:51:15.7122007Z  2025-03-14T05:51:15.7122540Z  2025-03-14T05:51:15.7123001Z  2025-03-14T05:51:15.7123437Z  2025-03-14T05:51:15.7123858Z  2025-03-14T05:51:15.7124294Z  2025-03-14T05:51:15.7124817Z  2025-03-14T05:51:15.7125242Z  2025-03-14T05:51:15.7126156Z [14,718 / 15,235] 48 actions, 47 running 2025-03-14T05:51:15.7127128Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T05:51:15.7128219Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T05:51:15.7129180Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T05:51:15.7130168Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2025-03-14T05:51:15.7131120Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local 2025-03-14T05:51:15.7131869Z Compiling xla/service/service.cc; 20s local 2025-03-14T05:51:15.7132668Z Compiling torch_xla/csrc/lowering_context.cpp; 20s local 2025-03-14T05:51:15.7133450Z Compiling xla/client/local_client.cc; 17s local ... 2025-03-14T05:51:15.9130827Z 2025-03-14T05:51:15.9131658Z  2025-03-14T05:51:15.9132180Z  2025-03-14T05:51:15.9132604Z  2025-03-14T05:51:15.9133024Z  2025-03-14T05:51:15.9133417Z  2025-03-14T05:51:15.9133880Z  2025-03-14T05:51:15.9134301Z  2025-03-14T05:51:15.9134697Z  2025-03-14T05:51:15.9135322Z [14,718 / 15,235] 48 actions running 2025-03-14T05:51:15.9136516Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T05:51:15.9137664Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T05:51:15.9138645Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T05:51:15.9139652Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2025-03-14T05:51:15.9140607Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local 2025-03-14T05:51:15.9141365Z Compiling xla/service/service.cc; 20s local 2025-03-14T05:51:15.9142152Z Compiling torch_xla/csrc/lowering_context.cpp; 20s local 2025-03-14T05:51:15.9143011Z Compiling xla/client/local_client.cc; 17s local ... 2025-03-14T05:51:16.5148886Z 2025-03-14T05:51:16.5149803Z  2025-03-14T05:51:16.5150283Z  2025-03-14T05:51:16.5150734Z  2025-03-14T05:51:16.5151130Z  2025-03-14T05:51:16.5151546Z  2025-03-14T05:51:16.5151907Z  2025-03-14T05:51:16.5152335Z  2025-03-14T05:51:16.5152750Z  2025-03-14T05:51:16.5153370Z [14,719 / 15,235] 48 actions, 47 running 2025-03-14T05:51:16.5154228Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T05:51:16.5155245Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T05:51:16.5156207Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2025-03-14T05:51:16.5157437Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2025-03-14T05:51:16.5158299Z Compiling torch_xla/csrc/unwrap_data.cpp; 25s local 2025-03-14T05:51:16.5158973Z Compiling xla/service/service.cc; 21s local 2025-03-14T05:51:16.5159744Z Compiling torch_xla/csrc/lowering_context.cpp; 20s local 2025-03-14T05:51:16.5160558Z Compiling xla/client/local_client.cc; 18s local ... 2025-03-14T05:51:16.9138581Z 2025-03-14T05:51:16.9139426Z  2025-03-14T05:51:16.9139867Z  2025-03-14T05:51:16.9140217Z  2025-03-14T05:51:16.9140811Z  2025-03-14T05:51:16.9141190Z  2025-03-14T05:51:16.9141575Z  2025-03-14T05:51:16.9141956Z  2025-03-14T05:51:16.9142369Z  2025-03-14T05:51:16.9142931Z [14,719 / 15,235] 48 actions running 2025-03-14T05:51:16.9143792Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T05:51:16.9144832Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T05:51:16.9145814Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2025-03-14T05:51:16.9146761Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2025-03-14T05:51:16.9147664Z Compiling torch_xla/csrc/unwrap_data.cpp; 26s local 2025-03-14T05:51:16.9148405Z Compiling xla/service/service.cc; 21s local 2025-03-14T05:51:16.9149167Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2025-03-14T05:51:16.9150176Z Compiling xla/client/local_client.cc; 18s local ... 2025-03-14T05:51:17.1576418Z 2025-03-14T05:51:17.1577362Z  2025-03-14T05:51:17.1577879Z  2025-03-14T05:51:17.1578302Z  2025-03-14T05:51:17.1578669Z  2025-03-14T05:51:17.1579069Z  2025-03-14T05:51:17.1579462Z  2025-03-14T05:51:17.1579882Z  2025-03-14T05:51:17.1580304Z  2025-03-14T05:51:17.1580845Z [14,722 / 15,235] 48 actions, 46 running 2025-03-14T05:51:17.1581601Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T05:51:17.1582569Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T05:51:17.1583452Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2025-03-14T05:51:17.1584278Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2025-03-14T05:51:17.1585075Z Compiling torch_xla/csrc/unwrap_data.cpp; 26s local 2025-03-14T05:51:17.1585733Z Compiling xla/service/service.cc; 22s local 2025-03-14T05:51:17.1586501Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2025-03-14T05:51:17.1587280Z Compiling xla/client/local_client.cc; 19s local ... 2025-03-14T05:51:17.4770033Z 2025-03-14T05:51:17.4771073Z  2025-03-14T05:51:17.4771636Z  2025-03-14T05:51:17.4772068Z  2025-03-14T05:51:17.4772502Z  2025-03-14T05:51:17.4772933Z  2025-03-14T05:51:17.4773335Z  2025-03-14T05:51:17.4773763Z  2025-03-14T05:51:17.4774174Z  2025-03-14T05:51:17.4774808Z [14,723 / 15,235] 48 actions, 47 running 2025-03-14T05:51:17.4775772Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T05:51:17.4776880Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T05:51:17.4777840Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T05:51:17.4778788Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2025-03-14T05:51:17.4779713Z Compiling torch_xla/csrc/unwrap_data.cpp; 26s local 2025-03-14T05:51:17.4780425Z Compiling xla/service/service.cc; 22s local 2025-03-14T05:51:17.4781225Z Compiling torch_xla/csrc/lowering_context.cpp; 21s local 2025-03-14T05:51:17.4782068Z Compiling xla/client/local_client.cc; 19s local ... 2025-03-14T05:51:17.7145147Z 2025-03-14T05:51:17.7146018Z  2025-03-14T05:51:17.7146522Z  2025-03-14T05:51:17.7146972Z  2025-03-14T05:51:17.7147400Z  2025-03-14T05:51:17.7147847Z  2025-03-14T05:51:17.7148286Z  2025-03-14T05:51:17.7148722Z  2025-03-14T05:51:17.7149152Z  2025-03-14T05:51:17.7150084Z [14,723 / 15,235] 48 actions running 2025-03-14T05:51:17.7151052Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T05:51:17.7152156Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T05:51:17.7153100Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T05:51:17.7154147Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2025-03-14T05:51:17.7155151Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2025-03-14T05:51:17.7155935Z Compiling xla/service/service.cc; 22s local 2025-03-14T05:51:17.7156796Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2025-03-14T05:51:17.7157685Z Compiling xla/client/local_client.cc; 19s local ... 2025-03-14T05:51:17.9212756Z 2025-03-14T05:51:17.9213652Z  2025-03-14T05:51:17.9214159Z  2025-03-14T05:51:17.9214607Z  2025-03-14T05:51:17.9215019Z  2025-03-14T05:51:17.9215411Z  2025-03-14T05:51:17.9215837Z  2025-03-14T05:51:17.9216243Z  2025-03-14T05:51:17.9216760Z  2025-03-14T05:51:17.9217343Z [14,727 / 15,235] 48 actions, 47 running 2025-03-14T05:51:17.9218201Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T05:51:17.9219193Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T05:51:17.9220418Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T05:51:17.9221352Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T05:51:17.9222233Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2025-03-14T05:51:17.9222925Z Compiling xla/service/service.cc; 22s local 2025-03-14T05:51:17.9223676Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2025-03-14T05:51:17.9224477Z Compiling xla/client/local_client.cc; 19s local ... 2025-03-14T05:51:18.1872374Z 2025-03-14T05:51:18.1873190Z  2025-03-14T05:51:18.1873716Z  2025-03-14T05:51:18.1874190Z  2025-03-14T05:51:18.1874598Z  2025-03-14T05:51:18.1875005Z  2025-03-14T05:51:18.1875426Z  2025-03-14T05:51:18.1875855Z  2025-03-14T05:51:18.1876267Z  2025-03-14T05:51:18.1876870Z [14,728 / 15,235] 48 actions, 47 running 2025-03-14T05:51:18.1877795Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T05:51:18.1878772Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T05:51:18.1879745Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T05:51:18.1881011Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T05:51:18.1881998Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local 2025-03-14T05:51:18.1882722Z Compiling xla/service/service.cc; 23s local 2025-03-14T05:51:18.1883477Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2025-03-14T05:51:18.1884378Z Compiling xla/client/local_client.cc; 20s local ... 2025-03-14T05:51:18.5151856Z 2025-03-14T05:51:18.5152723Z  2025-03-14T05:51:18.5153243Z  2025-03-14T05:51:18.5153670Z  2025-03-14T05:51:18.5154126Z  2025-03-14T05:51:18.5154523Z  2025-03-14T05:51:18.5154931Z  2025-03-14T05:51:18.5155334Z  2025-03-14T05:51:18.5155769Z  2025-03-14T05:51:18.5156370Z [14,730 / 15,235] 48 actions running 2025-03-14T05:51:18.5157240Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T05:51:18.5158312Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T05:51:18.5159277Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T05:51:18.5160226Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T05:51:18.5161174Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T05:51:18.5161937Z Compiling xla/service/service.cc; 23s local 2025-03-14T05:51:18.5163061Z Compiling torch_xla/csrc/lowering_context.cpp; 22s local 2025-03-14T05:51:18.5164049Z Compiling xla/client/local_client.cc; 20s local ... 2025-03-14T05:51:18.7155213Z 2025-03-14T05:51:18.7156099Z  2025-03-14T05:51:18.7156612Z  2025-03-14T05:51:18.7157059Z  2025-03-14T05:51:18.7157449Z  2025-03-14T05:51:18.7157841Z  2025-03-14T05:51:18.7158259Z  2025-03-14T05:51:18.7158718Z  2025-03-14T05:51:18.7159142Z  2025-03-14T05:51:18.7159724Z [14,731 / 15,235] 48 actions running 2025-03-14T05:51:18.7160918Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T05:51:18.7161879Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T05:51:18.7162756Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T05:51:18.7163678Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T05:51:18.7164566Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T05:51:18.7165716Z Compiling xla/service/service.cc; 23s local 2025-03-14T05:51:18.7166519Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2025-03-14T05:51:18.7167336Z Compiling xla/client/local_client.cc; 20s local ... 2025-03-14T05:51:18.9830632Z 2025-03-14T05:51:18.9831488Z  2025-03-14T05:51:18.9831953Z  2025-03-14T05:51:18.9832304Z  2025-03-14T05:51:18.9832992Z  2025-03-14T05:51:18.9833343Z  2025-03-14T05:51:18.9833692Z  2025-03-14T05:51:18.9834017Z  2025-03-14T05:51:18.9834371Z  2025-03-14T05:51:18.9834991Z [14,732 / 15,235] 48 actions, 47 running 2025-03-14T05:51:18.9835898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T05:51:18.9837087Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T05:51:18.9838055Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T05:51:18.9838934Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T05:51:18.9839835Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T05:51:18.9840611Z Compiling xla/service/service.cc; 23s local 2025-03-14T05:51:18.9841399Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2025-03-14T05:51:18.9842360Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local ... 2025-03-14T05:51:19.3160588Z 2025-03-14T05:51:19.3161493Z  2025-03-14T05:51:19.3162004Z  2025-03-14T05:51:19.3162437Z  2025-03-14T05:51:19.3162860Z  2025-03-14T05:51:19.3163295Z  2025-03-14T05:51:19.3163704Z  2025-03-14T05:51:19.3164392Z  2025-03-14T05:51:19.3164963Z  2025-03-14T05:51:19.3165782Z [14,732 / 15,235] 48 actions running 2025-03-14T05:51:19.3166605Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T05:51:19.3167587Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T05:51:19.3168493Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T05:51:19.3169390Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T05:51:19.3170304Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T05:51:19.3171035Z Compiling xla/service/service.cc; 24s local 2025-03-14T05:51:19.3171764Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2025-03-14T05:51:19.3172639Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local ... 2025-03-14T05:51:19.5163753Z 2025-03-14T05:51:19.5164802Z  2025-03-14T05:51:19.5165531Z  2025-03-14T05:51:19.5165925Z  2025-03-14T05:51:19.5166334Z  2025-03-14T05:51:19.5166713Z  2025-03-14T05:51:19.5167083Z  2025-03-14T05:51:19.5167433Z  2025-03-14T05:51:19.5167792Z  2025-03-14T05:51:19.5168361Z [14,733 / 15,235] 48 actions, 47 running 2025-03-14T05:51:19.5169185Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T05:51:19.5170520Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T05:51:19.5171489Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2025-03-14T05:51:19.5172419Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T05:51:19.5173291Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T05:51:19.5174054Z Compiling xla/service/service.cc; 24s local 2025-03-14T05:51:19.5174837Z Compiling torch_xla/csrc/lowering_context.cpp; 23s local 2025-03-14T05:51:19.5175975Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local ... 2025-03-14T05:51:19.9168194Z 2025-03-14T05:51:19.9169021Z  2025-03-14T05:51:19.9169528Z  2025-03-14T05:51:19.9169900Z  2025-03-14T05:51:19.9170268Z  2025-03-14T05:51:19.9170638Z  2025-03-14T05:51:19.9171002Z  2025-03-14T05:51:19.9171431Z  2025-03-14T05:51:19.9171842Z  2025-03-14T05:51:19.9172392Z [14,733 / 15,235] 48 actions running 2025-03-14T05:51:19.9173330Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T05:51:19.9174396Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T05:51:19.9175479Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2025-03-14T05:51:19.9176451Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2025-03-14T05:51:19.9177402Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T05:51:19.9178525Z Compiling xla/service/service.cc; 24s local 2025-03-14T05:51:19.9179384Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2025-03-14T05:51:19.9180400Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local ... 2025-03-14T05:51:20.1182680Z 2025-03-14T05:51:20.1183601Z  2025-03-14T05:51:20.1184124Z  2025-03-14T05:51:20.1184571Z  2025-03-14T05:51:20.1185037Z  2025-03-14T05:51:20.1185479Z  2025-03-14T05:51:20.1185918Z  2025-03-14T05:51:20.1186329Z  2025-03-14T05:51:20.1186774Z  2025-03-14T05:51:20.1187438Z [14,734 / 15,235] 48 actions, 47 running 2025-03-14T05:51:20.1188362Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T05:51:20.1189322Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T05:51:20.1190142Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2025-03-14T05:51:20.1191001Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2025-03-14T05:51:20.1191800Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T05:51:20.1192471Z Compiling xla/service/service.cc; 25s local 2025-03-14T05:51:20.1193423Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2025-03-14T05:51:20.1194301Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local ... 2025-03-14T05:51:20.3823431Z 2025-03-14T05:51:20.3824270Z  2025-03-14T05:51:20.3824755Z  2025-03-14T05:51:20.3825155Z  2025-03-14T05:51:20.3825530Z  2025-03-14T05:51:20.3825909Z  2025-03-14T05:51:20.3826384Z  2025-03-14T05:51:20.3826777Z  2025-03-14T05:51:20.3827184Z  2025-03-14T05:51:20.3827780Z [14,736 / 15,235] 48 actions, 47 running 2025-03-14T05:51:20.3828722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T05:51:20.3829758Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2025-03-14T05:51:20.3830755Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 42s local 2025-03-14T05:51:20.3831575Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T05:51:20.3832332Z Compiling xla/service/service.cc; 25s local 2025-03-14T05:51:20.3833236Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local 2025-03-14T05:51:20.3834165Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T05:51:20.3835200Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local ... 2025-03-14T05:51:20.7174646Z 2025-03-14T05:51:20.7175472Z  2025-03-14T05:51:20.7176317Z  2025-03-14T05:51:20.7176756Z  2025-03-14T05:51:20.7177134Z  2025-03-14T05:51:20.7177539Z  2025-03-14T05:51:20.7177950Z  2025-03-14T05:51:20.7178349Z  2025-03-14T05:51:20.7178757Z  2025-03-14T05:51:20.7179344Z [14,738 / 15,235] 48 actions running 2025-03-14T05:51:20.7180252Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T05:51:20.7181327Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2025-03-14T05:51:20.7182459Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 42s local 2025-03-14T05:51:20.7183363Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2025-03-14T05:51:20.7184152Z Compiling xla/service/service.cc; 25s local 2025-03-14T05:51:20.7184990Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2025-03-14T05:51:20.7185961Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T05:51:20.7187080Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local ... 2025-03-14T05:51:20.9892710Z 2025-03-14T05:51:20.9893587Z  2025-03-14T05:51:20.9894076Z  2025-03-14T05:51:20.9894491Z  2025-03-14T05:51:20.9894913Z  2025-03-14T05:51:20.9895350Z  2025-03-14T05:51:20.9895786Z  2025-03-14T05:51:20.9896213Z  2025-03-14T05:51:20.9896650Z  2025-03-14T05:51:20.9897586Z [14,739 / 15,235] 48 actions, 47 running 2025-03-14T05:51:20.9898524Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T05:51:20.9899571Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2025-03-14T05:51:20.9900501Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 42s local 2025-03-14T05:51:20.9901334Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2025-03-14T05:51:20.9902104Z Compiling xla/service/service.cc; 25s local 2025-03-14T05:51:20.9902790Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2025-03-14T05:51:20.9903705Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T05:51:20.9904681Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local ... 2025-03-14T05:51:21.1962011Z 2025-03-14T05:51:21.1962848Z  2025-03-14T05:51:21.1963325Z  2025-03-14T05:51:21.1963762Z  2025-03-14T05:51:21.1964150Z  2025-03-14T05:51:21.1964514Z  2025-03-14T05:51:21.1965094Z  2025-03-14T05:51:21.1965691Z  2025-03-14T05:51:21.1966097Z  2025-03-14T05:51:21.1966701Z [14,742 / 15,235] 48 actions, 47 running 2025-03-14T05:51:21.1967571Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T05:51:21.1968782Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T05:51:21.1969611Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 42s local 2025-03-14T05:51:21.1970303Z Compiling xla/service/service.cc; 26s local 2025-03-14T05:51:21.1970993Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2025-03-14T05:51:21.1971808Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T05:51:21.1972668Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2025-03-14T05:51:21.1973477Z Compiling stablehlo/dialect/ChloOps.cpp; 19s local ... 2025-03-14T05:51:21.5180834Z 2025-03-14T05:51:21.5190247Z  2025-03-14T05:51:21.5191058Z  2025-03-14T05:51:21.5191489Z  2025-03-14T05:51:21.5191878Z  2025-03-14T05:51:21.5192251Z  2025-03-14T05:51:21.5192637Z  2025-03-14T05:51:21.5193039Z  2025-03-14T05:51:21.5193425Z  2025-03-14T05:51:21.5193989Z [14,742 / 15,235] 48 actions running 2025-03-14T05:51:21.5194789Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T05:51:21.5195723Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T05:51:21.5196580Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 43s local 2025-03-14T05:51:21.5197540Z Compiling xla/service/service.cc; 26s local 2025-03-14T05:51:21.5198244Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2025-03-14T05:51:21.5199054Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T05:51:21.5199952Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2025-03-14T05:51:21.5200810Z Compiling stablehlo/dialect/ChloOps.cpp; 20s local ... 2025-03-14T05:51:21.7184584Z 2025-03-14T05:51:21.7185477Z  2025-03-14T05:51:21.7185978Z  2025-03-14T05:51:21.7186683Z  2025-03-14T05:51:21.7187117Z  2025-03-14T05:51:21.7187561Z  2025-03-14T05:51:21.7187978Z  2025-03-14T05:51:21.7188389Z  2025-03-14T05:51:21.7188805Z  2025-03-14T05:51:21.7189396Z [14,744 / 15,235] 48 actions running 2025-03-14T05:51:21.7190280Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T05:51:21.7191305Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T05:51:21.7192158Z Compiling xla/service/service.cc; 26s local 2025-03-14T05:51:21.7192941Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2025-03-14T05:51:21.7193844Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T05:51:21.7194787Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2025-03-14T05:51:21.7195616Z Compiling stablehlo/dialect/ChloOps.cpp; 20s local 2025-03-14T05:51:21.7196568Z Compiling stablehlo/dialect/VhloOps.cpp; 17s local ... 2025-03-14T05:51:22.1628060Z 2025-03-14T05:51:22.1628983Z  2025-03-14T05:51:22.1629503Z  2025-03-14T05:51:22.1629934Z  2025-03-14T05:51:22.1630350Z  2025-03-14T05:51:22.1630736Z  2025-03-14T05:51:22.1631131Z  2025-03-14T05:51:22.1631523Z  2025-03-14T05:51:22.1631925Z  2025-03-14T05:51:22.1632533Z [14,745 / 15,235] 48 actions, 47 running 2025-03-14T05:51:22.1633409Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T05:51:22.1634398Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T05:51:22.1635253Z Compiling xla/service/service.cc; 27s local 2025-03-14T05:51:22.1636006Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2025-03-14T05:51:22.1636905Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2025-03-14T05:51:22.1637867Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2025-03-14T05:51:22.1638758Z Compiling stablehlo/dialect/ChloOps.cpp; 20s local 2025-03-14T05:51:22.1639554Z Compiling stablehlo/dialect/VhloOps.cpp; 17s local ... 2025-03-14T05:51:22.5191326Z 2025-03-14T05:51:22.5192210Z  2025-03-14T05:51:22.5192688Z  2025-03-14T05:51:22.5193101Z  2025-03-14T05:51:22.5193505Z  2025-03-14T05:51:22.5193901Z  2025-03-14T05:51:22.5194292Z  2025-03-14T05:51:22.5194659Z  2025-03-14T05:51:22.5195044Z  2025-03-14T05:51:22.5195592Z [14,745 / 15,235] 48 actions running 2025-03-14T05:51:22.5196463Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T05:51:22.5197464Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2025-03-14T05:51:22.5198258Z Compiling xla/service/service.cc; 27s local 2025-03-14T05:51:22.5198942Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2025-03-14T05:51:22.5199789Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2025-03-14T05:51:22.5200696Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2025-03-14T05:51:22.5201583Z Compiling stablehlo/dialect/ChloOps.cpp; 21s local 2025-03-14T05:51:22.5202350Z Compiling stablehlo/dialect/VhloOps.cpp; 18s local ... 2025-03-14T05:51:22.8606162Z 2025-03-14T05:51:22.8607031Z  2025-03-14T05:51:22.8607497Z  2025-03-14T05:51:22.8607876Z  2025-03-14T05:51:22.8608262Z  2025-03-14T05:51:22.8608652Z  2025-03-14T05:51:22.8609025Z  2025-03-14T05:51:22.8609387Z  2025-03-14T05:51:22.8610067Z  2025-03-14T05:51:22.8610709Z [14,746 / 15,235] 48 actions, 47 running 2025-03-14T05:51:22.8611520Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T05:51:22.8612505Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2025-03-14T05:51:22.8613326Z Compiling xla/service/service.cc; 27s local 2025-03-14T05:51:22.8614079Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2025-03-14T05:51:22.8615161Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2025-03-14T05:51:22.8616109Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2025-03-14T05:51:22.8616915Z Compiling stablehlo/dialect/ChloOps.cpp; 21s local 2025-03-14T05:51:22.8617669Z Compiling stablehlo/dialect/VhloOps.cpp; 18s local ... 2025-03-14T05:51:23.1197265Z 2025-03-14T05:51:23.1198138Z  2025-03-14T05:51:23.1198647Z  2025-03-14T05:51:23.1199067Z  2025-03-14T05:51:23.1199475Z  2025-03-14T05:51:23.1199876Z  2025-03-14T05:51:23.1200312Z  2025-03-14T05:51:23.1200709Z  2025-03-14T05:51:23.1201105Z  2025-03-14T05:51:23.1201683Z [14,746 / 15,235] 48 actions running 2025-03-14T05:51:23.1202575Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T05:51:23.1203557Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2025-03-14T05:51:23.1205077Z Compiling xla/service/service.cc; 28s local 2025-03-14T05:51:23.1205871Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2025-03-14T05:51:23.1206773Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T05:51:23.1207749Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2025-03-14T05:51:23.1208599Z Compiling stablehlo/dialect/ChloOps.cpp; 21s local 2025-03-14T05:51:23.1209367Z Compiling stablehlo/dialect/VhloOps.cpp; 18s local ... 2025-03-14T05:51:23.3471860Z 2025-03-14T05:51:23.3472760Z  2025-03-14T05:51:23.3473302Z  2025-03-14T05:51:23.3473699Z  2025-03-14T05:51:23.3474100Z  2025-03-14T05:51:23.3474578Z  2025-03-14T05:51:23.3475067Z  2025-03-14T05:51:23.3475461Z  2025-03-14T05:51:23.3475850Z  2025-03-14T05:51:23.3476434Z [14,747 / 15,235] 48 actions, 47 running 2025-03-14T05:51:23.3477475Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T05:51:23.3478395Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T05:51:23.3479128Z Compiling xla/service/service.cc; 28s local 2025-03-14T05:51:23.3480142Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2025-03-14T05:51:23.3480986Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T05:51:23.3481897Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2025-03-14T05:51:23.3482784Z Compiling stablehlo/dialect/ChloOps.cpp; 21s local 2025-03-14T05:51:23.3483661Z Compiling stablehlo/dialect/VhloOps.cpp; 19s local ... 2025-03-14T05:51:23.7199271Z 2025-03-14T05:51:23.7200175Z  2025-03-14T05:51:23.7200713Z  2025-03-14T05:51:23.7201136Z  2025-03-14T05:51:23.7201572Z  2025-03-14T05:51:23.7202007Z  2025-03-14T05:51:23.7202427Z  2025-03-14T05:51:23.7202853Z  2025-03-14T05:51:23.7203275Z  2025-03-14T05:51:23.7203922Z [14,747 / 15,235] 48 actions running 2025-03-14T05:51:23.7204959Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T05:51:23.7206030Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T05:51:23.7206918Z Compiling xla/service/service.cc; 28s local 2025-03-14T05:51:23.7207720Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T05:51:23.7208664Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T05:51:23.7209696Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2025-03-14T05:51:23.7210935Z Compiling stablehlo/dialect/ChloOps.cpp; 22s local 2025-03-14T05:51:23.7211782Z Compiling stablehlo/dialect/VhloOps.cpp; 19s local ... 2025-03-14T05:51:23.9202673Z 2025-03-14T05:51:23.9203750Z  2025-03-14T05:51:23.9204253Z  2025-03-14T05:51:23.9204754Z  2025-03-14T05:51:23.9205183Z  2025-03-14T05:51:23.9205577Z  2025-03-14T05:51:23.9206008Z  2025-03-14T05:51:23.9206406Z  2025-03-14T05:51:23.9206790Z  2025-03-14T05:51:23.9209374Z [14,750 / 15,235] 48 actions running 2025-03-14T05:51:23.9210494Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T05:51:23.9211505Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T05:51:23.9212320Z Compiling xla/service/service.cc; 28s local 2025-03-14T05:51:23.9213101Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T05:51:23.9213982Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T05:51:23.9214967Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2025-03-14T05:51:23.9215878Z Compiling stablehlo/dialect/ChloOps.cpp; 22s local 2025-03-14T05:51:23.9216659Z Compiling stablehlo/dialect/VhloOps.cpp; 19s local ... 2025-03-14T05:51:24.3206901Z 2025-03-14T05:51:24.3207759Z  2025-03-14T05:51:24.3208272Z  2025-03-14T05:51:24.3209003Z  2025-03-14T05:51:24.3209365Z  2025-03-14T05:51:24.3209716Z  2025-03-14T05:51:24.3210103Z  2025-03-14T05:51:24.3210483Z  2025-03-14T05:51:24.3210878Z  2025-03-14T05:51:24.3211450Z [14,752 / 15,235] 48 actions running 2025-03-14T05:51:24.3212315Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T05:51:24.3213355Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T05:51:24.3214317Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T05:51:24.3215205Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T05:51:24.3216154Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2025-03-14T05:51:24.3217060Z Compiling stablehlo/dialect/ChloOps.cpp; 22s local 2025-03-14T05:51:24.3217768Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local 2025-03-14T05:51:24.3218503Z Compiling torch_xla/csrc/ir.cpp; 18s local ... 2025-03-14T05:51:24.5210932Z 2025-03-14T05:51:24.5211806Z  2025-03-14T05:51:24.5212410Z  2025-03-14T05:51:24.5212874Z  2025-03-14T05:51:24.5213369Z  2025-03-14T05:51:24.5213825Z  2025-03-14T05:51:24.5214533Z  2025-03-14T05:51:24.5214908Z  2025-03-14T05:51:24.5215281Z  2025-03-14T05:51:24.5215822Z [14,753 / 15,235] 48 actions running 2025-03-14T05:51:24.5216690Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T05:51:24.5217716Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T05:51:24.5218737Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T05:51:24.5219661Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T05:51:24.5220721Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2025-03-14T05:51:24.5221698Z Compiling stablehlo/dialect/ChloOps.cpp; 23s local 2025-03-14T05:51:24.5222473Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local 2025-03-14T05:51:24.5223205Z Compiling torch_xla/csrc/ir.cpp; 18s local ... 2025-03-14T05:51:24.8175507Z 2025-03-14T05:51:24.8176285Z  2025-03-14T05:51:24.8176670Z  2025-03-14T05:51:24.8177035Z  2025-03-14T05:51:24.8177397Z  2025-03-14T05:51:24.8177777Z  2025-03-14T05:51:24.8178158Z  2025-03-14T05:51:24.8178587Z  2025-03-14T05:51:24.8179000Z  2025-03-14T05:51:24.8179599Z [14,755 / 15,235] 48 actions, 47 running 2025-03-14T05:51:24.8180619Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T05:51:24.8181883Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T05:51:24.8182835Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T05:51:24.8183720Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T05:51:24.8184750Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2025-03-14T05:51:24.8185707Z Compiling stablehlo/dialect/ChloOps.cpp; 23s local 2025-03-14T05:51:24.8186636Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local 2025-03-14T05:51:24.8187316Z Compiling torch_xla/csrc/ir.cpp; 18s local ... 2025-03-14T05:51:25.0152158Z 2025-03-14T05:51:25.0153113Z  2025-03-14T05:51:25.0153595Z  2025-03-14T05:51:25.0154003Z  2025-03-14T05:51:25.0154626Z  2025-03-14T05:51:25.0154957Z  2025-03-14T05:51:25.0155384Z  2025-03-14T05:51:25.0155950Z  2025-03-14T05:51:25.0156448Z  2025-03-14T05:51:25.0157155Z [14,758 / 15,235] 48 actions, 47 running 2025-03-14T05:51:25.0158180Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T05:51:25.0159259Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T05:51:25.0160276Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T05:51:25.0161364Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2025-03-14T05:51:25.0162744Z Compiling stablehlo/dialect/ChloOps.cpp; 23s local 2025-03-14T05:51:25.0163660Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local 2025-03-14T05:51:25.0164474Z Compiling torch_xla/csrc/ir.cpp; 18s local 2025-03-14T05:51:25.0165670Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local ... 2025-03-14T05:51:25.3217245Z 2025-03-14T05:51:25.3218168Z  2025-03-14T05:51:25.3218656Z  2025-03-14T05:51:25.3219073Z  2025-03-14T05:51:25.3219542Z  2025-03-14T05:51:25.3220005Z  2025-03-14T05:51:25.3220420Z  2025-03-14T05:51:25.3220874Z  2025-03-14T05:51:25.3221341Z  2025-03-14T05:51:25.3221928Z [14,758 / 15,235] 48 actions running 2025-03-14T05:51:25.3222796Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T05:51:25.3223780Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T05:51:25.3224710Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T05:51:25.3225857Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2025-03-14T05:51:25.3226796Z Compiling stablehlo/dialect/ChloOps.cpp; 23s local 2025-03-14T05:51:25.3227956Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local 2025-03-14T05:51:25.3228675Z Compiling torch_xla/csrc/ir.cpp; 19s local 2025-03-14T05:51:25.3229459Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local ... 2025-03-14T05:51:25.5221154Z 2025-03-14T05:51:25.5222110Z  2025-03-14T05:51:25.5222724Z  2025-03-14T05:51:25.5223255Z  2025-03-14T05:51:25.5223768Z  2025-03-14T05:51:25.5224207Z  2025-03-14T05:51:25.5224579Z  2025-03-14T05:51:25.5224949Z  2025-03-14T05:51:25.5225338Z  2025-03-14T05:51:25.5225953Z [14,759 / 15,235] 48 actions running 2025-03-14T05:51:25.5226898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T05:51:25.5227938Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T05:51:25.5228935Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T05:51:25.5230020Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2025-03-14T05:51:25.5230955Z Compiling stablehlo/dialect/ChloOps.cpp; 24s local 2025-03-14T05:51:25.5231847Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local 2025-03-14T05:51:25.5232563Z Compiling torch_xla/csrc/ir.cpp; 19s local 2025-03-14T05:51:25.5233372Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local ... 2025-03-14T05:51:25.7608517Z 2025-03-14T05:51:25.7609397Z  2025-03-14T05:51:25.7609921Z  2025-03-14T05:51:25.7610509Z  2025-03-14T05:51:25.7610949Z  2025-03-14T05:51:25.7611322Z  2025-03-14T05:51:25.7611699Z  2025-03-14T05:51:25.7612112Z  2025-03-14T05:51:25.7612477Z  2025-03-14T05:51:25.7613072Z [14,760 / 15,235] 48 actions, 47 running 2025-03-14T05:51:25.7613976Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T05:51:25.7614953Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T05:51:25.7616034Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T05:51:25.7617175Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2025-03-14T05:51:25.7618142Z Compiling stablehlo/dialect/ChloOps.cpp; 24s local 2025-03-14T05:51:25.7618969Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local 2025-03-14T05:51:25.7619698Z Compiling torch_xla/csrc/ir.cpp; 19s local 2025-03-14T05:51:25.7620547Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local ... 2025-03-14T05:51:26.0929320Z 2025-03-14T05:51:26.0930209Z  2025-03-14T05:51:26.0930749Z  2025-03-14T05:51:26.0931152Z  2025-03-14T05:51:26.0931544Z  2025-03-14T05:51:26.0931927Z  2025-03-14T05:51:26.0932327Z  2025-03-14T05:51:26.0932704Z  2025-03-14T05:51:26.0933108Z  2025-03-14T05:51:26.0933715Z [14,762 / 15,235] 48 actions, 47 running 2025-03-14T05:51:26.0934969Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T05:51:26.0935871Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T05:51:26.0936670Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T05:51:26.0938018Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T05:51:26.0939051Z Compiling stablehlo/dialect/ChloOps.cpp; 24s local 2025-03-14T05:51:26.0939927Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local 2025-03-14T05:51:26.0940758Z Compiling torch_xla/csrc/ir.cpp; 20s local 2025-03-14T05:51:26.0941583Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local ... 2025-03-14T05:51:26.3227270Z 2025-03-14T05:51:26.3228168Z  2025-03-14T05:51:26.3228669Z  2025-03-14T05:51:26.3229112Z  2025-03-14T05:51:26.3229501Z  2025-03-14T05:51:26.3229912Z  2025-03-14T05:51:26.3230313Z  2025-03-14T05:51:26.3230753Z  2025-03-14T05:51:26.3231106Z  2025-03-14T05:51:26.3231653Z [14,765 / 15,235] 48 actions running 2025-03-14T05:51:26.3232513Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T05:51:26.3233719Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T05:51:26.3234558Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T05:51:26.3235507Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T05:51:26.3236378Z Compiling stablehlo/dialect/ChloOps.cpp; 24s local 2025-03-14T05:51:26.3237114Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local 2025-03-14T05:51:26.3237797Z Compiling torch_xla/csrc/ir.cpp; 20s local 2025-03-14T05:51:26.3238541Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local ... 2025-03-14T05:51:26.5526498Z 2025-03-14T05:51:26.5527409Z  2025-03-14T05:51:26.5527903Z  2025-03-14T05:51:26.5528289Z  2025-03-14T05:51:26.5528697Z  2025-03-14T05:51:26.5529051Z  2025-03-14T05:51:26.5529453Z  2025-03-14T05:51:26.5529858Z  2025-03-14T05:51:26.5530286Z  2025-03-14T05:51:26.5530919Z [14,766 / 15,235] 48 actions, 47 running 2025-03-14T05:51:26.5531815Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T05:51:26.5532792Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T05:51:26.5533719Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T05:51:26.5534704Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T05:51:26.5535842Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local 2025-03-14T05:51:26.5536612Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local 2025-03-14T05:51:26.5537331Z Compiling torch_xla/csrc/ir.cpp; 20s local 2025-03-14T05:51:26.5538129Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local ... 2025-03-14T05:51:26.9232745Z 2025-03-14T05:51:26.9233651Z  2025-03-14T05:51:26.9234113Z  2025-03-14T05:51:26.9234520Z  2025-03-14T05:51:26.9234910Z  2025-03-14T05:51:26.9235603Z  2025-03-14T05:51:26.9236524Z  2025-03-14T05:51:26.9237187Z  2025-03-14T05:51:26.9237704Z  2025-03-14T05:51:26.9238415Z [14,766 / 15,235] 48 actions running 2025-03-14T05:51:26.9239432Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2025-03-14T05:51:26.9240484Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2025-03-14T05:51:26.9241494Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T05:51:26.9242572Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T05:51:26.9243561Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local 2025-03-14T05:51:26.9244409Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local 2025-03-14T05:51:26.9245338Z Compiling torch_xla/csrc/ir.cpp; 20s local 2025-03-14T05:51:26.9246204Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local ... 2025-03-14T05:51:27.1843063Z 2025-03-14T05:51:27.1844002Z  2025-03-14T05:51:27.1844525Z  2025-03-14T05:51:27.1845085Z  2025-03-14T05:51:27.1845506Z  2025-03-14T05:51:27.1845916Z  2025-03-14T05:51:27.1846328Z  2025-03-14T05:51:27.1846711Z  2025-03-14T05:51:27.1847100Z  2025-03-14T05:51:27.1847696Z [14,768 / 15,235] 48 actions, 47 running 2025-03-14T05:51:27.1848540Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2025-03-14T05:51:27.1849446Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2025-03-14T05:51:27.1850377Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T05:51:27.1851352Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T05:51:27.1852190Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local 2025-03-14T05:51:27.1852881Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2025-03-14T05:51:27.1853552Z Compiling torch_xla/csrc/ir.cpp; 21s local 2025-03-14T05:51:27.1854275Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local ... 2025-03-14T05:51:27.4185024Z 2025-03-14T05:51:27.4187073Z  2025-03-14T05:51:27.4187591Z  2025-03-14T05:51:27.4189288Z  2025-03-14T05:51:27.4190143Z  2025-03-14T05:51:27.4191440Z  2025-03-14T05:51:27.4192651Z  2025-03-14T05:51:27.4193893Z  2025-03-14T05:51:27.4195223Z  2025-03-14T05:51:27.4196250Z [14,769 / 15,235] 48 actions, 47 running 2025-03-14T05:51:27.4197185Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2025-03-14T05:51:27.4198135Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2025-03-14T05:51:27.4199047Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T05:51:27.4200054Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T05:51:27.4200952Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T05:51:27.4201748Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2025-03-14T05:51:27.4202475Z Compiling torch_xla/csrc/ir.cpp; 21s local 2025-03-14T05:51:27.4203285Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local ... 2025-03-14T05:51:27.7241718Z 2025-03-14T05:51:27.7242723Z  2025-03-14T05:51:27.7243204Z  2025-03-14T05:51:27.7243606Z  2025-03-14T05:51:27.7244017Z  2025-03-14T05:51:27.7244416Z  2025-03-14T05:51:27.7244946Z  2025-03-14T05:51:27.7245327Z  2025-03-14T05:51:27.7245698Z  2025-03-14T05:51:27.7246596Z [14,769 / 15,235] 48 actions running 2025-03-14T05:51:27.7247483Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T05:51:27.7248432Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2025-03-14T05:51:27.7249242Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T05:51:27.7250208Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T05:51:27.7251072Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T05:51:27.7251986Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2025-03-14T05:51:27.7252661Z Compiling torch_xla/csrc/ir.cpp; 21s local 2025-03-14T05:51:27.7253358Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local ... 2025-03-14T05:51:28.1239917Z 2025-03-14T05:51:28.1240887Z  2025-03-14T05:51:28.1241312Z  2025-03-14T05:51:28.1241635Z  2025-03-14T05:51:28.1241985Z  2025-03-14T05:51:28.1242336Z  2025-03-14T05:51:28.1242717Z  2025-03-14T05:51:28.1243100Z  2025-03-14T05:51:28.1243523Z  2025-03-14T05:51:28.1244143Z [14,770 / 15,235] 48 actions, 47 running 2025-03-14T05:51:28.1245145Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T05:51:28.1246074Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2025-03-14T05:51:28.1246946Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T05:51:28.1248171Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2025-03-14T05:51:28.1249047Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T05:51:28.1249880Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2025-03-14T05:51:28.1250595Z Compiling torch_xla/csrc/ir.cpp; 22s local 2025-03-14T05:51:28.1251372Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local ... 2025-03-14T05:51:28.3246715Z 2025-03-14T05:51:28.3247582Z  2025-03-14T05:51:28.3248091Z  2025-03-14T05:51:28.3248483Z  2025-03-14T05:51:28.3248871Z  2025-03-14T05:51:28.3249292Z  2025-03-14T05:51:28.3249684Z  2025-03-14T05:51:28.3250080Z  2025-03-14T05:51:28.3250469Z  2025-03-14T05:51:28.3251053Z [14,772 / 15,235] 48 actions running 2025-03-14T05:51:28.3251958Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T05:51:28.3252946Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2025-03-14T05:51:28.3253869Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T05:51:28.3254806Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2025-03-14T05:51:28.3256053Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T05:51:28.3256842Z Compiling stablehlo/dialect/VhloOps.cpp; 24s local 2025-03-14T05:51:28.3257530Z Compiling torch_xla/csrc/ir.cpp; 22s local 2025-03-14T05:51:28.3258372Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local ... 2025-03-14T05:51:29.0064283Z 2025-03-14T05:51:29.0065215Z  2025-03-14T05:51:29.0065920Z  2025-03-14T05:51:29.0066318Z  2025-03-14T05:51:29.0066678Z  2025-03-14T05:51:29.0067124Z  2025-03-14T05:51:29.0067528Z  2025-03-14T05:51:29.0067927Z  2025-03-14T05:51:29.0068356Z  2025-03-14T05:51:29.0068944Z [14,773 / 15,235] 48 actions, 47 running 2025-03-14T05:51:29.0069806Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T05:51:29.0070776Z Compiling torch_xla/csrc/lowering_context.cpp; 33s local 2025-03-14T05:51:29.0071700Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T05:51:29.0072830Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T05:51:29.0073724Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T05:51:29.0074498Z Compiling stablehlo/dialect/VhloOps.cpp; 24s local 2025-03-14T05:51:29.0075206Z Compiling torch_xla/csrc/ir.cpp; 22s local 2025-03-14T05:51:29.0076230Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local ... 2025-03-14T05:51:29.3254670Z 2025-03-14T05:51:29.3255561Z  2025-03-14T05:51:29.3256063Z  2025-03-14T05:51:29.3256481Z  2025-03-14T05:51:29.3256950Z  2025-03-14T05:51:29.3257337Z  2025-03-14T05:51:29.3257733Z  2025-03-14T05:51:29.3258127Z  2025-03-14T05:51:29.3258544Z  2025-03-14T05:51:29.3259174Z [14,774 / 15,235] 48 actions running 2025-03-14T05:51:29.3260347Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T05:51:29.3261357Z Compiling torch_xla/csrc/lowering_context.cpp; 33s local 2025-03-14T05:51:29.3262363Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2025-03-14T05:51:29.3263441Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T05:51:29.3264449Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T05:51:29.3265253Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2025-03-14T05:51:29.3266245Z Compiling torch_xla/csrc/ir.cpp; 23s local 2025-03-14T05:51:29.3267086Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local ... 2025-03-14T05:51:29.7250936Z 2025-03-14T05:51:29.7251756Z  2025-03-14T05:51:29.7252192Z  2025-03-14T05:51:29.7252554Z  2025-03-14T05:51:29.7252922Z  2025-03-14T05:51:29.7253275Z  2025-03-14T05:51:29.7253881Z  2025-03-14T05:51:29.7254232Z  2025-03-14T05:51:29.7254591Z  2025-03-14T05:51:29.7255152Z [14,776 / 15,235] 48 actions, 47 running 2025-03-14T05:51:29.7255936Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T05:51:29.7256796Z Compiling torch_xla/csrc/lowering_context.cpp; 34s local 2025-03-14T05:51:29.7257604Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2025-03-14T05:51:29.7258484Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T05:51:29.7259292Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T05:51:29.7260011Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2025-03-14T05:51:29.7260659Z Compiling torch_xla/csrc/ir.cpp; 23s local 2025-03-14T05:51:29.7261362Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local ... 2025-03-14T05:51:30.0860961Z 2025-03-14T05:51:30.0861776Z  2025-03-14T05:51:30.0862187Z  2025-03-14T05:51:30.0862547Z  2025-03-14T05:51:30.0862879Z  2025-03-14T05:51:30.0863213Z  2025-03-14T05:51:30.0863552Z  2025-03-14T05:51:30.0863895Z  2025-03-14T05:51:30.0864238Z  2025-03-14T05:51:30.0864985Z [14,777 / 15,235] 48 actions, 47 running 2025-03-14T05:51:30.0866094Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T05:51:30.0866924Z Compiling torch_xla/csrc/lowering_context.cpp; 34s local 2025-03-14T05:51:30.0867696Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T05:51:30.0868556Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T05:51:30.0869320Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T05:51:30.0869972Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2025-03-14T05:51:30.0870566Z Compiling torch_xla/csrc/ir.cpp; 24s local 2025-03-14T05:51:30.0871248Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local ... 2025-03-14T05:51:30.3261556Z 2025-03-14T05:51:30.3262586Z  2025-03-14T05:51:30.3263039Z  2025-03-14T05:51:30.3263445Z  2025-03-14T05:51:30.3263859Z  2025-03-14T05:51:30.3264233Z  2025-03-14T05:51:30.3264600Z  2025-03-14T05:51:30.3265060Z  2025-03-14T05:51:30.3265654Z  2025-03-14T05:51:30.3266195Z [14,779 / 15,235] 48 actions running 2025-03-14T05:51:30.3267049Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T05:51:30.3267997Z Compiling torch_xla/csrc/lowering_context.cpp; 34s local 2025-03-14T05:51:30.3269181Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T05:51:30.3270176Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T05:51:30.3271090Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T05:51:30.3271838Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2025-03-14T05:51:30.3272565Z Compiling torch_xla/csrc/ir.cpp; 24s local 2025-03-14T05:51:30.3273398Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local ... 2025-03-14T05:51:30.6902990Z 2025-03-14T05:51:30.6903907Z  2025-03-14T05:51:30.6904633Z  2025-03-14T05:51:30.6905060Z  2025-03-14T05:51:30.6905445Z  2025-03-14T05:51:30.6905851Z  2025-03-14T05:51:30.6906223Z  2025-03-14T05:51:30.6906616Z  2025-03-14T05:51:30.6907025Z  2025-03-14T05:51:30.6907611Z [14,783 / 15,235] 48 actions, 47 running 2025-03-14T05:51:30.6908485Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2025-03-14T05:51:30.6909488Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T05:51:30.6910491Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T05:51:30.6911365Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T05:51:30.6912094Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2025-03-14T05:51:30.6912787Z Compiling torch_xla/csrc/ir.cpp; 24s local 2025-03-14T05:51:30.6913901Z Compiling stablehlo/dialect/StablehloOps.cpp; 23s local 2025-03-14T05:51:30.6914733Z @llvm-project//mlir:SCFTransforms; 16s local ... 2025-03-14T05:51:30.9268133Z 2025-03-14T05:51:30.9269163Z  2025-03-14T05:51:30.9269651Z  2025-03-14T05:51:30.9270072Z  2025-03-14T05:51:30.9270451Z  2025-03-14T05:51:30.9270842Z  2025-03-14T05:51:30.9271233Z  2025-03-14T05:51:30.9271635Z  2025-03-14T05:51:30.9272052Z  2025-03-14T05:51:30.9272607Z [14,784 / 15,235] 48 actions running 2025-03-14T05:51:30.9273447Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2025-03-14T05:51:30.9274347Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T05:51:30.9275245Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T05:51:30.9276093Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T05:51:30.9276801Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2025-03-14T05:51:30.9277503Z Compiling torch_xla/csrc/ir.cpp; 24s local 2025-03-14T05:51:30.9278185Z Compiling stablehlo/dialect/StablehloOps.cpp; 23s local 2025-03-14T05:51:30.9278897Z @llvm-project//mlir:SCFTransforms; 16s local ... 2025-03-14T05:51:31.2826523Z 2025-03-14T05:51:31.2827372Z  2025-03-14T05:51:31.2827879Z  2025-03-14T05:51:31.2828257Z  2025-03-14T05:51:31.2828641Z  2025-03-14T05:51:31.2829012Z  2025-03-14T05:51:31.2829399Z  2025-03-14T05:51:31.2829783Z  2025-03-14T05:51:31.2830139Z  2025-03-14T05:51:31.2830735Z [14,785 / 15,235] 48 actions, 47 running 2025-03-14T05:51:31.2831576Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2025-03-14T05:51:31.2832525Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2025-03-14T05:51:31.2833489Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T05:51:31.2834392Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T05:51:31.2835174Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2025-03-14T05:51:31.2835916Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T05:51:31.2836669Z Compiling stablehlo/dialect/StablehloOps.cpp; 23s local 2025-03-14T05:51:31.2837439Z @llvm-project//mlir:SCFTransforms; 16s local ... 2025-03-14T05:51:31.5274229Z 2025-03-14T05:51:31.5275053Z  2025-03-14T05:51:31.5275548Z  2025-03-14T05:51:31.5275939Z  2025-03-14T05:51:31.5276338Z  2025-03-14T05:51:31.5276734Z  2025-03-14T05:51:31.5277131Z  2025-03-14T05:51:31.5277514Z  2025-03-14T05:51:31.5279818Z  2025-03-14T05:51:31.5280737Z [14,786 / 15,235] 48 actions running 2025-03-14T05:51:31.5281702Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2025-03-14T05:51:31.5282745Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2025-03-14T05:51:31.5283698Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T05:51:31.5284788Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T05:51:31.5285758Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2025-03-14T05:51:31.5286523Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T05:51:31.5287269Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2025-03-14T05:51:31.5288107Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 15s local ... 2025-03-14T05:51:31.8201608Z 2025-03-14T05:51:31.8202431Z  2025-03-14T05:51:31.8202929Z  2025-03-14T05:51:31.8203357Z  2025-03-14T05:51:31.8203780Z  2025-03-14T05:51:31.8204210Z  2025-03-14T05:51:31.8204763Z  2025-03-14T05:51:31.8205166Z  2025-03-14T05:51:31.8205515Z  2025-03-14T05:51:31.8206134Z [14,788 / 15,235] 48 actions, 47 running 2025-03-14T05:51:31.8207022Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T05:51:31.8208036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2025-03-14T05:51:31.8209293Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T05:51:31.8210169Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T05:51:31.8210880Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2025-03-14T05:51:31.8211561Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T05:51:31.8212301Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2025-03-14T05:51:31.8213131Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 16s local ... 2025-03-14T05:51:32.1281531Z 2025-03-14T05:51:32.1282402Z  2025-03-14T05:51:32.1282938Z  2025-03-14T05:51:32.1283357Z  2025-03-14T05:51:32.1283761Z  2025-03-14T05:51:32.1284168Z  2025-03-14T05:51:32.1284560Z  2025-03-14T05:51:32.1285092Z  2025-03-14T05:51:32.1285509Z  2025-03-14T05:51:32.1286073Z [14,791 / 15,235] 48 actions running 2025-03-14T05:51:32.1286905Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T05:51:32.1287933Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T05:51:32.1288881Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2025-03-14T05:51:32.1290062Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T05:51:32.1290825Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2025-03-14T05:51:32.1291521Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T05:51:32.1292281Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2025-03-14T05:51:32.1293104Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 16s local ... 2025-03-14T05:51:32.5276305Z 2025-03-14T05:51:32.5277076Z  2025-03-14T05:51:32.5277506Z  2025-03-14T05:51:32.5277890Z  2025-03-14T05:51:32.5278239Z  2025-03-14T05:51:32.5278612Z  2025-03-14T05:51:32.5278955Z  2025-03-14T05:51:32.5279302Z  2025-03-14T05:51:32.5279656Z  2025-03-14T05:51:32.5280185Z [14,792 / 15,235] 48 actions, 47 running 2025-03-14T05:51:32.5280982Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T05:51:32.5281872Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T05:51:32.5282744Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2025-03-14T05:51:32.5283531Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T05:51:32.5284209Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2025-03-14T05:51:32.5284996Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T05:51:32.5285993Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2025-03-14T05:51:32.5286725Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 16s local ... 2025-03-14T05:51:32.7286786Z 2025-03-14T05:51:32.7287571Z  2025-03-14T05:51:32.7288051Z  2025-03-14T05:51:32.7288462Z  2025-03-14T05:51:32.7288873Z  2025-03-14T05:51:32.7289276Z  2025-03-14T05:51:32.7289682Z  2025-03-14T05:51:32.7290127Z  2025-03-14T05:51:32.7290531Z  2025-03-14T05:51:32.7291103Z [14,792 / 15,235] 48 actions running 2025-03-14T05:51:32.7292228Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2025-03-14T05:51:32.7293237Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T05:51:32.7294215Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2025-03-14T05:51:32.7295094Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T05:51:32.7295787Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2025-03-14T05:51:32.7296552Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T05:51:32.7297294Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2025-03-14T05:51:32.7298146Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 17s local ... 2025-03-14T05:51:33.1601884Z 2025-03-14T05:51:33.1602702Z  2025-03-14T05:51:33.1603194Z  2025-03-14T05:51:33.1603591Z  2025-03-14T05:51:33.1603992Z  2025-03-14T05:51:33.1604779Z  2025-03-14T05:51:33.1605150Z  2025-03-14T05:51:33.1605554Z  2025-03-14T05:51:33.1605939Z  2025-03-14T05:51:33.1606545Z [14,793 / 15,235] 48 actions, 47 running 2025-03-14T05:51:33.1607436Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2025-03-14T05:51:33.1608458Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T05:51:33.1609482Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T05:51:33.1610417Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T05:51:33.1611189Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2025-03-14T05:51:33.1611879Z Compiling torch_xla/csrc/ir.cpp; 27s local 2025-03-14T05:51:33.1612626Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2025-03-14T05:51:33.1613430Z Compiling xla/pjrt/gpu/gpu_helpers.cc; 17s local ... 2025-03-14T05:51:33.5292911Z 2025-03-14T05:51:33.5293744Z  2025-03-14T05:51:33.5294393Z  2025-03-14T05:51:33.5294786Z  2025-03-14T05:51:33.5295165Z  2025-03-14T05:51:33.5295559Z  2025-03-14T05:51:33.5295981Z  2025-03-14T05:51:33.5296388Z  2025-03-14T05:51:33.5297065Z  2025-03-14T05:51:33.5297667Z [14,795 / 15,235] 48 actions running 2025-03-14T05:51:33.5298553Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2025-03-14T05:51:33.5299592Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T05:51:33.5300618Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T05:51:33.5301578Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T05:51:33.5302405Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2025-03-14T05:51:33.5303152Z Compiling torch_xla/csrc/ir.cpp; 27s local 2025-03-14T05:51:33.5303885Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2025-03-14T05:51:33.5304640Z Compiling stablehlo/reference/Ops.cpp; 16s local ... 2025-03-14T05:51:33.8203960Z 2025-03-14T05:51:33.8205046Z  2025-03-14T05:51:33.8205550Z  2025-03-14T05:51:33.8206003Z  2025-03-14T05:51:33.8206392Z  2025-03-14T05:51:33.8206787Z  2025-03-14T05:51:33.8207189Z  2025-03-14T05:51:33.8207559Z  2025-03-14T05:51:33.8207935Z  2025-03-14T05:51:33.8208506Z [14,796 / 15,235] 48 actions, 47 running 2025-03-14T05:51:33.8209359Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T05:51:33.8210316Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T05:51:33.8211596Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T05:51:33.8212523Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T05:51:33.8213290Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2025-03-14T05:51:33.8214007Z Compiling torch_xla/csrc/ir.cpp; 27s local 2025-03-14T05:51:33.8214729Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2025-03-14T05:51:33.8215588Z Compiling stablehlo/reference/Ops.cpp; 16s local ... 2025-03-14T05:51:34.1298396Z 2025-03-14T05:51:34.1299541Z  2025-03-14T05:51:34.1300057Z  2025-03-14T05:51:34.1300466Z  2025-03-14T05:51:34.1300861Z  2025-03-14T05:51:34.1301248Z  2025-03-14T05:51:34.1301661Z  2025-03-14T05:51:34.1302046Z  2025-03-14T05:51:34.1302363Z  2025-03-14T05:51:34.1302811Z [14,797 / 15,235] 48 actions running 2025-03-14T05:51:34.1303630Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T05:51:34.1304714Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2025-03-14T05:51:34.1305621Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2025-03-14T05:51:34.1306507Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T05:51:34.1307196Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2025-03-14T05:51:34.1307952Z Compiling torch_xla/csrc/ir.cpp; 28s local 2025-03-14T05:51:34.1308960Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2025-03-14T05:51:34.1309808Z Compiling stablehlo/reference/Ops.cpp; 17s local ... 2025-03-14T05:51:35.1245162Z 2025-03-14T05:51:35.1245968Z  2025-03-14T05:51:35.1246456Z  2025-03-14T05:51:35.1246842Z  2025-03-14T05:51:35.1247269Z  2025-03-14T05:51:35.1247669Z  2025-03-14T05:51:35.1248067Z  2025-03-14T05:51:35.1248443Z  2025-03-14T05:51:35.1248850Z  2025-03-14T05:51:35.1249522Z [14,798 / 15,235] 48 actions, 47 running 2025-03-14T05:51:35.1250464Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T05:51:35.1251474Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2025-03-14T05:51:35.1252457Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T05:51:35.1253372Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2025-03-14T05:51:35.1254199Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2025-03-14T05:51:35.1254998Z Compiling torch_xla/csrc/ir.cpp; 29s local 2025-03-14T05:51:35.1255828Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2025-03-14T05:51:35.1256972Z Compiling stablehlo/reference/Ops.cpp; 18s local ... 2025-03-14T05:51:35.3304623Z 2025-03-14T05:51:35.3305467Z  2025-03-14T05:51:35.3316007Z  2025-03-14T05:51:35.3316738Z  2025-03-14T05:51:35.3317162Z  2025-03-14T05:51:35.3317568Z  2025-03-14T05:51:35.3317978Z  2025-03-14T05:51:35.3318407Z  2025-03-14T05:51:35.3318808Z  2025-03-14T05:51:35.3319471Z [14,799 / 15,235] 48 actions, 47 running 2025-03-14T05:51:35.3320391Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T05:51:35.3321433Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2025-03-14T05:51:35.3322506Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T05:51:35.3323478Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2025-03-14T05:51:35.3324275Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T05:51:35.3325178Z Compiling torch_xla/csrc/ir.cpp; 29s local 2025-03-14T05:51:35.3326011Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2025-03-14T05:51:35.3326870Z Compiling stablehlo/reference/Ops.cpp; 18s local ... 2025-03-14T05:51:35.6389939Z 2025-03-14T05:51:35.6390753Z  2025-03-14T05:51:35.6391192Z  2025-03-14T05:51:35.6391566Z  2025-03-14T05:51:35.6391940Z  2025-03-14T05:51:35.6392311Z  2025-03-14T05:51:35.6392927Z  2025-03-14T05:51:35.6393299Z  2025-03-14T05:51:35.6393667Z  2025-03-14T05:51:35.6394242Z [14,802 / 15,235] 48 actions, 47 running 2025-03-14T05:51:35.6395048Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T05:51:35.6395965Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2025-03-14T05:51:35.6396913Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T05:51:35.6397971Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T05:51:35.6398609Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T05:51:35.6399201Z Compiling torch_xla/csrc/ir.cpp; 29s local 2025-03-14T05:51:35.6399821Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T05:51:35.6400476Z Compiling stablehlo/reference/Ops.cpp; 18s local ... 2025-03-14T05:51:35.8974148Z 2025-03-14T05:51:35.8974974Z  2025-03-14T05:51:35.8975418Z  2025-03-14T05:51:35.8975929Z  2025-03-14T05:51:35.8976404Z  2025-03-14T05:51:35.8976830Z  2025-03-14T05:51:35.8977255Z  2025-03-14T05:51:35.8977654Z  2025-03-14T05:51:35.8978061Z  2025-03-14T05:51:35.8978683Z [14,805 / 15,235] 48 actions, 47 running 2025-03-14T05:51:35.8979560Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2025-03-14T05:51:35.8980906Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2025-03-14T05:51:35.8981966Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T05:51:35.8982945Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T05:51:35.8983784Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T05:51:35.8984566Z Compiling torch_xla/csrc/ir.cpp; 29s local 2025-03-14T05:51:35.8985353Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T05:51:35.8986219Z Compiling stablehlo/reference/Ops.cpp; 18s local ... 2025-03-14T05:51:36.1311261Z 2025-03-14T05:51:36.1312094Z  2025-03-14T05:51:36.1312612Z  2025-03-14T05:51:36.1313066Z  2025-03-14T05:51:36.1313512Z  2025-03-14T05:51:36.1313953Z  2025-03-14T05:51:36.1314385Z  2025-03-14T05:51:36.1314809Z  2025-03-14T05:51:36.1315235Z  2025-03-14T05:51:36.1315857Z [14,806 / 15,235] 48 actions running 2025-03-14T05:51:36.1316828Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2025-03-14T05:51:36.1317951Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T05:51:36.1319056Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T05:51:36.1320382Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T05:51:36.1321254Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T05:51:36.1322049Z Compiling torch_xla/csrc/ir.cpp; 30s local 2025-03-14T05:51:36.1322885Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T05:51:36.1323825Z Compiling stablehlo/reference/Ops.cpp; 19s local ... 2025-03-14T05:51:36.8649749Z 2025-03-14T05:51:36.8650642Z  2025-03-14T05:51:36.8651130Z  2025-03-14T05:51:36.8651542Z  2025-03-14T05:51:36.8651943Z  2025-03-14T05:51:36.8652326Z  2025-03-14T05:51:36.8652707Z  2025-03-14T05:51:36.8653062Z  2025-03-14T05:51:36.8653442Z  2025-03-14T05:51:36.8654092Z [14,807 / 15,235] 48 actions, 47 running 2025-03-14T05:51:36.8654993Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T05:51:36.8655975Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T05:51:36.8656961Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T05:51:36.8657822Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T05:51:36.8658599Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T05:51:36.8659324Z Compiling torch_xla/csrc/ir.cpp; 30s local 2025-03-14T05:51:36.8660369Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T05:51:36.8661248Z Compiling stablehlo/reference/Ops.cpp; 19s local ... 2025-03-14T05:51:37.1318856Z 2025-03-14T05:51:37.1319715Z  2025-03-14T05:51:37.1320191Z  2025-03-14T05:51:37.1320600Z  2025-03-14T05:51:37.1321010Z  2025-03-14T05:51:37.1321416Z  2025-03-14T05:51:37.1321863Z  2025-03-14T05:51:37.1322233Z  2025-03-14T05:51:37.1322610Z  2025-03-14T05:51:37.1323413Z [14,807 / 15,235] 48 actions running 2025-03-14T05:51:37.1324268Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T05:51:37.1325363Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T05:51:37.1326411Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T05:51:37.1327319Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T05:51:37.1328094Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T05:51:37.1328825Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T05:51:37.1329572Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T05:51:37.1330399Z Compiling stablehlo/reference/Ops.cpp; 20s local ... 2025-03-14T05:51:37.3322566Z 2025-03-14T05:51:37.3323368Z  2025-03-14T05:51:37.3323824Z  2025-03-14T05:51:37.3324479Z  2025-03-14T05:51:37.3324986Z  2025-03-14T05:51:37.3325395Z  2025-03-14T05:51:37.3325786Z  2025-03-14T05:51:37.3326221Z  2025-03-14T05:51:37.3326634Z  2025-03-14T05:51:37.3327234Z [14,808 / 15,235] 48 actions running 2025-03-14T05:51:37.3328131Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T05:51:37.3329122Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T05:51:37.3330115Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T05:51:37.3331048Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T05:51:37.3331853Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2025-03-14T05:51:37.3332613Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T05:51:37.3333399Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T05:51:37.3334212Z Compiling stablehlo/reference/Ops.cpp; 20s local ... 2025-03-14T05:51:37.5343376Z 2025-03-14T05:51:37.5344235Z  2025-03-14T05:51:37.5344777Z  2025-03-14T05:51:37.5345172Z  2025-03-14T05:51:37.5345591Z  2025-03-14T05:51:37.5346020Z  2025-03-14T05:51:37.5346449Z  2025-03-14T05:51:37.5347132Z  2025-03-14T05:51:37.5347543Z  2025-03-14T05:51:37.5348120Z [14,810 / 15,235] 48 actions, 47 running 2025-03-14T05:51:37.5349039Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T05:51:37.5350065Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T05:51:37.5351048Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T05:51:37.5351931Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T05:51:37.5352689Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2025-03-14T05:51:37.5353451Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T05:51:37.5354127Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T05:51:37.5354957Z Compiling stablehlo/reference/Ops.cpp; 20s local ... 2025-03-14T05:51:37.8004060Z 2025-03-14T05:51:37.8005102Z  2025-03-14T05:51:37.8005649Z  2025-03-14T05:51:37.8006056Z  2025-03-14T05:51:37.8006484Z  2025-03-14T05:51:37.8006897Z  2025-03-14T05:51:37.8007297Z  2025-03-14T05:51:37.8007697Z  2025-03-14T05:51:37.8008094Z  2025-03-14T05:51:37.8008723Z [14,812 / 15,235] 48 actions, 47 running 2025-03-14T05:51:37.8009619Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T05:51:37.8010900Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T05:51:37.8011911Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T05:51:37.8012796Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T05:51:37.8013559Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2025-03-14T05:51:37.8014364Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T05:51:37.8015301Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T05:51:37.8016326Z Compiling stablehlo/reference/Ops.cpp; 20s local ... 2025-03-14T05:51:38.1330058Z 2025-03-14T05:51:38.1330919Z  2025-03-14T05:51:38.1331400Z  2025-03-14T05:51:38.1331811Z  2025-03-14T05:51:38.1332226Z  2025-03-14T05:51:38.1332619Z  2025-03-14T05:51:38.1333024Z  2025-03-14T05:51:38.1333426Z  2025-03-14T05:51:38.1333838Z  2025-03-14T05:51:38.1334426Z [14,813 / 15,235] 48 actions running 2025-03-14T05:51:38.1335309Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T05:51:38.1336305Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T05:51:38.1337267Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T05:51:38.1338139Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T05:51:38.1338876Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2025-03-14T05:51:38.1339963Z Compiling torch_xla/csrc/ir.cpp; 32s local 2025-03-14T05:51:38.1340731Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T05:51:38.1341592Z Compiling stablehlo/reference/Ops.cpp; 21s local ... 2025-03-14T05:51:38.5664288Z 2025-03-14T05:51:38.5665227Z  2025-03-14T05:51:38.5665904Z  2025-03-14T05:51:38.5666512Z  2025-03-14T05:51:38.5666885Z  2025-03-14T05:51:38.5667373Z  2025-03-14T05:51:38.5667846Z  2025-03-14T05:51:38.5668220Z  2025-03-14T05:51:38.5668718Z  2025-03-14T05:51:38.5669418Z [14,814 / 15,235] 48 actions, 47 running 2025-03-14T05:51:38.5670343Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T05:51:38.5671640Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T05:51:38.5672638Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T05:51:38.5673682Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2025-03-14T05:51:38.5674397Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2025-03-14T05:51:38.5674997Z Compiling torch_xla/csrc/ir.cpp; 32s local 2025-03-14T05:51:38.5675692Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T05:51:38.5676721Z Compiling stablehlo/reference/Ops.cpp; 21s local ... 2025-03-14T05:51:38.9336961Z 2025-03-14T05:51:38.9337791Z  2025-03-14T05:51:38.9338296Z  2025-03-14T05:51:38.9338690Z  2025-03-14T05:51:38.9339095Z  2025-03-14T05:51:38.9339532Z  2025-03-14T05:51:38.9339963Z  2025-03-14T05:51:38.9340381Z  2025-03-14T05:51:38.9340793Z  2025-03-14T05:51:38.9341352Z [14,816 / 15,235] 48 actions running 2025-03-14T05:51:38.9342140Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T05:51:38.9342901Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T05:51:38.9343870Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T05:51:38.9344859Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2025-03-14T05:51:38.9345652Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2025-03-14T05:51:38.9346518Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T05:51:38.9347319Z Compiling stablehlo/reference/Ops.cpp; 21s local 2025-03-14T05:51:38.9348268Z Compiling stablehlo/reference/InterpreterOps.cpp; 14s local ... 2025-03-14T05:51:39.4727516Z 2025-03-14T05:51:39.4728330Z  2025-03-14T05:51:39.4728807Z  2025-03-14T05:51:39.4729203Z  2025-03-14T05:51:39.4729599Z  2025-03-14T05:51:39.4730252Z  2025-03-14T05:51:39.4730664Z  2025-03-14T05:51:39.4731070Z  2025-03-14T05:51:39.4731463Z  2025-03-14T05:51:39.4732053Z [14,817 / 15,235] 48 actions, 47 running 2025-03-14T05:51:39.4732944Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T05:51:39.4733916Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T05:51:39.4734918Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T05:51:39.4735982Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2025-03-14T05:51:39.4736763Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T05:51:39.4737574Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T05:51:39.4738375Z Compiling stablehlo/reference/Ops.cpp; 22s local 2025-03-14T05:51:39.4739244Z Compiling stablehlo/reference/InterpreterOps.cpp; 14s local ... 2025-03-14T05:51:39.7343446Z 2025-03-14T05:51:39.7344265Z  2025-03-14T05:51:39.7344772Z  2025-03-14T05:51:39.7345198Z  2025-03-14T05:51:39.7345603Z  2025-03-14T05:51:39.7345995Z  2025-03-14T05:51:39.7346415Z  2025-03-14T05:51:39.7346813Z  2025-03-14T05:51:39.7347200Z  2025-03-14T05:51:39.7347775Z [14,818 / 15,235] 48 actions running 2025-03-14T05:51:39.7348901Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T05:51:39.7349921Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T05:51:39.7350908Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T05:51:39.7351971Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2025-03-14T05:51:39.7352735Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T05:51:39.7353583Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T05:51:39.7354439Z Compiling stablehlo/reference/Ops.cpp; 22s local 2025-03-14T05:51:39.7355505Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 13s local ... 2025-03-14T05:51:40.1348058Z 2025-03-14T05:51:40.1348898Z  2025-03-14T05:51:40.1349407Z  2025-03-14T05:51:40.1349781Z  2025-03-14T05:51:40.1350165Z  2025-03-14T05:51:40.1350681Z  2025-03-14T05:51:40.1351164Z  2025-03-14T05:51:40.1351525Z  2025-03-14T05:51:40.1351938Z  2025-03-14T05:51:40.1352508Z [14,820 / 15,235] 48 actions running 2025-03-14T05:51:40.1353397Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T05:51:40.1354680Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T05:51:40.1355658Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T05:51:40.1356571Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2025-03-14T05:51:40.1357511Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T05:51:40.1358377Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T05:51:40.1359132Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T05:51:40.1360167Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 14s local ... 2025-03-14T05:51:40.3815076Z 2025-03-14T05:51:40.3815884Z  2025-03-14T05:51:40.3816377Z  2025-03-14T05:51:40.3816782Z  2025-03-14T05:51:40.3817191Z  2025-03-14T05:51:40.3817631Z  2025-03-14T05:51:40.3818044Z  2025-03-14T05:51:40.3818410Z  2025-03-14T05:51:40.3818772Z  2025-03-14T05:51:40.3819359Z [14,821 / 15,235] 48 actions, 47 running 2025-03-14T05:51:40.3820220Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T05:51:40.3821174Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T05:51:40.3822127Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T05:51:40.3822917Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2025-03-14T05:51:40.3823933Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T05:51:40.3824755Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T05:51:40.3825568Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T05:51:40.3826515Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 14s local ... 2025-03-14T05:51:40.7353673Z 2025-03-14T05:51:40.7354476Z  2025-03-14T05:51:40.7354939Z  2025-03-14T05:51:40.7355306Z  2025-03-14T05:51:40.7355642Z  2025-03-14T05:51:40.7355988Z  2025-03-14T05:51:40.7356617Z  2025-03-14T05:51:40.7356978Z  2025-03-14T05:51:40.7357335Z  2025-03-14T05:51:40.7357834Z [14,821 / 15,235] 48 actions running 2025-03-14T05:51:40.7358572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2025-03-14T05:51:40.7359422Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T05:51:40.7360328Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T05:51:40.7361123Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T05:51:40.7361815Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T05:51:40.7362565Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2025-03-14T05:51:40.7363322Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T05:51:40.7364104Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 14s local ... 2025-03-14T05:51:41.6696043Z 2025-03-14T05:51:41.6696880Z  2025-03-14T05:51:41.6697339Z  2025-03-14T05:51:41.6697762Z  2025-03-14T05:51:41.6698179Z  2025-03-14T05:51:41.6698566Z  2025-03-14T05:51:41.6698963Z  2025-03-14T05:51:41.6699358Z  2025-03-14T05:51:41.6699757Z  2025-03-14T05:51:41.6700321Z [14,822 / 15,235] 48 actions, 47 running 2025-03-14T05:51:41.6701181Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2025-03-14T05:51:41.6702206Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2025-03-14T05:51:41.6703221Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T05:51:41.6704160Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2025-03-14T05:51:41.6704953Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T05:51:41.6705786Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T05:51:41.6706590Z Compiling stablehlo/reference/Ops.cpp; 24s local 2025-03-14T05:51:41.6707535Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 15s local ... 2025-03-14T05:51:41.9020705Z 2025-03-14T05:51:41.9021842Z  2025-03-14T05:51:41.9022336Z  2025-03-14T05:51:41.9022688Z  2025-03-14T05:51:41.9023040Z  2025-03-14T05:51:41.9023408Z  2025-03-14T05:51:41.9023783Z  2025-03-14T05:51:41.9024167Z  2025-03-14T05:51:41.9024539Z  2025-03-14T05:51:41.9025145Z [14,823 / 15,235] 48 actions, 47 running 2025-03-14T05:51:41.9026058Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T05:51:41.9027030Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2025-03-14T05:51:41.9028045Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T05:51:41.9028902Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T05:51:41.9029676Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T05:51:41.9030519Z Compiling stablehlo/reference/Ops.cpp; 24s local 2025-03-14T05:51:41.9031364Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 15s local 2025-03-14T05:51:41.9032259Z @llvm-project//mlir:MemRefTransforms; 15s local ... 2025-03-14T05:51:42.1365001Z 2025-03-14T05:51:42.1366049Z  2025-03-14T05:51:42.1366541Z  2025-03-14T05:51:42.1366983Z  2025-03-14T05:51:42.1367347Z  2025-03-14T05:51:42.1367826Z  2025-03-14T05:51:42.1368154Z  2025-03-14T05:51:42.1368556Z  2025-03-14T05:51:42.1368933Z  2025-03-14T05:51:42.1369800Z [14,823 / 15,235] 48 actions running 2025-03-14T05:51:42.1370722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T05:51:42.1371695Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T05:51:42.1372686Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T05:51:42.1373518Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T05:51:42.1374296Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T05:51:42.1375268Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T05:51:42.1376212Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 16s local 2025-03-14T05:51:42.1377159Z @llvm-project//mlir:MemRefTransforms; 16s local ... 2025-03-14T05:51:42.5369953Z 2025-03-14T05:51:42.5370868Z  2025-03-14T05:51:42.5371521Z  2025-03-14T05:51:42.5371919Z  2025-03-14T05:51:42.5372323Z  2025-03-14T05:51:42.5372683Z  2025-03-14T05:51:42.5373092Z  2025-03-14T05:51:42.5373480Z  2025-03-14T05:51:42.5373887Z  2025-03-14T05:51:42.5374383Z [14,824 / 15,235] 48 actions running 2025-03-14T05:51:42.5375208Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T05:51:42.5376248Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T05:51:42.5377500Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T05:51:42.5378426Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2025-03-14T05:51:42.5379228Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T05:51:42.5380044Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T05:51:42.5380943Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 16s local 2025-03-14T05:51:42.5381884Z @llvm-project//mlir:MemRefTransforms; 16s local ... 2025-03-14T05:51:42.7373784Z 2025-03-14T05:51:42.7374599Z  2025-03-14T05:51:42.7375067Z  2025-03-14T05:51:42.7375482Z  2025-03-14T05:51:42.7375866Z  2025-03-14T05:51:42.7376286Z  2025-03-14T05:51:42.7376658Z  2025-03-14T05:51:42.7377017Z  2025-03-14T05:51:42.7377390Z  2025-03-14T05:51:42.7377962Z [14,825 / 15,235] 48 actions running 2025-03-14T05:51:42.7378942Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T05:51:42.7379799Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T05:51:42.7380726Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T05:51:42.7382032Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2025-03-14T05:51:42.7382835Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T05:51:42.7383647Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T05:51:42.7384533Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 16s local 2025-03-14T05:51:42.7385486Z @llvm-project//mlir:MemRefTransforms; 16s local ... 2025-03-14T05:51:43.1237654Z 2025-03-14T05:51:43.1238448Z  2025-03-14T05:51:43.1238874Z  2025-03-14T05:51:43.1239219Z  2025-03-14T05:51:43.1239567Z  2025-03-14T05:51:43.1239933Z  2025-03-14T05:51:43.1240280Z  2025-03-14T05:51:43.1240825Z  2025-03-14T05:51:43.1241334Z  2025-03-14T05:51:43.1241910Z [14,826 / 15,235] 48 actions, 47 running 2025-03-14T05:51:43.1242789Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T05:51:43.1243685Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2025-03-14T05:51:43.1244747Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T05:51:43.1245634Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2025-03-14T05:51:43.1246363Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T05:51:43.1247073Z Compiling stablehlo/reference/Ops.cpp; 26s local 2025-03-14T05:51:43.1248222Z @llvm-project//mlir:MemRefTransforms; 17s local 2025-03-14T05:51:43.1248993Z @llvm-project//mlir:VectorToLLVM; 16s local ... 2025-03-14T05:51:43.3378781Z 2025-03-14T05:51:43.3379645Z  2025-03-14T05:51:43.3380137Z  2025-03-14T05:51:43.3380520Z  2025-03-14T05:51:43.3380909Z  2025-03-14T05:51:43.3381307Z  2025-03-14T05:51:43.3381706Z  2025-03-14T05:51:43.3382136Z  2025-03-14T05:51:43.3382610Z  2025-03-14T05:51:43.3383176Z [14,826 / 15,235] 48 actions running 2025-03-14T05:51:43.3384226Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T05:51:43.3385142Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2025-03-14T05:51:43.3386036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T05:51:43.3386912Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2025-03-14T05:51:43.3387748Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T05:51:43.3388601Z Compiling stablehlo/reference/Ops.cpp; 26s local 2025-03-14T05:51:43.3389340Z @llvm-project//mlir:MemRefTransforms; 17s local 2025-03-14T05:51:43.3390083Z @llvm-project//mlir:VectorToLLVM; 17s local ... 2025-03-14T05:51:44.3144759Z 2025-03-14T05:51:44.3145561Z  2025-03-14T05:51:44.3146009Z  2025-03-14T05:51:44.3146396Z  2025-03-14T05:51:44.3146767Z  2025-03-14T05:51:44.3147425Z  2025-03-14T05:51:44.3147832Z  2025-03-14T05:51:44.3148163Z  2025-03-14T05:51:44.3148571Z  2025-03-14T05:51:44.3149195Z [14,827 / 15,235] 48 actions, 47 running 2025-03-14T05:51:44.3149987Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2025-03-14T05:51:44.3150905Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2025-03-14T05:51:44.3151923Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T05:51:44.3152788Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T05:51:44.3153564Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2025-03-14T05:51:44.3154354Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T05:51:44.3155029Z @llvm-project//mlir:MemRefTransforms; 18s local 2025-03-14T05:51:44.3155712Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2025-03-14T05:51:44.5387583Z 2025-03-14T05:51:44.5388397Z  2025-03-14T05:51:44.5388906Z  2025-03-14T05:51:44.5389309Z  2025-03-14T05:51:44.5389708Z  2025-03-14T05:51:44.5390111Z  2025-03-14T05:51:44.5390523Z  2025-03-14T05:51:44.5390927Z  2025-03-14T05:51:44.5391563Z  2025-03-14T05:51:44.5392137Z [14,827 / 15,235] 48 actions running 2025-03-14T05:51:44.5393013Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2025-03-14T05:51:44.5393994Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2025-03-14T05:51:44.5394833Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T05:51:44.5395658Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T05:51:44.5396392Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2025-03-14T05:51:44.5397115Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T05:51:44.5397779Z @llvm-project//mlir:MemRefTransforms; 18s local 2025-03-14T05:51:44.5398439Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2025-03-14T05:51:44.8886017Z 2025-03-14T05:51:44.8886820Z  2025-03-14T05:51:44.8887255Z  2025-03-14T05:51:44.8887636Z  2025-03-14T05:51:44.8888023Z  2025-03-14T05:51:44.8888377Z  2025-03-14T05:51:44.8888759Z  2025-03-14T05:51:44.8889120Z  2025-03-14T05:51:44.8889481Z  2025-03-14T05:51:44.8890024Z [14,829 / 15,235] 48 actions, 47 running 2025-03-14T05:51:44.8890826Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T05:51:44.8891743Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2025-03-14T05:51:44.8892867Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T05:51:44.8893716Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T05:51:44.8894453Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2025-03-14T05:51:44.8895144Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T05:51:44.8895762Z @llvm-project//mlir:MemRefTransforms; 18s local 2025-03-14T05:51:44.8896403Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2025-03-14T05:51:45.1393465Z 2025-03-14T05:51:45.1394486Z  2025-03-14T05:51:45.1394934Z  2025-03-14T05:51:45.1395307Z  2025-03-14T05:51:45.1395686Z  2025-03-14T05:51:45.1396035Z  2025-03-14T05:51:45.1396393Z  2025-03-14T05:51:45.1396748Z  2025-03-14T05:51:45.1397104Z  2025-03-14T05:51:45.1397603Z [14,830 / 15,235] 48 actions running 2025-03-14T05:51:45.1398374Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T05:51:45.1399255Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2025-03-14T05:51:45.1400149Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2025-03-14T05:51:45.1400999Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T05:51:45.1401769Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2025-03-14T05:51:45.1402526Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T05:51:45.1403396Z @llvm-project//mlir:MemRefTransforms; 19s local 2025-03-14T05:51:45.1404074Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2025-03-14T05:51:46.3402206Z 2025-03-14T05:51:46.3403071Z  2025-03-14T05:51:46.3403525Z  2025-03-14T05:51:46.3403930Z  2025-03-14T05:51:46.3404308Z  2025-03-14T05:51:46.3404815Z  2025-03-14T05:51:46.3405162Z  2025-03-14T05:51:46.3405477Z  2025-03-14T05:51:46.3405791Z  2025-03-14T05:51:46.3406332Z [14,830 / 15,235] 48 actions running 2025-03-14T05:51:46.3407110Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2025-03-14T05:51:46.3408173Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T05:51:46.3409161Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T05:51:46.3410026Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T05:51:46.3410764Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2025-03-14T05:51:46.3411573Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T05:51:46.3412209Z @llvm-project//mlir:MemRefTransforms; 20s local 2025-03-14T05:51:46.3413166Z @llvm-project//mlir:VectorToLLVM; 20s local ... 2025-03-14T05:51:46.8141638Z 2025-03-14T05:51:46.8142493Z  2025-03-14T05:51:46.8142998Z  2025-03-14T05:51:46.8143386Z  2025-03-14T05:51:46.8143713Z  2025-03-14T05:51:46.8144083Z  2025-03-14T05:51:46.8144475Z  2025-03-14T05:51:46.8144879Z  2025-03-14T05:51:46.8145310Z  2025-03-14T05:51:46.8145973Z [14,831 / 15,235] 48 actions, 47 running 2025-03-14T05:51:46.8146767Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2025-03-14T05:51:46.8147762Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T05:51:46.8148652Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T05:51:46.8149536Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T05:51:46.8150399Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T05:51:46.8151183Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T05:51:46.8151898Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T05:51:46.8152706Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local ... 2025-03-14T05:51:47.1409784Z 2025-03-14T05:51:47.1410600Z  2025-03-14T05:51:47.1411294Z  2025-03-14T05:51:47.1411705Z  2025-03-14T05:51:47.1412052Z  2025-03-14T05:51:47.1412381Z  2025-03-14T05:51:47.1412683Z  2025-03-14T05:51:47.1413312Z  2025-03-14T05:51:47.1413724Z  2025-03-14T05:51:47.1414279Z [14,831 / 15,235] 48 actions running 2025-03-14T05:51:47.1415145Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2025-03-14T05:51:47.1416013Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T05:51:47.1416955Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T05:51:47.1417820Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T05:51:47.1418812Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T05:51:47.1419570Z Compiling stablehlo/reference/Ops.cpp; 30s local 2025-03-14T05:51:47.1420249Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T05:51:47.1421028Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local ... 2025-03-14T05:51:47.3653715Z 2025-03-14T05:51:47.3654540Z  2025-03-14T05:51:47.3655049Z  2025-03-14T05:51:47.3655443Z  2025-03-14T05:51:47.3655818Z  2025-03-14T05:51:47.3656321Z  2025-03-14T05:51:47.3656846Z  2025-03-14T05:51:47.3657293Z  2025-03-14T05:51:47.3657750Z  2025-03-14T05:51:47.3658346Z [14,832 / 15,235] 48 actions, 47 running 2025-03-14T05:51:47.3659224Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2025-03-14T05:51:47.3660404Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T05:51:47.3661345Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T05:51:47.3662278Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T05:51:47.3663070Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T05:51:47.3663804Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T05:51:47.3664533Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local 2025-03-14T05:51:47.3665270Z @llvm-project//mlir:VectorToLLVM; 17s local ... 2025-03-14T05:51:47.7415721Z 2025-03-14T05:51:47.7416552Z  2025-03-14T05:51:47.7417125Z  2025-03-14T05:51:47.7417526Z  2025-03-14T05:51:47.7417943Z  2025-03-14T05:51:47.7418351Z  2025-03-14T05:51:47.7418768Z  2025-03-14T05:51:47.7419176Z  2025-03-14T05:51:47.7419575Z  2025-03-14T05:51:47.7420164Z [14,833 / 15,235] 48 actions running 2025-03-14T05:51:47.7421079Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T05:51:47.7422128Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T05:51:47.7423156Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T05:51:47.7424298Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T05:51:47.7425041Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T05:51:47.7425707Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T05:51:47.7426257Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2025-03-14T05:51:47.7426878Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2025-03-14T05:51:48.1115915Z 2025-03-14T05:51:48.1116769Z  2025-03-14T05:51:48.1117256Z  2025-03-14T05:51:48.1117617Z  2025-03-14T05:51:48.1118009Z  2025-03-14T05:51:48.1118405Z  2025-03-14T05:51:48.1118792Z  2025-03-14T05:51:48.1119170Z  2025-03-14T05:51:48.1119548Z  2025-03-14T05:51:48.1120179Z [14,835 / 15,235] 48 actions, 47 running 2025-03-14T05:51:48.1121052Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T05:51:48.1121922Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T05:51:48.1122880Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T05:51:48.1123771Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T05:51:48.1124492Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T05:51:48.1125451Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2025-03-14T05:51:48.1126424Z @llvm-project//mlir:VectorToLLVM; 18s local 2025-03-14T05:51:48.1127104Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T05:51:48.3421432Z 2025-03-14T05:51:48.3422307Z  2025-03-14T05:51:48.3422789Z  2025-03-14T05:51:48.3423191Z  2025-03-14T05:51:48.3423564Z  2025-03-14T05:51:48.3423965Z  2025-03-14T05:51:48.3424396Z  2025-03-14T05:51:48.3424776Z  2025-03-14T05:51:48.3425150Z  2025-03-14T05:51:48.3426014Z [14,836 / 15,235] 48 actions running 2025-03-14T05:51:48.3426898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T05:51:48.3427867Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T05:51:48.3428844Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T05:51:48.3429777Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T05:51:48.3430542Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T05:51:48.3431370Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2025-03-14T05:51:48.3432246Z @llvm-project//mlir:VectorToLLVM; 18s local 2025-03-14T05:51:48.3433047Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T05:51:48.5424882Z 2025-03-14T05:51:48.5425832Z  2025-03-14T05:51:48.5426327Z  2025-03-14T05:51:48.5426760Z  2025-03-14T05:51:48.5427401Z  2025-03-14T05:51:48.5427828Z  2025-03-14T05:51:48.5428252Z  2025-03-14T05:51:48.5428672Z  2025-03-14T05:51:48.5429110Z  2025-03-14T05:51:48.5429721Z [14,837 / 15,235] 48 actions running 2025-03-14T05:51:48.5430649Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T05:51:48.5431725Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T05:51:48.5432796Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T05:51:48.5433779Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T05:51:48.5434648Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T05:51:48.5435418Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2025-03-14T05:51:48.5435994Z @llvm-project//mlir:VectorToLLVM; 19s local 2025-03-14T05:51:48.5436554Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T05:51:48.9430362Z 2025-03-14T05:51:48.9431274Z  2025-03-14T05:51:48.9431746Z  2025-03-14T05:51:48.9432128Z  2025-03-14T05:51:48.9432524Z  2025-03-14T05:51:48.9432941Z  2025-03-14T05:51:48.9433343Z  2025-03-14T05:51:48.9434055Z  2025-03-14T05:51:48.9434440Z  2025-03-14T05:51:48.9435026Z [14,839 / 15,235] 48 actions running 2025-03-14T05:51:48.9435890Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T05:51:48.9436895Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T05:51:48.9437822Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T05:51:48.9438767Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T05:51:48.9439596Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T05:51:48.9440492Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2025-03-14T05:51:48.9441244Z @llvm-project//mlir:VectorToLLVM; 19s local 2025-03-14T05:51:48.9442031Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T05:51:49.1433409Z 2025-03-14T05:51:49.1434253Z  2025-03-14T05:51:49.1434757Z  2025-03-14T05:51:49.1435158Z  2025-03-14T05:51:49.1435565Z  2025-03-14T05:51:49.1435957Z  2025-03-14T05:51:49.1436331Z  2025-03-14T05:51:49.1436718Z  2025-03-14T05:51:49.1437116Z  2025-03-14T05:51:49.1437677Z [14,841 / 15,235] 48 actions running 2025-03-14T05:51:49.1438515Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T05:51:49.1439363Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T05:51:49.1440809Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2025-03-14T05:51:49.1441655Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T05:51:49.1442539Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T05:51:49.1443353Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2025-03-14T05:51:49.1444145Z @llvm-project//mlir:VectorToLLVM; 19s local 2025-03-14T05:51:49.1445053Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T05:51:50.3443081Z 2025-03-14T05:51:50.3443905Z  2025-03-14T05:51:50.3444391Z  2025-03-14T05:51:50.3444934Z  2025-03-14T05:51:50.3445315Z  2025-03-14T05:51:50.3445725Z  2025-03-14T05:51:50.3446112Z  2025-03-14T05:51:50.3446626Z  2025-03-14T05:51:50.3447009Z  2025-03-14T05:51:50.3447585Z [14,841 / 15,235] 48 actions running 2025-03-14T05:51:50.3448478Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2025-03-14T05:51:50.3449414Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2025-03-14T05:51:50.3450402Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T05:51:50.3451371Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T05:51:50.3452221Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2025-03-14T05:51:50.3453289Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local 2025-03-14T05:51:50.3454075Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T05:51:50.3454790Z @llvm-project//mlir:VectorTransforms; 19s local ... 2025-03-14T05:51:50.7447917Z 2025-03-14T05:51:50.7448802Z  2025-03-14T05:51:50.7449298Z  2025-03-14T05:51:50.7449703Z  2025-03-14T05:51:50.7450057Z  2025-03-14T05:51:50.7450398Z  2025-03-14T05:51:50.7450781Z  2025-03-14T05:51:50.7451187Z  2025-03-14T05:51:50.7451587Z  2025-03-14T05:51:50.7452175Z [14,842 / 15,235] 48 actions running 2025-03-14T05:51:50.7453044Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T05:51:50.7453915Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2025-03-14T05:51:50.7455058Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T05:51:50.7455982Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T05:51:50.7456774Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T05:51:50.7457633Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2025-03-14T05:51:50.7458405Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T05:51:50.7459400Z @llvm-project//mlir:VectorTransforms; 20s local ... 2025-03-14T05:51:51.1270049Z 2025-03-14T05:51:51.1270905Z  2025-03-14T05:51:51.1271416Z  2025-03-14T05:51:51.1271832Z  2025-03-14T05:51:51.1272246Z  2025-03-14T05:51:51.1272649Z  2025-03-14T05:51:51.1273040Z  2025-03-14T05:51:51.1273413Z  2025-03-14T05:51:51.1273826Z  2025-03-14T05:51:51.1274451Z [14,843 / 15,235] 48 actions, 47 running 2025-03-14T05:51:51.1275346Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T05:51:51.1276282Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T05:51:51.1277215Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T05:51:51.1278062Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T05:51:51.1278836Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T05:51:51.1279641Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2025-03-14T05:51:51.1280368Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T05:51:51.1281061Z @llvm-project//mlir:VectorTransforms; 20s local ... 2025-03-14T05:51:51.3453328Z 2025-03-14T05:51:51.3454133Z  2025-03-14T05:51:51.3454640Z  2025-03-14T05:51:51.3455052Z  2025-03-14T05:51:51.3455476Z  2025-03-14T05:51:51.3456174Z  2025-03-14T05:51:51.3456604Z  2025-03-14T05:51:51.3456975Z  2025-03-14T05:51:51.3457366Z  2025-03-14T05:51:51.3457956Z [14,844 / 15,235] 48 actions running 2025-03-14T05:51:51.3458816Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T05:51:51.3459858Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T05:51:51.3460855Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T05:51:51.3462105Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T05:51:51.3462905Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T05:51:51.3463634Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2025-03-14T05:51:51.3464349Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T05:51:51.3464986Z @stablehlo//:linalg_passes; 19s local ... 2025-03-14T05:51:51.7457909Z 2025-03-14T05:51:51.7458763Z  2025-03-14T05:51:51.7459226Z  2025-03-14T05:51:51.7459678Z  2025-03-14T05:51:51.7460086Z  2025-03-14T05:51:51.7460486Z  2025-03-14T05:51:51.7460918Z  2025-03-14T05:51:51.7461317Z  2025-03-14T05:51:51.7461697Z  2025-03-14T05:51:51.7462230Z [14,845 / 15,235] 48 actions running 2025-03-14T05:51:51.7463088Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2025-03-14T05:51:51.7464469Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T05:51:51.7465672Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T05:51:51.7466610Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T05:51:51.7467444Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2025-03-14T05:51:51.7468278Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local 2025-03-14T05:51:51.7469011Z @llvm-project//mlir:VectorToLLVM; 22s local 2025-03-14T05:51:51.7469620Z @stablehlo//:linalg_passes; 19s local ... 2025-03-14T05:51:51.9931717Z 2025-03-14T05:51:51.9932562Z  2025-03-14T05:51:51.9933045Z  2025-03-14T05:51:51.9933428Z  2025-03-14T05:51:51.9933812Z  2025-03-14T05:51:51.9934196Z  2025-03-14T05:51:51.9944313Z  2025-03-14T05:51:51.9944808Z  2025-03-14T05:51:51.9945210Z  2025-03-14T05:51:51.9945845Z [14,847 / 15,235] 48 actions, 47 running 2025-03-14T05:51:51.9946801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2025-03-14T05:51:51.9947825Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T05:51:51.9949103Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T05:51:51.9950048Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T05:51:51.9950880Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2025-03-14T05:51:51.9951733Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local 2025-03-14T05:51:51.9952476Z @llvm-project//mlir:VectorToLLVM; 22s local 2025-03-14T05:51:51.9953144Z @stablehlo//:linalg_passes; 20s local ... 2025-03-14T05:51:52.2986987Z 2025-03-14T05:51:52.2987800Z  2025-03-14T05:51:52.2988266Z  2025-03-14T05:51:52.2988634Z  2025-03-14T05:51:52.2989006Z  2025-03-14T05:51:52.2989360Z  2025-03-14T05:51:52.2989703Z  2025-03-14T05:51:52.2990062Z  2025-03-14T05:51:52.2990436Z  2025-03-14T05:51:52.2990976Z [14,848 / 15,235] 48 actions, 47 running 2025-03-14T05:51:52.2991790Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2025-03-14T05:51:52.2992676Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T05:51:52.2993582Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T05:51:52.2994390Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T05:51:52.2995104Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2025-03-14T05:51:52.2996133Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local 2025-03-14T05:51:52.2996813Z @llvm-project//mlir:VectorToLLVM; 22s local 2025-03-14T05:51:52.2997398Z @stablehlo//:linalg_passes; 20s local ... 2025-03-14T05:51:52.5333407Z 2025-03-14T05:51:52.5334171Z  2025-03-14T05:51:52.5334605Z  2025-03-14T05:51:52.5334970Z  2025-03-14T05:51:52.5335341Z  2025-03-14T05:51:52.5335723Z  2025-03-14T05:51:52.5336128Z  2025-03-14T05:51:52.5336502Z  2025-03-14T05:51:52.5336869Z  2025-03-14T05:51:52.5337656Z [14,849 / 15,235] 48 actions, 47 running 2025-03-14T05:51:52.5338469Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2025-03-14T05:51:52.5339358Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T05:51:52.5340234Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T05:51:52.5341050Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T05:51:52.5341800Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T05:51:52.5342531Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T05:51:52.5343198Z @llvm-project//mlir:VectorToLLVM; 23s local 2025-03-14T05:51:52.5343793Z @stablehlo//:linalg_passes; 20s local ... 2025-03-14T05:51:52.7465992Z 2025-03-14T05:51:52.7466786Z  2025-03-14T05:51:52.7467225Z  2025-03-14T05:51:52.7467812Z  2025-03-14T05:51:52.7468187Z  2025-03-14T05:51:52.7468540Z  2025-03-14T05:51:52.7468900Z  2025-03-14T05:51:52.7469275Z  2025-03-14T05:51:52.7469627Z  2025-03-14T05:51:52.7470158Z [14,852 / 15,235] 48 actions running 2025-03-14T05:51:52.7470925Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2025-03-14T05:51:52.7471797Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T05:51:52.7472672Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T05:51:52.7473482Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T05:51:52.7474221Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T05:51:52.7474970Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T05:51:52.7475645Z @llvm-project//mlir:VectorToLLVM; 23s local 2025-03-14T05:51:52.7476201Z @stablehlo//:linalg_passes; 20s local ... 2025-03-14T05:51:53.1471335Z 2025-03-14T05:51:53.1472179Z  2025-03-14T05:51:53.1472610Z  2025-03-14T05:51:53.1472970Z  2025-03-14T05:51:53.1473328Z  2025-03-14T05:51:53.1473724Z  2025-03-14T05:51:53.1474099Z  2025-03-14T05:51:53.1474707Z  2025-03-14T05:51:53.1475056Z  2025-03-14T05:51:53.1475561Z [14,853 / 15,235] 47 actions running 2025-03-14T05:51:53.1476345Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2025-03-14T05:51:53.1477267Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T05:51:53.1478202Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T05:51:53.1479020Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T05:51:53.1479757Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T05:51:53.1480491Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T05:51:53.1481110Z @llvm-project//mlir:VectorToLLVM; 23s local 2025-03-14T05:51:53.1481706Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T05:51:53.3475119Z 2025-03-14T05:51:53.3475931Z  2025-03-14T05:51:53.3476386Z  2025-03-14T05:51:53.3476752Z  2025-03-14T05:51:53.3477145Z  2025-03-14T05:51:53.3477494Z  2025-03-14T05:51:53.3477859Z  2025-03-14T05:51:53.3478217Z  2025-03-14T05:51:53.3478582Z  2025-03-14T05:51:53.3479121Z [14,855 / 15,235] 48 actions running 2025-03-14T05:51:53.3479879Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2025-03-14T05:51:53.3480742Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T05:51:53.3481849Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T05:51:53.3482619Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T05:51:53.3483304Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T05:51:53.3483989Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T05:51:53.3484800Z @llvm-project//mlir:VectorToLLVM; 23s local 2025-03-14T05:51:53.3485402Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T05:51:53.6965230Z 2025-03-14T05:51:53.6966281Z  2025-03-14T05:51:53.6966676Z  2025-03-14T05:51:53.6966999Z  2025-03-14T05:51:53.6967320Z  2025-03-14T05:51:53.6967635Z  2025-03-14T05:51:53.6967942Z  2025-03-14T05:51:53.6968251Z  2025-03-14T05:51:53.6968560Z  2025-03-14T05:51:53.6969041Z [14,857 / 15,235] 48 actions, 47 running 2025-03-14T05:51:53.6969713Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T05:51:53.6970500Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T05:51:53.6971247Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T05:51:53.6971931Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T05:51:53.6972561Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T05:51:53.6973514Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2025-03-14T05:51:53.6974115Z @llvm-project//mlir:VectorToLLVM; 24s local 2025-03-14T05:51:53.6974648Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T05:51:53.9481292Z 2025-03-14T05:51:53.9482086Z  2025-03-14T05:51:53.9482478Z  2025-03-14T05:51:53.9482798Z  2025-03-14T05:51:53.9483095Z  2025-03-14T05:51:53.9483412Z  2025-03-14T05:51:53.9483716Z  2025-03-14T05:51:53.9484014Z  2025-03-14T05:51:53.9484317Z  2025-03-14T05:51:53.9484907Z [14,858 / 15,235] 48 actions running 2025-03-14T05:51:53.9485628Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T05:51:53.9486384Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T05:51:53.9487125Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T05:51:53.9487801Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T05:51:53.9488420Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T05:51:53.9489010Z @llvm-project//mlir:VectorToLLVM; 24s local 2025-03-14T05:51:53.9489505Z @stablehlo//:linalg_passes; 21s local 2025-03-14T05:51:53.9490236Z @stablehlo//:linalg_passes; 20s local ... 2025-03-14T05:51:54.1483202Z 2025-03-14T05:51:54.1484051Z  2025-03-14T05:51:54.1484534Z  2025-03-14T05:51:54.1485163Z  2025-03-14T05:51:54.1485527Z  2025-03-14T05:51:54.1485887Z  2025-03-14T05:51:54.1486234Z  2025-03-14T05:51:54.1486597Z  2025-03-14T05:51:54.1486969Z  2025-03-14T05:51:54.1487565Z [14,859 / 15,235] 48 actions running 2025-03-14T05:51:54.1488409Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T05:51:54.1489319Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T05:51:54.1490264Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T05:51:54.1491111Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T05:51:54.1491899Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T05:51:54.1492666Z @llvm-project//mlir:VectorToLLVM; 24s local 2025-03-14T05:51:54.1493312Z @stablehlo//:linalg_passes; 22s local 2025-03-14T05:51:54.1493895Z @stablehlo//:linalg_passes; 20s local ... 2025-03-14T05:51:54.3693175Z 2025-03-14T05:51:54.3693957Z  2025-03-14T05:51:54.3694388Z  2025-03-14T05:51:54.3694752Z  2025-03-14T05:51:54.3695115Z  2025-03-14T05:51:54.3695456Z  2025-03-14T05:51:54.3695812Z  2025-03-14T05:51:54.3696407Z  2025-03-14T05:51:54.3696777Z  2025-03-14T05:51:54.3697326Z [14,861 / 15,235] 48 actions, 47 running 2025-03-14T05:51:54.3698098Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T05:51:54.3698942Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T05:51:54.3699843Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T05:51:54.3700690Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T05:51:54.3701696Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T05:51:54.3702416Z @llvm-project//mlir:VectorToLLVM; 24s local 2025-03-14T05:51:54.3703043Z @stablehlo//:linalg_passes; 22s local 2025-03-14T05:51:54.3703611Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T05:51:54.7324498Z 2025-03-14T05:51:54.7325579Z  2025-03-14T05:51:54.7326111Z  2025-03-14T05:51:54.7326521Z  2025-03-14T05:51:54.7326928Z  2025-03-14T05:51:54.7327358Z  2025-03-14T05:51:54.7327745Z  2025-03-14T05:51:54.7328200Z  2025-03-14T05:51:54.7328555Z  2025-03-14T05:51:54.7329139Z [14,862 / 15,235] 48 actions, 47 running 2025-03-14T05:51:54.7329991Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T05:51:54.7330952Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T05:51:54.7332168Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T05:51:54.7333024Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T05:51:54.7333805Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T05:51:54.7334545Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T05:51:54.7335294Z @stablehlo//:linalg_passes; 22s local 2025-03-14T05:51:54.7335930Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T05:51:54.9488441Z 2025-03-14T05:51:54.9489298Z  2025-03-14T05:51:54.9489799Z  2025-03-14T05:51:54.9490212Z  2025-03-14T05:51:54.9490610Z  2025-03-14T05:51:54.9490986Z  2025-03-14T05:51:54.9491378Z  2025-03-14T05:51:54.9491780Z  2025-03-14T05:51:54.9492166Z  2025-03-14T05:51:54.9492745Z [14,863 / 15,235] 48 actions running 2025-03-14T05:51:54.9493625Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T05:51:54.9494572Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T05:51:54.9495504Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T05:51:54.9496582Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T05:51:54.9497386Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T05:51:54.9498145Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T05:51:54.9499383Z @stablehlo//:linalg_passes; 22s local 2025-03-14T05:51:54.9500176Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T05:51:55.1493107Z 2025-03-14T05:51:55.1494095Z  2025-03-14T05:51:55.1494500Z  2025-03-14T05:51:55.1494908Z  2025-03-14T05:51:55.1495302Z  2025-03-14T05:51:55.1495671Z  2025-03-14T05:51:55.1496082Z  2025-03-14T05:51:55.1496572Z  2025-03-14T05:51:55.1496969Z  2025-03-14T05:51:55.1497552Z [14,864 / 15,235] 48 actions running 2025-03-14T05:51:55.1498422Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T05:51:55.1499416Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T05:51:55.1500468Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T05:51:55.1501472Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T05:51:55.1502308Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T05:51:55.1503104Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T05:51:55.1503804Z @stablehlo//:linalg_passes; 23s local 2025-03-14T05:51:55.1504749Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T05:51:55.5498223Z 2025-03-14T05:51:55.5499095Z  2025-03-14T05:51:55.5499545Z  2025-03-14T05:51:55.5499954Z  2025-03-14T05:51:55.5500366Z  2025-03-14T05:51:55.5500768Z  2025-03-14T05:51:55.5501143Z  2025-03-14T05:51:55.5501541Z  2025-03-14T05:51:55.5501926Z  2025-03-14T05:51:55.5502550Z [14,865 / 15,235] 48 actions running 2025-03-14T05:51:55.5503770Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T05:51:55.5504868Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T05:51:55.5505856Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T05:51:55.5506745Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T05:51:55.5507579Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T05:51:55.5508333Z @llvm-project//mlir:VectorToLLVM; 26s local 2025-03-14T05:51:55.5508959Z @stablehlo//:linalg_passes; 23s local 2025-03-14T05:51:55.5509604Z @stablehlo//:linalg_passes; 22s local ... 2025-03-14T05:51:55.7501785Z 2025-03-14T05:51:55.7502591Z  2025-03-14T05:51:55.7503084Z  2025-03-14T05:51:55.7503479Z  2025-03-14T05:51:55.7503895Z  2025-03-14T05:51:55.7504309Z  2025-03-14T05:51:55.7504693Z  2025-03-14T05:51:55.7505355Z  2025-03-14T05:51:55.7505751Z  2025-03-14T05:51:55.7506287Z [14,866 / 15,235] 48 actions running 2025-03-14T05:51:55.7507168Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T05:51:55.7508160Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T05:51:55.7509143Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T05:51:55.7510063Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T05:51:55.7510906Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T05:51:55.7511691Z @llvm-project//mlir:VectorToLLVM; 26s local 2025-03-14T05:51:55.7512324Z @stablehlo//:linalg_passes; 23s local 2025-03-14T05:51:55.7512882Z @stablehlo//:linalg_passes; 22s local ... 2025-03-14T05:51:56.1476165Z 2025-03-14T05:51:56.1477059Z  2025-03-14T05:51:56.1477602Z  2025-03-14T05:51:56.1478033Z  2025-03-14T05:51:56.1478442Z  2025-03-14T05:51:56.1478892Z  2025-03-14T05:51:56.1479301Z  2025-03-14T05:51:56.1479706Z  2025-03-14T05:51:56.1480108Z  2025-03-14T05:51:56.1480681Z [14,867 / 15,235] 48 actions, 47 running 2025-03-14T05:51:56.1481759Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T05:51:56.1482675Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T05:51:56.1483609Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T05:51:56.1484439Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T05:51:56.1485348Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T05:51:56.1486101Z @llvm-project//mlir:VectorToLLVM; 26s local 2025-03-14T05:51:56.1486799Z @stablehlo//:linalg_passes; 24s local 2025-03-14T05:51:56.1487305Z @stablehlo//:linalg_passes; 22s local ... 2025-03-14T05:51:56.3507039Z 2025-03-14T05:51:56.3507843Z  2025-03-14T05:51:56.3508316Z  2025-03-14T05:51:56.3508749Z  2025-03-14T05:51:56.3509156Z  2025-03-14T05:51:56.3509555Z  2025-03-14T05:51:56.3509940Z  2025-03-14T05:51:56.3510350Z  2025-03-14T05:51:56.3510733Z  2025-03-14T05:51:56.3511344Z [14,867 / 15,235] 48 actions running 2025-03-14T05:51:56.3512225Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T05:51:56.3513249Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T05:51:56.3514280Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T05:51:56.3515211Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T05:51:56.3516247Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T05:51:56.3517076Z @llvm-project//mlir:VectorToLLVM; 26s local 2025-03-14T05:51:56.3517762Z @stablehlo//:linalg_passes; 24s local 2025-03-14T05:51:56.3518410Z @stablehlo//:linalg_passes; 23s local ... 2025-03-14T05:51:56.6825698Z 2025-03-14T05:51:56.6826591Z  2025-03-14T05:51:56.6827146Z  2025-03-14T05:51:56.6827564Z  2025-03-14T05:51:56.6827982Z  2025-03-14T05:51:56.6828657Z  2025-03-14T05:51:56.6829100Z  2025-03-14T05:51:56.6829528Z  2025-03-14T05:51:56.6830007Z  2025-03-14T05:51:56.6830618Z [14,868 / 15,235] 48 actions, 47 running 2025-03-14T05:51:56.6831649Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T05:51:56.6832674Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T05:51:56.6833691Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T05:51:56.6834623Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T05:51:56.6835481Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T05:51:56.6836282Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T05:51:56.6836972Z @stablehlo//:linalg_passes; 24s local 2025-03-14T05:51:56.6837613Z @stablehlo//:linalg_passes; 23s local ... 2025-03-14T05:51:56.9511995Z 2025-03-14T05:51:56.9512844Z  2025-03-14T05:51:56.9513258Z  2025-03-14T05:51:56.9513634Z  2025-03-14T05:51:56.9513996Z  2025-03-14T05:51:56.9514362Z  2025-03-14T05:51:56.9514718Z  2025-03-14T05:51:56.9515079Z  2025-03-14T05:51:56.9515428Z  2025-03-14T05:51:56.9515943Z [14,868 / 15,235] 48 actions running 2025-03-14T05:51:56.9516737Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T05:51:56.9517647Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T05:51:56.9518585Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T05:51:56.9519447Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T05:51:56.9520188Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T05:51:56.9520908Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T05:51:56.9521519Z @stablehlo//:linalg_passes; 24s local 2025-03-14T05:51:56.9522094Z @stablehlo//:linalg_passes; 23s local ... 2025-03-14T05:51:57.2427984Z 2025-03-14T05:51:57.2428835Z  2025-03-14T05:51:57.2429260Z  2025-03-14T05:51:57.2430124Z  2025-03-14T05:51:57.2430492Z  2025-03-14T05:51:57.2430959Z  2025-03-14T05:51:57.2431455Z  2025-03-14T05:51:57.2431925Z  2025-03-14T05:51:57.2432380Z  2025-03-14T05:51:57.2433046Z [14,869 / 15,235] 48 actions, 47 running 2025-03-14T05:51:57.2433915Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T05:51:57.2434897Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T05:51:57.2435879Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T05:51:57.2436772Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T05:51:57.2437603Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T05:51:57.2438396Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T05:51:57.2439111Z @stablehlo//:linalg_passes; 25s local 2025-03-14T05:51:57.2439754Z @stablehlo//:linalg_passes; 24s local ... 2025-03-14T05:51:57.4774223Z 2025-03-14T05:51:57.4775106Z  2025-03-14T05:51:57.4775495Z  2025-03-14T05:51:57.4775808Z  2025-03-14T05:51:57.4776123Z  2025-03-14T05:51:57.4776436Z  2025-03-14T05:51:57.4776740Z  2025-03-14T05:51:57.4777030Z  2025-03-14T05:51:57.4777340Z  2025-03-14T05:51:57.4777813Z [14,873 / 15,235] 48 actions, 47 running 2025-03-14T05:51:57.4778754Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T05:51:57.4779515Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T05:51:57.4780271Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T05:51:57.4780956Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T05:51:57.4781566Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T05:51:57.4782165Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T05:51:57.4782782Z @stablehlo//:linalg_passes; 25s local 2025-03-14T05:51:57.4783260Z @stablehlo//:linalg_passes; 24s local ... 2025-03-14T05:51:57.7520355Z 2025-03-14T05:51:57.7521249Z  2025-03-14T05:51:57.7521637Z  2025-03-14T05:51:57.7522004Z  2025-03-14T05:51:57.7522446Z  2025-03-14T05:51:57.7522972Z  2025-03-14T05:51:57.7523417Z  2025-03-14T05:51:57.7523780Z  2025-03-14T05:51:57.7524146Z  2025-03-14T05:51:57.7524796Z [14,873 / 15,235] 48 actions running 2025-03-14T05:51:57.7525674Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T05:51:57.7526659Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T05:51:57.7527625Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T05:51:57.7528505Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T05:51:57.7529571Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T05:51:57.7530337Z @llvm-project//mlir:VectorToLLVM; 28s local 2025-03-14T05:51:57.7531016Z @stablehlo//:linalg_passes; 25s local 2025-03-14T05:51:57.7531647Z @stablehlo//:linalg_passes; 24s local ... 2025-03-14T05:51:58.0517597Z 2025-03-14T05:51:58.0518412Z  2025-03-14T05:51:58.0518894Z  2025-03-14T05:51:58.0519313Z  2025-03-14T05:51:58.0519723Z  2025-03-14T05:51:58.0520118Z  2025-03-14T05:51:58.0520521Z  2025-03-14T05:51:58.0520927Z  2025-03-14T05:51:58.0521294Z  2025-03-14T05:51:58.0521934Z [14,874 / 15,235] 48 actions, 47 running 2025-03-14T05:51:58.0522855Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T05:51:58.0523879Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T05:51:58.0525014Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T05:51:58.0525948Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T05:51:58.0526770Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T05:51:58.0527501Z @stablehlo//:linalg_passes; 26s local 2025-03-14T05:51:58.0528361Z @stablehlo//:linalg_passes; 24s local 2025-03-14T05:51:58.0529186Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 22s local ... 2025-03-14T05:51:58.3526406Z 2025-03-14T05:51:58.3527221Z  2025-03-14T05:51:58.3527622Z  2025-03-14T05:51:58.3527963Z  2025-03-14T05:51:58.3528330Z  2025-03-14T05:51:58.3528722Z  2025-03-14T05:51:58.3529127Z  2025-03-14T05:51:58.3529525Z  2025-03-14T05:51:58.3529883Z  2025-03-14T05:51:58.3530363Z [14,874 / 15,235] 48 actions running 2025-03-14T05:51:58.3531145Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T05:51:58.3532030Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T05:51:58.3532865Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T05:51:58.3533741Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2025-03-14T05:51:58.3534468Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T05:51:58.3535067Z @stablehlo//:linalg_passes; 26s local 2025-03-14T05:51:58.3535629Z @stablehlo//:linalg_passes; 25s local 2025-03-14T05:51:58.3536447Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local ... 2025-03-14T05:51:58.7531950Z 2025-03-14T05:51:58.7532812Z  2025-03-14T05:51:58.7533292Z  2025-03-14T05:51:58.7533694Z  2025-03-14T05:51:58.7534347Z  2025-03-14T05:51:58.7534784Z  2025-03-14T05:51:58.7535182Z  2025-03-14T05:51:58.7535581Z  2025-03-14T05:51:58.7535988Z  2025-03-14T05:51:58.7536553Z [14,875 / 15,235] 48 actions running 2025-03-14T05:51:58.7537437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T05:51:58.7538490Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T05:51:58.7539604Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T05:51:58.7540595Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2025-03-14T05:51:58.7541427Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2025-03-14T05:51:58.7542201Z @stablehlo//:linalg_passes; 26s local 2025-03-14T05:51:58.7542806Z @stablehlo//:linalg_passes; 25s local 2025-03-14T05:51:58.7543703Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local ... 2025-03-14T05:51:59.5362180Z 2025-03-14T05:51:59.5363007Z  2025-03-14T05:51:59.5363516Z  2025-03-14T05:51:59.5363935Z  2025-03-14T05:51:59.5364348Z  2025-03-14T05:51:59.5364887Z  2025-03-14T05:51:59.5365489Z  2025-03-14T05:51:59.5365841Z  2025-03-14T05:51:59.5366194Z  2025-03-14T05:51:59.5366856Z [14,876 / 15,235] 48 actions, 47 running 2025-03-14T05:51:59.5367955Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T05:51:59.5368939Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T05:51:59.5369963Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T05:51:59.5370897Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2025-03-14T05:51:59.5371747Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T05:51:59.5372486Z @stablehlo//:linalg_passes; 27s local 2025-03-14T05:51:59.5373100Z @stablehlo//:linalg_passes; 26s local 2025-03-14T05:51:59.5374040Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local ... 2025-03-14T05:51:59.7488549Z 2025-03-14T05:51:59.7489418Z  2025-03-14T05:51:59.7489946Z  2025-03-14T05:51:59.7490384Z  2025-03-14T05:51:59.7490932Z  2025-03-14T05:51:59.7491463Z  2025-03-14T05:51:59.7491999Z  2025-03-14T05:51:59.7492539Z  2025-03-14T05:51:59.7493116Z  2025-03-14T05:51:59.7493918Z [14,877 / 15,235] 48 actions, 47 running 2025-03-14T05:51:59.7494980Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T05:51:59.7496612Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T05:51:59.7497974Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T05:51:59.7499214Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2025-03-14T05:51:59.7500325Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T05:51:59.7501333Z @stablehlo//:linalg_passes; 27s local 2025-03-14T05:51:59.7502182Z @stablehlo//:linalg_passes; 26s local 2025-03-14T05:51:59.7503413Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local ... 2025-03-14T05:51:59.9538273Z 2025-03-14T05:51:59.9539209Z  2025-03-14T05:51:59.9539638Z  2025-03-14T05:51:59.9539994Z  2025-03-14T05:51:59.9540341Z  2025-03-14T05:51:59.9540716Z  2025-03-14T05:51:59.9541070Z  2025-03-14T05:51:59.9541427Z  2025-03-14T05:51:59.9541776Z  2025-03-14T05:51:59.9542297Z [14,877 / 15,235] 48 actions running 2025-03-14T05:51:59.9543074Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T05:51:59.9543934Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T05:51:59.9544784Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T05:51:59.9545582Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2025-03-14T05:51:59.9546517Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T05:51:59.9547192Z @stablehlo//:linalg_passes; 27s local 2025-03-14T05:51:59.9547748Z @stablehlo//:linalg_passes; 26s local 2025-03-14T05:51:59.9548527Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local ... 2025-03-14T05:52:00.4844553Z 2025-03-14T05:52:00.4845502Z  2025-03-14T05:52:00.4845914Z  2025-03-14T05:52:00.4846287Z  2025-03-14T05:52:00.4846630Z  2025-03-14T05:52:00.4846962Z  2025-03-14T05:52:00.4847291Z  2025-03-14T05:52:00.4847828Z  2025-03-14T05:52:00.4848179Z  2025-03-14T05:52:00.4848688Z [14,878 / 15,235] 48 actions, 47 running 2025-03-14T05:52:00.4849417Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T05:52:00.4850237Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T05:52:00.4851050Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T05:52:00.4851798Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2025-03-14T05:52:00.4852452Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T05:52:00.4853025Z @stablehlo//:linalg_passes; 28s local 2025-03-14T05:52:00.4853516Z @stablehlo//:linalg_passes; 27s local 2025-03-14T05:52:00.4854387Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local ... 2025-03-14T05:52:00.7545962Z 2025-03-14T05:52:00.7546843Z  2025-03-14T05:52:00.7547285Z  2025-03-14T05:52:00.7547650Z  2025-03-14T05:52:00.7548064Z  2025-03-14T05:52:00.7548435Z  2025-03-14T05:52:00.7548817Z  2025-03-14T05:52:00.7549185Z  2025-03-14T05:52:00.7549555Z  2025-03-14T05:52:00.7550104Z [14,878 / 15,235] 48 actions running 2025-03-14T05:52:00.7550905Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T05:52:00.7551771Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T05:52:00.7552654Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T05:52:00.7553475Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2025-03-14T05:52:00.7554231Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2025-03-14T05:52:00.7554962Z @stablehlo//:linalg_passes; 28s local 2025-03-14T05:52:00.7555544Z @stablehlo//:linalg_passes; 27s local 2025-03-14T05:52:00.7556387Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local ... 2025-03-14T05:52:01.0323457Z 2025-03-14T05:52:01.0324261Z  2025-03-14T05:52:01.0324766Z  2025-03-14T05:52:01.0325324Z  2025-03-14T05:52:01.0325616Z  2025-03-14T05:52:01.0325925Z  2025-03-14T05:52:01.0326232Z  2025-03-14T05:52:01.0326535Z  2025-03-14T05:52:01.0326841Z  2025-03-14T05:52:01.0327301Z [14,879 / 15,235] 48 actions, 47 running 2025-03-14T05:52:01.0327971Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T05:52:01.0328738Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T05:52:01.0329478Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T05:52:01.0330159Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2025-03-14T05:52:01.0330778Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2025-03-14T05:52:01.0331336Z @stablehlo//:linalg_passes; 29s local 2025-03-14T05:52:01.0331816Z @stablehlo//:linalg_passes; 27s local 2025-03-14T05:52:01.0332500Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local ... 2025-03-14T05:52:01.3551929Z 2025-03-14T05:52:01.3552783Z  2025-03-14T05:52:01.3553204Z  2025-03-14T05:52:01.3553609Z  2025-03-14T05:52:01.3554019Z  2025-03-14T05:52:01.3554419Z  2025-03-14T05:52:01.3554808Z  2025-03-14T05:52:01.3555188Z  2025-03-14T05:52:01.3555567Z  2025-03-14T05:52:01.3556126Z [14,880 / 15,235] 48 actions running 2025-03-14T05:52:01.3557257Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T05:52:01.3558258Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T05:52:01.3559194Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T05:52:01.3560044Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T05:52:01.3560833Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2025-03-14T05:52:01.3561581Z @stablehlo//:linalg_passes; 29s local 2025-03-14T05:52:01.3562368Z @stablehlo//:linalg_passes; 28s local 2025-03-14T05:52:01.7557685Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local ... 2025-03-14T05:52:01.7558492Z 2025-03-14T05:52:01.7558923Z  2025-03-14T05:52:01.7559330Z  2025-03-14T05:52:01.7559718Z  2025-03-14T05:52:01.7560129Z  2025-03-14T05:52:01.7560540Z  2025-03-14T05:52:01.7560946Z  2025-03-14T05:52:01.7561352Z  2025-03-14T05:52:01.7561743Z  2025-03-14T05:52:01.7562331Z [14,881 / 15,235] 48 actions running 2025-03-14T05:52:01.7563162Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T05:52:01.7564192Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T05:52:01.7565601Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T05:52:01.7566758Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T05:52:01.7567568Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T05:52:01.7568410Z @stablehlo//:linalg_passes; 29s local 2025-03-14T05:52:01.7569026Z @stablehlo//:linalg_passes; 28s local 2025-03-14T05:52:01.7569909Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local ... 2025-03-14T05:52:01.9561106Z 2025-03-14T05:52:01.9561903Z  2025-03-14T05:52:01.9562389Z  2025-03-14T05:52:01.9562781Z  2025-03-14T05:52:01.9563167Z  2025-03-14T05:52:01.9563561Z  2025-03-14T05:52:01.9563944Z  2025-03-14T05:52:01.9564362Z  2025-03-14T05:52:01.9564900Z  2025-03-14T05:52:01.9565649Z [14,882 / 15,235] 48 actions running 2025-03-14T05:52:01.9566504Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T05:52:01.9567443Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T05:52:01.9568425Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T05:52:01.9569283Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T05:52:01.9570112Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T05:52:01.9571104Z @stablehlo//:linalg_passes; 29s local 2025-03-14T05:52:01.9571698Z @stablehlo//:linalg_passes; 28s local 2025-03-14T05:52:01.9572584Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local ... 2025-03-14T05:52:02.7331418Z 2025-03-14T05:52:02.7332281Z  2025-03-14T05:52:02.7332771Z  2025-03-14T05:52:02.7333164Z  2025-03-14T05:52:02.7333606Z  2025-03-14T05:52:02.7333993Z  2025-03-14T05:52:02.7334385Z  2025-03-14T05:52:02.7334771Z  2025-03-14T05:52:02.7335152Z  2025-03-14T05:52:02.7335769Z [14,883 / 15,235] 48 actions, 47 running 2025-03-14T05:52:02.7336611Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T05:52:02.7337606Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T05:52:02.7338628Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2025-03-14T05:52:02.7339519Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2025-03-14T05:52:02.7340323Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T05:52:02.7341041Z @stablehlo//:linalg_passes; 30s local 2025-03-14T05:52:02.7341615Z @stablehlo//:linalg_passes; 29s local 2025-03-14T05:52:02.7342431Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local ... 2025-03-14T05:52:02.9569303Z 2025-03-14T05:52:02.9570110Z  2025-03-14T05:52:02.9570867Z  2025-03-14T05:52:02.9571349Z  2025-03-14T05:52:02.9571797Z  2025-03-14T05:52:02.9572221Z  2025-03-14T05:52:02.9572701Z  2025-03-14T05:52:02.9573089Z  2025-03-14T05:52:02.9573488Z  2025-03-14T05:52:02.9574035Z [14,883 / 15,235] 48 actions running 2025-03-14T05:52:02.9574920Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T05:52:02.9576112Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T05:52:02.9577098Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2025-03-14T05:52:02.9577963Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2025-03-14T05:52:02.9578744Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T05:52:02.9579432Z @stablehlo//:linalg_passes; 30s local 2025-03-14T05:52:02.9579979Z @stablehlo//:linalg_passes; 29s local 2025-03-14T05:52:02.9580841Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local ... 2025-03-14T05:52:03.2072634Z 2025-03-14T05:52:03.2073462Z  2025-03-14T05:52:03.2073984Z  2025-03-14T05:52:03.2074377Z  2025-03-14T05:52:03.2074757Z  2025-03-14T05:52:03.2075148Z  2025-03-14T05:52:03.2075584Z  2025-03-14T05:52:03.2075995Z  2025-03-14T05:52:03.2076392Z  2025-03-14T05:52:03.2077321Z [14,884 / 15,235] 48 actions, 47 running 2025-03-14T05:52:03.2078215Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T05:52:03.2079224Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T05:52:03.2080217Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T05:52:03.2081070Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2025-03-14T05:52:03.2081794Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T05:52:03.2082506Z @stablehlo//:linalg_passes; 31s local 2025-03-14T05:52:03.2083113Z @stablehlo//:linalg_passes; 30s local 2025-03-14T05:52:03.2083981Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local ... 2025-03-14T05:52:03.5574540Z 2025-03-14T05:52:03.5575394Z  2025-03-14T05:52:03.5575895Z  2025-03-14T05:52:03.5576337Z  2025-03-14T05:52:03.5576726Z  2025-03-14T05:52:03.5577134Z  2025-03-14T05:52:03.5577561Z  2025-03-14T05:52:03.5577965Z  2025-03-14T05:52:03.5578356Z  2025-03-14T05:52:03.5578939Z [14,884 / 15,235] 48 actions running 2025-03-14T05:52:03.5579886Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T05:52:03.5581196Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T05:52:03.5582218Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T05:52:03.5583174Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2025-03-14T05:52:03.5583991Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2025-03-14T05:52:03.5584871Z @stablehlo//:linalg_passes; 31s local 2025-03-14T05:52:03.5585425Z @stablehlo//:linalg_passes; 30s local 2025-03-14T05:52:03.5586153Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local ... 2025-03-14T05:52:03.9578944Z 2025-03-14T05:52:03.9579812Z  2025-03-14T05:52:03.9580311Z  2025-03-14T05:52:03.9580711Z  2025-03-14T05:52:03.9581133Z  2025-03-14T05:52:03.9581564Z  2025-03-14T05:52:03.9582003Z  2025-03-14T05:52:03.9582566Z  2025-03-14T05:52:03.9582969Z  2025-03-14T05:52:03.9583535Z [14,885 / 15,235] 48 actions running 2025-03-14T05:52:03.9584363Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T05:52:03.9585339Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T05:52:03.9586767Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T05:52:03.9587841Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2025-03-14T05:52:03.9589146Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2025-03-14T05:52:03.9590095Z @stablehlo//:linalg_passes; 31s local 2025-03-14T05:52:03.9590823Z @stablehlo//:linalg_passes; 30s local 2025-03-14T05:52:03.9591854Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local ... 2025-03-14T05:52:04.9200591Z 2025-03-14T05:52:04.9201489Z  2025-03-14T05:52:04.9201952Z  2025-03-14T05:52:04.9202336Z  2025-03-14T05:52:04.9202791Z  2025-03-14T05:52:04.9203524Z  2025-03-14T05:52:04.9203967Z  2025-03-14T05:52:04.9204352Z  2025-03-14T05:52:04.9204881Z  2025-03-14T05:52:04.9205486Z [14,886 / 15,235] 48 actions, 47 running 2025-03-14T05:52:04.9206405Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T05:52:04.9207426Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T05:52:04.9208395Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2025-03-14T05:52:04.9209343Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2025-03-14T05:52:04.9210205Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T05:52:04.9210965Z @stablehlo//:linalg_passes; 32s local 2025-03-14T05:52:04.9211604Z @stablehlo//:linalg_passes; 31s local 2025-03-14T05:52:04.9212510Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local ... 2025-03-14T05:52:05.1589239Z 2025-03-14T05:52:05.1590081Z  2025-03-14T05:52:05.1590585Z  2025-03-14T05:52:05.1592903Z  2025-03-14T05:52:05.1595982Z  2025-03-14T05:52:05.1598955Z  2025-03-14T05:52:05.1602008Z  2025-03-14T05:52:05.1602887Z  2025-03-14T05:52:05.1603871Z  2025-03-14T05:52:05.1604504Z [14,887 / 15,235] 48 actions running 2025-03-14T05:52:05.1605557Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T05:52:05.1606632Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T05:52:05.1607676Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T05:52:05.1608623Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2025-03-14T05:52:05.1609503Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T05:52:05.1610287Z @stablehlo//:linalg_passes; 33s local 2025-03-14T05:52:05.1610936Z @stablehlo//:linalg_passes; 31s local 2025-03-14T05:52:05.1611905Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local ... 2025-03-14T05:52:05.3593357Z 2025-03-14T05:52:05.3595382Z  2025-03-14T05:52:05.3595876Z  2025-03-14T05:52:05.3596274Z  2025-03-14T05:52:05.3596672Z  2025-03-14T05:52:05.3597078Z  2025-03-14T05:52:05.3597471Z  2025-03-14T05:52:05.3597893Z  2025-03-14T05:52:05.3598305Z  2025-03-14T05:52:05.3598891Z [14,888 / 15,235] 48 actions running 2025-03-14T05:52:05.3599851Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T05:52:05.3600916Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T05:52:05.3601940Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T05:52:05.3602874Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T05:52:05.3603729Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T05:52:05.3604539Z @stablehlo//:linalg_passes; 33s local 2025-03-14T05:52:05.3605314Z @stablehlo//:linalg_passes; 32s local 2025-03-14T05:52:05.3606243Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local ... 2025-03-14T05:52:05.6364379Z 2025-03-14T05:52:05.6365463Z  2025-03-14T05:52:05.6365997Z  2025-03-14T05:52:05.6366437Z  2025-03-14T05:52:05.6366873Z  2025-03-14T05:52:05.6367302Z  2025-03-14T05:52:05.6367707Z  2025-03-14T05:52:05.6368139Z  2025-03-14T05:52:05.6368553Z  2025-03-14T05:52:05.6369482Z [14,889 / 15,235] 48 actions, 47 running 2025-03-14T05:52:05.6370391Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T05:52:05.6371313Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T05:52:05.6372309Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T05:52:05.6373286Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T05:52:05.6374153Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T05:52:05.6375144Z @stablehlo//:linalg_passes; 33s local 2025-03-14T05:52:05.6375844Z @stablehlo//:linalg_passes; 32s local 2025-03-14T05:52:05.6376793Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local ... 2025-03-14T05:52:05.9598644Z 2025-03-14T05:52:05.9599500Z  2025-03-14T05:52:05.9599977Z  2025-03-14T05:52:05.9600385Z  2025-03-14T05:52:05.9600759Z  2025-03-14T05:52:05.9601155Z  2025-03-14T05:52:05.9601545Z  2025-03-14T05:52:05.9614589Z  2025-03-14T05:52:05.9615430Z  2025-03-14T05:52:05.9615954Z [14,891 / 15,235] 48 actions running 2025-03-14T05:52:05.9616792Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T05:52:05.9617645Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T05:52:05.9618558Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T05:52:05.9619691Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T05:52:05.9620472Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T05:52:05.9621693Z @stablehlo//:linalg_passes; 33s local 2025-03-14T05:52:05.9622474Z @stablehlo//:linalg_passes; 32s local 2025-03-14T05:52:05.9623484Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local ... 2025-03-14T05:52:06.1946050Z 2025-03-14T05:52:06.1947063Z  2025-03-14T05:52:06.1948726Z  2025-03-14T05:52:06.1949224Z  2025-03-14T05:52:06.1949673Z  2025-03-14T05:52:06.1950124Z  2025-03-14T05:52:06.1950572Z  2025-03-14T05:52:06.1951008Z  2025-03-14T05:52:06.1951454Z  2025-03-14T05:52:06.1952064Z [14,892 / 15,235] 48 actions, 47 running 2025-03-14T05:52:06.1952978Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T05:52:06.1954058Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T05:52:06.1955163Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T05:52:06.1956236Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T05:52:06.1957481Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T05:52:06.1958302Z @stablehlo//:linalg_passes; 34s local 2025-03-14T05:52:06.1958975Z @stablehlo//:linalg_passes; 33s local 2025-03-14T05:52:06.1959959Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local ... 2025-03-14T05:52:06.5605772Z 2025-03-14T05:52:06.5606745Z  2025-03-14T05:52:06.5607260Z  2025-03-14T05:52:06.5607705Z  2025-03-14T05:52:06.5608142Z  2025-03-14T05:52:06.5608571Z  2025-03-14T05:52:06.5608989Z  2025-03-14T05:52:06.5609391Z  2025-03-14T05:52:06.5609790Z  2025-03-14T05:52:06.5610362Z [14,892 / 15,235] 48 actions running 2025-03-14T05:52:06.5611263Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T05:52:06.5612304Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T05:52:06.5613286Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T05:52:06.5614178Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T05:52:06.5615005Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T05:52:06.5615774Z @stablehlo//:linalg_passes; 34s local 2025-03-14T05:52:06.5616354Z @stablehlo//:linalg_passes; 33s local 2025-03-14T05:52:06.5617574Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local ... 2025-03-14T05:52:06.8310243Z 2025-03-14T05:52:06.8311050Z  2025-03-14T05:52:06.8311526Z  2025-03-14T05:52:06.8311947Z  2025-03-14T05:52:06.8312371Z  2025-03-14T05:52:06.8312772Z  2025-03-14T05:52:06.8313171Z  2025-03-14T05:52:06.8313529Z  2025-03-14T05:52:06.8313940Z  2025-03-14T05:52:06.8314557Z [14,893 / 15,235] 48 actions, 47 running 2025-03-14T05:52:06.8315475Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2025-03-14T05:52:06.8317123Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T05:52:06.8318359Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T05:52:06.8319416Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T05:52:06.8320349Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T05:52:06.8321189Z @stablehlo//:linalg_passes; 34s local 2025-03-14T05:52:06.8321999Z @stablehlo//:linalg_passes; 33s local 2025-03-14T05:52:06.8323095Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local ... 2025-03-14T05:52:07.1611265Z 2025-03-14T05:52:07.1612142Z  2025-03-14T05:52:07.1612625Z  2025-03-14T05:52:07.1613027Z  2025-03-14T05:52:07.1613448Z  2025-03-14T05:52:07.1613859Z  2025-03-14T05:52:07.1614265Z  2025-03-14T05:52:07.1614946Z  2025-03-14T05:52:07.1615354Z  2025-03-14T05:52:07.1615947Z [14,894 / 15,235] 48 actions running 2025-03-14T05:52:07.1616886Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2025-03-14T05:52:07.1617965Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T05:52:07.1618966Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T05:52:07.1619808Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T05:52:07.1620640Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T05:52:07.1621305Z @stablehlo//:linalg_passes; 35s local 2025-03-14T05:52:07.1621852Z @stablehlo//:linalg_passes; 33s local 2025-03-14T05:52:07.1622661Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local ... 2025-03-14T05:52:07.5257000Z 2025-03-14T05:52:07.5257974Z  2025-03-14T05:52:07.5258432Z  2025-03-14T05:52:07.5258842Z  2025-03-14T05:52:07.5259286Z  2025-03-14T05:52:07.5259672Z  2025-03-14T05:52:07.5260085Z  2025-03-14T05:52:07.5260497Z  2025-03-14T05:52:07.5260883Z  2025-03-14T05:52:07.5261494Z [14,895 / 15,235] 48 actions, 47 running 2025-03-14T05:52:07.5262702Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2025-03-14T05:52:07.5263719Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T05:52:07.5264770Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T05:52:07.5265979Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T05:52:07.5266820Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T05:52:07.5267575Z @stablehlo//:linalg_passes; 35s local 2025-03-14T05:52:07.5268158Z @stablehlo//:linalg_passes; 34s local 2025-03-14T05:52:07.5269071Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local ... 2025-03-14T05:52:07.7615745Z 2025-03-14T05:52:07.7616637Z  2025-03-14T05:52:07.7617109Z  2025-03-14T05:52:07.7617506Z  2025-03-14T05:52:07.7617897Z  2025-03-14T05:52:07.7618294Z  2025-03-14T05:52:07.7618698Z  2025-03-14T05:52:07.7619120Z  2025-03-14T05:52:07.7619533Z  2025-03-14T05:52:07.7620092Z [14,896 / 15,235] 48 actions running 2025-03-14T05:52:07.7620977Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2025-03-14T05:52:07.7621980Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T05:52:07.7623046Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T05:52:07.7624239Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T05:52:07.7625187Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T05:52:07.7625922Z @stablehlo//:linalg_passes; 35s local 2025-03-14T05:52:07.7626816Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2025-03-14T05:52:07.7627758Z @stablehlo//:linalg_passes; 32s local ... 2025-03-14T05:52:08.1609311Z 2025-03-14T05:52:08.1610206Z  2025-03-14T05:52:08.1610653Z  2025-03-14T05:52:08.1611284Z  2025-03-14T05:52:08.1611667Z  2025-03-14T05:52:08.1612037Z  2025-03-14T05:52:08.1612422Z  2025-03-14T05:52:08.1612743Z  2025-03-14T05:52:08.1613094Z  2025-03-14T05:52:08.1613619Z [14,897 / 15,235] 48 actions, 47 running 2025-03-14T05:52:08.1614375Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2025-03-14T05:52:08.1615224Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2025-03-14T05:52:08.1616060Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T05:52:08.1616851Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T05:52:08.1617541Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T05:52:08.1618154Z @stablehlo//:linalg_passes; 36s local 2025-03-14T05:52:08.1618860Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2025-03-14T05:52:08.1619854Z @stablehlo//:linalg_passes; 32s local ... 2025-03-14T05:52:08.3622565Z 2025-03-14T05:52:08.3623340Z  2025-03-14T05:52:08.3623811Z  2025-03-14T05:52:08.3624188Z  2025-03-14T05:52:08.3624551Z  2025-03-14T05:52:08.3624916Z  2025-03-14T05:52:08.3625279Z  2025-03-14T05:52:08.3625631Z  2025-03-14T05:52:08.3625972Z  2025-03-14T05:52:08.3626467Z [14,898 / 15,235] 48 actions running 2025-03-14T05:52:08.3627232Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2025-03-14T05:52:08.3628102Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2025-03-14T05:52:08.3628943Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T05:52:08.3629736Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2025-03-14T05:52:08.3630444Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T05:52:08.3631124Z @stablehlo//:linalg_passes; 36s local 2025-03-14T05:52:08.3631867Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2025-03-14T05:52:08.3632602Z @stablehlo//:linalg_passes; 32s local ... 2025-03-14T05:52:09.3630362Z 2025-03-14T05:52:09.3631178Z  2025-03-14T05:52:09.3631611Z  2025-03-14T05:52:09.3631971Z  2025-03-14T05:52:09.3632394Z  2025-03-14T05:52:09.3632801Z  2025-03-14T05:52:09.3633190Z  2025-03-14T05:52:09.3633593Z  2025-03-14T05:52:09.3634017Z  2025-03-14T05:52:09.3634601Z [14,898 / 15,235] 48 actions running 2025-03-14T05:52:09.3635513Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T05:52:09.3636564Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T05:52:09.3637586Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T05:52:09.3638450Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T05:52:09.3639300Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2025-03-14T05:52:09.3640051Z @stablehlo//:linalg_passes; 37s local 2025-03-14T05:52:09.3641023Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T05:52:09.3641954Z @stablehlo//:linalg_passes; 33s local ... 2025-03-14T05:52:09.7635144Z 2025-03-14T05:52:09.7635944Z  2025-03-14T05:52:09.7636403Z  2025-03-14T05:52:09.7636797Z  2025-03-14T05:52:09.7637194Z  2025-03-14T05:52:09.7637587Z  2025-03-14T05:52:09.7637985Z  2025-03-14T05:52:09.7638366Z  2025-03-14T05:52:09.7639047Z  2025-03-14T05:52:09.7639689Z [14,899 / 15,235] 48 actions running 2025-03-14T05:52:09.7640549Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T05:52:09.7641552Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T05:52:09.7642558Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T05:52:09.7643486Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T05:52:09.7644685Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T05:52:09.7645455Z @stablehlo//:linalg_passes; 37s local 2025-03-14T05:52:09.7646364Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T05:52:09.7647307Z @stablehlo//:linalg_passes; 34s local ... 2025-03-14T05:52:10.0568146Z 2025-03-14T05:52:10.0568981Z  2025-03-14T05:52:10.0569429Z  2025-03-14T05:52:10.0569835Z  2025-03-14T05:52:10.0570226Z  2025-03-14T05:52:10.0570642Z  2025-03-14T05:52:10.0571047Z  2025-03-14T05:52:10.0571458Z  2025-03-14T05:52:10.0571882Z  2025-03-14T05:52:10.0572499Z [14,900 / 15,235] 48 actions, 47 running 2025-03-14T05:52:10.0573768Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T05:52:10.0574945Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T05:52:10.0576378Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T05:52:10.0577446Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T05:52:10.0578453Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T05:52:10.0579330Z @stablehlo//:linalg_passes; 38s local 2025-03-14T05:52:10.0580284Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T05:52:10.0581152Z @stablehlo//:linalg_passes; 34s local ... 2025-03-14T05:52:10.3642265Z 2025-03-14T05:52:10.3643107Z  2025-03-14T05:52:10.3643538Z  2025-03-14T05:52:10.3645807Z  2025-03-14T05:52:10.3648456Z  2025-03-14T05:52:10.3651109Z  2025-03-14T05:52:10.3653737Z  2025-03-14T05:52:10.3656210Z  2025-03-14T05:52:10.3656734Z  2025-03-14T05:52:10.3657390Z [14,901 / 15,235] 48 actions running 2025-03-14T05:52:10.3658294Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T05:52:10.3659467Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T05:52:10.3660431Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T05:52:10.3661743Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T05:52:10.3662551Z @stablehlo//:linalg_passes; 38s local 2025-03-14T05:52:10.3663768Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T05:52:10.3664607Z @stablehlo//:linalg_passes; 34s local 2025-03-14T05:52:10.3665552Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 30s local ... 2025-03-14T05:52:10.5862696Z 2025-03-14T05:52:10.5863547Z  2025-03-14T05:52:10.5864038Z  2025-03-14T05:52:10.5864426Z  2025-03-14T05:52:10.5864806Z  2025-03-14T05:52:10.5865194Z  2025-03-14T05:52:10.5865777Z  2025-03-14T05:52:10.5866148Z  2025-03-14T05:52:10.5866491Z  2025-03-14T05:52:10.5867043Z [14,902 / 15,235] 48 actions, 47 running 2025-03-14T05:52:10.5867930Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T05:52:10.5868889Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T05:52:10.5869861Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T05:52:10.5870747Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T05:52:10.5871464Z @stablehlo//:linalg_passes; 38s local 2025-03-14T05:52:10.5872274Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T05:52:10.5873141Z @stablehlo//:linalg_passes; 34s local 2025-03-14T05:52:10.5874144Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 30s local ... 2025-03-14T05:52:10.8705590Z 2025-03-14T05:52:10.8706433Z  2025-03-14T05:52:10.8706874Z  2025-03-14T05:52:10.8707231Z  2025-03-14T05:52:10.8707566Z  2025-03-14T05:52:10.8707925Z  2025-03-14T05:52:10.8708281Z  2025-03-14T05:52:10.8708665Z  2025-03-14T05:52:10.8709022Z  2025-03-14T05:52:10.8709557Z [14,904 / 15,235] 48 actions, 47 running 2025-03-14T05:52:10.8710580Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T05:52:10.8711479Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T05:52:10.8712354Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T05:52:10.8713193Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T05:52:10.8714074Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T05:52:10.8714885Z @stablehlo//:linalg_passes; 35s local 2025-03-14T05:52:10.8715609Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T05:52:10.8716449Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local ... 2025-03-14T05:52:11.1647960Z 2025-03-14T05:52:11.1648830Z  2025-03-14T05:52:11.1649307Z  2025-03-14T05:52:11.1649983Z  2025-03-14T05:52:11.1650377Z  2025-03-14T05:52:11.1650739Z  2025-03-14T05:52:11.1651131Z  2025-03-14T05:52:11.1651543Z  2025-03-14T05:52:11.1651936Z  2025-03-14T05:52:11.1652605Z [14,906 / 15,235] 48 actions running 2025-03-14T05:52:11.1653427Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T05:52:11.1654426Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T05:52:11.1655428Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T05:52:11.1656339Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T05:52:11.1657305Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T05:52:11.1658172Z @stablehlo//:linalg_passes; 35s local 2025-03-14T05:52:11.1658980Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T05:52:11.1659951Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local ... 2025-03-14T05:52:11.3954955Z 2025-03-14T05:52:11.3955787Z  2025-03-14T05:52:11.3956274Z  2025-03-14T05:52:11.3956646Z  2025-03-14T05:52:11.3957033Z  2025-03-14T05:52:11.3957422Z  2025-03-14T05:52:11.3958084Z  2025-03-14T05:52:11.3958474Z  2025-03-14T05:52:11.3958888Z  2025-03-14T05:52:11.3959496Z [14,907 / 15,235] 48 actions, 47 running 2025-03-14T05:52:11.3960350Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T05:52:11.3961875Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T05:52:11.3963116Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T05:52:11.3964198Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T05:52:11.3965726Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2025-03-14T05:52:11.3966657Z @stablehlo//:linalg_passes; 35s local 2025-03-14T05:52:11.3967525Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T05:52:11.3968509Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local ... 2025-03-14T05:52:11.7654684Z 2025-03-14T05:52:11.7655580Z  2025-03-14T05:52:11.7656101Z  2025-03-14T05:52:11.7656528Z  2025-03-14T05:52:11.7656933Z  2025-03-14T05:52:11.7657338Z  2025-03-14T05:52:11.7657718Z  2025-03-14T05:52:11.7658130Z  2025-03-14T05:52:11.7658558Z  2025-03-14T05:52:11.7659160Z [14,907 / 15,235] 48 actions running 2025-03-14T05:52:11.7660076Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T05:52:11.7661409Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T05:52:11.7662479Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T05:52:11.7663478Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T05:52:11.7664508Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2025-03-14T05:52:11.7665682Z @stablehlo//:linalg_passes; 36s local 2025-03-14T05:52:11.7666731Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T05:52:11.7667736Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local ... 2025-03-14T05:52:12.2505237Z 2025-03-14T05:52:12.2506095Z  2025-03-14T05:52:12.2506605Z  2025-03-14T05:52:12.2507007Z  2025-03-14T05:52:12.2507388Z  2025-03-14T05:52:12.2507849Z  2025-03-14T05:52:12.2508246Z  2025-03-14T05:52:12.2508641Z  2025-03-14T05:52:12.2509027Z  2025-03-14T05:52:12.2509669Z [14,908 / 15,235] 48 actions, 47 running 2025-03-14T05:52:12.2510569Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T05:52:12.2511530Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T05:52:12.2512549Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T05:52:12.2513533Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T05:52:12.2514906Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2025-03-14T05:52:12.2515801Z @stablehlo//:linalg_passes; 36s local 2025-03-14T05:52:12.2516480Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local 2025-03-14T05:52:12.2517450Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local ... 2025-03-14T05:52:12.5662109Z 2025-03-14T05:52:12.5662939Z  2025-03-14T05:52:12.5663480Z  2025-03-14T05:52:12.5663881Z  2025-03-14T05:52:12.5664289Z  2025-03-14T05:52:12.5664701Z  2025-03-14T05:52:12.5665131Z  2025-03-14T05:52:12.5665776Z  2025-03-14T05:52:12.5666171Z  2025-03-14T05:52:12.5666761Z [14,909 / 15,235] 48 actions running 2025-03-14T05:52:12.5667604Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T05:52:12.5668613Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T05:52:12.5669644Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T05:52:12.5670564Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T05:52:12.5671708Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2025-03-14T05:52:12.5672906Z @stablehlo//:linalg_passes; 36s local 2025-03-14T05:52:12.5673609Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2025-03-14T05:52:12.5674618Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local ... 2025-03-14T05:52:12.9237838Z 2025-03-14T05:52:12.9238689Z  2025-03-14T05:52:12.9239172Z  2025-03-14T05:52:12.9239619Z  2025-03-14T05:52:12.9240026Z  2025-03-14T05:52:12.9240417Z  2025-03-14T05:52:12.9240817Z  2025-03-14T05:52:12.9241226Z  2025-03-14T05:52:12.9241634Z  2025-03-14T05:52:12.9242240Z [14,910 / 15,235] 48 actions, 47 running 2025-03-14T05:52:12.9243125Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T05:52:12.9244165Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T05:52:12.9245293Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T05:52:12.9246235Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T05:52:12.9247193Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2025-03-14T05:52:12.9248070Z @stablehlo//:linalg_passes; 37s local 2025-03-14T05:52:12.9248747Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2025-03-14T05:52:12.9249954Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local ... 2025-03-14T05:52:13.1668133Z 2025-03-14T05:52:13.1668953Z  2025-03-14T05:52:13.1669442Z  2025-03-14T05:52:13.1669865Z  2025-03-14T05:52:13.1670272Z  2025-03-14T05:52:13.1670654Z  2025-03-14T05:52:13.1671061Z  2025-03-14T05:52:13.1671481Z  2025-03-14T05:52:13.1671886Z  2025-03-14T05:52:13.1672508Z [14,910 / 15,235] 48 actions running 2025-03-14T05:52:13.1673741Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T05:52:13.1674777Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T05:52:13.1675794Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T05:52:13.1676732Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T05:52:13.1677753Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2025-03-14T05:52:13.1678669Z @stablehlo//:linalg_passes; 37s local 2025-03-14T05:52:13.1679393Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2025-03-14T05:52:13.1680409Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local ... 2025-03-14T05:52:13.3672594Z 2025-03-14T05:52:13.3673434Z  2025-03-14T05:52:13.3673863Z  2025-03-14T05:52:13.3674306Z  2025-03-14T05:52:13.3674729Z  2025-03-14T05:52:13.3675164Z  2025-03-14T05:52:13.3675862Z  2025-03-14T05:52:13.3676235Z  2025-03-14T05:52:13.3676598Z  2025-03-14T05:52:13.3677215Z [14,911 / 15,235] 48 actions running 2025-03-14T05:52:13.3678128Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T05:52:13.3679036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T05:52:13.3680127Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T05:52:13.3681054Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T05:52:13.3681808Z @stablehlo//:linalg_passes; 37s local 2025-03-14T05:52:13.3682523Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local 2025-03-14T05:52:13.3683440Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2025-03-14T05:52:13.3684391Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2025-03-14T05:52:13.6776512Z 2025-03-14T05:52:13.6777315Z  2025-03-14T05:52:13.6777811Z  2025-03-14T05:52:13.6778229Z  2025-03-14T05:52:13.6778603Z  2025-03-14T05:52:13.6778999Z  2025-03-14T05:52:13.6779384Z  2025-03-14T05:52:13.6779788Z  2025-03-14T05:52:13.6780198Z  2025-03-14T05:52:13.6781162Z [14,915 / 15,235] 48 actions, 47 running 2025-03-14T05:52:13.6781954Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T05:52:13.6782901Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T05:52:13.6784006Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T05:52:13.6784991Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T05:52:13.6785783Z @stablehlo//:linalg_passes; 38s local 2025-03-14T05:52:13.6786492Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2025-03-14T05:52:13.6787434Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2025-03-14T05:52:13.6788579Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2025-03-14T05:52:13.9679545Z 2025-03-14T05:52:13.9680312Z  2025-03-14T05:52:13.9680751Z  2025-03-14T05:52:13.9681094Z  2025-03-14T05:52:13.9681464Z  2025-03-14T05:52:13.9681824Z  2025-03-14T05:52:13.9682207Z  2025-03-14T05:52:13.9682538Z  2025-03-14T05:52:13.9682870Z  2025-03-14T05:52:13.9683335Z [14,915 / 15,235] 48 actions running 2025-03-14T05:52:13.9684113Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2025-03-14T05:52:13.9685124Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T05:52:13.9686246Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T05:52:13.9687092Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T05:52:13.9687746Z @stablehlo//:linalg_passes; 38s local 2025-03-14T05:52:13.9688328Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2025-03-14T05:52:13.9689165Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2025-03-14T05:52:13.9690094Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2025-03-14T05:52:14.7845762Z 2025-03-14T05:52:14.7846852Z  2025-03-14T05:52:14.7847373Z  2025-03-14T05:52:14.7847768Z  2025-03-14T05:52:14.7848158Z  2025-03-14T05:52:14.7848532Z  2025-03-14T05:52:14.7848904Z  2025-03-14T05:52:14.7849305Z  2025-03-14T05:52:14.7849677Z  2025-03-14T05:52:14.7850234Z [14,916 / 15,235] 48 actions, 47 running 2025-03-14T05:52:14.7850977Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T05:52:14.7852009Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2025-03-14T05:52:14.7852982Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T05:52:14.7853908Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T05:52:14.7854562Z @stablehlo//:linalg_passes; 39s local 2025-03-14T05:52:14.7855228Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2025-03-14T05:52:14.7858522Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2025-03-14T05:52:14.7859506Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2025-03-14T05:52:15.1688286Z 2025-03-14T05:52:15.1689120Z  2025-03-14T05:52:15.1689630Z  2025-03-14T05:52:15.1690083Z  2025-03-14T05:52:15.1690510Z  2025-03-14T05:52:15.1690913Z  2025-03-14T05:52:15.1691340Z  2025-03-14T05:52:15.1691771Z  2025-03-14T05:52:15.1692202Z  2025-03-14T05:52:15.1692825Z [14,917 / 15,235] 48 actions running 2025-03-14T05:52:15.1693755Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T05:52:15.1694790Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T05:52:15.1695810Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T05:52:15.1696816Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T05:52:15.1697618Z @stablehlo//:linalg_passes; 39s local 2025-03-14T05:52:15.1698342Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2025-03-14T05:52:15.1699358Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2025-03-14T05:52:15.1700742Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2025-03-14T05:52:15.5692530Z 2025-03-14T05:52:15.5693411Z  2025-03-14T05:52:15.5693921Z  2025-03-14T05:52:15.5694323Z  2025-03-14T05:52:15.5694746Z  2025-03-14T05:52:15.5695164Z  2025-03-14T05:52:15.5695550Z  2025-03-14T05:52:15.5695931Z  2025-03-14T05:52:15.5696372Z  2025-03-14T05:52:15.5696905Z [14,918 / 15,235] 48 actions running 2025-03-14T05:52:15.5697736Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T05:52:15.5698701Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T05:52:15.5699637Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T05:52:15.5700593Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T05:52:15.5701351Z @stablehlo//:linalg_passes; 39s local 2025-03-14T05:52:15.5702033Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2025-03-14T05:52:15.5702936Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2025-03-14T05:52:15.5703930Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2025-03-14T05:52:15.9697682Z 2025-03-14T05:52:15.9698502Z  2025-03-14T05:52:15.9698945Z  2025-03-14T05:52:15.9699306Z  2025-03-14T05:52:15.9699652Z  2025-03-14T05:52:15.9700245Z  2025-03-14T05:52:15.9700603Z  2025-03-14T05:52:15.9700955Z  2025-03-14T05:52:15.9701322Z  2025-03-14T05:52:15.9701828Z [14,919 / 15,235] 48 actions running 2025-03-14T05:52:15.9702618Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2025-03-14T05:52:15.9703517Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T05:52:15.9704420Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T05:52:15.9705441Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T05:52:15.9706137Z @stablehlo//:linalg_passes; 40s local 2025-03-14T05:52:15.9706790Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2025-03-14T05:52:15.9707670Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2025-03-14T05:52:15.9708587Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2025-03-14T05:52:16.9703267Z 2025-03-14T05:52:16.9704605Z  2025-03-14T05:52:16.9705562Z  2025-03-14T05:52:16.9706645Z  2025-03-14T05:52:16.9707157Z  2025-03-14T05:52:16.9707527Z  2025-03-14T05:52:16.9707906Z  2025-03-14T05:52:16.9708283Z  2025-03-14T05:52:16.9708672Z  2025-03-14T05:52:16.9709257Z [14,919 / 15,235] 48 actions running 2025-03-14T05:52:16.9710142Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T05:52:16.9711415Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T05:52:16.9712465Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T05:52:16.9713462Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T05:52:16.9714255Z @stablehlo//:linalg_passes; 41s local 2025-03-14T05:52:16.9714966Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2025-03-14T05:52:16.9715946Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2025-03-14T05:52:16.9717027Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2025-03-14T05:52:17.6434973Z 2025-03-14T05:52:17.6436399Z  2025-03-14T05:52:17.6436941Z  2025-03-14T05:52:17.6439368Z  2025-03-14T05:52:17.6439890Z  2025-03-14T05:52:17.6440273Z  2025-03-14T05:52:17.6440679Z  2025-03-14T05:52:17.6441092Z  2025-03-14T05:52:17.6441483Z  2025-03-14T05:52:17.6442124Z [14,920 / 15,235] 48 actions, 47 running 2025-03-14T05:52:17.6443010Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T05:52:17.6444004Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T05:52:17.6445484Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T05:52:17.6446443Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T05:52:17.6447174Z @stablehlo//:linalg_passes; 41s local 2025-03-14T05:52:17.6447878Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2025-03-14T05:52:17.6448858Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T05:52:17.6449850Z @llvm-project//mlir:LinalgTransforms; 25s local ... 2025-03-14T05:52:17.9605273Z 2025-03-14T05:52:17.9606115Z  2025-03-14T05:52:17.9606518Z  2025-03-14T05:52:17.9606834Z  2025-03-14T05:52:17.9607161Z  2025-03-14T05:52:17.9607500Z  2025-03-14T05:52:17.9607888Z  2025-03-14T05:52:17.9608225Z  2025-03-14T05:52:17.9608559Z  2025-03-14T05:52:17.9609082Z [14,922 / 15,235] 48 actions, 47 running 2025-03-14T05:52:17.9609818Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T05:52:17.9610672Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T05:52:17.9611578Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T05:52:17.9612515Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T05:52:17.9613212Z @stablehlo//:linalg_passes; 42s local 2025-03-14T05:52:17.9614196Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2025-03-14T05:52:17.9615034Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T05:52:17.9615966Z @llvm-project//mlir:LinalgTransforms; 25s local ... 2025-03-14T05:52:18.1712560Z 2025-03-14T05:52:18.1713539Z  2025-03-14T05:52:18.1714228Z  2025-03-14T05:52:18.1714779Z  2025-03-14T05:52:18.1715314Z  2025-03-14T05:52:18.1715833Z  2025-03-14T05:52:18.1716337Z  2025-03-14T05:52:18.1717104Z  2025-03-14T05:52:18.1717635Z  2025-03-14T05:52:18.1718364Z [14,923 / 15,235] 48 actions running 2025-03-14T05:52:18.1719331Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T05:52:18.1720414Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T05:52:18.1721503Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T05:52:18.1722554Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T05:52:18.1723425Z @stablehlo//:linalg_passes; 42s local 2025-03-14T05:52:18.1724203Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2025-03-14T05:52:18.1725361Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T05:52:18.1726423Z @llvm-project//mlir:LinalgTransforms; 25s local ... 2025-03-14T05:52:18.5134492Z 2025-03-14T05:52:18.5135336Z  2025-03-14T05:52:18.5135793Z  2025-03-14T05:52:18.5136156Z  2025-03-14T05:52:18.5136568Z  2025-03-14T05:52:18.5136947Z  2025-03-14T05:52:18.5137335Z  2025-03-14T05:52:18.5137739Z  2025-03-14T05:52:18.5138100Z  2025-03-14T05:52:18.5138673Z [14,924 / 15,235] 48 actions, 47 running 2025-03-14T05:52:18.5139530Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T05:52:18.5140602Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T05:52:18.5141604Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T05:52:18.5142559Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T05:52:18.5143324Z @stablehlo//:linalg_passes; 42s local 2025-03-14T05:52:18.5144011Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2025-03-14T05:52:18.5144951Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T05:52:18.5145936Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2025-03-14T05:52:18.7718019Z 2025-03-14T05:52:18.7718870Z  2025-03-14T05:52:18.7719349Z  2025-03-14T05:52:18.7719975Z  2025-03-14T05:52:18.7720352Z  2025-03-14T05:52:18.7720759Z  2025-03-14T05:52:18.7721142Z  2025-03-14T05:52:18.7721507Z  2025-03-14T05:52:18.7721882Z  2025-03-14T05:52:18.7722437Z [14,924 / 15,235] 48 actions running 2025-03-14T05:52:18.7723319Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 171s local 2025-03-14T05:52:18.7724290Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T05:52:18.7725417Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T05:52:18.7726370Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T05:52:18.7727110Z @stablehlo//:linalg_passes; 43s local 2025-03-14T05:52:18.7727771Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T05:52:18.7728623Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2025-03-14T05:52:18.7729592Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2025-03-14T05:52:18.9721260Z 2025-03-14T05:52:18.9722061Z  2025-03-14T05:52:18.9722539Z  2025-03-14T05:52:18.9723057Z  2025-03-14T05:52:18.9723445Z  2025-03-14T05:52:18.9723791Z  2025-03-14T05:52:18.9724136Z  2025-03-14T05:52:18.9724652Z  2025-03-14T05:52:18.9725028Z  2025-03-14T05:52:18.9725505Z [14,926 / 15,235] 48 actions running 2025-03-14T05:52:18.9726553Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 171s local 2025-03-14T05:52:18.9727443Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T05:52:18.9728331Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T05:52:18.9729190Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T05:52:18.9729939Z @stablehlo//:linalg_passes; 43s local 2025-03-14T05:52:18.9730614Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T05:52:18.9731717Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2025-03-14T05:52:18.9732720Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2025-03-14T05:52:19.1734865Z 2025-03-14T05:52:19.1735749Z  2025-03-14T05:52:19.1736275Z  2025-03-14T05:52:19.1736686Z  2025-03-14T05:52:19.1737093Z  2025-03-14T05:52:19.1737447Z  2025-03-14T05:52:19.1737836Z  2025-03-14T05:52:19.1738224Z  2025-03-14T05:52:19.1738738Z  2025-03-14T05:52:19.1739276Z [14,928 / 15,235] 48 actions, 47 running 2025-03-14T05:52:19.1740106Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T05:52:19.1741158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T05:52:19.1742024Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T05:52:19.1743027Z @stablehlo//:linalg_passes; 43s local 2025-03-14T05:52:19.1743667Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T05:52:19.1744531Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2025-03-14T05:52:19.1745697Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 26s local 2025-03-14T05:52:19.1746828Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local ... 2025-03-14T05:52:19.3924930Z 2025-03-14T05:52:19.3925826Z  2025-03-14T05:52:19.3926480Z  2025-03-14T05:52:19.3927021Z  2025-03-14T05:52:19.3927539Z  2025-03-14T05:52:19.3928078Z  2025-03-14T05:52:19.3928563Z  2025-03-14T05:52:19.3929037Z  2025-03-14T05:52:19.3929570Z  2025-03-14T05:52:19.3930269Z [14,929 / 15,235] 48 actions, 47 running 2025-03-14T05:52:19.3931222Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T05:52:19.3932346Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T05:52:19.3933409Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T05:52:19.3934288Z @stablehlo//:linalg_passes; 43s local 2025-03-14T05:52:19.3935413Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T05:52:19.3936551Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2025-03-14T05:52:19.3938000Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T05:52:19.3939179Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local ... 2025-03-14T05:52:19.6290524Z 2025-03-14T05:52:19.6291411Z  2025-03-14T05:52:19.6291906Z  2025-03-14T05:52:19.6292262Z  2025-03-14T05:52:19.6292567Z  2025-03-14T05:52:19.6292874Z  2025-03-14T05:52:19.6293182Z  2025-03-14T05:52:19.6293495Z  2025-03-14T05:52:19.6293809Z  2025-03-14T05:52:19.6294273Z [14,930 / 15,235] 48 actions, 47 running 2025-03-14T05:52:19.6295027Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T05:52:19.6295978Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T05:52:19.6296877Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T05:52:19.6297602Z @stablehlo//:linalg_passes; 43s local 2025-03-14T05:52:19.6298262Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T05:52:19.6299166Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T05:52:19.6300278Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T05:52:19.6301550Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local ... 2025-03-14T05:52:19.9731203Z 2025-03-14T05:52:19.9732003Z  2025-03-14T05:52:19.9732521Z  2025-03-14T05:52:19.9732966Z  2025-03-14T05:52:19.9733399Z  2025-03-14T05:52:19.9733840Z  2025-03-14T05:52:19.9734282Z  2025-03-14T05:52:19.9734725Z  2025-03-14T05:52:19.9735201Z  2025-03-14T05:52:19.9735800Z [14,931 / 15,235] 48 actions running 2025-03-14T05:52:19.9738695Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T05:52:19.9739907Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T05:52:19.9741043Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T05:52:19.9741818Z @stablehlo//:linalg_passes; 44s local 2025-03-14T05:52:19.9742542Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T05:52:19.9743504Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T05:52:19.9744702Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T05:52:19.9745775Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local ... 2025-03-14T05:52:20.1736111Z 2025-03-14T05:52:20.1736922Z  2025-03-14T05:52:20.1737424Z  2025-03-14T05:52:20.1737828Z  2025-03-14T05:52:20.1738238Z  2025-03-14T05:52:20.1738929Z  2025-03-14T05:52:20.1739333Z  2025-03-14T05:52:20.1739754Z  2025-03-14T05:52:20.1740148Z  2025-03-14T05:52:20.1740762Z [14,933 / 15,235] 48 actions running 2025-03-14T05:52:20.1741650Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T05:52:20.1742567Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T05:52:20.1743357Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T05:52:20.1744093Z @stablehlo//:linalg_passes; 44s local 2025-03-14T05:52:20.1744800Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T05:52:20.1745808Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T05:52:20.1746830Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T05:52:20.1747740Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2025-03-14T05:52:20.4018935Z 2025-03-14T05:52:20.4019792Z  2025-03-14T05:52:20.4020299Z  2025-03-14T05:52:20.4020706Z  2025-03-14T05:52:20.4021087Z  2025-03-14T05:52:20.4021460Z  2025-03-14T05:52:20.4021871Z  2025-03-14T05:52:20.4022260Z  2025-03-14T05:52:20.4022927Z  2025-03-14T05:52:20.4023489Z [14,934 / 15,235] 48 actions, 47 running 2025-03-14T05:52:20.4024281Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T05:52:20.4025229Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T05:52:20.4026172Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T05:52:20.4026884Z @stablehlo//:linalg_passes; 44s local 2025-03-14T05:52:20.4027607Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T05:52:20.4028551Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T05:52:20.4029503Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T05:52:20.4030318Z @llvm-project//mlir:LinalgTransforms; 27s local ... 2025-03-14T05:52:20.7741714Z 2025-03-14T05:52:20.7742544Z  2025-03-14T05:52:20.7743018Z  2025-03-14T05:52:20.7743451Z  2025-03-14T05:52:20.7743843Z  2025-03-14T05:52:20.7744231Z  2025-03-14T05:52:20.7744628Z  2025-03-14T05:52:20.7745020Z  2025-03-14T05:52:20.7745400Z  2025-03-14T05:52:20.7745940Z [14,936 / 15,235] 48 actions running 2025-03-14T05:52:20.7746738Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T05:52:20.7747713Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T05:52:20.7748853Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2025-03-14T05:52:20.7749635Z @stablehlo//:linalg_passes; 45s local 2025-03-14T05:52:20.7750243Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2025-03-14T05:52:20.7750976Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T05:52:20.7751730Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T05:52:20.7752406Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local ... 2025-03-14T05:52:20.9745667Z 2025-03-14T05:52:20.9746539Z  2025-03-14T05:52:20.9747041Z  2025-03-14T05:52:20.9747465Z  2025-03-14T05:52:20.9747895Z  2025-03-14T05:52:20.9748308Z  2025-03-14T05:52:20.9748717Z  2025-03-14T05:52:20.9749117Z  2025-03-14T05:52:20.9749532Z  2025-03-14T05:52:20.9750112Z [14,937 / 15,235] 48 actions running 2025-03-14T05:52:20.9750939Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T05:52:20.9761510Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T05:52:20.9762445Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2025-03-14T05:52:20.9763176Z @stablehlo//:linalg_passes; 45s local 2025-03-14T05:52:20.9763825Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2025-03-14T05:52:20.9764844Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T05:52:20.9766213Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T05:52:20.9767037Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local ... 2025-03-14T05:52:21.8116247Z 2025-03-14T05:52:21.8117115Z  2025-03-14T05:52:21.8117610Z  2025-03-14T05:52:21.8118043Z  2025-03-14T05:52:21.8118420Z  2025-03-14T05:52:21.8118804Z  2025-03-14T05:52:21.8119200Z  2025-03-14T05:52:21.8119588Z  2025-03-14T05:52:21.8119999Z  2025-03-14T05:52:21.8120637Z [14,938 / 15,235] 48 actions, 47 running 2025-03-14T05:52:21.8121564Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2025-03-14T05:52:21.8122591Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2025-03-14T05:52:21.8123562Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2025-03-14T05:52:21.8124387Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T05:52:21.8125448Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2025-03-14T05:52:21.8126395Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2025-03-14T05:52:21.8127650Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2025-03-14T05:52:21.8128556Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 22s local ... 2025-03-14T05:52:22.1756306Z 2025-03-14T05:52:22.1757172Z  2025-03-14T05:52:22.1757602Z  2025-03-14T05:52:22.1757973Z  2025-03-14T05:52:22.1758335Z  2025-03-14T05:52:22.1758736Z  2025-03-14T05:52:22.1759098Z  2025-03-14T05:52:22.1759526Z  2025-03-14T05:52:22.1759930Z  2025-03-14T05:52:22.1760457Z [14,939 / 15,235] 48 actions running 2025-03-14T05:52:22.1761343Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T05:52:22.1762310Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2025-03-14T05:52:22.1763108Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T05:52:22.1764067Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2025-03-14T05:52:22.1765188Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2025-03-14T05:52:22.1766219Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T05:52:22.1767003Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 22s local 2025-03-14T05:52:22.1767702Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 17s local ... 2025-03-14T05:52:22.8749748Z 2025-03-14T05:52:22.8750548Z  2025-03-14T05:52:22.8751003Z  2025-03-14T05:52:22.8751372Z  2025-03-14T05:52:22.8751988Z  2025-03-14T05:52:22.8752367Z  2025-03-14T05:52:22.8752728Z  2025-03-14T05:52:22.8753092Z  2025-03-14T05:52:22.8753455Z  2025-03-14T05:52:22.8753999Z [14,940 / 15,235] 48 actions, 47 running 2025-03-14T05:52:22.8754801Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T05:52:22.8755651Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T05:52:22.8756385Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T05:52:22.8757355Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T05:52:22.8758193Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2025-03-14T05:52:22.8758890Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T05:52:22.8759597Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 23s local 2025-03-14T05:52:22.8760321Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 17s local ... 2025-03-14T05:52:23.0963342Z 2025-03-14T05:52:23.0964240Z  2025-03-14T05:52:23.0964776Z  2025-03-14T05:52:23.0965125Z  2025-03-14T05:52:23.0965637Z  2025-03-14T05:52:23.0965978Z  2025-03-14T05:52:23.0966319Z  2025-03-14T05:52:23.0966656Z  2025-03-14T05:52:23.0966990Z  2025-03-14T05:52:23.0967502Z [14,941 / 15,235] 48 actions, 47 running 2025-03-14T05:52:23.0968476Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T05:52:23.0969281Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T05:52:23.0969986Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T05:52:23.0970788Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T05:52:23.0971613Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2025-03-14T05:52:23.0972300Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2025-03-14T05:52:23.0972996Z Compiling xla/python/pjrt_ifrt/pjrt_tuple.cc; 23s local 2025-03-14T05:52:23.0973731Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 18s local ... 2025-03-14T05:52:23.3764050Z 2025-03-14T05:52:23.3765018Z  2025-03-14T05:52:23.3766070Z  2025-03-14T05:52:23.3766402Z  2025-03-14T05:52:23.3766719Z  2025-03-14T05:52:23.3767019Z  2025-03-14T05:52:23.3767333Z  2025-03-14T05:52:23.3767670Z  2025-03-14T05:52:23.3767976Z  2025-03-14T05:52:23.3768424Z [14,943 / 15,235] 48 actions running 2025-03-14T05:52:23.3769123Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T05:52:23.3770104Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T05:52:23.3770713Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T05:52:23.3771425Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T05:52:23.3772157Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2025-03-14T05:52:23.3772765Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2025-03-14T05:52:23.3773384Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 18s local 2025-03-14T05:52:23.3773951Z @stablehlo//:stablehlo_passes; 17s local ... 2025-03-14T05:52:24.3188807Z 2025-03-14T05:52:24.3189634Z  2025-03-14T05:52:24.3190130Z  2025-03-14T05:52:24.3190536Z  2025-03-14T05:52:24.3190907Z  2025-03-14T05:52:24.3191324Z  2025-03-14T05:52:24.3191700Z  2025-03-14T05:52:24.3192090Z  2025-03-14T05:52:24.3192503Z  2025-03-14T05:52:24.3193091Z [14,944 / 15,235] 48 actions, 47 running 2025-03-14T05:52:24.3193961Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2025-03-14T05:52:24.3194939Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2025-03-14T05:52:24.3195765Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2025-03-14T05:52:24.3196714Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2025-03-14T05:52:24.3197995Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T05:52:24.3198814Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T05:52:24.3199594Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local 2025-03-14T05:52:24.3200327Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T05:52:24.5772946Z 2025-03-14T05:52:24.5773813Z  2025-03-14T05:52:24.5774308Z  2025-03-14T05:52:24.5774715Z  2025-03-14T05:52:24.5775082Z  2025-03-14T05:52:24.5775471Z  2025-03-14T05:52:24.5776164Z  2025-03-14T05:52:24.5776579Z  2025-03-14T05:52:24.5776974Z  2025-03-14T05:52:24.5777557Z [14,945 / 15,235] 48 actions running 2025-03-14T05:52:24.5778438Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2025-03-14T05:52:24.5779315Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T05:52:24.5780105Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T05:52:24.5781116Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T05:52:24.5782152Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T05:52:24.5782976Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T05:52:24.5783798Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local 2025-03-14T05:52:24.5784574Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T05:52:24.8141023Z 2025-03-14T05:52:24.8141885Z  2025-03-14T05:52:24.8142369Z  2025-03-14T05:52:24.8142767Z  2025-03-14T05:52:24.8143182Z  2025-03-14T05:52:24.8143592Z  2025-03-14T05:52:24.8143984Z  2025-03-14T05:52:24.8144351Z  2025-03-14T05:52:24.8144741Z  2025-03-14T05:52:24.8145353Z [14,946 / 15,235] 48 actions, 47 running 2025-03-14T05:52:24.8146275Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2025-03-14T05:52:24.8147259Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T05:52:24.8148072Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T05:52:24.8149000Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T05:52:24.8149983Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T05:52:24.8150780Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T05:52:24.8151622Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local 2025-03-14T05:52:24.8152392Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T05:52:25.0315862Z 2025-03-14T05:52:25.0316721Z  2025-03-14T05:52:25.0317561Z  2025-03-14T05:52:25.0317938Z  2025-03-14T05:52:25.0318342Z  2025-03-14T05:52:25.0318693Z  2025-03-14T05:52:25.0319083Z  2025-03-14T05:52:25.0319496Z  2025-03-14T05:52:25.0319909Z  2025-03-14T05:52:25.0320490Z [14,947 / 15,235] 48 actions, 47 running 2025-03-14T05:52:25.0321320Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T05:52:25.0322291Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T05:52:25.0323144Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T05:52:25.0324161Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T05:52:25.0325242Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T05:52:25.0326083Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T05:52:25.0326949Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2025-03-14T05:52:25.0327652Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T05:52:25.3779247Z 2025-03-14T05:52:25.3780053Z  2025-03-14T05:52:25.3780458Z  2025-03-14T05:52:25.3780855Z  2025-03-14T05:52:25.3781250Z  2025-03-14T05:52:25.3781685Z  2025-03-14T05:52:25.3782102Z  2025-03-14T05:52:25.3782531Z  2025-03-14T05:52:25.3782893Z  2025-03-14T05:52:25.3783757Z [14,947 / 15,235] 48 actions running 2025-03-14T05:52:25.3784722Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T05:52:25.3785699Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T05:52:25.3786394Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T05:52:25.3787103Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T05:52:25.3787859Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T05:52:25.3788651Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T05:52:25.3789322Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2025-03-14T05:52:25.3789940Z @stablehlo//:stablehlo_passes; 19s local ... 2025-03-14T05:52:25.6725685Z 2025-03-14T05:52:25.6726503Z  2025-03-14T05:52:25.6726992Z  2025-03-14T05:52:25.6727389Z  2025-03-14T05:52:25.6727943Z  2025-03-14T05:52:25.6728357Z  2025-03-14T05:52:25.6728744Z  2025-03-14T05:52:25.6729140Z  2025-03-14T05:52:25.6729584Z  2025-03-14T05:52:25.6730209Z [14,948 / 15,235] 48 actions, 47 running 2025-03-14T05:52:25.6731113Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T05:52:25.6732089Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T05:52:25.6732896Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T05:52:25.6734191Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T05:52:25.6735177Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T05:52:25.6735980Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T05:52:25.6736768Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2025-03-14T05:52:25.6737673Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 18s local ... 2025-03-14T05:52:25.9785738Z 2025-03-14T05:52:25.9786599Z  2025-03-14T05:52:25.9787086Z  2025-03-14T05:52:25.9787496Z  2025-03-14T05:52:25.9787936Z  2025-03-14T05:52:25.9788343Z  2025-03-14T05:52:25.9788743Z  2025-03-14T05:52:25.9789155Z  2025-03-14T05:52:25.9789545Z  2025-03-14T05:52:25.9790127Z [14,948 / 15,235] 48 actions running 2025-03-14T05:52:25.9791036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T05:52:25.9792027Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T05:52:25.9792853Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T05:52:25.9793654Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T05:52:25.9794705Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T05:52:25.9795587Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T05:52:25.9796393Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2025-03-14T05:52:25.9797207Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 18s local ... 2025-03-14T05:52:26.1803359Z 2025-03-14T05:52:26.1804248Z  2025-03-14T05:52:26.1804868Z  2025-03-14T05:52:26.1805272Z  2025-03-14T05:52:26.1805670Z  2025-03-14T05:52:26.1806019Z  2025-03-14T05:52:26.1806454Z  2025-03-14T05:52:26.1806825Z  2025-03-14T05:52:26.1807196Z  2025-03-14T05:52:26.1807756Z [14,949 / 15,235] 48 actions, 47 running 2025-03-14T05:52:26.1808664Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T05:52:26.1809623Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T05:52:26.1810448Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T05:52:26.1811383Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T05:52:26.1812368Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T05:52:26.1813139Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T05:52:26.1813940Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2025-03-14T05:52:26.1815081Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 18s local ... 2025-03-14T05:52:26.5272631Z 2025-03-14T05:52:26.5273462Z  2025-03-14T05:52:26.5273950Z  2025-03-14T05:52:26.5274372Z  2025-03-14T05:52:26.5274761Z  2025-03-14T05:52:26.5275173Z  2025-03-14T05:52:26.5275556Z  2025-03-14T05:52:26.5275980Z  2025-03-14T05:52:26.5276383Z  2025-03-14T05:52:26.5276950Z [14,950 / 15,235] 48 actions, 47 running 2025-03-14T05:52:26.5278089Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T05:52:26.5279047Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T05:52:26.5279802Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T05:52:26.5280697Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T05:52:26.5281670Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T05:52:26.5282503Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T05:52:26.5283339Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2025-03-14T05:52:26.5284232Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 18s local ... 2025-03-14T05:52:26.7792358Z 2025-03-14T05:52:26.7793225Z  2025-03-14T05:52:26.7793874Z  2025-03-14T05:52:26.7794292Z  2025-03-14T05:52:26.7795068Z  2025-03-14T05:52:26.7795457Z  2025-03-14T05:52:26.7795867Z  2025-03-14T05:52:26.7796253Z  2025-03-14T05:52:26.7796731Z  2025-03-14T05:52:26.7797283Z [14,950 / 15,235] 48 actions running 2025-03-14T05:52:26.7798187Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T05:52:26.7799123Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T05:52:26.7799942Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T05:52:26.7800921Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2025-03-14T05:52:26.7801911Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T05:52:26.7802709Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T05:52:26.7803546Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2025-03-14T05:52:26.7804604Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 19s local ... 2025-03-14T05:52:26.9795314Z 2025-03-14T05:52:26.9796165Z  2025-03-14T05:52:26.9796637Z  2025-03-14T05:52:26.9797044Z  2025-03-14T05:52:26.9797451Z  2025-03-14T05:52:26.9797865Z  2025-03-14T05:52:26.9798268Z  2025-03-14T05:52:26.9798964Z  2025-03-14T05:52:26.9799341Z  2025-03-14T05:52:26.9799888Z [14,951 / 15,235] 48 actions running 2025-03-14T05:52:26.9800778Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T05:52:26.9801716Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T05:52:26.9802465Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T05:52:26.9803416Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2025-03-14T05:52:26.9804396Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T05:52:26.9805316Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T05:52:26.9806134Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2025-03-14T05:52:26.9807000Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 19s local ... 2025-03-14T05:52:27.3800614Z 2025-03-14T05:52:27.3801445Z  2025-03-14T05:52:27.3801866Z  2025-03-14T05:52:27.3802195Z  2025-03-14T05:52:27.3802497Z  2025-03-14T05:52:27.3802872Z  2025-03-14T05:52:27.3803222Z  2025-03-14T05:52:27.3803529Z  2025-03-14T05:52:27.3803838Z  2025-03-14T05:52:27.3804322Z [14,952 / 15,235] 48 actions running 2025-03-14T05:52:27.3805325Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T05:52:27.3806503Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T05:52:27.3807340Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T05:52:27.3808240Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2025-03-14T05:52:27.3809105Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T05:52:27.3809907Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T05:52:27.3810688Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2025-03-14T05:52:27.3811682Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 19s local ... 2025-03-14T05:52:27.7580255Z 2025-03-14T05:52:27.7581133Z  2025-03-14T05:52:27.7581548Z  2025-03-14T05:52:27.7581858Z  2025-03-14T05:52:27.7582164Z  2025-03-14T05:52:27.7582498Z  2025-03-14T05:52:27.7582852Z  2025-03-14T05:52:27.7583204Z  2025-03-14T05:52:27.7583574Z  2025-03-14T05:52:27.7584139Z [14,953 / 15,235] 48 actions, 47 running 2025-03-14T05:52:27.7585031Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T05:52:27.7585944Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T05:52:27.7586740Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T05:52:27.7587804Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T05:52:27.7588980Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T05:52:27.7589742Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T05:52:27.7590604Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2025-03-14T05:52:27.7591464Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 20s local ... 2025-03-14T05:52:27.9806304Z 2025-03-14T05:52:27.9807160Z  2025-03-14T05:52:27.9807640Z  2025-03-14T05:52:27.9808051Z  2025-03-14T05:52:27.9808452Z  2025-03-14T05:52:27.9808870Z  2025-03-14T05:52:27.9809277Z  2025-03-14T05:52:27.9809665Z  2025-03-14T05:52:27.9810065Z  2025-03-14T05:52:27.9810597Z [14,953 / 15,235] 48 actions running 2025-03-14T05:52:27.9811463Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T05:52:27.9812378Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T05:52:27.9813201Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T05:52:27.9814160Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T05:52:27.9815133Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T05:52:27.9815974Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T05:52:27.9817038Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2025-03-14T05:52:27.9817938Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 20s local ... 2025-03-14T05:52:28.2612185Z 2025-03-14T05:52:28.2613046Z  2025-03-14T05:52:28.2613525Z  2025-03-14T05:52:28.2613947Z  2025-03-14T05:52:28.2614338Z  2025-03-14T05:52:28.2614750Z  2025-03-14T05:52:28.2615113Z  2025-03-14T05:52:28.2615502Z  2025-03-14T05:52:28.2615911Z  2025-03-14T05:52:28.2616525Z [14,954 / 15,235] 48 actions, 47 running 2025-03-14T05:52:28.2617405Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T05:52:28.2618409Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T05:52:28.2619175Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T05:52:28.2620085Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T05:52:28.2621150Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T05:52:28.2622023Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T05:52:28.2622738Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2025-03-14T05:52:28.2623441Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 20s local ... 2025-03-14T05:52:28.5135181Z 2025-03-14T05:52:28.5136052Z  2025-03-14T05:52:28.5136792Z  2025-03-14T05:52:28.5137194Z  2025-03-14T05:52:28.5137566Z  2025-03-14T05:52:28.5137942Z  2025-03-14T05:52:28.5138330Z  2025-03-14T05:52:28.5138733Z  2025-03-14T05:52:28.5139132Z  2025-03-14T05:52:28.5139730Z [14,955 / 15,235] 48 actions, 47 running 2025-03-14T05:52:28.5140639Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T05:52:28.5141736Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T05:52:28.5142568Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T05:52:28.5143558Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T05:52:28.5144545Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T05:52:28.5145329Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T05:52:28.5146140Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2025-03-14T05:52:28.5147012Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 20s local ... 2025-03-14T05:52:28.7813055Z 2025-03-14T05:52:28.7813873Z  2025-03-14T05:52:28.7814353Z  2025-03-14T05:52:28.7814757Z  2025-03-14T05:52:28.7815140Z  2025-03-14T05:52:28.7815541Z  2025-03-14T05:52:28.7815943Z  2025-03-14T05:52:28.7816325Z  2025-03-14T05:52:28.7817020Z  2025-03-14T05:52:28.7817566Z [14,955 / 15,235] 48 actions running 2025-03-14T05:52:28.7818486Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T05:52:28.7819319Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T05:52:28.7820104Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T05:52:28.7821041Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2025-03-14T05:52:28.7821901Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T05:52:28.7822663Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T05:52:28.7823446Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2025-03-14T05:52:28.7824284Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local ... 2025-03-14T05:52:29.1818059Z 2025-03-14T05:52:29.1818905Z  2025-03-14T05:52:29.1819397Z  2025-03-14T05:52:29.1819788Z  2025-03-14T05:52:29.1820154Z  2025-03-14T05:52:29.1820541Z  2025-03-14T05:52:29.1820884Z  2025-03-14T05:52:29.1821214Z  2025-03-14T05:52:29.1821590Z  2025-03-14T05:52:29.1822129Z [14,957 / 15,235] 48 actions running 2025-03-14T05:52:29.1823300Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2025-03-14T05:52:29.1824223Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T05:52:29.1824964Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T05:52:29.1825829Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2025-03-14T05:52:29.1826748Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T05:52:29.1827509Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2025-03-14T05:52:29.1828269Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2025-03-14T05:52:29.1829071Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local ... 2025-03-14T05:52:29.5965857Z 2025-03-14T05:52:29.5966714Z  2025-03-14T05:52:29.5967206Z  2025-03-14T05:52:29.5967579Z  2025-03-14T05:52:29.5967968Z  2025-03-14T05:52:29.5968333Z  2025-03-14T05:52:29.5968713Z  2025-03-14T05:52:29.5969098Z  2025-03-14T05:52:29.5969502Z  2025-03-14T05:52:29.5970081Z [14,958 / 15,235] 48 actions, 47 running 2025-03-14T05:52:29.5970935Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2025-03-14T05:52:29.5971856Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T05:52:29.5972626Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T05:52:29.5973834Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2025-03-14T05:52:29.5974844Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T05:52:29.5975652Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2025-03-14T05:52:29.5976440Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2025-03-14T05:52:29.5977278Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 21s local ... 2025-03-14T05:52:29.9824716Z 2025-03-14T05:52:29.9825541Z  2025-03-14T05:52:29.9826298Z  2025-03-14T05:52:29.9826710Z  2025-03-14T05:52:29.9827131Z  2025-03-14T05:52:29.9827490Z  2025-03-14T05:52:29.9827840Z  2025-03-14T05:52:29.9828184Z  2025-03-14T05:52:29.9828535Z  2025-03-14T05:52:29.9829106Z [14,958 / 15,235] 48 actions running 2025-03-14T05:52:29.9829960Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2025-03-14T05:52:29.9830887Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T05:52:29.9831671Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T05:52:29.9832579Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2025-03-14T05:52:29.9833505Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T05:52:29.9834331Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2025-03-14T05:52:29.9835330Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2025-03-14T05:52:29.9836082Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 22s local ... 2025-03-14T05:52:30.3861555Z 2025-03-14T05:52:30.3862478Z  2025-03-14T05:52:30.3862975Z  2025-03-14T05:52:30.3863365Z  2025-03-14T05:52:30.3863871Z  2025-03-14T05:52:30.3864281Z  2025-03-14T05:52:30.3864671Z  2025-03-14T05:52:30.3865056Z  2025-03-14T05:52:30.3865738Z  2025-03-14T05:52:30.3866314Z [14,959 / 15,235] 48 actions, 47 running 2025-03-14T05:52:30.3867166Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T05:52:30.3868169Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T05:52:30.3868964Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T05:52:30.3869922Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2025-03-14T05:52:30.3870907Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2025-03-14T05:52:30.3871770Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T05:52:30.3872636Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2025-03-14T05:52:30.3873893Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 22s local ... 2025-03-14T05:52:30.7831831Z 2025-03-14T05:52:30.7832673Z  2025-03-14T05:52:30.7833275Z  2025-03-14T05:52:30.7833697Z  2025-03-14T05:52:30.7834087Z  2025-03-14T05:52:30.7834487Z  2025-03-14T05:52:30.7834870Z  2025-03-14T05:52:30.7835254Z  2025-03-14T05:52:30.7835652Z  2025-03-14T05:52:30.7836258Z [14,959 / 15,235] 48 actions running 2025-03-14T05:52:30.7837128Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T05:52:30.7838032Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T05:52:30.7838840Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T05:52:30.7839801Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2025-03-14T05:52:30.7840723Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2025-03-14T05:52:30.7841468Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T05:52:30.7842268Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2025-03-14T05:52:30.7843120Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local ... 2025-03-14T05:52:30.9835435Z 2025-03-14T05:52:30.9836303Z  2025-03-14T05:52:30.9836766Z  2025-03-14T05:52:30.9837142Z  2025-03-14T05:52:30.9837554Z  2025-03-14T05:52:30.9837952Z  2025-03-14T05:52:30.9838618Z  2025-03-14T05:52:30.9839016Z  2025-03-14T05:52:30.9839416Z  2025-03-14T05:52:30.9839982Z [14,960 / 15,235] 48 actions running 2025-03-14T05:52:30.9840876Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T05:52:30.9841983Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T05:52:30.9842848Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T05:52:30.9843999Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2025-03-14T05:52:30.9845148Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2025-03-14T05:52:30.9845991Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T05:52:30.9846840Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2025-03-14T05:52:30.9847726Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local ... 2025-03-14T05:52:31.3840514Z 2025-03-14T05:52:31.3841360Z  2025-03-14T05:52:31.3841839Z  2025-03-14T05:52:31.3842271Z  2025-03-14T05:52:31.3842662Z  2025-03-14T05:52:31.3843062Z  2025-03-14T05:52:31.3843461Z  2025-03-14T05:52:31.3843862Z  2025-03-14T05:52:31.3844249Z  2025-03-14T05:52:31.3844986Z [14,961 / 15,235] 48 actions running 2025-03-14T05:52:31.3845884Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T05:52:31.3847133Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T05:52:31.3847973Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T05:52:31.3848915Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2025-03-14T05:52:31.3849954Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T05:52:31.3850773Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T05:52:31.3851613Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2025-03-14T05:52:31.3852538Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local ... 2025-03-14T05:52:31.5844133Z 2025-03-14T05:52:31.5845213Z  2025-03-14T05:52:31.5845681Z  2025-03-14T05:52:31.5846083Z  2025-03-14T05:52:31.5846475Z  2025-03-14T05:52:31.5846865Z  2025-03-14T05:52:31.5847254Z  2025-03-14T05:52:31.5847644Z  2025-03-14T05:52:31.5848041Z  2025-03-14T05:52:31.5848597Z [14,962 / 15,235] 48 actions running 2025-03-14T05:52:31.5849479Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T05:52:31.5850492Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T05:52:31.5851683Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T05:52:31.5852761Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2025-03-14T05:52:31.5853818Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T05:52:31.5854696Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T05:52:31.5855551Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2025-03-14T05:52:31.5856402Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 23s local ... 2025-03-14T05:52:31.9849429Z 2025-03-14T05:52:31.9850311Z  2025-03-14T05:52:31.9850856Z  2025-03-14T05:52:31.9851341Z  2025-03-14T05:52:31.9851808Z  2025-03-14T05:52:31.9852284Z  2025-03-14T05:52:31.9852796Z  2025-03-14T05:52:31.9853260Z  2025-03-14T05:52:31.9853735Z  2025-03-14T05:52:31.9854421Z [14,963 / 15,235] 48 actions running 2025-03-14T05:52:31.9855490Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T05:52:31.9856670Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T05:52:31.9857677Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T05:52:31.9858818Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2025-03-14T05:52:31.9860016Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T05:52:31.9861245Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T05:52:31.9862255Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 27s local 2025-03-14T05:52:31.9863317Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local ... 2025-03-14T05:52:32.1853356Z 2025-03-14T05:52:32.1854169Z  2025-03-14T05:52:32.1854648Z  2025-03-14T05:52:32.1855102Z  2025-03-14T05:52:32.1855509Z  2025-03-14T05:52:32.1855912Z  2025-03-14T05:52:32.1856315Z  2025-03-14T05:52:32.1856983Z  2025-03-14T05:52:32.1857397Z  2025-03-14T05:52:32.1858005Z [14,965 / 15,235] 48 actions running 2025-03-14T05:52:32.1858921Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2025-03-14T05:52:32.1859910Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T05:52:32.1860746Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T05:52:32.1861734Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2025-03-14T05:52:32.1862751Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T05:52:32.1863577Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2025-03-14T05:52:32.1864431Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local 2025-03-14T05:52:32.1865238Z @stablehlo//:stablehlo_passes; 21s local ... 2025-03-14T05:52:32.5858153Z 2025-03-14T05:52:32.5858987Z  2025-03-14T05:52:32.5859414Z  2025-03-14T05:52:32.5859768Z  2025-03-14T05:52:32.5860127Z  2025-03-14T05:52:32.5860479Z  2025-03-14T05:52:32.5860840Z  2025-03-14T05:52:32.5861185Z  2025-03-14T05:52:32.5861542Z  2025-03-14T05:52:32.5862063Z [14,966 / 15,235] 48 actions running 2025-03-14T05:52:32.5862838Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2025-03-14T05:52:32.5863677Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T05:52:32.5864425Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T05:52:32.5865515Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2025-03-14T05:52:32.5866383Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T05:52:32.5867106Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2025-03-14T05:52:32.5867841Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 24s local 2025-03-14T05:52:32.5868539Z @stablehlo//:stablehlo_passes; 21s local ... 2025-03-14T05:52:33.0746350Z 2025-03-14T05:52:33.0747207Z  2025-03-14T05:52:33.0747633Z  2025-03-14T05:52:33.0748200Z  2025-03-14T05:52:33.0748569Z  2025-03-14T05:52:33.0748924Z  2025-03-14T05:52:33.0749282Z  2025-03-14T05:52:33.0749649Z  2025-03-14T05:52:33.0749988Z  2025-03-14T05:52:33.0750533Z [14,967 / 15,235] 48 actions, 47 running 2025-03-14T05:52:33.0751324Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T05:52:33.0752207Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T05:52:33.0752971Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T05:52:33.0753796Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2025-03-14T05:52:33.0754669Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T05:52:33.0755382Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T05:52:33.0756117Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2025-03-14T05:52:33.0756826Z @stablehlo//:stablehlo_passes; 22s local ... 2025-03-14T05:52:33.2845347Z 2025-03-14T05:52:33.2846122Z  2025-03-14T05:52:33.2846527Z  2025-03-14T05:52:33.2846873Z  2025-03-14T05:52:33.2847210Z  2025-03-14T05:52:33.2847575Z  2025-03-14T05:52:33.2847929Z  2025-03-14T05:52:33.2848308Z  2025-03-14T05:52:33.2848650Z  2025-03-14T05:52:33.2849179Z [14,968 / 15,235] 48 actions, 47 running 2025-03-14T05:52:33.2850222Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T05:52:33.2851076Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T05:52:33.2851780Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T05:52:33.2852593Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2025-03-14T05:52:33.2853660Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2025-03-14T05:52:33.2854692Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T05:52:33.2855418Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2025-03-14T05:52:33.2856111Z @stablehlo//:stablehlo_passes; 22s local ... 2025-03-14T05:52:33.5865947Z 2025-03-14T05:52:33.5866750Z  2025-03-14T05:52:33.5867158Z  2025-03-14T05:52:33.5867497Z  2025-03-14T05:52:33.5867836Z  2025-03-14T05:52:33.5868175Z  2025-03-14T05:52:33.5868523Z  2025-03-14T05:52:33.5868860Z  2025-03-14T05:52:33.5869199Z  2025-03-14T05:52:33.5869719Z [14,969 / 15,235] 48 actions running 2025-03-14T05:52:33.5870482Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T05:52:33.5871300Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T05:52:33.5871998Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T05:52:33.5873057Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T05:52:33.5873918Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2025-03-14T05:52:33.5874589Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T05:52:33.5875305Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 25s local 2025-03-14T05:52:33.5875928Z @stablehlo//:stablehlo_passes; 22s local ... 2025-03-14T05:52:33.8796868Z 2025-03-14T05:52:33.8797699Z  2025-03-14T05:52:33.8798160Z  2025-03-14T05:52:33.8798562Z  2025-03-14T05:52:33.8798955Z  2025-03-14T05:52:33.8799343Z  2025-03-14T05:52:33.8799749Z  2025-03-14T05:52:33.8800132Z  2025-03-14T05:52:33.8800519Z  2025-03-14T05:52:33.8801090Z [14,971 / 15,235] 48 actions, 47 running 2025-03-14T05:52:33.8801923Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T05:52:33.8802833Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T05:52:33.8803609Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T05:52:33.8804714Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T05:52:33.8805875Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2025-03-14T05:52:33.8806635Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T05:52:33.8807399Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2025-03-14T05:52:33.8808122Z @stablehlo//:stablehlo_passes; 23s local ... 2025-03-14T05:52:34.1280805Z 2025-03-14T05:52:34.1281571Z  2025-03-14T05:52:34.1281955Z  2025-03-14T05:52:34.1282309Z  2025-03-14T05:52:34.1282627Z  2025-03-14T05:52:34.1282944Z  2025-03-14T05:52:34.1283260Z  2025-03-14T05:52:34.1283581Z  2025-03-14T05:52:34.1283897Z  2025-03-14T05:52:34.1284671Z [14,973 / 15,235] 48 actions, 47 running 2025-03-14T05:52:34.1285392Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2025-03-14T05:52:34.1286154Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T05:52:34.1286816Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T05:52:34.1287590Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T05:52:34.1288377Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2025-03-14T05:52:34.1289020Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2025-03-14T05:52:34.1289678Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2025-03-14T05:52:34.1290273Z @stablehlo//:stablehlo_passes; 23s local ... 2025-03-14T05:52:34.3873949Z 2025-03-14T05:52:34.3874760Z  2025-03-14T05:52:34.3875152Z  2025-03-14T05:52:34.3875493Z  2025-03-14T05:52:34.3875814Z  2025-03-14T05:52:34.3876131Z  2025-03-14T05:52:34.3876445Z  2025-03-14T05:52:34.3876758Z  2025-03-14T05:52:34.3877072Z  2025-03-14T05:52:34.3877531Z [14,976 / 15,235] 48 actions running 2025-03-14T05:52:34.3878218Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2025-03-14T05:52:34.3879110Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T05:52:34.3879750Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T05:52:34.3880599Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T05:52:34.3881361Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2025-03-14T05:52:34.3881993Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2025-03-14T05:52:34.3882652Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 26s local 2025-03-14T05:52:34.3883248Z @stablehlo//:stablehlo_passes; 23s local ... 2025-03-14T05:52:35.3523935Z 2025-03-14T05:52:35.3524913Z  2025-03-14T05:52:35.3525410Z  2025-03-14T05:52:35.3525807Z  2025-03-14T05:52:35.3526188Z  2025-03-14T05:52:35.3526596Z  2025-03-14T05:52:35.3527020Z  2025-03-14T05:52:35.3527766Z  2025-03-14T05:52:35.3528183Z  2025-03-14T05:52:35.3528778Z [14,977 / 15,235] 48 actions, 47 running 2025-03-14T05:52:35.3529742Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2025-03-14T05:52:35.3530798Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2025-03-14T05:52:35.3531681Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2025-03-14T05:52:35.3532649Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2025-03-14T05:52:35.3533675Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2025-03-14T05:52:35.3534551Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2025-03-14T05:52:35.3535411Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2025-03-14T05:52:35.3536244Z @stablehlo//:stablehlo_passes; 24s local ... 2025-03-14T05:52:35.5881516Z 2025-03-14T05:52:35.5882410Z  2025-03-14T05:52:35.5882908Z  2025-03-14T05:52:35.5883328Z  2025-03-14T05:52:35.5883774Z  2025-03-14T05:52:35.5884168Z  2025-03-14T05:52:35.5884695Z  2025-03-14T05:52:35.5885075Z  2025-03-14T05:52:35.5885485Z  2025-03-14T05:52:35.5886102Z [14,978 / 15,235] 48 actions running 2025-03-14T05:52:35.5887190Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T05:52:35.5888031Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T05:52:35.5889029Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2025-03-14T05:52:35.5890033Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2025-03-14T05:52:35.5890900Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2025-03-14T05:52:35.5891791Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 27s local 2025-03-14T05:52:35.5892595Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T05:52:35.5893457Z Compiling .../hlo_to_mhlo/module_attributes_importer.cc; 23s local ... 2025-03-14T05:52:36.1359369Z 2025-03-14T05:52:36.1360341Z  2025-03-14T05:52:36.1360848Z  2025-03-14T05:52:36.1361279Z  2025-03-14T05:52:36.1361699Z  2025-03-14T05:52:36.1362130Z  2025-03-14T05:52:36.1362572Z  2025-03-14T05:52:36.1362986Z  2025-03-14T05:52:36.1363398Z  2025-03-14T05:52:36.1364030Z [14,979 / 15,235] 48 actions, 47 running 2025-03-14T05:52:36.1364937Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T05:52:36.1365998Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T05:52:36.1366968Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2025-03-14T05:52:36.1368152Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2025-03-14T05:52:36.1368919Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T05:52:36.1369707Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2025-03-14T05:52:36.1370403Z @stablehlo//:stablehlo_passes; 25s local 2025-03-14T05:52:36.1371205Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 20s local ... 2025-03-14T05:52:36.3888380Z 2025-03-14T05:52:36.3889231Z  2025-03-14T05:52:36.3889952Z  2025-03-14T05:52:36.3890370Z  2025-03-14T05:52:36.3890771Z  2025-03-14T05:52:36.3891157Z  2025-03-14T05:52:36.3891538Z  2025-03-14T05:52:36.3891916Z  2025-03-14T05:52:36.3892341Z  2025-03-14T05:52:36.3892914Z [14,979 / 15,235] 48 actions running 2025-03-14T05:52:36.3893700Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T05:52:36.3894544Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T05:52:36.3895504Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2025-03-14T05:52:36.3905763Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T05:52:36.3906655Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T05:52:36.3907545Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 28s local 2025-03-14T05:52:36.3908549Z @stablehlo//:stablehlo_passes; 25s local 2025-03-14T05:52:36.3909458Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local ... 2025-03-14T05:52:36.6831996Z 2025-03-14T05:52:36.6832835Z  2025-03-14T05:52:36.6833260Z  2025-03-14T05:52:36.6833623Z  2025-03-14T05:52:36.6833979Z  2025-03-14T05:52:36.6834311Z  2025-03-14T05:52:36.6834658Z  2025-03-14T05:52:36.6835011Z  2025-03-14T05:52:36.6835361Z  2025-03-14T05:52:36.6835883Z [14,980 / 15,235] 48 actions, 47 running 2025-03-14T05:52:36.6836622Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T05:52:36.6837361Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T05:52:36.6838236Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T05:52:36.6839100Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T05:52:36.6839827Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T05:52:36.6840575Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2025-03-14T05:52:36.6841253Z @stablehlo//:stablehlo_passes; 26s local 2025-03-14T05:52:36.6842276Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local ... 2025-03-14T05:52:36.9894894Z 2025-03-14T05:52:36.9895908Z  2025-03-14T05:52:36.9896422Z  2025-03-14T05:52:36.9896871Z  2025-03-14T05:52:36.9897414Z  2025-03-14T05:52:36.9897877Z  2025-03-14T05:52:36.9898331Z  2025-03-14T05:52:36.9898755Z  2025-03-14T05:52:36.9899192Z  2025-03-14T05:52:36.9899829Z [14,980 / 15,235] 48 actions running 2025-03-14T05:52:36.9900692Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T05:52:36.9901543Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T05:52:36.9902525Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T05:52:36.9903546Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T05:52:36.9904393Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T05:52:36.9905281Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2025-03-14T05:52:36.9906071Z @stablehlo//:stablehlo_passes; 26s local 2025-03-14T05:52:36.9906996Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local ... 2025-03-14T05:52:37.3026726Z 2025-03-14T05:52:37.3027628Z  2025-03-14T05:52:37.3028162Z  2025-03-14T05:52:37.3028605Z  2025-03-14T05:52:37.3029042Z  2025-03-14T05:52:37.3029441Z  2025-03-14T05:52:37.3030292Z  2025-03-14T05:52:37.3030772Z  2025-03-14T05:52:37.3031213Z  2025-03-14T05:52:37.3031819Z [14,981 / 15,235] 48 actions, 47 running 2025-03-14T05:52:37.3032663Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T05:52:37.3033489Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T05:52:37.3034510Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T05:52:37.3035652Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T05:52:37.3036485Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T05:52:37.3037353Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2025-03-14T05:52:37.3038134Z @stablehlo//:stablehlo_passes; 26s local 2025-03-14T05:52:37.3039015Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local ... 2025-03-14T05:52:37.5899747Z 2025-03-14T05:52:37.5900646Z  2025-03-14T05:52:37.5901120Z  2025-03-14T05:52:37.5901580Z  2025-03-14T05:52:37.5902004Z  2025-03-14T05:52:37.5902382Z  2025-03-14T05:52:37.5902775Z  2025-03-14T05:52:37.5903174Z  2025-03-14T05:52:37.5903578Z  2025-03-14T05:52:37.5904168Z [14,981 / 15,235] 48 actions running 2025-03-14T05:52:37.5904985Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T05:52:37.5906050Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T05:52:37.5907042Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 49s local 2025-03-14T05:52:37.5908108Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T05:52:37.5908939Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T05:52:37.5909751Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2025-03-14T05:52:37.5910493Z @stablehlo//:stablehlo_passes; 26s local 2025-03-14T05:52:37.5911374Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local ... 2025-03-14T05:52:37.7937535Z 2025-03-14T05:52:37.7938404Z  2025-03-14T05:52:37.7938973Z  2025-03-14T05:52:37.7939370Z  2025-03-14T05:52:37.7939781Z  2025-03-14T05:52:37.7940216Z  2025-03-14T05:52:37.7940609Z  2025-03-14T05:52:37.7941013Z  2025-03-14T05:52:37.7941426Z  2025-03-14T05:52:37.7942031Z [14,982 / 15,235] 48 actions, 47 running 2025-03-14T05:52:37.7942915Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T05:52:37.7943750Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T05:52:37.7944882Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T05:52:37.7945704Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T05:52:37.7946516Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2025-03-14T05:52:37.7947265Z @stablehlo//:stablehlo_passes; 27s local 2025-03-14T05:52:37.7948149Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local 2025-03-14T05:52:37.7949072Z @xla//xla/mlir_hlo:mhlo_passes; 18s local ... 2025-03-14T05:52:38.0420117Z 2025-03-14T05:52:38.0420944Z  2025-03-14T05:52:38.0421443Z  2025-03-14T05:52:38.0421840Z  2025-03-14T05:52:38.0422269Z  2025-03-14T05:52:38.0422682Z  2025-03-14T05:52:38.0423075Z  2025-03-14T05:52:38.0423484Z  2025-03-14T05:52:38.0423908Z  2025-03-14T05:52:38.0424511Z [14,983 / 15,235] 48 actions, 47 running 2025-03-14T05:52:38.0425343Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T05:52:38.0426207Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T05:52:38.0427020Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T05:52:38.0427839Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T05:52:38.0428840Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2025-03-14T05:52:38.0429601Z @stablehlo//:stablehlo_passes; 27s local 2025-03-14T05:52:38.0430753Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local 2025-03-14T05:52:38.0431657Z @xla//xla/mlir_hlo:mhlo_passes; 18s local ... 2025-03-14T05:52:38.2440460Z 2025-03-14T05:52:38.2441346Z  2025-03-14T05:52:38.2441815Z  2025-03-14T05:52:38.2442214Z  2025-03-14T05:52:38.2442605Z  2025-03-14T05:52:38.2442994Z  2025-03-14T05:52:38.2443437Z  2025-03-14T05:52:38.2443845Z  2025-03-14T05:52:38.2444271Z  2025-03-14T05:52:38.2445299Z [14,984 / 15,235] 48 actions, 47 running 2025-03-14T05:52:38.2446127Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T05:52:38.2446978Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T05:52:38.2447812Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 45s local 2025-03-14T05:52:38.2448622Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2025-03-14T05:52:38.2449433Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2025-03-14T05:52:38.2450201Z @stablehlo//:stablehlo_passes; 27s local 2025-03-14T05:52:38.2451100Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2025-03-14T05:52:38.2452030Z @xla//xla/mlir_hlo:mhlo_passes; 19s local ... 2025-03-14T05:52:38.5540179Z 2025-03-14T05:52:38.5541062Z  2025-03-14T05:52:38.5541555Z  2025-03-14T05:52:38.5542228Z  2025-03-14T05:52:38.5542628Z  2025-03-14T05:52:38.5543017Z  2025-03-14T05:52:38.5543441Z  2025-03-14T05:52:38.5543878Z  2025-03-14T05:52:38.5544283Z  2025-03-14T05:52:38.5544869Z [14,986 / 15,235] 48 actions, 47 running 2025-03-14T05:52:38.5545623Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T05:52:38.5546384Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T05:52:38.5547176Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 45s local 2025-03-14T05:52:38.5547958Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2025-03-14T05:52:38.5548827Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2025-03-14T05:52:38.5549580Z @stablehlo//:stablehlo_passes; 27s local 2025-03-14T05:52:38.5550367Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2025-03-14T05:52:38.5551249Z @xla//xla/mlir_hlo:mhlo_passes; 19s local ... 2025-03-14T05:52:38.7907870Z 2025-03-14T05:52:38.7908752Z  2025-03-14T05:52:38.7909247Z  2025-03-14T05:52:38.7909662Z  2025-03-14T05:52:38.7910079Z  2025-03-14T05:52:38.7910467Z  2025-03-14T05:52:38.7910862Z  2025-03-14T05:52:38.7911538Z  2025-03-14T05:52:38.7911914Z  2025-03-14T05:52:38.7912503Z [14,988 / 15,235] 48 actions running 2025-03-14T05:52:38.7913315Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T05:52:38.7914156Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T05:52:38.7914937Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2025-03-14T05:52:38.7915803Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2025-03-14T05:52:38.7916582Z @stablehlo//:stablehlo_passes; 28s local 2025-03-14T05:52:38.7917432Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2025-03-14T05:52:38.7918320Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T05:52:38.7919062Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2025-03-14T05:52:39.2158859Z 2025-03-14T05:52:39.2159692Z  2025-03-14T05:52:39.2160206Z  2025-03-14T05:52:39.2160637Z  2025-03-14T05:52:39.2161042Z  2025-03-14T05:52:39.2161460Z  2025-03-14T05:52:39.2161851Z  2025-03-14T05:52:39.2162243Z  2025-03-14T05:52:39.2162615Z  2025-03-14T05:52:39.2163222Z [14,989 / 15,235] 48 actions, 47 running 2025-03-14T05:52:39.2163998Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T05:52:39.2165012Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T05:52:39.2166282Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2025-03-14T05:52:39.2167013Z @stablehlo//:stablehlo_passes; 28s local 2025-03-14T05:52:39.2167805Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T05:52:39.2168604Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T05:52:39.2169239Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T05:52:39.2170126Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 16s local ... 2025-03-14T05:52:39.5916485Z 2025-03-14T05:52:39.5917619Z  2025-03-14T05:52:39.5918108Z  2025-03-14T05:52:39.5918494Z  2025-03-14T05:52:39.5918897Z  2025-03-14T05:52:39.5919447Z  2025-03-14T05:52:39.5919824Z  2025-03-14T05:52:39.5920193Z  2025-03-14T05:52:39.5920622Z  2025-03-14T05:52:39.5921270Z [14,990 / 15,235] 48 actions running 2025-03-14T05:52:39.5922044Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2025-03-14T05:52:39.5922883Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2025-03-14T05:52:39.5923669Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2025-03-14T05:52:39.5924399Z @stablehlo//:stablehlo_passes; 28s local 2025-03-14T05:52:39.5925375Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T05:52:39.5926208Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T05:52:39.5927150Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T05:52:39.5927951Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 16s local ... 2025-03-14T05:52:40.4935546Z 2025-03-14T05:52:40.4936413Z  2025-03-14T05:52:40.4936894Z  2025-03-14T05:52:40.4937305Z  2025-03-14T05:52:40.4937693Z  2025-03-14T05:52:40.4938085Z  2025-03-14T05:52:40.4938470Z  2025-03-14T05:52:40.4938876Z  2025-03-14T05:52:40.4939282Z  2025-03-14T05:52:40.4939941Z [14,991 / 15,235] 48 actions, 47 running 2025-03-14T05:52:40.4940697Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2025-03-14T05:52:40.4941473Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2025-03-14T05:52:40.4942236Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T05:52:40.4942959Z @stablehlo//:stablehlo_passes; 29s local 2025-03-14T05:52:40.4943754Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2025-03-14T05:52:40.4944617Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T05:52:40.4945306Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T05:52:40.4946178Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 17s local ... 2025-03-14T05:52:40.7924747Z 2025-03-14T05:52:40.7925650Z  2025-03-14T05:52:40.7926151Z  2025-03-14T05:52:40.7926548Z  2025-03-14T05:52:40.7926979Z  2025-03-14T05:52:40.7927485Z  2025-03-14T05:52:40.7927915Z  2025-03-14T05:52:40.7928297Z  2025-03-14T05:52:40.7928675Z  2025-03-14T05:52:40.7929267Z [14,991 / 15,235] 48 actions running 2025-03-14T05:52:40.7930088Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T05:52:40.7930909Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T05:52:40.7931656Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T05:52:40.7932337Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T05:52:40.7933144Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2025-03-14T05:52:40.7933987Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T05:52:40.7934643Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T05:52:40.7935546Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 17s local ... 2025-03-14T05:52:41.1929101Z 2025-03-14T05:52:41.1929851Z  2025-03-14T05:52:41.1930245Z  2025-03-14T05:52:41.1930578Z  2025-03-14T05:52:41.1930906Z  2025-03-14T05:52:41.1931229Z  2025-03-14T05:52:41.1931548Z  2025-03-14T05:52:41.1931868Z  2025-03-14T05:52:41.1932464Z  2025-03-14T05:52:41.1932939Z [14,992 / 15,235] 48 actions running 2025-03-14T05:52:41.1933596Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T05:52:41.1934271Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T05:52:41.1934909Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T05:52:41.1935515Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T05:52:41.1936307Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2025-03-14T05:52:41.1937018Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T05:52:41.1937554Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T05:52:41.1938243Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 18s local ... 2025-03-14T05:52:41.3932592Z 2025-03-14T05:52:41.3933556Z  2025-03-14T05:52:41.3933972Z  2025-03-14T05:52:41.3934333Z  2025-03-14T05:52:41.3934694Z  2025-03-14T05:52:41.3935091Z  2025-03-14T05:52:41.3935445Z  2025-03-14T05:52:41.3935813Z  2025-03-14T05:52:41.3936154Z  2025-03-14T05:52:41.3936655Z [14,993 / 15,235] 48 actions running 2025-03-14T05:52:41.3937349Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T05:52:41.3938089Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T05:52:41.3938998Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T05:52:41.3939636Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T05:52:41.3940363Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2025-03-14T05:52:41.3941123Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T05:52:41.3941745Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T05:52:41.3942547Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 18s local ... 2025-03-14T05:52:41.7937563Z 2025-03-14T05:52:41.7938394Z  2025-03-14T05:52:41.7938855Z  2025-03-14T05:52:41.7939241Z  2025-03-14T05:52:41.7939628Z  2025-03-14T05:52:41.7940010Z  2025-03-14T05:52:41.7940398Z  2025-03-14T05:52:41.7940774Z  2025-03-14T05:52:41.7941153Z  2025-03-14T05:52:41.7941686Z [14,994 / 15,235] 48 actions running 2025-03-14T05:52:41.7942433Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T05:52:41.7943272Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T05:52:41.7944072Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T05:52:41.7944780Z @stablehlo//:stablehlo_passes; 31s local 2025-03-14T05:52:41.7945930Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2025-03-14T05:52:41.7946785Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T05:52:41.7947396Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T05:52:41.7948177Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 18s local ... 2025-03-14T05:52:42.5339936Z 2025-03-14T05:52:42.5340812Z  2025-03-14T05:52:42.5341286Z  2025-03-14T05:52:42.5341641Z  2025-03-14T05:52:42.5342031Z  2025-03-14T05:52:42.5342422Z  2025-03-14T05:52:42.5342832Z  2025-03-14T05:52:42.5343213Z  2025-03-14T05:52:42.5343562Z  2025-03-14T05:52:42.5344123Z [14,995 / 15,235] 48 actions, 47 running 2025-03-14T05:52:42.5344908Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T05:52:42.5345753Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T05:52:42.5346510Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T05:52:42.5347276Z @stablehlo//:stablehlo_passes; 31s local 2025-03-14T05:52:42.5348144Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T05:52:42.5348963Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T05:52:42.5349643Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T05:52:42.5350781Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 19s local ... 2025-03-14T05:52:42.7945883Z 2025-03-14T05:52:42.7946801Z  2025-03-14T05:52:42.7947291Z  2025-03-14T05:52:42.7947690Z  2025-03-14T05:52:42.7948109Z  2025-03-14T05:52:42.7948511Z  2025-03-14T05:52:42.7948911Z  2025-03-14T05:52:42.7949334Z  2025-03-14T05:52:42.7949731Z  2025-03-14T05:52:42.7950330Z [14,995 / 15,235] 48 actions running 2025-03-14T05:52:42.7951383Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T05:52:42.7952229Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T05:52:42.7952977Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T05:52:42.7953657Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T05:52:42.7954476Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T05:52:42.7955266Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T05:52:42.7955948Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T05:52:42.7956802Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 19s local ... 2025-03-14T05:52:43.0486864Z 2025-03-14T05:52:43.0487722Z  2025-03-14T05:52:43.0488216Z  2025-03-14T05:52:43.0488606Z  2025-03-14T05:52:43.0489003Z  2025-03-14T05:52:43.0489361Z  2025-03-14T05:52:43.0489761Z  2025-03-14T05:52:43.0490410Z  2025-03-14T05:52:43.0490799Z  2025-03-14T05:52:43.0491415Z [14,996 / 15,235] 48 actions, 47 running 2025-03-14T05:52:43.0492181Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T05:52:43.0493028Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T05:52:43.0493817Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T05:52:43.0494565Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T05:52:43.0495400Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T05:52:43.0496281Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T05:52:43.0496971Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T05:52:43.0497822Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 20s local ... 2025-03-14T05:52:43.3921617Z 2025-03-14T05:52:43.3922476Z  2025-03-14T05:52:43.3922987Z  2025-03-14T05:52:43.3923409Z  2025-03-14T05:52:43.3923895Z  2025-03-14T05:52:43.3924272Z  2025-03-14T05:52:43.3924819Z  2025-03-14T05:52:43.3925221Z  2025-03-14T05:52:43.3925641Z  2025-03-14T05:52:43.3926257Z [14,998 / 15,235] 48 actions, 47 running 2025-03-14T05:52:43.3927359Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T05:52:43.3928220Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T05:52:43.3929022Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T05:52:43.3929766Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T05:52:43.3930735Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T05:52:43.3931610Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T05:52:43.3932284Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T05:52:43.3933132Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 20s local ... 2025-03-14T05:52:43.5953062Z 2025-03-14T05:52:43.5953933Z  2025-03-14T05:52:43.5954478Z  2025-03-14T05:52:43.5954867Z  2025-03-14T05:52:43.5955264Z  2025-03-14T05:52:43.5955661Z  2025-03-14T05:52:43.5956074Z  2025-03-14T05:52:43.5956473Z  2025-03-14T05:52:43.5956880Z  2025-03-14T05:52:43.5957463Z [14,999 / 15,235] 48 actions running 2025-03-14T05:52:43.5958253Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T05:52:43.5959097Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T05:52:43.5959896Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T05:52:43.5960879Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T05:52:43.5961756Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T05:52:43.5962659Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T05:52:43.5963366Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T05:52:43.5964250Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 20s local ... 2025-03-14T05:52:43.9830964Z 2025-03-14T05:52:43.9831787Z  2025-03-14T05:52:43.9832254Z  2025-03-14T05:52:43.9832591Z  2025-03-14T05:52:43.9833248Z  2025-03-14T05:52:43.9833693Z  2025-03-14T05:52:43.9834117Z  2025-03-14T05:52:43.9834511Z  2025-03-14T05:52:43.9834866Z  2025-03-14T05:52:43.9835469Z [15,001 / 15,235] 48 actions, 47 running 2025-03-14T05:52:43.9836270Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T05:52:43.9837126Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T05:52:43.9837999Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T05:52:43.9838991Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T05:52:43.9839966Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T05:52:43.9840617Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T05:52:43.9841473Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 21s local 2025-03-14T05:52:43.9842522Z @xla//xla/mlir_hlo:mhlo_passes; 20s local ... 2025-03-14T05:52:44.1873426Z 2025-03-14T05:52:44.1874256Z  2025-03-14T05:52:44.1874798Z  2025-03-14T05:52:44.1875230Z  2025-03-14T05:52:44.1875622Z  2025-03-14T05:52:44.1876019Z  2025-03-14T05:52:44.1876430Z  2025-03-14T05:52:44.1876823Z  2025-03-14T05:52:44.1877203Z  2025-03-14T05:52:44.1877812Z [15,002 / 15,235] 48 actions, 47 running 2025-03-14T05:52:44.1878585Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T05:52:44.1879381Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T05:52:44.1880181Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2025-03-14T05:52:44.1881111Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T05:52:44.1881967Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T05:52:44.1882760Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 21s local 2025-03-14T05:52:44.1883564Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T05:52:44.1884469Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 19s local ... 2025-03-14T05:52:44.3959784Z 2025-03-14T05:52:44.3960664Z  2025-03-14T05:52:44.3961168Z  2025-03-14T05:52:44.3961576Z  2025-03-14T05:52:44.3961990Z  2025-03-14T05:52:44.3962357Z  2025-03-14T05:52:44.3962675Z  2025-03-14T05:52:44.3962992Z  2025-03-14T05:52:44.3963311Z  2025-03-14T05:52:44.3963831Z [15,002 / 15,235] 48 actions running 2025-03-14T05:52:44.3964802Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T05:52:44.3965954Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T05:52:44.3966751Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2025-03-14T05:52:44.3967686Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2025-03-14T05:52:44.3968598Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T05:52:44.3969455Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 21s local 2025-03-14T05:52:44.3970283Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T05:52:44.3971179Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 19s local ... 2025-03-14T05:52:45.3968396Z 2025-03-14T05:52:45.3969253Z  2025-03-14T05:52:45.3969780Z  2025-03-14T05:52:45.3970209Z  2025-03-14T05:52:45.3970629Z  2025-03-14T05:52:45.3971054Z  2025-03-14T05:52:45.3971447Z  2025-03-14T05:52:45.3971868Z  2025-03-14T05:52:45.3972270Z  2025-03-14T05:52:45.3973132Z [15,002 / 15,235] 48 actions running 2025-03-14T05:52:45.3973904Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2025-03-14T05:52:45.3974726Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2025-03-14T05:52:45.3975576Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2025-03-14T05:52:45.3976489Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2025-03-14T05:52:45.3977503Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T05:52:45.3978495Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 22s local 2025-03-14T05:52:45.3979296Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T05:52:45.3980213Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local ... 2025-03-14T05:52:45.6118952Z 2025-03-14T05:52:45.6119832Z  2025-03-14T05:52:45.6120324Z  2025-03-14T05:52:45.6120708Z  2025-03-14T05:52:45.6121083Z  2025-03-14T05:52:45.6121459Z  2025-03-14T05:52:45.6121842Z  2025-03-14T05:52:45.6122275Z  2025-03-14T05:52:45.6122680Z  2025-03-14T05:52:45.6123285Z [15,003 / 15,235] 48 actions, 47 running 2025-03-14T05:52:45.6124047Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T05:52:45.6124998Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T05:52:45.6125753Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2025-03-14T05:52:45.6127021Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2025-03-14T05:52:45.6127935Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T05:52:45.6128756Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 22s local 2025-03-14T05:52:45.6129573Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T05:52:45.6130485Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local ... 2025-03-14T05:52:45.9974210Z 2025-03-14T05:52:45.9975060Z  2025-03-14T05:52:45.9975531Z  2025-03-14T05:52:45.9975927Z  2025-03-14T05:52:45.9976366Z  2025-03-14T05:52:45.9976763Z  2025-03-14T05:52:45.9977132Z  2025-03-14T05:52:45.9977493Z  2025-03-14T05:52:45.9977900Z  2025-03-14T05:52:45.9978479Z [15,004 / 15,235] 48 actions running 2025-03-14T05:52:45.9979364Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T05:52:45.9980249Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T05:52:45.9981078Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2025-03-14T05:52:45.9981929Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T05:52:45.9983094Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local 2025-03-14T05:52:45.9983862Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T05:52:45.9984745Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 20s local 2025-03-14T05:52:45.9985661Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2025-03-14T05:52:46.2073551Z 2025-03-14T05:52:46.2074364Z  2025-03-14T05:52:46.2074800Z  2025-03-14T05:52:46.2075159Z  2025-03-14T05:52:46.2075509Z  2025-03-14T05:52:46.2075856Z  2025-03-14T05:52:46.2076211Z  2025-03-14T05:52:46.2076565Z  2025-03-14T05:52:46.2076912Z  2025-03-14T05:52:46.2077451Z [15,005 / 15,235] 48 actions, 47 running 2025-03-14T05:52:46.2078192Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T05:52:46.2078959Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T05:52:46.2079760Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T05:52:46.2080523Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T05:52:46.2081214Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local 2025-03-14T05:52:46.2081954Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T05:52:46.2082715Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local 2025-03-14T05:52:46.2083773Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2025-03-14T05:52:46.5979436Z 2025-03-14T05:52:46.5980241Z  2025-03-14T05:52:46.5980662Z  2025-03-14T05:52:46.5981018Z  2025-03-14T05:52:46.5981361Z  2025-03-14T05:52:46.5981716Z  2025-03-14T05:52:46.5982061Z  2025-03-14T05:52:46.5982394Z  2025-03-14T05:52:46.5982763Z  2025-03-14T05:52:46.5983225Z [15,005 / 15,235] 48 actions running 2025-03-14T05:52:46.5984180Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T05:52:46.5984903Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T05:52:46.5985729Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T05:52:46.5986451Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T05:52:46.5987143Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local 2025-03-14T05:52:46.5987838Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T05:52:46.5988602Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local 2025-03-14T05:52:46.5989442Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2025-03-14T05:52:46.8003464Z 2025-03-14T05:52:46.8004237Z  2025-03-14T05:52:46.8004797Z  2025-03-14T05:52:46.8005143Z  2025-03-14T05:52:46.8005488Z  2025-03-14T05:52:46.8005831Z  2025-03-14T05:52:46.8006418Z  2025-03-14T05:52:46.8006759Z  2025-03-14T05:52:46.8007096Z  2025-03-14T05:52:46.8007614Z [15,006 / 15,235] 48 actions, 47 running 2025-03-14T05:52:46.8008300Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T05:52:46.8008998Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T05:52:46.8009764Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T05:52:46.8010490Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T05:52:46.8011144Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local 2025-03-14T05:52:46.8011836Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T05:52:46.8012547Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local 2025-03-14T05:52:46.8013354Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2025-03-14T05:52:47.1052273Z 2025-03-14T05:52:47.1053037Z  2025-03-14T05:52:47.1053428Z  2025-03-14T05:52:47.1053789Z  2025-03-14T05:52:47.1054100Z  2025-03-14T05:52:47.1054410Z  2025-03-14T05:52:47.1054723Z  2025-03-14T05:52:47.1055042Z  2025-03-14T05:52:47.1055352Z  2025-03-14T05:52:47.1056098Z [15,008 / 15,235] 48 actions, 47 running 2025-03-14T05:52:47.1056717Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T05:52:47.1057350Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T05:52:47.1058047Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T05:52:47.1058706Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T05:52:47.1059321Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local 2025-03-14T05:52:47.1059946Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T05:52:47.1060611Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 22s local 2025-03-14T05:52:47.1061344Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2025-03-14T05:52:47.3462193Z 2025-03-14T05:52:47.3463081Z  2025-03-14T05:52:47.3463694Z  2025-03-14T05:52:47.3464107Z  2025-03-14T05:52:47.3464549Z  2025-03-14T05:52:47.3464968Z  2025-03-14T05:52:47.3465676Z  2025-03-14T05:52:47.3466112Z  2025-03-14T05:52:47.3466510Z  2025-03-14T05:52:47.3467103Z [15,009 / 15,235] 48 actions, 47 running 2025-03-14T05:52:47.3467892Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T05:52:47.3468732Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T05:52:47.3470057Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T05:52:47.3470945Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T05:52:47.3471751Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local 2025-03-14T05:52:47.3472541Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T05:52:47.3473235Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T05:52:47.3474267Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 17s local ... 2025-03-14T05:52:47.5775001Z 2025-03-14T05:52:47.5775815Z  2025-03-14T05:52:47.5776508Z  2025-03-14T05:52:47.5776948Z  2025-03-14T05:52:47.5777351Z  2025-03-14T05:52:47.5777710Z  2025-03-14T05:52:47.5778076Z  2025-03-14T05:52:47.5778511Z  2025-03-14T05:52:47.5778881Z  2025-03-14T05:52:47.5779450Z [15,010 / 15,235] 48 actions, 47 running 2025-03-14T05:52:47.5780226Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T05:52:47.5781013Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T05:52:47.5781874Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T05:52:47.5782734Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T05:52:47.5783497Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local 2025-03-14T05:52:47.5784288Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T05:52:47.5785279Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T05:52:47.5786262Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 17s local ... 2025-03-14T05:52:47.7989809Z 2025-03-14T05:52:47.7990688Z  2025-03-14T05:52:47.7991147Z  2025-03-14T05:52:47.7991531Z  2025-03-14T05:52:47.7991916Z  2025-03-14T05:52:47.7992306Z  2025-03-14T05:52:47.7992676Z  2025-03-14T05:52:47.7993061Z  2025-03-14T05:52:47.7993438Z  2025-03-14T05:52:47.7993995Z [15,010 / 15,235] 48 actions running 2025-03-14T05:52:47.7994802Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T05:52:47.7995625Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T05:52:47.7996528Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T05:52:47.7997380Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T05:52:47.7998145Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local 2025-03-14T05:52:47.7998961Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T05:52:47.7999667Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T05:52:47.8000640Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local ... 2025-03-14T05:52:47.9997657Z 2025-03-14T05:52:47.9998462Z  2025-03-14T05:52:47.9998944Z  2025-03-14T05:52:47.9999466Z  2025-03-14T05:52:47.9999905Z  2025-03-14T05:52:48.0000322Z  2025-03-14T05:52:48.0000723Z  2025-03-14T05:52:48.0001140Z  2025-03-14T05:52:48.0001503Z  2025-03-14T05:52:48.0002117Z [15,011 / 15,235] 48 actions running 2025-03-14T05:52:48.0002970Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T05:52:48.0003851Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T05:52:48.0004940Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T05:52:48.0005832Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T05:52:48.0006671Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2025-03-14T05:52:48.0007517Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T05:52:48.0008233Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T05:52:48.0009266Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local ... 2025-03-14T05:52:48.4986136Z 2025-03-14T05:52:48.4987056Z  2025-03-14T05:52:48.4987668Z  2025-03-14T05:52:48.4988060Z  2025-03-14T05:52:48.4988439Z  2025-03-14T05:52:48.4988800Z  2025-03-14T05:52:48.4989206Z  2025-03-14T05:52:48.4989926Z  2025-03-14T05:52:48.4990347Z  2025-03-14T05:52:48.4990921Z [15,013 / 15,235] 47 actions, 46 running 2025-03-14T05:52:48.4991741Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T05:52:48.4992620Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T05:52:48.4993572Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2025-03-14T05:52:48.4994486Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T05:52:48.4995466Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2025-03-14T05:52:48.4996314Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T05:52:48.4996989Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T05:52:48.4997994Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local ... 2025-03-14T05:52:48.7999428Z 2025-03-14T05:52:48.8000327Z  2025-03-14T05:52:48.8000788Z  2025-03-14T05:52:48.8001186Z  2025-03-14T05:52:48.8001577Z  2025-03-14T05:52:48.8002015Z  2025-03-14T05:52:48.8002438Z  2025-03-14T05:52:48.8002843Z  2025-03-14T05:52:48.8003283Z  2025-03-14T05:52:48.8003886Z [15,013 / 15,235] 48 actions running 2025-03-14T05:52:48.8004839Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2025-03-14T05:52:48.8005718Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2025-03-14T05:52:48.8006872Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2025-03-14T05:52:48.8007744Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T05:52:48.8008561Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2025-03-14T05:52:48.8009382Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T05:52:48.8010648Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T05:52:48.8011581Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local ... 2025-03-14T05:52:49.8010148Z 2025-03-14T05:52:49.8011041Z  2025-03-14T05:52:49.8011585Z  2025-03-14T05:52:49.8011974Z  2025-03-14T05:52:49.8012378Z  2025-03-14T05:52:49.8012783Z  2025-03-14T05:52:49.8013149Z  2025-03-14T05:52:49.8013534Z  2025-03-14T05:52:49.8013938Z  2025-03-14T05:52:49.8014460Z [15,013 / 15,235] 48 actions running 2025-03-14T05:52:49.8015243Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2025-03-14T05:52:49.8016064Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2025-03-14T05:52:49.8017004Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2025-03-14T05:52:49.8018100Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T05:52:49.8018881Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2025-03-14T05:52:49.8019679Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T05:52:49.8020362Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T05:52:49.8021375Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local ... 2025-03-14T05:52:50.5742741Z 2025-03-14T05:52:50.5743609Z  2025-03-14T05:52:50.5744071Z  2025-03-14T05:52:50.5744433Z  2025-03-14T05:52:50.5744789Z  2025-03-14T05:52:50.5745181Z  2025-03-14T05:52:50.5745586Z  2025-03-14T05:52:50.5745977Z  2025-03-14T05:52:50.5746360Z  2025-03-14T05:52:50.5746990Z [15,014 / 15,235] 48 actions, 47 running 2025-03-14T05:52:50.5747813Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T05:52:50.5748627Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T05:52:50.5749493Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T05:52:50.5750358Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T05:52:50.5751155Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2025-03-14T05:52:50.5751957Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T05:52:50.5752931Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T05:52:50.5753909Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local ... 2025-03-14T05:52:50.7759654Z 2025-03-14T05:52:50.7760486Z  2025-03-14T05:52:50.7760953Z  2025-03-14T05:52:50.7761360Z  2025-03-14T05:52:50.7761758Z  2025-03-14T05:52:50.7762156Z  2025-03-14T05:52:50.7762562Z  2025-03-14T05:52:50.7762948Z  2025-03-14T05:52:50.7763330Z  2025-03-14T05:52:50.7764189Z [15,015 / 15,235] 48 actions, 47 running 2025-03-14T05:52:50.7765208Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T05:52:50.7766219Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T05:52:50.7767168Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T05:52:50.7768082Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T05:52:50.7768932Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2025-03-14T05:52:50.7769788Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T05:52:50.7770390Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T05:52:50.7771180Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local ... 2025-03-14T05:52:51.0017074Z 2025-03-14T05:52:51.0017904Z  2025-03-14T05:52:51.0018402Z  2025-03-14T05:52:51.0018838Z  2025-03-14T05:52:51.0019511Z  2025-03-14T05:52:51.0019922Z  2025-03-14T05:52:51.0020355Z  2025-03-14T05:52:51.0020741Z  2025-03-14T05:52:51.0021144Z  2025-03-14T05:52:51.0021739Z [15,015 / 15,235] 48 actions running 2025-03-14T05:52:51.0022983Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T05:52:51.0024104Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T05:52:51.0025175Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T05:52:51.0026189Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T05:52:51.0027135Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2025-03-14T05:52:51.0028056Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T05:52:51.0030222Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T05:52:51.0032717Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local ... 2025-03-14T05:52:52.0026509Z 2025-03-14T05:52:52.0027396Z  2025-03-14T05:52:52.0028556Z  2025-03-14T05:52:52.0028986Z  2025-03-14T05:52:52.0029382Z  2025-03-14T05:52:52.0029813Z  2025-03-14T05:52:52.0030212Z  2025-03-14T05:52:52.0030975Z  2025-03-14T05:52:52.0031381Z  2025-03-14T05:52:52.0031953Z [15,015 / 15,235] 48 actions running 2025-03-14T05:52:52.0032782Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2025-03-14T05:52:52.0033595Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2025-03-14T05:52:52.0034476Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2025-03-14T05:52:52.0035348Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T05:52:52.0036136Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2025-03-14T05:52:52.0036934Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T05:52:52.0037612Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T05:52:52.0038663Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local ... 2025-03-14T05:52:52.4082793Z 2025-03-14T05:52:52.4083676Z  2025-03-14T05:52:52.4084336Z  2025-03-14T05:52:52.4084892Z  2025-03-14T05:52:52.4085268Z  2025-03-14T05:52:52.4085640Z  2025-03-14T05:52:52.4086011Z  2025-03-14T05:52:52.4086395Z  2025-03-14T05:52:52.4086782Z  2025-03-14T05:52:52.4087345Z [15,016 / 15,235] 48 actions, 47 running 2025-03-14T05:52:52.4088081Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2025-03-14T05:52:52.4088949Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T05:52:52.4090064Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T05:52:52.4090814Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2025-03-14T05:52:52.4091557Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T05:52:52.4092203Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T05:52:52.4102868Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2025-03-14T05:52:52.4104355Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 20s local ... 2025-03-14T05:52:52.6314661Z 2025-03-14T05:52:52.6316207Z  2025-03-14T05:52:52.6316655Z  2025-03-14T05:52:52.6317024Z  2025-03-14T05:52:52.6317369Z  2025-03-14T05:52:52.6317696Z  2025-03-14T05:52:52.6318040Z  2025-03-14T05:52:52.6318376Z  2025-03-14T05:52:52.6318735Z  2025-03-14T05:52:52.6319273Z [15,017 / 15,235] 48 actions, 47 running 2025-03-14T05:52:52.6319941Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T05:52:52.6320773Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T05:52:52.6321515Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T05:52:52.6322252Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2025-03-14T05:52:52.6322951Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T05:52:52.6323985Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T05:52:52.6325030Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 20s local 2025-03-14T05:52:52.6325787Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local ... 2025-03-14T05:52:53.0033066Z 2025-03-14T05:52:53.0033881Z  2025-03-14T05:52:53.0034293Z  2025-03-14T05:52:53.0034633Z  2025-03-14T05:52:53.0034989Z  2025-03-14T05:52:53.0035328Z  2025-03-14T05:52:53.0035667Z  2025-03-14T05:52:53.0036004Z  2025-03-14T05:52:53.0036342Z  2025-03-14T05:52:53.0036844Z [15,017 / 15,235] 48 actions running 2025-03-14T05:52:53.0037653Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T05:52:53.0038435Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T05:52:53.0039174Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T05:52:53.0039922Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2025-03-14T05:52:53.0040687Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T05:52:53.0041533Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T05:52:53.0042385Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 20s local 2025-03-14T05:52:53.0043458Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local ... 2025-03-14T05:52:53.4247010Z 2025-03-14T05:52:53.4247809Z  2025-03-14T05:52:53.4248290Z  2025-03-14T05:52:53.4248662Z  2025-03-14T05:52:53.4249057Z  2025-03-14T05:52:53.4249454Z  2025-03-14T05:52:53.4249846Z  2025-03-14T05:52:53.4250218Z  2025-03-14T05:52:53.4250587Z  2025-03-14T05:52:53.4251139Z [15,018 / 15,235] 48 actions, 47 running 2025-03-14T05:52:53.4251855Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T05:52:53.4252731Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T05:52:53.4253545Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T05:52:53.4254323Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2025-03-14T05:52:53.4255105Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T05:52:53.4255935Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T05:52:53.4256922Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 21s local 2025-03-14T05:52:53.4257719Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local ... 2025-03-14T05:52:53.8040131Z 2025-03-14T05:52:53.8040898Z  2025-03-14T05:52:53.8041321Z  2025-03-14T05:52:53.8041680Z  2025-03-14T05:52:53.8042029Z  2025-03-14T05:52:53.8042664Z  2025-03-14T05:52:53.8043031Z  2025-03-14T05:52:53.8043404Z  2025-03-14T05:52:53.8043748Z  2025-03-14T05:52:53.8044256Z [15,018 / 15,235] 48 actions running 2025-03-14T05:52:53.8045095Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T05:52:53.8045930Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T05:52:53.8046726Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T05:52:53.8047589Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2025-03-14T05:52:53.8048330Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T05:52:53.8049289Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T05:52:53.8050332Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 21s local 2025-03-14T05:52:53.8051110Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local ... 2025-03-14T05:52:54.1266676Z 2025-03-14T05:52:54.1267490Z  2025-03-14T05:52:54.1267948Z  2025-03-14T05:52:54.1268348Z  2025-03-14T05:52:54.1268722Z  2025-03-14T05:52:54.1269112Z  2025-03-14T05:52:54.1269494Z  2025-03-14T05:52:54.1270019Z  2025-03-14T05:52:54.1270399Z  2025-03-14T05:52:54.1270966Z [15,019 / 15,235] 48 actions, 47 running 2025-03-14T05:52:54.1271669Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T05:52:54.1272791Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T05:52:54.1273620Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T05:52:54.1274381Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2025-03-14T05:52:54.1275163Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T05:52:54.1276023Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T05:52:54.1277090Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 22s local 2025-03-14T05:52:54.1277922Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local ... 2025-03-14T05:52:54.4046957Z 2025-03-14T05:52:54.4047758Z  2025-03-14T05:52:54.4048193Z  2025-03-14T05:52:54.4048579Z  2025-03-14T05:52:54.4048928Z  2025-03-14T05:52:54.4049292Z  2025-03-14T05:52:54.4049634Z  2025-03-14T05:52:54.4049969Z  2025-03-14T05:52:54.4050325Z  2025-03-14T05:52:54.4050823Z [15,019 / 15,235] 48 actions running 2025-03-14T05:52:54.4051501Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T05:52:54.4052329Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2025-03-14T05:52:54.4053484Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T05:52:54.4054182Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2025-03-14T05:52:54.4054878Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T05:52:54.4055636Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T05:52:54.4056691Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 22s local 2025-03-14T05:52:54.4057405Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local ... 2025-03-14T05:52:55.0695358Z 2025-03-14T05:52:55.0696257Z  2025-03-14T05:52:55.0696762Z  2025-03-14T05:52:55.0697180Z  2025-03-14T05:52:55.0697613Z  2025-03-14T05:52:55.0698045Z  2025-03-14T05:52:55.0698455Z  2025-03-14T05:52:55.0698863Z  2025-03-14T05:52:55.0699263Z  2025-03-14T05:52:55.0699874Z [15,020 / 15,235] 48 actions, 47 running 2025-03-14T05:52:55.0700677Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2025-03-14T05:52:55.0701619Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2025-03-14T05:52:55.0702497Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T05:52:55.0703122Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T05:52:55.0704026Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2025-03-14T05:52:55.0705414Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 23s local 2025-03-14T05:52:55.0706207Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local 2025-03-14T05:52:55.0707082Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 20s local ... 2025-03-14T05:52:55.4055581Z 2025-03-14T05:52:55.4056413Z  2025-03-14T05:52:55.4056908Z  2025-03-14T05:52:55.4057344Z  2025-03-14T05:52:55.4057745Z  2025-03-14T05:52:55.4058184Z  2025-03-14T05:52:55.4058608Z  2025-03-14T05:52:55.4059000Z  2025-03-14T05:52:55.4059401Z  2025-03-14T05:52:55.4060264Z [15,020 / 15,235] 48 actions running 2025-03-14T05:52:55.4061069Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2025-03-14T05:52:55.4062044Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T05:52:55.4062912Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T05:52:55.4063489Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T05:52:55.4064330Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2025-03-14T05:52:55.4065557Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 23s local 2025-03-14T05:52:55.4066379Z Compiling xla/pjrt/mlir_to_hlo.cc; 23s local 2025-03-14T05:52:55.4067224Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 21s local ... 2025-03-14T05:52:55.6807020Z 2025-03-14T05:52:55.6808029Z  2025-03-14T05:52:55.6808831Z  2025-03-14T05:52:55.6809225Z  2025-03-14T05:52:55.6809625Z  2025-03-14T05:52:55.6810037Z  2025-03-14T05:52:55.6810428Z  2025-03-14T05:52:55.6810817Z  2025-03-14T05:52:55.6811214Z  2025-03-14T05:52:55.6811823Z [15,021 / 15,235] 48 actions, 47 running 2025-03-14T05:52:55.6812598Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T05:52:55.6813487Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T05:52:55.6814302Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T05:52:55.6814939Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T05:52:55.6815729Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 26s local 2025-03-14T05:52:55.6816759Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 23s local 2025-03-14T05:52:55.6817561Z Compiling xla/pjrt/mlir_to_hlo.cc; 23s local 2025-03-14T05:52:55.6818278Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 21s local ... 2025-03-14T05:52:55.8920884Z 2025-03-14T05:52:55.8921718Z  2025-03-14T05:52:55.8922194Z  2025-03-14T05:52:55.8922620Z  2025-03-14T05:52:55.8923064Z  2025-03-14T05:52:55.8923915Z  2025-03-14T05:52:55.8924331Z  2025-03-14T05:52:55.8924909Z  2025-03-14T05:52:55.8925320Z  2025-03-14T05:52:55.8925875Z [15,022 / 15,235] 48 actions, 47 running 2025-03-14T05:52:55.8926535Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T05:52:55.8927316Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T05:52:55.8928074Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T05:52:55.8928657Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T05:52:55.8929332Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 23s local 2025-03-14T05:52:55.8930240Z Compiling xla/pjrt/mlir_to_hlo.cc; 23s local 2025-03-14T05:52:55.8930972Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 21s local 2025-03-14T05:52:55.8931840Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 21s local ... 2025-03-14T05:52:56.1220313Z 2025-03-14T05:52:56.1221131Z  2025-03-14T05:52:56.1221599Z  2025-03-14T05:52:56.1221997Z  2025-03-14T05:52:56.1222398Z  2025-03-14T05:52:56.1222794Z  2025-03-14T05:52:56.1223204Z  2025-03-14T05:52:56.1223616Z  2025-03-14T05:52:56.1224028Z  2025-03-14T05:52:56.1224632Z [15,023 / 15,235] 48 actions, 47 running 2025-03-14T05:52:56.1225443Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T05:52:56.1226689Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T05:52:56.1227608Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T05:52:56.1228205Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T05:52:56.1228917Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 24s local 2025-03-14T05:52:56.1229682Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2025-03-14T05:52:56.1230470Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 21s local 2025-03-14T05:52:56.1231651Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 21s local ... 2025-03-14T05:52:56.4061412Z 2025-03-14T05:52:56.4062278Z  2025-03-14T05:52:56.4062759Z  2025-03-14T05:52:56.4063165Z  2025-03-14T05:52:56.4063574Z  2025-03-14T05:52:56.4063992Z  2025-03-14T05:52:56.4064382Z  2025-03-14T05:52:56.4064800Z  2025-03-14T05:52:56.4065205Z  2025-03-14T05:52:56.4066023Z [15,023 / 15,235] 48 actions running 2025-03-14T05:52:56.4066834Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T05:52:56.4067777Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2025-03-14T05:52:56.4068674Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T05:52:56.4069323Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T05:52:56.4070083Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 24s local 2025-03-14T05:52:56.4071375Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2025-03-14T05:52:56.4072234Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 22s local 2025-03-14T05:52:56.4073234Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local ... 2025-03-14T05:52:56.8068991Z 2025-03-14T05:52:56.8069807Z  2025-03-14T05:52:56.8070259Z  2025-03-14T05:52:56.8070651Z  2025-03-14T05:52:56.8071067Z  2025-03-14T05:52:56.8071472Z  2025-03-14T05:52:56.8071872Z  2025-03-14T05:52:56.8072253Z  2025-03-14T05:52:56.8072618Z  2025-03-14T05:52:56.8073203Z [15,024 / 15,235] 48 actions running 2025-03-14T05:52:56.8073949Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T05:52:56.8074676Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T05:52:56.8075302Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T05:52:56.8076051Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 24s local 2025-03-14T05:52:56.8076858Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2025-03-14T05:52:56.8077676Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 22s local 2025-03-14T05:52:56.8078579Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2025-03-14T05:52:56.8079806Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local ... 2025-03-14T05:52:57.1347465Z 2025-03-14T05:52:57.1348297Z  2025-03-14T05:52:57.1348774Z  2025-03-14T05:52:57.1349192Z  2025-03-14T05:52:57.1349576Z  2025-03-14T05:52:57.1349967Z  2025-03-14T05:52:57.1350548Z  2025-03-14T05:52:57.1350958Z  2025-03-14T05:52:57.1351401Z  2025-03-14T05:52:57.1351989Z [15,025 / 15,235] 48 actions, 47 running 2025-03-14T05:52:57.1352762Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T05:52:57.1353529Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T05:52:57.1354342Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 25s local 2025-03-14T05:52:57.1355187Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2025-03-14T05:52:57.1356036Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 22s local 2025-03-14T05:52:57.1356947Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2025-03-14T05:52:57.1357819Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local 2025-03-14T05:52:57.1358791Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local ... 2025-03-14T05:52:57.3674749Z 2025-03-14T05:52:57.3675588Z  2025-03-14T05:52:57.3676058Z  2025-03-14T05:52:57.3676447Z  2025-03-14T05:52:57.3676810Z  2025-03-14T05:52:57.3677215Z  2025-03-14T05:52:57.3677936Z  2025-03-14T05:52:57.3678378Z  2025-03-14T05:52:57.3678915Z  2025-03-14T05:52:57.3679521Z [15,025 / 15,235] 48 actions, 47 running 2025-03-14T05:52:57.3680277Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T05:52:57.3680948Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T05:52:57.3681771Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 25s local 2025-03-14T05:52:57.3682540Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2025-03-14T05:52:57.3683535Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 23s local 2025-03-14T05:52:57.3684432Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2025-03-14T05:52:57.3685370Z Compiling xla/pjrt/pjrt_c_api_client.cc; 21s local 2025-03-14T05:52:57.3686274Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local ... 2025-03-14T05:52:57.5595342Z 2025-03-14T05:52:57.5596147Z  2025-03-14T05:52:57.5596516Z  2025-03-14T05:52:57.5596854Z  2025-03-14T05:52:57.5597162Z  2025-03-14T05:52:57.5597462Z  2025-03-14T05:52:57.5597760Z  2025-03-14T05:52:57.5598061Z  2025-03-14T05:52:57.5598344Z  2025-03-14T05:52:57.5598776Z [15,025 / 15,235] 48 actions running 2025-03-14T05:52:57.5599349Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2025-03-14T05:52:57.5600147Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T05:52:57.5600737Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 25s local 2025-03-14T05:52:57.5601338Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2025-03-14T05:52:57.5601950Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 23s local 2025-03-14T05:52:57.5602655Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2025-03-14T05:52:57.5603438Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local 2025-03-14T05:52:57.5604239Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local ... 2025-03-14T05:52:57.9599989Z 2025-03-14T05:52:57.9600865Z  2025-03-14T05:52:57.9601341Z  2025-03-14T05:52:57.9601782Z  2025-03-14T05:52:57.9602210Z  2025-03-14T05:52:57.9602600Z  2025-03-14T05:52:57.9602943Z  2025-03-14T05:52:57.9603257Z  2025-03-14T05:52:57.9603565Z  2025-03-14T05:52:57.9604057Z [15,026 / 15,235] 48 actions running 2025-03-14T05:52:57.9604940Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2025-03-14T05:52:57.9605624Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T05:52:57.9606234Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2025-03-14T05:52:57.9607257Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 23s local 2025-03-14T05:52:57.9608093Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2025-03-14T05:52:57.9608901Z Compiling xla/pjrt/pjrt_c_api_client.cc; 22s local 2025-03-14T05:52:57.9609826Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2025-03-14T05:52:57.9610760Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2025-03-14T05:52:58.7952930Z 2025-03-14T05:52:58.7953874Z  2025-03-14T05:52:58.7954350Z  2025-03-14T05:52:58.7954741Z  2025-03-14T05:52:58.7955141Z  2025-03-14T05:52:58.7955550Z  2025-03-14T05:52:58.7955958Z  2025-03-14T05:52:58.7956349Z  2025-03-14T05:52:58.7956886Z  2025-03-14T05:52:58.7957513Z [15,027 / 15,235] 48 actions, 47 running 2025-03-14T05:52:58.7958270Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2025-03-14T05:52:58.7958926Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T05:52:58.7959745Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local 2025-03-14T05:52:58.7960594Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 24s local 2025-03-14T05:52:58.7961384Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2025-03-14T05:52:58.7962298Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2025-03-14T05:52:58.7963531Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T05:52:58.7964147Z @stablehlo//:stablehlo_passes; 20s local ... 2025-03-14T05:52:59.1608582Z 2025-03-14T05:52:59.1609408Z  2025-03-14T05:52:59.1609874Z  2025-03-14T05:52:59.1610282Z  2025-03-14T05:52:59.1610683Z  2025-03-14T05:52:59.1611054Z  2025-03-14T05:52:59.1611464Z  2025-03-14T05:52:59.1611859Z  2025-03-14T05:52:59.1612265Z  2025-03-14T05:52:59.1613096Z [15,027 / 15,235] 48 actions running 2025-03-14T05:52:59.1613834Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2025-03-14T05:52:59.1614519Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T05:52:59.1615275Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2025-03-14T05:52:59.1616173Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 24s local 2025-03-14T05:52:59.1616976Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local 2025-03-14T05:52:59.1617928Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2025-03-14T05:52:59.1618850Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T05:52:59.1619523Z @stablehlo//:stablehlo_passes; 20s local ... 2025-03-14T05:53:00.1036429Z 2025-03-14T05:53:00.1037275Z  2025-03-14T05:53:00.1037761Z  2025-03-14T05:53:00.1038208Z  2025-03-14T05:53:00.1038863Z  2025-03-14T05:53:00.1039260Z  2025-03-14T05:53:00.1039658Z  2025-03-14T05:53:00.1040062Z  2025-03-14T05:53:00.1040461Z  2025-03-14T05:53:00.1041040Z [15,028 / 15,235] 48 actions, 47 running 2025-03-14T05:53:00.1041927Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T05:53:00.1042652Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T05:53:00.1043394Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2025-03-14T05:53:00.1044317Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 25s local 2025-03-14T05:53:00.1045352Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local 2025-03-14T05:53:00.1046057Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T05:53:00.1046729Z @stablehlo//:stablehlo_passes; 21s local 2025-03-14T05:53:00.1047643Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local ... 2025-03-14T05:53:00.3617366Z 2025-03-14T05:53:00.3618250Z  2025-03-14T05:53:00.3618734Z  2025-03-14T05:53:00.3619126Z  2025-03-14T05:53:00.3619502Z  2025-03-14T05:53:00.3619914Z  2025-03-14T05:53:00.3620345Z  2025-03-14T05:53:00.3620717Z  2025-03-14T05:53:00.3621445Z  2025-03-14T05:53:00.3622003Z [15,028 / 15,235] 48 actions running 2025-03-14T05:53:00.3622772Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T05:53:00.3623480Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T05:53:00.3624206Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2025-03-14T05:53:00.3625057Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2025-03-14T05:53:00.3625870Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local 2025-03-14T05:53:00.3626607Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T05:53:00.3627253Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T05:53:00.3628074Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local ... 2025-03-14T05:53:00.6195340Z 2025-03-14T05:53:00.6196132Z  2025-03-14T05:53:00.6196646Z  2025-03-14T05:53:00.6197062Z  2025-03-14T05:53:00.6197505Z  2025-03-14T05:53:00.6197917Z  2025-03-14T05:53:00.6198328Z  2025-03-14T05:53:00.6198691Z  2025-03-14T05:53:00.6199037Z  2025-03-14T05:53:00.6199604Z [15,029 / 15,235] 48 actions, 47 running 2025-03-14T05:53:00.6200305Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T05:53:00.6200986Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T05:53:00.6201999Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2025-03-14T05:53:00.6202857Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2025-03-14T05:53:00.6203614Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local 2025-03-14T05:53:00.6204298Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T05:53:00.6205090Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T05:53:00.6205961Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local ... 2025-03-14T05:53:00.9622615Z 2025-03-14T05:53:00.9623728Z  2025-03-14T05:53:00.9624235Z  2025-03-14T05:53:00.9624681Z  2025-03-14T05:53:00.9625093Z  2025-03-14T05:53:00.9625511Z  2025-03-14T05:53:00.9625933Z  2025-03-14T05:53:00.9626352Z  2025-03-14T05:53:00.9626765Z  2025-03-14T05:53:00.9627370Z [15,029 / 15,235] 48 actions running 2025-03-14T05:53:00.9628138Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T05:53:00.9628887Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T05:53:00.9629731Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2025-03-14T05:53:00.9630692Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2025-03-14T05:53:00.9631561Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local 2025-03-14T05:53:00.9632352Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T05:53:00.9633222Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T05:53:00.9634215Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local ... 2025-03-14T05:53:01.9735010Z 2025-03-14T05:53:01.9735899Z  2025-03-14T05:53:01.9736343Z  2025-03-14T05:53:01.9736701Z  2025-03-14T05:53:01.9737085Z  2025-03-14T05:53:01.9737415Z  2025-03-14T05:53:01.9737730Z  2025-03-14T05:53:01.9738066Z  2025-03-14T05:53:01.9738413Z  2025-03-14T05:53:01.9738919Z [15,030 / 15,235] 48 actions, 47 running 2025-03-14T05:53:01.9739598Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T05:53:01.9740242Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2025-03-14T05:53:01.9740917Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 27s local 2025-03-14T05:53:01.9741700Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2025-03-14T05:53:01.9742440Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2025-03-14T05:53:01.9743116Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T05:53:01.9743706Z @stablehlo//:stablehlo_passes; 23s local 2025-03-14T05:53:01.9744508Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local ... 2025-03-14T05:53:02.2326734Z 2025-03-14T05:53:02.2327552Z  2025-03-14T05:53:02.2328019Z  2025-03-14T05:53:02.2328393Z  2025-03-14T05:53:02.2328793Z  2025-03-14T05:53:02.2329136Z  2025-03-14T05:53:02.2329495Z  2025-03-14T05:53:02.2329881Z  2025-03-14T05:53:02.2330266Z  2025-03-14T05:53:02.2330857Z [15,031 / 15,235] 48 actions, 47 running 2025-03-14T05:53:02.2331560Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T05:53:02.2332247Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2025-03-14T05:53:02.2333004Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 28s local 2025-03-14T05:53:02.2333830Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2025-03-14T05:53:02.2334584Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2025-03-14T05:53:02.2335321Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T05:53:02.2335952Z @stablehlo//:stablehlo_passes; 23s local 2025-03-14T05:53:02.2336856Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local ... 2025-03-14T05:53:02.5634032Z 2025-03-14T05:53:02.5634879Z  2025-03-14T05:53:02.5635363Z  2025-03-14T05:53:02.5635737Z  2025-03-14T05:53:02.5636072Z  2025-03-14T05:53:02.5636411Z  2025-03-14T05:53:02.5636790Z  2025-03-14T05:53:02.5637167Z  2025-03-14T05:53:02.5637531Z  2025-03-14T05:53:02.5638329Z [15,031 / 15,235] 48 actions running 2025-03-14T05:53:02.5639014Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T05:53:02.5639637Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2025-03-14T05:53:02.5640351Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 28s local 2025-03-14T05:53:02.5641218Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 28s local 2025-03-14T05:53:02.5641926Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2025-03-14T05:53:02.5642841Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T05:53:02.5643477Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T05:53:02.5644267Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local ... 2025-03-14T05:53:03.6761286Z 2025-03-14T05:53:03.6762152Z  2025-03-14T05:53:03.6762683Z  2025-03-14T05:53:03.6763156Z  2025-03-14T05:53:03.6763559Z  2025-03-14T05:53:03.6763957Z  2025-03-14T05:53:03.6764332Z  2025-03-14T05:53:03.6764907Z  2025-03-14T05:53:03.6765524Z  2025-03-14T05:53:03.6766234Z [15,032 / 15,235] 48 actions, 47 running 2025-03-14T05:53:03.6767007Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2025-03-14T05:53:03.6767731Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T05:53:03.6768494Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2025-03-14T05:53:03.6769820Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2025-03-14T05:53:03.6770667Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2025-03-14T05:53:03.6771453Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T05:53:03.6772421Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T05:53:03.6773524Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local ... 2025-03-14T05:53:03.9643703Z 2025-03-14T05:53:03.9644666Z  2025-03-14T05:53:03.9645181Z  2025-03-14T05:53:03.9645608Z  2025-03-14T05:53:03.9646017Z  2025-03-14T05:53:03.9646420Z  2025-03-14T05:53:03.9646816Z  2025-03-14T05:53:03.9647207Z  2025-03-14T05:53:03.9647611Z  2025-03-14T05:53:03.9648206Z [15,032 / 15,235] 48 actions running 2025-03-14T05:53:03.9648972Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2025-03-14T05:53:03.9649676Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T05:53:03.9650449Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2025-03-14T05:53:03.9651404Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2025-03-14T05:53:03.9652489Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2025-03-14T05:53:03.9653243Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T05:53:03.9654186Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T05:53:03.9655569Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local ... 2025-03-14T05:53:04.2798398Z 2025-03-14T05:53:04.2799315Z  2025-03-14T05:53:04.2799899Z  2025-03-14T05:53:04.2800400Z  2025-03-14T05:53:04.2800898Z  2025-03-14T05:53:04.2801330Z  2025-03-14T05:53:04.2801820Z  2025-03-14T05:53:04.2802289Z  2025-03-14T05:53:04.2802736Z  2025-03-14T05:53:04.2803427Z [15,034 / 15,235] 48 actions, 47 running 2025-03-14T05:53:04.2804310Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2025-03-14T05:53:04.2805352Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T05:53:04.2806225Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2025-03-14T05:53:04.2807161Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2025-03-14T05:53:04.2808092Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2025-03-14T05:53:04.2808740Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T05:53:04.2809599Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T05:53:04.2810989Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local ... 2025-03-14T05:53:04.5045597Z 2025-03-14T05:53:04.5046471Z  2025-03-14T05:53:04.5046975Z  2025-03-14T05:53:04.5047393Z  2025-03-14T05:53:04.5047788Z  2025-03-14T05:53:04.5048203Z  2025-03-14T05:53:04.5048623Z  2025-03-14T05:53:04.5049045Z  2025-03-14T05:53:04.5049466Z  2025-03-14T05:53:04.5050064Z [15,035 / 15,235] 48 actions, 47 running 2025-03-14T05:53:04.5051124Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2025-03-14T05:53:04.5051896Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T05:53:04.5052689Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2025-03-14T05:53:04.5053534Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2025-03-14T05:53:04.5054316Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T05:53:04.5055047Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T05:53:04.5055937Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T05:53:04.5056993Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local ... 2025-03-14T05:53:04.7650868Z 2025-03-14T05:53:04.7651746Z  2025-03-14T05:53:04.7652238Z  2025-03-14T05:53:04.7652652Z  2025-03-14T05:53:04.7653055Z  2025-03-14T05:53:04.7653787Z  2025-03-14T05:53:04.7654197Z  2025-03-14T05:53:04.7654597Z  2025-03-14T05:53:04.7654990Z  2025-03-14T05:53:04.7655568Z [15,035 / 15,235] 48 actions running 2025-03-14T05:53:04.7656342Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T05:53:04.7657053Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T05:53:04.7657823Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2025-03-14T05:53:04.7658736Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2025-03-14T05:53:04.7659571Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T05:53:04.7660326Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T05:53:04.7661261Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T05:53:04.7662385Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local ... 2025-03-14T05:53:04.9653748Z 2025-03-14T05:53:04.9654785Z  2025-03-14T05:53:04.9655271Z  2025-03-14T05:53:04.9655617Z  2025-03-14T05:53:04.9656001Z  2025-03-14T05:53:04.9656403Z  2025-03-14T05:53:04.9656794Z  2025-03-14T05:53:04.9657179Z  2025-03-14T05:53:04.9657979Z  2025-03-14T05:53:04.9658563Z [15,036 / 15,235] 48 actions, 47 running 2025-03-14T05:53:04.9659303Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T05:53:04.9659991Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T05:53:04.9660712Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2025-03-14T05:53:04.9661609Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2025-03-14T05:53:04.9662413Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T05:53:04.9663166Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T05:53:04.9664116Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T05:53:04.9665542Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local ... 2025-03-14T05:53:05.3659143Z 2025-03-14T05:53:05.3659953Z  2025-03-14T05:53:05.3660449Z  2025-03-14T05:53:05.3660887Z  2025-03-14T05:53:05.3661290Z  2025-03-14T05:53:05.3661712Z  2025-03-14T05:53:05.3662094Z  2025-03-14T05:53:05.3662494Z  2025-03-14T05:53:05.3662892Z  2025-03-14T05:53:05.3663467Z [15,036 / 15,235] 48 actions running 2025-03-14T05:53:05.3664240Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T05:53:05.3664987Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T05:53:05.3666261Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2025-03-14T05:53:05.3667221Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 31s local 2025-03-14T05:53:05.3668070Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T05:53:05.3668838Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T05:53:05.3669807Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T05:53:05.3670824Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local ... 2025-03-14T05:53:05.5662989Z 2025-03-14T05:53:05.5663779Z  2025-03-14T05:53:05.5664287Z  2025-03-14T05:53:05.5664710Z  2025-03-14T05:53:05.5665107Z  2025-03-14T05:53:05.5665735Z  2025-03-14T05:53:05.5666144Z  2025-03-14T05:53:05.5666546Z  2025-03-14T05:53:05.5666930Z  2025-03-14T05:53:05.5667469Z [15,037 / 15,235] 48 actions running 2025-03-14T05:53:05.5668208Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T05:53:05.5668891Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T05:53:05.5669676Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2025-03-14T05:53:05.5670441Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T05:53:05.5671153Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T05:53:05.5672080Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T05:53:05.5673390Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local 2025-03-14T05:53:05.5674377Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 26s local ... 2025-03-14T05:53:05.9667903Z 2025-03-14T05:53:05.9668749Z  2025-03-14T05:53:05.9669210Z  2025-03-14T05:53:05.9669596Z  2025-03-14T05:53:05.9669996Z  2025-03-14T05:53:05.9670407Z  2025-03-14T05:53:05.9670822Z  2025-03-14T05:53:05.9671228Z  2025-03-14T05:53:05.9671620Z  2025-03-14T05:53:05.9672192Z [15,038 / 15,235] 48 actions running 2025-03-14T05:53:05.9673016Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T05:53:05.9673742Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T05:53:05.9674489Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2025-03-14T05:53:05.9675224Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T05:53:05.9675965Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T05:53:05.9676919Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T05:53:05.9677932Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 27s local 2025-03-14T05:53:05.9679146Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local ... 2025-03-14T05:53:06.3672715Z 2025-03-14T05:53:06.3673550Z  2025-03-14T05:53:06.3674056Z  2025-03-14T05:53:06.3674439Z  2025-03-14T05:53:06.3674768Z  2025-03-14T05:53:06.3675131Z  2025-03-14T05:53:06.3675517Z  2025-03-14T05:53:06.3675883Z  2025-03-14T05:53:06.3676281Z  2025-03-14T05:53:06.3676866Z [15,039 / 15,235] 48 actions running 2025-03-14T05:53:06.3677616Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T05:53:06.3678283Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T05:53:06.3679029Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2025-03-14T05:53:06.3679864Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2025-03-14T05:53:06.3680638Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T05:53:06.3681578Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T05:53:06.3682577Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 27s local 2025-03-14T05:53:06.3683471Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local ... 2025-03-14T05:53:06.6184877Z 2025-03-14T05:53:06.6185766Z  2025-03-14T05:53:06.6186281Z  2025-03-14T05:53:06.6186701Z  2025-03-14T05:53:06.6187099Z  2025-03-14T05:53:06.6187506Z  2025-03-14T05:53:06.6188173Z  2025-03-14T05:53:06.6188621Z  2025-03-14T05:53:06.6189015Z  2025-03-14T05:53:06.6189611Z [15,040 / 15,235] 48 actions, 47 running 2025-03-14T05:53:06.6190414Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T05:53:06.6191130Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T05:53:06.6191880Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2025-03-14T05:53:06.6192720Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2025-03-14T05:53:06.6193675Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T05:53:06.6194624Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T05:53:06.6195635Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 28s local 2025-03-14T05:53:06.6196539Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local ... 2025-03-14T05:53:06.9679333Z 2025-03-14T05:53:06.9680173Z  2025-03-14T05:53:06.9680713Z  2025-03-14T05:53:06.9681150Z  2025-03-14T05:53:06.9681571Z  2025-03-14T05:53:06.9681964Z  2025-03-14T05:53:06.9682328Z  2025-03-14T05:53:06.9682697Z  2025-03-14T05:53:06.9683073Z  2025-03-14T05:53:06.9683635Z [15,040 / 15,235] 48 actions running 2025-03-14T05:53:06.9684358Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T05:53:06.9685526Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T05:53:06.9686309Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2025-03-14T05:53:06.9687150Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2025-03-14T05:53:06.9687882Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T05:53:06.9688774Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T05:53:06.9689734Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 28s local 2025-03-14T05:53:06.9690640Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local ... 2025-03-14T05:53:07.2466876Z 2025-03-14T05:53:07.2467722Z  2025-03-14T05:53:07.2468211Z  2025-03-14T05:53:07.2468627Z  2025-03-14T05:53:07.2469030Z  2025-03-14T05:53:07.2469430Z  2025-03-14T05:53:07.2469837Z  2025-03-14T05:53:07.2470260Z  2025-03-14T05:53:07.2470681Z  2025-03-14T05:53:07.2471298Z [15,041 / 15,235] 48 actions, 47 running 2025-03-14T05:53:07.2472103Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T05:53:07.2472828Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T05:53:07.2473612Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T05:53:07.2474737Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2025-03-14T05:53:07.2475492Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T05:53:07.2476439Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T05:53:07.2477425Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 28s local 2025-03-14T05:53:07.2478388Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local ... 2025-03-14T05:53:07.5681335Z 2025-03-14T05:53:07.5682206Z  2025-03-14T05:53:07.5682627Z  2025-03-14T05:53:07.5682967Z  2025-03-14T05:53:07.5683306Z  2025-03-14T05:53:07.5683645Z  2025-03-14T05:53:07.5683984Z  2025-03-14T05:53:07.5684331Z  2025-03-14T05:53:07.5684850Z  2025-03-14T05:53:07.5685349Z [15,042 / 15,235] 47 actions running 2025-03-14T05:53:07.5685990Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T05:53:07.5686604Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T05:53:07.5687256Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T05:53:07.5687951Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2025-03-14T05:53:07.5688569Z @llvm-project//mlir:LinalgTransforms; 30s local 2025-03-14T05:53:07.5689361Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2025-03-14T05:53:07.5690457Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 28s local 2025-03-14T05:53:07.5691251Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local ... 2025-03-14T05:53:07.9686053Z 2025-03-14T05:53:07.9686872Z  2025-03-14T05:53:07.9687296Z  2025-03-14T05:53:07.9687646Z  2025-03-14T05:53:07.9687992Z  2025-03-14T05:53:07.9688369Z  2025-03-14T05:53:07.9688715Z  2025-03-14T05:53:07.9689061Z  2025-03-14T05:53:07.9689626Z  2025-03-14T05:53:07.9690501Z [15,042 / 15,235] 48 actions running 2025-03-14T05:53:07.9691282Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T05:53:07.9692008Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T05:53:07.9692787Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T05:53:07.9693623Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2025-03-14T05:53:07.9694379Z @llvm-project//mlir:LinalgTransforms; 30s local 2025-03-14T05:53:07.9695291Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2025-03-14T05:53:07.9696255Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local 2025-03-14T05:53:07.9697152Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local ... 2025-03-14T05:53:08.5040612Z 2025-03-14T05:53:08.5041460Z  2025-03-14T05:53:08.5041837Z  2025-03-14T05:53:08.5042432Z  2025-03-14T05:53:08.5042744Z  2025-03-14T05:53:08.5043066Z  2025-03-14T05:53:08.5043380Z  2025-03-14T05:53:08.5043705Z  2025-03-14T05:53:08.5044022Z  2025-03-14T05:53:08.5044649Z [15,043 / 15,235] 48 actions, 47 running 2025-03-14T05:53:08.5045251Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T05:53:08.5045798Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2025-03-14T05:53:08.5046391Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T05:53:08.5047032Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T05:53:08.5047620Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T05:53:08.5048337Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T05:53:08.5049093Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local 2025-03-14T05:53:08.5049735Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local ... 2025-03-14T05:53:08.7096428Z 2025-03-14T05:53:08.7097275Z  2025-03-14T05:53:08.7097788Z  2025-03-14T05:53:08.7098196Z  2025-03-14T05:53:08.7098601Z  2025-03-14T05:53:08.7098970Z  2025-03-14T05:53:08.7099614Z  2025-03-14T05:53:08.7099980Z  2025-03-14T05:53:08.7100336Z  2025-03-14T05:53:08.7100903Z [15,044 / 15,235] 48 actions, 47 running 2025-03-14T05:53:08.7101667Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2025-03-14T05:53:08.7102377Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2025-03-14T05:53:08.7103138Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T05:53:08.7104005Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T05:53:08.7104696Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T05:53:08.7105614Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T05:53:08.7106521Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2025-03-14T05:53:08.7117438Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local ... 2025-03-14T05:53:08.9548909Z 2025-03-14T05:53:08.9549787Z  2025-03-14T05:53:08.9550318Z  2025-03-14T05:53:08.9550703Z  2025-03-14T05:53:08.9551098Z  2025-03-14T05:53:08.9551493Z  2025-03-14T05:53:08.9551859Z  2025-03-14T05:53:08.9552250Z  2025-03-14T05:53:08.9552655Z  2025-03-14T05:53:08.9553267Z [15,045 / 15,235] 48 actions, 47 running 2025-03-14T05:53:08.9553981Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2025-03-14T05:53:08.9554647Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2025-03-14T05:53:08.9555697Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T05:53:08.9556537Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T05:53:08.9557298Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T05:53:08.9558185Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T05:53:08.9559147Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2025-03-14T05:53:08.9560118Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local ... 2025-03-14T05:53:09.1695679Z 2025-03-14T05:53:09.1696564Z  2025-03-14T05:53:09.1697094Z  2025-03-14T05:53:09.1697505Z  2025-03-14T05:53:09.1697913Z  2025-03-14T05:53:09.1698332Z  2025-03-14T05:53:09.1698675Z  2025-03-14T05:53:09.1699014Z  2025-03-14T05:53:09.1699331Z  2025-03-14T05:53:09.1699806Z [15,045 / 15,235] 48 actions running 2025-03-14T05:53:09.1700607Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2025-03-14T05:53:09.1701297Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2025-03-14T05:53:09.1702077Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2025-03-14T05:53:09.1703006Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T05:53:09.1703740Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T05:53:09.1704960Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T05:53:09.1705951Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2025-03-14T05:53:09.1706778Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local ... 2025-03-14T05:53:10.1703455Z 2025-03-14T05:53:10.1704259Z  2025-03-14T05:53:10.1704787Z  2025-03-14T05:53:10.1705183Z  2025-03-14T05:53:10.1705562Z  2025-03-14T05:53:10.1705956Z  2025-03-14T05:53:10.1706351Z  2025-03-14T05:53:10.1706746Z  2025-03-14T05:53:10.1707148Z  2025-03-14T05:53:10.1707764Z [15,045 / 15,235] 48 actions running 2025-03-14T05:53:10.1708530Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2025-03-14T05:53:10.1709264Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2025-03-14T05:53:10.1710072Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T05:53:10.1710886Z Compiling xla/pjrt/pjrt_c_api_client.cc; 34s local 2025-03-14T05:53:10.1711669Z @llvm-project//mlir:LinalgTransforms; 32s local 2025-03-14T05:53:10.1712653Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2025-03-14T05:53:10.1713682Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2025-03-14T05:53:10.1714915Z Compiling xla/service/cpu/cpu_compiler.cc; 28s local ... 2025-03-14T05:53:10.7458309Z 2025-03-14T05:53:10.7459138Z  2025-03-14T05:53:10.7459641Z  2025-03-14T05:53:10.7460055Z  2025-03-14T05:53:10.7460452Z  2025-03-14T05:53:10.7460837Z  2025-03-14T05:53:10.7461219Z  2025-03-14T05:53:10.7461559Z  2025-03-14T05:53:10.7462042Z  2025-03-14T05:53:10.7462788Z [15,046 / 15,235] 48 actions, 47 running 2025-03-14T05:53:10.7463523Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2025-03-14T05:53:10.7464181Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2025-03-14T05:53:10.7464976Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T05:53:10.7466051Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T05:53:10.7466916Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2025-03-14T05:53:10.7467753Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T05:53:10.7468458Z Compiling xla/service/cpu/cpu_compiler.cc; 29s local 2025-03-14T05:53:10.7469370Z Compiling xla/pjrt/cpu/cpu_client.cc; 27s local ... 2025-03-14T05:53:10.9710644Z 2025-03-14T05:53:10.9711443Z  2025-03-14T05:53:10.9711922Z  2025-03-14T05:53:10.9712330Z  2025-03-14T05:53:10.9712744Z  2025-03-14T05:53:10.9713174Z  2025-03-14T05:53:10.9713968Z  2025-03-14T05:53:10.9714376Z  2025-03-14T05:53:10.9714779Z  2025-03-14T05:53:10.9715328Z [15,046 / 15,235] 48 actions running 2025-03-14T05:53:10.9716095Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2025-03-14T05:53:10.9716796Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2025-03-14T05:53:10.9717626Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T05:53:10.9718419Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T05:53:10.9719457Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2025-03-14T05:53:10.9720503Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T05:53:10.9721266Z Compiling xla/service/cpu/cpu_compiler.cc; 29s local 2025-03-14T05:53:10.9722041Z Compiling xla/pjrt/cpu/cpu_client.cc; 27s local ... 2025-03-14T05:53:11.9718682Z 2025-03-14T05:53:11.9719501Z  2025-03-14T05:53:11.9719953Z  2025-03-14T05:53:11.9720311Z  2025-03-14T05:53:11.9720708Z  2025-03-14T05:53:11.9721109Z  2025-03-14T05:53:11.9721476Z  2025-03-14T05:53:11.9721861Z  2025-03-14T05:53:11.9722248Z  2025-03-14T05:53:11.9722810Z [15,046 / 15,235] 48 actions running 2025-03-14T05:53:11.9723516Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T05:53:11.9724728Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2025-03-14T05:53:11.9725484Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2025-03-14T05:53:11.9726308Z @llvm-project//mlir:LinalgTransforms; 34s local 2025-03-14T05:53:11.9727237Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2025-03-14T05:53:11.9728326Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2025-03-14T05:53:11.9729223Z Compiling xla/service/cpu/cpu_compiler.cc; 30s local 2025-03-14T05:53:11.9730079Z Compiling xla/pjrt/cpu/cpu_client.cc; 28s local ... 2025-03-14T05:53:12.9726920Z 2025-03-14T05:53:12.9727809Z  2025-03-14T05:53:12.9728327Z  2025-03-14T05:53:12.9728746Z  2025-03-14T05:53:12.9729126Z  2025-03-14T05:53:12.9729507Z  2025-03-14T05:53:12.9729906Z  2025-03-14T05:53:12.9730267Z  2025-03-14T05:53:12.9730647Z  2025-03-14T05:53:12.9731210Z [15,046 / 15,235] 48 actions running 2025-03-14T05:53:12.9731943Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T05:53:12.9732659Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2025-03-14T05:53:12.9733375Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2025-03-14T05:53:12.9734515Z @llvm-project//mlir:LinalgTransforms; 35s local 2025-03-14T05:53:12.9735422Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T05:53:12.9736367Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 34s local 2025-03-14T05:53:12.9737175Z Compiling xla/service/cpu/cpu_compiler.cc; 31s local 2025-03-14T05:53:12.9737922Z Compiling xla/pjrt/cpu/cpu_client.cc; 29s local ... 2025-03-14T05:53:13.1730619Z 2025-03-14T05:53:13.1731463Z  2025-03-14T05:53:13.1732054Z  2025-03-14T05:53:13.1732583Z  2025-03-14T05:53:13.1733112Z  2025-03-14T05:53:13.1733626Z  2025-03-14T05:53:13.1734147Z  2025-03-14T05:53:13.1734664Z  2025-03-14T05:53:13.1735035Z  2025-03-14T05:53:13.1735593Z [15,047 / 15,235] 48 actions, 47 running 2025-03-14T05:53:13.1736257Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T05:53:13.1736946Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2025-03-14T05:53:13.1737764Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T05:53:13.1738609Z @llvm-project//mlir:LinalgTransforms; 35s local 2025-03-14T05:53:13.1739520Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T05:53:13.1740496Z Compiling xla/service/cpu/cpu_compiler.cc; 31s local 2025-03-14T05:53:13.1741508Z Compiling xla/pjrt/cpu/cpu_client.cc; 30s local 2025-03-14T05:53:13.1742367Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local ... 2025-03-14T05:53:13.5737489Z 2025-03-14T05:53:13.5738321Z  2025-03-14T05:53:13.5738812Z  2025-03-14T05:53:13.5739252Z  2025-03-14T05:53:13.5739674Z  2025-03-14T05:53:13.5740076Z  2025-03-14T05:53:13.5740478Z  2025-03-14T05:53:13.5740923Z  2025-03-14T05:53:13.5741298Z  2025-03-14T05:53:13.5741841Z [15,047 / 15,235] 48 actions running 2025-03-14T05:53:13.5742797Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T05:53:13.5743424Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2025-03-14T05:53:13.5744000Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T05:53:13.5744606Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T05:53:13.5745277Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T05:53:13.5746155Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2025-03-14T05:53:13.5746876Z Compiling xla/pjrt/cpu/cpu_client.cc; 30s local 2025-03-14T05:53:13.5747696Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local ... 2025-03-14T05:53:13.9741964Z 2025-03-14T05:53:13.9742759Z  2025-03-14T05:53:13.9743236Z  2025-03-14T05:53:13.9743632Z  2025-03-14T05:53:13.9744315Z  2025-03-14T05:53:13.9744708Z  2025-03-14T05:53:13.9745115Z  2025-03-14T05:53:13.9745502Z  2025-03-14T05:53:13.9745929Z  2025-03-14T05:53:13.9746509Z [15,048 / 15,235] 48 actions running 2025-03-14T05:53:13.9747221Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T05:53:13.9747877Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2025-03-14T05:53:13.9748630Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T05:53:13.9749428Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T05:53:13.9750401Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T05:53:13.9751368Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2025-03-14T05:53:13.9752144Z Compiling xla/pjrt/cpu/cpu_client.cc; 30s local 2025-03-14T05:53:13.9753039Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local ... 2025-03-14T05:53:14.2169704Z 2025-03-14T05:53:14.2170466Z  2025-03-14T05:53:14.2170917Z  2025-03-14T05:53:14.2171270Z  2025-03-14T05:53:14.2171651Z  2025-03-14T05:53:14.2172035Z  2025-03-14T05:53:14.2172407Z  2025-03-14T05:53:14.2172748Z  2025-03-14T05:53:14.2173329Z  2025-03-14T05:53:14.2174052Z [15,049 / 15,235] 48 actions, 47 running 2025-03-14T05:53:14.2174692Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T05:53:14.2175322Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T05:53:14.2176011Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2025-03-14T05:53:14.2176675Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T05:53:14.2177510Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T05:53:14.2178328Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2025-03-14T05:53:14.2179024Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2025-03-14T05:53:14.2179767Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 29s local ... 2025-03-14T05:53:14.5747417Z 2025-03-14T05:53:14.5748259Z  2025-03-14T05:53:14.5748883Z  2025-03-14T05:53:14.5749283Z  2025-03-14T05:53:14.5749721Z  2025-03-14T05:53:14.5750114Z  2025-03-14T05:53:14.5750485Z  2025-03-14T05:53:14.5750858Z  2025-03-14T05:53:14.5751246Z  2025-03-14T05:53:14.5751824Z [15,049 / 15,235] 48 actions running 2025-03-14T05:53:14.5752571Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T05:53:14.5753295Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T05:53:14.5754307Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2025-03-14T05:53:14.5755170Z @llvm-project//mlir:LinalgTransforms; 37s local 2025-03-14T05:53:14.5756039Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T05:53:14.5756902Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2025-03-14T05:53:14.5757585Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2025-03-14T05:53:14.5758366Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 30s local ... 2025-03-14T05:53:14.9314135Z 2025-03-14T05:53:14.9315293Z  2025-03-14T05:53:14.9315845Z  2025-03-14T05:53:14.9316240Z  2025-03-14T05:53:14.9316622Z  2025-03-14T05:53:14.9316999Z  2025-03-14T05:53:14.9317416Z  2025-03-14T05:53:14.9317819Z  2025-03-14T05:53:14.9318201Z  2025-03-14T05:53:14.9318783Z [15,050 / 15,235] 48 actions, 47 running 2025-03-14T05:53:14.9319502Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T05:53:14.9320199Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T05:53:14.9320936Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2025-03-14T05:53:14.9321729Z @llvm-project//mlir:LinalgTransforms; 37s local 2025-03-14T05:53:14.9322606Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T05:53:14.9323530Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2025-03-14T05:53:14.9324655Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2025-03-14T05:53:14.9325566Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 29s local ... 2025-03-14T05:53:15.1753104Z 2025-03-14T05:53:15.1753949Z  2025-03-14T05:53:15.1754381Z  2025-03-14T05:53:15.1754739Z  2025-03-14T05:53:15.1755161Z  2025-03-14T05:53:15.1755551Z  2025-03-14T05:53:15.1755936Z  2025-03-14T05:53:15.1756329Z  2025-03-14T05:53:15.1756692Z  2025-03-14T05:53:15.1757236Z [15,050 / 15,235] 48 actions running 2025-03-14T05:53:15.1757978Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T05:53:15.1758685Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T05:53:15.1759442Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 41s local 2025-03-14T05:53:15.1760234Z @llvm-project//mlir:LinalgTransforms; 37s local 2025-03-14T05:53:15.1761158Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T05:53:15.1762121Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2025-03-14T05:53:15.1762819Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2025-03-14T05:53:15.1763983Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 29s local ... 2025-03-14T05:53:15.6053782Z 2025-03-14T05:53:15.6054651Z  2025-03-14T05:53:15.6055130Z  2025-03-14T05:53:15.6055548Z  2025-03-14T05:53:15.6055951Z  2025-03-14T05:53:15.6056361Z  2025-03-14T05:53:15.6056737Z  2025-03-14T05:53:15.6057126Z  2025-03-14T05:53:15.6057529Z  2025-03-14T05:53:15.6058164Z [15,051 / 15,235] 48 actions, 47 running 2025-03-14T05:53:15.6058944Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2025-03-14T05:53:15.6059661Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T05:53:15.6060336Z @llvm-project//mlir:LinalgTransforms; 38s local 2025-03-14T05:53:15.6061289Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2025-03-14T05:53:15.6062297Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2025-03-14T05:53:15.6063044Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2025-03-14T05:53:15.6063929Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 29s local 2025-03-14T05:53:15.6065047Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 29s local ... 2025-03-14T05:53:15.9760109Z 2025-03-14T05:53:15.9760946Z  2025-03-14T05:53:15.9761387Z  2025-03-14T05:53:15.9761832Z  2025-03-14T05:53:15.9762261Z  2025-03-14T05:53:15.9762676Z  2025-03-14T05:53:15.9763424Z  2025-03-14T05:53:15.9763855Z  2025-03-14T05:53:15.9764254Z  2025-03-14T05:53:15.9764972Z [15,051 / 15,235] 48 actions running 2025-03-14T05:53:15.9766039Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2025-03-14T05:53:15.9766765Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T05:53:15.9767385Z @llvm-project//mlir:LinalgTransforms; 38s local 2025-03-14T05:53:15.9768336Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2025-03-14T05:53:15.9769441Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2025-03-14T05:53:15.9770029Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2025-03-14T05:53:15.9770826Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 30s local 2025-03-14T05:53:15.9771887Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 30s local ... 2025-03-14T05:53:16.9769066Z 2025-03-14T05:53:16.9769852Z  2025-03-14T05:53:16.9770337Z  2025-03-14T05:53:16.9770771Z  2025-03-14T05:53:16.9771141Z  2025-03-14T05:53:16.9771501Z  2025-03-14T05:53:16.9771874Z  2025-03-14T05:53:16.9772249Z  2025-03-14T05:53:16.9772616Z  2025-03-14T05:53:16.9773169Z [15,051 / 15,235] 48 actions running 2025-03-14T05:53:16.9773863Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T05:53:16.9774854Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2025-03-14T05:53:16.9775509Z @llvm-project//mlir:LinalgTransforms; 39s local 2025-03-14T05:53:16.9776400Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2025-03-14T05:53:16.9777355Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2025-03-14T05:53:16.9778070Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T05:53:16.9778859Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 31s local 2025-03-14T05:53:16.9779841Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 31s local ... 2025-03-14T05:53:17.9773932Z 2025-03-14T05:53:17.9775237Z  2025-03-14T05:53:17.9775768Z  2025-03-14T05:53:17.9776182Z  2025-03-14T05:53:17.9776572Z  2025-03-14T05:53:17.9776968Z  2025-03-14T05:53:17.9777367Z  2025-03-14T05:53:17.9777778Z  2025-03-14T05:53:17.9778153Z  2025-03-14T05:53:17.9778881Z [15,051 / 15,235] 48 actions running 2025-03-14T05:53:17.9779629Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2025-03-14T05:53:17.9780347Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2025-03-14T05:53:17.9781019Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T05:53:17.9782213Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2025-03-14T05:53:17.9783074Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local 2025-03-14T05:53:17.9783794Z Compiling xla/pjrt/cpu/cpu_client.cc; 34s local 2025-03-14T05:53:17.9784579Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local 2025-03-14T05:53:17.9785603Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local ... 2025-03-14T05:53:18.3023228Z 2025-03-14T05:53:18.3024037Z  2025-03-14T05:53:18.3024477Z  2025-03-14T05:53:18.3024846Z  2025-03-14T05:53:18.3025197Z  2025-03-14T05:53:18.3025618Z  2025-03-14T05:53:18.3026031Z  2025-03-14T05:53:18.3026576Z  2025-03-14T05:53:18.3027013Z  2025-03-14T05:53:18.3027601Z [15,052 / 15,235] 48 actions, 47 running 2025-03-14T05:53:18.3028327Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2025-03-14T05:53:18.3029042Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2025-03-14T05:53:18.3029724Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T05:53:18.3030672Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2025-03-14T05:53:18.3031698Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local 2025-03-14T05:53:18.3032460Z Compiling xla/pjrt/cpu/cpu_client.cc; 35s local 2025-03-14T05:53:18.3033633Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local 2025-03-14T05:53:18.3034799Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local ... 2025-03-14T05:53:18.5780207Z 2025-03-14T05:53:18.5781047Z  2025-03-14T05:53:18.5781528Z  2025-03-14T05:53:18.5781967Z  2025-03-14T05:53:18.5782380Z  2025-03-14T05:53:18.5782822Z  2025-03-14T05:53:18.5783222Z  2025-03-14T05:53:18.5783613Z  2025-03-14T05:53:18.5784015Z  2025-03-14T05:53:18.5784828Z [15,052 / 15,235] 48 actions running 2025-03-14T05:53:18.5785615Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2025-03-14T05:53:18.5786335Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2025-03-14T05:53:18.5787014Z @llvm-project//mlir:LinalgTransforms; 41s local 2025-03-14T05:53:18.5787951Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2025-03-14T05:53:18.5788939Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local 2025-03-14T05:53:18.5789702Z Compiling xla/pjrt/cpu/cpu_client.cc; 35s local 2025-03-14T05:53:18.5790586Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local 2025-03-14T05:53:18.5791688Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local ... 2025-03-14T05:53:19.7018470Z 2025-03-14T05:53:19.7019280Z  2025-03-14T05:53:19.7020007Z  2025-03-14T05:53:19.7020347Z  2025-03-14T05:53:19.7020705Z  2025-03-14T05:53:19.7021050Z  2025-03-14T05:53:19.7021412Z  2025-03-14T05:53:19.7021744Z  2025-03-14T05:53:19.7022083Z  2025-03-14T05:53:19.7022597Z [15,053 / 15,235] 48 actions, 47 running 2025-03-14T05:53:19.7023242Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2025-03-14T05:53:19.7023836Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2025-03-14T05:53:19.7024407Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T05:53:19.7025173Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T05:53:19.7026011Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2025-03-14T05:53:19.7026639Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2025-03-14T05:53:19.7027363Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 34s local 2025-03-14T05:53:19.7028294Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local ... 2025-03-14T05:53:19.9790280Z 2025-03-14T05:53:19.9791114Z  2025-03-14T05:53:19.9791585Z  2025-03-14T05:53:19.9792002Z  2025-03-14T05:53:19.9792392Z  2025-03-14T05:53:19.9793131Z  2025-03-14T05:53:19.9793523Z  2025-03-14T05:53:19.9793909Z  2025-03-14T05:53:19.9794281Z  2025-03-14T05:53:19.9794833Z [15,053 / 15,235] 48 actions running 2025-03-14T05:53:19.9795492Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2025-03-14T05:53:19.9796144Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2025-03-14T05:53:19.9796768Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T05:53:19.9797672Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T05:53:19.9798677Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2025-03-14T05:53:19.9799441Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2025-03-14T05:53:19.9800263Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 34s local 2025-03-14T05:53:19.9801286Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local ... 2025-03-14T05:53:20.9796801Z 2025-03-14T05:53:20.9797603Z  2025-03-14T05:53:20.9798004Z  2025-03-14T05:53:20.9798325Z  2025-03-14T05:53:20.9798643Z  2025-03-14T05:53:20.9798960Z  2025-03-14T05:53:20.9799279Z  2025-03-14T05:53:20.9799593Z  2025-03-14T05:53:20.9799915Z  2025-03-14T05:53:20.9800381Z [15,053 / 15,235] 48 actions running 2025-03-14T05:53:20.9800988Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2025-03-14T05:53:20.9801821Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2025-03-14T05:53:20.9802376Z @llvm-project//mlir:LinalgTransforms; 43s local 2025-03-14T05:53:20.9803100Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2025-03-14T05:53:20.9803873Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2025-03-14T05:53:20.9804604Z Compiling xla/pjrt/cpu/cpu_client.cc; 37s local 2025-03-14T05:53:20.9805319Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 35s local 2025-03-14T05:53:20.9806356Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local ... 2025-03-14T05:53:21.9804924Z 2025-03-14T05:53:21.9818076Z  2025-03-14T05:53:21.9818499Z  2025-03-14T05:53:21.9818841Z  2025-03-14T05:53:21.9819171Z  2025-03-14T05:53:21.9819502Z  2025-03-14T05:53:21.9819828Z  2025-03-14T05:53:21.9820147Z  2025-03-14T05:53:21.9820473Z  2025-03-14T05:53:21.9820969Z [15,054 / 15,235] 47 actions running 2025-03-14T05:53:21.9821604Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T05:53:21.9822182Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T05:53:21.9822723Z @llvm-project//mlir:LinalgTransforms; 44s local 2025-03-14T05:53:21.9823470Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2025-03-14T05:53:21.9824645Z Compiling xla/service/cpu/cpu_compiler.cc; 40s local 2025-03-14T05:53:21.9825254Z Compiling xla/pjrt/cpu/cpu_client.cc; 38s local 2025-03-14T05:53:21.9825978Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 36s local 2025-03-14T05:53:21.9826867Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local ... 2025-03-14T05:53:22.3811059Z 2025-03-14T05:53:22.3811865Z  2025-03-14T05:53:22.3812350Z  2025-03-14T05:53:22.3812755Z  2025-03-14T05:53:22.3813157Z  2025-03-14T05:53:22.3813544Z  2025-03-14T05:53:22.3813947Z  2025-03-14T05:53:22.3814333Z  2025-03-14T05:53:22.3814749Z  2025-03-14T05:53:22.3815289Z [15,054 / 15,235] 48 actions running 2025-03-14T05:53:22.3816019Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T05:53:22.3816740Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2025-03-14T05:53:22.3817393Z @llvm-project//mlir:LinalgTransforms; 45s local 2025-03-14T05:53:22.3818335Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2025-03-14T05:53:22.3819312Z Compiling xla/service/cpu/cpu_compiler.cc; 40s local 2025-03-14T05:53:22.3820049Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2025-03-14T05:53:22.3821242Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 36s local 2025-03-14T05:53:22.3822323Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local ... 2025-03-14T05:53:22.8592483Z 2025-03-14T05:53:22.8598644Z  2025-03-14T05:53:22.8599113Z  2025-03-14T05:53:22.8599472Z  2025-03-14T05:53:22.8599834Z  2025-03-14T05:53:22.8600225Z  2025-03-14T05:53:22.8600579Z  2025-03-14T05:53:22.8600929Z  2025-03-14T05:53:22.8601258Z  2025-03-14T05:53:22.8601797Z [15,055 / 15,235] 48 actions, 47 running 2025-03-14T05:53:22.8602405Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T05:53:22.8602987Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2025-03-14T05:53:22.8603561Z @llvm-project//mlir:LinalgTransforms; 45s local 2025-03-14T05:53:22.8604310Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2025-03-14T05:53:22.8605277Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T05:53:22.8605868Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2025-03-14T05:53:22.8606573Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 37s local 2025-03-14T05:53:22.8607425Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local ... 2025-03-14T05:53:23.1817067Z 2025-03-14T05:53:23.1817954Z  2025-03-14T05:53:23.1818655Z  2025-03-14T05:53:23.1819019Z  2025-03-14T05:53:23.1819363Z  2025-03-14T05:53:23.1819734Z  2025-03-14T05:53:23.1820061Z  2025-03-14T05:53:23.1820381Z  2025-03-14T05:53:23.1820708Z  2025-03-14T05:53:23.1821200Z [15,055 / 15,235] 48 actions running 2025-03-14T05:53:23.1821882Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T05:53:23.1822522Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T05:53:23.1823285Z @llvm-project//mlir:LinalgTransforms; 45s local 2025-03-14T05:53:23.1824125Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2025-03-14T05:53:23.1824952Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T05:53:23.1825602Z Compiling xla/pjrt/cpu/cpu_client.cc; 40s local 2025-03-14T05:53:23.1826840Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 37s local 2025-03-14T05:53:23.1827926Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local ... 2025-03-14T05:53:23.4302481Z 2025-03-14T05:53:23.4303253Z  2025-03-14T05:53:23.4303681Z  2025-03-14T05:53:23.4304044Z  2025-03-14T05:53:23.4304379Z  2025-03-14T05:53:23.4304719Z  2025-03-14T05:53:23.4305060Z  2025-03-14T05:53:23.4305393Z  2025-03-14T05:53:23.4305719Z  2025-03-14T05:53:23.4308550Z [15,056 / 15,235] 48 actions, 47 running 2025-03-14T05:53:23.4309307Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T05:53:23.4309986Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T05:53:23.4310632Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T05:53:23.4311447Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T05:53:23.4312395Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T05:53:23.4313169Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 37s local 2025-03-14T05:53:23.4314106Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2025-03-14T05:53:23.4314973Z Compiling torch_xla/csrc/init_python_bindings.cpp; 36s local ... 2025-03-14T05:53:23.7824083Z 2025-03-14T05:53:23.7825041Z  2025-03-14T05:53:23.7825571Z  2025-03-14T05:53:23.7826001Z  2025-03-14T05:53:23.7826369Z  2025-03-14T05:53:23.7826797Z  2025-03-14T05:53:23.7827172Z  2025-03-14T05:53:23.7827549Z  2025-03-14T05:53:23.7827936Z  2025-03-14T05:53:23.7828554Z [15,056 / 15,235] 48 actions running 2025-03-14T05:53:23.7829578Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T05:53:23.7830272Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T05:53:23.7830926Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T05:53:23.7831771Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T05:53:23.7832686Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2025-03-14T05:53:23.7833586Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2025-03-14T05:53:23.7834631Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2025-03-14T05:53:23.7835611Z Compiling torch_xla/csrc/init_python_bindings.cpp; 36s local ... 2025-03-14T05:53:24.0757837Z 2025-03-14T05:53:24.0759254Z  2025-03-14T05:53:24.0759814Z  2025-03-14T05:53:24.0760220Z  2025-03-14T05:53:24.0760654Z  2025-03-14T05:53:24.0761036Z  2025-03-14T05:53:24.0761449Z  2025-03-14T05:53:24.0761839Z  2025-03-14T05:53:24.0762222Z  2025-03-14T05:53:24.0762816Z [15,057 / 15,235] 48 actions, 47 running 2025-03-14T05:53:24.0763554Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T05:53:24.0764283Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T05:53:24.0765164Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T05:53:24.0766558Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T05:53:24.0767531Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2025-03-14T05:53:24.0768447Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2025-03-14T05:53:24.0769507Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2025-03-14T05:53:24.0770588Z Compiling torch_xla/csrc/init_python_bindings.cpp; 37s local ... 2025-03-14T05:53:24.3828759Z 2025-03-14T05:53:24.3830850Z  2025-03-14T05:53:24.3831322Z  2025-03-14T05:53:24.3832014Z  2025-03-14T05:53:24.3832428Z  2025-03-14T05:53:24.3832824Z  2025-03-14T05:53:24.3833206Z  2025-03-14T05:53:24.3833624Z  2025-03-14T05:53:24.3834004Z  2025-03-14T05:53:24.3834551Z [15,057 / 15,235] 48 actions running 2025-03-14T05:53:24.3835272Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T05:53:24.3835999Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2025-03-14T05:53:24.3836669Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T05:53:24.3837584Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T05:53:24.3838546Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2025-03-14T05:53:24.3839465Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2025-03-14T05:53:24.3840516Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2025-03-14T05:53:24.3841792Z Compiling torch_xla/csrc/init_python_bindings.cpp; 37s local ... 2025-03-14T05:53:24.5834259Z 2025-03-14T05:53:24.5835089Z  2025-03-14T05:53:24.5835575Z  2025-03-14T05:53:24.5835978Z  2025-03-14T05:53:24.5836349Z  2025-03-14T05:53:24.5836735Z  2025-03-14T05:53:24.5837115Z  2025-03-14T05:53:24.5837497Z  2025-03-14T05:53:24.5837881Z  2025-03-14T05:53:24.5838443Z [15,058 / 15,235] 48 actions running 2025-03-14T05:53:24.5839159Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2025-03-14T05:53:24.5839871Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2025-03-14T05:53:24.5840522Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T05:53:24.5841272Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2025-03-14T05:53:24.5842173Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2025-03-14T05:53:24.5843147Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2025-03-14T05:53:24.5844060Z Compiling torch_xla/csrc/init_python_bindings.cpp; 37s local 2025-03-14T05:53:24.5845000Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 37s local ... 2025-03-14T05:53:25.5841982Z 2025-03-14T05:53:25.5842809Z  2025-03-14T05:53:25.5843260Z  2025-03-14T05:53:25.5843684Z  2025-03-14T05:53:25.5844020Z  2025-03-14T05:53:25.5844344Z  2025-03-14T05:53:25.5844830Z  2025-03-14T05:53:25.5845224Z  2025-03-14T05:53:25.5845567Z  2025-03-14T05:53:25.5846128Z [15,058 / 15,235] 48 actions running 2025-03-14T05:53:25.5846825Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T05:53:25.5847435Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2025-03-14T05:53:25.5848089Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T05:53:25.5848751Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2025-03-14T05:53:25.5849649Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2025-03-14T05:53:25.5850659Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 39s local 2025-03-14T05:53:25.5851647Z Compiling torch_xla/csrc/init_python_bindings.cpp; 38s local 2025-03-14T05:53:25.5852529Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 38s local ... 2025-03-14T05:53:25.8633234Z 2025-03-14T05:53:25.8634100Z  2025-03-14T05:53:25.8634639Z  2025-03-14T05:53:25.8635036Z  2025-03-14T05:53:25.8635428Z  2025-03-14T05:53:25.8635833Z  2025-03-14T05:53:25.8636225Z  2025-03-14T05:53:25.8637013Z  2025-03-14T05:53:25.8637425Z  2025-03-14T05:53:25.8638018Z [15,059 / 15,235] 48 actions, 47 running 2025-03-14T05:53:25.8638765Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T05:53:25.8639435Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2025-03-14T05:53:25.8640094Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T05:53:25.8640830Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2025-03-14T05:53:25.8641915Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T05:53:25.8642987Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T05:53:25.8643985Z Compiling torch_xla/csrc/init_python_bindings.cpp; 38s local 2025-03-14T05:53:25.8644998Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 38s local ... 2025-03-14T05:53:26.1847680Z 2025-03-14T05:53:26.1848486Z  2025-03-14T05:53:26.1849005Z  2025-03-14T05:53:26.1849416Z  2025-03-14T05:53:26.1849819Z  2025-03-14T05:53:26.1850191Z  2025-03-14T05:53:26.1850559Z  2025-03-14T05:53:26.1850930Z  2025-03-14T05:53:26.1851286Z  2025-03-14T05:53:26.1851863Z [15,059 / 15,235] 48 actions running 2025-03-14T05:53:26.1852607Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T05:53:26.1853307Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2025-03-14T05:53:26.1854243Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T05:53:26.1855038Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2025-03-14T05:53:26.1855955Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T05:53:26.1857047Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T05:53:26.1858014Z Compiling torch_xla/csrc/init_python_bindings.cpp; 39s local 2025-03-14T05:53:26.1858910Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 38s local ... 2025-03-14T05:53:26.3850972Z 2025-03-14T05:53:26.3851819Z  2025-03-14T05:53:26.3852277Z  2025-03-14T05:53:26.3852665Z  2025-03-14T05:53:26.3853088Z  2025-03-14T05:53:26.3853489Z  2025-03-14T05:53:26.3853852Z  2025-03-14T05:53:26.3854204Z  2025-03-14T05:53:26.3854600Z  2025-03-14T05:53:26.3855170Z [15,060 / 15,235] 47 actions running 2025-03-14T05:53:26.3855931Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T05:53:26.3856661Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2025-03-14T05:53:26.3857332Z @llvm-project//mlir:LinalgTransforms; 49s local 2025-03-14T05:53:26.3858398Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2025-03-14T05:53:26.3859239Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T05:53:26.3860227Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T05:53:26.3861110Z Compiling torch_xla/csrc/init_python_bindings.cpp; 39s local 2025-03-14T05:53:26.3861886Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 39s local ... 2025-03-14T05:53:26.7858461Z 2025-03-14T05:53:26.7859297Z  2025-03-14T05:53:26.7859714Z  2025-03-14T05:53:26.7860065Z  2025-03-14T05:53:26.7860414Z  2025-03-14T05:53:26.7860740Z  2025-03-14T05:53:26.7861090Z  2025-03-14T05:53:26.7861430Z  2025-03-14T05:53:26.7861804Z  2025-03-14T05:53:26.7862283Z [15,061 / 15,235] 47 actions running 2025-03-14T05:53:26.7862939Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2025-03-14T05:53:26.7863542Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2025-03-14T05:53:26.7864138Z @llvm-project//mlir:LinalgTransforms; 49s local 2025-03-14T05:53:26.7864770Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T05:53:26.7865747Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T05:53:26.7866647Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T05:53:26.7867705Z Compiling torch_xla/csrc/init_python_bindings.cpp; 39s local 2025-03-14T05:53:26.7868492Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 39s local ... 2025-03-14T05:53:27.1353514Z 2025-03-14T05:53:27.1354311Z  2025-03-14T05:53:27.1354692Z  2025-03-14T05:53:27.1354993Z  2025-03-14T05:53:27.1355313Z  2025-03-14T05:53:27.1355663Z  2025-03-14T05:53:27.1355975Z  2025-03-14T05:53:27.1356286Z  2025-03-14T05:53:27.1356594Z  2025-03-14T05:53:27.1357406Z [15,063 / 15,235] 48 actions, 47 running 2025-03-14T05:53:27.1358027Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2025-03-14T05:53:27.1358579Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2025-03-14T05:53:27.1359114Z @llvm-project//mlir:LinalgTransforms; 49s local 2025-03-14T05:53:27.1359706Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T05:53:27.1360400Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T05:53:27.1361221Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 41s local 2025-03-14T05:53:27.1361988Z Compiling torch_xla/csrc/init_python_bindings.cpp; 40s local 2025-03-14T05:53:27.1362680Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 39s local ... 2025-03-14T05:53:27.3864075Z 2025-03-14T05:53:27.3864903Z  2025-03-14T05:53:27.3865933Z  2025-03-14T05:53:27.3866255Z  2025-03-14T05:53:27.3866583Z  2025-03-14T05:53:27.3866882Z  2025-03-14T05:53:27.3867211Z  2025-03-14T05:53:27.3867531Z  2025-03-14T05:53:27.3867882Z  2025-03-14T05:53:27.3868344Z [15,063 / 15,235] 48 actions running 2025-03-14T05:53:27.3868948Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2025-03-14T05:53:27.3869507Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T05:53:27.3870042Z @llvm-project//mlir:LinalgTransforms; 50s local 2025-03-14T05:53:27.3870648Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T05:53:27.3871374Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T05:53:27.3872211Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 41s local 2025-03-14T05:53:27.3872984Z Compiling torch_xla/csrc/init_python_bindings.cpp; 40s local 2025-03-14T05:53:27.3873712Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2025-03-14T05:53:27.6103258Z 2025-03-14T05:53:27.6104120Z  2025-03-14T05:53:27.6104696Z  2025-03-14T05:53:27.6105083Z  2025-03-14T05:53:27.6105566Z  2025-03-14T05:53:27.6106345Z  2025-03-14T05:53:27.6106716Z  2025-03-14T05:53:27.6107058Z  2025-03-14T05:53:27.6107407Z  2025-03-14T05:53:27.6107947Z [15,064 / 15,235] 48 actions, 47 running 2025-03-14T05:53:27.6108523Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2025-03-14T05:53:27.6109111Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T05:53:27.6109779Z @llvm-project//mlir:LinalgTransforms; 50s local 2025-03-14T05:53:27.6110549Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2025-03-14T05:53:27.6111616Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T05:53:27.6112536Z Compiling torch_xla/csrc/init_python_bindings.cpp; 40s local 2025-03-14T05:53:27.6113418Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2025-03-14T05:53:27.6114225Z Compiling torch_xla/csrc/aten_xla_type.cpp; 39s local ... 2025-03-14T05:53:27.9870584Z 2025-03-14T05:53:27.9871470Z  2025-03-14T05:53:27.9871944Z  2025-03-14T05:53:27.9872346Z  2025-03-14T05:53:27.9872728Z  2025-03-14T05:53:27.9873091Z  2025-03-14T05:53:27.9873465Z  2025-03-14T05:53:27.9873846Z  2025-03-14T05:53:27.9874245Z  2025-03-14T05:53:27.9874797Z [15,064 / 15,235] 48 actions running 2025-03-14T05:53:27.9875535Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2025-03-14T05:53:27.9876564Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T05:53:27.9877275Z @llvm-project//mlir:LinalgTransforms; 50s local 2025-03-14T05:53:27.9877952Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2025-03-14T05:53:27.9878839Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 42s local 2025-03-14T05:53:27.9879718Z Compiling torch_xla/csrc/init_python_bindings.cpp; 41s local 2025-03-14T05:53:27.9880446Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2025-03-14T05:53:27.9881447Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local ... 2025-03-14T05:53:28.4488561Z 2025-03-14T05:53:28.4489545Z  2025-03-14T05:53:28.4490026Z  2025-03-14T05:53:28.4490394Z  2025-03-14T05:53:28.4490774Z  2025-03-14T05:53:28.4491156Z  2025-03-14T05:53:28.4491557Z  2025-03-14T05:53:28.4491930Z  2025-03-14T05:53:28.4492291Z  2025-03-14T05:53:28.4492839Z [15,065 / 15,235] 48 actions, 47 running 2025-03-14T05:53:28.4493552Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2025-03-14T05:53:28.4494198Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T05:53:28.4494814Z @llvm-project//mlir:LinalgTransforms; 51s local 2025-03-14T05:53:28.4495527Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2025-03-14T05:53:28.4496364Z Compiling torch_xla/csrc/init_python_bindings.cpp; 41s local 2025-03-14T05:53:28.4497590Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2025-03-14T05:53:28.4498419Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2025-03-14T05:53:28.4499276Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 35s local ... 2025-03-14T05:53:28.7877435Z 2025-03-14T05:53:28.7878258Z  2025-03-14T05:53:28.7878717Z  2025-03-14T05:53:28.7879091Z  2025-03-14T05:53:28.7879488Z  2025-03-14T05:53:28.7879840Z  2025-03-14T05:53:28.7880193Z  2025-03-14T05:53:28.7880572Z  2025-03-14T05:53:28.7880949Z  2025-03-14T05:53:28.7881523Z [15,065 / 15,235] 48 actions running 2025-03-14T05:53:28.7882227Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2025-03-14T05:53:28.7882947Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T05:53:28.7883613Z @llvm-project//mlir:LinalgTransforms; 51s local 2025-03-14T05:53:28.7884358Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2025-03-14T05:53:28.7885350Z Compiling torch_xla/csrc/init_python_bindings.cpp; 41s local 2025-03-14T05:53:28.7886231Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2025-03-14T05:53:28.7887455Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2025-03-14T05:53:28.7898314Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 36s local ... 2025-03-14T05:53:29.7884619Z 2025-03-14T05:53:29.7885475Z  2025-03-14T05:53:29.7885938Z  2025-03-14T05:53:29.7886365Z  2025-03-14T05:53:29.7886743Z  2025-03-14T05:53:29.7887129Z  2025-03-14T05:53:29.7887517Z  2025-03-14T05:53:29.7887935Z  2025-03-14T05:53:29.7888327Z  2025-03-14T05:53:29.7888861Z [15,065 / 15,235] 48 actions running 2025-03-14T05:53:29.7889567Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2025-03-14T05:53:29.7890277Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2025-03-14T05:53:29.7890926Z @llvm-project//mlir:LinalgTransforms; 52s local 2025-03-14T05:53:29.7891698Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2025-03-14T05:53:29.7892551Z Compiling torch_xla/csrc/init_python_bindings.cpp; 42s local 2025-03-14T05:53:29.7893392Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2025-03-14T05:53:29.7894237Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2025-03-14T05:53:29.7895097Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 37s local ... 2025-03-14T05:53:30.3185884Z 2025-03-14T05:53:30.3186715Z  2025-03-14T05:53:30.3187185Z  2025-03-14T05:53:30.3187558Z  2025-03-14T05:53:30.3187927Z  2025-03-14T05:53:30.3188594Z  2025-03-14T05:53:30.3188976Z  2025-03-14T05:53:30.3189361Z  2025-03-14T05:53:30.3189742Z  2025-03-14T05:53:30.3190297Z [15,066 / 15,235] 48 actions, 47 running 2025-03-14T05:53:30.3191029Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2025-03-14T05:53:30.3191701Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2025-03-14T05:53:30.3192325Z @llvm-project//mlir:LinalgTransforms; 53s local 2025-03-14T05:53:30.3193207Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2025-03-14T05:53:30.3194017Z Compiling torch_xla/csrc/init_python_bindings.cpp; 43s local 2025-03-14T05:53:30.3194856Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2025-03-14T05:53:30.3195624Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local 2025-03-14T05:53:30.3196641Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 37s local ... 2025-03-14T05:53:30.5890856Z 2025-03-14T05:53:30.5891672Z  2025-03-14T05:53:30.5892171Z  2025-03-14T05:53:30.5892566Z  2025-03-14T05:53:30.5892935Z  2025-03-14T05:53:30.5893308Z  2025-03-14T05:53:30.5893673Z  2025-03-14T05:53:30.5894035Z  2025-03-14T05:53:30.5894417Z  2025-03-14T05:53:30.5895083Z [15,066 / 15,235] 48 actions running 2025-03-14T05:53:30.5895794Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2025-03-14T05:53:30.5896821Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2025-03-14T05:53:30.5897483Z @llvm-project//mlir:LinalgTransforms; 53s local 2025-03-14T05:53:30.5898217Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2025-03-14T05:53:30.5899006Z Compiling torch_xla/csrc/init_python_bindings.cpp; 43s local 2025-03-14T05:53:30.5900045Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2025-03-14T05:53:30.5900868Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local 2025-03-14T05:53:30.5901750Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 37s local ... 2025-03-14T05:53:31.5898431Z 2025-03-14T05:53:31.5899282Z  2025-03-14T05:53:31.5899817Z  2025-03-14T05:53:31.5900197Z  2025-03-14T05:53:31.5900553Z  2025-03-14T05:53:31.5900913Z  2025-03-14T05:53:31.5901279Z  2025-03-14T05:53:31.5901647Z  2025-03-14T05:53:31.5902058Z  2025-03-14T05:53:31.5902589Z [15,066 / 15,235] 48 actions running 2025-03-14T05:53:31.5903378Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T05:53:31.5904078Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2025-03-14T05:53:31.5904823Z @llvm-project//mlir:LinalgTransforms; 54s local 2025-03-14T05:53:31.5905950Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T05:53:31.5906800Z Compiling torch_xla/csrc/init_python_bindings.cpp; 44s local 2025-03-14T05:53:31.5907628Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2025-03-14T05:53:31.5908447Z Compiling torch_xla/csrc/aten_xla_type.cpp; 43s local 2025-03-14T05:53:31.5909362Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 38s local ... 2025-03-14T05:53:32.0549172Z 2025-03-14T05:53:32.0550037Z  2025-03-14T05:53:32.0550534Z  2025-03-14T05:53:32.0550954Z  2025-03-14T05:53:32.0551367Z  2025-03-14T05:53:32.0551779Z  2025-03-14T05:53:32.0552184Z  2025-03-14T05:53:32.0552582Z  2025-03-14T05:53:32.0553013Z  2025-03-14T05:53:32.0553598Z [15,067 / 15,235] 48 actions, 47 running 2025-03-14T05:53:32.0554357Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T05:53:32.0555079Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2025-03-14T05:53:32.0555788Z @llvm-project//mlir:LinalgTransforms; 54s local 2025-03-14T05:53:32.0556562Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T05:53:32.0557411Z Compiling torch_xla/csrc/init_python_bindings.cpp; 45s local 2025-03-14T05:53:32.0558233Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2025-03-14T05:53:32.0559299Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2025-03-14T05:53:32.0560149Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local ... 2025-03-14T05:53:32.3468802Z 2025-03-14T05:53:32.3469616Z  2025-03-14T05:53:32.3470068Z  2025-03-14T05:53:32.3470435Z  2025-03-14T05:53:32.3470807Z  2025-03-14T05:53:32.3471195Z  2025-03-14T05:53:32.3471604Z  2025-03-14T05:53:32.3471983Z  2025-03-14T05:53:32.3472367Z  2025-03-14T05:53:32.3473203Z [15,068 / 15,235] 48 actions, 47 running 2025-03-14T05:53:32.3473949Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T05:53:32.3474608Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2025-03-14T05:53:32.3475277Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T05:53:32.3476000Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T05:53:32.3476842Z Compiling torch_xla/csrc/init_python_bindings.cpp; 45s local 2025-03-14T05:53:32.3477673Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2025-03-14T05:53:32.3478484Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2025-03-14T05:53:32.3479295Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local ... 2025-03-14T05:53:32.5806360Z 2025-03-14T05:53:32.5807094Z  2025-03-14T05:53:32.5807527Z  2025-03-14T05:53:32.5808266Z  2025-03-14T05:53:32.5808647Z  2025-03-14T05:53:32.5809015Z  2025-03-14T05:53:32.5809386Z  2025-03-14T05:53:32.5809811Z  2025-03-14T05:53:32.5810199Z  2025-03-14T05:53:32.5810777Z [15,069 / 15,235] 48 actions, 47 running 2025-03-14T05:53:32.5811492Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T05:53:32.5812124Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2025-03-14T05:53:32.5812722Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T05:53:32.5813436Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2025-03-14T05:53:32.5814266Z Compiling torch_xla/csrc/init_python_bindings.cpp; 45s local 2025-03-14T05:53:32.5815140Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2025-03-14T05:53:32.5816000Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2025-03-14T05:53:32.5816839Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local ... 2025-03-14T05:53:32.7907182Z 2025-03-14T05:53:32.7908098Z  2025-03-14T05:53:32.7908604Z  2025-03-14T05:53:32.7908971Z  2025-03-14T05:53:32.7909336Z  2025-03-14T05:53:32.7909717Z  2025-03-14T05:53:32.7910080Z  2025-03-14T05:53:32.7910810Z  2025-03-14T05:53:32.7911192Z  2025-03-14T05:53:32.7911753Z [15,069 / 15,235] 48 actions running 2025-03-14T05:53:32.7912486Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T05:53:32.7913202Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2025-03-14T05:53:32.7913871Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T05:53:32.7914671Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2025-03-14T05:53:32.7915459Z Compiling torch_xla/csrc/init_python_bindings.cpp; 45s local 2025-03-14T05:53:32.7916295Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2025-03-14T05:53:32.7917080Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2025-03-14T05:53:32.7917927Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 40s local ... 2025-03-14T05:53:33.3300278Z 2025-03-14T05:53:33.3301049Z  2025-03-14T05:53:33.3301426Z  2025-03-14T05:53:33.3301769Z  2025-03-14T05:53:33.3302076Z  2025-03-14T05:53:33.3302399Z  2025-03-14T05:53:33.3302788Z  2025-03-14T05:53:33.3303093Z  2025-03-14T05:53:33.3303390Z  2025-03-14T05:53:33.3303862Z [15,071 / 15,235] 47 actions, 46 running 2025-03-14T05:53:33.3304433Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T05:53:33.3304958Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T05:53:33.3305808Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T05:53:33.3306514Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2025-03-14T05:53:33.3307282Z Compiling torch_xla/csrc/init_python_bindings.cpp; 46s local 2025-03-14T05:53:33.3308062Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2025-03-14T05:53:33.3308841Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 40s local 2025-03-14T05:53:33.3309654Z Compiling torch_xla/csrc/debug_util.cpp; 39s local ... 2025-03-14T05:53:33.5397202Z 2025-03-14T05:53:33.5398062Z  2025-03-14T05:53:33.5398470Z  2025-03-14T05:53:33.5398790Z  2025-03-14T05:53:33.5399098Z  2025-03-14T05:53:33.5399466Z  2025-03-14T05:53:33.5399826Z  2025-03-14T05:53:33.5400152Z  2025-03-14T05:53:33.5400474Z  2025-03-14T05:53:33.5400973Z [15,072 / 15,235] 48 actions, 47 running 2025-03-14T05:53:33.5401687Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T05:53:33.5402292Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T05:53:33.5402849Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T05:53:33.5403457Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2025-03-14T05:53:33.5404195Z Compiling torch_xla/csrc/init_python_bindings.cpp; 46s local 2025-03-14T05:53:33.5405160Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2025-03-14T05:53:33.5406030Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 40s local 2025-03-14T05:53:33.5406709Z Compiling torch_xla/csrc/debug_util.cpp; 39s local ... 2025-03-14T05:53:33.7914780Z 2025-03-14T05:53:33.7915613Z  2025-03-14T05:53:33.7916100Z  2025-03-14T05:53:33.7916488Z  2025-03-14T05:53:33.7916834Z  2025-03-14T05:53:33.7917186Z  2025-03-14T05:53:33.7917549Z  2025-03-14T05:53:33.7917902Z  2025-03-14T05:53:33.7918294Z  2025-03-14T05:53:33.7918856Z [15,072 / 15,235] 48 actions running 2025-03-14T05:53:33.7919627Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2025-03-14T05:53:33.7920359Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T05:53:33.7920984Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T05:53:33.7921711Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2025-03-14T05:53:33.7922521Z Compiling torch_xla/csrc/init_python_bindings.cpp; 46s local 2025-03-14T05:53:33.7923393Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2025-03-14T05:53:33.7924229Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 41s local 2025-03-14T05:53:33.7925600Z Compiling torch_xla/csrc/debug_util.cpp; 39s local ... 2025-03-14T05:53:34.9311215Z 2025-03-14T05:53:34.9312085Z  2025-03-14T05:53:34.9312532Z  2025-03-14T05:53:34.9312886Z  2025-03-14T05:53:34.9313240Z  2025-03-14T05:53:34.9313611Z  2025-03-14T05:53:34.9313974Z  2025-03-14T05:53:34.9314329Z  2025-03-14T05:53:34.9314688Z  2025-03-14T05:53:34.9315250Z [15,073 / 15,235] 48 actions, 47 running 2025-03-14T05:53:34.9315951Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2025-03-14T05:53:34.9316622Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2025-03-14T05:53:34.9317256Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T05:53:34.9317932Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2025-03-14T05:53:34.9318728Z Compiling torch_xla/csrc/init_python_bindings.cpp; 48s local 2025-03-14T05:53:34.9319529Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2025-03-14T05:53:34.9320270Z Compiling torch_xla/csrc/debug_util.cpp; 40s local 2025-03-14T05:53:34.9320979Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local ... 2025-03-14T05:53:35.1924992Z 2025-03-14T05:53:35.1925802Z  2025-03-14T05:53:35.1926249Z  2025-03-14T05:53:35.1926634Z  2025-03-14T05:53:35.1926985Z  2025-03-14T05:53:35.1927319Z  2025-03-14T05:53:35.1927669Z  2025-03-14T05:53:35.1928001Z  2025-03-14T05:53:35.1928645Z  2025-03-14T05:53:35.1929180Z [15,073 / 15,235] 48 actions running 2025-03-14T05:53:35.1929864Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2025-03-14T05:53:35.1930493Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2025-03-14T05:53:35.1931096Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T05:53:35.1931793Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2025-03-14T05:53:35.1932675Z Compiling torch_xla/csrc/init_python_bindings.cpp; 48s local 2025-03-14T05:53:35.1933445Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2025-03-14T05:53:35.1934119Z Compiling torch_xla/csrc/debug_util.cpp; 40s local 2025-03-14T05:53:35.1935505Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local ... 2025-03-14T05:53:36.4072439Z 2025-03-14T05:53:36.4073289Z  2025-03-14T05:53:36.4073773Z  2025-03-14T05:53:36.4074168Z  2025-03-14T05:53:36.4074555Z  2025-03-14T05:53:36.4074925Z  2025-03-14T05:53:36.4075321Z  2025-03-14T05:53:36.4075683Z  2025-03-14T05:53:36.4076085Z  2025-03-14T05:53:36.4076638Z [15,073 / 15,235] 48 actions running 2025-03-14T05:53:36.4077382Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T05:53:36.4078088Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2025-03-14T05:53:36.4079274Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T05:53:36.4080076Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2025-03-14T05:53:36.4080907Z Compiling torch_xla/csrc/init_python_bindings.cpp; 49s local 2025-03-14T05:53:36.4081747Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2025-03-14T05:53:36.4082502Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2025-03-14T05:53:36.4083265Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local ... 2025-03-14T05:53:36.6076022Z 2025-03-14T05:53:36.6076898Z  2025-03-14T05:53:36.6077421Z  2025-03-14T05:53:36.6077820Z  2025-03-14T05:53:36.6078238Z  2025-03-14T05:53:36.6078621Z  2025-03-14T05:53:36.6079022Z  2025-03-14T05:53:36.6079405Z  2025-03-14T05:53:36.6079794Z  2025-03-14T05:53:36.6080318Z [15,074 / 15,235] 48 actions running 2025-03-14T05:53:36.6081064Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2025-03-14T05:53:36.6081752Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2025-03-14T05:53:36.6082404Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T05:53:36.6083119Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2025-03-14T05:53:36.6084283Z Compiling torch_xla/csrc/init_python_bindings.cpp; 49s local 2025-03-14T05:53:36.6085311Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2025-03-14T05:53:36.6086055Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2025-03-14T05:53:36.6086835Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local ... 2025-03-14T05:53:37.7521430Z 2025-03-14T05:53:37.7522319Z  2025-03-14T05:53:37.7522787Z  2025-03-14T05:53:37.7523123Z  2025-03-14T05:53:37.7523487Z  2025-03-14T05:53:37.7523895Z  2025-03-14T05:53:37.7524254Z  2025-03-14T05:53:37.7524836Z  2025-03-14T05:53:37.7525244Z  2025-03-14T05:53:37.7525858Z [15,075 / 15,235] 48 actions, 47 running 2025-03-14T05:53:37.7526659Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T05:53:37.7527446Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2025-03-14T05:53:37.7528173Z @llvm-project//mlir:LinalgTransforms; 60s local 2025-03-14T05:53:37.7528967Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T05:53:37.7529801Z Compiling torch_xla/csrc/init_python_bindings.cpp; 50s local 2025-03-14T05:53:37.7530580Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2025-03-14T05:53:37.7531339Z Compiling torch_xla/csrc/debug_util.cpp; 43s local 2025-03-14T05:53:37.7532183Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local ... 2025-03-14T05:53:37.9767069Z 2025-03-14T05:53:37.9767917Z  2025-03-14T05:53:37.9768401Z  2025-03-14T05:53:37.9768797Z  2025-03-14T05:53:37.9769195Z  2025-03-14T05:53:37.9769610Z  2025-03-14T05:53:37.9770029Z  2025-03-14T05:53:37.9770441Z  2025-03-14T05:53:37.9770859Z  2025-03-14T05:53:37.9771461Z [15,076 / 15,235] 48 actions, 47 running 2025-03-14T05:53:37.9772255Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T05:53:37.9773347Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2025-03-14T05:53:37.9774046Z @llvm-project//mlir:LinalgTransforms; 60s local 2025-03-14T05:53:37.9774833Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T05:53:37.9775642Z Compiling torch_xla/csrc/init_python_bindings.cpp; 51s local 2025-03-14T05:53:37.9776460Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T05:53:37.9777273Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2025-03-14T05:53:37.9778085Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2025-03-14T05:53:38.2085015Z 2025-03-14T05:53:38.2085862Z  2025-03-14T05:53:38.2086358Z  2025-03-14T05:53:38.2086804Z  2025-03-14T05:53:38.2087223Z  2025-03-14T05:53:38.2087651Z  2025-03-14T05:53:38.2088063Z  2025-03-14T05:53:38.2088483Z  2025-03-14T05:53:38.2088906Z  2025-03-14T05:53:38.2089827Z [15,076 / 15,235] 48 actions running 2025-03-14T05:53:38.2090614Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T05:53:38.2091395Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T05:53:38.2092113Z @llvm-project//mlir:LinalgTransforms; 60s local 2025-03-14T05:53:38.2092898Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T05:53:38.2093761Z Compiling torch_xla/csrc/init_python_bindings.cpp; 51s local 2025-03-14T05:53:38.2094640Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T05:53:38.2095469Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2025-03-14T05:53:38.2096188Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2025-03-14T05:53:38.5384951Z 2025-03-14T05:53:38.5385814Z  2025-03-14T05:53:38.5386310Z  2025-03-14T05:53:38.5386715Z  2025-03-14T05:53:38.5387130Z  2025-03-14T05:53:38.5387531Z  2025-03-14T05:53:38.5387954Z  2025-03-14T05:53:38.5388404Z  2025-03-14T05:53:38.5388806Z  2025-03-14T05:53:38.5389434Z [15,077 / 15,235] 48 actions, 47 running 2025-03-14T05:53:38.5390241Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T05:53:38.5391285Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T05:53:38.5392017Z @llvm-project//mlir:LinalgTransforms; 61s local 2025-03-14T05:53:38.5392811Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T05:53:38.5393636Z Compiling torch_xla/csrc/init_python_bindings.cpp; 51s local 2025-03-14T05:53:38.5394555Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T05:53:38.5395360Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2025-03-14T05:53:38.5396192Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2025-03-14T05:53:38.8091685Z 2025-03-14T05:53:38.8092710Z  2025-03-14T05:53:38.8093369Z  2025-03-14T05:53:38.8093970Z  2025-03-14T05:53:38.8094545Z  2025-03-14T05:53:38.8094994Z  2025-03-14T05:53:38.8095552Z  2025-03-14T05:53:38.8095923Z  2025-03-14T05:53:38.8096485Z  2025-03-14T05:53:38.8097416Z [15,077 / 15,235] 48 actions running 2025-03-14T05:53:38.8098461Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2025-03-14T05:53:38.8099330Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T05:53:38.8100194Z @llvm-project//mlir:LinalgTransforms; 61s local 2025-03-14T05:53:38.8101137Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T05:53:38.8102283Z Compiling torch_xla/csrc/init_python_bindings.cpp; 51s local 2025-03-14T05:53:38.8103522Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T05:53:38.8104662Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2025-03-14T05:53:38.8105625Z Compiling torch_xla/csrc/tensor.cpp; 35s local ... 2025-03-14T05:53:39.8098330Z 2025-03-14T05:53:39.8099183Z  2025-03-14T05:53:39.8099671Z  2025-03-14T05:53:39.8100118Z  2025-03-14T05:53:39.8100514Z  2025-03-14T05:53:39.8100892Z  2025-03-14T05:53:39.8101199Z  2025-03-14T05:53:39.8101721Z  2025-03-14T05:53:39.8102093Z  2025-03-14T05:53:39.8102650Z [15,077 / 15,235] 48 actions running 2025-03-14T05:53:39.8103352Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2025-03-14T05:53:39.8104021Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2025-03-14T05:53:39.8104671Z @llvm-project//mlir:LinalgTransforms; 62s local 2025-03-14T05:53:39.8105399Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2025-03-14T05:53:39.8106187Z Compiling torch_xla/csrc/init_python_bindings.cpp; 52s local 2025-03-14T05:53:39.8106963Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2025-03-14T05:53:39.8107696Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2025-03-14T05:53:39.8108614Z Compiling torch_xla/csrc/tensor.cpp; 36s local ... 2025-03-14T05:53:40.8105951Z 2025-03-14T05:53:40.8106785Z  2025-03-14T05:53:40.8107632Z  2025-03-14T05:53:40.8108049Z  2025-03-14T05:53:40.8108455Z  2025-03-14T05:53:40.8108842Z  2025-03-14T05:53:40.8109240Z  2025-03-14T05:53:40.8109682Z  2025-03-14T05:53:40.8110126Z  2025-03-14T05:53:40.8110703Z [15,077 / 15,235] 48 actions running 2025-03-14T05:53:40.8111475Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2025-03-14T05:53:40.8112142Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2025-03-14T05:53:40.8112833Z @llvm-project//mlir:LinalgTransforms; 63s local 2025-03-14T05:53:40.8113608Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2025-03-14T05:53:40.8114494Z Compiling torch_xla/csrc/init_python_bindings.cpp; 53s local 2025-03-14T05:53:40.8115396Z Compiling torch_xla/csrc/aten_xla_type.cpp; 52s local 2025-03-14T05:53:40.8116185Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2025-03-14T05:53:40.8116954Z Compiling torch_xla/csrc/tensor.cpp; 37s local ... 2025-03-14T05:53:41.8058047Z 2025-03-14T05:53:41.8058927Z  2025-03-14T05:53:41.8059426Z  2025-03-14T05:53:41.8059804Z  2025-03-14T05:53:41.8060235Z  2025-03-14T05:53:41.8060635Z  2025-03-14T05:53:41.8061301Z  2025-03-14T05:53:41.8061703Z  2025-03-14T05:53:41.8062145Z  2025-03-14T05:53:41.8062731Z [15,078 / 15,235] 48 actions, 47 running 2025-03-14T05:53:41.8063491Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2025-03-14T05:53:41.8064183Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2025-03-14T05:53:41.8064861Z @llvm-project//mlir:LinalgTransforms; 64s local 2025-03-14T05:53:41.8065950Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2025-03-14T05:53:41.8066790Z Compiling torch_xla/csrc/init_python_bindings.cpp; 54s local 2025-03-14T05:53:41.8067642Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2025-03-14T05:53:41.8068399Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2025-03-14T05:53:41.8069169Z Compiling torch_xla/csrc/tensor.cpp; 38s local ... 2025-03-14T05:53:42.0116249Z 2025-03-14T05:53:42.0117122Z  2025-03-14T05:53:42.0117622Z  2025-03-14T05:53:42.0118021Z  2025-03-14T05:53:42.0118401Z  2025-03-14T05:53:42.0118773Z  2025-03-14T05:53:42.0119170Z  2025-03-14T05:53:42.0119574Z  2025-03-14T05:53:42.0119940Z  2025-03-14T05:53:42.0120491Z [15,078 / 15,235] 48 actions running 2025-03-14T05:53:42.0121238Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2025-03-14T05:53:42.0121954Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2025-03-14T05:53:42.0122977Z @llvm-project//mlir:LinalgTransforms; 64s local 2025-03-14T05:53:42.0123770Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2025-03-14T05:53:42.0124768Z Compiling torch_xla/csrc/init_python_bindings.cpp; 55s local 2025-03-14T05:53:42.0125636Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2025-03-14T05:53:42.0126384Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2025-03-14T05:53:42.0127150Z Compiling torch_xla/csrc/tensor.cpp; 38s local ... 2025-03-14T05:53:43.0126497Z 2025-03-14T05:53:43.0127419Z  2025-03-14T05:53:43.0127948Z  2025-03-14T05:53:43.0128376Z  2025-03-14T05:53:43.0128785Z  2025-03-14T05:53:43.0129186Z  2025-03-14T05:53:43.0129600Z  2025-03-14T05:53:43.0130003Z  2025-03-14T05:53:43.0130399Z  2025-03-14T05:53:43.0130982Z [15,078 / 15,235] 48 actions running 2025-03-14T05:53:43.0131751Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2025-03-14T05:53:43.0132477Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2025-03-14T05:53:43.0133197Z @llvm-project//mlir:LinalgTransforms; 65s local 2025-03-14T05:53:43.0133987Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2025-03-14T05:53:43.0134824Z Compiling torch_xla/csrc/init_python_bindings.cpp; 56s local 2025-03-14T05:53:43.0136482Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2025-03-14T05:53:43.0137651Z Compiling torch_xla/csrc/ir_dump_util.cpp; 46s local 2025-03-14T05:53:43.0138473Z Compiling torch_xla/csrc/tensor.cpp; 39s local ... 2025-03-14T05:53:44.0135075Z 2025-03-14T05:53:44.0136643Z  2025-03-14T05:53:44.0137122Z  2025-03-14T05:53:44.0137485Z  2025-03-14T05:53:44.0137867Z  2025-03-14T05:53:44.0138231Z  2025-03-14T05:53:44.0138621Z  2025-03-14T05:53:44.0138977Z  2025-03-14T05:53:44.0139353Z  2025-03-14T05:53:44.0139917Z [15,078 / 15,235] 48 actions running 2025-03-14T05:53:44.0140708Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T05:53:44.0141425Z @xla//xla/mlir_hlo:mhlo_passes; 80s local 2025-03-14T05:53:44.0142140Z @llvm-project//mlir:LinalgTransforms; 66s local 2025-03-14T05:53:44.0142915Z Compiling xla/service/cpu/cpu_compiler.cc; 62s local 2025-03-14T05:53:44.0143757Z Compiling torch_xla/csrc/init_python_bindings.cpp; 57s local 2025-03-14T05:53:44.0144683Z Compiling torch_xla/csrc/aten_xla_type.cpp; 56s local 2025-03-14T05:53:44.0145520Z Compiling torch_xla/csrc/ir_dump_util.cpp; 47s local 2025-03-14T05:53:44.0146320Z Compiling torch_xla/csrc/tensor.cpp; 40s local ... 2025-03-14T05:53:44.4864897Z 2025-03-14T05:53:44.4866092Z  2025-03-14T05:53:44.4866598Z  2025-03-14T05:53:44.4866989Z  2025-03-14T05:53:44.4867396Z  2025-03-14T05:53:44.4867785Z  2025-03-14T05:53:44.4868190Z  2025-03-14T05:53:44.4868602Z  2025-03-14T05:53:44.4868997Z  2025-03-14T05:53:44.4869610Z [15,079 / 15,235] 48 actions, 47 running 2025-03-14T05:53:44.4870407Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T05:53:44.4871097Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2025-03-14T05:53:44.4871786Z @llvm-project//mlir:LinalgTransforms; 67s local 2025-03-14T05:53:44.4872579Z Compiling torch_xla/csrc/init_python_bindings.cpp; 57s local 2025-03-14T05:53:44.4873462Z Compiling torch_xla/csrc/aten_xla_type.cpp; 56s local 2025-03-14T05:53:44.4874291Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2025-03-14T05:53:44.4875018Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2025-03-14T05:53:44.4875814Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local ... 2025-03-14T05:53:44.8142318Z 2025-03-14T05:53:44.8143131Z  2025-03-14T05:53:44.8143604Z  2025-03-14T05:53:44.8143941Z  2025-03-14T05:53:44.8144296Z  2025-03-14T05:53:44.8144651Z  2025-03-14T05:53:44.8145028Z  2025-03-14T05:53:44.8145434Z  2025-03-14T05:53:44.8145839Z  2025-03-14T05:53:44.8146742Z [15,079 / 15,235] 48 actions running 2025-03-14T05:53:44.8147446Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T05:53:44.8148101Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2025-03-14T05:53:44.8148954Z @llvm-project//mlir:LinalgTransforms; 67s local 2025-03-14T05:53:44.8149807Z Compiling torch_xla/csrc/init_python_bindings.cpp; 57s local 2025-03-14T05:53:44.8150659Z Compiling torch_xla/csrc/aten_xla_type.cpp; 56s local 2025-03-14T05:53:44.8151545Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2025-03-14T05:53:44.8152251Z Compiling torch_xla/csrc/tensor.cpp; 41s local 2025-03-14T05:53:44.8152973Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local ... 2025-03-14T05:53:45.1315545Z 2025-03-14T05:53:45.1316426Z  2025-03-14T05:53:45.1316915Z  2025-03-14T05:53:45.1317302Z  2025-03-14T05:53:45.1317703Z  2025-03-14T05:53:45.1318091Z  2025-03-14T05:53:45.1318481Z  2025-03-14T05:53:45.1318906Z  2025-03-14T05:53:45.1319295Z  2025-03-14T05:53:45.1319880Z [15,080 / 15,235] 48 actions, 47 running 2025-03-14T05:53:45.1320635Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T05:53:45.1321375Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2025-03-14T05:53:45.1322097Z @llvm-project//mlir:LinalgTransforms; 67s local 2025-03-14T05:53:45.1323234Z Compiling torch_xla/csrc/init_python_bindings.cpp; 58s local 2025-03-14T05:53:45.1324117Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2025-03-14T05:53:45.1325198Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2025-03-14T05:53:45.1326138Z Compiling torch_xla/csrc/tensor.cpp; 41s local 2025-03-14T05:53:45.1326956Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local ... 2025-03-14T05:53:45.4146734Z 2025-03-14T05:53:45.4147600Z  2025-03-14T05:53:45.4148093Z  2025-03-14T05:53:45.4148511Z  2025-03-14T05:53:45.4148882Z  2025-03-14T05:53:45.4149322Z  2025-03-14T05:53:45.4149727Z  2025-03-14T05:53:45.4150136Z  2025-03-14T05:53:45.4150563Z  2025-03-14T05:53:45.4151166Z [15,080 / 15,235] 48 actions running 2025-03-14T05:53:45.4151946Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T05:53:45.4152718Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2025-03-14T05:53:45.4153633Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T05:53:45.4154502Z Compiling torch_xla/csrc/init_python_bindings.cpp; 58s local 2025-03-14T05:53:45.4155344Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2025-03-14T05:53:45.4156494Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2025-03-14T05:53:45.4157289Z Compiling torch_xla/csrc/tensor.cpp; 41s local 2025-03-14T05:53:45.4158049Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local ... 2025-03-14T05:53:45.9645425Z 2025-03-14T05:53:45.9646257Z  2025-03-14T05:53:45.9646732Z  2025-03-14T05:53:45.9647150Z  2025-03-14T05:53:45.9647539Z  2025-03-14T05:53:45.9647933Z  2025-03-14T05:53:45.9648309Z  2025-03-14T05:53:45.9648681Z  2025-03-14T05:53:45.9649064Z  2025-03-14T05:53:45.9649644Z [15,081 / 15,235] 48 actions, 47 running 2025-03-14T05:53:45.9650355Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T05:53:45.9651041Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2025-03-14T05:53:45.9651810Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T05:53:45.9652858Z Compiling torch_xla/csrc/init_python_bindings.cpp; 59s local 2025-03-14T05:53:45.9653830Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2025-03-14T05:53:45.9654571Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2025-03-14T05:53:45.9655283Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T05:53:45.9656058Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local ... 2025-03-14T05:53:46.2153471Z 2025-03-14T05:53:46.2154549Z  2025-03-14T05:53:46.2155055Z  2025-03-14T05:53:46.2155485Z  2025-03-14T05:53:46.2155874Z  2025-03-14T05:53:46.2156270Z  2025-03-14T05:53:46.2156668Z  2025-03-14T05:53:46.2157072Z  2025-03-14T05:53:46.2157462Z  2025-03-14T05:53:46.2158046Z [15,081 / 15,235] 48 actions running 2025-03-14T05:53:46.2158852Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T05:53:46.2159616Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2025-03-14T05:53:46.2160526Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T05:53:46.2161428Z Compiling torch_xla/csrc/init_python_bindings.cpp; 59s local 2025-03-14T05:53:46.2162327Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2025-03-14T05:53:46.2163107Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2025-03-14T05:53:46.2163897Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T05:53:46.2164878Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local ... 2025-03-14T05:53:46.6158133Z 2025-03-14T05:53:46.6158971Z  2025-03-14T05:53:46.6159421Z  2025-03-14T05:53:46.6159822Z  2025-03-14T05:53:46.6160212Z  2025-03-14T05:53:46.6160608Z  2025-03-14T05:53:46.6160996Z  2025-03-14T05:53:46.6161405Z  2025-03-14T05:53:46.6161793Z  2025-03-14T05:53:46.6162648Z [15,082 / 15,235] 47 actions running 2025-03-14T05:53:46.6163458Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2025-03-14T05:53:46.6164172Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2025-03-14T05:53:46.6165012Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T05:53:46.6165996Z Compiling torch_xla/csrc/init_python_bindings.cpp; 59s local 2025-03-14T05:53:46.6166875Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2025-03-14T05:53:46.6167663Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2025-03-14T05:53:46.6168425Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T05:53:46.6169166Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local ... 2025-03-14T05:53:47.0162575Z 2025-03-14T05:53:47.0163376Z  2025-03-14T05:53:47.0163834Z  2025-03-14T05:53:47.0164224Z  2025-03-14T05:53:47.0164732Z  2025-03-14T05:53:47.0165103Z  2025-03-14T05:53:47.0165689Z  2025-03-14T05:53:47.0166066Z  2025-03-14T05:53:47.0166474Z  2025-03-14T05:53:47.0166982Z [15,082 / 15,235] 48 actions running 2025-03-14T05:53:47.0167706Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2025-03-14T05:53:47.0168645Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2025-03-14T05:53:47.0169292Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T05:53:47.0170067Z Compiling torch_xla/csrc/init_python_bindings.cpp; 60s local 2025-03-14T05:53:47.0170862Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2025-03-14T05:53:47.0171598Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2025-03-14T05:53:47.0172279Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2025-03-14T05:53:47.0172987Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local ... 2025-03-14T05:53:47.2166731Z 2025-03-14T05:53:47.2167589Z  2025-03-14T05:53:47.2168054Z  2025-03-14T05:53:47.2168478Z  2025-03-14T05:53:47.2168886Z  2025-03-14T05:53:47.2169294Z  2025-03-14T05:53:47.2169721Z  2025-03-14T05:53:47.2170130Z  2025-03-14T05:53:47.2170526Z  2025-03-14T05:53:47.2171104Z [15,083 / 15,235] 48 actions running 2025-03-14T05:53:47.2171849Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2025-03-14T05:53:47.2172522Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2025-03-14T05:53:47.2173171Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T05:53:47.2173964Z Compiling torch_xla/csrc/init_python_bindings.cpp; 60s local 2025-03-14T05:53:47.2174804Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2025-03-14T05:53:47.2175838Z Compiling torch_xla/csrc/ir_dump_util.cpp; 51s local 2025-03-14T05:53:47.2176594Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2025-03-14T05:53:47.2177358Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local ... 2025-03-14T05:53:47.8168275Z 2025-03-14T05:53:47.8169689Z  2025-03-14T05:53:47.8172913Z  2025-03-14T05:53:47.8173685Z  2025-03-14T05:53:47.8174341Z  2025-03-14T05:53:47.8175406Z  2025-03-14T05:53:47.8175890Z  2025-03-14T05:53:47.8176323Z  2025-03-14T05:53:47.8177070Z  2025-03-14T05:53:47.8177707Z [15,084 / 15,235] 47 actions running 2025-03-14T05:53:47.8178514Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T05:53:47.8179253Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2025-03-14T05:53:47.8179980Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T05:53:47.8180889Z Compiling torch_xla/csrc/init_python_bindings.cpp; 60s local 2025-03-14T05:53:47.8181852Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2025-03-14T05:53:47.8182691Z Compiling torch_xla/csrc/ir_dump_util.cpp; 51s local 2025-03-14T05:53:47.8183491Z Compiling torch_xla/csrc/tensor.cpp; 44s local 2025-03-14T05:53:47.8184376Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local ... 2025-03-14T05:53:48.0170874Z 2025-03-14T05:53:48.0171837Z  2025-03-14T05:53:48.0172666Z  2025-03-14T05:53:48.0173110Z  2025-03-14T05:53:48.0173562Z  2025-03-14T05:53:48.0173952Z  2025-03-14T05:53:48.0174366Z  2025-03-14T05:53:48.0174760Z  2025-03-14T05:53:48.0175146Z  2025-03-14T05:53:48.0175666Z [15,084 / 15,235] 48 actions running 2025-03-14T05:53:48.0176420Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T05:53:48.0177116Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2025-03-14T05:53:48.0177783Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T05:53:48.0178629Z Compiling torch_xla/csrc/init_python_bindings.cpp; 61s local 2025-03-14T05:53:48.0179989Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2025-03-14T05:53:48.0180802Z Compiling torch_xla/csrc/ir_dump_util.cpp; 51s local 2025-03-14T05:53:48.0181730Z Compiling torch_xla/csrc/tensor.cpp; 44s local 2025-03-14T05:53:48.0182699Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local ... 2025-03-14T05:53:49.2179079Z 2025-03-14T05:53:49.2180026Z  2025-03-14T05:53:49.2180499Z  2025-03-14T05:53:49.2180866Z  2025-03-14T05:53:49.2181277Z  2025-03-14T05:53:49.2182043Z  2025-03-14T05:53:49.2182876Z  2025-03-14T05:53:49.2183382Z  2025-03-14T05:53:49.2183932Z  2025-03-14T05:53:49.2184656Z [15,084 / 15,235] 48 actions running 2025-03-14T05:53:49.2185535Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2025-03-14T05:53:49.2186365Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2025-03-14T05:53:49.2187145Z @llvm-project//mlir:LinalgTransforms; 71s local 2025-03-14T05:53:49.2188068Z Compiling torch_xla/csrc/init_python_bindings.cpp; 62s local 2025-03-14T05:53:49.2189009Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2025-03-14T05:53:49.2189943Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2025-03-14T05:53:49.2190806Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2025-03-14T05:53:49.2191686Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local ... 2025-03-14T05:53:50.3043334Z 2025-03-14T05:53:50.3044266Z  2025-03-14T05:53:50.3044859Z  2025-03-14T05:53:50.3045318Z  2025-03-14T05:53:50.3045722Z  2025-03-14T05:53:50.3046163Z  2025-03-14T05:53:50.3046580Z  2025-03-14T05:53:50.3046982Z  2025-03-14T05:53:50.3047381Z  2025-03-14T05:53:50.3048008Z [15,085 / 15,235] 48 actions, 47 running 2025-03-14T05:53:50.3048737Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2025-03-14T05:53:50.3049397Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2025-03-14T05:53:50.3050477Z @llvm-project//mlir:LinalgTransforms; 72s local 2025-03-14T05:53:50.3051366Z Compiling torch_xla/csrc/init_python_bindings.cpp; 63s local 2025-03-14T05:53:50.3052277Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2025-03-14T05:53:50.3053076Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2025-03-14T05:53:50.3053854Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T05:53:50.3054694Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local ... 2025-03-14T05:53:50.6190646Z 2025-03-14T05:53:50.6191742Z  2025-03-14T05:53:50.6192255Z  2025-03-14T05:53:50.6192669Z  2025-03-14T05:53:50.6193082Z  2025-03-14T05:53:50.6193491Z  2025-03-14T05:53:50.6193880Z  2025-03-14T05:53:50.6194275Z  2025-03-14T05:53:50.6194677Z  2025-03-14T05:53:50.6195213Z [15,085 / 15,235] 48 actions running 2025-03-14T05:53:50.6195981Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T05:53:50.6196682Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2025-03-14T05:53:50.6197332Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T05:53:50.6198164Z Compiling torch_xla/csrc/init_python_bindings.cpp; 63s local 2025-03-14T05:53:50.6198961Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2025-03-14T05:53:50.6199659Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2025-03-14T05:53:50.6200610Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T05:53:50.6201425Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local ... 2025-03-14T05:53:50.9393006Z 2025-03-14T05:53:50.9393987Z  2025-03-14T05:53:50.9394462Z  2025-03-14T05:53:50.9395130Z  2025-03-14T05:53:50.9395537Z  2025-03-14T05:53:50.9396063Z  2025-03-14T05:53:50.9396572Z  2025-03-14T05:53:50.9397057Z  2025-03-14T05:53:50.9397586Z  2025-03-14T05:53:50.9398331Z [15,086 / 15,235] 48 actions, 47 running 2025-03-14T05:53:50.9399277Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T05:53:50.9400166Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2025-03-14T05:53:50.9401011Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T05:53:50.9402032Z Compiling torch_xla/csrc/init_python_bindings.cpp; 64s local 2025-03-14T05:53:50.9403041Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2025-03-14T05:53:50.9403986Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2025-03-14T05:53:50.9404973Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2025-03-14T05:53:50.9405885Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local ... 2025-03-14T05:53:51.1405467Z 2025-03-14T05:53:51.1406389Z  2025-03-14T05:53:51.1406867Z  2025-03-14T05:53:51.1407468Z  2025-03-14T05:53:51.1407890Z  2025-03-14T05:53:51.1408433Z  2025-03-14T05:53:51.1408962Z  2025-03-14T05:53:51.1409445Z  2025-03-14T05:53:51.1409936Z  2025-03-14T05:53:51.1410636Z [15,087 / 15,235] 48 actions, 47 running 2025-03-14T05:53:51.1411488Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T05:53:51.1412303Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T05:53:51.1413268Z Compiling torch_xla/csrc/init_python_bindings.cpp; 64s local 2025-03-14T05:53:51.1414252Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2025-03-14T05:53:51.1415193Z Compiling torch_xla/csrc/ir_dump_util.cpp; 55s local 2025-03-14T05:53:51.1416039Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2025-03-14T05:53:51.1416973Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2025-03-14T05:53:51.1417918Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local ... 2025-03-14T05:53:51.4195472Z 2025-03-14T05:53:51.4196411Z  2025-03-14T05:53:51.4196880Z  2025-03-14T05:53:51.4197275Z  2025-03-14T05:53:51.4197690Z  2025-03-14T05:53:51.4198083Z  2025-03-14T05:53:51.4198499Z  2025-03-14T05:53:51.4201013Z  2025-03-14T05:53:51.4203903Z  2025-03-14T05:53:51.4207372Z [15,087 / 15,235] 48 actions running 2025-03-14T05:53:51.4210695Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T05:53:51.4213998Z @llvm-project//mlir:LinalgTransforms; 74s local 2025-03-14T05:53:51.4217366Z Compiling torch_xla/csrc/init_python_bindings.cpp; 64s local 2025-03-14T05:53:51.4220826Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2025-03-14T05:53:51.4224275Z Compiling torch_xla/csrc/ir_dump_util.cpp; 55s local 2025-03-14T05:53:51.4238621Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2025-03-14T05:53:51.4241348Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2025-03-14T05:53:51.4242457Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local ... 2025-03-14T05:53:52.3979537Z 2025-03-14T05:53:52.3980430Z  2025-03-14T05:53:52.3980931Z  2025-03-14T05:53:52.3981329Z  2025-03-14T05:53:52.3981734Z  2025-03-14T05:53:52.3982151Z  2025-03-14T05:53:52.3982565Z  2025-03-14T05:53:52.3983013Z  2025-03-14T05:53:52.3983418Z  2025-03-14T05:53:52.3984026Z [15,088 / 15,235] 48 actions, 47 running 2025-03-14T05:53:52.3984830Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2025-03-14T05:53:52.3985571Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T05:53:52.3986436Z Compiling torch_xla/csrc/init_python_bindings.cpp; 65s local 2025-03-14T05:53:52.3987594Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T05:53:52.3988348Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2025-03-14T05:53:52.3989111Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2025-03-14T05:53:52.3989931Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2025-03-14T05:53:52.3990822Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 44s local ... 2025-03-14T05:53:52.6204682Z 2025-03-14T05:53:52.6205552Z  2025-03-14T05:53:52.6206020Z  2025-03-14T05:53:52.6206441Z  2025-03-14T05:53:52.6207052Z  2025-03-14T05:53:52.6207461Z  2025-03-14T05:53:52.6207849Z  2025-03-14T05:53:52.6208243Z  2025-03-14T05:53:52.6208644Z  2025-03-14T05:53:52.6209222Z [15,088 / 15,235] 48 actions running 2025-03-14T05:53:52.6210010Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T05:53:52.6210785Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T05:53:52.6211639Z Compiling torch_xla/csrc/init_python_bindings.cpp; 65s local 2025-03-14T05:53:52.6212434Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T05:53:52.6213402Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2025-03-14T05:53:52.6214086Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2025-03-14T05:53:52.6214811Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2025-03-14T05:53:52.6215611Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 44s local ... 2025-03-14T05:53:52.8234961Z 2025-03-14T05:53:52.8235767Z  2025-03-14T05:53:52.8236309Z  2025-03-14T05:53:52.8236728Z  2025-03-14T05:53:52.8237152Z  2025-03-14T05:53:52.8237579Z  2025-03-14T05:53:52.8238009Z  2025-03-14T05:53:52.8238410Z  2025-03-14T05:53:52.8238791Z  2025-03-14T05:53:52.8239440Z [15,089 / 15,235] 48 actions, 47 running 2025-03-14T05:53:52.8240238Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T05:53:52.8240977Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T05:53:52.8241810Z Compiling torch_xla/csrc/init_python_bindings.cpp; 65s local 2025-03-14T05:53:52.8242696Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T05:53:52.8243445Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2025-03-14T05:53:52.8244218Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2025-03-14T05:53:52.8245101Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2025-03-14T05:53:52.8245912Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local ... 2025-03-14T05:53:53.2211808Z 2025-03-14T05:53:53.2212698Z  2025-03-14T05:53:53.2213179Z  2025-03-14T05:53:53.2213578Z  2025-03-14T05:53:53.2213958Z  2025-03-14T05:53:53.2214354Z  2025-03-14T05:53:53.2214741Z  2025-03-14T05:53:53.2215124Z  2025-03-14T05:53:53.2215542Z  2025-03-14T05:53:53.2216141Z [15,089 / 15,235] 48 actions running 2025-03-14T05:53:53.2216906Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T05:53:53.2217843Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T05:53:53.2218665Z Compiling torch_xla/csrc/init_python_bindings.cpp; 66s local 2025-03-14T05:53:53.2219483Z Compiling torch_xla/csrc/aten_xla_type.cpp; 65s local 2025-03-14T05:53:53.2220206Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2025-03-14T05:53:53.2220956Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2025-03-14T05:53:53.2221753Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2025-03-14T05:53:53.2222560Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local ... 2025-03-14T05:53:54.3692606Z 2025-03-14T05:53:54.3693850Z  2025-03-14T05:53:54.3694356Z  2025-03-14T05:53:54.3694790Z  2025-03-14T05:53:54.3695193Z  2025-03-14T05:53:54.3695600Z  2025-03-14T05:53:54.3695994Z  2025-03-14T05:53:54.3696405Z  2025-03-14T05:53:54.3697113Z  2025-03-14T05:53:54.3697718Z [15,090 / 15,235] 48 actions, 47 running 2025-03-14T05:53:54.3698531Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2025-03-14T05:53:54.3699357Z @llvm-project//mlir:LinalgTransforms; 77s local 2025-03-14T05:53:54.3700133Z Compiling torch_xla/csrc/init_python_bindings.cpp; 67s local 2025-03-14T05:53:54.3700959Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2025-03-14T05:53:54.3701688Z Compiling torch_xla/csrc/tensor.cpp; 50s local 2025-03-14T05:53:54.3702429Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2025-03-14T05:53:54.3703229Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2025-03-14T05:53:54.3704094Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local ... 2025-03-14T05:53:54.6220261Z 2025-03-14T05:53:54.6221168Z  2025-03-14T05:53:54.6221685Z  2025-03-14T05:53:54.6222130Z  2025-03-14T05:53:54.6222500Z  2025-03-14T05:53:54.6222866Z  2025-03-14T05:53:54.6223282Z  2025-03-14T05:53:54.6223666Z  2025-03-14T05:53:54.6224055Z  2025-03-14T05:53:54.6224598Z [15,090 / 15,235] 48 actions running 2025-03-14T05:53:54.6225585Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T05:53:54.6226361Z @llvm-project//mlir:LinalgTransforms; 77s local 2025-03-14T05:53:54.6227178Z Compiling torch_xla/csrc/init_python_bindings.cpp; 67s local 2025-03-14T05:53:54.6228031Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2025-03-14T05:53:54.6228799Z Compiling torch_xla/csrc/tensor.cpp; 50s local 2025-03-14T05:53:54.6229571Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2025-03-14T05:53:54.6230154Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2025-03-14T05:53:54.6230875Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local ... 2025-03-14T05:53:55.3675169Z 2025-03-14T05:53:55.3676419Z  2025-03-14T05:53:55.3676922Z  2025-03-14T05:53:55.3677386Z  2025-03-14T05:53:55.3677804Z  2025-03-14T05:53:55.3678226Z  2025-03-14T05:53:55.3678648Z  2025-03-14T05:53:55.3679020Z  2025-03-14T05:53:55.3679426Z  2025-03-14T05:53:55.3680045Z [15,091 / 15,235] 48 actions, 47 running 2025-03-14T05:53:55.3680846Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T05:53:55.3681640Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T05:53:55.3682497Z Compiling torch_xla/csrc/init_python_bindings.cpp; 68s local 2025-03-14T05:53:55.3683351Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2025-03-14T05:53:55.3684458Z Compiling torch_xla/csrc/tensor.cpp; 51s local 2025-03-14T05:53:55.3685432Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T05:53:55.3686256Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2025-03-14T05:53:55.3687175Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local ... 2025-03-14T05:53:55.6227615Z 2025-03-14T05:53:55.6228495Z  2025-03-14T05:53:55.6228988Z  2025-03-14T05:53:55.6229392Z  2025-03-14T05:53:55.6229820Z  2025-03-14T05:53:55.6230470Z  2025-03-14T05:53:55.6230884Z  2025-03-14T05:53:55.6231275Z  2025-03-14T05:53:55.6231714Z  2025-03-14T05:53:55.6232319Z [15,091 / 15,235] 48 actions running 2025-03-14T05:53:55.6233063Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2025-03-14T05:53:55.6233877Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T05:53:55.6234695Z Compiling torch_xla/csrc/init_python_bindings.cpp; 68s local 2025-03-14T05:53:55.6235610Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2025-03-14T05:53:55.6236411Z Compiling torch_xla/csrc/tensor.cpp; 51s local 2025-03-14T05:53:55.6237240Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T05:53:55.6238083Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2025-03-14T05:53:55.6239000Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local ... 2025-03-14T05:53:56.1524908Z 2025-03-14T05:53:56.1525777Z  2025-03-14T05:53:56.1526161Z  2025-03-14T05:53:56.1526497Z  2025-03-14T05:53:56.1526801Z  2025-03-14T05:53:56.1527111Z  2025-03-14T05:53:56.1527422Z  2025-03-14T05:53:56.1527725Z  2025-03-14T05:53:56.1528024Z  2025-03-14T05:53:56.1528575Z [15,092 / 15,235] 48 actions, 47 running 2025-03-14T05:53:56.1529366Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2025-03-14T05:53:56.1529971Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T05:53:56.1530622Z Compiling torch_xla/csrc/init_python_bindings.cpp; 69s local 2025-03-14T05:53:56.1531284Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2025-03-14T05:53:56.1531880Z Compiling torch_xla/csrc/tensor.cpp; 52s local 2025-03-14T05:53:56.1532639Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T05:53:56.1533414Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2025-03-14T05:53:56.1534321Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local ... 2025-03-14T05:53:56.4234537Z 2025-03-14T05:53:56.4235416Z  2025-03-14T05:53:56.4238309Z  2025-03-14T05:53:56.4238726Z  2025-03-14T05:53:56.4239140Z  2025-03-14T05:53:56.4239573Z  2025-03-14T05:53:56.4239948Z  2025-03-14T05:53:56.4240303Z  2025-03-14T05:53:56.4240696Z  2025-03-14T05:53:56.4241254Z [15,092 / 15,235] 48 actions running 2025-03-14T05:53:56.4242020Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2025-03-14T05:53:56.4242746Z @llvm-project//mlir:LinalgTransforms; 79s local 2025-03-14T05:53:56.4243548Z Compiling torch_xla/csrc/init_python_bindings.cpp; 69s local 2025-03-14T05:53:56.4244686Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2025-03-14T05:53:56.4245483Z Compiling torch_xla/csrc/tensor.cpp; 52s local 2025-03-14T05:53:56.4246186Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2025-03-14T05:53:56.4246919Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2025-03-14T05:53:56.4247736Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local ... 2025-03-14T05:53:57.4242080Z 2025-03-14T05:53:57.4243362Z  2025-03-14T05:53:57.4243861Z  2025-03-14T05:53:57.4244248Z  2025-03-14T05:53:57.4244778Z  2025-03-14T05:53:57.4245215Z  2025-03-14T05:53:57.4245643Z  2025-03-14T05:53:57.4246031Z  2025-03-14T05:53:57.4246440Z  2025-03-14T05:53:57.4246943Z [15,092 / 15,235] 48 actions running 2025-03-14T05:53:57.4247900Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2025-03-14T05:53:57.4248680Z @llvm-project//mlir:LinalgTransforms; 80s local 2025-03-14T05:53:57.4249541Z Compiling torch_xla/csrc/init_python_bindings.cpp; 70s local 2025-03-14T05:53:57.4250398Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2025-03-14T05:53:57.4251046Z Compiling torch_xla/csrc/tensor.cpp; 53s local 2025-03-14T05:53:57.4251936Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2025-03-14T05:53:57.4252851Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2025-03-14T05:53:57.4253706Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local ... 2025-03-14T05:53:58.1087766Z 2025-03-14T05:53:58.1088811Z  2025-03-14T05:53:58.1089270Z  2025-03-14T05:53:58.1089656Z  2025-03-14T05:53:58.1090057Z  2025-03-14T05:53:58.1090451Z  2025-03-14T05:53:58.1090842Z  2025-03-14T05:53:58.1091218Z  2025-03-14T05:53:58.1091575Z  2025-03-14T05:53:58.1092187Z [15,093 / 15,235] 48 actions, 47 running 2025-03-14T05:53:58.1092923Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T05:53:58.1093723Z @llvm-project//mlir:LinalgTransforms; 80s local 2025-03-14T05:53:58.1094545Z Compiling torch_xla/csrc/init_python_bindings.cpp; 71s local 2025-03-14T05:53:58.1095375Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T05:53:58.1096403Z Compiling torch_xla/csrc/tensor.cpp; 54s local 2025-03-14T05:53:58.1097118Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2025-03-14T05:53:58.1097851Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2025-03-14T05:53:58.1098662Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local ... 2025-03-14T05:53:58.4249941Z 2025-03-14T05:53:58.4250833Z  2025-03-14T05:53:58.4251284Z  2025-03-14T05:53:58.4251671Z  2025-03-14T05:53:58.4252057Z  2025-03-14T05:53:58.4252442Z  2025-03-14T05:53:58.4252830Z  2025-03-14T05:53:58.4253248Z  2025-03-14T05:53:58.4253622Z  2025-03-14T05:53:58.4254172Z [15,094 / 15,235] 47 actions running 2025-03-14T05:53:58.4254889Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T05:53:58.4255614Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T05:53:58.4256384Z Compiling torch_xla/csrc/init_python_bindings.cpp; 71s local 2025-03-14T05:53:58.4257226Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T05:53:58.4257982Z Compiling torch_xla/csrc/tensor.cpp; 54s local 2025-03-14T05:53:58.4259042Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2025-03-14T05:53:58.4259765Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2025-03-14T05:53:58.4260500Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local ... 2025-03-14T05:53:58.8254204Z 2025-03-14T05:53:58.8255057Z  2025-03-14T05:53:58.8255506Z  2025-03-14T05:53:58.8255847Z  2025-03-14T05:53:58.8256185Z  2025-03-14T05:53:58.8256565Z  2025-03-14T05:53:58.8256916Z  2025-03-14T05:53:58.8257261Z  2025-03-14T05:53:58.8257596Z  2025-03-14T05:53:58.8258084Z [15,095 / 15,235] 47 actions running 2025-03-14T05:53:58.8258731Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T05:53:58.8259375Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T05:53:58.8260087Z Compiling torch_xla/csrc/init_python_bindings.cpp; 71s local 2025-03-14T05:53:58.8260797Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T05:53:58.8261461Z Compiling torch_xla/csrc/tensor.cpp; 55s local 2025-03-14T05:53:58.8262100Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2025-03-14T05:53:58.8262765Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T05:53:58.8263471Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local ... 2025-03-14T05:53:59.0421344Z 2025-03-14T05:53:59.0422211Z  2025-03-14T05:53:59.0422655Z  2025-03-14T05:53:59.0423260Z  2025-03-14T05:53:59.0423614Z  2025-03-14T05:53:59.0423957Z  2025-03-14T05:53:59.0424299Z  2025-03-14T05:53:59.0424642Z  2025-03-14T05:53:59.0424986Z  2025-03-14T05:53:59.0425490Z [15,096 / 15,235] 48 actions, 47 running 2025-03-14T05:53:59.0426135Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T05:53:59.0426794Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T05:53:59.0427640Z Compiling torch_xla/csrc/init_python_bindings.cpp; 72s local 2025-03-14T05:53:59.0428381Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T05:53:59.0429004Z Compiling torch_xla/csrc/tensor.cpp; 55s local 2025-03-14T05:53:59.0429652Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2025-03-14T05:53:59.0430319Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T05:53:59.0431021Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local ... 2025-03-14T05:53:59.2578676Z 2025-03-14T05:53:59.2579545Z  2025-03-14T05:53:59.2580025Z  2025-03-14T05:53:59.2580426Z  2025-03-14T05:53:59.2580821Z  2025-03-14T05:53:59.2581227Z  2025-03-14T05:53:59.2581656Z  2025-03-14T05:53:59.2582063Z  2025-03-14T05:53:59.2582467Z  2025-03-14T05:53:59.2583060Z [15,097 / 15,235] 48 actions, 47 running 2025-03-14T05:53:59.2584152Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T05:53:59.2584965Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T05:53:59.2585821Z Compiling torch_xla/csrc/init_python_bindings.cpp; 72s local 2025-03-14T05:53:59.2586725Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T05:53:59.2587496Z Compiling torch_xla/csrc/tensor.cpp; 55s local 2025-03-14T05:53:59.2588302Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2025-03-14T05:53:59.2589063Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T05:53:59.2589948Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local ... 2025-03-14T05:53:59.6261055Z 2025-03-14T05:53:59.6261942Z  2025-03-14T05:53:59.6262472Z  2025-03-14T05:53:59.6262895Z  2025-03-14T05:53:59.6263312Z  2025-03-14T05:53:59.6263726Z  2025-03-14T05:53:59.6264141Z  2025-03-14T05:53:59.6264554Z  2025-03-14T05:53:59.6265015Z  2025-03-14T05:53:59.6265829Z [15,097 / 15,235] 48 actions running 2025-03-14T05:53:59.6266641Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T05:53:59.6267649Z @llvm-project//mlir:LinalgTransforms; 82s local 2025-03-14T05:53:59.6268529Z Compiling torch_xla/csrc/init_python_bindings.cpp; 72s local 2025-03-14T05:53:59.6269443Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T05:53:59.6270240Z Compiling torch_xla/csrc/tensor.cpp; 55s local 2025-03-14T05:53:59.6271072Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2025-03-14T05:53:59.6271926Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T05:53:59.6272840Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local ... 2025-03-14T05:53:59.8446103Z 2025-03-14T05:53:59.8446995Z  2025-03-14T05:53:59.8447469Z  2025-03-14T05:53:59.8447834Z  2025-03-14T05:53:59.8448208Z  2025-03-14T05:53:59.8448605Z  2025-03-14T05:53:59.8449009Z  2025-03-14T05:53:59.8449378Z  2025-03-14T05:53:59.8449739Z  2025-03-14T05:53:59.8450335Z [15,098 / 15,235] 48 actions, 47 running 2025-03-14T05:53:59.8451155Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T05:53:59.8451888Z @llvm-project//mlir:LinalgTransforms; 82s local 2025-03-14T05:53:59.8452662Z Compiling torch_xla/csrc/init_python_bindings.cpp; 72s local 2025-03-14T05:53:59.8453465Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T05:53:59.8454159Z Compiling torch_xla/csrc/tensor.cpp; 56s local 2025-03-14T05:53:59.8455183Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2025-03-14T05:53:59.8455956Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T05:53:59.8456758Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local ... 2025-03-14T05:54:00.0495259Z 2025-03-14T05:54:00.0496101Z  2025-03-14T05:54:00.0496611Z  2025-03-14T05:54:00.0497005Z  2025-03-14T05:54:00.0497364Z  2025-03-14T05:54:00.0497719Z  2025-03-14T05:54:00.0498080Z  2025-03-14T05:54:00.0498428Z  2025-03-14T05:54:00.0499134Z  2025-03-14T05:54:00.0499797Z [15,099 / 15,235] 48 actions, 47 running 2025-03-14T05:54:00.0500511Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T05:54:00.0501209Z @llvm-project//mlir:LinalgTransforms; 82s local 2025-03-14T05:54:00.0501969Z Compiling torch_xla/csrc/init_python_bindings.cpp; 73s local 2025-03-14T05:54:00.0502830Z Compiling torch_xla/csrc/aten_xla_type.cpp; 72s local 2025-03-14T05:54:00.0503593Z Compiling torch_xla/csrc/tensor.cpp; 56s local 2025-03-14T05:54:00.0504392Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2025-03-14T05:54:00.0505100Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T05:54:00.0505886Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local ... 2025-03-14T05:54:00.3850930Z 2025-03-14T05:54:00.3852035Z  2025-03-14T05:54:00.3852511Z  2025-03-14T05:54:00.3852908Z  2025-03-14T05:54:00.3853305Z  2025-03-14T05:54:00.3853699Z  2025-03-14T05:54:00.3854125Z  2025-03-14T05:54:00.3854494Z  2025-03-14T05:54:00.3854897Z  2025-03-14T05:54:00.3855458Z [15,101 / 15,235] 48 actions, 47 running 2025-03-14T05:54:00.3856208Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T05:54:00.3856946Z @llvm-project//mlir:LinalgTransforms; 83s local 2025-03-14T05:54:00.3857731Z Compiling torch_xla/csrc/init_python_bindings.cpp; 73s local 2025-03-14T05:54:00.3858551Z Compiling torch_xla/csrc/tensor.cpp; 56s local 2025-03-14T05:54:00.3859310Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T05:54:00.3860078Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T05:54:00.3860938Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2025-03-14T05:54:00.3861756Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local ... 2025-03-14T05:54:00.6268474Z 2025-03-14T05:54:00.6269334Z  2025-03-14T05:54:00.6269783Z  2025-03-14T05:54:00.6270214Z  2025-03-14T05:54:00.6270579Z  2025-03-14T05:54:00.6271148Z  2025-03-14T05:54:00.6271454Z  2025-03-14T05:54:00.6271763Z  2025-03-14T05:54:00.6272141Z  2025-03-14T05:54:00.6272672Z [15,101 / 15,235] 48 actions running 2025-03-14T05:54:00.6273393Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T05:54:00.6274125Z @llvm-project//mlir:LinalgTransforms; 83s local 2025-03-14T05:54:00.6275094Z Compiling torch_xla/csrc/init_python_bindings.cpp; 73s local 2025-03-14T05:54:00.6275835Z Compiling torch_xla/csrc/tensor.cpp; 56s local 2025-03-14T05:54:00.6276543Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T05:54:00.6277314Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2025-03-14T05:54:00.6278093Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2025-03-14T05:54:00.6279049Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local ... 2025-03-14T05:54:00.8276990Z 2025-03-14T05:54:00.8277846Z  2025-03-14T05:54:00.8278342Z  2025-03-14T05:54:00.8278691Z  2025-03-14T05:54:00.8279076Z  2025-03-14T05:54:00.8279446Z  2025-03-14T05:54:00.8279804Z  2025-03-14T05:54:00.8280171Z  2025-03-14T05:54:00.8280526Z  2025-03-14T05:54:00.8281079Z [15,102 / 15,235] 48 actions running 2025-03-14T05:54:00.8281795Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T05:54:00.8282812Z @llvm-project//mlir:LinalgTransforms; 83s local 2025-03-14T05:54:00.8283600Z Compiling torch_xla/csrc/init_python_bindings.cpp; 73s local 2025-03-14T05:54:00.8284381Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T05:54:00.8285272Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2025-03-14T05:54:00.8285935Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2025-03-14T05:54:00.8286749Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local 2025-03-14T05:54:00.8287646Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local ... 2025-03-14T05:54:01.5217756Z 2025-03-14T05:54:01.5218667Z  2025-03-14T05:54:01.5219244Z  2025-03-14T05:54:01.5219658Z  2025-03-14T05:54:01.5220204Z  2025-03-14T05:54:01.5220540Z  2025-03-14T05:54:01.5220893Z  2025-03-14T05:54:01.5221258Z  2025-03-14T05:54:01.5221638Z  2025-03-14T05:54:01.5222203Z [15,103 / 15,235] 48 actions, 47 running 2025-03-14T05:54:01.5223050Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T05:54:01.5223766Z @llvm-project//mlir:LinalgTransforms; 84s local 2025-03-14T05:54:01.5224607Z Compiling torch_xla/csrc/init_python_bindings.cpp; 74s local 2025-03-14T05:54:01.5225479Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2025-03-14T05:54:01.5226228Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T05:54:01.5227435Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2025-03-14T05:54:01.5228314Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2025-03-14T05:54:01.5229356Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local ... 2025-03-14T05:54:01.8386688Z 2025-03-14T05:54:01.8387537Z  2025-03-14T05:54:01.8388017Z  2025-03-14T05:54:01.8388439Z  2025-03-14T05:54:01.8388809Z  2025-03-14T05:54:01.8389207Z  2025-03-14T05:54:01.8389611Z  2025-03-14T05:54:01.8390025Z  2025-03-14T05:54:01.8390406Z  2025-03-14T05:54:01.8390998Z [15,103 / 15,235] 48 actions running 2025-03-14T05:54:01.8391760Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T05:54:01.8392664Z @llvm-project//mlir:LinalgTransforms; 84s local 2025-03-14T05:54:01.8393479Z Compiling torch_xla/csrc/init_python_bindings.cpp; 74s local 2025-03-14T05:54:01.8394307Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2025-03-14T05:54:01.8395065Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T05:54:01.8395855Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T05:54:01.8397046Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2025-03-14T05:54:01.8397866Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local ... 2025-03-14T05:54:02.0390367Z 2025-03-14T05:54:02.0391229Z  2025-03-14T05:54:02.0391709Z  2025-03-14T05:54:02.0392089Z  2025-03-14T05:54:02.0392458Z  2025-03-14T05:54:02.0392832Z  2025-03-14T05:54:02.0393230Z  2025-03-14T05:54:02.0393655Z  2025-03-14T05:54:02.0394015Z  2025-03-14T05:54:02.0394580Z [15,104 / 15,235] 47 actions running 2025-03-14T05:54:02.0395348Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T05:54:02.0396110Z @llvm-project//mlir:LinalgTransforms; 84s local 2025-03-14T05:54:02.0396911Z Compiling torch_xla/csrc/init_python_bindings.cpp; 75s local 2025-03-14T05:54:02.0397803Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2025-03-14T05:54:02.0398542Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T05:54:02.0399338Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T05:54:02.0400159Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2025-03-14T05:54:02.0401053Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local ... 2025-03-14T05:54:02.3589678Z 2025-03-14T05:54:02.3590490Z  2025-03-14T05:54:02.3590983Z  2025-03-14T05:54:02.3591378Z  2025-03-14T05:54:02.3591981Z  2025-03-14T05:54:02.3592368Z  2025-03-14T05:54:02.3592753Z  2025-03-14T05:54:02.3593139Z  2025-03-14T05:54:02.3593497Z  2025-03-14T05:54:02.3594051Z [15,104 / 15,235] 48 actions running 2025-03-14T05:54:02.3594781Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T05:54:02.3595547Z @llvm-project//mlir:LinalgTransforms; 85s local 2025-03-14T05:54:02.3596334Z Compiling torch_xla/csrc/init_python_bindings.cpp; 75s local 2025-03-14T05:54:02.3597383Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2025-03-14T05:54:02.3598162Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T05:54:02.3598936Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T05:54:02.3599756Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2025-03-14T05:54:02.3600549Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local ... 2025-03-14T05:54:03.4878341Z 2025-03-14T05:54:03.4879146Z  2025-03-14T05:54:03.4879625Z  2025-03-14T05:54:03.4879970Z  2025-03-14T05:54:03.4880329Z  2025-03-14T05:54:03.4880683Z  2025-03-14T05:54:03.4881050Z  2025-03-14T05:54:03.4881419Z  2025-03-14T05:54:03.4881793Z  2025-03-14T05:54:03.4882373Z [15,105 / 15,235] 48 actions, 47 running 2025-03-14T05:54:03.4883367Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T05:54:03.4884171Z Compiling torch_xla/csrc/init_python_bindings.cpp; 76s local 2025-03-14T05:54:03.4885211Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T05:54:03.4886017Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2025-03-14T05:54:03.4886843Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2025-03-14T05:54:03.4887759Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 54s local 2025-03-14T05:54:03.4888615Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2025-03-14T05:54:03.4889512Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 37s local ... 2025-03-14T05:54:03.7600391Z 2025-03-14T05:54:03.7601245Z  2025-03-14T05:54:03.7601645Z  2025-03-14T05:54:03.7601990Z  2025-03-14T05:54:03.7602374Z  2025-03-14T05:54:03.7602777Z  2025-03-14T05:54:03.7603144Z  2025-03-14T05:54:03.7603534Z  2025-03-14T05:54:03.7603848Z  2025-03-14T05:54:03.7604346Z [15,105 / 15,235] 48 actions running 2025-03-14T05:54:03.7605181Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T05:54:03.7605930Z Compiling torch_xla/csrc/init_python_bindings.cpp; 76s local 2025-03-14T05:54:03.7606910Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T05:54:03.7607681Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2025-03-14T05:54:03.7608434Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2025-03-14T05:54:03.7609152Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 54s local 2025-03-14T05:54:03.7609944Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2025-03-14T05:54:03.7610677Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 37s local ... 2025-03-14T05:54:04.0481671Z 2025-03-14T05:54:04.0482506Z  2025-03-14T05:54:04.0482951Z  2025-03-14T05:54:04.0483315Z  2025-03-14T05:54:04.0483698Z  2025-03-14T05:54:04.0484075Z  2025-03-14T05:54:04.0484488Z  2025-03-14T05:54:04.0485013Z  2025-03-14T05:54:04.0485405Z  2025-03-14T05:54:04.0485974Z [15,106 / 15,235] 48 actions, 47 running 2025-03-14T05:54:04.0486713Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T05:54:04.0487534Z Compiling torch_xla/csrc/init_python_bindings.cpp; 77s local 2025-03-14T05:54:04.0488354Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T05:54:04.0489136Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2025-03-14T05:54:04.0489924Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2025-03-14T05:54:04.0491042Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T05:54:04.0491884Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2025-03-14T05:54:04.0492622Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local ... 2025-03-14T05:54:04.3604360Z 2025-03-14T05:54:04.3605362Z  2025-03-14T05:54:04.3605877Z  2025-03-14T05:54:04.3606303Z  2025-03-14T05:54:04.3606690Z  2025-03-14T05:54:04.3607149Z  2025-03-14T05:54:04.3607508Z  2025-03-14T05:54:04.3607897Z  2025-03-14T05:54:04.3608561Z  2025-03-14T05:54:04.3609176Z [15,106 / 15,235] 48 actions running 2025-03-14T05:54:04.3609887Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T05:54:04.3610708Z Compiling torch_xla/csrc/init_python_bindings.cpp; 77s local 2025-03-14T05:54:04.3611496Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T05:54:04.3612399Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2025-03-14T05:54:04.3613264Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2025-03-14T05:54:04.3614152Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T05:54:04.3614912Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2025-03-14T05:54:04.3615724Z Compiling torch_xla/csrc/ops/cast.cpp; 37s local ... 2025-03-14T05:54:04.5995946Z 2025-03-14T05:54:04.5997095Z  2025-03-14T05:54:04.5997566Z  2025-03-14T05:54:04.5997904Z  2025-03-14T05:54:04.5998194Z  2025-03-14T05:54:04.5998553Z  2025-03-14T05:54:04.5998859Z  2025-03-14T05:54:04.5999178Z  2025-03-14T05:54:04.5999493Z  2025-03-14T05:54:04.5999976Z [15,107 / 15,235] 48 actions, 47 running 2025-03-14T05:54:04.6000565Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T05:54:04.6001206Z Compiling torch_xla/csrc/init_python_bindings.cpp; 77s local 2025-03-14T05:54:04.6001996Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2025-03-14T05:54:04.6002702Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2025-03-14T05:54:04.6003435Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2025-03-14T05:54:04.6004251Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T05:54:04.6005182Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2025-03-14T05:54:04.6005925Z Compiling torch_xla/csrc/ops/cast.cpp; 37s local ... 2025-03-14T05:54:04.9610805Z 2025-03-14T05:54:04.9611711Z  2025-03-14T05:54:04.9612132Z  2025-03-14T05:54:04.9612522Z  2025-03-14T05:54:04.9612916Z  2025-03-14T05:54:04.9613622Z  2025-03-14T05:54:04.9613961Z  2025-03-14T05:54:04.9614358Z  2025-03-14T05:54:04.9614746Z  2025-03-14T05:54:04.9615300Z [15,107 / 15,235] 48 actions running 2025-03-14T05:54:04.9616001Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T05:54:04.9616790Z Compiling torch_xla/csrc/init_python_bindings.cpp; 78s local 2025-03-14T05:54:04.9617664Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2025-03-14T05:54:04.9618391Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2025-03-14T05:54:04.9619190Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2025-03-14T05:54:04.9620015Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T05:54:04.9620790Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2025-03-14T05:54:04.9621506Z Compiling torch_xla/csrc/ops/cast.cpp; 37s local ... 2025-03-14T05:54:05.2076275Z 2025-03-14T05:54:05.2077133Z  2025-03-14T05:54:05.2077629Z  2025-03-14T05:54:05.2078024Z  2025-03-14T05:54:05.2078384Z  2025-03-14T05:54:05.2078746Z  2025-03-14T05:54:05.2079103Z  2025-03-14T05:54:05.2079495Z  2025-03-14T05:54:05.2079873Z  2025-03-14T05:54:05.2080459Z [15,108 / 15,235] 48 actions, 47 running 2025-03-14T05:54:05.2081207Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T05:54:05.2082313Z Compiling torch_xla/csrc/init_python_bindings.cpp; 78s local 2025-03-14T05:54:05.2083202Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2025-03-14T05:54:05.2083976Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2025-03-14T05:54:05.2084966Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2025-03-14T05:54:05.2085785Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2025-03-14T05:54:05.2086556Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2025-03-14T05:54:05.2087582Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local ... 2025-03-14T05:54:05.5319048Z 2025-03-14T05:54:05.5319831Z  2025-03-14T05:54:05.5320317Z  2025-03-14T05:54:05.5320724Z  2025-03-14T05:54:05.5321201Z  2025-03-14T05:54:05.5321733Z  2025-03-14T05:54:05.5322253Z  2025-03-14T05:54:05.5322661Z  2025-03-14T05:54:05.5323036Z  2025-03-14T05:54:05.5323620Z [15,109 / 15,235] 48 actions, 47 running 2025-03-14T05:54:05.5324393Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T05:54:05.5325287Z Compiling torch_xla/csrc/init_python_bindings.cpp; 78s local 2025-03-14T05:54:05.5326110Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2025-03-14T05:54:05.5326898Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2025-03-14T05:54:05.5327802Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2025-03-14T05:54:05.5328882Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2025-03-14T05:54:05.5329660Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2025-03-14T05:54:05.5330479Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local ... 2025-03-14T05:54:05.7616323Z 2025-03-14T05:54:05.7617161Z  2025-03-14T05:54:05.7617630Z  2025-03-14T05:54:05.7617990Z  2025-03-14T05:54:05.7618341Z  2025-03-14T05:54:05.7618750Z  2025-03-14T05:54:05.7619127Z  2025-03-14T05:54:05.7619497Z  2025-03-14T05:54:05.7619863Z  2025-03-14T05:54:05.7620428Z [15,109 / 15,235] 48 actions running 2025-03-14T05:54:05.7621107Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T05:54:05.7621909Z Compiling torch_xla/csrc/init_python_bindings.cpp; 78s local 2025-03-14T05:54:05.7622789Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2025-03-14T05:54:05.7623574Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2025-03-14T05:54:05.7624419Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T05:54:05.7625233Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2025-03-14T05:54:05.7626334Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T05:54:05.7627178Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local ... 2025-03-14T05:54:05.9620234Z 2025-03-14T05:54:05.9621109Z  2025-03-14T05:54:05.9621600Z  2025-03-14T05:54:05.9621993Z  2025-03-14T05:54:05.9622384Z  2025-03-14T05:54:05.9622765Z  2025-03-14T05:54:05.9623159Z  2025-03-14T05:54:05.9623629Z  2025-03-14T05:54:05.9624059Z  2025-03-14T05:54:05.9624652Z [15,110 / 15,235] 48 actions running 2025-03-14T05:54:05.9625444Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T05:54:05.9626229Z Compiling torch_xla/csrc/init_python_bindings.cpp; 79s local 2025-03-14T05:54:05.9627084Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2025-03-14T05:54:05.9627888Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2025-03-14T05:54:05.9628751Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T05:54:05.9629581Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2025-03-14T05:54:05.9630396Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T05:54:05.9631198Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local ... 2025-03-14T05:54:06.1823294Z 2025-03-14T05:54:06.1824097Z  2025-03-14T05:54:06.1824570Z  2025-03-14T05:54:06.1824982Z  2025-03-14T05:54:06.1825659Z  2025-03-14T05:54:06.1826050Z  2025-03-14T05:54:06.1826443Z  2025-03-14T05:54:06.1826831Z  2025-03-14T05:54:06.1827212Z  2025-03-14T05:54:06.1827765Z [15,111 / 15,235] 48 actions, 47 running 2025-03-14T05:54:06.1828448Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T05:54:06.1829208Z Compiling torch_xla/csrc/init_python_bindings.cpp; 79s local 2025-03-14T05:54:06.1829988Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2025-03-14T05:54:06.1830845Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2025-03-14T05:54:06.1831621Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T05:54:06.1832551Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2025-03-14T05:54:06.1833249Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T05:54:06.1833965Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local ... 2025-03-14T05:54:06.5356337Z 2025-03-14T05:54:06.5357198Z  2025-03-14T05:54:06.5357752Z  2025-03-14T05:54:06.5360004Z  2025-03-14T05:54:06.5363022Z  2025-03-14T05:54:06.5366542Z  2025-03-14T05:54:06.5369540Z  2025-03-14T05:54:06.5371712Z  2025-03-14T05:54:06.5372354Z  2025-03-14T05:54:06.5373070Z [15,112 / 15,235] 48 actions, 47 running 2025-03-14T05:54:06.5374323Z @llvm-project//mlir:LinalgTransforms; 89s local 2025-03-14T05:54:06.5375354Z Compiling torch_xla/csrc/init_python_bindings.cpp; 79s local 2025-03-14T05:54:06.5376388Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2025-03-14T05:54:06.5377374Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T05:54:06.5378613Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2025-03-14T05:54:06.5379827Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T05:54:06.5381160Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2025-03-14T05:54:06.5382250Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 33s local ... 2025-03-14T05:54:06.7627724Z 2025-03-14T05:54:06.7628573Z  2025-03-14T05:54:06.7629102Z  2025-03-14T05:54:06.7629644Z  2025-03-14T05:54:06.7630041Z  2025-03-14T05:54:06.7630468Z  2025-03-14T05:54:06.7630881Z  2025-03-14T05:54:06.7631280Z  2025-03-14T05:54:06.7631688Z  2025-03-14T05:54:06.7632306Z [15,112 / 15,235] 48 actions running 2025-03-14T05:54:06.7633043Z @llvm-project//mlir:LinalgTransforms; 89s local 2025-03-14T05:54:06.7633840Z Compiling torch_xla/csrc/init_python_bindings.cpp; 79s local 2025-03-14T05:54:06.7635057Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2025-03-14T05:54:06.7635927Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 59s local 2025-03-14T05:54:06.7636822Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2025-03-14T05:54:06.7637608Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2025-03-14T05:54:06.7638410Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2025-03-14T05:54:06.7639403Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 33s local ... 2025-03-14T05:54:07.4864894Z 2025-03-14T05:54:07.4865889Z  2025-03-14T05:54:07.4866304Z  2025-03-14T05:54:07.4866620Z  2025-03-14T05:54:07.4866943Z  2025-03-14T05:54:07.4867258Z  2025-03-14T05:54:07.4867603Z  2025-03-14T05:54:07.4867923Z  2025-03-14T05:54:07.4868239Z  2025-03-14T05:54:07.4868740Z [15,113 / 15,235] 48 actions, 47 running 2025-03-14T05:54:07.4869343Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T05:54:07.4869992Z Compiling torch_xla/csrc/init_python_bindings.cpp; 80s local 2025-03-14T05:54:07.4870654Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T05:54:07.4871301Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 59s local 2025-03-14T05:54:07.4871972Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2025-03-14T05:54:07.4872940Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2025-03-14T05:54:07.4873569Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2025-03-14T05:54:07.4874212Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local ... 2025-03-14T05:54:07.7634835Z 2025-03-14T05:54:07.7635640Z  2025-03-14T05:54:07.7636135Z  2025-03-14T05:54:07.7636557Z  2025-03-14T05:54:07.7636947Z  2025-03-14T05:54:07.7637323Z  2025-03-14T05:54:07.7637710Z  2025-03-14T05:54:07.7638392Z  2025-03-14T05:54:07.7638825Z  2025-03-14T05:54:07.7640131Z [15,113 / 15,235] 48 actions running 2025-03-14T05:54:07.7640897Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T05:54:07.7641721Z Compiling torch_xla/csrc/init_python_bindings.cpp; 80s local 2025-03-14T05:54:07.7642575Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T05:54:07.7643383Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 60s local 2025-03-14T05:54:07.7644286Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2025-03-14T05:54:07.7645208Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2025-03-14T05:54:07.7645944Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2025-03-14T05:54:07.7646789Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local ... 2025-03-14T05:54:08.3430754Z 2025-03-14T05:54:08.3431871Z  2025-03-14T05:54:08.3432342Z  2025-03-14T05:54:08.3432734Z  2025-03-14T05:54:08.3433106Z  2025-03-14T05:54:08.3433504Z  2025-03-14T05:54:08.3433904Z  2025-03-14T05:54:08.3434287Z  2025-03-14T05:54:08.3434674Z  2025-03-14T05:54:08.3435252Z [15,114 / 15,235] 48 actions, 47 running 2025-03-14T05:54:08.3435966Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T05:54:08.3436758Z Compiling torch_xla/csrc/init_python_bindings.cpp; 81s local 2025-03-14T05:54:08.3437565Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T05:54:08.3438415Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 60s local 2025-03-14T05:54:08.3439186Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2025-03-14T05:54:08.3440859Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2025-03-14T05:54:08.3441599Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2025-03-14T05:54:08.3442576Z Compiling torch_xla/csrc/ops/var_mean.cpp; 31s local ... 2025-03-14T05:54:08.5779657Z 2025-03-14T05:54:08.5780464Z  2025-03-14T05:54:08.5780940Z  2025-03-14T05:54:08.5781345Z  2025-03-14T05:54:08.5781743Z  2025-03-14T05:54:08.5782374Z  2025-03-14T05:54:08.5782767Z  2025-03-14T05:54:08.5783159Z  2025-03-14T05:54:08.5783526Z  2025-03-14T05:54:08.5784053Z [15,114 / 15,235] 48 actions running 2025-03-14T05:54:08.5784776Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T05:54:08.5785577Z Compiling torch_xla/csrc/init_python_bindings.cpp; 81s local 2025-03-14T05:54:08.5786413Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2025-03-14T05:54:08.5787832Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 60s local 2025-03-14T05:54:08.5788656Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2025-03-14T05:54:08.5801300Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2025-03-14T05:54:08.5802371Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2025-03-14T05:54:08.5803297Z Compiling torch_xla/csrc/ops/var_mean.cpp; 32s local ... 2025-03-14T05:54:09.2778836Z 2025-03-14T05:54:09.2779816Z  2025-03-14T05:54:09.2780385Z  2025-03-14T05:54:09.2780849Z  2025-03-14T05:54:09.2781285Z  2025-03-14T05:54:09.2781736Z  2025-03-14T05:54:09.2782131Z  2025-03-14T05:54:09.2782586Z  2025-03-14T05:54:09.2783022Z  2025-03-14T05:54:09.2783673Z [15,115 / 15,235] 48 actions, 47 running 2025-03-14T05:54:09.2784428Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T05:54:09.2785656Z Compiling torch_xla/csrc/init_python_bindings.cpp; 82s local 2025-03-14T05:54:09.2786516Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2025-03-14T05:54:09.2787313Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2025-03-14T05:54:09.2788120Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2025-03-14T05:54:09.2788924Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local 2025-03-14T05:54:09.2789733Z Compiling torch_xla/csrc/ops/var_mean.cpp; 32s local 2025-03-14T05:54:09.2790727Z Compiling torch_xla/csrc/ops/cumsum.cpp; 31s local ... 2025-03-14T05:54:09.5786787Z 2025-03-14T05:54:09.5787564Z  2025-03-14T05:54:09.5788059Z  2025-03-14T05:54:09.5788452Z  2025-03-14T05:54:09.5789369Z  2025-03-14T05:54:09.5789777Z  2025-03-14T05:54:09.5790158Z  2025-03-14T05:54:09.5790541Z  2025-03-14T05:54:09.5790919Z  2025-03-14T05:54:09.5791502Z [15,115 / 15,235] 48 actions running 2025-03-14T05:54:09.5792256Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T05:54:09.5793146Z Compiling torch_xla/csrc/init_python_bindings.cpp; 82s local 2025-03-14T05:54:09.5794030Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2025-03-14T05:54:09.5794703Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2025-03-14T05:54:09.5795366Z Compiling torch_xla/csrc/ops/constant.cpp; 37s local 2025-03-14T05:54:09.5796326Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local 2025-03-14T05:54:09.5797105Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2025-03-14T05:54:09.5797946Z Compiling torch_xla/csrc/ops/cumsum.cpp; 31s local ... 2025-03-14T05:54:09.8946899Z 2025-03-14T05:54:09.8947721Z  2025-03-14T05:54:09.8948208Z  2025-03-14T05:54:09.8948620Z  2025-03-14T05:54:09.8949007Z  2025-03-14T05:54:09.8949390Z  2025-03-14T05:54:09.8949904Z  2025-03-14T05:54:09.8950312Z  2025-03-14T05:54:09.8950717Z  2025-03-14T05:54:09.8951361Z [15,116 / 15,235] 48 actions, 47 running 2025-03-14T05:54:09.8952112Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T05:54:09.8952927Z Compiling torch_xla/csrc/init_python_bindings.cpp; 82s local 2025-03-14T05:54:09.8953883Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2025-03-14T05:54:09.8954628Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2025-03-14T05:54:09.8955423Z Compiling torch_xla/csrc/ops/constant.cpp; 37s local 2025-03-14T05:54:09.8956213Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local 2025-03-14T05:54:09.8956981Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2025-03-14T05:54:09.8958200Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local ... 2025-03-14T05:54:10.1791249Z 2025-03-14T05:54:10.1792153Z  2025-03-14T05:54:10.1792608Z  2025-03-14T05:54:10.1792987Z  2025-03-14T05:54:10.1793369Z  2025-03-14T05:54:10.1793733Z  2025-03-14T05:54:10.1794103Z  2025-03-14T05:54:10.1794477Z  2025-03-14T05:54:10.1794901Z  2025-03-14T05:54:10.1795428Z [15,116 / 15,235] 48 actions running 2025-03-14T05:54:10.1796124Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T05:54:10.1796872Z Compiling torch_xla/csrc/init_python_bindings.cpp; 83s local 2025-03-14T05:54:10.1797731Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2025-03-14T05:54:10.1798452Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2025-03-14T05:54:10.1799172Z Compiling torch_xla/csrc/ops/constant.cpp; 37s local 2025-03-14T05:54:10.1799876Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2025-03-14T05:54:10.1800599Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2025-03-14T05:54:10.1801326Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local ... 2025-03-14T05:54:10.4161324Z 2025-03-14T05:54:10.4162207Z  2025-03-14T05:54:10.4162635Z  2025-03-14T05:54:10.4163042Z  2025-03-14T05:54:10.4163432Z  2025-03-14T05:54:10.4163829Z  2025-03-14T05:54:10.4164537Z  2025-03-14T05:54:10.4165091Z  2025-03-14T05:54:10.4165708Z  2025-03-14T05:54:10.4166282Z [15,117 / 15,235] 48 actions, 47 running 2025-03-14T05:54:10.4166990Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T05:54:10.4167755Z Compiling torch_xla/csrc/init_python_bindings.cpp; 83s local 2025-03-14T05:54:10.4168559Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2025-03-14T05:54:10.4169415Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2025-03-14T05:54:10.4170258Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2025-03-14T05:54:10.4171199Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2025-03-14T05:54:10.4171952Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2025-03-14T05:54:10.4172816Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 31s local ... 2025-03-14T05:54:10.7797350Z 2025-03-14T05:54:10.7798271Z  2025-03-14T05:54:10.7798723Z  2025-03-14T05:54:10.7799103Z  2025-03-14T05:54:10.7799517Z  2025-03-14T05:54:10.7799881Z  2025-03-14T05:54:10.7800249Z  2025-03-14T05:54:10.7800613Z  2025-03-14T05:54:10.7801020Z  2025-03-14T05:54:10.7801529Z [15,118 / 15,235] 47 actions running 2025-03-14T05:54:10.7802199Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T05:54:10.7803674Z Compiling torch_xla/csrc/init_python_bindings.cpp; 83s local 2025-03-14T05:54:10.7804438Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2025-03-14T05:54:10.7805388Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2025-03-14T05:54:10.7806191Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2025-03-14T05:54:10.7806964Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2025-03-14T05:54:10.7807917Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 32s local 2025-03-14T05:54:10.7809017Z Compiling torch_xla/csrc/ops/device_data.cpp; 28s local ... 2025-03-14T05:54:10.9801789Z 2025-03-14T05:54:10.9802752Z  2025-03-14T05:54:10.9803215Z  2025-03-14T05:54:10.9803608Z  2025-03-14T05:54:10.9805822Z  2025-03-14T05:54:10.9808985Z  2025-03-14T05:54:10.9812185Z  2025-03-14T05:54:10.9814917Z  2025-03-14T05:54:10.9815578Z  2025-03-14T05:54:10.9816393Z [15,118 / 15,235] 48 actions running 2025-03-14T05:54:10.9817402Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T05:54:10.9818492Z Compiling torch_xla/csrc/init_python_bindings.cpp; 84s local 2025-03-14T05:54:10.9819615Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2025-03-14T05:54:10.9820936Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2025-03-14T05:54:10.9821988Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2025-03-14T05:54:10.9823014Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2025-03-14T05:54:10.9824024Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 32s local 2025-03-14T05:54:10.9825190Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local ... 2025-03-14T05:54:11.5510378Z 2025-03-14T05:54:11.5511319Z  2025-03-14T05:54:11.5511761Z  2025-03-14T05:54:11.5512113Z  2025-03-14T05:54:11.5512462Z  2025-03-14T05:54:11.5512843Z  2025-03-14T05:54:11.5513211Z  2025-03-14T05:54:11.5513549Z  2025-03-14T05:54:11.5513888Z  2025-03-14T05:54:11.5514441Z [15,119 / 15,235] 48 actions, 47 running 2025-03-14T05:54:11.5515091Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T05:54:11.5515827Z Compiling torch_xla/csrc/init_python_bindings.cpp; 84s local 2025-03-14T05:54:11.5516592Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2025-03-14T05:54:11.5517251Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2025-03-14T05:54:11.5517922Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T05:54:11.5518590Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2025-03-14T05:54:11.5519537Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local 2025-03-14T05:54:11.5520293Z Compiling torch_xla/csrc/ops/diagonal.cpp; 26s local ... 2025-03-14T05:54:11.7810513Z 2025-03-14T05:54:11.7811289Z  2025-03-14T05:54:11.7811707Z  2025-03-14T05:54:11.7812059Z  2025-03-14T05:54:11.7812403Z  2025-03-14T05:54:11.7812766Z  2025-03-14T05:54:11.7813112Z  2025-03-14T05:54:11.7813489Z  2025-03-14T05:54:11.7813840Z  2025-03-14T05:54:11.7814339Z [15,119 / 15,235] 48 actions running 2025-03-14T05:54:11.7815294Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T05:54:11.7816038Z Compiling torch_xla/csrc/init_python_bindings.cpp; 84s local 2025-03-14T05:54:11.7816799Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2025-03-14T05:54:11.7817503Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2025-03-14T05:54:11.7818229Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T05:54:11.7818996Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2025-03-14T05:54:11.7819774Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local 2025-03-14T05:54:11.7820534Z Compiling torch_xla/csrc/ops/diagonal.cpp; 27s local ... 2025-03-14T05:54:12.6293053Z 2025-03-14T05:54:12.6293867Z  2025-03-14T05:54:12.6294340Z  2025-03-14T05:54:12.6294731Z  2025-03-14T05:54:12.6295123Z  2025-03-14T05:54:12.6295858Z  2025-03-14T05:54:12.6296255Z  2025-03-14T05:54:12.6296622Z  2025-03-14T05:54:12.6297055Z  2025-03-14T05:54:12.6297648Z [15,120 / 15,235] 48 actions, 47 running 2025-03-14T05:54:12.6298361Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T05:54:12.6299176Z Compiling torch_xla/csrc/init_python_bindings.cpp; 85s local 2025-03-14T05:54:12.6300014Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T05:54:12.6300772Z Compiling torch_xla/csrc/ops/cumprod.cpp; 37s local 2025-03-14T05:54:12.6301538Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2025-03-14T05:54:12.6302235Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2025-03-14T05:54:12.6302964Z Compiling torch_xla/csrc/ops/device_data.cpp; 30s local 2025-03-14T05:54:12.6303826Z Compiling torch_xla/csrc/ops/diagonal.cpp; 28s local ... 2025-03-14T05:54:12.8739139Z 2025-03-14T05:54:12.8739976Z  2025-03-14T05:54:12.8741440Z  2025-03-14T05:54:12.8741869Z  2025-03-14T05:54:12.8742247Z  2025-03-14T05:54:12.8742617Z  2025-03-14T05:54:12.8743170Z  2025-03-14T05:54:12.8743572Z  2025-03-14T05:54:12.8743964Z  2025-03-14T05:54:12.8744852Z [15,121 / 15,235] 48 actions, 47 running 2025-03-14T05:54:12.8745563Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T05:54:12.8746332Z Compiling torch_xla/csrc/init_python_bindings.cpp; 85s local 2025-03-14T05:54:12.8747124Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T05:54:12.8747878Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2025-03-14T05:54:12.8748631Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2025-03-14T05:54:12.8749382Z Compiling torch_xla/csrc/ops/device_data.cpp; 30s local 2025-03-14T05:54:12.8750154Z Compiling torch_xla/csrc/ops/diagonal.cpp; 28s local 2025-03-14T05:54:12.8751015Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 27s local ... 2025-03-14T05:54:13.1820448Z 2025-03-14T05:54:13.1821351Z  2025-03-14T05:54:13.1821810Z  2025-03-14T05:54:13.1822196Z  2025-03-14T05:54:13.1822643Z  2025-03-14T05:54:13.1822980Z  2025-03-14T05:54:13.1823393Z  2025-03-14T05:54:13.1823793Z  2025-03-14T05:54:13.1824165Z  2025-03-14T05:54:13.1824717Z [15,121 / 15,235] 48 actions running 2025-03-14T05:54:13.1825400Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T05:54:13.1826057Z Compiling torch_xla/csrc/init_python_bindings.cpp; 86s local 2025-03-14T05:54:13.1827067Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T05:54:13.1827831Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2025-03-14T05:54:13.1828645Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2025-03-14T05:54:13.1829420Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2025-03-14T05:54:13.1830187Z Compiling torch_xla/csrc/ops/diagonal.cpp; 28s local 2025-03-14T05:54:13.1831096Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 27s local ... 2025-03-14T05:54:14.1831789Z 2025-03-14T05:54:14.1832791Z  2025-03-14T05:54:14.1833652Z  2025-03-14T05:54:14.1834106Z  2025-03-14T05:54:14.1834550Z  2025-03-14T05:54:14.1834958Z  2025-03-14T05:54:14.1835389Z  2025-03-14T05:54:14.1835798Z  2025-03-14T05:54:14.1836213Z  2025-03-14T05:54:14.1836796Z [15,121 / 15,235] 48 actions running 2025-03-14T05:54:14.1837574Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T05:54:14.1838430Z Compiling torch_xla/csrc/init_python_bindings.cpp; 87s local 2025-03-14T05:54:14.1839291Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2025-03-14T05:54:14.1840066Z Compiling torch_xla/csrc/ops/var_mean.cpp; 37s local 2025-03-14T05:54:14.1841680Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2025-03-14T05:54:14.1842518Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2025-03-14T05:54:14.1843638Z Compiling torch_xla/csrc/ops/diagonal.cpp; 29s local 2025-03-14T05:54:14.1844706Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 28s local ... 2025-03-14T05:54:14.5148531Z 2025-03-14T05:54:14.5149381Z  2025-03-14T05:54:14.5149863Z  2025-03-14T05:54:14.5150238Z  2025-03-14T05:54:14.5150637Z  2025-03-14T05:54:14.5151025Z  2025-03-14T05:54:14.5151382Z  2025-03-14T05:54:14.5151751Z  2025-03-14T05:54:14.5152106Z  2025-03-14T05:54:14.5152663Z [15,122 / 15,235] 48 actions, 47 running 2025-03-14T05:54:14.5153408Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T05:54:14.5154186Z Compiling torch_xla/csrc/init_python_bindings.cpp; 87s local 2025-03-14T05:54:14.5155005Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2025-03-14T05:54:14.5155783Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2025-03-14T05:54:14.5156634Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2025-03-14T05:54:14.5157407Z Compiling torch_xla/csrc/ops/diagonal.cpp; 29s local 2025-03-14T05:54:14.5158215Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local 2025-03-14T05:54:14.5159180Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local ... 2025-03-14T05:54:14.7444269Z 2025-03-14T05:54:14.7445267Z  2025-03-14T05:54:14.7445750Z  2025-03-14T05:54:14.7446154Z  2025-03-14T05:54:14.7446567Z  2025-03-14T05:54:14.7446968Z  2025-03-14T05:54:14.7447341Z  2025-03-14T05:54:14.7447711Z  2025-03-14T05:54:14.7448119Z  2025-03-14T05:54:14.7448717Z [15,123 / 15,235] 48 actions, 47 running 2025-03-14T05:54:14.7449462Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T05:54:14.7450229Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2025-03-14T05:54:14.7451051Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2025-03-14T05:54:14.7451802Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2025-03-14T05:54:14.7452652Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local 2025-03-14T05:54:14.7453502Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local 2025-03-14T05:54:14.7454459Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local 2025-03-14T05:54:14.7455352Z Compiling torch_xla/csrc/ops/dot_general.cpp; 27s local ... 2025-03-14T05:54:14.9840022Z 2025-03-14T05:54:14.9841569Z  2025-03-14T05:54:14.9841979Z  2025-03-14T05:54:14.9842342Z  2025-03-14T05:54:14.9842680Z  2025-03-14T05:54:14.9842983Z  2025-03-14T05:54:14.9843280Z  2025-03-14T05:54:14.9843896Z  2025-03-14T05:54:14.9844205Z  2025-03-14T05:54:14.9844786Z [15,123 / 15,235] 48 actions running 2025-03-14T05:54:14.9845494Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T05:54:14.9846219Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2025-03-14T05:54:14.9846890Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2025-03-14T05:54:14.9847494Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2025-03-14T05:54:14.9848265Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local 2025-03-14T05:54:14.9848916Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local 2025-03-14T05:54:14.9849685Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local 2025-03-14T05:54:14.9850365Z Compiling torch_xla/csrc/ops/dot_general.cpp; 28s local ... 2025-03-14T05:54:15.9374628Z 2025-03-14T05:54:15.9375462Z  2025-03-14T05:54:15.9375947Z  2025-03-14T05:54:15.9376349Z  2025-03-14T05:54:15.9376767Z  2025-03-14T05:54:15.9377235Z  2025-03-14T05:54:15.9377636Z  2025-03-14T05:54:15.9378023Z  2025-03-14T05:54:15.9378381Z  2025-03-14T05:54:15.9378961Z [15,124 / 15,235] 48 actions, 47 running 2025-03-14T05:54:15.9380729Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T05:54:15.9381481Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2025-03-14T05:54:15.9382603Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2025-03-14T05:54:15.9383454Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2025-03-14T05:54:15.9384373Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T05:54:15.9385342Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2025-03-14T05:54:15.9386181Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2025-03-14T05:54:15.9387048Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local ... 2025-03-14T05:54:16.1848106Z 2025-03-14T05:54:16.1848964Z  2025-03-14T05:54:16.1849390Z  2025-03-14T05:54:16.1849719Z  2025-03-14T05:54:16.1850023Z  2025-03-14T05:54:16.1850343Z  2025-03-14T05:54:16.1850660Z  2025-03-14T05:54:16.1850974Z  2025-03-14T05:54:16.1851293Z  2025-03-14T05:54:16.1851746Z [15,124 / 15,235] 48 actions running 2025-03-14T05:54:16.1852307Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T05:54:16.1852906Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2025-03-14T05:54:16.1853540Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2025-03-14T05:54:16.1854450Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2025-03-14T05:54:16.1855197Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T05:54:16.1856022Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T05:54:16.1856854Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2025-03-14T05:54:16.1857572Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local ... 2025-03-14T05:54:16.7565758Z 2025-03-14T05:54:16.7571627Z  2025-03-14T05:54:16.7572098Z  2025-03-14T05:54:16.7572490Z  2025-03-14T05:54:16.7572870Z  2025-03-14T05:54:16.7573256Z  2025-03-14T05:54:16.7573645Z  2025-03-14T05:54:16.7574002Z  2025-03-14T05:54:16.7574362Z  2025-03-14T05:54:16.7574918Z [15,125 / 15,235] 48 actions, 47 running 2025-03-14T05:54:16.7575589Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T05:54:16.7576301Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2025-03-14T05:54:16.7577027Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2025-03-14T05:54:16.7577849Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 31s local 2025-03-14T05:54:16.7578684Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T05:54:16.7579495Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2025-03-14T05:54:16.7580654Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local 2025-03-14T05:54:16.7581506Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 28s local ... 2025-03-14T05:54:16.9856841Z 2025-03-14T05:54:16.9857791Z  2025-03-14T05:54:16.9858253Z  2025-03-14T05:54:16.9858650Z  2025-03-14T05:54:16.9859058Z  2025-03-14T05:54:16.9859447Z  2025-03-14T05:54:16.9859859Z  2025-03-14T05:54:16.9860260Z  2025-03-14T05:54:16.9860641Z  2025-03-14T05:54:16.9861490Z [15,125 / 15,235] 48 actions running 2025-03-14T05:54:16.9862225Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T05:54:16.9862970Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2025-03-14T05:54:16.9863719Z Compiling torch_xla/csrc/ops/device_data.cpp; 35s local 2025-03-14T05:54:16.9864588Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 31s local 2025-03-14T05:54:16.9865806Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T05:54:16.9866625Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2025-03-14T05:54:16.9867398Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local 2025-03-14T05:54:16.9868213Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local ... 2025-03-14T05:54:17.1860365Z 2025-03-14T05:54:17.1861319Z  2025-03-14T05:54:17.1861760Z  2025-03-14T05:54:17.1862430Z  2025-03-14T05:54:17.1863123Z  2025-03-14T05:54:17.1863654Z  2025-03-14T05:54:17.1864161Z  2025-03-14T05:54:17.1864660Z  2025-03-14T05:54:17.1865158Z  2025-03-14T05:54:17.1866078Z [15,126 / 15,235] 48 actions, 47 running 2025-03-14T05:54:17.1866916Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T05:54:17.1867741Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2025-03-14T05:54:17.1868552Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 31s local 2025-03-14T05:54:17.1869373Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2025-03-14T05:54:17.1870199Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2025-03-14T05:54:17.1871168Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2025-03-14T05:54:17.1872082Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local 2025-03-14T05:54:17.1872997Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 26s local ... 2025-03-14T05:54:17.5866145Z 2025-03-14T05:54:17.5868221Z  2025-03-14T05:54:17.5868645Z  2025-03-14T05:54:17.5868969Z  2025-03-14T05:54:17.5869285Z  2025-03-14T05:54:17.5869704Z  2025-03-14T05:54:17.5870326Z  2025-03-14T05:54:17.5870659Z  2025-03-14T05:54:17.5871036Z  2025-03-14T05:54:17.5871582Z [15,127 / 15,235] 48 actions running 2025-03-14T05:54:17.5872286Z @llvm-project//mlir:LinalgTransforms; 100s local 2025-03-14T05:54:17.5872911Z Compiling torch_xla/csrc/tensor_util.cpp; 72s local 2025-03-14T05:54:17.5873537Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2025-03-14T05:54:17.5874269Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2025-03-14T05:54:17.5875024Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2025-03-14T05:54:17.5875856Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local 2025-03-14T05:54:17.5876670Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 27s local 2025-03-14T05:54:17.5877529Z Compiling torch_xla/csrc/ops/custom_call.cpp; 26s local ... 2025-03-14T05:54:18.5875114Z 2025-03-14T05:54:18.5875967Z  2025-03-14T05:54:18.5876457Z  2025-03-14T05:54:18.5876810Z  2025-03-14T05:54:18.5877170Z  2025-03-14T05:54:18.5877573Z  2025-03-14T05:54:18.5877948Z  2025-03-14T05:54:18.5878279Z  2025-03-14T05:54:18.5878612Z  2025-03-14T05:54:18.5879102Z [15,127 / 15,235] 48 actions running 2025-03-14T05:54:18.5879714Z @llvm-project//mlir:LinalgTransforms; 101s local 2025-03-14T05:54:18.5880355Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2025-03-14T05:54:18.5881341Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2025-03-14T05:54:18.5882247Z Compiling torch_xla/csrc/ops/dot_general.cpp; 31s local 2025-03-14T05:54:18.5883205Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2025-03-14T05:54:18.5883970Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2025-03-14T05:54:18.5885079Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 28s local 2025-03-14T05:54:18.5886087Z Compiling torch_xla/csrc/ops/custom_call.cpp; 27s local ... 2025-03-14T05:54:19.1881329Z 2025-03-14T05:54:19.1882160Z  2025-03-14T05:54:19.1882561Z  2025-03-14T05:54:19.1882909Z  2025-03-14T05:54:19.1883222Z  2025-03-14T05:54:19.1883535Z  2025-03-14T05:54:19.1883832Z  2025-03-14T05:54:19.1884163Z  2025-03-14T05:54:19.1884545Z  2025-03-14T05:54:19.1885156Z [15,128 / 15,235] 47 actions running 2025-03-14T05:54:19.1885825Z @llvm-project//mlir:LinalgTransforms; 101s local 2025-03-14T05:54:19.1886707Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2025-03-14T05:54:19.1887354Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2025-03-14T05:54:19.1888109Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 32s local 2025-03-14T05:54:19.1888830Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2025-03-14T05:54:19.1889774Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 28s local 2025-03-14T05:54:19.1890417Z Compiling torch_xla/csrc/ops/custom_call.cpp; 28s local 2025-03-14T05:54:19.1891024Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local ... 2025-03-14T05:54:19.6542863Z 2025-03-14T05:54:19.6543888Z  2025-03-14T05:54:19.6544387Z  2025-03-14T05:54:19.6544740Z  2025-03-14T05:54:19.6545106Z  2025-03-14T05:54:19.6545476Z  2025-03-14T05:54:19.6545831Z  2025-03-14T05:54:19.6546226Z  2025-03-14T05:54:19.6546640Z  2025-03-14T05:54:19.6547254Z [15,129 / 15,235] 48 actions, 47 running 2025-03-14T05:54:19.6547980Z @llvm-project//mlir:LinalgTransforms; 102s local 2025-03-14T05:54:19.6548695Z Compiling torch_xla/csrc/tensor_util.cpp; 74s local 2025-03-14T05:54:19.6549471Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2025-03-14T05:54:19.6550772Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2025-03-14T05:54:19.6551738Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 29s local 2025-03-14T05:54:19.6552672Z Compiling torch_xla/csrc/ops/custom_call.cpp; 28s local 2025-03-14T05:54:19.6553556Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local 2025-03-14T05:54:19.6554812Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 27s local ... 2025-03-14T05:54:20.0546804Z 2025-03-14T05:54:20.0547630Z  2025-03-14T05:54:20.0548206Z  2025-03-14T05:54:20.0548609Z  2025-03-14T05:54:20.0549011Z  2025-03-14T05:54:20.0549424Z  2025-03-14T05:54:20.0549805Z  2025-03-14T05:54:20.0550216Z  2025-03-14T05:54:20.0550577Z  2025-03-14T05:54:20.0551143Z [15,129 / 15,235] 48 actions running 2025-03-14T05:54:20.0551843Z @llvm-project//mlir:LinalgTransforms; 102s local 2025-03-14T05:54:20.0552571Z Compiling torch_xla/csrc/tensor_util.cpp; 74s local 2025-03-14T05:54:20.0553513Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2025-03-14T05:54:20.0554294Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2025-03-14T05:54:20.0555098Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 29s local 2025-03-14T05:54:20.0555901Z Compiling torch_xla/csrc/ops/custom_call.cpp; 29s local 2025-03-14T05:54:20.0556635Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local 2025-03-14T05:54:20.0557369Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 27s local ... 2025-03-14T05:54:21.0554731Z 2025-03-14T05:54:21.0555686Z  2025-03-14T05:54:21.0556148Z  2025-03-14T05:54:21.0556850Z  2025-03-14T05:54:21.0557241Z  2025-03-14T05:54:21.0558013Z  2025-03-14T05:54:21.0558558Z  2025-03-14T05:54:21.0559084Z  2025-03-14T05:54:21.0559590Z  2025-03-14T05:54:21.0560337Z [15,129 / 15,235] 48 actions running 2025-03-14T05:54:21.0561180Z @llvm-project//mlir:LinalgTransforms; 103s local 2025-03-14T05:54:21.0561998Z Compiling torch_xla/csrc/tensor_util.cpp; 75s local 2025-03-14T05:54:21.0562944Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2025-03-14T05:54:21.0564165Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2025-03-14T05:54:21.0565204Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2025-03-14T05:54:21.0566233Z Compiling torch_xla/csrc/ops/custom_call.cpp; 30s local 2025-03-14T05:54:21.0566988Z Compiling torch_xla/csrc/ops/eigh.cpp; 29s local 2025-03-14T05:54:21.0567848Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 28s local ... 2025-03-14T05:54:22.0563092Z 2025-03-14T05:54:22.0563991Z  2025-03-14T05:54:22.0565701Z  2025-03-14T05:54:22.0567646Z  2025-03-14T05:54:22.0568149Z  2025-03-14T05:54:22.0568549Z  2025-03-14T05:54:22.0568917Z  2025-03-14T05:54:22.0569323Z  2025-03-14T05:54:22.0569705Z  2025-03-14T05:54:22.0570302Z [15,129 / 15,235] 48 actions running 2025-03-14T05:54:22.0571050Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T05:54:22.0572109Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2025-03-14T05:54:22.0572995Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T05:54:22.0573896Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2025-03-14T05:54:22.0574718Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 31s local 2025-03-14T05:54:22.0575551Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local 2025-03-14T05:54:22.0576353Z Compiling torch_xla/csrc/ops/eigh.cpp; 30s local 2025-03-14T05:54:22.0577258Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local ... 2025-03-14T05:54:22.2995198Z 2025-03-14T05:54:22.2996072Z  2025-03-14T05:54:22.2996565Z  2025-03-14T05:54:22.2996986Z  2025-03-14T05:54:22.2997404Z  2025-03-14T05:54:22.2997801Z  2025-03-14T05:54:22.2998183Z  2025-03-14T05:54:22.2998568Z  2025-03-14T05:54:22.2999156Z  2025-03-14T05:54:22.2999788Z [15,130 / 15,235] 48 actions, 47 running 2025-03-14T05:54:22.3000598Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T05:54:22.3001427Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2025-03-14T05:54:22.3002305Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T05:54:22.3003553Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2025-03-14T05:54:22.3004419Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local 2025-03-14T05:54:22.3005368Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2025-03-14T05:54:22.3006218Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local 2025-03-14T05:54:22.3007160Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local ... 2025-03-14T05:54:22.6568391Z 2025-03-14T05:54:22.6569246Z  2025-03-14T05:54:22.6569704Z  2025-03-14T05:54:22.6570080Z  2025-03-14T05:54:22.6570469Z  2025-03-14T05:54:22.6570864Z  2025-03-14T05:54:22.6571268Z  2025-03-14T05:54:22.6571630Z  2025-03-14T05:54:22.6572126Z  2025-03-14T05:54:22.6572649Z [15,130 / 15,235] 48 actions running 2025-03-14T05:54:22.6573347Z @llvm-project//mlir:LinalgTransforms; 105s local 2025-03-14T05:54:22.6574034Z Compiling torch_xla/csrc/tensor_util.cpp; 77s local 2025-03-14T05:54:22.6574793Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T05:54:22.6575612Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2025-03-14T05:54:22.6576374Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local 2025-03-14T05:54:22.6577126Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2025-03-14T05:54:22.6578211Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2025-03-14T05:54:22.6579049Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local ... 2025-03-14T05:54:23.3153840Z 2025-03-14T05:54:23.3154701Z  2025-03-14T05:54:23.3155153Z  2025-03-14T05:54:23.3155526Z  2025-03-14T05:54:23.3155907Z  2025-03-14T05:54:23.3156294Z  2025-03-14T05:54:23.3156736Z  2025-03-14T05:54:23.3157123Z  2025-03-14T05:54:23.3157478Z  2025-03-14T05:54:23.3158342Z [15,131 / 15,235] 48 actions, 47 running 2025-03-14T05:54:23.3159099Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T05:54:23.3159839Z Compiling torch_xla/csrc/tensor_util.cpp; 77s local 2025-03-14T05:54:23.3160678Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 37s local 2025-03-14T05:54:23.3161522Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2025-03-14T05:54:23.3162270Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2025-03-14T05:54:23.3163033Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2025-03-14T05:54:23.3163835Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local 2025-03-14T05:54:23.3164791Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 28s local ... 2025-03-14T05:54:23.6575188Z 2025-03-14T05:54:23.6576116Z  2025-03-14T05:54:23.6576651Z  2025-03-14T05:54:23.6577421Z  2025-03-14T05:54:23.6577858Z  2025-03-14T05:54:23.6578337Z  2025-03-14T05:54:23.6578755Z  2025-03-14T05:54:23.6579142Z  2025-03-14T05:54:23.6579506Z  2025-03-14T05:54:23.6580060Z [15,131 / 15,235] 48 actions running 2025-03-14T05:54:23.6580714Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T05:54:23.6581421Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2025-03-14T05:54:23.6582198Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 37s local 2025-03-14T05:54:23.6583018Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2025-03-14T05:54:23.6583738Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2025-03-14T05:54:23.6584467Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2025-03-14T05:54:23.6585263Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local 2025-03-14T05:54:23.6586042Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 29s local ... 2025-03-14T05:54:24.0579759Z 2025-03-14T05:54:24.0580747Z  2025-03-14T05:54:24.0581206Z  2025-03-14T05:54:24.0581570Z  2025-03-14T05:54:24.0581953Z  2025-03-14T05:54:24.0582360Z  2025-03-14T05:54:24.0582755Z  2025-03-14T05:54:24.0583415Z  2025-03-14T05:54:24.0583813Z  2025-03-14T05:54:24.0584357Z [15,132 / 15,235] 48 actions running 2025-03-14T05:54:24.0585052Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T05:54:24.0585787Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2025-03-14T05:54:24.0586512Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T05:54:24.0587267Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2025-03-14T05:54:24.0588013Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2025-03-14T05:54:24.0588779Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2025-03-14T05:54:24.0589439Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 29s local 2025-03-14T05:54:24.0590248Z Compiling torch_xla/csrc/ops/expand.cpp; 28s local ... 2025-03-14T05:54:24.2620196Z 2025-03-14T05:54:24.2621079Z  2025-03-14T05:54:24.2621503Z  2025-03-14T05:54:24.2621944Z  2025-03-14T05:54:24.2622344Z  2025-03-14T05:54:24.2622739Z  2025-03-14T05:54:24.2623129Z  2025-03-14T05:54:24.2623525Z  2025-03-14T05:54:24.2623934Z  2025-03-14T05:54:24.2624542Z [15,133 / 15,235] 48 actions, 47 running 2025-03-14T05:54:24.2625280Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T05:54:24.2626026Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2025-03-14T05:54:24.2627135Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T05:54:24.2627944Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2025-03-14T05:54:24.2628767Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2025-03-14T05:54:24.2629630Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 29s local 2025-03-14T05:54:24.2630521Z Compiling torch_xla/csrc/ops/expand.cpp; 28s local 2025-03-14T05:54:24.2631425Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 28s local ... 2025-03-14T05:54:24.5386314Z 2025-03-14T05:54:24.5388574Z  2025-03-14T05:54:24.5389052Z  2025-03-14T05:54:24.5389430Z  2025-03-14T05:54:24.5389819Z  2025-03-14T05:54:24.5390157Z  2025-03-14T05:54:24.5390490Z  2025-03-14T05:54:24.5390857Z  2025-03-14T05:54:24.5391210Z  2025-03-14T05:54:24.5391787Z [15,134 / 15,235] 48 actions, 47 running 2025-03-14T05:54:24.5392477Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T05:54:24.5393205Z Compiling torch_xla/csrc/tensor_util.cpp; 79s local 2025-03-14T05:54:24.5393953Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T05:54:24.5394672Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2025-03-14T05:54:24.5395410Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local 2025-03-14T05:54:24.5396165Z Compiling torch_xla/csrc/ops/expand.cpp; 29s local 2025-03-14T05:54:24.5397160Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 28s local 2025-03-14T05:54:24.5398007Z Compiling torch_xla/csrc/ops/exponential.cpp; 26s local ... 2025-03-14T05:54:24.8586576Z 2025-03-14T05:54:24.8587507Z  2025-03-14T05:54:24.8587936Z  2025-03-14T05:54:24.8588279Z  2025-03-14T05:54:24.8588672Z  2025-03-14T05:54:24.8589043Z  2025-03-14T05:54:24.8589378Z  2025-03-14T05:54:24.8589735Z  2025-03-14T05:54:24.8590067Z  2025-03-14T05:54:24.8590544Z [15,134 / 15,235] 48 actions running 2025-03-14T05:54:24.8591205Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T05:54:24.8591871Z Compiling torch_xla/csrc/tensor_util.cpp; 79s local 2025-03-14T05:54:24.8592529Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T05:54:24.8593186Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2025-03-14T05:54:24.8593830Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local 2025-03-14T05:54:24.8594538Z Compiling torch_xla/csrc/ops/expand.cpp; 29s local 2025-03-14T05:54:24.8595252Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 28s local 2025-03-14T05:54:24.8595977Z Compiling torch_xla/csrc/ops/exponential.cpp; 26s local ... 2025-03-14T05:54:25.8592890Z 2025-03-14T05:54:25.8593909Z  2025-03-14T05:54:25.8594388Z  2025-03-14T05:54:25.8594778Z  2025-03-14T05:54:25.8595183Z  2025-03-14T05:54:25.8595588Z  2025-03-14T05:54:25.8596158Z  2025-03-14T05:54:25.8596563Z  2025-03-14T05:54:25.8596976Z  2025-03-14T05:54:25.8597595Z [15,134 / 15,235] 48 actions running 2025-03-14T05:54:25.8598348Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T05:54:25.8599112Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2025-03-14T05:54:25.8599890Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2025-03-14T05:54:25.8600678Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2025-03-14T05:54:25.8601492Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2025-03-14T05:54:25.8602327Z Compiling torch_xla/csrc/ops/expand.cpp; 30s local 2025-03-14T05:54:25.8603144Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2025-03-14T05:54:25.8604061Z Compiling torch_xla/csrc/ops/exponential.cpp; 27s local ... 2025-03-14T05:54:26.8602246Z 2025-03-14T05:54:26.8603237Z  2025-03-14T05:54:26.8603678Z  2025-03-14T05:54:26.8604050Z  2025-03-14T05:54:26.8604429Z  2025-03-14T05:54:26.8604931Z  2025-03-14T05:54:26.8605313Z  2025-03-14T05:54:26.8605689Z  2025-03-14T05:54:26.8606323Z  2025-03-14T05:54:26.8606823Z [15,134 / 15,235] 48 actions running 2025-03-14T05:54:26.8607425Z @llvm-project//mlir:LinalgTransforms; 109s local 2025-03-14T05:54:26.8608098Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2025-03-14T05:54:26.8608701Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2025-03-14T05:54:26.8609311Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2025-03-14T05:54:26.8610057Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 32s local 2025-03-14T05:54:26.8610680Z Compiling torch_xla/csrc/ops/expand.cpp; 31s local 2025-03-14T05:54:26.8611298Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2025-03-14T05:54:26.8611955Z Compiling torch_xla/csrc/ops/exponential.cpp; 28s local ... 2025-03-14T05:54:27.2606613Z 2025-03-14T05:54:27.2607604Z  2025-03-14T05:54:27.2608098Z  2025-03-14T05:54:27.2608555Z  2025-03-14T05:54:27.2608977Z  2025-03-14T05:54:27.2609406Z  2025-03-14T05:54:27.2609867Z  2025-03-14T05:54:27.2610298Z  2025-03-14T05:54:27.2610732Z  2025-03-14T05:54:27.2611321Z [15,135 / 15,235] 47 actions running 2025-03-14T05:54:27.2612100Z @llvm-project//mlir:LinalgTransforms; 109s local 2025-03-14T05:54:27.2612898Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2025-03-14T05:54:27.2613954Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T05:54:27.2614808Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 32s local 2025-03-14T05:54:27.2615687Z Compiling torch_xla/csrc/ops/expand.cpp; 31s local 2025-03-14T05:54:27.2616557Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2025-03-14T05:54:27.2617467Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local 2025-03-14T05:54:27.2618298Z Compiling torch_xla/csrc/ops/flip.cpp; 28s local ... 2025-03-14T05:54:27.4610517Z 2025-03-14T05:54:27.4611470Z  2025-03-14T05:54:27.4611940Z  2025-03-14T05:54:27.4612319Z  2025-03-14T05:54:27.4612770Z  2025-03-14T05:54:27.4613166Z  2025-03-14T05:54:27.4613570Z  2025-03-14T05:54:27.4613948Z  2025-03-14T05:54:27.4614397Z  2025-03-14T05:54:27.4614989Z [15,136 / 15,235] 48 actions, 47 running 2025-03-14T05:54:27.4615699Z @llvm-project//mlir:LinalgTransforms; 110s local 2025-03-14T05:54:27.4616420Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2025-03-14T05:54:27.4617024Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T05:54:27.4617632Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 33s local 2025-03-14T05:54:27.4618601Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2025-03-14T05:54:27.4619325Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local 2025-03-14T05:54:27.4620006Z Compiling torch_xla/csrc/ops/flip.cpp; 28s local 2025-03-14T05:54:27.4620642Z Compiling torch_xla/csrc/ops/gather.cpp; 28s local ... 2025-03-14T05:54:27.8614926Z 2025-03-14T05:54:27.8615905Z  2025-03-14T05:54:27.8616359Z  2025-03-14T05:54:27.8616756Z  2025-03-14T05:54:27.8617080Z  2025-03-14T05:54:27.8617438Z  2025-03-14T05:54:27.8617758Z  2025-03-14T05:54:27.8618076Z  2025-03-14T05:54:27.8618398Z  2025-03-14T05:54:27.8618851Z [15,137 / 15,235] 48 actions running 2025-03-14T05:54:27.8619442Z @llvm-project//mlir:LinalgTransforms; 110s local 2025-03-14T05:54:27.8620016Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2025-03-14T05:54:27.8620611Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T05:54:27.8621235Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2025-03-14T05:54:27.8621884Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local 2025-03-14T05:54:27.8622482Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local 2025-03-14T05:54:27.8623051Z Compiling torch_xla/csrc/ops/gather.cpp; 28s local 2025-03-14T05:54:27.8623658Z Compiling torch_xla/csrc/ops/generic.cpp; 28s local ... 2025-03-14T05:54:28.8622936Z 2025-03-14T05:54:28.8623767Z  2025-03-14T05:54:28.8624232Z  2025-03-14T05:54:28.8624626Z  2025-03-14T05:54:28.8625069Z  2025-03-14T05:54:28.8625453Z  2025-03-14T05:54:28.8625846Z  2025-03-14T05:54:28.8626229Z  2025-03-14T05:54:28.8626641Z  2025-03-14T05:54:28.8627232Z [15,137 / 15,235] 48 actions running 2025-03-14T05:54:28.8628015Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T05:54:28.8628990Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2025-03-14T05:54:28.8629791Z Compiling torch_xla/csrc/ops/eigh.cpp; 37s local 2025-03-14T05:54:28.8630748Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2025-03-14T05:54:28.8631668Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2025-03-14T05:54:28.8632453Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2025-03-14T05:54:28.8633408Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local 2025-03-14T05:54:28.8634239Z Compiling torch_xla/csrc/ops/generic.cpp; 29s local ... 2025-03-14T05:54:29.1206648Z 2025-03-14T05:54:29.1207548Z  2025-03-14T05:54:29.1208009Z  2025-03-14T05:54:29.1208374Z  2025-03-14T05:54:29.1208769Z  2025-03-14T05:54:29.1209164Z  2025-03-14T05:54:29.1209519Z  2025-03-14T05:54:29.1209868Z  2025-03-14T05:54:29.1210495Z  2025-03-14T05:54:29.1211074Z [15,138 / 15,235] 48 actions, 47 running 2025-03-14T05:54:29.1211783Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T05:54:29.1212500Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2025-03-14T05:54:29.1213281Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2025-03-14T05:54:29.1223912Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2025-03-14T05:54:29.1224725Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2025-03-14T05:54:29.1225440Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2025-03-14T05:54:29.1226194Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2025-03-14T05:54:29.1226993Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local ... 2025-03-14T05:54:29.4486912Z 2025-03-14T05:54:29.4487836Z  2025-03-14T05:54:29.4488295Z  2025-03-14T05:54:29.4488697Z  2025-03-14T05:54:29.4489110Z  2025-03-14T05:54:29.4489483Z  2025-03-14T05:54:29.4489934Z  2025-03-14T05:54:29.4490332Z  2025-03-14T05:54:29.4490697Z  2025-03-14T05:54:29.4491295Z [15,139 / 15,235] 48 actions, 47 running 2025-03-14T05:54:29.4492471Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T05:54:29.4493238Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2025-03-14T05:54:29.4493976Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2025-03-14T05:54:29.4494701Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2025-03-14T05:54:29.4495397Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2025-03-14T05:54:29.4496112Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2025-03-14T05:54:29.4496880Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2025-03-14T05:54:29.4497856Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local ... 2025-03-14T05:54:29.6629609Z 2025-03-14T05:54:29.6630530Z  2025-03-14T05:54:29.6630930Z  2025-03-14T05:54:29.6631321Z  2025-03-14T05:54:29.6631675Z  2025-03-14T05:54:29.6632041Z  2025-03-14T05:54:29.6632415Z  2025-03-14T05:54:29.6632777Z  2025-03-14T05:54:29.6633181Z  2025-03-14T05:54:29.6633727Z [15,139 / 15,235] 48 actions running 2025-03-14T05:54:29.6634404Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T05:54:29.6635121Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2025-03-14T05:54:29.6635809Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2025-03-14T05:54:29.6636481Z Compiling torch_xla/csrc/ops/flip.cpp; 31s local 2025-03-14T05:54:29.6637487Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2025-03-14T05:54:29.6638278Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2025-03-14T05:54:29.6639059Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2025-03-14T05:54:29.6639990Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local ... 2025-03-14T05:54:30.2174180Z 2025-03-14T05:54:30.2175332Z  2025-03-14T05:54:30.2175932Z  2025-03-14T05:54:30.2176308Z  2025-03-14T05:54:30.2176633Z  2025-03-14T05:54:30.2177217Z  2025-03-14T05:54:30.2177595Z  2025-03-14T05:54:30.2177966Z  2025-03-14T05:54:30.2178311Z  2025-03-14T05:54:30.2178876Z [15,140 / 15,235] 48 actions, 47 running 2025-03-14T05:54:30.2179592Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T05:54:30.2180274Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2025-03-14T05:54:30.2181031Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2025-03-14T05:54:30.2181781Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2025-03-14T05:54:30.2182477Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2025-03-14T05:54:30.2183221Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2025-03-14T05:54:30.2184026Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2025-03-14T05:54:30.2184921Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local ... 2025-03-14T05:54:30.4636346Z 2025-03-14T05:54:30.4637346Z  2025-03-14T05:54:30.4637804Z  2025-03-14T05:54:30.4638166Z  2025-03-14T05:54:30.4638562Z  2025-03-14T05:54:30.4638978Z  2025-03-14T05:54:30.4639351Z  2025-03-14T05:54:30.4639708Z  2025-03-14T05:54:30.4640090Z  2025-03-14T05:54:30.4640671Z [15,141 / 15,235] 48 actions running 2025-03-14T05:54:30.4641380Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2025-03-14T05:54:30.4642124Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2025-03-14T05:54:30.4642917Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2025-03-14T05:54:30.4643607Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2025-03-14T05:54:30.4644306Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2025-03-14T05:54:30.4645201Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2025-03-14T05:54:30.4646047Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2025-03-14T05:54:30.4646923Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local ... 2025-03-14T05:54:30.6638989Z 2025-03-14T05:54:30.6640074Z  2025-03-14T05:54:30.6640507Z  2025-03-14T05:54:30.6640856Z  2025-03-14T05:54:30.6641206Z  2025-03-14T05:54:30.6641559Z  2025-03-14T05:54:30.6641903Z  2025-03-14T05:54:30.6642256Z  2025-03-14T05:54:30.6642581Z  2025-03-14T05:54:30.6643102Z [15,142 / 15,235] 48 actions, 47 running 2025-03-14T05:54:30.6643759Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2025-03-14T05:54:30.6644438Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2025-03-14T05:54:30.6645257Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2025-03-14T05:54:30.6645918Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2025-03-14T05:54:30.6646679Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2025-03-14T05:54:30.6647451Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2025-03-14T05:54:30.6648221Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2025-03-14T05:54:30.6648962Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local ... 2025-03-14T05:54:31.0645889Z 2025-03-14T05:54:31.0646960Z  2025-03-14T05:54:31.0647555Z  2025-03-14T05:54:31.0647925Z  2025-03-14T05:54:31.0648298Z  2025-03-14T05:54:31.0648671Z  2025-03-14T05:54:31.0649038Z  2025-03-14T05:54:31.0649407Z  2025-03-14T05:54:31.0649772Z  2025-03-14T05:54:31.0650566Z [15,142 / 15,235] 48 actions running 2025-03-14T05:54:31.0651235Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2025-03-14T05:54:31.0651964Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2025-03-14T05:54:31.0652722Z Compiling torch_xla/csrc/ops/gather.cpp; 32s local 2025-03-14T05:54:31.0653473Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2025-03-14T05:54:31.0654605Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2025-03-14T05:54:31.0655549Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2025-03-14T05:54:31.0656403Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2025-03-14T05:54:31.0657208Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local ... 2025-03-14T05:54:31.3940922Z 2025-03-14T05:54:31.3941801Z  2025-03-14T05:54:31.3942421Z  2025-03-14T05:54:31.3942976Z  2025-03-14T05:54:31.3943419Z  2025-03-14T05:54:31.3943781Z  2025-03-14T05:54:31.3944145Z  2025-03-14T05:54:31.3944531Z  2025-03-14T05:54:31.3944912Z  2025-03-14T05:54:31.3945467Z [15,143 / 15,235] 48 actions, 47 running 2025-03-14T05:54:31.3946104Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2025-03-14T05:54:31.3946754Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T05:54:31.3947513Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T05:54:31.3948693Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2025-03-14T05:54:31.3949408Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2025-03-14T05:54:31.3950178Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2025-03-14T05:54:31.3950990Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2025-03-14T05:54:31.3951776Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local ... 2025-03-14T05:54:31.6336170Z 2025-03-14T05:54:31.6337383Z  2025-03-14T05:54:31.6337947Z  2025-03-14T05:54:31.6338299Z  2025-03-14T05:54:31.6338688Z  2025-03-14T05:54:31.6339037Z  2025-03-14T05:54:31.6339381Z  2025-03-14T05:54:31.6339728Z  2025-03-14T05:54:31.6340068Z  2025-03-14T05:54:31.6340568Z [15,144 / 15,235] 48 actions, 47 running 2025-03-14T05:54:31.6341195Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T05:54:31.6341887Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T05:54:31.6342619Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T05:54:31.6343365Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2025-03-14T05:54:31.6344406Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2025-03-14T05:54:31.6345116Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2025-03-14T05:54:31.6345773Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2025-03-14T05:54:31.6346456Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local ... 2025-03-14T05:54:31.8650762Z 2025-03-14T05:54:31.8651751Z  2025-03-14T05:54:31.8652351Z  2025-03-14T05:54:31.8652682Z  2025-03-14T05:54:31.8653006Z  2025-03-14T05:54:31.8653331Z  2025-03-14T05:54:31.8653653Z  2025-03-14T05:54:31.8653982Z  2025-03-14T05:54:31.8654306Z  2025-03-14T05:54:31.8654780Z [15,144 / 15,235] 48 actions running 2025-03-14T05:54:31.8655385Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T05:54:31.8656025Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T05:54:31.8656678Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T05:54:31.8657382Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2025-03-14T05:54:31.8658101Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2025-03-14T05:54:31.8658755Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2025-03-14T05:54:31.8659358Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2025-03-14T05:54:31.8660342Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local ... 2025-03-14T05:54:32.1815588Z 2025-03-14T05:54:32.1816537Z  2025-03-14T05:54:32.1816994Z  2025-03-14T05:54:32.1817394Z  2025-03-14T05:54:32.1817742Z  2025-03-14T05:54:32.1818111Z  2025-03-14T05:54:32.1818495Z  2025-03-14T05:54:32.1818879Z  2025-03-14T05:54:32.1819296Z  2025-03-14T05:54:32.1819869Z [15,145 / 15,235] 48 actions, 47 running 2025-03-14T05:54:32.1820845Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T05:54:32.1821667Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T05:54:32.1822514Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T05:54:32.1823428Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T05:54:32.1824250Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2025-03-14T05:54:32.1824967Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2025-03-14T05:54:32.1825698Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2025-03-14T05:54:32.1826450Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local ... 2025-03-14T05:54:32.4657304Z 2025-03-14T05:54:32.4658258Z  2025-03-14T05:54:32.4658738Z  2025-03-14T05:54:32.4659116Z  2025-03-14T05:54:32.4659482Z  2025-03-14T05:54:32.4660216Z  2025-03-14T05:54:32.4660595Z  2025-03-14T05:54:32.4660971Z  2025-03-14T05:54:32.4661390Z  2025-03-14T05:54:32.4661969Z [15,145 / 15,235] 48 actions running 2025-03-14T05:54:32.4662670Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T05:54:32.4663387Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2025-03-14T05:54:32.4664182Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2025-03-14T05:54:32.4664999Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T05:54:32.4666050Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2025-03-14T05:54:32.4666813Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2025-03-14T05:54:32.4667718Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2025-03-14T05:54:32.4668484Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local ... 2025-03-14T05:54:32.6660418Z 2025-03-14T05:54:32.6661409Z  2025-03-14T05:54:32.6661907Z  2025-03-14T05:54:32.6662265Z  2025-03-14T05:54:32.6662614Z  2025-03-14T05:54:32.6662963Z  2025-03-14T05:54:32.6663332Z  2025-03-14T05:54:32.6663712Z  2025-03-14T05:54:32.6664380Z  2025-03-14T05:54:32.6664917Z [15,146 / 15,235] 48 actions running 2025-03-14T05:54:32.6665811Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2025-03-14T05:54:32.6666512Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2025-03-14T05:54:32.6667260Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2025-03-14T05:54:32.6668057Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T05:54:32.6668836Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2025-03-14T05:54:32.6669560Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2025-03-14T05:54:32.6670463Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2025-03-14T05:54:32.6671288Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local ... 2025-03-14T05:54:33.1729419Z 2025-03-14T05:54:33.1730402Z  2025-03-14T05:54:33.1730866Z  2025-03-14T05:54:33.1731306Z  2025-03-14T05:54:33.1731657Z  2025-03-14T05:54:33.1732055Z  2025-03-14T05:54:33.1732425Z  2025-03-14T05:54:33.1732798Z  2025-03-14T05:54:33.1733194Z  2025-03-14T05:54:33.1733735Z [15,147 / 15,235] 48 actions, 47 running 2025-03-14T05:54:33.1734422Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2025-03-14T05:54:33.1735179Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2025-03-14T05:54:33.1736315Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2025-03-14T05:54:33.1737159Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2025-03-14T05:54:33.1737993Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T05:54:33.1738742Z Compiling torch_xla/csrc/ops/index_select.cpp; 31s local 2025-03-14T05:54:33.1739496Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2025-03-14T05:54:33.1740334Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local ... 2025-03-14T05:54:33.4669006Z 2025-03-14T05:54:33.4669851Z  2025-03-14T05:54:33.4670296Z  2025-03-14T05:54:33.4670692Z  2025-03-14T05:54:33.4671076Z  2025-03-14T05:54:33.4671459Z  2025-03-14T05:54:33.4671835Z  2025-03-14T05:54:33.4672198Z  2025-03-14T05:54:33.4672565Z  2025-03-14T05:54:33.4673093Z [15,147 / 15,235] 48 actions running 2025-03-14T05:54:33.4673775Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2025-03-14T05:54:33.4674559Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 37s local 2025-03-14T05:54:33.4675354Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2025-03-14T05:54:33.4676247Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2025-03-14T05:54:33.4677047Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T05:54:33.4678100Z Compiling torch_xla/csrc/ops/index_select.cpp; 31s local 2025-03-14T05:54:33.4678875Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2025-03-14T05:54:33.4679748Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local ... 2025-03-14T05:54:33.9555021Z 2025-03-14T05:54:33.9556048Z  2025-03-14T05:54:33.9556504Z  2025-03-14T05:54:33.9556867Z  2025-03-14T05:54:33.9557212Z  2025-03-14T05:54:33.9557574Z  2025-03-14T05:54:33.9557947Z  2025-03-14T05:54:33.9558319Z  2025-03-14T05:54:33.9558679Z  2025-03-14T05:54:33.9559236Z [15,148 / 15,235] 48 actions, 47 running 2025-03-14T05:54:33.9559933Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2025-03-14T05:54:33.9560657Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2025-03-14T05:54:33.9561475Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2025-03-14T05:54:33.9562245Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T05:54:33.9563000Z Compiling torch_xla/csrc/ops/index_select.cpp; 31s local 2025-03-14T05:54:33.9563777Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2025-03-14T05:54:33.9564743Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local 2025-03-14T05:54:33.9566111Z Compiling torch_xla/csrc/ops/linspace.cpp; 28s local ... 2025-03-14T05:54:34.2675276Z 2025-03-14T05:54:34.2676339Z  2025-03-14T05:54:34.2676834Z  2025-03-14T05:54:34.2677217Z  2025-03-14T05:54:34.2677602Z  2025-03-14T05:54:34.2678010Z  2025-03-14T05:54:34.2678405Z  2025-03-14T05:54:34.2678898Z  2025-03-14T05:54:34.2679316Z  2025-03-14T05:54:34.2679847Z [15,148 / 15,235] 48 actions running 2025-03-14T05:54:34.2680526Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2025-03-14T05:54:34.2681302Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2025-03-14T05:54:34.2682164Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2025-03-14T05:54:34.2683009Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T05:54:34.2683836Z Compiling torch_xla/csrc/ops/index_select.cpp; 32s local 2025-03-14T05:54:34.2684779Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2025-03-14T05:54:34.2685614Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local 2025-03-14T05:54:34.2686458Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local ... 2025-03-14T05:54:34.5525893Z 2025-03-14T05:54:34.5526831Z  2025-03-14T05:54:34.5527383Z  2025-03-14T05:54:34.5527866Z  2025-03-14T05:54:34.5528343Z  2025-03-14T05:54:34.5529108Z  2025-03-14T05:54:34.5529594Z  2025-03-14T05:54:34.5530074Z  2025-03-14T05:54:34.5530553Z  2025-03-14T05:54:34.5531272Z [15,149 / 15,235] 48 actions, 47 running 2025-03-14T05:54:34.5532148Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2025-03-14T05:54:34.5533110Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2025-03-14T05:54:34.5534202Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2025-03-14T05:54:34.5535366Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T05:54:34.5536326Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2025-03-14T05:54:34.5537368Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local 2025-03-14T05:54:34.5538414Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2025-03-14T05:54:34.5539386Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 28s local ... 2025-03-14T05:54:34.8680129Z 2025-03-14T05:54:34.8681144Z  2025-03-14T05:54:34.8681608Z  2025-03-14T05:54:34.8681978Z  2025-03-14T05:54:34.8682342Z  2025-03-14T05:54:34.8682698Z  2025-03-14T05:54:34.8683052Z  2025-03-14T05:54:34.8683385Z  2025-03-14T05:54:34.8683754Z  2025-03-14T05:54:34.8684263Z [15,149 / 15,235] 48 actions running 2025-03-14T05:54:34.8685035Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2025-03-14T05:54:34.8686042Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2025-03-14T05:54:34.8686850Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2025-03-14T05:54:34.8687607Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2025-03-14T05:54:34.8688285Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2025-03-14T05:54:34.8689046Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2025-03-14T05:54:34.8689802Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2025-03-14T05:54:34.8690545Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 29s local ... 2025-03-14T05:54:35.6503976Z 2025-03-14T05:54:35.6504922Z  2025-03-14T05:54:35.6505402Z  2025-03-14T05:54:35.6505953Z  2025-03-14T05:54:35.6506325Z  2025-03-14T05:54:35.6506704Z  2025-03-14T05:54:35.6507066Z  2025-03-14T05:54:35.6507441Z  2025-03-14T05:54:35.6507798Z  2025-03-14T05:54:35.6508406Z [15,150 / 15,235] 48 actions, 47 running 2025-03-14T05:54:35.6509122Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2025-03-14T05:54:35.6509879Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2025-03-14T05:54:35.6511036Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 35s local 2025-03-14T05:54:35.6511869Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2025-03-14T05:54:35.6512793Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 31s local 2025-03-14T05:54:35.6513790Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2025-03-14T05:54:35.6514613Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2025-03-14T05:54:35.6515420Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 29s local ... 2025-03-14T05:54:35.8698294Z 2025-03-14T05:54:35.8699233Z  2025-03-14T05:54:35.8699706Z  2025-03-14T05:54:35.8700105Z  2025-03-14T05:54:35.8700504Z  2025-03-14T05:54:35.8700908Z  2025-03-14T05:54:35.8701331Z  2025-03-14T05:54:35.8701708Z  2025-03-14T05:54:35.8702108Z  2025-03-14T05:54:35.8702700Z [15,150 / 15,235] 48 actions running 2025-03-14T05:54:35.8703418Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2025-03-14T05:54:35.8704193Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2025-03-14T05:54:35.8705074Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 35s local 2025-03-14T05:54:35.8705901Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2025-03-14T05:54:35.8706770Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 31s local 2025-03-14T05:54:35.8707899Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2025-03-14T05:54:35.8708664Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2025-03-14T05:54:35.8709466Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 29s local ... 2025-03-14T05:54:36.9614235Z 2025-03-14T05:54:36.9615417Z  2025-03-14T05:54:36.9615939Z  2025-03-14T05:54:36.9616347Z  2025-03-14T05:54:36.9616774Z  2025-03-14T05:54:36.9617159Z  2025-03-14T05:54:36.9617535Z  2025-03-14T05:54:36.9618224Z  2025-03-14T05:54:36.9618637Z  2025-03-14T05:54:36.9619206Z [15,150 / 15,235] 48 actions running 2025-03-14T05:54:36.9619911Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2025-03-14T05:54:36.9620667Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 37s local 2025-03-14T05:54:36.9621545Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 37s local 2025-03-14T05:54:36.9622364Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2025-03-14T05:54:36.9623193Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 32s local 2025-03-14T05:54:36.9624050Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2025-03-14T05:54:36.9624771Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2025-03-14T05:54:36.9625754Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local ... 2025-03-14T05:54:37.2058714Z 2025-03-14T05:54:37.2059655Z  2025-03-14T05:54:37.2060156Z  2025-03-14T05:54:37.2060676Z  2025-03-14T05:54:37.2061096Z  2025-03-14T05:54:37.2061504Z  2025-03-14T05:54:37.2061903Z  2025-03-14T05:54:37.2062292Z  2025-03-14T05:54:37.2062679Z  2025-03-14T05:54:37.2063268Z [15,154 / 15,235] 48 actions, 45 running 2025-03-14T05:54:37.2063989Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2025-03-14T05:54:37.2064735Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2025-03-14T05:54:37.2065800Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2025-03-14T05:54:37.2066724Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2025-03-14T05:54:37.2067499Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local 2025-03-14T05:54:37.2068284Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2025-03-14T05:54:37.2069119Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local 2025-03-14T05:54:37.2069997Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 28s local ... 2025-03-14T05:54:37.5622235Z 2025-03-14T05:54:37.5623274Z  2025-03-14T05:54:37.5623777Z  2025-03-14T05:54:37.5624636Z  2025-03-14T05:54:37.5625192Z  2025-03-14T05:54:37.5625627Z  2025-03-14T05:54:37.5626007Z  2025-03-14T05:54:37.5626383Z  2025-03-14T05:54:37.5626762Z  2025-03-14T05:54:37.5627307Z [15,154 / 15,235] 48 actions running 2025-03-14T05:54:37.5628063Z Compiling torch_xla/csrc/tensor_util.cpp; 92s local 2025-03-14T05:54:37.5628861Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2025-03-14T05:54:37.5629632Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2025-03-14T05:54:37.5630443Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2025-03-14T05:54:37.5631251Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 31s local 2025-03-14T05:54:37.5632075Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2025-03-14T05:54:37.5632938Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local 2025-03-14T05:54:37.5633807Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local ... 2025-03-14T05:54:38.3043393Z 2025-03-14T05:54:38.3044453Z  2025-03-14T05:54:38.3045136Z  2025-03-14T05:54:38.3045523Z  2025-03-14T05:54:38.3045910Z  2025-03-14T05:54:38.3046294Z  2025-03-14T05:54:38.3046623Z  2025-03-14T05:54:38.3046944Z  2025-03-14T05:54:38.3047308Z  2025-03-14T05:54:38.3047869Z [15,156 / 15,235] 47 actions, 46 running 2025-03-14T05:54:38.3048867Z Compiling torch_xla/csrc/tensor_util.cpp; 92s local 2025-03-14T05:54:38.3049610Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2025-03-14T05:54:38.3050313Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2025-03-14T05:54:38.3051058Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2025-03-14T05:54:38.3051835Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2025-03-14T05:54:38.3052630Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local 2025-03-14T05:54:38.3053593Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 28s local 2025-03-14T05:54:38.3054485Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 28s local ... 2025-03-14T05:54:38.5626988Z 2025-03-14T05:54:38.5628067Z  2025-03-14T05:54:38.5628570Z  2025-03-14T05:54:38.5628960Z  2025-03-14T05:54:38.5629335Z  2025-03-14T05:54:38.5629723Z  2025-03-14T05:54:38.5630125Z  2025-03-14T05:54:38.5630512Z  2025-03-14T05:54:38.5630896Z  2025-03-14T05:54:38.5631489Z [15,156 / 15,235] 48 actions running 2025-03-14T05:54:38.5632237Z Compiling torch_xla/csrc/tensor_util.cpp; 93s local 2025-03-14T05:54:38.5632934Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2025-03-14T05:54:38.5633674Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2025-03-14T05:54:38.5634414Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2025-03-14T05:54:38.5635539Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2025-03-14T05:54:38.5636322Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2025-03-14T05:54:38.5637071Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 29s local 2025-03-14T05:54:38.5637940Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 28s local ... 2025-03-14T05:54:39.5634414Z 2025-03-14T05:54:39.5635497Z  2025-03-14T05:54:39.5636041Z  2025-03-14T05:54:39.5636430Z  2025-03-14T05:54:39.5636810Z  2025-03-14T05:54:39.5637185Z  2025-03-14T05:54:39.5637581Z  2025-03-14T05:54:39.5638006Z  2025-03-14T05:54:39.5638419Z  2025-03-14T05:54:39.5638978Z [15,156 / 15,235] 48 actions running 2025-03-14T05:54:39.5639701Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2025-03-14T05:54:39.5640465Z Compiling torch_xla/csrc/ops/index_ops.cpp; 38s local 2025-03-14T05:54:39.5641276Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2025-03-14T05:54:39.5642050Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2025-03-14T05:54:39.5642795Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2025-03-14T05:54:39.5643885Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 31s local 2025-03-14T05:54:39.5644769Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2025-03-14T05:54:39.5645611Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 29s local ... 2025-03-14T05:54:40.3327028Z 2025-03-14T05:54:40.3327947Z  2025-03-14T05:54:40.3328441Z  2025-03-14T05:54:40.3328861Z  2025-03-14T05:54:40.3329296Z  2025-03-14T05:54:40.3329708Z  2025-03-14T05:54:40.3330125Z  2025-03-14T05:54:40.3330510Z  2025-03-14T05:54:40.3330924Z  2025-03-14T05:54:40.3331491Z [15,157 / 15,235] 48 actions, 47 running 2025-03-14T05:54:40.3332235Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2025-03-14T05:54:40.3332961Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2025-03-14T05:54:40.3333757Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2025-03-14T05:54:40.3334569Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T05:54:40.3335380Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2025-03-14T05:54:40.3336189Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2025-03-14T05:54:40.3337045Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local 2025-03-14T05:54:40.3337950Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 29s local ... 2025-03-14T05:54:40.5642863Z 2025-03-14T05:54:40.5644121Z  2025-03-14T05:54:40.5644783Z  2025-03-14T05:54:40.5645194Z  2025-03-14T05:54:40.5645571Z  2025-03-14T05:54:40.5646010Z  2025-03-14T05:54:40.5646401Z  2025-03-14T05:54:40.5646799Z  2025-03-14T05:54:40.5647334Z  2025-03-14T05:54:40.5648048Z [15,157 / 15,235] 48 actions running 2025-03-14T05:54:40.5648813Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2025-03-14T05:54:40.5649789Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2025-03-14T05:54:40.5650667Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2025-03-14T05:54:40.5651503Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T05:54:40.5652383Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2025-03-14T05:54:40.5653133Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 31s local 2025-03-14T05:54:40.5653955Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local 2025-03-14T05:54:40.5654833Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local ... 2025-03-14T05:54:40.8003731Z 2025-03-14T05:54:40.8004788Z  2025-03-14T05:54:40.8005197Z  2025-03-14T05:54:40.8005530Z  2025-03-14T05:54:40.8005854Z  2025-03-14T05:54:40.8006181Z  2025-03-14T05:54:40.8006491Z  2025-03-14T05:54:40.8006815Z  2025-03-14T05:54:40.8007449Z  2025-03-14T05:54:40.8007939Z [15,158 / 15,235] 48 actions, 47 running 2025-03-14T05:54:40.8008551Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2025-03-14T05:54:40.8009191Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2025-03-14T05:54:40.8009865Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T05:54:40.8010539Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2025-03-14T05:54:40.8011318Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 31s local 2025-03-14T05:54:40.8012146Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local 2025-03-14T05:54:40.8013137Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2025-03-14T05:54:40.8013849Z Compiling torch_xla/csrc/ops/mean.cpp; 29s local ... 2025-03-14T05:54:41.1647779Z 2025-03-14T05:54:41.1648628Z  2025-03-14T05:54:41.1649093Z  2025-03-14T05:54:41.1649493Z  2025-03-14T05:54:41.1649867Z  2025-03-14T05:54:41.1650272Z  2025-03-14T05:54:41.1650641Z  2025-03-14T05:54:41.1651010Z  2025-03-14T05:54:41.1651385Z  2025-03-14T05:54:41.1652309Z [15,158 / 15,235] 48 actions running 2025-03-14T05:54:41.1653448Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2025-03-14T05:54:41.1654329Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2025-03-14T05:54:41.1655210Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2025-03-14T05:54:41.1656114Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2025-03-14T05:54:41.1657021Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 31s local 2025-03-14T05:54:41.1657967Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 31s local 2025-03-14T05:54:41.1659092Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2025-03-14T05:54:41.1659951Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local ... 2025-03-14T05:54:42.0187687Z 2025-03-14T05:54:42.0188545Z  2025-03-14T05:54:42.0189000Z  2025-03-14T05:54:42.0189415Z  2025-03-14T05:54:42.0189800Z  2025-03-14T05:54:42.0190192Z  2025-03-14T05:54:42.0190580Z  2025-03-14T05:54:42.0190978Z  2025-03-14T05:54:42.0191379Z  2025-03-14T05:54:42.0191987Z [15,159 / 15,235] 48 actions, 47 running 2025-03-14T05:54:42.0192683Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2025-03-14T05:54:42.0193455Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2025-03-14T05:54:42.0194237Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2025-03-14T05:54:42.0195012Z Compiling torch_xla/csrc/ops/masked_select.cpp; 34s local 2025-03-14T05:54:42.0196092Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 32s local 2025-03-14T05:54:42.0196928Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2025-03-14T05:54:42.0197700Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2025-03-14T05:54:42.0198464Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local ... 2025-03-14T05:54:42.2359531Z 2025-03-14T05:54:42.2360384Z  2025-03-14T05:54:42.2360854Z  2025-03-14T05:54:42.2361242Z  2025-03-14T05:54:42.2361877Z  2025-03-14T05:54:42.2362281Z  2025-03-14T05:54:42.2362671Z  2025-03-14T05:54:42.2363112Z  2025-03-14T05:54:42.2363530Z  2025-03-14T05:54:42.2364101Z [15,160 / 15,235] 48 actions, 47 running 2025-03-14T05:54:42.2365005Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2025-03-14T05:54:42.2366020Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2025-03-14T05:54:42.2366869Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2025-03-14T05:54:42.2367661Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 32s local 2025-03-14T05:54:42.2368508Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2025-03-14T05:54:42.2369311Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2025-03-14T05:54:42.2370097Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2025-03-14T05:54:42.2371143Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 29s local ... 2025-03-14T05:54:42.5657701Z 2025-03-14T05:54:42.5658575Z  2025-03-14T05:54:42.5659102Z  2025-03-14T05:54:42.5659511Z  2025-03-14T05:54:42.5659952Z  2025-03-14T05:54:42.5660362Z  2025-03-14T05:54:42.5660762Z  2025-03-14T05:54:42.5661143Z  2025-03-14T05:54:42.5661531Z  2025-03-14T05:54:42.5662105Z [15,160 / 15,235] 48 actions running 2025-03-14T05:54:42.5662865Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T05:54:42.5663688Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2025-03-14T05:54:42.5664517Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2025-03-14T05:54:42.5665561Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 33s local 2025-03-14T05:54:42.5666390Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2025-03-14T05:54:42.5667181Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2025-03-14T05:54:42.5667965Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2025-03-14T05:54:42.5668781Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 29s local ... 2025-03-14T05:54:42.9482560Z 2025-03-14T05:54:42.9483718Z  2025-03-14T05:54:42.9484132Z  2025-03-14T05:54:42.9484468Z  2025-03-14T05:54:42.9484970Z  2025-03-14T05:54:42.9485333Z  2025-03-14T05:54:42.9485712Z  2025-03-14T05:54:42.9486128Z  2025-03-14T05:54:42.9486466Z  2025-03-14T05:54:42.9486977Z [15,161 / 15,235] 48 actions, 47 running 2025-03-14T05:54:42.9487676Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T05:54:42.9488445Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2025-03-14T05:54:42.9489114Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 33s local 2025-03-14T05:54:42.9489816Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2025-03-14T05:54:42.9490479Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2025-03-14T05:54:42.9491132Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2025-03-14T05:54:42.9491788Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2025-03-14T05:54:42.9492505Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local ... 2025-03-14T05:54:43.1663838Z 2025-03-14T05:54:43.1664740Z  2025-03-14T05:54:43.1665238Z  2025-03-14T05:54:43.1665863Z  2025-03-14T05:54:43.1666301Z  2025-03-14T05:54:43.1666713Z  2025-03-14T05:54:43.1667114Z  2025-03-14T05:54:43.1667543Z  2025-03-14T05:54:43.1667996Z  2025-03-14T05:54:43.1668920Z [15,162 / 15,235] 48 actions, 47 running 2025-03-14T05:54:43.1669707Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T05:54:43.1670318Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 37s local 2025-03-14T05:54:43.1670946Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2025-03-14T05:54:43.1671549Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2025-03-14T05:54:43.1672698Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2025-03-14T05:54:43.1673465Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2025-03-14T05:54:43.1674131Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2025-03-14T05:54:43.1675010Z Compiling torch_xla/csrc/ops/var.cpp; 28s local ... 2025-03-14T05:54:43.5668664Z 2025-03-14T05:54:43.5669593Z  2025-03-14T05:54:43.5670054Z  2025-03-14T05:54:43.5670450Z  2025-03-14T05:54:43.5670840Z  2025-03-14T05:54:43.5671209Z  2025-03-14T05:54:43.5671618Z  2025-03-14T05:54:43.5672002Z  2025-03-14T05:54:43.5672356Z  2025-03-14T05:54:43.5672901Z [15,162 / 15,235] 48 actions running 2025-03-14T05:54:43.5673626Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T05:54:43.5674384Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 37s local 2025-03-14T05:54:43.5675182Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2025-03-14T05:54:43.5676100Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2025-03-14T05:54:43.5676914Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2025-03-14T05:54:43.5677682Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2025-03-14T05:54:43.5678485Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2025-03-14T05:54:43.5679362Z Compiling torch_xla/csrc/ops/var.cpp; 28s local ... 2025-03-14T05:54:43.7673291Z 2025-03-14T05:54:43.7674240Z  2025-03-14T05:54:43.7674879Z  2025-03-14T05:54:43.7675359Z  2025-03-14T05:54:43.7675840Z  2025-03-14T05:54:43.7676259Z  2025-03-14T05:54:43.7676702Z  2025-03-14T05:54:43.7677126Z  2025-03-14T05:54:43.7677573Z  2025-03-14T05:54:43.7678185Z [15,163 / 15,235] 48 actions running 2025-03-14T05:54:43.7678993Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T05:54:43.7679824Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2025-03-14T05:54:43.7680682Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2025-03-14T05:54:43.7681453Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 32s local 2025-03-14T05:54:43.7682327Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 31s local 2025-03-14T05:54:43.7683543Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2025-03-14T05:54:43.7684327Z Compiling torch_xla/csrc/ops/var.cpp; 29s local 2025-03-14T05:54:43.7685143Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local ... 2025-03-14T05:54:44.1677913Z 2025-03-14T05:54:44.1678768Z  2025-03-14T05:54:44.1679210Z  2025-03-14T05:54:44.1679591Z  2025-03-14T05:54:44.1679991Z  2025-03-14T05:54:44.1680363Z  2025-03-14T05:54:44.1680748Z  2025-03-14T05:54:44.1681110Z  2025-03-14T05:54:44.1681480Z  2025-03-14T05:54:44.1681986Z [15,164 / 15,235] 48 actions running 2025-03-14T05:54:44.1682690Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T05:54:44.1683461Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2025-03-14T05:54:44.1684207Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2025-03-14T05:54:44.1685091Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 31s local 2025-03-14T05:54:44.1685865Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 31s local 2025-03-14T05:54:44.1686623Z Compiling torch_xla/csrc/ops/var.cpp; 29s local 2025-03-14T05:54:44.1687334Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local 2025-03-14T05:54:44.1688189Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 28s local ... 2025-03-14T05:54:44.5094512Z 2025-03-14T05:54:44.5095941Z  2025-03-14T05:54:44.5096421Z  2025-03-14T05:54:44.5096802Z  2025-03-14T05:54:44.5097188Z  2025-03-14T05:54:44.5097725Z  2025-03-14T05:54:44.5098092Z  2025-03-14T05:54:44.5098446Z  2025-03-14T05:54:44.5098798Z  2025-03-14T05:54:44.5099331Z [15,165 / 15,235] 48 actions, 47 running 2025-03-14T05:54:44.5100015Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2025-03-14T05:54:44.5100894Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T05:54:44.5101633Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2025-03-14T05:54:44.5102384Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 31s local 2025-03-14T05:54:44.5103100Z Compiling torch_xla/csrc/ops/var.cpp; 29s local 2025-03-14T05:54:44.5103782Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local 2025-03-14T05:54:44.5104611Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 28s local 2025-03-14T05:54:44.5105616Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 27s local ... 2025-03-14T05:54:44.7683046Z 2025-03-14T05:54:44.7684022Z  2025-03-14T05:54:44.7684463Z  2025-03-14T05:54:44.7685079Z  2025-03-14T05:54:44.7685471Z  2025-03-14T05:54:44.7685851Z  2025-03-14T05:54:44.7686240Z  2025-03-14T05:54:44.7686642Z  2025-03-14T05:54:44.7687355Z  2025-03-14T05:54:44.7687923Z [15,165 / 15,235] 48 actions running 2025-03-14T05:54:44.7688892Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2025-03-14T05:54:44.7689693Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T05:54:44.7690485Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2025-03-14T05:54:44.7691275Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 31s local 2025-03-14T05:54:44.7692039Z Compiling torch_xla/csrc/ops/var.cpp; 30s local 2025-03-14T05:54:44.7692793Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T05:54:44.7693728Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 28s local 2025-03-14T05:54:44.7694683Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 27s local ... 2025-03-14T05:54:44.9995393Z 2025-03-14T05:54:44.9996265Z  2025-03-14T05:54:44.9996759Z  2025-03-14T05:54:44.9997172Z  2025-03-14T05:54:44.9997623Z  2025-03-14T05:54:44.9998042Z  2025-03-14T05:54:44.9998467Z  2025-03-14T05:54:44.9998885Z  2025-03-14T05:54:44.9999304Z  2025-03-14T05:54:44.9999948Z [15,166 / 15,235] 48 actions, 47 running 2025-03-14T05:54:45.0000993Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2025-03-14T05:54:45.0001851Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T05:54:45.0002690Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T05:54:45.0003451Z Compiling torch_xla/csrc/ops/var.cpp; 30s local 2025-03-14T05:54:45.0004284Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T05:54:45.0005428Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 28s local 2025-03-14T05:54:45.0006493Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 28s local 2025-03-14T05:54:45.0007576Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 27s local ... 2025-03-14T05:54:45.2307303Z 2025-03-14T05:54:45.2308243Z  2025-03-14T05:54:45.2308687Z  2025-03-14T05:54:45.2309036Z  2025-03-14T05:54:45.2309398Z  2025-03-14T05:54:45.2309779Z  2025-03-14T05:54:45.2310126Z  2025-03-14T05:54:45.2310498Z  2025-03-14T05:54:45.2310861Z  2025-03-14T05:54:45.2311363Z [15,167 / 15,235] 48 actions, 47 running 2025-03-14T05:54:45.2312005Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2025-03-14T05:54:45.2312643Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T05:54:45.2313246Z Compiling torch_xla/csrc/ops/var.cpp; 30s local 2025-03-14T05:54:45.2314167Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T05:54:45.2315015Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local 2025-03-14T05:54:45.2315937Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 28s local 2025-03-14T05:54:45.2316801Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 27s local 2025-03-14T05:54:45.2317605Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 27s local ... 2025-03-14T05:54:45.7686004Z 2025-03-14T05:54:45.7686849Z  2025-03-14T05:54:45.7687645Z  2025-03-14T05:54:45.7688067Z  2025-03-14T05:54:45.7688444Z  2025-03-14T05:54:45.7688851Z  2025-03-14T05:54:45.7689233Z  2025-03-14T05:54:45.7689630Z  2025-03-14T05:54:45.7690013Z  2025-03-14T05:54:45.7690568Z [15,167 / 15,235] 48 actions running 2025-03-14T05:54:45.7691322Z Compiling torch_xla/csrc/tensor_util.cpp; 100s local 2025-03-14T05:54:45.7692102Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T05:54:45.7692833Z Compiling torch_xla/csrc/ops/var.cpp; 30s local 2025-03-14T05:54:45.7703766Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T05:54:45.7704768Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local 2025-03-14T05:54:45.7705796Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 28s local 2025-03-14T05:54:45.7707059Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 28s local 2025-03-14T05:54:45.7707975Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 28s local ... 2025-03-14T05:54:46.7694221Z 2025-03-14T05:54:46.7695025Z  2025-03-14T05:54:46.7695490Z  2025-03-14T05:54:46.7695867Z  2025-03-14T05:54:46.7696209Z  2025-03-14T05:54:46.7696596Z  2025-03-14T05:54:46.7696986Z  2025-03-14T05:54:46.7697374Z  2025-03-14T05:54:46.7697796Z  2025-03-14T05:54:46.7698340Z [15,167 / 15,235] 48 actions running 2025-03-14T05:54:46.7699150Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2025-03-14T05:54:46.7699910Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2025-03-14T05:54:46.7700613Z Compiling torch_xla/csrc/ops/var.cpp; 32s local 2025-03-14T05:54:46.7701391Z Compiling torch_xla/csrc/ops/multinomial.cpp; 32s local 2025-03-14T05:54:46.7702312Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2025-03-14T05:54:46.7703361Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 29s local 2025-03-14T05:54:46.7704330Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 29s local 2025-03-14T05:54:46.7705599Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local ... 2025-03-14T05:54:47.1698201Z 2025-03-14T05:54:47.1699054Z  2025-03-14T05:54:47.1699545Z  2025-03-14T05:54:47.1699955Z  2025-03-14T05:54:47.1700352Z  2025-03-14T05:54:47.1700752Z  2025-03-14T05:54:47.1701155Z  2025-03-14T05:54:47.1701569Z  2025-03-14T05:54:47.1701956Z  2025-03-14T05:54:47.1702548Z [15,168 / 15,235] 48 actions running 2025-03-14T05:54:47.1703336Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2025-03-14T05:54:47.1704126Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2025-03-14T05:54:47.1704917Z Compiling torch_xla/csrc/ops/var.cpp; 32s local 2025-03-14T05:54:47.1705806Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 31s local 2025-03-14T05:54:47.1706902Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2025-03-14T05:54:47.1707945Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 29s local 2025-03-14T05:54:47.1708902Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2025-03-14T05:54:47.1709810Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 27s local ... 2025-03-14T05:54:47.4570541Z 2025-03-14T05:54:47.4571331Z  2025-03-14T05:54:47.4571798Z  2025-03-14T05:54:47.4572183Z  2025-03-14T05:54:47.4572769Z  2025-03-14T05:54:47.4573453Z  2025-03-14T05:54:47.4573905Z  2025-03-14T05:54:47.4574315Z  2025-03-14T05:54:47.4574691Z  2025-03-14T05:54:47.4575292Z [15,169 / 15,235] 48 actions, 47 running 2025-03-14T05:54:47.4576019Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2025-03-14T05:54:47.4576797Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2025-03-14T05:54:47.4577502Z Compiling torch_xla/csrc/ops/var.cpp; 32s local 2025-03-14T05:54:47.4578779Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2025-03-14T05:54:47.4579827Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2025-03-14T05:54:47.4580789Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2025-03-14T05:54:47.4581694Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 28s local 2025-03-14T05:54:47.4582528Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 27s local ... 2025-03-14T05:54:47.7703707Z 2025-03-14T05:54:47.7704942Z  2025-03-14T05:54:47.7705415Z  2025-03-14T05:54:47.7705845Z  2025-03-14T05:54:47.7706220Z  2025-03-14T05:54:47.7706623Z  2025-03-14T05:54:47.7706997Z  2025-03-14T05:54:47.7707392Z  2025-03-14T05:54:47.7707748Z  2025-03-14T05:54:47.7708343Z [15,169 / 15,235] 48 actions running 2025-03-14T05:54:47.7709047Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2025-03-14T05:54:47.7710084Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2025-03-14T05:54:47.7710760Z Compiling torch_xla/csrc/ops/var.cpp; 33s local 2025-03-14T05:54:47.7711616Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2025-03-14T05:54:47.7712561Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2025-03-14T05:54:47.7713400Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2025-03-14T05:54:47.7714184Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 28s local 2025-03-14T05:54:47.7714940Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 28s local ... 2025-03-14T05:54:48.1908508Z 2025-03-14T05:54:48.1909409Z  2025-03-14T05:54:48.1909887Z  2025-03-14T05:54:48.1910296Z  2025-03-14T05:54:48.1910679Z  2025-03-14T05:54:48.1911076Z  2025-03-14T05:54:48.1911446Z  2025-03-14T05:54:48.1911862Z  2025-03-14T05:54:48.1912266Z  2025-03-14T05:54:48.1912886Z [15,170 / 15,235] 48 actions, 47 running 2025-03-14T05:54:48.1913615Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2025-03-14T05:54:48.1914297Z Compiling torch_xla/csrc/ops/var.cpp; 33s local 2025-03-14T05:54:48.1915404Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2025-03-14T05:54:48.1916377Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2025-03-14T05:54:48.1917246Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2025-03-14T05:54:48.1917988Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 28s local 2025-03-14T05:54:48.1918733Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 28s local 2025-03-14T05:54:48.1919651Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 25s local ... 2025-03-14T05:54:48.4783915Z 2025-03-14T05:54:48.4784780Z  2025-03-14T05:54:48.4785249Z  2025-03-14T05:54:48.4785617Z  2025-03-14T05:54:48.4786000Z  2025-03-14T05:54:48.4786379Z  2025-03-14T05:54:48.4786811Z  2025-03-14T05:54:48.4787184Z  2025-03-14T05:54:48.4787557Z  2025-03-14T05:54:48.4788132Z [15,170 / 15,235] 48 actions running 2025-03-14T05:54:48.4788826Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2025-03-14T05:54:48.4789532Z Compiling torch_xla/csrc/ops/var.cpp; 33s local 2025-03-14T05:54:48.4790309Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2025-03-14T05:54:48.4791265Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2025-03-14T05:54:48.4792134Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 31s local 2025-03-14T05:54:48.4793183Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2025-03-14T05:54:48.4793950Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 28s local 2025-03-14T05:54:48.4794776Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local ... 2025-03-14T05:54:48.8789678Z 2025-03-14T05:54:48.8790479Z  2025-03-14T05:54:48.8790941Z  2025-03-14T05:54:48.8791373Z  2025-03-14T05:54:48.8791766Z  2025-03-14T05:54:48.8792162Z  2025-03-14T05:54:48.8792552Z  2025-03-14T05:54:48.8793222Z  2025-03-14T05:54:48.8793607Z  2025-03-14T05:54:48.8794185Z [15,171 / 15,235] 47 actions running 2025-03-14T05:54:48.8794943Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2025-03-14T05:54:48.8795713Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2025-03-14T05:54:48.8796626Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2025-03-14T05:54:48.8797562Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 31s local 2025-03-14T05:54:48.8798405Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2025-03-14T05:54:48.8799201Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2025-03-14T05:54:48.8800056Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local 2025-03-14T05:54:48.8801016Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 25s local ... 2025-03-14T05:54:49.0792428Z 2025-03-14T05:54:49.0793196Z  2025-03-14T05:54:49.0793591Z  2025-03-14T05:54:49.0793984Z  2025-03-14T05:54:49.0794391Z  2025-03-14T05:54:49.0794779Z  2025-03-14T05:54:49.0795161Z  2025-03-14T05:54:49.0795574Z  2025-03-14T05:54:49.0795907Z  2025-03-14T05:54:49.0796482Z [15,172 / 15,235] 48 actions, 47 running 2025-03-14T05:54:49.0797304Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2025-03-14T05:54:49.0797970Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2025-03-14T05:54:49.0799473Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2025-03-14T05:54:49.0800376Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2025-03-14T05:54:49.0801182Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2025-03-14T05:54:49.0802056Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local 2025-03-14T05:54:49.0803118Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 25s local 2025-03-14T05:54:49.0804032Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local ... 2025-03-14T05:54:49.2887906Z 2025-03-14T05:54:49.2888793Z  2025-03-14T05:54:49.2889266Z  2025-03-14T05:54:49.2889999Z  2025-03-14T05:54:49.2890596Z  2025-03-14T05:54:49.2890946Z  2025-03-14T05:54:49.2891251Z  2025-03-14T05:54:49.2891551Z  2025-03-14T05:54:49.2891856Z  2025-03-14T05:54:49.2892372Z [15,173 / 15,235] 48 actions, 47 running 2025-03-14T05:54:49.2893103Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2025-03-14T05:54:49.2893843Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2025-03-14T05:54:49.2894560Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T05:54:49.2895246Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2025-03-14T05:54:49.2895917Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local 2025-03-14T05:54:49.2896747Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 25s local 2025-03-14T05:54:49.2897504Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2025-03-14T05:54:49.2898119Z Compiling torch_xla/csrc/ops/nms.cpp; 24s local ... 2025-03-14T05:54:49.4891551Z 2025-03-14T05:54:49.4892502Z  2025-03-14T05:54:49.4892966Z  2025-03-14T05:54:49.4893354Z  2025-03-14T05:54:49.4893701Z  2025-03-14T05:54:49.4894050Z  2025-03-14T05:54:49.4894424Z  2025-03-14T05:54:49.4894823Z  2025-03-14T05:54:49.4895256Z  2025-03-14T05:54:49.4896043Z [15,173 / 15,235] 48 actions running 2025-03-14T05:54:49.4897243Z Compiling torch_xla/csrc/tensor_util.cpp; 104s local 2025-03-14T05:54:49.4898210Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2025-03-14T05:54:49.4898887Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T05:54:49.4899607Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2025-03-14T05:54:49.4900413Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local 2025-03-14T05:54:49.4901489Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 26s local 2025-03-14T05:54:49.4902626Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2025-03-14T05:54:49.4903590Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local ... 2025-03-14T05:54:49.7283761Z 2025-03-14T05:54:49.7284677Z  2025-03-14T05:54:49.7285061Z  2025-03-14T05:54:49.7285381Z  2025-03-14T05:54:49.7285705Z  2025-03-14T05:54:49.7286035Z  2025-03-14T05:54:49.7286347Z  2025-03-14T05:54:49.7286670Z  2025-03-14T05:54:49.7286983Z  2025-03-14T05:54:49.7287494Z [15,174 / 15,235] 48 actions, 47 running 2025-03-14T05:54:49.7288088Z Compiling torch_xla/csrc/tensor_util.cpp; 104s local 2025-03-14T05:54:49.7288670Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2025-03-14T05:54:49.7289278Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T05:54:49.7289881Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2025-03-14T05:54:49.7290845Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local 2025-03-14T05:54:49.7291570Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 26s local 2025-03-14T05:54:49.7292234Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local 2025-03-14T05:54:49.7292813Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local ... 2025-03-14T05:54:50.0896833Z 2025-03-14T05:54:50.0897668Z  2025-03-14T05:54:50.0898152Z  2025-03-14T05:54:50.0898543Z  2025-03-14T05:54:50.0898926Z  2025-03-14T05:54:50.0899280Z  2025-03-14T05:54:50.0899587Z  2025-03-14T05:54:50.0899888Z  2025-03-14T05:54:50.0900220Z  2025-03-14T05:54:50.0900661Z [15,174 / 15,235] 48 actions running 2025-03-14T05:54:50.0901239Z Compiling torch_xla/csrc/tensor_util.cpp; 104s local 2025-03-14T05:54:50.0901796Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2025-03-14T05:54:50.0902348Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T05:54:50.0903034Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2025-03-14T05:54:50.0903682Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local 2025-03-14T05:54:50.0904393Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 26s local 2025-03-14T05:54:50.0905458Z Compiling torch_xla/csrc/ops/nonzero.cpp; 26s local 2025-03-14T05:54:50.0906168Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local ... 2025-03-14T05:54:51.0904329Z 2025-03-14T05:54:51.0905194Z  2025-03-14T05:54:51.0905680Z  2025-03-14T05:54:51.0906068Z  2025-03-14T05:54:51.0906474Z  2025-03-14T05:54:51.0906877Z  2025-03-14T05:54:51.0907265Z  2025-03-14T05:54:51.0907644Z  2025-03-14T05:54:51.0908001Z  2025-03-14T05:54:51.0908442Z [15,174 / 15,235] 48 actions running 2025-03-14T05:54:51.0909017Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T05:54:51.0909577Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2025-03-14T05:54:51.0910139Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2025-03-14T05:54:51.0910726Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2025-03-14T05:54:51.0911349Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 28s local 2025-03-14T05:54:51.0912086Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 27s local 2025-03-14T05:54:51.0912758Z Compiling torch_xla/csrc/ops/nonzero.cpp; 27s local 2025-03-14T05:54:51.0913303Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local ... 2025-03-14T05:54:51.4671958Z 2025-03-14T05:54:51.4672715Z  2025-03-14T05:54:51.4673121Z  2025-03-14T05:54:51.4673727Z  2025-03-14T05:54:51.4674084Z  2025-03-14T05:54:51.4674434Z  2025-03-14T05:54:51.4674774Z  2025-03-14T05:54:51.4675099Z  2025-03-14T05:54:51.4675446Z  2025-03-14T05:54:51.4675959Z [15,176 / 15,235] 48 actions, 47 running 2025-03-14T05:54:51.4676618Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T05:54:51.4677401Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2025-03-14T05:54:51.4678350Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2025-03-14T05:54:51.4679187Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 28s local 2025-03-14T05:54:51.4679947Z Compiling torch_xla/csrc/ops/nonzero.cpp; 27s local 2025-03-14T05:54:51.4680588Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2025-03-14T05:54:51.4681238Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2025-03-14T05:54:51.4682030Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local ... 2025-03-14T05:54:51.8989083Z 2025-03-14T05:54:51.8990091Z  2025-03-14T05:54:51.8990601Z  2025-03-14T05:54:51.8990995Z  2025-03-14T05:54:51.8991378Z  2025-03-14T05:54:51.8991777Z  2025-03-14T05:54:51.8992173Z  2025-03-14T05:54:51.8992730Z  2025-03-14T05:54:51.8993097Z  2025-03-14T05:54:51.8993672Z [15,177 / 15,235] 48 actions, 47 running 2025-03-14T05:54:51.8994660Z Compiling torch_xla/csrc/tensor_util.cpp; 106s local 2025-03-14T05:54:51.8995473Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2025-03-14T05:54:51.8996307Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 28s local 2025-03-14T05:54:51.8997115Z Compiling torch_xla/csrc/ops/nonzero.cpp; 28s local 2025-03-14T05:54:51.8997788Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2025-03-14T05:54:51.8998491Z Compiling torch_xla/csrc/ops/normal.cpp; 27s local 2025-03-14T05:54:51.8999237Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local 2025-03-14T05:54:51.9000008Z Compiling torch_xla/csrc/ops/ops.cpp; 24s local ... 2025-03-14T05:54:52.2993060Z 2025-03-14T05:54:52.2993970Z  2025-03-14T05:54:52.2994459Z  2025-03-14T05:54:52.2994824Z  2025-03-14T05:54:52.2995149Z  2025-03-14T05:54:52.2995479Z  2025-03-14T05:54:52.2995796Z  2025-03-14T05:54:52.2996118Z  2025-03-14T05:54:52.2996473Z  2025-03-14T05:54:52.2996933Z [15,177 / 15,235] 48 actions running 2025-03-14T05:54:52.2997550Z Compiling torch_xla/csrc/tensor_util.cpp; 106s local 2025-03-14T05:54:52.2998500Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2025-03-14T05:54:52.2999211Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 28s local 2025-03-14T05:54:52.2999873Z Compiling torch_xla/csrc/ops/nonzero.cpp; 28s local 2025-03-14T05:54:52.3000440Z Compiling torch_xla/csrc/ops/nms.cpp; 28s local 2025-03-14T05:54:52.3001025Z Compiling torch_xla/csrc/ops/normal.cpp; 27s local 2025-03-14T05:54:52.3001778Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local 2025-03-14T05:54:52.3003102Z Compiling torch_xla/csrc/ops/ops.cpp; 24s local ... 2025-03-14T05:54:53.3000761Z 2025-03-14T05:54:53.3001816Z  2025-03-14T05:54:53.3002342Z  2025-03-14T05:54:53.3002780Z  2025-03-14T05:54:53.3003468Z  2025-03-14T05:54:53.3003898Z  2025-03-14T05:54:53.3004506Z  2025-03-14T05:54:53.3005330Z  2025-03-14T05:54:53.3005852Z  2025-03-14T05:54:53.3006569Z [15,177 / 15,235] 48 actions running 2025-03-14T05:54:53.3007498Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2025-03-14T05:54:53.3008495Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 30s local 2025-03-14T05:54:53.3009600Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2025-03-14T05:54:53.3010621Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2025-03-14T05:54:53.3011501Z Compiling torch_xla/csrc/ops/nms.cpp; 29s local 2025-03-14T05:54:53.3012694Z Compiling torch_xla/csrc/ops/normal.cpp; 28s local 2025-03-14T05:54:53.3013713Z Compiling torch_xla/csrc/ops/not_supported.cpp; 25s local 2025-03-14T05:54:53.3014693Z Compiling torch_xla/csrc/ops/ops.cpp; 25s local ... 2025-03-14T05:54:54.1007277Z 2025-03-14T05:54:54.1008269Z  2025-03-14T05:54:54.1008770Z  2025-03-14T05:54:54.1009233Z  2025-03-14T05:54:54.1009662Z  2025-03-14T05:54:54.1010091Z  2025-03-14T05:54:54.1010508Z  2025-03-14T05:54:54.1011164Z  2025-03-14T05:54:54.1011611Z  2025-03-14T05:54:54.1012115Z [15,178 / 15,235] 47 actions running 2025-03-14T05:54:54.1012768Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2025-03-14T05:54:54.1013496Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local 2025-03-14T05:54:54.1014209Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2025-03-14T05:54:54.1014823Z Compiling torch_xla/csrc/ops/nms.cpp; 29s local 2025-03-14T05:54:54.1015635Z Compiling torch_xla/csrc/ops/normal.cpp; 29s local 2025-03-14T05:54:54.1016335Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2025-03-14T05:54:54.1017448Z Compiling torch_xla/csrc/ops/ops.cpp; 26s local 2025-03-14T05:54:54.1018139Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 26s local ... 2025-03-14T05:54:54.3010695Z 2025-03-14T05:54:54.3012683Z  2025-03-14T05:54:54.3013156Z  2025-03-14T05:54:54.3013573Z  2025-03-14T05:54:54.3013995Z  2025-03-14T05:54:54.3014428Z  2025-03-14T05:54:54.3014854Z  2025-03-14T05:54:54.3015284Z  2025-03-14T05:54:54.3015685Z  2025-03-14T05:54:54.3016248Z [15,178 / 15,235] 48 actions running 2025-03-14T05:54:54.3017012Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2025-03-14T05:54:54.3017909Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local 2025-03-14T05:54:54.3018796Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2025-03-14T05:54:54.3019562Z Compiling torch_xla/csrc/ops/nms.cpp; 30s local 2025-03-14T05:54:54.3020329Z Compiling torch_xla/csrc/ops/normal.cpp; 29s local 2025-03-14T05:54:54.3021172Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2025-03-14T05:54:54.3022041Z Compiling torch_xla/csrc/ops/ops.cpp; 26s local 2025-03-14T05:54:54.3022857Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 26s local ... 2025-03-14T05:54:55.5018675Z 2025-03-14T05:54:55.5019616Z  2025-03-14T05:54:55.5020103Z  2025-03-14T05:54:55.5020827Z  2025-03-14T05:54:55.5021387Z  2025-03-14T05:54:55.5022227Z  2025-03-14T05:54:55.5022737Z  2025-03-14T05:54:55.5023257Z  2025-03-14T05:54:55.5023756Z  2025-03-14T05:54:55.5024459Z [15,178 / 15,235] 48 actions running 2025-03-14T05:54:55.5025337Z Compiling torch_xla/csrc/tensor_util.cpp; 110s local 2025-03-14T05:54:55.5026330Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 32s local 2025-03-14T05:54:55.5027290Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2025-03-14T05:54:55.5028127Z Compiling torch_xla/csrc/ops/nms.cpp; 31s local 2025-03-14T05:54:55.5028965Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2025-03-14T05:54:55.5029898Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local 2025-03-14T05:54:55.5030937Z Compiling torch_xla/csrc/ops/ops.cpp; 27s local 2025-03-14T05:54:55.5031856Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 27s local ... 2025-03-14T05:54:55.9728338Z 2025-03-14T05:54:55.9729202Z  2025-03-14T05:54:55.9729697Z  2025-03-14T05:54:55.9730106Z  2025-03-14T05:54:55.9730477Z  2025-03-14T05:54:55.9730891Z  2025-03-14T05:54:55.9731273Z  2025-03-14T05:54:55.9731688Z  2025-03-14T05:54:55.9732064Z  2025-03-14T05:54:55.9732635Z [15,179 / 15,235] 48 actions, 47 running 2025-03-14T05:54:55.9733354Z Compiling torch_xla/csrc/tensor_util.cpp; 110s local 2025-03-14T05:54:55.9734486Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 32s local 2025-03-14T05:54:55.9735316Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2025-03-14T05:54:55.9736535Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2025-03-14T05:54:55.9737459Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local 2025-03-14T05:54:55.9738542Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T05:54:55.9739523Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2025-03-14T05:54:55.9740718Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local ... 2025-03-14T05:54:56.2156272Z 2025-03-14T05:54:56.2157126Z  2025-03-14T05:54:56.2157585Z  2025-03-14T05:54:56.2157942Z  2025-03-14T05:54:56.2158306Z  2025-03-14T05:54:56.2158626Z  2025-03-14T05:54:56.2158936Z  2025-03-14T05:54:56.2159307Z  2025-03-14T05:54:56.2159687Z  2025-03-14T05:54:56.2160245Z [15,180 / 15,235] 48 actions, 47 running 2025-03-14T05:54:56.2160996Z Compiling torch_xla/csrc/tensor_util.cpp; 110s local 2025-03-14T05:54:56.2161804Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 32s local 2025-03-14T05:54:56.2162627Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2025-03-14T05:54:56.2163455Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local 2025-03-14T05:54:56.2164679Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T05:54:56.2165590Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2025-03-14T05:54:56.2166496Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local 2025-03-14T05:54:56.2167373Z Compiling torch_xla/csrc/ops/permute.cpp; 25s local ... 2025-03-14T05:54:56.5026041Z 2025-03-14T05:54:56.5026880Z  2025-03-14T05:54:56.5027366Z  2025-03-14T05:54:56.5027748Z  2025-03-14T05:54:56.5028124Z  2025-03-14T05:54:56.5028509Z  2025-03-14T05:54:56.5028895Z  2025-03-14T05:54:56.5029244Z  2025-03-14T05:54:56.5029624Z  2025-03-14T05:54:56.5030164Z [15,180 / 15,235] 48 actions running 2025-03-14T05:54:56.5030849Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2025-03-14T05:54:56.5031683Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 33s local 2025-03-14T05:54:56.5032540Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2025-03-14T05:54:56.5033392Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2025-03-14T05:54:56.5034167Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T05:54:56.5034924Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2025-03-14T05:54:56.5036579Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 26s local 2025-03-14T05:54:56.5037466Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local ... 2025-03-14T05:54:57.0438511Z 2025-03-14T05:54:57.0439362Z  2025-03-14T05:54:57.0439850Z  2025-03-14T05:54:57.0440246Z  2025-03-14T05:54:57.0440643Z  2025-03-14T05:54:57.0441454Z  2025-03-14T05:54:57.0442041Z  2025-03-14T05:54:57.0442574Z  2025-03-14T05:54:57.0443083Z  2025-03-14T05:54:57.0443767Z [15,181 / 15,235] 48 actions, 47 running 2025-03-14T05:54:57.0444726Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2025-03-14T05:54:57.0445616Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2025-03-14T05:54:57.0446572Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2025-03-14T05:54:57.0447543Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2025-03-14T05:54:57.0448407Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2025-03-14T05:54:57.0449399Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2025-03-14T05:54:57.0450428Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local 2025-03-14T05:54:57.0451307Z Compiling torch_xla/csrc/ops/prod.cpp; 26s local ... 2025-03-14T05:54:57.3033295Z 2025-03-14T05:54:57.3034190Z  2025-03-14T05:54:57.3034637Z  2025-03-14T05:54:57.3035302Z  2025-03-14T05:54:57.3035658Z  2025-03-14T05:54:57.3036010Z  2025-03-14T05:54:57.3036376Z  2025-03-14T05:54:57.3036735Z  2025-03-14T05:54:57.3037094Z  2025-03-14T05:54:57.3037640Z [15,181 / 15,235] 48 actions running 2025-03-14T05:54:57.3038397Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2025-03-14T05:54:57.3039228Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2025-03-14T05:54:57.3040175Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2025-03-14T05:54:57.3040892Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2025-03-14T05:54:57.3041639Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2025-03-14T05:54:57.3042497Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2025-03-14T05:54:57.3043325Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local 2025-03-14T05:54:57.3044032Z Compiling torch_xla/csrc/ops/prod.cpp; 26s local ... 2025-03-14T05:54:58.3041563Z 2025-03-14T05:54:58.3042454Z  2025-03-14T05:54:58.3042859Z  2025-03-14T05:54:58.3043212Z  2025-03-14T05:54:58.3043565Z  2025-03-14T05:54:58.3043926Z  2025-03-14T05:54:58.3044269Z  2025-03-14T05:54:58.3044771Z  2025-03-14T05:54:58.3045129Z  2025-03-14T05:54:58.3045640Z [15,181 / 15,235] 48 actions running 2025-03-14T05:54:58.3046598Z Compiling torch_xla/csrc/tensor_util.cpp; 112s local 2025-03-14T05:54:58.3047330Z Compiling torch_xla/csrc/ops/nonzero.cpp; 34s local 2025-03-14T05:54:58.3048068Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2025-03-14T05:54:58.3049297Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2025-03-14T05:54:58.3050143Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2025-03-14T05:54:58.3051033Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local 2025-03-14T05:54:58.3051956Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2025-03-14T05:54:58.3052827Z Compiling torch_xla/csrc/ops/prod.cpp; 27s local ... 2025-03-14T05:54:58.6141749Z 2025-03-14T05:54:58.6142712Z  2025-03-14T05:54:58.6143244Z  2025-03-14T05:54:58.6143662Z  2025-03-14T05:54:58.6144096Z  2025-03-14T05:54:58.6144494Z  2025-03-14T05:54:58.6144901Z  2025-03-14T05:54:58.6145327Z  2025-03-14T05:54:58.6145755Z  2025-03-14T05:54:58.6146406Z [15,182 / 15,235] 48 actions, 47 running 2025-03-14T05:54:58.6147204Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2025-03-14T05:54:58.6148118Z Compiling torch_xla/csrc/ops/not_supported.cpp; 31s local 2025-03-14T05:54:58.6149226Z Compiling torch_xla/csrc/ops/ops.cpp; 31s local 2025-03-14T05:54:58.6149985Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2025-03-14T05:54:58.6150888Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2025-03-14T05:54:58.6151808Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2025-03-14T05:54:58.6152636Z Compiling torch_xla/csrc/ops/prod.cpp; 28s local 2025-03-14T05:54:58.6153418Z Compiling torch_xla/csrc/ops/put.cpp; 27s local ... 2025-03-14T05:54:58.9047557Z 2025-03-14T05:54:58.9048783Z  2025-03-14T05:54:58.9049273Z  2025-03-14T05:54:58.9049673Z  2025-03-14T05:54:58.9050119Z  2025-03-14T05:54:58.9050506Z  2025-03-14T05:54:58.9050955Z  2025-03-14T05:54:58.9051345Z  2025-03-14T05:54:58.9051738Z  2025-03-14T05:54:58.9052286Z [15,182 / 15,235] 48 actions running 2025-03-14T05:54:58.9053016Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2025-03-14T05:54:58.9053784Z Compiling torch_xla/csrc/ops/not_supported.cpp; 31s local 2025-03-14T05:54:58.9054523Z Compiling torch_xla/csrc/ops/ops.cpp; 31s local 2025-03-14T05:54:58.9055278Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2025-03-14T05:54:58.9056217Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2025-03-14T05:54:58.9057427Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2025-03-14T05:54:58.9058248Z Compiling torch_xla/csrc/ops/prod.cpp; 28s local 2025-03-14T05:54:58.9058958Z Compiling torch_xla/csrc/ops/put.cpp; 28s local ... 2025-03-14T05:54:59.1625520Z 2025-03-14T05:54:59.1626399Z  2025-03-14T05:54:59.1627063Z  2025-03-14T05:54:59.1627534Z  2025-03-14T05:54:59.1628028Z  2025-03-14T05:54:59.1628509Z  2025-03-14T05:54:59.1629009Z  2025-03-14T05:54:59.1629502Z  2025-03-14T05:54:59.1630252Z  2025-03-14T05:54:59.1631008Z [15,183 / 15,235] 48 actions, 47 running 2025-03-14T05:54:59.1631900Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2025-03-14T05:54:59.1632765Z Compiling torch_xla/csrc/ops/ops.cpp; 31s local 2025-03-14T05:54:59.1633769Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2025-03-14T05:54:59.1634782Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2025-03-14T05:54:59.1635792Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2025-03-14T05:54:59.1636649Z Compiling torch_xla/csrc/ops/prod.cpp; 28s local 2025-03-14T05:54:59.1637483Z Compiling torch_xla/csrc/ops/put.cpp; 28s local 2025-03-14T05:54:59.1638323Z Compiling torch_xla/csrc/ops/qr.cpp; 27s local ... 2025-03-14T05:54:59.5054089Z 2025-03-14T05:54:59.5055022Z  2025-03-14T05:54:59.5055796Z  2025-03-14T05:54:59.5056181Z  2025-03-14T05:54:59.5056584Z  2025-03-14T05:54:59.5056959Z  2025-03-14T05:54:59.5057398Z  2025-03-14T05:54:59.5057790Z  2025-03-14T05:54:59.5058162Z  2025-03-14T05:54:59.5058714Z [15,183 / 15,235] 48 actions running 2025-03-14T05:54:59.5059415Z Compiling torch_xla/csrc/tensor_util.cpp; 114s local 2025-03-14T05:54:59.5060158Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2025-03-14T05:54:59.5060911Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2025-03-14T05:54:59.5061766Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2025-03-14T05:54:59.5062564Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2025-03-14T05:54:59.5063289Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local 2025-03-14T05:54:59.5063998Z Compiling torch_xla/csrc/ops/put.cpp; 28s local 2025-03-14T05:54:59.5064709Z Compiling torch_xla/csrc/ops/qr.cpp; 28s local ... 2025-03-14T05:55:00.5061113Z 2025-03-14T05:55:00.5062349Z  2025-03-14T05:55:00.5062871Z  2025-03-14T05:55:00.5063251Z  2025-03-14T05:55:00.5063675Z  2025-03-14T05:55:00.5064073Z  2025-03-14T05:55:00.5064797Z  2025-03-14T05:55:00.5065176Z  2025-03-14T05:55:00.5065806Z  2025-03-14T05:55:00.5066353Z [15,183 / 15,235] 48 actions running 2025-03-14T05:55:00.5067090Z Compiling torch_xla/csrc/tensor_util.cpp; 115s local 2025-03-14T05:55:00.5067804Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2025-03-14T05:55:00.5068583Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 32s local 2025-03-14T05:55:00.5069511Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2025-03-14T05:55:00.5070488Z Compiling torch_xla/csrc/ops/permute.cpp; 30s local 2025-03-14T05:55:00.5071323Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2025-03-14T05:55:00.5072035Z Compiling torch_xla/csrc/ops/put.cpp; 29s local 2025-03-14T05:55:00.5072767Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local ... 2025-03-14T05:55:01.5068712Z 2025-03-14T05:55:01.5069513Z  2025-03-14T05:55:01.5070092Z  2025-03-14T05:55:01.5070559Z  2025-03-14T05:55:01.5071038Z  2025-03-14T05:55:01.5071500Z  2025-03-14T05:55:01.5071973Z  2025-03-14T05:55:01.5072435Z  2025-03-14T05:55:01.5072886Z  2025-03-14T05:55:01.5073534Z [15,183 / 15,235] 48 actions running 2025-03-14T05:55:01.5074431Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2025-03-14T05:55:01.5075334Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2025-03-14T05:55:01.5076573Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2025-03-14T05:55:01.5077693Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 31s local 2025-03-14T05:55:01.5078764Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2025-03-14T05:55:01.5079664Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2025-03-14T05:55:01.5080538Z Compiling torch_xla/csrc/ops/put.cpp; 30s local 2025-03-14T05:55:01.5081431Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local ... 2025-03-14T05:55:02.2835495Z 2025-03-14T05:55:02.2836401Z  2025-03-14T05:55:02.2836930Z  2025-03-14T05:55:02.2837325Z  2025-03-14T05:55:02.2837726Z  2025-03-14T05:55:02.2838118Z  2025-03-14T05:55:02.2838492Z  2025-03-14T05:55:02.2838890Z  2025-03-14T05:55:02.2839293Z  2025-03-14T05:55:02.2839873Z [15,184 / 15,235] 48 actions, 47 running 2025-03-14T05:55:02.2840618Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2025-03-14T05:55:02.2841381Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2025-03-14T05:55:02.2842181Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2025-03-14T05:55:02.2843061Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2025-03-14T05:55:02.2843923Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2025-03-14T05:55:02.2844806Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2025-03-14T05:55:02.2845815Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local 2025-03-14T05:55:02.2846598Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local ... 2025-03-14T05:55:02.4926177Z 2025-03-14T05:55:02.4929424Z  2025-03-14T05:55:02.4929850Z  2025-03-14T05:55:02.4930198Z  2025-03-14T05:55:02.4930607Z  2025-03-14T05:55:02.4930994Z  2025-03-14T05:55:02.4931340Z  2025-03-14T05:55:02.4931664Z  2025-03-14T05:55:02.4932005Z  2025-03-14T05:55:02.4932600Z [15,185 / 15,235] 48 actions, 47 running 2025-03-14T05:55:02.4933375Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2025-03-14T05:55:02.4934050Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2025-03-14T05:55:02.4934692Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2025-03-14T05:55:02.4935471Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2025-03-14T05:55:02.4936178Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2025-03-14T05:55:02.4936772Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2025-03-14T05:55:02.4937453Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2025-03-14T05:55:02.4938434Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local ... 2025-03-14T05:55:02.7078126Z 2025-03-14T05:55:02.7078999Z  2025-03-14T05:55:02.7079494Z  2025-03-14T05:55:02.7079867Z  2025-03-14T05:55:02.7080271Z  2025-03-14T05:55:02.7080675Z  2025-03-14T05:55:02.7081076Z  2025-03-14T05:55:02.7081472Z  2025-03-14T05:55:02.7081861Z  2025-03-14T05:55:02.7082455Z [15,185 / 15,235] 48 actions running 2025-03-14T05:55:02.7083212Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2025-03-14T05:55:02.7083954Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2025-03-14T05:55:02.7084925Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2025-03-14T05:55:02.7085957Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2025-03-14T05:55:02.7086944Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2025-03-14T05:55:02.7087690Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2025-03-14T05:55:02.7088422Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2025-03-14T05:55:02.7089175Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local ... 2025-03-14T05:55:03.1833443Z 2025-03-14T05:55:03.1834689Z  2025-03-14T05:55:03.1835194Z  2025-03-14T05:55:03.1835599Z  2025-03-14T05:55:03.1835974Z  2025-03-14T05:55:03.1836364Z  2025-03-14T05:55:03.1836746Z  2025-03-14T05:55:03.1837437Z  2025-03-14T05:55:03.1837856Z  2025-03-14T05:55:03.1838434Z [15,186 / 15,235] 48 actions, 47 running 2025-03-14T05:55:03.1839175Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2025-03-14T05:55:03.1839920Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2025-03-14T05:55:03.1840656Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2025-03-14T05:55:03.1841601Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2025-03-14T05:55:03.1842662Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2025-03-14T05:55:03.1843455Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2025-03-14T05:55:03.1844287Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local 2025-03-14T05:55:03.1845231Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local ... 2025-03-14T05:55:03.5084280Z 2025-03-14T05:55:03.5085296Z  2025-03-14T05:55:03.5086817Z  2025-03-14T05:55:03.5087672Z  2025-03-14T05:55:03.5088318Z  2025-03-14T05:55:03.5088718Z  2025-03-14T05:55:03.5089068Z  2025-03-14T05:55:03.5089414Z  2025-03-14T05:55:03.5089742Z  2025-03-14T05:55:03.5090231Z [15,187 / 15,235] 47 actions running 2025-03-14T05:55:03.5090871Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2025-03-14T05:55:03.5091536Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2025-03-14T05:55:03.5092501Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2025-03-14T05:55:03.5093297Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2025-03-14T05:55:03.5094073Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2025-03-14T05:55:03.5094719Z Compiling torch_xla/csrc/ops/randperm.cpp; 31s local 2025-03-14T05:55:03.5095381Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local 2025-03-14T05:55:03.5096090Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local ... 2025-03-14T05:55:03.9087568Z 2025-03-14T05:55:03.9088780Z  2025-03-14T05:55:03.9089222Z  2025-03-14T05:55:03.9089618Z  2025-03-14T05:55:03.9089958Z  2025-03-14T05:55:03.9090307Z  2025-03-14T05:55:03.9090656Z  2025-03-14T05:55:03.9091017Z  2025-03-14T05:55:03.9091393Z  2025-03-14T05:55:03.9091980Z [15,189 / 15,235] 45 actions running 2025-03-14T05:55:03.9092677Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2025-03-14T05:55:03.9093360Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2025-03-14T05:55:03.9094290Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2025-03-14T05:55:03.9095353Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2025-03-14T05:55:03.9096024Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2025-03-14T05:55:03.9096778Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local 2025-03-14T05:55:03.9097630Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 29s local 2025-03-14T05:55:03.9098606Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local ... 2025-03-14T05:55:04.1091177Z 2025-03-14T05:55:04.1091941Z  2025-03-14T05:55:04.1092367Z  2025-03-14T05:55:04.1092754Z  2025-03-14T05:55:04.1093083Z  2025-03-14T05:55:04.1093456Z  2025-03-14T05:55:04.1093824Z  2025-03-14T05:55:04.1094187Z  2025-03-14T05:55:04.1094544Z  2025-03-14T05:55:04.1095052Z [15,190 / 15,235] 44 actions running 2025-03-14T05:55:04.1095734Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2025-03-14T05:55:04.1096444Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2025-03-14T05:55:04.1097149Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2025-03-14T05:55:04.1097834Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2025-03-14T05:55:04.1098565Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local 2025-03-14T05:55:04.1099319Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2025-03-14T05:55:04.1100432Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local 2025-03-14T05:55:04.1101287Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 28s local ... 2025-03-14T05:55:05.3102695Z 2025-03-14T05:55:05.3103527Z  2025-03-14T05:55:05.3103985Z  2025-03-14T05:55:05.3104358Z  2025-03-14T05:55:05.3104719Z  2025-03-14T05:55:05.3105266Z  2025-03-14T05:55:05.3105645Z  2025-03-14T05:55:05.3106070Z  2025-03-14T05:55:05.3106452Z  2025-03-14T05:55:05.3107020Z [15,190 / 15,235] 44 actions running 2025-03-14T05:55:05.3108058Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2025-03-14T05:55:05.3108830Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2025-03-14T05:55:05.3109596Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2025-03-14T05:55:05.3110366Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2025-03-14T05:55:05.3111176Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 32s local 2025-03-14T05:55:05.3112088Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 31s local 2025-03-14T05:55:05.3113021Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2025-03-14T05:55:05.3113774Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 29s local ... 2025-03-14T05:55:05.9108662Z 2025-03-14T05:55:05.9109527Z  2025-03-14T05:55:05.9110030Z  2025-03-14T05:55:05.9110430Z  2025-03-14T05:55:05.9111139Z  2025-03-14T05:55:05.9111548Z  2025-03-14T05:55:05.9111952Z  2025-03-14T05:55:05.9112366Z  2025-03-14T05:55:05.9112784Z  2025-03-14T05:55:05.9113384Z [15,192 / 15,235] 42 actions running 2025-03-14T05:55:05.9114317Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2025-03-14T05:55:05.9115040Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2025-03-14T05:55:05.9115774Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 38s local 2025-03-14T05:55:05.9116464Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2025-03-14T05:55:05.9117382Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2025-03-14T05:55:05.9118362Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2025-03-14T05:55:05.9119370Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 28s local 2025-03-14T05:55:05.9120312Z Compiling torch_xla/csrc/ops/resize.cpp; 28s local ... 2025-03-14T05:55:06.3113088Z 2025-03-14T05:55:06.3113965Z  2025-03-14T05:55:06.3114446Z  2025-03-14T05:55:06.3114850Z  2025-03-14T05:55:06.3115249Z  2025-03-14T05:55:06.3115631Z  2025-03-14T05:55:06.3115987Z  2025-03-14T05:55:06.3116697Z  2025-03-14T05:55:06.3117097Z  2025-03-14T05:55:06.3117642Z [15,193 / 15,235] 41 actions running 2025-03-14T05:55:06.3118389Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2025-03-14T05:55:06.3119111Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2025-03-14T05:55:06.3119806Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2025-03-14T05:55:06.3120685Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2025-03-14T05:55:06.3121654Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2025-03-14T05:55:06.3122539Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2025-03-14T05:55:06.3123377Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2025-03-14T05:55:06.3124137Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local ... 2025-03-14T05:55:06.9118307Z 2025-03-14T05:55:06.9119080Z  2025-03-14T05:55:06.9119511Z  2025-03-14T05:55:06.9119838Z  2025-03-14T05:55:06.9120148Z  2025-03-14T05:55:06.9120442Z  2025-03-14T05:55:06.9120733Z  2025-03-14T05:55:06.9121025Z  2025-03-14T05:55:06.9121317Z  2025-03-14T05:55:06.9121746Z [15,194 / 15,235] 40 actions running 2025-03-14T05:55:06.9122411Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2025-03-14T05:55:06.9133192Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2025-03-14T05:55:06.9134280Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2025-03-14T05:55:06.9135107Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2025-03-14T05:55:06.9136031Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2025-03-14T05:55:06.9136904Z Compiling torch_xla/csrc/ops/resize.cpp; 29s local 2025-03-14T05:55:06.9137617Z Compiling torch_xla/csrc/ops/roll.cpp; 29s local 2025-03-14T05:55:06.9138481Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 29s local ... 2025-03-14T05:55:07.3120305Z 2025-03-14T05:55:07.3121104Z  2025-03-14T05:55:07.3121675Z  2025-03-14T05:55:07.3122069Z  2025-03-14T05:55:07.3122465Z  2025-03-14T05:55:07.3122851Z  2025-03-14T05:55:07.3123256Z  2025-03-14T05:55:07.3123620Z  2025-03-14T05:55:07.3124013Z  2025-03-14T05:55:07.3124668Z [15,195 / 15,235] 39 actions running 2025-03-14T05:55:07.3125551Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2025-03-14T05:55:07.3126325Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2025-03-14T05:55:07.3127103Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2025-03-14T05:55:07.3127803Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2025-03-14T05:55:07.3128646Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2025-03-14T05:55:07.3129586Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2025-03-14T05:55:07.3130281Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2025-03-14T05:55:07.3131214Z Compiling torch_xla/csrc/ops/scalar.cpp; 28s local ... 2025-03-14T05:55:07.7122935Z 2025-03-14T05:55:07.7123720Z  2025-03-14T05:55:07.7124121Z  2025-03-14T05:55:07.7124463Z  2025-03-14T05:55:07.7124955Z  2025-03-14T05:55:07.7125294Z  2025-03-14T05:55:07.7125625Z  2025-03-14T05:55:07.7125959Z  2025-03-14T05:55:07.7126299Z  2025-03-14T05:55:07.7126792Z [15,196 / 15,235] 38 actions running 2025-03-14T05:55:07.7127443Z Compiling torch_xla/csrc/tensor_util.cpp; 122s local 2025-03-14T05:55:07.7128075Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2025-03-14T05:55:07.7128812Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2025-03-14T05:55:07.7129575Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2025-03-14T05:55:07.7130210Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2025-03-14T05:55:07.7130907Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2025-03-14T05:55:07.7131599Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2025-03-14T05:55:07.7132615Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local ... 2025-03-14T05:55:08.5128739Z 2025-03-14T05:55:08.5129511Z  2025-03-14T05:55:08.5129982Z  2025-03-14T05:55:08.5130353Z  2025-03-14T05:55:08.5130748Z  2025-03-14T05:55:08.5131128Z  2025-03-14T05:55:08.5131516Z  2025-03-14T05:55:08.5131888Z  2025-03-14T05:55:08.5132312Z  2025-03-14T05:55:08.5132837Z [15,197 / 15,235] 37 actions running 2025-03-14T05:55:08.5133611Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2025-03-14T05:55:08.5134353Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2025-03-14T05:55:08.5135202Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2025-03-14T05:55:08.5136112Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2025-03-14T05:55:08.5136929Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 31s local 2025-03-14T05:55:08.5137755Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2025-03-14T05:55:08.5138662Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2025-03-14T05:55:08.5139611Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local ... 2025-03-14T05:55:08.9132245Z 2025-03-14T05:55:08.9132967Z  2025-03-14T05:55:08.9133371Z  2025-03-14T05:55:08.9133714Z  2025-03-14T05:55:08.9134067Z  2025-03-14T05:55:08.9134631Z  2025-03-14T05:55:08.9134973Z  2025-03-14T05:55:08.9135333Z  2025-03-14T05:55:08.9135686Z  2025-03-14T05:55:08.9136176Z [15,200 / 15,235] 34 actions running 2025-03-14T05:55:08.9136844Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2025-03-14T05:55:08.9137517Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2025-03-14T05:55:08.9138187Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2025-03-14T05:55:08.9139130Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2025-03-14T05:55:08.9139920Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local 2025-03-14T05:55:08.9140633Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local 2025-03-14T05:55:08.9141425Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 26s local 2025-03-14T05:55:08.9142191Z Compiling torch_xla/csrc/ops/select.cpp; 26s local ... 2025-03-14T05:55:09.9139372Z 2025-03-14T05:55:09.9140194Z  2025-03-14T05:55:09.9140669Z  2025-03-14T05:55:09.9141105Z  2025-03-14T05:55:09.9141502Z  2025-03-14T05:55:09.9141890Z  2025-03-14T05:55:09.9142284Z  2025-03-14T05:55:09.9142682Z  2025-03-14T05:55:09.9143074Z  2025-03-14T05:55:09.9143618Z [15,201 / 15,235] 33 actions running 2025-03-14T05:55:09.9144378Z Compiling torch_xla/csrc/tensor_util.cpp; 124s local 2025-03-14T05:55:09.9145338Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2025-03-14T05:55:09.9146068Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2025-03-14T05:55:09.9146824Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2025-03-14T05:55:09.9147628Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2025-03-14T05:55:09.9148465Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local 2025-03-14T05:55:09.9149256Z Compiling torch_xla/csrc/ops/select.cpp; 27s local 2025-03-14T05:55:09.9150029Z Compiling torch_xla/csrc/ops/send.cpp; 26s local ... 2025-03-14T05:55:10.3143338Z 2025-03-14T05:55:10.3144139Z  2025-03-14T05:55:10.3144582Z  2025-03-14T05:55:10.3144964Z  2025-03-14T05:55:10.3145378Z  2025-03-14T05:55:10.3145760Z  2025-03-14T05:55:10.3146117Z  2025-03-14T05:55:10.3146459Z  2025-03-14T05:55:10.3146824Z  2025-03-14T05:55:10.3147378Z [15,202 / 15,235] 32 actions running 2025-03-14T05:55:10.3148105Z Compiling torch_xla/csrc/tensor_util.cpp; 124s local 2025-03-14T05:55:10.3148868Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2025-03-14T05:55:10.3149561Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2025-03-14T05:55:10.3150602Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2025-03-14T05:55:10.3151405Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 28s local 2025-03-14T05:55:10.3152188Z Compiling torch_xla/csrc/ops/select.cpp; 28s local 2025-03-14T05:55:10.3152915Z Compiling torch_xla/csrc/ops/send.cpp; 27s local 2025-03-14T05:55:10.3153739Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local ... 2025-03-14T05:55:11.3150985Z 2025-03-14T05:55:11.3151763Z  2025-03-14T05:55:11.3152240Z  2025-03-14T05:55:11.3152623Z  2025-03-14T05:55:11.3152999Z  2025-03-14T05:55:11.3153357Z  2025-03-14T05:55:11.3153745Z  2025-03-14T05:55:11.3154138Z  2025-03-14T05:55:11.3154518Z  2025-03-14T05:55:11.3155125Z [15,202 / 15,235] 32 actions running 2025-03-14T05:55:11.3155830Z Compiling torch_xla/csrc/tensor_util.cpp; 125s local 2025-03-14T05:55:11.3156559Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2025-03-14T05:55:11.3157314Z Compiling torch_xla/csrc/ops/scalar.cpp; 32s local 2025-03-14T05:55:11.3158079Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2025-03-14T05:55:11.3158868Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2025-03-14T05:55:11.3159629Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2025-03-14T05:55:11.3160655Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2025-03-14T05:55:11.3161497Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local ... 2025-03-14T05:55:11.7154410Z 2025-03-14T05:55:11.7155217Z  2025-03-14T05:55:11.7155680Z  2025-03-14T05:55:11.7156084Z  2025-03-14T05:55:11.7156482Z  2025-03-14T05:55:11.7156848Z  2025-03-14T05:55:11.7157252Z  2025-03-14T05:55:11.7157594Z  2025-03-14T05:55:11.7157964Z  2025-03-14T05:55:11.7158755Z [15,204 / 15,235] 30 actions running 2025-03-14T05:55:11.7159447Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2025-03-14T05:55:11.7160216Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2025-03-14T05:55:11.7161054Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2025-03-14T05:55:11.7161854Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2025-03-14T05:55:11.7162559Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2025-03-14T05:55:11.7163395Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2025-03-14T05:55:11.7164179Z Compiling torch_xla/csrc/ops/softmax.cpp; 27s local 2025-03-14T05:55:11.7165148Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 27s local ... 2025-03-14T05:55:12.1157829Z 2025-03-14T05:55:12.1158802Z  2025-03-14T05:55:12.1159270Z  2025-03-14T05:55:12.1159669Z  2025-03-14T05:55:12.1160346Z  2025-03-14T05:55:12.1160755Z  2025-03-14T05:55:12.1161160Z  2025-03-14T05:55:12.1161567Z  2025-03-14T05:55:12.1161992Z  2025-03-14T05:55:12.1162574Z [15,206 / 15,235] 28 actions running 2025-03-14T05:55:12.1163408Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2025-03-14T05:55:12.1164073Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2025-03-14T05:55:12.1164799Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2025-03-14T05:55:12.1165657Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2025-03-14T05:55:12.1166465Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2025-03-14T05:55:12.1167289Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local 2025-03-14T05:55:12.1168132Z Compiling torch_xla/csrc/ops/split.cpp; 27s local 2025-03-14T05:55:12.1168902Z Compiling torch_xla/csrc/ops/squeeze.cpp; 27s local ... 2025-03-14T05:55:12.7164083Z 2025-03-14T05:55:12.7165011Z  2025-03-14T05:55:12.7165801Z  2025-03-14T05:55:12.7166191Z  2025-03-14T05:55:12.7166539Z  2025-03-14T05:55:12.7166892Z  2025-03-14T05:55:12.7167278Z  2025-03-14T05:55:12.7167664Z  2025-03-14T05:55:12.7168292Z  2025-03-14T05:55:12.7168857Z [15,207 / 15,235] 27 actions running 2025-03-14T05:55:12.7169589Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2025-03-14T05:55:12.7170296Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2025-03-14T05:55:12.7170845Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2025-03-14T05:55:12.7171536Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2025-03-14T05:55:12.7172313Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local 2025-03-14T05:55:12.7173048Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2025-03-14T05:55:12.7173762Z Compiling torch_xla/csrc/ops/squeeze.cpp; 27s local 2025-03-14T05:55:12.7174461Z Compiling torch_xla/csrc/ops/stack.cpp; 27s local ... 2025-03-14T05:55:13.1168883Z 2025-03-14T05:55:13.1169682Z  2025-03-14T05:55:13.1170134Z  2025-03-14T05:55:13.1170505Z  2025-03-14T05:55:13.1170935Z  2025-03-14T05:55:13.1171329Z  2025-03-14T05:55:13.1171732Z  2025-03-14T05:55:13.1172080Z  2025-03-14T05:55:13.1172454Z  2025-03-14T05:55:13.1172985Z [15,209 / 15,235] 25 actions running 2025-03-14T05:55:13.1173638Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2025-03-14T05:55:13.1174290Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2025-03-14T05:55:13.1175244Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2025-03-14T05:55:13.1175984Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2025-03-14T05:55:13.1176664Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2025-03-14T05:55:13.1177412Z Compiling torch_xla/csrc/ops/stack.cpp; 27s local 2025-03-14T05:55:13.1178073Z Compiling torch_xla/csrc/ops/std.cpp; 26s local 2025-03-14T05:55:13.1178828Z Compiling torch_xla/csrc/ops/std_mean.cpp; 25s local ... 2025-03-14T05:55:13.7173358Z 2025-03-14T05:55:13.7174315Z  2025-03-14T05:55:13.7175029Z  2025-03-14T05:55:13.7175444Z  2025-03-14T05:55:13.7175838Z  2025-03-14T05:55:13.7176207Z  2025-03-14T05:55:13.7176584Z  2025-03-14T05:55:13.7176970Z  2025-03-14T05:55:13.7177334Z  2025-03-14T05:55:13.7177880Z [15,211 / 15,235] 23 actions running 2025-03-14T05:55:13.7178591Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2025-03-14T05:55:13.7179343Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2025-03-14T05:55:13.7180105Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2025-03-14T05:55:13.7180816Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local 2025-03-14T05:55:13.7181465Z Compiling torch_xla/csrc/ops/std.cpp; 26s local 2025-03-14T05:55:13.7182124Z Compiling torch_xla/csrc/ops/std_mean.cpp; 26s local 2025-03-14T05:55:13.7182787Z Compiling torch_xla/csrc/ops/sum.cpp; 25s local 2025-03-14T05:55:13.7183637Z Compiling torch_xla/csrc/ops/svd.cpp; 24s local ... 2025-03-14T05:55:14.3177985Z 2025-03-14T05:55:14.3178825Z  2025-03-14T05:55:14.3179278Z  2025-03-14T05:55:14.3179690Z  2025-03-14T05:55:14.3180089Z  2025-03-14T05:55:14.3180473Z  2025-03-14T05:55:14.3180872Z  2025-03-14T05:55:14.3181258Z  2025-03-14T05:55:14.3181662Z  2025-03-14T05:55:14.3182191Z [15,212 / 15,235] 22 actions running 2025-03-14T05:55:14.3182943Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2025-03-14T05:55:14.3183651Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2025-03-14T05:55:14.3184368Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2025-03-14T05:55:14.3185063Z Compiling torch_xla/csrc/ops/std.cpp; 27s local 2025-03-14T05:55:14.3185793Z Compiling torch_xla/csrc/ops/std_mean.cpp; 26s local 2025-03-14T05:55:14.3186568Z Compiling torch_xla/csrc/ops/sum.cpp; 26s local 2025-03-14T05:55:14.3187289Z Compiling torch_xla/csrc/ops/svd.cpp; 25s local 2025-03-14T05:55:14.3188024Z Compiling torch_xla/csrc/ops/symeig.cpp; 25s local ... 2025-03-14T05:55:14.7182337Z 2025-03-14T05:55:14.7183348Z  2025-03-14T05:55:14.7183808Z  2025-03-14T05:55:14.7184205Z  2025-03-14T05:55:14.7184593Z  2025-03-14T05:55:14.7184977Z  2025-03-14T05:55:14.7185394Z  2025-03-14T05:55:14.7185779Z  2025-03-14T05:55:14.7186168Z  2025-03-14T05:55:14.7186691Z [15,213 / 15,235] 21 actions running 2025-03-14T05:55:14.7187433Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2025-03-14T05:55:14.7188145Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2025-03-14T05:55:14.7188842Z Compiling torch_xla/csrc/ops/std.cpp; 27s local 2025-03-14T05:55:14.7189567Z Compiling torch_xla/csrc/ops/std_mean.cpp; 27s local 2025-03-14T05:55:14.7190281Z Compiling torch_xla/csrc/ops/sum.cpp; 26s local 2025-03-14T05:55:14.7190993Z Compiling torch_xla/csrc/ops/svd.cpp; 25s local 2025-03-14T05:55:14.7191699Z Compiling torch_xla/csrc/ops/symeig.cpp; 25s local 2025-03-14T05:55:14.7192489Z Compiling torch_xla/csrc/ops/threshold.cpp; 25s local ... 2025-03-14T05:55:15.3187643Z 2025-03-14T05:55:15.3188440Z  2025-03-14T05:55:15.3188823Z  2025-03-14T05:55:15.3189134Z  2025-03-14T05:55:15.3189440Z  2025-03-14T05:55:15.3189757Z  2025-03-14T05:55:15.3190060Z  2025-03-14T05:55:15.3190356Z  2025-03-14T05:55:15.3190664Z  2025-03-14T05:55:15.3191100Z [15,215 / 15,235] 19 actions running 2025-03-14T05:55:15.3191917Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2025-03-14T05:55:15.3192548Z Compiling torch_xla/csrc/ops/std_mean.cpp; 27s local 2025-03-14T05:55:15.3193111Z Compiling torch_xla/csrc/ops/sum.cpp; 27s local 2025-03-14T05:55:15.3193688Z Compiling torch_xla/csrc/ops/svd.cpp; 26s local 2025-03-14T05:55:15.3194232Z Compiling torch_xla/csrc/ops/symeig.cpp; 26s local 2025-03-14T05:55:15.3194836Z Compiling torch_xla/csrc/ops/threshold.cpp; 25s local 2025-03-14T05:55:15.3195590Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 25s local 2025-03-14T05:55:15.3196321Z Compiling torch_xla/csrc/ops/user_computation.cpp; 24s local ... 2025-03-14T05:55:15.5190505Z 2025-03-14T05:55:15.5191246Z  2025-03-14T05:55:15.5191646Z  2025-03-14T05:55:15.5191994Z  2025-03-14T05:55:15.5192339Z  2025-03-14T05:55:15.5192698Z  2025-03-14T05:55:15.5193050Z  2025-03-14T05:55:15.5193380Z  2025-03-14T05:55:15.5193688Z  2025-03-14T05:55:15.5194183Z [15,216 / 15,235] 18 actions running 2025-03-14T05:55:15.5194840Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2025-03-14T05:55:15.5195497Z Compiling torch_xla/csrc/ops/std_mean.cpp; 27s local 2025-03-14T05:55:15.5196133Z Compiling torch_xla/csrc/ops/sum.cpp; 27s local 2025-03-14T05:55:15.5196765Z Compiling torch_xla/csrc/ops/svd.cpp; 26s local 2025-03-14T05:55:15.5197624Z Compiling torch_xla/csrc/ops/symeig.cpp; 26s local 2025-03-14T05:55:15.5198335Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 25s local 2025-03-14T05:55:15.5199120Z Compiling torch_xla/csrc/ops/user_computation.cpp; 24s local 2025-03-14T05:55:15.5199855Z Compiling torch_xla/csrc/ops/topk.cpp; 23s local ... 2025-03-14T05:55:16.1196324Z 2025-03-14T05:55:16.1197109Z  2025-03-14T05:55:16.1197574Z  2025-03-14T05:55:16.1197944Z  2025-03-14T05:55:16.1198366Z  2025-03-14T05:55:16.1198739Z  2025-03-14T05:55:16.1199112Z  2025-03-14T05:55:16.1199524Z  2025-03-14T05:55:16.1199901Z  2025-03-14T05:55:16.1200453Z [15,217 / 15,235] 17 actions running 2025-03-14T05:55:16.1201155Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2025-03-14T05:55:16.1201918Z Compiling torch_xla/csrc/ops/std_mean.cpp; 28s local 2025-03-14T05:55:16.1202631Z Compiling torch_xla/csrc/ops/sum.cpp; 27s local 2025-03-14T05:55:16.1203324Z Compiling torch_xla/csrc/ops/svd.cpp; 27s local 2025-03-14T05:55:16.1204052Z Compiling torch_xla/csrc/ops/symeig.cpp; 26s local 2025-03-14T05:55:16.1204963Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 26s local 2025-03-14T05:55:16.1206042Z Compiling torch_xla/csrc/ops/topk.cpp; 24s local 2025-03-14T05:55:16.1206846Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 24s local ... 2025-03-14T05:55:16.3197121Z 2025-03-14T05:55:16.3197922Z  2025-03-14T05:55:16.3198384Z  2025-03-14T05:55:16.3198766Z  2025-03-14T05:55:16.3199143Z  2025-03-14T05:55:16.3199537Z  2025-03-14T05:55:16.3199919Z  2025-03-14T05:55:16.3200325Z  2025-03-14T05:55:16.3200704Z  2025-03-14T05:55:16.3201238Z [15,218 / 15,235] 16 actions running 2025-03-14T05:55:16.3201944Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2025-03-14T05:55:16.3202664Z Compiling torch_xla/csrc/ops/std_mean.cpp; 28s local 2025-03-14T05:55:16.3203416Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local 2025-03-14T05:55:16.3204134Z Compiling torch_xla/csrc/ops/symeig.cpp; 27s local 2025-03-14T05:55:16.3205090Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 26s local 2025-03-14T05:55:16.3205909Z Compiling torch_xla/csrc/ops/topk.cpp; 24s local 2025-03-14T05:55:16.3206687Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 24s local 2025-03-14T05:55:16.3207581Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 22s local ... 2025-03-14T05:55:16.7200572Z 2025-03-14T05:55:16.7201383Z  2025-03-14T05:55:16.7201873Z  2025-03-14T05:55:16.7202536Z  2025-03-14T05:55:16.7202947Z  2025-03-14T05:55:16.7203319Z  2025-03-14T05:55:16.7203688Z  2025-03-14T05:55:16.7204051Z  2025-03-14T05:55:16.7204419Z  2025-03-14T05:55:16.7205043Z [15,220 / 15,235] 14 actions running 2025-03-14T05:55:16.7205790Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2025-03-14T05:55:16.7206586Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2025-03-14T05:55:16.7207476Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local 2025-03-14T05:55:16.7208323Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 26s local 2025-03-14T05:55:16.7209320Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 24s local 2025-03-14T05:55:16.7210283Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 22s local 2025-03-14T05:55:16.7211115Z Compiling torch_xla/csrc/ops/uniform.cpp; 20s local 2025-03-14T05:55:16.7211949Z Compiling torch_xla/csrc/ops/unselect.cpp; 20s local ... 2025-03-14T05:55:17.1204679Z 2025-03-14T05:55:17.1205313Z  2025-03-14T05:55:17.1205612Z  2025-03-14T05:55:17.1205861Z  2025-03-14T05:55:17.1206101Z  2025-03-14T05:55:17.1206340Z  2025-03-14T05:55:17.1206578Z  2025-03-14T05:55:17.1206816Z  2025-03-14T05:55:17.1207058Z  2025-03-14T05:55:17.1207401Z [15,221 / 15,235] 13 actions running 2025-03-14T05:55:17.1208030Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2025-03-14T05:55:17.1208482Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2025-03-14T05:55:17.1208929Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local 2025-03-14T05:55:17.1209393Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 25s local 2025-03-14T05:55:17.1209906Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 22s local 2025-03-14T05:55:17.1210382Z Compiling torch_xla/csrc/ops/uniform.cpp; 21s local 2025-03-14T05:55:17.1210826Z Compiling torch_xla/csrc/ops/unselect.cpp; 20s local 2025-03-14T05:55:17.1211295Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 19s local ... 2025-03-14T05:55:17.3206930Z 2025-03-14T05:55:17.3207570Z  2025-03-14T05:55:17.3207865Z  2025-03-14T05:55:17.3208103Z  2025-03-14T05:55:17.3208350Z  2025-03-14T05:55:17.3208584Z  2025-03-14T05:55:17.3208818Z  2025-03-14T05:55:17.3209049Z  2025-03-14T05:55:17.3209314Z  2025-03-14T05:55:17.3209653Z [15,222 / 15,235] 12 actions running 2025-03-14T05:55:17.3210106Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2025-03-14T05:55:17.3210740Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2025-03-14T05:55:17.3211186Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 25s local 2025-03-14T05:55:17.3211694Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local 2025-03-14T05:55:17.3212166Z Compiling torch_xla/csrc/ops/uniform.cpp; 21s local 2025-03-14T05:55:17.3212605Z Compiling torch_xla/csrc/ops/unselect.cpp; 21s local 2025-03-14T05:55:17.3213061Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 20s local 2025-03-14T05:55:17.3213542Z Compiling torch_xla/csrc/ops/update_slice.cpp; 18s local ... 2025-03-14T05:55:17.7209345Z 2025-03-14T05:55:17.7209969Z  2025-03-14T05:55:17.7210286Z  2025-03-14T05:55:17.7210534Z  2025-03-14T05:55:17.7210773Z  2025-03-14T05:55:17.7211038Z  2025-03-14T05:55:17.7211271Z  2025-03-14T05:55:17.7211505Z  2025-03-14T05:55:17.7211737Z  2025-03-14T05:55:17.7212084Z [15,224 / 15,235] 10 actions running 2025-03-14T05:55:17.7212519Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2025-03-14T05:55:17.7212990Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local 2025-03-14T05:55:17.7213467Z Compiling torch_xla/csrc/ops/uniform.cpp; 21s local 2025-03-14T05:55:17.7213908Z Compiling torch_xla/csrc/ops/unselect.cpp; 21s local 2025-03-14T05:55:17.7214357Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 20s local 2025-03-14T05:55:17.7214999Z Compiling torch_xla/csrc/ops/update_slice.cpp; 19s local 2025-03-14T05:55:17.7215526Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 18s local 2025-03-14T05:55:17.7216091Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 15s local ... 2025-03-14T05:55:18.7215982Z 2025-03-14T05:55:18.7216599Z  2025-03-14T05:55:18.7216933Z  2025-03-14T05:55:18.7217226Z  2025-03-14T05:55:18.7217466Z  2025-03-14T05:55:18.7217703Z  2025-03-14T05:55:18.7217942Z  2025-03-14T05:55:18.7218361Z  2025-03-14T05:55:18.7218639Z  2025-03-14T05:55:18.7218988Z [15,224 / 15,235] 10 actions running 2025-03-14T05:55:18.7219411Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2025-03-14T05:55:18.7219882Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 24s local 2025-03-14T05:55:18.7220353Z Compiling torch_xla/csrc/ops/uniform.cpp; 22s local 2025-03-14T05:55:18.7220795Z Compiling torch_xla/csrc/ops/unselect.cpp; 22s local 2025-03-14T05:55:18.7221254Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 21s local 2025-03-14T05:55:18.7221725Z Compiling torch_xla/csrc/ops/update_slice.cpp; 20s local 2025-03-14T05:55:18.7222234Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 19s local 2025-03-14T05:55:18.7222801Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 16s local ... 2025-03-14T05:55:19.9226036Z 2025-03-14T05:55:19.9226670Z  2025-03-14T05:55:19.9227020Z  2025-03-14T05:55:19.9227298Z  2025-03-14T05:55:19.9227573Z  2025-03-14T05:55:19.9227841Z  2025-03-14T05:55:19.9228092Z  2025-03-14T05:55:19.9228340Z  2025-03-14T05:55:19.9228588Z  2025-03-14T05:55:19.9228941Z [15,224 / 15,235] 10 actions running 2025-03-14T05:55:19.9229368Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2025-03-14T05:55:19.9229839Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 25s local 2025-03-14T05:55:19.9230335Z Compiling torch_xla/csrc/ops/uniform.cpp; 23s local 2025-03-14T05:55:19.9230782Z Compiling torch_xla/csrc/ops/unselect.cpp; 23s local 2025-03-14T05:55:19.9231236Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 22s local 2025-03-14T05:55:19.9231690Z Compiling torch_xla/csrc/ops/update_slice.cpp; 21s local 2025-03-14T05:55:19.9232203Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 20s local 2025-03-14T05:55:19.9232775Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 17s local ... 2025-03-14T05:55:20.3230670Z 2025-03-14T05:55:20.3231340Z  2025-03-14T05:55:20.3231685Z  2025-03-14T05:55:20.3232131Z  2025-03-14T05:55:20.3232370Z  2025-03-14T05:55:20.3232602Z  2025-03-14T05:55:20.3232837Z  2025-03-14T05:55:20.3233068Z  2025-03-14T05:55:20.3233298Z  2025-03-14T05:55:20.3233627Z [15,225 / 15,235] 9 actions running 2025-03-14T05:55:20.3234062Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2025-03-14T05:55:20.3234487Z Compiling torch_xla/csrc/ops/uniform.cpp; 24s local 2025-03-14T05:55:20.3234936Z Compiling torch_xla/csrc/ops/unselect.cpp; 24s local 2025-03-14T05:55:20.3235390Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 23s local 2025-03-14T05:55:20.3235859Z Compiling torch_xla/csrc/ops/update_slice.cpp; 21s local 2025-03-14T05:55:20.3236374Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 21s local 2025-03-14T05:55:20.3236961Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 17s local 2025-03-14T05:55:20.3237562Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 17s local ... 2025-03-14T05:55:20.9235898Z 2025-03-14T05:55:20.9236744Z  2025-03-14T05:55:20.9237100Z  2025-03-14T05:55:20.9237343Z  2025-03-14T05:55:20.9237578Z  2025-03-14T05:55:20.9237815Z  2025-03-14T05:55:20.9238048Z  2025-03-14T05:55:20.9238280Z  2025-03-14T05:55:20.9238511Z  2025-03-14T05:55:20.9238838Z [15,226 / 15,235] 8 actions running 2025-03-14T05:55:20.9239471Z Compiling torch_xla/csrc/ops/uniform.cpp; 24s local 2025-03-14T05:55:20.9239941Z Compiling torch_xla/csrc/ops/unselect.cpp; 24s local 2025-03-14T05:55:20.9240400Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 23s local 2025-03-14T05:55:20.9240856Z Compiling torch_xla/csrc/ops/update_slice.cpp; 22s local 2025-03-14T05:55:20.9241366Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 21s local 2025-03-14T05:55:20.9242036Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 18s local 2025-03-14T05:55:20.9242628Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 18s local 2025-03-14T05:55:20.9243201Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 17s local 2025-03-14T05:55:21.5243204Z 2025-03-14T05:55:21.5243941Z  2025-03-14T05:55:21.5244234Z  2025-03-14T05:55:21.5244563Z  2025-03-14T05:55:21.5244820Z  2025-03-14T05:55:21.5245056Z  2025-03-14T05:55:21.5245287Z  2025-03-14T05:55:21.5245519Z  2025-03-14T05:55:21.5245774Z  2025-03-14T05:55:21.5246100Z [15,227 / 15,235] 7 actions running 2025-03-14T05:55:21.5246540Z Compiling torch_xla/csrc/ops/uniform.cpp; 25s local 2025-03-14T05:55:21.5246978Z Compiling torch_xla/csrc/ops/unselect.cpp; 25s local 2025-03-14T05:55:21.5247433Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 24s local 2025-03-14T05:55:21.5248092Z Compiling torch_xla/csrc/ops/update_slice.cpp; 22s local 2025-03-14T05:55:21.5248645Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 19s local 2025-03-14T05:55:21.5249229Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 18s local 2025-03-14T05:55:21.5249793Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 18s local 2025-03-14T05:55:21.9246350Z 2025-03-14T05:55:21.9247116Z  2025-03-14T05:55:21.9247469Z  2025-03-14T05:55:21.9247725Z  2025-03-14T05:55:21.9247985Z  2025-03-14T05:55:21.9248222Z  2025-03-14T05:55:21.9248479Z  2025-03-14T05:55:21.9248712Z  2025-03-14T05:55:21.9249038Z [15,228 / 15,235] 6 actions running 2025-03-14T05:55:21.9249470Z Compiling torch_xla/csrc/ops/uniform.cpp; 25s local 2025-03-14T05:55:21.9249919Z Compiling torch_xla/csrc/ops/unselect.cpp; 25s local 2025-03-14T05:55:21.9250385Z Compiling torch_xla/csrc/ops/update_slice.cpp; 23s local 2025-03-14T05:55:21.9250947Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 19s local 2025-03-14T05:55:21.9251530Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 19s local 2025-03-14T05:55:21.9252294Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 18s local 2025-03-14T05:55:22.9250816Z 2025-03-14T05:55:22.9251453Z  2025-03-14T05:55:22.9251791Z  2025-03-14T05:55:22.9252047Z  2025-03-14T05:55:22.9252297Z  2025-03-14T05:55:22.9252550Z  2025-03-14T05:55:22.9252794Z  2025-03-14T05:55:22.9253134Z [15,228 / 15,235] 6 actions running 2025-03-14T05:55:22.9253599Z Compiling torch_xla/csrc/ops/uniform.cpp; 26s local 2025-03-14T05:55:22.9254069Z Compiling torch_xla/csrc/ops/unselect.cpp; 26s local 2025-03-14T05:55:22.9254545Z Compiling torch_xla/csrc/ops/update_slice.cpp; 24s local 2025-03-14T05:55:22.9255100Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 20s local 2025-03-14T05:55:22.9255690Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 20s local 2025-03-14T05:55:22.9256271Z Compiling torch_xla/csrc/ops/upsample_nearest2d_backward.cpp; 19s local 2025-03-14T05:55:23.3253982Z 2025-03-14T05:55:23.3254761Z  2025-03-14T05:55:23.3255120Z  2025-03-14T05:55:23.3255377Z  2025-03-14T05:55:23.3255623Z  2025-03-14T05:55:23.3255864Z  2025-03-14T05:55:23.3256103Z  2025-03-14T05:55:23.3256438Z [15,229 / 15,235] 5 actions running 2025-03-14T05:55:23.3256876Z Compiling torch_xla/csrc/ops/uniform.cpp; 27s local 2025-03-14T05:55:23.3257550Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local 2025-03-14T05:55:23.3258033Z Compiling torch_xla/csrc/ops/update_slice.cpp; 24s local 2025-03-14T05:55:23.3258589Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 20s local 2025-03-14T05:55:23.3259177Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 20s local 2025-03-14T05:55:23.5256409Z 2025-03-14T05:55:23.5257056Z  2025-03-14T05:55:23.5257415Z  2025-03-14T05:55:23.5257672Z  2025-03-14T05:55:23.5257922Z  2025-03-14T05:55:23.5258352Z  2025-03-14T05:55:23.5258696Z [15,230 / 15,235] 4 actions running 2025-03-14T05:55:23.5259142Z Compiling torch_xla/csrc/ops/uniform.cpp; 27s local 2025-03-14T05:55:23.5259613Z Compiling torch_xla/csrc/ops/update_slice.cpp; 24s local 2025-03-14T05:55:23.5260164Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 21s local 2025-03-14T05:55:23.5260740Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 20s local 2025-03-14T05:55:24.1262661Z 2025-03-14T05:55:24.1263306Z  2025-03-14T05:55:24.1263647Z  2025-03-14T05:55:24.1263904Z  2025-03-14T05:55:24.1264154Z  2025-03-14T05:55:24.1264514Z [15,231 / 15,235] 3 actions running 2025-03-14T05:55:24.1264959Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2025-03-14T05:55:24.1265606Z Compiling torch_xla/csrc/ops/update_slice.cpp; 25s local 2025-03-14T05:55:24.1266386Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 21s local 2025-03-14T05:55:25.1269123Z 2025-03-14T05:55:25.1269798Z  2025-03-14T05:55:25.1270130Z  2025-03-14T05:55:25.1270385Z  2025-03-14T05:55:25.1270725Z [15,232 / 15,235] 2 actions running 2025-03-14T05:55:25.1271195Z Compiling torch_xla/csrc/ops/update_slice.cpp; 26s local 2025-03-14T05:55:25.1271753Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 22s local 2025-03-14T05:55:25.3886521Z 2025-03-14T05:55:25.3887185Z  2025-03-14T05:55:25.3887525Z  2025-03-14T05:55:25.3887924Z [15,234 / 15,235] [Prepa] Linking _XLAC.so 2025-03-14T05:55:25.7273787Z 2025-03-14T05:55:25.7274518Z [15,234 / 15,235] Linking _XLAC.so; 0s local 2025-03-14T05:55:26.7284158Z 2025-03-14T05:55:26.7285046Z [15,234 / 15,235] Linking _XLAC.so; 1s local 2025-03-14T05:55:27.7289261Z 2025-03-14T05:55:27.7290006Z [15,234 / 15,235] Linking _XLAC.so; 2s local 2025-03-14T05:55:28.9295580Z 2025-03-14T05:55:28.9296570Z [15,234 / 15,235] Linking _XLAC.so; 3s local 2025-03-14T05:55:30.1305832Z 2025-03-14T05:55:30.1306639Z [15,234 / 15,235] Linking _XLAC.so; 4s local 2025-03-14T05:55:31.1314044Z 2025-03-14T05:55:31.1314871Z [15,234 / 15,235] Linking _XLAC.so; 5s local 2025-03-14T05:55:32.1321628Z 2025-03-14T05:55:32.1322374Z [15,234 / 15,235] Linking _XLAC.so; 6s local 2025-03-14T05:55:33.1327764Z 2025-03-14T05:55:33.1328695Z [15,234 / 15,235] Linking _XLAC.so; 7s local 2025-03-14T05:55:34.3332265Z 2025-03-14T05:55:34.3333129Z [15,234 / 15,235] Linking _XLAC.so; 8s local 2025-03-14T05:55:35.3338781Z 2025-03-14T05:55:35.3339581Z [15,234 / 15,235] Linking _XLAC.so; 9s local 2025-03-14T05:55:36.5347833Z 2025-03-14T05:55:36.5348659Z [15,234 / 15,235] Linking _XLAC.so; 11s local 2025-03-14T05:55:37.0860431Z 2025-03-14T05:55:37.0861268Z [15,234 / 15,235] Linking _XLAC.so; 11s local 2025-03-14T05:55:38.1358715Z 2025-03-14T05:55:38.1359573Z [15,234 / 15,235] Linking _XLAC.so; 12s local 2025-03-14T05:55:38.8053136Z 2025-03-14T05:55:38.8054715Z Target //:_XLAC.so up-to-date: 2025-03-14T05:55:38.8055504Z [15,235 / 15,235] checking cached actions 2025-03-14T05:55:38.8055948Z 2025-03-14T05:55:38.8056399Z  build/temp.linux-x86_64-cpython-310/bazel-bin/_XLAC.so 2025-03-14T05:55:38.8057496Z [15,235 / 15,235] checking cached actions 2025-03-14T05:55:38.8866651Z 2025-03-14T05:55:38.8867683Z INFO: Elapsed time: 876.717s, Critical Path: 216.65s 2025-03-14T05:55:38.8868243Z [15,235 / 15,235] checking cached actions 2025-03-14T05:55:38.8868507Z 2025-03-14T05:55:38.8868764Z INFO: 15235 processes: 9086 internal, 6149 local. 2025-03-14T05:55:38.8869277Z [15,235 / 15,235] checking cached actions 2025-03-14T05:55:38.8869533Z 2025-03-14T05:55:38.8869975Z INFO: Build completed successfully, 15235 total actions 2025-03-14T05:55:39.0468192Z bazel build //:_XLAC_cuda_functions.so --symlink_prefix=build/temp.linux-x86_64-cpython-310/bazel- --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=1 --remote_default_exec_properties=cache-silo-key=dev 2025-03-14T05:55:39.0772554Z INFO: Options provided by the client: 2025-03-14T05:55:39.0773064Z Inherited 'common' options: --isatty=1 --terminal_columns=0 2025-03-14T05:55:39.0773799Z INFO: Reading rc options for 'build' from /var/lib/jenkins/workspace/xla/.bazelrc: 2025-03-14T05:55:39.0774416Z Inherited 'common' options: --experimental_repo_remote_exec 2025-03-14T05:55:39.0775097Z INFO: Reading rc options for 'build' from /var/lib/jenkins/workspace/xla/.bazelrc: 2025-03-14T05:55:39.0778827Z 'build' options: --announce_rc --nocheck_visibility --enable_platform_specific_config --experimental_cc_shared_library --define=no_aws_support=true --define=no_hdfs_support=true --define=no_hdfs_support=true --define=no_kafka_support=true --define=no_ignite_support=true --define=grpc_no_ares=true -c opt --config=short_logs --action_env=CC=gcc --action_env=CXX=g++ --spawn_strategy=standalone --incompatible_strict_action_env --noremote_upload_local_results --java_runtime_version=remotejdk_11 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --define framework_shared_object=false --define tsl_protobuf_header_only=false --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --define=with_xla_support=true --noincompatible_remove_legacy_whole_archive --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility 2025-03-14T05:55:39.0783179Z INFO: Found applicable config definition build:short_logs in file /var/lib/jenkins/workspace/xla/.bazelrc: --output_filter=DONT_MATCH_ANYTHING 2025-03-14T05:55:39.0787128Z INFO: Found applicable config definition build:linux in file /var/lib/jenkins/workspace/xla/.bazelrc: --config=posix --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --define=build_with_onednn_v2=true --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable 2025-03-14T05:55:39.0791023Z INFO: Found applicable config definition build:posix in file /var/lib/jenkins/workspace/xla/.bazelrc: --copt=-Wno-sign-compare --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 2025-03-14T05:55:39.0792705Z INFO: Found applicable config definition build:dynamic_kernels in file /var/lib/jenkins/workspace/xla/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS 2025-03-14T05:55:39.3626731Z Loading: 2025-03-14T05:55:40.0814439Z 2025-03-14T05:55:40.0815183Z Loading: 2025-03-14T05:55:40.0815565Z Fetching repository @torch; starting 2025-03-14T05:55:40.0947056Z 2025-03-14T05:55:40.0947692Z  2025-03-14T05:55:40.0948596Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:154:14: 2025-03-14T05:55:40.0949551Z HERMETIC_PYTHON_VERSION variable was not set correctly, using default version. 2025-03-14T05:55:40.0950229Z Python 3.10 will be used. 2025-03-14T05:55:40.0950675Z To select Python version, either set HERMETIC_PYTHON_VERSION env variable in 2025-03-14T05:55:40.0951138Z your shell: 2025-03-14T05:55:40.0951401Z export HERMETIC_PYTHON_VERSION=3.12 2025-03-14T05:55:40.0951850Z OR pass it as an argument to bazel command directly or inside your .bazelrc 2025-03-14T05:55:40.0952291Z file: 2025-03-14T05:55:40.0952562Z --repo_env=HERMETIC_PYTHON_VERSION=3.12 2025-03-14T05:55:40.0952994Z Loading: 2025-03-14T05:55:40.0953390Z Fetching repository @python_version_repo; starting 2025-03-14T05:55:40.0954542Z 2025-03-14T05:55:40.0954685Z  2025-03-14T05:55:40.0955516Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:87:10: 2025-03-14T05:55:40.0956290Z ============================= 2025-03-14T05:55:40.0956599Z Hermetic Python configuration: 2025-03-14T05:55:40.0956901Z Version: "3.10" 2025-03-14T05:55:40.0957141Z Kind: "" 2025-03-14T05:55:40.0957429Z Interpreter: "default" (provided by rules_python) 2025-03-14T05:55:40.0957957Z Requirements_lock label: "@python_version_repo//:requirements_lock_3_10.txt" 2025-03-14T05:55:40.0958435Z ===================================== 2025-03-14T05:55:40.0958759Z Loading: 2025-03-14T05:55:40.0959075Z Fetching repository @python_version_repo; starting 2025-03-14T05:55:40.1196109Z 2025-03-14T05:55:40.1196658Z  2025-03-14T05:55:40.1196980Z Loading: 2025-03-14T05:55:40.1197217Z 2025-03-14T05:55:40.1197404Z Loading: 0 packages loaded 2025-03-14T05:55:40.1345635Z 2025-03-14T05:55:40.1346440Z Analyzing: target //:_XLAC_cuda_functions.so (0 packages loaded, 0 targets con\ 2025-03-14T05:55:40.1346986Z figured) 2025-03-14T05:55:40.3665264Z 2025-03-14T05:55:40.3666054Z  2025-03-14T05:55:40.3666695Z Analyzing: target //:_XLAC_cuda_functions.so (1 packages loaded, 8673 targets \ 2025-03-14T05:55:40.3667248Z configured) 2025-03-14T05:55:40.5083739Z 2025-03-14T05:55:40.5084626Z  2025-03-14T05:55:40.5085349Z INFO: Analyzed target //:_XLAC_cuda_functions.so (1 packages loaded, 8676 targets configured). 2025-03-14T05:55:40.5085990Z  checking cached actions 2025-03-14T05:55:40.5086190Z 2025-03-14T05:55:40.5086363Z INFO: Found 1 target... 2025-03-14T05:55:40.5086759Z  checking cached actions 2025-03-14T05:55:40.7679808Z 2025-03-14T05:55:40.7683022Z  checking cached actions 2025-03-14T05:55:41.1131804Z 2025-03-14T05:55:41.1132871Z [0 / 8] [Prepa] Creating source manifest for //:_XLAC_cuda_functions.so 2025-03-14T05:55:41.3737976Z 2025-03-14T05:55:41.3739804Z [6,351 / 8,838] checking cached actions 2025-03-14T05:55:41.7736783Z 2025-03-14T05:55:41.7737736Z [8,836 / 8,838] Compiling torch_xla/csrc/aten_cuda_functions.cpp; 0s local 2025-03-14T05:55:42.9747523Z 2025-03-14T05:55:42.9748476Z [8,836 / 8,838] Compiling torch_xla/csrc/aten_cuda_functions.cpp; 1s local 2025-03-14T05:55:43.9756139Z 2025-03-14T05:55:43.9757059Z [8,836 / 8,838] Compiling torch_xla/csrc/aten_cuda_functions.cpp; 2s local 2025-03-14T05:55:44.5166984Z 2025-03-14T05:55:44.5167807Z [8,837 / 8,838] [Prepa] Linking _XLAC_cuda_functions.so 2025-03-14T05:55:44.5542318Z 2025-03-14T05:55:44.5542995Z Target //:_XLAC_cuda_functions.so up-to-date: 2025-03-14T05:55:44.5604868Z [8,838 / 8,838] checking cached actions 2025-03-14T05:55:44.5605182Z 2025-03-14T05:55:44.5605535Z  build/temp.linux-x86_64-cpython-310/bazel-bin/_XLAC_cuda_functions.so 2025-03-14T05:55:44.5606102Z [8,838 / 8,838] checking cached actions 2025-03-14T05:55:44.6687441Z 2025-03-14T05:55:44.6688220Z INFO: Elapsed time: 5.607s, Critical Path: 3.03s 2025-03-14T05:55:44.6688811Z [8,838 / 8,838] checking cached actions 2025-03-14T05:55:44.6689056Z 2025-03-14T05:55:44.6689463Z INFO: 6 processes: 4 internal, 2 local. 2025-03-14T05:55:44.6689933Z [8,838 / 8,838] checking cached actions 2025-03-14T05:55:44.6690173Z 2025-03-14T05:55:44.6690443Z INFO: Build completed successfully, 6 total actions 2025-03-14T05:55:44.7669426Z creating build/bdist.linux-x86_64 2025-03-14T05:55:44.7669852Z creating build/bdist.linux-x86_64/egg 2025-03-14T05:55:44.7670267Z creating build/bdist.linux-x86_64/egg/torch_xla 2025-03-14T05:55:44.7671143Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_patched_functions.py -> build/bdist.linux-x86_64/egg/torch_xla 2025-03-14T05:55:44.7676597Z copying build/lib.linux-x86_64-cpython-310/torch_xla/stablehlo.py -> build/bdist.linux-x86_64/egg/torch_xla 2025-03-14T05:55:44.7683226Z copying build/lib.linux-x86_64-cpython-310/torch_xla/tf_saved_model_integration.py -> build/bdist.linux-x86_64/egg/torch_xla 2025-03-14T05:55:44.7696746Z copying build/lib.linux-x86_64-cpython-310/torch_xla/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla 2025-03-14T05:55:44.7702467Z copying build/lib.linux-x86_64-cpython-310/torch_xla/runtime.py -> build/bdist.linux-x86_64/egg/torch_xla 2025-03-14T05:55:44.7708354Z copying build/lib.linux-x86_64-cpython-310/torch_xla/torch_xla.py -> build/bdist.linux-x86_64/egg/torch_xla 2025-03-14T05:55:44.7713078Z copying build/lib.linux-x86_64-cpython-310/torch_xla/version.py -> build/bdist.linux-x86_64/egg/torch_xla 2025-03-14T05:55:44.7717203Z creating build/bdist.linux-x86_64/egg/torch_xla/_dynamo 2025-03-14T05:55:44.7718065Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/_dynamo 2025-03-14T05:55:44.7723002Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo/config.py -> build/bdist.linux-x86_64/egg/torch_xla/_dynamo 2025-03-14T05:55:44.7727135Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_dynamo/dynamo_bridge.py -> build/bdist.linux-x86_64/egg/torch_xla/_dynamo 2025-03-14T05:55:44.7745853Z creating build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7748121Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7751235Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/c10d_registration.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7752838Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/custom_kernel.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7757208Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/decomp_registration.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7765003Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/gpu.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7773294Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/neuron_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7777151Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/rendezvous.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7781970Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/tpu.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7786989Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/utils.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7791812Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/xpu.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7800250Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/neuron.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7807729Z copying build/lib.linux-x86_64-cpython-310/torch_xla/_internal/pjrt.py -> build/bdist.linux-x86_64/egg/torch_xla/_internal 2025-03-14T05:55:44.7812843Z creating build/bdist.linux-x86_64/egg/torch_xla/amp 2025-03-14T05:55:44.7813766Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/amp 2025-03-14T05:55:44.7818343Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/autocast_mode.py -> build/bdist.linux-x86_64/egg/torch_xla/amp 2025-03-14T05:55:44.7823904Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/grad_scaler.py -> build/bdist.linux-x86_64/egg/torch_xla/amp 2025-03-14T05:55:44.7832395Z creating build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2025-03-14T05:55:44.7834559Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2025-03-14T05:55:44.7842754Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/_functional.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2025-03-14T05:55:44.7846943Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/adam.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2025-03-14T05:55:44.7851882Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/adamw.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2025-03-14T05:55:44.7858785Z copying build/lib.linux-x86_64-cpython-310/torch_xla/amp/syncfree/sgd.py -> build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree 2025-03-14T05:55:44.7868518Z creating build/bdist.linux-x86_64/egg/torch_xla/core 2025-03-14T05:55:44.7869599Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2025-03-14T05:55:44.7870652Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/dynamo_bridge.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2025-03-14T05:55:44.7879064Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/functions.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2025-03-14T05:55:44.7886784Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/xla_env_vars.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2025-03-14T05:55:44.7894212Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/xla_op_registry.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2025-03-14T05:55:44.7903614Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/xla_builder.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2025-03-14T05:55:44.7913417Z copying build/lib.linux-x86_64-cpython-310/torch_xla/core/xla_model.py -> build/bdist.linux-x86_64/egg/torch_xla/core 2025-03-14T05:55:44.7930408Z creating build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7933208Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7936263Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/frame_parser_util.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7940887Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/graph_saver.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7946989Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/metrics.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7953121Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/metrics_compare_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7963271Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/model_comparator.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7969379Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/metrics_saver.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7979188Z copying build/lib.linux-x86_64-cpython-310/torch_xla/debug/profiler.py -> build/bdist.linux-x86_64/egg/torch_xla/debug 2025-03-14T05:55:44.7988902Z creating build/bdist.linux-x86_64/egg/torch_xla/distributed 2025-03-14T05:55:44.7989768Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2025-03-14T05:55:44.7990931Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/data_parallel.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2025-03-14T05:55:44.7996747Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/parallel_loader.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2025-03-14T05:55:44.8003272Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/xla_backend.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2025-03-14T05:55:44.8012696Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/xla_multiprocessing.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2025-03-14T05:55:44.8017796Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/zero_redundancy_optimizer.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed 2025-03-14T05:55:44.8033380Z creating build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8034292Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8038260Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/_init_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8044659Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/consolidate_sharded_ckpts.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8053930Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/state_dict_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8058198Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/utils.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8064038Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/wrap.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8075013Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/xla_flatten_params_wrapper.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8081384Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/fsdp/xla_fully_sharded_data_parallel.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp 2025-03-14T05:55:44.8104998Z creating build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2025-03-14T05:55:44.8107563Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/api.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2025-03-14T05:55:44.8110134Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/debugging.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2025-03-14T05:55:44.8120747Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/xla_sharded_tensor.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2025-03-14T05:55:44.8128868Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2025-03-14T05:55:44.8134882Z copying build/lib.linux-x86_64-cpython-310/torch_xla/distributed/spmd/xla_sharding.py -> build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd 2025-03-14T05:55:44.8154951Z creating build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8155789Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8159870Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/callback.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8169748Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/deprecation.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8174098Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/dynamo_mark_sharding.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8179895Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/dynamo_set_buffer_donor.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8186710Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/eager.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8196983Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/fori_loop.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8202888Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/mark_pattern_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8214249Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pjrt_backend.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8220271Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/plugins.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8231888Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pytreeify.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8233131Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/quantized.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8237793Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/scan_layers.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8246920Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/stablehlo_custom_call.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8252754Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/unbounded_dynamism_export.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8262798Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/xla_dynamic_reshape_ops.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8268252Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/xla_marker.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8274466Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/xla_mlir_debuginfo.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8283711Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/xla_quantized_matmul.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8290840Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/custom_kernel.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8310314Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/scan.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8315316Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/spmd_fully_sharded_data_parallel.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8325169Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/triton.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental 2025-03-14T05:55:44.8331416Z creating build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:55:44.8332533Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:55:44.8342779Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/_helpers.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:55:44.8349938Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/manager.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:55:44.8357374Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/planners.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:55:44.8367921Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/distributed_checkpoint/util.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint 2025-03-14T05:55:44.8374155Z creating build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels 2025-03-14T05:55:44.8375156Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels 2025-03-14T05:55:44.8376679Z copying build/lib.linux-x86_64-cpython-310/torch_xla/experimental/pallas_kernels/multi_queries_paged_attention_kernel.py -> build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels 2025-03-14T05:55:44.8383635Z creating build/bdist.linux-x86_64/egg/torch_xla/test 2025-03-14T05:55:44.8384503Z copying build/lib.linux-x86_64-cpython-310/torch_xla/test/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/test 2025-03-14T05:55:44.8385712Z copying build/lib.linux-x86_64-cpython-310/torch_xla/test/test_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/test 2025-03-14T05:55:44.8392495Z creating build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8393297Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/__init__.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8394399Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/checkpoint_tagger.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8400464Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/closures.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8407344Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/dlpack.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8413679Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/keyd_queue.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8423325Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/stablehlo_test_utils.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8431607Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/utils.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8437472Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/checkpoint.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8448147Z copying build/lib.linux-x86_64-cpython-310/torch_xla/utils/serialization.py -> build/bdist.linux-x86_64/egg/torch_xla/utils 2025-03-14T05:55:44.8455030Z copying build/lib.linux-x86_64-cpython-310/_XLAC.cpython-310-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/egg 2025-03-14T05:55:45.0779875Z copying build/lib.linux-x86_64-cpython-310/_XLAC_cuda_functions.cpython-310-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/egg 2025-03-14T05:55:45.0784085Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_patched_functions.py to _patched_functions.cpython-310.pyc 2025-03-14T05:55:45.0792060Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/stablehlo.py to stablehlo.cpython-310.pyc 2025-03-14T05:55:45.0834967Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/tf_saved_model_integration.py to tf_saved_model_integration.cpython-310.pyc 2025-03-14T05:55:45.0841575Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.0853261Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/runtime.py to runtime.cpython-310.pyc 2025-03-14T05:55:45.0865852Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/torch_xla.py to torch_xla.cpython-310.pyc 2025-03-14T05:55:45.0874102Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/version.py to version.cpython-310.pyc 2025-03-14T05:55:45.0876031Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_dynamo/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.0877834Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_dynamo/config.py to config.cpython-310.pyc 2025-03-14T05:55:45.0879524Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_dynamo/dynamo_bridge.py to dynamo_bridge.cpython-310.pyc 2025-03-14T05:55:45.0921372Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.0922377Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/c10d_registration.py to c10d_registration.cpython-310.pyc 2025-03-14T05:55:45.0923374Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/custom_kernel.py to custom_kernel.cpython-310.pyc 2025-03-14T05:55:45.0926847Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/decomp_registration.py to decomp_registration.cpython-310.pyc 2025-03-14T05:55:45.0928949Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/gpu.py to gpu.cpython-310.pyc 2025-03-14T05:55:45.0931586Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/neuron_utils.py to neuron_utils.cpython-310.pyc 2025-03-14T05:55:45.0936892Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/rendezvous.py to rendezvous.cpython-310.pyc 2025-03-14T05:55:45.0942066Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/tpu.py to tpu.cpython-310.pyc 2025-03-14T05:55:45.0962605Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/utils.py to utils.cpython-310.pyc 2025-03-14T05:55:45.0963450Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/xpu.py to xpu.cpython-310.pyc 2025-03-14T05:55:45.0964266Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/neuron.py to neuron.cpython-310.pyc 2025-03-14T05:55:45.0970866Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/_internal/pjrt.py to pjrt.cpython-310.pyc 2025-03-14T05:55:45.0981716Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.0983696Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/autocast_mode.py to autocast_mode.cpython-310.pyc 2025-03-14T05:55:45.0989598Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/grad_scaler.py to grad_scaler.cpython-310.pyc 2025-03-14T05:55:45.0995137Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.0997204Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/_functional.py to _functional.cpython-310.pyc 2025-03-14T05:55:45.1001749Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/adam.py to adam.cpython-310.pyc 2025-03-14T05:55:45.1007421Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/adamw.py to adamw.cpython-310.pyc 2025-03-14T05:55:45.1012730Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/amp/syncfree/sgd.py to sgd.cpython-310.pyc 2025-03-14T05:55:45.1017833Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1019663Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/dynamo_bridge.py to dynamo_bridge.cpython-310.pyc 2025-03-14T05:55:45.1021311Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/functions.py to functions.cpython-310.pyc 2025-03-14T05:55:45.1031982Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/xla_env_vars.py to xla_env_vars.cpython-310.pyc 2025-03-14T05:55:45.1035216Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/xla_op_registry.py to xla_op_registry.cpython-310.pyc 2025-03-14T05:55:45.1039787Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/xla_builder.py to xla_builder.cpython-310.pyc 2025-03-14T05:55:45.1083757Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/core/xla_model.py to xla_model.cpython-310.pyc 2025-03-14T05:55:45.1144442Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1145404Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/frame_parser_util.py to frame_parser_util.cpython-310.pyc 2025-03-14T05:55:45.1147305Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/graph_saver.py to graph_saver.cpython-310.pyc 2025-03-14T05:55:45.1150697Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/metrics.py to metrics.cpython-310.pyc 2025-03-14T05:55:45.1154896Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/metrics_compare_utils.py to metrics_compare_utils.cpython-310.pyc 2025-03-14T05:55:45.1164033Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/model_comparator.py to model_comparator.cpython-310.pyc 2025-03-14T05:55:45.1176066Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/metrics_saver.py to metrics_saver.cpython-310.pyc 2025-03-14T05:55:45.1180468Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/debug/profiler.py to profiler.cpython-310.pyc 2025-03-14T05:55:45.1187445Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1189510Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/data_parallel.py to data_parallel.cpython-310.pyc 2025-03-14T05:55:45.1198398Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/parallel_loader.py to parallel_loader.cpython-310.pyc 2025-03-14T05:55:45.1211426Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/xla_backend.py to xla_backend.cpython-310.pyc 2025-03-14T05:55:45.1236073Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/xla_multiprocessing.py to xla_multiprocessing.cpython-310.pyc 2025-03-14T05:55:45.1237281Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/zero_redundancy_optimizer.py to zero_redundancy_optimizer.cpython-310.pyc 2025-03-14T05:55:45.1263929Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1264942Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/_init_utils.py to _init_utils.cpython-310.pyc 2025-03-14T05:55:45.1268316Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/consolidate_sharded_ckpts.py to consolidate_sharded_ckpts.cpython-310.pyc 2025-03-14T05:55:45.1271090Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/state_dict_utils.py to state_dict_utils.cpython-310.pyc 2025-03-14T05:55:45.1281006Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/utils.py to utils.cpython-310.pyc 2025-03-14T05:55:45.1293064Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/wrap.py to wrap.cpython-310.pyc 2025-03-14T05:55:45.1301077Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/xla_flatten_params_wrapper.py to xla_flatten_params_wrapper.cpython-310.pyc 2025-03-14T05:55:45.1329122Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/fsdp/xla_fully_sharded_data_parallel.py to xla_fully_sharded_data_parallel.cpython-310.pyc 2025-03-14T05:55:45.1392319Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/api.py to api.cpython-310.pyc 2025-03-14T05:55:45.1398179Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/debugging.py to debugging.cpython-310.pyc 2025-03-14T05:55:45.1408241Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/xla_sharded_tensor.py to xla_sharded_tensor.cpython-310.pyc 2025-03-14T05:55:45.1416857Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1419544Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/distributed/spmd/xla_sharding.py to xla_sharding.cpython-310.pyc 2025-03-14T05:55:45.1452066Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1453369Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/callback.py to callback.cpython-310.pyc 2025-03-14T05:55:45.1456497Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/deprecation.py to deprecation.cpython-310.pyc 2025-03-14T05:55:45.1460760Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/dynamo_mark_sharding.py to dynamo_mark_sharding.cpython-310.pyc 2025-03-14T05:55:45.1463046Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/dynamo_set_buffer_donor.py to dynamo_set_buffer_donor.cpython-310.pyc 2025-03-14T05:55:45.1464773Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/eager.py to eager.cpython-310.pyc 2025-03-14T05:55:45.1468148Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/fori_loop.py to fori_loop.cpython-310.pyc 2025-03-14T05:55:45.1476590Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/mark_pattern_utils.py to mark_pattern_utils.cpython-310.pyc 2025-03-14T05:55:45.1481391Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/pjrt_backend.py to pjrt_backend.cpython-310.pyc 2025-03-14T05:55:45.1484365Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/plugins.py to plugins.cpython-310.pyc 2025-03-14T05:55:45.1489869Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/pytreeify.py to pytreeify.cpython-310.pyc 2025-03-14T05:55:45.1494382Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/quantized.py to quantized.cpython-310.pyc 2025-03-14T05:55:45.1501521Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/scan_layers.py to scan_layers.cpython-310.pyc 2025-03-14T05:55:45.1509035Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/stablehlo_custom_call.py to stablehlo_custom_call.cpython-310.pyc 2025-03-14T05:55:45.1515089Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/unbounded_dynamism_export.py to unbounded_dynamism_export.cpython-310.pyc 2025-03-14T05:55:45.1540039Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/xla_dynamic_reshape_ops.py to xla_dynamic_reshape_ops.cpython-310.pyc 2025-03-14T05:55:45.1541909Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/xla_marker.py to xla_marker.cpython-310.pyc 2025-03-14T05:55:45.1548564Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/xla_mlir_debuginfo.py to xla_mlir_debuginfo.cpython-310.pyc 2025-03-14T05:55:45.1551868Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/xla_quantized_matmul.py to xla_quantized_matmul.cpython-310.pyc 2025-03-14T05:55:45.1566653Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/custom_kernel.py to custom_kernel.cpython-310.pyc 2025-03-14T05:55:45.1608155Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/scan.py to scan.cpython-310.pyc 2025-03-14T05:55:45.1636970Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/spmd_fully_sharded_data_parallel.py to spmd_fully_sharded_data_parallel.cpython-310.pyc 2025-03-14T05:55:45.1642866Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/triton.py to triton.cpython-310.pyc 2025-03-14T05:55:45.1653714Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1655779Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/_helpers.py to _helpers.cpython-310.pyc 2025-03-14T05:55:45.1670402Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/manager.py to manager.cpython-310.pyc 2025-03-14T05:55:45.1686339Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/planners.py to planners.cpython-310.pyc 2025-03-14T05:55:45.1705435Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/distributed_checkpoint/util.py to util.cpython-310.pyc 2025-03-14T05:55:45.1706538Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1707828Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/experimental/pallas_kernels/multi_queries_paged_attention_kernel.py to multi_queries_paged_attention_kernel.cpython-310.pyc 2025-03-14T05:55:45.1734854Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/test/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1735986Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/test/test_utils.py to test_utils.cpython-310.pyc 2025-03-14T05:55:45.1743519Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/__init__.py to __init__.cpython-310.pyc 2025-03-14T05:55:45.1745436Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/checkpoint_tagger.py to checkpoint_tagger.cpython-310.pyc 2025-03-14T05:55:45.1749584Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/closures.py to closures.cpython-310.pyc 2025-03-14T05:55:45.1754935Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/dlpack.py to dlpack.cpython-310.pyc 2025-03-14T05:55:45.1759359Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/keyd_queue.py to keyd_queue.cpython-310.pyc 2025-03-14T05:55:45.1766727Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/stablehlo_test_utils.py to stablehlo_test_utils.cpython-310.pyc 2025-03-14T05:55:45.1772374Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/utils.py to utils.cpython-310.pyc 2025-03-14T05:55:45.1793525Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/checkpoint.py to checkpoint.cpython-310.pyc 2025-03-14T05:55:45.1801513Z byte-compiling build/bdist.linux-x86_64/egg/torch_xla/utils/serialization.py to serialization.cpython-310.pyc 2025-03-14T05:55:45.1814854Z creating stub loader for _XLAC.cpython-310-x86_64-linux-gnu.so 2025-03-14T05:55:45.1816146Z creating stub loader for _XLAC_cuda_functions.cpython-310-x86_64-linux-gnu.so 2025-03-14T05:55:45.1817387Z byte-compiling build/bdist.linux-x86_64/egg/_XLAC.py to _XLAC.cpython-310.pyc 2025-03-14T05:55:45.1820442Z byte-compiling build/bdist.linux-x86_64/egg/_XLAC_cuda_functions.py to _XLAC_cuda_functions.cpython-310.pyc 2025-03-14T05:55:45.1822964Z creating build/bdist.linux-x86_64/egg/EGG-INFO 2025-03-14T05:55:45.1824262Z copying torch_xla.egg-info/PKG-INFO -> build/bdist.linux-x86_64/egg/EGG-INFO 2025-03-14T05:55:45.1840412Z copying torch_xla.egg-info/SOURCES.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2025-03-14T05:55:45.1845039Z copying torch_xla.egg-info/dependency_links.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2025-03-14T05:55:45.1852123Z copying torch_xla.egg-info/entry_points.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2025-03-14T05:55:45.1853159Z copying torch_xla.egg-info/requires.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2025-03-14T05:55:45.1863070Z copying torch_xla.egg-info/top_level.txt -> build/bdist.linux-x86_64/egg/EGG-INFO 2025-03-14T05:55:45.1869685Z writing build/bdist.linux-x86_64/egg/EGG-INFO/native_libs.txt 2025-03-14T05:55:45.1870659Z zip_safe flag not set; analyzing archive contents... 2025-03-14T05:55:45.1872201Z __pycache__._XLAC.cpython-310: module references __file__ 2025-03-14T05:55:45.1872917Z __pycache__._XLAC_cuda_functions.cpython-310: module references __file__ 2025-03-14T05:55:45.1876970Z torch_xla.__pycache__.__init__.cpython-310: module references __file__ 2025-03-14T05:55:45.1878824Z torch_xla.__pycache__._patched_functions.cpython-310: module MAY be using inspect.stack 2025-03-14T05:55:45.1929777Z torch_xla.amp.__pycache__.grad_scaler.cpython-310: module MAY be using inspect.stack 2025-03-14T05:55:45.1983683Z torch_xla.debug.__pycache__.model_comparator.cpython-310: module references __file__ 2025-03-14T05:55:45.2144800Z creating dist 2025-03-14T05:55:45.2145414Z creating 'dist/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg' and adding 'build/bdist.linux-x86_64/egg' to it 2025-03-14T05:55:57.6487924Z removing 'build/bdist.linux-x86_64/egg' (and everything under it) 2025-03-14T05:55:57.6878494Z Processing torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg 2025-03-14T05:55:57.6906920Z creating /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg 2025-03-14T05:55:57.6907844Z Extracting torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg to /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.4948009Z Adding torch-xla 2.7.0+gitb2b890e to easy-install.pth file 2025-03-14T05:55:59.4950773Z Installing stablehlo-to-saved-model script to /opt/conda/bin 2025-03-14T05:55:59.4952126Z 2025-03-14T05:55:59.4952725Z Installed /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg 2025-03-14T05:55:59.4956585Z Processing dependencies for torch-xla==2.7.0+gitb2b890e 2025-03-14T05:55:59.5062406Z Searching for requests==2.32.3 2025-03-14T05:55:59.5062837Z Best match: requests 2.32.3 2025-03-14T05:55:59.5063197Z Adding requests 2.32.3 to easy-install.pth file 2025-03-14T05:55:59.5063717Z detected new path './torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg' 2025-03-14T05:55:59.5083008Z 2025-03-14T05:55:59.5083426Z Using /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.5083867Z Searching for PyYAML==6.0.2 2025-03-14T05:55:59.5084172Z Best match: PyYAML 6.0.2 2025-03-14T05:55:59.5084972Z Adding PyYAML 6.0.2 to easy-install.pth file 2025-03-14T05:55:59.5090150Z 2025-03-14T05:55:59.5090320Z Using /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.5093024Z Searching for numpy==2.1.3 2025-03-14T05:55:59.5093759Z Best match: numpy 2.1.3 2025-03-14T05:55:59.5094390Z Adding numpy 2.1.3 to easy-install.pth file 2025-03-14T05:55:59.5103110Z Installing f2py script to /opt/conda/bin 2025-03-14T05:55:59.5104969Z Installing numpy-config script to /opt/conda/bin 2025-03-14T05:55:59.5106223Z 2025-03-14T05:55:59.5106378Z Using /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.5109342Z Searching for absl-py==2.1.0 2025-03-14T05:55:59.5110103Z Best match: absl-py 2.1.0 2025-03-14T05:55:59.5110963Z Adding absl-py 2.1.0 to easy-install.pth file 2025-03-14T05:55:59.5116363Z 2025-03-14T05:55:59.5116525Z Using /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.5119356Z Searching for certifi==2025.1.31 2025-03-14T05:55:59.5120110Z Best match: certifi 2025.1.31 2025-03-14T05:55:59.5120713Z Adding certifi 2025.1.31 to easy-install.pth file 2025-03-14T05:55:59.5129591Z 2025-03-14T05:55:59.5129748Z Using /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.5132544Z Searching for urllib3==1.26.20 2025-03-14T05:55:59.5133291Z Best match: urllib3 1.26.20 2025-03-14T05:55:59.5133923Z Adding urllib3 1.26.20 to easy-install.pth file 2025-03-14T05:55:59.5142504Z 2025-03-14T05:55:59.5142670Z Using /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.5145473Z Searching for idna==3.7 2025-03-14T05:55:59.5146222Z Best match: idna 3.7 2025-03-14T05:55:59.5146796Z Adding idna 3.7 to easy-install.pth file 2025-03-14T05:55:59.5154712Z 2025-03-14T05:55:59.5154883Z Using /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.5157751Z Searching for charset-normalizer==3.3.2 2025-03-14T05:55:59.5158500Z Best match: charset-normalizer 3.3.2 2025-03-14T05:55:59.5159569Z Adding charset-normalizer 3.3.2 to easy-install.pth file 2025-03-14T05:55:59.5167949Z Installing normalizer script to /opt/conda/bin 2025-03-14T05:55:59.5169465Z 2025-03-14T05:55:59.5169619Z Using /opt/conda/lib/python3.10/site-packages 2025-03-14T05:55:59.5170820Z Finished processing dependencies for torch-xla==2.7.0+gitb2b890e 2025-03-14T05:55:59.7823326Z + popd 2025-03-14T05:55:59.7823696Z /var/lib/jenkins/workspace 2025-03-14T05:55:59.7824032Z + assert_git_not_dirty 2025-03-14T05:55:59.7824356Z + [[ linux-focal-py3.9-clang9-xla != *rocm* ]] 2025-03-14T05:55:59.7824761Z + [[ linux-focal-py3.9-clang9-xla != *xla* ]] 2025-03-14T05:55:59.7825104Z + test_xla 2025-03-14T05:55:59.7825362Z ++ dirname .ci/pytorch/test.sh 2025-03-14T05:55:59.7849386Z + source .ci/pytorch/common-build.sh 2025-03-14T05:55:59.7859766Z ++ [[ linux-focal-py3.9-clang9-xla != *win-* ]] 2025-03-14T05:55:59.7867375Z ++++ dirname .ci/pytorch/common-build.sh 2025-03-14T05:55:59.7877119Z +++ cd .ci/pytorch 2025-03-14T05:55:59.7877776Z +++ pwd -P 2025-03-14T05:55:59.7880932Z ++ script_dir=/var/lib/jenkins/workspace/.ci/pytorch 2025-03-14T05:55:59.7881433Z ++ [[ linux-focal-py3.9-clang9-xla == *-pch* ]] 2025-03-14T05:55:59.7881814Z ++ which sccache 2025-03-14T05:55:59.7901692Z ++ sccache --stop-server 2025-03-14T05:55:59.7974570Z ++ rm -f /home/jenkins/sccache_error.log 2025-03-14T05:55:59.7998504Z ++ trap_add sccache_epilogue EXIT 2025-03-14T05:55:59.7999152Z ++ trap_add_cmd=sccache_epilogue 2025-03-14T05:55:59.7999467Z ++ shift 2025-03-14T05:55:59.7999712Z ++ for trap_add_name in "$@" 2025-03-14T05:55:59.8002542Z ++++ trap -p EXIT 2025-03-14T05:55:59.8005683Z +++ eval 'extract_trap_cmd trap -- '\'' 2025-03-14T05:55:59.8006024Z cleanup_workspace 2025-03-14T05:55:59.8006278Z sccache_epilogue 2025-03-14T05:55:59.8006544Z ccache_epilogue'\'' EXIT' 2025-03-14T05:55:59.8006849Z ++++ extract_trap_cmd trap -- ' 2025-03-14T05:55:59.8007152Z cleanup_workspace 2025-03-14T05:55:59.8007628Z sccache_epilogue 2025-03-14T05:55:59.8007940Z ccache_epilogue' EXIT 2025-03-14T05:55:59.8008285Z ++++ printf '%s\n' ' 2025-03-14T05:55:59.8008546Z cleanup_workspace 2025-03-14T05:55:59.8008794Z sccache_epilogue 2025-03-14T05:55:59.8009042Z ccache_epilogue' 2025-03-14T05:55:59.8009385Z +++ printf '%s\n' sccache_epilogue 2025-03-14T05:55:59.8009703Z ++ trap -- ' 2025-03-14T05:55:59.8009939Z cleanup_workspace 2025-03-14T05:55:59.8010187Z sccache_epilogue 2025-03-14T05:55:59.8010445Z ccache_epilogue 2025-03-14T05:55:59.8010773Z sccache_epilogue' EXIT 2025-03-14T05:55:59.8011156Z ++ [[ -n 1 ]] 2025-03-14T05:55:59.8011576Z ++ echo 'Skipping sccache server initialization, setting environment variables' 2025-03-14T05:55:59.8012206Z Skipping sccache server initialization, setting environment variables 2025-03-14T05:55:59.8012936Z ++ export SCCACHE_IDLE_TIMEOUT=0 2025-03-14T05:55:59.8013525Z ++ SCCACHE_IDLE_TIMEOUT=0 2025-03-14T05:55:59.8014012Z ++ export SCCACHE_ERROR_LOG=/home/jenkins/sccache_error.log 2025-03-14T05:55:59.8014583Z ++ SCCACHE_ERROR_LOG=/home/jenkins/sccache_error.log 2025-03-14T05:55:59.8015007Z ++ export RUST_LOG=sccache::server=error 2025-03-14T05:55:59.8015426Z ++ RUST_LOG=sccache::server=error 2025-03-14T05:55:59.8015747Z ++ sccache --zero-stats 2025-03-14T05:55:59.8209099Z Compile requests 0 2025-03-14T05:55:59.8209509Z Compile requests executed 0 2025-03-14T05:55:59.8209850Z Cache hits 0 2025-03-14T05:55:59.8210194Z Cache misses 0 2025-03-14T05:55:59.8210526Z Cache timeouts 0 2025-03-14T05:55:59.8210865Z Cache read errors 0 2025-03-14T05:55:59.8211197Z Forced recaches 0 2025-03-14T05:55:59.8211531Z Cache write errors 0 2025-03-14T05:55:59.8211865Z Compilation failures 0 2025-03-14T05:55:59.8212206Z Cache errors 0 2025-03-14T05:55:59.8212541Z Non-cacheable compilations 0 2025-03-14T05:55:59.8212888Z Non-cacheable calls 0 2025-03-14T05:55:59.8213383Z Non-compilation calls 0 2025-03-14T05:55:59.8213733Z Unsupported compiler calls 0 2025-03-14T05:55:59.8214082Z Average cache write 0.000 s 2025-03-14T05:55:59.8214429Z Average cache read miss 0.000 s 2025-03-14T05:55:59.8214765Z Average cache read hit 0.000 s 2025-03-14T05:55:59.8215119Z Failed distributed compilations 0 2025-03-14T05:55:59.8215937Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2025-03-14T05:55:59.8216713Z ++ which ccache 2025-03-14T05:55:59.8221298Z ++ ccache --zero-stats 2025-03-14T05:56:00.0554549Z Statistics zeroed 2025-03-14T05:56:00.0554907Z ++ ccache --show-stats 2025-03-14T05:56:00.0606420Z cache directory /home/jenkins/.cache/ccache 2025-03-14T05:56:00.0606986Z primary config /home/jenkins/.config/ccache/ccache.conf 2025-03-14T05:56:00.0607476Z secondary config (readonly) /etc/ccache.conf 2025-03-14T05:56:00.0607914Z stats updated Fri Mar 14 05:56:00 2025 2025-03-14T05:56:00.0608350Z stats zeroed Fri Mar 14 05:55:59 2025 2025-03-14T05:56:00.0608740Z cache hit (direct) 0 2025-03-14T05:56:00.0609086Z cache hit (preprocessed) 0 2025-03-14T05:56:00.0609560Z cache miss 0 2025-03-14T05:56:00.0609908Z cache hit rate 0.00 % 2025-03-14T05:56:00.0610256Z cleanups performed 0 2025-03-14T05:56:00.0610600Z files in cache 0 2025-03-14T05:56:00.0610934Z cache size 0.0 kB 2025-03-14T05:56:00.0611279Z max cache size 5.0 GB 2025-03-14T05:56:00.0611629Z ++ trap_add ccache_epilogue EXIT 2025-03-14T05:56:00.0611949Z ++ trap_add_cmd=ccache_epilogue 2025-03-14T05:56:00.0612298Z ++ shift 2025-03-14T05:56:00.0612542Z ++ for trap_add_name in "$@" 2025-03-14T05:56:00.0612845Z ++++ trap -p EXIT 2025-03-14T05:56:00.0615445Z +++ eval 'extract_trap_cmd trap -- '\'' 2025-03-14T05:56:00.0615782Z cleanup_workspace 2025-03-14T05:56:00.0616042Z sccache_epilogue 2025-03-14T05:56:00.0616300Z ccache_epilogue 2025-03-14T05:56:00.0616569Z sccache_epilogue'\'' EXIT' 2025-03-14T05:56:00.0616870Z ++++ extract_trap_cmd trap -- ' 2025-03-14T05:56:00.0617172Z cleanup_workspace 2025-03-14T05:56:00.0617428Z sccache_epilogue 2025-03-14T05:56:00.0617675Z ccache_epilogue 2025-03-14T05:56:00.0617925Z sccache_epilogue' EXIT 2025-03-14T05:56:00.0618196Z ++++ printf '%s\n' ' 2025-03-14T05:56:00.0618457Z cleanup_workspace 2025-03-14T05:56:00.0618709Z sccache_epilogue 2025-03-14T05:56:00.0618954Z ccache_epilogue 2025-03-14T05:56:00.0619198Z sccache_epilogue' 2025-03-14T05:56:00.0619518Z +++ printf '%s\n' ccache_epilogue 2025-03-14T05:56:00.0619830Z ++ trap -- ' 2025-03-14T05:56:00.0620070Z cleanup_workspace 2025-03-14T05:56:00.0620324Z sccache_epilogue 2025-03-14T05:56:00.0620575Z ccache_epilogue 2025-03-14T05:56:00.0620817Z sccache_epilogue 2025-03-14T05:56:00.0621070Z ccache_epilogue' EXIT 2025-03-14T05:56:00.0621351Z + clone_pytorch_xla 2025-03-14T05:56:00.0621602Z + [[ ! -d ./xla ]] 2025-03-14T05:56:00.0621872Z + source ./xla/.circleci/common.sh 2025-03-14T05:56:00.0622180Z ++ set -ex 2025-03-14T05:56:00.0622406Z ++ CONTINUE_ON_ERROR=false 2025-03-14T05:56:00.0622687Z ++ [[ false == \1 ]] 2025-03-14T05:56:00.0622993Z ++ export CMAKE_PREFIX_PATH=/opt/conda/bin/../ 2025-03-14T05:56:00.0623373Z ++ CMAKE_PREFIX_PATH=/opt/conda/bin/../ 2025-03-14T05:56:00.0623959Z +++ python3-config --prefix 2025-03-14T05:56:00.0805729Z ++ export LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2025-03-14T05:56:00.0806873Z ++ LD_LIBRARY_PATH=/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2025-03-14T05:56:00.0807880Z ++ echo /lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2025-03-14T05:56:00.0808944Z /lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2025-03-14T05:56:00.0809762Z ++ python -c 'from distutils.sysconfig import get_python_lib; print(get_python_lib())' 2025-03-14T05:56:00.1995310Z + SITE_PACKAGES=/opt/conda/lib/python3.10/site-packages 2025-03-14T05:56:00.1996256Z + export LD_LIBRARY_PATH=/opt/conda/lib/:/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2025-03-14T05:56:00.1997474Z + LD_LIBRARY_PATH=/opt/conda/lib/:/lib/x86_64-linux-gnu/:/usr/lib/x86_64-linux-gnu/:/opt/conda/lib/:/usr/local/cuda/lib64::/opt/conda/lib:/opt/conda/lib 2025-03-14T05:56:00.1998221Z ++ pwd 2025-03-14T05:56:00.2001350Z ++ pwd 2025-03-14T05:56:00.2003368Z + CMAKE_PREFIX_PATH=/opt/conda/lib/python3.10/site-packages/torch:/opt/conda/bin/../ 2025-03-14T05:56:00.2003902Z + XLA_SKIP_MP_OP_TESTS=1 2025-03-14T05:56:00.2004348Z + run_torch_xla_tests /var/lib/jenkins/workspace /var/lib/jenkins/workspace/xla 2025-03-14T05:56:00.2004963Z + PYTORCH_DIR=/var/lib/jenkins/workspace 2025-03-14T05:56:00.2005319Z + XLA_DIR=/var/lib/jenkins/workspace/xla 2025-03-14T05:56:00.2005644Z + USE_COVERAGE=0 2025-03-14T05:56:00.2005891Z + RUN_CPP= 2025-03-14T05:56:00.2006117Z + RUN_PYTHON= 2025-03-14T05:56:00.2007909Z ++ command -v nvidia-smi 2025-03-14T05:56:00.2011039Z + '[' -x '' ']' 2025-03-14T05:56:00.2011323Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=xla 2025-03-14T05:56:00.2011700Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=xla 2025-03-14T05:56:00.2016146Z ++ python -c 'import torch;print(int(torch._C._GLIBCXX_USE_CXX11_ABI))' 2025-03-14T05:56:00.2727372Z Traceback (most recent call last): 2025-03-14T05:56:00.2727776Z File "", line 1, in 2025-03-14T05:56:00.2728384Z File "/var/lib/jenkins/workspace/torch/__init__.py", line 73, in 2025-03-14T05:56:00.2728960Z from torch.torch_version import __version__ as __version__ 2025-03-14T05:56:00.2729538Z File "/var/lib/jenkins/workspace/torch/torch_version.py", line 5, in 2025-03-14T05:56:00.2730123Z from torch.version import __version__ as internal_version 2025-03-14T05:56:00.2730595Z ModuleNotFoundError: No module named 'torch.version' 2025-03-14T05:56:00.2802022Z + export CXX_ABI= 2025-03-14T05:56:00.2802758Z + CXX_ABI= 2025-03-14T05:56:00.2803063Z + [[ -z '' ]] 2025-03-14T05:56:00.2803321Z + [[ -z '' ]] 2025-03-14T05:56:00.2803631Z + [[ -z '' ]] 2025-03-14T05:56:00.2803858Z + [[ -z '' ]] 2025-03-14T05:56:00.2804300Z + run_torch_xla_python_tests /var/lib/jenkins/workspace /var/lib/jenkins/workspace/xla 0 2025-03-14T05:56:00.2804974Z + PYTORCH_DIR=/var/lib/jenkins/workspace 2025-03-14T05:56:00.2805481Z + XLA_DIR=/var/lib/jenkins/workspace/xla 2025-03-14T05:56:00.2805812Z + USE_COVERAGE=0 2025-03-14T05:56:00.2806093Z + pushd /var/lib/jenkins/workspace/xla 2025-03-14T05:56:00.2806515Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2025-03-14T05:56:00.2806938Z + echo 'Running Python Tests' 2025-03-14T05:56:00.2807238Z Running Python Tests 2025-03-14T05:56:00.2807497Z + '[' 0 '!=' 0 ']' 2025-03-14T05:56:00.2807743Z + ./test/run_tests.sh 2025-03-14T05:56:00.2825971Z /bin/bash: /opt/conda/lib/libtinfo.so.6: no version information available (required by /bin/bash) 2025-03-14T05:56:00.2841064Z +++ dirname ./test/run_tests.sh 2025-03-14T05:56:00.2846314Z ++ cd ./test 2025-03-14T05:56:00.2846568Z ++ pwd -P 2025-03-14T05:56:00.2848044Z + CDIR=/var/lib/jenkins/workspace/xla/test 2025-03-14T05:56:00.2848410Z + LOGFILE=/tmp/pytorch_py_test.log 2025-03-14T05:56:00.2848715Z + MAX_GRAPH_SIZE=500 2025-03-14T05:56:00.2848988Z + GRAPH_CHECK_FREQUENCY=100 2025-03-14T05:56:00.2849270Z + VERBOSITY=2 2025-03-14T05:56:00.2849661Z + source /var/lib/jenkins/workspace/xla/test/utils/run_tests_utils.sh 2025-03-14T05:56:00.2854489Z ++ set -exo pipefail 2025-03-14T05:56:00.2855663Z + CONTINUE_ON_ERROR=0 2025-03-14T05:56:00.2856050Z + [[ 0 == \1 ]] 2025-03-14T05:56:00.2856299Z + getopts LM:C:V: OPTION 2025-03-14T05:56:00.2856566Z + shift 0 2025-03-14T05:56:00.2856806Z + export TRIM_GRAPH_SIZE=500 2025-03-14T05:56:00.2857099Z + TRIM_GRAPH_SIZE=500 2025-03-14T05:56:00.2857394Z + export TRIM_GRAPH_CHECK_FREQUENCY=100 2025-03-14T05:56:00.2857751Z + TRIM_GRAPH_CHECK_FREQUENCY=100 2025-03-14T05:56:00.2858252Z + export TORCH_TEST_DEVICES=/var/lib/jenkins/workspace/xla/test/pytorch_test_base.py 2025-03-14T05:56:00.2858922Z + TORCH_TEST_DEVICES=/var/lib/jenkins/workspace/xla/test/pytorch_test_base.py 2025-03-14T05:56:00.2859419Z + export PYTORCH_TEST_WITH_SLOW=1 2025-03-14T05:56:00.2859742Z + PYTORCH_TEST_WITH_SLOW=1 2025-03-14T05:56:00.2860043Z + export XLA_DUMP_FATAL_STACK=1 2025-03-14T05:56:00.2860347Z + XLA_DUMP_FATAL_STACK=1 2025-03-14T05:56:00.2860632Z + export CPU_NUM_DEVICES=4 2025-03-14T05:56:00.2860902Z + CPU_NUM_DEVICES=4 2025-03-14T05:56:00.2861158Z ++ cd /home/jenkins 2025-03-14T05:56:00.2863338Z +++ python -c 'import torch_xla; print(torch_xla.__file__)' 2025-03-14T05:56:04.3042361Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2025-03-14T05:56:04.8983559Z ++ dirname /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/__init__.py 2025-03-14T05:56:04.8988221Z + TORCH_XLA_DIR=/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla 2025-03-14T05:56:04.8989242Z + COVERAGE_FILE=/var/lib/jenkins/workspace/xla/test/../.coverage 2025-03-14T05:56:04.8995421Z + '[' /tmp/pytorch_py_test.log '!=' '' ']' 2025-03-14T05:56:04.8997989Z + run_tests 2025-03-14T05:56:04.8999708Z + tee /tmp/pytorch_py_test.log 2025-03-14T05:56:04.9030803Z + [[ '' == \x\l\a\_\o\p\1 ]] 2025-03-14T05:56:04.9031162Z + [[ '' == \x\l\a\_\o\p\2 ]] 2025-03-14T05:56:04.9031522Z + [[ '' == \x\l\a\_\o\p\3 ]] 2025-03-14T05:56:04.9031809Z + [[ '' == \t\o\r\c\h\_\m\p\_\o\p ]] 2025-03-14T05:56:04.9032116Z + [[ '' != \1 ]] 2025-03-14T05:56:04.9032509Z + run_xla_op_tests1 2025-03-14T05:56:04.9032988Z + run_dynamic /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:04.9033802Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2025-03-14T05:56:04.9034675Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:04.9035352Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T05:56:04.9035937Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:04.9036697Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2025-03-14T05:56:04.9037515Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:04.9038173Z ++ command -v nvidia-smi 2025-03-14T05:56:04.9038458Z + '[' -x '' ']' 2025-03-14T05:56:04.9038708Z + PJRT_DEVICE=CPU 2025-03-14T05:56:04.9038974Z + CPU_NUM_DEVICES=1 2025-03-14T05:56:04.9039436Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:04.9039952Z + '[' 0 '!=' 0 ']' 2025-03-14T05:56:04.9040382Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:08.7239205Z test_mp_decorator (__main__.MpDecoratorTest) ... ok 2025-03-14T05:56:08.7241715Z test_multi_init_xla_backend (__main__.RegisterXLAKeyTest) ... ok 2025-03-14T05:56:08.7371877Z test_dropout (__main__.TestActivationCheckpoint) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:93: DeprecationWarning: torch.get_autocast_gpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cuda') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:828.) 2025-03-14T05:56:08.7373726Z "dtype": torch.get_autocast_gpu_dtype(), 2025-03-14T05:56:08.7375303Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:97: DeprecationWarning: torch.is_autocast_cpu_enabled() is deprecated. Please use torch.is_autocast_enabled('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:704.) 2025-03-14T05:56:08.7377067Z "enabled": torch.is_autocast_cpu_enabled(), 2025-03-14T05:56:08.7378628Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:98: DeprecationWarning: torch.get_autocast_cpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:837.) 2025-03-14T05:56:08.7380181Z "dtype": torch.get_autocast_cpu_dtype(), 2025-03-14T05:56:08.7642736Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:183: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead. 2025-03-14T05:56:08.7644056Z torch.cuda.amp.autocast(**ctx.gpu_autocast_kwargs), \ 2025-03-14T05:56:08.7645432Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:184: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead. 2025-03-14T05:56:08.7646857Z torch.cpu.amp.autocast(**ctx.cpu_autocast_kwargs): 2025-03-14T05:56:09.1088145Z ok 2025-03-14T05:56:09.1127342Z test_opt_barrier (__main__.TestActivationCheckpoint) ... ok 2025-03-14T05:56:09.1138550Z test (__main__.TestAtenTensorTo) ... ok 2025-03-14T05:56:09.2300105Z test_add_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.3065010Z test_addmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.3754368Z test_ailing_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.5561418Z test_amp_foreach_non_finite_check_and_unscale_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.6163536Z test_amp_norm_append_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.6625041Z test_arange_nan (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.7037435Z test_as_strided_r1 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.7514669Z test_as_strided_r1_dim1 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.7971452Z test_as_strided_r1_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.8446577Z test_as_strided_r1_t (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.8926794Z test_as_strided_r1_t_off (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:09.9396644Z test_as_strided_r1_t_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.0003369Z test_as_strided_r2_t_update (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.0443540Z test_as_strided_with_empty_args (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.0921769Z test_as_strided_with_gap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.1404758Z test_as_strided_with_gap_no_unit_stride (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.1881092Z test_as_strided_with_overlap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.2359087Z test_as_strided_with_overlap_and_gap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.2365191Z test_as_strided_with_overlap_zero_stride (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:990.) 2025-03-14T05:56:10.2367319Z expected[nan_mask] = 0 2025-03-14T05:56:10.2368951Z /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:2486.) 2025-03-14T05:56:10.2370788Z expected[nan_mask] = 0 2025-03-14T05:56:10.2372409Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:990.) 2025-03-14T05:56:10.2374073Z expected[inf_mask] = 0 2025-03-14T05:56:10.2375686Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:2486.) 2025-03-14T05:56:10.2377327Z expected[inf_mask] = 0 2025-03-14T05:56:10.2377594Z ok 2025-03-14T05:56:10.3097509Z test_baddmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.3743773Z test_basic_bfloat16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.4210352Z test_bfloat16_float32_cast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.6247685Z test_binaryop_order (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.6692920Z test_bitwise_and_not (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.6699020Z test_byte_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.8422643Z test_cached_addcdiv (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.8822088Z test_cat_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:10.9464442Z test_clamp (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.0242629Z test_clip_grad_norm_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.0645110Z test_clip_grad_norm_zero (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.1949234Z test_conv2d_backward (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.3328157Z test_deepcopy (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.3812856Z test_diagonal_scatter_negative_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.4385958Z test_diagonal_write (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.4977151Z test_diagonal_write_transposed (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.5646767Z test_diagonal_write_transposed_r3 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.6747041Z test_div_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.6936710Z test_emb_bf16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:11.9718371Z test_embedding_bag_backward_fallback (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/graph.py:824: UserWarning: XLA does not support EmbeddingBag sparse backward function. Falling back to the dense function. (Triggered internally at torch_xla/csrc/aten_xla_type.cpp:1515.) 2025-03-14T05:56:11.9721764Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-03-14T05:56:11.9828132Z ok 2025-03-14T05:56:12.1088172Z test_embedding_int_indices (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.1248616Z test_empty_advanced_indexing (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.1250134Z test_empty_strided (__main__.TestAtenXlaTensor) ... skipped 'grad_input produces wrong results after functionalization. pytorch/pytorch#91199' 2025-03-14T05:56:12.1782126Z test_expand_default (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.5040980Z test_flip (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.5860860Z test_flip_check_throws (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.5863174Z test_flip_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.6734678Z test_flip_expand (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.7647958Z test_flip_rectangular (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.7662406Z test_flip_shape (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.8151806Z test_float32_bfloat16_cast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:12.8603074Z test_frac_negative (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:13.4282267Z test_gelu_backward_different_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:13.4288992Z test_get_real_xla_devices (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:13.4892266Z test_index_bool (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:13.5768760Z test_index_put (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:13.6328848Z test_index_select_0dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:13.7392496Z test_index_select_out (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:13.9368527Z test_index_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.1366514Z test_index_zero_tensor_by_zero_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.1825207Z test_inplace_copy_different_sizes (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.2579772Z test_inplace_mul_scalar_different_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.3069764Z test_inplace_view_backprop_base (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.3620340Z test_inplace_view_backprop_view (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:994: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /var/lib/jenkins/workspace/build/aten/src/ATen/core/TensorBody.h:494.) 2025-03-14T05:56:14.3623248Z self.assertIsNone(a.grad) 2025-03-14T05:56:14.3623555Z ok 2025-03-14T05:56:14.4104109Z test_inplace_view_backprop_view_of_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.4677874Z test_inplace_view_gradcheck (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.5153688Z test_inplace_view_makes_base_require_grad (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.5873336Z test_inplace_view_modify_base (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.6190769Z test_inplace_view_multiple_outputs (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.6687855Z test_inplace_view_non_contig (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.7189027Z test_inplace_view_of_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.8206301Z test_inplace_view_python (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.9172632Z test_manual_seed (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:14.9665081Z test_masked_fill_in_out_place (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:15.0169479Z test_masked_fill_with_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:15.2521935Z test_matmul_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:15.2983129Z test_max_broadcast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:15.4014999Z test_mul_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:15.7083887Z test_multi_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:15.7576943Z test_nan_to_num_in_place (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:15.7594337Z test_nan_to_num_in_place_with_inf (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:15.9595938Z test_native_dropout_backward (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.0070135Z test_negative_cat (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.0536622Z test_negative_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.0550594Z test_no_storage (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.0556208Z test_norm_p0 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.1152956Z test_one_hot_no_fallback (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.3327688Z test_patched_linear_1D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.5169262Z test_patched_linear_2D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.6580061Z test_patched_linear_3D (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.7502098Z test_patched_linear_3D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:16.7505550Z test_pow_constant (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.0274915Z test_pow_dtype_promotion (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.1684920Z test_pow_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.2169244Z test_pred_and_u8 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.3767898Z test_pred_one_hot (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.6279712Z test_pred_type (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.6284641Z test_print (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.8559812Z test_print_executation (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.8563521Z test_rand (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.8570645Z test_rand_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.8576378Z test_randint_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.8581761Z test_randn_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:17.8599670Z test_randperm (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.1754029Z test_reduction_0dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.2252801Z test_reduction_unordered_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.3090684Z test_replace_xla_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.4054117Z test_rrelu_module (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.4060356Z test_s_copy_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.5074153Z test_save (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.5150039Z test_save_api (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.6125018Z test_save_bf16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.6149007Z test_save_tuple (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.6149884Z test_save_view_alias_check (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is not disabled. Reason: views do not exist.' 2025-03-14T05:56:18.6709887Z test_scatter_add_bool (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.7254483Z test_scatter_add_small_target (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.7367509Z test_serialization_api (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.7368014Z test_set (__main__.TestAtenXlaTensor) ... skipped '' 2025-03-14T05:56:18.8329710Z test_sgn (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:18.9876332Z test_sigmoid_bounds (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:19.0343269Z test_slice_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:19.0864725Z test_slice_copy (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:21.1794963Z test_slice_rnd_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:21.2196057Z test_slice_start_end (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:21.2656094Z test_slice_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:21.3126686Z test_slice_stepped_other_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:21.3130391Z test_slice_zero_sized_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:21.3530860Z test_split_empty_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:22.0782330Z test_spooky_ailing (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:22.2116067Z test_squeeze_nonzero (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:22.2615038Z test_stack_different_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:22.3110114Z test_stack_pred (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:22.4056390Z test_sub_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.0374819Z test_too_many_parameter (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.0383346Z test_transpose_1d (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.0391440Z test_transpose_1d_inplace (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.1912288Z test_trilinear_interpolate (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.1919149Z test_upsample_bilinear_double (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2258: UserWarning: `nn.functional.upsample_bilinear` is deprecated. Use `nn.functional.interpolate` instead. 2025-03-14T05:56:32.1921388Z r = torch.nn.functional.upsample_bilinear(x, scale_factor=2) 2025-03-14T05:56:32.3076879Z ok 2025-03-14T05:56:32.4192932Z test_view_1718 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.7077618Z test_view_and_copy_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.7875522Z test_view_and_multi_mark_step (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.7891198Z test_view_as_complex_f32 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.7913170Z test_view_as_complex_f64 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.7926750Z test_view_as_real_c128 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.7945803Z test_view_as_real_c64 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.8033242Z test_view_empty (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.8929004Z test_view_out_computation (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:32.9395940Z test_writeable_tensors_updates (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:33.0708979Z test_cross_entropy_loss (__main__.TestBinaryCrossEntropyLimitValue) ... ok 2025-03-14T05:56:33.0709648Z test_dlpack_non_default_layout (__main__.TestDLPack) 2025-03-14T05:56:33.0710226Z TestDLPack.test_dlpack_non_default_layout ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.0710836Z test_dlpack_pytorch_cuda_to_xla (__main__.TestDLPack) 2025-03-14T05:56:33.0711598Z TestDLPack.test_dlpack_pytorch_cuda_to_xla ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.0712268Z test_dlpack_pytorch_cuda_to_xla_protocol_conversion (__main__.TestDLPack) 2025-03-14T05:56:33.0713008Z TestDLPack.test_dlpack_pytorch_cuda_to_xla_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.0713661Z test_dlpack_roundtrip_bool (__main__.TestDLPack) 2025-03-14T05:56:33.0714206Z TestDLPack.test_dlpack_roundtrip_bool ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.0714758Z test_dlpack_roundtrip_scalar (__main__.TestDLPack) 2025-03-14T05:56:33.0715142Z TestDLPack.test_dlpack_roundtrip_scalar 2025-03-14T05:56:33.0715724Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.0716346Z test_dlpack_roundtrip_tensor (__main__.TestDLPack) 2025-03-14T05:56:33.0716811Z TestDLPack.test_dlpack_roundtrip_tensor 2025-03-14T05:56:33.0717397Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.0718036Z test_dlpack_xla_to_pytorch_cuda (__main__.TestDLPack) 2025-03-14T05:56:33.0718621Z TestDLPack.test_dlpack_xla_to_pytorch_cuda ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.0719266Z test_dlpack_xla_to_pytorch_cuda_protocol_conversion (__main__.TestDLPack) 2025-03-14T05:56:33.0719997Z TestDLPack.test_dlpack_xla_to_pytorch_cuda_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.0720671Z test_mixed_dtype_tuple (__main__.TestDataType) ... ok 2025-03-14T05:56:33.1102681Z test_get_xla_tensor_debug_info (__main__.TestDebuggingUtil) ... ok 2025-03-14T05:56:33.2047816Z test_masked_select_shape (__main__.TestDynamicShape) ... ok 2025-03-14T05:56:33.3246882Z test_nonzero_cast (__main__.TestDynamicShape) ... ok 2025-03-14T05:56:33.4207074Z test_nonzero_shape (__main__.TestDynamicShape) ... ok 2025-03-14T05:56:33.5053691Z test_as_strided_input_larger (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.5054356Z test_aten_move_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.5055297Z test_aten_move_scalar_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:56:33.5060741Z test_data_wrapper (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.5064381Z test_git_revisons (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.5068939Z test_send_to_device_grad (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.5074508Z test_send_to_device_single (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.5454678Z test_unsafe_buffer_pointer (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.5458896Z test_util_foreach_api (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.5462820Z test_util_foreach_api_cycle (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.5467139Z test_zeros_like_patch (__main__.TestGeneric) ... ok 2025-03-14T05:56:33.6827584Z test_repeat_extended (__main__.TestHelperFunction) ... ok 2025-03-14T05:56:33.8138217Z test_repeat_special (__main__.TestHelperFunction) ... ok 2025-03-14T05:56:33.9437601Z test_repeat_truncated (__main__.TestHelperFunction) ... ok 2025-03-14T05:56:34.0423225Z test_inter_op_sync (__main__.TestInterOpSyncTensors) ... ok 2025-03-14T05:56:34.5607924Z test (__main__.TestLongGraphChain) ... ok 2025-03-14T05:56:34.5636444Z test_api (__main__.TestLoweringContext) ... ok 2025-03-14T05:56:34.5636938Z test_get_parameters_scalar (__main__.TestLoweringContext) 2025-03-14T05:56:34.5684483Z Scalar tensors parameters may be shared in the HLO graph if their ... ok 2025-03-14T05:56:34.8522872Z test (__main__.TestModelComparator) ... ok 2025-03-14T05:56:35.0973251Z test_legacy (__main__.TestNMS) ... ok 2025-03-14T05:56:35.1467880Z test_nms_input_errors (__main__.TestNMS) ... ok 2025-03-14T05:56:35.6862802Z test_nms_ref (__main__.TestNMS) ... ok 2025-03-14T05:56:35.7412417Z test_nll_loss_inf (__main__.TestNllLossLimitValue) ... ok 2025-03-14T05:56:35.7435183Z test_nll_loss_nan (__main__.TestNllLossLimitValue) ... ok 2025-03-14T05:56:35.7888214Z test_add (__main__.TestOpBuilder) ... ok 2025-03-14T05:56:35.8840099Z test_conditional (__main__.TestOpBuilder) ... ok 2025-03-14T05:56:35.9293294Z test_mul (__main__.TestOpBuilder) ... ok 2025-03-14T05:56:35.9321024Z test_triangular_solve (__main__.TestOpBuilder) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2576: UserWarning: torch.triangular_solve is deprecated in favor of torch.linalg.solve_triangularand will be removed in a future PyTorch release. 2025-03-14T05:56:35.9323763Z torch.linalg.solve_triangular has its arguments reversed and does not return a copy of one of the inputs. 2025-03-14T05:56:35.9324923Z X = torch.triangular_solve(B, A).solution 2025-03-14T05:56:35.9325511Z should be replaced with 2025-03-14T05:56:35.9326792Z X = torch.linalg.solve_triangular(A, B). (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:2261.) 2025-03-14T05:56:35.9328373Z return torch.triangular_solve( 2025-03-14T05:56:35.9896039Z ok 2025-03-14T05:56:36.0405592Z test_while (__main__.TestOpBuilder) ... ok 2025-03-14T05:56:36.0411516Z test_optimization_barrier_correctness (__main__.TestOptimizationBarrier) ... ok 2025-03-14T05:56:36.0438307Z test (__main__.TestParallelLoader) ... ok 2025-03-14T05:56:36.4360861Z test (__main__.TestParallelTensorMNIST) ... ok 2025-03-14T05:56:37.3429813Z test_random_from_to_bool (__main__.TestRandom) ... ok 2025-03-14T05:56:37.4865834Z test_get_xla_tensor (__main__.TestSelect) ... ok 2025-03-14T05:56:37.6269732Z test_masked_fill_scalar (__main__.TestSelect) ... ok 2025-03-14T05:56:37.6273247Z test (__main__.TestToXlaTensorArena) ... ok 2025-03-14T05:56:39.4080263Z test_wait_device_ops (__main__.TestWaitDeviceOps) ... ok 2025-03-14T05:56:39.4212541Z test_non_empty_scope (__main__.XpTraceTest) ... ok 2025-03-14T05:56:39.4336471Z test_non_empty_scope_decorator (__main__.XpTraceTest) ... ok 2025-03-14T05:56:39.4336873Z 2025-03-14T05:56:39.4337051Z ---------------------------------------------------------------------- 2025-03-14T05:56:39.4337447Z Ran 205 tests in 30.742s 2025-03-14T05:56:39.4337848Z 2025-03-14T05:56:39.4337947Z OK (skipped=13) 2025-03-14T05:56:39.4814391Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:56:39.4814887Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:56:39.4815346Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:56:39.4815818Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:56:39.4816268Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:56:39.4816714Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:56:39.4817120Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:56:39.4817462Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:56:39.4817820Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:56:40.3926634Z + run_dynamic /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2025-03-14T05:56:40.3927491Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py' 2025-03-14T05:56:40.3936043Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2025-03-14T05:56:40.3936798Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T05:56:40.3937359Z + run_test /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2025-03-14T05:56:40.3938233Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py' 2025-03-14T05:56:40.3938994Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2025-03-14T05:56:40.3939533Z ++ command -v nvidia-smi 2025-03-14T05:56:40.3939832Z + '[' -x '' ']' 2025-03-14T05:56:40.3940079Z + PJRT_DEVICE=CPU 2025-03-14T05:56:40.3940336Z + CPU_NUM_DEVICES=1 2025-03-14T05:56:40.3940755Z + run_coverage /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2025-03-14T05:56:40.3941306Z + '[' 0 '!=' 0 ']' 2025-03-14T05:56:40.3941714Z + python3 /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shapes.py 2025-03-14T05:56:45.7684478Z .................................. 2025-03-14T05:56:45.7685082Z ---------------------------------------------------------------------- 2025-03-14T05:56:45.7685494Z Ran 34 tests in 2.205s 2025-03-14T05:56:45.7685665Z 2025-03-14T05:56:45.7685768Z OK 2025-03-14T05:56:46.3993666Z + run_dynamic /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2025-03-14T05:56:46.3994809Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py' --verbosity=2 2025-03-14T05:56:46.3995808Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2025-03-14T05:56:46.3996636Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T05:56:46.3997537Z + run_test /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2025-03-14T05:56:46.3998426Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py' --verbosity=2 2025-03-14T05:56:46.3999375Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2025-03-14T05:56:46.4000014Z ++ command -v nvidia-smi 2025-03-14T05:56:46.4000299Z + '[' -x '' ']' 2025-03-14T05:56:46.4000550Z + PJRT_DEVICE=CPU 2025-03-14T05:56:46.4000811Z + CPU_NUM_DEVICES=1 2025-03-14T05:56:46.4001338Z + run_coverage /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2025-03-14T05:56:46.4001933Z + '[' 0 '!=' 0 ']' 2025-03-14T05:56:46.4002427Z + python3 /var/lib/jenkins/workspace/xla/test/ds/test_dynamic_shape_models.py --verbosity=2 2025-03-14T05:56:49.5814472Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:99: UserWarning: `devkind` argument is deprecated and will be removed in a future release. 2025-03-14T05:56:49.5815724Z warnings.warn("`devkind` argument is deprecated and will be removed in a " 2025-03-14T05:56:49.5830847Z test_backward_pass_with_dynamic_input (__main__.TestDynamicShapeModels) ... skipped 'The tests fail on CPU. See https://github.com/pytorch/xla/issues/4298 for more detail.' 2025-03-14T05:56:49.5832277Z test_forward_pass_dynamic_input_compile_once (__main__.TestDynamicShapeModels) ... skipped 'The tests fail on CPU. See https://github.com/pytorch/xla/issues/4298 for more detail.' 2025-03-14T05:56:49.5833708Z test_forward_pass_dynamic_input_correctness (__main__.TestDynamicShapeModels) ... skipped 'The tests fail on CPU. See https://github.com/pytorch/xla/issues/4298 for more detail.' 2025-03-14T05:56:49.5834483Z 2025-03-14T05:56:49.5834656Z ---------------------------------------------------------------------- 2025-03-14T05:56:49.5835053Z Ran 3 tests in 0.000s 2025-03-14T05:56:49.5835237Z 2025-03-14T05:56:49.5835335Z OK (skipped=3) 2025-03-14T05:56:50.1996932Z + run_eager_debug /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:50.1997875Z + echo 'Running in Eager Debug mode: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2025-03-14T05:56:50.1998738Z Running in Eager Debug mode: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:50.1999335Z + XLA_USE_EAGER_DEBUG_MODE=1 2025-03-14T05:56:50.1999821Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:50.2000786Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2025-03-14T05:56:50.2001634Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:50.2002203Z ++ command -v nvidia-smi 2025-03-14T05:56:50.2002491Z + '[' -x '' ']' 2025-03-14T05:56:50.2002757Z + PJRT_DEVICE=CPU 2025-03-14T05:56:50.2003004Z + CPU_NUM_DEVICES=1 2025-03-14T05:56:50.2003537Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:50.2004057Z + '[' 0 '!=' 0 ']' 2025-03-14T05:56:50.2004490Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:56:53.8968028Z test_mp_decorator (__main__.MpDecoratorTest) ... ok 2025-03-14T05:56:53.8974308Z test_multi_init_xla_backend (__main__.RegisterXLAKeyTest) ... ok 2025-03-14T05:56:54.0548667Z test_dropout (__main__.TestActivationCheckpoint) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:93: DeprecationWarning: torch.get_autocast_gpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cuda') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:828.) 2025-03-14T05:56:54.0550583Z "dtype": torch.get_autocast_gpu_dtype(), 2025-03-14T05:56:54.0552189Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:97: DeprecationWarning: torch.is_autocast_cpu_enabled() is deprecated. Please use torch.is_autocast_enabled('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:704.) 2025-03-14T05:56:54.0554069Z "enabled": torch.is_autocast_cpu_enabled(), 2025-03-14T05:56:54.0555631Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:98: DeprecationWarning: torch.get_autocast_cpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:837.) 2025-03-14T05:56:54.0557187Z "dtype": torch.get_autocast_cpu_dtype(), 2025-03-14T05:56:54.7374339Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:183: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead. 2025-03-14T05:56:54.7375709Z torch.cuda.amp.autocast(**ctx.gpu_autocast_kwargs), \ 2025-03-14T05:56:54.7376965Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:184: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead. 2025-03-14T05:56:54.9006790Z torch.cpu.amp.autocast(**ctx.cpu_autocast_kwargs): 2025-03-14T05:56:54.9007257Z ok 2025-03-14T05:56:54.9041512Z test_opt_barrier (__main__.TestActivationCheckpoint) ... ok 2025-03-14T05:56:54.9522929Z test (__main__.TestAtenTensorTo) ... ok 2025-03-14T05:56:55.1087030Z test_add_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:55.2551781Z test_addmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:55.4707670Z test_ailing_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:55.6039186Z test_amp_foreach_non_finite_check_and_unscale_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:55.7017381Z test_amp_norm_append_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:55.7751891Z test_arange_nan (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:55.8695144Z test_as_strided_r1 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:55.9704412Z test_as_strided_r1_dim1 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:56.0647483Z test_as_strided_r1_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:56.1173659Z test_as_strided_r1_t (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:56.2175876Z test_as_strided_r1_t_off (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:56.2704522Z test_as_strided_r1_t_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:56.9247246Z test_as_strided_r2_t_update (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:57.0195360Z test_as_strided_with_empty_args (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:57.1787380Z test_as_strided_with_gap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:57.2720110Z test_as_strided_with_gap_no_unit_stride (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:57.3692290Z test_as_strided_with_overlap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:57.4675479Z test_as_strided_with_overlap_and_gap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:57.4682308Z test_as_strided_with_overlap_zero_stride (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:990.) 2025-03-14T05:56:57.4684273Z expected[nan_mask] = 0 2025-03-14T05:56:57.4686012Z /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:2486.) 2025-03-14T05:56:57.4687894Z expected[nan_mask] = 0 2025-03-14T05:56:57.4689520Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:990.) 2025-03-14T05:56:57.4691175Z expected[inf_mask] = 0 2025-03-14T05:56:57.4692785Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:2486.) 2025-03-14T05:56:57.4694451Z expected[inf_mask] = 0 2025-03-14T05:56:57.4694705Z ok 2025-03-14T05:56:57.6591547Z test_baddmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:57.9046761Z test_basic_bfloat16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:57.9527455Z test_bfloat16_float32_cast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:58.1385193Z test_binaryop_order (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:58.2664938Z test_bitwise_and_not (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:58.3548205Z test_byte_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:58.4415519Z test_cached_addcdiv (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:58.5284990Z test_cat_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:58.6206869Z test_clamp (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:59.3121892Z test_clip_grad_norm_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:59.3124825Z test_clip_grad_norm_zero (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:59.6007054Z test_conv2d_backward (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:59.7810421Z test_deepcopy (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:56:59.8721552Z test_diagonal_scatter_negative_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:00.1521893Z test_diagonal_write (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:00.2526767Z test_diagonal_write_transposed (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:00.5867286Z test_diagonal_write_transposed_r3 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:00.6762103Z test_div_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:01.0711403Z test_emb_bf16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:01.5159949Z test_embedding_bag_backward_fallback (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/graph.py:824: UserWarning: XLA does not support EmbeddingBag sparse backward function. Falling back to the dense function. (Triggered internally at torch_xla/csrc/aten_xla_type.cpp:1515.) 2025-03-14T05:57:01.5163358Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-03-14T05:57:01.5186710Z ok 2025-03-14T05:57:01.9893983Z test_embedding_int_indices (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:02.1286681Z test_empty_advanced_indexing (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:02.1287576Z test_empty_strided (__main__.TestAtenXlaTensor) ... skipped 'grad_input produces wrong results after functionalization. pytorch/pytorch#91199' 2025-03-14T05:57:02.2168005Z test_expand_default (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:02.6166208Z test_flip (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:02.6306904Z test_flip_check_throws (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:02.6307457Z test_flip_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:02.8817431Z test_flip_expand (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:02.9715717Z test_flip_rectangular (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:03.3983804Z test_flip_shape (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:03.3998670Z test_float32_bfloat16_cast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:03.4396797Z test_frac_negative (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:03.5124540Z test_gelu_backward_different_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:03.5131819Z test_get_real_xla_devices (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:03.8783684Z test_index_bool (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:04.2445878Z test_index_put (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:04.3251591Z test_index_select_0dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:04.6453497Z test_index_select_out (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:05.3896570Z test_index_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:06.3488243Z test_index_zero_tensor_by_zero_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:06.4843977Z test_inplace_copy_different_sizes (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:06.8236352Z test_inplace_mul_scalar_different_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:07.1673943Z test_inplace_view_backprop_base (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:07.4411367Z test_inplace_view_backprop_view (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:994: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /var/lib/jenkins/workspace/build/aten/src/ATen/core/TensorBody.h:494.) 2025-03-14T05:57:07.4414174Z self.assertIsNone(a.grad) 2025-03-14T05:57:07.4414468Z ok 2025-03-14T05:57:07.5376304Z test_inplace_view_backprop_view_of_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:07.9919610Z test_inplace_view_gradcheck (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:08.0869472Z test_inplace_view_makes_base_require_grad (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:08.2670033Z test_inplace_view_modify_base (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:08.6126768Z test_inplace_view_multiple_outputs (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:09.2448225Z test_inplace_view_non_contig (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:09.2471603Z test_inplace_view_of_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:09.2509496Z test_inplace_view_python (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:09.3962244Z test_manual_seed (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:09.5294820Z test_masked_fill_in_out_place (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:09.7063004Z test_masked_fill_with_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:10.4088525Z test_matmul_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:10.4978519Z test_max_broadcast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:10.5891051Z test_mul_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:10.8961127Z test_multi_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:10.9445786Z test_nan_to_num_in_place (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:10.9465596Z test_nan_to_num_in_place_with_inf (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:11.4132992Z test_native_dropout_backward (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:11.4607248Z test_negative_cat (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:11.7032230Z test_negative_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:11.8019689Z test_no_storage (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:11.8027356Z test_norm_p0 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:11.9534113Z test_one_hot_no_fallback (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:12.2606963Z test_patched_linear_1D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:12.5491131Z test_patched_linear_2D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:12.8426060Z test_patched_linear_3D (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:12.9953972Z test_patched_linear_3D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:12.9954671Z test_pow_constant (__main__.TestAtenXlaTensor) ... skipped 'skip on eager debug mode' 2025-03-14T05:57:13.4534969Z test_pow_dtype_promotion (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:13.6417582Z test_pow_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:14.0404035Z test_pred_and_u8 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:14.6270488Z test_pred_one_hot (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:15.1281054Z test_pred_type (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:15.1285518Z test_print (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:15.1286549Z test_print_executation (__main__.TestAtenXlaTensor) ... skipped 'skip on eager debug mode' 2025-03-14T05:57:15.2747638Z test_rand (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:15.4113899Z test_rand_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:15.5339160Z test_randint_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:15.6286156Z test_randn_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:15.6868213Z test_randperm (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:16.1526948Z test_reduction_0dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:16.2492157Z test_reduction_unordered_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:16.3413215Z test_replace_xla_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:16.5292780Z test_rrelu_module (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:16.8618906Z test_s_copy_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:16.8666613Z test_save (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:17.1087200Z test_save_api (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:17.2550193Z test_save_bf16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:17.2570696Z test_save_tuple (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:17.2571627Z test_save_view_alias_check (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is not disabled. Reason: views do not exist.' 2025-03-14T05:57:17.4062998Z test_scatter_add_bool (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:17.5554778Z test_scatter_add_small_target (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:17.5663817Z test_serialization_api (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:17.5664337Z test_set (__main__.TestAtenXlaTensor) ... skipped '' 2025-03-14T05:57:17.6984067Z test_sgn (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:18.0165229Z test_sigmoid_bounds (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:18.4775258Z test_slice_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:18.7860357Z test_slice_copy (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:23.9438673Z test_slice_rnd_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:24.1322370Z test_slice_start_end (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:24.4154205Z test_slice_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:24.5645507Z test_slice_stepped_other_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:24.9004377Z test_slice_zero_sized_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:24.9843121Z test_split_empty_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:26.4281330Z test_spooky_ailing (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:26.5647925Z test_squeeze_nonzero (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:26.6131046Z test_stack_different_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:27.2784963Z test_stack_pred (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:27.3746634Z test_sub_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:27.9033695Z test_too_many_parameter (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:27.9038061Z test_transpose_1d (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:27.9045038Z test_transpose_1d_inplace (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:30.4077618Z test_trilinear_interpolate (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:30.4615231Z test_upsample_bilinear_double (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2258: UserWarning: `nn.functional.upsample_bilinear` is deprecated. Use `nn.functional.interpolate` instead. 2025-03-14T05:57:30.4617461Z r = torch.nn.functional.upsample_bilinear(x, scale_factor=2) 2025-03-14T05:57:30.5817479Z ok 2025-03-14T05:57:31.4248379Z test_view_1718 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:31.9331690Z test_view_and_copy_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:32.1213700Z test_view_and_multi_mark_step (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:32.2675404Z test_view_as_complex_f32 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:32.4426907Z test_view_as_complex_f64 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:32.6354830Z test_view_as_real_c128 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:32.8368631Z test_view_as_real_c64 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:32.8387762Z test_view_empty (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:32.9677679Z test_view_out_computation (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:33.0606519Z test_writeable_tensors_updates (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:33.1067852Z test_cross_entropy_loss (__main__.TestBinaryCrossEntropyLimitValue) ... ok 2025-03-14T05:57:33.1068427Z test_dlpack_non_default_layout (__main__.TestDLPack) 2025-03-14T05:57:33.1069000Z TestDLPack.test_dlpack_non_default_layout ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.1069599Z test_dlpack_pytorch_cuda_to_xla (__main__.TestDLPack) 2025-03-14T05:57:33.1070174Z TestDLPack.test_dlpack_pytorch_cuda_to_xla ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.1070830Z test_dlpack_pytorch_cuda_to_xla_protocol_conversion (__main__.TestDLPack) 2025-03-14T05:57:33.1071570Z TestDLPack.test_dlpack_pytorch_cuda_to_xla_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.1072217Z test_dlpack_roundtrip_bool (__main__.TestDLPack) 2025-03-14T05:57:33.1072756Z TestDLPack.test_dlpack_roundtrip_bool ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.1073484Z test_dlpack_roundtrip_scalar (__main__.TestDLPack) 2025-03-14T05:57:33.1073885Z TestDLPack.test_dlpack_roundtrip_scalar 2025-03-14T05:57:33.1074476Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.1075099Z test_dlpack_roundtrip_tensor (__main__.TestDLPack) 2025-03-14T05:57:33.1075499Z TestDLPack.test_dlpack_roundtrip_tensor 2025-03-14T05:57:33.1076083Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.1076767Z test_dlpack_xla_to_pytorch_cuda (__main__.TestDLPack) 2025-03-14T05:57:33.1077346Z TestDLPack.test_dlpack_xla_to_pytorch_cuda ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.1077992Z test_dlpack_xla_to_pytorch_cuda_protocol_conversion (__main__.TestDLPack) 2025-03-14T05:57:33.1078727Z TestDLPack.test_dlpack_xla_to_pytorch_cuda_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.1997210Z test_mixed_dtype_tuple (__main__.TestDataType) ... ok 2025-03-14T05:57:33.1997862Z test_get_xla_tensor_debug_info (__main__.TestDebuggingUtil) ... skipped 'skip on eager debug mode' 2025-03-14T05:57:33.3366294Z test_masked_select_shape (__main__.TestDynamicShape) ... ok 2025-03-14T05:57:33.6716334Z test_nonzero_cast (__main__.TestDynamicShape) ... ok 2025-03-14T05:57:33.7691176Z test_nonzero_shape (__main__.TestDynamicShape) ... ok 2025-03-14T05:57:33.9627304Z test_as_strided_input_larger (__main__.TestGeneric) ... ok 2025-03-14T05:57:33.9627992Z test_aten_move_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.9628769Z test_aten_move_scalar_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:57:33.9629720Z test_data_wrapper (__main__.TestGeneric) ... ok 2025-03-14T05:57:33.9633688Z test_git_revisons (__main__.TestGeneric) ... ok 2025-03-14T05:57:33.9638145Z test_send_to_device_grad (__main__.TestGeneric) ... ok 2025-03-14T05:57:33.9644363Z test_send_to_device_single (__main__.TestGeneric) ... ok 2025-03-14T05:57:34.0092898Z test_unsafe_buffer_pointer (__main__.TestGeneric) ... ok 2025-03-14T05:57:34.0097578Z test_util_foreach_api (__main__.TestGeneric) ... ok 2025-03-14T05:57:34.0101721Z test_util_foreach_api_cycle (__main__.TestGeneric) ... ok 2025-03-14T05:57:34.0105759Z test_zeros_like_patch (__main__.TestGeneric) ... ok 2025-03-14T05:57:35.3472302Z test_repeat_extended (__main__.TestHelperFunction) ... ok 2025-03-14T05:57:36.3175586Z test_repeat_special (__main__.TestHelperFunction) ... ok 2025-03-14T05:57:36.8724932Z test_repeat_truncated (__main__.TestHelperFunction) ... ok 2025-03-14T05:57:36.9249380Z test_inter_op_sync (__main__.TestInterOpSyncTensors) ... ok 2025-03-14T05:57:37.0643091Z test (__main__.TestLongGraphChain) ... ok 2025-03-14T05:57:37.0643999Z test_api (__main__.TestLoweringContext) ... skipped 'Skipping test under XLA_USE_EAGER_DEBUG_MODE because `result` will not reference a graph due to eager evaluation.' 2025-03-14T05:57:37.0645064Z test_get_parameters_scalar (__main__.TestLoweringContext) 2025-03-14T05:57:37.0646061Z Scalar tensors parameters may be shared in the HLO graph if their ... skipped 'Skipping test under XLA_USE_EAGER_DEBUG_MODE because `result` will not reference a graph due to eager evaluation.' 2025-03-14T05:57:37.8611353Z test (__main__.TestModelComparator) ... ok 2025-03-14T05:57:37.8611919Z test_legacy (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:57:37.8612565Z test_nms_input_errors (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:57:37.8613198Z test_nms_ref (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:57:37.9726392Z test_nll_loss_inf (__main__.TestNllLossLimitValue) ... ok 2025-03-14T05:57:37.9751382Z test_nll_loss_nan (__main__.TestNllLossLimitValue) ... ok 2025-03-14T05:57:38.0237578Z test_add (__main__.TestOpBuilder) ... ok 2025-03-14T05:57:38.1261186Z test_conditional (__main__.TestOpBuilder) ... ok 2025-03-14T05:57:38.1742562Z test_mul (__main__.TestOpBuilder) ... ok 2025-03-14T05:57:38.1749194Z test_triangular_solve (__main__.TestOpBuilder) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2576: UserWarning: torch.triangular_solve is deprecated in favor of torch.linalg.solve_triangularand will be removed in a future PyTorch release. 2025-03-14T05:57:38.1751929Z torch.linalg.solve_triangular has its arguments reversed and does not return a copy of one of the inputs. 2025-03-14T05:57:38.1753116Z X = torch.triangular_solve(B, A).solution 2025-03-14T05:57:38.1753712Z should be replaced with 2025-03-14T05:57:38.1755002Z X = torch.linalg.solve_triangular(A, B). (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:2261.) 2025-03-14T05:57:38.1756396Z return torch.triangular_solve( 2025-03-14T05:57:38.2362321Z ok 2025-03-14T05:57:38.2913984Z test_while (__main__.TestOpBuilder) ... ok 2025-03-14T05:57:38.2920368Z test_optimization_barrier_correctness (__main__.TestOptimizationBarrier) ... ok 2025-03-14T05:57:38.2950208Z test (__main__.TestParallelLoader) ... ok 2025-03-14T05:57:40.5234825Z test (__main__.TestParallelTensorMNIST) ... ok 2025-03-14T05:57:41.1481543Z test_random_from_to_bool (__main__.TestRandom) ... ok 2025-03-14T05:57:41.4011596Z test_get_xla_tensor (__main__.TestSelect) ... ok 2025-03-14T05:57:41.6270668Z test_masked_fill_scalar (__main__.TestSelect) ... ok 2025-03-14T05:57:41.6273289Z test (__main__.TestToXlaTensorArena) ... ok 2025-03-14T05:57:44.3648832Z test_wait_device_ops (__main__.TestWaitDeviceOps) ... ok 2025-03-14T05:57:44.3782932Z test_non_empty_scope (__main__.XpTraceTest) ... ok 2025-03-14T05:57:44.3909395Z test_non_empty_scope_decorator (__main__.XpTraceTest) ... ok 2025-03-14T05:57:44.3909740Z 2025-03-14T05:57:44.3910296Z ---------------------------------------------------------------------- 2025-03-14T05:57:44.3910745Z Ran 205 tests in 50.525s 2025-03-14T05:57:44.3910929Z 2025-03-14T05:57:44.3911047Z OK (skipped=21) 2025-03-14T05:57:45.2506770Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:57:45.2507764Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2025-03-14T05:57:45.2509188Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:57:45.2510103Z ++ command -v nvidia-smi 2025-03-14T05:57:45.2510551Z + '[' -x '' ']' 2025-03-14T05:57:45.2510984Z + PJRT_DEVICE=CPU 2025-03-14T05:57:45.2511390Z + CPU_NUM_DEVICES=1 2025-03-14T05:57:45.2511854Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:57:45.2512558Z + '[' 0 '!=' 0 ']' 2025-03-14T05:57:45.2512989Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:57:48.9639442Z test_mp_decorator (__main__.MpDecoratorTest) ... ok 2025-03-14T05:57:48.9642983Z test_multi_init_xla_backend (__main__.RegisterXLAKeyTest) ... ok 2025-03-14T05:57:48.9673750Z test_dropout (__main__.TestActivationCheckpoint) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:93: DeprecationWarning: torch.get_autocast_gpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cuda') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:828.) 2025-03-14T05:57:48.9676745Z "dtype": torch.get_autocast_gpu_dtype(), 2025-03-14T05:57:48.9679274Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:97: DeprecationWarning: torch.is_autocast_cpu_enabled() is deprecated. Please use torch.is_autocast_enabled('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:704.) 2025-03-14T05:57:48.9682044Z "enabled": torch.is_autocast_cpu_enabled(), 2025-03-14T05:57:48.9685231Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:98: DeprecationWarning: torch.get_autocast_cpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:837.) 2025-03-14T05:57:48.9687048Z "dtype": torch.get_autocast_cpu_dtype(), 2025-03-14T05:57:48.9693246Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:183: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead. 2025-03-14T05:57:48.9694523Z torch.cuda.amp.autocast(**ctx.gpu_autocast_kwargs), \ 2025-03-14T05:57:48.9695776Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:184: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead. 2025-03-14T05:57:48.9697017Z torch.cpu.amp.autocast(**ctx.cpu_autocast_kwargs): 2025-03-14T05:57:49.2551122Z ok 2025-03-14T05:57:49.2583594Z test_opt_barrier (__main__.TestActivationCheckpoint) ... ok 2025-03-14T05:57:49.2588585Z test (__main__.TestAtenTensorTo) ... ok 2025-03-14T05:57:49.3607443Z test_add_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.4116436Z test_addmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.4671901Z test_ailing_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.6102127Z test_amp_foreach_non_finite_check_and_unscale_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.6639145Z test_amp_norm_append_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.6979737Z test_arange_nan (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.7375011Z test_as_strided_r1 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.7847480Z test_as_strided_r1_dim1 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.8310002Z test_as_strided_r1_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.8760950Z test_as_strided_r1_t (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.9234090Z test_as_strided_r1_t_off (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:49.9682953Z test_as_strided_r1_t_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.0205095Z test_as_strided_r2_t_update (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.0629812Z test_as_strided_with_empty_args (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.1110602Z test_as_strided_with_gap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.1577394Z test_as_strided_with_gap_no_unit_stride (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.2047422Z test_as_strided_with_overlap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.2526888Z test_as_strided_with_overlap_and_gap (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.2532577Z test_as_strided_with_overlap_zero_stride (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:990.) 2025-03-14T05:57:50.2534549Z expected[nan_mask] = 0 2025-03-14T05:57:50.2536178Z /var/lib/jenkins/workspace/xla/test/test_utils.py:316: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:2486.) 2025-03-14T05:57:50.2537859Z expected[nan_mask] = 0 2025-03-14T05:57:50.2539635Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of index_put_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[indices] = tensor (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:990.) 2025-03-14T05:57:50.2541289Z expected[inf_mask] = 0 2025-03-14T05:57:50.2542899Z /var/lib/jenkins/workspace/xla/test/test_utils.py:320: UserWarning: Use of masked_fill_ on expanded tensors is deprecated. Please clone() the tensor before performing this operation. This also applies to advanced indexing e.g. tensor[mask] = scalar (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:2486.) 2025-03-14T05:57:50.2544612Z expected[inf_mask] = 0 2025-03-14T05:57:50.2544887Z ok 2025-03-14T05:57:50.3035857Z test_baddmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.3499410Z test_basic_bfloat16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.3963088Z test_bfloat16_float32_cast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.5891014Z test_binaryop_order (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.6332309Z test_bitwise_and_not (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.6336871Z test_byte_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.7890117Z test_cached_addcdiv (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.8288944Z test_cat_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.8747990Z test_clamp (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.9315403Z test_clip_grad_norm_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:50.9711835Z test_clip_grad_norm_zero (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.0127783Z test_conv2d_backward (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.1513037Z test_deepcopy (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.1999615Z test_diagonal_scatter_negative_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.2560094Z test_diagonal_write (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.3138993Z test_diagonal_write_transposed (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.3842652Z test_diagonal_write_transposed_r3 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.4833076Z test_div_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.4851688Z test_emb_bf16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.5621239Z test_embedding_bag_backward_fallback (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/graph.py:824: UserWarning: XLA does not support EmbeddingBag sparse backward function. Falling back to the dense function. (Triggered internally at torch_xla/csrc/aten_xla_type.cpp:1515.) 2025-03-14T05:57:51.5624397Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-03-14T05:57:51.5639621Z ok 2025-03-14T05:57:51.6820134Z test_embedding_int_indices (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.6826510Z test_empty_advanced_indexing (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:51.6828036Z test_empty_strided (__main__.TestAtenXlaTensor) ... skipped 'grad_input produces wrong results after functionalization. pytorch/pytorch#91199' 2025-03-14T05:57:51.7236793Z test_expand_default (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.0425347Z test_flip (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.0563698Z test_flip_check_throws (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.0564259Z test_flip_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.1410208Z test_flip_expand (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.2292506Z test_flip_rectangular (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.2308580Z test_flip_shape (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.2789156Z test_float32_bfloat16_cast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.3230086Z test_frac_negative (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.3813119Z test_gelu_backward_different_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.3817517Z test_get_real_xla_devices (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.4294885Z test_index_bool (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.4894316Z test_index_put (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.5314136Z test_index_select_0dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.6270540Z test_index_select_out (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.7603006Z test_index_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:52.9563087Z test_index_zero_tensor_by_zero_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.0007326Z test_inplace_copy_different_sizes (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.0453059Z test_inplace_mul_scalar_different_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.0928304Z test_inplace_view_backprop_base (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.1370116Z test_inplace_view_backprop_view (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:994: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /var/lib/jenkins/workspace/build/aten/src/ATen/core/TensorBody.h:494.) 2025-03-14T05:57:53.1373119Z self.assertIsNone(a.grad) 2025-03-14T05:57:53.1373416Z ok 2025-03-14T05:57:53.1843125Z test_inplace_view_backprop_view_of_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.2399794Z test_inplace_view_gradcheck (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.2869655Z test_inplace_view_makes_base_require_grad (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.3303481Z test_inplace_view_modify_base (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.3308747Z test_inplace_view_multiple_outputs (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.3799233Z test_inplace_view_non_contig (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.4289234Z test_inplace_view_of_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.5280157Z test_inplace_view_python (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.6208791Z test_manual_seed (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.6694009Z test_masked_fill_in_out_place (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.7174917Z test_masked_fill_with_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.9521464Z test_matmul_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:53.9987367Z test_max_broadcast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.0863197Z test_mul_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.3534529Z test_multi_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.4016722Z test_nan_to_num_in_place (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.4039113Z test_nan_to_num_in_place_with_inf (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.5992992Z test_native_dropout_backward (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.6461379Z test_negative_cat (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.6926081Z test_negative_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.6931459Z test_no_storage (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.6949782Z test_norm_p0 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.7492185Z test_one_hot_no_fallback (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:54.9488674Z test_patched_linear_1D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:55.1328716Z test_patched_linear_2D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:55.2733581Z test_patched_linear_3D (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:55.3658026Z test_patched_linear_3D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:55.3663858Z test_pow_constant (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:55.6367485Z test_pow_dtype_promotion (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:55.7772793Z test_pow_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:55.8247405Z test_pred_and_u8 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:55.9364681Z test_pred_one_hot (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.1767744Z test_pred_type (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.1773041Z test_print (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.4029399Z test_print_executation (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.4037477Z test_rand (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.4040502Z test_rand_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.4042491Z test_randint_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.4047873Z test_randn_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.4052871Z test_randperm (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.7113265Z test_reduction_0dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.7606887Z test_reduction_unordered_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.8446816Z test_replace_xla_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.9322061Z test_rrelu_module (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:56.9324932Z test_s_copy_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.0299533Z test_save (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.0364896Z test_save_api (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.1326199Z test_save_bf16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.1349483Z test_save_tuple (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.1350406Z test_save_view_alias_check (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is not disabled. Reason: views do not exist.' 2025-03-14T05:57:57.1904912Z test_scatter_add_bool (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.2447379Z test_scatter_add_small_target (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.2553296Z test_serialization_api (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.2553817Z test_set (__main__.TestAtenXlaTensor) ... skipped '' 2025-03-14T05:57:57.3496500Z test_sgn (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.4968352Z test_sigmoid_bounds (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.5442253Z test_slice_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:57.5966503Z test_slice_copy (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:59.6720050Z test_slice_rnd_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:59.7118902Z test_slice_start_end (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:59.7576975Z test_slice_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:59.8044860Z test_slice_stepped_other_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:59.8046047Z test_slice_zero_sized_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:57:59.8447137Z test_split_empty_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:00.5652097Z test_spooky_ailing (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:00.6532786Z test_squeeze_nonzero (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:00.7041448Z test_stack_different_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:00.7527164Z test_stack_pred (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:00.8449863Z test_sub_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:10.4174513Z test_too_many_parameter (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:10.4189041Z test_transpose_1d (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:10.4191239Z test_transpose_1d_inplace (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:10.5490131Z test_trilinear_interpolate (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:10.5496791Z test_upsample_bilinear_double (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2258: UserWarning: `nn.functional.upsample_bilinear` is deprecated. Use `nn.functional.interpolate` instead. 2025-03-14T05:58:10.5499038Z r = torch.nn.functional.upsample_bilinear(x, scale_factor=2) 2025-03-14T05:58:10.6625549Z ok 2025-03-14T05:58:10.7658611Z test_view_1718 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.0555961Z test_view_and_copy_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.1343803Z test_view_and_multi_mark_step (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.1362772Z test_view_as_complex_f32 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.1374871Z test_view_as_complex_f64 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.1396145Z test_view_as_real_c128 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.1406607Z test_view_as_real_c64 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.1417531Z test_view_empty (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.2321088Z test_view_out_computation (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.2773139Z test_writeable_tensors_updates (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:11.4072857Z test_cross_entropy_loss (__main__.TestBinaryCrossEntropyLimitValue) ... ok 2025-03-14T05:58:11.4073438Z test_dlpack_non_default_layout (__main__.TestDLPack) 2025-03-14T05:58:11.4074016Z TestDLPack.test_dlpack_non_default_layout ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.4074834Z test_dlpack_pytorch_cuda_to_xla (__main__.TestDLPack) 2025-03-14T05:58:11.4075419Z TestDLPack.test_dlpack_pytorch_cuda_to_xla ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.4076065Z test_dlpack_pytorch_cuda_to_xla_protocol_conversion (__main__.TestDLPack) 2025-03-14T05:58:11.4076804Z TestDLPack.test_dlpack_pytorch_cuda_to_xla_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.4077456Z test_dlpack_roundtrip_bool (__main__.TestDLPack) 2025-03-14T05:58:11.4077999Z TestDLPack.test_dlpack_roundtrip_bool ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.4078565Z test_dlpack_roundtrip_scalar (__main__.TestDLPack) 2025-03-14T05:58:11.4078974Z TestDLPack.test_dlpack_roundtrip_scalar 2025-03-14T05:58:11.4079559Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.4080181Z test_dlpack_roundtrip_tensor (__main__.TestDLPack) 2025-03-14T05:58:11.4080583Z TestDLPack.test_dlpack_roundtrip_tensor 2025-03-14T05:58:11.4081168Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.4081799Z test_dlpack_xla_to_pytorch_cuda (__main__.TestDLPack) 2025-03-14T05:58:11.4082445Z TestDLPack.test_dlpack_xla_to_pytorch_cuda ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.4083090Z test_dlpack_xla_to_pytorch_cuda_protocol_conversion (__main__.TestDLPack) 2025-03-14T05:58:11.4083822Z TestDLPack.test_dlpack_xla_to_pytorch_cuda_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.4084602Z test_mixed_dtype_tuple (__main__.TestDataType) ... ok 2025-03-14T05:58:11.4466232Z test_get_xla_tensor_debug_info (__main__.TestDebuggingUtil) ... ok 2025-03-14T05:58:11.5372615Z test_masked_select_shape (__main__.TestDynamicShape) ... ok 2025-03-14T05:58:11.6240958Z test_nonzero_cast (__main__.TestDynamicShape) ... ok 2025-03-14T05:58:11.6687159Z test_nonzero_shape (__main__.TestDynamicShape) ... ok 2025-03-14T05:58:11.7527612Z test_as_strided_input_larger (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.7528283Z test_aten_move_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.7529040Z test_aten_move_scalar_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:11.7532110Z test_data_wrapper (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.7535601Z test_git_revisons (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.7539549Z test_send_to_device_grad (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.7545289Z test_send_to_device_single (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.7927578Z test_unsafe_buffer_pointer (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.7930374Z test_util_foreach_api (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.7934231Z test_util_foreach_api_cycle (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.7937823Z test_zeros_like_patch (__main__.TestGeneric) ... ok 2025-03-14T05:58:11.9458902Z test_repeat_extended (__main__.TestHelperFunction) ... ok 2025-03-14T05:58:12.1076550Z test_repeat_special (__main__.TestHelperFunction) ... ok 2025-03-14T05:58:12.2690970Z test_repeat_truncated (__main__.TestHelperFunction) ... ok 2025-03-14T05:58:12.3262130Z test_inter_op_sync (__main__.TestInterOpSyncTensors) ... ok 2025-03-14T05:58:12.7946836Z test (__main__.TestLongGraphChain) ... ok 2025-03-14T05:58:12.7970793Z test_api (__main__.TestLoweringContext) ... ok 2025-03-14T05:58:12.7971275Z test_get_parameters_scalar (__main__.TestLoweringContext) 2025-03-14T05:58:12.8010109Z Scalar tensors parameters may be shared in the HLO graph if their ... ok 2025-03-14T05:58:13.0887910Z test (__main__.TestModelComparator) ... ok 2025-03-14T05:58:13.0888451Z test_legacy (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:58:13.0889078Z test_nms_input_errors (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:58:13.0889695Z test_nms_ref (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:58:13.1428730Z test_nll_loss_inf (__main__.TestNllLossLimitValue) ... ok 2025-03-14T05:58:13.1446189Z test_nll_loss_nan (__main__.TestNllLossLimitValue) ... ok 2025-03-14T05:58:13.1896015Z test_add (__main__.TestOpBuilder) ... ok 2025-03-14T05:58:13.2845785Z test_conditional (__main__.TestOpBuilder) ... ok 2025-03-14T05:58:13.3290853Z test_mul (__main__.TestOpBuilder) ... ok 2025-03-14T05:58:13.3299517Z test_triangular_solve (__main__.TestOpBuilder) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2576: UserWarning: torch.triangular_solve is deprecated in favor of torch.linalg.solve_triangularand will be removed in a future PyTorch release. 2025-03-14T05:58:13.3302241Z torch.linalg.solve_triangular has its arguments reversed and does not return a copy of one of the inputs. 2025-03-14T05:58:13.3303350Z X = torch.triangular_solve(B, A).solution 2025-03-14T05:58:13.3303930Z should be replaced with 2025-03-14T05:58:13.3305205Z X = torch.linalg.solve_triangular(A, B). (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:2261.) 2025-03-14T05:58:13.3306608Z return torch.triangular_solve( 2025-03-14T05:58:13.4030467Z ok 2025-03-14T05:58:13.4669420Z test_while (__main__.TestOpBuilder) ... ok 2025-03-14T05:58:13.4677424Z test_optimization_barrier_correctness (__main__.TestOptimizationBarrier) ... ok 2025-03-14T05:58:13.4708015Z test (__main__.TestParallelLoader) ... ok 2025-03-14T05:58:13.8575195Z test (__main__.TestParallelTensorMNIST) ... ok 2025-03-14T05:58:14.7750259Z test_random_from_to_bool (__main__.TestRandom) ... ok 2025-03-14T05:58:14.9199272Z test_get_xla_tensor (__main__.TestSelect) ... ok 2025-03-14T05:58:15.0633656Z test_masked_fill_scalar (__main__.TestSelect) ... ok 2025-03-14T05:58:15.0634840Z test (__main__.TestToXlaTensorArena) ... ok 2025-03-14T05:58:16.8441683Z test_wait_device_ops (__main__.TestWaitDeviceOps) ... ok 2025-03-14T05:58:16.8571318Z test_non_empty_scope (__main__.XpTraceTest) ... ok 2025-03-14T05:58:16.8693559Z test_non_empty_scope_decorator (__main__.XpTraceTest) ... ok 2025-03-14T05:58:16.8693911Z 2025-03-14T05:58:16.8694114Z ---------------------------------------------------------------------- 2025-03-14T05:58:16.8694522Z Ran 205 tests in 27.937s 2025-03-14T05:58:16.8694697Z 2025-03-14T05:58:16.8694809Z OK (skipped=16) 2025-03-14T05:58:16.9169706Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:58:16.9170225Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:58:16.9170681Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:58:16.9171342Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:58:16.9171796Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:58:16.9172245Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:58:16.9172655Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:58:16.9173023Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:58:16.9173379Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:58:17.7716291Z + run_test_without_functionalization /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:58:17.7717509Z + echo 'Running with XLA_DISABLE_FUNCTIONALIZATION: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2025-03-14T05:58:17.7718519Z Running with XLA_DISABLE_FUNCTIONALIZATION: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:58:17.7719190Z + XLA_DISABLE_FUNCTIONALIZATION=1 2025-03-14T05:58:17.7719700Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:58:17.7720464Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py' --verbosity=2 2025-03-14T05:58:17.7721289Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:58:17.7721853Z ++ command -v nvidia-smi 2025-03-14T05:58:17.7722209Z + '[' -x '' ']' 2025-03-14T05:58:17.7722463Z + PJRT_DEVICE=CPU 2025-03-14T05:58:17.7722722Z + CPU_NUM_DEVICES=1 2025-03-14T05:58:17.7723183Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:58:17.7723699Z + '[' 0 '!=' 0 ']' 2025-03-14T05:58:17.7724138Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations.py --verbosity=2 2025-03-14T05:58:21.5433663Z test_mp_decorator (__main__.MpDecoratorTest) ... ok 2025-03-14T05:58:21.5436416Z test_multi_init_xla_backend (__main__.RegisterXLAKeyTest) ... ok 2025-03-14T05:58:21.5468527Z test_dropout (__main__.TestActivationCheckpoint) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:93: DeprecationWarning: torch.get_autocast_gpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cuda') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:828.) 2025-03-14T05:58:21.5470432Z "dtype": torch.get_autocast_gpu_dtype(), 2025-03-14T05:58:21.5472018Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:97: DeprecationWarning: torch.is_autocast_cpu_enabled() is deprecated. Please use torch.is_autocast_enabled('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:704.) 2025-03-14T05:58:21.5473784Z "enabled": torch.is_autocast_cpu_enabled(), 2025-03-14T05:58:21.5475351Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:98: DeprecationWarning: torch.get_autocast_cpu_dtype() is deprecated. Please use torch.get_autocast_dtype('cpu') instead. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/autograd/init.cpp:837.) 2025-03-14T05:58:21.5476903Z "dtype": torch.get_autocast_cpu_dtype(), 2025-03-14T05:58:21.5485322Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:183: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead. 2025-03-14T05:58:21.5486596Z torch.cuda.amp.autocast(**ctx.gpu_autocast_kwargs), \ 2025-03-14T05:58:21.5487848Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/checkpoint.py:184: FutureWarning: `torch.cpu.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cpu', args...)` instead. 2025-03-14T05:58:21.5489085Z torch.cpu.amp.autocast(**ctx.cpu_autocast_kwargs): 2025-03-14T05:58:21.8353665Z ok 2025-03-14T05:58:21.8387384Z test_opt_barrier (__main__.TestActivationCheckpoint) ... ok 2025-03-14T05:58:21.8390151Z test (__main__.TestAtenTensorTo) ... ok 2025-03-14T05:58:21.9512571Z test_add_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.0140404Z test_addmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.0809711Z test_ailing_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.2551555Z test_amp_foreach_non_finite_check_and_unscale_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.3091521Z test_amp_norm_append_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.3367995Z test_arange_nan (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.3759669Z test_as_strided_r1 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.4222977Z test_as_strided_r1_dim1 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.4672538Z test_as_strided_r1_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.5118338Z test_as_strided_r1_t (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.5573063Z test_as_strided_r1_t_off (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.6018133Z test_as_strided_r1_t_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.6528422Z test_as_strided_r2_t_update (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.6529513Z test_as_strided_with_empty_args (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2025-03-14T05:58:22.6531113Z test_as_strided_with_gap (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2025-03-14T05:58:22.6532530Z test_as_strided_with_gap_no_unit_stride (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2025-03-14T05:58:22.6533960Z test_as_strided_with_overlap (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2025-03-14T05:58:22.6535364Z test_as_strided_with_overlap_and_gap (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2025-03-14T05:58:22.6536778Z test_as_strided_with_overlap_zero_stride (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: arbitrary as_strided unsupported.' 2025-03-14T05:58:22.7017926Z test_baddmm_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.7474986Z test_basic_bfloat16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.7927194Z test_bfloat16_float32_cast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:22.9736178Z test_binaryop_order (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.0171759Z test_bitwise_and_not (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.0176804Z test_byte_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.1726136Z test_cached_addcdiv (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.2118371Z test_cat_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.2577188Z test_clamp (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.3134137Z test_clip_grad_norm_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.3526952Z test_clip_grad_norm_zero (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.3932442Z test_conv2d_backward (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.5917759Z test_deepcopy (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.6392470Z test_diagonal_scatter_negative_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.6945372Z test_diagonal_write (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.7522859Z test_diagonal_write_transposed (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.8168025Z test_diagonal_write_transposed_r3 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.9251115Z test_div_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:23.9254508Z test_emb_bf16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.0551086Z test_embedding_bag_backward_fallback (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch/autograd/graph.py:824: UserWarning: XLA does not support EmbeddingBag sparse backward function. Falling back to the dense function. (Triggered internally at torch_xla/csrc/aten_xla_type.cpp:1515.) 2025-03-14T05:58:24.0554268Z return Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass 2025-03-14T05:58:24.0567918Z ok 2025-03-14T05:58:24.1789462Z test_embedding_int_indices (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.1797825Z test_empty_advanced_indexing (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.1799342Z test_empty_strided (__main__.TestAtenXlaTensor) ... skipped 'grad_input produces wrong results after functionalization. pytorch/pytorch#91199' 2025-03-14T05:58:24.2321283Z test_expand_default (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.5488039Z test_flip (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.5613831Z test_flip_check_throws (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.5617357Z test_flip_empty_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.6447668Z test_flip_expand (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.7321211Z test_flip_rectangular (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.7322236Z test_flip_shape (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.7799503Z test_float32_bfloat16_cast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.8231423Z test_frac_negative (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.8920381Z test_gelu_backward_different_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.8927293Z test_get_real_xla_devices (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:24.9511981Z test_index_bool (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.0248167Z test_index_put (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.0646520Z test_index_select_0dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.1577142Z test_index_select_out (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.2896554Z test_index_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.4812885Z test_index_zero_tensor_by_zero_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.5250858Z test_inplace_copy_different_sizes (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.5690707Z test_inplace_mul_scalar_different_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.6159768Z test_inplace_view_backprop_base (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.6600208Z test_inplace_view_backprop_view (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:994: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the .grad field to be populated for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more informations. (Triggered internally at /var/lib/jenkins/workspace/build/aten/src/ATen/core/TensorBody.h:494.) 2025-03-14T05:58:25.6603018Z self.assertIsNone(a.grad) 2025-03-14T05:58:25.6603321Z ok 2025-03-14T05:58:25.7052553Z test_inplace_view_backprop_view_of_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.7606377Z test_inplace_view_gradcheck (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.8061185Z test_inplace_view_makes_base_require_grad (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.8484858Z test_inplace_view_modify_base (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.8487905Z test_inplace_view_multiple_outputs (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.8966984Z test_inplace_view_non_contig (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:25.9448327Z test_inplace_view_of_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.0421324Z test_inplace_view_python (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.1340148Z test_manual_seed (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.1804303Z test_masked_fill_in_out_place (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.2281173Z test_masked_fill_with_tensor (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.4585613Z test_matmul_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.5039069Z test_max_broadcast (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.5967550Z test_mul_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.7751150Z test_multi_view (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.8229273Z test_nan_to_num_in_place (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:26.8231778Z test_nan_to_num_in_place_with_inf (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.0145580Z test_native_dropout_backward (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.0604349Z test_negative_cat (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.1064380Z test_negative_slice (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.1065215Z test_no_storage (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.1073657Z test_norm_p0 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.1612376Z test_one_hot_no_fallback (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.3590095Z test_patched_linear_1D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.5400391Z test_patched_linear_2D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.6777117Z test_patched_linear_3D (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.7690621Z test_patched_linear_3D_bias (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:27.7696913Z test_pow_constant (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.0362434Z test_pow_dtype_promotion (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.1738775Z test_pow_integer_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.2206708Z test_pred_and_u8 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.3616653Z test_pred_one_hot (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.6074789Z test_pred_type (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.6078377Z test_print (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.7881796Z test_print_executation (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.7882364Z test_rand (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.7887273Z test_rand_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.7892296Z test_randint_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.7896898Z test_randn_like (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:28.7901803Z test_randperm (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.0886363Z test_reduction_0dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.1370557Z test_reduction_unordered_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.1371480Z test_replace_xla_tensor (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: metrics differ.' 2025-03-14T05:58:29.2816545Z test_rrelu_module (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.2822295Z test_s_copy_dtype (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.3792459Z test_save (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.3850245Z test_save_api (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.4803105Z test_save_bf16 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.4821705Z test_save_tuple (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.4825755Z test_save_view_alias_check (__main__.TestAtenXlaTensor) ... /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:376: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2025-03-14T05:58:29.4827831Z return t.storage().data_ptr(), 'torch' 2025-03-14T05:58:29.4828165Z ok 2025-03-14T05:58:29.5370562Z test_scatter_add_bool (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.5909920Z test_scatter_add_small_target (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.6006863Z test_serialization_api (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.6007558Z test_set (__main__.TestAtenXlaTensor) ... skipped '' 2025-03-14T05:58:29.6933145Z test_sgn (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.8365460Z test_sigmoid_bounds (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.8815521Z test_slice_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:29.9330860Z test_slice_copy (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:31.9687211Z test_slice_rnd_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:32.0079547Z test_slice_start_end (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:32.0528690Z test_slice_stepped_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:32.0992109Z test_slice_stepped_other_assign (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:32.0992710Z test_slice_zero_sized_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:32.1392452Z test_split_empty_dim (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:32.8486988Z test_spooky_ailing (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:32.9349795Z test_squeeze_nonzero (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:32.9844492Z test_stack_different_types (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:33.0326967Z test_stack_pred (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:33.1264930Z test_sub_mixed_device (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:42.6805918Z test_too_many_parameter (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:42.6813678Z test_transpose_1d (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:42.6820233Z test_transpose_1d_inplace (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:42.8139094Z test_trilinear_interpolate (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:42.8144995Z test_upsample_bilinear_double (__main__.TestAtenXlaTensor) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2258: UserWarning: `nn.functional.upsample_bilinear` is deprecated. Use `nn.functional.interpolate` instead. 2025-03-14T05:58:42.8147281Z r = torch.nn.functional.upsample_bilinear(x, scale_factor=2) 2025-03-14T05:58:42.9272073Z ok 2025-03-14T05:58:43.0294041Z test_view_1718 (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:43.3138067Z test_view_and_copy_ (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:43.3920943Z test_view_and_multi_mark_step (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:43.3921929Z test_view_as_complex_f32 (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: view_as_real unsupported.' 2025-03-14T05:58:43.3923147Z test_view_as_complex_f64 (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: view_as_real unsupported.' 2025-03-14T05:58:43.3924432Z test_view_as_real_c128 (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: view_as_real unsupported.' 2025-03-14T05:58:43.3925578Z test_view_as_real_c64 (__main__.TestAtenXlaTensor) ... skipped 'Works only when functionalization is disabled. Reason: view_as_real unsupported.' 2025-03-14T05:58:43.4248036Z test_view_empty (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:43.5127794Z test_view_out_computation (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:43.5582610Z test_writeable_tensors_updates (__main__.TestAtenXlaTensor) ... ok 2025-03-14T05:58:43.6846458Z test_cross_entropy_loss (__main__.TestBinaryCrossEntropyLimitValue) ... ok 2025-03-14T05:58:43.6847054Z test_dlpack_non_default_layout (__main__.TestDLPack) 2025-03-14T05:58:43.6847862Z TestDLPack.test_dlpack_non_default_layout ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.6848456Z test_dlpack_pytorch_cuda_to_xla (__main__.TestDLPack) 2025-03-14T05:58:43.6849028Z TestDLPack.test_dlpack_pytorch_cuda_to_xla ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.6849680Z test_dlpack_pytorch_cuda_to_xla_protocol_conversion (__main__.TestDLPack) 2025-03-14T05:58:43.6850416Z TestDLPack.test_dlpack_pytorch_cuda_to_xla_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.6851131Z test_dlpack_roundtrip_bool (__main__.TestDLPack) 2025-03-14T05:58:43.6851685Z TestDLPack.test_dlpack_roundtrip_bool ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.6852252Z test_dlpack_roundtrip_scalar (__main__.TestDLPack) 2025-03-14T05:58:43.6852650Z TestDLPack.test_dlpack_roundtrip_scalar 2025-03-14T05:58:43.6853232Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.6853853Z test_dlpack_roundtrip_tensor (__main__.TestDLPack) 2025-03-14T05:58:43.6854249Z TestDLPack.test_dlpack_roundtrip_tensor 2025-03-14T05:58:43.6854828Z Callable and iterable class for producing new test cases. ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.6855456Z test_dlpack_xla_to_pytorch_cuda (__main__.TestDLPack) 2025-03-14T05:58:43.6856020Z TestDLPack.test_dlpack_xla_to_pytorch_cuda ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.6856747Z test_dlpack_xla_to_pytorch_cuda_protocol_conversion (__main__.TestDLPack) 2025-03-14T05:58:43.6857481Z TestDLPack.test_dlpack_xla_to_pytorch_cuda_protocol_conversion ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.6858147Z test_mixed_dtype_tuple (__main__.TestDataType) ... ok 2025-03-14T05:58:43.7240270Z test_get_xla_tensor_debug_info (__main__.TestDebuggingUtil) ... ok 2025-03-14T05:58:43.8136726Z test_masked_select_shape (__main__.TestDynamicShape) ... ok 2025-03-14T05:58:43.9002137Z test_nonzero_cast (__main__.TestDynamicShape) ... ok 2025-03-14T05:58:43.9443957Z test_nonzero_shape (__main__.TestDynamicShape) ... ok 2025-03-14T05:58:43.9445158Z test_as_strided_input_larger (__main__.TestGeneric) ... skipped 'Works only when functionalization is disabled. Reason: https://github.com/pytorch/xla/pull/7864#issuecomment-2294034008.' 2025-03-14T05:58:43.9446274Z test_aten_move_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.9447029Z test_aten_move_scalar_cuda_to_xla (__main__.TestGeneric) ... skipped 'requires PyTorch CUDA support' 2025-03-14T05:58:43.9448170Z test_data_wrapper (__main__.TestGeneric) ... ok 2025-03-14T05:58:43.9451558Z test_git_revisons (__main__.TestGeneric) ... ok 2025-03-14T05:58:43.9455492Z test_send_to_device_grad (__main__.TestGeneric) ... ok 2025-03-14T05:58:43.9460703Z test_send_to_device_single (__main__.TestGeneric) ... ok 2025-03-14T05:58:43.9846224Z test_unsafe_buffer_pointer (__main__.TestGeneric) ... ok 2025-03-14T05:58:43.9846724Z test_util_foreach_api (__main__.TestGeneric) ... ok 2025-03-14T05:58:43.9850176Z test_util_foreach_api_cycle (__main__.TestGeneric) ... ok 2025-03-14T05:58:43.9853911Z test_zeros_like_patch (__main__.TestGeneric) ... ok 2025-03-14T05:58:44.1337394Z test_repeat_extended (__main__.TestHelperFunction) ... ok 2025-03-14T05:58:44.2923313Z test_repeat_special (__main__.TestHelperFunction) ... ok 2025-03-14T05:58:44.4485256Z test_repeat_truncated (__main__.TestHelperFunction) ... ok 2025-03-14T05:58:44.5051518Z test_inter_op_sync (__main__.TestInterOpSyncTensors) ... ok 2025-03-14T05:58:44.9613019Z test (__main__.TestLongGraphChain) ... ok 2025-03-14T05:58:44.9647061Z test_api (__main__.TestLoweringContext) ... ok 2025-03-14T05:58:44.9647543Z test_get_parameters_scalar (__main__.TestLoweringContext) 2025-03-14T05:58:44.9676052Z Scalar tensors parameters may be shared in the HLO graph if their ... ok 2025-03-14T05:58:45.2454530Z test (__main__.TestModelComparator) ... ok 2025-03-14T05:58:45.2455105Z test_legacy (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:58:45.2455932Z test_nms_input_errors (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:58:45.2456613Z test_nms_ref (__main__.TestNMS) ... skipped 'XLA_EXPERIMENTAL=nms required' 2025-03-14T05:58:45.2996287Z test_nll_loss_inf (__main__.TestNllLossLimitValue) ... ok 2025-03-14T05:58:45.3012120Z test_nll_loss_nan (__main__.TestNllLossLimitValue) ... ok 2025-03-14T05:58:45.3465785Z test_add (__main__.TestOpBuilder) ... ok 2025-03-14T05:58:45.4401321Z test_conditional (__main__.TestOpBuilder) ... ok 2025-03-14T05:58:45.4843476Z test_mul (__main__.TestOpBuilder) ... ok 2025-03-14T05:58:45.4850496Z test_triangular_solve (__main__.TestOpBuilder) ... /var/lib/jenkins/workspace/xla/test/test_operations.py:2576: UserWarning: torch.triangular_solve is deprecated in favor of torch.linalg.solve_triangularand will be removed in a future PyTorch release. 2025-03-14T05:58:45.4853197Z torch.linalg.solve_triangular has its arguments reversed and does not return a copy of one of the inputs. 2025-03-14T05:58:45.4854305Z X = torch.triangular_solve(B, A).solution 2025-03-14T05:58:45.4854892Z should be replaced with 2025-03-14T05:58:45.4856159Z X = torch.linalg.solve_triangular(A, B). (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:2261.) 2025-03-14T05:58:45.4857554Z return torch.triangular_solve( 2025-03-14T05:58:45.5424723Z ok 2025-03-14T05:58:45.5926353Z test_while (__main__.TestOpBuilder) ... ok 2025-03-14T05:58:45.5932539Z test_optimization_barrier_correctness (__main__.TestOptimizationBarrier) ... ok 2025-03-14T05:58:45.5960042Z test (__main__.TestParallelLoader) ... ok 2025-03-14T05:58:45.9918224Z test (__main__.TestParallelTensorMNIST) ... ok 2025-03-14T05:58:46.8891559Z test_random_from_to_bool (__main__.TestRandom) ... ok 2025-03-14T05:58:47.0324391Z test_get_xla_tensor (__main__.TestSelect) ... ok 2025-03-14T05:58:47.1699921Z test_masked_fill_scalar (__main__.TestSelect) ... ok 2025-03-14T05:58:47.1701876Z test (__main__.TestToXlaTensorArena) ... ok 2025-03-14T05:58:48.9270278Z test_wait_device_ops (__main__.TestWaitDeviceOps) ... ok 2025-03-14T05:58:48.9403829Z test_non_empty_scope (__main__.XpTraceTest) ... ok 2025-03-14T05:58:48.9526177Z test_non_empty_scope_decorator (__main__.XpTraceTest) ... ok 2025-03-14T05:58:48.9526527Z 2025-03-14T05:58:48.9526703Z ---------------------------------------------------------------------- 2025-03-14T05:58:48.9527124Z Ran 205 tests in 27.442s 2025-03-14T05:58:48.9527298Z 2025-03-14T05:58:48.9527410Z OK (skipped=27) 2025-03-14T05:58:49.0000387Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:58:49.0001209Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:58:49.0001662Z tensor([[-0.0173, -0.2847, 2.7991, -0.5970]], device='xla:0') 2025-03-14T05:58:49.0002110Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:58:49.0002558Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:58:49.0003006Z tensor([[-0.0765, -0.0917, -1.8744, 1.6705]], device='xla:0') 2025-03-14T05:58:49.0003413Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:58:49.0003761Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:58:49.0004116Z tensor([[-0.0469, -0.7407, 1.4922, 0.0348]]) 2025-03-14T05:58:49.8506115Z + run_pt_xla_debug /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:49.8507063Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py' 2025-03-14T05:58:49.8508099Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:49.8508693Z + PT_XLA_DEBUG=1 2025-03-14T05:58:49.8508975Z + PT_XLA_DEBUG_FILE=/tmp/pt_xla_debug.txt 2025-03-14T05:58:49.8509485Z + run_test /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:49.8510225Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py' 2025-03-14T05:58:49.8511217Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:49.8511791Z ++ command -v nvidia-smi 2025-03-14T05:58:49.8512085Z + '[' -x '' ']' 2025-03-14T05:58:49.8512334Z + PJRT_DEVICE=CPU 2025-03-14T05:58:49.8512595Z + CPU_NUM_DEVICES=1 2025-03-14T05:58:49.8513054Z + run_coverage /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:49.8513562Z + '[' 0 '!=' 0 ']' 2025-03-14T05:58:49.8514056Z + python3 /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:54.1178458Z ......... 2025-03-14T05:58:54.1178842Z ---------------------------------------------------------------------- 2025-03-14T05:58:54.1179254Z Ran 9 tests in 1.103s 2025-03-14T05:58:54.1179420Z 2025-03-14T05:58:54.1179520Z OK 2025-03-14T05:58:54.1179798Z tensor([[ 0.4598, -0.0306, 0.2234, 0.5544, -0.5113], 2025-03-14T05:58:54.1180178Z [ 1.0380, -0.1918, 0.9208, -0.0310, 0.1858], 2025-03-14T05:58:54.1180554Z [ 0.0072, -0.9023, -1.3529, 0.3710, 1.9000], 2025-03-14T05:58:54.1180909Z [ 0.1453, 0.4618, -0.8955, -0.9982, -0.8850], 2025-03-14T05:58:54.1181315Z [ 0.9407, -0.0761, -0.9988, 0.7131, -0.7537]], device='xla:0') 2025-03-14T05:58:54.7404211Z + run_pt_xla_debug_level1 /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:54.7405484Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py' 2025-03-14T05:58:54.7406570Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:54.7407171Z + PT_XLA_DEBUG_LEVEL=1 2025-03-14T05:58:54.7407458Z + PT_XLA_DEBUG_FILE=/tmp/pt_xla_debug.txt 2025-03-14T05:58:54.7407963Z + run_test /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:54.7408705Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py' 2025-03-14T05:58:54.7409507Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:54.7410068Z ++ command -v nvidia-smi 2025-03-14T05:58:54.7410360Z + '[' -x '' ']' 2025-03-14T05:58:54.7410602Z + PJRT_DEVICE=CPU 2025-03-14T05:58:54.7410861Z + CPU_NUM_DEVICES=1 2025-03-14T05:58:54.7411310Z + run_coverage /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:54.7411811Z + '[' 0 '!=' 0 ']' 2025-03-14T05:58:54.7412230Z + python3 /var/lib/jenkins/workspace/xla/test/debug_tool/test_pt_xla_debug.py 2025-03-14T05:58:59.0228507Z ......... 2025-03-14T05:58:59.0228943Z ---------------------------------------------------------------------- 2025-03-14T05:58:59.0229369Z Ran 9 tests in 1.094s 2025-03-14T05:58:59.0229566Z 2025-03-14T05:58:59.0229657Z OK 2025-03-14T05:58:59.0229934Z tensor([[ 0.4598, -0.0306, 0.2234, 0.5544, -0.5113], 2025-03-14T05:58:59.0230326Z [ 1.0380, -0.1918, 0.9208, -0.0310, 0.1858], 2025-03-14T05:58:59.0230719Z [ 0.0072, -0.9023, -1.3529, 0.3710, 1.9000], 2025-03-14T05:58:59.0231085Z [ 0.1453, 0.4618, -0.8955, -0.9982, -0.8850], 2025-03-14T05:58:59.0231498Z [ 0.9407, -0.0761, -0.9988, 0.7131, -0.7537]], device='xla:0') 2025-03-14T05:58:59.6489707Z + run_test /var/lib/jenkins/workspace/xla/test/test_async_closures.py 2025-03-14T05:58:59.6490467Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_async_closures.py' 2025-03-14T05:58:59.6491244Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_async_closures.py 2025-03-14T05:58:59.6491790Z ++ command -v nvidia-smi 2025-03-14T05:58:59.6494325Z + '[' -x '' ']' 2025-03-14T05:58:59.6494582Z + PJRT_DEVICE=CPU 2025-03-14T05:58:59.6494842Z + CPU_NUM_DEVICES=1 2025-03-14T05:58:59.6495259Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_async_closures.py 2025-03-14T05:58:59.6495729Z + '[' 0 '!=' 0 ']' 2025-03-14T05:58:59.6496115Z + python3 /var/lib/jenkins/workspace/xla/test/test_async_closures.py 2025-03-14T05:59:04.8177052Z .... 2025-03-14T05:59:04.8177500Z ---------------------------------------------------------------------- 2025-03-14T05:59:04.8177928Z Ran 4 tests in 2.012s 2025-03-14T05:59:04.8178119Z 2025-03-14T05:59:04.8178211Z OK 2025-03-14T05:59:05.4330995Z + run_test /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py 2025-03-14T05:59:05.4331739Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py' 2025-03-14T05:59:05.4332696Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py 2025-03-14T05:59:05.4333323Z ++ command -v nvidia-smi 2025-03-14T05:59:05.4335528Z + '[' -x '' ']' 2025-03-14T05:59:05.4335789Z + PJRT_DEVICE=CPU 2025-03-14T05:59:05.4336044Z + CPU_NUM_DEVICES=1 2025-03-14T05:59:05.4336446Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py 2025-03-14T05:59:05.4336901Z + '[' 0 '!=' 0 ']' 2025-03-14T05:59:05.4337259Z + python3 /var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py 2025-03-14T05:59:08.5992943Z /opt/conda/lib/python3.10/site-packages/torch/__init__.py:1242: UserWarning: torch.set_default_tensor_type() is deprecated as of PyTorch 2.1, please use torch.set_default_dtype() and torch.set_default_device() as alternatives. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/tensor/python_tensor.cpp:436.) 2025-03-14T05:59:08.5994481Z _C._set_default_tensor_type(t) 2025-03-14T05:59:08.7295149Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:65: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2025-03-14T05:59:08.7296137Z if isinstance(candidate, dict): 2025-03-14T05:59:08.7297055Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:82: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2025-03-14T05:59:08.7298010Z elif isinstance(candidate, (list, tuple)): 2025-03-14T05:59:08.7298958Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:93: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2025-03-14T05:59:08.7299890Z elif hasattr(candidate, "__class__"): 2025-03-14T05:59:08.7300809Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:99: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2025-03-14T05:59:08.7301747Z if hasattr(candidate, att): 2025-03-14T05:59:08.7302662Z /var/lib/jenkins/workspace/xla/test/custom_debug_lowering.py:100: FutureWarning: `torch.distributed.reduce_op` is deprecated, please use `torch.distributed.ReduceOp` instead 2025-03-14T05:59:08.7303777Z v = getattr(candidate, att) 2025-03-14T05:59:11.3115835Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/xla__device_data', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py', 'sourceLine': 1341, 'stackFrameId': 16} 2025-03-14T05:59:11.3118875Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/xla__device_data', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py', 'sourceLine': 1341, 'stackFrameId': 16} 2025-03-14T05:59:11.3121792Z {'opType': 'aten__permute', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__permute', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3125026Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/xla__device_data', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py', 'sourceLine': 1341, 'stackFrameId': 16} 2025-03-14T05:59:11.3128038Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/xla__device_data', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/module.py', 'sourceLine': 1341, 'stackFrameId': 16} 2025-03-14T05:59:11.3130937Z {'opType': 'aten__permute', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__permute', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3133677Z {'opType': 'xla__device_data', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/xla__device_data', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3136253Z {'opType': 'prim__Constant', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/prim__Constant', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3138824Z {'opType': 'aten__mul', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__mul', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3141349Z {'opType': 'prim__Constant', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/prim__Constant', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3143896Z {'opType': 'aten__add', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__add', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3146495Z {'opType': 'prim__Constant', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/prim__Constant', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3149068Z {'opType': 'prim__Constant', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/prim__Constant', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3151626Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3154207Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3156775Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3159354Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3161901Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3164517Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3167942Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3170489Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3173029Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3175587Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3178202Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3180740Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3183292Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3185886Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3188602Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3191213Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3193805Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3196341Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3198925Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3201462Z {'opType': 'aten__uniform', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/aten__uniform', 'sourceFile': '/var/lib/jenkins/workspace/xla/test/test_hlo_metadata.py', 'sourceLine': 82, 'stackFrameId': 24} 2025-03-14T05:59:11.3204142Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3207032Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3209914Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3212736Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3215547Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3218375Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[0]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3220975Z {'opType': 'aten__relu', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/ReLU[1]/aten__relu', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/functional.py', 'sourceLine': 1704, 'stackFrameId': 26} 2025-03-14T05:59:11.3223522Z {'opType': 'aten__relu', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/ReLU[1]/aten__relu', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/functional.py', 'sourceLine': 1704, 'stackFrameId': 26} 2025-03-14T05:59:11.3226071Z {'opType': 'aten__relu', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/ReLU[1]/aten__relu', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/functional.py', 'sourceLine': 1704, 'stackFrameId': 26} 2025-03-14T05:59:11.3228886Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3231635Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3234368Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3237137Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3239973Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3242597Z {'opType': 'aten__addmm', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Linear[2]/aten__addmm', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/linear.py', 'sourceLine': 125, 'stackFrameId': 23} 2025-03-14T05:59:11.3244040Z . 2025-03-14T05:59:11.3244362Z ---------------------------------------------------------------------- 2025-03-14T05:59:11.3244897Z Ran 1 test in 2.714s 2025-03-14T05:59:11.3245066Z 2025-03-14T05:59:11.3245168Z OK 2025-03-14T05:59:11.3246691Z {'opType': 'aten__tanh', 'opName': 'TestProgram[.1]/TextTestRunner[testRunner]/TestSuite[test]/TestSuite[_tests.0]/TestHloMetaData[_tests.0]/TestHloMetaData[pre_test_ir_debug.errors.0.0]/Sequential[model]/Tanh[3]/aten__tanh', 'sourceFile': '/opt/conda/lib/python3.10/site-packages/torch/nn/modules/activation.py', 'sourceLine': 392, 'stackFrameId': 27} 2025-03-14T05:59:11.3248255Z {} 2025-03-14T05:59:11.3248504Z All required metadata symbols matched 2025-03-14T05:59:11.9169023Z + run_test /var/lib/jenkins/workspace/xla/test/test_profiler.py 2025-03-14T05:59:11.9169882Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_profiler.py' 2025-03-14T05:59:11.9170588Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_profiler.py 2025-03-14T05:59:11.9171137Z ++ command -v nvidia-smi 2025-03-14T05:59:11.9173567Z + '[' -x '' ']' 2025-03-14T05:59:11.9173829Z + PJRT_DEVICE=CPU 2025-03-14T05:59:11.9174087Z + CPU_NUM_DEVICES=1 2025-03-14T05:59:11.9174473Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_profiler.py 2025-03-14T05:59:11.9175166Z + '[' 0 '!=' 0 ']' 2025-03-14T05:59:11.9175524Z + python3 /var/lib/jenkins/workspace/xla/test/test_profiler.py 2025-03-14T05:59:18.8896345Z Epoch 1 train begin 05:59:18 2025-03-14T05:59:18.8896920Z | Training Device=xla:0/0 Step=0 Loss=nan Rate=75.94 GlobalRate=75.93 Time=05:59:18 2025-03-14T05:59:22.8391836Z Starting to trace for 5000 ms. Remaining attempt(s): 4 2025-03-14T05:59:23.2631512Z | Training Device=xla:0/0 Step=20 Loss=1.92684 Rate=74.28 GlobalRate=73.30 Time=05:59:23 2025-03-14T05:59:23.7777571Z | Training Device=xla:0/0 Step=40 Loss=1.52069 Rate=402.54 GlobalRate=128.66 Time=05:59:23 2025-03-14T05:59:24.4317179Z | Training Device=xla:0/0 Step=60 Loss=1.04478 Rate=454.61 GlobalRate=169.66 Time=05:59:24 2025-03-14T05:59:25.1311499Z | Training Device=xla:0/0 Step=80 Loss=0.40812 Rate=456.35 GlobalRate=200.86 Time=05:59:25 2025-03-14T05:59:25.7962001Z | Training Device=xla:0/0 Step=100 Loss=0.09718 Rate=471.24 GlobalRate=227.05 Time=05:59:25 2025-03-14T05:59:26.4668085Z | Training Device=xla:0/0 Step=120 Loss=0.03902 Rate=474.82 GlobalRate=248.59 Time=05:59:26 2025-03-14T05:59:27.1468275Z | Training Device=xla:0/0 Step=140 Loss=0.02194 Rate=472.27 GlobalRate=266.42 Time=05:59:27 2025-03-14T05:59:27.8218493Z | Training Device=xla:0/0 Step=160 Loss=0.01457 Rate=473.33 GlobalRate=281.75 Time=05:59:27 2025-03-14T05:59:28.4920194Z | Training Device=xla:0/0 Step=180 Loss=0.01063 Rate=475.84 GlobalRate=295.12 Time=05:59:28 2025-03-14T05:59:29.0875455Z | Training Device=xla:0/0 Step=200 Loss=0.00823 Rate=512.80 GlobalRate=308.98 Time=05:59:29 2025-03-14T05:59:29.6497165Z | Training Device=xla:0/0 Step=220 Loss=0.00665 Rate=546.61 GlobalRate=322.31 Time=05:59:29 2025-03-14T05:59:30.1848732Z | Training Device=xla:0/0 Step=240 Loss=0.00553 Rate=577.43 GlobalRate=335.13 Time=05:59:30 2025-03-14T05:59:30.7147152Z | Training Device=xla:0/0 Step=260 Loss=0.00471 Rate=593.49 GlobalRate=346.97 Time=05:59:30 2025-03-14T05:59:31.2490982Z | Training Device=xla:0/0 Step=280 Loss=0.00408 Rate=596.52 GlobalRate=357.67 Time=05:59:31 2025-03-14T05:59:31.7769487Z | Training Device=xla:0/0 Step=300 Loss=0.00359 Rate=602.35 GlobalRate=367.69 Time=05:59:31 2025-03-14T05:59:32.3058455Z | Training Device=xla:0/0 Step=320 Loss=0.00320 Rate=604.01 GlobalRate=376.90 Time=05:59:32 2025-03-14T05:59:32.8399256Z | Training Device=xla:0/0 Step=340 Loss=0.00287 Rate=601.30 GlobalRate=385.29 Time=05:59:32 2025-03-14T05:59:33.3802268Z | Training Device=xla:0/0 Step=360 Loss=0.00260 Rate=595.79 GlobalRate=392.90 Time=05:59:33 2025-03-14T05:59:33.8986453Z | Training Device=xla:0/0 Step=380 Loss=0.00238 Rate=608.73 GlobalRate=400.54 Time=05:59:33 2025-03-14T05:59:34.4174272Z | Training Device=xla:0/0 Step=400 Loss=0.00218 Rate=613.36 GlobalRate=407.66 Time=05:59:34 2025-03-14T05:59:34.9389368Z | Training Device=xla:0/0 Step=420 Loss=0.00202 Rate=613.75 GlobalRate=414.28 Time=05:59:34 2025-03-14T05:59:35.4603543Z | Training Device=xla:0/0 Step=440 Loss=0.00187 Rate=613.69 GlobalRate=420.47 Time=05:59:35 2025-03-14T05:59:35.9758063Z | Training Device=xla:0/0 Step=460 Loss=0.00174 Rate=618.01 GlobalRate=426.44 Time=05:59:35 2025-03-14T05:59:36.4952868Z | Training Device=xla:0/0 Step=480 Loss=0.00163 Rate=616.84 GlobalRate=431.97 Time=05:59:36 2025-03-14T05:59:37.0116763Z | Training Device=xla:0/0 Step=500 Loss=0.00153 Rate=618.53 GlobalRate=437.26 Time=05:59:37 2025-03-14T05:59:37.5268400Z | Training Device=xla:0/0 Step=520 Loss=0.00144 Rate=620.01 GlobalRate=442.28 Time=05:59:37 2025-03-14T05:59:38.0568545Z | Training Device=xla:0/0 Step=540 Loss=0.00136 Rate=610.25 GlobalRate=446.70 Time=05:59:38 2025-03-14T05:59:38.6056190Z | Training Device=xla:0/0 Step=560 Loss=0.00129 Rate=593.82 GlobalRate=450.45 Time=05:59:38 2025-03-14T05:59:39.1253902Z | Training Device=xla:0/0 Step=580 Loss=0.00122 Rate=606.93 GlobalRate=454.65 Time=05:59:39 2025-03-14T05:59:39.6414720Z | Training Device=xla:0/0 Step=600 Loss=0.00116 Rate=614.80 GlobalRate=458.72 Time=05:59:39 2025-03-14T05:59:40.1579524Z | Training Device=xla:0/0 Step=620 Loss=0.00111 Rate=617.75 GlobalRate=462.59 Time=05:59:40 2025-03-14T05:59:40.6762961Z | Training Device=xla:0/0 Step=640 Loss=0.00106 Rate=617.76 GlobalRate=466.25 Time=05:59:40 2025-03-14T05:59:41.1936724Z | Training Device=xla:0/0 Step=660 Loss=0.00101 Rate=617.87 GlobalRate=469.74 Time=05:59:41 2025-03-14T05:59:41.7147058Z | Training Device=xla:0/0 Step=680 Loss=0.00097 Rate=615.88 GlobalRate=473.01 Time=05:59:41 2025-03-14T05:59:42.2307701Z | Training Device=xla:0/0 Step=700 Loss=0.00093 Rate=618.34 GlobalRate=476.23 Time=05:59:42 2025-03-14T05:59:42.7469165Z | Training Device=xla:0/0 Step=720 Loss=0.00089 Rate=619.37 GlobalRate=479.31 Time=05:59:42 2025-03-14T05:59:43.2588621Z | Training Device=xla:0/0 Step=740 Loss=0.00086 Rate=622.83 GlobalRate=482.35 Time=05:59:43 2025-03-14T05:59:43.7736739Z | Training Device=xla:0/0 Step=760 Loss=0.00083 Rate=621.81 GlobalRate=485.20 Time=05:59:43 2025-03-14T05:59:44.2869841Z | Training Device=xla:0/0 Step=780 Loss=0.00080 Rate=622.96 GlobalRate=487.98 Time=05:59:44 2025-03-14T05:59:44.8031613Z | Training Device=xla:0/0 Step=800 Loss=0.00077 Rate=621.27 GlobalRate=490.59 Time=05:59:44 2025-03-14T05:59:45.3190229Z | Training Device=xla:0/0 Step=820 Loss=0.00074 Rate=620.64 GlobalRate=493.10 Time=05:59:45 2025-03-14T05:59:45.8334593Z | Training Device=xla:0/0 Step=840 Loss=0.00072 Rate=621.22 GlobalRate=495.53 Time=05:59:45 2025-03-14T05:59:46.3477340Z | Training Device=xla:0/0 Step=860 Loss=0.00070 Rate=621.84 GlobalRate=497.89 Time=05:59:46 2025-03-14T05:59:46.8651142Z | Training Device=xla:0/0 Step=880 Loss=0.00067 Rate=619.83 GlobalRate=500.10 Time=05:59:46 2025-03-14T05:59:47.3912079Z | Training Device=xla:0/0 Step=900 Loss=0.00065 Rate=613.20 GlobalRate=502.09 Time=05:59:47 2025-03-14T05:59:47.9089061Z | Training Device=xla:0/0 Step=920 Loss=0.00063 Rate=616.01 GlobalRate=504.14 Time=05:59:47 2025-03-14T05:59:48.4269837Z | Training Device=xla:0/0 Step=940 Loss=0.00062 Rate=616.87 GlobalRate=506.12 Time=05:59:48 2025-03-14T05:59:48.9485701Z | Training Device=xla:0/0 Step=960 Loss=0.00060 Rate=615.11 GlobalRate=507.97 Time=05:59:48 2025-03-14T05:59:49.4673054Z | Training Device=xla:0/0 Step=980 Loss=0.00058 Rate=615.87 GlobalRate=509.80 Time=05:59:49 2025-03-14T05:59:49.9904517Z | Training Device=xla:0/0 Step=1000 Loss=0.00057 Rate=613.51 GlobalRate=511.51 Time=05:59:49 2025-03-14T05:59:50.5068949Z | Training Device=xla:0/0 Step=1020 Loss=0.00055 Rate=617.12 GlobalRate=513.26 Time=05:59:50 2025-03-14T05:59:51.0269351Z | Training Device=xla:0/0 Step=1040 Loss=0.00054 Rate=616.04 GlobalRate=514.90 Time=05:59:51 2025-03-14T05:59:51.5455337Z | Training Device=xla:0/0 Step=1060 Loss=0.00052 Rate=616.57 GlobalRate=516.51 Time=05:59:51 2025-03-14T05:59:52.0752709Z | Training Device=xla:0/0 Step=1080 Loss=0.00051 Rate=609.27 GlobalRate=517.91 Time=05:59:52 2025-03-14T05:59:52.5973299Z | Training Device=xla:0/0 Step=1100 Loss=0.00050 Rate=611.26 GlobalRate=519.36 Time=05:59:52 2025-03-14T05:59:53.1168160Z | Training Device=xla:0/0 Step=1120 Loss=0.00049 Rate=614.30 GlobalRate=520.83 Time=05:59:53 2025-03-14T05:59:53.6413224Z | Training Device=xla:0/0 Step=1140 Loss=0.00047 Rate=611.60 GlobalRate=522.16 Time=05:59:53 2025-03-14T05:59:54.1882051Z | Training Device=xla:0/0 Step=1160 Loss=0.00046 Rate=595.90 GlobalRate=523.14 Time=05:59:54 2025-03-14T05:59:54.7139574Z | Training Device=xla:0/0 Step=1180 Loss=0.00045 Rate=603.40 GlobalRate=524.38 Time=05:59:54 2025-03-14T05:59:55.2331458Z | Training Device=xla:0/0 Step=1200 Loss=0.00044 Rate=611.11 GlobalRate=525.68 Time=05:59:55 2025-03-14T05:59:55.7551754Z | Training Device=xla:0/0 Step=1220 Loss=0.00043 Rate=612.53 GlobalRate=526.92 Time=05:59:55 2025-03-14T05:59:56.2788553Z | Training Device=xla:0/0 Step=1240 Loss=0.00042 Rate=611.59 GlobalRate=528.09 Time=05:59:56 2025-03-14T05:59:56.8003731Z | Training Device=xla:0/0 Step=1260 Loss=0.00042 Rate=612.83 GlobalRate=529.26 Time=05:59:56 2025-03-14T05:59:57.3211428Z | Training Device=xla:0/0 Step=1280 Loss=0.00041 Rate=613.55 GlobalRate=530.40 Time=05:59:57 2025-03-14T05:59:57.8408031Z | Training Device=xla:0/0 Step=1300 Loss=0.00040 Rate=615.13 GlobalRate=531.54 Time=05:59:57 2025-03-14T05:59:58.3570000Z | Training Device=xla:0/0 Step=1320 Loss=0.00039 Rate=617.76 GlobalRate=532.69 Time=05:59:58 2025-03-14T05:59:58.8755322Z | Training Device=xla:0/0 Step=1340 Loss=0.00038 Rate=617.61 GlobalRate=533.78 Time=05:59:58 2025-03-14T05:59:59.3984764Z | Training Device=xla:0/0 Step=1360 Loss=0.00038 Rate=614.30 GlobalRate=534.79 Time=05:59:59 2025-03-14T05:59:59.9175108Z | Training Device=xla:0/0 Step=1380 Loss=0.00037 Rate=615.31 GlobalRate=535.81 Time=05:59:59 2025-03-14T06:00:00.4354581Z | Training Device=xla:0/0 Step=1400 Loss=0.00036 Rate=617.00 GlobalRate=536.83 Time=06:00:00 2025-03-14T06:00:00.9956388Z | Training Device=xla:0/0 Step=1420 Loss=0.00036 Rate=589.67 GlobalRate=537.29 Time=06:00:00 2025-03-14T06:00:01.5211214Z | Training Device=xla:0/0 Step=1440 Loss=0.00035 Rate=600.94 GlobalRate=538.16 Time=06:00:01 2025-03-14T06:00:02.0453359Z | Training Device=xla:0/0 Step=1460 Loss=0.00034 Rate=606.63 GlobalRate=539.03 Time=06:00:02 2025-03-14T06:00:02.5716350Z | Training Device=xla:0/0 Step=1480 Loss=0.00034 Rate=607.69 GlobalRate=539.87 Time=06:00:02 2025-03-14T06:00:03.0989635Z | Training Device=xla:0/0 Step=1500 Loss=0.00033 Rate=607.15 GlobalRate=540.66 Time=06:00:03 2025-03-14T06:00:03.6152093Z | Training Device=xla:0/0 Step=1520 Loss=0.00033 Rate=614.72 GlobalRate=541.57 Time=06:00:03 2025-03-14T06:00:04.1343744Z | Training Device=xla:0/0 Step=1540 Loss=0.00032 Rate=615.78 GlobalRate=542.42 Time=06:00:04 2025-03-14T06:00:04.6541857Z | Training Device=xla:0/0 Step=1560 Loss=0.00031 Rate=615.62 GlobalRate=543.25 Time=06:00:04 2025-03-14T06:00:05.1753317Z | Training Device=xla:0/0 Step=1580 Loss=0.00031 Rate=614.78 GlobalRate=544.05 Time=06:00:05 2025-03-14T06:00:05.6958766Z | Training Device=xla:0/0 Step=1600 Loss=0.00030 Rate=614.70 GlobalRate=544.83 Time=06:00:05 2025-03-14T06:00:06.2168961Z | Training Device=xla:0/0 Step=1620 Loss=0.00030 Rate=614.24 GlobalRate=545.59 Time=06:00:06 2025-03-14T06:00:06.7436163Z | Training Device=xla:0/0 Step=1640 Loss=0.00029 Rate=610.42 GlobalRate=546.27 Time=06:00:06 2025-03-14T06:00:07.2846922Z | Training Device=xla:0/0 Step=1660 Loss=0.00029 Rate=599.03 GlobalRate=546.77 Time=06:00:07 2025-03-14T06:00:07.8218115Z | Training Device=xla:0/0 Step=1680 Loss=0.00029 Rate=596.81 GlobalRate=547.30 Time=06:00:07 2025-03-14T06:00:08.3619410Z | Training Device=xla:0/0 Step=1700 Loss=0.00028 Rate=594.25 GlobalRate=547.79 Time=06:00:08 2025-03-14T06:00:08.8990024Z | Training Device=xla:0/0 Step=1720 Loss=0.00028 Rate=595.41 GlobalRate=548.31 Time=06:00:08 2025-03-14T06:00:09.4384515Z | Training Device=xla:0/0 Step=1740 Loss=0.00027 Rate=594.12 GlobalRate=548.79 Time=06:00:09 2025-03-14T06:00:09.9729508Z | Training Device=xla:0/0 Step=1760 Loss=0.00027 Rate=596.55 GlobalRate=549.30 Time=06:00:09 2025-03-14T06:00:10.5217759Z | Training Device=xla:0/0 Step=1780 Loss=0.00027 Rate=588.47 GlobalRate=549.66 Time=06:00:10 2025-03-14T06:00:11.0759199Z | Training Device=xla:0/0 Step=1800 Loss=0.00026 Rate=582.19 GlobalRate=549.96 Time=06:00:11 2025-03-14T06:00:11.6336502Z | Training Device=xla:0/0 Step=1820 Loss=0.00026 Rate=576.82 GlobalRate=550.21 Time=06:00:11 2025-03-14T06:00:12.1833972Z | Training Device=xla:0/0 Step=1840 Loss=0.00025 Rate=580.20 GlobalRate=550.54 Time=06:00:12 2025-03-14T06:00:12.7325256Z | Training Device=xla:0/0 Step=1860 Loss=0.00025 Rate=581.73 GlobalRate=550.86 Time=06:00:12 2025-03-14T06:00:13.2798895Z | Training Device=xla:0/0 Step=1880 Loss=0.00025 Rate=583.47 GlobalRate=551.20 Time=06:00:13 2025-03-14T06:00:13.8168516Z | Training Device=xla:0/0 Step=1900 Loss=0.00024 Rate=590.91 GlobalRate=551.64 Time=06:00:13 2025-03-14T06:00:14.3546945Z | Training Device=xla:0/0 Step=1920 Loss=0.00024 Rate=593.51 GlobalRate=552.06 Time=06:00:14 2025-03-14T06:00:14.8885517Z | Training Device=xla:0/0 Step=1940 Loss=0.00024 Rate=596.92 GlobalRate=552.51 Time=06:00:14 2025-03-14T06:00:15.4339618Z | Training Device=xla:0/0 Step=1960 Loss=0.00023 Rate=590.62 GlobalRate=552.83 Time=06:00:15 2025-03-14T06:00:15.9633812Z | Training Device=xla:0/0 Step=1980 Loss=0.00023 Rate=599.07 GlobalRate=553.31 Time=06:00:15 2025-03-14T06:00:16.4955655Z | Training Device=xla:0/0 Step=2000 Loss=0.00023 Rate=600.48 GlobalRate=553.75 Time=06:00:16 2025-03-14T06:00:17.0324413Z | Training Device=xla:0/0 Step=2020 Loss=0.00023 Rate=597.81 GlobalRate=554.14 Time=06:00:17 2025-03-14T06:00:17.5689560Z | Training Device=xla:0/0 Step=2040 Loss=0.00022 Rate=596.72 GlobalRate=554.53 Time=06:00:17 2025-03-14T06:00:22.4766126Z INFO:root:PT_XLA_DEBUG_FILE Contents: 2025-03-14T06:00:22.4767816Z 2025-03-14T06:00:22.4768137Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4768635Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.4769101Z Compilation Analysis: mark_step in parallel loader at step end 2025-03-14T06:00:22.4769562Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.4770015Z Compilation Analysis: Graph Hash: b19816fff96c3b652311d3766deac227 2025-03-14T06:00:22.4770514Z Compilation Analysis: Number of Graph Inputs: 0 2025-03-14T06:00:22.4770947Z Compilation Analysis: Number of Graph Outputs: 2 2025-03-14T06:00:22.4771417Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4772352Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.4773733Z Compilation Analysis: next (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/distributed/parallel_loader.py:46) 2025-03-14T06:00:22.4775320Z Compilation Analysis: __next__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/distributed/parallel_loader.py:34) 2025-03-14T06:00:22.4776472Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:162) 2025-03-14T06:00:22.4777353Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4778537Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4779296Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4780047Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4780624Z Compilation Analysis: .......... 2025-03-14T06:00:22.4781129Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4781757Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4782101Z 2025-03-14T06:00:22.4782353Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4782973Z Post Compilation Analysis: Graph input size: 0.000000 GB 2025-03-14T06:00:22.4783461Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.4783954Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.4784472Z Post Compilation Analysis: Intermediate tensor size: 0.000000 GB 2025-03-14T06:00:22.4785007Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.4785638Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4786409Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4786775Z 2025-03-14T06:00:22.4787002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4787466Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.4787897Z Execution Analysis: mark_step in parallel loader at step end 2025-03-14T06:00:22.4788345Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.4788780Z Execution Analysis: Graph Hash: b19816fff96c3b652311d3766deac227 2025-03-14T06:00:22.4789262Z Execution Analysis: Number of Graph Inputs: 0 2025-03-14T06:00:22.4789675Z Execution Analysis: Number of Graph Outputs: 2 2025-03-14T06:00:22.4790108Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4791008Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.4792449Z Execution Analysis: next (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/distributed/parallel_loader.py:46) 2025-03-14T06:00:22.4793826Z Execution Analysis: __next__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/distributed/parallel_loader.py:34) 2025-03-14T06:00:22.4794956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:162) 2025-03-14T06:00:22.4795809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4796620Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4797353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4798081Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4798631Z Execution Analysis: .......... 2025-03-14T06:00:22.4799146Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4799750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4800094Z 2025-03-14T06:00:22.4800316Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4800802Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.4801357Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.4801915Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.4802351Z Compilation Analysis: Graph Hash: bc25873e57cc3c97ba43694630abe03f 2025-03-14T06:00:22.4802856Z Compilation Analysis: Number of Graph Inputs: 14 2025-03-14T06:00:22.4803290Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.4803758Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4804437Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.4805401Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4806230Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4807017Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4807764Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4808505Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4809230Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.4809813Z Compilation Analysis: (:1) 2025-03-14T06:00:22.4810372Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4810997Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4811353Z 2025-03-14T06:00:22.4811590Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4812139Z Post Compilation Analysis: Graph input size: 0.000128 GB 2025-03-14T06:00:22.4812617Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.4813105Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.4813616Z Post Compilation Analysis: Intermediate tensor size: 0.000000 GB 2025-03-14T06:00:22.4814151Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.4814760Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4815457Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4815814Z 2025-03-14T06:00:22.4816039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4816500Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.4817021Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.4817563Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.4817988Z Execution Analysis: Graph Hash: bc25873e57cc3c97ba43694630abe03f 2025-03-14T06:00:22.4818472Z Execution Analysis: Number of Graph Inputs: 14 2025-03-14T06:00:22.4818888Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.4819330Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4819988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.4820839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4821674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4822404Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4848266Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4849050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4849769Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.4850324Z Execution Analysis: (:1) 2025-03-14T06:00:22.4850853Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4851472Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4851818Z 2025-03-14T06:00:22.4852044Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4852540Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.4853036Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.4853541Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.4853988Z Compilation Analysis: Graph Hash: 4324294c43d8c65f5bc608df0ae0cfff 2025-03-14T06:00:22.4854594Z Compilation Analysis: Number of Graph Inputs: 17 2025-03-14T06:00:22.4855054Z Compilation Analysis: Number of Graph Outputs: 49 2025-03-14T06:00:22.4855529Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4856458Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.4857829Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.4858939Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.4859827Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4860664Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4861423Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4862176Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4862916Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4863449Z Compilation Analysis: .......... 2025-03-14T06:00:22.4863985Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4864620Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4864980Z 2025-03-14T06:00:22.4865222Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4865932Z Post Compilation Analysis: Graph input size: 0.000128 GB 2025-03-14T06:00:22.4866429Z Post Compilation Analysis: Graph output size: 0.000307 GB 2025-03-14T06:00:22.4866912Z Post Compilation Analysis: Aliased Input size: 0.000082 GB 2025-03-14T06:00:22.4867432Z Post Compilation Analysis: Intermediate tensor size: 0.000060 GB 2025-03-14T06:00:22.4867962Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.4868588Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4869253Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4869630Z 2025-03-14T06:00:22.4869844Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4870472Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.4870942Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.4871428Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.4871853Z Execution Analysis: Graph Hash: 4324294c43d8c65f5bc608df0ae0cfff 2025-03-14T06:00:22.4872340Z Execution Analysis: Number of Graph Inputs: 17 2025-03-14T06:00:22.4872763Z Execution Analysis: Number of Graph Outputs: 49 2025-03-14T06:00:22.4873214Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4874114Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.4875424Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.4876501Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.4877356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4878164Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4878953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4879685Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4880408Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4880925Z Execution Analysis: .......... 2025-03-14T06:00:22.4881404Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4882042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4882392Z 2025-03-14T06:00:22.4882612Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4883101Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.4883657Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.4884215Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.4884744Z Compilation Analysis: Graph Hash: e7e71ae51abfe683e4b463db94966965 2025-03-14T06:00:22.4885251Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.4885688Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.4886149Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4886876Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.4887753Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4888586Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4889341Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4890091Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4890833Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4891560Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.4892137Z Compilation Analysis: (:1) 2025-03-14T06:00:22.4892671Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4893296Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4893637Z 2025-03-14T06:00:22.4893892Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4894476Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.4894959Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.4895443Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.4895962Z Post Compilation Analysis: Intermediate tensor size: 0.000061 GB 2025-03-14T06:00:22.4896496Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.4897114Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4897786Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4898148Z 2025-03-14T06:00:22.4898374Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4898830Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.4899355Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.4899886Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.4900317Z Execution Analysis: Graph Hash: e7e71ae51abfe683e4b463db94966965 2025-03-14T06:00:22.4900808Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.4901279Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.4901727Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4902391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.4903230Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4904016Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4904752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4905461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4906167Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4906861Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.4907398Z Execution Analysis: (:1) 2025-03-14T06:00:22.4907898Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4908479Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4908808Z 2025-03-14T06:00:22.4909021Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4909506Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.4909971Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.4910438Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.4910856Z Compilation Analysis: Graph Hash: 5e2e57fc927e9dc655b6550d0df9923e 2025-03-14T06:00:22.4911336Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.4911753Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.4912197Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4913095Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.4914398Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.4915473Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.4916322Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4917149Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4917877Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4918602Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4919322Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4919834Z Compilation Analysis: .......... 2025-03-14T06:00:22.4920308Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4920907Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4921241Z 2025-03-14T06:00:22.4921483Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4922012Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.4922467Z Post Compilation Analysis: Graph output size: 0.000319 GB 2025-03-14T06:00:22.4922932Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.4923424Z Post Compilation Analysis: Intermediate tensor size: 0.000103 GB 2025-03-14T06:00:22.4923930Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.4924650Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4925290Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4925641Z 2025-03-14T06:00:22.4925848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4926285Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.4926752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.4927209Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.4927614Z Execution Analysis: Graph Hash: 5e2e57fc927e9dc655b6550d0df9923e 2025-03-14T06:00:22.4928078Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.4928469Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.4928883Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4929761Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.4931064Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.4932178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.4933027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4933836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4934553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4935284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4936010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4936529Z Execution Analysis: .......... 2025-03-14T06:00:22.4937005Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4937614Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4938240Z pt-xla-profiler: TransferFromDeviceTime too frequent: 3 counts during 3 steps 2025-03-14T06:00:22.4938653Z 2025-03-14T06:00:22.4938875Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4939382Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.4939932Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.4940490Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.4940929Z Compilation Analysis: Graph Hash: b2261beb2aec36188b929908024ed1e5 2025-03-14T06:00:22.4941432Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.4941868Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.4942327Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4943004Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.4943877Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4944707Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4945458Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4946210Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4946950Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4947702Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.4948280Z Compilation Analysis: (:1) 2025-03-14T06:00:22.4948811Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4949434Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4949778Z 2025-03-14T06:00:22.4950058Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4950610Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.4951088Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.4951577Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.4952089Z Post Compilation Analysis: Intermediate tensor size: 0.000086 GB 2025-03-14T06:00:22.4952624Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.4953238Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4953900Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4954260Z 2025-03-14T06:00:22.4954484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4954970Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.4955495Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.4956069Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.4956499Z Execution Analysis: Graph Hash: b2261beb2aec36188b929908024ed1e5 2025-03-14T06:00:22.4956975Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.4957385Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.4957824Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4958497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.4959348Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4960152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4960873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4961603Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4962349Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4963058Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.4963618Z Execution Analysis: (:1) 2025-03-14T06:00:22.4964132Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4964819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4965164Z 2025-03-14T06:00:22.4965514Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4965997Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.4966493Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.4966994Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.4967439Z Compilation Analysis: Graph Hash: 1530ee96117ff328527c97c302f7d224 2025-03-14T06:00:22.4967940Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.4968379Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.4968847Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4969836Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.4971169Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.4972264Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.4973137Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4973996Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4974751Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4975488Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4976230Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4976760Z Compilation Analysis: .......... 2025-03-14T06:00:22.4977256Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4977876Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4978230Z 2025-03-14T06:00:22.4978470Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4979057Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.4979537Z Post Compilation Analysis: Graph output size: 0.000331 GB 2025-03-14T06:00:22.4980026Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.4980542Z Post Compilation Analysis: Intermediate tensor size: 0.000204 GB 2025-03-14T06:00:22.4981072Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.4981689Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4982352Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4982710Z 2025-03-14T06:00:22.4982934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4983392Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.4983860Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.4984346Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.4984765Z Execution Analysis: Graph Hash: 1530ee96117ff328527c97c302f7d224 2025-03-14T06:00:22.4985299Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.4985722Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.4986170Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.4987066Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.4988364Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.4989435Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.4990283Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.4991091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.4991820Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.4992541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.4993263Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.4993783Z Execution Analysis: .......... 2025-03-14T06:00:22.4994271Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.4994878Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.4995497Z pt-xla-profiler: TransferFromDeviceTime too frequent: 4 counts during 4 steps 2025-03-14T06:00:22.4995904Z 2025-03-14T06:00:22.4996151Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.4996629Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.4997186Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.4997727Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.4998157Z Compilation Analysis: Graph Hash: 660edb8c155a215ef1bfb7ca4381ca48 2025-03-14T06:00:22.4998641Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.4999059Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.4999496Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5000155Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5001012Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5001841Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5002585Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5003319Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5004040Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5004836Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5005399Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5005907Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5006515Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5006854Z 2025-03-14T06:00:22.5007087Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5007612Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5008068Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5008572Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5009063Z Post Compilation Analysis: Intermediate tensor size: 0.000129 GB 2025-03-14T06:00:22.5009575Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5010174Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5010812Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5011161Z 2025-03-14T06:00:22.5011373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5011812Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5012312Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5012835Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5013247Z Execution Analysis: Graph Hash: 660edb8c155a215ef1bfb7ca4381ca48 2025-03-14T06:00:22.5013723Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5014122Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5014548Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5015193Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5016057Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5016847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5017560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5018268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5018986Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5019676Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5020213Z Execution Analysis: (:1) 2025-03-14T06:00:22.5020702Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5021281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5021615Z 2025-03-14T06:00:22.5021830Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5022289Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5022757Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5023259Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5023685Z Compilation Analysis: Graph Hash: 788fdd2ebe73519864dc0ab03d73131f 2025-03-14T06:00:22.5024172Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5024598Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5025041Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5025935Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5027244Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5028334Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5029210Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5030048Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5030802Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5031584Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5032329Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5032865Z Compilation Analysis: .......... 2025-03-14T06:00:22.5033364Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5033991Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5034347Z 2025-03-14T06:00:22.5034588Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5035138Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5035622Z Post Compilation Analysis: Graph output size: 0.000342 GB 2025-03-14T06:00:22.5036115Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5036632Z Post Compilation Analysis: Intermediate tensor size: 0.000402 GB 2025-03-14T06:00:22.5037161Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5037768Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5038453Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5038812Z 2025-03-14T06:00:22.5039037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5039494Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5039951Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5040436Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5040857Z Execution Analysis: Graph Hash: 788fdd2ebe73519864dc0ab03d73131f 2025-03-14T06:00:22.5041362Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5041781Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5042230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5043123Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5044428Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5045580Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5046435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5047272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5048008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5048727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5049455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5049974Z Execution Analysis: .......... 2025-03-14T06:00:22.5050449Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5051051Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5051653Z pt-xla-profiler: TransferFromDeviceTime too frequent: 5 counts during 5 steps 2025-03-14T06:00:22.5052063Z 2025-03-14T06:00:22.5052294Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5052758Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5053313Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5053895Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5054341Z Compilation Analysis: Graph Hash: e4776ffa071926a90a89be3777c652f9 2025-03-14T06:00:22.5054841Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5055279Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5055739Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5056423Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5057301Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5058124Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5058876Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5059622Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5060366Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5061094Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5061675Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5062236Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5062860Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5063215Z 2025-03-14T06:00:22.5063456Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5064005Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5064498Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5065010Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5065652Z Post Compilation Analysis: Intermediate tensor size: 0.000172 GB 2025-03-14T06:00:22.5066192Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5066810Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5067474Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5067834Z 2025-03-14T06:00:22.5068059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5068515Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5069039Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5069652Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5070079Z Execution Analysis: Graph Hash: e4776ffa071926a90a89be3777c652f9 2025-03-14T06:00:22.5070557Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5070972Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5071411Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5072062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5072916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5073725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5074456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5075181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5075904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5076610Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5077206Z Execution Analysis: (:1) 2025-03-14T06:00:22.5077698Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5078296Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5078640Z 2025-03-14T06:00:22.5078884Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5079372Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5079846Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5080339Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5080776Z Compilation Analysis: Graph Hash: bf76b4366ad78d6f64b92dbee7a6369 2025-03-14T06:00:22.5081276Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5081715Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5082193Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5083108Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5084440Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5085670Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5086549Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5087383Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5088141Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5088935Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5089680Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5090215Z Compilation Analysis: .......... 2025-03-14T06:00:22.5090711Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5091334Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5091689Z 2025-03-14T06:00:22.5091930Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5092480Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5092955Z Post Compilation Analysis: Graph output size: 0.000354 GB 2025-03-14T06:00:22.5093469Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5093988Z Post Compilation Analysis: Intermediate tensor size: 0.000557 GB 2025-03-14T06:00:22.5094523Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5095133Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5095795Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5096170Z 2025-03-14T06:00:22.5096384Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5096848Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5097307Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5097788Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5098214Z Execution Analysis: Graph Hash: bf76b4366ad78d6f64b92dbee7a6369 2025-03-14T06:00:22.5098703Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5099130Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5099583Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5100513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5101816Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5102887Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5103742Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5104545Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5105277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5106007Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5106740Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5107257Z Execution Analysis: .......... 2025-03-14T06:00:22.5107727Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5108350Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5108964Z pt-xla-profiler: TransferFromDeviceTime too frequent: 6 counts during 6 steps 2025-03-14T06:00:22.5109358Z 2025-03-14T06:00:22.5109596Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5110076Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5110637Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5111220Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5111653Z Compilation Analysis: Graph Hash: 6ef223b5c704888f8ec05d377eb6b7ea 2025-03-14T06:00:22.5112152Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5112583Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5113051Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5113735Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5114609Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5115444Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5116197Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5116972Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5117711Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5118442Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5119021Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5119561Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5120188Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5120543Z 2025-03-14T06:00:22.5120782Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5121334Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5121821Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5122326Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5122844Z Post Compilation Analysis: Intermediate tensor size: 0.000215 GB 2025-03-14T06:00:22.5227403Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5228062Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5228729Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5229098Z 2025-03-14T06:00:22.5229330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5229783Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5230303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5230835Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5231248Z Execution Analysis: Graph Hash: 6ef223b5c704888f8ec05d377eb6b7ea 2025-03-14T06:00:22.5231724Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5232131Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5232554Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5233196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5234027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5234960Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5235682Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5236392Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5237089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5237775Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5238371Z Execution Analysis: (:1) 2025-03-14T06:00:22.5238871Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5239456Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5239787Z 2025-03-14T06:00:22.5240003Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5240468Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5240937Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5241411Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5241828Z Compilation Analysis: Graph Hash: c236057acfc8889a2e675a1016709dfb 2025-03-14T06:00:22.5242305Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5242764Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5243210Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5244106Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5245559Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5246634Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5247490Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5248303Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5249033Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5249760Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5250490Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5251079Z Compilation Analysis: .......... 2025-03-14T06:00:22.5251575Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5252206Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5252549Z 2025-03-14T06:00:22.5252806Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5253364Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5253848Z Post Compilation Analysis: Graph output size: 0.000366 GB 2025-03-14T06:00:22.5254337Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5254859Z Post Compilation Analysis: Intermediate tensor size: 0.000695 GB 2025-03-14T06:00:22.5255395Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5256015Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5256686Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5257046Z 2025-03-14T06:00:22.5257275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5257778Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5258248Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5258723Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5259149Z Execution Analysis: Graph Hash: c236057acfc8889a2e675a1016709dfb 2025-03-14T06:00:22.5259629Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5260060Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5260504Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5261450Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5262759Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5263834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5264691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5265652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5266392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5267177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5267915Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5268443Z Execution Analysis: .......... 2025-03-14T06:00:22.5268922Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5269529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5270153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 7 counts during 7 steps 2025-03-14T06:00:22.5270563Z 2025-03-14T06:00:22.5270790Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5271275Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5271828Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5272387Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5272835Z Compilation Analysis: Graph Hash: 3f8b04fb0ed90ab101c5b5f449fecb59 2025-03-14T06:00:22.5273346Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5273824Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5274293Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5274975Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5275855Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5276693Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5277450Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5278206Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5278948Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5279656Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5280216Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5280727Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5281329Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5281662Z 2025-03-14T06:00:22.5281950Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5282488Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5282953Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5283428Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5283930Z Post Compilation Analysis: Intermediate tensor size: 0.000257 GB 2025-03-14T06:00:22.5284530Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5285165Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5285818Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5286173Z 2025-03-14T06:00:22.5286381Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5286818Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5287324Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5287848Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5288260Z Execution Analysis: Graph Hash: 3f8b04fb0ed90ab101c5b5f449fecb59 2025-03-14T06:00:22.5288721Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5289157Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5289584Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5290227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5291056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5291845Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5292556Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5293264Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5293970Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5294671Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5295222Z Execution Analysis: (:1) 2025-03-14T06:00:22.5295715Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5296327Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5296658Z 2025-03-14T06:00:22.5296877Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5297338Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5297807Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5298288Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5298715Z Compilation Analysis: Graph Hash: 7678ae35e827c08da7128326b3077eda 2025-03-14T06:00:22.5299202Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5299619Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5300072Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5300976Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5302288Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5303367Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5304246Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5305055Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5305789Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5306523Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5307254Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5307827Z Compilation Analysis: .......... 2025-03-14T06:00:22.5308301Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5308901Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5309237Z 2025-03-14T06:00:22.5309477Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5310015Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5310477Z Post Compilation Analysis: Graph output size: 0.000377 GB 2025-03-14T06:00:22.5310951Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5311445Z Post Compilation Analysis: Intermediate tensor size: 0.000835 GB 2025-03-14T06:00:22.5311955Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5312592Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5313237Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5313590Z 2025-03-14T06:00:22.5313800Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5314242Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5314685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5315147Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5315550Z Execution Analysis: Graph Hash: 7678ae35e827c08da7128326b3077eda 2025-03-14T06:00:22.5316012Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5316412Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5316843Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5317708Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5319027Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5320084Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5320919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5321708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5322417Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5323121Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5323829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5324325Z Execution Analysis: .......... 2025-03-14T06:00:22.5324867Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5325447Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5326054Z pt-xla-profiler: TransferFromDeviceTime too frequent: 8 counts during 8 steps 2025-03-14T06:00:22.5326455Z 2025-03-14T06:00:22.5326705Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5327177Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5327706Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5328252Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5328688Z Compilation Analysis: Graph Hash: cdcc6580eec753bad9dae222ce905a56 2025-03-14T06:00:22.5329190Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5329641Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5330089Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5330753Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5331614Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5332434Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5333167Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5333900Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5334624Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5335432Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5335995Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5336506Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5337110Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5337454Z 2025-03-14T06:00:22.5337692Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5338225Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5338679Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5339147Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5339646Z Post Compilation Analysis: Intermediate tensor size: 0.000300 GB 2025-03-14T06:00:22.5340157Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5340754Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5341395Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5341772Z 2025-03-14T06:00:22.5341988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5342436Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5342948Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5343472Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5343896Z Execution Analysis: Graph Hash: cdcc6580eec753bad9dae222ce905a56 2025-03-14T06:00:22.5344376Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5344782Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5345205Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5345851Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5346680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5347472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5348187Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5348936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5349641Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5350333Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5350877Z Execution Analysis: (:1) 2025-03-14T06:00:22.5351367Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5351975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5352309Z 2025-03-14T06:00:22.5352538Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5353000Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5353465Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5353937Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5354365Z Compilation Analysis: Graph Hash: 34d031311738ac27cd5aef299aea6b1a 2025-03-14T06:00:22.5354846Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5355269Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5355723Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5356616Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5357949Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5359032Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5359888Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5360704Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5361440Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5362163Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5362888Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5363398Z Compilation Analysis: .......... 2025-03-14T06:00:22.5363881Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5364963Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5365427Z 2025-03-14T06:00:22.5365662Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5366194Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5366658Z Post Compilation Analysis: Graph output size: 0.000389 GB 2025-03-14T06:00:22.5367127Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5367618Z Post Compilation Analysis: Intermediate tensor size: 0.000975 GB 2025-03-14T06:00:22.5368138Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5368741Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5369385Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5369744Z 2025-03-14T06:00:22.5369950Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5370395Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5370839Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5371305Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5371768Z Execution Analysis: Graph Hash: 34d031311738ac27cd5aef299aea6b1a 2025-03-14T06:00:22.5372236Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5372642Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5373076Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5373959Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5375279Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5376341Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5377171Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5377963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5378676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5379380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5380122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5380668Z Execution Analysis: .......... 2025-03-14T06:00:22.5381133Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5381720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5382322Z pt-xla-profiler: TransferFromDeviceTime too frequent: 9 counts during 9 steps 2025-03-14T06:00:22.5382709Z 2025-03-14T06:00:22.5382930Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5383397Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5383936Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5384470Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5384890Z Compilation Analysis: Graph Hash: c302cc49917a60bfd134204440128db4 2025-03-14T06:00:22.5385364Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5385783Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5386225Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5386892Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5387785Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5388598Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5389339Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5390067Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5390792Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5391499Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5392072Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5392577Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5393188Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5393534Z 2025-03-14T06:00:22.5393775Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5394312Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5394793Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5395265Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5395770Z Post Compilation Analysis: Intermediate tensor size: 0.000343 GB 2025-03-14T06:00:22.5396289Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5396893Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5397581Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5397951Z 2025-03-14T06:00:22.5398158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5398606Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5399121Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5399650Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5400058Z Execution Analysis: Graph Hash: c302cc49917a60bfd134204440128db4 2025-03-14T06:00:22.5400525Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5400920Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5401344Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5401992Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5402857Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5403648Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5404365Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5405148Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5405857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5406552Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5407097Z Execution Analysis: (:1) 2025-03-14T06:00:22.5407593Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5408180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5408503Z 2025-03-14T06:00:22.5408734Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5409234Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5409701Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5410181Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5410611Z Compilation Analysis: Graph Hash: 49770469b85408ab4adfa17f7dd8b656 2025-03-14T06:00:22.5411095Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5411519Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5411973Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5412878Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5414192Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5415262Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5416123Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5416931Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5417689Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5418423Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5419152Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5419676Z Compilation Analysis: .......... 2025-03-14T06:00:22.5420162Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5420807Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5421147Z 2025-03-14T06:00:22.5421394Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5421926Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5422395Z Post Compilation Analysis: Graph output size: 0.000401 GB 2025-03-14T06:00:22.5422873Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5423379Z Post Compilation Analysis: Intermediate tensor size: 0.001114 GB 2025-03-14T06:00:22.5423884Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5424493Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5425140Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5425532Z 2025-03-14T06:00:22.5425754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5426194Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5426635Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5427099Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5427507Z Execution Analysis: Graph Hash: 49770469b85408ab4adfa17f7dd8b656 2025-03-14T06:00:22.5427975Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5428392Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5429097Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5430141Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5431573Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5432819Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5433834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5434770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5435645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5436600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5437449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5438111Z Execution Analysis: .......... 2025-03-14T06:00:22.5438690Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5439420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5440201Z pt-xla-profiler: TransferFromDeviceTime too frequent: 10 counts during 10 steps 2025-03-14T06:00:22.5440740Z 2025-03-14T06:00:22.5441001Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5441630Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5442306Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5443033Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5443645Z Compilation Analysis: Graph Hash: c174d3f4c85200ee3fbc3051ca8bc765 2025-03-14T06:00:22.5444270Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5444929Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5445507Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5446379Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5447387Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5448402Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5449325Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5450230Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5451189Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5452062Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5452745Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5453415Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5454232Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5454613Z 2025-03-14T06:00:22.5454931Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5455575Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5545481Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5546030Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5546554Z Post Compilation Analysis: Intermediate tensor size: 0.000386 GB 2025-03-14T06:00:22.5547075Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5547682Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5548340Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5548714Z 2025-03-14T06:00:22.5548929Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5549525Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5550020Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5550535Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5550941Z Execution Analysis: Graph Hash: c174d3f4c85200ee3fbc3051ca8bc765 2025-03-14T06:00:22.5551412Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5551807Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5552226Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5552867Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5553706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5554492Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5555207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5555913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5556616Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5557300Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5557903Z Execution Analysis: (:1) 2025-03-14T06:00:22.5558403Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5558987Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5559311Z 2025-03-14T06:00:22.5559535Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5560036Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5560510Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5560981Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5561406Z Compilation Analysis: Graph Hash: 4fa0da965d7ce2d006e0733c6aac9131 2025-03-14T06:00:22.5561892Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5562311Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5562759Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5563669Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5565093Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5566380Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5567229Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5568027Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5568750Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5569471Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5570184Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5570688Z Compilation Analysis: .......... 2025-03-14T06:00:22.5571154Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5571753Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5572088Z 2025-03-14T06:00:22.5572326Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5572893Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5573345Z Post Compilation Analysis: Graph output size: 0.000413 GB 2025-03-14T06:00:22.5573804Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5574296Z Post Compilation Analysis: Intermediate tensor size: 0.001253 GB 2025-03-14T06:00:22.5574806Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5575394Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5576032Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5576394Z 2025-03-14T06:00:22.5576594Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5577033Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5577469Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5577920Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5578324Z Execution Analysis: Graph Hash: 4fa0da965d7ce2d006e0733c6aac9131 2025-03-14T06:00:22.5578782Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5579178Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5579635Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5580510Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5581786Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5582872Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5583695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5584473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5585177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5585877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5586571Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5587064Z Execution Analysis: .......... 2025-03-14T06:00:22.5587511Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5588085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5588672Z pt-xla-profiler: CompileTime too frequent: 21 counts during 11 steps 2025-03-14T06:00:22.5589275Z pt-xla-profiler: TransferFromDeviceTime too frequent: 11 counts during 11 steps 2025-03-14T06:00:22.5589667Z 2025-03-14T06:00:22.5589885Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5590344Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5590861Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5591392Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5591812Z Compilation Analysis: Graph Hash: b553f9b638c97c0ede28eb2b85f2798d 2025-03-14T06:00:22.5592292Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5592691Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5593128Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5593790Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5594636Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5595469Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5596193Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5596912Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5597629Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5598322Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5598878Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5599386Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5599988Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5600333Z 2025-03-14T06:00:22.5600563Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5601085Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5601543Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5602004Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5602516Z Post Compilation Analysis: Intermediate tensor size: 0.000429 GB 2025-03-14T06:00:22.5603020Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5603604Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5604239Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5604674Z 2025-03-14T06:00:22.5604912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5605351Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5605912Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5606429Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5606832Z Execution Analysis: Graph Hash: b553f9b638c97c0ede28eb2b85f2798d 2025-03-14T06:00:22.5607293Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5607689Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5608106Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5608741Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5609564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5610389Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5611088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5611787Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5612478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5613162Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5613696Z Execution Analysis: (:1) 2025-03-14T06:00:22.5614181Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5614754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5615082Z 2025-03-14T06:00:22.5615294Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5615751Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5616216Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5616714Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5617238Z Compilation Analysis: Graph Hash: 91c713f8cb95268896b612d4cbbc0264 2025-03-14T06:00:22.5617699Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5618098Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5618533Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5619412Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5620873Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5622051Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5622877Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5623665Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5624370Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5625101Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5625794Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5626284Z Compilation Analysis: .......... 2025-03-14T06:00:22.5626743Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5627322Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5627653Z 2025-03-14T06:00:22.5627922Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5628434Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5628882Z Post Compilation Analysis: Graph output size: 0.000424 GB 2025-03-14T06:00:22.5629330Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5629806Z Post Compilation Analysis: Intermediate tensor size: 0.001392 GB 2025-03-14T06:00:22.5629992Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5630280Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5630503Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5630508Z 2025-03-14T06:00:22.5630742Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5630853Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5631080Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5631189Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5631385Z Execution Analysis: Graph Hash: 91c713f8cb95268896b612d4cbbc0264 2025-03-14T06:00:22.5631527Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5631673Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5631836Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5632418Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5632973Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5633331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5633673Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5634006Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5634275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5634575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5634837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5634942Z Execution Analysis: .......... 2025-03-14T06:00:22.5635194Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5635389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5635617Z pt-xla-profiler: CompileTime too frequent: 23 counts during 12 steps 2025-03-14T06:00:22.5635886Z pt-xla-profiler: TransferFromDeviceTime too frequent: 12 counts during 12 steps 2025-03-14T06:00:22.5635893Z 2025-03-14T06:00:22.5636102Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5636218Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5636515Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5636652Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5636866Z Compilation Analysis: Graph Hash: 42c4ab789f1156aeab390ba9df0b9bf2 2025-03-14T06:00:22.5637010Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5637163Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5637333Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5637696Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5638075Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5638394Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5638668Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5638981Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5639253Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5639554Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5639682Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5639948Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5640184Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5640188Z 2025-03-14T06:00:22.5640420Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5640581Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5640757Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5640926Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5641130Z Post Compilation Analysis: Intermediate tensor size: 0.000472 GB 2025-03-14T06:00:22.5641312Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5641596Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5641819Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5641826Z 2025-03-14T06:00:22.5642030Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5642165Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5642453Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5642562Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5642768Z Execution Analysis: Graph Hash: 42c4ab789f1156aeab390ba9df0b9bf2 2025-03-14T06:00:22.5642904Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5643048Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5643212Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5643563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5643901Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5644211Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5644547Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5644863Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5645295Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5645593Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5645748Z Execution Analysis: (:1) 2025-03-14T06:00:22.5646013Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5646213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5646218Z 2025-03-14T06:00:22.5646435Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5646584Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5646835Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5646948Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5647167Z Compilation Analysis: Graph Hash: b6f363e184486e309763e8a981398cc8 2025-03-14T06:00:22.5647318Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5647474Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5647652Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5648259Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5648845Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5649248Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5649615Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5649938Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5650226Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5650540Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5650822Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5650928Z Compilation Analysis: .......... 2025-03-14T06:00:22.5651202Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5651412Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5651419Z 2025-03-14T06:00:22.5651659Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5651933Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5652114Z Post Compilation Analysis: Graph output size: 0.000436 GB 2025-03-14T06:00:22.5652286Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5652497Z Post Compilation Analysis: Intermediate tensor size: 0.001533 GB 2025-03-14T06:00:22.5652687Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5652978Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5653209Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5653213Z 2025-03-14T06:00:22.5653415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5653538Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5653771Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5653880Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5654082Z Execution Analysis: Graph Hash: b6f363e184486e309763e8a981398cc8 2025-03-14T06:00:22.5654226Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5654373Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5654561Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5655153Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5655726Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5656094Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5656468Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5656786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5657165Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5657469Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5657729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5657838Z Execution Analysis: .......... 2025-03-14T06:00:22.5658086Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5658287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5658533Z pt-xla-profiler: CompileTime too frequent: 25 counts during 13 steps 2025-03-14T06:00:22.5658807Z pt-xla-profiler: TransferFromDeviceTime too frequent: 13 counts during 13 steps 2025-03-14T06:00:22.5658814Z 2025-03-14T06:00:22.5659020Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5659145Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5659440Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5659557Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5659760Z Compilation Analysis: Graph Hash: 7326a28ed8c6fc77e7691bf0bc3ad8ee 2025-03-14T06:00:22.5659910Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5660057Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5660234Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5660591Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5660953Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5661293Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5661665Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5661958Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5662222Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5662501Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5662629Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5662874Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5663081Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5663085Z 2025-03-14T06:00:22.5663304Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5663462Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5663629Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5663790Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5664020Z Post Compilation Analysis: Intermediate tensor size: 0.000515 GB 2025-03-14T06:00:22.5664195Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5664467Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5664678Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5664684Z 2025-03-14T06:00:22.5664904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5665012Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5665402Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5665503Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5665867Z Execution Analysis: Graph Hash: 7326a28ed8c6fc77e7691bf0bc3ad8ee 2025-03-14T06:00:22.5666011Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5666160Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5666341Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5666703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5667049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5667419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5667692Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5668002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5668273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5668565Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5668689Z Execution Analysis: (:1) 2025-03-14T06:00:22.5668951Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5669150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5669154Z 2025-03-14T06:00:22.5669369Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5669491Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5669740Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5669888Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5670103Z Compilation Analysis: Graph Hash: d67345a3a0b7aef4202002e6b1633905 2025-03-14T06:00:22.5670251Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5670408Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5670584Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5671192Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5671775Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5672152Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5672513Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5672841Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5673124Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5673447Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5673760Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5673877Z Compilation Analysis: .......... 2025-03-14T06:00:22.5674143Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5674361Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5674368Z 2025-03-14T06:00:22.5674637Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5674814Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5674986Z Post Compilation Analysis: Graph output size: 0.000448 GB 2025-03-14T06:00:22.5675169Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5675368Z Post Compilation Analysis: Intermediate tensor size: 0.001744 GB 2025-03-14T06:00:22.5675565Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5675848Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5676082Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5676087Z 2025-03-14T06:00:22.5676294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5676431Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5676661Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5676779Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5676977Z Execution Analysis: Graph Hash: d67345a3a0b7aef4202002e6b1633905 2025-03-14T06:00:22.5677126Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5677271Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5677441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5678143Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5678704Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5679057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5679397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5679727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5679994Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5680296Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5680556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5680665Z Execution Analysis: .......... 2025-03-14T06:00:22.5680915Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5681115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5681332Z pt-xla-profiler: CompileTime too frequent: 27 counts during 14 steps 2025-03-14T06:00:22.5681704Z pt-xla-profiler: TransferFromDeviceTime too frequent: 14 counts during 14 steps 2025-03-14T06:00:22.5681710Z 2025-03-14T06:00:22.5681904Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5682021Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5682298Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5682408Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5682630Z Compilation Analysis: Graph Hash: 6edf523bd098482ccb7ece686387aab0 2025-03-14T06:00:22.5682773Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5682908Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5683076Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5683414Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5683781Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5684082Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5684347Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5684699Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5685135Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5685440Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5685580Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5685888Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5686142Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5686149Z 2025-03-14T06:00:22.5686384Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5686561Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5686735Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5686913Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5687120Z Post Compilation Analysis: Intermediate tensor size: 0.000558 GB 2025-03-14T06:00:22.5687311Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5687600Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5687832Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5687839Z 2025-03-14T06:00:22.5688045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5688163Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5688481Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5688599Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5688805Z Execution Analysis: Graph Hash: 6edf523bd098482ccb7ece686387aab0 2025-03-14T06:00:22.5688953Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5689094Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5689271Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5689626Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5689985Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5690296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5690582Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5690890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5691164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5691451Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5691580Z Execution Analysis: (:1) 2025-03-14T06:00:22.5691859Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5692064Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5692069Z 2025-03-14T06:00:22.5692277Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5692413Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5692675Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5692798Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5693015Z Compilation Analysis: Graph Hash: 3518d8da42ee3b27dd23f4dd59ef4234 2025-03-14T06:00:22.5693172Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5693324Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5693508Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5694113Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5694705Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5695103Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5695468Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5695796Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5696076Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5696399Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5696677Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5696787Z Compilation Analysis: .......... 2025-03-14T06:00:22.5697158Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5697368Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5697375Z 2025-03-14T06:00:22.5697599Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5697807Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5697975Z Post Compilation Analysis: Graph output size: 0.000460 GB 2025-03-14T06:00:22.5698150Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5698345Z Post Compilation Analysis: Intermediate tensor size: 0.001951 GB 2025-03-14T06:00:22.5698530Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5698810Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5699041Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5699045Z 2025-03-14T06:00:22.5699242Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5699358Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5699582Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5699693Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5699892Z Execution Analysis: Graph Hash: 3518d8da42ee3b27dd23f4dd59ef4234 2025-03-14T06:00:22.5700035Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5700178Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5700343Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5700938Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5701501Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5701850Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5702224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5702529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5702797Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5703098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5703365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5703469Z Execution Analysis: .......... 2025-03-14T06:00:22.5703722Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5703913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5704159Z pt-xla-profiler: CompileTime too frequent: 29 counts during 15 steps 2025-03-14T06:00:22.5704426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 15 counts during 15 steps 2025-03-14T06:00:22.5704432Z 2025-03-14T06:00:22.5704644Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5704764Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5705058Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5705171Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5705376Z Compilation Analysis: Graph Hash: e357452a92064e72019120f97b2e9eff 2025-03-14T06:00:22.5705520Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5705668Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5705842Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5706210Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5706563Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5706909Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5707283Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5707582Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5707839Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5708123Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5708244Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5708500Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5708700Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5708706Z 2025-03-14T06:00:22.5708923Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5709086Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5709245Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5709413Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5709599Z Post Compilation Analysis: Intermediate tensor size: 0.000601 GB 2025-03-14T06:00:22.5709804Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5710067Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5710288Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5710295Z 2025-03-14T06:00:22.5710482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5710617Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5710886Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5710992Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5711172Z Execution Analysis: Graph Hash: e357452a92064e72019120f97b2e9eff 2025-03-14T06:00:22.5711309Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5711436Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5711595Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5711919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5712250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5712558Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5712816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5713098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5713350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5713621Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5713741Z Execution Analysis: (:1) 2025-03-14T06:00:22.5713978Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5714169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5714173Z 2025-03-14T06:00:22.5714369Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5714489Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5714709Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5714843Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5715038Z Compilation Analysis: Graph Hash: 863f6315abeac31372e82cb8ee379f0e 2025-03-14T06:00:22.5715180Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5715319Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5715486Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5716041Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5716582Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5716923Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5717261Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5717563Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5717826Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5718124Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5718408Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5718506Z Compilation Analysis: .......... 2025-03-14T06:00:22.5718758Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5718952Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5718958Z 2025-03-14T06:00:22.5719199Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5719356Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5719523Z Post Compilation Analysis: Graph output size: 0.000471 GB 2025-03-14T06:00:22.5719683Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5719878Z Post Compilation Analysis: Intermediate tensor size: 0.002101 GB 2025-03-14T06:00:22.5720051Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5720320Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5720532Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5720542Z 2025-03-14T06:00:22.5720725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5720864Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5721076Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5721182Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5721366Z Execution Analysis: Graph Hash: 863f6315abeac31372e82cb8ee379f0e 2025-03-14T06:00:22.5721503Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5721636Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5721789Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5722339Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5722873Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5723201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5723534Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5723845Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5724100Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5724378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5724719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5724815Z Execution Analysis: .......... 2025-03-14T06:00:22.5725232Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5725431Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5725661Z pt-xla-profiler: CompileTime too frequent: 31 counts during 16 steps 2025-03-14T06:00:22.5725940Z pt-xla-profiler: TransferFromDeviceTime too frequent: 16 counts during 16 steps 2025-03-14T06:00:22.5725947Z 2025-03-14T06:00:22.5726166Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5726289Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5726597Z Compilation Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5726710Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5726957Z Compilation Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5727109Z Compilation Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5727262Z Compilation Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5727440Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5727810Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5728200Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5728532Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5728813Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5729135Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5729413Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5729718Z Compilation Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5729852Z Compilation Analysis: (:1) 2025-03-14T06:00:22.5730124Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5730376Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5730381Z 2025-03-14T06:00:22.5730617Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5730789Z Post Compilation Analysis: Graph input size: 0.000129 GB 2025-03-14T06:00:22.5730966Z Post Compilation Analysis: Graph output size: 0.000000 GB 2025-03-14T06:00:22.5731139Z Post Compilation Analysis: Aliased Input size: 0.000000 GB 2025-03-14T06:00:22.5731346Z Post Compilation Analysis: Intermediate tensor size: 0.000644 GB 2025-03-14T06:00:22.5731535Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5731824Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5732056Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5732063Z 2025-03-14T06:00:22.5732271Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5732383Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5732703Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5732810Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5733018Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5733159Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5733303Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5733471Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5733827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5734175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5734488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5734763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5735078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5735344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5735641Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5735764Z Execution Analysis: (:1) 2025-03-14T06:00:22.5736052Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5736252Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5736262Z 2025-03-14T06:00:22.5736471Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5736603Z Compilation Analysis: Compilation Cause 2025-03-14T06:00:22.5736866Z Compilation Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5736983Z Compilation Analysis: Graph Info: 2025-03-14T06:00:22.5737297Z Compilation Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5737434Z Compilation Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5737577Z Compilation Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5737740Z Compilation Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5738300Z Compilation Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5738842Z Compilation Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5739180Z Compilation Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5739548Z Compilation Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5739848Z Compilation Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5740116Z Compilation Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5740407Z Compilation Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5740669Z Compilation Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5740768Z Compilation Analysis: .......... 2025-03-14T06:00:22.5741018Z Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5741213Z Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5741219Z 2025-03-14T06:00:22.5741438Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5741596Z Post Compilation Analysis: Graph input size: 0.000210 GB 2025-03-14T06:00:22.5741788Z Post Compilation Analysis: Graph output size: 0.000483 GB 2025-03-14T06:00:22.5741952Z Post Compilation Analysis: Aliased Input size: 0.000163 GB 2025-03-14T06:00:22.5742142Z Post Compilation Analysis: Intermediate tensor size: 0.002251 GB 2025-03-14T06:00:22.5742318Z Post Compilation Analysis: Compiled program size: 0.000000 GB 2025-03-14T06:00:22.5742591Z Post Compilation Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5742803Z Post Compilation Analysis: ================================================================================ 2025-03-14T06:00:22.5742808Z 2025-03-14T06:00:22.5742997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5743101Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5743320Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5743597Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5743842Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5744054Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5744239Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5744471Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5745062Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5745728Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5746166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5746602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5746928Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5747256Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5747609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5747961Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5748093Z Execution Analysis: .......... 2025-03-14T06:00:22.5748410Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5748629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5748923Z pt-xla-profiler: CompileTime too frequent: 33 counts during 17 steps 2025-03-14T06:00:22.5749267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 17 counts during 17 steps 2025-03-14T06:00:22.5749314Z 2025-03-14T06:00:22.5749537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5749717Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5750019Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5750212Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5750461Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5750669Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5750834Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5751023Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5751413Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5751935Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5752260Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5752616Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5752936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5753249Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5753589Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5753797Z Execution Analysis: (:1) 2025-03-14T06:00:22.5754069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5754330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5754336Z 2025-03-14T06:00:22.5754564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5754763Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5755026Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5755202Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5755422Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5755636Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5755814Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5756088Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5756670Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5757273Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5757673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5758116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5758466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5758812Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5759132Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5759462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5759595Z Execution Analysis: .......... 2025-03-14T06:00:22.5759914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5760176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5760468Z pt-xla-profiler: CompileTime too frequent: 33 counts during 18 steps 2025-03-14T06:00:22.5760761Z pt-xla-profiler: TransferFromDeviceTime too frequent: 18 counts during 18 steps 2025-03-14T06:00:22.5760807Z 2025-03-14T06:00:22.5761027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5761215Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5761537Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5761721Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5761944Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5762152Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5762298Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5762576Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5762951Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5763376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5763771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5764082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5764435Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5764875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5765494Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5765698Z Execution Analysis: (:1) 2025-03-14T06:00:22.5765998Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5766306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5766313Z 2025-03-14T06:00:22.5766577Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5766771Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5767044Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5767235Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5767519Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5767811Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5767995Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5768243Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5768871Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5769555Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5770000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5770445Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5770865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5771221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5771575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5771937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5772139Z Execution Analysis: .......... 2025-03-14T06:00:22.5772484Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5772725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5773038Z pt-xla-profiler: CompileTime too frequent: 33 counts during 19 steps 2025-03-14T06:00:22.5773330Z pt-xla-profiler: TransferFromDeviceTime too frequent: 19 counts during 19 steps 2025-03-14T06:00:22.5773420Z 2025-03-14T06:00:22.5773679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5773875Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5774215Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5774404Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5774622Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5774901Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5775083Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5775336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5775771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5776180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5776556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5776996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5777458Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5777902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5778211Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5778410Z Execution Analysis: (:1) 2025-03-14T06:00:22.5778698Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5778973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5778978Z 2025-03-14T06:00:22.5779197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5779377Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5779633Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5779861Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5780084Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5780290Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5780461Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5780672Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5781321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5781949Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5782314Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5782717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5783038Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5783390Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5783817Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5784144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5784278Z Execution Analysis: .......... 2025-03-14T06:00:22.5784590Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5784799Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5785134Z pt-xla-profiler: CompileTime too frequent: 33 counts during 20 steps 2025-03-14T06:00:22.5785427Z pt-xla-profiler: TransferFromDeviceTime too frequent: 20 counts during 20 steps 2025-03-14T06:00:22.5785473Z 2025-03-14T06:00:22.5785698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5785888Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5786171Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5786393Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5786620Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5786852Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5787026Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5787237Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5787632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5788048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5788370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5788705Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5789022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5789438Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5789760Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5789953Z Execution Analysis: (:1) 2025-03-14T06:00:22.5790233Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5790496Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5790501Z 2025-03-14T06:00:22.5790728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5790978Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5791228Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5791412Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5791637Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5791851Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5792048Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5792304Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5792884Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5793488Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5793855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5794263Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5794600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5794970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5795288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5795841Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5795962Z Execution Analysis: .......... 2025-03-14T06:00:22.5796348Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5796585Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5796881Z pt-xla-profiler: CompileTime too frequent: 33 counts during 21 steps 2025-03-14T06:00:22.5797186Z pt-xla-profiler: TransferFromDeviceTime too frequent: 21 counts during 21 steps 2025-03-14T06:00:22.5816526Z 2025-03-14T06:00:22.5817022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5817296Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5817721Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5817926Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5818180Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5818386Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5818611Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5818802Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5819211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5819578Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5819951Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5820259Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5820618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5820901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5821251Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5821382Z Execution Analysis: (:1) 2025-03-14T06:00:22.5821799Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5822021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5822026Z 2025-03-14T06:00:22.5822293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5822434Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5822705Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5822901Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5823252Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5823432Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5823645Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5823833Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5824465Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5825047Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5825459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5826620Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5826990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5827265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5827673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5827962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5828135Z Execution Analysis: .......... 2025-03-14T06:00:22.5828410Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5828654Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5828920Z pt-xla-profiler: CompileTime too frequent: 33 counts during 22 steps 2025-03-14T06:00:22.5829279Z pt-xla-profiler: TransferFromDeviceTime too frequent: 22 counts during 22 steps 2025-03-14T06:00:22.5829285Z 2025-03-14T06:00:22.5829552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5829722Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5830044Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5830204Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5830564Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5830733Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5830939Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5831129Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5831548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5831923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5832294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5832582Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5832940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5833203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5833619Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5833770Z Execution Analysis: (:1) 2025-03-14T06:00:22.5834080Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5834299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5834306Z 2025-03-14T06:00:22.5834554Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5834748Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5835059Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5835197Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5835469Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5835637Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5835935Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5836145Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5836767Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5837331Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5837776Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5838116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5838523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5838809Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5839176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5839460Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5839616Z Execution Analysis: .......... 2025-03-14T06:00:22.5839911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5840189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5840441Z pt-xla-profiler: CompileTime too frequent: 33 counts during 23 steps 2025-03-14T06:00:22.5840771Z pt-xla-profiler: TransferFromDeviceTime too frequent: 24 counts during 23 steps 2025-03-14T06:00:22.5840803Z 2025-03-14T06:00:22.5841045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5841212Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5841577Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5841713Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5841976Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5842217Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5842433Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5842638Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5843055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5843417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5843782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5844049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5844455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5844879Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5845423Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5845582Z Execution Analysis: (:1) 2025-03-14T06:00:22.5845900Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5846212Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5846219Z 2025-03-14T06:00:22.5846518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5846667Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5846975Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5847120Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5847426Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5847625Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5847849Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5848119Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5848788Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5849417Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5849907Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5850296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5850688Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5851001Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5851374Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5851715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5851915Z Execution Analysis: .......... 2025-03-14T06:00:22.5852210Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5852501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5852787Z pt-xla-profiler: CompileTime too frequent: 33 counts during 24 steps 2025-03-14T06:00:22.5853156Z pt-xla-profiler: TransferFromDeviceTime too frequent: 25 counts during 24 steps 2025-03-14T06:00:22.5853161Z 2025-03-14T06:00:22.5853458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5853611Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5853987Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5854132Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5854425Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5854622Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5854909Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5855123Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5855564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5855932Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5856371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5856713Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5857216Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5857500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5857824Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5858021Z Execution Analysis: (:1) 2025-03-14T06:00:22.5858383Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5858606Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5858610Z 2025-03-14T06:00:22.5858870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5859010Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5859309Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5859469Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5859732Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5859898Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5860108Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5860305Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5861044Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5861613Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5862021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5862381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5862726Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5863046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5863425Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5863708Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5863884Z Execution Analysis: .......... 2025-03-14T06:00:22.5864183Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5864458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5864755Z pt-xla-profiler: CompileTime too frequent: 33 counts during 25 steps 2025-03-14T06:00:22.5865046Z pt-xla-profiler: TransferFromDeviceTime too frequent: 26 counts during 25 steps 2025-03-14T06:00:22.5865051Z 2025-03-14T06:00:22.5865435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5865585Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5866247Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5866415Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5866699Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5866882Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5867114Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5867313Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5867867Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5868257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5868713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5869037Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5869404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5869740Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5870170Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5870333Z Execution Analysis: (:1) 2025-03-14T06:00:22.5870677Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5870913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5870918Z 2025-03-14T06:00:22.5871208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5871374Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5871692Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5871838Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5872120Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5872318Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5872600Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5872812Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5873485Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5874093Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5874588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5875009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5875432Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5875745Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5876134Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5876475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5876669Z Execution Analysis: .......... 2025-03-14T06:00:22.5876985Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5877265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5877526Z pt-xla-profiler: CompileTime too frequent: 33 counts during 26 steps 2025-03-14T06:00:22.5877987Z pt-xla-profiler: TransferFromDeviceTime too frequent: 27 counts during 26 steps 2025-03-14T06:00:22.5877992Z 2025-03-14T06:00:22.5878288Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5878461Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5878824Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5878966Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5879242Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5879396Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5879665Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5879864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5880382Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5880761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5881129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5881467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5881892Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5882190Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5882554Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5882718Z Execution Analysis: (:1) 2025-03-14T06:00:22.5883070Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5883320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5883325Z 2025-03-14T06:00:22.5883596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5883743Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5884055Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5884204Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5884595Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5884775Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5885173Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5885378Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5886029Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5886671Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5887129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5887592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5888002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5888312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5888738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5889060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5889253Z Execution Analysis: .......... 2025-03-14T06:00:22.5889547Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5889829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5890142Z pt-xla-profiler: CompileTime too frequent: 33 counts during 27 steps 2025-03-14T06:00:22.5890472Z pt-xla-profiler: TransferFromDeviceTime too frequent: 28 counts during 27 steps 2025-03-14T06:00:22.5890479Z 2025-03-14T06:00:22.5890767Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5890919Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5891287Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5891414Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5891739Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5891927Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5892187Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5892390Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5892806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5893224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5893711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5894050Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5894441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5894748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5895142Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5895323Z Execution Analysis: (:1) 2025-03-14T06:00:22.5895662Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5895898Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5895903Z 2025-03-14T06:00:22.5896182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5896349Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5896711Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5896859Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5897246Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5897423Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5897635Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5897865Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5898539Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5899130Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5899560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5899950Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5900436Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5900757Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5901135Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5901433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5901623Z Execution Analysis: .......... 2025-03-14T06:00:22.5901890Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5902222Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5902518Z pt-xla-profiler: CompileTime too frequent: 33 counts during 28 steps 2025-03-14T06:00:22.5902831Z pt-xla-profiler: TransferFromDeviceTime too frequent: 29 counts during 28 steps 2025-03-14T06:00:22.5902838Z 2025-03-14T06:00:22.5903113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5903240Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5903651Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5903813Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5904122Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5904467Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5904718Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5905092Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5905910Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5906970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5907934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5908773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5909562Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5910432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5911264Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5911987Z Execution Analysis: (:1) 2025-03-14T06:00:22.5912627Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5913341Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5913756Z 2025-03-14T06:00:22.5913990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5914596Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5915270Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5915927Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5916441Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5917006Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5917558Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5918090Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5919087Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5920496Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5921660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5922660Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5923630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5924434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5925410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5926234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5926856Z Execution Analysis: .......... 2025-03-14T06:00:22.5927446Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5928140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5928837Z pt-xla-profiler: CompileTime too frequent: 33 counts during 29 steps 2025-03-14T06:00:22.5929566Z pt-xla-profiler: TransferFromDeviceTime too frequent: 30 counts during 29 steps 2025-03-14T06:00:22.5930038Z 2025-03-14T06:00:22.5930258Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5930860Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5931576Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5932231Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5932772Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5933345Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5933897Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5934425Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5935187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5936186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5937188Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5938003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5938883Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5939673Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5940479Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5941113Z Execution Analysis: (:1) 2025-03-14T06:00:22.5941719Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5942440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5942794Z 2025-03-14T06:00:22.5943076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5943611Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5944169Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.5944730Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5945332Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.5945896Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.5946375Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.5946958Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5947924Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.5949292Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.5950475Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.5951393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5952290Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5953093Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5953864Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5954768Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5955362Z Execution Analysis: .......... 2025-03-14T06:00:22.5955927Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5956626Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5957268Z pt-xla-profiler: CompileTime too frequent: 33 counts during 30 steps 2025-03-14T06:00:22.5957999Z pt-xla-profiler: TransferFromDeviceTime too frequent: 31 counts during 30 steps 2025-03-14T06:00:22.5958414Z 2025-03-14T06:00:22.5958718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.5959235Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.5959879Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.5960452Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.5961005Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.5961646Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.5962147Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.5962685Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.5963432Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.5964352Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.5965669Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.5966495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.5967296Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.5968156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.5969112Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.5969774Z Execution Analysis: (:1) 2025-03-14T06:00:22.5970392Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.5971092Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6128797Z 2025-03-14T06:00:22.6129287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6129812Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6130293Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6130770Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6131194Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6131669Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6132094Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6132579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6133491Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6135022Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6136093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6136971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6138051Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6138788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6139563Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6140376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6140896Z Execution Analysis: .......... 2025-03-14T06:00:22.6141369Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6141963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6142593Z pt-xla-profiler: CompileTime too frequent: 33 counts during 31 steps 2025-03-14T06:00:22.6143226Z pt-xla-profiler: TransferFromDeviceTime too frequent: 32 counts during 31 steps 2025-03-14T06:00:22.6143626Z 2025-03-14T06:00:22.6143852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6144307Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6144819Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6145409Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6145827Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6146309Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6146724Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6147159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6147815Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6148656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6149450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6150275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6151022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6151718Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6152415Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6152950Z Execution Analysis: (:1) 2025-03-14T06:00:22.6153438Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6154022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6154349Z 2025-03-14T06:00:22.6154552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6155011Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6155473Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6155972Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6156382Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6156844Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6157278Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6157707Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6179287Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6180584Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6181635Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6182458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6183243Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6183953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6184652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6185452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6185931Z Execution Analysis: .......... 2025-03-14T06:00:22.6186373Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6187023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6187558Z pt-xla-profiler: CompileTime too frequent: 33 counts during 32 steps 2025-03-14T06:00:22.6188150Z pt-xla-profiler: TransferFromDeviceTime too frequent: 33 counts during 32 steps 2025-03-14T06:00:22.6188539Z 2025-03-14T06:00:22.6188746Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6189220Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6189710Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6190217Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6190608Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6191053Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6191435Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6191845Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6192463Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6193268Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6194028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6194766Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6195445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6196123Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6196786Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6197304Z Execution Analysis: (:1) 2025-03-14T06:00:22.6197784Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6198345Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6198662Z 2025-03-14T06:00:22.6198856Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6199281Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6199713Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6200155Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6200601Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6201090Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6201476Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6201892Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6202744Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6203989Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6205244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6206075Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6206858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6207566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6208263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6208978Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6209538Z Execution Analysis: .......... 2025-03-14T06:00:22.6210005Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6210599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6211163Z pt-xla-profiler: CompileTime too frequent: 33 counts during 33 steps 2025-03-14T06:00:22.6211791Z pt-xla-profiler: TransferFromDeviceTime too frequent: 34 counts during 33 steps 2025-03-14T06:00:22.6212240Z 2025-03-14T06:00:22.6212467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6212923Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6213436Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6213971Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6214385Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6214847Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6215260Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6215689Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6216336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6217311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6218089Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6218793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6219487Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6220173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6220946Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6221456Z Execution Analysis: (:1) 2025-03-14T06:00:22.6221916Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6222466Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6222781Z 2025-03-14T06:00:22.6222973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6223420Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6223840Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6224274Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6224662Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6225101Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6225480Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6225890Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6226712Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6227905Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6228890Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6229671Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6230405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6231067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6231754Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6232410Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6232877Z Execution Analysis: .......... 2025-03-14T06:00:22.6233305Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6233857Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6234409Z pt-xla-profiler: CompileTime too frequent: 33 counts during 34 steps 2025-03-14T06:00:22.6234997Z pt-xla-profiler: TransferFromDeviceTime too frequent: 35 counts during 34 steps 2025-03-14T06:00:22.6235364Z 2025-03-14T06:00:22.6235571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6235990Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6236474Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6236960Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6237348Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6237786Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6238167Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6238603Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6239211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6239991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6240735Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6241404Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6242068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6242736Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6243381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6243890Z Execution Analysis: (:1) 2025-03-14T06:00:22.6244354Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6245139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6245514Z 2025-03-14T06:00:22.6245720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6246167Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6246624Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6247095Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6247511Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6247981Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6248385Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6248825Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6249708Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6251005Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6252065Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6252904Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6253727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6254450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6255161Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6255869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6256377Z Execution Analysis: .......... 2025-03-14T06:00:22.6256874Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6257545Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6258061Z pt-xla-profiler: CompileTime too frequent: 33 counts during 35 steps 2025-03-14T06:00:22.6258623Z pt-xla-profiler: TransferFromDeviceTime too frequent: 36 counts during 35 steps 2025-03-14T06:00:22.6258998Z 2025-03-14T06:00:22.6259204Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6259613Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6260092Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6260588Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6260976Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6261444Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6261824Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6262222Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6262822Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6263598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6264331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6265000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6265985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6266699Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6267388Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6267937Z Execution Analysis: (:1) 2025-03-14T06:00:22.6268434Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6269095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6269421Z 2025-03-14T06:00:22.6269640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6270141Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6270596Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6271061Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6271473Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6271943Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6272354Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6272792Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6273699Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6274996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6276054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6276939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6277854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6278659Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6279326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6280052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6280523Z Execution Analysis: .......... 2025-03-14T06:00:22.6280946Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6281539Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6282064Z pt-xla-profiler: CompileTime too frequent: 33 counts during 36 steps 2025-03-14T06:00:22.6282644Z pt-xla-profiler: TransferFromDeviceTime too frequent: 37 counts during 36 steps 2025-03-14T06:00:22.6283022Z 2025-03-14T06:00:22.6283215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6283637Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6284120Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6284753Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6285331Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6285810Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6286231Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6286670Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6287329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6288181Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6288988Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6289710Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6290426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6291143Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6291847Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6292428Z Execution Analysis: (:1) 2025-03-14T06:00:22.6292935Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6293539Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6293867Z 2025-03-14T06:00:22.6294090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6294553Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6295014Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6295486Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6295911Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6296386Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6296800Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6297349Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6298206Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6299493Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6300523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6301345Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6302116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6302818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6303542Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6304227Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6304726Z Execution Analysis: .......... 2025-03-14T06:00:22.6305178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6305764Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6306314Z pt-xla-profiler: CompileTime too frequent: 33 counts during 37 steps 2025-03-14T06:00:22.6306924Z pt-xla-profiler: TransferFromDeviceTime too frequent: 38 counts during 37 steps 2025-03-14T06:00:22.6307418Z 2025-03-14T06:00:22.6307611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6308055Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6308534Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6309034Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6309422Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6309864Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6310245Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6310648Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6311254Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6312035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6312775Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6313443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6314107Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6314792Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6315438Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6315949Z Execution Analysis: (:1) 2025-03-14T06:00:22.6316417Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6316966Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6317268Z 2025-03-14T06:00:22.6317469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6317883Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6318303Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6318738Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6319122Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6319560Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6319941Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6320336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6321185Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6322378Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6323355Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6324135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6325163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6325890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6326608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6327318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6327830Z Execution Analysis: .......... 2025-03-14T06:00:22.6328295Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6328888Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6329448Z pt-xla-profiler: CompileTime too frequent: 33 counts during 38 steps 2025-03-14T06:00:22.6330099Z pt-xla-profiler: TransferFromDeviceTime too frequent: 39 counts during 38 steps 2025-03-14T06:00:22.6330511Z 2025-03-14T06:00:22.6330723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6331182Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6331699Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6332228Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6332645Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6333119Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6333526Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6333962Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6334609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6335454Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6336257Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6336983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6337795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6338458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6339109Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6339625Z Execution Analysis: (:1) 2025-03-14T06:00:22.6340097Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6340651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6340955Z 2025-03-14T06:00:22.6341161Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6341582Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6342008Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6342450Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6342841Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6343274Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6343663Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6344098Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6344921Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6346117Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6347153Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6347939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6348682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6349353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6350016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6350678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6351149Z Execution Analysis: .......... 2025-03-14T06:00:22.6351580Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6352124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6352673Z pt-xla-profiler: CompileTime too frequent: 33 counts during 39 steps 2025-03-14T06:00:22.6353253Z pt-xla-profiler: TransferFromDeviceTime too frequent: 40 counts during 39 steps 2025-03-14T06:00:22.6353634Z 2025-03-14T06:00:22.6353830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6354247Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6354723Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6355219Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6355611Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6356056Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6356434Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6356832Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6357436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6358216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6358983Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6359651Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6360308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6360971Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6361617Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6362127Z Execution Analysis: (:1) 2025-03-14T06:00:22.6362596Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6363146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6363450Z 2025-03-14T06:00:22.6363652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6364071Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6364586Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6365202Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6365759Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6366308Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6366726Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6367164Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6368061Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6369391Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6370457Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6371296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6372092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6372817Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6373535Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6374244Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6374749Z Execution Analysis: .......... 2025-03-14T06:00:22.6375270Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6375862Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6376428Z pt-xla-profiler: CompileTime too frequent: 33 counts during 40 steps 2025-03-14T06:00:22.6377163Z pt-xla-profiler: TransferFromDeviceTime too frequent: 41 counts during 40 steps 2025-03-14T06:00:22.6377671Z 2025-03-14T06:00:22.6377865Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6378283Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6378762Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6379256Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6379647Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6380085Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6380469Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6380872Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6381475Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6382294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6383031Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6383704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6384367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6385026Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6385673Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6386189Z Execution Analysis: (:1) 2025-03-14T06:00:22.6386658Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6387218Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6387522Z 2025-03-14T06:00:22.6387725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6388145Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6388578Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6389020Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6389413Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6389859Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6390245Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6390653Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6391506Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6392714Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6393703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6394486Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6395231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6396083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6396791Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6397522Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6398028Z Execution Analysis: .......... 2025-03-14T06:00:22.6398490Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6399068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6399617Z pt-xla-profiler: CompileTime too frequent: 33 counts during 41 steps 2025-03-14T06:00:22.6400233Z pt-xla-profiler: TransferFromDeviceTime too frequent: 42 counts during 41 steps 2025-03-14T06:00:22.6400629Z 2025-03-14T06:00:22.6400829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6401266Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6401552Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6401678Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6401880Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6402036Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6402202Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6402380Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6402735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6403089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6403398Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6403677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6403978Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6404257Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6404649Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6404778Z Execution Analysis: (:1) 2025-03-14T06:00:22.6405214Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6405420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6405424Z 2025-03-14T06:00:22.6405669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6405789Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6406035Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6406149Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6406369Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6406517Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6406680Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6406875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6407482Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6408059Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6408435Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6408792Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6409118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6409418Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6409742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6410017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6410138Z Execution Analysis: .......... 2025-03-14T06:00:22.6410399Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6410616Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6410846Z pt-xla-profiler: CompileTime too frequent: 33 counts during 42 steps 2025-03-14T06:00:22.6411136Z pt-xla-profiler: TransferFromDeviceTime too frequent: 43 counts during 42 steps 2025-03-14T06:00:22.6411141Z 2025-03-14T06:00:22.6411346Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6411479Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6411776Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6411901Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6412135Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6412296Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6412443Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6412628Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6412991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6413357Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6413672Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6413961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6414278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6414566Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6414864Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6415004Z Execution Analysis: (:1) 2025-03-14T06:00:22.6415269Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6415523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6415528Z 2025-03-14T06:00:22.6415731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6415860Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6416092Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6416220Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6416449Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6416608Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6416759Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6417039Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6417584Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6418132Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6418467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6418805Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6419120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6419387Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6419679Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6419942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6420042Z Execution Analysis: .......... 2025-03-14T06:00:22.6420297Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6420488Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6420707Z pt-xla-profiler: CompileTime too frequent: 33 counts during 43 steps 2025-03-14T06:00:22.6420966Z pt-xla-profiler: TransferFromDeviceTime too frequent: 45 counts during 43 steps 2025-03-14T06:00:22.6420983Z 2025-03-14T06:00:22.6421175Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6421297Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6421592Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6421712Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6421903Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6422051Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6422186Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6422343Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6422689Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6423027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6423320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6423588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6423875Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6424138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6424411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6424543Z Execution Analysis: (:1) 2025-03-14T06:00:22.6424807Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6425011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6425015Z 2025-03-14T06:00:22.6425205Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6425326Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6425566Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6425687Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6425880Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6426027Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6426166Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6426336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6426888Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6427431Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6427790Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6428136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6428431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6428699Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6428985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6429252Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6429354Z Execution Analysis: .......... 2025-03-14T06:00:22.6429605Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6429796Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6430020Z pt-xla-profiler: CompileTime too frequent: 33 counts during 44 steps 2025-03-14T06:00:22.6430279Z pt-xla-profiler: TransferFromDeviceTime too frequent: 46 counts during 44 steps 2025-03-14T06:00:22.6430308Z 2025-03-14T06:00:22.6430511Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6430622Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6430909Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6431014Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6431221Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6431359Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6431504Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6431664Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6432009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6432342Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6432648Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6432907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6433208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6433461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6433769Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6433889Z Execution Analysis: (:1) 2025-03-14T06:00:22.6434147Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6434339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6434345Z 2025-03-14T06:00:22.6434571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6434684Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6434910Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6435018Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6435225Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6435363Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6435519Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6435679Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6436245Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6436804Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6437154Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6437485Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6437791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6438049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6438356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6438623Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6438728Z Execution Analysis: .......... 2025-03-14T06:00:22.6438987Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6439183Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6439431Z pt-xla-profiler: CompileTime too frequent: 33 counts during 45 steps 2025-03-14T06:00:22.6439693Z pt-xla-profiler: TransferFromDeviceTime too frequent: 47 counts during 45 steps 2025-03-14T06:00:22.6439697Z 2025-03-14T06:00:22.6439903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6440011Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6440298Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6440407Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6440614Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6440752Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6440904Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6441071Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6441421Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6441750Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6442055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6442314Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6442634Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6442887Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6443173Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6443290Z Execution Analysis: (:1) 2025-03-14T06:00:22.6443542Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6443755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6443762Z 2025-03-14T06:00:22.6443961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6444067Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6444295Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6444401Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6444693Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6444831Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6445151Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6445322Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6445960Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6446537Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6446912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6447267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6447600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6447876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6448198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6448471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6448593Z Execution Analysis: .......... 2025-03-14T06:00:22.6448856Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6449117Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6449342Z pt-xla-profiler: CompileTime too frequent: 33 counts during 46 steps 2025-03-14T06:00:22.6449633Z pt-xla-profiler: TransferFromDeviceTime too frequent: 48 counts during 46 steps 2025-03-14T06:00:22.6449638Z 2025-03-14T06:00:22.6449847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6449978Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6450273Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6450399Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6450609Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6450767Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6450914Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6451101Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6451460Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6451826Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6452165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6452454Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6452767Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6453051Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6453349Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6453953Z Execution Analysis: (:1) 2025-03-14T06:00:22.6454225Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6454449Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6454454Z 2025-03-14T06:00:22.6454660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6454796Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6455032Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6455163Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6455371Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6455536Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6455715Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6455905Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6456502Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6457200Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6457551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6457878Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6458185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6458441Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6458742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6458995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6459134Z Execution Analysis: .......... 2025-03-14T06:00:22.6459376Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6459578Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6459789Z pt-xla-profiler: CompileTime too frequent: 33 counts during 47 steps 2025-03-14T06:00:22.6460057Z pt-xla-profiler: TransferFromDeviceTime too frequent: 49 counts during 47 steps 2025-03-14T06:00:22.6460061Z 2025-03-14T06:00:22.6460252Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6460373Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6460646Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6460766Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6460956Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6461110Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6461244Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6461414Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6461748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6462109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6462399Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6462667Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6462956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6463243Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6463521Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6463649Z Execution Analysis: (:1) 2025-03-14T06:00:22.6463891Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6464091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6464096Z 2025-03-14T06:00:22.6464285Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6464404Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6464620Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6464737Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6464955Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6465103Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6465244Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6465822Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6466420Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6467009Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6467371Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6467737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6468056Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6468346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6468717Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6469000Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6469109Z Execution Analysis: .......... 2025-03-14T06:00:22.6469382Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6469587Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6469824Z pt-xla-profiler: CompileTime too frequent: 33 counts during 48 steps 2025-03-14T06:00:22.6470105Z pt-xla-profiler: TransferFromDeviceTime too frequent: 50 counts during 48 steps 2025-03-14T06:00:22.6470110Z 2025-03-14T06:00:22.6470330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6470450Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6470760Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6470880Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6471104Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6471249Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6471407Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6471615Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6471993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6472346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6472677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6472992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6473314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6473587Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6473896Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6474027Z Execution Analysis: (:1) 2025-03-14T06:00:22.6474304Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6474510Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6474526Z 2025-03-14T06:00:22.6474731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6474897Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6475131Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6475260Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6475467Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6475613Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6475772Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6475942Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6476546Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6477136Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6477497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6477975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6478386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6478676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6478960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6479225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6479327Z Execution Analysis: .......... 2025-03-14T06:00:22.6479578Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6479770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6479988Z pt-xla-profiler: CompileTime too frequent: 33 counts during 49 steps 2025-03-14T06:00:22.6480246Z pt-xla-profiler: TransferFromDeviceTime too frequent: 51 counts during 49 steps 2025-03-14T06:00:22.6480252Z 2025-03-14T06:00:22.6480453Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6480564Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6480847Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6480955Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6481160Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6481319Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6481465Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6481626Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6481968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6482298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6482621Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6482883Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6483186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6483440Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6483729Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6483851Z Execution Analysis: (:1) 2025-03-14T06:00:22.6484108Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6484298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6484335Z 2025-03-14T06:00:22.6484599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6484708Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6485104Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6485217Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6485431Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6485576Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6485736Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6485912Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6486516Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6487090Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6487459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6487840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6488165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6488442Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6488759Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6489030Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6489149Z Execution Analysis: .......... 2025-03-14T06:00:22.6489410Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6489628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6489856Z pt-xla-profiler: CompileTime too frequent: 33 counts during 50 steps 2025-03-14T06:00:22.6490149Z pt-xla-profiler: TransferFromDeviceTime too frequent: 52 counts during 50 steps 2025-03-14T06:00:22.6490154Z 2025-03-14T06:00:22.6490359Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6490486Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6490807Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6490934Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6491140Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6491295Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6491442Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6491626Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6492018Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6492385Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6492701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6492990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6493307Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6493589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6493897Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6494020Z Execution Analysis: (:1) 2025-03-14T06:00:22.6494293Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6494523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6494530Z 2025-03-14T06:00:22.6494741Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6494855Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6495101Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6495213Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6495431Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6495576Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6495739Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6495907Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6496513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6497090Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6497586Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6497930Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6498246Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6498517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6498829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6499092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6499212Z Execution Analysis: .......... 2025-03-14T06:00:22.6499466Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6499676Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6499898Z pt-xla-profiler: CompileTime too frequent: 33 counts during 51 steps 2025-03-14T06:00:22.6500179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 53 counts during 51 steps 2025-03-14T06:00:22.6500183Z 2025-03-14T06:00:22.6500404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6500528Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6500814Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6500938Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6501137Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6501293Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6501433Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6501693Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6502050Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6502407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6502711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6502989Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6503291Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6503569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6503857Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6504015Z Execution Analysis: (:1) 2025-03-14T06:00:22.6504272Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6504488Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6504493Z 2025-03-14T06:00:22.6504690Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6504815Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6505044Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6505167Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6505365Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6505519Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6505663Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6505840Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6506416Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6507010Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6507455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6507792Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6508083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6508348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6508632Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6508896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6508994Z Execution Analysis: .......... 2025-03-14T06:00:22.6509248Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6509437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6509659Z pt-xla-profiler: CompileTime too frequent: 33 counts during 52 steps 2025-03-14T06:00:22.6509942Z pt-xla-profiler: TransferFromDeviceTime too frequent: 54 counts during 52 steps 2025-03-14T06:00:22.6509955Z 2025-03-14T06:00:22.6510147Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6510266Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6510533Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6510652Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6510861Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6511006Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6511141Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6511302Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6511644Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6511985Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6512276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6512544Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6512830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6513113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6513389Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6513522Z Execution Analysis: (:1) 2025-03-14T06:00:22.6513763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6513964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6513968Z 2025-03-14T06:00:22.6514160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6514282Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6514496Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6514617Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6514810Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6514960Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6515101Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6515293Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6515841Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6516386Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6516722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6517062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6517354Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6517625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6517915Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6518182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6518284Z Execution Analysis: .......... 2025-03-14T06:00:22.6518541Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6518754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6518979Z pt-xla-profiler: CompileTime too frequent: 33 counts during 53 steps 2025-03-14T06:00:22.6519239Z pt-xla-profiler: TransferFromDeviceTime too frequent: 55 counts during 53 steps 2025-03-14T06:00:22.6519244Z 2025-03-14T06:00:22.6519449Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6519562Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6519878Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6519987Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6520195Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6520330Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6520480Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6520642Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6520991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6521321Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6521630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6521911Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6522214Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6522471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6522765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6522884Z Execution Analysis: (:1) 2025-03-14T06:00:22.6523142Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6523336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6523341Z 2025-03-14T06:00:22.6523547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6523658Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6523890Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6523998Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6524208Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6524367Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6524585Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6524747Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6525513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6526089Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6526468Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6526825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6527161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6527443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6527768Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6528053Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6528166Z Execution Analysis: .......... 2025-03-14T06:00:22.6528469Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6528675Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6528915Z pt-xla-profiler: CompileTime too frequent: 33 counts during 54 steps 2025-03-14T06:00:22.6529192Z pt-xla-profiler: TransferFromDeviceTime too frequent: 56 counts during 54 steps 2025-03-14T06:00:22.6529198Z 2025-03-14T06:00:22.6529446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6529569Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6529877Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6529991Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6530208Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6530354Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6530514Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6530684Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6531055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6531410Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6531762Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6532038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6532366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6532637Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6532948Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6533078Z Execution Analysis: (:1) 2025-03-14T06:00:22.6533349Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6533557Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6533562Z 2025-03-14T06:00:22.6533777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6533894Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6534141Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6534279Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6534500Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6534649Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6534813Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6534986Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6535598Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6536173Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6536551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6536906Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6537335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6537592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6537890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6538176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6538290Z Execution Analysis: .......... 2025-03-14T06:00:22.6538531Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6538735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6538946Z pt-xla-profiler: CompileTime too frequent: 33 counts during 55 steps 2025-03-14T06:00:22.6539239Z pt-xla-profiler: TransferFromDeviceTime too frequent: 57 counts during 55 steps 2025-03-14T06:00:22.6539245Z 2025-03-14T06:00:22.6539437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6539558Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6539830Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6539950Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6540142Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6540291Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6540426Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6540598Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6540955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6541298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6541591Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6541860Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6542146Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6542410Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6542682Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6542813Z Execution Analysis: (:1) 2025-03-14T06:00:22.6543056Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6543259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6543265Z 2025-03-14T06:00:22.6543456Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6543602Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6543816Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6543933Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6544124Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6544274Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6544413Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6544586Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6545138Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6545685Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6546033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6546359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6546662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6546938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6547239Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6547494Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6547607Z Execution Analysis: .......... 2025-03-14T06:00:22.6547850Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6548072Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6548283Z pt-xla-profiler: CompileTime too frequent: 33 counts during 56 steps 2025-03-14T06:00:22.6548551Z pt-xla-profiler: TransferFromDeviceTime too frequent: 58 counts during 56 steps 2025-03-14T06:00:22.6548555Z 2025-03-14T06:00:22.6548744Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6548867Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6549140Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6549257Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6549448Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6549595Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6549755Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6549927Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6550260Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6550600Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6550889Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6551160Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6551446Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6551707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6551980Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6552112Z Execution Analysis: (:1) 2025-03-14T06:00:22.6552354Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6552579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6552584Z 2025-03-14T06:00:22.6552772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6552893Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6553109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6553229Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6553422Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6553569Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6553709Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6553881Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6554437Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6554987Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6555324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6555699Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6555993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6556262Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6556551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6556819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6556945Z Execution Analysis: .......... 2025-03-14T06:00:22.6557200Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6557391Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6557614Z pt-xla-profiler: CompileTime too frequent: 33 counts during 57 steps 2025-03-14T06:00:22.6557872Z pt-xla-profiler: TransferFromDeviceTime too frequent: 59 counts during 57 steps 2025-03-14T06:00:22.6557879Z 2025-03-14T06:00:22.6558082Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6558191Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6558474Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6558579Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6558809Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6558946Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6559095Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6559253Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6559652Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6559978Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6560287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6560544Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6560847Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6561101Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6561391Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6561512Z Execution Analysis: (:1) 2025-03-14T06:00:22.6561795Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6561988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6562006Z 2025-03-14T06:00:22.6562199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6562323Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6562541Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6562664Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6562858Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6562998Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6563153Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6563314Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6563877Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6564422Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6564874Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6565549Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6565915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6566210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6566584Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6566875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6566986Z Execution Analysis: .......... 2025-03-14T06:00:22.6567262Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6567471Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6567714Z pt-xla-profiler: CompileTime too frequent: 33 counts during 58 steps 2025-03-14T06:00:22.6567992Z pt-xla-profiler: TransferFromDeviceTime too frequent: 60 counts during 58 steps 2025-03-14T06:00:22.6567997Z 2025-03-14T06:00:22.6568217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6568373Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6568685Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6568806Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6569031Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6569180Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6569344Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6569516Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6569892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6570244Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6570575Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6570856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6571179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6571451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6571795Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6571921Z Execution Analysis: (:1) 2025-03-14T06:00:22.6572194Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6572400Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6572405Z 2025-03-14T06:00:22.6572621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6572737Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6572978Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6573093Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6573313Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6573457Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6573618Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6573788Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6574390Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6575003Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6575380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6575734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6576062Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6576364Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6576691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6576965Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6577089Z Execution Analysis: .......... 2025-03-14T06:00:22.6577354Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6583376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6583687Z pt-xla-profiler: CompileTime too frequent: 33 counts during 59 steps 2025-03-14T06:00:22.6583980Z pt-xla-profiler: TransferFromDeviceTime too frequent: 61 counts during 59 steps 2025-03-14T06:00:22.6584075Z 2025-03-14T06:00:22.6584293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6584421Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6584723Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6584847Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6585056Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6585211Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6585355Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6585535Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6585900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6586266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6586582Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6586976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6587312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6587585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6587871Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6588004Z Execution Analysis: (:1) 2025-03-14T06:00:22.6588263Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6588470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6588476Z 2025-03-14T06:00:22.6588673Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6588799Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6589029Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6589154Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6589355Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6589513Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6589653Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6589831Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6590440Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6591010Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6591360Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6591766Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6592182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6592448Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6592730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6592995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6593095Z Execution Analysis: .......... 2025-03-14T06:00:22.6593347Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6593537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6593783Z pt-xla-profiler: CompileTime too frequent: 33 counts during 60 steps 2025-03-14T06:00:22.6594041Z pt-xla-profiler: TransferFromDeviceTime too frequent: 62 counts during 60 steps 2025-03-14T06:00:22.6594055Z 2025-03-14T06:00:22.6594244Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6594358Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6594625Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6594736Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6594928Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6595067Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6595199Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6595355Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6595856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6596211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6596513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6596816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6597116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6597392Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6597679Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6597809Z Execution Analysis: (:1) 2025-03-14T06:00:22.6598059Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6598261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6598268Z 2025-03-14T06:00:22.6598461Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6598585Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6598811Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6598928Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6599125Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6599277Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6599443Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6599622Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6600197Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6600763Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6601137Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6601494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6601799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6602080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6602379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6602657Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6602758Z Execution Analysis: .......... 2025-03-14T06:00:22.6603020Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6603242Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6603475Z pt-xla-profiler: CompileTime too frequent: 33 counts during 61 steps 2025-03-14T06:00:22.6603745Z pt-xla-profiler: TransferFromDeviceTime too frequent: 63 counts during 61 steps 2025-03-14T06:00:22.6603750Z 2025-03-14T06:00:22.6603959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6604069Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6604363Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6604558Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6604783Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6605088Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6605244Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6605413Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6605780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6606165Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6606493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6606769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6607093Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6607363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6607667Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6607793Z Execution Analysis: (:1) 2025-03-14T06:00:22.6608065Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6608268Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6608275Z 2025-03-14T06:00:22.6608490Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6608605Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6608849Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6608959Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6609197Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6609343Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6609505Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6609672Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6610275Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6610879Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6611256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6611609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6611936Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6612212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6612532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6612809Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6612944Z Execution Analysis: .......... 2025-03-14T06:00:22.6613212Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6613418Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6613649Z pt-xla-profiler: CompileTime too frequent: 33 counts during 62 steps 2025-03-14T06:00:22.6613928Z pt-xla-profiler: TransferFromDeviceTime too frequent: 64 counts during 62 steps 2025-03-14T06:00:22.6613933Z 2025-03-14T06:00:22.6614149Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6614264Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6614564Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6614676Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6614891Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6615039Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6615193Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6615387Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6615754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6616109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6616432Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6616708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6617027Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6617395Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6617678Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6617797Z Execution Analysis: (:1) 2025-03-14T06:00:22.6618048Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6618236Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6618241Z 2025-03-14T06:00:22.6618435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6618567Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6618796Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6618900Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6619099Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6619235Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6619386Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6619543Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6620127Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6620657Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6621001Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6621328Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6621628Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6621882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6622212Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6622465Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6622577Z Execution Analysis: .......... 2025-03-14T06:00:22.6622815Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6623014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6623224Z pt-xla-profiler: CompileTime too frequent: 33 counts during 63 steps 2025-03-14T06:00:22.6623491Z pt-xla-profiler: TransferFromDeviceTime too frequent: 66 counts during 63 steps 2025-03-14T06:00:22.6623496Z 2025-03-14T06:00:22.6623683Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6623803Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6624071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6624190Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6624380Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6624552Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6624685Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6624854Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6625182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6625524Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6625812Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6626078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6626361Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6626624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6626895Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6627023Z Execution Analysis: (:1) 2025-03-14T06:00:22.6627264Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6627463Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6627503Z 2025-03-14T06:00:22.6627691Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6627809Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6628021Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6628138Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6628328Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6628500Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6628635Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6628806Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6629349Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6629891Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6630233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6630559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6630853Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6631135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6631604Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6631869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6631983Z Execution Analysis: .......... 2025-03-14T06:00:22.6632237Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6632448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6632667Z pt-xla-profiler: CompileTime too frequent: 33 counts during 64 steps 2025-03-14T06:00:22.6632948Z pt-xla-profiler: TransferFromDeviceTime too frequent: 67 counts during 64 steps 2025-03-14T06:00:22.6632952Z 2025-03-14T06:00:22.6633153Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6633279Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6633564Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6633704Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6633901Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6634054Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6634192Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6634368Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6634716Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6635066Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6635371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6635654Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6635956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6636228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6636512Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6636645Z Execution Analysis: (:1) 2025-03-14T06:00:22.6636919Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6637125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6637130Z 2025-03-14T06:00:22.6637324Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6637449Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6637674Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6637814Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6638016Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6638166Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6638308Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6638480Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6639055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6639621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6639969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6640345Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6640652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6640935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6641232Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6641510Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6641614Z Execution Analysis: .......... 2025-03-14T06:00:22.6641879Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6642075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6642305Z pt-xla-profiler: CompileTime too frequent: 33 counts during 65 steps 2025-03-14T06:00:22.6642574Z pt-xla-profiler: TransferFromDeviceTime too frequent: 68 counts during 65 steps 2025-03-14T06:00:22.6642579Z 2025-03-14T06:00:22.6642790Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6642927Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6643225Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6643331Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6643543Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6643687Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6643837Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6644003Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6644363Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6644803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6645294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6645568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6645896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6646164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6646496Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6646621Z Execution Analysis: (:1) 2025-03-14T06:00:22.6646890Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6647090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6647109Z 2025-03-14T06:00:22.6647336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6647460Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6647696Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6647820Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6648026Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6648168Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6648325Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6648492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6649096Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6649678Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6650139Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6650498Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6650812Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6651096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6651409Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6651692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6651801Z Execution Analysis: .......... 2025-03-14T06:00:22.6652070Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6652279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6652572Z pt-xla-profiler: TransferFromDeviceTime too frequent: 69 counts during 66 steps 2025-03-14T06:00:22.6652603Z 2025-03-14T06:00:22.6652809Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6652934Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6653227Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6653350Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6653556Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6653712Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6653855Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6654035Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6654396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6654760Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6655075Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6655359Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6655669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6655973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6656266Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6656403Z Execution Analysis: (:1) 2025-03-14T06:00:22.6656662Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6656876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6656882Z 2025-03-14T06:00:22.6657215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6657334Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6657546Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6657661Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6657849Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6657993Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6658130Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6658299Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6658843Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6659408Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6659738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6660078Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6660366Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6660632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6660917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6661178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6661277Z Execution Analysis: .......... 2025-03-14T06:00:22.6661529Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6661719Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6662024Z pt-xla-profiler: TransferFromDeviceTime too frequent: 70 counts during 67 steps 2025-03-14T06:00:22.6662028Z 2025-03-14T06:00:22.6662213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6662332Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6662596Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6662712Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6662901Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6663046Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6663178Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6663344Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6663677Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6664014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6664300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6664565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6664848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6665134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6665537Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6665833Z Execution Analysis: (:1) 2025-03-14T06:00:22.6666100Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6666366Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6666372Z 2025-03-14T06:00:22.6666587Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6666704Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6666943Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6667057Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6667275Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6667421Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6667574Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6667749Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6668338Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6668966Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6669336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6669686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6670009Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6670286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6670601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6670869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6670987Z Execution Analysis: .......... 2025-03-14T06:00:22.6671246Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6671453Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6671778Z pt-xla-profiler: TransferFromDeviceTime too frequent: 71 counts during 68 steps 2025-03-14T06:00:22.6671783Z 2025-03-14T06:00:22.6671991Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6672106Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6672404Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6672513Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6672724Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6672869Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6673020Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6673192Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6673559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6673910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6674230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6674504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6674855Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6675127Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6675427Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6675553Z Execution Analysis: (:1) 2025-03-14T06:00:22.6675823Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6676052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6676059Z 2025-03-14T06:00:22.6676269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6676384Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6676625Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6676739Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6676948Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6677088Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6677240Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6677409Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6678138Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6678695Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6679051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6679390Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6679702Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6679967Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6680270Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6680532Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6680641Z Execution Analysis: .......... 2025-03-14T06:00:22.6680892Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6681120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6681389Z pt-xla-profiler: TransferFromDeviceTime too frequent: 72 counts during 69 steps 2025-03-14T06:00:22.6681395Z 2025-03-14T06:00:22.6681595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6681708Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6681994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6682102Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6682303Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6682447Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6682591Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6682758Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6683109Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6683453Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6683760Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6684052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6684358Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6684704Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6685165Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6685293Z Execution Analysis: (:1) 2025-03-14T06:00:22.6685591Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6685798Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6685810Z 2025-03-14T06:00:22.6686010Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6686134Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6686362Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6686481Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6686682Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6686825Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6686977Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6687176Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6687775Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6688355Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6688712Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6689075Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6689386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6689668Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6689974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6690253Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6690362Z Execution Analysis: .......... 2025-03-14T06:00:22.6690653Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6690854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6691145Z pt-xla-profiler: TransferFromDeviceTime too frequent: 73 counts during 70 steps 2025-03-14T06:00:22.6691150Z 2025-03-14T06:00:22.6691355Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6691480Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6691771Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6691891Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6692099Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6692250Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6692394Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6692571Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6692927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6693286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6693622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6693905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6694213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6694487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6694782Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6694938Z Execution Analysis: (:1) 2025-03-14T06:00:22.6695193Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6695402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6695406Z 2025-03-14T06:00:22.6695607Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6695730Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6695960Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6696075Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6696275Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6696426Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6696616Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6696792Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6697489Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6698054Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6698407Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6698757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6699061Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6699336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6699640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6699913Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6700043Z Execution Analysis: .......... 2025-03-14T06:00:22.6700302Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6700497Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6700777Z pt-xla-profiler: TransferFromDeviceTime too frequent: 74 counts during 71 steps 2025-03-14T06:00:22.6700783Z 2025-03-14T06:00:22.6700979Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6701094Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6701377Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6701491Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6701692Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6701836Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6701975Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6702144Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6702493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6703111Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6703417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6703690Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6703987Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6704254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6704571Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6704694Z Execution Analysis: (:1) 2025-03-14T06:00:22.6704958Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6705153Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6705158Z 2025-03-14T06:00:22.6705361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6705471Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6705701Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6705809Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6706015Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6706179Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6706331Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6706495Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6707186Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6707712Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6708056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6708380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6708677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6708932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6709224Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6709495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6709600Z Execution Analysis: .......... 2025-03-14T06:00:22.6709838Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6710034Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6710292Z pt-xla-profiler: TransferFromDeviceTime too frequent: 75 counts during 72 steps 2025-03-14T06:00:22.6710297Z 2025-03-14T06:00:22.6710492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6710600Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6710878Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6710979Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6711177Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6711314Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6711455Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6711612Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6711951Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6712306Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6712602Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6712854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6713149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6713421Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6713703Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6713819Z Execution Analysis: (:1) 2025-03-14T06:00:22.6714069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6714258Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6714265Z 2025-03-14T06:00:22.6714460Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6714570Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6714794Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6714900Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6715119Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6715253Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6715401Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6715557Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6716111Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6716642Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6716984Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6717313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6717611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6717867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6718182Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6718431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6718539Z Execution Analysis: .......... 2025-03-14T06:00:22.6718776Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6718972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6719228Z pt-xla-profiler: TransferFromDeviceTime too frequent: 76 counts during 73 steps 2025-03-14T06:00:22.6719239Z 2025-03-14T06:00:22.6719422Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6719535Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6719804Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6719916Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6720105Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6720247Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6720376Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6720530Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6720887Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6721218Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6721506Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6721766Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6722072Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6722328Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6722601Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6722719Z Execution Analysis: (:1) 2025-03-14T06:00:22.6722956Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6723153Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6723157Z 2025-03-14T06:00:22.6723342Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6723456Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6723666Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6723798Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6723988Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6724130Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6724264Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6724427Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6725237Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6725818Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6726176Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6726532Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6726845Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6727129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6727466Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6727746Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6727853Z Execution Analysis: .......... 2025-03-14T06:00:22.6728120Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6728323Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6728608Z pt-xla-profiler: TransferFromDeviceTime too frequent: 77 counts during 74 steps 2025-03-14T06:00:22.6728614Z 2025-03-14T06:00:22.6728818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6728943Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6729233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6729352Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6729556Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6729705Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6729847Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6730046Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6730404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6730762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6731074Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6731358Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6731705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6731983Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6732275Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6732407Z Execution Analysis: (:1) 2025-03-14T06:00:22.6732668Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6732879Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6732883Z 2025-03-14T06:00:22.6733084Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6733231Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6733464Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6733587Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6733794Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6733950Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6734099Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6734278Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6734870Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6735452Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6735809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6736167Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6736481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6736790Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6737211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6737460Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6737567Z Execution Analysis: .......... 2025-03-14T06:00:22.6737806Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6738000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6738257Z pt-xla-profiler: TransferFromDeviceTime too frequent: 78 counts during 75 steps 2025-03-14T06:00:22.6738263Z 2025-03-14T06:00:22.6738458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6738563Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6738839Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6738939Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6739135Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6739266Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6739424Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6739579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6739912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6740235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6740530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6740805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6741095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6741342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6741618Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6741734Z Execution Analysis: (:1) 2025-03-14T06:00:22.6741978Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6742164Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6742168Z 2025-03-14T06:00:22.6742362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6742491Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6742713Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6742816Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6743013Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6743146Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6743290Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6743444Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6743998Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6744527Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6744869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6745194Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6745518Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6745773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6746066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6746316Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6746422Z Execution Analysis: .......... 2025-03-14T06:00:22.6746663Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6746856Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6747114Z pt-xla-profiler: TransferFromDeviceTime too frequent: 79 counts during 76 steps 2025-03-14T06:00:22.6747119Z 2025-03-14T06:00:22.6747315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6747423Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6747696Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6747799Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6747997Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6748155Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6748295Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6748451Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6748787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6749113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6749433Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6749688Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6749977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6750228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6750504Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6750620Z Execution Analysis: (:1) 2025-03-14T06:00:22.6750865Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6751050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6751082Z 2025-03-14T06:00:22.6751277Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6751383Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6751611Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6751713Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6751912Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6752044Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6752194Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6752349Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6752904Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6753433Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6753780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6754138Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6754429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6754697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6754987Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6755248Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6755350Z Execution Analysis: .......... 2025-03-14T06:00:22.6755602Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6755792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6756064Z pt-xla-profiler: TransferFromDeviceTime too frequent: 80 counts during 77 steps 2025-03-14T06:00:22.6756070Z 2025-03-14T06:00:22.6756261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6756378Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6756648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6756763Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6756981Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6757126Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6757260Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6757427Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6757760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6758121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6758414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6758677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6758962Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6759224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6759496Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6759623Z Execution Analysis: (:1) 2025-03-14T06:00:22.6759864Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6760060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6760090Z 2025-03-14T06:00:22.6760278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6760397Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6760611Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6760727Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6760915Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6761057Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6761195Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6761357Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6761902Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6762447Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6762779Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6763136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6763425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6763688Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6763971Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6764229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6764328Z Execution Analysis: .......... 2025-03-14T06:00:22.6764657Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6764850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6765453Z pt-xla-profiler: TransferFromDeviceTime too frequent: 81 counts during 78 steps 2025-03-14T06:00:22.6765461Z 2025-03-14T06:00:22.6765666Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6765793Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6766084Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6766281Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6766487Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6766640Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6766783Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6766959Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6767356Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6767718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6768032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6768315Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6768622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6768903Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6769192Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6769325Z Execution Analysis: (:1) 2025-03-14T06:00:22.6769581Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6769830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6769835Z 2025-03-14T06:00:22.6770047Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6770157Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6770401Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6770509Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6770715Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6770871Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6771019Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6771199Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6771790Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6772378Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6772789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6773139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6773467Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6773741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6774062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6774331Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6774453Z Execution Analysis: .......... 2025-03-14T06:00:22.6774709Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6774922Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6775201Z pt-xla-profiler: TransferFromDeviceTime too frequent: 82 counts during 79 steps 2025-03-14T06:00:22.6775206Z 2025-03-14T06:00:22.6775419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6775533Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6775860Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6775970Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6776190Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6776333Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6776488Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6776658Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6777056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6777614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6777914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6778167Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6778464Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6778712Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6778995Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6779109Z Execution Analysis: (:1) 2025-03-14T06:00:22.6779384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6779573Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6779579Z 2025-03-14T06:00:22.6779772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6779875Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6780098Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6780203Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6780398Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6780533Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6780677Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6780833Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6781388Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6781915Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6782279Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6782606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6782904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6783156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6783448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6783698Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6783807Z Execution Analysis: .......... 2025-03-14T06:00:22.6784045Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6784242Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6784501Z pt-xla-profiler: TransferFromDeviceTime too frequent: 83 counts during 80 steps 2025-03-14T06:00:22.6784505Z 2025-03-14T06:00:22.6784698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6784832Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6785109Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6785214Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6785411Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6785546Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6785685Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6785863Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6786206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6786531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6786828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6787084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6787378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6787627Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6787911Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6788064Z Execution Analysis: (:1) 2025-03-14T06:00:22.6788305Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6788504Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6788509Z 2025-03-14T06:00:22.6788691Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6788809Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6789021Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6789137Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6789325Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6789469Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6789604Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6789773Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6790321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6790886Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6791217Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6791553Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6791840Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6792105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6792389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6792650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6792751Z Execution Analysis: .......... 2025-03-14T06:00:22.6793002Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6793188Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6793459Z pt-xla-profiler: TransferFromDeviceTime too frequent: 84 counts during 81 steps 2025-03-14T06:00:22.6793463Z 2025-03-14T06:00:22.6793672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6793791Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6794055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6794173Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6794364Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6794511Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6794753Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6794926Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6795258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6795595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6796064Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6796345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6796644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6796919Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6797229Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6797365Z Execution Analysis: (:1) 2025-03-14T06:00:22.6797619Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6797829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6797833Z 2025-03-14T06:00:22.6798029Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6798155Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6798380Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6798499Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6798699Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6798849Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6798996Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6799174Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6799748Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6800358Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6800709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6801063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6801368Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6801646Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6801947Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6802218Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6802323Z Execution Analysis: .......... 2025-03-14T06:00:22.6802585Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6802783Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6803089Z pt-xla-profiler: TransferFromDeviceTime too frequent: 85 counts during 82 steps 2025-03-14T06:00:22.6803094Z 2025-03-14T06:00:22.6803303Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6803413Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6803704Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6803812Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6804044Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6804181Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6804320Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6804572Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6805087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6805447Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6805773Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6806046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6806366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6806665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6806969Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6807093Z Execution Analysis: (:1) 2025-03-14T06:00:22.6807361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6807561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6807565Z 2025-03-14T06:00:22.6807781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6807894Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6808134Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6808243Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6808459Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6808601Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6808762Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6808933Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6809556Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6810127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6810500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6810851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6811175Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6811451Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6811771Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6812040Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6812156Z Execution Analysis: .......... 2025-03-14T06:00:22.6812412Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6812643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6812922Z pt-xla-profiler: TransferFromDeviceTime too frequent: 87 counts during 83 steps 2025-03-14T06:00:22.6812927Z 2025-03-14T06:00:22.6813139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6813251Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6813554Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6813663Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6813901Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6814047Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6814200Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6814368Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6814739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6815090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6815409Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6815683Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6816001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6816300Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6816604Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6816729Z Execution Analysis: (:1) 2025-03-14T06:00:22.6816997Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6817302Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6817308Z 2025-03-14T06:00:22.6817505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6817611Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6817834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6817939Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6818138Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6818273Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6818444Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6818599Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6819148Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6819678Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6820020Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6820344Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6820638Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6820898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6821192Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6821455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6821552Z Execution Analysis: .......... 2025-03-14T06:00:22.6821803Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6822011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6822281Z pt-xla-profiler: TransferFromDeviceTime too frequent: 88 counts during 84 steps 2025-03-14T06:00:22.6822286Z 2025-03-14T06:00:22.6822471Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6822594Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6822883Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6823004Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6823192Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6823336Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6823465Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6823636Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6823965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6824301Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6824587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6824855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6825166Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6825426Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6825698Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6825827Z Execution Analysis: (:1) 2025-03-14T06:00:22.6826064Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6826266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6826270Z 2025-03-14T06:00:22.6826451Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6826570Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6826779Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6826894Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6827082Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6827252Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6827387Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6827556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6828098Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6828639Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6828970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6829306Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6829600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6829863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6830149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6830408Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6830505Z Execution Analysis: .......... 2025-03-14T06:00:22.6830776Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6830962Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6831232Z pt-xla-profiler: TransferFromDeviceTime too frequent: 89 counts during 85 steps 2025-03-14T06:00:22.6831236Z 2025-03-14T06:00:22.6831422Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6831565Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6831834Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6831955Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6832143Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6832283Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6832416Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6832579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6832909Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6833241Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6833529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6833835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6834120Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6834376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6834647Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6834772Z Execution Analysis: (:1) 2025-03-14T06:00:22.6835014Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6835216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6835221Z 2025-03-14T06:00:22.6835410Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6835534Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6835751Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6835870Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6836086Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6836235Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6836374Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6836544Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6837092Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6837637Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6837986Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6838314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6838619Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6838876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6839175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6839424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6839567Z Execution Analysis: .......... 2025-03-14T06:00:22.6839807Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6840006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6840268Z pt-xla-profiler: TransferFromDeviceTime too frequent: 90 counts during 86 steps 2025-03-14T06:00:22.6840274Z 2025-03-14T06:00:22.6840500Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6840605Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6840896Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6841002Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6841207Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6841344Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6841493Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6841652Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6841997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6842325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6842657Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6842915Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6843218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6843472Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6843758Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6843881Z Execution Analysis: (:1) 2025-03-14T06:00:22.6844135Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6844325Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6844329Z 2025-03-14T06:00:22.6844609Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6844726Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6845123Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6845267Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6845485Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6845649Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6845807Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6845977Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6846581Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6847155Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6847529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6847883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6848203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6848478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6848796Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6849091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6849209Z Execution Analysis: .......... 2025-03-14T06:00:22.6849468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6849676Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6849959Z pt-xla-profiler: TransferFromDeviceTime too frequent: 91 counts during 87 steps 2025-03-14T06:00:22.6849963Z 2025-03-14T06:00:22.6850199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6850318Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6850620Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6850732Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6850951Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6851100Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6851256Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6851428Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6851796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6852178Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6852505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6852781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6853096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6853368Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6853670Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6853797Z Execution Analysis: (:1) 2025-03-14T06:00:22.6854064Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6854271Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6854288Z 2025-03-14T06:00:22.6854490Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6854620Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6854880Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6855006Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6855211Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6855357Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6855516Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6855688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6856291Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6856879Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6857347Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6857690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6857979Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6858245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6858555Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6858819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6858918Z Execution Analysis: .......... 2025-03-14T06:00:22.6859166Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6859356Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6859649Z pt-xla-profiler: TransferFromDeviceTime too frequent: 92 counts during 88 steps 2025-03-14T06:00:22.6859656Z 2025-03-14T06:00:22.6859843Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6859962Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6860229Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6860344Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6860533Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6860678Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6860812Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6860980Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6861312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6861675Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6861966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6862228Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6862514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6862774Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6863046Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6863173Z Execution Analysis: (:1) 2025-03-14T06:00:22.6863412Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6863609Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6863615Z 2025-03-14T06:00:22.6863802Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6863942Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6864159Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6864268Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6864458Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6864602Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6864743Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6864911Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6866314Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6866913Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6867276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6867642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6867957Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6868313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6868625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6868906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6869015Z Execution Analysis: .......... 2025-03-14T06:00:22.6869286Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6869549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6869842Z pt-xla-profiler: TransferFromDeviceTime too frequent: 93 counts during 89 steps 2025-03-14T06:00:22.6869848Z 2025-03-14T06:00:22.6870054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6870177Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6870472Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6870596Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6870802Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6870957Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6871102Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6871283Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6871682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6872043Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6872360Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6872647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6872956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6873239Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6873542Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6873667Z Execution Analysis: (:1) 2025-03-14T06:00:22.6873938Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6874146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6874151Z 2025-03-14T06:00:22.6874409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6874525Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6874769Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6874880Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6875098Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6875240Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6875400Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6875567Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6876169Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6876747Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6877122Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6877476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6877908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6878310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6878608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6878857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6878969Z Execution Analysis: .......... 2025-03-14T06:00:22.6879233Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6879432Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6879697Z pt-xla-profiler: TransferFromDeviceTime too frequent: 94 counts during 90 steps 2025-03-14T06:00:22.6879703Z 2025-03-14T06:00:22.6879907Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6880016Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6880297Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6880402Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6880609Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6880746Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6880893Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6881077Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6881423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6881755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6882057Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6882316Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6882617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6882870Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6883154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6883276Z Execution Analysis: (:1) 2025-03-14T06:00:22.6883532Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6883725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6883752Z 2025-03-14T06:00:22.6883956Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6884067Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6884295Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6884405Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6884680Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6884818Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6885139Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6885311Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6885914Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6886490Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6886865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6887220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6887574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6887853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6888175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6888446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6888568Z Execution Analysis: .......... 2025-03-14T06:00:22.6888853Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6889069Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6889353Z pt-xla-profiler: TransferFromDeviceTime too frequent: 95 counts during 91 steps 2025-03-14T06:00:22.6889369Z 2025-03-14T06:00:22.6889575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6889703Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6889991Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6890111Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6890313Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6890495Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6890637Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6890809Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6891175Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6891540Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6891850Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6892138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6892445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6892733Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6893028Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6893168Z Execution Analysis: (:1) 2025-03-14T06:00:22.6893428Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6893671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6893676Z 2025-03-14T06:00:22.6893876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6894004Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6894236Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6894360Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6894566Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6894728Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6894875Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6895059Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6895651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6896239Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6896600Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6896991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6897414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6897694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6897995Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6898268Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6898399Z Execution Analysis: .......... 2025-03-14T06:00:22.6898662Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6898861Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6899145Z pt-xla-profiler: TransferFromDeviceTime too frequent: 96 counts during 92 steps 2025-03-14T06:00:22.6899152Z 2025-03-14T06:00:22.6899351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6899474Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6899759Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6899877Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6900103Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6900256Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6900400Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6900578Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6900931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6901287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6901595Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6901873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6902175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6902451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6902740Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6902877Z Execution Analysis: (:1) 2025-03-14T06:00:22.6903154Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6903363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6903368Z 2025-03-14T06:00:22.6903565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6903689Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6903916Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6904037Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6904237Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6904386Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6904534Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6904708Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6905282Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6905854Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6906238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6906592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6906898Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6907276Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6907572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6907844Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6907957Z Execution Analysis: .......... 2025-03-14T06:00:22.6908193Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6908392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6908653Z pt-xla-profiler: TransferFromDeviceTime too frequent: 97 counts during 93 steps 2025-03-14T06:00:22.6908657Z 2025-03-14T06:00:22.6908856Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6908962Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6909242Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6909368Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6909567Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6909705Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6909855Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6910012Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6910356Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6910682Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6910983Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6911236Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6911533Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6911783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6912067Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6912206Z Execution Analysis: (:1) 2025-03-14T06:00:22.6912459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6912644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6912648Z 2025-03-14T06:00:22.6912850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6912957Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6913187Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6913289Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6913491Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6913626Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6913780Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6913939Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6914497Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6915027Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6915398Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6915727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6916033Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6916289Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6916612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6916869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6916982Z Execution Analysis: .......... 2025-03-14T06:00:22.6917223Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6917421Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6917680Z pt-xla-profiler: TransferFromDeviceTime too frequent: 98 counts during 94 steps 2025-03-14T06:00:22.6917685Z 2025-03-14T06:00:22.6917882Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6917991Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6918292Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6918398Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6918596Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6918734Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6918875Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6919033Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6919375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6919702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6920002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6920258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6920553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6920810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6921151Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6921267Z Execution Analysis: (:1) 2025-03-14T06:00:22.6921514Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6921701Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6921707Z 2025-03-14T06:00:22.6921907Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6922014Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6922241Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6922345Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6922548Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6922687Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6922837Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6922997Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6923554Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6924109Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6924454Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6924880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6925358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6925679Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6925988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6926271Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6926376Z Execution Analysis: .......... 2025-03-14T06:00:22.6926650Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6926854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6927148Z pt-xla-profiler: TransferFromDeviceTime too frequent: 99 counts during 95 steps 2025-03-14T06:00:22.6927156Z 2025-03-14T06:00:22.6927359Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6927511Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6927803Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6927925Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6928130Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6928285Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6928425Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6928608Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6928969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6929331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6929642Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6929928Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6930238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6930517Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6930836Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6930972Z Execution Analysis: (:1) 2025-03-14T06:00:22.6931229Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6931443Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6931447Z 2025-03-14T06:00:22.6931646Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6931773Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6932002Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6932126Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6932334Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6932489Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6932635Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6932814Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6933403Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6934009Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6934369Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6934732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6935071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6935356Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6935663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6935942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6936048Z Execution Analysis: .......... 2025-03-14T06:00:22.6936319Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6936520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6936814Z pt-xla-profiler: TransferFromDeviceTime too frequent: 100 counts during 96 steps 2025-03-14T06:00:22.6936819Z 2025-03-14T06:00:22.6937023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6937277Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6937544Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6937662Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6937853Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6938005Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6938139Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6938312Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6938647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6938985Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6939278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6939548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6939838Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6940149Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6940422Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6940553Z Execution Analysis: (:1) 2025-03-14T06:00:22.6940796Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6940998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6941002Z 2025-03-14T06:00:22.6941202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6941311Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6941542Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6941651Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6941860Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6941999Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6942140Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6942319Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6942976Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6943515Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6943865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6944197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6944529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6944791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6945094Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6945348Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6945467Z Execution Analysis: .......... 2025-03-14T06:00:22.6945710Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6945912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6946177Z pt-xla-profiler: TransferFromDeviceTime too frequent: 101 counts during 97 steps 2025-03-14T06:00:22.6946205Z 2025-03-14T06:00:22.6946409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6946518Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6946800Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6946905Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6947109Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6947245Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6947394Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6947556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6947902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6948229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6948536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6948794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6949115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6949366Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6949651Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6949771Z Execution Analysis: (:1) 2025-03-14T06:00:22.6950022Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6950212Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6950216Z 2025-03-14T06:00:22.6950415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6950527Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6950758Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6950865Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6951068Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6951203Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6951352Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6951511Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6952095Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6952629Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6952978Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6953328Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6953633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6953888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6954186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6954439Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6954552Z Execution Analysis: .......... 2025-03-14T06:00:22.6954793Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6954995Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6955285Z pt-xla-profiler: TransferFromDeviceTime too frequent: 102 counts during 98 steps 2025-03-14T06:00:22.6955289Z 2025-03-14T06:00:22.6955491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6955601Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6955885Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6955990Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6956194Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6956331Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6956478Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6956638Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6956986Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6957317Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6957626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6957910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6958212Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6958478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6958756Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6958890Z Execution Analysis: (:1) 2025-03-14T06:00:22.6959132Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6959339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6959344Z 2025-03-14T06:00:22.6959533Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6959655Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6959920Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6972206Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6972558Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6972712Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6972860Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6973162Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6973768Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6974353Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6974769Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6975136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6975450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6975734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6976044Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6976323Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6976430Z Execution Analysis: .......... 2025-03-14T06:00:22.6976705Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6976954Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6977358Z pt-xla-profiler: TransferFromDeviceTime too frequent: 103 counts during 99 steps 2025-03-14T06:00:22.6977367Z 2025-03-14T06:00:22.6977563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6977786Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6978054Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6978166Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6978358Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6978501Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6978632Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6978800Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6979134Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6979471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6979799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6980060Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6980345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6980605Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6980876Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6981001Z Execution Analysis: (:1) 2025-03-14T06:00:22.6981243Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6981442Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6981448Z 2025-03-14T06:00:22.6981637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6981755Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6981970Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6982079Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6982269Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6982407Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6982563Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6982726Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6983272Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6983834Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6984167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6984500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6984787Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6985050Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6985335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6985594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6985693Z Execution Analysis: .......... 2025-03-14T06:00:22.6985938Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6986150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6986422Z pt-xla-profiler: TransferFromDeviceTime too frequent: 104 counts during 100 steps 2025-03-14T06:00:22.6986428Z 2025-03-14T06:00:22.6986621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6986726Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6987000Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6987102Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6987302Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6987433Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6987573Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6987726Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6988067Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6988389Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6988709Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6988963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6989258Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6989505Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6989781Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6989895Z Execution Analysis: (:1) 2025-03-14T06:00:22.6990141Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6990330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6990336Z 2025-03-14T06:00:22.6990528Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6990630Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6990850Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.6990949Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6991166Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.6991297Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.6991438Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.6991592Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6992339Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.6992925Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.6993284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.6993628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6993938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6994207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6994516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6994778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6994916Z Execution Analysis: .......... 2025-03-14T06:00:22.6995169Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6995373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6995651Z pt-xla-profiler: TransferFromDeviceTime too frequent: 105 counts during 101 steps 2025-03-14T06:00:22.6995656Z 2025-03-14T06:00:22.6995860Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6995974Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.6996269Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.6996377Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.6996583Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.6996722Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.6996866Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.6997032Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.6997388Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.6997771Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.6998083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.6998347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.6998656Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.6998921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.6999212Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.6999338Z Execution Analysis: (:1) 2025-03-14T06:00:22.6999600Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.6999801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.6999807Z 2025-03-14T06:00:22.7000013Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7000125Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7000358Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7000487Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7000692Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7000833Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7000985Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7001148Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7001762Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7002320Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7002681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7003035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7003501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7003790Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7004098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7004375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7004732Z Execution Analysis: .......... 2025-03-14T06:00:22.7005004Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7005205Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7005506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 106 counts during 102 steps 2025-03-14T06:00:22.7005512Z 2025-03-14T06:00:22.7005718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7005841Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7006129Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7006247Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7006448Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7006601Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7006740Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7006916Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7007302Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7007659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7007969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7008253Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7008557Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7008839Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7009128Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7009263Z Execution Analysis: (:1) 2025-03-14T06:00:22.7009522Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7009736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7009742Z 2025-03-14T06:00:22.7009943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7010064Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7010319Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7010437Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7010642Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7010795Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7010941Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7011120Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7011737Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7012317Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7012674Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7013034Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7013345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7013626Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7013930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7014234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7014339Z Execution Analysis: .......... 2025-03-14T06:00:22.7014606Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7014806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7015098Z pt-xla-profiler: TransferFromDeviceTime too frequent: 108 counts during 103 steps 2025-03-14T06:00:22.7015104Z 2025-03-14T06:00:22.7015307Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7015431Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7015719Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7015837Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7016046Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7016199Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7016344Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7016547Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7016909Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7017381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7017692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7017964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7018265Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7018536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7018824Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7018958Z Execution Analysis: (:1) 2025-03-14T06:00:22.7019213Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7019421Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7019426Z 2025-03-14T06:00:22.7019632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7019770Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7020000Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7020116Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7020320Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7020466Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7020612Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7020809Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7021387Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7021958Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7022321Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7022664Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7022979Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7023246Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7023578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7023842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7023954Z Execution Analysis: .......... 2025-03-14T06:00:22.7024204Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7024407Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7024682Z pt-xla-profiler: TransferFromDeviceTime too frequent: 109 counts during 104 steps 2025-03-14T06:00:22.7024687Z 2025-03-14T06:00:22.7024890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7025000Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7025287Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7025393Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7025607Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7025747Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7025920Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7026083Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7026548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7026874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7027167Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7027419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7027712Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7027963Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7028239Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7028354Z Execution Analysis: (:1) 2025-03-14T06:00:22.7028596Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7028780Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7028784Z 2025-03-14T06:00:22.7028998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7029105Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7029324Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7029422Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7029618Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7029751Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7029917Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7030075Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7030628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7031157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7031501Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7031825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7032124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7032412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7032706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7032960Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7033064Z Execution Analysis: .......... 2025-03-14T06:00:22.7033302Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7033498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7033761Z pt-xla-profiler: TransferFromDeviceTime too frequent: 110 counts during 105 steps 2025-03-14T06:00:22.7033766Z 2025-03-14T06:00:22.7033957Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7034062Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7034339Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7034445Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7034640Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7034800Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7034939Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7035096Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7035430Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7035759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7036057Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7036313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7036610Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7036865Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7037144Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7037261Z Execution Analysis: (:1) 2025-03-14T06:00:22.7037508Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7037732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7037737Z 2025-03-14T06:00:22.7037922Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7038039Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7038249Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7038363Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7038551Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7038718Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7038853Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7039016Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7039560Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7040094Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7040428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7040761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7041073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7041336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7041623Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7041878Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7041977Z Execution Analysis: .......... 2025-03-14T06:00:22.7042221Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7042411Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7042679Z pt-xla-profiler: TransferFromDeviceTime too frequent: 111 counts during 106 steps 2025-03-14T06:00:22.7042683Z 2025-03-14T06:00:22.7042869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7042986Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7043257Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7043390Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7043579Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7043720Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7043857Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7044017Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7044348Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7044772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7045239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7045522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7045835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7046114Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7046406Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7046539Z Execution Analysis: (:1) 2025-03-14T06:00:22.7046797Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7047038Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7047043Z 2025-03-14T06:00:22.7047247Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7047368Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7047596Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7047718Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7048023Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7048181Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7048327Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7048509Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7049098Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7049680Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7050041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7050398Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7050738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7051024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7051332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7051611Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7051717Z Execution Analysis: .......... 2025-03-14T06:00:22.7051984Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7052187Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7052483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 112 counts during 107 steps 2025-03-14T06:00:22.7052488Z 2025-03-14T06:00:22.7052708Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7052824Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7053123Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7053256Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7053466Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7053610Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7053755Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7053931Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7054292Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7054648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7054970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7055246Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7055564Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7055834Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7056134Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7056258Z Execution Analysis: (:1) 2025-03-14T06:00:22.7056553Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7056759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7056764Z 2025-03-14T06:00:22.7056983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7057210Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7057458Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7057561Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7057762Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7057896Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7058047Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7058203Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7058761Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7059290Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7059634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7062445Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7062751Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7063014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7063313Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7063568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7063679Z Execution Analysis: .......... 2025-03-14T06:00:22.7063923Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7064125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7064397Z pt-xla-profiler: TransferFromDeviceTime too frequent: 113 counts during 108 steps 2025-03-14T06:00:22.7064441Z 2025-03-14T06:00:22.7064632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7064793Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7065064Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7065178Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7065512Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7065832Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7065979Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7066160Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7066519Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7066880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7067197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7067488Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7067799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7068081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7068374Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7068575Z Execution Analysis: (:1) 2025-03-14T06:00:22.7068836Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7069052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7069057Z 2025-03-14T06:00:22.7069260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7069388Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7069659Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7069787Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7069993Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7070149Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7070298Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7070478Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7071074Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7071660Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7072038Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7072474Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7072802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7073080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7073404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7073674Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7073795Z Execution Analysis: .......... 2025-03-14T06:00:22.7074058Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7074275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7074563Z pt-xla-profiler: TransferFromDeviceTime too frequent: 114 counts during 109 steps 2025-03-14T06:00:22.7074572Z 2025-03-14T06:00:22.7074790Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7074950Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7075255Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7075366Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7075580Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7075726Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7075883Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7076055Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7076419Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7076772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7077103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7077382Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7077804Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7078067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7078387Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7078512Z Execution Analysis: (:1) 2025-03-14T06:00:22.7078776Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7078974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7078978Z 2025-03-14T06:00:22.7079211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7079324Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7079562Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7079674Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7079881Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7080022Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7080176Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7080347Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7080933Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7081492Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7081895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7082238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7082551Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7082820Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7083130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7083394Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7083506Z Execution Analysis: .......... 2025-03-14T06:00:22.7083758Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7083968Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7084253Z pt-xla-profiler: TransferFromDeviceTime too frequent: 115 counts during 110 steps 2025-03-14T06:00:22.7084284Z 2025-03-14T06:00:22.7084560Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7084678Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7085143Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7085258Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7085479Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7085627Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7085783Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7085954Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7086323Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7086680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7087010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7087289Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7087613Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7087914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7088224Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7088350Z Execution Analysis: (:1) 2025-03-14T06:00:22.7088621Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7088827Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7088845Z 2025-03-14T06:00:22.7089072Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7089203Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7089435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7089559Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7089764Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7089923Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7090071Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7090254Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7090846Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7091434Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7091836Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7092200Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7092516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7092805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7093115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7093395Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7093501Z Execution Analysis: .......... 2025-03-14T06:00:22.7093770Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7093978Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7094305Z pt-xla-profiler: TransferFromDeviceTime too frequent: 116 counts during 111 steps 2025-03-14T06:00:22.7094310Z 2025-03-14T06:00:22.7094514Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7094641Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7094933Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7095056Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7095261Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7095417Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7095562Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7095744Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7096107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7096468Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7096784Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7097072Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7097404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7097793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7098079Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7098215Z Execution Analysis: (:1) 2025-03-14T06:00:22.7098467Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7098700Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7098707Z 2025-03-14T06:00:22.7098904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7099025Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7099250Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7099369Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7099570Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7099721Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7099863Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7100038Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7100613Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7101214Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7101567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7101919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7102225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7102504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7102805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7103081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7103189Z Execution Analysis: .......... 2025-03-14T06:00:22.7103460Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7103658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7103998Z pt-xla-profiler: TransferFromDeviceTime too frequent: 117 counts during 112 steps 2025-03-14T06:00:22.7104003Z 2025-03-14T06:00:22.7104214Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7104330Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7104628Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7104736Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7104936Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7105088Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7105229Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7105408Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7105760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7106115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7106431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7106700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7107036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7107300Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7107600Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7107722Z Execution Analysis: (:1) 2025-03-14T06:00:22.7108014Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7108213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7108219Z 2025-03-14T06:00:22.7108428Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7108542Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7108780Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7108891Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7109100Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7109241Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7109396Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7109563Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7110154Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7110738Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7111096Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7111443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7111761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7112031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7112346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7112612Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7112728Z Execution Analysis: .......... 2025-03-14T06:00:22.7112983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7113215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7113494Z pt-xla-profiler: TransferFromDeviceTime too frequent: 118 counts during 113 steps 2025-03-14T06:00:22.7113499Z 2025-03-14T06:00:22.7113712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7113825Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7114122Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7114230Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7114442Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7114584Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7114738Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7114905Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7115266Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7115608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7115922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7116216Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7116529Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7116794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7117200Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7117319Z Execution Analysis: (:1) 2025-03-14T06:00:22.7117593Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7117787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7117791Z 2025-03-14T06:00:22.7117985Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7118093Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7118322Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7118424Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7118624Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7118756Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7118905Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7119061Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7119647Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7120178Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7120523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7120850Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7121148Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7121402Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7121695Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7121950Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7122062Z Execution Analysis: .......... 2025-03-14T06:00:22.7122331Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7122530Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7122807Z pt-xla-profiler: TransferFromDeviceTime too frequent: 119 counts during 114 steps 2025-03-14T06:00:22.7122812Z 2025-03-14T06:00:22.7123001Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7123120Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7123388Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7123505Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7123694Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7123846Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7123977Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7124147Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7124554Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7124899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7125407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7125694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7126003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7126282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7126605Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7126742Z Execution Analysis: (:1) 2025-03-14T06:00:22.7127006Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7127223Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7127228Z 2025-03-14T06:00:22.7127430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7127558Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7127792Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7127912Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7128117Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7128274Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7128424Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7128636Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7129229Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7129817Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7130181Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7130543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7130857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7131148Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7131463Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7131750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7131885Z Execution Analysis: .......... 2025-03-14T06:00:22.7132162Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7132364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7132663Z pt-xla-profiler: TransferFromDeviceTime too frequent: 120 counts during 115 steps 2025-03-14T06:00:22.7132668Z 2025-03-14T06:00:22.7132871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7132997Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7133285Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7133407Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7133615Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7133771Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7133914Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7134095Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7134455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7134844Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7135160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7135448Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7135758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7136039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7136359Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7136502Z Execution Analysis: (:1) 2025-03-14T06:00:22.7136763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7136980Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7136984Z 2025-03-14T06:00:22.7137189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7137318Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7137550Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7137673Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7137879Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7138074Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7138226Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7138409Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7138999Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7139582Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7139957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7140307Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7140634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7140912Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7141236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7141536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7141655Z Execution Analysis: .......... 2025-03-14T06:00:22.7141914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7142134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7142420Z pt-xla-profiler: TransferFromDeviceTime too frequent: 121 counts during 116 steps 2025-03-14T06:00:22.7142425Z 2025-03-14T06:00:22.7142641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7142755Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7143058Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7143174Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7143393Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7143540Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7143694Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7143864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7144232Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7144613Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7144941Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7145215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7145542Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7145843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7146151Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7146282Z Execution Analysis: (:1) 2025-03-14T06:00:22.7146557Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7146764Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7146768Z 2025-03-14T06:00:22.7146983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7147101Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7147347Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7147460Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7147710Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7147859Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7148022Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7148194Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7148798Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7149487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7149856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7150310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7150603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7150873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7151185Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7151452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7151555Z Execution Analysis: .......... 2025-03-14T06:00:22.7151812Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7152004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7152283Z pt-xla-profiler: TransferFromDeviceTime too frequent: 122 counts during 117 steps 2025-03-14T06:00:22.7152287Z 2025-03-14T06:00:22.7152482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7152605Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7152880Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7153001Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7153193Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7153345Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7153482Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7153657Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7154014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7154355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7154650Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7154917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7155232Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7155502Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7155774Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7155901Z Execution Analysis: (:1) 2025-03-14T06:00:22.7156144Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7156349Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7156353Z 2025-03-14T06:00:22.7156540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7156664Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7156877Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7157018Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7157210Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7157356Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7157493Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7157662Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7158209Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7158748Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7159081Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7159417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7159709Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7160001Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7160286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7160549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7160650Z Execution Analysis: .......... 2025-03-14T06:00:22.7160907Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7161096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7161372Z pt-xla-profiler: TransferFromDeviceTime too frequent: 123 counts during 118 steps 2025-03-14T06:00:22.7161376Z 2025-03-14T06:00:22.7161564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7161686Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7161962Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7162079Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7162271Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7162421Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7162554Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7162747Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7163083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7163421Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7163712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7164004Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7164294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7164644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7165087Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7165230Z Execution Analysis: (:1) 2025-03-14T06:00:22.7165641Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7165860Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7165864Z 2025-03-14T06:00:22.7166081Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7166200Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7166539Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7166655Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7166866Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7167027Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7167177Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7167363Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7167961Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7168552Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7168932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7169289Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7169613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7169932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7170254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7170531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7170651Z Execution Analysis: .......... 2025-03-14T06:00:22.7170911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7171126Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7171414Z pt-xla-profiler: TransferFromDeviceTime too frequent: 124 counts during 119 steps 2025-03-14T06:00:22.7171421Z 2025-03-14T06:00:22.7171637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7171756Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7172061Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7172174Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7172392Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7172537Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7172728Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7172900Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7173273Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7173626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7174002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7174281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7174604Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7174876Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7175179Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7175308Z Execution Analysis: (:1) 2025-03-14T06:00:22.7175579Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7175783Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7175788Z 2025-03-14T06:00:22.7176002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7176152Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7176400Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7176515Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7176734Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7176878Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7177039Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7177318Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7178009Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7178537Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7178884Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7179214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7179544Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7179799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7180096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7180346Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7180459Z Execution Analysis: .......... 2025-03-14T06:00:22.7180702Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7180907Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7181178Z pt-xla-profiler: TransferFromDeviceTime too frequent: 125 counts during 120 steps 2025-03-14T06:00:22.7181183Z 2025-03-14T06:00:22.7181386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7181494Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7181775Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7181878Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7182105Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7182243Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7182389Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7182545Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7182891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7183220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7183549Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7183806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7184106Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7184355Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7184647Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7184765Z Execution Analysis: (:1) 2025-03-14T06:00:22.7185017Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7185218Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7185251Z 2025-03-14T06:00:22.7185441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7185560Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7185778Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7185894Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7186086Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7186233Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7186375Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7186549Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7187096Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7187645Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7187983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7188350Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7188643Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7188911Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7189199Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7189464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7189566Z Execution Analysis: .......... 2025-03-14T06:00:22.7189819Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7190010Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7190294Z pt-xla-profiler: TransferFromDeviceTime too frequent: 126 counts during 121 steps 2025-03-14T06:00:22.7190300Z 2025-03-14T06:00:22.7190492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7190613Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7190884Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7191027Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7191221Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7191371Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7191507Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7191683Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7192017Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7192630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7192926Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7193195Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7193482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7193750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7194024Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7194156Z Execution Analysis: (:1) 2025-03-14T06:00:22.7194398Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7194602Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7194636Z 2025-03-14T06:00:22.7194827Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7194950Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7195166Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7195283Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7195477Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7195629Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7195936Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7196116Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7196692Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7197268Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7197730Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7198096Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7198406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7198694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7198999Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7199273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7199380Z Execution Analysis: .......... 2025-03-14T06:00:22.7199646Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7199847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7200143Z pt-xla-profiler: TransferFromDeviceTime too frequent: 127 counts during 122 steps 2025-03-14T06:00:22.7200149Z 2025-03-14T06:00:22.7200360Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7200473Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7200789Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7200900Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7201112Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7201254Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7201393Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7201572Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7201950Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7202308Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7202628Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7202898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7203210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7203475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7203773Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7203896Z Execution Analysis: (:1) 2025-03-14T06:00:22.7204161Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7204391Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7204397Z 2025-03-14T06:00:22.7204698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7204813Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7205225Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7205338Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7205557Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7205703Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7205864Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7206034Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7206638Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7207221Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7207627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7207980Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7208311Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7208589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7208908Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7209180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7209299Z Execution Analysis: .......... 2025-03-14T06:00:22.7209561Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7209780Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7210068Z pt-xla-profiler: TransferFromDeviceTime too frequent: 129 counts during 123 steps 2025-03-14T06:00:22.7210074Z 2025-03-14T06:00:22.7210290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7210450Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7210757Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7210871Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7211090Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7211237Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7211399Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7211597Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7211970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7212327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7212655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7212934Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7213259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7213531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7213842Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7213968Z Execution Analysis: (:1) 2025-03-14T06:00:22.7214274Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7214480Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7214484Z 2025-03-14T06:00:22.7214698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7214813Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7215057Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7215170Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7215390Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7215535Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7215696Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7215864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7216470Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7217071Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7217529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7217860Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7218163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7218421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7218718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7218981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7219084Z Execution Analysis: .......... 2025-03-14T06:00:22.7219338Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7219528Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7219803Z pt-xla-profiler: TransferFromDeviceTime too frequent: 130 counts during 124 steps 2025-03-14T06:00:22.7219808Z 2025-03-14T06:00:22.7220022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7220139Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7220412Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7220526Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7220717Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7220863Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7221024Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7221195Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7221531Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7221868Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7222158Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7222424Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7222711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7222972Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7223244Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7223420Z Execution Analysis: (:1) 2025-03-14T06:00:22.7223666Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7223869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7223873Z 2025-03-14T06:00:22.7224062Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7224180Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7224398Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7224514Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7224705Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7224855Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7224993Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7225167Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7225720Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7226297Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7226630Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7226972Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7227266Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7227534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7227985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7228266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7228373Z Execution Analysis: .......... 2025-03-14T06:00:22.7228637Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7228836Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7229130Z pt-xla-profiler: TransferFromDeviceTime too frequent: 131 counts during 125 steps 2025-03-14T06:00:22.7229159Z 2025-03-14T06:00:22.7229359Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7229484Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7229768Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7229890Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7230093Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7230274Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7230419Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7230597Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7230946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7231301Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7231604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7231888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7232193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7232473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7232793Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7232929Z Execution Analysis: (:1) 2025-03-14T06:00:22.7233187Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7233400Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7233405Z 2025-03-14T06:00:22.7233606Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7233736Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7233964Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7234093Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7234294Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7234453Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7234600Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7234783Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7235388Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7235963Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7236334Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7236681Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7237005Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7237278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7237603Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7237872Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7238000Z Execution Analysis: .......... 2025-03-14T06:00:22.7238258Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7238473Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7238782Z pt-xla-profiler: TransferFromDeviceTime too frequent: 132 counts during 126 steps 2025-03-14T06:00:22.7238787Z 2025-03-14T06:00:22.7238999Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7239118Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7239418Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7239534Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7239880Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7240023Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7240173Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7240333Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7240682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7241014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7241321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7241579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7241881Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7242163Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7242446Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7242564Z Execution Analysis: (:1) 2025-03-14T06:00:22.7242814Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7243002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7243006Z 2025-03-14T06:00:22.7243209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7243317Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7243547Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7243652Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7243858Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7243993Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7244143Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7244341Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7245158Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7245736Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7246109Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7246462Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7246789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7247071Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7247392Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7247665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7247787Z Execution Analysis: .......... 2025-03-14T06:00:22.7248048Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7248295Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7248585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 133 counts during 127 steps 2025-03-14T06:00:22.7248591Z 2025-03-14T06:00:22.7248809Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7248927Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7249229Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7249370Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7249592Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7249740Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7249898Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7250070Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7250442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7250796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7251125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7251403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7251725Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7252027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7252338Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7252465Z Execution Analysis: (:1) 2025-03-14T06:00:22.7252739Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7252947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7252964Z 2025-03-14T06:00:22.7253170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7253299Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7253531Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7253659Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7253870Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7254028Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7254205Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7254375Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7254981Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7255568Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7255932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7256297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7256614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7256905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7257320Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7257584Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7257685Z Execution Analysis: .......... 2025-03-14T06:00:22.7257961Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7258151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7258428Z pt-xla-profiler: TransferFromDeviceTime too frequent: 134 counts during 128 steps 2025-03-14T06:00:22.7258433Z 2025-03-14T06:00:22.7258621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7258743Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7259036Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7259154Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7259345Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7259495Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7259628Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7259796Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7260130Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7260469Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7260761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7261026Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7261340Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7261601Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7261873Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7262002Z Execution Analysis: (:1) 2025-03-14T06:00:22.7262246Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7262448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7262452Z 2025-03-14T06:00:22.7262641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7262761Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7262975Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7263094Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7263283Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7263455Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7263594Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7263762Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7264308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7264853Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7265188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7265827Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7266147Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7266442Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7266753Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7267035Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7267144Z Execution Analysis: .......... 2025-03-14T06:00:22.7267479Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7267686Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7267990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 135 counts during 129 steps 2025-03-14T06:00:22.7267996Z 2025-03-14T06:00:22.7268200Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7268370Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7268668Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7268797Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7269006Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7269169Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7269317Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7269507Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7269871Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7270238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7270554Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7270882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7271207Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7271477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7271783Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7271912Z Execution Analysis: (:1) 2025-03-14T06:00:22.7272187Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7272394Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7272398Z 2025-03-14T06:00:22.7272614Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7272731Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7272980Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7273132Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7273351Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7273497Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7273660Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7273832Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7274441Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7275017Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7275391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7275750Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7276081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7276361Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7276684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7276980Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7277103Z Execution Analysis: .......... 2025-03-14T06:00:22.7277365Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7277692Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7277977Z pt-xla-profiler: TransferFromDeviceTime too frequent: 136 counts during 130 steps 2025-03-14T06:00:22.7277984Z 2025-03-14T06:00:22.7278327Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7278442Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7278728Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7278835Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7279042Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7279183Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7279335Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7279495Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7279841Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7280170Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7280517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7280780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7281084Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7281338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7281625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7281746Z Execution Analysis: (:1) 2025-03-14T06:00:22.7282002Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7282193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7282197Z 2025-03-14T06:00:22.7282403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7282519Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7282776Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7282883Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7283091Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7283230Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7283385Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7283548Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7284114Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7284710Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7285243Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7285596Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7285927Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7286202Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7286552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7286823Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7286944Z Execution Analysis: .......... 2025-03-14T06:00:22.7287205Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7287419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7287737Z pt-xla-profiler: TransferFromDeviceTime too frequent: 137 counts during 131 steps 2025-03-14T06:00:22.7287759Z 2025-03-14T06:00:22.7287968Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7288098Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7288391Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7288515Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7288725Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7288884Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7289031Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7289217Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7289576Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7289945Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7290289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7290583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7290894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7291181Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7291477Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7291626Z Execution Analysis: (:1) 2025-03-14T06:00:22.7291889Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7292107Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7292114Z 2025-03-14T06:00:22.7292320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7292474Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7292708Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7292834Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7293042Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7293198Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7293349Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7293532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7294128Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7294714Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7295079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7295444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7295760Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7296048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7296383Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7296666Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7296774Z Execution Analysis: .......... 2025-03-14T06:00:22.7297047Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7297386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7297684Z pt-xla-profiler: TransferFromDeviceTime too frequent: 138 counts during 132 steps 2025-03-14T06:00:22.7297691Z 2025-03-14T06:00:22.7297892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7298019Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7298305Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7298429Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7298632Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7298787Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7298931Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7299110Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7299461Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7299845Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7300153Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7300436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7300736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7301015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7301302Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7301443Z Execution Analysis: (:1) 2025-03-14T06:00:22.7301695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7301909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7301915Z 2025-03-14T06:00:22.7302113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7302267Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7302494Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7302616Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7302817Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7302972Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7303116Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7303291Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7303869Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7304444Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7304797Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7305152Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7305467Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7305759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7306073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7306340Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7306456Z Execution Analysis: .......... 2025-03-14T06:00:22.7306709Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7306945Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7307327Z pt-xla-profiler: TransferFromDeviceTime too frequent: 139 counts during 133 steps 2025-03-14T06:00:22.7307332Z 2025-03-14T06:00:22.7307532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7307640Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7307921Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7308026Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7308228Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7308364Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7308507Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7308667Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7309039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7309370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7309672Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7309927Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7310227Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7310478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7310763Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7310881Z Execution Analysis: (:1) 2025-03-14T06:00:22.7311134Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7311329Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7311359Z 2025-03-14T06:00:22.7311561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7311673Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7311900Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7312005Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7312209Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7312345Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7312499Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7312660Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7313217Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7313756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7314107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7314434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7314764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7315021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7315320Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7315573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7315687Z Execution Analysis: .......... 2025-03-14T06:00:22.7315966Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7316169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7316438Z pt-xla-profiler: TransferFromDeviceTime too frequent: 140 counts during 134 steps 2025-03-14T06:00:22.7316443Z 2025-03-14T06:00:22.7316818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7316935Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7317233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7317345Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7317557Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7317702Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7317855Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7318053Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7318593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7318984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7319452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7319769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7320088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7320376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7320676Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7320818Z Execution Analysis: (:1) 2025-03-14T06:00:22.7321089Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7321360Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7321365Z 2025-03-14T06:00:22.7321597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7321721Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7321974Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7322089Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7322311Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7322482Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7322631Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7322819Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7323432Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7324013Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7324387Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7324865Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7325200Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7325477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7325802Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7326076Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7326234Z Execution Analysis: .......... 2025-03-14T06:00:22.7326500Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7326718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7327006Z pt-xla-profiler: TransferFromDeviceTime too frequent: 141 counts during 135 steps 2025-03-14T06:00:22.7327012Z 2025-03-14T06:00:22.7327232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7327351Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7327652Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7327766Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7327982Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7328153Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7328314Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7328492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7328863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7329216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7329540Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7329817Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7330136Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7330407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7330713Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7330848Z Execution Analysis: (:1) 2025-03-14T06:00:22.7331118Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7331349Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7331354Z 2025-03-14T06:00:22.7331566Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7331682Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7331927Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7332040Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7332260Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7332407Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7332570Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7332743Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7333351Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7333929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7334300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7334679Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7335009Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7335287Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7335611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7335912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7336036Z Execution Analysis: .......... 2025-03-14T06:00:22.7336296Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7336512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7336805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 142 counts during 136 steps 2025-03-14T06:00:22.7336824Z 2025-03-14T06:00:22.7337138Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7337254Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7337723Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7337836Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7338087Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7338238Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7338396Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7338566Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7338939Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7339294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7339626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7339903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7340227Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7340509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7340807Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7340973Z Execution Analysis: (:1) 2025-03-14T06:00:22.7341233Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7341447Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7341451Z 2025-03-14T06:00:22.7341657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7341785Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7342018Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7342141Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7342348Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7342505Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7342654Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7342838Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7343430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7344019Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7344406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7344770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7345085Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7345373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7345708Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7345994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7346108Z Execution Analysis: .......... 2025-03-14T06:00:22.7346377Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7346582Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7346884Z pt-xla-profiler: TransferFromDeviceTime too frequent: 143 counts during 137 steps 2025-03-14T06:00:22.7346889Z 2025-03-14T06:00:22.7347096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7347222Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7347625Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7347849Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7348055Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7348212Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7348353Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7348532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7348883Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7349354Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7349644Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7349912Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7350201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7350631Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7350918Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7351079Z Execution Analysis: (:1) 2025-03-14T06:00:22.7351333Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7351544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7351550Z 2025-03-14T06:00:22.7351746Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7351872Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7352268Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7352393Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7352598Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7352759Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7352907Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7353093Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7353689Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7354312Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7354676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7355044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7355359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7355675Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7355991Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7356281Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7356391Z Execution Analysis: .......... 2025-03-14T06:00:22.7356665Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7356873Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7357176Z pt-xla-profiler: TransferFromDeviceTime too frequent: 144 counts during 138 steps 2025-03-14T06:00:22.7357181Z 2025-03-14T06:00:22.7357401Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7357520Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7357853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7357967Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7358185Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7358334Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7363961Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7364190Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7364682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7365049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7365517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7365806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7366119Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7366400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7366803Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7366932Z Execution Analysis: (:1) 2025-03-14T06:00:22.7367204Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7367417Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7367425Z 2025-03-14T06:00:22.7367628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7367748Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7367978Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7368097Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7368304Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7368451Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7368600Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7368773Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7369371Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7369996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7370359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7370716Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7371071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7371355Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7371664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7371936Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7372039Z Execution Analysis: .......... 2025-03-14T06:00:22.7372304Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7372505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7372800Z pt-xla-profiler: TransferFromDeviceTime too frequent: 145 counts during 139 steps 2025-03-14T06:00:22.7372806Z 2025-03-14T06:00:22.7373003Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7373172Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7373462Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7373576Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7373778Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7373928Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7374067Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7374239Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7374594Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7374953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7375265Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7375544Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7375852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7376152Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7376443Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7376572Z Execution Analysis: (:1) 2025-03-14T06:00:22.7376834Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7377039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7377044Z 2025-03-14T06:00:22.7377251Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7377477Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7377702Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7377820Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7378017Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7378165Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7378307Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7378476Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7379081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7379652Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7380001Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7380349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7380677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7380953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7381250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7381518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7381623Z Execution Analysis: .......... 2025-03-14T06:00:22.7381881Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7382076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7382363Z pt-xla-profiler: TransferFromDeviceTime too frequent: 146 counts during 140 steps 2025-03-14T06:00:22.7382369Z 2025-03-14T06:00:22.7382608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7382719Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7383009Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7383115Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7383318Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7383457Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7383594Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7383764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7384111Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7384457Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7384771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7385042Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7385375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7385635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7385926Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7386048Z Execution Analysis: (:1) 2025-03-14T06:00:22.7386307Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7386503Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7386508Z 2025-03-14T06:00:22.7386710Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7386821Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7387053Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7387162Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7387364Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7387501Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7387648Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7387810Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7388413Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7388972Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7389329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7389696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7390009Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7390275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7390581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7390845Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7390957Z Execution Analysis: .......... 2025-03-14T06:00:22.7391206Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7391410Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7391687Z pt-xla-profiler: TransferFromDeviceTime too frequent: 147 counts during 141 steps 2025-03-14T06:00:22.7391721Z 2025-03-14T06:00:22.7391928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7392039Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7392327Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7392435Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7392639Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7392781Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7392927Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7393089Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7393440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7393780Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7394091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7394398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7394810Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7395058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7395335Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7395448Z Execution Analysis: (:1) 2025-03-14T06:00:22.7395688Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7396040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7396045Z 2025-03-14T06:00:22.7396246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7396360Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7396591Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7396699Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7396902Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7397041Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7397189Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7397377Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7397956Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7398512Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7398894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7399242Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7399552Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7399986Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7400302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7400573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7400678Z Execution Analysis: .......... 2025-03-14T06:00:22.7400939Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7401138Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7401461Z pt-xla-profiler: TransferFromDeviceTime too frequent: 148 counts during 142 steps 2025-03-14T06:00:22.7401468Z 2025-03-14T06:00:22.7401667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7401786Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7402075Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7402190Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7402394Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7402541Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7402681Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7402854Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7403206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7403566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7403879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7404192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7404630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7404989Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7405321Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7405541Z Execution Analysis: (:1) 2025-03-14T06:00:22.7405937Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7406238Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7406246Z 2025-03-14T06:00:22.7406485Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7406685Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7406961Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7407181Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7407444Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7407669Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7407887Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7408217Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7408828Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7409564Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7409967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7410407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7410758Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7411092Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7411474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7411841Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7411984Z Execution Analysis: .......... 2025-03-14T06:00:22.7412329Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7412598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7412971Z pt-xla-profiler: TransferFromDeviceTime too frequent: 150 counts during 143 steps 2025-03-14T06:00:22.7412980Z 2025-03-14T06:00:22.7413234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7413435Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7413761Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7413950Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7414169Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7414435Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7414620Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7414935Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7415331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7415746Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7416217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7416531Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7416920Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7417338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7417684Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7417866Z Execution Analysis: (:1) 2025-03-14T06:00:22.7418221Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7418458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7418463Z 2025-03-14T06:00:22.7418736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7418883Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7419193Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7419360Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7419665Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7419840Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7420064Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7420245Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7420954Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7421666Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7422099Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7422478Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7422847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7423188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7423583Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7423880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7424063Z Execution Analysis: .......... 2025-03-14T06:00:22.7424356Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7424848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7425187Z pt-xla-profiler: TransferFromDeviceTime too frequent: 151 counts during 144 steps 2025-03-14T06:00:22.7425192Z 2025-03-14T06:00:22.7425476Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7425626Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7426007Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7426210Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7426472Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7426652Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7426880Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7427085Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7427506Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7428086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7428435Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7428795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7429142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7429475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7429834Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7430059Z Execution Analysis: (:1) 2025-03-14T06:00:22.7430362Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7430648Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7430655Z 2025-03-14T06:00:22.7430891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7431103Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7431389Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7431613Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7431856Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7432077Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7432239Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7432554Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7433207Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7433862Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7434260Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7434670Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7435118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7435497Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7435952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7436295Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7436464Z Execution Analysis: .......... 2025-03-14T06:00:22.7436810Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7437060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7437417Z pt-xla-profiler: TransferFromDeviceTime too frequent: 152 counts during 145 steps 2025-03-14T06:00:22.7437422Z 2025-03-14T06:00:22.7437657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7437847Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7438222Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7438383Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7438661Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7438877Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7439053Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7439287Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7439780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7440324Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7440714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7441035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7441471Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7441803Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7442194Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7442354Z Execution Analysis: (:1) 2025-03-14T06:00:22.7442705Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7442944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7442949Z 2025-03-14T06:00:22.7443235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7443401Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7443741Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7443897Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7444183Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7444342Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7444706Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7444914Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7445629Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7446245Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7446666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7447088Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7447504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7447814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7448274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7448610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7448814Z Execution Analysis: .......... 2025-03-14T06:00:22.7449136Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7449413Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7449735Z pt-xla-profiler: TransferFromDeviceTime too frequent: 153 counts during 146 steps 2025-03-14T06:00:22.7449741Z 2025-03-14T06:00:22.7450023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7450225Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7450581Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7450727Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7451010Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7451192Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7451395Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7451670Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7452122Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7452553Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7452905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7453240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7453623Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7453992Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7454389Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7454599Z Execution Analysis: (:1) 2025-03-14T06:00:22.7454895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7455197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7455203Z 2025-03-14T06:00:22.7455458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7456064Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7456339Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7456540Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7456763Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7457151Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7457324Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7457583Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7458177Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7458765Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7459174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7459589Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7459911Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7460246Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7460566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7460926Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7461313Z Execution Analysis: .......... 2025-03-14T06:00:22.7461655Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7461889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7462250Z pt-xla-profiler: TransferFromDeviceTime too frequent: 154 counts during 147 steps 2025-03-14T06:00:22.7462256Z 2025-03-14T06:00:22.7462462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7462751Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7463044Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7463156Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7463376Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7463522Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7463711Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7463882Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7464257Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7464613Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7464939Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7465229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7465678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7465962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7466263Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7466404Z Execution Analysis: (:1) 2025-03-14T06:00:22.7466665Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7466883Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7466887Z 2025-03-14T06:00:22.7467150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7467280Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7467513Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7467639Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7467843Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7468003Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7468187Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7468371Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7468964Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7469552Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7469919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7470287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7470603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7470896Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7471251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7471540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7471647Z Execution Analysis: .......... 2025-03-14T06:00:22.7471923Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7472128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7472427Z pt-xla-profiler: TransferFromDeviceTime too frequent: 155 counts during 148 steps 2025-03-14T06:00:22.7472433Z 2025-03-14T06:00:22.7472637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7472768Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7473061Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7473194Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7473398Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7473598Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7473740Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7473928Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7474291Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7474654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7474967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7475256Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7475562Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7475847Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7476144Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7476278Z Execution Analysis: (:1) 2025-03-14T06:00:22.7476538Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7476754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7476785Z 2025-03-14T06:00:22.7476989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7477114Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7477347Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7477472Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7477677Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7477857Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7478011Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7478192Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7478784Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7479370Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7479727Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7480091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7480402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7480716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7481027Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7481417Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7481533Z Execution Analysis: .......... 2025-03-14T06:00:22.7481785Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7482001Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7482278Z pt-xla-profiler: TransferFromDeviceTime too frequent: 156 counts during 149 steps 2025-03-14T06:00:22.7482282Z 2025-03-14T06:00:22.7482495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7482606Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7482904Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7483053Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7483264Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7483404Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7483561Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7483728Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7484093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7484718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7485049Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7485326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7485655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7485928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7486240Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7486371Z Execution Analysis: (:1) 2025-03-14T06:00:22.7486648Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7486885Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7486890Z 2025-03-14T06:00:22.7487105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7487221Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7487463Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7487578Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7487826Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7487976Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7488131Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7488301Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7488899Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7489477Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7489848Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7490202Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7490556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7490832Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7491154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7491426Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7491544Z Execution Analysis: .......... 2025-03-14T06:00:22.7491805Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7492018Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7492303Z pt-xla-profiler: TransferFromDeviceTime too frequent: 157 counts during 150 steps 2025-03-14T06:00:22.7492308Z 2025-03-14T06:00:22.7492523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7492640Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7492942Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7493084Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7493301Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7493444Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7493600Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7493771Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7494142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7494494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7494820Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7495100Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7495418Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7495692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7496000Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7496131Z Execution Analysis: (:1) 2025-03-14T06:00:22.7496424Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7496630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7496634Z 2025-03-14T06:00:22.7496845Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7496964Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7497210Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7497351Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7497566Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7497712Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7497868Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7498037Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7498642Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7499232Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7499595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7499956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7500307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7500596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7500908Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7501188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7501299Z Execution Analysis: .......... 2025-03-14T06:00:22.7501575Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7501780Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7502078Z pt-xla-profiler: TransferFromDeviceTime too frequent: 158 counts during 151 steps 2025-03-14T06:00:22.7502083Z 2025-03-14T06:00:22.7502290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7502452Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7502744Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7502867Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7503072Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7503232Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7503375Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7503559Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7503919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7504290Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7504712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7504999Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7505304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7505580Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7505866Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7506055Z Execution Analysis: (:1) 2025-03-14T06:00:22.7506311Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7506523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7506528Z 2025-03-14T06:00:22.7506727Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7506855Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7507108Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7507235Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7507442Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7507596Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7507742Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7507918Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7508501Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7509074Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7509425Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7509810Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7510123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7510403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7510706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7510985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7511089Z Execution Analysis: .......... 2025-03-14T06:00:22.7511354Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7511556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7511847Z pt-xla-profiler: TransferFromDeviceTime too frequent: 159 counts during 152 steps 2025-03-14T06:00:22.7511858Z 2025-03-14T06:00:22.7512055Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7512214Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7512500Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7512620Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7512819Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7512974Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7513114Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7513294Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7513647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7514002Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7514312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7514588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7514889Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7515161Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7515474Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7515605Z Execution Analysis: (:1) 2025-03-14T06:00:22.7515862Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7516071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7516075Z 2025-03-14T06:00:22.7516309Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7516422Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7516661Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7516774Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7516985Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7517128Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7517284Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7517450Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7518034Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7518595Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7519007Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7519350Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7519671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7519939Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7520255Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7520526Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7520644Z Execution Analysis: .......... 2025-03-14T06:00:22.7520895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7521106Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7521394Z pt-xla-profiler: TransferFromDeviceTime too frequent: 160 counts during 153 steps 2025-03-14T06:00:22.7521427Z 2025-03-14T06:00:22.7521638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7521752Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7522048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7522156Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7522368Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7522510Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7522661Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7522831Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7523191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7523538Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7523857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7524126Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7524445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7524837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7525315Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7525445Z Execution Analysis: (:1) 2025-03-14T06:00:22.7525723Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7525930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7525937Z 2025-03-14T06:00:22.7526182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7526302Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7526549Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7526661Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7526883Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7527032Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7527192Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7527364Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7527965Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7528544Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7528942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7529296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7529629Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7529909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7530231Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7530504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7530622Z Execution Analysis: .......... 2025-03-14T06:00:22.7530882Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7531103Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7531421Z pt-xla-profiler: TransferFromDeviceTime too frequent: 161 counts during 154 steps 2025-03-14T06:00:22.7531437Z 2025-03-14T06:00:22.7531641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7531769Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7532064Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7532195Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7532399Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7532552Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7532697Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7532867Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7533237Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7533601Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7533915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7534201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7534517Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7534827Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7535125Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7535263Z Execution Analysis: (:1) 2025-03-14T06:00:22.7535526Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7535768Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7535775Z 2025-03-14T06:00:22.7535982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7536108Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7536340Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7536468Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7536680Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7536839Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7536987Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7537279Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7537855Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7538463Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7538814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7539175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7539485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7539769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7540071Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7540348Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7540454Z Execution Analysis: .......... 2025-03-14T06:00:22.7540725Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7540925Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7541245Z pt-xla-profiler: TransferFromDeviceTime too frequent: 162 counts during 155 steps 2025-03-14T06:00:22.7541250Z 2025-03-14T06:00:22.7541449Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7541575Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7541864Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7541988Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7542189Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7542343Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7542485Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7542665Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7543020Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7543383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7543690Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7543972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7544299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7544577Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7544864Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7544999Z Execution Analysis: (:1) 2025-03-14T06:00:22.7545277Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7545491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7545497Z 2025-03-14T06:00:22.7545713Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7545826Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7546065Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7546181Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7546396Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7546540Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7546689Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7546870Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7547461Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7548065Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7548435Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7548783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7549107Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7549379Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7549693Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7549960Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7550084Z Execution Analysis: .......... 2025-03-14T06:00:22.7550345Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7550585Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7550870Z pt-xla-profiler: TransferFromDeviceTime too frequent: 163 counts during 156 steps 2025-03-14T06:00:22.7550876Z 2025-03-14T06:00:22.7551097Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7551215Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7551517Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7551631Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7551847Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7551997Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7552156Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7552328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7552696Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7553044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7553368Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7553673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7553989Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7554255Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7554557Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7554685Z Execution Analysis: (:1) 2025-03-14T06:00:22.7554999Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7555202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7555207Z 2025-03-14T06:00:22.7555421Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7555538Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7555781Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7555891Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7556105Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7556246Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7556406Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7556571Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7557186Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7557751Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7558114Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7558465Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7558783Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7559051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7559363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7559633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7559754Z Execution Analysis: .......... 2025-03-14T06:00:22.7560049Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7562476Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7562791Z pt-xla-profiler: TransferFromDeviceTime too frequent: 164 counts during 157 steps 2025-03-14T06:00:22.7562797Z 2025-03-14T06:00:22.7563018Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7563138Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7563438Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7563553Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7563770Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7563922Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7564078Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7564247Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7564714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7565267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7565737Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7566029Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7566343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7566634Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7566929Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7567144Z Execution Analysis: (:1) 2025-03-14T06:00:22.7567413Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7567633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7567644Z 2025-03-14T06:00:22.7567863Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7567982Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7568217Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7568349Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7568556Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7568715Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7568865Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7569103Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7569702Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7570298Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7570673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7571031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7571361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7571637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7571959Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7572238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7572401Z Execution Analysis: .......... 2025-03-14T06:00:22.7572665Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7572970Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7573263Z pt-xla-profiler: TransferFromDeviceTime too frequent: 165 counts during 158 steps 2025-03-14T06:00:22.7573268Z 2025-03-14T06:00:22.7573486Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7573606Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7573911Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7574025Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7574248Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7574395Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7574555Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7574730Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7575109Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7575465Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7575791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7576072Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7576398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7576671Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7577011Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7577251Z Execution Analysis: (:1) 2025-03-14T06:00:22.7577518Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7577720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7577725Z 2025-03-14T06:00:22.7577938Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7578051Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7578290Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7578401Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7578618Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7578789Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7578950Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7579117Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7579709Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7580278Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7580642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7580987Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7581315Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7581588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7581908Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7582202Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7582320Z Execution Analysis: .......... 2025-03-14T06:00:22.7582611Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7582822Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7583105Z pt-xla-profiler: TransferFromDeviceTime too frequent: 166 counts during 159 steps 2025-03-14T06:00:22.7583110Z 2025-03-14T06:00:22.7583326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7583442Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7583738Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7583854Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7584066Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7584211Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7584367Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7584536Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7584901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7585246Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7585566Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7585837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7586153Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7586458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7586750Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7587055Z Execution Analysis: (:1) 2025-03-14T06:00:22.7587319Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7587537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7587542Z 2025-03-14T06:00:22.7587749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7587882Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7588118Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7588247Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7588559Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7588722Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7588873Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7589060Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7589659Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7590247Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7590610Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7590980Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7591296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7591596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7591935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7592224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7592377Z Execution Analysis: .......... 2025-03-14T06:00:22.7592655Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7592861Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7593164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 167 counts during 160 steps 2025-03-14T06:00:22.7593169Z 2025-03-14T06:00:22.7593374Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7593507Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7593805Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7593935Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7594146Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7594307Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7594454Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7594640Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7595004Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7595374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7595691Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7595981Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7596320Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7596609Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7596908Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7597055Z Execution Analysis: (:1) 2025-03-14T06:00:22.7597316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7597535Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7597540Z 2025-03-14T06:00:22.7597746Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7597880Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7598114Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7598269Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7598480Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7598641Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7598795Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7598974Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7599574Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7600163Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7600525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7600891Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7601210Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7601529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7601840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7602153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7602278Z Execution Analysis: .......... 2025-03-14T06:00:22.7602537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7602755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7603043Z pt-xla-profiler: TransferFromDeviceTime too frequent: 168 counts during 161 steps 2025-03-14T06:00:22.7603049Z 2025-03-14T06:00:22.7603265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7603385Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7603689Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7603804Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7604023Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7604174Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7604329Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7604612Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7604990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7605346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7605673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7605991Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7606317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7606594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7606905Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7607036Z Execution Analysis: (:1) 2025-03-14T06:00:22.7607312Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7607518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7607522Z 2025-03-14T06:00:22.7607737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7607855Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7608131Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7608246Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7608471Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7608617Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7608778Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7608952Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7609562Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7610140Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7610515Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7610874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7611203Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7611509Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7611862Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7612136Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7612258Z Execution Analysis: .......... 2025-03-14T06:00:22.7612521Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7612737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7613026Z pt-xla-profiler: TransferFromDeviceTime too frequent: 169 counts during 162 steps 2025-03-14T06:00:22.7613034Z 2025-03-14T06:00:22.7613255Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7613376Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7613681Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7613796Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7614019Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7614170Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7614330Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7614502Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7614878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7615233Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7615590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7615870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7616195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7616467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7616776Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7616902Z Execution Analysis: (:1) 2025-03-14T06:00:22.7617279Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7617479Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7617484Z 2025-03-14T06:00:22.7617694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7617839Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7618079Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7618190Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7618404Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7618548Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7618706Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7618872Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7619460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7620036Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7620393Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7620755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7621091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7621404Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7621710Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7621991Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7622098Z Execution Analysis: .......... 2025-03-14T06:00:22.7622366Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7622566Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7622860Z pt-xla-profiler: TransferFromDeviceTime too frequent: 171 counts during 163 steps 2025-03-14T06:00:22.7622866Z 2025-03-14T06:00:22.7623064Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7623192Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7623480Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7623608Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7623808Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7623962Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7624103Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7624282Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7624632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7624990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7625325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7625610Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7625913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7626197Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7626488Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7626625Z Execution Analysis: (:1) 2025-03-14T06:00:22.7626880Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7627091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7627095Z 2025-03-14T06:00:22.7627320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7627453Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7627683Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7627811Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7628019Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7628181Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7628327Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7628511Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7629088Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7629661Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7630018Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7630418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7630725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7631031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7631353Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7631624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7631747Z Execution Analysis: .......... 2025-03-14T06:00:22.7632006Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7632219Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7632506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 172 counts during 164 steps 2025-03-14T06:00:22.7632514Z 2025-03-14T06:00:22.7632728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7632845Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7633151Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7633264Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7633483Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7633628Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7633786Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7633956Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7634325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7634707Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7635032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7635304Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7635626Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7635894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7636202Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7636330Z Execution Analysis: (:1) 2025-03-14T06:00:22.7636601Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7636804Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7636850Z 2025-03-14T06:00:22.7637051Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7637184Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7637416Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7637547Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7637751Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7637911Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7638061Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7638249Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7638832Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7639415Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7639803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7640166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7640502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7640791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7641097Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7641377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7641483Z Execution Analysis: .......... 2025-03-14T06:00:22.7641747Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7641951Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7642249Z pt-xla-profiler: TransferFromDeviceTime too frequent: 173 counts during 165 steps 2025-03-14T06:00:22.7642253Z 2025-03-14T06:00:22.7642454Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7642579Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7642864Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7642990Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7643190Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7643348Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7643490Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7643674Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7644052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7644411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7644815Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7645272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7645583Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7645868Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7646166Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7646307Z Execution Analysis: (:1) 2025-03-14T06:00:22.7646569Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7646829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7646836Z 2025-03-14T06:00:22.7647044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7647178Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7647417Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7647549Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7647759Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7647920Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7648070Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7648258Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7648852Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7649445Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7649840Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7650233Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7650551Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7650843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7651154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7651442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7651552Z Execution Analysis: .......... 2025-03-14T06:00:22.7651832Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7652040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7652343Z pt-xla-profiler: TransferFromDeviceTime too frequent: 174 counts during 166 steps 2025-03-14T06:00:22.7652349Z 2025-03-14T06:00:22.7652569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7652688Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7652996Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7653110Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7653317Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7653477Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7653624Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7653811Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7654205Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7654575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7654908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7655185Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7655507Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7655779Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7656086Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7656212Z Execution Analysis: (:1) 2025-03-14T06:00:22.7656521Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7656726Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7656733Z 2025-03-14T06:00:22.7656948Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7657067Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7657421Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7657530Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7657745Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7657888Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7658048Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7658215Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7658806Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7659399Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7659795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7660142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7660463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7660737Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7661053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7661324Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7661447Z Execution Analysis: .......... 2025-03-14T06:00:22.7661701Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7661913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7662197Z pt-xla-profiler: TransferFromDeviceTime too frequent: 175 counts during 167 steps 2025-03-14T06:00:22.7662201Z 2025-03-14T06:00:22.7662412Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7662525Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7662822Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7662934Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7663149Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7663293Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7663477Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7663648Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7664016Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7664364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7664685Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7664954Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7665272Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7665889Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7666198Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7666421Z Execution Analysis: (:1) 2025-03-14T06:00:22.7666700Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7666913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7666918Z 2025-03-14T06:00:22.7667138Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7667257Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7667506Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7667624Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7667852Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7667999Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7668167Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7668339Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7668953Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7669569Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7669988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7670349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7670678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7670968Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7671279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7671568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7671681Z Execution Analysis: .......... 2025-03-14T06:00:22.7671956Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7672166Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7672468Z pt-xla-profiler: TransferFromDeviceTime too frequent: 176 counts during 168 steps 2025-03-14T06:00:22.7672474Z 2025-03-14T06:00:22.7672682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7672812Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7673106Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7673236Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7673444Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7673647Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7673797Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7673986Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7674347Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7674718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7675035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7675327Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7675637Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7675923Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7676253Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7676395Z Execution Analysis: (:1) 2025-03-14T06:00:22.7676659Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7676884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7676889Z 2025-03-14T06:00:22.7677094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7677228Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7677462Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7677591Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7677909Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7678067Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7678220Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7678402Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7679012Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7679618Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7679972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7680334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7680648Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7680931Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7681238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7681520Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7681630Z Execution Analysis: .......... 2025-03-14T06:00:22.7681897Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7682099Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7682394Z pt-xla-profiler: TransferFromDeviceTime too frequent: 177 counts during 169 steps 2025-03-14T06:00:22.7682399Z 2025-03-14T06:00:22.7682599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7682728Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7683013Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7683139Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7683367Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7683527Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7683668Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7683851Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7684206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7684628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7685103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7685394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7685708Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7685991Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7686325Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7686467Z Execution Analysis: (:1) 2025-03-14T06:00:22.7686730Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7686950Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7686955Z 2025-03-14T06:00:22.7687158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7687288Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7687522Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7687655Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7687865Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7688030Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7688183Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7688404Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7688998Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7689618Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7689998Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7690357Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7690692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7690970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7691295Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7691572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7691694Z Execution Analysis: .......... 2025-03-14T06:00:22.7691957Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7692174Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7692462Z pt-xla-profiler: TransferFromDeviceTime too frequent: 178 counts during 170 steps 2025-03-14T06:00:22.7692468Z 2025-03-14T06:00:22.7692685Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7692804Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7693109Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7693253Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7693477Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7693627Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7693785Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7693963Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7694336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7694690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7695022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7695301Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7695623Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7695922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7696232Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7696361Z Execution Analysis: (:1) 2025-03-14T06:00:22.7696644Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7696850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7696855Z 2025-03-14T06:00:22.7697070Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7697296Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7697535Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7697646Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7697865Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7698007Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7698190Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7698355Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7698970Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7699534Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7699904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7700249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7700566Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7700838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7701154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7701423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7701543Z Execution Analysis: .......... 2025-03-14T06:00:22.7701796Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7702008Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7702289Z pt-xla-profiler: TransferFromDeviceTime too frequent: 179 counts during 171 steps 2025-03-14T06:00:22.7702293Z 2025-03-14T06:00:22.7702505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7702622Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7702961Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7703075Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7703295Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7703438Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7703594Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7703764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7704129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7704476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7704794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7705061Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7705424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7705692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7705992Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7706132Z Execution Analysis: (:1) 2025-03-14T06:00:22.7706385Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7706598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7706602Z 2025-03-14T06:00:22.7706801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7706929Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7707157Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7707290Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7707496Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7708027Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7708178Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7708361Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7708971Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7709552Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7709907Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7710271Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7710585Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7710868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7711172Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7711456Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7711564Z Execution Analysis: .......... 2025-03-14T06:00:22.7711831Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7712032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7712326Z pt-xla-profiler: TransferFromDeviceTime too frequent: 180 counts during 172 steps 2025-03-14T06:00:22.7712330Z 2025-03-14T06:00:22.7712532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7712691Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7712986Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7713114Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7713316Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7713475Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7713617Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7713800Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7714154Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7714526Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7714834Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7715143Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7715450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7715730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7716020Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7716160Z Execution Analysis: (:1) 2025-03-14T06:00:22.7716419Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7716637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7716642Z 2025-03-14T06:00:22.7716842Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7716973Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7717207Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7717335Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7717565Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7717725Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7717901Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7718082Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7718661Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7719240Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7719593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7719959Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7720272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7720559Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7720865Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7721147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7721273Z Execution Analysis: .......... 2025-03-14T06:00:22.7721530Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7721746Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7722033Z pt-xla-profiler: TransferFromDeviceTime too frequent: 181 counts during 173 steps 2025-03-14T06:00:22.7722040Z 2025-03-14T06:00:22.7722278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7722394Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7722700Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7722814Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7723033Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7723175Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7723335Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7723505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7723869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7724216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7724638Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7725078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7725405Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7725679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7725987Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7726114Z Execution Analysis: (:1) 2025-03-14T06:00:22.7726389Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7726593Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7726597Z 2025-03-14T06:00:22.7726813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7726938Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7727184Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7727331Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7727551Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7727737Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7727902Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7728073Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7728682Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7729259Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7729636Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7729994Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7730327Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7730606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7730931Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7731203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7731326Z Execution Analysis: .......... 2025-03-14T06:00:22.7731589Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7731806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7732123Z pt-xla-profiler: TransferFromDeviceTime too frequent: 182 counts during 174 steps 2025-03-14T06:00:22.7732129Z 2025-03-14T06:00:22.7732352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7732470Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7732783Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7732897Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7733116Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7733262Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7733422Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7733594Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7733966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7734320Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7734678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7734958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7735289Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7735562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7735871Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7736004Z Execution Analysis: (:1) 2025-03-14T06:00:22.7736283Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7736491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7736498Z 2025-03-14T06:00:22.7736716Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7736859Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7737216Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7737328Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7737580Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7737726Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7737885Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7738051Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7738646Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7739206Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7739577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7739936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7740245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7740528Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7740830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7741112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7741218Z Execution Analysis: .......... 2025-03-14T06:00:22.7741484Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7741787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7742086Z pt-xla-profiler: TransferFromDeviceTime too frequent: 183 counts during 175 steps 2025-03-14T06:00:22.7742093Z 2025-03-14T06:00:22.7742294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7742422Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7742709Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7742834Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7743035Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7743194Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7743337Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7743522Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7743877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7744258Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7744566Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7744847Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7745148Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7745425Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7745714Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7745852Z Execution Analysis: (:1) 2025-03-14T06:00:22.7746108Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7746320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7746329Z 2025-03-14T06:00:22.7746527Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7746684Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7746912Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7747060Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7747264Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7747420Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7747568Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7747748Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7748326Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7748902Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7749258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7749615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7749924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7750207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7750509Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7750787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7750899Z Execution Analysis: .......... 2025-03-14T06:00:22.7751166Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7751394Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7751689Z pt-xla-profiler: TransferFromDeviceTime too frequent: 184 counts during 176 steps 2025-03-14T06:00:22.7751695Z 2025-03-14T06:00:22.7751897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7752026Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7752309Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7752434Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7752639Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7752794Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7752936Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7761173Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7761674Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7762050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7762356Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7762639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7762937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7763207Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7763493Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7763625Z Execution Analysis: (:1) 2025-03-14T06:00:22.7763880Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7764094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7764134Z 2025-03-14T06:00:22.7764330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7764452Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7764829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7765112Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7765452Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7765607Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7765753Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7765930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7766529Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7767120Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7767488Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7767842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7768161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7768440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7768753Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7769022Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7769135Z Execution Analysis: .......... 2025-03-14T06:00:22.7769480Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7769693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7769983Z pt-xla-profiler: TransferFromDeviceTime too frequent: 185 counts during 177 steps 2025-03-14T06:00:22.7769990Z 2025-03-14T06:00:22.7770203Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7770316Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7770616Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7770726Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7770936Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7771082Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7771230Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7771442Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7771812Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7772159Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7772478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7772752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7773064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7773330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7773630Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7773751Z Execution Analysis: (:1) 2025-03-14T06:00:22.7774017Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7774255Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7774260Z 2025-03-14T06:00:22.7774498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7774615Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7774853Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7774964Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7775180Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7775323Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7775478Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7775641Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7776246Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7776819Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7777184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7777534Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7777950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7778216Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7778524Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7778785Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7778922Z Execution Analysis: .......... 2025-03-14T06:00:22.7779173Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7779378Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7779656Z pt-xla-profiler: TransferFromDeviceTime too frequent: 186 counts during 178 steps 2025-03-14T06:00:22.7779662Z 2025-03-14T06:00:22.7779862Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7779973Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7780261Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7780370Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7780574Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7780715Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7780900Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7781061Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7781419Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7781760Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7782071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7782336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7782643Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7782902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7783197Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7783325Z Execution Analysis: (:1) 2025-03-14T06:00:22.7783589Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7783818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7783823Z 2025-03-14T06:00:22.7784043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7784161Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7784386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7784504Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7784700Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7784845Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7784987Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7785160Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7785739Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7786304Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7786653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7786999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7787304Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7787577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7787879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7788173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7788281Z Execution Analysis: .......... 2025-03-14T06:00:22.7788537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7788732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7789013Z pt-xla-profiler: TransferFromDeviceTime too frequent: 187 counts during 179 steps 2025-03-14T06:00:22.7789019Z 2025-03-14T06:00:22.7789210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7789326Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7789609Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7789719Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7789914Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7790088Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7790226Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7790398Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7790747Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7791097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7791401Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7791679Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7791980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7792248Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7792536Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7792705Z Execution Analysis: (:1) 2025-03-14T06:00:22.7792955Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7793183Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7793188Z 2025-03-14T06:00:22.7793387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7793504Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7793725Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7793847Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7794042Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7794193Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7794335Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7794510Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7795081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7795646Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7795994Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7796343Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7796647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7796922Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7797246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7797523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7797626Z Execution Analysis: .......... 2025-03-14T06:00:22.7797885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7798080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7798361Z pt-xla-profiler: TransferFromDeviceTime too frequent: 188 counts during 180 steps 2025-03-14T06:00:22.7798367Z 2025-03-14T06:00:22.7798569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7798679Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7798965Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7799097Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7799313Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7799458Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7799616Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7799790Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7800155Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7800501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7800820Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7801093Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7801411Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7801684Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7801987Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7802141Z Execution Analysis: (:1) 2025-03-14T06:00:22.7802417Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7802641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7802645Z 2025-03-14T06:00:22.7802858Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7802976Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7803215Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7803327Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7803543Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7803692Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7803853Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7804022Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7804715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7805463Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7805851Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7806206Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7806539Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7806854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7807177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7807452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7807579Z Execution Analysis: .......... 2025-03-14T06:00:22.7807845Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7808066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7808358Z pt-xla-profiler: TransferFromDeviceTime too frequent: 189 counts during 181 steps 2025-03-14T06:00:22.7808364Z 2025-03-14T06:00:22.7808584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7808701Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7809037Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7809154Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7809377Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7809523Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7809683Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7809859Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7810233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7810589Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7810914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7811191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7811512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7811788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7812122Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7812251Z Execution Analysis: (:1) 2025-03-14T06:00:22.7812549Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7812754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7812758Z 2025-03-14T06:00:22.7812973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7813092Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7813336Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7813449Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7813673Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7813818Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7813986Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7814157Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7814765Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7815343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7815718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7816085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7816402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7816724Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7817039Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7817432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7817540Z Execution Analysis: .......... 2025-03-14T06:00:22.7817807Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7818007Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7818299Z pt-xla-profiler: TransferFromDeviceTime too frequent: 190 counts during 182 steps 2025-03-14T06:00:22.7818303Z 2025-03-14T06:00:22.7818504Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7818660Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7818950Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7819077Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7819280Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7819436Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7819580Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7819758Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7820112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7820471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7820780Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7821064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7821372Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7821677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7821966Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7822129Z Execution Analysis: (:1) 2025-03-14T06:00:22.7822388Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7822601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7822605Z 2025-03-14T06:00:22.7822805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7822932Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7823162Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7823291Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7823493Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7823650Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7823795Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7823976Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7824554Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7825127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7825480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7825836Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7826170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7826455Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7826756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7827036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7827142Z Execution Analysis: .......... 2025-03-14T06:00:22.7827409Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7827609Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7827903Z pt-xla-profiler: TransferFromDeviceTime too frequent: 192 counts during 183 steps 2025-03-14T06:00:22.7827908Z 2025-03-14T06:00:22.7828111Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7828278Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7828566Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7828688Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7828892Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7829047Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7829187Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7829366Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7829716Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7830073Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7830377Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7830666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7830996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7831274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7831585Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7831723Z Execution Analysis: (:1) 2025-03-14T06:00:22.7831977Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7832189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7832193Z 2025-03-14T06:00:22.7832402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7832519Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7832764Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7832878Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7833091Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7833236Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7833397Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7833563Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7834154Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7834719Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7835084Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7835459Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7835782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7836054Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7836371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7836638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7836756Z Execution Analysis: .......... 2025-03-14T06:00:22.7837010Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7837221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7837500Z pt-xla-profiler: TransferFromDeviceTime too frequent: 193 counts during 184 steps 2025-03-14T06:00:22.7837531Z 2025-03-14T06:00:22.7837747Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7837864Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7838161Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7838274Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7838487Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7838631Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7838785Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7838953Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7839315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7839661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7839984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7840280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7840597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7840888Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7841189Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7841315Z Execution Analysis: (:1) 2025-03-14T06:00:22.7841582Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7841784Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7841788Z 2025-03-14T06:00:22.7842000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7842121Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7842363Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7842475Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7842692Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7842838Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7842998Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7843164Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7843747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7844299Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7844779Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7845295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7845624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7845920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7846227Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7846511Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7846618Z Execution Analysis: .......... 2025-03-14T06:00:22.7846895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7847098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7847427Z pt-xla-profiler: TransferFromDeviceTime too frequent: 194 counts during 185 steps 2025-03-14T06:00:22.7847434Z 2025-03-14T06:00:22.7847635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7847758Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7848055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7848180Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7848388Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7848543Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7848688Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7848869Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7849231Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7849596Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7849914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7850224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7850559Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7850836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7851129Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7851263Z Execution Analysis: (:1) 2025-03-14T06:00:22.7851519Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7851731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7851738Z 2025-03-14T06:00:22.7851943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7852072Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7852303Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7852424Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7852634Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7852791Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7852938Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7853121Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7853714Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7854299Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7854684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7855051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7855364Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7855657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7855963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7856247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7856352Z Execution Analysis: .......... 2025-03-14T06:00:22.7856624Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7856855Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7857263Z pt-xla-profiler: TransferFromDeviceTime too frequent: 195 counts during 186 steps 2025-03-14T06:00:22.7857271Z 2025-03-14T06:00:22.7857466Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7857589Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7857873Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7857988Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7858188Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7858337Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7858479Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7858657Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7859005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7859360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7859693Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7859993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7860294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7860566Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7860850Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7860985Z Execution Analysis: (:1) 2025-03-14T06:00:22.7861236Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7861450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7861455Z 2025-03-14T06:00:22.7861654Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7861779Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7862002Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7862124Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7862322Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7862475Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7862613Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7862789Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7863360Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7863971Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7864337Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7864680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7864992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7865264Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7865887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7866163Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7866284Z Execution Analysis: .......... 2025-03-14T06:00:22.7866547Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7866838Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7867129Z pt-xla-profiler: TransferFromDeviceTime too frequent: 196 counts during 187 steps 2025-03-14T06:00:22.7867134Z 2025-03-14T06:00:22.7867351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7867471Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7867777Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7867892Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7868112Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7868257Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7868418Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7868590Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7868966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7869362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7869685Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7869994Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7870314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7870588Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7870891Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7871019Z Execution Analysis: (:1) 2025-03-14T06:00:22.7871288Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7871498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7871504Z 2025-03-14T06:00:22.7871714Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7871829Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7872070Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7872182Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7872394Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7872538Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7872686Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7872857Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7873458Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7874142Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7874517Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7874872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7875198Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7875472Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7875791Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7876060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7876205Z Execution Analysis: .......... 2025-03-14T06:00:22.7876469Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7876687Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7876973Z pt-xla-profiler: TransferFromDeviceTime too frequent: 197 counts during 188 steps 2025-03-14T06:00:22.7876981Z 2025-03-14T06:00:22.7877191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7877309Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7877614Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7877726Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7877943Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7878089Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7878245Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7878415Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7878818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7879168Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7879517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7879793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7880108Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7880379Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7880685Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7880809Z Execution Analysis: (:1) 2025-03-14T06:00:22.7881086Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7881408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7881412Z 2025-03-14T06:00:22.7881611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7881733Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7881959Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7882076Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7882277Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7882424Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7882565Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7882842Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7883602Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7884172Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7884585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7885104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7885417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7885702Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7886011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7886291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7886432Z Execution Analysis: .......... 2025-03-14T06:00:22.7886705Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7886910Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7887208Z pt-xla-profiler: TransferFromDeviceTime too frequent: 198 counts during 189 steps 2025-03-14T06:00:22.7887214Z 2025-03-14T06:00:22.7887415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7887541Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7887826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7887948Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7888150Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7888309Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7888453Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7888663Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7889019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7889417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7889730Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7890019Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7890322Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7890599Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7890896Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7891034Z Execution Analysis: (:1) 2025-03-14T06:00:22.7891297Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7891507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7891512Z 2025-03-14T06:00:22.7891719Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7891841Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7892073Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7892195Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7892403Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7892548Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7892694Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7892872Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7893491Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7894078Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7894438Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7894801Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7895115Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7895397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7895705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7896010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7896118Z Execution Analysis: .......... 2025-03-14T06:00:22.7896387Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7896590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7896990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 199 counts during 190 steps 2025-03-14T06:00:22.7896996Z 2025-03-14T06:00:22.7897205Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7897318Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7897605Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7897712Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7897915Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7898069Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7898231Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7898402Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7898785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7899139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7899446Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7899714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7900019Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7900283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7900577Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7900702Z Execution Analysis: (:1) 2025-03-14T06:00:22.7900959Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7901157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7901161Z 2025-03-14T06:00:22.7901363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7901474Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7901706Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7901817Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7902020Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7902161Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7902333Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7902497Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7903078Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7903634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7903990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7904333Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7904645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7904910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7905245Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7905505Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7905619Z Execution Analysis: .......... 2025-03-14T06:00:22.7905871Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7906078Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7906353Z pt-xla-profiler: TransferFromDeviceTime too frequent: 200 counts during 191 steps 2025-03-14T06:00:22.7906357Z 2025-03-14T06:00:22.7906564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7906675Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7906970Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7907189Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7907390Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7907547Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7907691Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7907847Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7908207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7908535Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7908832Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7909088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7909380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7909636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7909916Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7910034Z Execution Analysis: (:1) 2025-03-14T06:00:22.7910284Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7910468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7910472Z 2025-03-14T06:00:22.7910665Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7910772Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7910997Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7911102Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7911303Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7911462Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7911608Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7911765Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7912321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7912850Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7913189Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7913519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7913814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7914094Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7914389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7914651Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7914750Z Execution Analysis: .......... 2025-03-14T06:00:22.7914990Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7915187Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7915462Z pt-xla-profiler: TransferFromDeviceTime too frequent: 201 counts during 192 steps 2025-03-14T06:00:22.7915467Z 2025-03-14T06:00:22.7915651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7915771Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7916042Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7916157Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7916367Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7916515Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7916646Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7916834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7917169Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7917501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7917791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7918052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7918338Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7918594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7918868Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7918990Z Execution Analysis: (:1) 2025-03-14T06:00:22.7919225Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7919418Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7919422Z 2025-03-14T06:00:22.7919609Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7919723Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7919939Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7920051Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7920263Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7920410Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7920547Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7920711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7921258Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7921797Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7922126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7922468Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7922782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7923047Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7923332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7923594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7923690Z Execution Analysis: .......... 2025-03-14T06:00:22.7923944Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7924129Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7924399Z pt-xla-profiler: TransferFromDeviceTime too frequent: 202 counts during 193 steps 2025-03-14T06:00:22.7924403Z 2025-03-14T06:00:22.7924678Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7924796Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7925248Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7925401Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7925608Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7925786Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7925930Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7926106Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7926466Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7926827Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7927140Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7927420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7927729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7928011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7928307Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7928454Z Execution Analysis: (:1) 2025-03-14T06:00:22.7928716Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7928935Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7928940Z 2025-03-14T06:00:22.7929143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7929277Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7929511Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7929664Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7929875Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7930036Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7930185Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7930374Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7930969Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7931559Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7931935Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7932294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7932653Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7932932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7933259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7933533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7933657Z Execution Analysis: .......... 2025-03-14T06:00:22.7933917Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7934136Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7934426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 203 counts during 194 steps 2025-03-14T06:00:22.7934432Z 2025-03-14T06:00:22.7934656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7934775Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7935119Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7935236Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7935484Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7935634Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7935792Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7935966Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7936341Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7936698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7937027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7937409Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7937713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7937966Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7938257Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7938381Z Execution Analysis: (:1) 2025-03-14T06:00:22.7938639Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7938831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7938835Z 2025-03-14T06:00:22.7939031Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7939141Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7939395Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7939502Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7939713Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7939848Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7940002Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7940161Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7940722Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7941251Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7941596Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7941951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7942254Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7942510Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7942811Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7943061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7943169Z Execution Analysis: .......... 2025-03-14T06:00:22.7943409Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7943612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7943879Z pt-xla-profiler: TransferFromDeviceTime too frequent: 204 counts during 195 steps 2025-03-14T06:00:22.7943885Z 2025-03-14T06:00:22.7944080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7944218Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7944501Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7944632Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7944838Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7944975Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7945124Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7945282Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7945629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7945958Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7946268Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7946525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7946820Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7947075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7947361Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7947479Z Execution Analysis: (:1) 2025-03-14T06:00:22.7947727Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7947918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7947933Z 2025-03-14T06:00:22.7948146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7948267Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7948485Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7948602Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7948793Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7948931Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7949086Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7949243Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7949802Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7950344Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7950708Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7951050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7951344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7951614Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7951900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7952164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7952264Z Execution Analysis: .......... 2025-03-14T06:00:22.7952518Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7952707Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7952989Z pt-xla-profiler: TransferFromDeviceTime too frequent: 205 counts during 196 steps 2025-03-14T06:00:22.7953019Z 2025-03-14T06:00:22.7953207Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7953322Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7953617Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7953733Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7953925Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7954071Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7954205Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7954378Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7954711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7955053Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7955344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7955610Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7955900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7956162Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7956436Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7956564Z Execution Analysis: (:1) 2025-03-14T06:00:22.7956805Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7957004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7957010Z 2025-03-14T06:00:22.7957221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7957343Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7957557Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7957674Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7957867Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7958013Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7958150Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7958319Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7958865Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7959405Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7959778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7960121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7960415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7960681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7960967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7961226Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7961328Z Execution Analysis: .......... 2025-03-14T06:00:22.7961581Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7961772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7962073Z pt-xla-profiler: TransferFromDeviceTime too frequent: 206 counts during 197 steps 2025-03-14T06:00:22.7962078Z 2025-03-14T06:00:22.7962268Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7962414Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7962685Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7962804Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7962995Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7963143Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7963282Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7963447Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7963782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7964123Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7964417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7964762Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7965230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7965680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7965992Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7966121Z Execution Analysis: (:1) 2025-03-14T06:00:22.7966394Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7966667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7966672Z 2025-03-14T06:00:22.7966892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7967008Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7967255Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7967364Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7967582Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7967726Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7967885Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7968056Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7968658Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7969293Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7969671Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7970026Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7970359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7970637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7970960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7971233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7971353Z Execution Analysis: .......... 2025-03-14T06:00:22.7971617Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7971838Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7972166Z pt-xla-profiler: TransferFromDeviceTime too frequent: 207 counts during 198 steps 2025-03-14T06:00:22.7972171Z 2025-03-14T06:00:22.7972423Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7972543Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7972854Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7972970Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7973191Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7973340Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7973501Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7973674Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7974051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7974409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7974742Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7975021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7975347Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7975620Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7975931Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7976060Z Execution Analysis: (:1) 2025-03-14T06:00:22.7976335Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7976572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7976579Z 2025-03-14T06:00:22.7976790Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7976913Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7977161Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7977385Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7977603Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7977850Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7978008Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7978170Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7978732Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7979291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7979640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7979968Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7980276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7980533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7980838Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7981095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7981212Z Execution Analysis: .......... 2025-03-14T06:00:22.7981453Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7981681Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7981975Z pt-xla-profiler: TransferFromDeviceTime too frequent: 208 counts during 199 steps 2025-03-14T06:00:22.7981994Z 2025-03-14T06:00:22.7982184Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7982303Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7982572Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7982689Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7982878Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7983025Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7983160Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7983322Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7983664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7984003Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7984295Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7984564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7984849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7985113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7985384Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7985514Z Execution Analysis: (:1) 2025-03-14T06:00:22.7985778Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7985981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7985985Z 2025-03-14T06:00:22.7986172Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7986295Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7986511Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7986631Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7986818Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7986965Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7987104Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7987274Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7987849Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7988394Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7988732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7989072Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7989365Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7989634Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7989919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7990182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7990282Z Execution Analysis: .......... 2025-03-14T06:00:22.7990560Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7990749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7991050Z pt-xla-profiler: TransferFromDeviceTime too frequent: 209 counts during 200 steps 2025-03-14T06:00:22.7991055Z 2025-03-14T06:00:22.7991244Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7991366Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7991636Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.7991751Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7991944Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.7992094Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.7992229Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.7992401Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7992733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.7993075Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7993365Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7993631Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7994092Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.7994367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.7994654Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.7994821Z Execution Analysis: (:1) 2025-03-14T06:00:22.7995076Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.7995288Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7995295Z 2025-03-14T06:00:22.7995493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.7995662Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.7996055Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.7996178Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.7996386Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.7996542Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.7996691Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.7996903Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.7997499Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.7998131Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.7998532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.7998896Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.7999222Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.7999502Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.7999829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8000103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8000263Z Execution Analysis: .......... 2025-03-14T06:00:22.8000528Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8000776Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8001066Z pt-xla-profiler: TransferFromDeviceTime too frequent: 210 counts during 201 steps 2025-03-14T06:00:22.8001070Z 2025-03-14T06:00:22.8001288Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8001402Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8001708Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8001825Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8002048Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8002195Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8002357Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8002527Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8002908Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8003267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8003594Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8003876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8004199Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8004533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8004909Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8005042Z Execution Analysis: (:1) 2025-03-14T06:00:22.8005323Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8005529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8005534Z 2025-03-14T06:00:22.8005758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8005876Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8006125Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8006240Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8006463Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8006612Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8006806Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8006979Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8007584Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8008167Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8008539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8008907Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8009225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8009514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8009828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8010135Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8010246Z Execution Analysis: .......... 2025-03-14T06:00:22.8010541Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8010758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8011061Z pt-xla-profiler: TransferFromDeviceTime too frequent: 211 counts during 202 steps 2025-03-14T06:00:22.8011066Z 2025-03-14T06:00:22.8011273Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8011406Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8011702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8011837Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8012045Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8012214Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8012362Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8012552Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8012916Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8013285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8013599Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8013895Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8014208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8014526Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8014824Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8014970Z Execution Analysis: (:1) 2025-03-14T06:00:22.8015236Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8015458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8015462Z 2025-03-14T06:00:22.8015669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8015803Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8016042Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8016172Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8016384Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8016584Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8016738Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8016925Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8017522Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8018116Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8018483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8018858Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8019179Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8019588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8020022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8020291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8020652Z Execution Analysis: .......... 2025-03-14T06:00:22.8020925Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8021129Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8021428Z pt-xla-profiler: TransferFromDeviceTime too frequent: 213 counts during 203 steps 2025-03-14T06:00:22.8021432Z 2025-03-14T06:00:22.8021637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8021768Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8022058Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8022185Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8022386Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8022544Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8022687Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8022870Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8023221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8023576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8023885Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8024166Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8024493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8024775Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8025063Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8025203Z Execution Analysis: (:1) 2025-03-14T06:00:22.8025459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8025678Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8025683Z 2025-03-14T06:00:22.8025893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8026009Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8026247Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8026383Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8026600Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8026747Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8026894Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8027079Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8027672Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8028235Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8028598Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8028944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8029269Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8029566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8029882Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8030172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8030297Z Execution Analysis: .......... 2025-03-14T06:00:22.8030551Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8030765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8031044Z pt-xla-profiler: TransferFromDeviceTime too frequent: 214 counts during 204 steps 2025-03-14T06:00:22.8031049Z 2025-03-14T06:00:22.8031261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8031382Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8031680Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8031796Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8032009Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8032156Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8032311Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8032481Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8032940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8033269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8033574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8033858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8034163Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8034419Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8034706Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8034825Z Execution Analysis: (:1) 2025-03-14T06:00:22.8035080Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8035271Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8035275Z 2025-03-14T06:00:22.8035476Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8035584Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8035843Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8035950Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8036155Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8036291Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8036441Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8036604Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8037161Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8037695Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8038042Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8038372Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8038680Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8038960Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8039304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8039557Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8039669Z Execution Analysis: .......... 2025-03-14T06:00:22.8039910Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8040113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8040380Z pt-xla-profiler: TransferFromDeviceTime too frequent: 215 counts during 205 steps 2025-03-14T06:00:22.8040398Z 2025-03-14T06:00:22.8040591Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8040704Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8040986Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8041090Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8041297Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8041437Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8041585Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8041747Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8042096Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8042423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8042727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8043008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8043307Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8043570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8043844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8043976Z Execution Analysis: (:1) 2025-03-14T06:00:22.8044221Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8044424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8044428Z 2025-03-14T06:00:22.8044756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8045081Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8045321Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8045452Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8045660Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8045818Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8045970Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8046155Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8046750Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8047342Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8047705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8048077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8048421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8048743Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8049056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8049345Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8049455Z Execution Analysis: .......... 2025-03-14T06:00:22.8049736Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8049942Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8050244Z pt-xla-profiler: TransferFromDeviceTime too frequent: 216 counts during 206 steps 2025-03-14T06:00:22.8050253Z 2025-03-14T06:00:22.8050458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8050590Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8050883Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8051013Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8051221Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8051383Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8051529Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8051712Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8052074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8052442Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8052800Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8053097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8053407Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8053692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8053988Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8054130Z Execution Analysis: (:1) 2025-03-14T06:00:22.8054393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8054614Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8054619Z 2025-03-14T06:00:22.8054857Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8054989Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8055226Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8055354Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8055567Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8055731Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8055883Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8056072Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8056673Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8057372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8057732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8058117Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8058426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8058739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8059046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8059326Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8059435Z Execution Analysis: .......... 2025-03-14T06:00:22.8059707Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8059910Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8060212Z pt-xla-profiler: TransferFromDeviceTime too frequent: 217 counts during 207 steps 2025-03-14T06:00:22.8060218Z 2025-03-14T06:00:22.8060432Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8060550Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8060853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8060967Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8061187Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8061336Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8061493Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8061664Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8062033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8062408Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8062732Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8063005Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8063327Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8063593Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8063896Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8064022Z Execution Analysis: (:1) 2025-03-14T06:00:22.8064293Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8064497Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8064526Z 2025-03-14T06:00:22.8064742Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8064858Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8065099Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8065209Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8065539Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8065850Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8066014Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8066184Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8066790Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8067372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8067749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8068164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8068528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8068809Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8069134Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8069405Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8069525Z Execution Analysis: .......... 2025-03-14T06:00:22.8069784Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8070004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8070295Z pt-xla-profiler: TransferFromDeviceTime too frequent: 218 counts during 208 steps 2025-03-14T06:00:22.8070300Z 2025-03-14T06:00:22.8070517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8070636Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8070946Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8071059Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8071282Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8071432Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8071589Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8071762Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8072182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8072543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8072874Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8073152Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8073477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8073748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8074053Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8074180Z Execution Analysis: (:1) 2025-03-14T06:00:22.8074455Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8074699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8074706Z 2025-03-14T06:00:22.8074923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8075041Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8075290Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8075404Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8075622Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8075771Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8075933Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8076105Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8076715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8077302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8077721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8078328Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8078623Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8078893Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8079182Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8079451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8079554Z Execution Analysis: .......... 2025-03-14T06:00:22.8079812Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8080006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8080292Z pt-xla-profiler: TransferFromDeviceTime too frequent: 219 counts during 209 steps 2025-03-14T06:00:22.8080296Z 2025-03-14T06:00:22.8080489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8080613Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8080885Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8081003Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8081193Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8081342Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8081477Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8081651Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8082007Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8082348Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8082642Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8083084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8083386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8083663Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8083950Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8084086Z Execution Analysis: (:1) 2025-03-14T06:00:22.8084368Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8084668Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8084676Z 2025-03-14T06:00:22.8084876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8085171Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8085407Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8085536Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8085741Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8085900Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8086050Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8086237Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8086833Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8087456Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8087845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8088214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8088530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8088817Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8089126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8089409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8089520Z Execution Analysis: .......... 2025-03-14T06:00:22.8089796Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8090004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8090306Z pt-xla-profiler: TransferFromDeviceTime too frequent: 220 counts during 210 steps 2025-03-14T06:00:22.8090311Z 2025-03-14T06:00:22.8090517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8090645Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8090936Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8091062Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8091267Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8091426Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8091574Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8091783Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8092148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8092514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8092833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8093125Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8093436Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8093724Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8094021Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8094188Z Execution Analysis: (:1) 2025-03-14T06:00:22.8094454Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8094677Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8094681Z 2025-03-14T06:00:22.8094900Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8095018Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8095252Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8095379Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8095587Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8095746Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8095896Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8096078Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8096678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8097304Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8097702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8098059Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8098387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8098664Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8098996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8099273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8099395Z Execution Analysis: .......... 2025-03-14T06:00:22.8099661Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8099882Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8100172Z pt-xla-profiler: TransferFromDeviceTime too frequent: 221 counts during 211 steps 2025-03-14T06:00:22.8100180Z 2025-03-14T06:00:22.8100402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8100521Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8100828Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8100949Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8101172Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8101348Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8101511Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8101688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8102063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8102422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8102755Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8103035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8103363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8103638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8103979Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8104110Z Execution Analysis: (:1) 2025-03-14T06:00:22.8104390Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8104603Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8104609Z 2025-03-14T06:00:22.8104830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8104950Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8105202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8105317Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8105544Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8105695Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8105862Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8106148Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8106773Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8107457Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8107811Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8108144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8108450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8108710Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8109016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8109269Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8109386Z Execution Analysis: .......... 2025-03-14T06:00:22.8109627Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8109832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8110098Z pt-xla-profiler: TransferFromDeviceTime too frequent: 222 counts during 212 steps 2025-03-14T06:00:22.8110103Z 2025-03-14T06:00:22.8110307Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8110418Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8110701Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8110806Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8111036Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8111174Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8111320Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8111477Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8111827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8112153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8112457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8112716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8113016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8113267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8113596Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8113716Z Execution Analysis: (:1) 2025-03-14T06:00:22.8113977Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8114181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8114185Z 2025-03-14T06:00:22.8114375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8114499Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8114719Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8114843Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8115207Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8115366Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8115512Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8115721Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8116471Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8117087Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8117454Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8117826Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8118143Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8118434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8118748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8119036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8119146Z Execution Analysis: .......... 2025-03-14T06:00:22.8119425Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8119636Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8119936Z pt-xla-profiler: TransferFromDeviceTime too frequent: 223 counts during 213 steps 2025-03-14T06:00:22.8119941Z 2025-03-14T06:00:22.8120147Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8120280Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8120575Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8120729Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8120938Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8121103Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8121249Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8121436Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8121797Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8122165Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8122480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8122771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8123082Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8123396Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8123694Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8123835Z Execution Analysis: (:1) 2025-03-14T06:00:22.8124100Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8124316Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8124321Z 2025-03-14T06:00:22.8124604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8124739Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8124975Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8125108Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8125317Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8125481Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8125660Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8125846Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8126465Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8127055Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8127415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8127780Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8128096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8128387Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8128697Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8128983Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8129096Z Execution Analysis: .......... 2025-03-14T06:00:22.8129368Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8129572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8129874Z pt-xla-profiler: TransferFromDeviceTime too frequent: 224 counts during 214 steps 2025-03-14T06:00:22.8129879Z 2025-03-14T06:00:22.8130096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8130214Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8130547Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8130663Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8130884Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8131029Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8131175Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8131356Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8131717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8132083Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8132408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8132685Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8133037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8133311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8133615Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8133744Z Execution Analysis: (:1) 2025-03-14T06:00:22.8134017Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8134222Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8134226Z 2025-03-14T06:00:22.8134442Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8134561Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8134808Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8134923Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8135148Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8135321Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8135489Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8135660Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8136306Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8136892Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8137271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8137629Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8137962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8138241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8138566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8138840Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8138962Z Execution Analysis: .......... 2025-03-14T06:00:22.8139223Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8139440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8145251Z pt-xla-profiler: TransferFromDeviceTime too frequent: 225 counts during 215 steps 2025-03-14T06:00:22.8145273Z 2025-03-14T06:00:22.8145564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8145778Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8146092Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8146208Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8146428Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8146582Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8146734Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8146910Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8147281Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8147638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8148069Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8148480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8148770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8149024Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8149301Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8149417Z Execution Analysis: (:1) 2025-03-14T06:00:22.8149665Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8149856Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8149861Z 2025-03-14T06:00:22.8150057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8150164Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8150386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8150490Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8150718Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8150852Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8150995Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8151180Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8151740Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8152274Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8152613Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8152944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8153242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8153500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8153792Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8154041Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8154147Z Execution Analysis: .......... 2025-03-14T06:00:22.8154387Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8154581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8154845Z pt-xla-profiler: TransferFromDeviceTime too frequent: 226 counts during 216 steps 2025-03-14T06:00:22.8154852Z 2025-03-14T06:00:22.8155088Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8155198Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8155472Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8155573Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8155770Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8155902Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8156039Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8156192Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8156532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8156854Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8157176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8157429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8157720Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8157974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8158244Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8158363Z Execution Analysis: (:1) 2025-03-14T06:00:22.8158601Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8158791Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8158796Z 2025-03-14T06:00:22.8158981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8159090Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8159302Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8159434Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8159623Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8159782Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8159919Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8160076Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8160621Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8161155Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8161485Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8161817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8162109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8162370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8162654Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8162907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8163005Z Execution Analysis: .......... 2025-03-14T06:00:22.8163251Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8163435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8163731Z pt-xla-profiler: TransferFromDeviceTime too frequent: 227 counts during 217 steps 2025-03-14T06:00:22.8163736Z 2025-03-14T06:00:22.8163925Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8164038Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8164308Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8164417Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8164704Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8164849Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8165150Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8165461Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8165856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8166222Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8166609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8166898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8167208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8167490Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8167783Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8167925Z Execution Analysis: (:1) 2025-03-14T06:00:22.8168184Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8168404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8168410Z 2025-03-14T06:00:22.8168612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8168776Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8169003Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8169125Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8169361Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8169518Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8169664Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8169838Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8170427Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8171009Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8171371Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8171734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8172044Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8172321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8172627Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8172902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8173008Z Execution Analysis: .......... 2025-03-14T06:00:22.8173272Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8173474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8173804Z pt-xla-profiler: TransferFromDeviceTime too frequent: 228 counts during 218 steps 2025-03-14T06:00:22.8173813Z 2025-03-14T06:00:22.8174025Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8174136Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8174433Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8174544Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8174758Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8174899Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8175045Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8175213Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8175581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8175967Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8176287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8176562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8176880Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8177257Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8177652Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8177764Z Execution Analysis: (:1) 2025-03-14T06:00:22.8178011Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8178197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8178205Z 2025-03-14T06:00:22.8178395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8178599Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8178822Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8178948Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8179144Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8179275Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8179419Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8179573Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8180310Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8181034Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8181405Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8181753Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8182073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8182344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8182657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8182924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8183038Z Execution Analysis: .......... 2025-03-14T06:00:22.8183294Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8183531Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8183818Z pt-xla-profiler: TransferFromDeviceTime too frequent: 229 counts during 219 steps 2025-03-14T06:00:22.8183823Z 2025-03-14T06:00:22.8184035Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8184145Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8184440Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8184550Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8184759Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8184902Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8185059Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8185230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8185634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8185990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8186317Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8186596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8186919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8187192Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8187499Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8187629Z Execution Analysis: (:1) 2025-03-14T06:00:22.8187904Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8188114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8188156Z 2025-03-14T06:00:22.8188373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8188491Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8188777Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8188892Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8189117Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8189265Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8189429Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8189602Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8190212Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8190796Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8191178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8191537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8191876Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8192168Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8192482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8192769Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8192880Z Execution Analysis: .......... 2025-03-14T06:00:22.8193185Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8193395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8193701Z pt-xla-profiler: TransferFromDeviceTime too frequent: 230 counts during 220 steps 2025-03-14T06:00:22.8193708Z 2025-03-14T06:00:22.8193918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8194054Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8194348Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8194479Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8194689Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8194852Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8195000Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8195215Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8195581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8195953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8196272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8196565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8196879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8197164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8197462Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8197603Z Execution Analysis: (:1) 2025-03-14T06:00:22.8197873Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8198117Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8198122Z 2025-03-14T06:00:22.8198327Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8198506Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8198742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8198870Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8199076Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8199232Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8199381Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8199563Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8200161Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8200754Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8201121Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8201488Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8201803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8202090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8202401Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8202685Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8202931Z Execution Analysis: .......... 2025-03-14T06:00:22.8203199Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8203402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8203698Z pt-xla-profiler: TransferFromDeviceTime too frequent: 231 counts during 221 steps 2025-03-14T06:00:22.8203703Z 2025-03-14T06:00:22.8203901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8204029Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8204314Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8204443Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8204749Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8205071Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8205253Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8205441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8205802Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8206173Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8206487Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8206777Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8207087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8207371Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8207667Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8207812Z Execution Analysis: (:1) 2025-03-14T06:00:22.8208076Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8208320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8208325Z 2025-03-14T06:00:22.8208556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8208689Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8208923Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8209048Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8209257Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8209415Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8209565Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8209751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8210345Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8210934Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8211311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8211667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8211998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8212278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8212602Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8213244Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8213381Z Execution Analysis: .......... 2025-03-14T06:00:22.8213644Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8213868Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8214158Z pt-xla-profiler: TransferFromDeviceTime too frequent: 232 counts during 222 steps 2025-03-14T06:00:22.8214163Z 2025-03-14T06:00:22.8214384Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8214505Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8214813Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8214926Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8215149Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8215325Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8215486Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8215657Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8216030Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8216387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8216712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8216988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8217403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8217657Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8217946Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8218066Z Execution Analysis: (:1) 2025-03-14T06:00:22.8218346Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8218562Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8218567Z 2025-03-14T06:00:22.8218768Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8218877Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8219107Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8219211Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8219414Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8219550Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8219701Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8219862Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8220426Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8220960Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8221308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8221638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8221942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8222197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8222520Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8222771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8222886Z Execution Analysis: .......... 2025-03-14T06:00:22.8223128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8223331Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8223596Z pt-xla-profiler: TransferFromDeviceTime too frequent: 234 counts during 223 steps 2025-03-14T06:00:22.8223601Z 2025-03-14T06:00:22.8223802Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8223912Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8224195Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8224327Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8224537Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8224676Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8224824Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8224983Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8225331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8225661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8225965Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8226222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8226522Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8226780Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8227071Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8227230Z Execution Analysis: (:1) 2025-03-14T06:00:22.8227488Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8227701Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8227719Z 2025-03-14T06:00:22.8227909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8228034Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8228250Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8228367Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8228558Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8228708Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8228851Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8229023Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8229569Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8230112Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8230448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8230790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8231084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8231378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8231665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8231934Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8232032Z Execution Analysis: .......... 2025-03-14T06:00:22.8232288Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8232476Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8232754Z pt-xla-profiler: TransferFromDeviceTime too frequent: 235 counts during 224 steps 2025-03-14T06:00:22.8232758Z 2025-03-14T06:00:22.8232946Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8233066Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8233333Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8233478Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8233668Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8233815Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8233947Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8234120Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8234453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8234788Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8235075Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8235344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8235627Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8235894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8236189Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8236316Z Execution Analysis: (:1) 2025-03-14T06:00:22.8236583Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8236784Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8236788Z 2025-03-14T06:00:22.8236974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8237097Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8237310Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8237432Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8237625Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8237772Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8237911Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8238081Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8238633Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8239181Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8239514Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8239851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8240143Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8240436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8240720Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8240979Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8241081Z Execution Analysis: .......... 2025-03-14T06:00:22.8241327Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8241517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8241793Z pt-xla-profiler: TransferFromDeviceTime too frequent: 236 counts during 225 steps 2025-03-14T06:00:22.8241798Z 2025-03-14T06:00:22.8241996Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8242125Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8242407Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8242509Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8242696Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8242838Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8242970Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8243135Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8243464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8243796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8244095Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8244348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8244739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8245196Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8245503Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8245651Z Execution Analysis: (:1) 2025-03-14T06:00:22.8245924Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8246123Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8246128Z 2025-03-14T06:00:22.8246338Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8246447Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8246690Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8246805Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8247025Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8247169Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8247327Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8247495Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8248096Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8248664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8249035Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8249385Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8249738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8250013Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8250332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8250601Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8250721Z Execution Analysis: .......... 2025-03-14T06:00:22.8250977Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8251192Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8251477Z pt-xla-profiler: TransferFromDeviceTime too frequent: 237 counts during 226 steps 2025-03-14T06:00:22.8251482Z 2025-03-14T06:00:22.8251696Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8251843Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8252148Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8252258Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8252476Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8252622Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8252779Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8252946Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8253317Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8253666Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8253992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8254269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8254621Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8254889Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8255223Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8255349Z Execution Analysis: (:1) 2025-03-14T06:00:22.8255621Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8255821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8255825Z 2025-03-14T06:00:22.8256039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8256152Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8256400Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8256510Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8256729Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8256871Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8257032Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8257303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8257855Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8258388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8258729Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8259078Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8259381Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8259634Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8259930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8260178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8260289Z Execution Analysis: .......... 2025-03-14T06:00:22.8260528Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8260722Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8260995Z pt-xla-profiler: TransferFromDeviceTime too frequent: 238 counts during 227 steps 2025-03-14T06:00:22.8261035Z 2025-03-14T06:00:22.8261221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8261344Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8261613Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8261726Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8261914Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8262060Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8262189Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8262355Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8262683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8263020Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8263310Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8263600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8263883Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8264174Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8264442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8264572Z Execution Analysis: (:1) 2025-03-14T06:00:22.8264808Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8265009Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8265013Z 2025-03-14T06:00:22.8265197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8265559Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8265952Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8266078Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8266338Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8266495Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8266638Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8266821Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8267412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8268000Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8268430Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8268801Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8269118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8269407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8269713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8269997Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8270104Z Execution Analysis: .......... 2025-03-14T06:00:22.8270377Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8270578Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8270917Z pt-xla-profiler: TransferFromDeviceTime too frequent: 239 counts during 228 steps 2025-03-14T06:00:22.8270923Z 2025-03-14T06:00:22.8271127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8271256Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8271547Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8271671Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8271874Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8272033Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8272174Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8272357Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8272716Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8273085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8273401Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8273726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8274068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8274353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8274645Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8274782Z Execution Analysis: (:1) 2025-03-14T06:00:22.8275044Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8275263Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8275270Z 2025-03-14T06:00:22.8275474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8275601Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8275834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8275960Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8276171Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8276328Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8276474Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8276656Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8277244Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8277834Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8278223Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8278590Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8278918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8279197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8279514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8279788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8279904Z Execution Analysis: .......... 2025-03-14T06:00:22.8280167Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8280383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8280700Z pt-xla-profiler: TransferFromDeviceTime too frequent: 240 counts during 229 steps 2025-03-14T06:00:22.8280706Z 2025-03-14T06:00:22.8280918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8281038Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8281338Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8281451Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8281667Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8281816Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8281968Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8282140Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8282509Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8282868Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8283215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8283493Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8283832Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8284102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8284398Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8284587Z Execution Analysis: (:1) 2025-03-14T06:00:22.8284858Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8285066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8285072Z 2025-03-14T06:00:22.8285282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8285404Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8285646Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8285760Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8285971Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8286115Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8286271Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8286441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8287038Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8287647Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8288018Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8288370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8288695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8288969Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8289287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8289559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8289677Z Execution Analysis: .......... 2025-03-14T06:00:22.8289938Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8290181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8290471Z pt-xla-profiler: TransferFromDeviceTime too frequent: 241 counts during 230 steps 2025-03-14T06:00:22.8290477Z 2025-03-14T06:00:22.8290694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8290810Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8291112Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8291224Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8291438Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8291586Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8291739Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8291908Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8292277Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8292655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8292977Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8293278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8293599Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8293870Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8294172Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8294294Z Execution Analysis: (:1) 2025-03-14T06:00:22.8294566Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8294772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8294788Z 2025-03-14T06:00:22.8294990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8295116Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8295352Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8295463Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8295680Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8295822Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8295979Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8296145Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8296751Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8297376Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8297745Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8298108Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8298422Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8298710Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8299019Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8299297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8299406Z Execution Analysis: .......... 2025-03-14T06:00:22.8299703Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8299911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8300213Z pt-xla-profiler: TransferFromDeviceTime too frequent: 242 counts during 231 steps 2025-03-14T06:00:22.8300220Z 2025-03-14T06:00:22.8300428Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8300553Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8300848Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8300969Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8301173Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8301325Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8301469Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8301653Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8302012Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8302404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8302745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8303033Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8303343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8303622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8303918Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8304057Z Execution Analysis: (:1) 2025-03-14T06:00:22.8304324Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8304549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8304554Z 2025-03-14T06:00:22.8304760Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8304889Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8305125Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8305247Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8305452Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8305607Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8305752Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8305933Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8306547Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8307136Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8307505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8307866Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8308180Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8308466Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8308772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8309057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8309190Z Execution Analysis: .......... 2025-03-14T06:00:22.8309461Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8309664Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8309966Z pt-xla-profiler: TransferFromDeviceTime too frequent: 243 counts during 232 steps 2025-03-14T06:00:22.8309971Z 2025-03-14T06:00:22.8310171Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8310298Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8310590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8310712Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8310917Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8311071Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8311218Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8311425Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8311785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8312172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8312488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8312770Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8313078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8313356Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8313662Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8313789Z Execution Analysis: (:1) 2025-03-14T06:00:22.8314061Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8314265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8314269Z 2025-03-14T06:00:22.8314488Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8314605Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8314858Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8314972Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8315191Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8315339Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8315504Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8315678Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8316412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8316982Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8317349Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8317798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8318104Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8318362Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8318661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8318946Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8319062Z Execution Analysis: .......... 2025-03-14T06:00:22.8319307Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8319515Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8319784Z pt-xla-profiler: TransferFromDeviceTime too frequent: 244 counts during 233 steps 2025-03-14T06:00:22.8319788Z 2025-03-14T06:00:22.8319993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8320104Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8320389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8320499Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8320708Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8320850Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8321026Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8321186Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8321558Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8321889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8322190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8322447Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8322750Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8323005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8323298Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8323419Z Execution Analysis: (:1) 2025-03-14T06:00:22.8323678Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8323871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8323875Z 2025-03-14T06:00:22.8324081Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8324192Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8324425Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8324596Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8324804Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8325108Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8325274Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8325473Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8326081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8326658Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8327039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8327392Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8327715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8327991Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8328442Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8328714Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8328835Z Execution Analysis: .......... 2025-03-14T06:00:22.8329094Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8329313Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8329601Z pt-xla-profiler: TransferFromDeviceTime too frequent: 245 counts during 234 steps 2025-03-14T06:00:22.8329619Z 2025-03-14T06:00:22.8329824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8329954Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8330245Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8330373Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8330583Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8330767Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8330916Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8331086Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8331497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8331864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8332179Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8332468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8332779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8333071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8333368Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8333509Z Execution Analysis: (:1) 2025-03-14T06:00:22.8333769Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8333984Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8333989Z 2025-03-14T06:00:22.8334195Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8334321Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8334554Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8334675Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8334883Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8335071Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8335223Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8335406Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8336003Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8336591Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8336955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8337418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8337710Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8338008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8338296Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8338564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8338666Z Execution Analysis: .......... 2025-03-14T06:00:22.8338920Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8339111Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8339388Z pt-xla-profiler: TransferFromDeviceTime too frequent: 246 counts during 235 steps 2025-03-14T06:00:22.8339393Z 2025-03-14T06:00:22.8339584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8339705Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8339977Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8340096Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8340311Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8340458Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8340593Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8340785Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8341118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8341456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8341748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8342017Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8342308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8342570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8342844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8342970Z Execution Analysis: (:1) 2025-03-14T06:00:22.8343212Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8343414Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8343419Z 2025-03-14T06:00:22.8343608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8343728Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8343946Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8344061Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8344279Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8344427Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8344568Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8344737Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8345285Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8345827Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8346164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8346503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8346819Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8347087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8347384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8347636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8347751Z Execution Analysis: .......... 2025-03-14T06:00:22.8347990Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8348187Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8348455Z pt-xla-profiler: TransferFromDeviceTime too frequent: 247 counts during 236 steps 2025-03-14T06:00:22.8348460Z 2025-03-14T06:00:22.8348657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8348766Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8349048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8349176Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8349379Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8349541Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8349686Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8349844Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8350190Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8350519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8350822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8351081Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8351381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8351635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8351918Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8352041Z Execution Analysis: (:1) 2025-03-14T06:00:22.8352298Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8352489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8352493Z 2025-03-14T06:00:22.8352698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8352809Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8353037Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8353178Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8353385Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8353523Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8353671Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8353832Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8354391Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8355087Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8355451Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8355798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8356311Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8356591Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8356914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8357189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8357311Z Execution Analysis: .......... 2025-03-14T06:00:22.8357570Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8357784Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8358074Z pt-xla-profiler: TransferFromDeviceTime too frequent: 248 counts during 237 steps 2025-03-14T06:00:22.8358078Z 2025-03-14T06:00:22.8358297Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8358415Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8358746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8358863Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8359103Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8359250Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8359407Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8359579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8359955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8360312Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8360639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8360923Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8361251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8361525Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8361836Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8361965Z Execution Analysis: (:1) 2025-03-14T06:00:22.8362241Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8362449Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8362454Z 2025-03-14T06:00:22.8362672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8362792Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8363064Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8363184Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8363407Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8363554Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8363720Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8363893Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8364585Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8365167Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8365691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8366127Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8366449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8366738Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8367052Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8367335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8367446Z Execution Analysis: .......... 2025-03-14T06:00:22.8367719Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8367926Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8368230Z pt-xla-profiler: TransferFromDeviceTime too frequent: 249 counts during 238 steps 2025-03-14T06:00:22.8368238Z 2025-03-14T06:00:22.8368445Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8368628Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8368924Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8369074Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8369283Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8369443Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8369587Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8369770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8370131Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8370497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8370816Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8371106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8371416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8371696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8371991Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8372128Z Execution Analysis: (:1) 2025-03-14T06:00:22.8372387Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8372602Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8372606Z 2025-03-14T06:00:22.8372811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8372976Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8373215Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8373336Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8373543Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8373699Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8373847Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8374029Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8374624Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8375207Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8375598Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8375970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8376286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8376576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8376887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8377275Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8377381Z Execution Analysis: .......... 2025-03-14T06:00:22.8377751Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8377943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8378223Z pt-xla-profiler: TransferFromDeviceTime too frequent: 250 counts during 239 steps 2025-03-14T06:00:22.8378251Z 2025-03-14T06:00:22.8378443Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8378562Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8378856Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8378974Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8379164Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8379314Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8379451Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8379623Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8379960Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8380305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8380597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8380865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8381156Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8381416Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8381690Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8381819Z Execution Analysis: (:1) 2025-03-14T06:00:22.8382059Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8382260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8382265Z 2025-03-14T06:00:22.8382490Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8382601Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8382830Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8382935Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8383141Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8383277Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8383425Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8383582Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8384139Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8384669Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8385042Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8385369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8385672Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8385926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8386222Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8386471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8386584Z Execution Analysis: .......... 2025-03-14T06:00:22.8386824Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8387030Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8387299Z pt-xla-profiler: TransferFromDeviceTime too frequent: 251 counts during 240 steps 2025-03-14T06:00:22.8387328Z 2025-03-14T06:00:22.8387529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8387661Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8387941Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8388047Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8388251Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8388387Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8388532Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8388687Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8389029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8389358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8389659Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8389916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8390213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8390465Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8390748Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8390866Z Execution Analysis: (:1) 2025-03-14T06:00:22.8391116Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8391333Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8391338Z 2025-03-14T06:00:22.8391540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8391651Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8391879Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8391985Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8392188Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8392323Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8392474Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8392633Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8393192Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8393754Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8394102Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8394432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8394736Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8394993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8395290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8395538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8395651Z Execution Analysis: .......... 2025-03-14T06:00:22.8396068Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8396284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8396590Z pt-xla-profiler: TransferFromDeviceTime too frequent: 252 counts during 241 steps 2025-03-14T06:00:22.8396606Z 2025-03-14T06:00:22.8396831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8396947Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8397244Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8397356Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8397567Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8397708Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8397861Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8398027Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8398391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8398736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8399052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8399334Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8399636Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8399911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8400194Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8400329Z Execution Analysis: (:1) 2025-03-14T06:00:22.8400583Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8400828Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8400834Z 2025-03-14T06:00:22.8401034Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8401164Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8401396Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8401521Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8401726Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8401883Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8402029Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8402211Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8402794Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8403415Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8403773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8404136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8404447Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8404821Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8405295Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8405583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8405695Z Execution Analysis: .......... 2025-03-14T06:00:22.8405972Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8406211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8406513Z pt-xla-profiler: TransferFromDeviceTime too frequent: 253 counts during 242 steps 2025-03-14T06:00:22.8406543Z 2025-03-14T06:00:22.8406753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8406886Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8407182Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8407313Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8407520Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8407682Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8407831Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8408022Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8408385Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8408754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8409072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8409367Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8409680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8409970Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8410267Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8410410Z Execution Analysis: (:1) 2025-03-14T06:00:22.8410696Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8410915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8410920Z 2025-03-14T06:00:22.8411130Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8411262Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8411497Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8411623Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8411828Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8411987Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8412135Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8412321Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8412940Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8413529Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8413892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8414262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8414576Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8414867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8415175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8415459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8415570Z Execution Analysis: .......... 2025-03-14T06:00:22.8415869Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8416076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8416403Z pt-xla-profiler: TransferFromDeviceTime too frequent: 255 counts during 243 steps 2025-03-14T06:00:22.8416408Z 2025-03-14T06:00:22.8416625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8416743Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8417048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8417268Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8417482Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8417628Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8417785Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8417955Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8418319Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8418665Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8418986Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8419257Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8419571Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8419836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8420134Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8420287Z Execution Analysis: (:1) 2025-03-14T06:00:22.8420554Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8420754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8420758Z 2025-03-14T06:00:22.8420972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8421085Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8421325Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8421435Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8421648Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8421791Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8422113Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8422315Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8422923Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8423503Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8423880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8424235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8424563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8424844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8425167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8425447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8425594Z Execution Analysis: .......... 2025-03-14T06:00:22.8425856Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8426098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8426387Z pt-xla-profiler: TransferFromDeviceTime too frequent: 256 counts during 244 steps 2025-03-14T06:00:22.8426392Z 2025-03-14T06:00:22.8426610Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8426727Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8427036Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8427148Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8427372Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8427517Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8427677Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8427847Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8428223Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8428579Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8428907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8429186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8429508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8429778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8430110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8430239Z Execution Analysis: (:1) 2025-03-14T06:00:22.8430510Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8430719Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8430724Z 2025-03-14T06:00:22.8430939Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8431056Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8431300Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8431412Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8431630Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8431775Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8431964Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8432134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8432741Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8433321Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8433696Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8434062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8434376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8434665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8434979Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8435289Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8435398Z Execution Analysis: .......... 2025-03-14T06:00:22.8435693Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8435899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8436304Z pt-xla-profiler: TransferFromDeviceTime too frequent: 257 counts during 245 steps 2025-03-14T06:00:22.8436309Z 2025-03-14T06:00:22.8436508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8436636Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8436919Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8437045Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8437247Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8437404Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8437652Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8437824Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8438158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8438500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8438792Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8439060Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8439346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8439653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8439931Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8440066Z Execution Analysis: (:1) 2025-03-14T06:00:22.8440310Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8440518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8440522Z 2025-03-14T06:00:22.8440712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8440834Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8441049Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8441166Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8441360Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8441540Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8441682Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8441853Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8442400Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8442949Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8443284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8443626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8443918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8444192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8444570Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8444839Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8445140Z Execution Analysis: .......... 2025-03-14T06:00:22.8445418Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8445630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8445933Z pt-xla-profiler: TransferFromDeviceTime too frequent: 258 counts during 246 steps 2025-03-14T06:00:22.8445938Z 2025-03-14T06:00:22.8446144Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8446278Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8446577Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8446709Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8446917Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8447078Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8447226Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8447412Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8447772Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8448139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8448458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8448747Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8449082Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8449373Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8449671Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8449812Z Execution Analysis: (:1) 2025-03-14T06:00:22.8450074Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8450291Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8450295Z 2025-03-14T06:00:22.8450513Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8450634Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8450881Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8451018Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8451228Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8451395Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8451542Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8451726Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8452319Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8452906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8453279Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8453633Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8453965Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8454242Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8454592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8455109Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8455232Z Execution Analysis: .......... 2025-03-14T06:00:22.8455493Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8455711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8455998Z pt-xla-profiler: TransferFromDeviceTime too frequent: 259 counts during 247 steps 2025-03-14T06:00:22.8456002Z 2025-03-14T06:00:22.8456219Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8456339Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8456644Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8456758Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8456979Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8457236Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8457381Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8457540Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8457885Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8458211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8458512Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8458769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8459090Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8459344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8459629Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8459747Z Execution Analysis: (:1) 2025-03-14T06:00:22.8460000Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8460190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8460194Z 2025-03-14T06:00:22.8460395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8460506Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8460761Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8460868Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8461076Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8461213Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8461365Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8461525Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8462089Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8462624Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8462970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8463295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8463601Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8463884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8464206Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8464459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8464573Z Execution Analysis: .......... 2025-03-14T06:00:22.8464816Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8465018Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8465401Z pt-xla-profiler: TransferFromDeviceTime too frequent: 260 counts during 248 steps 2025-03-14T06:00:22.8465405Z 2025-03-14T06:00:22.8465779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8465900Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8466213Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8466329Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8466551Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8466700Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8466863Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8467037Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8467414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8467772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8468102Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8468439Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8468768Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8469040Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8469355Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8469484Z Execution Analysis: (:1) 2025-03-14T06:00:22.8469762Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8469982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8469987Z 2025-03-14T06:00:22.8470193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8470358Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8470595Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8470722Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8470931Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8471089Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8471239Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8471422Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8472017Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8472606Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8472968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8473341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8473692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8473981Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8474339Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8474625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8474735Z Execution Analysis: .......... 2025-03-14T06:00:22.8475030Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8475236Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8475537Z pt-xla-profiler: TransferFromDeviceTime too frequent: 261 counts during 249 steps 2025-03-14T06:00:22.8475546Z 2025-03-14T06:00:22.8475753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8475883Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8476177Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8476305Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8476511Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8476672Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8476820Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8477006Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8477366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8477733Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8478167Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8478459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8478769Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8479058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8479353Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8479493Z Execution Analysis: (:1) 2025-03-14T06:00:22.8479754Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8479972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8479977Z 2025-03-14T06:00:22.8480209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8480341Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8480574Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8480705Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8480912Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8481070Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8481218Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8481402Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8481998Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8482586Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8482952Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8483352Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8483670Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8483987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8484301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8484683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8484796Z Execution Analysis: .......... 2025-03-14T06:00:22.8485074Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8485278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8485583Z pt-xla-profiler: TransferFromDeviceTime too frequent: 262 counts during 250 steps 2025-03-14T06:00:22.8485590Z 2025-03-14T06:00:22.8485807Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8485926Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8486233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8486348Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8486566Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8486725Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8486873Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8487060Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8487424Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8487822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8488154Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8488435Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8488763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8489038Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8489351Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8489481Z Execution Analysis: (:1) 2025-03-14T06:00:22.8489757Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8489963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8489993Z 2025-03-14T06:00:22.8490214Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8490334Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8490584Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8490701Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8490927Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8491077Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8491244Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8491418Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8492027Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8492605Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8492984Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8493365Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8493719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8494000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8494327Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8494602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8494731Z Execution Analysis: .......... 2025-03-14T06:00:22.8494994Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8495222Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8495513Z pt-xla-profiler: TransferFromDeviceTime too frequent: 263 counts during 251 steps 2025-03-14T06:00:22.8495518Z 2025-03-14T06:00:22.8495738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8495859Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8496161Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8496277Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8496500Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8496649Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8496811Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8496986Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8497391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8497744Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8498076Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8498355Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8498678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8498949Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8499259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8499387Z Execution Analysis: (:1) 2025-03-14T06:00:22.8499661Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8499894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8499900Z 2025-03-14T06:00:22.8500117Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8500233Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8500482Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8500597Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8500817Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8500964Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8501128Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8501300Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8501907Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8502484Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8502883Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8503270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8503600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8503878Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8504202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8504473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8504596Z Execution Analysis: .......... 2025-03-14T06:00:22.8504861Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8505079Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8505384Z pt-xla-profiler: TransferFromDeviceTime too frequent: 264 counts during 252 steps 2025-03-14T06:00:22.8505391Z 2025-03-14T06:00:22.8505597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8505729Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8506021Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8506146Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8506353Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8506513Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8506767Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8506953Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8507334Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8507696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8508004Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8508285Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8508588Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8508867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8509154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8509293Z Execution Analysis: (:1) 2025-03-14T06:00:22.8509547Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8509789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8509795Z 2025-03-14T06:00:22.8509995Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8510125Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8510353Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8510477Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8510678Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8510833Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8510981Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8511159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8511740Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8512313Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8512733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8513091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8513398Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8513680Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8513983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8514265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8514374Z Execution Analysis: .......... 2025-03-14T06:00:22.8514644Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8514847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8515144Z pt-xla-profiler: TransferFromDeviceTime too frequent: 265 counts during 253 steps 2025-03-14T06:00:22.8515149Z 2025-03-14T06:00:22.8515353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8515481Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8515766Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8515890Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8516092Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8516246Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8516391Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8516594Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8516947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8517306Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8517616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8517898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8518200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8518478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8518763Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8518926Z Execution Analysis: (:1) 2025-03-14T06:00:22.8519181Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8519395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8519400Z 2025-03-14T06:00:22.8519600Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8519725Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8519953Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8520074Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8520276Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8520430Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8520576Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8520754Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8521335Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8521933Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8522321Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8522669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8522989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8523258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8523572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8523841Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8523961Z Execution Analysis: .......... 2025-03-14T06:00:22.8524218Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8524433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8524803Z pt-xla-profiler: TransferFromDeviceTime too frequent: 266 counts during 254 steps 2025-03-14T06:00:22.8524810Z 2025-03-14T06:00:22.8525195Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8525315Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8525621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8525735Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8525956Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8526135Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8526295Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8526469Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8526842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8527195Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8527516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8532925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8533254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8533530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8533833Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8534045Z Execution Analysis: (:1) 2025-03-14T06:00:22.8534325Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8534529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8534540Z 2025-03-14T06:00:22.8534751Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8534864Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8535108Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8535220Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8535435Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8535579Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8535738Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8535909Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8536514Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8537153Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8537527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8537879Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8538202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8538474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8538787Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8539057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8539174Z Execution Analysis: .......... 2025-03-14T06:00:22.8539436Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8539649Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8539932Z pt-xla-profiler: TransferFromDeviceTime too frequent: 267 counts during 255 steps 2025-03-14T06:00:22.8539938Z 2025-03-14T06:00:22.8540147Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8540261Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8540561Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8540671Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8540917Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8541063Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8541215Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8541383Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8541757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8542110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8542428Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8542703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8543021Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8543286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8543618Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8543741Z Execution Analysis: (:1) 2025-03-14T06:00:22.8544008Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8544210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8544215Z 2025-03-14T06:00:22.8544423Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8544538Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8544780Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8544890Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8545103Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8545246Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8545401Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8545597Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8546195Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8546795Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8547163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8547516Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8547835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8548108Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8548422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8548691Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8548803Z Execution Analysis: .......... 2025-03-14T06:00:22.8549064Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8549270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8549558Z pt-xla-profiler: TransferFromDeviceTime too frequent: 268 counts during 256 steps 2025-03-14T06:00:22.8549564Z 2025-03-14T06:00:22.8549763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8549882Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8550170Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8550313Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8550516Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8550665Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8550805Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8550982Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8551337Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8551691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8552001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8552282Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8552587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8552906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8553196Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8553327Z Execution Analysis: (:1) 2025-03-14T06:00:22.8553585Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8553794Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8553799Z 2025-03-14T06:00:22.8553998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8554118Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8554348Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8554467Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8554671Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8554824Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8554996Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8555169Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8555786Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8556367Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8556725Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8557083Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8557503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8557781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8558081Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8558351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8558455Z Execution Analysis: .......... 2025-03-14T06:00:22.8558714Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8558909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8559190Z pt-xla-profiler: TransferFromDeviceTime too frequent: 269 counts during 257 steps 2025-03-14T06:00:22.8559195Z 2025-03-14T06:00:22.8559391Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8559506Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8559816Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8559932Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8560129Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8560275Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8560412Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8560585Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8560932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8561283Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8561583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8561857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8562190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8562461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8562743Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8562874Z Execution Analysis: (:1) 2025-03-14T06:00:22.8563123Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8563330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8563335Z 2025-03-14T06:00:22.8563531Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8563669Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8563895Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8564010Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8564210Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8564377Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8564608Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8564781Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8565774Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8566357Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8566720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8567071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8567395Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8567669Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8567986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8568256Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8568367Z Execution Analysis: .......... 2025-03-14T06:00:22.8568623Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8568832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8569117Z pt-xla-profiler: TransferFromDeviceTime too frequent: 270 counts during 258 steps 2025-03-14T06:00:22.8569123Z 2025-03-14T06:00:22.8569330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8569482Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8569783Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8569894Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8570101Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8570245Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8570393Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8570559Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8570921Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8571270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8571588Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8571897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8572209Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8572480Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8572779Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8572908Z Execution Analysis: (:1) 2025-03-14T06:00:22.8573181Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8573386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8573391Z 2025-03-14T06:00:22.8573607Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8573725Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8573973Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8574088Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8574345Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8574493Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8574656Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8574852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8575460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8576037Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8576416Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8576782Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8577118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8577508Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8577828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8578095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8578220Z Execution Analysis: .......... 2025-03-14T06:00:22.8578475Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8578693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8578977Z pt-xla-profiler: TransferFromDeviceTime too frequent: 271 counts during 259 steps 2025-03-14T06:00:22.8578984Z 2025-03-14T06:00:22.8579225Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8579345Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8579643Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8579757Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8579978Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8580124Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8580283Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8580453Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8580822Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8581169Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8581496Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8581795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8582116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8582386Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8582691Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8582819Z Execution Analysis: (:1) 2025-03-14T06:00:22.8583090Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8583290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8583308Z 2025-03-14T06:00:22.8583511Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8583646Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8583877Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8584028Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8584232Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8584401Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8584564Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8584733Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8585324Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8585901Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8586257Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8586622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8586932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8587222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8587695Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8587980Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8588088Z Execution Analysis: .......... 2025-03-14T06:00:22.8588359Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8588563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8588866Z pt-xla-profiler: TransferFromDeviceTime too frequent: 272 counts during 260 steps 2025-03-14T06:00:22.8588909Z 2025-03-14T06:00:22.8589116Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8589249Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8589543Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8589667Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8589873Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8590033Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8590177Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8590359Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8590721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8591086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8591430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8591720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8592031Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8592317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8592614Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8592759Z Execution Analysis: (:1) 2025-03-14T06:00:22.8593021Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8593239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8593243Z 2025-03-14T06:00:22.8593451Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8593608Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8593842Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8593970Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8594204Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8594364Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8594513Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8594696Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8595294Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8595882Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8596249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8596617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8596933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8597224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8597536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8597820Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8597930Z Execution Analysis: .......... 2025-03-14T06:00:22.8598203Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8598409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8598741Z pt-xla-profiler: TransferFromDeviceTime too frequent: 273 counts during 261 steps 2025-03-14T06:00:22.8598748Z 2025-03-14T06:00:22.8598955Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8599085Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8599379Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8599508Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8599716Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8599876Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8600022Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8600206Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8600567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8600959Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8601277Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8601567Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8601879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8602165Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8602472Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8602600Z Execution Analysis: (:1) 2025-03-14T06:00:22.8602873Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8603078Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8603084Z 2025-03-14T06:00:22.8603302Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8603445Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8603691Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8603829Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8604050Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8604195Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8604355Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8604617Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8605226Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8605807Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8606186Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8606541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8606872Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8607151Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8607475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8607749Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8607872Z Execution Analysis: .......... 2025-03-14T06:00:22.8608136Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8608384Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8608673Z pt-xla-profiler: TransferFromDeviceTime too frequent: 274 counts during 262 steps 2025-03-14T06:00:22.8608679Z 2025-03-14T06:00:22.8608898Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8609014Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8609321Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8609434Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8609651Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8609797Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8609953Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8610124Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8610523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8610879Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8611206Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8611486Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8611810Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8612083Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8612389Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8612517Z Execution Analysis: (:1) 2025-03-14T06:00:22.8612790Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8613001Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8613030Z 2025-03-14T06:00:22.8613249Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8613368Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8613639Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8613755Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8613977Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8614125Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8614293Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8614468Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8615077Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8615659Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8616037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8616396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8616727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8617003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8617328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8617600Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8617722Z Execution Analysis: .......... 2025-03-14T06:00:22.8618012Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8618233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8618524Z pt-xla-profiler: TransferFromDeviceTime too frequent: 276 counts during 263 steps 2025-03-14T06:00:22.8618543Z 2025-03-14T06:00:22.8618750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8618882Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8619176Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8619303Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8619513Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8619672Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8619930Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8620121Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8620485Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8620837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8621146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8621423Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8621727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8622001Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8622287Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8622418Z Execution Analysis: (:1) 2025-03-14T06:00:22.8622677Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8622885Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8622914Z 2025-03-14T06:00:22.8623114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8623273Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8623503Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8623619Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8623822Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8623975Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8624120Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8624295Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8624872Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8625445Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8625803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8626162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8626471Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8626753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8627056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8627328Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8627462Z Execution Analysis: .......... 2025-03-14T06:00:22.8627729Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8627930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8628222Z pt-xla-profiler: TransferFromDeviceTime too frequent: 277 counts during 264 steps 2025-03-14T06:00:22.8628227Z 2025-03-14T06:00:22.8628426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8628548Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8628834Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8628956Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8629157Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8629309Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8629475Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8629654Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8630002Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8630360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8630686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8630964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8631264Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8631540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8631825Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8631959Z Execution Analysis: (:1) 2025-03-14T06:00:22.8632213Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8632450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8632454Z 2025-03-14T06:00:22.8632744Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8632870Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8633094Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8633212Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8633408Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8633554Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8633694Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8633871Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8634449Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8635016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8635367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8635724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8636028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8636308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8636613Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8636904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8637020Z Execution Analysis: .......... 2025-03-14T06:00:22.8637274Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8637480Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8637760Z pt-xla-profiler: TransferFromDeviceTime too frequent: 278 counts during 265 steps 2025-03-14T06:00:22.8637766Z 2025-03-14T06:00:22.8637973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8638089Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8638379Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8638488Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8638694Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8638863Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8639013Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8639179Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8639537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8639885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8640200Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8640468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8640777Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8641044Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8641341Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8641464Z Execution Analysis: (:1) 2025-03-14T06:00:22.8641752Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8641971Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8641976Z 2025-03-14T06:00:22.8642173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8642284Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8642522Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8642632Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8642843Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8642985Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8643139Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8643307Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8643894Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8644456Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8645073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8645432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8645761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8646038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8646392Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8646664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8646789Z Execution Analysis: .......... 2025-03-14T06:00:22.8647048Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8647264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8647548Z pt-xla-profiler: TransferFromDeviceTime too frequent: 279 counts during 266 steps 2025-03-14T06:00:22.8647554Z 2025-03-14T06:00:22.8647768Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8647882Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8648183Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8648318Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8648538Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8648684Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8648834Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8649006Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8649377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8649729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8650050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8650327Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8650643Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8650915Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8651221Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8651373Z Execution Analysis: (:1) 2025-03-14T06:00:22.8651643Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8651867Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8651872Z 2025-03-14T06:00:22.8652084Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8652202Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8652440Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8652551Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8652764Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8652914Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8653070Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8653241Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8653843Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8654417Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8654787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8655150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8655463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8655749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8656083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8656369Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8656473Z Execution Analysis: .......... 2025-03-14T06:00:22.8656747Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8656947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8657246Z pt-xla-profiler: TransferFromDeviceTime too frequent: 280 counts during 267 steps 2025-03-14T06:00:22.8657250Z 2025-03-14T06:00:22.8657452Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8657580Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8657871Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8658022Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8658228Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8658386Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8658526Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8658708Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8659064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8659428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8659740Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8660027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8660335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8660623Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8660958Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8661096Z Execution Analysis: (:1) 2025-03-14T06:00:22.8661391Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8661608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8661612Z 2025-03-14T06:00:22.8661814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8661945Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8662178Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8662304Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8662512Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8662671Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8662821Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8663002Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8663595Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8664186Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8664550Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8664916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8665234Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8665718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8666033Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8666320Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8666431Z Execution Analysis: .......... 2025-03-14T06:00:22.8666708Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8666912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8667215Z pt-xla-profiler: TransferFromDeviceTime too frequent: 281 counts during 268 steps 2025-03-14T06:00:22.8667220Z 2025-03-14T06:00:22.8667425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8667594Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8667890Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8668020Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8668223Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8668382Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8668527Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8668710Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8669072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8669438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8669754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8670044Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8670356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8670676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8670969Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8671140Z Execution Analysis: (:1) 2025-03-14T06:00:22.8671405Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8671620Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8671625Z 2025-03-14T06:00:22.8671841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8671959Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8672204Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8672317Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8672537Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8672682Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8672840Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8673008Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8673613Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8674185Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8674559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8674912Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8675278Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8675551Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8675871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8676142Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8676263Z Execution Analysis: .......... 2025-03-14T06:00:22.8676520Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8676735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8677020Z pt-xla-profiler: TransferFromDeviceTime too frequent: 282 counts during 269 steps 2025-03-14T06:00:22.8677025Z 2025-03-14T06:00:22.8677239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8677380Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8677685Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8677795Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8678010Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8678154Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8678310Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8678481Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8678852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8679204Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8679532Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8679812Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8680159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8680428Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8680757Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8680883Z Execution Analysis: (:1) 2025-03-14T06:00:22.8681159Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8681361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8681366Z 2025-03-14T06:00:22.8681581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8681693Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8681942Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8682053Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8682270Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8682413Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8682573Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8682738Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8683340Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8683911Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8684280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8684736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8685065Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8685341Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8685668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8685941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8686063Z Execution Analysis: .......... 2025-03-14T06:00:22.8686320Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8686537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8686826Z pt-xla-profiler: TransferFromDeviceTime too frequent: 283 counts during 270 steps 2025-03-14T06:00:22.8686870Z 2025-03-14T06:00:22.8687076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8687193Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8687497Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8687608Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8687823Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8687969Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8688123Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8688293Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8688664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8689016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8689345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8689632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8689964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8690275Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8690566Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8690705Z Execution Analysis: (:1) 2025-03-14T06:00:22.8690966Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8691183Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8691187Z 2025-03-14T06:00:22.8691389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8691521Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8691752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8691880Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8692082Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8692240Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8692383Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8692564Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8693153Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8693736Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8694123Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8694494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8694808Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8695096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8695402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8695685Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8695788Z Execution Analysis: .......... 2025-03-14T06:00:22.8696062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8696266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8696605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 284 counts during 271 steps 2025-03-14T06:00:22.8696610Z 2025-03-14T06:00:22.8696811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8696940Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8697231Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8697355Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8697562Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8697720Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8697861Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8698043Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8698401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8698770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8699083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8699394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8699726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8700010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8700300Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8700443Z Execution Analysis: (:1) 2025-03-14T06:00:22.8700702Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8700924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8700930Z 2025-03-14T06:00:22.8701134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8701263Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8701494Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8701616Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8701819Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8701965Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8702109Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8702292Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8702884Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8703470Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8703858Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8704223Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8704541Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8704820Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8705130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8705411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8705519Z Execution Analysis: .......... 2025-03-14T06:00:22.8705789Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8705992Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8706319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 285 counts during 272 steps 2025-03-14T06:00:22.8706325Z 2025-03-14T06:00:22.8706541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8706656Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8706970Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8707086Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8707305Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8707452Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8707610Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8707784Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8708160Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8708520Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8709222Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8709501Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8709852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8710128Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8710437Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8710567Z Execution Analysis: (:1) 2025-03-14T06:00:22.8710842Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8711049Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8711058Z 2025-03-14T06:00:22.8711275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8711396Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8711646Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8711764Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8711988Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8712137Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8712300Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8712472Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8713087Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8713695Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8714076Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8714435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8714766Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8715046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8715373Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8715647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8715771Z Execution Analysis: .......... 2025-03-14T06:00:22.8716034Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8716287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8716580Z pt-xla-profiler: TransferFromDeviceTime too frequent: 286 counts during 273 steps 2025-03-14T06:00:22.8716585Z 2025-03-14T06:00:22.8716807Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8716925Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8717228Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8717341Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8717561Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8717710Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8717867Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8718036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8718411Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8718796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8719118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8719417Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8719735Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8720007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8720313Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8720442Z Execution Analysis: (:1) 2025-03-14T06:00:22.8720712Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8720921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8720927Z 2025-03-14T06:00:22.8721139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8721255Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8721500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8721612Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8721827Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8721972Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8722131Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8722302Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8722907Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8723507Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8723885Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8724254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8724660Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8724951Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8725286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8725570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8725681Z Execution Analysis: .......... 2025-03-14T06:00:22.8725991Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8726199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8726499Z pt-xla-profiler: TransferFromDeviceTime too frequent: 287 counts during 274 steps 2025-03-14T06:00:22.8726504Z 2025-03-14T06:00:22.8726714Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8726844Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8727139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8727266Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8727473Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8727635Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8727799Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8727990Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8728351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8728741Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8729080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8729369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8729679Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8729961Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8730255Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8730395Z Execution Analysis: (:1) 2025-03-14T06:00:22.8730660Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8730876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8730881Z 2025-03-14T06:00:22.8731085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8731214Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8731449Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8731577Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8731784Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8731943Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8732091Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8732275Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8732904Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8733494Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8733858Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8734227Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8734542Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8734831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8735142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8735423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8735559Z Execution Analysis: .......... 2025-03-14T06:00:22.8735831Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8736038Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8736339Z pt-xla-profiler: TransferFromDeviceTime too frequent: 288 counts during 275 steps 2025-03-14T06:00:22.8736345Z 2025-03-14T06:00:22.8736549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8736675Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8736967Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8737091Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8737301Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8737458Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8737608Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8737788Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8738174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8738563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8738877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8739164Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8739585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8739861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8740148Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8740289Z Execution Analysis: (:1) 2025-03-14T06:00:22.8740540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8740753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8740757Z 2025-03-14T06:00:22.8740969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8741083Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8741309Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8741429Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8741630Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8741785Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8741930Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8742109Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8742712Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8743287Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8743651Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8743997Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8744312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8744584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8744895Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8745189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8745311Z Execution Analysis: .......... 2025-03-14T06:00:22.8745564Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8745779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8746061Z pt-xla-profiler: TransferFromDeviceTime too frequent: 289 counts during 276 steps 2025-03-14T06:00:22.8746066Z 2025-03-14T06:00:22.8746281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8746399Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8746697Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8746807Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8747019Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8747168Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8747347Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8747514Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8747900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8748251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8748567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8748837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8749147Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8749411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8749714Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8749839Z Execution Analysis: (:1) 2025-03-14T06:00:22.8750101Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8750304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8750308Z 2025-03-14T06:00:22.8750519Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8750634Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8750874Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8750986Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8751199Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8751343Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8751503Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8751696Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8752288Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8752851Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8753218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8753563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8753884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8754155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8754498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8754767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8754892Z Execution Analysis: .......... 2025-03-14T06:00:22.8755151Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8755366Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8755648Z pt-xla-profiler: TransferFromDeviceTime too frequent: 290 counts during 277 steps 2025-03-14T06:00:22.8755653Z 2025-03-14T06:00:22.8755867Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8755984Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8756286Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8756400Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8756619Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8756791Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8756944Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8757113Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8757501Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8757851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8758170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8758442Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8758760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8759031Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8759333Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8759462Z Execution Analysis: (:1) 2025-03-14T06:00:22.8759730Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8759947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8759951Z 2025-03-14T06:00:22.8760151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8760281Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8760507Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8760631Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8760831Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8761015Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8761165Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8761345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8761929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8762501Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8762853Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8763208Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8763515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8763825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8764150Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8764431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8764620Z Execution Analysis: .......... 2025-03-14T06:00:22.8765057Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8765262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8765715Z pt-xla-profiler: TransferFromDeviceTime too frequent: 291 counts during 278 steps 2025-03-14T06:00:22.8765721Z 2025-03-14T06:00:22.8765926Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8766056Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8766355Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8766481Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8766751Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8766908Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8767055Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8767286Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8767651Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8768014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8768331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8768622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8768932Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8769219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8769535Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8769682Z Execution Analysis: (:1) 2025-03-14T06:00:22.8769945Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8770158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8770163Z 2025-03-14T06:00:22.8770367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8770496Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8770732Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8770857Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8771104Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8771264Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8771415Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8771596Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8772192Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8772782Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8773150Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8773523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8773839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8774168Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8774481Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8774770Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8774879Z Execution Analysis: .......... 2025-03-14T06:00:22.8775152Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8775358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8775656Z pt-xla-profiler: TransferFromDeviceTime too frequent: 292 counts during 279 steps 2025-03-14T06:00:22.8775662Z 2025-03-14T06:00:22.8775878Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8775997Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8776301Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8776441Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8776658Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8776804Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8776975Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8777158Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8777519Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8777987Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8778312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8778579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8778897Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8779164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8779462Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8779587Z Execution Analysis: (:1) 2025-03-14T06:00:22.8779853Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8780052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8780057Z 2025-03-14T06:00:22.8780267Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8780380Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8780617Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8780753Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8780967Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8781112Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8781270Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8781438Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8782026Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8782584Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8782947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8783294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8783638Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8783908Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8784222Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8784487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8784605Z Execution Analysis: .......... 2025-03-14T06:00:22.8784859Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8785067Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8785347Z pt-xla-profiler: TransferFromDeviceTime too frequent: 293 counts during 280 steps 2025-03-14T06:00:22.8785353Z 2025-03-14T06:00:22.8785565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8785684Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8786086Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8786198Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8786435Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8786578Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8786733Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8786900Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8787262Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8787608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8787930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8788205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8788523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8788787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8789090Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8789216Z Execution Analysis: (:1) 2025-03-14T06:00:22.8789481Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8789682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8789687Z 2025-03-14T06:00:22.8789899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8790016Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8790276Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8790390Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8790604Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8790748Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8790905Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8791072Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8791664Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8792224Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8792589Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8792963Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8793283Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8793553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8793870Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8794148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8794257Z Execution Analysis: .......... 2025-03-14T06:00:22.8794524Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8794724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8795026Z pt-xla-profiler: TransferFromDeviceTime too frequent: 294 counts during 281 steps 2025-03-14T06:00:22.8795033Z 2025-03-14T06:00:22.8795235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8795387Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8795674Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8795988Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8796201Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8796363Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8796511Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8796696Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8797061Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8797431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8797750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8798041Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8798353Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8798643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8798941Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8799085Z Execution Analysis: (:1) 2025-03-14T06:00:22.8799350Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8799569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8799574Z 2025-03-14T06:00:22.8799784Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8799944Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8800182Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8800313Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8800527Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8800691Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8800843Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8801031Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8801647Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8802241Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8802634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8803008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8803328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8803624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8803937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8804228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8804338Z Execution Analysis: .......... 2025-03-14T06:00:22.8804726Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8804935Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8805245Z pt-xla-profiler: TransferFromDeviceTime too frequent: 295 counts during 282 steps 2025-03-14T06:00:22.8805309Z 2025-03-14T06:00:22.8805514Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8805643Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8805961Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8806092Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8806296Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8806457Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8806601Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8806788Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8807149Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8807521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8807835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8808124Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8808436Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8808719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8809013Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8809153Z Execution Analysis: (:1) 2025-03-14T06:00:22.8809414Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8809629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8809635Z 2025-03-14T06:00:22.8809863Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8809994Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8810231Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8810356Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8810566Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8810725Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8810876Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8811060Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8811658Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8812246Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8812647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8813003Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8813333Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8813612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8813936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8814206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8814331Z Execution Analysis: .......... 2025-03-14T06:00:22.8814592Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8814814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8815103Z pt-xla-profiler: TransferFromDeviceTime too frequent: 297 counts during 283 steps 2025-03-14T06:00:22.8815134Z 2025-03-14T06:00:22.8815352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8815517Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8815826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8815940Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8816161Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8816309Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8816469Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8816642Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8817119Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8817469Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8817795Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8818069Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8818386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8818653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8818952Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8819077Z Execution Analysis: (:1) 2025-03-14T06:00:22.8819344Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8819570Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8819577Z 2025-03-14T06:00:22.8819790Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8819905Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8820144Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8820258Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8820473Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8820615Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8820774Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8820939Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8821528Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8822117Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8822483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8822831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8823151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8823422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8823736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8823999Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8824117Z Execution Analysis: .......... 2025-03-14T06:00:22.8824372Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8824587Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8824892Z pt-xla-profiler: TransferFromDeviceTime too frequent: 298 counts during 284 steps 2025-03-14T06:00:22.8824899Z 2025-03-14T06:00:22.8825133Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8825248Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8825547Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8825659Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8825876Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8826021Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8826176Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8826343Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8826710Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8827059Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8827375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8827647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8827959Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8828227Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8828523Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8828647Z Execution Analysis: (:1) 2025-03-14T06:00:22.8828912Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8829141Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8829159Z 2025-03-14T06:00:22.8829358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8829487Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8829716Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8829838Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8830039Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8830182Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8830338Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8830505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8831097Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8831697Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8832053Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8832417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8832724Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8833006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8833309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8833590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8833702Z Execution Analysis: .......... 2025-03-14T06:00:22.8833975Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8834202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8834498Z pt-xla-profiler: TransferFromDeviceTime too frequent: 299 counts during 285 steps 2025-03-14T06:00:22.8834526Z 2025-03-14T06:00:22.8834727Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8834856Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8835141Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8835263Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8835463Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8835621Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8835764Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8835947Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8836302Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8836657Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8836967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8837251Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8837554Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8837830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8838117Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8838256Z Execution Analysis: (:1) 2025-03-14T06:00:22.8838538Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8838753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8838757Z 2025-03-14T06:00:22.8838958Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8839087Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8839315Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8839440Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8839644Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8839804Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8839950Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8840131Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8840751Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8841327Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8841683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8842048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8842358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8842643Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8842948Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8843330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8843438Z Execution Analysis: .......... 2025-03-14T06:00:22.8843717Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8843911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8844219Z pt-xla-profiler: TransferFromDeviceTime too frequent: 300 counts during 286 steps 2025-03-14T06:00:22.8844224Z 2025-03-14T06:00:22.8844419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8844645Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8845084Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8845217Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8845426Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8845653Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8845802Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8845991Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8846355Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8846728Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8847045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8847339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8847652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8847942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8848255Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8848420Z Execution Analysis: (:1) 2025-03-14T06:00:22.8848699Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8848904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8848909Z 2025-03-14T06:00:22.8849129Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8849247Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8849492Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8849602Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8849819Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8849963Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8850122Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8850320Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8850923Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8851502Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8851877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8852232Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8852559Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8852837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8853161Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8853436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8853588Z Execution Analysis: .......... 2025-03-14T06:00:22.8853849Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8854089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8854377Z pt-xla-profiler: TransferFromDeviceTime too frequent: 301 counts during 287 steps 2025-03-14T06:00:22.8854382Z 2025-03-14T06:00:22.8854598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8854717Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8855020Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8855135Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8855360Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8855511Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8855672Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8855846Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8856226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8856587Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8856917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8857298Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8857597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8857849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8858160Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8858282Z Execution Analysis: (:1) 2025-03-14T06:00:22.8858537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8858731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8858737Z 2025-03-14T06:00:22.8858940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8859048Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8859277Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8859383Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8859588Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8859723Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8859901Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8860059Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8860625Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8861163Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8861511Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8861840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8862146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8862403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8862705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8862981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8863095Z Execution Analysis: .......... 2025-03-14T06:00:22.8863360Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8863563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8863831Z pt-xla-profiler: TransferFromDeviceTime too frequent: 302 counts during 288 steps 2025-03-14T06:00:22.8863849Z 2025-03-14T06:00:22.8864040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8864162Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8864432Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8864553Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8864744Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8864893Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8865028Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8865198Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8865851Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8866224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8866541Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8866832Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8867144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8867503Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8867802Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8867944Z Execution Analysis: (:1) 2025-03-14T06:00:22.8868210Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8868431Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8868435Z 2025-03-14T06:00:22.8868643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8868774Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8869008Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8869136Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8869343Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8869547Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8869695Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8869875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8870472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8871060Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8871423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8871790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8872106Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8872399Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8872745Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8873027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8873136Z Execution Analysis: .......... 2025-03-14T06:00:22.8873442Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8873650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8873950Z pt-xla-profiler: TransferFromDeviceTime too frequent: 303 counts during 289 steps 2025-03-14T06:00:22.8873954Z 2025-03-14T06:00:22.8874160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8874291Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8874589Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8874716Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8874927Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8875087Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8875234Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8875420Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8875780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8876149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8876465Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8876755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8877109Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8877400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8877806Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8877945Z Execution Analysis: (:1) 2025-03-14T06:00:22.8878303Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8878508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8878513Z 2025-03-14T06:00:22.8878705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8878829Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8879047Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8879191Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8879384Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8879534Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8879673Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8879843Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8880395Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8880940Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8881275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8881616Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8881925Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8882182Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8882504Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8882788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8882903Z Execution Analysis: .......... 2025-03-14T06:00:22.8883146Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8883351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8883620Z pt-xla-profiler: TransferFromDeviceTime too frequent: 304 counts during 290 steps 2025-03-14T06:00:22.8883624Z 2025-03-14T06:00:22.8883830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8883943Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8884232Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8884342Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8884622Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8884762Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8885074Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8885247Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8885624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8885980Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8886311Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8886591Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8886953Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8887230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8887542Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8887673Z Execution Analysis: (:1) 2025-03-14T06:00:22.8887951Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8888158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8888163Z 2025-03-14T06:00:22.8888383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8888504Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8888755Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8888900Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8889123Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8889275Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8889442Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8889619Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8890230Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8890810Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8891188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8891550Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8891883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8892188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8892544Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8892816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8892938Z Execution Analysis: .......... 2025-03-14T06:00:22.8893203Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8893425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8893718Z pt-xla-profiler: TransferFromDeviceTime too frequent: 305 counts during 291 steps 2025-03-14T06:00:22.8893722Z 2025-03-14T06:00:22.8893947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8894066Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8894371Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8894483Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8894702Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8894848Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8895004Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8895174Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8895545Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8895898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8896224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8896528Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8896852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8897125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8897535Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8897660Z Execution Analysis: (:1) 2025-03-14T06:00:22.8897928Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8898128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8898133Z 2025-03-14T06:00:22.8898346Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8898486Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8898734Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8898846Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8899065Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8899210Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8899370Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8899539Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8900130Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8900707Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8901063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8901426Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8901758Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8902040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8902369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8902652Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8902759Z Execution Analysis: .......... 2025-03-14T06:00:22.8903026Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8903227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8903520Z pt-xla-profiler: TransferFromDeviceTime too frequent: 306 counts during 292 steps 2025-03-14T06:00:22.8903526Z 2025-03-14T06:00:22.8903727Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8903856Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8904142Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8904267Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8904469Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8904628Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8904772Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8904953Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8905306Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8905663Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8905999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8906283Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8906587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8906868Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8907265Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8907395Z Execution Analysis: (:1) 2025-03-14T06:00:22.8907637Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8907841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8907846Z 2025-03-14T06:00:22.8908037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8908184Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8908403Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8908522Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8908713Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8908863Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8909003Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8909173Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8909721Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8910264Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8910604Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8910970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8911265Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8911567Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8911857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8912122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8912225Z Execution Analysis: .......... 2025-03-14T06:00:22.8912479Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8912672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8912952Z pt-xla-profiler: TransferFromDeviceTime too frequent: 307 counts during 293 steps 2025-03-14T06:00:22.8912959Z 2025-03-14T06:00:22.8913147Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8913268Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8913543Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8913660Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8913852Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8914001Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8914135Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8914307Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8914640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8915005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8915299Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8915568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8915857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8916120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8916393Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8916522Z Execution Analysis: (:1) 2025-03-14T06:00:22.8916766Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8916967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8916996Z 2025-03-14T06:00:22.8917197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8917309Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8917537Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8917643Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8917850Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8917985Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8918135Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8918295Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8918855Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8919391Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8919746Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8920103Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8920435Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8920696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8921004Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8921259Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8921376Z Execution Analysis: .......... 2025-03-14T06:00:22.8921619Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8921825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8922093Z pt-xla-profiler: TransferFromDeviceTime too frequent: 308 counts during 294 steps 2025-03-14T06:00:22.8922097Z 2025-03-14T06:00:22.8922298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8922410Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8927475Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8927633Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8927866Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8928014Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8928166Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8928336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8928795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8929158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8929478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8929758Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8930073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8930341Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8930638Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8930760Z Execution Analysis: (:1) 2025-03-14T06:00:22.8931028Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8931270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8931277Z 2025-03-14T06:00:22.8931484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8931596Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8931845Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8931955Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8932172Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8932314Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8932474Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8932641Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8933250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8933828Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8934225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8934602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8934925Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8935201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8935519Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8935785Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8935900Z Execution Analysis: .......... 2025-03-14T06:00:22.8936159Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8936375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8936661Z pt-xla-profiler: TransferFromDeviceTime too frequent: 309 counts during 295 steps 2025-03-14T06:00:22.8936667Z 2025-03-14T06:00:22.8936884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8936995Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8937394Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8937498Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8937695Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8937828Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8937967Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8938123Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8938492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8938817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8939116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8939366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8939659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8939904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8940180Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8940292Z Execution Analysis: (:1) 2025-03-14T06:00:22.8940540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8940826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8940842Z 2025-03-14T06:00:22.8941024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8941140Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8941354Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8941453Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8941651Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8941780Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8941925Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8942080Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8942640Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8943180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8943535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8943886Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8944176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8944435Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8944719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8944974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8945072Z Execution Analysis: .......... 2025-03-14T06:00:22.8945317Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8945503Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8945775Z pt-xla-profiler: TransferFromDeviceTime too frequent: 310 counts during 296 steps 2025-03-14T06:00:22.8945780Z 2025-03-14T06:00:22.8945966Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8946074Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8946341Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8946449Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8946637Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8946776Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8946908Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8947092Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8947426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8947761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8948051Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8948318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8948601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8948860Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8949128Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8949292Z Execution Analysis: (:1) 2025-03-14T06:00:22.8949527Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8949730Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8949734Z 2025-03-14T06:00:22.8949925Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8950040Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8950253Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8950368Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8950554Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8950701Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8950835Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8951000Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8951548Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8952121Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8952472Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8952809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8953096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8953362Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8953643Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8953904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8954001Z Execution Analysis: .......... 2025-03-14T06:00:22.8954255Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8954440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8954720Z pt-xla-profiler: TransferFromDeviceTime too frequent: 311 counts during 297 steps 2025-03-14T06:00:22.8954724Z 2025-03-14T06:00:22.8954911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8955028Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8955296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8955407Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8955598Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8955742Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8955897Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8956062Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8956392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8956728Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8957017Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8957275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8957559Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8957816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8958084Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8958246Z Execution Analysis: (:1) 2025-03-14T06:00:22.8958484Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8958678Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8958685Z 2025-03-14T06:00:22.8958881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8958983Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8959198Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8959299Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8959494Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8959624Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8959763Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8959920Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8960472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8961043Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8961380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8961702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8961999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8962248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8962535Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8962784Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8962891Z Execution Analysis: .......... 2025-03-14T06:00:22.8963126Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8963319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8963580Z pt-xla-profiler: TransferFromDeviceTime too frequent: 312 counts during 298 steps 2025-03-14T06:00:22.8963585Z 2025-03-14T06:00:22.8963781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8963884Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8964156Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8964255Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8964548Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8964697Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8964835Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8965159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8965667Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8966024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8966351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8966629Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8966953Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8967225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8967601Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8967731Z Execution Analysis: (:1) 2025-03-14T06:00:22.8968007Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8968217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8968222Z 2025-03-14T06:00:22.8968443Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8968562Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8968812Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8968927Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8969157Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8969306Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8969476Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8969648Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8970294Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8970904Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8971285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8971642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8971972Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8972253Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8972585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8972861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8972986Z Execution Analysis: .......... 2025-03-14T06:00:22.8973252Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8973476Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8973766Z pt-xla-profiler: TransferFromDeviceTime too frequent: 313 counts during 299 steps 2025-03-14T06:00:22.8973785Z 2025-03-14T06:00:22.8973995Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8974133Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8974430Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8974598Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8974808Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8974974Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8975123Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8975299Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8975679Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8976048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8976366Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8976661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8976974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8977392Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8977784Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8977918Z Execution Analysis: (:1) 2025-03-14T06:00:22.8978161Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8978369Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8978373Z 2025-03-14T06:00:22.8978566Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8978693Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8978912Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8979034Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8979226Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8979379Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8979544Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8979714Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8980283Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8980837Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8981174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8981512Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8981805Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8982075Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8982365Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8982626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8982729Z Execution Analysis: .......... 2025-03-14T06:00:22.8982979Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8983168Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8983446Z pt-xla-profiler: TransferFromDeviceTime too frequent: 314 counts during 300 steps 2025-03-14T06:00:22.8983452Z 2025-03-14T06:00:22.8983641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8983761Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8984055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8984176Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8984369Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8984522Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8984661Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8984837Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8985172Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8985516Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8985809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8986082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8986411Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8986678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8986951Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8987084Z Execution Analysis: (:1) 2025-03-14T06:00:22.8987327Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8987529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8987534Z 2025-03-14T06:00:22.8987726Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8987846Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8988063Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8988184Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8988378Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8988552Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8988691Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8988865Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8989439Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8989986Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8990324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.8990665Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8990962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8991236Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8991524Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8991794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8991910Z Execution Analysis: .......... 2025-03-14T06:00:22.8992151Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8992355Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8992623Z pt-xla-profiler: TransferFromDeviceTime too frequent: 315 counts during 301 steps 2025-03-14T06:00:22.8992628Z 2025-03-14T06:00:22.8992831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8992966Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8993251Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.8993358Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8993563Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.8993701Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.8993850Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.8994009Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8994354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.8994682Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.8994987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.8995270Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.8995569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.8995996Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.8996297Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.8996422Z Execution Analysis: (:1) 2025-03-14T06:00:22.8996687Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.8996887Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8996892Z 2025-03-14T06:00:22.8997102Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.8997215Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.8997460Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.8997573Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.8997816Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.8997958Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.8998117Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.8998306Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.8998897Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.8999456Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.8999823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9000172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9000496Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9000768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9001086Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9001351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9001469Z Execution Analysis: .......... 2025-03-14T06:00:22.9001722Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9001933Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9002212Z pt-xla-profiler: TransferFromDeviceTime too frequent: 316 counts during 302 steps 2025-03-14T06:00:22.9002220Z 2025-03-14T06:00:22.9002456Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9002573Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9002869Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9002981Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9003197Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9003341Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9003494Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9003662Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9004026Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9004371Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9004786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9005261Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9005625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9005900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9006207Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9006335Z Execution Analysis: (:1) 2025-03-14T06:00:22.9006612Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9006821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9006825Z 2025-03-14T06:00:22.9007046Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9007166Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9007414Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9007556Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9007778Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9007926Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9008112Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9008285Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9008891Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9009468Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9009844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9010214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9010532Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9010826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9011137Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9011425Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9011535Z Execution Analysis: .......... 2025-03-14T06:00:22.9011806Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9012019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9012310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 318 counts during 303 steps 2025-03-14T06:00:22.9012341Z 2025-03-14T06:00:22.9012548Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9012674Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9012969Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9013090Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9013297Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9013451Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9013599Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9013775Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9014139Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9014496Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9014838Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9015119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9015431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9015709Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9016004Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9016137Z Execution Analysis: (:1) 2025-03-14T06:00:22.9016401Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9016613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9016617Z 2025-03-14T06:00:22.9016826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9016947Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9017302Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9017417Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9017633Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9017774Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9017912Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9018077Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9018628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9019348Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9019705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9020061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9020364Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9020644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9021119Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9021402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9021512Z Execution Analysis: .......... 2025-03-14T06:00:22.9021781Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9021982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9022320Z pt-xla-profiler: TransferFromDeviceTime too frequent: 319 counts during 304 steps 2025-03-14T06:00:22.9022328Z 2025-03-14T06:00:22.9022531Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9022657Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9022949Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9023069Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9023269Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9023426Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9023567Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9023744Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9024099Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9024495Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9024806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9025089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9025397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9025676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9025967Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9026132Z Execution Analysis: (:1) 2025-03-14T06:00:22.9026427Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9026634Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9026640Z 2025-03-14T06:00:22.9026854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9026994Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9027233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9027367Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9027582Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9027724Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9027878Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9028044Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9028645Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9029218Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9029587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9029938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9030261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9030536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9030850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9031120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9031234Z Execution Analysis: .......... 2025-03-14T06:00:22.9031492Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9031733Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9032023Z pt-xla-profiler: TransferFromDeviceTime too frequent: 320 counts during 305 steps 2025-03-14T06:00:22.9032028Z 2025-03-14T06:00:22.9032238Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9032355Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9032655Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9032766Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9032978Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9033125Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9033276Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9033445Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9033841Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9034192Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9034516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9034793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9035108Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9035381Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9035683Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9035819Z Execution Analysis: (:1) 2025-03-14T06:00:22.9036075Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9036293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9036322Z 2025-03-14T06:00:22.9036523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9036651Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9036904Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9037030Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9037232Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9037388Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9037531Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9037711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9038301Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9038996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9039345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9039703Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9040008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9040286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9040586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9040858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9040960Z Execution Analysis: .......... 2025-03-14T06:00:22.9041247Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9041441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9041731Z pt-xla-profiler: TransferFromDeviceTime too frequent: 321 counts during 306 steps 2025-03-14T06:00:22.9041736Z 2025-03-14T06:00:22.9041934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9042055Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9042339Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9042455Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9042661Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9042809Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9042949Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9043150Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9043502Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9043858Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9044160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9044434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9044824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9045270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9045561Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9045697Z Execution Analysis: (:1) 2025-03-14T06:00:22.9045955Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9046169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9046203Z 2025-03-14T06:00:22.9046406Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9046553Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9046787Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9046907Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9047111Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9047265Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9047410Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9047584Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9048174Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9048757Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9049119Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9049480Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9049791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9050076Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9050388Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9050664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9050773Z Execution Analysis: .......... 2025-03-14T06:00:22.9051065Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9051275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9051572Z pt-xla-profiler: TransferFromDeviceTime too frequent: 322 counts during 307 steps 2025-03-14T06:00:22.9051577Z 2025-03-14T06:00:22.9051793Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9051905Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9052205Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9052316Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9052528Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9052671Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9052851Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9053022Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9053394Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9053743Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9054068Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9054341Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9054661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9054932Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9055239Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9055364Z Execution Analysis: (:1) 2025-03-14T06:00:22.9055637Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9055865Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9055869Z 2025-03-14T06:00:22.9056124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9056238Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9056485Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9056597Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9056816Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9056956Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9057227Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9057383Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9057946Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9058477Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9058824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9059149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9059448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9059701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9059997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9060278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9060386Z Execution Analysis: .......... 2025-03-14T06:00:22.9060626Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9060824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9061088Z pt-xla-profiler: TransferFromDeviceTime too frequent: 323 counts during 308 steps 2025-03-14T06:00:22.9061092Z 2025-03-14T06:00:22.9061291Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9061396Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9061675Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9061778Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9061980Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9062144Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9062285Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9062443Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9062782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9063115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9063414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9063669Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9063961Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9064206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9064488Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9064607Z Execution Analysis: (:1) 2025-03-14T06:00:22.9064876Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9065065Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9065091Z 2025-03-14T06:00:22.9065406Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9065513Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9065914Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9066023Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9066235Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9066378Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9066534Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9066708Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9067306Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9067886Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9068255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9068608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9068927Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9069212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9069582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9069864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9069969Z Execution Analysis: .......... 2025-03-14T06:00:22.9070242Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9070447Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9070749Z pt-xla-profiler: TransferFromDeviceTime too frequent: 324 counts during 309 steps 2025-03-14T06:00:22.9070755Z 2025-03-14T06:00:22.9070959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9071087Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9071375Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9071502Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9071751Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9071909Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9072053Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9072236Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9072602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9072973Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9073285Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9073573Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9073878Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9074161Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9074455Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9074629Z Execution Analysis: (:1) 2025-03-14T06:00:22.9074889Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9075138Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9075143Z 2025-03-14T06:00:22.9075345Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9075471Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9075703Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9075824Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9076028Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9076187Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9076334Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9076515Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9077109Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9077697Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9078268Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9078603Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9078891Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9079156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9079472Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9079737Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9079838Z Execution Analysis: .......... 2025-03-14T06:00:22.9080090Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9080278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9080552Z pt-xla-profiler: TransferFromDeviceTime too frequent: 325 counts during 310 steps 2025-03-14T06:00:22.9080557Z 2025-03-14T06:00:22.9080744Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9080861Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9081128Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9081268Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9081456Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9081599Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9081733Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9081898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9082231Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9082564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9082857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9083118Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9083403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9083667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9083970Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9084094Z Execution Analysis: (:1) 2025-03-14T06:00:22.9084359Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9084635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9084640Z 2025-03-14T06:00:22.9084826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9085109Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9085345Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9085465Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9085674Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9085829Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9085978Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9086158Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9086753Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9087345Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9087722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9088072Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9088399Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9088780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9089107Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9089377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9089502Z Execution Analysis: .......... 2025-03-14T06:00:22.9089758Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9089974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9090262Z pt-xla-profiler: TransferFromDeviceTime too frequent: 326 counts during 311 steps 2025-03-14T06:00:22.9090266Z 2025-03-14T06:00:22.9090485Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9090600Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9090935Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9091048Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9091270Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9091415Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9091574Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9091741Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9092121Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9092473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9092798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9093072Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9093397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9093710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9094013Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9094162Z Execution Analysis: (:1) 2025-03-14T06:00:22.9094431Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9094634Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9094639Z 2025-03-14T06:00:22.9094850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9094968Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9095209Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9095320Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9095537Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9095682Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9095839Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9096009Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9096619Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9097302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9097667Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9098009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9098357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9098636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9098953Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9099221Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9099342Z Execution Analysis: .......... 2025-03-14T06:00:22.9099598Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9099811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9100093Z pt-xla-profiler: TransferFromDeviceTime too frequent: 327 counts during 312 steps 2025-03-14T06:00:22.9100098Z 2025-03-14T06:00:22.9100476Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9100622Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9100932Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9101045Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9101266Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9101411Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9101571Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9101743Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9102124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9102482Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9102817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9103104Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9103433Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9103736Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9104073Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9104200Z Execution Analysis: (:1) 2025-03-14T06:00:22.9104476Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9104683Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9104700Z 2025-03-14T06:00:22.9104907Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9105041Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9105286Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9105415Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9105626Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9105791Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9105948Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9106136Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9106736Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9107323Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9107688Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9108091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9108408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9108699Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9109013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9109302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9109414Z Execution Analysis: .......... 2025-03-14T06:00:22.9109687Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9109892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9110196Z pt-xla-profiler: TransferFromDeviceTime too frequent: 328 counts during 313 steps 2025-03-14T06:00:22.9110230Z 2025-03-14T06:00:22.9110441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9110575Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9110971Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9111093Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9111296Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9111450Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9111586Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9111764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9112112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9112466Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9112774Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9113057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9113391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9113694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9113986Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9114125Z Execution Analysis: (:1) 2025-03-14T06:00:22.9114378Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9114594Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9114598Z 2025-03-14T06:00:22.9114800Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9114935Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9115162Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9115289Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9115493Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9115650Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9115801Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9115978Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9116556Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9117131Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9117483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9117870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9118179Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9118463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9118765Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9119041Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9119147Z Execution Analysis: .......... 2025-03-14T06:00:22.9119413Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9119613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9119936Z pt-xla-profiler: TransferFromDeviceTime too frequent: 329 counts during 314 steps 2025-03-14T06:00:22.9119942Z 2025-03-14T06:00:22.9120154Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9120268Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9120552Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9120675Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9120876Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9121033Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9121174Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9121353Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9121707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9122063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9122373Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9122689Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9123034Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9123304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9123603Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9123728Z Execution Analysis: (:1) 2025-03-14T06:00:22.9123993Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9124194Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9124200Z 2025-03-14T06:00:22.9124409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9124609Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9124853Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9125133Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9125362Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9125508Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9125672Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9125842Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9126449Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9127025Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9127437Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9127797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9128129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9128407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9128729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9129000Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9129121Z Execution Analysis: .......... 2025-03-14T06:00:22.9129381Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9129595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9129928Z pt-xla-profiler: TransferFromDeviceTime too frequent: 330 counts during 315 steps 2025-03-14T06:00:22.9129935Z 2025-03-14T06:00:22.9130151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9130266Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9130571Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9130685Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9130906Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9131050Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9131207Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9131378Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9131751Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9132108Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9132462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9132738Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9133085Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9133357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9133664Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9133793Z Execution Analysis: (:1) 2025-03-14T06:00:22.9134066Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9134272Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9134281Z 2025-03-14T06:00:22.9134498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9134617Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9134862Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9134978Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9135199Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9135343Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9135506Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9135670Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9136282Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9136890Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9137275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9137632Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9137963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9138240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9138569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9138842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9138967Z Execution Analysis: .......... 2025-03-14T06:00:22.9139229Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9139481Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9139785Z pt-xla-profiler: TransferFromDeviceTime too frequent: 331 counts during 316 steps 2025-03-14T06:00:22.9139790Z 2025-03-14T06:00:22.9139994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9140122Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9140419Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9140543Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9140751Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9140913Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9141059Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9141241Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9141609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9142002Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9142318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9142633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9142945Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9143230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9143525Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9143663Z Execution Analysis: (:1) 2025-03-14T06:00:22.9143928Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9144151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9144157Z 2025-03-14T06:00:22.9144361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9144494Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9144729Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9144858Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9145066Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9145234Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9145383Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9145568Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9146164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9146785Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9147149Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9147519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9147836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9148128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9148441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9148727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9148838Z Execution Analysis: .......... 2025-03-14T06:00:22.9149146Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9149352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9149659Z pt-xla-profiler: TransferFromDeviceTime too frequent: 332 counts during 317 steps 2025-03-14T06:00:22.9149664Z 2025-03-14T06:00:22.9149871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9150004Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9150297Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9150428Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9150632Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9150798Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9150943Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9151134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9151497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9151897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9152241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9152534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9152845Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9153127Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9153421Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9153565Z Execution Analysis: (:1) 2025-03-14T06:00:22.9153825Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9154043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9154048Z 2025-03-14T06:00:22.9154250Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9154375Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9154609Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9154736Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9154943Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9155101Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9155248Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9155533Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9156139Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9156714Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9157066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9157422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9157744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9158019Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9158335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9158600Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9158750Z Execution Analysis: .......... 2025-03-14T06:00:22.9159005Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9159220Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9159503Z pt-xla-profiler: TransferFromDeviceTime too frequent: 333 counts during 318 steps 2025-03-14T06:00:22.9159509Z 2025-03-14T06:00:22.9159720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9159835Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9160134Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9160247Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9160464Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9160609Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9160764Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9160930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9161325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9161698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9162015Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9162285Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9162595Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9162859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9163158Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9163286Z Execution Analysis: (:1) 2025-03-14T06:00:22.9163551Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9163752Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9163757Z 2025-03-14T06:00:22.9163969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9164082Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9164322Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9164433Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9164732Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9164876Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9165206Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9165549Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9166243Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9166828Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9167210Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9167566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9167897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9168174Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9168501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9168813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9168936Z Execution Analysis: .......... 2025-03-14T06:00:22.9169199Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9169423Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9169712Z pt-xla-profiler: TransferFromDeviceTime too frequent: 334 counts during 319 steps 2025-03-14T06:00:22.9169717Z 2025-03-14T06:00:22.9169934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9170050Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9170359Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9170470Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9170688Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9170838Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9171034Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9171205Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9171575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9171961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9172290Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9172564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9172887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9173159Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9173470Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9173596Z Execution Analysis: (:1) 2025-03-14T06:00:22.9173871Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9174077Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9174093Z 2025-03-14T06:00:22.9174296Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9174423Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9174654Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9174768Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9174984Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9175129Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9175293Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9175489Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9176100Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9176692Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9177054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9177420Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9177947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9178215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9178542Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9178804Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9178908Z Execution Analysis: .......... 2025-03-14T06:00:22.9179163Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9179353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9179634Z pt-xla-profiler: TransferFromDeviceTime too frequent: 335 counts during 320 steps 2025-03-14T06:00:22.9179639Z 2025-03-14T06:00:22.9179832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9179952Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9180225Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9180343Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9180538Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9180716Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9180849Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9181024Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9181385Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9181725Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9182020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9182291Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9182579Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9182851Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9183127Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9183260Z Execution Analysis: (:1) 2025-03-14T06:00:22.9183503Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9183708Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9183712Z 2025-03-14T06:00:22.9183900Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9184020Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9184237Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9184353Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9184544Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9184696Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9184868Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9185040Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9185592Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9186145Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9186481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9186824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9187117Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9187419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9187708Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9187977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9188081Z Execution Analysis: .......... 2025-03-14T06:00:22.9188342Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9188535Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9188819Z pt-xla-profiler: TransferFromDeviceTime too frequent: 336 counts during 321 steps 2025-03-14T06:00:22.9188825Z 2025-03-14T06:00:22.9189017Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9189141Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9189416Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9189544Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9189764Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9189920Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9190056Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9190253Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9190590Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9190932Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9191228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9191504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9191793Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9192066Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9192344Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9192479Z Execution Analysis: (:1) 2025-03-14T06:00:22.9192725Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9192931Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9192935Z 2025-03-14T06:00:22.9193140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9193254Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9193488Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9193597Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9193835Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9193974Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9194129Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9194292Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9194863Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9195398Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9195920Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9196272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9196592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9196891Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9197211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9197475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9197599Z Execution Analysis: .......... 2025-03-14T06:00:22.9197853Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9198064Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9198345Z pt-xla-profiler: TransferFromDeviceTime too frequent: 337 counts during 322 steps 2025-03-14T06:00:22.9198350Z 2025-03-14T06:00:22.9198557Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9198671Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9198969Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9199106Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9199320Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9199463Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9199657Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9199827Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9200191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9200537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9200864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9201133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9201455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9201720Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9202021Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9202151Z Execution Analysis: (:1) 2025-03-14T06:00:22.9202421Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9202621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9202625Z 2025-03-14T06:00:22.9202835Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9202950Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9203193Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9203691Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9203916Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9204060Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9204220Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9204391Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9205237Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9205815Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9206191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9206545Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9206918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9207202Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9207530Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9207807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9207927Z Execution Analysis: .......... 2025-03-14T06:00:22.9208190Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9208409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9208699Z pt-xla-profiler: TransferFromDeviceTime too frequent: 339 counts during 323 steps 2025-03-14T06:00:22.9208716Z 2025-03-14T06:00:22.9208924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9209059Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9209384Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9209513Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9209722Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9209909Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9210055Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9210228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9210602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9210970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9211286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9211579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9211893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9212177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9212478Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9212620Z Execution Analysis: (:1) 2025-03-14T06:00:22.9212885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9213104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9213108Z 2025-03-14T06:00:22.9213312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9213442Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9213706Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9213835Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9214042Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9214200Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9214351Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9214535Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9215128Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9215717Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9216080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9216476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9216799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9217198Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9217505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9217784Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9217889Z Execution Analysis: .......... 2025-03-14T06:00:22.9218156Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9218355Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9218646Z pt-xla-profiler: TransferFromDeviceTime too frequent: 340 counts during 324 steps 2025-03-14T06:00:22.9218652Z 2025-03-14T06:00:22.9218854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9219011Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9219298Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9219420Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9219648Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9219804Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9219947Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9220125Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9220477Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9220833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9221144Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9221529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9221817Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9222082Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9222356Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9222485Z Execution Analysis: (:1) 2025-03-14T06:00:22.9222727Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9222928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9222933Z 2025-03-14T06:00:22.9223121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9223270Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9223491Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9223609Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9223802Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9223952Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9224092Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9224267Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9224815Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9225363Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9225731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9226078Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9226376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9226647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9226946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9227197Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9227314Z Execution Analysis: .......... 2025-03-14T06:00:22.9227555Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9227761Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9228032Z pt-xla-profiler: TransferFromDeviceTime too frequent: 341 counts during 325 steps 2025-03-14T06:00:22.9228037Z 2025-03-14T06:00:22.9228266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9228377Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9228684Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9228792Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9228996Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9229132Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9229281Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9229445Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9229796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9230124Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9230431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9230692Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9230996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9231250Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9231538Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9231659Z Execution Analysis: (:1) 2025-03-14T06:00:22.9231914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9232106Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9232112Z 2025-03-14T06:00:22.9232343Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9232455Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9232689Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9232797Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9233010Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9233148Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9233302Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9233465Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9234031Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9234568Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9234949Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9235281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9235593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9235853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9236161Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9236415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9236532Z Execution Analysis: .......... 2025-03-14T06:00:22.9236775Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9236986Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9237258Z pt-xla-profiler: TransferFromDeviceTime too frequent: 342 counts during 326 steps 2025-03-14T06:00:22.9237301Z 2025-03-14T06:00:22.9237508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9237721Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9238007Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9238115Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9238324Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9238463Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9238616Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9238778Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9239130Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9239463Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9239772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9240028Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9240329Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9240581Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9240866Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9240985Z Execution Analysis: (:1) 2025-03-14T06:00:22.9241236Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9241426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9241460Z 2025-03-14T06:00:22.9241664Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9241774Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9241999Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9242105Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9242307Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9242445Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9242597Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9242753Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9243313Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9243873Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9244220Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9244637Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9245104Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9245394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9245705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9245991Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9246100Z Execution Analysis: .......... 2025-03-14T06:00:22.9246375Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9246585Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9246922Z pt-xla-profiler: TransferFromDeviceTime too frequent: 343 counts during 327 steps 2025-03-14T06:00:22.9246927Z 2025-03-14T06:00:22.9247157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9247289Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9247586Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9247713Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9247922Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9248082Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9248227Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9248412Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9248777Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9249145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9249461Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9249752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9250063Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9250349Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9250644Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9250785Z Execution Analysis: (:1) 2025-03-14T06:00:22.9251049Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9251297Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9251304Z 2025-03-14T06:00:22.9251508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9251639Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9251874Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9251999Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9252208Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9252366Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9252516Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9252701Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9253293Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9253913Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9254278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9254649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9254966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9255254Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9255565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9255850Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9255959Z Execution Analysis: .......... 2025-03-14T06:00:22.9256235Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9256467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9256766Z pt-xla-profiler: TransferFromDeviceTime too frequent: 344 counts during 328 steps 2025-03-14T06:00:22.9256796Z 2025-03-14T06:00:22.9257001Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9257238Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9257526Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9257648Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9257847Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9258001Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9258144Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9258327Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9258680Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9259038Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9259346Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9259628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9259931Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9260206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9260495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9260632Z Execution Analysis: (:1) 2025-03-14T06:00:22.9260916Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9261132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9261136Z 2025-03-14T06:00:22.9261348Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9261462Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9261702Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9261811Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9262024Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9262166Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9262311Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9262490Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9263107Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9263673Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9264037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9264381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9264702Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9264971Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9265435Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9265702Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9265827Z Execution Analysis: .......... 2025-03-14T06:00:22.9266324Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9266543Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9266869Z pt-xla-profiler: TransferFromDeviceTime too frequent: 345 counts during 329 steps 2025-03-14T06:00:22.9266876Z 2025-03-14T06:00:22.9267094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9267213Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9267522Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9267638Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9267857Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9268008Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9268170Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9268345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9268720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9269078Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9269406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9269682Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9270005Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9270277Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9270585Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9270753Z Execution Analysis: (:1) 2025-03-14T06:00:22.9271027Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9271235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9271239Z 2025-03-14T06:00:22.9271455Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9271572Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9271820Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9271932Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9272151Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9272297Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9272472Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9272693Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9273308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9273891Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9274271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9274628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9274961Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9275242Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9275569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9275845Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9275999Z Execution Analysis: .......... 2025-03-14T06:00:22.9276262Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9276507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9276797Z pt-xla-profiler: TransferFromDeviceTime too frequent: 346 counts during 330 steps 2025-03-14T06:00:22.9276802Z 2025-03-14T06:00:22.9277028Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9277147Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9277458Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9277574Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9277798Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9277949Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9278113Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9278288Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9278668Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9279126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9279450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9279722Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9280039Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9280321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9280637Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9280884Z Execution Analysis: (:1) 2025-03-14T06:00:22.9281127Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9281337Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9281342Z 2025-03-14T06:00:22.9281532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9281657Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9281878Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9282001Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9282196Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9282344Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9282510Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9282688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9283241Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9283792Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9284126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9284522Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9284826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9285273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9285586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9285902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9286010Z Execution Analysis: .......... 2025-03-14T06:00:22.9286311Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9286517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9286816Z pt-xla-profiler: TransferFromDeviceTime too frequent: 347 counts during 331 steps 2025-03-14T06:00:22.9286822Z 2025-03-14T06:00:22.9287028Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9287159Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9287450Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9287579Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9287787Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9287951Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9288099Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9288282Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9288646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9289011Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9289326Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9289618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9289929Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9290257Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9290555Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9290699Z Execution Analysis: (:1) 2025-03-14T06:00:22.9290962Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9291181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9291185Z 2025-03-14T06:00:22.9291390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9291518Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9291752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9291879Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9292087Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9292273Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9292423Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9292610Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9293206Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9293796Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9294160Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9294527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9294842Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9295138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9295450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9295759Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9295869Z Execution Analysis: .......... 2025-03-14T06:00:22.9296166Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9296372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9296675Z pt-xla-profiler: TransferFromDeviceTime too frequent: 348 counts during 332 steps 2025-03-14T06:00:22.9296680Z 2025-03-14T06:00:22.9296897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9297014Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9297434Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9297545Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9297763Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9297907Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9298061Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9298230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9298594Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9298940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9299260Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9299530Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9299872Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9300136Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9300437Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9300559Z Execution Analysis: (:1) 2025-03-14T06:00:22.9300826Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9301023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9301027Z 2025-03-14T06:00:22.9301238Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9301351Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9301589Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9301698Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9301938Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9302082Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9302242Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9302411Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9303003Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9303564Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9303929Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9304274Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9304600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9304869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9305213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9305504Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9305621Z Execution Analysis: .......... 2025-03-14T06:00:22.9305874Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9306084Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9306365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 349 counts during 333 steps 2025-03-14T06:00:22.9306370Z 2025-03-14T06:00:22.9306580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9306697Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9306997Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9307109Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9307427Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9307566Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9307713Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9307874Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9308217Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9308547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9308851Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9309107Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9309445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9309699Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9309985Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9310107Z Execution Analysis: (:1) 2025-03-14T06:00:22.9310361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9310552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9310556Z 2025-03-14T06:00:22.9310755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9310866Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9311099Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9311235Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9311442Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9311581Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9311735Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9311898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9312457Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9312992Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9313340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9313667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9318791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9319187Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9319498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9319782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9319888Z Execution Analysis: .......... 2025-03-14T06:00:22.9320131Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9320326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9320590Z pt-xla-profiler: TransferFromDeviceTime too frequent: 350 counts during 334 steps 2025-03-14T06:00:22.9320601Z 2025-03-14T06:00:22.9320791Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9320903Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9321174Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9321285Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9321476Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9321608Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9321745Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9321902Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9322241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9322568Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9322864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9323160Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9323448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9323705Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9323978Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9324103Z Execution Analysis: (:1) 2025-03-14T06:00:22.9324343Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9324638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9324643Z 2025-03-14T06:00:22.9324828Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9325147Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9325382Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9325504Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9325709Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9325860Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9326005Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9326181Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9326779Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9327363Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9327722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9328094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9328434Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9328720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9329051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9329331Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9329436Z Execution Analysis: .......... 2025-03-14T06:00:22.9329708Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9329907Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9330195Z pt-xla-profiler: TransferFromDeviceTime too frequent: 351 counts during 335 steps 2025-03-14T06:00:22.9330202Z 2025-03-14T06:00:22.9330404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9330529Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9330818Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9330934Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9331134Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9331287Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9331429Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9331607Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9331961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9332323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9332668Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9332953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9333260Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9333538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9333828Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9333961Z Execution Analysis: (:1) 2025-03-14T06:00:22.9334217Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9334430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9334435Z 2025-03-14T06:00:22.9334632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9334782Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9335011Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9335131Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9335334Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9335489Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9335634Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9335813Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9336402Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9336987Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9337431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9337793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9338078Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9338360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9338642Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9338900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9338995Z Execution Analysis: .......... 2025-03-14T06:00:22.9339239Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9339432Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9339697Z pt-xla-profiler: TransferFromDeviceTime too frequent: 352 counts during 336 steps 2025-03-14T06:00:22.9339703Z 2025-03-14T06:00:22.9339896Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9339999Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9340277Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9340378Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9340575Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9340706Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9340846Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9341000Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9341337Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9341685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9341987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9342241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9342537Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9342787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9343069Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9343180Z Execution Analysis: (:1) 2025-03-14T06:00:22.9343426Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9343611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9343640Z 2025-03-14T06:00:22.9343840Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9343947Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9344173Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9344274Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9344472Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9344601Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9344745Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9344900Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9345452Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9345977Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9346322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9346671Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9347005Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9347258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9347551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9347796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9347904Z Execution Analysis: .......... 2025-03-14T06:00:22.9348143Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9348345Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9348606Z pt-xla-profiler: TransferFromDeviceTime too frequent: 353 counts during 337 steps 2025-03-14T06:00:22.9348612Z 2025-03-14T06:00:22.9348809Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9348916Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9349196Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9349297Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9349503Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9349637Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9349776Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9349929Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9350266Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9350614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9350908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9351158Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9351449Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9351697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9351981Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9352093Z Execution Analysis: (:1) 2025-03-14T06:00:22.9352340Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9352552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9352556Z 2025-03-14T06:00:22.9352750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9352851Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9353075Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9353175Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9353372Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9353502Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9353644Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9353796Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9354347Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9354873Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9355233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9355584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9355870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9356128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9356414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9356668Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9356764Z Execution Analysis: .......... 2025-03-14T06:00:22.9357007Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9357196Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9357477Z pt-xla-profiler: TransferFromDeviceTime too frequent: 354 counts during 338 steps 2025-03-14T06:00:22.9357481Z 2025-03-14T06:00:22.9357674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9357802Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9358074Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9358197Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9358389Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9358539Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9358675Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9358845Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9359209Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9359553Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9359846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9360117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9360405Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9360672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9360947Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9361080Z Execution Analysis: (:1) 2025-03-14T06:00:22.9361322Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9361552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9361558Z 2025-03-14T06:00:22.9361749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9362047Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9362279Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9362404Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9362611Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9362768Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9362915Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9363099Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9363681Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9364260Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9364737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9365448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9365769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9366064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9366379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9366669Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9366782Z Execution Analysis: .......... 2025-03-14T06:00:22.9367062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9367271Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9367578Z pt-xla-profiler: TransferFromDeviceTime too frequent: 355 counts during 339 steps 2025-03-14T06:00:22.9367586Z 2025-03-14T06:00:22.9367791Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9367925Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9368226Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9368359Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9368568Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9368732Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9368881Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9369132Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9369495Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9369866Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9370184Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9370477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9370790Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9371080Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9371377Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9371523Z Execution Analysis: (:1) 2025-03-14T06:00:22.9371825Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9372042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9372047Z 2025-03-14T06:00:22.9372264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9372382Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9372629Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9372743Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9372949Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9373107Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9373257Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9373441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9374035Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9374664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9375078Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9375435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9375766Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9376043Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9376368Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9376643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9376769Z Execution Analysis: .......... 2025-03-14T06:00:22.9377037Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9377361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9377743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 356 counts during 340 steps 2025-03-14T06:00:22.9377748Z 2025-03-14T06:00:22.9377951Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9378062Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9378348Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9378456Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9378662Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9378801Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9378975Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9379137Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9379485Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9379816Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9380119Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9380375Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9380673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9380925Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9381214Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9381363Z Execution Analysis: (:1) 2025-03-14T06:00:22.9381617Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9381807Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9381811Z 2025-03-14T06:00:22.9382015Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9382124Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9382355Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9382461Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9382666Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9382801Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9382953Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9383116Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9383678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9384277Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9384627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9384956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9385261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9385517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9385819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9386073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9386192Z Execution Analysis: .......... 2025-03-14T06:00:22.9386435Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9386642Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9386911Z pt-xla-profiler: TransferFromDeviceTime too frequent: 357 counts during 341 steps 2025-03-14T06:00:22.9386915Z 2025-03-14T06:00:22.9387117Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9387226Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9387512Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9387617Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9387822Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9387986Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9388135Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9388295Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9388642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9388969Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9389273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9389532Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9389833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9390086Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9390396Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9390529Z Execution Analysis: (:1) 2025-03-14T06:00:22.9390771Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9390975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9390980Z 2025-03-14T06:00:22.9391167Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9391288Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9391502Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9391619Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9391809Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9391955Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9392096Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9392266Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9392914Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9393482Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9393822Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9394165Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9394457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9394726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9395016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9395282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9395384Z Execution Analysis: .......... 2025-03-14T06:00:22.9395639Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9396000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9396294Z pt-xla-profiler: TransferFromDeviceTime too frequent: 358 counts during 342 steps 2025-03-14T06:00:22.9396299Z 2025-03-14T06:00:22.9396498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9396627Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9396912Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9397038Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9397268Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9397429Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9397572Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9397753Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9398107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9398472Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9398779Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9399065Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9399369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9399677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9399966Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9400100Z Execution Analysis: (:1) 2025-03-14T06:00:22.9400360Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9400572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9400576Z 2025-03-14T06:00:22.9400776Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9400904Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9401133Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9401261Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9401463Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9401622Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9401798Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9401978Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9402577Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9403159Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9403513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9403866Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9404172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9404457Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9404871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9405319Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9405429Z Execution Analysis: .......... 2025-03-14T06:00:22.9405700Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9405904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9406207Z pt-xla-profiler: TransferFromDeviceTime too frequent: 360 counts during 343 steps 2025-03-14T06:00:22.9406212Z 2025-03-14T06:00:22.9406429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9406549Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9406882Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9406997Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9407215Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9407365Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9407519Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9407692Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9408064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9408419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9408745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9409022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9409371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9409645Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9409953Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9410082Z Execution Analysis: (:1) 2025-03-14T06:00:22.9410354Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9410561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9410566Z 2025-03-14T06:00:22.9410778Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9410896Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9411140Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9411258Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9411477Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9411652Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9411808Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9411981Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9412609Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9413189Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9413561Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9413918Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9414245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9414522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9414842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9415116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9415234Z Execution Analysis: .......... 2025-03-14T06:00:22.9415492Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9415705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9415991Z pt-xla-profiler: TransferFromDeviceTime too frequent: 361 counts during 344 steps 2025-03-14T06:00:22.9415996Z 2025-03-14T06:00:22.9416211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9416356Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9416660Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9416774Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9416990Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9417241Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9417387Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9417545Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9417890Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9418217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9418518Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9418815Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9419114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9419364Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9419646Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9419768Z Execution Analysis: (:1) 2025-03-14T06:00:22.9420022Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9420210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9420214Z 2025-03-14T06:00:22.9420413Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9420522Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9420748Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9420855Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9421101Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9421236Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9421381Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9421563Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9422119Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9422648Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9422991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9423315Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9423621Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9423885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9424176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9424438Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9424541Z Execution Analysis: .......... 2025-03-14T06:00:22.9424790Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9424981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9425255Z pt-xla-profiler: TransferFromDeviceTime too frequent: 362 counts during 345 steps 2025-03-14T06:00:22.9425260Z 2025-03-14T06:00:22.9425476Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9425596Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9425867Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9425980Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9426175Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9426317Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9426451Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9426619Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9426955Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9427290Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9427581Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9427872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9428160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9428419Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9428692Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9428818Z Execution Analysis: (:1) 2025-03-14T06:00:22.9429061Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9429259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9429263Z 2025-03-14T06:00:22.9429450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9429566Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9429783Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9429920Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9430113Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9430256Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9430421Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9430586Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9431133Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9431673Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9432006Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9432346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9432640Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9432904Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9433192Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9433451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9433552Z Execution Analysis: .......... 2025-03-14T06:00:22.9433802Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9433991Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9434264Z pt-xla-profiler: TransferFromDeviceTime too frequent: 363 counts during 346 steps 2025-03-14T06:00:22.9434296Z 2025-03-14T06:00:22.9434484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9434603Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9434872Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9434987Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9435179Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9435325Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9435457Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9435625Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9435958Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9436299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9436614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9436881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9437165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9437426Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9437698Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9437826Z Execution Analysis: (:1) 2025-03-14T06:00:22.9438065Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9438266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9438270Z 2025-03-14T06:00:22.9438461Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9438578Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9438819Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9438937Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9439127Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9439292Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9439428Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9439595Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9440138Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9440679Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9441024Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9441353Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9441652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9441910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9442204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9442458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9442566Z Execution Analysis: .......... 2025-03-14T06:00:22.9442808Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9443002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9443295Z pt-xla-profiler: TransferFromDeviceTime too frequent: 364 counts during 347 steps 2025-03-14T06:00:22.9443302Z 2025-03-14T06:00:22.9443497Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9443606Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9443888Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9443993Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9444191Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9444327Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9444469Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9444720Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9445247Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9445637Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9445966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9446245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9446566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9446839Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9447142Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9447270Z Execution Analysis: (:1) 2025-03-14T06:00:22.9447540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9447747Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9447753Z 2025-03-14T06:00:22.9447969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9448112Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9448351Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9448467Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9448963Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9449111Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9449273Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9449445Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9450046Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9450625Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9451004Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9451365Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9451697Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9451977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9452297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9452570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9452693Z Execution Analysis: .......... 2025-03-14T06:00:22.9452956Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9453215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9453504Z pt-xla-profiler: TransferFromDeviceTime too frequent: 365 counts during 348 steps 2025-03-14T06:00:22.9453510Z 2025-03-14T06:00:22.9453728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9453848Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9454153Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9454267Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9454484Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9454629Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9454784Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9454954Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9455324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9455701Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9456025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9456300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9456618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9456886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9457296Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9457410Z Execution Analysis: (:1) 2025-03-14T06:00:22.9457660Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9457852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9457887Z 2025-03-14T06:00:22.9458075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9458189Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9458429Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9458541Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9458733Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9458875Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9459010Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9459165Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9459725Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9460266Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9460602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9460936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9461228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9461492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9461776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9462033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9462132Z Execution Analysis: .......... 2025-03-14T06:00:22.9462402Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9462592Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9462867Z pt-xla-profiler: TransferFromDeviceTime too frequent: 366 counts during 349 steps 2025-03-14T06:00:22.9462872Z 2025-03-14T06:00:22.9463063Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9463179Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9463451Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9463563Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9463752Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9463895Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9464028Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9464216Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9464553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9464888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9465181Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9465920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9466236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9466518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9466814Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9466954Z Execution Analysis: (:1) 2025-03-14T06:00:22.9467219Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9467437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9467513Z 2025-03-14T06:00:22.9467718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9467880Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9468118Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9468242Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9468454Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9468612Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9468762Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9468943Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9469537Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9470124Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9470489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9470855Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9471169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9471459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9471770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9472054Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9472162Z Execution Analysis: .......... 2025-03-14T06:00:22.9472466Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9472671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9472967Z pt-xla-profiler: TransferFromDeviceTime too frequent: 367 counts during 350 steps 2025-03-14T06:00:22.9472973Z 2025-03-14T06:00:22.9473174Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9473300Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9473590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9473714Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9473916Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9474070Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9474247Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9474433Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9474793Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9475159Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9475472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9475758Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9476075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9476343Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9476651Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9476780Z Execution Analysis: (:1) 2025-03-14T06:00:22.9477053Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9477282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9477286Z 2025-03-14T06:00:22.9477521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9477639Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9477987Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9478096Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9478411Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9478546Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9478687Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9478844Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9479399Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9479931Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9480270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9480602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9480900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9481156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9481448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9481727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9481831Z Execution Analysis: .......... 2025-03-14T06:00:22.9482073Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9482268Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9482534Z pt-xla-profiler: TransferFromDeviceTime too frequent: 368 counts during 351 steps 2025-03-14T06:00:22.9482539Z 2025-03-14T06:00:22.9482736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9482845Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9483126Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9483232Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9483431Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9483594Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9483737Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9483896Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9484236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9484630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9484928Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9485366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9485684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9485956Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9486258Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9486390Z Execution Analysis: (:1) 2025-03-14T06:00:22.9486695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9486899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9486941Z 2025-03-14T06:00:22.9487153Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9487269Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9487508Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9487618Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9487835Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9487990Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9488149Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9488326Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9488931Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9489512Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9489890Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9490247Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9490577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9490856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9491183Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9491486Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9491610Z Execution Analysis: .......... 2025-03-14T06:00:22.9491873Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9492094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9492398Z pt-xla-profiler: TransferFromDeviceTime too frequent: 369 counts during 352 steps 2025-03-14T06:00:22.9492403Z 2025-03-14T06:00:22.9492611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9492745Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9493040Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9493168Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9493402Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9493561Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9493710Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9493895Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9494261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9494631Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9494947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9495237Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9495550Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9495837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9496141Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9496307Z Execution Analysis: (:1) 2025-03-14T06:00:22.9496571Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9496821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9496826Z 2025-03-14T06:00:22.9497031Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9497267Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9497498Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9497624Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9497828Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9497987Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9498134Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9498312Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9498889Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9499460Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9499812Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9500173Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9500481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9500763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9501089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9501368Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9501476Z Execution Analysis: .......... 2025-03-14T06:00:22.9501744Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9501944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9502233Z pt-xla-profiler: TransferFromDeviceTime too frequent: 370 counts during 353 steps 2025-03-14T06:00:22.9502237Z 2025-03-14T06:00:22.9502436Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9502563Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9502850Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9502998Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9503200Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9503357Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9503499Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9503679Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9504029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9504389Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9504696Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9504978Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9505279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9505561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9505876Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9506014Z Execution Analysis: (:1) 2025-03-14T06:00:22.9506294Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9506510Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9506514Z 2025-03-14T06:00:22.9506711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9506835Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9507061Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9507183Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9507388Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9507545Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9507694Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9507874Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9508450Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9509024Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9509380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9509738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9510058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9510357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9510676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9510941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9511062Z Execution Analysis: .......... 2025-03-14T06:00:22.9511316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9511529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9511809Z pt-xla-profiler: TransferFromDeviceTime too frequent: 371 counts during 354 steps 2025-03-14T06:00:22.9511813Z 2025-03-14T06:00:22.9512024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9512139Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9512465Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9512578Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9512792Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9512936Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9513095Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9513262Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9513625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9513967Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9514287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9514557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9514873Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9515162Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9515463Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9515611Z Execution Analysis: (:1) 2025-03-14T06:00:22.9515876Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9516076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9516081Z 2025-03-14T06:00:22.9516290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9516402Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9516639Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9516751Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9516964Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9517110Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9517266Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9517433Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9518026Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9518587Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9518948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9519295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9519812Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9520090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9520413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9520686Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9520806Z Execution Analysis: .......... 2025-03-14T06:00:22.9521066Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9521282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9521569Z pt-xla-profiler: TransferFromDeviceTime too frequent: 372 counts during 355 steps 2025-03-14T06:00:22.9521574Z 2025-03-14T06:00:22.9521790Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9521934Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9522237Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9522354Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9522571Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9522719Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9522873Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9523045Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9523415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9523772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9524097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9524377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9524772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9525094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9525429Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9525558Z Execution Analysis: (:1) 2025-03-14T06:00:22.9525830Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9526034Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9526050Z 2025-03-14T06:00:22.9526254Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9526384Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9526623Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9526737Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9526962Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9527108Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9527271Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9527444Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9528050Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9528640Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9529000Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9529397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9529715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9530005Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9530316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9530599Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9530708Z Execution Analysis: .......... 2025-03-14T06:00:22.9530979Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9531185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9531483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 373 counts during 356 steps 2025-03-14T06:00:22.9531513Z 2025-03-14T06:00:22.9531723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9531854Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9532148Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9532277Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9532487Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9532650Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9532797Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9532983Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9533346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9533712Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9534032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9534323Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9534660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9534970Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9535267Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9535406Z Execution Analysis: (:1) 2025-03-14T06:00:22.9535671Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9535893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9535897Z 2025-03-14T06:00:22.9536103Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9536238Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9536474Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9536603Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9536811Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9536974Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9537127Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9537362Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9537957Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9538547Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9538911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9539305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9539626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9540025Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9540328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9540608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9540716Z Execution Analysis: .......... 2025-03-14T06:00:22.9541085Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9541277Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9541664Z pt-xla-profiler: TransferFromDeviceTime too frequent: 374 counts during 357 steps 2025-03-14T06:00:22.9541670Z 2025-03-14T06:00:22.9541862Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9541987Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9542262Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9542380Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9542571Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9542720Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9542856Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9543027Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9543358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9543700Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9543995Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9544287Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9544573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9544856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9545131Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9545260Z Execution Analysis: (:1) 2025-03-14T06:00:22.9545503Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9545704Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9545708Z 2025-03-14T06:00:22.9545912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9546020Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9546252Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9546360Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9546565Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9546701Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9546850Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9547008Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9547563Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9548096Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9548466Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9548798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9549104Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9549363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9549664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9549917Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9550029Z Execution Analysis: .......... 2025-03-14T06:00:22.9550270Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9550475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9550768Z pt-xla-profiler: TransferFromDeviceTime too frequent: 375 counts during 358 steps 2025-03-14T06:00:22.9550773Z 2025-03-14T06:00:22.9550974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9551084Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9551366Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9551471Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9551674Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9551810Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9551956Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9552113Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9552461Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9552793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9553119Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9553376Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9553698Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9553954Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9554236Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9554356Z Execution Analysis: (:1) 2025-03-14T06:00:22.9554609Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9554800Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9554806Z 2025-03-14T06:00:22.9555007Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9555117Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9555346Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9555454Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9555657Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9555793Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9555945Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9556104Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9556664Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9557216Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9557566Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9557892Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9558198Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9558451Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9558749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9558998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9559111Z Execution Analysis: .......... 2025-03-14T06:00:22.9559350Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9559601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9559868Z pt-xla-profiler: TransferFromDeviceTime too frequent: 376 counts during 359 steps 2025-03-14T06:00:22.9559885Z 2025-03-14T06:00:22.9560075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9560198Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9560469Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9560585Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9560779Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9560913Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9561061Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9561217Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9561566Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9561914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9562216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9562505Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9562793Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9563052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9563325Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9563457Z Execution Analysis: (:1) 2025-03-14T06:00:22.9563699Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9563904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9563909Z 2025-03-14T06:00:22.9564097Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9564214Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9564431Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9564634Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9564829Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9565142Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9565419Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9565604Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9566198Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9566854Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9567221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9567589Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9567905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9568193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9568504Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9568791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9568903Z Execution Analysis: .......... 2025-03-14T06:00:22.9569217Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9569428Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9569731Z pt-xla-profiler: TransferFromDeviceTime too frequent: 377 counts during 360 steps 2025-03-14T06:00:22.9569736Z 2025-03-14T06:00:22.9569943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9570072Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9570365Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9570489Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9570696Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9570854Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9570998Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9571183Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9571551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9571954Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9572305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9572596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9572907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9573190Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9573484Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9573622Z Execution Analysis: (:1) 2025-03-14T06:00:22.9573885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9574100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9574106Z 2025-03-14T06:00:22.9574311Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9574451Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9574686Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9574816Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9575024Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9575186Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9575337Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9575523Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9576142Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9576739Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9577216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9577677Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9577970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9578248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9578537Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9578808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9578937Z Execution Analysis: .......... 2025-03-14T06:00:22.9579194Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9579403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9579674Z pt-xla-profiler: TransferFromDeviceTime too frequent: 378 counts during 361 steps 2025-03-14T06:00:22.9579678Z 2025-03-14T06:00:22.9579883Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9579995Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9580281Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9580390Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9580598Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9580736Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9580891Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9581053Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9581425Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9581784Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9582094Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9582353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9582657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9582907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9583197Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9583319Z Execution Analysis: (:1) 2025-03-14T06:00:22.9583578Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9583774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9583778Z 2025-03-14T06:00:22.9583988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9584098Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9584332Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9584442Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9584647Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9584783Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9584937Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9585095Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9585678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9586214Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9586561Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9586891Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9587195Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9587451Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9587752Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9588031Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9588145Z Execution Analysis: .......... 2025-03-14T06:00:22.9588384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9588587Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9588853Z pt-xla-profiler: TransferFromDeviceTime too frequent: 379 counts during 362 steps 2025-03-14T06:00:22.9588857Z 2025-03-14T06:00:22.9589058Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9589166Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9589448Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9589556Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9589760Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9589900Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9590048Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9590233Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9590583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9591109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9591433Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9591706Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9592023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9592289Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9592592Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9592717Z Execution Analysis: (:1) 2025-03-14T06:00:22.9592985Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9593189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9593193Z 2025-03-14T06:00:22.9593403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9593517Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9593760Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9593870Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9594089Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9594231Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9594393Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9594602Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9595197Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9595757Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9596124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9596484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9596790Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9597077Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9597410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9597691Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9597802Z Execution Analysis: .......... 2025-03-14T06:00:22.9598073Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9598277Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9598572Z pt-xla-profiler: TransferFromDeviceTime too frequent: 381 counts during 363 steps 2025-03-14T06:00:22.9598577Z 2025-03-14T06:00:22.9598775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9598903Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9599188Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9599312Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9599515Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9599697Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9599838Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9600017Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9600395Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9600752Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9601056Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9601339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9601641Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9601917Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9602208Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9602515Z Execution Analysis: (:1) 2025-03-14T06:00:22.9602777Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9602996Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9603001Z 2025-03-14T06:00:22.9603205Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9603334Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9603567Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9603692Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9603902Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9604059Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9604239Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9604426Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9605118Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9605709Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9606073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9606440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9606758Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9607048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9607392Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9607679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9607787Z Execution Analysis: .......... 2025-03-14T06:00:22.9608062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9608266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9608566Z pt-xla-profiler: TransferFromDeviceTime too frequent: 382 counts during 364 steps 2025-03-14T06:00:22.9608573Z 2025-03-14T06:00:22.9608779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9608908Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9609203Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9609333Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9609569Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9609728Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9609874Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9610082Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9610444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9610812Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9611128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9611419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9611730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9612021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9612317Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9612460Z Execution Analysis: (:1) 2025-03-14T06:00:22.9612726Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9612947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9612952Z 2025-03-14T06:00:22.9613173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9613290Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9613545Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9613660Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9613872Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9614055Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9614207Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9614390Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9614981Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9615571Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9615948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9616303Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9616633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9616945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9617376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9617645Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9617764Z Execution Analysis: .......... 2025-03-14T06:00:22.9618020Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9618233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9618516Z pt-xla-profiler: TransferFromDeviceTime too frequent: 383 counts during 365 steps 2025-03-14T06:00:22.9618520Z 2025-03-14T06:00:22.9618735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9618854Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9619156Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9619296Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9619512Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9619658Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9619840Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9620010Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9620375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9620723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9621044Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9621316Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9621639Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9621909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9622212Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9622340Z Execution Analysis: (:1) 2025-03-14T06:00:22.9622612Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9622816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9622820Z 2025-03-14T06:00:22.9623037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9623153Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9623398Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9623513Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9623755Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9623902Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9624060Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9624228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9624824Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9625387Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9625754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9626105Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9626452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9626727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9627048Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9627317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9627441Z Execution Analysis: .......... 2025-03-14T06:00:22.9627697Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9627913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9628303Z pt-xla-profiler: TransferFromDeviceTime too frequent: 384 counts during 366 steps 2025-03-14T06:00:22.9628309Z 2025-03-14T06:00:22.9628511Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9628627Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9628939Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9629045Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9629247Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9629418Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9629562Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9629721Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9630066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9630394Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9630699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9630960Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9631257Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9631510Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9631799Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9631930Z Execution Analysis: (:1) 2025-03-14T06:00:22.9632170Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9632376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9632380Z 2025-03-14T06:00:22.9632569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9632690Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9632938Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9633055Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9633249Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9633402Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9633544Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9633716Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9634264Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9634813Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9635152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9635526Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9635822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9636092Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9636379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9636647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9636748Z Execution Analysis: .......... 2025-03-14T06:00:22.9636999Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9637190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9637468Z pt-xla-profiler: TransferFromDeviceTime too frequent: 385 counts during 367 steps 2025-03-14T06:00:22.9637474Z 2025-03-14T06:00:22.9637664Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9637809Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9638081Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9638201Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9638418Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9638567Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9638703Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9638871Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9639206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9639548Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9639846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9640116Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9640406Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9640674Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9640948Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9641081Z Execution Analysis: (:1) 2025-03-14T06:00:22.9641322Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9641526Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9641531Z 2025-03-14T06:00:22.9641720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9641865Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9642084Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9642204Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9642398Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9642547Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9642683Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9642855Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9643401Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9643944Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9644282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9644730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9645200Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9645500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9645811Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9646098Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9646208Z Execution Analysis: .......... 2025-03-14T06:00:22.9646482Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9646688Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9646993Z pt-xla-profiler: TransferFromDeviceTime too frequent: 386 counts during 368 steps 2025-03-14T06:00:22.9646998Z 2025-03-14T06:00:22.9647249Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9647368Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9647697Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9647811Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9648030Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9648177Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9648334Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9648505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9648881Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9649236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9649568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9649849Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9650173Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9650443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9650751Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9650878Z Execution Analysis: (:1) 2025-03-14T06:00:22.9651151Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9651355Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9651361Z 2025-03-14T06:00:22.9651602Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9651722Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9651968Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9652081Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9652302Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9652447Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9652606Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9652777Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9653380Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9653957Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9654360Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9654718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9655050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9655327Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9655652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9655926Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9656053Z Execution Analysis: .......... 2025-03-14T06:00:22.9656315Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9656533Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9656824Z pt-xla-profiler: TransferFromDeviceTime too frequent: 387 counts during 369 steps 2025-03-14T06:00:22.9656857Z 2025-03-14T06:00:22.9657081Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9657305Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9657612Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9657718Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9657923Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9658059Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9658205Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9658366Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9658711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9659041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9659347Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9659603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9659905Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9660157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9660441Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9660566Z Execution Analysis: (:1) 2025-03-14T06:00:22.9660820Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9661011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9661040Z 2025-03-14T06:00:22.9661245Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9661358Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9661592Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9661701Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9661908Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9662048Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9662201Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9662359Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9662925Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9663460Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9663837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9664166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9664473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9664747Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9665036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9665423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9665528Z Execution Analysis: .......... 2025-03-14T06:00:22.9665966Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9666299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9666675Z pt-xla-profiler: TransferFromDeviceTime too frequent: 388 counts during 370 steps 2025-03-14T06:00:22.9666680Z 2025-03-14T06:00:22.9666923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9667057Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9667354Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9667484Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9667693Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9667858Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9668005Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9668194Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9668562Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9668934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9669251Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9669545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9669859Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9670148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9670446Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9670591Z Execution Analysis: (:1) 2025-03-14T06:00:22.9670854Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9671108Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9671115Z 2025-03-14T06:00:22.9671322Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9671450Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9671686Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9671814Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9672021Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9672180Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9672329Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9672513Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9673104Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9673730Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9674094Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9674462Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9674777Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9675064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9675375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9675659Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9675767Z Execution Analysis: .......... 2025-03-14T06:00:22.9676047Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9676279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9676581Z pt-xla-profiler: TransferFromDeviceTime too frequent: 389 counts during 371 steps 2025-03-14T06:00:22.9676587Z 2025-03-14T06:00:22.9676816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9676949Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9677244Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9677372Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9677581Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9677745Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9678001Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9678292Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9678626Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9678970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9679268Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9679533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9679823Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9680087Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9680361Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9680494Z Execution Analysis: (:1) 2025-03-14T06:00:22.9680763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9680971Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9680976Z 2025-03-14T06:00:22.9681165Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9681288Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9681506Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9681623Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9681816Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9681965Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9682104Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9682275Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9682825Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9683397Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9683748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9684077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9684384Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9684708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9685187Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9685461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9685592Z Execution Analysis: .......... 2025-03-14T06:00:22.9685855Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9686108Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9686419Z pt-xla-profiler: TransferFromDeviceTime too frequent: 390 counts during 372 steps 2025-03-14T06:00:22.9686425Z 2025-03-14T06:00:22.9686643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9686760Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9687064Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9687179Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9687396Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9687542Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9687703Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9687873Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9688250Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9688606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9688934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9689209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9689532Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9689806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9690113Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9690337Z Execution Analysis: (:1) 2025-03-14T06:00:22.9690615Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9690822Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9690827Z 2025-03-14T06:00:22.9691047Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9691164Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9691411Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9691525Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9691747Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9691892Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9692054Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9692252Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9692858Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9693436Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9693812Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9694167Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9694493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9694768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9695091Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9695367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9695519Z Execution Analysis: .......... 2025-03-14T06:00:22.9695778Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9696018Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9696309Z pt-xla-profiler: TransferFromDeviceTime too frequent: 391 counts during 373 steps 2025-03-14T06:00:22.9696314Z 2025-03-14T06:00:22.9696535Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9696653Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9696958Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9697072Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9697392Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9697541Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9697698Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9697865Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9698233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9698579Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9698899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9699170Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9699489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9699756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9700088Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9700219Z Execution Analysis: (:1) 2025-03-14T06:00:22.9700492Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9700699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9700716Z 2025-03-14T06:00:22.9700915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9701041Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9701268Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9701383Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9706216Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9706381Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9706624Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9706793Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9707488Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9708024Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9708374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9708709Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9708999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9709265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9709555Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9709845Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9709944Z Execution Analysis: .......... 2025-03-14T06:00:22.9710223Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9710414Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9710686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 392 counts during 374 steps 2025-03-14T06:00:22.9710694Z 2025-03-14T06:00:22.9710881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9711000Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9711270Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9711384Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9711573Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9711718Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9711850Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9712009Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9712342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9712673Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9712960Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9713220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9713504Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9713791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9714061Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9714187Z Execution Analysis: (:1) 2025-03-14T06:00:22.9714427Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9714623Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9714628Z 2025-03-14T06:00:22.9714812Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9714923Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9715136Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9715246Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9715434Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9715604Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9715738Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9715906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9716453Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9716992Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9717322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9717657Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9717944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9718208Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9718489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9718769Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9718865Z Execution Analysis: .......... 2025-03-14T06:00:22.9719134Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9719321Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9719597Z pt-xla-profiler: TransferFromDeviceTime too frequent: 393 counts during 375 steps 2025-03-14T06:00:22.9719602Z 2025-03-14T06:00:22.9719786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9719900Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9720169Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9720281Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9720468Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9720610Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9720743Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9720911Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9721239Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9721571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9721858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9722117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9722398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9722688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9722961Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9723091Z Execution Analysis: (:1) 2025-03-14T06:00:22.9723331Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9723526Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9723530Z 2025-03-14T06:00:22.9723722Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9723826Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9724038Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9724150Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9724368Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9724610Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9724751Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9725082Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9725674Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9726256Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9726623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9726976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9727300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9727579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9727934Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9728229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9728347Z Execution Analysis: .......... 2025-03-14T06:00:22.9728606Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9728818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9729102Z pt-xla-profiler: TransferFromDeviceTime too frequent: 394 counts during 376 steps 2025-03-14T06:00:22.9729108Z 2025-03-14T06:00:22.9729319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9729433Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9729734Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9729843Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9730056Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9730197Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9730352Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9730521Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9730889Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9731236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9731560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9731831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9732173Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9732441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9732744Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9732868Z Execution Analysis: (:1) 2025-03-14T06:00:22.9733136Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9733335Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9733340Z 2025-03-14T06:00:22.9733551Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9733666Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9733903Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9734039Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9734252Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9734395Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9734550Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9734715Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9735318Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9735890Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9736256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9736608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9736937Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9737336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9737628Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9737900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9738011Z Execution Analysis: .......... 2025-03-14T06:00:22.9738250Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9738447Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9738709Z pt-xla-profiler: TransferFromDeviceTime too frequent: 395 counts during 377 steps 2025-03-14T06:00:22.9738714Z 2025-03-14T06:00:22.9738915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9739019Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9739300Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9739405Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9739605Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9739735Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9739874Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9740029Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9740366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9740687Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9740983Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9741271Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9741566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9741814Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9742094Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9742209Z Execution Analysis: (:1) 2025-03-14T06:00:22.9742455Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9742650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9742655Z 2025-03-14T06:00:22.9742837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9742978Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9743191Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9743301Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9743488Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9743630Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9743765Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9743927Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9744470Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9745007Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9745347Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9745693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9746012Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9746282Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9746597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9746864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9746968Z Execution Analysis: .......... 2025-03-14T06:00:22.9747221Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9747415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9747695Z pt-xla-profiler: TransferFromDeviceTime too frequent: 396 counts during 378 steps 2025-03-14T06:00:22.9747701Z 2025-03-14T06:00:22.9747896Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9748023Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9748296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9748417Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9748611Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9748764Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9748900Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9749076Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9749412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9749755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9750073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9750348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9750637Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9750906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9751184Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9751322Z Execution Analysis: (:1) 2025-03-14T06:00:22.9751566Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9751773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9751777Z 2025-03-14T06:00:22.9751969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9752120Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9752342Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9752466Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9752661Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9752815Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9752957Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9753132Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9753681Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9754231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9754573Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9754921Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9755239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9755539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9755829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9756096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9756200Z Execution Analysis: .......... 2025-03-14T06:00:22.9756459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9756652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9756938Z pt-xla-profiler: TransferFromDeviceTime too frequent: 397 counts during 379 steps 2025-03-14T06:00:22.9756945Z 2025-03-14T06:00:22.9757152Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9757264Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9757555Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9757664Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9757873Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9758010Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9758145Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9758323Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9758659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9759024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9759330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9759588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9759889Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9760144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9760428Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9760546Z Execution Analysis: (:1) 2025-03-14T06:00:22.9760799Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9760989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9761017Z 2025-03-14T06:00:22.9761219Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9761332Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9761558Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9761664Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9761869Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9762004Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9762155Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9762313Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9762875Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9763409Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9763764Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9764120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9764452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9764791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9765277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9765721Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9765842Z Execution Analysis: .......... 2025-03-14T06:00:22.9766104Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9766327Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9766617Z pt-xla-profiler: TransferFromDeviceTime too frequent: 398 counts during 380 steps 2025-03-14T06:00:22.9766625Z 2025-03-14T06:00:22.9766844Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9766964Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9767270Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9767385Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9767604Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9767752Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9767911Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9768083Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9768458Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9768889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9769225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9769508Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9769837Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9770112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9770425Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9770557Z Execution Analysis: (:1) 2025-03-14T06:00:22.9770842Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9771052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9771093Z 2025-03-14T06:00:22.9771317Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9771435Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9771683Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9771798Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9772018Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9772165Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9772327Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9772499Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9773106Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9773688Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9774101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9774502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9774833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9775111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9775439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9775724Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9775833Z Execution Analysis: .......... 2025-03-14T06:00:22.9776094Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9776317Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9776620Z pt-xla-profiler: TransferFromDeviceTime too frequent: 399 counts during 381 steps 2025-03-14T06:00:22.9776626Z 2025-03-14T06:00:22.9776834Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9776965Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9777382Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9777510Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9777814Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9777963Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9778099Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9778271Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9778631Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9778975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9779267Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9779537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9779825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9780088Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9780364Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9780494Z Execution Analysis: (:1) 2025-03-14T06:00:22.9780734Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9780963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9780969Z 2025-03-14T06:00:22.9781158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9781281Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9781500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9781618Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9781809Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9781956Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9782095Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9782266Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9782816Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9783362Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9783899Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9784284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9784592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9784873Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9785179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9785459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9785568Z Execution Analysis: .......... 2025-03-14T06:00:22.9785836Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9786040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9786336Z pt-xla-profiler: TransferFromDeviceTime too frequent: 400 counts during 382 steps 2025-03-14T06:00:22.9786344Z 2025-03-14T06:00:22.9786545Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9786674Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9786959Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9787085Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9787286Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9787443Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9787586Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9787797Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9788152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9788509Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9788818Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9789101Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9789405Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9789684Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9789971Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9790107Z Execution Analysis: (:1) 2025-03-14T06:00:22.9790392Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9790608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9790613Z 2025-03-14T06:00:22.9790820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9790945Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9791172Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9791294Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9791496Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9791651Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9791795Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9791973Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9792553Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9793157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9793542Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9793888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9794208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9794482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9794791Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9795222Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9795348Z Execution Analysis: .......... 2025-03-14T06:00:22.9795614Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9795829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9796123Z pt-xla-profiler: TransferFromDeviceTime too frequent: 402 counts during 383 steps 2025-03-14T06:00:22.9796128Z 2025-03-14T06:00:22.9796344Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9796461Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9796767Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9796881Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9797098Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9797249Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9797427Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9797603Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9797970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9798328Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9798655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9798932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9799256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9799530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9799836Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9799991Z Execution Analysis: (:1) 2025-03-14T06:00:22.9800263Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9800468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9800473Z 2025-03-14T06:00:22.9800689Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9800808Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9801053Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9801169Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9801387Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9801531Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9801689Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9801862Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9802462Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9803085Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9803455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9803808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9804129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9804405Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9804820Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9805101Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9805221Z Execution Analysis: .......... 2025-03-14T06:00:22.9805482Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9805699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9805985Z pt-xla-profiler: TransferFromDeviceTime too frequent: 403 counts during 384 steps 2025-03-14T06:00:22.9805990Z 2025-03-14T06:00:22.9806203Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9806318Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9806622Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9806735Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9806952Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9807128Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9807287Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9807459Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9807832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9808185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9808508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9808783Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9809101Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9809369Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9809705Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9809832Z Execution Analysis: (:1) 2025-03-14T06:00:22.9810104Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9810305Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9810321Z 2025-03-14T06:00:22.9810526Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9810650Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9810885Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9811005Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9811211Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9811354Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9811519Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9811688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9812328Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9812941Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9813305Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9813669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9813984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9814268Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9814581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9814862Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9814971Z Execution Analysis: .......... 2025-03-14T06:00:22.9815238Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9815443Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9815742Z pt-xla-profiler: TransferFromDeviceTime too frequent: 404 counts during 385 steps 2025-03-14T06:00:22.9815746Z 2025-03-14T06:00:22.9815952Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9816078Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9816371Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9816496Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9816728Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9816886Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9817135Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9817300Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9817635Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9817967Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9818258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9818522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9818808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9819098Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9819370Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9819494Z Execution Analysis: (:1) 2025-03-14T06:00:22.9819737Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9819933Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9819937Z 2025-03-14T06:00:22.9820125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9820242Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9820459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9820568Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9820761Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9820908Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9821044Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9821236Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9821808Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9822348Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9822683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9823019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9823310Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9823576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9823861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9824121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9824221Z Execution Analysis: .......... 2025-03-14T06:00:22.9824473Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9824660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9824933Z pt-xla-profiler: TransferFromDeviceTime too frequent: 405 counts during 386 steps 2025-03-14T06:00:22.9824938Z 2025-03-14T06:00:22.9825125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9825245Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9825541Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9825656Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9825847Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9825990Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9826121Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9826288Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9826619Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9826957Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9827244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9827512Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9827827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9828090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9828374Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9828493Z Execution Analysis: (:1) 2025-03-14T06:00:22.9828744Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9828934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9828938Z 2025-03-14T06:00:22.9829133Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9829243Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9829465Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9829571Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9829771Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9829931Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9830073Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9830231Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9830809Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9831344Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9831690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9832015Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9832313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9832572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9832871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9833125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9833233Z Execution Analysis: .......... 2025-03-14T06:00:22.9833476Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9833674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9833939Z pt-xla-profiler: TransferFromDeviceTime too frequent: 406 counts during 387 steps 2025-03-14T06:00:22.9833943Z 2025-03-14T06:00:22.9834143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9834254Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9834559Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9834668Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9834868Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9835007Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9835150Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9835311Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9835655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9835985Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9836288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9836548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9836868Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9837122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9837407Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9837528Z Execution Analysis: (:1) 2025-03-14T06:00:22.9837779Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9837971Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9837975Z 2025-03-14T06:00:22.9838176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9838283Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9838513Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9838623Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9838843Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9838981Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9839129Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9839388Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9839946Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9840482Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9840828Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9841155Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9841466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9841723Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9842028Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9842277Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9842390Z Execution Analysis: .......... 2025-03-14T06:00:22.9842629Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9842830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9843097Z pt-xla-profiler: TransferFromDeviceTime too frequent: 407 counts during 388 steps 2025-03-14T06:00:22.9843112Z 2025-03-14T06:00:22.9843332Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9843448Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9843721Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9843829Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9844021Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9844162Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9844296Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9844450Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9844872Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9845398Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9845713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9846044Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9846361Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9846639Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9846936Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9847070Z Execution Analysis: (:1) 2025-03-14T06:00:22.9847331Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9847544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9847548Z 2025-03-14T06:00:22.9847750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9847876Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9848112Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9848256Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9848464Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9848616Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9848786Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9848962Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9849555Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9850136Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9850499Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9850866Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9851182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9851468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9851779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9852056Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9852165Z Execution Analysis: .......... 2025-03-14T06:00:22.9852433Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9852638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9852931Z pt-xla-profiler: TransferFromDeviceTime too frequent: 408 counts during 389 steps 2025-03-14T06:00:22.9852938Z 2025-03-14T06:00:22.9853165Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9853295Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9853587Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9853712Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9853918Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9854073Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9854218Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9854400Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9854760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9855123Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9855466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9855756Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9856069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9856357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9856651Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9856786Z Execution Analysis: (:1) 2025-03-14T06:00:22.9857048Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9857371Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9857375Z 2025-03-14T06:00:22.9857564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9857682Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9857925Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9858039Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9858231Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9858395Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9858533Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9858698Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9859243Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9859785Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9860119Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9860454Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9860740Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9861003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9861294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9861545Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9861650Z Execution Analysis: .......... 2025-03-14T06:00:22.9861889Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9862085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9862373Z pt-xla-profiler: TransferFromDeviceTime too frequent: 409 counts during 390 steps 2025-03-14T06:00:22.9862380Z 2025-03-14T06:00:22.9862576Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9862684Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9862962Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9863066Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9863265Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9863404Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9863545Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9863702Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9864042Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9864393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9864692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9864947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9865242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9865810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9866116Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9866243Z Execution Analysis: (:1) 2025-03-14T06:00:22.9866513Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9866718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9866725Z 2025-03-14T06:00:22.9866938Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9867117Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9867363Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9867478Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9867729Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9867879Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9868038Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9868206Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9868803Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9869381Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9869757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9870114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9870438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9870714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9871034Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9871305Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9871423Z Execution Analysis: .......... 2025-03-14T06:00:22.9871680Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9871930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9872220Z pt-xla-profiler: TransferFromDeviceTime too frequent: 410 counts during 391 steps 2025-03-14T06:00:22.9872225Z 2025-03-14T06:00:22.9872439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9872558Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9872858Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9872971Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9873187Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9873331Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9873486Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9873657Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9874027Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9874414Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9874741Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9875020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9875342Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9875614Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9875928Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9876055Z Execution Analysis: (:1) 2025-03-14T06:00:22.9876327Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9876537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9876541Z 2025-03-14T06:00:22.9876785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9876902Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9877174Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9877287Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9877508Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9877655Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9877817Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9877990Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9878594Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9879189Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9879556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9879927Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9880244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9880535Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9880847Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9881133Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9881244Z Execution Analysis: .......... 2025-03-14T06:00:22.9881554Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9881767Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9882067Z pt-xla-profiler: TransferFromDeviceTime too frequent: 411 counts during 392 steps 2025-03-14T06:00:22.9882072Z 2025-03-14T06:00:22.9882281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9882411Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9882709Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9882840Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9883050Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9883208Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9883354Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9883540Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9883935Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9884300Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9884695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9884988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9885302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9885584Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9885882Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9886025Z Execution Analysis: (:1) 2025-03-14T06:00:22.9886291Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9886513Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9886547Z 2025-03-14T06:00:22.9886756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9886907Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9887142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9887264Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9887473Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9887631Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9887781Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9887965Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9888556Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9889141Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9889506Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9889874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9890190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9890478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9890789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9891068Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9891178Z Execution Analysis: .......... 2025-03-14T06:00:22.9891475Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9891682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9891983Z pt-xla-profiler: TransferFromDeviceTime too frequent: 412 counts during 393 steps 2025-03-14T06:00:22.9891987Z 2025-03-14T06:00:22.9892192Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9892321Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9892611Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9892733Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9892942Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9893101Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9893270Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9893458Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9893818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9894180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9894495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9894784Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9895096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9895379Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9895675Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9895813Z Execution Analysis: (:1) 2025-03-14T06:00:22.9896076Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9896322Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9896326Z 2025-03-14T06:00:22.9896565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9896683Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9896927Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9897147Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9897358Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9897500Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9897660Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9897825Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9898417Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9898981Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9899348Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9899694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9900011Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9900283Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9900600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9900911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9901029Z Execution Analysis: .......... 2025-03-14T06:00:22.9901287Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9901497Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9901780Z pt-xla-profiler: TransferFromDeviceTime too frequent: 413 counts during 394 steps 2025-03-14T06:00:22.9901785Z 2025-03-14T06:00:22.9901993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9902108Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9902407Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9902519Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9902733Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9902905Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9903063Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9903233Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9903593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9903940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9904257Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9904527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9904840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9905104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9905403Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9905531Z Execution Analysis: (:1) 2025-03-14T06:00:22.9905820Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9906019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9906048Z 2025-03-14T06:00:22.9906260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9906373Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9906613Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9906725Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9906939Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9907081Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9907342Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9907504Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9908063Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9908596Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9908942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9909266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9909568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9909823Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9910119Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9910395Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9910510Z Execution Analysis: .......... 2025-03-14T06:00:22.9910749Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9910953Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9911220Z pt-xla-profiler: TransferFromDeviceTime too frequent: 414 counts during 395 steps 2025-03-14T06:00:22.9911235Z 2025-03-14T06:00:22.9911424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9911545Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9911816Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9911921Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9912154Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9912290Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9912437Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9912594Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9912940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9913267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9913571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9913837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9914126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9914389Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9914665Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9914819Z Execution Analysis: (:1) 2025-03-14T06:00:22.9915063Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9915304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9915309Z 2025-03-14T06:00:22.9915498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9915617Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9915834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9915947Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9916141Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9916286Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9916426Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9916596Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9917146Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9917691Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9918028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9918368Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9918662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9918932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9919243Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9919512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9919615Z Execution Analysis: .......... 2025-03-14T06:00:22.9919873Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9920065Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9920344Z pt-xla-profiler: TransferFromDeviceTime too frequent: 415 counts during 396 steps 2025-03-14T06:00:22.9920349Z 2025-03-14T06:00:22.9920540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9920662Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9920934Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9921078Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9921271Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9921424Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9921561Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9921739Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9922075Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9922419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9922714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9922985Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9923276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9923545Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9923845Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9923976Z Execution Analysis: (:1) 2025-03-14T06:00:22.9924247Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9924450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9924455Z 2025-03-14T06:00:22.9924713Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9924836Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9925234Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9925364Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9925573Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9925743Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9925894Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9926078Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9926674Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9927265Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9927628Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9927996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9928314Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9928636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9928951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9929234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9929348Z Execution Analysis: .......... 2025-03-14T06:00:22.9929622Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9929835Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9930123Z pt-xla-profiler: TransferFromDeviceTime too frequent: 416 counts during 397 steps 2025-03-14T06:00:22.9930128Z 2025-03-14T06:00:22.9930345Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9930462Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9930791Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9930904Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9931121Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9931267Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9931429Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9931600Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9931972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9932326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9932651Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9932929Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9933259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9933561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9933865Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9934017Z Execution Analysis: (:1) 2025-03-14T06:00:22.9934289Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9934495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9934499Z 2025-03-14T06:00:22.9934714Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9934832Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9935076Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9935192Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9935414Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9935560Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9935727Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9935898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9936505Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9937085Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9937459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9937816Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9938175Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9938456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9938780Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9939053Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9939173Z Execution Analysis: .......... 2025-03-14T06:00:22.9939432Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9939648Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9939937Z pt-xla-profiler: TransferFromDeviceTime too frequent: 417 counts during 398 steps 2025-03-14T06:00:22.9939942Z 2025-03-14T06:00:22.9940161Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9940641Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9940949Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9941067Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9941291Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9941443Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9941603Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9941883Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9942250Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9942595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9942915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9943190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9943506Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9943800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9944125Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9944252Z Execution Analysis: (:1) 2025-03-14T06:00:22.9944517Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9944718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9944722Z 2025-03-14T06:00:22.9944931Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9945044Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9945288Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9945400Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9945613Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9945754Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9945910Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9946077Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9946666Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9947389Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9947765Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9948156Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9948475Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9948762Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9949074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9949358Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9949467Z Execution Analysis: .......... 2025-03-14T06:00:22.9949740Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9949944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9950241Z pt-xla-profiler: TransferFromDeviceTime too frequent: 418 counts during 399 steps 2025-03-14T06:00:22.9950273Z 2025-03-14T06:00:22.9950480Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9950608Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9950901Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9951025Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9951233Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9951388Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9951533Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9951716Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9952077Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9952543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9952849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9953136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9953482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9953756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9954070Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9954207Z Execution Analysis: (:1) 2025-03-14T06:00:22.9954467Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9954677Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9954682Z 2025-03-14T06:00:22.9954881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9955009Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9955240Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9955366Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9955569Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9955722Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9955872Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9956050Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9956628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9957200Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9957554Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9957944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9958253Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9958539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9958845Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9959229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9959333Z Execution Analysis: .......... 2025-03-14T06:00:22.9959590Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9959781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9960060Z pt-xla-profiler: TransferFromDeviceTime too frequent: 419 counts during 400 steps 2025-03-14T06:00:22.9960089Z 2025-03-14T06:00:22.9960281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9960403Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9960675Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9960795Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9960988Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9961137Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9961273Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9961440Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9961774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9962112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9962413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9962710Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9962997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9963286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9963562Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9963696Z Execution Analysis: (:1) 2025-03-14T06:00:22.9963938Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9964143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9964147Z 2025-03-14T06:00:22.9964352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9964463Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9964779Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9964887Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9965258Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9965568Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9965719Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9965906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9966505Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9967100Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9967538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9967898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9968230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9968512Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9968841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9969115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9969242Z Execution Analysis: .......... 2025-03-14T06:00:22.9969506Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9969727Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9970058Z pt-xla-profiler: TransferFromDeviceTime too frequent: 420 counts during 401 steps 2025-03-14T06:00:22.9970066Z 2025-03-14T06:00:22.9970287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9970409Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9970718Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9970835Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9971056Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9971207Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9971369Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9971543Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9971919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9972281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9972644Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9972926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9973283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9973559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9973868Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9973998Z Execution Analysis: (:1) 2025-03-14T06:00:22.9974274Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9974479Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9974486Z 2025-03-14T06:00:22.9974705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9974824Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9975072Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9975186Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9975404Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9975549Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9975709Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9975880Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9976485Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9977202Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9977573Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9977922Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9978244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9978514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9978829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9979095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9979214Z Execution Analysis: .......... 2025-03-14T06:00:22.9979468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9979708Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9979992Z pt-xla-profiler: TransferFromDeviceTime too frequent: 421 counts during 402 steps 2025-03-14T06:00:22.9979996Z 2025-03-14T06:00:22.9980211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9980329Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9980630Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9980741Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9980956Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9981099Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9981251Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9981416Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9981787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9982132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9982479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9982774Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9983090Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9983356Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9983657Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9983794Z Execution Analysis: (:1) 2025-03-14T06:00:22.9984048Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9984264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9984270Z 2025-03-14T06:00:22.9984470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9984597Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9984827Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9984951Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9985154Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9985314Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9985460Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9985639Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9986219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9986819Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9987281Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9987621Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9987913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9988186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9988474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9988739Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9988841Z Execution Analysis: .......... 2025-03-14T06:00:22.9989134Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9989324Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9989610Z pt-xla-profiler: TransferFromDeviceTime too frequent: 423 counts during 403 steps 2025-03-14T06:00:22.9989615Z 2025-03-14T06:00:22.9989807Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9989928Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9990198Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9990316Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9990506Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:22.9990653Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:22.9990787Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:22.9990958Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9991293Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:22.9991734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9992047Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9992318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9992610Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9992875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9993148Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:22.9993279Z Execution Analysis: (:1) 2025-03-14T06:00:22.9993526Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9993729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9993735Z 2025-03-14T06:00:22.9993923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9994046Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9994262Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:22.9994381Z Execution Analysis: Graph Info: 2025-03-14T06:00:22.9994571Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:22.9994719Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:22.9994857Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:22.9995027Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:22.9995597Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:22.9996331Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:22.9996687Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:22.9997043Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:22.9997349Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:22.9997629Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:22.9997934Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:22.9998212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:22.9998341Z Execution Analysis: .......... 2025-03-14T06:00:22.9998608Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:22.9998813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9999106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 424 counts during 404 steps 2025-03-14T06:00:22.9999111Z 2025-03-14T06:00:22.9999326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:22.9999445Z Execution Analysis: Execution Cause 2025-03-14T06:00:22.9999749Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:22.9999861Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0000075Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0000220Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0000381Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0000549Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0000924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0001306Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0001630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0001900Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0002216Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0002483Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0002784Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0002911Z Execution Analysis: (:1) 2025-03-14T06:00:23.0003178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0003380Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0003385Z 2025-03-14T06:00:23.0003596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0003710Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0003953Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0004065Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0004277Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0004419Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0004688Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0004859Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0005668Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0006248Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0006629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0006988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0007321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0007603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0007929Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0008233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0008355Z Execution Analysis: .......... 2025-03-14T06:00:23.0008620Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0008845Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0009135Z pt-xla-profiler: TransferFromDeviceTime too frequent: 425 counts during 405 steps 2025-03-14T06:00:23.0009141Z 2025-03-14T06:00:23.0009361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0009480Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0009790Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0009906Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0010129Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0010283Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0010447Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0010649Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0011024Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0011404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0011734Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0012014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0012340Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0012614Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0012931Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0013060Z Execution Analysis: (:1) 2025-03-14T06:00:23.0013340Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0013549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0013556Z 2025-03-14T06:00:23.0013775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0013893Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0014143Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0014259Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0014481Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0014629Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0014792Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0014991Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0015602Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0016181Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0016556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0016912Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0017342Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0017607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0017921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0018185Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0018288Z Execution Analysis: .......... 2025-03-14T06:00:23.0018539Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0018731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0019010Z pt-xla-profiler: TransferFromDeviceTime too frequent: 426 counts during 406 steps 2025-03-14T06:00:23.0019014Z 2025-03-14T06:00:23.0019204Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0019324Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0019595Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0019711Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0019908Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0020059Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0020222Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0020397Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0020756Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0021098Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0021391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0021663Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0021952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0022220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0022498Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0022632Z Execution Analysis: (:1) 2025-03-14T06:00:23.0022875Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0023080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0023084Z 2025-03-14T06:00:23.0023275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0023396Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0023613Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0023733Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0023927Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0024074Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0024251Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0024427Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0024981Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0025524Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0025860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0026199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0026493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0026763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0027076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0027344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0027448Z Execution Analysis: .......... 2025-03-14T06:00:23.0027708Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0027901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0028181Z pt-xla-profiler: TransferFromDeviceTime too frequent: 427 counts during 407 steps 2025-03-14T06:00:23.0028185Z 2025-03-14T06:00:23.0028377Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0028499Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0028770Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0028891Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0029083Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0029269Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0029403Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0029601Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0029935Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0030273Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0030565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0030835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0031123Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0031393Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0031671Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0031806Z Execution Analysis: (:1) 2025-03-14T06:00:23.0032049Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0032252Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0032257Z 2025-03-14T06:00:23.0032445Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0032565Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0032782Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0032899Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0033092Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0033266Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0033407Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0033578Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0034131Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0034679Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0035027Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0035356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0035662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0035947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0036249Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0036500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0036617Z Execution Analysis: .......... 2025-03-14T06:00:23.0036858Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0037059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0037327Z pt-xla-profiler: TransferFromDeviceTime too frequent: 428 counts during 408 steps 2025-03-14T06:00:23.0037331Z 2025-03-14T06:00:23.0037531Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0037642Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0037928Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0038061Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0038264Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0038401Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0038578Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0038739Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0039083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0039412Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0039713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0039970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0040273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0040527Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0040812Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0040934Z Execution Analysis: (:1) 2025-03-14T06:00:23.0041182Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0041373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0041377Z 2025-03-14T06:00:23.0041749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0041866Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0042106Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0042219Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0042464Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0042608Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0042770Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0042941Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0043534Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0044095Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0044462Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0045052Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0045419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0045701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0046027Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0046302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0046425Z Execution Analysis: .......... 2025-03-14T06:00:23.0046686Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0046903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0047192Z pt-xla-profiler: TransferFromDeviceTime too frequent: 429 counts during 409 steps 2025-03-14T06:00:23.0047197Z 2025-03-14T06:00:23.0047416Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0047538Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0047875Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0047990Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0048211Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0048383Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0048550Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0048723Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0049099Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0049457Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0049788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0050071Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0050397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0050672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0050986Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0051116Z Execution Analysis: (:1) 2025-03-14T06:00:23.0051391Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0051601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0051619Z 2025-03-14T06:00:23.0051826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0051960Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0052224Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0052352Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0052567Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0052732Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0052886Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0053060Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0053674Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0054267Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0054631Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0055032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0055351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0055648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0055964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0056253Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0056365Z Execution Analysis: .......... 2025-03-14T06:00:23.0056643Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0056851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0057258Z pt-xla-profiler: TransferFromDeviceTime too frequent: 430 counts during 410 steps 2025-03-14T06:00:23.0057266Z 2025-03-14T06:00:23.0057459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0057613Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0057889Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0058013Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0058245Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0058402Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0058538Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0058714Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0059054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0059396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0059694Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0059966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0060253Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0060522Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0060795Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0060926Z Execution Analysis: (:1) 2025-03-14T06:00:23.0061166Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0061368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0061372Z 2025-03-14T06:00:23.0061558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0061702Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0061919Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0062040Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0062234Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0062385Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0062525Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0062694Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0063240Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0063787Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0064124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0064492Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0064787Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0065058Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0065473Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0065920Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0066033Z Execution Analysis: .......... 2025-03-14T06:00:23.0066313Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0066517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0066822Z pt-xla-profiler: TransferFromDeviceTime too frequent: 431 counts during 411 steps 2025-03-14T06:00:23.0066828Z 2025-03-14T06:00:23.0067105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0067236Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0067566Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0067695Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0067903Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0068062Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0068208Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0068392Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0068754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0069121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0069444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0069736Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0070062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0070338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0070649Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0070779Z Execution Analysis: (:1) 2025-03-14T06:00:23.0071056Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0071264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0071270Z 2025-03-14T06:00:23.0071524Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0071647Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0071896Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0072011Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0072235Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0072383Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0072545Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0072718Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0073324Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0073901Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0074313Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0074672Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0075003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0075279Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0075601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0075874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0075996Z Execution Analysis: .......... 2025-03-14T06:00:23.0076257Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0076475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0076767Z pt-xla-profiler: TransferFromDeviceTime too frequent: 432 counts during 412 steps 2025-03-14T06:00:23.0076803Z 2025-03-14T06:00:23.0077019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0077137Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0077466Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0077689Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0077906Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0078049Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0078307Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0078465Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0078810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0079140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0079447Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0079703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0080003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0080255Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0080543Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0080661Z Execution Analysis: (:1) 2025-03-14T06:00:23.0080914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0081103Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0081133Z 2025-03-14T06:00:23.0081333Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0081444Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0081671Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0081778Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0081982Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0082117Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0082275Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0082433Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0082992Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0083525Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0083897Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0084226Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0084590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0084848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0085335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0085607Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0085730Z Execution Analysis: .......... 2025-03-14T06:00:23.0085992Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0086219Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0086553Z pt-xla-profiler: TransferFromDeviceTime too frequent: 433 counts during 413 steps 2025-03-14T06:00:23.0086559Z 2025-03-14T06:00:23.0086789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0086922Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0087216Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0087342Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0087549Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0087710Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0087855Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0088042Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0088408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0088779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0089093Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0089383Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0089697Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0094554Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0094917Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0095046Z Execution Analysis: (:1) 2025-03-14T06:00:23.0095322Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0095605Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0095615Z 2025-03-14T06:00:23.0095817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0095940Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0096174Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0096295Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0096500Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0096652Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0096799Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0096976Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0097675Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0098281Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0098636Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0098988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0099295Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0099577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0099875Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0100149Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0100250Z Execution Analysis: .......... 2025-03-14T06:00:23.0100519Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0100763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0101052Z pt-xla-profiler: TransferFromDeviceTime too frequent: 434 counts during 414 steps 2025-03-14T06:00:23.0101057Z 2025-03-14T06:00:23.0101283Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0101403Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0101684Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0101799Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0101998Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0102147Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0102283Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0102459Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0102806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0103160Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0103463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0103736Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0104035Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0104304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0104586Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0104714Z Execution Analysis: (:1) 2025-03-14T06:00:23.0104990Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0105199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0105204Z 2025-03-14T06:00:23.0105395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0105512Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0105732Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0105842Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0106036Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0106185Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0106325Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0106498Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0107069Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0107662Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0108014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0108364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0108833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0109121Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0109427Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0109707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0109816Z Execution Analysis: .......... 2025-03-14T06:00:23.0110082Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0110311Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0110635Z pt-xla-profiler: TransferFromDeviceTime too frequent: 435 counts during 415 steps 2025-03-14T06:00:23.0110641Z 2025-03-14T06:00:23.0110848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0110961Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0111254Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0111363Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0111571Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0111712Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0111854Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0112025Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0112381Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0112737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0113052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0113325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0113634Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0113898Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0114302Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0114448Z Execution Analysis: (:1) 2025-03-14T06:00:23.0114705Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0114901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0114905Z 2025-03-14T06:00:23.0115112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0115218Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0115444Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0115548Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0115748Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0115886Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0116034Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0116198Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0116809Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0117366Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0117725Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0118067Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0118378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0118642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0118948Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0119211Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0119345Z Execution Analysis: .......... 2025-03-14T06:00:23.0119596Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0119821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0120100Z pt-xla-profiler: TransferFromDeviceTime too frequent: 436 counts during 416 steps 2025-03-14T06:00:23.0120105Z 2025-03-14T06:00:23.0120308Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0120418Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0120709Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0120814Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0121020Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0121164Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0121313Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0121475Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0121829Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0122169Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0122479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0122744Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0123050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0123308Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0123630Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0123749Z Execution Analysis: (:1) 2025-03-14T06:00:23.0124007Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0124202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0124207Z 2025-03-14T06:00:23.0124408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0124618Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0124854Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0125127Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0125343Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0125485Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0125670Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0125836Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0126433Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0127010Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0127376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0127723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0128041Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0128313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0128630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0128905Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0129036Z Execution Analysis: .......... 2025-03-14T06:00:23.0129302Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0129529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0129820Z pt-xla-profiler: TransferFromDeviceTime too frequent: 437 counts during 417 steps 2025-03-14T06:00:23.0129826Z 2025-03-14T06:00:23.0130024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0130139Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0130426Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0130542Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0130744Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0130894Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0131033Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0131204Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0131560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0131918Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0132227Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0132505Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0132809Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0133110Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0133401Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0133535Z Execution Analysis: (:1) 2025-03-14T06:00:23.0133790Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0133997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0134002Z 2025-03-14T06:00:23.0134197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0134321Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0134554Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0134679Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0134888Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0135083Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0135234Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0135419Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0136014Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0136603Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0136966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0137334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0137651Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0137946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0138258Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0138570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0138682Z Execution Analysis: .......... 2025-03-14T06:00:23.0138983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0139191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0139494Z pt-xla-profiler: TransferFromDeviceTime too frequent: 438 counts during 418 steps 2025-03-14T06:00:23.0139499Z 2025-03-14T06:00:23.0139704Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0139836Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0140132Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0140264Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0140475Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0140641Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0140789Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0140980Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0141343Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0141713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0142030Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0142430Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0142734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0143045Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0143339Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0143480Z Execution Analysis: (:1) 2025-03-14T06:00:23.0143739Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0143956Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0143960Z 2025-03-14T06:00:23.0144162Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0144294Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0144524Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0144652Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0144956Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0145115Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0145265Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0145448Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0146035Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0146612Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0146980Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0147327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0147651Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0147926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0148273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0148540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0148683Z Execution Analysis: .......... 2025-03-14T06:00:23.0148939Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0149147Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0149426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 439 counts during 419 steps 2025-03-14T06:00:23.0149432Z 2025-03-14T06:00:23.0149645Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0149759Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0150056Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0150167Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0150377Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0150520Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0150675Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0150842Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0151202Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0151548Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0151868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0152137Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0152476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0152743Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0153039Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0153165Z Execution Analysis: (:1) 2025-03-14T06:00:23.0153534Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0153725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0153729Z 2025-03-14T06:00:23.0153933Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0154042Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0154271Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0154404Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0154608Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0154745Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0154899Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0155058Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0155617Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0156149Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0156496Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0156824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0157130Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0157411Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0157709Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0157984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0158098Z Execution Analysis: .......... 2025-03-14T06:00:23.0158342Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0158550Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0158818Z pt-xla-profiler: TransferFromDeviceTime too frequent: 440 counts during 420 steps 2025-03-14T06:00:23.0158823Z 2025-03-14T06:00:23.0159027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0159142Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0159428Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0159535Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0159741Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0159881Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0160030Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0160189Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0160539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0160872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0161177Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0161457Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0161762Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0162014Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0162300Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0162420Z Execution Analysis: (:1) 2025-03-14T06:00:23.0162673Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0162865Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0162881Z 2025-03-14T06:00:23.0163070Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0163191Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0163434Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0163555Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0163746Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0163883Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0164034Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0164193Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0164872Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0165761Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0166125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0166497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0166882Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0167174Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0167522Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0167810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0167919Z Execution Analysis: .......... 2025-03-14T06:00:23.0168198Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0168408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0168707Z pt-xla-profiler: TransferFromDeviceTime too frequent: 441 counts during 421 steps 2025-03-14T06:00:23.0168715Z 2025-03-14T06:00:23.0168921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0169052Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0169346Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0169476Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0169686Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0169847Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0169992Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0170175Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0170535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0170902Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0171273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0171564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0171877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0172164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0172459Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0172599Z Execution Analysis: (:1) 2025-03-14T06:00:23.0172860Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0173078Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0173083Z 2025-03-14T06:00:23.0173286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0173462Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0173697Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0173825Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0174031Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0174192Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0174343Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0174526Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0175119Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0175706Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0176074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0176443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0176786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0177208Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0177514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0177891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0177993Z Execution Analysis: .......... 2025-03-14T06:00:23.0178245Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0178434Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0178718Z pt-xla-profiler: TransferFromDeviceTime too frequent: 442 counts during 422 steps 2025-03-14T06:00:23.0178723Z 2025-03-14T06:00:23.0178914Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0179035Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0179308Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0179426Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0179618Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0179767Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0179902Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0180071Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0180405Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0180774Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0181066Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0181335Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0181621Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0181880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0182157Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0182278Z Execution Analysis: (:1) 2025-03-14T06:00:23.0182530Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0182720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0182747Z 2025-03-14T06:00:23.0182944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0183057Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0183283Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0183389Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0183586Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0183722Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0183867Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0184024Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0184579Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0185110Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0185454Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0185805Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0186127Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0186386Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0186681Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0186935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0187042Z Execution Analysis: .......... 2025-03-14T06:00:23.0187284Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0187482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0187752Z pt-xla-profiler: TransferFromDeviceTime too frequent: 444 counts during 423 steps 2025-03-14T06:00:23.0187759Z 2025-03-14T06:00:23.0187957Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0188072Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0188350Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0188456Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0188657Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0188791Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0188931Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0189088Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0189429Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0189790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0190092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0190352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0190649Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0190901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0191179Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0191294Z Execution Analysis: (:1) 2025-03-14T06:00:23.0191548Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0191735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0191765Z 2025-03-14T06:00:23.0191961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0192068Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0192290Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0192396Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0192598Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0192732Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0192877Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0193033Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0193589Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0194125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0194493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0194819Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0195142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0195395Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0195687Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0196112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0196225Z Execution Analysis: .......... 2025-03-14T06:00:23.0196473Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0196687Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0196966Z pt-xla-profiler: TransferFromDeviceTime too frequent: 445 counts during 424 steps 2025-03-14T06:00:23.0196981Z 2025-03-14T06:00:23.0197178Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0197299Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0197582Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0197698Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0197898Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0198044Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0198183Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0198356Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0198735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0199088Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0199392Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0199667Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0199966Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0200238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0200523Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0200657Z Execution Analysis: (:1) 2025-03-14T06:00:23.0200911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0201145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0201151Z 2025-03-14T06:00:23.0201347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0201468Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0201698Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0201816Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0202017Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0202165Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0202310Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0202482Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0203060Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0203631Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0204010Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0204398Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0204793Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0205247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0205562Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0205848Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0205958Z Execution Analysis: .......... 2025-03-14T06:00:23.0206234Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0206443Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0206741Z pt-xla-profiler: TransferFromDeviceTime too frequent: 446 counts during 425 steps 2025-03-14T06:00:23.0206748Z 2025-03-14T06:00:23.0206952Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0207081Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0207374Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0207498Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0207705Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0207861Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0208006Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0208214Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0208573Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0208939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0209255Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0209539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0209848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0210124Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0210418Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0210553Z Execution Analysis: (:1) 2025-03-14T06:00:23.0210841Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0211056Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0211061Z 2025-03-14T06:00:23.0211265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0211392Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0211624Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0211747Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0211953Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0212106Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0212254Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0212434Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0213029Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0213648Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0214031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0214396Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0214726Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0215002Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0215317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0215588Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0215710Z Execution Analysis: .......... 2025-03-14T06:00:23.0215974Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0216186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0216476Z pt-xla-profiler: TransferFromDeviceTime too frequent: 447 counts during 426 steps 2025-03-14T06:00:23.0216481Z 2025-03-14T06:00:23.0216693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0216808Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0217214Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0217321Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0217520Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0217658Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0217824Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0217987Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0218327Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0218657Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0218954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0219209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0219500Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0219750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0220030Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0220175Z Execution Analysis: (:1) 2025-03-14T06:00:23.0220424Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0220613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0220617Z 2025-03-14T06:00:23.0220815Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0220921Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0221145Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0221248Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0221451Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0221585Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0221726Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0221884Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0222436Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0223016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0223360Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0223689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0223993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0224248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0224550Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0224807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0224917Z Execution Analysis: .......... 2025-03-14T06:00:23.0225160Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0225363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0225628Z pt-xla-profiler: TransferFromDeviceTime too frequent: 448 counts during 427 steps 2025-03-14T06:00:23.0225633Z 2025-03-14T06:00:23.0225837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0225945Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0226228Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0226333Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0226539Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0226703Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0226848Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0227007Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0227351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0227680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0227987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0228248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0228549Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0228800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0229110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0229230Z Execution Analysis: (:1) 2025-03-14T06:00:23.0229482Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0229674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0229678Z 2025-03-14T06:00:23.0229880Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0229986Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0230214Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0230317Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0230516Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0230649Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0230801Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0230961Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0231546Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0232111Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0232448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0232783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0233073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0233337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0233626Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0233885Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0233984Z Execution Analysis: .......... 2025-03-14T06:00:23.0234235Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0234424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0234695Z pt-xla-profiler: TransferFromDeviceTime too frequent: 449 counts during 428 steps 2025-03-14T06:00:23.0234700Z 2025-03-14T06:00:23.0234886Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0235004Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0235272Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0235387Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0235597Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0235744Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0235878Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0236043Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0236377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0236712Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0237003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0237269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0237556Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0237842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0238115Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0238240Z Execution Analysis: (:1) 2025-03-14T06:00:23.0238483Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0238680Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0238684Z 2025-03-14T06:00:23.0238870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0238985Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0239202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0239315Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0239505Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0239655Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0239794Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0239998Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0240572Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0241116Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0241448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0241785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0242078Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0242344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0242633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0242894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0242997Z Execution Analysis: .......... 2025-03-14T06:00:23.0243251Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0243443Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0243722Z pt-xla-profiler: TransferFromDeviceTime too frequent: 450 counts during 429 steps 2025-03-14T06:00:23.0243727Z 2025-03-14T06:00:23.0243916Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0244033Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0244330Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0244449Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0244718Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0244869Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0245179Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0245363Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0245726Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0246092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0246405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0246695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0247038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0247319Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0247614Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0247752Z Execution Analysis: (:1) 2025-03-14T06:00:23.0248011Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0248226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0248231Z 2025-03-14T06:00:23.0248442Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0248558Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0248798Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0248909Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0249131Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0249276Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0249460Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0249630Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0250256Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0250836Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0251207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0251564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0251892Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0252169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0252489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0252762Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0252878Z Execution Analysis: .......... 2025-03-14T06:00:23.0253139Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0253350Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0253635Z pt-xla-profiler: TransferFromDeviceTime too frequent: 451 counts during 430 steps 2025-03-14T06:00:23.0253639Z 2025-03-14T06:00:23.0253851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0253971Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0254296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0254411Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0254630Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0254778Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0254927Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0255097Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0255466Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0255820Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0256146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0256426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0256776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0257158Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0257442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0257561Z Execution Analysis: (:1) 2025-03-14T06:00:23.0257809Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0257997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0258002Z 2025-03-14T06:00:23.0258202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0258309Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0258532Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0258640Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0258842Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0259002Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0259151Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0259332Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0259892Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0260421Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0260762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0261091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0261394Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0261651Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0261943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0262196Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0262302Z Execution Analysis: .......... 2025-03-14T06:00:23.0262540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0262738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0263001Z pt-xla-profiler: TransferFromDeviceTime too frequent: 452 counts during 431 steps 2025-03-14T06:00:23.0263015Z 2025-03-14T06:00:23.0263231Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0263346Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0263616Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0263721Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0263920Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0264055Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0264208Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0264366Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0264712Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0265039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0265507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0266024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0266340Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0266626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0266924Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0267064Z Execution Analysis: (:1) 2025-03-14T06:00:23.0267327Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0267548Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0267553Z 2025-03-14T06:00:23.0267760Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0267890Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0268129Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0268293Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0268500Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0268659Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0268842Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0269029Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0269624Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0270212Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0270576Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0270947Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0271266Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0271556Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0271870Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0272157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0272269Z Execution Analysis: .......... 2025-03-14T06:00:23.0272543Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0272751Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0273054Z pt-xla-profiler: TransferFromDeviceTime too frequent: 453 counts during 432 steps 2025-03-14T06:00:23.0273061Z 2025-03-14T06:00:23.0273303Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0273437Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0273731Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0273861Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0274068Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0274229Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0274375Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0274562Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0274926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0275293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0275647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0275936Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0276245Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0276530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0276823Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0276958Z Execution Analysis: (:1) 2025-03-14T06:00:23.0277217Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0277430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0277434Z 2025-03-14T06:00:23.0277636Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0277903Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0278259Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0278374Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0278566Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0278734Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0278870Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0279036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0279584Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0280127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0280466Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0280805Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0281097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0281369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0281660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0281925Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0282026Z Execution Analysis: .......... 2025-03-14T06:00:23.0282281Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0282486Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0282778Z pt-xla-profiler: TransferFromDeviceTime too frequent: 454 counts during 433 steps 2025-03-14T06:00:23.0282785Z 2025-03-14T06:00:23.0282985Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0283095Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0283379Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0283485Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0283684Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0283819Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0283962Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0284119Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0284462Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0285068Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0285394Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0285677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0286004Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0286279Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0286588Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0286718Z Execution Analysis: (:1) 2025-03-14T06:00:23.0286991Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0287200Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0287207Z 2025-03-14T06:00:23.0287423Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0287570Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0287815Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0287928Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0288173Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0288319Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0288478Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0288647Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0289250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0289824Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0290201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0290559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0290886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0291161Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0291482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0291756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0291877Z Execution Analysis: .......... 2025-03-14T06:00:23.0292137Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0292450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0292740Z pt-xla-profiler: TransferFromDeviceTime too frequent: 455 counts during 434 steps 2025-03-14T06:00:23.0292747Z 2025-03-14T06:00:23.0292964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0293083Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0293389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0293502Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0293719Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0293866Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0294022Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0294191Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0294564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0294948Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0295273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0295554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0295876Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0296147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0296451Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0296578Z Execution Analysis: (:1) 2025-03-14T06:00:23.0296848Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0297169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0297173Z 2025-03-14T06:00:23.0297407Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0297520Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0297781Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0297892Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0298105Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0298244Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0298401Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0298566Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0299155Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0299717Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0300083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0300439Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0300745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0301031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0301334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0301608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0301715Z Execution Analysis: .......... 2025-03-14T06:00:23.0301979Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0302206Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0302498Z pt-xla-profiler: TransferFromDeviceTime too frequent: 456 counts during 435 steps 2025-03-14T06:00:23.0302503Z 2025-03-14T06:00:23.0302707Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0302832Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0303117Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0303239Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0303440Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0303593Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0303733Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0303910Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0304288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0304646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0304951Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0305229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0305530Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0305805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0306093Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0306226Z Execution Analysis: (:1) 2025-03-14T06:00:23.0306484Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0306699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0306728Z 2025-03-14T06:00:23.0306930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0307075Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0307405Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0307519Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0307713Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0307859Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0307997Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0308165Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0308716Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0309257Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0309596Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0309938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0310231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0310503Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0310791Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0311056Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0311161Z Execution Analysis: .......... 2025-03-14T06:00:23.0311452Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0311647Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0311931Z pt-xla-profiler: TransferFromDeviceTime too frequent: 457 counts during 436 steps 2025-03-14T06:00:23.0311938Z 2025-03-14T06:00:23.0312130Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0312255Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0312527Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0312649Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0312841Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0312988Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0313151Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0313324Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0313661Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0314004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0314299Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0314573Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0314860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0315125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0315399Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0315532Z Execution Analysis: (:1) 2025-03-14T06:00:23.0315778Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0316003Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0316008Z 2025-03-14T06:00:23.0316229Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0316341Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0316570Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0316677Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0316874Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0317022Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0317162Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0317336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0317886Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0318432Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0318776Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0319102Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0319401Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0319658Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0319951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0320202Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0320336Z Execution Analysis: .......... 2025-03-14T06:00:23.0320578Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0320776Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0321044Z pt-xla-profiler: TransferFromDeviceTime too frequent: 458 counts during 437 steps 2025-03-14T06:00:23.0321048Z 2025-03-14T06:00:23.0321246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0321353Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0321633Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0321738Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0321941Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0322102Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0322250Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0322411Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0322754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0323083Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0323385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0323642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0323934Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0324186Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0324470Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0324675Z Execution Analysis: (:1) 2025-03-14T06:00:23.0325132Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0325341Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0325346Z 2025-03-14T06:00:23.0325585Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0325703Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0325948Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0326060Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0326280Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0326426Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0326586Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0326760Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0327365Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0327945Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0328320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0328674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0329002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0329281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0329603Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0329902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0330024Z Execution Analysis: .......... 2025-03-14T06:00:23.0330286Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0330502Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0330792Z pt-xla-profiler: TransferFromDeviceTime too frequent: 459 counts during 438 steps 2025-03-14T06:00:23.0330797Z 2025-03-14T06:00:23.0331014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0331130Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0331434Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0331548Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0331789Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0331941Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0332098Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0332267Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0332641Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0332994Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0333316Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0333591Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0333910Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0334182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0334488Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0334653Z Execution Analysis: (:1) 2025-03-14T06:00:23.0334911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0335150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0335155Z 2025-03-14T06:00:23.0335357Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0335481Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0335711Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0335832Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0336039Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0336193Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0336345Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0336524Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0337223Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0337765Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0338100Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0338435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0338726Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0338993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0339302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0339565Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0339664Z Execution Analysis: .......... 2025-03-14T06:00:23.0339914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0340103Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0340380Z pt-xla-profiler: TransferFromDeviceTime too frequent: 460 counts during 439 steps 2025-03-14T06:00:23.0340385Z 2025-03-14T06:00:23.0340574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0340690Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0340963Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0341104Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0341296Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0341445Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0341579Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0341745Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0342082Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0342420Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0342715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0342980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0343268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0343530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0343825Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0343954Z Execution Analysis: (:1) 2025-03-14T06:00:23.0344234Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0344437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0344441Z 2025-03-14T06:00:23.0344629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0344749Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0344967Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0345080Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0345274Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0345428Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0345569Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0345737Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0346288Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0346830Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0347165Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0347502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0347794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0348086Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0348376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0348636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0348739Z Execution Analysis: .......... 2025-03-14T06:00:23.0348994Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0349187Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0349464Z pt-xla-profiler: TransferFromDeviceTime too frequent: 461 counts during 440 steps 2025-03-14T06:00:23.0349469Z 2025-03-14T06:00:23.0349669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0349774Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0350093Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0350200Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0350405Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0350545Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0350698Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0350860Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0351209Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0351537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0351844Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0352106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0352410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0352664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0352976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0353097Z Execution Analysis: (:1) 2025-03-14T06:00:23.0353381Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0353574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0353578Z 2025-03-14T06:00:23.0353778Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0353890Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0354122Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0354232Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0354438Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0354579Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0354733Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0354897Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0355460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0355996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0356347Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0356679Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0357010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0357269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0357571Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0357826Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0357941Z Execution Analysis: .......... 2025-03-14T06:00:23.0358184Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0358390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0358659Z pt-xla-profiler: TransferFromDeviceTime too frequent: 462 counts during 441 steps 2025-03-14T06:00:23.0358664Z 2025-03-14T06:00:23.0358872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0359008Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0359292Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0359400Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0359606Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0359747Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0359893Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0360049Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0360393Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0360720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0361023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0361281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0361583Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0361864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0362172Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0362292Z Execution Analysis: (:1) 2025-03-14T06:00:23.0362544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0362734Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0362738Z 2025-03-14T06:00:23.0362936Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0363045Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0363272Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0363379Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0363584Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0363720Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0363870Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0364030Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0364657Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0365542Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0365922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0366276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0366668Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0366967Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0367279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0367566Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0367677Z Execution Analysis: .......... 2025-03-14T06:00:23.0367950Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0368155Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0368456Z pt-xla-profiler: TransferFromDeviceTime too frequent: 463 counts during 442 steps 2025-03-14T06:00:23.0368462Z 2025-03-14T06:00:23.0368708Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0368840Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0369133Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0369258Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0369467Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0369624Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0369771Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0369954Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0370314Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0370684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0371002Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0371299Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0371647Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0371932Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0372261Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0372404Z Execution Analysis: (:1) 2025-03-14T06:00:23.0372666Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0372883Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0372887Z 2025-03-14T06:00:23.0373090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0373221Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0373456Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0373583Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0373789Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0373946Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0374097Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0374280Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0374874Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0375461Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0375823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0376216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0376534Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0376822Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0377247Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0377628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0377730Z Execution Analysis: .......... 2025-03-14T06:00:23.0377981Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0378169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0378445Z pt-xla-profiler: TransferFromDeviceTime too frequent: 465 counts during 443 steps 2025-03-14T06:00:23.0378476Z 2025-03-14T06:00:23.0378667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0378789Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0379058Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0379175Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0379366Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0379512Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0379648Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0379816Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0380148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0380489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0380784Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0381089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0381376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0381661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0381934Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0382061Z Execution Analysis: (:1) 2025-03-14T06:00:23.0382300Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0382500Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0382504Z 2025-03-14T06:00:23.0382693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0382815Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0383035Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0383151Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0383344Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0383494Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0383635Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0383808Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0384355Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0384898Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0385270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0385605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0385911Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0386169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0386468Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0386721Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0386833Z Execution Analysis: .......... 2025-03-14T06:00:23.0387076Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0387278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0387573Z pt-xla-profiler: TransferFromDeviceTime too frequent: 466 counts during 444 steps 2025-03-14T06:00:23.0387580Z 2025-03-14T06:00:23.0387781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0387891Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0388177Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0388283Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0388487Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0388623Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0388771Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0388929Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0389273Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0389606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0389931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0390187Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0390515Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0390768Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0391051Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0391170Z Execution Analysis: (:1) 2025-03-14T06:00:23.0391422Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0391613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0391618Z 2025-03-14T06:00:23.0391820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0391932Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0392162Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0392268Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0392475Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0392611Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0392763Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0392924Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0393487Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0394048Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0394397Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0394729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0395039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0395296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0395600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0396027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0396148Z Execution Analysis: .......... 2025-03-14T06:00:23.0396404Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0396643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0396926Z pt-xla-profiler: TransferFromDeviceTime too frequent: 467 counts during 445 steps 2025-03-14T06:00:23.0396932Z 2025-03-14T06:00:23.0397148Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0397267Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0397571Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0397684Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0397905Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0398052Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0398208Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0398376Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0398743Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0399093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0399441Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0399739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0400057Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0400325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0400628Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0400755Z Execution Analysis: (:1) 2025-03-14T06:00:23.0401021Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0401228Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0401245Z 2025-03-14T06:00:23.0401443Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0401572Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0401801Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0401923Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0402122Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0402284Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0402426Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0402591Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0403178Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0403774Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0404129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0404560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0404876Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0405332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0405640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0405924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0406033Z Execution Analysis: .......... 2025-03-14T06:00:23.0406338Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0406542Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0406846Z pt-xla-profiler: TransferFromDeviceTime too frequent: 468 counts during 446 steps 2025-03-14T06:00:23.0406850Z 2025-03-14T06:00:23.0407056Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0407186Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0407480Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0407605Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0407813Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0407973Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0408118Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0408306Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0408669Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0409062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0409405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0409694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0410007Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0410290Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0410585Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0410723Z Execution Analysis: (:1) 2025-03-14T06:00:23.0410988Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0411206Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0411212Z 2025-03-14T06:00:23.0411415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0411543Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0411777Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0411906Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0412111Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0412270Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0412419Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0412601Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0413218Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0413809Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0414175Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0414542Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0414859Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0415149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0415458Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0415743Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0415892Z Execution Analysis: .......... 2025-03-14T06:00:23.0416167Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0416376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0416676Z pt-xla-profiler: TransferFromDeviceTime too frequent: 469 counts during 447 steps 2025-03-14T06:00:23.0416681Z 2025-03-14T06:00:23.0416886Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0417014Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0417399Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0417519Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0417712Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0417863Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0418000Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0418171Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0418529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0418867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0419181Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0419451Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0419748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0419998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0420281Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0420404Z Execution Analysis: (:1) 2025-03-14T06:00:23.0420656Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0420847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0420851Z 2025-03-14T06:00:23.0421053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0421162Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0421389Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0421493Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0421697Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0421832Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0421980Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0422138Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0422721Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0423255Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0423601Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0423930Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0424229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0424485Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0424782Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0425060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0425172Z Execution Analysis: .......... 2025-03-14T06:00:23.0425414Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0425613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0425881Z pt-xla-profiler: TransferFromDeviceTime too frequent: 470 counts during 448 steps 2025-03-14T06:00:23.0425886Z 2025-03-14T06:00:23.0426084Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0426195Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0426477Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0426583Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0426787Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0426927Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0427072Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0427254Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0427597Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0427957Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0428262Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0428520Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0428821Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0429072Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0429355Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0429478Z Execution Analysis: (:1) 2025-03-14T06:00:23.0429736Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0429927Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0429933Z 2025-03-14T06:00:23.0430136Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0430245Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0430473Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0430581Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0430787Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0430925Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0431072Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0431255Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0431814Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0432348Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0432693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0433022Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0433326Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0433583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0433882Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0434158Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0434272Z Execution Analysis: .......... 2025-03-14T06:00:23.0434514Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0434723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0435003Z pt-xla-profiler: TransferFromDeviceTime too frequent: 471 counts during 449 steps 2025-03-14T06:00:23.0435007Z 2025-03-14T06:00:23.0435199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0435323Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0435596Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0435716Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0435913Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0436066Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0436226Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0436398Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0436832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0437176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0437470Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0437743Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0438032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0438299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0438578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0438714Z Execution Analysis: (:1) 2025-03-14T06:00:23.0438958Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0439166Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0439170Z 2025-03-14T06:00:23.0439361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0439487Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0439705Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0439829Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0440024Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0440179Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0440343Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0440519Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0441067Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0441616Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0441954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0442300Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0442594Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0442867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0443181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0443451Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0443555Z Execution Analysis: .......... 2025-03-14T06:00:23.0443814Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0444006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0444289Z pt-xla-profiler: TransferFromDeviceTime too frequent: 472 counts during 450 steps 2025-03-14T06:00:23.0444295Z 2025-03-14T06:00:23.0444553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0444684Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0445123Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0445256Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0445461Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0445653Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0445797Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0446007Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0446368Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0446733Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0447048Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0447337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0447648Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0447934Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0448231Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0448370Z Execution Analysis: (:1) 2025-03-14T06:00:23.0448633Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0448849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0448854Z 2025-03-14T06:00:23.0449057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0449186Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0449420Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0449546Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0449755Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0449957Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0450110Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0450294Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0450889Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0451478Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0451839Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0452208Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0452536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0452842Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0453166Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0453436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0453560Z Execution Analysis: .......... 2025-03-14T06:00:23.0453821Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0454037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0454324Z pt-xla-profiler: TransferFromDeviceTime too frequent: 473 counts during 451 steps 2025-03-14T06:00:23.0454329Z 2025-03-14T06:00:23.0454545Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0454661Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0454970Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0455110Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0455330Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0455477Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0455657Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0455828Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0456202Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0456557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0456886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0457266Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0457571Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0457824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0458110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0458231Z Execution Analysis: (:1) 2025-03-14T06:00:23.0458484Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0458675Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0458680Z 2025-03-14T06:00:23.0458881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0458990Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0459218Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0459325Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0459552Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0459689Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0459840Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0459996Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0460557Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0461087Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0461433Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0461759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0462089Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0462346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0462644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0462899Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0463011Z Execution Analysis: .......... 2025-03-14T06:00:23.0463253Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0463454Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0463721Z pt-xla-profiler: TransferFromDeviceTime too frequent: 474 counts during 452 steps 2025-03-14T06:00:23.0463726Z 2025-03-14T06:00:23.0463928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0464040Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0464323Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0464453Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0464657Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0464815Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0464962Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0465122Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0465753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0466109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0466437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0466718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0467041Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0467313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0467619Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0467749Z Execution Analysis: (:1) 2025-03-14T06:00:23.0468021Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0468225Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0468243Z 2025-03-14T06:00:23.0468446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0468576Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0468867Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0468982Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0469205Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0469351Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0469517Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0469690Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0470297Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0470894Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0471258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0471665Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0471982Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0472278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0472592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0472879Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0472987Z Execution Analysis: .......... 2025-03-14T06:00:23.0473262Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0473468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0473772Z pt-xla-profiler: TransferFromDeviceTime too frequent: 475 counts during 453 steps 2025-03-14T06:00:23.0473779Z 2025-03-14T06:00:23.0473987Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0474155Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0474448Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0474573Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0474813Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0479587Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0479767Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0479940Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0480285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0480622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0480913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0481187Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0481471Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0481730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0482000Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0482121Z Execution Analysis: (:1) 2025-03-14T06:00:23.0482363Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0482557Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0482564Z 2025-03-14T06:00:23.0482749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0482929Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0483142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0483252Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0483439Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0483584Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0483719Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0483877Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0484429Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0485231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0485591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0485995Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0486311Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0486595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0486900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0487177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0487283Z Execution Analysis: .......... 2025-03-14T06:00:23.0487556Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0487759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0488058Z pt-xla-profiler: TransferFromDeviceTime too frequent: 476 counts during 454 steps 2025-03-14T06:00:23.0488066Z 2025-03-14T06:00:23.0488265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0488421Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0488711Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0488876Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0489080Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0489231Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0489374Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0489548Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0489904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0490264Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0490575Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0490854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0491158Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0491432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0491719Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0491854Z Execution Analysis: (:1) 2025-03-14T06:00:23.0492115Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0492326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0492331Z 2025-03-14T06:00:23.0492558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0492683Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0492914Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0493034Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0493239Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0493391Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0493534Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0493710Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0494297Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0494881Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0495283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0495636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0495954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0496231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0496547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0496813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0496923Z Execution Analysis: .......... 2025-03-14T06:00:23.0497287Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0497489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0497769Z pt-xla-profiler: TransferFromDeviceTime too frequent: 477 counts during 455 steps 2025-03-14T06:00:23.0497800Z 2025-03-14T06:00:23.0498003Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0498112Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0498425Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0498529Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0498737Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0498875Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0499020Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0499183Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0499540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0499880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0500195Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0500460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0500767Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0501025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0501319Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0501438Z Execution Analysis: (:1) 2025-03-14T06:00:23.0501699Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0501894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0501901Z 2025-03-14T06:00:23.0502130Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0502242Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0502480Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0502588Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0502799Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0502936Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0503089Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0503251Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0503838Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0504395Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0504786Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0505127Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0505444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0505709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0506017Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0506275Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0506390Z Execution Analysis: .......... 2025-03-14T06:00:23.0506639Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0506849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0507150Z pt-xla-profiler: TransferFromDeviceTime too frequent: 478 counts during 456 steps 2025-03-14T06:00:23.0507155Z 2025-03-14T06:00:23.0507387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0507497Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0507789Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0507893Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0508099Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0508238Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0508381Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0508546Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0508901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0509242Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0509556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0509828Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0510136Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0510395Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0510687Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0510805Z Execution Analysis: (:1) 2025-03-14T06:00:23.0511063Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0511294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0511309Z 2025-03-14T06:00:23.0511501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0511728Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0511940Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0512047Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0512233Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0512365Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0512506Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0512657Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0513210Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0513773Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0514103Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0514436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0514723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0514980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0515262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0515515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0515611Z Execution Analysis: .......... 2025-03-14T06:00:23.0515855Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0516063Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0516336Z pt-xla-profiler: TransferFromDeviceTime too frequent: 479 counts during 457 steps 2025-03-14T06:00:23.0516340Z 2025-03-14T06:00:23.0516550Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0516663Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0516931Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0517041Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0517228Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0517368Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0517497Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0517659Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0517992Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0518325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0518613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0518875Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0519160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0519423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0519697Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0519827Z Execution Analysis: (:1) 2025-03-14T06:00:23.0520100Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0520306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0520312Z 2025-03-14T06:00:23.0520501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0520624Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0520842Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0520960Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0521153Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0521302Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0521440Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0521611Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0522163Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0522736Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0523074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0523418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0523712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0523983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0524272Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0524621Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0524730Z Execution Analysis: .......... 2025-03-14T06:00:23.0525161Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0525411Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0525740Z pt-xla-profiler: TransferFromDeviceTime too frequent: 480 counts during 458 steps 2025-03-14T06:00:23.0525746Z 2025-03-14T06:00:23.0525956Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0526089Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0526385Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0526516Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0526725Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0526891Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0527042Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0527233Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0527598Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0527971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0528289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0528580Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0528893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0529181Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0529491Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0529621Z Execution Analysis: (:1) 2025-03-14T06:00:23.0529921Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0530130Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0530135Z 2025-03-14T06:00:23.0530353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0530469Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0530721Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0530838Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0531061Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0531210Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0531374Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0531545Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0532180Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0532759Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0533133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0533486Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0533814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0534091Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0534415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0534690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0534836Z Execution Analysis: .......... 2025-03-14T06:00:23.0535098Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0535335Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0535626Z pt-xla-profiler: TransferFromDeviceTime too frequent: 481 counts during 459 steps 2025-03-14T06:00:23.0535632Z 2025-03-14T06:00:23.0535849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0535968Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0536275Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0536388Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0536611Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0536762Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0536918Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0537196Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0537541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0537870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0538176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0538432Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0538735Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0538987Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0539306Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0539428Z Execution Analysis: (:1) 2025-03-14T06:00:23.0539688Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0539881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0539885Z 2025-03-14T06:00:23.0540085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0540193Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0540424Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0540528Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0540732Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0540868Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0541045Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0541207Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0541771Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0542305Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0542654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0542984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0543289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0543547Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0543850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0544103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0544243Z Execution Analysis: .......... 2025-03-14T06:00:23.0544486Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0544721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0544990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 482 counts during 460 steps 2025-03-14T06:00:23.0545008Z 2025-03-14T06:00:23.0545199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0545321Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0545593Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0545713Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0545907Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0546058Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0546193Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0546365Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0546700Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0547041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0547333Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0547602Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0547889Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0548153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0548452Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0548588Z Execution Analysis: (:1) 2025-03-14T06:00:23.0548836Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0549040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0549044Z 2025-03-14T06:00:23.0549234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0549355Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0549571Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0549690Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0549882Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0550054Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0550194Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0550365Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0550915Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0551459Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0551794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0552139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0552430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0552698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0552991Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0553280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0553381Z Execution Analysis: .......... 2025-03-14T06:00:23.0553660Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0553851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0554130Z pt-xla-profiler: TransferFromDeviceTime too frequent: 483 counts during 461 steps 2025-03-14T06:00:23.0554134Z 2025-03-14T06:00:23.0554326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0554446Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0554715Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0554834Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0555028Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0555176Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0555310Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0555483Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0555814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0556152Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0556442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0556711Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0556997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0557286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0557562Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0557692Z Execution Analysis: (:1) 2025-03-14T06:00:23.0557935Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0558136Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0558140Z 2025-03-14T06:00:23.0558328Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0558450Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0558669Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0558792Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0559029Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0559180Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0559323Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0559496Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0560047Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0560591Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0560926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0561269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0561573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0561832Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0562163Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0562415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0562554Z Execution Analysis: .......... 2025-03-14T06:00:23.0562798Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0563000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0563268Z pt-xla-profiler: TransferFromDeviceTime too frequent: 484 counts during 462 steps 2025-03-14T06:00:23.0563274Z 2025-03-14T06:00:23.0563474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0563591Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0563869Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0563977Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0564176Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0564312Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0564455Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0564696Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0565219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0565704Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0566027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0566302Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0566695Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0566972Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0567274Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0567404Z Execution Analysis: (:1) 2025-03-14T06:00:23.0567671Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0567876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0567882Z 2025-03-14T06:00:23.0568094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0568214Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0568455Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0568607Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0568823Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0568971Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0569128Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0569297Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0569895Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0570475Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0570847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0571206Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0571530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0571846Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0572165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0572467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0572591Z Execution Analysis: .......... 2025-03-14T06:00:23.0572856Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0573072Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0573359Z pt-xla-profiler: TransferFromDeviceTime too frequent: 486 counts during 463 steps 2025-03-14T06:00:23.0573364Z 2025-03-14T06:00:23.0573575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0573697Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0574006Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0574117Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0574339Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0574488Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0574640Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0574809Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0575179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0575533Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0575852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0576160Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0576478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0576748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0577049Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0577289Z Execution Analysis: (:1) 2025-03-14T06:00:23.0577551Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0577853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0577867Z 2025-03-14T06:00:23.0578054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0578159Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0578414Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0578516Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0578715Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0578848Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0578995Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0579146Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0579701Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0580237Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0580569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0580903Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0581218Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0581477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0581783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0582040Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0582139Z Execution Analysis: .......... 2025-03-14T06:00:23.0582384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0582571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0582842Z pt-xla-profiler: TransferFromDeviceTime too frequent: 487 counts during 464 steps 2025-03-14T06:00:23.0582848Z 2025-03-14T06:00:23.0583039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0583157Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0583427Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0583540Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0583731Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0583874Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0584006Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0584170Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0584502Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0584833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0585149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0585411Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0585701Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0585961Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0586236Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0586361Z Execution Analysis: (:1) 2025-03-14T06:00:23.0586602Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0586800Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0586804Z 2025-03-14T06:00:23.0586993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0587133Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0587350Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0587464Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0587655Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0587799Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0587937Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0588103Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0588649Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0589191Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0589525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0589861Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0590248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0590537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0590824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0591085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0591187Z Execution Analysis: .......... 2025-03-14T06:00:23.0591436Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0591625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0591905Z pt-xla-profiler: TransferFromDeviceTime too frequent: 488 counts during 465 steps 2025-03-14T06:00:23.0591910Z 2025-03-14T06:00:23.0592097Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0592216Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0592490Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0592601Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0592789Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0592931Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0593064Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0593229Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0593562Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0593896Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0594219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0594484Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0594769Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0595030Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0595298Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0595424Z Execution Analysis: (:1) 2025-03-14T06:00:23.0595661Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0596029Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0596059Z 2025-03-14T06:00:23.0596266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0596381Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0596617Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0596726Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0596938Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0597081Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0597234Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0597397Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0597982Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0598541Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0598900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0599269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0599609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0599877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0600184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0600447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0600561Z Execution Analysis: .......... 2025-03-14T06:00:23.0600819Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0601024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0601306Z pt-xla-profiler: TransferFromDeviceTime too frequent: 489 counts during 466 steps 2025-03-14T06:00:23.0601312Z 2025-03-14T06:00:23.0601520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0601631Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0601927Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0602036Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0602244Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0602388Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0602538Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0602702Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0603061Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0603432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0603746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0604014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0604324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0604687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0605148Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0605275Z Execution Analysis: (:1) 2025-03-14T06:00:23.0605544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0605749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0605790Z 2025-03-14T06:00:23.0606006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0606126Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0606368Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0606483Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0606702Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0606847Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0607006Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0607176Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0607775Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0608356Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0608752Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0609108Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0609459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0609736Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0610054Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0610325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0610442Z Execution Analysis: .......... 2025-03-14T06:00:23.0610701Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0610922Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0611211Z pt-xla-profiler: TransferFromDeviceTime too frequent: 490 counts during 467 steps 2025-03-14T06:00:23.0611227Z 2025-03-14T06:00:23.0611433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0611557Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0611851Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0611962Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0612181Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0612325Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0612480Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0612646Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0613041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0613394Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0613720Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0614009Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0614319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0614601Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0614896Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0615031Z Execution Analysis: (:1) 2025-03-14T06:00:23.0615293Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0615533Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0615539Z 2025-03-14T06:00:23.0615745Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0615869Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0616105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0616224Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0616432Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0616586Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0616732Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0616905Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0617498Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0618081Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0618466Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0618853Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0619166Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0619454Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0619763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0620040Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0620147Z Execution Analysis: .......... 2025-03-14T06:00:23.0620414Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0620730Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0621016Z pt-xla-profiler: TransferFromDeviceTime too frequent: 491 counts during 468 steps 2025-03-14T06:00:23.0621021Z 2025-03-14T06:00:23.0621220Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0621337Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0621622Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0621740Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0621939Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0622089Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0622229Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0622429Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0622782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0623132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0623440Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0623720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0624022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0624294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0624581Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0624713Z Execution Analysis: (:1) 2025-03-14T06:00:23.0624997Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0625207Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0625212Z 2025-03-14T06:00:23.0625515Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0625630Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0625842Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0625951Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0626142Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0626284Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0626424Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0626587Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0627137Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0627703Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0628071Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0628409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0628699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0628964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0629248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0629509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0629612Z Execution Analysis: .......... 2025-03-14T06:00:23.0629862Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0630060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0630329Z pt-xla-profiler: TransferFromDeviceTime too frequent: 492 counts during 469 steps 2025-03-14T06:00:23.0630334Z 2025-03-14T06:00:23.0630530Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0630638Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0630914Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0631020Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0631217Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0631350Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0631518Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0631675Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0632019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0632346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0632643Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0632897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0633191Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0633442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0633722Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0633864Z Execution Analysis: (:1) 2025-03-14T06:00:23.0634113Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0634303Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0634308Z 2025-03-14T06:00:23.0634505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0634614Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0634837Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0634942Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0635139Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0635273Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0635420Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0635577Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0636133Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0636724Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0637066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0637393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0637694Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0637948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0638241Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0638494Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0638604Z Execution Analysis: .......... 2025-03-14T06:00:23.0638844Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0639043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0639307Z pt-xla-profiler: TransferFromDeviceTime too frequent: 493 counts during 470 steps 2025-03-14T06:00:23.0639312Z 2025-03-14T06:00:23.0639511Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0639618Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0639896Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0640000Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0640199Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0640363Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0640507Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0640669Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0641009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0641334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0641630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0641884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0642182Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0642433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0642737Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0642854Z Execution Analysis: (:1) 2025-03-14T06:00:23.0643103Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0643293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0643297Z 2025-03-14T06:00:23.0643494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0643600Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0643823Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0643927Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0644126Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0644258Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0644404Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0644651Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0645435Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0646039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0646412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0646777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0647093Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0647378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0647690Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0647969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0648078Z Execution Analysis: .......... 2025-03-14T06:00:23.0648351Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0648553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0648849Z pt-xla-profiler: TransferFromDeviceTime too frequent: 494 counts during 471 steps 2025-03-14T06:00:23.0648855Z 2025-03-14T06:00:23.0649059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0649188Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0649479Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0649606Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0649840Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0650001Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0650146Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0650328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0650690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0651053Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0651370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0651662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0651972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0652282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0652578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0652715Z Execution Analysis: (:1) 2025-03-14T06:00:23.0652974Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0653193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0653199Z 2025-03-14T06:00:23.0653404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0653530Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0653764Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0653889Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0654099Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0654259Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0654409Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0654617Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0655235Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0655826Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0656187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0656551Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0656869Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0657265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0657551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0657816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0657919Z Execution Analysis: .......... 2025-03-14T06:00:23.0658175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0658363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0658644Z pt-xla-profiler: TransferFromDeviceTime too frequent: 495 counts during 472 steps 2025-03-14T06:00:23.0658650Z 2025-03-14T06:00:23.0658841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0658960Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0659228Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0659366Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0659558Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0659704Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0659838Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0660005Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0660338Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0660669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0660960Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0661221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0661508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0661797Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0662070Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0662196Z Execution Analysis: (:1) 2025-03-14T06:00:23.0662436Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0662635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0662640Z 2025-03-14T06:00:23.0662838Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0662944Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0663170Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0663272Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0663466Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0663615Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0663787Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0663953Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0664521Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0665063Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0665561Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0666077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0666400Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0666679Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0667000Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0667275Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0667392Z Execution Analysis: .......... 2025-03-14T06:00:23.0667652Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0667865Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0668150Z pt-xla-profiler: TransferFromDeviceTime too frequent: 496 counts during 473 steps 2025-03-14T06:00:23.0668155Z 2025-03-14T06:00:23.0668372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0668490Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0668869Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0668986Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0669205Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0669352Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0669511Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0669685Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0670062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0670416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0670743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0671020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0671380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0671654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0671958Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0672087Z Execution Analysis: (:1) 2025-03-14T06:00:23.0672356Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0672560Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0672565Z 2025-03-14T06:00:23.0672779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0672895Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0673138Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0673254Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0673469Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0673663Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0673820Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0674020Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0674630Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0675204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0675581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0675935Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0676261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0676539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0676859Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0677131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0677248Z Execution Analysis: .......... 2025-03-14T06:00:23.0677510Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0677728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0678228Z pt-xla-profiler: TransferFromDeviceTime too frequent: 497 counts during 474 steps 2025-03-14T06:00:23.0678234Z 2025-03-14T06:00:23.0678458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0678572Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0678853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0678959Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0679161Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0679298Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0679446Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0679606Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0679950Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0680277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0680576Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0680860Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0681155Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0681407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0681689Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0681817Z Execution Analysis: (:1) 2025-03-14T06:00:23.0682057Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0682255Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0682258Z 2025-03-14T06:00:23.0682446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0682565Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0682782Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0682923Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0683116Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0683261Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0683422Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0683597Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0684148Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0684757Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0685276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0685642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0685962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0686247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0686559Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0686843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0686952Z Execution Analysis: .......... 2025-03-14T06:00:23.0687223Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0687429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0687726Z pt-xla-profiler: TransferFromDeviceTime too frequent: 498 counts during 475 steps 2025-03-14T06:00:23.0687733Z 2025-03-14T06:00:23.0687966Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0688095Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0688389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0688513Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0688716Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0688872Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0689016Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0689195Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0689555Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0689917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0690262Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0690550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0690861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0691146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0691442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0691579Z Execution Analysis: (:1) 2025-03-14T06:00:23.0691842Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0692059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0692064Z 2025-03-14T06:00:23.0692270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0692398Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0692661Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0692785Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0692993Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0693179Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0693330Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0693513Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0694110Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0694698Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0695065Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0695434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0695757Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0696053Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0696364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0696650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0696759Z Execution Analysis: .......... 2025-03-14T06:00:23.0697141Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0697343Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0697661Z pt-xla-profiler: TransferFromDeviceTime too frequent: 499 counts during 476 steps 2025-03-14T06:00:23.0697669Z 2025-03-14T06:00:23.0697881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0697997Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0698296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0698407Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0698619Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0698763Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0698906Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0699086Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0699439Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0699840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0700151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0700423Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0700739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0701002Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0701297Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0701422Z Execution Analysis: (:1) 2025-03-14T06:00:23.0701690Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0701891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0701897Z 2025-03-14T06:00:23.0702108Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0702247Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0702483Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0702591Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0702832Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0702974Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0703131Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0703296Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0703880Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0704440Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0704803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0705149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0705468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0705738Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0706049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0706313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0706427Z Execution Analysis: .......... 2025-03-14T06:00:23.0706679Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0706916Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0707310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 500 counts during 477 steps 2025-03-14T06:00:23.0707316Z 2025-03-14T06:00:23.0707521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0707632Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0707915Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0708019Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0708218Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0708355Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0708502Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0708656Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0708999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0709356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0709656Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0710079Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0710390Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0710656Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0710952Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0711075Z Execution Analysis: (:1) 2025-03-14T06:00:23.0711340Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0711541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0711548Z 2025-03-14T06:00:23.0711786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0711899Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0712136Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0712278Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0712490Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0712632Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0712787Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0712953Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0713537Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0714102Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0714465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0714813Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0715132Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0715402Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0715713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0715989Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0716094Z Execution Analysis: .......... 2025-03-14T06:00:23.0716358Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0716586Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0716879Z pt-xla-profiler: TransferFromDeviceTime too frequent: 501 counts during 478 steps 2025-03-14T06:00:23.0716884Z 2025-03-14T06:00:23.0717083Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0717207Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0717490Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0717612Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0717809Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0717961Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0718099Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0718277Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0718656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0719011Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0719317Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0719596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0719896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0720169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0720455Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0720588Z Execution Analysis: (:1) 2025-03-14T06:00:23.0720843Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0721055Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0721086Z 2025-03-14T06:00:23.0721284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0721407Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0721659Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0721779Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0722083Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0722228Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0722365Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0722532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0723081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0723625Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0723961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0724302Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0724684Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0725118Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0725426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0725711Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0725821Z Execution Analysis: .......... 2025-03-14T06:00:23.0726134Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0726343Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0726640Z pt-xla-profiler: TransferFromDeviceTime too frequent: 502 counts during 479 steps 2025-03-14T06:00:23.0726647Z 2025-03-14T06:00:23.0726852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0726979Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0727271Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0727396Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0727606Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0727761Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0727905Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0728118Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0728484Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0728848Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0729169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0729456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0729766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0730047Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0730342Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0730482Z Execution Analysis: (:1) 2025-03-14T06:00:23.0730747Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0730989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0730994Z 2025-03-14T06:00:23.0731223Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0731353Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0731587Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0731710Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0731918Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0732071Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0732220Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0732402Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0732996Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0733587Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0733965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0734318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0734643Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0734921Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0735255Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0735528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0735689Z Execution Analysis: .......... 2025-03-14T06:00:23.0735951Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0736170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0736462Z pt-xla-profiler: TransferFromDeviceTime too frequent: 503 counts during 480 steps 2025-03-14T06:00:23.0736467Z 2025-03-14T06:00:23.0736688Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0736806Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0737113Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0737334Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0737540Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0737769Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0737919Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0738080Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0738428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0738757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0739063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0739321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0739621Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0739872Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0740159Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0740284Z Execution Analysis: (:1) 2025-03-14T06:00:23.0740564Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0740757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0740762Z 2025-03-14T06:00:23.0740988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0741100Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0741332Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0741441Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0741648Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0741787Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0741942Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0742102Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0742670Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0743210Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0743559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0743890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0744195Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0744450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0744752Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0745027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0745147Z Execution Analysis: .......... 2025-03-14T06:00:23.0745391Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0745597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0745863Z pt-xla-profiler: TransferFromDeviceTime too frequent: 504 counts during 481 steps 2025-03-14T06:00:23.0745867Z 2025-03-14T06:00:23.0746068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0746176Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0746456Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0746562Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0746784Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0746922Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0747069Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0747228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0747577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0747904Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0748205Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0748461Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0748760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0749013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0749298Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0749440Z Execution Analysis: (:1) 2025-03-14T06:00:23.0749691Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0749906Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0749924Z 2025-03-14T06:00:23.0750112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0750236Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0750451Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0750567Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0750759Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0750907Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0751048Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0751209Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0751770Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0752311Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0752644Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0752983Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0753274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0753540Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0753854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0754121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0754222Z Execution Analysis: .......... 2025-03-14T06:00:23.0754476Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0754666Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0754944Z pt-xla-profiler: TransferFromDeviceTime too frequent: 505 counts during 482 steps 2025-03-14T06:00:23.0754951Z 2025-03-14T06:00:23.0755140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0755260Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0755529Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0755673Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0755867Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0756018Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0756153Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0756324Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0756661Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0757001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0757291Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0757557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0757843Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0758111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0758382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0758539Z Execution Analysis: (:1) 2025-03-14T06:00:23.0758804Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0759011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0759015Z 2025-03-14T06:00:23.0759204Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0759326Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0759541Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0759661Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0759852Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0760000Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0760137Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0760310Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0760857Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0761400Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0761732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0762073Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0762366Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0762660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0762948Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0763212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0763314Z Execution Analysis: .......... 2025-03-14T06:00:23.0763570Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0763761Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0764042Z pt-xla-profiler: TransferFromDeviceTime too frequent: 507 counts during 483 steps 2025-03-14T06:00:23.0764046Z 2025-03-14T06:00:23.0764235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0764354Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0764730Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0764850Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0765223Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0765522Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0765666Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0765855Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0766216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0766582Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0766895Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0767183Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0767510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0767781Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0768151Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0768280Z Execution Analysis: (:1) 2025-03-14T06:00:23.0768605Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0768813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0768818Z 2025-03-14T06:00:23.0769032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0769147Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0769391Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0769509Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0769732Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0769879Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0770039Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0770208Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0770814Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0771386Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0771762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0772114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0772482Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0772762Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0773089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0773366Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0773491Z Execution Analysis: .......... 2025-03-14T06:00:23.0773748Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0773972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0774260Z pt-xla-profiler: TransferFromDeviceTime too frequent: 508 counts during 484 steps 2025-03-14T06:00:23.0774266Z 2025-03-14T06:00:23.0774483Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0774665Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0774969Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0775083Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0775299Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0775448Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0775603Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0775774Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0776149Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0776503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0776834Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0777220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0777639Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0777917Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0778226Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0778349Z Execution Analysis: (:1) 2025-03-14T06:00:23.0778604Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0778795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0778799Z 2025-03-14T06:00:23.0779000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0779109Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0779339Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0779449Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0779655Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0779793Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0779947Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0780108Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0780671Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0781206Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0781561Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0781896Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0782229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0782489Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0782791Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0783048Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0783163Z Execution Analysis: .......... 2025-03-14T06:00:23.0783406Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0783612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0783890Z pt-xla-profiler: TransferFromDeviceTime too frequent: 509 counts during 485 steps 2025-03-14T06:00:23.0783894Z 2025-03-14T06:00:23.0784112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0784239Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0784514Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0784635Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0784829Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0784977Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0785115Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0785290Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0785624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0785968Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0786259Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0786532Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0786842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0787108Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0787402Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0787534Z Execution Analysis: (:1) 2025-03-14T06:00:23.0787776Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0787985Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0787989Z 2025-03-14T06:00:23.0788176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0788296Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0788512Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0788634Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0788824Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0788970Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0789106Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0789279Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0789824Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0790368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0790702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0791070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0791363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0791636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0791924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0792188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0792291Z Execution Analysis: .......... 2025-03-14T06:00:23.0792542Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0792732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0793010Z pt-xla-profiler: TransferFromDeviceTime too frequent: 510 counts during 486 steps 2025-03-14T06:00:23.0793040Z 2025-03-14T06:00:23.0793232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0793355Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0793627Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0793747Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0793939Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0794087Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0794221Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0794388Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0794720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0795058Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0795351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0795641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0796102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0796402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0796693Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0796827Z Execution Analysis: (:1) 2025-03-14T06:00:23.0797081Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0797293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0797298Z 2025-03-14T06:00:23.0797496Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0797624Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0797852Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0797976Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0798178Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0798334Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0798477Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0798656Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0799232Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0799803Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0800182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0800541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0800859Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0801129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0801444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0801709Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0801829Z Execution Analysis: .......... 2025-03-14T06:00:23.0802082Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0802291Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0802597Z pt-xla-profiler: TransferFromDeviceTime too frequent: 511 counts during 487 steps 2025-03-14T06:00:23.0802605Z 2025-03-14T06:00:23.0802816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0802930Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0803229Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0803337Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0803552Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0803695Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0803847Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0804010Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0804375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0804816Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0805355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0805633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0805982Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0806254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0806569Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0806697Z Execution Analysis: (:1) 2025-03-14T06:00:23.0806975Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0807180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0807187Z 2025-03-14T06:00:23.0807405Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0807524Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0807770Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0807884Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0808103Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0808249Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0808409Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0808578Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0809184Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0809786Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0810162Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0810515Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0810847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0811125Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0811446Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0811714Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0811833Z Execution Analysis: .......... 2025-03-14T06:00:23.0812094Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0812339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0812629Z pt-xla-profiler: TransferFromDeviceTime too frequent: 512 counts during 488 steps 2025-03-14T06:00:23.0812634Z 2025-03-14T06:00:23.0812849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0812967Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0813272Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0813388Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0813603Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0813751Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0813913Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0814084Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0814462Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0814820Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0815181Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0815484Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0815806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0816078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0816386Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0816514Z Execution Analysis: (:1) 2025-03-14T06:00:23.0816786Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0816994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0817010Z 2025-03-14T06:00:23.0817314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0817421Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0817648Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0817754Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0817958Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0818093Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0818243Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0818401Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0818961Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0819535Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0819881Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0820224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0820519Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0820792Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0821083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0821346Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0821448Z Execution Analysis: .......... 2025-03-14T06:00:23.0821707Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0821924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0822209Z pt-xla-profiler: TransferFromDeviceTime too frequent: 513 counts during 489 steps 2025-03-14T06:00:23.0822214Z 2025-03-14T06:00:23.0822408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0822531Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0822805Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0822924Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0823121Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0823273Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0823412Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0823588Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0823928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0824297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0824615Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0824887Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0825179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0825449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0825723Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0825860Z Execution Analysis: (:1) 2025-03-14T06:00:23.0826105Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0826319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0826325Z 2025-03-14T06:00:23.0826516Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0826644Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0826859Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0826980Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0827174Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0827325Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0827465Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0827640Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0828217Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0828767Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0829105Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0829452Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0829749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0830021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0830312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0830572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0830699Z Execution Analysis: .......... 2025-03-14T06:00:23.0830954Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0831144Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0831423Z pt-xla-profiler: TransferFromDeviceTime too frequent: 514 counts during 490 steps 2025-03-14T06:00:23.0831427Z 2025-03-14T06:00:23.0831618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0831737Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0832008Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0832127Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0832318Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0832466Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0832603Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0832772Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0833130Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0833470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0833786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0834057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0834346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0834612Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0834884Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0835019Z Execution Analysis: (:1) 2025-03-14T06:00:23.0835262Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0835467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0835472Z 2025-03-14T06:00:23.0835676Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0835787Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0836014Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0836120Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0836327Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0836461Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0836610Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0836768Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0837352Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0837886Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0838233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0838561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0838865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0839122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0839422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0839712Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0839825Z Execution Analysis: .......... 2025-03-14T06:00:23.0840068Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0840271Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0840541Z pt-xla-profiler: TransferFromDeviceTime too frequent: 515 counts during 491 steps 2025-03-14T06:00:23.0840545Z 2025-03-14T06:00:23.0840748Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0840857Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0841140Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0841245Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0841447Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0841585Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0841733Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0841917Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0842263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0842617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0842925Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0843184Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0843484Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0843736Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0844020Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0844140Z Execution Analysis: (:1) 2025-03-14T06:00:23.0844397Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0844660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0844667Z 2025-03-14T06:00:23.0844873Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0845151Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0845400Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0845514Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0845738Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0845883Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0846047Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0846253Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0846856Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0847433Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0847810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0848169Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0848496Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0848775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0849098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0849398Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0849521Z Execution Analysis: .......... 2025-03-14T06:00:23.0849782Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0850001Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0850288Z pt-xla-profiler: TransferFromDeviceTime too frequent: 516 counts during 492 steps 2025-03-14T06:00:23.0850305Z 2025-03-14T06:00:23.0850509Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0850638Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0850930Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0851056Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0851266Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0851413Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0851594Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0851766Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0852163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0852518Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0852844Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0853134Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0853444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0853728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0854028Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0854170Z Execution Analysis: (:1) 2025-03-14T06:00:23.0854432Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0854651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0854655Z 2025-03-14T06:00:23.0854858Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0854986Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0855218Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0855344Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0855550Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0855709Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0855885Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0856071Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0856666Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0857359Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0857697Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0858041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0858335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0858607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0858925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0859189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0859291Z Execution Analysis: .......... 2025-03-14T06:00:23.0863885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0864119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0864402Z pt-xla-profiler: TransferFromDeviceTime too frequent: 517 counts during 493 steps 2025-03-14T06:00:23.0864409Z 2025-03-14T06:00:23.0864599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0864715Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0864985Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0865100Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0865434Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0866019Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0866161Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0866383Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0866749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0867112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0867425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0867711Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0868024Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0868306Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0868598Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0868731Z Execution Analysis: (:1) 2025-03-14T06:00:23.0868992Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0869205Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0869209Z 2025-03-14T06:00:23.0869408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0869533Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0869764Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0869888Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0870092Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0870285Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0870435Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0870612Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0871216Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0871803Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0872161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0872522Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0872832Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0873160Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0873468Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0873748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0873855Z Execution Analysis: .......... 2025-03-14T06:00:23.0874123Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0874325Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0874616Z pt-xla-profiler: TransferFromDeviceTime too frequent: 518 counts during 494 steps 2025-03-14T06:00:23.0874621Z 2025-03-14T06:00:23.0874821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0874943Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0875232Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0875381Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0875582Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0875735Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0875900Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0876078Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0876434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0876795Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0877105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0877388Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0877803Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0878180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0878454Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0878570Z Execution Analysis: (:1) 2025-03-14T06:00:23.0878814Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0878999Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0879004Z 2025-03-14T06:00:23.0879194Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0879297Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0879514Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0879616Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0879858Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0879991Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0880133Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0880286Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0880839Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0881370Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0881709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0882032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0882359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0882613Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0882904Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0883151Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0883257Z Execution Analysis: .......... 2025-03-14T06:00:23.0883496Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0883690Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0883952Z pt-xla-profiler: TransferFromDeviceTime too frequent: 519 counts during 495 steps 2025-03-14T06:00:23.0883958Z 2025-03-14T06:00:23.0884152Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0884257Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0884597Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0884730Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0885098Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0885268Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0885424Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0885591Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0885961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0886312Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0886632Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0886910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0887230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0887497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0887799Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0887922Z Execution Analysis: (:1) 2025-03-14T06:00:23.0888187Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0888385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0888389Z 2025-03-14T06:00:23.0888597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0888708Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0888948Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0889149Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0889368Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0889508Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0889665Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0889833Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0890433Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0891005Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0891374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0891724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0892077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0892350Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0892667Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0892937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0893052Z Execution Analysis: .......... 2025-03-14T06:00:23.0893310Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0893518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0893804Z pt-xla-profiler: TransferFromDeviceTime too frequent: 520 counts during 496 steps 2025-03-14T06:00:23.0893821Z 2025-03-14T06:00:23.0894023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0894171Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0894461Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0894578Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0894803Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0894953Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0895091Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0895256Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0895619Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0895976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0896284Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0896568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0896872Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0897254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0897537Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0897663Z Execution Analysis: (:1) 2025-03-14T06:00:23.0897910Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0898113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0898118Z 2025-03-14T06:00:23.0898309Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0898427Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0898669Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0898784Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0898978Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0899122Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0899267Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0899441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0900014Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0900577Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0900923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0901296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0901598Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0901871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0902169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0902436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0902535Z Execution Analysis: .......... 2025-03-14T06:00:23.0902790Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0902983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0903266Z pt-xla-profiler: TransferFromDeviceTime too frequent: 521 counts during 497 steps 2025-03-14T06:00:23.0903274Z 2025-03-14T06:00:23.0903467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0903608Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0903886Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0904028Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0904231Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0904386Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0904530Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0904708Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0905061Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0905418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0905730Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0906015Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0906317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0906596Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0906884Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0907022Z Execution Analysis: (:1) 2025-03-14T06:00:23.0907383Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0907590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0907594Z 2025-03-14T06:00:23.0907811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0907932Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0908153Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0908272Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0908468Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0908620Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0908759Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0908934Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0909485Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0910031Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0910397Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0910739Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0911033Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0911310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0911613Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0911869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0911987Z Execution Analysis: .......... 2025-03-14T06:00:23.0912232Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0912437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0912711Z pt-xla-profiler: TransferFromDeviceTime too frequent: 522 counts during 498 steps 2025-03-14T06:00:23.0912737Z 2025-03-14T06:00:23.0912944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0913056Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0913377Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0913486Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0913694Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0913831Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0913983Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0914144Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0914491Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0914823Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0915133Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0915392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0915700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0915958Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0916247Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0916369Z Execution Analysis: (:1) 2025-03-14T06:00:23.0916626Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0916819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0916824Z 2025-03-14T06:00:23.0917051Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0917162Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0917388Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0917495Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0917698Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0917832Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0917981Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0918139Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0918694Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0919232Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0919774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0920103Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0920407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0920665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0920965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0921216Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0921331Z Execution Analysis: .......... 2025-03-14T06:00:23.0921575Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0921782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0922077Z pt-xla-profiler: TransferFromDeviceTime too frequent: 523 counts during 499 steps 2025-03-14T06:00:23.0922082Z 2025-03-14T06:00:23.0922286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0922419Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0922706Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0922813Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0923023Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0923163Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0923312Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0923474Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0923825Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0924154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0924460Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0924789Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0925269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0925543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0925852Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0925979Z Execution Analysis: (:1) 2025-03-14T06:00:23.0926252Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0926491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0926498Z 2025-03-14T06:00:23.0926717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0926834Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0927087Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0927202Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0927422Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0927571Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0927733Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0927905Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0928512Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0929115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0929493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0929861Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0930178Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0930469Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0930780Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0931067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0931626Z Execution Analysis: .......... 2025-03-14T06:00:23.0932108Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0932700Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0933366Z pt-xla-profiler: TransferFromDeviceTime too frequent: 524 counts during 500 steps 2025-03-14T06:00:23.0933785Z 2025-03-14T06:00:23.0934033Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0934481Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0935005Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0935544Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0935974Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0936452Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0936870Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0937314Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0937973Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0938863Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0939669Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0940395Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0941112Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0941826Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0942523Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0943075Z Execution Analysis: (:1) 2025-03-14T06:00:23.0943600Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0944193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0944526Z 2025-03-14T06:00:23.0944743Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0945194Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0945644Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0946113Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0946527Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0946993Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0947408Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0947844Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0948717Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0950045Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0951215Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0952040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0952812Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0953504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0954197Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0954888Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0955382Z Execution Analysis: .......... 2025-03-14T06:00:23.0955835Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0956435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0957058Z pt-xla-profiler: TransferFromDeviceTime too frequent: 525 counts during 501 steps 2025-03-14T06:00:23.0957460Z 2025-03-14T06:00:23.0957657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0958086Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0958579Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0959089Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0959487Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0959935Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0960326Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0960743Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0961368Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0962177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0962946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0963644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0964332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0965272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0966124Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0966668Z Execution Analysis: (:1) 2025-03-14T06:00:23.0967225Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0967816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0968142Z 2025-03-14T06:00:23.0968362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0968810Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0969262Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0969733Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0970153Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0970624Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0971034Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0971456Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0972372Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0973661Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0974720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0975558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0976346Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0977188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0977983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0978638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0979103Z Execution Analysis: .......... 2025-03-14T06:00:23.0979577Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0980154Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0980730Z pt-xla-profiler: TransferFromDeviceTime too frequent: 526 counts during 502 steps 2025-03-14T06:00:23.0981113Z 2025-03-14T06:00:23.0981303Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0981715Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0982184Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.0982670Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0983051Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.0983478Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.0983851Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.0984248Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0984837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.0985608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0986341Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0986999Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.0987654Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.0988311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.0988981Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.0989488Z Execution Analysis: (:1) 2025-03-14T06:00:23.0989952Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.0990492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0990796Z 2025-03-14T06:00:23.0990992Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.0991397Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.0991813Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.0992242Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.0992624Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.0993058Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.0993427Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.0993857Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.0994672Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.0996039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.0997066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.0997885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.0998662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.0999361Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1000065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1000763Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1001283Z Execution Analysis: .......... 2025-03-14T06:00:23.1001735Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1002339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1002944Z pt-xla-profiler: TransferFromDeviceTime too frequent: 528 counts during 503 steps 2025-03-14T06:00:23.1003346Z 2025-03-14T06:00:23.1003546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1003985Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1004563Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1005252Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1005674Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1006144Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1006549Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1006971Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1007620Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1008453Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1009238Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1009949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1010658Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1011358Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1012094Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1012645Z Execution Analysis: (:1) 2025-03-14T06:00:23.1013144Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1013737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1014063Z 2025-03-14T06:00:23.1014275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1014719Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1015165Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1015628Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1016047Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1016546Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1016959Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1017485Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1018297Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1019497Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1020473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1021253Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1021991Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1022655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1023315Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1024007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1024480Z Execution Analysis: .......... 2025-03-14T06:00:23.1024934Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1025483Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1026059Z pt-xla-profiler: TransferFromDeviceTime too frequent: 529 counts during 504 steps 2025-03-14T06:00:23.1026440Z 2025-03-14T06:00:23.1026634Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1027050Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1027522Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1028012Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1028391Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1028828Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1029201Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1029604Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1030206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1030983Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1031717Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1032383Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1033044Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1033737Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1034384Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1034897Z Execution Analysis: (:1) 2025-03-14T06:00:23.1035362Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1035913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1036218Z 2025-03-14T06:00:23.1036417Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1036830Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1037245Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1037679Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1038087Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1038530Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1038912Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1039318Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1040137Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1041333Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1042310Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1043085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1043823Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1044560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1045464Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1046171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1046711Z Execution Analysis: .......... 2025-03-14T06:00:23.1047181Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1047774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1048405Z pt-xla-profiler: TransferFromDeviceTime too frequent: 530 counts during 505 steps 2025-03-14T06:00:23.1048829Z 2025-03-14T06:00:23.1049038Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1049497Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1050027Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1050572Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1050998Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1051477Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1051894Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1052336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1052994Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1053841Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1054645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1055376Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1056144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1056882Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1057664Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1058179Z Execution Analysis: (:1) 2025-03-14T06:00:23.1058655Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1059208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1059511Z 2025-03-14T06:00:23.1059709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1060122Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1060536Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1061016Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1061391Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1061826Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1062211Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1062614Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1063434Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1064628Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1065936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1066780Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1067583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1068385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1069099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1069853Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1070365Z Execution Analysis: .......... 2025-03-14T06:00:23.1070829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1071426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1072049Z pt-xla-profiler: TransferFromDeviceTime too frequent: 531 counts during 506 steps 2025-03-14T06:00:23.1072470Z 2025-03-14T06:00:23.1072680Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1073137Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1073656Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1074191Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1074609Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1075089Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1075505Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1075943Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1076595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1077547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1078411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1079123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1079783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1080449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1081100Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1081615Z Execution Analysis: (:1) 2025-03-14T06:00:23.1082082Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1082634Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1082935Z 2025-03-14T06:00:23.1083135Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1083554Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1084015Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1084441Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1084897Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1085535Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1085949Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1086392Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1087287Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1088577Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1089638Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1090491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1091294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1092053Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1092802Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1093524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1094040Z Execution Analysis: .......... 2025-03-14T06:00:23.1094512Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1095112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1095741Z pt-xla-profiler: TransferFromDeviceTime too frequent: 532 counts during 507 steps 2025-03-14T06:00:23.1096161Z 2025-03-14T06:00:23.1096368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1096830Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1097449Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1097970Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1098378Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1098839Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1099241Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1099669Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1100303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1101127Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1101950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1102656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1103360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1104063Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1104746Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1105290Z Execution Analysis: (:1) 2025-03-14T06:00:23.1105782Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1106363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1106685Z 2025-03-14T06:00:23.1106900Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1107376Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1107814Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1108283Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1108692Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1109161Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1109577Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1110005Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1110871Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1112135Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1113168Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1113996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1114806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1115542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1116414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1117125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1117634Z Execution Analysis: .......... 2025-03-14T06:00:23.1118101Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1118694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1119322Z pt-xla-profiler: TransferFromDeviceTime too frequent: 533 counts during 508 steps 2025-03-14T06:00:23.1119740Z 2025-03-14T06:00:23.1119949Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1120406Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1120928Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1121465Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1121883Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1122359Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1122766Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1123200Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1123852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1124765Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1125608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1126336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1127057Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1127770Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1128470Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1129028Z Execution Analysis: (:1) 2025-03-14T06:00:23.1129524Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1130119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1130486Z 2025-03-14T06:00:23.1130692Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1131144Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1131595Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1132065Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1132483Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1132959Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1133379Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1133817Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1134697Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1135986Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1137161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1138015Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1138999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1139723Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1140437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1141150Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1141658Z Execution Analysis: .......... 2025-03-14T06:00:23.1142123Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1142714Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1143343Z pt-xla-profiler: TransferFromDeviceTime too frequent: 534 counts during 509 steps 2025-03-14T06:00:23.1143752Z 2025-03-14T06:00:23.1143972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1144425Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1144946Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1145479Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1145897Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1146373Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1146788Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1147222Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1147879Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1148778Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1149688Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1150491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1151156Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1151815Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1152462Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1152964Z Execution Analysis: (:1) 2025-03-14T06:00:23.1153443Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1154000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1154348Z 2025-03-14T06:00:23.1154540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1154966Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1155393Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1155841Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1156241Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1156687Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1157078Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1157492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1158321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1159525Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1160546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1161336Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1162113Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1162788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1163460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1164130Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1164692Z Execution Analysis: .......... 2025-03-14T06:00:23.1165457Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1166068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1166698Z pt-xla-profiler: TransferFromDeviceTime too frequent: 535 counts during 510 steps 2025-03-14T06:00:23.1167103Z 2025-03-14T06:00:23.1167326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1167779Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1168297Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1168834Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1169253Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1169728Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1170137Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1170579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1171304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1172156Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1172961Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1173690Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1174407Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1175113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1175813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1176366Z Execution Analysis: (:1) 2025-03-14T06:00:23.1176877Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1177714Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1178029Z 2025-03-14T06:00:23.1178221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1178641Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1179066Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1179518Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1179913Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1180363Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1180751Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1181162Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1181987Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1183186Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1184206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1185093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1185843Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1186516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1187184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1187847Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1188322Z Execution Analysis: .......... 2025-03-14T06:00:23.1188766Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1189321Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1189898Z pt-xla-profiler: TransferFromDeviceTime too frequent: 536 counts during 511 steps 2025-03-14T06:00:23.1190275Z 2025-03-14T06:00:23.1190485Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1190909Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1191387Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1191880Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1192268Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1192710Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1193090Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1193528Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1194133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1194916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1195657Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1196513Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1197212Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1197909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1198588Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1199131Z Execution Analysis: (:1) 2025-03-14T06:00:23.1199656Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1200242Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1200574Z 2025-03-14T06:00:23.1200780Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1201223Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1201671Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1202127Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1202539Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1203005Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1203408Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1203835Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1204810Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1206317Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1207416Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1208269Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1209073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1209802Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1210527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1211248Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1211770Z Execution Analysis: .......... 2025-03-14T06:00:23.1212248Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1212852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1213483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 537 counts during 512 steps 2025-03-14T06:00:23.1213892Z 2025-03-14T06:00:23.1214116Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1214575Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1215099Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1215638Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1216064Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1216546Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1216995Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1217535Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1218176Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1218989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1219764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1220466Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1221163Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1221859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1222535Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1223109Z Execution Analysis: (:1) 2025-03-14T06:00:23.1223599Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1224180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1224514Z 2025-03-14T06:00:23.1224717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1225163Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1225611Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1226076Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1226489Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1226959Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1227459Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1227864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1228681Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1229902Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1230935Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1231720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1232468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1233147Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1233822Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1234493Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1234969Z Execution Analysis: .......... 2025-03-14T06:00:23.1235405Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1235961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1236540Z pt-xla-profiler: TransferFromDeviceTime too frequent: 538 counts during 513 steps 2025-03-14T06:00:23.1236915Z 2025-03-14T06:00:23.1237121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1237539Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1238019Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1238126Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1238330Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1238497Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1238651Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1238810Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1239158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1239489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1239793Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1240048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1240346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1240602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1240919Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1241036Z Execution Analysis: (:1) 2025-03-14T06:00:23.1241293Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1241489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1241493Z 2025-03-14T06:00:23.1241693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1241801Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1242029Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1242140Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1242344Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1242480Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1242633Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1242793Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1243381Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1243941Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1244287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1244710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1245190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1245468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1245798Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1246073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1246198Z Execution Analysis: .......... 2025-03-14T06:00:23.1246459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1246678Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1246968Z pt-xla-profiler: TransferFromDeviceTime too frequent: 539 counts during 514 steps 2025-03-14T06:00:23.1246985Z 2025-03-14T06:00:23.1247193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1247326Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1247621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1247749Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1247988Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1248139Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1248296Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1248468Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1248845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1249204Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1249538Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1249829Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1250141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1250452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1250750Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1250897Z Execution Analysis: (:1) 2025-03-14T06:00:23.1251157Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1251377Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1251382Z 2025-03-14T06:00:23.1251587Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1251716Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1251950Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1252076Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1252285Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1252445Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1252596Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1252808Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1253428Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1254020Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1254383Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1254761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1255077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1255370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1255686Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1255975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1256085Z Execution Analysis: .......... 2025-03-14T06:00:23.1256365Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1256575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1256878Z pt-xla-profiler: TransferFromDeviceTime too frequent: 540 counts during 515 steps 2025-03-14T06:00:23.1256883Z 2025-03-14T06:00:23.1257198Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1257321Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1257593Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1257742Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1257940Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1258090Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1258227Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1258403Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1258739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1259083Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1259379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1259653Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1259943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1260239Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1260516Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1260651Z Execution Analysis: (:1) 2025-03-14T06:00:23.1260897Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1261107Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1261112Z 2025-03-14T06:00:23.1261303Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1261425Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1261644Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1261762Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1261960Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1262112Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1262277Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1262451Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1263025Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1263573Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1263913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1264259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1264553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1264827Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1265120Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1265500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1265770Z Execution Analysis: .......... 2025-03-14T06:00:23.1266046Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1266266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1266553Z pt-xla-profiler: TransferFromDeviceTime too frequent: 541 counts during 516 steps 2025-03-14T06:00:23.1266558Z 2025-03-14T06:00:23.1266777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1266897Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1267276Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1267393Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1267614Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1267761Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1267919Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1268089Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1268466Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1268821Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1269151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1269427Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1269789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1270063Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1270373Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1270503Z Execution Analysis: (:1) 2025-03-14T06:00:23.1270778Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1270982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1270987Z 2025-03-14T06:00:23.1271206Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1271323Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1271571Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1271687Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1271908Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1272104Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1272266Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1272472Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1273081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1273657Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1274033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1274389Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1274723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1275002Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1275331Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1275607Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1275728Z Execution Analysis: .......... 2025-03-14T06:00:23.1275989Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1276211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1276501Z pt-xla-profiler: TransferFromDeviceTime too frequent: 542 counts during 517 steps 2025-03-14T06:00:23.1276507Z 2025-03-14T06:00:23.1276729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1276877Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1277187Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1277303Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1277524Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1277781Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1278047Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1278205Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1278553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1278883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1279188Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1279472Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1279776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1280030Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1280321Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1280439Z Execution Analysis: (:1) 2025-03-14T06:00:23.1280695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1280885Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1280890Z 2025-03-14T06:00:23.1281089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1281198Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1281429Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1281560Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1281763Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1281899Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1282075Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1282235Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1282798Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1283332Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1283682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1284026Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1284321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1284658Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1285118Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1285405Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1285515Z Execution Analysis: .......... 2025-03-14T06:00:23.1285789Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1285994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1286297Z pt-xla-profiler: TransferFromDeviceTime too frequent: 543 counts during 518 steps 2025-03-14T06:00:23.1286306Z 2025-03-14T06:00:23.1286547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1286681Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1286975Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1287100Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1287307Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1287465Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1287612Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1287796Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1288157Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1288525Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1288870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1289161Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1289474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1289760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1290055Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1290195Z Execution Analysis: (:1) 2025-03-14T06:00:23.1290455Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1290672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1290676Z 2025-03-14T06:00:23.1290880Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1291014Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1291248Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1291401Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1291608Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1291794Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1291946Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1292133Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1292730Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1293322Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1293691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1294063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1294384Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1294677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1294989Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1295275Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1295384Z Execution Analysis: .......... 2025-03-14T06:00:23.1295656Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1302287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1302855Z pt-xla-profiler: TransferFromDeviceTime too frequent: 544 counts during 519 steps 2025-03-14T06:00:23.1302863Z 2025-03-14T06:00:23.1303077Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1303202Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1303492Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1303613Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1303811Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1303965Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1304105Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1304282Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1304639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1304997Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1305335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1305619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1305921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1306196Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1306479Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1306610Z Execution Analysis: (:1) 2025-03-14T06:00:23.1306866Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1307073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1307080Z 2025-03-14T06:00:23.1307383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1307526Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1307738Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1307851Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1308069Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1308213Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1308348Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1308510Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1309064Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1309608Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1309946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1310282Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1310571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1310841Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1311133Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1311379Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1311484Z Execution Analysis: .......... 2025-03-14T06:00:23.1311721Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1311940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1312205Z pt-xla-profiler: TransferFromDeviceTime too frequent: 545 counts during 520 steps 2025-03-14T06:00:23.1312212Z 2025-03-14T06:00:23.1312408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1312516Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1312791Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1312892Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1313088Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1313220Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1313357Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1313510Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1313845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1314221Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1314515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1314765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1315056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1315301Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1315575Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1315685Z Execution Analysis: (:1) 2025-03-14T06:00:23.1315930Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1316114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1316122Z 2025-03-14T06:00:23.1316312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1316441Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1316659Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1316783Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1316981Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1317111Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1317254Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1317408Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1317962Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1318495Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1318833Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1319153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1319452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1319704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1319994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1320239Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1320342Z Execution Analysis: .......... 2025-03-14T06:00:23.1320578Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1320801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1321067Z pt-xla-profiler: TransferFromDeviceTime too frequent: 546 counts during 521 steps 2025-03-14T06:00:23.1321072Z 2025-03-14T06:00:23.1321269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1321373Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1321648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1321748Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1321940Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1322071Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1322209Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1322362Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1322729Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1323056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1323358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1323612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1323907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1324153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1324434Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1324657Z Execution Analysis: (:1) 2025-03-14T06:00:23.1325077Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1325284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1325319Z 2025-03-14T06:00:23.1325536Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1325651Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1325921Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1326033Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1326249Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1326390Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1326544Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1326711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1327308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1327888Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1328258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1328622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1328934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1329217Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1329525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1329801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1329909Z Execution Analysis: .......... 2025-03-14T06:00:23.1330205Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1330408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1330700Z pt-xla-profiler: TransferFromDeviceTime too frequent: 547 counts during 522 steps 2025-03-14T06:00:23.1330704Z 2025-03-14T06:00:23.1330904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1331028Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1331313Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1331426Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1331625Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1331776Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1331917Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1332117Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1332473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1332836Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1333147Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1333433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1333738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1334016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1334304Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1334437Z Execution Analysis: (:1) 2025-03-14T06:00:23.1334695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1334930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1334935Z 2025-03-14T06:00:23.1335162Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1335284Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1335516Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1335631Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1335831Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1335981Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1336126Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1336303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1336897Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1337561Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1337895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1338228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1338515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1338776Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1339058Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1339316Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1339437Z Execution Analysis: .......... 2025-03-14T06:00:23.1339684Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1339869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1340141Z pt-xla-profiler: TransferFromDeviceTime too frequent: 549 counts during 523 steps 2025-03-14T06:00:23.1340146Z 2025-03-14T06:00:23.1340331Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1340445Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1340710Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1340819Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1341004Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1341178Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1341317Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1341491Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1341827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1342168Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1342463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1342734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1343024Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1343290Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1343563Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1343698Z Execution Analysis: (:1) 2025-03-14T06:00:23.1343941Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1344170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1344173Z 2025-03-14T06:00:23.1344400Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1344511Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1344741Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1344848Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1345055Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1345193Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1345332Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1345509Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1346060Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1346612Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1346966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1347297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1347610Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1347871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1348177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1348479Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1348601Z Execution Analysis: .......... 2025-03-14T06:00:23.1348847Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1349057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1349327Z pt-xla-profiler: TransferFromDeviceTime too frequent: 550 counts during 524 steps 2025-03-14T06:00:23.1349332Z 2025-03-14T06:00:23.1349539Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1349651Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1349941Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1350048Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1350281Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1350422Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1350574Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1350735Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1351086Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1351417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1351729Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1351990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1352294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1352548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1352842Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1352988Z Execution Analysis: (:1) 2025-03-14T06:00:23.1353246Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1353462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1353466Z 2025-03-14T06:00:23.1353672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1353781Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1354010Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1354115Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1354317Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1354452Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1354604Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1354765Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1355322Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1355855Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1356201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1356538Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1356839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1357096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1357420Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1357675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1357788Z Execution Analysis: .......... 2025-03-14T06:00:23.1358032Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1358235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1358500Z pt-xla-profiler: TransferFromDeviceTime too frequent: 551 counts during 525 steps 2025-03-14T06:00:23.1358505Z 2025-03-14T06:00:23.1358709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1358817Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1359102Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1359236Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1359447Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1359586Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1359738Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1359900Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1360250Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1360579Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1360887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1361145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1361444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1361714Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1361986Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1362146Z Execution Analysis: (:1) 2025-03-14T06:00:23.1362416Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1362620Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1362624Z 2025-03-14T06:00:23.1362813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1362937Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1363156Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1363273Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1363465Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1363620Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1363760Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1363936Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1364559Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1365430Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1365803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1366177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1366494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1366870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1367187Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1367478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1367589Z Execution Analysis: .......... 2025-03-14T06:00:23.1367869Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1368075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1368379Z pt-xla-profiler: TransferFromDeviceTime too frequent: 552 counts during 526 steps 2025-03-14T06:00:23.1368385Z 2025-03-14T06:00:23.1368593Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1368728Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1369065Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1369191Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1369397Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1369556Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1369701Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1369890Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1370254Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1370622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1370936Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1371227Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1371540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1371829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1372248Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1372394Z Execution Analysis: (:1) 2025-03-14T06:00:23.1372692Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1372912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1372917Z 2025-03-14T06:00:23.1373121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1373253Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1373488Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1373617Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1373830Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1373991Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1374143Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1374325Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1374926Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1375514Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1375878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1376244Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1376587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1376879Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1377298Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1377578Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1377683Z Execution Analysis: .......... 2025-03-14T06:00:23.1377949Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1378150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1378441Z pt-xla-profiler: TransferFromDeviceTime too frequent: 553 counts during 527 steps 2025-03-14T06:00:23.1378446Z 2025-03-14T06:00:23.1378658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1378801Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1379103Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1379215Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1379429Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1379574Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1379729Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1379896Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1380261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1380609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1380931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1381202Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1381523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1381813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1382119Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1382283Z Execution Analysis: (:1) 2025-03-14T06:00:23.1382555Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1382756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1382761Z 2025-03-14T06:00:23.1382975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1383090Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1383329Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1383443Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1383657Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1383801Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1383958Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1384126Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1384714Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1385275Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1385641Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1385986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1386336Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1386608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1386926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1387195Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1387311Z Execution Analysis: .......... 2025-03-14T06:00:23.1387569Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1387779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1388059Z pt-xla-profiler: TransferFromDeviceTime too frequent: 554 counts during 528 steps 2025-03-14T06:00:23.1388063Z 2025-03-14T06:00:23.1388302Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1388418Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1388716Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1388828Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1389041Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1389185Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1389339Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1389505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1389868Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1390216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1390533Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1390808Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1391145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1391411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1391733Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1391859Z Execution Analysis: (:1) 2025-03-14T06:00:23.1392128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1392330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1392334Z 2025-03-14T06:00:23.1392545Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1392663Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1392905Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1393022Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1393238Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1393381Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1393539Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1393705Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1394295Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1394857Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1395221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1395591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1395914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1396240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1396545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1396817Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1396923Z Execution Analysis: .......... 2025-03-14T06:00:23.1397191Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1397392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1397684Z pt-xla-profiler: TransferFromDeviceTime too frequent: 555 counts during 529 steps 2025-03-14T06:00:23.1397711Z 2025-03-14T06:00:23.1397912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1398035Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1398317Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1398439Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1398638Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1398787Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1398928Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1399106Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1399456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1399811Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1400124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1400428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1400732Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1401034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1401323Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1401457Z Execution Analysis: (:1) 2025-03-14T06:00:23.1401710Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1401918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1401922Z 2025-03-14T06:00:23.1402120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1402246Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1402473Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1402590Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1402793Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1402943Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1403088Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1403262Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1403840Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1404403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1404880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1405410Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1405724Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1406011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1406322Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1406601Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1406709Z Execution Analysis: .......... 2025-03-14T06:00:23.1406979Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1407183Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1407506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 556 counts during 530 steps 2025-03-14T06:00:23.1407513Z 2025-03-14T06:00:23.1407719Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1407851Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1408147Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1408275Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1408482Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1408639Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1408784Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1408966Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1409325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1409694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1410008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1410321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1410655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1410939Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1411236Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1411375Z Execution Analysis: (:1) 2025-03-14T06:00:23.1411634Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1411848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1411854Z 2025-03-14T06:00:23.1412062Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1412193Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1412426Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1412546Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1412751Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1412903Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1413049Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1413228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1413820Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1414403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1414803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1415157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1415481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1415756Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1416076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1416349Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1416472Z Execution Analysis: .......... 2025-03-14T06:00:23.1416730Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1416978Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1417270Z pt-xla-profiler: TransferFromDeviceTime too frequent: 557 counts during 531 steps 2025-03-14T06:00:23.1417276Z 2025-03-14T06:00:23.1417490Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1417607Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1417910Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1418022Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1418239Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1418386Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1418539Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1418708Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1419080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1419436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1419798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1420101Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1420424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1420694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1420997Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1421125Z Execution Analysis: (:1) 2025-03-14T06:00:23.1421395Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1421604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1421608Z 2025-03-14T06:00:23.1421825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1421942Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1422184Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1422298Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1422521Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1422667Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1422827Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1423107Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1423664Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1424228Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1424576Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1424908Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1425210Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1425470Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1425766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1426019Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1426129Z Execution Analysis: .......... 2025-03-14T06:00:23.1426371Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1426596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1426865Z pt-xla-profiler: TransferFromDeviceTime too frequent: 558 counts during 532 steps 2025-03-14T06:00:23.1426869Z 2025-03-14T06:00:23.1427070Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1427179Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1427462Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1427570Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1427772Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1427908Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1428050Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1428206Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1428556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1428920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1429224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1429506Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1429806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1430056Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1430339Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1430456Z Execution Analysis: (:1) 2025-03-14T06:00:23.1430709Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1430903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1430922Z 2025-03-14T06:00:23.1431110Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1431230Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1431448Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1431568Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1431757Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1431906Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1432044Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1432216Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1432785Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1433332Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1433669Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1434017Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1434311Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1434579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1434869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1435133Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1435262Z Execution Analysis: .......... 2025-03-14T06:00:23.1435521Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1435715Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1435993Z pt-xla-profiler: TransferFromDeviceTime too frequent: 559 counts during 533 steps 2025-03-14T06:00:23.1435999Z 2025-03-14T06:00:23.1436192Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1436312Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1436583Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1436698Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1436891Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1437038Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1437176Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1437344Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1437709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1438049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1438398Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1438664Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1438956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1439219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1439491Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1439620Z Execution Analysis: (:1) 2025-03-14T06:00:23.1439864Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1440064Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1440068Z 2025-03-14T06:00:23.1440257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1440378Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1440594Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1440706Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1440897Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1441041Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1441180Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1441346Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1441917Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1442460Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1442800Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1443140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1443433Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1443699Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1443987Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1444243Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1444371Z Execution Analysis: .......... 2025-03-14T06:00:23.1444712Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1445071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1445375Z pt-xla-profiler: TransferFromDeviceTime too frequent: 560 counts during 534 steps 2025-03-14T06:00:23.1445380Z 2025-03-14T06:00:23.1445598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1445714Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1446021Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1446131Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1446337Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1446495Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1446640Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1446855Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1447216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1447606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1447932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1448207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1448529Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1448800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1449104Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1449234Z Execution Analysis: (:1) 2025-03-14T06:00:23.1449507Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1449711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1449716Z 2025-03-14T06:00:23.1449928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1450041Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1450287Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1450399Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1450616Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1450761Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1450921Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1451121Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1451730Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1452311Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1452685Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1453041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1453366Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1453645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1453965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1454278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1454399Z Execution Analysis: .......... 2025-03-14T06:00:23.1454658Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1454876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1455164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 561 counts during 535 steps 2025-03-14T06:00:23.1455169Z 2025-03-14T06:00:23.1455381Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1455499Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1455803Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1455918Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1456144Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1456293Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1456473Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1456645Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1457037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1457476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1457776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1458031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1458331Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1458583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1458870Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1458993Z Execution Analysis: (:1) 2025-03-14T06:00:23.1459247Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1459438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1459443Z 2025-03-14T06:00:23.1459643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1459751Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1459979Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1460084Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1460286Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1460421Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1460593Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1460752Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1461311Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1461845Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1462189Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1462514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1462816Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1463071Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1463395Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1463647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1463763Z Execution Analysis: .......... 2025-03-14T06:00:23.1464003Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1464200Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1464473Z pt-xla-profiler: TransferFromDeviceTime too frequent: 562 counts during 536 steps 2025-03-14T06:00:23.1464478Z 2025-03-14T06:00:23.1464667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1464780Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1465051Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1465168Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1465506Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1465893Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1466039Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1466220Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1466642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1467009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1467325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1467615Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1467928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1468211Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1468512Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1468650Z Execution Analysis: (:1) 2025-03-14T06:00:23.1468913Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1469127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1469131Z 2025-03-14T06:00:23.1469336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1469462Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1469697Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1469820Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1470029Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1470220Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1470373Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1470556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1471151Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1471738Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1472101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1472473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1472791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1473124Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1473442Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1473729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1473839Z Execution Analysis: .......... 2025-03-14T06:00:23.1474118Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1474326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1474629Z pt-xla-profiler: TransferFromDeviceTime too frequent: 563 counts during 537 steps 2025-03-14T06:00:23.1474633Z 2025-03-14T06:00:23.1474840Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1474974Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1475269Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1475398Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1475635Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1475797Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1475968Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1476159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1476520Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1476895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1477211Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1477505Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1477824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1478113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1478519Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1478661Z Execution Analysis: (:1) 2025-03-14T06:00:23.1479024Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1479233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1479237Z 2025-03-14T06:00:23.1479428Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1479553Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1479773Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1479896Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1480114Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1480269Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1480410Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1480583Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1481137Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1481684Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1482030Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1482357Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1482691Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1482947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1483248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1483500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1483613Z Execution Analysis: .......... 2025-03-14T06:00:23.1483853Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1484057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1484324Z pt-xla-profiler: TransferFromDeviceTime too frequent: 564 counts during 538 steps 2025-03-14T06:00:23.1484329Z 2025-03-14T06:00:23.1484589Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1484703Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1485158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1485311Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1485528Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1485699Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1485859Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1486028Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1486400Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1486752Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1487080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1487359Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1487686Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1487959Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1488269Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1488396Z Execution Analysis: (:1) 2025-03-14T06:00:23.1488671Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1488884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1488888Z 2025-03-14T06:00:23.1489107Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1489225Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1489472Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1489626Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1489850Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1489995Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1490155Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1490328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1490934Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1491511Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1491884Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1492239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1492596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1492876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1493199Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1493472Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1493595Z Execution Analysis: .......... 2025-03-14T06:00:23.1493857Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1494073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1494361Z pt-xla-profiler: TransferFromDeviceTime too frequent: 565 counts during 539 steps 2025-03-14T06:00:23.1494366Z 2025-03-14T06:00:23.1494589Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1494732Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1495035Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1495150Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1495397Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1495545Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1495703Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1495875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1496249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1496603Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1496930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1497319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1497635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1497900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1498201Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1498325Z Execution Analysis: (:1) 2025-03-14T06:00:23.1498592Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1498792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1498808Z 2025-03-14T06:00:23.1499006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1499133Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1499386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1499510Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1499710Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1499851Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1500010Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1500177Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1500768Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1501342Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1501694Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1502084Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1502393Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1502678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1502983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1503260Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1503365Z Execution Analysis: .......... 2025-03-14T06:00:23.1503629Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1503829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1504121Z pt-xla-profiler: TransferFromDeviceTime too frequent: 566 counts during 540 steps 2025-03-14T06:00:23.1504131Z 2025-03-14T06:00:23.1504331Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1504486Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1504770Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1504917Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1505118Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1505272Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1505413Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1505590Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1505940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1506300Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1506610Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1506892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1507194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1507473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1507762Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1507900Z Execution Analysis: (:1) 2025-03-14T06:00:23.1508153Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1508366Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1508370Z 2025-03-14T06:00:23.1508597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1508728Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1508956Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1509080Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1509283Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1509437Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1509583Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1509765Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1510342Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1510918Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1511467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1511996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1512313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1512606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1512918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1513205Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1513315Z Execution Analysis: .......... 2025-03-14T06:00:23.1513588Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1513792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1514098Z pt-xla-profiler: TransferFromDeviceTime too frequent: 567 counts during 541 steps 2025-03-14T06:00:23.1514134Z 2025-03-14T06:00:23.1514344Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1514471Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1514794Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1514926Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1515135Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1515295Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1515440Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1515625Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1515988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1516359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1516676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1516968Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1517285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1517569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1517880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1518008Z Execution Analysis: (:1) 2025-03-14T06:00:23.1518282Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1518488Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1518494Z 2025-03-14T06:00:23.1518736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1518857Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1519105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1519221Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1519445Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1519593Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1519756Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1519930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1520536Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1521117Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1521595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1521953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1522288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1522570Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1522898Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1523175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1523298Z Execution Analysis: .......... 2025-03-14T06:00:23.1523560Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1523783Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1524097Z pt-xla-profiler: TransferFromDeviceTime too frequent: 568 counts during 542 steps 2025-03-14T06:00:23.1524102Z 2025-03-14T06:00:23.1524323Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1524529Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1524857Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1524973Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1525195Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1525344Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1525504Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1525676Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1526056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1526415Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1526748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1527027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1527353Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1527626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1527934Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1528060Z Execution Analysis: (:1) 2025-03-14T06:00:23.1528334Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1528568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1528574Z 2025-03-14T06:00:23.1528790Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1528907Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1529153Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1529268Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1529486Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1529631Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1529791Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1529961Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1530564Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1531163Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1531540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1531896Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1532224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1532500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1532824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1533098Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1533218Z Execution Analysis: .......... 2025-03-14T06:00:23.1533480Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1533704Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1534017Z pt-xla-profiler: TransferFromDeviceTime too frequent: 570 counts during 543 steps 2025-03-14T06:00:23.1534034Z 2025-03-14T06:00:23.1534265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1534395Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1534687Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1534815Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1535023Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1535181Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1535325Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1535497Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1535872Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1536239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1536557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1536939Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1537226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1537491Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1537768Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1537899Z Execution Analysis: (:1) 2025-03-14T06:00:23.1538169Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1538374Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1538380Z 2025-03-14T06:00:23.1538568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1538690Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1538907Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1539027Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1539219Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1539369Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1539507Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1539678Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1540226Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1540801Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1541140Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1541477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1541768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1542036Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1542322Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1542585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1542689Z Execution Analysis: .......... 2025-03-14T06:00:23.1542944Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1543157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1543456Z pt-xla-profiler: TransferFromDeviceTime too frequent: 571 counts during 544 steps 2025-03-14T06:00:23.1543461Z 2025-03-14T06:00:23.1543651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1543773Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1544045Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1544163Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1544353Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1544500Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1544638Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1544809Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1545146Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1545485Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1545781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1546049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1546338Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1546602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1546875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1547008Z Execution Analysis: (:1) 2025-03-14T06:00:23.1547270Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1547475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1547479Z 2025-03-14T06:00:23.1547669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1547788Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1548008Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1548127Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1548318Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1548464Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1548602Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1548770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1549348Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1549891Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1550230Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1550571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1550864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1551134Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1551434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1551691Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1551802Z Execution Analysis: .......... 2025-03-14T06:00:23.1552069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1552271Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1552562Z pt-xla-profiler: TransferFromDeviceTime too frequent: 572 counts during 545 steps 2025-03-14T06:00:23.1552567Z 2025-03-14T06:00:23.1552775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1552884Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1553170Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1553278Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1553486Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1553626Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1553773Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1553936Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1554286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1554616Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1554922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1555180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1555483Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1555737Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1556024Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1556172Z Execution Analysis: (:1) 2025-03-14T06:00:23.1556427Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1556619Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1556625Z 2025-03-14T06:00:23.1556826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1556935Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1557163Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1557268Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1557472Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1557608Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1557760Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1557952Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1558512Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1559046Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1559397Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1559729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1560035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1560293Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1560597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1560854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1561007Z Execution Analysis: .......... 2025-03-14T06:00:23.1561253Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1561484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1561754Z pt-xla-profiler: TransferFromDeviceTime too frequent: 573 counts during 546 steps 2025-03-14T06:00:23.1561759Z 2025-03-14T06:00:23.1561963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1562074Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1562364Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1562470Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1562682Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1562821Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1562973Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1563134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1563487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1563817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1564129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1564389Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1564757Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1565186Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1565707Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1565843Z Execution Analysis: (:1) 2025-03-14T06:00:23.1566121Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1566330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1566335Z 2025-03-14T06:00:23.1566556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1566675Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1566921Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1567038Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1567261Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1567407Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1567619Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1567790Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1568401Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1568980Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1569361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1569730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1570046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1570334Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1570651Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1570977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1571087Z Execution Analysis: .......... 2025-03-14T06:00:23.1571393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1571599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1571898Z pt-xla-profiler: TransferFromDeviceTime too frequent: 574 counts during 547 steps 2025-03-14T06:00:23.1571903Z 2025-03-14T06:00:23.1572109Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1572236Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1572531Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1572664Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1572871Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1573032Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1573178Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1573365Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1573726Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1574094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1574410Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1574698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1575010Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1575324Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1575623Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1575765Z Execution Analysis: (:1) 2025-03-14T06:00:23.1576028Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1576246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1576250Z 2025-03-14T06:00:23.1576454Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1576585Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1576819Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1576943Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1577287Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1577580Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1577722Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1577893Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1578445Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1578988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1579323Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1579665Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1579958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1580232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1580547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1580812Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1580937Z Execution Analysis: .......... 2025-03-14T06:00:23.1581195Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1581389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1581669Z pt-xla-profiler: TransferFromDeviceTime too frequent: 575 counts during 548 steps 2025-03-14T06:00:23.1581673Z 2025-03-14T06:00:23.1581864Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1581987Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1582264Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1582388Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1582581Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1582731Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1582868Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1583039Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1583372Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1583711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1584006Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1584274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1584590Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1584857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1585130Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1585262Z Execution Analysis: (:1) 2025-03-14T06:00:23.1585502Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1585703Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1585707Z 2025-03-14T06:00:23.1585909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1586020Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1586248Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1586378Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1586584Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1586722Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1586860Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1587030Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1587595Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1588129Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1588476Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1588807Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1589113Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1589394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1589693Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1589977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1590095Z Execution Analysis: .......... 2025-03-14T06:00:23.1590334Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1590539Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1590803Z pt-xla-profiler: TransferFromDeviceTime too frequent: 576 counts during 549 steps 2025-03-14T06:00:23.1590807Z 2025-03-14T06:00:23.1591011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1591124Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1591406Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1591513Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1591718Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1591857Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1592008Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1592167Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1592514Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1592844Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1593149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1593433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1593733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1593988Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1594274Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1594393Z Execution Analysis: (:1) 2025-03-14T06:00:23.1594648Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1594839Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1594843Z 2025-03-14T06:00:23.1595044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1595153Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1595424Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1595533Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1595907Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1596052Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1596213Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1596385Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1596980Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1597541Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1597907Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1598258Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1598577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1598874Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1599212Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1599481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1599604Z Execution Analysis: .......... 2025-03-14T06:00:23.1599860Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1600071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1600353Z pt-xla-profiler: TransferFromDeviceTime too frequent: 577 counts during 550 steps 2025-03-14T06:00:23.1600373Z 2025-03-14T06:00:23.1600575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1600692Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1600992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1601103Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1601320Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1601464Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1601619Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1601786Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1602156Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1602504Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1602826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1603122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1603447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1603731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1604019Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1604158Z Execution Analysis: (:1) 2025-03-14T06:00:23.1604415Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1604706Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1604711Z 2025-03-14T06:00:23.1605076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1605246Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1605482Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1605615Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1605823Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1605986Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1606140Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1606328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1606923Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1607516Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1607882Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1608259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1608605Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1608923Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1609238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1609526Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1609638Z Execution Analysis: .......... 2025-03-14T06:00:23.1609914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1610121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1610426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 578 counts during 551 steps 2025-03-14T06:00:23.1610433Z 2025-03-14T06:00:23.1610641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1610778Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1611087Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1611272Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1611494Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1611659Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1611807Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1611992Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1612355Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1612726Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1613073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1613365Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1613676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1613963Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1614257Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1614395Z Execution Analysis: (:1) 2025-03-14T06:00:23.1614656Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1614872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1614876Z 2025-03-14T06:00:23.1615114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1615241Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1615477Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1615601Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1615811Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1615970Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1616119Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1616306Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1616903Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1617488Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1617854Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1618250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1618568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1618885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1619200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1619488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1619599Z Execution Analysis: .......... 2025-03-14T06:00:23.1619874Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1620080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1620386Z pt-xla-profiler: TransferFromDeviceTime too frequent: 579 counts during 552 steps 2025-03-14T06:00:23.1620393Z 2025-03-14T06:00:23.1620611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1620728Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1621038Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1621151Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1621372Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1621519Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1621678Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1621849Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1622223Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1622605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1622938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1623215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1623540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1623813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1624123Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1624252Z Execution Analysis: (:1) 2025-03-14T06:00:23.1624526Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1624732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1624763Z 2025-03-14T06:00:23.1624984Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1625104Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1625352Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1625470Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1625690Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1625843Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1626004Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1626172Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1626777Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1627356Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1627759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1628216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1628562Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1628835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1629152Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1629416Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1629535Z Execution Analysis: .......... 2025-03-14T06:00:23.1629789Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1630003Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1630286Z pt-xla-profiler: TransferFromDeviceTime too frequent: 580 counts during 553 steps 2025-03-14T06:00:23.1630290Z 2025-03-14T06:00:23.1630503Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1630618Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1630917Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1631027Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1631241Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1631491Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1631639Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1631797Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1632183Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1632513Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1632820Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1633084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1633384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1633635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1633923Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1634042Z Execution Analysis: (:1) 2025-03-14T06:00:23.1634298Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1634517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1634523Z 2025-03-14T06:00:23.1634724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1634833Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1635063Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1635168Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1635375Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1635512Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1635666Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1635825Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1636389Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1636923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1637302Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1637651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1637956Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1638226Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1638514Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1638782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1638884Z Execution Analysis: .......... 2025-03-14T06:00:23.1639142Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1639334Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1639616Z pt-xla-profiler: TransferFromDeviceTime too frequent: 581 counts during 554 steps 2025-03-14T06:00:23.1639620Z 2025-03-14T06:00:23.1639813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1639936Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1640207Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1640327Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1640688Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1640846Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1640988Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1641168Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1641548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1641910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1642221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1642506Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1642809Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1643087Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1643380Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1643516Z Execution Analysis: (:1) 2025-03-14T06:00:23.1643802Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1644014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1644020Z 2025-03-14T06:00:23.1644217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1644345Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1644660Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1644796Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1645170Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1645332Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1645484Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1645672Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1646270Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1646898Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1647289Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1647667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1647989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1648284Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1648598Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1648887Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1649004Z Execution Analysis: .......... 2025-03-14T06:00:23.1649284Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1649493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1649799Z pt-xla-profiler: TransferFromDeviceTime too frequent: 582 counts during 555 steps 2025-03-14T06:00:23.1649805Z 2025-03-14T06:00:23.1650013Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1650150Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1650444Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1650577Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1650786Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1650950Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1651124Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1651314Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1651680Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1652054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1652372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1652671Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1652984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1653274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1653573Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1653746Z Execution Analysis: (:1) 2025-03-14T06:00:23.1654014Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1654239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1654243Z 2025-03-14T06:00:23.1654466Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1654587Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1654824Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1654956Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1655167Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1655329Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1655482Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1655668Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1656264Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1656877Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1657384Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1657733Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1658055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1658326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1658640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1658909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1659027Z Execution Analysis: .......... 2025-03-14T06:00:23.1659281Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1659494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1659773Z pt-xla-profiler: TransferFromDeviceTime too frequent: 583 counts during 556 steps 2025-03-14T06:00:23.1659778Z 2025-03-14T06:00:23.1659989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1660103Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1660399Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1660510Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1660723Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1660893Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1661046Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1661215Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1661581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1661928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1662248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1662519Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1662839Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1663105Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1663435Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1663667Z Execution Analysis: (:1) 2025-03-14T06:00:23.1663927Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1664121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1664125Z 2025-03-14T06:00:23.1664327Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1664436Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1664666Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1664772Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1664976Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1665111Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1665265Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1665578Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1666418Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1667044Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1667421Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1667777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1668108Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1668389Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1668720Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1668996Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1669127Z Execution Analysis: .......... 2025-03-14T06:00:23.1669391Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1669616Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1669905Z pt-xla-profiler: TransferFromDeviceTime too frequent: 584 counts during 557 steps 2025-03-14T06:00:23.1669910Z 2025-03-14T06:00:23.1670129Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1670246Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1670553Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1670670Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1671004Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1671160Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1671321Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1671493Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1671871Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1672230Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1672563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1672842Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1673169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1673441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1673788Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1673917Z Execution Analysis: (:1) 2025-03-14T06:00:23.1674189Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1674409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1674414Z 2025-03-14T06:00:23.1674617Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1674747Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1674981Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1675110Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1675316Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1675477Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1675628Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1675837Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1676431Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1677040Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1677403Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1677879Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1678288Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1678560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1678852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1679118Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1679219Z Execution Analysis: .......... 2025-03-14T06:00:23.1679474Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1679666Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1679948Z pt-xla-profiler: TransferFromDeviceTime too frequent: 585 counts during 558 steps 2025-03-14T06:00:23.1679952Z 2025-03-14T06:00:23.1680142Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1680262Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1680535Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1680677Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1680871Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1681020Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1681155Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1681329Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1681666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1682010Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1682300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1682568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1682857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1683149Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1683425Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1683556Z Execution Analysis: (:1) 2025-03-14T06:00:23.1683799Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1684008Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1684012Z 2025-03-14T06:00:23.1684204Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1684330Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1684610Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1684733Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1685095Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1685260Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1685440Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1685624Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1686243Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1686830Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1691888Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1692301Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1692625Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1692919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1693234Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1693515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1693623Z Execution Analysis: .......... 2025-03-14T06:00:23.1693894Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1694096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1694393Z pt-xla-profiler: TransferFromDeviceTime too frequent: 586 counts during 559 steps 2025-03-14T06:00:23.1694401Z 2025-03-14T06:00:23.1694601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1694728Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1695082Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1695206Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1695411Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1695566Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1695709Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1695887Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1696247Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1696611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1696922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1697310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1697647Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1697922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1698202Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1698334Z Execution Analysis: (:1) 2025-03-14T06:00:23.1698585Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1698788Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1698793Z 2025-03-14T06:00:23.1698997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1699108Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1699345Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1699456Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1699654Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1699832Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1699974Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1700148Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1700756Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1701332Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1701686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1702027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1702342Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1702610Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1702914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1703175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1703288Z Execution Analysis: .......... 2025-03-14T06:00:23.1703537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1703741Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1704017Z pt-xla-profiler: TransferFromDeviceTime too frequent: 587 counts during 560 steps 2025-03-14T06:00:23.1704022Z 2025-03-14T06:00:23.1704223Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1704361Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1704654Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1704758Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1704965Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1705103Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1705250Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1705408Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1705764Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1706103Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1706414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1706707Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1707016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1707377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1707656Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1707769Z Execution Analysis: (:1) 2025-03-14T06:00:23.1708014Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1708201Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1708205Z 2025-03-14T06:00:23.1708399Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1708503Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1708728Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1708830Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1709071Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1709202Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1709374Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1709531Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1710085Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1710609Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1710949Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1711274Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1711574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1711824Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1712112Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1712357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1712462Z Execution Analysis: .......... 2025-03-14T06:00:23.1712695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1712889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1713150Z pt-xla-profiler: TransferFromDeviceTime too frequent: 588 counts during 561 steps 2025-03-14T06:00:23.1713157Z 2025-03-14T06:00:23.1713376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1713482Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1713757Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1713856Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1714053Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1714182Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1714319Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1714472Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1714810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1715134Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1715455Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1715704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1715996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1716245Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1716520Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1716640Z Execution Analysis: (:1) 2025-03-14T06:00:23.1716878Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1717071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1717075Z 2025-03-14T06:00:23.1717428Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1717550Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1717771Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1717912Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1718110Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1718284Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1718425Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1718598Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1719169Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1719728Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1720079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1720431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1720738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1721008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1721304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1721581Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1721683Z Execution Analysis: .......... 2025-03-14T06:00:23.1721942Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1722140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1722451Z pt-xla-profiler: TransferFromDeviceTime too frequent: 589 counts during 562 steps 2025-03-14T06:00:23.1722457Z 2025-03-14T06:00:23.1722655Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1722779Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1723061Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1723178Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1723374Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1723521Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1723656Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1723828Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1724174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1724631Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1725135Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1725421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1725730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1726005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1726295Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1726429Z Execution Analysis: (:1) 2025-03-14T06:00:23.1726686Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1726893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1726899Z 2025-03-14T06:00:23.1727101Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1727254Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1727483Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1727599Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1727822Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1727972Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1728114Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1728286Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1728875Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1729447Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1729805Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1730164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1730473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1730750Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1731051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1731321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1731423Z Execution Analysis: .......... 2025-03-14T06:00:23.1731695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1731900Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1732231Z pt-xla-profiler: TransferFromDeviceTime too frequent: 591 counts during 563 steps 2025-03-14T06:00:23.1732238Z 2025-03-14T06:00:23.1732457Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1732576Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1732882Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1732996Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1733218Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1733365Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1733522Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1733695Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1734069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1734452Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1734784Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1735064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1735393Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1735667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1735976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1736105Z Execution Analysis: (:1) 2025-03-14T06:00:23.1736383Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1736593Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1736601Z 2025-03-14T06:00:23.1736820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1736964Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1737315Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1737446Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1737653Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1737794Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1737948Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1738111Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1738675Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1739215Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1739569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1739900Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1740209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1740468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1740771Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1741026Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1741145Z Execution Analysis: .......... 2025-03-14T06:00:23.1741389Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1741622Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1741896Z pt-xla-profiler: TransferFromDeviceTime too frequent: 592 counts during 564 steps 2025-03-14T06:00:23.1741900Z 2025-03-14T06:00:23.1742106Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1742218Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1742509Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1742618Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1742826Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1742966Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1743118Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1743279Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1743666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1743995Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1744299Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1744557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1744860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1745111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1745394Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1745514Z Execution Analysis: (:1) 2025-03-14T06:00:23.1745767Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1745962Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1745992Z 2025-03-14T06:00:23.1746194Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1746303Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1746555Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1746661Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1746864Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1746999Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1747147Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1747304Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1747862Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1748397Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1748746Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1749074Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1749379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1749650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1749938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1750205Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1750310Z Execution Analysis: .......... 2025-03-14T06:00:23.1750594Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1750789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1751070Z pt-xla-profiler: TransferFromDeviceTime too frequent: 593 counts during 565 steps 2025-03-14T06:00:23.1751074Z 2025-03-14T06:00:23.1751267Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1751395Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1751667Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1751787Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1751978Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1752125Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1752259Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1752459Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1752795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1753135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1753428Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1753698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1753986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1754248Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1754520Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1754650Z Execution Analysis: (:1) 2025-03-14T06:00:23.1754895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1755127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1755131Z 2025-03-14T06:00:23.1755322Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1755470Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1755690Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1755809Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1756002Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1756153Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1756293Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1756465Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1757015Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1757567Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1757903Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1758245Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1758537Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1758807Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1759093Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1759362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1759489Z Execution Analysis: .......... 2025-03-14T06:00:23.1759746Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1759938Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1760219Z pt-xla-profiler: TransferFromDeviceTime too frequent: 594 counts during 566 steps 2025-03-14T06:00:23.1760223Z 2025-03-14T06:00:23.1760413Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1760535Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1760807Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1760927Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1761120Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1761268Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1761430Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1761601Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1761937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1762279Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1762571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1762841Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1763128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1763392Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1763665Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1763803Z Execution Analysis: (:1) 2025-03-14T06:00:23.1764045Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1764275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1764279Z 2025-03-14T06:00:23.1764573Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1764702Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1765086Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1765215Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1765568Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1765729Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1765877Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1766066Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1766662Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1767257Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1767636Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1767991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1768319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1768596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1768921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1769261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1769388Z Execution Analysis: .......... 2025-03-14T06:00:23.1769650Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1769871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1770159Z pt-xla-profiler: TransferFromDeviceTime too frequent: 595 counts during 567 steps 2025-03-14T06:00:23.1770164Z 2025-03-14T06:00:23.1770382Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1770501Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1770809Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1770923Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1771144Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1771334Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1771499Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1771670Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1772045Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1772404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1772733Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1773010Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1773333Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1773604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1773915Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1774081Z Execution Analysis: (:1) 2025-03-14T06:00:23.1774356Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1774603Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1774608Z 2025-03-14T06:00:23.1774827Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1774946Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1775192Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1775307Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1775530Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1775678Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1775847Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1776018Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1776619Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1777199Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1777676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1778005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1778308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1778566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1778902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1779158Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1779269Z Execution Analysis: .......... 2025-03-14T06:00:23.1779513Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1779710Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1779977Z pt-xla-profiler: TransferFromDeviceTime too frequent: 596 counts during 568 steps 2025-03-14T06:00:23.1779981Z 2025-03-14T06:00:23.1780182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1780292Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1780576Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1780706Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1780911Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1781052Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1781199Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1781357Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1781703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1782032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1782335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1782588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1782887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1783137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1783419Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1783560Z Execution Analysis: (:1) 2025-03-14T06:00:23.1783808Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1784022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1784035Z 2025-03-14T06:00:23.1784227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1784345Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1784562Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1784675Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1784867Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1785011Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1785148Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1785305Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1785860Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1786398Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1786730Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1787063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1787353Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1787639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1787924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1788183Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1788282Z Execution Analysis: .......... 2025-03-14T06:00:23.1788529Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1788717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1788992Z pt-xla-profiler: TransferFromDeviceTime too frequent: 597 counts during 569 steps 2025-03-14T06:00:23.1788997Z 2025-03-14T06:00:23.1789186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1789300Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1789568Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1789707Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1789899Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1790042Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1790175Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1790342Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1790675Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1791008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1791298Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1791562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1791848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1792108Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1792409Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1792539Z Execution Analysis: (:1) 2025-03-14T06:00:23.1792804Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1793004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1793008Z 2025-03-14T06:00:23.1793194Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1793313Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1793527Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1793638Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1793834Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1793973Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1794111Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1794277Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1794825Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1795364Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1795700Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1796219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1796530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1796834Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1797141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1797421Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1797526Z Execution Analysis: .......... 2025-03-14T06:00:23.1797789Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1797987Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1798276Z pt-xla-profiler: TransferFromDeviceTime too frequent: 598 counts during 570 steps 2025-03-14T06:00:23.1798281Z 2025-03-14T06:00:23.1798492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1798632Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1798917Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1799040Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1799237Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1799389Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1799528Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1799701Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1800049Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1800404Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1800707Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1800985Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1801295Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1801585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1801878Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1802024Z Execution Analysis: (:1) 2025-03-14T06:00:23.1802287Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1802486Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1802490Z 2025-03-14T06:00:23.1802696Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1802809Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1803041Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1803154Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1803366Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1803509Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1803659Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1803831Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1804408Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1805245Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1805616Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1805970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1806325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1806604Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1806921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1807193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1807312Z Execution Analysis: .......... 2025-03-14T06:00:23.1807573Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1807785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1808071Z pt-xla-profiler: TransferFromDeviceTime too frequent: 599 counts during 571 steps 2025-03-14T06:00:23.1808076Z 2025-03-14T06:00:23.1808290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1808435Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1808735Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1808846Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1809058Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1809203Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1809364Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1809535Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1809904Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1810256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1810575Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1810856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1811203Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1811474Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1811813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1811939Z Execution Analysis: (:1) 2025-03-14T06:00:23.1812213Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1812417Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1812422Z 2025-03-14T06:00:23.1812637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1812755Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1813000Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1813112Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1813328Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1813475Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1813634Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1813802Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1814402Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1814974Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1815342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1815720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1816045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1816318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1816639Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1816905Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1817022Z Execution Analysis: .......... 2025-03-14T06:00:23.1817375Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1817572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1817845Z pt-xla-profiler: TransferFromDeviceTime too frequent: 600 counts during 572 steps 2025-03-14T06:00:23.1817874Z 2025-03-14T06:00:23.1818068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1818182Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1818453Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1818568Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1818756Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1818897Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1819029Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1819193Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1819529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1819864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1820158Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1820444Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1820733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1821094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1821370Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1821496Z Execution Analysis: (:1) 2025-03-14T06:00:23.1821737Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1821934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1821937Z 2025-03-14T06:00:23.1822124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1822246Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1822464Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1822580Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1822771Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1822915Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1823053Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1823218Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1823767Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1824309Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1824670Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1825003Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1825297Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1825562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1825850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1826114Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1826216Z Execution Analysis: .......... 2025-03-14T06:00:23.1826463Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1826653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1826953Z pt-xla-profiler: TransferFromDeviceTime too frequent: 601 counts during 573 steps 2025-03-14T06:00:23.1826959Z 2025-03-14T06:00:23.1827151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1827266Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1827536Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1827650Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1827843Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1827988Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1828123Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1828290Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1828625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1828964Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1829254Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1829539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1829848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1830106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1830378Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1830503Z Execution Analysis: (:1) 2025-03-14T06:00:23.1830744Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1830943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1830949Z 2025-03-14T06:00:23.1831136Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1831257Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1831470Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1831583Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1831774Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1831918Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1832054Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1832219Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1832762Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1833302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1833657Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1834001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1834296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1834551Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1834843Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1835093Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1835199Z Execution Analysis: .......... 2025-03-14T06:00:23.1835440Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1835663Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1835928Z pt-xla-profiler: TransferFromDeviceTime too frequent: 602 counts during 574 steps 2025-03-14T06:00:23.1835934Z 2025-03-14T06:00:23.1836127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1836236Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1836516Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1836621Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1836817Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1836954Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1837095Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1837250Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1837585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1837914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1838459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1838740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1839036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1839284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1839566Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1839685Z Execution Analysis: (:1) 2025-03-14T06:00:23.1839934Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1840126Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1840132Z 2025-03-14T06:00:23.1840334Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1840444Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1840666Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1840772Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1840971Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1841105Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1841252Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1841411Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1841966Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1842522Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1842873Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1843203Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1843501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1843755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1844051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1844302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1844411Z Execution Analysis: .......... 2025-03-14T06:00:23.1844732Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1845139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1845431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 603 counts during 575 steps 2025-03-14T06:00:23.1845436Z 2025-03-14T06:00:23.1845650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1845766Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1846070Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1846184Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1846401Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1846547Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1846702Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1846875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1847250Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1847643Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1847968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1848267Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1848585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1848855Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1849160Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1849285Z Execution Analysis: (:1) 2025-03-14T06:00:23.1849554Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1849756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1849772Z 2025-03-14T06:00:23.1849974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1850098Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1850331Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1850441Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1850656Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1850799Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1850955Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1851124Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1851727Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1852332Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1852695Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1853063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1853374Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1853656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1853969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1854246Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1854377Z Execution Analysis: .......... 2025-03-14T06:00:23.1854644Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1854851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1855147Z pt-xla-profiler: TransferFromDeviceTime too frequent: 604 counts during 576 steps 2025-03-14T06:00:23.1855154Z 2025-03-14T06:00:23.1855356Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1855478Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1855770Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1855888Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1856093Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1856244Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1856389Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1856567Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1856954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1857419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1857732Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1857995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1858281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1858539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1858810Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1858933Z Execution Analysis: (:1) 2025-03-14T06:00:23.1859175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1859375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1859379Z 2025-03-14T06:00:23.1859568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1859680Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1859896Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1860019Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1860212Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1860356Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1860496Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1860669Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1861240Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1861790Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1862128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1862470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1862764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1863032Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1863318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1863580Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1863710Z Execution Analysis: .......... 2025-03-14T06:00:23.1863966Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1864157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1864439Z pt-xla-profiler: TransferFromDeviceTime too frequent: 605 counts during 577 steps 2025-03-14T06:00:23.1864443Z 2025-03-14T06:00:23.1864636Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1864757Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1865031Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1865149Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1865471Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1865789Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1866101Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1866345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1866708Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1867111Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1867429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1867720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1868032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1868316Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1868612Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1868757Z Execution Analysis: (:1) 2025-03-14T06:00:23.1869021Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1869236Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1869240Z 2025-03-14T06:00:23.1869458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1869575Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1869816Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1869927Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1870147Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1870291Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1870451Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1870620Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1871256Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1871837Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1872206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1872558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1872883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1873159Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1873475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1873786Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1873906Z Execution Analysis: .......... 2025-03-14T06:00:23.1874165Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1874379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1874665Z pt-xla-profiler: TransferFromDeviceTime too frequent: 606 counts during 578 steps 2025-03-14T06:00:23.1874671Z 2025-03-14T06:00:23.1874884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1875003Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1875303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1875415Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1875634Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1875782Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1875963Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1876133Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1876526Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1876881Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1877208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1877592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1877904Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1878270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1878559Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1878679Z Execution Analysis: (:1) 2025-03-14T06:00:23.1878929Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1879118Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1879122Z 2025-03-14T06:00:23.1879320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1879428Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1879653Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1879756Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1879957Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1880091Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1880264Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1880424Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1880980Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1881514Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1881859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1882189Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1882492Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1882751Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1883083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1883338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1883447Z Execution Analysis: .......... 2025-03-14T06:00:23.1883690Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1883890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1884156Z pt-xla-profiler: TransferFromDeviceTime too frequent: 607 counts during 579 steps 2025-03-14T06:00:23.1884171Z 2025-03-14T06:00:23.1884359Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1884547Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1884831Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1885121Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1885329Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1885518Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1885661Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1885836Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1886234Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1886601Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1886913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1887202Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1887512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1887798Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1888092Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1888231Z Execution Analysis: (:1) 2025-03-14T06:00:23.1888492Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1888708Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1888712Z 2025-03-14T06:00:23.1888915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1889042Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1889274Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1889397Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1889603Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1889787Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1889936Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1890117Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1890710Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1891296Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1891657Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1892020Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1892335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1892652Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1892962Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1893245Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1893354Z Execution Analysis: .......... 2025-03-14T06:00:23.1893626Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1893831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1894127Z pt-xla-profiler: TransferFromDeviceTime too frequent: 608 counts during 580 steps 2025-03-14T06:00:23.1894132Z 2025-03-14T06:00:23.1894336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1894464Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1894760Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1894884Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1895114Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1895270Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1895413Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1895617Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1895979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1896342Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1896661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1896948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1897367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1897643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1897933Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1898069Z Execution Analysis: (:1) 2025-03-14T06:00:23.1898324Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1898534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1898538Z 2025-03-14T06:00:23.1898736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1898861Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1899089Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1899207Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1899435Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1899592Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1899737Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1899910Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1900487Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1901055Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1901407Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1901762Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1902101Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1902377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1902688Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1902953Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1903072Z Execution Analysis: .......... 2025-03-14T06:00:23.1903325Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1903532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1903813Z pt-xla-profiler: TransferFromDeviceTime too frequent: 609 counts during 581 steps 2025-03-14T06:00:23.1903818Z 2025-03-14T06:00:23.1904026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1904144Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1904444Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1904579Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1904791Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1904963Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1905115Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1905282Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1905643Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1905990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1906308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1906579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1906898Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1907270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1907556Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1907676Z Execution Analysis: (:1) 2025-03-14T06:00:23.1907930Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1908120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1908124Z 2025-03-14T06:00:23.1908330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1908440Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1908670Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1908820Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1909025Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1909163Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1909317Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1909477Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1910037Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1910570Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1910912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1911242Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1911574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1911833Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1912136Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1912391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1912507Z Execution Analysis: .......... 2025-03-14T06:00:23.1912745Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1912945Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1913210Z pt-xla-profiler: TransferFromDeviceTime too frequent: 610 counts during 582 steps 2025-03-14T06:00:23.1913216Z 2025-03-14T06:00:23.1913422Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1913532Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1913841Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1913947Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1914174Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1914310Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1914457Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1914614Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1914957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1915283Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1915584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1915843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1916139Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1916389Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1916670Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1916789Z Execution Analysis: (:1) 2025-03-14T06:00:23.1917035Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1917226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1917230Z 2025-03-14T06:00:23.1917426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1917536Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1917800Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1917909Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1918107Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1918240Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1918385Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1918543Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1919101Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1919632Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1919976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1920341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1920633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1920898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1921185Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1921450Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1921548Z Execution Analysis: .......... 2025-03-14T06:00:23.1921800Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1921989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1922263Z pt-xla-profiler: TransferFromDeviceTime too frequent: 612 counts during 583 steps 2025-03-14T06:00:23.1922270Z 2025-03-14T06:00:23.1922459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1922600Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1922870Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1923013Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1923203Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1923349Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1923484Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1923650Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1923982Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1924319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1924699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1925138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1925450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1925738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1926032Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1926172Z Execution Analysis: (:1) 2025-03-14T06:00:23.1926436Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1926654Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1926658Z 2025-03-14T06:00:23.1926862Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1927023Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1927260Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1927382Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1927587Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1927746Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1927895Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1928074Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1928667Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1929252Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1929646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1930013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1930330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1930617Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1930928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1931208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1931315Z Execution Analysis: .......... 2025-03-14T06:00:23.1931586Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1931789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1932091Z pt-xla-profiler: TransferFromDeviceTime too frequent: 613 counts during 584 steps 2025-03-14T06:00:23.1932123Z 2025-03-14T06:00:23.1932329Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1932455Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1932773Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1932896Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1933103Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1933260Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1933404Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1933587Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1933949Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1934316Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1934633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1934921Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1935235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1935516Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1935810Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1935946Z Execution Analysis: (:1) 2025-03-14T06:00:23.1936206Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1936419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1936426Z 2025-03-14T06:00:23.1936663Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1936782Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1937026Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1937245Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1937446Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1937578Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1937715Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1937879Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1938439Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1938968Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1939338Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1939668Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1939969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1940224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1940519Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1940769Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1940882Z Execution Analysis: .......... 2025-03-14T06:00:23.1941120Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1941319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1941615Z pt-xla-profiler: TransferFromDeviceTime too frequent: 614 counts during 585 steps 2025-03-14T06:00:23.1941619Z 2025-03-14T06:00:23.1941825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1941956Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1942241Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1942345Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1942545Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1942683Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1942826Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1942981Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1943324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1943655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1943957Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1944215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1944509Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1944760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1945041Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1945158Z Execution Analysis: (:1) 2025-03-14T06:00:23.1945404Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1945628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1945632Z 2025-03-14T06:00:23.1945838Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1945950Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1946183Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1946293Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1946499Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1946636Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1946790Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1946951Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1947513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1948074Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1948427Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1948759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1949067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1949324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1949627Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1949881Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1950000Z Execution Analysis: .......... 2025-03-14T06:00:23.1950244Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1950450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1950739Z pt-xla-profiler: TransferFromDeviceTime too frequent: 615 counts during 586 steps 2025-03-14T06:00:23.1950759Z 2025-03-14T06:00:23.1950985Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1951096Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1951380Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1951490Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1951694Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1951832Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1951983Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1952142Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1952496Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1952827Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1953136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1953394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1953696Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1953965Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1954239Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1954373Z Execution Analysis: (:1) 2025-03-14T06:00:23.1954616Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1954848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1954854Z 2025-03-14T06:00:23.1955046Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1955173Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1955394Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1955515Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1955706Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1955853Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1955988Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1956163Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1956711Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1957277Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1957612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1957954Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1958244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1958512Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1958797Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1959060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1959163Z Execution Analysis: .......... 2025-03-14T06:00:23.1959414Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1959630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1959931Z pt-xla-profiler: TransferFromDeviceTime too frequent: 616 counts during 587 steps 2025-03-14T06:00:23.1959935Z 2025-03-14T06:00:23.1960123Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1960242Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1960512Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1960628Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1960823Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1960970Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1961105Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1961278Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1961615Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1961956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1962251Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1962519Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1962806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1963071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1963342Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1963474Z Execution Analysis: (:1) 2025-03-14T06:00:23.1963737Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1963943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1963947Z 2025-03-14T06:00:23.1964137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1964259Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1964534Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1964664Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1964854Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1965173Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1965438Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1965628Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1966288Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1966882Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1967248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1967618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1967934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1968227Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1968538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1968829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1968939Z Execution Analysis: .......... 2025-03-14T06:00:23.1969331Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1969539Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1969878Z pt-xla-profiler: TransferFromDeviceTime too frequent: 617 counts during 588 steps 2025-03-14T06:00:23.1969884Z 2025-03-14T06:00:23.1970105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1970223Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1970530Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1970644Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1970869Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1971019Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1971183Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1971356Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1971729Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1972086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1972416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1972691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1973014Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1973284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1973591Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1973757Z Execution Analysis: (:1) 2025-03-14T06:00:23.1974032Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1974235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1974242Z 2025-03-14T06:00:23.1974455Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1974575Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1974821Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1974934Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1975152Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1975297Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1975458Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1975657Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1976262Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1976838Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1977353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1977793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1978097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1978352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1978651Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1978908Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1979048Z Execution Analysis: .......... 2025-03-14T06:00:23.1979288Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1979517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1979785Z pt-xla-profiler: TransferFromDeviceTime too frequent: 618 counts during 589 steps 2025-03-14T06:00:23.1979790Z 2025-03-14T06:00:23.1979990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1980098Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1980381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1980486Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1980693Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1980831Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1980979Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1981139Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1981489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1981819Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1982124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1982377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1982677Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1982929Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1983243Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1983364Z Execution Analysis: (:1) 2025-03-14T06:00:23.1983621Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1983812Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1983815Z 2025-03-14T06:00:23.1984019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1984128Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1984358Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1984463Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1984665Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1984799Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1984973Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1985131Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1985691Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1986227Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1986572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1986900Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1987207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1987474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1987765Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1988068Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1988169Z Execution Analysis: .......... 2025-03-14T06:00:23.1988445Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1988637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1988917Z pt-xla-profiler: TransferFromDeviceTime too frequent: 619 counts during 590 steps 2025-03-14T06:00:23.1988922Z 2025-03-14T06:00:23.1989112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1989234Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1989509Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1989634Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1989825Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1989977Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1990114Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1990290Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1990625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.1990970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1991264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1991534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1991820Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1992111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1992385Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.1992520Z Execution Analysis: (:1) 2025-03-14T06:00:23.1992764Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1992970Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1992974Z 2025-03-14T06:00:23.1993163Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1993289Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1993504Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.1993625Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1993817Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.1993994Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.1994136Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.1994309Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.1994860Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.1995408Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.1995911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.1996272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.1996583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.1996872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.1997199Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.1997477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.1997609Z Execution Analysis: .......... 2025-03-14T06:00:23.1997877Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.1998078Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1998375Z pt-xla-profiler: TransferFromDeviceTime too frequent: 620 counts during 591 steps 2025-03-14T06:00:23.1998379Z 2025-03-14T06:00:23.1998580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.1998709Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.1998997Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.1999122Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.1999322Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.1999483Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.1999626Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.1999804Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2000154Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2000512Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2000816Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2001096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2001429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2001704Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2001994Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2002128Z Execution Analysis: (:1) 2025-03-14T06:00:23.2002382Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2002591Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2002595Z 2025-03-14T06:00:23.2002793Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2002920Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2003148Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2003295Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2003499Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2003656Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2003802Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2003982Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2004647Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2005393Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2005768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2006119Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2006450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2006728Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2007080Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2007377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2007498Z Execution Analysis: .......... 2025-03-14T06:00:23.2007759Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2007977Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2008261Z pt-xla-profiler: TransferFromDeviceTime too frequent: 621 counts during 592 steps 2025-03-14T06:00:23.2008265Z 2025-03-14T06:00:23.2008481Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2008601Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2008903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2009017Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2009234Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2009383Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2009544Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2009715Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2010090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2010447Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2010776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2011079Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2011402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2011676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2011983Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2012109Z Execution Analysis: (:1) 2025-03-14T06:00:23.2012381Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2012584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2012588Z 2025-03-14T06:00:23.2012803Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2012918Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2013188Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2013303Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2013523Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2013669Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2013829Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2014002Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2014604Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2015181Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2015554Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2015909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2016239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2016544Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2016997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2017262Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2017383Z Execution Analysis: .......... 2025-03-14T06:00:23.2017638Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2017850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2018128Z pt-xla-profiler: TransferFromDeviceTime too frequent: 622 counts during 593 steps 2025-03-14T06:00:23.2018134Z 2025-03-14T06:00:23.2018347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2018464Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2018762Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2018871Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2019086Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2019228Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2019383Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2019548Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2019911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2020254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2020571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2020865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2021177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2021441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2021739Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2021863Z Execution Analysis: (:1) 2025-03-14T06:00:23.2022126Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2022340Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2022344Z 2025-03-14T06:00:23.2022542Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2022707Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2022934Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2023059Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2023260Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2023579Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2023729Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2023913Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2024503Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2025096Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2025455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2025824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2026162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2026450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2026786Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2027071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2027177Z Execution Analysis: .......... 2025-03-14T06:00:23.2027453Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2027660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2027962Z pt-xla-profiler: TransferFromDeviceTime too frequent: 623 counts during 594 steps 2025-03-14T06:00:23.2027971Z 2025-03-14T06:00:23.2028174Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2028305Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2028596Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2028721Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2028925Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2029082Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2029225Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2029407Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2029764Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2030132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2030473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2030762Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2031070Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2031361Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2031656Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2031797Z Execution Analysis: (:1) 2025-03-14T06:00:23.2032059Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2032383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2032388Z 2025-03-14T06:00:23.2032619Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2032748Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2032979Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2033107Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2033312Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2033469Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2033616Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2033798Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2034378Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2034954Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2035315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2035817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2036113Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2036411Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2036702Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2036972Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2037075Z Execution Analysis: .......... 2025-03-14T06:00:23.2037333Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2037525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2037814Z pt-xla-profiler: TransferFromDeviceTime too frequent: 624 counts during 595 steps 2025-03-14T06:00:23.2037820Z 2025-03-14T06:00:23.2038025Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2038137Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2038425Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2038533Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2038731Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2038885Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2039022Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2039198Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2039532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2039903Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2040214Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2040473Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2040778Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2041029Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2041318Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2041438Z Execution Analysis: (:1) 2025-03-14T06:00:23.2041697Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2041886Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2041913Z 2025-03-14T06:00:23.2042117Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2042227Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2042457Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2042563Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2042767Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2042902Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2043051Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2043209Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2043767Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2044299Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2044712Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2045251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2045618Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2045896Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2046219Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2046493Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2046612Z Execution Analysis: .......... 2025-03-14T06:00:23.2046875Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2047096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2047389Z pt-xla-profiler: TransferFromDeviceTime too frequent: 625 counts during 596 steps 2025-03-14T06:00:23.2047394Z 2025-03-14T06:00:23.2047612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2047732Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2048041Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2048158Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2048378Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2048526Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2048686Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2048858Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2049258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2049615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2049943Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2050222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2050544Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2050818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2051129Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2051257Z Execution Analysis: (:1) 2025-03-14T06:00:23.2051531Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2051765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2051771Z 2025-03-14T06:00:23.2051988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2052108Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2052357Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2052471Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2052691Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2052838Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2052999Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2053172Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2053780Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2054358Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2054760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2055141Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2055470Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2055749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2056073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2056360Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2056472Z Execution Analysis: .......... 2025-03-14T06:00:23.2056734Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2056951Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2057356Z pt-xla-profiler: TransferFromDeviceTime too frequent: 626 counts during 597 steps 2025-03-14T06:00:23.2057360Z 2025-03-14T06:00:23.2057552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2057674Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2057943Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2058062Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2058254Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2058404Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2058537Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2058711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2059080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2059422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2059719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2059990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2060278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2060542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2060814Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2060945Z Execution Analysis: (:1) 2025-03-14T06:00:23.2061213Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2061418Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2061423Z 2025-03-14T06:00:23.2061613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2061740Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2061958Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2062076Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2062268Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2062416Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2062555Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2062724Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2063274Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2063852Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2064211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2064552Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2064846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2065116Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2065518Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2065966Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2066078Z Execution Analysis: .......... 2025-03-14T06:00:23.2066355Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2066561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2066865Z pt-xla-profiler: TransferFromDeviceTime too frequent: 627 counts during 598 steps 2025-03-14T06:00:23.2066870Z 2025-03-14T06:00:23.2067076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2067210Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2067502Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2067629Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2067838Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2067998Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2068145Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2068389Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2068754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2069124Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2069440Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2069734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2070046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2070330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2070626Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2070805Z Execution Analysis: (:1) 2025-03-14T06:00:23.2071070Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2071290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2071295Z 2025-03-14T06:00:23.2071501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2071628Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2080245Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2080606Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2080826Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2080983Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2081127Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2081303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2081901Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2082575Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2082976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2083330Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2083634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2083914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2084213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2084575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2084684Z Execution Analysis: .......... 2025-03-14T06:00:23.2085116Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2085321Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2085616Z pt-xla-profiler: TransferFromDeviceTime too frequent: 628 counts during 599 steps 2025-03-14T06:00:23.2085623Z 2025-03-14T06:00:23.2085832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2085944Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2086241Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2086351Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2086560Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2086740Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2086893Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2087063Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2087429Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2087779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2088097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2088369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2088680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2088945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2089492Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2089616Z Execution Analysis: (:1) 2025-03-14T06:00:23.2089887Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2090087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2090094Z 2025-03-14T06:00:23.2090303Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2090414Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2090653Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2090763Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2090975Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2091118Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2091272Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2091440Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2092071Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2092669Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2093037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2093384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2093701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2093971Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2094287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2094552Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2094666Z Execution Analysis: .......... 2025-03-14T06:00:23.2094921Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2095127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2095409Z pt-xla-profiler: TransferFromDeviceTime too frequent: 629 counts during 600 steps 2025-03-14T06:00:23.2095415Z 2025-03-14T06:00:23.2095618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2095730Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2096026Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2096136Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2096375Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2096518Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2096666Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2096831Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2097300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2097638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2097947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2098210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2098513Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2098771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2099089Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2099211Z Execution Analysis: (:1) 2025-03-14T06:00:23.2099468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2099665Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2099669Z 2025-03-14T06:00:23.2099872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2099980Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2100211Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2100316Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2100522Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2100661Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2100809Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2100996Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2101575Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2102157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2102516Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2102855Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2103165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2103437Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2103738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2104010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2104114Z Execution Analysis: .......... 2025-03-14T06:00:23.2104372Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2104568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2104849Z pt-xla-profiler: TransferFromDeviceTime too frequent: 630 counts during 601 steps 2025-03-14T06:00:23.2104854Z 2025-03-14T06:00:23.2105049Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2105170Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2105449Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2105589Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2105785Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2105932Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2106066Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2106234Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2106578Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2106926Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2107335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2107598Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2107879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2108161Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2108429Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2108553Z Execution Analysis: (:1) 2025-03-14T06:00:23.2108791Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2108982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2108986Z 2025-03-14T06:00:23.2109168Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2109277Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2109489Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2109600Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2109788Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2109925Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2110081Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2110240Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2110804Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2111340Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2111670Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2112000Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2112286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2112544Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2112827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2113088Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2113186Z Execution Analysis: .......... 2025-03-14T06:00:23.2113433Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2113616Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2113887Z pt-xla-profiler: TransferFromDeviceTime too frequent: 631 counts during 602 steps 2025-03-14T06:00:23.2113891Z 2025-03-14T06:00:23.2114075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2114183Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2114470Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2114580Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2114763Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2115068Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2115206Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2115371Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2115714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2116056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2116357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2116625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2116947Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2117214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2117495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2117621Z Execution Analysis: (:1) 2025-03-14T06:00:23.2117869Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2118069Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2118074Z 2025-03-14T06:00:23.2118265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2118379Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2118599Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2118715Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2118910Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2119093Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2119233Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2119401Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2119994Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2120570Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2120937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2121282Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2121606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2121876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2122192Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2122460Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2122580Z Execution Analysis: .......... 2025-03-14T06:00:23.2122836Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2123050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2123333Z pt-xla-profiler: TransferFromDeviceTime too frequent: 633 counts during 603 steps 2025-03-14T06:00:23.2123337Z 2025-03-14T06:00:23.2123549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2123690Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2123990Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2124103Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2124317Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2124464Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2124718Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2124889Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2125430Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2125785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2126117Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2126429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2126756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2127032Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2127343Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2127475Z Execution Analysis: (:1) 2025-03-14T06:00:23.2127751Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2127959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2127963Z 2025-03-14T06:00:23.2128184Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2128304Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2128556Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2128673Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2128920Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2129069Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2129235Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2129432Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2130041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2130621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2130999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2131359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2131689Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2131969Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2132299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2132575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2132701Z Execution Analysis: .......... 2025-03-14T06:00:23.2132965Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2133185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2133478Z pt-xla-profiler: TransferFromDeviceTime too frequent: 634 counts during 604 steps 2025-03-14T06:00:23.2133486Z 2025-03-14T06:00:23.2133736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2133863Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2134172Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2134288Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2134505Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2134653Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2134809Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2134980Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2135356Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2135710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2136063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2136339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2136664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2136936Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2137348Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2137640Z Execution Analysis: (:1) 2025-03-14T06:00:23.2137911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2138116Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2138132Z 2025-03-14T06:00:23.2138336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2138469Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2138702Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2138852Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2139060Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2139245Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2139396Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2139568Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2140177Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2140770Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2141133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2141510Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2141826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2142117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2142428Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2142711Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2142820Z Execution Analysis: .......... 2025-03-14T06:00:23.2143093Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2143298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2143622Z pt-xla-profiler: TransferFromDeviceTime too frequent: 635 counts during 605 steps 2025-03-14T06:00:23.2143627Z 2025-03-14T06:00:23.2143833Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2143966Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2144262Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2144390Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2144598Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2144758Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2144903Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2145087Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2145448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2145813Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2146161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2146454Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2146764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2147050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2147349Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2147493Z Execution Analysis: (:1) 2025-03-14T06:00:23.2147756Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2147973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2147978Z 2025-03-14T06:00:23.2148186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2148339Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2148677Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2148800Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2149025Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2149183Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2149329Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2149615Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2150164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2150711Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2151048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2151390Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2151685Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2151956Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2152243Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2152506Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2152609Z Execution Analysis: .......... 2025-03-14T06:00:23.2152860Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2153052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2153356Z pt-xla-profiler: TransferFromDeviceTime too frequent: 636 counts during 606 steps 2025-03-14T06:00:23.2153362Z 2025-03-14T06:00:23.2153554Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2153675Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2153947Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2154066Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2154259Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2154409Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2154544Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2154715Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2155049Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2155424Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2155717Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2155986Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2156286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2156538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2156824Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2156942Z Execution Analysis: (:1) 2025-03-14T06:00:23.2157193Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2157382Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2157390Z 2025-03-14T06:00:23.2157590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2157722Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2157953Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2158080Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2158286Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2158422Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2158573Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2158732Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2159293Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2159826Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2160180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2160510Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2160818Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2161075Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2161378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2161630Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2161747Z Execution Analysis: .......... 2025-03-14T06:00:23.2161992Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2162221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2162492Z pt-xla-profiler: TransferFromDeviceTime too frequent: 637 counts during 607 steps 2025-03-14T06:00:23.2162496Z 2025-03-14T06:00:23.2162702Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2162811Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2163095Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2163202Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2163406Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2163544Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2163693Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2163853Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2164225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2164638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2165110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2165537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2165864Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2166138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2166446Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2166576Z Execution Analysis: (:1) 2025-03-14T06:00:23.2166858Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2167066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2167134Z 2025-03-14T06:00:23.2167349Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2167466Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2167744Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2167857Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2168072Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2168215Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2168371Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2168542Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2169139Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2169718Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2170093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2170445Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2170768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2171041Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2171359Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2171629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2171751Z Execution Analysis: .......... 2025-03-14T06:00:23.2172043Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2172255Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2172548Z pt-xla-profiler: TransferFromDeviceTime too frequent: 638 counts during 608 steps 2025-03-14T06:00:23.2172554Z 2025-03-14T06:00:23.2172758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2172882Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2173175Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2173291Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2173496Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2173648Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2173791Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2174004Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2174364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2174724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2175039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2175323Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2175631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2175907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2176199Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2176329Z Execution Analysis: (:1) 2025-03-14T06:00:23.2176590Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2176820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2176825Z 2025-03-14T06:00:23.2177028Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2177282Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2177510Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2177731Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2177921Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2178063Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2178202Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2178365Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2178912Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2179449Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2179783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2180115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2180404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2180666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2180950Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2181209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2181333Z Execution Analysis: .......... 2025-03-14T06:00:23.2181578Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2181768Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2182040Z pt-xla-profiler: TransferFromDeviceTime too frequent: 639 counts during 609 steps 2025-03-14T06:00:23.2182044Z 2025-03-14T06:00:23.2182232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2182347Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2182617Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2182727Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2182917Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2183058Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2183231Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2183396Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2183727Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2184061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2184351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2184612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2184898Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2185153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2185426Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2185555Z Execution Analysis: (:1) 2025-03-14T06:00:23.2185795Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2186014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2186018Z 2025-03-14T06:00:23.2186228Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2186343Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2186557Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2186668Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2186857Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2186993Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2187130Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2187295Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2187844Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2188387Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2188723Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2189053Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2189350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2189603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2189892Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2190177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2190283Z Execution Analysis: .......... 2025-03-14T06:00:23.2190523Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2190718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2190985Z pt-xla-profiler: TransferFromDeviceTime too frequent: 640 counts during 610 steps 2025-03-14T06:00:23.2190989Z 2025-03-14T06:00:23.2191182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2191288Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2191564Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2191665Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2191861Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2192025Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2192165Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2192325Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2192664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2192993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2193292Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2193549Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2193841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2194091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2194376Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2194493Z Execution Analysis: (:1) 2025-03-14T06:00:23.2194758Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2194971Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2194975Z 2025-03-14T06:00:23.2195169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2195276Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2195497Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2195600Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2195966Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2196107Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2196262Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2196430Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2197011Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2197574Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2197928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2198271Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2198587Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2198855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2199188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2199454Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2199569Z Execution Analysis: .......... 2025-03-14T06:00:23.2199819Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2200026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2200303Z pt-xla-profiler: TransferFromDeviceTime too frequent: 641 counts during 611 steps 2025-03-14T06:00:23.2200308Z 2025-03-14T06:00:23.2200512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2200623Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2200913Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2201048Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2201257Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2201403Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2201551Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2201717Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2202075Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2202418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2202729Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2202996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2203305Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2203571Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2203862Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2204013Z Execution Analysis: (:1) 2025-03-14T06:00:23.2204270Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2204574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2204592Z 2025-03-14T06:00:23.2204794Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2205076Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2205310Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2205418Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2205629Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2205773Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2205931Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2206099Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2206698Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2207277Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2207637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2207995Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2208309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2208587Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2208926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2209210Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2209318Z Execution Analysis: .......... 2025-03-14T06:00:23.2209583Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2209785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2210079Z pt-xla-profiler: TransferFromDeviceTime too frequent: 642 counts during 612 steps 2025-03-14T06:00:23.2210084Z 2025-03-14T06:00:23.2210288Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2210410Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2210703Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2210847Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2211056Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2211208Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2211354Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2211535Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2211898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2212259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2212573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2212852Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2213160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2213437Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2213761Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2213897Z Execution Analysis: (:1) 2025-03-14T06:00:23.2214182Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2214392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2214396Z 2025-03-14T06:00:23.2214601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2214724Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2214956Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2215074Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2215285Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2215438Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2215589Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2215764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2216363Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2216947Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2217416Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2217767Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2218073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2218373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2218676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2218946Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2219054Z Execution Analysis: .......... 2025-03-14T06:00:23.2219314Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2219509Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2222165Z pt-xla-profiler: TransferFromDeviceTime too frequent: 643 counts during 613 steps 2025-03-14T06:00:23.2222171Z 2025-03-14T06:00:23.2222361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2222474Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2222915Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2223036Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2223238Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2223385Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2223527Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2223700Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2224052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2224402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2224736Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2225011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2225312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2225628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2225908Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2226076Z Execution Analysis: (:1) 2025-03-14T06:00:23.2226329Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2226539Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2226543Z 2025-03-14T06:00:23.2226736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2226856Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2227078Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2227197Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2227394Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2227546Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2227686Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2227861Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2228434Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2229001Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2229349Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2229697Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2230091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2230372Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2230670Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2230943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2231045Z Execution Analysis: .......... 2025-03-14T06:00:23.2231310Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2231505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2231869Z pt-xla-profiler: TransferFromDeviceTime too frequent: 644 counts during 614 steps 2025-03-14T06:00:23.2231874Z 2025-03-14T06:00:23.2232073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2232191Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2232485Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2232595Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2232802Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2232946Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2233096Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2233262Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2233620Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2233965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2234280Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2234550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2234982Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2235235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2235539Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2235656Z Execution Analysis: (:1) 2025-03-14T06:00:23.2235905Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2236094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2236100Z 2025-03-14T06:00:23.2236297Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2236407Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2236628Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2236733Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2236929Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2237065Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2237210Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2237365Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2237918Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2238449Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2238791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2239139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2239439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2239691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2239990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2240239Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2240346Z Execution Analysis: .......... 2025-03-14T06:00:23.2240581Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2240816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2241076Z pt-xla-profiler: TransferFromDeviceTime too frequent: 645 counts during 615 steps 2025-03-14T06:00:23.2241080Z 2025-03-14T06:00:23.2241281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2241385Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2241665Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2241765Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2241965Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2242097Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2242239Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2242392Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2242734Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2243057Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2243357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2243607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2243929Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2244195Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2244548Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2244674Z Execution Analysis: (:1) 2025-03-14T06:00:23.2245091Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2245295Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2245299Z 2025-03-14T06:00:23.2245507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2245625Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2245872Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2245983Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2246196Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2246340Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2246495Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2246661Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2247260Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2247832Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2248231Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2248583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2248908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2249199Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2249507Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2249783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2249890Z Execution Analysis: .......... 2025-03-14T06:00:23.2250182Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2250385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2250681Z pt-xla-profiler: TransferFromDeviceTime too frequent: 646 counts during 616 steps 2025-03-14T06:00:23.2250686Z 2025-03-14T06:00:23.2250889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2251008Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2251300Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2251420Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2251624Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2251774Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2251919Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2252096Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2252456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2252818Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2253127Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2253443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2253776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2254060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2254354Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2254491Z Execution Analysis: (:1) 2025-03-14T06:00:23.2254756Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2254974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2254978Z 2025-03-14T06:00:23.2255184Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2255312Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2255545Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2255669Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2255878Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2256031Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2256182Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2256363Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2256954Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2257617Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2257976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2258313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2258607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2258872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2259160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2259421Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2259547Z Execution Analysis: .......... 2025-03-14T06:00:23.2259799Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2259991Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2260267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 647 counts during 617 steps 2025-03-14T06:00:23.2260273Z 2025-03-14T06:00:23.2260462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2260583Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2260855Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2260971Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2261163Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2261308Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2261446Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2261615Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2261949Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2262287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2262616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2262880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2263190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2263454Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2263730Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2263855Z Execution Analysis: (:1) 2025-03-14T06:00:23.2264094Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2264290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2264295Z 2025-03-14T06:00:23.2264483Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2264600Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2264814Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2264928Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2265120Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2265260Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2265546Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2265887Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2266481Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2267125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2267500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2267853Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2268182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2268458Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2268779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2269095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2269211Z Execution Analysis: .......... 2025-03-14T06:00:23.2269469Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2269687Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2269975Z pt-xla-profiler: TransferFromDeviceTime too frequent: 648 counts during 618 steps 2025-03-14T06:00:23.2269979Z 2025-03-14T06:00:23.2270199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2270315Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2270623Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2270735Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2270951Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2271101Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2271254Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2271428Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2271800Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2272190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2272514Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2272835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2273155Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2273426Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2273729Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2273857Z Execution Analysis: (:1) 2025-03-14T06:00:23.2274128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2274335Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2274341Z 2025-03-14T06:00:23.2274549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2274667Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2274911Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2275023Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2275240Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2275383Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2275544Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2275715Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2276315Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2276916Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2277291Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2277649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2277970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2278456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2278777Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2279028Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2279140Z Execution Analysis: .......... 2025-03-14T06:00:23.2279382Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2279579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2279848Z pt-xla-profiler: TransferFromDeviceTime too frequent: 649 counts during 619 steps 2025-03-14T06:00:23.2279852Z 2025-03-14T06:00:23.2280052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2280160Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2280439Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2280544Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2280744Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2280879Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2281018Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2281179Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2281522Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2281874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2282197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2282454Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2282746Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2282997Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2283282Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2283401Z Execution Analysis: (:1) 2025-03-14T06:00:23.2283655Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2283847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2283859Z 2025-03-14T06:00:23.2284051Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2284168Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2284380Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2284556Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2284753Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2284901Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2285215Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2285394Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2286017Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2286604Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2286967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2287331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2287645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2287929Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2288269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2288550Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2288663Z Execution Analysis: .......... 2025-03-14T06:00:23.2288934Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2289141Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2289441Z pt-xla-profiler: TransferFromDeviceTime too frequent: 650 counts during 620 steps 2025-03-14T06:00:23.2289446Z 2025-03-14T06:00:23.2289652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2289780Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2290071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2290193Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2290399Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2290553Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2290702Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2290909Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2291271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2291658Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2291974Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2292367Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2292818Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2293180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2293558Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2293697Z Execution Analysis: (:1) 2025-03-14T06:00:23.2293958Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2294169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2294174Z 2025-03-14T06:00:23.2294383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2294503Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2294737Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2294858Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2295067Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2295221Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2295369Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2295543Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2296178Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2296768Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2297132Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2297496Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2297811Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2298141Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2298449Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2298731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2298843Z Execution Analysis: .......... 2025-03-14T06:00:23.2299114Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2299323Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2299621Z pt-xla-profiler: TransferFromDeviceTime too frequent: 651 counts during 621 steps 2025-03-14T06:00:23.2299626Z 2025-03-14T06:00:23.2299843Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2299966Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2300296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2300455Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2300733Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2300941Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2301183Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2301366Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2301758Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2302125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2302443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2302731Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2303053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2303327Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2303638Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2303769Z Execution Analysis: (:1) 2025-03-14T06:00:23.2304042Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2304251Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2304255Z 2025-03-14T06:00:23.2304472Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2304588Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2304834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2304949Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2305171Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2305318Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2305477Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2305677Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2306288Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2306869Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2307245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2307597Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2307952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2308230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2308550Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2308821Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2308936Z Execution Analysis: .......... 2025-03-14T06:00:23.2309200Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2309416Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2309702Z pt-xla-profiler: TransferFromDeviceTime too frequent: 652 counts during 622 steps 2025-03-14T06:00:23.2309707Z 2025-03-14T06:00:23.2309919Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2310038Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2310337Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2310450Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2310666Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2310846Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2310997Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2311168Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2311558Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2311913Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2312238Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2312517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2312834Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2313106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2313409Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2313541Z Execution Analysis: (:1) 2025-03-14T06:00:23.2313806Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2314010Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2314015Z 2025-03-14T06:00:23.2314221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2314339Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2314581Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2314698Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2314911Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2315084Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2315237Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2315408Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2316010Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2316587Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2316957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2317340Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2317659Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2317938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2318256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2318528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2318645Z Execution Analysis: .......... 2025-03-14T06:00:23.2318907Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2319123Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2319421Z pt-xla-profiler: TransferFromDeviceTime too frequent: 654 counts during 623 steps 2025-03-14T06:00:23.2319427Z 2025-03-14T06:00:23.2319630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2319756Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2320051Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2320173Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2320406Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2320562Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2320706Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2320914Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2321273Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2321635Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2321950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2322236Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2322547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2322826Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2323121Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2323257Z Execution Analysis: (:1) 2025-03-14T06:00:23.2323518Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2323730Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2323734Z 2025-03-14T06:00:23.2323937Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2324066Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2324300Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2324425Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2324755Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2324923Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2325076Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2325258Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2325855Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2326443Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2326804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2327196Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2327510Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2327794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2328106Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2328386Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2328495Z Execution Analysis: .......... 2025-03-14T06:00:23.2328763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2328966Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2329264Z pt-xla-profiler: TransferFromDeviceTime too frequent: 655 counts during 624 steps 2025-03-14T06:00:23.2329271Z 2025-03-14T06:00:23.2329474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2329596Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2329891Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2330042Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2330249Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2330407Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2330575Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2330756Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2331117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2331483Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2331799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2332083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2332396Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2332675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2332971Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2333110Z Execution Analysis: (:1) 2025-03-14T06:00:23.2333369Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2333578Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2333584Z 2025-03-14T06:00:23.2333785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2333908Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2334139Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2335438Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2335674Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2335831Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2335980Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2336167Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2336764Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2337346Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2337747Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2338112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2338441Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2338719Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2339042Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2339419Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2339537Z Execution Analysis: .......... 2025-03-14T06:00:23.2339789Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2339999Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2340280Z pt-xla-profiler: TransferFromDeviceTime too frequent: 656 counts during 625 steps 2025-03-14T06:00:23.2340285Z 2025-03-14T06:00:23.2340493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2340608Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2340928Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2341038Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2341274Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2341418Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2341565Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2341736Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2342102Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2342448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2342767Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2343145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2343451Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2343703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2343991Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2344110Z Execution Analysis: (:1) 2025-03-14T06:00:23.2344364Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2344555Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2344561Z 2025-03-14T06:00:23.2344763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2344873Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2345127Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2345236Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2345435Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2345571Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2345725Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2345884Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2346448Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2346982Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2347359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2347687Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2347996Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2348257Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2348560Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2348814Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2348926Z Execution Analysis: .......... 2025-03-14T06:00:23.2349168Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2349372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2349639Z pt-xla-profiler: TransferFromDeviceTime too frequent: 657 counts during 626 steps 2025-03-14T06:00:23.2349644Z 2025-03-14T06:00:23.2349846Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2349980Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2350263Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2350392Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2350594Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2350730Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2350881Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2351041Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2351386Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2351714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2352016Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2352274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2352571Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2352824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2353104Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2353222Z Execution Analysis: (:1) 2025-03-14T06:00:23.2353475Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2353663Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2353677Z 2025-03-14T06:00:23.2353863Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2354010Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2354228Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2354334Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2354534Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2354672Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2354825Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2354982Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2355538Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2356104Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2356439Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2356780Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2357071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2357337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2357624Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2357885Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2357985Z Execution Analysis: .......... 2025-03-14T06:00:23.2358242Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2358430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2358713Z pt-xla-profiler: TransferFromDeviceTime too frequent: 658 counts during 627 steps 2025-03-14T06:00:23.2358745Z 2025-03-14T06:00:23.2358934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2359054Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2359348Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2359467Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2359656Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2359804Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2359936Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2360107Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2360441Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2360777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2361067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2361336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2361625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2361889Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2362163Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2362294Z Execution Analysis: (:1) 2025-03-14T06:00:23.2362537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2362742Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2362746Z 2025-03-14T06:00:23.2362958Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2363081Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2363297Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2363411Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2363605Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2363752Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2363889Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2364060Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2364692Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2365656Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2366145Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2366572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2366893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2367181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2367491Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2367778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2367891Z Execution Analysis: .......... 2025-03-14T06:00:23.2368166Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2368373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2368668Z pt-xla-profiler: TransferFromDeviceTime too frequent: 659 counts during 628 steps 2025-03-14T06:00:23.2368744Z 2025-03-14T06:00:23.2368951Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2369130Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2369429Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2369556Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2369765Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2369924Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2370075Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2370259Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2370619Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2370989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2371305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2371597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2371912Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2372194Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2372489Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2372629Z Execution Analysis: (:1) 2025-03-14T06:00:23.2372891Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2373142Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2373147Z 2025-03-14T06:00:23.2373362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2373479Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2373728Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2373839Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2374056Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2374200Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2374362Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2374574Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2375180Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2375755Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2376129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2376484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2376809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2377085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2377408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2377681Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2377800Z Execution Analysis: .......... 2025-03-14T06:00:23.2378161Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2378364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2378655Z pt-xla-profiler: TransferFromDeviceTime too frequent: 660 counts during 629 steps 2025-03-14T06:00:23.2378660Z 2025-03-14T06:00:23.2378924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2379035Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2379319Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2379427Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2379630Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2379767Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2379915Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2380075Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2380422Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2380750Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2381049Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2381308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2381604Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2381854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2382135Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2382252Z Execution Analysis: (:1) 2025-03-14T06:00:23.2382504Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2382715Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2382721Z 2025-03-14T06:00:23.2382918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2383028Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2383262Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2383368Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2383569Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2383704Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2383904Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2384062Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2384624Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2385160Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2385510Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2385840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2386145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2386400Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2386703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2386959Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2387072Z Execution Analysis: .......... 2025-03-14T06:00:23.2387316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2387540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2387808Z pt-xla-profiler: TransferFromDeviceTime too frequent: 661 counts during 630 steps 2025-03-14T06:00:23.2387849Z 2025-03-14T06:00:23.2388041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2388162Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2388435Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2388555Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2388747Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2388898Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2389033Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2389194Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2389545Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2389884Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2390175Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2390445Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2390730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2390997Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2391272Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2391405Z Execution Analysis: (:1) 2025-03-14T06:00:23.2391671Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2391875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2391879Z 2025-03-14T06:00:23.2392069Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2392193Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2392409Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2392530Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2392724Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2392896Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2393036Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2393205Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2393756Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2394303Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2394639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2394979Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2395272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2395541Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2395824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2396258Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2396365Z Execution Analysis: .......... 2025-03-14T06:00:23.2396654Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2396855Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2397168Z pt-xla-profiler: TransferFromDeviceTime too frequent: 662 counts during 631 steps 2025-03-14T06:00:23.2397173Z 2025-03-14T06:00:23.2397373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2397498Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2397783Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2397909Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2398110Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2398263Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2398406Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2398590Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2398940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2399296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2399600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2399880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2400180Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2400458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2400745Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2400905Z Execution Analysis: (:1) 2025-03-14T06:00:23.2401166Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2401375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2401380Z 2025-03-14T06:00:23.2401580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2401705Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2401934Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2402053Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2402279Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2402429Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2402575Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2402751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2403321Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2403896Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2404247Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2404712Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2405189Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2405482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2405806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2406081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2406250Z Execution Analysis: .......... 2025-03-14T06:00:23.2406511Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2406754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2407042Z pt-xla-profiler: TransferFromDeviceTime too frequent: 663 counts during 632 steps 2025-03-14T06:00:23.2407047Z 2025-03-14T06:00:23.2407262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2407381Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2407689Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2407801Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2408024Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2408173Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2408336Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2408508Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2408882Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2409234Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2409561Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2409835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2410157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2410426Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2410758Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2410889Z Execution Analysis: (:1) 2025-03-14T06:00:23.2411159Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2411365Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2411369Z 2025-03-14T06:00:23.2411583Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2411700Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2411944Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2412080Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2412297Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2412443Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2412608Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2412778Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2413383Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2413962Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2414336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2414689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2415018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2415297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2415621Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2415919Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2416038Z Execution Analysis: .......... 2025-03-14T06:00:23.2416320Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2416538Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2416824Z pt-xla-profiler: TransferFromDeviceTime too frequent: 664 counts during 633 steps 2025-03-14T06:00:23.2416829Z 2025-03-14T06:00:23.2417040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2417268Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2417551Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2417656Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2417860Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2418000Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2418146Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2418304Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2418648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2418976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2419276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2419532Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2419827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2420105Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2420392Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2420511Z Execution Analysis: (:1) 2025-03-14T06:00:23.2420764Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2420955Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2420959Z 2025-03-14T06:00:23.2421158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2421291Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2421520Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2421626Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2421835Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2421973Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2422124Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2422283Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2422842Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2423375Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2423720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2424059Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2424346Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2424612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2424925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2425187Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2425287Z Execution Analysis: .......... 2025-03-14T06:00:23.2425563Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2425754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2426033Z pt-xla-profiler: TransferFromDeviceTime too frequent: 665 counts during 634 steps 2025-03-14T06:00:23.2426039Z 2025-03-14T06:00:23.2426227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2426347Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2426618Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2426744Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2426936Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2427087Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2427225Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2427399Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2427734Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2428076Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2428370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2428816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2429144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2429423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2429716Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2429856Z Execution Analysis: (:1) 2025-03-14T06:00:23.2430112Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2430324Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2430328Z 2025-03-14T06:00:23.2430528Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2430679Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2430908Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2431035Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2431242Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2431402Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2431550Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2431733Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2432312Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2432889Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2433245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2433609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2433921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2434212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2434537Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2434842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2434948Z Execution Analysis: .......... 2025-03-14T06:00:23.2435218Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2435423Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2435716Z pt-xla-profiler: TransferFromDeviceTime too frequent: 666 counts during 635 steps 2025-03-14T06:00:23.2435721Z 2025-03-14T06:00:23.2435920Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2436051Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2436340Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2436466Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2436671Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2436834Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2436974Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2437155Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2437504Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2437861Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2438168Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2438445Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2438771Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2439049Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2439337Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2439472Z Execution Analysis: (:1) 2025-03-14T06:00:23.2439724Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2439937Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2439978Z 2025-03-14T06:00:23.2440188Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2440302Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2440544Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2440657Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2440872Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2441015Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2441161Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2441340Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2441933Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2442493Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2442857Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2443200Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2443519Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2443816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2444156Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2444423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2444643Z Execution Analysis: .......... 2025-03-14T06:00:23.2444903Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2445288Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2445575Z pt-xla-profiler: TransferFromDeviceTime too frequent: 667 counts during 636 steps 2025-03-14T06:00:23.2445580Z 2025-03-14T06:00:23.2445872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2445990Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2446296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2446410Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2446630Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2446776Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2446936Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2447106Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2447478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2447836Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2448161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2448467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2448792Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2449062Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2449370Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2449499Z Execution Analysis: (:1) 2025-03-14T06:00:23.2449774Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2449980Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2450010Z 2025-03-14T06:00:23.2450227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2450344Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2450594Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2450709Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2450926Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2451074Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2451240Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2451411Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2452012Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2452588Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2452961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2453315Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2453666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2453945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2454296Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2454569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2454689Z Execution Analysis: .......... 2025-03-14T06:00:23.2454948Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2455168Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2455456Z pt-xla-profiler: TransferFromDeviceTime too frequent: 668 counts during 637 steps 2025-03-14T06:00:23.2455460Z 2025-03-14T06:00:23.2455679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2455797Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2456102Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2456216Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2456435Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2456580Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2456739Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2456909Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2457283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2457637Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2457986Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2458266Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2458588Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2458875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2459170Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2459418Z Execution Analysis: (:1) 2025-03-14T06:00:23.2459673Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2459911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2459915Z 2025-03-14T06:00:23.2460115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2460242Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2460471Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2460594Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2460794Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2460950Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2461198Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2461369Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2461916Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2462461Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2462798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2463160Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2463452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2463744Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2464036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2464301Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2464404Z Execution Analysis: .......... 2025-03-14T06:00:23.2464658Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2464847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2465130Z pt-xla-profiler: TransferFromDeviceTime too frequent: 669 counts during 638 steps 2025-03-14T06:00:23.2465137Z 2025-03-14T06:00:23.2465468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2465591Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2466043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2466171Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2466378Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2466537Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2466680Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2466865Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2467225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2467649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2472097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2472421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2472743Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2473025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2473318Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2473452Z Execution Analysis: (:1) 2025-03-14T06:00:23.2473797Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2474010Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2474016Z 2025-03-14T06:00:23.2474216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2474347Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2474575Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2474692Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2474900Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2475056Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2475202Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2475377Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2475979Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2476564Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2476925Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2477329Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2477679Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2477963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2478360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2478618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2478716Z Execution Analysis: .......... 2025-03-14T06:00:23.2478965Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2479151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2479423Z pt-xla-profiler: TransferFromDeviceTime too frequent: 670 counts during 639 steps 2025-03-14T06:00:23.2479428Z 2025-03-14T06:00:23.2479611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2479726Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2479992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2480104Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2480292Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2480432Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2480564Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2480732Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2481105Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2481438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2481727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2481987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2482271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2482528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2482798Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2482945Z Execution Analysis: (:1) 2025-03-14T06:00:23.2483182Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2483376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2483383Z 2025-03-14T06:00:23.2483574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2483677Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2483899Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2483998Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2484192Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2484322Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2484459Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2484710Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2485457Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2486026Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2486423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2486797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2487114Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2487385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2487696Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2487968Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2488079Z Execution Analysis: .......... 2025-03-14T06:00:23.2488337Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2488544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2488827Z pt-xla-profiler: TransferFromDeviceTime too frequent: 671 counts during 640 steps 2025-03-14T06:00:23.2488833Z 2025-03-14T06:00:23.2489042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2489150Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2489444Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2489552Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2489758Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2489897Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2490044Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2490206Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2490594Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2490946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2491264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2491534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2491846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2492112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2492439Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2492560Z Execution Analysis: (:1) 2025-03-14T06:00:23.2492825Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2493023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2493029Z 2025-03-14T06:00:23.2493235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2493350Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2493585Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2493694Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2493904Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2494044Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2494203Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2494368Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2494970Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2495538Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2495954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2496305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2496628Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2496901Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2497326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2497585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2497696Z Execution Analysis: .......... 2025-03-14T06:00:23.2497947Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2498151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2498430Z pt-xla-profiler: TransferFromDeviceTime too frequent: 672 counts during 641 steps 2025-03-14T06:00:23.2498443Z 2025-03-14T06:00:23.2498640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2498754Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2499038Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2499155Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2499350Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2499492Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2499634Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2499819Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2500170Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2500507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2500818Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2501090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2501384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2501679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2501961Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2502087Z Execution Analysis: (:1) 2025-03-14T06:00:23.2502337Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2502540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2502544Z 2025-03-14T06:00:23.2502739Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2502859Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2503081Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2503193Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2503391Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2503537Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2503679Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2503845Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2504418Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2505002Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2505372Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2505722Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2506023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2506297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2506591Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2506858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2506958Z Execution Analysis: .......... 2025-03-14T06:00:23.2507219Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2507415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2507693Z pt-xla-profiler: TransferFromDeviceTime too frequent: 673 counts during 642 steps 2025-03-14T06:00:23.2507699Z 2025-03-14T06:00:23.2507890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2508006Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2508287Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2508400Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2508596Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2508764Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2508900Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2509069Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2509412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2509756Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2510054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2510324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2510645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2510907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2511186Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2511312Z Execution Analysis: (:1) 2025-03-14T06:00:23.2511561Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2511771Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2511777Z 2025-03-14T06:00:23.2511975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2512099Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2512326Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2512446Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2512650Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2512804Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2512951Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2513131Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2513708Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2514343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2514700Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2515057Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2515364Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2515648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2515950Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2516233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2516343Z Execution Analysis: .......... 2025-03-14T06:00:23.2516614Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2516830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2517211Z pt-xla-profiler: TransferFromDeviceTime too frequent: 675 counts during 643 steps 2025-03-14T06:00:23.2517215Z 2025-03-14T06:00:23.2517420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2517532Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2517816Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2517923Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2518153Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2518292Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2518444Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2518605Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2518956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2519285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2519592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2519850Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2520174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2520428Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2520717Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2520841Z Execution Analysis: (:1) 2025-03-14T06:00:23.2521096Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2521288Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2521293Z 2025-03-14T06:00:23.2521495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2521607Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2521836Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2521946Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2522155Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2522293Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2522452Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2522637Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2523203Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2523759Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2524110Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2524439Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2524834Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2525277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2525603Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2525879Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2526000Z Execution Analysis: .......... 2025-03-14T06:00:23.2526264Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2526482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2526770Z pt-xla-profiler: TransferFromDeviceTime too frequent: 676 counts during 644 steps 2025-03-14T06:00:23.2526774Z 2025-03-14T06:00:23.2526991Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2527109Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2527415Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2527575Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2527800Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2527948Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2528106Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2528278Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2528651Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2529003Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2529328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2529633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2529958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2530232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2530542Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2530671Z Execution Analysis: (:1) 2025-03-14T06:00:23.2530949Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2531154Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2531160Z 2025-03-14T06:00:23.2531377Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2531497Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2531741Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2531855Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2532075Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2532222Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2532449Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2532622Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2533249Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2533825Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2534199Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2534571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2534886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2535178Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2535492Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2535777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2535890Z Execution Analysis: .......... 2025-03-14T06:00:23.2536167Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2536372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2536671Z pt-xla-profiler: TransferFromDeviceTime too frequent: 677 counts during 645 steps 2025-03-14T06:00:23.2536678Z 2025-03-14T06:00:23.2536882Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2537012Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2537423Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2537545Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2537737Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2537887Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2538025Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2538197Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2538533Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2538872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2539199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2539469Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2539760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2540027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2540301Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2540605Z Execution Analysis: (:1) 2025-03-14T06:00:23.2540860Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2541071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2541076Z 2025-03-14T06:00:23.2541273Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2541401Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2541627Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2541750Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2541953Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2542132Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2542277Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2542455Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2543071Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2543848Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2544213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2544580Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2544900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2545192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2545505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2545792Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2545902Z Execution Analysis: .......... 2025-03-14T06:00:23.2546178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2546383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2546693Z pt-xla-profiler: TransferFromDeviceTime too frequent: 678 counts during 646 steps 2025-03-14T06:00:23.2546698Z 2025-03-14T06:00:23.2546903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2547061Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2547356Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2547484Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2547714Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2547876Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2548021Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2548202Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2548564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2548956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2549269Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2549560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2549870Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2550157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2550481Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2550672Z Execution Analysis: (:1) 2025-03-14T06:00:23.2550988Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2551210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2551217Z 2025-03-14T06:00:23.2551435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2551553Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2551804Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2551918Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2552165Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2552327Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2552476Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2552687Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2553281Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2553871Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2554248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2554607Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2554936Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2555218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2555542Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2555815Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2555938Z Execution Analysis: .......... 2025-03-14T06:00:23.2556197Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2556416Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2556706Z pt-xla-profiler: TransferFromDeviceTime too frequent: 679 counts during 647 steps 2025-03-14T06:00:23.2556710Z 2025-03-14T06:00:23.2556952Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2557073Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2557377Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2557492Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2557712Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2557862Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2558024Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2558190Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2558559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2558935Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2559258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2559533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2559857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2560128Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2560431Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2560556Z Execution Analysis: (:1) 2025-03-14T06:00:23.2560826Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2561028Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2561032Z 2025-03-14T06:00:23.2561249Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2561361Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2561608Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2561744Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2561959Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2562101Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2562284Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2562452Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2563055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2563631Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2564008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2564362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2564786Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2565062Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2565592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2565864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2565986Z Execution Analysis: .......... 2025-03-14T06:00:23.2566243Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2566459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2566743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 680 counts during 648 steps 2025-03-14T06:00:23.2566812Z 2025-03-14T06:00:23.2567029Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2567144Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2567447Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2567559Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2567774Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2567919Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2568075Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2568242Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2568648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2568999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2569322Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2569596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2569913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2570179Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2570481Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2570618Z Execution Analysis: (:1) 2025-03-14T06:00:23.2570875Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2571091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2571095Z 2025-03-14T06:00:23.2571296Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2571419Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2571682Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2571804Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2572039Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2572198Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2572342Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2572516Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2573104Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2573691Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2574051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2574413Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2574724Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2575012Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2575317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2575595Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2575702Z Execution Analysis: .......... 2025-03-14T06:00:23.2575968Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2576166Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2576488Z pt-xla-profiler: TransferFromDeviceTime too frequent: 681 counts during 649 steps 2025-03-14T06:00:23.2576495Z 2025-03-14T06:00:23.2576699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2576823Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2577112Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2577234Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2577438Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2577590Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2577757Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2577936Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2578291Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2578656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2578967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2579252Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2579561Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2579842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2580131Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2580270Z Execution Analysis: (:1) 2025-03-14T06:00:23.2580526Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2580739Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2580743Z 2025-03-14T06:00:23.2580945Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2581101Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2581331Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2582076Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2582291Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2582452Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2582597Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2582782Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2583379Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2583969Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2584331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2584696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2585013Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2585297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2585605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2585888Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2585996Z Execution Analysis: .......... 2025-03-14T06:00:23.2586263Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2586494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2586794Z pt-xla-profiler: TransferFromDeviceTime too frequent: 682 counts during 650 steps 2025-03-14T06:00:23.2586800Z 2025-03-14T06:00:23.2587014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2587127Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2587432Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2587543Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2587759Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2587942Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2588097Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2588261Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2588627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2588989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2589314Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2589590Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2589908Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2590173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2590485Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2590611Z Execution Analysis: (:1) 2025-03-14T06:00:23.2590884Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2591085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2591114Z 2025-03-14T06:00:23.2591325Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2591435Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2591701Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2591812Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2592027Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2592165Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2592325Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2592492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2593093Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2593668Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2594042Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2594395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2594719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2594992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2595314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2595587Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2595704Z Execution Analysis: .......... 2025-03-14T06:00:23.2595983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2596202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2596484Z pt-xla-profiler: TransferFromDeviceTime too frequent: 683 counts during 651 steps 2025-03-14T06:00:23.2596489Z 2025-03-14T06:00:23.2596705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2596817Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2597122Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2597231Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2597472Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2597613Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2597766Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2597933Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2598304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2598653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2598977Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2599250Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2599569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2599838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2600143Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2600266Z Execution Analysis: (:1) 2025-03-14T06:00:23.2600535Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2600738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2600767Z 2025-03-14T06:00:23.2600979Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2601130Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2601378Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2601488Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2601705Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2601847Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2602008Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2602174Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2602781Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2603360Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2603732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2604083Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2604406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2604775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2605090Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2605371Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2605526Z Execution Analysis: .......... 2025-03-14T06:00:23.2605829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2606030Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2606333Z pt-xla-profiler: TransferFromDeviceTime too frequent: 684 counts during 652 steps 2025-03-14T06:00:23.2606338Z 2025-03-14T06:00:23.2606538Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2606666Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2606956Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2607107Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2607310Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2607465Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2607608Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2607790Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2608148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2608515Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2608826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2609112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2609416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2609701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2609990Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2610128Z Execution Analysis: (:1) 2025-03-14T06:00:23.2610386Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2610626Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2610631Z 2025-03-14T06:00:23.2610854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2610983Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2611212Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2611330Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2611533Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2611693Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2611837Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2612016Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2612613Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2613199Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2613558Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2613921Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2614231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2614516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2614819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2615124Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2615227Z Execution Analysis: .......... 2025-03-14T06:00:23.2615494Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2615694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2615990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 685 counts during 653 steps 2025-03-14T06:00:23.2615995Z 2025-03-14T06:00:23.2616195Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2616320Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2616633Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2616756Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2616958Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2617117Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2617257Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2617441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2617798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2618162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2618476Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2618761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2619068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2619348Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2619641Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2619779Z Execution Analysis: (:1) 2025-03-14T06:00:23.2620062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2620299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2620303Z 2025-03-14T06:00:23.2620507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2620632Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2620861Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2620983Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2621188Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2621340Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2621485Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2621663Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2622252Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2622833Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2623202Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2623552Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2623877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2624149Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2624502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2624771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2624891Z Execution Analysis: .......... 2025-03-14T06:00:23.2625147Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2625362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2625647Z pt-xla-profiler: TransferFromDeviceTime too frequent: 686 counts during 654 steps 2025-03-14T06:00:23.2625652Z 2025-03-14T06:00:23.2625863Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2626003Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2626305Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2626413Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2626638Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2626784Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2626941Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2627112Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2627487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2627833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2628157Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2628430Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2628748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2629015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2629320Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2629468Z Execution Analysis: (:1) 2025-03-14T06:00:23.2629738Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2629963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2629968Z 2025-03-14T06:00:23.2630182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2630295Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2630541Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2630648Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2630862Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2631002Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2631163Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2631331Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2631933Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2632505Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2632879Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2633229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2633557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2633831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2634176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2634447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2634569Z Execution Analysis: .......... 2025-03-14T06:00:23.2634829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2635041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2635326Z pt-xla-profiler: TransferFromDeviceTime too frequent: 687 counts during 655 steps 2025-03-14T06:00:23.2635356Z 2025-03-14T06:00:23.2635569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2635683Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2635987Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2636098Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2636315Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2636460Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2636613Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2636782Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2637148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2637499Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2637819Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2638095Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2638413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2638685Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2639012Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2639137Z Execution Analysis: (:1) 2025-03-14T06:00:23.2639431Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2639631Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2639648Z 2025-03-14T06:00:23.2639845Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2639973Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2640201Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2640324Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2640526Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2640682Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2640827Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2640994Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2641592Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2642175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2642531Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2642893Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2643199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2643508Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2643818Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2644100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2644207Z Execution Analysis: .......... 2025-03-14T06:00:23.2644534Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2644746Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2645043Z pt-xla-profiler: TransferFromDeviceTime too frequent: 688 counts during 656 steps 2025-03-14T06:00:23.2645080Z 2025-03-14T06:00:23.2645282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2645412Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2645713Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2645839Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2646046Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2646205Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2646355Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2646538Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2646901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2647267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2647586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2647874Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2648186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2648494Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2648790Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2648954Z Execution Analysis: (:1) 2025-03-14T06:00:23.2649217Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2649434Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2649438Z 2025-03-14T06:00:23.2649644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2649774Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2650004Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2650129Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2650338Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2650499Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2650649Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2650834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2651427Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2652015Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2652380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2652748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2653087Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2653380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2653690Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2653975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2654086Z Execution Analysis: .......... 2025-03-14T06:00:23.2654358Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2654565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2654888Z pt-xla-profiler: TransferFromDeviceTime too frequent: 689 counts during 657 steps 2025-03-14T06:00:23.2654892Z 2025-03-14T06:00:23.2655097Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2655225Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2655514Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2655637Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2655847Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2656011Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2656153Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2656338Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2656698Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2657174Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2657464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2657733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2658064Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2658313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2658632Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2658751Z Execution Analysis: (:1) 2025-03-14T06:00:23.2659000Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2659189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2659195Z 2025-03-14T06:00:23.2659392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2659500Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2659723Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2659829Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2660030Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2660166Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2660314Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2660472Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2661028Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2661560Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2661906Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2662260Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2662568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2662824Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2663127Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2663378Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2663489Z Execution Analysis: .......... 2025-03-14T06:00:23.2663730Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2663955Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2664220Z pt-xla-profiler: TransferFromDeviceTime too frequent: 690 counts during 658 steps 2025-03-14T06:00:23.2664224Z 2025-03-14T06:00:23.2664423Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2664531Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2664807Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2664910Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2665112Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2665248Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2665532Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2665692Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2666230Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2666585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2666914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2667192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2667577Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2667894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2668205Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2668336Z Execution Analysis: (:1) 2025-03-14T06:00:23.2668608Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2668814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2668818Z 2025-03-14T06:00:23.2669032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2669149Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2669393Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2669508Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2669730Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2669879Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2670040Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2670207Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2670810Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2671388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2671796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2672149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2672476Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2672754Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2673075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2673345Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2673466Z Execution Analysis: .......... 2025-03-14T06:00:23.2673761Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2673977Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2674277Z pt-xla-profiler: TransferFromDeviceTime too frequent: 691 counts during 659 steps 2025-03-14T06:00:23.2674282Z 2025-03-14T06:00:23.2674487Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2674612Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2674905Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2675028Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2675234Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2675387Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2675533Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2675714Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2676076Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2676436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2676755Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2677066Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2677401Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2677680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2678086Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2678214Z Execution Analysis: (:1) 2025-03-14T06:00:23.2678456Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2678655Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2678658Z 2025-03-14T06:00:23.2678849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2678966Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2679181Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2679297Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2679489Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2679633Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2679772Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2679939Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2680486Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2681026Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2681384Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2681723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2682018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2682286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2682573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2682835Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2682998Z Execution Analysis: .......... 2025-03-14T06:00:23.2683251Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2683441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2683720Z pt-xla-profiler: TransferFromDeviceTime too frequent: 692 counts during 660 steps 2025-03-14T06:00:23.2683727Z 2025-03-14T06:00:23.2683915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2684032Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2684302Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2684420Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2684671Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2684820Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2685126Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2685310Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2685672Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2686038Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2686384Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2686670Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2687001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2687284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2687578Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2687718Z Execution Analysis: (:1) 2025-03-14T06:00:23.2687976Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2688191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2688198Z 2025-03-14T06:00:23.2688398Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2688527Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2688759Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2688888Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2689093Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2689250Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2689402Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2689588Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2690183Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2690800Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2691163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2691532Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2691861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2692141Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2692461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2692769Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2692888Z Execution Analysis: .......... 2025-03-14T06:00:23.2693150Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2693367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2693660Z pt-xla-profiler: TransferFromDeviceTime too frequent: 693 counts during 661 steps 2025-03-14T06:00:23.2693664Z 2025-03-14T06:00:23.2693881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2694000Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2694302Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2694417Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2694632Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2694784Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2694940Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2695113Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2695487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2695881Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2696205Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2696506Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2696828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2697101Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2697408Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2697537Z Execution Analysis: (:1) 2025-03-14T06:00:23.2697807Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2698016Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2698022Z 2025-03-14T06:00:23.2698234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2698351Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2698596Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2698711Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2698925Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2699073Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2699231Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2699404Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2700004Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2700601Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2700973Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2701326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2701649Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2701922Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2702268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2702540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2702657Z Execution Analysis: .......... 2025-03-14T06:00:23.2702917Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2703133Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2703419Z pt-xla-profiler: TransferFromDeviceTime too frequent: 694 counts during 662 steps 2025-03-14T06:00:23.2703424Z 2025-03-14T06:00:23.2703638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2703752Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2704158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2704269Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2704481Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2704620Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2704769Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2704937Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2707518Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2707911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2708212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2708471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2708764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2709016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2709297Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2709416Z Execution Analysis: (:1) 2025-03-14T06:00:23.2709672Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2709892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2709897Z 2025-03-14T06:00:23.2710087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2710204Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2710419Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2710530Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2710720Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2710873Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2711011Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2711178Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2711753Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2712300Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2712636Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2712972Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2713274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2713528Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2713852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2714102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2714216Z Execution Analysis: .......... 2025-03-14T06:00:23.2714459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2714660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2714926Z pt-xla-profiler: TransferFromDeviceTime too frequent: 696 counts during 663 steps 2025-03-14T06:00:23.2714930Z 2025-03-14T06:00:23.2715128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2715236Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2715515Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2715619Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2715820Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2715954Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2716102Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2716258Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2716686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2717013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2717314Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2717567Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2717865Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2718116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2718400Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2718518Z Execution Analysis: (:1) 2025-03-14T06:00:23.2718772Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2718964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2718968Z 2025-03-14T06:00:23.2719170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2719277Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2719503Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2719605Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2719808Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2719942Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2720092Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2720248Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2720835Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2721368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2721713Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2722040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2722340Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2722618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2722914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2723164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2723275Z Execution Analysis: .......... 2025-03-14T06:00:23.2723517Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2723718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2723982Z pt-xla-profiler: TransferFromDeviceTime too frequent: 697 counts during 664 steps 2025-03-14T06:00:23.2723987Z 2025-03-14T06:00:23.2724186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2724293Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2724676Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2724782Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2725162Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2725308Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2725494Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2725703Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2726074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2726427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2726750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2727023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2727348Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2727617Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2727929Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2728055Z Execution Analysis: (:1) 2025-03-14T06:00:23.2728327Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2728528Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2728545Z 2025-03-14T06:00:23.2728746Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2728865Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2729109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2729223Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2729436Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2729583Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2729740Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2729933Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2730539Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2731125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2731485Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2731850Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2732199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2732490Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2732798Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2733084Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2733187Z Execution Analysis: .......... 2025-03-14T06:00:23.2733471Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2733679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2733983Z pt-xla-profiler: TransferFromDeviceTime too frequent: 698 counts during 665 steps 2025-03-14T06:00:23.2733988Z 2025-03-14T06:00:23.2734209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2734329Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2734635Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2734751Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2734973Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2735146Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2735329Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2735502Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2735874Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2736237Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2736566Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2736847Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2737279Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2737549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2737850Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2737980Z Execution Analysis: (:1) 2025-03-14T06:00:23.2738251Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2738452Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2738456Z 2025-03-14T06:00:23.2738671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2738788Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2739029Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2739143Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2739462Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2739600Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2739779Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2739944Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2740507Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2741039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2741389Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2741741Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2742046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2742306Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2742610Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2742866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2742980Z Execution Analysis: .......... 2025-03-14T06:00:23.2743224Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2743430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2743700Z pt-xla-profiler: TransferFromDeviceTime too frequent: 699 counts during 666 steps 2025-03-14T06:00:23.2743706Z 2025-03-14T06:00:23.2743911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2744019Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2744298Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2744404Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2744656Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2744793Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2744940Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2745098Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2745440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2745767Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2746070Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2746326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2746623Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2746876Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2747163Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2747281Z Execution Analysis: (:1) 2025-03-14T06:00:23.2747533Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2747721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2747724Z 2025-03-14T06:00:23.2747922Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2748032Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2748261Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2748367Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2748594Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2748731Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2748887Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2749045Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2749606Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2750140Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2750486Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2750840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2751147Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2751412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2751703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2751965Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2752066Z Execution Analysis: .......... 2025-03-14T06:00:23.2752317Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2752507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2752786Z pt-xla-profiler: TransferFromDeviceTime too frequent: 700 counts during 667 steps 2025-03-14T06:00:23.2752791Z 2025-03-14T06:00:23.2752979Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2753100Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2753372Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2753535Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2753728Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2753873Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2754007Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2754179Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2754513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2754849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2755142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2755407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2755698Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2755964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2756237Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2756367Z Execution Analysis: (:1) 2025-03-14T06:00:23.2756616Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2756816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2756820Z 2025-03-14T06:00:23.2757009Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2757129Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2757343Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2757483Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2757677Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2757827Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2757965Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2758135Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2758682Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2759225Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2759584Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2759924Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2760217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2760488Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2760775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2761038Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2761141Z Execution Analysis: .......... 2025-03-14T06:00:23.2761392Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2761582Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2761865Z pt-xla-profiler: TransferFromDeviceTime too frequent: 701 counts during 668 steps 2025-03-14T06:00:23.2761871Z 2025-03-14T06:00:23.2762063Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2762184Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2762506Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2762622Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2762813Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2762961Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2763095Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2763263Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2763597Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2763936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2764227Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2764573Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2764867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2765489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2765788Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2765929Z Execution Analysis: (:1) 2025-03-14T06:00:23.2766195Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2766412Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2766420Z 2025-03-14T06:00:23.2766621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2766751Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2767061Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2767194Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2767403Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2767561Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2767711Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2767895Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2768488Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2769077Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2769491Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2769850Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2770181Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2770459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2770783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2771056Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2771177Z Execution Analysis: .......... 2025-03-14T06:00:23.2771440Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2771662Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2771951Z pt-xla-profiler: TransferFromDeviceTime too frequent: 702 counts during 669 steps 2025-03-14T06:00:23.2771956Z 2025-03-14T06:00:23.2772175Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2772379Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2772686Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2772801Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2773020Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2773168Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2773326Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2773496Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2773874Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2774227Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2774556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2774840Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2775167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2775443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2775753Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2775883Z Execution Analysis: (:1) 2025-03-14T06:00:23.2776156Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2776363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2776367Z 2025-03-14T06:00:23.2776583Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2776727Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2776977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2777093Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2777421Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2777559Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2777710Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2777870Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2778436Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2778993Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2779344Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2779675Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2779984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2780243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2780543Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2780796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2780912Z Execution Analysis: .......... 2025-03-14T06:00:23.2781157Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2781362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2781635Z pt-xla-profiler: TransferFromDeviceTime too frequent: 703 counts during 670 steps 2025-03-14T06:00:23.2781640Z 2025-03-14T06:00:23.2781892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2782003Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2782286Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2782391Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2782597Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2782734Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2782883Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2783044Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2783391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2783718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2784023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2784283Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2784589Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2784842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2785130Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2785250Z Execution Analysis: (:1) 2025-03-14T06:00:23.2785503Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2785693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2785704Z 2025-03-14T06:00:23.2785919Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2786041Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2786258Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2786374Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2786564Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2786709Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2786846Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2787005Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2787563Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2788134Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2788469Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2788808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2789098Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2789365Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2789652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2789915Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2790018Z Execution Analysis: .......... 2025-03-14T06:00:23.2790268Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2790458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2790734Z pt-xla-profiler: TransferFromDeviceTime too frequent: 704 counts during 671 steps 2025-03-14T06:00:23.2790785Z 2025-03-14T06:00:23.2790976Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2791098Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2791372Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2791488Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2791680Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2791828Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2791967Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2792305Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2792656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2793014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2793491Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2793777Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2794085Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2794367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2794661Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2794801Z Execution Analysis: (:1) 2025-03-14T06:00:23.2795062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2795301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2795306Z 2025-03-14T06:00:23.2795514Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2795639Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2795872Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2795996Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2796202Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2796359Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2796507Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2796690Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2797312Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2797903Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2798270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2798639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2798954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2799243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2799554Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2799837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2799945Z Execution Analysis: .......... 2025-03-14T06:00:23.2800214Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2800419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2800779Z pt-xla-profiler: TransferFromDeviceTime too frequent: 705 counts during 672 steps 2025-03-14T06:00:23.2800785Z 2025-03-14T06:00:23.2800990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2801123Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2801415Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2801542Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2801750Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2801909Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2802056Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2802238Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2802599Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2802967Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2803282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2803574Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2803897Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2804170Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2804558Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2804698Z Execution Analysis: (:1) 2025-03-14T06:00:23.2804971Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2805207Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2805214Z 2025-03-14T06:00:23.2805433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2805584Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2805831Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2805945Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2806164Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2806310Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2806501Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2806671Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2807277Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2807857Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2808233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2808587Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2808913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2809190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2809511Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2809779Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2809901Z Execution Analysis: .......... 2025-03-14T06:00:23.2810162Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2810429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2810718Z pt-xla-profiler: TransferFromDeviceTime too frequent: 706 counts during 673 steps 2025-03-14T06:00:23.2810722Z 2025-03-14T06:00:23.2810940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2811057Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2811363Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2811479Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2811696Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2811846Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2812004Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2812179Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2812551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2812904Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2813230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2813507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2813830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2814106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2814414Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2814543Z Execution Analysis: (:1) 2025-03-14T06:00:23.2814838Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2815046Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2815050Z 2025-03-14T06:00:23.2815263Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2815380Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2815623Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2815738Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2815953Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2816131Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2816292Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2816465Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2817176Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2817712Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2818058Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2818387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2818688Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2818955Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2819253Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2819506Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2819623Z Execution Analysis: .......... 2025-03-14T06:00:23.2819919Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2820119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2820400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 707 counts during 674 steps 2025-03-14T06:00:23.2820405Z 2025-03-14T06:00:23.2820596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2820717Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2820988Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2821108Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2821302Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2821454Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2821592Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2821769Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2822108Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2822450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2822743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2823014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2823303Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2823576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2823852Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2824007Z Execution Analysis: (:1) 2025-03-14T06:00:23.2824254Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2824458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2824462Z 2025-03-14T06:00:23.2824653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2824777Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2824994Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2825115Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2825333Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2825483Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2825623Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2825796Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2826353Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2826898Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2827237Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2827579Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2827870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2828142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2828430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2828700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2829101Z Execution Analysis: .......... 2025-03-14T06:00:23.2829386Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2829576Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2829855Z pt-xla-profiler: TransferFromDeviceTime too frequent: 708 counts during 675 steps 2025-03-14T06:00:23.2829859Z 2025-03-14T06:00:23.2830048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2830170Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2830440Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2830558Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2830749Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2830900Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2831036Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2831207Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2831539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2831882Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2832177Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2832443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2832734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2832994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2833337Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2833471Z Execution Analysis: (:1) 2025-03-14T06:00:23.2833714Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2833914Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2833918Z 2025-03-14T06:00:23.2834107Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2834227Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2834444Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2834590Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2834783Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2834931Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2835073Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2835247Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2835800Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2836342Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2836675Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2837014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2837321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2837577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2837877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2838188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2838302Z Execution Analysis: .......... 2025-03-14T06:00:23.2838544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2838747Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2839013Z pt-xla-profiler: TransferFromDeviceTime too frequent: 709 counts during 676 steps 2025-03-14T06:00:23.2839017Z 2025-03-14T06:00:23.2839217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2839327Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2839610Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2839716Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2839922Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2840062Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2840209Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2840367Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2840711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2841040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2841342Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2841600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2841900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2842177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2842461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2842583Z Execution Analysis: (:1) 2025-03-14T06:00:23.2842835Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2843024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2843028Z 2025-03-14T06:00:23.2843227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2843337Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2843601Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2843707Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2843911Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2844048Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2844199Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2844361Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2845183Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2845843Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2846219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2846575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2846903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2847182Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2847538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2847833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2847954Z Execution Analysis: .......... 2025-03-14T06:00:23.2848214Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2848431Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2848720Z pt-xla-profiler: TransferFromDeviceTime too frequent: 710 counts during 677 steps 2025-03-14T06:00:23.2848726Z 2025-03-14T06:00:23.2848945Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2849063Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2849369Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2849483Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2849703Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2849850Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2850010Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2850182Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2850552Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2850905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2851233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2851507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2851850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2852121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2852430Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2852559Z Execution Analysis: (:1) 2025-03-14T06:00:23.2852829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2853032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2853049Z 2025-03-14T06:00:23.2853252Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2853406Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2853637Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2853749Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2853969Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2854116Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2854279Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2854450Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2855055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2855650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2856015Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2856386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2856703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2856996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2857452Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2857719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2857820Z Execution Analysis: .......... 2025-03-14T06:00:23.2858069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2858258Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2858529Z pt-xla-profiler: TransferFromDeviceTime too frequent: 711 counts during 678 steps 2025-03-14T06:00:23.2862768Z 2025-03-14T06:00:23.2863021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2863146Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2863439Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2863557Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2863758Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2863909Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2864048Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2864220Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2864570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2864920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2865230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2865855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2866264Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2866548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2866841Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2866971Z Execution Analysis: (:1) 2025-03-14T06:00:23.2867231Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2867439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2867484Z 2025-03-14T06:00:23.2867683Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2867806Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2868036Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2868154Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2868358Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2868512Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2868656Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2868830Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2869430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2870012Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2870370Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2870732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2871045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2871433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2871741Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2872019Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2872121Z Execution Analysis: .......... 2025-03-14T06:00:23.2872389Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2872587Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2872885Z pt-xla-profiler: TransferFromDeviceTime too frequent: 712 counts during 679 steps 2025-03-14T06:00:23.2872890Z 2025-03-14T06:00:23.2873094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2873218Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2873508Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2873623Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2873824Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2873971Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2874110Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2874284Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2874640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2874999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2875308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2875620Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2875931Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2876207Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2876495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2876624Z Execution Analysis: (:1) 2025-03-14T06:00:23.2876879Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2877088Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2877132Z 2025-03-14T06:00:23.2877330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2877454Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2877682Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2877801Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2878110Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2878244Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2878375Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2878533Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2879076Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2879612Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2879943Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2880276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2880613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2880867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2881154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2881400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2881502Z Execution Analysis: .......... 2025-03-14T06:00:23.2881737Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2881928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2882191Z pt-xla-profiler: TransferFromDeviceTime too frequent: 713 counts during 680 steps 2025-03-14T06:00:23.2882196Z 2025-03-14T06:00:23.2882387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2882493Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2882764Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2882864Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2883057Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2883188Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2883322Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2883474Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2883809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2884131Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2884445Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2884791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2885266Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2885532Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2885833Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2885955Z Execution Analysis: (:1) 2025-03-14T06:00:23.2886223Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2886453Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2886458Z 2025-03-14T06:00:23.2886668Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2886784Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2887030Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2887138Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2887349Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2887489Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2887643Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2887808Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2888408Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2888983Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2889352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2889754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2890073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2890343Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2890655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2890921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2891032Z Execution Analysis: .......... 2025-03-14T06:00:23.2891289Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2891492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2891777Z pt-xla-profiler: TransferFromDeviceTime too frequent: 714 counts during 681 steps 2025-03-14T06:00:23.2891783Z 2025-03-14T06:00:23.2891989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2892099Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2892394Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2892506Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2892720Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2892865Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2893010Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2893177Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2893541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2893914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2894241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2894514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2894828Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2895096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2895394Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2895515Z Execution Analysis: (:1) 2025-03-14T06:00:23.2895803Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2896000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2896014Z 2025-03-14T06:00:23.2896213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2896329Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2896566Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2896672Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2896876Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2897014Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2897269Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2897428Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2898005Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2898568Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2898915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2899309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2899611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2899885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2900181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2900446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2900548Z Execution Analysis: .......... 2025-03-14T06:00:23.2900801Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2900998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2901282Z pt-xla-profiler: TransferFromDeviceTime too frequent: 715 counts during 682 steps 2025-03-14T06:00:23.2901287Z 2025-03-14T06:00:23.2901478Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2901593Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2901872Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2901982Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2902178Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2902322Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2902465Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2902643Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2902995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2903378Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2903689Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2903972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2904275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2904554Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2904841Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2905000Z Execution Analysis: (:1) 2025-03-14T06:00:23.2905255Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2905469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2905474Z 2025-03-14T06:00:23.2905677Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2905805Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2906034Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2906161Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2906362Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2906519Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2906669Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2906852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2907525Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2908072Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2908455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2908797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2909090Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2909364Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2909653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2909924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2910027Z Execution Analysis: .......... 2025-03-14T06:00:23.2910288Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2910482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2910767Z pt-xla-profiler: TransferFromDeviceTime too frequent: 717 counts during 683 steps 2025-03-14T06:00:23.2910771Z 2025-03-14T06:00:23.2910962Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2911088Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2911360Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2911482Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2911677Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2911831Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2911967Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2912142Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2912513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2912864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2913156Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2913426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2913715Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2913984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2914283Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2914420Z Execution Analysis: (:1) 2025-03-14T06:00:23.2914664Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2914874Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2914882Z 2025-03-14T06:00:23.2915085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2915195Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2915425Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2915534Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2915739Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2915874Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2916027Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2916184Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2916747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2917301Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2917674Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2918002Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2918305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2918561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2918861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2919110Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2919221Z Execution Analysis: .......... 2025-03-14T06:00:23.2919464Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2919669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2919936Z pt-xla-profiler: TransferFromDeviceTime too frequent: 718 counts during 684 steps 2025-03-14T06:00:23.2919940Z 2025-03-14T06:00:23.2920142Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2920250Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2920534Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2920641Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2920844Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2920981Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2921130Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2921311Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2921664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2921993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2922301Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2922558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2922857Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2923132Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2923415Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2923534Z Execution Analysis: (:1) 2025-03-14T06:00:23.2923791Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2923985Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2923989Z 2025-03-14T06:00:23.2924191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2924300Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2924609Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2924717Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2925091Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2925242Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2925407Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2925580Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2926195Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2926829Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2927206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2927560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2927889Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2928168Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2928493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2928768Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2928890Z Execution Analysis: .......... 2025-03-14T06:00:23.2929158Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2929377Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2929667Z pt-xla-profiler: TransferFromDeviceTime too frequent: 719 counts during 685 steps 2025-03-14T06:00:23.2929683Z 2025-03-14T06:00:23.2929887Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2930017Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2930312Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2930439Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2930645Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2930792Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2930975Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2931151Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2931525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2931879Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2932207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2932495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2932806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2933116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2933411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2933554Z Execution Analysis: (:1) 2025-03-14T06:00:23.2933820Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2934038Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2934043Z 2025-03-14T06:00:23.2934246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2934375Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2934608Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2934734Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2934944Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2935103Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2935253Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2935438Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2936056Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2936670Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2937122Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2937461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2937753Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2938024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2938311Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2938576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2938679Z Execution Analysis: .......... 2025-03-14T06:00:23.2938932Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2939122Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2939402Z pt-xla-profiler: TransferFromDeviceTime too frequent: 720 counts during 686 steps 2025-03-14T06:00:23.2939407Z 2025-03-14T06:00:23.2939596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2939721Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2939994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2940111Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2940326Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2940476Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2940613Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2940784Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2941117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2941458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2941749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2942021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2942337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2942602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2942877Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2943019Z Execution Analysis: (:1) 2025-03-14T06:00:23.2943262Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2943464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2943468Z 2025-03-14T06:00:23.2943656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2943782Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2943999Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2944121Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2944313Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2944458Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2944598Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2944768Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2945376Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2945923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2946258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2946598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2946893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2947164Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2947454Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2947719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2947821Z Execution Analysis: .......... 2025-03-14T06:00:23.2948067Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2948262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2948524Z pt-xla-profiler: TransferFromDeviceTime too frequent: 721 counts during 687 steps 2025-03-14T06:00:23.2948529Z 2025-03-14T06:00:23.2948724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2948833Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2949108Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2949237Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2949430Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2949570Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2949706Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2949864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2950199Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2950521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2950814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2951088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2951376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2951628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2951909Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2952026Z Execution Analysis: (:1) 2025-03-14T06:00:23.2952268Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2952456Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2952460Z 2025-03-14T06:00:23.2952657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2952765Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2952985Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2953086Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2953278Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2953414Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2953577Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2953758Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2954305Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2954839Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2955180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2955507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2955800Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2956058Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2956353Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2956601Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2956705Z Execution Analysis: .......... 2025-03-14T06:00:23.2956943Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2957135Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2957402Z pt-xla-profiler: TransferFromDeviceTime too frequent: 722 counts during 688 steps 2025-03-14T06:00:23.2957409Z 2025-03-14T06:00:23.2957604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2957708Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2958008Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2958112Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2958313Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2958443Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2958583Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2958737Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2959073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2959397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2959715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2959969Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2960260Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2960507Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2960785Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2960900Z Execution Analysis: (:1) 2025-03-14T06:00:23.2961143Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2961327Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2961330Z 2025-03-14T06:00:23.2961522Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2961627Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2961846Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2961948Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2962143Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2962299Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2962465Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2962619Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2963169Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2963694Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2964031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2964358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2964721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2965153Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2965624Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2965901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2966006Z Execution Analysis: .......... 2025-03-14T06:00:23.2966269Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2966474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2966768Z pt-xla-profiler: TransferFromDeviceTime too frequent: 723 counts during 689 steps 2025-03-14T06:00:23.2966773Z 2025-03-14T06:00:23.2966973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2967161Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2967454Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2967576Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2967779Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2967931Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2968075Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2968253Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2968612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2969012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2969323Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2969607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2969915Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2970195Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2970485Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2970621Z Execution Analysis: (:1) 2025-03-14T06:00:23.2970881Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2971093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2971099Z 2025-03-14T06:00:23.2971298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2971420Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2971651Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2971773Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2972046Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2972198Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2972345Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2972520Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2973112Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2973691Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2974053Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2974415Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2974726Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2975016Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2975325Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2975602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2975710Z Execution Analysis: .......... 2025-03-14T06:00:23.2975974Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2976177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2976470Z pt-xla-profiler: TransferFromDeviceTime too frequent: 724 counts during 690 steps 2025-03-14T06:00:23.2976476Z 2025-03-14T06:00:23.2976704Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2976832Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2977122Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2977242Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2977446Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2977698Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2977829Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2977992Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2978324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2978679Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2978963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2979221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2979505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2979760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2980029Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2980150Z Execution Analysis: (:1) 2025-03-14T06:00:23.2980387Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2980581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2980585Z 2025-03-14T06:00:23.2980778Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2980885Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2981100Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2981310Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2981495Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2981635Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2981767Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2981928Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2982469Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2983008Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2983345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2983669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2983967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2984220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2984510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2984758Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2984863Z Execution Analysis: .......... 2025-03-14T06:00:23.2985101Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2985296Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2985559Z pt-xla-profiler: TransferFromDeviceTime too frequent: 725 counts during 691 steps 2025-03-14T06:00:23.2985587Z 2025-03-14T06:00:23.2985777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2985887Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2986158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2986259Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2986449Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2986587Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2986725Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2986879Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2987238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2987566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2987861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2988115Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2988406Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2988653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2988932Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2989048Z Execution Analysis: (:1) 2025-03-14T06:00:23.2989291Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2989477Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2989481Z 2025-03-14T06:00:23.2989679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2989784Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2990048Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2990149Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2990346Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2990481Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2990625Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.2990781Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2991337Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.2991868Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.2992206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.2992535Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2992833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2993085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2993380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2993628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2993736Z Execution Analysis: .......... 2025-03-14T06:00:23.2993975Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2994175Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2994458Z pt-xla-profiler: TransferFromDeviceTime too frequent: 726 counts during 692 steps 2025-03-14T06:00:23.2994467Z 2025-03-14T06:00:23.2994664Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2994771Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2995055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.2995155Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2995355Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.2995487Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.2995660Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.2995979Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.2996336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.2996674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.2996986Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.2997251Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.2997557Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.2997816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.2998107Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.2998231Z Execution Analysis: (:1) 2025-03-14T06:00:23.2998483Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.2998685Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2998689Z 2025-03-14T06:00:23.2998885Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.2999047Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.2999273Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.2999384Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.2999582Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.2999726Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.2999866Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3000034Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3000612Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3001170Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3001522Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3001869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3002172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3002443Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3002743Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3003013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3003119Z Execution Analysis: .......... 2025-03-14T06:00:23.3003376Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3003595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3003880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 727 counts during 693 steps 2025-03-14T06:00:23.3003884Z 2025-03-14T06:00:23.3004080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3004200Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3004593Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3004711Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3005074Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3005257Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3005398Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3005572Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3005933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3006291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3006606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3006886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3007193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3007468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3007758Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3007894Z Execution Analysis: (:1) 2025-03-14T06:00:23.3008149Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3008354Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3008383Z 2025-03-14T06:00:23.3008607Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3008727Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3008957Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3009072Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3009279Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3009430Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3009577Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3009754Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3010345Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3010927Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3011290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3011654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3011964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3012242Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3012550Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3012830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3012933Z Execution Analysis: .......... 2025-03-14T06:00:23.3013225Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3013433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3013727Z pt-xla-profiler: TransferFromDeviceTime too frequent: 728 counts during 694 steps 2025-03-14T06:00:23.3013732Z 2025-03-14T06:00:23.3013941Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3014055Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3014348Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3014459Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3014706Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3014847Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3014993Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3015159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3015515Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3015875Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3016191Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3016463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3016885Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3017145Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3017437Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3017667Z Execution Analysis: (:1) 2025-03-14T06:00:23.3017912Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3018103Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3018158Z 2025-03-14T06:00:23.3018350Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3018457Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3018674Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3018774Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3018967Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3019098Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3019242Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3019400Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3019949Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3020480Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3020824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3021149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3021443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3021694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3021984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3022230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3022332Z Execution Analysis: .......... 2025-03-14T06:00:23.3022592Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3022788Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3023052Z pt-xla-profiler: TransferFromDeviceTime too frequent: 729 counts during 695 steps 2025-03-14T06:00:23.3023056Z 2025-03-14T06:00:23.3023253Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3023357Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3023631Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3023761Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3023957Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3024088Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3024225Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3024382Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3024722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3025044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3025344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3025599Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3025890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3026138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3026415Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3026531Z Execution Analysis: (:1) 2025-03-14T06:00:23.3026776Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3027007Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3027011Z 2025-03-14T06:00:23.3027203Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3027306Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3027520Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3027623Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3027813Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3027948Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3028092Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3028247Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3028798Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3029329Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3029671Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3029993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3030296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3030560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3030845Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3031131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3031232Z Execution Analysis: .......... 2025-03-14T06:00:23.3031483Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3031671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3031944Z pt-xla-profiler: TransferFromDeviceTime too frequent: 730 counts during 696 steps 2025-03-14T06:00:23.3031949Z 2025-03-14T06:00:23.3032137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3032251Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3032547Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3032659Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3032848Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3032992Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3033126Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3033295Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3033625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3033958Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3034248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3034509Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3034800Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3035060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3035334Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3035462Z Execution Analysis: (:1) 2025-03-14T06:00:23.3035748Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3035943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3035947Z 2025-03-14T06:00:23.3036134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3036251Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3036466Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3036578Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3036768Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3036914Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3037053Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3037219Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3037770Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3038309Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3038643Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3038974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3039263Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3039523Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3039833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3040089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3040191Z Execution Analysis: .......... 2025-03-14T06:00:23.3040438Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3040625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3040898Z pt-xla-profiler: TransferFromDeviceTime too frequent: 731 counts during 697 steps 2025-03-14T06:00:23.3040902Z 2025-03-14T06:00:23.3041088Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3041218Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3041485Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3041597Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3041785Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3041924Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3042058Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3042218Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3042548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3042877Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3043164Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3043425Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3043709Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3043963Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3044237Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3044403Z Execution Analysis: (:1) 2025-03-14T06:00:23.3044738Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3045103Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3045108Z 2025-03-14T06:00:23.3045307Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3045430Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3045664Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3045786Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3045990Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3046143Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3046293Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3046472Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3047062Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3047643Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3048009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3048360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3048680Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3048953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3049308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3049583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3049694Z Execution Analysis: .......... 2025-03-14T06:00:23.3049951Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3050160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3050446Z pt-xla-profiler: TransferFromDeviceTime too frequent: 732 counts during 698 steps 2025-03-14T06:00:23.3050452Z 2025-03-14T06:00:23.3050693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3050809Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3051115Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3051227Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3051442Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3051593Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3051746Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3051915Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3052278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3052630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3052949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3053224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3053538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3053807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3054157Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3054283Z Execution Analysis: (:1) 2025-03-14T06:00:23.3054547Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3054749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3054753Z 2025-03-14T06:00:23.3054959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3055078Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3055317Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3055426Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3055637Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3055782Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3055939Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3056108Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3056706Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3057374Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3057713Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3058039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3058332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3058609Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3058904Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3059152Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3059263Z Execution Analysis: .......... 2025-03-14T06:00:23.3059500Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3059693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3059957Z pt-xla-profiler: TransferFromDeviceTime too frequent: 733 counts during 699 steps 2025-03-14T06:00:23.3059984Z 2025-03-14T06:00:23.3060180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3060287Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3060561Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3060663Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3060861Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3060994Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3061130Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3061284Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3061622Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3061946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3062248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3062504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3062796Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3063095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3063376Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3063491Z Execution Analysis: (:1) 2025-03-14T06:00:23.3063733Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3063923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3063934Z 2025-03-14T06:00:23.3064128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3064242Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3064455Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3064572Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3064763Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3064904Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3065038Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3065196Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3066054Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3066642Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3067004Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3067366Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3067739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3068028Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3068337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3068611Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3068720Z Execution Analysis: .......... 2025-03-14T06:00:23.3068983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3069188Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3069674Z pt-xla-profiler: TransferFromDeviceTime too frequent: 734 counts during 700 steps 2025-03-14T06:00:23.3069679Z 2025-03-14T06:00:23.3069881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3070002Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3070292Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3070412Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3070617Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3070769Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3070911Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3071090Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3071447Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3071808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3072121Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3072403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3072745Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3073055Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3073348Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3073483Z Execution Analysis: (:1) 2025-03-14T06:00:23.3073743Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3073951Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3073958Z 2025-03-14T06:00:23.3074157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3074282Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3074518Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3074637Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3074848Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3074998Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3075150Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3075326Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3075919Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3076498Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3076859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3077242Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3077557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3077848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3078259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3078515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3078614Z Execution Analysis: .......... 2025-03-14T06:00:23.3078864Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3079077Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3079348Z pt-xla-profiler: TransferFromDeviceTime too frequent: 735 counts during 701 steps 2025-03-14T06:00:23.3079352Z 2025-03-14T06:00:23.3079543Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3079659Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3079928Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3080039Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3080230Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3080373Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3080508Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3080675Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3081009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3081343Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3081638Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3081901Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3082248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3082499Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3082778Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3082893Z Execution Analysis: (:1) 2025-03-14T06:00:23.3083138Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3083326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3083330Z 2025-03-14T06:00:23.3083518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3083624Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3083846Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3083952Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3084147Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3084280Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3084424Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3084643Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3085384Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3085960Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3086324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3086703Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3087025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3087300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3087613Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3087881Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3087993Z Execution Analysis: .......... 2025-03-14T06:00:23.3088280Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3088487Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3088773Z pt-xla-profiler: TransferFromDeviceTime too frequent: 736 counts during 702 steps 2025-03-14T06:00:23.3088778Z 2025-03-14T06:00:23.3088988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3089108Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3089404Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3089515Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3089724Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3089866Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3090013Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3090182Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3090544Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3090892Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3091212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3091533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3091850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3092118Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3092415Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3092540Z Execution Analysis: (:1) 2025-03-14T06:00:23.3092799Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3093005Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3093010Z 2025-03-14T06:00:23.3093222Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3093337Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3093575Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3093683Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3093895Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3094036Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3094190Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3094355Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3094953Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3095531Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3095923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3096280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3096600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3096871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3097296Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3097556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3097697Z Execution Analysis: .......... 2025-03-14T06:00:23.3097944Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3098148Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3098435Z pt-xla-profiler: TransferFromDeviceTime too frequent: 738 counts during 703 steps 2025-03-14T06:00:23.3098441Z 2025-03-14T06:00:23.3098635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3098760Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3099040Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3099157Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3099356Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3099503Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3099644Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3099817Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3100163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3100513Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3100866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3101142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3101441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3101709Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3101994Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3102126Z Execution Analysis: (:1) 2025-03-14T06:00:23.3102376Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3102582Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3102588Z 2025-03-14T06:00:23.3102782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3102906Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3103126Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3103245Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3103445Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3103595Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3103736Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3103907Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3104477Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3105072Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3105427Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3105777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3106079Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3106356Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3106652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3106954Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3107056Z Execution Analysis: .......... 2025-03-14T06:00:23.3107415Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3107603Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3107878Z pt-xla-profiler: TransferFromDeviceTime too frequent: 739 counts during 704 steps 2025-03-14T06:00:23.3107883Z 2025-03-14T06:00:23.3108068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3108181Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3108450Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3108559Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3108745Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3108888Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3109021Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3109186Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3109513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3109894Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3110185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3110447Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3110731Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3110988Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3111256Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3111381Z Execution Analysis: (:1) 2025-03-14T06:00:23.3111620Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3111821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3111827Z 2025-03-14T06:00:23.3112013Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3112124Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3112338Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3112450Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3112637Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3112777Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3112910Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3113072Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3113616Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3114187Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3114526Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3114860Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3115161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3115413Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3115709Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3115985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3116094Z Execution Analysis: .......... 2025-03-14T06:00:23.3116333Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3116535Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3116802Z pt-xla-profiler: TransferFromDeviceTime too frequent: 740 counts during 705 steps 2025-03-14T06:00:23.3116806Z 2025-03-14T06:00:23.3117005Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3117114Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3117397Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3117503Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3117707Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3117842Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3117988Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3118147Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3118492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3118873Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3119177Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3119434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3119730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3119981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3120262Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3120378Z Execution Analysis: (:1) 2025-03-14T06:00:23.3120635Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3120826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3120830Z 2025-03-14T06:00:23.3121027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3121133Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3121358Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3121464Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3121670Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3121804Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3121957Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3122112Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3122859Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3123427Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3123785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3124124Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3124437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3124776Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3125286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3125556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3125674Z Execution Analysis: .......... 2025-03-14T06:00:23.3125932Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3126149Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3126432Z pt-xla-profiler: TransferFromDeviceTime too frequent: 741 counts during 706 steps 2025-03-14T06:00:23.3126437Z 2025-03-14T06:00:23.3126645Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3126758Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3127057Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3127171Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3127383Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3127526Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3127678Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3127850Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3128331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3128683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3129005Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3129277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3129594Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3129864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3130172Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3130297Z Execution Analysis: (:1) 2025-03-14T06:00:23.3130567Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3130774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3130788Z 2025-03-14T06:00:23.3130989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3131114Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3131344Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3131457Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3131674Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3131817Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3131972Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3132141Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3132777Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3133366Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3133725Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3134085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3134397Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3134709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3135018Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3135301Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3135411Z Execution Analysis: .......... 2025-03-14T06:00:23.3135687Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3135892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3136194Z pt-xla-profiler: TransferFromDeviceTime too frequent: 742 counts during 707 steps 2025-03-14T06:00:23.3136199Z 2025-03-14T06:00:23.3136403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3136532Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3136822Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3136946Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3137149Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3137307Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3137451Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3137679Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3138037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3138399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3138711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3138997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3139308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3139588Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3139880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3140014Z Execution Analysis: (:1) 2025-03-14T06:00:23.3140280Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3140493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3140498Z 2025-03-14T06:00:23.3140696Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3140820Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3141052Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3141174Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3141379Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3141529Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3141675Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3141874Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3142466Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3143049Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3143408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3143770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3144118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3144406Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3144716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3144992Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3145105Z Execution Analysis: .......... 2025-03-14T06:00:23.3145372Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3145789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3146061Z pt-xla-profiler: TransferFromDeviceTime too frequent: 743 counts during 708 steps 2025-03-14T06:00:23.3146066Z 2025-03-14T06:00:23.3146254Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3146373Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3146642Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3146753Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3146946Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3147110Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3147264Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3147432Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3147761Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3148098Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3148388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3148653Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3148939Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3149197Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3149471Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3149600Z Execution Analysis: (:1) 2025-03-14T06:00:23.3149838Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3150037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3150041Z 2025-03-14T06:00:23.3150240Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3150346Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3150574Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3150677Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3150880Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3151013Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3151183Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3151344Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3151900Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3152429Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3152770Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3153129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3153426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3153678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3153976Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3154229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3154337Z Execution Analysis: .......... 2025-03-14T06:00:23.3154576Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3154772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3155036Z pt-xla-profiler: TransferFromDeviceTime too frequent: 744 counts during 709 steps 2025-03-14T06:00:23.3155042Z 2025-03-14T06:00:23.3155238Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3155344Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3155622Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3155726Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3155951Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3156106Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3156248Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3156404Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3156744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3157071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3157370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3157624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3157918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3158170Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3158453Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3158571Z Execution Analysis: (:1) 2025-03-14T06:00:23.3158823Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3159012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3159016Z 2025-03-14T06:00:23.3159220Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3159329Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3159556Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3159661Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3159885Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3160021Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3160171Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3160328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3160887Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3161419Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3161763Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3162116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3162417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3162672Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3162970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3163223Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3163335Z Execution Analysis: .......... 2025-03-14T06:00:23.3163572Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3163775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3164039Z pt-xla-profiler: TransferFromDeviceTime too frequent: 745 counts during 710 steps 2025-03-14T06:00:23.3164056Z 2025-03-14T06:00:23.3164243Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3164362Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3164713Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3164859Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3165258Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3165643Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3165826Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3166044Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3166445Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3166803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3167117Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3167403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3167711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3167995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3168285Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3168422Z Execution Analysis: (:1) 2025-03-14T06:00:23.3168681Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3168891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3168896Z 2025-03-14T06:00:23.3169098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3169223Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3169452Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3169638Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3169847Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3170007Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3170154Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3170336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3170928Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3171510Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3171907Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3172267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3172584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3172871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3173179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3173458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3173566Z Execution Analysis: .......... 2025-03-14T06:00:23.3173829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3174030Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3174322Z pt-xla-profiler: TransferFromDeviceTime too frequent: 746 counts during 711 steps 2025-03-14T06:00:23.3174327Z 2025-03-14T06:00:23.3174528Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3174654Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3175009Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3175132Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3175335Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3175486Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3175632Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3175808Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3176163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3176524Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3176833Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3177117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3177426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3177703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3178259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3178386Z Execution Analysis: (:1) 2025-03-14T06:00:23.3178627Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3178824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3178830Z 2025-03-14T06:00:23.3179018Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3179134Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3179375Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3179487Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3179678Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3179820Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3179956Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3180120Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3180668Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3181209Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3181567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3181905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3182199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3182460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3182745Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3183001Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3183115Z Execution Analysis: .......... 2025-03-14T06:00:23.3183353Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3183552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3183817Z pt-xla-profiler: TransferFromDeviceTime too frequent: 747 counts during 712 steps 2025-03-14T06:00:23.3183822Z 2025-03-14T06:00:23.3184024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3184177Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3184455Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3184559Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3184758Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3184889Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3185040Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3185193Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3185536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3185861Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3186163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3186415Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3186709Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3186956Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3187235Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3187351Z Execution Analysis: (:1) 2025-03-14T06:00:23.3187598Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3187789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3187793Z 2025-03-14T06:00:23.3187990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3188131Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3188352Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3188458Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3188660Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3188792Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3188937Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3189092Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3189648Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3190199Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3190546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3190869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3191171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3191420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3191714Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3191964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3192071Z Execution Analysis: .......... 2025-03-14T06:00:23.3192311Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3192508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3192774Z pt-xla-profiler: TransferFromDeviceTime too frequent: 748 counts during 713 steps 2025-03-14T06:00:23.3192779Z 2025-03-14T06:00:23.3193021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3193130Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3193409Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3193511Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3193708Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3193846Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3193984Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3194142Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3194482Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3194805Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3195111Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3195369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3195659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3196081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3196370Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3196492Z Execution Analysis: (:1) 2025-03-14T06:00:23.3196752Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3196949Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3196953Z 2025-03-14T06:00:23.3197181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3197293Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3197529Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3197637Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3197848Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3197998Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3198153Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3198318Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3198906Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3199491Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3199856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3200217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3200522Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3200806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3201107Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3201385Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3201498Z Execution Analysis: .......... 2025-03-14T06:00:23.3201766Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3201967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3202262Z pt-xla-profiler: TransferFromDeviceTime too frequent: 749 counts during 714 steps 2025-03-14T06:00:23.3202291Z 2025-03-14T06:00:23.3202515Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3202645Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3202932Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3203054Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3203255Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3203413Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3203558Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3203736Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3204086Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3204448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3204853Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3205308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3205620Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3205902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3206198Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3206340Z Execution Analysis: (:1) 2025-03-14T06:00:23.3206602Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3206819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3206853Z 2025-03-14T06:00:23.3207061Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3207194Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3207430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3207552Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3207761Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3207919Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3208072Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3208253Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3208866Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3209457Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3209821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3210183Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3210497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3210783Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3211091Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3211373Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3211481Z Execution Analysis: .......... 2025-03-14T06:00:23.3211750Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3211955Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3212302Z pt-xla-profiler: TransferFromDeviceTime too frequent: 750 counts during 715 steps 2025-03-14T06:00:23.3212307Z 2025-03-14T06:00:23.3212508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3212633Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3212922Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3213045Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3213250Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3213408Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3213551Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3213733Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3214092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3214454Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3214770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3215059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3215369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3215653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3215948Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3216086Z Execution Analysis: (:1) 2025-03-14T06:00:23.3216344Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3216583Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3216589Z 2025-03-14T06:00:23.3216805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3216923Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3217268Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3217372Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3217571Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3217707Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3217870Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3218037Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3218586Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3219134Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3219481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3219806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3220109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3220363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3220665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3220914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3221027Z Execution Analysis: .......... 2025-03-14T06:00:23.3221268Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3221526Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3221794Z pt-xla-profiler: TransferFromDeviceTime too frequent: 751 counts during 716 steps 2025-03-14T06:00:23.3221799Z 2025-03-14T06:00:23.3222000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3222106Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3222389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3222495Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3222697Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3222833Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3222979Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3223143Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3223490Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3223817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3224119Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3224373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3224670Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3224920Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3225205Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3225323Z Execution Analysis: (:1) 2025-03-14T06:00:23.3225593Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3225786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3225789Z 2025-03-14T06:00:23.3225988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3226097Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3226321Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3226425Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3226627Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3226790Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3226937Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3227093Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3227652Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3228369Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3228731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3229074Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3229390Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3229659Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3229971Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3230234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3230352Z Execution Analysis: .......... 2025-03-14T06:00:23.3230628Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3230862Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3231140Z pt-xla-profiler: TransferFromDeviceTime too frequent: 752 counts during 717 steps 2025-03-14T06:00:23.3231145Z 2025-03-14T06:00:23.3231353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3231466Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3231761Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3231874Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3232086Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3232229Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3232382Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3232560Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3232922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3233264Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3233586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3233856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3234168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3234446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3234731Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3234890Z Execution Analysis: (:1) 2025-03-14T06:00:23.3235146Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3235357Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3235361Z 2025-03-14T06:00:23.3235557Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3235683Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3235908Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3236027Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3236249Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3236405Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3236550Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3236726Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3237305Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3237876Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3238227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3242093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3242426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3242699Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3242985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3243241Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3243395Z Execution Analysis: .......... 2025-03-14T06:00:23.3243677Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3243863Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3244132Z pt-xla-profiler: TransferFromDeviceTime too frequent: 753 counts during 718 steps 2025-03-14T06:00:23.3244138Z 2025-03-14T06:00:23.3244326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3244438Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3244807Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3245082Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3245284Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3245437Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3245578Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3245752Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3246112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3246471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3246781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3247058Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3247365Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3247638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3247961Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3248096Z Execution Analysis: (:1) 2025-03-14T06:00:23.3248357Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3248561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3248566Z 2025-03-14T06:00:23.3248764Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3248881Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3249110Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3249254Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3249457Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3249604Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3249747Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3249924Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3250525Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3251108Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3251465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3251821Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3252132Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3252413Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3252719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3253045Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3253148Z Execution Analysis: .......... 2025-03-14T06:00:23.3253416Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3253613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3253908Z pt-xla-profiler: TransferFromDeviceTime too frequent: 754 counts during 719 steps 2025-03-14T06:00:23.3253914Z 2025-03-14T06:00:23.3254114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3254238Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3254525Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3254642Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3254844Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3254996Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3255134Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3255308Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3255661Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3256015Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3256323Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3256603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3256907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3257312Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3257579Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3257702Z Execution Analysis: (:1) 2025-03-14T06:00:23.3257936Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3258127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3258131Z 2025-03-14T06:00:23.3258318Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3258424Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3258663Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3258766Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3258957Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3259087Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3259224Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3259380Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3259932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3260459Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3260796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3261121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3261411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3261664Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3261951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3262272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3262375Z Execution Analysis: .......... 2025-03-14T06:00:23.3262613Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3262808Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3263071Z pt-xla-profiler: TransferFromDeviceTime too frequent: 755 counts during 720 steps 2025-03-14T06:00:23.3263078Z 2025-03-14T06:00:23.3263270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3263375Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3263652Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3263755Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3263954Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3264085Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3264221Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3264374Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3264709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3265030Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3265472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3265898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3266210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3266548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3266853Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3266973Z Execution Analysis: (:1) 2025-03-14T06:00:23.3267238Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3267438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3267442Z 2025-03-14T06:00:23.3267648Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3267799Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3268039Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3268147Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3268362Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3268502Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3268663Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3268830Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3269424Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3269992Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3270357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3270706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3271026Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3271300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3271683Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3271951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3272064Z Execution Analysis: .......... 2025-03-14T06:00:23.3272319Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3272529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3272815Z pt-xla-profiler: TransferFromDeviceTime too frequent: 756 counts during 721 steps 2025-03-14T06:00:23.3272828Z 2025-03-14T06:00:23.3273027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3273147Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3273440Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3273552Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3273761Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3273900Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3274043Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3274208Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3274568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3274914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3275230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3275505Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3275835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3276109Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3276397Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3276524Z Execution Analysis: (:1) 2025-03-14T06:00:23.3276779Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3276983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3277071Z 2025-03-14T06:00:23.3277269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3277386Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3277612Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3277729Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3277929Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3278077Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3278338Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3278611Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3279153Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3279681Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3280011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3280336Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3280623Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3280927Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3281208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3281460Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3281556Z Execution Analysis: .......... 2025-03-14T06:00:23.3281797Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3281988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3282269Z pt-xla-profiler: TransferFromDeviceTime too frequent: 757 counts during 722 steps 2025-03-14T06:00:23.3282273Z 2025-03-14T06:00:23.3282464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3282585Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3282857Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3282975Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3283168Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3283315Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3283451Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3283621Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3283953Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3284293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3284644Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3285113Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3285432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3285721Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3286020Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3286165Z Execution Analysis: (:1) 2025-03-14T06:00:23.3286423Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3286644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3286673Z 2025-03-14T06:00:23.3286879Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3287010Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3287246Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3287378Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3287586Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3287748Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3287899Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3288085Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3288683Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3289275Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3289637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3290007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3290372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3290662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3290974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3291262Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3291373Z Execution Analysis: .......... 2025-03-14T06:00:23.3291649Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3291869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3292160Z pt-xla-profiler: TransferFromDeviceTime too frequent: 759 counts during 723 steps 2025-03-14T06:00:23.3292164Z 2025-03-14T06:00:23.3292386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3292505Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3292817Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3292933Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3293152Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3293302Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3293457Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3293633Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3294008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3294364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3294718Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3294997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3295318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3295594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3295899Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3296026Z Execution Analysis: (:1) 2025-03-14T06:00:23.3296295Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3296545Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3296549Z 2025-03-14T06:00:23.3296759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3296877Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3297230Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3297339Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3297548Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3297689Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3297846Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3298010Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3298600Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3299163Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3299528Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3299895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3300243Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3300512Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3300824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3301085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3301200Z Execution Analysis: .......... 2025-03-14T06:00:23.3301455Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3301667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3301949Z pt-xla-profiler: TransferFromDeviceTime too frequent: 760 counts during 724 steps 2025-03-14T06:00:23.3301956Z 2025-03-14T06:00:23.3302169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3302281Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3302578Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3302686Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3302895Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3303038Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3303191Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3303357Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3303716Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3304079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3304397Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3304667Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3304979Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3305239Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3305538Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3305658Z Execution Analysis: (:1) 2025-03-14T06:00:23.3305949Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3306147Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3306151Z 2025-03-14T06:00:23.3306362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3306478Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3306719Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3306829Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3307043Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3307290Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3307440Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3307599Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3308159Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3308692Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3309040Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3309428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3309721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3309989Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3310275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3310542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3310645Z Execution Analysis: .......... 2025-03-14T06:00:23.3310896Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3311085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3311362Z pt-xla-profiler: TransferFromDeviceTime too frequent: 761 counts during 725 steps 2025-03-14T06:00:23.3311370Z 2025-03-14T06:00:23.3311558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3311679Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3311949Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3312064Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3312256Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3312401Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3312536Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3312704Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3313036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3313940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3314246Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3314517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3314806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3315071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3315347Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3315506Z Execution Analysis: (:1) 2025-03-14T06:00:23.3315749Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3315952Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3315956Z 2025-03-14T06:00:23.3316146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3316267Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3316484Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3316598Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3316794Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3316942Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3317080Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3317252Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3317804Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3318347Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3318746Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3319080Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3319371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3319637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3319925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3320186Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3320287Z Execution Analysis: .......... 2025-03-14T06:00:23.3320537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3320729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3321009Z pt-xla-profiler: TransferFromDeviceTime too frequent: 762 counts during 726 steps 2025-03-14T06:00:23.3321014Z 2025-03-14T06:00:23.3321204Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3321322Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3321592Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3321710Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3321900Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3322048Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3322182Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3322355Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3322714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3323059Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3323349Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3323614Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3323900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3324159Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3324458Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3324680Z Execution Analysis: (:1) 2025-03-14T06:00:23.3325090Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3325311Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3325318Z 2025-03-14T06:00:23.3325532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3325648Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3325894Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3326007Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3326213Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3326370Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3326523Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3326703Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3327299Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3327907Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3328296Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3328651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3328967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3329240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3329553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3329823Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3329930Z Execution Analysis: .......... 2025-03-14T06:00:23.3330190Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3330399Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3330686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 763 counts during 727 steps 2025-03-14T06:00:23.3330691Z 2025-03-14T06:00:23.3330901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3331012Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3331305Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3331420Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3331631Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3331776Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3331924Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3332134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3332498Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3332849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3333166Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3333438Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3333755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3334051Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3334347Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3334470Z Execution Analysis: (:1) 2025-03-14T06:00:23.3334734Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3334937Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3334941Z 2025-03-14T06:00:23.3335146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3335257Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3335492Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3335603Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3335812Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3335956Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3336106Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3336273Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3336866Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3337569Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3337908Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3338232Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3338525Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3338779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3339066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3339315Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3339419Z Execution Analysis: .......... 2025-03-14T06:00:23.3339660Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3339849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3340109Z pt-xla-profiler: TransferFromDeviceTime too frequent: 764 counts during 728 steps 2025-03-14T06:00:23.3340114Z 2025-03-14T06:00:23.3340304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3340406Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3340674Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3340776Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3340968Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3341100Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3341258Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3341415Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3341749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3342071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3342367Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3342616Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3342902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3343173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3343449Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3343569Z Execution Analysis: (:1) 2025-03-14T06:00:23.3343809Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3343998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3344002Z 2025-03-14T06:00:23.3344188Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3344295Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3344507Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3344613Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3344801Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3344937Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3345072Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3345231Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3345801Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3346358Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3346688Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3347018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3347306Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3347566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3347850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3348104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3348205Z Execution Analysis: .......... 2025-03-14T06:00:23.3348448Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3348634Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3348901Z pt-xla-profiler: TransferFromDeviceTime too frequent: 765 counts during 729 steps 2025-03-14T06:00:23.3348906Z 2025-03-14T06:00:23.3349093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3349207Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3349476Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3349583Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3349773Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3349939Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3350073Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3350236Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3350567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3350899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3351188Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3351446Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3351755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3352006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3352277Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3352398Z Execution Analysis: (:1) 2025-03-14T06:00:23.3352638Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3352832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3352836Z 2025-03-14T06:00:23.3353021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3353132Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3353344Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3353454Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3353642Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3353778Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3353914Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3354074Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3354669Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3355204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3355535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3355861Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3356152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3356413Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3356696Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3356956Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3357054Z Execution Analysis: .......... 2025-03-14T06:00:23.3357303Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3357485Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3357752Z pt-xla-profiler: TransferFromDeviceTime too frequent: 766 counts during 730 steps 2025-03-14T06:00:23.3357757Z 2025-03-14T06:00:23.3357947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3358053Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3358327Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3358430Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3358643Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3358780Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3358912Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3359074Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3359398Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3359732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3360024Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3360302Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3360585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3360837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3361117Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3361232Z Execution Analysis: (:1) 2025-03-14T06:00:23.3361474Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3361662Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3361666Z 2025-03-14T06:00:23.3361855Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3361962Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3362180Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3362283Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3362477Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3362611Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3362747Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3362966Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3363515Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3364045Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3364381Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3364785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3365258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3365680Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3365998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3366266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3366378Z Execution Analysis: .......... 2025-03-14T06:00:23.3366635Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3366845Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3367128Z pt-xla-profiler: TransferFromDeviceTime too frequent: 767 counts during 731 steps 2025-03-14T06:00:23.3367135Z 2025-03-14T06:00:23.3367341Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3367457Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3367811Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3367926Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3368140Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3368286Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3368435Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3368604Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3368969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3369322Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3369678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3369952Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3370270Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3370540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3370844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3370969Z Execution Analysis: (:1) 2025-03-14T06:00:23.3371235Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3371436Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3371440Z 2025-03-14T06:00:23.3371646Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3371762Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3371997Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3372108Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3372326Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3372506Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3372705Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3372873Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3373466Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3374037Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3374409Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3374759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3375081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3375353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3375676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3375951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3376056Z Execution Analysis: .......... 2025-03-14T06:00:23.3376320Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3376522Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3376813Z pt-xla-profiler: TransferFromDeviceTime too frequent: 768 counts during 732 steps 2025-03-14T06:00:23.3376819Z 2025-03-14T06:00:23.3377020Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3377168Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3377460Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3377580Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3377783Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3378038Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3378171Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3378333Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3378663Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3379020Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3379309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3379566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3379849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3380105Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3380375Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3380490Z Execution Analysis: (:1) 2025-03-14T06:00:23.3380728Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3380917Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3380924Z 2025-03-14T06:00:23.3381107Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3381217Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3381428Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3381536Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3381749Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3381910Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3382045Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3382206Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3382749Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3383279Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3383609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3383936Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3384229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3384490Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3384772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3385023Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3385120Z Execution Analysis: .......... 2025-03-14T06:00:23.3385364Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3385553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3385822Z pt-xla-profiler: TransferFromDeviceTime too frequent: 769 counts during 733 steps 2025-03-14T06:00:23.3385826Z 2025-03-14T06:00:23.3386038Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3386148Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3386416Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3386525Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3386713Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3386849Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3386980Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3387142Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3387472Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3387822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3388109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3388368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3388653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3388907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3389177Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3389301Z Execution Analysis: (:1) 2025-03-14T06:00:23.3389541Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3389735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3389741Z 2025-03-14T06:00:23.3389929Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3390045Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3390258Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3390391Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3390600Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3390739Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3390873Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3391035Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3391576Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3392115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3392457Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3392785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3393079Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3393333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3393619Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3393867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3393971Z Execution Analysis: .......... 2025-03-14T06:00:23.3394208Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3394402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3394665Z pt-xla-profiler: TransferFromDeviceTime too frequent: 770 counts during 734 steps 2025-03-14T06:00:23.3394669Z 2025-03-14T06:00:23.3394884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3394993Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3395267Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3395368Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3395560Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3395695Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3396001Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3396165Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3396547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3396888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3397197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3397468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3397772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3398032Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3398319Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3398440Z Execution Analysis: (:1) 2025-03-14T06:00:23.3398695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3398894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3398899Z 2025-03-14T06:00:23.3399101Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3399210Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3399499Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3399611Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3399815Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3399953Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3400103Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3400269Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3400852Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3401411Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3401768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3402113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3402420Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3402684Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3402988Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3403247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3403356Z Execution Analysis: .......... 2025-03-14T06:00:23.3403609Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3403813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3404115Z pt-xla-profiler: TransferFromDeviceTime too frequent: 771 counts during 735 steps 2025-03-14T06:00:23.3404121Z 2025-03-14T06:00:23.3404326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3404438Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3404820Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3405092Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3405309Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3405453Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3405597Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3405797Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3406159Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3406511Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3406832Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3407102Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3407413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3407679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3407975Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3408097Z Execution Analysis: (:1) 2025-03-14T06:00:23.3408365Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3408565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3408574Z 2025-03-14T06:00:23.3408775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3408947Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3409178Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3409295Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3409500Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3409649Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3409794Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3409966Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3410569Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3411153Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3411511Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3411875Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3412187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3412468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3412776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3413052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3413163Z Execution Analysis: .......... 2025-03-14T06:00:23.3413432Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3413663Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3413959Z pt-xla-profiler: TransferFromDeviceTime too frequent: 772 counts during 736 steps 2025-03-14T06:00:23.3413964Z 2025-03-14T06:00:23.3414167Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3414290Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3414581Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3414702Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3414908Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3415086Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3415231Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3415406Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3415763Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3416121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3416439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3416725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3417123Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3417384Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3417655Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3417788Z Execution Analysis: (:1) 2025-03-14T06:00:23.3418026Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3418224Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3418254Z 2025-03-14T06:00:23.3418470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3418583Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3418797Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3418907Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3419096Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3419232Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3419371Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3419537Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3420079Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3420618Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3420951Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3421282Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3421571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3421826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3422110Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3422366Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3422466Z Execution Analysis: .......... 2025-03-14T06:00:23.3422803Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3422988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3423263Z pt-xla-profiler: TransferFromDeviceTime too frequent: 773 counts during 737 steps 2025-03-14T06:00:23.3423268Z 2025-03-14T06:00:23.3423453Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3423566Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3423832Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3423941Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3424151Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3424291Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3424424Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3424584Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3424917Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3425255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3425544Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3425800Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3426100Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3426346Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3426630Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3426745Z Execution Analysis: (:1) 2025-03-14T06:00:23.3426994Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3427181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3427231Z 2025-03-14T06:00:23.3427424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3427527Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3427749Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3427849Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3428042Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3428170Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3428315Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3428469Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3429023Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3429550Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3429894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3430218Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3430516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3430771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3431067Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3431317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3431425Z Execution Analysis: .......... 2025-03-14T06:00:23.3431689Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3431889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3432153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 774 counts during 738 steps 2025-03-14T06:00:23.3432158Z 2025-03-14T06:00:23.3432351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3432460Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3432733Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3432869Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3433063Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3433196Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3433334Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3433492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3433834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3434158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3434455Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3434712Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3435003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3435253Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3435533Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3435652Z Execution Analysis: (:1) 2025-03-14T06:00:23.3435905Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3436138Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3436142Z 2025-03-14T06:00:23.3436335Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3436440Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3436661Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3436765Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3436967Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3437102Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3437249Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3437406Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3437960Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3438493Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3438832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3439159Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3439455Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3439713Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3440003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3440274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3440381Z Execution Analysis: .......... 2025-03-14T06:00:23.3440626Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3440821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3441083Z pt-xla-profiler: TransferFromDeviceTime too frequent: 775 counts during 739 steps 2025-03-14T06:00:23.3441095Z 2025-03-14T06:00:23.3441283Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3441396Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3441708Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3441818Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3442004Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3442151Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3442285Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3442450Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3442781Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3443111Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3443399Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3443658Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3443945Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3444205Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3444548Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3444689Z Execution Analysis: (:1) 2025-03-14T06:00:23.3445150Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3445361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3445366Z 2025-03-14T06:00:23.3445565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3445685Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3445914Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3446033Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3446239Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3446391Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3446537Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3446713Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3447305Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3447888Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3448249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3448608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3448923Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3449204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3449511Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3449813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3449924Z Execution Analysis: .......... 2025-03-14T06:00:23.3450190Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3450390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3450684Z pt-xla-profiler: TransferFromDeviceTime too frequent: 776 counts during 740 steps 2025-03-14T06:00:23.3450689Z 2025-03-14T06:00:23.3450890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3451037Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3451328Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3451447Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3451654Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3451804Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3451952Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3452129Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3452486Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3452849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3453163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3453451Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3453763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3454042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3454341Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3454525Z Execution Analysis: (:1) 2025-03-14T06:00:23.3454787Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3455003Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3455007Z 2025-03-14T06:00:23.3455209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3455336Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3455568Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3455690Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3455896Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3456048Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3456199Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3456376Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3456971Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3457621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3457954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3458286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3458589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3458845Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3459162Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3459414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3459519Z Execution Analysis: .......... 2025-03-14T06:00:23.3459760Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3459958Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3460225Z pt-xla-profiler: TransferFromDeviceTime too frequent: 777 counts during 741 steps 2025-03-14T06:00:23.3460229Z 2025-03-14T06:00:23.3460453Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3460560Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3460839Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3460946Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3461144Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3461280Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3461424Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3461578Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3461915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3462237Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3462537Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3462791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3463083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3463332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3463663Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3463777Z Execution Analysis: (:1) 2025-03-14T06:00:23.3464023Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3464210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3464213Z 2025-03-14T06:00:23.3464406Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3464513Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3464733Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3464836Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3465032Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3465166Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3465438Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3465594Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3466348Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3466923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3467291Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3467642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3467959Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3468303Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3468626Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3468893Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3469005Z Execution Analysis: .......... 2025-03-14T06:00:23.3469263Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3469472Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3469756Z pt-xla-profiler: TransferFromDeviceTime too frequent: 778 counts during 742 steps 2025-03-14T06:00:23.3469796Z 2025-03-14T06:00:23.3470007Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3470120Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3470419Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3470532Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3470747Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3470890Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3471041Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3471209Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3471572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3471925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3472242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3472513Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3472826Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3473163Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3473466Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3473591Z Execution Analysis: (:1) 2025-03-14T06:00:23.3473855Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3474053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3474067Z 2025-03-14T06:00:23.3474264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3474382Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3474620Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3474732Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3474946Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3475090Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3475248Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3475417Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3476014Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3476591Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3476954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3477314Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3477650Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3477937Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3478349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3478605Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3478704Z Execution Analysis: .......... 2025-03-14T06:00:23.3478949Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3479135Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3479430Z pt-xla-profiler: TransferFromDeviceTime too frequent: 780 counts during 743 steps 2025-03-14T06:00:23.3479435Z 2025-03-14T06:00:23.3479621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3479734Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3480001Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3480114Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3480305Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3480441Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3480575Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3480738Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3481069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3481401Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3481691Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3481952Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3482235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3482538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3482810Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3482933Z Execution Analysis: (:1) 2025-03-14T06:00:23.3483170Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3483365Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3483370Z 2025-03-14T06:00:23.3483555Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3483667Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3483883Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3483996Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3484188Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3484330Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3484464Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3484692Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3485432Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3486010Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3486375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3486765Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3487080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3487363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3487668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3487950Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3488055Z Execution Analysis: .......... 2025-03-14T06:00:23.3488322Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3488555Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3488852Z pt-xla-profiler: TransferFromDeviceTime too frequent: 781 counts during 744 steps 2025-03-14T06:00:23.3488857Z 2025-03-14T06:00:23.3489060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3489184Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3489475Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3489595Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3489800Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3489951Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3490091Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3490265Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3490621Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3490980Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3491293Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3491573Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3491934Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3492214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3492502Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3492635Z Execution Analysis: (:1) 2025-03-14T06:00:23.3492894Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3493103Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3493108Z 2025-03-14T06:00:23.3493325Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3493439Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3493683Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3493798Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3494015Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3494161Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3494318Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3494486Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3495087Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3495661Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3496033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3496409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3496739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3497011Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3497434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3497696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3497815Z Execution Analysis: .......... 2025-03-14T06:00:23.3498068Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3498306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3498585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 782 counts during 745 steps 2025-03-14T06:00:23.3498591Z 2025-03-14T06:00:23.3498802Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3498915Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3499209Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3499322Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3499534Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3499676Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3499830Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3499994Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3500357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3500699Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3501019Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3501345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3501659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3501922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3502223Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3502345Z Execution Analysis: (:1) 2025-03-14T06:00:23.3502611Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3502810Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3502814Z 2025-03-14T06:00:23.3503024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3503136Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3503380Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3503486Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3503701Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3503839Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3503999Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3504164Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3504752Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3505312Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3505697Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3506044Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3506358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3506622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3506932Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3507196Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3507341Z Execution Analysis: .......... 2025-03-14T06:00:23.3507592Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3507799Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3508076Z pt-xla-profiler: TransferFromDeviceTime too frequent: 783 counts during 746 steps 2025-03-14T06:00:23.3508094Z 2025-03-14T06:00:23.3508294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3508416Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3508696Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3508816Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3509009Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3509150Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3509306Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3509470Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3509824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3510168Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3510528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3510810Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3511107Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3511383Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3511667Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3511802Z Execution Analysis: (:1) 2025-03-14T06:00:23.3512055Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3512263Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3512267Z 2025-03-14T06:00:23.3512464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3512589Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3512809Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3512930Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3513127Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3513278Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3513419Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3513594Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3514171Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3514764Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3515117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3515471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3515776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3516053Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3516354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3516651Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3516755Z Execution Analysis: .......... 2025-03-14T06:00:23.3517018Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3517217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3517510Z pt-xla-profiler: TransferFromDeviceTime too frequent: 784 counts during 747 steps 2025-03-14T06:00:23.3517514Z 2025-03-14T06:00:23.3517710Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3517834Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3518113Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3518232Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3518430Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3518585Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3518723Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3519011Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3519342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3519699Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3520009Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3520276Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3520561Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3520822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3521093Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3521223Z Execution Analysis: (:1) 2025-03-14T06:00:23.3521460Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3521659Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3521665Z 2025-03-14T06:00:23.3521857Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3521977Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3522190Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3522301Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3522491Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3522635Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3522773Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3522941Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3523486Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3524047Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3524384Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3524791Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3525259Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3525545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3525854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3526167Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3526272Z Execution Analysis: .......... 2025-03-14T06:00:23.3526544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3526761Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3527043Z pt-xla-profiler: TransferFromDeviceTime too frequent: 785 counts during 748 steps 2025-03-14T06:00:23.3527049Z 2025-03-14T06:00:23.3527264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3527378Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3527678Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3527786Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3528004Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3528149Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3528302Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3528466Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3528841Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3529240Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3529565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3529840Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3530157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3530427Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3530733Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3530855Z Execution Analysis: (:1) 2025-03-14T06:00:23.3531128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3531330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3531337Z 2025-03-14T06:00:23.3531548Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3531659Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3531903Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3532015Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3532232Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3532376Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3532536Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3532706Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3533331Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3533904Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3534276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3534625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3534946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3535218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3535562Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3535829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3535946Z Execution Analysis: .......... 2025-03-14T06:00:23.3536206Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3536422Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3536707Z pt-xla-profiler: TransferFromDeviceTime too frequent: 786 counts during 749 steps 2025-03-14T06:00:23.3536711Z 2025-03-14T06:00:23.3536927Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3537043Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3537440Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3537548Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3537750Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3537887Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3538035Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3538191Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3538602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3538928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3539230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3539485Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3539786Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3540037Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3540319Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3540435Z Execution Analysis: (:1) 2025-03-14T06:00:23.3540689Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3540882Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3540885Z 2025-03-14T06:00:23.3541083Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3541192Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3541418Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3541523Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3541725Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3541861Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3542008Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3542164Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3542747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3543280Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3543623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3543964Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3544255Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3544546Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3544829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3545092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3545192Z Execution Analysis: .......... 2025-03-14T06:00:23.3545445Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3545635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3545909Z pt-xla-profiler: TransferFromDeviceTime too frequent: 787 counts during 750 steps 2025-03-14T06:00:23.3545914Z 2025-03-14T06:00:23.3546098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3546214Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3546483Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3546597Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3546784Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3546933Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3547063Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3547747Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3548087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3548425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3548714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3548979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3549263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3549525Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3549795Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3549925Z Execution Analysis: (:1) 2025-03-14T06:00:23.3550167Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3550365Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3550369Z 2025-03-14T06:00:23.3550554Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3550672Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3550886Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3551002Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3551192Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3551339Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3551476Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3551667Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3552216Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3552758Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3553092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3553430Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3553747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3554014Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3554298Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3554558Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3554661Z Execution Analysis: .......... 2025-03-14T06:00:23.3554911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3555099Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3555376Z pt-xla-profiler: TransferFromDeviceTime too frequent: 788 counts during 751 steps 2025-03-14T06:00:23.3555380Z 2025-03-14T06:00:23.3555569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3555688Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3555956Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3556070Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3556261Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3556433Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3556588Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3556760Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3557092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3557431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3557722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3557988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3558273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3558532Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3558806Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3558934Z Execution Analysis: (:1) 2025-03-14T06:00:23.3559175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3559371Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3559375Z 2025-03-14T06:00:23.3559574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3559678Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3559902Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3560007Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3560196Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3560341Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3560505Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3560672Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3561218Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3561753Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3562094Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3562418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3562739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3562992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3563289Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3563540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3563651Z Execution Analysis: .......... 2025-03-14T06:00:23.3563887Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3564087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3564350Z pt-xla-profiler: TransferFromDeviceTime too frequent: 789 counts during 752 steps 2025-03-14T06:00:23.3564356Z 2025-03-14T06:00:23.3564633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3564739Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3565196Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3565428Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3565708Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3566009Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3566168Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3566337Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3566711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3567060Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3567389Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3567666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3567992Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3568261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3568569Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3568692Z Execution Analysis: (:1) 2025-03-14T06:00:23.3568959Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3569157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3569161Z 2025-03-14T06:00:23.3569378Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3569494Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3569737Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3569847Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3570063Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3570239Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3570406Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3570576Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3571181Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3571752Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3572121Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3572518Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3572842Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3573117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3573437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3573707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3573826Z Execution Analysis: .......... 2025-03-14T06:00:23.3574085Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3574298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3574585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 790 counts during 753 steps 2025-03-14T06:00:23.3574591Z 2025-03-14T06:00:23.3574809Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3574923Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3575222Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3575358Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3575595Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3575737Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3575891Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3576060Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3576430Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3576781Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3577107Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3577381Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3577703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3577976Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3578280Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3578420Z Execution Analysis: (:1) 2025-03-14T06:00:23.3578678Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3578891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3578895Z 2025-03-14T06:00:23.3579102Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3579227Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3579462Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3579586Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3579828Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3579989Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3580139Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3580321Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3580917Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3581503Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3581892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3582254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3582573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3582863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3583177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3583461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3583573Z Execution Analysis: .......... 2025-03-14T06:00:23.3583846Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3584051Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3584350Z pt-xla-profiler: TransferFromDeviceTime too frequent: 791 counts during 754 steps 2025-03-14T06:00:23.3584355Z 2025-03-14T06:00:23.3584559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3584690Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3585033Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3585159Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3585365Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3585524Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3585669Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3585855Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3586214Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3586583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3586900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3587190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3587503Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3587787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3588083Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3588218Z Execution Analysis: (:1) 2025-03-14T06:00:23.3588479Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3588695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3588701Z 2025-03-14T06:00:23.3588906Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3589035Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3589291Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3589421Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3589631Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3589787Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3589934Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3590114Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3590705Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3591289Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3591679Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3592043Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3592360Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3592647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3592955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3593235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3593343Z Execution Analysis: .......... 2025-03-14T06:00:23.3593615Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3593819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3594337Z pt-xla-profiler: TransferFromDeviceTime too frequent: 792 counts during 755 steps 2025-03-14T06:00:23.3594349Z 2025-03-14T06:00:23.3594854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3595177Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3595938Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3596199Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3596700Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3597039Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3597392Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3597789Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3598655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3599529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3600300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3600964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3601719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3602364Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3603086Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3603380Z Execution Analysis: (:1) 2025-03-14T06:00:23.3604013Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3604611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3604623Z 2025-03-14T06:00:23.3605120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3605435Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3606010Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3606273Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3606777Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3607108Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3607461Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3607853Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3609312Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3610781Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3611678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3612545Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3613334Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3613998Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3614760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3615409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3615659Z Execution Analysis: .......... 2025-03-14T06:00:23.3616282Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3616783Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3617473Z pt-xla-profiler: TransferFromDeviceTime too frequent: 793 counts during 756 steps 2025-03-14T06:00:23.3617484Z 2025-03-14T06:00:23.3618073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3618344Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3619065Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3619326Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3619830Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3620164Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3620529Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3620933Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3621828Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3622693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3623478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3624151Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3624918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3625563Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3626294Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3626592Z Execution Analysis: (:1) 2025-03-14T06:00:23.3627236Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3627717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3627725Z 2025-03-14T06:00:23.3628296Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3628563Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3629143Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3629408Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3629916Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3630258Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3630619Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3631011Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3632478Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3633929Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3634834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3635702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3636491Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3637171Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3637913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3638585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3638837Z Execution Analysis: .......... 2025-03-14T06:00:23.3639475Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3639960Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3640663Z pt-xla-profiler: TransferFromDeviceTime too frequent: 794 counts during 757 steps 2025-03-14T06:00:23.3640719Z 2025-03-14T06:00:23.3641243Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3641526Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3642227Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3642506Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3642996Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3643346Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3643689Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3644102Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3645029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3645915Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3646684Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3647366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3648117Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3648776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3649485Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3649793Z Execution Analysis: (:1) 2025-03-14T06:00:23.3650410Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3650911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3650970Z 2025-03-14T06:00:23.3651455Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3651741Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3652296Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3659351Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3659889Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3660245Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3660588Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3661001Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3662557Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3663980Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3664869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3665880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3666636Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3667304Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3668045Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3668709Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3668948Z Execution Analysis: .......... 2025-03-14T06:00:23.3669574Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3670054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3670927Z pt-xla-profiler: TransferFromDeviceTime too frequent: 795 counts during 758 steps 2025-03-14T06:00:23.3670940Z 2025-03-14T06:00:23.3671415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3671681Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3672385Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3672649Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3673129Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3673477Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3673801Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3674198Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3675072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3675958Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3676713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3677383Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3678114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3678766Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3679468Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3679760Z Execution Analysis: (:1) 2025-03-14T06:00:23.3680370Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3680921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3680937Z 2025-03-14T06:00:23.3681413Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3681677Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3682216Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3682479Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3682957Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3683301Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3683638Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3684097Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3685600Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3687016Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3687889Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3688754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3689505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3690171Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3690907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3691560Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3691793Z Execution Analysis: .......... 2025-03-14T06:00:23.3692419Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3692981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3693679Z pt-xla-profiler: TransferFromDeviceTime too frequent: 796 counts during 759 steps 2025-03-14T06:00:23.3693691Z 2025-03-14T06:00:23.3694176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3694434Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3695150Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3695398Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3695893Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3696228Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3696578Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3696966Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3697846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3698706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3699473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3700130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3700884Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3701525Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3702252Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3702533Z Execution Analysis: (:1) 2025-03-14T06:00:23.3703207Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3703687Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3703697Z 2025-03-14T06:00:23.3704183Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3704440Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3704999Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3705243Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3705734Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3706102Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3706447Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3706839Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3708294Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3709693Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3710566Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3711418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3712183Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3712835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3713593Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3714227Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3714483Z Execution Analysis: .......... 2025-03-14T06:00:23.3715133Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3715697Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3716373Z pt-xla-profiler: TransferFromDeviceTime too frequent: 797 counts during 760 steps 2025-03-14T06:00:23.3716382Z 2025-03-14T06:00:23.3716859Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3717115Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3717821Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3718075Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3718563Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3718888Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3719236Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3719622Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3720511Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3721363Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3722131Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3722790Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3723536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3724178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3724966Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3725292Z Execution Analysis: (:1) 2025-03-14T06:00:23.3725928Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3726413Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3726423Z 2025-03-14T06:00:23.3726914Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3727177Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3727734Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3727984Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3728520Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3728855Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3729208Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3729601Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3731069Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3732468Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3733351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3734216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3734990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3735660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3736393Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3737048Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3737338Z Execution Analysis: .......... 2025-03-14T06:00:23.3738004Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3738484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3739177Z pt-xla-profiler: TransferFromDeviceTime too frequent: 798 counts during 761 steps 2025-03-14T06:00:23.3739187Z 2025-03-14T06:00:23.3739658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3739935Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3740633Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3740901Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3741377Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3741727Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3742054Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3742462Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3743333Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3744209Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3744953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3745616Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3746343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3746993Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3747729Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3748025Z Execution Analysis: (:1) 2025-03-14T06:00:23.3748644Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3749134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3749143Z 2025-03-14T06:00:23.3749604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3749873Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3750419Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3750720Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3751192Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3751530Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3751866Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3752277Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3753716Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3755111Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3755987Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3756880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3757647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3758336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3759087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3759848Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3760095Z Execution Analysis: .......... 2025-03-14T06:00:23.3760731Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3761217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3761922Z pt-xla-profiler: TransferFromDeviceTime too frequent: 799 counts during 762 steps 2025-03-14T06:00:23.3761934Z 2025-03-14T06:00:23.3762420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3762705Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3763407Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3763678Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3764173Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3764600Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3764949Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3765479Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3766358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3767239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3768007Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3768698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3769447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3770222Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3770929Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3771246Z Execution Analysis: (:1) 2025-03-14T06:00:23.3771867Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3772372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3772382Z 2025-03-14T06:00:23.3772862Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3773147Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3773771Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3774045Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3774533Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3774891Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3775242Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3775668Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3777124Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3778552Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3779448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3780317Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3781103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3781763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3782526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3783294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3783561Z Execution Analysis: .......... 2025-03-14T06:00:23.3784180Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3784688Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3785376Z pt-xla-profiler: TransferFromDeviceTime too frequent: 801 counts during 763 steps 2025-03-14T06:00:23.3785390Z 2025-03-14T06:00:23.3785902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3786169Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3786897Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3787163Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3787670Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3788002Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3788354Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3788753Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3789648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3790509Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3791289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3791952Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3792717Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3793413Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3794143Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3794430Z Execution Analysis: (:1) 2025-03-14T06:00:23.3795054Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3795537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3795546Z 2025-03-14T06:00:23.3796042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3796353Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3796918Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3797174Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3797689Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3798026Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3798397Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3798798Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3800269Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3801679Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3802574Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3803443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3804228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3804963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3805854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3806516Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3806783Z Execution Analysis: .......... 2025-03-14T06:00:23.3807406Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3807912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3808604Z pt-xla-profiler: TransferFromDeviceTime too frequent: 802 counts during 764 steps 2025-03-14T06:00:23.3808617Z 2025-03-14T06:00:23.3809113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3809381Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3810110Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3810383Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3810890Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3811225Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3811582Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3811978Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3812872Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3813734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3814523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3815181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3815987Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3816645Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3817372Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3817662Z Execution Analysis: (:1) 2025-03-14T06:00:23.3818310Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3818812Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3818821Z 2025-03-14T06:00:23.3819349Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3819632Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3820187Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3820470Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3820957Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3821320Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3821661Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3822080Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3823531Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3824964Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3825846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3826727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3827490Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3828259Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3829011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3829677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3829924Z Execution Analysis: .......... 2025-03-14T06:00:23.3830562Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3831044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3831761Z pt-xla-profiler: TransferFromDeviceTime too frequent: 803 counts during 765 steps 2025-03-14T06:00:23.3831770Z 2025-03-14T06:00:23.3832256Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3832535Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3833246Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3833526Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3834014Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3834368Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3834704Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3835126Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3836007Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3836892Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3837645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3838370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3839126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3839797Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3840504Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3840813Z Execution Analysis: (:1) 2025-03-14T06:00:23.3841427Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3841925Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3841975Z 2025-03-14T06:00:23.3842459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3842745Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3843304Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3843580Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3844072Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3844431Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3844853Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3845271Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3846721Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3848154Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3849039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3849925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3850792Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3851471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3852224Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3852893Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3853135Z Execution Analysis: .......... 2025-03-14T06:00:23.3853768Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3854260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3854966Z pt-xla-profiler: TransferFromDeviceTime too frequent: 804 counts during 766 steps 2025-03-14T06:00:23.3854976Z 2025-03-14T06:00:23.3855483Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3855760Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3856485Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3856748Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3857236Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3857589Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3857925Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3858342Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3859218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3860102Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3860931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3861601Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3862371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3863027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3863754Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3864044Z Execution Analysis: (:1) 2025-03-14T06:00:23.3864681Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3865208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3865219Z 2025-03-14T06:00:23.3865822Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3866085Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3866650Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3866907Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3867399Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3867728Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3868074Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3868466Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3869908Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3871314Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3872197Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3873142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3873968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3874623Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3875376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3876026Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3876285Z Execution Analysis: .......... 2025-03-14T06:00:23.3876900Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3877386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3878070Z pt-xla-profiler: TransferFromDeviceTime too frequent: 805 counts during 767 steps 2025-03-14T06:00:23.3878082Z 2025-03-14T06:00:23.3878577Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3878836Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3879544Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3879795Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3880285Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3880615Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3880949Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3881349Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3882225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3883148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3883905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3884626Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3885389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3886034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3886753Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3887035Z Execution Analysis: (:1) 2025-03-14T06:00:23.3887752Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3888228Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3888238Z 2025-03-14T06:00:23.3888729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3888987Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3889553Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3889810Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3890298Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3890628Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3890978Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3891370Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3892826Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3894223Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3895112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3896162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3896931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3897582Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3898330Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3898985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3899231Z Execution Analysis: .......... 2025-03-14T06:00:23.3899843Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3900337Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3901031Z pt-xla-profiler: TransferFromDeviceTime too frequent: 806 counts during 768 steps 2025-03-14T06:00:23.3901051Z 2025-03-14T06:00:23.3901527Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3901798Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3902496Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3902752Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3903233Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3903566Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3903897Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3904298Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3905169Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3906072Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3906829Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3907493Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3908237Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3908889Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3909597Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3909934Z Execution Analysis: (:1) 2025-03-14T06:00:23.3910554Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3911044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3911053Z 2025-03-14T06:00:23.3911533Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3911801Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3912349Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3912606Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3913085Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3913426Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3913767Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3914170Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3915609Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3917026Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3917988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3918847Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3919608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3920279Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3921015Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3921678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3921917Z Execution Analysis: .......... 2025-03-14T06:00:23.3922540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3923026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3923728Z pt-xla-profiler: TransferFromDeviceTime too frequent: 807 counts during 769 steps 2025-03-14T06:00:23.3923739Z 2025-03-14T06:00:23.3924209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3924541Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3925241Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3925504Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3925984Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3926339Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3926679Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3927084Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3928020Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3928902Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3929664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3930334Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3931081Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3931745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3932494Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3932793Z Execution Analysis: (:1) 2025-03-14T06:00:23.3933411Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3933909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3933922Z 2025-03-14T06:00:23.3934403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3934687Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3935230Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3935490Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3935967Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3936310Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3936660Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3937061Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3938515Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3939964Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3940889Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3941751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3942515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3943172Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3943916Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3944560Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3944805Z Execution Analysis: .......... 2025-03-14T06:00:23.3945419Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3945908Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3946589Z pt-xla-profiler: TransferFromDeviceTime too frequent: 808 counts during 770 steps 2025-03-14T06:00:23.3946601Z 2025-03-14T06:00:23.3947079Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3947336Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3948043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3948297Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3948782Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3949120Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3949460Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3949899Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3950783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3951651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3952417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3953075Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3953826Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3954514Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3955225Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3955512Z Execution Analysis: (:1) 2025-03-14T06:00:23.3956138Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3956628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3956638Z 2025-03-14T06:00:23.3957125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3957384Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3957950Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3958203Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3958688Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3959027Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3959373Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3959764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3961214Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3962709Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3963591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3964451Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3965448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3966115Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3966869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3967513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3967769Z Execution Analysis: .......... 2025-03-14T06:00:23.3968393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3968881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3969564Z pt-xla-profiler: TransferFromDeviceTime too frequent: 809 counts during 771 steps 2025-03-14T06:00:23.3969572Z 2025-03-14T06:00:23.3970056Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3970311Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3971027Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3971283Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3971777Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3972111Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3972579Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3972977Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3973871Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3974734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3975512Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3976169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3976918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3977627Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3978343Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.3978635Z Execution Analysis: (:1) 2025-03-14T06:00:23.3979263Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3979741Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3979766Z 2025-03-14T06:00:23.3980238Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3980507Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3981053Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.3981308Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3981790Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.3982120Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.3982467Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.3982853Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3984377Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.3985861Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.3986731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.3987594Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3988352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3989017Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3989747Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.3990401Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.3990645Z Execution Analysis: .......... 2025-03-14T06:00:23.3991273Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.3991754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3992443Z pt-xla-profiler: TransferFromDeviceTime too frequent: 810 counts during 772 steps 2025-03-14T06:00:23.3992454Z 2025-03-14T06:00:23.3992928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.3993202Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.3993898Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.3994152Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.3994635Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.3995015Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.3995348Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.3995748Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.3996622Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.3997483Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.3998235Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.3998900Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.3999690Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4000342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4001043Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4001347Z Execution Analysis: (:1) 2025-03-14T06:00:23.4001960Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4002448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4002456Z 2025-03-14T06:00:23.4002931Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4003198Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4003749Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4004021Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4004574Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4004920Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4005259Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4005660Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4007210Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4008619Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4009489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4010358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4011121Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4011788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4012536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4013204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4013444Z Execution Analysis: .......... 2025-03-14T06:00:23.4014067Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4014546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4015247Z pt-xla-profiler: TransferFromDeviceTime too frequent: 811 counts during 773 steps 2025-03-14T06:00:23.4015259Z 2025-03-14T06:00:23.4015732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4016003Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4016708Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4016969Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4017498Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4017851Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4018177Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4018584Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4019450Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4020324Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4021080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4021805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4022545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4023212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4023929Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4024226Z Execution Analysis: (:1) 2025-03-14T06:00:23.4024849Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4025328Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4025338Z 2025-03-14T06:00:23.4025820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4026076Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4026645Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4026896Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4027384Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4027711Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4028060Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4028534Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4029997Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4031394Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4032273Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4033130Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4033895Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4034552Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4035307Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4035949Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4036195Z Execution Analysis: .......... 2025-03-14T06:00:23.4036806Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4037292Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4037969Z pt-xla-profiler: TransferFromDeviceTime too frequent: 812 counts during 774 steps 2025-03-14T06:00:23.4037983Z 2025-03-14T06:00:23.4038465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4038723Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4039473Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4039721Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4040217Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4040555Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4040890Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4041277Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4042155Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4042998Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4043806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4044462Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4045271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4045914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4046648Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4046928Z Execution Analysis: (:1) 2025-03-14T06:00:23.4047554Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4048032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4048042Z 2025-03-14T06:00:23.4048529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4048796Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4049365Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4049621Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4050118Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4050498Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4050911Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4051302Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4052757Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4054166Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4055043Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4055907Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4056675Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4057338Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4058092Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4058737Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4058990Z Execution Analysis: .......... 2025-03-14T06:00:23.4059595Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4060083Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4060764Z pt-xla-profiler: TransferFromDeviceTime too frequent: 813 counts during 775 steps 2025-03-14T06:00:23.4060785Z 2025-03-14T06:00:23.4061264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4061532Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4062286Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4062549Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4063027Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4063362Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4063695Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4064082Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4064965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4065949Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4066793Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4067464Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4068203Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4068864Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4069582Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4069882Z Execution Analysis: (:1) 2025-03-14T06:00:23.4070490Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4070982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4070996Z 2025-03-14T06:00:23.4071474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4071746Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4072292Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4072566Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4075015Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4075431Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4075778Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4076187Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4077638Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4079045Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4079920Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4080797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4081562Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4082235Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4082974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4083629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4083874Z Execution Analysis: .......... 2025-03-14T06:00:23.4084556Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4085034Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4085741Z pt-xla-profiler: TransferFromDeviceTime too frequent: 814 counts during 776 steps 2025-03-14T06:00:23.4085753Z 2025-03-14T06:00:23.4086298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4086573Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4087282Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4087545Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4088032Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4088379Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4088711Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4089119Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4089999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4090921Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4091682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4092360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4093104Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4093760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4094462Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4094758Z Execution Analysis: (:1) 2025-03-14T06:00:23.4095373Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4095861Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4095875Z 2025-03-14T06:00:23.4096347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4096617Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4097171Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4097482Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4098008Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4098353Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4098691Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4099096Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4100535Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4101952Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4102824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4103691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4104465Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4105138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4105886Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4106528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4106783Z Execution Analysis: .......... 2025-03-14T06:00:23.4107396Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4107888Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4108568Z pt-xla-profiler: TransferFromDeviceTime too frequent: 815 counts during 777 steps 2025-03-14T06:00:23.4108577Z 2025-03-14T06:00:23.4109102Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4109378Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4110094Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4110340Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4110833Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4111167Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4111495Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4111891Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4112825Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4113680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4114444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4115106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4115864Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4116507Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4117224Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4117509Z Execution Analysis: (:1) 2025-03-14T06:00:23.4118139Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4118622Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4118631Z 2025-03-14T06:00:23.4119112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4119382Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4120032Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4120287Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4120786Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4121117Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4121477Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4121871Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4123333Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4124805Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4125701Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4126566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4127337Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4127997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4128744Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4129402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4129661Z Execution Analysis: .......... 2025-03-14T06:00:23.4130277Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4130770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4131503Z pt-xla-profiler: TransferFromDeviceTime too frequent: 816 counts during 778 steps 2025-03-14T06:00:23.4131518Z 2025-03-14T06:00:23.4132011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4132273Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4132984Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4133240Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4133733Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4134065Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4134410Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4134849Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4135737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4136599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4137374Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4138030Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4138779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4139429Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4140151Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4140439Z Execution Analysis: (:1) 2025-03-14T06:00:23.4141072Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4141549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4141558Z 2025-03-14T06:00:23.4142052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4142425Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4142987Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4143248Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4143739Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4144073Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4144421Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4144817Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4146274Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4147692Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4148557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4149430Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4150193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4150878Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4151614Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4152273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4152519Z Execution Analysis: .......... 2025-03-14T06:00:23.4153148Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4153673Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4154380Z pt-xla-profiler: TransferFromDeviceTime too frequent: 817 counts during 779 steps 2025-03-14T06:00:23.4154392Z 2025-03-14T06:00:23.4154870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4155139Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4155849Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4156109Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4156593Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4156942Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4157313Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4157723Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4158593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4159478Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4160248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4160919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4161653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4162316Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4163021Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4163328Z Execution Analysis: (:1) 2025-03-14T06:00:23.4163936Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4164430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4164439Z 2025-03-14T06:00:23.4165076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4165450Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4165999Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4166263Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4166742Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4167083Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4167421Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4167833Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4169280Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4170700Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4171582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4172459Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4173216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4173888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4174631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4175293Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4175536Z Execution Analysis: .......... 2025-03-14T06:00:23.4176265Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4176748Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4177447Z pt-xla-profiler: TransferFromDeviceTime too frequent: 818 counts during 780 steps 2025-03-14T06:00:23.4177459Z 2025-03-14T06:00:23.4177941Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4178211Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4178917Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4179182Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4179668Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4180080Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4180414Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4180823Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4181690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4182573Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4183329Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4184000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4184738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4185385Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4186094Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4186393Z Execution Analysis: (:1) 2025-03-14T06:00:23.4187006Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4187500Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4187626Z 2025-03-14T06:00:23.4188112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4188372Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4188933Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4189188Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4189692Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4190026Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4190382Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4190770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4192235Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4193642Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4194532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4195386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4196167Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4196831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4197591Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4198236Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4198479Z Execution Analysis: .......... 2025-03-14T06:00:23.4199134Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4199633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4200310Z pt-xla-profiler: TransferFromDeviceTime too frequent: 819 counts during 781 steps 2025-03-14T06:00:23.4200322Z 2025-03-14T06:00:23.4200806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4201067Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4201781Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4202081Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4202571Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4202900Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4203243Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4203632Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4204612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4205474Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4206235Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4206903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4207659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4208305Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4209009Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4209295Z Execution Analysis: (:1) 2025-03-14T06:00:23.4209927Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4210505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4210516Z 2025-03-14T06:00:23.4211006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4211265Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4211829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4212082Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4212578Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4212915Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4213264Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4213649Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4215110Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4216516Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4217406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4218263Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4219031Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4219700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4220448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4221096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4221396Z Execution Analysis: .......... 2025-03-14T06:00:23.4222017Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4222506Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4223194Z pt-xla-profiler: TransferFromDeviceTime too frequent: 820 counts during 782 steps 2025-03-14T06:00:23.4223219Z 2025-03-14T06:00:23.4223693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4223950Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4224736Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4224987Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4225478Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4225809Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4226153Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4226552Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4227430Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4228294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4229063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4229726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4230462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4231124Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4231819Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4232125Z Execution Analysis: (:1) 2025-03-14T06:00:23.4232844Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4233338Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4233348Z 2025-03-14T06:00:23.4233824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4234094Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4234643Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4234905Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4235387Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4235742Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4236083Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4236497Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4237940Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4239354Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4240225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4241101Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4241853Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4242523Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4243261Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4243973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4244225Z Execution Analysis: .......... 2025-03-14T06:00:23.4244905Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4245385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4246086Z pt-xla-profiler: TransferFromDeviceTime too frequent: 822 counts during 783 steps 2025-03-14T06:00:23.4246098Z 2025-03-14T06:00:23.4246574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4247012Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4247715Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4247988Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4248464Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4248813Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4249157Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4249565Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4250439Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4251311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4252066Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4252738Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4253484Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4254146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4254853Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4255192Z Execution Analysis: (:1) 2025-03-14T06:00:23.4255851Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4256342Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4256351Z 2025-03-14T06:00:23.4256825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4257098Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4257651Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4257916Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4258399Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4258734Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4259075Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4259480Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4260932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4262345Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4263225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4264091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4264858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4265645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4266476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4267147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4267390Z Execution Analysis: .......... 2025-03-14T06:00:23.4268011Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4268492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4269178Z pt-xla-profiler: TransferFromDeviceTime too frequent: 823 counts during 784 steps 2025-03-14T06:00:23.4269190Z 2025-03-14T06:00:23.4269738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4269997Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4270719Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4270976Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4271473Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4271810Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4272154Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4272542Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4273429Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4274284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4275056Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4275715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4276473Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4277116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4277955Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4278243Z Execution Analysis: (:1) 2025-03-14T06:00:23.4278872Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4279346Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4279355Z 2025-03-14T06:00:23.4279851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4280114Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4280685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4280937Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4281449Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4281780Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4282142Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4282540Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4284008Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4285450Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4286342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4287196Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4287971Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4288678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4289448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4290094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4290361Z Execution Analysis: .......... 2025-03-14T06:00:23.4290973Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4291471Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4292159Z pt-xla-profiler: TransferFromDeviceTime too frequent: 824 counts during 785 steps 2025-03-14T06:00:23.4292212Z 2025-03-14T06:00:23.4292712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4292967Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4293690Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4293949Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4294451Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4294784Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4295137Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4295531Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4296426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4297284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4298061Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4298716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4299476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4300122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4300928Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4301207Z Execution Analysis: (:1) 2025-03-14T06:00:23.4301818Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4302302Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4302312Z 2025-03-14T06:00:23.4302798Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4303063Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4303622Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4303875Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4304375Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4304710Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4305065Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4305461Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4306919Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4308325Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4309218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4310089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4310913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4311583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4312332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4312997Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4313236Z Execution Analysis: .......... 2025-03-14T06:00:23.4313869Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4314352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4315095Z pt-xla-profiler: TransferFromDeviceTime too frequent: 825 counts during 786 steps 2025-03-14T06:00:23.4315105Z 2025-03-14T06:00:23.4315580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4315859Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4316562Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4316845Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4317317Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4317676Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4317998Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4318406Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4319285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4320159Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4320923Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4321598Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4322330Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4323077Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4323789Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4324088Z Execution Analysis: (:1) 2025-03-14T06:00:23.4324751Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4325260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4325273Z 2025-03-14T06:00:23.4325754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4326044Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4326591Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4326870Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4327354Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4327714Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4328060Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4328476Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4329930Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4331358Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4332236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4333162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4333927Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4334611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4335349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4336013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4336255Z Execution Analysis: .......... 2025-03-14T06:00:23.4336892Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4337415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4338127Z pt-xla-profiler: TransferFromDeviceTime too frequent: 826 counts during 787 steps 2025-03-14T06:00:23.4338137Z 2025-03-14T06:00:23.4338618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4338911Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4339615Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4339888Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4340370Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4340724Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4341053Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4341467Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4342335Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4343210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4343972Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4344648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4345478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4346141Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4346844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4347148Z Execution Analysis: (:1) 2025-03-14T06:00:23.4347758Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4348262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4348273Z 2025-03-14T06:00:23.4348774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4349035Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4349591Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4349865Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4350347Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4350697Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4351038Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4351447Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4352895Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4354310Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4355191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4356087Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4356862Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4357518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4358275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4358920Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4359178Z Execution Analysis: .......... 2025-03-14T06:00:23.4359789Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4360328Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4361007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 827 counts during 788 steps 2025-03-14T06:00:23.4361022Z 2025-03-14T06:00:23.4361520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4361788Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4362511Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4362761Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4363267Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4363594Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4363948Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4364336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4365271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4366236Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4367012Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4367846Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4368608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4369251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4369974Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4370252Z Execution Analysis: (:1) 2025-03-14T06:00:23.4370885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4371365Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4371374Z 2025-03-14T06:00:23.4371875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4372133Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4372703Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4372961Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4373466Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4373798Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4374167Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4374556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4376031Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4377438Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4378396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4379267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4380043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4380707Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4381466Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4382106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4382430Z Execution Analysis: .......... 2025-03-14T06:00:23.4383046Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4383544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4384231Z pt-xla-profiler: TransferFromDeviceTime too frequent: 828 counts during 789 steps 2025-03-14T06:00:23.4384245Z 2025-03-14T06:00:23.4384739Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4384999Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4385712Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4385967Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4386466Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4386805Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4387153Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4387549Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4388441Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4389299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4390176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4390837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4391593Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4392234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4392950Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4393236Z Execution Analysis: (:1) 2025-03-14T06:00:23.4393868Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4394360Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4394369Z 2025-03-14T06:00:23.4394845Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4395138Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4395685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4395952Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4396429Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4396777Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4397109Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4397513Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4398952Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4400422Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4401295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4402174Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4402926Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4403602Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4404340Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4405056Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4405339Z Execution Analysis: .......... 2025-03-14T06:00:23.4405967Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4406444Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4407148Z pt-xla-profiler: TransferFromDeviceTime too frequent: 829 counts during 790 steps 2025-03-14T06:00:23.4407160Z 2025-03-14T06:00:23.4407630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4407905Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4408612Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4408876Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4409355Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4409718Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4410045Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4410456Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4411325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4412246Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4413046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4413727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4414468Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4415131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4415831Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4416133Z Execution Analysis: (:1) 2025-03-14T06:00:23.4416747Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4417234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4417247Z 2025-03-14T06:00:23.4417726Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4418005Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4418548Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4418820Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4419296Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4419645Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4419981Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4420394Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4421838Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4423299Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4424179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4425040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4425800Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4426462Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4427207Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4427912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4428149Z Execution Analysis: .......... 2025-03-14T06:00:23.4428781Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4429275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4429977Z pt-xla-profiler: TransferFromDeviceTime too frequent: 830 counts during 791 steps 2025-03-14T06:00:23.4429987Z 2025-03-14T06:00:23.4430480Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4430742Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4431454Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4431711Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4432216Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4432555Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4432890Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4433297Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4434179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4435135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4435907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4436563Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4437316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4437954Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4438678Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4438961Z Execution Analysis: (:1) 2025-03-14T06:00:23.4439597Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4440073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4440089Z 2025-03-14T06:00:23.4440583Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4440839Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4441410Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4441659Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4442162Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4442487Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4442846Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4443245Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4444832Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4446240Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4447139Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4447991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4448767Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4449437Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4450246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4450885Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4451147Z Execution Analysis: .......... 2025-03-14T06:00:23.4451766Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4452269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4452952Z pt-xla-profiler: TransferFromDeviceTime too frequent: 831 counts during 792 steps 2025-03-14T06:00:23.4452962Z 2025-03-14T06:00:23.4453455Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4453712Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4454422Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4454675Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4455165Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4455494Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4455852Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4456258Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4457237Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4458092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4458866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4459524Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4460277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4460918Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4461638Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4461917Z Execution Analysis: (:1) 2025-03-14T06:00:23.4462557Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4463043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4463053Z 2025-03-14T06:00:23.4463547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4463803Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4464371Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4464627Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4465123Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4465565Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4465917Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4466312Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4467865Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4469284Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4470179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4471037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4471809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4472529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4473277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4473943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4474181Z Execution Analysis: .......... 2025-03-14T06:00:23.4474812Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4475287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4475983Z pt-xla-profiler: TransferFromDeviceTime too frequent: 832 counts during 793 steps 2025-03-14T06:00:23.4475992Z 2025-03-14T06:00:23.4476466Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4476746Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4477451Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4477718Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4478202Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4478563Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4478890Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4479442Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4480316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4481186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4481949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4482619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4483364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4484024Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4484777Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4485080Z Execution Analysis: (:1) 2025-03-14T06:00:23.4485690Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4486185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4486194Z 2025-03-14T06:00:23.4486673Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4486956Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4487503Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4487779Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4488254Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4488604Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4488920Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4489148Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4489750Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4490334Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4490694Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4491056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4491402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4491692Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4492006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4492290Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4492404Z Execution Analysis: .......... 2025-03-14T06:00:23.4492679Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4492886Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4493187Z pt-xla-profiler: TransferFromDeviceTime too frequent: 833 counts during 794 steps 2025-03-14T06:00:23.4493192Z 2025-03-14T06:00:23.4493399Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4493532Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4493827Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4493953Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4494162Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4494320Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4494514Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4494695Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4495055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4495420Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4495731Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4496017Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4496323Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4496604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4496896Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4497038Z Execution Analysis: (:1) 2025-03-14T06:00:23.4497293Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4497504Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4497508Z 2025-03-14T06:00:23.4497709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4497837Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4498069Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4498190Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4498393Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4498547Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4498721Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4498904Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4499495Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4500180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4500538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4500884Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4501230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4501498Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4501813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4502082Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4502195Z Execution Analysis: .......... 2025-03-14T06:00:23.4502448Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4502657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4502936Z pt-xla-profiler: TransferFromDeviceTime too frequent: 834 counts during 795 steps 2025-03-14T06:00:23.4502941Z 2025-03-14T06:00:23.4503153Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4503265Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4503556Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4503667Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4503873Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4504062Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4504209Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4504374Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4504728Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4505073Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4505388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4505661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4505970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4506236Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4506540Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4506664Z Execution Analysis: (:1) 2025-03-14T06:00:23.4506927Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4507129Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4507133Z 2025-03-14T06:00:23.4507342Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4507458Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4507696Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4507808Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4508014Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4508180Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4508340Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4508505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4509091Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4509652Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4510019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4510390Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4510703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4510975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4511290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4511554Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4511674Z Execution Analysis: .......... 2025-03-14T06:00:23.4511927Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4512137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4512418Z pt-xla-profiler: TransferFromDeviceTime too frequent: 835 counts during 796 steps 2025-03-14T06:00:23.4512425Z 2025-03-14T06:00:23.4512633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4512746Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4513040Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4513177Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4513406Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4513548Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4513699Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4513865Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4514223Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4514566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4514883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4515147Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4515459Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4515726Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4516021Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4516143Z Execution Analysis: (:1) 2025-03-14T06:00:23.4516406Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4516601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4516619Z 2025-03-14T06:00:23.4516817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4516944Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4517171Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4517287Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4517512Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4517667Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4517811Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4517975Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4518561Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4519126Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4519515Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4519865Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4520171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4520448Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4520920Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4521202Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4521419Z Execution Analysis: .......... 2025-03-14T06:00:23.4521684Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4521884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4522175Z pt-xla-profiler: TransferFromDeviceTime too frequent: 836 counts during 797 steps 2025-03-14T06:00:23.4522180Z 2025-03-14T06:00:23.4522382Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4522508Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4522844Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4522963Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4523164Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4523314Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4523455Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4523630Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4523980Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4524571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4524888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4525178Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4525486Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4529408Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4529757Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4529891Z Execution Analysis: (:1) 2025-03-14T06:00:23.4530155Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4530364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4530373Z 2025-03-14T06:00:23.4530573Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4530693Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4530981Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4531102Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4531309Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4531459Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4531603Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4531778Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4532381Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4532968Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4533365Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4533725Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4534036Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4534326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4534630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4534911Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4535014Z Execution Analysis: .......... 2025-03-14T06:00:23.4535279Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4535481Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4535770Z pt-xla-profiler: TransferFromDeviceTime too frequent: 837 counts during 798 steps 2025-03-14T06:00:23.4535776Z 2025-03-14T06:00:23.4535977Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4536123Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4536435Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4536554Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4536756Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4536904Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4537046Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4537222Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4537578Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4537939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4538253Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4538533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4538840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4539113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4539404Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4539533Z Execution Analysis: (:1) 2025-03-14T06:00:23.4539789Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4539997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4540002Z 2025-03-14T06:00:23.4540199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4540419Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4540647Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4540764Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4540964Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4541113Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4541255Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4541430Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4542018Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4542621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4542985Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4543335Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4543760Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4544024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4544329Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4544587Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4544692Z Execution Analysis: .......... 2025-03-14T06:00:23.4544942Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4545144Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4545418Z pt-xla-profiler: TransferFromDeviceTime too frequent: 838 counts during 799 steps 2025-03-14T06:00:23.4545426Z 2025-03-14T06:00:23.4545649Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4545780Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4546062Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4546165Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4546365Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4546504Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4546648Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4546812Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4547161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4547500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4547808Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4548071Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4548371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4548629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4548915Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4549033Z Execution Analysis: (:1) 2025-03-14T06:00:23.4549287Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4549482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4549486Z 2025-03-14T06:00:23.4549711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4549822Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4550053Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4550157Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4550360Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4550502Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4550647Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4550810Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4551392Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4551975Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4552331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4552677Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4552987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4553250Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4553552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4553811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4553921Z Execution Analysis: .......... 2025-03-14T06:00:23.4554168Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4554369Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4554647Z pt-xla-profiler: TransferFromDeviceTime too frequent: 839 counts during 800 steps 2025-03-14T06:00:23.4554675Z 2025-03-14T06:00:23.4554897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4555006Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4555293Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4555398Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4555605Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4555743Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4555889Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4556051Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4556403Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4556748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4557059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4557322Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4557623Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4557880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4558170Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4558289Z Execution Analysis: (:1) 2025-03-14T06:00:23.4558545Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4558738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4558773Z 2025-03-14T06:00:23.4558966Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4559085Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4559304Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4559413Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4559608Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4559753Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4559893Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4560062Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4561520Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4562085Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4562433Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4562775Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4563074Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4563342Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4563636Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4563902Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4564001Z Execution Analysis: .......... 2025-03-14T06:00:23.4564255Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4564451Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4565073Z pt-xla-profiler: TransferFromDeviceTime too frequent: 840 counts during 801 steps 2025-03-14T06:00:23.4565080Z 2025-03-14T06:00:23.4565279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4565568Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4565856Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4565969Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4566171Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4566320Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4566457Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4566628Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4566985Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4567342Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4567651Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4567928Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4568231Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4568500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4568789Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4568920Z Execution Analysis: (:1) 2025-03-14T06:00:23.4569173Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4569440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4569448Z 2025-03-14T06:00:23.4569648Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4569762Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4569994Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4570118Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4570325Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4570481Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4570628Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4570848Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4571444Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4572034Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4572400Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4572769Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4573085Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4573375Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4573686Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4573975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4574085Z Execution Analysis: .......... 2025-03-14T06:00:23.4574364Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4574640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4574944Z pt-xla-profiler: TransferFromDeviceTime too frequent: 841 counts during 802 steps 2025-03-14T06:00:23.4574950Z 2025-03-14T06:00:23.4575169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4575287Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4575593Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4575706Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4575916Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4576076Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4576223Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4576410Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4576771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4577248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4577569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4577837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4578154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4578422Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4578724Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4578850Z Execution Analysis: (:1) 2025-03-14T06:00:23.4579148Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4579353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4579358Z 2025-03-14T06:00:23.4579568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4579683Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4579927Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4580039Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4580253Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4580399Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4580584Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4580751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4581341Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4581906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4582271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4582614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4582931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4583203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4583521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4583788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4583911Z Execution Analysis: .......... 2025-03-14T06:00:23.4584166Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4584424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4584703Z pt-xla-profiler: TransferFromDeviceTime too frequent: 843 counts during 803 steps 2025-03-14T06:00:23.4584707Z 2025-03-14T06:00:23.4584913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4585025Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4585320Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4585431Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4585640Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4585783Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4585933Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4586097Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4586464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4586806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4587119Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4587390Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4587703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4587969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4588273Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4588396Z Execution Analysis: (:1) 2025-03-14T06:00:23.4588683Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4588884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4588889Z 2025-03-14T06:00:23.4589098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4589211Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4589449Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4589561Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4589777Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4589944Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4590102Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4590269Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4590859Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4591422Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4591782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4592125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4592444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4592715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4593028Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4593295Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4593437Z Execution Analysis: .......... 2025-03-14T06:00:23.4593714Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4593926Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4594215Z pt-xla-profiler: TransferFromDeviceTime too frequent: 844 counts during 804 steps 2025-03-14T06:00:23.4594221Z 2025-03-14T06:00:23.4594420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4594542Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4594828Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4594951Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4595152Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4595309Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4595449Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4595628Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4595979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4596334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4596639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4596925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4597228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4597501Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4597811Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4597948Z Execution Analysis: (:1) 2025-03-14T06:00:23.4598206Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4598416Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4598420Z 2025-03-14T06:00:23.4598619Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4598741Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4598965Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4599120Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4599322Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4599475Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4599619Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4599796Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4600375Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4600940Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4601294Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4601648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4601956Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4602238Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4602541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4602818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4602971Z Execution Analysis: .......... 2025-03-14T06:00:23.4603236Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4603435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4603724Z pt-xla-profiler: TransferFromDeviceTime too frequent: 845 counts during 805 steps 2025-03-14T06:00:23.4603729Z 2025-03-14T06:00:23.4603928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4604054Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4604338Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4604462Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4604757Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4604916Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4605226Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4605410Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4605772Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4606139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4606453Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4606742Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4607052Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4607334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4607657Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4607800Z Execution Analysis: (:1) 2025-03-14T06:00:23.4608062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4608276Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4608280Z 2025-03-14T06:00:23.4608484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4608613Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4608875Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4608997Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4609206Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4609363Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4609515Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4609702Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4610300Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4610887Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4611260Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4611615Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4611943Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4612219Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4612546Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4612869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4612991Z Execution Analysis: .......... 2025-03-14T06:00:23.4613250Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4613465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4613750Z pt-xla-profiler: TransferFromDeviceTime too frequent: 846 counts during 806 steps 2025-03-14T06:00:23.4613757Z 2025-03-14T06:00:23.4613971Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4614087Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4614387Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4614503Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4614722Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4614869Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4615022Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4615193Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4615572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4615924Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4616243Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4616516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4616825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4617121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4617525Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4617646Z Execution Analysis: (:1) 2025-03-14T06:00:23.4617905Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4618101Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4618105Z 2025-03-14T06:00:23.4618301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4618438Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4618663Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4618769Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4618975Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4619112Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4619262Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4619428Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4620015Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4620572Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4620929Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4621273Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4621584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4621852Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4622201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4622465Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4622572Z Execution Analysis: .......... 2025-03-14T06:00:23.4622822Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4623024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4623302Z pt-xla-profiler: TransferFromDeviceTime too frequent: 847 counts during 807 steps 2025-03-14T06:00:23.4623308Z 2025-03-14T06:00:23.4623510Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4623620Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4623911Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4624020Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4624229Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4624368Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4624512Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4624678Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4625030Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4625370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4625681Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4625947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4626275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4626537Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4626824Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4626942Z Execution Analysis: (:1) 2025-03-14T06:00:23.4627195Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4627386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4627397Z 2025-03-14T06:00:23.4627615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4627726Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4627948Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4628061Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4628258Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4628397Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4628543Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4628703Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4629279Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4629837Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4630190Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4630536Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4630838Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4631159Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4631458Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4631719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4631820Z Execution Analysis: .......... 2025-03-14T06:00:23.4632075Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4632269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4632550Z pt-xla-profiler: TransferFromDeviceTime too frequent: 848 counts during 808 steps 2025-03-14T06:00:23.4632555Z 2025-03-14T06:00:23.4632750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4633032Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4633326Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4633439Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4633640Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4633786Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4633926Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4634095Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4634452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4634807Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4635116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4635428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4635738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4636011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4636301Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4636429Z Execution Analysis: (:1) 2025-03-14T06:00:23.4636686Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4636891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4636921Z 2025-03-14T06:00:23.4637124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4637243Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4637473Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4637587Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4637789Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4637937Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4638082Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4638254Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4638842Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4639423Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4639783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4640138Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4640506Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4640785Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4641088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4641364Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4641470Z Execution Analysis: .......... 2025-03-14T06:00:23.4641733Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4641934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4642224Z pt-xla-profiler: TransferFromDeviceTime too frequent: 849 counts during 809 steps 2025-03-14T06:00:23.4642228Z 2025-03-14T06:00:23.4642428Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4642550Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4642835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4642954Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4643153Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4643303Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4643444Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4643620Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4643976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4644331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4644762Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4645048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4645358Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4645635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4645930Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4646054Z Execution Analysis: (:1) 2025-03-14T06:00:23.4646317Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4646546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4646550Z 2025-03-14T06:00:23.4646755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4646872Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4647110Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4647228Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4647437Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4647578Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4647727Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4647892Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4648487Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4649061Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4649426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4649774Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4650138Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4650410Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4650720Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4650986Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4651094Z Execution Analysis: .......... 2025-03-14T06:00:23.4651353Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4651560Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4651846Z pt-xla-profiler: TransferFromDeviceTime too frequent: 850 counts during 810 steps 2025-03-14T06:00:23.4651852Z 2025-03-14T06:00:23.4652063Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4652177Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4652471Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4652579Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4652787Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4652931Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4653077Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4653246Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4653604Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4653979Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4654294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4654567Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4654875Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4655142Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4655439Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4655560Z Execution Analysis: (:1) 2025-03-14T06:00:23.4655845Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4656045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4656049Z 2025-03-14T06:00:23.4656257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4656377Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4656614Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4656724Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4656933Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4657077Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4657338Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4657500Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4658079Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4658640Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4658998Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4659384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4659698Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4659965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4660273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4660536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4660646Z Execution Analysis: .......... 2025-03-14T06:00:23.4660895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4661100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4661375Z pt-xla-profiler: TransferFromDeviceTime too frequent: 851 counts during 811 steps 2025-03-14T06:00:23.4661387Z 2025-03-14T06:00:23.4661585Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4661701Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4661983Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4662095Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4662293Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4662437Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4662577Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4662736Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4663090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4663463Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4663768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4664035Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4664335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4664602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4664888Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4665037Z Execution Analysis: (:1) 2025-03-14T06:00:23.4665411Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4665627Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4665634Z 2025-03-14T06:00:23.4665997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4666117Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4666346Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4666463Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4666668Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4666816Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4666962Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4667132Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4667726Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4668302Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4668773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4669129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4669441Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4669715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4670019Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4670297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4670399Z Execution Analysis: .......... 2025-03-14T06:00:23.4670659Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4670861Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4671151Z pt-xla-profiler: TransferFromDeviceTime too frequent: 852 counts during 812 steps 2025-03-14T06:00:23.4671159Z 2025-03-14T06:00:23.4671358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4671475Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4671763Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4671876Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4672076Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4672224Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4672364Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4672532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4672920Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4673280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4673588Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4673867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4674169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4674439Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4674764Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4674891Z Execution Analysis: (:1) 2025-03-14T06:00:23.4675146Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4675352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4675358Z 2025-03-14T06:00:23.4675558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4675677Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4675906Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4676019Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4676223Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4676370Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4676516Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4676690Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4677275Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4677876Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4678361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4678708Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4679008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4679277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4679579Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4679837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4679941Z Execution Analysis: .......... 2025-03-14T06:00:23.4680194Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4680396Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4680675Z pt-xla-profiler: TransferFromDeviceTime too frequent: 853 counts during 813 steps 2025-03-14T06:00:23.4680679Z 2025-03-14T06:00:23.4680881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4680991Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4681278Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4681384Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4681586Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4681724Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4681866Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4682052Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4682405Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4682747Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4683054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4683317Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4683617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4683877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4684188Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4684307Z Execution Analysis: (:1) 2025-03-14T06:00:23.4684627Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4684829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4684833Z 2025-03-14T06:00:23.4685202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4685316Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4685553Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4685662Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4685869Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4686014Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4686164Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4686332Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4686924Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4687621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4687986Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4688336Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4688654Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4688926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4689242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4689512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4689625Z Execution Analysis: .......... 2025-03-14T06:00:23.4689883Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4690092Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4690380Z pt-xla-profiler: TransferFromDeviceTime too frequent: 854 counts during 814 steps 2025-03-14T06:00:23.4690385Z 2025-03-14T06:00:23.4690595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4690709Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4691006Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4691115Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4691324Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4691470Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4691648Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4691819Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4692182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4692531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4692847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4693119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4693429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4693724Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4694019Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4694146Z Execution Analysis: (:1) 2025-03-14T06:00:23.4694414Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4694614Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4694619Z 2025-03-14T06:00:23.4694827Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4694939Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4695175Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4695281Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4695493Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4695634Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4695784Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4695950Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4696573Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4697277Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4697632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4697979Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4698282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4698554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4698851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4699116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4699219Z Execution Analysis: .......... 2025-03-14T06:00:23.4699472Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4699664Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4699945Z pt-xla-profiler: TransferFromDeviceTime too frequent: 855 counts during 815 steps 2025-03-14T06:00:23.4699949Z 2025-03-14T06:00:23.4700145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4700261Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4700542Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4700653Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4700848Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4701017Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4701162Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4701335Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4701681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4702030Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4702333Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4702605Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4702928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4703198Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4703484Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4703614Z Execution Analysis: (:1) 2025-03-14T06:00:23.4703866Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4704069Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4704074Z 2025-03-14T06:00:23.4704272Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4704391Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4704615Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4704732Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4704930Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4705076Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4705218Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4705390Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4706023Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4706587Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4706937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4707287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4707594Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4707865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4708166Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4708441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4708544Z Execution Analysis: .......... 2025-03-14T06:00:23.4708803Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4709000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4709288Z pt-xla-profiler: TransferFromDeviceTime too frequent: 856 counts during 816 steps 2025-03-14T06:00:23.4709293Z 2025-03-14T06:00:23.4709489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4709609Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4709893Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4710005Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4710224Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4710372Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4710508Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4710677Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4711023Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4711369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4711671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4711964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4712262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4712533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4712817Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4712945Z Execution Analysis: (:1) 2025-03-14T06:00:23.4713195Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4713397Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4713402Z 2025-03-14T06:00:23.4713599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4713708Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4713937Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4714041Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4714242Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4714379Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4714527Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4714737Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4715320Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4715875Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4716229Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4716571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4716880Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4717146Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4717450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4717715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4717828Z Execution Analysis: .......... 2025-03-14T06:00:23.4718077Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4718279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4718555Z pt-xla-profiler: TransferFromDeviceTime too frequent: 857 counts during 817 steps 2025-03-14T06:00:23.4718561Z 2025-03-14T06:00:23.4718763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4718871Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4719181Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4719286Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4719494Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4719633Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4719774Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4719936Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4720288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4720628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4720962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4721224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4721529Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4721791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4722087Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4722208Z Execution Analysis: (:1) 2025-03-14T06:00:23.4722465Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4722660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4722664Z 2025-03-14T06:00:23.4722864Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4722977Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4723208Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4723316Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4723521Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4723660Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4723855Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4724019Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4724682Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4725416Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4725783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4726138Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4726454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4726729Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4727047Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4727317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4727429Z Execution Analysis: .......... 2025-03-14T06:00:23.4727685Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4727893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4728182Z pt-xla-profiler: TransferFromDeviceTime too frequent: 858 counts during 818 steps 2025-03-14T06:00:23.4728196Z 2025-03-14T06:00:23.4728395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4728510Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4728835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4728950Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4729153Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4729298Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4729444Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4729612Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4729975Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4730324Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4730664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4730936Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4731251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4731529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4731819Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4731951Z Execution Analysis: (:1) 2025-03-14T06:00:23.4732208Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4732415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4732421Z 2025-03-14T06:00:23.4732622Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4732739Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4732968Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4733086Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4733288Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4733490Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4733635Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4733810Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4734399Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4734978Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4735339Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4735695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4736007Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4736291Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4736598Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4736871Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4736976Z Execution Analysis: .......... 2025-03-14T06:00:23.4737349Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4737543Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4737827Z pt-xla-profiler: TransferFromDeviceTime too frequent: 859 counts during 819 steps 2025-03-14T06:00:23.4737832Z 2025-03-14T06:00:23.4738052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4738171Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4738456Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4738569Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4738765Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4738910Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4739049Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4739222Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4739569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4739954Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4740258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4740532Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4740833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4741098Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4741381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4741508Z Execution Analysis: (:1) 2025-03-14T06:00:23.4741756Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4741957Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4741963Z 2025-03-14T06:00:23.4742158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4742272Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4742498Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4742637Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4742858Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4743006Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4743149Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4743320Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4743896Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4744456Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4744809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4745158Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4745464Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4745735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4746032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4746305Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4746409Z Execution Analysis: .......... 2025-03-14T06:00:23.4746668Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4746869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4747152Z pt-xla-profiler: TransferFromDeviceTime too frequent: 860 counts during 820 steps 2025-03-14T06:00:23.4747157Z 2025-03-14T06:00:23.4747385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4747501Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4747788Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4747894Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4748096Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4748236Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4748381Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4748545Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4748922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4749266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4749577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4749846Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4750150Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4750412Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4750705Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4750826Z Execution Analysis: (:1) 2025-03-14T06:00:23.4751084Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4751282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4751286Z 2025-03-14T06:00:23.4751488Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4751600Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4751877Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4751986Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4752195Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4752333Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4752486Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4752650Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4753233Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4753788Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4754147Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4754489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4754799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4755062Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4755365Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4755624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4755732Z Execution Analysis: .......... 2025-03-14T06:00:23.4755983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4756182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4756478Z pt-xla-profiler: TransferFromDeviceTime too frequent: 861 counts during 821 steps 2025-03-14T06:00:23.4756485Z 2025-03-14T06:00:23.4756692Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4756800Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4757088Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4757196Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4757399Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4757538Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4757681Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4757872Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4758227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4758569Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4758877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4759145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4759445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4759703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4759991Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4760112Z Execution Analysis: (:1) 2025-03-14T06:00:23.4760370Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4760565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4760569Z 2025-03-14T06:00:23.4760773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4760906Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4761158Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4761263Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4761466Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4761603Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4761748Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4761910Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4762489Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4763047Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4763402Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4763752Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4764052Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4764324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4764691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4765126Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4765234Z Execution Analysis: .......... 2025-03-14T06:00:23.4765645Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4765911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4766206Z pt-xla-profiler: TransferFromDeviceTime too frequent: 862 counts during 822 steps 2025-03-14T06:00:23.4766215Z 2025-03-14T06:00:23.4766415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4766536Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4766824Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4766940Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4767142Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4767291Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4767466Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4767641Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4767998Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4768356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4768668Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4768945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4769251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4769525Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4769815Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4769951Z Execution Analysis: (:1) 2025-03-14T06:00:23.4770209Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4770421Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4770425Z 2025-03-14T06:00:23.4770692Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4770814Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4771044Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4771163Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4771366Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4771514Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4771657Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4771835Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4772426Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4773005Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4773367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4773723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4774035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4774313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4774619Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4774896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4774999Z Execution Analysis: .......... 2025-03-14T06:00:23.4775262Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4775500Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4775795Z pt-xla-profiler: TransferFromDeviceTime too frequent: 864 counts during 823 steps 2025-03-14T06:00:23.4775800Z 2025-03-14T06:00:23.4775998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4776117Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4776404Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4776520Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4776723Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4776897Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4777036Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4777211Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4777676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4778027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4778328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4778598Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4778897Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4779163Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4779447Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4779570Z Execution Analysis: (:1) 2025-03-14T06:00:23.4779818Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4780023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4780052Z 2025-03-14T06:00:23.4780280Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4780391Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4780616Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4780726Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4780922Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4781063Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4781213Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4781382Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4781959Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4782524Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4782880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4783218Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4783529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4783793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4784096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4784355Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4784465Z Execution Analysis: .......... 2025-03-14T06:00:23.4784739Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4784946Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4785222Z pt-xla-profiler: TransferFromDeviceTime too frequent: 865 counts during 824 steps 2025-03-14T06:00:23.4785226Z 2025-03-14T06:00:23.4785426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4785534Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4785829Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4785958Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4786168Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4786308Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4786459Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4786624Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4787148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4787497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4787820Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4788091Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4788404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4788671Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4788971Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4789094Z Execution Analysis: (:1) 2025-03-14T06:00:23.4789361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4789615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4789619Z 2025-03-14T06:00:23.4789829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4789944Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4790186Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4790297Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4790515Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4790659Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4790819Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4790985Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4791584Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4792161Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4792530Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4792880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4793198Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4793472Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4793785Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4794157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4794295Z Execution Analysis: .......... 2025-03-14T06:00:23.4794553Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4794758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4795037Z pt-xla-profiler: TransferFromDeviceTime too frequent: 866 counts during 825 steps 2025-03-14T06:00:23.4795041Z 2025-03-14T06:00:23.4795249Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4795356Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4795644Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4795777Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4796146Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4796288Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4796446Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4796614Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4796983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4797331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4797645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4797915Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4798226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4798492Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4798791Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4799025Z Execution Analysis: (:1) 2025-03-14T06:00:23.4799334Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4799542Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4799546Z 2025-03-14T06:00:23.4799739Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4799861Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4800083Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4800198Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4800397Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4800544Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4800683Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4800860Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4801435Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4802002Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4802348Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4802695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4802995Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4803271Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4803567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4804036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4804139Z Execution Analysis: .......... 2025-03-14T06:00:23.4804402Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4804709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4805162Z pt-xla-profiler: TransferFromDeviceTime too frequent: 867 counts during 826 steps 2025-03-14T06:00:23.4805170Z 2025-03-14T06:00:23.4805371Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4805522Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4805813Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4805931Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4806133Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4806286Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4806430Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4806608Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4806965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4807325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4807634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4807916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4808225Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4808507Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4808802Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4808966Z Execution Analysis: (:1) 2025-03-14T06:00:23.4809258Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4809471Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4809475Z 2025-03-14T06:00:23.4809675Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4809798Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4810028Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4810147Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4810350Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4810500Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4810646Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4810820Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4811412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4811996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4812352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4812715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4813030Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4813312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4813643Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4813926Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4814032Z Execution Analysis: .......... 2025-03-14T06:00:23.4814298Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4814498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4814790Z pt-xla-profiler: TransferFromDeviceTime too frequent: 868 counts during 827 steps 2025-03-14T06:00:23.4814795Z 2025-03-14T06:00:23.4815009Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4815145Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4815442Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4815550Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4815762Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4815907Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4816051Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4816224Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4816582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4816941Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4817355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4817607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4817898Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4818150Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4818480Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4818594Z Execution Analysis: (:1) 2025-03-14T06:00:23.4818841Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4819023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4819027Z 2025-03-14T06:00:23.4819221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4819325Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4819546Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4819644Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4819844Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4819977Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4820126Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4820281Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4820834Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4821361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4821701Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4822023Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4822325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4822602Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4822896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4823147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4823254Z Execution Analysis: .......... 2025-03-14T06:00:23.4823490Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4823684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4823946Z pt-xla-profiler: TransferFromDeviceTime too frequent: 869 counts during 828 steps 2025-03-14T06:00:23.4823976Z 2025-03-14T06:00:23.4824173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4824280Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4824561Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4824663Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4824864Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4824997Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4825137Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4825290Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4825627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4825951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4826247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4826496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4826791Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4827036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4827358Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4827473Z Execution Analysis: (:1) 2025-03-14T06:00:23.4827720Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4827907Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4827911Z 2025-03-14T06:00:23.4828105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4828213Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4828435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4828537Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4828737Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4828870Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4829015Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4829173Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4829728Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4830258Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4830597Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4830923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4831243Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4831496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4831796Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4832059Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4832161Z Execution Analysis: .......... 2025-03-14T06:00:23.4832401Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4832598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4832891Z pt-xla-profiler: TransferFromDeviceTime too frequent: 870 counts during 829 steps 2025-03-14T06:00:23.4832895Z 2025-03-14T06:00:23.4833082Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4833203Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4833468Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4833584Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4833774Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4833924Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4834054Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4834222Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4834551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4834884Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4835172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4835430Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4835714Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4836090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4836360Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4836486Z Execution Analysis: (:1) 2025-03-14T06:00:23.4836726Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4836922Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4836927Z 2025-03-14T06:00:23.4837110Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4837229Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4837442Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4837557Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4837746Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4837887Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4838021Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4838184Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4838724Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4839260Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4839591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4839925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4840236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4840500Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4840781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4841038Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4841133Z Execution Analysis: .......... 2025-03-14T06:00:23.4841383Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4841592Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4841861Z pt-xla-profiler: TransferFromDeviceTime too frequent: 871 counts during 830 steps 2025-03-14T06:00:23.4841865Z 2025-03-14T06:00:23.4842050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4842163Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4842432Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4842543Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4842730Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4842873Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4843007Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4843170Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4843499Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4843835Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4844126Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4844389Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4844831Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4845270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4845560Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4845692Z Execution Analysis: (:1) 2025-03-14T06:00:23.4845948Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4846160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4846167Z 2025-03-14T06:00:23.4846368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4846488Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4846721Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4846839Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4847047Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4847196Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4847340Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4847515Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4848103Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4848688Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4849057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4849430Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4849754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4850026Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4850343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4850613Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4850726Z Execution Analysis: .......... 2025-03-14T06:00:23.4850983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4851220Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4851501Z pt-xla-profiler: TransferFromDeviceTime too frequent: 872 counts during 831 steps 2025-03-14T06:00:23.4851505Z 2025-03-14T06:00:23.4851715Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4851831Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4852128Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4852235Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4852444Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4852588Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4852736Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4852906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4853278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4853627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4853949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4854268Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4854585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4854855Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4855153Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4855276Z Execution Analysis: (:1) 2025-03-14T06:00:23.4855542Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4855742Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4855747Z 2025-03-14T06:00:23.4855959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4856073Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4856319Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4856428Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4856640Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4856782Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4856933Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4857102Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4857770Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4858300Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4858672Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4858999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4859296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4859550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4859841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4860088Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4860223Z Execution Analysis: .......... 2025-03-14T06:00:23.4860457Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4860653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4860915Z pt-xla-profiler: TransferFromDeviceTime too frequent: 873 counts during 832 steps 2025-03-14T06:00:23.4860922Z 2025-03-14T06:00:23.4861119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4861221Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4861497Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4861598Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4861796Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4861929Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4862071Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4862228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4862564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4862888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4863229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4863481Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4863773Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4864016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4864291Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4864406Z Execution Analysis: (:1) 2025-03-14T06:00:23.4864649Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4864834Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4864847Z 2025-03-14T06:00:23.4865036Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4865153Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4865509Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4865622Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4865983Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4866125Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4866276Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4866445Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4867047Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4867691Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4868051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4868412Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4868722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4869007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4869313Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4869591Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4869729Z Execution Analysis: .......... 2025-03-14T06:00:23.4869996Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4870198Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4870497Z pt-xla-profiler: TransferFromDeviceTime too frequent: 874 counts during 833 steps 2025-03-14T06:00:23.4870503Z 2025-03-14T06:00:23.4870705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4870826Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4871118Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4871235Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4871440Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4871595Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4871739Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4871918Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4872280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4872646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4873026Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4873313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4873622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4873901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4874193Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4874331Z Execution Analysis: (:1) 2025-03-14T06:00:23.4874589Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4874803Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4874809Z 2025-03-14T06:00:23.4875019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4875145Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4875378Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4875498Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4875703Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4875856Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4876005Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4876184Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4876776Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4877381Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4877744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4878204Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4878494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4878760Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4879050Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4879352Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4879456Z Execution Analysis: .......... 2025-03-14T06:00:23.4879708Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4879897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4880175Z pt-xla-profiler: TransferFromDeviceTime too frequent: 875 counts during 834 steps 2025-03-14T06:00:23.4880180Z 2025-03-14T06:00:23.4880367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4880483Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4880750Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4880862Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4881052Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4881193Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4881322Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4881488Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4881823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4882203Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4882492Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4882755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4883038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4883468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4883767Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4883889Z Execution Analysis: (:1) 2025-03-14T06:00:23.4884149Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4884348Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4884355Z 2025-03-14T06:00:23.4884652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4884767Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4885169Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4885280Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4885494Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4885636Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4885794Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4885959Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4886591Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4887167Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4887537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4887888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4888209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4888485Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4888827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4889097Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4889210Z Execution Analysis: .......... 2025-03-14T06:00:23.4889472Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4889689Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4889971Z pt-xla-profiler: TransferFromDeviceTime too frequent: 876 counts during 835 steps 2025-03-14T06:00:23.4889976Z 2025-03-14T06:00:23.4890184Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4890300Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4890596Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4890709Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4890922Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4891066Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4891215Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4891388Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4891807Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4892161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4892482Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4892756Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4893071Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4893343Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4893644Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4893768Z Execution Analysis: (:1) 2025-03-14T06:00:23.4894034Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4894243Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4894247Z 2025-03-14T06:00:23.4894458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4894572Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4894807Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4894920Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4895137Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4895285Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4895441Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4895610Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4896234Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4896811Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4897284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4897625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4897938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4898230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4898539Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4898806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4898920Z Execution Analysis: .......... 2025-03-14T06:00:23.4899173Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4899379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4899656Z pt-xla-profiler: TransferFromDeviceTime too frequent: 877 counts during 836 steps 2025-03-14T06:00:23.4899672Z 2025-03-14T06:00:23.4899869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4899988Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4900272Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4900389Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4900588Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4900736Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4900878Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4901098Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4901446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4901794Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4902096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4902366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4902666Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4902942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4903227Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4903359Z Execution Analysis: (:1) 2025-03-14T06:00:23.4903614Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4903819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4903823Z 2025-03-14T06:00:23.4904019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4904143Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4904368Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4904489Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4904691Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4904840Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4904983Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4905179Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4905754Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4906326Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4906679Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4907031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4907458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4907719Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4908004Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4908266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4908369Z Execution Analysis: .......... 2025-03-14T06:00:23.4908619Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4908804Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4909073Z pt-xla-profiler: TransferFromDeviceTime too frequent: 878 counts during 837 steps 2025-03-14T06:00:23.4909078Z 2025-03-14T06:00:23.4909264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4909381Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4909649Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4909758Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4909948Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4913423Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4913688Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4913851Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4914191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4914520Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4914806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4915069Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4915353Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4915603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4915874Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4916000Z Execution Analysis: (:1) 2025-03-14T06:00:23.4916243Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4916438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4916443Z 2025-03-14T06:00:23.4916627Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4916741Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4916952Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4917061Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4917251Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4917387Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4917563Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4917727Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4918280Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4918814Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4919145Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4919475Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4919789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4920047Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4920329Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4920586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4920682Z Execution Analysis: .......... 2025-03-14T06:00:23.4920926Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4921112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4921378Z pt-xla-profiler: TransferFromDeviceTime too frequent: 879 counts during 838 steps 2025-03-14T06:00:23.4921384Z 2025-03-14T06:00:23.4921579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4921682Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4921955Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4922057Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4922242Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4922428Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4922559Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4922714Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4923043Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4923371Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4923653Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4923909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4924195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4924440Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4924817Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4925097Z Execution Analysis: (:1) 2025-03-14T06:00:23.4925366Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4925563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4925568Z 2025-03-14T06:00:23.4925769Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4925882Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4926114Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4926221Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4926428Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4926597Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4926749Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4926915Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4927513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4928086Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4928447Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4928823Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4929137Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4929409Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4929720Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4929984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4930092Z Execution Analysis: .......... 2025-03-14T06:00:23.4930346Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4930550Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4930831Z pt-xla-profiler: TransferFromDeviceTime too frequent: 880 counts during 839 steps 2025-03-14T06:00:23.4930838Z 2025-03-14T06:00:23.4931043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4931154Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4931448Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4931581Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4931815Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4931958Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4932100Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4932266Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4932623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4932974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4933289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4933560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4933873Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4934145Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4934439Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4934560Z Execution Analysis: (:1) 2025-03-14T06:00:23.4934821Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4935020Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4935024Z 2025-03-14T06:00:23.4935229Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4935344Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4935577Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4935685Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4935918Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4936062Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4936216Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4936382Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4936976Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4937542Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4937936Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4938284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4938602Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4938876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4939191Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4939457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4939567Z Execution Analysis: .......... 2025-03-14T06:00:23.4939820Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4940026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4940319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 881 counts during 840 steps 2025-03-14T06:00:23.4940325Z 2025-03-14T06:00:23.4940524Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4940644Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4940931Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4941097Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4941302Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4941449Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4941588Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4941763Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4942116Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4942470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4942778Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4943057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4943465Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4943734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4944119Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4944239Z Execution Analysis: (:1) 2025-03-14T06:00:23.4944475Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4944663Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4944669Z 2025-03-14T06:00:23.4945021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4945137Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4945386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4945498Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4945695Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4945836Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4945977Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4946147Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4946714Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4947272Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4947643Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4947989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4948290Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4948562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4948858Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4949120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4949220Z Execution Analysis: .......... 2025-03-14T06:00:23.4949472Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4949667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4949948Z pt-xla-profiler: TransferFromDeviceTime too frequent: 882 counts during 841 steps 2025-03-14T06:00:23.4949952Z 2025-03-14T06:00:23.4950147Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4950285Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4950598Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4950709Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4950904Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4951045Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4951182Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4951346Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4951691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4952035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4952335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4952610Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4952914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4953188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4953474Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4953608Z Execution Analysis: (:1) 2025-03-14T06:00:23.4953862Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4954073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4954077Z 2025-03-14T06:00:23.4954274Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4954395Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4954647Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4954774Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4954974Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4955124Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4955267Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4955443Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4956017Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4956790Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4957151Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4957517Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4957847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4958126Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4958445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4958717Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4958834Z Execution Analysis: .......... 2025-03-14T06:00:23.4959096Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4959315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4959607Z pt-xla-profiler: TransferFromDeviceTime too frequent: 883 counts during 842 steps 2025-03-14T06:00:23.4959614Z 2025-03-14T06:00:23.4959852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4959995Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4960296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4960410Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4960624Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4960771Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4960926Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4961095Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4961469Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4961823Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4962254Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4962528Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4962839Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4963103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4963400Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4963524Z Execution Analysis: (:1) 2025-03-14T06:00:23.4963792Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4963996Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4964000Z 2025-03-14T06:00:23.4964231Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4964347Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4964668Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4964782Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4965156Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4965425Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4965585Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4965756Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4966359Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4966999Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4967376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4967735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4968059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4968333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4968655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4968926Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4969046Z Execution Analysis: .......... 2025-03-14T06:00:23.4969305Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4969517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4969806Z pt-xla-profiler: TransferFromDeviceTime too frequent: 885 counts during 843 steps 2025-03-14T06:00:23.4969849Z 2025-03-14T06:00:23.4970105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4970224Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4970522Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4970636Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4970853Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4970998Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4971152Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4971322Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4971691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4972047Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4972375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4972651Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4972970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4973240Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4973547Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4973675Z Execution Analysis: (:1) 2025-03-14T06:00:23.4973947Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4974150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4974162Z 2025-03-14T06:00:23.4974407Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4974536Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4974769Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4974880Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4975098Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4975240Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4975399Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4975564Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4976192Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4976782Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4977149Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4977607Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4977899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4978166Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4978454Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4978718Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4978818Z Execution Analysis: .......... 2025-03-14T06:00:23.4979069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4979261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4979585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 886 counts during 844 steps 2025-03-14T06:00:23.4979590Z 2025-03-14T06:00:23.4979781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4979899Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4980170Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4980284Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4980474Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4980621Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4980755Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4980922Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4981255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4981595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4981887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4982153Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4982439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4982699Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4982971Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4983101Z Execution Analysis: (:1) 2025-03-14T06:00:23.4983340Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4983559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4983566Z 2025-03-14T06:00:23.4983755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4983872Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4984087Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4984203Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4984393Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4984538Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4984676Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4984941Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4985487Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4986030Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4986369Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4986702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4986993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4987262Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4987547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4987810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4987908Z Execution Analysis: .......... 2025-03-14T06:00:23.4988164Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4988389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4988701Z pt-xla-profiler: TransferFromDeviceTime too frequent: 887 counts during 845 steps 2025-03-14T06:00:23.4988706Z 2025-03-14T06:00:23.4988895Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4989012Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4989284Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4989397Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4989590Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4989742Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4989876Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4990047Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4990383Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.4990725Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4991014Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4991279Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4991564Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4991825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4992096Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.4992224Z Execution Analysis: (:1) 2025-03-14T06:00:23.4992488Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4992690Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4992696Z 2025-03-14T06:00:23.4992895Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4993001Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4993224Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.4993326Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4993526Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.4993661Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.4993831Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.4993989Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4994549Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.4995084Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.4995423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.4995749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.4996224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.4996493Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.4996806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.4997070Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.4997185Z Execution Analysis: .......... 2025-03-14T06:00:23.4997442Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.4997697Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4997978Z pt-xla-profiler: TransferFromDeviceTime too frequent: 888 counts during 846 steps 2025-03-14T06:00:23.4997983Z 2025-03-14T06:00:23.4998191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.4998302Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.4998586Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.4998696Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.4998901Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.4999039Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.4999184Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.4999345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.4999700Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5000040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5000348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5000611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5000912Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5001172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5001461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5001580Z Execution Analysis: (:1) 2025-03-14T06:00:23.5001858Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5002057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5002061Z 2025-03-14T06:00:23.5002262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5002370Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5002603Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5002707Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5002911Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5003074Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5003224Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5003386Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5003967Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5004595Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5005117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5005466Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5005781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5006056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5006369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5006640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5006755Z Execution Analysis: .......... 2025-03-14T06:00:23.5007065Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5007275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5007560Z pt-xla-profiler: TransferFromDeviceTime too frequent: 889 counts during 847 steps 2025-03-14T06:00:23.5007573Z 2025-03-14T06:00:23.5007771Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5007887Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5008175Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5008293Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5008495Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5008644Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5008782Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5008950Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5009310Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5009667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5009975Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5010250Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5010555Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5010826Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5011136Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5011267Z Execution Analysis: (:1) 2025-03-14T06:00:23.5011523Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5011725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5011729Z 2025-03-14T06:00:23.5011926Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5012041Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5012265Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5012404Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5012604Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5012749Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5012892Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5013064Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5013655Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5014231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5014585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5014941Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5015251Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5015525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5015832Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5016102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5016252Z Execution Analysis: .......... 2025-03-14T06:00:23.5016513Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5016711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5016999Z pt-xla-profiler: TransferFromDeviceTime too frequent: 890 counts during 848 steps 2025-03-14T06:00:23.5017003Z 2025-03-14T06:00:23.5017309Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5017427Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5017703Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5017815Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5018011Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5018157Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5018294Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5018465Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5018809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5019155Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5019454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5019726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5020022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5020289Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5020593Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5020726Z Execution Analysis: (:1) 2025-03-14T06:00:23.5020974Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5021177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5021182Z 2025-03-14T06:00:23.5021376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5021493Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5021847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5021956Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5022142Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5022280Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5022413Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5022576Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5023119Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5023657Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5023988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5024318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5024606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5024862Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5025154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5025449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5025551Z Execution Analysis: .......... 2025-03-14T06:00:23.5025785Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5025979Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5026237Z pt-xla-profiler: TransferFromDeviceTime too frequent: 891 counts during 849 steps 2025-03-14T06:00:23.5026243Z 2025-03-14T06:00:23.5026432Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5026533Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5026810Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5026917Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5027115Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5027245Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5027380Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5027533Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5027865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5028183Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5028481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5028734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5029024Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5029293Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5029572Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5029683Z Execution Analysis: (:1) 2025-03-14T06:00:23.5029923Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5030106Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5030110Z 2025-03-14T06:00:23.5030300Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5030429Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5030646Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5030749Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5030942Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5031072Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5031215Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5031364Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5031918Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5032443Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5032779Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5033103Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5033398Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5033650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5033989Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5034237Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5034342Z Execution Analysis: .......... 2025-03-14T06:00:23.5034581Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5034773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5035034Z pt-xla-profiler: TransferFromDeviceTime too frequent: 892 counts during 850 steps 2025-03-14T06:00:23.5035039Z 2025-03-14T06:00:23.5035234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5035338Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5035613Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5035715Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5035910Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5036039Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5036174Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5036326Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5036661Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5036983Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5037276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5037529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5037836Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5038085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5038361Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5038475Z Execution Analysis: (:1) 2025-03-14T06:00:23.5038717Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5038899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5038903Z 2025-03-14T06:00:23.5039118Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5039220Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5039436Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5039534Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5039731Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5039864Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5040006Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5040159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5040707Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5041232Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5041573Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5041901Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5042191Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5042697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5042980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5043234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5043331Z Execution Analysis: .......... 2025-03-14T06:00:23.5043573Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5043758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5044027Z pt-xla-profiler: TransferFromDeviceTime too frequent: 893 counts during 851 steps 2025-03-14T06:00:23.5044032Z 2025-03-14T06:00:23.5044215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5044329Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5044682Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5044795Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5045152Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5045301Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5045440Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5045613Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5045968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5046327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5046635Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5046947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5047256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5047530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5047818Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5047946Z Execution Analysis: (:1) 2025-03-14T06:00:23.5048202Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5048409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5048438Z 2025-03-14T06:00:23.5048640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5048760Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5048988Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5049101Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5049304Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5049452Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5049594Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5049763Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5050347Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5050925Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5051284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5051642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5052000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5052280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5052581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5052856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5052959Z Execution Analysis: .......... 2025-03-14T06:00:23.5053221Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5053423Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5053715Z pt-xla-profiler: TransferFromDeviceTime too frequent: 894 counts during 852 steps 2025-03-14T06:00:23.5053721Z 2025-03-14T06:00:23.5053920Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5054042Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5054332Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5054447Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5054645Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5054793Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5054931Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5055100Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5055456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5055807Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5056151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5056431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5056742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5057118Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5057398Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5057523Z Execution Analysis: (:1) 2025-03-14T06:00:23.5057772Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5058003Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5058007Z 2025-03-14T06:00:23.5058207Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5058316Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5058543Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5058651Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5058853Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5058989Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5059127Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5059294Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5059872Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5060426Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5060783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5061122Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5061480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5061746Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5062053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5062311Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5062423Z Execution Analysis: .......... 2025-03-14T06:00:23.5062775Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5062966Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5063231Z pt-xla-profiler: TransferFromDeviceTime too frequent: 895 counts during 853 steps 2025-03-14T06:00:23.5063235Z 2025-03-14T06:00:23.5063430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5063532Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5063803Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5063900Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5064094Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5064224Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5064364Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5064516Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5064851Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5065171Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5065626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5066063Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5066379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5066644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5066943Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5067065Z Execution Analysis: (:1) 2025-03-14T06:00:23.5067367Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5067565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5067570Z 2025-03-14T06:00:23.5067781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5067897Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5068138Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5068247Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5068457Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5068597Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5068749Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5068914Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5069513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5070084Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5070452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5070869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5071186Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5071459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5071773Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5072039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5072150Z Execution Analysis: .......... 2025-03-14T06:00:23.5072403Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5072605Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5072891Z pt-xla-profiler: TransferFromDeviceTime too frequent: 896 counts during 854 steps 2025-03-14T06:00:23.5072898Z 2025-03-14T06:00:23.5073106Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5073217Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5073513Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5073622Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5073837Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5073977Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5074126Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5074291Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5074656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5075029Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5075351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5075620Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5075933Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5076203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5076492Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5076646Z Execution Analysis: (:1) 2025-03-14T06:00:23.5076899Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5077107Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5077113Z 2025-03-14T06:00:23.5077309Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5077431Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5077657Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5077770Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5078075Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5078211Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5078343Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5078498Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5079039Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5079573Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5079948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5080276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5080560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5080821Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5081102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5081356Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5081452Z Execution Analysis: .......... 2025-03-14T06:00:23.5081698Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5081886Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5082157Z pt-xla-profiler: TransferFromDeviceTime too frequent: 897 counts during 855 steps 2025-03-14T06:00:23.5082162Z 2025-03-14T06:00:23.5082348Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5082463Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5082731Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5082840Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5083031Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5083175Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5083308Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5083469Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5083823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5084157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5084447Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5084768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5085234Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5085509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5085800Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5085963Z Execution Analysis: (:1) 2025-03-14T06:00:23.5086219Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5086435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5086441Z 2025-03-14T06:00:23.5086644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5086768Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5086996Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5087115Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5087323Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5087472Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5087617Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5087797Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5088386Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5088996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5089392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5089747Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5090060Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5090343Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5090648Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5090929Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5091032Z Execution Analysis: .......... 2025-03-14T06:00:23.5091298Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5091501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5091792Z pt-xla-profiler: TransferFromDeviceTime too frequent: 898 counts during 856 steps 2025-03-14T06:00:23.5091797Z 2025-03-14T06:00:23.5091999Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5092114Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5092406Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5092516Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5092725Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5092869Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5093015Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5093206Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5093568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5093923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5094239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5094510Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5094821Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5095089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5095411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5095536Z Execution Analysis: (:1) 2025-03-14T06:00:23.5095802Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5096005Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5096010Z 2025-03-14T06:00:23.5096213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5096325Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5096562Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5096671Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5096877Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5097019Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5097278Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5097443Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5098023Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5098630Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5098991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5099334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5099642Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5099907Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5100212Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5100476Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5100584Z Execution Analysis: .......... 2025-03-14T06:00:23.5100832Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5101035Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5101311Z pt-xla-profiler: TransferFromDeviceTime too frequent: 899 counts during 857 steps 2025-03-14T06:00:23.5101315Z 2025-03-14T06:00:23.5101516Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5101627Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5101915Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5102026Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5102229Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5102369Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5102537Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5102704Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5103062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5103403Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5103712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5103977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5104281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5104569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5104859Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5104981Z Execution Analysis: (:1) 2025-03-14T06:00:23.5105238Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5105436Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5105440Z 2025-03-14T06:00:23.5105640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5105749Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5105979Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5106082Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5106290Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5106427Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5106577Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5106737Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5107443Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5107994Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5108335Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5108654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5108948Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5109208Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5109493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5109745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5109846Z Execution Analysis: .......... 2025-03-14T06:00:23.5110091Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5110278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5110546Z pt-xla-profiler: TransferFromDeviceTime too frequent: 900 counts during 858 steps 2025-03-14T06:00:23.5110550Z 2025-03-14T06:00:23.5110737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5110847Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5111115Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5111224Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5111412Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5111571Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5111708Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5111870Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5112202Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5112529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5112820Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5113080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5113385Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5113636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5113908Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5114028Z Execution Analysis: (:1) 2025-03-14T06:00:23.5114272Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5114462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5114466Z 2025-03-14T06:00:23.5114652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5114762Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5114974Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5115084Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5115272Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5115409Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5115545Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5115711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5116298Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5116832Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5117161Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5117488Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5117957Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5118229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5118527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5118795Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5118901Z Execution Analysis: .......... 2025-03-14T06:00:23.5119158Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5119353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5119637Z pt-xla-profiler: TransferFromDeviceTime too frequent: 901 counts during 859 steps 2025-03-14T06:00:23.5119642Z 2025-03-14T06:00:23.5119836Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5119955Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5120235Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5120348Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5120568Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5120716Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5120855Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5121024Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5121371Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5121720Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5122021Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5122319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5122617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5122891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5123174Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5123309Z Execution Analysis: (:1) 2025-03-14T06:00:23.5123558Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5123762Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5123766Z 2025-03-14T06:00:23.5123961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5124077Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5124299Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5124414Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5124693Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5124845Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5125157Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5125405Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5125995Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5126578Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5126940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5127294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5127611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5127885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5128198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5128470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5128586Z Execution Analysis: .......... 2025-03-14T06:00:23.5128844Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5129053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5129337Z pt-xla-profiler: TransferFromDeviceTime too frequent: 902 counts during 860 steps 2025-03-14T06:00:23.5129345Z 2025-03-14T06:00:23.5129551Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5129666Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5129962Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5130175Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5130387Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5130530Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5130679Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5130847Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5131208Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5131558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5131905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5132180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5132495Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5132767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5133068Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5133196Z Execution Analysis: (:1) 2025-03-14T06:00:23.5133460Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5133661Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5133666Z 2025-03-14T06:00:23.5133870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5133984Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5134218Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5134326Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5134536Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5134677Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5134877Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5135044Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5135634Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5136204Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5136566Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5136919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5137238Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5137511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5137825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5138096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5138207Z Execution Analysis: .......... 2025-03-14T06:00:23.5138570Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5138772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5139049Z pt-xla-profiler: TransferFromDeviceTime too frequent: 903 counts during 861 steps 2025-03-14T06:00:23.5139054Z 2025-03-14T06:00:23.5139258Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5139369Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5139681Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5139956Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5140166Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5140306Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5140454Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5140619Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5140984Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5141333Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5141673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5141943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5142256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5142525Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5142825Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5142947Z Execution Analysis: (:1) 2025-03-14T06:00:23.5143211Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5143411Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5143422Z 2025-03-14T06:00:23.5143623Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5143740Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5143970Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5144087Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5144290Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5144486Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5144633Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5144804Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5145393Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5145967Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5146326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5146680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5146993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5147274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5147582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5147854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5147960Z Execution Analysis: .......... 2025-03-14T06:00:23.5148221Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5148420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5148713Z pt-xla-profiler: TransferFromDeviceTime too frequent: 904 counts during 862 steps 2025-03-14T06:00:23.5148718Z 2025-03-14T06:00:23.5148944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5149063Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5149355Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5149471Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5149673Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5149820Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5149960Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5150134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5150491Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5150871Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5151286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5151561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5151865Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5152136Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5152420Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5152545Z Execution Analysis: (:1) 2025-03-14T06:00:23.5152797Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5152998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5153004Z 2025-03-14T06:00:23.5153200Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5153315Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5153542Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5153681Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5153906Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5154050Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5154192Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5154358Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5154931Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5155495Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5155843Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5156193Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5156499Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5156771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5157069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5157340Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5157443Z Execution Analysis: .......... 2025-03-14T06:00:23.5157702Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5157897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5158179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 906 counts during 863 steps 2025-03-14T06:00:23.5158184Z 2025-03-14T06:00:23.5158408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5158521Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5158805Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5158914Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5159109Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5159254Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5159388Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5159555Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5159937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5160284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5160592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5160861Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5161161Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5161419Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5161708Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5161834Z Execution Analysis: (:1) 2025-03-14T06:00:23.5162184Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5162373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5162377Z 2025-03-14T06:00:23.5162565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5162671Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5162911Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5163034Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5163226Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5163359Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5163498Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5163653Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5164203Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5164802Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5165469Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5165824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5166143Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5166418Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5166738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5167007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5167121Z Execution Analysis: .......... 2025-03-14T06:00:23.5167381Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5167591Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5167938Z pt-xla-profiler: TransferFromDeviceTime too frequent: 907 counts during 864 steps 2025-03-14T06:00:23.5167945Z 2025-03-14T06:00:23.5168164Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5168281Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5168581Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5168691Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5168904Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5169048Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5169203Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5169417Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5169778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5170133Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5170456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5170735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5171051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5171322Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5171623Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5171751Z Execution Analysis: (:1) 2025-03-14T06:00:23.5172020Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5172224Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5172228Z 2025-03-14T06:00:23.5172444Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5172595Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5172871Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5172985Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5173197Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5173340Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5173496Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5173665Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5174267Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5174844Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5175215Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5175573Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5175896Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5176172Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5176488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5176765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5176872Z Execution Analysis: .......... 2025-03-14T06:00:23.5177130Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5177367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5177659Z pt-xla-profiler: TransferFromDeviceTime too frequent: 908 counts during 865 steps 2025-03-14T06:00:23.5177667Z 2025-03-14T06:00:23.5177870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5177989Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5178277Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5178394Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5178596Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5178745Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5178912Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5179087Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5179443Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5179804Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5180118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5180398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5180706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5180985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5181275Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5181409Z Execution Analysis: (:1) 2025-03-14T06:00:23.5181668Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5181876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5181880Z 2025-03-14T06:00:23.5182130Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5182252Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5182481Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5182598Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5182803Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5182953Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5183100Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5183278Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5183871Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5184454Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5184818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5185175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5185489Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5185767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5186073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5186351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5186455Z Execution Analysis: .......... 2025-03-14T06:00:23.5186722Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5186949Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5187250Z pt-xla-profiler: TransferFromDeviceTime too frequent: 909 counts during 866 steps 2025-03-14T06:00:23.5187255Z 2025-03-14T06:00:23.5187459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5187585Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5187982Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5188103Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5188302Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5188479Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5188618Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5188791Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5189240Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5189577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5189867Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5190129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5190412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5190665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5190935Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5191059Z Execution Analysis: (:1) 2025-03-14T06:00:23.5191296Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5191488Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5191516Z 2025-03-14T06:00:23.5191725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5191837Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5192052Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5192163Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5192353Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5192489Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5192626Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5192790Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5193337Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5193874Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5194216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5194540Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5194838Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5195089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5195384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5195633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5195740Z Execution Analysis: .......... 2025-03-14T06:00:23.5196194Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5196407Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5196686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 910 counts during 867 steps 2025-03-14T06:00:23.5196691Z 2025-03-14T06:00:23.5196896Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5197005Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5197295Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5197431Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5197635Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5197776Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5197922Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5198089Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5198450Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5198792Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5199103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5199368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5199678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5199942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5200233Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5200356Z Execution Analysis: (:1) 2025-03-14T06:00:23.5200614Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5200862Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5200867Z 2025-03-14T06:00:23.5201070Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5201182Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5201413Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5201526Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5201733Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5201877Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5202028Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5202195Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5202779Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5203342Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5203700Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5204043Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5204354Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5204710Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5205193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5205461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5205671Z Execution Analysis: .......... 2025-03-14T06:00:23.5205930Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5206139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5206426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 911 counts during 868 steps 2025-03-14T06:00:23.5206431Z 2025-03-14T06:00:23.5206641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5206756Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5207052Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5207188Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5207401Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5207545Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5207696Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5207868Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5208236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5208586Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5208905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5209180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5209497Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5209765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5210067Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5210200Z Execution Analysis: (:1) 2025-03-14T06:00:23.5210492Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5210722Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5210734Z 2025-03-14T06:00:23.5210932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5211055Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5211283Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5211401Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5211608Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5211752Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5211904Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5212073Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5212678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5213259Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5213618Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5213976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5214289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5214573Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5214881Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5215181Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5215291Z Execution Analysis: .......... 2025-03-14T06:00:23.5215558Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5215763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5216056Z pt-xla-profiler: TransferFromDeviceTime too frequent: 912 counts during 869 steps 2025-03-14T06:00:23.5216061Z 2025-03-14T06:00:23.5216261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5216407Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5216702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5216823Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5217026Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5217287Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5217426Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5217600Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5217948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5218298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5218603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5218880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5219181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5219453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5219736Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5219891Z Execution Analysis: (:1) 2025-03-14T06:00:23.5220165Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5220370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5220374Z 2025-03-14T06:00:23.5220569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5220689Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5220914Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5221032Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5221232Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5221377Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5221519Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5221688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5222266Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5222940Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5223269Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5223600Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5223888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5224150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5224455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5224715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5224814Z Execution Analysis: .......... 2025-03-14T06:00:23.5225058Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5225247Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5225519Z pt-xla-profiler: TransferFromDeviceTime too frequent: 913 counts during 870 steps 2025-03-14T06:00:23.5225523Z 2025-03-14T06:00:23.5225709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5225845Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5226113Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5226224Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5226415Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5226558Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5226689Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5226849Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5227179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5227513Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5227968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5228239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5228538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5228808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5229097Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5229278Z Execution Analysis: (:1) 2025-03-14T06:00:23.5229540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5229736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5229740Z 2025-03-14T06:00:23.5229941Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5230049Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5230282Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5230392Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5230598Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5230741Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5230891Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5231057Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5231638Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5232196Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5232553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5232897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5233207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5233498Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5233808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5234071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5234183Z Execution Analysis: .......... 2025-03-14T06:00:23.5234433Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5234635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5234913Z pt-xla-profiler: TransferFromDeviceTime too frequent: 914 counts during 871 steps 2025-03-14T06:00:23.5234941Z 2025-03-14T06:00:23.5235145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5235257Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5235552Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5235661Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5235873Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5236014Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5236159Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5236321Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5236676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5237015Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5237328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5237593Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5237901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5238165Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5238506Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5238630Z Execution Analysis: (:1) 2025-03-14T06:00:23.5238892Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5239094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5239098Z 2025-03-14T06:00:23.5239300Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5239418Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5239650Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5239864Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5240063Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5240199Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5240344Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5240498Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5241052Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5241582Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5241923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5242251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5242567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5242821Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5243115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5243361Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5243465Z Execution Analysis: .......... 2025-03-14T06:00:23.5243705Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5243894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5244184Z pt-xla-profiler: TransferFromDeviceTime too frequent: 915 counts during 872 steps 2025-03-14T06:00:23.5244197Z 2025-03-14T06:00:23.5244382Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5244567Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5244838Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5245123Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5245328Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5245480Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5245626Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5245793Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5246154Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5246511Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5246825Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5247108Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5247416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5247759Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5248053Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5248187Z Execution Analysis: (:1) 2025-03-14T06:00:23.5248444Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5248653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5248659Z 2025-03-14T06:00:23.5248860Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5248984Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5249213Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5249336Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5249542Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5249697Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5249844Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5250021Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5250614Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5251196Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5251563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5251924Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5252264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5252558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5252869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5253153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5253261Z Execution Analysis: .......... 2025-03-14T06:00:23.5253536Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5253739Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5254070Z pt-xla-profiler: TransferFromDeviceTime too frequent: 916 counts during 873 steps 2025-03-14T06:00:23.5254075Z 2025-03-14T06:00:23.5254278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5254408Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5254703Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5254830Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5255034Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5255192Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5255337Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5255519Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5255880Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5256248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5256563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5256854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5257313Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5257576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5257851Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5257981Z Execution Analysis: (:1) 2025-03-14T06:00:23.5258222Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5258426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5258431Z 2025-03-14T06:00:23.5258618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5258737Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5258955Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5259077Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5259272Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5259418Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5259557Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5259726Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5260275Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5260819Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5261150Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5261508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5261804Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5262067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5262362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5262611Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5262723Z Execution Analysis: .......... 2025-03-14T06:00:23.5262958Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5263183Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5263444Z pt-xla-profiler: TransferFromDeviceTime too frequent: 917 counts during 874 steps 2025-03-14T06:00:23.5263448Z 2025-03-14T06:00:23.5263650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5263759Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5264042Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5264145Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5264344Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5264477Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5264619Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5264772Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5265113Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5265557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5266042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5266439Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5266758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5267028Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5267333Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5267458Z Execution Analysis: (:1) 2025-03-14T06:00:23.5267730Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5267934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5267939Z 2025-03-14T06:00:23.5268152Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5268268Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5268515Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5268627Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5268847Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5268990Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5269146Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5269312Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5269916Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5270490Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5270895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5271252Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5271576Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5271849Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5272170Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5272439Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5272559Z Execution Analysis: .......... 2025-03-14T06:00:23.5272851Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5273066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5273358Z pt-xla-profiler: TransferFromDeviceTime too frequent: 918 counts during 875 steps 2025-03-14T06:00:23.5273364Z 2025-03-14T06:00:23.5273580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5273696Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5273999Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5274112Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5274329Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5274472Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5274627Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5274798Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5275166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5275518Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5275860Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5276230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5276548Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5276818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5277122Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5277250Z Execution Analysis: (:1) 2025-03-14T06:00:23.5277523Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5277832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5277836Z 2025-03-14T06:00:23.5278051Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5278168Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5278408Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5278517Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5278729Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5278871Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5279026Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5279189Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5279775Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5280355Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5280721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5281079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5281384Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5281663Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5281964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5282237Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5282361Z Execution Analysis: .......... 2025-03-14T06:00:23.5282622Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5282820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5283113Z pt-xla-profiler: TransferFromDeviceTime too frequent: 919 counts during 876 steps 2025-03-14T06:00:23.5283122Z 2025-03-14T06:00:23.5283319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5283447Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5283732Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5283853Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5284051Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5284198Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5284337Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5284579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5285095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5285461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5286162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5286452Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5286757Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5287039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5287328Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5287471Z Execution Analysis: (:1) 2025-03-14T06:00:23.5287735Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5287951Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5287955Z 2025-03-14T06:00:23.5288162Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5288287Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5288518Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5288642Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5288846Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5289002Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5289149Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5289330Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5289920Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5290532Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5290899Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5291265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5291576Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5291862Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5292169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5292476Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5292582Z Execution Analysis: .......... 2025-03-14T06:00:23.5296296Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5296534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5296837Z pt-xla-profiler: TransferFromDeviceTime too frequent: 920 counts during 877 steps 2025-03-14T06:00:23.5296843Z 2025-03-14T06:00:23.5297048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5297278Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5297560Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5297676Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5297873Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5298028Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5298165Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5298335Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5298688Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5299124Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5299429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5299708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5300006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5300272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5300558Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5300689Z Execution Analysis: (:1) 2025-03-14T06:00:23.5300941Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5301145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5301153Z 2025-03-14T06:00:23.5301346Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5301469Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5301693Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5301808Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5302004Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5302149Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5302291Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5302462Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5303069Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5303642Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5303992Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5304343Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5304653Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5304920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5305267Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5305527Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5305634Z Execution Analysis: .......... 2025-03-14T06:00:23.5305884Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5306087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5306363Z pt-xla-profiler: TransferFromDeviceTime too frequent: 921 counts during 878 steps 2025-03-14T06:00:23.5306368Z 2025-03-14T06:00:23.5306565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5306674Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5306961Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5307067Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5307370Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5307499Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5307635Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5307789Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5308170Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5308494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5308783Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5309032Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5309318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5309565Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5309835Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5309946Z Execution Analysis: (:1) 2025-03-14T06:00:23.5310190Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5310377Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5310382Z 2025-03-14T06:00:23.5310565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5310667Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5310881Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5310979Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5311168Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5311300Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5311438Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5311590Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5312164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5312695Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5313031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5313352Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5313643Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5313919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5314208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5314453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5314557Z Execution Analysis: .......... 2025-03-14T06:00:23.5314795Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5314983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5315244Z pt-xla-profiler: TransferFromDeviceTime too frequent: 922 counts during 879 steps 2025-03-14T06:00:23.5315249Z 2025-03-14T06:00:23.5315438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5315540Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5315815Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5315915Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5316108Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5316238Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5316378Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5316577Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5316915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5317235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5317528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5317777Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5318065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5318313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5318588Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5318701Z Execution Analysis: (:1) 2025-03-14T06:00:23.5318946Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5319127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5319137Z 2025-03-14T06:00:23.5319322Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5319424Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5319641Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5319739Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5319935Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5320065Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5320204Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5320383Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5320938Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5321472Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5321802Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5322128Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5322415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5322694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5322976Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5323235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5323334Z Execution Analysis: .......... 2025-03-14T06:00:23.5323578Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5323760Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5324027Z pt-xla-profiler: TransferFromDeviceTime too frequent: 923 counts during 880 steps 2025-03-14T06:00:23.5324032Z 2025-03-14T06:00:23.5324213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5324324Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5324693Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5324800Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5325161Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5325310Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5325508Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5325684Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5326038Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5326392Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5326701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5326977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5327280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5327554Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5327842Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5327971Z Execution Analysis: (:1) 2025-03-14T06:00:23.5328228Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5328429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5328433Z 2025-03-14T06:00:23.5328629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5328743Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5328969Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5329082Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5329284Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5329430Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5329598Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5329772Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5330362Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5330935Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5331290Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5331645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5331980Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5332255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5332560Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5332834Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5332935Z Execution Analysis: .......... 2025-03-14T06:00:23.5333195Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5333392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5333680Z pt-xla-profiler: TransferFromDeviceTime too frequent: 924 counts during 881 steps 2025-03-14T06:00:23.5333684Z 2025-03-14T06:00:23.5333884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5334001Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5334286Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5334407Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5334614Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5334819Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5334963Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5335145Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5335508Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5335870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5336183Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5336470Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5336778Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5337065Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5337452Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5337578Z Execution Analysis: (:1) 2025-03-14T06:00:23.5337819Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5338022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5338025Z 2025-03-14T06:00:23.5338223Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5338333Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5338561Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5338666Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5338869Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5339040Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5339192Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5339352Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5339913Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5340445Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5340790Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5341144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5341444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5341704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5342005Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5342258Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5342368Z Execution Analysis: .......... 2025-03-14T06:00:23.5342611Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5342813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5343083Z pt-xla-profiler: TransferFromDeviceTime too frequent: 925 counts during 882 steps 2025-03-14T06:00:23.5343089Z 2025-03-14T06:00:23.5343290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5343401Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5343686Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5343815Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5344041Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5344181Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5344325Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5344488Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5344832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5345162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5345466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5345727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5346028Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5346280Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5346568Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5346687Z Execution Analysis: (:1) 2025-03-14T06:00:23.5346941Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5347131Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5347136Z 2025-03-14T06:00:23.5347336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5347446Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5347670Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5347775Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5348002Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5348137Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5348287Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5348446Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5349004Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5349536Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5349902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5350229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5350531Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5350787Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5351088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5351338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5351447Z Execution Analysis: .......... 2025-03-14T06:00:23.5351688Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5351890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5352158Z pt-xla-profiler: TransferFromDeviceTime too frequent: 927 counts during 883 steps 2025-03-14T06:00:23.5352173Z 2025-03-14T06:00:23.5352365Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5352484Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5352756Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5352924Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5353115Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5353251Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5353398Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5353556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5353902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5354231Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5354535Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5354801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5355089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5355352Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5355623Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5355752Z Execution Analysis: (:1) 2025-03-14T06:00:23.5355991Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5356186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5356192Z 2025-03-14T06:00:23.5356379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5356495Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5356712Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5356848Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5357045Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5357187Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5357326Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5357492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5358041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5358580Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5358939Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5359277Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5359568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5359839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5360127Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5360387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5360490Z Execution Analysis: .......... 2025-03-14T06:00:23.5360739Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5360931Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5361208Z pt-xla-profiler: TransferFromDeviceTime too frequent: 928 counts during 884 steps 2025-03-14T06:00:23.5361212Z 2025-03-14T06:00:23.5361402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5361548Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5361840Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5361952Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5362144Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5362288Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5362421Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5362590Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5362923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5363259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5363548Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5363818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5364110Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5364367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5364714Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5364845Z Execution Analysis: (:1) 2025-03-14T06:00:23.5365267Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5365608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5365613Z 2025-03-14T06:00:23.5365888Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5366018Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5366317Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5366446Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5366652Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5366810Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5366958Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5367140Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5367735Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5368355Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5368718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5369081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5369402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5369686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5369998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5370278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5370385Z Execution Analysis: .......... 2025-03-14T06:00:23.5370653Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5370870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5371157Z pt-xla-profiler: TransferFromDeviceTime too frequent: 929 counts during 885 steps 2025-03-14T06:00:23.5371164Z 2025-03-14T06:00:23.5371376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5371574Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5371874Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5371984Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5372200Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5372348Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5372502Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5372675Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5373046Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5373399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5373723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5374003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5374324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5374596Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5374902Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5375031Z Execution Analysis: (:1) 2025-03-14T06:00:23.5375301Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5375507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5375513Z 2025-03-14T06:00:23.5375747Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5375868Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5376111Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5376227Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5376446Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5376594Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5376749Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5376918Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5377628Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5378217Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5378578Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5378926Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5379242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5379512Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5379815Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5380075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5380183Z Execution Analysis: .......... 2025-03-14T06:00:23.5380432Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5380632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5380910Z pt-xla-profiler: TransferFromDeviceTime too frequent: 930 counts during 886 steps 2025-03-14T06:00:23.5380939Z 2025-03-14T06:00:23.5381167Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5381278Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5381562Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5381669Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5381871Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5382013Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5382155Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5382318Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5382669Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5383012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5383324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5383589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5383892Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5384150Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5384441Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5384562Z Execution Analysis: (:1) 2025-03-14T06:00:23.5384819Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5385011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5385015Z 2025-03-14T06:00:23.5385239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5385354Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5385582Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5385688Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5385888Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5386024Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5386171Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5386331Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5386934Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5387494Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5387849Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5388194Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5388495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5388764Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5389060Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5389325Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5389429Z Execution Analysis: .......... 2025-03-14T06:00:23.5389683Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5389878Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5390207Z pt-xla-profiler: TransferFromDeviceTime too frequent: 931 counts during 887 steps 2025-03-14T06:00:23.5390211Z 2025-03-14T06:00:23.5390407Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5390518Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5390798Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5390907Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5391100Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5391244Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5391381Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5391546Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5391894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5392237Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5392539Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5392806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5393102Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5393363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5393645Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5393770Z Execution Analysis: (:1) 2025-03-14T06:00:23.5394016Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5394238Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5394244Z 2025-03-14T06:00:23.5394440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5394553Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5394775Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5394886Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5395082Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5395223Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5395363Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5395554Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5396128Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5396688Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5397039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5397383Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5397682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5397949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5398246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5398513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5398614Z Execution Analysis: .......... 2025-03-14T06:00:23.5398870Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5399089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5399398Z pt-xla-profiler: TransferFromDeviceTime too frequent: 932 counts during 888 steps 2025-03-14T06:00:23.5399403Z 2025-03-14T06:00:23.5399596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5399713Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5399993Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5400103Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5400301Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5400445Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5400583Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5400751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5401099Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5401452Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5401753Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5402022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5402319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5402585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5402868Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5402994Z Execution Analysis: (:1) 2025-03-14T06:00:23.5403264Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5403464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5403472Z 2025-03-14T06:00:23.5403672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5403782Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5404006Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5404113Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5404309Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5404453Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5404728Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5404898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5405651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5406233Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5406603Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5406952Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5407267Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5407539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5407851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5408122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5408238Z Execution Analysis: .......... 2025-03-14T06:00:23.5408498Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5408767Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5409052Z pt-xla-profiler: TransferFromDeviceTime too frequent: 933 counts during 889 steps 2025-03-14T06:00:23.5409057Z 2025-03-14T06:00:23.5409260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5409371Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5409661Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5409770Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5409977Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5410120Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5410266Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5410432Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5410796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5411143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5411456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5411728Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5412037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5412304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5412599Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5412722Z Execution Analysis: (:1) 2025-03-14T06:00:23.5413005Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5413209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5413214Z 2025-03-14T06:00:23.5413418Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5413531Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5413762Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5413869Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5414079Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5414250Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5414403Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5414568Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5415166Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5415740Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5416101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5416449Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5416761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5417037Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5417438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5417687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5417786Z Execution Analysis: .......... 2025-03-14T06:00:23.5418069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5418258Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5418519Z pt-xla-profiler: TransferFromDeviceTime too frequent: 934 counts during 890 steps 2025-03-14T06:00:23.5418523Z 2025-03-14T06:00:23.5418712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5418814Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5419085Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5419183Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5419375Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5419508Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5419645Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5419802Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5420141Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5420461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5420752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5421001Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5421290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5421534Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5421813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5421959Z Execution Analysis: (:1) 2025-03-14T06:00:23.5422202Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5422391Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5422396Z 2025-03-14T06:00:23.5422580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5422687Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5422898Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5423031Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5423219Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5423357Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5423490Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5423648Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5424198Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5424731Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5425061Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5425387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5425678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5425935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5426219Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5426473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5426690Z Execution Analysis: .......... 2025-03-14T06:00:23.5426935Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5427119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5427384Z pt-xla-profiler: TransferFromDeviceTime too frequent: 935 counts during 891 steps 2025-03-14T06:00:23.5427388Z 2025-03-14T06:00:23.5427575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5427684Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5427954Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5428059Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5428247Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5428382Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5428518Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5428679Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5429010Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5429340Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5429626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5429882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5430168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5430422Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5430714Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5430841Z Execution Analysis: (:1) 2025-03-14T06:00:23.5431075Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5431266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5431270Z 2025-03-14T06:00:23.5431454Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5431561Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5431794Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5431901Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5432086Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5432224Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5432356Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5432515Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5433059Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5433590Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5433918Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5434248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5434535Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5434788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5435069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5435371Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5435469Z Execution Analysis: .......... 2025-03-14T06:00:23.5435711Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5435893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5436158Z pt-xla-profiler: TransferFromDeviceTime too frequent: 936 counts during 892 steps 2025-03-14T06:00:23.5436162Z 2025-03-14T06:00:23.5436350Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5436456Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5436724Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5436825Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5437015Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5437150Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5437282Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5437434Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5437768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5438089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5438378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5438630Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5438918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5439187Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5439461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5439573Z Execution Analysis: (:1) 2025-03-14T06:00:23.5439812Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5439995Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5439999Z 2025-03-14T06:00:23.5440185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5440323Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5440540Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5440642Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5440834Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5440967Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5441107Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5441262Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5441809Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5442336Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5442668Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5442992Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5443283Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5443537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5443867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5444116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5444221Z Execution Analysis: .......... 2025-03-14T06:00:23.5444457Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5444726Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5445163Z pt-xla-profiler: TransferFromDeviceTime too frequent: 937 counts during 893 steps 2025-03-14T06:00:23.5445171Z 2025-03-14T06:00:23.5445377Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5445489Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5445785Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5445899Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5446109Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5446253Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5446401Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5446567Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5446933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5447285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5447604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5447877Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5448216Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5448489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5448789Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5448918Z Execution Analysis: (:1) 2025-03-14T06:00:23.5449176Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5449375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5449379Z 2025-03-14T06:00:23.5449582Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5449720Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5449959Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5450066Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5450280Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5450423Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5450577Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5450740Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5451335Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5451903Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5452267Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5452620Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5452944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5453271Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5453576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5453845Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5453949Z Execution Analysis: .......... 2025-03-14T06:00:23.5454206Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5454405Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5454696Z pt-xla-profiler: TransferFromDeviceTime too frequent: 938 counts during 894 steps 2025-03-14T06:00:23.5454701Z 2025-03-14T06:00:23.5454900Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5455018Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5455309Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5455422Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5455624Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5455768Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5455907Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5456074Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5456429Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5456781Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5457090Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5457533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5457817Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5458070Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5458337Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5458454Z Execution Analysis: (:1) 2025-03-14T06:00:23.5458692Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5458884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5458912Z 2025-03-14T06:00:23.5459096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5459204Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5459417Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5459525Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5459716Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5459851Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5459984Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5460143Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5460685Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5461222Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5461554Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5461883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5462170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5462477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5462762Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5463013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5463112Z Execution Analysis: .......... 2025-03-14T06:00:23.5463356Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5463544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5463814Z pt-xla-profiler: TransferFromDeviceTime too frequent: 939 counts during 895 steps 2025-03-14T06:00:23.5463819Z 2025-03-14T06:00:23.5464007Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5464122Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5464389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5464501Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5464689Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5464828Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5464959Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5465122Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5465564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5466086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5466455Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5466735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5467042Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5467317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5467608Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5467737Z Execution Analysis: (:1) 2025-03-14T06:00:23.5467993Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5468238Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5468242Z 2025-03-14T06:00:23.5468440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5468563Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5468793Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5468912Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5469115Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5469264Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5469408Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5469584Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5470171Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5470746Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5471110Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5471460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5471845Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5472119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5472429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5472694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5472805Z Execution Analysis: .......... 2025-03-14T06:00:23.5473061Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5473265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5473548Z pt-xla-profiler: TransferFromDeviceTime too frequent: 940 counts during 896 steps 2025-03-14T06:00:23.5473559Z 2025-03-14T06:00:23.5473767Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5473883Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5474174Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5474280Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5474487Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5474628Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5474774Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5474941Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5475300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5475648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5475997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5476272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5476583Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5476849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5477144Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5477267Z Execution Analysis: (:1) 2025-03-14T06:00:23.5477535Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5477891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5477896Z 2025-03-14T06:00:23.5478201Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5478307Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5478528Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5478629Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5478821Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5478951Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5479090Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5479244Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5479791Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5480316Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5480653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5481027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5481320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5481572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5481859Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5482108Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5482211Z Execution Analysis: .......... 2025-03-14T06:00:23.5482447Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5482638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5482903Z pt-xla-profiler: TransferFromDeviceTime too frequent: 941 counts during 897 steps 2025-03-14T06:00:23.5482909Z 2025-03-14T06:00:23.5483102Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5483206Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5483479Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5483581Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5483772Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5483903Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5484040Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5484194Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5484590Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5485110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5485433Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5485705Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5486020Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5486288Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5486585Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5486734Z Execution Analysis: (:1) 2025-03-14T06:00:23.5486999Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5487197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5487210Z 2025-03-14T06:00:23.5487407Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5487527Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5487754Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5487870Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5488072Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5488222Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5488366Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5488535Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5489131Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5489707Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5490114Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5490470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5490781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5491059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5491364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5491647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5491752Z Execution Analysis: .......... 2025-03-14T06:00:23.5492012Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5492217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5492512Z pt-xla-profiler: TransferFromDeviceTime too frequent: 942 counts during 898 steps 2025-03-14T06:00:23.5492517Z 2025-03-14T06:00:23.5492717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5492836Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5493127Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5493243Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5493445Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5493594Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5493734Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5493906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5494288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5494649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5494962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5495242Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5495548Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5495822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5496113Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5496268Z Execution Analysis: (:1) 2025-03-14T06:00:23.5496522Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5496729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5496734Z 2025-03-14T06:00:23.5496935Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5497056Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5497386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5497500Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5497698Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5497842Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5497981Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5498150Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5498724Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5499288Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5499684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5500032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5500334Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5500606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5500907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5501172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5501271Z Execution Analysis: .......... 2025-03-14T06:00:23.5501527Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5501724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5502004Z pt-xla-profiler: TransferFromDeviceTime too frequent: 943 counts during 899 steps 2025-03-14T06:00:23.5502008Z 2025-03-14T06:00:23.5502208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5502315Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5502594Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5502706Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5502903Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5503046Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5503183Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5503373Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5503722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5504071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5504371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5504641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5504946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5505207Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5505523Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5505647Z Execution Analysis: (:1) 2025-03-14T06:00:23.5505914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5506109Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5506115Z 2025-03-14T06:00:23.5506315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5506424Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5506651Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5506759Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5506964Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5507102Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5507356Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5507510Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5508061Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5508649Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5508988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5509310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5509601Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5509855Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5510143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5510391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5510495Z Execution Analysis: .......... 2025-03-14T06:00:23.5510731Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5511095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5511375Z pt-xla-profiler: TransferFromDeviceTime too frequent: 944 counts during 900 steps 2025-03-14T06:00:23.5511380Z 2025-03-14T06:00:23.5511580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5511689Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5511979Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5512088Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5512291Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5512432Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5512601Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5512766Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5513126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5513464Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5513772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5514039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5514345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5514629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5514918Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5515037Z Execution Analysis: (:1) 2025-03-14T06:00:23.5515292Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5515489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5515494Z 2025-03-14T06:00:23.5515691Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5515799Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5516026Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5516131Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5516331Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5516468Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5516611Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5516773Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5517351Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5517955Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5518308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5518648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5518953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5519219Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5519517Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5519780Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5519891Z Execution Analysis: .......... 2025-03-14T06:00:23.5520143Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5520341Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5520620Z pt-xla-profiler: TransferFromDeviceTime too frequent: 945 counts during 901 steps 2025-03-14T06:00:23.5520624Z 2025-03-14T06:00:23.5520816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5520930Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5521211Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5521322Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5521518Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5521684Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5521822Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5521992Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5522338Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5522686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5522987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5523258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5523661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5523928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5524213Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5524340Z Execution Analysis: (:1) 2025-03-14T06:00:23.5524687Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5524892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5525057Z 2025-03-14T06:00:23.5525256Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5525375Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5525606Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5525726Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5525926Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5526073Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5526217Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5526392Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5527038Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5527614Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5527971Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5528326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5528637Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5528914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5529221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5529491Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5529600Z Execution Analysis: .......... 2025-03-14T06:00:23.5529868Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5530071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5530360Z pt-xla-profiler: TransferFromDeviceTime too frequent: 946 counts during 902 steps 2025-03-14T06:00:23.5530366Z 2025-03-14T06:00:23.5530568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5530686Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5530973Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5531089Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5531318Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5531469Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5531612Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5531785Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5532142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5532499Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5532808Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5533111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5533416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5533688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5533978Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5534114Z Execution Analysis: (:1) 2025-03-14T06:00:23.5534368Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5534572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5534577Z 2025-03-14T06:00:23.5534774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5534893Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5535127Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5535239Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5535440Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5535586Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5535731Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5535954Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5536542Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5537225Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5537555Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5537883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5538176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5538429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5538715Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5538963Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5539064Z Execution Analysis: .......... 2025-03-14T06:00:23.5539304Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5539496Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5539756Z pt-xla-profiler: TransferFromDeviceTime too frequent: 948 counts during 903 steps 2025-03-14T06:00:23.5539762Z 2025-03-14T06:00:23.5539949Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5540052Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5540320Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5540447Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5540641Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5540773Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5540907Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5541060Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5541394Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5541718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5542010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5542284Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5542572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5542821Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5543096Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5543209Z Execution Analysis: (:1) 2025-03-14T06:00:23.5543451Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5543635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5543639Z 2025-03-14T06:00:23.5543832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5543937Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5544153Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5544252Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5544444Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5544574Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5544782Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5544936Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5545494Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5546020Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5546362Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5546689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5546984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5547239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5547536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5547783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5547891Z Execution Analysis: .......... 2025-03-14T06:00:23.5548128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5548324Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5548586Z pt-xla-profiler: TransferFromDeviceTime too frequent: 949 counts during 904 steps 2025-03-14T06:00:23.5548593Z 2025-03-14T06:00:23.5548788Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5548892Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5549194Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5549297Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5549495Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5549627Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5549767Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5549920Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5550263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5550583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5550905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5551156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5551444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5551697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5551972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5552086Z Execution Analysis: (:1) 2025-03-14T06:00:23.5552334Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5552520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5552535Z 2025-03-14T06:00:23.5552721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5552834Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5553046Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5553150Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5553345Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5553522Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5553665Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5553819Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5554371Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5554911Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5555241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5555572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5555858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5556120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5556402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5556656Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5556750Z Execution Analysis: .......... 2025-03-14T06:00:23.5556994Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5557176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5557451Z pt-xla-profiler: TransferFromDeviceTime too frequent: 950 counts during 905 steps 2025-03-14T06:00:23.5557455Z 2025-03-14T06:00:23.5557641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5557778Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5558046Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5558158Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5558340Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5558481Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5558608Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5558769Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5559095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5559451Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5559736Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5560000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5560284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5560540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5560809Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5560935Z Execution Analysis: (:1) 2025-03-14T06:00:23.5561172Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5561363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5561369Z 2025-03-14T06:00:23.5561552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5561666Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5561878Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5562010Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5562222Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5562365Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5562497Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5562658Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5563202Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5563740Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5564074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5564409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5564772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5565217Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5565657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5565935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5566041Z Execution Analysis: .......... 2025-03-14T06:00:23.5566306Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5566509Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5566806Z pt-xla-profiler: TransferFromDeviceTime too frequent: 951 counts during 906 steps 2025-03-14T06:00:23.5566811Z 2025-03-14T06:00:23.5567073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5567206Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5567497Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5567616Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5567819Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5567972Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5568112Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5568289Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5568750Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5569111Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5569424Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5569708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5570018Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5570293Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5570584Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5570716Z Execution Analysis: (:1) 2025-03-14T06:00:23.5570973Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5571185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5571189Z 2025-03-14T06:00:23.5571399Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5571511Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5571747Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5571921Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5572137Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5572275Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5572426Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5572590Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5573184Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5573755Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5574125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5574476Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5574803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5575075Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5575389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5575652Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5575767Z Execution Analysis: .......... 2025-03-14T06:00:23.5576021Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5576236Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5576540Z pt-xla-profiler: TransferFromDeviceTime too frequent: 952 counts during 907 steps 2025-03-14T06:00:23.5576546Z 2025-03-14T06:00:23.5576756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5576867Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5577267Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5577370Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5577572Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5577708Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5577856Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5578054Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5578412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5578749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5579060Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5579326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5579737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5579983Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5580261Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5580374Z Execution Analysis: (:1) 2025-03-14T06:00:23.5580624Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5580806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5580810Z 2025-03-14T06:00:23.5581001Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5581138Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5581387Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5581491Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5581688Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5581819Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5581961Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5582114Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5582667Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5583198Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5583535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5583864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5584162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5584414Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5584705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5584951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5585056Z Execution Analysis: .......... 2025-03-14T06:00:23.5585289Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5585502Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5585766Z pt-xla-profiler: TransferFromDeviceTime too frequent: 953 counts during 908 steps 2025-03-14T06:00:23.5585781Z 2025-03-14T06:00:23.5585967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5586080Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5586347Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5586459Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5586644Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5586785Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5586937Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5587090Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5587428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5587763Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5588053Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5588313Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5588595Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5588853Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5589122Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5589251Z Execution Analysis: (:1) 2025-03-14T06:00:23.5589489Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5589689Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5589695Z 2025-03-14T06:00:23.5589899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5590035Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5590247Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5590357Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5590543Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5590687Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5590821Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5590989Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5591536Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5592075Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5592408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5592743Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5593029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5593290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5593573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5593832Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5593932Z Execution Analysis: .......... 2025-03-14T06:00:23.5594180Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5594386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5594663Z pt-xla-profiler: TransferFromDeviceTime too frequent: 954 counts during 909 steps 2025-03-14T06:00:23.5594667Z 2025-03-14T06:00:23.5594852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5594966Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5595228Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5595334Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5595523Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5595685Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5595977Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5596146Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5596493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5596844Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5597143Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5597414Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5597708Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5597977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5598259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5598386Z Execution Analysis: (:1) 2025-03-14T06:00:23.5598636Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5598838Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5598867Z 2025-03-14T06:00:23.5599086Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5599206Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5599426Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5599540Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5599734Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5599880Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5600022Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5600189Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5600762Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5601329Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5601678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5602028Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5602330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5602609Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5602907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5603175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5603286Z Execution Analysis: .......... 2025-03-14T06:00:23.5603555Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5603764Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5604039Z pt-xla-profiler: TransferFromDeviceTime too frequent: 955 counts during 910 steps 2025-03-14T06:00:23.5604044Z 2025-03-14T06:00:23.5604249Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5604358Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5604731Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5604838Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5605245Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5605387Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5605533Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5605702Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5606069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5606417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5606735Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5607007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5607319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5607585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5607890Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5608015Z Execution Analysis: (:1) 2025-03-14T06:00:23.5608284Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5608534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5608539Z 2025-03-14T06:00:23.5608748Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5608862Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5609099Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5609206Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5609423Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5609567Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5609720Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5609883Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5610485Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5611058Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5611428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5611775Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5612098Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5612369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5612687Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5612950Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5613105Z Execution Analysis: .......... 2025-03-14T06:00:23.5613364Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5613576Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5613858Z pt-xla-profiler: TransferFromDeviceTime too frequent: 956 counts during 911 steps 2025-03-14T06:00:23.5613863Z 2025-03-14T06:00:23.5614077Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5614188Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5614484Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5614620Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5614833Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5614975Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5615128Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5615298Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5615666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5616014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5616334Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5616608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5617025Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5617274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5617549Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5617668Z Execution Analysis: (:1) 2025-03-14T06:00:23.5617938Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5618147Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5618151Z 2025-03-14T06:00:23.5618342Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5618445Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5618662Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5618762Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5618956Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5619086Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5619231Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5619383Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5619940Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5620474Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5620816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5621145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5621429Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5621691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5621972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5622250Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5622348Z Execution Analysis: .......... 2025-03-14T06:00:23.5622596Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5622781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5623054Z pt-xla-profiler: TransferFromDeviceTime too frequent: 957 counts during 912 steps 2025-03-14T06:00:23.5623058Z 2025-03-14T06:00:23.5623242Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5623382Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5623647Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5623757Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5623943Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5624088Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5624219Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5624382Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5624707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5625035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5625319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5625578Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5625858Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5626112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5626382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5626533Z Execution Analysis: (:1) 2025-03-14T06:00:23.5626793Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5626988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5626992Z 2025-03-14T06:00:23.5627176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5627288Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5627505Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5627619Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5627808Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5627953Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5628088Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5628256Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5628807Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5629350Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5629682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5630019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5630312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5630581Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5630890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5631154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5631252Z Execution Analysis: .......... 2025-03-14T06:00:23.5631499Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5631684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5631963Z pt-xla-profiler: TransferFromDeviceTime too frequent: 958 counts during 913 steps 2025-03-14T06:00:23.5631967Z 2025-03-14T06:00:23.5632151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5632293Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5632564Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5632678Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5632868Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5633015Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5633151Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5633322Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5633654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5633988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5634277Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5634539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5634826Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5635092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5635364Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5635543Z Execution Analysis: (:1) 2025-03-14T06:00:23.5635781Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5635975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5635979Z 2025-03-14T06:00:23.5636176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5636284Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5636508Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5636609Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5636805Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5636937Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5637073Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5637242Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5637786Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5638322Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5638666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5638991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5639289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5639565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5639860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5640111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5640223Z Execution Analysis: .......... 2025-03-14T06:00:23.5640459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5640656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5640917Z pt-xla-profiler: TransferFromDeviceTime too frequent: 959 counts during 914 steps 2025-03-14T06:00:23.5640946Z 2025-03-14T06:00:23.5641316Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5641426Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5641722Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5641828Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5642041Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5642178Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5642327Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5642491Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5642847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5643190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5643508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5643775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5644085Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5644351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5644794Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5645082Z Execution Analysis: (:1) 2025-03-14T06:00:23.5645351Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5645550Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5645554Z 2025-03-14T06:00:23.5645767Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5645912Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5646150Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5646260Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5646480Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5646624Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5646783Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5646953Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5647552Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5648127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5648497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5648851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5649174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5649472Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5649793Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5650061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5650179Z Execution Analysis: .......... 2025-03-14T06:00:23.5650434Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5650644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5650956Z pt-xla-profiler: TransferFromDeviceTime too frequent: 960 counts during 915 steps 2025-03-14T06:00:23.5650961Z 2025-03-14T06:00:23.5651173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5651288Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5651587Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5651701Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5651912Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5652054Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5652203Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5652372Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5652739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5653086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5653408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5653681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5653999Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5654321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5654614Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5654749Z Execution Analysis: (:1) 2025-03-14T06:00:23.5655008Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5655217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5655223Z 2025-03-14T06:00:23.5655424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5655549Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5655782Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5655908Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5656114Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5656268Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5656415Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5656589Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5657178Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5657756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5658120Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5658477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5658814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5659097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5659402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5659680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5659789Z Execution Analysis: .......... 2025-03-14T06:00:23.5660057Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5660260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5660580Z pt-xla-profiler: TransferFromDeviceTime too frequent: 961 counts during 916 steps 2025-03-14T06:00:23.5660585Z 2025-03-14T06:00:23.5660793Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5660917Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5661213Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5661335Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5661538Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5661694Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5661837Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5662018Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5662373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5662837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5663142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5663420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5663771Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5664040Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5664327Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5664458Z Execution Analysis: (:1) 2025-03-14T06:00:23.5664710Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5664918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5664924Z 2025-03-14T06:00:23.5665121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5665244Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5665755Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5665881Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5666088Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5666242Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5666388Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5666565Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5667152Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5671048Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5671444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5671891Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5672213Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5672495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5672803Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5673081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5673187Z Execution Analysis: .......... 2025-03-14T06:00:23.5673455Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5673695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5673992Z pt-xla-profiler: TransferFromDeviceTime too frequent: 962 counts during 917 steps 2025-03-14T06:00:23.5673999Z 2025-03-14T06:00:23.5674199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5674322Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5674610Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5674723Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5674925Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5675076Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5675216Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5675389Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5675751Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5676104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5676414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5676762Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5677073Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5677345Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5677740Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5677867Z Execution Analysis: (:1) 2025-03-14T06:00:23.5678217Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5678409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5678414Z 2025-03-14T06:00:23.5678601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5678705Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5678925Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5679026Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5679221Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5679351Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5679491Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5679644Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5680199Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5680731Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5681094Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5681422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5681716Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5681965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5682252Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5682497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5682597Z Execution Analysis: .......... 2025-03-14T06:00:23.5682856Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5683044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5683309Z pt-xla-profiler: TransferFromDeviceTime too frequent: 963 counts during 918 steps 2025-03-14T06:00:23.5683316Z 2025-03-14T06:00:23.5683510Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5683611Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5683884Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5683987Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5684177Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5684310Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5684445Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5684695Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5685205Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5685557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5685877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5686218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5686528Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5686793Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5687086Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5687209Z Execution Analysis: (:1) 2025-03-14T06:00:23.5687472Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5687671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5687676Z 2025-03-14T06:00:23.5687880Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5687992Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5688228Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5688334Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5688539Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5688679Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5688826Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5688991Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5689585Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5690156Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5690543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5690896Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5691211Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5691480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5691787Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5692054Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5692190Z Execution Analysis: .......... 2025-03-14T06:00:23.5692443Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5692650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5692933Z pt-xla-profiler: TransferFromDeviceTime too frequent: 964 counts during 919 steps 2025-03-14T06:00:23.5692947Z 2025-03-14T06:00:23.5693145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5693264Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5693549Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5693658Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5693865Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5694008Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5694156Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5694323Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5694685Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5695039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5695403Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5695681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5695987Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5696258Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5696548Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5696678Z Execution Analysis: (:1) 2025-03-14T06:00:23.5696935Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5697251Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5697255Z 2025-03-14T06:00:23.5697449Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5697566Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5697787Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5697900Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5698096Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5698239Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5698380Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5698550Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5699121Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5699707Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5700056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5700403Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5700703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5700974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5701271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5701562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5701662Z Execution Analysis: .......... 2025-03-14T06:00:23.5701918Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5702111Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5702395Z pt-xla-profiler: TransferFromDeviceTime too frequent: 965 counts during 920 steps 2025-03-14T06:00:23.5702400Z 2025-03-14T06:00:23.5702593Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5702709Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5702987Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5703102Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5703295Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5703445Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5703580Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5703747Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5704093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5704487Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5704790Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5705059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5705357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5705627Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5705907Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5706032Z Execution Analysis: (:1) 2025-03-14T06:00:23.5706281Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5706482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5706489Z 2025-03-14T06:00:23.5706683Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5706796Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5707016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5707130Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5707426Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5707564Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5707697Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5707855Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5708395Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5708950Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5709280Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5709606Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5709889Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5710144Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5710449Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5710701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5710803Z Execution Analysis: .......... 2025-03-14T06:00:23.5711052Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5711248Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5711523Z pt-xla-profiler: TransferFromDeviceTime too frequent: 966 counts during 921 steps 2025-03-14T06:00:23.5711527Z 2025-03-14T06:00:23.5711721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5711828Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5712107Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5712213Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5712413Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5712549Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5712691Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5712851Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5713239Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5713565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5713864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5714116Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5714411Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5714664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5714950Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5715069Z Execution Analysis: (:1) 2025-03-14T06:00:23.5715325Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5715518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5715521Z 2025-03-14T06:00:23.5715721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5715829Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5716055Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5716162Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5716365Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5716505Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5716654Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5716810Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5717462Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5717996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5718342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5718666Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5718969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5719260Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5719555Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5719807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5719918Z Execution Analysis: .......... 2025-03-14T06:00:23.5720164Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5720364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5720631Z pt-xla-profiler: TransferFromDeviceTime too frequent: 967 counts during 922 steps 2025-03-14T06:00:23.5720636Z 2025-03-14T06:00:23.5720835Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5720946Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5721225Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5721331Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5721534Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5721673Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5721825Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5722004Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5722374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5722703Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5723003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5723255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5723551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5723803Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5724084Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5724206Z Execution Analysis: (:1) 2025-03-14T06:00:23.5724461Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5724725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5724730Z 2025-03-14T06:00:23.5725089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5725201Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5725440Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5725549Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5725766Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5725912Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5726068Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5726269Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5726876Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5727452Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5727822Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5728185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5728496Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5728811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5729118Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5729399Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5729508Z Execution Analysis: .......... 2025-03-14T06:00:23.5729780Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5729984Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5730283Z pt-xla-profiler: TransferFromDeviceTime too frequent: 969 counts during 923 steps 2025-03-14T06:00:23.5730288Z 2025-03-14T06:00:23.5730489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5730615Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5730903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5731028Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5731232Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5731390Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5731586Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5731767Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5732125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5732484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5732797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5733083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5733434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5733727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5734056Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5734206Z Execution Analysis: (:1) 2025-03-14T06:00:23.5734504Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5734751Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5734756Z 2025-03-14T06:00:23.5734963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5735094Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5735325Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5735452Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5735659Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5735813Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5735986Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5736165Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5736762Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5737344Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5737703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5738068Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5738407Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5738691Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5739001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5739283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5739388Z Execution Analysis: .......... 2025-03-14T06:00:23.5739655Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5739859Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5740153Z pt-xla-profiler: TransferFromDeviceTime too frequent: 970 counts during 924 steps 2025-03-14T06:00:23.5740160Z 2025-03-14T06:00:23.5740364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5740496Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5740787Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5740907Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5741115Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5741318Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5741463Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5741642Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5741999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5742363Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5742676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5742963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5743268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5743552Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5743850Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5744097Z Execution Analysis: (:1) 2025-03-14T06:00:23.5744350Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5744558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5744562Z 2025-03-14T06:00:23.5744773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5744886Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5745116Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5745226Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5745425Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5745607Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5745751Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5745933Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5746506Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5747172Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5747516Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5747868Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5748173Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5748433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5748730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5748983Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5749089Z Execution Analysis: .......... 2025-03-14T06:00:23.5749328Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5749531Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5749798Z pt-xla-profiler: TransferFromDeviceTime too frequent: 971 counts during 925 steps 2025-03-14T06:00:23.5749805Z 2025-03-14T06:00:23.5749998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5750107Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5750387Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5750492Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5750738Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5750873Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5751015Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5751172Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5751513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5752004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5752320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5752587Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5752899Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5753161Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5753461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5753585Z Execution Analysis: (:1) 2025-03-14T06:00:23.5753846Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5754045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5754049Z 2025-03-14T06:00:23.5754257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5754365Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5754598Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5754703Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5754951Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5755088Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5755238Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5755398Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5755981Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5756533Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5756915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5757251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5757562Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5757827Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5758132Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5758390Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5758498Z Execution Analysis: .......... 2025-03-14T06:00:23.5758746Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5758946Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5759223Z pt-xla-profiler: TransferFromDeviceTime too frequent: 972 counts during 926 steps 2025-03-14T06:00:23.5759228Z 2025-03-14T06:00:23.5759429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5759539Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5759826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5759981Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5760183Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5760321Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5760462Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5760623Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5760976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5761315Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5761624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5761886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5762191Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5762455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5762744Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5762869Z Execution Analysis: (:1) 2025-03-14T06:00:23.5763117Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5763316Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5763322Z 2025-03-14T06:00:23.5763514Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5763627Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5763847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5764138Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5764337Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5764557Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5764705Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5764876Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5765787Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5766367Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5766796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5767157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5767469Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5767752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5768056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5768330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5768431Z Execution Analysis: .......... 2025-03-14T06:00:23.5768694Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5768893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5769181Z pt-xla-profiler: TransferFromDeviceTime too frequent: 973 counts during 927 steps 2025-03-14T06:00:23.5769187Z 2025-03-14T06:00:23.5769387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5769502Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5769866Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5769983Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5770183Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5770330Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5770468Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5770641Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5770995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5771353Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5771661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5771940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5772244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5772517Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5772806Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5772933Z Execution Analysis: (:1) 2025-03-14T06:00:23.5773189Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5773395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5773401Z 2025-03-14T06:00:23.5773598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5773716Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5773980Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5774100Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5774302Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5774452Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5774595Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5774767Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5775352Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5775961Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5776318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5776678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5776993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5777378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5777776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5778028Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5778126Z Execution Analysis: .......... 2025-03-14T06:00:23.5778366Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5778554Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5778822Z pt-xla-profiler: TransferFromDeviceTime too frequent: 974 counts during 928 steps 2025-03-14T06:00:23.5778827Z 2025-03-14T06:00:23.5779022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5779172Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5779445Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5779544Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5779739Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5779871Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5780014Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5780167Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5780502Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5780821Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5781115Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5781366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5781655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5781900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5782175Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5782287Z Execution Analysis: (:1) 2025-03-14T06:00:23.5782531Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5782716Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5782720Z 2025-03-14T06:00:23.5782932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5783034Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5783254Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5783355Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5783548Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5783679Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5783821Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5783974Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5784524Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5785073Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5785412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5785737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5786035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5786285Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5786575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5786819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5786922Z Execution Analysis: .......... 2025-03-14T06:00:23.5787156Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5787347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5787608Z pt-xla-profiler: TransferFromDeviceTime too frequent: 975 counts during 929 steps 2025-03-14T06:00:23.5787635Z 2025-03-14T06:00:23.5787866Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5787968Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5788242Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5788341Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5788534Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5788665Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5788803Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5788956Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5789293Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5789618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5789915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5790167Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5790455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5790699Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5790972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5791084Z Execution Analysis: (:1) 2025-03-14T06:00:23.5791327Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5791512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5791515Z 2025-03-14T06:00:23.5791733Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5791841Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5792060Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5792161Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5792355Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5792484Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5792626Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5792778Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5793349Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5793879Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5794216Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5794544Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5794835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5795091Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5795371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5795626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5795724Z Execution Analysis: .......... 2025-03-14T06:00:23.5796140Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5796337Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5796669Z pt-xla-profiler: TransferFromDeviceTime too frequent: 976 counts during 930 steps 2025-03-14T06:00:23.5796675Z 2025-03-14T06:00:23.5796868Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5796984Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5797267Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5797381Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5797576Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5797724Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5797860Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5798032Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5798380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5798728Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5799032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5799309Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5799609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5799877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5800158Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5800290Z Execution Analysis: (:1) 2025-03-14T06:00:23.5800539Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5800763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5800770Z 2025-03-14T06:00:23.5800966Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5801081Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5801302Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5801417Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5801612Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5801757Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5801897Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5802089Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5802664Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5803231Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5803582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5803930Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5804231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5804594Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5804891Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5805332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5805435Z Execution Analysis: .......... 2025-03-14T06:00:23.5805699Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5805898Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5806243Z pt-xla-profiler: TransferFromDeviceTime too frequent: 977 counts during 931 steps 2025-03-14T06:00:23.5806248Z 2025-03-14T06:00:23.5806445Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5806560Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5806845Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5806961Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5807165Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5807312Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5807450Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5807624Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5807979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5808339Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5808647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5808926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5809228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5809503Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5809794Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5809922Z Execution Analysis: (:1) 2025-03-14T06:00:23.5810203Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5810412Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5810420Z 2025-03-14T06:00:23.5810618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5810738Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5810966Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5811083Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5811283Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5811430Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5811598Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5811768Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5812359Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5812937Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5813304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5813651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5813964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5814234Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5814548Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5814813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5814922Z Execution Analysis: .......... 2025-03-14T06:00:23.5815178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5815435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5815723Z pt-xla-profiler: TransferFromDeviceTime too frequent: 978 counts during 932 steps 2025-03-14T06:00:23.5815728Z 2025-03-14T06:00:23.5815932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5816042Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5816334Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5816446Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5816654Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5816795Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5816941Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5817215Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5817552Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5817872Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5818162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5818411Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5818696Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5818943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5819219Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5819331Z Execution Analysis: (:1) 2025-03-14T06:00:23.5819599Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5819787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5819791Z 2025-03-14T06:00:23.5819982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5820084Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5820303Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5820401Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5820598Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5820752Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5820893Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5821045Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5821595Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5822123Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5822460Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5822778Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5823071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5823326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5823612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5823862Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5823963Z Execution Analysis: .......... 2025-03-14T06:00:23.5824264Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5824465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5824728Z pt-xla-profiler: TransferFromDeviceTime too frequent: 979 counts during 933 steps 2025-03-14T06:00:23.5824733Z 2025-03-14T06:00:23.5824924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5825031Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5825307Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5825409Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5825604Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5825737Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5825880Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5826036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5826369Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5826689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5826982Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5827233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5827520Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5827765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5828038Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5828173Z Execution Analysis: (:1) 2025-03-14T06:00:23.5828419Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5828600Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5828610Z 2025-03-14T06:00:23.5828792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5828904Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5829115Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5829220Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5829428Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5829566Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5829698Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5829852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5830397Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5830926Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5831253Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5831581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5831868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5832123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5832403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5832659Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5832802Z Execution Analysis: .......... 2025-03-14T06:00:23.5833047Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5833230Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5833495Z pt-xla-profiler: TransferFromDeviceTime too frequent: 980 counts during 934 steps 2025-03-14T06:00:23.5833499Z 2025-03-14T06:00:23.5833683Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5833794Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5834057Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5834163Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5834349Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5834487Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5834619Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5834777Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5835104Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5835432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5835717Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5835973Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5836255Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5836509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5836795Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5836925Z Execution Analysis: (:1) 2025-03-14T06:00:23.5837164Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5837353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5837357Z 2025-03-14T06:00:23.5837543Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5837657Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5837869Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5838002Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5838191Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5838330Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5838467Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5838633Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5839179Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5839716Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5840047Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5840381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5840671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5840932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5841215Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5841514Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5841612Z Execution Analysis: .......... 2025-03-14T06:00:23.5841860Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5842044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5842320Z pt-xla-profiler: TransferFromDeviceTime too frequent: 981 counts during 935 steps 2025-03-14T06:00:23.5842324Z 2025-03-14T06:00:23.5842512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5842624Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5842890Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5843001Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5843188Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5843334Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5843461Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5843630Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5843957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5844289Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5844662Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5845096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5845407Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5845702Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5846001Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5846125Z Execution Analysis: (:1) 2025-03-14T06:00:23.5846389Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5846588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5846592Z 2025-03-14T06:00:23.5846797Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5846936Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5847168Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5847277Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5847486Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5847630Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5847780Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5847948Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5848543Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5849117Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5849478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5849829Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5850144Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5850420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5850781Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5851050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5851160Z Execution Analysis: .......... 2025-03-14T06:00:23.5851420Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5851628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5851911Z pt-xla-profiler: TransferFromDeviceTime too frequent: 982 counts during 936 steps 2025-03-14T06:00:23.5851919Z 2025-03-14T06:00:23.5852124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5852236Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5852532Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5852644Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5852856Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5852998Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5853143Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5853313Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5853678Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5854029Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5854345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5854617Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5854952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5855228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5855525Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5855649Z Execution Analysis: (:1) 2025-03-14T06:00:23.5855910Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5856110Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5856114Z 2025-03-14T06:00:23.5856320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5856473Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5856710Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5856816Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5857029Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5857271Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5857415Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5857569Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5858119Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5858645Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5858986Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5859310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5859608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5859983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5860275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5860525Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5860632Z Execution Analysis: .......... 2025-03-14T06:00:23.5860867Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5861066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5861339Z pt-xla-profiler: TransferFromDeviceTime too frequent: 983 counts during 937 steps 2025-03-14T06:00:23.5861345Z 2025-03-14T06:00:23.5861532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5861644Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5861914Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5862025Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5862212Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5862349Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5862480Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5862639Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5862967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5863295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5863583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5863864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5864149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5864406Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5864677Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5864796Z Execution Analysis: (:1) 2025-03-14T06:00:23.5865033Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5865222Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5865248Z 2025-03-14T06:00:23.5865553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5865837Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5866071Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5866189Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5866398Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5866549Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5866699Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5866873Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5867465Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5868044Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5868405Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5868761Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5869071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5869431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5869740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5870018Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5870123Z Execution Analysis: .......... 2025-03-14T06:00:23.5870392Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5870594Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5870890Z pt-xla-profiler: TransferFromDeviceTime too frequent: 984 counts during 938 steps 2025-03-14T06:00:23.5870895Z 2025-03-14T06:00:23.5871098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5871220Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5871512Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5871629Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5871832Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5871983Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5872123Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5872295Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5872650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5873010Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5873320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5873632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5873942Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5874215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5874504Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5874637Z Execution Analysis: (:1) 2025-03-14T06:00:23.5874892Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5875135Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5875139Z 2025-03-14T06:00:23.5875336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5875456Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5875683Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5875802Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5876002Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5876149Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5876294Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5876466Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5877053Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5877743Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5878194Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5878528Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5878875Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5879128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5879417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5879661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5879765Z Execution Analysis: .......... 2025-03-14T06:00:23.5880004Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5880194Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5880457Z pt-xla-profiler: TransferFromDeviceTime too frequent: 985 counts during 939 steps 2025-03-14T06:00:23.5880463Z 2025-03-14T06:00:23.5880657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5880765Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5881035Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5881139Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5881334Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5881467Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5881608Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5881764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5882103Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5882429Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5882747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5883003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5883290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5883541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5883816Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5883935Z Execution Analysis: (:1) 2025-03-14T06:00:23.5884178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5884389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5884393Z 2025-03-14T06:00:23.5884651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5884759Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5885150Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5885261Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5885472Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5885619Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5885773Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5885955Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5886552Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5887127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5887494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5887898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5888225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5888496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5888813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5889084Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5889197Z Execution Analysis: .......... 2025-03-14T06:00:23.5889453Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5889662Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5889949Z pt-xla-profiler: TransferFromDeviceTime too frequent: 986 counts during 940 steps 2025-03-14T06:00:23.5889956Z 2025-03-14T06:00:23.5890164Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5890279Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5890571Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5890678Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5890886Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5891025Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5891174Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5891337Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5891699Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5892086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5892404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5892673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5892986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5893252Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5893547Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5893697Z Execution Analysis: (:1) 2025-03-14T06:00:23.5893959Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5894157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5894170Z 2025-03-14T06:00:23.5894373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5894491Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5894721Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5894827Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5895033Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5895172Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5895325Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5895490Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5896087Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5896664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5897068Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5897522Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5897824Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5898091Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5898389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5898655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5898758Z Execution Analysis: .......... 2025-03-14T06:00:23.5899013Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5899211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5899495Z pt-xla-profiler: TransferFromDeviceTime too frequent: 987 counts during 941 steps 2025-03-14T06:00:23.5899500Z 2025-03-14T06:00:23.5899696Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5899814Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5900096Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5900207Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5900404Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5900550Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5900688Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5900858Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5901230Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5901579Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5901882Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5902152Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5902450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5902718Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5903001Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5903151Z Execution Analysis: (:1) 2025-03-14T06:00:23.5903400Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5903607Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5903613Z 2025-03-14T06:00:23.5903808Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5903924Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5904146Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5904256Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5904460Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5904603Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5904744Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5904917Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5905488Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5906048Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5906447Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5906795Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5907097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5907472Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5907753Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5908008Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5908104Z Execution Analysis: .......... 2025-03-14T06:00:23.5908349Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5908535Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5908806Z pt-xla-profiler: TransferFromDeviceTime too frequent: 988 counts during 942 steps 2025-03-14T06:00:23.5908811Z 2025-03-14T06:00:23.5908994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5909107Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5909371Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5909483Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5909671Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5909811Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5909938Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5910100Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5910448Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5910786Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5911072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5911332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5911610Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5911867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5912163Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5912286Z Execution Analysis: (:1) 2025-03-14T06:00:23.5912522Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5912718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5912724Z 2025-03-14T06:00:23.5912912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5913018Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5913235Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5913338Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5913530Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5913660Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5913799Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5913955Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5914504Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5915078Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5915413Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5915735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5916027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5916279Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5916570Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5916819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5916922Z Execution Analysis: .......... 2025-03-14T06:00:23.5917162Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5917358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5917621Z pt-xla-profiler: TransferFromDeviceTime too frequent: 990 counts during 943 steps 2025-03-14T06:00:23.5917625Z 2025-03-14T06:00:23.5917814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5917920Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5918191Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5918293Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5918485Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5918619Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5918779Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5918936Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5919272Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5919593Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5919884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5920140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5920429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5920700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5920977Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5921095Z Execution Analysis: (:1) 2025-03-14T06:00:23.5921343Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5921536Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5921539Z 2025-03-14T06:00:23.5921734Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5921839Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5922063Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5922168Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5922368Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5922505Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5922651Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5922805Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5923357Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5923946Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5924284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5924678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5925145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5925424Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5925740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5926013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5926127Z Execution Analysis: .......... 2025-03-14T06:00:23.5926389Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5926598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5926886Z pt-xla-profiler: TransferFromDeviceTime too frequent: 991 counts during 944 steps 2025-03-14T06:00:23.5926899Z 2025-03-14T06:00:23.5927100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5927221Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5927511Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5927629Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5927831Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5928006Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5928157Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5928329Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5928691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5929040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5929361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5929643Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5929977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5930252Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5930547Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5930680Z Execution Analysis: (:1) 2025-03-14T06:00:23.5930941Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5931148Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5931152Z 2025-03-14T06:00:23.5931352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5931476Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5931706Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5931823Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5932023Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5932168Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5932314Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5932489Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5933129Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5933720Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5934813Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5935651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5936456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5937187Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5937900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5938609Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5939115Z Execution Analysis: .......... 2025-03-14T06:00:23.5939567Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5940190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5940805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 992 counts during 945 steps 2025-03-14T06:00:23.5941215Z 2025-03-14T06:00:23.5941419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5941866Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5942370Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5942895Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5943336Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5943802Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5944205Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5944631Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5945270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5946198Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5946965Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5947864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5948837Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5949541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5950227Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5950772Z Execution Analysis: (:1) 2025-03-14T06:00:23.5951267Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5951853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5952176Z 2025-03-14T06:00:23.5952494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5952926Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5953363Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5953811Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5954206Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5954655Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5955050Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5955491Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5956363Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5957615Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5958638Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5959453Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5960222Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5960910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5961601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5962288Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5962775Z Execution Analysis: .......... 2025-03-14T06:00:23.5963211Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5963774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5964372Z pt-xla-profiler: TransferFromDeviceTime too frequent: 993 counts during 946 steps 2025-03-14T06:00:23.5964841Z 2025-03-14T06:00:23.5965205Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5965762Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5966268Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5966855Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5967271Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5967742Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5968143Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5968576Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5969220Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5970051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5970837Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5971590Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5972297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5973006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5973700Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5974244Z Execution Analysis: (:1) 2025-03-14T06:00:23.5974734Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5975320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5975645Z 2025-03-14T06:00:23.5975855Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5976294Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5976742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5977320Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5977718Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.5978258Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.5978701Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.5979097Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5979904Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.5981088Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.5982054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.5982824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5983549Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5984203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5984854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5985496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5985952Z Execution Analysis: .......... 2025-03-14T06:00:23.5986378Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5986921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5987490Z pt-xla-profiler: TransferFromDeviceTime too frequent: 994 counts during 947 steps 2025-03-14T06:00:23.5987872Z 2025-03-14T06:00:23.5988061Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5988468Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5988962Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.5989445Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5989821Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.5990253Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.5990620Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.5991017Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.5991611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.5992386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.5993145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.5993806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.5994462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.5995115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.5995753Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.5996436Z Execution Analysis: (:1) 2025-03-14T06:00:23.5996914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.5997482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5997795Z 2025-03-14T06:00:23.5998002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.5998433Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.5998865Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.5999313Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.5999713Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6000232Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6000628Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6001045Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6001895Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6003141Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6004170Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6005272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6006065Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6006768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6007475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6008176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6008679Z Execution Analysis: .......... 2025-03-14T06:00:23.6009132Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6009716Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6010336Z pt-xla-profiler: TransferFromDeviceTime too frequent: 995 counts during 948 steps 2025-03-14T06:00:23.6010744Z 2025-03-14T06:00:23.6010948Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6011422Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6011946Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6012478Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6012892Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6013362Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6013755Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6014186Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6014834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6015694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6016493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6017322Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6018016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6018707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6019381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6019920Z Execution Analysis: (:1) 2025-03-14T06:00:23.6020408Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6020983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6021314Z 2025-03-14T06:00:23.6021513Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6021947Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6022387Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6022837Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6023287Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6023842Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6024222Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6024617Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6025428Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6026620Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6027592Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6028530Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6029300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6029996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6030687Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6031369Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6031851Z Execution Analysis: .......... 2025-03-14T06:00:23.6032304Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6032872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6033469Z pt-xla-profiler: TransferFromDeviceTime too frequent: 996 counts during 949 steps 2025-03-14T06:00:23.6033859Z 2025-03-14T06:00:23.6034093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6034530Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6035028Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6035540Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6035940Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6036383Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6036779Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6037203Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6037859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6038673Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6039444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6040137Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6040825Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6041511Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6042181Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6042707Z Execution Analysis: (:1) 2025-03-14T06:00:23.6043187Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6043758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6044084Z 2025-03-14T06:00:23.6044281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6044795Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6045408Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6045937Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6046351Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6046815Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6047223Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6047658Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6048537Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6049827Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6050881Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6051715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6052508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6053218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6053925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6054634Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6055139Z Execution Analysis: .......... 2025-03-14T06:00:23.6055601Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6056185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6056829Z pt-xla-profiler: TransferFromDeviceTime too frequent: 997 counts during 950 steps 2025-03-14T06:00:23.6057330Z 2025-03-14T06:00:23.6057532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6057942Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6058409Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6058900Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6059269Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6059701Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6060071Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6064735Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6065498Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6066496Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6067291Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6068008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6068710Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6069409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6070092Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6070625Z Execution Analysis: (:1) 2025-03-14T06:00:23.6071120Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6071700Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6072024Z 2025-03-14T06:00:23.6072232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6072770Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6073249Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6073708Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6074110Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6074570Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6074970Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6075394Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6076266Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6077550Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6078756Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6079527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6080247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6080898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6081545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6082187Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6082644Z Execution Analysis: .......... 2025-03-14T06:00:23.6083050Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6083586Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6084186Z pt-xla-profiler: TransferFromDeviceTime too frequent: 998 counts during 951 steps 2025-03-14T06:00:23.6084632Z 2025-03-14T06:00:23.6084820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6085416Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6085921Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6086437Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6086838Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6087297Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6087756Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6088176Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6088812Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6089636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6090418Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6091126Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6091827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6092522Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6093202Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6093739Z Execution Analysis: (:1) 2025-03-14T06:00:23.6094227Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6094802Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6095124Z 2025-03-14T06:00:23.6095335Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6096033Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6096474Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6096935Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6097445Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6097888Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6098273Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6098685Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6099529Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6100771Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6101792Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6102596Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6103357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6104045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6104731Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6105409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6105882Z Execution Analysis: .......... 2025-03-14T06:00:23.6106320Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6106912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6107602Z pt-xla-profiler: TransferFromDeviceTime too frequent: 999 counts during 952 steps 2025-03-14T06:00:23.6107977Z 2025-03-14T06:00:23.6108165Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6108565Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6109025Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6109501Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6109875Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6110324Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6110687Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6111071Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6111655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6112418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6113134Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6113795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6114448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6115101Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6115740Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6116250Z Execution Analysis: (:1) 2025-03-14T06:00:23.6116714Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6117264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6117669Z 2025-03-14T06:00:23.6117899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6118320Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6118747Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6119182Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6119568Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6120007Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6120390Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6120803Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6121630Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6122832Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6124013Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6125082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6125880Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6126600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6127314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6128017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6128526Z Execution Analysis: .......... 2025-03-14T06:00:23.6129021Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6129620Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6130243Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1000 counts during 953 steps 2025-03-14T06:00:23.6130663Z 2025-03-14T06:00:23.6130870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6131316Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6131828Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6132358Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6132805Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6133270Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6133674Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6134104Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6134746Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6135588Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6136375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6137094Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6137805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6138509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6139205Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6139753Z Execution Analysis: (:1) 2025-03-14T06:00:23.6140246Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6140884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6141213Z 2025-03-14T06:00:23.6141425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6141871Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6142321Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6142789Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6143207Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6143678Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6144091Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6144529Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6145413Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6146801Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6147834Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6148648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6149421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6150106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6150801Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6151488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6152008Z Execution Analysis: .......... 2025-03-14T06:00:23.6152462Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6153034Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6153642Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1001 counts during 954 steps 2025-03-14T06:00:23.6154049Z 2025-03-14T06:00:23.6154250Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6154685Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6155187Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6155730Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6156131Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6156587Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6156983Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6157400Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6158031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6158840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6159611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6160311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6161001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6161692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6162364Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6162902Z Execution Analysis: (:1) 2025-03-14T06:00:23.6163390Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6164019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6164335Z 2025-03-14T06:00:23.6164616Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6165221Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6165798Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6166267Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6166685Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6167159Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6167571Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6167997Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6168883Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6170160Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6171217Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6172039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6172823Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6173527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6174232Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6175012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6175511Z Execution Analysis: .......... 2025-03-14T06:00:23.6175967Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6176553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6177332Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1002 counts during 955 steps 2025-03-14T06:00:23.6177821Z 2025-03-14T06:00:23.6178009Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6178417Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6178917Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6179396Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6179766Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6180191Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6180559Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6180947Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6181530Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6182293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6183015Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6183668Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6184315Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6184957Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6185587Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6186077Z Execution Analysis: (:1) 2025-03-14T06:00:23.6186588Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6187121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6187418Z 2025-03-14T06:00:23.6187610Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6188020Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6188428Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6188850Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6189223Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6189648Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6190011Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6190411Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6191219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6192397Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6193366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6194135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6194866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6195521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6196380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6197068Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6197556Z Execution Analysis: .......... 2025-03-14T06:00:23.6197997Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6198562Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6199167Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1003 counts during 956 steps 2025-03-14T06:00:23.6199570Z 2025-03-14T06:00:23.6199770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6200229Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6200719Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6201225Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6201620Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6202070Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6202456Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6202864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6203483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6204286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6205309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6206023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6206724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6207429Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6208114Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6208715Z Execution Analysis: (:1) 2025-03-14T06:00:23.6209208Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6209786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6210106Z 2025-03-14T06:00:23.6210316Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6210757Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6211196Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6211653Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6212061Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6212518Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6212918Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6213350Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6214219Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6215496Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6216542Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6217457Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6218181Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6218867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6219517Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6220168Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6220627Z Execution Analysis: .......... 2025-03-14T06:00:23.6221046Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6221584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6222144Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1004 counts during 957 steps 2025-03-14T06:00:23.6222554Z 2025-03-14T06:00:23.6222740Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6223143Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6223603Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6224087Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6224463Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6224887Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6225254Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6225643Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6226229Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6226999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6227727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6228577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6229262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6229943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6230660Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6231189Z Execution Analysis: (:1) 2025-03-14T06:00:23.6231665Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6232230Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6232543Z 2025-03-14T06:00:23.6232744Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6233174Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6233602Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6234042Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6234428Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6234872Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6235262Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6235672Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6236516Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6237758Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6238774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6239581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6240416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6241090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6241744Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6242392Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6242850Z Execution Analysis: .......... 2025-03-14T06:00:23.6243093Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6243277Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6243575Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1005 counts during 958 steps 2025-03-14T06:00:23.6243580Z 2025-03-14T06:00:23.6243766Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6243874Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6244142Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6244254Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6244441Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6244671Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6244803Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6245132Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6245490Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6245851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6246164Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6246447Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6246753Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6247103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6247398Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6247531Z Execution Analysis: (:1) 2025-03-14T06:00:23.6247788Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6248000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6248006Z 2025-03-14T06:00:23.6248206Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6248325Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6248554Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6248675Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6248877Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6249028Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6249174Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6249350Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6249939Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6250514Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6250872Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6251232Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6251568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6251853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6252165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6252435Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6252547Z Execution Analysis: .......... 2025-03-14T06:00:23.6252804Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6253010Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6253324Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1006 counts during 959 steps 2025-03-14T06:00:23.6253328Z 2025-03-14T06:00:23.6253540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6253655Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6253953Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6254062Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6254269Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6254413Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6254560Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6254728Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6255089Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6255440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6255759Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6256031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6256393Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6256664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6256959Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6257194Z Execution Analysis: (:1) 2025-03-14T06:00:23.6257438Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6257625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6257631Z 2025-03-14T06:00:23.6257824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6257927Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6258148Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6258250Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6258447Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6258581Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6258722Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6258875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6259423Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6259950Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6260287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6260633Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6260935Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6261188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6261475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6261722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6261828Z Execution Analysis: .......... 2025-03-14T06:00:23.6262066Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6262285Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6262551Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1007 counts during 960 steps 2025-03-14T06:00:23.6262556Z 2025-03-14T06:00:23.6262752Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6262863Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6263135Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6263238Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6263432Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6263566Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6263703Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6263857Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6264193Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6264516Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6264810Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6265109Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6265512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6265942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6266239Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6266363Z Execution Analysis: (:1) 2025-03-14T06:00:23.6266630Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6266837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6266841Z 2025-03-14T06:00:23.6267058Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6267174Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6267413Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6267528Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6267741Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6267882Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6268036Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6268207Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6268805Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6269381Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6269806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6270171Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6270488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6270773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6271080Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6271352Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6271457Z Execution Analysis: .......... 2025-03-14T06:00:23.6271760Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6271958Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6272259Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1008 counts during 961 steps 2025-03-14T06:00:23.6272266Z 2025-03-14T06:00:23.6272472Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6272595Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6272884Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6273004Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6273208Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6273356Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6273496Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6273679Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6274034Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6274399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6274711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6275059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6275371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6275654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6275945Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6276081Z Execution Analysis: (:1) 2025-03-14T06:00:23.6276338Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6276547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6276552Z 2025-03-14T06:00:23.6276752Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6276876Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6277109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6277224Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6277530Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6277676Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6277821Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6278099Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6278644Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6279179Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6279536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6279878Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6280165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6280421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6280706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6280960Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6281084Z Execution Analysis: .......... 2025-03-14T06:00:23.6281326Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6281513Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6281786Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1009 counts during 962 steps 2025-03-14T06:00:23.6281794Z 2025-03-14T06:00:23.6281982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6282095Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6282362Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6282476Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6282665Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6282805Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6282938Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6283102Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6283435Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6283769Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6284121Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6284387Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6284738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6285165Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6285454Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6285591Z Execution Analysis: (:1) 2025-03-14T06:00:23.6285848Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6286060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6286065Z 2025-03-14T06:00:23.6286277Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6286389Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6286627Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6286737Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6286948Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6287091Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6287245Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6287416Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6288014Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6288616Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6288989Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6289337Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6289657Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6289930Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6290244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6290539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6290658Z Execution Analysis: .......... 2025-03-14T06:00:23.6290915Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6291127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6291418Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1011 counts during 963 steps 2025-03-14T06:00:23.6291422Z 2025-03-14T06:00:23.6291633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6291745Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6292040Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6292151Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6292359Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6292507Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6292657Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6292824Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6293192Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6293595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6293910Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6294180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6294493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6294761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6295062Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6295185Z Execution Analysis: (:1) 2025-03-14T06:00:23.6295445Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6295648Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6295654Z 2025-03-14T06:00:23.6295864Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6295976Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6296215Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6296325Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6296536Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6296678Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6296832Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6296998Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6297690Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6298276Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6298635Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6298975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6299287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6299553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6299885Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6300145Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6300257Z Execution Analysis: .......... 2025-03-14T06:00:23.6300512Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6300720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6301001Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1012 counts during 964 steps 2025-03-14T06:00:23.6301017Z 2025-03-14T06:00:23.6301216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6301327Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6301617Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6301727Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6301936Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6302080Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6302225Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6302391Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6302799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6303143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6303450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6303714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6304021Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6304288Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6304570Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6304700Z Execution Analysis: (:1) 2025-03-14T06:00:23.6304952Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6305159Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6305163Z 2025-03-14T06:00:23.6305356Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6305477Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6305701Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6305816Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6306013Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6306159Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6306300Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6306470Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6307066Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6307714Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6308044Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6308376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6308664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6308948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6309233Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6309487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6309588Z Execution Analysis: .......... 2025-03-14T06:00:23.6309833Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6310021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6310296Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1013 counts during 965 steps 2025-03-14T06:00:23.6310300Z 2025-03-14T06:00:23.6310487Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6310596Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6310864Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6310976Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6311167Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6311309Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6311444Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6311637Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6311990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6312324Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6312613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6312876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6313162Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6313421Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6313691Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6313818Z Execution Analysis: (:1) 2025-03-14T06:00:23.6314061Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6314257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6314261Z 2025-03-14T06:00:23.6314448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6314562Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6314778Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6314892Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6315084Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6315228Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6315362Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6315550Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6316101Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6316639Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6316973Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6317303Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6317594Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6317894Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6318180Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6318442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6318542Z Execution Analysis: .......... 2025-03-14T06:00:23.6318795Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6318984Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6319263Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1014 counts during 966 steps 2025-03-14T06:00:23.6319267Z 2025-03-14T06:00:23.6319459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6319565Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6319840Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6319940Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6320135Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6320268Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6320453Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6320609Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6320943Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6321262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6321560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6321811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6322106Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6322354Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6322631Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6322747Z Execution Analysis: (:1) 2025-03-14T06:00:23.6322993Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6323178Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6323182Z 2025-03-14T06:00:23.6323375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6323480Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6323700Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6323802Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6323997Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6324131Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6324301Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6324455Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6325274Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6325847Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6326215Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6326564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6326915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6327185Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6327498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6327771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6327885Z Execution Analysis: .......... 2025-03-14T06:00:23.6328143Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6328352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6328638Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1015 counts during 967 steps 2025-03-14T06:00:23.6328643Z 2025-03-14T06:00:23.6328851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6328967Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6329263Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6329374Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6329587Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6329786Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6329939Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6330106Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6330470Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6330820Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6331137Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6331412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6331722Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6331993Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6332294Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6332420Z Execution Analysis: (:1) 2025-03-14T06:00:23.6332685Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6332889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6332894Z 2025-03-14T06:00:23.6333104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6333220Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6333459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6333569Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6333780Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6333947Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6334101Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6334274Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6334872Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6335446Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6335810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6336264Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6336577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6336968Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6337254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6337512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6337610Z Execution Analysis: .......... 2025-03-14T06:00:23.6337856Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6338045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6338318Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1016 counts during 968 steps 2025-03-14T06:00:23.6338324Z 2025-03-14T06:00:23.6338511Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6338627Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6338895Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6339002Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6339242Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6339388Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6339516Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6339674Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6340005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6340337Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6340628Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6340889Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6341174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6341429Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6341703Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6341829Z Execution Analysis: (:1) 2025-03-14T06:00:23.6342064Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6342261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6342266Z 2025-03-14T06:00:23.6342449Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6342561Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6342775Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6342884Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6343091Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6343235Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6343373Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6343534Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6344078Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6344615Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6344972Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6345301Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6345589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6345848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6346134Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6346388Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6346488Z Execution Analysis: .......... 2025-03-14T06:00:23.6346733Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6346920Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6347200Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1017 counts during 969 steps 2025-03-14T06:00:23.6347205Z 2025-03-14T06:00:23.6347396Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6347510Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6347780Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6347937Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6348127Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6348269Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6348399Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6348563Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6348894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6349228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6349516Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6349777Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6350062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6350317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6350595Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6350724Z Execution Analysis: (:1) 2025-03-14T06:00:23.6350964Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6351162Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6351167Z 2025-03-14T06:00:23.6351368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6351476Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6351689Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6351844Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6352037Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6352183Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6352321Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6352487Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6353032Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6353574Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6353945Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6354272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6354580Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6354839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6355137Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6355386Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6355495Z Execution Analysis: .......... 2025-03-14T06:00:23.6355734Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6355936Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6356201Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1018 counts during 970 steps 2025-03-14T06:00:23.6356206Z 2025-03-14T06:00:23.6356407Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6356550Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6356851Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6356953Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6357152Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6357284Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6357431Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6357588Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6357931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6358255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6358553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6358808Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6359109Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6359358Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6359638Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6359755Z Execution Analysis: (:1) 2025-03-14T06:00:23.6360004Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6360193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6360197Z 2025-03-14T06:00:23.6360393Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6360496Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6360742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6360845Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6361048Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6361180Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6361327Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6361481Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6362035Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6362587Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6362932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6363256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6363556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6363809Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6364103Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6364352Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6364458Z Execution Analysis: .......... 2025-03-14T06:00:23.6364772Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6365143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6365578Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1019 counts during 971 steps 2025-03-14T06:00:23.6365592Z 2025-03-14T06:00:23.6365806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6366020Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6366335Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6366443Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6366664Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6366808Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6366961Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6367128Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6367500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6367850Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6368177Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6368453Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6368774Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6369042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6369343Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6369467Z Execution Analysis: (:1) 2025-03-14T06:00:23.6369732Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6369944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6369948Z 2025-03-14T06:00:23.6370191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6370316Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6370553Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6370673Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6370877Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6371029Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6371172Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6371354Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6371946Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6372562Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6372924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6373293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6373606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6373889Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6374194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6374473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6374579Z Execution Analysis: .......... 2025-03-14T06:00:23.6374844Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6375044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6375342Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1020 counts during 972 steps 2025-03-14T06:00:23.6375374Z 2025-03-14T06:00:23.6375599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6375724Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6376014Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6376135Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6376338Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6376492Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6376637Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6376818Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6377284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6377744Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6378035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6378296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6378581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6378839Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6379108Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6379236Z Execution Analysis: (:1) 2025-03-14T06:00:23.6379474Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6379671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6379675Z 2025-03-14T06:00:23.6379888Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6380009Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6380221Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6380335Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6380521Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6380665Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6380797Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6380965Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6381536Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6382072Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6382409Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6382744Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6383031Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6383295Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6383578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6383842Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6383941Z Execution Analysis: .......... 2025-03-14T06:00:23.6384186Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6384376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6384709Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1021 counts during 973 steps 2025-03-14T06:00:23.6384713Z 2025-03-14T06:00:23.6384913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6385021Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6385300Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6385404Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6385600Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6385737Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6385867Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6386039Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6386372Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6386709Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6387010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6387262Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6387558Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6387809Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6388093Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6388212Z Execution Analysis: (:1) 2025-03-14T06:00:23.6388466Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6388679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6388686Z 2025-03-14T06:00:23.6388883Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6388990Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6389217Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6389319Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6389518Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6389649Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6389795Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6389973Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6390529Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6391061Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6391410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6391739Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6392043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6392296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6392588Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6392837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6392947Z Execution Analysis: .......... 2025-03-14T06:00:23.6393186Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6393409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6393700Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1022 counts during 974 steps 2025-03-14T06:00:23.6393705Z 2025-03-14T06:00:23.6393902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6394009Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6394288Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6394392Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6394598Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6394733Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6394879Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6395036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6395380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6395708Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6396183Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6396450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6396764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6397027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6397332Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6397453Z Execution Analysis: (:1) 2025-03-14T06:00:23.6397748Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6397947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6397955Z 2025-03-14T06:00:23.6398160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6398271Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6398512Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6398620Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6398835Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6398974Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6399153Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6399318Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6399910Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6400471Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6400840Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6401185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6401505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6401771Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6402082Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6402353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6402455Z Execution Analysis: .......... 2025-03-14T06:00:23.6402707Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6402961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6403247Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1023 counts during 975 steps 2025-03-14T06:00:23.6403251Z 2025-03-14T06:00:23.6403446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6403568Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6403848Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6403967Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6404166Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6404318Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6404455Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6404725Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6405248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6405612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6405924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6406210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6406516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6406801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6407090Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6407228Z Execution Analysis: (:1) 2025-03-14T06:00:23.6407515Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6407735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6407740Z 2025-03-14T06:00:23.6407939Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6408065Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6408295Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6408414Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6408618Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6408798Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6408944Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6409127Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6409719Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6410306Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6410666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6411029Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6411340Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6411626Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6411933Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6412215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6412318Z Execution Analysis: .......... 2025-03-14T06:00:23.6412646Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6412848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6413147Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1024 counts during 976 steps 2025-03-14T06:00:23.6413152Z 2025-03-14T06:00:23.6413351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6413476Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6413766Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6413889Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6414093Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6414251Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6414393Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6414580Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6414938Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6415304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6415619Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6415905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6416213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6416496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6416814Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6416950Z Execution Analysis: (:1) 2025-03-14T06:00:23.6417311Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6417506Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6417510Z 2025-03-14T06:00:23.6417694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6417811Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6418024Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6418164Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6418353Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6418497Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6418633Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6418799Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6419346Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6419885Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6420227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6420550Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6420852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6421105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6421408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6421654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6422023Z Execution Analysis: .......... 2025-03-14T06:00:23.6422261Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6422470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6422737Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1025 counts during 977 steps 2025-03-14T06:00:23.6422741Z 2025-03-14T06:00:23.6422940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6423051Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6423331Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6423436Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6423643Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6423780Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6423928Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6424083Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6424426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6424746Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6425043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6425296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6425591Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6425840Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6426150Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6426274Z Execution Analysis: (:1) 2025-03-14T06:00:23.6426524Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6426711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6426716Z 2025-03-14T06:00:23.6426914Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6427021Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6427276Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6427376Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6427573Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6427706Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6427856Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6428013Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6428568Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6429096Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6429437Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6429766Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6430070Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6430321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6430617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6430913Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6431025Z Execution Analysis: .......... 2025-03-14T06:00:23.6431263Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6431461Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6431729Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1026 counts during 978 steps 2025-03-14T06:00:23.6431733Z 2025-03-14T06:00:23.6431932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6432040Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6432320Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6432425Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6432628Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6432767Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6432912Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6433069Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6433410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6433734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6434039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6434297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6434594Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6434874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6435164Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6435282Z Execution Analysis: (:1) 2025-03-14T06:00:23.6435534Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6435724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6435741Z 2025-03-14T06:00:23.6435930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6436073Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6436288Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6436406Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6436597Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6436735Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6436884Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6437044Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6437605Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6438155Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6438490Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6438833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6439125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6439393Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6439733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6439995Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6440096Z Execution Analysis: .......... 2025-03-14T06:00:23.6440349Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6440537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6440822Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1027 counts during 979 steps 2025-03-14T06:00:23.6440829Z 2025-03-14T06:00:23.6441017Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6441140Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6441412Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6441535Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6441728Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6441873Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6442006Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6442175Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6442507Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6442846Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6443138Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6443412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6443718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6443987Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6444259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6444390Z Execution Analysis: (:1) 2025-03-14T06:00:23.6444710Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6445080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6445084Z 2025-03-14T06:00:23.6445316Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6445441Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6445673Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6445802Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6446008Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6446170Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6446318Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6446499Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6447090Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6447675Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6448035Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6448401Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6448716Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6449052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6449361Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6449641Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6449751Z Execution Analysis: .......... 2025-03-14T06:00:23.6450023Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6450225Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6450529Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1028 counts during 980 steps 2025-03-14T06:00:23.6450534Z 2025-03-14T06:00:23.6450739Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6450869Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6451162Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6451284Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6451490Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6451649Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6451792Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6451971Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6452330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6452699Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6453016Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6453326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6453637Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6453921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6454228Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6454354Z Execution Analysis: (:1) 2025-03-14T06:00:23.6454624Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6454826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6454872Z 2025-03-14T06:00:23.6455089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6455205Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6455453Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6455564Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6455787Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6455930Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6456089Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6456256Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6456862Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6457520Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6457867Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6458194Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6458523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6458802Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6459099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6459347Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6459457Z Execution Analysis: .......... 2025-03-14T06:00:23.6459697Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6459897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6460163Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1029 counts during 981 steps 2025-03-14T06:00:23.6460167Z 2025-03-14T06:00:23.6460370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6460482Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6460762Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6460866Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6461067Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6461204Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6461349Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6461505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6461850Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6462175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6462503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6462757Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6463056Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6463304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6463588Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6463704Z Execution Analysis: (:1) 2025-03-14T06:00:23.6463955Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6464168Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6464172Z 2025-03-14T06:00:23.6464369Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6464479Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6464702Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6464808Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6465010Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6465142Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6465415Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6465738Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6466342Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6466913Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6467287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6467638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6468060Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6468339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6468660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6468931Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6469055Z Execution Analysis: .......... 2025-03-14T06:00:23.6469318Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6469534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6469826Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1030 counts during 982 steps 2025-03-14T06:00:23.6469843Z 2025-03-14T06:00:23.6470050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6470178Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6470470Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6470593Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6470800Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6470957Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6471104Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6471289Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6471646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6472018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6472363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6472658Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6472965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6473246Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6473539Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6473675Z Execution Analysis: (:1) 2025-03-14T06:00:23.6473933Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6478753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6478776Z 2025-03-14T06:00:23.6479001Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6479115Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6479339Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6479446Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6479637Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6479775Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6479911Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6480064Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6480624Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6481164Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6481501Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6481930Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6482223Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6482480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6482761Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6483019Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6483121Z Execution Analysis: .......... 2025-03-14T06:00:23.6483370Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6483556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6483832Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1032 counts during 983 steps 2025-03-14T06:00:23.6483840Z 2025-03-14T06:00:23.6484026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6484137Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6484404Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6484615Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6484805Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6485111Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6485254Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6485430Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6485788Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6486254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6486567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6486849Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6487155Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6487428Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6487717Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6487878Z Execution Analysis: (:1) 2025-03-14T06:00:23.6488138Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6488346Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6488353Z 2025-03-14T06:00:23.6488553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6488680Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6488906Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6489024Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6489224Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6489368Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6489509Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6489679Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6490268Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6490844Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6491251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6491604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6491913Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6492190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6492493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6492773Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6492876Z Execution Analysis: .......... 2025-03-14T06:00:23.6493140Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6493340Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6493637Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1033 counts during 984 steps 2025-03-14T06:00:23.6493642Z 2025-03-14T06:00:23.6493841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6493962Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6494247Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6494360Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6494560Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6494708Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6494848Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6495020Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6495414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6495773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6496082Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6496358Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6496667Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6496933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6497332Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6497478Z Execution Analysis: (:1) 2025-03-14T06:00:23.6497733Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6497927Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6497934Z 2025-03-14T06:00:23.6498132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6498241Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6498470Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6498576Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6498779Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6498916Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6499062Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6499225Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6499805Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6500387Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6500766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6501105Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6501416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6501681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6501985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6502245Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6502354Z Execution Analysis: .......... 2025-03-14T06:00:23.6502603Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6502810Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6503085Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1034 counts during 985 steps 2025-03-14T06:00:23.6503090Z 2025-03-14T06:00:23.6503292Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6503400Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6503686Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6503791Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6503995Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6504133Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6504275Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6504460Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6504814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6505157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6505462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6505728Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6506037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6506298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6506616Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6506735Z Execution Analysis: (:1) 2025-03-14T06:00:23.6506991Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6507296Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6507300Z 2025-03-14T06:00:23.6507489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6507591Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6507811Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6507911Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6508106Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6508239Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6508379Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6508533Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6509089Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6509666Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6510005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6510326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6510621Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6510868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6511159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6511403Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6511507Z Execution Analysis: .......... 2025-03-14T06:00:23.6511743Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6511933Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6512199Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1035 counts during 986 steps 2025-03-14T06:00:23.6512203Z 2025-03-14T06:00:23.6512386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6512494Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6512757Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6512866Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6513223Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6513365Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6513526Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6513691Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6514040Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6514384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6514683Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6514949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6515244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6515537Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6515818Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6515947Z Execution Analysis: (:1) 2025-03-14T06:00:23.6516195Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6516396Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6516401Z 2025-03-14T06:00:23.6516591Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6516704Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6516925Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6517036Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6517234Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6517379Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6517524Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6517697Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6518301Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6518894Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6519246Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6519601Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6519907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6520191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6520494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6520769Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6520881Z Execution Analysis: .......... 2025-03-14T06:00:23.6521146Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6521344Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6521638Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1036 counts during 987 steps 2025-03-14T06:00:23.6521643Z 2025-03-14T06:00:23.6521844Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6521965Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6522250Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6522374Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6522576Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6522757Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6522907Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6523091Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6523441Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6523801Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6524111Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6524394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6524815Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6525267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6525565Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6525708Z Execution Analysis: (:1) 2025-03-14T06:00:23.6525976Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6526195Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6526199Z 2025-03-14T06:00:23.6526404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6526535Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6526771Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6526902Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6527111Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6527272Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6527422Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6527608Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6528265Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6528852Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6529214Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6529584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6529918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6530196Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6530521Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6530798Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6530920Z Execution Analysis: .......... 2025-03-14T06:00:23.6531184Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6531403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6531695Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1037 counts during 988 steps 2025-03-14T06:00:23.6531700Z 2025-03-14T06:00:23.6531915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6532031Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6532337Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6532449Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6532690Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6532841Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6532996Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6533167Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6533538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6533890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6534215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6534515Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6534834Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6535107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6535417Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6535552Z Execution Analysis: (:1) 2025-03-14T06:00:23.6535822Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6536025Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6536029Z 2025-03-14T06:00:23.6536239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6536355Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6536598Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6536715Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6536933Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6537191Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6537343Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6537549Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6538112Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6538643Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6538988Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6539320Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6539622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6539881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6540178Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6540433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6540543Z Execution Analysis: .......... 2025-03-14T06:00:23.6540785Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6540987Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6541257Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1038 counts during 989 steps 2025-03-14T06:00:23.6541263Z 2025-03-14T06:00:23.6541464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6541572Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6541853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6541984Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6542192Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6542331Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6542480Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6542639Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6542982Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6543311Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6543670Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6543923Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6544223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6544477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6544765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6544883Z Execution Analysis: (:1) 2025-03-14T06:00:23.6545134Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6545323Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6545340Z 2025-03-14T06:00:23.6545531Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6545656Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6545874Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6545981Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6546187Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6546322Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6546521Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6546681Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6547241Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6547786Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6548119Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6548458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6548749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6549017Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6549306Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6549573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6549674Z Execution Analysis: .......... 2025-03-14T06:00:23.6549925Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6550116Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6550400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1039 counts during 990 steps 2025-03-14T06:00:23.6550404Z 2025-03-14T06:00:23.6550592Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6550713Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6551004Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6551124Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6551317Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6551464Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6551599Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6551768Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6552101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6552436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6552750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6553016Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6553309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6553572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6553844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6553971Z Execution Analysis: (:1) 2025-03-14T06:00:23.6554213Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6554414Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6554420Z 2025-03-14T06:00:23.6554607Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6554725Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6554941Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6555058Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6555252Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6555442Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6555584Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6555752Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6556299Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6556840Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6557182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6557519Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6557812Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6558084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6558375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6558646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6558749Z Execution Analysis: .......... 2025-03-14T06:00:23.6559002Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6559192Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6559474Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1040 counts during 991 steps 2025-03-14T06:00:23.6559479Z 2025-03-14T06:00:23.6559695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6559817Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6560089Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6560205Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6560396Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6560541Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6560674Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6560844Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6561178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6561546Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6561839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6562110Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6562402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6562669Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6562937Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6563062Z Execution Analysis: (:1) 2025-03-14T06:00:23.6563297Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6563493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6563500Z 2025-03-14T06:00:23.6563695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6563799Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6564019Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6564155Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6564369Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6564584Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6564728Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6565049Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6565766Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6566346Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6566717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6567069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6567393Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6567669Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6567985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6568254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6568366Z Execution Analysis: .......... 2025-03-14T06:00:23.6568627Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6568839Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6569128Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1041 counts during 992 steps 2025-03-14T06:00:23.6569134Z 2025-03-14T06:00:23.6569405Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6569529Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6569824Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6569936Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6570147Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6570292Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6570441Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6570611Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6571012Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6571366Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6571685Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6571961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6572277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6572547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6572846Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6572972Z Execution Analysis: (:1) 2025-03-14T06:00:23.6573235Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6573440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6573444Z 2025-03-14T06:00:23.6573655Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6573771Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6574075Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6574186Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6574398Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6574541Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6574697Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6574864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6575460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6576034Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6576402Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6576754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6577185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6577450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6577759Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6578119Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6578225Z Execution Analysis: .......... 2025-03-14T06:00:23.6578460Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6578658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6578947Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1042 counts during 993 steps 2025-03-14T06:00:23.6578961Z 2025-03-14T06:00:23.6579151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6579261Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6579529Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6579634Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6579820Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6579959Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6580089Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6580266Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6580603Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6580932Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6581217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6581477Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6581759Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6582009Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6582278Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6582400Z Execution Analysis: (:1) 2025-03-14T06:00:23.6582641Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6582832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6582836Z 2025-03-14T06:00:23.6583021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6583157Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6583395Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6583504Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6583691Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6583825Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6583962Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6584125Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6584668Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6585207Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6585539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6585874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6586161Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6586421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6586704Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6586960Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6587065Z Execution Analysis: .......... 2025-03-14T06:00:23.6587310Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6587519Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6587792Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1043 counts during 994 steps 2025-03-14T06:00:23.6587801Z 2025-03-14T06:00:23.6587986Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6588097Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6588364Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6588471Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6588661Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6588801Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6588956Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6589117Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6589446Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6589777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6590070Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6590327Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6590610Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6590861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6591134Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6591259Z Execution Analysis: (:1) 2025-03-14T06:00:23.6591497Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6591693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6591697Z 2025-03-14T06:00:23.6591929Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6592042Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6592254Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6592362Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6592551Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6592691Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6592828Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6592995Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6593536Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6594074Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6594406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6594734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6595019Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6595278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6595556Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6595813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6596083Z Execution Analysis: .......... 2025-03-14T06:00:23.6596333Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6596560Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6596844Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1044 counts during 995 steps 2025-03-14T06:00:23.6596848Z 2025-03-14T06:00:23.6597054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6597166Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6597455Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6597564Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6597769Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6597948Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6598090Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6598253Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6598606Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6598953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6599260Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6599525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6599830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6600089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6600380Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6600501Z Execution Analysis: (:1) 2025-03-14T06:00:23.6600760Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6600956Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6600986Z 2025-03-14T06:00:23.6601211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6601322Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6601550Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6601658Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6601860Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6601999Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6602146Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6602309Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6602884Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6603447Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6603803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6604143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6604456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6604814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6605294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6605564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6605678Z Execution Analysis: .......... 2025-03-14T06:00:23.6605968Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6606184Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6606473Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1045 counts during 996 steps 2025-03-14T06:00:23.6606478Z 2025-03-14T06:00:23.6606686Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6606801Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6607100Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6607237Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6607453Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6607597Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6607749Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6607922Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6608289Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6608639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6608959Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6609231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6609547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6609819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6610118Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6610245Z Execution Analysis: (:1) 2025-03-14T06:00:23.6610511Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6610763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6610768Z 2025-03-14T06:00:23.6610977Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6611088Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6611328Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6611437Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6611650Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6611793Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6611952Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6612118Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6612718Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6613291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6613659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6614015Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6614327Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6614609Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6614915Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6615187Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6615320Z Execution Analysis: .......... 2025-03-14T06:00:23.6615591Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6615792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6616080Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1046 counts during 997 steps 2025-03-14T06:00:23.6616087Z 2025-03-14T06:00:23.6616287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6616406Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6616692Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6616838Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6617039Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6617289Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6617422Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6617586Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6617917Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6618249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6618536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6618792Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6619078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6619329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6619600Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6619722Z Execution Analysis: (:1) 2025-03-14T06:00:23.6620007Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6620202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6620206Z 2025-03-14T06:00:23.6620392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6620501Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6620714Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6620824Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6621014Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6621151Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6621285Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6621452Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6622001Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6622533Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6622864Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6623197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6623485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6623747Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6624030Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6624309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6624408Z Execution Analysis: .......... 2025-03-14T06:00:23.6624653Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6624839Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6625112Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1047 counts during 998 steps 2025-03-14T06:00:23.6625118Z 2025-03-14T06:00:23.6625304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6625441Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6625709Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6625820Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6626010Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6626153Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6626289Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6626451Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6626782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6627116Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6627402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6627662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6627950Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6628204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6628476Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6628625Z Execution Analysis: (:1) 2025-03-14T06:00:23.6628953Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6629150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6629154Z 2025-03-14T06:00:23.6629347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6629455Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6629677Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6629782Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6629976Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6630110Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6630245Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6630409Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6630958Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6631498Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6631840Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6632162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6632456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6632714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6633035Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6633289Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6633392Z Execution Analysis: .......... 2025-03-14T06:00:23.6633633Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6633825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6634092Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1048 counts during 999 steps 2025-03-14T06:00:23.6634096Z 2025-03-14T06:00:23.6634286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6634421Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6634696Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6634800Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6634999Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6635135Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6635271Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6635426Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6635760Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6636085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6636375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6636628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6636919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6637171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6637495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6637610Z Execution Analysis: (:1) 2025-03-14T06:00:23.6637853Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6638039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6638043Z 2025-03-14T06:00:23.6638242Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6638351Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6638571Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6638672Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6638873Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6639008Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6639149Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6639307Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6639855Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6640388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6640728Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6641054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6641348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6641626Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6641918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6642169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6642272Z Execution Analysis: .......... 2025-03-14T06:00:23.6642509Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6642702Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6642966Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1049 counts during 1000 steps 2025-03-14T06:00:23.6642994Z 2025-03-14T06:00:23.6643189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6643292Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6643568Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6643667Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6643871Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6644004Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6644145Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6644299Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6644733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6645238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6645623Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6645909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6646220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6646501Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6646851Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6646988Z Execution Analysis: (:1) 2025-03-14T06:00:23.6647251Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6647465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6647469Z 2025-03-14T06:00:23.6647671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6647798Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6648030Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6648146Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6648353Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6648510Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6648664Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6648845Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6649434Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6650014Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6650374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6650738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6651081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6651367Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6651681Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6651966Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6652074Z Execution Analysis: .......... 2025-03-14T06:00:23.6652343Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6652546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6652878Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1050 counts during 1001 steps 2025-03-14T06:00:23.6652882Z 2025-03-14T06:00:23.6653086Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6653214Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6653507Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6653629Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6653836Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6653994Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6654136Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6654317Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6654673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6655036Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6655350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6655644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6655954Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6656284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6656576Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6656710Z Execution Analysis: (:1) 2025-03-14T06:00:23.6657072Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6657278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6657284Z 2025-03-14T06:00:23.6657481Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6657600Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6657990Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6658112Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6658321Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6658469Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6658616Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6658788Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6659382Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6659960Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6660321Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6660678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6661017Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6661308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6661617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6661897Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6662002Z Execution Analysis: .......... 2025-03-14T06:00:23.6662268Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6662691Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6662984Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1051 counts during 1002 steps 2025-03-14T06:00:23.6662989Z 2025-03-14T06:00:23.6663203Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6663320Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6663622Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6663732Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6663945Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6664087Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6664237Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6664407Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6664774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6665127Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6665582Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6665860Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6666282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6666554Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6666857Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6666982Z Execution Analysis: (:1) 2025-03-14T06:00:23.6667248Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6667452Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6667457Z 2025-03-14T06:00:23.6667666Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6667781Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6668023Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6668138Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6668353Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6668497Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6668655Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6668823Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6669422Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6669999Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6670368Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6670754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6671084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6671360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6671680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6671947Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6672062Z Execution Analysis: .......... 2025-03-14T06:00:23.6672320Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6672567Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6672858Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1053 counts during 1003 steps 2025-03-14T06:00:23.6672866Z 2025-03-14T06:00:23.6673074Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6673195Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6673492Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6673602Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6673815Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6673957Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6674110Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6674281Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6674648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6674999Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6675320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6675647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6675965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6676241Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6676541Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6676671Z Execution Analysis: (:1) 2025-03-14T06:00:23.6676941Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6677146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6677151Z 2025-03-14T06:00:23.6677360Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6677475Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6677718Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6677832Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6678046Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6678299Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6678450Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6678612Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6679196Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6679760Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6680241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6680580Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6680872Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6681131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6681416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6681673Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6681800Z Execution Analysis: .......... 2025-03-14T06:00:23.6682051Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6682238Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6682524Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1054 counts during 1004 steps 2025-03-14T06:00:23.6682531Z 2025-03-14T06:00:23.6682720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6682835Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6683102Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6683213Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6683402Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6683541Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6683672Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6683841Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6684171Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6684564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6685072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6685362Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6685669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6685947Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6686242Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6686375Z Execution Analysis: (:1) 2025-03-14T06:00:23.6686637Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6686844Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6686849Z 2025-03-14T06:00:23.6687049Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6687175Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6687405Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6687524Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6687730Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6687878Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6688026Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6688205Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6688798Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6689405Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6689767Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6690131Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6690446Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6690728Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6691037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6691318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6691451Z Execution Analysis: .......... 2025-03-14T06:00:23.6691721Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6691930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6692238Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1055 counts during 1005 steps 2025-03-14T06:00:23.6692244Z 2025-03-14T06:00:23.6692447Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6692571Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6692863Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6692985Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6693193Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6693351Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6693494Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6693677Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6694036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6694425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6694766Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6695045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6695352Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6695632Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6695927Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6696064Z Execution Analysis: (:1) 2025-03-14T06:00:23.6696326Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6696540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6696546Z 2025-03-14T06:00:23.6696759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6696877Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6697226Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6697335Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6697536Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6697683Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6697830Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6698004Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6698582Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6699175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6699543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6699885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6700198Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6700463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6700768Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6701056Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6701169Z Execution Analysis: .......... 2025-03-14T06:00:23.6701419Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6701624Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6701908Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1056 counts during 1006 steps 2025-03-14T06:00:23.6701912Z 2025-03-14T06:00:23.6702114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6702224Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6702518Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6702624Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6702831Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6702969Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6703114Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6703277Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6703633Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6704037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6704353Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6704618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6704927Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6705189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6705484Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6705607Z Execution Analysis: (:1) 2025-03-14T06:00:23.6705869Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6706066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6706072Z 2025-03-14T06:00:23.6706276Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6706387Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6706621Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6706728Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6706936Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6707075Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6707332Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6707486Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6708061Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6708593Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6708939Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6709267Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6709565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6709818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6710134Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6710383Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6710489Z Execution Analysis: .......... 2025-03-14T06:00:23.6710733Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6710935Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6711208Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1057 counts during 1007 steps 2025-03-14T06:00:23.6711212Z 2025-03-14T06:00:23.6711407Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6711513Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6711789Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6711896Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6712091Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6712225Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6712367Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6712525Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6712909Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6713237Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6713536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6713791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6714084Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6714336Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6714617Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6714733Z Execution Analysis: (:1) 2025-03-14T06:00:23.6714980Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6715180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6715184Z 2025-03-14T06:00:23.6715372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6715484Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6715700Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6715810Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6716002Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6716142Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6716276Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6716443Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6717014Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6717555Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6717887Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6718215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6718504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6718790Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6719074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6719333Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6719434Z Execution Analysis: .......... 2025-03-14T06:00:23.6719683Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6720042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6720329Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1058 counts during 1008 steps 2025-03-14T06:00:23.6720334Z 2025-03-14T06:00:23.6720698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6720820Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6721112Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6721233Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6721437Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6721590Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6721734Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6721969Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6722328Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6722690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6723003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6723282Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6723592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6723866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6724158Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6724297Z Execution Analysis: (:1) 2025-03-14T06:00:23.6724650Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6724869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6724873Z 2025-03-14T06:00:23.6725074Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6725196Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6725429Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6725549Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6725754Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6725905Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6726052Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6726260Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6726856Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6727439Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6727797Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6728157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6728497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6728778Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6729088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6729366Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6729477Z Execution Analysis: .......... 2025-03-14T06:00:23.6729744Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6729947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6730245Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1059 counts during 1009 steps 2025-03-14T06:00:23.6730249Z 2025-03-14T06:00:23.6730462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6730581Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6730879Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6730990Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6731204Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6731378Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6731549Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6731730Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6732088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6732452Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6732775Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6733053Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6733375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6733647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6733954Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6734084Z Execution Analysis: (:1) 2025-03-14T06:00:23.6734357Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6734561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6734566Z 2025-03-14T06:00:23.6734779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6734895Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6735137Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6735251Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6735470Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6735637Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6735914Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6736231Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6737403Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6738530Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6739245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6739928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6740596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6741127Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6741743Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6742264Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6742467Z Execution Analysis: .......... 2025-03-14T06:00:23.6742960Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6743357Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6743913Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1060 counts during 1010 steps 2025-03-14T06:00:23.6743926Z 2025-03-14T06:00:23.6744324Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6744531Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6745110Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6745317Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6745752Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6746049Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6746326Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6746638Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6747353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6748038Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6748661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6749190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6749802Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6750322Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6750904Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6751129Z Execution Analysis: (:1) 2025-03-14T06:00:23.6751630Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6752011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6752018Z 2025-03-14T06:00:23.6752408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6752620Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6753073Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6753275Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6753667Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6753963Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6754255Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6754568Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6755738Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6756862Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6757577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6758291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6758907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6759439Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6760047Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6760576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6760767Z Execution Analysis: .......... 2025-03-14T06:00:23.6761272Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6761656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6762223Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1061 counts during 1011 steps 2025-03-14T06:00:23.6762234Z 2025-03-14T06:00:23.6762615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6762836Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6763400Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6763640Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6764054Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6764330Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6764650Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6764977Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6765816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6766517Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6767127Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6767668Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6768269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6768803Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6769367Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6769614Z Execution Analysis: (:1) 2025-03-14T06:00:23.6770108Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6770505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6770513Z 2025-03-14T06:00:23.6770897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6771119Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6771564Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6771783Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6772238Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6772520Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6772794Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6773126Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6774282Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6775423Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6776167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6776866Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6777472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6778017Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6778615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6779146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6779338Z Execution Analysis: .......... 2025-03-14T06:00:23.6779846Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6780226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6780800Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1062 counts during 1012 steps 2025-03-14T06:00:23.6780807Z 2025-03-14T06:00:23.6781189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6781417Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6782065Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6782282Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6782664Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6782940Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6783198Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6783521Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6784220Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6784925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6785528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6786075Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6786678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6787212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6787778Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6788016Z Execution Analysis: (:1) 2025-03-14T06:00:23.6788510Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6788906Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6788916Z 2025-03-14T06:00:23.6789300Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6789525Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6789997Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6790211Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6790597Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6790876Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6791145Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6791464Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6792619Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6793753Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6794494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6795182Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6795804Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6796329Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6796934Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6797448Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6797650Z Execution Analysis: .......... 2025-03-14T06:00:23.6798140Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6798543Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6799100Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1063 counts during 1013 steps 2025-03-14T06:00:23.6799107Z 2025-03-14T06:00:23.6799504Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6799776Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6800350Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6800557Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6800952Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6801218Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6801498Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6801812Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6802523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6803208Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6803830Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6804357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6805021Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6805540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6806114Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6806343Z Execution Analysis: (:1) 2025-03-14T06:00:23.6806850Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6807235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6807242Z 2025-03-14T06:00:23.6807638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6807900Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6808355Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6808562Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6808962Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6809227Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6809511Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6809821Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6810992Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6812147Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6812867Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6813557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6814184Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6814710Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6815314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6815829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6816032Z Execution Analysis: .......... 2025-03-14T06:00:23.6816523Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6816919Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6817482Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1064 counts during 1014 steps 2025-03-14T06:00:23.6817489Z 2025-03-14T06:00:23.6818024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6818229Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6818804Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6819006Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6819403Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6819668Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6819942Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6820260Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6820969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6821660Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6822281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6822809Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6823412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6823931Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6824510Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6824743Z Execution Analysis: (:1) 2025-03-14T06:00:23.6825249Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6825627Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6825646Z 2025-03-14T06:00:23.6826062Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6826283Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6826727Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6826941Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6827324Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6827609Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6827885Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6828201Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6829372Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6830542Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6831239Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6831941Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6832543Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6833082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6833676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6834202Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6834394Z Execution Analysis: .......... 2025-03-14T06:00:23.6834893Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6835276Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6835846Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1065 counts during 1015 steps 2025-03-14T06:00:23.6835913Z 2025-03-14T06:00:23.6836296Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6836515Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6837070Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6837284Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6837669Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6837948Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6838211Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6838541Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6839230Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6839937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6840551Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6841091Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6841684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6842213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6842780Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6843026Z Execution Analysis: (:1) 2025-03-14T06:00:23.6843516Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6843913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6843951Z 2025-03-14T06:00:23.6844334Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6844614Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6845056Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6845274Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6845653Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6845932Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6846204Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6846534Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6847728Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6848859Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6849560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6850265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6850865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6851408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6852005Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6852540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6852735Z Execution Analysis: .......... 2025-03-14T06:00:23.6853237Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6853622Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6854255Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1066 counts during 1016 steps 2025-03-14T06:00:23.6854262Z 2025-03-14T06:00:23.6854637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6854860Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6855420Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6855636Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6856021Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6856299Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6856562Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6856888Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6857585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6858293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6858902Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6859438Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6860044Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6860563Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6861142Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6861370Z Execution Analysis: (:1) 2025-03-14T06:00:23.6861876Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6862283Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6862294Z 2025-03-14T06:00:23.6862692Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6862896Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6863360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6863560Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6863961Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6864222Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6864535Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6864848Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6866136Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6867266Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6867984Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6868675Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6869296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6869823Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6870434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6870950Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6871155Z Execution Analysis: .......... 2025-03-14T06:00:23.6871646Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6872169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6872727Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1067 counts during 1017 steps 2025-03-14T06:00:23.6872735Z 2025-03-14T06:00:23.6873130Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6873340Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6873917Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6874122Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6874518Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6874780Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6875056Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6875372Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6876089Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6876779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6877391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6877917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6878523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6879039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6879618Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6879851Z Execution Analysis: (:1) 2025-03-14T06:00:23.6880393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6880776Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6880784Z 2025-03-14T06:00:23.6881177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6881386Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6881840Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6882043Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6882440Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6882748Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6883034Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6883347Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6884570Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6885701Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6886413Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6887099Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6887721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6888245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6888853Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6889371Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6889580Z Execution Analysis: .......... 2025-03-14T06:00:23.6890135Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6890527Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6891085Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1068 counts during 1018 steps 2025-03-14T06:00:23.6891106Z 2025-03-14T06:00:23.6891490Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6891713Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6892283Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6892501Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6892883Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6893167Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6893438Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6893775Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6894476Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6895179Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6895788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6896332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6896930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6897466Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6898031Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6898304Z Execution Analysis: (:1) 2025-03-14T06:00:23.6898798Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6899203Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6899210Z 2025-03-14T06:00:23.6899592Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6899816Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6900261Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6900479Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6900893Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6901174Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6901448Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6901777Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6902939Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6904083Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6904781Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6905487Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6906100Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6906647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6907245Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6907783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6908011Z Execution Analysis: .......... 2025-03-14T06:00:23.6908551Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6908935Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6909512Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1069 counts during 1019 steps 2025-03-14T06:00:23.6909520Z 2025-03-14T06:00:23.6909903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6910131Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6910696Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6910910Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6911297Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6911579Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6911849Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6912177Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6912873Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6913576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6914182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6914726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6915321Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6915851Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6916462Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6916704Z Execution Analysis: (:1) 2025-03-14T06:00:23.6917200Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6917596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6917603Z 2025-03-14T06:00:23.6917986Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6918206Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6918646Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6918894Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6919279Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6919561Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6919837Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6920163Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6921322Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6922459Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6923162Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6923869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6924547Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6925070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6925687Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6926271Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6926474Z Execution Analysis: .......... 2025-03-14T06:00:23.6926965Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6927356Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6927921Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1070 counts during 1020 steps 2025-03-14T06:00:23.6927929Z 2025-03-14T06:00:23.6928330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6928545Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6929123Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6929324Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6929724Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6929997Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6930277Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6930591Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6931301Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6931993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6932612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6933145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6933747Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6934295Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6934875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6935110Z Execution Analysis: (:1) 2025-03-14T06:00:23.6935616Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6936000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6936007Z 2025-03-14T06:00:23.6936404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6936611Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6937098Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6937301Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6937699Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6937964Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6938252Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6938571Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6939735Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6940861Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6941569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6942259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6942880Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6943409Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6944062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6944608Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6944816Z Execution Analysis: .......... 2025-03-14T06:00:23.6945307Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6945706Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6946264Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1071 counts during 1021 steps 2025-03-14T06:00:23.6946275Z 2025-03-14T06:00:23.6946669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6946881Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6947452Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6947656Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6948060Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6948325Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6948602Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6948916Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6949629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6950312Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6950940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6951465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6952105Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6952620Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6953201Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6953432Z Execution Analysis: (:1) 2025-03-14T06:00:23.6953938Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6954320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6954340Z 2025-03-14T06:00:23.6954722Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6954963Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6955412Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6955613Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6956013Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6956280Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6956566Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6956877Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6958044Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6959180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6959879Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6960578Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6961190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6961731Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6962391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6962919Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6963110Z Execution Analysis: .......... 2025-03-14T06:00:23.6963612Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6963993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6964631Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1072 counts during 1022 steps 2025-03-14T06:00:23.6964639Z 2025-03-14T06:00:23.6965021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6965242Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6965961Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6966181Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6966566Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6966850Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6967113Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6967441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6968142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6973951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6974596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6975135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6975830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6976363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6976926Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6977166Z Execution Analysis: (:1) 2025-03-14T06:00:23.6977661Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6978053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6978106Z 2025-03-14T06:00:23.6978485Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6978700Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6979137Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6979351Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6979733Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6980007Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6980276Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6980597Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6981755Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.6982877Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.6983577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.6984274Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6984883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6985516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6986105Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6986625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6986815Z Execution Analysis: .......... 2025-03-14T06:00:23.6987312Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6987695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6988264Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1074 counts during 1023 steps 2025-03-14T06:00:23.6988272Z 2025-03-14T06:00:23.6988651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6988870Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6989431Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.6989639Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6990023Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.6990297Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.6990558Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.6990881Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6991578Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.6992272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.6992875Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.6993440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.6994037Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.6994559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.6995114Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.6995347Z Execution Analysis: (:1) 2025-03-14T06:00:23.6995834Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.6996221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6996260Z 2025-03-14T06:00:23.6996636Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.6996851Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.6997292Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.6997501Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.6997885Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.6998153Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.6998423Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.6998739Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.6999893Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7001029Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7001730Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7002416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7003092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7003615Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7004208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7004817Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7005020Z Execution Analysis: .......... 2025-03-14T06:00:23.7005509Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7005897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7006452Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1075 counts during 1024 steps 2025-03-14T06:00:23.7006461Z 2025-03-14T06:00:23.7006852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7007060Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7007624Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7007820Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7008202Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7008461Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7008721Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7009032Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7009731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7010414Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7011054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7011583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7012179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7012690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7013259Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7013484Z Execution Analysis: (:1) 2025-03-14T06:00:23.7013981Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7014408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7014415Z 2025-03-14T06:00:23.7014805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7015010Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7015463Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7015656Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7016049Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7016309Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7016588Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7016897Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7018059Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7019174Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7019878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7020625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7021230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7021751Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7022346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7022859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7023061Z Execution Analysis: .......... 2025-03-14T06:00:23.7023546Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7023938Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7024492Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1076 counts during 1025 steps 2025-03-14T06:00:23.7024503Z 2025-03-14T06:00:23.7024895Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7025101Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7025672Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7025871Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7026263Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7026527Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7026799Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7027112Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7027813Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7028522Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7029131Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7029654Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7030247Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7030760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7031328Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7031551Z Execution Analysis: (:1) 2025-03-14T06:00:23.7032074Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7032451Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7032467Z 2025-03-14T06:00:23.7032847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7033066Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7033503Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7033706Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7034084Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7034342Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7034614Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7034921Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7036091Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7037219Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7037942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7038668Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7039271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7039807Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7040392Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7040916Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7041107Z Execution Analysis: .......... 2025-03-14T06:00:23.7041596Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7041974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7042538Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1077 counts during 1026 steps 2025-03-14T06:00:23.7042546Z 2025-03-14T06:00:23.7042923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7043138Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7043695Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7043900Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7044279Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7044604Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7044865Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7045179Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7045906Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7046595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7047202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7047734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7048321Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7048839Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7049394Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7049655Z Execution Analysis: (:1) 2025-03-14T06:00:23.7050147Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7050549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7050559Z 2025-03-14T06:00:23.7050939Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7051162Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7051603Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7051817Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7052201Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7052481Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7052749Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7053083Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7054243Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7055382Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7056146Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7056849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7057454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7057997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7058592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7059126Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7059318Z Execution Analysis: .......... 2025-03-14T06:00:23.7059829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7060215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7060795Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1078 counts during 1027 steps 2025-03-14T06:00:23.7060802Z 2025-03-14T06:00:23.7061185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7061411Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7061978Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7062198Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7062584Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7062863Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7063127Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7063455Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7065471Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7066219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7066827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7067376Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7067972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7068509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7069151Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7069382Z Execution Analysis: (:1) 2025-03-14T06:00:23.7069894Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7070283Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7070296Z 2025-03-14T06:00:23.7070693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7070907Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7071368Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7071574Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7071974Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7072243Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7072533Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7072852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7074030Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7075198Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7075956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7076648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7077274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7077799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7078412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7078929Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7079134Z Execution Analysis: .......... 2025-03-14T06:00:23.7079623Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7080026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7080581Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1079 counts during 1028 steps 2025-03-14T06:00:23.7080590Z 2025-03-14T06:00:23.7080989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7081201Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7081782Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7081989Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7082387Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7082650Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7082929Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7083306Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7084024Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7084767Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7085389Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7085916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7086518Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7087069Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7087648Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7087880Z Execution Analysis: (:1) 2025-03-14T06:00:23.7088388Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7088775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7088782Z 2025-03-14T06:00:23.7089180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7089391Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7089849Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7090057Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7090457Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7090725Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7091013Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7091328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7092502Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7093685Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7094397Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7095087Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7095706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7096236Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7096845Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7097363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7097570Z Execution Analysis: .......... 2025-03-14T06:00:23.7098068Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7098462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7099019Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1080 counts during 1029 steps 2025-03-14T06:00:23.7099042Z 2025-03-14T06:00:23.7099426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7099647Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7100209Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7100425Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7100813Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7101132Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7101397Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7101717Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7102429Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7103133Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7103739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7104281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7104986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7105521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7106086Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7106336Z Execution Analysis: (:1) 2025-03-14T06:00:23.7106832Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7107228Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7107235Z 2025-03-14T06:00:23.7107619Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7107843Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7108283Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7108505Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7108890Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7109171Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7109445Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7109773Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7110995Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7112130Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7112833Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7113538Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7114154Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7114696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7115292Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7115824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7116024Z Execution Analysis: .......... 2025-03-14T06:00:23.7116524Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7116908Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7117478Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1081 counts during 1030 steps 2025-03-14T06:00:23.7117486Z 2025-03-14T06:00:23.7117867Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7118087Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7118649Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7118864Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7119279Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7119562Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7119835Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7120164Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7120862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7121556Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7122162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7122730Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7123324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7123853Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7124423Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7124721Z Execution Analysis: (:1) 2025-03-14T06:00:23.7125213Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7125607Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7125615Z 2025-03-14T06:00:23.7125998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7126218Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7126660Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7126873Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7127259Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7127544Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7127821Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7128187Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7129378Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7130518Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7131223Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7131930Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7132540Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7133082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7133694Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7134219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7134425Z Execution Analysis: .......... 2025-03-14T06:00:23.7134915Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7135315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7135876Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1082 counts during 1031 steps 2025-03-14T06:00:23.7135884Z 2025-03-14T06:00:23.7136287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7136497Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7137074Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7137308Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7137707Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7137981Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7138249Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7138559Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7139265Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7139951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7140560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7141117Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7141710Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7142226Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7142796Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7143022Z Execution Analysis: (:1) 2025-03-14T06:00:23.7143519Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7143900Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7143907Z 2025-03-14T06:00:23.7144286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7144490Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7144932Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7145134Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7145526Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7145791Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7146095Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7146450Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7147609Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7148732Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7149435Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7150129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7150740Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7151272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7151872Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7152391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7152588Z Execution Analysis: .......... 2025-03-14T06:00:23.7153076Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7153466Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7154019Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1083 counts during 1032 steps 2025-03-14T06:00:23.7154030Z 2025-03-14T06:00:23.7154419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7154620Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7155220Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7155421Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7155809Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7156072Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7156342Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7156649Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7157350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7158033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7158673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7159196Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7159802Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7160317Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7160888Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7161110Z Execution Analysis: (:1) 2025-03-14T06:00:23.7161602Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7161978Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7161985Z 2025-03-14T06:00:23.7162370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7162575Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7163020Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7163213Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7163601Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7163935Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7164213Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7164588Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7165874Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7166995Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7167706Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7168398Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7169006Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7169535Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7170128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7170643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7170832Z Execution Analysis: .......... 2025-03-14T06:00:23.7171326Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7171701Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7172267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1084 counts during 1033 steps 2025-03-14T06:00:23.7172275Z 2025-03-14T06:00:23.7172651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7172925Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7173495Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7173697Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7174079Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7174349Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7174611Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7174925Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7175621Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7176352Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7176954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7177483Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7178074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7178594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7179155Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7179387Z Execution Analysis: (:1) 2025-03-14T06:00:23.7179875Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7180261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7180271Z 2025-03-14T06:00:23.7180647Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7180861Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7181306Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7181515Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7181977Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7182248Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7182518Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7182834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7183986Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7185107Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7185807Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7186502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7187107Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7187642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7188233Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7188756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7188945Z Execution Analysis: .......... 2025-03-14T06:00:23.7189441Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7189823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7190385Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1085 counts during 1034 steps 2025-03-14T06:00:23.7190394Z 2025-03-14T06:00:23.7190804Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7191017Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7191573Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7191783Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7192163Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7192431Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7192690Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7193004Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7193725Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7194417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7195021Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7195548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7196138Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7196662Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7197221Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7197458Z Execution Analysis: (:1) 2025-03-14T06:00:23.7197949Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7198340Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7198347Z 2025-03-14T06:00:23.7198727Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7198937Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7199376Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7199630Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7200019Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7200280Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7200556Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7200864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7202026Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7203149Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7203851Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7204618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7205240Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7205765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7206361Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7206875Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7207070Z Execution Analysis: .......... 2025-03-14T06:00:23.7207562Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7207947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7208533Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1086 counts during 1035 steps 2025-03-14T06:00:23.7208541Z 2025-03-14T06:00:23.7208930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7209135Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7209701Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7209900Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7210290Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7210557Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7210826Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7211169Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7211869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7212555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7213166Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7213697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7214291Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7214808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7215378Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7215603Z Execution Analysis: (:1) 2025-03-14T06:00:23.7216097Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7216473Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7216480Z 2025-03-14T06:00:23.7216869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7217118Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7217597Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7217793Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7218180Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7218441Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7218715Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7219021Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7220183Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7221303Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7222009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7222704Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7223316Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7223834Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7224432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7224940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7225142Z Execution Analysis: .......... 2025-03-14T06:00:23.7225626Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7226012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7226595Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1087 counts during 1036 steps 2025-03-14T06:00:23.7226614Z 2025-03-14T06:00:23.7226993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7227198Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7227763Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7227965Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7228352Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7228614Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7228915Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7229227Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7229928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7230617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7231230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7231761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7232351Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7232869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7233430Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7233662Z Execution Analysis: (:1) 2025-03-14T06:00:23.7234148Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7234531Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7234542Z 2025-03-14T06:00:23.7234922Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7235195Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7235636Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7235842Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7236224Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7236499Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7236768Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7237086Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7238246Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7239374Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7240080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7240772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7241371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7241904Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7242492Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7243011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7243199Z Execution Analysis: .......... 2025-03-14T06:00:23.7243692Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7244101Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7244704Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1088 counts during 1037 steps 2025-03-14T06:00:23.7244713Z 2025-03-14T06:00:23.7245087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7245301Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7245857Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7246063Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7246443Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7246754Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7247012Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7247333Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7248033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7248734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7249337Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7249872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7250464Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7250988Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7251549Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7251781Z Execution Analysis: (:1) 2025-03-14T06:00:23.7252268Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7252656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7252694Z 2025-03-14T06:00:23.7253099Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7253307Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7253744Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7253947Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7254323Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7254591Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7254854Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7255170Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7256325Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7257456Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7258158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7258852Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7259454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7259983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7260572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7261094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7261281Z Execution Analysis: .......... 2025-03-14T06:00:23.7261812Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7262193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7262753Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1089 counts during 1038 steps 2025-03-14T06:00:23.7262761Z 2025-03-14T06:00:23.7263144Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7263349Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7263916Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7264117Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7264530Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7264792Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7265062Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7265494Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7266196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7266884Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7267495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7268016Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7268612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7269131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7269699Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7269926Z Execution Analysis: (:1) 2025-03-14T06:00:23.7270420Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7270937Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7270945Z 2025-03-14T06:00:23.7271328Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7271533Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7271977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7272178Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7272565Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7272827Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7273105Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7273410Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7274571Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7275694Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7276396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7277079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7277689Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7278211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7278807Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7279319Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7279556Z Execution Analysis: .......... 2025-03-14T06:00:23.7280049Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7280437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7280993Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1090 counts during 1039 steps 2025-03-14T06:00:23.7281000Z 2025-03-14T06:00:23.7281383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7281589Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7282149Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7282405Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7282789Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7283051Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7283321Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7283629Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7284332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7285063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7285671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7286192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7286785Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7287299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7287870Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7288093Z Execution Analysis: (:1) 2025-03-14T06:00:23.7288620Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7289030Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7289038Z 2025-03-14T06:00:23.7289424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7289627Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7290076Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7290275Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7290668Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7290931Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7291209Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7291516Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7292686Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7293806Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7294509Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7295200Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7295805Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7296335Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7296928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7297479Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7297670Z Execution Analysis: .......... 2025-03-14T06:00:23.7298164Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7298544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7299106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1091 counts during 1040 steps 2025-03-14T06:00:23.7299114Z 2025-03-14T06:00:23.7299492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7299744Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7300303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7300509Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7300889Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7301161Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7301424Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7301748Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7302444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7303142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7303748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7304284Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7304884Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7305411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7305975Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7306244Z Execution Analysis: (:1) 2025-03-14T06:00:23.7306763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7307151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7307159Z 2025-03-14T06:00:23.7307536Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7307753Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7308192Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7308408Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7308789Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7309063Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7309331Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7309661Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7310821Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7311956Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7312653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7313355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7313963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7314496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7315120Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7315650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7315841Z Execution Analysis: .......... 2025-03-14T06:00:23.7316344Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7316729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7317293Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1092 counts during 1041 steps 2025-03-14T06:00:23.7317300Z 2025-03-14T06:00:23.7317677Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7317921Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7318479Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7318687Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7319073Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7319349Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7319608Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7319930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7320625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7321319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7321923Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7322463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7323053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7323580Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7324140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7324442Z Execution Analysis: (:1) 2025-03-14T06:00:23.7324994Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7325383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7325390Z 2025-03-14T06:00:23.7325776Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7325979Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7326419Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7326628Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7327007Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7327278Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7327557Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7327881Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7329033Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7330162Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7330867Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7331554Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7332170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7332726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7333331Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7333853Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7334053Z Execution Analysis: .......... 2025-03-14T06:00:23.7334538Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7334928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7335485Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1093 counts during 1042 steps 2025-03-14T06:00:23.7335523Z 2025-03-14T06:00:23.7335909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7336113Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7336681Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7336881Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7337275Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7337536Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7337813Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7338127Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7338828Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7339514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7340128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7340649Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7341250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7341770Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7342407Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7342632Z Execution Analysis: (:1) 2025-03-14T06:00:23.7343130Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7343507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7343514Z 2025-03-14T06:00:23.7343899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7344110Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7344558Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7344757Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7345152Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7345413Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7345699Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7346008Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7347170Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7348290Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7349002Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7349692Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7350355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7350883Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7351486Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7352004Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7352203Z Execution Analysis: .......... 2025-03-14T06:00:23.7352691Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7353085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7353672Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1095 counts during 1043 steps 2025-03-14T06:00:23.7353680Z 2025-03-14T06:00:23.7354064Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7354268Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7354835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7355040Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7355430Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7355699Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7355973Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7356281Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7356977Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7357663Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7358273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7358793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7359396Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7359978Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7360547Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7360771Z Execution Analysis: (:1) 2025-03-14T06:00:23.7361265Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7361653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7361663Z 2025-03-14T06:00:23.7362039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7362253Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7362691Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7362899Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7363278Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7363553Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7363818Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7364134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7365460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7366593Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7367293Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7367990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7368658Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7369197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7369784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7370304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7370489Z Execution Analysis: .......... 2025-03-14T06:00:23.7370981Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7371358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7371964Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1096 counts during 1044 steps 2025-03-14T06:00:23.7371972Z 2025-03-14T06:00:23.7372351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7372562Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7373124Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7373331Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7373710Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7373980Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7374242Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7374563Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7375256Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7375953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7376552Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7377090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7377768Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7378292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7378852Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7379085Z Execution Analysis: (:1) 2025-03-14T06:00:23.7379573Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7379958Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7379968Z 2025-03-14T06:00:23.7380347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7380561Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7381006Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7381219Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7381598Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7381869Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7382140Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7382459Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7383612Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7384741Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7385434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7386239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7386848Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7387383Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7387971Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7388497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7388691Z Execution Analysis: .......... 2025-03-14T06:00:23.7389192Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7389606Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7390166Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1097 counts during 1045 steps 2025-03-14T06:00:23.7390174Z 2025-03-14T06:00:23.7390566Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7390775Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7391346Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7391546Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7391941Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7392207Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7392473Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7392789Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7393492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7394184Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7394797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7395378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7395972Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7396487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7397057Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7397284Z Execution Analysis: (:1) 2025-03-14T06:00:23.7397782Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7398166Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7398173Z 2025-03-14T06:00:23.7398561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7398773Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7399231Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7399432Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7399825Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7400087Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7400361Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7400670Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7401837Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7402962Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7403697Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7404391Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7405059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7405583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7406186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7406700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7406895Z Execution Analysis: .......... 2025-03-14T06:00:23.7407408Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7407799Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7408359Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1098 counts during 1046 steps 2025-03-14T06:00:23.7408370Z 2025-03-14T06:00:23.7408757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7408963Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7409537Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7409737Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7410127Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7410390Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7410660Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7410979Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7411686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7412375Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7413064Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7413590Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7414189Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7414701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7415271Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7415496Z Execution Analysis: (:1) 2025-03-14T06:00:23.7415987Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7416367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7416374Z 2025-03-14T06:00:23.7416765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7416979Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7417423Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7417629Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7418022Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7418283Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7418555Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7418870Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7420036Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7421191Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7421900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7422595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7423207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7423733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7424324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7424843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7425063Z Execution Analysis: .......... 2025-03-14T06:00:23.7425561Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7425943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7426510Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1099 counts during 1047 steps 2025-03-14T06:00:23.7426517Z 2025-03-14T06:00:23.7426894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7427105Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7427667Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7427874Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7428256Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7428530Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7428794Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7429113Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7429812Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7430505Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7431171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7431709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7432302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7432824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7433385Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7433626Z Execution Analysis: (:1) 2025-03-14T06:00:23.7434118Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7434513Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7434521Z 2025-03-14T06:00:23.7434902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7435118Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7435552Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7435754Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7436132Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7436394Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7436664Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7436990Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7438142Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7439301Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7439999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7440691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7441297Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7441836Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7442422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7442983Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7443174Z Execution Analysis: .......... 2025-03-14T06:00:23.7443674Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7444052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7444674Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1100 counts during 1048 steps 2025-03-14T06:00:23.7444683Z 2025-03-14T06:00:23.7445061Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7445277Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7445836Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7446040Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7446428Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7446701Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7446962Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7447283Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7447979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7448738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7449338Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7449869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7450459Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7450983Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7451546Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7451778Z Execution Analysis: (:1) 2025-03-14T06:00:23.7452270Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7452659Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7452672Z 2025-03-14T06:00:23.7453047Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7453261Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7453699Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7453908Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7454293Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7454560Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7454833Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7455149Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7456328Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7457460Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7458171Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7458851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7459462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7459982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7460618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7461134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7461333Z Execution Analysis: .......... 2025-03-14T06:00:23.7461828Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7462232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7462781Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1101 counts during 1049 steps 2025-03-14T06:00:23.7462789Z 2025-03-14T06:00:23.7463180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7463385Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7463960Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7464163Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7464559Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7464825Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7465099Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7465532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7466353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7467039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7467655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7468177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7468780Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7469298Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7469875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7470099Z Execution Analysis: (:1) 2025-03-14T06:00:23.7470615Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7470997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7471004Z 2025-03-14T06:00:23.7471399Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7471602Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7472060Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7472262Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7472660Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7472925Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7473213Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7473522Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7474731Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7475864Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7476576Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7477265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7477887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7478453Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7479061Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7479579Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7479783Z Execution Analysis: .......... 2025-03-14T06:00:23.7480278Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7480671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7481227Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1102 counts during 1050 steps 2025-03-14T06:00:23.7481235Z 2025-03-14T06:00:23.7481630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7481836Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7482408Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7482608Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7483002Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7483263Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7483542Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7483932Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7484699Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7485384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7486003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7486523Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7487125Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7487640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7488217Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7488443Z Execution Analysis: (:1) 2025-03-14T06:00:23.7488947Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7489329Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7489350Z 2025-03-14T06:00:23.7489726Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7489943Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7490376Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7490590Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7490972Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7491249Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7491521Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7491864Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7493034Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7494170Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7494866Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7495558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7496192Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7496733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7497327Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7497861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7498055Z Execution Analysis: .......... 2025-03-14T06:00:23.7498555Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7498937Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7499502Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1103 counts during 1051 steps 2025-03-14T06:00:23.7499509Z 2025-03-14T06:00:23.7499891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7500111Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7500678Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7500889Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7501274Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7501551Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7501872Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7502195Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7502893Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7503583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7504187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7504731Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7505326Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7505854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7506421Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7506671Z Execution Analysis: (:1) 2025-03-14T06:00:23.7507162Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7507563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7507570Z 2025-03-14T06:00:23.7507950Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7508169Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7508605Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7508816Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7509200Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7509474Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7509776Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7510101Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7511264Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7512399Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7513099Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7513795Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7514441Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7514981Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7515580Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7516114Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7516310Z Execution Analysis: .......... 2025-03-14T06:00:23.7516808Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7517188Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7517752Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1104 counts during 1052 steps 2025-03-14T06:00:23.7517760Z 2025-03-14T06:00:23.7518140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7518356Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7518913Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7519121Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7519505Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7521019Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7521305Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7521631Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7522326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7523021Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7523625Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7524163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7524818Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7525346Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7525920Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7526145Z Execution Analysis: (:1) 2025-03-14T06:00:23.7526647Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7527026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7527034Z 2025-03-14T06:00:23.7527422Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7527626Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7528073Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7528268Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7528662Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7528965Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7529247Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7529562Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7530726Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7531847Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7532560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7533280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7533897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7534423Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7535031Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7535550Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7535757Z Execution Analysis: .......... 2025-03-14T06:00:23.7536249Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7536642Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7537197Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1105 counts during 1053 steps 2025-03-14T06:00:23.7537207Z 2025-03-14T06:00:23.7537599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7537805Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7538375Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7538605Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7539024Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7539288Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7539562Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7539871Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7540579Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7541259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7541883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7542404Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7543013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7543531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7544108Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7544334Z Execution Analysis: (:1) 2025-03-14T06:00:23.7544835Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7545216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7545223Z 2025-03-14T06:00:23.7545616Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7545824Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7546274Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7546480Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7546904Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7547174Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7547457Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7547771Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7548938Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7550057Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7550821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7551513Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7552136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7552663Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7553270Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7553787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7553996Z Execution Analysis: .......... 2025-03-14T06:00:23.7554485Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7554884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7555445Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1106 counts during 1054 steps 2025-03-14T06:00:23.7555465Z 2025-03-14T06:00:23.7555842Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7556067Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7556658Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7556898Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7557280Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7557554Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7557818Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7558145Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7558844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7559544Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7560151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7560692Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7561277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7561812Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7562374Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7562618Z Execution Analysis: (:1) 2025-03-14T06:00:23.7563108Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7563500Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7563511Z 2025-03-14T06:00:23.7563887Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7564103Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7564622Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7564835Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7565220Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7565623Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7565891Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7566210Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7567363Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7568500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7569257Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7569955Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7570569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7571112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7571700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7572227Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7572413Z Execution Analysis: .......... 2025-03-14T06:00:23.7572912Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7573293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7573863Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1107 counts during 1055 steps 2025-03-14T06:00:23.7573871Z 2025-03-14T06:00:23.7574246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7574511Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7575114Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7575328Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7575709Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7575984Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7576244Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7576567Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7577264Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7577966Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7578568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7579111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7579705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7580230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7580793Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7581030Z Execution Analysis: (:1) 2025-03-14T06:00:23.7581518Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7581915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7581923Z 2025-03-14T06:00:23.7582299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7582560Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7582998Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7583213Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7583594Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7583863Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7584135Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7584458Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7585615Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7586786Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7587483Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7588187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7588807Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7589334Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7589938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7590450Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7590656Z Execution Analysis: .......... 2025-03-14T06:00:23.7591146Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7591544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7592104Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1108 counts during 1056 steps 2025-03-14T06:00:23.7592114Z 2025-03-14T06:00:23.7592537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7592775Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7593350Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7593550Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7593945Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7594209Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7594486Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7594798Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7595507Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7596190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7596806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7597339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7597941Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7598458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7599032Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7599256Z Execution Analysis: (:1) 2025-03-14T06:00:23.7599762Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7600145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7600152Z 2025-03-14T06:00:23.7600573Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7600778Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7601230Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7601430Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7601824Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7602090Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7602374Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7602687Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7603856Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7605062Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7605774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7606465Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7607082Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7607606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7608210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7608721Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7608926Z Execution Analysis: .......... 2025-03-14T06:00:23.7609413Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7609802Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7610358Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1109 counts during 1057 steps 2025-03-14T06:00:23.7610399Z 2025-03-14T06:00:23.7610817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7611020Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7611590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7611791Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7612190Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7612453Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7612731Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7613045Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7613757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7614442Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7615063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7615589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7616195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7616710Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7617287Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7617518Z Execution Analysis: (:1) 2025-03-14T06:00:23.7618015Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7618397Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7618468Z 2025-03-14T06:00:23.7618846Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7619057Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7619505Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7619703Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7620097Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7620358Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7620634Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7620942Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7622134Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7623278Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7623984Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7624689Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7625296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7625832Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7626431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7626966Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7627159Z Execution Analysis: .......... 2025-03-14T06:00:23.7627664Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7628048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7628675Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1110 counts during 1058 steps 2025-03-14T06:00:23.7628682Z 2025-03-14T06:00:23.7629066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7629295Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7629862Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7630077Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7630469Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7630722Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7630877Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7631062Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7631427Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7631796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7632113Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7632401Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7632713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7632997Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7633294Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7633437Z Execution Analysis: (:1) 2025-03-14T06:00:23.7633698Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7633944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7633950Z 2025-03-14T06:00:23.7634158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7634289Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7634523Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7634647Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7634857Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7635016Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7635168Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7635380Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7635974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7636568Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7636937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7637308Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7637625Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7637918Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7638228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7638517Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7638628Z Execution Analysis: .......... 2025-03-14T06:00:23.7638903Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7639161Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7639464Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1111 counts during 1059 steps 2025-03-14T06:00:23.7639469Z 2025-03-14T06:00:23.7639671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7639798Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7640090Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7640215Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7640423Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7640577Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7640721Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7640902Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7641367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7641724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7642129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7642394Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7642677Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7642941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7643212Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7643341Z Execution Analysis: (:1) 2025-03-14T06:00:23.7643609Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7643813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7643817Z 2025-03-14T06:00:23.7644017Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7644127Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7644353Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7644459Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7644722Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7644889Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7645212Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7645384Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7645991Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7646568Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7646941Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7647295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7647623Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7647899Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7648222Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7648495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7648619Z Execution Analysis: .......... 2025-03-14T06:00:23.7648880Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7649220Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7649515Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1112 counts during 1060 steps 2025-03-14T06:00:23.7649520Z 2025-03-14T06:00:23.7649737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7649856Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7650157Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7650273Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7650492Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7650641Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7650801Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7650975Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7651354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7651708Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7652036Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7652311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7652635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7652909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7653214Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7653365Z Execution Analysis: (:1) 2025-03-14T06:00:23.7653642Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7653850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7653855Z 2025-03-14T06:00:23.7654066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7654181Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7654425Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7654541Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7654782Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7654927Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7655086Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7655256Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7655866Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7656444Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7656926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7657271Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7657586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7657858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7658169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7658436Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7658577Z Execution Analysis: .......... 2025-03-14T06:00:23.7658867Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7659077Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7659360Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1113 counts during 1061 steps 2025-03-14T06:00:23.7659375Z 2025-03-14T06:00:23.7659574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7659697Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7659981Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7660103Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7660303Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7660444Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7660596Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7660764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7661125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7661470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7661788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7662065Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7662370Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7662643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7662952Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7663086Z Execution Analysis: (:1) 2025-03-14T06:00:23.7663342Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7663550Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7663555Z 2025-03-14T06:00:23.7663755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7663879Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7664105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7664247Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7664449Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7664602Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7664746Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7664925Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7665659Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7666415Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7666789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7667156Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7667473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7667768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7668079Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7668363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7668570Z Execution Analysis: .......... 2025-03-14T06:00:23.7668842Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7669047Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7669347Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1114 counts during 1062 steps 2025-03-14T06:00:23.7669352Z 2025-03-14T06:00:23.7669555Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7674606Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7674941Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7675059Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7675278Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7675430Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7675572Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7675753Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7676119Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7676482Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7676796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7677084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7677389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7677750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7678154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7678286Z Execution Analysis: (:1) 2025-03-14T06:00:23.7678639Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7678834Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7678840Z 2025-03-14T06:00:23.7679023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7679136Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7679386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7679496Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7679685Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7679825Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7679959Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7680124Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7680680Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7681217Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7681547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7681880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7682169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7682429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7682712Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7683026Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7683122Z Execution Analysis: .......... 2025-03-14T06:00:23.7683369Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7683552Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7683831Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1116 counts during 1063 steps 2025-03-14T06:00:23.7683838Z 2025-03-14T06:00:23.7684025Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7684139Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7684402Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7684608Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7684802Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7685113Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7685252Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7685428Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7685784Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7686143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7686455Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7686735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7687038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7687340Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7687642Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7687765Z Execution Analysis: (:1) 2025-03-14T06:00:23.7688031Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7688229Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7688234Z 2025-03-14T06:00:23.7688438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7688575Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7688812Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7688919Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7689132Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7689272Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7689426Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7689592Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7690188Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7690758Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7691118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7691465Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7691779Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7692052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7692426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7692693Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7692802Z Execution Analysis: .......... 2025-03-14T06:00:23.7693059Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7693262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7693552Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1117 counts during 1064 steps 2025-03-14T06:00:23.7693557Z 2025-03-14T06:00:23.7693764Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7693876Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7694174Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7694286Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7694498Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7694638Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7694782Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7694947Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7695307Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7695654Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7695969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7696239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7696573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7696843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7697246Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7697365Z Execution Analysis: (:1) 2025-03-14T06:00:23.7697619Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7697814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7697843Z 2025-03-14T06:00:23.7698045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7698153Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7698382Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7698488Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7698692Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7698832Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7698990Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7699151Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7699734Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7700289Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7700645Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7700982Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7701294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7701608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7701914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7702171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7702281Z Execution Analysis: .......... 2025-03-14T06:00:23.7702528Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7702729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7703012Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1118 counts during 1065 steps 2025-03-14T06:00:23.7703025Z 2025-03-14T06:00:23.7703220Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7703339Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7703623Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7703735Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7703930Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7704078Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7704215Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7704380Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7704732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7705081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7705379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7705677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7705979Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7706245Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7706524Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7706647Z Execution Analysis: (:1) 2025-03-14T06:00:23.7706895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7707095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7707125Z 2025-03-14T06:00:23.7707420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7707532Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7707742Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7707848Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7708034Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7708168Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7708300Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7708456Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7708997Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7709528Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7709860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7710190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7710524Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7710782Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7711063Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7711313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7711407Z Execution Analysis: .......... 2025-03-14T06:00:23.7711646Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7711831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7712101Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1119 counts during 1066 steps 2025-03-14T06:00:23.7712106Z 2025-03-14T06:00:23.7712291Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7712400Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7712663Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7712765Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7712949Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7713083Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7713210Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7713373Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7713709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7714046Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7714361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7714632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7714922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7715187Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7715461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7715589Z Execution Analysis: (:1) 2025-03-14T06:00:23.7715829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7716053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7716057Z 2025-03-14T06:00:23.7716247Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7716369Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7716589Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7716708Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7716903Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7717047Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7717186Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7717358Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7717905Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7718450Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7718789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7719151Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7719469Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7719741Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7720043Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7720296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7720415Z Execution Analysis: .......... 2025-03-14T06:00:23.7720660Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7720866Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7721141Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1120 counts during 1067 steps 2025-03-14T06:00:23.7721147Z 2025-03-14T06:00:23.7721352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7721463Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7721751Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7721858Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7722064Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7722202Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7722350Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7722511Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7722855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7723208Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7723515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7723777Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7724079Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7724335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7724702Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7724823Z Execution Analysis: (:1) 2025-03-14T06:00:23.7725288Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7725494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7725498Z 2025-03-14T06:00:23.7725719Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7725838Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7726086Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7726199Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7726422Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7726565Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7726730Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7726898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7727502Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7728078Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7728449Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7728864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7729190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7729467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7729784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7730053Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7730175Z Execution Analysis: .......... 2025-03-14T06:00:23.7730435Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7730652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7730947Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1121 counts during 1068 steps 2025-03-14T06:00:23.7730956Z 2025-03-14T06:00:23.7731172Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7731289Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7731589Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7731702Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7731920Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7732067Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7732229Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7732400Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7732771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7733148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7733480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7733758Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7734079Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7734350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7734655Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7734808Z Execution Analysis: (:1) 2025-03-14T06:00:23.7735078Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7735285Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7735289Z 2025-03-14T06:00:23.7735508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7735624Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7735868Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7735981Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7736198Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7736345Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7736502Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7736676Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7737367Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7737901Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7738295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7738638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7738930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7739201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7739489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7739755Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7739856Z Execution Analysis: .......... 2025-03-14T06:00:23.7740108Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7740299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7740585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1122 counts during 1069 steps 2025-03-14T06:00:23.7740589Z 2025-03-14T06:00:23.7740777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7740898Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7741167Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7741282Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7741474Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7741624Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7741757Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7741928Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7742283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7742627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7742917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7743189Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7743475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7743738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7744037Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7744167Z Execution Analysis: (:1) 2025-03-14T06:00:23.7744408Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7744614Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7744620Z 2025-03-14T06:00:23.7744810Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7744929Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7745142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7745261Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7745452Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7745597Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7745737Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7745906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7746455Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7747018Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7747376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7747714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7748006Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7748277Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7748567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7748829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7748930Z Execution Analysis: .......... 2025-03-14T06:00:23.7749183Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7749374Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7749656Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1123 counts during 1070 steps 2025-03-14T06:00:23.7749661Z 2025-03-14T06:00:23.7749850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7749968Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7750239Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7750356Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7750547Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7750695Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7750828Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7751020Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7751358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7751695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7751987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7752253Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7752540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7752827Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7753100Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7753232Z Execution Analysis: (:1) 2025-03-14T06:00:23.7753481Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7753684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7753688Z 2025-03-14T06:00:23.7753890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7753999Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7754228Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7754333Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7754536Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7754674Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7754811Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7754981Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7755544Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7756125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7756474Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7756802Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7757106Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7757363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7757662Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7757913Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7758030Z Execution Analysis: .......... 2025-03-14T06:00:23.7758275Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7758468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7758738Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1124 counts during 1071 steps 2025-03-14T06:00:23.7758742Z 2025-03-14T06:00:23.7758936Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7759042Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7759318Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7759420Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7759618Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7759749Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7759976Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7760137Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7760474Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7760802Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7761094Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7761346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7761635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7761927Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7762201Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7762323Z Execution Analysis: (:1) 2025-03-14T06:00:23.7762571Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7762757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7762761Z 2025-03-14T06:00:23.7762953Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7763062Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7763283Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7763388Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7763585Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7763719Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7763860Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7764017Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7764678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7765560Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7765930Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7766283Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7766608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7766884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7767202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7767470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7767587Z Execution Analysis: .......... 2025-03-14T06:00:23.7767843Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7768052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7768339Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1125 counts during 1072 steps 2025-03-14T06:00:23.7768355Z 2025-03-14T06:00:23.7768559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7768673Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7768968Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7769075Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7769343Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7769487Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7769639Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7769803Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7770166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7770513Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7770835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7771114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7771456Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7771727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7772019Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7772148Z Execution Analysis: (:1) 2025-03-14T06:00:23.7772408Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7772615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7772620Z 2025-03-14T06:00:23.7772821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7772939Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7773169Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7773284Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7773487Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7773634Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7773782Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7773952Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7774605Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7775184Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7775541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7775895Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7776209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7776487Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7776795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7777177Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7777275Z Execution Analysis: .......... 2025-03-14T06:00:23.7777520Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7777704Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7777977Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1126 counts during 1073 steps 2025-03-14T06:00:23.7777981Z 2025-03-14T06:00:23.7778170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7778281Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7778549Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7778681Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7778873Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7779013Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7779144Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7779303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7779631Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7779961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7780250Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7780534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7780821Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7781078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7781352Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7781475Z Execution Analysis: (:1) 2025-03-14T06:00:23.7781712Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7781904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7781908Z 2025-03-14T06:00:23.7782095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7782207Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7782419Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7782527Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7782715Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7782859Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7783018Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7783200Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7783743Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7784274Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7784602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7784939Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7785224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7785492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7785776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7786035Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7786129Z Execution Analysis: .......... 2025-03-14T06:00:23.7786372Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7786556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7786829Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1127 counts during 1074 steps 2025-03-14T06:00:23.7786836Z 2025-03-14T06:00:23.7787026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7787131Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7787428Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7787530Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7787723Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7787853Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7787991Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7788147Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7788484Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7788806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7789119Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7789375Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7789664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7789912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7790188Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7790302Z Execution Analysis: (:1) 2025-03-14T06:00:23.7790543Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7790729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7790732Z 2025-03-14T06:00:23.7790921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7791026Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7791242Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7791343Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7791536Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7791694Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7791863Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7792019Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7792570Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7793099Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7793436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7793760Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7794058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7794315Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7794605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7794854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7794959Z Execution Analysis: .......... 2025-03-14T06:00:23.7795196Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7795388Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7795660Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1128 counts during 1075 steps 2025-03-14T06:00:23.7795664Z 2025-03-14T06:00:23.7796022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7796171Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7796456Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7796568Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7796769Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7796910Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7797052Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7797220Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7797572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7797938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7798243Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7798511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7798812Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7799075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7799366Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7799487Z Execution Analysis: (:1) 2025-03-14T06:00:23.7799748Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7799943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7799949Z 2025-03-14T06:00:23.7800152Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7800262Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7800499Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7800609Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7800861Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7801003Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7801153Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7801319Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7801904Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7802459Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7802820Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7803170Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7803476Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7803753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7804055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7804326Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7804428Z Execution Analysis: .......... 2025-03-14T06:00:23.7804793Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7805162Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7805457Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1129 counts during 1076 steps 2025-03-14T06:00:23.7805462Z 2025-03-14T06:00:23.7805694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7805815Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7806107Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7806222Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7806424Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7806572Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7806714Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7806890Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7807248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7807632Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7807947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7808228Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7808540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7808817Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7809110Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7809240Z Execution Analysis: (:1) 2025-03-14T06:00:23.7809493Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7809695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7809700Z 2025-03-14T06:00:23.7809902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7810021Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7810252Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7810412Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7810614Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7810758Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7810903Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7811073Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7811667Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7812245Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7812602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7812961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7813276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7813554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7813860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7814134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7814239Z Execution Analysis: .......... 2025-03-14T06:00:23.7814501Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7814701Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7814999Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1130 counts during 1077 steps 2025-03-14T06:00:23.7815027Z 2025-03-14T06:00:23.7815233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7815355Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7815644Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7815759Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7815962Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7816112Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7816253Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7816426Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7816912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7817245Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7817535Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7817796Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7818080Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7818333Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7818603Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7818725Z Execution Analysis: (:1) 2025-03-14T06:00:23.7818963Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7819155Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7819159Z 2025-03-14T06:00:23.7819351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7819454Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7820593Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7820700Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7820890Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7821031Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7821165Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7821327Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7821872Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7822408Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7822749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7823076Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7823372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7823625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7823912Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7824160Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7824269Z Execution Analysis: .......... 2025-03-14T06:00:23.7824507Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7824696Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7824990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1131 counts during 1078 steps 2025-03-14T06:00:23.7824997Z 2025-03-14T06:00:23.7825189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7825294Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7825566Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7825669Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7825860Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7825990Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7826147Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7826303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7826638Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7826964Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7827265Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7827518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7827809Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7828057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7828333Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7828453Z Execution Analysis: (:1) 2025-03-14T06:00:23.7828695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7828880Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7828884Z 2025-03-14T06:00:23.7829076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7829243Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7829462Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7829563Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7829757Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7829890Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7830031Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7830189Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7830738Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7831271Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7831611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7831937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7832229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7832481Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7832770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7833021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7833127Z Execution Analysis: .......... 2025-03-14T06:00:23.7833365Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7833578Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7833850Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1132 counts during 1079 steps 2025-03-14T06:00:23.7833854Z 2025-03-14T06:00:23.7834046Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7834150Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7834422Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7834525Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7834719Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7834875Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7835013Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7835166Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7835501Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7835825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7836120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7836373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7836663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7836909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7837184Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7837299Z Execution Analysis: (:1) 2025-03-14T06:00:23.7837539Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7837731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7837757Z 2025-03-14T06:00:23.7837965Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7838074Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7838285Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7838389Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7838575Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7838707Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7838840Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7839000Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7839546Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7840078Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7840414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7840746Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7841036Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7841297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7841581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7841840Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7841938Z Execution Analysis: .......... 2025-03-14T06:00:23.7842209Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7842400Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7842679Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1133 counts during 1080 steps 2025-03-14T06:00:23.7842683Z 2025-03-14T06:00:23.7842871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7842987Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7843255Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7843369Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7843581Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7843720Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7843853Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7844019Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7844352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7844771Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7845239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7845523Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7845830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7846111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7846406Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7846547Z Execution Analysis: (:1) 2025-03-14T06:00:23.7846810Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7847057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7847086Z 2025-03-14T06:00:23.7847289Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7847413Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7847644Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7847766Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7847972Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7848125Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7848276Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7848453Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7849047Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7849635Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7849996Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7850357Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7850668Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7850945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7851254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7851530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7851664Z Execution Analysis: .......... 2025-03-14T06:00:23.7851934Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7852137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7852431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1134 counts during 1081 steps 2025-03-14T06:00:23.7852435Z 2025-03-14T06:00:23.7852645Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7852758Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7853055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7853190Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7853400Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7853541Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7853687Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7853861Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7854221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7854574Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7854894Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7855165Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7855478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7855744Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7856045Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7856170Z Execution Analysis: (:1) 2025-03-14T06:00:23.7856437Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7856685Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7856690Z 2025-03-14T06:00:23.7856902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7857016Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7857354Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7857456Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7857654Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7857788Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7857929Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7858085Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7858639Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7859172Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7859508Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7859832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7860128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7860382Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7860673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7860954Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7861063Z Execution Analysis: .......... 2025-03-14T06:00:23.7861300Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7861494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7861763Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1135 counts during 1082 steps 2025-03-14T06:00:23.7861768Z 2025-03-14T06:00:23.7861961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7862069Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7862369Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7862473Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7862668Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7862802Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7862941Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7863100Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7863437Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7863759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7864054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7864307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7864601Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7864847Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7865127Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7865244Z Execution Analysis: (:1) 2025-03-14T06:00:23.7865890Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7866098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7866102Z 2025-03-14T06:00:23.7866312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7866426Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7866664Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7866778Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7866987Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7867131Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7867284Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7867455Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7868054Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7868626Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7868991Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7869344Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7869667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7869940Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7870292Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7870572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7870681Z Execution Analysis: .......... 2025-03-14T06:00:23.7870949Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7871149Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7871447Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1137 counts during 1083 steps 2025-03-14T06:00:23.7871451Z 2025-03-14T06:00:23.7871652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7871807Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7872097Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7872215Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7872419Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7872573Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7872718Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7872892Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7873245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7873599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7873909Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7874193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7874499Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7874776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7875068Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7875255Z Execution Analysis: (:1) 2025-03-14T06:00:23.7875513Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7875720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7875724Z 2025-03-14T06:00:23.7875923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7876045Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7876278Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7876399Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7876602Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7876752Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7876897Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7877076Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7877668Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7878343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7878673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7879008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7879295Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7879555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7879861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7880125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7880220Z Execution Analysis: .......... 2025-03-14T06:00:23.7880467Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7880652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7880930Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1138 counts during 1084 steps 2025-03-14T06:00:23.7880958Z 2025-03-14T06:00:23.7881148Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7881261Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7881529Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7881640Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7881829Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7881971Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7882101Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7882262Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7882592Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7882921Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7883212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7883475Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7883758Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7884017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7884337Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7884461Z Execution Analysis: (:1) 2025-03-14T06:00:23.7884760Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7885129Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7885133Z 2025-03-14T06:00:23.7885337Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7885463Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7885698Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7885820Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7886028Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7886182Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7886337Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7886516Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7887111Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7887690Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7888056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7888409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7888729Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7889032Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7889356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7889626Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7889739Z Execution Analysis: .......... 2025-03-14T06:00:23.7889999Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7890208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7890528Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1139 counts during 1085 steps 2025-03-14T06:00:23.7890532Z 2025-03-14T06:00:23.7890743Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7890859Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7891160Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7891275Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7891489Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7891630Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7891781Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7891946Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7892311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7892663Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7892981Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7893257Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7893577Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7893896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7894192Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7894319Z Execution Analysis: (:1) 2025-03-14T06:00:23.7894581Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7894781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7894785Z 2025-03-14T06:00:23.7894993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7895104Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7895338Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7895450Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7895658Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7895805Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7895958Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7896127Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7896725Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7897397Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7897750Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7898092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7898426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7898699Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7899005Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7899267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7899378Z Execution Analysis: .......... 2025-03-14T06:00:23.7899628Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7899830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7900150Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1140 counts during 1086 steps 2025-03-14T06:00:23.7900155Z 2025-03-14T06:00:23.7900357Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7900469Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7900764Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7900871Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7901076Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7901218Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7901364Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7901527Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7901878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7902219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7902528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7902795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7903218Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7903480Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7903773Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7903899Z Execution Analysis: (:1) 2025-03-14T06:00:23.7904158Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7904359Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7904373Z 2025-03-14T06:00:23.7904568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7904690Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7904915Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7905034Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7905235Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7905375Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7905525Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7905689Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7906267Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7906830Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7907180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7907645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7907938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7908198Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7908483Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7908739Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7908837Z Execution Analysis: .......... 2025-03-14T06:00:23.7909081Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7909294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7909566Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1141 counts during 1087 steps 2025-03-14T06:00:23.7909570Z 2025-03-14T06:00:23.7909756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7909871Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7910139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7910249Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7910437Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7910575Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7910708Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7910872Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7911206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7911537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7911831Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7912138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7912422Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7912675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7912942Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7913065Z Execution Analysis: (:1) 2025-03-14T06:00:23.7913305Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7913500Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7913504Z 2025-03-14T06:00:23.7913688Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7913801Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7914015Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7914126Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7914315Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7914456Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7914592Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7914754Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7915296Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7915827Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7916182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7916522Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7916814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7917075Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7917362Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7917615Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7917715Z Execution Analysis: .......... 2025-03-14T06:00:23.7917984Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7918172Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7918450Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1142 counts during 1088 steps 2025-03-14T06:00:23.7918455Z 2025-03-14T06:00:23.7918644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7918759Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7919027Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7919140Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7919329Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7919468Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7919599Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7919765Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7920095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7920423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7920709Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7921016Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7921301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7921560Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7921836Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7921950Z Execution Analysis: (:1) 2025-03-14T06:00:23.7922196Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7922382Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7922386Z 2025-03-14T06:00:23.7922580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7922686Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7922908Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7923010Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7923206Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7923338Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7923480Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7923637Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7924190Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7924804Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7925378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7925736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7926063Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7926339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7926660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7926933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7927079Z Execution Analysis: .......... 2025-03-14T06:00:23.7927340Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7927555Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7927844Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1143 counts during 1089 steps 2025-03-14T06:00:23.7927853Z 2025-03-14T06:00:23.7928066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7928181Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7928486Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7928599Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7928813Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7928957Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7929118Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7929289Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7929660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7930014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7930395Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7930670Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7930997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7931267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7931574Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7931701Z Execution Analysis: (:1) 2025-03-14T06:00:23.7931976Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7932180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7932184Z 2025-03-14T06:00:23.7932405Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7932520Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7932763Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7932875Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7933095Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7933236Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7933391Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7933558Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7934161Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7934778Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7935157Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7935508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7935836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7936112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7936430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7936723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7936838Z Execution Analysis: .......... 2025-03-14T06:00:23.7937204Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7937405Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7937678Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1144 counts during 1090 steps 2025-03-14T06:00:23.7937693Z 2025-03-14T06:00:23.7937877Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7937993Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7938257Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7938370Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7938557Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7938700Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7938827Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7938992Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7939325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7939712Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7940000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7940271Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7940557Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7940819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7941089Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7941220Z Execution Analysis: (:1) 2025-03-14T06:00:23.7941458Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7941658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7941664Z 2025-03-14T06:00:23.7941851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7941968Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7942183Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7942297Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7942481Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7942622Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7942757Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7942924Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7943472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7944034Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7944366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7944702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7944989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7945258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7945572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7945834Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7945931Z Execution Analysis: .......... 2025-03-14T06:00:23.7946179Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7946370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7946652Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1145 counts during 1091 steps 2025-03-14T06:00:23.7946657Z 2025-03-14T06:00:23.7946845Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7946964Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7947234Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7947350Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7947539Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7947685Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7947818Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7947988Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7948364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7948701Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7948990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7949257Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7949540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7949801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7950071Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7950197Z Execution Analysis: (:1) 2025-03-14T06:00:23.7950439Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7950638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7950642Z 2025-03-14T06:00:23.7950831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7950949Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7951158Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7951272Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7951462Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7951607Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7951741Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7951905Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7952475Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7953018Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7953350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7953685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7953984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7954259Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7954552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7954802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7954914Z Execution Analysis: .......... 2025-03-14T06:00:23.7955154Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7955354Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7955623Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1146 counts during 1092 steps 2025-03-14T06:00:23.7955628Z 2025-03-14T06:00:23.7955825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7955928Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7956204Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7956306Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7956505Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7956638Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7956780Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7956957Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7957323Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7957644Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7957946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7958199Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7958494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7958740Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7959020Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7959138Z Execution Analysis: (:1) 2025-03-14T06:00:23.7959392Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7959578Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7959583Z 2025-03-14T06:00:23.7959785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7959889Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7960118Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7960221Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7960426Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7960559Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7960712Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7960891Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7961450Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7961981Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7962325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7962648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7962942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7963219Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7963515Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7963767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7963875Z Execution Analysis: .......... 2025-03-14T06:00:23.7964116Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7964314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7964670Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1147 counts during 1093 steps 2025-03-14T06:00:23.7964675Z 2025-03-14T06:00:23.7964872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7965153Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7965605Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7965719Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7965932Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7966082Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7966355Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7966529Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7966902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7967254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7967582Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7967858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7968180Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7968452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7968757Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7968887Z Execution Analysis: (:1) 2025-03-14T06:00:23.7969161Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7969364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7969380Z 2025-03-14T06:00:23.7969581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7969698Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7969944Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7970057Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7970272Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7970414Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7970606Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7970780Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7971389Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7971974Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7972330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7972693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7973043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7973328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7973637Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7973921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7974028Z Execution Analysis: .......... 2025-03-14T06:00:23.7974302Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7974502Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7974805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1148 counts during 1094 steps 2025-03-14T06:00:23.7974810Z 2025-03-14T06:00:23.7975014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7975143Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7975432Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7975558Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7975762Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7975967Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7976110Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7976295Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7976650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7977016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7977324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7977712Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7977996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7978257Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7978532Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7978656Z Execution Analysis: (:1) 2025-03-14T06:00:23.7978892Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7979088Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7979092Z 2025-03-14T06:00:23.7979276Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7979397Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7979607Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7979723Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7979911Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7980079Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7980216Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7980390Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7980933Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7981473Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7981803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7982164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7982454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7982720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7983007Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7983268Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7983371Z Execution Analysis: .......... 2025-03-14T06:00:23.7983617Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7983802Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7984082Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1149 counts during 1095 steps 2025-03-14T06:00:23.7984089Z 2025-03-14T06:00:23.7984276Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7984393Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7984663Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7984776Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7985037Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7985184Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7985312Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7985474Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7985803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7986137Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7986426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7986686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7986971Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7987234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7987510Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7987635Z Execution Analysis: (:1) 2025-03-14T06:00:23.7987875Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7988071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7988075Z 2025-03-14T06:00:23.7988273Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7988379Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7988600Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7988703Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7988923Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7989058Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7989211Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7989367Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7989920Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7990452Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.7990820Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.7991144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7991447Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7991700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7992000Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7992251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7992359Z Execution Analysis: .......... 2025-03-14T06:00:23.7992597Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7992798Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7993065Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1150 counts during 1096 steps 2025-03-14T06:00:23.7993069Z 2025-03-14T06:00:23.7993268Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7993374Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7993653Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.7993799Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7993997Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.7994131Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.7994276Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.7994433Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7994775Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.7995104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.7995403Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.7995657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.7996128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.7996395Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.7996688Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.7996811Z Execution Analysis: (:1) 2025-03-14T06:00:23.7997075Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.7997268Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7997274Z 2025-03-14T06:00:23.7997482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.7997593Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.7997826Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.7997956Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.7998172Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.7998315Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.7998468Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.7998632Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.7999216Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.7999771Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8000155Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8000497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8000814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8001083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8001390Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8001652Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8001765Z Execution Analysis: .......... 2025-03-14T06:00:23.8002019Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8002228Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8002512Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1151 counts during 1097 steps 2025-03-14T06:00:23.8002529Z 2025-03-14T06:00:23.8002727Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8002885Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8003190Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8003309Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8003507Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8003649Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8003799Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8003965Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8004326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8004765Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8005247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8005534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8005846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8006125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8006416Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8006553Z Execution Analysis: (:1) 2025-03-14T06:00:23.8006809Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8007024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8007028Z 2025-03-14T06:00:23.8007228Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8007352Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8007606Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8007731Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8007936Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8008092Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8008245Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8008425Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8009019Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8009634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8009995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8010364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8010686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8010976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8011288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8011572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8011680Z Execution Analysis: .......... 2025-03-14T06:00:23.8011954Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8012165Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8012467Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1152 counts during 1098 steps 2025-03-14T06:00:23.8012475Z 2025-03-14T06:00:23.8012680Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8012857Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8013151Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8013275Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8013482Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8013640Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8013790Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8013974Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8014336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8014698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8015017Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8015310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8015623Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8015907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8016205Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8016345Z Execution Analysis: (:1) 2025-03-14T06:00:23.8016605Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8016822Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8016827Z 2025-03-14T06:00:23.8017054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8017287Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8017520Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8017643Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8017845Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8018004Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8018149Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8018321Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8018893Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8019491Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8019842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8020199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8020504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8020785Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8021085Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8021362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8021464Z Execution Analysis: .......... 2025-03-14T06:00:23.8021730Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8021940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8022228Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1153 counts during 1099 steps 2025-03-14T06:00:23.8022256Z 2025-03-14T06:00:23.8022488Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8022601Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8022894Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8023001Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8023208Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8023350Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8023505Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8023677Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8024032Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8024376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8024690Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8024959Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8025269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8025533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8025832Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8025959Z Execution Analysis: (:1) 2025-03-14T06:00:23.8026220Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8026419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8026423Z 2025-03-14T06:00:23.8026660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8026778Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8027117Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8027222Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8027422Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8027554Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8027697Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8027854Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8028434Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8028966Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8029313Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8029639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8029943Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8030200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8030494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8030747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8030859Z Execution Analysis: .......... 2025-03-14T06:00:23.8031099Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8031300Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8031618Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1154 counts during 1100 steps 2025-03-14T06:00:23.8031623Z 2025-03-14T06:00:23.8031823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8031931Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8032206Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8032310Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8032514Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8032649Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8032796Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8032955Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8033299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8033628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8033926Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8034183Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8034477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8034728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8035013Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8035130Z Execution Analysis: (:1) 2025-03-14T06:00:23.8035386Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8035596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8035602Z 2025-03-14T06:00:23.8035802Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8035909Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8036134Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8036236Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8036433Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8036568Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8036717Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8036905Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8037466Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8037998Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8038346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8038678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8038970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8039231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8039516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8039777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8039874Z Execution Analysis: .......... 2025-03-14T06:00:23.8040128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8040349Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8040653Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1155 counts during 1101 steps 2025-03-14T06:00:23.8040657Z 2025-03-14T06:00:23.8040846Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8040957Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8041225Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8041338Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8041531Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8041676Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8041808Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8041978Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8042312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8042653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8042942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8043210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8043498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8043756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8044027Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8044157Z Execution Analysis: (:1) 2025-03-14T06:00:23.8044420Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8044710Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8044716Z 2025-03-14T06:00:23.8045068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8045195Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8045426Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8045549Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8045756Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8045910Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8046091Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8046272Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8046873Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8047467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8047829Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8048191Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8048506Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8052119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8052466Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8052745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8052848Z Execution Analysis: .......... 2025-03-14T06:00:23.8053122Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8053484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8053786Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1156 counts during 1102 steps 2025-03-14T06:00:23.8053792Z 2025-03-14T06:00:23.8053993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8054113Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8054401Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8054521Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8054723Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8054876Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8055013Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8055187Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8055547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8055905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8056216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8056497Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8056803Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8057190Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8057458Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8057578Z Execution Analysis: (:1) 2025-03-14T06:00:23.8057843Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8058038Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8058042Z 2025-03-14T06:00:23.8058225Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8058333Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8058544Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8058654Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8058840Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8059161Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8059295Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8059458Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8060008Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8060546Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8060876Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8061207Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8061495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8061755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8062045Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8062292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8062394Z Execution Analysis: .......... 2025-03-14T06:00:23.8062677Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8062870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8063138Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1158 counts during 1103 steps 2025-03-14T06:00:23.8063144Z 2025-03-14T06:00:23.8063337Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8063440Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8063712Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8063812Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8064004Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8064134Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8064267Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8064422Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8064756Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8065077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8065526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8065780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8066255Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8066523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8066885Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8067008Z Execution Analysis: (:1) 2025-03-14T06:00:23.8067277Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8067476Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8067481Z 2025-03-14T06:00:23.8067687Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8067797Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8068032Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8068175Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8068386Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8068527Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8068680Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8068845Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8069441Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8070009Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8070374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8070722Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8071040Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8071312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8071624Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8071894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8072071Z Execution Analysis: .......... 2025-03-14T06:00:23.8072328Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8072536Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8072824Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1159 counts during 1104 steps 2025-03-14T06:00:23.8072829Z 2025-03-14T06:00:23.8073043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8073155Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8073449Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8073556Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8073771Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8073911Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8074063Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8074228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8074595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8074942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8075259Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8075531Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8075845Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8076112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8076451Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8076581Z Execution Analysis: (:1) 2025-03-14T06:00:23.8076845Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8077042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8077046Z 2025-03-14T06:00:23.8077254Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8077365Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8077626Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8077735Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8077946Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8078197Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8078342Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8078497Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8079048Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8079577Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8079915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8080246Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8080534Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8080792Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8081075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8081375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8081470Z Execution Analysis: .......... 2025-03-14T06:00:23.8081712Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8081895Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8082169Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1160 counts during 1105 steps 2025-03-14T06:00:23.8082175Z 2025-03-14T06:00:23.8082358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8082470Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8082737Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8082848Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8083036Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8083181Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8083309Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8083470Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8083798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8084129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8084413Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8084743Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8085204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8085509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8085802Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8085931Z Execution Analysis: (:1) 2025-03-14T06:00:23.8086187Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8086390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8086395Z 2025-03-14T06:00:23.8086591Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8086737Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8086962Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8087079Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8087280Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8087431Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8087576Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8087750Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8088340Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8088915Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8089271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8089630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8089939Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8090222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8090584Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8090861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8090966Z Execution Analysis: .......... 2025-03-14T06:00:23.8091226Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8091426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8091726Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1161 counts during 1106 steps 2025-03-14T06:00:23.8091733Z 2025-03-14T06:00:23.8091936Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8092064Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8092359Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8092486Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8092693Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8092856Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8093002Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8093189Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8093550Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8093916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8094232Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8094516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8094854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8095146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8095442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8095584Z Execution Analysis: (:1) 2025-03-14T06:00:23.8095847Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8096067Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8096071Z 2025-03-14T06:00:23.8096314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8096433Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8096679Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8096793Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8097015Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8097273Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8097433Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8097601Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8098193Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8098755Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8099126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8099473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8099799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8100120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8100436Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8100704Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8100824Z Execution Analysis: .......... 2025-03-14T06:00:23.8101080Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8101297Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8101588Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1162 counts during 1107 steps 2025-03-14T06:00:23.8101592Z 2025-03-14T06:00:23.8101808Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8101928Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8102230Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8102342Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8102550Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8102693Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8102851Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8103019Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8103383Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8103730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8104047Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8104341Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8104662Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8104930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8105227Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8105350Z Execution Analysis: (:1) 2025-03-14T06:00:23.8105617Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8105816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8105844Z 2025-03-14T06:00:23.8106054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8106166Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8106402Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8106510Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8106723Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8106866Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8107021Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8107186Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8107859Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8108392Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8108739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8109067Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8109423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8109682Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8109978Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8110228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8110339Z Execution Analysis: .......... 2025-03-14T06:00:23.8110582Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8110783Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8111056Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1163 counts during 1108 steps 2025-03-14T06:00:23.8111075Z 2025-03-14T06:00:23.8111269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8111383Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8111662Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8111769Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8111971Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8112108Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8112254Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8112413Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8112757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8113084Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8113411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8113683Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8113975Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8114238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8114509Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8114637Z Execution Analysis: (:1) 2025-03-14T06:00:23.8114877Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8115099Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8115102Z 2025-03-14T06:00:23.8115292Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8115415Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8115632Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8115752Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8115942Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8116087Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8116225Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8116395Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8116946Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8117492Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8118023Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8118380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8118739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8119021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8119322Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8119598Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8119704Z Execution Analysis: .......... 2025-03-14T06:00:23.8119971Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8120170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8120466Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1164 counts during 1109 steps 2025-03-14T06:00:23.8120471Z 2025-03-14T06:00:23.8120674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8120800Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8121083Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8121205Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8121406Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8121563Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8121704Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8121885Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8122235Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8122608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8122917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8123200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8123502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8123778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8124066Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8124201Z Execution Analysis: (:1) 2025-03-14T06:00:23.8124559Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8124780Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8124784Z 2025-03-14T06:00:23.8125149Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8125284Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8125520Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8125650Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8125856Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8126014Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8126162Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8126346Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8126938Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8127527Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8127889Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8128309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8128624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8128909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8129222Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8129505Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8129615Z Execution Analysis: .......... 2025-03-14T06:00:23.8129890Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8130097Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8130402Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1165 counts during 1110 steps 2025-03-14T06:00:23.8130411Z 2025-03-14T06:00:23.8130626Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8130746Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8131046Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8131159Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8131376Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8131520Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8131679Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8131850Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8132230Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8132611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8132944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8133218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8133536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8133809Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8134116Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8134268Z Execution Analysis: (:1) 2025-03-14T06:00:23.8134540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8134745Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8134751Z 2025-03-14T06:00:23.8134969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8135089Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8135336Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8135450Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8135667Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8135814Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8135974Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8136146Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8136747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8137331Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8137744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8138094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8138415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8138793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8139098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8139365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8139482Z Execution Analysis: .......... 2025-03-14T06:00:23.8139732Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8140102Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8140395Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1166 counts during 1111 steps 2025-03-14T06:00:23.8140400Z 2025-03-14T06:00:23.8140612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8140729Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8141026Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8141137Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8141350Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8141497Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8141650Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8141820Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8142211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8142574Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8142894Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8143170Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8143486Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8143756Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8144082Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8144208Z Execution Analysis: (:1) 2025-03-14T06:00:23.8144474Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8144682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8144688Z 2025-03-14T06:00:23.8144901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8145014Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8145251Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8145361Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8145573Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8145718Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8145873Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8146043Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8146641Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8147249Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8147641Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8148001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8148313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8148592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8148900Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8149175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8149282Z Execution Analysis: .......... 2025-03-14T06:00:23.8149547Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8149754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8150048Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1167 counts during 1112 steps 2025-03-14T06:00:23.8150053Z 2025-03-14T06:00:23.8150254Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8150373Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8150659Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8150775Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8151088Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8151233Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8151369Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8151669Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8152004Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8152331Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8152623Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8152883Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8153171Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8153424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8153720Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8153842Z Execution Analysis: (:1) 2025-03-14T06:00:23.8154082Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8154279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8154284Z 2025-03-14T06:00:23.8154468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8154582Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8154794Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8154904Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8155094Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8155233Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8155369Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8155532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8156076Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8156657Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8156989Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8157319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8157611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8157869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8158157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8158414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8158512Z Execution Analysis: .......... 2025-03-14T06:00:23.8158761Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8158947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8159226Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1168 counts during 1113 steps 2025-03-14T06:00:23.8159231Z 2025-03-14T06:00:23.8159415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8159529Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8159798Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8159910Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8160100Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8160409Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8160574Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8160751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8161100Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8161449Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8161752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8162026Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8162324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8162619Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8162903Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8163035Z Execution Analysis: (:1) 2025-03-14T06:00:23.8163288Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8163495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8163499Z 2025-03-14T06:00:23.8163705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8163816Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8164037Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8164154Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8164352Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8164582Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8164725Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8164900Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8165903Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8166531Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8166897Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8167251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8167577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8167853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8168167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8168440Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8168553Z Execution Analysis: .......... 2025-03-14T06:00:23.8168815Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8169027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8169319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1169 counts during 1114 steps 2025-03-14T06:00:23.8169325Z 2025-03-14T06:00:23.8169534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8169650Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8169948Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8170059Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8170271Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8170456Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8170609Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8170779Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8171142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8171491Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8171813Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8172083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8172441Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8172706Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8173011Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8173139Z Execution Analysis: (:1) 2025-03-14T06:00:23.8173408Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8173611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8173616Z 2025-03-14T06:00:23.8173828Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8173942Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8174182Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8174296Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8174512Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8174656Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8174810Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8174976Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8175622Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8176195Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8176560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8176910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8177231Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8177615Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8177923Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8178191Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8178300Z Execution Analysis: .......... 2025-03-14T06:00:23.8178552Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8178759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8179041Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1170 counts during 1115 steps 2025-03-14T06:00:23.8179046Z 2025-03-14T06:00:23.8179248Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8179357Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8179648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8179754Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8179983Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8180127Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8180271Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8180435Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8180791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8181127Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8181441Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8181745Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8182053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8182318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8182614Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8182738Z Execution Analysis: (:1) 2025-03-14T06:00:23.8182999Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8183307Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8183312Z 2025-03-14T06:00:23.8183499Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8183611Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8183828Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8183936Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8184128Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8184268Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8184407Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8184618Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8185164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8185698Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8186033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8186367Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8186656Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8186917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8187207Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8187464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8187563Z Execution Analysis: .......... 2025-03-14T06:00:23.8187811Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8188001Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8188276Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1171 counts during 1116 steps 2025-03-14T06:00:23.8188284Z 2025-03-14T06:00:23.8188471Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8188583Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8188874Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8188984Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8189177Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8189315Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8189448Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8189612Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8189945Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8190272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8190583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8190843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8191128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8191384Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8191656Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8191780Z Execution Analysis: (:1) 2025-03-14T06:00:23.8192018Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8192210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8192214Z 2025-03-14T06:00:23.8192402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8192513Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8192727Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8192835Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8193023Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8193188Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8193347Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8193512Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8194058Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8194592Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8194927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8195262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8195550Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8195812Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8196276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8196544Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8196644Z Execution Analysis: .......... 2025-03-14T06:00:23.8196901Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8197096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8197387Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1172 counts during 1117 steps 2025-03-14T06:00:23.8197392Z 2025-03-14T06:00:23.8197596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8197708Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8198018Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8198130Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8198336Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8198472Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8198608Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8198777Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8199122Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8199472Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8199876Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8200142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8200450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8200716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8201008Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8201134Z Execution Analysis: (:1) 2025-03-14T06:00:23.8201393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8201591Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8201597Z 2025-03-14T06:00:23.8201801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8201915Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8202148Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8202258Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8202485Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8202648Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8202799Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8202963Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8203546Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8204105Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8204464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8205066Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8205397Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8205675Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8205993Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8206263Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8206380Z Execution Analysis: .......... 2025-03-14T06:00:23.8206642Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8206854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8207148Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1173 counts during 1118 steps 2025-03-14T06:00:23.8207153Z 2025-03-14T06:00:23.8207395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8207512Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8207808Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8207917Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8210402Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8210552Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8212319Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8212490Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8212865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8213218Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8213543Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8213822Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8214144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8214412Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8214734Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8214869Z Execution Analysis: (:1) 2025-03-14T06:00:23.8215148Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8215357Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8215362Z 2025-03-14T06:00:23.8215561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8215686Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8215917Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8216039Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8216283Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8216437Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8216586Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8216760Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8217461Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8218026Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8218375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8218731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8219035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8219309Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8219608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8219880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8219990Z Execution Analysis: .......... 2025-03-14T06:00:23.8220250Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8220447Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8220741Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1174 counts during 1119 steps 2025-03-14T06:00:23.8220746Z 2025-03-14T06:00:23.8220989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8221115Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8221397Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8221591Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8221790Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8221976Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8222114Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8222290Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8222638Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8222990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8223296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8223578Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8223878Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8224150Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8224442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8224564Z Execution Analysis: (:1) 2025-03-14T06:00:23.8224821Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8225018Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8225022Z 2025-03-14T06:00:23.8225230Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8225336Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8225601Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8225710Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8225917Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8226061Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8226215Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8226384Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8226976Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8227539Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8227903Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8228253Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8228572Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8228844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8229157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8229423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8229541Z Execution Analysis: .......... 2025-03-14T06:00:23.8229796Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8230007Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8230318Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1175 counts during 1120 steps 2025-03-14T06:00:23.8230324Z 2025-03-14T06:00:23.8230533Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8230649Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8230985Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8231098Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8231343Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8231488Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8231638Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8231804Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8232167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8232517Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8232835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8233103Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8233421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8233686Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8233986Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8234110Z Execution Analysis: (:1) 2025-03-14T06:00:23.8234375Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8234574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8234589Z 2025-03-14T06:00:23.8234784Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8234929Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8235153Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8235258Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8235473Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8235609Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8235767Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8235930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8236516Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8237091Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8237444Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8237791Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8238099Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8238376Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8238680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8238954Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8239058Z Execution Analysis: .......... 2025-03-14T06:00:23.8239316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8239540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8239944Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1176 counts during 1121 steps 2025-03-14T06:00:23.8239949Z 2025-03-14T06:00:23.8240140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8240278Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8240547Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8240689Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8240881Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8241021Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8241154Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8241321Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8241658Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8241992Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8242287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8242551Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8242841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8243103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8243375Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8243499Z Execution Analysis: (:1) 2025-03-14T06:00:23.8243739Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8243937Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8243941Z 2025-03-14T06:00:23.8244150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8244268Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8244564Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8244689Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8244879Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8245197Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8245345Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8245524Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8246114Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8246705Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8247068Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8247433Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8247749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8248038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8248348Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8248627Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8248736Z Execution Analysis: .......... 2025-03-14T06:00:23.8249030Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8249234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8249533Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1177 counts during 1122 steps 2025-03-14T06:00:23.8249539Z 2025-03-14T06:00:23.8249771Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8249896Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8250212Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8250335Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8250540Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8250694Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8250836Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8251015Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8251374Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8251738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8252053Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8252338Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8252644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8252921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8253213Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8253348Z Execution Analysis: (:1) 2025-03-14T06:00:23.8253609Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8253820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8253860Z 2025-03-14T06:00:23.8254071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8254189Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8254431Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8254546Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8254761Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8254906Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8255061Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8255231Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8255830Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8256405Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8256771Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8257235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8257537Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8257793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8258085Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8258334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8258443Z Execution Analysis: .......... 2025-03-14T06:00:23.8258707Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8258909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8259181Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1179 counts during 1123 steps 2025-03-14T06:00:23.8259210Z 2025-03-14T06:00:23.8259412Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8259545Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8259825Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8259929Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8260128Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8260261Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8260402Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8260567Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8260905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8261230Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8261529Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8261787Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8262083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8262333Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8262611Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8262728Z Execution Analysis: (:1) 2025-03-14T06:00:23.8262979Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8263191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8263195Z 2025-03-14T06:00:23.8263394Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8263502Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8263729Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8263833Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8264030Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8264164Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8264311Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8264468Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8265025Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8265889Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8266264Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8266617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8266941Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8267215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8267533Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8267862Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8267980Z Execution Analysis: .......... 2025-03-14T06:00:23.8268245Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8268464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8268803Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1180 counts during 1124 steps 2025-03-14T06:00:23.8268854Z 2025-03-14T06:00:23.8269059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8269185Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8269478Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8269598Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8269805Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8269953Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8270109Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8270278Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8270660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8271018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8271347Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8271635Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8271946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8272229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8272526Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8272662Z Execution Analysis: (:1) 2025-03-14T06:00:23.8272956Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8273170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8273177Z 2025-03-14T06:00:23.8273379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8273505Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8273740Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8273863Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8274068Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8274220Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8274371Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8274551Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8275144Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8275731Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8276095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8276459Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8276777Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8277059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8277366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8277672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8277784Z Execution Analysis: .......... 2025-03-14T06:00:23.8278052Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8278284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8278592Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1181 counts during 1125 steps 2025-03-14T06:00:23.8278624Z 2025-03-14T06:00:23.8278831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8278964Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8279253Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8279373Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8279581Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8279734Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8279880Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8280055Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8280414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8280777Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8281093Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8281374Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8281685Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8281965Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8282262Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8282423Z Execution Analysis: (:1) 2025-03-14T06:00:23.8282681Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8282894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8282899Z 2025-03-14T06:00:23.8283104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8283229Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8283459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8283583Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8283788Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8283939Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8284085Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8284264Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8284939Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8285571Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8285932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8286296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8286609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8286894Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8287234Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8287518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8287621Z Execution Analysis: .......... 2025-03-14T06:00:23.8287887Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8288128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8288461Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1182 counts during 1126 steps 2025-03-14T06:00:23.8288467Z 2025-03-14T06:00:23.8288676Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8288792Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8289092Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8289206Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8289417Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8289565Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8289714Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8289889Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8290254Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8290609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8290931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8291206Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8291525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8291798Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8292122Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8292249Z Execution Analysis: (:1) 2025-03-14T06:00:23.8292519Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8292723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8292730Z 2025-03-14T06:00:23.8292944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8293060Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8293301Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8293412Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8293628Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8293774Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8293930Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8294100Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8294698Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8295274Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8295643Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8295997Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8296319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8296619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8296937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8297314Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8297456Z Execution Analysis: .......... 2025-03-14T06:00:23.8297707Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8297940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8298224Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1183 counts during 1127 steps 2025-03-14T06:00:23.8298229Z 2025-03-14T06:00:23.8298435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8298546Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8298836Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8298946Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8299154Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8299295Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8299446Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8299613Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8299976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8300321Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8300626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8300897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8301208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8301497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8301792Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8301916Z Execution Analysis: (:1) 2025-03-14T06:00:23.8302175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8302373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8302378Z 2025-03-14T06:00:23.8302584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8302698Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8302932Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8303039Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8303253Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8303396Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8303555Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8303717Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8304308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8304866Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8305228Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8305580Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8306160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8306436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8306737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8307037Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8307144Z Execution Analysis: .......... 2025-03-14T06:00:23.8307530Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8307718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8307996Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1184 counts during 1128 steps 2025-03-14T06:00:23.8308001Z 2025-03-14T06:00:23.8308189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8308307Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8308581Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8308690Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8308880Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8309027Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8309162Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8309329Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8309662Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8309995Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8310287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8310548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8310860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8311120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8311393Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8311515Z Execution Analysis: (:1) 2025-03-14T06:00:23.8311765Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8311966Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8311970Z 2025-03-14T06:00:23.8312159Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8312277Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8312496Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8312613Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8312807Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8312955Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8313093Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8313265Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8313813Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8314361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8314696Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8315061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8315358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8315622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8315917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8316207Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8316336Z Execution Analysis: .......... 2025-03-14T06:00:23.8316585Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8316772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8317060Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1185 counts during 1129 steps 2025-03-14T06:00:23.8317064Z 2025-03-14T06:00:23.8317257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8317381Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8317655Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8317772Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8317967Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8318116Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8318255Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8318421Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8318754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8319094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8319389Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8319657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8319969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8320235Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8320507Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8320635Z Execution Analysis: (:1) 2025-03-14T06:00:23.8320877Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8321075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8321079Z 2025-03-14T06:00:23.8321275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8321387Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8321612Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8321718Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8321915Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8322047Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8322186Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8322352Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8322904Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8323442Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8323786Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8324137Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8324446Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8324778Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8325306Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8325603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8325723Z Execution Analysis: .......... 2025-03-14T06:00:23.8325983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8326197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8326492Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1186 counts during 1130 steps 2025-03-14T06:00:23.8326497Z 2025-03-14T06:00:23.8326713Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8326831Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8327127Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8327243Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8327460Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8327608Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8327759Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8327930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8328299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8328651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8328973Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8329270Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8329586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8329859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8330165Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8330294Z Execution Analysis: (:1) 2025-03-14T06:00:23.8330566Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8330769Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8330774Z 2025-03-14T06:00:23.8330988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8331105Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8331352Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8331462Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8331681Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8331826Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8331987Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8332159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8332762Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8333338Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8333734Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8334095Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8334420Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8334723Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8335069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8335339Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8335461Z Execution Analysis: .......... 2025-03-14T06:00:23.8335724Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8335940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8336232Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1187 counts during 1131 steps 2025-03-14T06:00:23.8336236Z 2025-03-14T06:00:23.8336451Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8336567Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8336869Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8336984Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8337299Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8337433Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8337573Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8337730Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8338071Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8338400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8338725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8338980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8339276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8339534Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8339807Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8339932Z Execution Analysis: (:1) 2025-03-14T06:00:23.8340170Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8340367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8340373Z 2025-03-14T06:00:23.8340559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8340677Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8340890Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8341005Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8341194Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8341338Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8341477Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8341643Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8342192Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8342756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8343097Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8343432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8343747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8344009Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8344317Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8344578Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8344678Z Execution Analysis: .......... 2025-03-14T06:00:23.8344925Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8345115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8345392Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1188 counts during 1132 steps 2025-03-14T06:00:23.8345397Z 2025-03-14T06:00:23.8345587Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8345704Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8345971Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8346090Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8346281Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8346426Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8346560Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8346730Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8347064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8347425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8347716Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8347983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8348268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8348535Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8348808Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8348936Z Execution Analysis: (:1) 2025-03-14T06:00:23.8349178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8349375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8349379Z 2025-03-14T06:00:23.8349571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8349690Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8349905Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8350019Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8350212Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8350356Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8350496Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8350662Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8351212Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8351856Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8352194Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8352558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8352850Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8353144Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8353433Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8353698Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8353800Z Execution Analysis: .......... 2025-03-14T06:00:23.8354053Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8354245Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8354522Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1189 counts during 1133 steps 2025-03-14T06:00:23.8354528Z 2025-03-14T06:00:23.8354728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8354839Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8355119Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8355225Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8355427Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8355565Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8355711Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8355872Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8356244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8356571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8356876Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8357131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8357432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8357689Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8357974Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8358094Z Execution Analysis: (:1) 2025-03-14T06:00:23.8358351Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8358544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8358548Z 2025-03-14T06:00:23.8358749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8358860Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8359090Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8359198Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8359399Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8359531Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8359679Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8359836Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8360431Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8360969Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8361315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8361667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8361996Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8362254Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8362555Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8362808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8362922Z Execution Analysis: .......... 2025-03-14T06:00:23.8363165Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8363363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8363637Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1190 counts during 1134 steps 2025-03-14T06:00:23.8363642Z 2025-03-14T06:00:23.8363842Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8363951Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8364233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8364337Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8364622Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8364759Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8365069Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8365241Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8365856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8366211Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8366536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8366813Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8367130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8367400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8367702Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8367831Z Execution Analysis: (:1) 2025-03-14T06:00:23.8368097Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8368302Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8368306Z 2025-03-14T06:00:23.8368521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8368637Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8368880Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8368992Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8369206Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8369350Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8369507Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8369678Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8370314Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8370894Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8371317Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8371716Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8372039Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8372326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8372633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8372914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8373020Z Execution Analysis: .......... 2025-03-14T06:00:23.8373289Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8373491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8373793Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1191 counts during 1135 steps 2025-03-14T06:00:23.8373799Z 2025-03-14T06:00:23.8374002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8374129Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8374418Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8374543Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8374749Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8374912Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8375058Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8375266Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8375624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8375990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8376306Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8376592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8376902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8377180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8377568Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8377693Z Execution Analysis: (:1) 2025-03-14T06:00:23.8377935Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8378132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8378138Z 2025-03-14T06:00:23.8378326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8378442Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8378659Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8378774Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8378965Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8379109Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8379245Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8379432Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8379978Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8380519Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8380875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8381240Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8381530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8381793Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8382078Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8382340Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8382443Z Execution Analysis: .......... 2025-03-14T06:00:23.8382690Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8382879Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8383158Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1192 counts during 1136 steps 2025-03-14T06:00:23.8383163Z 2025-03-14T06:00:23.8383352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8383471Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8383740Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8383857Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8384049Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8384218Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8384353Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8384523Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8384853Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8385187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8385481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8385740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8386025Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8386283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8386555Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8386681Z Execution Analysis: (:1) 2025-03-14T06:00:23.8386922Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8387120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8387126Z 2025-03-14T06:00:23.8387312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8387426Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8387643Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8387757Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8387949Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8388114Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8388253Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8388425Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8388974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8389540Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8389912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8390235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8390538Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8390795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8391092Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8391342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8391451Z Execution Analysis: .......... 2025-03-14T06:00:23.8391693Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8391893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8392161Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1193 counts during 1137 steps 2025-03-14T06:00:23.8392165Z 2025-03-14T06:00:23.8392362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8392470Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8392750Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8392857Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8393093Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8393230Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8393373Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8393532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8393875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8394202Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8394505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8394761Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8395063Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8395312Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8395598Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8395716Z Execution Analysis: (:1) 2025-03-14T06:00:23.8396142Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8396340Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8396346Z 2025-03-14T06:00:23.8396556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8396672Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8396912Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8397021Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8397261Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8397409Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8397570Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8397738Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8398324Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8398932Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8399295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8399641Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8399964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8400235Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8400556Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8400819Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8400939Z Execution Analysis: .......... 2025-03-14T06:00:23.8401193Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8401412Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8401697Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1194 counts during 1138 steps 2025-03-14T06:00:23.8401702Z 2025-03-14T06:00:23.8401918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8402030Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8402330Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8402465Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8402680Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8402822Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8402980Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8403150Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8403518Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8403867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8404187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8404454Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8404877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8405316Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8405622Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8405748Z Execution Analysis: (:1) 2025-03-14T06:00:23.8406022Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8406231Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8406248Z 2025-03-14T06:00:23.8406451Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8406580Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8406814Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8406977Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8407183Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8407343Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8407491Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8407698Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8408290Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8408900Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8409259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8409626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8409940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8410229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8410538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8410823Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8410931Z Execution Analysis: .......... 2025-03-14T06:00:23.8411203Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8411409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8411711Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1195 counts during 1139 steps 2025-03-14T06:00:23.8411716Z 2025-03-14T06:00:23.8411919Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8412049Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8412371Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8412502Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8412708Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8412870Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8413015Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8413198Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8413556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8413919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8414232Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8414524Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8414835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8415120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8415416Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8415557Z Execution Analysis: (:1) 2025-03-14T06:00:23.8415824Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8416042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8416046Z 2025-03-14T06:00:23.8416248Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8416376Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8416635Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8416868Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8417072Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8417337Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8417499Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8417666Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8418239Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8418781Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8419117Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8419458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8419751Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8420016Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8420302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8420565Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8420666Z Execution Analysis: .......... 2025-03-14T06:00:23.8420921Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8421110Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8421391Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1196 counts during 1140 steps 2025-03-14T06:00:23.8421396Z 2025-03-14T06:00:23.8421595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8421724Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8422005Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8422111Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8422303Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8422450Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8422583Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8422753Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8423085Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8423422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8423723Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8423979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8424275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8424527Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8424811Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8424931Z Execution Analysis: (:1) 2025-03-14T06:00:23.8425181Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8425368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8425372Z 2025-03-14T06:00:23.8425570Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8425708Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8425936Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8426040Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8426242Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8426396Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8426545Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8426734Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8427293Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8427825Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8428172Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8428499Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8428801Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8429059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8429356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8429610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8429720Z Execution Analysis: .......... 2025-03-14T06:00:23.8429962Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8430163Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8430435Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1197 counts during 1141 steps 2025-03-14T06:00:23.8430439Z 2025-03-14T06:00:23.8430660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8430769Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8431053Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8431158Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8431364Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8431498Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8431645Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8431803Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8432150Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8432478Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8432781Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8433039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8433336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8433590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8433877Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8433995Z Execution Analysis: (:1) 2025-03-14T06:00:23.8434250Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8434438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8434442Z 2025-03-14T06:00:23.8434665Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8438520Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8438784Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8438888Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8439144Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8439276Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8439451Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8439605Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8440169Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8440702Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8441042Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8441372Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8441674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8441929Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8442219Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8442464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8442571Z Execution Analysis: .......... 2025-03-14T06:00:23.8442811Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8443004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8443304Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1198 counts during 1142 steps 2025-03-14T06:00:23.8443311Z 2025-03-14T06:00:23.8443504Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8443609Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8443881Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8443984Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8444180Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8444313Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8444450Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8444708Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8445221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8445573Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8445893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8446167Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8446484Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8446752Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8447051Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8447174Z Execution Analysis: (:1) 2025-03-14T06:00:23.8447444Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8447685Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8447690Z 2025-03-14T06:00:23.8447893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8448009Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8448238Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8448379Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8448580Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8448759Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8448902Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8449075Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8449663Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8450239Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8450596Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8450951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8451262Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8451539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8451843Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8452117Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8452220Z Execution Analysis: .......... 2025-03-14T06:00:23.8452488Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8452688Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8453009Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1200 counts during 1143 steps 2025-03-14T06:00:23.8453014Z 2025-03-14T06:00:23.8453215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8453336Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8453625Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8453742Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8453946Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8454095Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8454236Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8454413Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8454772Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8455129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8455437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8455716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8456022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8456294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8456585Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8456713Z Execution Analysis: (:1) 2025-03-14T06:00:23.8456969Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8457303Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8457310Z 2025-03-14T06:00:23.8457492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8457630Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8457840Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8457970Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8458155Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8458292Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8458427Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8458585Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8459129Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8459666Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8459995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8460329Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8460616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8460876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8461156Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8461410Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8461504Z Execution Analysis: .......... 2025-03-14T06:00:23.8461749Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8461956Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8462234Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1201 counts during 1144 steps 2025-03-14T06:00:23.8462241Z 2025-03-14T06:00:23.8462435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8462542Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8462815Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8462915Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8463112Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8463243Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8463374Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8463536Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8463865Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8464194Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8464490Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8464740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8465032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8465278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8465846Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8465972Z Execution Analysis: (:1) 2025-03-14T06:00:23.8466316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8466521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8466525Z 2025-03-14T06:00:23.8466734Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8466900Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8467138Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8467283Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8467496Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8467635Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8467788Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8467955Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8468557Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8469127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8469491Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8469837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8470156Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8470429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8470742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8471011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8471121Z Execution Analysis: .......... 2025-03-14T06:00:23.8471407Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8471618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8471906Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1202 counts during 1145 steps 2025-03-14T06:00:23.8471911Z 2025-03-14T06:00:23.8472124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8472236Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8472529Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8472638Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8472846Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8472986Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8473135Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8473302Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8473663Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8474016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8474332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8474606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8474916Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8475183Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8475481Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8475628Z Execution Analysis: (:1) 2025-03-14T06:00:23.8475897Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8476094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8476123Z 2025-03-14T06:00:23.8476330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8476464Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8476700Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8476806Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8477013Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8477153Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8477302Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8477468Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8478283Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8478817Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8479167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8479497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8479799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8480058Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8480359Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8480623Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8480749Z Execution Analysis: .......... 2025-03-14T06:00:23.8481001Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8481195Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8481477Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1203 counts during 1146 steps 2025-03-14T06:00:23.8481483Z 2025-03-14T06:00:23.8481674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8481794Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8482067Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8482184Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8482380Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8482529Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8482667Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8482838Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8483174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8483514Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8483809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8484080Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8484371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8484706Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8485185Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8485331Z Execution Analysis: (:1) 2025-03-14T06:00:23.8485590Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8485841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8485845Z 2025-03-14T06:00:23.8486052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8486206Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8486442Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8486570Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8486779Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8486937Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8487092Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8487276Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8487873Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8488462Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8488829Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8489197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8489511Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8489801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8490114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8490422Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8490531Z Execution Analysis: .......... 2025-03-14T06:00:23.8490807Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8491017Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8491326Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1204 counts during 1147 steps 2025-03-14T06:00:23.8491331Z 2025-03-14T06:00:23.8491537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8491669Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8491965Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8492084Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8492289Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8492445Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8492589Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8492779Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8493142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8493508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8493821Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8494107Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8494413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8494716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8495013Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8495151Z Execution Analysis: (:1) 2025-03-14T06:00:23.8495410Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8495653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8495682Z 2025-03-14T06:00:23.8495884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8496015Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8496250Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8496372Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8496579Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8496739Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8496891Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8497077Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8497764Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8498336Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8498706Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8499054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8499372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8499645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8500055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8500321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8500441Z Execution Analysis: .......... 2025-03-14T06:00:23.8500696Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8500910Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8501196Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1205 counts during 1148 steps 2025-03-14T06:00:23.8501200Z 2025-03-14T06:00:23.8501410Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8501524Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8501820Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8501931Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8502145Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8502289Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8502439Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8502609Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8502971Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8503321Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8503638Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8503909Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8504260Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8504529Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8504828Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8504979Z Execution Analysis: (:1) 2025-03-14T06:00:23.8505245Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8505469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8505473Z 2025-03-14T06:00:23.8505683Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8505796Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8506036Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8506149Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8506366Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8506512Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8506668Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8506834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8507531Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8508065Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8508412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8508742Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8509049Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8509328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8509627Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8509880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8509993Z Execution Analysis: .......... 2025-03-14T06:00:23.8510236Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8510439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8510712Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1206 counts during 1149 steps 2025-03-14T06:00:23.8510716Z 2025-03-14T06:00:23.8510916Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8511026Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8511309Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8511414Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8511616Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8511753Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8511902Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8512066Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8512408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8512735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8513034Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8513312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8513611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8513863Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8514145Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8514287Z Execution Analysis: (:1) 2025-03-14T06:00:23.8514537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8514750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8514764Z 2025-03-14T06:00:23.8514953Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8515072Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8515290Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8515407Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8515600Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8515750Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8515888Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8516048Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8516791Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8517365Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8517717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8518076Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8518388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8518697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8519002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8519285Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8519396Z Execution Analysis: .......... 2025-03-14T06:00:23.8519658Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8519859Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8520158Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1207 counts during 1150 steps 2025-03-14T06:00:23.8520163Z 2025-03-14T06:00:23.8520363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8520487Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8520774Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8520895Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8521097Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8521251Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8521395Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8521573Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8521925Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8522281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8522612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8522894Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8523199Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8523474Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8523798Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8523961Z Execution Analysis: (:1) 2025-03-14T06:00:23.8524213Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8524420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8524424Z 2025-03-14T06:00:23.8524688Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8524811Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8525204Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8525322Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8525529Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8525679Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8525828Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8526001Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8526594Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8527174Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8527532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8527889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8528233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8528514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8528826Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8529104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8529211Z Execution Analysis: .......... 2025-03-14T06:00:23.8529472Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8529672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8529973Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1208 counts during 1151 steps 2025-03-14T06:00:23.8529980Z 2025-03-14T06:00:23.8530185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8530307Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8530597Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8530715Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8530920Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8531073Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8531212Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8531384Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8531737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8532097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8532431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8532718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8533026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8533320Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8533618Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8533768Z Execution Analysis: (:1) 2025-03-14T06:00:23.8534032Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8534234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8534239Z 2025-03-14T06:00:23.8534445Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8534558Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8534793Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8534902Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8535110Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8535256Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8535401Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8535570Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8536163Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8536736Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8537207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8537563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8537854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8538107Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8538393Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8538642Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8538744Z Execution Analysis: .......... 2025-03-14T06:00:23.8538983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8539173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8539444Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1209 counts during 1152 steps 2025-03-14T06:00:23.8539448Z 2025-03-14T06:00:23.8539640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8539743Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8540018Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8540119Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8540312Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8540440Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8540576Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8540729Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8541062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8541411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8541703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8541955Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8542268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8542518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8542816Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8542934Z Execution Analysis: (:1) 2025-03-14T06:00:23.8543179Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8543364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8543371Z 2025-03-14T06:00:23.8543562Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8543670Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8543888Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8543995Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8544191Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8544327Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8544468Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8544623Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8545171Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8545705Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8546187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8546515Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8546817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8547070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8547368Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8547618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8547726Z Execution Analysis: .......... 2025-03-14T06:00:23.8547968Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8548166Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8548434Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1210 counts during 1153 steps 2025-03-14T06:00:23.8548447Z 2025-03-14T06:00:23.8548632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8548746Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8549016Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8549123Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8549309Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8549446Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8549574Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8549735Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8550088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8550419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8550709Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8550989Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8551273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8551553Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8551820Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8551941Z Execution Analysis: (:1) 2025-03-14T06:00:23.8552184Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8552376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8552379Z 2025-03-14T06:00:23.8552567Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8552678Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8552892Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8552997Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8553188Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8553323Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8553459Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8553616Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8554159Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8554695Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8555050Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8555382Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8555670Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8555929Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8556215Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8556467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8556563Z Execution Analysis: .......... 2025-03-14T06:00:23.8556813Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8557002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8557276Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1211 counts during 1154 steps 2025-03-14T06:00:23.8557283Z 2025-03-14T06:00:23.8557465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8557575Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8557846Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8557957Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8558140Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8558279Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8558410Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8558596Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8558926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8559255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8559545Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8559825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8560135Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8560391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8560660Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8560785Z Execution Analysis: (:1) 2025-03-14T06:00:23.8561024Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8561219Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8561223Z 2025-03-14T06:00:23.8561408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8561522Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8561733Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8561842Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8562030Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8562167Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8562302Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8562464Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8563012Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8563572Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8563901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8564235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8564600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8564854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8565465Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8565736Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8565850Z Execution Analysis: .......... 2025-03-14T06:00:23.8566106Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8566315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8566606Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1212 counts during 1155 steps 2025-03-14T06:00:23.8566614Z 2025-03-14T06:00:23.8566822Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8566939Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8567233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8567347Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8567557Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8567702Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8567911Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8568087Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8568453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8568807Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8569162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8569494Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8569808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8570079Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8570380Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8570507Z Execution Analysis: (:1) 2025-03-14T06:00:23.8570770Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8570977Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8570981Z 2025-03-14T06:00:23.8571190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8571303Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8571544Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8571654Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8571861Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8572003Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8572152Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8572323Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8572951Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8573526Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8573895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8574249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8574571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8574846Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8575157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8575432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8575543Z Execution Analysis: .......... 2025-03-14T06:00:23.8575804Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8576009Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8576301Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1213 counts during 1156 steps 2025-03-14T06:00:23.8576308Z 2025-03-14T06:00:23.8576514Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8576628Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8576922Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8577026Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8577236Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8577406Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8577659Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8577823Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8578173Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8578539Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8578870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8579133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8579437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8579698Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8579991Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8580110Z Execution Analysis: (:1) 2025-03-14T06:00:23.8580363Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8580557Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8580570Z 2025-03-14T06:00:23.8580764Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8580875Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8581105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8581209Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8581417Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8581554Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8581701Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8581863Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8582465Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8583024Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8583373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8583719Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8584019Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8584289Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8584588Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8584853Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8584957Z Execution Analysis: .......... 2025-03-14T06:00:23.8585209Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8585409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8585696Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1214 counts during 1157 steps 2025-03-14T06:00:23.8585701Z 2025-03-14T06:00:23.8585896Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8586010Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8586290Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8586401Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8586624Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8586771Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8586911Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8587077Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8587453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8587800Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8588129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8588403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8588700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8588971Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8589256Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8589391Z Execution Analysis: (:1) 2025-03-14T06:00:23.8589641Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8589843Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8589849Z 2025-03-14T06:00:23.8590043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8590160Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8590386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8590499Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8590697Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8590844Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8590986Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8591178Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8591754Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8592319Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8592668Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8593013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8593313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8593583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8593883Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8594149Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8594254Z Execution Analysis: .......... 2025-03-14T06:00:23.8594514Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8594711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8595007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1215 counts during 1158 steps 2025-03-14T06:00:23.8595013Z 2025-03-14T06:00:23.8595206Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8595325Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8595608Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8595748Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8595947Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8596094Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8596232Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8596429Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8596776Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8597154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8597454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8597724Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8598022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8598292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8598575Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8598705Z Execution Analysis: (:1) 2025-03-14T06:00:23.8598959Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8599161Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8599167Z 2025-03-14T06:00:23.8599363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8599473Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8599703Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8599810Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8600011Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8600149Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8600318Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8600480Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8601052Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8601609Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8601964Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8602304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8602614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8602881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8603188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8603449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8603555Z Execution Analysis: .......... 2025-03-14T06:00:23.8603805Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8604006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8604288Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1216 counts during 1159 steps 2025-03-14T06:00:23.8604293Z 2025-03-14T06:00:23.8604580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8604694Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8605180Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8605294Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8605501Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8605644Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8605829Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8605999Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8606388Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8606738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8607054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8607326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8607648Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8607921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8608219Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8608349Z Execution Analysis: (:1) 2025-03-14T06:00:23.8608619Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8608822Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8608827Z 2025-03-14T06:00:23.8609037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8609154Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8609392Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8609506Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8609721Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8609890Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8610044Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8610213Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8610817Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8611391Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8611759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8612110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8612430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8612709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8613026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8613301Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8613417Z Execution Analysis: .......... 2025-03-14T06:00:23.8613676Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8613888Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8614179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1217 counts during 1160 steps 2025-03-14T06:00:23.8614190Z 2025-03-14T06:00:23.8614414Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8614537Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8614826Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8614946Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8615152Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8615322Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8615470Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8615668Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8616033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8616384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8616701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8616981Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8617393Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8617657Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8617945Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8618071Z Execution Analysis: (:1) 2025-03-14T06:00:23.8618322Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8618525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8618529Z 2025-03-14T06:00:23.8618721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8618838Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8619062Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8619171Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8619393Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8619540Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8619685Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8619853Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8620427Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8620988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8621336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8621684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8621988Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8622261Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8622561Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8622829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8622935Z Execution Analysis: .......... 2025-03-14T06:00:23.8623194Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8623390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8623676Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1218 counts during 1161 steps 2025-03-14T06:00:23.8623682Z 2025-03-14T06:00:23.8623902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8624022Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8624303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8624446Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8624644Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8624792Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8624957Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8625125Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8625473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8625820Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8626128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8626403Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8626703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8626971Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8627254Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8627383Z Execution Analysis: (:1) 2025-03-14T06:00:23.8627631Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8627832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8627836Z 2025-03-14T06:00:23.8628030Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8628153Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8628402Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8628519Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8628719Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8628865Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8629007Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8629179Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8629752Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8630312Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8630665Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8631014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8631320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8631595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8631896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8632165Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8632269Z Execution Analysis: .......... 2025-03-14T06:00:23.8632529Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8632732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8633038Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1219 counts during 1162 steps 2025-03-14T06:00:23.8633043Z 2025-03-14T06:00:23.8633248Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8633359Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8633648Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8633779Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8633980Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8634145Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8634288Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8634451Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8634802Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8635145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8635451Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8635719Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8636025Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8636286Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8636579Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8636701Z Execution Analysis: (:1) 2025-03-14T06:00:23.8636955Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8637151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8637156Z 2025-03-14T06:00:23.8637357Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8637469Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8637718Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8637826Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8638033Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8638169Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8638317Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8638480Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8639057Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8639613Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8639973Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8640318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8640631Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8640901Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8641208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8641469Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8641582Z Execution Analysis: .......... 2025-03-14T06:00:23.8641835Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8642077Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8642362Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1221 counts during 1163 steps 2025-03-14T06:00:23.8642368Z 2025-03-14T06:00:23.8642571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8642708Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8642996Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8643201Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8643408Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8643547Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8643694Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8643857Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8644209Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8644634Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8645117Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8645392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8645708Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8645981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8646280Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8646406Z Execution Analysis: (:1) 2025-03-14T06:00:23.8646672Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8646875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8646880Z 2025-03-14T06:00:23.8647127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8647242Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8647478Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8647591Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8647800Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8647946Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8648096Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8648264Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8648858Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8649436Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8649810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8650168Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8650485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8650768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8651076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8651354Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8651463Z Execution Analysis: .......... 2025-03-14T06:00:23.8651727Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8651954Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8652256Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1222 counts during 1164 steps 2025-03-14T06:00:23.8652261Z 2025-03-14T06:00:23.8652465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8652613Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8652928Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8653046Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8653251Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8653401Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8653546Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8653722Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8654079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8654441Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8654752Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8655034Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8655347Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8655624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8655915Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8656046Z Execution Analysis: (:1) 2025-03-14T06:00:23.8656302Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8656513Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8656517Z 2025-03-14T06:00:23.8656851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8656973Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8657201Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8657319Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8657521Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8657664Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8657804Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8657973Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8658555Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8659125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8659474Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8659827Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8660135Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8660408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8660704Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8660973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8661076Z Execution Analysis: .......... 2025-03-14T06:00:23.8661359Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8661559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8661846Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1223 counts during 1165 steps 2025-03-14T06:00:23.8661874Z 2025-03-14T06:00:23.8662072Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8662213Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8662493Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8662654Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8662852Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8662997Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8663135Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8663306Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8663654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8664000Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8664307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8664578Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8664879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8665148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8665553Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8665850Z Execution Analysis: (:1) 2025-03-14T06:00:23.8666109Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8666368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8666373Z 2025-03-14T06:00:23.8666582Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8666695Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8666934Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8667046Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8667250Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8667397Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8667545Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8667716Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8668303Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8668879Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8669244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8669594Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8669914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8670189Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8670502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8670771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8670920Z Execution Analysis: .......... 2025-03-14T06:00:23.8671183Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8671390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8671723Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1224 counts during 1166 steps 2025-03-14T06:00:23.8671729Z 2025-03-14T06:00:23.8671973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8672089Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8672384Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8672496Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8672711Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8672855Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8673005Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8673174Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8673539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8673893Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8674214Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8674491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8674805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8675074Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8675374Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8675500Z Execution Analysis: (:1) 2025-03-14T06:00:23.8675797Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8675999Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8676005Z 2025-03-14T06:00:23.8676211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8676332Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8676569Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8676680Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8676892Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8677033Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8677185Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8677357Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8677955Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8678527Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8678897Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8679249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8679568Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8679841Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8680154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8680447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8680562Z Execution Analysis: .......... 2025-03-14T06:00:23.8680823Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8681056Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8681349Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1225 counts during 1167 steps 2025-03-14T06:00:23.8681378Z 2025-03-14T06:00:23.8681588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8681702Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8681994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8682105Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8682314Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8682458Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8682607Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8682775Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8683136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8683489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8683812Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8686057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8686397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8688167Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8688484Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8688610Z Execution Analysis: (:1) 2025-03-14T06:00:23.8688878Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8689077Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8689086Z 2025-03-14T06:00:23.8689294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8689408Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8689645Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8689784Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8689985Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8690133Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8690291Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8690461Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8691066Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8691646Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8692018Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8692370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8692695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8692981Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8693287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8693563Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8693668Z Execution Analysis: .......... 2025-03-14T06:00:23.8693935Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8694181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8694507Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1226 counts during 1168 steps 2025-03-14T06:00:23.8694512Z 2025-03-14T06:00:23.8694717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8694838Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8695127Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8695245Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8695459Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8695606Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8695760Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8695930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8696302Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8696658Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8697084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8697413Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8697723Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8698015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8698310Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8698433Z Execution Analysis: (:1) 2025-03-14T06:00:23.8698700Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8698898Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8698905Z 2025-03-14T06:00:23.8699115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8699226Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8699466Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8699577Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8699791Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8699933Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8700089Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8700252Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8700839Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8701400Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8701765Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8702112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8702427Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8702698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8703009Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8703272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8703415Z Execution Analysis: .......... 2025-03-14T06:00:23.8703667Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8703899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8704195Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1227 counts during 1169 steps 2025-03-14T06:00:23.8704202Z 2025-03-14T06:00:23.8704400Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8704524Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8704812Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8704929Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8705127Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8705276Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8705413Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8705588Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8705942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8706289Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8706627Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8706905Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8707342Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8707605Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8707875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8707999Z Execution Analysis: (:1) 2025-03-14T06:00:23.8708239Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8708437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8708441Z 2025-03-14T06:00:23.8708630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8708745Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8708957Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8709068Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8709255Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8709397Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8709534Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8709700Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8710249Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8710790Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8711124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8711457Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8711746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8712007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8712292Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8712551Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8712678Z Execution Analysis: .......... 2025-03-14T06:00:23.8712925Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8713153Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8713431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1228 counts during 1170 steps 2025-03-14T06:00:23.8713435Z 2025-03-14T06:00:23.8713622Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8713738Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8714008Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8714119Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8714307Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8714451Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8714581Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8714752Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8715083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8715444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8715735Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8716021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8716308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8716568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8716840Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8716967Z Execution Analysis: (:1) 2025-03-14T06:00:23.8717206Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8717409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8717413Z 2025-03-14T06:00:23.8717599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8717717Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8717932Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8718049Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8718238Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8718381Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8718515Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8718683Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8719231Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8719775Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8720105Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8720443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8720741Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8720993Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8721283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8721556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8721684Z Execution Analysis: .......... 2025-03-14T06:00:23.8721924Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8722122Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8722391Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1229 counts during 1171 steps 2025-03-14T06:00:23.8722396Z 2025-03-14T06:00:23.8722590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8722697Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8722971Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8723076Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8723272Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8723406Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8723552Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8723709Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8724072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8724400Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8724827Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8725267Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8725585Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8725857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8726166Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8726292Z Execution Analysis: (:1) 2025-03-14T06:00:23.8726561Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8726765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8726769Z 2025-03-14T06:00:23.8726981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8727094Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8727333Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8727443Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8727653Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8727797Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8727952Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8728122Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8728720Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8729298Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8729666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8730024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8730348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8730624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8730968Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8731264Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8731381Z Execution Analysis: .......... 2025-03-14T06:00:23.8731643Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8731857Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8732151Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1230 counts during 1172 steps 2025-03-14T06:00:23.8732156Z 2025-03-14T06:00:23.8732371Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8732487Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8732785Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8732901Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8733115Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8733260Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8733410Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8733576Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8733968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8734350Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8734674Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8734947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8735261Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8735531Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8735831Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8735957Z Execution Analysis: (:1) 2025-03-14T06:00:23.8736228Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8736432Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8736447Z 2025-03-14T06:00:23.8736649Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8736770Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8737000Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8737217Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8737416Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8737550Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8737693Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8737853Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8738409Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8738948Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8739284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8739618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8739910Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8740198Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8740483Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8740764Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8740865Z Execution Analysis: .......... 2025-03-14T06:00:23.8741114Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8741306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8741587Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1231 counts during 1173 steps 2025-03-14T06:00:23.8741591Z 2025-03-14T06:00:23.8741782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8741904Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8742179Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8742291Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8742482Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8742626Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8742758Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8742950Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8743282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8743640Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8743930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8744196Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8744488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8744750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8745025Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8745152Z Execution Analysis: (:1) 2025-03-14T06:00:23.8745395Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8745594Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8745598Z 2025-03-14T06:00:23.8745783Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8745898Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8746111Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8746228Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8746421Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8746563Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8746702Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8746862Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8747410Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8747953Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8748284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8748617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8748941Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8749200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8749509Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8749766Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8749864Z Execution Analysis: .......... 2025-03-14T06:00:23.8750109Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8750297Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8750575Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1232 counts during 1174 steps 2025-03-14T06:00:23.8750580Z 2025-03-14T06:00:23.8750765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8750887Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8751154Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8751269Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8751458Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8751622Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8751753Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8751921Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8752273Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8752612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8752898Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8753163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8753447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8753706Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8753975Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8754103Z Execution Analysis: (:1) 2025-03-14T06:00:23.8754341Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8754541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8754545Z 2025-03-14T06:00:23.8754735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8754842Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8755064Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8755167Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8755360Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8755494Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8755637Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8755798Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8756351Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8756885Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8757224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8757552Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8757874Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8758152Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8758452Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8758704Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8758813Z Execution Analysis: .......... 2025-03-14T06:00:23.8759055Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8759253Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8759523Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1233 counts during 1175 steps 2025-03-14T06:00:23.8759529Z 2025-03-14T06:00:23.8759722Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8759831Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8760109Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8760212Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8760435Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8760572Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8760713Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8760895Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8761242Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8761571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8761866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8762122Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8762421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8762672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8762953Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8763071Z Execution Analysis: (:1) 2025-03-14T06:00:23.8763321Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8763508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8763512Z 2025-03-14T06:00:23.8763704Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8763812Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8764035Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8764136Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8764336Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8764464Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8764686Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8764843Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8765745Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8766320Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8766693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8767108Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8767466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8767742Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8768062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8768330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8768443Z Execution Analysis: .......... 2025-03-14T06:00:23.8768705Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8768918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8769209Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1234 counts during 1176 steps 2025-03-14T06:00:23.8769229Z 2025-03-14T06:00:23.8769433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8769564Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8769852Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8770015Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8770222Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8770376Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8770555Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8770728Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8771098Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8771459Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8771772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8772057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8772363Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8772644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8772936Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8773071Z Execution Analysis: (:1) 2025-03-14T06:00:23.8773329Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8773545Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8773549Z 2025-03-14T06:00:23.8773752Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8773876Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8774109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8774234Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8774437Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8774593Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8774742Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8774919Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8775507Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8776087Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8776472Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8776857Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8777296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8777572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8777870Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8778143Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8778247Z Execution Analysis: .......... 2025-03-14T06:00:23.8778504Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8778700Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8778998Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1235 counts during 1177 steps 2025-03-14T06:00:23.8779004Z 2025-03-14T06:00:23.8779200Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8779332Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8779642Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8779765Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8779968Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8780164Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8780308Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8780489Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8780841Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8781201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8781510Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8781791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8782097Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8782374Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8782662Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8782801Z Execution Analysis: (:1) 2025-03-14T06:00:23.8783055Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8783269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8783276Z 2025-03-14T06:00:23.8783475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8783606Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8783836Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8783963Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8784276Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8784430Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8784569Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8784742Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8785292Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8785839Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8786198Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8786727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8787022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8787294Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8787596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8787850Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8787965Z Execution Analysis: .......... 2025-03-14T06:00:23.8788207Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8788413Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8788688Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1236 counts during 1178 steps 2025-03-14T06:00:23.8788693Z 2025-03-14T06:00:23.8788895Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8789029Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8789310Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8789416Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8789642Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8789779Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8789922Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8790080Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8790425Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8790753Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8791055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8791312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8791607Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8791859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8792137Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8792255Z Execution Analysis: (:1) 2025-03-14T06:00:23.8792509Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8792699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8792704Z 2025-03-14T06:00:23.8792903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8793011Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8793237Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8793342Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8793544Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8793682Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8793831Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8793989Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8794545Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8795175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8795547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8796042Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8796361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8796630Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8796944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8797206Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8797320Z Execution Analysis: .......... 2025-03-14T06:00:23.8797575Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8797785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8798074Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1237 counts during 1179 steps 2025-03-14T06:00:23.8798079Z 2025-03-14T06:00:23.8798310Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8798426Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8798744Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8798858Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8799069Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8799210Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8799361Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8799531Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8799893Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8800239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8800557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8800825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8801137Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8801400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8801699Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8801827Z Execution Analysis: (:1) 2025-03-14T06:00:23.8802096Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8802293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8802299Z 2025-03-14T06:00:23.8802508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8802623Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8802859Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8802969Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8803181Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8803323Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8803476Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8803641Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8804227Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8805065Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8805471Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8805842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8806162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8806449Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8806756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8807040Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8807151Z Execution Analysis: .......... 2025-03-14T06:00:23.8807424Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8807630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8807965Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1238 counts during 1180 steps 2025-03-14T06:00:23.8807971Z 2025-03-14T06:00:23.8808175Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8808330Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8808623Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8808744Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8808949Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8809103Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8809250Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8809428Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8809792Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8810156Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8810471Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8810757Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8811069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8811351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8811645Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8811783Z Execution Analysis: (:1) 2025-03-14T06:00:23.8812046Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8812259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8812264Z 2025-03-14T06:00:23.8812469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8812595Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8812828Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8812953Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8813159Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8813316Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8813465Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8813644Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8814260Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8814865Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8815229Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8815598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8815915Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8816201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8816512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8816794Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8816903Z Execution Analysis: .......... 2025-03-14T06:00:23.8817279Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8817502Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8817789Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1239 counts during 1181 steps 2025-03-14T06:00:23.8817793Z 2025-03-14T06:00:23.8818004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8818124Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8818396Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8818510Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8818700Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8818845Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8818977Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8822689Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8823066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8823416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8823706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8823975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8824259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8824515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8824785Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8824908Z Execution Analysis: (:1) 2025-03-14T06:00:23.8825154Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8825346Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8825353Z 2025-03-14T06:00:23.8825537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8825653Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8825869Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8825979Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8826168Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8826306Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8826514Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8826675Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8827226Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8827805Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8828138Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8828473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8828768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8829021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8829314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8829561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8829667Z Execution Analysis: .......... 2025-03-14T06:00:23.8829905Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8830124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8830394Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1240 counts during 1182 steps 2025-03-14T06:00:23.8830427Z 2025-03-14T06:00:23.8830620Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8830725Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8830995Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8831100Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8831290Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8831421Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8831559Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8831711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8832047Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8832369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8832664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8832915Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8833201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8833447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8833723Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8833838Z Execution Analysis: (:1) 2025-03-14T06:00:23.8834084Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8834266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8834271Z 2025-03-14T06:00:23.8834465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8834569Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8834788Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8834885Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8835079Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8835234Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8835378Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8835556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8836109Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8836636Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8836975Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8837296Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8837589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8837837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8838126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8838372Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8838471Z Execution Analysis: .......... 2025-03-14T06:00:23.8838730Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8838920Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8839214Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1242 counts during 1183 steps 2025-03-14T06:00:23.8839219Z 2025-03-14T06:00:23.8839408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8839511Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8839780Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8839880Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8840075Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8840208Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8840348Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8840502Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8840840Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8841162Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8841458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8841709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8841997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8842243Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8842519Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8842631Z Execution Analysis: (:1) 2025-03-14T06:00:23.8842875Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8843059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8843062Z 2025-03-14T06:00:23.8843254Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8843359Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8843576Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8843676Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8843893Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8844024Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8844191Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8844345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8845176Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8845756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8846113Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8846470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8846778Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8847061Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8847367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8847638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8847781Z Execution Analysis: .......... 2025-03-14T06:00:23.8848047Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8848280Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8848576Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1243 counts during 1184 steps 2025-03-14T06:00:23.8848581Z 2025-03-14T06:00:23.8848777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8848895Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8849182Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8849300Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8849499Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8849645Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8849788Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8849959Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8850317Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8850671Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8850978Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8851254Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8851560Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8851832Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8852118Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8852251Z Execution Analysis: (:1) 2025-03-14T06:00:23.8852503Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8852711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8852715Z 2025-03-14T06:00:23.8852912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8853031Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8853260Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8853402Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8853600Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8853785Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8853928Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8854097Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8854685Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8855268Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8855625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8855980Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8856291Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8856569Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8856871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8857273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8857368Z Execution Analysis: .......... 2025-03-14T06:00:23.8857635Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8857818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8858093Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1244 counts during 1185 steps 2025-03-14T06:00:23.8858097Z 2025-03-14T06:00:23.8858279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8858391Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8858656Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8858763Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8858947Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8859085Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8859212Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8859371Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8859699Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8860027Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8860312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8860569Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8860850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8861100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8861371Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8861501Z Execution Analysis: (:1) 2025-03-14T06:00:23.8861743Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8861943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8861947Z 2025-03-14T06:00:23.8862143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8862252Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8862505Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8862608Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8862833Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8862969Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8863118Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8863276Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8863836Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8864368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8864718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8865047Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8865480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8865919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8866299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8866574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8866699Z Execution Analysis: .......... 2025-03-14T06:00:23.8866994Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8867217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8867512Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1245 counts during 1186 steps 2025-03-14T06:00:23.8867519Z 2025-03-14T06:00:23.8867737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8867856Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8868162Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8868274Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8868496Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8868639Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8868801Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8868973Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8869348Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8869701Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8870033Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8870311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8870637Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8870910Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8871221Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8871347Z Execution Analysis: (:1) 2025-03-14T06:00:23.8871624Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8871828Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8871832Z 2025-03-14T06:00:23.8872050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8872198Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8872443Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8872589Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8872811Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8872956Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8873121Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8873291Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8873902Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8874479Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8874853Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8875209Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8875536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8875838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8876157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8876448Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8876571Z Execution Analysis: .......... 2025-03-14T06:00:23.8876829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8877041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8877330Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1246 counts during 1187 steps 2025-03-14T06:00:23.8877346Z 2025-03-14T06:00:23.8877656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8877785Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8878177Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8878280Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8878482Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8878618Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8878761Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8878917Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8879262Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8879589Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8879893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8880159Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8880447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8880713Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8880983Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8881116Z Execution Analysis: (:1) 2025-03-14T06:00:23.8881354Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8881557Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8881585Z 2025-03-14T06:00:23.8881775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8881917Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8882132Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8882249Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8882440Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8882588Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8882724Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8882894Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8883442Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8883983Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8884320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8884735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8885233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8885524Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8885860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8886148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8886256Z Execution Analysis: .......... 2025-03-14T06:00:23.8886532Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8886736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8887042Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1247 counts during 1188 steps 2025-03-14T06:00:23.8887049Z 2025-03-14T06:00:23.8887254Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8887384Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8887678Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8887807Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8888016Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8888177Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8888319Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8888505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8888863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8889231Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8889544Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8889831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8890142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8890424Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8890715Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8890856Z Execution Analysis: (:1) 2025-03-14T06:00:23.8891114Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8891332Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8891376Z 2025-03-14T06:00:23.8891579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8891735Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8891967Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8892094Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8892300Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8892454Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8892598Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8892780Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8893373Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8893961Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8894326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8894692Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8895029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8895317Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8895655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8895940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8896046Z Execution Analysis: .......... 2025-03-14T06:00:23.8896317Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8896521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8896827Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1248 counts during 1189 steps 2025-03-14T06:00:23.8896832Z 2025-03-14T06:00:23.8897048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8897273Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8897566Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8897678Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8897891Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8898032Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8898183Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8898345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8898709Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8899052Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8899370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8899638Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8899952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8900216Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8900515Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8900635Z Execution Analysis: (:1) 2025-03-14T06:00:23.8900899Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8901122Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8901150Z 2025-03-14T06:00:23.8901359Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8901474Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8901712Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8901823Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8902038Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8902179Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8902340Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8902505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8903089Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8903645Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8904009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8904374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8904693Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8904985Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8905298Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8905561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8905677Z Execution Analysis: .......... 2025-03-14T06:00:23.8905929Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8906142Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8906422Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1249 counts during 1190 steps 2025-03-14T06:00:23.8906428Z 2025-03-14T06:00:23.8906638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8906755Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8907052Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8907160Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8907474Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8907606Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8907742Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8907899Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8908234Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8908560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8908857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8909111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8909401Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8909647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8909921Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8910037Z Execution Analysis: (:1) 2025-03-14T06:00:23.8910309Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8910516Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8910520Z 2025-03-14T06:00:23.8910710Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8910813Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8911036Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8911136Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8911330Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8911460Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8911602Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8911756Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8912310Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8912836Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8913201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8913528Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8913836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8914094Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8914377Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8914628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8914727Z Execution Analysis: .......... 2025-03-14T06:00:23.8914966Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8915153Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8915429Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1250 counts during 1191 steps 2025-03-14T06:00:23.8915434Z 2025-03-14T06:00:23.8915622Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8915735Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8915997Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8916103Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8916290Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8916428Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8916559Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8916717Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8917045Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8917371Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8917656Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8917913Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8918194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8918447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8918712Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8918856Z Execution Analysis: (:1) 2025-03-14T06:00:23.8919091Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8919304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8919308Z 2025-03-14T06:00:23.8919490Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8919599Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8919810Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8919916Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8920101Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8920237Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8920369Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8920531Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8921073Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8921633Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8921961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8922324Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8922612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8922869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8923151Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8923407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8923505Z Execution Analysis: .......... 2025-03-14T06:00:23.8923747Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8923933Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8924205Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1251 counts during 1192 steps 2025-03-14T06:00:23.8924209Z 2025-03-14T06:00:23.8924394Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8924585Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8924854Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8925129Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8925332Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8925481Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8925621Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8925795Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8926151Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8926508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8926822Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8927105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8927412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8927692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8928015Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8928145Z Execution Analysis: (:1) 2025-03-14T06:00:23.8928430Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8928639Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8928643Z 2025-03-14T06:00:23.8928850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8928965Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8929203Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8929313Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8929514Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8929661Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8929807Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8929981Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8930570Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8931171Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8931566Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8931914Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8932232Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8932503Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8932817Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8933084Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8933196Z Execution Analysis: .......... 2025-03-14T06:00:23.8933452Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8933656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8933948Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1252 counts during 1193 steps 2025-03-14T06:00:23.8933953Z 2025-03-14T06:00:23.8934158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8934273Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8934566Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8934675Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8934880Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8935024Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8935171Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8935337Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8935704Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8936056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8936371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8936646Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8936961Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8937350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8937625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8937760Z Execution Analysis: (:1) 2025-03-14T06:00:23.8938006Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8938190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8938195Z 2025-03-14T06:00:23.8938385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8938490Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8938706Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8938804Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8938999Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8939130Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8939273Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8939428Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8940003Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8940532Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8940966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8941291Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8941585Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8941843Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8942137Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8942386Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8942493Z Execution Analysis: .......... 2025-03-14T06:00:23.8942732Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8942928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8943194Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1253 counts during 1194 steps 2025-03-14T06:00:23.8943198Z 2025-03-14T06:00:23.8943394Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8943499Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8943772Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8943871Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8944067Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8944197Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8944333Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8944488Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8944821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8945147Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8945440Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8945689Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8946003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8946249Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8946546Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8946659Z Execution Analysis: (:1) 2025-03-14T06:00:23.8946904Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8947095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8947100Z 2025-03-14T06:00:23.8947282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8947390Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8947602Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8947712Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8947899Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8948031Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8948170Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8948331Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8948894Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8949450Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8949780Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8950113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8950404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8950662Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8950946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8951201Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8951298Z Execution Analysis: .......... 2025-03-14T06:00:23.8951542Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8951734Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8952006Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1254 counts during 1195 steps 2025-03-14T06:00:23.8952011Z 2025-03-14T06:00:23.8952197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8952313Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8952580Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8952691Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8952878Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8953018Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8953149Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8953309Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8953637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8953963Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8954251Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8954513Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8954816Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8955091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8955361Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8955482Z Execution Analysis: (:1) 2025-03-14T06:00:23.8955717Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8955912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8955916Z 2025-03-14T06:00:23.8956100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8956207Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8956419Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8956533Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8956719Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8956857Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8956989Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8957188Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8957732Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8958293Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8958624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8958951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8959237Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8959497Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8959776Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8960026Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8960121Z Execution Analysis: .......... 2025-03-14T06:00:23.8960364Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8960546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8960821Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1255 counts during 1196 steps 2025-03-14T06:00:23.8960825Z 2025-03-14T06:00:23.8961014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8961118Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8961389Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8961491Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8961685Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8961817Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8961945Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8962103Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8962429Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8962755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8963044Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8963319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8963628Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8963873Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8964149Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8964263Z Execution Analysis: (:1) 2025-03-14T06:00:23.8964586Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8964773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8964777Z 2025-03-14T06:00:23.8965136Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8965252Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8965623Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8965732Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8965941Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8966085Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8966292Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8966459Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8967089Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8967663Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8968029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8968382Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8968704Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8968976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8969290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8969558Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8969672Z Execution Analysis: .......... 2025-03-14T06:00:23.8969927Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8970132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8970420Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1256 counts during 1197 steps 2025-03-14T06:00:23.8970431Z 2025-03-14T06:00:23.8970638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8970752Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8971046Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8971154Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8971363Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8971505Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8971655Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8971826Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8972186Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8972535Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8972899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8973212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8973527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8973796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8974095Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8974220Z Execution Analysis: (:1) 2025-03-14T06:00:23.8974482Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8974682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8974686Z 2025-03-14T06:00:23.8974891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8975008Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8975245Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8975356Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8975566Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8975736Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8975889Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8976056Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8976733Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8977353Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8977723Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8978082Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8978399Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8978712Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8979033Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8979312Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8979419Z Execution Analysis: .......... 2025-03-14T06:00:23.8979684Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8979881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8980181Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1257 counts during 1198 steps 2025-03-14T06:00:23.8980188Z 2025-03-14T06:00:23.8980386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8980507Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8980797Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8980913Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8981114Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8981261Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8981399Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8981571Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8981925Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8982305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8982614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8982918Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8983223Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8983497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8983798Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8983921Z Execution Analysis: (:1) 2025-03-14T06:00:23.8984184Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8984385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8984392Z 2025-03-14T06:00:23.8984597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8984711Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8984946Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8985053Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8985288Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8985428Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8985606Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8985774Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8986368Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8986938Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8987304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8987656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8988088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8988352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8988663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8988932Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8989035Z Execution Analysis: .......... 2025-03-14T06:00:23.8989290Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8989489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8989782Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1258 counts during 1199 steps 2025-03-14T06:00:23.8989789Z 2025-03-14T06:00:23.8989987Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8990115Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8990398Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.8990516Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8990717Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.8990866Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.8991005Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.8991178Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8991529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.8991903Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8992244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8992519Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8992817Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8993192Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8993461Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.8993589Z Execution Analysis: (:1) 2025-03-14T06:00:23.8993826Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8994193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8994197Z 2025-03-14T06:00:23.8994392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8994515Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.8994767Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.8994890Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.8995088Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.8995265Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.8995407Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.8995579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.8996150Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.8996715Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.8997064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.8997420Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.8997722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.8997997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.8998291Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.8998559Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.8998659Z Execution Analysis: .......... 2025-03-14T06:00:23.8998921Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.8999112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8999400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1259 counts during 1200 steps 2025-03-14T06:00:23.8999406Z 2025-03-14T06:00:23.8999608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.8999718Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9000007Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9000111Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9000317Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9000457Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9000599Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9000792Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9001144Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9001512Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9001823Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9002089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9002395Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9002655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9002946Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9003069Z Execution Analysis: (:1) 2025-03-14T06:00:23.9003325Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9003521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9003527Z 2025-03-14T06:00:23.9003725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9003858Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9004089Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9004197Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9004430Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9004683Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9004835Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9005163Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9005762Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9006333Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9006700Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9007051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9007372Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9007647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9007957Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9008223Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9008338Z Execution Analysis: .......... 2025-03-14T06:00:23.9008592Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9008801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9009093Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1260 counts during 1201 steps 2025-03-14T06:00:23.9009098Z 2025-03-14T06:00:23.9009306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9009419Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9009715Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9009825Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9010037Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9010179Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9010364Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9010532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9010919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9011265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9011586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9011859Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9012178Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9012445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9012744Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9012866Z Execution Analysis: (:1) 2025-03-14T06:00:23.9013132Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9013332Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9013336Z 2025-03-14T06:00:23.9013569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9013680Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9013918Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9014050Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9014267Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9014404Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9014558Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9014722Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9015322Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9015890Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9016258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9016604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9016925Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9017309Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9017609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9017880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9017984Z Execution Analysis: .......... 2025-03-14T06:00:23.9018241Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9018437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9018727Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1261 counts during 1202 steps 2025-03-14T06:00:23.9018732Z 2025-03-14T06:00:23.9018928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9019047Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9019324Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9019441Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9019641Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9019814Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9019953Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9020150Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9020497Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9020844Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9021146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9021421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9021721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9021986Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9022270Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9022405Z Execution Analysis: (:1) 2025-03-14T06:00:23.9022658Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9022860Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9022888Z 2025-03-14T06:00:23.9023084Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9023204Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9023450Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9023564Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9023762Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9023910Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9024051Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9024225Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9024800Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9025372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9025722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9026073Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9026377Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9026650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9026949Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9027221Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9027323Z Execution Analysis: .......... 2025-03-14T06:00:23.9027580Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9027777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9028065Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1263 counts during 1203 steps 2025-03-14T06:00:23.9028070Z 2025-03-14T06:00:23.9028265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9028385Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9028662Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9028775Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9029291Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9029431Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9029587Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9029750Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9030080Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9030417Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9030705Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9030969Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9031252Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9031512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9031781Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9031908Z Execution Analysis: (:1) 2025-03-14T06:00:23.9032149Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9032370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9032374Z 2025-03-14T06:00:23.9032582Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9032696Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9032905Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9033022Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9033211Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9033357Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9033489Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9033654Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9034201Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9034745Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9035082Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9035410Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9035703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9035958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9036252Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9036505Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9036611Z Execution Analysis: .......... 2025-03-14T06:00:23.9036856Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9037049Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9037321Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1264 counts during 1204 steps 2025-03-14T06:00:23.9037325Z 2025-03-14T06:00:23.9037522Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9037627Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9037900Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9038033Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9038226Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9038385Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9038519Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9038677Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9039016Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9039345Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9039639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9039892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9040189Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9040441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9040720Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9040836Z Execution Analysis: (:1) 2025-03-14T06:00:23.9041103Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9041288Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9041292Z 2025-03-14T06:00:23.9041509Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9041613Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9041831Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9041929Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9042125Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9042255Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9042402Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9042554Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9043108Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9043633Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9043969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9044289Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9044677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9045099Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9045415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9045681Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9045801Z Execution Analysis: .......... 2025-03-14T06:00:23.9046056Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9046268Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9046557Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1265 counts during 1205 steps 2025-03-14T06:00:23.9046561Z 2025-03-14T06:00:23.9046770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9046879Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9047206Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9047339Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9047552Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9047692Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9047844Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9048010Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9048375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9048722Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9049043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9049312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9049630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9049897Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9050197Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9050344Z Execution Analysis: (:1) 2025-03-14T06:00:23.9050611Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9050834Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9050849Z 2025-03-14T06:00:23.9051048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9051168Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9051398Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9051518Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9051722Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9051870Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9052015Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9052189Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9052782Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9053361Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9053718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9054077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9054396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9054709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9055036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9055329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9055434Z Execution Analysis: .......... 2025-03-14T06:00:23.9055697Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9055898Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9056198Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1266 counts during 1206 steps 2025-03-14T06:00:23.9056203Z 2025-03-14T06:00:23.9056410Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9056556Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9056855Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9056988Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9057199Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9057343Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9057497Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9057666Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9058033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9058384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9058706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9058984Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9059299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9059574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9059902Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9060031Z Execution Analysis: (:1) 2025-03-14T06:00:23.9060331Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9060537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9060541Z 2025-03-14T06:00:23.9060745Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9060858Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9061104Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9061215Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9061432Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9061570Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9061726Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9061891Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9062497Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9063071Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9063438Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9063790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9064106Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9064383Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9064697Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9064967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9065083Z Execution Analysis: .......... 2025-03-14T06:00:23.9065466Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9065674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9065964Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1267 counts during 1207 steps 2025-03-14T06:00:23.9066027Z 2025-03-14T06:00:23.9066233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9066382Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9066676Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9066786Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9066997Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9067141Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9067288Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9067459Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9067821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9068169Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9068494Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9068765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9069084Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9069386Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9069692Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9069821Z Execution Analysis: (:1) 2025-03-14T06:00:23.9070124Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9070329Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9070333Z 2025-03-14T06:00:23.9070547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9070664Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9070904Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9071019Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9071231Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9071378Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9071531Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9071700Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9072301Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9072877Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9073249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9073614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9073929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9074216Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9074524Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9074803Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9074910Z Execution Analysis: .......... 2025-03-14T06:00:23.9075181Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9075383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9075710Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1268 counts during 1208 steps 2025-03-14T06:00:23.9075715Z 2025-03-14T06:00:23.9075917Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9076064Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9076355Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9076478Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9076687Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9076842Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9076987Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9077166Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9077527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9077887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9078202Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9078488Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9078818Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9079099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9079392Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9079554Z Execution Analysis: (:1) 2025-03-14T06:00:23.9079813Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9080026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9080032Z 2025-03-14T06:00:23.9080233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9080356Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9080586Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9080708Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9080911Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9081066Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9081211Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9081390Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9081979Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9082558Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9082920Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9083281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9083598Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9083876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9084186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9084467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9084640Z Execution Analysis: .......... 2025-03-14T06:00:23.9084940Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9085142Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9085473Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1269 counts during 1209 steps 2025-03-14T06:00:23.9085502Z 2025-03-14T06:00:23.9085708Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9085832Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9086124Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9086244Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9086449Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9086600Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9086743Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9086920Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9087278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9087644Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9087959Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9088239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9088645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9088930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9089249Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9089386Z Execution Analysis: (:1) 2025-03-14T06:00:23.9089643Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9089859Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9089866Z 2025-03-14T06:00:23.9090081Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9090202Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9090447Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9090562Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9090774Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9090919Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9091068Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9091251Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9091851Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9092423Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9092795Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9093150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9093470Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9093744Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9094058Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9094328Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9094443Z Execution Analysis: .......... 2025-03-14T06:00:23.9094700Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9094940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9095255Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1270 counts during 1210 steps 2025-03-14T06:00:23.9095260Z 2025-03-14T06:00:23.9095469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9095582Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9095882Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9095997Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9096211Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9096358Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9096511Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9096679Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9097152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9097501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9097810Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9098119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9098426Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9098713Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9099007Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9099130Z Execution Analysis: (:1) 2025-03-14T06:00:23.9099391Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9099590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9099596Z 2025-03-14T06:00:23.9099801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9099913Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9100150Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9100256Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9100468Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9100607Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9100764Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9100927Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9101510Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9102070Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9102428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9102773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9103085Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9103351Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9103662Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9103924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9104037Z Execution Analysis: .......... 2025-03-14T06:00:23.9104316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9104545Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9104828Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1271 counts during 1211 steps 2025-03-14T06:00:23.9104843Z 2025-03-14T06:00:23.9105041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9105155Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9105448Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9105555Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9105764Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9105903Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9106053Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9106223Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9106579Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9106925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9107261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9107527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9107864Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9108139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9108423Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9108554Z Execution Analysis: (:1) 2025-03-14T06:00:23.9108810Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9109014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9109021Z 2025-03-14T06:00:23.9109216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9109337Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9109561Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9109677Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9109880Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9110031Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9110170Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9110343Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9110919Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9111485Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9111837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9112188Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9112497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9112773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9113076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9113349Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9113479Z Execution Analysis: .......... 2025-03-14T06:00:23.9113744Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9113968Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9114266Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1272 counts during 1212 steps 2025-03-14T06:00:23.9114270Z 2025-03-14T06:00:23.9114468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9114597Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9114884Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9115003Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9115200Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9115349Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9115491Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9115669Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9116019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9116397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9116706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9117008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9117311Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9117587Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9117875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9118013Z Execution Analysis: (:1) 2025-03-14T06:00:23.9118265Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9118471Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9118475Z 2025-03-14T06:00:23.9118674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9118796Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9119028Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9119149Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9119349Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9119499Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9119643Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9119825Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9120406Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9120977Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9121326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9121676Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9121979Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9122419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9122728Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9123039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9123169Z Execution Analysis: .......... 2025-03-14T06:00:23.9123435Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9123636Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9123939Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1273 counts during 1213 steps 2025-03-14T06:00:23.9123943Z 2025-03-14T06:00:23.9124156Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9124273Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9124647Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9124760Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9124977Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9125125Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9125276Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9125447Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9125815Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9126198Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9126544Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9126819Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9127132Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9127402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9127709Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9127837Z Execution Analysis: (:1) 2025-03-14T06:00:23.9128105Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9128308Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9128313Z 2025-03-14T06:00:23.9128521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9128639Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9128880Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9128992Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9129203Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9129344Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9129502Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9129672Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9130271Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9130847Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9131213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9131567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9131888Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9132164Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9132510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9132780Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9132935Z Execution Analysis: .......... 2025-03-14T06:00:23.9133195Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9133405Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9133701Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1274 counts during 1214 steps 2025-03-14T06:00:23.9133705Z 2025-03-14T06:00:23.9133918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9134036Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9134334Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9134448Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9134666Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9134819Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9134974Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9135146Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9135538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9135892Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9136242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9136518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9136835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9137106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9137409Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9137539Z Execution Analysis: (:1) 2025-03-14T06:00:23.9137806Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9138010Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9138014Z 2025-03-14T06:00:23.9138226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9138340Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9138579Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9138690Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9138902Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9139049Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9139206Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9139376Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9139983Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9140554Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9140925Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9141273Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9141593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9141903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9142211Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9142511Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9142618Z Execution Analysis: .......... 2025-03-14T06:00:23.9142885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9143087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9143393Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1275 counts during 1215 steps 2025-03-14T06:00:23.9143398Z 2025-03-14T06:00:23.9143600Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9143723Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9144015Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9144134Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9144339Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9144490Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9144634Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9144838Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9145195Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9145581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9145895Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9146180Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9146493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9146765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9147062Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9147195Z Execution Analysis: (:1) 2025-03-14T06:00:23.9147458Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9147666Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9147673Z 2025-03-14T06:00:23.9147874Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9147998Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9148232Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9148357Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9148561Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9148711Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9148860Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9149036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9149630Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9150213Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9150574Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9150934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9151274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9151557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9151889Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9152171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9152279Z Execution Analysis: .......... 2025-03-14T06:00:23.9152544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9152749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9153049Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1276 counts during 1216 steps 2025-03-14T06:00:23.9153054Z 2025-03-14T06:00:23.9153259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9153388Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9153679Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9153803Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9154007Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9154165Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9154341Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9154527Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9154912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9155279Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9155594Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9155882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9156193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9156478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9156774Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9156916Z Execution Analysis: (:1) 2025-03-14T06:00:23.9157177Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9157397Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9157401Z 2025-03-14T06:00:23.9157615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9157732Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9157967Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9158095Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9158303Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9158463Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9158614Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9158908Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9159488Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9160053Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9160409Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9160750Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9161101Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9161396Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9161706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9161978Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9162093Z Execution Analysis: .......... 2025-03-14T06:00:23.9162350Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9162560Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9162843Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1277 counts during 1217 steps 2025-03-14T06:00:23.9162848Z 2025-03-14T06:00:23.9163061Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9163175Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9163470Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9163583Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9163818Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9163962Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9164111Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9164302Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9164739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9165257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9165695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9165974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9166301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9166570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9166875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9167000Z Execution Analysis: (:1) 2025-03-14T06:00:23.9167273Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9167475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9167479Z 2025-03-14T06:00:23.9167690Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9167806Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9168049Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9168163Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9168379Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9168521Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9168680Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9168852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9169457Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9170031Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9170401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9170831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9171188Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9171463Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9171784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9172054Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9172176Z Execution Analysis: .......... 2025-03-14T06:00:23.9172434Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9172650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9172944Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1278 counts during 1218 steps 2025-03-14T06:00:23.9172952Z 2025-03-14T06:00:23.9173168Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9173288Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9173589Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9173733Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9173951Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9174097Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9174285Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9174456Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9174826Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9175177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9175503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9175780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9176099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9176374Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9176677Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9176808Z Execution Analysis: (:1) 2025-03-14T06:00:23.9177079Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9177294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9177299Z 2025-03-14T06:00:23.9177501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9177633Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9177867Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9177992Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9178195Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9178352Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9178499Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9178678Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9179270Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9179852Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9180242Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9180608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9180946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9181231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9181537Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9181821Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9181929Z Execution Analysis: .......... 2025-03-14T06:00:23.9182197Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9182396Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9182700Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1279 counts during 1219 steps 2025-03-14T06:00:23.9182707Z 2025-03-14T06:00:23.9182910Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9183051Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9183365Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9183491Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9183694Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9183871Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9184020Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9184199Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9184557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9184921Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9185234Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9185522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9185833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9186112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9186406Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9186542Z Execution Analysis: (:1) 2025-03-14T06:00:23.9186800Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9187010Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9187017Z 2025-03-14T06:00:23.9187221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9187351Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9187584Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9187707Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9187914Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9188075Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9188222Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9188406Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9189000Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9189584Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9189969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9190358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9190676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9190968Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9191386Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9191659Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9191765Z Execution Analysis: .......... 2025-03-14T06:00:23.9192026Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9192232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9192526Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1280 counts during 1220 steps 2025-03-14T06:00:23.9192533Z 2025-03-14T06:00:23.9192740Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9192884Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9193189Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9193299Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9193537Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9193681Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9193822Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9193996Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9194346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9194702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9195018Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9195286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9195586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9200722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9201035Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9201177Z Execution Analysis: (:1) 2025-03-14T06:00:23.9201442Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9201659Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9201665Z 2025-03-14T06:00:23.9201875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9201990Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9202228Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9202339Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9202554Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9202699Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9202845Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9203021Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9203619Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9204277Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9204790Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9205143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9205460Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9205736Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9206052Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9206316Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9206426Z Execution Analysis: .......... 2025-03-14T06:00:23.9206683Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9206891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9207184Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1281 counts during 1221 steps 2025-03-14T06:00:23.9207190Z 2025-03-14T06:00:23.9207429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9207543Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9207881Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9207989Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9208202Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9208343Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9208489Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9208658Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9209020Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9209372Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9209690Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9209960Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9210277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9210543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9210838Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9210959Z Execution Analysis: (:1) 2025-03-14T06:00:23.9211219Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9211418Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9211425Z 2025-03-14T06:00:23.9211629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9211743Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9211975Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9212081Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9212290Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9212429Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9212577Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9212740Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9213337Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9213938Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9214330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9214678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9214994Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9215264Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9215575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9215840Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9215956Z Execution Analysis: .......... 2025-03-14T06:00:23.9216210Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9216415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9216704Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1282 counts during 1222 steps 2025-03-14T06:00:23.9216735Z 2025-03-14T06:00:23.9217046Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9217153Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9217462Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9217567Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9217770Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9217907Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9218052Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9218214Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9218569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9218910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9219219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9219481Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9219787Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9220217Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9220505Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9220637Z Execution Analysis: (:1) 2025-03-14T06:00:23.9220893Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9221100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9221105Z 2025-03-14T06:00:23.9221306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9221423Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9221653Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9221772Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9221975Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9222122Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9222266Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9222440Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9223060Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9223668Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9224029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9224387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9224698Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9224983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9225287Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9225564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9225666Z Execution Analysis: .......... 2025-03-14T06:00:23.9225930Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9226131Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9226455Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1284 counts during 1223 steps 2025-03-14T06:00:23.9226460Z 2025-03-14T06:00:23.9226682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9226807Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9227091Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9227209Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9227413Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9227570Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9227707Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9227883Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9228235Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9228592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9228900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9229179Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9229480Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9229755Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9230043Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9230181Z Execution Analysis: (:1) 2025-03-14T06:00:23.9230438Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9230650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9230656Z 2025-03-14T06:00:23.9230853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9230974Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9231202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9231323Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9231523Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9231675Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9231816Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9232122Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9232696Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9233291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9233639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9233992Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9234292Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9234564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9234860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9235133Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9235233Z Execution Analysis: .......... 2025-03-14T06:00:23.9235487Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9235703Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9235990Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1285 counts during 1224 steps 2025-03-14T06:00:23.9235995Z 2025-03-14T06:00:23.9236216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9236326Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9236611Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9236717Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9236919Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9237057Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9237202Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9237363Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9237715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9238053Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9238362Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9238622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9238924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9239180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9239468Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9239586Z Execution Analysis: (:1) 2025-03-14T06:00:23.9239839Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9240033Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9240037Z 2025-03-14T06:00:23.9240233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9240347Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9240587Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9240696Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9240911Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9241050Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9241232Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9241398Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9242082Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9242644Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9243012Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9243356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9243676Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9243943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9244262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9244607Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9244729Z Execution Analysis: .......... 2025-03-14T06:00:23.9245188Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9245411Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9245791Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1286 counts during 1225 steps 2025-03-14T06:00:23.9245796Z 2025-03-14T06:00:23.9246019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9246138Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9246443Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9246562Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9246782Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9246930Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9247088Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9247262Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9247636Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9247993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9248321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9248597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9248921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9249194Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9249509Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9249635Z Execution Analysis: (:1) 2025-03-14T06:00:23.9249913Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9250118Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9250122Z 2025-03-14T06:00:23.9250345Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9250464Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9250712Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9250824Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9251047Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9251222Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9251415Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9251588Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9252197Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9252777Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9253152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9253507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9253836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9254123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9254435Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9254722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9254851Z Execution Analysis: .......... 2025-03-14T06:00:23.9255123Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9255347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9255652Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1287 counts during 1226 steps 2025-03-14T06:00:23.9255657Z 2025-03-14T06:00:23.9255860Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9255988Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9256282Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9256408Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9256613Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9256768Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9256913Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9257093Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9257452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9257814Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9258128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9258412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9258720Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9259002Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9259297Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9259436Z Execution Analysis: (:1) 2025-03-14T06:00:23.9259697Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9259915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9259919Z 2025-03-14T06:00:23.9260121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9260249Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9260478Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9260629Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9260836Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9261019Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9261165Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9261348Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9261945Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9262533Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9262892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9263258Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9263575Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9263865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9264174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9264479Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9264588Z Execution Analysis: .......... 2025-03-14T06:00:23.9264885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9265090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9265532Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1288 counts during 1227 steps 2025-03-14T06:00:23.9265538Z 2025-03-14T06:00:23.9265745Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9265881Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9266177Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9266309Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9266515Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9266679Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9266825Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9267012Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9267376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9267743Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9268056Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9268345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9268654Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9268941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9269237Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9269376Z Execution Analysis: (:1) 2025-03-14T06:00:23.9269635Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9269851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9269855Z 2025-03-14T06:00:23.9270060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9270188Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9270482Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9270609Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9270852Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9271014Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9271167Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9271352Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9271947Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9272538Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9272915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9273275Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9273603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9273884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9274238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9274509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9274631Z Execution Analysis: .......... 2025-03-14T06:00:23.9275223Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9275441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9275735Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1289 counts during 1228 steps 2025-03-14T06:00:23.9275742Z 2025-03-14T06:00:23.9275959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9276079Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9276384Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9276497Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9276720Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9276867Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9277026Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9277198Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9277569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9277920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9278247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9278631Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9278949Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9279212Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9279510Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9279633Z Execution Analysis: (:1) 2025-03-14T06:00:23.9279901Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9280100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9280104Z 2025-03-14T06:00:23.9280318Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9280469Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9280709Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9280862Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9281078Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9281218Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9281377Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9281543Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9282134Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9282694Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9283062Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9283411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9283733Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9284027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9284340Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9284717Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9284834Z Execution Analysis: .......... 2025-03-14T06:00:23.9285258Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9285474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9285768Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1290 counts during 1229 steps 2025-03-14T06:00:23.9285773Z 2025-03-14T06:00:23.9285991Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9286111Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9286420Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9286536Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9286754Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9286900Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9287060Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9287230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9287603Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9287960Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9288281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9288554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9288869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9289138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9289436Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9289563Z Execution Analysis: (:1) 2025-03-14T06:00:23.9289829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9290026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9290040Z 2025-03-14T06:00:23.9290265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9290390Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9290643Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9290760Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9290962Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9291111Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9291254Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9291434Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9292024Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9292604Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9292962Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9293323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9293631Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9293944Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9294247Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9294551Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9294655Z Execution Analysis: .......... 2025-03-14T06:00:23.9294919Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9295120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9295422Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1291 counts during 1230 steps 2025-03-14T06:00:23.9295429Z 2025-03-14T06:00:23.9295628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9295754Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9296043Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9296164Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9296370Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9296519Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9296660Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9296834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9297300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9297651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9297958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9298231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9298534Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9298807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9299092Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9299219Z Execution Analysis: (:1) 2025-03-14T06:00:23.9299468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9299673Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9299701Z 2025-03-14T06:00:23.9299897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9300202Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9300433Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9300551Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9300753Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9300904Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9301050Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9301223Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9301808Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9302388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9302748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9303107Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9303463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9303748Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9304130Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9304407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9304510Z Execution Analysis: .......... 2025-03-14T06:00:23.9304775Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9304976Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9305276Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1292 counts during 1231 steps 2025-03-14T06:00:23.9305281Z 2025-03-14T06:00:23.9305486Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9305601Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9305894Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9306005Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9306208Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9306359Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9306499Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9306675Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9307032Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9307495Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9307798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9308075Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9308382Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9308646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9308936Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9309057Z Execution Analysis: (:1) 2025-03-14T06:00:23.9309315Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9309535Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9309563Z 2025-03-14T06:00:23.9309763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9309876Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9310111Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9310218Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9310419Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9310558Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9310707Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9310871Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9311453Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9312012Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9312368Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9312731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9313042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9313332Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9313640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9313901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9314011Z Execution Analysis: .......... 2025-03-14T06:00:23.9314265Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9314467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9314750Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1293 counts during 1232 steps 2025-03-14T06:00:23.9314754Z 2025-03-14T06:00:23.9314957Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9315068Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9315356Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9315464Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9315668Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9315807Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9315950Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9316116Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9316469Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9316811Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9317126Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9317392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9317697Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9317956Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9318245Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9318364Z Execution Analysis: (:1) 2025-03-14T06:00:23.9318658Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9318855Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9318883Z 2025-03-14T06:00:23.9319085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9319197Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9319427Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9319539Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9319741Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9319882Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9320032Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9320194Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9320776Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9321335Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9321718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9322058Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9322395Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9322661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9322966Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9323225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9323339Z Execution Analysis: .......... 2025-03-14T06:00:23.9323589Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9323795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9324080Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1294 counts during 1233 steps 2025-03-14T06:00:23.9324084Z 2025-03-14T06:00:23.9324281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9324400Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9324770Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9324886Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9325256Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9325405Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9325551Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9325727Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9326090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9326447Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9326758Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9327038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9327346Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9327616Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9327906Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9328064Z Execution Analysis: (:1) 2025-03-14T06:00:23.9328322Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9328554Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9328558Z 2025-03-14T06:00:23.9328759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9328878Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9329110Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9329226Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9329431Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9329578Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9329721Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9329896Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9330486Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9331068Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9331452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9331830Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9332140Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9332423Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9332732Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9333005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9333111Z Execution Analysis: .......... 2025-03-14T06:00:23.9333375Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9333582Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9333880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1295 counts during 1234 steps 2025-03-14T06:00:23.9333885Z 2025-03-14T06:00:23.9334091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9334215Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9334504Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9334618Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9334820Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9334972Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9335117Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9335291Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9335647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9336005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9336318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9336598Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9337012Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9337283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9337589Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9337714Z Execution Analysis: (:1) 2025-03-14T06:00:23.9337986Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9338193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9338198Z 2025-03-14T06:00:23.9338390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9338508Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9338730Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9338843Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9339042Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9339188Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9339336Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9339505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9340077Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9340661Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9341008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9341376Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9341684Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9341947Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9342251Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9342510Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9342624Z Execution Analysis: .......... 2025-03-14T06:00:23.9342872Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9343074Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9343355Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1296 counts during 1235 steps 2025-03-14T06:00:23.9343359Z 2025-03-14T06:00:23.9343559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9343669Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9343952Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9344063Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9344264Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9344406Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9344548Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9344712Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9345063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9345405Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9345715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9345978Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9346280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9346564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9346853Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9346995Z Execution Analysis: (:1) 2025-03-14T06:00:23.9347247Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9347443Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9347447Z 2025-03-14T06:00:23.9347652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9347762Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9347993Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9348100Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9348301Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9348443Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9348589Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9348751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9349353Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9349913Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9350305Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9350644Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9350953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9351219Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9351527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9351787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9351895Z Execution Analysis: .......... 2025-03-14T06:00:23.9352146Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9352351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9352634Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1297 counts during 1236 steps 2025-03-14T06:00:23.9352639Z 2025-03-14T06:00:23.9352842Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9352951Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9353239Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9353347Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9353553Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9353693Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9353837Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9354001Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9354358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9354698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9355007Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9355273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9355578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9355861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9356181Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9356301Z Execution Analysis: (:1) 2025-03-14T06:00:23.9356560Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9356756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9356770Z 2025-03-14T06:00:23.9356964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9357082Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9357306Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9357414Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9357624Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9357759Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9357909Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9358068Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9358674Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9359262Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9359611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9359955Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9360262Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9360535Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9360834Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9361098Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9361204Z Execution Analysis: .......... 2025-03-14T06:00:23.9361458Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9361653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9361942Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1298 counts during 1237 steps 2025-03-14T06:00:23.9361947Z 2025-03-14T06:00:23.9362145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9362265Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9362544Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9362661Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9362854Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9362999Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9363138Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9363303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9363650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9363997Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9364301Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9364645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9365141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9365595Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9365891Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9366027Z Execution Analysis: (:1) 2025-03-14T06:00:23.9366284Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9366497Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9366501Z 2025-03-14T06:00:23.9366701Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9366822Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9367050Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9367171Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9367372Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9367524Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9367669Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9367898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9368489Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9369105Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9369467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9369825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9370142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9370425Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9370731Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9371008Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9371113Z Execution Analysis: .......... 2025-03-14T06:00:23.9371379Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9371581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9371880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1299 counts during 1238 steps 2025-03-14T06:00:23.9371885Z 2025-03-14T06:00:23.9372085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9372211Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9372500Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9372620Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9372826Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9372987Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9373127Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9373308Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9373664Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9374023Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9374339Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9374656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9375000Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9375278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9375575Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9375711Z Execution Analysis: (:1) 2025-03-14T06:00:23.9375974Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9376185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9376190Z 2025-03-14T06:00:23.9376403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9376522Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9376762Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9376878Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9377088Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9377361Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9377539Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9377707Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9378317Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9378876Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9379232Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9379579Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9379891Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9380162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9380475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9380739Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9380854Z Execution Analysis: .......... 2025-03-14T06:00:23.9381108Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9381316Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9381604Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1300 counts during 1239 steps 2025-03-14T06:00:23.9381610Z 2025-03-14T06:00:23.9381817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9381934Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9382230Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9382341Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9382544Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9382685Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9382832Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9382996Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9383348Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9383690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9384025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9384290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9384620Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9384886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9385180Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9385303Z Execution Analysis: (:1) 2025-03-14T06:00:23.9385564Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9385760Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9385764Z 2025-03-14T06:00:23.9385965Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9386076Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9386305Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9386415Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9386620Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9386794Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9386944Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9387110Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9387717Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9388276Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9388631Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9388973Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9389286Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9389555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9389861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9390125Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9390235Z Execution Analysis: .......... 2025-03-14T06:00:23.9390487Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9390694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9390980Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1301 counts during 1240 steps 2025-03-14T06:00:23.9390994Z 2025-03-14T06:00:23.9391192Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9391313Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9391596Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9391713Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9391913Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9392065Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9392200Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9392365Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9392721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9393164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9393467Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9393768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9394072Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9394345Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9394633Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9394767Z Execution Analysis: (:1) 2025-03-14T06:00:23.9395018Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9395227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9395233Z 2025-03-14T06:00:23.9395429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9395550Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9395775Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9395891Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9396113Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9396262Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9396463Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9396656Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9397231Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9397795Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9398147Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9398494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9398803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9399077Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9399378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9399646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9399748Z Execution Analysis: .......... 2025-03-14T06:00:23.9400007Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9400206Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9400498Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1302 counts during 1241 steps 2025-03-14T06:00:23.9400504Z 2025-03-14T06:00:23.9400700Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9400818Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9401100Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9401212Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9401414Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9401564Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9401703Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9401875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9402224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9402595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9402924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9403198Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9403498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9403769Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9404053Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9404183Z Execution Analysis: (:1) 2025-03-14T06:00:23.9404435Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9404733Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9404738Z 2025-03-14T06:00:23.9405098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9405227Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9405458Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9405609Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9405829Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9406006Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9406154Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9406328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9406917Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9407500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9407862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9408224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9408540Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9408825Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9409141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9409411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9409529Z Execution Analysis: .......... 2025-03-14T06:00:23.9409787Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9409997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9410290Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1303 counts during 1242 steps 2025-03-14T06:00:23.9410295Z 2025-03-14T06:00:23.9410506Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9410621Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9410919Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9411030Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9411246Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9411391Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9411541Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9411712Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9412104Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9412484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9412803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9413078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9413393Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9413660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9413957Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9414084Z Execution Analysis: (:1) 2025-03-14T06:00:23.9414349Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9414553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9414559Z 2025-03-14T06:00:23.9414768Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9414883Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9415145Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9415258Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9415496Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9415642Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9415798Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9415967Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9416569Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9417253Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9417611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9417958Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9418273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9418542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9418852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9419117Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9419235Z Execution Analysis: .......... 2025-03-14T06:00:23.9419488Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9419696Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9419978Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1305 counts during 1243 steps 2025-03-14T06:00:23.9419984Z 2025-03-14T06:00:23.9420189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9420302Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9420590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9420700Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9420908Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9421051Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9421228Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9421394Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9421747Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9422126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9422440Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9422708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9423019Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9423285Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9423580Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9423702Z Execution Analysis: (:1) 2025-03-14T06:00:23.9423964Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9424163Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9424167Z 2025-03-14T06:00:23.9424389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9424499Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9424733Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9424869Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9425080Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9425225Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9425381Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9425548Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9426131Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9426688Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9427044Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9427388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9427692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9427966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9428262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9428532Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9428635Z Execution Analysis: .......... 2025-03-14T06:00:23.9428895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9429091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9429384Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1306 counts during 1244 steps 2025-03-14T06:00:23.9429390Z 2025-03-14T06:00:23.9429588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9429707Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9429988Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9430101Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9430300Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9430495Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9430633Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9430838Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9431186Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9431536Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9431839Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9432111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9432409Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9432676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9432964Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9433094Z Execution Analysis: (:1) 2025-03-14T06:00:23.9433344Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9433548Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9433552Z 2025-03-14T06:00:23.9433773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9433891Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9434138Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9434251Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9434451Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9434598Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9434740Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9434914Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9435489Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9436055Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9436404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9436756Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9437062Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9437337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9437635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9437906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9438013Z Execution Analysis: .......... 2025-03-14T06:00:23.9438269Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9438469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9438758Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1307 counts during 1245 steps 2025-03-14T06:00:23.9438762Z 2025-03-14T06:00:23.9438960Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9439081Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9439529Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9439645Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9439876Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9440027Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9440196Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9440374Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9440732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9441090Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9441398Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9441682Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9441986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9442263Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9442556Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9442690Z Execution Analysis: (:1) 2025-03-14T06:00:23.9442949Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9443187Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9443191Z 2025-03-14T06:00:23.9443402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9443539Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9443783Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9443891Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9444100Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9444245Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9444389Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9444647Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9445250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9445824Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9446193Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9446545Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9446870Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9447142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9447461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9447730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9447846Z Execution Analysis: .......... 2025-03-14T06:00:23.9448108Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9448316Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9448606Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1308 counts during 1246 steps 2025-03-14T06:00:23.9448612Z 2025-03-14T06:00:23.9448823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9448933Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9449232Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9449377Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9449592Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9449761Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9449917Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9450081Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9450449Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9450803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9451122Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9451397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9451711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9451982Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9452285Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9452411Z Execution Analysis: (:1) 2025-03-14T06:00:23.9452698Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9452899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9452903Z 2025-03-14T06:00:23.9453134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9453249Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9453487Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9453597Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9453811Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9453958Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9454110Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9454280Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9454881Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9455452Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9455821Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9456172Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9456495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9456770Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9457194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9457455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9457573Z Execution Analysis: .......... 2025-03-14T06:00:23.9457824Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9458032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9458313Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1309 counts during 1247 steps 2025-03-14T06:00:23.9458318Z 2025-03-14T06:00:23.9458521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9458629Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9458961Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9459072Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9459308Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9459449Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9459604Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9459773Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9460136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9460484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9460803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9461072Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9461383Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9461661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9461953Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9462086Z Execution Analysis: (:1) 2025-03-14T06:00:23.9462360Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9462592Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9462597Z 2025-03-14T06:00:23.9462795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9462919Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9463145Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9463268Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9463469Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9463624Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9463768Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9463944Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9464524Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9465095Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9465571Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9466097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9466410Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9466696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9467006Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9467292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9467402Z Execution Analysis: .......... 2025-03-14T06:00:23.9467669Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9467874Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9468179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1310 counts during 1248 steps 2025-03-14T06:00:23.9468185Z 2025-03-14T06:00:23.9468388Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9468565Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9468857Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9469016Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9469224Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9469382Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9469522Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9469704Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9470065Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9470429Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9470743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9471030Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9471336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9471616Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9471938Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9472076Z Execution Analysis: (:1) 2025-03-14T06:00:23.9472335Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9472575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9472580Z 2025-03-14T06:00:23.9472781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9472906Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9473144Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9473264Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9473471Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9473630Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9473780Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9473958Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9474548Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9475126Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9475486Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9475849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9476165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9476449Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9476764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9477045Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9477151Z Execution Analysis: .......... 2025-03-14T06:00:23.9477426Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9477628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9477934Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1311 counts during 1249 steps 2025-03-14T06:00:23.9477964Z 2025-03-14T06:00:23.9478179Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9478295Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9478644Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9478763Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9478994Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9479156Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9479308Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9479494Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9479861Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9480227Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9480544Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9480831Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9481141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9481423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9481737Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9481874Z Execution Analysis: (:1) 2025-03-14T06:00:23.9482157Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9482373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9482377Z 2025-03-14T06:00:23.9482579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9482707Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9482937Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9483062Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9483264Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9483416Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9483563Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9483742Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9484336Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9484993Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9485352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9485719Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9486032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9486318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9486630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9486909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9487017Z Execution Analysis: .......... 2025-03-14T06:00:23.9487291Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9487492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9487796Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1312 counts during 1250 steps 2025-03-14T06:00:23.9487833Z 2025-03-14T06:00:23.9488034Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9488186Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9488472Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9488601Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9488803Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9488962Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9489103Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9489284Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9489644Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9490008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9490322Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9490609Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9490913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9491219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9491523Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9491686Z Execution Analysis: (:1) 2025-03-14T06:00:23.9491956Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9492158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9492162Z 2025-03-14T06:00:23.9492374Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9492488Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9492733Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9492845Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9493065Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9493207Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9493366Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9493538Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9494140Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9494714Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9495088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9495444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9495770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9496045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9496369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9496641Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9496761Z Execution Analysis: .......... 2025-03-14T06:00:23.9497126Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9497334Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9497642Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1313 counts during 1251 steps 2025-03-14T06:00:23.9497670Z 2025-03-14T06:00:23.9497877Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9497988Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9498281Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9498387Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9498596Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9498735Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9498886Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9499048Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9499407Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9499749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9500066Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9500333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9500667Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9500933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9501254Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9501376Z Execution Analysis: (:1) 2025-03-14T06:00:23.9501644Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9501843Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9501850Z 2025-03-14T06:00:23.9502062Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9502174Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9502412Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9502523Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9502734Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9502876Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9503033Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9503197Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9503784Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9504341Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9504705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9505053Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9505378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9505647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9505963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9506226Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9506346Z Execution Analysis: .......... 2025-03-14T06:00:23.9506597Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9506833Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9507144Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1314 counts during 1252 steps 2025-03-14T06:00:23.9507157Z 2025-03-14T06:00:23.9507462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9507586Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9507859Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9507976Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9508168Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9508315Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9508450Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9508622Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9508960Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9509300Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9509593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9509880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9510168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9510458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9510730Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9510858Z Execution Analysis: (:1) 2025-03-14T06:00:23.9511096Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9511292Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9511298Z 2025-03-14T06:00:23.9511484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9511600Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9511813Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9511924Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9512108Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9512254Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9512390Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9512554Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9513098Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9513643Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9513976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9514318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9514607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9514871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9515156Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9515415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9515511Z Execution Analysis: .......... 2025-03-14T06:00:23.9515785Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9515968Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9516272Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1315 counts during 1253 steps 2025-03-14T06:00:23.9516276Z 2025-03-14T06:00:23.9516462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9516580Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9516849Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9516966Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9517156Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9517303Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9517436Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9517606Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9517938Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9518276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9519008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9519292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9519618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9519892Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9520176Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9520310Z Execution Analysis: (:1) 2025-03-14T06:00:23.9520561Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9520770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9520776Z 2025-03-14T06:00:23.9520972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9521097Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9521321Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9521444Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9521644Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9521798Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9521942Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9522119Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9522693Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9523265Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9523618Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9523971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9524293Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9524632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9525112Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9525385Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9525545Z Execution Analysis: .......... 2025-03-14T06:00:23.9525805Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9526050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9526344Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1316 counts during 1254 steps 2025-03-14T06:00:23.9526349Z 2025-03-14T06:00:23.9526562Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9526679Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9526981Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9527095Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9527311Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9527458Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9527618Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9527789Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9528158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9528548Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9528872Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9529171Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9529490Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9529758Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9530061Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9530190Z Execution Analysis: (:1) 2025-03-14T06:00:23.9530459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9530666Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9530671Z 2025-03-14T06:00:23.9530881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9530996Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9531245Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9531355Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9531570Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9531713Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9531869Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9532037Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9532640Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9533217Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9533591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9533947Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9534274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9534550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9534869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9535163Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9535279Z Execution Analysis: .......... 2025-03-14T06:00:23.9535562Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9535774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9536064Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1317 counts during 1255 steps 2025-03-14T06:00:23.9536069Z 2025-03-14T06:00:23.9536282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9536399Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9536698Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9536916Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9537126Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9537267Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9537416Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9537585Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9537946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9538309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9538622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9538982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9539293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9539556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9539855Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9539979Z Execution Analysis: (:1) 2025-03-14T06:00:23.9540243Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9540441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9540456Z 2025-03-14T06:00:23.9540650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9540763Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9540999Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9541108Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9541319Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9541460Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9541618Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9541783Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9542364Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9542935Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9543286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9543645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9543953Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9544233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9544560Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9544835Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9544966Z Execution Analysis: .......... 2025-03-14T06:00:23.9545401Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9545608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9545917Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1318 counts during 1256 steps 2025-03-14T06:00:23.9545924Z 2025-03-14T06:00:23.9546130Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9546261Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9546554Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9546684Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9546891Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9547049Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9547199Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9547382Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9547768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9548132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9548471Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9548759Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9549072Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9549359Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9549656Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9549798Z Execution Analysis: (:1) 2025-03-14T06:00:23.9550058Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9550280Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9550284Z 2025-03-14T06:00:23.9550493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9550626Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9550860Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9550984Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9551189Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9551349Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9551501Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9551688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9552283Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9552973Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9553330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9553690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9554000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9554299Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9554598Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9554897Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9555002Z Execution Analysis: .......... 2025-03-14T06:00:23.9555268Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9555467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9555758Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1319 counts during 1257 steps 2025-03-14T06:00:23.9555763Z 2025-03-14T06:00:23.9555961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9556090Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9556374Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9556492Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9556691Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9556845Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9556986Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9557297Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9557632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9557991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9558283Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9558550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9558839Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9559102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9559374Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9559503Z Execution Analysis: (:1) 2025-03-14T06:00:23.9559743Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9559943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9559947Z 2025-03-14T06:00:23.9560149Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9560256Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9560483Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9560588Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9560789Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9560924Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9561070Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9561229Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9561786Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9562319Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9562662Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9562987Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9563287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9563568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9563902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9564155Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9564268Z Execution Analysis: .......... 2025-03-14T06:00:23.9564591Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9564799Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9565250Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1320 counts during 1258 steps 2025-03-14T06:00:23.9565255Z 2025-03-14T06:00:23.9565610Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9565732Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9566035Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9566151Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9566372Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9566521Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9566738Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9566912Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9567327Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9567684Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9568009Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9568287Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9568609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9568882Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9569185Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9569315Z Execution Analysis: (:1) 2025-03-14T06:00:23.9569586Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9569792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9569796Z 2025-03-14T06:00:23.9570008Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9570131Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9570379Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9570493Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9570709Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9570858Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9571018Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9571189Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9571795Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9572373Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9572745Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9573098Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9573457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9573765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9574084Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9574357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9574472Z Execution Analysis: .......... 2025-03-14T06:00:23.9574733Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9574944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9575237Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1321 counts during 1259 steps 2025-03-14T06:00:23.9575252Z 2025-03-14T06:00:23.9575454Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9575582Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9575875Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9576001Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9576206Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9576376Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9576531Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9576703Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9577102Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9577457Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9577783Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9578070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9578384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9578667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9578962Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9579098Z Execution Analysis: (:1) 2025-03-14T06:00:23.9579362Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9579689Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9579693Z 2025-03-14T06:00:23.9579890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9580014Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9580240Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9580365Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9580567Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9580724Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9580870Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9581050Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9581631Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9582201Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9582553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9583040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9583332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9583624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9583912Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9584175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9584279Z Execution Analysis: .......... 2025-03-14T06:00:23.9584528Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9589214Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9589537Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1322 counts during 1260 steps 2025-03-14T06:00:23.9589551Z 2025-03-14T06:00:23.9589747Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9589869Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9590141Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9590255Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9590514Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9590658Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9590822Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9590991Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9591325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9591661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9591958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9592222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9592510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9592771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9593040Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9593165Z Execution Analysis: (:1) 2025-03-14T06:00:23.9593409Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9593604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9593608Z 2025-03-14T06:00:23.9593795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9593912Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9594124Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9594236Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9594422Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9594564Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9594699Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9594858Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9595414Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9596116Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9596495Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9596847Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9597179Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9597458Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9597755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9598027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9598131Z Execution Analysis: .......... 2025-03-14T06:00:23.9598393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9598589Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9598885Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1323 counts during 1261 steps 2025-03-14T06:00:23.9598890Z 2025-03-14T06:00:23.9599088Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9599207Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9599519Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9599633Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9599828Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9599996Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9600132Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9600302Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9600645Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9600998Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9601297Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9601572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9601870Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9602137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9602430Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9602547Z Execution Analysis: (:1) 2025-03-14T06:00:23.9602802Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9602995Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9603001Z 2025-03-14T06:00:23.9603203Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9603314Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9603540Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9603646Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9603847Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9603983Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9604129Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9604290Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9605163Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9605737Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9606148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9606523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9606840Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9607114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9607430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9607698Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9607811Z Execution Analysis: .......... 2025-03-14T06:00:23.9608070Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9608278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9608565Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1324 counts during 1262 steps 2025-03-14T06:00:23.9608572Z 2025-03-14T06:00:23.9608778Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9608926Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9609224Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9609333Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9609568Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9609710Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9609851Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9610016Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9610375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9610725Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9611044Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9611317Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9611629Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9611896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9612193Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9612317Z Execution Analysis: (:1) 2025-03-14T06:00:23.9612579Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9612782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9612789Z 2025-03-14T06:00:23.9612994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9613110Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9613347Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9613458Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9613704Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9613851Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9614022Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9614203Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9614816Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9615435Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9615858Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9616231Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9616548Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9616826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9617138Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9617415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9617519Z Execution Analysis: .......... 2025-03-14T06:00:23.9617781Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9617983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9618283Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1326 counts during 1263 steps 2025-03-14T06:00:23.9618287Z 2025-03-14T06:00:23.9618512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9618631Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9618924Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9619067Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9619269Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9619421Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9619561Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9619732Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9620087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9620440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9620749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9621026Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9621336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9621605Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9621903Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9622023Z Execution Analysis: (:1) 2025-03-14T06:00:23.9622284Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9622486Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9622493Z 2025-03-14T06:00:23.9622696Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9622806Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9623043Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9623152Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9623360Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9623500Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9623648Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9623810Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9624410Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9625007Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9625395Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9625747Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9626064Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9626339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9626654Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9626922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9627035Z Execution Analysis: .......... 2025-03-14T06:00:23.9627290Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9627495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9627787Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1327 counts during 1264 steps 2025-03-14T06:00:23.9627817Z 2025-03-14T06:00:23.9628033Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9628150Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9628477Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9628590Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9628808Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9629063Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9629219Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9629387Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9629746Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9630094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9630416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9630685Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9631003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9631439Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9631749Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9631877Z Execution Analysis: (:1) 2025-03-14T06:00:23.9632157Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9632366Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9632370Z 2025-03-14T06:00:23.9632588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9632707Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9632954Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9633073Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9633296Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9633443Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9633606Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9633777Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9634411Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9635017Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9635396Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9635754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9636087Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9636367Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9636696Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9636969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9637095Z Execution Analysis: .......... 2025-03-14T06:00:23.9637359Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9637583Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9637921Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1328 counts during 1265 steps 2025-03-14T06:00:23.9637926Z 2025-03-14T06:00:23.9638131Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9638295Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9638591Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9638722Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9638931Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9639093Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9639240Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9639425Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9639787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9640157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9640478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9640774Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9641088Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9641375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9641673Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9641815Z Execution Analysis: (:1) 2025-03-14T06:00:23.9642075Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9642292Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9642296Z 2025-03-14T06:00:23.9642501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9642625Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9642982Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9643101Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9643300Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9643450Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9643594Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9643797Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9644374Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9645245Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9645609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9645974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9646291Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9646584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9646895Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9647180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9647290Z Execution Analysis: .......... 2025-03-14T06:00:23.9647562Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9647795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9648105Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1329 counts during 1266 steps 2025-03-14T06:00:23.9648110Z 2025-03-14T06:00:23.9648343Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9648471Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9648764Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9648894Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9649102Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9649262Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9649409Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9649590Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9649954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9650317Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9650633Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9650921Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9651231Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9651512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9651811Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9651952Z Execution Analysis: (:1) 2025-03-14T06:00:23.9652214Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9652433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9652438Z 2025-03-14T06:00:23.9652642Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9652773Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9653008Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9653134Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9653341Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9653501Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9653677Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9653859Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9654481Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9655071Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9655436Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9655803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9656131Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9656408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9656736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9657010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9657236Z Execution Analysis: .......... 2025-03-14T06:00:23.9657501Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9657702Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9657994Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1330 counts during 1267 steps 2025-03-14T06:00:23.9657999Z 2025-03-14T06:00:23.9658200Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9658308Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9658589Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9658696Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9658897Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9659035Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9659180Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9659337Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9659677Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9660004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9660306Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9660564Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9660861Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9661116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9661402Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9661523Z Execution Analysis: (:1) 2025-03-14T06:00:23.9661776Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9661969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9661973Z 2025-03-14T06:00:23.9662173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9662280Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9662507Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9662610Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9662812Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9662972Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9663121Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9663303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9663862Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9664395Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9664742Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9665069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9665505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9665941Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9666342Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9666615Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9666735Z Execution Analysis: .......... 2025-03-14T06:00:23.9667054Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9667305Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9667601Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1331 counts during 1268 steps 2025-03-14T06:00:23.9667606Z 2025-03-14T06:00:23.9667823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9667943Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9668251Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9668366Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9668587Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9668735Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9668891Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9669065Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9669441Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9669798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9670125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9670402Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9670723Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9670994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9671306Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9671432Z Execution Analysis: (:1) 2025-03-14T06:00:23.9671709Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9671914Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9671929Z 2025-03-14T06:00:23.9672133Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9672261Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9672497Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9672645Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9672864Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9673012Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9673207Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9673376Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9673984Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9674570Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9674930Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9675287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9675604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9675883Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9676197Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9676519Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9676628Z Execution Analysis: .......... 2025-03-14T06:00:23.9676891Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9677118Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9677420Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1332 counts during 1269 steps 2025-03-14T06:00:23.9677425Z 2025-03-14T06:00:23.9677632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9677756Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9678048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9678162Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9678366Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9678519Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9678661Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9678835Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9679196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9679553Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9679866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9680150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9680460Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9680738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9681034Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9681166Z Execution Analysis: (:1) 2025-03-14T06:00:23.9681424Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9681633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9681637Z 2025-03-14T06:00:23.9681839Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9681961Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9682218Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9682336Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9682542Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9682727Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9682874Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9683056Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9683645Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9684227Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9684655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9685017Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9685334Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9685620Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9685958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9686236Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9686341Z Execution Analysis: .......... 2025-03-14T06:00:23.9686634Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9686838Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9687134Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1333 counts during 1270 steps 2025-03-14T06:00:23.9687141Z 2025-03-14T06:00:23.9687343Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9687465Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9687757Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9687874Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9688081Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9688228Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9688369Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9688546Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9688902Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9689257Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9689567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9689854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9690165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9690441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9690736Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9690867Z Execution Analysis: (:1) 2025-03-14T06:00:23.9691123Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9691332Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9691336Z 2025-03-14T06:00:23.9691541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9691682Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9691914Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9692047Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9692257Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9692397Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9692554Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9692722Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9693316Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9693891Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9694255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9694611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9694933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9695229Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9695666Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9695952Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9696098Z Execution Analysis: .......... 2025-03-14T06:00:23.9696358Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9696572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9696866Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1334 counts during 1271 steps 2025-03-14T06:00:23.9696879Z 2025-03-14T06:00:23.9697079Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9697196Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9697501Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9697615Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9697824Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9697967Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9698119Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9698287Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9698653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9699007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9699334Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9699626Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9699935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9700220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9700516Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9700652Z Execution Analysis: (:1) 2025-03-14T06:00:23.9700912Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9701122Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9701126Z 2025-03-14T06:00:23.9701354Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9701477Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9701735Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9701850Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9702052Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9702205Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9702352Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9702535Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9703125Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9703710Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9704065Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9704427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9704737Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9705050Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9705354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9705660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9705770Z Execution Analysis: .......... 2025-03-14T06:00:23.9706039Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9706235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9706544Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1335 counts during 1272 steps 2025-03-14T06:00:23.9706550Z 2025-03-14T06:00:23.9706751Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9706872Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9707164Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9707284Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9707486Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9707641Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9707780Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9707957Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9708311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9708674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9708989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9709273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9709586Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9709863Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9710155Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9710289Z Execution Analysis: (:1) 2025-03-14T06:00:23.9710546Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9710754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9710784Z 2025-03-14T06:00:23.9710982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9711139Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9711368Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9711484Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9711688Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9711839Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9711986Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9712164Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9712749Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9713331Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9713692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9714056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9714401Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9714677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9715017Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9715397Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9715513Z Execution Analysis: .......... 2025-03-14T06:00:23.9715768Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9715981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9716267Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1336 counts during 1273 steps 2025-03-14T06:00:23.9716273Z 2025-03-14T06:00:23.9716478Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9716591Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9716888Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9716998Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9717208Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9717350Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9717497Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9717662Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9718021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9718359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9718677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9718944Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9719260Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9719522Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9719816Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9719936Z Execution Analysis: (:1) 2025-03-14T06:00:23.9720197Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9720417Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9720421Z 2025-03-14T06:00:23.9720648Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9720757Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9720993Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9721097Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9721307Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9721444Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9721598Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9721761Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9722346Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9722902Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9723264Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9723630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9723945Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9724233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9724625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9725052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9725172Z Execution Analysis: .......... 2025-03-14T06:00:23.9725434Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9725643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9725937Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1337 counts during 1274 steps 2025-03-14T06:00:23.9725941Z 2025-03-14T06:00:23.9726149Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9726261Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9726560Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9726669Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9726881Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9727023Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9727172Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9727342Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9727707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9728056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9728377Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9728653Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9728969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9729239Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9729539Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9729664Z Execution Analysis: (:1) 2025-03-14T06:00:23.9729963Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9730163Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9730200Z 2025-03-14T06:00:23.9730400Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9730514Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9730753Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9730863Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9731076Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9731219Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9731374Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9731540Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9732140Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9732723Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9733104Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9733466Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9733802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9734085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9734391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9734666Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9734771Z Execution Analysis: .......... 2025-03-14T06:00:23.9735036Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9735239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9735541Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1338 counts during 1275 steps 2025-03-14T06:00:23.9735545Z 2025-03-14T06:00:23.9735745Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9735869Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9736158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9736276Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9736486Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9736641Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9736785Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9736961Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9737423Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9737772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9738079Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9738357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9738655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9738923Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9739208Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9739364Z Execution Analysis: (:1) 2025-03-14T06:00:23.9739614Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9739845Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9739849Z 2025-03-14T06:00:23.9740047Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9740164Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9740386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9740506Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9740703Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9740850Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9740991Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9741163Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9741740Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9742305Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9742681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9743031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9743359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9743637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9743942Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9744215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9744317Z Execution Analysis: .......... 2025-03-14T06:00:23.9744576Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9744777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9745065Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1339 counts during 1276 steps 2025-03-14T06:00:23.9745071Z 2025-03-14T06:00:23.9745266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9745385Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9745669Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9745786Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9745985Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9746135Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9746273Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9746444Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9746794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9747147Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9747452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9747728Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9748028Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9748302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9748624Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9748913Z Execution Analysis: (:1) 2025-03-14T06:00:23.9749195Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9749403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9749409Z 2025-03-14T06:00:23.9749618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9749730Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9749975Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9750084Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9750294Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9750436Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9750594Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9750760Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9751361Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9751964Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9752331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9752704Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9753024Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9753296Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9753616Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9753886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9754002Z Execution Analysis: .......... 2025-03-14T06:00:23.9754261Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9754470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9754756Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1340 counts during 1277 steps 2025-03-14T06:00:23.9754763Z 2025-03-14T06:00:23.9754973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9755086Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9755384Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9755497Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9755708Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9755852Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9756001Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9756167Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9756534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9756884Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9757215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9757492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9757811Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9758081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9758409Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9758561Z Execution Analysis: (:1) 2025-03-14T06:00:23.9758830Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9759037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9759041Z 2025-03-14T06:00:23.9759258Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9759375Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9759617Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9759730Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9759945Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9760092Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9760249Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9760421Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9761020Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9761632Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9762025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9762381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9762706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9762983Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9763307Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9763584Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9763699Z Execution Analysis: .......... 2025-03-14T06:00:23.9763961Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9764178Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9764552Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1341 counts during 1278 steps 2025-03-14T06:00:23.9764575Z 2025-03-14T06:00:23.9764782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9764913Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9765207Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9765446Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9765650Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9765801Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9765954Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9766126Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9766493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9766848Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9767174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9767458Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9767765Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9768105Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9768814Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9768952Z Execution Analysis: (:1) 2025-03-14T06:00:23.9769211Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9769427Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9769431Z 2025-03-14T06:00:23.9769633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9769757Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9769987Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9770106Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9770311Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9770460Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9770609Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9770786Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9771408Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9772031Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9772392Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9772755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9773068Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9773354Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9773664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9773940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9774047Z Execution Analysis: .......... 2025-03-14T06:00:23.9774315Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9774518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9774821Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1342 counts during 1279 steps 2025-03-14T06:00:23.9774826Z 2025-03-14T06:00:23.9775027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9775155Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9775446Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9775570Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9775775Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9775929Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9776073Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9776251Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9776612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9776969Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9777282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9777562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9777899Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9778205Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9778497Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9778633Z Execution Analysis: (:1) 2025-03-14T06:00:23.9778892Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9779105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9779110Z 2025-03-14T06:00:23.9779311Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9779438Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9779774Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9779899Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9780098Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9780251Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9780394Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9780565Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9781165Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9781946Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9782308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9782668Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9782983Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9783268Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9783580Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9783861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9783972Z Execution Analysis: .......... 2025-03-14T06:00:23.9784244Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9784463Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9784753Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1343 counts during 1280 steps 2025-03-14T06:00:23.9784759Z 2025-03-14T06:00:23.9784973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9785088Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9785391Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9785503Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9785715Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9785860Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9786012Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9786178Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9786551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9786901Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9787225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9787526Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9787846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9788143Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9788451Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9788576Z Execution Analysis: (:1) 2025-03-14T06:00:23.9788848Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9789048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9789052Z 2025-03-14T06:00:23.9789264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9789379Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9789620Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9789732Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9789946Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9790088Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9790270Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9790439Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9791065Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9791642Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9792011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9792364Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9792688Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9792966Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9793284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9793556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9793674Z Execution Analysis: .......... 2025-03-14T06:00:23.9793937Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9794150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9794442Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1344 counts during 1281 steps 2025-03-14T06:00:23.9794448Z 2025-03-14T06:00:23.9794661Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9794780Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9795081Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9795192Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9795410Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9795554Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9795710Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9795880Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9796245Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9796598Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9796949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9797225Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9797568Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9797839Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9798141Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9798265Z Execution Analysis: (:1) 2025-03-14T06:00:23.9798534Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9798736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9798740Z 2025-03-14T06:00:23.9798950Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9799066Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9799304Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9799416Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9799631Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9799798Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9799956Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9800125Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9800750Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9801325Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9801695Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9802063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9802378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9802667Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9802975Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9803266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9803373Z Execution Analysis: .......... 2025-03-14T06:00:23.9803647Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9803852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9804166Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1345 counts during 1282 steps 2025-03-14T06:00:23.9804171Z 2025-03-14T06:00:23.9804375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9804602Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9804901Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9805026Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9805232Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9805390Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9805534Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9805725Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9806083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9806451Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9806797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9807107Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9807423Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9807705Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9808001Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9808140Z Execution Analysis: (:1) 2025-03-14T06:00:23.9808400Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9808614Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9808621Z 2025-03-14T06:00:23.9808825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9808950Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9809182Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9809301Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9809529Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9809688Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9809836Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9810036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9810632Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9811216Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9811577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9811938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9812255Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9812543Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9812851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9813132Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9813238Z Execution Analysis: .......... 2025-03-14T06:00:23.9813502Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9813702Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9814004Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1347 counts during 1283 steps 2025-03-14T06:00:23.9814010Z 2025-03-14T06:00:23.9814212Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9814335Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9814627Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9814746Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9814952Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9815105Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9815251Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9815427Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9815784Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9816173Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9816512Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9816902Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9817203Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9817473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9817760Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9817891Z Execution Analysis: (:1) 2025-03-14T06:00:23.9818141Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9818350Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9818356Z 2025-03-14T06:00:23.9818564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9818676Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9818907Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9819050Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9819252Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9819398Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9819561Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9819736Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9820312Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9820878Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9821238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9821582Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9821901Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9822169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9822482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9822746Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9822864Z Execution Analysis: .......... 2025-03-14T06:00:23.9823116Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9823326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9823609Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1348 counts during 1284 steps 2025-03-14T06:00:23.9823614Z 2025-03-14T06:00:23.9823821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9823934Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9824229Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9824339Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9824548Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9824689Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9824838Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9825003Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9825386Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9825749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9826068Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9826337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9826647Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9826913Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9827204Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9827326Z Execution Analysis: (:1) 2025-03-14T06:00:23.9827585Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9827782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9827787Z 2025-03-14T06:00:23.9827993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9828103Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9828363Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9828472Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9828678Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9828838Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9828994Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9829157Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9829737Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9830296Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9830656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9831001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9831313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9831584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9831894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9832159Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9832272Z Execution Analysis: .......... 2025-03-14T06:00:23.9832527Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9832734Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9833021Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1349 counts during 1285 steps 2025-03-14T06:00:23.9833026Z 2025-03-14T06:00:23.9833232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9833348Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9833641Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9833751Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9833959Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9834099Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9834246Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9834437Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9834794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9835161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9835480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9835750Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9836062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9836337Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9836623Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9836756Z Execution Analysis: (:1) 2025-03-14T06:00:23.9837007Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9837221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9837225Z 2025-03-14T06:00:23.9837446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9837570Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9837796Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9837913Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9838132Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9838284Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9838428Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9838604Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9839177Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9839745Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9840099Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9840450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9840759Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9841036Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9841336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9841607Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9841711Z Execution Analysis: .......... 2025-03-14T06:00:23.9841969Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9842167Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9842463Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1350 counts during 1286 steps 2025-03-14T06:00:23.9842469Z 2025-03-14T06:00:23.9842665Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9842786Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9843070Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9843184Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9843383Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9843567Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9843705Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9843883Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9844333Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9844757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9845233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9845525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9845850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9846134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9846426Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9846567Z Execution Analysis: (:1) 2025-03-14T06:00:23.9846827Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9847046Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9847051Z 2025-03-14T06:00:23.9847281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9847411Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9847669Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9847796Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9848003Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9848159Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9848308Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9848492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9849083Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9849675Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9850037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9850402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9850720Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9851008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9851319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9851607Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9851716Z Execution Analysis: .......... 2025-03-14T06:00:23.9851988Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9852196Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9852502Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1351 counts during 1287 steps 2025-03-14T06:00:23.9852507Z 2025-03-14T06:00:23.9852724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9852841Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9853149Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9853263Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9853506Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9853655Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9853862Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9854033Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9854422Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9854800Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9855133Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9855433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9855741Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9856024Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9856318Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9856460Z Execution Analysis: (:1) 2025-03-14T06:00:23.9856721Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9856972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9856976Z 2025-03-14T06:00:23.9857201Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9857346Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9857600Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9857735Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9857947Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9858106Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9858272Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9858439Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9859050Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9859627Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9859989Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9860350Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9860664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9860946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9861257Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9861539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9861649Z Execution Analysis: .......... 2025-03-14T06:00:23.9861917Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9862119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9862425Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1352 counts during 1288 steps 2025-03-14T06:00:23.9862431Z 2025-03-14T06:00:23.9862636Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9862763Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9863052Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9863202Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9863408Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9863585Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9863731Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9863913Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9864278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9864642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9864957Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9865243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9865676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9865964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9866260Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9866399Z Execution Analysis: (:1) 2025-03-14T06:00:23.9866710Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9866930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9866934Z 2025-03-14T06:00:23.9867170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9867300Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9867532Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9867658Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9867867Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9868026Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9868176Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9868356Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9868950Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9869536Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9869900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9870261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9870579Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9870868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9871179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9871461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9871568Z Execution Analysis: .......... 2025-03-14T06:00:23.9871836Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9872040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9872342Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1353 counts during 1289 steps 2025-03-14T06:00:23.9872346Z 2025-03-14T06:00:23.9872548Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9872674Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9872998Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9873120Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9873356Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9873513Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9873656Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9873838Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9874198Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9874562Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9874874Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9875156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9875474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9875744Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9876050Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9876180Z Execution Analysis: (:1) 2025-03-14T06:00:23.9876475Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9876684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9876712Z 2025-03-14T06:00:23.9876930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9877048Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9877288Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9877402Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9877621Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9877769Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9878037Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9878204Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9878790Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9879349Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9879713Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9880059Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9880381Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9880652Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9880963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9881232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9881457Z Execution Analysis: .......... 2025-03-14T06:00:23.9881699Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9881899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9882172Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1354 counts during 1290 steps 2025-03-14T06:00:23.9882177Z 2025-03-14T06:00:23.9882375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9882510Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9882787Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9882913Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9883112Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9883250Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9883391Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9883548Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9883891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9884219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9884583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9884844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9885329Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9885605Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9885911Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9886067Z Execution Analysis: (:1) 2025-03-14T06:00:23.9886341Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9886570Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9886575Z 2025-03-14T06:00:23.9886788Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9886907Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9887152Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9887266Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9887486Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9887635Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9887795Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9887973Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9888577Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9889154Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9889532Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9889886Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9890217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9890498Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9890821Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9891096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9891216Z Execution Analysis: .......... 2025-03-14T06:00:23.9891478Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9891695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9891987Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1355 counts during 1291 steps 2025-03-14T06:00:23.9892005Z 2025-03-14T06:00:23.9892251Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9892376Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9892694Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9892815Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9893023Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9893183Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9893327Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9893510Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9893871Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9894239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9894556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9894844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9895160Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9895444Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9895762Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9895902Z Execution Analysis: (:1) 2025-03-14T06:00:23.9896184Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9896394Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9896398Z 2025-03-14T06:00:23.9896603Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9896734Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9896964Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9897192Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9897390Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9897540Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9897687Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9897861Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9898442Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9899010Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9899359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9899712Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9900021Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9900303Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9900608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9900884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9900991Z Execution Analysis: .......... 2025-03-14T06:00:23.9901253Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9901451Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9901743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1356 counts during 1292 steps 2025-03-14T06:00:23.9901771Z 2025-03-14T06:00:23.9901970Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9902114Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9902403Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9902528Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9902727Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9902881Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9903023Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9903198Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9903550Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9903905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9904217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9904496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9904796Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9905095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9905381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9905536Z Execution Analysis: (:1) 2025-03-14T06:00:23.9905791Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9905997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9906002Z 2025-03-14T06:00:23.9906198Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9906322Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9906550Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9906668Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9906867Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9907019Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9907165Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9907342Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9907917Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9908582Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9908922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9909261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9909567Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9909824Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9910123Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9910375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9910487Z Execution Analysis: .......... 2025-03-14T06:00:23.9910726Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9910922Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9911215Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1357 counts during 1293 steps 2025-03-14T06:00:23.9911243Z 2025-03-14T06:00:23.9911440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9911547Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9911829Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9911934Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9912135Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9912270Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9912412Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9912567Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9912908Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9913237Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9913538Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9913794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9914135Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9914387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9914699Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9914820Z Execution Analysis: (:1) 2025-03-14T06:00:23.9915073Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9915263Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9915269Z 2025-03-14T06:00:23.9915468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9915580Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9915803Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9915906Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9916109Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9916241Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9916389Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9916547Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9917100Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9917630Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9917976Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9918304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9918604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9918860Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9919159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9919410Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9919516Z Execution Analysis: .......... 2025-03-14T06:00:23.9919757Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9919977Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9920249Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1358 counts during 1294 steps 2025-03-14T06:00:23.9920278Z 2025-03-14T06:00:23.9920475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9920586Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9920865Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9920971Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9921170Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9921306Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9921450Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9921610Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9921952Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9922282Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9922579Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9922857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9923155Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9923442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9923728Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9923847Z Execution Analysis: (:1) 2025-03-14T06:00:23.9924099Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9924293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9924306Z 2025-03-14T06:00:23.9924579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9924687Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9925078Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9925190Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9925406Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9925552Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9925707Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9925875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9926479Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9927065Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9927431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9927797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9928114Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9928407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9928719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9929001Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9929109Z Execution Analysis: .......... 2025-03-14T06:00:23.9929413Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9929618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9929949Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1359 counts during 1295 steps 2025-03-14T06:00:23.9929953Z 2025-03-14T06:00:23.9930164Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9930297Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9930591Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9930719Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9930925Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9931085Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9931231Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9931413Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9931774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9932142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9932480Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9932769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9933105Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9933391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9933688Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9933824Z Execution Analysis: (:1) 2025-03-14T06:00:23.9934087Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9934306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9934312Z 2025-03-14T06:00:23.9934515Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9934650Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9934882Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9935008Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9935217Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9935377Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9935527Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9935711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9936303Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9936893Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9937259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9937629Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9937947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9938238Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9938551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9938833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9938968Z Execution Analysis: .......... 2025-03-14T06:00:23.9939240Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9939470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9939775Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1360 counts during 1296 steps 2025-03-14T06:00:23.9939780Z 2025-03-14T06:00:23.9939982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9940106Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9940398Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9940521Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9940727Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9940881Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9941026Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9941208Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9941571Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9941937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9942276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9942561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9942924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9943312Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9943599Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9943734Z Execution Analysis: (:1) 2025-03-14T06:00:23.9943989Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9944199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9944203Z 2025-03-14T06:00:23.9944412Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9944524Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9944761Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9944874Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9945089Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9945230Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9945387Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9945551Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9946145Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9946708Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9947071Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9947415Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9947735Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9948004Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9948318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9948610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9948724Z Execution Analysis: .......... 2025-03-14T06:00:23.9949004Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9949213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9949502Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1361 counts during 1297 steps 2025-03-14T06:00:23.9949506Z 2025-03-14T06:00:23.9949717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9949832Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9950127Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9950237Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9950450Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9950595Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9950748Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9950918Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9951278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9951650Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9951969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9952262Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9952576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9952840Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9953140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9953264Z Execution Analysis: (:1) 2025-03-14T06:00:23.9953534Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9953731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9953736Z 2025-03-14T06:00:23.9953942Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9954059Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9954299Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9954407Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9954622Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9954872Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9955020Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9955179Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9955738Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9956273Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9956619Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9956951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9957255Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9957511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9957811Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9958091Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9958227Z Execution Analysis: .......... 2025-03-14T06:00:23.9958471Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9958672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9958944Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1362 counts during 1298 steps 2025-03-14T06:00:23.9958958Z 2025-03-14T06:00:23.9959148Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9959264Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9959532Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9959817Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9960017Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9960158Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9960309Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9960474Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9961048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9961406Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9961751Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9962038Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9962348Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9962630Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9962928Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9963068Z Execution Analysis: (:1) 2025-03-14T06:00:23.9963326Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9963542Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9963546Z 2025-03-14T06:00:23.9963752Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9963881Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9964112Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9964233Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9964439Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9964687Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9964835Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9965020Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9965764Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9966353Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9966718Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9967086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9967405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9967690Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9968065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9968383Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9968491Z Execution Analysis: .......... 2025-03-14T06:00:23.9968767Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9968971Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9969274Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1363 counts during 1299 steps 2025-03-14T06:00:23.9969279Z 2025-03-14T06:00:23.9974866Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9975036Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9975339Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9975467Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9975675Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9975828Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9975969Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9976239Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9976608Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9977009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9977324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9977612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9977923Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9978204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9978498Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9978634Z Execution Analysis: (:1) 2025-03-14T06:00:23.9978897Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9979105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9979111Z 2025-03-14T06:00:23.9979314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9979436Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9979667Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9979784Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9979991Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9980141Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9980287Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9980460Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9981061Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9981642Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9982003Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9982361Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9982784Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9983090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9983417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9983686Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9983789Z Execution Analysis: .......... 2025-03-14T06:00:23.9984050Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9984245Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9984538Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1364 counts during 1300 steps 2025-03-14T06:00:23.9984544Z 2025-03-14T06:00:23.9984736Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9984857Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9985139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9985257Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9985452Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9985598Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9985756Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9985928Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9986295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9986743Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9987031Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9987290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9987573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9987829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9988107Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9988222Z Execution Analysis: (:1) 2025-03-14T06:00:23.9988468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9988652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9988656Z 2025-03-14T06:00:23.9988849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9988951Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9989168Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9989269Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9989463Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9989594Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9989731Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9989881Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9990431Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:23.9990961Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:23.9991296Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:23.9991619Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9992109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9992398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9992703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9992966Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9993076Z Execution Analysis: .......... 2025-03-14T06:00:23.9993324Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9993527Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9993811Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1365 counts during 1301 steps 2025-03-14T06:00:23.9993816Z 2025-03-14T06:00:23.9994177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9994290Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9994584Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:23.9994694Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9994906Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:23.9995073Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:23.9995223Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:23.9995387Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:23.9995774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:23.9996124Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:23.9996442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:23.9996718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:23.9997033Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:23.9997304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:23.9997605Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:23.9997731Z Execution Analysis: (:1) 2025-03-14T06:00:23.9997996Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:23.9998193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9998198Z 2025-03-14T06:00:23.9998404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:23.9998515Z Execution Analysis: Execution Cause 2025-03-14T06:00:23.9998752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:23.9998860Z Execution Analysis: Graph Info: 2025-03-14T06:00:23.9999070Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:23.9999213Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:23.9999369Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:23.9999537Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0000138Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0000709Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0001074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0001525Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0001851Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0002163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0002486Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0002757Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0002869Z Execution Analysis: .......... 2025-03-14T06:00:24.0003129Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0003342Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0003633Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1366 counts during 1302 steps 2025-03-14T06:00:24.0003648Z 2025-03-14T06:00:24.0003847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0003973Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0004260Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0004375Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0004717Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0004868Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0005007Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0005204Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0005563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0005917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0006230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0006507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0006815Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0007090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0007377Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0007508Z Execution Analysis: (:1) 2025-03-14T06:00:24.0007766Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0007970Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0007974Z 2025-03-14T06:00:24.0008171Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0008287Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0008514Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0008627Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0008827Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0008972Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0009113Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0009285Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0009876Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0010455Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0010810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0011187Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0011519Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0011796Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0012099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0012369Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0012471Z Execution Analysis: .......... 2025-03-14T06:00:24.0012731Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0012929Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0013224Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1368 counts during 1303 steps 2025-03-14T06:00:24.0013229Z 2025-03-14T06:00:24.0013425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0013544Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0013854Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0013966Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0014165Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0014331Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0014475Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0014656Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0015015Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0015379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0015698Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0015989Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0016305Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0016590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0016888Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0017132Z Execution Analysis: (:1) 2025-03-14T06:00:24.0017375Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0017577Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0017583Z 2025-03-14T06:00:24.0017772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0017894Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0018113Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0018233Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0018426Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0018575Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0018714Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0018888Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0019440Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0020169Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0020903Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0021288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0021614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0021890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0022210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0022478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0022597Z Execution Analysis: .......... 2025-03-14T06:00:24.0022853Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0023067Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0023359Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1369 counts during 1304 steps 2025-03-14T06:00:24.0023366Z 2025-03-14T06:00:24.0023579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0023695Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0024021Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0024133Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0024369Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0024515Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0024666Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0024830Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0025195Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0025543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0025869Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0026140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0026462Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0026730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0027033Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0027161Z Execution Analysis: (:1) 2025-03-14T06:00:24.0027433Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0027633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0027639Z 2025-03-14T06:00:24.0027850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0027967Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0028205Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0028318Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0028531Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0028672Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0028832Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0028996Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0029588Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0030150Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0030561Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0030909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0031229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0031498Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0031916Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0032169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0032280Z Execution Analysis: .......... 2025-03-14T06:00:24.0032522Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0032721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0032993Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1370 counts during 1305 steps 2025-03-14T06:00:24.0032998Z 2025-03-14T06:00:24.0033223Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0033331Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0033613Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0033743Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0033946Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0034081Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0034226Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0034385Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0034733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0035062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0035367Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0035627Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0035925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0036179Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0036463Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0036580Z Execution Analysis: (:1) 2025-03-14T06:00:24.0036836Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0037028Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0037033Z 2025-03-14T06:00:24.0037234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0037342Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0037570Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0037678Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0037881Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0038017Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0038164Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0038323Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0038880Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0039634Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0040013Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0040371Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0040682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0040965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0041437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0041726Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0041837Z Execution Analysis: .......... 2025-03-14T06:00:24.0042115Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0042324Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0042628Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1371 counts during 1306 steps 2025-03-14T06:00:24.0042633Z 2025-03-14T06:00:24.0042860Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0043022Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0043338Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0043465Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0043669Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0043827Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0043972Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0044156Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0044609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0044983Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0045302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0045602Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0045956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0046267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0046596Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0046742Z Execution Analysis: (:1) 2025-03-14T06:00:24.0047018Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0047224Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0047230Z 2025-03-14T06:00:24.0047457Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0047585Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0047847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0047978Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0048203Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0048345Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0048503Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0048676Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0049327Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0049936Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0050314Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0050683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0051000Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0051288Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0051600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0051884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0051996Z Execution Analysis: .......... 2025-03-14T06:00:24.0052269Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0052474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0052805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1372 counts during 1307 steps 2025-03-14T06:00:24.0052811Z 2025-03-14T06:00:24.0053015Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0053166Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0053459Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0053587Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0053792Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0053949Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0054095Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0054280Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0054645Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0055012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0055326Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0055619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0055931Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0056219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0056515Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0056656Z Execution Analysis: (:1) 2025-03-14T06:00:24.0056918Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0057134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0057138Z 2025-03-14T06:00:24.0057343Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0057470Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0057707Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0057833Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0058043Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0058199Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0058348Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0058556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0059149Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0059761Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0060121Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0060486Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0060799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0061078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0061387Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0061664Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0061773Z Execution Analysis: .......... 2025-03-14T06:00:24.0062037Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0062270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0062567Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1373 counts during 1308 steps 2025-03-14T06:00:24.0062574Z 2025-03-14T06:00:24.0062799Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0062920Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0063208Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0063326Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0063528Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0063678Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0063818Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0063999Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0064353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0064715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0065029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0065462Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0065772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0066055Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0066346Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0066480Z Execution Analysis: (:1) 2025-03-14T06:00:24.0066738Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0066954Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0066958Z 2025-03-14T06:00:24.0067162Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0067276Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0067510Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0067620Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0067830Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0067976Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0068183Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0068353Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0068981Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0069549Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0069914Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0070266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0070584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0070859Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0071174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0071441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0071561Z Execution Analysis: .......... 2025-03-14T06:00:24.0071847Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0072058Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0072388Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1374 counts during 1309 steps 2025-03-14T06:00:24.0072394Z 2025-03-14T06:00:24.0072604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0072717Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0073012Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0073123Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0073332Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0073477Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0073624Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0073789Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0074154Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0074504Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0074825Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0075096Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0075408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0075678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0075976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0076100Z Execution Analysis: (:1) 2025-03-14T06:00:24.0076361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0076563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0076567Z 2025-03-14T06:00:24.0076773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0076882Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0077115Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0077221Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0077429Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0077597Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0077857Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0078148Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0078699Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0079226Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0079568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0079890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0080187Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0080441Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0080736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0080987Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0081093Z Execution Analysis: .......... 2025-03-14T06:00:24.0081353Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0081551Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0081844Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1375 counts during 1310 steps 2025-03-14T06:00:24.0081859Z 2025-03-14T06:00:24.0082045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0082157Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0082427Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0082529Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0082726Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0082857Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0082999Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0083153Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0083494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0083817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0084112Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0084370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0084724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0085153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0085450Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0085585Z Execution Analysis: (:1) 2025-03-14T06:00:24.0085845Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0086055Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0086061Z 2025-03-14T06:00:24.0086261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0086380Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0086611Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0086732Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0086962Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0087112Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0087280Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0087453Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0088041Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0088621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0088978Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0089337Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0089647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0089933Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0090237Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0090540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0090643Z Execution Analysis: .......... 2025-03-14T06:00:24.0090912Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0091134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0091434Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1376 counts during 1311 steps 2025-03-14T06:00:24.0091439Z 2025-03-14T06:00:24.0091635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0091762Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0092052Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0092172Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0092374Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0092524Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0092665Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0092845Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0093200Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0093557Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0093865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0094147Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0094454Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0094733Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0095020Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0095155Z Execution Analysis: (:1) 2025-03-14T06:00:24.0095410Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0095617Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0095621Z 2025-03-14T06:00:24.0095820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0095943Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0096169Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0096311Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0096511Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0096693Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0096837Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0097013Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0097701Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0098265Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0098612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0098961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0099266Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0099545Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0099842Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0100136Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0100236Z Execution Analysis: .......... 2025-03-14T06:00:24.0100523Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0100725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0101009Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1377 counts during 1312 steps 2025-03-14T06:00:24.0101014Z 2025-03-14T06:00:24.0101217Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0101326Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0101617Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0101721Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0101926Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0102064Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0102206Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0102369Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0102722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0103062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0103369Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0103636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0103946Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0104209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0104501Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0104624Z Execution Analysis: (:1) 2025-03-14T06:00:24.0104881Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0105078Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0105082Z 2025-03-14T06:00:24.0105289Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0105426Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0105659Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0105788Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0105992Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0106129Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0106280Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0106441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0107026Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0107676Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0108011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0108336Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0108634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0108887Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0109214Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0109462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0109590Z Execution Analysis: .......... 2025-03-14T06:00:24.0109825Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0110019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0110287Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1378 counts during 1313 steps 2025-03-14T06:00:24.0110292Z 2025-03-14T06:00:24.0110488Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0110593Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0110869Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0110973Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0111169Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0111298Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0111440Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0111593Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0111931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0112251Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0112545Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0112795Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0113087Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0113335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0113609Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0113724Z Execution Analysis: (:1) 2025-03-14T06:00:24.0113971Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0114154Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0114157Z 2025-03-14T06:00:24.0114346Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0114472Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0114717Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0114819Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0115013Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0115144Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0115286Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0115439Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0115993Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0116521Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0116862Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0117195Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0117485Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0117772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0118055Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0118335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0118433Z Execution Analysis: .......... 2025-03-14T06:00:24.0118683Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0118869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0119144Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1379 counts during 1314 steps 2025-03-14T06:00:24.0119149Z 2025-03-14T06:00:24.0119334Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0119447Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0119719Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0119825Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0120014Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0120153Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0120284Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0120447Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0120778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0121109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0121395Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0121656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0121940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0122365Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0122650Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0122778Z Execution Analysis: (:1) 2025-03-14T06:00:24.0123028Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0123232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0123262Z 2025-03-14T06:00:24.0123457Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0123600Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0123823Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0123938Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0124136Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0124284Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0124423Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0124681Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0125430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0126014Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0126375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0126734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0127074Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0127356Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0127688Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0127970Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0128072Z Execution Analysis: .......... 2025-03-14T06:00:24.0128339Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0128538Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0128840Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1380 counts during 1315 steps 2025-03-14T06:00:24.0128847Z 2025-03-14T06:00:24.0129046Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0129172Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0129464Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0129583Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0129789Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0129957Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0130119Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0130292Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0130671Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0131033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0131355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0131630Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0131947Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0132217Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0132514Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0132637Z Execution Analysis: (:1) 2025-03-14T06:00:24.0132902Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0133131Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0133145Z 2025-03-14T06:00:24.0133368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0133487Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0133721Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0133835Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0134043Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0134200Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0134345Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0134519Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0135110Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0135696Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0136058Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0136436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0136750Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0137059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0137366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0137645Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0137746Z Execution Analysis: .......... 2025-03-14T06:00:24.0138008Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0138208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0138507Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1381 counts during 1316 steps 2025-03-14T06:00:24.0138512Z 2025-03-14T06:00:24.0138711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0138828Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0139118Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0139233Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0139439Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0139586Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0139727Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0139906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0140261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0140626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0140940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0141222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0141531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0141810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0142101Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0142241Z Execution Analysis: (:1) 2025-03-14T06:00:24.0142497Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0142737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0142779Z 2025-03-14T06:00:24.0142981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0143106Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0143334Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0143454Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0143658Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0143815Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0143961Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0144139Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0144731Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0145313Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0145674Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0146061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0146479Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0146768Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0147077Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0147357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0147465Z Execution Analysis: .......... 2025-03-14T06:00:24.0147733Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0147936Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0148238Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1382 counts during 1317 steps 2025-03-14T06:00:24.0148244Z 2025-03-14T06:00:24.0148459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0148574Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0148877Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0148987Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0149202Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0149345Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0149503Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0149668Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0150039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0150389Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0150712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0150987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0151307Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0151574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0151876Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0152022Z Execution Analysis: (:1) 2025-03-14T06:00:24.0152287Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0152510Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0152514Z 2025-03-14T06:00:24.0152724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0152835Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0153072Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0153182Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0153394Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0153532Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0153686Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0153852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0154451Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0155022Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0155440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0155792Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0156152Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0156425Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0156746Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0157017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0157140Z Execution Analysis: .......... 2025-03-14T06:00:24.0157400Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0157612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0157904Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1383 counts during 1318 steps 2025-03-14T06:00:24.0157909Z 2025-03-14T06:00:24.0158122Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0158235Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0158537Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0158648Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0158862Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0159007Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0159162Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0159329Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0159695Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0160046Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0160365Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0160639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0160959Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0161230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0161530Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0161690Z Execution Analysis: (:1) 2025-03-14T06:00:24.0161987Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0162190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0162196Z 2025-03-14T06:00:24.0162406Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0162520Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0162763Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0162873Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0163088Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0163229Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0163385Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0163553Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0164152Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0164845Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0165221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0165729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0166058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0166345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0166652Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0166938Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0167046Z Execution Analysis: .......... 2025-03-14T06:00:24.0167316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0167520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0167821Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1384 counts during 1319 steps 2025-03-14T06:00:24.0167826Z 2025-03-14T06:00:24.0168027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0168149Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0168437Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0168555Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0168758Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0168911Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0169050Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0169228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0169583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0169944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0170252Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0170536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0170841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0171121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0171447Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0171616Z Execution Analysis: (:1) 2025-03-14T06:00:24.0171875Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0172089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0172093Z 2025-03-14T06:00:24.0172294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0172422Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0172650Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0172775Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0172978Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0173131Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0173274Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0173451Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0174044Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0174658Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0175043Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0175407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0175721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0176007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0176312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0176597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0176701Z Execution Analysis: .......... 2025-03-14T06:00:24.0176976Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0177177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0177479Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1385 counts during 1320 steps 2025-03-14T06:00:24.0177484Z 2025-03-14T06:00:24.0177786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0177909Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0178190Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0178310Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0178508Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0178658Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0178797Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0178974Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0179319Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0179670Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0179972Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0180248Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0180546Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0180863Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0181171Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0181303Z Execution Analysis: (:1) 2025-03-14T06:00:24.0181556Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0181758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0181762Z 2025-03-14T06:00:24.0181958Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0182081Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0182302Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0182418Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0182616Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0182766Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0182907Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0183080Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0183678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0184270Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0184632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0185150Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0185475Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0185751Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0186072Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0186342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0186462Z Execution Analysis: .......... 2025-03-14T06:00:24.0186721Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0186943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0187233Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1386 counts during 1321 steps 2025-03-14T06:00:24.0187237Z 2025-03-14T06:00:24.0187450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0187564Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0187869Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0187980Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0188202Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0188342Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0188497Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0188664Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0189037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0189390Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0189715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0189987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0190332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0190602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0190933Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0191060Z Execution Analysis: (:1) 2025-03-14T06:00:24.0191334Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0191537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0191541Z 2025-03-14T06:00:24.0191756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0191868Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0192107Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0192218Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0192433Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0192577Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0192734Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0192898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0193526Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0194121Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0194492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0194842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0195168Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0195442Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0195756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0196026Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0196139Z Execution Analysis: .......... 2025-03-14T06:00:24.0196397Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0196704Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0196991Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1387 counts during 1322 steps 2025-03-14T06:00:24.0196996Z 2025-03-14T06:00:24.0197218Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0197331Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0197630Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0197742Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0197952Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0198094Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0198244Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0198412Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0198778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0199128Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0199449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0199749Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0200067Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0200362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0200667Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0200791Z Execution Analysis: (:1) 2025-03-14T06:00:24.0201054Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0201262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0201273Z 2025-03-14T06:00:24.0201473Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0201593Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0201825Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0201942Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0202146Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0202295Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0202438Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0202633Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0203258Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0203840Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0204198Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0204649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0204964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0205253Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0205566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0205849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0205959Z Execution Analysis: .......... 2025-03-14T06:00:24.0206231Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0206433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0206737Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1389 counts during 1323 steps 2025-03-14T06:00:24.0206743Z 2025-03-14T06:00:24.0206945Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0207074Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0207365Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0207485Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0207692Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0207848Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0207990Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0208170Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0208527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0208886Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0209232Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0209516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0209850Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0210127Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0210421Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0210554Z Execution Analysis: (:1) 2025-03-14T06:00:24.0210815Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0211026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0211030Z 2025-03-14T06:00:24.0211231Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0211352Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0211582Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0211700Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0211906Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0212060Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0212233Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0212407Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0213032Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0213611Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0213969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0214329Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0214648Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0214933Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0215242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0215524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0215629Z Execution Analysis: .......... 2025-03-14T06:00:24.0215891Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0216093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0216391Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1390 counts during 1324 steps 2025-03-14T06:00:24.0216396Z 2025-03-14T06:00:24.0216600Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0216721Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0217017Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0217140Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0217345Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0217498Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0217649Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0217827Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0218186Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0218543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0218884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0219190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0219508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0219780Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0220083Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0220209Z Execution Analysis: (:1) 2025-03-14T06:00:24.0220477Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0220677Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0220682Z 2025-03-14T06:00:24.0220893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0221006Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0221247Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0221356Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0221588Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0221731Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0221887Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0222076Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0222678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0223255Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0223625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0223977Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0224296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0224572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0224887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0225159Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0225272Z Execution Analysis: .......... 2025-03-14T06:00:24.0225529Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0225740Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0226034Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1391 counts during 1325 steps 2025-03-14T06:00:24.0226040Z 2025-03-14T06:00:24.0226250Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0226363Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0226667Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0226883Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0227100Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0227241Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0227393Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0227556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0228083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0228460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0228815Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0229093Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0229415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0229688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0229995Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0230119Z Execution Analysis: (:1) 2025-03-14T06:00:24.0230391Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0230596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0230603Z 2025-03-14T06:00:24.0230821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0230937Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0231185Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0231319Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0231539Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0231684Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0231871Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0232038Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0232643Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0233216Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0233591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0233950Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0234279Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0234556Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0234881Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0235153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0235273Z Execution Analysis: .......... 2025-03-14T06:00:24.0235532Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0235753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0236059Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1392 counts during 1326 steps 2025-03-14T06:00:24.0236064Z 2025-03-14T06:00:24.0236271Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0236400Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0236695Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0236820Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0237027Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0237185Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0237327Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0237509Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0237891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0238252Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0238589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0238879Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0239186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0239470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0239762Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0240003Z Execution Analysis: (:1) 2025-03-14T06:00:24.0240253Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0240462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0240467Z 2025-03-14T06:00:24.0240663Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0240786Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0241033Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0241153Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0241348Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0241522Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0241664Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0241840Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0242412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0242983Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0243333Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0243688Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0243992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0244272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0244648Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0245092Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0245194Z Execution Analysis: .......... 2025-03-14T06:00:24.0245467Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0245672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0245978Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1393 counts during 1327 steps 2025-03-14T06:00:24.0245983Z 2025-03-14T06:00:24.0246186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0246310Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0246602Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0246721Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0246925Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0247081Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0247222Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0247432Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0247791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0248183Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0248498Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0248784Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0249095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0249377Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0249669Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0249807Z Execution Analysis: (:1) 2025-03-14T06:00:24.0250071Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0250284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0250290Z 2025-03-14T06:00:24.0250489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0250656Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0250888Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0251014Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0251247Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0251397Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0251544Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0251722Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0252313Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0252901Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0253261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0253627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0253954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0254232Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0254553Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0254824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0254939Z Execution Analysis: .......... 2025-03-14T06:00:24.0255199Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0255413Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0255710Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1394 counts during 1328 steps 2025-03-14T06:00:24.0255715Z 2025-03-14T06:00:24.0255929Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0256045Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0256348Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0256463Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0256676Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0256927Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0257107Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0257274Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0257658Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0258008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0258321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0258594Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0258901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0259166Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0259463Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0259583Z Execution Analysis: (:1) 2025-03-14T06:00:24.0259847Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0260046Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0260050Z 2025-03-14T06:00:24.0260282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0260393Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0260984Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0261097Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0261307Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0261447Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0261597Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0261764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0262352Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0262913Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0263274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0263617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0263938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0264207Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0264516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0264783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0264897Z Execution Analysis: .......... 2025-03-14T06:00:24.0265153Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0265485Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0265942Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1395 counts during 1329 steps 2025-03-14T06:00:24.0265948Z 2025-03-14T06:00:24.0266167Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0266282Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0266586Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0266698Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0266914Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0267115Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0267264Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0267466Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0267837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0268190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0268513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0268789Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0269109Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0269379Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0269683Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0269810Z Execution Analysis: (:1) 2025-03-14T06:00:24.0270078Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0270314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0270332Z 2025-03-14T06:00:24.0270577Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0270733Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0270967Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0271077Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0271290Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0271434Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0271591Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0271762Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0272367Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0272959Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0273320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0273685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0274003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0274292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0274605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0274893Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0275002Z Execution Analysis: .......... 2025-03-14T06:00:24.0275275Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0275480Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0275784Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1396 counts during 1330 steps 2025-03-14T06:00:24.0275790Z 2025-03-14T06:00:24.0275996Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0276125Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0276420Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0276567Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0276770Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0276954Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0277095Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0277277Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0277639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0278004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0278317Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0278608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0278918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0279214Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0279510Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0279650Z Execution Analysis: (:1) 2025-03-14T06:00:24.0279910Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0280151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0280156Z 2025-03-14T06:00:24.0280382Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0280511Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0280743Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0280866Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0281070Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0281236Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0281383Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0281569Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0282164Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0282744Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0283106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0283473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0283785Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0284073Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0284379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0284729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0284833Z Execution Analysis: .......... 2025-03-14T06:00:24.0285104Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0285309Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0285611Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1397 counts during 1331 steps 2025-03-14T06:00:24.0285616Z 2025-03-14T06:00:24.0285817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0285941Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0286232Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0286387Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0286626Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0286780Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0286923Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0287101Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0287460Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0287823Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0288135Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0288419Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0288729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0289010Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0289318Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0289443Z Execution Analysis: (:1) 2025-03-14T06:00:24.0289736Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0289939Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0289967Z 2025-03-14T06:00:24.0290177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0290290Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0290529Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0290639Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0290854Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0290998Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0291160Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0291327Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0291932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0292506Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0292877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0293230Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0293556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0293835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0294162Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0294432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0294553Z Execution Analysis: .......... 2025-03-14T06:00:24.0294813Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0295027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0295319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1398 counts during 1332 steps 2025-03-14T06:00:24.0295324Z 2025-03-14T06:00:24.0295537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0295678Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0295984Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0296124Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0296344Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0296488Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0296646Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0296815Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0297285Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0297627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0297943Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0298212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0298526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0298788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0299086Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0299307Z Execution Analysis: (:1) 2025-03-14T06:00:24.0299575Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0299794Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0299798Z 2025-03-14T06:00:24.0300009Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0300121Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0300360Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0300471Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0300682Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0300823Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0300978Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0301144Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0301731Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0302293Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0302653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0302995Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0303314Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0303583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0303892Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0304157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0304273Z Execution Analysis: .......... 2025-03-14T06:00:24.0304527Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0304738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0305022Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1399 counts during 1333 steps 2025-03-14T06:00:24.0305037Z 2025-03-14T06:00:24.0305235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0305386Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0305693Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0305814Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0306012Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0306162Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0306299Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0306467Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0306824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0307177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0307481Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0307764Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0308066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0308344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0308650Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0308783Z Execution Analysis: (:1) 2025-03-14T06:00:24.0309058Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0309266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0309271Z 2025-03-14T06:00:24.0309467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0309594Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0309819Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0309941Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0310138Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0310294Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0310438Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0310615Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0311191Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0311759Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0312109Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0312467Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0312773Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0313051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0313354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0313631Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0313733Z Execution Analysis: .......... 2025-03-14T06:00:24.0313996Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0314193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0314490Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1400 counts during 1334 steps 2025-03-14T06:00:24.0314518Z 2025-03-14T06:00:24.0314722Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0314871Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0315156Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0315283Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0315484Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0315642Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0315785Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0315966Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0316318Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0316676Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0316986Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0317273Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0317581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0317884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0318174Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0318330Z Execution Analysis: (:1) 2025-03-14T06:00:24.0318588Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0318801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0318805Z 2025-03-14T06:00:24.0319004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0319133Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0319366Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0319493Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0319694Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0319855Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0320003Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0320185Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0320768Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0321345Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0321701Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0322058Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0322370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0322656Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0322970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0323239Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0323360Z Execution Analysis: .......... 2025-03-14T06:00:24.0323615Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0323829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0324157Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1401 counts during 1335 steps 2025-03-14T06:00:24.0324162Z 2025-03-14T06:00:24.0324401Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0324600Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0325072Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0325184Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0325402Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0325552Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0325708Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0325874Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0326241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0326596Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0326922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0327200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0327551Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0327825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0328150Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0328278Z Execution Analysis: (:1) 2025-03-14T06:00:24.0328552Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0328754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0328759Z 2025-03-14T06:00:24.0328974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0329093Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0329340Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0329453Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0329668Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0329813Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0329972Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0330143Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0330745Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0331321Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0331698Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0332054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0332382Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0332658Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0332980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0333251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0333370Z Execution Analysis: .......... 2025-03-14T06:00:24.0333629Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0333871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0334162Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1402 counts during 1336 steps 2025-03-14T06:00:24.0334190Z 2025-03-14T06:00:24.0334406Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0334525Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0334828Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0334942Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0335158Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0335304Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0335461Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0335631Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0336001Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0336357Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0336685Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0336988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0337576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0337876Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0338185Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0338313Z Execution Analysis: (:1) 2025-03-14T06:00:24.0338587Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0338793Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0338797Z 2025-03-14T06:00:24.0339012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0339128Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0339374Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0339488Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0339704Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0339847Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0340009Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0340180Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0340782Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0341359Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0341739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0342110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0342425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0342718Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0343026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0343312Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0343420Z Execution Analysis: .......... 2025-03-14T06:00:24.0343689Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0343919Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0344247Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1403 counts during 1337 steps 2025-03-14T06:00:24.0344252Z 2025-03-14T06:00:24.0344462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0344589Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0344881Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0345007Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0345211Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0345368Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0345511Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0345693Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0346051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0346419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0346734Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0347048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0347360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0347665Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0347960Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0348098Z Execution Analysis: (:1) 2025-03-14T06:00:24.0348356Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0348573Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0348580Z 2025-03-14T06:00:24.0348786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0348912Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0349143Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0349268Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0349472Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0349630Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0349775Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0349957Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0350547Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0351137Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0351500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0351869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0352185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0352482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0352794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0353075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0353211Z Execution Analysis: .......... 2025-03-14T06:00:24.0353483Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0353710Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0354014Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1404 counts during 1338 steps 2025-03-14T06:00:24.0354021Z 2025-03-14T06:00:24.0354226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0354355Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0354651Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0354776Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0354981Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0355136Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0355284Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0360481Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0360891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0361263Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0361639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0361927Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0362278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0362551Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0362832Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0362966Z Execution Analysis: (:1) 2025-03-14T06:00:24.0363224Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0363437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0363442Z 2025-03-14T06:00:24.0363639Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0363760Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0363984Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0364106Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0364309Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0364459Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0364703Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0364876Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0365788Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0366376Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0366738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0367100Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0367422Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0367701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0368016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0368351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0368465Z Execution Analysis: .......... 2025-03-14T06:00:24.0368766Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0368972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0369265Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1405 counts during 1339 steps 2025-03-14T06:00:24.0369272Z 2025-03-14T06:00:24.0369483Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0369597Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0369893Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0370004Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0370216Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0370359Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0370508Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0370676Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0371036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0371422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0371740Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0372043Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0372354Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0372617Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0372913Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0373039Z Execution Analysis: (:1) 2025-03-14T06:00:24.0373303Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0373503Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0373508Z 2025-03-14T06:00:24.0373713Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0373822Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0374061Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0374167Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0374376Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0374516Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0374668Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0374837Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0375437Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0376012Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0376378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0376728Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0377048Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0377321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0377747Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0378036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0378173Z Execution Analysis: .......... 2025-03-14T06:00:24.0378422Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0378625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0378907Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1406 counts during 1340 steps 2025-03-14T06:00:24.0378912Z 2025-03-14T06:00:24.0379114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0379222Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0379512Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0379617Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0379829Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0379967Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0380112Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0380274Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0380655Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0380996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0381327Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0381592Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0381899Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0382160Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0382452Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0382573Z Execution Analysis: (:1) 2025-03-14T06:00:24.0382829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0383026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0383030Z 2025-03-14T06:00:24.0383232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0383341Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0383575Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0383680Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0383888Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0384027Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0384182Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0384344Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0384932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0385500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0386014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0386373Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0386684Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0386970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0387310Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0387610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0387715Z Execution Analysis: .......... 2025-03-14T06:00:24.0387986Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0388190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0388486Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1407 counts during 1341 steps 2025-03-14T06:00:24.0388491Z 2025-03-14T06:00:24.0388689Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0388809Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0389094Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0389217Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0389416Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0389567Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0389705Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0389878Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0390257Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0390645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0390954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0391235Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0391541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0391814Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0392104Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0392230Z Execution Analysis: (:1) 2025-03-14T06:00:24.0392488Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0392699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0392703Z 2025-03-14T06:00:24.0392903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0393030Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0393258Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0393377Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0393579Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0393732Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0393873Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0394052Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0394649Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0395225Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0395585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0395942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0396253Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0396560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0396867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0397166Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0397274Z Execution Analysis: .......... 2025-03-14T06:00:24.0397537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0397739Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0398038Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1408 counts during 1342 steps 2025-03-14T06:00:24.0398043Z 2025-03-14T06:00:24.0398243Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0398365Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0398655Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0398771Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0398971Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0399120Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0399298Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0399473Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0399830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0400213Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0400526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0400806Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0401112Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0401391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0401687Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0401827Z Execution Analysis: (:1) 2025-03-14T06:00:24.0402090Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0402307Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0402311Z 2025-03-14T06:00:24.0402525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0402644Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0402888Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0403005Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0403223Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0403373Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0403535Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0403705Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0404315Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0404990Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0405369Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0405769Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0406134Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0406416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0406767Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0407046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0407168Z Execution Analysis: .......... 2025-03-14T06:00:24.0407431Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0407653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0407950Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1410 counts during 1343 steps 2025-03-14T06:00:24.0407955Z 2025-03-14T06:00:24.0408175Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0408295Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0408602Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0408720Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0408942Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0409117Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0409280Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0409454Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0409854Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0410212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0410545Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0410826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0411154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0411431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0411746Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0411875Z Execution Analysis: (:1) 2025-03-14T06:00:24.0412153Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0412362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0412366Z 2025-03-14T06:00:24.0412589Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0412708Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0412955Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0413072Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0413295Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0413443Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0413609Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0413784Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0414397Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0414977Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0415358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0415713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0416066Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0416370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0416699Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0416971Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0417091Z Execution Analysis: .......... 2025-03-14T06:00:24.0417351Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0417565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0417857Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1411 counts during 1344 steps 2025-03-14T06:00:24.0417874Z 2025-03-14T06:00:24.0418075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0418203Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0418498Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0418612Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0418854Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0419000Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0419158Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0419353Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0419726Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0420083Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0420412Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0420705Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0421018Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0421306Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0421604Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0421744Z Execution Analysis: (:1) 2025-03-14T06:00:24.0422009Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0422227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0422231Z 2025-03-14T06:00:24.0422435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0422564Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0422798Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0422926Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0423132Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0423290Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0423440Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0423623Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0424216Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0424806Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0425169Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0425561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0425904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0426192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0426505Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0426789Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0426901Z Execution Analysis: .......... 2025-03-14T06:00:24.0427172Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0427375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0427684Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1412 counts during 1345 steps 2025-03-14T06:00:24.0427690Z 2025-03-14T06:00:24.0427896Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0428028Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0428322Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0428475Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0428792Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0428952Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0429118Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0429297Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0429647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0430002Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0430308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0430593Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0430894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0431171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0431459Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0431597Z Execution Analysis: (:1) 2025-03-14T06:00:24.0431848Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0432059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0432064Z 2025-03-14T06:00:24.0432262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0432387Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0432615Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0432739Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0432940Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0433095Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0433240Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0433418Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0433994Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0434570Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0434946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0435347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0435655Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0435943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0436245Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0436522Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0436627Z Execution Analysis: .......... 2025-03-14T06:00:24.0436896Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0437109Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0437396Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1413 counts during 1346 steps 2025-03-14T06:00:24.0437402Z 2025-03-14T06:00:24.0437611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0437726Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0438046Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0438158Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0438394Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0438535Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0438688Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0438856Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0439218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0439565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0439886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0440156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0440476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0440745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0441048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0441175Z Execution Analysis: (:1) 2025-03-14T06:00:24.0441441Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0441641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0441647Z 2025-03-14T06:00:24.0441856Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0441973Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0442214Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0442330Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0442546Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0442689Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0442849Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0443016Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0443606Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0444168Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0444640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0445186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0445518Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0445872Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0446197Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0446467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0446589Z Execution Analysis: .......... 2025-03-14T06:00:24.0446851Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0447070Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0447365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1414 counts during 1347 steps 2025-03-14T06:00:24.0447369Z 2025-03-14T06:00:24.0447589Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0447731Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0448035Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0448171Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0448384Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0448528Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0448680Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0448847Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0449219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0449574Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0449899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0450178Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0450493Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0450766Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0451069Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0451195Z Execution Analysis: (:1) 2025-03-14T06:00:24.0451459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0451660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0451666Z 2025-03-14T06:00:24.0451876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0451992Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0452233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0452343Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0452558Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0452704Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0452866Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0453035Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0453631Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0454229Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0454675Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0455035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0455349Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0455633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0455939Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0456215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0456324Z Execution Analysis: .......... 2025-03-14T06:00:24.0456596Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0456799Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0457207Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1415 counts during 1348 steps 2025-03-14T06:00:24.0457213Z 2025-03-14T06:00:24.0457419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0457536Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0457820Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0457933Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0458122Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0458263Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0458392Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0458556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0458883Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0459220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0459509Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0459763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0460048Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0460302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0460570Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0460695Z Execution Analysis: (:1) 2025-03-14T06:00:24.0460934Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0461127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0461133Z 2025-03-14T06:00:24.0461315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0461430Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0461642Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0461753Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0461946Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0462087Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0462222Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0462388Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0462931Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0463487Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0463845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0464176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0464471Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0464734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0465019Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0465276Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0465499Z Execution Analysis: .......... 2025-03-14T06:00:24.0465924Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0466129Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0466478Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1416 counts during 1349 steps 2025-03-14T06:00:24.0466484Z 2025-03-14T06:00:24.0466688Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0466842Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0467134Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0467252Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0467455Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0467607Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0467750Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0467929Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0468287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0468648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0468962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0469247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0469552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0469831Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0470123Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0470257Z Execution Analysis: (:1) 2025-03-14T06:00:24.0470513Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0470725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0470729Z 2025-03-14T06:00:24.0470939Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0471053Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0471293Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0471403Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0471607Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0471756Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0471902Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0472079Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0472721Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0473335Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0473702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0474056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0474375Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0474647Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0474965Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0475237Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0475353Z Execution Analysis: .......... 2025-03-14T06:00:24.0475612Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0475846Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0476138Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1417 counts during 1350 steps 2025-03-14T06:00:24.0476142Z 2025-03-14T06:00:24.0476376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0476492Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0476787Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0476898Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0477112Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0477257Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0477406Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0477683Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0478142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0478471Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0478763Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0479017Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0479305Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0479548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0479824Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0479943Z Execution Analysis: (:1) 2025-03-14T06:00:24.0480190Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0480550Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0480554Z 2025-03-14T06:00:24.0480757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0480867Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0481097Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0481203Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0481409Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0481550Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0481725Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0482053Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0482674Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0483251Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0483620Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0483975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0484299Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0484651Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0484969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0485238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0485351Z Execution Analysis: .......... 2025-03-14T06:00:24.0485615Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0485853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0486144Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1418 counts during 1351 steps 2025-03-14T06:00:24.0486174Z 2025-03-14T06:00:24.0486387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0486535Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0486841Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0486981Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0487195Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0487360Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0487516Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0487695Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0488052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0488418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0488764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0489055Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0489366Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0489644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0489937Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0490066Z Execution Analysis: (:1) 2025-03-14T06:00:24.0490325Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0490532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0490536Z 2025-03-14T06:00:24.0490750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0490864Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0491104Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0491219Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0491435Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0491604Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0491761Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0491957Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0492555Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0493130Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0493500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0493850Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0494170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0494446Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0494767Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0495040Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0495152Z Execution Analysis: .......... 2025-03-14T06:00:24.0495435Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0495644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0495956Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1419 counts during 1352 steps 2025-03-14T06:00:24.0495961Z 2025-03-14T06:00:24.0496172Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0496286Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0496585Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0496696Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0496913Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0497059Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0497216Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0497384Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0497749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0498102Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0498426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0498696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0499014Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0499284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0499587Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0499712Z Execution Analysis: (:1) 2025-03-14T06:00:24.0499984Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0500182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0500186Z 2025-03-14T06:00:24.0500394Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0500510Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0500753Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0500859Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0501099Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0501240Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0501417Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0501583Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0502274Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0502830Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0503184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0503694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0504013Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0504289Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0504604Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0504871Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0505004Z Execution Analysis: .......... 2025-03-14T06:00:24.0505259Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0505499Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0505788Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1420 counts during 1353 steps 2025-03-14T06:00:24.0505805Z 2025-03-14T06:00:24.0506003Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0506116Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0506416Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0506548Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0506761Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0506902Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0507054Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0507222Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0507588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0508041Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0508349Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0508622Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0508922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0509192Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0509474Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0509604Z Execution Analysis: (:1) 2025-03-14T06:00:24.0509851Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0510059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0510064Z 2025-03-14T06:00:24.0510256Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0510372Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0510599Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0510742Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0510938Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0511111Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0511251Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0511424Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0511995Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0512564Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0512911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0513261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0513565Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0513844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0514139Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0514657Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0514758Z Execution Analysis: .......... 2025-03-14T06:00:24.0515047Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0515244Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0515540Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1421 counts during 1354 steps 2025-03-14T06:00:24.0515545Z 2025-03-14T06:00:24.0515743Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0515870Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0516150Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0516266Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0516462Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0516619Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0516753Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0516934Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0517282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0517633Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0517934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0518212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0518509Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0518783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0519066Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0519200Z Execution Analysis: (:1) 2025-03-14T06:00:24.0519449Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0519658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0519663Z 2025-03-14T06:00:24.0519856Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0519979Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0520227Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0520343Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0520569Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0520718Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0520860Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0521029Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0521607Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0522176Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0522524Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0522878Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0523183Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0523461Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0523783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0524052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0524177Z Execution Analysis: .......... 2025-03-14T06:00:24.0524438Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0524727Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0525186Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1422 counts during 1355 steps 2025-03-14T06:00:24.0525193Z 2025-03-14T06:00:24.0525402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0525514Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0525817Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0525924Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0526137Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0526277Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0526428Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0526593Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0526956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0527305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0527627Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0527898Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0528214Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0528484Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0528789Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0528912Z Execution Analysis: (:1) 2025-03-14T06:00:24.0529180Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0529384Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0529388Z 2025-03-14T06:00:24.0529597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0529738Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0529973Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0530104Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0530315Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0530459Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0530611Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0530777Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0531380Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0531952Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0532324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0532674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0532997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0533308Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0533633Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0533933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0534050Z Execution Analysis: .......... 2025-03-14T06:00:24.0534311Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0534523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0534817Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1423 counts during 1356 steps 2025-03-14T06:00:24.0534822Z 2025-03-14T06:00:24.0535036Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0535151Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0535452Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0535567Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0535786Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0535932Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0536088Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0536263Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0536634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0536989Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0537421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0537693Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0538004Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0538270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0538569Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0538693Z Execution Analysis: (:1) 2025-03-14T06:00:24.0538956Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0539160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0539193Z 2025-03-14T06:00:24.0539398Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0539538Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0539772Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0539884Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0540098Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0540242Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0540398Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0540566Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0541153Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0541715Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0542076Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0542432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0542772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0543051Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0543374Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0543647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0543752Z Execution Analysis: .......... 2025-03-14T06:00:24.0544010Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0544209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0544504Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1424 counts during 1357 steps 2025-03-14T06:00:24.0544510Z 2025-03-14T06:00:24.0544706Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0544826Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0545108Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0545223Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0545425Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0545578Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0545720Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0545891Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0546239Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0546592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0546896Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0547169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0547467Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0547738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0548028Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0548158Z Execution Analysis: (:1) 2025-03-14T06:00:24.0548411Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0548615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0548644Z 2025-03-14T06:00:24.0548841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0548990Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0549215Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0549338Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0549537Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0549686Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0549833Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0550009Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0550588Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0551157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0551510Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0551862Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0552191Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0552468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0552789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0553061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0553164Z Execution Analysis: .......... 2025-03-14T06:00:24.0553427Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0553625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0553917Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1425 counts during 1358 steps 2025-03-14T06:00:24.0553922Z 2025-03-14T06:00:24.0554118Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0554240Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0554526Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0554645Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0554845Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0554992Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0555132Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0555303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0555653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0556003Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0556308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0556583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0556886Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0557158Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0557442Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0557573Z Execution Analysis: (:1) 2025-03-14T06:00:24.0557824Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0558056Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0558083Z 2025-03-14T06:00:24.0558289Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0558402Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0558629Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0558748Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0558949Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0559098Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0559240Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0559413Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0559988Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0560554Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0560910Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0561275Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0561590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0561880Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0562188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0562450Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0562561Z Execution Analysis: .......... 2025-03-14T06:00:24.0562816Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0563022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0563304Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1426 counts during 1359 steps 2025-03-14T06:00:24.0563310Z 2025-03-14T06:00:24.0563515Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0563796Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0564096Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0564211Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0564421Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0564637Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0564794Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0564986Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0565513Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0565902Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0566241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0566529Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0566839Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0567120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0567416Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0567552Z Execution Analysis: (:1) 2025-03-14T06:00:24.0567871Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0568118Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0568123Z 2025-03-14T06:00:24.0568326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0568454Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0568689Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0568812Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0569016Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0569171Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0569320Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0569499Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0570096Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0570681Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0571074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0571445Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0571788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0572075Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0572385Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0572661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0572771Z Execution Analysis: .......... 2025-03-14T06:00:24.0573041Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0573249Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0573555Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1427 counts during 1360 steps 2025-03-14T06:00:24.0573560Z 2025-03-14T06:00:24.0573763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0573889Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0574179Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0574302Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0574508Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0574671Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0574816Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0575002Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0575361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0575729Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0576045Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0576336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0576644Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0576923Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0577217Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0577379Z Execution Analysis: (:1) 2025-03-14T06:00:24.0577638Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0577889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0577893Z 2025-03-14T06:00:24.0578094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0578220Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0578453Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0578579Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0578785Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0578944Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0579089Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0579273Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0579862Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0580476Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0580844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0581224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0581551Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0581828Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0582144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0582414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0582531Z Execution Analysis: .......... 2025-03-14T06:00:24.0582792Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0583006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0583297Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1428 counts during 1361 steps 2025-03-14T06:00:24.0583302Z 2025-03-14T06:00:24.0583516Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0583633Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0583933Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0584043Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0584253Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0584396Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0584548Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0584715Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0585081Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0585428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0585749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0586021Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0586336Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0586606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0586938Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0587088Z Execution Analysis: (:1) 2025-03-14T06:00:24.0587352Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0587555Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0587560Z 2025-03-14T06:00:24.0587772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0587886Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0588127Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0588238Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0588458Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0588602Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0588754Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0588923Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0589521Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0590115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0590503Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0590856Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0591176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0591449Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0591768Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0592042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0592157Z Execution Analysis: .......... 2025-03-14T06:00:24.0592416Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0592629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0592925Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1429 counts during 1362 steps 2025-03-14T06:00:24.0592930Z 2025-03-14T06:00:24.0593139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0593256Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0593555Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0593672Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0593887Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0594035Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0594189Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0594359Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0594727Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0595083Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0595406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0595681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0595999Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0596300Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0596601Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0596752Z Execution Analysis: (:1) 2025-03-14T06:00:24.0597019Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0597229Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0597234Z 2025-03-14T06:00:24.0597438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0597563Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0597795Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0597915Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0598122Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0598276Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0598424Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0598606Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0599223Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0599805Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0600187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0600549Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0600862Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0601148Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0601455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0601731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0601841Z Execution Analysis: .......... 2025-03-14T06:00:24.0602107Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0602312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0602610Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1431 counts during 1363 steps 2025-03-14T06:00:24.0602614Z 2025-03-14T06:00:24.0602817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0602942Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0603236Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0603354Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0603562Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0603714Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0603858Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0604036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0604395Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0604855Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0605172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0605458Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0605905Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0606188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0606505Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0606644Z Execution Analysis: (:1) 2025-03-14T06:00:24.0606906Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0607120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0607124Z 2025-03-14T06:00:24.0607328Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0607450Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0607685Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0607806Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0608012Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0608165Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0608315Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0608490Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0609102Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0609707Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0610068Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0610425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0610742Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0611023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0611332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0611612Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0611719Z Execution Analysis: .......... 2025-03-14T06:00:24.0611985Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0612188Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0612491Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1432 counts during 1364 steps 2025-03-14T06:00:24.0612496Z 2025-03-14T06:00:24.0612707Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0612827Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0613125Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0613238Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0613444Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0613598Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0613742Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0613921Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0614284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0614648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0614969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0615281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0615605Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0615899Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0616208Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0616335Z Execution Analysis: (:1) 2025-03-14T06:00:24.0616614Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0616819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0616824Z 2025-03-14T06:00:24.0617039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0617156Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0617401Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0617514Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0617730Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0617881Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0618040Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0618235Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0618835Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0619434Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0619807Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0620163Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0620495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0620779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0621101Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0621373Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0621500Z Execution Analysis: .......... 2025-03-14T06:00:24.0621764Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0621986Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0622282Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1433 counts during 1365 steps 2025-03-14T06:00:24.0622287Z 2025-03-14T06:00:24.0622505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0622624Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0622931Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0623047Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0623268Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0623417Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0623576Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0623751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0624129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0624484Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0624814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0625120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0625465Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0625738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0626048Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0626177Z Execution Analysis: (:1) 2025-03-14T06:00:24.0626451Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0626655Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0626659Z 2025-03-14T06:00:24.0626871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0626986Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0627229Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0627341Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0627557Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0627702Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0627886Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0628057Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0628679Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0629257Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0629627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0629981Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0630316Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0630591Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0630919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0631203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0631310Z Execution Analysis: .......... 2025-03-14T06:00:24.0631569Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0631786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0632092Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1434 counts during 1366 steps 2025-03-14T06:00:24.0632099Z 2025-03-14T06:00:24.0632304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0632455Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0632746Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0632873Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0633084Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0633242Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0633386Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0633568Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0633927Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0634290Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0634631Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0634944Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0635254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0635539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0635831Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0635976Z Execution Analysis: (:1) 2025-03-14T06:00:24.0636237Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0636457Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0636461Z 2025-03-14T06:00:24.0636667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0636795Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0637030Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0637154Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0637358Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0637545Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0637695Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0637900Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0638500Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0639086Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0639451Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0639821Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0640136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0640427Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0640737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0641017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0641125Z Execution Analysis: .......... 2025-03-14T06:00:24.0641392Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0641595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0641902Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1435 counts during 1367 steps 2025-03-14T06:00:24.0641909Z 2025-03-14T06:00:24.0642111Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0642240Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0642532Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0642655Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0642860Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0643020Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0643165Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0643345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0643705Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0644093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0644432Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0644791Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0645104Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0645388Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0645685Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0645827Z Execution Analysis: (:1) 2025-03-14T06:00:24.0646086Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0646300Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0646306Z 2025-03-14T06:00:24.0646508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0646637Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0646869Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0646995Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0647230Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0647390Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0647576Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0647757Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0648348Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0648931Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0649304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0649660Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0649992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0650269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0650590Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0650861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0650979Z Execution Analysis: .......... 2025-03-14T06:00:24.0651241Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0651460Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0651753Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1436 counts during 1368 steps 2025-03-14T06:00:24.0651758Z 2025-03-14T06:00:24.0651976Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0652097Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0652401Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0652511Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0652731Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0652878Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0653036Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0653207Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0653602Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0653956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0654311Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0654590Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0654911Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0655186Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0655491Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0655619Z Execution Analysis: (:1) 2025-03-14T06:00:24.0655889Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0656093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0656097Z 2025-03-14T06:00:24.0656312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0656432Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0656702Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0656815Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0657030Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0657198Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0657359Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0657531Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0658139Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0658717Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0659092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0659445Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0659771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0660049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0660370Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0660640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0660760Z Execution Analysis: .......... 2025-03-14T06:00:24.0661022Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0661237Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0661535Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1437 counts during 1369 steps 2025-03-14T06:00:24.0661539Z 2025-03-14T06:00:24.0661756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0661875Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0662180Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0662292Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0662510Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0662660Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0662819Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0663024Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0663394Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0663778Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0664105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0664380Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0664707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0664980Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0665404Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0665534Z Execution Analysis: (:1) 2025-03-14T06:00:24.0665808Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0666012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0666032Z 2025-03-14T06:00:24.0666236Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0666462Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0666698Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0666824Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0667071Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0667221Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0667382Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0667554Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0668163Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0668752Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0669116Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0669483Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0669802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0670088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0670395Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0670677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0670787Z Execution Analysis: .......... 2025-03-14T06:00:24.0671056Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0671259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0671563Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1438 counts during 1370 steps 2025-03-14T06:00:24.0671568Z 2025-03-14T06:00:24.0671770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0671896Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0672187Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0672309Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0672516Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0672672Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0672850Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0673032Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0673429Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0673796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0674110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0674400Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0674712Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0674994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0675289Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0675426Z Execution Analysis: (:1) 2025-03-14T06:00:24.0675684Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0675902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0675906Z 2025-03-14T06:00:24.0676135Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0676264Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0676498Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0676647Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0676853Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0677010Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0677160Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0677344Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0677939Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0678529Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0678894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0679255Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0679574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0679862Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0680172Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0680459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0680567Z Execution Analysis: .......... 2025-03-14T06:00:24.0680837Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0681043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0681347Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1439 counts during 1371 steps 2025-03-14T06:00:24.0681356Z 2025-03-14T06:00:24.0681559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0681683Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0681975Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0682101Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0682310Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0682502Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0682648Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0682857Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0683217Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0683584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0683900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0684193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0684565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0684855Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0685169Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0685297Z Execution Analysis: (:1) 2025-03-14T06:00:24.0685576Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0685782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0685830Z 2025-03-14T06:00:24.0686049Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0686165Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0686434Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0686547Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0686761Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0686905Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0687062Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0687232Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0687834Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0688411Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0688784Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0689138Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0689462Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0689739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0690058Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0690329Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0690448Z Execution Analysis: .......... 2025-03-14T06:00:24.0690708Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0690921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0691212Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1440 counts during 1372 steps 2025-03-14T06:00:24.0691220Z 2025-03-14T06:00:24.0691433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0691552Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0691857Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0691970Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0692213Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0692358Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0692538Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0692706Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0693075Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0693431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0693756Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0694033Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0694352Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0694622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0694936Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0695066Z Execution Analysis: (:1) 2025-03-14T06:00:24.0695336Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0695564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0695568Z 2025-03-14T06:00:24.0695810Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0695928Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0696169Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0696281Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0696497Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0696647Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0696803Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0696975Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0697582Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0698159Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0698533Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0698885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0699211Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0699488Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0699816Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0700090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0700209Z Execution Analysis: .......... 2025-03-14T06:00:24.0700469Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0700682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0700976Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1441 counts during 1373 steps 2025-03-14T06:00:24.0700991Z 2025-03-14T06:00:24.0701195Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0701326Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0701614Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0701760Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0701966Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0702150Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0702294Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0702476Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0702852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0703210Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0703537Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0703816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0704139Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0704412Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0704723Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0704853Z Execution Analysis: (:1) 2025-03-14T06:00:24.0705148Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0705354Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0705358Z 2025-03-14T06:00:24.0705601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0705721Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0705972Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0706088Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0706312Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0706460Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0706626Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0706799Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0707407Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0707988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0708367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0708724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0709055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0709337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0709766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0710031Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0710156Z Execution Analysis: .......... 2025-03-14T06:00:24.0710411Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0710626Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0710914Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1442 counts during 1374 steps 2025-03-14T06:00:24.0710918Z 2025-03-14T06:00:24.0711133Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0711274Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0711574Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0711713Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0711928Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0712073Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0712233Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0712400Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0712767Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0713114Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0713439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0713709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0714027Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0714293Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0714593Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0714743Z Execution Analysis: (:1) 2025-03-14T06:00:24.0715012Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0715233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0715237Z 2025-03-14T06:00:24.0715447Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0715560Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0715798Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0715911Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0716122Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0716266Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0716422Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0716587Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0717179Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0717743Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0718112Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0718468Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0718775Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0719056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0719360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0719636Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0719744Z Execution Analysis: .......... 2025-03-14T06:00:24.0720007Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0720208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0720509Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1443 counts during 1375 steps 2025-03-14T06:00:24.0720513Z 2025-03-14T06:00:24.0720819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0720965Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0721238Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0721392Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0721585Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0721734Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0721868Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0722044Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0722379Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0722718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0723010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0723282Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0723572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0723838Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0724135Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0724266Z Execution Analysis: (:1) 2025-03-14T06:00:24.0724617Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0724826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0724830Z 2025-03-14T06:00:24.0725193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0725327Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0725614Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0725744Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0725960Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0726119Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0726272Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0726457Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0727055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0727647Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0728008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0728377Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0728692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0728986Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0729299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0729583Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0729691Z Execution Analysis: .......... 2025-03-14T06:00:24.0729962Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0730167Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0730474Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1444 counts during 1376 steps 2025-03-14T06:00:24.0730507Z 2025-03-14T06:00:24.0730712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0730866Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0731160Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0731284Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0731492Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0731650Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0731794Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0731979Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0732339Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0732702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0733019Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0733303Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0733617Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0733922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0734215Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0734353Z Execution Analysis: (:1) 2025-03-14T06:00:24.0734639Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0734853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0734858Z 2025-03-14T06:00:24.0735071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0735188Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0735430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0735545Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0735752Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0735908Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0736057Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0736239Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0736838Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0737508Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0737853Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0738183Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0738488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0738745Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0739046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0739299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0739411Z Execution Analysis: .......... 2025-03-14T06:00:24.0739653Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0739853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0740150Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1445 counts during 1377 steps 2025-03-14T06:00:24.0740154Z 2025-03-14T06:00:24.0740355Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0740489Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0740775Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0740881Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0741090Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0741228Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0741377Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0741537Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0741885Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0742214Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0742523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0742781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0743101Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0743356Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0743667Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0748539Z Execution Analysis: (:1) 2025-03-14T06:00:24.0748837Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0749031Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0749044Z 2025-03-14T06:00:24.0749237Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0749346Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0749570Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0749673Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0749877Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0750011Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0750156Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0750313Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0750880Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0751408Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0751754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0752079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0752378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0752633Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0752924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0753172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0753280Z Execution Analysis: .......... 2025-03-14T06:00:24.0753519Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0753712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0754048Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1446 counts during 1378 steps 2025-03-14T06:00:24.0754081Z 2025-03-14T06:00:24.0754274Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0754378Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0754657Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0754758Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0754955Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0755088Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0755227Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0755381Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0755720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0756050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0756350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0756603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0756919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0757168Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0757536Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0757651Z Execution Analysis: (:1) 2025-03-14T06:00:24.0757900Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0758085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0758091Z 2025-03-14T06:00:24.0758285Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0758392Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0758612Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0758713Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0758913Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0759043Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0759186Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0759338Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0759891Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0760421Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0760761Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0761089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0761378Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0761636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0761921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0762175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0762272Z Execution Analysis: .......... 2025-03-14T06:00:24.0762515Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0762738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0763284Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1447 counts during 1379 steps 2025-03-14T06:00:24.0763289Z 2025-03-14T06:00:24.0763475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0763588Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0763855Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0763964Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0764150Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0764289Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0764419Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0764677Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0765185Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0765687Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0765998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0766342Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0766650Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0766958Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0767250Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0767379Z Execution Analysis: (:1) 2025-03-14T06:00:24.0767634Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0767839Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0767846Z 2025-03-14T06:00:24.0768043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0768163Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0768394Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0768512Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0768715Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0768861Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0769002Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0769171Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0769759Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0770336Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0770693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0771052Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0771360Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0771641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0771945Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0772218Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0772321Z Execution Analysis: .......... 2025-03-14T06:00:24.0772616Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0772847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0773144Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1448 counts during 1380 steps 2025-03-14T06:00:24.0773149Z 2025-03-14T06:00:24.0773353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0773474Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0773765Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0773885Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0774088Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0774243Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0774380Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0774558Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0774916Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0775278Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0775614Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0775893Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0776224Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0776500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0776788Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0776921Z Execution Analysis: (:1) 2025-03-14T06:00:24.0777334Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0777540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0777544Z 2025-03-14T06:00:24.0777851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0777956Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0778179Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0778279Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0778477Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0778607Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0778741Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0778901Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0779455Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0779982Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0780320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0780643Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0780934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0781185Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0781477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0781723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0781850Z Execution Analysis: .......... 2025-03-14T06:00:24.0782087Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0782301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0782569Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1449 counts during 1381 steps 2025-03-14T06:00:24.0782574Z 2025-03-14T06:00:24.0782765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0782869Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0783144Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0783243Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0783436Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0783567Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0783706Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0783859Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0784193Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0784537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0784834Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0785108Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0785396Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0785643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0785920Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0786035Z Execution Analysis: (:1) 2025-03-14T06:00:24.0786278Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0786464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0786468Z 2025-03-14T06:00:24.0786659Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0786762Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0786982Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0787081Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0787283Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0787419Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0787569Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0787728Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0788291Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0788828Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0789176Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0789505Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0789810Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0790067Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0790370Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0790648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0790787Z Execution Analysis: .......... 2025-03-14T06:00:24.0791028Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0791233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0791505Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1450 counts during 1382 steps 2025-03-14T06:00:24.0791509Z 2025-03-14T06:00:24.0791712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0791825Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0792111Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0792219Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0792428Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0792564Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0792717Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0792880Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0793252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0793582Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0793919Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0794178Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0794480Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0794748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0795023Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0795158Z Execution Analysis: (:1) 2025-03-14T06:00:24.0795403Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0795610Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0795614Z 2025-03-14T06:00:24.0795805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0796099Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0796383Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0796508Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0796712Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0796873Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0797022Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0797204Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0797787Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0798371Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0798732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0799093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0799403Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0799687Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0800015Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0800296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0800431Z Execution Analysis: .......... 2025-03-14T06:00:24.0800695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0800898Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0801196Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1452 counts during 1383 steps 2025-03-14T06:00:24.0801201Z 2025-03-14T06:00:24.0801400Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0801524Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0801806Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0801933Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0802133Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0802288Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0802429Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0802607Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0802979Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0803359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0803665Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0803945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0804247Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0804635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0805087Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0805231Z Execution Analysis: (:1) 2025-03-14T06:00:24.0805494Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0805709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0805713Z 2025-03-14T06:00:24.0805918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0806049Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0806285Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0806416Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0806622Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0806784Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0806937Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0807124Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0807719Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0808307Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0808671Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0809039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0809354Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0809679Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0809990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0810300Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0810407Z Execution Analysis: .......... 2025-03-14T06:00:24.0810685Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0810891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0811196Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1453 counts during 1384 steps 2025-03-14T06:00:24.0811201Z 2025-03-14T06:00:24.0811417Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0811534Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0811841Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0811957Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0812179Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0812328Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0812487Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0812682Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0813057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0813434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0813765Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0814041Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0814367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0814638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0814947Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0815074Z Execution Analysis: (:1) 2025-03-14T06:00:24.0815352Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0815556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0815562Z 2025-03-14T06:00:24.0815779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0815896Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0816142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0816258Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0816479Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0816626Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0816789Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0816957Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0817641Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0818175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0818523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0818853Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0819181Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0819437Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0819762Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0820016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0820129Z Execution Analysis: .......... 2025-03-14T06:00:24.0820370Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0820573Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0820844Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1454 counts during 1385 steps 2025-03-14T06:00:24.0820848Z 2025-03-14T06:00:24.0821048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0821160Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0821442Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0821551Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0821751Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0821912Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0822059Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0822218Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0822589Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0822917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0823224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0823479Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0823778Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0824030Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0824312Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0824433Z Execution Analysis: (:1) 2025-03-14T06:00:24.0824684Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0824875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0824879Z 2025-03-14T06:00:24.0825079Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0825188Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0825414Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0825523Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0825725Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0825863Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0826014Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0826174Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0826732Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0827268Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0827615Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0827944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0828279Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0828582Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0828872Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0829139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0829241Z Execution Analysis: .......... 2025-03-14T06:00:24.0829500Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0829689Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0829975Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1455 counts during 1386 steps 2025-03-14T06:00:24.0829980Z 2025-03-14T06:00:24.0830169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0830289Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0830562Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0830680Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0830904Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0831056Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0831190Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0831382Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0831717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0832058Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0832351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0832617Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0832901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0833159Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0833429Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0833552Z Execution Analysis: (:1) 2025-03-14T06:00:24.0833792Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0833986Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0833990Z 2025-03-14T06:00:24.0834175Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0834291Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0834502Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0834614Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0834802Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0834943Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0835078Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0835241Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0835783Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0836318Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0836651Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0837006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0837323Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0837584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0837871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0838131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0838238Z Execution Analysis: .......... 2025-03-14T06:00:24.0838486Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0838676Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0838951Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1456 counts during 1387 steps 2025-03-14T06:00:24.0838957Z 2025-03-14T06:00:24.0839140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0839255Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0839525Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0839659Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0839849Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0839989Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0840149Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0840314Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0840647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0840982Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0841272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0841531Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0841813Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0842071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0842339Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0842468Z Execution Analysis: (:1) 2025-03-14T06:00:24.0842706Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0842901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0842905Z 2025-03-14T06:00:24.0843087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0843199Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0843412Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0843519Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0843707Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0843847Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0843982Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0844143Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0844787Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0845522Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0845922Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0846271Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0846616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0846892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0847205Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0847473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0847584Z Execution Analysis: .......... 2025-03-14T06:00:24.0847837Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0848044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0848335Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1457 counts during 1388 steps 2025-03-14T06:00:24.0848341Z 2025-03-14T06:00:24.0848551Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0848662Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0848979Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0849088Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0849300Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0849464Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0849616Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0849783Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0850147Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0850500Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0850817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0851090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0851403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0851670Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0851972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0852094Z Execution Analysis: (:1) 2025-03-14T06:00:24.0852358Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0852561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0852567Z 2025-03-14T06:00:24.0852776Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0852892Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0853129Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0853237Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0853452Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0853592Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0853743Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0853911Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0854506Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0855077Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0855470Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0855845Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0856167Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0856440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0856755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0857022Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0857243Z Execution Analysis: .......... 2025-03-14T06:00:24.0857482Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0857681Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0857950Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1458 counts during 1389 steps 2025-03-14T06:00:24.0857957Z 2025-03-14T06:00:24.0858155Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0858285Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0858560Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0858663Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0858881Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0859014Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0859154Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0859309Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0859646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0859970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0860265Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0860519Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0860808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0861057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0861332Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0861446Z Execution Analysis: (:1) 2025-03-14T06:00:24.0861690Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0861875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0861888Z 2025-03-14T06:00:24.0862074Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0862185Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0862398Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0862508Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0862696Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0862840Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0862975Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0863137Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0863678Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0864236Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0864603Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0864937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0865224Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0865773Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0866083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0866356Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0866459Z Execution Analysis: .......... 2025-03-14T06:00:24.0866727Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0866928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0867226Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1459 counts during 1390 steps 2025-03-14T06:00:24.0867231Z 2025-03-14T06:00:24.0867484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0867610Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0867932Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0868050Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0868252Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0868407Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0868548Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0868724Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0869079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0869438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0869749Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0870030Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0870338Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0870616Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0870909Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0871043Z Execution Analysis: (:1) 2025-03-14T06:00:24.0871298Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0871510Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0871516Z 2025-03-14T06:00:24.0871716Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0871838Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0872067Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0872186Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0872391Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0872543Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0872690Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0872866Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0873454Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0874072Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0874465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0874832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0875146Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0875428Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0875733Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0876013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0876118Z Execution Analysis: .......... 2025-03-14T06:00:24.0876386Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0876588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0876909Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1460 counts during 1391 steps 2025-03-14T06:00:24.0876914Z 2025-03-14T06:00:24.0877127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0877242Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0877566Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0877676Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0877984Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0878133Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0878273Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0878444Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0878791Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0879140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0879450Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0879713Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0880017Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0880278Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0880570Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0880694Z Execution Analysis: (:1) 2025-03-14T06:00:24.0880948Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0881145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0881149Z 2025-03-14T06:00:24.0881349Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0881457Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0881688Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0881796Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0882000Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0882139Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0882287Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0882448Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0883058Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0883640Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0883999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0884337Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0884712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0885143Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0885457Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0885728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0885844Z Execution Analysis: .......... 2025-03-14T06:00:24.0886100Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0886310Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0886626Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1461 counts during 1392 steps 2025-03-14T06:00:24.0886631Z 2025-03-14T06:00:24.0886867Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0886980Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0887277Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0887388Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0887600Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0887744Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0887895Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0888062Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0888428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0888779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0889097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0889370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0889685Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0889951Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0890249Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0890374Z Execution Analysis: (:1) 2025-03-14T06:00:24.0890643Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0890844Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0890850Z 2025-03-14T06:00:24.0891059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0891170Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0891409Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0891517Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0891729Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0891869Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0892021Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0892214Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0892809Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0893408Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0893774Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0894126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0894444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0894716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0895028Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0895299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0895417Z Execution Analysis: .......... 2025-03-14T06:00:24.0895671Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0895903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0896200Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1462 counts during 1393 steps 2025-03-14T06:00:24.0896205Z 2025-03-14T06:00:24.0896429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0896555Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0896949Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0897067Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0897266Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0897413Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0897553Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0897727Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0898074Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0898427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0898733Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0899006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0899301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0899569Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0899853Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0899982Z Execution Analysis: (:1) 2025-03-14T06:00:24.0900233Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0900435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0900439Z 2025-03-14T06:00:24.0900635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0900751Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0900974Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0901087Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0901284Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0901464Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0901605Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0901776Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0902372Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0902939Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0903288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0903638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0903940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0904216Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0904515Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0904786Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0904890Z Execution Analysis: .......... 2025-03-14T06:00:24.0905244Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0905441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0905755Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1463 counts during 1394 steps 2025-03-14T06:00:24.0905760Z 2025-03-14T06:00:24.0905954Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0906077Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0906360Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0906481Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0906677Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0906828Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0906965Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0907141Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0907583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0907922Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0908208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0908467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0908750Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0909007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0909277Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0909403Z Execution Analysis: (:1) 2025-03-14T06:00:24.0909642Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0909835Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0909839Z 2025-03-14T06:00:24.0910023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0910133Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0910344Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0910452Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0910666Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0910807Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0910964Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0911126Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0911672Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0912207Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0912539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0912874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0913167Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0913421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0913716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0913964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0914090Z Execution Analysis: .......... 2025-03-14T06:00:24.0914328Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0914542Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0914811Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1464 counts during 1395 steps 2025-03-14T06:00:24.0914815Z 2025-03-14T06:00:24.0915007Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0915110Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0915383Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0915487Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0915682Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0915817Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0915960Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0916112Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0916455Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0916783Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0917081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0917339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0917636Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0917891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0918343Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0918470Z Execution Analysis: (:1) 2025-03-14T06:00:24.0918730Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0918928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0918933Z 2025-03-14T06:00:24.0919139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0919251Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0919486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0919624Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0919996Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0920163Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0920317Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0920488Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0921090Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0921664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0922040Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0922393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0922722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0922999Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0923318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0923610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0923730Z Execution Analysis: .......... 2025-03-14T06:00:24.0924010Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0924222Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0924596Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1465 counts during 1396 steps 2025-03-14T06:00:24.0924602Z 2025-03-14T06:00:24.0924820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0924999Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0925299Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0925437Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0925648Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0925812Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0925973Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0926157Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0926525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0926890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0927245Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0927531Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0927855Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0928595Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0929296Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0929846Z Execution Analysis: (:1) 2025-03-14T06:00:24.0930353Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0930944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0931272Z 2025-03-14T06:00:24.0931479Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0931927Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0932405Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0932868Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0933309Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0933814Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0934223Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0934651Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0935526Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0936809Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0937859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0938694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0939476Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0940192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0940922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0941632Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0942138Z Execution Analysis: .......... 2025-03-14T06:00:24.0942632Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0943218Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0943836Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1466 counts during 1397 steps 2025-03-14T06:00:24.0944255Z 2025-03-14T06:00:24.0944458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0944904Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0945412Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0945946Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0946357Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0946820Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0947223Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0947652Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0948298Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0949126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0949916Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0950630Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0951332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0952036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0952720Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0953257Z Execution Analysis: (:1) 2025-03-14T06:00:24.0953758Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0954446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0954759Z 2025-03-14T06:00:24.0954972Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0955429Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0955859Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0956329Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0956719Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0957178Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0957572Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0957982Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0958837Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0960091Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0961113Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0961930Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0962689Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0963412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0964103Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0965058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0965686Z Execution Analysis: .......... 2025-03-14T06:00:24.0966145Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0966728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0967351Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1467 counts during 1398 steps 2025-03-14T06:00:24.0967775Z 2025-03-14T06:00:24.0967982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0968428Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0968938Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0969464Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0969874Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0970338Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0970740Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0971164Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0971807Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0972634Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0973425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0974141Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0974849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0975556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0976245Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0976787Z Execution Analysis: (:1) 2025-03-14T06:00:24.0977280Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0977859Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0978240Z 2025-03-14T06:00:24.0978453Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0978894Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0979384Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.0979843Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0980254Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.0980717Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.0981123Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.0981542Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0982412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.0983693Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.0984741Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.0985571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0986357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0987212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0987986Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0988660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0989126Z Execution Analysis: .......... 2025-03-14T06:00:24.0989544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.0990084Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0990660Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1468 counts during 1399 steps 2025-03-14T06:00:24.0991046Z 2025-03-14T06:00:24.0991233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.0991642Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.0992111Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.0992593Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.0992974Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.0993404Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.0993777Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.0994173Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.0994767Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.0995543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.0996458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.0997153Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.0997841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.0998528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.0999200Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.0999724Z Execution Analysis: (:1) 2025-03-14T06:00:24.1000202Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1000763Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1001102Z 2025-03-14T06:00:24.1001310Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1001766Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1002202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1002650Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1003051Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1003505Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1003888Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1004471Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1005459Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1006793Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1007855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1008699Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1009528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1010249Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1010992Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1011708Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1012217Z Execution Analysis: .......... 2025-03-14T06:00:24.1012685Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1013278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1013914Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1469 counts during 1400 steps 2025-03-14T06:00:24.1014344Z 2025-03-14T06:00:24.1014554Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1015006Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1015520Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1016056Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1016475Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1016941Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1017342Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1017769Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1018415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1019252Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1020044Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1020756Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1021463Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1022175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1022865Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1023406Z Execution Analysis: (:1) 2025-03-14T06:00:24.1023904Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1024521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1024874Z 2025-03-14T06:00:24.1025089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1025535Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1025986Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1026453Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1026865Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1027339Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1027741Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1028178Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1029056Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1030348Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1031409Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1032287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1033082Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1033822Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1034540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1035251Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1035757Z Execution Analysis: .......... 2025-03-14T06:00:24.1036217Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1036809Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1037429Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1470 counts during 1401 steps 2025-03-14T06:00:24.1037847Z 2025-03-14T06:00:24.1038053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1038498Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1039010Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1039535Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1039947Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1040414Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1040821Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1041250Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1041898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1042735Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1043528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1044239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1045036Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1045741Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1046431Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1046978Z Execution Analysis: (:1) 2025-03-14T06:00:24.1047512Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1048102Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1048459Z 2025-03-14T06:00:24.1048677Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1049132Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1049588Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1050059Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1050475Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1050933Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1051344Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1051775Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1052657Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1053942Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1055027Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1055867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1056681Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1057505Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1058196Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1058891Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1059395Z Execution Analysis: .......... 2025-03-14T06:00:24.1059852Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1060439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1061049Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1471 counts during 1402 steps 2025-03-14T06:00:24.1061461Z 2025-03-14T06:00:24.1061661Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1062099Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1062606Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1063128Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1063530Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1063993Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1064394Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1064821Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1065569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1066577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1067374Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1068093Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1068807Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1069514Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1070202Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1070806Z Execution Analysis: (:1) 2025-03-14T06:00:24.1071304Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1071925Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1072249Z 2025-03-14T06:00:24.1072462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1072905Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1073357Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1073821Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1074224Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1074690Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1075099Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1075532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1076412Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1077737Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1078800Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1079668Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1080473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1081186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1081894Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1082604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1083111Z Execution Analysis: .......... 2025-03-14T06:00:24.1083572Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1084160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1084851Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1473 counts during 1403 steps 2025-03-14T06:00:24.1085277Z 2025-03-14T06:00:24.1085485Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1085933Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1086448Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1086984Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1087400Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1087874Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1088281Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1088711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1089359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1090196Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1090987Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1091705Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1092415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1093122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1093848Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1094394Z Execution Analysis: (:1) 2025-03-14T06:00:24.1094915Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1095503Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1095827Z 2025-03-14T06:00:24.1096037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1096483Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1096933Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1097491Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1097892Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1098346Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1098746Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1099164Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1100020Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1101294Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1102325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1103154Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1103931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1104632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1105333Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1106021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1106518Z Execution Analysis: .......... 2025-03-14T06:00:24.1106965Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1107532Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1108140Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1474 counts during 1404 steps 2025-03-14T06:00:24.1108550Z 2025-03-14T06:00:24.1108750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1109186Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1109682Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1110208Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1110618Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1111087Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1111490Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1111916Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1112555Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1113381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1114165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1114868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1115567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1116687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1117371Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1117953Z Execution Analysis: (:1) 2025-03-14T06:00:24.1118446Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1119035Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1119354Z 2025-03-14T06:00:24.1119574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1120020Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1120456Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1120916Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1121325Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1121790Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1122198Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1122629Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1123510Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1124844Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1126152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1126993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1127794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1128510Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1129222Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1129933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1130439Z Execution Analysis: .......... 2025-03-14T06:00:24.1130904Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1131498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1132127Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1475 counts during 1405 steps 2025-03-14T06:00:24.1132553Z 2025-03-14T06:00:24.1132758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1133207Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1133721Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1134253Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1134674Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1135144Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1135554Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1135988Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1136637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1137478Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1138271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1138992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1139706Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1140442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1141164Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1141710Z Execution Analysis: (:1) 2025-03-14T06:00:24.1142214Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1142795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1143136Z 2025-03-14T06:00:24.1143352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1143789Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1144241Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1144711Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1145127Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1145597Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1146011Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1146446Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1147352Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1148666Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1149727Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1150568Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1151368Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1152091Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1152911Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1153603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1154101Z Execution Analysis: .......... 2025-03-14T06:00:24.1154553Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1155127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1155740Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1476 counts during 1406 steps 2025-03-14T06:00:24.1156151Z 2025-03-14T06:00:24.1156354Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1156798Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1157300Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1157818Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1158226Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1158691Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1159089Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1165746Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1166489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1167339Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1168134Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1168841Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1169659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1170402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1171088Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1171633Z Execution Analysis: (:1) 2025-03-14T06:00:24.1172126Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1172714Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1173046Z 2025-03-14T06:00:24.1173248Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1173684Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1174124Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1174588Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1174990Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1175451Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1175857Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1176319Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1177309Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1178637Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1179607Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1180374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1181100Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1181756Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1182402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1183042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1183499Z Execution Analysis: .......... 2025-03-14T06:00:24.1183919Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1184452Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1185016Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1477 counts during 1407 steps 2025-03-14T06:00:24.1185390Z 2025-03-14T06:00:24.1185586Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1185989Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1186454Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1186933Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1187310Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1187738Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1188104Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1188502Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1189083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1189849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1190572Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1191251Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1191926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1192771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1193443Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1193972Z Execution Analysis: (:1) 2025-03-14T06:00:24.1194454Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1195016Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1195337Z 2025-03-14T06:00:24.1195534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1195965Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1196390Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1196835Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1197233Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1197681Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1198102Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1198516Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1199400Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1200643Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1201669Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1202478Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1203249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1204123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1204928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1205658Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1206159Z Execution Analysis: .......... 2025-03-14T06:00:24.1206612Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1207192Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1207805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1478 counts during 1408 steps 2025-03-14T06:00:24.1208214Z 2025-03-14T06:00:24.1208423Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1208861Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1209358Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1209878Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1210279Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1210737Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1211131Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1211542Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1212179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1213006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1213836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1214568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1215280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1215989Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1216687Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1217345Z Execution Analysis: (:1) 2025-03-14T06:00:24.1217833Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1218412Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1218741Z 2025-03-14T06:00:24.1218942Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1219383Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1219830Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1220295Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1220706Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1221202Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1221611Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1222042Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1222929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1224191Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1225231Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1226061Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1226847Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1227561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1228262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1228962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1229460Z Execution Analysis: .......... 2025-03-14T06:00:24.1229916Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1230499Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1231117Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1479 counts during 1409 steps 2025-03-14T06:00:24.1231521Z 2025-03-14T06:00:24.1231743Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1232186Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1232684Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1233202Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1233604Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1234066Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1234452Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1234873Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1235505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1236351Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1237130Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1237912Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1238615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1239306Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1240090Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1240602Z Execution Analysis: (:1) 2025-03-14T06:00:24.1241068Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1241617Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1241929Z 2025-03-14T06:00:24.1242120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1242537Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1242762Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1242867Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1243093Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1243232Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1243382Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1243562Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1244126Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1244740Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1245272Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1245632Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1245964Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1246245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1246572Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1246848Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1246975Z Execution Analysis: .......... 2025-03-14T06:00:24.1247240Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1247461Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1247757Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1480 counts during 1410 steps 2025-03-14T06:00:24.1247765Z 2025-03-14T06:00:24.1247984Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1248103Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1248405Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1248519Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1248735Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1248881Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1249039Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1249208Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1249582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1249966Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1250318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1250596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1250917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1251189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1251494Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1251621Z Execution Analysis: (:1) 2025-03-14T06:00:24.1251893Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1252099Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1252104Z 2025-03-14T06:00:24.1252319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1252434Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1252704Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1252819Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1253035Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1253207Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1253365Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1253533Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1254140Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1254716Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1255091Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1255455Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1255770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1256059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1256369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1256650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1256760Z Execution Analysis: .......... 2025-03-14T06:00:24.1257031Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1257336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1257623Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1481 counts during 1411 steps 2025-03-14T06:00:24.1257627Z 2025-03-14T06:00:24.1257817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1257941Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1258213Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1258327Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1258517Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1258664Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1258800Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1258974Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1259332Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1259696Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1259990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1260255Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1260547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1260813Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1261085Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1261218Z Execution Analysis: (:1) 2025-03-14T06:00:24.1261459Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1261662Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1261668Z 2025-03-14T06:00:24.1261857Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1262001Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1262217Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1262330Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1262558Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1262706Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1262844Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1263014Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1263562Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1264107Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1264443Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1264785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1265079Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1265471Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1265935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1266213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1266324Z Execution Analysis: .......... 2025-03-14T06:00:24.1266590Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1266790Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1267091Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1482 counts during 1412 steps 2025-03-14T06:00:24.1267098Z 2025-03-14T06:00:24.1267299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1267421Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1267710Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1267826Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1268028Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1268175Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1268371Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1268546Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1268940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1269299Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1269610Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1269890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1270195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1270469Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1270760Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1270894Z Execution Analysis: (:1) 2025-03-14T06:00:24.1271148Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1271361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1271365Z 2025-03-14T06:00:24.1271598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1271713Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1271950Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1272089Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1272304Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1272448Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1272591Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1272767Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1273367Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1273947Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1274315Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1274670Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1274993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1275268Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1275580Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1275854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1275964Z Execution Analysis: .......... 2025-03-14T06:00:24.1276229Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1276437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1276728Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1483 counts during 1413 steps 2025-03-14T06:00:24.1276732Z 2025-03-14T06:00:24.1276938Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1277053Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1277347Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1277456Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1277663Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1277940Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1278085Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1278272Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1278623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1278965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1279273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1279543Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1279846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1280107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1280397Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1280522Z Execution Analysis: (:1) 2025-03-14T06:00:24.1280782Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1280979Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1281007Z 2025-03-14T06:00:24.1281209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1281319Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1281567Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1281675Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1281880Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1282019Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1282165Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1282328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1282906Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1283469Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1283824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1284166Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1284522Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1284801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1285273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1285540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1285655Z Execution Analysis: .......... 2025-03-14T06:00:24.1285910Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1286118Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1286407Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1484 counts during 1414 steps 2025-03-14T06:00:24.1286421Z 2025-03-14T06:00:24.1286622Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1286734Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1287031Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1287142Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1287385Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1287526Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1287699Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1287868Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1288233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1288585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1288905Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1289176Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1289488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1289762Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1290052Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1290183Z Execution Analysis: (:1) 2025-03-14T06:00:24.1290439Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1290668Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1290672Z 2025-03-14T06:00:24.1290871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1291013Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1291243Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1291357Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1291568Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1291715Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1291863Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1292039Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1292631Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1293209Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1293571Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1293924Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1294237Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1294513Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1294819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1295093Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1295200Z Execution Analysis: .......... 2025-03-14T06:00:24.1295468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1295666Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1295965Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1485 counts during 1415 steps 2025-03-14T06:00:24.1295969Z 2025-03-14T06:00:24.1296171Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1296292Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1296580Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1296720Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1296923Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1297205Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1297344Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1297518Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1297863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1298213Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1298519Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1298792Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1299090Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1299358Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1299640Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1299766Z Execution Analysis: (:1) 2025-03-14T06:00:24.1300047Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1300247Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1300251Z 2025-03-14T06:00:24.1300465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1300578Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1300800Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1300913Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1301113Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1301255Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1301392Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1301563Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1302136Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1302702Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1303054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1303405Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1303709Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1303980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1304278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1304544Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1304648Z Execution Analysis: .......... 2025-03-14T06:00:24.1304901Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1305094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1305382Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1486 counts during 1416 steps 2025-03-14T06:00:24.1305387Z 2025-03-14T06:00:24.1305588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1305697Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1306010Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1306114Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1306345Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1306484Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1306625Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1306786Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1307140Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1307577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1307865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1308115Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1308400Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1308648Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1308920Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1309062Z Execution Analysis: (:1) 2025-03-14T06:00:24.1309307Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1309517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1309521Z 2025-03-14T06:00:24.1309710Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1309815Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1310032Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1310136Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1310329Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1310463Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1310603Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1310759Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1311308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1311840Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1312177Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1312502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1312804Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1313056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1313345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1313592Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1313693Z Execution Analysis: .......... 2025-03-14T06:00:24.1313933Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1314122Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1314389Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1487 counts during 1417 steps 2025-03-14T06:00:24.1314393Z 2025-03-14T06:00:24.1314583Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1314712Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1314989Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1315118Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1315313Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1315450Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1315587Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1315740Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1316077Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1316401Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1316691Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1316943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1317235Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1317480Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1317776Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1317890Z Execution Analysis: (:1) 2025-03-14T06:00:24.1318130Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1318333Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1318337Z 2025-03-14T06:00:24.1318525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1318628Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1318847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1318945Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1319137Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1319267Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1319405Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1319557Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1320108Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1320633Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1320965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1321288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1321580Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1321837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1322120Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1322375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1322469Z Execution Analysis: .......... 2025-03-14T06:00:24.1322711Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1322896Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1323166Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1488 counts during 1418 steps 2025-03-14T06:00:24.1323194Z 2025-03-14T06:00:24.1323380Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1323514Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1323781Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1323885Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1324075Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1324212Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1324340Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1324564Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1325060Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1325412Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1325722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1325996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1326301Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1326615Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1326907Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1327035Z Execution Analysis: (:1) 2025-03-14T06:00:24.1327319Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1327525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1327530Z 2025-03-14T06:00:24.1327729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1327846Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1328079Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1328198Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1328403Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1328551Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1328698Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1328873Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1329464Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1330038Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1330394Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1330748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1331061Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1331340Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1331645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1331922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1332029Z Execution Analysis: .......... 2025-03-14T06:00:24.1332295Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1332495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1332817Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1489 counts during 1419 steps 2025-03-14T06:00:24.1332822Z 2025-03-14T06:00:24.1333025Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1333180Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1333466Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1333585Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1333787Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1333936Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1334080Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1334259Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1334611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1334970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1335283Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1335563Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1335871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1336169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1336459Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1336615Z Execution Analysis: (:1) 2025-03-14T06:00:24.1336870Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1337075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1337079Z 2025-03-14T06:00:24.1337379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1337487Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1337701Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1337806Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1337993Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1338131Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1338263Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1338424Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1338962Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1339666Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1340022Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1340365Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1340677Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1341108Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1341421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1341689Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1341807Z Execution Analysis: .......... 2025-03-14T06:00:24.1342062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1342269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1342581Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1490 counts during 1420 steps 2025-03-14T06:00:24.1342609Z 2025-03-14T06:00:24.1342816Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1342927Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1343224Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1343331Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1343541Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1343680Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1343827Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1343992Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1344353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1344702Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1345020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1345290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1345625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1345901Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1346252Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1346376Z Execution Analysis: (:1) 2025-03-14T06:00:24.1346636Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1346834Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1346840Z 2025-03-14T06:00:24.1347044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1347158Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1347389Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1347502Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1347708Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1347848Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1347998Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1348165Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1348760Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1349331Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1349704Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1350057Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1350376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1350653Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1350969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1351241Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1351355Z Execution Analysis: .......... 2025-03-14T06:00:24.1351613Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1351849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1352164Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1491 counts during 1421 steps 2025-03-14T06:00:24.1352169Z 2025-03-14T06:00:24.1352384Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1352497Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1352794Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1352908Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1353121Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1353263Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1353413Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1353579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1353944Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1354399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1354719Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1355008Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1355315Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1355602Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1355891Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1356013Z Execution Analysis: (:1) 2025-03-14T06:00:24.1356271Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1356480Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1356486Z 2025-03-14T06:00:24.1356681Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1356801Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1357027Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1357142Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1357341Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1357489Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1357629Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1357800Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1358371Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1359025Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1359361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1359690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1359978Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1360242Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1360524Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1360785Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1360884Z Execution Analysis: .......... 2025-03-14T06:00:24.1361149Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1361334Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1361629Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1492 counts during 1422 steps 2025-03-14T06:00:24.1361633Z 2025-03-14T06:00:24.1361819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1361932Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1362199Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1362305Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1362496Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1362635Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1362767Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1362934Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1363260Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1363599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1363908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1364169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1364558Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1364824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1365274Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1365529Z Execution Analysis: (:1) 2025-03-14T06:00:24.1365847Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1366056Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1366062Z 2025-03-14T06:00:24.1366267Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1366392Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1366625Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1366746Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1366953Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1367106Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1367251Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1367427Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1368017Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1368602Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1368963Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1369324Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1369643Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1369927Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1370236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1370512Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1370684Z Execution Analysis: .......... 2025-03-14T06:00:24.1370951Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1371191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1371496Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1494 counts during 1423 steps 2025-03-14T06:00:24.1371501Z 2025-03-14T06:00:24.1371720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1371837Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1372138Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1372249Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1372457Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1372601Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1372746Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1372924Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1373283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1373675Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1373997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1374300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1374615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1374884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1375180Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1375308Z Execution Analysis: (:1) 2025-03-14T06:00:24.1375576Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1375777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1375782Z 2025-03-14T06:00:24.1375989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1376102Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1376337Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1376450Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1376657Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1376799Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1376951Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1377228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1377895Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1378425Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1378766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1379094Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1379389Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1379641Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1379930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1380203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1380308Z Execution Analysis: .......... 2025-03-14T06:00:24.1380569Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1380762Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1381031Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1495 counts during 1424 steps 2025-03-14T06:00:24.1381036Z 2025-03-14T06:00:24.1381231Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1381338Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1381615Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1381716Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1381914Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1382049Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1382189Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1382345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1382686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1383031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1383350Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1383600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1383891Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1384134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1384415Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1384531Z Execution Analysis: (:1) 2025-03-14T06:00:24.1384778Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1384964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1384968Z 2025-03-14T06:00:24.1385162Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1385266Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1385486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1385585Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1385780Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1385911Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1386055Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1386207Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1386761Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1387290Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1387627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1387953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1388252Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1388504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1388846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1389099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1389220Z Execution Analysis: .......... 2025-03-14T06:00:24.1389462Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1389650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1389924Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1496 counts during 1425 steps 2025-03-14T06:00:24.1389929Z 2025-03-14T06:00:24.1390116Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1390227Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1390497Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1390605Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1390795Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1390937Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1391067Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1391231Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1391582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1391915Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1392225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1392487Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1392774Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1393030Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1393297Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1393418Z Execution Analysis: (:1) 2025-03-14T06:00:24.1393657Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1393853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1393856Z 2025-03-14T06:00:24.1394041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1394156Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1394368Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1394477Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1394666Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1394813Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1394946Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1395110Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1395653Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1396407Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1396758Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1397107Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1397411Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1397704Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1398002Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1398294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1398396Z Execution Analysis: .......... 2025-03-14T06:00:24.1398653Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1398848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1399138Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1497 counts during 1426 steps 2025-03-14T06:00:24.1399143Z 2025-03-14T06:00:24.1399338Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1399455Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1399733Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1399849Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1400049Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1400196Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1400335Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1400533Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1400882Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1401270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1401574Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1401848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1402145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1402414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1402695Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1402825Z Execution Analysis: (:1) 2025-03-14T06:00:24.1403074Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1403282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1403288Z 2025-03-14T06:00:24.1403477Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1403593Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1403814Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1403927Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1404124Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1404270Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1404410Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1404688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1405436Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1406022Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1406386Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1406736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1407057Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1407362Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1407700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1407971Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1408082Z Execution Analysis: .......... 2025-03-14T06:00:24.1408337Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1408544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1408833Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1498 counts during 1427 steps 2025-03-14T06:00:24.1408838Z 2025-03-14T06:00:24.1409044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1409159Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1409453Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1409563Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1409771Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1409914Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1410092Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1410262Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1410648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1411000Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1411318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1411589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1411903Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1412172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1412472Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1412599Z Execution Analysis: (:1) 2025-03-14T06:00:24.1412860Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1413062Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1413066Z 2025-03-14T06:00:24.1413275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1413388Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1413626Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1413739Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1413950Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1414092Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1414247Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1414415Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1415008Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1415580Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1415945Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1416294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1416642Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1416938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1417350Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1417599Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1417705Z Execution Analysis: .......... 2025-03-14T06:00:24.1417945Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1418137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1418404Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1499 counts during 1428 steps 2025-03-14T06:00:24.1418408Z 2025-03-14T06:00:24.1418602Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1418708Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1418984Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1419083Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1419301Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1419431Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1419571Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1419747Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1420083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1420407Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1420702Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1420952Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1421246Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1421491Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1421770Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1421882Z Execution Analysis: (:1) 2025-03-14T06:00:24.1422130Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1422312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1422324Z 2025-03-14T06:00:24.1422506Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1422620Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1422834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1422941Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1423132Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1423261Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1423404Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1423557Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1424113Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1424650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1424982Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1425334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1425645Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1425904Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1426188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1426445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1426544Z Execution Analysis: .......... 2025-03-14T06:00:24.1426792Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1426976Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1427250Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1500 counts during 1429 steps 2025-03-14T06:00:24.1427256Z 2025-03-14T06:00:24.1427445Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1427558Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1427823Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1427951Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1428139Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1428276Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1428686Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1428852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1429182Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1429516Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1429806Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1430062Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1430348Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1430606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1430876Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1431002Z Execution Analysis: (:1) 2025-03-14T06:00:24.1431238Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1431432Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1431436Z 2025-03-14T06:00:24.1431622Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1431734Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1431943Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1432051Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1432237Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1432376Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1432518Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1432683Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1433231Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1433766Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1434124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1434458Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1434771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1435040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1435322Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1435584Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1435682Z Execution Analysis: .......... 2025-03-14T06:00:24.1435934Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1436121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1436403Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1501 counts during 1430 steps 2025-03-14T06:00:24.1436408Z 2025-03-14T06:00:24.1436595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1436716Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1437018Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1437134Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1437324Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1437492Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1437624Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1437788Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1438120Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1438460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1438751Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1439020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1439315Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1439562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1439844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1439960Z Execution Analysis: (:1) 2025-03-14T06:00:24.1440211Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1440399Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1440405Z 2025-03-14T06:00:24.1440599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1440706Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1440931Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1441035Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1441239Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1441373Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1441515Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1441671Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1442225Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1442756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1443124Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1443470Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1443773Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1444022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1444319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1444655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1444767Z Execution Analysis: .......... 2025-03-14T06:00:24.1445170Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1445383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1445675Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1502 counts during 1431 steps 2025-03-14T06:00:24.1445681Z 2025-03-14T06:00:24.1445915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1446053Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1446355Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1446462Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1446701Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1446846Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1447005Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1447171Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1447539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1447891Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1448212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1448487Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1448805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1449071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1449375Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1449500Z Execution Analysis: (:1) 2025-03-14T06:00:24.1449767Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1449968Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1449973Z 2025-03-14T06:00:24.1450182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1450298Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1450535Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1450644Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1450857Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1450999Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1451155Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1451319Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1451919Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1452530Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1452934Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1453283Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1453607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1453885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1454205Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1454473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1454593Z Execution Analysis: .......... 2025-03-14T06:00:24.1454850Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1455068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1455359Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1503 counts during 1432 steps 2025-03-14T06:00:24.1455374Z 2025-03-14T06:00:24.1455599Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1455731Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1456024Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1456168Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1456373Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1456525Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1456666Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1456839Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1457299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1457634Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1457921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1458190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1458473Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1458732Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1459002Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1459124Z Execution Analysis: (:1) 2025-03-14T06:00:24.1459361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1459556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1459562Z 2025-03-14T06:00:24.1459749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1459866Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1460078Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1460185Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1460374Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1460512Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1460646Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1460814Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1461354Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1461919Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1462271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1462605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1462890Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1463155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1463439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1463696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1463794Z Execution Analysis: .......... 2025-03-14T06:00:24.1464042Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1464228Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1464507Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1504 counts during 1433 steps 2025-03-14T06:00:24.1464534Z 2025-03-14T06:00:24.1464721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1464834Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1465119Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1465232Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1465549Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1465864Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1466007Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1466188Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1466546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1466911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1467223Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1467510Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1467819Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1468099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1468388Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1468523Z Execution Analysis: (:1) 2025-03-14T06:00:24.1468781Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1468997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1469001Z 2025-03-14T06:00:24.1469201Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1469325Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1469552Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1469678Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1469882Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1470037Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1470185Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1470364Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1471011Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1471639Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1471999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1472359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1472686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1472958Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1473275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1473543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1473660Z Execution Analysis: .......... 2025-03-14T06:00:24.1473923Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1474134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1474462Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1505 counts during 1434 steps 2025-03-14T06:00:24.1474468Z 2025-03-14T06:00:24.1474714Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1474831Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1475133Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1475245Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1475459Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1475604Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1475755Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1475924Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1476295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1476649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1476970Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1477247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1477568Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1477837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1478348Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1478468Z Execution Analysis: (:1) 2025-03-14T06:00:24.1478723Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1478912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1478916Z 2025-03-14T06:00:24.1479113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1479220Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1479447Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1479552Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1479750Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1479882Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1480030Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1480208Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1480764Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1481320Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1481659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1481988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1482289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1482542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1482836Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1483086Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1483199Z Execution Analysis: .......... 2025-03-14T06:00:24.1483436Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1483658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1483926Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1506 counts during 1435 steps 2025-03-14T06:00:24.1483931Z 2025-03-14T06:00:24.1484155Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1484264Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1484604Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1484708Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1485077Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1485219Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1485374Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1485543Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1485921Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1486268Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1486592Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1486863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1487180Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1487446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1487748Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1487874Z Execution Analysis: (:1) 2025-03-14T06:00:24.1488143Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1488344Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1488356Z 2025-03-14T06:00:24.1488558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1488673Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1488915Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1489024Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1489243Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1489387Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1489579Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1489746Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1490370Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1490952Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1491313Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1491678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1491990Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1492275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1492587Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1492866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1492971Z Execution Analysis: .......... 2025-03-14T06:00:24.1493266Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1493468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1493792Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1507 counts during 1436 steps 2025-03-14T06:00:24.1493798Z 2025-03-14T06:00:24.1494002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1494126Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1494415Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1494537Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1494740Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1494897Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1495037Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1495213Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1495571Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1495934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1496244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1496526Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1496836Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1497120Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1497522Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1497660Z Execution Analysis: (:1) 2025-03-14T06:00:24.1497913Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1498121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1498125Z 2025-03-14T06:00:24.1498323Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1498447Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1498672Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1498790Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1498987Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1499165Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1499306Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1499501Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1500079Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1500641Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1500990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1501342Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1501644Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1501926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1502226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1502506Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1502632Z Execution Analysis: .......... 2025-03-14T06:00:24.1502892Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1503109Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1503406Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1508 counts during 1437 steps 2025-03-14T06:00:24.1503410Z 2025-03-14T06:00:24.1503604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1503727Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1504010Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1504131Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1504334Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1504485Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1504625Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1504799Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1505148Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1505503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1505805Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1506087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1506385Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1506660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1506947Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1507082Z Execution Analysis: (:1) 2025-03-14T06:00:24.1507334Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1507545Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1507549Z 2025-03-14T06:00:24.1507757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1507870Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1508106Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1508254Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1508459Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1508626Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1508777Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1508940Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1509525Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1510190Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1510534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1510860Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1511163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1511416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1511713Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1511986Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1512097Z Execution Analysis: .......... 2025-03-14T06:00:24.1512339Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1512559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1512825Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1509 counts during 1438 steps 2025-03-14T06:00:24.1512830Z 2025-03-14T06:00:24.1513029Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1513136Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1513414Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1513519Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1513720Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1513854Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1514000Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1514153Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1514493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1514819Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1515116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1515369Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1515664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1515914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1516197Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1516312Z Execution Analysis: (:1) 2025-03-14T06:00:24.1516564Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1516753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1516757Z 2025-03-14T06:00:24.1516956Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1517063Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1517315Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1517421Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1517646Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1517780Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1517930Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1518089Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1518654Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1519188Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1519534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1519862Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1520169Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1520429Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1520753Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1521006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1521115Z Execution Analysis: .......... 2025-03-14T06:00:24.1521379Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1521581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1521855Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1510 counts during 1439 steps 2025-03-14T06:00:24.1521872Z 2025-03-14T06:00:24.1522064Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1522187Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1522461Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1522578Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1522773Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1522909Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1523057Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1523218Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1523567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1524071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1524391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1524745Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1525220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1525502Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1525801Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1525942Z Execution Analysis: (:1) 2025-03-14T06:00:24.1526207Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1526425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1526430Z 2025-03-14T06:00:24.1526633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1526791Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1527027Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1527180Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1527386Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1527539Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1527690Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1527869Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1528462Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1529046Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1529405Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1529771Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1530088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1530373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1530707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1530988Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1531197Z Execution Analysis: .......... 2025-03-14T06:00:24.1531466Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1531668Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1531970Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1511 counts during 1440 steps 2025-03-14T06:00:24.1531976Z 2025-03-14T06:00:24.1532180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1532312Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1532604Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1532728Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1532935Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1533093Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1533240Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1533422Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1533782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1534146Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1534465Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1534756Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1535069Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1535350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1535645Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1535786Z Execution Analysis: (:1) 2025-03-14T06:00:24.1536049Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1536261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1536266Z 2025-03-14T06:00:24.1536499Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1536629Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1536892Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1537015Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1537322Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1537467Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1537607Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1537776Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1538326Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1538870Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1539210Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1539552Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1539844Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1540133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1540421Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1540716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1540822Z Execution Analysis: .......... 2025-03-14T06:00:24.1541075Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1541277Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1541550Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1512 counts during 1441 steps 2025-03-14T06:00:24.1541556Z 2025-03-14T06:00:24.1541757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1541866Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1542146Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1542251Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1542457Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1542594Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1542741Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1542899Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1543242Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1543571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1543875Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1544136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1544438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1544691Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1544975Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1545096Z Execution Analysis: (:1) 2025-03-14T06:00:24.1545350Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1545537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1545568Z 2025-03-14T06:00:24.1545768Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1545901Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1546126Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1546232Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1546436Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1546575Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1546727Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1546884Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1547442Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1547978Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1548322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1548652Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1548976Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1549234Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1549552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1549804Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1549916Z Execution Analysis: .......... 2025-03-14T06:00:24.1550156Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1550360Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1550634Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1513 counts during 1442 steps 2025-03-14T06:00:24.1550640Z 2025-03-14T06:00:24.1550841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1550952Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1551233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1551340Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1551542Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1551678Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1551823Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1551982Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1552333Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1552664Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1552966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1553224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1553524Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1553776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1554059Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1554182Z Execution Analysis: (:1) 2025-03-14T06:00:24.1554433Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1554650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1554676Z 2025-03-14T06:00:24.1554875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1554990Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1555217Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1555324Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1555530Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1555669Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1555820Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1555978Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1556539Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1561779Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1562184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1562583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1562887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1563176Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1563468Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1563717Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1563827Z Execution Analysis: .......... 2025-03-14T06:00:24.1564070Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1564271Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1564638Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1515 counts during 1443 steps 2025-03-14T06:00:24.1564658Z 2025-03-14T06:00:24.1564848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1565137Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1565569Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1565691Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1565895Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1566049Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1566190Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1566361Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1566728Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1567089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1567402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1567683Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1567990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1568270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1568562Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1568695Z Execution Analysis: (:1) 2025-03-14T06:00:24.1569024Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1569237Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1569277Z 2025-03-14T06:00:24.1569477Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1569599Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1569829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1569952Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1570162Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1570314Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1570459Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1570632Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1571230Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1571812Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1572207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1572567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1572911Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1573196Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1573498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1573772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1573877Z Execution Analysis: .......... 2025-03-14T06:00:24.1574148Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1574349Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1574653Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1516 counts during 1444 steps 2025-03-14T06:00:24.1574659Z 2025-03-14T06:00:24.1574859Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1574981Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1575268Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1575386Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1575587Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1575736Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1575877Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1576054Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1576414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1576778Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1577088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1577580Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1577862Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1578114Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1578382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1578530Z Execution Analysis: (:1) 2025-03-14T06:00:24.1578765Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1578983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1578987Z 2025-03-14T06:00:24.1579172Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1579285Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1579496Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1579608Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1579795Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1579936Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1580067Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1580230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1580772Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1581310Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1581683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1582042Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1582330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1582593Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1582885Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1583134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1583239Z Execution Analysis: .......... 2025-03-14T06:00:24.1583480Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1583674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1583941Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1517 counts during 1445 steps 2025-03-14T06:00:24.1583945Z 2025-03-14T06:00:24.1584140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1584244Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1584521Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1584621Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1584819Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1584954Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1585096Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1585254Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1585593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1585916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1586217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1586469Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1586765Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1587011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1587320Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1587438Z Execution Analysis: (:1) 2025-03-14T06:00:24.1587710Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1587893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1587897Z 2025-03-14T06:00:24.1588092Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1588194Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1588422Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1588522Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1588721Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1588850Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1588993Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1589143Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1589702Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1590255Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1590600Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1590942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1591239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1591489Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1591783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1592027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1592139Z Execution Analysis: .......... 2025-03-14T06:00:24.1592372Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1592568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1592837Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1518 counts during 1446 steps 2025-03-14T06:00:24.1592843Z 2025-03-14T06:00:24.1593039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1593141Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1593414Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1593519Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1593716Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1593847Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1593988Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1594141Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1594482Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1594804Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1595101Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1595352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1595640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1596075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1596366Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1596512Z Execution Analysis: (:1) 2025-03-14T06:00:24.1596769Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1596967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1596971Z 2025-03-14T06:00:24.1597173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1597281Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1597509Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1597613Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1597816Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1597954Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1598100Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1598263Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1598842Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1599427Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1599809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1600156Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1600459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1600737Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1601034Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1601304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1601410Z Execution Analysis: .......... 2025-03-14T06:00:24.1601680Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1601880Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1602179Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1519 counts during 1447 steps 2025-03-14T06:00:24.1602185Z 2025-03-14T06:00:24.1602384Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1602511Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1602797Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1602922Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1603124Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1603280Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1603422Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1603603Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1603951Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1604313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1604714Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1605163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1605474Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1605796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1606125Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1606269Z Execution Analysis: (:1) 2025-03-14T06:00:24.1606533Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1606753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1606757Z 2025-03-14T06:00:24.1606964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1607097Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1607334Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1607464Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1607673Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1607833Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1607986Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1608171Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1608796Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1609409Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1609777Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1610142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1610457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1610752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1611065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1611351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1611464Z Execution Analysis: .......... 2025-03-14T06:00:24.1611740Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1611950Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1612264Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1520 counts during 1448 steps 2025-03-14T06:00:24.1612269Z 2025-03-14T06:00:24.1612475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1612610Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1612903Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1613034Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1613246Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1613407Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1613554Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1613737Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1614101Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1614472Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1614789Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1615074Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1615416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1615734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1616027Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1616170Z Execution Analysis: (:1) 2025-03-14T06:00:24.1616432Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1616651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1616655Z 2025-03-14T06:00:24.1616869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1616987Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1617332Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1617438Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1617643Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1617779Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1617917Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1618084Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1618672Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1619229Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1619577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1619906Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1620216Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1620474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1620777Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1621032Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1621146Z Execution Analysis: .......... 2025-03-14T06:00:24.1621388Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1621591Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1621863Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1521 counts during 1449 steps 2025-03-14T06:00:24.1621868Z 2025-03-14T06:00:24.1622071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1622183Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1622465Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1622570Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1622774Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1622912Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1623060Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1623220Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1623570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1623897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1624201Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1624489Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1624785Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1625061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1625346Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1625465Z Execution Analysis: (:1) 2025-03-14T06:00:24.1625722Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1625912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1625916Z 2025-03-14T06:00:24.1626119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1626229Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1626459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1626564Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1626770Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1626906Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1627079Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1627237Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1627822Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1628353Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1628703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1629033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1629338Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1629596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1629901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1630153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1630268Z Execution Analysis: .......... 2025-03-14T06:00:24.1630508Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1630709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1630984Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1522 counts during 1450 steps 2025-03-14T06:00:24.1630990Z 2025-03-14T06:00:24.1631190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1631299Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1631581Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1631688Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1631894Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1632030Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1632179Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1632337Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1632682Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1633009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1633338Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1633595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1633917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1634188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1634460Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1634590Z Execution Analysis: (:1) 2025-03-14T06:00:24.1634834Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1635035Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1635039Z 2025-03-14T06:00:24.1635227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1635350Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1635564Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1635683Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1635875Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1636045Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1636184Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1636352Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1636924Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1637467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1637804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1638143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1638437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1638708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1638995Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1639256Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1639359Z Execution Analysis: .......... 2025-03-14T06:00:24.1639616Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1639805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1640089Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1523 counts during 1451 steps 2025-03-14T06:00:24.1640093Z 2025-03-14T06:00:24.1640287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1640407Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1640680Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1640799Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1640993Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1641145Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1641280Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1641454Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1641789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1642129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1642442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1642733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1643022Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1643284Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1643560Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1643691Z Execution Analysis: (:1) 2025-03-14T06:00:24.1643933Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1644135Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1644140Z 2025-03-14T06:00:24.1644327Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1644450Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1644752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1644874Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1645281Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1645448Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1645596Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1645801Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1646422Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1647009Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1647370Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1647736Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1648050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1648336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1648647Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1648928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1649038Z Execution Analysis: .......... 2025-03-14T06:00:24.1649310Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1649515Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1649822Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1524 counts during 1452 steps 2025-03-14T06:00:24.1649829Z 2025-03-14T06:00:24.1650039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1650156Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1650457Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1650572Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1650785Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1650931Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1651084Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1651254Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1651625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1652021Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1652368Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1652646Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1652967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1653238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1653540Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1653667Z Execution Analysis: (:1) 2025-03-14T06:00:24.1653935Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1654141Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1654147Z 2025-03-14T06:00:24.1654362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1654480Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1654724Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1654861Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1655080Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1655226Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1655407Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1655576Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1656177Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1656757Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1657237Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1657563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1657864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1658120Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1658413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1658666Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1658771Z Execution Analysis: .......... 2025-03-14T06:00:24.1659012Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1659210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1659482Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1525 counts during 1453 steps 2025-03-14T06:00:24.1659486Z 2025-03-14T06:00:24.1659684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1659791Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1660069Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1660176Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1660375Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1660512Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1660656Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1660813Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1661180Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1661529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1661828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1662085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1662378Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1662628Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1662909Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1663026Z Execution Analysis: (:1) 2025-03-14T06:00:24.1663272Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1663461Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1663467Z 2025-03-14T06:00:24.1663663Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1663767Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1664010Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1664113Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1664333Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1664468Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1664612Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1664934Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1665825Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1666403Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1666772Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1667126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1667454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1667740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1668052Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1668335Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1668448Z Execution Analysis: .......... 2025-03-14T06:00:24.1668717Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1668923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1669226Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1526 counts during 1454 steps 2025-03-14T06:00:24.1669233Z 2025-03-14T06:00:24.1669437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1669560Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1669853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1669974Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1670180Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1670334Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1670479Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1670720Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1671082Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1671477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1671794Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1672083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1672392Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1672677Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1672971Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1673109Z Execution Analysis: (:1) 2025-03-14T06:00:24.1673367Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1673581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1673585Z 2025-03-14T06:00:24.1674050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1674180Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1674413Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1674566Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1674772Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1674927Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1675074Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1675250Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1675842Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1676425Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1676788Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1677148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1677466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1677752Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1678060Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1678342Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1678452Z Execution Analysis: .......... 2025-03-14T06:00:24.1678721Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1678927Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1679231Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1527 counts during 1455 steps 2025-03-14T06:00:24.1679236Z 2025-03-14T06:00:24.1679438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1679559Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1679850Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1679970Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1680173Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1680355Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1680501Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1680676Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1681059Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1681421Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1681838Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1682121Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1682418Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1682688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1682972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1683106Z Execution Analysis: (:1) 2025-03-14T06:00:24.1683356Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1683565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1683569Z 2025-03-14T06:00:24.1683864Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1683987Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1684249Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1684370Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1684640Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1684796Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1685104Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1685286Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1685876Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1686464Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1686831Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1687185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1687505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1687781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1688095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1688369Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1688485Z Execution Analysis: .......... 2025-03-14T06:00:24.1688746Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1688960Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1689252Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1528 counts during 1456 steps 2025-03-14T06:00:24.1689257Z 2025-03-14T06:00:24.1689467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1689583Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1689884Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1689996Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1690237Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1690379Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1690556Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1690726Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1691093Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1691447Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1691768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1692042Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1692361Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1692633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1692937Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1693069Z Execution Analysis: (:1) 2025-03-14T06:00:24.1693338Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1693573Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1693577Z 2025-03-14T06:00:24.1693787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1693929Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1694172Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1694286Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1694499Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1694647Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1694804Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1694976Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1695577Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1696154Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1696527Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1696879Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1697201Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1697478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1697798Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1698071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1698188Z Execution Analysis: .......... 2025-03-14T06:00:24.1698449Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1698662Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1698956Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1529 counts during 1457 steps 2025-03-14T06:00:24.1698960Z 2025-03-14T06:00:24.1699175Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1699288Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1699590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1699727Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1699943Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1700222Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1700371Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1700534Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1700894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1701235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1701547Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1701812Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1702124Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1702387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1702682Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1702805Z Execution Analysis: (:1) 2025-03-14T06:00:24.1703091Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1703287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1703302Z 2025-03-14T06:00:24.1703521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1703641Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1703867Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1703989Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1704189Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1704338Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1704481Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1704658Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1705235Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1705800Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1706151Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1706498Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1706803Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1707083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1707385Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1707657Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1707764Z Execution Analysis: .......... 2025-03-14T06:00:24.1708026Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1708223Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1708514Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1530 counts during 1458 steps 2025-03-14T06:00:24.1708518Z 2025-03-14T06:00:24.1708716Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1708837Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1709145Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1709260Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1709484Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1709632Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1709772Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1709944Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1710296Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1710648Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1710952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1711226Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1711531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1711802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1712091Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1712220Z Execution Analysis: (:1) 2025-03-14T06:00:24.1712499Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1712733Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1712737Z 2025-03-14T06:00:24.1712935Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1713057Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1713283Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1713402Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1713601Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1713749Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1713892Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1714066Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1714638Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1715208Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1715560Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1715909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1716215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1716491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1716790Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1717060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1717162Z Execution Analysis: .......... 2025-03-14T06:00:24.1717423Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1717620Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1717912Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1531 counts during 1459 steps 2025-03-14T06:00:24.1717916Z 2025-03-14T06:00:24.1718119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1718254Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1718545Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1718677Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1718873Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1719024Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1719160Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1719333Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1719681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1720032Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1720451Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1720706Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1720998Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1721249Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1721562Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1721679Z Execution Analysis: (:1) 2025-03-14T06:00:24.1721926Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1722137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1722141Z 2025-03-14T06:00:24.1722332Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1722440Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1722664Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1722770Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1722965Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1723102Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1723245Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1723402Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1723960Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1724566Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1725076Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1725432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1725757Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1726095Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1726410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1726680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1726796Z Execution Analysis: .......... 2025-03-14T06:00:24.1727056Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1727263Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1727556Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1532 counts during 1460 steps 2025-03-14T06:00:24.1727561Z 2025-03-14T06:00:24.1727804Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1727920Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1728244Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1728356Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1728571Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1728717Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1728866Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1729036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1729402Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1729755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1730074Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1730350Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1730668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1730935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1731261Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1731391Z Execution Analysis: (:1) 2025-03-14T06:00:24.1731684Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1731889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1731894Z 2025-03-14T06:00:24.1732108Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1732223Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1732471Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1732586Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1732803Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1732948Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1733106Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1733278Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1733885Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1734461Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1734832Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1735188Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1735515Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1735790Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1736111Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1736386Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1736513Z Execution Analysis: .......... 2025-03-14T06:00:24.1736778Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1736993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1737399Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1533 counts during 1461 steps 2025-03-14T06:00:24.1737428Z 2025-03-14T06:00:24.1737620Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1737765Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1738039Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1738160Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1738353Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1738499Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1738634Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1738805Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1739137Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1739477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1739772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1740040Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1740332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1740625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1740898Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1741051Z Execution Analysis: (:1) 2025-03-14T06:00:24.1741292Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1741494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1741498Z 2025-03-14T06:00:24.1741686Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1741803Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1742021Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1742137Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1742329Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1742476Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1742611Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1742778Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1743325Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1743871Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1744207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1744547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1744838Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1745104Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1745391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1745650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1745751Z Execution Analysis: .......... 2025-03-14T06:00:24.1745998Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1746187Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1746492Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1534 counts during 1462 steps 2025-03-14T06:00:24.1746520Z 2025-03-14T06:00:24.1746709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1746825Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1747098Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1747212Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1747401Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1747547Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1747682Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1747849Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1748179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1748522Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1748815Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1749085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1749396Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1749662Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1749958Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1750091Z Execution Analysis: (:1) 2025-03-14T06:00:24.1750332Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1750530Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1750536Z 2025-03-14T06:00:24.1750723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1750843Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1751062Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1751175Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1751365Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1751509Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1751648Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1751814Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1752360Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1752898Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1753236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1753575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1753878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1754133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1754430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1754680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1754791Z Execution Analysis: .......... 2025-03-14T06:00:24.1755030Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1755258Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1755564Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1536 counts during 1463 steps 2025-03-14T06:00:24.1755569Z 2025-03-14T06:00:24.1755768Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1755876Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1756156Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1756261Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1756461Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1756595Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1756736Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1756894Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1757244Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1757571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1757874Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1758150Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1758448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1758722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1759002Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1759123Z Execution Analysis: (:1) 2025-03-14T06:00:24.1759373Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1759564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1759568Z 2025-03-14T06:00:24.1759932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1760048Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1760286Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1760396Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1760607Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1760748Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1760898Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1761065Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1761650Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1762213Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1762575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1762919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1763238Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1763511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1763822Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1764085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1764202Z Execution Analysis: .......... 2025-03-14T06:00:24.1764551Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1764762Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1765253Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1537 counts during 1464 steps 2025-03-14T06:00:24.1765257Z 2025-03-14T06:00:24.1765730Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1765849Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1766156Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1766268Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1766488Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1766630Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1766786Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1766959Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1767328Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1767685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1768069Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1768346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1768700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1768976Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1769280Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1769407Z Execution Analysis: (:1) 2025-03-14T06:00:24.1769680Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1769887Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1769904Z 2025-03-14T06:00:24.1770108Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1770237Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1770469Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1770584Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1770800Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1770947Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1771109Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1771278Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1771879Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1772462Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1772829Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1773198Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1773517Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1773803Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1774114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1774397Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1774539Z Execution Analysis: .......... 2025-03-14T06:00:24.1774807Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1775044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1775351Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1538 counts during 1465 steps 2025-03-14T06:00:24.1775355Z 2025-03-14T06:00:24.1775556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1775686Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1775980Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1776106Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1776311Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1776473Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1776621Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1776803Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1777167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1777639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1777972Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1778253Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1778584Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1778861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1779151Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1779289Z Execution Analysis: (:1) 2025-03-14T06:00:24.1779541Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1779752Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1779756Z 2025-03-14T06:00:24.1779959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1780089Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1780318Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1780442Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1780647Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1780802Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1780948Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1781126Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1781706Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1782373Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1782710Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1783051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1783345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1783613Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1783899Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1784186Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1784286Z Execution Analysis: .......... 2025-03-14T06:00:24.1784564Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1784754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1785039Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1539 counts during 1466 steps 2025-03-14T06:00:24.1785043Z 2025-03-14T06:00:24.1785234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1785350Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1785621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1785735Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1785927Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1786068Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1786200Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1786366Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1786697Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1787054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1787344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1787630Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1787918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1788176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1788462Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1788579Z Execution Analysis: (:1) 2025-03-14T06:00:24.1788827Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1789014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1789020Z 2025-03-14T06:00:24.1789219Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1789324Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1789553Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1789655Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1789854Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1789988Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1790138Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1790296Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1790853Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1791387Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1791732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1792060Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1792355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1792610Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1792952Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1793202Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1793331Z Execution Analysis: .......... 2025-03-14T06:00:24.1793571Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1793771Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1794042Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1540 counts during 1467 steps 2025-03-14T06:00:24.1794047Z 2025-03-14T06:00:24.1794245Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1794355Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1794634Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1794737Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1794942Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1795079Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1795222Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1795382Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1795753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1796256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1796596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1796867Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1797177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1797441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1797737Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1797862Z Execution Analysis: (:1) 2025-03-14T06:00:24.1798128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1798326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1798330Z 2025-03-14T06:00:24.1798539Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1798654Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1798890Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1799000Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1799212Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1799356Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1799513Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1799684Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1800268Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1800833Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1801193Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1801536Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1801851Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1802119Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1802453Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1802743Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1802856Z Execution Analysis: .......... 2025-03-14T06:00:24.1803109Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1803318Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1803605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1541 counts during 1468 steps 2025-03-14T06:00:24.1803621Z 2025-03-14T06:00:24.1803819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1803945Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1804227Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1804348Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1804641Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1804798Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1805102Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1805302Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1805676Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1806062Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1806376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1806660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1806970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1807254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1807548Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1807684Z Execution Analysis: (:1) 2025-03-14T06:00:24.1807946Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1808160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1808164Z 2025-03-14T06:00:24.1808368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1808495Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1808728Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1808847Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1809055Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1809210Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1809360Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1809538Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1810130Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1810717Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1811081Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1811441Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1811758Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1812072Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1812406Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1812683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1812793Z Execution Analysis: .......... 2025-03-14T06:00:24.1813062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1813267Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1813576Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1542 counts during 1469 steps 2025-03-14T06:00:24.1813581Z 2025-03-14T06:00:24.1813785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1813919Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1814211Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1814335Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1814542Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1814699Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1814873Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1815055Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1815440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1815804Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1816120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1816405Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1816717Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1817090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1817364Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1817489Z Execution Analysis: (:1) 2025-03-14T06:00:24.1817735Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1817939Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1817943Z 2025-03-14T06:00:24.1818132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1818251Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1818468Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1818588Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1818779Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1818930Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1819069Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1819241Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1819792Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1820338Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1820673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1821012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1821329Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1821618Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1821915Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1822171Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1822283Z Execution Analysis: .......... 2025-03-14T06:00:24.1822531Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1822732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1823007Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1543 counts during 1470 steps 2025-03-14T06:00:24.1823012Z 2025-03-14T06:00:24.1823216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1823327Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1823612Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1823719Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1823930Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1824091Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1824237Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1824396Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1824778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1825107Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1825412Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1825673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1825973Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1826229Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1826516Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1826637Z Execution Analysis: (:1) 2025-03-14T06:00:24.1826891Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1827081Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1827085Z 2025-03-14T06:00:24.1827286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1827398Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1827626Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1827729Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1827928Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1828066Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1828216Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1828375Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1828929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1829456Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1829799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1830153Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1830454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1830805Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1831100Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1831354Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1831465Z Execution Analysis: .......... 2025-03-14T06:00:24.1831705Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1831904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1832178Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1544 counts during 1471 steps 2025-03-14T06:00:24.1832184Z 2025-03-14T06:00:24.1832385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1832495Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1832774Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1832880Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1833102Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1833241Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1833391Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1833571Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1833917Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1834243Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1834548Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1834802Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1835099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1835350Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1835631Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1835747Z Execution Analysis: (:1) 2025-03-14T06:00:24.1836000Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1836191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1836195Z 2025-03-14T06:00:24.1836390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1836501Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1836729Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1836836Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1837040Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1837177Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1837329Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1837487Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1838048Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1838576Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1838923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1839285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1839599Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1839865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1840153Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1840416Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1840516Z Execution Analysis: .......... 2025-03-14T06:00:24.1840765Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1840954Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1841238Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1545 counts during 1472 steps 2025-03-14T06:00:24.1841242Z 2025-03-14T06:00:24.1841431Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1841554Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1841848Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1841963Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1842155Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1842321Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1842456Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1842626Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1842958Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1843297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1843589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1843859Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1844146Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1844405Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1844763Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1845060Z Execution Analysis: (:1) 2025-03-14T06:00:24.1845325Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1845542Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1845548Z 2025-03-14T06:00:24.1845754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1845930Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1846164Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1846289Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1846498Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1846651Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1846803Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1846984Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1847575Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1848160Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1848551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1848938Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1849254Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1849537Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1849848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1850127Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1850237Z Execution Analysis: .......... 2025-03-14T06:00:24.1850505Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1850706Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1851012Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1546 counts during 1473 steps 2025-03-14T06:00:24.1851019Z 2025-03-14T06:00:24.1851221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1851349Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1851665Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1851792Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1852020Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1852178Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1852321Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1852506Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1852863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1853228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1853546Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1853832Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1854149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1854431Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1854725Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1854866Z Execution Analysis: (:1) 2025-03-14T06:00:24.1855128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1855342Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1855348Z 2025-03-14T06:00:24.1855559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1855677Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1855922Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1856037Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1856251Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1856395Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1856547Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1856729Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1857400Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1857958Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1858327Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1858655Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1858958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1859215Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1859512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1859765Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1859876Z Execution Analysis: .......... 2025-03-14T06:00:24.1860116Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1860319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1860597Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1547 counts during 1474 steps 2025-03-14T06:00:24.1860601Z 2025-03-14T06:00:24.1860836Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1860946Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1861227Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1861357Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1861562Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1861703Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1861852Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1862013Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1862361Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1862691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1862993Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1863257Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1863556Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1863811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1864099Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1864220Z Execution Analysis: (:1) 2025-03-14T06:00:24.1864471Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1864663Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1864669Z 2025-03-14T06:00:24.1864869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1864981Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1865212Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1865452Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1865833Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1865983Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1866145Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1866319Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1866926Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1867561Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1867986Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1868346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1868675Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1868953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1869281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1869555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1869678Z Execution Analysis: .......... 2025-03-14T06:00:24.1869942Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1870163Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1870450Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1548 counts during 1475 steps 2025-03-14T06:00:24.1870468Z 2025-03-14T06:00:24.1870704Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1870822Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1871152Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1871265Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1871479Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1871624Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1871777Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1871949Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1872320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1872675Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1873001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1873275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1873598Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1873884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1874177Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1874315Z Execution Analysis: (:1) 2025-03-14T06:00:24.1874576Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1874793Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1874797Z 2025-03-14T06:00:24.1875002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1875129Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1875361Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1875486Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1875696Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1875854Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1875999Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1876178Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1876801Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1877415Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1877778Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1878254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1878564Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1878845Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1879240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1879500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1879602Z Execution Analysis: .......... 2025-03-14T06:00:24.1879852Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1880041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1880345Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1549 counts during 1476 steps 2025-03-14T06:00:24.1880351Z 2025-03-14T06:00:24.1880538Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1880681Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1880952Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1881070Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1881264Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1881413Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1881550Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1881721Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1882056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1882395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1882687Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1882956Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1883248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1883513Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1883784Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1883916Z Execution Analysis: (:1) 2025-03-14T06:00:24.1884157Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1884360Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1884365Z 2025-03-14T06:00:24.1884615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1884743Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1885129Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1885256Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1885461Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1885621Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1885771Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1885988Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1886579Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1887195Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1887557Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1887920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1888233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1888522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1888833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1889121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1889231Z Execution Analysis: .......... 2025-03-14T06:00:24.1889504Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1889733Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1890038Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1550 counts during 1477 steps 2025-03-14T06:00:24.1890042Z 2025-03-14T06:00:24.1890285Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1890403Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1890702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1890815Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1891034Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1891180Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1891333Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1891503Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1891875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1892228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1892560Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1892838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1893159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1893430Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1893738Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1893865Z Execution Analysis: (:1) 2025-03-14T06:00:24.1894136Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1894339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1894343Z 2025-03-14T06:00:24.1894560Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1894680Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1894921Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1895034Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1895253Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1895397Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1895582Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1895754Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1896397Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1896977Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1897458Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1897803Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1898124Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1898396Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1898712Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1898979Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1899097Z Execution Analysis: .......... 2025-03-14T06:00:24.1899374Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1899585Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1899895Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1551 counts during 1478 steps 2025-03-14T06:00:24.1899900Z 2025-03-14T06:00:24.1900114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1900227Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1900521Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1900632Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1900845Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1900989Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1901145Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1901313Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1901674Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1902018Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1902338Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1902608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1902925Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1903192Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1903493Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1903620Z Execution Analysis: (:1) 2025-03-14T06:00:24.1903889Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1904090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1904094Z 2025-03-14T06:00:24.1904308Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1904427Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1904668Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1904779Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1904993Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1905161Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1905320Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1905510Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1906100Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1906663Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1907036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1907501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1907797Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1908068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1908356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1908624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1908728Z Execution Analysis: .......... 2025-03-14T06:00:24.1909003Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1909218Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1909503Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1552 counts during 1479 steps 2025-03-14T06:00:24.1909507Z 2025-03-14T06:00:24.1909697Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1909821Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1910095Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1910214Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1910409Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1910558Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1910694Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1910869Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1911204Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1911547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1911837Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1912106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1912395Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1912660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1912937Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1913070Z Execution Analysis: (:1) 2025-03-14T06:00:24.1913315Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1913520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1913526Z 2025-03-14T06:00:24.1913713Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1913831Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1914047Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1914164Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1914379Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1914528Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1914703Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1914870Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1915418Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1915963Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1916298Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1916636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1916929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1917198Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1917486Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1917771Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1917874Z Execution Analysis: .......... 2025-03-14T06:00:24.1918127Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1918340Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1918626Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1553 counts during 1480 steps 2025-03-14T06:00:24.1918631Z 2025-03-14T06:00:24.1918818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1918941Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1919212Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1919332Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1919523Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1919675Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1919812Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1919977Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1920312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1920651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1920944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1921209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1921494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1921761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1922033Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1922166Z Execution Analysis: (:1) 2025-03-14T06:00:24.1922408Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1922612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1922616Z 2025-03-14T06:00:24.1922815Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1922923Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1923137Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1923276Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1923468Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1923635Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1923774Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1923945Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1924572Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1925306Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1925681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1926036Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1926367Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1926645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1926970Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1927287Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1927409Z Execution Analysis: .......... 2025-03-14T06:00:24.1927697Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1927913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1928207Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1554 counts during 1481 steps 2025-03-14T06:00:24.1928212Z 2025-03-14T06:00:24.1928430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1928546Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1928855Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1928971Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1929191Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1929337Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1929496Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1929665Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1930040Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1930395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1930721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1930997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1931318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1931589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1931894Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1932023Z Execution Analysis: (:1) 2025-03-14T06:00:24.1932294Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1932498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1932503Z 2025-03-14T06:00:24.1932721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1932876Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1933120Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1933258Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1933475Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1933624Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1933788Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1933961Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1934567Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1935140Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1935515Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1935876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1936205Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1936482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1936938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1937309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1937445Z Execution Analysis: .......... 2025-03-14T06:00:24.1937686Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1937886Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1938158Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1555 counts during 1482 steps 2025-03-14T06:00:24.1938163Z 2025-03-14T06:00:24.1938364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1938474Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1938754Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1938864Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1939067Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1939203Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1939356Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1939513Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1939860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1940186Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1940492Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1940754Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1941054Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1941312Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1941600Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1941721Z Execution Analysis: (:1) 2025-03-14T06:00:24.1941971Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1942168Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1942172Z 2025-03-14T06:00:24.1942359Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1949601Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1949994Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1950099Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1950305Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1950443Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1950586Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1950742Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1951309Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1951841Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1952188Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1952518Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1952809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1953094Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1953382Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1953669Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1953766Z Execution Analysis: .......... 2025-03-14T06:00:24.1954017Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1954204Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1954481Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1557 counts during 1483 steps 2025-03-14T06:00:24.1954490Z 2025-03-14T06:00:24.1954675Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1954790Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1955058Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1955168Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1955353Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1955496Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1955627Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1955790Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1956120Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1956456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1956741Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1957000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1957285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1957543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1957815Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1957938Z Execution Analysis: (:1) 2025-03-14T06:00:24.1958178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1958372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1958403Z 2025-03-14T06:00:24.1958590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1958726Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1958938Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1959046Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1959235Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1959371Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1959503Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1959666Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1960211Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1960746Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1961078Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1961409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1961720Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1961980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1962283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1962536Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1962631Z Execution Analysis: .......... 2025-03-14T06:00:24.1962877Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1963061Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1963335Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1558 counts during 1484 steps 2025-03-14T06:00:24.1963342Z 2025-03-14T06:00:24.1963523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1963635Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1963898Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1964004Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1964192Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1964332Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1964464Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1964717Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1965223Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1965710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1966020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1966303Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1966608Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1966882Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1967171Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1967304Z Execution Analysis: (:1) 2025-03-14T06:00:24.1967558Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1967834Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1967839Z 2025-03-14T06:00:24.1968078Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1968190Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1968425Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1968535Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1968736Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1968886Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1969030Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1969206Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1969796Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1970378Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1970744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1971120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1971439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1971811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1972122Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1972389Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1972503Z Execution Analysis: .......... 2025-03-14T06:00:24.1972759Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1972965Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1973257Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1559 counts during 1485 steps 2025-03-14T06:00:24.1973262Z 2025-03-14T06:00:24.1973470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1973582Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1973883Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1973992Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1974206Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1974348Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1974501Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1974668Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1975028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1975380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1975698Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1975968Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1976280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1976544Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1976844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1976965Z Execution Analysis: (:1) 2025-03-14T06:00:24.1977339Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1977547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1977573Z 2025-03-14T06:00:24.1977762Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1977867Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1978082Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1978182Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1978380Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1978512Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1978655Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1978805Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1979357Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1979882Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1980217Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1980558Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1980876Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1981129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1981415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1981658Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1981765Z Execution Analysis: .......... 2025-03-14T06:00:24.1982001Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1982193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1982458Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1560 counts during 1486 steps 2025-03-14T06:00:24.1982463Z 2025-03-14T06:00:24.1982656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1982760Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1983037Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1983135Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1983329Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1983461Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1983598Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1983751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1984088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1984409Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1984700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1984951Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1985240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1985489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1985756Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1985899Z Execution Analysis: (:1) 2025-03-14T06:00:24.1986136Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1986350Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1986354Z 2025-03-14T06:00:24.1986538Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1986648Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1986860Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1986966Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1987152Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1987287Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1987420Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1987584Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1988135Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1988680Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1989048Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1989387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1989705Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1989975Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1990262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1990528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1990628Z Execution Analysis: .......... 2025-03-14T06:00:24.1990881Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1991071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1991362Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1561 counts during 1487 steps 2025-03-14T06:00:24.1991367Z 2025-03-14T06:00:24.1991563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1991688Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1991961Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.1992080Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1992275Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.1992426Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.1992562Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.1992737Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1993070Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.1993414Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1993706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1993977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1994269Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.1994537Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.1994812Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.1994968Z Execution Analysis: (:1) 2025-03-14T06:00:24.1995239Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.1995442Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1995448Z 2025-03-14T06:00:24.1995637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.1995762Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.1996148Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.1996277Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.1996478Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.1996638Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.1996786Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.1996970Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.1997546Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.1998146Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.1998502Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.1998888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.1999197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.1999482Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.1999785Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2000067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2000177Z Execution Analysis: .......... 2025-03-14T06:00:24.2000446Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2000649Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2000950Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1562 counts during 1488 steps 2025-03-14T06:00:24.2000955Z 2025-03-14T06:00:24.2001174Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2001291Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2001585Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2001695Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2001907Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2002048Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2002199Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2002362Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2002725Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2003068Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2003388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2003660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2003974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2004237Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2004673Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2004830Z Execution Analysis: (:1) 2025-03-14T06:00:24.2005267Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2005474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2005479Z 2025-03-14T06:00:24.2005697Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2005814Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2006058Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2006173Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2006392Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2006538Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2006703Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2006875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2007485Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2008084Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2008481Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2008837Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2009165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2009441Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2009766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2010039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2010161Z Execution Analysis: .......... 2025-03-14T06:00:24.2010423Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2010644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2010938Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1563 counts during 1489 steps 2025-03-14T06:00:24.2010944Z 2025-03-14T06:00:24.2011160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2011277Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2011578Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2011693Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2011912Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2012060Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2012217Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2012390Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2012762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2013118Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2013444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2013720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2014044Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2014344Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2014677Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2014806Z Execution Analysis: (:1) 2025-03-14T06:00:24.2015080Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2015286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2015290Z 2025-03-14T06:00:24.2015508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2015623Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2015869Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2015983Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2016205Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2016350Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2016515Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2016685Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2017406Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2017962Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2018308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2018634Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2018937Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2019209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2019497Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2019760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2019862Z Execution Analysis: .......... 2025-03-14T06:00:24.2020112Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2020301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2020583Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1564 counts during 1490 steps 2025-03-14T06:00:24.2020588Z 2025-03-14T06:00:24.2020773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2020894Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2021166Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2021284Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2021477Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2021627Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2021764Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2021934Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2022267Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2022604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2022892Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2023157Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2023466Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2023761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2024032Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2024163Z Execution Analysis: (:1) 2025-03-14T06:00:24.2024405Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2024611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2024615Z 2025-03-14T06:00:24.2024803Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2024924Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2025312Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2025435Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2025635Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2025791Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2025938Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2026115Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2026713Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2027311Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2027665Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2028024Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2028332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2028615Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2028918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2029195Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2029304Z Execution Analysis: .......... 2025-03-14T06:00:24.2029574Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2029774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2030075Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1565 counts during 1491 steps 2025-03-14T06:00:24.2030079Z 2025-03-14T06:00:24.2030279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2030405Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2030688Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2030813Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2031015Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2031171Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2031312Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2031492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2031844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2032201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2032507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2032810Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2033113Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2033415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2033703Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2033843Z Execution Analysis: (:1) 2025-03-14T06:00:24.2034096Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2034299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2034303Z 2025-03-14T06:00:24.2034498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2034618Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2034840Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2034958Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2035159Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2035304Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2035447Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2035638Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2036234Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2036800Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2037255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2037584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2037879Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2038136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2038428Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2038676Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2038780Z Execution Analysis: .......... 2025-03-14T06:00:24.2039190Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2039392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2039677Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1566 counts during 1492 steps 2025-03-14T06:00:24.2039684Z 2025-03-14T06:00:24.2039884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2039999Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2040285Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2040392Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2040593Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2040732Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2040876Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2041041Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2041391Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2041732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2042067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2042336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2042665Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2042930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2043215Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2043333Z Execution Analysis: (:1) 2025-03-14T06:00:24.2043591Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2043788Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2043793Z 2025-03-14T06:00:24.2043993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2044104Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2044336Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2044442Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2044733Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2045069Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2045224Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2045390Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2046010Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2046583Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2046947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2047297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2047615Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2047886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2048196Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2048465Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2048576Z Execution Analysis: .......... 2025-03-14T06:00:24.2048831Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2049037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2049325Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1567 counts during 1493 steps 2025-03-14T06:00:24.2049330Z 2025-03-14T06:00:24.2049534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2049647Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2049942Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2050050Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2050259Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2050403Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2050549Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2050716Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2051079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2051431Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2051775Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2052071Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2052381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2052650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2052951Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2053075Z Execution Analysis: (:1) 2025-03-14T06:00:24.2053338Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2053537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2053550Z 2025-03-14T06:00:24.2053750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2053868Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2054100Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2054215Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2054443Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2054593Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2054738Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2054926Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2055523Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2056099Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2056459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2056817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2057129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2057518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2057816Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2058085Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2058190Z Execution Analysis: .......... 2025-03-14T06:00:24.2058445Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2058647Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2058938Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1568 counts during 1494 steps 2025-03-14T06:00:24.2058945Z 2025-03-14T06:00:24.2059140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2059256Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2059539Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2059652Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2059851Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2059997Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2060136Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2060306Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2060654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2061066Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2061404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2061677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2061977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2062345Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2062616Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2062741Z Execution Analysis: (:1) 2025-03-14T06:00:24.2062978Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2063170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2063175Z 2025-03-14T06:00:24.2063358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2063472Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2063682Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2063812Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2064002Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2064137Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2064296Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2064458Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2065003Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2065824Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2066185Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2066543Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2066852Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2067132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2067438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2067714Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2067819Z Execution Analysis: .......... 2025-03-14T06:00:24.2068080Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2068283Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2068582Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1569 counts during 1495 steps 2025-03-14T06:00:24.2068588Z 2025-03-14T06:00:24.2068794Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2068904Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2069192Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2069310Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2069511Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2069660Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2069801Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2069980Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2070386Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2070745Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2071089Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2071375Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2071684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2071952Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2072251Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2072374Z Execution Analysis: (:1) 2025-03-14T06:00:24.2072636Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2072836Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2072842Z 2025-03-14T06:00:24.2073045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2073159Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2073426Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2073537Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2073745Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2073917Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2074070Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2074237Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2074835Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2075409Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2075776Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2076126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2076442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2076717Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2077029Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2077296Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2077406Z Execution Analysis: .......... 2025-03-14T06:00:24.2077772Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2078085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2078356Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1570 counts during 1496 steps 2025-03-14T06:00:24.2078364Z 2025-03-14T06:00:24.2078558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2078664Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2078940Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2079043Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2079240Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2079373Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2079513Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2079692Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2080023Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2080369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2080665Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2080916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2081210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2081460Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2081732Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2081847Z Execution Analysis: (:1) 2025-03-14T06:00:24.2082095Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2082281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2082286Z 2025-03-14T06:00:24.2082486Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2082614Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2082831Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2082934Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2083150Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2083286Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2083427Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2083581Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2084131Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2084719Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2085233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2085580Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2085908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2086182Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2086495Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2086761Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2086872Z Execution Analysis: .......... 2025-03-14T06:00:24.2087125Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2087333Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2087624Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1571 counts during 1497 steps 2025-03-14T06:00:24.2087630Z 2025-03-14T06:00:24.2087831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2087947Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2088235Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2088346Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2088545Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2088691Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2088864Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2089032Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2089416Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2089770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2090078Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2090353Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2090659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2090931Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2091219Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2091347Z Execution Analysis: (:1) 2025-03-14T06:00:24.2091604Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2091811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2091815Z 2025-03-14T06:00:24.2092039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2092160Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2092424Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2092540Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2092740Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2092888Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2093032Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2093202Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2093791Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2094372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2094732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2095093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2095404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2095684Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2095990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2096268Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2096373Z Execution Analysis: .......... 2025-03-14T06:00:24.2096635Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2096836Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2097128Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1572 counts during 1498 steps 2025-03-14T06:00:24.2097133Z 2025-03-14T06:00:24.2097444Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2097561Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2097839Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2097954Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2098151Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2098326Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2098464Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2098658Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2099006Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2099354Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2099659Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2099932Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2100230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2100497Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2100782Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2100911Z Execution Analysis: (:1) 2025-03-14T06:00:24.2101164Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2101390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2101395Z 2025-03-14T06:00:24.2101590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2101729Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2101951Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2102064Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2102261Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2102404Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2102547Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2102716Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2103291Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2103857Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2104201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2104555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2104864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2105131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2105437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2105697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2105805Z Execution Analysis: .......... 2025-03-14T06:00:24.2106057Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2106259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2106540Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1573 counts during 1499 steps 2025-03-14T06:00:24.2106544Z 2025-03-14T06:00:24.2106743Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2106850Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2107133Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2107372Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2107565Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2107717Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2107854Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2108013Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2108346Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2108669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2108963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2109217Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2109504Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2109752Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2110027Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2110144Z Execution Analysis: (:1) 2025-03-14T06:00:24.2110389Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2110598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2110602Z 2025-03-14T06:00:24.2110817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2110922Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2111142Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2111241Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2111435Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2111566Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2111705Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2111862Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2112413Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2112942Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2113282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2113604Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2113900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2114157Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2114447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2114700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2114801Z Execution Analysis: .......... 2025-03-14T06:00:24.2115041Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2115233Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2115503Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1574 counts during 1500 steps 2025-03-14T06:00:24.2115509Z 2025-03-14T06:00:24.2115700Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2115805Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2116099Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2116202Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2116418Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2116552Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2116690Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2116849Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2117184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2117510Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2117802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2118052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2118347Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2118596Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2118873Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2118989Z Execution Analysis: (:1) 2025-03-14T06:00:24.2119327Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2119517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2119553Z 2025-03-14T06:00:24.2119740Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2119859Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2120071Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2120176Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2120377Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2120508Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2120653Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2120815Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2121540Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2122109Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2122459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2122809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2123111Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2123388Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2123691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2123962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2124067Z Execution Analysis: .......... 2025-03-14T06:00:24.2124324Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2124605Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2125064Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1575 counts during 1501 steps 2025-03-14T06:00:24.2125068Z 2025-03-14T06:00:24.2125269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2125423Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2125713Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2125860Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2126065Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2126218Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2126360Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2126539Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2126896Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2127258Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2127570Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2127850Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2128161Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2128440Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2128732Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2128895Z Execution Analysis: (:1) 2025-03-14T06:00:24.2129152Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2129387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2129392Z 2025-03-14T06:00:24.2129593Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2129713Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2129942Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2130060Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2130264Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2130414Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2130560Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2130735Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2131322Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2131904Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2132263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2132620Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2132932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2133213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2133523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2133799Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2133904Z Execution Analysis: .......... 2025-03-14T06:00:24.2134172Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2134373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2134669Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1576 counts during 1502 steps 2025-03-14T06:00:24.2134673Z 2025-03-14T06:00:24.2134902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2135025Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2135338Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2135456Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2135662Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2135817Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2135959Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2136137Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2136495Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2136852Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2137162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2137440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2137748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2138021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2138337Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2138470Z Execution Analysis: (:1) 2025-03-14T06:00:24.2138751Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2138960Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2138964Z 2025-03-14T06:00:24.2139174Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2139290Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2139529Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2139641Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2139852Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2139994Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2140148Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2140313Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2140911Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2141485Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2141850Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2142201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2142523Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2142797Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2143113Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2143384Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2143499Z Execution Analysis: .......... 2025-03-14T06:00:24.2143757Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2143965Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2144256Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1578 counts during 1503 steps 2025-03-14T06:00:24.2144284Z 2025-03-14T06:00:24.2144493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2144629Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2144925Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2145037Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2145245Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2145386Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2145536Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2145703Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2146063Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2146416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2146736Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2147012Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2147324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2147621Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2147920Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2148069Z Execution Analysis: (:1) 2025-03-14T06:00:24.2148332Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2148537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2148542Z 2025-03-14T06:00:24.2148750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2148862Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2149102Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2149212Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2149422Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2149570Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2149725Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2149892Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2150490Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2151062Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2151432Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2151785Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2152103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2152377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2152693Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2152964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2153076Z Execution Analysis: .......... 2025-03-14T06:00:24.2153335Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2153541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2153856Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1579 counts during 1504 steps 2025-03-14T06:00:24.2153869Z 2025-03-14T06:00:24.2154095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2154216Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2154508Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2154628Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2154828Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2154981Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2155121Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2155290Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2155653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2156012Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2156323Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2156606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2156935Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2157216Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2157528Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2157662Z Execution Analysis: (:1) 2025-03-14T06:00:24.2157919Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2158127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2158133Z 2025-03-14T06:00:24.2158439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2158559Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2158778Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2158894Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2159092Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2159237Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2159378Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2159547Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2160120Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2160775Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2161109Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2161443Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2161733Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2161994Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2162281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2162542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2162641Z Execution Analysis: .......... 2025-03-14T06:00:24.2162889Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2163104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2163381Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1580 counts during 1505 steps 2025-03-14T06:00:24.2163419Z 2025-03-14T06:00:24.2163611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2163730Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2163997Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2164110Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2164299Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2164443Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2164660Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2164829Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2165471Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2165834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2166149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2166485Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2166794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2167107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2167401Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2167539Z Execution Analysis: (:1) 2025-03-14T06:00:24.2167798Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2168011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2168015Z 2025-03-14T06:00:24.2168216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2168338Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2168572Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2168690Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2168896Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2169046Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2169190Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2169364Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2169957Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2170543Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2170906Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2171266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2171578Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2171863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2172171Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2172446Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2172560Z Execution Analysis: .......... 2025-03-14T06:00:24.2172815Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2173055Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2173376Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1581 counts during 1506 steps 2025-03-14T06:00:24.2173380Z 2025-03-14T06:00:24.2173592Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2173703Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2173999Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2174107Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2174315Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2174456Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2174604Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2174770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2175133Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2175483Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2175832Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2176101Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2176439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2176707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2177005Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2177235Z Execution Analysis: (:1) 2025-03-14T06:00:24.2177598Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2177786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2177792Z 2025-03-14T06:00:24.2177984Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2178090Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2178309Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2178411Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2178605Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2178737Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2178877Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2179029Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2179580Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2180109Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2180450Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2180773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2181072Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2181325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2181616Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2181866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2181993Z Execution Analysis: .......... 2025-03-14T06:00:24.2182233Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2182448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2182719Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1582 counts during 1507 steps 2025-03-14T06:00:24.2182726Z 2025-03-14T06:00:24.2182919Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2183026Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2183302Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2183405Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2183602Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2183735Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2183875Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2184029Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2184367Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2184691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2185009Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2185264Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2185576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2185824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2186101Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2186221Z Execution Analysis: (:1) 2025-03-14T06:00:24.2186466Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2186654Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2186658Z 2025-03-14T06:00:24.2186851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2186959Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2187177Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2187282Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2187474Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2187605Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2187747Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2187904Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2188460Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2188990Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2189329Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2189659Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2189948Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2190209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2190491Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2190767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2190863Z Execution Analysis: .......... 2025-03-14T06:00:24.2191128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2191312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2191589Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1583 counts during 1508 steps 2025-03-14T06:00:24.2191593Z 2025-03-14T06:00:24.2191778Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2191889Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2192153Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2192261Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2192448Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2192586Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2192717Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2192878Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2193209Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2193560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2193848Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2194131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2194414Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2194667Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2194937Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2195060Z Execution Analysis: (:1) 2025-03-14T06:00:24.2195301Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2195491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2195497Z 2025-03-14T06:00:24.2195683Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2195796Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2196182Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2196299Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2196496Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2196642Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2196786Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2196960Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2197538Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2198105Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2198451Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2198804Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2199110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2199388Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2199686Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2199992Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2200125Z Execution Analysis: .......... 2025-03-14T06:00:24.2200384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2200582Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2200870Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1584 counts during 1509 steps 2025-03-14T06:00:24.2200875Z 2025-03-14T06:00:24.2201073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2201195Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2201480Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2201596Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2201796Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2201943Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2202083Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2202251Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2202627Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2202978Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2203307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2203586Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2203888Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2204156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2204443Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2204664Z Execution Analysis: (:1) 2025-03-14T06:00:24.2204919Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2205133Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2205138Z 2025-03-14T06:00:24.2205516Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2205632Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2205875Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2205985Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2206200Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2206344Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2206492Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2206674Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2207269Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2207857Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2208226Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2208574Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2208903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2209177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2209528Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2209822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2209942Z Execution Analysis: .......... 2025-03-14T06:00:24.2210201Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2210415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2210706Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1585 counts during 1510 steps 2025-03-14T06:00:24.2210710Z 2025-03-14T06:00:24.2210925Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2211040Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2211340Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2211451Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2211668Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2211813Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2211967Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2212155Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2212526Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2212899Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2213219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2213493Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2213807Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2214076Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2214382Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2214505Z Execution Analysis: (:1) 2025-03-14T06:00:24.2214774Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2214973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2214977Z 2025-03-14T06:00:24.2215191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2215304Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2215542Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2215654Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2215870Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2216013Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2216176Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2216345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2216947Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2217521Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2217889Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2218238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2218557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2218856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2219201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2219471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2219593Z Execution Analysis: .......... 2025-03-14T06:00:24.2219848Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2220062Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2220464Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1586 counts during 1511 steps 2025-03-14T06:00:24.2220468Z 2025-03-14T06:00:24.2220678Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2220787Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2221077Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2221184Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2221395Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2221531Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2221701Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2221867Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2222224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2222587Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2222899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2223166Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2223476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2223749Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2224032Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2224166Z Execution Analysis: (:1) 2025-03-14T06:00:24.2224415Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2224627Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2224631Z 2025-03-14T06:00:24.2224824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2224949Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2225172Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2225293Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2225489Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2225642Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2225782Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2225957Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2226530Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2227101Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2227544Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2227880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2228190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2228450Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2228755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2229016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2229113Z Execution Analysis: .......... 2025-03-14T06:00:24.2229361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2229543Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2229822Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1587 counts during 1512 steps 2025-03-14T06:00:24.2229826Z 2025-03-14T06:00:24.2230012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2230127Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2230393Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2230507Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2230695Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2230858Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2230987Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2231153Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2231510Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2231845Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2232129Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2232392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2232676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2232940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2233207Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2233337Z Execution Analysis: (:1) 2025-03-14T06:00:24.2233576Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2233770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2233774Z 2025-03-14T06:00:24.2233958Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2234073Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2234289Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2234400Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2234589Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2234728Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2234860Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2235026Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2235573Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2236111Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2236442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2236799Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2237088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2237370Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2237653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2237910Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2238009Z Execution Analysis: .......... 2025-03-14T06:00:24.2238255Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2238442Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2238720Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1588 counts during 1513 steps 2025-03-14T06:00:24.2238726Z 2025-03-14T06:00:24.2238924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2239030Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2239306Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2239407Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2239628Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2239765Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2239907Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2240085Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2240426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2240748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2241048Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2241300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2241592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2241841Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2242118Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2242232Z Execution Analysis: (:1) 2025-03-14T06:00:24.2242483Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2242669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2242673Z 2025-03-14T06:00:24.2242868Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2242974Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2243195Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2243297Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2243492Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2243623Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2243768Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2244093Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2244764Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2245502Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2245869Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2246250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2246599Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2246879Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2247194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2247463Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2247580Z Execution Analysis: .......... 2025-03-14T06:00:24.2247838Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2248054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2248347Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1589 counts during 1514 steps 2025-03-14T06:00:24.2248351Z 2025-03-14T06:00:24.2248572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2248690Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2248991Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2249124Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2249341Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2249486Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2249665Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2249834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2250204Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2250552Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2250877Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2251153Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2251469Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2251738Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2252039Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2252165Z Execution Analysis: (:1) 2025-03-14T06:00:24.2252431Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2252631Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2252635Z 2025-03-14T06:00:24.2252848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2252962Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2253207Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2253318Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2253532Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2253677Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2253837Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2254004Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2254604Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2255172Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2255561Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2255935Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2256255Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2256534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2256838Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2257115Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2257218Z Execution Analysis: .......... 2025-03-14T06:00:24.2257485Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2257790Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2258083Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1590 counts during 1515 steps 2025-03-14T06:00:24.2258089Z 2025-03-14T06:00:24.2258282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2258402Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2258707Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2258822Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2259039Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2259193Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2259327Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2259500Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2259844Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2260197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2260499Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2260774Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2261076Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2261346Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2261632Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2261766Z Execution Analysis: (:1) 2025-03-14T06:00:24.2262015Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2262221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2262227Z 2025-03-14T06:00:24.2262418Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2262543Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2262766Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2262882Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2263080Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2263229Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2263373Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2263545Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2264118Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2264687Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2265058Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2265796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2266109Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2266392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2266700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2266981Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2267088Z Execution Analysis: .......... 2025-03-14T06:00:24.2267358Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2267564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2267871Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1591 counts during 1516 steps 2025-03-14T06:00:24.2267875Z 2025-03-14T06:00:24.2268142Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2268271Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2268561Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2268717Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2268923Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2269078Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2269221Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2269400Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2269759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2270121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2270433Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2270720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2271025Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2271304Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2271596Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2271732Z Execution Analysis: (:1) 2025-03-14T06:00:24.2271987Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2272197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2272203Z 2025-03-14T06:00:24.2272404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2272524Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2272755Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2272875Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2273079Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2273228Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2273372Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2273546Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2274131Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2274741Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2275143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2275492Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2275815Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2276088Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2276405Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2276670Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2276787Z Execution Analysis: .......... 2025-03-14T06:00:24.2277043Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2277253Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2277545Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1592 counts during 1517 steps 2025-03-14T06:00:24.2277550Z 2025-03-14T06:00:24.2277998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2278103Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2278399Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2278499Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2278698Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2278829Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2278972Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2279127Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2279469Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2279793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2280091Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2280344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2280640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2280888Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2281170Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2281284Z Execution Analysis: (:1) 2025-03-14T06:00:24.2281533Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2281721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2281726Z 2025-03-14T06:00:24.2281923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2282028Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2282252Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2282352Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2282555Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2282685Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2282830Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2282984Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2283542Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2284115Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2284459Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2284848Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2285331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2285603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2285916Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2286185Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2286304Z Execution Analysis: .......... 2025-03-14T06:00:24.2286558Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2286770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2287086Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1593 counts during 1518 steps 2025-03-14T06:00:24.2287091Z 2025-03-14T06:00:24.2287306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2287442Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2287743Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2287852Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2288072Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2288215Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2288371Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2288539Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2288912Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2289264Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2289590Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2289869Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2290190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2290459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2290768Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2290899Z Execution Analysis: (:1) 2025-03-14T06:00:24.2291174Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2291379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2291395Z 2025-03-14T06:00:24.2291602Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2291729Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2291963Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2292088Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2292294Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2292453Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2292603Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2292797Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2293397Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2294007Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2294370Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2294740Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2295056Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2295338Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2295647Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2295931Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2296040Z Execution Analysis: .......... 2025-03-14T06:00:24.2296313Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2296541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2296847Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1594 counts during 1519 steps 2025-03-14T06:00:24.2296851Z 2025-03-14T06:00:24.2297080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2297316Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2297600Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2297719Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2297920Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2298078Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2298215Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2298386Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2298735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2299091Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2299396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2299673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2299975Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2300247Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2300535Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2300667Z Execution Analysis: (:1) 2025-03-14T06:00:24.2300924Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2301130Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2301135Z 2025-03-14T06:00:24.2301333Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2301456Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2301681Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2301797Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2301995Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2302147Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2302315Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2302488Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2303103Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2303673Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2304025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2304381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2304684Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2304960Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2305263Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2305537Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2305643Z Execution Analysis: .......... 2025-03-14T06:00:24.2305905Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2306127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2306422Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1595 counts during 1520 steps 2025-03-14T06:00:24.2306450Z 2025-03-14T06:00:24.2306660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2306772Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2307054Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2307177Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2307482Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2307628Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2307757Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2307923Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2308255Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2308590Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2308881Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2309146Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2309439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2309857Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2310154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2310280Z Execution Analysis: (:1) 2025-03-14T06:00:24.2310544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2310746Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2310751Z 2025-03-14T06:00:24.2310963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2311075Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2311312Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2311421Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2311629Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2311794Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2311945Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2312134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2312724Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2313284Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2313647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2313991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2314306Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2314574Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2314883Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2315148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2315265Z Execution Analysis: .......... 2025-03-14T06:00:24.2315541Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2315750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2316060Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1596 counts during 1521 steps 2025-03-14T06:00:24.2316064Z 2025-03-14T06:00:24.2316270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2316383Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2316676Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2316787Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2316999Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2317142Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2317294Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2317464Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2317823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2318171Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2318488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2318755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2319065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2319330Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2319627Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2319747Z Execution Analysis: (:1) 2025-03-14T06:00:24.2320011Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2320209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2320216Z 2025-03-14T06:00:24.2320425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2320537Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2320772Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2320881Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2321118Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2321258Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2321437Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2321711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2322267Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2322800Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2323143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2323468Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2323766Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2324020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2324318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2324638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2324781Z Execution Analysis: .......... 2025-03-14T06:00:24.2325193Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2325434Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2325740Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1597 counts during 1522 steps 2025-03-14T06:00:24.2325746Z 2025-03-14T06:00:24.2325964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2326094Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2326386Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2326510Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2326714Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2326866Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2327012Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2327192Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2327552Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2327907Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2328219Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2331721Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2332086Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2332367Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2332665Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2332789Z Execution Analysis: (:1) 2025-03-14T06:00:24.2333057Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2333270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2333275Z 2025-03-14T06:00:24.2333474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2333595Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2333824Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2334001Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2334205Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2334387Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2334532Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2334705Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2335300Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2335879Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2336238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2336595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2336909Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2337295Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2337576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2337853Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2337953Z Execution Analysis: .......... 2025-03-14T06:00:24.2338223Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2338410Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2338684Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1599 counts during 1523 steps 2025-03-14T06:00:24.2338689Z 2025-03-14T06:00:24.2338871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2338984Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2339255Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2339362Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2339549Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2339688Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2339819Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2339984Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2340314Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2340644Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2340930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2341188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2341470Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2341722Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2341988Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2342110Z Execution Analysis: (:1) 2025-03-14T06:00:24.2342347Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2342540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2342544Z 2025-03-14T06:00:24.2342727Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2342881Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2343091Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2343202Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2343411Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2343547Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2343682Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2343846Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2344391Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2344922Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2345249Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2345581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2345868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2346128Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2346429Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2346685Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2346801Z Execution Analysis: .......... 2025-03-14T06:00:24.2347045Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2347229Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2347500Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1600 counts during 1524 steps 2025-03-14T06:00:24.2347507Z 2025-03-14T06:00:24.2347697Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2347800Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2348069Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2348169Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2348362Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2348492Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2348623Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2348781Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2349107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2349434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2349725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2349974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2350261Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2350507Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2350781Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2350895Z Execution Analysis: (:1) 2025-03-14T06:00:24.2351138Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2351322Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2351326Z 2025-03-14T06:00:24.2351515Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2351642Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2351865Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2351987Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2352180Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2352312Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2352451Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2352602Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2353153Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2353678Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2354015Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2354334Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2354626Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2354900Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2355190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2355464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2355568Z Execution Analysis: .......... 2025-03-14T06:00:24.2355804Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2355997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2356263Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1601 counts during 1525 steps 2025-03-14T06:00:24.2356267Z 2025-03-14T06:00:24.2356460Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2356564Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2356836Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2356934Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2357125Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2357257Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2357397Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2357550Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2357884Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2358207Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2358499Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2358753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2359041Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2359288Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2359559Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2359674Z Execution Analysis: (:1) 2025-03-14T06:00:24.2359913Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2360096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2360127Z 2025-03-14T06:00:24.2360319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2360447Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2360662Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2360762Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2360958Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2361086Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2361225Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2361377Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2361923Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2362447Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2362783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2363104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2363419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2363668Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2363977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2364232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2364324Z Execution Analysis: .......... 2025-03-14T06:00:24.2364671Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2364857Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2365446Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1602 counts during 1526 steps 2025-03-14T06:00:24.2365454Z 2025-03-14T06:00:24.2365652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2365768Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2366053Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2366164Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2366365Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2366509Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2366646Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2366816Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2367167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2367521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2367830Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2368108Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2368410Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2368683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2368970Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2369095Z Execution Analysis: (:1) 2025-03-14T06:00:24.2369349Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2369619Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2369624Z 2025-03-14T06:00:24.2369825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2369990Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2370224Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2370351Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2370558Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2370715Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2370866Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2371044Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2371638Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2372222Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2372587Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2372985Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2373300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2373628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2373941Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2374221Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2374330Z Execution Analysis: .......... 2025-03-14T06:00:24.2374606Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2374812Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2375122Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1603 counts during 1527 steps 2025-03-14T06:00:24.2375127Z 2025-03-14T06:00:24.2375336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2375465Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2375758Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2375889Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2376097Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2376258Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2376402Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2376587Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2376948Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2377524Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2377817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2378087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2378377Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2378644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2378921Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2379053Z Execution Analysis: (:1) 2025-03-14T06:00:24.2379295Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2379519Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2379547Z 2025-03-14T06:00:24.2379735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2379855Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2380074Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2380192Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2380387Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2380533Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2380674Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2380839Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2381387Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2381933Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2382283Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2382627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2382930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2383210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2383502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2383753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2383867Z Execution Analysis: .......... 2025-03-14T06:00:24.2384114Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2384315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2384585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1604 counts during 1528 steps 2025-03-14T06:00:24.2384591Z 2025-03-14T06:00:24.2384788Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2384895Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2385179Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2385283Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2385480Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2385614Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2385760Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2385917Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2386261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2386587Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2386885Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2387139Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2387433Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2387682Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2387962Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2388078Z Execution Analysis: (:1) 2025-03-14T06:00:24.2388360Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2388572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2388576Z 2025-03-14T06:00:24.2388773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2388879Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2389109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2389217Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2389419Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2389556Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2389703Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2389863Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2390421Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2390957Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2391323Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2391651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2391976Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2392233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2392528Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2392777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2392889Z Execution Analysis: .......... 2025-03-14T06:00:24.2393131Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2393328Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2393602Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1605 counts during 1529 steps 2025-03-14T06:00:24.2393606Z 2025-03-14T06:00:24.2393808Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2393916Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2394197Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2394301Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2394504Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2394638Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2394782Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2394943Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2395286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2395612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2395911Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2396345Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2396658Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2396922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2397215Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2397365Z Execution Analysis: (:1) 2025-03-14T06:00:24.2397628Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2397854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2397870Z 2025-03-14T06:00:24.2398065Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2398188Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2398414Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2398535Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2398734Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2398873Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2399027Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2399195Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2399782Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2400381Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2400731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2401420Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2401732Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2402010Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2402316Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2402597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2402705Z Execution Analysis: .......... 2025-03-14T06:00:24.2402968Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2403168Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2403463Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1606 counts during 1530 steps 2025-03-14T06:00:24.2403468Z 2025-03-14T06:00:24.2403672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2403793Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2404081Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2404200Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2404401Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2404638Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2404782Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2405120Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2405480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2405841Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2406157Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2406440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2406749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2407029Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2407360Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2407520Z Execution Analysis: (:1) 2025-03-14T06:00:24.2407781Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2407995Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2407999Z 2025-03-14T06:00:24.2408203Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2408331Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2408562Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2408686Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2408890Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2409046Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2409196Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2409376Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2409975Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2410595Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2410981Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2411347Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2411664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2411949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2412261Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2412543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2412649Z Execution Analysis: .......... 2025-03-14T06:00:24.2412920Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2413125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2413429Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1607 counts during 1531 steps 2025-03-14T06:00:24.2413433Z 2025-03-14T06:00:24.2413638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2413765Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2414055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2414181Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2414389Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2414546Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2414690Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2414871Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2415228Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2415587Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2415899Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2416176Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2416480Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2416960Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2417235Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2417372Z Execution Analysis: (:1) 2025-03-14T06:00:24.2417615Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2417797Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2417801Z 2025-03-14T06:00:24.2417993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2418097Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2418312Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2418411Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2418603Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2418736Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2418875Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2419029Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2419599Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2420125Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2420479Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2420805Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2421096Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2421351Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2421639Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2421889Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2421989Z Execution Analysis: .......... 2025-03-14T06:00:24.2422226Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2422415Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2422682Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1608 counts during 1532 steps 2025-03-14T06:00:24.2422689Z 2025-03-14T06:00:24.2422883Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2422988Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2423260Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2423360Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2423552Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2423683Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2423820Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2423972Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2424303Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2424627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2424917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2425167Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2425479Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2425725Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2426021Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2426137Z Execution Analysis: (:1) 2025-03-14T06:00:24.2426380Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2426566Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2426570Z 2025-03-14T06:00:24.2426758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2426863Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2427079Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2427180Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2427371Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2427503Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2427640Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2427796Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2428367Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2428915Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2429251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2429572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2429864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2430114Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2430405Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2430654Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2430753Z Execution Analysis: .......... 2025-03-14T06:00:24.2430989Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2431181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2431447Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1609 counts during 1533 steps 2025-03-14T06:00:24.2431455Z 2025-03-14T06:00:24.2431637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2431745Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2432010Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2432116Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2432298Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2432436Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2432565Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2432724Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2433054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2433380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2433663Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2433939Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2434221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2434495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2434765Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2434882Z Execution Analysis: (:1) 2025-03-14T06:00:24.2435116Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2435309Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2435313Z 2025-03-14T06:00:24.2435495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2435605Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2435818Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2435923Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2436111Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2436248Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2436383Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2436564Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2437135Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2437667Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2437993Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2438318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2438606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2438864Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2439149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2439401Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2439496Z Execution Analysis: .......... 2025-03-14T06:00:24.2439739Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2439924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2440195Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1610 counts during 1534 steps 2025-03-14T06:00:24.2440202Z 2025-03-14T06:00:24.2440385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2440495Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2440762Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2440867Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2441056Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2441189Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2441316Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2441476Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2441805Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2442132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2442416Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2442696Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2443013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2443267Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2443539Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2443660Z Execution Analysis: (:1) 2025-03-14T06:00:24.2443895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2444086Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2444089Z 2025-03-14T06:00:24.2444272Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2444383Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2444676Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2444786Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2445141Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2445286Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2445460Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2445630Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2446242Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2446820Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2447174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2447531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2447845Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2448116Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2448424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2448692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2448804Z Execution Analysis: .......... 2025-03-14T06:00:24.2449060Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2449261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2449549Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1611 counts during 1535 steps 2025-03-14T06:00:24.2449556Z 2025-03-14T06:00:24.2449761Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2449873Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2450165Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2450274Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2450478Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2450618Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2450762Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2450929Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2451289Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2451636Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2451976Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2452271Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2452581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2452849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2453143Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2453267Z Execution Analysis: (:1) 2025-03-14T06:00:24.2453526Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2453725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2453729Z 2025-03-14T06:00:24.2453932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2454043Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2454276Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2454383Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2454612Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2454753Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2454903Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2455090Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2455681Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2456250Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2456614Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2457060Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2457351Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2457603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2457891Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2458139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2458242Z Execution Analysis: .......... 2025-03-14T06:00:24.2458480Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2458673Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2458946Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1612 counts during 1536 steps 2025-03-14T06:00:24.2458952Z 2025-03-14T06:00:24.2459143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2459250Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2459521Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2459620Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2459817Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2459948Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2460081Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2460235Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2460566Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2460915Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2461229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2461478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2461764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2462011Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2462285Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2462397Z Execution Analysis: (:1) 2025-03-14T06:00:24.2462639Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2462823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2462834Z 2025-03-14T06:00:24.2463017Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2463122Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2463338Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2463460Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2463655Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2463784Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2463946Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2464100Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2464647Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2465176Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2465787Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2466143Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2466452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2466727Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2467032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2467302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2467405Z Execution Analysis: .......... 2025-03-14T06:00:24.2467664Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2467864Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2468158Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1613 counts during 1537 steps 2025-03-14T06:00:24.2468164Z 2025-03-14T06:00:24.2468361Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2468478Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2468765Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2468877Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2469078Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2469225Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2469364Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2469535Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2469940Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2470293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2470642Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2470920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2471222Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2471496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2471784Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2471908Z Execution Analysis: (:1) 2025-03-14T06:00:24.2472162Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2472367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2472373Z 2025-03-14T06:00:24.2472571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2472686Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2472943Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2473057Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2473260Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2473433Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2473576Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2473747Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2474331Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2474906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2475263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2475618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2475929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2476203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2476507Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2476777Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2476882Z Execution Analysis: .......... 2025-03-14T06:00:24.2477144Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2477344Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2477640Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1614 counts during 1538 steps 2025-03-14T06:00:24.2477645Z 2025-03-14T06:00:24.2477847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2477965Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2478254Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2478369Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2478571Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2478718Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2478859Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2479068Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2479422Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2479796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2480105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2480384Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2480691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2480964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2481252Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2481382Z Execution Analysis: (:1) 2025-03-14T06:00:24.2481638Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2481844Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2481851Z 2025-03-14T06:00:24.2482056Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2482195Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2482430Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2482538Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2482767Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2482911Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2483063Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2483230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2483816Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2484390Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2484833Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2485185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2485501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2485772Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2486081Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2486347Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2486460Z Execution Analysis: .......... 2025-03-14T06:00:24.2486717Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2486926Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2487216Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1615 counts during 1539 steps 2025-03-14T06:00:24.2487220Z 2025-03-14T06:00:24.2487425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2487540Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2487829Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2487936Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2488144Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2488284Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2488456Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2488623Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2489010Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2489359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2489675Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2489948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2490259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2490530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2490822Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2490945Z Execution Analysis: (:1) 2025-03-14T06:00:24.2491205Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2491404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2491408Z 2025-03-14T06:00:24.2491635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2491747Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2491980Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2492114Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2492322Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2492462Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2492612Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2492778Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2493371Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2493945Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2494306Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2494657Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2494969Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2495240Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2495550Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2495816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2495924Z Execution Analysis: .......... 2025-03-14T06:00:24.2496178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2496381Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2496669Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1616 counts during 1540 steps 2025-03-14T06:00:24.2496680Z 2025-03-14T06:00:24.2496878Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2496995Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2497386Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2497490Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2497695Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2497859Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2498000Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2498188Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2498537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2498876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2499183Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2499458Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2499757Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2500025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2500310Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2500436Z Execution Analysis: (:1) 2025-03-14T06:00:24.2500689Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2500916Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2500920Z 2025-03-14T06:00:24.2501117Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2501232Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2501475Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2501592Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2501789Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2501933Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2502077Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2502247Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2502820Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2503388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2503737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2504089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2504392Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2504666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2504964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2505234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2505339Z Execution Analysis: .......... 2025-03-14T06:00:24.2505599Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2505795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2506086Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1617 counts during 1541 steps 2025-03-14T06:00:24.2506092Z 2025-03-14T06:00:24.2506287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2506404Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2506683Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2506819Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2507014Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2507158Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2507424Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2507583Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2507913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2508238Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2508526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2508785Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2509068Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2509321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2509588Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2509711Z Execution Analysis: (:1) 2025-03-14T06:00:24.2509947Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2510157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2510162Z 2025-03-14T06:00:24.2510376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2510486Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2510698Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2510803Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2510989Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2511124Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2511259Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2511418Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2511956Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2512490Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2512822Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2513148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2513438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2513698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2513979Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2514233Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2514330Z Execution Analysis: .......... 2025-03-14T06:00:24.2514574Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2514764Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2515030Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1618 counts during 1542 steps 2025-03-14T06:00:24.2515035Z 2025-03-14T06:00:24.2515224Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2515328Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2515598Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2515723Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2515914Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2516066Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2516205Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2516360Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2516693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2517016Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2517312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2517565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2517851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2518099Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2518375Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2518486Z Execution Analysis: (:1) 2025-03-14T06:00:24.2518754Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2518939Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2518943Z 2025-03-14T06:00:24.2519155Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2519260Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2519477Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2519579Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2519775Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2519905Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2520047Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2520204Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2520755Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2521283Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2521618Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2521940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2522233Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2522486Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2522777Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2523021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2523125Z Execution Analysis: .......... 2025-03-14T06:00:24.2523360Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2523550Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2523818Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1620 counts during 1543 steps 2025-03-14T06:00:24.2523822Z 2025-03-14T06:00:24.2524011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2524138Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2524408Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2524613Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2524809Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2525110Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2525263Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2525426Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2525792Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2526142Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2526458Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2526731Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2527044Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2527314Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2527614Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2527799Z Execution Analysis: (:1) 2025-03-14T06:00:24.2528069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2528299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2528303Z 2025-03-14T06:00:24.2528507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2528620Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2528857Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2528972Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2529181Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2529324Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2529477Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2529641Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2530233Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2530804Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2531167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2531518Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2531829Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2532107Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2532411Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2532683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2532786Z Execution Analysis: .......... 2025-03-14T06:00:24.2533046Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2533246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2533539Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1621 counts during 1544 steps 2025-03-14T06:00:24.2533544Z 2025-03-14T06:00:24.2533741Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2533888Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2534201Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2534315Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2534514Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2534665Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2534802Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2534975Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2535331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2535685Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2535994Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2536272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2536575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2536849Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2537269Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2537398Z Execution Analysis: (:1) 2025-03-14T06:00:24.2537669Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2537973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2537977Z 2025-03-14T06:00:24.2538164Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2538272Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2538486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2538594Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2538782Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2538919Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2539056Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2539215Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2539758Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2540294Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2540626Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2540956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2541249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2541513Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2541797Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2542058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2542157Z Execution Analysis: .......... 2025-03-14T06:00:24.2542397Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2542585Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2542861Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1622 counts during 1545 steps 2025-03-14T06:00:24.2542889Z 2025-03-14T06:00:24.2543071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2543205Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2543470Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2543578Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2543766Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2543905Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2544034Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2544195Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2544523Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2544853Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2545142Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2545398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2545684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2545974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2546244Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2546366Z Execution Analysis: (:1) 2025-03-14T06:00:24.2546625Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2546814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2546818Z 2025-03-14T06:00:24.2547008Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2547114Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2547327Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2547432Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2547619Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2547757Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2547891Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2548049Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2548592Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2549121Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2549457Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2549779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2550074Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2550325Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2550612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2550858Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2550960Z Execution Analysis: .......... 2025-03-14T06:00:24.2551197Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2551387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2551676Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1623 counts during 1546 steps 2025-03-14T06:00:24.2551680Z 2025-03-14T06:00:24.2551893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2551997Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2552268Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2552367Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2552555Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2552688Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2552826Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2552979Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2553311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2553631Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2553922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2554174Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2554481Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2554732Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2555097Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2555211Z Execution Analysis: (:1) 2025-03-14T06:00:24.2555452Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2555635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2555641Z 2025-03-14T06:00:24.2555830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2555934Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2556150Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2556250Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2556448Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2556579Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2556719Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2556873Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2557421Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2557947Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2558284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2558611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2558904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2559155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2559445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2559692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2559794Z Execution Analysis: .......... 2025-03-14T06:00:24.2560031Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2560242Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2560509Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1624 counts during 1547 steps 2025-03-14T06:00:24.2560535Z 2025-03-14T06:00:24.2560724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2560829Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2561102Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2561207Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2561401Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2561532Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2561671Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2561824Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2562158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2562481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2562772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2563027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2563338Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2563586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2563880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2563995Z Execution Analysis: (:1) 2025-03-14T06:00:24.2564237Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2564429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2564435Z 2025-03-14T06:00:24.2564691Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2564805Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2565191Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2565447Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2565652Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2565799Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2565949Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2566122Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2566709Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2567288Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2567647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2568005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2568319Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2568596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2568899Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2569175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2569279Z Execution Analysis: .......... 2025-03-14T06:00:24.2569538Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2569798Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2570129Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1625 counts during 1548 steps 2025-03-14T06:00:24.2570134Z 2025-03-14T06:00:24.2570337Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2570460Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2570747Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2570868Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2571068Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2571215Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2571354Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2571528Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2571885Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2572240Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2572549Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2572858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2573165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2573464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2573757Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2573885Z Execution Analysis: (:1) 2025-03-14T06:00:24.2574139Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2574344Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2574350Z 2025-03-14T06:00:24.2574547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2574663Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2574892Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2575013Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2575215Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2575366Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2575508Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2575678Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2576263Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2576841Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2577304Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2577650Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2577951Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2578222Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2578525Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2578791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2578919Z Execution Analysis: .......... 2025-03-14T06:00:24.2579173Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2579405Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2579689Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1626 counts during 1549 steps 2025-03-14T06:00:24.2579696Z 2025-03-14T06:00:24.2579901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2580008Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2580296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2580400Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2580601Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2580739Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2580877Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2581053Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2581398Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2581749Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2582080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2582344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2582678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2582937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2583223Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2583343Z Execution Analysis: (:1) 2025-03-14T06:00:24.2583602Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2583798Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2583803Z 2025-03-14T06:00:24.2584112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2584215Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2584433Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2584535Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2584734Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2584864Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2585008Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2585162Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2585717Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2586245Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2586588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2586911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2587210Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2587462Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2587752Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2587996Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2588127Z Execution Analysis: .......... 2025-03-14T06:00:24.2588364Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2588581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2588849Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1627 counts during 1550 steps 2025-03-14T06:00:24.2588853Z 2025-03-14T06:00:24.2589048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2589154Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2589430Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2589530Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2589721Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2589853Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2589995Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2590147Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2590487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2590832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2591125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2591397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2591689Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2591933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2592209Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2592326Z Execution Analysis: (:1) 2025-03-14T06:00:24.2592568Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2592753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2592757Z 2025-03-14T06:00:24.2592951Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2593054Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2593271Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2593371Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2593566Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2593696Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2593835Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2593991Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2594538Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2595069Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2595406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2595727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2596191Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2596453Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2596756Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2597048Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2597171Z Execution Analysis: .......... 2025-03-14T06:00:24.2597427Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2597621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2597908Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1628 counts during 1551 steps 2025-03-14T06:00:24.2597915Z 2025-03-14T06:00:24.2598109Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2598224Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2598501Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2598618Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2598815Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2598960Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2599097Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2599269Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2599637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2599988Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2600310Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2600588Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2600886Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2601154Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2601437Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2601570Z Execution Analysis: (:1) 2025-03-14T06:00:24.2601818Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2602028Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2602032Z 2025-03-14T06:00:24.2602225Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2602345Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2602565Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2602682Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2602876Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2603020Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2603162Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2603331Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2603902Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2604467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2605085Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2605448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2605759Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2606046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2606383Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2606688Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2606790Z Execution Analysis: .......... 2025-03-14T06:00:24.2607057Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2607255Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2607551Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1629 counts during 1552 steps 2025-03-14T06:00:24.2607556Z 2025-03-14T06:00:24.2607755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2607879Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2608166Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2608292Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2608493Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2608648Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2608785Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2608962Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2609339Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2609724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2610036Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2610318Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2610620Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2610897Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2611191Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2611326Z Execution Analysis: (:1) 2025-03-14T06:00:24.2611583Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2611791Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2611796Z 2025-03-14T06:00:24.2611994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2612115Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2612345Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2612460Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2612663Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2612813Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2612956Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2613130Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2613720Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2614295Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2614659Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2615006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2615324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2615630Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2615943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2616234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2616348Z Execution Analysis: .......... 2025-03-14T06:00:24.2616606Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2616820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2617212Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1630 counts during 1553 steps 2025-03-14T06:00:24.2617216Z 2025-03-14T06:00:24.2617411Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2617512Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2617784Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2617882Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2618077Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2618208Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2618344Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2618519Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2618856Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2619199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2619493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2619745Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2620038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2620287Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2620563Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2620675Z Execution Analysis: (:1) 2025-03-14T06:00:24.2620921Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2621107Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2621110Z 2025-03-14T06:00:24.2621302Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2621404Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2621624Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2621729Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2621925Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2622057Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2622199Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2622353Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2622908Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2623436Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2623773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2624097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2624414Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2624666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2624977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2625227Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2625335Z Execution Analysis: .......... 2025-03-14T06:00:24.2625573Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2625773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2626038Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1631 counts during 1554 steps 2025-03-14T06:00:24.2626043Z 2025-03-14T06:00:24.2626235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2626342Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2626616Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2626722Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2626919Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2627075Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2627214Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2627373Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2627731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2628056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2628349Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2628603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2628893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2629142Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2629417Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2629531Z Execution Analysis: (:1) 2025-03-14T06:00:24.2629775Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2629959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2629974Z 2025-03-14T06:00:24.2630157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2630269Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2630482Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2630590Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2630775Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2630914Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2631045Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2631198Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2631744Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2632279Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2632606Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2632934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2633242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2633524Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2633806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2634064Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2634158Z Execution Analysis: .......... 2025-03-14T06:00:24.2634405Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2634588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2634863Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1632 counts during 1555 steps 2025-03-14T06:00:24.2634868Z 2025-03-14T06:00:24.2635052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2635162Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2635428Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2635533Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2635889Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2636032Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2636161Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2636348Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2636674Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2637005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2637287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2637546Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2637830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2638088Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2638355Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2638478Z Execution Analysis: (:1) 2025-03-14T06:00:24.2638715Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2638908Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2638911Z 2025-03-14T06:00:24.2639094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2639205Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2639417Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2639525Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2639709Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2639845Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2639980Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2640141Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2640688Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2641221Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2641550Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2641906Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2642217Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2642480Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2642764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2643017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2643115Z Execution Analysis: .......... 2025-03-14T06:00:24.2643361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2643547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2643826Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1633 counts during 1556 steps 2025-03-14T06:00:24.2643833Z 2025-03-14T06:00:24.2644016Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2644131Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2644395Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2644621Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2644814Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2645125Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2645300Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2645477Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2645837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2646197Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2646511Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2646799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2647116Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2647384Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2647684Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2647809Z Execution Analysis: (:1) 2025-03-14T06:00:24.2648077Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2648278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2648283Z 2025-03-14T06:00:24.2648497Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2648609Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2648853Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2648961Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2649172Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2649314Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2649469Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2649635Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2650238Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2650808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2651212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2651591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2651914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2652185Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2652501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2652769Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2652884Z Execution Analysis: .......... 2025-03-14T06:00:24.2653138Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2653351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2653639Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1634 counts during 1557 steps 2025-03-14T06:00:24.2653646Z 2025-03-14T06:00:24.2653856Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2653967Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2654290Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2654398Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2654607Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2654770Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2654917Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2655083Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2655449Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2655798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2656116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2656388Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2656704Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2656969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2657365Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2657479Z Execution Analysis: (:1) 2025-03-14T06:00:24.2657719Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2657906Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2657911Z 2025-03-14T06:00:24.2658110Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2658217Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2658438Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2658539Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2658733Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2658861Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2659004Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2659158Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2659711Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2660235Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2660599Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2660943Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2661239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2661491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2661780Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2662028Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2662137Z Execution Analysis: .......... 2025-03-14T06:00:24.2662373Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2662573Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2662843Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1635 counts during 1558 steps 2025-03-14T06:00:24.2662856Z 2025-03-14T06:00:24.2663043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2663183Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2663454Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2663563Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2663777Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2663917Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2664048Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2664213Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2664548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2664882Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2665172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2665549Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2666024Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2666303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2666598Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2666731Z Execution Analysis: (:1) 2025-03-14T06:00:24.2666991Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2667200Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2667204Z 2025-03-14T06:00:24.2667410Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2667528Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2667761Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2667880Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2668087Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2668241Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2668389Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2668561Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2669150Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2669787Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2670181Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2670542Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2670858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2671140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2671445Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2671723Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2671829Z Execution Analysis: .......... 2025-03-14T06:00:24.2672097Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2672298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2672595Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1636 counts during 1559 steps 2025-03-14T06:00:24.2672599Z 2025-03-14T06:00:24.2672828Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2672955Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2673276Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2673399Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2673601Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2673754Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2673898Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2674078Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2674432Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2674791Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2675103Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2675385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2675694Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2675967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2676255Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2676386Z Execution Analysis: (:1) 2025-03-14T06:00:24.2676643Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2676851Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2676856Z 2025-03-14T06:00:24.2677053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2677179Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2677405Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2677525Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2677830Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2677969Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2678105Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2678275Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2678817Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2679376Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2679730Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2680060Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2680357Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2680611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2680901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2681148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2681253Z Execution Analysis: .......... 2025-03-14T06:00:24.2681491Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2681684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2681988Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1637 counts during 1560 steps 2025-03-14T06:00:24.2681992Z 2025-03-14T06:00:24.2682184Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2682313Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2682590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2682693Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2682884Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2683018Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2683155Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2683314Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2683652Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2683977Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2684275Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2684585Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2684886Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2685321Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2685627Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2685753Z Execution Analysis: (:1) 2025-03-14T06:00:24.2686020Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2686226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2686230Z 2025-03-14T06:00:24.2686445Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2686560Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2686800Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2686913Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2687129Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2687274Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2687430Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2687598Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2688220Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2688823Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2689189Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2689541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2689865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2690138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2690450Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2690720Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2690835Z Execution Analysis: .......... 2025-03-14T06:00:24.2691094Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2691325Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2691615Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1638 counts during 1561 steps 2025-03-14T06:00:24.2691620Z 2025-03-14T06:00:24.2691852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2691965Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2692261Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2692373Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2692586Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2692731Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2692882Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2693051Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2693417Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2693769Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2694090Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2694361Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2694678Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2694948Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2695253Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2695374Z Execution Analysis: (:1) 2025-03-14T06:00:24.2695643Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2695842Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2695858Z 2025-03-14T06:00:24.2696055Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2696166Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2696403Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2696509Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2696723Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2696860Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2697013Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2697309Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2697892Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2698480Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2698830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2699180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2699483Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2699754Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2700054Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2700322Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2700429Z Execution Analysis: .......... 2025-03-14T06:00:24.2700688Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2700981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2701269Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1639 counts during 1562 steps 2025-03-14T06:00:24.2701298Z 2025-03-14T06:00:24.2701496Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2701611Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2701892Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2705020Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2705249Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2705397Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2705536Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2705711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2706066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2706416Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2706722Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2706995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2707402Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2707653Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2708088Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2708217Z Execution Analysis: (:1) 2025-03-14T06:00:24.2708468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2708668Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2708673Z 2025-03-14T06:00:24.2708865Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2708979Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2709204Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2709314Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2709509Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2709703Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2709842Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2710037Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2710614Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2711179Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2711529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2711873Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2712176Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2712444Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2712741Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2713005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2713105Z Execution Analysis: .......... 2025-03-14T06:00:24.2713384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2713579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2713890Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1641 counts during 1563 steps 2025-03-14T06:00:24.2713896Z 2025-03-14T06:00:24.2714089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2714204Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2714480Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2714593Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2714789Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2714935Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2715068Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2715236Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2715579Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2715928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2716229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2716495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2716789Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2717057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2717338Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2717463Z Execution Analysis: (:1) 2025-03-14T06:00:24.2717710Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2717906Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2717910Z 2025-03-14T06:00:24.2718103Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2718215Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2718436Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2718542Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2718763Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2718905Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2719082Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2719247Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2720004Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2720581Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2720941Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2721290Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2721603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2721878Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2722188Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2722453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2722586Z Execution Analysis: .......... 2025-03-14T06:00:24.2722840Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2723066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2723355Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1642 counts during 1564 steps 2025-03-14T06:00:24.2723361Z 2025-03-14T06:00:24.2723565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2723678Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2723968Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2724075Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2724280Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2724420Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2724668Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2724834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2725196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2725547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2725863Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2726135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2726447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2726714Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2727012Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2727135Z Execution Analysis: (:1) 2025-03-14T06:00:24.2727398Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2727598Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2727603Z 2025-03-14T06:00:24.2727806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2727915Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2728146Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2728282Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2728485Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2728651Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2728798Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2728963Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2729556Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2730127Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2730487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2730833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2731149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2731422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2731730Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2732019Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2732129Z Execution Analysis: .......... 2025-03-14T06:00:24.2732406Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2732619Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2732905Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1643 counts during 1565 steps 2025-03-14T06:00:24.2732910Z 2025-03-14T06:00:24.2733110Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2733221Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2733511Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2733620Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2733825Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2733965Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2734109Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2734272Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2734634Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2734981Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2735294Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2735565Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2735877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2736143Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2736444Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2736565Z Execution Analysis: (:1) 2025-03-14T06:00:24.2736825Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2737132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2737142Z 2025-03-14T06:00:24.2737324Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2737430Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2737663Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2737766Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2737974Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2738101Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2738235Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2738387Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2738932Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2739459Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2739786Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2740113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2740396Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2740650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2740950Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2741200Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2741293Z Execution Analysis: .......... 2025-03-14T06:00:24.2741551Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2741737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2742005Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1644 counts during 1566 steps 2025-03-14T06:00:24.2742011Z 2025-03-14T06:00:24.2742193Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2742301Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2742564Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2742668Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2742855Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2742989Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2743116Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2743275Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2743600Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2743925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2744215Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2744474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2744761Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2745019Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2745289Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2745411Z Execution Analysis: (:1) 2025-03-14T06:00:24.2745653Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2745852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2745856Z 2025-03-14T06:00:24.2746045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2746184Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2746399Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2746531Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2746721Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2746866Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2747005Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2747169Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2747720Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2748259Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2748594Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2748934Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2749226Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2749512Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2749800Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2750087Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2750188Z Execution Analysis: .......... 2025-03-14T06:00:24.2750439Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2750626Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2750907Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1645 counts during 1567 steps 2025-03-14T06:00:24.2750912Z 2025-03-14T06:00:24.2751100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2751220Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2751490Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2751605Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2751794Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2751943Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2752078Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2752250Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2752584Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2752920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2753214Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2753479Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2753766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2754021Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2754303Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2754422Z Execution Analysis: (:1) 2025-03-14T06:00:24.2754670Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2754859Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2754899Z 2025-03-14T06:00:24.2755093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2755224Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2755452Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2755557Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2755759Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2755895Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2756038Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2756193Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2756747Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2757278Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2757621Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2757945Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2758264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2758517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2758833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2759082Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2759191Z Execution Analysis: .......... 2025-03-14T06:00:24.2759430Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2759623Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2759895Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1646 counts during 1568 steps 2025-03-14T06:00:24.2759902Z 2025-03-14T06:00:24.2760095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2760201Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2760478Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2760582Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2760786Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2760918Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2761055Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2761210Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2761552Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2761880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2762178Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2762432Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2762727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2762976Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2763256Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2763373Z Execution Analysis: (:1) 2025-03-14T06:00:24.2763622Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2763811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2763838Z 2025-03-14T06:00:24.2764033Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2764163Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2764386Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2764575Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2764777Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2765079Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2765238Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2765526Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2766126Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2766702Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2767076Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2767430Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2767818Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2768100Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2768455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2768729Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2768850Z Execution Analysis: .......... 2025-03-14T06:00:24.2769113Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2769332Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2769629Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1647 counts during 1569 steps 2025-03-14T06:00:24.2769647Z 2025-03-14T06:00:24.2769849Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2769975Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2770267Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2770393Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2770599Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2770753Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2770894Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2771065Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2771435Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2771796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2772105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2772392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2772698Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2772977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2773272Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2773404Z Execution Analysis: (:1) 2025-03-14T06:00:24.2773660Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2773905Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2773939Z 2025-03-14T06:00:24.2774140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2774260Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2774492Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2774616Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2774821Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2774976Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2775125Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2775307Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2775905Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2776526Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2776905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2777313Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2777641Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2777943Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2778272Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2778570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2778694Z Execution Analysis: .......... 2025-03-14T06:00:24.2778957Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2779171Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2779464Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1648 counts during 1570 steps 2025-03-14T06:00:24.2779469Z 2025-03-14T06:00:24.2779682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2779801Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2780106Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2780217Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2780428Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2780572Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2780727Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2780902Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2781271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2781626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2781947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2782223Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2782544Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2782818Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2783123Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2783252Z Execution Analysis: (:1) 2025-03-14T06:00:24.2783550Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2783778Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2783782Z 2025-03-14T06:00:24.2783993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2784109Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2784348Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2784458Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2784673Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2784818Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2784973Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2785142Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2785745Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2786421Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2786801Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2787145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2787495Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2787765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2788074Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2788332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2788440Z Execution Analysis: .......... 2025-03-14T06:00:24.2788687Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2788890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2789175Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1649 counts during 1571 steps 2025-03-14T06:00:24.2789186Z 2025-03-14T06:00:24.2789380Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2789496Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2789781Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2789904Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2790112Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2790262Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2790405Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2790580Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2790939Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2791287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2791596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2791863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2792169Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2792594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2792889Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2793036Z Execution Analysis: (:1) 2025-03-14T06:00:24.2793303Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2793528Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2793532Z 2025-03-14T06:00:24.2793734Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2793845Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2794082Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2794191Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2794401Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2794541Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2794689Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2794856Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2795445Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2796041Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2796404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2796779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2797095Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2797364Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2797672Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2797940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2798050Z Execution Analysis: .......... 2025-03-14T06:00:24.2798304Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2798512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2798799Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1650 counts during 1572 steps 2025-03-14T06:00:24.2798804Z 2025-03-14T06:00:24.2799010Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2799120Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2799414Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2799519Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2799728Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2799867Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2800012Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2800176Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2800536Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2800883Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2801197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2801466Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2801774Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2802038Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2802356Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2802476Z Execution Analysis: (:1) 2025-03-14T06:00:24.2802763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2802967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2802971Z 2025-03-14T06:00:24.2803168Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2803283Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2803511Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2803624Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2803824Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2803968Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2804110Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2804279Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2804958Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2805563Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2805945Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2806298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2806605Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2806885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2807191Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2807462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2807567Z Execution Analysis: .......... 2025-03-14T06:00:24.2807829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2808028Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2808324Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1651 counts during 1573 steps 2025-03-14T06:00:24.2808329Z 2025-03-14T06:00:24.2808529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2808648Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2808934Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2809054Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2809254Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2809404Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2809544Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2809717Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2810072Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2810424Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2810734Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2811012Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2811315Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2811614Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2811904Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2812061Z Execution Analysis: (:1) 2025-03-14T06:00:24.2812316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2812524Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2812529Z 2025-03-14T06:00:24.2812728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2812847Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2813074Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2813189Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2813391Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2813540Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2813682Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2813854Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2814463Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2815040Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2815422Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2815782Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2816095Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2816379Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2816794Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2817061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2817162Z Execution Analysis: .......... 2025-03-14T06:00:24.2817416Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2817613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2817900Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1652 counts during 1574 steps 2025-03-14T06:00:24.2817904Z 2025-03-14T06:00:24.2818104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2818214Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2818501Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2818605Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2818809Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2818946Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2819082Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2819251Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2819593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2819940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2820244Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2820506Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2820835Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2821093Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2821405Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2821523Z Execution Analysis: (:1) 2025-03-14T06:00:24.2821778Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2821971Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2821977Z 2025-03-14T06:00:24.2822177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2822283Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2822511Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2822614Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2822821Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2822955Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2823100Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2823259Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2823871Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2824449Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2824802Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2825140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2825449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2825713Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2826016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2826275Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2826379Z Execution Analysis: .......... 2025-03-14T06:00:24.2826626Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2826826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2827106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1653 counts during 1575 steps 2025-03-14T06:00:24.2827110Z 2025-03-14T06:00:24.2827311Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2827420Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2827709Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2827814Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2828013Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2828152Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2828292Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2828452Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2828913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2829235Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2829530Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2829780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2830092Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2830363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2830637Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2830751Z Execution Analysis: (:1) 2025-03-14T06:00:24.2830994Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2831179Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2831183Z 2025-03-14T06:00:24.2831370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2831472Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2831689Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2831789Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2831984Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2832114Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2832255Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2832433Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2832979Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2833529Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2833866Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2834189Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2834482Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2834734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2835020Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2835273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2835369Z Execution Analysis: .......... 2025-03-14T06:00:24.2835611Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2835793Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2836066Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1654 counts during 1576 steps 2025-03-14T06:00:24.2836070Z 2025-03-14T06:00:24.2836256Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2836364Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2836630Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2836736Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2836922Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2837059Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2837187Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2837346Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2837672Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2837998Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2838281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2838563Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2838867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2839116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2839381Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2839497Z Execution Analysis: (:1) 2025-03-14T06:00:24.2839735Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2839921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2839925Z 2025-03-14T06:00:24.2840105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2840216Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2840424Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2840528Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2840714Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2840849Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2841002Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2841159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2841720Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2842254Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2842582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2842911Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2843200Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2843456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2843736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2843985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2844080Z Execution Analysis: .......... 2025-03-14T06:00:24.2844321Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2844589Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2844862Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1655 counts during 1577 steps 2025-03-14T06:00:24.2844868Z 2025-03-14T06:00:24.2845228Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2845349Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2845635Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2845749Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2845950Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2846095Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2846236Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2846405Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2846757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2847109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2847449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2847813Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2848117Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2848395Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2848683Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2848813Z Execution Analysis: (:1) 2025-03-14T06:00:24.2849070Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2849279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2849283Z 2025-03-14T06:00:24.2849483Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2849608Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2849837Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2849952Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2850153Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2850324Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2850467Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2850636Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2851246Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2851822Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2852187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2852534Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2852855Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2853129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2853442Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2853707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2853818Z Execution Analysis: .......... 2025-03-14T06:00:24.2854071Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2854281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2854572Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1656 counts during 1578 steps 2025-03-14T06:00:24.2854578Z 2025-03-14T06:00:24.2854789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2854897Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2855190Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2855298Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2855506Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2855649Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2855798Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2855962Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2856322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2856693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2857008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2857416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2857717Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2857973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2858262Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2858381Z Execution Analysis: (:1) 2025-03-14T06:00:24.2858634Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2858829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2858835Z 2025-03-14T06:00:24.2859037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2859150Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2859382Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2859486Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2859715Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2859853Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2860023Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2860183Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2860762Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2861313Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2861667Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2862008Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2862318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2862581Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2862881Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2863140Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2863247Z Execution Analysis: .......... 2025-03-14T06:00:24.2863496Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2863701Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2863981Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1657 counts during 1579 steps 2025-03-14T06:00:24.2863987Z 2025-03-14T06:00:24.2864186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2864294Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2864577Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2864681Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2864884Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2865020Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2865166Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2865542Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2866060Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2866461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2866810Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2867082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2867391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2867660Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2867955Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2868076Z Execution Analysis: (:1) 2025-03-14T06:00:24.2868337Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2868537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2868550Z 2025-03-14T06:00:24.2868749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2868863Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2869120Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2869237Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2869437Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2869609Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2869761Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2869925Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2870519Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2871094Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2871453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2871810Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2872120Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2872405Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2872714Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2872990Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2873094Z Execution Analysis: .......... 2025-03-14T06:00:24.2873356Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2873559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2873861Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1658 counts during 1580 steps 2025-03-14T06:00:24.2873866Z 2025-03-14T06:00:24.2874068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2874185Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2874474Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2874588Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2874790Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2874940Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2875084Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2875281Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2875637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2876297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2876611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2876892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2877203Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2877477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2877769Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2878008Z Execution Analysis: (:1) 2025-03-14T06:00:24.2878354Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2878547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2878553Z 2025-03-14T06:00:24.2878738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2878873Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2879087Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2879191Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2879403Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2879537Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2879672Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2879828Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2880371Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2880905Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2881236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2881565Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2881854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2882109Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2882391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2882646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2882744Z Execution Analysis: .......... 2025-03-14T06:00:24.2882985Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2883170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2883443Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1659 counts during 1581 steps 2025-03-14T06:00:24.2883447Z 2025-03-14T06:00:24.2883631Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2883740Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2884004Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2884110Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2884297Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2884437Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2884659Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2884820Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2885365Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2885718Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2886026Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2886306Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2886611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2886884Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2887177Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2887306Z Execution Analysis: (:1) 2025-03-14T06:00:24.2887569Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2887770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2887774Z 2025-03-14T06:00:24.2888004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2888118Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2888351Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2888481Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2888689Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2888830Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2888976Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2889142Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2889734Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2890305Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2890671Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2891019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2891340Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2891612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2891926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2892201Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2892309Z Execution Analysis: .......... 2025-03-14T06:00:24.2892569Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2892775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2893064Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1660 counts during 1582 steps 2025-03-14T06:00:24.2893069Z 2025-03-14T06:00:24.2893273Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2893387Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2893682Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2893794Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2893997Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2894175Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2894320Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2894512Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2894875Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2895226Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2895543Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2895815Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2896128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2896397Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2896694Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2896818Z Execution Analysis: (:1) 2025-03-14T06:00:24.2897080Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2897283Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2897311Z 2025-03-14T06:00:24.2897518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2897631Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2897890Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2898003Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2898212Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2898352Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2898504Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2898676Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2899295Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2899901Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2900270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2900638Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2900946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2901231Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2901542Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2901829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2901949Z Execution Analysis: .......... 2025-03-14T06:00:24.2902210Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2902434Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2902726Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1662 counts during 1583 steps 2025-03-14T06:00:24.2902731Z 2025-03-14T06:00:24.2902951Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2903063Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2903365Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2903471Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2903705Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2903846Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2904015Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2904181Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2904540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2904887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2905207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2905475Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2905785Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2906049Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2906349Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2906472Z Execution Analysis: (:1) 2025-03-14T06:00:24.2906739Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2906963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2906967Z 2025-03-14T06:00:24.2907199Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2907311Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2907547Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2907654Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2907862Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2908003Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2908154Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2908319Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2908921Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2909492Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2909857Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2910204Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2910522Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2910799Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2911110Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2911387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2911493Z Execution Analysis: .......... 2025-03-14T06:00:24.2911758Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2911958Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2912255Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1663 counts during 1584 steps 2025-03-14T06:00:24.2912260Z 2025-03-14T06:00:24.2912461Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2912580Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2912868Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2913014Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2913218Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2913397Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2913541Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2913717Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2914071Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2914430Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2914744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2915022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2915327Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2915603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2915896Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2916029Z Execution Analysis: (:1) 2025-03-14T06:00:24.2916315Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2916523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2916527Z 2025-03-14T06:00:24.2916750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2916870Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2917099Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2917218Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2917420Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2917568Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2917718Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2917893Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2918484Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2919061Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2919416Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2919778Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2920088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2920368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2920677Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2920954Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2921062Z Execution Analysis: .......... 2025-03-14T06:00:24.2921324Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2921525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2921823Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1664 counts during 1585 steps 2025-03-14T06:00:24.2921828Z 2025-03-14T06:00:24.2922023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2922144Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2922458Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2922599Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2922798Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2923057Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2923195Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2923364Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2923710Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2924055Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2924354Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2924714Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2925183Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2925459Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2925750Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2925909Z Execution Analysis: (:1) 2025-03-14T06:00:24.2926165Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2926410Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2926414Z 2025-03-14T06:00:24.2926612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2926733Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2926962Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2927083Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2927282Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2927432Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2927574Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2927749Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2928335Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2928914Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2929276Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2929628Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2929947Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2930221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2930537Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2930808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2930920Z Execution Analysis: .......... 2025-03-14T06:00:24.2931180Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2931387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2931680Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1665 counts during 1586 steps 2025-03-14T06:00:24.2931684Z 2025-03-14T06:00:24.2931893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2932030Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2932330Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2932464Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2932674Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2932818Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2932966Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2933133Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2933506Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2933853Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2934171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2934445Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2934761Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2935028Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2935351Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2935473Z Execution Analysis: (:1) 2025-03-14T06:00:24.2935761Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2935961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2935965Z 2025-03-14T06:00:24.2936172Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2936285Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2936525Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2936632Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2936847Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2936989Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2937254Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2937417Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2938005Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2938562Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2938919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2939259Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2939572Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2939836Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2940144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2940400Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2940511Z Execution Analysis: .......... 2025-03-14T06:00:24.2940764Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2940968Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2941248Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1666 counts during 1587 steps 2025-03-14T06:00:24.2941283Z 2025-03-14T06:00:24.2941491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2941623Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2941916Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2942021Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2942230Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2942370Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2942517Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2942681Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2943037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2943380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2943696Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2943961Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2944273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2944560Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2944857Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2944976Z Execution Analysis: (:1) 2025-03-14T06:00:24.2945265Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2945459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2945473Z 2025-03-14T06:00:24.2945670Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2945787Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2946012Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2946130Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2946328Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2946474Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2946616Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2946782Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2947374Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2947944Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2948292Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2948643Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2948946Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2949224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2949523Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2949798Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2949900Z Execution Analysis: .......... 2025-03-14T06:00:24.2950159Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2950351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2950667Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1667 counts during 1588 steps 2025-03-14T06:00:24.2950672Z 2025-03-14T06:00:24.2950867Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2951012Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2951295Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2951410Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2951607Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2951757Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2951893Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2952065Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2952410Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2952759Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2953064Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2953349Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2953646Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2953944Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2954227Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2954382Z Execution Analysis: (:1) 2025-03-14T06:00:24.2954631Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2954842Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2954848Z 2025-03-14T06:00:24.2955047Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2955166Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2955394Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2955516Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2955716Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2955866Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2956006Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2956183Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2956758Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2957331Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2957679Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2958037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2958339Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2958616Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2958914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2959191Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2959292Z Execution Analysis: .......... 2025-03-14T06:00:24.2959556Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2959751Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2960073Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1668 counts during 1589 steps 2025-03-14T06:00:24.2960101Z 2025-03-14T06:00:24.2960306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2960416Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2960697Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2960817Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2961019Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2961173Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2961312Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2961489Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2961837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2962191Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2962493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2962770Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2963109Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2963373Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2963690Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2963814Z Execution Analysis: (:1) 2025-03-14T06:00:24.2964070Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2964264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2964270Z 2025-03-14T06:00:24.2964551Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2964675Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2965076Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2965186Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2965579Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2965720Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2965879Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2966049Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2966649Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2967221Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2967600Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2967950Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2968274Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2968548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2968863Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2969130Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2969248Z Execution Analysis: .......... 2025-03-14T06:00:24.2969504Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2969781Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2970106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1669 counts during 1590 steps 2025-03-14T06:00:24.2970111Z 2025-03-14T06:00:24.2970323Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2970437Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2970739Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2970850Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2971061Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2971202Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2971354Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2971521Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2971892Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2972239Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2972563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2972866Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2973186Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2973486Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2973794Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2973920Z Execution Analysis: (:1) 2025-03-14T06:00:24.2974186Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2974389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2974395Z 2025-03-14T06:00:24.2974607Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2974721Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2974966Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2975076Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2975293Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2975437Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2975592Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2975760Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2976367Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2976941Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2977316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2977770Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2978083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2978348Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2978655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2978915Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2979026Z Execution Analysis: .......... 2025-03-14T06:00:24.2979301Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2979535Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2979832Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1670 counts during 1591 steps 2025-03-14T06:00:24.2979837Z 2025-03-14T06:00:24.2980035Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2980154Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2980437Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2980555Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2980753Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2980902Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2981041Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2981216Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2981562Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2981917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2982241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2982518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2982840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2983106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2983391Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2983520Z Execution Analysis: (:1) 2025-03-14T06:00:24.2983771Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2983978Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2983984Z 2025-03-14T06:00:24.2984177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2984299Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2984520Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2984639Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2984835Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2984988Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2985127Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2985303Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2985875Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2986444Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2986794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2987145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2987453Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2987731Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2988027Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2988302Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2988426Z Execution Analysis: .......... 2025-03-14T06:00:24.2988687Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2988908Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2989200Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1671 counts during 1592 steps 2025-03-14T06:00:24.2989205Z 2025-03-14T06:00:24.2989400Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2989522Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2989800Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2989920Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2990116Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.2990267Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.2990407Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.2990582Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2990930Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.2991307Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2991612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2991910Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2992210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2992482Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2992764Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.2992895Z Execution Analysis: (:1) 2025-03-14T06:00:24.2993149Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2993360Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2993364Z 2025-03-14T06:00:24.2993561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2993684Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2993911Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.2994028Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2994222Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.2994371Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.2994513Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.2994692Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.2995267Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.2995843Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.2996364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.2996730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.2997049Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.2997326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.2997643Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.2998019Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.2998177Z Execution Analysis: .......... 2025-03-14T06:00:24.2998440Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.2998764Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2999051Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1672 counts during 1593 steps 2025-03-14T06:00:24.2999055Z 2025-03-14T06:00:24.2999266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.2999378Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.2999673Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.2999785Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.2999995Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3000137Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3000283Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3000449Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3000809Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3001176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3001513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3001783Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3002089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3002351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3002647Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3002767Z Execution Analysis: (:1) 2025-03-14T06:00:24.3003029Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3003224Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3003228Z 2025-03-14T06:00:24.3003432Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3003548Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3003781Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3003888Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3004099Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3004238Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3004391Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3004637Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3005403Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3005978Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3006351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3006707Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3007029Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3007300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3007648Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3007916Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3008056Z Execution Analysis: .......... 2025-03-14T06:00:24.3008315Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3008529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3008820Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1673 counts during 1594 steps 2025-03-14T06:00:24.3008825Z 2025-03-14T06:00:24.3009037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3009148Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3009449Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3009558Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3009771Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3009918Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3010069Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3010234Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3010628Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3010976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3011320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3011593Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3011914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3012180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3012482Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3012608Z Execution Analysis: (:1) 2025-03-14T06:00:24.3012880Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3013082Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3013099Z 2025-03-14T06:00:24.3013301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3013422Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3013654Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3013763Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3013978Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3014122Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3014280Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3014453Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3015057Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3015640Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3016003Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3016362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3016673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3016980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3017394Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3017690Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3017791Z Execution Analysis: .......... 2025-03-14T06:00:24.3018054Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3018249Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3018545Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1674 counts during 1595 steps 2025-03-14T06:00:24.3018549Z 2025-03-14T06:00:24.3018748Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3018873Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3019157Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3019276Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3019475Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3019625Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3019764Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3019965Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3020311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3020683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3020984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3021259Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3021557Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3021829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3022113Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3022246Z Execution Analysis: (:1) 2025-03-14T06:00:24.3022496Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3022703Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3022709Z 2025-03-14T06:00:24.3022901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3023023Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3023243Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3023361Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3023558Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3023707Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3023851Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3024026Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3024603Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3025168Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3025519Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3025869Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3026174Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3026474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3026798Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3027073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3027176Z Execution Analysis: .......... 2025-03-14T06:00:24.3027432Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3027628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3027923Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1675 counts during 1596 steps 2025-03-14T06:00:24.3027927Z 2025-03-14T06:00:24.3028122Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3028247Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3028527Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3028648Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3028848Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3029000Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3029163Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3029339Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3029707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3030060Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3030360Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3030637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3030938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3031211Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3031492Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3031627Z Execution Analysis: (:1) 2025-03-14T06:00:24.3031879Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3032091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3032096Z 2025-03-14T06:00:24.3032298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3032410Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3032645Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3032757Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3032964Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3033104Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3033254Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3033420Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3034006Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3034570Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3034929Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3035272Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3035623Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3035916Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3036225Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3036485Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3036597Z Execution Analysis: .......... 2025-03-14T06:00:24.3036847Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3037054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3037335Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1676 counts during 1597 steps 2025-03-14T06:00:24.3037340Z 2025-03-14T06:00:24.3037546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3037658Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3037954Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3038060Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3038292Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3038430Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3038580Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3038772Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3039131Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3039477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3039791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3040062Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3040371Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3040635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3040933Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3041057Z Execution Analysis: (:1) 2025-03-14T06:00:24.3041323Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3041525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3041529Z 2025-03-14T06:00:24.3041741Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3041860Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3042095Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3042209Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3042421Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3042562Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3042717Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3042883Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3043472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3044034Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3044395Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3044827Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3045345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3045619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3045944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3046215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3046334Z Execution Analysis: .......... 2025-03-14T06:00:24.3046594Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3046806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3047103Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1677 counts during 1598 steps 2025-03-14T06:00:24.3047119Z 2025-03-14T06:00:24.3047326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3047456Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3047749Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3047898Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3048107Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3048263Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3048434Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3048604Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3048970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3049325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3049639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3049924Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3050230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3050514Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3050807Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3050944Z Execution Analysis: (:1) 2025-03-14T06:00:24.3051205Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3051417Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3051422Z 2025-03-14T06:00:24.3051625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3051753Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3051988Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3052109Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3052315Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3052469Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3052616Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3052793Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3053384Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3053965Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3054352Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3054716Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3055055Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3055342Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3055651Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3055930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3056038Z Execution Analysis: .......... 2025-03-14T06:00:24.3056310Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3056519Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3056822Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1678 counts during 1599 steps 2025-03-14T06:00:24.3056826Z 2025-03-14T06:00:24.3057029Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3057260Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3057554Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3057669Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3057855Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3058024Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3058160Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3058324Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3058656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3058992Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3059280Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3059543Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3059830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3060086Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3060358Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3060483Z Execution Analysis: (:1) 2025-03-14T06:00:24.3060723Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3060922Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3060928Z 2025-03-14T06:00:24.3061115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3061234Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3061450Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3061567Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3061759Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3061900Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3062037Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3062207Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3062753Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3063293Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3063650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3064007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3064299Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3064563Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3064858Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3065105Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3065217Z Execution Analysis: .......... 2025-03-14T06:00:24.3065577Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3065959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3066254Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1679 counts during 1600 steps 2025-03-14T06:00:24.3066261Z 2025-03-14T06:00:24.3066475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3066642Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3066950Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3067061Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3067329Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3067476Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3067629Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3067804Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3068178Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3068531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3068856Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3069132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3069448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3069719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3070021Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3070148Z Execution Analysis: (:1) 2025-03-14T06:00:24.3070413Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3070616Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3070621Z 2025-03-14T06:00:24.3070831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3070945Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3071185Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3071296Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3071513Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3071658Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3071809Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3071979Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3072581Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3073193Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3073595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3073954Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3074272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3074550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3074867Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3075137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3075255Z Execution Analysis: .......... 2025-03-14T06:00:24.3075514Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3075731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3076026Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1680 counts during 1601 steps 2025-03-14T06:00:24.3076030Z 2025-03-14T06:00:24.3076265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3076383Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3076707Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3076821Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3077039Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3077185Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3077339Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3077508Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3078090Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3078419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3078718Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3078976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3079265Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3079516Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3083861Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3084006Z Execution Analysis: (:1) 2025-03-14T06:00:24.3084266Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3084460Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3084469Z 2025-03-14T06:00:24.3084756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3084863Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3085267Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3085377Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3085588Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3085730Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3085887Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3086052Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3086659Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3087301Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3087698Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3088051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3088370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3088646Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3088958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3089227Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3089340Z Execution Analysis: .......... 2025-03-14T06:00:24.3089597Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3089805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3090097Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1681 counts during 1602 steps 2025-03-14T06:00:24.3090134Z 2025-03-14T06:00:24.3090334Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3090452Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3090763Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3090878Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3091081Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3091229Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3091369Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3091540Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3091899Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3092253Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3092562Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3092839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3093145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3093419Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3093708Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3093842Z Execution Analysis: (:1) 2025-03-14T06:00:24.3094097Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3094305Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3094310Z 2025-03-14T06:00:24.3094509Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3094626Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3094852Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3094970Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3095170Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3095318Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3095461Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3095634Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3096251Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3096858Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3097322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3097669Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3097972Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3098245Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3098539Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3098805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3098904Z Execution Analysis: .......... 2025-03-14T06:00:24.3099162Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3099355Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3099669Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1683 counts during 1603 steps 2025-03-14T06:00:24.3099675Z 2025-03-14T06:00:24.3099897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3100014Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3100292Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3100405Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3100602Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3100748Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3100882Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3101054Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3101399Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3101748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3102046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3102319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3102613Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3102878Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3103158Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3103284Z Execution Analysis: (:1) 2025-03-14T06:00:24.3103533Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3103734Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3103741Z 2025-03-14T06:00:24.3103935Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3104050Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3104271Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3104382Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3104580Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3104724Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3104864Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3105060Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3105635Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3106230Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3106577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3106928Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3107237Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3107600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3107892Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3108139Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3108244Z Execution Analysis: .......... 2025-03-14T06:00:24.3108479Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3108710Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3108980Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1684 counts during 1604 steps 2025-03-14T06:00:24.3108985Z 2025-03-14T06:00:24.3109203Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3109306Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3109581Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3109682Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3109875Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3110006Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3110144Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3110297Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3110633Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3110953Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3111249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3111499Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3111784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3112029Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3112303Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3112419Z Execution Analysis: (:1) 2025-03-14T06:00:24.3112662Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3112848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3112852Z 2025-03-14T06:00:24.3113040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3113142Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3113356Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3113455Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3113649Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3113778Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3113945Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3114099Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3114673Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3115198Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3115538Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3115863Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3116162Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3116411Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3116703Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3116950Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3117050Z Execution Analysis: .......... 2025-03-14T06:00:24.3117308Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3117496Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3117783Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1685 counts during 1605 steps 2025-03-14T06:00:24.3117788Z 2025-03-14T06:00:24.3117982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3118087Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3118357Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3118459Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3118651Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3118782Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3118916Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3119069Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3119402Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3119724Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3120016Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3120266Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3120555Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3120969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3121263Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3121382Z Execution Analysis: (:1) 2025-03-14T06:00:24.3121641Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3121831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3121841Z 2025-03-14T06:00:24.3122035Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3122141Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3122536Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3122648Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3122866Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3123363Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3123524Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3123723Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3124330Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3124996Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3125360Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3125730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3126046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3126340Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3126653Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3126942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3127094Z Execution Analysis: .......... 2025-03-14T06:00:24.3127367Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3127597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3127911Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1686 counts during 1606 steps 2025-03-14T06:00:24.3127916Z 2025-03-14T06:00:24.3128123Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3128255Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3128550Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3128680Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3128888Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3129049Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3129196Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3129378Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3129740Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3130112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3130427Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3130720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3131029Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3131313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3131611Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3131754Z Execution Analysis: (:1) 2025-03-14T06:00:24.3132015Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3132236Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3132242Z 2025-03-14T06:00:24.3132444Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3132574Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3132807Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3132955Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3133161Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3133348Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3133498Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3133679Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3134275Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3134871Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3135232Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3135601Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3135920Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3136211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3136527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3136837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3136948Z Execution Analysis: .......... 2025-03-14T06:00:24.3137242Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3137446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3137748Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1687 counts during 1607 steps 2025-03-14T06:00:24.3137754Z 2025-03-14T06:00:24.3137957Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3138085Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3138377Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3138501Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3138707Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3138866Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3139012Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3139190Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3139554Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3139917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3140229Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3140514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3140824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3141108Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3141401Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3141536Z Execution Analysis: (:1) 2025-03-14T06:00:24.3141794Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3142012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3142016Z 2025-03-14T06:00:24.3142235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3142348Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3142617Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3142728Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3142986Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3143133Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3143296Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3143471Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3144075Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3144652Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3145024Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3145379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3145706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3145984Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3146331Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3146603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3146724Z Execution Analysis: .......... 2025-03-14T06:00:24.3147077Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3147295Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3147587Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1688 counts during 1608 steps 2025-03-14T06:00:24.3147593Z 2025-03-14T06:00:24.3147811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3147930Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3148239Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3148353Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3148578Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3148724Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3148884Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3149056Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3149428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3149781Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3150105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3150382Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3150705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3150977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3151280Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3151411Z Execution Analysis: (:1) 2025-03-14T06:00:24.3151685Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3151889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3151893Z 2025-03-14T06:00:24.3152106Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3152246Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3152492Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3152629Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3152848Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3152994Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3153155Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3153327Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3153929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3154502Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3154977Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3155326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3155648Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3155942Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3156255Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3156542Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3156662Z Execution Analysis: .......... 2025-03-14T06:00:24.3156917Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3157126Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3157414Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1689 counts during 1609 steps 2025-03-14T06:00:24.3157431Z 2025-03-14T06:00:24.3157632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3157761Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3158042Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3158154Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3158363Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3158507Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3158661Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3158827Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3159189Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3159532Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3159849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3160138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3160439Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3160711Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3160997Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3161133Z Execution Analysis: (:1) 2025-03-14T06:00:24.3161384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3161596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3161600Z 2025-03-14T06:00:24.3161825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3161950Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3162202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3162321Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3162525Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3162681Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3162825Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3163005Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3163581Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3164149Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3164571Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3165095Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3165536Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3165885Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3166202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3166518Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3166629Z Execution Analysis: .......... 2025-03-14T06:00:24.3166899Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3167105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3167412Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1690 counts during 1610 steps 2025-03-14T06:00:24.3167419Z 2025-03-14T06:00:24.3167626Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3167756Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3168051Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3168173Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3168384Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3168544Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3168691Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3168875Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3169239Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3169605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3169917Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3170200Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3170506Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3170782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3171072Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3171206Z Execution Analysis: (:1) 2025-03-14T06:00:24.3171462Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3171675Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3171713Z 2025-03-14T06:00:24.3171914Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3172068Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3172298Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3172418Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3172619Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3172769Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3172916Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3173091Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3173676Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3174254Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3174614Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3174975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3175307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3175586Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3175914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3176189Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3176295Z Execution Analysis: .......... 2025-03-14T06:00:24.3176559Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3176772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3177063Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1691 counts during 1611 steps 2025-03-14T06:00:24.3177068Z 2025-03-14T06:00:24.3177382Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3177491Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3177781Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3177891Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3178099Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3178238Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3178381Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3178543Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3178900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3179237Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3179548Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3179814Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3180122Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3180382Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3180674Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3180792Z Execution Analysis: (:1) 2025-03-14T06:00:24.3181050Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3181281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3181308Z 2025-03-14T06:00:24.3181511Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3181616Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3181850Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3181953Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3182161Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3182297Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3182448Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3182608Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3183189Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3183745Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3184103Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3184467Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3184776Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3185063Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3185370Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3185630Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3185738Z Execution Analysis: .......... 2025-03-14T06:00:24.3185988Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3186189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3186471Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1692 counts during 1612 steps 2025-03-14T06:00:24.3186476Z 2025-03-14T06:00:24.3186682Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3186793Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3187078Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3187184Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3187387Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3187526Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3187669Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3187831Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3188184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3188527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3188836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3189103Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3189415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3189675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3189966Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3190085Z Execution Analysis: (:1) 2025-03-14T06:00:24.3190367Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3190562Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3190590Z 2025-03-14T06:00:24.3190793Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3190905Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3191134Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3191241Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3191449Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3191587Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3191739Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3191903Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3192482Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3193040Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3193420Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3193772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3194097Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3194371Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3194666Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3194935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3195036Z Execution Analysis: .......... 2025-03-14T06:00:24.3195295Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3195491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3195782Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1693 counts during 1613 steps 2025-03-14T06:00:24.3195787Z 2025-03-14T06:00:24.3195979Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3196102Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3196379Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3196492Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3196687Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3196835Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3196972Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3197143Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3197492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3197845Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3198144Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3198421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3198715Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3198984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3199264Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3199415Z Execution Analysis: (:1) 2025-03-14T06:00:24.3199662Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3199892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3199896Z 2025-03-14T06:00:24.3200090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3200211Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3200435Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3200550Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3200746Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3200890Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3201028Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3201200Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3201774Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3202342Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3202712Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3203088Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3203392Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3203665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3203960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3204232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3204332Z Execution Analysis: .......... 2025-03-14T06:00:24.3204688Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3204887Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3205354Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1694 counts during 1614 steps 2025-03-14T06:00:24.3205360Z 2025-03-14T06:00:24.3205560Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3205680Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3205968Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3206087Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3206286Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3206441Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3206581Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3206762Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3207118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3207480Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3207791Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3208068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3208375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3208650Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3208971Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3209103Z Execution Analysis: (:1) 2025-03-14T06:00:24.3209384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3209592Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3209596Z 2025-03-14T06:00:24.3209805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3209919Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3210157Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3210267Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3210468Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3210618Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3210764Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3210938Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3211525Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3212129Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3212494Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3212876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3213197Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3213468Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3213790Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3214057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3214173Z Execution Analysis: .......... 2025-03-14T06:00:24.3214429Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3214640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3214928Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1695 counts during 1615 steps 2025-03-14T06:00:24.3214935Z 2025-03-14T06:00:24.3215146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3215258Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3215560Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3215671Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3215883Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3216024Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3216174Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3216339Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3216703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3217050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3217472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3217737Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3218046Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3218332Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3218620Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3218764Z Execution Analysis: (:1) 2025-03-14T06:00:24.3219018Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3219214Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3219218Z 2025-03-14T06:00:24.3219425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3219532Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3219762Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3219868Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3220072Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3220211Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3220361Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3220521Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3221103Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3221679Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3222064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3222405Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3222711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3222976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3223280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3223539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3223649Z Execution Analysis: .......... 2025-03-14T06:00:24.3223897Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3224101Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3224382Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1696 counts during 1616 steps 2025-03-14T06:00:24.3224386Z 2025-03-14T06:00:24.3224584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3224693Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3224978Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3225086Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3225296Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3225438Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3225583Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3225745Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3226096Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3226436Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3226748Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3227013Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3227319Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3227603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3228082Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3228210Z Execution Analysis: (:1) 2025-03-14T06:00:24.3228466Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3228673Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3228679Z 2025-03-14T06:00:24.3228876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3228994Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3229222Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3229337Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3229539Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3229687Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3229832Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3230003Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3230618Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3231220Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3231577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3231931Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3232242Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3232525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3232833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3233106Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3233210Z Execution Analysis: .......... 2025-03-14T06:00:24.3233474Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3233675Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3233976Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1697 counts during 1617 steps 2025-03-14T06:00:24.3233980Z 2025-03-14T06:00:24.3234181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3234303Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3234590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3234708Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3234909Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3235063Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3235204Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3235377Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3235731Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3236192Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3236493Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3236767Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3237089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3237382Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3237665Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3237794Z Execution Analysis: (:1) 2025-03-14T06:00:24.3238040Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3238244Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3238248Z 2025-03-14T06:00:24.3238439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3238555Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3238779Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3238893Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3239090Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3239238Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3239377Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3239573Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3240236Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3240793Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3241125Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3241455Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3241742Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3242000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3242284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3242539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3242635Z Execution Analysis: .......... 2025-03-14T06:00:24.3242879Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3243063Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3243336Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1698 counts during 1618 steps 2025-03-14T06:00:24.3243341Z 2025-03-14T06:00:24.3243537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3243644Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3243920Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3244020Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3244215Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3244346Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3244554Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3244721Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3245236Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3245584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3245903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3246204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3246545Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3246811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3247114Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3247238Z Execution Analysis: (:1) 2025-03-14T06:00:24.3247502Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3247702Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3247706Z 2025-03-14T06:00:24.3247911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3248024Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3248264Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3248372Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3248584Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3248724Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3248917Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3249083Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3249705Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3250279Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3250640Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3250993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3251313Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3251584Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3251896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3252164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3252276Z Execution Analysis: .......... 2025-03-14T06:00:24.3252530Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3252737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3253023Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1699 counts during 1619 steps 2025-03-14T06:00:24.3253029Z 2025-03-14T06:00:24.3253235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3253349Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3253644Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3253752Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3253963Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3254107Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3254263Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3254434Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3254796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3255149Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3255505Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3255780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3256126Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3256398Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3256703Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3256833Z Execution Analysis: (:1) 2025-03-14T06:00:24.3257209Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3257396Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3257400Z 2025-03-14T06:00:24.3257595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3257702Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3257928Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3258031Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3258227Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3258387Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3258534Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3258692Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3259274Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3259806Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3260150Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3260477Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3260780Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3261049Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3261334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3261600Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3261700Z Execution Analysis: .......... 2025-03-14T06:00:24.3261952Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3262142Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3262424Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1700 counts during 1620 steps 2025-03-14T06:00:24.3262432Z 2025-03-14T06:00:24.3262619Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3262738Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3263008Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3263122Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3263313Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3263456Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3263583Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3263747Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3264078Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3264435Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3264720Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3265005Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3265404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3265836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3266129Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3266271Z Execution Analysis: (:1) 2025-03-14T06:00:24.3266528Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3266738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3266744Z 2025-03-14T06:00:24.3266946Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3267071Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3267299Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3267417Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3267672Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3267825Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3267970Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3268182Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3268773Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3269356Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3269714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3270074Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3270388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3270672Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3270982Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3271260Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3271366Z Execution Analysis: .......... 2025-03-14T06:00:24.3271636Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3271842Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3272140Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1701 counts during 1621 steps 2025-03-14T06:00:24.3272147Z 2025-03-14T06:00:24.3272348Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3272473Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3272761Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3272879Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3273085Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3273235Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3273378Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3273551Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3273907Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3274301Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3274646Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3274930Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3275238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3275519Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3275814Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3275950Z Execution Analysis: (:1) 2025-03-14T06:00:24.3276210Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3276419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3276424Z 2025-03-14T06:00:24.3276624Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3276749Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3276981Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3277128Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3277335Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3277487Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3277766Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3277938Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3278591Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3279132Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3279476Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3279800Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3280104Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3280361Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3280658Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3280906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3281014Z Execution Analysis: .......... 2025-03-14T06:00:24.3281251Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3281448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3281717Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1702 counts during 1622 steps 2025-03-14T06:00:24.3281722Z 2025-03-14T06:00:24.3281917Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3282024Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3282297Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3282400Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3282596Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3282726Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3282869Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3283025Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3283384Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3283748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3284042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3284295Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3284651Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3284904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3285371Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3285502Z Execution Analysis: (:1) 2025-03-14T06:00:24.3285766Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3285969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3285975Z 2025-03-14T06:00:24.3286185Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3286299Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3286569Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3286680Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3286916Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3287062Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3287216Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3287386Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3287986Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3288562Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3288932Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3289287Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3289608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3289884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3290202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3290469Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3290589Z Execution Analysis: .......... 2025-03-14T06:00:24.3290845Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3291056Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3291342Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1704 counts during 1623 steps 2025-03-14T06:00:24.3291348Z 2025-03-14T06:00:24.3291562Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3291677Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3291980Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3292090Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3292306Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3294770Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3294972Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3295140Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3295514Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3295867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3296190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3296465Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3296783Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3297051Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3297457Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3297610Z Execution Analysis: (:1) 2025-03-14T06:00:24.3297871Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3298068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3298073Z 2025-03-14T06:00:24.3298379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3298493Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3298728Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3298866Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3299080Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3299221Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3299374Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3299539Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3300131Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3300689Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3301047Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3301391Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3301708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3301976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3302283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3302549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3302665Z Execution Analysis: .......... 2025-03-14T06:00:24.3302916Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3303121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3303408Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1705 counts during 1624 steps 2025-03-14T06:00:24.3303424Z 2025-03-14T06:00:24.3303621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3303747Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3304028Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3304148Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3304410Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3304579Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3304727Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3304890Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3305250Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3305594Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3305908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3306189Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3306485Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3306758Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3307042Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3307178Z Execution Analysis: (:1) 2025-03-14T06:00:24.3307530Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3307728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3307732Z 2025-03-14T06:00:24.3307946Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3308063Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3308297Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3308414Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3308602Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3308747Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3308886Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3309050Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3309592Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3310128Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3310458Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3310790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3311077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3311337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3311621Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3311880Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3311978Z Execution Analysis: .......... 2025-03-14T06:00:24.3312223Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3312409Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3312682Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1706 counts during 1625 steps 2025-03-14T06:00:24.3312686Z 2025-03-14T06:00:24.3312872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3312986Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3313253Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3313409Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3313621Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3313761Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3313892Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3314053Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3314388Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3314721Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3315009Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3315264Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3315547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3315806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3316077Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3316195Z Execution Analysis: (:1) 2025-03-14T06:00:24.3316432Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3316646Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3316650Z 2025-03-14T06:00:24.3316837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3316969Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3317184Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3317293Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3317482Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3317625Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3317763Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3317922Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3318465Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3319001Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3319336Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3319667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3319958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3320220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3320506Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3320762Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3320860Z Execution Analysis: .......... 2025-03-14T06:00:24.3321105Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3321301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3321570Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1707 counts during 1626 steps 2025-03-14T06:00:24.3321575Z 2025-03-14T06:00:24.3321773Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3321876Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3322195Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3322318Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3322514Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3322646Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3322789Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3322944Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3323286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3323609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3323904Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3324155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3324452Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3324805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3325265Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3325389Z Execution Analysis: (:1) 2025-03-14T06:00:24.3325689Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3325890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3325895Z 2025-03-14T06:00:24.3326131Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3326245Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3326486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3326597Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3326812Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3326960Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3327114Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3327280Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3327876Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3328450Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3328819Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3329173Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3329497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3329774Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3330086Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3330353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3330468Z Execution Analysis: .......... 2025-03-14T06:00:24.3330726Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3330943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3331235Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1708 counts during 1627 steps 2025-03-14T06:00:24.3331240Z 2025-03-14T06:00:24.3331448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3331591Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3331913Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3332025Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3332233Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3332376Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3332526Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3332693Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3333056Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3333408Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3333727Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3334003Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3334321Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3334590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3334888Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3335009Z Execution Analysis: (:1) 2025-03-14T06:00:24.3335303Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3335527Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3335531Z 2025-03-14T06:00:24.3335740Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3335853Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3336089Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3336200Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3336416Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3336561Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3336717Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3336882Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3337556Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3338083Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3338425Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3338753Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3339043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3339302Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3339588Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3339843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3339939Z Execution Analysis: .......... 2025-03-14T06:00:24.3340184Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3340376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3340646Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1709 counts during 1628 steps 2025-03-14T06:00:24.3340651Z 2025-03-14T06:00:24.3340876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3341014Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3341284Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3341403Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3341593Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3341741Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3341874Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3342043Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3342380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3342714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3343006Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3343274Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3343561Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3343822Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3344118Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3344245Z Execution Analysis: (:1) 2025-03-14T06:00:24.3344487Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3344717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3344722Z 2025-03-14T06:00:24.3344909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3345029Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3345246Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3345361Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3345552Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3345699Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3345836Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3346009Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3346557Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3347100Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3347431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3347769Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3348060Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3348330Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3348619Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3348885Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3348985Z Execution Analysis: .......... 2025-03-14T06:00:24.3349239Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3349426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3349714Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1710 counts during 1629 steps 2025-03-14T06:00:24.3349763Z 2025-03-14T06:00:24.3349952Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3350068Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3350334Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3350450Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3350645Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3350788Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3350922Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3351091Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3351424Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3351760Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3352050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3352312Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3352596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3352856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3353152Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3353280Z Execution Analysis: (:1) 2025-03-14T06:00:24.3353551Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3353747Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3353750Z 2025-03-14T06:00:24.3353949Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3354058Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3354285Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3354387Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3354577Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3354722Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3354859Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3355023Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3355568Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3356105Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3356456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3356779Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3357080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3357333Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3357630Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3357879Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3357993Z Execution Analysis: .......... 2025-03-14T06:00:24.3358228Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3358426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3358716Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1711 counts during 1630 steps 2025-03-14T06:00:24.3358743Z 2025-03-14T06:00:24.3358944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3359048Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3359325Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3359433Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3359637Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3359771Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3359914Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3360068Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3360412Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3360741Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3361042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3361297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3361594Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3361868Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3362151Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3362517Z Execution Analysis: (:1) 2025-03-14T06:00:24.3362780Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3362968Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3362974Z 2025-03-14T06:00:24.3363175Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3363279Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3363505Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3363611Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3363816Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3363951Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3364100Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3364260Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3365134Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3365846Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3366230Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3366585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3366910Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3367190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3367511Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3367784Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3367903Z Execution Analysis: .......... 2025-03-14T06:00:24.3368161Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3368448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3368776Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1712 counts during 1631 steps 2025-03-14T06:00:24.3368782Z 2025-03-14T06:00:24.3368993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3369106Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3369412Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3369525Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3369744Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3369891Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3370045Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3370216Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3370588Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3370945Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3371275Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3371548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3371896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3372169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3372501Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3372640Z Execution Analysis: (:1) 2025-03-14T06:00:24.3372897Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3373112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3373119Z 2025-03-14T06:00:24.3373319Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3373447Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3373677Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3373802Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3374006Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3374161Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3374306Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3374487Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3375080Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3375667Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3376025Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3376385Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3376704Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3376991Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3377513Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3377774Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3377874Z Execution Analysis: .......... 2025-03-14T06:00:24.3378124Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3378360Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3378645Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1713 counts during 1632 steps 2025-03-14T06:00:24.3378649Z 2025-03-14T06:00:24.3378836Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3378956Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3379223Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3379341Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3379530Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3379673Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3379804Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3379972Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3380305Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3380641Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3380930Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3381218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3381504Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3381790Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3382065Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3382192Z Execution Analysis: (:1) 2025-03-14T06:00:24.3382430Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3382633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3382637Z 2025-03-14T06:00:24.3382824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3382940Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3383156Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3383275Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3383465Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3383613Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3383753Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3383924Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3384472Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3385020Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3385355Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3385694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3385985Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3386256Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3386538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3386796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3386922Z Execution Analysis: .......... 2025-03-14T06:00:24.3387199Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3387390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3387672Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1714 counts during 1633 steps 2025-03-14T06:00:24.3387677Z 2025-03-14T06:00:24.3387875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3387983Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3388266Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3388371Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3388573Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3388708Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3388855Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3389016Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3389358Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3389683Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3390023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3390278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3390590Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3390841Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3391125Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3391244Z Execution Analysis: (:1) 2025-03-14T06:00:24.3391498Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3391684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3391688Z 2025-03-14T06:00:24.3391891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3392000Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3392228Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3392327Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3392528Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3392660Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3392807Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3392962Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3393513Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3394043Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3394388Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3394710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3395010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3395262Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3395559Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3395833Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3396135Z Execution Analysis: .......... 2025-03-14T06:00:24.3396387Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3396594Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3396880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1715 counts during 1634 steps 2025-03-14T06:00:24.3396886Z 2025-03-14T06:00:24.3397094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3397205Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3397500Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3397606Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3397813Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3397956Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3398110Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3398273Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3398629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3398997Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3399312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3399600Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3399914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3400176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3400467Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3400593Z Execution Analysis: (:1) 2025-03-14T06:00:24.3400854Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3401050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3401054Z 2025-03-14T06:00:24.3401262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3401376Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3401611Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3401719Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3401925Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3402067Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3402216Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3402384Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3402969Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3403529Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3403896Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3404241Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3404649Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3405097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3405404Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3405745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3405853Z Execution Analysis: .......... 2025-03-14T06:00:24.3406124Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3406328Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3406630Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1716 counts during 1635 steps 2025-03-14T06:00:24.3406635Z 2025-03-14T06:00:24.3406836Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3406964Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3407253Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3407379Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3407586Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3407748Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3407892Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3408070Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3408426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3408814Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3409127Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3409436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3409746Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3410027Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3410320Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3410460Z Execution Analysis: (:1) 2025-03-14T06:00:24.3410718Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3410936Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3410940Z 2025-03-14T06:00:24.3411144Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3411271Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3411503Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3411624Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3411827Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3411985Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3412132Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3412314Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3412907Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3413492Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3413849Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3414219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3414533Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3414818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3415174Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3415457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3415565Z Execution Analysis: .......... 2025-03-14T06:00:24.3415837Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3416040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3416345Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1717 counts during 1636 steps 2025-03-14T06:00:24.3416351Z 2025-03-14T06:00:24.3416551Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3416677Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3416968Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3417205Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3417394Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3417539Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3417673Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3417846Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3418201Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3418540Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3418850Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3419110Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3419396Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3419663Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3419934Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3420061Z Execution Analysis: (:1) 2025-03-14T06:00:24.3420301Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3420501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3420506Z 2025-03-14T06:00:24.3420696Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3420814Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3421029Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3421142Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3421333Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3421477Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3421613Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3421781Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3422327Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3422865Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3423212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3423536Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3423836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3424115Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3424444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3424694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3424809Z Execution Analysis: .......... 2025-03-14T06:00:24.3425053Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3425257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3425532Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1718 counts during 1637 steps 2025-03-14T06:00:24.3425536Z 2025-03-14T06:00:24.3425742Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3425854Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3426139Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3426246Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3426451Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3426589Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3426736Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3426921Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3427270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3427618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3427922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3428177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3428479Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3428734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3429022Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3429138Z Execution Analysis: (:1) 2025-03-14T06:00:24.3429394Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3429584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3429588Z 2025-03-14T06:00:24.3429792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3429902Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3430130Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3430240Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3430448Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3430584Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3430737Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3430895Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3431456Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3431989Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3432340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3432667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3432998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3433279Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3433579Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3433831Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3433949Z Execution Analysis: .......... 2025-03-14T06:00:24.3434189Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3434391Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3434661Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1719 counts during 1638 steps 2025-03-14T06:00:24.3434665Z 2025-03-14T06:00:24.3434865Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3434976Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3435258Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3435362Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3435559Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3435695Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3435860Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3436020Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3436383Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3436710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3437009Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3437264Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3437566Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3437817Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3438098Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3438220Z Execution Analysis: (:1) 2025-03-14T06:00:24.3438468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3438658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3438672Z 2025-03-14T06:00:24.3438858Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3438978Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3439194Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3439313Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3439504Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3439651Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3439789Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3439947Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3440509Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3441056Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3441388Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3441753Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3442141Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3442415Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3442700Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3442968Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3443067Z Execution Analysis: .......... 2025-03-14T06:00:24.3443322Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3443509Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3443789Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1720 counts during 1639 steps 2025-03-14T06:00:24.3443795Z 2025-03-14T06:00:24.3443985Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3444109Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3444380Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3444583Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3444777Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3445123Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3445270Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3445457Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3445843Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3446212Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3446528Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3446819Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3447131Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3447416Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3447712Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3447852Z Execution Analysis: (:1) 2025-03-14T06:00:24.3448115Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3448330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3448334Z 2025-03-14T06:00:24.3448533Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3448662Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3448895Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3449020Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3449221Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3449376Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3449529Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3449713Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3450308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3450894Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3451252Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3451679Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3451992Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3452280Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3452591Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3452874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3452982Z Execution Analysis: .......... 2025-03-14T06:00:24.3453253Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3453455Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3453758Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1721 counts during 1640 steps 2025-03-14T06:00:24.3453765Z 2025-03-14T06:00:24.3453968Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3454095Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3454386Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3454510Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3454737Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3454895Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3455062Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3455245Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3455605Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3455973Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3456289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3456578Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3456898Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3457274Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3457558Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3457673Z Execution Analysis: (:1) 2025-03-14T06:00:24.3457925Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3458115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3458121Z 2025-03-14T06:00:24.3458322Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3458431Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3458659Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3458761Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3458961Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3459093Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3459242Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3459396Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3459957Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3460488Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3460894Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3461220Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3461525Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3461781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3462077Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3462327Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3462437Z Execution Analysis: .......... 2025-03-14T06:00:24.3462678Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3462878Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3463152Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1722 counts during 1641 steps 2025-03-14T06:00:24.3463156Z 2025-03-14T06:00:24.3463356Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3463465Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3463765Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3468253Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3468528Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3468770Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3468924Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3469094Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3469473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3469833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3470160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3470435Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3470752Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3471020Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3471324Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3471451Z Execution Analysis: (:1) 2025-03-14T06:00:24.3471719Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3471923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3471932Z 2025-03-14T06:00:24.3472140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3472253Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3472490Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3472601Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3472814Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3472956Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3473109Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3473279Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3473885Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3474460Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3474909Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3475260Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3475579Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3475851Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3476165Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3476433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3476546Z Execution Analysis: .......... 2025-03-14T06:00:24.3476805Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3477014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3477303Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1723 counts during 1642 steps 2025-03-14T06:00:24.3477309Z 2025-03-14T06:00:24.3477518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3477664Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3478071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3478172Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3478391Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3478525Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3478662Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3478815Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3479151Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3479475Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3479765Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3480016Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3480309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3480552Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3480830Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3480942Z Execution Analysis: (:1) 2025-03-14T06:00:24.3481185Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3481379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3481385Z 2025-03-14T06:00:24.3481567Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3481674Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3481883Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3481991Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3482176Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3482313Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3482446Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3482606Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3483146Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3483728Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3484055Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3484382Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3484770Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3485204Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3485510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3485782Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3485907Z Execution Analysis: .......... 2025-03-14T06:00:24.3486171Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3486372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3486667Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1725 counts during 1643 steps 2025-03-14T06:00:24.3486673Z 2025-03-14T06:00:24.3486904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3487024Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3487310Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3487444Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3487646Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3487790Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3487928Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3488099Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3488453Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3488808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3489117Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3489395Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3489698Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3489976Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3490265Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3490394Z Execution Analysis: (:1) 2025-03-14T06:00:24.3490652Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3490860Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3490864Z 2025-03-14T06:00:24.3491060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3491182Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3491415Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3491536Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3491740Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3491891Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3492036Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3492211Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3492798Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3493427Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3493783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3494141Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3494449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3494733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3495038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3495320Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3495427Z Execution Analysis: .......... 2025-03-14T06:00:24.3495695Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3495896Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3496192Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1726 counts during 1644 steps 2025-03-14T06:00:24.3496220Z 2025-03-14T06:00:24.3496424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3496536Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3496866Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3496975Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3497291Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3497428Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3497568Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3497736Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3498083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3498427Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3498738Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3499004Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3499312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3499573Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3499866Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3499992Z Execution Analysis: (:1) 2025-03-14T06:00:24.3500248Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3500440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3500444Z 2025-03-14T06:00:24.3500644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3500751Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3500982Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3501090Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3501289Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3501424Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3501573Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3501765Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3502369Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3502923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3503275Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3503614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3503919Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3504181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3504483Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3504746Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3504856Z Execution Analysis: .......... 2025-03-14T06:00:24.3505103Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3505301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3505604Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1727 counts during 1645 steps 2025-03-14T06:00:24.3505608Z 2025-03-14T06:00:24.3505807Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3505938Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3506222Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3506325Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3506527Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3506667Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3506807Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3506967Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3507426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3507747Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3508046Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3508304Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3508598Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3508850Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3509133Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3509253Z Execution Analysis: (:1) 2025-03-14T06:00:24.3509502Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3509691Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3509695Z 2025-03-14T06:00:24.3509897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3510005Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3510233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3510338Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3510541Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3510677Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3510853Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3511036Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3511597Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3512129Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3512478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3512808Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3513112Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3513368Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3513669Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3513935Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3514041Z Execution Analysis: .......... 2025-03-14T06:00:24.3514297Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3514511Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3514794Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1728 counts during 1646 steps 2025-03-14T06:00:24.3514798Z 2025-03-14T06:00:24.3515015Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3515139Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3515414Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3515534Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3515729Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3515875Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3516013Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3516181Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3516518Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3516862Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3517160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3517434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3517726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3517994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3518271Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3518398Z Execution Analysis: (:1) 2025-03-14T06:00:24.3518638Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3518845Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3518849Z 2025-03-14T06:00:24.3519038Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3519159Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3519378Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3519497Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3519690Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3519863Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3520027Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3520194Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3520738Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3521283Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3521622Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3521956Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3522246Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3522511Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3522797Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3523057Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3523157Z Execution Analysis: .......... 2025-03-14T06:00:24.3523433Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3523623Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3523925Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1729 counts during 1647 steps 2025-03-14T06:00:24.3523929Z 2025-03-14T06:00:24.3524119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3524237Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3524591Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3524712Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3525068Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3525229Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3525375Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3525556Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3525919Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3526284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3526596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3526886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3527195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3527482Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3527779Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3527917Z Execution Analysis: (:1) 2025-03-14T06:00:24.3528178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3528393Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3528398Z 2025-03-14T06:00:24.3528604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3528728Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3528960Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3529087Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3529329Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3529511Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3529662Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3529844Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3530439Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3531024Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3531398Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3531751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3532076Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3532359Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3532680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3532954Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3533076Z Execution Analysis: .......... 2025-03-14T06:00:24.3533375Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3533621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3533914Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1730 counts during 1648 steps 2025-03-14T06:00:24.3533919Z 2025-03-14T06:00:24.3534137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3534256Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3534562Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3534674Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3534891Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3535039Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3535195Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3535369Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3535739Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3536093Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3536415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3536689Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3537013Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3537282Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3537587Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3537713Z Execution Analysis: (:1) 2025-03-14T06:00:24.3537986Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3538190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3538194Z 2025-03-14T06:00:24.3538408Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3538522Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3538763Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3538923Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3539139Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3539285Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3539444Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3539613Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3540222Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3540798Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3541171Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3541525Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3541857Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3542135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3542455Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3542811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3542928Z Execution Analysis: .......... 2025-03-14T06:00:24.3543188Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3543428Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3543721Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1731 counts during 1649 steps 2025-03-14T06:00:24.3543725Z 2025-03-14T06:00:24.3543944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3544062Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3544366Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3544478Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3544697Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3544846Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3545003Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3545172Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3545547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3546009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3546328Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3546604Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3546917Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3547181Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3547482Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3547607Z Execution Analysis: (:1) 2025-03-14T06:00:24.3547872Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3548076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3548091Z 2025-03-14T06:00:24.3548290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3548445Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3548699Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3548819Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3549021Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3549175Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3549320Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3549488Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3550078Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3550650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3551003Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3551358Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3551667Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3551949Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3552280Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3552556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3552662Z Execution Analysis: .......... 2025-03-14T06:00:24.3552951Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3553150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3553441Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1732 counts during 1650 steps 2025-03-14T06:00:24.3553448Z 2025-03-14T06:00:24.3553651Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3553760Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3554051Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3554158Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3554362Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3554501Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3554645Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3554807Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3555159Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3555497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3555807Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3556076Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3556380Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3556640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3556929Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3557050Z Execution Analysis: (:1) 2025-03-14T06:00:24.3557309Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3557503Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3557507Z 2025-03-14T06:00:24.3557714Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3557877Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3558107Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3558214Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3558422Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3558559Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3558711Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3558874Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3559456Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3560012Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3560372Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3560715Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3561027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3561291Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3561624Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3561885Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3562016Z Execution Analysis: .......... 2025-03-14T06:00:24.3562267Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3562468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3562750Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1733 counts during 1651 steps 2025-03-14T06:00:24.3562762Z 2025-03-14T06:00:24.3562956Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3563065Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3563352Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3563460Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3563662Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3563802Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3563949Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3564111Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3564465Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3564877Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3565497Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3565779Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3566082Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3566362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3566654Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3566782Z Execution Analysis: (:1) 2025-03-14T06:00:24.3567035Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3567241Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3567307Z 2025-03-14T06:00:24.3567557Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3567676Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3567905Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3568020Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3568224Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3568372Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3568513Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3568682Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3569269Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3569848Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3570207Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3570564Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3570872Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3571190Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3571498Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3571801Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3571907Z Execution Analysis: .......... 2025-03-14T06:00:24.3572165Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3572366Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3572667Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1734 counts during 1652 steps 2025-03-14T06:00:24.3572672Z 2025-03-14T06:00:24.3572871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3572988Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3573278Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3573394Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3573596Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3573746Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3573885Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3574058Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3574414Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3574773Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3575081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3575360Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3575668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3575942Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3576237Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3576368Z Execution Analysis: (:1) 2025-03-14T06:00:24.3576625Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3576863Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3576891Z 2025-03-14T06:00:24.3577091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3577318Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3577643Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3577752Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3577943Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3578079Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3578218Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3578378Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3578925Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3579464Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3579794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3580124Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3580438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3580698Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3581003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3581256Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3581355Z Execution Analysis: .......... 2025-03-14T06:00:24.3581598Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3581785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3582057Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1735 counts during 1653 steps 2025-03-14T06:00:24.3582061Z 2025-03-14T06:00:24.3582251Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3582360Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3582631Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3582729Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3582923Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3583054Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3583191Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3583346Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3583684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3584005Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3584298Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3584550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3584841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3585090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3585362Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3585474Z Execution Analysis: (:1) 2025-03-14T06:00:24.3585716Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3585948Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3585952Z 2025-03-14T06:00:24.3586141Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3586244Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3586463Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3586561Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3586756Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3586888Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3587029Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3587183Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3587732Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3588258Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3588598Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3588944Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3589247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3589522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3589815Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3590066Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3590170Z Execution Analysis: .......... 2025-03-14T06:00:24.3590406Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3590596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3590862Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1736 counts during 1654 steps 2025-03-14T06:00:24.3590866Z 2025-03-14T06:00:24.3591058Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3591161Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3591432Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3591531Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3591724Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3591855Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3591991Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3592146Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3592658Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3592996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3593309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3593573Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3593880Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3594138Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3594432Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3594647Z Execution Analysis: (:1) 2025-03-14T06:00:24.3594929Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3595125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3595129Z 2025-03-14T06:00:24.3595335Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3595448Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3595682Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3595788Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3595997Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3596137Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3596289Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3596454Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3597040Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3597599Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3597977Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3598324Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3598652Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3598926Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3599225Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3599493Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3599601Z Execution Analysis: .......... 2025-03-14T06:00:24.3599861Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3600057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3600344Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1737 counts during 1655 steps 2025-03-14T06:00:24.3600349Z 2025-03-14T06:00:24.3600546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3600665Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3600946Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3601061Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3601258Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3601404Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3601541Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3601709Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3602054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3602397Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3602697Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3602971Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3603273Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3603538Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3603822Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3604018Z Execution Analysis: (:1) 2025-03-14T06:00:24.3604269Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3604469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3604553Z 2025-03-14T06:00:24.3604761Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3604881Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3605272Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3605390Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3605591Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3605738Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3605881Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3606054Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3606641Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3607219Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3607810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3608168Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3608502Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3608781Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3609083Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3609363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3609467Z Execution Analysis: .......... 2025-03-14T06:00:24.3609733Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3609933Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3610228Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1738 counts during 1656 steps 2025-03-14T06:00:24.3610233Z 2025-03-14T06:00:24.3610434Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3610555Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3610841Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3610957Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3611160Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3611307Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3611443Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3611616Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3611971Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3612326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3612634Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3612914Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3613221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3613495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3613831Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3613961Z Execution Analysis: (:1) 2025-03-14T06:00:24.3614217Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3614421Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3614427Z 2025-03-14T06:00:24.3614635Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3614746Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3614975Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3615089Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3615292Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3615436Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3615583Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3615757Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3616346Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3617048Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3617390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3617733Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3618027Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3618278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3618569Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3618816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3618918Z Execution Analysis: .......... 2025-03-14T06:00:24.3619152Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3619345Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3619612Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1739 counts during 1657 steps 2025-03-14T06:00:24.3619617Z 2025-03-14T06:00:24.3619811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3619914Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3620188Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3620291Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3620487Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3620620Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3620758Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3620910Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3621246Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3621570Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3621864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3622123Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3622411Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3622684Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3622986Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3623102Z Execution Analysis: (:1) 2025-03-14T06:00:24.3623343Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3623530Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3623534Z 2025-03-14T06:00:24.3623730Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3623835Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3624053Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3624152Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3624347Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3624478Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3624618Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3624771Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3625323Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3625870Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3626233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3626560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3626854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3627106Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3627397Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3627647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3627755Z Execution Analysis: .......... 2025-03-14T06:00:24.3627993Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3628187Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3628455Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1740 counts during 1658 steps 2025-03-14T06:00:24.3628461Z 2025-03-14T06:00:24.3628655Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3628759Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3629034Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3629136Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3629330Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3629463Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3629598Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3629754Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3630091Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3630414Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3630706Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3630959Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3631272Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3631541Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3631815Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3631931Z Execution Analysis: (:1) 2025-03-14T06:00:24.3632175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3632367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3632370Z 2025-03-14T06:00:24.3632556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3632668Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3632879Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3632988Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3633174Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3633311Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3633445Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3633604Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3634167Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3634733Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3635065Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3635393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3635681Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3635942Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3636226Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3636487Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3636584Z Execution Analysis: .......... 2025-03-14T06:00:24.3636832Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3637015Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3637294Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1741 counts during 1659 steps 2025-03-14T06:00:24.3637297Z 2025-03-14T06:00:24.3637484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3637601Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3637867Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3637982Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3638169Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3638315Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3638448Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3638609Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3638942Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3639279Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3639569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3639851Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3640157Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3640416Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3640682Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3640811Z Execution Analysis: (:1) 2025-03-14T06:00:24.3641049Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3641248Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3641252Z 2025-03-14T06:00:24.3641435Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3641548Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3641763Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3641879Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3642067Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3642204Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3642341Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3642505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3643072Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3643633Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3643968Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3644304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3644678Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3645110Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3645417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3645694Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3645798Z Execution Analysis: .......... 2025-03-14T06:00:24.3646062Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3646262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3646560Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1742 counts during 1660 steps 2025-03-14T06:00:24.3646566Z 2025-03-14T06:00:24.3646772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3646886Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3647182Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3647288Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3647497Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3647638Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3647779Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3647953Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3648311Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3648666Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3648984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3649311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3649625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3649893Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3650191Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3650312Z Execution Analysis: (:1) 2025-03-14T06:00:24.3650580Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3650779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3650783Z 2025-03-14T06:00:24.3650988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3651101Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3651342Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3651449Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3651660Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3651803Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3651960Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3652149Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3652774Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3653344Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3653714Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3654069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3654387Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3654661Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3654979Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3655245Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3655356Z Execution Analysis: .......... 2025-03-14T06:00:24.3655612Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3655818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3656106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1743 counts during 1661 steps 2025-03-14T06:00:24.3656114Z 2025-03-14T06:00:24.3656323Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3656437Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3656733Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3656843Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3657058Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3657306Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3657444Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3657599Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3657935Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3658260Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3658605Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3658860Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3659153Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3659402Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3659679Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3659794Z Execution Analysis: (:1) 2025-03-14T06:00:24.3660039Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3660224Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3660228Z 2025-03-14T06:00:24.3660420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3660524Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3660741Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3660844Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3661047Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3661206Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3661349Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3661505Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3662076Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3662604Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3662943Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3663270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3663563Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3663815Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3664105Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3664364Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3664460Z Execution Analysis: .......... 2025-03-14T06:00:24.3664696Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3664889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3665167Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1744 counts during 1662 steps 2025-03-14T06:00:24.3665172Z 2025-03-14T06:00:24.3665469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3665589Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3666041Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3666160Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3666363Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3666522Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3666662Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3666843Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3667199Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3667616Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3667959Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3668243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3668552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3668830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3669124Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3669258Z Execution Analysis: (:1) 2025-03-14T06:00:24.3669514Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3669724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3669732Z 2025-03-14T06:00:24.3669930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3670050Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3670280Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3670400Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3670651Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3670803Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3670947Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3671155Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3671748Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3672326Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3672691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3673049Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3673361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3673639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3673945Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3674219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3674324Z Execution Analysis: .......... 2025-03-14T06:00:24.3674587Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3674787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3675086Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1746 counts during 1663 steps 2025-03-14T06:00:24.3675091Z 2025-03-14T06:00:24.3675291Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3675411Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3675702Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3675818Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3676023Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3676171Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3676310Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3676488Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3676868Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3677248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3677556Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3678050Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3678335Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3678595Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3678867Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3678992Z Execution Analysis: (:1) 2025-03-14T06:00:24.3679230Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3679426Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3679432Z 2025-03-14T06:00:24.3679619Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3679733Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3679946Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3680079Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3680268Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3680410Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3680569Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3680732Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3681273Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3681808Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3682152Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3682475Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3682775Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3683028Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3683322Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3683567Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3683673Z Execution Analysis: .......... 2025-03-14T06:00:24.3683912Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3684105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3684371Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1747 counts during 1664 steps 2025-03-14T06:00:24.3684376Z 2025-03-14T06:00:24.3684633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3684739Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3685187Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3685297Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3685511Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3685653Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3685803Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3685999Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3686390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3686740Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3687061Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3687336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3687654Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3687930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3688233Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3688357Z Execution Analysis: (:1) 2025-03-14T06:00:24.3688623Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3688828Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3688832Z 2025-03-14T06:00:24.3689040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3689152Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3689411Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3689518Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3689728Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3689892Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3690043Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3690205Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3690799Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3691372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3691737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3692085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3692405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3692679Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3692991Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3693256Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3693371Z Execution Analysis: .......... 2025-03-14T06:00:24.3693629Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3693837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3694125Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1748 counts during 1665 steps 2025-03-14T06:00:24.3694129Z 2025-03-14T06:00:24.3694339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3694455Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3694749Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3694858Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3695067Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3695208Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3695382Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3695572Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3695937Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3696283Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3696600Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3696870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3697290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3697550Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3697839Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3697959Z Execution Analysis: (:1) 2025-03-14T06:00:24.3698222Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3698414Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3698426Z 2025-03-14T06:00:24.3698649Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3698770Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3698992Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3699106Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3699325Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3699465Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3699613Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3699774Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3700359Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3700923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3701270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3701619Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3701924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3702197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3702494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3702762Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3702864Z Execution Analysis: .......... 2025-03-14T06:00:24.3703119Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3703315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3703605Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1749 counts during 1666 steps 2025-03-14T06:00:24.3703611Z 2025-03-14T06:00:24.3703801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3703922Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3704200Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3704317Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3704512Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3704718Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3704855Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3705029Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3705373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3705722Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3706020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3706297Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3706592Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3706859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3707144Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3707389Z Execution Analysis: (:1) 2025-03-14T06:00:24.3707623Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3707818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3707822Z 2025-03-14T06:00:24.3708029Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3708141Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3708373Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3708482Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3708665Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3708802Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3708937Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3709107Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3709652Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3710191Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3710517Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3710851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3711136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3711399Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3711685Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3711945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3712039Z Execution Analysis: .......... 2025-03-14T06:00:24.3712282Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3712469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3712743Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1750 counts during 1667 steps 2025-03-14T06:00:24.3712747Z 2025-03-14T06:00:24.3712936Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3713050Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3713321Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3713454Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3713665Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3713804Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3713935Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3714094Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3714424Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3714754Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3715042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3715473Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3715772Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3716041Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3716334Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3716455Z Execution Analysis: (:1) 2025-03-14T06:00:24.3716713Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3716930Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3716934Z 2025-03-14T06:00:24.3717137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3717269Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3717500Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3717604Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3717806Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3717946Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3718098Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3718258Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3718838Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3719392Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3719749Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3720088Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3720406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3720676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3720989Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3721249Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3721363Z Execution Analysis: .......... 2025-03-14T06:00:24.3721612Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3721819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3722106Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1751 counts during 1668 steps 2025-03-14T06:00:24.3722111Z 2025-03-14T06:00:24.3722314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3722426Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3722717Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3722868Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3723078Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3723216Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3723363Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3723526Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3723884Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3724226Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3724622Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3725055Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3725372Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3725642Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3725946Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3726069Z Execution Analysis: (:1) 2025-03-14T06:00:24.3726377Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3726577Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3726582Z 2025-03-14T06:00:24.3726825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3726939Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3727179Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3727284Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3727501Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3727646Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3727807Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3727970Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3728570Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3729142Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3729511Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3729862Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3730185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3730461Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3730777Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3731044Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3731160Z Execution Analysis: .......... 2025-03-14T06:00:24.3731418Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3731630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3731914Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1752 counts during 1669 steps 2025-03-14T06:00:24.3731926Z 2025-03-14T06:00:24.3732127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3732275Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3732588Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3732704Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3732907Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3733058Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3733200Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3733368Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3733734Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3734092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3734404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3734685Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3734995Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3735271Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3735564Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3735694Z Execution Analysis: (:1) 2025-03-14T06:00:24.3735975Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3736189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3736295Z 2025-03-14T06:00:24.3736498Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3736615Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3736846Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3736967Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3737171Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3737431Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3737573Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3737746Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3738430Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3738968Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3739297Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3739629Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3739921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3740181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3740467Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3740725Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3740824Z Execution Analysis: .......... 2025-03-14T06:00:24.3741069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3741254Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3741528Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1753 counts during 1670 steps 2025-03-14T06:00:24.3741533Z 2025-03-14T06:00:24.3741718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3741886Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3742152Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3742262Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3742449Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3742593Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3742724Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3742893Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3743224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3743561Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3743846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3744109Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3744391Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3744647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3744914Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3745057Z Execution Analysis: (:1) 2025-03-14T06:00:24.3745295Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3745514Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3745518Z 2025-03-14T06:00:24.3745703Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3745817Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3746028Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3746141Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3746331Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3746471Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3746603Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3746770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3747311Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3747846Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3748174Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3748510Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3748798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3749061Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3749348Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3749597Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3749702Z Execution Analysis: .......... 2025-03-14T06:00:24.3749942Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3750134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3750402Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1754 counts during 1671 steps 2025-03-14T06:00:24.3750440Z 2025-03-14T06:00:24.3750654Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3750760Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3751033Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3751134Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3751331Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3751462Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3751598Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3751754Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3752089Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3752411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3752705Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3752962Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3753256Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3753502Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3753801Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3753918Z Execution Analysis: (:1) 2025-03-14T06:00:24.3754187Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3754376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3754380Z 2025-03-14T06:00:24.3754572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3754684Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3754912Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3755013Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3755211Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3755342Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3755488Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3755642Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3756197Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3756724Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3757069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3757392Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3757692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3757944Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3758242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3758488Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3758599Z Execution Analysis: .......... 2025-03-14T06:00:24.3758844Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3759040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3759330Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1755 counts during 1672 steps 2025-03-14T06:00:24.3759358Z 2025-03-14T06:00:24.3759553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3759656Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3759931Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3760032Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3760229Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3760364Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3760505Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3760657Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3760999Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3761324Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3761620Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3761871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3764058Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3764372Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3764761Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3764881Z Execution Analysis: (:1) 2025-03-14T06:00:24.3765449Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3765656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3765664Z 2025-03-14T06:00:24.3765875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3765994Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3766239Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3766353Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3766595Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3766743Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3766898Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3767066Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3767666Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3768236Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3768611Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3768960Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3769285Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3769561Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3769879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3770146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3770261Z Execution Analysis: .......... 2025-03-14T06:00:24.3770516Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3770780Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3771109Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1756 counts during 1673 steps 2025-03-14T06:00:24.3771114Z 2025-03-14T06:00:24.3771325Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3771440Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3771749Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3771860Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3772077Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3772219Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3772372Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3772541Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3772910Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3773262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3773580Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3773853Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3774282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3774553Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3774857Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3774980Z Execution Analysis: (:1) 2025-03-14T06:00:24.3775244Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3775454Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3775460Z 2025-03-14T06:00:24.3775656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3775778Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3776007Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3776129Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3776336Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3776492Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3776637Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3776817Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3777617Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3778158Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3778490Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3778824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3779114Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3779377Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3779660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3779921Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3780017Z Execution Analysis: .......... 2025-03-14T06:00:24.3780266Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3780501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3780779Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1757 counts during 1674 steps 2025-03-14T06:00:24.3780784Z 2025-03-14T06:00:24.3780970Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3781089Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3781353Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3781462Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3781651Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3781791Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3781919Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3782081Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3782413Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3782750Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3783033Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3783357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3783641Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3783899Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3784165Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3784289Z Execution Analysis: (:1) 2025-03-14T06:00:24.3784525Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3784728Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3784732Z 2025-03-14T06:00:24.3784918Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3785038Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3785254Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3785373Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3785562Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3785708Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3785845Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3786012Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3786560Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3787102Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3787433Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3787772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3788059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3788322Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3788604Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3788866Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3788990Z Execution Analysis: .......... 2025-03-14T06:00:24.3789264Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3789450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3789725Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1758 counts during 1675 steps 2025-03-14T06:00:24.3789729Z 2025-03-14T06:00:24.3789929Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3790033Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3790312Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3790416Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3790605Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3790747Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3790879Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3791049Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3791378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3791709Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3792054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3792307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3792599Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3792846Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3793124Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3793238Z Execution Analysis: (:1) 2025-03-14T06:00:24.3793486Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3793673Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3793678Z 2025-03-14T06:00:24.3793877Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3793987Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3794208Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3794308Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3794504Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3794633Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3794781Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3794934Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3795485Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3796183Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3796543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3796887Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3797198Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3797461Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3797774Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3798036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3798203Z Execution Analysis: .......... 2025-03-14T06:00:24.3798450Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3798656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3798941Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1759 counts during 1676 steps 2025-03-14T06:00:24.3798946Z 2025-03-14T06:00:24.3799149Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3799259Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3799555Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3799660Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3799868Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3800007Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3800158Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3800318Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3800673Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3801040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3801379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3801648Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3801955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3802217Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3802507Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3802633Z Execution Analysis: (:1) 2025-03-14T06:00:24.3802893Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3803089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3803093Z 2025-03-14T06:00:24.3803304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3803416Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3803652Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3803758Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3803966Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3804106Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3804263Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3804429Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3805297Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3805878Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3806253Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3806607Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3806934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3807213Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3807537Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3807881Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3807990Z Execution Analysis: .......... 2025-03-14T06:00:24.3808249Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3808471Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3808777Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1760 counts during 1677 steps 2025-03-14T06:00:24.3808783Z 2025-03-14T06:00:24.3808985Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3809116Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3809406Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3809532Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3809737Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3809898Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3810041Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3810222Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3810578Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3811007Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3811322Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3811611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3811921Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3812203Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3812498Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3812636Z Execution Analysis: (:1) 2025-03-14T06:00:24.3812895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3813113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3813119Z 2025-03-14T06:00:24.3813320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3813450Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3813684Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3813807Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3814009Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3814163Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3814310Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3814492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3815084Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3815667Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3816023Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3816392Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3816703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3816987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3817424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3817724Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3817830Z Execution Analysis: .......... 2025-03-14T06:00:24.3818092Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3818290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3818583Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1761 counts during 1678 steps 2025-03-14T06:00:24.3818587Z 2025-03-14T06:00:24.3818786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3818908Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3819192Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3819314Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3819513Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3819665Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3819907Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3820074Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3820454Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3820792Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3821083Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3821347Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3821632Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3821897Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3822171Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3822301Z Execution Analysis: (:1) 2025-03-14T06:00:24.3822540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3822745Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3822749Z 2025-03-14T06:00:24.3822936Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3823056Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3823271Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3823387Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3823578Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3823726Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3823862Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3824030Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3824578Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3825118Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3825464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3825788Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3826088Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3826540Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3826875Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3827137Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3827253Z Execution Analysis: .......... 2025-03-14T06:00:24.3827507Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3827717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3827999Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1762 counts during 1679 steps 2025-03-14T06:00:24.3828003Z 2025-03-14T06:00:24.3828213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3828323Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3828618Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3828727Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3828937Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3829076Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3829224Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3829436Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3829800Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3830140Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3830453Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3830720Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3831035Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3831297Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3831598Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3831720Z Execution Analysis: (:1) 2025-03-14T06:00:24.3831983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3832180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3832184Z 2025-03-14T06:00:24.3832392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3832505Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3832743Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3832852Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3833062Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3833201Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3833359Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3833524Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3834112Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3834666Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3835026Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3835369Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3835710Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3836000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3836311Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3836574Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3836694Z Execution Analysis: .......... 2025-03-14T06:00:24.3836947Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3837152Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3837438Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1763 counts during 1680 steps 2025-03-14T06:00:24.3837442Z 2025-03-14T06:00:24.3837652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3837766Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3838061Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3838277Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3838477Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3838610Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3838799Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3838960Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3839299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3839626Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3839925Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3840183Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3840483Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3840734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3841015Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3841133Z Execution Analysis: (:1) 2025-03-14T06:00:24.3841381Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3841567Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3841582Z 2025-03-14T06:00:24.3841768Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3841885Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3842105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3842222Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3842410Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3842545Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3842690Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3842848Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3843405Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3843944Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3844279Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3844688Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3845228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3849697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3850065Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3850353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3850459Z Execution Analysis: .......... 2025-03-14T06:00:24.3850729Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3850934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3851230Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1764 counts during 1681 steps 2025-03-14T06:00:24.3851239Z 2025-03-14T06:00:24.3851440Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3851562Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3851853Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3851972Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3852238Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3852422Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3852563Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3852738Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3853100Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3853456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3853765Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3854045Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3854359Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3854632Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3854923Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3855053Z Execution Analysis: (:1) 2025-03-14T06:00:24.3855309Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3855515Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3855520Z 2025-03-14T06:00:24.3855720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3855839Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3856068Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3856182Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3856386Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3856532Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3856678Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3856851Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3857532Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3858066Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3858395Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3858784Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3859071Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3859326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3859614Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3859865Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3859960Z Execution Analysis: .......... 2025-03-14T06:00:24.3860203Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3860387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3860662Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1765 counts during 1682 steps 2025-03-14T06:00:24.3860670Z 2025-03-14T06:00:24.3860856Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3860967Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3861232Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3861364Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3861575Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3861712Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3861842Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3862002Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3862331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3862661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3862950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3863205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3863488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3863914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3864195Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3864320Z Execution Analysis: (:1) 2025-03-14T06:00:24.3864569Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3864770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3864775Z 2025-03-14T06:00:24.3864969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3865085Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3865454Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3865567Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3865932Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3866084Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3866228Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3866400Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3866988Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3867563Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3867990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3868377Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3868695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3868971Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3869282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3869547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3869657Z Execution Analysis: .......... 2025-03-14T06:00:24.3869910Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3870114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3870408Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1767 counts during 1683 steps 2025-03-14T06:00:24.3870414Z 2025-03-14T06:00:24.3870617Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3870731Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3871092Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3871202Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3871408Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3871550Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3871700Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3871863Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3872225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3872575Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3872895Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3873169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3873478Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3873747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3874044Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3874168Z Execution Analysis: (:1) 2025-03-14T06:00:24.3874427Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3874626Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3874634Z 2025-03-14T06:00:24.3874841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3874952Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3875191Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3875298Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3875507Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3875650Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3875799Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3875966Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3876666Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3877221Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3877623Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3878064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3878361Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3878613Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3878901Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3879148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3879248Z Execution Analysis: .......... 2025-03-14T06:00:24.3879485Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3879680Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3879946Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1768 counts during 1684 steps 2025-03-14T06:00:24.3879951Z 2025-03-14T06:00:24.3880144Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3880274Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3880570Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3880670Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3880861Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3880990Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3881124Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3881276Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3881616Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3881940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3882230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3882484Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3882775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3883020Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3883293Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3883408Z Execution Analysis: (:1) 2025-03-14T06:00:24.3883649Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3883833Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3883846Z 2025-03-14T06:00:24.3884027Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3884134Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3884346Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3884451Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3884707Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3884842Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3885144Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3885308Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3885902Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3886522Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3886905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3887261Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3887572Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3887848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3888150Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3888423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3888526Z Execution Analysis: .......... 2025-03-14T06:00:24.3888787Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3888987Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3889282Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1769 counts during 1685 steps 2025-03-14T06:00:24.3889287Z 2025-03-14T06:00:24.3889612Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3889739Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3890033Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3890152Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3890358Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3890514Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3890658Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3890840Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3891206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3891573Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3891892Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3892181Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3892492Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3892772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3893067Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3893203Z Execution Analysis: (:1) 2025-03-14T06:00:24.3893468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3893683Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3893688Z 2025-03-14T06:00:24.3893894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3894026Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3894262Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3894385Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3894594Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3894756Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3894906Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3895089Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3895684Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3896322Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3896686Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3897053Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3897473Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3897755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3898059Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3898338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3898448Z Execution Analysis: .......... 2025-03-14T06:00:24.3898715Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3898916Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3899216Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1770 counts during 1686 steps 2025-03-14T06:00:24.3899248Z 2025-03-14T06:00:24.3899474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3899597Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3899882Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3900005Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3900208Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3900367Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3900512Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3900683Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3901034Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3901395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3901703Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3901980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3902288Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3902555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3902847Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3902971Z Execution Analysis: (:1) 2025-03-14T06:00:24.3903232Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3903429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3903434Z 2025-03-14T06:00:24.3903641Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3903757Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3903994Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3904102Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3904309Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3904450Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3904607Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3904770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3905404Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3905988Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3906353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3906695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3907007Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3907383Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3907676Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3907930Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3908038Z Execution Analysis: .......... 2025-03-14T06:00:24.3908277Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3908479Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3908793Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1771 counts during 1687 steps 2025-03-14T06:00:24.3908797Z 2025-03-14T06:00:24.3908998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3909105Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3909386Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3909495Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3909693Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3909830Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3909971Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3910129Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3910470Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3910797Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3911094Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3911346Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3911640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3911890Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3912171Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3912291Z Execution Analysis: (:1) 2025-03-14T06:00:24.3912540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3912731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3912737Z 2025-03-14T06:00:24.3912934Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3913042Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3913268Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3913374Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3913575Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3913711Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3913884Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3914066Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3914623Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3915157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3915505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3915831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3916130Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3916385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3916684Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3916937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3917045Z Execution Analysis: .......... 2025-03-14T06:00:24.3917285Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3917538Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3917823Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1772 counts during 1688 steps 2025-03-14T06:00:24.3917827Z 2025-03-14T06:00:24.3918017Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3918134Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3918402Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3918517Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3918707Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3918852Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3918985Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3919152Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3919485Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3919825Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3920114Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3920375Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3920660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3920920Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3921195Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3921321Z Execution Analysis: (:1) 2025-03-14T06:00:24.3921561Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3921756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3921760Z 2025-03-14T06:00:24.3921950Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3922066Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3922282Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3922390Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3922588Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3922755Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3922915Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3923081Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3923625Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3924162Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3924584Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3925084Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3925395Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3925681Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3925994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3926277Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3926384Z Execution Analysis: .......... 2025-03-14T06:00:24.3926694Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3926924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3927226Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1773 counts during 1689 steps 2025-03-14T06:00:24.3927231Z 2025-03-14T06:00:24.3927436Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3927566Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3927855Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3927982Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3928187Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3928344Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3928488Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3928670Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3929032Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3929393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3929708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3929992Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3930300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3930590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3930883Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3931020Z Execution Analysis: (:1) 2025-03-14T06:00:24.3931279Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3931495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3931500Z 2025-03-14T06:00:24.3931703Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3931829Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3932063Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3932186Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3932416Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3932598Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3932747Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3932926Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3933521Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3934106Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3934461Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3934819Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3935131Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3935408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3935716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3935982Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3936118Z Execution Analysis: .......... 2025-03-14T06:00:24.3936400Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3936608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3936896Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1774 counts during 1690 steps 2025-03-14T06:00:24.3936900Z 2025-03-14T06:00:24.3937213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3937321Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3937594Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3937695Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3937885Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3938018Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3938153Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3938310Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3938642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3938966Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3939262Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3939517Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3939809Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3940059Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3940331Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3940446Z Execution Analysis: (:1) 2025-03-14T06:00:24.3940690Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3940877Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3940880Z 2025-03-14T06:00:24.3941067Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3941170Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3941388Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3941515Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3941733Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3941865Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3942003Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3942155Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3942706Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3943233Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3943568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3943889Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3944185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3944438Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3944726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3945015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3945117Z Execution Analysis: .......... 2025-03-14T06:00:24.3945351Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3945541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3945805Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1775 counts during 1691 steps 2025-03-14T06:00:24.3945810Z 2025-03-14T06:00:24.3945999Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3946104Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3946375Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3946474Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3946666Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3946799Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3946934Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3947085Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3947419Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3947740Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3948032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3948284Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3948571Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3948815Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3949088Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3949200Z Execution Analysis: (:1) 2025-03-14T06:00:24.3949442Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3949631Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3949640Z 2025-03-14T06:00:24.3949825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3949933Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3950166Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3950287Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3950478Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3950606Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3950740Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3950894Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3951442Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3951976Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3952307Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3952640Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3952933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3953192Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3953510Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3953783Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3953879Z Execution Analysis: .......... 2025-03-14T06:00:24.3954121Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3954305Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3954579Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1776 counts during 1692 steps 2025-03-14T06:00:24.3954586Z 2025-03-14T06:00:24.3954772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3954882Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3955149Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3955259Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3955451Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3955594Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3955726Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3955884Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3956213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3956541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3956828Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3957085Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3957365Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3957618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3957889Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3958010Z Execution Analysis: (:1) 2025-03-14T06:00:24.3958245Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3958434Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3958438Z 2025-03-14T06:00:24.3958621Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3958782Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3958992Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3959099Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3959289Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3959424Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3959560Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3959720Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3960261Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3960797Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3961127Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3961457Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3961743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3962023Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3962328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3962589Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3962685Z Execution Analysis: .......... 2025-03-14T06:00:24.3962929Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3963115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3963395Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1777 counts during 1693 steps 2025-03-14T06:00:24.3963401Z 2025-03-14T06:00:24.3963588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3963699Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3963963Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3964074Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3964258Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3964394Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3964605Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3964770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3965278Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3965752Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3966066Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3966344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3966646Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3966923Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3967212Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3967343Z Execution Analysis: (:1) 2025-03-14T06:00:24.3967595Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3967805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3967866Z 2025-03-14T06:00:24.3968072Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3968220Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3968455Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3968564Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3968772Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3968913Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3969066Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3969230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3969827Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3970398Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3970764Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3971113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3971430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3971763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3972075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3972343Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3972451Z Execution Analysis: .......... 2025-03-14T06:00:24.3972707Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3972912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3973204Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1778 counts during 1694 steps 2025-03-14T06:00:24.3973209Z 2025-03-14T06:00:24.3973414Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3973525Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3973822Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3973932Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3974141Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3974285Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3974431Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3974595Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3974953Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3975304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3975623Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3975893Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3976207Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3976475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3976771Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3976893Z Execution Analysis: (:1) 2025-03-14T06:00:24.3977262Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3977559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3977609Z 2025-03-14T06:00:24.3977801Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3977907Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3978129Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3978231Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3978425Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3978557Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3978696Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3978850Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3979397Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3979924Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3980259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3980584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3980921Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3981173Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3981461Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3981707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3981806Z Execution Analysis: .......... 2025-03-14T06:00:24.3982041Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3982239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3982506Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1779 counts during 1695 steps 2025-03-14T06:00:24.3982517Z 2025-03-14T06:00:24.3982705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3982817Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3983085Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3983190Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3983376Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3983516Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3983645Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3983796Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3984130Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3984456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3984739Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3984996Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3985276Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3985524Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3985790Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3985906Z Execution Analysis: (:1) 2025-03-14T06:00:24.3986139Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3986383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3986386Z 2025-03-14T06:00:24.3986568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3986674Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3986887Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3986994Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3987181Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3987315Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3987447Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3987603Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3988146Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3988680Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3989009Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3989379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3989666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3989921Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3990205Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3990455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3990551Z Execution Analysis: .......... 2025-03-14T06:00:24.3990792Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3990978Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3991248Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1780 counts during 1696 steps 2025-03-14T06:00:24.3991252Z 2025-03-14T06:00:24.3991441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3991548Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3991814Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.3991919Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3992104Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.3992240Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.3992369Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.3992526Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3992855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.3993181Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3993468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3993725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3994009Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3994260Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3994527Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.3994644Z Execution Analysis: (:1) 2025-03-14T06:00:24.3994906Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.3995124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3995128Z 2025-03-14T06:00:24.3995310Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.3995422Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.3995635Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.3995740Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.3995928Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.3996236Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.3996377Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.3996544Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.3997116Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.3997680Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.3998052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.3998423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.3998725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.3998995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.3999297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.3999558Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.3999669Z Execution Analysis: .......... 2025-03-14T06:00:24.3999914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4000114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4000398Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1781 counts during 1697 steps 2025-03-14T06:00:24.4000405Z 2025-03-14T06:00:24.4000604Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4000711Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4000998Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4001103Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4001305Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4001447Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4001592Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4001756Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4002106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4002446Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4002754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4003022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4003324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4003588Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4003873Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4004043Z Execution Analysis: (:1) 2025-03-14T06:00:24.4004295Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4004565Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4004573Z 2025-03-14T06:00:24.4004783Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4004892Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4005295Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4005404Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4005613Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4005824Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4005975Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4006145Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4006737Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4007306Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4007721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4008069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4008384Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4008657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4008967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4009243Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4009353Z Execution Analysis: .......... 2025-03-14T06:00:24.4009607Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4009815Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4010103Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1782 counts during 1698 steps 2025-03-14T06:00:24.4010109Z 2025-03-14T06:00:24.4010312Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4010423Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4010713Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4010823Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4011032Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4011174Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4011318Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4011483Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4011842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4012196Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4012509Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4012780Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4013090Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4013357Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4013674Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4013823Z Execution Analysis: (:1) 2025-03-14T06:00:24.4014083Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4014284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4014288Z 2025-03-14T06:00:24.4014494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4014606Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4014841Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4014949Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4015164Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4015305Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4015461Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4015630Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4016224Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4016842Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4017308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4017639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4017928Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4018189Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4018476Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4018734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4018832Z Execution Analysis: .......... 2025-03-14T06:00:24.4019071Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4019259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4019537Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1783 counts during 1699 steps 2025-03-14T06:00:24.4019542Z 2025-03-14T06:00:24.4019732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4019842Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4020109Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4020224Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4020413Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4020554Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4020687Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4020850Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4021186Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4021515Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4021802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4022059Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4022343Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4022632Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4022925Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4023047Z Execution Analysis: (:1) 2025-03-14T06:00:24.4023286Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4023479Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4023483Z 2025-03-14T06:00:24.4023668Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4023778Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4023989Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4024097Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4024283Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4024418Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4024554Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4024715Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4025282Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4025837Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4026166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4026494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4026780Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4027039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4027322Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4027572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4027669Z Execution Analysis: .......... 2025-03-14T06:00:24.4027913Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4028100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4028372Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1784 counts during 1700 steps 2025-03-14T06:00:24.4028377Z 2025-03-14T06:00:24.4028563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4028669Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4028939Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4029046Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4029404Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4029548Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4029686Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4029856Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4030204Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4030548Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4030849Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4031115Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4031440Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4031800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4032082Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4032208Z Execution Analysis: (:1) 2025-03-14T06:00:24.4032458Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4032660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4032664Z 2025-03-14T06:00:24.4032865Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4032972Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4033199Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4033308Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4033510Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4033648Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4033787Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4033954Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4034580Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4035137Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4035493Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4035834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4036145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4036415Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4036719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4036979Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4037090Z Execution Analysis: .......... 2025-03-14T06:00:24.4037339Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4037542Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4037825Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1785 counts during 1701 steps 2025-03-14T06:00:24.4037829Z 2025-03-14T06:00:24.4038032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4038144Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4038432Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4038540Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4038743Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4038882Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4039027Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4039189Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4039541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4039880Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4040188Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4040456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4040805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4041065Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4041453Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4041570Z Execution Analysis: (:1) 2025-03-14T06:00:24.4041812Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4042000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4042004Z 2025-03-14T06:00:24.4042192Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4042295Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4042510Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4042612Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4042803Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4042937Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4043077Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4043254Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4043827Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4044355Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4044773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4045285Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4045608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4045882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4046193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4046467Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4046576Z Execution Analysis: .......... 2025-03-14T06:00:24.4046832Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4047041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4047331Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1786 counts during 1702 steps 2025-03-14T06:00:24.4047335Z 2025-03-14T06:00:24.4047544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4047657Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4047952Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4048062Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4048273Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4048418Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4048565Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4048733Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4049095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4049444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4049761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4050091Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4050403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4050675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4050966Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4051093Z Execution Analysis: (:1) 2025-03-14T06:00:24.4051348Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4051551Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4051555Z 2025-03-14T06:00:24.4051755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4051876Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4052106Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4052219Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4052423Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4052572Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4052743Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4052956Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4053543Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4054124Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4054480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4054840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4055153Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4055431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4055741Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4056015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4056119Z Execution Analysis: .......... 2025-03-14T06:00:24.4056384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4056581Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4056876Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1788 counts during 1703 steps 2025-03-14T06:00:24.4056884Z 2025-03-14T06:00:24.4057087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4057308Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4057572Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4057682Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4057871Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4058009Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4058139Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4058297Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4058632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4058962Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4059272Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4059554Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4059840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4060101Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4060373Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4060496Z Execution Analysis: (:1) 2025-03-14T06:00:24.4060734Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4060923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4060927Z 2025-03-14T06:00:24.4061113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4061228Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4061439Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4061547Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4061736Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4061894Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4062054Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4062216Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4062761Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4063297Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4063631Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4063965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4064255Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4064519Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4064804Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4065058Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4065157Z Execution Analysis: .......... 2025-03-14T06:00:24.4065674Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4065872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4066330Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1789 counts during 1704 steps 2025-03-14T06:00:24.4066336Z 2025-03-14T06:00:24.4066546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4066661Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4066957Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4067071Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4067283Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4067427Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4067576Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4067743Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4068106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4068508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4068858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4069130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4069444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4069712Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4070010Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4070134Z Execution Analysis: (:1) 2025-03-14T06:00:24.4070393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4070592Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4070598Z 2025-03-14T06:00:24.4070806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4070917Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4071154Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4071262Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4071545Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4071686Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4071836Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4072003Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4072599Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4073167Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4073533Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4073885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4074205Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4074478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4074788Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4075054Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4075164Z Execution Analysis: .......... 2025-03-14T06:00:24.4075418Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4075624Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4075913Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1790 counts during 1705 steps 2025-03-14T06:00:24.4075918Z 2025-03-14T06:00:24.4076121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4076234Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4076525Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4076631Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4076837Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4076981Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4077126Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4077290Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4077677Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4078050Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4078472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4078739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4079043Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4079305Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4079593Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4079712Z Execution Analysis: (:1) 2025-03-14T06:00:24.4079965Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4080163Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4080169Z 2025-03-14T06:00:24.4080368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4080478Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4080710Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4080864Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4081069Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4081206Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4081354Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4081516Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4082191Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4082721Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4083057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4083381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4083673Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4083937Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4084216Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4084471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4084635Z Execution Analysis: .......... 2025-03-14T06:00:24.4084881Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4085246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4085542Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1791 counts during 1706 steps 2025-03-14T06:00:24.4085547Z 2025-03-14T06:00:24.4085751Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4085872Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4086160Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4086276Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4086480Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4086630Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4086769Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4087166Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4087552Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4087908Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4088221Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4088507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4088814Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4089089Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4089378Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4089514Z Execution Analysis: (:1) 2025-03-14T06:00:24.4089771Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4089982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4089986Z 2025-03-14T06:00:24.4090184Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4090302Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4090594Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4090713Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4090918Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4091066Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4091211Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4091380Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4091971Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4092547Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4092906Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4093266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4093577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4093854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4094159Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4094429Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4094539Z Execution Analysis: .......... 2025-03-14T06:00:24.4094804Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4095004Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4095298Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1792 counts during 1707 steps 2025-03-14T06:00:24.4095304Z 2025-03-14T06:00:24.4095506Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4095621Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4095907Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4096026Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4096229Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4096380Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4096550Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4096745Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4097103Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4097560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4097866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4098135Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4098431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4098696Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4098982Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4099107Z Execution Analysis: (:1) 2025-03-14T06:00:24.4099359Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4099556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4099561Z 2025-03-14T06:00:24.4099778Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4099915Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4100146Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4100260Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4100458Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4100608Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4100751Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4100922Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4101502Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4102067Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4102428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4102769Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4103082Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4103349Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4103659Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4103925Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4104039Z Execution Analysis: .......... 2025-03-14T06:00:24.4104287Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4104492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4104776Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1793 counts during 1708 steps 2025-03-14T06:00:24.4104781Z 2025-03-14T06:00:24.4104987Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4105095Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4105382Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4105490Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4105703Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4105868Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4106038Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4106202Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4106561Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4106902Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4107212Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4107576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4107870Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4108118Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4108398Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4108516Z Execution Analysis: (:1) 2025-03-14T06:00:24.4108766Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4108954Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4108958Z 2025-03-14T06:00:24.4109202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4109312Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4109535Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4109635Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4109829Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4109961Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4110106Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4110261Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4110814Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4111343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4111688Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4112013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4112307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4112557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4112848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4113096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4113203Z Execution Analysis: .......... 2025-03-14T06:00:24.4113441Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4113633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4113899Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1794 counts during 1709 steps 2025-03-14T06:00:24.4113903Z 2025-03-14T06:00:24.4114099Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4114204Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4114477Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4114583Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4114806Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4114966Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4115100Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4115255Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4115599Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4115926Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4116225Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4116478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4116769Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4117016Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4117295Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4117408Z Execution Analysis: (:1) 2025-03-14T06:00:24.4117829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4118068Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4118082Z 2025-03-14T06:00:24.4118276Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4118393Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4118612Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4118725Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4118920Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4119071Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4119214Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4119387Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4119959Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4120529Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4120878Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4121229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4121532Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4121808Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4122110Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4122379Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4122480Z Execution Analysis: .......... 2025-03-14T06:00:24.4122743Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4122943Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4123235Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1795 counts during 1710 steps 2025-03-14T06:00:24.4123239Z 2025-03-14T06:00:24.4123434Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4123556Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4123835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4124015Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4124210Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4124359Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4124562Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4124736Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4125258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4125622Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4125935Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4126221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4126526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4126809Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4127102Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4127239Z Execution Analysis: (:1) 2025-03-14T06:00:24.4127523Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4127756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4127760Z 2025-03-14T06:00:24.4127960Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4128080Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4128310Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4128425Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4128630Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4128782Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4128928Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4129100Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4129685Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4130268Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4130625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4130985Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4131296Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4131579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4131887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4132164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4132274Z Execution Analysis: .......... 2025-03-14T06:00:24.4132537Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4132738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4133033Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1796 counts during 1711 steps 2025-03-14T06:00:24.4133037Z 2025-03-14T06:00:24.4133248Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4133384Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4133684Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4133819Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4134023Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4134172Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4134316Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4134491Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4134847Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4135206Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4135513Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4135797Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4136114Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4136387Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4136689Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4136814Z Execution Analysis: (:1) 2025-03-14T06:00:24.4137133Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4137336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4137340Z 2025-03-14T06:00:24.4137549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4137660Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4137898Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4138007Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4138217Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4138357Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4138509Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4138675Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4139273Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4139843Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4140214Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4140566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4140886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4141162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4141479Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4141750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4141866Z Execution Analysis: .......... 2025-03-14T06:00:24.4142122Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4142330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4142615Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1797 counts during 1712 steps 2025-03-14T06:00:24.4142620Z 2025-03-14T06:00:24.4142831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4142995Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4143292Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4143406Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4143619Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4143766Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4143918Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4144086Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4144452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4144804Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4145125Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4145402Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4145718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4145984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4146305Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4146456Z Execution Analysis: (:1) 2025-03-14T06:00:24.4146721Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4146924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4146928Z 2025-03-14T06:00:24.4147137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4147250Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4147490Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4147601Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4147816Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4147958Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4148117Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4148288Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4148887Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4149464Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4149830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4150185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4150503Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4150774Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4151198Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4151463Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4151574Z Execution Analysis: .......... 2025-03-14T06:00:24.4151930Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4152123Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4152399Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1798 counts during 1713 steps 2025-03-14T06:00:24.4152427Z 2025-03-14T06:00:24.4152618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4152762Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4153029Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4153140Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4153330Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4153468Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4153597Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4153759Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4154088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4154419Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4154709Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4154972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4155255Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4155511Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4155821Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4155947Z Execution Analysis: (:1) 2025-03-14T06:00:24.4156183Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4156382Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4156386Z 2025-03-14T06:00:24.4156572Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4156689Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4156899Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4157009Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4157196Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4157335Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4157473Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4157634Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4158178Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4158708Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4159039Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4159373Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4159661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4159920Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4160207Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4160463Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4160556Z Execution Analysis: .......... 2025-03-14T06:00:24.4160803Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4160987Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4161297Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1799 counts during 1714 steps 2025-03-14T06:00:24.4161327Z 2025-03-14T06:00:24.4161512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4161623Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4161891Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4161998Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4162185Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4162324Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4162453Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4162617Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4162947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4163279Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4163569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4163829Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4164111Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4164411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4164746Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4164868Z Execution Analysis: (:1) 2025-03-14T06:00:24.4165442Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4165656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4165662Z 2025-03-14T06:00:24.4165860Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4165987Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4166217Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4166339Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4166547Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4166704Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4166851Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4167031Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4167619Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4168198Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4168563Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4168922Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4169247Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4169521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4169838Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4170104Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4170219Z Execution Analysis: .......... 2025-03-14T06:00:24.4170473Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4170684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4171063Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1800 counts during 1715 steps 2025-03-14T06:00:24.4171068Z 2025-03-14T06:00:24.4171281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4171392Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4171695Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4171804Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4172019Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4172160Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4172309Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4172473Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4172845Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4173199Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4173521Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4173796Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4174173Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4174443Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4174747Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4174873Z Execution Analysis: (:1) 2025-03-14T06:00:24.4175138Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4175339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4175346Z 2025-03-14T06:00:24.4175553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4175667Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4175903Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4176014Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4176230Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4176374Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4176526Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4176692Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4177392Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4177950Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4178306Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4178646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4178959Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4179224Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4179531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4179792Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4179901Z Execution Analysis: .......... 2025-03-14T06:00:24.4180148Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4180472Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4180754Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1801 counts during 1716 steps 2025-03-14T06:00:24.4180759Z 2025-03-14T06:00:24.4180963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4181076Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4181364Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4181470Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4181673Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4181811Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4181957Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4182118Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4182473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4182816Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4183127Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4183439Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4183742Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4184003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4184294Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4184417Z Execution Analysis: (:1) 2025-03-14T06:00:24.4184681Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4184881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4184894Z 2025-03-14T06:00:24.4185090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4185211Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4185439Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4185553Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4185762Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4185901Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4186054Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4186219Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4186803Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4187378Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4187732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4188088Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4188399Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4188676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4188978Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4189252Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4189362Z Execution Analysis: .......... 2025-03-14T06:00:24.4189645Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4189867Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4190159Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1802 counts during 1717 steps 2025-03-14T06:00:24.4190163Z 2025-03-14T06:00:24.4190364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4190487Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4190770Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4190890Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4191092Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4191242Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4191384Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4191560Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4191911Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4192265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4192595Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4193020Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4193312Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4193572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4193844Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4193971Z Execution Analysis: (:1) 2025-03-14T06:00:24.4194211Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4194410Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4194414Z 2025-03-14T06:00:24.4194601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4194715Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4194932Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4195044Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4195235Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4195375Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4195512Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4195673Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4196400Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4196972Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4197324Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4197677Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4197983Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4198258Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4198559Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4198825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4198984Z Execution Analysis: .......... 2025-03-14T06:00:24.4199247Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4199448Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4199740Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1803 counts during 1718 steps 2025-03-14T06:00:24.4199746Z 2025-03-14T06:00:24.4199945Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4200064Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4200346Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4200463Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4200665Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4200817Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4200962Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4201134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4201486Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4201859Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4202190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4202464Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4202766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4203042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4203340Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4203464Z Execution Analysis: (:1) 2025-03-14T06:00:24.4203726Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4203925Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4203929Z 2025-03-14T06:00:24.4204139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4204249Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4204556Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4204678Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4205054Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4205202Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4205360Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4205531Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4206134Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4206709Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4207086Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4207439Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4207764Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4208037Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4208355Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4208657Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4208799Z Execution Analysis: .......... 2025-03-14T06:00:24.4209058Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4209275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4209570Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1804 counts during 1719 steps 2025-03-14T06:00:24.4209575Z 2025-03-14T06:00:24.4209785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4209902Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4210198Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4210310Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4210525Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4210670Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4210826Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4210993Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4211359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4211758Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4212081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4212355Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4212674Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4212943Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4213241Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4213367Z Execution Analysis: (:1) 2025-03-14T06:00:24.4213635Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4213841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4213845Z 2025-03-14T06:00:24.4214057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4214172Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4214413Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4214526Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4214738Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4214881Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4215035Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4215205Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4215808Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4216385Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4216758Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4217219Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4217532Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4217801Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4218132Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4218425Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4218538Z Execution Analysis: .......... 2025-03-14T06:00:24.4218791Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4219002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4219287Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1805 counts during 1720 steps 2025-03-14T06:00:24.4219300Z 2025-03-14T06:00:24.4219497Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4219614Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4219897Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4220019Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4220221Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4220369Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4220507Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4220673Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4221085Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4221440Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4221746Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4222022Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4222320Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4222591Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4222875Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4223004Z Execution Analysis: (:1) 2025-03-14T06:00:24.4223258Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4223471Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4223475Z 2025-03-14T06:00:24.4223670Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4223793Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4224019Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4224135Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4224334Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4228046Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4228232Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4228399Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4229000Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4229577Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4229929Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4230276Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4230579Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4230918Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4231248Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4231521Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4231629Z Execution Analysis: .......... 2025-03-14T06:00:24.4231895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4232090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4232380Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1806 counts during 1721 steps 2025-03-14T06:00:24.4232386Z 2025-03-14T06:00:24.4232580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4232697Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4233146Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4233263Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4233465Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4233616Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4233755Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4233974Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4234357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4234717Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4235025Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4235303Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4235613Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4235887Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4236182Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4236311Z Execution Analysis: (:1) 2025-03-14T06:00:24.4236571Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4236779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4236784Z 2025-03-14T06:00:24.4236983Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4237102Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4237329Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4237444Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4237645Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4237793Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4237938Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4238108Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4238699Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4239274Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4239630Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4240089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4240417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4240715Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4241011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4241277Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4241379Z Execution Analysis: .......... 2025-03-14T06:00:24.4241633Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4241826Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4242113Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1807 counts during 1722 steps 2025-03-14T06:00:24.4242118Z 2025-03-14T06:00:24.4242314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4242431Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4242712Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4242827Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4243023Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4243168Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4243347Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4243516Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4243859Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4244205Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4244609Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4244881Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4245360Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4245625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4245922Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4246046Z Execution Analysis: (:1) 2025-03-14T06:00:24.4246307Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4246506Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4246510Z 2025-03-14T06:00:24.4246712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4246824Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4247059Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4247169Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4247376Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4247515Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4247664Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4247830Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4248434Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4249004Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4249364Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4249710Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4250080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4250350Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4250661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4250931Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4251040Z Execution Analysis: .......... 2025-03-14T06:00:24.4251293Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4251496Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4251786Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1809 counts during 1723 steps 2025-03-14T06:00:24.4251791Z 2025-03-14T06:00:24.4251998Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4252110Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4252406Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4252515Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4252724Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4252914Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4253064Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4253231Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4253595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4253945Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4254264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4254538Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4254849Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4255116Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4255413Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4255539Z Execution Analysis: (:1) 2025-03-14T06:00:24.4255803Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4256002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4256006Z 2025-03-14T06:00:24.4256215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4256328Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4256564Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4256673Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4256879Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4257020Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4257277Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4257432Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4257977Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4258500Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4258837Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4259184Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4259501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4259753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4260043Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4260294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4260397Z Execution Analysis: .......... 2025-03-14T06:00:24.4260634Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4260823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4261086Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1810 counts during 1724 steps 2025-03-14T06:00:24.4261101Z 2025-03-14T06:00:24.4261286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4261398Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4261662Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4261768Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4261996Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4262133Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4262260Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4262416Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4262744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4263071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4263356Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4263612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4263892Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4264144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4264411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4264530Z Execution Analysis: (:1) 2025-03-14T06:00:24.4264763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4264948Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4264952Z 2025-03-14T06:00:24.4265134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4265243Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4265747Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4265862Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4266061Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4266209Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4266352Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4266522Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4267111Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4267687Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4268102Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4268508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4268824Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4269111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4269420Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4269701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4269807Z Execution Analysis: .......... 2025-03-14T06:00:24.4270078Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4270280Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4270585Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1811 counts during 1725 steps 2025-03-14T06:00:24.4270592Z 2025-03-14T06:00:24.4270794Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4270922Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4271248Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4271402Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4271611Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4271770Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4271914Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4272095Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4272458Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4272826Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4273145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4273436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4273748Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4274033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4274328Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4274468Z Execution Analysis: (:1) 2025-03-14T06:00:24.4274729Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4274949Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4274956Z 2025-03-14T06:00:24.4275161Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4275289Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4275525Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4275650Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4275861Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4276020Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4276171Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4276355Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4276946Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4277533Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4278058Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4278411Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4278735Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4279006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4279320Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4279587Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4279704Z Execution Analysis: .......... 2025-03-14T06:00:24.4279955Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4280169Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4280456Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1812 counts during 1726 steps 2025-03-14T06:00:24.4280461Z 2025-03-14T06:00:24.4280669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4280806Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4281131Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4281238Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4281452Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4281596Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4281749Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4281910Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4282270Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4282614Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4282931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4283196Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4283508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4283770Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4284064Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4284188Z Execution Analysis: (:1) 2025-03-14T06:00:24.4284453Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4284722Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4284730Z 2025-03-14T06:00:24.4285104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4285217Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4285459Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4285573Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4285783Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4285927Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4286086Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4286254Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4286856Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4287459Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4287863Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4288217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4288553Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4288828Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4289151Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4289421Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4289540Z Execution Analysis: .......... 2025-03-14T06:00:24.4289799Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4290017Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4290307Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1813 counts during 1727 steps 2025-03-14T06:00:24.4290313Z 2025-03-14T06:00:24.4290546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4290684Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4290984Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4291093Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4291307Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4291452Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4291610Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4291782Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4292156Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4292508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4292831Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4293112Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4293430Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4293701Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4294006Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4294132Z Execution Analysis: (:1) 2025-03-14T06:00:24.4294405Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4294613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4294629Z 2025-03-14T06:00:24.4294832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4294948Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4295195Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4295306Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4295524Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4295669Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4295827Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4295996Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4296596Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4297343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4297694Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4298048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4298352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4298629Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4298928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4299201Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4299308Z Execution Analysis: .......... 2025-03-14T06:00:24.4299573Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4299769Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4300062Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1814 counts during 1728 steps 2025-03-14T06:00:24.4300091Z 2025-03-14T06:00:24.4300315Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4300433Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4300720Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4300840Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4301041Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4301194Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4301335Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4301514Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4301864Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4302217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4302526Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4302802Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4303104Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4303376Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4303662Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4303794Z Execution Analysis: (:1) 2025-03-14T06:00:24.4304047Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4304257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4304262Z 2025-03-14T06:00:24.4304460Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4304583Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4304809Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4304928Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4305126Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4305272Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4305419Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4305591Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4306203Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4306799Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4307155Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4307608Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4307897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4308157Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4308444Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4308707Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4308807Z Execution Analysis: .......... 2025-03-14T06:00:24.4309058Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4309245Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4309572Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1815 counts during 1729 steps 2025-03-14T06:00:24.4309577Z 2025-03-14T06:00:24.4309769Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4309889Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4310158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4310271Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4310461Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4310606Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4310742Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4310908Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4311240Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4311576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4311865Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4312131Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4312416Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4312675Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4312947Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4313075Z Execution Analysis: (:1) 2025-03-14T06:00:24.4313314Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4313512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4313516Z 2025-03-14T06:00:24.4313711Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4313824Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4314039Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4314137Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4314330Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4314461Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4314598Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4314778Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4315349Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4315880Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4316214Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4316535Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4316825Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4317079Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4317364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4317614Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4317712Z Execution Analysis: .......... 2025-03-14T06:00:24.4317948Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4318182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4318450Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1816 counts during 1730 steps 2025-03-14T06:00:24.4318455Z 2025-03-14T06:00:24.4318643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4318747Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4319017Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4319117Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4319312Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4319445Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4319578Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4319734Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4320066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4320390Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4320680Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4320931Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4321220Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4321468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4321745Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4321860Z Execution Analysis: (:1) 2025-03-14T06:00:24.4322101Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4322290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4322294Z 2025-03-14T06:00:24.4322481Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4322586Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4322798Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4322898Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4323093Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4323249Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4323411Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4323565Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4324114Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4324710Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4325224Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4325572Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4325885Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4326155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4326466Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4326733Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4326842Z Execution Analysis: .......... 2025-03-14T06:00:24.4327123Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4327441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4327728Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1817 counts during 1731 steps 2025-03-14T06:00:24.4327737Z 2025-03-14T06:00:24.4327935Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4328050Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4328337Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4328455Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4328656Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4328797Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4328940Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4329106Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4329470Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4329816Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4330132Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4330408Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4330711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4330982Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4331274Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4331400Z Execution Analysis: (:1) 2025-03-14T06:00:24.4331652Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4331857Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4331861Z 2025-03-14T06:00:24.4332059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4332173Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4332401Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4332511Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4332739Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4332909Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4333054Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4333224Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4333817Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4334396Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4334751Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4335105Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4335415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4335695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4336001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4336270Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4336376Z Execution Analysis: .......... 2025-03-14T06:00:24.4336696Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4336897Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4337301Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1818 counts during 1732 steps 2025-03-14T06:00:24.4337306Z 2025-03-14T06:00:24.4337501Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4337614Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4337897Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4338010Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4338209Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4338350Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4338489Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4338662Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4339008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4339356Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4339658Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4339931Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4340230Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4340495Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4340774Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4340898Z Execution Analysis: (:1) 2025-03-14T06:00:24.4341151Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4341348Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4341352Z 2025-03-14T06:00:24.4341546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4341662Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4341885Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4342022Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4342241Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4342382Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4342525Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4342687Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4343264Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4343824Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4344277Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4344607Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4344895Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4345155Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4345436Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4345709Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4345828Z Execution Analysis: .......... 2025-03-14T06:00:24.4346071Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4346260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4346525Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1819 counts during 1733 steps 2025-03-14T06:00:24.4346528Z 2025-03-14T06:00:24.4346716Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4346990Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4347275Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4347378Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4347578Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4347716Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4347858Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4348019Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4348371Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4348711Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4349016Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4349283Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4349590Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4349852Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4350140Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4350263Z Execution Analysis: (:1) 2025-03-14T06:00:24.4350513Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4350705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4350709Z 2025-03-14T06:00:24.4350908Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4351017Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4351276Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4351404Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4351602Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4351740Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4351882Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4352043Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4352618Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4353172Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4353522Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4353864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4354173Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4354440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4354769Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4355054Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4355160Z Execution Analysis: .......... 2025-03-14T06:00:24.4355411Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4355608Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4355889Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1820 counts during 1734 steps 2025-03-14T06:00:24.4355897Z 2025-03-14T06:00:24.4356096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4356208Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4356497Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4356603Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4356809Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4356951Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4357094Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4357256Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4357609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4357948Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4358258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4358523Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4358923Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4359169Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4359449Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4359565Z Execution Analysis: (:1) 2025-03-14T06:00:24.4359808Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4359994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4359998Z 2025-03-14T06:00:24.4360184Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4360310Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4360547Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4360647Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4360842Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4360974Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4361118Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4361271Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4361823Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4362351Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4362684Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4363014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4363300Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4363553Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4363876Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4364129Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4364226Z Execution Analysis: .......... 2025-03-14T06:00:24.4364466Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4364738Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4365188Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1821 counts during 1735 steps 2025-03-14T06:00:24.4365194Z 2025-03-14T06:00:24.4365505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4365624Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4365910Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4366028Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4366230Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4366377Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4366515Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4366684Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4367038Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4367391Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4367701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4367976Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4368278Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4368550Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4368841Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4368967Z Execution Analysis: (:1) 2025-03-14T06:00:24.4369225Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4369428Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4369489Z 2025-03-14T06:00:24.4369693Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4369847Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4370075Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4370190Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4370393Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4370541Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4370688Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4370856Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4371442Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4372018Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4372380Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4372734Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4373044Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4373417Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4373728Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4373998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4374101Z Execution Analysis: .......... 2025-03-14T06:00:24.4374361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4374561Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4374856Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1822 counts during 1736 steps 2025-03-14T06:00:24.4374861Z 2025-03-14T06:00:24.4375060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4375179Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4375469Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4375583Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4375789Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4375936Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4376077Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4376249Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4376607Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4376965Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4377385Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4377642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4377927Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4378178Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4378448Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4378568Z Execution Analysis: (:1) 2025-03-14T06:00:24.4378804Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4378991Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4379041Z 2025-03-14T06:00:24.4379231Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4379334Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4379553Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4379653Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4379842Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4379983Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4380113Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4380275Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4380815Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4381345Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4381679Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4382004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4382344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4382599Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4382885Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4383132Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4383236Z Execution Analysis: .......... 2025-03-14T06:00:24.4383473Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4383669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4383936Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1823 counts during 1737 steps 2025-03-14T06:00:24.4383940Z 2025-03-14T06:00:24.4384128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4384233Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4384500Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4384602Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4384797Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4384928Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4385064Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4385216Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4385553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4385876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4386167Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4386420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4386711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4386959Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4387233Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4387350Z Execution Analysis: (:1) 2025-03-14T06:00:24.4387594Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4387804Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4387830Z 2025-03-14T06:00:24.4388018Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4388121Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4388341Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4388442Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4388633Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4388763Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4388900Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4389052Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4389603Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4390131Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4390464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4390806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4391122Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4391378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4391664Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4391910Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4392008Z Execution Analysis: .......... 2025-03-14T06:00:24.4392248Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4392439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4392707Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1824 counts during 1738 steps 2025-03-14T06:00:24.4392712Z 2025-03-14T06:00:24.4392903Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4393007Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4393280Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4393381Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4393569Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4393699Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4393833Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4393985Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4394321Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4394642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4394933Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4395184Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4395471Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4395717Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4396153Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4396280Z Execution Analysis: (:1) 2025-03-14T06:00:24.4396554Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4396779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4396784Z 2025-03-14T06:00:24.4396976Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4397094Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4397320Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4397434Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4397633Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4397779Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4397922Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4398093Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4398663Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4399227Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4399600Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4399975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4400281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4400550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4400846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4401114Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4401218Z Execution Analysis: .......... 2025-03-14T06:00:24.4401476Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4401672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4401963Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1825 counts during 1739 steps 2025-03-14T06:00:24.4401970Z 2025-03-14T06:00:24.4402167Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4402286Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4402567Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4402682Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4402881Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4403029Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4403169Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4403343Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4403691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4404043Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4404348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4404734Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4405202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4405481Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4405767Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4405928Z Execution Analysis: (:1) 2025-03-14T06:00:24.4406225Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4406437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4406441Z 2025-03-14T06:00:24.4406646Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4406762Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4406990Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4407104Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4407305Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4407450Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4407595Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4407768Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4408358Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4408933Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4409340Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4409695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4410006Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4410278Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4410582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4410856Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4410960Z Execution Analysis: .......... 2025-03-14T06:00:24.4411219Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4411421Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4411718Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1826 counts during 1740 steps 2025-03-14T06:00:24.4411723Z 2025-03-14T06:00:24.4411928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4412038Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4412330Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4412436Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4412644Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4412791Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4412938Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4413102Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4413468Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4413822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4414136Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4414407Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4414718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4414986Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4415308Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4415452Z Execution Analysis: (:1) 2025-03-14T06:00:24.4415710Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4415909Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4415915Z 2025-03-14T06:00:24.4416121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4416231Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4416466Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4416575Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4416784Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4416924Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4417076Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4417343Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4417893Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4418463Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4418804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4419128Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4419421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4419674Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4419963Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4420215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4420318Z Execution Analysis: .......... 2025-03-14T06:00:24.4420554Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4420750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4421017Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1827 counts during 1741 steps 2025-03-14T06:00:24.4421021Z 2025-03-14T06:00:24.4421212Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4421318Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4421588Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4421693Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4421891Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4422024Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4422159Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4422312Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4422648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4422970Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4423261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4423513Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4423802Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4424073Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4424367Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4424480Z Execution Analysis: (:1) 2025-03-14T06:00:24.4424724Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4424912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4424916Z 2025-03-14T06:00:24.4425104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4425206Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4425423Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4425527Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4425718Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4425853Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4425995Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4426154Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4426703Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4427274Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4427614Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4427940Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4428232Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4428491Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4428775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4429031Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4429128Z Execution Analysis: .......... 2025-03-14T06:00:24.4429374Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4429558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4429831Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1828 counts during 1742 steps 2025-03-14T06:00:24.4429836Z 2025-03-14T06:00:24.4430017Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4430126Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4430394Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4430502Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4430686Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4430826Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4430958Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4431121Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4431449Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4431776Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4432062Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4432319Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4432600Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4432900Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4433168Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4433289Z Execution Analysis: (:1) 2025-03-14T06:00:24.4433525Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4433717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4433721Z 2025-03-14T06:00:24.4433902Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4434015Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4434226Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4434332Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4434520Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4434658Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4434790Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4434949Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4435540Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4436075Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4436404Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4436732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4437020Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4437281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4437563Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4437817Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4437916Z Execution Analysis: .......... 2025-03-14T06:00:24.4438161Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4438347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4438619Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1830 counts during 1743 steps 2025-03-14T06:00:24.4438623Z 2025-03-14T06:00:24.4438812Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4438926Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4439194Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4439303Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4439494Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4439635Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4439766Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4439930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4440259Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4440585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4440875Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4441136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4441479Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4441733Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4442004Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4442123Z Execution Analysis: (:1) 2025-03-14T06:00:24.4442361Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4442553Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4442557Z 2025-03-14T06:00:24.4442742Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4442852Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4443064Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4443173Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4443362Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4443498Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4443631Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4443788Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4444375Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4445176Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4445543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4445894Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4446220Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4446494Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4446806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4447078Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4447191Z Execution Analysis: .......... 2025-03-14T06:00:24.4447447Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4447654Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4447942Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1831 counts during 1744 steps 2025-03-14T06:00:24.4447947Z 2025-03-14T06:00:24.4448155Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4448268Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4448563Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4448670Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4448877Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4449021Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4449165Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4449331Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4449690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4450037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4450354Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4450692Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4451003Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4451272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4451569Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4451691Z Execution Analysis: (:1) 2025-03-14T06:00:24.4451954Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4452153Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4452157Z 2025-03-14T06:00:24.4452362Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4452474Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4452708Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4452817Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4453022Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4453162Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4453310Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4453523Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4454119Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4454690Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4455053Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4455403Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4455721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4455994Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4456308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4456575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4456684Z Execution Analysis: .......... 2025-03-14T06:00:24.4456941Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4457258Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4457521Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1832 counts during 1745 steps 2025-03-14T06:00:24.4457527Z 2025-03-14T06:00:24.4457719Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4457824Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4458096Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4458197Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4458390Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4458524Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4458661Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4458816Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4459149Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4459472Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4459787Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4460063Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4460349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4460598Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4460873Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4460986Z Execution Analysis: (:1) 2025-03-14T06:00:24.4461229Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4461418Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4461428Z 2025-03-14T06:00:24.4461611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4461724Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4461932Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4462036Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4462222Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4462382Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4462540Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4462701Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4463244Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4463773Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4464105Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4464434Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4464720Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4464979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4465260Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4465806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4465913Z Execution Analysis: .......... 2025-03-14T06:00:24.4466178Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4466378Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4466674Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1833 counts during 1746 steps 2025-03-14T06:00:24.4466681Z 2025-03-14T06:00:24.4466885Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4467004Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4467293Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4467411Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4467615Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4467760Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4467899Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4468075Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4468434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4468845Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4469190Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4469470Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4469780Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4470060Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4470351Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4470483Z Execution Analysis: (:1) 2025-03-14T06:00:24.4470740Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4470947Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4470953Z 2025-03-14T06:00:24.4471154Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4471271Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4471498Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4471615Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4471922Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4472117Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4472263Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4472437Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4473027Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4473603Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4473963Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4474323Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4474636Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4474919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4475224Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4475501Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4475605Z Execution Analysis: .......... 2025-03-14T06:00:24.4475871Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4476075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4476372Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1834 counts during 1747 steps 2025-03-14T06:00:24.4476377Z 2025-03-14T06:00:24.4476584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4476697Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4476994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4477106Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4477308Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4477454Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4477601Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4477771Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4478212Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4478585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4478878Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4479130Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4479432Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4479679Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4479960Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4480074Z Execution Analysis: (:1) 2025-03-14T06:00:24.4480322Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4480507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4480513Z 2025-03-14T06:00:24.4480708Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4480815Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4481035Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4481161Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4481382Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4481513Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4481659Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4481813Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4482369Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4482898Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4483241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4483566Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4483867Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4484118Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4484413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4484725Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4484838Z Execution Analysis: .......... 2025-03-14T06:00:24.4485255Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4485470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4485757Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1835 counts during 1748 steps 2025-03-14T06:00:24.4485762Z 2025-03-14T06:00:24.4485977Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4486092Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4486391Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4486500Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4486715Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4486859Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4487009Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4487175Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4487597Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4487948Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4488268Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4488542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4488859Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4489127Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4489425Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4489554Z Execution Analysis: (:1) 2025-03-14T06:00:24.4489823Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4490026Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4490031Z 2025-03-14T06:00:24.4490239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4490350Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4490634Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4490743Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4490952Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4491093Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4491244Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4491412Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4492007Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4492579Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4492944Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4493295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4493616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4493890Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4494201Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4494468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4494583Z Execution Analysis: .......... 2025-03-14T06:00:24.4494844Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4495053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4495355Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1836 counts during 1749 steps 2025-03-14T06:00:24.4495359Z 2025-03-14T06:00:24.4495564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4495682Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4495969Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4496087Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4496288Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4496440Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4496631Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4496833Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4497295Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4497645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4497949Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4498220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4498517Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4498789Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4499072Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4499203Z Execution Analysis: (:1) 2025-03-14T06:00:24.4499456Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4499661Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4499665Z 2025-03-14T06:00:24.4499881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4500025Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4500250Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4500368Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4500567Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4500715Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4500856Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4501031Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4501612Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4502184Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4502535Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4502888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4503189Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4503466Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4503763Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4504034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4504135Z Execution Analysis: .......... 2025-03-14T06:00:24.4504393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4504588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4504884Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1837 counts during 1750 steps 2025-03-14T06:00:24.4504889Z 2025-03-14T06:00:24.4505089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4505207Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4505484Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4505603Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4505801Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4505974Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4506137Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4506307Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4506653Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4507006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4507417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4507676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4507961Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4508216Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4508485Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4508611Z Execution Analysis: (:1) 2025-03-14T06:00:24.4508849Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4509044Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4509048Z 2025-03-14T06:00:24.4509290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4509404Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4509618Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4509729Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4509918Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4510055Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4510190Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4510354Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4510901Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4511437Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4511779Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4512102Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4512402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4512655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4512951Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4513200Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4513308Z Execution Analysis: .......... 2025-03-14T06:00:24.4513544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4513742Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4514011Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1838 counts during 1751 steps 2025-03-14T06:00:24.4514015Z 2025-03-14T06:00:24.4514208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4514314Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4514592Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4514691Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4514913Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4515070Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4515208Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4515361Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4515702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4516029Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4516327Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4516579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4516874Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4517121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4517405Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4517520Z Execution Analysis: (:1) 2025-03-14T06:00:24.4517768Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4517984Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4518009Z 2025-03-14T06:00:24.4518206Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4518310Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4518529Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4518628Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4518828Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4518956Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4519102Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4519259Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4519814Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4520346Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4520687Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4521013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4521307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4521558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4521858Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4522107Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4522217Z Execution Analysis: .......... 2025-03-14T06:00:24.4522457Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4522655Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4522923Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1839 counts during 1752 steps 2025-03-14T06:00:24.4522928Z 2025-03-14T06:00:24.4523125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4523229Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4523507Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4523633Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4523853Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4523988Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4524133Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4524289Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4524723Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4525224Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4525546Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4525818Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4526138Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4526410Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4526711Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4526835Z Execution Analysis: (:1) 2025-03-14T06:00:24.4527132Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4527359Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4527372Z 2025-03-14T06:00:24.4527571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4527694Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4527924Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4528046Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4528249Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4528395Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4528550Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4528718Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4529318Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4529905Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4530265Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4530625Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4530939Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4531226Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4531533Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4531808Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4531909Z Execution Analysis: .......... 2025-03-14T06:00:24.4532175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4532375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4532673Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1840 counts during 1753 steps 2025-03-14T06:00:24.4532679Z 2025-03-14T06:00:24.4532877Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4533002Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4533313Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4533455Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4533657Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4533810Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4533954Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4534134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4534489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4534855Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4535165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4535449Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4535755Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4536034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4536325Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4536460Z Execution Analysis: (:1) 2025-03-14T06:00:24.4536763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4536976Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4536980Z 2025-03-14T06:00:24.4537287Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4537409Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4537630Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4537750Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4537947Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4538095Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4538235Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4538407Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4538984Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4539550Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4539898Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4540249Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4540555Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4540834Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4541133Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4541404Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4541508Z Execution Analysis: .......... 2025-03-14T06:00:24.4541769Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4542065Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4542344Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1841 counts during 1754 steps 2025-03-14T06:00:24.4542349Z 2025-03-14T06:00:24.4542534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4542714Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4542981Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4543092Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4543280Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4543425Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4543556Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4543722Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4544052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4544559Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4544864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4545139Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4545438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4545705Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4545996Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4546162Z Execution Analysis: (:1) 2025-03-14T06:00:24.4546420Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4546613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4546617Z 2025-03-14T06:00:24.4546819Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4546928Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4547162Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4547266Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4547477Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4547613Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4547766Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4547932Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4548516Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4549068Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4549430Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4549772Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4550090Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4550356Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4550661Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4550925Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4551037Z Execution Analysis: .......... 2025-03-14T06:00:24.4551282Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4551482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4551763Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1842 counts during 1755 steps 2025-03-14T06:00:24.4551792Z 2025-03-14T06:00:24.4552000Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4552135Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4552430Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4552537Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4552747Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4552887Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4553039Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4553201Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4553559Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4553898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4554207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4554474Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4554784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4555044Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4555386Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4555506Z Execution Analysis: (:1) 2025-03-14T06:00:24.4555938Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4556139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4556143Z 2025-03-14T06:00:24.4556355Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4556469Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4556712Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4556820Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4557031Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4557174Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4557328Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4557495Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4558095Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4558664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4559032Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4559388Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4559708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4559979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4560300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4560568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4560681Z Execution Analysis: .......... 2025-03-14T06:00:24.4560936Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4561145Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4561436Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1843 counts during 1756 steps 2025-03-14T06:00:24.4561496Z 2025-03-14T06:00:24.4561694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4561815Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4562104Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4562225Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4562428Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4562579Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4562720Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4562887Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4563263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4563623Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4563940Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4564221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4564607Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4565258Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4565696Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4565832Z Execution Analysis: (:1) 2025-03-14T06:00:24.4566096Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4566311Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4566315Z 2025-03-14T06:00:24.4566521Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4566649Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4566883Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4567001Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4567207Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4567368Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4567518Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4567700Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4568295Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4568881Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4569247Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4569609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4569923Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4570209Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4570519Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4570802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4570911Z Execution Analysis: .......... 2025-03-14T06:00:24.4571180Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4571385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4571774Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1844 counts during 1757 steps 2025-03-14T06:00:24.4571779Z 2025-03-14T06:00:24.4571982Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4572108Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4572404Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4572531Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4572736Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4572891Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4573034Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4573214Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4573573Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4573937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4574249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4574535Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4574905Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4575188Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4575482Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4575626Z Execution Analysis: (:1) 2025-03-14T06:00:24.4575884Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4576098Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4576107Z 2025-03-14T06:00:24.4576307Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4576430Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4576662Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4576783Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4576993Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4577256Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4577504Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4577671Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4578217Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4578759Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4579092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4579428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4579721Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4579987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4580283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4580533Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4580641Z Execution Analysis: .......... 2025-03-14T06:00:24.4580877Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4581119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4581415Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1845 counts during 1758 steps 2025-03-14T06:00:24.4581419Z 2025-03-14T06:00:24.4581615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4581726Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4582008Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4582111Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4582306Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4582437Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4582580Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4582740Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4583083Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4583410Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4583708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4583988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4584305Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4584557Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4584836Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4584951Z Execution Analysis: (:1) 2025-03-14T06:00:24.4585199Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4585389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4585394Z 2025-03-14T06:00:24.4585590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4585697Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4585924Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4586030Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4586230Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4586364Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4586510Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4586668Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4587221Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4587753Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4588095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4588423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4588725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4588981Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4589275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4589523Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4589631Z Execution Analysis: .......... 2025-03-14T06:00:24.4589893Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4590115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4590385Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1846 counts during 1759 steps 2025-03-14T06:00:24.4590390Z 2025-03-14T06:00:24.4590590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4590697Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4590973Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4591079Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4591276Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4591411Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4591549Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4591708Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4592051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4592378Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4592699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4592970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4593266Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4593515Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4593961Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4594082Z Execution Analysis: (:1) 2025-03-14T06:00:24.4594344Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4594541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4594545Z 2025-03-14T06:00:24.4594749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4594862Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4595094Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4595202Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4595414Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4595552Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4595707Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4595866Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4596455Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4597012Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4597378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4597731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4598035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4598310Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4598611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4599055Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4599228Z Execution Analysis: .......... 2025-03-14T06:00:24.4599521Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4599725Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4600028Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1847 counts during 1760 steps 2025-03-14T06:00:24.4600034Z 2025-03-14T06:00:24.4600239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4600362Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4600655Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4600776Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4600982Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4601135Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4601280Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4601460Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4601817Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4602180Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4602542Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4602828Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4603136Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4603411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4603705Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4607488Z Execution Analysis: (:1) 2025-03-14T06:00:24.4607799Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4608011Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4608016Z 2025-03-14T06:00:24.4608221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4608340Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4608571Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4608683Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4608888Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4609037Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4609179Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4609350Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4609952Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4610537Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4610901Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4611260Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4611571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4611852Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4612158Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4612503Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4612637Z Execution Analysis: .......... 2025-03-14T06:00:24.4612905Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4613104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4613405Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1848 counts during 1761 steps 2025-03-14T06:00:24.4613410Z 2025-03-14T06:00:24.4613610Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4613730Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4614019Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4614139Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4614340Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4614492Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4614631Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4614802Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4615158Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4615586Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4615898Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4616178Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4616483Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4616755Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4617151Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4617271Z Execution Analysis: (:1) 2025-03-14T06:00:24.4617510Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4617703Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4617709Z 2025-03-14T06:00:24.4617894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4618004Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4618218Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4618328Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4618517Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4618655Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4618791Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4618953Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4619495Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4620029Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4620360Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4620686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4620974Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4621226Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4621540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4621885Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4621988Z Execution Analysis: .......... 2025-03-14T06:00:24.4622222Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4622416Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4622681Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1849 counts during 1762 steps 2025-03-14T06:00:24.4622686Z 2025-03-14T06:00:24.4622876Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4622978Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4623250Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4623350Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4623544Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4623673Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4623809Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4623964Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4624344Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4624668Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4624956Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4625205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4625489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4625735Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4626010Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4626122Z Execution Analysis: (:1) 2025-03-14T06:00:24.4626532Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4626731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4626736Z 2025-03-14T06:00:24.4626937Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4627043Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4627269Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4627374Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4627576Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4627714Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4627862Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4628022Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4628602Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4629158Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4629514Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4629851Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4630163Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4630449Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4630779Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4631039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4631148Z Execution Analysis: .......... 2025-03-14T06:00:24.4631398Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4631596Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4631876Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1851 counts during 1763 steps 2025-03-14T06:00:24.4631881Z 2025-03-14T06:00:24.4632086Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4632194Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4632479Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4632588Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4632791Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4632929Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4633070Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4633256Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4633633Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4633976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4634284Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4634550Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4634851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4635112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4635398Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4635517Z Execution Analysis: (:1) 2025-03-14T06:00:24.4635779Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4635975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4635986Z 2025-03-14T06:00:24.4636178Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4636285Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4636516Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4636621Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4636826Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4636966Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4637108Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4637270Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4637849Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4638507Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4638835Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4639161Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4639449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4639753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4640035Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4640285Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4640381Z Execution Analysis: .......... 2025-03-14T06:00:24.4640622Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4640805Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4641074Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1852 counts during 1764 steps 2025-03-14T06:00:24.4641078Z 2025-03-14T06:00:24.4641259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4641371Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4641636Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4641743Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4641928Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4642065Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4642215Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4642393Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4642721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4643048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4643332Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4643587Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4643871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4644122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4644388Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4644590Z Execution Analysis: (:1) 2025-03-14T06:00:24.4644830Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4645195Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4645199Z 2025-03-14T06:00:24.4645395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4645510Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4645737Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4645855Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4646064Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4646222Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4646370Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4646551Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4647150Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4647736Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4648096Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4648461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4648831Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4649118Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4649428Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4649715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4649823Z Execution Analysis: .......... 2025-03-14T06:00:24.4650092Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4650295Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4650599Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1853 counts during 1765 steps 2025-03-14T06:00:24.4650603Z 2025-03-14T06:00:24.4650809Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4650939Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4651233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4651360Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4651568Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4651785Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4651931Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4652113Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4652476Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4652846Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4653160Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4653452Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4653764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4654046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4654343Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4654484Z Execution Analysis: (:1) 2025-03-14T06:00:24.4654745Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4654963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4654967Z 2025-03-14T06:00:24.4655180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4655295Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4655545Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4655662Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4655878Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4656024Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4656184Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4656361Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4656967Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4657644Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4658008Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4658378Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4658725Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4658999Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4659318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4659582Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4659697Z Execution Analysis: .......... 2025-03-14T06:00:24.4659951Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4660158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4660441Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1854 counts during 1766 steps 2025-03-14T06:00:24.4660448Z 2025-03-14T06:00:24.4660659Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4660771Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4661068Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4661177Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4661432Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4661577Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4661726Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4661889Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4662250Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4662593Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4662907Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4663176Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4663485Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4663750Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4664045Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4664169Z Execution Analysis: (:1) 2025-03-14T06:00:24.4664429Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4664628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4664632Z 2025-03-14T06:00:24.4664837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4664953Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4665193Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4665434Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4665808Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4665953Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4666118Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4666288Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4666890Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4667467Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4667900Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4668289Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4668613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4668892Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4669213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4669486Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4669605Z Execution Analysis: .......... 2025-03-14T06:00:24.4669865Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4670077Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4670373Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1855 counts during 1767 steps 2025-03-14T06:00:24.4670392Z 2025-03-14T06:00:24.4670594Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4670722Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4671055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4671225Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4671436Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4671583Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4671736Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4671906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4672281Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4672639Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4672968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4673259Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4673570Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4673854Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4674146Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4674285Z Execution Analysis: (:1) 2025-03-14T06:00:24.4674546Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4674757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4674763Z 2025-03-14T06:00:24.4674967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4675096Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4675327Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4675452Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4675659Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4675816Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4675963Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4676140Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4676735Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4677316Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4677827Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4678281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4678573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4678844Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4679128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4679384Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4679487Z Execution Analysis: .......... 2025-03-14T06:00:24.4679738Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4679927Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4680210Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1856 counts during 1768 steps 2025-03-14T06:00:24.4680215Z 2025-03-14T06:00:24.4680404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4680520Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4680835Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4680951Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4681141Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4681284Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4681417Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4681582Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4681916Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4682256Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4682546Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4682808Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4683098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4683362Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4683634Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4683760Z Execution Analysis: (:1) 2025-03-14T06:00:24.4683999Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4684200Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4684208Z 2025-03-14T06:00:24.4684397Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4684577Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4684797Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4685083Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4685290Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4685450Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4685599Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4685779Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4686372Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4686992Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4687390Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4687753Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4688074Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4688363Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4688680Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4688962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4689070Z Execution Analysis: .......... 2025-03-14T06:00:24.4689344Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4689563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4689856Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1857 counts during 1769 steps 2025-03-14T06:00:24.4689861Z 2025-03-14T06:00:24.4690105Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4690245Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4690550Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4690662Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4690878Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4691026Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4691181Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4691348Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4691722Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4692079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4692402Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4692686Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4693000Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4693271Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4693567Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4693693Z Execution Analysis: (:1) 2025-03-14T06:00:24.4693953Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4694156Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4694160Z 2025-03-14T06:00:24.4694367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4694479Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4694716Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4694824Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4695030Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4695175Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4695327Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4695493Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4696088Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4696706Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4697069Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4697529Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4697837Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4698105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4698411Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4698674Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4698784Z Execution Analysis: .......... 2025-03-14T06:00:24.4699034Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4699239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4699523Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1858 counts during 1770 steps 2025-03-14T06:00:24.4699528Z 2025-03-14T06:00:24.4699777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4699889Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4700175Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4700281Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4700487Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4700632Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4700780Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4700944Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4701299Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4701642Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4701954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4702221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4702527Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4702788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4703082Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4703201Z Execution Analysis: (:1) 2025-03-14T06:00:24.4703463Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4703657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4703662Z 2025-03-14T06:00:24.4703859Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4703972Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4704202Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4704306Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4704506Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4704644Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4704791Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4704950Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4705554Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4706131Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4706484Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4706833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4707135Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4707406Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4707707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4707975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4708081Z Execution Analysis: .......... 2025-03-14T06:00:24.4708336Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4708530Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4708860Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1859 counts during 1771 steps 2025-03-14T06:00:24.4708864Z 2025-03-14T06:00:24.4709059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4709175Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4709454Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4709564Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4709759Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4709902Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4710042Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4710211Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4710558Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4710904Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4711209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4711479Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4711778Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4712148Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4712419Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4712543Z Execution Analysis: (:1) 2025-03-14T06:00:24.4712777Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4712967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4712970Z 2025-03-14T06:00:24.4713158Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4713265Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4713478Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4713584Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4713770Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4713906Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4714042Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4714230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4714800Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4715338Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4715672Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4716004Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4716295Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4716552Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4716837Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4717094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4717191Z Execution Analysis: .......... 2025-03-14T06:00:24.4717432Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4717642Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4717940Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1860 counts during 1772 steps 2025-03-14T06:00:24.4717944Z 2025-03-14T06:00:24.4718128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4718241Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4718507Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4718615Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4718803Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4718946Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4719076Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4719235Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4719564Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4719897Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4720181Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4720441Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4720721Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4720977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4721247Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4721370Z Execution Analysis: (:1) 2025-03-14T06:00:24.4721604Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4721797Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4721803Z 2025-03-14T06:00:24.4721991Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4722098Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4722316Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4722419Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4722607Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4722743Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4722908Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4723093Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4723634Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4724167Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4724585Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4725074Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4725391Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4725665Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4725979Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4726250Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4726359Z Execution Analysis: .......... 2025-03-14T06:00:24.4726644Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4726875Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4727165Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1861 counts during 1773 steps 2025-03-14T06:00:24.4727169Z 2025-03-14T06:00:24.4727376Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4727490Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4727786Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4727896Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4728107Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4728247Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4728392Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4728558Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4728923Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4729273Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4729591Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4729865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4730179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4730447Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4730746Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4730870Z Execution Analysis: (:1) 2025-03-14T06:00:24.4731128Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4731331Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4731335Z 2025-03-14T06:00:24.4731540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4731653Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4731885Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4731993Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4732201Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4732389Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4732539Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4732707Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4733302Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4733874Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4734238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4734585Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4734900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4735175Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4735491Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4735760Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4735874Z Execution Analysis: .......... 2025-03-14T06:00:24.4736176Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4736383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4736672Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1862 counts during 1774 steps 2025-03-14T06:00:24.4736677Z 2025-03-14T06:00:24.4736888Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4737001Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4737405Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4737514Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4737887Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4738029Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4738175Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4738343Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4738707Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4739055Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4739370Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4739642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4739957Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4740226Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4740523Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4740650Z Execution Analysis: (:1) 2025-03-14T06:00:24.4740909Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4741114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4741119Z 2025-03-14T06:00:24.4741318Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4741436Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4741669Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4741809Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4742041Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4742186Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4742330Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4742502Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4743095Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4743674Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4744032Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4744386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4744700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4745082Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4745381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4745668Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4745791Z Execution Analysis: .......... 2025-03-14T06:00:24.4746044Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4746239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4746525Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1863 counts during 1775 steps 2025-03-14T06:00:24.4746530Z 2025-03-14T06:00:24.4746723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4746836Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4747115Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4747227Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4747426Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4747571Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4747711Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4747878Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4748223Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4748569Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4748871Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4749143Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4749443Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4749815Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4750084Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4750205Z Execution Analysis: (:1) 2025-03-14T06:00:24.4750442Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4750634Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4750638Z 2025-03-14T06:00:24.4750823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4750935Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4751172Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4751300Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4751487Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4751621Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4751757Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4751918Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4752462Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4752995Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4753326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4753653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4753944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4754201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4754482Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4754787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4754885Z Execution Analysis: .......... 2025-03-14T06:00:24.4755126Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4755311Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4755587Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1864 counts during 1776 steps 2025-03-14T06:00:24.4755593Z 2025-03-14T06:00:24.4755783Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4755889Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4756161Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4756261Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4756457Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4756590Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4756729Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4756885Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4757211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4757544Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4757836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4758090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4758377Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4758624Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4758900Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4759014Z Execution Analysis: (:1) 2025-03-14T06:00:24.4759258Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4759442Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4759446Z 2025-03-14T06:00:24.4759637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4759765Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4760003Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4760103Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4760292Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4760423Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4760564Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4760720Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4761270Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4761802Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4762138Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4762465Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4762755Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4763006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4763334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4763586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4763685Z Execution Analysis: .......... 2025-03-14T06:00:24.4763922Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4764111Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4764378Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1865 counts during 1777 steps 2025-03-14T06:00:24.4764385Z 2025-03-14T06:00:24.4764660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4764766Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4765044Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4765449Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4765664Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4765807Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4765953Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4766122Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4766489Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4766840Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4767164Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4767438Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4767754Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4768025Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4768321Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4768444Z Execution Analysis: (:1) 2025-03-14T06:00:24.4768707Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4768910Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4768914Z 2025-03-14T06:00:24.4769254Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4769402Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4769636Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4769746Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4769955Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4770100Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4770250Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4770420Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4771019Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4771588Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4771958Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4772310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4772628Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4772964Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4773274Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4773547Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4773650Z Execution Analysis: .......... 2025-03-14T06:00:24.4773911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4774112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4774409Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1866 counts during 1778 steps 2025-03-14T06:00:24.4774414Z 2025-03-14T06:00:24.4774615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4774733Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4775022Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4775137Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4775340Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4775490Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4775631Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4775807Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4776167Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4776527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4776841Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4777124Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4777660Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4777924Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4778195Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4778322Z Execution Analysis: (:1) 2025-03-14T06:00:24.4778561Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4778759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4778806Z 2025-03-14T06:00:24.4778994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4779107Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4779322Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4779438Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4779630Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4779770Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4779904Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4780068Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4780612Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4781151Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4781487Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4781822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4782139Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4782427Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4782716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4782973Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4783075Z Execution Analysis: .......... 2025-03-14T06:00:24.4783326Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4783518Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4783801Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1867 counts during 1779 steps 2025-03-14T06:00:24.4783806Z 2025-03-14T06:00:24.4783995Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4784113Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4784381Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4784495Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4784685Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4784829Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4784961Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4785123Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4785456Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4785790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4786077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4786337Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4786622Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4786877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4787144Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4787265Z Execution Analysis: (:1) 2025-03-14T06:00:24.4787504Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4787719Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4787745Z 2025-03-14T06:00:24.4787933Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4788044Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4788261Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4788368Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4788555Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4788692Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4788828Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4788986Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4789533Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4790069Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4790407Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4790763Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4791081Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4791336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4791627Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4791874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4791982Z Execution Analysis: .......... 2025-03-14T06:00:24.4792222Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4792417Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4792686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1868 counts during 1780 steps 2025-03-14T06:00:24.4792690Z 2025-03-14T06:00:24.4792885Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4792991Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4793265Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4793366Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4793560Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4793693Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4793831Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4793987Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4794322Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4794645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4794943Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4795197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4795488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4795737Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4796178Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4796301Z Execution Analysis: (:1) 2025-03-14T06:00:24.4796584Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4796806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4796810Z 2025-03-14T06:00:24.4797012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4797123Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4797358Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4797465Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4797674Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4797814Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4797967Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4798135Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4798718Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4799282Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4799641Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4800030Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4800344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4800612Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4800918Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4801182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4801295Z Execution Analysis: .......... 2025-03-14T06:00:24.4801548Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4801751Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4802033Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1869 counts during 1781 steps 2025-03-14T06:00:24.4802039Z 2025-03-14T06:00:24.4802244Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4802358Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4802645Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4802753Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4802957Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4803098Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4803242Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4803408Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4803762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4804105Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4804418Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4804753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4805228Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4805499Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4805801Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4805959Z Execution Analysis: (:1) 2025-03-14T06:00:24.4806495Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4806701Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4806715Z 2025-03-14T06:00:24.4806917Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4807044Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4807277Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4807395Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4807598Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4807751Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4807899Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4808067Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4808664Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4809243Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4809648Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4810009Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4810321Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4810602Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4810910Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4811191Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4811297Z Execution Analysis: .......... 2025-03-14T06:00:24.4811559Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4811765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4812065Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1870 counts during 1782 steps 2025-03-14T06:00:24.4812070Z 2025-03-14T06:00:24.4812273Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4812392Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4812686Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4812801Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4813004Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4813158Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4813302Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4813476Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4813835Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4814196Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4814508Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4814789Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4815095Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4815370Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4815686Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4815840Z Execution Analysis: (:1) 2025-03-14T06:00:24.4816098Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4816306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4816312Z 2025-03-14T06:00:24.4816516Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4816642Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4816872Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4816990Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4817303Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4817449Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4817594Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4817767Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4818340Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4818939Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4819316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4819666Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4819971Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4820246Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4820549Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4820820Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4820930Z Execution Analysis: .......... 2025-03-14T06:00:24.4821193Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4821393Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4821686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1872 counts during 1783 steps 2025-03-14T06:00:24.4821691Z 2025-03-14T06:00:24.4821890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4822009Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4822292Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4822417Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4822617Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4822769Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4822909Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4823078Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4823430Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4823782Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4824087Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4824362Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4824668Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4824929Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4825283Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4825406Z Execution Analysis: (:1) 2025-03-14T06:00:24.4825668Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4825869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4825873Z 2025-03-14T06:00:24.4826076Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4826186Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4826419Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4826526Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4826730Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4826875Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4827029Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4827195Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4827779Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4828384Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4828744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4829084Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4829392Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4829657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4829964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4830223Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4830331Z Execution Analysis: .......... 2025-03-14T06:00:24.4830583Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4830789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4831072Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1873 counts during 1784 steps 2025-03-14T06:00:24.4831077Z 2025-03-14T06:00:24.4831282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4831395Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4831685Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4831796Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4832000Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4832142Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4832286Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4832450Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4832806Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4833147Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4833457Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4833726Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4834032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4834341Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4834636Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4834758Z Execution Analysis: (:1) 2025-03-14T06:00:24.4835015Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4835213Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4835218Z 2025-03-14T06:00:24.4835418Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4835527Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4835759Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4835866Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4836073Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4836215Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4836362Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4836525Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4837146Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4837704Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4838058Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4838399Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4838711Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4838982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4839285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4839549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4839661Z Execution Analysis: .......... 2025-03-14T06:00:24.4839914Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4840118Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4840409Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1874 counts during 1785 steps 2025-03-14T06:00:24.4840413Z 2025-03-14T06:00:24.4840610Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4840727Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4841011Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4841126Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4841325Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4841472Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4841614Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4841785Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4842135Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4842485Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4842788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4843060Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4843384Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4843678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4843962Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4844091Z Execution Analysis: (:1) 2025-03-14T06:00:24.4844343Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4844628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4844633Z 2025-03-14T06:00:24.4844832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4845116Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4845348Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4845471Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4845677Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4845830Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4845979Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4846159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4846806Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4847388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4847751Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4848109Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4848425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4848708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4849016Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4849294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4849400Z Execution Analysis: .......... 2025-03-14T06:00:24.4849664Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4849864Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4850160Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1875 counts during 1786 steps 2025-03-14T06:00:24.4850166Z 2025-03-14T06:00:24.4850369Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4850494Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4850784Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4850900Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4851108Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4851265Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4851412Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4851587Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4851947Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4852304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4852617Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4852923Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4853254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4853530Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4853823Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4853962Z Execution Analysis: (:1) 2025-03-14T06:00:24.4854219Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4854436Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4854440Z 2025-03-14T06:00:24.4854644Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4854768Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4855002Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4855118Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4855322Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4855470Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4855619Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4855838Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4856436Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4857015Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4857478Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4857832Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4858144Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4858410Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4858714Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4858978Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4859088Z Execution Analysis: .......... 2025-03-14T06:00:24.4859339Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4859543Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4859826Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1876 counts during 1787 steps 2025-03-14T06:00:24.4859833Z 2025-03-14T06:00:24.4860036Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4860148Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4860435Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4860541Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4860760Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4860901Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4861055Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4861220Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4861579Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4861922Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4862276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4862567Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4862879Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4863146Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4863445Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4863569Z Execution Analysis: (:1) 2025-03-14T06:00:24.4863835Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4864031Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4864035Z 2025-03-14T06:00:24.4864244Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4864356Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4864596Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4864703Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4864913Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4865053Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4865253Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4865532Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4866303Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4866873Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4867248Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4867605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4867934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4868210Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4868531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4868799Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4868920Z Execution Analysis: .......... 2025-03-14T06:00:24.4869179Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4869397Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4869693Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1877 counts during 1788 steps 2025-03-14T06:00:24.4869701Z 2025-03-14T06:00:24.4869919Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4870033Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4870333Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4870448Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4870667Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4870814Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4870970Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4871140Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4871509Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4871859Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4872269Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4872542Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4872862Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4873134Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4873433Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4873558Z Execution Analysis: (:1) 2025-03-14T06:00:24.4873828Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4874028Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4874046Z 2025-03-14T06:00:24.4874244Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4874378Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4874607Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4874719Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4874964Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4875139Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4875297Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4875467Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4876073Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4876655Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4877019Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4877382Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4877691Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4878089Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4878389Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4878662Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4878764Z Execution Analysis: .......... 2025-03-14T06:00:24.4879026Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4879223Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4879521Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1878 counts during 1789 steps 2025-03-14T06:00:24.4879525Z 2025-03-14T06:00:24.4879718Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4879838Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4880126Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4880244Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4880440Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4880595Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4880731Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4880906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4881253Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4881653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4881957Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4882237Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4882541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4882816Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4883101Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4883237Z Execution Analysis: (:1) 2025-03-14T06:00:24.4883489Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4883700Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4883708Z 2025-03-14T06:00:24.4883904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4884030Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4884255Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4884401Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4884695Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4884850Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4885161Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4885344Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4885933Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4886525Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4886888Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4887254Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4887569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4887861Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4888168Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4888457Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4888561Z Execution Analysis: .......... 2025-03-14T06:00:24.4888838Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4889043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4889346Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1879 counts during 1790 steps 2025-03-14T06:00:24.4889351Z 2025-03-14T06:00:24.4889558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4889687Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4889977Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4890101Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4890309Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4890468Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4890611Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4890795Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4891218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4891605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4891941Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4892243Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4892563Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4892844Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4893139Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4893281Z Execution Analysis: (:1) 2025-03-14T06:00:24.4893543Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4893756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4893760Z 2025-03-14T06:00:24.4893967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4894091Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4894383Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4894503Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4894711Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4894860Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4895007Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4895188Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4895781Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4896368Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4896732Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4897106Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4897421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4897706Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4898012Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4898291Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4898399Z Execution Analysis: .......... 2025-03-14T06:00:24.4898667Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4898872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4899172Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1880 counts during 1791 steps 2025-03-14T06:00:24.4899176Z 2025-03-14T06:00:24.4899383Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4899509Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4899802Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4899923Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4900128Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4900285Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4900426Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4900631Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4901017Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4901382Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4901696Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4901987Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4902296Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4902575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4902869Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4903008Z Execution Analysis: (:1) 2025-03-14T06:00:24.4903268Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4903489Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4903494Z 2025-03-14T06:00:24.4903712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4903852Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4904110Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4904235Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4904440Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4904600Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4904746Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4904927Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4905523Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4906109Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4906479Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4906834Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4907165Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4907444Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4907764Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4908033Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4908152Z Execution Analysis: .......... 2025-03-14T06:00:24.4908409Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4908630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4908930Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1881 counts during 1792 steps 2025-03-14T06:00:24.4908936Z 2025-03-14T06:00:24.4909151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4909268Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4909572Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4909683Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4909904Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4910075Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4910257Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4910424Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4910796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4911148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4911478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4911753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4912079Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4912461Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4912761Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4912890Z Execution Analysis: (:1) 2025-03-14T06:00:24.4913156Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4913353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4913357Z 2025-03-14T06:00:24.4913684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4913796Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4914036Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4914142Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4914359Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4914496Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4914653Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4914817Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4915405Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4915963Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4916328Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4916672Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4916989Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4917256Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4917567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4917837Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4917956Z Execution Analysis: .......... 2025-03-14T06:00:24.4918206Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4918419Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4918706Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1882 counts during 1793 steps 2025-03-14T06:00:24.4918710Z 2025-03-14T06:00:24.4918921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4919034Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4919333Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4919439Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4919680Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4919848Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4920000Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4920167Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4920529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4920876Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4921193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4921458Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4921770Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4922036Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4922333Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4922458Z Execution Analysis: (:1) 2025-03-14T06:00:24.4922720Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4922952Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4922957Z 2025-03-14T06:00:24.4923186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4923311Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4923538Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4923659Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4923857Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4924011Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4924184Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4924368Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4925207Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4925799Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4926166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4926532Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4926846Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4927136Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4927447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4927731Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4927844Z Execution Analysis: .......... 2025-03-14T06:00:24.4928118Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4928325Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4928632Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1883 counts during 1794 steps 2025-03-14T06:00:24.4928639Z 2025-03-14T06:00:24.4928842Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4928967Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4929257Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4929408Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4929638Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4929793Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4929936Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4930119Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4930477Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4930839Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4931149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4931440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4931747Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4932029Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4932327Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4932467Z Execution Analysis: (:1) 2025-03-14T06:00:24.4932725Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4933002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4933006Z 2025-03-14T06:00:24.4933208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4933334Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4933566Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4933690Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4933894Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4934054Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4934202Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4934382Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4934983Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4935571Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4935929Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4936295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4936608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4936893Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4937309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4937581Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4937684Z Execution Analysis: .......... 2025-03-14T06:00:24.4937953Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4938150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4938447Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1884 counts during 1795 steps 2025-03-14T06:00:24.4938452Z 2025-03-14T06:00:24.4938660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4938773Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4939091Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4939225Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4939423Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4939580Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4939722Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4939898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4940250Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4940605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4940918Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4941185Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4941496Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4941762Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4942061Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4942184Z Execution Analysis: (:1) 2025-03-14T06:00:24.4942496Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4942697Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4942701Z 2025-03-14T06:00:24.4942911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4943023Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4943260Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4943369Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4943576Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4943716Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4943869Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4944034Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4944625Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4945180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4945541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4945886Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4946208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4946487Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4946797Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4947065Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4947189Z Execution Analysis: .......... 2025-03-14T06:00:24.4947441Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4947653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4947942Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1885 counts during 1796 steps 2025-03-14T06:00:24.4947947Z 2025-03-14T06:00:24.4948159Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4948301Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4948621Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4948734Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4948949Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4949096Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4949252Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4949423Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4949785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4950135Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4950454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4950725Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4951042Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4951309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4951612Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4951765Z Execution Analysis: (:1) 2025-03-14T06:00:24.4952055Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4952256Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4952260Z 2025-03-14T06:00:24.4952470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4952588Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4952829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4952946Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4953161Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4953306Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4953468Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4953638Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4954232Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4954796Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4955166Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4955508Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4955835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4956105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4956424Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4956706Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4956814Z Execution Analysis: .......... 2025-03-14T06:00:24.4957080Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4957277Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4957576Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1886 counts during 1797 steps 2025-03-14T06:00:24.4957580Z 2025-03-14T06:00:24.4957803Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4957950Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4958235Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4958355Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4958559Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4958710Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4958852Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4959026Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4959384Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4959738Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4960043Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4960328Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4960631Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4960910Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4961245Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4961380Z Execution Analysis: (:1) 2025-03-14T06:00:24.4961634Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4961843Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4961847Z 2025-03-14T06:00:24.4962048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4962174Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4962404Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4962526Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4962731Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4962885Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4963033Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4963210Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4963814Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4964386Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4964829Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4965496Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4965817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4966105Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4966419Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4966702Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4966811Z Execution Analysis: .......... 2025-03-14T06:00:24.4967080Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4967286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4967592Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1887 counts during 1798 steps 2025-03-14T06:00:24.4967704Z 2025-03-14T06:00:24.4967911Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4968042Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4968338Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4968471Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4968681Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4968843Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4968995Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4969181Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4969543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4969912Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4970230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4970523Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4970834Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4971198Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4971498Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4971636Z Execution Analysis: (:1) 2025-03-14T06:00:24.4971895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4972113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4972118Z 2025-03-14T06:00:24.4972323Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4972457Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4972690Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4972819Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4973029Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4973190Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4973342Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4973530Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4974124Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4974711Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4975088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4975444Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4975771Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4976050Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4976375Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4976645Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4976765Z Execution Analysis: .......... 2025-03-14T06:00:24.4977025Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4977241Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4977586Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1888 counts during 1799 steps 2025-03-14T06:00:24.4977591Z 2025-03-14T06:00:24.4977804Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4977921Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4978224Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4978339Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4978557Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4978704Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4978862Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4979037Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4979408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4979765Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4980095Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4980373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4980718Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4981015Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4981325Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4981455Z Execution Analysis: (:1) 2025-03-14T06:00:24.4981726Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4981932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4981938Z 2025-03-14T06:00:24.4982157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4982274Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4982519Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4982632Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4982855Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4983026Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4983190Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4983362Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4983969Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4984551Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4984926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4985281Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4985612Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4985893Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4986213Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4986486Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4986608Z Execution Analysis: .......... 2025-03-14T06:00:24.4986868Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4987107Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4987425Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1889 counts during 1800 steps 2025-03-14T06:00:24.4987429Z 2025-03-14T06:00:24.4992282Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4992427Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4992742Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.4992854Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4993073Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.4993220Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.4993372Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.4993542Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4993916Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.4994275Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.4994597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.4994938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.4995282Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.4995549Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.4995848Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.4995971Z Execution Analysis: (:1) 2025-03-14T06:00:24.4996240Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.4996445Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4996452Z 2025-03-14T06:00:24.4996662Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.4996775Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.4997016Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.4997130Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.4997341Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.4997481Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.4997637Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.4997805Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.4998409Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.4998984Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.4999354Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.4999708Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5000032Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5000311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5000618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5000892Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5000996Z Execution Analysis: .......... 2025-03-14T06:00:24.5001290Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5001514Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5001809Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1890 counts during 1801 steps 2025-03-14T06:00:24.5001815Z 2025-03-14T06:00:24.5002019Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5002139Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5002424Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5002543Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5002746Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5002895Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5003032Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5003205Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5003565Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5003916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5004227Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5004680Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5004987Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5005261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5005552Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5005685Z Execution Analysis: (:1) 2025-03-14T06:00:24.5005940Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5006151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5006156Z 2025-03-14T06:00:24.5006354Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5006473Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5006704Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5006821Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5007024Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5007174Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5007318Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5007489Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5008081Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5008664Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5009023Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5009384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5009697Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5009978Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5010283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5010558Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5010703Z Execution Analysis: .......... 2025-03-14T06:00:24.5010991Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5011189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5011480Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1891 counts during 1802 steps 2025-03-14T06:00:24.5011487Z 2025-03-14T06:00:24.5011686Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5011802Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5012090Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5012202Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5012403Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5012551Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5012693Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5012869Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5013227Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5013588Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5013950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5014233Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5014539Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5014815Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5015104Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5015237Z Execution Analysis: (:1) 2025-03-14T06:00:24.5015495Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5015702Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5015707Z 2025-03-14T06:00:24.5015907Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5016029Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5016255Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5016375Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5016581Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5016843Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5016982Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5017151Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5017723Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5018289Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5018647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5018991Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5019303Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5019568Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5019876Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5020160Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5020294Z Execution Analysis: .......... 2025-03-14T06:00:24.5020544Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5020749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5021031Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1893 counts during 1803 steps 2025-03-14T06:00:24.5021036Z 2025-03-14T06:00:24.5021239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5021346Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5021636Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5021739Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5021943Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5022081Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5022225Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5022389Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5022738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5023125Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5023437Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5023700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5024005Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5024263Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5024554Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5024675Z Execution Analysis: (:1) 2025-03-14T06:00:24.5024931Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5025122Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5025126Z 2025-03-14T06:00:24.5025330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5025437Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5025665Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5025772Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5025979Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5026115Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5026262Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5026426Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5027009Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5027568Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5027925Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5028265Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5028573Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5028838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5029167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5029452Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5029558Z Execution Analysis: .......... 2025-03-14T06:00:24.5029806Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5030180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5030467Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1894 counts during 1804 steps 2025-03-14T06:00:24.5030472Z 2025-03-14T06:00:24.5030679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5030790Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5031089Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5031195Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5031409Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5031550Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5031701Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5031872Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5032268Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5032645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5032971Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5033247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5033571Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5033843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5034155Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5034283Z Execution Analysis: (:1) 2025-03-14T06:00:24.5034556Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5034767Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5034784Z 2025-03-14T06:00:24.5034988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5035119Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5035356Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5035482Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5035692Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5035857Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5036010Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5036196Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5036789Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5037382Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5037744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5038112Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5038431Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5038724Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5039092Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5039380Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5039490Z Execution Analysis: .......... 2025-03-14T06:00:24.5039767Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5039975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5040284Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1895 counts during 1805 steps 2025-03-14T06:00:24.5040289Z 2025-03-14T06:00:24.5040494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5040628Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5040923Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5041056Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5041265Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5041427Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5041574Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5041764Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5042187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5042577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5042893Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5043186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5043496Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5043788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5044083Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5044223Z Execution Analysis: (:1) 2025-03-14T06:00:24.5044580Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5044809Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5044814Z 2025-03-14T06:00:24.5045020Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5045153Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5045389Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5045520Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5045729Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5045889Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5046037Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5046221Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5046813Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5047399Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5047762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5048123Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5048439Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5048786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5049094Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5049378Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5049488Z Execution Analysis: .......... 2025-03-14T06:00:24.5049763Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5049967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5050272Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1896 counts during 1806 steps 2025-03-14T06:00:24.5050280Z 2025-03-14T06:00:24.5050499Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5050621Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5050925Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5051039Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5051244Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5051402Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5051573Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5051781Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5052142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5052527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5052841Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5053132Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5053454Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5053727Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5054032Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5054162Z Execution Analysis: (:1) 2025-03-14T06:00:24.5054438Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5054643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5054648Z 2025-03-14T06:00:24.5054864Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5054981Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5055226Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5055339Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5055560Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5055707Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5055867Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5056037Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5056647Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5057328Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5057692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5058039Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5058715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5059027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5059345Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5059614Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5059738Z Execution Analysis: .......... 2025-03-14T06:00:24.5059994Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5060209Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5060497Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1897 counts during 1807 steps 2025-03-14T06:00:24.5060501Z 2025-03-14T06:00:24.5060715Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5060838Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5061142Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5061253Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5061470Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5061637Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5061813Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5061981Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5062345Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5062690Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5063008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5063281Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5063596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5063861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5064161Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5064287Z Execution Analysis: (:1) 2025-03-14T06:00:24.5064551Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5064748Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5064752Z 2025-03-14T06:00:24.5064963Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5065077Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5065457Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5065738Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5065964Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5066153Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5066319Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5066492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5067097Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5067675Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5068051Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5068466Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5068830Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5069107Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5069431Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5069703Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5069827Z Execution Analysis: .......... 2025-03-14T06:00:24.5070087Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5070304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5070613Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1898 counts during 1808 steps 2025-03-14T06:00:24.5070620Z 2025-03-14T06:00:24.5070823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5070959Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5071252Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5071381Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5071690Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5071882Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5072031Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5072215Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5072580Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5072947Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5073266Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5073558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5073871Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5074156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5074456Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5074601Z Execution Analysis: (:1) 2025-03-14T06:00:24.5074863Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5075080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5075085Z 2025-03-14T06:00:24.5075290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5075425Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5075659Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5075786Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5075991Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5076148Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5076301Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5076481Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5077079Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5077674Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5078037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5078456Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5078772Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5079061Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5079376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5079659Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5079771Z Execution Analysis: .......... 2025-03-14T06:00:24.5080034Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5080236Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5080536Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1899 counts during 1809 steps 2025-03-14T06:00:24.5080543Z 2025-03-14T06:00:24.5080750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5080869Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5081158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5081337Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5081543Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5081693Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5081838Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5082014Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5082375Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5082731Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5083048Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5083330Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5083640Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5083922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5084215Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5084349Z Execution Analysis: (:1) 2025-03-14T06:00:24.5084679Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5084891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5084898Z 2025-03-14T06:00:24.5085102Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5085227Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5085461Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5085584Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5085793Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5085947Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5086094Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5086272Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5086864Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5087444Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5087860Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5088225Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5088548Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5088824Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5089145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5089415Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5089532Z Execution Analysis: .......... 2025-03-14T06:00:24.5089793Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5090002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5090296Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1900 counts during 1810 steps 2025-03-14T06:00:24.5090300Z 2025-03-14T06:00:24.5090512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5090625Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5090966Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5091078Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5091289Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5091434Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5091576Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5091744Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5092108Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5092460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5092777Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5093052Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5093367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5093638Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5093934Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5094061Z Execution Analysis: (:1) 2025-03-14T06:00:24.5094324Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5094527Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5094535Z 2025-03-14T06:00:24.5094743Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5094858Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5095092Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5095203Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5095414Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5095556Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5095711Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5095881Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5096482Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5097056Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5097473Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5097826Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5098147Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5098420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5098734Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5099003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5099118Z Execution Analysis: .......... 2025-03-14T06:00:24.5099376Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5099590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5099883Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1901 counts during 1811 steps 2025-03-14T06:00:24.5099888Z 2025-03-14T06:00:24.5100096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5100255Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5100555Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5100667Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5100880Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5101025Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5101175Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5101346Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5101715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5102071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5102398Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5102675Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5102994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5103260Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5103564Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5103688Z Execution Analysis: (:1) 2025-03-14T06:00:24.5103957Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5104160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5104175Z 2025-03-14T06:00:24.5104380Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5104505Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5104740Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5104860Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5105063Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5105207Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5105365Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5105530Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5106131Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5106772Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5107129Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5107490Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5107910Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5108184Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5108481Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5108751Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5108853Z Execution Analysis: .......... 2025-03-14T06:00:24.5109113Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5109310Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5109607Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1902 counts during 1812 steps 2025-03-14T06:00:24.5109612Z 2025-03-14T06:00:24.5109852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5109973Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5110253Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5110365Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5110565Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5110715Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5110851Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5111030Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5111381Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5111732Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5112037Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5112316Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5112612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5112882Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5113166Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5113294Z Execution Analysis: (:1) 2025-03-14T06:00:24.5113550Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5113757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5113761Z 2025-03-14T06:00:24.5113956Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5114075Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5114311Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5114427Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5114729Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5114870Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5115007Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5115173Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5115745Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5116319Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5116656Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5116994Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5117284Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5117544Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5117830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5118086Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5118189Z Execution Analysis: .......... 2025-03-14T06:00:24.5118434Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5118623Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5118918Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1903 counts during 1813 steps 2025-03-14T06:00:24.5118945Z 2025-03-14T06:00:24.5119132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5119245Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5119511Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5119624Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5119814Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5119956Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5120089Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5120254Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5120758Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5121111Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5121417Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5121693Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5121991Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5122261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5122550Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5122673Z Execution Analysis: (:1) 2025-03-14T06:00:24.5122942Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5123139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5123143Z 2025-03-14T06:00:24.5123353Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5123464Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5123701Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5123808Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5124017Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5124156Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5124311Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5124566Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5125353Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5125927Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5126301Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5126653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5126979Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5127252Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5127567Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5127835Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5127954Z Execution Analysis: .......... 2025-03-14T06:00:24.5128211Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5128449Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5128766Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1904 counts during 1814 steps 2025-03-14T06:00:24.5128771Z 2025-03-14T06:00:24.5128986Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5129101Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5129401Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5129511Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5129725Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5129872Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5130022Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5130188Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5130556Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5130909Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5131234Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5131507Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5131829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5132096Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5132398Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5132522Z Execution Analysis: (:1) 2025-03-14T06:00:24.5132790Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5132990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5132994Z 2025-03-14T06:00:24.5133207Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5133318Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5133559Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5133666Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5133881Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5134023Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5134204Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5134393Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5134993Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5135567Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5135934Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5136284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5136606Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5136876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5137195Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5137464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5137577Z Execution Analysis: .......... 2025-03-14T06:00:24.5137832Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5138086Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5138376Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1905 counts during 1815 steps 2025-03-14T06:00:24.5138391Z 2025-03-14T06:00:24.5138590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5138711Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5139001Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5139124Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5139328Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5139481Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5139622Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5139789Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5140159Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5140517Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5140826Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5141108Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5141413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5141692Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5141985Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5142122Z Execution Analysis: (:1) 2025-03-14T06:00:24.5142376Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5142588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5142593Z 2025-03-14T06:00:24.5142791Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5142912Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5143139Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5143261Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5143568Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5143742Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5143904Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5144077Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5144650Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5145219Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5145567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5145919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5146220Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5146496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5146796Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5147071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5147177Z Execution Analysis: .......... 2025-03-14T06:00:24.5147483Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5147678Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5147973Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1906 counts during 1816 steps 2025-03-14T06:00:24.5147978Z 2025-03-14T06:00:24.5148171Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5148291Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5148571Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5148692Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5148888Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5149041Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5149176Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5149355Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5149703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5150056Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5150359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5150636Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5150936Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5151213Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5151496Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5151630Z Execution Analysis: (:1) 2025-03-14T06:00:24.5151882Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5152087Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5152092Z 2025-03-14T06:00:24.5152286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5152407Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5152629Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5152748Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5152980Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5153152Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5153295Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5153470Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5154045Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5154708Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5155042Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5155375Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5155664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5155925Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5156221Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5156468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5156598Z Execution Analysis: .......... 2025-03-14T06:00:24.5156857Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5157054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5157320Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1907 counts during 1817 steps 2025-03-14T06:00:24.5157324Z 2025-03-14T06:00:24.5157522Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5157626Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5157905Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5158005Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5158205Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5158334Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5158477Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5158630Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5158970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5159293Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5159589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5159838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5160137Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5160383Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5160659Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5160773Z Execution Analysis: (:1) 2025-03-14T06:00:24.5161022Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5161208Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5161212Z 2025-03-14T06:00:24.5161406Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5161508Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5161730Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5161877Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5162071Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5162202Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5162347Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5162501Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5163055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5163584Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5163926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5164250Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5164637Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5164897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5165512Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5165878Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5166002Z Execution Analysis: .......... 2025-03-14T06:00:24.5166267Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5166487Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5166784Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1908 counts during 1818 steps 2025-03-14T06:00:24.5166788Z 2025-03-14T06:00:24.5167007Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5167126Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5167429Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5167541Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5167761Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5167911Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5168066Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5168238Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5168609Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5168963Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5169287Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5169569Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5169893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5170166Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5170477Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5170606Z Execution Analysis: (:1) 2025-03-14T06:00:24.5170878Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5171080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5171084Z 2025-03-14T06:00:24.5171301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5171453Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5171727Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5171842Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5172061Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5172207Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5172370Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5172544Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5173149Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5173723Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5174095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5174460Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5174780Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5175064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5175417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5175695Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5175802Z Execution Analysis: .......... 2025-03-14T06:00:24.5176069Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5176273Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5176570Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1909 counts during 1819 steps 2025-03-14T06:00:24.5176578Z 2025-03-14T06:00:24.5176782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5176903Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5177195Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5177315Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5177523Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5177674Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5177818Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5177994Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5178353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5178716Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5179030Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5179316Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5179626Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5179906Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5180200Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5180332Z Execution Analysis: (:1) 2025-03-14T06:00:24.5180591Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5180807Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5180812Z 2025-03-14T06:00:24.5181012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5181188Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5181418Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5181540Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5181744Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5181899Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5182049Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5182230Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5182821Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5183405Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5183768Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5184131Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5184443Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5184753Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5185099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5185380Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5185488Z Execution Analysis: .......... 2025-03-14T06:00:24.5185756Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5185959Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5186261Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1910 counts during 1820 steps 2025-03-14T06:00:24.5186270Z 2025-03-14T06:00:24.5186475Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5186601Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5186899Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5187027Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5187236Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5187390Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5187533Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5187715Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5188075Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5188439Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5188755Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5189039Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5189349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5189629Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5189923Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5190055Z Execution Analysis: (:1) 2025-03-14T06:00:24.5190315Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5190528Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5190562Z 2025-03-14T06:00:24.5190798Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5190910Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5191152Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5191262Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5191588Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5191726Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5191880Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5192043Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5192629Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5193186Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5193546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5193888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5194226Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5194521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5194830Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5195094Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5195210Z Execution Analysis: .......... 2025-03-14T06:00:24.5195461Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5195669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5195960Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1911 counts during 1821 steps 2025-03-14T06:00:24.5195964Z 2025-03-14T06:00:24.5196176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5196291Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5196588Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5196697Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5196905Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5197046Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5197195Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5197363Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5197721Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5198069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5198384Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5198653Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5198967Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5199232Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5199528Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5199651Z Execution Analysis: (:1) 2025-03-14T06:00:24.5199911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5200138Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5200167Z 2025-03-14T06:00:24.5200378Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5200490Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5200725Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5200838Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5201047Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5201189Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5201343Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5201508Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5202092Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5202654Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5203017Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5203360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5203718Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5203988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5204297Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5204646Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5204760Z Execution Analysis: .......... 2025-03-14T06:00:24.5205180Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5205397Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5205691Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1912 counts during 1822 steps 2025-03-14T06:00:24.5205708Z 2025-03-14T06:00:24.5205910Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5206038Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5206331Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5206444Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5206655Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5206803Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5206959Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5207133Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5207504Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5207859Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5208186Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5208476Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5208788Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5209069Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5209365Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5209504Z Execution Analysis: (:1) 2025-03-14T06:00:24.5209762Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5210030Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5210035Z 2025-03-14T06:00:24.5210239Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5210367Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5210604Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5210726Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5210932Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5211089Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5211237Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5211417Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5212010Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5212596Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5212956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5213370Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5213687Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5213973Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5214283Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5214562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5214672Z Execution Analysis: .......... 2025-03-14T06:00:24.5214943Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5215151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5215453Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1914 counts during 1823 steps 2025-03-14T06:00:24.5215459Z 2025-03-14T06:00:24.5215665Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5215790Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5216079Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5216202Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5216408Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5216572Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5216719Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5216903Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5217372Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5217726Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5218035Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5218309Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5218611Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5218886Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5219171Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5219331Z Execution Analysis: (:1) 2025-03-14T06:00:24.5219678Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5219885Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5219889Z 2025-03-14T06:00:24.5220088Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5220208Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5220436Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5220555Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5220755Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5220926Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5221070Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5221243Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5221822Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5222388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5222798Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5223152Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5223456Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5223735Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5224038Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5224314Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5224421Z Execution Analysis: .......... 2025-03-14T06:00:24.5224683Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5224882Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5225178Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1915 counts during 1824 steps 2025-03-14T06:00:24.5225183Z 2025-03-14T06:00:24.5225389Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5225500Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5225793Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5225901Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5226112Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5226256Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5226406Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5226572Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5226951Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5227298Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5227610Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5227875Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5228184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5228449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5228742Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5228910Z Execution Analysis: (:1) 2025-03-14T06:00:24.5229172Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5229369Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5229373Z 2025-03-14T06:00:24.5229585Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5229698Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5229932Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5230043Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5230252Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5230396Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5230550Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5230718Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5231306Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5231887Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5232271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5232617Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5232931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5233199Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5233508Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5233945Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5234059Z Execution Analysis: .......... 2025-03-14T06:00:24.5234316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5234530Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5234822Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1916 counts during 1825 steps 2025-03-14T06:00:24.5234826Z 2025-03-14T06:00:24.5235037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5235153Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5235453Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5235563Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5235780Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5235928Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5236078Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5236249Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5236617Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5236968Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5237291Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5237563Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5237881Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5238152Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5238504Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5238630Z Execution Analysis: (:1) 2025-03-14T06:00:24.5238899Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5239106Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5239110Z 2025-03-14T06:00:24.5239320Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5239434Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5239676Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5239787Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5240002Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5240145Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5240303Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5240472Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5241074Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5241694Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5242064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5242430Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5242744Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5243031Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5243341Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5243622Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5243733Z Execution Analysis: .......... 2025-03-14T06:00:24.5244007Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5244211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5244594Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1917 counts during 1826 steps 2025-03-14T06:00:24.5244600Z 2025-03-14T06:00:24.5244806Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5244934Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5245226Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5245353Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5245560Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5245716Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5245858Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5246037Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5246401Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5246766Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5247079Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5247366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5247673Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5247985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5248308Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5248442Z Execution Analysis: (:1) 2025-03-14T06:00:24.5248706Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5248920Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5248924Z 2025-03-14T06:00:24.5249127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5249252Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5249484Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5249605Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5249809Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5249961Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5250108Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5250297Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5250912Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5251525Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5251886Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5252253Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5252569Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5252861Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5253175Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5253462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5253570Z Execution Analysis: .......... 2025-03-14T06:00:24.5253847Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5254053Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5254364Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1918 counts during 1827 steps 2025-03-14T06:00:24.5254368Z 2025-03-14T06:00:24.5254574Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5254706Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5254999Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5255130Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5255336Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5255498Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5255643Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5255833Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5256196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5256568Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5256886Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5257286Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5257618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5257936Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5258222Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5258360Z Execution Analysis: (:1) 2025-03-14T06:00:24.5258620Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5258833Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5258837Z 2025-03-14T06:00:24.5259050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5259163Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5259389Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5259514Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5259720Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5259876Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5260023Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5260203Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5260829Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5261402Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5261769Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5262113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5262433Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5262701Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5263012Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5263276Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5263400Z Execution Analysis: .......... 2025-03-14T06:00:24.5263649Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5263858Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5264140Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1919 counts during 1828 steps 2025-03-14T06:00:24.5264145Z 2025-03-14T06:00:24.5264354Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5264471Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5264768Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5264877Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5265088Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5265229Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5265513Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5265845Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5266221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5266573Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5266900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5267230Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5267589Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5267861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5268169Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5268299Z Execution Analysis: (:1) 2025-03-14T06:00:24.5268570Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5268772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5268777Z 2025-03-14T06:00:24.5268990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5269104Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5269351Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5269466Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5269683Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5269828Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5269988Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5270186Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5270830Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5271406Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5271783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5272139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5272466Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5272746Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5273066Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5273340Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5273461Z Execution Analysis: .......... 2025-03-14T06:00:24.5273722Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5273941Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5274232Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1920 counts during 1829 steps 2025-03-14T06:00:24.5274239Z 2025-03-14T06:00:24.5274456Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5274574Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5274883Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5274996Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5275218Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5275368Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5275525Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5275696Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5276064Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5276418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5276787Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5277090Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5277412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5277685Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5278097Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5278220Z Execution Analysis: (:1) 2025-03-14T06:00:24.5278485Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5278698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5278702Z 2025-03-14T06:00:24.5278899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5279029Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5279255Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5279375Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5279573Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5279726Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5279921Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5280100Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5280674Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5281241Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5281592Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5281950Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5282256Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5282536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5282838Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5283113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5283217Z Execution Analysis: .......... 2025-03-14T06:00:24.5283482Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5283679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5283976Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1921 counts during 1830 steps 2025-03-14T06:00:24.5283983Z 2025-03-14T06:00:24.5284178Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5284304Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5284666Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5284792Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5285160Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5285322Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5285465Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5285649Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5286005Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5286371Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5286735Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5287025Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5287334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5287621Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5287915Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5288056Z Execution Analysis: (:1) 2025-03-14T06:00:24.5288315Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5288534Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5288538Z 2025-03-14T06:00:24.5288741Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5288877Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5289109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5289232Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5289439Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5289643Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5289793Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5289975Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5290569Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5291159Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5291526Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5291890Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5292207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5292498Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5292806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5293090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5293197Z Execution Analysis: .......... 2025-03-14T06:00:24.5293469Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5293674Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5293984Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1922 counts during 1831 steps 2025-03-14T06:00:24.5293988Z 2025-03-14T06:00:24.5294205Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5294323Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5294628Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5294744Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5294963Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5295107Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5295252Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5295432Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5295793Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5296200Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5296557Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5296837Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5297272Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5297535Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5297834Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5297960Z Execution Analysis: (:1) 2025-03-14T06:00:24.5298229Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5298433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5298441Z 2025-03-14T06:00:24.5298653Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5298767Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5299007Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5299116Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5299683Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5299830Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5299988Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5300155Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5300748Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5301311Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5301683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5302028Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5302355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5302625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5302940Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5303208Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5303326Z Execution Analysis: .......... 2025-03-14T06:00:24.5303584Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5303804Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5304090Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1923 counts during 1832 steps 2025-03-14T06:00:24.5304098Z 2025-03-14T06:00:24.5304311Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5304432Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5304736Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5304850Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5305066Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5305210Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5305361Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5305525Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5305915Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5306284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5306604Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5306876Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5307190Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5307556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5307840Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5307956Z Execution Analysis: (:1) 2025-03-14T06:00:24.5308208Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5308399Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5308405Z 2025-03-14T06:00:24.5308602Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5308710Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5308958Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5309086Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5309291Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5309427Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5309577Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5309733Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5310290Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5310824Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5311169Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5311497Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5311801Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5312057Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5312356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5312618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5312718Z Execution Analysis: .......... 2025-03-14T06:00:24.5312973Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5313163Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5313444Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1924 counts during 1833 steps 2025-03-14T06:00:24.5313448Z 2025-03-14T06:00:24.5313640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5313758Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5314028Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5314143Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5314333Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5314480Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5314615Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5314807Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5315164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5315503Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5315798Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5316066Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5316353Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5316618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5316892Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5317021Z Execution Analysis: (:1) 2025-03-14T06:00:24.5317265Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5317468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5317471Z 2025-03-14T06:00:24.5317662Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5317806Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5318044Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5318164Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5318355Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5318501Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5318642Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5318811Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5319358Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5319906Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5320240Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5320581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5320871Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5321140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5321425Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5321687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5321790Z Execution Analysis: .......... 2025-03-14T06:00:24.5322041Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5322229Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5322511Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1925 counts during 1834 steps 2025-03-14T06:00:24.5322517Z 2025-03-14T06:00:24.5322707Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5322828Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5323100Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5323217Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5323408Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5323555Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5323711Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5323905Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5324235Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5324657Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5325123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5325412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5325722Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5326002Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5326295Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5326442Z Execution Analysis: (:1) 2025-03-14T06:00:24.5326706Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5326924Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5326929Z 2025-03-14T06:00:24.5327196Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5327327Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5327562Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5327686Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5327892Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5328045Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5328192Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5328375Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5328972Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5329557Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5329933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5330286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5330616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5330893Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5331215Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5331486Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5331611Z Execution Analysis: .......... 2025-03-14T06:00:24.5331872Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5332089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5332383Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1926 counts during 1835 steps 2025-03-14T06:00:24.5332387Z 2025-03-14T06:00:24.5332602Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5332719Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5333023Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5333137Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5333355Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5333549Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5333707Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5333878Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5334251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5334607Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5334932Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5335205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5335526Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5335798Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5336104Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5336235Z Execution Analysis: (:1) 2025-03-14T06:00:24.5336508Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5336713Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5336740Z 2025-03-14T06:00:24.5336980Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5337206Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5337433Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5337542Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5337746Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5337883Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5338038Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5338203Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5338765Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5339491Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5339855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5340201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5340524Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5340796Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5341115Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5341384Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5341508Z Execution Analysis: .......... 2025-03-14T06:00:24.5341764Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5341984Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5342272Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1927 counts during 1836 steps 2025-03-14T06:00:24.5342277Z 2025-03-14T06:00:24.5342493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5342610Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5342910Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5343053Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5343291Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5343436Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5343595Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5343763Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5344134Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5344481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5344801Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5345068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5345385Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5345652Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5345957Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5346088Z Execution Analysis: (:1) 2025-03-14T06:00:24.5346357Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5346606Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5346626Z 2025-03-14T06:00:24.5346824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5346954Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5347184Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5347302Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5347505Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5347664Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5347815Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5347978Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5348564Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5349138Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5349491Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5349849Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5350155Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5350436Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5350740Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5351113Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5351214Z Execution Analysis: .......... 2025-03-14T06:00:24.5351476Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5351667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5351949Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1928 counts during 1837 steps 2025-03-14T06:00:24.5351954Z 2025-03-14T06:00:24.5352143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5352263Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5352562Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5352701Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5352892Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5353040Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5353175Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5353347Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5353683Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5354025Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5354318Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5354589Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5354878Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5355147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5355420Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5355553Z Execution Analysis: (:1) 2025-03-14T06:00:24.5355840Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5356043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5356047Z 2025-03-14T06:00:24.5356236Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5356353Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5356571Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5356686Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5356882Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5357030Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5357169Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5357340Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5357891Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5358433Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5358769Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5359108Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5359400Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5359672Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5359960Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5360224Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5360328Z Execution Analysis: .......... 2025-03-14T06:00:24.5360582Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5360771Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5361053Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1929 counts during 1838 steps 2025-03-14T06:00:24.5361058Z 2025-03-14T06:00:24.5361248Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5361393Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5361687Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5361803Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5361996Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5362143Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5362278Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5362450Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5362782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5363120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5363409Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5363676Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5363980Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5364231Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5364614Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5364778Z Execution Analysis: (:1) 2025-03-14T06:00:24.5365237Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5365575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5365580Z 2025-03-14T06:00:24.5365891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5366008Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5366254Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5366374Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5366596Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5366743Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5366904Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5367077Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5367686Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5368264Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5368639Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5368994Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5369324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5369601Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5369920Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5370194Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5370313Z Execution Analysis: .......... 2025-03-14T06:00:24.5370571Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5370787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5371081Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1930 counts during 1839 steps 2025-03-14T06:00:24.5371086Z 2025-03-14T06:00:24.5371301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5371581Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5371891Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5372005Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5372225Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5372376Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5372535Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5372706Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5373079Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5373432Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5373761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5374044Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5374369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5374640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5375012Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5375143Z Execution Analysis: (:1) 2025-03-14T06:00:24.5375420Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5375625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5375630Z 2025-03-14T06:00:24.5375848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5375968Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5376247Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5376383Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5376596Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5376768Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5376935Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5377115Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5386075Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5386748Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5387142Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5387499Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5387821Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5388097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5388415Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5388685Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5388795Z Execution Analysis: .......... 2025-03-14T06:00:24.5389057Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5389265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5389555Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1931 counts during 1840 steps 2025-03-14T06:00:24.5389592Z 2025-03-14T06:00:24.5389824Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5389936Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5390231Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5390345Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5390554Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5390699Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5390847Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5391013Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5391377Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5391728Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5392050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5392324Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5392637Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5392933Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5393256Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5393383Z Execution Analysis: (:1) 2025-03-14T06:00:24.5393645Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5393850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5393854Z 2025-03-14T06:00:24.5394059Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5394174Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5394409Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5394519Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5394726Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5394871Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5395021Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5395187Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5395783Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5396355Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5396719Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5397077Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5397388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5397666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5397977Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5398249Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5398352Z Execution Analysis: .......... 2025-03-14T06:00:24.5398614Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5398814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5399137Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1932 counts during 1841 steps 2025-03-14T06:00:24.5399165Z 2025-03-14T06:00:24.5399363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5399482Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5399774Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5399889Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5400198Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5400341Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5400478Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5400645Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5400992Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5401341Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5401644Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5401913Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5402232Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5402520Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5402802Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5402928Z Execution Analysis: (:1) 2025-03-14T06:00:24.5403175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5403375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5403381Z 2025-03-14T06:00:24.5403575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5403690Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5403911Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5404022Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5404219Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5404362Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5404567Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5404735Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5405502Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5406081Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5406441Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5406793Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5407106Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5407386Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5407691Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5407962Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5408066Z Execution Analysis: .......... 2025-03-14T06:00:24.5408329Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5408556Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5408886Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1933 counts during 1842 steps 2025-03-14T06:00:24.5408892Z 2025-03-14T06:00:24.5409091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5409208Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5409500Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5409614Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5409815Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5409965Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5410107Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5410277Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5410632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5410990Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5411302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5411580Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5411933Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5412207Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5412500Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5412629Z Execution Analysis: (:1) 2025-03-14T06:00:24.5412885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5413091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5413097Z 2025-03-14T06:00:24.5413302Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5413413Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5413640Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5413758Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5413963Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5414111Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5414256Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5414429Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5415017Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5415598Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5415967Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5416318Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5416639Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5416912Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5417328Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5417588Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5417694Z Execution Analysis: .......... 2025-03-14T06:00:24.5417940Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5418191Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5418471Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1935 counts during 1843 steps 2025-03-14T06:00:24.5418475Z 2025-03-14T06:00:24.5418678Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5418788Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5419073Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5419179Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5419382Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5419520Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5419663Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5419823Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5420181Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5420521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5420924Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5421218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5421507Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5421752Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5422027Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5422141Z Execution Analysis: (:1) 2025-03-14T06:00:24.5422384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5422571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5422575Z 2025-03-14T06:00:24.5422766Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5422869Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5423087Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5423187Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5423381Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5423511Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5423650Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5423804Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5424352Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5424888Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5425222Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5425547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5425850Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5426108Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5426409Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5426662Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5426799Z Execution Analysis: .......... 2025-03-14T06:00:24.5427072Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5427273Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5427544Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1936 counts during 1844 steps 2025-03-14T06:00:24.5427549Z 2025-03-14T06:00:24.5427755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5427867Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5428152Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5428258Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5428462Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5428600Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5428752Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5428915Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5429261Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5429589Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5429939Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5430197Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5430501Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5430754Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5431046Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5431170Z Execution Analysis: (:1) 2025-03-14T06:00:24.5431429Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5431633Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5431637Z 2025-03-14T06:00:24.5431833Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5431961Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5432180Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5432300Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5432495Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5432648Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5432791Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5432965Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5433516Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5434066Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5434408Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5434751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5435047Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5435315Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5435604Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5435894Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5436024Z Execution Analysis: .......... 2025-03-14T06:00:24.5436279Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5436470Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5436761Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1937 counts during 1845 steps 2025-03-14T06:00:24.5436766Z 2025-03-14T06:00:24.5436954Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5437078Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5437352Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5437472Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5437668Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5437823Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5437963Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5438134Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5438467Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5438831Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5439145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5439412Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5439699Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5439967Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5440239Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5440371Z Execution Analysis: (:1) 2025-03-14T06:00:24.5440612Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5440811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5440815Z 2025-03-14T06:00:24.5441006Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5441125Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5441340Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5441460Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5441654Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5441799Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5441936Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5442110Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5442659Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5443210Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5443548Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5443888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5444180Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5444448Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5444820Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5445340Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5445449Z Execution Analysis: .......... 2025-03-14T06:00:24.5445724Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5445932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5446239Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1938 counts during 1846 steps 2025-03-14T06:00:24.5446244Z 2025-03-14T06:00:24.5446463Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5446581Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5446886Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5447000Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5447219Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5447371Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5447514Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5447698Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5448087Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5448481Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5448808Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5449087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5449412Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5449689Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5450001Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5450130Z Execution Analysis: (:1) 2025-03-14T06:00:24.5450408Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5450614Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5450620Z 2025-03-14T06:00:24.5450836Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5450953Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5451200Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5451313Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5451530Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5451676Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5451840Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5452013Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5452617Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5453195Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5453569Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5453923Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5454249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5454525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5454895Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5455167Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5455288Z Execution Analysis: .......... 2025-03-14T06:00:24.5455550Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5455767Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5456062Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1939 counts during 1847 steps 2025-03-14T06:00:24.5456067Z 2025-03-14T06:00:24.5456284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5456402Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5456706Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5456927Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5457133Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5457269Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5457416Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5457575Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5457966Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5458295Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5458598Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5458857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5459158Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5459412Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5459700Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5459818Z Execution Analysis: (:1) 2025-03-14T06:00:24.5460072Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5460264Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5460268Z 2025-03-14T06:00:24.5460467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5460575Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5460801Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5460907Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5461109Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5461247Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5461397Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5461555Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5462118Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5462651Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5462997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5463326Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5463630Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5463912Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5464236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5464499Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5464602Z Execution Analysis: .......... 2025-03-14T06:00:24.5464847Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5465050Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5465462Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1940 counts during 1848 steps 2025-03-14T06:00:24.5465467Z 2025-03-14T06:00:24.5465825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5465959Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5466258Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5466389Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5466596Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5466754Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5466902Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5467171Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5467537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5467904Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5468220Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5468510Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5468824Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5469112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5469410Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5469551Z Execution Analysis: (:1) 2025-03-14T06:00:24.5469819Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5470042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5470046Z 2025-03-14T06:00:24.5470252Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5470384Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5470613Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5470738Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5470940Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5471093Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5471238Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5471417Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5472012Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5472600Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5472959Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5473320Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5473669Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5473988Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5474294Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5474576Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5474683Z Execution Analysis: .......... 2025-03-14T06:00:24.5474951Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5475151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5475455Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1941 counts during 1849 steps 2025-03-14T06:00:24.5475459Z 2025-03-14T06:00:24.5475661Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5475792Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5476082Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5476203Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5476407Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5476590Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5476770Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5476950Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5477308Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5477672Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5478193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5478456Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5478739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5478998Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5479269Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5479396Z Execution Analysis: (:1) 2025-03-14T06:00:24.5479635Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5479832Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5479836Z 2025-03-14T06:00:24.5480023Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5480140Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5480355Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5480467Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5480656Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5480799Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5480931Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5481097Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5481640Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5482177Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5482518Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5482864Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5483182Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5483434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5483727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5483974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5484083Z Execution Analysis: .......... 2025-03-14T06:00:24.5484320Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5484577Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5484848Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1942 counts during 1850 steps 2025-03-14T06:00:24.5484855Z 2025-03-14T06:00:24.5485229Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5485344Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5485641Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5485750Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5485992Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5486158Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5486311Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5486479Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5486842Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5487190Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5487509Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5487786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5488103Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5488375Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5488679Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5488804Z Execution Analysis: (:1) 2025-03-14T06:00:24.5489070Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5489269Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5489274Z 2025-03-14T06:00:24.5489482Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5489599Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5489840Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5489947Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5490158Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5490300Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5490457Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5490627Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5491225Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5491795Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5492163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5492563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5492883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5493156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5493475Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5493745Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5493859Z Execution Analysis: .......... 2025-03-14T06:00:24.5494117Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5494326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5494616Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1943 counts during 1851 steps 2025-03-14T06:00:24.5494625Z 2025-03-14T06:00:24.5494834Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5494949Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5495247Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5495382Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5495617Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5495758Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5495908Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5496076Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5496443Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5496796Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5497227Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5497496Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5497802Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5498066Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5498359Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5498478Z Execution Analysis: (:1) 2025-03-14T06:00:24.5498738Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5498931Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5498946Z 2025-03-14T06:00:24.5499137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5499259Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5499479Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5499595Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5499788Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5499927Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5500077Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5500240Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5500821Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5501388Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5501765Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5502144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5502448Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5502730Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5503026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5503299Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5503402Z Execution Analysis: .......... 2025-03-14T06:00:24.5503663Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5503858Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5504154Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1944 counts during 1852 steps 2025-03-14T06:00:24.5504159Z 2025-03-14T06:00:24.5504352Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5504473Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5504800Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5504919Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5505114Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5505267Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5505408Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5505582Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5505930Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5506289Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5506594Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5506874Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5507176Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5507555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5507827Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5507954Z Execution Analysis: (:1) 2025-03-14T06:00:24.5508191Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5508388Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5508396Z 2025-03-14T06:00:24.5508583Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5508701Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5508913Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5509028Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5509220Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5509361Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5509494Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5509656Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5510199Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5510732Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5511114Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5511448Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5511741Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5511997Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5512281Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5512540Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5512639Z Execution Analysis: .......... 2025-03-14T06:00:24.5512885Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5513075Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5513356Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1945 counts during 1853 steps 2025-03-14T06:00:24.5513360Z 2025-03-14T06:00:24.5513544Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5513692Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5513981Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5514091Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5514280Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5514424Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5514555Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5514718Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5515054Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5515389Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5515680Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5515945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5516233Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5516496Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5516775Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5516891Z Execution Analysis: (:1) 2025-03-14T06:00:24.5517137Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5517325Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5517331Z 2025-03-14T06:00:24.5517525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5517629Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5517855Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5517958Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5518157Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5518289Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5518433Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5518589Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5519145Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5519697Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5520066Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5520393Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5520692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5520945Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5521241Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5521493Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5521605Z Execution Analysis: .......... 2025-03-14T06:00:24.5521845Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5522045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5522314Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1946 counts during 1854 steps 2025-03-14T06:00:24.5522319Z 2025-03-14T06:00:24.5522631Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5522736Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5523014Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5523115Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5523312Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5523444Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5523586Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5523743Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5524088Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5524412Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5524792Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5525226Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5525541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5525867Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5526170Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5526292Z Execution Analysis: (:1) 2025-03-14T06:00:24.5526560Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5526762Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5526766Z 2025-03-14T06:00:24.5526975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5527087Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5527327Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5527437Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5527652Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5527793Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5527947Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5528114Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5528709Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5529334Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5529703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5530054Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5530376Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5530650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5530964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5531230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5531348Z Execution Analysis: .......... 2025-03-14T06:00:24.5531606Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5531817Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5532130Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1947 counts during 1855 steps 2025-03-14T06:00:24.5532146Z 2025-03-14T06:00:24.5532370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5532494Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5532779Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5532896Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5533097Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5533247Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5533390Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5533558Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5533926Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5534288Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5534601Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5534886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5535193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5535473Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5535762Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5535899Z Execution Analysis: (:1) 2025-03-14T06:00:24.5536157Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5536370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5536374Z 2025-03-14T06:00:24.5536575Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5536703Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5536931Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5537052Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5537359Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5537511Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5537649Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5537825Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5538444Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5539011Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5539366Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5539719Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5540022Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5540300Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5540597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5540874Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5540978Z Execution Analysis: .......... 2025-03-14T06:00:24.5541237Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5541434Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5541781Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1948 counts during 1856 steps 2025-03-14T06:00:24.5541786Z 2025-03-14T06:00:24.5541981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5542102Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5542382Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5542493Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5542690Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5542842Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5542982Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5543154Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5543500Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5543857Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5544257Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5544520Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5544805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5545061Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5545331Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5545463Z Execution Analysis: (:1) 2025-03-14T06:00:24.5545702Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5545898Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5545904Z 2025-03-14T06:00:24.5546089Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5546202Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5546412Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5546526Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5546711Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5546849Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5547010Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5547209Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5547752Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5548292Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5548621Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5548952Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5549241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5549504Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5549800Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5550050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5550161Z Execution Analysis: .......... 2025-03-14T06:00:24.5550398Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5550915Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5551189Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1949 counts during 1857 steps 2025-03-14T06:00:24.5551193Z 2025-03-14T06:00:24.5551390Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5551496Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5551775Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5551879Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5552079Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5552213Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5552352Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5552509Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5552852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5553177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5553477Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5553728Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5554023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5554273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5554554Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5554668Z Execution Analysis: (:1) 2025-03-14T06:00:24.5554919Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5555112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5555116Z 2025-03-14T06:00:24.5555314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5555422Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5555645Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5555754Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5555959Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5556119Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5556288Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5556449Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5557007Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5557542Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5557887Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5558217Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5558520Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5558778Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5559075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5559327Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5559435Z Execution Analysis: .......... 2025-03-14T06:00:24.5559722Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5559921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5560195Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1950 counts during 1858 steps 2025-03-14T06:00:24.5560200Z 2025-03-14T06:00:24.5560398Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5560508Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5560790Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5560897Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5561098Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5561236Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5561385Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5561547Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5561897Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5562228Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5562533Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5562790Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5563089Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5563341Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5563616Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5563734Z Execution Analysis: (:1) 2025-03-14T06:00:24.5563983Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5564173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5564177Z 2025-03-14T06:00:24.5564368Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5564528Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5564763Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5564867Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5565271Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5565573Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5565729Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5565899Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5566501Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5567081Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5567442Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5567801Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5568115Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5568400Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5568707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5568984Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5569138Z Execution Analysis: .......... 2025-03-14T06:00:24.5569441Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5569648Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5569948Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1951 counts during 1859 steps 2025-03-14T06:00:24.5569953Z 2025-03-14T06:00:24.5570157Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5570283Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5570575Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5570695Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5570901Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5571057Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5571204Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5571387Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5571748Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5572110Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5572426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5572709Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5573023Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5573303Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5573599Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5573737Z Execution Analysis: (:1) 2025-03-14T06:00:24.5574001Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5574214Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5574219Z 2025-03-14T06:00:24.5574422Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5574544Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5574776Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5574931Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5575171Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5575324Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5575470Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5575649Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5576243Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5576829Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5577296Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5577653Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5577963Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5578241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5578541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5578863Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5578970Z Execution Analysis: .......... 2025-03-14T06:00:24.5579338Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5579524Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5579804Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1952 counts during 1860 steps 2025-03-14T06:00:24.5579808Z 2025-03-14T06:00:24.5579993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5580115Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5580380Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5580497Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5580686Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5580833Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5580965Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5581131Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5581460Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5581801Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5582087Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5582352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5582635Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5582893Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5583164Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5583299Z Execution Analysis: (:1) 2025-03-14T06:00:24.5583536Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5583733Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5583737Z 2025-03-14T06:00:24.5583931Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5584039Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5584297Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5584425Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5584623Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5584758Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5584903Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5585064Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5585625Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5586157Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5586501Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5586829Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5587128Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5587383Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5587707Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5587985Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5588094Z Execution Analysis: .......... 2025-03-14T06:00:24.5588332Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5588525Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5588797Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1953 counts during 1861 steps 2025-03-14T06:00:24.5588803Z 2025-03-14T06:00:24.5588999Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5589106Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5589385Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5589491Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5589690Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5589827Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5589970Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5590126Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5590469Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5590795Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5591098Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5591354Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5591649Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5591904Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5592187Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5592306Z Execution Analysis: (:1) 2025-03-14T06:00:24.5592554Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5592744Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5592748Z 2025-03-14T06:00:24.5592940Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5593092Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5593316Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5593418Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5593618Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5593752Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5593903Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5594059Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5594616Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5595144Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5595492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5595817Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5596289Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5596581Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5596915Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5597180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5597294Z Execution Analysis: .......... 2025-03-14T06:00:24.5597543Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5597754Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5598038Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1954 counts during 1862 steps 2025-03-14T06:00:24.5598056Z 2025-03-14T06:00:24.5598255Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5598375Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5598661Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5598769Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5598979Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5599120Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5599273Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5599441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5599805Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5600148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5600468Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5600746Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5601049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5601326Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5601613Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5601744Z Execution Analysis: (:1) 2025-03-14T06:00:24.5602000Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5602211Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5602239Z 2025-03-14T06:00:24.5602436Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5602588Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5602813Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5602929Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5603134Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5603292Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5603437Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5603614Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5604196Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5604868Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5605402Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5605765Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5606084Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5606421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5606731Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5607017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5607124Z Execution Analysis: .......... 2025-03-14T06:00:24.5607395Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5607601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5607903Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1956 counts during 1863 steps 2025-03-14T06:00:24.5607907Z 2025-03-14T06:00:24.5608109Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5608233Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5608526Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5608646Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5608851Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5609007Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5609147Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5609328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5609685Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5610052Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5610363Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5610650Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5610962Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5611243Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5611532Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5611665Z Execution Analysis: (:1) 2025-03-14T06:00:24.5611920Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5612136Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5612188Z 2025-03-14T06:00:24.5612392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5612519Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5612748Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5612873Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5613077Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5613233Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5613380Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5613559Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5614147Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5614732Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5615092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5615454Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5615824Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5616111Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5616417Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5616700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5616807Z Execution Analysis: .......... 2025-03-14T06:00:24.5617073Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5617373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5617648Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1957 counts during 1864 steps 2025-03-14T06:00:24.5617653Z 2025-03-14T06:00:24.5617852Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5617961Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5618236Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5618343Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5618543Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5618678Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5618819Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5618975Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5619316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5619645Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5619942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5620201Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5620495Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5620746Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5621025Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5621143Z Execution Analysis: (:1) 2025-03-14T06:00:24.5621389Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5621623Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5621627Z 2025-03-14T06:00:24.5621821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5621927Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5622155Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5622258Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5622457Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5622591Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5622734Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5622889Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5623444Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5623982Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5624325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5624698Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5624995Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5625250Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5625547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5625798Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5625906Z Execution Analysis: .......... 2025-03-14T06:00:24.5626145Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5626346Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5626614Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1958 counts during 1865 steps 2025-03-14T06:00:24.5626618Z 2025-03-14T06:00:24.5626815Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5626922Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5627203Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5627308Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5627507Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5627640Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5627780Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5627937Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5628282Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5628605Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5628909Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5629162Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5629456Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5629704Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5629987Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5630103Z Execution Analysis: (:1) 2025-03-14T06:00:24.5630378Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5630588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5630592Z 2025-03-14T06:00:24.5630792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5630897Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5631126Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5631226Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5631427Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5631559Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5631705Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5631860Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5632419Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5632947Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5633316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5633674Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5633967Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5634228Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5634516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5634772Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5634876Z Execution Analysis: .......... 2025-03-14T06:00:24.5635126Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5635316Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5635597Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1959 counts during 1866 steps 2025-03-14T06:00:24.5635602Z 2025-03-14T06:00:24.5635791Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5635906Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5636176Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5636286Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5636476Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5636620Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5636757Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5636922Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5637258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5637592Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5637882Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5638142Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5638434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5638697Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5638972Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5639145Z Execution Analysis: (:1) 2025-03-14T06:00:24.5639389Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5639590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5639594Z 2025-03-14T06:00:24.5639786Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5639906Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5640121Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5640239Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5640430Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5640580Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5640719Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5640891Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5641440Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5642008Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5642370Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5642707Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5643003Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5643272Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5643561Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5643830Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5643933Z Execution Analysis: .......... 2025-03-14T06:00:24.5644187Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5644380Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5644751Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1960 counts during 1867 steps 2025-03-14T06:00:24.5644756Z 2025-03-14T06:00:24.5645116Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5645244Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5645539Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5645698Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5645910Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5646072Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5646219Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5646406Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5646769Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5647136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5647452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5647740Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5648051Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5648338Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5648664Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5648828Z Execution Analysis: (:1) 2025-03-14T06:00:24.5649089Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5649301Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5649307Z 2025-03-14T06:00:24.5649520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5649635Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5649884Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5649995Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5650199Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5650353Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5650503Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5650684Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5651275Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5651923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5652291Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5652646Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5652973Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5653247Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5653570Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5653843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5653966Z Execution Analysis: .......... 2025-03-14T06:00:24.5654229Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5654446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5654746Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1961 counts during 1868 steps 2025-03-14T06:00:24.5654750Z 2025-03-14T06:00:24.5654989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5655113Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5655423Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5655556Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5655778Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5655939Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5656091Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5656276Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5656642Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5657013Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5657381Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5657666Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5657990Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5658294Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5658623Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5658751Z Execution Analysis: (:1) 2025-03-14T06:00:24.5659023Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5659231Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5659235Z 2025-03-14T06:00:24.5659450Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5659570Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5659817Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5659930Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5660147Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5660298Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5660460Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5660629Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5661257Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5661857Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5662231Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5662586Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5662914Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5663193Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5663516Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5663787Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5663904Z Execution Analysis: .......... 2025-03-14T06:00:24.5664166Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5664380Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5664673Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1962 counts during 1869 steps 2025-03-14T06:00:24.5664678Z 2025-03-14T06:00:24.5664889Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5665007Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5665433Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5665551Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5665770Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5665916Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5666141Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5666320Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5666691Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5667063Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5667425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5667705Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5668085Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5668398Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5668704Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5668831Z Execution Analysis: (:1) 2025-03-14T06:00:24.5669111Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5669313Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5669328Z 2025-03-14T06:00:24.5669528Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5669655Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5669890Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5670004Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5670223Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5670367Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5670525Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5670696Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5671402Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5671997Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5672357Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5672723Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5673038Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5673330Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5673639Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5673925Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5674037Z Execution Analysis: .......... 2025-03-14T06:00:24.5674311Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5674513Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5674819Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1963 counts during 1870 steps 2025-03-14T06:00:24.5674824Z 2025-03-14T06:00:24.5675029Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5675160Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5675457Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5675580Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5675787Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5675944Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5676090Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5676272Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5676632Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5676993Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5677308Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5677619Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5678060Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5678334Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5678620Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5678758Z Execution Analysis: (:1) 2025-03-14T06:00:24.5679012Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5679221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5679226Z 2025-03-14T06:00:24.5679424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5679655Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5679874Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5679992Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5680184Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5680328Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5680467Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5680656Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5681231Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5681774Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5682110Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5682451Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5682747Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5683015Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5683304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5683572Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5683674Z Execution Analysis: .......... 2025-03-14T06:00:24.5683928Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5684116Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5684403Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1964 counts during 1871 steps 2025-03-14T06:00:24.5684410Z 2025-03-14T06:00:24.5684660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5684784Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5685233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5685365Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5685575Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5685736Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5685881Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5686068Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5686432Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5686805Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5687123Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5687476Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5687786Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5688071Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5688371Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5688512Z Execution Analysis: (:1) 2025-03-14T06:00:24.5688774Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5688990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5688994Z 2025-03-14T06:00:24.5689210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5689331Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5689579Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5689692Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5689913Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5690060Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5690241Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5690436Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5691044Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5691619Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5691995Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5692354Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5692681Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5692956Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5693277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5693548Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5693669Z Execution Analysis: .......... 2025-03-14T06:00:24.5693932Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5694143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5694435Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1965 counts during 1872 steps 2025-03-14T06:00:24.5694443Z 2025-03-14T06:00:24.5694657Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5694769Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5695071Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5695182Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5695400Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5695549Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5695706Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5695876Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5696251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5696602Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5696974Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5697357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5697670Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5697937Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5698239Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5698363Z Execution Analysis: (:1) 2025-03-14T06:00:24.5698630Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5698829Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5698833Z 2025-03-14T06:00:24.5699045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5699159Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5699392Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5699502Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5699715Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5699901Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5700063Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5700228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5700816Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5701374Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5701738Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5702086Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5702405Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5702678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5702994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5703257Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5703376Z Execution Analysis: .......... 2025-03-14T06:00:24.5703628Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5703837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5704125Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1966 counts during 1873 steps 2025-03-14T06:00:24.5704142Z 2025-03-14T06:00:24.5704339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5704464Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5704750Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5704873Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5705071Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5705214Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5705367Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5705534Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5705895Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5706263Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5706605Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5706884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5707183Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5707562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5707834Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5707963Z Execution Analysis: (:1) 2025-03-14T06:00:24.5708202Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5708402Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5708409Z 2025-03-14T06:00:24.5708597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5708716Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5708931Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5709046Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5709282Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5709428Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5709564Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5709732Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5710283Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5710824Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5711163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5711502Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5711793Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5712063Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5712349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5712610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5712709Z Execution Analysis: .......... 2025-03-14T06:00:24.5712961Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5713150Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5713431Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1967 counts during 1874 steps 2025-03-14T06:00:24.5713436Z 2025-03-14T06:00:24.5713627Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5713748Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5714019Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5714134Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5714324Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5714468Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5714603Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5714770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5715143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5715504Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5715793Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5716060Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5716350Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5716611Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5716885Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5717015Z Execution Analysis: (:1) 2025-03-14T06:00:24.5717255Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5717463Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5717469Z 2025-03-14T06:00:24.5717655Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5717774Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5718009Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5718149Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5718342Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5718490Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5718628Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5718800Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5719350Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5719897Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5720234Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5720571Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5720866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5721133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5721420Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5721680Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5721780Z Execution Analysis: .......... 2025-03-14T06:00:24.5722033Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5722235Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5722504Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1968 counts during 1875 steps 2025-03-14T06:00:24.5722509Z 2025-03-14T06:00:24.5722713Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5722822Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5723106Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5723212Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5723417Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5723556Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5723705Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5723898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5724269Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5724686Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5725164Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5725447Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5725773Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5726049Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5726360Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5726487Z Execution Analysis: (:1) 2025-03-14T06:00:24.5726764Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5726973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5726977Z 2025-03-14T06:00:24.5727194Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5727341Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5727611Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5727727Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5727948Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5728096Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5728261Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5728435Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5729043Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5729624Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5730004Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5730360Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5730692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5730972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5731298Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5731575Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5731703Z Execution Analysis: .......... 2025-03-14T06:00:24.5731968Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5732188Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5732483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1969 counts during 1876 steps 2025-03-14T06:00:24.5732491Z 2025-03-14T06:00:24.5732709Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5732829Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5733137Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5733253Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5733476Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5733625Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5733810Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5734004Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5734373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5734727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5735059Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5735335Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5735656Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5735928Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5736232Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5736361Z Execution Analysis: (:1) 2025-03-14T06:00:24.5736636Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5736844Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5736848Z 2025-03-14T06:00:24.5737088Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5737337Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5737574Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5737684Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5737897Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5738040Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5738199Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5738365Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5738955Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5739519Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5739886Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5740245Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5740554Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5740838Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5741143Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5741423Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5741533Z Execution Analysis: .......... 2025-03-14T06:00:24.5741798Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5741999Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5742304Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1970 counts during 1877 steps 2025-03-14T06:00:24.5742308Z 2025-03-14T06:00:24.5742509Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5742637Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5742923Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5743048Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5743248Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5743430Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5743596Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5743774Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5744126Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5744487Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5744793Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5745074Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5745376Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5745655Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5745945Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5746085Z Execution Analysis: (:1) 2025-03-14T06:00:24.5746340Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5746720Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5746751Z 2025-03-14T06:00:24.5746978Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5747109Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5747343Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5747468Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5747674Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5747832Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5747981Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5748168Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5748760Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5749351Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5749717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5750080Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5750394Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5750684Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5750996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5751281Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5751390Z Execution Analysis: .......... 2025-03-14T06:00:24.5751660Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5751869Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5752172Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1971 counts during 1878 steps 2025-03-14T06:00:24.5752177Z 2025-03-14T06:00:24.5752380Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5752507Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5752798Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5752949Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5753155Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5753339Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5753484Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5753666Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5754028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5754398Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5754712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5754998Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5755308Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5755592Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5755891Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5756035Z Execution Analysis: (:1) 2025-03-14T06:00:24.5756296Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5756570Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5756574Z 2025-03-14T06:00:24.5756792Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5756908Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5757154Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5757264Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5757481Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5757629Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5757888Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5758066Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5758655Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5759300Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5759646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5759974Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5760280Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5760538Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5760841Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5761093Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5761207Z Execution Analysis: .......... 2025-03-14T06:00:24.5761451Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5761654Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5761928Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1972 counts during 1879 steps 2025-03-14T06:00:24.5761932Z 2025-03-14T06:00:24.5762132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5762244Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5762530Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5762684Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5762888Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5763024Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5763171Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5763332Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5763681Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5768949Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5769344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5769632Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5769955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5770237Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5770540Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5770670Z Execution Analysis: (:1) 2025-03-14T06:00:24.5771038Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5771280Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5771286Z 2025-03-14T06:00:24.5771497Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5771610Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5771846Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5771956Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5772169Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5772313Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5772466Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5772633Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5773245Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5773819Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5774187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5774539Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5774858Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5775138Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5775451Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5775719Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5775837Z Execution Analysis: .......... 2025-03-14T06:00:24.5776098Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5776306Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5776596Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1973 counts during 1880 steps 2025-03-14T06:00:24.5776602Z 2025-03-14T06:00:24.5776811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5776963Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5777434Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5777543Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5777857Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5777990Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5778132Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5778287Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5778625Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5778950Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5779249Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5779502Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5779795Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5780046Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5780325Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5780465Z Execution Analysis: (:1) 2025-03-14T06:00:24.5780736Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5780923Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5780936Z 2025-03-14T06:00:24.5781120Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5781222Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5781442Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5781544Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5781741Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5781872Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5782013Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5782165Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5782721Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5783254Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5783586Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5783917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5784207Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5784467Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5784750Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5785004Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5785103Z Execution Analysis: .......... 2025-03-14T06:00:24.5785349Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5785533Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5785809Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1974 counts during 1881 steps 2025-03-14T06:00:24.5785813Z 2025-03-14T06:00:24.5785997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5786156Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5786423Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5786530Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5786717Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5786856Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5786987Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5787154Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5787482Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5787812Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5788098Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5788358Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5788641Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5788896Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5789186Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5789330Z Execution Analysis: (:1) 2025-03-14T06:00:24.5789570Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5789765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5789769Z 2025-03-14T06:00:24.5789952Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5790068Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5790281Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5790393Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5790580Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5790723Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5790856Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5791023Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5791567Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5792105Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5792434Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5792771Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5793061Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5793320Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5793602Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5793861Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5793956Z Execution Analysis: .......... 2025-03-14T06:00:24.5794201Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5794386Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5794660Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1975 counts during 1882 steps 2025-03-14T06:00:24.5794688Z 2025-03-14T06:00:24.5795131Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5795248Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5795516Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5795629Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5795819Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5796128Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5796271Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5796443Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5796786Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5797136Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5797438Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5797716Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5798010Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5798318Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5798625Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5798756Z Execution Analysis: (:1) 2025-03-14T06:00:24.5799006Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5799214Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5799218Z 2025-03-14T06:00:24.5799421Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5799538Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5799771Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5799878Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5800088Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5800223Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5800376Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5800537Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5801118Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5801677Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5802033Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5802375Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5802683Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5802948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5803250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5803508Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5803616Z Execution Analysis: .......... 2025-03-14T06:00:24.5803862Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5804060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5804365Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1977 counts during 1883 steps 2025-03-14T06:00:24.5804393Z 2025-03-14T06:00:24.5804694Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5804803Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5805264Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5805376Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5805586Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5805728Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5805875Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5806040Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5806406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5806751Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5807073Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5807344Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5807655Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5807975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5808275Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5808397Z Execution Analysis: (:1) 2025-03-14T06:00:24.5808670Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5808874Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5808880Z 2025-03-14T06:00:24.5809096Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5809217Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5809462Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5809576Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5809798Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5809948Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5810112Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5810284Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5810891Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5811468Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5811846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5812202Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5812535Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5812816Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5813142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5813414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5813542Z Execution Analysis: .......... 2025-03-14T06:00:24.5813803Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5814024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5814368Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1978 counts during 1884 steps 2025-03-14T06:00:24.5814386Z 2025-03-14T06:00:24.5814593Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5814726Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5815025Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5815154Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5815365Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5815514Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5815679Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5815847Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5816225Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5816583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5816916Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5817311Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5817647Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5817912Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5818187Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5818323Z Execution Analysis: (:1) 2025-03-14T06:00:24.5818566Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5818772Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5818779Z 2025-03-14T06:00:24.5818970Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5819093Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5819311Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5819434Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5819632Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5819784Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5819924Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5820094Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5820644Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5821190Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5821526Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5821871Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5822168Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5822437Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5822724Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5822989Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5823091Z Execution Analysis: .......... 2025-03-14T06:00:24.5823345Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5823623Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5823906Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1979 counts during 1885 steps 2025-03-14T06:00:24.5823910Z 2025-03-14T06:00:24.5824100Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5824224Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5824493Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5824615Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5824807Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5824958Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5825091Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5825261Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5825595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5825937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5826228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5826540Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5826829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5827093Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5827367Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5827499Z Execution Analysis: (:1) 2025-03-14T06:00:24.5827741Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5827949Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5827953Z 2025-03-14T06:00:24.5828143Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5828266Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5828486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5828603Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5828796Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5828941Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5829078Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5829247Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5829795Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5830343Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5830677Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5831019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5831309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5831576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5831864Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5832129Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5832230Z Execution Analysis: .......... 2025-03-14T06:00:24.5832511Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5832747Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5833023Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1980 counts during 1886 steps 2025-03-14T06:00:24.5833028Z 2025-03-14T06:00:24.5833234Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5833346Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5833630Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5833737Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5833945Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5834082Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5834231Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5834392Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5834745Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5835076Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5835403Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5835684Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5835985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5836238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5836522Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5836641Z Execution Analysis: (:1) 2025-03-14T06:00:24.5836895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5837085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5837089Z 2025-03-14T06:00:24.5837290Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5837400Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5837628Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5837734Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5837936Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5838070Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5838221Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5838377Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5838936Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5839469Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5839817Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5840145Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5840449Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5840708Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5841007Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5841259Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5841421Z Execution Analysis: .......... 2025-03-14T06:00:24.5841662Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5841862Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5842134Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1981 counts during 1887 steps 2025-03-14T06:00:24.5842140Z 2025-03-14T06:00:24.5842342Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5842449Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5842730Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5842834Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5843039Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5843177Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5843325Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5843483Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5843828Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5844177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5844596Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5844858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5845337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5845609Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5845978Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5846111Z Execution Analysis: (:1) 2025-03-14T06:00:24.5846385Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5846588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5846593Z 2025-03-14T06:00:24.5846812Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5846930Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5847181Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5847296Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5847518Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5847665Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5847831Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5848005Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5848614Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5849189Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5849570Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5849937Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5850252Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5850541Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5850852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5851187Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5851298Z Execution Analysis: .......... 2025-03-14T06:00:24.5851567Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5851774Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5852085Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1982 counts during 1888 steps 2025-03-14T06:00:24.5852090Z 2025-03-14T06:00:24.5852296Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5852427Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5852722Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5852850Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5853060Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5853223Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5853365Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5853539Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5853897Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5854303Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5854615Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5854899Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5855208Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5855484Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5855779Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5855912Z Execution Analysis: (:1) 2025-03-14T06:00:24.5856172Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5856385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5856389Z 2025-03-14T06:00:24.5856595Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5856716Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5856949Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5857065Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5857379Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5857526Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5857672Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5857849Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5858524Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5859064Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5859394Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5859730Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5860023Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5860287Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5860597Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5860877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5860976Z Execution Analysis: .......... 2025-03-14T06:00:24.5861216Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5861403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5861680Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1983 counts during 1889 steps 2025-03-14T06:00:24.5861684Z 2025-03-14T06:00:24.5861870Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5861982Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5862247Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5862357Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5862546Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5862691Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5862821Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5862985Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5863359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5863695Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5863981Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5864239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5864520Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5864776Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5865046Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5865169Z Execution Analysis: (:1) 2025-03-14T06:00:24.5865532Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5865905Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5865910Z 2025-03-14T06:00:24.5866113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5866229Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5866473Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5866581Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5866781Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5866934Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5867080Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5867257Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5867843Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5868425Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5868789Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5869138Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5869454Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5869794Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5870140Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5870409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5870525Z Execution Analysis: .......... 2025-03-14T06:00:24.5870784Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5870993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5871281Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1984 counts during 1890 steps 2025-03-14T06:00:24.5871286Z 2025-03-14T06:00:24.5871494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5871606Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5871906Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5872017Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5872229Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5872371Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5872519Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5872753Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5873120Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5873467Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5873782Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5874055Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5874370Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5874643Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5874943Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5875070Z Execution Analysis: (:1) 2025-03-14T06:00:24.5875339Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5875541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5875545Z 2025-03-14T06:00:24.5875757Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5875871Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5876110Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5876224Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5876437Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5876583Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5876735Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5876906Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5877505Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5878175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5878629Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5878957Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5879277Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5879555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5879846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5880095Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5880202Z Execution Analysis: .......... 2025-03-14T06:00:24.5880439Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5880631Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5880901Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1985 counts during 1891 steps 2025-03-14T06:00:24.5880905Z 2025-03-14T06:00:24.5881094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5881202Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5881480Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5881585Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5881777Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5881911Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5882094Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5882252Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5882589Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5882910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5883204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5883458Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5883751Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5883997Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5884275Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5884396Z Execution Analysis: (:1) 2025-03-14T06:00:24.5884699Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5885063Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5885068Z 2025-03-14T06:00:24.5885270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5885390Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5885653Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5885772Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5885974Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5886121Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5886267Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5886441Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5887035Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5887609Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5887970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5888322Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5888686Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5888962Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5889270Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5889556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5890107Z Execution Analysis: .......... 2025-03-14T06:00:24.5890573Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5891162Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5891783Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1986 counts during 1892 steps 2025-03-14T06:00:24.5892198Z 2025-03-14T06:00:24.5892411Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5892858Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5893362Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5893887Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5894310Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5894799Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5895198Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5895684Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5896326Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5897157Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5897942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5898653Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5899353Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5900050Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5900739Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5901282Z Execution Analysis: (:1) 2025-03-14T06:00:24.5901768Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5902351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5902682Z 2025-03-14T06:00:24.5902893Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5903325Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5903769Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5904230Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5904636Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5905094Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5905503Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5905930Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5906799Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5908191Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5909213Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5910074Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5910843Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5911534Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5912224Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5912909Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5913393Z Execution Analysis: .......... 2025-03-14T06:00:24.5913840Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5914406Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5915003Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1987 counts during 1893 steps 2025-03-14T06:00:24.5915413Z 2025-03-14T06:00:24.5915607Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5916034Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5916522Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5917058Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5917495Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5917948Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5918337Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5918751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5919376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5920189Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5920958Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5921655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5922339Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5923024Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5923692Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5924208Z Execution Analysis: (:1) 2025-03-14T06:00:24.5924776Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5925523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5925924Z 2025-03-14T06:00:24.5926127Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5926575Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5927019Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5927478Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5927886Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5928350Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5928753Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5929180Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5930055Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5931336Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5932419Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5933279Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5934067Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5934786Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5935497Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5936196Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5936693Z Execution Analysis: .......... 2025-03-14T06:00:24.5937251Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5937785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5938356Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1988 counts during 1894 steps 2025-03-14T06:00:24.5938734Z 2025-03-14T06:00:24.5938932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5939356Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5939839Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5940355Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5940738Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5941171Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5941547Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5941946Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5942543Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5943322Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5944058Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5944722Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5945382Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5946034Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5946675Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5947188Z Execution Analysis: (:1) 2025-03-14T06:00:24.5947649Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5948197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5948507Z 2025-03-14T06:00:24.5948699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5949108Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5949519Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5949949Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5950324Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5950755Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5951127Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5951524Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5952336Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5953519Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5954540Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5955307Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5956041Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5956702Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5957359Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5958006Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5958471Z Execution Analysis: .......... 2025-03-14T06:00:24.5958895Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5959439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5960004Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1989 counts during 1895 steps 2025-03-14T06:00:24.5960384Z 2025-03-14T06:00:24.5960584Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5961007Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5961499Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5961986Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5962365Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5962795Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5963167Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5963562Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5964153Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5965188Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5966118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5966839Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5967546Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5968252Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5968941Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5969483Z Execution Analysis: (:1) 2025-03-14T06:00:24.5969976Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5970563Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5970886Z 2025-03-14T06:00:24.5971095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5971532Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5971977Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5972442Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5972852Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5973311Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5973716Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5974146Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5975021Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5976370Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.5977568Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.5978386Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5979155Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5979848Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5980536Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5981220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5981709Z Execution Analysis: .......... 2025-03-14T06:00:24.5982144Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5982712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5983319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1990 counts during 1896 steps 2025-03-14T06:00:24.5983728Z 2025-03-14T06:00:24.5983990Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5984424Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5984918Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.5985428Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5985826Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.5986278Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.5986666Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.5987084Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5987803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.5988577Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.5989309Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.5989970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.5990625Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.5991272Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.5991910Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.5992412Z Execution Analysis: (:1) 2025-03-14T06:00:24.5992869Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.5993416Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5993714Z 2025-03-14T06:00:24.5993912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.5994324Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.5994746Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.5995181Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.5995561Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.5996156Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.5996551Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.5996970Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.5997828Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.5999134Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6000163Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6000982Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6001754Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6002448Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6003135Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6003821Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6004300Z Execution Analysis: .......... 2025-03-14T06:00:24.6004828Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6005571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6006189Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1991 counts during 1897 steps 2025-03-14T06:00:24.6006652Z 2025-03-14T06:00:24.6006884Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6007326Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6007830Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6008351Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6008758Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6009220Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6009623Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6010050Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6010692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6011523Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6012312Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6013025Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6013727Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6014425Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6015113Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6015656Z Execution Analysis: (:1) 2025-03-14T06:00:24.6016149Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6016844Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6017142Z 2025-03-14T06:00:24.6017343Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6017753Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6018164Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6018589Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6018966Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6019395Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6019767Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6020160Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6020995Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6022206Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6023179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6023951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6024682Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6025342Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6025994Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6026635Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6027098Z Execution Analysis: .......... 2025-03-14T06:00:24.6027520Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6028057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6028677Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1992 counts during 1898 steps 2025-03-14T06:00:24.6029068Z 2025-03-14T06:00:24.6029255Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6029660Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6030126Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6030618Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6030998Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6031432Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6031802Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6032196Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6032794Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6033756Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6034518Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6035211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6035896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6036580Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6037249Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6037779Z Execution Analysis: (:1) 2025-03-14T06:00:24.6038261Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6038825Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6039137Z 2025-03-14T06:00:24.6039349Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6039777Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6040204Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6040663Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6041069Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6041526Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6041922Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6042380Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6043250Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6044602Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6045825Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6046670Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6047469Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6048177Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6048890Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6049606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6050116Z Execution Analysis: .......... 2025-03-14T06:00:24.6050576Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6051215Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6051845Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1993 counts during 1899 steps 2025-03-14T06:00:24.6052270Z 2025-03-14T06:00:24.6052474Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6052927Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6053441Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6053969Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6054385Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6054850Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6055250Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6055675Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6056320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6057155Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6057998Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6058660Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6059314Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6059965Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6060605Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6061107Z Execution Analysis: (:1) 2025-03-14T06:00:24.6061568Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6062115Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6062414Z 2025-03-14T06:00:24.6062611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6063024Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6063437Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6063867Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6064248Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6064716Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6065119Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6065808Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6066695Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6067994Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6069052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6069898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6070695Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6071416Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6072125Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6072827Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6073332Z Execution Analysis: .......... 2025-03-14T06:00:24.6073846Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6074469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6075104Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1994 counts during 1900 steps 2025-03-14T06:00:24.6075525Z 2025-03-14T06:00:24.6075729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6076172Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6076682Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6077210Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6077618Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6078279Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6078652Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6079048Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6079650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6080418Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6081151Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6081810Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6082463Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6083124Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6083761Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6084267Z Execution Analysis: (:1) 2025-03-14T06:00:24.6084790Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6085539Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6085865Z 2025-03-14T06:00:24.6086080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6086532Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6086979Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6087450Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6087975Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6088496Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6088892Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6089328Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6090218Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6091516Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6092575Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6093413Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6094209Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6094935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6095645Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6096349Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6096854Z Execution Analysis: .......... 2025-03-14T06:00:24.6097467Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6098040Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6098659Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1995 counts during 1901 steps 2025-03-14T06:00:24.6099071Z 2025-03-14T06:00:24.6099270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6099705Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6100205Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6100721Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6101130Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6101589Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6101986Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6102406Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6103041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6103858Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6104629Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6105326Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6106018Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6106706Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6107480Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6107985Z Execution Analysis: (:1) 2025-03-14T06:00:24.6108450Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6108994Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6109295Z 2025-03-14T06:00:24.6109493Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6109904Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6110324Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6110782Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6111189Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6111611Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6111989Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6112389Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6113201Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6114386Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6115359Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6116132Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6116864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6117525Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6118364Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6119076Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6119595Z Execution Analysis: .......... 2025-03-14T06:00:24.6120042Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6120611Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6121216Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1996 counts during 1902 steps 2025-03-14T06:00:24.6121622Z 2025-03-14T06:00:24.6121823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6122260Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6122761Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6123273Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6123672Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6124125Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6124582Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6125176Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6125823Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6126682Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6127472Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6128194Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6128907Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6129611Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6130298Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6130846Z Execution Analysis: (:1) 2025-03-14T06:00:24.6131344Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6131926Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6132250Z 2025-03-14T06:00:24.6132462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6132908Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6133390Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6133881Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6134277Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6134749Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6135159Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6135595Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6136474Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6137756Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6138909Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6139727Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6140671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6141390Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6142123Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6142855Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6143361Z Execution Analysis: .......... 2025-03-14T06:00:24.6143823Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6144403Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6145025Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1998 counts during 1903 steps 2025-03-14T06:00:24.6145444Z 2025-03-14T06:00:24.6145650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6146095Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6146602Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6147138Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6147560Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6148038Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6148447Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6148884Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6149537Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6150381Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6151184Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6152006Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6152793Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6153455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6154104Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6154617Z Execution Analysis: (:1) 2025-03-14T06:00:24.6155084Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6155632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6155934Z 2025-03-14T06:00:24.6156132Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6156603Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6157023Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6157463Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6157835Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6158264Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6158649Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6159051Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6159865Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6161051Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6162026Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6162806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6163543Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6164211Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6165178Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6166014Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6166519Z Execution Analysis: .......... 2025-03-14T06:00:24.6166979Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6167568Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6168198Z pt-xla-profiler: TransferFromDeviceTime too frequent: 1999 counts during 1904 steps 2025-03-14T06:00:24.6168624Z 2025-03-14T06:00:24.6168828Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6169275Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6169786Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6170316Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6170729Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6171203Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6171609Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6172042Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6172692Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6173534Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6174335Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6175056Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6175769Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6176482Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6177284Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6177907Z Execution Analysis: (:1) 2025-03-14T06:00:24.6178372Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6178917Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6179292Z 2025-03-14T06:00:24.6179495Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6179948Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6180366Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6180791Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6181179Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6181617Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6181999Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6182402Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6183214Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6184402Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6185383Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6186163Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6186900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6187617Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6188284Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6188941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6189406Z Execution Analysis: .......... 2025-03-14T06:00:24.6189839Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6190387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6190972Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2000 counts during 1905 steps 2025-03-14T06:00:24.6191367Z 2025-03-14T06:00:24.6191557Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6191975Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6192454Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6192558Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6192760Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6192894Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6193038Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6193196Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6193541Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6193874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6194172Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6194431Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6200259Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6200556Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6200855Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6200978Z Execution Analysis: (:1) 2025-03-14T06:00:24.6201246Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6201442Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6201562Z 2025-03-14T06:00:24.6201761Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6201870Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6202105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6202215Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6202430Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6202571Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6202720Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6202884Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6203479Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6204043Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6204398Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6204867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6205406Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6205688Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6205997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6206273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6206378Z Execution Analysis: .......... 2025-03-14T06:00:24.6206641Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6206847Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6207145Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2001 counts during 1906 steps 2025-03-14T06:00:24.6207151Z 2025-03-14T06:00:24.6207357Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6207480Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6207772Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6207888Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6208090Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6208236Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6208378Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6208551Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6208909Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6209264Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6209575Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6209863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6210167Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6210442Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6210731Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6210861Z Execution Analysis: (:1) 2025-03-14T06:00:24.6211116Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6211369Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6211373Z 2025-03-14T06:00:24.6211571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6211690Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6211922Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6212042Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6212243Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6212392Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6212535Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6212705Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6213299Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6213886Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6214243Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6214649Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6214962Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6215238Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6215540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6215811Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6215914Z Execution Analysis: .......... 2025-03-14T06:00:24.6216176Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6216375Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6216667Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2002 counts during 1907 steps 2025-03-14T06:00:24.6216672Z 2025-03-14T06:00:24.6216873Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6216988Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6217367Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6217471Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6217655Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6217793Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6217922Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6218084Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6218415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6218743Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6219030Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6219292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6219573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6219824Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6220090Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6220213Z Execution Analysis: (:1) 2025-03-14T06:00:24.6220739Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6220957Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6220961Z 2025-03-14T06:00:24.6221149Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6221256Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6221483Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6221585Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6221782Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6221914Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6222057Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6222212Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6222768Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6223300Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6223661Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6224019Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6224314Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6224566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6224854Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6225100Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6225208Z Execution Analysis: .......... 2025-03-14T06:00:24.6225445Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6225640Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6225911Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2003 counts during 1908 steps 2025-03-14T06:00:24.6225918Z 2025-03-14T06:00:24.6226111Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6226219Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6226489Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6226590Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6226783Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6226913Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6227053Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6227210Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6227546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6228037Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6228345Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6228607Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6228908Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6229164Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6229449Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6229592Z Execution Analysis: (:1) 2025-03-14T06:00:24.6229877Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6230073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6230077Z 2025-03-14T06:00:24.6230279Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6230387Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6230618Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6230725Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6230928Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6231064Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6231213Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6231378Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6231961Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6232518Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6232924Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6233262Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6233575Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6233840Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6234151Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6234411Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6234523Z Execution Analysis: .......... 2025-03-14T06:00:24.6234772Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6234971Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6235254Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2004 counts during 1909 steps 2025-03-14T06:00:24.6235263Z 2025-03-14T06:00:24.6235454Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6235569Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6235848Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6235953Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6236155Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6236296Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6236438Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6236601Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6236954Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6237297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6237603Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6237870Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6238166Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6238430Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6238736Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6238885Z Execution Analysis: (:1) 2025-03-14T06:00:24.6239133Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6239333Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6239338Z 2025-03-14T06:00:24.6239537Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6239661Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6239992Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6240111Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6240306Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6240452Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6240591Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6240926Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6241501Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6242120Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6242476Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6242833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6243141Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6243422Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6243726Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6244007Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6244115Z Execution Analysis: .......... 2025-03-14T06:00:24.6244381Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6244679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6245147Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2005 counts during 1910 steps 2025-03-14T06:00:24.6245152Z 2025-03-14T06:00:24.6245358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6245489Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6245782Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6245913Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6246124Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6246287Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6246434Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6246620Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6246986Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6247355Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6247671Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6247965Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6248275Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6248590Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6248909Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6249054Z Execution Analysis: (:1) 2025-03-14T06:00:24.6249316Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6249540Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6249544Z 2025-03-14T06:00:24.6249753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6249881Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6250115Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6250244Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6250451Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6250611Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6250764Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6250950Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6251541Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6252182Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6252546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6252919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6253236Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6253530Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6253840Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6254126Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6254233Z Execution Analysis: .......... 2025-03-14T06:00:24.6254510Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6254729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6255022Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2006 counts during 1911 steps 2025-03-14T06:00:24.6255026Z 2025-03-14T06:00:24.6255243Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6255361Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6255666Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6255782Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6255997Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6256144Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6256301Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6256472Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6256846Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6257203Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6257533Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6257809Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6258154Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6258561Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6258858Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6258982Z Execution Analysis: (:1) 2025-03-14T06:00:24.6259256Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6259455Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6259460Z 2025-03-14T06:00:24.6259676Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6259791Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6260031Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6260142Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6260358Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6260503Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6260663Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6260826Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6261473Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6262039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6262405Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6262748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6263069Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6263339Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6263651Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6264013Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6264127Z Execution Analysis: .......... 2025-03-14T06:00:24.6264367Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6264564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6264835Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2007 counts during 1912 steps 2025-03-14T06:00:24.6264840Z 2025-03-14T06:00:24.6265039Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6265153Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6265567Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6265845Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6266069Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6266219Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6266384Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6266557Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6266931Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6267286Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6267615Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6267891Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6268313Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6268586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6268896Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6269029Z Execution Analysis: (:1) 2025-03-14T06:00:24.6269308Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6269513Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6269518Z 2025-03-14T06:00:24.6269737Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6269855Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6270105Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6270221Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6270442Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6270587Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6270748Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6270919Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6271589Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6272165Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6272539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6272905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6273226Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6273514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6273823Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6274112Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6274222Z Execution Analysis: .......... 2025-03-14T06:00:24.6274493Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6274697Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6275003Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2008 counts during 1913 steps 2025-03-14T06:00:24.6275008Z 2025-03-14T06:00:24.6275212Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6275342Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6275634Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6275761Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6275967Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6276129Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6276273Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6276454Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6276814Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6277178Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6277597Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6278037Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6278325Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6278587Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6278863Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6278993Z Execution Analysis: (:1) 2025-03-14T06:00:24.6279233Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6279433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6279438Z 2025-03-14T06:00:24.6279624Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6279748Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6279965Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6280081Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6280269Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6280416Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6280576Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6280771Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6281322Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6281872Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6282206Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6282550Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6282844Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6283113Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6283403Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6283668Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6283770Z Execution Analysis: .......... 2025-03-14T06:00:24.6284023Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6284210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6284550Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2009 counts during 1914 steps 2025-03-14T06:00:24.6284563Z 2025-03-14T06:00:24.6284756Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6284880Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6285336Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6285464Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6285674Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6285834Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6285980Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6286165Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6286529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6286888Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6287235Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6287538Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6287846Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6288123Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6288416Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6288547Z Execution Analysis: (:1) 2025-03-14T06:00:24.6288806Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6289014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6289019Z 2025-03-14T06:00:24.6289227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6289341Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6289577Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6289690Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6289891Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6290064Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6290234Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6290409Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6291001Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6291579Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6291946Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6292297Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6292618Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6292893Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6293209Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6293478Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6293593Z Execution Analysis: .......... 2025-03-14T06:00:24.6293850Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6294057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6294348Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2010 counts during 1915 steps 2025-03-14T06:00:24.6294355Z 2025-03-14T06:00:24.6294564Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6294676Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6294977Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6295087Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6295299Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6295439Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6295587Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6295751Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6296113Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6296493Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6296854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6297237Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6297549Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6297810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6298099Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6298217Z Execution Analysis: (:1) 2025-03-14T06:00:24.6298477Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6298671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6298677Z 2025-03-14T06:00:24.6298881Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6298987Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6299216Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6299320Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6299547Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6299775Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6299925Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6300084Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6300664Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6301218Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6301577Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6301916Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6302228Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6302495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6302799Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6303059Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6303167Z Execution Analysis: .......... 2025-03-14T06:00:24.6303415Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6303618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6303901Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2011 counts during 1916 steps 2025-03-14T06:00:24.6303906Z 2025-03-14T06:00:24.6304108Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6304221Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6304514Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6304619Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6304824Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6304962Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6305107Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6305269Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6305620Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6306006Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6306316Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6306583Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6306889Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6307150Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6307544Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6307661Z Execution Analysis: (:1) 2025-03-14T06:00:24.6307902Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6308095Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6308100Z 2025-03-14T06:00:24.6308283Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6308392Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6308604Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6308754Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6308943Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6309081Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6309217Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6309378Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6309926Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6310465Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6310799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6311129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6311418Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6311678Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6311962Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6312219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6312315Z Execution Analysis: .......... 2025-03-14T06:00:24.6312561Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6312749Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6313025Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2012 counts during 1917 steps 2025-03-14T06:00:24.6313030Z 2025-03-14T06:00:24.6313216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6313333Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6313600Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6313713Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6313897Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6314035Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6314164Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6314353Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6314704Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6315036Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6315323Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6315587Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6315869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6316124Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6316393Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6316514Z Execution Analysis: (:1) 2025-03-14T06:00:24.6316750Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6316949Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6316954Z 2025-03-14T06:00:24.6317139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6317253Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6317506Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6317620Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6317808Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6317946Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6318079Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6318239Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6318784Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6319330Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6319660Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6319996Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6320284Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6320544Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6320827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6321081Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6321187Z Execution Analysis: .......... 2025-03-14T06:00:24.6321434Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6321618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6321895Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2013 counts during 1918 steps 2025-03-14T06:00:24.6321902Z 2025-03-14T06:00:24.6322097Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6322204Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6322475Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6322575Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6322766Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6322899Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6323058Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6323243Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6323572Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6323900Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6324199Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6324451Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6324808Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6325238Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6325537Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6325661Z Execution Analysis: (:1) 2025-03-14T06:00:24.6325926Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6326128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6326132Z 2025-03-14T06:00:24.6326370Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6326515Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6326752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6326860Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6327068Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6327208Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6327361Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6327527Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6328128Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6328704Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6329073Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6329422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6329743Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6330016Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6330334Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6330603Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6330719Z Execution Analysis: .......... 2025-03-14T06:00:24.6330976Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6331188Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6331481Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2014 counts during 1919 steps 2025-03-14T06:00:24.6331487Z 2025-03-14T06:00:24.6331699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6331810Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6332108Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6332215Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6332426Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6332606Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6332781Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6332947Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6333313Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6333667Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6333988Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6334261Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6334575Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6334843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6335143Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6335267Z Execution Analysis: (:1) 2025-03-14T06:00:24.6335531Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6335731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6335736Z 2025-03-14T06:00:24.6335988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6336101Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6336340Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6336447Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6336655Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6336798Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6336952Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6337228Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6337781Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6338311Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6338652Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6338977Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6339273Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6339527Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6339818Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6340075Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6340172Z Execution Analysis: .......... 2025-03-14T06:00:24.6340417Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6340605Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6340880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2015 counts during 1920 steps 2025-03-14T06:00:24.6340884Z 2025-03-14T06:00:24.6341069Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6341183Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6341452Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6341559Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6341770Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6341934Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6342064Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6342225Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6342553Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6342885Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6343170Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6343430Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6343711Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6343964Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6344235Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6344358Z Execution Analysis: (:1) 2025-03-14T06:00:24.6344594Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6344813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6344837Z 2025-03-14T06:00:24.6345021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6345132Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6345340Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6345446Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6345631Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6345765Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6345900Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6346064Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6346605Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6347145Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6347474Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6347977Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6348276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6348548Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6348845Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6349111Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6349212Z Execution Analysis: .......... 2025-03-14T06:00:24.6349477Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6349672Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6349963Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2016 counts during 1921 steps 2025-03-14T06:00:24.6349968Z 2025-03-14T06:00:24.6350160Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6350282Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6350560Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6350726Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6350920Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6351071Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6351207Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6351381Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6351729Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6352079Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6352383Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6352657Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6352953Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6353225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6353511Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6353644Z Execution Analysis: (:1) 2025-03-14T06:00:24.6353918Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6354146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6354150Z 2025-03-14T06:00:24.6354348Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6354465Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6354690Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6354800Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6355000Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6355150Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6355289Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6355459Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6356034Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6356602Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6356961Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6357305Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6357616Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6357884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6358194Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6358454Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6358560Z Execution Analysis: .......... 2025-03-14T06:00:24.6358813Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6359014Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6359298Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2017 counts during 1922 steps 2025-03-14T06:00:24.6359303Z 2025-03-14T06:00:24.6359506Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6359722Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6360017Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6360141Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6360334Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6360466Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6360598Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6360753Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6361092Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6361413Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6361705Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6361955Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6362244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6362492Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6362768Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6362881Z Execution Analysis: (:1) 2025-03-14T06:00:24.6363172Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6363356Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6363360Z 2025-03-14T06:00:24.6363548Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6363652Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6363871Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6363972Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6364169Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6364300Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6364444Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6364677Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6365539Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6366109Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6366480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6366829Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6367153Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6367426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6367737Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6368008Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6368125Z Execution Analysis: .......... 2025-03-14T06:00:24.6368381Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6368593Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6368879Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2019 counts during 1923 steps 2025-03-14T06:00:24.6368884Z 2025-03-14T06:00:24.6369093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6369297Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6369594Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6369704Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6369919Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6370064Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6370216Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6370385Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6370754Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6371104Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6371425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6371700Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6372020Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6372289Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6372631Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6372791Z Execution Analysis: (:1) 2025-03-14T06:00:24.6373057Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6373260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6373275Z 2025-03-14T06:00:24.6373477Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6373602Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6373834Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6373952Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6374159Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6374311Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6374460Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6374626Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6375235Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6375822Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6376183Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6376545Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6376861Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6377254Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6377657Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6377914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6378014Z Execution Analysis: .......... 2025-03-14T06:00:24.6378261Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6378452Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6378726Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2020 counts during 1924 steps 2025-03-14T06:00:24.6378755Z 2025-03-14T06:00:24.6378944Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6379079Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6379348Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6379454Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6379645Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6379787Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6379917Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6380081Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6380409Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6380741Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6381028Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6381290Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6381571Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6381828Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6382141Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6382267Z Execution Analysis: (:1) 2025-03-14T06:00:24.6382504Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6382699Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6382703Z 2025-03-14T06:00:24.6382886Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6383005Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6383221Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6383330Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6383516Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6383656Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6383793Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6383954Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6384501Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6385042Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6385376Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6385713Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6385999Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6386261Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6386548Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6386806Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6386901Z Execution Analysis: .......... 2025-03-14T06:00:24.6387149Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6387336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6387641Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2021 counts during 1925 steps 2025-03-14T06:00:24.6387668Z 2025-03-14T06:00:24.6387853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6387965Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6388233Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6388344Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6388535Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6388672Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6388803Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6388963Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6389288Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6389618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6389908Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6390171Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6390453Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6390754Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6391033Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6391146Z Execution Analysis: (:1) 2025-03-14T06:00:24.6391388Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6391577Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6391581Z 2025-03-14T06:00:24.6391777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6391888Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6392109Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6392212Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6392411Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6392546Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6392684Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6392841Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6393395Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6393923Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6394266Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6394589Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6394884Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6395139Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6395435Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6395682Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6395787Z Execution Analysis: .......... 2025-03-14T06:00:24.6396189Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6396394Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6396724Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2022 counts during 1926 steps 2025-03-14T06:00:24.6396728Z 2025-03-14T06:00:24.6396929Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6397039Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6397333Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6397439Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6397648Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6397790Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6397935Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6398096Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6398452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6398795Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6399110Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6399376Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6399739Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6400000Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6400291Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6400412Z Execution Analysis: (:1) 2025-03-14T06:00:24.6400669Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6400866Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6400873Z 2025-03-14T06:00:24.6401078Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6401185Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6401415Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6401521Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6401730Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6401868Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6402016Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6402182Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6402772Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6403329Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6403693Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6404035Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6404353Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6404707Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6405183Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6405453Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6405631Z Execution Analysis: .......... 2025-03-14T06:00:24.6405888Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6406128Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6406443Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2023 counts during 1927 steps 2025-03-14T06:00:24.6406460Z 2025-03-14T06:00:24.6406660Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6406786Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6407072Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6407192Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6407392Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6407545Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6407685Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6407861Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6408221Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6408582Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6408895Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6409205Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6409534Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6409807Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6410098Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6410230Z Execution Analysis: (:1) 2025-03-14T06:00:24.6410491Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6410698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6410704Z 2025-03-14T06:00:24.6410904Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6411023Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6411254Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6411370Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6411574Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6411724Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6411872Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6412049Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6412641Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6413223Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6413583Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6413942Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6414257Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6414539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6414848Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6415129Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6415237Z Execution Analysis: .......... 2025-03-14T06:00:24.6415525Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6415755Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6416055Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2024 counts during 1928 steps 2025-03-14T06:00:24.6416060Z 2025-03-14T06:00:24.6416266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6416387Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6416678Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6416796Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6417000Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6417260Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6417391Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6417555Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6417891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6418223Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6418535Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6418817Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6419098Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6419353Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6419620Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6419747Z Execution Analysis: (:1) 2025-03-14T06:00:24.6419988Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6420186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6420191Z 2025-03-14T06:00:24.6420377Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6420496Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6420713Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6420824Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6421017Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6421156Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6421291Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6421453Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6422002Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6422541Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6422874Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6423208Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6423501Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6423755Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6424045Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6424292Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6424448Z Execution Analysis: .......... 2025-03-14T06:00:24.6424686Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6424879Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6425148Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2025 counts during 1929 steps 2025-03-14T06:00:24.6425152Z 2025-03-14T06:00:24.6425347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6425448Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6425722Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6425822Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6426015Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6426147Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6426287Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6426444Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6426783Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6427107Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6427444Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6427695Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6427985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6428234Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6428511Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6428628Z Execution Analysis: (:1) 2025-03-14T06:00:24.6428878Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6429063Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6429067Z 2025-03-14T06:00:24.6429262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6429364Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6429580Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6429680Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6429875Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6430008Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6430152Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6430311Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6430860Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6431392Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6431733Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6432057Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6432355Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6432608Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6432898Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6433173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6433310Z Execution Analysis: .......... 2025-03-14T06:00:24.6433549Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6433740Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6434013Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2026 counts during 1930 steps 2025-03-14T06:00:24.6434018Z 2025-03-14T06:00:24.6434212Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6434319Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6434595Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6434697Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6434893Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6435030Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6435177Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6435334Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6435677Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6436051Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6436344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6436595Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6436884Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6437132Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6437411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6437533Z Execution Analysis: (:1) 2025-03-14T06:00:24.6437777Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6437964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6437978Z 2025-03-14T06:00:24.6438161Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6438267Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6438486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6438591Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6438789Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6438919Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6439062Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6439217Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6439766Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6440307Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6440636Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6440971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6441257Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6441518Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6441823Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6442102Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6442197Z Execution Analysis: .......... 2025-03-14T06:00:24.6442442Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6442629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6442902Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2027 counts during 1931 steps 2025-03-14T06:00:24.6442907Z 2025-03-14T06:00:24.6443091Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6443208Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6443477Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6443590Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6443780Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6443922Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6444055Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6444217Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6444751Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6445266Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6445577Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6445857Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6446163Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6446440Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6446736Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6446869Z Execution Analysis: (:1) 2025-03-14T06:00:24.6447126Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6447336Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6447340Z 2025-03-14T06:00:24.6447542Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6447660Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6447889Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6448007Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6448213Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6448363Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6448512Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6448689Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6449276Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6449861Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6450218Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6450576Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6450887Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6451191Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6451531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6451812Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6451916Z Execution Analysis: .......... 2025-03-14T06:00:24.6452185Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6452385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6452681Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2028 counts during 1932 steps 2025-03-14T06:00:24.6452686Z 2025-03-14T06:00:24.6452887Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6453020Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6453315Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6453445Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6453651Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6453805Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6453948Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6454153Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6454539Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6454900Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6455214Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6455495Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6455804Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6456090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6456383Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6456519Z Execution Analysis: (:1) 2025-03-14T06:00:24.6456782Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6456993Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6456998Z 2025-03-14T06:00:24.6457310Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6457417Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6457640Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6457744Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6457948Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6458085Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6458231Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6458389Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6458944Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6459474Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6459815Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6460144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6460442Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6460738Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6461032Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6461283Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6461394Z Execution Analysis: .......... 2025-03-14T06:00:24.6461637Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6461830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6462099Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2029 counts during 1933 steps 2025-03-14T06:00:24.6462103Z 2025-03-14T06:00:24.6462299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6462407Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6462686Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6462786Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6462985Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6463118Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6463284Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6463466Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6463804Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6464129Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6464426Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6464679Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6464974Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6465225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6465813Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6465944Z Execution Analysis: (:1) 2025-03-14T06:00:24.6466209Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6466413Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6466417Z 2025-03-14T06:00:24.6466632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6466749Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6466984Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6467099Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6467315Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6467460Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6467615Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6467785Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6468384Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6468955Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6469323Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6469678Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6470102Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6470378Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6470695Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6470969Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6471086Z Execution Analysis: .......... 2025-03-14T06:00:24.6471345Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6471558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6471849Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2030 counts during 1934 steps 2025-03-14T06:00:24.6471864Z 2025-03-14T06:00:24.6472066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6472191Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6472479Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6472601Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6472804Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6473017Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6473175Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6473345Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6473711Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6474066Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6474389Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6474671Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6474983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6475266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6475567Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6475705Z Execution Analysis: (:1) 2025-03-14T06:00:24.6475966Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6476180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6476184Z 2025-03-14T06:00:24.6476387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6476511Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6476745Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6476866Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6477070Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6477223Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6477371Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6477553Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6478342Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6478879Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6479211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6479569Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6479883Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6480145Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6480435Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6480693Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6480792Z Execution Analysis: .......... 2025-03-14T06:00:24.6481038Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6481225Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6481500Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2031 counts during 1935 steps 2025-03-14T06:00:24.6481507Z 2025-03-14T06:00:24.6481695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6481807Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6482077Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6482190Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6482426Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6482563Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6482697Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6482859Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6483189Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6483521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6483809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6484068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6484352Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6484674Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6485116Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6485254Z Execution Analysis: (:1) 2025-03-14T06:00:24.6485514Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6485723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6485727Z 2025-03-14T06:00:24.6485928Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6486053Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6486286Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6486406Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6486610Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6486765Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6486914Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6487089Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6487680Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6488258Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6488647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6489033Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6489341Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6489626Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6489937Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6490218Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6490326Z Execution Analysis: .......... 2025-03-14T06:00:24.6490597Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6490813Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6491107Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2032 counts during 1936 steps 2025-03-14T06:00:24.6491113Z 2025-03-14T06:00:24.6491330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6491445Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6491766Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6491899Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6492111Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6492253Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6492405Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6492574Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6492938Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6493289Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6493608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6493886Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6494204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6494474Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6494778Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6494906Z Execution Analysis: (:1) 2025-03-14T06:00:24.6495175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6495379Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6495385Z 2025-03-14T06:00:24.6495597Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6495715Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6495957Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6496075Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6496294Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6496443Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6496601Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6496771Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6497477Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6498039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6498464Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6498806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6499127Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6499398Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6499716Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6499980Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6500089Z Execution Analysis: .......... 2025-03-14T06:00:24.6500342Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6500558Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6500845Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2033 counts during 1937 steps 2025-03-14T06:00:24.6500850Z 2025-03-14T06:00:24.6501066Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6501184Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6501538Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6501648Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6501858Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6501999Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6502145Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6502311Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6502677Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6503026Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6503344Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6503610Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6503922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6504182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6504483Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6504608Z Execution Analysis: (:1) 2025-03-14T06:00:24.6504872Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6505074Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6505080Z 2025-03-14T06:00:24.6505284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6505394Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6505628Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6505739Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6505946Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6506085Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6506235Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6506397Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6506988Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6507670Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6508036Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6508368Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6508661Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6508922Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6509205Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6509462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6509560Z Execution Analysis: .......... 2025-03-14T06:00:24.6509807Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6509996Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6510273Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2034 counts during 1938 steps 2025-03-14T06:00:24.6510278Z 2025-03-14T06:00:24.6510487Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6510622Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6510894Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6511006Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6511195Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6511337Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6511472Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6511636Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6511971Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6512304Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6512593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6512858Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6513142Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6513401Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6513671Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6513796Z Execution Analysis: (:1) 2025-03-14T06:00:24.6514035Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6514232Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6514236Z 2025-03-14T06:00:24.6514422Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6514535Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6514752Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6514865Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6515053Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6515193Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6515328Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6515492Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6516037Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6516621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6516957Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6517294Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6517583Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6517845Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6518129Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6518382Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6518480Z Execution Analysis: .......... 2025-03-14T06:00:24.6518727Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6518913Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6519188Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2035 counts during 1939 steps 2025-03-14T06:00:24.6519193Z 2025-03-14T06:00:24.6519424Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6519542Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6519809Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6519919Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6520108Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6520251Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6520382Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6520548Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6520877Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6521215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6521504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6521769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6522053Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6522313Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6522582Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6522712Z Execution Analysis: (:1) 2025-03-14T06:00:24.6522950Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6523146Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6523151Z 2025-03-14T06:00:24.6523350Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6523458Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6523680Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6523784Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6523973Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6524118Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6524253Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6524420Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6525260Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6525880Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6526251Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6526603Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6526928Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6527203Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6527524Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6527796Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6527916Z Execution Analysis: .......... 2025-03-14T06:00:24.6528175Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6528385Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6528725Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2036 counts during 1940 steps 2025-03-14T06:00:24.6528730Z 2025-03-14T06:00:24.6528942Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6529055Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6529356Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6529468Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6529681Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6529826Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6529975Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6530144Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6530512Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6530867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6531189Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6531462Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6531771Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6532039Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6532338Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6532468Z Execution Analysis: (:1) 2025-03-14T06:00:24.6532737Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6532938Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6532942Z 2025-03-14T06:00:24.6533154Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6533271Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6533510Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6533621Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6533828Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6533971Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6534123Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6534317Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6534941Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6535512Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6535879Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6536229Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6536550Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6536822Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6537250Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6537514Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6537630Z Execution Analysis: .......... 2025-03-14T06:00:24.6537888Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6538135Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6538444Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2037 counts during 1941 steps 2025-03-14T06:00:24.6538449Z 2025-03-14T06:00:24.6538664Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6538779Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6539077Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6539191Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6539403Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6539549Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6539703Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6539870Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6540237Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6540583Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6540900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6541169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6541489Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6541753Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6542060Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6542195Z Execution Analysis: (:1) 2025-03-14T06:00:24.6542451Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6542667Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6542673Z 2025-03-14T06:00:24.6542874Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6543000Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6543229Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6543353Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6543553Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6543707Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6543880Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6544080Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6544661Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6545236Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6545592Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6545951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6546358Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6546628Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6546920Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6547180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6547280Z Execution Analysis: .......... 2025-03-14T06:00:24.6547553Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6547770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6548053Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2038 counts during 1942 steps 2025-03-14T06:00:24.6548058Z 2025-03-14T06:00:24.6548243Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6548356Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6548627Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6548746Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6548934Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6549077Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6549209Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6549377Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6549713Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6550048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6550340Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6550601Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6550887Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6551147Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6551421Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6551543Z Execution Analysis: (:1) 2025-03-14T06:00:24.6551784Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6551988Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6551992Z 2025-03-14T06:00:24.6552181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6552295Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6552510Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6552622Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6552811Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6552998Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6553135Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6553307Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6553855Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6554401Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6554734Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6555069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6555359Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6555625Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6555913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6556175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6556274Z Execution Analysis: .......... 2025-03-14T06:00:24.6556570Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6556760Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6557040Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2040 counts during 1943 steps 2025-03-14T06:00:24.6557044Z 2025-03-14T06:00:24.6557241Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6557348Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6557630Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6557734Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6557935Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6558070Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6558219Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6558379Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6558710Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6559047Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6559352Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6559606Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6559905Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6560156Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6560441Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6560559Z Execution Analysis: (:1) 2025-03-14T06:00:24.6560810Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6560997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6561001Z 2025-03-14T06:00:24.6561197Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6561304Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6561531Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6561657Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6561881Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6562012Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6562161Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6562318Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6562879Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6563407Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6563752Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6564078Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6564380Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6564707Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6565179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6565641Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6565843Z Execution Analysis: .......... 2025-03-14T06:00:24.6566105Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6566317Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6566612Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2041 counts during 1944 steps 2025-03-14T06:00:24.6566617Z 2025-03-14T06:00:24.6566834Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6566952Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6567253Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6567365Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6567578Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6567726Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6567882Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6568052Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6568426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6568781Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6569105Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6569385Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6569705Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6569975Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6570277Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6570413Z Execution Analysis: (:1) 2025-03-14T06:00:24.6570677Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6570878Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6570882Z 2025-03-14T06:00:24.6571094Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6571208Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6571482Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6571636Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6571852Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6572001Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6572160Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6572331Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6572937Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6573512Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6573886Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6574243Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6574576Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6574866Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6575177Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6575508Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6575616Z Execution Analysis: .......... 2025-03-14T06:00:24.6575890Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6576093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6576400Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2042 counts during 1945 steps 2025-03-14T06:00:24.6576407Z 2025-03-14T06:00:24.6576609Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6576737Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6577025Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6577250Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6581386Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6581526Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6581667Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6581825Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6582176Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6582504Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6582802Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6583068Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6583351Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6583610Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6583884Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6584006Z Execution Analysis: (:1) 2025-03-14T06:00:24.6584248Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6584441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6584446Z 2025-03-14T06:00:24.6584630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6584799Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6585041Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6585149Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6585339Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6585477Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6585613Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6585777Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6586330Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6586866Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6587196Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6587532Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6587819Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6588078Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6588413Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6588666Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6588764Z Execution Analysis: .......... 2025-03-14T06:00:24.6589009Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6589194Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6589468Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2043 counts during 1946 steps 2025-03-14T06:00:24.6589477Z 2025-03-14T06:00:24.6589665Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6589776Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6590044Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6590153Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6590340Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6590480Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6590607Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6590770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6591095Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6591426Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6591715Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6591970Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6592254Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6592517Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6592783Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6592904Z Execution Analysis: (:1) 2025-03-14T06:00:24.6593139Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6593330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6593335Z 2025-03-14T06:00:24.6593546Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6593754Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6593961Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6594068Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6594254Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6594397Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6594531Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6594691Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6595232Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6595767Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6596271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6596621Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6596922Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6597239Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6597538Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6597805Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6597909Z Execution Analysis: .......... 2025-03-14T06:00:24.6598164Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6598355Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6598647Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2044 counts during 1947 steps 2025-03-14T06:00:24.6598653Z 2025-03-14T06:00:24.6598853Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6598962Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6599250Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6599357Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6599556Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6599692Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6599833Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6599997Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6600350Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6600691Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6600997Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6601263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6601570Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6601829Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6602120Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6602237Z Execution Analysis: (:1) 2025-03-14T06:00:24.6602495Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6602688Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6602738Z 2025-03-14T06:00:24.6602938Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6603047Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6603278Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6603384Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6603590Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6603726Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6603874Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6604034Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6604721Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6605453Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6605824Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6606176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6606547Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6606826Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6607141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6607407Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6607519Z Execution Analysis: .......... 2025-03-14T06:00:24.6607773Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6607981Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6608271Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2045 counts during 1948 steps 2025-03-14T06:00:24.6608277Z 2025-03-14T06:00:24.6608484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6608597Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6608892Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6608997Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6609204Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6609344Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6609492Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6609658Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6610021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6610374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6610692Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6610963Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6611277Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6611543Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6611838Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6611960Z Execution Analysis: (:1) 2025-03-14T06:00:24.6612225Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6612464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6612492Z 2025-03-14T06:00:24.6612702Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6612815Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6613052Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6613159Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6613372Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6613512Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6613664Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6613828Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6614423Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6614995Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6615362Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6615742Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6616077Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6616352Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6616656Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6616926Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6617029Z Execution Analysis: .......... 2025-03-14T06:00:24.6617384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6617569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6617838Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2046 counts during 1949 steps 2025-03-14T06:00:24.6617842Z 2025-03-14T06:00:24.6618030Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6618138Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6618404Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6618507Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6618692Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6618827Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6618955Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6619115Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6619443Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6619768Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6620060Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6620329Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6620615Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6620877Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6621154Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6621282Z Execution Analysis: (:1) 2025-03-14T06:00:24.6621548Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6621770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6621774Z 2025-03-14T06:00:24.6621964Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6622084Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6622302Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6622420Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6622608Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6622756Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6622896Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6623065Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6623615Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6624169Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6624505Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6624891Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6625185Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6625451Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6625736Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6626004Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6626107Z Execution Analysis: .......... 2025-03-14T06:00:24.6626367Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6626559Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6626847Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2047 counts during 1950 steps 2025-03-14T06:00:24.6626852Z 2025-03-14T06:00:24.6627041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6627169Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6627438Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6627558Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6627750Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6627901Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6628038Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6628214Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6628546Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6628894Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6629186Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6629459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6629744Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6630012Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6630287Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6630442Z Execution Analysis: (:1) 2025-03-14T06:00:24.6630705Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6630912Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6630916Z 2025-03-14T06:00:24.6631113Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6631223Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6631441Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6631561Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6631755Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6631905Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6632045Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6632219Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6632768Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6633311Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6633702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6634031Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6634330Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6634585Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6634877Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6635129Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6635242Z Execution Analysis: .......... 2025-03-14T06:00:24.6635483Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6635679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6635953Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2048 counts during 1951 steps 2025-03-14T06:00:24.6635957Z 2025-03-14T06:00:24.6636161Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6636270Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6636548Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6636651Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6636855Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6636995Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6637142Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6637299Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6637643Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6637975Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6638279Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6638536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6638837Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6639090Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6639399Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6639539Z Execution Analysis: (:1) 2025-03-14T06:00:24.6639792Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6639985Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6639991Z 2025-03-14T06:00:24.6640189Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6640297Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6640519Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6640623Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6640820Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6640955Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6641105Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6641261Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6641822Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6642407Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6642756Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6643081Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6643384Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6643642Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6643944Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6644197Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6644312Z Execution Analysis: .......... 2025-03-14T06:00:24.6644625Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6644838Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6645290Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2049 counts during 1952 steps 2025-03-14T06:00:24.6645296Z 2025-03-14T06:00:24.6645601Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6645718Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6646027Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6646140Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6646363Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6646511Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6646671Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6646844Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6647219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6647567Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6647892Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6648166Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6648488Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6648788Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6649118Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6649242Z Execution Analysis: (:1) 2025-03-14T06:00:24.6649514Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6649732Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6649736Z 2025-03-14T06:00:24.6649938Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6650063Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6650293Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6650415Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6650618Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6650778Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6650929Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6651112Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6651705Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6652338Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6652702Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6653067Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6653379Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6653673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6653984Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6654266Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6654373Z Execution Analysis: .......... 2025-03-14T06:00:24.6654645Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6654848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6655154Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2050 counts during 1953 steps 2025-03-14T06:00:24.6655158Z 2025-03-14T06:00:24.6655363Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6655491Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6655783Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6655913Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6656120Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6656280Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6656423Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6656607Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6656969Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6657423Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6657713Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6657982Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6658268Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6658579Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6658852Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6658983Z Execution Analysis: (:1) 2025-03-14T06:00:24.6659222Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6659425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6659429Z 2025-03-14T06:00:24.6659617Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6659738Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6659955Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6660074Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6660266Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6660413Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6660548Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6660716Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6661308Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6661854Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6662187Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6662526Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6662817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6663084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6663369Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6663633Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6663737Z Execution Analysis: .......... 2025-03-14T06:00:24.6663989Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6664176Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6664458Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2051 counts during 1954 steps 2025-03-14T06:00:24.6664463Z 2025-03-14T06:00:24.6664658Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6664765Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6665038Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6665140Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6665577Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6665889Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6666034Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6666213Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6666566Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6666925Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6667241Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6667514Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6667928Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6668195Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6668490Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6668616Z Execution Analysis: (:1) 2025-03-14T06:00:24.6668883Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6669083Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6669087Z 2025-03-14T06:00:24.6669293Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6669406Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6669640Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6669754Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6669965Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6670108Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6670260Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6670430Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6671090Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6671665Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6672031Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6672379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6672699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6672974Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6673291Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6673564Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6673676Z Execution Analysis: .......... 2025-03-14T06:00:24.6673932Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6674137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6674428Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2052 counts during 1955 steps 2025-03-14T06:00:24.6674433Z 2025-03-14T06:00:24.6674638Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6674757Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6675050Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6675158Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6675368Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6675510Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6675656Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6675822Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6676184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6676535Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6676853Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6677151Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6677494Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6677870Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6678162Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6678287Z Execution Analysis: (:1) 2025-03-14T06:00:24.6678541Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6678735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6678739Z 2025-03-14T06:00:24.6678942Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6679049Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6679277Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6679385Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6679585Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6679721Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6679867Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6680083Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6680669Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6681225Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6681581Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6681920Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6682230Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6682494Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6682801Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6683067Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6683169Z Execution Analysis: .......... 2025-03-14T06:00:24.6683417Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6683618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6683904Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2053 counts during 1956 steps 2025-03-14T06:00:24.6683910Z 2025-03-14T06:00:24.6684106Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6684220Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6684735Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6684852Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6685058Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6685208Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6685350Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6685524Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6685885Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6686243Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6686584Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6686888Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6687193Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6687470Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6687764Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6687896Z Execution Analysis: (:1) 2025-03-14T06:00:24.6688155Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6688367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6688371Z 2025-03-14T06:00:24.6688569Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6688691Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6688921Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6689036Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6689240Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6689410Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6689582Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6689756Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6690345Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6690924Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6691284Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6691641Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6691950Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6692234Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6692541Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6692815Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6692920Z Execution Analysis: .......... 2025-03-14T06:00:24.6693185Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6693384Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6693683Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2054 counts during 1957 steps 2025-03-14T06:00:24.6693689Z 2025-03-14T06:00:24.6693890Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6694011Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6694301Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6694418Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6694619Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6694767Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6694905Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6695074Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6695431Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6695811Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6696149Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6696433Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6696738Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6697017Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6697411Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6697542Z Execution Analysis: (:1) 2025-03-14T06:00:24.6697791Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6697992Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6697998Z 2025-03-14T06:00:24.6698190Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6698307Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6698527Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6698638Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6699046Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6699215Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6699359Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6699527Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6700100Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6700660Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6701020Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6701359Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6701666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6701935Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6702238Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6702500Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6702608Z Execution Analysis: .......... 2025-03-14T06:00:24.6702857Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6703057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6703340Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2055 counts during 1958 steps 2025-03-14T06:00:24.6703345Z 2025-03-14T06:00:24.6703547Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6703655Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6703942Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6704047Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6704247Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6704387Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6704528Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6704688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6705040Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6705428Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6705735Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6706000Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6706304Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6706570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6706857Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6706981Z Execution Analysis: (:1) 2025-03-14T06:00:24.6707237Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6707536Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6707544Z 2025-03-14T06:00:24.6707735Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6707840Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6708060Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6708188Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6708407Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6708542Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6708680Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6708836Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6709390Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6709925Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6710267Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6710591Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6710891Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6711144Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6711435Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6711683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6711785Z Execution Analysis: .......... 2025-03-14T06:00:24.6712026Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6712222Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6712489Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2056 counts during 1959 steps 2025-03-14T06:00:24.6712494Z 2025-03-14T06:00:24.6712692Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6712802Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6713078Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6713179Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6713371Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6713502Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6713640Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6713797Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6714160Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6714521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6714816Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6715070Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6715357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6715604Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6715882Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6715997Z Execution Analysis: (:1) 2025-03-14T06:00:24.6716244Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6716433Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6716445Z 2025-03-14T06:00:24.6716628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6716742Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6717002Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6717111Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6717298Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6717428Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6717567Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6717719Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6718269Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6718801Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6719137Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6719474Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6719763Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6720018Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6720302Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6720555Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6720654Z Execution Analysis: .......... 2025-03-14T06:00:24.6720893Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6721085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6721356Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2057 counts during 1960 steps 2025-03-14T06:00:24.6721361Z 2025-03-14T06:00:24.6721548Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6721656Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6721922Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6722029Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6722217Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6722353Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6722484Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6722690Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6723021Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6723349Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6723637Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6723896Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6724181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6724432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6724785Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6725076Z Execution Analysis: (:1) 2025-03-14T06:00:24.6725334Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6725541Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6725546Z 2025-03-14T06:00:24.6725745Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6725918Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6726151Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6726267Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6726470Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6726618Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6726763Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6726935Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6727529Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6728110Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6728471Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6728830Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6729145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6729426Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6729731Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6730005Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6730112Z Execution Analysis: .......... 2025-03-14T06:00:24.6730380Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6730579Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6730880Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2058 counts during 1961 steps 2025-03-14T06:00:24.6730884Z 2025-03-14T06:00:24.6731084Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6731207Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6731494Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6731614Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6731815Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6731994Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6732160Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6732336Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6732694Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6733052Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6733362Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6733643Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6733953Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6734228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6734527Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6734652Z Execution Analysis: (:1) 2025-03-14T06:00:24.6734913Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6735117Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6735122Z 2025-03-14T06:00:24.6735373Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6735485Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6735718Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6735829Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6736038Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6736179Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6736330Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6736501Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6737206Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6737739Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6738077Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6738402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6738699Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6738953Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6739240Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6739489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6739594Z Execution Analysis: .......... 2025-03-14T06:00:24.6739829Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6740022Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6740293Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2059 counts during 1962 steps 2025-03-14T06:00:24.6740298Z 2025-03-14T06:00:24.6740487Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6740591Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6740866Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6740967Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6741261Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6741415Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6741552Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6741706Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6742045Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6742374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6742666Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6742917Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6743209Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6743458Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6743736Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6743853Z Execution Analysis: (:1) 2025-03-14T06:00:24.6744097Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6744304Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6744329Z 2025-03-14T06:00:24.6744520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6744626Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6744847Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6744949Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6745141Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6745269Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6745410Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6745566Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6746306Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6746865Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6747219Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6747560Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6747868Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6748133Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6748437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6748700Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6748816Z Execution Analysis: .......... 2025-03-14T06:00:24.6749067Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6749270Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6749552Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2061 counts during 1963 steps 2025-03-14T06:00:24.6749565Z 2025-03-14T06:00:24.6749759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6749878Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6750158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6750311Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6750537Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6750682Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6750819Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6750989Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6751341Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6751693Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6752001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6752276Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6752574Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6752845Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6753133Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6753265Z Execution Analysis: (:1) 2025-03-14T06:00:24.6753520Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6753771Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6753776Z 2025-03-14T06:00:24.6753975Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6754095Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6754320Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6754437Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6754638Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6754789Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6754933Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6755105Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6755683Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6756250Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6756601Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6756952Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6757259Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6757533Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6757833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6758097Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6758200Z Execution Analysis: .......... 2025-03-14T06:00:24.6758460Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6758654Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6758940Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2062 counts during 1964 steps 2025-03-14T06:00:24.6758944Z 2025-03-14T06:00:24.6759141Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6759263Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6759568Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6759709Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6759905Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6760056Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6760195Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6760372Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6760720Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6761068Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6761371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6761645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6761943Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6762215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6762495Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6762625Z Execution Analysis: (:1) 2025-03-14T06:00:24.6762922Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6763126Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6763130Z 2025-03-14T06:00:24.6763329Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6763450Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6763675Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6763791Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6763989Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6764133Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6764277Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6764450Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6765403Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6765990Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6766351Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6766706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6767024Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6767301Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6767618Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6767889Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6768003Z Execution Analysis: .......... 2025-03-14T06:00:24.6768260Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6768469Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6768761Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2063 counts during 1965 steps 2025-03-14T06:00:24.6768765Z 2025-03-14T06:00:24.6768973Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6769149Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6769485Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6769597Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6769808Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6769955Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6770112Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6770283Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6770650Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6771001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6771320Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6771599Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6771914Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6772182Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6772483Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6772667Z Execution Analysis: (:1) 2025-03-14T06:00:24.6772933Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6773134Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6773139Z 2025-03-14T06:00:24.6773344Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6773459Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6773695Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6773810Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6774019Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6774161Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6774315Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6774481Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6775087Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6775659Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6776028Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6776379Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6776700Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6776977Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6777293Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6777568Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6777787Z Execution Analysis: .......... 2025-03-14T06:00:24.6778042Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6778242Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6778526Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2064 counts during 1966 steps 2025-03-14T06:00:24.6778557Z 2025-03-14T06:00:24.6778762Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6778897Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6779186Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6779300Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6779506Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6779651Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6779799Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6779960Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6780316Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6780763Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6781061Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6781315Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6781607Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6781859Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6782195Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6782316Z Execution Analysis: (:1) 2025-03-14T06:00:24.6782564Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6782752Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6782756Z 2025-03-14T06:00:24.6782950Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6783057Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6783451Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6783559Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6783763Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6783904Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6784053Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6784219Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6784800Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6785365Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6785715Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6786069Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6786373Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6786649Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6786949Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6787220Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6787325Z Execution Analysis: .......... 2025-03-14T06:00:24.6787581Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6787777Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6788068Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2065 counts during 1967 steps 2025-03-14T06:00:24.6788124Z 2025-03-14T06:00:24.6788322Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6788442Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6788726Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6788841Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6789043Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6789187Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6789326Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6789496Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6789843Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6790195Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6790499Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6790777Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6791075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6791390Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6791675Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6791807Z Execution Analysis: (:1) 2025-03-14T06:00:24.6792061Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6792265Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6792269Z 2025-03-14T06:00:24.6792467Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6792592Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6792816Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6792932Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6793132Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6793286Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6793429Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6793602Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6794177Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6794741Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6795199Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6795541Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6795836Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6796271Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6796573Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6796848Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6796953Z Execution Analysis: .......... 2025-03-14T06:00:24.6797216Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6797414Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6797758Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2066 counts during 1968 steps 2025-03-14T06:00:24.6797764Z 2025-03-14T06:00:24.6797961Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6798083Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6798370Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6798486Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6798681Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6798829Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6798968Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6799141Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6799492Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6799842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6800150Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6800425Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6800749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6801042Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6801331Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6801461Z Execution Analysis: (:1) 2025-03-14T06:00:24.6801713Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6801920Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6801927Z 2025-03-14T06:00:24.6802131Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6802241Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6802473Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6802578Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6802783Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6802921Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6803066Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6803229Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6803810Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6804362Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6804810Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6805325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6805647Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6805919Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6806236Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6806503Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6806617Z Execution Analysis: .......... 2025-03-14T06:00:24.6806874Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6807114Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6807432Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2067 counts during 1969 steps 2025-03-14T06:00:24.6807436Z 2025-03-14T06:00:24.6807643Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6807759Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6808055Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6808163Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6808373Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6808516Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6808666Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6808834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6809198Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6809548Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6809866Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6810163Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6810504Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6810773Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6811073Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6811197Z Execution Analysis: (:1) 2025-03-14T06:00:24.6811461Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6811665Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6811671Z 2025-03-14T06:00:24.6811879Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6811993Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6812233Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6812346Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6812560Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6812701Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6812856Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6813025Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6813621Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6814196Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6814565Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6814919Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6815238Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6815515Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6815829Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6816098Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6816210Z Execution Analysis: .......... 2025-03-14T06:00:24.6816495Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6816733Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6817026Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2068 counts during 1970 steps 2025-03-14T06:00:24.6817150Z 2025-03-14T06:00:24.6817341Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6817453Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6817719Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6817822Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6818016Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6818153Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6818294Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6818454Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6818790Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6819113Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6819408Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6819729Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6820017Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6820273Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6820541Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6820665Z Execution Analysis: (:1) 2025-03-14T06:00:24.6820907Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6821104Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6821108Z 2025-03-14T06:00:24.6821292Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6821405Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6821622Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6821733Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6821923Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6822063Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6822200Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6822366Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6822912Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6823452Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6823782Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6824115Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6824404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6824668Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6824955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6825209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6825331Z Execution Analysis: .......... 2025-03-14T06:00:24.6825600Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6825787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6826063Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2069 counts during 1971 steps 2025-03-14T06:00:24.6826069Z 2025-03-14T06:00:24.6826255Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6826371Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6826643Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6826757Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6826944Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6827084Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6827219Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6827385Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6827717Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6828048Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6828383Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6828644Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6828926Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6829180Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6829453Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6829578Z Execution Analysis: (:1) 2025-03-14T06:00:24.6829819Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6830016Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6830020Z 2025-03-14T06:00:24.6830206Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6830323Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6830540Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6830651Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6830841Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6830981Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6831118Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6831285Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6831830Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6832367Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6832703Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6833036Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6833324Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6833596Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6833898Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6834172Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6834304Z Execution Analysis: .......... 2025-03-14T06:00:24.6834542Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6834742Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6835011Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2070 counts during 1972 steps 2025-03-14T06:00:24.6835016Z 2025-03-14T06:00:24.6835222Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6835330Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6835613Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6835720Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6835921Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6836056Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6836202Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6836359Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6836701Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6837070Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6837371Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6837627Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6837927Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6838176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6838462Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6838582Z Execution Analysis: (:1) 2025-03-14T06:00:24.6838834Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6839021Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6839025Z 2025-03-14T06:00:24.6839226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6839336Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6839566Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6839667Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6839866Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6839998Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6840150Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6840306Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6840868Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6841399Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6841744Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6842071Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6842374Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6842624Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6842938Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6843209Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6843322Z Execution Analysis: .......... 2025-03-14T06:00:24.6843557Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6843758Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6844025Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2071 counts during 1973 steps 2025-03-14T06:00:24.6844029Z 2025-03-14T06:00:24.6844227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6844332Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6844707Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6844812Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6845186Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6845331Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6845487Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6845656Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6846057Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6846433Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6846761Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6847033Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6847356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6847625Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6847933Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6848058Z Execution Analysis: (:1) 2025-03-14T06:00:24.6848324Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6848529Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6848533Z 2025-03-14T06:00:24.6848748Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6848862Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6849099Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6849213Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6849431Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6849579Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6849737Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6849905Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6850506Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6851087Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6851458Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6851822Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6852138Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6852421Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6852793Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6853076Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6853182Z Execution Analysis: .......... 2025-03-14T06:00:24.6853457Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6853659Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6853966Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2072 counts during 1974 steps 2025-03-14T06:00:24.6853971Z 2025-03-14T06:00:24.6854172Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6854300Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6854590Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6854715Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6854918Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6855075Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6855216Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6855418Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6855801Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6856164Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6856478Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6856765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6857072Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6857448Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6857717Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6857844Z Execution Analysis: (:1) 2025-03-14T06:00:24.6858085Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6858286Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6858291Z 2025-03-14T06:00:24.6858477Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6858595Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6858808Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6858921Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6859109Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6859259Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6859393Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6859561Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6860110Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6860650Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6860980Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6861319Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6861608Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6861918Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6862204Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6862462Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6862563Z Execution Analysis: .......... 2025-03-14T06:00:24.6862811Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6862997Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6863277Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2073 counts during 1975 steps 2025-03-14T06:00:24.6863282Z 2025-03-14T06:00:24.6863468Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6863588Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6863857Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6863972Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6864160Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6864306Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6864463Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6864661Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6864989Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6865437Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6865903Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6866185Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6866497Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6866784Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6867075Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6867212Z Execution Analysis: (:1) 2025-03-14T06:00:24.6867476Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6867687Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6867692Z 2025-03-14T06:00:24.6867907Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6868019Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6868260Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6868369Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6868583Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6868725Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6868871Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6869050Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6869653Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6870223Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6870595Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6870946Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6871329Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6871637Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6871956Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6872228Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6872351Z Execution Analysis: .......... 2025-03-14T06:00:24.6872607Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6872823Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6873115Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2074 counts during 1976 steps 2025-03-14T06:00:24.6873120Z 2025-03-14T06:00:24.6873333Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6873450Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6873753Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6873864Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6874077Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6874252Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6874441Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6874609Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6874981Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6875335Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6875664Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6875938Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6876262Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6876528Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6876833Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6876961Z Execution Analysis: (:1) 2025-03-14T06:00:24.6877234Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6877437Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6877441Z 2025-03-14T06:00:24.6877656Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6877771Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6878110Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6878217Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6878419Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6878555Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6878705Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6878865Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6879422Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6879952Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6880300Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6880656Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6880981Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6881238Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6881540Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6881791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6881910Z Execution Analysis: .......... 2025-03-14T06:00:24.6882152Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6882351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6882623Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2075 counts during 1977 steps 2025-03-14T06:00:24.6882628Z 2025-03-14T06:00:24.6882830Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6882939Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6883215Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6883320Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6883646Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6883779Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6883920Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6884074Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6884421Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6884812Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6885302Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6885576Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6885893Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6886174Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6886466Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6886602Z Execution Analysis: (:1) 2025-03-14T06:00:24.6886856Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6887071Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6887076Z 2025-03-14T06:00:24.6887275Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6887408Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6887636Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6887757Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6887961Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6888114Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6888263Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6888444Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6889036Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6889621Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6889983Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6890413Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6890724Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6891013Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6891324Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6891606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6891712Z Execution Analysis: .......... 2025-03-14T06:00:24.6891981Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6892180Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6892484Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2076 counts during 1978 steps 2025-03-14T06:00:24.6892491Z 2025-03-14T06:00:24.6892691Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6892816Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6893104Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6893273Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6893478Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6893632Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6893771Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6893949Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6894306Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6894668Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6894984Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6895268Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6895576Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6895860Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6896153Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6896291Z Execution Analysis: (:1) 2025-03-14T06:00:24.6896548Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6896759Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6896766Z 2025-03-14T06:00:24.6896967Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6897203Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6897432Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6897552Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6897753Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6897906Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6898050Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6898224Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6898801Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6899372Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6899766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6900117Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6900420Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6900699Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6900997Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6901271Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6901375Z Execution Analysis: .......... 2025-03-14T06:00:24.6901642Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6901840Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6902140Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2077 counts during 1979 steps 2025-03-14T06:00:24.6902144Z 2025-03-14T06:00:24.6902350Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6902460Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6902798Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6902908Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6903115Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6903255Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6903410Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6903571Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6903933Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6904280Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6904593Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6904860Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6905172Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6905434Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6905726Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6905846Z Execution Analysis: (:1) 2025-03-14T06:00:24.6906110Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6906305Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6906313Z 2025-03-14T06:00:24.6906523Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6906634Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6906874Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6906982Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6907195Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6907443Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6907589Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6907741Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6908297Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6908847Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6909211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6909531Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6909835Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6910086Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6910381Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6910630Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6910739Z Execution Analysis: .......... 2025-03-14T06:00:24.6910977Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6911179Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6911450Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2078 counts during 1980 steps 2025-03-14T06:00:24.6911455Z 2025-03-14T06:00:24.6911673Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6911801Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6912082Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6912183Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6912385Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6912518Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6912661Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6912817Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6913164Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6913489Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6913788Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6914044Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6914340Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6914591Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6914873Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6914989Z Execution Analysis: (:1) 2025-03-14T06:00:24.6915240Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6915427Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6915431Z 2025-03-14T06:00:24.6915627Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6915732Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6915962Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6916064Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6916265Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6916396Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6916542Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6916698Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6917257Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6917836Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6918184Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6918527Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6918823Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6919087Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6919379Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6919640Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6919745Z Execution Analysis: .......... 2025-03-14T06:00:24.6919998Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6920192Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6920477Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2079 counts during 1981 steps 2025-03-14T06:00:24.6920480Z 2025-03-14T06:00:24.6920741Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6920861Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6921135Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6921252Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6921445Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6921592Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6921728Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6921898Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6922233Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6922570Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6922864Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6923129Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6923418Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6923683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6923960Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6924091Z Execution Analysis: (:1) 2025-03-14T06:00:24.6924337Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6924600Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6924605Z 2025-03-14T06:00:24.6924794Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6925080Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6925317Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6925442Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6925649Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6925807Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6925954Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6926139Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6926766Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6927374Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6927735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6928097Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6928412Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6928694Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6929001Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6929281Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6929392Z Execution Analysis: .......... 2025-03-14T06:00:24.6929663Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6929865Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6930194Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2080 counts during 1982 steps 2025-03-14T06:00:24.6930223Z 2025-03-14T06:00:24.6930429Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6930556Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6930848Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6930969Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6931175Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6931330Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6931476Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6931655Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6932014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6932380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6932694Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6932980Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6933285Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6933566Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6933861Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6934001Z Execution Analysis: (:1) 2025-03-14T06:00:24.6934261Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6934480Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6934485Z 2025-03-14T06:00:24.6934691Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6934820Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6935052Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6935176Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6935382Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6935537Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6935684Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6935890Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6936730Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6937413Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6937759Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6938089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6938388Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6938645Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6938939Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6939196Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6939306Z Execution Analysis: .......... 2025-03-14T06:00:24.6939550Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6939779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6940074Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2082 counts during 1983 steps 2025-03-14T06:00:24.6940079Z 2025-03-14T06:00:24.6940281Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6940388Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6940671Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6940775Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6940976Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6941114Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6941256Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6941413Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6941757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6942089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6942399Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6942655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6942955Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6943204Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6943490Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6943608Z Execution Analysis: (:1) 2025-03-14T06:00:24.6943856Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6944047Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6944051Z 2025-03-14T06:00:24.6944250Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6944357Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6944579Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6944684Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6944885Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6945021Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6945193Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6945375Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6945934Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6946470Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6946811Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6947144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6947446Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6947703Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6948000Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6948254Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6948365Z Execution Analysis: .......... 2025-03-14T06:00:24.6948605Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6948846Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6949117Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2083 counts during 1984 steps 2025-03-14T06:00:24.6949121Z 2025-03-14T06:00:24.6949318Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6949426Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6949704Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6949810Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6950014Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6950147Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6950290Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6950447Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6950792Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6951122Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6951423Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6951677Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6951973Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6952225Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6952513Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6952628Z Execution Analysis: (:1) 2025-03-14T06:00:24.6952881Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6953080Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6953085Z 2025-03-14T06:00:24.6953274Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6953394Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6953609Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6953724Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6953915Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6954093Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6954257Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6954424Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6954974Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6955516Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6955852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6956185Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6956474Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6956739Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6957026Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6962716Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6962899Z Execution Analysis: .......... 2025-03-14T06:00:24.6963263Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6963458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6963739Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2084 counts during 1985 steps 2025-03-14T06:00:24.6963745Z 2025-03-14T06:00:24.6963932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6964045Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6964318Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6964428Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6964719Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6964860Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6965164Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6965475Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6965838Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6966198Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6966510Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6966788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6967096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6967369Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6967658Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6967787Z Execution Analysis: (:1) 2025-03-14T06:00:24.6968052Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6968256Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6968261Z 2025-03-14T06:00:24.6968459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6968575Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6968805Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6968987Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6969188Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6969372Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6969516Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6969688Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6970291Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6970869Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6971228Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6971581Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6971891Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6972173Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6972477Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6972752Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6972937Z Execution Analysis: .......... 2025-03-14T06:00:24.6973204Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6973404Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6973696Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2085 counts during 1986 steps 2025-03-14T06:00:24.6973702Z 2025-03-14T06:00:24.6973901Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6974024Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6974313Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6974426Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6974628Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6974778Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6974919Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6975097Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6975452Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6975809Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6976118Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6976397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6976704Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6976979Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6977480Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6977602Z Execution Analysis: (:1) 2025-03-14T06:00:24.6977841Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6978032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6978036Z 2025-03-14T06:00:24.6978227Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6978330Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6978544Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6978766Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6978951Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6979089Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6979221Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6979384Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6979929Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6980463Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6980799Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6981120Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6981415Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6981667Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6981953Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6982241Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6982343Z Execution Analysis: .......... 2025-03-14T06:00:24.6982578Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6982765Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6983029Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2086 counts during 1987 steps 2025-03-14T06:00:24.6983033Z 2025-03-14T06:00:24.6983223Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6983327Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6983600Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6983700Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6983892Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6984025Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6984159Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6984311Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6984647Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6984969Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6985261Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6985516Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6985805Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6986051Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6986329Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6986442Z Execution Analysis: (:1) 2025-03-14T06:00:24.6986682Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6986864Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6986868Z 2025-03-14T06:00:24.6987060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6987187Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6987433Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6987533Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6987728Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6987858Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6988003Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6988159Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6988713Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6989236Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6989576Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6989901Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6990193Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6990446Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6990775Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6991023Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6991123Z Execution Analysis: .......... 2025-03-14T06:00:24.6991360Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6991548Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6991816Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2087 counts during 1988 steps 2025-03-14T06:00:24.6991823Z 2025-03-14T06:00:24.6992012Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6992115Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6992387Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.6992489Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6992686Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.6992816Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.6992954Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.6993105Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6993440Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.6993764Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6994054Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6994307Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6994596Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.6994843Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.6995117Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.6995235Z Execution Analysis: (:1) 2025-03-14T06:00:24.6995470Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.6995659Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6995664Z 2025-03-14T06:00:24.6995846Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.6996165Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.6996387Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.6996496Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.6996692Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.6996835Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.6996975Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.6997142Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.6997715Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.6998275Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.6998624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.6998976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.6999276Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.6999567Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.6999888Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7000153Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7000253Z Execution Analysis: .......... 2025-03-14T06:00:24.7000506Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7000698Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7000987Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2088 counts during 1989 steps 2025-03-14T06:00:24.7000993Z 2025-03-14T06:00:24.7001186Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7001301Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7001586Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7001707Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7001911Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7002064Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7002205Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7002383Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7002737Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7003092Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7003397Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7003679Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7003983Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7004261Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7004621Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7004759Z Execution Analysis: (:1) 2025-03-14T06:00:24.7005180Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7005396Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7005432Z 2025-03-14T06:00:24.7005669Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7005798Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7006033Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7006159Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7006371Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7006531Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7006681Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7006868Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7007462Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7008053Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7008421Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7008790Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7009135Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7009448Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7009760Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7010044Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7010154Z Execution Analysis: .......... 2025-03-14T06:00:24.7010430Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7010636Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7010946Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2089 counts during 1990 steps 2025-03-14T06:00:24.7010951Z 2025-03-14T06:00:24.7011170Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7011289Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7011602Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7011717Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7011936Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7012086Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7012244Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7012413Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7012788Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7013148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7013470Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7013748Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7014075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7014349Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7014650Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7014776Z Execution Analysis: (:1) 2025-03-14T06:00:24.7015051Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7015278Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7015306Z 2025-03-14T06:00:24.7015520Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7015634Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7015880Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7015996Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7016214Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7016360Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7016517Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7016687Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7017388Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7017920Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7018266Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7018618Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7018942Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7019198Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7019495Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7019744Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7019858Z Execution Analysis: .......... 2025-03-14T06:00:24.7020099Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7020299Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7020571Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2090 counts during 1991 steps 2025-03-14T06:00:24.7020576Z 2025-03-14T06:00:24.7020775Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7020887Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7021169Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7021276Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7021484Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7021621Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7021765Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7021925Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7022272Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7022599Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7022898Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7023156Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7023452Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7023702Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7023987Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7024105Z Execution Analysis: (:1) 2025-03-14T06:00:24.7024358Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7024593Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7024597Z 2025-03-14T06:00:24.7024794Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7024902Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7025130Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7025236Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7025440Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7025580Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7025731Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7025891Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7026450Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7026987Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7027331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7027706Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7028008Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7028276Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7028560Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7028825Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7028930Z Execution Analysis: .......... 2025-03-14T06:00:24.7029183Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7029372Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7029653Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2091 counts during 1992 steps 2025-03-14T06:00:24.7029659Z 2025-03-14T06:00:24.7029848Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7029967Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7030238Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7030356Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7030545Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7030690Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7030826Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7030993Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7031325Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7031661Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7031952Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7032218Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7032502Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7032762Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7033035Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7033187Z Execution Analysis: (:1) 2025-03-14T06:00:24.7033449Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7033648Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7033651Z 2025-03-14T06:00:24.7033841Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7033959Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7034177Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7034296Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7034486Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7034630Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7034769Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7034936Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7035663Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7036235Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7036630Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7036984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7037290Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7037566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7037866Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7038144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7038253Z Execution Analysis: .......... 2025-03-14T06:00:24.7038516Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7038717Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7039018Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2092 counts during 1993 steps 2025-03-14T06:00:24.7039022Z 2025-03-14T06:00:24.7039221Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7039345Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7039628Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7039751Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7039950Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7040112Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7040253Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7040434Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7040785Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7041144Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7041452Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7041732Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7042035Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7042309Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7042596Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7042788Z Execution Analysis: (:1) 2025-03-14T06:00:24.7043042Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7043251Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7043255Z 2025-03-14T06:00:24.7043458Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7043585Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7043810Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7043931Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7044133Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7044287Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7044432Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7044687Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7045443Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7046063Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7046466Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7046824Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7047145Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7047420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7047728Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7047999Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7048115Z Execution Analysis: .......... 2025-03-14T06:00:24.7048374Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7048588Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7048879Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2093 counts during 1994 steps 2025-03-14T06:00:24.7048886Z 2025-03-14T06:00:24.7049090Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7049203Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7049499Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7049607Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7049816Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7049960Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7050106Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7050272Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7050635Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7050986Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7051305Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7051579Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7051891Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7052157Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7052531Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7052655Z Execution Analysis: (:1) 2025-03-14T06:00:24.7052917Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7053121Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7053125Z 2025-03-14T06:00:24.7053330Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7053442Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7053677Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7053786Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7053994Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7054137Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7054291Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7054458Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7055049Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7055670Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7056037Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7056387Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7056701Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7056972Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7057286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7057557Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7057673Z Execution Analysis: .......... 2025-03-14T06:00:24.7057934Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7058139Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7058427Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2094 counts during 1995 steps 2025-03-14T06:00:24.7058432Z 2025-03-14T06:00:24.7058645Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7058757Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7059048Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7059160Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7059368Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7059509Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7059655Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7059823Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7060185Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7060535Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7060850Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7061121Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7061434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7061748Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7062044Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7062167Z Execution Analysis: (:1) 2025-03-14T06:00:24.7062428Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7062627Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7062639Z 2025-03-14T06:00:24.7062837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7062952Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7063182Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7063295Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7063500Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7063647Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7063793Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7063958Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7064578Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7065177Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7065666Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7066022Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7066331Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7066611Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7066919Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7067193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7067298Z Execution Analysis: .......... 2025-03-14T06:00:24.7067565Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7067767Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7068062Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2095 counts during 1996 steps 2025-03-14T06:00:24.7068068Z 2025-03-14T06:00:24.7068266Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7068388Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7068676Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7068793Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7068997Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7069145Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7069289Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7069464Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7069819Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7070177Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7070486Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7070763Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7071123Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7071432Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7071724Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7071853Z Execution Analysis: (:1) 2025-03-14T06:00:24.7072119Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7072327Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7072331Z 2025-03-14T06:00:24.7072533Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7072651Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7072880Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7072995Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7073202Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7073349Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7073493Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7073665Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7074332Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7074912Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7075271Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7075627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7075938Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7076221Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7076530Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7076810Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7076916Z Execution Analysis: .......... 2025-03-14T06:00:24.7077287Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7077480Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7077874Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2096 counts during 1997 steps 2025-03-14T06:00:24.7077879Z 2025-03-14T06:00:24.7078064Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7078183Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7078449Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7078557Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7078744Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7078884Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7079014Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7079177Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7079503Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7079833Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7080116Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7080397Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7080704Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7080947Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7081222Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7081339Z Execution Analysis: (:1) 2025-03-14T06:00:24.7081577Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7081760Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7081764Z 2025-03-14T06:00:24.7081953Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7082058Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7082275Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7082379Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7082575Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7082706Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7082845Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7083041Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7083588Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7084114Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7084450Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7084842Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7085325Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7085597Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7085909Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7086176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7086283Z Execution Analysis: .......... 2025-03-14T06:00:24.7086540Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7086744Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7087035Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2097 counts during 1998 steps 2025-03-14T06:00:24.7087042Z 2025-03-14T06:00:24.7087246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7087363Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7087658Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7087766Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7087977Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7088122Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7088264Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7088434Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7088796Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7089147Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7089491Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7089788Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7090097Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7090363Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7090665Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7090791Z Execution Analysis: (:1) 2025-03-14T06:00:24.7091053Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7091253Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7091257Z 2025-03-14T06:00:24.7091464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7091580Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7091816Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7091927Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7092142Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7092288Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7092486Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7092654Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7093247Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7093818Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7094181Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7094536Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7094854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7095126Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7095448Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7095715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7095825Z Execution Analysis: .......... 2025-03-14T06:00:24.7096078Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7096284Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7096580Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2098 counts during 1999 steps 2025-03-14T06:00:24.7096587Z 2025-03-14T06:00:24.7096787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7096909Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7097303Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7097419Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7097619Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7097763Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7097901Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7098066Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7098415Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7098758Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7099126Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7099392Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7099688Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7099960Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7100240Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7100365Z Execution Analysis: (:1) 2025-03-14T06:00:24.7100613Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7100814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7100820Z 2025-03-14T06:00:24.7101016Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7101132Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7101356Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7101470Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7101689Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7101856Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7102002Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7102167Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7102741Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7103304Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7103654Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7104000Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7104299Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7104577Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7104876Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7105144Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7105245Z Execution Analysis: .......... 2025-03-14T06:00:24.7105500Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7105692Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7105981Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2099 counts during 2000 steps 2025-03-14T06:00:24.7105985Z 2025-03-14T06:00:24.7106182Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7106294Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7106576Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7106684Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7106878Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7107021Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7107160Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7107436Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7107765Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7108139Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7108427Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7108684Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7108969Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7109219Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7109487Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7109607Z Execution Analysis: (:1) 2025-03-14T06:00:24.7109846Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7110037Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7110045Z 2025-03-14T06:00:24.7110229Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7110342Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7110554Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7110696Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7110908Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7111046Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7111180Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7111343Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7111887Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7112418Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7112753Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7113085Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7113384Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7113635Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7113924Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7114173Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7114277Z Execution Analysis: .......... 2025-03-14T06:00:24.7114514Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7114707Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7114973Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2100 counts during 2001 steps 2025-03-14T06:00:24.7114978Z 2025-03-14T06:00:24.7115167Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7115274Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7115545Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7115645Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7115841Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7115971Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7116107Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7116263Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7116624Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7116973Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7117264Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7117521Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7117806Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7118053Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7118325Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7118439Z Execution Analysis: (:1) 2025-03-14T06:00:24.7118680Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7118872Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7118876Z 2025-03-14T06:00:24.7119065Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7119169Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7119409Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7119608Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7119803Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7120106Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7120252Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7120414Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7120992Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7121549Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7121905Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7122248Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7122558Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7122822Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7123128Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7123389Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7123498Z Execution Analysis: .......... 2025-03-14T06:00:24.7123748Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7123950Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7124233Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2101 counts during 2002 steps 2025-03-14T06:00:24.7124238Z 2025-03-14T06:00:24.7124439Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7124615Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7125072Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7125181Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7125390Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7125533Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7125684Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7125883Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7126274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7126627Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7126944Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7127220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7127531Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7127800Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7128096Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7128219Z Execution Analysis: (:1) 2025-03-14T06:00:24.7128484Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7128685Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7128695Z 2025-03-14T06:00:24.7128894Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7129035Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7129291Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7129400Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7129606Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7129747Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7129901Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7130068Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7130669Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7131253Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7131610Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7131969Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7132281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7132560Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7132866Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7133141Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7133250Z Execution Analysis: .......... 2025-03-14T06:00:24.7133517Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7133721Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7134019Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2103 counts during 2003 steps 2025-03-14T06:00:24.7134025Z 2025-03-14T06:00:24.7134226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7134348Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7134638Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7134758Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7134960Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7135109Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7135299Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7135470Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7135830Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7136193Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7136507Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7136787Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7137096Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7137371Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7137664Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7137797Z Execution Analysis: (:1) 2025-03-14T06:00:24.7138058Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7138267Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7138272Z 2025-03-14T06:00:24.7138524Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7138645Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7138874Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7138990Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7139195Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7139344Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7139492Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7139664Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7140256Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7140831Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7141191Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7141547Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7141859Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7142134Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7142440Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7142827Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7142930Z Execution Analysis: .......... 2025-03-14T06:00:24.7143188Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7143387Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7143682Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2104 counts during 2004 steps 2025-03-14T06:00:24.7143687Z 2025-03-14T06:00:24.7143879Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7143997Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7144276Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7144389Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7144586Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7144787Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7144923Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7145090Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7145439Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7145789Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7146092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7146366Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7146663Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7146931Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7147216Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7147344Z Execution Analysis: (:1) 2025-03-14T06:00:24.7147595Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7147820Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7147824Z 2025-03-14T06:00:24.7148049Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7148159Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7148389Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7148494Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7148698Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7148834Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7148985Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7149151Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7149731Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7150291Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7150646Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7150984Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7151292Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7151555Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7151860Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7152122Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7152230Z Execution Analysis: .......... 2025-03-14T06:00:24.7152482Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7152690Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7152973Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2105 counts during 2005 steps 2025-03-14T06:00:24.7152977Z 2025-03-14T06:00:24.7153179Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7153289Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7153576Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7153817Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7154036Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7154170Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7154311Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7154466Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7154803Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7155126Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7155419Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7155674Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7155964Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7156215Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7156492Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7156779Z Execution Analysis: (:1) 2025-03-14T06:00:24.7157037Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7157276Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7157281Z 2025-03-14T06:00:24.7157484Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7157593Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7157823Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7157927Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7158130Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7158268Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7158417Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7158583Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7159165Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7159730Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7160086Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7160425Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7160729Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7160994Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7161299Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7161562Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7161668Z Execution Analysis: .......... 2025-03-14T06:00:24.7161922Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7162126Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7162409Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2106 counts during 2006 steps 2025-03-14T06:00:24.7162423Z 2025-03-14T06:00:24.7162615Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7162735Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7163045Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7163182Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7163378Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7163526Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7163662Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7163827Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7164179Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7164612Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7165082Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7165492Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7165802Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7166082Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7166372Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7166504Z Execution Analysis: (:1) 2025-03-14T06:00:24.7166844Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7167054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7167059Z 2025-03-14T06:00:24.7167257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7167377Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7167604Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7167722Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7167925Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7168072Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7168215Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7168391Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7168982Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7169563Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7169920Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7170275Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7170586Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7170871Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7171179Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7171455Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7171561Z Execution Analysis: .......... 2025-03-14T06:00:24.7171823Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7172024Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7172319Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2107 counts during 2007 steps 2025-03-14T06:00:24.7172323Z 2025-03-14T06:00:24.7172522Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7172674Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7172992Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7173112Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7173314Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7173465Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7173610Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7173784Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7174143Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7174501Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7174813Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7175097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7175408Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7175683Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7175976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7176133Z Execution Analysis: (:1) 2025-03-14T06:00:24.7176422Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7176632Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7176636Z 2025-03-14T06:00:24.7176837Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7176960Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7177298Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7177532Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7177721Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7177861Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7177998Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7178161Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7178712Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7179249Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7179582Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7179910Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7180204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7180464Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7180757Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7181009Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7181116Z Execution Analysis: .......... 2025-03-14T06:00:24.7181355Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7181549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7181815Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2108 counts during 2008 steps 2025-03-14T06:00:24.7181820Z 2025-03-14T06:00:24.7182292Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7182422Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7182695Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7182798Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7182992Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7183128Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7183271Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7183429Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7183766Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7184089Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7184386Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7184639Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7184930Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7185175Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7185494Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7185608Z Execution Analysis: (:1) 2025-03-14T06:00:24.7185849Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7186032Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7186036Z 2025-03-14T06:00:24.7186226Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7186332Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7186552Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7186653Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7186845Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7186973Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7187116Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7187272Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7187823Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7188352Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7188690Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7189014Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7189307Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7189562Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7189851Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7190097Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7190201Z Execution Analysis: .......... 2025-03-14T06:00:24.7190437Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7190631Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7190896Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2109 counts during 2009 steps 2025-03-14T06:00:24.7190945Z 2025-03-14T06:00:24.7191138Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7191243Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7191515Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7191614Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7191811Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7191941Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7192078Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7192231Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7192567Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7192891Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7193184Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7193440Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7193729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7194001Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7194302Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7194418Z Execution Analysis: (:1) 2025-03-14T06:00:24.7194664Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7194850Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7194854Z 2025-03-14T06:00:24.7195045Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7195152Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7195369Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7195470Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7195665Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7195800Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7195943Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7196272Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7196856Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7197412Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7197773Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7198123Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7198425Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7198697Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7198996Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7199265Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7199369Z Execution Analysis: .......... 2025-03-14T06:00:24.7199624Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7199818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7200129Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2110 counts during 2010 steps 2025-03-14T06:00:24.7200157Z 2025-03-14T06:00:24.7200351Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7200469Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7200749Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7200863Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7201060Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7201204Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7201339Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7201507Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7201852Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7202201Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7202504Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7202775Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7203099Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7203391Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7203679Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7203805Z Execution Analysis: (:1) 2025-03-14T06:00:24.7204055Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7204261Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7204267Z 2025-03-14T06:00:24.7204464Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7204671Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7204896Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7205177Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7205380Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7205533Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7205679Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7205852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7206439Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7207019Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7207378Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7207737Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7208050Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7208336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7208641Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7208914Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7209020Z Execution Analysis: .......... 2025-03-14T06:00:24.7209283Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7209512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7209834Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2111 counts during 2011 steps 2025-03-14T06:00:24.7209839Z 2025-03-14T06:00:24.7210041Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7210164Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7210454Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7210569Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7210768Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7210917Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7211061Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7211235Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7211591Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7211951Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7212258Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7212536Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7212902Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7213176Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7213467Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7213595Z Execution Analysis: (:1) 2025-03-14T06:00:24.7213852Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7214060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7214066Z 2025-03-14T06:00:24.7214273Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7214384Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7214622Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7214729Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7214952Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7215094Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7215248Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7215415Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7216019Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7216591Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7216965Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7217422Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7217741Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7218007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7218318Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7218579Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7218695Z Execution Analysis: .......... 2025-03-14T06:00:24.7218945Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7219202Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7219483Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2112 counts during 2012 steps 2025-03-14T06:00:24.7219488Z 2025-03-14T06:00:24.7219697Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7219809Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7220102Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7220209Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7220419Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7220557Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7220712Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7220878Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7221241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7221584Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7221900Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7222212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7222530Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7222791Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7223085Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7223205Z Execution Analysis: (:1) 2025-03-14T06:00:24.7223471Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7223671Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7223675Z 2025-03-14T06:00:24.7223887Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7223997Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7224239Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7224350Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7224558Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7224699Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7224856Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7225018Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7225710Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7226239Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7226578Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7226905Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7227204Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7227455Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7227747Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7227994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7228122Z Execution Analysis: .......... 2025-03-14T06:00:24.7228384Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7228578Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7228846Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2113 counts during 2013 steps 2025-03-14T06:00:24.7228862Z 2025-03-14T06:00:24.7229048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7229165Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7229431Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7229537Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7229736Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7229867Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7230010Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7230169Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7230506Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7230830Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7231171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7231437Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7231719Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7231977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7232242Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7232370Z Execution Analysis: (:1) 2025-03-14T06:00:24.7232607Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7232804Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7232808Z 2025-03-14T06:00:24.7232992Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7233109Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7233321Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7233432Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7233619Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7233760Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7233893Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7234058Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7234606Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7235144Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7235480Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7235816Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7236106Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7236373Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7236658Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7236941Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7237062Z Execution Analysis: .......... 2025-03-14T06:00:24.7237311Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7237494Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7237778Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2114 counts during 2014 steps 2025-03-14T06:00:24.7237783Z 2025-03-14T06:00:24.7237969Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7238087Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7238354Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7238466Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7238653Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7238801Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7238935Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7239100Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7239426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7239806Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7240092Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7240357Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7240639Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7240898Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7241166Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7241293Z Execution Analysis: (:1) 2025-03-14T06:00:24.7241529Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7241724Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7241728Z 2025-03-14T06:00:24.7241916Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7242032Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7242244Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7242355Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7242541Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7242684Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7242820Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7242988Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7243534Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7244074Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7244406Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7244812Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7245285Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7245572Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7245882Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7246216Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7246324Z Execution Analysis: .......... 2025-03-14T06:00:24.7246596Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7246814Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7247102Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2115 counts during 2015 steps 2025-03-14T06:00:24.7247106Z 2025-03-14T06:00:24.7247318Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7247429Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7247728Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7247837Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7248052Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7248195Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7248347Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7248513Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7248917Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7249292Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7249613Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7249884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7250202Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7250468Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7250775Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7250897Z Execution Analysis: (:1) 2025-03-14T06:00:24.7251167Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7251367Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7251374Z 2025-03-14T06:00:24.7251587Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7251697Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7251937Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7252048Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7252264Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7252405Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7252563Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7252728Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7253323Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7253895Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7254263Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7254611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7254931Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7255202Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7255565Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7255834Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7255951Z Execution Analysis: .......... 2025-03-14T06:00:24.7256210Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7256425Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7256714Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2116 counts during 2016 steps 2025-03-14T06:00:24.7256720Z 2025-03-14T06:00:24.7256932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7257045Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7257449Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7257560Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7257770Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7257911Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7258061Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7258225Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7258637Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7258976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7259290Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7259557Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7259868Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7260131Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7260430Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7260546Z Execution Analysis: (:1) 2025-03-14T06:00:24.7260809Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7261005Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7261009Z 2025-03-14T06:00:24.7261214Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7261329Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7261568Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7261676Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7261881Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7262023Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7262176Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7262341Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7262925Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7263484Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7264011Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7264374Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7264685Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7264994Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7265437Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7265715Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7265818Z Execution Analysis: .......... 2025-03-14T06:00:24.7266089Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7266289Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7266591Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2117 counts during 2017 steps 2025-03-14T06:00:24.7266596Z 2025-03-14T06:00:24.7266795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7266920Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7267211Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7267332Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7267534Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7267686Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7267827Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7268155Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7268509Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7268870Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7269178Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7269460Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7269766Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7270047Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7270334Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7270466Z Execution Analysis: (:1) 2025-03-14T06:00:24.7270722Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7270932Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7270937Z 2025-03-14T06:00:24.7271136Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7271260Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7271486Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7271607Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7271814Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7271964Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7272107Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7272281Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7272872Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7273458Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7273816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7274176Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7274520Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7274835Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7275141Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7275421Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7275528Z Execution Analysis: .......... 2025-03-14T06:00:24.7275792Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7275989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7276290Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2118 counts during 2018 steps 2025-03-14T06:00:24.7276296Z 2025-03-14T06:00:24.7276496Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7276624Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7276910Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7277137Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7277335Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7277509Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7277669Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7277945Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7278274Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7278609Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7278897Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7279161Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7279447Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7279705Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7279976Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7280102Z Execution Analysis: (:1) 2025-03-14T06:00:24.7280339Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7280531Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7280535Z 2025-03-14T06:00:24.7280729Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7280831Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7281057Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7281157Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7281344Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7281485Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7281620Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7281787Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7282335Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7282869Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7283211Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7283555Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7283889Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7284140Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7284434Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7284747Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7284857Z Execution Analysis: .......... 2025-03-14T06:00:24.7285276Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7285485Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7285775Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2119 counts during 2019 steps 2025-03-14T06:00:24.7285781Z 2025-03-14T06:00:24.7285992Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7286105Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7286408Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7286517Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7286761Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7286927Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7287082Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7287247Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7287612Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7287961Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7288283Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7288558Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7288873Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7289142Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7289447Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7289573Z Execution Analysis: (:1) 2025-03-14T06:00:24.7289843Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7290043Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7290047Z 2025-03-14T06:00:24.7290259Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7290375Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7290617Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7290726Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7290942Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7291082Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7291245Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7291410Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7292015Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7292588Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7292956Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7293353Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7293675Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7293946Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7294271Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7294539Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7294654Z Execution Analysis: .......... 2025-03-14T06:00:24.7294911Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7295125Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7295416Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2120 counts during 2020 steps 2025-03-14T06:00:24.7295423Z 2025-03-14T06:00:24.7295636Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7295750Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7296045Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7296179Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7296419Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7296563Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7296713Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7296881Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7297353Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7297694Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7298011Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7298275Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7298580Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7298845Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7299139Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7299257Z Execution Analysis: (:1) 2025-03-14T06:00:24.7299515Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7299723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7299727Z 2025-03-14T06:00:24.7299921Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7300046Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7300272Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7300391Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7300594Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7300749Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7300894Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7301071Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7301647Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7302215Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7302593Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7302971Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7303282Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7303566Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7303869Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7304141Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7304247Z Execution Analysis: .......... 2025-03-14T06:00:24.7304512Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7304712Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7305011Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2121 counts during 2021 steps 2025-03-14T06:00:24.7305015Z 2025-03-14T06:00:24.7305216Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7305341Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7305671Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7305787Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7305991Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7306144Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7306287Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7306464Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7306818Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7307173Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7307588Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7307854Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7308145Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7308409Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7308684Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7308815Z Execution Analysis: (:1) 2025-03-14T06:00:24.7309059Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7309262Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7309270Z 2025-03-14T06:00:24.7309459Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7309579Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7309795Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7309909Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7310104Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7310248Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7310385Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7310552Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7311095Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7311636Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7312014Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7312346Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7312637Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7312899Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7313183Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7313441Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7313541Z Execution Analysis: .......... 2025-03-14T06:00:24.7313789Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7313974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7314259Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2122 counts during 2022 steps 2025-03-14T06:00:24.7314265Z 2025-03-14T06:00:24.7314462Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7314595Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7314897Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7315004Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7315203Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7315338Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7315471Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7315639Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7315970Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7316309Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7316607Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7316865Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7317162Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7317414Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7317689Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7317806Z Execution Analysis: (:1) 2025-03-14T06:00:24.7318055Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7318246Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7318252Z 2025-03-14T06:00:24.7318446Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7318553Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7318777Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7318883Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7319079Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7319212Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7319357Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7319514Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7320067Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7320656Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7321002Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7321327Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7321627Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7321882Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7322181Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7322433Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7322541Z Execution Analysis: .......... 2025-03-14T06:00:24.7322784Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7322989Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7323259Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2124 counts during 2023 steps 2025-03-14T06:00:24.7323263Z 2025-03-14T06:00:24.7323505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7323614Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7323888Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7323992Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7324190Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7324325Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7324467Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7324709Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7325229Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7325582Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7325909Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7326188Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7326507Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7326778Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7327081Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7327208Z Execution Analysis: (:1) 2025-03-14T06:00:24.7327479Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7327684Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7327689Z 2025-03-14T06:00:24.7327899Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7328016Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7328257Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7328368Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7328582Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7328729Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7328886Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7329054Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7329651Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7330278Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7330649Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7331001Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7331329Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7331603Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7331922Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7332199Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7332307Z Execution Analysis: .......... 2025-03-14T06:00:24.7332577Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7332782Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7333107Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2125 counts during 2024 steps 2025-03-14T06:00:24.7333112Z 2025-03-14T06:00:24.7333339Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7333463Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7333755Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7333873Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7334077Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7334228Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7334374Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7334555Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7334913Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7335270Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7335589Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7335875Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7336184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7336464Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7336759Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7336893Z Execution Analysis: (:1) 2025-03-14T06:00:24.7337261Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7337456Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7337459Z 2025-03-14T06:00:24.7337650Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7337766Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7337980Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7338091Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7338281Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7338421Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7338558Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7341758Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7342409Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7342946Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7343287Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7343621Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7343911Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7344172Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7344456Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7344713Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7344812Z Execution Analysis: .......... 2025-03-14T06:00:24.7345060Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7345245Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7345575Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2126 counts during 2025 steps 2025-03-14T06:00:24.7345581Z 2025-03-14T06:00:24.7345770Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7345882Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7346148Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7346255Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7346440Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7346581Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7346709Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7346872Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7347203Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7347537Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7347824Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7348083Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7348367Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7348618Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7348886Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7349011Z Execution Analysis: (:1) 2025-03-14T06:00:24.7349247Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7349438Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7349444Z 2025-03-14T06:00:24.7349630Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7349740Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7349952Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7350058Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7350246Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7350384Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7350547Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7350734Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7351283Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7351821Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7352153Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7352483Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7352768Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7353027Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7353309Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7353563Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7353657Z Execution Analysis: .......... 2025-03-14T06:00:24.7353902Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7354151Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7354426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2127 counts during 2026 steps 2025-03-14T06:00:24.7354430Z 2025-03-14T06:00:24.7354623Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7354726Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7354999Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7355099Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7355291Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7355422Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7355556Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7355712Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7356052Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7356373Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7356665Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7356915Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7357203Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7357449Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7357724Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7357837Z Execution Analysis: (:1) 2025-03-14T06:00:24.7358078Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7358263Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7358268Z 2025-03-14T06:00:24.7358629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7358739Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7358965Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7359069Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7359272Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7359438Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7359610Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7359770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7360350Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7360907Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7361258Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7361600Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7361909Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7362178Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7362480Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7362741Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7362849Z Execution Analysis: .......... 2025-03-14T06:00:24.7363144Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7363344Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7363624Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2128 counts during 2027 steps 2025-03-14T06:00:24.7363629Z 2025-03-14T06:00:24.7363831Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7363940Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7364222Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7364330Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7364630Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7364770Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7365083Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7365252Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7365751Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7366102Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7366421Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7366692Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7367011Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7367281Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7367576Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7367699Z Execution Analysis: (:1) 2025-03-14T06:00:24.7367965Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7368163Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7368167Z 2025-03-14T06:00:24.7368371Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7368482Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7368719Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7368825Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7369099Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7369275Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7369423Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7369587Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7370189Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7370760Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7371127Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7371475Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7371796Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7372077Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7372382Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7372656Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7372793Z Execution Analysis: .......... 2025-03-14T06:00:24.7373091Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7373291Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7373589Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2129 counts during 2028 steps 2025-03-14T06:00:24.7373594Z 2025-03-14T06:00:24.7373795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7373917Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7374204Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7374317Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7374519Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7374669Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7374808Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7374977Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7375330Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7375687Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7375995Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7376269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7376578Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7376848Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7377243Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7377361Z Execution Analysis: (:1) 2025-03-14T06:00:24.7377598Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7377785Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7377790Z 2025-03-14T06:00:24.7377974Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7378086Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7378294Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7378443Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7378628Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7378764Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7378899Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7379058Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7379602Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7380132Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7380462Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7380789Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7381080Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7381336Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7381620Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7381922Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7382023Z Execution Analysis: .......... 2025-03-14T06:00:24.7382270Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7382457Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7382739Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2130 counts during 2029 steps 2025-03-14T06:00:24.7382743Z 2025-03-14T06:00:24.7382931Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7383050Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7383320Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7383437Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7383628Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7383777Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7383909Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7384081Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7384418Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7384755Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7385049Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7385321Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7385609Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7385870Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7386147Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7386278Z Execution Analysis: (:1) 2025-03-14T06:00:24.7386519Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7386723Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7386727Z 2025-03-14T06:00:24.7386917Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7387063Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7387279Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7387421Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7387612Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7387763Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7387902Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7388077Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7388627Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7389175Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7389525Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7389857Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7390166Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7390424Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7390778Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7391032Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7391144Z Execution Analysis: .......... 2025-03-14T06:00:24.7391385Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7391586Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7391856Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2131 counts during 2030 steps 2025-03-14T06:00:24.7391863Z 2025-03-14T06:00:24.7392060Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7392167Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7392449Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7392553Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7392758Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7392895Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7393042Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7393201Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7393550Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7393878Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7394180Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7394434Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7394725Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7394977Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7395256Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7395373Z Execution Analysis: (:1) 2025-03-14T06:00:24.7395620Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7395810Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7395814Z 2025-03-14T06:00:24.7396173Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7396333Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7396574Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7396682Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7396890Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7397033Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7397189Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7397353Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7397944Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7398504Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7398868Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7399215Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7399531Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7399827Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7400163Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7400429Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7400546Z Execution Analysis: .......... 2025-03-14T06:00:24.7400799Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7401008Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7401295Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2132 counts during 2031 steps 2025-03-14T06:00:24.7401301Z 2025-03-14T06:00:24.7401507Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7401620Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7401913Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7402027Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7402237Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7402377Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7402527Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7402692Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7403053Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7403395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7403712Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7403979Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7404290Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7404672Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7405141Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7405271Z Execution Analysis: (:1) 2025-03-14T06:00:24.7405543Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7405750Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7405799Z 2025-03-14T06:00:24.7406005Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7406160Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7406394Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7406522Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7406729Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7406889Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7407039Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7407220Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7407812Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7408394Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7408757Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7409121Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7409459Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7409769Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7410075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7410351Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7410458Z Execution Analysis: .......... 2025-03-14T06:00:24.7410726Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7410931Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7411232Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2133 counts during 2032 steps 2025-03-14T06:00:24.7411236Z 2025-03-14T06:00:24.7411441Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7411567Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7411864Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7411983Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7412187Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7412343Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7412488Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7412669Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7413029Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7413395Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7413708Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7413990Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7414305Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7414586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7414880Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7415017Z Execution Analysis: (:1) 2025-03-14T06:00:24.7415275Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7415512Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7415615Z 2025-03-14T06:00:24.7415818Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7415945Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7416177Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7416303Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7416510Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7416665Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7416814Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7416993Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7417656Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7418198Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7418531Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7418867Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7419210Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7419478Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7419767Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7420028Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7420130Z Execution Analysis: .......... 2025-03-14T06:00:24.7420379Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7420571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7420852Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2134 counts during 2033 steps 2025-03-14T06:00:24.7420858Z 2025-03-14T06:00:24.7421057Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7421169Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7421453Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7421556Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7421750Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7421894Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7422029Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7422196Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7422534Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7422874Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7423171Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7423430Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7423725Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7423974Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7424255Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7424372Z Execution Analysis: (:1) 2025-03-14T06:00:24.7424623Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7424871Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7424875Z 2025-03-14T06:00:24.7425073Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7425182Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7425409Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7425513Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7425709Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7425841Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7425981Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7426136Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7426683Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7427215Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7427551Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7427917Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7428208Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7428459Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7428747Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7428994Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7429099Z Execution Analysis: .......... 2025-03-14T06:00:24.7429341Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7429530Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7429796Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2135 counts during 2034 steps 2025-03-14T06:00:24.7429800Z 2025-03-14T06:00:24.7429995Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7430103Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7430373Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7430475Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7430667Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7430799Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7430935Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7431091Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7431426Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7431748Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7432042Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7432292Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7432581Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7432831Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7433105Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7433219Z Execution Analysis: (:1) 2025-03-14T06:00:24.7433486Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7433695Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7433699Z 2025-03-14T06:00:24.7433891Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7434001Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7434218Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7434320Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7434511Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7434640Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7434778Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7434933Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7435484Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7436011Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7436370Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7436714Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7437010Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7437263Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7437547Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7437802Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7437900Z Execution Analysis: .......... 2025-03-14T06:00:24.7438135Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7438326Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7438601Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2136 counts during 2035 steps 2025-03-14T06:00:24.7438606Z 2025-03-14T06:00:24.7438789Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7438896Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7439162Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7439267Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7439452Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7439589Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7439720Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7439878Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7440203Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7440530Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7440817Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7441073Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7441357Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7441606Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7441872Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7442035Z Execution Analysis: (:1) 2025-03-14T06:00:24.7442272Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7442460Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7442464Z 2025-03-14T06:00:24.7442652Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7442758Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7442970Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7443074Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7443261Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7443395Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7443530Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7443691Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7444237Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7445055Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7445439Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7445798Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7446111Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7446395Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7446701Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7446979Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7447086Z Execution Analysis: .......... 2025-03-14T06:00:24.7447346Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7447549Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7447844Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2137 counts during 2036 steps 2025-03-14T06:00:24.7447849Z 2025-03-14T06:00:24.7448052Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7448172Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7448459Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7448576Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7448778Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7448931Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7449071Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7449243Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7449600Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7449955Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7450265Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7450539Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7450847Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7451118Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7451460Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7451588Z Execution Analysis: (:1) 2025-03-14T06:00:24.7451845Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7452054Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7452060Z 2025-03-14T06:00:24.7452257Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7452377Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7452606Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7452720Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7452923Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7453067Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7453216Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7453389Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7453976Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7454597Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7454959Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7455308Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7455624Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7455897Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7456210Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7456477Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7456586Z Execution Analysis: .......... 2025-03-14T06:00:24.7456841Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7457048Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7457426Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2138 counts during 2037 steps 2025-03-14T06:00:24.7457430Z 2025-03-14T06:00:24.7457618Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7457722Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7457994Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7458097Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7458290Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7458422Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7458557Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7458711Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7459041Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7459362Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7459654Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7459903Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7460192Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7460475Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7460777Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7460889Z Execution Analysis: (:1) 2025-03-14T06:00:24.7461130Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7461317Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7461321Z 2025-03-14T06:00:24.7461508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7461610Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7461829Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7461928Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7462121Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7462255Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7462389Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7462540Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7463109Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7463657Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7463990Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7464310Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7464601Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7464856Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7465144Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7465509Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7465778Z Execution Analysis: .......... 2025-03-14T06:00:24.7466041Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7466245Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7466534Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2139 counts during 2038 steps 2025-03-14T06:00:24.7466538Z 2025-03-14T06:00:24.7466745Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7466857Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7467155Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7467267Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7467475Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7467622Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7467767Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7467941Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7468301Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7468651Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7468968Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7469241Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7469606Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7469907Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7470208Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7470331Z Execution Analysis: (:1) 2025-03-14T06:00:24.7470594Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7470794Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7470804Z 2025-03-14T06:00:24.7471002Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7471118Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7471345Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7471461Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7471662Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7471804Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7471953Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7472117Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7472771Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7473353Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7473713Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7474064Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7474377Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7474655Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7474958Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7475230Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7475334Z Execution Analysis: .......... 2025-03-14T06:00:24.7475594Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7475795Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7476090Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2140 counts during 2039 steps 2025-03-14T06:00:24.7476094Z 2025-03-14T06:00:24.7476291Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7476410Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7476696Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7476807Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7477005Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7477153Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7477295Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7477464Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7477816Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7478271Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7478571Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7478863Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7479184Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7479445Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7479725Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7479852Z Execution Analysis: (:1) 2025-03-14T06:00:24.7480100Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7480298Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7480302Z 2025-03-14T06:00:24.7480491Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7480605Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7480828Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7480941Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7481136Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7481279Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7481420Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7481607Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7482204Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7482768Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7483118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7483461Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7483769Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7484036Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7484332Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7484666Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7484769Z Execution Analysis: .......... 2025-03-14T06:00:24.7485193Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7485391Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7485686Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2141 counts during 2040 steps 2025-03-14T06:00:24.7485693Z 2025-03-14T06:00:24.7485892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7486011Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7486296Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7486409Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7486613Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7486761Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7486904Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7487075Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7487428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7487784Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7488094Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7488424Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7488729Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7489003Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7489302Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7489426Z Execution Analysis: (:1) 2025-03-14T06:00:24.7489686Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7489885Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7489889Z 2025-03-14T06:00:24.7490093Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7490207Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7490443Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7490552Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7490758Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7490898Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7491071Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7491271Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7491866Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7492437Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7492793Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7493148Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7493463Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7493733Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7494049Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7494315Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7494426Z Execution Analysis: .......... 2025-03-14T06:00:24.7494684Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7494892Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7495182Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2142 counts during 2041 steps 2025-03-14T06:00:24.7495190Z 2025-03-14T06:00:24.7495395Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7495508Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7495802Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7495910Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7496119Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7496260Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7496406Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7496572Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7496928Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7497380Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7497733Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7497999Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7498300Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7498565Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7498855Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7498972Z Execution Analysis: (:1) 2025-03-14T06:00:24.7499226Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7499420Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7499424Z 2025-03-14T06:00:24.7499625Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7499734Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7499968Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7500073Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7500279Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7500462Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7500610Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7500772Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7501350Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7501905Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7502257Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7502595Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7502901Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7503169Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7503472Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7503730Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7503837Z Execution Analysis: .......... 2025-03-14T06:00:24.7504085Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7504283Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7504566Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2143 counts during 2042 steps 2025-03-14T06:00:24.7504578Z 2025-03-14T06:00:24.7504771Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7504884Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7505166Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7505276Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7505472Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7505614Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7505749Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7505908Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7506257Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7506630Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7506954Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7507220Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7507620Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7507871Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7508139Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7508255Z Execution Analysis: (:1) 2025-03-14T06:00:24.7508493Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7508680Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7508687Z 2025-03-14T06:00:24.7508877Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7508988Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7509198Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7509301Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7509531Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7509668Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7509800Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7509960Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7510504Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7511039Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7511373Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7511704Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7511995Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7512254Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7512534Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7512789Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7512883Z Execution Analysis: .......... 2025-03-14T06:00:24.7513126Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7513314Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7513587Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2145 counts during 2043 steps 2025-03-14T06:00:24.7513591Z 2025-03-14T06:00:24.7513779Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7513890Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7514158Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7514265Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7514452Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7514591Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7514722Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7514887Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7515238Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7515593Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7515880Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7516141Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7516425Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7516678Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7516945Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7517065Z Execution Analysis: (:1) 2025-03-14T06:00:24.7517302Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7517492Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7517498Z 2025-03-14T06:00:24.7517679Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7517789Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7518021Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7518170Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7518358Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7518490Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7518625Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7518781Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7519326Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7519858Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7520189Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7520521Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7520809Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7521064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7521349Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7521594Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7521696Z Execution Analysis: .......... 2025-03-14T06:00:24.7521931Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7522119Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7522384Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2146 counts during 2044 steps 2025-03-14T06:00:24.7522389Z 2025-03-14T06:00:24.7522580Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7522682Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7522954Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7523053Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7523243Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7523374Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7523508Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7523687Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7524044Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7524367Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7524732Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7525158Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7525470Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7525734Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7526028Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7526148Z Execution Analysis: (:1) 2025-03-14T06:00:24.7526412Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7526613Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7526617Z 2025-03-14T06:00:24.7526821Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7526970Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7527229Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7527338Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7527543Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7527683Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7527834Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7527998Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7528589Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7529162Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7529529Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7529881Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7530201Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7530473Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7530784Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7531049Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7531167Z Execution Analysis: .......... 2025-03-14T06:00:24.7531427Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7531637Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7531928Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2147 counts during 2045 steps 2025-03-14T06:00:24.7531934Z 2025-03-14T06:00:24.7532140Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7532253Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7532547Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7532662Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7532869Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7533011Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7533183Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7533375Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7533735Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7534084Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7534404Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7534673Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7534985Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7535252Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7535544Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7535665Z Execution Analysis: (:1) 2025-03-14T06:00:24.7535927Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7536124Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7536128Z 2025-03-14T06:00:24.7536358Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7536499Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7536736Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7536847Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7537055Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7537303Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7537448Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7537612Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7538192Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7538747Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7539106Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7539450Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7539751Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7540024Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7540321Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7540585Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7540689Z Execution Analysis: .......... 2025-03-14T06:00:24.7540943Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7541137Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7541430Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2148 counts during 2046 steps 2025-03-14T06:00:24.7541435Z 2025-03-14T06:00:24.7541629Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7541743Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7542024Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7542134Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7542328Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7542496Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7542658Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7542824Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7543169Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7543516Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7543814Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7544084Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7544382Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7544647Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7544930Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7545056Z Execution Analysis: (:1) 2025-03-14T06:00:24.7545303Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7545508Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7545534Z 2025-03-14T06:00:24.7545753Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7545874Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7546095Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7546205Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7546399Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7546542Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7546685Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7546852Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7547422Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7547984Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7548428Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7548757Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7549044Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7549301Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7549582Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7549836Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7549933Z Execution Analysis: .......... 2025-03-14T06:00:24.7550176Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7550364Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7550638Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2149 counts during 2047 steps 2025-03-14T06:00:24.7550642Z 2025-03-14T06:00:24.7550828Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7550938Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7551207Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7551338Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7551548Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7551685Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7551816Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7551980Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7552312Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7552644Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7552929Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7553186Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7553468Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7553728Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7553995Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7554116Z Execution Analysis: (:1) 2025-03-14T06:00:24.7554353Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7554590Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7554594Z 2025-03-14T06:00:24.7554787Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7554897Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7555112Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7555212Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7555403Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7555533Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7555675Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7555829Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7556376Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7556905Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7557241Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7557563Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7557854Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7558108Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7558398Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7558645Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7558748Z Execution Analysis: .......... 2025-03-14T06:00:24.7558986Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7559177Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7559449Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2150 counts during 2048 steps 2025-03-14T06:00:24.7559454Z 2025-03-14T06:00:24.7559645Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7559746Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7560016Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7560240Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7560433Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7560564Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7560698Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7560850Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7561183Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7561507Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7561799Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7562048Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7562337Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7562586Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7562858Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7562970Z Execution Analysis: (:1) 2025-03-14T06:00:24.7563253Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7563465Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7563469Z 2025-03-14T06:00:24.7563659Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7563764Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7563981Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7564080Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7564271Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7564402Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7564617Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7564770Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7565643Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7566220Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7566584Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7566932Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7567248Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7567522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7567833Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7568098Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7568213Z Execution Analysis: .......... 2025-03-14T06:00:24.7568468Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7568676Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7568966Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2151 counts during 2049 steps 2025-03-14T06:00:24.7568980Z 2025-03-14T06:00:24.7569181Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7569353Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7569682Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7569790Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7569999Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7570143Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7570294Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7570464Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7570826Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7571175Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7571488Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7571765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7572075Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7572346Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7572639Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7572798Z Execution Analysis: (:1) 2025-03-14T06:00:24.7573088Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7573294Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7573298Z 2025-03-14T06:00:24.7573496Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7573616Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7573848Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7573965Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7574170Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7574318Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7574461Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7574634Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7575226Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7575804Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7576159Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7576512Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7576825Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7577212Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7577612Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7577869Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7577964Z Execution Analysis: .......... 2025-03-14T06:00:24.7578207Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7578392Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7578662Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2152 counts during 2050 steps 2025-03-14T06:00:24.7578668Z 2025-03-14T06:00:24.7578854Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7579006Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7579271Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7579377Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7579563Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7579699Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7579832Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7579991Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7580320Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7580647Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7580934Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7581372Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7581675Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7581940Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7582245Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7582396Z Execution Analysis: (:1) 2025-03-14T06:00:24.7582647Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7582846Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7582850Z 2025-03-14T06:00:24.7583042Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7583156Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7583378Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7583493Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7583688Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7583836Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7583979Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7584149Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7584721Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7585280Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7585628Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7585976Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7586281Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7586552Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7586852Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7587121Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7587220Z Execution Analysis: .......... 2025-03-14T06:00:24.7587474Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7587668Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7587954Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2153 counts during 2051 steps 2025-03-14T06:00:24.7587983Z 2025-03-14T06:00:24.7588210Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7588318Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7588602Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7588707Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7588913Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7589049Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7589190Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7589349Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7589701Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7590040Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7590348Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7590613Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7590913Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7591193Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7591514Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7591632Z Execution Analysis: (:1) 2025-03-14T06:00:24.7591892Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7592085Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7592089Z 2025-03-14T06:00:24.7592291Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7592403Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7592634Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7592739Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7593049Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7593181Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7593326Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7593480Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7594029Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7594553Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7594891Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7595216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7595512Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7595765Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7596227Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7596489Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7596600Z Execution Analysis: .......... 2025-03-14T06:00:24.7596850Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7597058Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7597382Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2154 counts during 2052 steps 2025-03-14T06:00:24.7597410Z 2025-03-14T06:00:24.7597616Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7597725Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7598017Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7598126Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7598330Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7598468Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7598615Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7598775Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7599130Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7599473Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7599783Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7600046Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7600356Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7600661Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7600951Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7601068Z Execution Analysis: (:1) 2025-03-14T06:00:24.7601323Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7601517Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7601523Z 2025-03-14T06:00:24.7601731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7601841Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7602069Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7602174Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7602378Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7602519Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7602667Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7602826Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7603407Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7603961Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7604319Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7604763Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7605239Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7605522Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7605827Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7606103Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7606208Z Execution Analysis: .......... 2025-03-14T06:00:24.7606473Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7606705Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7607027Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2155 counts during 2053 steps 2025-03-14T06:00:24.7607032Z 2025-03-14T06:00:24.7607230Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7607351Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7607641Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7607757Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7607954Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7608104Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7608241Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7608411Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7608762Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7609123Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7609430Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7609711Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7610062Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7610339Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7610629Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7610759Z Execution Analysis: (:1) 2025-03-14T06:00:24.7611016Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7611225Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7611233Z 2025-03-14T06:00:24.7611430Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7611552Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7611780Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7611899Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7612102Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7612257Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7612403Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7612579Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7613166Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7613748Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7614107Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7614467Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7614780Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7615064Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7615370Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7615644Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7615747Z Execution Analysis: .......... 2025-03-14T06:00:24.7616012Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7616260Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7616561Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2156 counts during 2054 steps 2025-03-14T06:00:24.7616566Z 2025-03-14T06:00:24.7616766Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7616891Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7617280Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7617392Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7617578Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7617716Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7617843Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7618011Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7618342Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7618680Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7618966Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7619269Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7619550Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7619804Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7620071Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7620196Z Execution Analysis: (:1) 2025-03-14T06:00:24.7620433Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7620628Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7620633Z 2025-03-14T06:00:24.7620822Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7620926Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7621151Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7621248Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7621434Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7621572Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7621709Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7621871Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7622414Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7622949Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7623286Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7623611Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7623902Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7624152Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7624442Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7624687Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7624818Z Execution Analysis: .......... 2025-03-14T06:00:24.7625053Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7625267Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7625532Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2157 counts during 2055 steps 2025-03-14T06:00:24.7625536Z 2025-03-14T06:00:24.7625731Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7625834Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7626109Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7626208Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7626405Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7626537Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7626676Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7626834Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7627171Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7627494Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7627845Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7628097Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7628390Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7628637Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7628916Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7629028Z Execution Analysis: (:1) 2025-03-14T06:00:24.7629273Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7629460Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7629464Z 2025-03-14T06:00:24.7629662Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7629767Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7629990Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7630090Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7630289Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7630417Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7630561Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7630714Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7631262Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7631786Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7632128Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7632451Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7632745Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7632995Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7633286Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7633532Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7633682Z Execution Analysis: .......... 2025-03-14T06:00:24.7633919Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7634112Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7634383Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2158 counts during 2056 steps 2025-03-14T06:00:24.7634387Z 2025-03-14T06:00:24.7634583Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7634687Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7634962Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7635062Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7635260Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7635396Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7635539Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7635695Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7636038Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7636384Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7636704Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7636956Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7637244Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7637492Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7637770Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7637890Z Execution Analysis: (:1) 2025-03-14T06:00:24.7638137Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7638335Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7638339Z 2025-03-14T06:00:24.7638524Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7638635Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7638848Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7638955Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7639142Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7639282Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7639416Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7639581Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7640128Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7640665Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7640997Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7641325Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7641611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7641868Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7642149Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7642465Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7642559Z Execution Analysis: .......... 2025-03-14T06:00:24.7642805Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7642991Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7643269Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2159 counts during 2057 steps 2025-03-14T06:00:24.7643273Z 2025-03-14T06:00:24.7643457Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7643571Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7643834Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7643945Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7644130Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7644270Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7644397Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7644634Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7645136Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7645548Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7645856Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7646134Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7646438Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7646717Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7647007Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7647138Z Execution Analysis: (:1) 2025-03-14T06:00:24.7647393Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7647606Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7647612Z 2025-03-14T06:00:24.7647811Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7647931Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7648158Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7648275Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7648475Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7648623Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7648768Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7648943Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7649533Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7650113Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7650470Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7650828Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7651140Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7651420Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7651749Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7652052Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7652155Z Execution Analysis: .......... 2025-03-14T06:00:24.7652417Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7652620Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7652920Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2160 counts during 2058 steps 2025-03-14T06:00:24.7652925Z 2025-03-14T06:00:24.7653133Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7653243Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7653538Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7653648Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7653863Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7654005Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7654148Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7654323Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7654920Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7655284Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7655611Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7655884Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7656200Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7656471Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7656773Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7656896Z Execution Analysis: (:1) 2025-03-14T06:00:24.7657265Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7657452Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7657456Z 2025-03-14T06:00:24.7657647Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7657753Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7657974Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7658074Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7658270Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7658403Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7658544Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7658698Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7659251Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7659778Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7660118Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7660438Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7660731Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7661007Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7661325Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7661570Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7661676Z Execution Analysis: .......... 2025-03-14T06:00:24.7661915Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7662108Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7662375Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2161 counts during 2059 steps 2025-03-14T06:00:24.7662379Z 2025-03-14T06:00:24.7662571Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7662677Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7662950Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7663051Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7663249Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7663380Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7663526Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7663738Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7664082Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7664402Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7664697Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7664948Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7665242Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7665767Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7666071Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7666193Z Execution Analysis: (:1) 2025-03-14T06:00:24.7666463Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7666664Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7666668Z 2025-03-14T06:00:24.7666880Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7666991Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7667229Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7667340Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7667551Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7667691Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7667845Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7668011Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7668610Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7669180Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7669547Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7669898Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7670271Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7670582Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7670896Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7671170Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7671280Z Execution Analysis: .......... 2025-03-14T06:00:24.7671547Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7671743Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7672040Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2162 counts during 2060 steps 2025-03-14T06:00:24.7672046Z 2025-03-14T06:00:24.7672244Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7672363Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7672650Z Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:00:24.7672767Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7672967Z Execution Analysis: Graph Hash: 8a01acb3a2ebd41ca454ff7cecce6a8 2025-03-14T06:00:24.7673119Z Execution Analysis: Number of Graph Inputs: 18 2025-03-14T06:00:24.7673323Z Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:00:24.7673501Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7673855Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:187) 2025-03-14T06:00:24.7674216Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7674524Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7674811Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7675118Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7675393Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7675687Z Execution Analysis: spawn_main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:116) 2025-03-14T06:00:24.7675823Z Execution Analysis: (:1) 2025-03-14T06:00:24.7676086Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7676297Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7676302Z 2025-03-14T06:00:24.7676505Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7676630Z Execution Analysis: Execution Cause 2025-03-14T06:00:24.7676868Z Execution Analysis: mark_step when exiting a profiler StepTrace region 2025-03-14T06:00:24.7676993Z Execution Analysis: Graph Info: 2025-03-14T06:00:24.7677200Z Execution Analysis: Graph Hash: 6e56af7790180391eddf27d3d13d121d 2025-03-14T06:00:24.7677351Z Execution Analysis: Number of Graph Inputs: 34 2025-03-14T06:00:24.7677499Z Execution Analysis: Number of Graph Outputs: 53 2025-03-14T06:00:24.7677677Z Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:00:24.7678458Z Execution Analysis: mark_step (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:1046) 2025-03-14T06:00:24.7678998Z Execution Analysis: __exit__ (/opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/debug/profiler.py:170) 2025-03-14T06:00:24.7679331Z Execution Analysis: train_loop_fn (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:178) 2025-03-14T06:00:24.7679664Z Execution Analysis: train_mnist (/var/lib/jenkins/workspace/xla/test/test_profile_mp_mnist.py:213) 2025-03-14T06:00:24.7680001Z Execution Analysis: train_worker (/var/lib/jenkins/workspace/xla/test/test_profiler.py:35) 2025-03-14T06:00:24.7680265Z Execution Analysis: run (/opt/conda/lib/python3.10/multiprocessing/process.py:108) 2025-03-14T06:00:24.7680552Z Execution Analysis: _bootstrap (/opt/conda/lib/python3.10/multiprocessing/process.py:314) 2025-03-14T06:00:24.7680812Z Execution Analysis: _main (/opt/conda/lib/python3.10/multiprocessing/spawn.py:129) 2025-03-14T06:00:24.7680910Z Execution Analysis: .......... 2025-03-14T06:00:24.7681158Z Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:00:24.7681347Z Execution Analysis: ================================================================================ 2025-03-14T06:00:24.7681625Z pt-xla-profiler: TransferFromDeviceTime too frequent: 2163 counts during 2061 steps 2025-03-14T06:00:24.7681629Z 2025-03-14T06:00:24.7681707Z . 2025-03-14T06:00:24.7681860Z ---------------------------------------------------------------------- 2025-03-14T06:00:24.7681950Z Ran 1 test in 67.348s 2025-03-14T06:00:24.7681955Z 2025-03-14T06:00:24.7682037Z OK 2025-03-14T06:00:24.7682289Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py 2025-03-14T06:00:24.7682580Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py' 2025-03-14T06:00:24.7682880Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py 2025-03-14T06:00:24.7682989Z ++ command -v nvidia-smi 2025-03-14T06:00:24.7683071Z + '[' -x '' ']' 2025-03-14T06:00:24.7683167Z + PJRT_DEVICE=CPU 2025-03-14T06:00:24.7683255Z + CPU_NUM_DEVICES=1 2025-03-14T06:00:24.7683481Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py 2025-03-14T06:00:24.7683562Z + '[' 0 '!=' 0 ']' 2025-03-14T06:00:24.7683768Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime.py 2025-03-14T06:00:26.5047387Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:00:26.5067892Z [ RUN ] TestExperimentalPjrt.test_default_ordinals 2025-03-14T06:00:26.5068471Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2025-03-14T06:00:26.5069105Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2025-03-14T06:00:26.5069734Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2025-03-14T06:00:26.5070353Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2025-03-14T06:00:26.5076624Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2025-03-14T06:00:26.5152792Z [ OK ] TestExperimentalPjrt.test_default_ordinals 2025-03-14T06:00:26.5153337Z [ RUN ] TestExperimentalPjrt.test_device_type0 ('CPU', 'CPU') 2025-03-14T06:00:26.5157679Z [ OK ] TestExperimentalPjrt.test_device_type0 ('CPU', 'CPU') 2025-03-14T06:00:26.5158201Z [ RUN ] TestExperimentalPjrt.test_device_type1 ('CUDA', 'CUDA') 2025-03-14T06:00:26.5163558Z [ OK ] TestExperimentalPjrt.test_device_type1 ('CUDA', 'CUDA') 2025-03-14T06:00:26.5164080Z [ RUN ] TestExperimentalPjrt.test_device_type2 ('TPU', 'TPU') 2025-03-14T06:00:26.5169913Z [ OK ] TestExperimentalPjrt.test_device_type2 ('TPU', 'TPU') 2025-03-14T06:00:26.5170372Z [ RUN ] TestExperimentalPjrt.test_host_index 2025-03-14T06:00:26.5170792Z [ OK ] TestExperimentalPjrt.test_host_index 2025-03-14T06:00:26.5171227Z [ RUN ] TestExperimentalPjrt.test_num_global_devices 2025-03-14T06:00:26.5171673Z [ OK ] TestExperimentalPjrt.test_num_global_devices 2025-03-14T06:00:26.5172115Z [ RUN ] TestExperimentalPjrt.test_num_local_devices 2025-03-14T06:00:26.5172551Z [ OK ] TestExperimentalPjrt.test_num_local_devices 2025-03-14T06:00:26.5173023Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_default 2025-03-14T06:00:26.5244377Z W0314 06:00:26.523959 139689497982144 runtime.py:79] Defaulting to PJRT_DEVICE=CPU 2025-03-14T06:00:26.5245731Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_default 2025-03-14T06:00:26.5246498Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_gpu_num_devives 2025-03-14T06:00:26.5314043Z W0314 06:00:26.530740 139689497982144 runtime.py:66] GPU_NUM_DEVICES is set. Setting PJRT_DEVICE=CUDA 2025-03-14T06:00:26.5314753Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_gpu_num_devives 2025-03-14T06:00:26.5315337Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_no_default 2025-03-14T06:00:26.5375598Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_no_default 2025-03-14T06:00:26.5376164Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_cpu 2025-03-14T06:00:26.5447350Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_cpu 2025-03-14T06:00:26.5447904Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_gpu 2025-03-14T06:00:26.5514132Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_gpu 2025-03-14T06:00:26.5514815Z [ RUN ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_tpu_precedence 2025-03-14T06:00:26.5575057Z [ OK ] TestExperimentalPjrt.test_pjrt_default_device_pjrt_tpu_precedence 2025-03-14T06:00:26.5575615Z [ RUN ] TestExperimentalPjrt.test_set_device_type 2025-03-14T06:00:26.5582259Z [ OK ] TestExperimentalPjrt.test_set_device_type 2025-03-14T06:00:26.5582836Z [ RUN ] TestExperimentalPjrt.test_set_device_type_error 2025-03-14T06:00:26.5590428Z [ OK ] TestExperimentalPjrt.test_set_device_type_error 2025-03-14T06:00:26.5590922Z [ RUN ] TestExperimentalPjrt.test_set_device_type_same_device 2025-03-14T06:00:26.5598405Z [ OK ] TestExperimentalPjrt.test_set_device_type_same_device 2025-03-14T06:00:26.5598894Z [ RUN ] TestExperimentalPjrt.test_xla_device_error 2025-03-14T06:00:26.5599319Z [ OK ] TestExperimentalPjrt.test_xla_device_error 2025-03-14T06:00:26.5599755Z ---------------------------------------------------------------------- 2025-03-14T06:00:26.5600153Z Ran 17 tests in 0.054s 2025-03-14T06:00:26.5600325Z 2025-03-14T06:00:26.5600424Z OK 2025-03-14T06:00:27.1747078Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py 2025-03-14T06:00:27.1747953Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py' 2025-03-14T06:00:27.1748850Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py 2025-03-14T06:00:27.1749455Z ++ command -v nvidia-smi 2025-03-14T06:00:27.1749749Z + '[' -x '' ']' 2025-03-14T06:00:27.1749996Z + PJRT_DEVICE=CPU 2025-03-14T06:00:27.1750248Z + CPU_NUM_DEVICES=1 2025-03-14T06:00:27.1750729Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py 2025-03-14T06:00:27.1751259Z + '[' 0 '!=' 0 ']' 2025-03-14T06:00:27.1751705Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_single_proc_gpu.py 2025-03-14T06:00:30.3707472Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:00:30.3727054Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_addressable_device_count 2025-03-14T06:00:30.3727789Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_addressable_device_count 2025-03-14T06:00:30.3728486Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_addressable_runtime_device_count 2025-03-14T06:00:30.3729228Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_addressable_runtime_device_count 2025-03-14T06:00:30.3729912Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_local_process_count 2025-03-14T06:00:30.3730519Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_local_process_count 2025-03-14T06:00:30.3731144Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_num_global_device_count 2025-03-14T06:00:30.3731789Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_num_global_device_count 2025-03-14T06:00:30.3732410Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_num_local_devices 2025-03-14T06:00:30.3732996Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_num_local_devices 2025-03-14T06:00:30.3733785Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_ordinal 2025-03-14T06:00:30.3734291Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_ordinal 2025-03-14T06:00:30.3734818Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_process_count 2025-03-14T06:00:30.3735372Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_process_count 2025-03-14T06:00:30.3735930Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_process_index 2025-03-14T06:00:30.3736477Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_process_index 2025-03-14T06:00:30.3737016Z [ RUN ] TestExperimentalSingleProcPjrtGpu.test_world_size 2025-03-14T06:00:30.3737538Z [ SKIPPED ] TestExperimentalSingleProcPjrtGpu.test_world_size 2025-03-14T06:00:30.3738035Z ---------------------------------------------------------------------- 2025-03-14T06:00:30.3738425Z Ran 9 tests in 0.000s 2025-03-14T06:00:30.3738590Z 2025-03-14T06:00:30.3738701Z OK (skipped=9) 2025-03-14T06:00:30.9866342Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py 2025-03-14T06:00:30.9867222Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py' 2025-03-14T06:00:30.9868040Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py 2025-03-14T06:00:30.9868612Z ++ command -v nvidia-smi 2025-03-14T06:00:30.9868891Z + '[' -x '' ']' 2025-03-14T06:00:30.9869380Z + PJRT_DEVICE=CPU 2025-03-14T06:00:30.9869645Z + CPU_NUM_DEVICES=1 2025-03-14T06:00:30.9870104Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py 2025-03-14T06:00:30.9870612Z + '[' 0 '!=' 0 ']' 2025-03-14T06:00:30.9871033Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_gpu.py 2025-03-14T06:00:34.1842487Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:00:34.1863357Z [ RUN ] TestExperimentalPjrtMultiGpu.test_addressable_device_count 2025-03-14T06:00:34.1864050Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_addressable_device_count 2025-03-14T06:00:34.1864708Z [ RUN ] TestExperimentalPjrtMultiGpu.test_addressable_runtime_device_count 2025-03-14T06:00:34.1865567Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_addressable_runtime_device_count 2025-03-14T06:00:34.1866179Z [ RUN ] TestExperimentalPjrtMultiGpu.test_all_gather_pinned 2025-03-14T06:00:34.1866718Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_all_gather_pinned 2025-03-14T06:00:34.1867266Z [ RUN ] TestExperimentalPjrtMultiGpu.test_all_gather_unpinned 2025-03-14T06:00:34.1867810Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_all_gather_unpinned 2025-03-14T06:00:34.1868348Z [ RUN ] TestExperimentalPjrtMultiGpu.test_all_to_all_pinned 2025-03-14T06:00:34.1868873Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_all_to_all_pinned 2025-03-14T06:00:34.1869408Z [ RUN ] TestExperimentalPjrtMultiGpu.test_all_to_all_unpinned 2025-03-14T06:00:34.1869949Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_all_to_all_unpinned 2025-03-14T06:00:34.1870623Z [ RUN ] TestExperimentalPjrtMultiGpu.test_broadcast_master_param_synchronized_parameters 2025-03-14T06:00:34.1871415Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_broadcast_master_param_synchronized_parameters 2025-03-14T06:00:34.1872212Z [ RUN ] TestExperimentalPjrtMultiGpu.test_broadcast_master_param_unsynchronized_parameters 2025-03-14T06:00:34.1873022Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_broadcast_master_param_unsynchronized_parameters 2025-03-14T06:00:34.1873699Z [ RUN ] TestExperimentalPjrtMultiGpu.test_default_gpu_device 2025-03-14T06:00:34.1874238Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_default_gpu_device 2025-03-14T06:00:34.1874779Z [ RUN ] TestExperimentalPjrtMultiGpu.test_global_device_count 2025-03-14T06:00:34.1875328Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_global_device_count 2025-03-14T06:00:34.1875856Z [ RUN ] TestExperimentalPjrtMultiGpu.test_global_ordinal 2025-03-14T06:00:34.1876536Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_global_ordinal 2025-03-14T06:00:34.1877102Z [ RUN ] TestExperimentalPjrtMultiGpu.test_local_device_count 2025-03-14T06:00:34.1877640Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_local_device_count 2025-03-14T06:00:34.1878157Z [ RUN ] TestExperimentalPjrtMultiGpu.test_local_ordinal 2025-03-14T06:00:34.1878656Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_local_ordinal 2025-03-14T06:00:34.1879187Z [ RUN ] TestExperimentalPjrtMultiGpu.test_local_process_count 2025-03-14T06:00:34.1879736Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_local_process_count 2025-03-14T06:00:34.1880280Z [ RUN ] TestExperimentalPjrtMultiGpu.test_multi_gpu_backwards 2025-03-14T06:00:34.1880825Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_multi_gpu_backwards 2025-03-14T06:00:34.1881376Z [ RUN ] TestExperimentalPjrtMultiGpu.test_multi_gpu_devices 2025-03-14T06:00:34.1881899Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_multi_gpu_devices 2025-03-14T06:00:34.1882419Z [ RUN ] TestExperimentalPjrtMultiGpu.test_process_count 2025-03-14T06:00:34.1882928Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_process_count 2025-03-14T06:00:34.1883430Z [ RUN ] TestExperimentalPjrtMultiGpu.test_process_index 2025-03-14T06:00:34.1883929Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_process_index 2025-03-14T06:00:34.1884454Z [ RUN ] TestExperimentalPjrtMultiGpu.test_reduce_scatter_pinned 2025-03-14T06:00:34.1885211Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_reduce_scatter_pinned 2025-03-14T06:00:34.1885792Z [ RUN ] TestExperimentalPjrtMultiGpu.test_reduce_scatter_unpinned 2025-03-14T06:00:34.1886377Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_reduce_scatter_unpinned 2025-03-14T06:00:34.1886915Z [ RUN ] TestExperimentalPjrtMultiGpu.test_spawn_pjrt 2025-03-14T06:00:34.1887392Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_spawn_pjrt 2025-03-14T06:00:34.1887868Z [ RUN ] TestExperimentalPjrtMultiGpu.test_spawn_xmp 2025-03-14T06:00:34.1888336Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_spawn_xmp 2025-03-14T06:00:34.1888806Z [ RUN ] TestExperimentalPjrtMultiGpu.test_world_size 2025-03-14T06:00:34.1889279Z [ SKIPPED ] TestExperimentalPjrtMultiGpu.test_world_size 2025-03-14T06:00:34.1889746Z ---------------------------------------------------------------------- 2025-03-14T06:00:34.1890136Z Ran 23 tests in 0.000s 2025-03-14T06:00:34.1890303Z 2025-03-14T06:00:34.1890415Z OK (skipped=23) 2025-03-14T06:00:34.7935869Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py 2025-03-14T06:00:34.7936681Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py' 2025-03-14T06:00:34.7937488Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py 2025-03-14T06:00:34.7938182Z ++ command -v nvidia-smi 2025-03-14T06:00:34.7940455Z + '[' -x '' ']' 2025-03-14T06:00:34.7940788Z + PJRT_DEVICE=CPU 2025-03-14T06:00:34.7941047Z + CPU_NUM_DEVICES=1 2025-03-14T06:00:34.7941511Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py 2025-03-14T06:00:34.7942034Z + '[' 0 '!=' 0 ']' 2025-03-14T06:00:34.7942465Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_runtime_multi_cpu.py 2025-03-14T06:00:37.9795130Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:00:37.9810891Z [ RUN ] TestExperimentalPjrtMultiCpu.test_all_reduce_no_op_with_one_replica 2025-03-14T06:00:37.9811619Z [ SKIPPED ] TestExperimentalPjrtMultiCpu.test_all_reduce_no_op_with_one_replica 2025-03-14T06:00:37.9812236Z [ RUN ] TestExperimentalPjrtMultiCpu.test_default_cpu_device 2025-03-14T06:00:41.7812147Z [ OK ] TestExperimentalPjrtMultiCpu.test_default_cpu_device 2025-03-14T06:00:41.7812758Z [ RUN ] TestExperimentalPjrtMultiCpu.test_global_ordinal 2025-03-14T06:00:45.5674388Z [ OK ] TestExperimentalPjrtMultiCpu.test_global_ordinal 2025-03-14T06:00:45.5674925Z [ RUN ] TestExperimentalPjrtMultiCpu.test_hlo_dump 2025-03-14T06:00:49.5749898Z [ OK ] TestExperimentalPjrtMultiCpu.test_hlo_dump 2025-03-14T06:00:49.5750803Z [ RUN ] TestExperimentalPjrtMultiCpu.test_local_ordinal 2025-03-14T06:00:53.3927629Z [ OK ] TestExperimentalPjrtMultiCpu.test_local_ordinal 2025-03-14T06:00:53.3928227Z [ RUN ] TestExperimentalPjrtMultiCpu.test_multi_cpu_backwards 2025-03-14T06:00:57.3270924Z [ OK ] TestExperimentalPjrtMultiCpu.test_multi_cpu_backwards 2025-03-14T06:00:57.3271554Z [ RUN ] TestExperimentalPjrtMultiCpu.test_multi_cpu_devices 2025-03-14T06:01:01.1048384Z [ OK ] TestExperimentalPjrtMultiCpu.test_multi_cpu_devices 2025-03-14T06:01:01.1048956Z [ RUN ] TestExperimentalPjrtMultiCpu.test_spawn_pjrt 2025-03-14T06:01:04.9127795Z [ OK ] TestExperimentalPjrtMultiCpu.test_spawn_pjrt 2025-03-14T06:01:04.9128325Z [ RUN ] TestExperimentalPjrtMultiCpu.test_spawn_xmp 2025-03-14T06:01:08.7465854Z [ OK ] TestExperimentalPjrtMultiCpu.test_spawn_xmp 2025-03-14T06:01:08.7466430Z ---------------------------------------------------------------------- 2025-03-14T06:01:08.7466847Z Ran 9 tests in 30.765s 2025-03-14T06:01:08.7467032Z 2025-03-14T06:01:08.7467133Z OK (skipped=1) 2025-03-14T06:01:09.4093449Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py 2025-03-14T06:01:09.4094256Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py' 2025-03-14T06:01:09.4095368Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py 2025-03-14T06:01:09.4095932Z ++ command -v nvidia-smi 2025-03-14T06:01:09.4097867Z + '[' -x '' ']' 2025-03-14T06:01:09.4098118Z + PJRT_DEVICE=CPU 2025-03-14T06:01:09.4098377Z + CPU_NUM_DEVICES=1 2025-03-14T06:01:09.4098809Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py 2025-03-14T06:01:09.4099293Z + '[' 0 '!=' 0 ']' 2025-03-14T06:01:09.4099692Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py 2025-03-14T06:01:12.5990848Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:01:12.6007444Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v3-8_process_0 2025-03-14T06:01:12.6025037Z /var/lib/jenkins/workspace/xla/test/pjrt/test_internal_tpu.py:331: DeprecationWarning: assertDictContainsSubset is deprecated 2025-03-14T06:01:12.6025898Z self.assertDictContainsSubset(expected, os.environ) 2025-03-14T06:01:12.6026461Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v3-8_process_0 2025-03-14T06:01:12.6027099Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v4-16_worker_1_process_0 2025-03-14T06:01:12.6037802Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v4-16_worker_1_process_0 2025-03-14T06:01:12.6038485Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v4-8_process_0 2025-03-14T06:01:12.6043753Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v4-8_process_0 2025-03-14T06:01:12.6044338Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v4-8_process_3 2025-03-14T06:01:12.6067512Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v4-8_process_3 2025-03-14T06:01:12.6068174Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v5-4_process_0 2025-03-14T06:01:12.6074007Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v5-4_process_0 2025-03-14T06:01:12.6074634Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v5abcdefg-16_process_0 2025-03-14T06:01:12.6084341Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v5abcdefg-16_process_0 2025-03-14T06:01:12.6085101Z [ RUN ] TestExperimentalTpu.test_configure_tpu_topology_v5abcdefg-4_process_0 2025-03-14T06:01:12.6095730Z [ OK ] TestExperimentalTpu.test_configure_tpu_topology_v5abcdefg-4_process_0 2025-03-14T06:01:12.6096308Z [ RUN ] TestExperimentalTpu.test_get_worker_ips_four_hosts 2025-03-14T06:01:12.6098429Z [ OK ] TestExperimentalTpu.test_get_worker_ips_four_hosts 2025-03-14T06:01:12.6098910Z [ RUN ] TestExperimentalTpu.test_get_worker_ips_one_host 2025-03-14T06:01:12.6100666Z [ OK ] TestExperimentalTpu.test_get_worker_ips_one_host 2025-03-14T06:01:12.6101170Z [ RUN ] TestExperimentalTpu.test_num_available_chips_four_chips 2025-03-14T06:01:12.6133655Z [ OK ] TestExperimentalTpu.test_num_available_chips_four_chips 2025-03-14T06:01:12.6134229Z [ RUN ] TestExperimentalTpu.test_num_available_chips_no_chips 2025-03-14T06:01:12.6153403Z [ OK ] TestExperimentalTpu.test_num_available_chips_no_chips 2025-03-14T06:01:12.6154038Z [ RUN ] TestExperimentalTpu.test_num_available_chips_one_chip 2025-03-14T06:01:12.6167715Z [ OK ] TestExperimentalTpu.test_num_available_chips_one_chip 2025-03-14T06:01:12.6168236Z [ RUN ] TestExperimentalTpu.test_num_available_devices_v2-8 2025-03-14T06:01:12.6172415Z [ OK ] TestExperimentalTpu.test_num_available_devices_v2-8 2025-03-14T06:01:12.6172909Z [ RUN ] TestExperimentalTpu.test_num_available_devices_v3-8 2025-03-14T06:01:12.6176482Z [ OK ] TestExperimentalTpu.test_num_available_devices_v3-8 2025-03-14T06:01:12.6176979Z [ RUN ] TestExperimentalTpu.test_num_available_devices_v4-8 2025-03-14T06:01:12.6180593Z [ OK ] TestExperimentalTpu.test_num_available_devices_v4-8 2025-03-14T06:01:12.6181123Z [ RUN ] TestExperimentalTpu.test_num_available_devices_v4-8_one_chip 2025-03-14T06:01:12.6185681Z [ OK ] TestExperimentalTpu.test_num_available_devices_v4-8_one_chip 2025-03-14T06:01:12.6186318Z [ RUN ] TestExperimentalTpu.test_num_local_processes_default_one_host 2025-03-14T06:01:12.6193562Z [ OK ] TestExperimentalTpu.test_num_local_processes_default_one_host 2025-03-14T06:01:12.6194200Z [ RUN ] TestExperimentalTpu.test_num_local_processes_multi_process_one_host 2025-03-14T06:01:12.6201661Z [ OK ] TestExperimentalTpu.test_num_local_processes_multi_process_one_host 2025-03-14T06:01:12.6202300Z [ RUN ] TestExperimentalTpu.test_num_local_processes_multi_process_v4-16 2025-03-14T06:01:12.6210571Z [ OK ] TestExperimentalTpu.test_num_local_processes_multi_process_v4-16 2025-03-14T06:01:12.6211194Z [ RUN ] TestExperimentalTpu.test_num_local_processes_multi_process_v4-32 2025-03-14T06:01:12.6218523Z [ OK ] TestExperimentalTpu.test_num_local_processes_multi_process_v4-32 2025-03-14T06:01:12.6219140Z [ RUN ] TestExperimentalTpu.test_num_local_processes_one_process_one_host 2025-03-14T06:01:12.6226464Z [ OK ] TestExperimentalTpu.test_num_local_processes_one_process_one_host 2025-03-14T06:01:12.6227079Z [ RUN ] TestExperimentalTpu.test_num_local_processes_single_chip_default 2025-03-14T06:01:12.6234340Z [ OK ] TestExperimentalTpu.test_num_local_processes_single_chip_default 2025-03-14T06:01:12.6234968Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_default_one_host 2025-03-14T06:01:12.6240089Z [ OK ] TestExperimentalTpu.test_process_bounds_size_default_one_host 2025-03-14T06:01:12.6240687Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_multi_process_one_host 2025-03-14T06:01:12.6246224Z [ OK ] TestExperimentalTpu.test_process_bounds_size_multi_process_one_host 2025-03-14T06:01:12.6246842Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_multi_process_v4-16 2025-03-14T06:01:12.6251762Z [ OK ] TestExperimentalTpu.test_process_bounds_size_multi_process_v4-16 2025-03-14T06:01:12.6252360Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_multi_process_v4-32 2025-03-14T06:01:12.6257593Z [ OK ] TestExperimentalTpu.test_process_bounds_size_multi_process_v4-32 2025-03-14T06:01:12.6258200Z [ RUN ] TestExperimentalTpu.test_process_bounds_size_one_process_one_host 2025-03-14T06:01:12.6263326Z [ OK ] TestExperimentalTpu.test_process_bounds_size_one_process_one_host 2025-03-14T06:01:12.6263863Z [ RUN ] TestExperimentalTpu.test_task_id0 (None, None) 2025-03-14T06:01:12.6269305Z [ OK ] TestExperimentalTpu.test_task_id0 (None, None) 2025-03-14T06:01:12.6269751Z [ RUN ] TestExperimentalTpu.test_task_id1 ('0', 0) 2025-03-14T06:01:12.6274934Z [ OK ] TestExperimentalTpu.test_task_id1 ('0', 0) 2025-03-14T06:01:12.6275423Z [ RUN ] TestExperimentalTpu.test_task_id2 ('1', 1) 2025-03-14T06:01:12.6280618Z [ OK ] TestExperimentalTpu.test_task_id2 ('1', 1) 2025-03-14T06:01:12.6281051Z [ RUN ] TestExperimentalTpu.test_task_id3 ('15', 15) 2025-03-14T06:01:12.6286434Z [ OK ] TestExperimentalTpu.test_task_id3 ('15', 15) 2025-03-14T06:01:12.6286943Z [ RUN ] TestExperimentalTpu.test_tpu_env_from_env_vars_all-vars-set 2025-03-14T06:01:12.6292487Z [ OK ] TestExperimentalTpu.test_tpu_env_from_env_vars_all-vars-set 2025-03-14T06:01:12.6293057Z [ RUN ] TestExperimentalTpu.test_tpu_env_from_env_vars_defaults-only 2025-03-14T06:01:12.6298410Z [ OK ] TestExperimentalTpu.test_tpu_env_from_env_vars_defaults-only 2025-03-14T06:01:12.6298954Z [ RUN ] TestExperimentalTpu.test_tpu_env_from_gce_metadata_v4 2025-03-14T06:01:12.6320381Z [ OK ] TestExperimentalTpu.test_tpu_env_from_gce_metadata_v4 2025-03-14T06:01:12.6321030Z [ RUN ] TestExperimentalTpu.test_tpu_env_from_gce_metadata_v5 2025-03-14T06:01:12.6329887Z [ OK ] TestExperimentalTpu.test_tpu_env_from_gce_metadata_v5 2025-03-14T06:01:12.6330380Z [ RUN ] TestExperimentalTpu.test_worker_id0 ('0', 0) 2025-03-14T06:01:12.6332313Z [ OK ] TestExperimentalTpu.test_worker_id0 ('0', 0) 2025-03-14T06:01:12.6332878Z [ RUN ] TestExperimentalTpu.test_worker_id1 ('1', 1) 2025-03-14T06:01:12.6334713Z [ OK ] TestExperimentalTpu.test_worker_id1 ('1', 1) 2025-03-14T06:01:12.6335161Z [ RUN ] TestExperimentalTpu.test_worker_id2 ('15', 15) 2025-03-14T06:01:12.6337188Z [ OK ] TestExperimentalTpu.test_worker_id2 ('15', 15) 2025-03-14T06:01:12.6337637Z ---------------------------------------------------------------------- 2025-03-14T06:01:12.6338031Z Ran 38 tests in 0.033s 2025-03-14T06:01:12.6338198Z 2025-03-14T06:01:12.6338297Z OK 2025-03-14T06:01:13.2398635Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py 2025-03-14T06:01:13.2399351Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py' 2025-03-14T06:01:13.2400039Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py 2025-03-14T06:01:13.2400544Z ++ command -v nvidia-smi 2025-03-14T06:01:13.2401158Z + '[' -x '' ']' 2025-03-14T06:01:13.2401458Z + PJRT_DEVICE=CPU 2025-03-14T06:01:13.2401721Z + CPU_NUM_DEVICES=1 2025-03-14T06:01:13.2402137Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py 2025-03-14T06:01:13.2402588Z + '[' 0 '!=' 0 ']' 2025-03-14T06:01:13.2402945Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_ddp.py 2025-03-14T06:01:16.4269535Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:01:16.4286842Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_correctness_env_init 2025-03-14T06:01:19.9226419Z [rank0]:[W314 06:01:19.875436371 logger.cpp:337] Warning: Time stats are currently only collected for CPU and CUDA devices. Please refer to CpuTimer or CudaTimer for how to register timer for other device type. (function operator()) 2025-03-14T06:01:20.9457139Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_correctness_env_init 2025-03-14T06:01:20.9457896Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_correctness_large_net 2025-03-14T06:01:24.7513201Z [rank0]:[W314 06:01:24.704150272 logger.cpp:337] Warning: Time stats are currently only collected for CPU and CUDA devices. Please refer to CpuTimer or CudaTimer for how to register timer for other device type. (function operator()) 2025-03-14T06:01:25.9968619Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_correctness_large_net 2025-03-14T06:01:25.9969321Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_correctness_small_net 2025-03-14T06:01:29.4772977Z [rank0]:[W314 06:01:29.430350405 logger.cpp:337] Warning: Time stats are currently only collected for CPU and CUDA devices. Please refer to CpuTimer or CudaTimer for how to register timer for other device type. (function operator()) 2025-03-14T06:01:30.5105799Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_correctness_small_net 2025-03-14T06:01:30.5106743Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_init 2025-03-14T06:01:34.5049090Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_init 2025-03-14T06:01:34.5050058Z [ RUN ] TestPjRtDistributedDataParallel.test_ddp_init_threaded 2025-03-14T06:01:34.5051036Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2025-03-14T06:01:34.5052055Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2025-03-14T06:01:34.5053080Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2025-03-14T06:01:34.5054112Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2025-03-14T06:01:34.5055140Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2025-03-14T06:01:34.6263547Z [ OK ] TestPjRtDistributedDataParallel.test_ddp_init_threaded 2025-03-14T06:01:34.6264401Z ---------------------------------------------------------------------- 2025-03-14T06:01:34.6265039Z Ran 5 tests in 18.198s 2025-03-14T06:01:34.6265498Z 2025-03-14T06:01:34.6265658Z OK 2025-03-14T06:01:35.2508272Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py 2025-03-14T06:01:35.2509058Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py' 2025-03-14T06:01:35.2510138Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py 2025-03-14T06:01:35.2510795Z ++ command -v nvidia-smi 2025-03-14T06:01:35.2511093Z + '[' -x '' ']' 2025-03-14T06:01:35.2511345Z + PJRT_DEVICE=CPU 2025-03-14T06:01:35.2511606Z + CPU_NUM_DEVICES=1 2025-03-14T06:01:35.2512045Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py 2025-03-14T06:01:35.2512527Z + '[' 0 '!=' 0 ']' 2025-03-14T06:01:35.2512935Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_mesh_service.py 2025-03-14T06:01:38.4281555Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:01:38.4300656Z [ RUN ] PjRtMeshServiceTest.test_mesh_reduce 2025-03-14T06:01:42.2989493Z [ OK ] PjRtMeshServiceTest.test_mesh_reduce 2025-03-14T06:01:42.2990152Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_default_payload_cpu_transfers 2025-03-14T06:01:46.1460799Z [ OK ] PjRtMeshServiceTest.test_rendezvous_default_payload_cpu_transfers 2025-03-14T06:01:46.1461451Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_dynamic_size 2025-03-14T06:01:49.9799282Z [ OK ] PjRtMeshServiceTest.test_rendezvous_dynamic_size 2025-03-14T06:01:49.9799875Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_empty_payload 2025-03-14T06:01:53.9392506Z [ OK ] PjRtMeshServiceTest.test_rendezvous_empty_payload 2025-03-14T06:01:53.9393046Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_replica_groups 2025-03-14T06:01:57.8322197Z [ OK ] PjRtMeshServiceTest.test_rendezvous_replica_groups 2025-03-14T06:01:57.8322758Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_static_size 2025-03-14T06:02:01.7375004Z [ OK ] PjRtMeshServiceTest.test_rendezvous_static_size 2025-03-14T06:02:01.7375575Z [ RUN ] PjRtMeshServiceTest.test_rendezvous_string_payload 2025-03-14T06:02:05.5568433Z [ OK ] PjRtMeshServiceTest.test_rendezvous_string_payload 2025-03-14T06:02:05.5568996Z ---------------------------------------------------------------------- 2025-03-14T06:02:05.5569431Z Ran 7 tests in 27.127s 2025-03-14T06:02:05.5569609Z 2025-03-14T06:02:05.5569710Z OK 2025-03-14T06:02:06.1732400Z + run_test /var/lib/jenkins/workspace/xla/test/test_python_ops.py 2025-03-14T06:02:06.1733083Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_python_ops.py' 2025-03-14T06:02:06.1733769Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_python_ops.py 2025-03-14T06:02:06.1734305Z ++ command -v nvidia-smi 2025-03-14T06:02:06.1736764Z + '[' -x '' ']' 2025-03-14T06:02:06.1737023Z + PJRT_DEVICE=CPU 2025-03-14T06:02:06.1737497Z + CPU_NUM_DEVICES=1 2025-03-14T06:02:06.1737955Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_python_ops.py 2025-03-14T06:02:06.1738455Z + '[' 0 '!=' 0 ']' 2025-03-14T06:02:06.1738865Z + python3 /var/lib/jenkins/workspace/xla/test/test_python_ops.py 2025-03-14T06:02:09.7826468Z 2025-03-14T06:02:09.7826955Z Running tests... 2025-03-14T06:02:09.7827351Z ---------------------------------------------------------------------- 2025-03-14T06:04:52.8853631Z .sss........sss....... 2025-03-14T06:04:52.8854060Z ---------------------------------------------------------------------- 2025-03-14T06:04:52.8854474Z Ran 22 tests in 163.103s 2025-03-14T06:04:52.8854667Z 2025-03-14T06:04:52.8854769Z OK (skipped=6) 2025-03-14T06:04:52.8854928Z 2025-03-14T06:04:52.8855043Z Generating XML reports... 2025-03-14T06:04:53.9175801Z + run_test /var/lib/jenkins/workspace/xla/test/test_ops.py 2025-03-14T06:04:53.9176414Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_ops.py' 2025-03-14T06:04:53.9177071Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_ops.py 2025-03-14T06:04:53.9178042Z ++ command -v nvidia-smi 2025-03-14T06:04:53.9180238Z + '[' -x '' ']' 2025-03-14T06:04:53.9180508Z + PJRT_DEVICE=CPU 2025-03-14T06:04:53.9180758Z + CPU_NUM_DEVICES=1 2025-03-14T06:04:53.9181123Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_ops.py 2025-03-14T06:04:53.9181603Z + '[' 0 '!=' 0 ']' 2025-03-14T06:04:53.9182219Z + python3 /var/lib/jenkins/workspace/xla/test/test_ops.py 2025-03-14T06:05:43.9032562Z .................................................../opt/conda/lib/python3.10/site-packages/torch/testing/_internal/opinfo/core.py:1188: UserWarning: torch.cholesky is deprecated in favor of torch.linalg.cholesky and will be removed in a future PyTorch release. 2025-03-14T06:05:43.9034790Z L = torch.cholesky(A) 2025-03-14T06:05:43.9035258Z should be replaced with 2025-03-14T06:05:43.9035738Z L = torch.linalg.cholesky(A) 2025-03-14T06:05:43.9036221Z and 2025-03-14T06:05:43.9036637Z U = torch.cholesky(A, upper=True) 2025-03-14T06:05:43.9037178Z should be replaced with 2025-03-14T06:05:43.9037653Z U = torch.linalg.cholesky(A).mH 2025-03-14T06:05:43.9039478Z This transform will produce equivalent results for all valid (symmetric positive definite) inputs. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/BatchLinearAlgebra.cpp:1767.) 2025-03-14T06:05:43.9041351Z return self.op(*args, **kwargs) 2025-03-14T06:05:50.6794907Z ................/opt/conda/lib/python3.10/site-packages/torch/testing/_internal/opinfo/core.py:1188: UserWarning: Using torch.cross without specifying the dim arg is deprecated. 2025-03-14T06:05:50.6796908Z Please either pass the dim explicitly or simply use torch.linalg.cross. 2025-03-14T06:05:50.6798489Z The default value of dim will change to agree with that of linalg.cross in a future release. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/Cross.cpp:66.) 2025-03-14T06:05:50.6799932Z return self.op(*args, **kwargs) 2025-03-14T06:08:09.5122405Z ...........................................................................s...................................................................................................................s...........ss................................................................................... 2025-03-14T06:08:09.5123280Z ---------------------------------------------------------------------- 2025-03-14T06:08:09.5123715Z Ran 355 tests in 190.989s 2025-03-14T06:08:09.5123933Z 2025-03-14T06:08:09.5124036Z OK (skipped=4) 2025-03-14T06:08:10.5912585Z + run_test /var/lib/jenkins/workspace/xla/test/test_metrics.py 2025-03-14T06:08:10.5913274Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_metrics.py' 2025-03-14T06:08:10.5913945Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_metrics.py 2025-03-14T06:08:10.5914446Z ++ command -v nvidia-smi 2025-03-14T06:08:10.5914745Z + '[' -x '' ']' 2025-03-14T06:08:10.5915008Z + PJRT_DEVICE=CPU 2025-03-14T06:08:10.5915580Z + CPU_NUM_DEVICES=1 2025-03-14T06:08:10.5916059Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_metrics.py 2025-03-14T06:08:10.5916494Z + '[' 0 '!=' 0 ']' 2025-03-14T06:08:10.5916844Z + python3 /var/lib/jenkins/workspace/xla/test/test_metrics.py 2025-03-14T06:08:14.9861698Z ........... 2025-03-14T06:08:14.9862123Z ---------------------------------------------------------------------- 2025-03-14T06:08:14.9862737Z Ran 11 tests in 1.225s 2025-03-14T06:08:14.9862922Z 2025-03-14T06:08:14.9863016Z OK 2025-03-14T06:08:15.6409968Z + run_test /var/lib/jenkins/workspace/xla/test/test_deprecation.py 2025-03-14T06:08:15.6410713Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_deprecation.py' 2025-03-14T06:08:15.6411416Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_deprecation.py 2025-03-14T06:08:15.6412216Z ++ command -v nvidia-smi 2025-03-14T06:08:15.6414654Z + '[' -x '' ']' 2025-03-14T06:08:15.6414963Z + PJRT_DEVICE=CPU 2025-03-14T06:08:15.6415249Z + CPU_NUM_DEVICES=1 2025-03-14T06:08:15.6415651Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_deprecation.py 2025-03-14T06:08:15.6416113Z + '[' 0 '!=' 0 ']' 2025-03-14T06:08:15.6416482Z + python3 /var/lib/jenkins/workspace/xla/test/test_deprecation.py 2025-03-14T06:08:18.8076540Z .. 2025-03-14T06:08:18.8076931Z ---------------------------------------------------------------------- 2025-03-14T06:08:18.8077356Z Ran 2 tests in 0.001s 2025-03-14T06:08:18.8077753Z 2025-03-14T06:08:18.8077938Z OK 2025-03-14T06:08:19.4050042Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py 2025-03-14T06:08:19.4051014Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py' 2025-03-14T06:08:19.4051932Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py 2025-03-14T06:08:19.4052552Z ++ command -v nvidia-smi 2025-03-14T06:08:19.4054558Z + '[' -x '' ']' 2025-03-14T06:08:19.4054918Z + PJRT_DEVICE=CPU 2025-03-14T06:08:19.4055176Z + CPU_NUM_DEVICES=1 2025-03-14T06:08:19.4055680Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py 2025-03-14T06:08:19.4056227Z + '[' 0 '!=' 0 ']' 2025-03-14T06:08:19.4056691Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_integrations_util.py 2025-03-14T06:08:22.9233506Z ....... 2025-03-14T06:08:22.9234118Z ---------------------------------------------------------------------- 2025-03-14T06:08:22.9234810Z Ran 7 tests in 0.358s 2025-03-14T06:08:22.9235086Z 2025-03-14T06:08:22.9235247Z OK 2025-03-14T06:08:23.5723928Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py 2025-03-14T06:08:23.5724928Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py' 2025-03-14T06:08:23.5725748Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py 2025-03-14T06:08:23.5726323Z ++ command -v nvidia-smi 2025-03-14T06:08:23.5727404Z + '[' -x '' ']' 2025-03-14T06:08:23.5727656Z + PJRT_DEVICE=CPU 2025-03-14T06:08:23.5727922Z + CPU_NUM_DEVICES=1 2025-03-14T06:08:23.5728370Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py 2025-03-14T06:08:23.5728875Z + '[' 0 '!=' 0 ']' 2025-03-14T06:08:23.5729296Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_aliasing.py 2025-03-14T06:08:27.4135126Z .......... 2025-03-14T06:08:27.4135565Z ---------------------------------------------------------------------- 2025-03-14T06:08:27.4135990Z Ran 10 tests in 0.530s 2025-03-14T06:08:27.4136170Z 2025-03-14T06:08:27.4136261Z OK 2025-03-14T06:08:28.0776823Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py 2025-03-14T06:08:28.0777566Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py' 2025-03-14T06:08:28.0778309Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py 2025-03-14T06:08:28.0779135Z ++ command -v nvidia-smi 2025-03-14T06:08:28.0781866Z + '[' -x '' ']' 2025-03-14T06:08:28.0782213Z + PJRT_DEVICE=CPU 2025-03-14T06:08:28.0782475Z + CPU_NUM_DEVICES=1 2025-03-14T06:08:28.0782891Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py 2025-03-14T06:08:28.0783360Z + '[' 0 '!=' 0 ']' 2025-03-14T06:08:28.0783744Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo.py 2025-03-14T06:08:51.3456824Z ......s.s.s...ss.s........W0314 06:08:51.344000 44099 site-packages/torch/_logging/_internal.py:1130] [3/0] Profiler function will be ignored 2025-03-14T06:08:56.9005039Z .. 2025-03-14T06:08:56.9005628Z ---------------------------------------------------------------------- 2025-03-14T06:08:56.9006321Z Ran 28 tests in 25.523s 2025-03-14T06:08:56.9006624Z 2025-03-14T06:08:56.9006787Z OK (skipped=6) 2025-03-14T06:08:58.0511617Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py 2025-03-14T06:08:58.0512499Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py' 2025-03-14T06:08:58.0513371Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py 2025-03-14T06:08:58.0513953Z ++ command -v nvidia-smi 2025-03-14T06:08:58.0514515Z + '[' -x '' ']' 2025-03-14T06:08:58.0514764Z + PJRT_DEVICE=CPU 2025-03-14T06:08:58.0515018Z + CPU_NUM_DEVICES=1 2025-03-14T06:08:58.0515843Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py 2025-03-14T06:08:58.0516403Z + '[' 0 '!=' 0 ']' 2025-03-14T06:08:58.0516847Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_dynamic_shape.py 2025-03-14T06:09:19.9847731Z .......s 2025-03-14T06:09:19.9848104Z ---------------------------------------------------------------------- 2025-03-14T06:09:19.9848513Z Ran 8 tests in 18.580s 2025-03-14T06:09:19.9848680Z 2025-03-14T06:09:19.9848778Z OK (skipped=1) 2025-03-14T06:09:21.2778821Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py 2025-03-14T06:09:21.2779613Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py' 2025-03-14T06:09:21.2780363Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py 2025-03-14T06:09:21.2780905Z ++ command -v nvidia-smi 2025-03-14T06:09:21.2782463Z + '[' -x '' ']' 2025-03-14T06:09:21.2782750Z + PJRT_DEVICE=CPU 2025-03-14T06:09:21.2783005Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:21.2783430Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py 2025-03-14T06:09:21.2783892Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:21.2784271Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_bridge.py 2025-03-14T06:09:24.7190166Z 2025-03-14T06:09:24.7190643Z Running tests... 2025-03-14T06:09:24.7191073Z ---------------------------------------------------------------------- 2025-03-14T06:09:25.2292440Z .frames [('total', 1), ('ok', 1)] 2025-03-14T06:09:25.2292912Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-03-14T06:09:25.2293349Z aot_autograd [('total', 1), ('ok', 1)] 2025-03-14T06:09:25.3522894Z .frames [('total', 1), ('ok', 1)] 2025-03-14T06:09:25.3523366Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-03-14T06:09:25.3523769Z aot_autograd [('total', 1), ('ok', 1)] 2025-03-14T06:09:25.4688466Z ./opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/_dynamo/dynamo_bridge.py:833: UserWarning: Found tensor with shape torch.Size([3]) on cpu. Please move all tensors to xla device to execute on XLA device. 2025-03-14T06:09:25.4689855Z warnings.warn( 2025-03-14T06:09:25.5666400Z frames [('total', 1), ('ok', 1)] 2025-03-14T06:09:25.5666867Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-03-14T06:09:25.5667262Z aot_autograd [('total', 1), ('ok', 1)] 2025-03-14T06:09:25.9610324Z ..frames [('total', 1), ('ok', 1)] 2025-03-14T06:09:25.9610788Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-03-14T06:09:25.9611193Z aot_autograd [('total', 1), ('ok', 1)] 2025-03-14T06:09:26.8046958Z ...frames [('total', 1), ('ok', 1)] 2025-03-14T06:09:26.8047708Z inline_call [] 2025-03-14T06:09:26.8048011Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-03-14T06:09:26.8048401Z aot_autograd [('total', 1), ('ok', 1)] 2025-03-14T06:09:26.8287264Z ./opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/_dynamo/dynamo_bridge.py:833: UserWarning: Found tensor with shape torch.Size([3]) on cpu. Please move all tensors to xla device to execute on XLA device. 2025-03-14T06:09:26.8288495Z warnings.warn( 2025-03-14T06:09:26.8292931Z frames [('total', 1), ('ok', 1)] 2025-03-14T06:09:26.8293285Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-03-14T06:09:26.8293670Z aot_autograd [('total', 1), ('ok', 1)] 2025-03-14T06:09:27.2156221Z .expected_output: 2025-03-14T06:09:27.2156684Z [tensor([[-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2157145Z -0.0874, 0.0034], 2025-03-14T06:09:27.2157548Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2158016Z -0.0874, 0.0034], 2025-03-14T06:09:27.2158392Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2158798Z -0.0874, 0.0034], 2025-03-14T06:09:27.2159166Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2159873Z -0.0874, 0.0034], 2025-03-14T06:09:27.2160244Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2160818Z -0.0874, 0.0034]], device='xla:0'), tensor([0.2000, 0.2000, 0.2000, 0.2000, 0.2000], device='xla:0')] 2025-03-14T06:09:27.2161316Z actual_output: 2025-03-14T06:09:27.2161675Z [tensor([[-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2162090Z -0.0874, 0.0034], 2025-03-14T06:09:27.2162448Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2162858Z -0.0874, 0.0034], 2025-03-14T06:09:27.2163217Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2163614Z -0.0874, 0.0034], 2025-03-14T06:09:27.2163970Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2164463Z -0.0874, 0.0034], 2025-03-14T06:09:27.2164836Z [-0.0004, -0.0899, -0.0298, 0.0807, -0.1007, -0.1278, 0.1306, 0.1066, 2025-03-14T06:09:27.2165562Z -0.0874, 0.0034]], device='xla:0'), tensor([0.2000, 0.2000, 0.2000, 0.2000, 0.2000], device='xla:0')] 2025-03-14T06:09:27.2166071Z frames [('total', 6), ('ok', 6)] 2025-03-14T06:09:27.2166373Z inline_call [] 2025-03-14T06:09:27.2166626Z unimplemented [] 2025-03-14T06:09:27.2166900Z graph_break [('Tensor.backward', 1)] 2025-03-14T06:09:27.2167275Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-03-14T06:09:27.6297035Z .expected_output: 2025-03-14T06:09:27.6297383Z [tensor([[[[-0.2111, -0.1610, 0.0259], 2025-03-14T06:09:27.6297749Z [-0.2274, -0.0024, 0.1752], 2025-03-14T06:09:27.6298064Z [-0.1434, 0.1030, -0.1211]], 2025-03-14T06:09:27.6298273Z 2025-03-14T06:09:27.6298388Z [[-0.1547, 0.1979, 0.0639], 2025-03-14T06:09:27.6298698Z [ 0.0246, 0.1635, -0.1678], 2025-03-14T06:09:27.6299005Z [ 0.2300, -0.1006, 0.0044]], 2025-03-14T06:09:27.6299223Z 2025-03-14T06:09:27.6299328Z [[-0.0315, 0.0969, -0.1511], 2025-03-14T06:09:27.6299635Z [ 0.0229, -0.0664, -0.0201], 2025-03-14T06:09:27.6299945Z [ 0.1521, -0.1607, 0.0669]]], 2025-03-14T06:09:27.6300162Z 2025-03-14T06:09:27.6300166Z 2025-03-14T06:09:27.6300264Z [[[-0.1136, 0.1280, -0.1644], 2025-03-14T06:09:27.6300566Z [-0.0965, -0.1072, 0.0701], 2025-03-14T06:09:27.6300871Z [-0.2735, 0.0679, 0.0361]], 2025-03-14T06:09:27.6301085Z 2025-03-14T06:09:27.6301374Z [[ 0.1658, 0.1183, -0.0699], 2025-03-14T06:09:27.6301741Z [-0.1186, -0.0327, -0.0896], 2025-03-14T06:09:27.6302050Z [ 0.2017, -0.0935, 0.1166]], 2025-03-14T06:09:27.6302264Z 2025-03-14T06:09:27.6302366Z [[ 0.0482, -0.1383, -0.2425], 2025-03-14T06:09:27.6302673Z [ 0.1879, -0.1784, -0.0643], 2025-03-14T06:09:27.6302979Z [ 0.0667, -0.1372, 0.0676]]], 2025-03-14T06:09:27.6303183Z 2025-03-14T06:09:27.6303204Z 2025-03-14T06:09:27.6303306Z [[[ 0.2678, 0.1837, -0.3151], 2025-03-14T06:09:27.6303612Z [ 0.0841, -0.3076, -0.0264], 2025-03-14T06:09:27.6303917Z [ 0.0238, 0.1743, -0.1330]], 2025-03-14T06:09:27.6304117Z 2025-03-14T06:09:27.6304229Z [[-0.0466, -0.0402, 0.1108], 2025-03-14T06:09:27.6304536Z [ 0.0535, 0.0294, -0.1435], 2025-03-14T06:09:27.6304841Z [-0.0593, -0.0774, 0.0738]], 2025-03-14T06:09:27.6305042Z 2025-03-14T06:09:27.6305186Z [[ 0.0169, 0.0425, 0.1195], 2025-03-14T06:09:27.6305492Z [-0.1143, 0.0370, -0.0381], 2025-03-14T06:09:27.6305805Z [-0.0361, 0.0981, -0.3143]]], 2025-03-14T06:09:27.6306010Z 2025-03-14T06:09:27.6306014Z 2025-03-14T06:09:27.6306128Z [[[ 0.0914, -0.0925, -0.1136], 2025-03-14T06:09:27.6306437Z [-0.0827, 0.2555, -0.0965], 2025-03-14T06:09:27.6306744Z [ 0.0466, 0.0556, -0.2735]], 2025-03-14T06:09:27.6306947Z 2025-03-14T06:09:27.6307119Z [[ 0.0104, -0.0668, 0.1658], 2025-03-14T06:09:27.6307478Z [-0.0374, -0.1550, -0.1186], 2025-03-14T06:09:27.6307786Z [ 0.1135, 0.1915, 0.2017]], 2025-03-14T06:09:27.6307988Z 2025-03-14T06:09:27.6308101Z [[-0.0213, 0.0340, 0.0482], 2025-03-14T06:09:27.6308406Z [-0.1122, -0.0944, 0.1879], 2025-03-14T06:09:27.6308713Z [ 0.0985, -0.0576, 0.0667]]], 2025-03-14T06:09:27.6308918Z 2025-03-14T06:09:27.6308922Z 2025-03-14T06:09:27.6309031Z [[[-0.1847, -0.2655, 0.1420], 2025-03-14T06:09:27.6309325Z [-0.1014, 0.1627, 0.0593], 2025-03-14T06:09:27.6309633Z [ 0.1392, 0.1409, -0.1831]], 2025-03-14T06:09:27.6309851Z 2025-03-14T06:09:27.6309949Z [[-0.0814, 0.0718, 0.0106], 2025-03-14T06:09:27.6310256Z [-0.0516, 0.2063, -0.0575], 2025-03-14T06:09:27.6310830Z [ 0.0817, 0.0513, 0.1583]], 2025-03-14T06:09:27.6311043Z 2025-03-14T06:09:27.6311203Z [[-0.3198, -0.1175, -0.0086], 2025-03-14T06:09:27.6311514Z [-0.2251, -0.0053, -0.0658], 2025-03-14T06:09:27.6311820Z [-0.0227, -0.1734, 0.0872]]], 2025-03-14T06:09:27.6312037Z 2025-03-14T06:09:27.6312040Z 2025-03-14T06:09:27.6312140Z [[[ 0.0914, -0.0925, -0.1136], 2025-03-14T06:09:27.6312446Z [-0.0827, 0.2555, -0.0965], 2025-03-14T06:09:27.6312751Z [ 0.0466, 0.0556, -0.2735]], 2025-03-14T06:09:27.6312968Z 2025-03-14T06:09:27.6313069Z [[ 0.0104, -0.0668, 0.1658], 2025-03-14T06:09:27.6313375Z [-0.0374, -0.1550, -0.1186], 2025-03-14T06:09:27.6313681Z [ 0.1135, 0.1915, 0.2017]], 2025-03-14T06:09:27.6313884Z 2025-03-14T06:09:27.6313993Z [[-0.0213, 0.0340, 0.0482], 2025-03-14T06:09:27.6314300Z [-0.1122, -0.0944, 0.1879], 2025-03-14T06:09:27.6314829Z [ 0.0985, -0.0576, 0.0667]]]], device='xla:0'), tensor([0.1667, 0.1667, 0.1667, 0.1667, 0.1667, 0.1667], device='xla:0')] 2025-03-14T06:09:27.6321687Z actual_output: 2025-03-14T06:09:27.6322087Z [tensor([[[[-0.2111, -0.1610, 0.0259], 2025-03-14T06:09:27.6322436Z [-0.2274, -0.0024, 0.1752], 2025-03-14T06:09:27.6322753Z [-0.1434, 0.1030, -0.1211]], 2025-03-14T06:09:27.6322963Z 2025-03-14T06:09:27.6323083Z [[-0.1547, 0.1979, 0.0639], 2025-03-14T06:09:27.6323395Z [ 0.0246, 0.1635, -0.1678], 2025-03-14T06:09:27.6323705Z [ 0.2300, -0.1006, 0.0044]], 2025-03-14T06:09:27.6323909Z 2025-03-14T06:09:27.6324027Z [[-0.0315, 0.0969, -0.1511], 2025-03-14T06:09:27.6324445Z [ 0.0229, -0.0664, -0.0201], 2025-03-14T06:09:27.6324858Z [ 0.1521, -0.1607, 0.0669]]], 2025-03-14T06:09:27.6325115Z 2025-03-14T06:09:27.6325120Z 2025-03-14T06:09:27.6325233Z [[[-0.1136, 0.1280, -0.1644], 2025-03-14T06:09:27.6325529Z [-0.0965, -0.1072, 0.0701], 2025-03-14T06:09:27.6325839Z [-0.2735, 0.0679, 0.0361]], 2025-03-14T06:09:27.6326055Z 2025-03-14T06:09:27.6326156Z [[ 0.1658, 0.1183, -0.0699], 2025-03-14T06:09:27.6326472Z [-0.1186, -0.0327, -0.0896], 2025-03-14T06:09:27.6326784Z [ 0.2017, -0.0935, 0.1166]], 2025-03-14T06:09:27.6327005Z 2025-03-14T06:09:27.6327106Z [[ 0.0482, -0.1383, -0.2425], 2025-03-14T06:09:27.6327422Z [ 0.1879, -0.1784, -0.0643], 2025-03-14T06:09:27.6327731Z [ 0.0667, -0.1372, 0.0676]]], 2025-03-14T06:09:27.6327951Z 2025-03-14T06:09:27.6327955Z 2025-03-14T06:09:27.6328055Z [[[ 0.2678, 0.1837, -0.3151], 2025-03-14T06:09:27.6328365Z [ 0.0841, -0.3076, -0.0264], 2025-03-14T06:09:27.6328675Z [ 0.0238, 0.1743, -0.1330]], 2025-03-14T06:09:27.6328889Z 2025-03-14T06:09:27.6328988Z [[-0.0466, -0.0402, 0.1108], 2025-03-14T06:09:27.6329287Z [ 0.0535, 0.0294, -0.1435], 2025-03-14T06:09:27.6329576Z [-0.0593, -0.0774, 0.0738]], 2025-03-14T06:09:27.6329770Z 2025-03-14T06:09:27.6329868Z [[ 0.0169, 0.0425, 0.1195], 2025-03-14T06:09:27.6330154Z [-0.1143, 0.0370, -0.0381], 2025-03-14T06:09:27.6330507Z [-0.0361, 0.0981, -0.3143]]], 2025-03-14T06:09:27.6330704Z 2025-03-14T06:09:27.6330708Z 2025-03-14T06:09:27.6330813Z [[[ 0.0914, -0.0925, -0.1136], 2025-03-14T06:09:27.6331099Z [-0.0827, 0.2555, -0.0965], 2025-03-14T06:09:27.6331391Z [ 0.0466, 0.0556, -0.2735]], 2025-03-14T06:09:27.6331588Z 2025-03-14T06:09:27.6331692Z [[ 0.0104, -0.0668, 0.1658], 2025-03-14T06:09:27.6331982Z [-0.0374, -0.1550, -0.1186], 2025-03-14T06:09:27.6332276Z [ 0.1135, 0.1915, 0.2017]], 2025-03-14T06:09:27.6332475Z 2025-03-14T06:09:27.6332578Z [[-0.0213, 0.0340, 0.0482], 2025-03-14T06:09:27.6332868Z [-0.1122, -0.0944, 0.1879], 2025-03-14T06:09:27.6333160Z [ 0.0985, -0.0576, 0.0667]]], 2025-03-14T06:09:27.6333372Z 2025-03-14T06:09:27.6333375Z 2025-03-14T06:09:27.6333469Z [[[-0.1847, -0.2655, 0.1420], 2025-03-14T06:09:27.6333757Z [-0.1014, 0.1627, 0.0593], 2025-03-14T06:09:27.6334049Z [ 0.1392, 0.1409, -0.1831]], 2025-03-14T06:09:27.6334255Z 2025-03-14T06:09:27.6334348Z [[-0.0814, 0.0718, 0.0106], 2025-03-14T06:09:27.6334635Z [-0.0516, 0.2063, -0.0575], 2025-03-14T06:09:27.6334922Z [ 0.0817, 0.0513, 0.1583]], 2025-03-14T06:09:27.6335124Z 2025-03-14T06:09:27.6335218Z [[-0.3198, -0.1175, -0.0086], 2025-03-14T06:09:27.6335509Z [-0.2251, -0.0053, -0.0658], 2025-03-14T06:09:27.6335800Z [-0.0227, -0.1734, 0.0872]]], 2025-03-14T06:09:27.6336009Z 2025-03-14T06:09:27.6336015Z 2025-03-14T06:09:27.6336114Z [[[ 0.0914, -0.0925, -0.1136], 2025-03-14T06:09:27.6336411Z [-0.0827, 0.2555, -0.0965], 2025-03-14T06:09:27.6336705Z [ 0.0466, 0.0556, -0.2735]], 2025-03-14T06:09:27.6337009Z 2025-03-14T06:09:27.6337110Z [[ 0.0104, -0.0668, 0.1658], 2025-03-14T06:09:27.6337398Z [-0.0374, -0.1550, -0.1186], 2025-03-14T06:09:27.6337681Z [ 0.1135, 0.1915, 0.2017]], 2025-03-14T06:09:27.6337873Z 2025-03-14T06:09:27.6337977Z [[-0.0213, 0.0340, 0.0482], 2025-03-14T06:09:27.6338258Z [-0.1122, -0.0944, 0.1879], 2025-03-14T06:09:27.6338753Z [ 0.0985, -0.0576, 0.0667]]]], device='xla:0'), tensor([0.1667, 0.1667, 0.1667, 0.1667, 0.1667, 0.1667], device='xla:0')] 2025-03-14T06:09:27.6339266Z frames [('total', 6), ('ok', 6)] 2025-03-14T06:09:27.6339544Z inline_call [] 2025-03-14T06:09:27.6339772Z unimplemented [] 2025-03-14T06:09:27.6340023Z graph_break [('Tensor.backward', 1)] 2025-03-14T06:09:27.6340401Z stats [('calls_captured', 3), ('unique_graphs', 1)] 2025-03-14T06:09:27.9294658Z .expected_output: 2025-03-14T06:09:27.9294990Z [] 2025-03-14T06:09:27.9295219Z actual_output: 2025-03-14T06:09:27.9295462Z [] 2025-03-14T06:09:27.9295695Z frames [('total', 6), ('ok', 6)] 2025-03-14T06:09:27.9296008Z inline_call [] 2025-03-14T06:09:27.9296262Z unimplemented [] 2025-03-14T06:09:27.9296531Z graph_break [('Tensor.backward', 1)] 2025-03-14T06:09:27.9296949Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-03-14T06:09:27.9297335Z . 2025-03-14T06:09:27.9297626Z ---------------------------------------------------------------------- 2025-03-14T06:09:27.9298026Z Ran 13 tests in 3.211s 2025-03-14T06:09:27.9298204Z 2025-03-14T06:09:27.9298294Z OK 2025-03-14T06:09:27.9298420Z 2025-03-14T06:09:27.9298531Z Generating XML reports... 2025-03-14T06:09:28.7200198Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py 2025-03-14T06:09:28.7201009Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py' 2025-03-14T06:09:28.7201820Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py 2025-03-14T06:09:28.7202482Z ++ command -v nvidia-smi 2025-03-14T06:09:28.7202769Z + '[' -x '' ']' 2025-03-14T06:09:28.7203029Z + PJRT_DEVICE=CPU 2025-03-14T06:09:28.7203282Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:28.7203711Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py 2025-03-14T06:09:28.7204492Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:28.7204976Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_num_output.py 2025-03-14T06:09:32.0153238Z ... 2025-03-14T06:09:32.0153650Z ---------------------------------------------------------------------- 2025-03-14T06:09:32.0154077Z Ran 3 tests in 0.095s 2025-03-14T06:09:32.0154272Z 2025-03-14T06:09:32.0154364Z OK 2025-03-14T06:09:32.6438066Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py 2025-03-14T06:09:32.6438928Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py' 2025-03-14T06:09:32.6439820Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py 2025-03-14T06:09:32.6440419Z ++ command -v nvidia-smi 2025-03-14T06:09:32.6441042Z + '[' -x '' ']' 2025-03-14T06:09:32.6441350Z + PJRT_DEVICE=CPU 2025-03-14T06:09:32.6441616Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:32.6442124Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py 2025-03-14T06:09:32.6442664Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:32.6443106Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_graph_input_matcher.py 2025-03-14T06:09:35.8128638Z . 2025-03-14T06:09:35.8129034Z ---------------------------------------------------------------------- 2025-03-14T06:09:35.8129459Z Ran 1 test in 0.010s 2025-03-14T06:09:35.8129632Z 2025-03-14T06:09:35.8129737Z OK 2025-03-14T06:09:36.4173955Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py 2025-03-14T06:09:36.4174767Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py' 2025-03-14T06:09:36.4175573Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py 2025-03-14T06:09:36.4176135Z ++ command -v nvidia-smi 2025-03-14T06:09:36.4178607Z + '[' -x '' ']' 2025-03-14T06:09:36.4178863Z + PJRT_DEVICE=CPU 2025-03-14T06:09:36.4179122Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:36.4179579Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py 2025-03-14T06:09:36.4180076Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:36.4180473Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_config.py 2025-03-14T06:09:39.8015524Z . 2025-03-14T06:09:39.8015950Z ---------------------------------------------------------------------- 2025-03-14T06:09:39.8016385Z Ran 1 test in 0.213s 2025-03-14T06:09:39.8016574Z 2025-03-14T06:09:39.8016663Z OK 2025-03-14T06:09:39.8016876Z False 2025-03-14T06:09:40.4382216Z + run_save_tensor_ir run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2025-03-14T06:09:40.4383307Z + local run_test_func=run_test 2025-03-14T06:09:40.4383605Z + shift 2025-03-14T06:09:40.4384136Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py' 2025-03-14T06:09:40.4385008Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2025-03-14T06:09:40.4385860Z + run_save_tensor run_test text /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2025-03-14T06:09:40.4386446Z + local run_test_func=run_test 2025-03-14T06:09:40.4386755Z + local file_graph_format=text 2025-03-14T06:09:40.4387042Z + shift 2 2025-03-14T06:09:40.4387564Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py' 2025-03-14T06:09:40.4388432Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2025-03-14T06:09:40.4389052Z + local base_file=/tmp/xla_test_save_ir.txt 2025-03-14T06:09:40.4389414Z + ls '/tmp/xla_test_save_ir.txt*' 2025-03-14T06:09:40.4406487Z + XLA_SAVE_TENSORS_FILE=/tmp/xla_test_save_ir.txt 2025-03-14T06:09:40.4406907Z + XLA_SAVE_TENSORS_FMT=text 2025-03-14T06:09:40.4407391Z + run_test /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2025-03-14T06:09:40.4408303Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py' 2025-03-14T06:09:40.4409197Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2025-03-14T06:09:40.4409775Z ++ command -v nvidia-smi 2025-03-14T06:09:40.4410932Z + '[' -x '' ']' 2025-03-14T06:09:40.4411193Z + PJRT_DEVICE=CPU 2025-03-14T06:09:40.4411456Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:40.4411918Z + run_coverage /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2025-03-14T06:09:40.4412435Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:40.4412849Z + python3 /var/lib/jenkins/workspace/xla/test/dynamo/test_dynamo_graph_dump.py 2025-03-14T06:09:43.9156405Z . 2025-03-14T06:09:43.9156821Z ---------------------------------------------------------------------- 2025-03-14T06:09:43.9157247Z Ran 1 test in 0.109s 2025-03-14T06:09:43.9157416Z 2025-03-14T06:09:43.9157521Z OK 2025-03-14T06:09:44.5804583Z + local test_status=0 2025-03-14T06:09:44.5805059Z + local actual_file 2025-03-14T06:09:44.5807910Z ++ head -n1 2025-03-14T06:09:44.5808718Z ++ ls /tmp/xla_test_save_ir.txt.0 2025-03-14T06:09:44.5831188Z + actual_file=/tmp/xla_test_save_ir.txt.0 2025-03-14T06:09:44.5831695Z + '[' -f /tmp/xla_test_save_ir.txt.0 ']' 2025-03-14T06:09:44.5832141Z + echo 'Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0' 2025-03-14T06:09:44.5832634Z Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0 2025-03-14T06:09:44.5833034Z + rm /tmp/xla_test_save_ir.txt.0 2025-03-14T06:09:44.5844067Z + return 0 2025-03-14T06:09:44.5844580Z + run_test /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:44.5845234Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2025-03-14T06:09:44.5845927Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:44.5846439Z ++ command -v nvidia-smi 2025-03-14T06:09:44.5846718Z + '[' -x '' ']' 2025-03-14T06:09:44.5846967Z + PJRT_DEVICE=CPU 2025-03-14T06:09:44.5847225Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:44.5847621Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:44.5848066Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:44.5848427Z + python3 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:47.8662065Z ... 2025-03-14T06:09:47.8662462Z ---------------------------------------------------------------------- 2025-03-14T06:09:47.8662886Z Ran 3 tests in 0.067s 2025-03-14T06:09:47.8663056Z 2025-03-14T06:09:47.8663161Z OK 2025-03-14T06:09:48.4991607Z + run_use_bf16 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:48.4992663Z + echo 'Running with XLA_USE_BF16: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2025-03-14T06:09:48.4993426Z Running with XLA_USE_BF16: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:48.4993910Z + XLA_USE_BF16=1 2025-03-14T06:09:48.4994271Z + run_test /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:48.4994892Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2025-03-14T06:09:48.4995570Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:48.4996062Z ++ command -v nvidia-smi 2025-03-14T06:09:48.4996344Z + '[' -x '' ']' 2025-03-14T06:09:48.4996594Z + PJRT_DEVICE=CPU 2025-03-14T06:09:48.4996848Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:48.4997230Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:48.4997663Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:48.4998020Z + python3 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:51.7115687Z ... 2025-03-14T06:09:51.7116165Z ---------------------------------------------------------------------- 2025-03-14T06:09:51.7116693Z Ran 3 tests in 0.054s 2025-03-14T06:09:51.7116883Z 2025-03-14T06:09:51.7116973Z OK 2025-03-14T06:09:51.7117425Z XLA_USE_BF16 will be deprecated after the 2.6 release, please convert your model to bf16 directly 2025-03-14T06:09:52.3228104Z + run_downcast_bf16 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:52.3229165Z + echo 'Running with XLA_DOWNCAST_BF16: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2025-03-14T06:09:52.3229980Z Running with XLA_DOWNCAST_BF16: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:52.3230494Z + XLA_DOWNCAST_BF16=1 2025-03-14T06:09:52.3230870Z + run_test /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:52.3231478Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py' 2025-03-14T06:09:52.3232148Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:52.3232656Z ++ command -v nvidia-smi 2025-03-14T06:09:52.3232944Z + '[' -x '' ']' 2025-03-14T06:09:52.3233192Z + PJRT_DEVICE=CPU 2025-03-14T06:09:52.3233445Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:52.3233828Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:52.3234260Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:52.3234620Z + python3 /var/lib/jenkins/workspace/xla/test/test_data_type.py 2025-03-14T06:09:55.5509225Z ... 2025-03-14T06:09:55.5509639Z ---------------------------------------------------------------------- 2025-03-14T06:09:55.5510071Z Ran 3 tests in 0.050s 2025-03-14T06:09:55.5510252Z 2025-03-14T06:09:55.5510358Z OK 2025-03-14T06:09:55.5510823Z XLA_DOWNCAST_BF16 will be deprecated after the 2.6 release, please downcast your model directly 2025-03-14T06:09:56.1719051Z + run_test /var/lib/jenkins/workspace/xla/test/test_fp8.py 2025-03-14T06:09:56.1719707Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_fp8.py' 2025-03-14T06:09:56.1720368Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_fp8.py 2025-03-14T06:09:56.1720851Z ++ command -v nvidia-smi 2025-03-14T06:09:56.1721139Z + '[' -x '' ']' 2025-03-14T06:09:56.1721388Z + PJRT_DEVICE=CPU 2025-03-14T06:09:56.1721650Z + CPU_NUM_DEVICES=1 2025-03-14T06:09:56.1722011Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_fp8.py 2025-03-14T06:09:56.1722426Z + '[' 0 '!=' 0 ']' 2025-03-14T06:09:56.1722770Z + python3 /var/lib/jenkins/workspace/xla/test/test_fp8.py 2025-03-14T06:09:59.4955582Z ...... 2025-03-14T06:09:59.4956067Z ---------------------------------------------------------------------- 2025-03-14T06:09:59.4956498Z Ran 6 tests in 0.117s 2025-03-14T06:09:59.4956685Z 2025-03-14T06:09:59.4956776Z OK 2025-03-14T06:10:00.1269579Z + run_xla_ir_debug /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:00.1270390Z + echo 'Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py' 2025-03-14T06:10:00.1271380Z Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:00.1271971Z + XLA_IR_DEBUG=1 2025-03-14T06:10:00.1272357Z + run_test /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:00.1273011Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py' 2025-03-14T06:10:00.1273728Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:00.1274254Z ++ command -v nvidia-smi 2025-03-14T06:10:00.1274937Z + '[' -x '' ']' 2025-03-14T06:10:00.1275188Z + PJRT_DEVICE=CPU 2025-03-14T06:10:00.1275448Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:00.1275862Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:00.1276316Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:00.1276702Z + python3 /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:03.3199919Z . 2025-03-14T06:10:03.3200331Z ---------------------------------------------------------------------- 2025-03-14T06:10:03.3200792Z Ran 1 test in 0.009s 2025-03-14T06:10:03.3200958Z 2025-03-14T06:10:03.3201065Z OK 2025-03-14T06:10:03.9277242Z + run_xla_hlo_debug /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:03.9278060Z + echo 'Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py' 2025-03-14T06:10:03.9279076Z Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:03.9279594Z + XLA_HLO_DEBUG=1 2025-03-14T06:10:03.9279982Z + run_test /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:03.9280645Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py' 2025-03-14T06:10:03.9281360Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:03.9281888Z ++ command -v nvidia-smi 2025-03-14T06:10:03.9282663Z + '[' -x '' ']' 2025-03-14T06:10:03.9282916Z + PJRT_DEVICE=CPU 2025-03-14T06:10:03.9283181Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:03.9283599Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:03.9284062Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:03.9284522Z + python3 /var/lib/jenkins/workspace/xla/test/test_env_var_mapper.py 2025-03-14T06:10:07.0848612Z . 2025-03-14T06:10:07.0849030Z ---------------------------------------------------------------------- 2025-03-14T06:10:07.0849482Z Ran 1 test in 0.010s 2025-03-14T06:10:07.0849664Z 2025-03-14T06:10:07.0849764Z OK 2025-03-14T06:10:07.6877691Z + run_xla_hlo_debug /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2025-03-14T06:10:07.6878633Z + echo 'Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py' 2025-03-14T06:10:07.6879534Z Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2025-03-14T06:10:07.6880128Z + XLA_HLO_DEBUG=1 2025-03-14T06:10:07.6880603Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2025-03-14T06:10:07.6881459Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py' 2025-03-14T06:10:07.6882334Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2025-03-14T06:10:07.6882948Z ++ command -v nvidia-smi 2025-03-14T06:10:07.6883231Z + '[' -x '' ']' 2025-03-14T06:10:07.6883488Z + PJRT_DEVICE=CPU 2025-03-14T06:10:07.6883739Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:07.6884219Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2025-03-14T06:10:07.6884841Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:07.6885300Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_save_load.py 2025-03-14T06:10:11.1011842Z ../opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:11.1013663Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:11.2705269Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:11.2706768Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:11.3304369Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:11.3305895Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:11.4913887Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:11.4915413Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:11.5402242Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:11.5403832Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:11.7002569Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:11.7004048Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:11.7143055Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:11.7144531Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:11.9906283Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:11.9907823Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:12.0393705Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:12.0395236Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:12.1991374Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:10:12.1992833Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:10:12.4084469Z ... 2025-03-14T06:10:12.4085071Z ---------------------------------------------------------------------- 2025-03-14T06:10:12.4085763Z Ran 9 tests in 1.368s 2025-03-14T06:10:12.4086036Z 2025-03-14T06:10:12.4086193Z OK 2025-03-14T06:10:13.0761230Z + run_save_tensor_ir run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:13.0762188Z + local run_test_func=run_test 2025-03-14T06:10:13.0762490Z + shift 2025-03-14T06:10:13.0763006Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2025-03-14T06:10:13.0763854Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:13.0764784Z + run_save_tensor run_test text /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:13.0765536Z + local run_test_func=run_test 2025-03-14T06:10:13.0765859Z + local file_graph_format=text 2025-03-14T06:10:13.0766150Z + shift 2 2025-03-14T06:10:13.0766656Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2025-03-14T06:10:13.0767501Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:13.0768097Z + local base_file=/tmp/xla_test_save_ir.txt 2025-03-14T06:10:13.0768459Z + ls '/tmp/xla_test_save_ir.txt*' 2025-03-14T06:10:13.0774304Z + XLA_SAVE_TENSORS_FILE=/tmp/xla_test_save_ir.txt 2025-03-14T06:10:13.0774678Z + XLA_SAVE_TENSORS_FMT=text 2025-03-14T06:10:13.0775133Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:13.0776014Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2025-03-14T06:10:13.0776860Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:13.0777670Z ++ command -v nvidia-smi 2025-03-14T06:10:13.0780162Z + '[' -x '' ']' 2025-03-14T06:10:13.0780419Z + PJRT_DEVICE=CPU 2025-03-14T06:10:13.0780676Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:13.0781119Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:13.0781619Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:13.0782035Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:16.3066539Z . 2025-03-14T06:10:16.3066934Z ---------------------------------------------------------------------- 2025-03-14T06:10:16.3067366Z Ran 1 test in 0.064s 2025-03-14T06:10:16.3067552Z 2025-03-14T06:10:16.3067642Z OK 2025-03-14T06:10:16.9228438Z + local test_status=0 2025-03-14T06:10:16.9232616Z + local actual_file 2025-03-14T06:10:16.9232936Z ++ head -n1 2025-03-14T06:10:16.9233229Z ++ ls /tmp/xla_test_save_ir.txt.0 2025-03-14T06:10:16.9249263Z + actual_file=/tmp/xla_test_save_ir.txt.0 2025-03-14T06:10:16.9249648Z + '[' -f /tmp/xla_test_save_ir.txt.0 ']' 2025-03-14T06:10:16.9250082Z + echo 'Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0' 2025-03-14T06:10:16.9250581Z Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0 2025-03-14T06:10:16.9250982Z + rm /tmp/xla_test_save_ir.txt.0 2025-03-14T06:10:16.9259200Z + return 0 2025-03-14T06:10:16.9259901Z + run_save_tensor_hlo run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:16.9260507Z + local run_test_func=run_test 2025-03-14T06:10:16.9260811Z + shift 2025-03-14T06:10:16.9261336Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2025-03-14T06:10:16.9262173Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:16.9262970Z + run_save_tensor run_test hlo /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:16.9263529Z + local run_test_func=run_test 2025-03-14T06:10:16.9263838Z + local file_graph_format=hlo 2025-03-14T06:10:16.9264124Z + shift 2 2025-03-14T06:10:16.9264625Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2025-03-14T06:10:16.9265642Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:16.9266244Z + local base_file=/tmp/xla_test_save_ir.txt 2025-03-14T06:10:16.9266779Z + ls '/tmp/xla_test_save_ir.txt*' 2025-03-14T06:10:16.9275814Z + XLA_SAVE_TENSORS_FILE=/tmp/xla_test_save_ir.txt 2025-03-14T06:10:16.9276224Z + XLA_SAVE_TENSORS_FMT=hlo 2025-03-14T06:10:16.9276683Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:16.9277416Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py' 2025-03-14T06:10:16.9278202Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:16.9279065Z ++ command -v nvidia-smi 2025-03-14T06:10:16.9281339Z + '[' -x '' ']' 2025-03-14T06:10:16.9281580Z + PJRT_DEVICE=CPU 2025-03-14T06:10:16.9281840Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:16.9282282Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:16.9282777Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:16.9283191Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_graph_dump.py 2025-03-14T06:10:20.1613297Z . 2025-03-14T06:10:20.1613716Z ---------------------------------------------------------------------- 2025-03-14T06:10:20.1614147Z Ran 1 test in 0.059s 2025-03-14T06:10:20.1614312Z 2025-03-14T06:10:20.1614413Z OK 2025-03-14T06:10:20.7806595Z + local test_status=0 2025-03-14T06:10:20.7806936Z + local actual_file 2025-03-14T06:10:20.7809053Z ++ head -n1 2025-03-14T06:10:20.7809316Z ++ ls /tmp/xla_test_save_ir.txt.0 2025-03-14T06:10:20.7830759Z + actual_file=/tmp/xla_test_save_ir.txt.0 2025-03-14T06:10:20.7831244Z + '[' -f /tmp/xla_test_save_ir.txt.0 ']' 2025-03-14T06:10:20.7831690Z + echo 'Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0' 2025-03-14T06:10:20.7832180Z Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0 2025-03-14T06:10:20.7832586Z + rm /tmp/xla_test_save_ir.txt.0 2025-03-14T06:10:20.7842463Z + return 0 2025-03-14T06:10:20.7842719Z + run_xla_op_tests2 2025-03-14T06:10:20.7843122Z + run_test /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py 2025-03-14T06:10:20.7843763Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py' 2025-03-14T06:10:20.7844586Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py 2025-03-14T06:10:20.7845101Z ++ command -v nvidia-smi 2025-03-14T06:10:20.7845550Z + '[' -x '' ']' 2025-03-14T06:10:20.7845805Z + PJRT_DEVICE=CPU 2025-03-14T06:10:20.7846067Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:20.7846468Z + run_coverage /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py 2025-03-14T06:10:20.7846921Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:20.7847288Z + python3 /var/lib/jenkins/workspace/xla/test/pjrt/test_dtypes.py 2025-03-14T06:10:23.9779343Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:10:23.9802672Z [ RUN ] TestDtypes.test_bool_round_trip 2025-03-14T06:10:23.9803230Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2025-03-14T06:10:23.9803870Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2025-03-14T06:10:23.9804643Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2025-03-14T06:10:23.9805289Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2025-03-14T06:10:23.9805897Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2025-03-14T06:10:23.9960814Z [ OK ] TestDtypes.test_bool_round_trip 2025-03-14T06:10:23.9961801Z [ RUN ] TestDtypes.test_float_round_trip0 (torch.float16) 2025-03-14T06:10:23.9962374Z [ OK ] TestDtypes.test_float_round_trip0 (torch.float16) 2025-03-14T06:10:23.9962854Z [ RUN ] TestDtypes.test_float_round_trip1 (torch.float32) 2025-03-14T06:10:23.9964692Z [ OK ] TestDtypes.test_float_round_trip1 (torch.float32) 2025-03-14T06:10:23.9965161Z [ RUN ] TestDtypes.test_float_round_trip2 (torch.float64) 2025-03-14T06:10:23.9968471Z [ OK ] TestDtypes.test_float_round_trip2 (torch.float64) 2025-03-14T06:10:23.9968940Z [ RUN ] TestDtypes.test_float_round_trip3 (torch.bfloat16) 2025-03-14T06:10:23.9971728Z [ OK ] TestDtypes.test_float_round_trip3 (torch.bfloat16) 2025-03-14T06:10:23.9972283Z [ RUN ] TestDtypes.test_float_round_trip4 (torch.complex64) 2025-03-14T06:10:23.9975767Z [ OK ] TestDtypes.test_float_round_trip4 (torch.complex64) 2025-03-14T06:10:23.9976227Z [ RUN ] TestDtypes.test_int_round_trip0 (torch.uint8) 2025-03-14T06:10:23.9978703Z [ OK ] TestDtypes.test_int_round_trip0 (torch.uint8) 2025-03-14T06:10:23.9979144Z [ RUN ] TestDtypes.test_int_round_trip1 (torch.int8) 2025-03-14T06:10:23.9981628Z [ OK ] TestDtypes.test_int_round_trip1 (torch.int8) 2025-03-14T06:10:23.9982062Z [ RUN ] TestDtypes.test_int_round_trip2 (torch.int16) 2025-03-14T06:10:23.9984515Z [ OK ] TestDtypes.test_int_round_trip2 (torch.int16) 2025-03-14T06:10:23.9984951Z [ RUN ] TestDtypes.test_int_round_trip3 (torch.int32) 2025-03-14T06:10:23.9987288Z [ OK ] TestDtypes.test_int_round_trip3 (torch.int32) 2025-03-14T06:10:23.9987723Z [ RUN ] TestDtypes.test_int_round_trip4 (torch.int64) 2025-03-14T06:10:23.9990128Z [ OK ] TestDtypes.test_int_round_trip4 (torch.int64) 2025-03-14T06:10:23.9990575Z ---------------------------------------------------------------------- 2025-03-14T06:10:23.9990976Z Ran 11 tests in 0.019s 2025-03-14T06:10:23.9991173Z 2025-03-14T06:10:23.9991261Z OK 2025-03-14T06:10:24.6225895Z + run_test /var/lib/jenkins/workspace/xla/test/test_while_loop.py 2025-03-14T06:10:24.6226906Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_while_loop.py' 2025-03-14T06:10:24.6227721Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_while_loop.py 2025-03-14T06:10:24.6228208Z ++ command -v nvidia-smi 2025-03-14T06:10:24.6228514Z + '[' -x '' ']' 2025-03-14T06:10:24.6228766Z + PJRT_DEVICE=CPU 2025-03-14T06:10:24.6229023Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:24.6229416Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_while_loop.py 2025-03-14T06:10:24.6229857Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:24.6230214Z + python3 /var/lib/jenkins/workspace/xla/test/test_while_loop.py 2025-03-14T06:10:29.7208984Z s... 2025-03-14T06:10:29.7209406Z ---------------------------------------------------------------------- 2025-03-14T06:10:29.7209843Z Ran 4 tests in 1.929s 2025-03-14T06:10:29.7210020Z 2025-03-14T06:10:29.7210140Z OK (skipped=1) 2025-03-14T06:10:30.3591817Z + run_test /var/lib/jenkins/workspace/xla/test/scan/test_scan.py 2025-03-14T06:10:30.3592580Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan.py' 2025-03-14T06:10:30.3593276Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan.py 2025-03-14T06:10:30.3593798Z ++ command -v nvidia-smi 2025-03-14T06:10:30.3594084Z + '[' -x '' ']' 2025-03-14T06:10:30.3594339Z + PJRT_DEVICE=CPU 2025-03-14T06:10:30.3594586Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:30.3594987Z + run_coverage /var/lib/jenkins/workspace/xla/test/scan/test_scan.py 2025-03-14T06:10:30.3595430Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:30.3595806Z + python3 /var/lib/jenkins/workspace/xla/test/scan/test_scan.py 2025-03-14T06:10:38.0272546Z ............... 2025-03-14T06:10:38.0273103Z ---------------------------------------------------------------------- 2025-03-14T06:10:38.0273536Z Ran 15 tests in 4.334s 2025-03-14T06:10:38.0273723Z 2025-03-14T06:10:38.0273820Z OK 2025-03-14T06:10:38.7052557Z + run_test /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py 2025-03-14T06:10:38.7053337Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py' 2025-03-14T06:10:38.7054093Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py 2025-03-14T06:10:38.7054819Z ++ command -v nvidia-smi 2025-03-14T06:10:38.7057418Z + '[' -x '' ']' 2025-03-14T06:10:38.7057675Z + PJRT_DEVICE=CPU 2025-03-14T06:10:38.7057929Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:38.7058344Z + run_coverage /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py 2025-03-14T06:10:38.7058808Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:38.7059189Z + python3 /var/lib/jenkins/workspace/xla/test/scan/test_scan_spmd.py 2025-03-14T06:10:41.8742554Z s 2025-03-14T06:10:41.8742944Z ---------------------------------------------------------------------- 2025-03-14T06:10:41.8743415Z Ran 1 test in 0.000s 2025-03-14T06:10:41.8743601Z 2025-03-14T06:10:41.8743703Z OK (skipped=1) 2025-03-14T06:10:42.4803052Z + run_test /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py 2025-03-14T06:10:42.4803846Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py' 2025-03-14T06:10:42.4804733Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py 2025-03-14T06:10:42.4805424Z ++ command -v nvidia-smi 2025-03-14T06:10:42.4805711Z + '[' -x '' ']' 2025-03-14T06:10:42.4805963Z + PJRT_DEVICE=CPU 2025-03-14T06:10:42.4806222Z + CPU_NUM_DEVICES=1 2025-03-14T06:10:42.4806650Z + run_coverage /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py 2025-03-14T06:10:42.4807133Z + '[' 0 '!=' 0 ']' 2025-03-14T06:10:42.4807539Z + python3 /var/lib/jenkins/workspace/xla/test/scan/test_scan_layers.py 2025-03-14T06:12:02.8729533Z ...... 2025-03-14T06:12:02.8729922Z ---------------------------------------------------------------------- 2025-03-14T06:12:02.8730344Z Ran 6 tests in 77.218s 2025-03-14T06:12:02.8730511Z 2025-03-14T06:12:02.8730607Z OK 2025-03-14T06:12:03.5634364Z + run_test /var/lib/jenkins/workspace/xla/test/test_autocast.py 2025-03-14T06:12:03.5635394Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_autocast.py' 2025-03-14T06:12:03.5636185Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_autocast.py 2025-03-14T06:12:03.5636697Z ++ command -v nvidia-smi 2025-03-14T06:12:03.5636979Z + '[' -x '' ']' 2025-03-14T06:12:03.5637229Z + PJRT_DEVICE=CPU 2025-03-14T06:12:03.5637492Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:03.5637879Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_autocast.py 2025-03-14T06:12:03.5638310Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:03.5638649Z + python3 /var/lib/jenkins/workspace/xla/test/test_autocast.py 2025-03-14T06:12:07.0139447Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:99: UserWarning: `devkind` argument is deprecated and will be removed in a future release. 2025-03-14T06:12:07.0140726Z warnings.warn("`devkind` argument is deprecated and will be removed in a " 2025-03-14T06:12:07.0237909Z test_autocast_banned (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0238634Z test_autocast_linalg_fp16 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0239414Z test_autocast_methods_expect_builtin_promote (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0240193Z test_autocast_methods_fp16 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0240891Z test_autocast_methods_fp32 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0241572Z test_autocast_nn_fp16 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0242225Z test_autocast_nn_fp32 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0242887Z test_autocast_torch_bf16 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0243646Z test_autocast_torch_expect_builtin_promote (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0244513Z test_autocast_torch_fp32 (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0245266Z test_autocast_torch_need_autocast_promote (__main__.TestAutocastCuda) ... skipped 'CUDA autocast test.' 2025-03-14T06:12:07.0246027Z test_autocast_methods_bf16 (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2025-03-14T06:12:07.0246784Z test_autocast_methods_expect_builtin_promote (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2025-03-14T06:12:07.0247540Z test_autocast_methods_fp32 (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2025-03-14T06:12:07.0248406Z test_autocast_nn_fp32 (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2025-03-14T06:12:07.0249197Z test_autocast_torch_expect_builtin_promote (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2025-03-14T06:12:07.0249940Z test_autocast_torch_fp32 (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2025-03-14T06:12:07.0250687Z test_autocast_torch_need_autocast_promote (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2025-03-14T06:12:07.0251444Z test_autocast_tpu_check_dtype (__main__.TestAutocastTPU) ... skipped 'TPU autocast test.' 2025-03-14T06:12:07.0251865Z 2025-03-14T06:12:07.0252041Z ---------------------------------------------------------------------- 2025-03-14T06:12:07.0252434Z Ran 19 tests in 0.000s 2025-03-14T06:12:07.0252599Z 2025-03-14T06:12:07.0252710Z OK (skipped=19) 2025-03-14T06:12:07.6830818Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager.py 2025-03-14T06:12:07.6831573Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager.py' 2025-03-14T06:12:07.6832301Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager.py 2025-03-14T06:12:07.6835676Z ++ command -v nvidia-smi 2025-03-14T06:12:07.6836040Z + '[' -x '' ']' 2025-03-14T06:12:07.6836294Z + PJRT_DEVICE=CPU 2025-03-14T06:12:07.6836548Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:07.6837145Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager.py 2025-03-14T06:12:07.6837660Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:07.6838031Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager.py 2025-03-14T06:12:11.8556882Z ....... 2025-03-14T06:12:11.8557338Z ---------------------------------------------------------------------- 2025-03-14T06:12:11.8559170Z Ran 7 tests in 1.014s 2025-03-14T06:12:11.8559405Z 2025-03-14T06:12:11.8559495Z OK 2025-03-14T06:12:12.4859598Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py 2025-03-14T06:12:12.4860660Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py' 2025-03-14T06:12:12.4861671Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py 2025-03-14T06:12:12.4862276Z ++ command -v nvidia-smi 2025-03-14T06:12:12.4863823Z + '[' -x '' ']' 2025-03-14T06:12:12.4864344Z + PJRT_DEVICE=CPU 2025-03-14T06:12:12.4864633Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:12.4865136Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py 2025-03-14T06:12:12.4866151Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:12.4866605Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py 2025-03-14T06:12:16.7886412Z .. 2025-03-14T06:12:16.7886936Z Unexpected Execution Analysis: ================================================================================ 2025-03-14T06:12:16.7887494Z Unexpected Execution Analysis: Compilation Cause 2025-03-14T06:12:16.7888113Z Unexpected Execution Analysis: most likely user code trying to access tensor value before mark_step 2025-03-14T06:12:16.7888753Z Unexpected Execution Analysis: Graph Info: 2025-03-14T06:12:16.7889209Z Unexpected Execution Analysis: Graph Name: dummy_graph_break 2025-03-14T06:12:16.7889797Z Unexpected Execution Analysis: Graph Hash: f615a2bc91df6cff5239bdce1202fb72 2025-03-14T06:12:16.7890380Z Unexpected Execution Analysis: Number of Graph Inputs: 1 2025-03-14T06:12:16.7890903Z Unexpected Execution Analysis: Number of Graph Outputs: 1 2025-03-14T06:12:16.7891439Z Unexpected Execution Analysis: Python Frame Triggered Execution: 2025-03-14T06:12:16.7892278Z Unexpected Execution Analysis: dummy_graph_break (/var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py:24) 2025-03-14T06:12:16.7893173Z Unexpected Execution Analysis: inner (/opt/conda/lib/python3.10/contextlib.py:79) 2025-03-14T06:12:16.7894134Z Unexpected Execution Analysis: test_eager_with_compile_graph_break (/var/lib/jenkins/workspace/xla/test/eager/test_eager_with_xla_compile.py:78) 2025-03-14T06:12:16.7895359Z Unexpected Execution Analysis: _callTestMethod (/opt/conda/lib/python3.10/unittest/case.py:549) 2025-03-14T06:12:16.7896166Z Unexpected Execution Analysis: run (/opt/conda/lib/python3.10/unittest/case.py:591) 2025-03-14T06:12:16.7896869Z Unexpected Execution Analysis: __call__ (/opt/conda/lib/python3.10/unittest/case.py:650) 2025-03-14T06:12:16.7897583Z Unexpected Execution Analysis: run (/opt/conda/lib/python3.10/unittest/suite.py:122) 2025-03-14T06:12:16.7898288Z Unexpected Execution Analysis: __call__ (/opt/conda/lib/python3.10/unittest/suite.py:84) 2025-03-14T06:12:16.7898936Z Unexpected Execution Analysis: .......... 2025-03-14T06:12:16.7899487Z Unexpected Execution Analysis: -------------------------------------------------------------------------------- 2025-03-14T06:12:16.7900175Z Unexpected Execution Analysis: ================================================================================ 2025-03-14T06:12:16.7904536Z . 2025-03-14T06:12:16.7904829Z ---------------------------------------------------------------------- 2025-03-14T06:12:16.7905221Z Ran 3 tests in 1.141s 2025-03-14T06:12:16.7905386Z 2025-03-14T06:12:16.7905488Z OK 2025-03-14T06:12:17.4070605Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py 2025-03-14T06:12:17.4071687Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py' 2025-03-14T06:12:17.4072752Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py 2025-03-14T06:12:17.4073473Z ++ command -v nvidia-smi 2025-03-14T06:12:17.4075839Z + '[' -x '' ']' 2025-03-14T06:12:17.4076099Z + PJRT_DEVICE=CPU 2025-03-14T06:12:17.4076407Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:17.4076963Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py 2025-03-14T06:12:17.4077507Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:17.4077961Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager_with_torch_compile.py 2025-03-14T06:12:21.4494383Z . 2025-03-14T06:12:21.4494778Z ---------------------------------------------------------------------- 2025-03-14T06:12:21.4495193Z Ran 1 test in 0.894s 2025-03-14T06:12:21.4495368Z 2025-03-14T06:12:21.4495462Z OK 2025-03-14T06:12:22.1852051Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py 2025-03-14T06:12:22.1854668Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py' 2025-03-14T06:12:22.1857290Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py 2025-03-14T06:12:22.1858734Z ++ command -v nvidia-smi 2025-03-14T06:12:22.1861017Z + '[' -x '' ']' 2025-03-14T06:12:22.1861288Z + PJRT_DEVICE=CPU 2025-03-14T06:12:22.1861546Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:22.1862045Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py 2025-03-14T06:12:22.1862597Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:22.1863068Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager_all_reduce_in_place.py 2025-03-14T06:12:29.7212234Z + run_test /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py 2025-03-14T06:12:29.7213009Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py' 2025-03-14T06:12:29.7213786Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py 2025-03-14T06:12:29.7214552Z ++ command -v nvidia-smi 2025-03-14T06:12:29.7217162Z + '[' -x '' ']' 2025-03-14T06:12:29.7217488Z + PJRT_DEVICE=CPU 2025-03-14T06:12:29.7217754Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:29.7218166Z + run_coverage /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py 2025-03-14T06:12:29.7218639Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:29.7219032Z + python3 /var/lib/jenkins/workspace/xla/test/eager/test_eager_spmd.py 2025-03-14T06:12:33.3759441Z .. 2025-03-14T06:12:33.3759835Z ---------------------------------------------------------------------- 2025-03-14T06:12:33.3760472Z Ran 2 tests in 0.492s 2025-03-14T06:12:33.3760704Z 2025-03-14T06:12:33.3760807Z OK 2025-03-14T06:12:33.9914473Z + run_test /var/lib/jenkins/workspace/xla/test/test_callback.py 2025-03-14T06:12:33.9915185Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_callback.py' 2025-03-14T06:12:33.9915875Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_callback.py 2025-03-14T06:12:33.9916425Z ++ command -v nvidia-smi 2025-03-14T06:12:33.9916717Z + '[' -x '' ']' 2025-03-14T06:12:33.9916974Z + PJRT_DEVICE=CPU 2025-03-14T06:12:33.9917238Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:33.9917632Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_callback.py 2025-03-14T06:12:33.9918083Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:33.9918443Z + python3 /var/lib/jenkins/workspace/xla/test/test_callback.py 2025-03-14T06:12:37.2536386Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:12:37.2559896Z [ RUN ] TestExperimentalCallback.test_callback 2025-03-14T06:12:37.2560588Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2025-03-14T06:12:37.2561228Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2025-03-14T06:12:37.2561841Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2025-03-14T06:12:37.2562450Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2025-03-14T06:12:37.2563378Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2025-03-14T06:12:37.4489811Z [ OK ] TestExperimentalCallback.test_callback 2025-03-14T06:12:37.4490373Z [ RUN ] TestExperimentalCallback.test_callback_event 2025-03-14T06:12:37.4515238Z [ OK ] TestExperimentalCallback.test_callback_event 2025-03-14T06:12:37.4515775Z ---------------------------------------------------------------------- 2025-03-14T06:12:37.4516179Z Ran 2 tests in 0.196s 2025-03-14T06:12:37.4516420Z 2025-03-14T06:12:37.4516521Z OK 2025-03-14T06:12:38.1050670Z + XLA_USE_SPMD=1 2025-03-14T06:12:38.1051470Z + run_test /var/lib/jenkins/workspace/xla/test/test_callback.py 2025-03-14T06:12:38.1052631Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_callback.py' 2025-03-14T06:12:38.1053891Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_callback.py 2025-03-14T06:12:38.1054830Z ++ command -v nvidia-smi 2025-03-14T06:12:38.1055788Z + '[' -x '' ']' 2025-03-14T06:12:38.1056239Z + PJRT_DEVICE=CPU 2025-03-14T06:12:38.1056701Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:38.1057381Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_callback.py 2025-03-14T06:12:38.1058176Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:38.1058816Z + python3 /var/lib/jenkins/workspace/xla/test/test_callback.py 2025-03-14T06:12:41.2839613Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:12:41.2855048Z [ RUN ] TestExperimentalCallback.test_callback 2025-03-14T06:12:41.2855763Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2025-03-14T06:12:41.2856423Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2025-03-14T06:12:41.2857057Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2025-03-14T06:12:41.2857674Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2025-03-14T06:12:41.2858270Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2025-03-14T06:12:41.4789799Z [ OK ] TestExperimentalCallback.test_callback 2025-03-14T06:12:41.4790360Z [ RUN ] TestExperimentalCallback.test_callback_event 2025-03-14T06:12:41.4809436Z [ OK ] TestExperimentalCallback.test_callback_event 2025-03-14T06:12:41.4809916Z ---------------------------------------------------------------------- 2025-03-14T06:12:41.4810314Z Ran 2 tests in 0.196s 2025-03-14T06:12:41.4810546Z 2025-03-14T06:12:41.4810637Z OK 2025-03-14T06:12:42.1056346Z + run_xla_op_tests3 2025-03-14T06:12:42.1056883Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py 2025-03-14T06:12:42.1057939Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py' 2025-03-14T06:12:42.1058708Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py 2025-03-14T06:12:42.1059370Z ++ command -v nvidia-smi 2025-03-14T06:12:42.1061907Z + '[' -x '' ']' 2025-03-14T06:12:42.1062504Z + PJRT_DEVICE=CPU 2025-03-14T06:12:42.1062828Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:42.1063288Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py 2025-03-14T06:12:42.1063790Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:42.1064195Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_exports.py 2025-03-14T06:12:45.3773633Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:45.3775148Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:45.4621986Z /opt/conda/lib/python3.10/site-packages/torch/export/_unlift.py:81: UserWarning: Attempted to insert a get_attr Node with no underlying reference in the owning GraphModule! Call GraphModule.add_submodule to add the necessary submodule, GraphModule.add_parameter to add the necessary Parameter, or nn.Module.register_buffer to add the necessary buffer 2025-03-14T06:12:45.4623736Z getattr_node = gm.graph.get_attr(lifted_node) 2025-03-14T06:12:45.6482130Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:45.6483603Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:45.7580326Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:45.7587843Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:45.9125756Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:45.9127235Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:45.9271842Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:45.9273328Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:46.0767313Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:46.0768781Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:46.1255810Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:46.1257291Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:46.2759485Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:46.2761176Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:46.3581535Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:46.3584169Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:46.6374985Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:46.6376486Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:46.7766913Z . 2025-03-14T06:12:46.7767477Z ---------------------------------------------------------------------- 2025-03-14T06:12:46.7768161Z Ran 5 tests in 1.419s 2025-03-14T06:12:46.7768453Z 2025-03-14T06:12:46.7768594Z OK 2025-03-14T06:12:47.4487002Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py 2025-03-14T06:12:47.4488022Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py' 2025-03-14T06:12:47.4488881Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py 2025-03-14T06:12:47.4489471Z ++ command -v nvidia-smi 2025-03-14T06:12:47.4490334Z + '[' -x '' ']' 2025-03-14T06:12:47.4490591Z + PJRT_DEVICE=CPU 2025-03-14T06:12:47.4490832Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:47.4491302Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py 2025-03-14T06:12:47.4491829Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:47.4492277Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_export_fx_passes.py 2025-03-14T06:12:50.6958846Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:50.6960388Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:50.7208387Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:50.7209852Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:50.7436855Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:50.7438358Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:50.8833043Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:50.8834582Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:50.9002954Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:50.9004815Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:50.9368256Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:50.9369732Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:50.9894654Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:50.9897277Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:51.0226281Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:51.0228926Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:51.0412562Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:51.0415115Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:51.1005912Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:51.1008722Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:51.1500224Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:51.1502837Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:51.2989295Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:51.2991861Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:51.3258890Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:51.3261503Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:51.3352941Z . 2025-03-14T06:12:51.3353457Z ---------------------------------------------------------------------- 2025-03-14T06:12:51.3354151Z Ran 12 tests in 0.698s 2025-03-14T06:12:51.3354473Z 2025-03-14T06:12:51.3354609Z OK 2025-03-14T06:12:51.3354968Z ExportedProgram: 2025-03-14T06:12:51.3355432Z class GraphModule(torch.nn.Module): 2025-03-14T06:12:51.3356149Z def forward(self, args_0: "f32[20, 768]", args_1: "i64[s0, 10]"): 2025-03-14T06:12:51.3357916Z # File: /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/stablehlo_test_utils.py:27 in forward, code: return f(*args) 2025-03-14T06:12:51.3359933Z embedding: "f32[s0, 10, 768]" = torch.ops.aten.embedding.default(args_0, args_1); args_0 = args_1 = None 2025-03-14T06:12:51.3361210Z return (embedding,) 2025-03-14T06:12:51.3361686Z 2025-03-14T06:12:51.3364593Z Graph signature: ExportGraphSignature(input_specs=[InputSpec(kind=, arg=TensorArgument(name='args_0'), target=None, persistent=None), InputSpec(kind=, arg=TensorArgument(name='args_1'), target=None, persistent=None)], output_specs=[OutputSpec(kind=, arg=TensorArgument(name='embedding'), target=None)]) 2025-03-14T06:12:51.3367789Z Range constraints: {s0: VR[0, int_oo]} 2025-03-14T06:12:51.3368190Z 2025-03-14T06:12:51.3368358Z ExportedProgram: 2025-03-14T06:12:51.3368821Z class GraphModule(torch.nn.Module): 2025-03-14T06:12:51.3369538Z def forward(self, args_0: "f32[20, 768]", args_1: "i64[s0, 10]"): 2025-03-14T06:12:51.3370305Z # No stacktrace found for following nodes 2025-03-14T06:12:51.3371070Z sym_size_int_1: "Sym(s0)" = torch.ops.aten.sym_size.int(args_1, 0) 2025-03-14T06:12:51.3371833Z mul: "Sym(10*s0)" = sym_size_int_1 * 10 2025-03-14T06:12:51.3372660Z reshape: "i64[10*s0]" = torch.ops.aten.reshape(args_1, [mul]); args_1 = mul = None 2025-03-14T06:12:51.3373469Z 2025-03-14T06:12:51.3375052Z # File: /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/utils/stablehlo_test_utils.py:27 in forward, code: return f(*args) 2025-03-14T06:12:51.3377103Z embedding: "f32[s0, 10, 768]" = torch.ops.aten.embedding.default(args_0, reshape); args_0 = reshape = None 2025-03-14T06:12:51.3378083Z 2025-03-14T06:12:51.3378533Z # No stacktrace found for following nodes 2025-03-14T06:12:51.3379641Z reshape_1: "f32[s0, 10, 768]" = torch.ops.aten.reshape(embedding, [sym_size_int_1, 10, 768]); embedding = sym_size_int_1 = None 2025-03-14T06:12:51.3380716Z return (reshape_1,) 2025-03-14T06:12:51.3381197Z 2025-03-14T06:12:51.3384023Z Graph signature: ExportGraphSignature(input_specs=[InputSpec(kind=, arg=TensorArgument(name='args_0'), target=None, persistent=None), InputSpec(kind=, arg=TensorArgument(name='args_1'), target=None, persistent=None)], output_specs=[OutputSpec(kind=, arg=TensorArgument(name='embedding'), target=None)]) 2025-03-14T06:12:51.3387032Z Range constraints: {s0: VR[0, int_oo]} 2025-03-14T06:12:51.3387406Z 2025-03-14T06:12:51.9936199Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py 2025-03-14T06:12:51.9937106Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py' 2025-03-14T06:12:51.9938019Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py 2025-03-14T06:12:51.9938636Z ++ command -v nvidia-smi 2025-03-14T06:12:51.9940961Z + '[' -x '' ']' 2025-03-14T06:12:51.9941233Z + PJRT_DEVICE=CPU 2025-03-14T06:12:51.9941491Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:51.9941994Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py 2025-03-14T06:12:51.9942549Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:51.9943019Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_implicit_broadcasting.py 2025-03-14T06:12:55.2756219Z ........... 2025-03-14T06:12:55.2756662Z ---------------------------------------------------------------------- 2025-03-14T06:12:55.2757098Z Ran 11 tests in 0.030s 2025-03-14T06:12:55.2757271Z 2025-03-14T06:12:55.8930984Z OK 2025-03-14T06:12:55.8931537Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py 2025-03-14T06:12:55.8932301Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py' 2025-03-14T06:12:55.8933155Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py 2025-03-14T06:12:55.8934006Z ++ command -v nvidia-smi 2025-03-14T06:12:55.8936469Z + '[' -x '' ']' 2025-03-14T06:12:55.8936771Z + PJRT_DEVICE=CPU 2025-03-14T06:12:55.8937024Z + CPU_NUM_DEVICES=1 2025-03-14T06:12:55.8937467Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py 2025-03-14T06:12:55.8937964Z + '[' 0 '!=' 0 ']' 2025-03-14T06:12:55.8938386Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_composite.py 2025-03-14T06:12:59.0529440Z ERROR:root:This module is need tensorflow with xla support. 2025-03-14T06:12:59.0530037Z Please install tensorflow with `pip install tf-nightly`. 2025-03-14T06:12:59.0845995Z 2025-03-14T06:12:59.0847498Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:59.0848999Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:59.3546621Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:59.3548171Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:59.4749965Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:59.4751574Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:59.6871142Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:59.6872632Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:59.7539082Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:59.7541711Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:59.9217198Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:59.9219791Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:12:59.9394128Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:12:59.9395612Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:00.2137160Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:00.2138719Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:00.2368735Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:00.2370471Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:00.4045303Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:00.4046772Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:00.5413535Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:00.5416154Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:00.7834348Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:00.7835850Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:00.8910124Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:00.8911665Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:01.0955549Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:01.0957041Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:01.1419259Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:01.1421873Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:01.4269101Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:01.4270574Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:01.4450334Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:01.4451840Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:01.6064975Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:01.6066604Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:01.7079654Z .s/opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:01.7082629Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:01.9477240Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:01.9478728Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:01.9931805Z .s/opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:01.9933286Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:02.1693550Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:02.1695028Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:02.1891828Z . 2025-03-14T06:13:02.1892354Z ---------------------------------------------------------------------- 2025-03-14T06:13:02.1892835Z Ran 13 tests in 3.135s 2025-03-14T06:13:02.1893020Z 2025-03-14T06:13:02.1893122Z OK (skipped=2) 2025-03-14T06:13:02.1893474Z tf is not installed. The tf.saved_model tests will be skipped. 2025-03-14T06:13:02.8455643Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py 2025-03-14T06:13:02.8456412Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py' 2025-03-14T06:13:02.8457230Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py 2025-03-14T06:13:02.8457861Z ++ command -v nvidia-smi 2025-03-14T06:13:02.8460418Z + '[' -x '' ']' 2025-03-14T06:13:02.8460703Z + PJRT_DEVICE=CPU 2025-03-14T06:13:02.8460964Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:02.8461405Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py 2025-03-14T06:13:02.8461891Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:02.8462283Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_pt2e_qdq.py 2025-03-14T06:13:06.2152101Z ERROR:root:This module is need tensorflow with xla support. 2025-03-14T06:13:06.2152723Z Please install tensorflow with `pip install tf-nightly`. 2025-03-14T06:13:06.2153051Z 2025-03-14T06:13:06.7350418Z ../opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:06.7351900Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:06.8343860Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:06.8345319Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:06.9053144Z /opt/conda/lib/python3.10/site-packages/torch/ao/quantization/quantizer/xnnpack_quantizer.py:281: UserWarning: XNNPACKQuantizer is deprecated! 2025-03-14T06:13:06.9054091Z warnings.warn(f"{self.__class__.__name__} is deprecated!") 2025-03-14T06:13:06.9087595Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm) on an already erased node 2025-03-14T06:13:06.9089073Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9100333Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_1) on an already erased node 2025-03-14T06:13:06.9102028Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9113713Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_2) on an already erased node 2025-03-14T06:13:06.9115145Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9126970Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_3) on an already erased node 2025-03-14T06:13:06.9128407Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9139281Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_4) on an already erased node 2025-03-14T06:13:06.9140710Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9151166Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_5) on an already erased node 2025-03-14T06:13:06.9152603Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9163590Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_6) on an already erased node 2025-03-14T06:13:06.9165081Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9175592Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_7) on an already erased node 2025-03-14T06:13:06.9177018Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9187550Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_8) on an already erased node 2025-03-14T06:13:06.9188965Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9199532Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_9) on an already erased node 2025-03-14T06:13:06.9200976Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9212092Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_10) on an already erased node 2025-03-14T06:13:06.9213431Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9226183Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_11) on an already erased node 2025-03-14T06:13:06.9227861Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9237377Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_12) on an already erased node 2025-03-14T06:13:06.9238896Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9250297Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_13) on an already erased node 2025-03-14T06:13:06.9251801Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9262599Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_14) on an already erased node 2025-03-14T06:13:06.9264059Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9275899Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_15) on an already erased node 2025-03-14T06:13:06.9277472Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9291205Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_16) on an already erased node 2025-03-14T06:13:06.9292644Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9301708Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_17) on an already erased node 2025-03-14T06:13:06.9303406Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9317385Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_18) on an already erased node 2025-03-14T06:13:06.9318906Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9331249Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_19) on an already erased node 2025-03-14T06:13:06.9332690Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:06.9824728Z /opt/conda/lib/python3.10/site-packages/torch/ao/quantization/utils.py:408: UserWarning: must run observer before calling calculate_qparams. Returning default values. 2025-03-14T06:13:06.9826323Z warnings.warn( 2025-03-14T06:13:06.9864118Z /opt/conda/lib/python3.10/site-packages/torch/ao/quantization/observer.py:1333: UserWarning: must run observer before calling calculate_qparams. Returning default scale and zero point 2025-03-14T06:13:06.9866083Z warnings.warn( 2025-03-14T06:13:07.1967949Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:07.1969430Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:07.8360549Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:07.8362049Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:08.3855014Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:08.3856517Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:08.4807651Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:08.4809109Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:08.5485596Z /opt/conda/lib/python3.10/site-packages/torch/ao/quantization/quantizer/xnnpack_quantizer.py:281: UserWarning: XNNPACKQuantizer is deprecated! 2025-03-14T06:13:08.5486542Z warnings.warn(f"{self.__class__.__name__} is deprecated!") 2025-03-14T06:13:08.5501722Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm) on an already erased node 2025-03-14T06:13:08.5503158Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5513946Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_1) on an already erased node 2025-03-14T06:13:08.5515396Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5527569Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_2) on an already erased node 2025-03-14T06:13:08.5529006Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5540720Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_3) on an already erased node 2025-03-14T06:13:08.5542151Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5552994Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_4) on an already erased node 2025-03-14T06:13:08.5554502Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5564974Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_5) on an already erased node 2025-03-14T06:13:08.5566541Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5577312Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_6) on an already erased node 2025-03-14T06:13:08.5578736Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5588716Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_7) on an already erased node 2025-03-14T06:13:08.5590143Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5600079Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_8) on an already erased node 2025-03-14T06:13:08.5601516Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5611357Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_9) on an already erased node 2025-03-14T06:13:08.5612998Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5622340Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_10) on an already erased node 2025-03-14T06:13:08.5623759Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5636348Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_11) on an already erased node 2025-03-14T06:13:08.5637788Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5647232Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_12) on an already erased node 2025-03-14T06:13:08.5648688Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5660008Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_13) on an already erased node 2025-03-14T06:13:08.5661451Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5672244Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_14) on an already erased node 2025-03-14T06:13:08.5673685Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5685407Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_15) on an already erased node 2025-03-14T06:13:08.5686906Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5700545Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_16) on an already erased node 2025-03-14T06:13:08.5701992Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5710373Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_17) on an already erased node 2025-03-14T06:13:08.5711916Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5724870Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_18) on an already erased node 2025-03-14T06:13:08.5726350Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.5739062Z /opt/conda/lib/python3.10/site-packages/torch/fx/graph.py:1179: UserWarning: erase_node(batch_norm_19) on an already erased node 2025-03-14T06:13:08.5740500Z warnings.warn(f"erase_node({to_erase}) on an already erased node") 2025-03-14T06:13:08.9924803Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:08.9926564Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:09.8370850Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:09.8372334Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:10.1105442Z . 2025-03-14T06:13:10.1106002Z ---------------------------------------------------------------------- 2025-03-14T06:13:10.1106687Z Ran 4 tests in 3.894s 2025-03-14T06:13:10.1106987Z 2025-03-14T06:13:10.1107141Z OK 2025-03-14T06:13:10.1107669Z tf is not installed. The tf.saved_model tests will be skipped. 2025-03-14T06:13:10.8668439Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py 2025-03-14T06:13:10.8669327Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py' 2025-03-14T06:13:10.8670511Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py 2025-03-14T06:13:10.8671172Z ++ command -v nvidia-smi 2025-03-14T06:13:10.8671716Z + '[' -x '' ']' 2025-03-14T06:13:10.8671996Z + PJRT_DEVICE=CPU 2025-03-14T06:13:10.8672255Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:10.8672760Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py 2025-03-14T06:13:10.8673309Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:10.8673774Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_custom_call.py 2025-03-14T06:13:14.0819546Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:14.0821073Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:14.3607986Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:14.3609560Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:14.4214717Z ..../opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:14.4216266Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:14.5806748Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:14.5808249Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:14.5954026Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:14.5955504Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:14.7486587Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:14.7488282Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:14.7563336Z . 2025-03-14T06:13:14.7563799Z ---------------------------------------------------------------------- 2025-03-14T06:13:14.7564219Z Ran 6 tests in 0.698s 2025-03-14T06:13:14.7564489Z 2025-03-14T06:13:14.7564594Z OK 2025-03-14T06:13:15.3808721Z + run_xla_hlo_debug /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2025-03-14T06:13:15.3809680Z + echo 'Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py' 2025-03-14T06:13:15.3810581Z Running with XLA_IR_DEBUG: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2025-03-14T06:13:15.3811223Z + XLA_HLO_DEBUG=1 2025-03-14T06:13:15.3811693Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2025-03-14T06:13:15.3812531Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py' 2025-03-14T06:13:15.3813410Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2025-03-14T06:13:15.3814015Z ++ command -v nvidia-smi 2025-03-14T06:13:15.3814498Z + '[' -x '' ']' 2025-03-14T06:13:15.3814818Z + PJRT_DEVICE=CPU 2025-03-14T06:13:15.3815078Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:15.3815559Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2025-03-14T06:13:15.3816097Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:15.3816552Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_inference.py 2025-03-14T06:13:18.7484046Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:18.7485781Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:18.9166410Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:18.9167956Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:18.9925682Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:18.9927244Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:19.1570456Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:19.1571933Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:19.6755640Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:19.6757117Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:20.4879113Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:20.4881057Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:21.1408230Z .. 2025-03-14T06:13:21.1408815Z ---------------------------------------------------------------------- 2025-03-14T06:13:21.1409497Z Ran 4 tests in 2.412s 2025-03-14T06:13:21.1409790Z 2025-03-14T06:13:21.1409961Z OK 2025-03-14T06:13:21.8509008Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py 2025-03-14T06:13:21.8509928Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py' 2025-03-14T06:13:21.8510809Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py 2025-03-14T06:13:21.8511411Z ++ command -v nvidia-smi 2025-03-14T06:13:21.8511710Z + '[' -x '' ']' 2025-03-14T06:13:21.8511966Z + PJRT_DEVICE=CPU 2025-03-14T06:13:21.8512527Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:21.8513029Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py 2025-03-14T06:13:21.8513569Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:21.8514016Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_stablehlo_compile.py 2025-03-14T06:13:25.9360426Z . 2025-03-14T06:13:25.9361030Z ---------------------------------------------------------------------- 2025-03-14T06:13:25.9361727Z Ran 1 test in 0.745s 2025-03-14T06:13:25.9362017Z 2025-03-14T06:13:25.9363533Z OK 2025-03-14T06:13:26.5957133Z + run_test /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py 2025-03-14T06:13:26.5958056Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py' 2025-03-14T06:13:26.5958942Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py 2025-03-14T06:13:26.5959537Z ++ command -v nvidia-smi 2025-03-14T06:13:26.5959839Z + '[' -x '' ']' 2025-03-14T06:13:26.5960137Z + PJRT_DEVICE=CPU 2025-03-14T06:13:26.5960404Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:26.5960916Z + run_coverage /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py 2025-03-14T06:13:26.5961458Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:26.5961918Z + python3 /var/lib/jenkins/workspace/xla/test/stablehlo/test_unbounded_dynamism.py 2025-03-14T06:13:29.7707470Z ERROR:root:This module is need tensorflow with xla support. 2025-03-14T06:13:29.7708094Z Please install tensorflow with `pip install tf-nightly`. 2025-03-14T06:13:29.7708401Z 2025-03-14T06:13:29.8569198Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:29.8570686Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:30.1368054Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:30.1369572Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:30.1891956Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:30.1894567Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:30.3568734Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:30.3570466Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:30.3895128Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:30.3897761Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:30.5637803Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:30.5640358Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:30.5966157Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:30.5967656Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:30.8767312Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:30.8768844Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:30.9047292Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:30.9049899Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.0732560Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.0735153Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.1010915Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.1013460Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.2668882Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.2671522Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.3038269Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.3039723Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.4667288Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.4668938Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.5046343Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.5048965Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.7959039Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.8264296Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.8267036Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.8269654Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:31.9959651Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:31.9962239Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.0320861Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.0322342Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.1977159Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.1978635Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.2268140Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.2269608Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.3883991Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.3885601Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.4127610Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.4129084Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.6927162Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.6928640Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.7278299Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.7279956Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.8921705Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.8923163Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:32.9240916Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:32.9243562Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:33.0962692Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:33.0965258Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:33.1375230Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:33.1376692Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:33.3287155Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:33.3289836Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:33.3794018Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:33.3796591Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:33.5526197Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:33.5527694Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:33.5831250Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:33.5833816Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:33.8755956Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:33.8757497Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:33.9032096Z .s/opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:33.9033880Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.0661485Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.0662945Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.0971567Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.0973057Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.2617476Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.2619163Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.2959467Z .s/opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.2960989Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.4590707Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.4592191Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.4895418Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.4898037Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.7792408Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.7793985Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.8047582Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.8049079Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:34.9647168Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:34.9648649Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:35.0149222Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:35.0152149Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:35.2106583Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:35.2108050Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:35.2702588Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:35.2705207Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:35.4534057Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:35.4535714Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:35.4998074Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:35.5000690Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:35.7889439Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:35.7891020Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:35.8231505Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:35.8232982Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:35.9805850Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:35.9807320Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.0110190Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.0112839Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.1718948Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.1721521Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.2070101Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.2072979Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.4955194Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.4956774Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.5266871Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.5269482Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.6911946Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.6914532Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.7406181Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.7408750Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.9023824Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.9025304Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:36.9305134Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:36.9307759Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.0944320Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.0946918Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.1241257Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.1242726Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.2847760Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.2849228Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.3166046Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.3167753Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.6024593Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.6026084Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.6297108Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.6298569Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.7860245Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.7861780Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.8137382Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.8138851Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.9709140Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.9710645Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:37.9945651Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:37.9947142Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:38.2769310Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:38.2770795Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:38.3045210Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:38.3046711Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:38.4613860Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:38.4615319Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:38.4954016Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:38.4955718Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:38.6525579Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:13:38.6527058Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:13:38.6736149Z . 2025-03-14T06:13:38.6736689Z ---------------------------------------------------------------------- 2025-03-14T06:13:38.6737347Z Ran 40 tests in 8.894s 2025-03-14T06:13:38.6737622Z 2025-03-14T06:13:38.6737785Z OK (skipped=2) 2025-03-14T06:13:38.6738336Z tf is not installed. The tf.saved_model tests will be skipped. 2025-03-14T06:13:39.3806355Z + run_test /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py 2025-03-14T06:13:39.3807277Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py' 2025-03-14T06:13:39.3808210Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py 2025-03-14T06:13:39.3808820Z ++ command -v nvidia-smi 2025-03-14T06:13:39.3809121Z + '[' -x '' ']' 2025-03-14T06:13:39.3809374Z + PJRT_DEVICE=CPU 2025-03-14T06:13:39.3809640Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:39.3810401Z + run_coverage /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py 2025-03-14T06:13:39.3810961Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:39.3811422Z + python3 /var/lib/jenkins/workspace/xla/test/quantized_ops/test_quantized_matmul.py 2025-03-14T06:13:43.2191694Z ............. 2025-03-14T06:13:43.2192300Z ---------------------------------------------------------------------- 2025-03-14T06:13:43.2192977Z Ran 13 tests in 0.630s 2025-03-14T06:13:43.2193272Z 2025-03-14T06:13:43.2193414Z OK 2025-03-14T06:13:43.8712107Z + run_test /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py 2025-03-14T06:13:43.8713023Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py' 2025-03-14T06:13:43.8713878Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py 2025-03-14T06:13:43.8714461Z ++ command -v nvidia-smi 2025-03-14T06:13:43.8714762Z + '[' -x '' ']' 2025-03-14T06:13:43.8715015Z + PJRT_DEVICE=CPU 2025-03-14T06:13:43.8715289Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:43.8715773Z + run_coverage /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py 2025-03-14T06:13:43.8716298Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:43.8716739Z + python3 /var/lib/jenkins/workspace/xla/test/quantized_ops/test_dot_general.py 2025-03-14T06:13:47.2957247Z .... 2025-03-14T06:13:47.2957849Z ---------------------------------------------------------------------- 2025-03-14T06:13:47.2958524Z Ran 4 tests in 0.220s 2025-03-14T06:13:47.2958797Z 2025-03-14T06:13:47.2958953Z OK 2025-03-14T06:13:47.9247859Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py 2025-03-14T06:13:47.9248701Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py' 2025-03-14T06:13:47.9249497Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py 2025-03-14T06:13:47.9250056Z ++ command -v nvidia-smi 2025-03-14T06:13:47.9250789Z + '[' -x '' ']' 2025-03-14T06:13:47.9251484Z + PJRT_DEVICE=CPU 2025-03-14T06:13:47.9251786Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:47.9252234Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py 2025-03-14T06:13:47.9252722Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:47.9253122Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding.py 2025-03-14T06:13:52.5866158Z .s....sss..........s.................ss......s......s....ss.ss..s..... 2025-03-14T06:13:52.5866677Z ---------------------------------------------------------------------- 2025-03-14T06:13:52.5867082Z Ran 70 tests in 1.416s 2025-03-14T06:13:52.5867514Z 2025-03-14T06:13:52.5867626Z OK (skipped=14) 2025-03-14T06:13:53.2394552Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py 2025-03-14T06:13:53.2395373Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py' 2025-03-14T06:13:53.2396181Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py 2025-03-14T06:13:53.2396796Z ++ command -v nvidia-smi 2025-03-14T06:13:53.2397093Z + '[' -x '' ']' 2025-03-14T06:13:53.2397347Z + PJRT_DEVICE=CPU 2025-03-14T06:13:53.2397611Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:53.2398060Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py 2025-03-14T06:13:53.2398563Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:53.2398986Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_sharding_hlo.py 2025-03-14T06:13:56.4368878Z . 2025-03-14T06:13:56.4369268Z ---------------------------------------------------------------------- 2025-03-14T06:13:56.4369709Z Ran 1 test in 0.048s 2025-03-14T06:13:56.4369876Z 2025-03-14T06:13:56.4369987Z OK 2025-03-14T06:13:57.0433869Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py 2025-03-14T06:13:57.0434711Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py' 2025-03-14T06:13:57.0435782Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py 2025-03-14T06:13:57.0436551Z ++ command -v nvidia-smi 2025-03-14T06:13:57.0436835Z + '[' -x '' ']' 2025-03-14T06:13:57.0437085Z + PJRT_DEVICE=CPU 2025-03-14T06:13:57.0437344Z + CPU_NUM_DEVICES=1 2025-03-14T06:13:57.0437802Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py 2025-03-14T06:13:57.0438310Z + '[' 0 '!=' 0 ']' 2025-03-14T06:13:57.0438733Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_virtual_device.py 2025-03-14T06:14:00.4250128Z ............ 2025-03-14T06:14:00.4250537Z ---------------------------------------------------------------------- 2025-03-14T06:14:00.4251009Z Ran 12 tests in 0.213s 2025-03-14T06:14:00.4251196Z 2025-03-14T06:14:00.4251289Z OK 2025-03-14T06:14:01.0434238Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py 2025-03-14T06:14:01.0435019Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py' 2025-03-14T06:14:01.0435825Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py 2025-03-14T06:14:01.0436394Z ++ command -v nvidia-smi 2025-03-14T06:14:01.0436708Z + '[' -x '' ']' 2025-03-14T06:14:01.0436972Z + PJRT_DEVICE=CPU 2025-03-14T06:14:01.0437241Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:01.0437690Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py 2025-03-14T06:14:01.0438176Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:01.0438581Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_dynamo_spmd.py 2025-03-14T06:14:05.2451586Z .s....s. 2025-03-14T06:14:05.2452123Z ---------------------------------------------------------------------- 2025-03-14T06:14:05.2452591Z Ran 8 tests in 1.015s 2025-03-14T06:14:05.2452777Z 2025-03-14T06:14:05.2452881Z OK (skipped=2) 2025-03-14T06:14:05.8941482Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py 2025-03-14T06:14:05.8942316Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py' 2025-03-14T06:14:05.8943155Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py 2025-03-14T06:14:05.8943747Z ++ command -v nvidia-smi 2025-03-14T06:14:05.8944248Z + '[' -x '' ']' 2025-03-14T06:14:05.8944515Z + PJRT_DEVICE=CPU 2025-03-14T06:14:05.8944771Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:05.8945211Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py 2025-03-14T06:14:05.8945705Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:05.8946112Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_debugging.py 2025-03-14T06:14:09.1244380Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/runtime.py:236: UserWarning: XLA_USE_SPMD is being deprecated. Use torch_xla.runtime.use_spmd() without setting XLA_USE_SPMD env-var. 2025-03-14T06:14:09.1246517Z warnings.warn("XLA_USE_SPMD is being deprecated. " 2025-03-14T06:14:09.1613627Z ┌───────┬───────┬───────┬────────┬───────┬───────┬────────┬────────┐ 2025-03-14T06:14:09.1614159Z │ │ │ │ │ │ │ │ │ 2025-03-14T06:14:09.1614673Z │ CPU 0 │ CPU 4 │ CPU 8 │ CPU 12 │ CPU 2 │ CPU 6 │ CPU 10 │ CPU 14 │ 2025-03-14T06:14:09.1615160Z │ │ │ │ │ │ │ │ │ 2025-03-14T06:14:09.1615653Z ├───────┼───────┼───────┼────────┼───────┼───────┼────────┼────────┤ 2025-03-14T06:14:09.1616102Z │ │ │ │ │ │ │ │ │ 2025-03-14T06:14:09.1616595Z │ CPU 1 │ CPU 5 │ CPU 9 │ CPU 13 │ CPU 3 │ CPU 7 │ CPU 11 │ CPU 15 │ 2025-03-14T06:14:09.1617090Z │ │ │ │ │ │ │ │ │ 2025-03-14T06:14:09.1617585Z └───────┴───────┴───────┴────────┴───────┴───────┴────────┴────────┘ 2025-03-14T06:14:09.1699796Z .s┌─────────┐ 2025-03-14T06:14:09.1700126Z │ │ 2025-03-14T06:14:09.1700395Z │ CPU [0] │ 2025-03-14T06:14:09.1700651Z │ │ 2025-03-14T06:14:09.1700910Z └─────────┘ 2025-03-14T06:14:09.1734060Z .s┌──────────────┐ 2025-03-14T06:14:09.1734572Z │ │ 2025-03-14T06:14:09.1734944Z │ CPU [0, 1] │ 2025-03-14T06:14:09.1735224Z │ │ 2025-03-14T06:14:09.1735506Z ├──────────────┤ 2025-03-14T06:14:09.1735771Z │ │ 2025-03-14T06:14:09.1736038Z │ CPU [4, 5] │ 2025-03-14T06:14:09.1736302Z │ │ 2025-03-14T06:14:09.1736573Z ├──────────────┤ 2025-03-14T06:14:09.1736836Z │ │ 2025-03-14T06:14:09.1737103Z │ CPU [8, 9] │ 2025-03-14T06:14:09.1737354Z │ │ 2025-03-14T06:14:09.1737625Z ├──────────────┤ 2025-03-14T06:14:09.1737886Z │ │ 2025-03-14T06:14:09.1738170Z │ CPU [12, 13] │ 2025-03-14T06:14:09.1738444Z │ │ 2025-03-14T06:14:09.1738718Z ├──────────────┤ 2025-03-14T06:14:09.1738978Z │ │ 2025-03-14T06:14:09.1739240Z │ CPU [2, 3] │ 2025-03-14T06:14:09.1739503Z │ │ 2025-03-14T06:14:09.1739775Z ├──────────────┤ 2025-03-14T06:14:09.1740034Z │ │ 2025-03-14T06:14:09.1740299Z │ CPU [6, 7] │ 2025-03-14T06:14:09.1740562Z │ │ 2025-03-14T06:14:09.1740832Z ├──────────────┤ 2025-03-14T06:14:09.1741108Z │ │ 2025-03-14T06:14:09.1741382Z │ CPU [10, 11] │ 2025-03-14T06:14:09.1741649Z │ │ 2025-03-14T06:14:09.1741922Z ├──────────────┤ 2025-03-14T06:14:09.1742185Z │ │ 2025-03-14T06:14:09.1748176Z │ CPU [14, 15] │ 2025-03-14T06:14:09.1748561Z │ │ 2025-03-14T06:14:09.1748849Z └──────────────┘ 2025-03-14T06:14:09.1790296Z .s┌─────────┐ 2025-03-14T06:14:09.1790623Z │ │ 2025-03-14T06:14:09.1790886Z │ CPU [0] │ 2025-03-14T06:14:09.1791150Z │ │ 2025-03-14T06:14:09.1791408Z └─────────┘ 2025-03-14T06:14:09.1811863Z .s┌─────────┐ 2025-03-14T06:14:09.1812141Z │ │ 2025-03-14T06:14:09.1812394Z │ CPU [0] │ 2025-03-14T06:14:09.1812646Z │ │ 2025-03-14T06:14:09.1812907Z └─────────┘ 2025-03-14T06:14:09.1839112Z .s┌─────────┐ 2025-03-14T06:14:09.1839513Z │ │ 2025-03-14T06:14:09.1839785Z │ CPU [0] │ 2025-03-14T06:14:09.1840039Z │ │ 2025-03-14T06:14:09.1840318Z └─────────┘ 2025-03-14T06:14:09.1843931Z .s 2025-03-14T06:14:09.1844246Z ---------------------------------------------------------------------- 2025-03-14T06:14:09.1844801Z Ran 12 tests in 0.061s 2025-03-14T06:14:09.1844979Z 2025-03-14T06:14:09.1845091Z OK (skipped=6) 2025-03-14T06:14:09.8208215Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py 2025-03-14T06:14:09.8209153Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py' 2025-03-14T06:14:09.8210067Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py 2025-03-14T06:14:09.8211068Z ++ command -v nvidia-smi 2025-03-14T06:14:09.8211514Z + '[' -x '' ']' 2025-03-14T06:14:09.8211753Z + PJRT_DEVICE=CPU 2025-03-14T06:14:09.8212013Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:09.8212505Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py 2025-03-14T06:14:09.8213055Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:09.8213647Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_distributed_checkpoint.py 2025-03-14T06:14:12.9870277Z sE0314 06:14:12.986299948 57906 server_chttp2.cc:40] {"created":"@1741932852.986285448","description":"Only 1 addresses added out of total 2 resolved","file":"external/com_github_grpc_grpc/src/core/ext/transport/chttp2/server/chttp2_server.cc","file_line":404,"referenced_errors":[{"created":"@1741932852.986283380","description":"Address family not supported by protocol","errno":97,"file":"external/com_github_grpc_grpc/src/core/lib/iomgr/socket_utils_common_posix.cc","file_line":420,"os_error":"Address family not supported by protocol","syscall":"socket","target_address":"[::1]:8547"}]} 2025-03-14T06:14:12.9905501Z WARNING: All log messages before absl::InitializeLog() is called are written to STDERR 2025-03-14T06:14:12.9906339Z I0000 00:00:1741932852.989759 57906 coordination_service_agent.cc:367] Coordination agent has successfully connected. 2025-03-14T06:14:12.9907695Z I0000 00:00:1741932852.989882 57906 coordination_service_agent.cc:440] Polling for error from coordination service. This is a long-running RPC that will return only if an error is encountered or cancelled (e.g. due to shutdown). 2025-03-14T06:14:13.0009146Z /opt/conda/lib/python3.10/site-packages/torch/distributed/checkpoint/state_dict_saver.py:323: UserWarning: The function definition for SavePlanner.set_up_planner has been updated to include the storage_meta argument. Please update your implementation to include this parameter. 2025-03-14T06:14:13.0010541Z warnings.warn( 2025-03-14T06:14:13.0069569Z /opt/conda/lib/python3.10/site-packages/torch/distributed/checkpoint/filesystem.py:111: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2025-03-14T06:14:13.0071381Z if tensor.storage().size() != tensor.numel(): 2025-03-14T06:14:14.9643702Z .....s2025-03-14 06:14:14.963394: W external/xla/xla/tsl/distributed_runtime/preemption/preemption_notifier.cc:89] SIGTERM caught at 2025-03-14T06:14:14.963251802+00:00 2025-03-14T06:14:14.9647002Z I0000 00:00:1741932854.964135 58158 preemption_sync_manager.cc:202] Received preemption notice with death_time 2025-03-14T06:14:14.963251802+00:00 2025-03-14T06:14:14.9648340Z I0000 00:00:1741932854.964375 58278 preemption_sync_manager.cc:162] Notified coordination service that this task will be preempted at 2025-03-14T06:14:14.963251802+00:00. absl::Status: OK 2025-03-14T06:14:14.9650105Z I0000 00:00:1741932854.964801 58279 preemption_sync_manager.cc:295] Preemption sync counter is set: 12 2025-03-14T06:14:15.9804363Z ./opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/runtime.py:242: UserWarning: Replicating tensors already initialized on non-virtual XLA device for SPMD to force SPMD mode. This is one-time overhead to setup, and to minimize such, please set SPMD mode before initializting tensors (i.e., call use_spmd() in the beginning of the program). 2025-03-14T06:14:15.9806463Z warnings.warn( 2025-03-14T06:14:15.9839189Z .sss/opt/conda/lib/python3.10/site-packages/torch/distributed/checkpoint/state_dict_saver.py:167: UserWarning: torch.distributed is disabled, unavailable or uninitialized, assuming the intent is to save in a single process. 2025-03-14T06:14:15.9840408Z warnings.warn( 2025-03-14T06:14:15.9877904Z /opt/conda/lib/python3.10/site-packages/torch/distributed/checkpoint/state_dict_loader.py:153: UserWarning: torch.distributed is disabled, unavailable or uninitialized, assuming the intent is to load in a single process. 2025-03-14T06:14:15.9879103Z warnings.warn( 2025-03-14T06:14:16.0949033Z .s.ss.s.s.s.. 2025-03-14T06:14:16.0949848Z ---------------------------------------------------------------------- 2025-03-14T06:14:16.0950342Z Ran 25 tests in 3.117s 2025-03-14T06:14:16.0950693Z 2025-03-14T06:14:16.0950886Z OK (skipped=11) 2025-03-14T06:14:16.5889347Z I0000 00:00:1741932856.587852 57906 coordination_service_agent.cc:617] Coordination agent has initiated Shutdown(). 2025-03-14T06:14:16.5890617Z I0000 00:00:1741932856.588940 57906 coordination_service_agent.cc:638] Coordination agent has successfully shut down. 2025-03-14T06:14:16.5891646Z I0000 00:00:1741932856.589020 58158 coordination_service_agent.cc:447] Cancelling error polling because the service or the agent is shutting down. 2025-03-14T06:14:16.7069276Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py 2025-03-14T06:14:16.7070319Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py' 2025-03-14T06:14:16.7071278Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py 2025-03-14T06:14:16.7071931Z ++ command -v nvidia-smi 2025-03-14T06:14:16.7072655Z + '[' -x '' ']' 2025-03-14T06:14:16.7072919Z + PJRT_DEVICE=CPU 2025-03-14T06:14:16.7073173Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:16.7073690Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py 2025-03-14T06:14:16.7074260Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:16.7074745Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_spmd_python_api_interaction.py 2025-03-14T06:14:19.9466603Z s.........../opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/runtime.py:242: UserWarning: Replicating tensors already initialized on non-virtual XLA device for SPMD to force SPMD mode. This is one-time overhead to setup, and to minimize such, please set SPMD mode before initializting tensors (i.e., call use_spmd() in the beginning of the program). 2025-03-14T06:14:19.9468477Z warnings.warn( 2025-03-14T06:14:19.9937913Z ..../opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/core/xla_model.py:99: UserWarning: `devkind` argument is deprecated and will be removed in a future release. 2025-03-14T06:14:19.9939139Z warnings.warn("`devkind` argument is deprecated and will be removed in a " 2025-03-14T06:14:19.9941960Z ....... 2025-03-14T06:14:19.9942263Z ---------------------------------------------------------------------- 2025-03-14T06:14:19.9942666Z Ran 23 tests in 0.060s 2025-03-14T06:14:19.9942844Z 2025-03-14T06:14:19.9942945Z OK (skipped=1) 2025-03-14T06:14:20.6326313Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py 2025-03-14T06:14:20.6327440Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py' 2025-03-14T06:14:20.6328346Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py 2025-03-14T06:14:20.6328934Z ++ command -v nvidia-smi 2025-03-14T06:14:20.6329217Z + '[' -x '' ']' 2025-03-14T06:14:20.6329465Z + PJRT_DEVICE=CPU 2025-03-14T06:14:20.6329719Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:20.6330196Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py 2025-03-14T06:14:20.6330696Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:20.6331128Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration.py 2025-03-14T06:14:23.8558820Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/runtime.py:236: UserWarning: XLA_USE_SPMD is being deprecated. Use torch_xla.runtime.use_spmd() without setting XLA_USE_SPMD env-var. 2025-03-14T06:14:23.8560058Z warnings.warn("XLA_USE_SPMD is being deprecated. " 2025-03-14T06:14:23.8561592Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/distributed/spmd/xla_sharding.py:58: DeprecationWarning: __array__ implementation doesn't accept a copy keyword, so passing copy=False failed. __array__ must implement 'dtype' and 'copy' keyword arguments. 2025-03-14T06:14:23.8563038Z device_ids = np.array(device_ids) 2025-03-14T06:14:24.1960985Z ... 2025-03-14T06:14:24.1961460Z ---------------------------------------------------------------------- 2025-03-14T06:14:24.1961883Z Ran 3 tests in 0.351s 2025-03-14T06:14:24.1962067Z 2025-03-14T06:14:24.1962154Z OK 2025-03-14T06:14:24.8196475Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py 2025-03-14T06:14:24.8197346Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py' 2025-03-14T06:14:24.8198254Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py 2025-03-14T06:14:24.8198898Z ++ command -v nvidia-smi 2025-03-14T06:14:24.8199230Z + '[' -x '' ']' 2025-03-14T06:14:24.8199497Z + PJRT_DEVICE=CPU 2025-03-14T06:14:24.8199766Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:24.8200240Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py 2025-03-14T06:14:24.8200780Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:24.8201243Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_dtensor_integration2.py 2025-03-14T06:14:28.0472610Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/runtime.py:236: UserWarning: XLA_USE_SPMD is being deprecated. Use torch_xla.runtime.use_spmd() without setting XLA_USE_SPMD env-var. 2025-03-14T06:14:28.0473868Z warnings.warn("XLA_USE_SPMD is being deprecated. " 2025-03-14T06:14:28.0532920Z WARNING: All log messages before absl::InitializeLog() is called are written to STDERR 2025-03-14T06:14:28.0533856Z W0000 00:00:1741932868.053080 58926 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2025-03-14T06:14:28.0534973Z I0000 00:00:1741932868.053098 58926 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2025-03-14T06:14:28.1349695Z W0000 00:00:1741932868.134240 58926 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2025-03-14T06:14:28.1350901Z I0000 00:00:1741932868.134257 58926 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2025-03-14T06:14:28.2035599Z . 2025-03-14T06:14:28.2036068Z ---------------------------------------------------------------------- 2025-03-14T06:14:28.2036590Z Ran 1 test in 0.165s 2025-03-14T06:14:28.2036797Z 2025-03-14T06:14:28.2036920Z OK 2025-03-14T06:14:28.8427930Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py 2025-03-14T06:14:28.8428781Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py' 2025-03-14T06:14:28.8430080Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py 2025-03-14T06:14:28.8430659Z ++ command -v nvidia-smi 2025-03-14T06:14:28.8430945Z + '[' -x '' ']' 2025-03-14T06:14:28.8431198Z + PJRT_DEVICE=CPU 2025-03-14T06:14:28.8431454Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:28.8431918Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py 2025-03-14T06:14:28.8432417Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:28.8432844Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_xla_auto_sharding.py 2025-03-14T06:14:32.0331651Z /opt/conda/lib/python3.10/site-packages/torch_xla-2.7.0+gitb2b890e-py3.10-linux-x86_64.egg/torch_xla/runtime.py:236: UserWarning: XLA_USE_SPMD is being deprecated. Use torch_xla.runtime.use_spmd() without setting XLA_USE_SPMD env-var. 2025-03-14T06:14:32.0332908Z warnings.warn("XLA_USE_SPMD is being deprecated. " 2025-03-14T06:14:32.0367681Z .WARNING: All log messages before absl::InitializeLog() is called are written to STDERR 2025-03-14T06:14:32.0370206Z W0000 00:00:1741932872.036262 59248 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2025-03-14T06:14:32.0373451Z I0000 00:00:1741932872.036392 59248 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2025-03-14T06:14:32.1843256Z .W0000 00:00:1741932872.183640 59248 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2025-03-14T06:14:32.1844610Z I0000 00:00:1741932872.183652 59248 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2025-03-14T06:14:32.2553443Z W0000 00:00:1741932872.254570 59248 hlo_module_config.h:193] Warning: Using auto_spmd_partitioning. It is experimental and may contain bugs! 2025-03-14T06:14:32.2554645Z I0000 00:00:1741932872.254586 59248 hlo_module_config.h:195] Overwriting use_spmd_partitioning to true, because use_auto_spmd_partitioning is true. 2025-03-14T06:14:32.3238783Z . 2025-03-14T06:14:32.3239235Z ---------------------------------------------------------------------- 2025-03-14T06:14:32.3239675Z Ran 3 tests in 0.300s 2025-03-14T06:14:32.3239865Z 2025-03-14T06:14:32.3239959Z OK 2025-03-14T06:14:32.9503530Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py 2025-03-14T06:14:32.9504761Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py' 2025-03-14T06:14:32.9506288Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py 2025-03-14T06:14:32.9507235Z ++ command -v nvidia-smi 2025-03-14T06:14:32.9507729Z + '[' -x '' ']' 2025-03-14T06:14:32.9508132Z + PJRT_DEVICE=CPU 2025-03-14T06:14:32.9508391Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:32.9508875Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py 2025-03-14T06:14:32.9509437Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:32.9509888Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_parameter_wrapping.py 2025-03-14T06:14:36.2584015Z . 2025-03-14T06:14:36.2584449Z ---------------------------------------------------------------------- 2025-03-14T06:14:36.2584898Z Ran 1 test in 0.160s 2025-03-14T06:14:36.2585083Z 2025-03-14T06:14:36.2585175Z OK 2025-03-14T06:14:36.8668412Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py 2025-03-14T06:14:36.8669223Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py' 2025-03-14T06:14:36.8670048Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py 2025-03-14T06:14:36.8671011Z ++ command -v nvidia-smi 2025-03-14T06:14:36.8671466Z + '[' -x '' ']' 2025-03-14T06:14:36.8671859Z + PJRT_DEVICE=CPU 2025-03-14T06:14:36.8672295Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:36.8673230Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py 2025-03-14T06:14:36.8674204Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:36.8674690Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_mp_input_sharding.py 2025-03-14T06:14:40.1084068Z ssssss 2025-03-14T06:14:40.1084586Z ---------------------------------------------------------------------- 2025-03-14T06:14:40.1085015Z Ran 6 tests in 0.000s 2025-03-14T06:14:40.1085216Z 2025-03-14T06:14:40.1085322Z OK (skipped=6) 2025-03-14T06:14:40.7368082Z + run_save_tensor_hlo run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2025-03-14T06:14:40.7368722Z + local run_test_func=run_test 2025-03-14T06:14:40.7369015Z + shift 2025-03-14T06:14:40.7369557Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py' 2025-03-14T06:14:40.7370453Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2025-03-14T06:14:40.7371333Z + run_save_tensor run_test hlo /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2025-03-14T06:14:40.7371928Z + local run_test_func=run_test 2025-03-14T06:14:40.7372244Z + local file_graph_format=hlo 2025-03-14T06:14:40.7372533Z + shift 2 2025-03-14T06:14:40.7373067Z + echo 'Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py' 2025-03-14T06:14:40.7374198Z Running in save tensor file mode: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2025-03-14T06:14:40.7374843Z + local base_file=/tmp/xla_test_save_ir.txt 2025-03-14T06:14:40.7375211Z + ls '/tmp/xla_test_save_ir.txt*' 2025-03-14T06:14:40.7385526Z + XLA_SAVE_TENSORS_FILE=/tmp/xla_test_save_ir.txt 2025-03-14T06:14:40.7385898Z + XLA_SAVE_TENSORS_FMT=hlo 2025-03-14T06:14:40.7386373Z + run_test /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2025-03-14T06:14:40.7387158Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py' 2025-03-14T06:14:40.7388113Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2025-03-14T06:14:40.7388697Z ++ command -v nvidia-smi 2025-03-14T06:14:40.7390866Z + '[' -x '' ']' 2025-03-14T06:14:40.7391121Z + PJRT_DEVICE=CPU 2025-03-14T06:14:40.7391366Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:40.7391845Z + run_coverage /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2025-03-14T06:14:40.7392378Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:40.7392820Z + python3 /var/lib/jenkins/workspace/xla/test/spmd/test_spmd_lowering_context.py 2025-03-14T06:14:44.0814676Z .. 2025-03-14T06:14:44.0815234Z ---------------------------------------------------------------------- 2025-03-14T06:14:44.0815919Z Ran 2 tests in 0.174s 2025-03-14T06:14:44.0816215Z 2025-03-14T06:14:44.0816357Z OK 2025-03-14T06:14:44.7258418Z + local test_status=0 2025-03-14T06:14:44.7258844Z + local actual_file 2025-03-14T06:14:44.7265639Z ++ head -n1 2025-03-14T06:14:44.7266034Z ++ ls /tmp/xla_test_save_ir.txt.0 2025-03-14T06:14:44.7286887Z + actual_file=/tmp/xla_test_save_ir.txt.0 2025-03-14T06:14:44.7287312Z + '[' -f /tmp/xla_test_save_ir.txt.0 ']' 2025-03-14T06:14:44.7287755Z + echo 'Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0' 2025-03-14T06:14:44.7288251Z Cleaning up temporary file: /tmp/xla_test_save_ir.txt.0 2025-03-14T06:14:44.7288652Z + rm /tmp/xla_test_save_ir.txt.0 2025-03-14T06:14:44.7294498Z + return 0 2025-03-14T06:14:44.7295032Z + run_test /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py --verbosity=2 2025-03-14T06:14:44.7295850Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py' --verbosity=2 2025-03-14T06:14:44.7296699Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py --verbosity=2 2025-03-14T06:14:44.7298026Z ++ command -v nvidia-smi 2025-03-14T06:14:44.7300362Z + '[' -x '' ']' 2025-03-14T06:14:44.7300695Z + PJRT_DEVICE=CPU 2025-03-14T06:14:44.7301115Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:44.7301595Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py --verbosity=2 2025-03-14T06:14:44.7302219Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:44.7302666Z + python3 /var/lib/jenkins/workspace/xla/test/test_operations_hlo.py --verbosity=2 2025-03-14T06:14:48.1120622Z test_div_by_f64 (__main__.TestOperationsHlo) ... ok 2025-03-14T06:14:48.1129588Z test_dropout_by_u8_mask (__main__.TestOperationsHlo) ... ok 2025-03-14T06:14:48.1141926Z test_expand (__main__.TestOperationsHlo) ... ok 2025-03-14T06:14:48.1151419Z test_special_scalars_addcdiv_addcmul (__main__.TestOperationsHlo) ... ok 2025-03-14T06:14:48.1152091Z 2025-03-14T06:14:48.1152375Z ---------------------------------------------------------------------- 2025-03-14T06:14:48.1153032Z Ran 4 tests in 0.218s 2025-03-14T06:14:48.1153305Z 2025-03-14T06:14:48.1153445Z OK 2025-03-14T06:14:48.7306457Z + run_test /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py 2025-03-14T06:14:48.7307334Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py' 2025-03-14T06:14:48.7308141Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py 2025-03-14T06:14:48.7308705Z ++ command -v nvidia-smi 2025-03-14T06:14:48.7309236Z + '[' -x '' ']' 2025-03-14T06:14:48.7309510Z + PJRT_DEVICE=CPU 2025-03-14T06:14:48.7309769Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:48.7310437Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py 2025-03-14T06:14:48.7310942Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:48.7311358Z + python3 /var/lib/jenkins/workspace/xla/test/test_input_output_aliases.py 2025-03-14T06:14:52.9216585Z ...... 2025-03-14T06:14:52.9217035Z ---------------------------------------------------------------------- 2025-03-14T06:14:52.9217472Z Ran 6 tests in 1.022s 2025-03-14T06:14:52.9217662Z 2025-03-14T06:14:52.9217754Z OK 2025-03-14T06:14:53.5456152Z + run_test /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py 2025-03-14T06:14:53.5457094Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py' 2025-03-14T06:14:53.5457992Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py 2025-03-14T06:14:53.5458600Z ++ command -v nvidia-smi 2025-03-14T06:14:53.5461005Z + '[' -x '' ']' 2025-03-14T06:14:53.5461276Z + PJRT_DEVICE=CPU 2025-03-14T06:14:53.5461546Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:53.5462039Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py 2025-03-14T06:14:53.5462564Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:53.5463010Z + python3 /var/lib/jenkins/workspace/xla/test/test_torch_distributed_xla_backend.py 2025-03-14T06:14:56.8214772Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:14:56.8241572Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2025-03-14T06:14:56.8242286Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2025-03-14T06:14:56.8242936Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2025-03-14T06:14:56.8243555Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2025-03-14T06:14:56.8244171Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2025-03-14T06:14:56.8335488Z [ RUN ] XlaBackendTest.test_all_scalar_allgather 2025-03-14T06:14:56.8367566Z [ OK ] XlaBackendTest.test_all_scalar_allgather 2025-03-14T06:14:56.8367995Z [ RUN ] XlaBackendTest.test_allgather 2025-03-14T06:14:56.8389310Z [ OK ] XlaBackendTest.test_allgather 2025-03-14T06:14:56.8389841Z [ RUN ] XlaBackendTest.test_allgather_coalesced 2025-03-14T06:14:56.8406205Z [ OK ] XlaBackendTest.test_allgather_coalesced 2025-03-14T06:14:56.8406649Z [ RUN ] XlaBackendTest.test_allreduce 2025-03-14T06:14:56.8408908Z [ OK ] XlaBackendTest.test_allreduce 2025-03-14T06:14:56.8409300Z [ RUN ] XlaBackendTest.test_allreduce_with_mesh 2025-03-14T06:14:56.8438295Z [ OK ] XlaBackendTest.test_allreduce_with_mesh 2025-03-14T06:14:56.8438871Z [ RUN ] XlaBackendTest.test_barrier 2025-03-14T06:14:56.8439238Z [ OK ] XlaBackendTest.test_barrier 2025-03-14T06:14:56.8439603Z [ RUN ] XlaBackendTest.test_broadcast 2025-03-14T06:14:56.8442699Z [ OK ] XlaBackendTest.test_broadcast 2025-03-14T06:14:56.8443107Z [ RUN ] XlaBackendTest.test_new_group_entire_world 2025-03-14T06:14:56.8451576Z [ OK ] XlaBackendTest.test_new_group_entire_world 2025-03-14T06:14:56.8452027Z [ RUN ] XlaBackendTest.test_new_group_horizontal 2025-03-14T06:14:56.8474415Z [ OK ] XlaBackendTest.test_new_group_horizontal 2025-03-14T06:14:56.8474893Z [ RUN ] XlaBackendTest.test_new_group_invalid_horizontal 2025-03-14T06:14:56.8503254Z [ OK ] XlaBackendTest.test_new_group_invalid_horizontal 2025-03-14T06:14:56.8503758Z [ RUN ] XlaBackendTest.test_new_group_invalid_ranks 2025-03-14T06:14:56.8505920Z [ OK ] XlaBackendTest.test_new_group_invalid_ranks 2025-03-14T06:14:56.8506369Z [ RUN ] XlaBackendTest.test_new_group_invalid_vertical 2025-03-14T06:14:56.8526147Z [ OK ] XlaBackendTest.test_new_group_invalid_vertical 2025-03-14T06:14:56.8526623Z [ RUN ] XlaBackendTest.test_new_group_no_ranks 2025-03-14T06:14:56.8529952Z [ OK ] XlaBackendTest.test_new_group_no_ranks 2025-03-14T06:14:56.8530500Z [ RUN ] XlaBackendTest.test_new_group_one_paticipant 2025-03-14T06:14:56.8537952Z [ OK ] XlaBackendTest.test_new_group_one_paticipant 2025-03-14T06:14:56.8538378Z [ RUN ] XlaBackendTest.test_new_group_vertical 2025-03-14T06:14:56.8565668Z [ OK ] XlaBackendTest.test_new_group_vertical 2025-03-14T06:14:56.8566096Z [ RUN ] XlaBackendTest.test_recv 2025-03-14T06:14:56.8572657Z [ OK ] XlaBackendTest.test_recv 2025-03-14T06:14:56.8573023Z [ RUN ] XlaBackendTest.test_reduce_scatter 2025-03-14T06:14:56.8581910Z [ OK ] XlaBackendTest.test_reduce_scatter 2025-03-14T06:14:56.8582383Z [ RUN ] XlaBackendTest.test_reduce_scatter_coalesced 2025-03-14T06:14:56.8582845Z [ SKIPPED ] XlaBackendTest.test_reduce_scatter_coalesced 2025-03-14T06:14:56.8583251Z [ RUN ] XlaBackendTest.test_send 2025-03-14T06:14:56.8600521Z [ OK ] XlaBackendTest.test_send 2025-03-14T06:14:56.8601050Z [ RUN ] XlaBackendTest.test_unimplemented_op0 ('reduce') 2025-03-14T06:14:56.8601543Z [ OK ] XlaBackendTest.test_unimplemented_op0 ('reduce') 2025-03-14T06:14:56.8602073Z [ RUN ] XlaBackendTest.test_unimplemented_op1 ('allreduce_coalesced') 2025-03-14T06:14:56.8602650Z [ OK ] XlaBackendTest.test_unimplemented_op1 ('allreduce_coalesced') 2025-03-14T06:14:56.8603185Z [ RUN ] XlaBackendTest.test_unimplemented_op2 ('alltoall') 2025-03-14T06:14:56.8603661Z [ OK ] XlaBackendTest.test_unimplemented_op2 ('alltoall') 2025-03-14T06:14:56.8604114Z [ RUN ] XlaBackendTest.test_unimplemented_op3 ('gather') 2025-03-14T06:14:56.8604703Z [ OK ] XlaBackendTest.test_unimplemented_op3 ('gather') 2025-03-14T06:14:56.8605172Z [ RUN ] XlaBackendTest.test_unimplemented_op4 ('scatter') 2025-03-14T06:14:56.8605707Z [ OK ] XlaBackendTest.test_unimplemented_op4 ('scatter') 2025-03-14T06:14:56.8606198Z [ RUN ] XlaBackendTest.test_unimplemented_op5 ('recv_anysource') 2025-03-14T06:14:56.8607136Z [ OK ] XlaBackendTest.test_unimplemented_op5 ('recv_anysource') 2025-03-14T06:14:56.8607683Z [ RUN ] XlaBackendTest.test_unimplemented_op6 ('monitored_barrier') 2025-03-14T06:14:56.8609144Z [ OK ] XlaBackendTest.test_unimplemented_op6 ('monitored_barrier') 2025-03-14T06:14:56.8609630Z [ RUN ] XlaBackendTest.test_xla_backend_exists 2025-03-14T06:14:56.8610035Z [ OK ] XlaBackendTest.test_xla_backend_exists 2025-03-14T06:14:56.8610462Z ---------------------------------------------------------------------- 2025-03-14T06:14:56.8610854Z Ran 27 tests in 0.038s 2025-03-14T06:14:56.8611035Z 2025-03-14T06:14:56.8611134Z OK (skipped=1) 2025-03-14T06:14:57.5069191Z + run_torchrun /var/lib/jenkins/workspace/xla/test/pjrt/test_torchrun.py 2025-03-14T06:14:57.5070443Z ++ command -v nvidia-smi 2025-03-14T06:14:57.5073440Z + '[' -x '' ']' 2025-03-14T06:14:57.5073851Z + run_test /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py 2025-03-14T06:14:57.5074553Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py' 2025-03-14T06:14:57.5075316Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py 2025-03-14T06:14:57.5076931Z ++ command -v nvidia-smi 2025-03-14T06:14:57.5079283Z + '[' -x '' ']' 2025-03-14T06:14:57.5079532Z + PJRT_DEVICE=CPU 2025-03-14T06:14:57.5079786Z + CPU_NUM_DEVICES=1 2025-03-14T06:14:57.5080205Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py 2025-03-14T06:14:57.5080675Z + '[' 0 '!=' 0 ']' 2025-03-14T06:14:57.5081063Z + python3 /var/lib/jenkins/workspace/xla/test/test_persistent_cache.py 2025-03-14T06:15:00.6800882Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:15:00.6815853Z [ RUN ] PersistentCacheTest.test_persistent_cache_mp 2025-03-14T06:15:00.6816451Z [ SKIPPED ] PersistentCacheTest.test_persistent_cache_mp 2025-03-14T06:15:00.6816961Z [ RUN ] PersistentCacheTest.test_persistent_cache_single_device 2025-03-14T06:15:00.6817531Z [ SKIPPED ] PersistentCacheTest.test_persistent_cache_single_device 2025-03-14T06:15:00.6818329Z [ RUN ] PersistentCacheTest.test_persistent_cache_spmd_replicated 2025-03-14T06:15:00.6818913Z [ SKIPPED ] PersistentCacheTest.test_persistent_cache_spmd_replicated 2025-03-14T06:15:00.6819460Z [ RUN ] PersistentCacheTest.test_persistent_cache_spmd_sharded 2025-03-14T06:15:00.6820000Z [ SKIPPED ] PersistentCacheTest.test_persistent_cache_spmd_sharded 2025-03-14T06:15:00.6820516Z [ RUN ] PersistentCacheTest.test_replicated_spmd_hash 2025-03-14T06:15:00.6820993Z [ SKIPPED ] PersistentCacheTest.test_replicated_spmd_hash 2025-03-14T06:15:00.6821458Z ---------------------------------------------------------------------- 2025-03-14T06:15:00.6821861Z Ran 5 tests in 0.000s 2025-03-14T06:15:00.6822039Z 2025-03-14T06:15:00.6822136Z OK (skipped=5) 2025-03-14T06:15:01.2794352Z + run_test /var/lib/jenkins/workspace/xla/test/test_devices.py 2025-03-14T06:15:01.2795021Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_devices.py' 2025-03-14T06:15:01.2795753Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_devices.py 2025-03-14T06:15:01.2796445Z ++ command -v nvidia-smi 2025-03-14T06:15:01.2796785Z + '[' -x '' ']' 2025-03-14T06:15:01.2797036Z + PJRT_DEVICE=CPU 2025-03-14T06:15:01.2797292Z + CPU_NUM_DEVICES=1 2025-03-14T06:15:01.2797670Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_devices.py 2025-03-14T06:15:01.2798098Z + '[' 0 '!=' 0 ']' 2025-03-14T06:15:01.2798429Z + python3 /var/lib/jenkins/workspace/xla/test/test_devices.py 2025-03-14T06:15:04.4788691Z Running tests under Python 3.10.16: /opt/conda/bin/python3 2025-03-14T06:15:04.4807219Z [ RUN ] TestDevices.test_device0 (None, device(type='xla', index=0)) 2025-03-14T06:15:04.4807867Z Warning, backtrace signal handler for signal 11 overwrote previous handler. 2025-03-14T06:15:04.4808502Z Warning, backtrace signal handler for signal 6 overwrote previous handler. 2025-03-14T06:15:04.4809123Z Warning, backtrace signal handler for signal 7 overwrote previous handler. 2025-03-14T06:15:04.4809747Z Warning, backtrace signal handler for signal 4 overwrote previous handler. 2025-03-14T06:15:04.4810358Z Warning, backtrace signal handler for signal 8 overwrote previous handler. 2025-03-14T06:15:04.4885589Z [ OK ] TestDevices.test_device0 (None, device(type='xla', index=0)) 2025-03-14T06:15:04.4886168Z [ RUN ] TestDevices.test_device1 (0, device(type='xla', index=0)) 2025-03-14T06:15:04.4886694Z [ OK ] TestDevices.test_device1 (0, device(type='xla', index=0)) 2025-03-14T06:15:04.4887204Z [ RUN ] TestDevices.test_device2 (3, device(type='xla', index=3)) 2025-03-14T06:15:04.4887912Z [ OK ] TestDevices.test_device2 (3, device(type='xla', index=3)) 2025-03-14T06:15:04.4888404Z [ RUN ] TestDevices.test_device_count 2025-03-14T06:15:04.4888847Z [ OK ] TestDevices.test_device_count 2025-03-14T06:15:04.4889204Z [ RUN ] TestDevices.test_devices 2025-03-14T06:15:04.4889543Z [ OK ] TestDevices.test_devices 2025-03-14T06:15:04.4889891Z [ RUN ] TestDevices.test_real_devices 2025-03-14T06:15:04.4890260Z [ OK ] TestDevices.test_real_devices 2025-03-14T06:15:04.4890606Z [ RUN ] TestDevices.test_step 2025-03-14T06:15:04.4898863Z [ OK ] TestDevices.test_step 2025-03-14T06:15:04.4899246Z [ RUN ] TestDevices.test_step_exception 2025-03-14T06:15:04.4902115Z [ OK ] TestDevices.test_step_exception 2025-03-14T06:15:04.4902469Z [ RUN ] TestDevices.test_sync 2025-03-14T06:15:04.4903623Z [ OK ] TestDevices.test_sync 2025-03-14T06:15:04.4903964Z [ RUN ] TestDevices.test_trivial_model 2025-03-14T06:15:04.6530455Z [ OK ] TestDevices.test_trivial_model 2025-03-14T06:15:04.6531005Z ---------------------------------------------------------------------- 2025-03-14T06:15:04.6531418Z Ran 10 tests in 0.173s 2025-03-14T06:15:04.6531608Z 2025-03-14T06:15:04.6531696Z OK 2025-03-14T06:15:05.2835059Z + run_device_detection_test /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py 2025-03-14T06:15:05.2836173Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py' 2025-03-14T06:15:05.2836965Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py 2025-03-14T06:15:05.2837502Z + current_device= 2025-03-14T06:15:05.2837766Z + current_num_gpu_devices= 2025-03-14T06:15:05.2838054Z + unset PJRT_DEVICE 2025-03-14T06:15:05.2838320Z + unset GPU_NUM_DEVICES 2025-03-14T06:15:05.2838771Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py 2025-03-14T06:15:05.2839263Z + '[' 0 '!=' 0 ']' 2025-03-14T06:15:05.2839672Z + python3 /var/lib/jenkins/workspace/xla/test/test_gpu_device_detection.py 2025-03-14T06:15:08.4481345Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2025-03-14T06:15:08.4488778Z s 2025-03-14T06:15:08.4489080Z ---------------------------------------------------------------------- 2025-03-14T06:15:08.4489490Z Ran 1 test in 0.000s 2025-03-14T06:15:08.4489672Z 2025-03-14T06:15:08.4489772Z OK (skipped=1) 2025-03-14T06:15:09.0485531Z + export GPU_NUM_DEVICES= 2025-03-14T06:15:09.0485995Z + GPU_NUM_DEVICES= 2025-03-14T06:15:09.0486295Z + export PJRT_DEVICE= 2025-03-14T06:15:09.0486575Z + PJRT_DEVICE= 2025-03-14T06:15:09.0486826Z + PJRT_DEVICE=CPU 2025-03-14T06:15:09.0487084Z + CPU_NUM_DEVICES=1 2025-03-14T06:15:09.0487505Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_core_aten_ops.py 2025-03-14T06:15:09.0487981Z + '[' 0 '!=' 0 ']' 2025-03-14T06:15:09.0488365Z + python3 /var/lib/jenkins/workspace/xla/test/test_core_aten_ops.py 2025-03-14T06:15:12.4057200Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:12.4059860Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:12.6817489Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:12.6818995Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:12.7900758Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:12.7903646Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:12.9495304Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:12.9496768Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:13.0644975Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:13.0647614Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:13.2252554Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:13.2254050Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:13.3432197Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:13.3434838Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:13.6204931Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:13.6206424Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:13.7308554Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:13.7310130Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:13.8869046Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:13.8870554Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:14.0083100Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:14.0085831Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:14.1669513Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:14.1670981Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:14.2930877Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:14.2933496Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:14.4520558Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:14.4522210Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:14.5644327Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:14.5646002Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:14.8367820Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:14.8369359Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:14.9495904Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:14.9498574Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:15.1088307Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:15.1089784Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:15.2265780Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:15.2268481Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:15.3850149Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:15.3851615Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:15.4910874Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:15.4912395Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:15.6444168Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:15.6445732Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:15.7390989Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:15.7392466Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:16.0111093Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:16.0112889Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:16.1054263Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:16.1055833Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:16.2596470Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:16.2597982Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:16.3566433Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:16.3568055Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:16.5096177Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:16.5097656Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:16.6115051Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:16.6116542Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:16.7647683Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:16.7649157Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:16.8651312Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:16.8652823Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:17.0187227Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:17.0188702Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:17.1237938Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:17.1239446Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:17.3929775Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:17.3931642Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:17.5075856Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:17.5077399Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:17.6626585Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:17.6628087Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:17.7729313Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:17.7731236Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:17.9267768Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:17.9269238Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:18.0464975Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:18.0466725Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:18.1999623Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:18.2001082Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:18.2957624Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:18.2959181Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:18.5667346Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:18.5668900Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:18.6631337Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:18.6632853Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:18.8162718Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:18.8164615Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:18.9126667Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:19.0638183Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:19.0639721Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:19.0641175Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:19.1600996Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:19.1602498Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:19.4318292Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:19.4319821Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:19.5276116Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:19.5277699Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:19.6796272Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:19.6797741Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:19.8214291Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:19.8215829Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:19.9755353Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:19.9756838Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:20.0748395Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:20.0749944Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:20.2292966Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:20.2294668Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:20.3289466Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:20.3290981Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:20.4825230Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:20.4826704Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:20.5311616Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:20.5313166Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:20.7994533Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:20.7996133Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:20.8408889Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:20.8410397Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:20.9905148Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:20.9906648Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:21.0310814Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:21.0312290Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:21.1793432Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:21.1794915Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:21.2673072Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:21.2674625Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:21.4171980Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:21.4173717Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:21.5146651Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:21.5148173Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:21.7857545Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:21.7859086Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:21.8856151Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:21.8857736Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:22.0375109Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:22.0376578Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:22.1363763Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:22.1365555Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:22.2871867Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:22.2873363Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:22.3836880Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:22.3838414Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:22.5344448Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:22.5345955Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:22.6327642Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:22.6329202Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:22.9039381Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:22.9041304Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:23.0055231Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:23.0056774Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:23.1569181Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:23.1570647Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:23.2589605Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:23.2591156Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:23.4092927Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:23.4094402Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:23.5081232Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:23.5082792Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:23.6583998Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:23.6585452Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:23.7595668Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:23.7597220Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:24.0296233Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:24.0297824Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:24.1322419Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:24.1323967Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:24.2833605Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:24.2835074Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:24.3831957Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:24.3833775Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:24.5336501Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:24.5337965Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:24.5865970Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:24.5867492Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:24.7373770Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:24.7375257Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:24.7915134Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:24.7916643Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:25.0647147Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:25.0648721Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:25.1175630Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:25.1177094Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:25.2687182Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:25.2688676Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:25.3687907Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:25.3689469Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:25.5198726Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:25.5200227Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:25.6218009Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:25.6219757Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:25.7734468Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:25.7735941Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:25.8762614Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:25.8764227Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:26.0286529Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:26.0288100Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:26.1316028Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:26.1317520Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:26.4048293Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:26.4049839Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:26.5079821Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:26.5081365Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:26.6592565Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:26.6594051Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:26.7626820Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:26.7628395Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:26.9125424Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:26.9126898Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:27.0125634Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:27.0127448Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:27.1653383Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:27.1654853Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:27.2590779Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:27.2592324Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:27.5324822Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:27.5326570Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:27.6268214Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:27.6269723Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:27.7795752Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:27.7797294Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:27.8755354Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:27.8756893Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:28.0274428Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:28.0275931Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:28.1278081Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:28.1279586Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:28.2794046Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:28.2798206Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:28.5010372Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:28.5012313Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:28.6521940Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:28.6523402Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:28.7618153Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:28.7619723Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:28.9130791Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:28.9132279Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:29.0350269Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:29.0351935Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:29.1866828Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:29.1868318Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:29.3081978Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:29.3083515Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:29.5845908Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:29.5847480Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:29.6957442Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:29.6958977Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:29.8490315Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:29.8491786Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:29.9473392Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:29.9475143Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:30.0989730Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:30.0991242Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:30.1948564Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:30.1950071Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:30.3451744Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:30.3453229Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:30.4415332Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:30.4416880Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:30.5916591Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:30.5918099Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:30.6880022Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:30.6881551Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:30.9635599Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:30.9637157Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:31.0690931Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:31.2206380Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:31.2207888Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:31.2209318Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:31.3467924Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:31.3469755Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:31.4985862Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:31.4987383Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:31.6242153Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:31.7734694Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:31.7736173Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:31.7737636Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:31.9055429Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:31.9058116Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:32.2276370Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:32.2277863Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:32.3546270Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:32.3548930Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:32.5367304Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:32.5368762Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:32.6823463Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:32.6825085Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:32.8897308Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:32.8898815Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:33.0477088Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:33.0479965Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:33.2440819Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:33.2442298Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:33.3480594Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:33.3482138Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:33.4996965Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:33.5954632Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:33.5956378Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:33.8694035Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:33.8695559Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:33.8697043Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:33.9199058Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:33.9200573Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:34.0718571Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:34.0720040Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:34.1208394Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:34.1209896Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:34.2726021Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:34.2727493Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:34.3211381Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:34.3213106Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:34.4728847Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:34.4730523Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:34.5680842Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:34.5682377Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:34.8417489Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:34.8418994Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:34.9377865Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:34.9379371Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:35.0888810Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:35.0890296Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:35.1791227Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:35.1792761Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:35.3310100Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:35.3311603Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:35.4208846Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:35.4210410Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:35.5734011Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:35.5735494Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:35.6647598Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:35.6649433Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:35.9427716Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:35.9429449Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:36.0248053Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:36.0249558Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:36.1752993Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:36.1754484Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:36.2159312Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:36.2161067Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:36.3646505Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:36.3647997Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:36.4048169Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:36.4049667Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:36.5534984Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:36.5536448Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:36.6414944Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:36.6416422Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:36.9180668Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:36.9182228Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:37.0166795Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:37.0168496Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:37.1665925Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:37.1667587Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:37.2560999Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:37.2562501Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:37.4047443Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:37.4048931Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:37.4936593Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:37.4938262Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:37.6447489Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:37.6449095Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:37.7411867Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:37.7413369Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:38.0172628Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:38.0174122Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:38.1159484Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:38.1160994Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:38.2667847Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:38.2669323Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:38.3639883Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:38.3641520Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:38.5152295Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:38.5153907Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:38.6121018Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:38.6122509Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:38.7632256Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:38.7633733Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:38.8596162Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:38.8597683Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.0119948Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.0121433Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.0614905Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.0616408Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.3374425Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.3376086Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.3792762Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.3794253Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.5285507Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.5286993Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.5688051Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.5689539Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.7163433Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.7165500Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.8057905Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.8059396Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:39.9568940Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:39.9570419Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:40.0556681Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:40.0558191Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:40.3356306Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:40.3357923Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:40.4347096Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:40.4348668Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:40.5851324Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:40.5852832Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:40.6889015Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:40.6890624Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:40.8484195Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:40.8485771Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:40.9709089Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:40.9710588Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:41.1552970Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:41.1555988Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:41.2639309Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:41.2641940Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:41.4240684Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:41.4243439Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:41.5245079Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:41.5247796Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:41.8030943Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:41.8033664Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:41.9002697Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:41.9005478Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:42.0493480Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:42.0496206Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:42.1490286Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:42.1493162Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:42.3000030Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:42.3002702Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:42.3989933Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:42.3992635Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:42.5493960Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:42.5496925Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:42.6511131Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:42.6512858Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:42.9290083Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:42.9291629Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:43.0316042Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:43.0317619Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:43.1821016Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:43.1822497Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:43.2852042Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:43.2853602Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:43.4368780Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:43.4370274Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:43.5408500Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:43.5410048Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:43.6906050Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:43.6907530Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:43.7939567Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:43.7941114Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:44.0729905Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:44.0731703Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:44.1775523Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:44.1777330Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:44.3302158Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:44.3303664Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:44.4361091Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:44.4362695Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:44.5867770Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:44.5869335Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:44.6921259Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:44.6922768Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:44.8423311Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:44.8424806Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:44.9439947Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:44.9441471Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:45.0946408Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:45.1899993Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:45.1901501Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:45.1902977Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:45.4689571Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:45.4691345Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:45.5656185Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:45.5658009Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:45.7167433Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:45.7168939Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:45.8169951Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:45.8171499Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:45.9678378Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:45.9680033Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:46.0712860Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:46.0714462Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:46.2211113Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:46.2212583Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:46.3253737Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:46.3255264Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:46.6056838Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:46.6058382Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:46.7039500Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:46.7041021Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:46.8561483Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:46.9520326Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:46.9521846Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:46.9523498Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:47.1032138Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:47.1033603Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:47.1990945Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:47.1992469Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:47.3512328Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:47.3513846Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:47.4487658Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:47.4489229Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:47.6008476Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:47.6009983Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:47.6998235Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:47.6999743Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:47.9838094Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:47.9839683Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:48.0850334Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:48.0851922Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:48.2375414Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:48.2376875Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:48.3382607Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:48.3384479Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:48.4906983Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:48.4908467Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:48.5870790Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:48.5872288Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:48.7381800Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:48.7383284Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:48.8348693Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:48.8350277Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:48.9848835Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:48.9850325Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:49.0830695Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:49.0832213Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:49.3641445Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:49.3643006Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:49.4608746Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:49.4610290Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:49.6105640Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:49.6107158Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:49.7064258Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:49.7066237Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:49.8567381Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:49.8568890Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:49.9533209Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:49.9534733Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:50.1048062Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:50.1049558Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:50.2007742Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:50.2009246Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:50.4840996Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:50.4842554Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:50.5803374Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:50.5805061Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:50.7325419Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:50.7326887Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:50.8298824Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:50.8300330Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:50.9803492Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:50.9805070Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:51.0788880Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:51.0790669Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:51.2288742Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:51.2290229Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:51.3276273Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:51.3277767Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:51.6111251Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:51.6112830Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:51.7093313Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:51.7094826Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:51.8602939Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:51.8604431Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:51.9594080Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:51.9595644Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:52.1097890Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:52.1099368Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:52.2090417Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:52.2091921Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:52.3592770Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:52.4558286Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:52.4559834Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:52.4561551Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:52.6072653Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:52.6074326Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:52.7016253Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:52.7017746Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:52.9851283Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:52.9852793Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:53.0809318Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:53.0810868Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:53.2326538Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:53.2328016Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:53.3216040Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:53.3217592Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:53.4741397Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:53.4742895Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:53.5552993Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:53.5554559Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:53.7055218Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:53.7056677Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:53.7865440Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:53.7867160Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:53.9367448Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:53.9369088Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:54.0297450Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:54.0298975Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:54.3131259Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:54.3132802Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:54.4239794Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:54.4241627Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:54.5745180Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:54.5746714Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:54.6839158Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:54.6840657Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:54.8339310Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:54.8340793Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:54.9340892Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:54.9342469Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:55.0854492Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:55.0855997Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:55.1806458Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:55.1808019Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:55.4673555Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:55.4675429Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:55.5628128Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:55.5629647Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:55.7144185Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:55.7145661Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:55.7643635Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:55.7645571Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:55.9172311Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:55.9173826Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:55.9673824Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:55.9675336Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:56.1206070Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:56.1207551Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:56.1691783Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:56.1693296Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:56.3234082Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:56.3235545Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:56.4188318Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:56.4189839Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:56.7039949Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:56.7041656Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:56.8007913Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:56.8009456Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:56.9523173Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:56.9524816Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:57.0477863Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:57.0479372Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:57.1994323Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:57.1995827Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:57.2956375Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:57.2957906Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:57.4467483Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:57.5442883Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:57.5444619Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:57.5446110Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:57.8289633Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:57.8291185Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:57.9206033Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:57.9207550Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:58.0705502Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:58.0707192Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:58.1627028Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:58.1628566Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:58.3149325Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:58.3150799Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:58.4187492Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:58.4189005Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:58.5713490Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:58.5715016Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:58.6720734Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:58.6722302Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:58.9583155Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:58.9584716Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:59.0563057Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:59.0564772Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:59.2078810Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:59.2080312Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:59.3055165Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:59.3056732Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:59.4563921Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:59.4565963Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:59.5549072Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:59.5550646Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:59.7074267Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:59.7075751Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:59.8046922Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:59.8048498Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:15:59.9569261Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:15:59.9570761Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:00.0068479Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:00.0070040Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:00.2929735Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:00.2931299Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:00.3436010Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:00.3437550Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:00.4933843Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:00.4935334Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:00.5426610Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:00.5428138Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:00.6928060Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:00.6929706Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:00.7887980Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:00.7889478Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:00.9413743Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:00.9415201Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:01.0390427Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:01.0391989Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:01.1911212Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:01.1912695Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:01.2870528Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:01.2872078Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:01.5759684Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:01.5761251Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:01.6745757Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:01.6747297Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:01.8256783Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:01.8258271Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:01.9219415Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:01.9220961Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:02.0727719Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:02.0729387Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:02.1688709Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:02.1690496Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:02.3200961Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:02.3202441Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:02.4168973Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:02.4170491Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:02.7084244Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:02.7085973Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:02.8049449Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:02.8051005Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:02.9608570Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:02.9610124Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:03.0588984Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:03.2120308Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:03.2121794Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:03.2123259Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:03.3154486Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:03.3157157Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:03.4705198Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:03.4706888Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:03.5720162Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:03.5722029Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:03.7227200Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:03.8241257Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:03.8242793Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:03.8244280Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:04.1168960Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:04.1170696Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:04.2234692Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:04.2236238Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:04.3779681Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:04.3781183Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:04.4786253Z .s/opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:04.4787793Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:04.6312248Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:04.6313759Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:04.7279649Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:04.7281184Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:04.8790182Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:04.8791862Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:04.9762638Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:04.9764425Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:05.2650032Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:05.2651596Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:05.3632985Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:05.3634548Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:05.5151175Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:05.5152681Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:05.6118182Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:05.6119751Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:05.7631573Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:05.7633104Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:05.8598717Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:05.8600241Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:06.0111774Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:06.0113308Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:06.1089025Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:06.1090554Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:06.2594889Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:06.2596352Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:06.3569364Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:06.3571143Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:06.6454769Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:06.6456301Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:06.7435392Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:06.8957587Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:06.8959109Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:06.8960577Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:06.9950554Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:06.9952113Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:07.1491318Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:07.1492801Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:07.2488794Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:07.2490334Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:07.4011861Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:07.4013336Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:07.5007936Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:07.5009534Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:07.6532682Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:07.6534156Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:07.7576854Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:07.7578685Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:08.0528227Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:08.0529810Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:08.1631999Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:08.1633580Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:08.3181523Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:08.3183006Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:08.4272019Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:08.4273557Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:08.5820531Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:08.5822061Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:08.6848800Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:08.6850290Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:08.8391690Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:08.8393221Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:08.9335649Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:08.9337213Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:09.2287895Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:09.2289431Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:09.3244650Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:09.3246420Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:09.4784615Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:09.4786139Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:09.5726175Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:09.5727681Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:09.7257658Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:09.7259144Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:09.8202959Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:09.8204645Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:09.9732070Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:09.9742382Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:10.0680012Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:10.0681554Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:10.3641040Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:10.3642597Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:10.4604572Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:10.4606123Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:10.6115773Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:10.6117259Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:10.7086248Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:10.7087946Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:10.8582071Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:10.8583726Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:10.9527896Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:10.9529445Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:11.1030680Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:11.1032185Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:11.1964051Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:11.1965967Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:11.3464955Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:11.3466615Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:11.4415178Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:11.4416764Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:11.7349564Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:11.7351094Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:11.8286393Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:11.8287956Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:11.9780523Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:11.9782027Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:12.0724808Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:12.2229449Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:12.2230933Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:12.2232553Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:12.3194310Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:12.3195841Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:12.4700054Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:12.4701557Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:12.5663997Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:12.5665894Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:12.7168526Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:12.7170012Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:12.8146377Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:12.8147888Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:13.1096391Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:13.1097906Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:13.2071853Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:13.2073395Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:13.3607860Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:13.3609356Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:13.4569264Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:13.4571005Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:13.6094639Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:13.6096299Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:13.7000242Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:13.7001731Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:13.8508814Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:13.8510335Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:13.9322689Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:13.9324401Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:14.0830062Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:14.0831615Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:14.1246516Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:14.1248024Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:14.4162087Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:14.4163655Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:14.4573704Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:14.4575211Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:14.6072578Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:14.6074057Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:14.6476832Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:14.6478597Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:14.7965886Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:14.7967552Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:14.8879162Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:14.8880708Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:15.0381556Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:15.0383081Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:15.1431037Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:15.1432593Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:15.4372793Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:15.4374304Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:15.5425021Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:15.5426753Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:15.6928257Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:15.6929725Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:15.7977658Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:15.7979183Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:15.9482570Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:15.9484071Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:16.0604400Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:16.0606105Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:16.2108973Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:16.2110612Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:16.3212342Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:16.3213896Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:16.4719830Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:16.4721326Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:16.5786410Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:16.5787988Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:16.8733127Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:16.8734681Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:16.9800372Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:16.9801947Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:17.1321101Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:17.1322606Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:17.2373414Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:17.2374934Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:17.3886969Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:17.3888453Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:17.4900573Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:17.4902103Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:17.6409556Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:17.6411341Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:17.7427743Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:17.7429290Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:17.8935240Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:17.8936733Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:17.9933455Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:17.9935035Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:18.2909719Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:18.2911312Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:18.3918102Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:18.3919676Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:18.5440875Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:18.5442395Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:18.6424600Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:18.6426159Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:18.7950967Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:18.7952443Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:18.8929151Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:18.8930690Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:19.0466102Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:19.0467845Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:19.1446178Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:19.1447737Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:19.4438937Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:19.4440472Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:19.5402067Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:19.5403618Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:19.6911674Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:19.6913183Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:19.7872133Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:19.7873699Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:19.9382032Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:19.9383540Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:20.0338209Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:20.0339729Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:20.1843311Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:20.1844921Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:20.2845304Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:20.2846940Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:20.4367482Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:20.4369147Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:20.5352520Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:20.5354353Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:20.8346781Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:20.8348318Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:20.9338144Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:20.9339704Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:21.0870931Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:21.0872433Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:21.1876651Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:21.1878141Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:21.3400937Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:21.4389621Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:21.4391173Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:21.4392641Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:21.5911680Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:21.5913194Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:21.6889846Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:21.6891332Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:21.8403738Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:21.8405603Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:21.9435177Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:21.9436969Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:22.1016866Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:22.1018334Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:22.2150542Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:22.2152069Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:22.5164392Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:22.5166557Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:22.6266156Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:22.6267700Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:22.7813717Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:22.7815207Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:22.8871862Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:22.8873424Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:23.0373272Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:23.0374759Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:23.1341587Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:23.1343127Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:23.2850267Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:23.2851917Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:23.3819707Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:23.3821529Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:23.5317918Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:23.5319398Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:23.6291999Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:23.6293504Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:23.9288200Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:23.9289958Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:24.0260964Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:24.0262566Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:24.1785683Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:24.1787198Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:24.2762389Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:24.2763934Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:24.4281481Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:24.4283004Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:24.5257180Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:24.5258743Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:24.6791295Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:24.6792760Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:24.7789362Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:24.7791163Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:24.9329905Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:24.9331382Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:25.0329031Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:25.0330579Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:25.3385235Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:25.3386823Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:25.4959377Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:25.4962093Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:25.6521947Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:25.6523453Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:25.8161309Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:25.8163914Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:25.9972066Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:25.9973556Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:26.1858977Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:26.1861598Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:26.3476535Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:26.3478072Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:26.5484909Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:26.5487917Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:26.7055635Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:26.7057104Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:26.9421926Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:26.9424576Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:27.2497977Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:27.2499474Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:27.4889739Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:27.4892415Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:27.6597273Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:27.6598772Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:27.8846088Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:27.8847652Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:28.0408343Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:28.0409831Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:28.2729540Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:28.2731137Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:28.4305782Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:28.4307321Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:28.6609756Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:28.6611612Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:28.8167962Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:28.8169439Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:28.9608128Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:28.9609659Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:29.2647538Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:29.2649092Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:29.3629832Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:29.3631451Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:29.5149095Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:29.5150594Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:29.6119943Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:29.6121512Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:29.7641019Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:29.7642494Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:29.8629531Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:29.8631089Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:30.0147797Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:30.0149291Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:30.1174268Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:30.1176060Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:30.4229984Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:30.4231820Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:30.4772837Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:30.4774387Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:30.6297748Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:30.6299261Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:30.6835157Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:30.6836669Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:30.8329637Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:30.8331119Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:30.9896592Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:30.9899246Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:31.1448514Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:31.1449977Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:31.3052773Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:31.3055444Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:31.4608737Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:31.4610214Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:31.6228093Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:31.6231002Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:31.7776073Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:31.7777755Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:31.8822315Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:32.1845831Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:32.1847335Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:32.1848779Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:32.2814291Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:32.2815949Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:32.4337007Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:32.4338489Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:32.5308181Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:32.5309688Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:32.6834806Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:32.6836292Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:32.7729232Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:32.7730761Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:32.9245066Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:32.9246618Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:33.0154461Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:33.0156289Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:33.1675662Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:33.1677348Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:33.2588095Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:33.2589609Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:33.5635876Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:33.5637464Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:33.6550304Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:33.6552064Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:33.8048889Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:33.8050375Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:33.9009301Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:33.9010858Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:34.0520411Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:34.0521876Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:34.1483415Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:34.1485117Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:34.2988529Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:34.2990009Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:34.3962521Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:34.3964303Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:34.5487367Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:34.5489061Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:34.6452551Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:34.6454082Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:34.9509530Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:34.9511118Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:35.0484308Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:35.0486045Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:35.2007990Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:35.2009473Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:35.3828110Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:35.3829676Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:35.5368947Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:35.5370426Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:35.8543682Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:35.8545257Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:36.0087775Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:36.0089268Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:36.2920679Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:36.2922199Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:36.4481493Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:36.4483195Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:36.7728036Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:36.7729562Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:37.0815239Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:37.0816744Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:37.3469313Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:37.3470868Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:37.5024355Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:37.5025853Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:37.6206251Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:37.6207791Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:37.7727229Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:37.7728699Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:37.8690925Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:37.8692499Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:38.0200817Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:38.0202322Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:38.1162051Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:38.1163541Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:38.2659413Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:38.2661167Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:38.3643054Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:38.3644715Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:38.6715282Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:38.6716863Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:38.7689164Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:38.7690733Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:38.9212143Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:38.9213655Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:39.0181070Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:39.0182573Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:39.1696827Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:39.1698340Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:39.2657395Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:39.2658957Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:39.4166630Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:39.4168128Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:39.5109714Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:39.5111261Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:39.6611933Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:39.6613639Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:39.7565832Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:39.7567363Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:40.0612503Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:40.0614073Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:40.1519529Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:40.1521107Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:40.3038203Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:40.3039695Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:40.3849072Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:40.3850587Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:40.5345748Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:40.5347226Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:40.6152368Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:40.6153862Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:40.7655620Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:40.7657099Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:40.8471349Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:40.8472821Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:41.1541019Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:41.1542964Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:41.2446210Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:41.2447935Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:41.3959364Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:41.3960862Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:41.4848494Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:41.4849980Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:41.6368586Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:41.6370074Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:41.7329862Z .sss/opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:41.7331422Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:41.8843677Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:41.8845342Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:41.9800935Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:41.9802472Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:42.1310130Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:42.1311657Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:42.2271382Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:42.2272893Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:42.5335474Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:42.5337229Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:42.6340504Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:42.6342480Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:42.7849958Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:42.7851434Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:42.8856444Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:42.8858042Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:43.0361979Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:43.0363639Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:43.1339771Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:43.1341341Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:43.2866815Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:43.2868319Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:43.3836894Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:43.3838451Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:43.5340830Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:43.5342331Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:43.6363523Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:43.6365179Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:43.7887736Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:43.7889398Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:43.8923461Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:43.8925384Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:44.1993260Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:44.1994760Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:44.3007549Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:44.3009109Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:44.4510374Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:44.5521540Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:44.5523299Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:44.5524970Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:44.7025759Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:44.7027236Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:44.8036560Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:44.8038106Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:44.9548419Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:44.9549953Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:45.1319470Z ../opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:45.1321007Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:45.2832442Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:45.2833910Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:45.3791346Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:45.3793138Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:45.6862442Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:45.6863954Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:45.7836009Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:45.7837578Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:45.9336677Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:45.9338168Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:46.0361772Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:46.0364517Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:46.1971153Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:46.1972624Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:46.3013989Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:46.3016643Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:46.4610909Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:46.4612388Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:46.5741698Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:46.5744364Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:46.7417372Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:46.7418831Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:46.8575459Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:46.8578471Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:47.1809873Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:47.1811334Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:47.3015003Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:47.3017668Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:47.4730699Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:47.4732186Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:47.5959280Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:47.5961940Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:47.7670852Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:47.7672339Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:47.8894456Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:47.8897095Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:48.0606228Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:48.0607713Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:48.1682575Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:48.1684144Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:48.3189309Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:48.3190770Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:48.4153882Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:48.4155683Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:48.7271176Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:48.7272740Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:48.8240729Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:48.8242298Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:48.9754862Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:48.9756394Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:49.0772735Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:49.0774312Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:49.2286971Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:49.2288451Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:49.3339789Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:49.3341346Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:49.4850940Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:49.4852415Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:49.5917716Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:49.5919226Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:49.7445576Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:49.7447069Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:49.8510964Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:49.8512679Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:50.0052012Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:50.0053520Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:50.1106838Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:50.1108372Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:50.4238292Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:50.4239805Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:50.5379377Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:50.5382020Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:50.7028089Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:50.7029573Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:50.8172051Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:50.8174688Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:50.9790975Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:50.9792458Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:51.0964885Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:51.0967646Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:51.2648532Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:51.2650001Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:51.3845360Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:51.3848303Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:51.5648476Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:51.5650213Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:51.6619981Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:51.6621462Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:51.9786596Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:51.9788167Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:52.0607287Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:52.0608825Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:52.2127788Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:52.2129275Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:52.2933062Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:52.2934572Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:52.4452821Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:52.4454282Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:52.5365269Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:52.5367008Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:52.6951936Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:52.6953405Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:52.7968320Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:52.7970095Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:52.9545637Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:52.9547318Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:53.0563681Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:53.0565591Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:53.3757731Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:53.3759311Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:53.4771101Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:53.4772864Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:53.6295689Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:53.6297162Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:53.7281501Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:53.7283031Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:53.8790519Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:53.8792046Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:53.9709845Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:53.9711410Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:54.1213276Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:54.1214790Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:54.2112226Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:54.2114054Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:54.3607299Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:54.3608944Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:54.4607614Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:54.4609202Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:54.6106218Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:54.6107703Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:54.7111985Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:54.7113530Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:55.0231655Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:55.0233203Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:55.1208086Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:55.1209652Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:55.2737870Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:55.2739358Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:55.3712928Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:55.3714425Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:55.5214901Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:55.5216391Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:55.6196453Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:55.6197994Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:55.7708756Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:55.7710374Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:55.8776405Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:55.8777934Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:56.0328443Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:56.0329932Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:56.1489476Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:56.1490994Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:56.4660665Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:56.4662177Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:56.5817239Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:56.5819835Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:56.7378591Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:56.7381335Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:56.8557757Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:56.8560496Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:57.0125512Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:57.0128294Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:57.1290730Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:57.1293305Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:57.2849559Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:57.2852546Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:57.4010511Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:57.4013322Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:57.5570134Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:57.5572829Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:57.6730428Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:57.6733102Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:57.9921018Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:57.9923845Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:58.1089328Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:58.1092118Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:58.2645100Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:58.2647837Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:58.3805305Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:58.3808034Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:58.5359298Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:58.5362076Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:58.6495332Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:58.6497920Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:58.8049564Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:58.8052460Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:58.9210766Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:58.9213536Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:59.0748835Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:59.0751566Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:59.1904733Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:59.1907402Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:59.5075559Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:59.5078413Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:59.6157607Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:59.6160242Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:59.7688772Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:59.7691464Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:16:59.8638288Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:16:59.8640971Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:00.0158883Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:00.0161637Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:00.1106136Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:00.1108859Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:00.2632648Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:00.2635586Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:00.3591531Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:00.3594341Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:00.5113435Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:00.5116177Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:00.6053221Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:00.6055924Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:00.9215099Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:00.9217803Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:01.0173007Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:01.0175739Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:01.1689868Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:01.1692615Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:01.2670328Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:01.2673020Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:01.4257530Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:01.4260302Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:01.5289706Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:01.5292500Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:01.6862085Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:01.6865003Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:01.7866111Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:01.7869275Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:01.9440709Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:01.9443343Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:02.0452655Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:02.0455377Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:02.3638224Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:02.3641105Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:02.4686495Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:02.4689151Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:02.6198448Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:02.6201072Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:02.7242872Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:02.7245582Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:02.8738320Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:02.8741037Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:02.9734513Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:02.9737186Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:03.1245504Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:03.1248450Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:03.2236315Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:03.2239233Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:03.3754245Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:03.3756936Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:03.4730876Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:03.4732430Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:03.7923787Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:03.7926579Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:03.8892652Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:03.8895447Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:04.0412392Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:04.0415087Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:04.1395809Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:04.1397345Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:04.2911849Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:04.2913364Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:04.3906257Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:04.3907795Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:04.5415797Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:04.5417479Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:04.6456999Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:04.6458779Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:04.7968729Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:04.7970221Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:04.9077347Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:05.2287643Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:05.2289200Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:05.2290665Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:05.3410737Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:05.3412345Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:05.4927758Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:05.4929249Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:05.5918666Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:05.5920220Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:05.7447486Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:05.7448966Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:05.8265938Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:05.8267454Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:05.9763796Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:05.9765661Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:06.0570625Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:06.0572316Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:06.2080230Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:06.2081723Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:06.2889000Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:06.2890498Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:06.4389278Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:06.4390821Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:06.5199501Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:06.5201020Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:06.8358472Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:06.8360042Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:06.9174750Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:06.9176234Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:07.0676926Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:07.0678429Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:07.1490158Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:07.1492811Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:07.3009973Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:07.3012679Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:07.3845666Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:07.3848779Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:07.5369466Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:07.5372285Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:07.6191711Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:07.6194412Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:07.7710475Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:07.7713199Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:07.9087418Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:07.9090332Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:08.2316459Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:08.2319213Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:08.3831143Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:08.3833957Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:08.5370888Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:08.5373658Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:08.6870081Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:08.6872798Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:08.8403874Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:08.8406690Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:09.1243985Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:09.1247155Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:09.2812189Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:09.2814894Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:09.5614762Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:09.5617503Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:09.7197138Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:09.7199826Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:10.0038364Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:10.0041191Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:10.3333490Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:10.3336333Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:10.5753098Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:10.5755828Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:10.7329221Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:10.7331883Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:10.9689772Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:10.9692586Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:11.1253385Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:11.1256147Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:11.3646046Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:11.3649029Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:11.5217261Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:11.5220500Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:11.6239762Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:11.6242480Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:11.7767710Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:11.7770407Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:11.8748766Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:11.8751537Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:12.0253554Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:12.0256244Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:12.1240790Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:12.1243513Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:12.4454902Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:12.4457451Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:12.5370155Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:12.5372935Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:12.6907243Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:12.6909938Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:12.7729995Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:12.7732972Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:12.9229915Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:12.9233010Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.0040899Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.0043603Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.1555267Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.1558013Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.2378882Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.2381657Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.3884721Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.3887469Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.4308926Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.4311643Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.7545992Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.7548910Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.7989683Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.7992406Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.9489831Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.9492492Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:13.9918627Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:13.9921599Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:14.1408229Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:14.1411153Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:14.1835085Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:14.1837781Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:14.3330250Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:14.3331731Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:14.3756200Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:14.3757692Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:14.5264725Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:14.5266425Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:14.5688519Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:14.5690032Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:14.7185771Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:14.7187238Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:14.7608170Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:14.7609661Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:15.0816565Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:15.0818054Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:15.1803926Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:15.1805659Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:15.3367145Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:15.3368817Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:15.3949325Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:15.3950923Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:15.5488874Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:15.5490364Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:15.6075160Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:15.6076669Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:15.7631463Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:15.7632935Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:15.8677150Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:15.8678657Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:16.0203058Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:16.0204635Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:16.1177587Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:16.1179094Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:16.4437986Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:16.4439551Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:16.5420744Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:16.5422278Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:16.6950748Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:16.6952380Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:16.7935643Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:16.7937233Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:16.9470597Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:16.9472080Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:17.0442418Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:17.0444007Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:17.1968858Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:17.1970335Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:17.2940775Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:17.2942358Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:17.4467203Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:17.4468673Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:17.5448404Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:17.5449958Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:17.8729479Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:17.8730997Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:17.9759141Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:17.9760641Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:18.1287968Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:18.1289669Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:18.2307722Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:18.2309241Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:18.3831219Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:18.3832716Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:18.4834796Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:18.4836365Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:18.6337576Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:18.6339113Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:18.7319649Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:18.7321147Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:18.8834476Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:18.8835939Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:18.9809067Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:18.9810619Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:19.1316377Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:19.1317887Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:19.2309741Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:19.2311280Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:19.5564252Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:19.5566382Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:19.6563456Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:19.6565166Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:19.8073097Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:19.8074559Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:19.9066372Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:19.9067905Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:20.0571206Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:20.0572704Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:20.2094449Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:20.2095964Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:20.3640717Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:20.3642214Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:20.5180128Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:20.5181657Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:20.6719023Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:20.6720531Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:20.8239606Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:20.8241161Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:21.1569592Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:21.1571367Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:21.2533994Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:21.2535810Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:21.4069552Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:21.4071034Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:21.4977736Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:21.4979243Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:21.6507374Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:21.6509012Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:21.7407734Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:21.7409266Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:21.8930955Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:21.8932451Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:21.9957191Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:21.9959847Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:22.1570427Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:22.1571917Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:22.2623116Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:22.2625747Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:22.4236252Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:22.4237942Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:22.5283395Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:22.5286314Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:22.8690417Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:22.8692019Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:22.9723575Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:22.9725368Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:23.1243746Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:23.1245535Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:23.2272573Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:23.2274109Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:23.3783993Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:23.3785494Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:23.4726345Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:23.4727849Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:23.6233292Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:23.6234761Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:24.1186745Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:24.1188324Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:24.2786509Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:24.2788176Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:24.7839445Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:24.7841146Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:24.9448403Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:24.9449927Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:25.4567441Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:25.4568977Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:25.7952010Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:25.7953555Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:25.8969193Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:25.8970739Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.0498354Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.0499845Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.1406427Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.1407968Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.2917178Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.2918666Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.3807354Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.3808911Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.5318313Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.5319785Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.5814936Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.5816645Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.7317778Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.7319253Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.7815987Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.9344595Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.9346078Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.9347550Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:26.9843235Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:26.9844889Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:27.3137237Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:27.3138762Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:27.4044899Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:27.4046413Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:27.5556510Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:27.5558038Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:27.6448540Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:27.6450120Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:27.7959364Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:27.7960838Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:27.8846393Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:27.8848215Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:28.0361245Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:28.0362771Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:28.1253782Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:28.1255322Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:28.2792482Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:28.2794127Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:28.5376946Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:28.5378495Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:28.6911892Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:28.6913389Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:28.7742181Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:28.7743706Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:28.9264955Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:28.9266633Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:29.0596116Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:29.0597694Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:29.2729559Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:29.2731042Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:29.4057908Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:29.4059683Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:29.5750305Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:29.5751829Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:29.6924708Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:29.6926207Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:30.0276378Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:30.0277955Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:30.1354957Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:30.1356500Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:30.2879318Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:30.2880798Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:30.3971518Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:30.3973044Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:30.5489986Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:30.5491460Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:30.6624953Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:30.6626537Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:30.8141108Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:30.8142582Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:30.9126886Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:30.9128659Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:31.0659622Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:31.0661254Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:31.1486226Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:31.1487710Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:31.2998951Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:31.3000450Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:31.3815070Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:31.3816595Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:31.7128104Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:31.7129616Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:31.7960628Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:31.7962176Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:31.9470147Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:31.9471623Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:32.0297785Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:32.0299336Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:32.1805988Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:32.1807458Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:32.2629865Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:32.2631565Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:32.4126112Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:32.4128012Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:32.5042697Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:32.5044246Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:32.6585544Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:32.6587041Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:32.7590881Z ./opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:32.7592538Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:33.0965867Z /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:17:33.0967393Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:17:33.1416315Z . 2025-03-14T06:17:33.1416737Z ---------------------------------------------------------------------- 2025-03-14T06:17:33.1417218Z Ran 491 tests in 140.842s 2025-03-14T06:17:33.1417403Z 2025-03-14T06:17:33.1417523Z OK (skipped=4) 2025-03-14T06:17:34.1047169Z + run_test /var/lib/jenkins/workspace/xla/test/test_pallas.py 2025-03-14T06:17:34.1047818Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_pallas.py' 2025-03-14T06:17:34.1048467Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/test_pallas.py 2025-03-14T06:17:34.1048964Z ++ command -v nvidia-smi 2025-03-14T06:17:34.1049268Z + '[' -x '' ']' 2025-03-14T06:17:34.1049518Z + PJRT_DEVICE=CPU 2025-03-14T06:17:34.1049770Z + CPU_NUM_DEVICES=1 2025-03-14T06:17:34.1050142Z + run_coverage /var/lib/jenkins/workspace/xla/test/test_pallas.py 2025-03-14T06:17:34.1050632Z + '[' 0 '!=' 0 ']' 2025-03-14T06:17:34.1050981Z + python3 /var/lib/jenkins/workspace/xla/test/test_pallas.py 2025-03-14T06:17:37.2586312Z ssssssssssssssssssssssssssss 2025-03-14T06:17:37.2586788Z ---------------------------------------------------------------------- 2025-03-14T06:17:37.2587227Z Ran 28 tests in 0.000s 2025-03-14T06:17:37.2587412Z 2025-03-14T06:17:37.2587511Z OK (skipped=28) 2025-03-14T06:17:37.8466807Z ++ command -v nvidia-smi 2025-03-14T06:17:37.8467167Z + '[' -x '' ']' 2025-03-14T06:17:37.8467413Z + [[ '' != \1 ]] 2025-03-14T06:17:37.8467696Z + run_torch_op_tests 2025-03-14T06:17:37.8468221Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:37.8469130Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py' -v TestViewOpsXLA 2025-03-14T06:17:37.8470162Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:37.8471096Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T06:17:37.8471788Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:37.8472760Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py' -v TestViewOpsXLA 2025-03-14T06:17:37.8473745Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:37.8474361Z ++ command -v nvidia-smi 2025-03-14T06:17:37.8474698Z + '[' -x '' ']' 2025-03-14T06:17:37.8474945Z + PJRT_DEVICE=CPU 2025-03-14T06:17:37.8475200Z + CPU_NUM_DEVICES=1 2025-03-14T06:17:37.8475710Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:37.8476268Z + '[' 0 '!=' 0 ']' 2025-03-14T06:17:37.8476743Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:41.5064786Z 2025-03-14T06:17:41.5065510Z Running tests... 2025-03-14T06:17:41.5065948Z ---------------------------------------------------------------------- 2025-03-14T06:17:41.5066566Z Test results will be stored in test-reports/python-unittest/test.......test.test_view_ops 2025-03-14T06:17:41.6000832Z test_T_view_xla (__main__.TestViewOpsXLA) ... ok (0.093s) 2025-03-14T06:17:41.6608329Z test_advanced_indexing_assignment_xla (__main__.TestViewOpsXLA) ... ok (0.061s) 2025-03-14T06:17:41.7522792Z test_advanced_indexing_nonview_xla (__main__.TestViewOpsXLA) ... ok (0.091s) 2025-03-14T06:17:41.7542595Z test_as_strided_gradients_xla (__main__.TestViewOpsXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py:746: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2025-03-14T06:17:41.7544582Z assert max_offset < len(y.storage()), "test case resizes storage" 2025-03-14T06:17:41.9072999Z ok (0.155s) 2025-03-14T06:17:41.9886055Z test_as_strided_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.081s) 2025-03-14T06:17:42.0683008Z test_as_strided_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2025-03-14T06:17:42.1563388Z test_basic_indexing_ellipses_view_xla (__main__.TestViewOpsXLA) ... ok (0.088s) 2025-03-14T06:17:42.2446374Z test_basic_indexing_newaxis_view_xla (__main__.TestViewOpsXLA) ... ok (0.088s) 2025-03-14T06:17:42.3327876Z test_basic_indexing_slice_view_xla (__main__.TestViewOpsXLA) ... ok (0.088s) 2025-03-14T06:17:42.3330913Z test_chunk_view_xla (__main__.TestViewOpsXLA) ... skip: See https://github.com/pytorch/pytorch/pull/32720 (0.000s) 2025-03-14T06:17:42.3341610Z test_conj_imag_view_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:42.3351537Z test_conj_imag_view_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:42.3360045Z test_conj_self_xla_bfloat16 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.3368407Z test_conj_self_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:42.3376494Z test_conj_self_xla_float32 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.3384819Z test_conj_self_xla_float64 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.3393077Z test_conj_self_xla_int16 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.3401358Z test_conj_self_xla_int32 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.3409812Z test_conj_self_xla_int64 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.3417988Z test_conj_self_xla_int8 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.3426230Z test_conj_self_xla_uint8 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.3435429Z test_conj_view_with_shared_memory_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:42.3443320Z test_contiguous_nonview_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:42.3451263Z test_contiguous_self_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:42.5523670Z test_diagonal_view_xla (__main__.TestViewOpsXLA) ... ok (0.206s) 2025-03-14T06:17:42.5529234Z test_expand_as_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:42.5537434Z test_expand_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:42.5548573Z test_flatten_nonview_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:42.5564999Z test_flatten_view_xla (__main__.TestViewOpsXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:17:42.5573115Z test_imag_noncomplex_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:42.5581287Z test_imag_noncomplex_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:42.5589577Z test_imag_noncomplex_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:42.5597851Z test_imag_noncomplex_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:42.5606288Z test_imag_noncomplex_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:42.5614620Z test_imag_noncomplex_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:42.5622718Z test_imag_noncomplex_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:42.5630907Z test_imag_noncomplex_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:42.5639143Z test_imag_noncomplex_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:43.4928265Z test_movedim_view_xla (__main__.TestViewOpsXLA) ... ok (0.928s) 2025-03-14T06:17:43.5807036Z test_narrow_view_xla (__main__.TestViewOpsXLA) ... ok (0.088s) 2025-03-14T06:17:43.5827442Z test_permute_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2025-03-14T06:17:43.5836156Z test_real_imag_view_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.5848773Z test_real_imag_view_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.6647506Z test_reshape_as_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2025-03-14T06:17:43.6654492Z test_reshape_nonview_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:43.6670781Z test_reshape_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2025-03-14T06:17:43.7086431Z test_select_view_xla (__main__.TestViewOpsXLA) ... ok (0.041s) 2025-03-14T06:17:43.7092805Z test_set_real_imag_xla_complex128_bfloat16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7103647Z test_set_real_imag_xla_complex128_bool (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7114469Z test_set_real_imag_xla_complex128_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7125238Z test_set_real_imag_xla_complex128_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7135972Z test_set_real_imag_xla_complex128_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7146635Z test_set_real_imag_xla_complex128_float32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7157267Z test_set_real_imag_xla_complex128_float64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7168361Z test_set_real_imag_xla_complex128_int16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7179079Z test_set_real_imag_xla_complex128_int32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7189661Z test_set_real_imag_xla_complex128_int64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7200333Z test_set_real_imag_xla_complex128_int8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7211238Z test_set_real_imag_xla_complex128_uint8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:43.7221896Z test_set_real_imag_xla_complex64_bfloat16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7232597Z test_set_real_imag_xla_complex64_bool (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7243358Z test_set_real_imag_xla_complex64_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7254234Z test_set_real_imag_xla_complex64_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7264875Z test_set_real_imag_xla_complex64_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7275809Z test_set_real_imag_xla_complex64_float32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7286643Z test_set_real_imag_xla_complex64_float64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7297290Z test_set_real_imag_xla_complex64_int16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7307999Z test_set_real_imag_xla_complex64_int32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7318757Z test_set_real_imag_xla_complex64_int64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7329580Z test_set_real_imag_xla_complex64_int8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7340333Z test_set_real_imag_xla_complex64_uint8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:43.7344931Z test_split_view_xla (__main__.TestViewOpsXLA) ... skip: See https://github.com/pytorch/pytorch/pull/32720 (0.000s) 2025-03-14T06:17:43.7757137Z test_squeeze_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.041s) 2025-03-14T06:17:43.8163612Z test_squeeze_view_xla (__main__.TestViewOpsXLA) ... ok (0.041s) 2025-03-14T06:17:43.8962808Z test_t_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2025-03-14T06:17:43.8973487Z test_t_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2025-03-14T06:17:43.9008443Z test_transpose_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.003s) 2025-03-14T06:17:43.9040157Z test_transpose_view_xla (__main__.TestViewOpsXLA) ... ok (0.003s) 2025-03-14T06:17:44.1439544Z test_unbind_view_xla (__main__.TestViewOpsXLA) ... ok (0.240s) 2025-03-14T06:17:44.1511042Z test_unbind_xla (__main__.TestViewOpsXLA) ... ok (0.007s) 2025-03-14T06:17:44.1515155Z test_unfold_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:44.2328214Z test_unsqueeze_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.081s) 2025-03-14T06:17:44.3134023Z test_unsqueeze_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2025-03-14T06:17:44.3151171Z test_view_as_complex_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:44.3163813Z test_view_as_real_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:44.3176768Z test_view_as_real_xla_complex32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex32 (0.001s) 2025-03-14T06:17:44.3188992Z test_view_as_real_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:44.3205237Z test_view_as_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2025-03-14T06:17:44.6086606Z test_view_copy_out_xla (__main__.TestViewOpsXLA) ... ok (0.287s) 2025-03-14T06:17:44.6107634Z test_view_copy_output_contiguous_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2025-03-14T06:17:44.7526868Z test_view_copy_xla (__main__.TestViewOpsXLA) ... ok (0.142s) 2025-03-14T06:17:44.7553846Z test_view_dtype_new_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:44.7583207Z test_view_dtype_new_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.003s) 2025-03-14T06:17:44.7610922Z test_view_dtype_new_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.003s) 2025-03-14T06:17:44.7640244Z test_view_dtype_new_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.003s) 2025-03-14T06:17:44.7668001Z test_view_dtype_new_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:44.7696310Z test_view_dtype_new_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:44.7724882Z test_view_dtype_new_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:44.7752987Z test_view_dtype_new_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:44.7781404Z test_view_dtype_new_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:44.7808845Z test_view_dtype_new_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:44.7837789Z test_view_dtype_new_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:44.7849538Z test_view_dtype_upsize_errors_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7861766Z test_view_dtype_upsize_errors_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7874396Z test_view_dtype_upsize_errors_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:44.7886758Z test_view_dtype_upsize_errors_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:44.7898829Z test_view_dtype_upsize_errors_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:44.7911104Z test_view_dtype_upsize_errors_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7923338Z test_view_dtype_upsize_errors_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7935751Z test_view_dtype_upsize_errors_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7948027Z test_view_dtype_upsize_errors_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7960238Z test_view_dtype_upsize_errors_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7973158Z test_view_dtype_upsize_errors_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7985536Z test_view_dtype_upsize_errors_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.7994612Z test_view_tensor_dsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8003673Z test_view_tensor_dsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8012885Z test_view_tensor_dsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:44.8021874Z test_view_tensor_dsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:44.8030838Z test_view_tensor_dsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:44.8039948Z test_view_tensor_dsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8049216Z test_view_tensor_dsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8058173Z test_view_tensor_dsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8067486Z test_view_tensor_dsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8076566Z test_view_tensor_dsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8085867Z test_view_tensor_dsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8094855Z test_view_tensor_dsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8103939Z test_view_tensor_hsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8112976Z test_view_tensor_hsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8121953Z test_view_tensor_hsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:44.8131047Z test_view_tensor_hsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:44.8140114Z test_view_tensor_hsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:44.8149187Z test_view_tensor_hsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8158233Z test_view_tensor_hsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8167849Z test_view_tensor_hsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8176962Z test_view_tensor_hsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8186009Z test_view_tensor_hsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8195039Z test_view_tensor_hsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8204123Z test_view_tensor_hsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8213857Z test_view_tensor_split_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8223430Z test_view_tensor_split_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8232888Z test_view_tensor_split_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:44.8242320Z test_view_tensor_split_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:44.8251957Z test_view_tensor_split_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:44.8261568Z test_view_tensor_split_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8271503Z test_view_tensor_split_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8281057Z test_view_tensor_split_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8290868Z test_view_tensor_split_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8300500Z test_view_tensor_split_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8309980Z test_view_tensor_split_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8319534Z test_view_tensor_split_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8328844Z test_view_tensor_vsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8337941Z test_view_tensor_vsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8346986Z test_view_tensor_vsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:44.8355994Z test_view_tensor_vsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:44.8365014Z test_view_tensor_vsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:44.8374362Z test_view_tensor_vsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8383431Z test_view_tensor_vsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8392410Z test_view_tensor_vsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8401463Z test_view_tensor_vsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8410673Z test_view_tensor_vsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8419694Z test_view_tensor_vsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8428689Z test_view_tensor_vsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:44.8446655Z test_view_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2025-03-14T06:17:44.8447032Z 2025-03-14T06:17:44.8447357Z ---------------------------------------------------------------------- 2025-03-14T06:17:44.8447757Z Ran 163 tests in 3.339s 2025-03-14T06:17:44.8447928Z 2025-03-14T06:17:44.8448037Z OK (skipped=123) 2025-03-14T06:17:44.8448190Z 2025-03-14T06:17:44.8448315Z Generating XML reports... 2025-03-14T06:17:44.8576086Z Generated XML report: test-reports/python-unittest/test.......test.test_view_ops/TEST-TestViewOpsXLA-20250314061741.xml 2025-03-14T06:17:45.6270936Z + run_test_without_functionalization /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:45.6272153Z + echo 'Running with XLA_DISABLE_FUNCTIONALIZATION: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py' -v TestViewOpsXLA 2025-03-14T06:17:45.6273256Z Running with XLA_DISABLE_FUNCTIONALIZATION: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:45.6273976Z + XLA_DISABLE_FUNCTIONALIZATION=1 2025-03-14T06:17:45.6274517Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:45.6275385Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py' -v TestViewOpsXLA 2025-03-14T06:17:45.6276297Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:45.6276919Z ++ command -v nvidia-smi 2025-03-14T06:17:45.6277211Z + '[' -x '' ']' 2025-03-14T06:17:45.6277448Z + PJRT_DEVICE=CPU 2025-03-14T06:17:45.6277706Z + CPU_NUM_DEVICES=1 2025-03-14T06:17:45.6278216Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:45.6278779Z + '[' 0 '!=' 0 ']' 2025-03-14T06:17:45.6279339Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py -v TestViewOpsXLA 2025-03-14T06:17:49.2810411Z 2025-03-14T06:17:49.2810865Z Running tests... 2025-03-14T06:17:49.2811288Z ---------------------------------------------------------------------- 2025-03-14T06:17:49.2811947Z Test results will be stored in test-reports/python-unittest/test.......test.test_view_ops 2025-03-14T06:17:49.4497142Z test_T_view_xla (__main__.TestViewOpsXLA) ... ok (0.168s) 2025-03-14T06:17:49.5095146Z test_advanced_indexing_assignment_xla (__main__.TestViewOpsXLA) ... ok (0.060s) 2025-03-14T06:17:49.5987390Z test_advanced_indexing_nonview_xla (__main__.TestViewOpsXLA) ... ok (0.089s) 2025-03-14T06:17:49.6006775Z test_as_strided_gradients_xla (__main__.TestViewOpsXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_view_ops.py:746: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2025-03-14T06:17:49.6008736Z assert max_offset < len(y.storage()), "test case resizes storage" 2025-03-14T06:17:49.7305241Z ok (0.132s) 2025-03-14T06:17:49.8104827Z test_as_strided_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.080s) 2025-03-14T06:17:49.8884505Z test_as_strided_view_xla (__main__.TestViewOpsXLA) ... ok (0.078s) 2025-03-14T06:17:49.9754111Z test_basic_indexing_ellipses_view_xla (__main__.TestViewOpsXLA) ... ok (0.087s) 2025-03-14T06:17:50.0609161Z test_basic_indexing_newaxis_view_xla (__main__.TestViewOpsXLA) ... ok (0.086s) 2025-03-14T06:17:50.1474915Z test_basic_indexing_slice_view_xla (__main__.TestViewOpsXLA) ... ok (0.086s) 2025-03-14T06:17:50.1475762Z test_chunk_view_xla (__main__.TestViewOpsXLA) ... skip: See https://github.com/pytorch/pytorch/pull/32720 (0.000s) 2025-03-14T06:17:50.1486082Z test_conj_imag_view_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:50.1495702Z test_conj_imag_view_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:50.1503397Z test_conj_self_xla_bfloat16 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.1511028Z test_conj_self_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:50.1518618Z test_conj_self_xla_float32 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.1526663Z test_conj_self_xla_float64 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.1534412Z test_conj_self_xla_int16 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.1542242Z test_conj_self_xla_int32 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.1549980Z test_conj_self_xla_int64 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.1557739Z test_conj_self_xla_int8 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.1565874Z test_conj_self_xla_uint8 (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.1574879Z test_conj_view_with_shared_memory_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:50.1582741Z test_contiguous_nonview_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:50.1589871Z test_contiguous_self_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:50.3633130Z test_diagonal_view_xla (__main__.TestViewOpsXLA) ... ok (0.204s) 2025-03-14T06:17:50.3638081Z test_expand_as_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:50.3646442Z test_expand_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:50.3657347Z test_flatten_nonview_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:50.3673044Z test_flatten_view_xla (__main__.TestViewOpsXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:17:50.3681241Z test_imag_noncomplex_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:50.3689422Z test_imag_noncomplex_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:50.3697541Z test_imag_noncomplex_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:50.3705582Z test_imag_noncomplex_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:50.3713662Z test_imag_noncomplex_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:50.3721748Z test_imag_noncomplex_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:50.3730027Z test_imag_noncomplex_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:50.3738086Z test_imag_noncomplex_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:50.3746112Z test_imag_noncomplex_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypesAnd mps : doesn't run on xla (0.001s) 2025-03-14T06:17:51.2899666Z test_movedim_view_xla (__main__.TestViewOpsXLA) ... ok (0.915s) 2025-03-14T06:17:51.3755298Z test_narrow_view_xla (__main__.TestViewOpsXLA) ... ok (0.086s) 2025-03-14T06:17:51.3768138Z test_permute_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2025-03-14T06:17:51.3782632Z test_real_imag_view_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.3794050Z test_real_imag_view_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.4576974Z test_reshape_as_view_xla (__main__.TestViewOpsXLA) ... ok (0.078s) 2025-03-14T06:17:51.4584880Z test_reshape_nonview_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:51.4599638Z test_reshape_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:51.5006426Z test_select_view_xla (__main__.TestViewOpsXLA) ... ok (0.040s) 2025-03-14T06:17:51.5014057Z test_set_real_imag_xla_complex128_bfloat16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5024802Z test_set_real_imag_xla_complex128_bool (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5035450Z test_set_real_imag_xla_complex128_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5046241Z test_set_real_imag_xla_complex128_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5056766Z test_set_real_imag_xla_complex128_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5067566Z test_set_real_imag_xla_complex128_float32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5078102Z test_set_real_imag_xla_complex128_float64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5088842Z test_set_real_imag_xla_complex128_int16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5099406Z test_set_real_imag_xla_complex128_int32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5109999Z test_set_real_imag_xla_complex128_int64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5120502Z test_set_real_imag_xla_complex128_int8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5131220Z test_set_real_imag_xla_complex128_uint8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:51.5141804Z test_set_real_imag_xla_complex64_bfloat16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5152301Z test_set_real_imag_xla_complex64_bool (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5162920Z test_set_real_imag_xla_complex64_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5174014Z test_set_real_imag_xla_complex64_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5184580Z test_set_real_imag_xla_complex64_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5195152Z test_set_real_imag_xla_complex64_float32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5205964Z test_set_real_imag_xla_complex64_float64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5216497Z test_set_real_imag_xla_complex64_int16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5226999Z test_set_real_imag_xla_complex64_int32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5237604Z test_set_real_imag_xla_complex64_int64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5248398Z test_set_real_imag_xla_complex64_int8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5259036Z test_set_real_imag_xla_complex64_uint8 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:51.5263609Z test_split_view_xla (__main__.TestViewOpsXLA) ... skip: See https://github.com/pytorch/pytorch/pull/32720 (0.000s) 2025-03-14T06:17:51.5665928Z test_squeeze_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.040s) 2025-03-14T06:17:51.6062254Z test_squeeze_view_xla (__main__.TestViewOpsXLA) ... ok (0.040s) 2025-03-14T06:17:51.6846432Z test_t_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.078s) 2025-03-14T06:17:51.6856925Z test_t_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:51.6887198Z test_transpose_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.003s) 2025-03-14T06:17:51.6913955Z test_transpose_view_xla (__main__.TestViewOpsXLA) ... ok (0.002s) 2025-03-14T06:17:51.9264072Z test_unbind_view_xla (__main__.TestViewOpsXLA) ... ok (0.235s) 2025-03-14T06:17:51.9330529Z test_unbind_xla (__main__.TestViewOpsXLA) ... ok (0.007s) 2025-03-14T06:17:51.9338531Z test_unfold_view_xla (__main__.TestViewOpsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:52.0132079Z test_unsqueeze_inplace_view_xla (__main__.TestViewOpsXLA) ... ok (0.079s) 2025-03-14T06:17:52.0919447Z test_unsqueeze_view_xla (__main__.TestViewOpsXLA) ... ok (0.078s) 2025-03-14T06:17:52.0932337Z test_view_as_complex_xla (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:52.0944807Z test_view_as_real_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:52.0956948Z test_view_as_real_xla_complex32 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex32 (0.001s) 2025-03-14T06:17:52.0969635Z test_view_as_real_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:52.0984775Z test_view_as_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:52.3787373Z test_view_copy_out_xla (__main__.TestViewOpsXLA) ... ok (0.280s) 2025-03-14T06:17:52.3801162Z test_view_copy_output_contiguous_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:52.5173454Z test_view_copy_xla (__main__.TestViewOpsXLA) ... ok (0.137s) 2025-03-14T06:17:52.5203284Z test_view_dtype_new_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:52.5231307Z test_view_dtype_new_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.003s) 2025-03-14T06:17:52.5259311Z test_view_dtype_new_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.003s) 2025-03-14T06:17:52.5287060Z test_view_dtype_new_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.003s) 2025-03-14T06:17:52.5315015Z test_view_dtype_new_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:52.5343394Z test_view_dtype_new_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:52.5370927Z test_view_dtype_new_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:52.5398927Z test_view_dtype_new_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:52.5427071Z test_view_dtype_new_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:52.5454999Z test_view_dtype_new_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:52.5483834Z test_view_dtype_new_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:17:52.5495366Z test_view_dtype_upsize_errors_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5507572Z test_view_dtype_upsize_errors_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5519785Z test_view_dtype_upsize_errors_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:52.5532084Z test_view_dtype_upsize_errors_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:52.5544383Z test_view_dtype_upsize_errors_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:52.5556752Z test_view_dtype_upsize_errors_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5569332Z test_view_dtype_upsize_errors_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5581599Z test_view_dtype_upsize_errors_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5593826Z test_view_dtype_upsize_errors_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5606262Z test_view_dtype_upsize_errors_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5618549Z test_view_dtype_upsize_errors_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5630699Z test_view_dtype_upsize_errors_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5639741Z test_view_tensor_dsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5649092Z test_view_tensor_dsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5657994Z test_view_tensor_dsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:52.5667213Z test_view_tensor_dsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:52.5676091Z test_view_tensor_dsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:52.5685268Z test_view_tensor_dsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5694438Z test_view_tensor_dsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5703587Z test_view_tensor_dsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5712533Z test_view_tensor_dsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5721481Z test_view_tensor_dsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5730756Z test_view_tensor_dsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5739789Z test_view_tensor_dsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5748813Z test_view_tensor_hsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5757828Z test_view_tensor_hsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5767189Z test_view_tensor_hsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:52.5776107Z test_view_tensor_hsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:52.5785025Z test_view_tensor_hsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:52.5794083Z test_view_tensor_hsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5803077Z test_view_tensor_hsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5812355Z test_view_tensor_hsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5821294Z test_view_tensor_hsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5830320Z test_view_tensor_hsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5839312Z test_view_tensor_hsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5848510Z test_view_tensor_hsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5858014Z test_view_tensor_split_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5867835Z test_view_tensor_split_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5877392Z test_view_tensor_split_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:52.5887033Z test_view_tensor_split_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:52.5896434Z test_view_tensor_split_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:52.5905904Z test_view_tensor_split_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5915440Z test_view_tensor_split_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5925068Z test_view_tensor_split_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5934645Z test_view_tensor_split_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5944173Z test_view_tensor_split_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5953689Z test_view_tensor_split_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5963240Z test_view_tensor_split_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5972735Z test_view_tensor_vsplit_xla_bfloat16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5981768Z test_view_tensor_vsplit_xla_bool (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.5990732Z test_view_tensor_vsplit_xla_complex128 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:17:52.5999667Z test_view_tensor_vsplit_xla_complex64 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:17:52.6008759Z test_view_tensor_vsplit_xla_float16 (__main__.TestViewOpsXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:52.6017765Z test_view_tensor_vsplit_xla_float32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.6026793Z test_view_tensor_vsplit_xla_float64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.6035845Z test_view_tensor_vsplit_xla_int16 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.6044942Z test_view_tensor_vsplit_xla_int32 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.6054006Z test_view_tensor_vsplit_xla_int64 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.6063049Z test_view_tensor_vsplit_xla_int8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.6072272Z test_view_tensor_vsplit_xla_uint8 (__main__.TestViewOpsXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:17:52.6087316Z test_view_view_xla (__main__.TestViewOpsXLA) ... ok (0.001s) 2025-03-14T06:17:52.6087756Z 2025-03-14T06:17:52.6087925Z ---------------------------------------------------------------------- 2025-03-14T06:17:52.6088333Z Ran 163 tests in 3.328s 2025-03-14T06:17:52.6088521Z 2025-03-14T06:17:52.6088621Z OK (skipped=123) 2025-03-14T06:17:52.6088787Z 2025-03-14T06:17:52.6088900Z Generating XML reports... 2025-03-14T06:17:52.6216308Z Generated XML report: test-reports/python-unittest/test.......test.test_view_ops/TEST-TestViewOpsXLA-20250314061749.xml 2025-03-14T06:17:53.3906789Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTorchDeviceTypeXLA 2025-03-14T06:17:53.3907813Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py' -v TestTorchDeviceTypeXLA 2025-03-14T06:17:53.3908990Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTorchDeviceTypeXLA 2025-03-14T06:17:53.3909732Z ++ command -v nvidia-smi 2025-03-14T06:17:53.3909997Z + '[' -x '' ']' 2025-03-14T06:17:53.3910248Z + PJRT_DEVICE=CPU 2025-03-14T06:17:53.3910502Z + CPU_NUM_DEVICES=1 2025-03-14T06:17:53.3911033Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTorchDeviceTypeXLA 2025-03-14T06:17:53.3911622Z + '[' 0 '!=' 0 ']' 2025-03-14T06:17:53.3912119Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTorchDeviceTypeXLA 2025-03-14T06:17:58.1268188Z 2025-03-14T06:17:58.1268632Z Running tests... 2025-03-14T06:17:58.1269079Z ---------------------------------------------------------------------- 2025-03-14T06:17:58.1269698Z Test results will be stored in test-reports/python-unittest/test.......test.test_torch 2025-03-14T06:17:58.1884981Z test__local_scalar_dense_with_empty_tensor_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.061s) 2025-03-14T06:17:58.1900498Z test_addcdiv_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:17:58.1920775Z test_addcdiv_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:17:58.1939986Z test_addcdiv_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:58.1959346Z test_addcdiv_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:58.1978797Z test_addcdiv_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:58.1997933Z test_addcdiv_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:58.2016056Z test_addcdiv_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:58.2036381Z test_addcdiv_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:58.2054601Z test_addcdiv_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:17:58.2064589Z test_addcmul_cuda_errors_with_cpu_scalars_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:17:58.2084565Z test_addcmul_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:17:58.2092535Z test_assertRaisesRegex_ignore_msg_non_native_device_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:58.2102426Z test_bernoulli_edge_cases_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:17:58.5767220Z test_bernoulli_edge_cases_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.366s) 2025-03-14T06:17:58.9816777Z test_bernoulli_edge_cases_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.405s) 2025-03-14T06:17:58.9828339Z test_bernoulli_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:17:59.5271694Z test_bernoulli_p_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.544s) 2025-03-14T06:17:59.9891114Z test_bernoulli_p_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.462s) 2025-03-14T06:18:00.6990211Z test_bernoulli_self_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.709s) 2025-03-14T06:18:00.9993743Z test_bernoulli_self_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.300s) 2025-03-14T06:18:01.0006349Z test_bfloat16_neg_abs_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:01.0473683Z test_bool_tensor_value_change_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.047s) 2025-03-14T06:18:01.0510627Z test_broadcast_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.004s) 2025-03-14T06:18:01.0522199Z test_bytes_to_scalar_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0533612Z test_bytes_to_scalar_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:01.0544715Z test_bytes_to_scalar_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:01.0555953Z test_bytes_to_scalar_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0567788Z test_bytes_to_scalar_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0578917Z test_bytes_to_scalar_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0590171Z test_bytes_to_scalar_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0601456Z test_bytes_to_scalar_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0612905Z test_bytes_to_scalar_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0624200Z test_bytes_to_scalar_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0635507Z test_bytes_to_scalar_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0646890Z test_bytes_to_scalar_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0658089Z test_bytes_to_scalar_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:01.0666985Z test_cauchy_kstest_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:01.0675560Z test_cauchy_no_inf_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:01.0684144Z test_cauchy_no_inf_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:01.1589608Z test_cauchy_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.090s) 2025-03-14T06:18:01.1595357Z test_cauchy_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:01.2454285Z test_cauchy_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.086s) 2025-03-14T06:18:01.3316928Z test_cauchy_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.086s) 2025-03-14T06:18:01.3327948Z test_cdist_cuda_backward_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:18:01.6524034Z test_cdist_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.319s) 2025-03-14T06:18:01.6567553Z test_cdist_euclidean_large_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.005s) 2025-03-14T06:18:02.5252143Z test_cdist_grad_p_lt_1_no_nan_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.868s) 2025-03-14T06:18:02.5263648Z test_cdist_large_batch_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:02.5274053Z test_cdist_large_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:02.5289375Z test_cdist_non_contiguous_batch_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:02.5303995Z test_cdist_non_contiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:02.5316237Z test_cdist_norm_batch_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:02.5328416Z test_cdist_norm_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:03.5434031Z test_cdist_same_inputs_xla (__main__.TestTorchDeviceTypeXLA) ... ok (1.010s) 2025-03-14T06:18:04.8551718Z test_check_tensor_all_xla (__main__.TestTorchDeviceTypeXLA) ... ok (1.312s) 2025-03-14T06:18:04.8650418Z test_check_tensor_internal_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.010s) 2025-03-14T06:18:04.8659487Z test_clone_all_dtypes_and_devices_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:04.8668781Z test_clone_not_memory_dense_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:04.8680373Z test_clone_zero_stride_dim_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:04.8694527Z test_complex_half_experimental_warning_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:04.8704297Z test_constants_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:04.8796051Z test_conv_transposed_backward_agnostic_to_memory_format_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.009s) 2025-03-14T06:18:04.8804720Z test_conv_transposed_large_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:04.8818464Z test_copy__xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:04.8827273Z test_copy_all_dtypes_and_devices_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:04.8842618Z test_copy_math_view_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:04.8851422Z test_copy_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:04.8863381Z test_copy_transpose_math_view_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:04.8875412Z test_copy_transpose_math_view_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:04.8887602Z test_copy_transpose_math_view_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:04.8895992Z test_corrcoef_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:04.8904504Z test_corrcoef_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:04.8912990Z test_corrcoef_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:04.8921590Z test_cov_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:04.9365731Z test_cpp_warnings_have_python_context_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.044s) 2025-03-14T06:18:04.9380672Z test_cublas_config_nondeterministic_alert_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:04.9404098Z test_cummax_cummin_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:04.9414781Z test_cummax_discontiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:04.9425206Z test_cummin_discontiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.1295637Z test_cumprod_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.187s) 2025-03-14T06:18:05.1308250Z test_cumsum_64bit_indexing_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:05.1326547Z test_cumsum_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:05.1335606Z test_deepcopy_scalar_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:05.1348215Z test_deepcopy_scalar_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:05.1364195Z test_deepcopy_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.1379185Z test_deterministic_cumsum_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:05.1393478Z test_deterministic_empty_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1407839Z test_deterministic_empty_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1421986Z test_deterministic_empty_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:05.1436028Z test_deterministic_empty_xla_complex32 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex32 (0.001s) 2025-03-14T06:18:05.1450267Z test_deterministic_empty_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:05.1464310Z test_deterministic_empty_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:05.1478637Z test_deterministic_empty_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1492925Z test_deterministic_empty_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1507023Z test_deterministic_empty_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1521149Z test_deterministic_empty_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1535521Z test_deterministic_empty_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1549640Z test_deterministic_empty_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1563775Z test_deterministic_empty_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1578329Z test_deterministic_empty_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1592544Z test_deterministic_empty_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.1606845Z test_deterministic_empty_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:05.2368886Z test_deterministic_interpolate_bilinear_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.076s) 2025-03-14T06:18:05.2424411Z test_deterministic_replication_pad2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.005s) 2025-03-14T06:18:05.2446748Z test_deterministic_resize_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2468194Z test_deterministic_resize_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2489519Z test_deterministic_resize_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:18:05.2510440Z test_deterministic_resize_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:18:05.2531628Z test_deterministic_resize_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:18:05.2552695Z test_deterministic_resize_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2574239Z test_deterministic_resize_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2595505Z test_deterministic_resize_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2616564Z test_deterministic_resize_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2637790Z test_deterministic_resize_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2659065Z test_deterministic_resize_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2680470Z test_deterministic_resize_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2701707Z test_deterministic_resize_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2722756Z test_deterministic_resize_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2744094Z test_deterministic_resize_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:05.2767808Z test_device_guard_xla (__main__.TestTorchDeviceTypeXLA) ... skip: fewer than 2 devices detected (0.002s) 2025-03-14T06:18:05.2778856Z test_diff_noncontig_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:05.2789659Z test_diff_noncontig_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:05.2800652Z test_diff_noncontig_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:05.2811489Z test_diff_noncontig_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:05.2822330Z test_diff_noncontig_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:05.2833115Z test_diff_noncontig_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:05.2843898Z test_diff_noncontig_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:05.2854868Z test_diff_noncontig_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:05.2865792Z test_diff_noncontig_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:05.2876686Z test_diff_noncontig_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:05.2887778Z test_diff_noncontig_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:05.2900591Z test_diff_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.2913975Z test_diff_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:05.2927291Z test_diff_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:05.2940170Z test_diff_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.2953310Z test_diff_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.2966782Z test_diff_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.2979857Z test_diff_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.2992951Z test_diff_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.3006185Z test_diff_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.3019287Z test_diff_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.3086635Z test_dim_function_empty_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.007s) 2025-03-14T06:18:05.3095783Z test_discontiguous_out_cumsum_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.3105637Z test_dist_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:05.3114018Z test_dtypetensor_warnings_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:05.3125068Z test_errors_index_copy_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:05.3132075Z test_expected_failure_xla_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:05.7472595Z test_exponential_kstest_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.433s) 2025-03-14T06:18:05.7481462Z test_exponential_kstest_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:06.0624203Z test_exponential_kstest_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.313s) 2025-03-14T06:18:06.3203842Z test_exponential_kstest_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.258s) 2025-03-14T06:18:06.3210300Z test_exponential_no_zero_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:06.3219405Z test_exponential_no_zero_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:06.4125185Z test_exponential_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.090s) 2025-03-14T06:18:06.4138556Z test_exponential_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:06.4972912Z test_exponential_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.084s) 2025-03-14T06:18:06.5808372Z test_exponential_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.083s) 2025-03-14T06:18:06.5817159Z test_gather_backward_deterministic_path_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.5824690Z test_gather_backward_one_dim_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:06.5833656Z test_geometric_kstest_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:06.5855604Z test_geometric_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:06.5864519Z test_geometric_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:06.5889716Z test_geometric_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:06.5912908Z test_geometric_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:06.6350630Z test_geometric_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.044s) 2025-03-14T06:18:06.6782022Z test_geometric_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.043s) 2025-03-14T06:18:06.7212491Z test_geometric_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.043s) 2025-03-14T06:18:06.7647050Z test_geometric_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.043s) 2025-03-14T06:18:06.8081626Z test_geometric_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.043s) 2025-03-14T06:18:06.8089111Z test_grad_scale_will_not_overflow_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8097451Z test_grad_scaler_deprecated_warning_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8112804Z test_grad_scaler_pass_itself_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8123928Z test_grad_scaling_accumulation_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8142090Z test_grad_scaling_autocast_foreach0_fused0_AdamW_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8159566Z test_grad_scaling_autocast_foreach0_fused0_Adam_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8176971Z test_grad_scaling_autocast_foreach0_fused0_SGD_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8195040Z test_grad_scaling_autocast_foreach2_fused_True_AdamW_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8212384Z test_grad_scaling_autocast_foreach2_fused_True_Adam_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8230691Z test_grad_scaling_autocast_foreach2_fused_True_SGD_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8248160Z test_grad_scaling_autocast_foreach_True_fused1_AdamW_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8265998Z test_grad_scaling_autocast_foreach_True_fused1_Adam_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8284626Z test_grad_scaling_autocast_foreach_True_fused1_SGD_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8296860Z test_grad_scaling_clipping_separate_unscale_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8309268Z test_grad_scaling_clipping_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8328200Z test_grad_scaling_multiple_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8342183Z test_grad_scaling_penalty_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8354600Z test_grad_scaling_state_dict_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8377973Z test_grad_scaling_unscale_sparse_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8408252Z test_grad_scaling_unscale_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:18:06.8438182Z test_grad_scaling_unscale_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:18:06.8449928Z test_grad_scaling_update_scale_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8472517Z test_gradient_all_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:18:06.8493941Z test_gradient_all_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8516036Z test_gradient_all_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:06.8530196Z test_gradient_extreme_cases_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:06.8544461Z test_gradient_extreme_cases_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8558983Z test_gradient_extreme_cases_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8572189Z test_gradient_spacing_list_length_error_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:06.8585146Z test_gradient_spacing_list_length_error_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8598117Z test_gradient_spacing_list_length_error_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:06.8620186Z test_gradient_type_promotion_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0414373Z test_hook_remove_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.179s) 2025-03-14T06:18:07.0426432Z test_index_add_deterministic_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0438828Z test_index_add_large_inputs_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:07.0450078Z test_index_add_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.0461607Z test_index_copy_deterministic_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0472947Z test_index_copy_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0483528Z test_index_copy_scalars_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0494186Z test_index_copy_scalars_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0504628Z test_index_copy_scalars_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:07.0515007Z test_index_copy_scalars_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:07.0525552Z test_index_copy_scalars_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.0536142Z test_index_copy_scalars_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0546483Z test_index_copy_scalars_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0556959Z test_index_copy_scalars_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0567861Z test_index_copy_scalars_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0578337Z test_index_copy_scalars_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0588819Z test_index_copy_scalars_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0599319Z test_index_copy_scalars_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0614548Z test_index_copy_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.0623804Z test_index_fill_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0635588Z test_index_fill_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.0648264Z test_index_put_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.0659162Z test_index_put_non_accumulate_deterministic_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.0680298Z test_index_reduce_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:07.0700413Z test_index_select_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0720955Z test_index_select_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0740610Z test_index_select_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:18:07.0760942Z test_index_select_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:18:07.0780672Z test_index_select_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:18:07.0800926Z test_index_select_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0820752Z test_index_select_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0841265Z test_index_select_xla_float8_e4m3fn (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0861032Z test_index_select_xla_float8_e4m3fnuz (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0880938Z test_index_select_xla_float8_e5m2 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0900995Z test_index_select_xla_float8_e5m2fnuz (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0921419Z test_index_select_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0941446Z test_index_select_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0961726Z test_index_select_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.0981729Z test_index_select_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.1002238Z test_index_select_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.1011888Z test_int64_upsample3d_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:07.1025702Z test_invalid_shapes_grid_sampler_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.1040351Z test_is_set_to_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.1049832Z test_is_signed_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.1508556Z test_item_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2025-03-14T06:18:07.1961383Z test_item_xla_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2025-03-14T06:18:07.1968269Z test_item_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:07.1978054Z test_item_xla_complex32 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex32 (0.001s) 2025-03-14T06:18:07.1987795Z test_item_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:07.1997679Z test_item_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.2450180Z test_item_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2025-03-14T06:18:07.2911597Z test_item_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.046s) 2025-03-14T06:18:07.2918203Z test_item_xla_float8_e4m3fn (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2025-03-14T06:18:07.2928511Z test_item_xla_float8_e4m3fnuz (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2025-03-14T06:18:07.2938412Z test_item_xla_float8_e5m2 (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2025-03-14T06:18:07.2948294Z test_item_xla_float8_e5m2fnuz (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2025-03-14T06:18:07.3406446Z test_item_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2025-03-14T06:18:07.3852633Z test_item_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2025-03-14T06:18:07.4307958Z test_item_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2025-03-14T06:18:07.4758898Z test_item_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2025-03-14T06:18:07.4765177Z test_item_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2025-03-14T06:18:07.4775543Z test_item_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2025-03-14T06:18:07.4785508Z test_item_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: uint16,32,64,float8 not implemented on XLA (0.001s) 2025-03-14T06:18:07.5243452Z test_item_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.045s) 2025-03-14T06:18:07.5249224Z test_large_cumprod_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.5259222Z test_large_cumsum_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.5268609Z test_lazy_clone_binary_op_no_materialize_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5277627Z test_lazy_clone_binary_op_no_materialize_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5286868Z test_lazy_clone_binary_op_no_materialize_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:07.5295714Z test_lazy_clone_binary_op_no_materialize_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:07.5304643Z test_lazy_clone_binary_op_no_materialize_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.5313573Z test_lazy_clone_binary_op_no_materialize_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5322543Z test_lazy_clone_binary_op_no_materialize_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5331755Z test_lazy_clone_binary_op_no_materialize_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5340756Z test_lazy_clone_binary_op_no_materialize_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5349727Z test_lazy_clone_binary_op_no_materialize_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5358721Z test_lazy_clone_binary_op_no_materialize_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5368302Z test_lazy_clone_binary_op_no_materialize_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5386954Z test_lazy_clone_view_materialize_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5403930Z test_lazy_clone_view_materialize_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5420954Z test_lazy_clone_view_materialize_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:18:07.5438238Z test_lazy_clone_view_materialize_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:18:07.5454354Z test_lazy_clone_view_materialize_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:18:07.5471519Z test_lazy_clone_view_materialize_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5489143Z test_lazy_clone_view_materialize_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5506883Z test_lazy_clone_view_materialize_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5524009Z test_lazy_clone_view_materialize_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5541125Z test_lazy_clone_view_materialize_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5558679Z test_lazy_clone_view_materialize_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5575023Z test_lazy_clone_view_materialize_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.002s) 2025-03-14T06:18:07.5587449Z test_lazy_clone_view_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5599997Z test_lazy_clone_view_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5612695Z test_lazy_clone_view_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:07.5625111Z test_lazy_clone_view_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:07.5637482Z test_lazy_clone_view_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.5650050Z test_lazy_clone_view_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5662653Z test_lazy_clone_view_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5675375Z test_lazy_clone_view_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5688134Z test_lazy_clone_view_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5700640Z test_lazy_clone_view_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5713184Z test_lazy_clone_view_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5725942Z test_lazy_clone_view_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5736975Z test_lazy_clone_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5748074Z test_lazy_clone_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5759319Z test_lazy_clone_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:07.5770621Z test_lazy_clone_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:07.5781534Z test_lazy_clone_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.5792525Z test_lazy_clone_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5803598Z test_lazy_clone_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5814897Z test_lazy_clone_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5825908Z test_lazy_clone_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5836948Z test_lazy_clone_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5848291Z test_lazy_clone_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5859405Z test_lazy_clone_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:07.5886788Z test_log_normal_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.5892876Z test_log_normal_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.5917994Z test_log_normal_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.5933009Z test_log_normal_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.5949332Z test_logcumsumexp_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.5957454Z test_lognormal_kstest_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:07.5967151Z test_masked_fill_bool_tensor_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.5977287Z test_masked_fill_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.5999477Z test_masked_fill_xla_bfloat16_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6018951Z test_masked_fill_xla_bfloat16_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6039130Z test_masked_fill_xla_bool_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6057936Z test_masked_fill_xla_bool_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6072273Z test_masked_fill_xla_complex128_bool (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:07.6087009Z test_masked_fill_xla_complex128_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:07.6102555Z test_masked_fill_xla_complex64_bool (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:07.6117197Z test_masked_fill_xla_complex64_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:07.6131329Z test_masked_fill_xla_float16_bool (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.6147008Z test_masked_fill_xla_float16_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:07.6166592Z test_masked_fill_xla_float32_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6186444Z test_masked_fill_xla_float32_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6205967Z test_masked_fill_xla_float64_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6225763Z test_masked_fill_xla_float64_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6245656Z test_masked_fill_xla_int16_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6264404Z test_masked_fill_xla_int16_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6284655Z test_masked_fill_xla_int32_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6303470Z test_masked_fill_xla_int32_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6323286Z test_masked_fill_xla_int64_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6342111Z test_masked_fill_xla_int64_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6361853Z test_masked_fill_xla_int8_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6380889Z test_masked_fill_xla_int8_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6400773Z test_masked_fill_xla_uint8_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6419150Z test_masked_fill_xla_uint8_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.6974254Z test_masked_scatter_bool_tensor_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.055s) 2025-03-14T06:18:07.6988835Z test_masked_scatter_inplace_noncontiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:07.6997362Z test_masked_scatter_large_tensor_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:07.7006647Z test_masked_scatter_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.7027339Z test_masked_scatter_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.7046642Z test_masked_scatter_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:18:07.7066247Z test_masked_scatter_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:18:07.7086304Z test_masked_scatter_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:18:07.7105391Z test_masked_scatter_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.7124804Z test_masked_scatter_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.7144045Z test_masked_scatter_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.7163084Z test_masked_scatter_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.7182555Z test_masked_scatter_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.7202155Z test_masked_scatter_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.7221264Z test_masked_scatter_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:07.7232903Z test_masked_select_discontiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.7251858Z test_masked_select_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:07.7261709Z test_memory_format_clone_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.7287151Z test_memory_format_consistency_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:07.7298259Z test_memory_format_cpu_and_cuda_ops_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:07.7313038Z test_memory_format_empty_like_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:07.7325803Z test_memory_format_factory_like_functions_preserve_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:21.3949420Z test_memory_format_operators_xla (__main__.TestTorchDeviceTypeXLA) ... ok (13.662s) 2025-03-14T06:18:21.3970595Z test_memory_format_preserved_after_permute_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:18:21.3990467Z test_memory_format_propagation_rules_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:21.3999691Z test_memory_format_to_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:21.4012280Z test_memory_format_type_shortcuts_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:21.4022056Z test_memory_format_type_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:21.4030099Z test_module_share_memory_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:21.4045804Z test_multinomial_cpu_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:21.4060373Z test_multinomial_cpu_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:18:21.4070709Z test_multinomial_deterministic_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:21.4081226Z test_multinomial_deterministic_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:21.4092034Z test_multinomial_deterministic_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:21.4099840Z test_multinomial_device_constrain_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:21.4992759Z test_multinomial_empty_w_replacement_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.089s) 2025-03-14T06:18:21.5913593Z test_multinomial_empty_wo_replacement_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.092s) 2025-03-14T06:18:21.5917251Z test_multinomial_gpu_device_constrain_xla (__main__.TestTorchDeviceTypeXLA) ... skip: fewer than 2 devices detected (0.001s) 2025-03-14T06:18:21.5928124Z test_multinomial_rng_state_advance_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:21.5957165Z test_multinomial_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.003s) 2025-03-14T06:18:21.5965447Z test_narrow_copy_non_contiguous_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:21.5988898Z test_narrow_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:21.6011226Z test_nondeterministic_alert_AdaptiveAvgPool2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:18:21.6038278Z test_nondeterministic_alert_AdaptiveAvgPool3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:21.6054990Z test_nondeterministic_alert_AdaptiveMaxPool2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:21.6076102Z test_nondeterministic_alert_AvgPool3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:21.8621607Z test_nondeterministic_alert_CTCLoss_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.254s) 2025-03-14T06:18:21.8638422Z test_nondeterministic_alert_EmbeddingBag_max_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:22.1323050Z test_nondeterministic_alert_FractionalMaxPool2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.268s) 2025-03-14T06:18:22.4234765Z test_nondeterministic_alert_FractionalMaxPool3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.291s) 2025-03-14T06:18:22.4266794Z test_nondeterministic_alert_MaxPool3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:18:22.4280043Z test_nondeterministic_alert_MaxUnpool1d_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:22.4291112Z test_nondeterministic_alert_MaxUnpool1d_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:22.4302893Z test_nondeterministic_alert_MaxUnpool1d_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:22.4314558Z test_nondeterministic_alert_MaxUnpool2d_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:22.4326407Z test_nondeterministic_alert_MaxUnpool2d_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:22.4338225Z test_nondeterministic_alert_MaxUnpool2d_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:22.4350002Z test_nondeterministic_alert_MaxUnpool3d_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:22.4361810Z test_nondeterministic_alert_MaxUnpool3d_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:22.4374031Z test_nondeterministic_alert_MaxUnpool3d_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:22.4397036Z test_nondeterministic_alert_NLLLoss_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:22.4419683Z test_nondeterministic_alert_ReflectionPad1d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:22.4442768Z test_nondeterministic_alert_ReflectionPad3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:22.4464793Z test_nondeterministic_alert_ReplicationPad1d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:22.4495315Z test_nondeterministic_alert_ReplicationPad2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:18:22.4520617Z test_nondeterministic_alert_ReplicationPad3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:22.4542599Z test_nondeterministic_alert_bincount_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:22.5501692Z test_nondeterministic_alert_grid_sample_2d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.096s) 2025-03-14T06:18:22.6436347Z test_nondeterministic_alert_grid_sample_3d_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.093s) 2025-03-14T06:18:22.6459778Z test_nondeterministic_alert_histc_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:22.7406951Z test_nondeterministic_alert_interpolate_bicubic_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.095s) 2025-03-14T06:18:22.7433176Z test_nondeterministic_alert_interpolate_bilinear_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:18:22.8831409Z test_nondeterministic_alert_interpolate_linear_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.139s) 2025-03-14T06:18:22.9357621Z test_nondeterministic_alert_interpolate_trilinear_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.053s) 2025-03-14T06:18:22.9406675Z test_nondeterministic_alert_kthvalue_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.005s) 2025-03-14T06:18:23.8621032Z test_nondeterministic_alert_median_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.921s) 2025-03-14T06:18:23.8643458Z test_nondeterministic_alert_put_accumulate_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:18:23.8651208Z test_nondeterministic_alert_put_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:23.8660742Z test_nondeterministic_resize_quantized_xla_qint32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:23.8669753Z test_nondeterministic_resize_quantized_xla_qint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:23.8678649Z test_nondeterministic_resize_quantized_xla_quint2x4 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:23.8687704Z test_nondeterministic_resize_quantized_xla_quint4x2 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:23.8696530Z test_nondeterministic_resize_quantized_xla_quint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:23.8706502Z test_normal_kstest_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:24.7328812Z test_normal_kstest_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.862s) 2025-03-14T06:18:25.4546748Z test_normal_kstest_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.721s) 2025-03-14T06:18:25.4645742Z test_nullary_op_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.010s) 2025-03-14T06:18:25.8203998Z test_pairwise_distance_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.356s) 2025-03-14T06:18:25.8217432Z test_parallel_cow_materialize_error_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:25.8232370Z test_params_invalidated_with_grads_invalidated_between_unscale_and_step_AdamW_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:25.8246247Z test_params_invalidated_with_grads_invalidated_between_unscale_and_step_Adam_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:25.8259744Z test_params_invalidated_with_grads_invalidated_between_unscale_and_step_SGD_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:26.0087138Z test_pdist_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.182s) 2025-03-14T06:18:26.0095355Z test_pdist_norm_large_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:26.0111030Z test_pickle_gradscaler_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:26.0124734Z test_pin_memory_from_constructor_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:26.2887827Z test_put_accumulate_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.276s) 2025-03-14T06:18:26.2902242Z test_put_accumulate_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:26.2913710Z test_put_accumulate_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:26.2925548Z test_put_accumulate_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:26.8096646Z test_put_accumulate_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.517s) 2025-03-14T06:18:27.2690386Z test_put_accumulate_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.459s) 2025-03-14T06:18:27.7287741Z test_put_accumulate_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.460s) 2025-03-14T06:18:28.1659447Z test_put_accumulate_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.437s) 2025-03-14T06:18:28.6011678Z test_put_accumulate_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.435s) 2025-03-14T06:18:29.1090063Z test_put_accumulate_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.508s) 2025-03-14T06:18:29.6101668Z test_put_accumulate_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.501s) 2025-03-14T06:18:30.4019095Z test_put_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.792s) 2025-03-14T06:18:30.4030565Z test_put_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:30.4054668Z test_put_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:30.4067028Z test_reduced_type_float_copy_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:30.4079066Z test_reduced_type_float_copy_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:30.5204902Z test_repeat_interleave_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.112s) 2025-03-14T06:18:30.5290318Z test_scalar_check_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.009s) 2025-03-14T06:18:30.5911387Z test_scatter_add_bool_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.062s) 2025-03-14T06:18:30.9048524Z test_scatter_add_non_unique_index_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.313s) 2025-03-14T06:18:30.9069738Z test_scatter_add_one_dim_deterministic_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:18:30.9822038Z test_scatter_add_to_large_input_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.075s) 2025-03-14T06:18:31.0567407Z test_scatter_bool_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.074s) 2025-03-14T06:18:31.0584440Z test_scatter_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:31.0598867Z test_scatter_reduce_multiply_unsupported_dtypes_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:31.0612348Z test_scatter_reduce_multiply_unsupported_dtypes_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:31.0632710Z test_scatter_reduce_non_unique_index_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:18:31.0653398Z test_scatter_reduce_non_unique_index_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:18:31.2324539Z test_scatter_reduce_non_unique_index_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py:3885: UserWarning: The reduce argument of torch.scatter with Tensor src is deprecated and will be removed in a future PyTorch release. Use torch.scatter_reduce instead for more reduction options. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/TensorAdvancedIndexing.cpp:234.) 2025-03-14T06:18:31.2327015Z input.scatter_(0, index, src, reduce=operation) 2025-03-14T06:18:31.2331394Z ok (0.168s) 2025-03-14T06:18:31.3909756Z test_scatter_reduce_non_unique_index_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.157s) 2025-03-14T06:18:31.3921365Z test_scatter_reduce_operations_to_large_input_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:18:31.3937187Z test_scatter_reduce_operations_to_large_input_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:31.4506579Z test_scatter_reduce_operations_to_large_input_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.056s) 2025-03-14T06:18:31.5614580Z test_scatter_reduce_operations_to_large_input_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.111s) 2025-03-14T06:18:31.5629562Z test_scatter_reduce_scalar_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:18:31.5644051Z test_scatter_reduce_scalar_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:31.6764129Z test_scatter_reduce_scalar_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.111s) 2025-03-14T06:18:31.7863145Z test_scatter_reduce_scalar_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.110s) 2025-03-14T06:18:31.8424491Z test_scatter_to_large_input_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.056s) 2025-03-14T06:18:31.8430338Z test_scatter_zero_size_index_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8442459Z test_serialization_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:31.8455956Z test_set_default_tensor_type_warnings_xla (__main__.TestTorchDeviceTypeXLA) ... /opt/conda/lib/python3.10/site-packages/torch/__init__.py:1242: UserWarning: torch.set_default_tensor_type() is deprecated as of PyTorch 2.1, please use torch.set_default_dtype() and torch.set_default_device() as alternatives. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/tensor/python_tensor.cpp:436.) 2025-03-14T06:18:31.8457778Z _C._set_default_tensor_type(t) 2025-03-14T06:18:31.8458090Z ok (0.001s) 2025-03-14T06:18:31.8468334Z test_set_storage_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8480663Z test_set_storage_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8493094Z test_set_storage_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:31.8505334Z test_set_storage_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:31.8517480Z test_set_storage_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:31.8529943Z test_set_storage_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8542322Z test_set_storage_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8554548Z test_set_storage_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8567229Z test_set_storage_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8579450Z test_set_storage_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8591688Z test_set_storage_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8604101Z test_set_storage_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.8612569Z test_shift_mem_overlap_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:31.8619482Z test_skip_xla_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:18:31.8630625Z test_storage_all_devices_non_blocking_False_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:31.8641666Z test_storage_all_devices_non_blocking_True_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:18:31.8657485Z test_storage_meta_errors_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py:356: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2025-03-14T06:18:31.8659466Z s0 = torch.TypedStorage([1, 2, 3, 4], device='meta', dtype=dtype) 2025-03-14T06:18:31.8757499Z ok (0.011s) 2025-03-14T06:18:31.8837419Z test_storage_meta_errors_xla_bool (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:18:31.8847908Z test_storage_meta_errors_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:31.8862161Z test_storage_meta_errors_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:31.8876820Z test_storage_meta_errors_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:31.8959675Z test_storage_meta_errors_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:18:31.9037949Z test_storage_meta_errors_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:18:31.9117729Z test_storage_meta_errors_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:18:31.9199167Z test_storage_meta_errors_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:18:31.9274301Z test_storage_meta_errors_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:18:31.9355890Z test_storage_meta_errors_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:18:31.9434327Z test_storage_meta_errors_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:18:31.9438399Z test_storage_meta_from_tensor_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9447524Z test_storage_meta_from_tensor_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9456336Z test_storage_meta_from_tensor_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:31.9465013Z test_storage_meta_from_tensor_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:31.9473997Z test_storage_meta_from_tensor_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:31.9482895Z test_storage_meta_from_tensor_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9492039Z test_storage_meta_from_tensor_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9500926Z test_storage_meta_from_tensor_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9509755Z test_storage_meta_from_tensor_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9518629Z test_storage_meta_from_tensor_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9527664Z test_storage_meta_from_tensor_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9536568Z test_storage_meta_from_tensor_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9544585Z test_storage_meta_ok_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9552699Z test_storage_meta_ok_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9560913Z test_storage_meta_ok_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:31.9569903Z test_storage_meta_ok_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:31.9577930Z test_storage_meta_ok_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:31.9585968Z test_storage_meta_ok_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9594104Z test_storage_meta_ok_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9602193Z test_storage_meta_ok_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9610592Z test_storage_meta_ok_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9618715Z test_storage_meta_ok_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9626840Z test_storage_meta_ok_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9635045Z test_storage_meta_ok_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:18:31.9648634Z test_storage_setitem_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9662784Z test_storage_setitem_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:18:31.9675297Z test_storage_setitem_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:18:31.9688673Z test_storage_setitem_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9702794Z test_storage_setitem_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9715073Z test_storage_setitem_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9728465Z test_storage_setitem_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9742567Z test_storage_setitem_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9754963Z test_storage_setitem_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9768526Z test_storage_setitem_xla_qint32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9782682Z test_storage_setitem_xla_qint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9795114Z test_storage_setitem_xla_quint4x2 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9808626Z test_storage_setitem_xla_quint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9822717Z test_storage_setitem_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:18:31.9835311Z test_storage_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:18:31.9854383Z test_strides_propagation_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:18:31.9873967Z test_sync_warning_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:18:32.3108950Z test_take_empty_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.323s) 2025-03-14T06:18:37.8895068Z test_take_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (5.579s) 2025-03-14T06:18:41.7311845Z test_take_xla_bool (__main__.TestTorchDeviceTypeXLA) ... ok (3.841s) 2025-03-14T06:18:41.7325404Z test_take_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:18:41.7342635Z test_take_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:18:41.7357123Z test_take_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:18:45.9673816Z test_take_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (4.231s) 2025-03-14T06:18:49.8884272Z test_take_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (3.921s) 2025-03-14T06:18:53.7607350Z test_take_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... ok (3.872s) 2025-03-14T06:18:57.6432816Z test_take_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... ok (3.882s) 2025-03-14T06:19:01.5236368Z test_take_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... ok (3.880s) 2025-03-14T06:19:05.4207195Z test_take_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... ok (3.897s) 2025-03-14T06:19:09.3050980Z test_take_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... ok (3.884s) 2025-03-14T06:19:09.3067377Z test_tensor_from_storage_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:19:09.3080830Z test_tensor_from_storage_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3093094Z test_tensor_from_storage_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:19:09.3104977Z test_tensor_from_storage_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:19:09.3116856Z test_tensor_from_storage_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:19:09.3129108Z test_tensor_from_storage_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3140962Z test_tensor_from_storage_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3152854Z test_tensor_from_storage_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3164832Z test_tensor_from_storage_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3177151Z test_tensor_from_storage_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3189026Z test_tensor_from_storage_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3200930Z test_tensor_from_storage_xla_uint16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3213107Z test_tensor_from_storage_xla_uint32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3224988Z test_tensor_from_storage_xla_uint64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3237011Z test_tensor_from_storage_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3247111Z test_tensor_set_errors_multigpu_xla (__main__.TestTorchDeviceTypeXLA) ... skip: fewer than 2 devices detected (0.001s) 2025-03-14T06:19:09.3277912Z test_tensor_shape_empty_xla (__main__.TestTorchDeviceTypeXLA) ... skip: skipped on XLA (0.003s) 2025-03-14T06:19:09.3287300Z test_tensor_storage_type_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3296493Z test_tensor_storage_type_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3305873Z test_tensor_storage_type_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:19:09.3314912Z test_tensor_storage_type_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:19:09.3324082Z test_tensor_storage_type_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:19:09.3333572Z test_tensor_storage_type_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3342850Z test_tensor_storage_type_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3352142Z test_tensor_storage_type_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3361463Z test_tensor_storage_type_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3371091Z test_tensor_storage_type_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3380322Z test_tensor_storage_type_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3389633Z test_tensor_storage_type_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3412301Z test_tensor_type_xla (__main__.TestTorchDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:19:09.3423242Z test_ternary_op_mem_overlap_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.001s) 2025-03-14T06:19:09.3432774Z test_typed_storage_meta_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3442093Z test_typed_storage_meta_xla_bool (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3451497Z test_typed_storage_meta_xla_complex128 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:19:09.3460765Z test_typed_storage_meta_xla_complex64 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:19:09.3470183Z test_typed_storage_meta_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:19:09.3479469Z test_typed_storage_meta_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3488926Z test_typed_storage_meta_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3498271Z test_typed_storage_meta_xla_int16 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3507546Z test_typed_storage_meta_xla_int32 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3516814Z test_typed_storage_meta_xla_int64 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3526333Z test_typed_storage_meta_xla_int8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.3535587Z test_typed_storage_meta_xla_uint8 (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:09.9361900Z test_uniform_kstest_xla_bfloat16 (__main__.TestTorchDeviceTypeXLA) ... ok (0.582s) 2025-03-14T06:19:09.9370712Z test_uniform_kstest_xla_float16 (__main__.TestTorchDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:19:10.4224110Z test_uniform_kstest_xla_float32 (__main__.TestTorchDeviceTypeXLA) ... ok (0.485s) 2025-03-14T06:19:10.8368609Z test_uniform_kstest_xla_float64 (__main__.TestTorchDeviceTypeXLA) ... ok (0.414s) 2025-03-14T06:19:10.8376946Z test_untyped_storage_meta_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:10.8386987Z test_warn_always_caught_xla (__main__.TestTorchDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:19:10.8406899Z test_where_scalar_handcrafted_values_xla (__main__.TestTorchDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:19:10.8407533Z 2025-03-14T06:19:10.8407717Z ---------------------------------------------------------------------- 2025-03-14T06:19:10.8408138Z Ran 618 tests in 72.714s 2025-03-14T06:19:10.8408313Z 2025-03-14T06:19:10.8408432Z OK (skipped=459) 2025-03-14T06:19:10.8408581Z 2025-03-14T06:19:10.8408708Z Generating XML reports... 2025-03-14T06:19:10.8869051Z Generated XML report: test-reports/python-unittest/test.......test.test_torch/TEST-TestTorchDeviceTypeXLA-20250314061758.xml 2025-03-14T06:19:11.9508211Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2025-03-14T06:19:11.9509322Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py' -v TestDevicePrecisionXLA 2025-03-14T06:19:11.9510343Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2025-03-14T06:19:11.9511097Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T06:19:11.9511921Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2025-03-14T06:19:11.9512880Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py' -v TestDevicePrecisionXLA 2025-03-14T06:19:11.9513849Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2025-03-14T06:19:11.9514495Z ++ command -v nvidia-smi 2025-03-14T06:19:11.9514789Z + '[' -x '' ']' 2025-03-14T06:19:11.9515049Z + PJRT_DEVICE=CPU 2025-03-14T06:19:11.9515302Z + CPU_NUM_DEVICES=1 2025-03-14T06:19:11.9515832Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2025-03-14T06:19:11.9516414Z + '[' 0 '!=' 0 ']' 2025-03-14T06:19:11.9516916Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestDevicePrecisionXLA 2025-03-14T06:19:16.6282702Z 2025-03-14T06:19:16.6283141Z Running tests... 2025-03-14T06:19:16.6283525Z ---------------------------------------------------------------------- 2025-03-14T06:19:16.6284341Z Test results will be stored in test-reports/python-unittest/test.......test.test_torch 2025-03-14T06:19:16.7482669Z test_advancedindex_mixed_cpu_devices_xla (__main__.TestDevicePrecisionXLA) ... ok (0.120s) 2025-03-14T06:19:16.7923177Z test_advancedindex_mixed_devices_error_xla (__main__.TestDevicePrecisionXLA) ... ok (0.044s) 2025-03-14T06:19:22.5076391Z test_clamp_xla_float32 (__main__.TestDevicePrecisionXLA) ... ok (5.715s) 2025-03-14T06:19:27.7165460Z test_clamp_xla_float64 (__main__.TestDevicePrecisionXLA) ... ok (5.208s) 2025-03-14T06:19:32.8253343Z test_clamp_xla_int64 (__main__.TestDevicePrecisionXLA) ... ok (5.109s) 2025-03-14T06:19:32.8263921Z test_copy_broadcast_xla (__main__.TestDevicePrecisionXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:32.9181113Z test_copy_noncontig_xla (__main__.TestDevicePrecisionXLA) ... ok (0.091s) 2025-03-14T06:19:32.9197495Z test_cuda_device_idx_xla (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2025-03-14T06:19:33.0177611Z test_device_serialization_xla (__main__.TestDevicePrecisionXLA) ... ok (0.098s) 2025-03-14T06:19:33.0199374Z test_from_sequence_xla_float32 (__main__.TestDevicePrecisionXLA) ... ok (0.002s) 2025-03-14T06:19:33.0209246Z test_from_sequence_xla_float64 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2025-03-14T06:19:33.0225157Z test_from_sequence_xla_int16 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2025-03-14T06:19:33.0240337Z test_from_sequence_xla_int32 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2025-03-14T06:19:33.0252624Z test_from_sequence_xla_int64 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2025-03-14T06:19:33.0267447Z test_from_sequence_xla_int8 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2025-03-14T06:19:33.0283537Z test_from_sequence_xla_uint8 (__main__.TestDevicePrecisionXLA) ... ok (0.001s) 2025-03-14T06:19:33.0293271Z test_index_add_bfloat16_xla (__main__.TestDevicePrecisionXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:19:33.0302902Z test_multidevice_serialization_xla (__main__.TestDevicePrecisionXLA) ... skip: fewer than 2 devices detected (0.001s) 2025-03-14T06:19:33.0311558Z test_type_conversions_same_device_xla (__main__.TestDevicePrecisionXLA) ... skip: fewer than 2 devices detected (0.001s) 2025-03-14T06:19:33.0312133Z 2025-03-14T06:19:33.0312303Z ---------------------------------------------------------------------- 2025-03-14T06:19:33.0312705Z Ran 19 tests in 16.403s 2025-03-14T06:19:33.0312907Z 2025-03-14T06:19:33.0313004Z OK (skipped=4) 2025-03-14T06:19:33.0313213Z 2025-03-14T06:19:33.0313368Z Generating XML reports... 2025-03-14T06:19:33.0330782Z Generated XML report: test-reports/python-unittest/test.......test.test_torch/TEST-TestDevicePrecisionXLA-20250314061916.xml 2025-03-14T06:19:34.0175606Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTensorDeviceOpsXLA 2025-03-14T06:19:34.0176599Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py' -v TestTensorDeviceOpsXLA 2025-03-14T06:19:34.0177605Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTensorDeviceOpsXLA 2025-03-14T06:19:34.0178246Z ++ command -v nvidia-smi 2025-03-14T06:19:34.0180201Z + '[' -x '' ']' 2025-03-14T06:19:34.0180471Z + PJRT_DEVICE=CPU 2025-03-14T06:19:34.0180728Z + CPU_NUM_DEVICES=1 2025-03-14T06:19:34.0181266Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTensorDeviceOpsXLA 2025-03-14T06:19:34.0181856Z + '[' 0 '!=' 0 ']' 2025-03-14T06:19:34.0182355Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_torch.py -v TestTensorDeviceOpsXLA 2025-03-14T06:19:38.6866068Z 2025-03-14T06:19:38.6866535Z Running tests... 2025-03-14T06:19:38.6867174Z ---------------------------------------------------------------------- 2025-03-14T06:19:38.6867477Z 2025-03-14T06:19:38.6867653Z ---------------------------------------------------------------------- 2025-03-14T06:19:38.6868038Z Ran 0 tests in 0.000s 2025-03-14T06:19:38.6868278Z 2025-03-14T06:19:38.6868382Z OK 2025-03-14T06:19:38.6868496Z 2025-03-14T06:19:38.6868627Z Generating XML reports... 2025-03-14T06:19:38.6876228Z Test results will be stored in test-reports/python-unittest/test.......test.test_torch 2025-03-14T06:19:39.6204799Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v TestIndexingXLA 2025-03-14T06:19:39.6205871Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py' -v TestIndexingXLA 2025-03-14T06:19:39.6206826Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v TestIndexingXLA 2025-03-14T06:19:39.6207467Z ++ command -v nvidia-smi 2025-03-14T06:19:39.6207751Z + '[' -x '' ']' 2025-03-14T06:19:39.6208011Z + PJRT_DEVICE=CPU 2025-03-14T06:19:39.6208271Z + CPU_NUM_DEVICES=1 2025-03-14T06:19:39.6208787Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v TestIndexingXLA 2025-03-14T06:19:39.6209340Z + '[' 0 '!=' 0 ']' 2025-03-14T06:19:39.6209833Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v TestIndexingXLA 2025-03-14T06:19:43.2486509Z 2025-03-14T06:19:43.2486946Z Running tests... 2025-03-14T06:19:43.2487388Z ---------------------------------------------------------------------- 2025-03-14T06:19:43.2488027Z Test results will be stored in test-reports/python-unittest/test.......test.test_indexing 2025-03-14T06:19:43.3315443Z test_advancedindex_big_xla (__main__.TestIndexingXLA) ... ok (0.083s) 2025-03-14T06:19:43.3494532Z test_advancedindex_xla_float16 (__main__.TestIndexingXLA) ... skip: XLA does not support dtype torch.float16 (0.018s) 2025-03-14T06:19:43.3674468Z test_advancedindex_xla_float64 (__main__.TestIndexingXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.018s) 2025-03-14T06:19:43.5662201Z test_basic_advanced_combined_xla (__main__.TestIndexingXLA) ... ok (0.199s) 2025-03-14T06:19:43.7143800Z test_bool_indices_accumulate_xla (__main__.TestIndexingXLA) ... ok (0.148s) 2025-03-14T06:19:43.7153473Z test_bool_indices_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:43.9217664Z test_byte_mask2d_xla (__main__.TestIndexingXLA) ... ok (0.206s) 2025-03-14T06:19:43.9225276Z test_byte_mask_accumulate_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:43.9235778Z test_byte_mask_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:43.9246387Z test_byte_tensor_assignment_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:43.9255354Z test_cpu_indices_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:19:43.9272964Z test_cuda_broadcast_index_use_deterministic_algorithms_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:19:44.0227223Z test_ellipsis_tensor_xla (__main__.TestIndexingXLA) ... ok (0.095s) 2025-03-14T06:19:44.1639056Z test_empty_index_xla (__main__.TestIndexingXLA) ... ok (0.141s) 2025-03-14T06:19:44.1651865Z test_empty_ndim_index_bool_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:44.1664012Z test_empty_ndim_index_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:44.1673008Z test_empty_slice_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:44.1684070Z test_gather_take_along_dim_cross_device_xla_float32 (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:19:44.1698209Z test_getitem_scalars_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:44.1708042Z test_index_getitem_copy_bools_slices_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:44.1720299Z test_index_ind_dtype_xla (__main__.TestIndexingXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:44.1731487Z test_index_limits_xla (__main__.TestIndexingXLA) ... ok (0.001s) 2025-03-14T06:19:44.1742518Z test_index_put_accumulate_duplicate_indices_xla (__main__.TestIndexingXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:19:44.1750234Z test_index_put_accumulate_empty_xla (__main__.TestIndexingXLA) ... skip: Marked as skipped for XLA (0.001s) 2025-03-14T06:19:44.1767361Z test_index_put_accumulate_expanded_values_xla (__main__.TestIndexingXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:19:53.0250444Z test_index_put_accumulate_large_tensor_xla (__main__.TestIndexingXLA) ... ok (8.848s) 2025-03-14T06:19:53.0262576Z test_index_put_accumulate_non_contiguous_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:19:53.0275198Z test_index_put_accumulate_with_optional_tensors_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:19:53.0291583Z test_index_put_large_indices_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:19:53.0309339Z test_index_put_src_datatype_xla_bfloat16 (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:53.0324101Z test_index_put_src_datatype_xla_bool (__main__.TestIndexingXLA) ... ok (0.001s) 2025-03-14T06:19:53.0334172Z test_index_put_src_datatype_xla_complex128 (__main__.TestIndexingXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:19:53.0344816Z test_index_put_src_datatype_xla_complex64 (__main__.TestIndexingXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:19:53.0359666Z test_index_put_src_datatype_xla_float32 (__main__.TestIndexingXLA) ... ok (0.001s) 2025-03-14T06:19:53.0373366Z test_index_put_src_datatype_xla_int64 (__main__.TestIndexingXLA) ... ok (0.001s) 2025-03-14T06:19:53.1649830Z test_index_scalar_with_bool_mask_xla (__main__.TestIndexingXLA) ... ok (0.127s) 2025-03-14T06:19:53.1661296Z test_index_setitem_bools_slices_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:53.1681933Z test_index_src_datatype_xla_bfloat16 (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:53.1694820Z test_index_src_datatype_xla_bool (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:53.1712057Z test_index_src_datatype_xla_float32 (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:53.1727419Z test_index_src_datatype_xla_int64 (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:59.0456452Z test_index_xla (__main__.TestIndexingXLA) ... ok (5.873s) 2025-03-14T06:19:59.1390120Z test_int_assignment_xla (__main__.TestIndexingXLA) ... ok (0.093s) 2025-03-14T06:19:59.1882168Z test_int_indices2d_xla (__main__.TestIndexingXLA) ... ok (0.049s) 2025-03-14T06:19:59.2373561Z test_int_indices_broadcast_xla (__main__.TestIndexingXLA) ... ok (0.049s) 2025-03-14T06:19:59.2401542Z test_int_indices_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:59.2406045Z test_invalid_device_xla (__main__.TestIndexingXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:19:59.2415111Z test_invalid_index_xla (__main__.TestIndexingXLA) ... ok (0.001s) 2025-03-14T06:19:59.4444601Z test_jit_indexing_xla (__main__.TestIndexingXLA) ... ok (0.202s) 2025-03-14T06:19:59.4467948Z test_multiple_bool_indices_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:59.4475214Z test_multiple_byte_mask_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:59.4490789Z test_multiple_int_xla (__main__.TestIndexingXLA) ... ok (0.001s) 2025-03-14T06:19:59.4514837Z test_none_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:59.4528809Z test_out_of_bound_index_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:19:59.4956356Z test_set_item_to_scalar_tensor_xla (__main__.TestIndexingXLA) ... ok (0.042s) 2025-03-14T06:19:59.4960310Z test_setitem_expansion_error_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:59.4971137Z test_setitem_scalars_xla (__main__.TestIndexingXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:19:59.4985185Z test_single_int_xla (__main__.TestIndexingXLA) ... ok (0.001s) 2025-03-14T06:19:59.5851287Z test_step_assignment_xla (__main__.TestIndexingXLA) ... ok (0.086s) 2025-03-14T06:19:59.8491430Z test_step_xla (__main__.TestIndexingXLA) ... ok (0.264s) 2025-03-14T06:19:59.8526516Z test_take_along_dim_invalid_xla_float32 (__main__.TestIndexingXLA) ... ok (0.003s) 2025-03-14T06:19:59.8553435Z test_take_along_dim_invalid_xla_int64 (__main__.TestIndexingXLA) ... ok (0.003s) 2025-03-14T06:20:02.0552764Z test_take_along_dim_xla_float32 (__main__.TestIndexingXLA) ... ok (2.200s) 2025-03-14T06:20:03.7317022Z test_take_along_dim_xla_int64 (__main__.TestIndexingXLA) ... ok (1.676s) 2025-03-14T06:20:03.7329960Z test_unravel_index_errors_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:20:03.8756732Z test_variable_slicing_xla (__main__.TestIndexingXLA) ... ok (0.142s) 2025-03-14T06:20:03.8767756Z test_zero_dim_index_xla (__main__.TestIndexingXLA) ... ok (0.002s) 2025-03-14T06:20:03.8768204Z 2025-03-14T06:20:03.8768413Z ---------------------------------------------------------------------- 2025-03-14T06:20:03.8768813Z Ran 67 tests in 20.629s 2025-03-14T06:20:03.8768985Z 2025-03-14T06:20:03.8769103Z OK (skipped=27) 2025-03-14T06:20:03.8769249Z 2025-03-14T06:20:03.8769384Z Generating XML reports... 2025-03-14T06:20:03.8826180Z Generated XML report: test-reports/python-unittest/test.......test.test_indexing/TEST-TestIndexingXLA-20250314061943.xml 2025-03-14T06:20:04.6368679Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v NumpyTestsXLA 2025-03-14T06:20:04.6369616Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py' -v NumpyTestsXLA 2025-03-14T06:20:04.6370567Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v NumpyTestsXLA 2025-03-14T06:20:04.6371196Z ++ command -v nvidia-smi 2025-03-14T06:20:04.6372980Z + '[' -x '' ']' 2025-03-14T06:20:04.6373239Z + PJRT_DEVICE=CPU 2025-03-14T06:20:04.6373507Z + CPU_NUM_DEVICES=1 2025-03-14T06:20:04.6374018Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v NumpyTestsXLA 2025-03-14T06:20:04.6374578Z + '[' 0 '!=' 0 ']' 2025-03-14T06:20:04.6375061Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_indexing.py -v NumpyTestsXLA 2025-03-14T06:20:08.2640564Z 2025-03-14T06:20:08.2641102Z Running tests... 2025-03-14T06:20:08.2641546Z ---------------------------------------------------------------------- 2025-03-14T06:20:08.2642172Z Test results will be stored in test-reports/python-unittest/test.......test.test_indexing 2025-03-14T06:20:08.2652695Z test_boolean_assignment_value_mismatch_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:20:08.2720015Z test_boolean_indexing_alldims_xla (__main__.NumpyTestsXLA) ... ok (0.006s) 2025-03-14T06:20:08.3727991Z test_boolean_indexing_onedim_xla (__main__.NumpyTestsXLA) ... ok (0.101s) 2025-03-14T06:20:08.7406623Z test_boolean_indexing_twodim_xla (__main__.NumpyTestsXLA) ... ok (0.368s) 2025-03-14T06:20:08.7413978Z test_boolean_indexing_weirdness_tensors_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:20:08.7422718Z test_boolean_indexing_weirdness_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:20:08.8388873Z test_boolean_list_indexing_xla (__main__.NumpyTestsXLA) ... ok (0.096s) 2025-03-14T06:20:08.8394480Z test_boolean_shape_mismatch_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:20:08.9505088Z test_broadcast_subspace_xla (__main__.NumpyTestsXLA) ... ok (0.110s) 2025-03-14T06:20:08.9509935Z test_broaderrors_indexing_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:20:08.9520711Z test_ellipsis_index_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:20:08.9529869Z test_empty_fancy_index_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:20:08.9537054Z test_empty_tuple_index_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:20:08.9546617Z test_everything_returns_views_xla (__main__.NumpyTestsXLA) ... ok (0.001s) 2025-03-14T06:20:09.0190231Z test_index_is_larger_xla (__main__.NumpyTestsXLA) ... ok (0.064s) 2025-03-14T06:20:09.0223352Z test_index_no_floats_xla (__main__.NumpyTestsXLA) ... ok (0.003s) 2025-03-14T06:20:09.0228319Z test_none_index_xla (__main__.NumpyTestsXLA) ... ok (0.001s) 2025-03-14T06:20:09.1817884Z test_single_bool_index_xla (__main__.NumpyTestsXLA) ... ok (0.159s) 2025-03-14T06:20:09.2711606Z test_single_int_index_xla (__main__.NumpyTestsXLA) ... ok (0.089s) 2025-03-14T06:20:09.2717359Z test_trivial_fancy_out_of_bounds_xla (__main__.NumpyTestsXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:20:09.2730541Z test_truncate_leading_1s_xla (__main__.NumpyTestsXLA) ... ok (0.001s) 2025-03-14T06:20:09.2730909Z 2025-03-14T06:20:09.2731089Z ---------------------------------------------------------------------- 2025-03-14T06:20:09.2731503Z Ran 21 tests in 1.010s 2025-03-14T06:20:09.2731671Z 2025-03-14T06:20:09.2731785Z OK (skipped=9) 2025-03-14T06:20:09.2731929Z 2025-03-14T06:20:09.2732055Z Generating XML reports... 2025-03-14T06:20:09.2756973Z Generated XML report: test-reports/python-unittest/test.......test.test_indexing/TEST-NumpyTestsXLA-20250314062008.xml 2025-03-14T06:20:10.0310302Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2025-03-14T06:20:10.0311533Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py' -v TestDropoutNNDeviceTypeXLA 2025-03-14T06:20:10.0312635Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2025-03-14T06:20:10.0313433Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T06:20:10.0314128Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2025-03-14T06:20:10.0315115Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py' -v TestDropoutNNDeviceTypeXLA 2025-03-14T06:20:10.0316157Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2025-03-14T06:20:10.0316832Z ++ command -v nvidia-smi 2025-03-14T06:20:10.0317116Z + '[' -x '' ']' 2025-03-14T06:20:10.0317362Z + PJRT_DEVICE=CPU 2025-03-14T06:20:10.0317614Z + CPU_NUM_DEVICES=1 2025-03-14T06:20:10.0318178Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2025-03-14T06:20:10.0318797Z + '[' 0 '!=' 0 ']' 2025-03-14T06:20:10.0319333Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_dropout.py -v TestDropoutNNDeviceTypeXLA 2025-03-14T06:20:13.7230902Z 2025-03-14T06:20:13.7231399Z Running tests... 2025-03-14T06:20:13.7231824Z ---------------------------------------------------------------------- 2025-03-14T06:20:13.7232486Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_dropout 2025-03-14T06:20:14.3240228Z test_Dropout1d_xla_float64 (__main__.TestDropoutNNDeviceTypeXLA) ... ok (0.601s) 2025-03-14T06:20:14.3253077Z test_Dropout2d_xla (__main__.TestDropoutNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:20:15.3040424Z test_Dropout3d_xla (__main__.TestDropoutNNDeviceTypeXLA) ... ok (0.978s) 2025-03-14T06:22:09.2561882Z test_Dropout_xla (__main__.TestDropoutNNDeviceTypeXLA) ... ok (113.952s) 2025-03-14T06:22:09.2592290Z test_empty_dropout_xla (__main__.TestDropoutNNDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:22:09.2592690Z 2025-03-14T06:22:09.2592873Z ---------------------------------------------------------------------- 2025-03-14T06:22:09.2593518Z Ran 5 tests in 115.536s 2025-03-14T06:22:09.2593687Z 2025-03-14T06:22:09.2593786Z OK (skipped=1) 2025-03-14T06:22:09.2593939Z 2025-03-14T06:22:09.2594050Z Generating XML reports... 2025-03-14T06:22:09.2598494Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_dropout/TEST-TestDropoutNNDeviceTypeXLA-20250314062013.xml 2025-03-14T06:22:10.2697144Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2025-03-14T06:22:10.2698337Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py' -v TestPoolingNNDeviceTypeXLA 2025-03-14T06:22:10.2699437Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2025-03-14T06:22:10.2700232Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T06:22:10.2700925Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2025-03-14T06:22:10.2701921Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py' -v TestPoolingNNDeviceTypeXLA 2025-03-14T06:22:10.2702958Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2025-03-14T06:22:10.2703638Z ++ command -v nvidia-smi 2025-03-14T06:22:10.2703921Z + '[' -x '' ']' 2025-03-14T06:22:10.2704167Z + PJRT_DEVICE=CPU 2025-03-14T06:22:10.2704426Z + CPU_NUM_DEVICES=1 2025-03-14T06:22:10.2705082Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2025-03-14T06:22:10.2705724Z + '[' 0 '!=' 0 ']' 2025-03-14T06:22:10.2706270Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_pooling.py -v TestPoolingNNDeviceTypeXLA 2025-03-14T06:22:13.9026954Z 2025-03-14T06:22:13.9027448Z Running tests... 2025-03-14T06:22:13.9027872Z ---------------------------------------------------------------------- 2025-03-14T06:22:13.9028540Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_pooling 2025-03-14T06:22:13.9044668Z test_AdaptiveMaxPool1d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:22:13.9047719Z test_AdaptiveMaxPool2d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:13.9054709Z test_AdaptiveMaxPool3d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:13.9067573Z test_AdaptiveMaxPool_zero_batch_dim_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9076991Z test_AvgPool2d_empty_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9086305Z test_AvgPool3d_backward_after_cat_dim1_device_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:13.9094534Z test_FractionalMaxPool2d_zero_batch_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9102411Z test_FractionalMaxPool2d_zero_out_size_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9111931Z test_FractionalMaxPool2d_zero_samples_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9120408Z test_FractionalMaxPool3d_zero_batch_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9128535Z test_FractionalMaxPool3d_zero_out_size_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9138151Z test_FractionalMaxPool3d_zero_samples_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9144823Z test_MaxPool1d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:13.9151576Z test_MaxPool2d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:13.9158444Z test_MaxPool3d_indices_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:13.9170789Z test_MaxPool_zero_batch_dim_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9194406Z test_MaxUnpool_index_errors_case10_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9215960Z test_MaxUnpool_index_errors_case1_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9239637Z test_MaxUnpool_index_errors_case2_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9262377Z test_MaxUnpool_index_errors_case3_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9285588Z test_MaxUnpool_index_errors_case4_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9308239Z test_MaxUnpool_index_errors_case5_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9330481Z test_MaxUnpool_index_errors_case6_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9353708Z test_MaxUnpool_index_errors_case7_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9376559Z test_MaxUnpool_index_errors_case8_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9400000Z test_MaxUnpool_index_errors_case9_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:13.9414636Z test_MaxUnpool_zero_batch_dim_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9428752Z test_adaptive_avg_pool2d_output_size_one_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:13.9437322Z test_adaptive_avg_pool3d_output_size_one_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:20.0563707Z test_adaptive_pool_odd_size_xla (__main__.TestPoolingNNDeviceTypeXLA) ... ok (6.112s) 2025-03-14T06:22:20.0574269Z test_adaptive_pooling_backward_fails_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:20.0586222Z test_adaptive_pooling_empty_output_size_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:20.0597493Z test_adaptive_pooling_empty_output_size_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:24.2654366Z test_adaptive_pooling_max_nhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (4.205s) 2025-03-14T06:22:28.6092623Z test_adaptive_pooling_max_nhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (4.340s) 2025-03-14T06:22:28.6094452Z test_adaptive_pooling_no_suppot_input_xla_int16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:28.6096593Z test_adaptive_pooling_no_suppot_input_xla_int32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:28.6107817Z test_adaptive_pooling_no_suppot_input_xla_int64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:28.6121854Z test_adaptive_pooling_no_suppot_input_xla_int8 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:28.6137220Z test_adaptive_pooling_no_suppot_input_xla_uint8 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:28.6153797Z test_adaptive_pooling_zero_batch_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:28.6170361Z test_adaptive_pooling_zero_batch_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:28.6202170Z test_avg_pool2d_nhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:22:28.6232715Z test_avg_pool2d_nhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:22:28.6253906Z test_avg_pool2d_reduced_floating_xla_bfloat16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:22:28.6274874Z test_avg_pool2d_reduced_floating_xla_float16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:28.6288318Z test_fractional_max_pool2d_backward_fails_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:28.6311157Z test_fractional_max_pool2d_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:28.6335204Z test_fractional_max_pool3d_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:28.6353124Z test_fractional_max_pool_nan_inf_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:28.6372835Z test_max_pool1d_corner_cases_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:22:28.6391949Z test_max_pool1d_corner_cases_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:22:28.6413867Z test_max_pool1d_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:22:28.6435592Z test_max_pool1d_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:22:28.6454354Z test_max_pool2d_corner_cases_xla_int32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:22:28.6473127Z test_max_pool2d_corner_cases_xla_int64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:22:28.6491972Z test_max_pool2d_indices_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:22:28.6518174Z test_max_pool2d_nhwc_xla_bfloat16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:28.6544192Z test_max_pool2d_nhwc_xla_float16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:28.6570686Z test_max_pool2d_nhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:22:28.6596707Z test_max_pool2d_nhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:28.6612179Z test_max_pool2d_with_indices_backward_fails_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:28.6628830Z test_max_pool2d_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:22:28.6670025Z test_max_pool3d_ndhwc_xla_bfloat16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.004s) 2025-03-14T06:22:28.6711512Z test_max_pool3d_ndhwc_xla_float16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.004s) 2025-03-14T06:22:28.6752852Z test_max_pool3d_ndhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.004s) 2025-03-14T06:22:28.6794317Z test_max_pool3d_ndhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.004s) 2025-03-14T06:22:28.6822608Z test_max_pool_bfloat16_half_xla_bfloat16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cpu (0.003s) 2025-03-14T06:22:28.6850975Z test_max_pool_bfloat16_half_xla_float16 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.003s) 2025-03-14T06:22:28.6872812Z test_max_pool_nan_inf_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:31.4325973Z test_maxpool3d_non_square_backward_xla (__main__.TestPoolingNNDeviceTypeXLA) ... ok (2.745s) 2025-03-14T06:22:31.4334282Z test_maxpool_indices_no_batch_dim_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) 2025-03-14T06:22:32.9692866Z Check that indices with no batch dim is consistent with a single batch. ... ok (1.537s) 2025-03-14T06:22:32.9705605Z test_pool3d_large_size_int64_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:32.9717165Z test_pool3d_size_one_feature_dim_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:32.9727525Z test_pool_invalid_size_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:32.9761385Z test_pool_large_size_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:22:32.9774461Z test_pooling_bfloat16_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:32.9784406Z test_pooling_large_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:34.4599632Z test_pooling_max_nhwc_xla_float32 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (1.481s) 2025-03-14T06:22:36.0269211Z test_pooling_max_nhwc_xla_float64 (__main__.TestPoolingNNDeviceTypeXLA) ... ok (1.553s) 2025-03-14T06:22:36.0270359Z test_pooling_shape_xla (__main__.TestPoolingNNDeviceTypeXLA) 2025-03-14T06:22:36.0355750Z Test the output shape calculation for pooling functions ... ok (0.023s) 2025-03-14T06:22:36.0373462Z test_pooling_zero_stride_xla (__main__.TestPoolingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:36.0376888Z 2025-03-14T06:22:36.0377196Z ---------------------------------------------------------------------- 2025-03-14T06:22:36.0377869Z Ran 82 tests in 22.135s 2025-03-14T06:22:36.0378136Z 2025-03-14T06:22:36.0378308Z OK (skipped=73) 2025-03-14T06:22:36.0378545Z 2025-03-14T06:22:36.0378734Z Generating XML reports... 2025-03-14T06:22:36.0501296Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_pooling/TEST-TestPoolingNNDeviceTypeXLA-20250314062213.xml 2025-03-14T06:22:36.8610346Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2025-03-14T06:22:36.8611501Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py' -v TestEmbeddingNNDeviceTypeXLA 2025-03-14T06:22:36.8612649Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2025-03-14T06:22:36.8613458Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T06:22:36.8614178Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2025-03-14T06:22:36.8615434Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py' -v TestEmbeddingNNDeviceTypeXLA 2025-03-14T06:22:36.8616511Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2025-03-14T06:22:36.8617297Z ++ command -v nvidia-smi 2025-03-14T06:22:36.8617578Z + '[' -x '' ']' 2025-03-14T06:22:36.8617832Z + PJRT_DEVICE=CPU 2025-03-14T06:22:36.8618145Z + CPU_NUM_DEVICES=1 2025-03-14T06:22:36.8618735Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2025-03-14T06:22:36.8619384Z + '[' 0 '!=' 0 ']' 2025-03-14T06:22:36.8619949Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_embedding.py -v TestEmbeddingNNDeviceTypeXLA 2025-03-14T06:22:40.6589252Z 2025-03-14T06:22:40.6589799Z Running tests... 2025-03-14T06:22:40.6590202Z ---------------------------------------------------------------------- 2025-03-14T06:22:40.6590876Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_embedding 2025-03-14T06:22:41.5026999Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.844s) 2025-03-14T06:22:41.5056662Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.003s) 2025-03-14T06:22:42.0981812Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.592s) 2025-03-14T06:22:42.5769859Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.479s) 2025-03-14T06:22:42.8323920Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.255s) 2025-03-14T06:22:42.8343263Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:42.8425482Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:22:42.8504444Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int32_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:22:42.8586267Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:22:42.8604887Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:42.8684965Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:22:42.8763328Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:22:42.8843510Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:22:42.8862336Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:42.8941579Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:22:42.9018966Z test_EmbeddingBag_empty_per_sample_weights_and_offsets_xla_int64_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.008s) 2025-03-14T06:22:42.9039982Z test_EmbeddingBag_per_sample_weights_and_new_offsets_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:22:42.9053784Z test_EmbeddingBag_per_sample_weights_and_no_offsets_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:44.2210628Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (1.315s) 2025-03-14T06:22:44.2231131Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:45.2581117Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (1.034s) 2025-03-14T06:22:46.0979731Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.840s) 2025-03-14T06:22:46.3522268Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.254s) 2025-03-14T06:22:46.3542188Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:46.3640048Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.010s) 2025-03-14T06:22:46.3734296Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int32_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.009s) 2025-03-14T06:22:47.0168357Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.643s) 2025-03-14T06:22:47.0185729Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:47.6260214Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.607s) 2025-03-14T06:22:48.1048942Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.479s) 2025-03-14T06:22:48.1158289Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.011s) 2025-03-14T06:22:48.1177817Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:48.1275567Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.010s) 2025-03-14T06:22:48.1369259Z test_EmbeddingBag_per_sample_weights_and_offsets_xla_int64_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.009s) 2025-03-14T06:22:48.1386844Z test_EmbeddingBag_per_sample_weights_failures_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:22:48.1401764Z test_embedding_backward_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:48.1429296Z test_embedding_bag_1D_padding_idx_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:22:48.1456583Z test_embedding_bag_1D_padding_idx_xla_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.003s) 2025-03-14T06:22:48.1479829Z test_embedding_bag_2D_padding_idx_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:48.1502758Z test_embedding_bag_2D_padding_idx_xla_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:22:48.1511912Z test_embedding_bag_bfloat16_xla_int32_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:48.1520977Z test_embedding_bag_bfloat16_xla_int32_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:48.1530294Z test_embedding_bag_bfloat16_xla_int64_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:48.1539482Z test_embedding_bag_bfloat16_xla_int64_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:48.1554509Z test_embedding_bag_device_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:48.5128463Z test_embedding_bag_dimension_errors_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.357s) 2025-03-14T06:22:48.6092044Z test_embedding_bag_empty_input_xla_int32_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.096s) 2025-03-14T06:22:48.6135960Z test_embedding_bag_empty_input_xla_int32_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.004s) 2025-03-14T06:22:48.6178781Z test_embedding_bag_empty_input_xla_int64_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.004s) 2025-03-14T06:22:48.6220383Z test_embedding_bag_empty_input_xla_int64_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.004s) 2025-03-14T06:22:48.6229191Z test_embedding_bag_half_xla_int32_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:48.6237296Z test_embedding_bag_half_xla_int32_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:48.6245038Z test_embedding_bag_half_xla_int64_int32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:48.6253032Z test_embedding_bag_half_xla_int64_int64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:22:48.8722951Z test_embedding_bag_non_contiguous_weight_xla_int32_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.247s) 2025-03-14T06:22:48.8738468Z test_embedding_bag_non_contiguous_weight_xla_int32_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:49.1019440Z test_embedding_bag_non_contiguous_weight_xla_int32_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.228s) 2025-03-14T06:22:49.2789136Z test_embedding_bag_non_contiguous_weight_xla_int32_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.177s) 2025-03-14T06:22:49.4080531Z test_embedding_bag_non_contiguous_weight_xla_int32_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.129s) 2025-03-14T06:22:49.4096161Z test_embedding_bag_non_contiguous_weight_xla_int32_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:49.5367784Z test_embedding_bag_non_contiguous_weight_xla_int32_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.127s) 2025-03-14T06:22:49.6321973Z test_embedding_bag_non_contiguous_weight_xla_int32_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.095s) 2025-03-14T06:22:49.7622854Z test_embedding_bag_non_contiguous_weight_xla_int64_int32_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.130s) 2025-03-14T06:22:49.7638466Z test_embedding_bag_non_contiguous_weight_xla_int64_int32_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:49.8914853Z test_embedding_bag_non_contiguous_weight_xla_int64_int32_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.127s) 2025-03-14T06:22:49.9864558Z test_embedding_bag_non_contiguous_weight_xla_int64_int32_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.094s) 2025-03-14T06:22:50.1157578Z test_embedding_bag_non_contiguous_weight_xla_int64_int64_bfloat16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.129s) 2025-03-14T06:22:50.1173554Z test_embedding_bag_non_contiguous_weight_xla_int64_int64_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:50.2443756Z test_embedding_bag_non_contiguous_weight_xla_int64_int64_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.127s) 2025-03-14T06:22:50.3392453Z test_embedding_bag_non_contiguous_weight_xla_int64_int64_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.094s) 2025-03-14T06:22:50.3402971Z test_embedding_bag_out_of_bounds_idx_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:22:50.3435699Z test_embedding_bag_per_sample_weights_grad_bag_use_grad_False_per_sample_weights_use_grad_False_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:22:50.4722581Z test_embedding_bag_per_sample_weights_grad_bag_use_grad_False_per_sample_weights_use_grad_True_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.129s) 2025-03-14T06:22:50.4757285Z test_embedding_bag_per_sample_weights_grad_bag_use_grad_True_per_sample_weights_use_grad_False_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:22:50.4789641Z test_embedding_bag_per_sample_weights_grad_bag_use_grad_True_per_sample_weights_use_grad_True_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:22:50.4799560Z test_embedding_dense_grad_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:50.6979787Z test_embedding_max_norm_backward_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.218s) 2025-03-14T06:22:50.6989814Z test_embedding_max_norm_device_xla_float16 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:22:50.6999968Z test_embedding_max_norm_device_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:50.7010045Z test_embedding_max_norm_device_xla_float64 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:50.7022233Z test_embedding_max_norm_fwd_AD_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: forward AD doesn't work on xla (0.001s) 2025-03-14T06:22:51.4528942Z test_embedding_padding_idx_xla_float32 (__main__.TestEmbeddingNNDeviceTypeXLA) ... ok (0.750s) 2025-03-14T06:22:51.4538045Z test_embedding_scalar_weight_error_xla (__main__.TestEmbeddingNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:51.4538605Z 2025-03-14T06:22:51.4538783Z ---------------------------------------------------------------------- 2025-03-14T06:22:51.4539187Z Ran 83 tests in 10.795s 2025-03-14T06:22:51.4539369Z 2025-03-14T06:22:51.4539467Z OK (skipped=36) 2025-03-14T06:22:51.4539626Z 2025-03-14T06:22:51.4539737Z Generating XML reports... 2025-03-14T06:22:51.4618995Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_embedding/TEST-TestEmbeddingNNDeviceTypeXLA-20250314062240.xml 2025-03-14T06:22:52.2590904Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2025-03-14T06:22:52.2592082Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py' -v TestConvolutionNNDeviceTypeXLA 2025-03-14T06:22:52.2593266Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2025-03-14T06:22:52.2594093Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T06:22:52.2594826Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2025-03-14T06:22:52.2595876Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py' -v TestConvolutionNNDeviceTypeXLA 2025-03-14T06:22:52.2597157Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2025-03-14T06:22:52.2597875Z ++ command -v nvidia-smi 2025-03-14T06:22:52.2598153Z + '[' -x '' ']' 2025-03-14T06:22:52.2598398Z + PJRT_DEVICE=CPU 2025-03-14T06:22:52.2598713Z + CPU_NUM_DEVICES=1 2025-03-14T06:22:52.2599327Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2025-03-14T06:22:52.2599988Z + '[' 0 '!=' 0 ']' 2025-03-14T06:22:52.2600615Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py -v TestConvolutionNNDeviceTypeXLA 2025-03-14T06:22:56.4330080Z 2025-03-14T06:22:56.4330553Z Running tests... 2025-03-14T06:22:56.4330982Z ---------------------------------------------------------------------- 2025-03-14T06:22:56.4331632Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_convolution 2025-03-14T06:22:56.4358658Z test_Conv2d_backward_depthwise_xla_complex128 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:22:56.4366578Z test_Conv2d_backward_depthwise_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:22:56.4389165Z test_Conv2d_depthwise_naive_groups_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:56.4409779Z test_Conv2d_depthwise_naive_groups_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:22:56.4431501Z test_Conv2d_depthwise_naive_groups_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:22:56.4444074Z test_Conv2d_deterministic_cudnn_xla_complex128 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:22:56.4458500Z test_Conv2d_deterministic_cudnn_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:22:56.4471471Z test_Conv2d_deterministic_cudnn_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:22:56.4484928Z test_Conv2d_deterministic_cudnn_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:56.4499297Z test_Conv2d_deterministic_cudnn_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:56.4510057Z test_Conv2d_large_workspace_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:22:56.4521434Z test_Conv2d_large_workspace_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:56.4533157Z test_Conv2d_large_workspace_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:57.3318380Z test_Conv2d_naive_groups_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.878s) 2025-03-14T06:22:57.3332489Z test_Conv2d_size_1_kernel_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:22:57.3355831Z test_Conv3d_depthwise_naive_groups_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:22:57.3378773Z test_Conv3d_depthwise_naive_groups_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:22:57.3400767Z test_Conv3d_depthwise_naive_groups_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:22:57.3411267Z test_ConvTranspose2d_large_output_padding_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:22:57.3422475Z test_ConvTranspose2d_large_output_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:57.3434914Z test_ConvTranspose2d_size_1_kernel_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:57.3447699Z test_ConvTranspose3d_size_1_kernel_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:57.3457046Z test_contig_wrong_stride_cudnn_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:22:57.3471149Z test_conv1d_same_padding_backward_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:22:57.6021249Z test_conv1d_same_padding_backward_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/nn/test_convolution.py:1827: UserWarning: Using padding='same' with even kernel lengths and odd dilation may require a zero-padded copy of the input be created (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/native/Convolution.cpp:1037.) 2025-03-14T06:22:57.6024450Z z = F.conv1d(x, y, padding="same") 2025-03-14T06:22:58.1035067Z ok (0.756s) 2025-03-14T06:22:58.1051999Z test_conv1d_same_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:22:58.8263358Z test_conv1d_same_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.721s) 2025-03-14T06:22:58.8280144Z test_conv1d_valid_padding_backward_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:22:59.0828739Z test_conv1d_valid_padding_backward_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.254s) 2025-03-14T06:22:59.0839761Z test_conv1d_valid_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:22:59.2087268Z test_conv1d_valid_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.124s) 2025-03-14T06:22:59.7296102Z test_conv1d_vs_scipy_mode_same_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.521s) 2025-03-14T06:22:59.9714082Z test_conv1d_vs_scipy_mode_valid_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.241s) 2025-03-14T06:22:59.9729708Z test_conv1d_vs_scipy_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:22:59.9740092Z test_conv2d_no_grad_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:22:59.9756093Z test_conv2d_same_padding_backward_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:23:00.6890533Z test_conv2d_same_padding_backward_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.713s) 2025-03-14T06:23:00.6908699Z test_conv2d_same_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:23:01.2662375Z test_conv2d_same_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.575s) 2025-03-14T06:23:01.2675668Z test_conv2d_valid_padding_backward_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:23:01.5210197Z test_conv2d_valid_padding_backward_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.253s) 2025-03-14T06:23:01.5222920Z test_conv2d_valid_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:23:01.6463021Z test_conv2d_valid_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.123s) 2025-03-14T06:23:02.1699615Z test_conv2d_vs_scipy_mode_same_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.524s) 2025-03-14T06:23:02.4040966Z test_conv2d_vs_scipy_mode_valid_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.234s) 2025-03-14T06:23:02.4061740Z test_conv2d_vs_scipy_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:23:02.4069372Z test_conv3d_64bit_indexing_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:02.4078449Z test_conv3d_large_batch_1_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:02.4099128Z test_conv3d_same_padding_backward_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:23:02.4112994Z test_conv3d_same_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:23:02.9978216Z test_conv3d_same_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.586s) 2025-03-14T06:23:02.9991873Z test_conv3d_valid_padding_backward_xla_complex128 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:23:03.0006252Z test_conv3d_valid_padding_backward_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:23:03.0014290Z test_conv3d_valid_padding_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:23:03.1259107Z test_conv3d_valid_padding_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.124s) 2025-03-14T06:23:03.6609489Z test_conv3d_vs_scipy_mode_same_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.535s) 2025-03-14T06:23:03.8999669Z test_conv3d_vs_scipy_mode_valid_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.239s) 2025-03-14T06:23:03.9017614Z test_conv3d_vs_scipy_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:23:04.0365265Z test_convTranspose_empty_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.134s) 2025-03-14T06:23:04.0457801Z test_conv_backend_cuda_depthwise1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.0553349Z test_conv_backend_cuda_depthwise1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.0647517Z test_conv_backend_cuda_depthwise1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.0742590Z test_conv_backend_cuda_depthwise1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.0836249Z test_conv_backend_cuda_depthwise1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.0932194Z test_conv_backend_cuda_depthwise1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.1026635Z test_conv_backend_cuda_depthwise1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1121373Z test_conv_backend_cuda_depthwise1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1215172Z test_conv_backend_cuda_depthwise2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1310070Z test_conv_backend_cuda_depthwise2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1403370Z test_conv_backend_cuda_depthwise2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1498121Z test_conv_backend_cuda_depthwise2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1592607Z test_conv_backend_cuda_depthwise2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1686850Z test_conv_backend_cuda_depthwise2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1782133Z test_conv_backend_cuda_depthwise2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1877431Z test_conv_backend_cuda_depthwise2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.1973015Z test_conv_backend_cuda_depthwise3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.2068641Z test_conv_backend_cuda_depthwise3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.2165243Z test_conv_backend_cuda_depthwise3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.2259856Z test_conv_backend_cuda_depthwise3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.2356180Z test_conv_backend_cuda_depthwise3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.2450260Z test_conv_backend_cuda_depthwise3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.2545695Z test_conv_backend_cuda_depthwise3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.2643606Z test_conv_backend_cuda_depthwise3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.2738772Z test_conv_backend_cudnn1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.2834823Z test_conv_backend_cudnn1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.2931258Z test_conv_backend_cudnn1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.3025243Z test_conv_backend_cudnn1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.3120069Z test_conv_backend_cudnn1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.3214633Z test_conv_backend_cudnn1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.3311127Z test_conv_backend_cudnn1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.3405204Z test_conv_backend_cudnn1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.3501538Z test_conv_backend_cudnn1d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.3595890Z test_conv_backend_cudnn1d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.3691996Z test_conv_backend_cudnn1d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.3786631Z test_conv_backend_cudnn1d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.3882578Z test_conv_backend_cudnn1d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.3977246Z test_conv_backend_cudnn1d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.4072888Z test_conv_backend_cudnn1d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.4168805Z test_conv_backend_cudnn1d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.4263555Z test_conv_backend_cudnn2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.4357151Z test_conv_backend_cudnn2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.4452520Z test_conv_backend_cudnn2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.4548843Z test_conv_backend_cudnn2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.4643864Z test_conv_backend_cudnn2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.4740631Z test_conv_backend_cudnn2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.4834382Z test_conv_backend_cudnn2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.4930806Z test_conv_backend_cudnn2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.5025914Z test_conv_backend_cudnn2d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.5122511Z test_conv_backend_cudnn2d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.5218667Z test_conv_backend_cudnn2d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.5314996Z test_conv_backend_cudnn2d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.5408527Z test_conv_backend_cudnn2d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.5504949Z test_conv_backend_cudnn2d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:04.5600367Z test_conv_backend_cudnn2d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.5694955Z test_conv_backend_cudnn2d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.5788757Z test_conv_backend_cudnn3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.5884425Z test_conv_backend_cudnn3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.5980397Z test_conv_backend_cudnn3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.6072459Z test_conv_backend_cudnn3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.6167544Z test_conv_backend_cudnn3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.6259996Z test_conv_backend_cudnn3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.6353301Z test_conv_backend_cudnn3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.6445858Z test_conv_backend_cudnn3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:04.6547425Z test_conv_backend_empty_batch1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... /opt/conda/lib/python3.10/site-packages/torch/backends/mkldnn/__init__.py:78: UserWarning: TF32 acceleration on top of oneDNN is available for Intel GPUs. The current Torch version does not have Intel GPU Support. (Triggered internally at /var/lib/jenkins/workspace/aten/src/ATen/Context.cpp:148.) 2025-03-14T06:23:04.6549430Z torch._C._set_onednn_allow_tf32(_allow_tf32) 2025-03-14T06:23:04.6549877Z skip: onlyNativeDeviceTypes: doesn't run on xla (0.010s) 2025-03-14T06:23:04.6640874Z test_conv_backend_empty_batch1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.6732989Z test_conv_backend_empty_batch1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.6826654Z test_conv_backend_empty_batch1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.6921197Z test_conv_backend_empty_batch1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7014579Z test_conv_backend_empty_batch1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7109745Z test_conv_backend_empty_batch1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7204210Z test_conv_backend_empty_batch1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7298993Z test_conv_backend_empty_batch2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7393784Z test_conv_backend_empty_batch2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7487304Z test_conv_backend_empty_batch2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7579632Z test_conv_backend_empty_batch2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7672748Z test_conv_backend_empty_batch2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7765701Z test_conv_backend_empty_batch2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7856243Z test_conv_backend_empty_batch2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.7951133Z test_conv_backend_empty_batch2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8044202Z test_conv_backend_empty_batch3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8138670Z test_conv_backend_empty_batch3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8231158Z test_conv_backend_empty_batch3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8325428Z test_conv_backend_empty_batch3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8418544Z test_conv_backend_empty_batch3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8512320Z test_conv_backend_empty_batch3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8605381Z test_conv_backend_empty_batch3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8700560Z test_conv_backend_empty_batch3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8793137Z test_conv_backend_empty_batch_channel1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8886723Z test_conv_backend_empty_batch_channel1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.8981879Z test_conv_backend_empty_batch_channel1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9075566Z test_conv_backend_empty_batch_channel1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9171260Z test_conv_backend_empty_batch_channel1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9266672Z test_conv_backend_empty_batch_channel1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9359571Z test_conv_backend_empty_batch_channel1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9452897Z test_conv_backend_empty_batch_channel1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9549032Z test_conv_backend_empty_batch_channel2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.010s) 2025-03-14T06:23:04.9644185Z test_conv_backend_empty_batch_channel2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9739929Z test_conv_backend_empty_batch_channel2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9835492Z test_conv_backend_empty_batch_channel2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:04.9931592Z test_conv_backend_empty_batch_channel2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.010s) 2025-03-14T06:23:05.0026508Z test_conv_backend_empty_batch_channel2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0120896Z test_conv_backend_empty_batch_channel2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0214522Z test_conv_backend_empty_batch_channel2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0309636Z test_conv_backend_empty_batch_channel3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0403857Z test_conv_backend_empty_batch_channel3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0498243Z test_conv_backend_empty_batch_channel3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0591599Z test_conv_backend_empty_batch_channel3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0686210Z test_conv_backend_empty_batch_channel3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0780636Z test_conv_backend_empty_batch_channel3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0874283Z test_conv_backend_empty_batch_channel3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.0968909Z test_conv_backend_empty_batch_channel3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1064513Z test_conv_backend_empty_channel1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1160682Z test_conv_backend_empty_channel1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.010s) 2025-03-14T06:23:05.1253291Z test_conv_backend_empty_channel1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1348323Z test_conv_backend_empty_channel1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1441975Z test_conv_backend_empty_channel1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1536915Z test_conv_backend_empty_channel1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1631246Z test_conv_backend_empty_channel1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1725624Z test_conv_backend_empty_channel1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1818303Z test_conv_backend_empty_channel2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.1913290Z test_conv_backend_empty_channel2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2006713Z test_conv_backend_empty_channel2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2100502Z test_conv_backend_empty_channel2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2196346Z test_conv_backend_empty_channel2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2291043Z test_conv_backend_empty_channel2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2385205Z test_conv_backend_empty_channel2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2479224Z test_conv_backend_empty_channel2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2573440Z test_conv_backend_empty_channel3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2669837Z test_conv_backend_empty_channel3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.010s) 2025-03-14T06:23:05.2763474Z test_conv_backend_empty_channel3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.2860539Z test_conv_backend_empty_channel3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.010s) 2025-03-14T06:23:05.2957108Z test_conv_backend_empty_channel3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.010s) 2025-03-14T06:23:05.3050940Z test_conv_backend_empty_channel3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.3148317Z test_conv_backend_empty_channel3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.010s) 2025-03-14T06:23:05.3243368Z test_conv_backend_empty_channel3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:05.3337015Z test_conv_backend_miopen1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.3431788Z test_conv_backend_miopen1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.3527822Z test_conv_backend_miopen1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.3620489Z test_conv_backend_miopen1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.3714652Z test_conv_backend_miopen1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.3807732Z test_conv_backend_miopen1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.3903251Z test_conv_backend_miopen1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.3995855Z test_conv_backend_miopen1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4089202Z test_conv_backend_miopen1d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4184715Z test_conv_backend_miopen1d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4279472Z test_conv_backend_miopen1d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4372733Z test_conv_backend_miopen1d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4465141Z test_conv_backend_miopen1d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4559139Z test_conv_backend_miopen1d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4653326Z test_conv_backend_miopen1d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4749187Z test_conv_backend_miopen1d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:05.4842852Z test_conv_backend_miopen2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.4937042Z test_conv_backend_miopen2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5029646Z test_conv_backend_miopen2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5123439Z test_conv_backend_miopen2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5217527Z test_conv_backend_miopen2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5311548Z test_conv_backend_miopen2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5405049Z test_conv_backend_miopen2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5498291Z test_conv_backend_miopen2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5592380Z test_conv_backend_miopen2d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5687216Z test_conv_backend_miopen2d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5780269Z test_conv_backend_miopen2d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5873802Z test_conv_backend_miopen2d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.5967387Z test_conv_backend_miopen2d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.6063192Z test_conv_backend_miopen2d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:05.6158448Z test_conv_backend_miopen2d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.6251583Z test_conv_backend_miopen2d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.6348140Z test_conv_backend_miopen3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:05.6443920Z test_conv_backend_miopen3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.6537893Z test_conv_backend_miopen3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.6631383Z test_conv_backend_miopen3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.6725993Z test_conv_backend_miopen3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.6818832Z test_conv_backend_miopen3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.6913412Z test_conv_backend_miopen3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7006168Z test_conv_backend_miopen3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7102086Z test_conv_backend_miopen3d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7197933Z test_conv_backend_miopen3d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7293234Z test_conv_backend_miopen3d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7386758Z test_conv_backend_miopen3d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7480887Z test_conv_backend_miopen3d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7575778Z test_conv_backend_miopen3d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7671906Z test_conv_backend_miopen3d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.010s) 2025-03-14T06:23:05.7764755Z test_conv_backend_miopen3d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7856013Z test_conv_backend_miopen_depthwise1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.7950038Z test_conv_backend_miopen_depthwise1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8042869Z test_conv_backend_miopen_depthwise1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8136795Z test_conv_backend_miopen_depthwise1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8229409Z test_conv_backend_miopen_depthwise1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8322001Z test_conv_backend_miopen_depthwise1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8413210Z test_conv_backend_miopen_depthwise1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8506614Z test_conv_backend_miopen_depthwise1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8600404Z test_conv_backend_miopen_depthwise2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8694099Z test_conv_backend_miopen_depthwise2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8786179Z test_conv_backend_miopen_depthwise2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8878553Z test_conv_backend_miopen_depthwise2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.8969639Z test_conv_backend_miopen_depthwise2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9061404Z test_conv_backend_miopen_depthwise2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9154224Z test_conv_backend_miopen_depthwise2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9247282Z test_conv_backend_miopen_depthwise2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9340578Z test_conv_backend_miopen_depthwise3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9433070Z test_conv_backend_miopen_depthwise3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9526330Z test_conv_backend_miopen_depthwise3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9619399Z test_conv_backend_miopen_depthwise3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9713855Z test_conv_backend_miopen_depthwise3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9808057Z test_conv_backend_miopen_depthwise3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9901677Z test_conv_backend_miopen_depthwise3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:05.9994494Z test_conv_backend_miopen_depthwise3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:06.0089790Z test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0184141Z test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0277411Z test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0367703Z test_conv_backend_mkldnn1d_cpu_input_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0459232Z test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0552381Z test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0644929Z test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0736908Z test_conv_backend_mkldnn1d_cpu_input_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0830056Z test_conv_backend_mkldnn1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.0923785Z test_conv_backend_mkldnn1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1015565Z test_conv_backend_mkldnn1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1110204Z test_conv_backend_mkldnn1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1204343Z test_conv_backend_mkldnn1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1297896Z test_conv_backend_mkldnn1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1391047Z test_conv_backend_mkldnn1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1485387Z test_conv_backend_mkldnn1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1580701Z test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1675208Z test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1768004Z test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1861489Z test_conv_backend_mkldnn1d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.1955713Z test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2048858Z test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2143813Z test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2239451Z test_conv_backend_mkldnn1d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2333095Z test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2426373Z test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2520134Z test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2615834Z test_conv_backend_mkldnn2d_cpu_input_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2711046Z test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2804682Z test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2898194Z test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.2991445Z test_conv_backend_mkldnn2d_cpu_input_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3085093Z test_conv_backend_mkldnn2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3180093Z test_conv_backend_mkldnn2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3272691Z test_conv_backend_mkldnn2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3365789Z test_conv_backend_mkldnn2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3457509Z test_conv_backend_mkldnn2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3551672Z test_conv_backend_mkldnn2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3645036Z test_conv_backend_mkldnn2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3738673Z test_conv_backend_mkldnn2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3831521Z test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.3925535Z test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4017672Z test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4111979Z test_conv_backend_mkldnn2d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4205997Z test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4298870Z test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4392370Z test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4486144Z test_conv_backend_mkldnn2d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4577619Z test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4672598Z test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4765821Z test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4858796Z test_conv_backend_mkldnn3d_cpu_input_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.4953452Z test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5046589Z test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5142329Z test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.010s) 2025-03-14T06:23:06.5237033Z test_conv_backend_mkldnn3d_cpu_input_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5330558Z test_conv_backend_mkldnn3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5424098Z test_conv_backend_mkldnn3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5518939Z test_conv_backend_mkldnn3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5611778Z test_conv_backend_mkldnn3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5707933Z test_conv_backend_mkldnn3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.010s) 2025-03-14T06:23:06.5802120Z test_conv_backend_mkldnn3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5895475Z test_conv_backend_mkldnn3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.5988385Z test_conv_backend_mkldnn3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6081942Z test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6176902Z test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6270344Z test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6362473Z test_conv_backend_mkldnn3d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6455394Z test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6549113Z test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6642335Z test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6734829Z test_conv_backend_mkldnn3d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6828070Z test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.6921316Z test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7010837Z test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7103361Z test_conv_backend_mkldnn_empty_batch1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7197050Z test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7289272Z test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7380706Z test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7471951Z test_conv_backend_mkldnn_empty_batch1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7564711Z test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7657458Z test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7750153Z test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7842021Z test_conv_backend_mkldnn_empty_batch2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.7933320Z test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8025578Z test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8119042Z test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8211487Z test_conv_backend_mkldnn_empty_batch2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8304800Z test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8396686Z test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8488427Z test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8581337Z test_conv_backend_mkldnn_empty_batch3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8673177Z test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8765040Z test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8855194Z test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.8949253Z test_conv_backend_mkldnn_empty_batch3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9041848Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9135933Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9230614Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9324719Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9415784Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9510601Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9604675Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9700787Z test_conv_backend_mkldnn_empty_batch_channel1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9794487Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9888729Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:06.9986047Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.010s) 2025-03-14T06:23:07.0081041Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0174312Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0267852Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0360986Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0452982Z test_conv_backend_mkldnn_empty_batch_channel2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0547578Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0642825Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0737258Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0830716Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.0927568Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.010s) 2025-03-14T06:23:07.1020826Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1115482Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1209066Z test_conv_backend_mkldnn_empty_batch_channel3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1303545Z test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1396258Z test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1490647Z test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1584511Z test_conv_backend_mkldnn_empty_channel1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1679665Z test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1771816Z test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1864212Z test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.1957400Z test_conv_backend_mkldnn_empty_channel1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2050055Z test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2145083Z test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2240434Z test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2335307Z test_conv_backend_mkldnn_empty_channel2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2429444Z test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2523175Z test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2618594Z test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2713801Z test_conv_backend_mkldnn_empty_channel2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2808473Z test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2902795Z test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.2995418Z test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.3089553Z test_conv_backend_mkldnn_empty_channel3d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.3185592Z test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.010s) 2025-03-14T06:23:07.3281543Z test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.010s) 2025-03-14T06:23:07.3374430Z test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.3467595Z test_conv_backend_mkldnn_empty_channel3d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.3561018Z test_conv_backend_slow1d_dilated_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.3653329Z test_conv_backend_slow1d_dilated_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.3749115Z test_conv_backend_slow1d_dilated_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.3842854Z test_conv_backend_slow1d_dilated_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.3937422Z test_conv_backend_slow1d_dilated_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4030652Z test_conv_backend_slow1d_dilated_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4124907Z test_conv_backend_slow1d_dilated_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4219874Z test_conv_backend_slow1d_dilated_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4315393Z test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4409499Z test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4504938Z test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4598177Z test_conv_backend_slow1d_dilated_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4692049Z test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4787112Z test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4880441Z test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.4973928Z test_conv_backend_slow1d_dilated_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5066807Z test_conv_backend_slow1d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5161474Z test_conv_backend_slow1d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5254755Z test_conv_backend_slow1d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5348607Z test_conv_backend_slow1d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5441539Z test_conv_backend_slow1d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5533077Z test_conv_backend_slow1d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5625444Z test_conv_backend_slow1d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5720209Z test_conv_backend_slow1d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5811319Z test_conv_backend_slow1d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5905241Z test_conv_backend_slow1d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.5996911Z test_conv_backend_slow1d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6089394Z test_conv_backend_slow1d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6182275Z test_conv_backend_slow1d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6275634Z test_conv_backend_slow1d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6368133Z test_conv_backend_slow1d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6460499Z test_conv_backend_slow1d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6554221Z test_conv_backend_slow2d_dilated_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6646502Z test_conv_backend_slow2d_dilated_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6740113Z test_conv_backend_slow2d_dilated_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6832469Z test_conv_backend_slow2d_dilated_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.6926812Z test_conv_backend_slow2d_dilated_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7018614Z test_conv_backend_slow2d_dilated_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7112604Z test_conv_backend_slow2d_dilated_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7206736Z test_conv_backend_slow2d_dilated_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7301486Z test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7394764Z test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7487520Z test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7579918Z test_conv_backend_slow2d_dilated_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7672721Z test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7766663Z test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7858757Z test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.7951703Z test_conv_backend_slow2d_dilated_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8044733Z test_conv_backend_slow2d_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8136034Z test_conv_backend_slow2d_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8229361Z test_conv_backend_slow2d_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8322620Z test_conv_backend_slow2d_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8413023Z test_conv_backend_slow2d_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8506495Z test_conv_backend_slow2d_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8598501Z test_conv_backend_slow2d_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8691178Z test_conv_backend_slow2d_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8784684Z test_conv_backend_slow2d_transposed_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8875949Z test_conv_backend_slow2d_transposed_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.8969707Z test_conv_backend_slow2d_transposed_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.9060890Z test_conv_backend_slow2d_transposed_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.9153655Z test_conv_backend_slow2d_transposed_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.9247286Z test_conv_backend_slow2d_transposed_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.9341224Z test_conv_backend_slow2d_transposed_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.9433522Z test_conv_backend_slow2d_transposed_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:07.9527400Z test_conv_backend_slow3d_cpu_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.9619642Z test_conv_backend_slow3d_cpu_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.9714831Z test_conv_backend_slow3d_cpu_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.9808526Z test_conv_backend_slow3d_cpu_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.9903903Z test_conv_backend_slow3d_cpu_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:07.9996232Z test_conv_backend_slow3d_cpu_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:08.0090279Z test_conv_backend_slow3d_cpu_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:08.0184468Z test_conv_backend_slow3d_cpu_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.009s) 2025-03-14T06:23:08.0278587Z test_conv_backend_slow3d_cuda_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:08.0369811Z test_conv_backend_slow3d_cuda_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:08.0460904Z test_conv_backend_slow3d_cuda_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:08.0553073Z test_conv_backend_slow3d_cuda_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:08.0645091Z test_conv_backend_slow3d_cuda_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:08.0738316Z test_conv_backend_slow3d_cuda_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:08.0830140Z test_conv_backend_slow3d_cuda_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:08.0924340Z test_conv_backend_slow3d_cuda_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.009s) 2025-03-14T06:23:08.1017226Z test_conv_backend_slow3d_dilated_has_bias_False_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:08.1112054Z test_conv_backend_slow3d_dilated_has_bias_False_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:08.1206722Z test_conv_backend_slow3d_dilated_has_bias_False_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:08.1302006Z test_conv_backend_slow3d_dilated_has_bias_False_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:08.1395350Z test_conv_backend_slow3d_dilated_has_bias_True_strided_False_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:08.1490335Z test_conv_backend_slow3d_dilated_has_bias_True_strided_False_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:08.1583033Z test_conv_backend_slow3d_dilated_has_bias_True_strided_True_contiguous_False_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:08.1677021Z test_conv_backend_slow3d_dilated_has_bias_True_strided_True_contiguous_True_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.009s) 2025-03-14T06:23:08.1688946Z test_conv_contiguous_for_oneDNN_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:23:08.1700333Z test_conv_cudnn_mismatch_memory_format_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:08.1721614Z test_conv_cudnn_ndhwc_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:23:08.1742956Z test_conv_cudnn_ndhwc_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:23:08.1753916Z test_conv_cudnn_nhwc_support_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:08.1764901Z test_conv_cudnn_nhwc_support_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:08.1786203Z test_conv_cudnn_nhwc_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:23:08.1807380Z test_conv_cudnn_nhwc_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:23:08.1827894Z test_conv_cudnn_nhwc_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:23:08.2019644Z test_conv_double_backward_groups_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.019s) 2025-03-14T06:23:08.2150445Z test_conv_double_backward_no_bias_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.013s) 2025-03-14T06:23:08.2702052Z test_conv_double_backward_stride_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.055s) 2025-03-14T06:23:08.2763627Z test_conv_double_backward_strided_with_3D_input_and_weight_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.006s) 2025-03-14T06:23:08.2776674Z test_conv_double_backward_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:08.2791106Z test_conv_empty_channel_xla_complex64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:23:08.2819727Z test_conv_empty_channel_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... /opt/conda/lib/python3.10/site-packages/torch/nn/init.py:511: UserWarning: Initializing zero-element tensors is a no-op 2025-03-14T06:23:08.2821733Z warnings.warn("Initializing zero-element tensors is a no-op") 2025-03-14T06:23:08.7079305Z ok (0.428s) 2025-03-14T06:23:08.7088012Z test_conv_ic1_channels_last_for_oneDNN_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:23:08.7099272Z test_conv_large_batch_1_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:08.7109700Z test_conv_large_nosplit_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:08.7126902Z test_conv_large_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:23:09.0466128Z test_conv_noncontig_weights_and_bias_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.334s) 2025-03-14T06:23:09.0647787Z test_conv_noncontig_weights_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.018s) 2025-03-14T06:23:09.0698141Z test_conv_thnn_nhwc_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.005s) 2025-03-14T06:23:09.0746640Z test_conv_thnn_nhwc_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cpu (0.005s) 2025-03-14T06:23:09.0777589Z test_conv_transpose_with_output_size_and_no_batch_dim_ConvTranspose2d_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:23:09.0808366Z test_conv_transpose_with_output_size_and_no_batch_dim_ConvTranspose3d_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:23:09.0832840Z test_conv_transposed_large_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:23:09.0849458Z test_convert_conv2d_weight_memory_format_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:23:09.0862554Z test_convert_conv3d_weight_memory_format_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.001s) 2025-03-14T06:23:09.0887236Z test_cudnn_convolution_add_relu_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:23:09.0911215Z test_cudnn_convolution_add_relu_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:23:09.0933734Z test_cudnn_convolution_relu_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:23:09.0956051Z test_cudnn_convolution_relu_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:23:09.1609221Z test_group_convTranspose_empty_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.065s) 2025-03-14T06:23:09.1653702Z test_group_conv_empty_xla (__main__.TestConvolutionNNDeviceTypeXLA) ... ok (0.004s) 2025-03-14T06:23:09.1671842Z test_noncontig_conv_grad_xla_float16 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:23:09.1688598Z test_noncontig_conv_grad_xla_float32 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: Only runs on cuda (0.002s) 2025-03-14T06:23:09.1705101Z test_noncontig_conv_grad_xla_float64 (__main__.TestConvolutionNNDeviceTypeXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:23:09.1706064Z 2025-03-14T06:23:09.1706332Z ---------------------------------------------------------------------- 2025-03-14T06:23:09.1707012Z Ran 537 tests in 12.738s 2025-03-14T06:23:09.1707319Z 2025-03-14T06:23:09.1707478Z OK (skipped=508) 2025-03-14T06:23:09.1707735Z 2025-03-14T06:23:09.1707915Z Generating XML reports... 2025-03-14T06:23:09.2398259Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_convolution/TEST-TestConvolutionNNDeviceTypeXLA-20250314062256.xml 2025-03-14T06:23:10.1133005Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2025-03-14T06:23:10.1134367Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py' -v TestMultiheadAttentionNNDeviceTypeXLA 2025-03-14T06:23:10.1135709Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2025-03-14T06:23:10.1136619Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T06:23:10.1137425Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2025-03-14T06:23:10.1138843Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py' -v TestMultiheadAttentionNNDeviceTypeXLA 2025-03-14T06:23:10.1140106Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2025-03-14T06:23:10.1140974Z ++ command -v nvidia-smi 2025-03-14T06:23:10.1141258Z + '[' -x '' ']' 2025-03-14T06:23:10.1141491Z + PJRT_DEVICE=CPU 2025-03-14T06:23:10.1141806Z + CPU_NUM_DEVICES=1 2025-03-14T06:23:10.1142493Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2025-03-14T06:23:10.1143230Z + '[' 0 '!=' 0 ']' 2025-03-14T06:23:10.1152799Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/nn/test_multihead_attention.py -v TestMultiheadAttentionNNDeviceTypeXLA 2025-03-14T06:23:13.7386246Z 2025-03-14T06:23:13.7386654Z Running tests... 2025-03-14T06:23:13.7387095Z ---------------------------------------------------------------------- 2025-03-14T06:23:13.7387782Z Test results will be stored in test-reports/python-unittest/test.......test.nn.test_multihead_attention 2025-03-14T06:23:13.7402365Z test_multihead_attention_dtype_batch_first_xla_float16 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:23:13.7413641Z test_multihead_attention_dtype_batch_first_xla_float32 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: onlyCUDAAndPRIVATEUSE1: doesn't run on xla (0.001s) 2025-03-14T06:23:13.7425605Z test_multihead_attention_dtype_batch_first_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: onlyCUDAAndPRIVATEUSE1: doesn't run on xla (0.001s) 2025-03-14T06:23:13.7435338Z test_multihead_attention_dtype_xla_float16 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:23:13.7445499Z test_multihead_attention_dtype_xla_float32 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: onlyCUDAAndPRIVATEUSE1: doesn't run on xla (0.001s) 2025-03-14T06:23:13.7455513Z test_multihead_attention_dtype_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: onlyCUDAAndPRIVATEUSE1: doesn't run on xla (0.001s) 2025-03-14T06:23:13.7463893Z test_multihead_attn_fast_path_query_and_bias_have_different_dtypes_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:23:13.7514434Z test_multihead_attn_fast_path_small_test_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... ok (0.004s) 2025-03-14T06:23:13.7532496Z test_multihead_attn_in_proj_bias_none_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... ok (0.002s) 2025-03-14T06:23:13.7565619Z test_multihead_attn_in_proj_weight_none_xla_float64 (__main__.TestMultiheadAttentionNNDeviceTypeXLA) ... ok (0.003s) 2025-03-14T06:23:13.7570732Z test_multihead_self_attn_two_masks_fast_path_mock_xla (__main__.TestMultiheadAttentionNNDeviceTypeXLA) 2025-03-14T06:23:13.7575424Z Multihead self-attention should take fast path when both attention mask (mask type 0) ... skip: Fastpath only runs on CPU and CUDA and PrivateUse1. (0.001s) 2025-03-14T06:23:13.7592118Z test_multihead_self_attn_two_masks_fast_path_xla (__main__.TestMultiheadAttentionNNDeviceTypeXLA) 2025-03-14T06:23:14.1874788Z Multihead self-attention should give the same result on the fast path (BetterTransformer) as on the slow path ... ok (0.430s) 2025-03-14T06:23:14.1875445Z 2025-03-14T06:23:14.1875621Z ---------------------------------------------------------------------- 2025-03-14T06:23:14.1876042Z Ran 12 tests in 0.449s 2025-03-14T06:23:14.1876237Z 2025-03-14T06:23:14.1876339Z OK (skipped=8) 2025-03-14T06:23:14.1876499Z 2025-03-14T06:23:14.1876613Z Generating XML reports... 2025-03-14T06:23:14.1890379Z Generated XML report: test-reports/python-unittest/test.......test.nn.test_multihead_attention/TEST-TestMultiheadAttentionNNDeviceTypeXLA-20250314062313.xml 2025-03-14T06:23:14.9329075Z + run_dynamic /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2025-03-14T06:23:14.9330182Z + echo 'Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py' -v TestTypePromotionXLA 2025-03-14T06:23:14.9331494Z Running in DynamicShape mode: /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2025-03-14T06:23:14.9332350Z + XLA_EXPERIMENTAL=nonzero:masked_select:masked_scatter:nms 2025-03-14T06:23:14.9333044Z + run_test /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2025-03-14T06:23:14.9334005Z + echo 'Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py' -v TestTypePromotionXLA 2025-03-14T06:23:14.9335022Z Running in PjRt runtime: /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2025-03-14T06:23:14.9335697Z ++ command -v nvidia-smi 2025-03-14T06:23:14.9335975Z + '[' -x '' ']' 2025-03-14T06:23:14.9336220Z + PJRT_DEVICE=CPU 2025-03-14T06:23:14.9336471Z + CPU_NUM_DEVICES=1 2025-03-14T06:23:14.9337024Z + run_coverage /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2025-03-14T06:23:14.9337635Z + '[' 0 '!=' 0 ']' 2025-03-14T06:23:14.9338161Z + python3 /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py -v TestTypePromotionXLA 2025-03-14T06:23:18.5970282Z 2025-03-14T06:23:18.5970725Z Running tests... 2025-03-14T06:23:18.5971302Z ---------------------------------------------------------------------- 2025-03-14T06:23:18.5971957Z Test results will be stored in test-reports/python-unittest/test.......test.test_type_promotion 2025-03-14T06:23:18.7054361Z test_add_wrapped_xla (__main__.TestTypePromotionXLA) ... ok (0.108s) 2025-03-14T06:23:18.7954125Z test_alpha_mismatch_xla (__main__.TestTypePromotionXLA) ... ok (0.089s) 2025-03-14T06:23:18.7960590Z test_alternate_result_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:23:19.8820161Z test_bfloat16_xla (__main__.TestTypePromotionXLA) ... ok (1.085s) 2025-03-14T06:23:19.9704703Z test_booleans_xla (__main__.TestTypePromotionXLA) ... /var/lib/jenkins/workspace/xla/test/../../test/test_type_promotion.py:434: UserWarning: This overload of add is deprecated: 2025-03-14T06:23:19.9705814Z add(Tensor input, Number alpha, Tensor other, *, Tensor out = None) 2025-03-14T06:23:19.9706355Z Consider using one of the following signatures instead: 2025-03-14T06:23:19.9707276Z add(Tensor input, Tensor other, *, Number alpha = 1, Tensor out = None) (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/utils/python_arg_parser.cpp:1691.) 2025-03-14T06:23:19.9708223Z self.assertEqual(torch.add(torch.tensor(True, device=device), 2025-03-14T06:23:20.0141992Z ok (0.132s) 2025-03-14T06:23:20.0146845Z test_can_cast_xla (__main__.TestTypePromotionXLA) ... ok (0.001s) 2025-03-14T06:23:20.0160815Z test_cat_different_dtypes_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:20.0172028Z test_cat_out_different_dtypes_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:20.0196813Z test_clamp_type_promotion_xla_bool_bool_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0220483Z test_clamp_type_promotion_xla_bool_bool_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0244115Z test_clamp_type_promotion_xla_bool_bool_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0269319Z test_clamp_type_promotion_xla_bool_bool_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0293219Z test_clamp_type_promotion_xla_bool_float32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0317413Z test_clamp_type_promotion_xla_bool_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0340993Z test_clamp_type_promotion_xla_bool_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0364906Z test_clamp_type_promotion_xla_bool_float32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0388496Z test_clamp_type_promotion_xla_bool_float64_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0411667Z test_clamp_type_promotion_xla_bool_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0435844Z test_clamp_type_promotion_xla_bool_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0459119Z test_clamp_type_promotion_xla_bool_float64_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0483271Z test_clamp_type_promotion_xla_bool_int32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0507142Z test_clamp_type_promotion_xla_bool_int32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0529821Z test_clamp_type_promotion_xla_bool_int32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0553858Z test_clamp_type_promotion_xla_bool_int32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0576799Z test_clamp_type_promotion_xla_float32_bool_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0601024Z test_clamp_type_promotion_xla_float32_bool_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0624785Z test_clamp_type_promotion_xla_float32_bool_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0647908Z test_clamp_type_promotion_xla_float32_bool_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0671494Z test_clamp_type_promotion_xla_float32_float32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0694996Z test_clamp_type_promotion_xla_float32_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0719775Z test_clamp_type_promotion_xla_float32_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0743577Z test_clamp_type_promotion_xla_float32_float32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0767403Z test_clamp_type_promotion_xla_float32_float64_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0791381Z test_clamp_type_promotion_xla_float32_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0814072Z test_clamp_type_promotion_xla_float32_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0838261Z test_clamp_type_promotion_xla_float32_float64_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0861660Z test_clamp_type_promotion_xla_float32_int32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0886086Z test_clamp_type_promotion_xla_float32_int32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0909024Z test_clamp_type_promotion_xla_float32_int32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0932306Z test_clamp_type_promotion_xla_float32_int32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0956064Z test_clamp_type_promotion_xla_float64_bool_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.0979508Z test_clamp_type_promotion_xla_float64_bool_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1002999Z test_clamp_type_promotion_xla_float64_bool_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1026607Z test_clamp_type_promotion_xla_float64_bool_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1050202Z test_clamp_type_promotion_xla_float64_float32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1074466Z test_clamp_type_promotion_xla_float64_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1097917Z test_clamp_type_promotion_xla_float64_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1121674Z test_clamp_type_promotion_xla_float64_float32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1145440Z test_clamp_type_promotion_xla_float64_float64_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1169467Z test_clamp_type_promotion_xla_float64_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1193065Z test_clamp_type_promotion_xla_float64_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1216239Z test_clamp_type_promotion_xla_float64_float64_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1240223Z test_clamp_type_promotion_xla_float64_int32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1263832Z test_clamp_type_promotion_xla_float64_int32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1287893Z test_clamp_type_promotion_xla_float64_int32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1311292Z test_clamp_type_promotion_xla_float64_int32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1334605Z test_clamp_type_promotion_xla_int32_bool_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1358211Z test_clamp_type_promotion_xla_int32_bool_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1382393Z test_clamp_type_promotion_xla_int32_bool_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1406240Z test_clamp_type_promotion_xla_int32_bool_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1429601Z test_clamp_type_promotion_xla_int32_float32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1453427Z test_clamp_type_promotion_xla_int32_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1476797Z test_clamp_type_promotion_xla_int32_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1500215Z test_clamp_type_promotion_xla_int32_float32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1524207Z test_clamp_type_promotion_xla_int32_float64_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1547493Z test_clamp_type_promotion_xla_int32_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1571441Z test_clamp_type_promotion_xla_int32_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1594991Z test_clamp_type_promotion_xla_int32_float64_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1618295Z test_clamp_type_promotion_xla_int32_int32_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1642060Z test_clamp_type_promotion_xla_int32_int32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1666192Z test_clamp_type_promotion_xla_int32_int32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:20.1689733Z test_clamp_type_promotion_xla_int32_int32_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.002s) 2025-03-14T06:23:51.3388653Z test_comparison_ops_with_type_promotion_xla (__main__.TestTypePromotionXLA) ... ok (31.169s) 2025-03-14T06:23:51.3397160Z test_complex_assertraises_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.3412585Z test_complex_half_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.3437514Z test_complex_promotion_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.002s) 2025-03-14T06:23:51.3443902Z test_complex_scalar_mult_tensor_promotion_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:23:51.3456687Z test_computation_ignores_out_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.8037187Z test_create_bool_tensors_xla (__main__.TestTypePromotionXLA) ... ok (0.457s) 2025-03-14T06:23:51.8043778Z test_div_promotion_inplace_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:23:51.8056426Z test_div_promotion_out_xla_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.8068534Z test_div_promotion_out_xla_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.8080083Z test_div_promotion_out_xla_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.8091928Z test_div_promotion_out_xla_int16 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.8103645Z test_div_promotion_out_xla_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.8115372Z test_div_promotion_out_xla_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.8127326Z test_div_promotion_out_xla_int8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:51.8138929Z test_div_promotion_out_xla_uint8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:23:53.1959823Z test_div_promotion_xla_bool (__main__.TestTypePromotionXLA) ... ok (1.381s) 2025-03-14T06:23:54.5731607Z test_div_promotion_xla_int16 (__main__.TestTypePromotionXLA) ... ok (1.378s) 2025-03-14T06:23:55.9546915Z test_div_promotion_xla_int32 (__main__.TestTypePromotionXLA) ... ok (1.381s) 2025-03-14T06:23:57.3350551Z test_div_promotion_xla_int64 (__main__.TestTypePromotionXLA) ... ok (1.380s) 2025-03-14T06:23:58.7160896Z test_div_promotion_xla_int8 (__main__.TestTypePromotionXLA) ... ok (1.381s) 2025-03-14T06:24:00.0959716Z test_div_promotion_xla_uint8 (__main__.TestTypePromotionXLA) ... ok (1.380s) 2025-03-14T06:24:00.2370256Z test_float_promotion_xla (__main__.TestTypePromotionXLA) ... ok (0.141s) 2025-03-14T06:24:00.2404470Z test_from_issue_xla (__main__.TestTypePromotionXLA) ... ok (0.003s) 2025-03-14T06:24:00.2410952Z test_half_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:24:00.2631292Z test_indexing_fail_xla (__main__.TestTypePromotionXLA) ... ok (0.022s) 2025-03-14T06:24:00.2638805Z test_indexing_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:24:00.2651260Z test_inplace_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:24:00.3596044Z test_int_promotion_xla (__main__.TestTypePromotionXLA) ... ok (0.094s) 2025-03-14T06:24:00.3604262Z test_int_to_float_xla (__main__.TestTypePromotionXLA) ... ok (0.001s) 2025-03-14T06:24:00.3614383Z test_integer_addcdiv_deprecated_xla_int16 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:00.3623354Z test_integer_addcdiv_deprecated_xla_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:00.3632022Z test_integer_addcdiv_deprecated_xla_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:00.3640720Z test_integer_addcdiv_deprecated_xla_int8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:00.3649754Z test_integer_addcdiv_deprecated_xla_uint8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:01.7399856Z test_lt_with_type_promotion_xla (__main__.TestTypePromotionXLA) ... ok (1.374s) 2025-03-14T06:24:01.7409397Z test_many_promotions_xla (__main__.TestTypePromotionXLA) ... skip: skipped on XLA (0.001s) 2025-03-14T06:24:01.8528549Z test_mixed_type_backward_xla (__main__.TestTypePromotionXLA) ... ok (0.112s) 2025-03-14T06:24:01.8767283Z test_non_promoting_ops_xla (__main__.TestTypePromotionXLA) ... ok (0.024s) 2025-03-14T06:24:01.8781536Z test_numpy_array_binary_ufunc_promotion_xla_bool_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:24:01.8797287Z test_numpy_array_binary_ufunc_promotion_xla_bool_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.8811952Z test_numpy_array_binary_ufunc_promotion_xla_bool_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.8828013Z test_numpy_array_binary_ufunc_promotion_xla_bool_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.8843301Z test_numpy_array_binary_ufunc_promotion_xla_bool_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.8858960Z test_numpy_array_binary_ufunc_promotion_xla_bool_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.8873870Z test_numpy_array_binary_ufunc_promotion_xla_bool_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.8889585Z test_numpy_array_binary_ufunc_promotion_xla_bool_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.8905886Z test_numpy_array_binary_ufunc_promotion_xla_bool_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.8921309Z test_numpy_array_binary_ufunc_promotion_xla_bool_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.8937758Z test_numpy_array_binary_ufunc_promotion_xla_bool_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:24:01.8952772Z test_numpy_array_binary_ufunc_promotion_xla_complex128_bool (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.8967606Z test_numpy_array_binary_ufunc_promotion_xla_complex128_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.8983530Z test_numpy_array_binary_ufunc_promotion_xla_complex128_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.8998858Z test_numpy_array_binary_ufunc_promotion_xla_complex128_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9013231Z test_numpy_array_binary_ufunc_promotion_xla_complex128_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9029257Z test_numpy_array_binary_ufunc_promotion_xla_complex128_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9044475Z test_numpy_array_binary_ufunc_promotion_xla_complex128_int16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9059868Z test_numpy_array_binary_ufunc_promotion_xla_complex128_int32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9074652Z test_numpy_array_binary_ufunc_promotion_xla_complex128_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9089906Z test_numpy_array_binary_ufunc_promotion_xla_complex128_int8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9105950Z test_numpy_array_binary_ufunc_promotion_xla_complex128_uint8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9121302Z test_numpy_array_binary_ufunc_promotion_xla_complex64_bool (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9135808Z test_numpy_array_binary_ufunc_promotion_xla_complex64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9151749Z test_numpy_array_binary_ufunc_promotion_xla_complex64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9166520Z test_numpy_array_binary_ufunc_promotion_xla_complex64_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9182507Z test_numpy_array_binary_ufunc_promotion_xla_complex64_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9197615Z test_numpy_array_binary_ufunc_promotion_xla_complex64_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9212201Z test_numpy_array_binary_ufunc_promotion_xla_complex64_int16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9228409Z test_numpy_array_binary_ufunc_promotion_xla_complex64_int32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9243446Z test_numpy_array_binary_ufunc_promotion_xla_complex64_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9258645Z test_numpy_array_binary_ufunc_promotion_xla_complex64_int8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9273284Z test_numpy_array_binary_ufunc_promotion_xla_complex64_uint8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9288549Z test_numpy_array_binary_ufunc_promotion_xla_float16_bool (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9304481Z test_numpy_array_binary_ufunc_promotion_xla_float16_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9319595Z test_numpy_array_binary_ufunc_promotion_xla_float16_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9334299Z test_numpy_array_binary_ufunc_promotion_xla_float16_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9350170Z test_numpy_array_binary_ufunc_promotion_xla_float16_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9364666Z test_numpy_array_binary_ufunc_promotion_xla_float16_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9380173Z test_numpy_array_binary_ufunc_promotion_xla_float16_int16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9396364Z test_numpy_array_binary_ufunc_promotion_xla_float16_int32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9410840Z test_numpy_array_binary_ufunc_promotion_xla_float16_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9426768Z test_numpy_array_binary_ufunc_promotion_xla_float16_int8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9441913Z test_numpy_array_binary_ufunc_promotion_xla_float16_uint8 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9458045Z test_numpy_array_binary_ufunc_promotion_xla_float32_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9472028Z test_numpy_array_binary_ufunc_promotion_xla_float32_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9487411Z test_numpy_array_binary_ufunc_promotion_xla_float32_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9503411Z test_numpy_array_binary_ufunc_promotion_xla_float32_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9518613Z test_numpy_array_binary_ufunc_promotion_xla_float32_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9533449Z test_numpy_array_binary_ufunc_promotion_xla_float32_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9549599Z test_numpy_array_binary_ufunc_promotion_xla_float32_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9565047Z test_numpy_array_binary_ufunc_promotion_xla_float32_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9580641Z test_numpy_array_binary_ufunc_promotion_xla_float32_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9596161Z test_numpy_array_binary_ufunc_promotion_xla_float32_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9610647Z test_numpy_array_binary_ufunc_promotion_xla_float32_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9626825Z test_numpy_array_binary_ufunc_promotion_xla_float64_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9642066Z test_numpy_array_binary_ufunc_promotion_xla_float64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9657649Z test_numpy_array_binary_ufunc_promotion_xla_float64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9672139Z test_numpy_array_binary_ufunc_promotion_xla_float64_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9687605Z test_numpy_array_binary_ufunc_promotion_xla_float64_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9702972Z test_numpy_array_binary_ufunc_promotion_xla_float64_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9719045Z test_numpy_array_binary_ufunc_promotion_xla_float64_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9733741Z test_numpy_array_binary_ufunc_promotion_xla_float64_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9750078Z test_numpy_array_binary_ufunc_promotion_xla_float64_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9765626Z test_numpy_array_binary_ufunc_promotion_xla_float64_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9781187Z test_numpy_array_binary_ufunc_promotion_xla_float64_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.002s) 2025-03-14T06:24:01.9796796Z test_numpy_array_binary_ufunc_promotion_xla_int16_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9811596Z test_numpy_array_binary_ufunc_promotion_xla_int16_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9827663Z test_numpy_array_binary_ufunc_promotion_xla_int16_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:01.9842892Z test_numpy_array_binary_ufunc_promotion_xla_int16_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:01.9858477Z test_numpy_array_binary_ufunc_promotion_xla_int16_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9873394Z test_numpy_array_binary_ufunc_promotion_xla_int16_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9889031Z test_numpy_array_binary_ufunc_promotion_xla_int16_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9905272Z test_numpy_array_binary_ufunc_promotion_xla_int16_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9920617Z test_numpy_array_binary_ufunc_promotion_xla_int16_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9935363Z test_numpy_array_binary_ufunc_promotion_xla_int16_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9951590Z test_numpy_array_binary_ufunc_promotion_xla_int16_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9966561Z test_numpy_array_binary_ufunc_promotion_xla_int32_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:01.9982800Z test_numpy_array_binary_ufunc_promotion_xla_int32_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:01.9997920Z test_numpy_array_binary_ufunc_promotion_xla_int32_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:02.0012496Z test_numpy_array_binary_ufunc_promotion_xla_int32_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:02.0028572Z test_numpy_array_binary_ufunc_promotion_xla_int32_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0043857Z test_numpy_array_binary_ufunc_promotion_xla_int32_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0059498Z test_numpy_array_binary_ufunc_promotion_xla_int32_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0074408Z test_numpy_array_binary_ufunc_promotion_xla_int32_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0089877Z test_numpy_array_binary_ufunc_promotion_xla_int32_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0106043Z test_numpy_array_binary_ufunc_promotion_xla_int32_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0121450Z test_numpy_array_binary_ufunc_promotion_xla_int32_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0136083Z test_numpy_array_binary_ufunc_promotion_xla_int64_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0152178Z test_numpy_array_binary_ufunc_promotion_xla_int64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:02.0166767Z test_numpy_array_binary_ufunc_promotion_xla_int64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:02.0182701Z test_numpy_array_binary_ufunc_promotion_xla_int64_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:02.0197919Z test_numpy_array_binary_ufunc_promotion_xla_int64_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0212695Z test_numpy_array_binary_ufunc_promotion_xla_int64_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0228867Z test_numpy_array_binary_ufunc_promotion_xla_int64_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0244127Z test_numpy_array_binary_ufunc_promotion_xla_int64_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0259634Z test_numpy_array_binary_ufunc_promotion_xla_int64_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0274408Z test_numpy_array_binary_ufunc_promotion_xla_int64_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0289875Z test_numpy_array_binary_ufunc_promotion_xla_int64_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0306069Z test_numpy_array_binary_ufunc_promotion_xla_int8_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0321407Z test_numpy_array_binary_ufunc_promotion_xla_int8_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:02.0335802Z test_numpy_array_binary_ufunc_promotion_xla_int8_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:02.0351628Z test_numpy_array_binary_ufunc_promotion_xla_int8_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:02.0366420Z test_numpy_array_binary_ufunc_promotion_xla_int8_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0382659Z test_numpy_array_binary_ufunc_promotion_xla_int8_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0397881Z test_numpy_array_binary_ufunc_promotion_xla_int8_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0412504Z test_numpy_array_binary_ufunc_promotion_xla_int8_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0428562Z test_numpy_array_binary_ufunc_promotion_xla_int8_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0443794Z test_numpy_array_binary_ufunc_promotion_xla_int8_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0459224Z test_numpy_array_binary_ufunc_promotion_xla_int8_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0473932Z test_numpy_array_binary_ufunc_promotion_xla_uint8_bool (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0489582Z test_numpy_array_binary_ufunc_promotion_xla_uint8_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:02.0505294Z test_numpy_array_binary_ufunc_promotion_xla_uint8_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:02.0520400Z test_numpy_array_binary_ufunc_promotion_xla_uint8_float16 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.float16 (0.001s) 2025-03-14T06:24:02.0534870Z test_numpy_array_binary_ufunc_promotion_xla_uint8_float32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0550885Z test_numpy_array_binary_ufunc_promotion_xla_uint8_float64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0565834Z test_numpy_array_binary_ufunc_promotion_xla_uint8_int16 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0582002Z test_numpy_array_binary_ufunc_promotion_xla_uint8_int32 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0597298Z test_numpy_array_binary_ufunc_promotion_xla_uint8_int64 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0612058Z test_numpy_array_binary_ufunc_promotion_xla_uint8_int8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0628019Z test_numpy_array_binary_ufunc_promotion_xla_uint8_uint8 (__main__.TestTypePromotionXLA) ... skip: Only runs on cpu (0.001s) 2025-03-14T06:24:02.0649110Z test_promote_self_xla (__main__.TestTypePromotionXLA) ... ok (0.002s) 2025-03-14T06:24:02.0692097Z test_promote_types_xla (__main__.TestTypePromotionXLA) ... ok (0.004s) 2025-03-14T06:24:02.0739135Z test_result_type_tensor_vs_scalar_xla (__main__.TestTypePromotionXLA) ... ok (0.004s) 2025-03-14T06:24:02.0754331Z test_result_type_xla_bfloat16_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.1301245Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.056s) 2025-03-14T06:24:02.1314261Z test_result_type_xla_bfloat16_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.1359871Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.1370856Z test_result_type_xla_bfloat16_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.1375584Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.1393249Z test_result_type_xla_bfloat16_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.1394484Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.1408631Z test_result_type_xla_bfloat16_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.1413279Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.1431733Z test_result_type_xla_bfloat16_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.1929090Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.051s) 2025-03-14T06:24:02.1946947Z test_result_type_xla_bfloat16_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.2446728Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.051s) 2025-03-14T06:24:02.2456222Z test_result_type_xla_bfloat16_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.2953508Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.051s) 2025-03-14T06:24:02.2963904Z test_result_type_xla_bfloat16_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.3452303Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.050s) 2025-03-14T06:24:02.3468091Z test_result_type_xla_bfloat16_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.3962983Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.051s) 2025-03-14T06:24:02.3973671Z test_result_type_xla_bfloat16_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.4469721Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.051s) 2025-03-14T06:24:02.4483805Z test_result_type_xla_bfloat16_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.4967864Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.050s) 2025-03-14T06:24:02.4985613Z test_result_type_xla_bool_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5029045Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.5042051Z test_result_type_xla_bool_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5075054Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.5088823Z test_result_type_xla_bool_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5093757Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5112404Z test_result_type_xla_bool_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5113193Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5126654Z test_result_type_xla_bool_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5130953Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.5147364Z test_result_type_xla_bool_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5189078Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.5206051Z test_result_type_xla_bool_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5246263Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.5261183Z test_result_type_xla_bool_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5296802Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.5315438Z test_result_type_xla_bool_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5354388Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.5364024Z test_result_type_xla_bool_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5402509Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.5412682Z test_result_type_xla_bool_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5451234Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.5467324Z test_result_type_xla_bool_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5506657Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.5518897Z test_result_type_xla_complex128_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5520013Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5533743Z test_result_type_xla_complex128_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5538126Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5557047Z test_result_type_xla_complex128_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5557868Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5570731Z test_result_type_xla_complex128_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5574973Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5594272Z test_result_type_xla_complex128_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5595081Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5607432Z test_result_type_xla_complex128_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5611751Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5631288Z test_result_type_xla_complex128_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5632090Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5646480Z test_result_type_xla_complex128_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5648655Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5667009Z test_result_type_xla_complex128_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5667810Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5686084Z test_result_type_xla_complex128_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5686869Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5704829Z test_result_type_xla_complex128_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5705629Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5722781Z test_result_type_xla_complex128_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5723591Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.5735854Z test_result_type_xla_complex64_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5740158Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5759770Z test_result_type_xla_complex64_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5760551Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5772729Z test_result_type_xla_complex64_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5777123Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5796552Z test_result_type_xla_complex64_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5797478Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5809281Z test_result_type_xla_complex64_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5813447Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5832770Z test_result_type_xla_complex64_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5833569Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5846541Z test_result_type_xla_complex64_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5849924Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5867661Z test_result_type_xla_complex64_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5868558Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5886250Z test_result_type_xla_complex64_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5887163Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5905923Z test_result_type_xla_complex64_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5906711Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5924807Z test_result_type_xla_complex64_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5925609Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5942580Z test_result_type_xla_complex64_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5943377Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.5960983Z test_result_type_xla_float16_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5961778Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.5974106Z test_result_type_xla_float16_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5978438Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.5996269Z test_result_type_xla_float16_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.5997019Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6010171Z test_result_type_xla_float16_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6014482Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6035020Z test_result_type_xla_float16_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6035805Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6047170Z test_result_type_xla_float16_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6051429Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6067756Z test_result_type_xla_float16_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6069927Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6087079Z test_result_type_xla_float16_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6088215Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6108233Z test_result_type_xla_float16_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6109015Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6125841Z test_result_type_xla_float16_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6126603Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6143037Z test_result_type_xla_float16_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6143817Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6161267Z test_result_type_xla_float16_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6162047Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6174509Z test_result_type_xla_float32_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6241350Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.007s) 2025-03-14T06:24:02.6249483Z test_result_type_xla_float32_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6292008Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6310763Z test_result_type_xla_float32_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6311559Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.6326859Z test_result_type_xla_float32_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6328367Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.6347959Z test_result_type_xla_float32_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6348752Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6364776Z test_result_type_xla_float32_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6407031Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6424991Z test_result_type_xla_float32_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6468072Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6486381Z test_result_type_xla_float32_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6526946Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6544128Z test_result_type_xla_float32_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6587609Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6601871Z test_result_type_xla_float32_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6645007Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6653121Z test_result_type_xla_float32_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6703148Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6715558Z test_result_type_xla_float32_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6760848Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6770375Z test_result_type_xla_float64_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6819384Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6835656Z test_result_type_xla_float64_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6874177Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.6887176Z test_result_type_xla_float64_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6891602Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.6910882Z test_result_type_xla_float64_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6911682Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.6926679Z test_result_type_xla_float64_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6928136Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.6947491Z test_result_type_xla_float64_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.6995636Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7005040Z test_result_type_xla_float64_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7050112Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7067626Z test_result_type_xla_float64_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7113048Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7124826Z test_result_type_xla_float64_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7167284Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7183300Z test_result_type_xla_float64_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7229082Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7243117Z test_result_type_xla_float64_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7286451Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7302492Z test_result_type_xla_float64_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7345779Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7360012Z test_result_type_xla_int16_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7403870Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7413352Z test_result_type_xla_int16_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7451298Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.7467425Z test_result_type_xla_int16_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7469664Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.7487039Z test_result_type_xla_int16_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7488340Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.7507653Z test_result_type_xla_int16_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7508437Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.7525624Z test_result_type_xla_int16_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7566805Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7583276Z test_result_type_xla_int16_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7626619Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7640993Z test_result_type_xla_int16_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7675626Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.7689096Z test_result_type_xla_int16_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7728187Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.7746854Z test_result_type_xla_int16_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7785042Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.7799417Z test_result_type_xla_int16_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7838037Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.7847380Z test_result_type_xla_int16_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7887118Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.7905537Z test_result_type_xla_int32_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7947429Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.7961903Z test_result_type_xla_int32_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.7998151Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8007294Z test_result_type_xla_int32_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8011672Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.8030773Z test_result_type_xla_int32_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8031560Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.8046140Z test_result_type_xla_int32_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8048245Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.8066957Z test_result_type_xla_int32_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8109730Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.8123727Z test_result_type_xla_int32_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8166236Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.8176520Z test_result_type_xla_int32_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8216190Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8234897Z test_result_type_xla_int32_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8268035Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8286316Z test_result_type_xla_int32_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8325120Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8334247Z test_result_type_xla_int32_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8374025Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8392181Z test_result_type_xla_int32_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8431581Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8445257Z test_result_type_xla_int64_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8487148Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.8505266Z test_result_type_xla_int64_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8542394Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8557248Z test_result_type_xla_int64_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8558197Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.8569885Z test_result_type_xla_int64_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8574183Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.8593321Z test_result_type_xla_int64_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8594217Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.8606396Z test_result_type_xla_int64_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8649563Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.8667439Z test_result_type_xla_int64_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8710479Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.8723912Z test_result_type_xla_int64_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8761940Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8771684Z test_result_type_xla_int64_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8811942Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8829647Z test_result_type_xla_int64_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8867037Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8877166Z test_result_type_xla_int64_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8919882Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8929849Z test_result_type_xla_int64_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.8968721Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.8986790Z test_result_type_xla_int8_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9030068Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.9044429Z test_result_type_xla_int8_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9077649Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9090838Z test_result_type_xla_int8_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9095478Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.9114530Z test_result_type_xla_int8_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9115309Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.9128359Z test_result_type_xla_int8_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9132209Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.9150784Z test_result_type_xla_int8_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9194805Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.9205280Z test_result_type_xla_int8_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9248147Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.9265728Z test_result_type_xla_int8_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9303816Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9318213Z test_result_type_xla_int8_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9356156Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9366821Z test_result_type_xla_int8_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9406260Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9422870Z test_result_type_xla_int8_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9456665Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9470025Z test_result_type_xla_int8_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9512240Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9525505Z test_result_type_xla_uint8_bfloat16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9567243Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.9584555Z test_result_type_xla_uint8_bool (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9617047Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9634246Z test_result_type_xla_uint8_complex128 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9635076Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:02.9648107Z test_result_type_xla_uint8_complex64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9652387Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.complex64 (0.002s) 2025-03-14T06:24:02.9667268Z test_result_type_xla_uint8_float16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9670594Z Test result_type for tensor vs tensor and scalar vs scalar. ... skip: XLA does not support dtype torch.float16 (0.002s) 2025-03-14T06:24:02.9686754Z test_result_type_xla_uint8_float32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9727012Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9744296Z test_result_type_xla_uint8_float64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9787233Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.006s) 2025-03-14T06:24:02.9801286Z test_result_type_xla_uint8_int16 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9839015Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9849580Z test_result_type_xla_uint8_int32 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9888905Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9906413Z test_result_type_xla_uint8_int64 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9944969Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:02.9956861Z test_result_type_xla_uint8_int8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:02.9997593Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:03.0007982Z test_result_type_xla_uint8_uint8 (__main__.TestTypePromotionXLA) 2025-03-14T06:24:03.0046985Z Test result_type for tensor vs tensor and scalar vs scalar. ... ok (0.005s) 2025-03-14T06:24:03.0051790Z test_sparse_add_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0060513Z test_sparse_div_promotion_xla_bool (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0069552Z test_sparse_div_promotion_xla_int16 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0078292Z test_sparse_div_promotion_xla_int32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0087179Z test_sparse_div_promotion_xla_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0095857Z test_sparse_div_promotion_xla_uint8 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0102771Z test_sparse_div_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0109359Z test_sparse_mul_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0115954Z test_sparse_sub_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.0126038Z test_ternary_out_promotion_xla (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1070496Z test_transpose_xla (__main__.TestTypePromotionXLA) ... ok (0.094s) 2025-03-14T06:24:03.1083000Z test_unary_op_out_casting_xla_complex128_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.002s) 2025-03-14T06:24:03.1097784Z test_unary_op_out_casting_xla_complex128_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:03.1112084Z test_unary_op_out_casting_xla_complex128_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:03.1126581Z test_unary_op_out_casting_xla_complex128_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:03.1140858Z test_unary_op_out_casting_xla_complex128_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:03.1155229Z test_unary_op_out_casting_xla_complex64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:03.1170175Z test_unary_op_out_casting_xla_complex64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:03.1184365Z test_unary_op_out_casting_xla_complex64_float32 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:03.1198635Z test_unary_op_out_casting_xla_complex64_float64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:03.1213068Z test_unary_op_out_casting_xla_complex64_int64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:03.1227397Z test_unary_op_out_casting_xla_float32_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:03.1241722Z test_unary_op_out_casting_xla_float32_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:03.1256265Z test_unary_op_out_casting_xla_float32_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1270879Z test_unary_op_out_casting_xla_float32_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1285353Z test_unary_op_out_casting_xla_float32_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1299774Z test_unary_op_out_casting_xla_float64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:03.1314052Z test_unary_op_out_casting_xla_float64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:03.1328657Z test_unary_op_out_casting_xla_float64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1343035Z test_unary_op_out_casting_xla_float64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1357376Z test_unary_op_out_casting_xla_float64_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1372164Z test_unary_op_out_casting_xla_int64_complex128 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex128 (0.001s) 2025-03-14T06:24:03.1386550Z test_unary_op_out_casting_xla_int64_complex64 (__main__.TestTypePromotionXLA) ... skip: XLA does not support dtype torch.complex64 (0.001s) 2025-03-14T06:24:03.1401186Z test_unary_op_out_casting_xla_int64_float32 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1415732Z test_unary_op_out_casting_xla_int64_float64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1430038Z test_unary_op_out_casting_xla_int64_int64 (__main__.TestTypePromotionXLA) ... skip: onlyNativeDeviceTypes: doesn't run on xla (0.001s) 2025-03-14T06:24:03.1441875Z test_unsigned_xla (__main__.TestTypePromotionXLA) ... ok (0.001s) 2025-03-14T06:24:03.1442399Z 2025-03-14T06:24:03.1442625Z ---------------------------------------------------------------------- 2025-03-14T06:24:03.1443129Z Ran 416 tests in 44.547s 2025-03-14T06:24:03.1443362Z 2025-03-14T06:24:03.1443475Z OK (skipped=309) 2025-03-14T06:24:03.1443623Z 2025-03-14T06:24:03.1443750Z Generating XML reports... 2025-03-14T06:24:03.1769922Z Generated XML report: test-reports/python-unittest/test.......test.test_type_promotion/TEST-TestTypePromotionXLA-20250314062318.xml 2025-03-14T06:24:03.9632693Z + [[ 1 != \1 ]] 2025-03-14T06:24:03.9633047Z + popd 2025-03-14T06:24:03.9633301Z /var/lib/jenkins/workspace 2025-03-14T06:24:03.9633847Z + run_torch_xla_cpp_tests /var/lib/jenkins/workspace /var/lib/jenkins/workspace/xla 0 2025-03-14T06:24:03.9634612Z + PYTORCH_DIR=/var/lib/jenkins/workspace 2025-03-14T06:24:03.9635059Z + XLA_DIR=/var/lib/jenkins/workspace/xla 2025-03-14T06:24:03.9635392Z + USE_COVERAGE=0 2025-03-14T06:24:03.9635675Z + pushd /var/lib/jenkins/workspace/xla 2025-03-14T06:24:03.9636100Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2025-03-14T06:24:03.9636534Z + echo 'Running C++ Tests on PJRT' 2025-03-14T06:24:03.9636859Z Running C++ Tests on PJRT 2025-03-14T06:24:03.9637144Z + EXTRA_ARGS= 2025-03-14T06:24:03.9637389Z + '[' 0 '!=' 0 ']' 2025-03-14T06:24:03.9637645Z + '[' '!' -z '' ']' 2025-03-14T06:24:03.9637894Z + '[' 0 '!=' 0 ']' 2025-03-14T06:24:03.9638560Z ++ command -v nvidia-smi 2025-03-14T06:24:03.9641328Z + '[' -x '' ']' 2025-03-14T06:24:03.9641563Z + PJRT_DEVICE=CPU 2025-03-14T06:24:03.9641845Z + test/cpp/run_tests.sh -L 2025-03-14T06:24:03.9658217Z /bin/bash: /opt/conda/lib/libtinfo.so.6: no version information available (required by /bin/bash) 2025-03-14T06:24:03.9671001Z +++ dirname test/cpp/run_tests.sh 2025-03-14T06:24:03.9679687Z ++ cd test/cpp 2025-03-14T06:24:03.9679952Z ++ pwd -P 2025-03-14T06:24:03.9681856Z + RUNDIR=/var/lib/jenkins/workspace/xla/test/cpp 2025-03-14T06:24:03.9682231Z + BUILDTYPE=opt 2025-03-14T06:24:03.9682471Z + VERB= 2025-03-14T06:24:03.9682687Z + FILTER= 2025-03-14T06:24:03.9682937Z + LOGFILE=/tmp/pytorch_cpp_test.log 2025-03-14T06:24:03.9683301Z + XLA_EXPERIMENTAL=nonzero:masked_select:nms 2025-03-14T06:24:03.9683647Z + BAZEL_REMOTE_CACHE=0 2025-03-14T06:24:03.9683911Z + BAZEL_VERB=test 2025-03-14T06:24:03.9684170Z + CONTINUE_ON_ERROR=false 2025-03-14T06:24:03.9684456Z + [[ false == \1 ]] 2025-03-14T06:24:03.9684795Z + '[' '' == 1 ']' 2025-03-14T06:24:03.9685050Z + getopts VLDKBF:X:RC OPTION 2025-03-14T06:24:03.9685341Z + case $OPTION in 2025-03-14T06:24:03.9685587Z + LOGFILE= 2025-03-14T06:24:03.9685816Z + getopts VLDKBF:X:RC OPTION 2025-03-14T06:24:03.9686103Z + shift 1 2025-03-14T06:24:03.9686339Z + export XLA_EXPERIMENTAL 2025-03-14T06:24:03.9686615Z + EXTRA_FLAGS= 2025-03-14T06:24:03.9686850Z + [[ '' == \1 ]] 2025-03-14T06:24:03.9687095Z + [[ -n '' ]] 2025-03-14T06:24:03.9687333Z + '[' '!' -z '' ']' 2025-03-14T06:24:03.9687574Z + [[ 0 == \1 ]] 2025-03-14T06:24:03.9687807Z + [[ 0 == \1 ]] 2025-03-14T06:24:03.9688054Z + [[ test == \c\o\v\e\r\a\g\e ]] 2025-03-14T06:24:03.9688353Z + test_names=("all") 2025-03-14T06:24:03.9688783Z + [[ '' == \c\p\p\_\t\e\s\t\s\1 ]] 2025-03-14T06:24:03.9689097Z + [[ '' == \c\p\p\_\t\e\s\t\s\2 ]] 2025-03-14T06:24:03.9689421Z + for name in "${test_names[@]}" 2025-03-14T06:24:03.9689722Z + echo 'Running all cpp test...' 2025-03-14T06:24:03.9690028Z Running all cpp test... 2025-03-14T06:24:03.9690354Z + '[' '' '!=' '' ']' 2025-03-14T06:24:03.9690756Z + bazel test //torch_xla/csrc/runtime:all //test/cpp:all --test_timeout 1200 2025-03-14T06:24:03.9954544Z INFO: Options provided by the client: 2025-03-14T06:24:03.9955305Z Inherited 'common' options: --isatty=1 --terminal_columns=0 2025-03-14T06:24:03.9956049Z INFO: Reading rc options for 'test' from /var/lib/jenkins/workspace/xla/.bazelrc: 2025-03-14T06:24:03.9956665Z Inherited 'common' options: --experimental_repo_remote_exec 2025-03-14T06:24:03.9957337Z INFO: Reading rc options for 'test' from /var/lib/jenkins/workspace/xla/.bazelrc: 2025-03-14T06:24:03.9961172Z Inherited 'build' options: --announce_rc --nocheck_visibility --enable_platform_specific_config --experimental_cc_shared_library --define=no_aws_support=true --define=no_hdfs_support=true --define=no_hdfs_support=true --define=no_kafka_support=true --define=no_ignite_support=true --define=grpc_no_ares=true -c opt --config=short_logs --action_env=CC=gcc --action_env=CXX=g++ --spawn_strategy=standalone --incompatible_strict_action_env --noremote_upload_local_results --java_runtime_version=remotejdk_11 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --define framework_shared_object=false --define tsl_protobuf_header_only=false --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --define=with_xla_support=true --noincompatible_remove_legacy_whole_archive --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility 2025-03-14T06:24:03.9965205Z INFO: Reading rc options for 'test' from /var/lib/jenkins/workspace/xla/.bazelrc: 2025-03-14T06:24:03.9968536Z 'test' options: --test_env=TPU_NUM_DEVICES --test_env=GPU_NUM_DEVICES --test_env=CPU_NUM_DEVICES --test_env=XRT_LOCAL_WORKER --test_env=XRT_TPU_CONFIG --test_env=XRT_DEVICE_MAP --test_env=XRT_WORKERS --test_env=XRT_MESH_SERVICE_ADDRESS --test_env=XRT_SHARD_WORLD_SIZE --test_env=XRT_MULTI_PROCESSING_DEVICE --test_env=XRT_HOST_ORDINAL --test_env=XRT_SHARD_ORDINAL --test_env=XRT_START_LOCAL_SERVER --test_env=TPUVM_MODE --test_env=PJRT_DEVICE --test_env=PJRT_TPU_MAX_INFLIGHT_COMPUTATIONS --test_env=PJRT_CPU_ASYNC_CLIENT --test_env=PJRT_GPU_ASYNC_CLIENT --test_env=TPU_LIBRARY_PATH --test_env=PJRT_DIST_SERVICE_ADDR --test_env=PJRT_LOCAL_PROCESS_RANK --test_env=XLA_EXPERIMENTAL --test_env=LD_LIBRARY_PATH --notrim_test_configuration 2025-03-14T06:24:03.9971984Z INFO: Found applicable config definition build:short_logs in file /var/lib/jenkins/workspace/xla/.bazelrc: --output_filter=DONT_MATCH_ANYTHING 2025-03-14T06:24:03.9975917Z INFO: Found applicable config definition build:linux in file /var/lib/jenkins/workspace/xla/.bazelrc: --config=posix --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --define=build_with_onednn_v2=true --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable 2025-03-14T06:24:03.9979590Z INFO: Found applicable config definition build:posix in file /var/lib/jenkins/workspace/xla/.bazelrc: --copt=-Wno-sign-compare --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 2025-03-14T06:24:03.9981263Z INFO: Found applicable config definition build:dynamic_kernels in file /var/lib/jenkins/workspace/xla/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS 2025-03-14T06:24:04.8100831Z Loading: 2025-03-14T06:24:04.9626413Z 2025-03-14T06:24:04.9627678Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:154:14: 2025-03-14T06:24:04.9628726Z HERMETIC_PYTHON_VERSION variable was not set correctly, using default version. 2025-03-14T06:24:04.9629452Z Python 3.10 will be used. 2025-03-14T06:24:04.9629899Z To select Python version, either set HERMETIC_PYTHON_VERSION env variable in 2025-03-14T06:24:04.9630364Z your shell: 2025-03-14T06:24:04.9630696Z export HERMETIC_PYTHON_VERSION=3.12 2025-03-14T06:24:04.9631156Z OR pass it as an argument to bazel command directly or inside your .bazelrc 2025-03-14T06:24:04.9631606Z file: 2025-03-14T06:24:04.9631869Z --repo_env=HERMETIC_PYTHON_VERSION=3.12 2025-03-14T06:24:04.9632269Z Loading: 2025-03-14T06:24:04.9639568Z Fetching repository @python_version_repo; starting 2025-03-14T06:24:04.9640032Z 2025-03-14T06:24:04.9640227Z  2025-03-14T06:24:04.9641088Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/py/python_repo.bzl:87:10: 2025-03-14T06:24:04.9641864Z ============================= 2025-03-14T06:24:04.9642177Z Hermetic Python configuration: 2025-03-14T06:24:04.9642487Z Version: "3.10" 2025-03-14T06:24:04.9642732Z Kind: "" 2025-03-14T06:24:04.9643026Z Interpreter: "default" (provided by rules_python) 2025-03-14T06:24:04.9643563Z Requirements_lock label: "@python_version_repo//:requirements_lock_3_10.txt" 2025-03-14T06:24:04.9644045Z ===================================== 2025-03-14T06:24:04.9644393Z Loading: 2025-03-14T06:24:04.9644962Z Fetching repository @python_version_repo; starting 2025-03-14T06:24:05.0143760Z 2025-03-14T06:24:05.0144452Z  2025-03-14T06:24:05.0145341Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/repo.bzl:132:14: 2025-03-14T06:24:05.0146376Z Warning: skipping import of repository 'llvm-raw' because it already exists. 2025-03-14T06:24:05.0146916Z Loading: 2025-03-14T06:24:05.0392474Z 2025-03-14T06:24:05.0393707Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/tsl/third_party/repo.bzl:132:14: 2025-03-14T06:24:05.0394880Z Warning: skipping import of repository 'pybind11_bazel' because it already exists. 2025-03-14T06:24:05.0395487Z Loading: 2025-03-14T06:24:05.0395643Z 2025-03-14T06:24:05.0396307Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/tsl/third_party/repo.bzl:132:14: 2025-03-14T06:24:05.0397318Z Warning: skipping import of repository 'pybind11' because it already exists. 2025-03-14T06:24:05.0397857Z Loading: 2025-03-14T06:24:05.0398006Z 2025-03-14T06:24:05.0398649Z DEBUG: /home/jenkins/.cache/bazel/_bazel_jenkins/9e766795b7b58aa74777805232118ec5/external/xla/third_party/repo.bzl:132:14: 2025-03-14T06:24:05.0399643Z Warning: skipping import of repository 'jsoncpp_git' because it already exists. 2025-03-14T06:24:05.0400175Z Loading: 2025-03-14T06:24:05.1424176Z 2025-03-14T06:24:05.1425222Z Loading: 2025-03-14T06:24:05.1425674Z 2025-03-14T06:24:05.1426017Z Loading: 0 packages loaded 2025-03-14T06:24:05.1781145Z 2025-03-14T06:24:05.1782236Z INFO: Build options --cxxopt, --test_env, --test_timeout, and 1 more have changed, discarding analysis cache. 2025-03-14T06:24:05.1783018Z Analyzing: 45 targets (2 packages loaded) 2025-03-14T06:24:05.2852257Z 2025-03-14T06:24:05.2853192Z Analyzing: 45 targets (2 packages loaded, 0 targets configured) 2025-03-14T06:24:05.5048827Z 2025-03-14T06:24:05.7512303Z Analyzing: 45 targets (151 packages loaded, 3589 targets configured) 2025-03-14T06:24:05.7513312Z currently loading: @xla//xla/mlir_hlo ... (15 packages) 2025-03-14T06:24:05.7514351Z Fetching repository @com_google_googletest; starting 2025-03-14T06:24:05.7515117Z Fetching repository @llvm-project; starting 2025-03-14T06:24:05.7516014Z Fetching ...ternal/com_google_googletest; Extracting release-1.12.1.tar.gz 2025-03-14T06:24:05.7516749Z 2025-03-14T06:24:05.7516970Z  2025-03-14T06:24:05.7517351Z  2025-03-14T06:24:05.7517719Z  2025-03-14T06:24:05.7518085Z  2025-03-14T06:24:05.7518960Z Analyzing: 45 targets (190 packages loaded, 15465 targets configured) 2025-03-14T06:24:05.7519888Z currently loading: @xla//xla/mlir_hlo ... (6 packages) 2025-03-14T06:24:05.7520604Z Fetching repository @llvm-project; starting 2025-03-14T06:24:05.9535453Z 2025-03-14T06:24:05.9536132Z  2025-03-14T06:24:05.9536458Z  2025-03-14T06:24:05.9536964Z Analyzing: 45 targets (200 packages loaded, 31224 targets configured) 2025-03-14T06:24:05.9537529Z currently loading: @xla//xla/mlir_hlo ... (6 packages) 2025-03-14T06:24:06.2113599Z 2025-03-14T06:24:06.2114274Z  2025-03-14T06:24:06.2114841Z Analyzing: 45 targets (224 packages loaded, 40627 targets configured) 2025-03-14T06:24:06.5008128Z 2025-03-14T06:24:06.5009303Z INFO: Analyzed 45 targets (224 packages loaded, 40939 targets configured). 2025-03-14T06:24:06.5009939Z  checking cached actions 2025-03-14T06:24:06.5118442Z 2025-03-14T06:24:06.5119297Z INFO: Found 28 targets and 17 test targets... 2025-03-14T06:24:06.5119807Z  checking cached actions 2025-03-14T06:24:06.5499116Z 2025-03-14T06:24:06.5500555Z [0 / 4] [Prepa] BazelWorkspaceStatusAction stable-status.txt 2025-03-14T06:24:06.7516720Z 2025-03-14T06:24:06.7517802Z [566 / 20,338] 27 actions, 26 running 2025-03-14T06:24:06.7518481Z Compiling googletest/src/gtest-typed-test.cc; 0s local 2025-03-14T06:24:06.7519212Z Compiling absl/profiling/internal/exponential_biased.cc; 0s local 2025-03-14T06:24:06.7519929Z Compiling src/google/protobuf/stubs/time.cc; 0s local 2025-03-14T06:24:06.7520586Z Compiling absl/time/internal/cctz/src/civil_time_detail.cc; 0s local 2025-03-14T06:24:06.7521487Z Compiling absl/time/internal/cctz/src/time_zone_fixed.cc; 0s local 2025-03-14T06:24:06.7522359Z Compiling tsl/profiler/lib/nvtx_utils_stub.cc; 0s local 2025-03-14T06:24:06.7522896Z Compiling trees.c; 0s local 2025-03-14T06:24:06.7523550Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local ... 2025-03-14T06:24:06.9520044Z 2025-03-14T06:24:06.9520863Z  2025-03-14T06:24:06.9521373Z  2025-03-14T06:24:06.9521813Z  2025-03-14T06:24:06.9522302Z  2025-03-14T06:24:06.9522774Z  2025-03-14T06:24:06.9523203Z  2025-03-14T06:24:06.9523719Z  2025-03-14T06:24:06.9524286Z  2025-03-14T06:24:06.9525069Z [785 / 20,624] 33 actions, 32 running 2025-03-14T06:24:06.9525927Z Compiling googletest/src/gtest-typed-test.cc; 0s local 2025-03-14T06:24:06.9526932Z Compiling absl/profiling/internal/exponential_biased.cc; 0s local 2025-03-14T06:24:06.9527912Z Compiling src/google/protobuf/stubs/time.cc; 0s local 2025-03-14T06:24:06.9528865Z Compiling absl/time/internal/cctz/src/civil_time_detail.cc; 0s local 2025-03-14T06:24:06.9529932Z Compiling absl/time/internal/cctz/src/time_zone_fixed.cc; 0s local 2025-03-14T06:24:06.9530653Z Compiling trees.c; 0s local 2025-03-14T06:24:06.9531544Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local 2025-03-14T06:24:06.9532858Z Compiling src/google/protobuf/util/internal/json_escaping.cc; 0s local ... 2025-03-14T06:24:07.1532129Z 2025-03-14T06:24:07.1532969Z  2025-03-14T06:24:07.1533438Z  2025-03-14T06:24:07.1533855Z  2025-03-14T06:24:07.1534275Z  2025-03-14T06:24:07.1534669Z  2025-03-14T06:24:07.1535083Z  2025-03-14T06:24:07.1535486Z  2025-03-14T06:24:07.1535892Z  2025-03-14T06:24:07.1536709Z [939 / 20,643] 43 actions, 41 running 2025-03-14T06:24:07.1537524Z Compiling googletest/src/gtest-typed-test.cc; 0s local 2025-03-14T06:24:07.1538375Z Compiling src/google/protobuf/stubs/time.cc; 0s local 2025-03-14T06:24:07.1539346Z Compiling absl/time/internal/cctz/src/civil_time_detail.cc; 0s local 2025-03-14T06:24:07.1540570Z Compiling absl/time/internal/cctz/src/time_zone_fixed.cc; 0s local 2025-03-14T06:24:07.1541639Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local 2025-03-14T06:24:07.1542846Z Compiling src/google/protobuf/util/internal/json_escaping.cc; 0s local 2025-03-14T06:24:07.1543854Z Compiling src/compiler/ruby_generator.cc [for tool]; 0s local 2025-03-14T06:24:07.1544687Z Compiling src/farmhash.cc; 0s local ... 2025-03-14T06:24:07.3580868Z 2025-03-14T06:24:07.3581706Z  2025-03-14T06:24:07.3582178Z  2025-03-14T06:24:07.3582562Z  2025-03-14T06:24:07.3582972Z  2025-03-14T06:24:07.3583443Z  2025-03-14T06:24:07.3583845Z  2025-03-14T06:24:07.3584243Z  2025-03-14T06:24:07.3584658Z  2025-03-14T06:24:07.3585303Z [1,237 / 20,643] 44 actions, 42 running 2025-03-14T06:24:07.3586097Z Compiling googletest/src/gtest-typed-test.cc; 0s local 2025-03-14T06:24:07.3586959Z Compiling src/google/protobuf/stubs/time.cc; 0s local 2025-03-14T06:24:07.3587886Z Compiling absl/time/internal/cctz/src/civil_time_detail.cc; 0s local 2025-03-14T06:24:07.3588967Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local 2025-03-14T06:24:07.3590059Z Compiling src/google/protobuf/util/internal/json_escaping.cc; 0s local 2025-03-14T06:24:07.3593251Z Compiling src/compiler/ruby_generator.cc [for tool]; 0s local 2025-03-14T06:24:07.3594153Z Compiling src/farmhash.cc; 0s local 2025-03-14T06:24:07.3594819Z Compiling xla/tsl/util/stats_calculator.cc; 0s local ... 2025-03-14T06:24:07.5551373Z 2025-03-14T06:24:07.5552202Z  2025-03-14T06:24:07.5552712Z  2025-03-14T06:24:07.5553096Z  2025-03-14T06:24:07.5553493Z  2025-03-14T06:24:07.5554015Z  2025-03-14T06:24:07.5554389Z  2025-03-14T06:24:07.5554801Z  2025-03-14T06:24:07.5555174Z  2025-03-14T06:24:07.5555767Z [1,526 / 20,643] 42 actions, 40 running 2025-03-14T06:24:07.5556604Z Compiling googletest/src/gtest-typed-test.cc; 0s local 2025-03-14T06:24:07.5557534Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 0s local 2025-03-14T06:24:07.5558549Z Compiling src/compiler/ruby_generator.cc [for tool]; 0s local 2025-03-14T06:24:07.5559456Z Compiling xla/tsl/util/stats_calculator.cc; 0s local 2025-03-14T06:24:07.5560183Z Compiling absl/numeric/int128.cc; 0s local 2025-03-14T06:24:07.5561063Z Compiling absl/time/internal/cctz/src/time_zone_if.cc; 0s local 2025-03-14T06:24:07.5562101Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 0s local 2025-03-14T06:24:07.5563046Z Compiling src/cpu/cpu_rnn_list.cpp; 0s local ... 2025-03-14T06:24:07.7563394Z 2025-03-14T06:24:07.7564249Z  2025-03-14T06:24:07.7564894Z  2025-03-14T06:24:07.7565489Z  2025-03-14T06:24:07.7565891Z  2025-03-14T06:24:07.7566295Z  2025-03-14T06:24:07.7566725Z  2025-03-14T06:24:07.7567129Z  2025-03-14T06:24:07.7567514Z  2025-03-14T06:24:07.7568101Z [2,009 / 20,647] 44 actions, 42 running 2025-03-14T06:24:07.7568897Z Compiling googletest/src/gtest-typed-test.cc; 1s local 2025-03-14T06:24:07.7569857Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 1s local 2025-03-14T06:24:07.7570847Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T06:24:07.7571713Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2025-03-14T06:24:07.7572667Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 1s local 2025-03-14T06:24:07.7573610Z Compiling src/cpu/cpu_rnn_list.cpp; 0s local 2025-03-14T06:24:07.7576271Z Compiling src/cpu/cpu_shuffle_list.cpp; 0s local 2025-03-14T06:24:07.7577047Z Compiling src/lib_json/json_reader.cpp; 0s local ... 2025-03-14T06:24:07.9570026Z 2025-03-14T06:24:07.9570892Z  2025-03-14T06:24:07.9571429Z  2025-03-14T06:24:07.9572182Z  2025-03-14T06:24:07.9572652Z  2025-03-14T06:24:07.9573283Z  2025-03-14T06:24:07.9573789Z  2025-03-14T06:24:07.9574284Z  2025-03-14T06:24:07.9574761Z  2025-03-14T06:24:07.9575514Z [2,382 / 20,647] 44 actions, 41 running 2025-03-14T06:24:07.9576404Z Compiling googletest/src/gtest-typed-test.cc; 1s local 2025-03-14T06:24:07.9577495Z Compiling absl/time/internal/cctz/src/time_zone_format.cc; 1s local 2025-03-14T06:24:07.9578739Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T06:24:07.9579607Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2025-03-14T06:24:07.9580544Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 1s local 2025-03-14T06:24:07.9581525Z Compiling src/cpu/cpu_rnn_list.cpp; 1s local 2025-03-14T06:24:07.9582271Z Compiling src/cpu/cpu_shuffle_list.cpp; 1s local 2025-03-14T06:24:07.9583080Z Compiling src/lib_json/json_reader.cpp; 1s local ... 2025-03-14T06:24:08.1584551Z 2025-03-14T06:24:08.1585426Z  2025-03-14T06:24:08.1585967Z  2025-03-14T06:24:08.1586419Z  2025-03-14T06:24:08.1586865Z  2025-03-14T06:24:08.1587316Z  2025-03-14T06:24:08.1587760Z  2025-03-14T06:24:08.1588189Z  2025-03-14T06:24:08.1588656Z  2025-03-14T06:24:08.1589247Z [2,860 / 20,647] 43 actions, 42 running 2025-03-14T06:24:08.1590377Z Compiling googletest/src/gtest-typed-test.cc; 1s local 2025-03-14T06:24:08.1591400Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T06:24:08.1592386Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2025-03-14T06:24:08.1593394Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 1s local 2025-03-14T06:24:08.1594404Z Compiling src/cpu/cpu_rnn_list.cpp; 1s local 2025-03-14T06:24:08.1595142Z Compiling src/cpu/cpu_shuffle_list.cpp; 1s local 2025-03-14T06:24:08.1595984Z Compiling src/lib_json/json_reader.cpp; 1s local 2025-03-14T06:24:08.1596762Z Compiling src/google/protobuf/type.pb.cc; 1s local ... 2025-03-14T06:24:08.3596125Z 2025-03-14T06:24:08.3597013Z  2025-03-14T06:24:08.3597514Z  2025-03-14T06:24:08.3597938Z  2025-03-14T06:24:08.3598357Z  2025-03-14T06:24:08.3598780Z  2025-03-14T06:24:08.3599201Z  2025-03-14T06:24:08.3599622Z  2025-03-14T06:24:08.3600040Z  2025-03-14T06:24:08.3600670Z [3,358 / 20,647] 42 actions, 41 running 2025-03-14T06:24:08.3601559Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T06:24:08.3602474Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2025-03-14T06:24:08.3603593Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 1s local 2025-03-14T06:24:08.3604705Z Compiling src/cpu/cpu_rnn_list.cpp; 1s local 2025-03-14T06:24:08.3605432Z Compiling src/cpu/cpu_shuffle_list.cpp; 1s local 2025-03-14T06:24:08.3606178Z Compiling src/lib_json/json_reader.cpp; 1s local 2025-03-14T06:24:08.3606955Z Compiling src/google/protobuf/type.pb.cc; 1s local 2025-03-14T06:24:08.3607720Z Compiling src/lib_json/json_value.cpp; 1s local ... 2025-03-14T06:24:08.5601626Z 2025-03-14T06:24:08.5602480Z  2025-03-14T06:24:08.5602975Z  2025-03-14T06:24:08.5603452Z  2025-03-14T06:24:08.5603870Z  2025-03-14T06:24:08.5604290Z  2025-03-14T06:24:08.5604784Z  2025-03-14T06:24:08.5605188Z  2025-03-14T06:24:08.5605592Z  2025-03-14T06:24:08.5606178Z [3,840 / 20,647] 47 actions, 45 running 2025-03-14T06:24:08.5607067Z Compiling src/compiler/ruby_generator.cc [for tool]; 1s local 2025-03-14T06:24:08.5607930Z Compiling xla/tsl/util/stats_calculator.cc; 1s local 2025-03-14T06:24:08.5609232Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 1s local 2025-03-14T06:24:08.5610240Z Compiling src/cpu/cpu_rnn_list.cpp; 1s local 2025-03-14T06:24:08.5610989Z Compiling src/cpu/cpu_shuffle_list.cpp; 1s local 2025-03-14T06:24:08.5611903Z Compiling src/lib_json/json_reader.cpp; 1s local 2025-03-14T06:24:08.5612705Z Compiling src/google/protobuf/type.pb.cc; 1s local 2025-03-14T06:24:08.5613531Z Compiling src/lib_json/json_value.cpp; 1s local ... 2025-03-14T06:24:08.7615140Z 2025-03-14T06:24:08.7616017Z  2025-03-14T06:24:08.7616487Z  2025-03-14T06:24:08.7616907Z  2025-03-14T06:24:08.7617334Z  2025-03-14T06:24:08.7617746Z  2025-03-14T06:24:08.7618135Z  2025-03-14T06:24:08.7618550Z  2025-03-14T06:24:08.7618935Z  2025-03-14T06:24:08.7619522Z [4,307 / 20,647] 46 actions, 45 running 2025-03-14T06:24:08.7620354Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T06:24:08.7621239Z Compiling xla/tsl/util/stats_calculator.cc; 2s local 2025-03-14T06:24:08.7622268Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2025-03-14T06:24:08.7623238Z Compiling src/cpu/cpu_rnn_list.cpp; 1s local 2025-03-14T06:24:08.7623967Z Compiling src/cpu/cpu_shuffle_list.cpp; 1s local 2025-03-14T06:24:08.7624695Z Compiling src/lib_json/json_reader.cpp; 1s local 2025-03-14T06:24:08.7625484Z Compiling src/google/protobuf/type.pb.cc; 1s local 2025-03-14T06:24:08.7626279Z Compiling src/lib_json/json_value.cpp; 1s local ... 2025-03-14T06:24:09.0218340Z 2025-03-14T06:24:09.0219220Z  2025-03-14T06:24:09.0219707Z  2025-03-14T06:24:09.0220408Z  2025-03-14T06:24:09.0220878Z  2025-03-14T06:24:09.0221287Z  2025-03-14T06:24:09.0221703Z  2025-03-14T06:24:09.0222119Z  2025-03-14T06:24:09.0222511Z  2025-03-14T06:24:09.0223111Z [4,740 / 20,647] 45 actions, 43 running 2025-03-14T06:24:09.0223901Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T06:24:09.0224995Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2025-03-14T06:24:09.0225984Z Compiling src/cpu/cpu_rnn_list.cpp; 2s local 2025-03-14T06:24:09.0226746Z Compiling src/cpu/cpu_shuffle_list.cpp; 2s local 2025-03-14T06:24:09.0227520Z Compiling src/lib_json/json_reader.cpp; 2s local 2025-03-14T06:24:09.0228298Z Compiling src/google/protobuf/type.pb.cc; 2s local 2025-03-14T06:24:09.0229056Z Compiling src/lib_json/json_value.cpp; 2s local 2025-03-14T06:24:09.0230031Z Compiling llvm/lib/Support/ELFAttributeParser.cpp [for tool]; 2s local ... 2025-03-14T06:24:09.2204380Z 2025-03-14T06:24:09.2205364Z  2025-03-14T06:24:09.2205891Z  2025-03-14T06:24:09.2206302Z  2025-03-14T06:24:09.2206692Z  2025-03-14T06:24:09.2207098Z  2025-03-14T06:24:09.2207484Z  2025-03-14T06:24:09.2207880Z  2025-03-14T06:24:09.2208323Z  2025-03-14T06:24:09.2208930Z [5,168 / 20,647] 46 actions, 45 running 2025-03-14T06:24:09.2209737Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T06:24:09.2210740Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2025-03-14T06:24:09.2211665Z Compiling src/cpu/cpu_rnn_list.cpp; 2s local 2025-03-14T06:24:09.2212359Z Compiling src/cpu/cpu_shuffle_list.cpp; 2s local 2025-03-14T06:24:09.2213056Z Compiling src/lib_json/json_reader.cpp; 2s local 2025-03-14T06:24:09.2213791Z Compiling src/google/protobuf/type.pb.cc; 2s local 2025-03-14T06:24:09.2214495Z Compiling src/lib_json/json_value.cpp; 2s local 2025-03-14T06:24:09.2215428Z Compiling llvm/lib/Support/ELFAttributeParser.cpp [for tool]; 2s local ... 2025-03-14T06:24:09.4247168Z 2025-03-14T06:24:09.4248061Z  2025-03-14T06:24:09.4248562Z  2025-03-14T06:24:09.4248985Z  2025-03-14T06:24:09.4249464Z  2025-03-14T06:24:09.4250148Z  2025-03-14T06:24:09.4250560Z  2025-03-14T06:24:09.4250986Z  2025-03-14T06:24:09.4251396Z  2025-03-14T06:24:09.4252011Z [5,659 / 20,647] 46 actions, 45 running 2025-03-14T06:24:09.4252906Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T06:24:09.4254215Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2025-03-14T06:24:09.4255195Z Compiling src/cpu/cpu_rnn_list.cpp; 2s local 2025-03-14T06:24:09.4256051Z Compiling src/cpu/cpu_shuffle_list.cpp; 2s local 2025-03-14T06:24:09.4256979Z Compiling src/lib_json/json_reader.cpp; 2s local 2025-03-14T06:24:09.4257777Z Compiling src/google/protobuf/type.pb.cc; 2s local 2025-03-14T06:24:09.4258571Z Compiling src/lib_json/json_value.cpp; 2s local 2025-03-14T06:24:09.4259601Z Compiling llvm/lib/Support/ELFAttributeParser.cpp [for tool]; 2s local ... 2025-03-14T06:24:09.6224185Z 2025-03-14T06:24:09.6225047Z  2025-03-14T06:24:09.6225481Z  2025-03-14T06:24:09.6225867Z  2025-03-14T06:24:09.6226242Z  2025-03-14T06:24:09.6226589Z  2025-03-14T06:24:09.6226953Z  2025-03-14T06:24:09.6227295Z  2025-03-14T06:24:09.6227684Z  2025-03-14T06:24:09.6228271Z [6,108 / 20,647] 46 actions, 45 running 2025-03-14T06:24:09.6229103Z Compiling src/compiler/ruby_generator.cc [for tool]; 2s local 2025-03-14T06:24:09.6230132Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 2s local 2025-03-14T06:24:09.6231075Z Compiling src/cpu/cpu_rnn_list.cpp; 2s local 2025-03-14T06:24:09.6231780Z Compiling src/cpu/cpu_shuffle_list.cpp; 2s local 2025-03-14T06:24:09.6232769Z Compiling src/lib_json/json_reader.cpp; 2s local 2025-03-14T06:24:09.6233620Z Compiling src/lib_json/json_value.cpp; 2s local 2025-03-14T06:24:09.6234476Z Compiling absl/time/internal/cctz/src/time_zone_info.cc; 2s local 2025-03-14T06:24:09.6235330Z Compiling src/common/binary.cpp; 2s local ... 2025-03-14T06:24:09.8234042Z 2025-03-14T06:24:09.8235335Z  2025-03-14T06:24:09.8235855Z  2025-03-14T06:24:09.8236265Z  2025-03-14T06:24:09.8236676Z  2025-03-14T06:24:09.8237113Z  2025-03-14T06:24:09.8237535Z  2025-03-14T06:24:09.8237973Z  2025-03-14T06:24:09.8238423Z  2025-03-14T06:24:09.8239063Z [6,523 / 20,647] 47 actions, 45 running 2025-03-14T06:24:09.8240065Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2025-03-14T06:24:09.8241189Z Compiling src/cpu/cpu_rnn_list.cpp; 2s local 2025-03-14T06:24:09.8241956Z Compiling src/cpu/cpu_shuffle_list.cpp; 2s local 2025-03-14T06:24:09.8242689Z Compiling src/lib_json/json_reader.cpp; 2s local 2025-03-14T06:24:09.8243447Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 2s local 2025-03-14T06:24:09.8244274Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 2s local 2025-03-14T06:24:09.8245208Z @onednn//:onednn_autogen; 2s local 2025-03-14T06:24:09.8245885Z @llvm-project//llvm:llvm-min-tblgen; 1s local ... 2025-03-14T06:24:10.0240981Z 2025-03-14T06:24:10.0241632Z  2025-03-14T06:24:10.0241951Z  2025-03-14T06:24:10.0242203Z  2025-03-14T06:24:10.0242452Z  2025-03-14T06:24:10.0242701Z  2025-03-14T06:24:10.0242975Z  2025-03-14T06:24:10.0243216Z  2025-03-14T06:24:10.0243459Z  2025-03-14T06:24:10.0243818Z [7,001 / 20,647] 46 actions, 45 running 2025-03-14T06:24:10.0244378Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2025-03-14T06:24:10.0245082Z Compiling src/cpu/cpu_rnn_list.cpp; 3s local 2025-03-14T06:24:10.0245524Z Compiling src/cpu/cpu_shuffle_list.cpp; 3s local 2025-03-14T06:24:10.0246108Z Compiling xla/service/cpu/runtime_key_value_sort.cc; 2s local 2025-03-14T06:24:10.0247095Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 2s local 2025-03-14T06:24:10.0247950Z @onednn//:onednn_autogen; 2s local 2025-03-14T06:24:10.0249085Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2025-03-14T06:24:10.0250120Z @llvm-project//llvm:TableGen; 2s local ... 2025-03-14T06:24:10.2256047Z 2025-03-14T06:24:10.2256928Z  2025-03-14T06:24:10.2257451Z  2025-03-14T06:24:10.2258228Z  2025-03-14T06:24:10.2258651Z  2025-03-14T06:24:10.2259057Z  2025-03-14T06:24:10.2259486Z  2025-03-14T06:24:10.2259938Z  2025-03-14T06:24:10.2260360Z  2025-03-14T06:24:10.2261157Z [7,493 / 20,647] 46 actions, 45 running 2025-03-14T06:24:10.2262251Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2025-03-14T06:24:10.2263284Z Compiling src/cpu/cpu_rnn_list.cpp; 3s local 2025-03-14T06:24:10.2264062Z Compiling src/cpu/cpu_shuffle_list.cpp; 3s local 2025-03-14T06:24:10.2265027Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 2s local 2025-03-14T06:24:10.2266069Z @onednn//:onednn_autogen; 2s local 2025-03-14T06:24:10.2266861Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2025-03-14T06:24:10.2267650Z @llvm-project//llvm:TableGen; 2s local 2025-03-14T06:24:10.2268325Z Compiling llvm/lib/TableGen/Error.cpp [for tool]; 1s local ... 2025-03-14T06:24:10.4262588Z 2025-03-14T06:24:10.4263466Z  2025-03-14T06:24:10.4263968Z  2025-03-14T06:24:10.4264370Z  2025-03-14T06:24:10.4264846Z  2025-03-14T06:24:10.4265505Z  2025-03-14T06:24:10.4265917Z  2025-03-14T06:24:10.4266348Z  2025-03-14T06:24:10.4266767Z  2025-03-14T06:24:10.4267481Z [7,993 / 20,647] 47 actions, 45 running 2025-03-14T06:24:10.4268663Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2025-03-14T06:24:10.4269669Z Compiling src/cpu/cpu_rnn_list.cpp; 3s local 2025-03-14T06:24:10.4270395Z Compiling src/cpu/cpu_shuffle_list.cpp; 3s local 2025-03-14T06:24:10.4271302Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 2s local 2025-03-14T06:24:10.4272189Z @onednn//:onednn_autogen; 2s local 2025-03-14T06:24:10.4273161Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2025-03-14T06:24:10.4274138Z @llvm-project//llvm:TableGen; 2s local 2025-03-14T06:24:10.4274823Z Compiling google/threading.cc; 2s local ... 2025-03-14T06:24:10.6277246Z 2025-03-14T06:24:10.6278107Z  2025-03-14T06:24:10.6278613Z  2025-03-14T06:24:10.6279026Z  2025-03-14T06:24:10.6279438Z  2025-03-14T06:24:10.6279863Z  2025-03-14T06:24:10.6280277Z  2025-03-14T06:24:10.6280698Z  2025-03-14T06:24:10.6281121Z  2025-03-14T06:24:10.6281738Z [8,413 / 20,647] 46 actions, 45 running 2025-03-14T06:24:10.6282839Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 3s local 2025-03-14T06:24:10.6283856Z Compiling src/cpu/cpu_rnn_list.cpp; 3s local 2025-03-14T06:24:10.6284733Z Compiling src/cpu/cpu_shuffle_list.cpp; 3s local 2025-03-14T06:24:10.6285719Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T06:24:10.6286635Z @onednn//:onednn_autogen; 2s local 2025-03-14T06:24:10.6287504Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2025-03-14T06:24:10.6288524Z Compiling google/threading.cc; 2s local 2025-03-14T06:24:10.6289153Z Compiling google/fft.cc; 2s local ... 2025-03-14T06:24:10.8281032Z 2025-03-14T06:24:10.8281917Z  2025-03-14T06:24:10.8282372Z  2025-03-14T06:24:10.8282837Z  2025-03-14T06:24:10.8283245Z  2025-03-14T06:24:10.8283603Z  2025-03-14T06:24:10.8283983Z  2025-03-14T06:24:10.8284390Z  2025-03-14T06:24:10.8284890Z  2025-03-14T06:24:10.8285456Z [8,884 / 20,647] 48 actions, 44 running 2025-03-14T06:24:10.8286398Z Compiling src/google/protobuf/generated_message_tctable_lite.cc; 4s local 2025-03-14T06:24:10.8287357Z Compiling src/cpu/cpu_rnn_list.cpp; 4s local 2025-03-14T06:24:10.8288383Z Compiling src/cpu/cpu_shuffle_list.cpp; 4s local 2025-03-14T06:24:10.8289296Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T06:24:10.8290107Z @onednn//:onednn_autogen; 3s local 2025-03-14T06:24:10.8291066Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 2s local 2025-03-14T06:24:10.8291950Z Compiling google/fft.cc; 2s local 2025-03-14T06:24:10.8292689Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local ... 2025-03-14T06:24:11.0304318Z 2025-03-14T06:24:11.0305220Z  2025-03-14T06:24:11.0305689Z  2025-03-14T06:24:11.0306091Z  2025-03-14T06:24:11.0306549Z  2025-03-14T06:24:11.0306964Z  2025-03-14T06:24:11.0307366Z  2025-03-14T06:24:11.0307773Z  2025-03-14T06:24:11.0308182Z  2025-03-14T06:24:11.0308791Z [9,390 / 20,647] 48 actions, 44 running 2025-03-14T06:24:11.0309518Z Compiling src/cpu/cpu_rnn_list.cpp; 4s local 2025-03-14T06:24:11.0310289Z Compiling src/cpu/cpu_shuffle_list.cpp; 4s local 2025-03-14T06:24:11.0311191Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T06:24:11.0312089Z @onednn//:onednn_autogen; 3s local 2025-03-14T06:24:11.0313001Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2025-03-14T06:24:11.0313915Z Compiling google/fft.cc; 2s local 2025-03-14T06:24:11.0314668Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2025-03-14T06:24:11.0315632Z Compiling llvm/lib/TableGen/JSONBackend.cpp [for tool]; 2s local ... 2025-03-14T06:24:11.2316755Z 2025-03-14T06:24:11.2317632Z  2025-03-14T06:24:11.2318141Z  2025-03-14T06:24:11.2318851Z  2025-03-14T06:24:11.2319255Z  2025-03-14T06:24:11.2319651Z  2025-03-14T06:24:11.2320051Z  2025-03-14T06:24:11.2320466Z  2025-03-14T06:24:11.2320890Z  2025-03-14T06:24:11.2321460Z [9,484 / 20,647] 48 actions running 2025-03-14T06:24:11.2322203Z Compiling src/cpu/cpu_rnn_list.cpp; 4s local 2025-03-14T06:24:11.2322956Z Compiling src/cpu/cpu_shuffle_list.cpp; 4s local 2025-03-14T06:24:11.2323929Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T06:24:11.2325158Z @onednn//:onednn_autogen; 3s local 2025-03-14T06:24:11.2326058Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2025-03-14T06:24:11.2326988Z Compiling google/fft.cc; 2s local 2025-03-14T06:24:11.2327720Z Compiling src/compiler/cpp_plugin.cc [for tool]; 2s local 2025-03-14T06:24:11.2328718Z Compiling llvm/lib/TableGen/JSONBackend.cpp [for tool]; 2s local ... 2025-03-14T06:24:11.4320524Z 2025-03-14T06:24:11.4321395Z  2025-03-14T06:24:11.4321892Z  2025-03-14T06:24:11.4322305Z  2025-03-14T06:24:11.4322730Z  2025-03-14T06:24:11.4323142Z  2025-03-14T06:24:11.4323533Z  2025-03-14T06:24:11.4323912Z  2025-03-14T06:24:11.4324322Z  2025-03-14T06:24:11.4325009Z [9,491 / 20,647] 48 actions running 2025-03-14T06:24:11.4325760Z Compiling src/cpu/cpu_rnn_list.cpp; 4s local 2025-03-14T06:24:11.4326506Z Compiling src/cpu/cpu_shuffle_list.cpp; 4s local 2025-03-14T06:24:11.4327445Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 3s local 2025-03-14T06:24:11.4328318Z @onednn//:onednn_autogen; 3s local 2025-03-14T06:24:11.4329147Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2025-03-14T06:24:11.4330101Z Compiling google/fft.cc; 3s local 2025-03-14T06:24:11.4330821Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2025-03-14T06:24:11.4331852Z Compiling llvm/lib/TableGen/JSONBackend.cpp [for tool]; 2s local ... 2025-03-14T06:24:11.6458511Z 2025-03-14T06:24:11.6459381Z  2025-03-14T06:24:11.6459876Z  2025-03-14T06:24:11.6460279Z  2025-03-14T06:24:11.6460668Z  2025-03-14T06:24:11.6461062Z  2025-03-14T06:24:11.6461471Z  2025-03-14T06:24:11.6462171Z  2025-03-14T06:24:11.6462564Z  2025-03-14T06:24:11.6463167Z [9,506 / 20,647] 48 actions, 47 running 2025-03-14T06:24:11.6463876Z Compiling src/cpu/cpu_rnn_list.cpp; 4s local 2025-03-14T06:24:11.6464550Z Compiling src/cpu/cpu_shuffle_list.cpp; 4s local 2025-03-14T06:24:11.6465869Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp [for tool]; 4s local 2025-03-14T06:24:11.6466721Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:11.6467821Z Compiling llvm/utils/TableGen/ARMTargetDefEmitter.cpp [for tool]; 3s local 2025-03-14T06:24:11.6468794Z Compiling google/fft.cc; 3s local 2025-03-14T06:24:11.6469509Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2025-03-14T06:24:11.6470624Z Compiling llvm/lib/TableGen/JSONBackend.cpp [for tool]; 2s local ... 2025-03-14T06:24:11.8807331Z 2025-03-14T06:24:11.8808196Z  2025-03-14T06:24:11.8808684Z  2025-03-14T06:24:11.8809093Z  2025-03-14T06:24:11.8809528Z  2025-03-14T06:24:11.8809930Z  2025-03-14T06:24:11.8810305Z  2025-03-14T06:24:11.8810705Z  2025-03-14T06:24:11.8811110Z  2025-03-14T06:24:11.8811701Z [9,526 / 20,647] 47 actions, 46 running 2025-03-14T06:24:11.8812436Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local 2025-03-14T06:24:11.8813177Z Compiling src/cpu/cpu_shuffle_list.cpp; 5s local 2025-03-14T06:24:11.8813834Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:11.8814435Z Compiling google/fft.cc; 3s local 2025-03-14T06:24:11.8815195Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2025-03-14T06:24:11.8816442Z Compiling llvm/lib/TableGen/JSONBackend.cpp [for tool]; 3s local 2025-03-14T06:24:11.8817410Z Compiling llvm/lib/TableGen/Main.cpp [for tool]; 2s local 2025-03-14T06:24:11.8818500Z Compiling src/compiler/cpp_generator.cc [for tool]; 2s local ... 2025-03-14T06:24:12.0844924Z 2025-03-14T06:24:12.0845792Z  2025-03-14T06:24:12.0846259Z  2025-03-14T06:24:12.0846645Z  2025-03-14T06:24:12.0846989Z  2025-03-14T06:24:12.0847331Z  2025-03-14T06:24:12.0847701Z  2025-03-14T06:24:12.0848095Z  2025-03-14T06:24:12.0848468Z  2025-03-14T06:24:12.0849016Z [9,535 / 20,647] 48 actions, 47 running 2025-03-14T06:24:12.0849731Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local 2025-03-14T06:24:12.0850512Z Compiling src/cpu/cpu_shuffle_list.cpp; 5s local 2025-03-14T06:24:12.0851207Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:12.0851819Z Compiling google/fft.cc; 3s local 2025-03-14T06:24:12.0852559Z Compiling src/compiler/cpp_plugin.cc [for tool]; 3s local 2025-03-14T06:24:12.0853485Z Compiling llvm/lib/TableGen/JSONBackend.cpp [for tool]; 3s local 2025-03-14T06:24:12.0854390Z Compiling llvm/lib/TableGen/Main.cpp [for tool]; 3s local 2025-03-14T06:24:12.0855244Z Compiling src/compiler/cpp_generator.cc [for tool]; 2s local ... 2025-03-14T06:24:12.2878933Z 2025-03-14T06:24:12.2879771Z  2025-03-14T06:24:12.2880277Z  2025-03-14T06:24:12.2880709Z  2025-03-14T06:24:12.2881127Z  2025-03-14T06:24:12.2881564Z  2025-03-14T06:24:12.2881941Z  2025-03-14T06:24:12.2882340Z  2025-03-14T06:24:12.2882711Z  2025-03-14T06:24:12.2883328Z [9,543 / 20,647] 48 actions, 47 running 2025-03-14T06:24:12.2884035Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local 2025-03-14T06:24:12.2884922Z Compiling src/cpu/cpu_shuffle_list.cpp; 5s local 2025-03-14T06:24:12.2885690Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:12.2886307Z Compiling google/fft.cc; 3s local 2025-03-14T06:24:12.2887168Z Compiling llvm/lib/TableGen/JSONBackend.cpp [for tool]; 3s local 2025-03-14T06:24:12.2888164Z Compiling llvm/lib/TableGen/Main.cpp [for tool]; 3s local 2025-03-14T06:24:12.2889094Z Compiling src/compiler/cpp_generator.cc [for tool]; 2s local 2025-03-14T06:24:12.2890054Z Compiling src/compiler/csharp_generator.cc [for tool]; 2s local ... 2025-03-14T06:24:12.5780665Z 2025-03-14T06:24:12.5781538Z  2025-03-14T06:24:12.5782017Z  2025-03-14T06:24:12.5782434Z  2025-03-14T06:24:12.5782856Z  2025-03-14T06:24:12.5783268Z  2025-03-14T06:24:12.5783705Z  2025-03-14T06:24:12.5784414Z  2025-03-14T06:24:12.5784845Z  2025-03-14T06:24:12.5785468Z [9,557 / 20,647] 48 actions, 47 running 2025-03-14T06:24:12.5786212Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local 2025-03-14T06:24:12.5787150Z Compiling src/cpu/cpu_shuffle_list.cpp; 5s local 2025-03-14T06:24:12.5787877Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:12.5788529Z Compiling google/fft.cc; 4s local 2025-03-14T06:24:12.5789291Z Compiling llvm/lib/TableGen/Main.cpp [for tool]; 3s local 2025-03-14T06:24:12.5790348Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.5791325Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.5792345Z Compiling src/compiler/node_generator.cc [for tool]; 2s local ... 2025-03-14T06:24:12.7970134Z 2025-03-14T06:24:12.7971096Z  2025-03-14T06:24:12.7971595Z  2025-03-14T06:24:12.7972004Z  2025-03-14T06:24:12.7972368Z  2025-03-14T06:24:12.7972803Z  2025-03-14T06:24:12.7973234Z  2025-03-14T06:24:12.7973648Z  2025-03-14T06:24:12.7974015Z  2025-03-14T06:24:12.7974613Z [9,568 / 20,647] 48 actions, 47 running 2025-03-14T06:24:12.7975357Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local 2025-03-14T06:24:12.7976020Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:24:12.7976608Z Compiling google/fft.cc; 4s local 2025-03-14T06:24:12.7977637Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.7978617Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.7979555Z Compiling src/compiler/node_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.7980542Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.7981613Z Compiling src/compiler/objective_c_generator.cc [for tool]; 2s local ... 2025-03-14T06:24:12.9981792Z 2025-03-14T06:24:12.9982672Z  2025-03-14T06:24:12.9983175Z  2025-03-14T06:24:12.9983643Z  2025-03-14T06:24:12.9984059Z  2025-03-14T06:24:12.9984474Z  2025-03-14T06:24:12.9984873Z  2025-03-14T06:24:12.9985291Z  2025-03-14T06:24:12.9985687Z  2025-03-14T06:24:12.9986444Z [9,575 / 20,647] 48 actions, 47 running 2025-03-14T06:24:12.9987180Z Compiling src/cpu/cpu_rnn_list.cpp; 6s local 2025-03-14T06:24:12.9987887Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:24:12.9988505Z Compiling google/fft.cc; 4s local 2025-03-14T06:24:12.9989322Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.9990378Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.9991456Z Compiling src/compiler/node_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.9992529Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T06:24:12.9993700Z Compiling src/compiler/objective_c_generator.cc [for tool]; 3s local ... 2025-03-14T06:24:13.2510185Z 2025-03-14T06:24:13.2511077Z  2025-03-14T06:24:13.2511567Z  2025-03-14T06:24:13.2512008Z  2025-03-14T06:24:13.2512432Z  2025-03-14T06:24:13.2512832Z  2025-03-14T06:24:13.2513231Z  2025-03-14T06:24:13.2513629Z  2025-03-14T06:24:13.2514078Z  2025-03-14T06:24:13.2514682Z [9,586 / 20,647] 48 actions, 47 running 2025-03-14T06:24:13.2515443Z Compiling src/cpu/cpu_rnn_list.cpp; 6s local 2025-03-14T06:24:13.2516095Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:24:13.2516712Z Compiling google/fft.cc; 4s local 2025-03-14T06:24:13.2517457Z Compiling src/compiler/cpp_generator.cc [for tool]; 3s local 2025-03-14T06:24:13.2518345Z Compiling src/compiler/csharp_generator.cc [for tool]; 3s local 2025-03-14T06:24:13.2519591Z Compiling src/compiler/node_generator.cc [for tool]; 3s local 2025-03-14T06:24:13.2520565Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T06:24:13.2521602Z Compiling src/compiler/objective_c_generator.cc [for tool]; 3s local ... 2025-03-14T06:24:13.5000594Z 2025-03-14T06:24:13.5001454Z  2025-03-14T06:24:13.5001939Z  2025-03-14T06:24:13.5002363Z  2025-03-14T06:24:13.5002784Z  2025-03-14T06:24:13.5003461Z  2025-03-14T06:24:13.5003883Z  2025-03-14T06:24:13.5004296Z  2025-03-14T06:24:13.5004834Z  2025-03-14T06:24:13.5005465Z [9,596 / 20,647] 48 actions, 47 running 2025-03-14T06:24:13.5006217Z Compiling src/cpu/cpu_rnn_list.cpp; 6s local 2025-03-14T06:24:13.5006912Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:13.5007673Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T06:24:13.5008663Z Compiling src/compiler/csharp_generator.cc [for tool]; 4s local 2025-03-14T06:24:13.5009668Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T06:24:13.5010664Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T06:24:13.5011629Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 2s local 2025-03-14T06:24:13.5012556Z Compiling src/google/protobuf/descriptor.cc; 2s local ... 2025-03-14T06:24:13.7014580Z 2025-03-14T06:24:13.7015434Z  2025-03-14T06:24:13.7015904Z  2025-03-14T06:24:13.7016314Z  2025-03-14T06:24:13.7016742Z  2025-03-14T06:24:13.7017130Z  2025-03-14T06:24:13.7017520Z  2025-03-14T06:24:13.7018143Z  2025-03-14T06:24:13.7018563Z  2025-03-14T06:24:13.7019150Z [9,605 / 20,647] 48 actions, 47 running 2025-03-14T06:24:13.7019825Z Compiling src/cpu/cpu_rnn_list.cpp; 6s local 2025-03-14T06:24:13.7020520Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:13.7021400Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T06:24:13.7022398Z Compiling src/compiler/csharp_generator.cc [for tool]; 4s local 2025-03-14T06:24:13.7023425Z Compiling src/compiler/python_generator.cc [for tool]; 3s local 2025-03-14T06:24:13.7024441Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T06:24:13.7025402Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2025-03-14T06:24:13.7026307Z Compiling src/google/protobuf/descriptor.cc; 3s local ... 2025-03-14T06:24:13.9078925Z 2025-03-14T06:24:13.9080271Z  2025-03-14T06:24:13.9080774Z  2025-03-14T06:24:13.9081198Z  2025-03-14T06:24:13.9081654Z  2025-03-14T06:24:13.9082076Z  2025-03-14T06:24:13.9082496Z  2025-03-14T06:24:13.9082913Z  2025-03-14T06:24:13.9083337Z  2025-03-14T06:24:13.9083961Z [9,612 / 20,647] 48 actions, 47 running 2025-03-14T06:24:13.9084859Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:13.9085551Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:13.9086489Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T06:24:13.9087435Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T06:24:13.9088322Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T06:24:13.9089319Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2025-03-14T06:24:13.9090227Z Compiling src/google/protobuf/descriptor.cc; 3s local 2025-03-14T06:24:13.9091178Z Compiling src/google/protobuf/descriptor.pb.cc; 3s local ... 2025-03-14T06:24:14.1137333Z 2025-03-14T06:24:14.1138190Z  2025-03-14T06:24:14.1138731Z  2025-03-14T06:24:14.1139114Z  2025-03-14T06:24:14.1139503Z  2025-03-14T06:24:14.1139867Z  2025-03-14T06:24:14.1140241Z  2025-03-14T06:24:14.1140640Z  2025-03-14T06:24:14.1141021Z  2025-03-14T06:24:14.1141610Z [9,618 / 20,647] 47 actions, 46 running 2025-03-14T06:24:14.1142624Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:14.1143291Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:14.1144028Z Compiling src/compiler/cpp_generator.cc [for tool]; 4s local 2025-03-14T06:24:14.1145116Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T06:24:14.1146073Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T06:24:14.1147003Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2025-03-14T06:24:14.1148019Z Compiling src/google/protobuf/descriptor.cc; 3s local 2025-03-14T06:24:14.1148926Z Compiling src/google/protobuf/descriptor.pb.cc; 3s local ... 2025-03-14T06:24:14.3197036Z 2025-03-14T06:24:14.3197865Z  2025-03-14T06:24:14.3198375Z  2025-03-14T06:24:14.3198799Z  2025-03-14T06:24:14.3199230Z  2025-03-14T06:24:14.3199641Z  2025-03-14T06:24:14.3200044Z  2025-03-14T06:24:14.3200459Z  2025-03-14T06:24:14.3201017Z  2025-03-14T06:24:14.3201611Z [9,625 / 20,647] 48 actions running 2025-03-14T06:24:14.3202341Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:14.3203036Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:14.3203831Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T06:24:14.3205029Z Compiling src/google/protobuf/compiler/parser.cc; 3s local 2025-03-14T06:24:14.3205986Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2025-03-14T06:24:14.3206921Z Compiling src/google/protobuf/descriptor.cc; 3s local 2025-03-14T06:24:14.3207815Z Compiling src/google/protobuf/descriptor.pb.cc; 3s local 2025-03-14T06:24:14.3209063Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2025-03-14T06:24:14.5201764Z 2025-03-14T06:24:14.5202593Z  2025-03-14T06:24:14.5203195Z  2025-03-14T06:24:14.5203613Z  2025-03-14T06:24:14.5204025Z  2025-03-14T06:24:14.5204436Z  2025-03-14T06:24:14.5205047Z  2025-03-14T06:24:14.5205478Z  2025-03-14T06:24:14.5205872Z  2025-03-14T06:24:14.5206447Z [9,630 / 20,647] 48 actions running 2025-03-14T06:24:14.5207144Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:14.5207808Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:14.5208616Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T06:24:14.5209565Z Compiling src/google/protobuf/compiler/parser.cc; 4s local 2025-03-14T06:24:14.5210506Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 3s local 2025-03-14T06:24:14.5211364Z Compiling src/google/protobuf/descriptor.cc; 3s local 2025-03-14T06:24:14.5212225Z Compiling src/google/protobuf/descriptor.pb.cc; 3s local 2025-03-14T06:24:14.5213138Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2025-03-14T06:24:14.7398786Z 2025-03-14T06:24:14.7401141Z  2025-03-14T06:24:14.7401644Z  2025-03-14T06:24:14.7402070Z  2025-03-14T06:24:14.7402512Z  2025-03-14T06:24:14.7402918Z  2025-03-14T06:24:14.7403317Z  2025-03-14T06:24:14.7403721Z  2025-03-14T06:24:14.7404134Z  2025-03-14T06:24:14.7404891Z [9,635 / 20,647] 48 actions, 47 running 2025-03-14T06:24:14.7405645Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:14.7406334Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:14.7407123Z Compiling src/compiler/python_generator.cc [for tool]; 4s local 2025-03-14T06:24:14.7408091Z Compiling src/google/protobuf/compiler/parser.cc; 4s local 2025-03-14T06:24:14.7408977Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2025-03-14T06:24:14.7409876Z Compiling src/google/protobuf/descriptor.cc; 4s local 2025-03-14T06:24:14.7410740Z Compiling src/google/protobuf/descriptor.pb.cc; 4s local 2025-03-14T06:24:14.7411713Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local ... 2025-03-14T06:24:14.9569020Z 2025-03-14T06:24:14.9571982Z  2025-03-14T06:24:14.9572469Z  2025-03-14T06:24:14.9572914Z  2025-03-14T06:24:14.9573337Z  2025-03-14T06:24:14.9573775Z  2025-03-14T06:24:14.9575664Z  2025-03-14T06:24:14.9576107Z  2025-03-14T06:24:14.9577827Z  2025-03-14T06:24:14.9578680Z [9,643 / 20,647] 48 actions, 47 running 2025-03-14T06:24:14.9579937Z Compiling src/cpu/cpu_rnn_list.cpp; 8s local 2025-03-14T06:24:14.9581697Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:14.9583691Z Compiling src/compiler/python_generator.cc [for tool]; 5s local 2025-03-14T06:24:14.9585771Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2025-03-14T06:24:14.9587793Z Compiling src/google/protobuf/descriptor.cc; 4s local 2025-03-14T06:24:14.9589802Z Compiling src/google/protobuf/descriptor.pb.cc; 4s local 2025-03-14T06:24:14.9591884Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 3s local 2025-03-14T06:24:14.9593242Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 3s local ... 2025-03-14T06:24:15.1553002Z 2025-03-14T06:24:15.1554273Z  2025-03-14T06:24:15.1554786Z  2025-03-14T06:24:15.1555228Z  2025-03-14T06:24:15.1555653Z  2025-03-14T06:24:15.1556119Z  2025-03-14T06:24:15.1556520Z  2025-03-14T06:24:15.1556966Z  2025-03-14T06:24:15.1557401Z  2025-03-14T06:24:15.1558030Z [9,653 / 20,647] 48 actions, 47 running 2025-03-14T06:24:15.1558796Z Compiling src/cpu/cpu_rnn_list.cpp; 8s local 2025-03-14T06:24:15.1559515Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:15.1560287Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2025-03-14T06:24:15.1561469Z Compiling src/google/protobuf/descriptor.cc; 4s local 2025-03-14T06:24:15.1562429Z Compiling src/google/protobuf/descriptor.pb.cc; 4s local 2025-03-14T06:24:15.1573990Z Compiling llvm/lib/Demangle/ItaniumDemangle.cpp; 4s local 2025-03-14T06:24:15.1574911Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 3s local 2025-03-14T06:24:15.1575942Z Compiling src/google/protobuf/descriptor_database.cc; 3s local ... 2025-03-14T06:24:15.3653422Z 2025-03-14T06:24:15.3654390Z  2025-03-14T06:24:15.3655134Z  2025-03-14T06:24:15.3655724Z  2025-03-14T06:24:15.3656318Z  2025-03-14T06:24:15.3656873Z  2025-03-14T06:24:15.3657422Z  2025-03-14T06:24:15.3657969Z  2025-03-14T06:24:15.3658523Z  2025-03-14T06:24:15.3659266Z [9,664 / 20,647] 48 actions, 47 running 2025-03-14T06:24:15.3660135Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:15.3661026Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 4s local 2025-03-14T06:24:15.3662032Z Compiling src/google/protobuf/descriptor.cc; 4s local 2025-03-14T06:24:15.3663119Z Compiling src/google/protobuf/descriptor.pb.cc; 4s local 2025-03-14T06:24:15.3664238Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 4s local 2025-03-14T06:24:15.3668320Z Compiling src/google/protobuf/descriptor_database.cc; 3s local 2025-03-14T06:24:15.3669581Z Compiling llvm/lib/TableGen/SetTheory.cpp [for tool]; 3s local 2025-03-14T06:24:15.3670673Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 2s local ... 2025-03-14T06:24:15.5717268Z 2025-03-14T06:24:15.5718364Z  2025-03-14T06:24:15.5718858Z  2025-03-14T06:24:15.5720739Z  2025-03-14T06:24:15.5721163Z  2025-03-14T06:24:15.5722926Z  2025-03-14T06:24:15.5723333Z  2025-03-14T06:24:15.5725344Z  2025-03-14T06:24:15.5725747Z  2025-03-14T06:24:15.5727892Z [9,672 / 20,647] 48 actions, 47 running 2025-03-14T06:24:15.5728593Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:15.5729321Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2025-03-14T06:24:15.5730340Z Compiling src/google/protobuf/descriptor.cc; 4s local 2025-03-14T06:24:15.5731374Z Compiling src/google/protobuf/descriptor.pb.cc; 4s local 2025-03-14T06:24:15.5732343Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 4s local 2025-03-14T06:24:15.5733479Z Compiling src/google/protobuf/descriptor_database.cc; 4s local 2025-03-14T06:24:15.5734490Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 2s local 2025-03-14T06:24:15.5735373Z Compiling src/cpu/cpu_softmax_list.cpp; 2s local ... 2025-03-14T06:24:15.7834624Z 2025-03-14T06:24:15.7836053Z  2025-03-14T06:24:15.7836562Z  2025-03-14T06:24:15.7836977Z  2025-03-14T06:24:15.7837398Z  2025-03-14T06:24:15.7837816Z  2025-03-14T06:24:15.7838497Z  2025-03-14T06:24:15.7838947Z  2025-03-14T06:24:15.7839379Z  2025-03-14T06:24:15.7840017Z [9,678 / 20,647] 48 actions, 47 running 2025-03-14T06:24:15.7840732Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:15.7841607Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2025-03-14T06:24:15.7842475Z Compiling src/google/protobuf/descriptor.cc; 5s local 2025-03-14T06:24:15.7843320Z Compiling src/google/protobuf/descriptor.pb.cc; 5s local 2025-03-14T06:24:15.7844229Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 4s local 2025-03-14T06:24:15.7845332Z Compiling src/google/protobuf/descriptor_database.cc; 4s local 2025-03-14T06:24:15.7846303Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 3s local 2025-03-14T06:24:15.7847199Z Compiling src/cpu/cpu_softmax_list.cpp; 3s local ... 2025-03-14T06:24:15.9827136Z 2025-03-14T06:24:15.9828492Z  2025-03-14T06:24:15.9829001Z  2025-03-14T06:24:15.9829437Z  2025-03-14T06:24:15.9829881Z  2025-03-14T06:24:15.9830287Z  2025-03-14T06:24:15.9830685Z  2025-03-14T06:24:15.9831080Z  2025-03-14T06:24:15.9831685Z  2025-03-14T06:24:15.9832532Z [9,685 / 20,647] 48 actions, 47 running 2025-03-14T06:24:15.9833239Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:15.9834003Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2025-03-14T06:24:15.9834881Z Compiling src/google/protobuf/descriptor.cc; 5s local 2025-03-14T06:24:15.9835873Z Compiling src/google/protobuf/descriptor.pb.cc; 5s local 2025-03-14T06:24:15.9836699Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 4s local 2025-03-14T06:24:15.9837528Z Compiling src/google/protobuf/descriptor_database.cc; 4s local 2025-03-14T06:24:15.9838587Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 3s local 2025-03-14T06:24:15.9839480Z Compiling src/cpu/cpu_softmax_list.cpp; 3s local ... 2025-03-14T06:24:16.2441420Z 2025-03-14T06:24:16.2442284Z  2025-03-14T06:24:16.2442775Z  2025-03-14T06:24:16.2443208Z  2025-03-14T06:24:16.2443626Z  2025-03-14T06:24:16.2444050Z  2025-03-14T06:24:16.2444473Z  2025-03-14T06:24:16.2445062Z  2025-03-14T06:24:16.2445480Z  2025-03-14T06:24:16.2446081Z [9,695 / 20,647] 48 actions, 47 running 2025-03-14T06:24:16.2446787Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:16.2447564Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2025-03-14T06:24:16.2448501Z Compiling src/google/protobuf/descriptor.cc; 5s local 2025-03-14T06:24:16.2449395Z Compiling src/google/protobuf/descriptor.pb.cc; 5s local 2025-03-14T06:24:16.2450785Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2025-03-14T06:24:16.2451891Z Compiling src/google/protobuf/descriptor_database.cc; 4s local 2025-03-14T06:24:16.2453014Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 3s local 2025-03-14T06:24:16.2454049Z Compiling src/cpu/cpu_softmax_list.cpp; 3s local ... 2025-03-14T06:24:16.4950421Z 2025-03-14T06:24:16.4951325Z  2025-03-14T06:24:16.4951812Z  2025-03-14T06:24:16.4952225Z  2025-03-14T06:24:16.4952608Z  2025-03-14T06:24:16.4953008Z  2025-03-14T06:24:16.4953427Z  2025-03-14T06:24:16.4953838Z  2025-03-14T06:24:16.4954239Z  2025-03-14T06:24:16.4954837Z [9,707 / 20,647] 48 actions, 47 running 2025-03-14T06:24:16.4955805Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:16.4956525Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 5s local 2025-03-14T06:24:16.4957400Z Compiling src/google/protobuf/descriptor.cc; 5s local 2025-03-14T06:24:16.4958223Z Compiling src/google/protobuf/descriptor.pb.cc; 5s local 2025-03-14T06:24:16.4959353Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2025-03-14T06:24:16.4960279Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 3s local 2025-03-14T06:24:16.4961267Z Compiling src/cpu/cpu_softmax_list.cpp; 3s local 2025-03-14T06:24:16.4961999Z Compiling src/common/gemm.cpp; 3s local ... 2025-03-14T06:24:16.7064804Z 2025-03-14T06:24:16.7066516Z  2025-03-14T06:24:16.7067059Z  2025-03-14T06:24:16.7067481Z  2025-03-14T06:24:16.7067866Z  2025-03-14T06:24:16.7068280Z  2025-03-14T06:24:16.7068703Z  2025-03-14T06:24:16.7069110Z  2025-03-14T06:24:16.7069515Z  2025-03-14T06:24:16.7070116Z [9,717 / 20,647] 48 actions, 47 running 2025-03-14T06:24:16.7070827Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:16.7071584Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2025-03-14T06:24:16.7072438Z Compiling src/google/protobuf/descriptor.cc; 6s local 2025-03-14T06:24:16.7073253Z Compiling src/google/protobuf/descriptor.pb.cc; 6s local 2025-03-14T06:24:16.7074141Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2025-03-14T06:24:16.7075099Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2025-03-14T06:24:16.7075926Z Compiling src/cpu/cpu_softmax_list.cpp; 3s local 2025-03-14T06:24:16.7076822Z @onednn//:onednn_autogen; 3s local ... 2025-03-14T06:24:16.9197141Z 2025-03-14T06:24:16.9198016Z  2025-03-14T06:24:16.9198521Z  2025-03-14T06:24:16.9198924Z  2025-03-14T06:24:16.9199349Z  2025-03-14T06:24:16.9199776Z  2025-03-14T06:24:16.9200193Z  2025-03-14T06:24:16.9200615Z  2025-03-14T06:24:16.9201085Z  2025-03-14T06:24:16.9201683Z [9,724 / 20,647] 48 actions, 47 running 2025-03-14T06:24:16.9202373Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:16.9203248Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2025-03-14T06:24:16.9204185Z Compiling src/google/protobuf/descriptor.cc; 6s local 2025-03-14T06:24:16.9205234Z Compiling src/google/protobuf/descriptor.pb.cc; 6s local 2025-03-14T06:24:16.9206205Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2025-03-14T06:24:16.9207218Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2025-03-14T06:24:16.9208127Z Compiling src/cpu/cpu_softmax_list.cpp; 4s local 2025-03-14T06:24:16.9208873Z @onednn//:onednn_autogen; 3s local ... 2025-03-14T06:24:17.1217934Z 2025-03-14T06:24:17.1219361Z  2025-03-14T06:24:17.1219914Z  2025-03-14T06:24:17.1220353Z  2025-03-14T06:24:17.1220753Z  2025-03-14T06:24:17.1221165Z  2025-03-14T06:24:17.1221616Z  2025-03-14T06:24:17.1222044Z  2025-03-14T06:24:17.1222457Z  2025-03-14T06:24:17.1223018Z [9,733 / 20,647] 48 actions running 2025-03-14T06:24:17.1223692Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:17.1224463Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2025-03-14T06:24:17.1225430Z Compiling src/google/protobuf/descriptor.cc; 6s local 2025-03-14T06:24:17.1226337Z Compiling src/google/protobuf/descriptor.pb.cc; 6s local 2025-03-14T06:24:17.1227221Z Compiling torch_xla/csrc/aten_cuda_functions.cpp; 5s local 2025-03-14T06:24:17.1228183Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2025-03-14T06:24:17.1229076Z Compiling src/cpu/cpu_softmax_list.cpp; 4s local 2025-03-14T06:24:17.1229762Z @onednn//:onednn_autogen; 3s local ... 2025-03-14T06:24:17.3222454Z 2025-03-14T06:24:17.3223811Z  2025-03-14T06:24:17.3224355Z  2025-03-14T06:24:17.3224790Z  2025-03-14T06:24:17.3225516Z  2025-03-14T06:24:17.3225956Z  2025-03-14T06:24:17.3226379Z  2025-03-14T06:24:17.3226817Z  2025-03-14T06:24:17.3227247Z  2025-03-14T06:24:17.3227807Z [9,740 / 20,647] 48 actions running 2025-03-14T06:24:17.3228543Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:17.3229519Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2025-03-14T06:24:17.3230444Z Compiling src/google/protobuf/descriptor.cc; 6s local 2025-03-14T06:24:17.3231445Z Compiling src/google/protobuf/descriptor.pb.cc; 6s local 2025-03-14T06:24:17.3232462Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2025-03-14T06:24:17.3233400Z Compiling src/cpu/cpu_softmax_list.cpp; 4s local 2025-03-14T06:24:17.3234173Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:17.3234882Z Compiling src/cpu/cpu_sum.cpp; 3s local ... 2025-03-14T06:24:17.5592850Z 2025-03-14T06:24:17.5594231Z  2025-03-14T06:24:17.5594833Z  2025-03-14T06:24:17.5595285Z  2025-03-14T06:24:17.5595721Z  2025-03-14T06:24:17.5596130Z  2025-03-14T06:24:17.5596582Z  2025-03-14T06:24:17.5597033Z  2025-03-14T06:24:17.5597467Z  2025-03-14T06:24:17.5598110Z [9,745 / 20,647] 48 actions, 47 running 2025-03-14T06:24:17.5598867Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:17.5599672Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 6s local 2025-03-14T06:24:17.5600618Z Compiling src/google/protobuf/descriptor.cc; 6s local 2025-03-14T06:24:17.5601547Z Compiling src/google/protobuf/descriptor.pb.cc; 6s local 2025-03-14T06:24:17.5602469Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 4s local 2025-03-14T06:24:17.5603626Z Compiling src/cpu/cpu_softmax_list.cpp; 4s local 2025-03-14T06:24:17.5604346Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:17.5605225Z Compiling src/cpu/cpu_sum.cpp; 3s local ... 2025-03-14T06:24:17.7602625Z 2025-03-14T06:24:17.7603353Z  2025-03-14T06:24:17.7603854Z  2025-03-14T06:24:17.7604290Z  2025-03-14T06:24:17.7604847Z  2025-03-14T06:24:17.7605268Z  2025-03-14T06:24:17.7605679Z  2025-03-14T06:24:17.7606116Z  2025-03-14T06:24:17.7606554Z  2025-03-14T06:24:17.7607181Z [9,755 / 20,647] 48 actions, 47 running 2025-03-14T06:24:17.7607910Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:17.7608657Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2025-03-14T06:24:17.7609585Z Compiling src/google/protobuf/descriptor.cc; 7s local 2025-03-14T06:24:17.7610494Z Compiling src/google/protobuf/descriptor.pb.cc; 7s local 2025-03-14T06:24:17.7611666Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2025-03-14T06:24:17.7612568Z Compiling src/cpu/cpu_softmax_list.cpp; 5s local 2025-03-14T06:24:17.7613229Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:17.7613910Z Compiling src/cpu/cpu_sum.cpp; 4s local ... 2025-03-14T06:24:18.0210547Z 2025-03-14T06:24:18.0212474Z  2025-03-14T06:24:18.0213316Z  2025-03-14T06:24:18.0214037Z  2025-03-14T06:24:18.0214718Z  2025-03-14T06:24:18.0216315Z  2025-03-14T06:24:18.0216809Z  2025-03-14T06:24:18.0217307Z  2025-03-14T06:24:18.0218065Z  2025-03-14T06:24:18.0218801Z [9,763 / 20,647] 48 actions, 47 running 2025-03-14T06:24:18.0219754Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:18.0220673Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2025-03-14T06:24:18.0222142Z Compiling src/google/protobuf/descriptor.cc; 7s local 2025-03-14T06:24:18.0223293Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2025-03-14T06:24:18.0224395Z Compiling src/cpu/cpu_softmax_list.cpp; 5s local 2025-03-14T06:24:18.0225333Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:18.0226338Z Compiling src/cpu/cpu_sum.cpp; 4s local 2025-03-14T06:24:18.0227536Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 4s local ... 2025-03-14T06:24:18.2480424Z 2025-03-14T06:24:18.2481737Z  2025-03-14T06:24:18.2482277Z  2025-03-14T06:24:18.2482678Z  2025-03-14T06:24:18.2483065Z  2025-03-14T06:24:18.2483466Z  2025-03-14T06:24:18.2483861Z  2025-03-14T06:24:18.2484673Z  2025-03-14T06:24:18.2485082Z  2025-03-14T06:24:18.2485680Z [9,767 / 20,647] 48 actions, 47 running 2025-03-14T06:24:18.2486302Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:18.2487213Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2025-03-14T06:24:18.2488080Z Compiling src/google/protobuf/descriptor.cc; 7s local 2025-03-14T06:24:18.2488941Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2025-03-14T06:24:18.2489808Z Compiling src/cpu/cpu_softmax_list.cpp; 5s local 2025-03-14T06:24:18.2490497Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:24:18.2491135Z Compiling src/cpu/cpu_sum.cpp; 4s local 2025-03-14T06:24:18.2491968Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 4s local ... 2025-03-14T06:24:18.4607263Z 2025-03-14T06:24:18.4608647Z  2025-03-14T06:24:18.4609175Z  2025-03-14T06:24:18.4609589Z  2025-03-14T06:24:18.4609977Z  2025-03-14T06:24:18.4610403Z  2025-03-14T06:24:18.4610811Z  2025-03-14T06:24:18.4611214Z  2025-03-14T06:24:18.4611613Z  2025-03-14T06:24:18.4612229Z [9,776 / 20,647] 48 actions, 47 running 2025-03-14T06:24:18.4612936Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:18.4613665Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 7s local 2025-03-14T06:24:18.4614776Z Compiling src/google/protobuf/descriptor.cc; 7s local 2025-03-14T06:24:18.4615688Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 5s local 2025-03-14T06:24:18.4616577Z Compiling src/cpu/cpu_softmax_list.cpp; 5s local 2025-03-14T06:24:18.4617283Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:24:18.4617880Z Compiling src/cpu/cpu_sum.cpp; 4s local 2025-03-14T06:24:18.4618748Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 4s local ... 2025-03-14T06:24:18.6667115Z 2025-03-14T06:24:18.6668166Z  2025-03-14T06:24:18.6668488Z  2025-03-14T06:24:18.6668745Z  2025-03-14T06:24:18.6669025Z  2025-03-14T06:24:18.6669294Z  2025-03-14T06:24:18.6669544Z  2025-03-14T06:24:18.6669794Z  2025-03-14T06:24:18.6670038Z  2025-03-14T06:24:18.6670406Z [9,783 / 20,647] 48 actions, 47 running 2025-03-14T06:24:18.6670829Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:18.6671282Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2025-03-14T06:24:18.6671806Z Compiling src/google/protobuf/descriptor.cc; 8s local 2025-03-14T06:24:18.6672322Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2025-03-14T06:24:18.6672825Z Compiling src/cpu/cpu_softmax_list.cpp; 5s local 2025-03-14T06:24:18.6673236Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:24:18.6673609Z Compiling src/cpu/cpu_sum.cpp; 4s local 2025-03-14T06:24:18.6674099Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 4s local ... 2025-03-14T06:24:18.8775990Z 2025-03-14T06:24:18.8777334Z  2025-03-14T06:24:18.8777846Z  2025-03-14T06:24:18.8778229Z  2025-03-14T06:24:18.8778580Z  2025-03-14T06:24:18.8778944Z  2025-03-14T06:24:18.8779337Z  2025-03-14T06:24:18.8779668Z  2025-03-14T06:24:18.8780021Z  2025-03-14T06:24:18.8780610Z [9,794 / 20,647] 48 actions, 47 running 2025-03-14T06:24:18.8781256Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:18.8782136Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2025-03-14T06:24:18.8783038Z Compiling src/google/protobuf/descriptor.cc; 8s local 2025-03-14T06:24:18.8783925Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2025-03-14T06:24:18.8784929Z Compiling src/cpu/cpu_softmax_list.cpp; 6s local 2025-03-14T06:24:18.8786060Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:24:18.8786854Z Compiling src/cpu/cpu_sum.cpp; 5s local 2025-03-14T06:24:18.8787644Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 5s local ... 2025-03-14T06:24:19.0889829Z 2025-03-14T06:24:19.0890940Z  2025-03-14T06:24:19.0891416Z  2025-03-14T06:24:19.0891930Z  2025-03-14T06:24:19.0892339Z  2025-03-14T06:24:19.0892723Z  2025-03-14T06:24:19.0893106Z  2025-03-14T06:24:19.0893509Z  2025-03-14T06:24:19.0894123Z  2025-03-14T06:24:19.0894754Z [9,801 / 20,647] 48 actions, 47 running 2025-03-14T06:24:19.0895365Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:19.0895927Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2025-03-14T06:24:19.0896758Z Compiling src/google/protobuf/descriptor.cc; 8s local 2025-03-14T06:24:19.0897571Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2025-03-14T06:24:19.0898381Z Compiling src/cpu/cpu_softmax_list.cpp; 6s local 2025-03-14T06:24:19.0899055Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:24:19.0899606Z Compiling src/cpu/cpu_sum.cpp; 5s local 2025-03-14T06:24:19.0900418Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 5s local ... 2025-03-14T06:24:19.2911539Z 2025-03-14T06:24:19.2913015Z  2025-03-14T06:24:19.2913518Z  2025-03-14T06:24:19.2913934Z  2025-03-14T06:24:19.2914335Z  2025-03-14T06:24:19.2914752Z  2025-03-14T06:24:19.2915200Z  2025-03-14T06:24:19.2915628Z  2025-03-14T06:24:19.2916061Z  2025-03-14T06:24:19.2916678Z [9,809 / 20,647] 48 actions, 47 running 2025-03-14T06:24:19.2917627Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:19.2918443Z Compiling llvm/lib/TableGen/Record.cpp [for tool]; 8s local 2025-03-14T06:24:19.2919385Z Compiling src/google/protobuf/descriptor.cc; 8s local 2025-03-14T06:24:19.2920335Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2025-03-14T06:24:19.2921230Z Compiling src/cpu/cpu_softmax_list.cpp; 6s local 2025-03-14T06:24:19.2921961Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:24:19.2922602Z Compiling src/cpu/cpu_sum.cpp; 5s local 2025-03-14T06:24:19.2923480Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 5s local ... 2025-03-14T06:24:19.5167696Z 2025-03-14T06:24:19.5168940Z  2025-03-14T06:24:19.5169729Z  2025-03-14T06:24:19.5170433Z  2025-03-14T06:24:19.5180870Z  2025-03-14T06:24:19.5181855Z  2025-03-14T06:24:19.5182512Z  2025-03-14T06:24:19.5183184Z  2025-03-14T06:24:19.5183818Z  2025-03-14T06:24:19.5184666Z [9,815 / 20,647] 48 actions, 47 running 2025-03-14T06:24:19.5193468Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:19.5194454Z Compiling src/google/protobuf/descriptor.cc; 8s local 2025-03-14T06:24:19.5195493Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 6s local 2025-03-14T06:24:19.5196559Z Compiling src/cpu/cpu_softmax_list.cpp; 6s local 2025-03-14T06:24:19.5197437Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:24:19.5198241Z Compiling src/cpu/cpu_sum.cpp; 5s local 2025-03-14T06:24:19.5199261Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 5s local 2025-03-14T06:24:19.5225364Z Compiling src/cpu/cpu_reduction_list.cpp; 4s local ... 2025-03-14T06:24:19.7183489Z 2025-03-14T06:24:19.7184357Z  2025-03-14T06:24:19.7184780Z  2025-03-14T06:24:19.7185203Z  2025-03-14T06:24:19.7185576Z  2025-03-14T06:24:19.7185971Z  2025-03-14T06:24:19.7186373Z  2025-03-14T06:24:19.7186775Z  2025-03-14T06:24:19.7187191Z  2025-03-14T06:24:19.7187795Z [9,824 / 20,647] 48 actions, 47 running 2025-03-14T06:24:19.7188586Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:19.7189271Z Compiling src/google/protobuf/descriptor.cc; 9s local 2025-03-14T06:24:19.7190128Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2025-03-14T06:24:19.7191225Z Compiling src/cpu/cpu_softmax_list.cpp; 6s local 2025-03-14T06:24:19.7191900Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:24:19.7192463Z Compiling src/cpu/cpu_sum.cpp; 5s local 2025-03-14T06:24:19.7193420Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 5s local 2025-03-14T06:24:19.7194363Z Compiling src/cpu/cpu_reduction_list.cpp; 4s local ... 2025-03-14T06:24:19.9241546Z 2025-03-14T06:24:19.9242429Z  2025-03-14T06:24:19.9243182Z  2025-03-14T06:24:19.9243636Z  2025-03-14T06:24:19.9244039Z  2025-03-14T06:24:19.9244460Z  2025-03-14T06:24:19.9245100Z  2025-03-14T06:24:19.9245509Z  2025-03-14T06:24:19.9245924Z  2025-03-14T06:24:19.9246529Z [9,830 / 20,647] 48 actions running 2025-03-14T06:24:19.9247230Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:19.9247950Z Compiling src/google/protobuf/descriptor.cc; 9s local 2025-03-14T06:24:19.9248852Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2025-03-14T06:24:19.9249650Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:24:19.9250292Z Compiling src/cpu/cpu_sum.cpp; 6s local 2025-03-14T06:24:19.9251212Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 6s local 2025-03-14T06:24:19.9252261Z Compiling src/cpu/cpu_reduction_list.cpp; 4s local 2025-03-14T06:24:19.9252944Z Compiling google/fft.cc; 4s local ... 2025-03-14T06:24:20.1245007Z 2025-03-14T06:24:20.1245992Z  2025-03-14T06:24:20.1246468Z  2025-03-14T06:24:20.1246869Z  2025-03-14T06:24:20.1247251Z  2025-03-14T06:24:20.1247589Z  2025-03-14T06:24:20.1248229Z  2025-03-14T06:24:20.1248658Z  2025-03-14T06:24:20.1249043Z  2025-03-14T06:24:20.1249610Z [9,834 / 20,647] 48 actions running 2025-03-14T06:24:20.1250298Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:20.1251005Z Compiling src/google/protobuf/descriptor.cc; 9s local 2025-03-14T06:24:20.1251888Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2025-03-14T06:24:20.1252789Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:24:20.1253389Z Compiling src/cpu/cpu_sum.cpp; 6s local 2025-03-14T06:24:20.1254284Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 6s local 2025-03-14T06:24:20.1255280Z Compiling src/cpu/cpu_reduction_list.cpp; 4s local 2025-03-14T06:24:20.1255986Z Compiling google/fft.cc; 4s local ... 2025-03-14T06:24:20.3458531Z 2025-03-14T06:24:20.3459373Z  2025-03-14T06:24:20.3459875Z  2025-03-14T06:24:20.3460287Z  2025-03-14T06:24:20.3460694Z  2025-03-14T06:24:20.3461130Z  2025-03-14T06:24:20.3461537Z  2025-03-14T06:24:20.3461950Z  2025-03-14T06:24:20.3462339Z  2025-03-14T06:24:20.3462920Z [9,840 / 20,647] 48 actions, 47 running 2025-03-14T06:24:20.3463589Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:20.3464319Z Compiling src/google/protobuf/descriptor.cc; 9s local 2025-03-14T06:24:20.3465197Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2025-03-14T06:24:20.3466269Z Compiling src/cpu/cpu_sum.cpp; 6s local 2025-03-14T06:24:20.3467177Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 6s local 2025-03-14T06:24:20.3468174Z Compiling src/cpu/cpu_reduction_list.cpp; 5s local 2025-03-14T06:24:20.3468856Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:20.3469599Z Compiling src/google/protobuf/text_format.cc; 3s local ... 2025-03-14T06:24:20.5609195Z 2025-03-14T06:24:20.5610063Z  2025-03-14T06:24:20.5610573Z  2025-03-14T06:24:20.5611027Z  2025-03-14T06:24:20.5611464Z  2025-03-14T06:24:20.5611889Z  2025-03-14T06:24:20.5612299Z  2025-03-14T06:24:20.5612706Z  2025-03-14T06:24:20.5613124Z  2025-03-14T06:24:20.5613736Z [9,846 / 20,647] 48 actions, 47 running 2025-03-14T06:24:20.5614767Z Compiling google/fft.cc; 12s local 2025-03-14T06:24:20.5615479Z Compiling src/google/protobuf/descriptor.cc; 9s local 2025-03-14T06:24:20.5616407Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 7s local 2025-03-14T06:24:20.5617188Z Compiling src/cpu/cpu_sum.cpp; 6s local 2025-03-14T06:24:20.5618301Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 6s local 2025-03-14T06:24:20.5619302Z Compiling src/cpu/cpu_reduction_list.cpp; 5s local 2025-03-14T06:24:20.5620172Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:20.5620993Z Compiling src/google/protobuf/text_format.cc; 4s local ... 2025-03-14T06:24:20.7639293Z 2025-03-14T06:24:20.7640114Z  2025-03-14T06:24:20.7640616Z  2025-03-14T06:24:20.7641031Z  2025-03-14T06:24:20.7641441Z  2025-03-14T06:24:20.7641850Z  2025-03-14T06:24:20.7642259Z  2025-03-14T06:24:20.7642645Z  2025-03-14T06:24:20.7643039Z  2025-03-14T06:24:20.7643651Z [9,851 / 20,647] 48 actions, 47 running 2025-03-14T06:24:20.7644357Z Compiling google/fft.cc; 12s local 2025-03-14T06:24:20.7645289Z Compiling src/google/protobuf/descriptor.cc; 10s local 2025-03-14T06:24:20.7646298Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 8s local 2025-03-14T06:24:20.7647057Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:20.7647954Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 6s local 2025-03-14T06:24:20.7648936Z Compiling src/cpu/cpu_reduction_list.cpp; 5s local 2025-03-14T06:24:20.7649650Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:20.7650616Z Compiling src/google/protobuf/text_format.cc; 4s local ... 2025-03-14T06:24:20.9686064Z 2025-03-14T06:24:20.9686889Z  2025-03-14T06:24:20.9687359Z  2025-03-14T06:24:20.9687780Z  2025-03-14T06:24:20.9688178Z  2025-03-14T06:24:20.9688585Z  2025-03-14T06:24:20.9688983Z  2025-03-14T06:24:20.9689410Z  2025-03-14T06:24:20.9689861Z  2025-03-14T06:24:20.9690559Z [9,857 / 20,647] 48 actions, 47 running 2025-03-14T06:24:20.9691270Z Compiling google/fft.cc; 12s local 2025-03-14T06:24:20.9692012Z Compiling src/google/protobuf/descriptor.cc; 10s local 2025-03-14T06:24:20.9692970Z Compiling llvm/lib/TableGen/TGParser.cpp [for tool]; 8s local 2025-03-14T06:24:20.9693853Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:20.9694844Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 7s local 2025-03-14T06:24:20.9695895Z Compiling src/cpu/cpu_reduction_list.cpp; 5s local 2025-03-14T06:24:20.9696585Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:20.9697330Z Compiling src/google/protobuf/text_format.cc; 4s local ... 2025-03-14T06:24:21.2704576Z 2025-03-14T06:24:21.2705383Z  2025-03-14T06:24:21.2705813Z  2025-03-14T06:24:21.2706177Z  2025-03-14T06:24:21.2706555Z  2025-03-14T06:24:21.2706904Z  2025-03-14T06:24:21.2707258Z  2025-03-14T06:24:21.2707605Z  2025-03-14T06:24:21.2707930Z  2025-03-14T06:24:21.2708429Z [9,862 / 20,647] 48 actions, 47 running 2025-03-14T06:24:21.2709038Z Compiling google/fft.cc; 12s local 2025-03-14T06:24:21.2709791Z Compiling src/google/protobuf/descriptor.cc; 10s local 2025-03-14T06:24:21.2710496Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:21.2711247Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 7s local 2025-03-14T06:24:21.2712161Z Compiling src/cpu/cpu_reduction_list.cpp; 5s local 2025-03-14T06:24:21.2712895Z Compiling google/fft.cc; 5s local 2025-03-14T06:24:21.2713566Z Compiling src/google/protobuf/text_format.cc; 4s local 2025-03-14T06:24:21.2714380Z Compiling src/cpu/gemm_convolution.cpp; 4s local ... 2025-03-14T06:24:21.4767851Z 2025-03-14T06:24:21.4768707Z  2025-03-14T06:24:21.4769178Z  2025-03-14T06:24:21.4769564Z  2025-03-14T06:24:21.4769974Z  2025-03-14T06:24:21.4770651Z  2025-03-14T06:24:21.4771055Z  2025-03-14T06:24:21.4771464Z  2025-03-14T06:24:21.4771885Z  2025-03-14T06:24:21.4772510Z [9,870 / 20,647] 48 actions, 47 running 2025-03-14T06:24:21.4773170Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:21.4774190Z Compiling src/google/protobuf/descriptor.cc; 10s local 2025-03-14T06:24:21.4774904Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:21.4775800Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 7s local 2025-03-14T06:24:21.4776846Z Compiling src/cpu/cpu_reduction_list.cpp; 6s local 2025-03-14T06:24:21.4777622Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:21.4778497Z Compiling src/google/protobuf/text_format.cc; 5s local 2025-03-14T06:24:21.4779600Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 4s local ... 2025-03-14T06:24:21.7256141Z 2025-03-14T06:24:21.7257008Z  2025-03-14T06:24:21.7257518Z  2025-03-14T06:24:21.7257970Z  2025-03-14T06:24:21.7258388Z  2025-03-14T06:24:21.7258806Z  2025-03-14T06:24:21.7259205Z  2025-03-14T06:24:21.7259627Z  2025-03-14T06:24:21.7260035Z  2025-03-14T06:24:21.7260622Z [9,877 / 20,647] 48 actions running 2025-03-14T06:24:21.7261332Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:21.7262093Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T06:24:21.7262871Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:21.7263748Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 7s local 2025-03-14T06:24:21.7264736Z Compiling src/cpu/cpu_reduction_list.cpp; 6s local 2025-03-14T06:24:21.7265909Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:21.7266808Z Compiling src/google/protobuf/text_format.cc; 5s local 2025-03-14T06:24:21.7267863Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local ... 2025-03-14T06:24:21.9263362Z 2025-03-14T06:24:21.9264249Z  2025-03-14T06:24:21.9264776Z  2025-03-14T06:24:21.9265182Z  2025-03-14T06:24:21.9265810Z  2025-03-14T06:24:21.9266212Z  2025-03-14T06:24:21.9266623Z  2025-03-14T06:24:21.9267034Z  2025-03-14T06:24:21.9267435Z  2025-03-14T06:24:21.9268068Z [9,883 / 20,647] 48 actions, 47 running 2025-03-14T06:24:21.9268760Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:21.9269471Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T06:24:21.9270363Z Compiling src/cpu/cpu_sum.cpp; 8s local 2025-03-14T06:24:21.9271237Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2025-03-14T06:24:21.9272286Z Compiling src/cpu/cpu_reduction_list.cpp; 6s local 2025-03-14T06:24:21.9273016Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:21.9273745Z Compiling src/google/protobuf/text_format.cc; 5s local 2025-03-14T06:24:21.9274810Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local ... 2025-03-14T06:24:22.1610390Z 2025-03-14T06:24:22.1611254Z  2025-03-14T06:24:22.1611818Z  2025-03-14T06:24:22.1612238Z  2025-03-14T06:24:22.1612650Z  2025-03-14T06:24:22.1613061Z  2025-03-14T06:24:22.1613513Z  2025-03-14T06:24:22.1613971Z  2025-03-14T06:24:22.1614390Z  2025-03-14T06:24:22.1615007Z [9,891 / 20,647] 48 actions, 47 running 2025-03-14T06:24:22.1615712Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:22.1616476Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T06:24:22.1617262Z Compiling src/cpu/cpu_sum.cpp; 8s local 2025-03-14T06:24:22.1618214Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2025-03-14T06:24:22.1619248Z Compiling src/cpu/cpu_reduction_list.cpp; 6s local 2025-03-14T06:24:22.1619995Z Compiling google/fft.cc; 6s local 2025-03-14T06:24:22.1620888Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T06:24:22.1622296Z Compiling src/cpu/cpu_resampling_list.cpp; 4s local ... 2025-03-14T06:24:22.3921420Z 2025-03-14T06:24:22.3922270Z  2025-03-14T06:24:22.3922749Z  2025-03-14T06:24:22.3923178Z  2025-03-14T06:24:22.3923586Z  2025-03-14T06:24:22.3924017Z  2025-03-14T06:24:22.3924830Z  2025-03-14T06:24:22.3925240Z  2025-03-14T06:24:22.3925654Z  2025-03-14T06:24:22.3926250Z [9,896 / 20,647] 48 actions, 47 running 2025-03-14T06:24:22.3926912Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:22.3927842Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T06:24:22.3928609Z Compiling src/cpu/cpu_sum.cpp; 8s local 2025-03-14T06:24:22.3929543Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2025-03-14T06:24:22.3930571Z Compiling src/cpu/cpu_reduction_list.cpp; 7s local 2025-03-14T06:24:22.3931313Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:22.3932172Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T06:24:22.3933220Z Compiling src/cpu/cpu_resampling_list.cpp; 4s local ... 2025-03-14T06:24:22.5977361Z 2025-03-14T06:24:22.5978225Z  2025-03-14T06:24:22.5978709Z  2025-03-14T06:24:22.5979088Z  2025-03-14T06:24:22.5979533Z  2025-03-14T06:24:22.5979941Z  2025-03-14T06:24:22.5980350Z  2025-03-14T06:24:22.5980778Z  2025-03-14T06:24:22.5981175Z  2025-03-14T06:24:22.5981763Z [9,901 / 20,647] 48 actions, 47 running 2025-03-14T06:24:22.5982442Z Compiling google/fft.cc; 14s local 2025-03-14T06:24:22.5983154Z Compiling src/google/protobuf/descriptor.cc; 11s local 2025-03-14T06:24:22.5984135Z Compiling src/cpu/cpu_sum.cpp; 8s local 2025-03-14T06:24:22.5985005Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2025-03-14T06:24:22.5987887Z Compiling src/cpu/cpu_reduction_list.cpp; 7s local 2025-03-14T06:24:22.5988654Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:22.5989547Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T06:24:22.5990562Z Compiling src/cpu/cpu_resampling_list.cpp; 4s local ... 2025-03-14T06:24:22.8305515Z 2025-03-14T06:24:22.8306402Z  2025-03-14T06:24:22.8306989Z  2025-03-14T06:24:22.8307410Z  2025-03-14T06:24:22.8307816Z  2025-03-14T06:24:22.8308218Z  2025-03-14T06:24:22.8308614Z  2025-03-14T06:24:22.8309024Z  2025-03-14T06:24:22.8309418Z  2025-03-14T06:24:22.8310062Z [9,908 / 20,647] 48 actions, 47 running 2025-03-14T06:24:22.8310752Z Compiling google/fft.cc; 14s local 2025-03-14T06:24:22.8311632Z Compiling src/google/protobuf/descriptor.cc; 12s local 2025-03-14T06:24:22.8312380Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:22.8313280Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:24:22.8314262Z Compiling src/cpu/cpu_reduction_list.cpp; 7s local 2025-03-14T06:24:22.8314988Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:22.8315778Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:22.8316802Z Compiling src/cpu/cpu_resampling_list.cpp; 5s local ... 2025-03-14T06:24:23.0786357Z 2025-03-14T06:24:23.0787381Z  2025-03-14T06:24:23.0787886Z  2025-03-14T06:24:23.0788387Z  2025-03-14T06:24:23.0788891Z  2025-03-14T06:24:23.0789359Z  2025-03-14T06:24:23.0789750Z  2025-03-14T06:24:23.0790184Z  2025-03-14T06:24:23.0790601Z  2025-03-14T06:24:23.0791230Z [9,912 / 20,647] 48 actions, 47 running 2025-03-14T06:24:23.0791905Z Compiling google/fft.cc; 14s local 2025-03-14T06:24:23.0792710Z Compiling src/google/protobuf/descriptor.cc; 12s local 2025-03-14T06:24:23.0793520Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:23.0794429Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:24:23.0795712Z Compiling src/cpu/cpu_reduction_list.cpp; 7s local 2025-03-14T06:24:23.0796456Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:23.0797369Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:23.0798455Z Compiling src/cpu/cpu_resampling_list.cpp; 5s local ... 2025-03-14T06:24:23.2793564Z 2025-03-14T06:24:23.2794449Z  2025-03-14T06:24:23.2794940Z  2025-03-14T06:24:23.2795357Z  2025-03-14T06:24:23.2795775Z  2025-03-14T06:24:23.2796196Z  2025-03-14T06:24:23.2796810Z  2025-03-14T06:24:23.2797236Z  2025-03-14T06:24:23.2797643Z  2025-03-14T06:24:23.2798263Z [9,917 / 20,647] 48 actions, 47 running 2025-03-14T06:24:23.2798953Z Compiling google/fft.cc; 14s local 2025-03-14T06:24:23.2799659Z Compiling src/google/protobuf/descriptor.cc; 12s local 2025-03-14T06:24:23.2800425Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:23.2801471Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:24:23.2802456Z Compiling src/cpu/cpu_reduction_list.cpp; 7s local 2025-03-14T06:24:23.2803190Z Compiling google/fft.cc; 7s local 2025-03-14T06:24:23.2804100Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:23.2805291Z Compiling src/cpu/cpu_resampling_list.cpp; 5s local ... 2025-03-14T06:24:23.4802708Z 2025-03-14T06:24:23.4803594Z  2025-03-14T06:24:23.4804089Z  2025-03-14T06:24:23.4804689Z  2025-03-14T06:24:23.4805118Z  2025-03-14T06:24:23.4805587Z  2025-03-14T06:24:23.4805995Z  2025-03-14T06:24:23.4806397Z  2025-03-14T06:24:23.4807100Z  2025-03-14T06:24:23.4807744Z [9,924 / 20,647] 48 actions, 47 running 2025-03-14T06:24:23.4808566Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:23.4809339Z Compiling src/google/protobuf/descriptor.cc; 12s local 2025-03-14T06:24:23.4810145Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:23.4811621Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:24:23.4812711Z Compiling src/cpu/cpu_reduction_list.cpp; 8s local 2025-03-14T06:24:23.4813642Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:23.4814705Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:23.4815947Z Compiling src/cpu/cpu_resampling_list.cpp; 5s local ... 2025-03-14T06:24:23.6889386Z 2025-03-14T06:24:23.6890218Z  2025-03-14T06:24:23.6890735Z  2025-03-14T06:24:23.6891186Z  2025-03-14T06:24:23.6891605Z  2025-03-14T06:24:23.6892030Z  2025-03-14T06:24:23.6892446Z  2025-03-14T06:24:23.6892876Z  2025-03-14T06:24:23.6893289Z  2025-03-14T06:24:23.6893918Z [9,933 / 20,647] 48 actions, 47 running 2025-03-14T06:24:23.6894618Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:23.6895332Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T06:24:23.6896100Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:23.6897012Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:24:23.6897955Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:23.6898835Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:23.6899863Z Compiling src/cpu/cpu_resampling_list.cpp; 5s local 2025-03-14T06:24:23.6900876Z Compiling src/cpu/gemm_x8s8s32x_convolution.cpp; 4s local ... 2025-03-14T06:24:23.9144733Z 2025-03-14T06:24:23.9145766Z  2025-03-14T06:24:23.9146272Z  2025-03-14T06:24:23.9146669Z  2025-03-14T06:24:23.9147033Z  2025-03-14T06:24:23.9147423Z  2025-03-14T06:24:23.9147812Z  2025-03-14T06:24:23.9148226Z  2025-03-14T06:24:23.9148632Z  2025-03-14T06:24:23.9149239Z [9,941 / 20,647] 48 actions, 47 running 2025-03-14T06:24:23.9149931Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:23.9152911Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T06:24:23.9153681Z Compiling src/cpu/cpu_sum.cpp; 10s local 2025-03-14T06:24:23.9154328Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:23.9155188Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T06:24:23.9156360Z Compiling src/cpu/cpu_resampling_list.cpp; 6s local 2025-03-14T06:24:23.9157227Z Compiling src/cpu/gemm_x8s8s32x_convolution.cpp; 5s local 2025-03-14T06:24:23.9158385Z Compiling src/google/protobuf/util/message_differencer.cc; 5s local ... 2025-03-14T06:24:24.1270240Z 2025-03-14T06:24:24.1272615Z  2025-03-14T06:24:24.1273207Z  2025-03-14T06:24:24.1273667Z  2025-03-14T06:24:24.1274077Z  2025-03-14T06:24:24.1274478Z  2025-03-14T06:24:24.1274893Z  2025-03-14T06:24:24.1275294Z  2025-03-14T06:24:24.1275694Z  2025-03-14T06:24:24.1276272Z [9,952 / 20,647] 48 actions running 2025-03-14T06:24:24.1276949Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:24.1277685Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T06:24:24.1278448Z Compiling src/cpu/cpu_sum.cpp; 10s local 2025-03-14T06:24:24.1279062Z Compiling google/fft.cc; 8s local 2025-03-14T06:24:24.1280010Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T06:24:24.1281024Z Compiling src/cpu/cpu_resampling_list.cpp; 6s local 2025-03-14T06:24:24.1281937Z Compiling src/cpu/gemm_x8s8s32x_convolution.cpp; 5s local 2025-03-14T06:24:24.1283107Z Compiling src/google/protobuf/util/message_differencer.cc; 5s local ... 2025-03-14T06:24:24.3274092Z 2025-03-14T06:24:24.3275345Z  2025-03-14T06:24:24.3275874Z  2025-03-14T06:24:24.3276304Z  2025-03-14T06:24:24.3276738Z  2025-03-14T06:24:24.3277640Z  2025-03-14T06:24:24.3278057Z  2025-03-14T06:24:24.3278476Z  2025-03-14T06:24:24.3278886Z  2025-03-14T06:24:24.3279463Z [9,960 / 20,647] 48 actions running 2025-03-14T06:24:24.3280174Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:24.3280925Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T06:24:24.3281725Z Compiling src/cpu/cpu_sum.cpp; 10s local 2025-03-14T06:24:24.3282405Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:24.3283303Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T06:24:24.3284338Z Compiling src/cpu/cpu_resampling_list.cpp; 6s local 2025-03-14T06:24:24.3285355Z Compiling src/cpu/gemm_x8s8s32x_convolution.cpp; 5s local 2025-03-14T06:24:24.3286448Z Compiling src/google/protobuf/util/message_differencer.cc; 5s local ... 2025-03-14T06:24:24.5308241Z 2025-03-14T06:24:24.5309107Z  2025-03-14T06:24:24.5309626Z  2025-03-14T06:24:24.5310044Z  2025-03-14T06:24:24.5310472Z  2025-03-14T06:24:24.5310897Z  2025-03-14T06:24:24.5311301Z  2025-03-14T06:24:24.5311729Z  2025-03-14T06:24:24.5312179Z  2025-03-14T06:24:24.5312800Z [9,975 / 20,647] 48 actions, 47 running 2025-03-14T06:24:24.5313478Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:24.5314230Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T06:24:24.5315050Z Compiling src/cpu/cpu_sum.cpp; 10s local 2025-03-14T06:24:24.5315705Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:24.5316591Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T06:24:24.5317641Z Compiling src/cpu/cpu_resampling_list.cpp; 6s local 2025-03-14T06:24:24.5318466Z Compiling src/common/memory_zero_pad.cpp; 5s local 2025-03-14T06:24:24.5319300Z Compiling src/cpu/gemm_inner_product.cpp; 4s local ... 2025-03-14T06:24:24.7662567Z 2025-03-14T06:24:24.7663478Z  2025-03-14T06:24:24.7663976Z  2025-03-14T06:24:24.7664362Z  2025-03-14T06:24:24.7664781Z  2025-03-14T06:24:24.7676340Z  2025-03-14T06:24:24.7676819Z  2025-03-14T06:24:24.7677554Z  2025-03-14T06:24:24.7677970Z  2025-03-14T06:24:24.7678528Z [9,979 / 20,647] 48 actions, 47 running 2025-03-14T06:24:24.7679263Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:24.7679973Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T06:24:24.7680868Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:24.7681517Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:24.7682470Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:24.7683426Z Compiling src/cpu/cpu_resampling_list.cpp; 7s local 2025-03-14T06:24:24.7684238Z Compiling src/common/memory_zero_pad.cpp; 5s local 2025-03-14T06:24:24.7685135Z Compiling src/cpu/gemm_inner_product.cpp; 4s local ... 2025-03-14T06:24:25.0096232Z 2025-03-14T06:24:25.0097070Z  2025-03-14T06:24:25.0097547Z  2025-03-14T06:24:25.0097945Z  2025-03-14T06:24:25.0098336Z  2025-03-14T06:24:25.0098721Z  2025-03-14T06:24:25.0099136Z  2025-03-14T06:24:25.0099528Z  2025-03-14T06:24:25.0099920Z  2025-03-14T06:24:25.0100507Z [9,985 / 20,647] 48 actions, 47 running 2025-03-14T06:24:25.0101173Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:25.0102026Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T06:24:25.0102789Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:25.0103433Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:25.0104306Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:25.0105309Z Compiling src/cpu/cpu_resampling_list.cpp; 7s local 2025-03-14T06:24:25.0106335Z Compiling src/common/memory_zero_pad.cpp; 5s local 2025-03-14T06:24:25.0107165Z Compiling src/cpu/gemm_inner_product.cpp; 5s local ... 2025-03-14T06:24:25.2146775Z 2025-03-14T06:24:25.2147760Z  2025-03-14T06:24:25.2148243Z  2025-03-14T06:24:25.2148661Z  2025-03-14T06:24:25.2149115Z  2025-03-14T06:24:25.2149526Z  2025-03-14T06:24:25.2149928Z  2025-03-14T06:24:25.2150350Z  2025-03-14T06:24:25.2150784Z  2025-03-14T06:24:25.2151407Z [9,991 / 20,647] 48 actions, 47 running 2025-03-14T06:24:25.2152117Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:25.2152891Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T06:24:25.2153697Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:25.2154361Z Compiling google/fft.cc; 9s local 2025-03-14T06:24:25.2155273Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:25.2156325Z Compiling src/common/memory_zero_pad.cpp; 6s local 2025-03-14T06:24:25.2157109Z Compiling src/cpu/gemm_inner_product.cpp; 5s local 2025-03-14T06:24:25.2158013Z Compiling .../cpu/runtime_single_threaded_matmul_c128.cc; 4s local ... 2025-03-14T06:24:25.4180949Z 2025-03-14T06:24:25.4181743Z  2025-03-14T06:24:25.4182189Z  2025-03-14T06:24:25.4182578Z  2025-03-14T06:24:25.4182939Z  2025-03-14T06:24:25.4183291Z  2025-03-14T06:24:25.4183645Z  2025-03-14T06:24:25.4184005Z  2025-03-14T06:24:25.4184362Z  2025-03-14T06:24:25.4184883Z [9,997 / 20,647] 48 actions, 47 running 2025-03-14T06:24:25.4185498Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:25.4186124Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T06:24:25.4186769Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:25.4187311Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:25.4188079Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:25.4188943Z Compiling src/common/memory_zero_pad.cpp; 6s local 2025-03-14T06:24:25.4189617Z Compiling src/cpu/gemm_inner_product.cpp; 5s local 2025-03-14T06:24:25.4190396Z Compiling .../cpu/runtime_single_threaded_matmul_c128.cc; 5s local ... 2025-03-14T06:24:25.6605798Z 2025-03-14T06:24:25.6606888Z  2025-03-14T06:24:25.6607398Z  2025-03-14T06:24:25.6607820Z  2025-03-14T06:24:25.6608238Z  2025-03-14T06:24:25.6608658Z  2025-03-14T06:24:25.6609070Z  2025-03-14T06:24:25.6609487Z  2025-03-14T06:24:25.6609997Z  2025-03-14T06:24:25.6610816Z [10,005 / 20,647] 48 actions, 47 running 2025-03-14T06:24:25.6611496Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:25.6612259Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T06:24:25.6613228Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:25.6613898Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:25.6614789Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:25.6615811Z Compiling src/common/memory_zero_pad.cpp; 6s local 2025-03-14T06:24:25.6616620Z Compiling src/cpu/gemm_inner_product.cpp; 5s local 2025-03-14T06:24:25.6617519Z Compiling .../cpu/runtime_single_threaded_matmul_c128.cc; 5s local ... 2025-03-14T06:24:25.9282689Z 2025-03-14T06:24:25.9283561Z  2025-03-14T06:24:25.9284154Z  2025-03-14T06:24:25.9284741Z  2025-03-14T06:24:25.9285125Z  2025-03-14T06:24:25.9285517Z  2025-03-14T06:24:25.9285924Z  2025-03-14T06:24:25.9286383Z  2025-03-14T06:24:25.9286762Z  2025-03-14T06:24:25.9287370Z [10,010 / 20,647] 48 actions running 2025-03-14T06:24:25.9288104Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:25.9288832Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T06:24:25.9289608Z Compiling src/cpu/cpu_sum.cpp; 12s local 2025-03-14T06:24:25.9290256Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:25.9291445Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:25.9292465Z Compiling src/common/memory_zero_pad.cpp; 6s local 2025-03-14T06:24:25.9293266Z Compiling src/cpu/gemm_inner_product.cpp; 6s local 2025-03-14T06:24:25.9294170Z Compiling .../cpu/runtime_single_threaded_matmul_c128.cc; 5s local ... 2025-03-14T06:24:26.1569990Z 2025-03-14T06:24:26.1570845Z  2025-03-14T06:24:26.1571336Z  2025-03-14T06:24:26.1571721Z  2025-03-14T06:24:26.1572085Z  2025-03-14T06:24:26.1572603Z  2025-03-14T06:24:26.1573144Z  2025-03-14T06:24:26.1573658Z  2025-03-14T06:24:26.1574172Z  2025-03-14T06:24:26.1574841Z [10,016 / 20,647] 48 actions, 47 running 2025-03-14T06:24:26.1575476Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:26.1576229Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T06:24:26.1576967Z Compiling src/cpu/cpu_sum.cpp; 12s local 2025-03-14T06:24:26.1577597Z Compiling google/fft.cc; 10s local 2025-03-14T06:24:26.1578480Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:26.1579454Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:26.1580248Z Compiling src/cpu/gemm_inner_product.cpp; 6s local 2025-03-14T06:24:26.1581149Z Compiling .../cpu/runtime_single_threaded_matmul_c128.cc; 5s local ... 2025-03-14T06:24:26.3746697Z 2025-03-14T06:24:26.3747604Z  2025-03-14T06:24:26.3748132Z  2025-03-14T06:24:26.3748579Z  2025-03-14T06:24:26.3749045Z  2025-03-14T06:24:26.3749466Z  2025-03-14T06:24:26.3749901Z  2025-03-14T06:24:26.3750333Z  2025-03-14T06:24:26.3750763Z  2025-03-14T06:24:26.3751416Z [10,027 / 20,647] 48 actions, 47 running 2025-03-14T06:24:26.3752132Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:26.3752865Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T06:24:26.3753667Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:26.3754610Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:26.3755704Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:26.3756788Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2025-03-14T06:24:26.3758020Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 5s local 2025-03-14T06:24:26.3758920Z Compiling src/common/memory_zero_pad.cpp; 4s local ... 2025-03-14T06:24:26.5918132Z 2025-03-14T06:24:26.5919015Z  2025-03-14T06:24:26.5919825Z  2025-03-14T06:24:26.5920229Z  2025-03-14T06:24:26.5920647Z  2025-03-14T06:24:26.5921085Z  2025-03-14T06:24:26.5921514Z  2025-03-14T06:24:26.5921918Z  2025-03-14T06:24:26.5922330Z  2025-03-14T06:24:26.5923124Z [10,037 / 20,647] 48 actions, 47 running 2025-03-14T06:24:26.5923856Z Compiling google/fft.cc; 18s local 2025-03-14T06:24:26.5924784Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T06:24:26.5925545Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:26.5926481Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:26.5927524Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:26.5928520Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2025-03-14T06:24:26.5929603Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 5s local 2025-03-14T06:24:26.5930472Z Compiling src/common/memory_zero_pad.cpp; 4s local ... 2025-03-14T06:24:26.8063981Z 2025-03-14T06:24:26.8064817Z  2025-03-14T06:24:26.8065499Z  2025-03-14T06:24:26.8065958Z  2025-03-14T06:24:26.8066404Z  2025-03-14T06:24:26.8066818Z  2025-03-14T06:24:26.8067236Z  2025-03-14T06:24:26.8067692Z  2025-03-14T06:24:26.8068119Z  2025-03-14T06:24:26.8068725Z [10,047 / 20,647] 48 actions, 47 running 2025-03-14T06:24:26.8069682Z Compiling google/fft.cc; 18s local 2025-03-14T06:24:26.8070333Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:26.8071246Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T06:24:26.8072339Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:26.8073376Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2025-03-14T06:24:26.8074426Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 5s local 2025-03-14T06:24:26.8075240Z Compiling src/common/memory_zero_pad.cpp; 4s local 2025-03-14T06:24:26.8076140Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 4s local ... 2025-03-14T06:24:27.0333589Z 2025-03-14T06:24:27.0334482Z  2025-03-14T06:24:27.0334971Z  2025-03-14T06:24:27.0335344Z  2025-03-14T06:24:27.0335764Z  2025-03-14T06:24:27.0336215Z  2025-03-14T06:24:27.0336641Z  2025-03-14T06:24:27.0337061Z  2025-03-14T06:24:27.0337478Z  2025-03-14T06:24:27.0338131Z [10,056 / 20,647] 48 actions, 47 running 2025-03-14T06:24:27.0338842Z Compiling google/fft.cc; 18s local 2025-03-14T06:24:27.0339481Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:27.0340396Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T06:24:27.0341443Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:27.0342448Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2025-03-14T06:24:27.0343477Z Compiling src/common/memory_zero_pad.cpp; 5s local 2025-03-14T06:24:27.0344336Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 4s local 2025-03-14T06:24:27.0345229Z Compiling src/common/rnn.cpp; 3s local ... 2025-03-14T06:24:27.2390641Z 2025-03-14T06:24:27.2391496Z  2025-03-14T06:24:27.2391987Z  2025-03-14T06:24:27.2392438Z  2025-03-14T06:24:27.2392847Z  2025-03-14T06:24:27.2393264Z  2025-03-14T06:24:27.2393703Z  2025-03-14T06:24:27.2394096Z  2025-03-14T06:24:27.2394491Z  2025-03-14T06:24:27.2395099Z [10,063 / 20,647] 48 actions, 47 running 2025-03-14T06:24:27.2395809Z Compiling google/fft.cc; 18s local 2025-03-14T06:24:27.2396445Z Compiling google/fft.cc; 11s local 2025-03-14T06:24:27.2397371Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T06:24:27.2398626Z Compiling src/common/memory_zero_pad.cpp; 8s local 2025-03-14T06:24:27.2399604Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2025-03-14T06:24:27.2400796Z Compiling src/common/memory_zero_pad.cpp; 5s local 2025-03-14T06:24:27.2401641Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 4s local 2025-03-14T06:24:27.2402511Z Compiling src/cpu/cpu_pooling_list.cpp; 3s local ... 2025-03-14T06:24:27.5014882Z 2025-03-14T06:24:27.5015951Z  2025-03-14T06:24:27.5016517Z  2025-03-14T06:24:27.5016991Z  2025-03-14T06:24:27.5017406Z  2025-03-14T06:24:27.5017828Z  2025-03-14T06:24:27.5018243Z  2025-03-14T06:24:27.5018705Z  2025-03-14T06:24:27.5019156Z  2025-03-14T06:24:27.5019801Z [10,071 / 20,647] 48 actions, 47 running 2025-03-14T06:24:27.5020524Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:27.5021230Z Compiling google/fft.cc; 12s local 2025-03-14T06:24:27.5022098Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T06:24:27.5023101Z Compiling src/common/memory_zero_pad.cpp; 8s local 2025-03-14T06:24:27.5024047Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 7s local 2025-03-14T06:24:27.5025033Z Compiling src/common/memory_zero_pad.cpp; 5s local 2025-03-14T06:24:27.5025831Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 4s local 2025-03-14T06:24:27.5026648Z Compiling src/cpu/cpu_pooling_list.cpp; 4s local ... 2025-03-14T06:24:27.7171596Z 2025-03-14T06:24:27.7172463Z  2025-03-14T06:24:27.7172946Z  2025-03-14T06:24:27.7173592Z  2025-03-14T06:24:27.7174032Z  2025-03-14T06:24:27.7174447Z  2025-03-14T06:24:27.7174874Z  2025-03-14T06:24:27.7175270Z  2025-03-14T06:24:27.7175665Z  2025-03-14T06:24:27.7176244Z [10,080 / 20,647] 48 actions, 47 running 2025-03-14T06:24:27.7176966Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:27.7177684Z Compiling google/fft.cc; 12s local 2025-03-14T06:24:27.7178565Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:27.7179505Z Compiling src/common/memory_zero_pad.cpp; 8s local 2025-03-14T06:24:27.7180441Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 7s local 2025-03-14T06:24:27.7181327Z Compiling src/common/memory_zero_pad.cpp; 5s local 2025-03-14T06:24:27.7182134Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 4s local 2025-03-14T06:24:27.7182937Z Compiling src/cpu/cpu_pooling_list.cpp; 4s local ... 2025-03-14T06:24:27.9298315Z 2025-03-14T06:24:27.9299322Z  2025-03-14T06:24:27.9299821Z  2025-03-14T06:24:27.9300222Z  2025-03-14T06:24:27.9300638Z  2025-03-14T06:24:27.9301024Z  2025-03-14T06:24:27.9301403Z  2025-03-14T06:24:27.9301787Z  2025-03-14T06:24:27.9302174Z  2025-03-14T06:24:27.9302756Z [10,087 / 20,647] 47 actions running 2025-03-14T06:24:27.9303422Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:27.9303986Z Compiling google/fft.cc; 12s local 2025-03-14T06:24:27.9304822Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:27.9305809Z Compiling src/common/memory_zero_pad.cpp; 8s local 2025-03-14T06:24:27.9306512Z Compiling src/common/memory_zero_pad.cpp; 5s local 2025-03-14T06:24:27.9307287Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local 2025-03-14T06:24:27.9308092Z Compiling src/cpu/cpu_pooling_list.cpp; 4s local 2025-03-14T06:24:27.9308945Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 4s local ... 2025-03-14T06:24:28.1459836Z 2025-03-14T06:24:28.1460704Z  2025-03-14T06:24:28.1461184Z  2025-03-14T06:24:28.1461581Z  2025-03-14T06:24:28.1461969Z  2025-03-14T06:24:28.1462358Z  2025-03-14T06:24:28.1462728Z  2025-03-14T06:24:28.1463119Z  2025-03-14T06:24:28.1463812Z  2025-03-14T06:24:28.1464393Z [10,092 / 20,647] 48 actions, 47 running 2025-03-14T06:24:28.1465073Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:28.1465949Z Compiling google/fft.cc; 12s local 2025-03-14T06:24:28.1466971Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:28.1467917Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:28.1468658Z Compiling src/common/memory_zero_pad.cpp; 6s local 2025-03-14T06:24:28.1469607Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local 2025-03-14T06:24:28.1470379Z Compiling src/cpu/cpu_pooling_list.cpp; 4s local 2025-03-14T06:24:28.1471220Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 4s local ... 2025-03-14T06:24:28.3479920Z 2025-03-14T06:24:28.3480805Z  2025-03-14T06:24:28.3481296Z  2025-03-14T06:24:28.3481697Z  2025-03-14T06:24:28.3482079Z  2025-03-14T06:24:28.3482461Z  2025-03-14T06:24:28.3482895Z  2025-03-14T06:24:28.3483288Z  2025-03-14T06:24:28.3483679Z  2025-03-14T06:24:28.3484274Z [10,098 / 20,647] 48 actions, 47 running 2025-03-14T06:24:28.3485073Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:28.3485691Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:28.3486499Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:28.3487449Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:28.3488211Z Compiling src/common/memory_zero_pad.cpp; 6s local 2025-03-14T06:24:28.3488974Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local 2025-03-14T06:24:28.3490019Z Compiling src/cpu/cpu_pooling_list.cpp; 4s local 2025-03-14T06:24:28.3490822Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 4s local ... 2025-03-14T06:24:28.5661592Z 2025-03-14T06:24:28.5662405Z  2025-03-14T06:24:28.5662876Z  2025-03-14T06:24:28.5663276Z  2025-03-14T06:24:28.5663719Z  2025-03-14T06:24:28.5664138Z  2025-03-14T06:24:28.5664537Z  2025-03-14T06:24:28.5664959Z  2025-03-14T06:24:28.5665574Z  2025-03-14T06:24:28.5666227Z [10,107 / 20,647] 48 actions, 47 running 2025-03-14T06:24:28.5666974Z Compiling google/fft.cc; 20s local 2025-03-14T06:24:28.5667618Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:28.5668665Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:28.5669693Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:28.5670496Z Compiling src/common/memory_zero_pad.cpp; 6s local 2025-03-14T06:24:28.5671318Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local 2025-03-14T06:24:28.5672090Z Compiling src/cpu/cpu_pooling_list.cpp; 5s local 2025-03-14T06:24:28.5672968Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 4s local ... 2025-03-14T06:24:28.7760308Z 2025-03-14T06:24:28.7761198Z  2025-03-14T06:24:28.7761737Z  2025-03-14T06:24:28.7762282Z  2025-03-14T06:24:28.7762722Z  2025-03-14T06:24:28.7763152Z  2025-03-14T06:24:28.7763566Z  2025-03-14T06:24:28.7763969Z  2025-03-14T06:24:28.7764385Z  2025-03-14T06:24:28.7765153Z [10,114 / 20,647] 48 actions, 47 running 2025-03-14T06:24:28.7766100Z Compiling google/fft.cc; 20s local 2025-03-14T06:24:28.7766736Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:28.7767662Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:28.7768674Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:28.7769464Z Compiling src/common/memory_zero_pad.cpp; 6s local 2025-03-14T06:24:28.7770260Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local 2025-03-14T06:24:28.7771075Z Compiling src/cpu/cpu_pooling_list.cpp; 5s local 2025-03-14T06:24:28.7771975Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 4s local ... 2025-03-14T06:24:29.0070085Z 2025-03-14T06:24:29.0070872Z  2025-03-14T06:24:29.0071273Z  2025-03-14T06:24:29.0071669Z  2025-03-14T06:24:29.0072050Z  2025-03-14T06:24:29.0072428Z  2025-03-14T06:24:29.0072807Z  2025-03-14T06:24:29.0073194Z  2025-03-14T06:24:29.0073833Z  2025-03-14T06:24:29.0074328Z [10,120 / 20,647] 48 actions, 47 running 2025-03-14T06:24:29.0074884Z Compiling google/fft.cc; 20s local 2025-03-14T06:24:29.0075463Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:29.0076492Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:29.0077444Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:29.0078214Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:29.0079029Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:29.0079800Z Compiling src/cpu/cpu_pooling_list.cpp; 5s local 2025-03-14T06:24:29.0080661Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 5s local ... 2025-03-14T06:24:29.2280478Z 2025-03-14T06:24:29.2281322Z  2025-03-14T06:24:29.2281859Z  2025-03-14T06:24:29.2282311Z  2025-03-14T06:24:29.2282735Z  2025-03-14T06:24:29.2283164Z  2025-03-14T06:24:29.2283639Z  2025-03-14T06:24:29.2284061Z  2025-03-14T06:24:29.2284607Z  2025-03-14T06:24:29.2285237Z [10,127 / 20,647] 48 actions, 47 running 2025-03-14T06:24:29.2285918Z Compiling google/fft.cc; 20s local 2025-03-14T06:24:29.2286545Z Compiling google/fft.cc; 13s local 2025-03-14T06:24:29.2287431Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:29.2288682Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:29.2289503Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:29.2290315Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:29.2291258Z Compiling src/cpu/cpu_pooling_list.cpp; 5s local 2025-03-14T06:24:29.2292168Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 5s local ... 2025-03-14T06:24:29.4520633Z 2025-03-14T06:24:29.4521643Z  2025-03-14T06:24:29.4522130Z  2025-03-14T06:24:29.4522556Z  2025-03-14T06:24:29.4522980Z  2025-03-14T06:24:29.4523380Z  2025-03-14T06:24:29.4523777Z  2025-03-14T06:24:29.4524163Z  2025-03-14T06:24:29.4524670Z  2025-03-14T06:24:29.4525269Z [10,132 / 20,647] 48 actions, 47 running 2025-03-14T06:24:29.4525951Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:29.4526533Z Compiling google/fft.cc; 14s local 2025-03-14T06:24:29.4527403Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:29.4528389Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:29.4529155Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:29.4529967Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:29.4530772Z Compiling src/cpu/cpu_pooling_list.cpp; 5s local 2025-03-14T06:24:29.4531650Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 5s local ... 2025-03-14T06:24:29.7194302Z 2025-03-14T06:24:29.7195149Z  2025-03-14T06:24:29.7195683Z  2025-03-14T06:24:29.7196081Z  2025-03-14T06:24:29.7196483Z  2025-03-14T06:24:29.7196864Z  2025-03-14T06:24:29.7197262Z  2025-03-14T06:24:29.7197646Z  2025-03-14T06:24:29.7198014Z  2025-03-14T06:24:29.7198655Z [10,138 / 20,647] 48 actions, 47 running 2025-03-14T06:24:29.7199283Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:29.7199892Z Compiling google/fft.cc; 14s local 2025-03-14T06:24:29.7200767Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:29.7201772Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:29.7202517Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:29.7203546Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:29.7204356Z Compiling src/cpu/cpu_pooling_list.cpp; 6s local 2025-03-14T06:24:29.7205427Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 5s local ... 2025-03-14T06:24:29.9311802Z 2025-03-14T06:24:29.9312687Z  2025-03-14T06:24:29.9313181Z  2025-03-14T06:24:29.9313585Z  2025-03-14T06:24:29.9313984Z  2025-03-14T06:24:29.9314381Z  2025-03-14T06:24:29.9314780Z  2025-03-14T06:24:29.9315178Z  2025-03-14T06:24:29.9315847Z  2025-03-14T06:24:29.9316461Z [10,141 / 20,647] 48 actions running 2025-03-14T06:24:29.9317157Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:29.9317759Z Compiling google/fft.cc; 14s local 2025-03-14T06:24:29.9318589Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:29.9319591Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:29.9320404Z Compiling src/common/memory_zero_pad.cpp; 7s local 2025-03-14T06:24:29.9321277Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2025-03-14T06:24:29.9322121Z Compiling src/cpu/cpu_pooling_list.cpp; 6s local 2025-03-14T06:24:29.9323001Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 6s local ... 2025-03-14T06:24:30.1329695Z 2025-03-14T06:24:30.1330543Z  2025-03-14T06:24:30.1331049Z  2025-03-14T06:24:30.1331463Z  2025-03-14T06:24:30.1331828Z  2025-03-14T06:24:30.1332194Z  2025-03-14T06:24:30.1332605Z  2025-03-14T06:24:30.1332977Z  2025-03-14T06:24:30.1333330Z  2025-03-14T06:24:30.1334183Z [10,145 / 20,647] 48 actions, 47 running 2025-03-14T06:24:30.1334885Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:30.1335486Z Compiling google/fft.cc; 14s local 2025-03-14T06:24:30.1336325Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:30.1337282Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:30.1338072Z Compiling src/common/memory_zero_pad.cpp; 8s local 2025-03-14T06:24:30.1338808Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2025-03-14T06:24:30.1339542Z Compiling src/cpu/cpu_pooling_list.cpp; 6s local 2025-03-14T06:24:30.1340363Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 6s local ... 2025-03-14T06:24:30.4012465Z 2025-03-14T06:24:30.4013289Z  2025-03-14T06:24:30.4013717Z  2025-03-14T06:24:30.4014092Z  2025-03-14T06:24:30.4014488Z  2025-03-14T06:24:30.4014855Z  2025-03-14T06:24:30.4015217Z  2025-03-14T06:24:30.4015605Z  2025-03-14T06:24:30.4015979Z  2025-03-14T06:24:30.4016540Z [10,152 / 20,647] 48 actions, 47 running 2025-03-14T06:24:30.4017166Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:30.4017702Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:30.4018485Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:30.4019406Z Compiling src/common/memory_zero_pad.cpp; 11s local 2025-03-14T06:24:30.4020111Z Compiling src/common/memory_zero_pad.cpp; 8s local 2025-03-14T06:24:30.4020878Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2025-03-14T06:24:30.4021611Z Compiling src/cpu/cpu_pooling_list.cpp; 6s local 2025-03-14T06:24:30.4022412Z Compiling .../cpu/runtime_single_threaded_matmul_f64.cc; 6s local ... 2025-03-14T06:24:30.6632277Z 2025-03-14T06:24:30.6633093Z  2025-03-14T06:24:30.6633630Z  2025-03-14T06:24:30.6634031Z  2025-03-14T06:24:30.6634440Z  2025-03-14T06:24:30.6634873Z  2025-03-14T06:24:30.6635225Z  2025-03-14T06:24:30.6635628Z  2025-03-14T06:24:30.6636002Z  2025-03-14T06:24:30.6636661Z [10,157 / 20,647] 48 actions, 47 running 2025-03-14T06:24:30.6637379Z Compiling google/fft.cc; 22s local 2025-03-14T06:24:30.6637954Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:30.6639042Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:30.6640024Z Compiling src/common/memory_zero_pad.cpp; 11s local 2025-03-14T06:24:30.6640895Z Compiling src/common/memory_zero_pad.cpp; 8s local 2025-03-14T06:24:30.6641811Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2025-03-14T06:24:30.6642515Z Compiling src/cpu/cpu_pooling_list.cpp; 7s local 2025-03-14T06:24:30.6643221Z Compiling src/cpu/ref_pooling.cpp; 5s local ... 2025-03-14T06:24:30.8926526Z 2025-03-14T06:24:30.8927704Z  2025-03-14T06:24:30.8928279Z  2025-03-14T06:24:30.8928674Z  2025-03-14T06:24:30.8929051Z  2025-03-14T06:24:30.8929468Z  2025-03-14T06:24:30.8929844Z  2025-03-14T06:24:30.8930223Z  2025-03-14T06:24:30.8930610Z  2025-03-14T06:24:30.8931197Z [10,162 / 20,647] 48 actions, 47 running 2025-03-14T06:24:30.8931825Z Compiling google/fft.cc; 22s local 2025-03-14T06:24:30.8932410Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:30.8933247Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:30.8934189Z Compiling src/common/memory_zero_pad.cpp; 11s local 2025-03-14T06:24:30.8934933Z Compiling src/common/memory_zero_pad.cpp; 8s local 2025-03-14T06:24:30.8935760Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:30.8936519Z Compiling src/cpu/cpu_pooling_list.cpp; 7s local 2025-03-14T06:24:30.8937273Z Compiling src/cpu/ref_pooling.cpp; 5s local ... 2025-03-14T06:24:31.1300848Z 2025-03-14T06:24:31.1301841Z  2025-03-14T06:24:31.1302376Z  2025-03-14T06:24:31.1302789Z  2025-03-14T06:24:31.1303446Z  2025-03-14T06:24:31.1303849Z  2025-03-14T06:24:31.1304271Z  2025-03-14T06:24:31.1304692Z  2025-03-14T06:24:31.1305101Z  2025-03-14T06:24:31.1305722Z [10,168 / 20,647] 48 actions, 47 running 2025-03-14T06:24:31.1306385Z Compiling google/fft.cc; 22s local 2025-03-14T06:24:31.1307019Z Compiling google/fft.cc; 15s local 2025-03-14T06:24:31.1307906Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:31.1308927Z Compiling src/common/memory_zero_pad.cpp; 11s local 2025-03-14T06:24:31.1309744Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:31.1310545Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:31.1311336Z Compiling src/cpu/cpu_pooling_list.cpp; 7s local 2025-03-14T06:24:31.1312082Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:24:31.3321771Z 2025-03-14T06:24:31.3322581Z  2025-03-14T06:24:31.3322998Z  2025-03-14T06:24:31.3323370Z  2025-03-14T06:24:31.3323703Z  2025-03-14T06:24:31.3324035Z  2025-03-14T06:24:31.3324378Z  2025-03-14T06:24:31.3324870Z  2025-03-14T06:24:31.3325241Z  2025-03-14T06:24:31.3325741Z [10,178 / 20,647] 48 actions running 2025-03-14T06:24:31.3326338Z Compiling google/fft.cc; 22s local 2025-03-14T06:24:31.3326863Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:31.3327565Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:31.3328447Z Compiling src/common/memory_zero_pad.cpp; 12s local 2025-03-14T06:24:31.3329148Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:31.3329846Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:31.3330553Z Compiling src/cpu/cpu_pooling_list.cpp; 7s local 2025-03-14T06:24:31.3331248Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:24:31.5326674Z 2025-03-14T06:24:31.5327541Z  2025-03-14T06:24:31.5328035Z  2025-03-14T06:24:31.5328438Z  2025-03-14T06:24:31.5328852Z  2025-03-14T06:24:31.5329270Z  2025-03-14T06:24:31.5329664Z  2025-03-14T06:24:31.5330092Z  2025-03-14T06:24:31.5330529Z  2025-03-14T06:24:31.5331130Z [10,181 / 20,647] 48 actions running 2025-03-14T06:24:31.5332058Z Compiling google/fft.cc; 23s local 2025-03-14T06:24:31.5332714Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:31.5333660Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:31.5334860Z Compiling src/common/memory_zero_pad.cpp; 12s local 2025-03-14T06:24:31.5335668Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:31.5336516Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:31.5337468Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:31.5338254Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:24:31.7721212Z 2025-03-14T06:24:31.7722102Z  2025-03-14T06:24:31.7722630Z  2025-03-14T06:24:31.7723052Z  2025-03-14T06:24:31.7723418Z  2025-03-14T06:24:31.7723795Z  2025-03-14T06:24:31.7724166Z  2025-03-14T06:24:31.7724682Z  2025-03-14T06:24:31.7725070Z  2025-03-14T06:24:31.7725588Z [10,188 / 20,647] 48 actions, 47 running 2025-03-14T06:24:31.7726236Z Compiling google/fft.cc; 23s local 2025-03-14T06:24:31.7726830Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:31.7727688Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T06:24:31.7728703Z Compiling src/common/memory_zero_pad.cpp; 12s local 2025-03-14T06:24:31.7729468Z Compiling src/common/memory_zero_pad.cpp; 9s local 2025-03-14T06:24:31.7730310Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:31.7731133Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:31.7732299Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:24:31.9928242Z 2025-03-14T06:24:31.9929127Z  2025-03-14T06:24:31.9929629Z  2025-03-14T06:24:31.9930064Z  2025-03-14T06:24:31.9930502Z  2025-03-14T06:24:31.9930904Z  2025-03-14T06:24:31.9931319Z  2025-03-14T06:24:31.9931745Z  2025-03-14T06:24:31.9932171Z  2025-03-14T06:24:31.9932731Z [10,193 / 20,647] 48 actions, 47 running 2025-03-14T06:24:31.9933412Z Compiling google/fft.cc; 23s local 2025-03-14T06:24:31.9934003Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:31.9934874Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T06:24:31.9936045Z Compiling src/common/memory_zero_pad.cpp; 12s local 2025-03-14T06:24:31.9936894Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:31.9937674Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2025-03-14T06:24:31.9938440Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:31.9939136Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:24:32.2030715Z 2025-03-14T06:24:32.2032229Z  2025-03-14T06:24:32.2032891Z  2025-03-14T06:24:32.2033505Z  2025-03-14T06:24:32.2034734Z  2025-03-14T06:24:32.2035257Z  2025-03-14T06:24:32.2035853Z  2025-03-14T06:24:32.2036313Z  2025-03-14T06:24:32.2036790Z  2025-03-14T06:24:32.2037496Z [10,197 / 20,647] 48 actions, 47 running 2025-03-14T06:24:32.2038257Z Compiling google/fft.cc; 23s local 2025-03-14T06:24:32.2038838Z Compiling google/fft.cc; 16s local 2025-03-14T06:24:32.2039694Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T06:24:32.2040686Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:32.2041484Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:32.2042308Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2025-03-14T06:24:32.2043142Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:32.2043905Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2025-03-14T06:24:32.4210306Z 2025-03-14T06:24:32.4211578Z  2025-03-14T06:24:32.4212356Z  2025-03-14T06:24:32.4213051Z  2025-03-14T06:24:32.4213628Z  2025-03-14T06:24:32.4214665Z  2025-03-14T06:24:32.4215221Z  2025-03-14T06:24:32.4215836Z  2025-03-14T06:24:32.4216406Z  2025-03-14T06:24:32.4217184Z [10,207 / 20,647] 48 actions, 47 running 2025-03-14T06:24:32.4218004Z Compiling google/fft.cc; 24s local 2025-03-14T06:24:32.4218993Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:32.4220099Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T06:24:32.4221415Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:32.4222574Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:32.4315750Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2025-03-14T06:24:32.4316750Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:32.4317537Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2025-03-14T06:24:32.7306607Z 2025-03-14T06:24:32.7307507Z  2025-03-14T06:24:32.7307979Z  2025-03-14T06:24:32.7308393Z  2025-03-14T06:24:32.7308842Z  2025-03-14T06:24:32.7309342Z  2025-03-14T06:24:32.7309771Z  2025-03-14T06:24:32.7310164Z  2025-03-14T06:24:32.7310625Z  2025-03-14T06:24:32.7311269Z [10,210 / 20,647] 48 actions, 47 running 2025-03-14T06:24:32.7312016Z Compiling google/fft.cc; 24s local 2025-03-14T06:24:32.7312653Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:32.7313660Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T06:24:32.7314694Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:32.7315511Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:32.7316541Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2025-03-14T06:24:32.7317370Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2025-03-14T06:24:32.7318150Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2025-03-14T06:24:32.9334904Z 2025-03-14T06:24:32.9335735Z  2025-03-14T06:24:32.9336235Z  2025-03-14T06:24:32.9336677Z  2025-03-14T06:24:32.9337184Z  2025-03-14T06:24:32.9337569Z  2025-03-14T06:24:32.9337951Z  2025-03-14T06:24:32.9338448Z  2025-03-14T06:24:32.9338944Z  2025-03-14T06:24:32.9339491Z [10,220 / 20,647] 48 actions running 2025-03-14T06:24:32.9340142Z Compiling google/fft.cc; 24s local 2025-03-14T06:24:32.9340721Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:32.9341602Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T06:24:32.9342620Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:32.9343403Z Compiling src/common/memory_zero_pad.cpp; 10s local 2025-03-14T06:24:32.9344185Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 10s local 2025-03-14T06:24:32.9344953Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2025-03-14T06:24:32.9345693Z Compiling src/common/verbose.cpp; 7s local ... 2025-03-14T06:24:33.2252453Z 2025-03-14T06:24:33.2253486Z  2025-03-14T06:24:33.2254000Z  2025-03-14T06:24:33.2254400Z  2025-03-14T06:24:33.2254949Z  2025-03-14T06:24:33.2255353Z  2025-03-14T06:24:33.2255740Z  2025-03-14T06:24:33.2256135Z  2025-03-14T06:24:33.2256645Z  2025-03-14T06:24:33.2257280Z [10,227 / 20,647] 48 actions, 47 running 2025-03-14T06:24:33.2257923Z Compiling google/fft.cc; 24s local 2025-03-14T06:24:33.2258482Z Compiling google/fft.cc; 17s local 2025-03-14T06:24:33.2259376Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T06:24:33.2260454Z Compiling src/common/memory_zero_pad.cpp; 14s local 2025-03-14T06:24:33.2261336Z Compiling src/common/memory_zero_pad.cpp; 11s local 2025-03-14T06:24:33.2262075Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2025-03-14T06:24:33.2262802Z Compiling src/common/verbose.cpp; 7s local 2025-03-14T06:24:33.2263417Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:24:33.4498269Z 2025-03-14T06:24:33.4499157Z  2025-03-14T06:24:33.4499650Z  2025-03-14T06:24:33.4500091Z  2025-03-14T06:24:33.4500506Z  2025-03-14T06:24:33.4500917Z  2025-03-14T06:24:33.4501312Z  2025-03-14T06:24:33.4501702Z  2025-03-14T06:24:33.4502422Z  2025-03-14T06:24:33.4503048Z [10,232 / 20,647] 48 actions, 47 running 2025-03-14T06:24:33.4503746Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:33.4504338Z Compiling google/fft.cc; 18s local 2025-03-14T06:24:33.4505484Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T06:24:33.4506487Z Compiling src/common/memory_zero_pad.cpp; 14s local 2025-03-14T06:24:33.4507225Z Compiling src/common/memory_zero_pad.cpp; 11s local 2025-03-14T06:24:33.4507976Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2025-03-14T06:24:33.4508695Z Compiling src/common/verbose.cpp; 7s local 2025-03-14T06:24:33.4509344Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:24:33.7340079Z 2025-03-14T06:24:33.7340936Z  2025-03-14T06:24:33.7341401Z  2025-03-14T06:24:33.7341807Z  2025-03-14T06:24:33.7342208Z  2025-03-14T06:24:33.7342598Z  2025-03-14T06:24:33.7342994Z  2025-03-14T06:24:33.7343392Z  2025-03-14T06:24:33.7343822Z  2025-03-14T06:24:33.7344378Z [10,236 / 20,647] 48 actions running 2025-03-14T06:24:33.7345021Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:33.7345740Z Compiling google/fft.cc; 18s local 2025-03-14T06:24:33.7346635Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:33.7347989Z Compiling src/common/memory_zero_pad.cpp; 14s local 2025-03-14T06:24:33.7348784Z Compiling src/common/memory_zero_pad.cpp; 11s local 2025-03-14T06:24:33.7349601Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2025-03-14T06:24:33.7350350Z Compiling src/common/verbose.cpp; 7s local 2025-03-14T06:24:33.7351002Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:24:33.9345735Z 2025-03-14T06:24:33.9346603Z  2025-03-14T06:24:33.9347145Z  2025-03-14T06:24:33.9347542Z  2025-03-14T06:24:33.9347946Z  2025-03-14T06:24:33.9348359Z  2025-03-14T06:24:33.9348760Z  2025-03-14T06:24:33.9349212Z  2025-03-14T06:24:33.9349623Z  2025-03-14T06:24:33.9350197Z [10,242 / 20,647] 48 actions running 2025-03-14T06:24:33.9350898Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:33.9351537Z Compiling google/fft.cc; 18s local 2025-03-14T06:24:33.9352431Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:33.9353475Z Compiling src/common/memory_zero_pad.cpp; 14s local 2025-03-14T06:24:33.9354277Z Compiling src/common/memory_zero_pad.cpp; 11s local 2025-03-14T06:24:33.9355059Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2025-03-14T06:24:33.9355819Z Compiling src/common/verbose.cpp; 8s local 2025-03-14T06:24:33.9356480Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:24:34.1532881Z 2025-03-14T06:24:34.1533717Z  2025-03-14T06:24:34.1534218Z  2025-03-14T06:24:34.1534644Z  2025-03-14T06:24:34.1535048Z  2025-03-14T06:24:34.1535455Z  2025-03-14T06:24:34.1535903Z  2025-03-14T06:24:34.1536292Z  2025-03-14T06:24:34.1536685Z  2025-03-14T06:24:34.1537299Z [10,255 / 20,647] 48 actions, 47 running 2025-03-14T06:24:34.1537978Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:34.1538622Z Compiling google/fft.cc; 18s local 2025-03-14T06:24:34.1539552Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:34.1540624Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:34.1541455Z Compiling src/common/memory_zero_pad.cpp; 12s local 2025-03-14T06:24:34.1542243Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2025-03-14T06:24:34.1542932Z Compiling src/common/verbose.cpp; 8s local 2025-03-14T06:24:34.1543889Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:24:34.3662458Z 2025-03-14T06:24:34.3663286Z  2025-03-14T06:24:34.3663743Z  2025-03-14T06:24:34.3664244Z  2025-03-14T06:24:34.3664621Z  2025-03-14T06:24:34.3665023Z  2025-03-14T06:24:34.3665940Z  2025-03-14T06:24:34.3666340Z  2025-03-14T06:24:34.3666772Z  2025-03-14T06:24:34.3667400Z [10,262 / 20,647] 48 actions, 47 running 2025-03-14T06:24:34.3668253Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:34.3668908Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:34.3669765Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:34.3670772Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:34.3671515Z Compiling src/common/memory_zero_pad.cpp; 12s local 2025-03-14T06:24:34.3672276Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2025-03-14T06:24:34.3673020Z Compiling src/common/verbose.cpp; 8s local 2025-03-14T06:24:34.3673739Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:24:34.5858424Z 2025-03-14T06:24:34.5859307Z  2025-03-14T06:24:34.5859832Z  2025-03-14T06:24:34.5860253Z  2025-03-14T06:24:34.5860676Z  2025-03-14T06:24:34.5861129Z  2025-03-14T06:24:34.5861558Z  2025-03-14T06:24:34.5861974Z  2025-03-14T06:24:34.5862390Z  2025-03-14T06:24:34.5863017Z [10,279 / 20,647] 48 actions, 47 running 2025-03-14T06:24:34.5863725Z Compiling google/fft.cc; 26s local 2025-03-14T06:24:34.5864437Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:34.5877158Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:34.5878261Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:34.5879062Z Compiling src/common/memory_zero_pad.cpp; 12s local 2025-03-14T06:24:34.5879826Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:34.5880563Z Compiling src/common/verbose.cpp; 8s local 2025-03-14T06:24:34.5881356Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local ... 2025-03-14T06:24:34.8027788Z 2025-03-14T06:24:34.8029277Z  2025-03-14T06:24:34.8029984Z  2025-03-14T06:24:34.8030656Z  2025-03-14T06:24:34.8031736Z  2025-03-14T06:24:34.8032196Z  2025-03-14T06:24:34.8032616Z  2025-03-14T06:24:34.8033009Z  2025-03-14T06:24:34.8033426Z  2025-03-14T06:24:34.8034101Z [10,286 / 20,647] 48 actions, 47 running 2025-03-14T06:24:34.8034799Z Compiling google/fft.cc; 26s local 2025-03-14T06:24:34.8035489Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:34.8036377Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T06:24:34.8037239Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:34.8038015Z Compiling src/common/memory_zero_pad.cpp; 12s local 2025-03-14T06:24:34.8038784Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:34.8039519Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:24:34.8040325Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local ... 2025-03-14T06:24:35.0870059Z 2025-03-14T06:24:35.0870939Z  2025-03-14T06:24:35.0871465Z  2025-03-14T06:24:35.0871881Z  2025-03-14T06:24:35.0872261Z  2025-03-14T06:24:35.0872657Z  2025-03-14T06:24:35.0873073Z  2025-03-14T06:24:35.0873465Z  2025-03-14T06:24:35.0873853Z  2025-03-14T06:24:35.0874455Z [10,300 / 20,647] 48 actions, 47 running 2025-03-14T06:24:35.0875151Z Compiling google/fft.cc; 26s local 2025-03-14T06:24:35.0875741Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:35.0876580Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T06:24:35.0877557Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:35.0878338Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:35.0879373Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:35.0880081Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:24:35.0880831Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local ... 2025-03-14T06:24:35.2958129Z 2025-03-14T06:24:35.2959103Z  2025-03-14T06:24:35.2959553Z  2025-03-14T06:24:35.2959924Z  2025-03-14T06:24:35.2960499Z  2025-03-14T06:24:35.2960875Z  2025-03-14T06:24:35.2961380Z  2025-03-14T06:24:35.2962085Z  2025-03-14T06:24:35.2962629Z  2025-03-14T06:24:35.2963378Z [10,308 / 20,647] 48 actions, 47 running 2025-03-14T06:24:35.2964350Z Compiling google/fft.cc; 26s local 2025-03-14T06:24:35.2965219Z Compiling google/fft.cc; 19s local 2025-03-14T06:24:35.2966482Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T06:24:35.2967634Z Compiling src/common/memory_zero_pad.cpp; 16s local 2025-03-14T06:24:35.2968549Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:35.2969466Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:35.2970337Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:24:35.2971318Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local ... 2025-03-14T06:24:35.5201583Z 2025-03-14T06:24:35.5202473Z  2025-03-14T06:24:35.5202922Z  2025-03-14T06:24:35.5203290Z  2025-03-14T06:24:35.5203676Z  2025-03-14T06:24:35.5204074Z  2025-03-14T06:24:35.5204669Z  2025-03-14T06:24:35.5205069Z  2025-03-14T06:24:35.5205466Z  2025-03-14T06:24:35.5206348Z [10,310 / 20,647] 48 actions, 47 running 2025-03-14T06:24:35.5207035Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:35.5207628Z Compiling google/fft.cc; 20s local 2025-03-14T06:24:35.5208514Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T06:24:35.5209452Z Compiling src/common/memory_zero_pad.cpp; 16s local 2025-03-14T06:24:35.5210205Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:35.5210967Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:35.5211687Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:24:35.5212485Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local ... 2025-03-14T06:24:35.7182323Z 2025-03-14T06:24:35.7183316Z  2025-03-14T06:24:35.7183811Z  2025-03-14T06:24:35.7184258Z  2025-03-14T06:24:35.7184647Z  2025-03-14T06:24:35.7185106Z  2025-03-14T06:24:35.7185515Z  2025-03-14T06:24:35.7185923Z  2025-03-14T06:24:35.7186344Z  2025-03-14T06:24:35.7186960Z [10,313 / 20,647] 48 actions, 47 running 2025-03-14T06:24:35.7187644Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:35.7188242Z Compiling google/fft.cc; 20s local 2025-03-14T06:24:35.7189087Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T06:24:35.7190111Z Compiling src/common/memory_zero_pad.cpp; 16s local 2025-03-14T06:24:35.7190879Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:35.7191661Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:35.7192382Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:24:35.7193193Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local ... 2025-03-14T06:24:35.9356669Z 2025-03-14T06:24:35.9357486Z  2025-03-14T06:24:35.9358004Z  2025-03-14T06:24:35.9358446Z  2025-03-14T06:24:35.9358850Z  2025-03-14T06:24:35.9359256Z  2025-03-14T06:24:35.9359669Z  2025-03-14T06:24:35.9360076Z  2025-03-14T06:24:35.9360488Z  2025-03-14T06:24:35.9361050Z [10,317 / 20,647] 48 actions running 2025-03-14T06:24:35.9361694Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:35.9362280Z Compiling google/fft.cc; 20s local 2025-03-14T06:24:35.9363143Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T06:24:35.9364433Z Compiling src/common/memory_zero_pad.cpp; 16s local 2025-03-14T06:24:35.9365556Z Compiling src/common/memory_zero_pad.cpp; 13s local 2025-03-14T06:24:35.9366351Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:35.9367316Z Compiling src/common/verbose.cpp; 10s local 2025-03-14T06:24:35.9368193Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local ... 2025-03-14T06:24:36.1867749Z 2025-03-14T06:24:36.1868641Z  2025-03-14T06:24:36.1869355Z  2025-03-14T06:24:36.1869818Z  2025-03-14T06:24:36.1870222Z  2025-03-14T06:24:36.1870618Z  2025-03-14T06:24:36.1871035Z  2025-03-14T06:24:36.1871449Z  2025-03-14T06:24:36.1871868Z  2025-03-14T06:24:36.1872490Z [10,322 / 20,647] 48 actions, 47 running 2025-03-14T06:24:36.1873169Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:36.1873815Z Compiling google/fft.cc; 20s local 2025-03-14T06:24:36.1874754Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T06:24:36.1875801Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:36.1876615Z Compiling src/common/memory_zero_pad.cpp; 14s local 2025-03-14T06:24:36.1877419Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:36.1878164Z Compiling src/common/verbose.cpp; 10s local 2025-03-14T06:24:36.1879041Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local ... 2025-03-14T06:24:36.4493019Z 2025-03-14T06:24:36.4493975Z  2025-03-14T06:24:36.4494459Z  2025-03-14T06:24:36.4495182Z  2025-03-14T06:24:36.4495742Z  2025-03-14T06:24:36.4496541Z  2025-03-14T06:24:36.4497155Z  2025-03-14T06:24:36.4497682Z  2025-03-14T06:24:36.4498216Z  2025-03-14T06:24:36.4498954Z [10,331 / 20,647] 48 actions, 47 running 2025-03-14T06:24:36.4499787Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:36.4500551Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:36.4501536Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T06:24:36.4502669Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:36.4503566Z Compiling src/common/memory_zero_pad.cpp; 14s local 2025-03-14T06:24:36.4504407Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:36.4505432Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2025-03-14T06:24:36.4506575Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local ... 2025-03-14T06:24:36.6593710Z 2025-03-14T06:24:36.6594549Z  2025-03-14T06:24:36.6595034Z  2025-03-14T06:24:36.6595448Z  2025-03-14T06:24:36.6595844Z  2025-03-14T06:24:36.6596210Z  2025-03-14T06:24:36.6596615Z  2025-03-14T06:24:36.6596993Z  2025-03-14T06:24:36.6597353Z  2025-03-14T06:24:36.6597918Z [10,337 / 20,647] 48 actions, 47 running 2025-03-14T06:24:36.6598623Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:36.6599189Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:36.6600046Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T06:24:36.6601031Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:36.6601776Z Compiling src/common/memory_zero_pad.cpp; 14s local 2025-03-14T06:24:36.6602510Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:36.6603377Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2025-03-14T06:24:36.6604338Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local ... 2025-03-14T06:24:36.8625054Z 2025-03-14T06:24:36.8625893Z  2025-03-14T06:24:36.8626321Z  2025-03-14T06:24:36.8626673Z  2025-03-14T06:24:36.8627016Z  2025-03-14T06:24:36.8627355Z  2025-03-14T06:24:36.8627690Z  2025-03-14T06:24:36.8628056Z  2025-03-14T06:24:36.8628393Z  2025-03-14T06:24:36.8629155Z [10,340 / 20,647] 48 actions, 47 running 2025-03-14T06:24:36.8629746Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:36.8630267Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:36.8630989Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:24:36.8631939Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:36.8632593Z Compiling src/common/memory_zero_pad.cpp; 14s local 2025-03-14T06:24:36.8633344Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:36.8634082Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2025-03-14T06:24:36.8634927Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local ... 2025-03-14T06:24:37.0674302Z 2025-03-14T06:24:37.0675267Z  2025-03-14T06:24:37.0675732Z  2025-03-14T06:24:37.0676138Z  2025-03-14T06:24:37.0676482Z  2025-03-14T06:24:37.0676836Z  2025-03-14T06:24:37.0677199Z  2025-03-14T06:24:37.0677599Z  2025-03-14T06:24:37.0677970Z  2025-03-14T06:24:37.0678547Z [10,352 / 20,647] 48 actions, 47 running 2025-03-14T06:24:37.0679197Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:37.0679769Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:37.0680586Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:24:37.0681560Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:37.0682301Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:37.0682998Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:37.0684040Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2025-03-14T06:24:37.0685082Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local ... 2025-03-14T06:24:37.2928297Z 2025-03-14T06:24:37.2929186Z  2025-03-14T06:24:37.2929683Z  2025-03-14T06:24:37.2930114Z  2025-03-14T06:24:37.2930517Z  2025-03-14T06:24:37.2930967Z  2025-03-14T06:24:37.2931386Z  2025-03-14T06:24:37.2931814Z  2025-03-14T06:24:37.2932235Z  2025-03-14T06:24:37.2932873Z [10,359 / 20,647] 48 actions, 47 running 2025-03-14T06:24:37.2933569Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:37.2934211Z Compiling google/fft.cc; 21s local 2025-03-14T06:24:37.2935124Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:24:37.2936147Z Compiling src/common/memory_zero_pad.cpp; 18s local 2025-03-14T06:24:37.2936891Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:37.2937660Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:37.2938480Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2025-03-14T06:24:37.2939467Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local ... 2025-03-14T06:24:37.5358149Z 2025-03-14T06:24:37.5359006Z  2025-03-14T06:24:37.5359507Z  2025-03-14T06:24:37.5359962Z  2025-03-14T06:24:37.5360370Z  2025-03-14T06:24:37.5360793Z  2025-03-14T06:24:37.5361189Z  2025-03-14T06:24:37.5361606Z  2025-03-14T06:24:37.5362004Z  2025-03-14T06:24:37.5362600Z [10,366 / 20,647] 47 actions, 46 running 2025-03-14T06:24:37.5363292Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:37.5364032Z Compiling google/fft.cc; 22s local 2025-03-14T06:24:37.5365062Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:24:37.5366258Z Compiling src/common/memory_zero_pad.cpp; 18s local 2025-03-14T06:24:37.5367098Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:37.5367960Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:37.5368874Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:24:37.5369902Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local ... 2025-03-14T06:24:37.7371702Z 2025-03-14T06:24:37.7372730Z  2025-03-14T06:24:37.7373231Z  2025-03-14T06:24:37.7373666Z  2025-03-14T06:24:37.7374109Z  2025-03-14T06:24:37.7374554Z  2025-03-14T06:24:37.7374977Z  2025-03-14T06:24:37.7375379Z  2025-03-14T06:24:37.7375956Z  2025-03-14T06:24:37.7376556Z [10,371 / 20,647] 47 actions running 2025-03-14T06:24:37.7377238Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:37.7377893Z Compiling google/fft.cc; 22s local 2025-03-14T06:24:37.7379015Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:24:37.7380101Z Compiling src/common/memory_zero_pad.cpp; 18s local 2025-03-14T06:24:37.7380890Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:37.7381709Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:37.7382644Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:24:37.7383752Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local ... 2025-03-14T06:24:37.9373010Z 2025-03-14T06:24:37.9373849Z  2025-03-14T06:24:37.9374377Z  2025-03-14T06:24:37.9374808Z  2025-03-14T06:24:37.9375238Z  2025-03-14T06:24:37.9375664Z  2025-03-14T06:24:37.9376109Z  2025-03-14T06:24:37.9376520Z  2025-03-14T06:24:37.9376925Z  2025-03-14T06:24:37.9377528Z [10,379 / 20,647] 47 actions running 2025-03-14T06:24:37.9378235Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:37.9378861Z Compiling google/fft.cc; 22s local 2025-03-14T06:24:37.9379713Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:24:37.9381140Z Compiling src/common/memory_zero_pad.cpp; 18s local 2025-03-14T06:24:37.9381959Z Compiling src/common/memory_zero_pad.cpp; 15s local 2025-03-14T06:24:37.9382759Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:37.9383626Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:24:37.9384666Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local ... 2025-03-14T06:24:38.1416418Z 2025-03-14T06:24:38.1417296Z  2025-03-14T06:24:38.1417783Z  2025-03-14T06:24:38.1418287Z  2025-03-14T06:24:38.1418858Z  2025-03-14T06:24:38.1419389Z  2025-03-14T06:24:38.1419900Z  2025-03-14T06:24:38.1420362Z  2025-03-14T06:24:38.1420815Z  2025-03-14T06:24:38.1421467Z [10,386 / 20,647] 47 actions, 46 running 2025-03-14T06:24:38.1422174Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:38.1422800Z Compiling google/fft.cc; 22s local 2025-03-14T06:24:38.1423659Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:24:38.1424607Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:38.1425360Z Compiling src/common/memory_zero_pad.cpp; 16s local 2025-03-14T06:24:38.1426155Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:38.1427121Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:24:38.1428102Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local ... 2025-03-14T06:24:38.3710692Z 2025-03-14T06:24:38.3711570Z  2025-03-14T06:24:38.3712087Z  2025-03-14T06:24:38.3712458Z  2025-03-14T06:24:38.3712884Z  2025-03-14T06:24:38.3713419Z  2025-03-14T06:24:38.3713898Z  2025-03-14T06:24:38.3714287Z  2025-03-14T06:24:38.3714690Z  2025-03-14T06:24:38.3715357Z [10,388 / 20,647] 47 actions, 46 running 2025-03-14T06:24:38.3716104Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:38.3716716Z Compiling google/fft.cc; 23s local 2025-03-14T06:24:38.3717648Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:24:38.3718756Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:38.3719515Z Compiling src/common/memory_zero_pad.cpp; 16s local 2025-03-14T06:24:38.3720579Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:38.3721568Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:24:38.3722557Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local ... 2025-03-14T06:24:38.5864849Z 2025-03-14T06:24:38.5865884Z  2025-03-14T06:24:38.5866418Z  2025-03-14T06:24:38.5866862Z  2025-03-14T06:24:38.5867264Z  2025-03-14T06:24:38.5867682Z  2025-03-14T06:24:38.5868095Z  2025-03-14T06:24:38.5868791Z  2025-03-14T06:24:38.5869190Z  2025-03-14T06:24:38.5869783Z [10,393 / 20,647] 47 actions, 46 running 2025-03-14T06:24:38.5870484Z Compiling google/fft.cc; 23s local 2025-03-14T06:24:38.5871393Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:24:38.5872427Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:38.5873233Z Compiling src/common/memory_zero_pad.cpp; 16s local 2025-03-14T06:24:38.5874059Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2025-03-14T06:24:38.5874936Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2025-03-14T06:24:38.5875953Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T06:24:38.5877009Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local ... 2025-03-14T06:24:38.8809683Z 2025-03-14T06:24:38.8810521Z  2025-03-14T06:24:38.8810989Z  2025-03-14T06:24:38.8811392Z  2025-03-14T06:24:38.8811790Z  2025-03-14T06:24:38.8812199Z  2025-03-14T06:24:38.8812589Z  2025-03-14T06:24:38.8813001Z  2025-03-14T06:24:38.8813415Z  2025-03-14T06:24:38.8814222Z [10,400 / 20,647] 47 actions, 46 running 2025-03-14T06:24:38.8814926Z Compiling google/fft.cc; 23s local 2025-03-14T06:24:38.8815947Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:24:38.8817024Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:38.8817811Z Compiling src/common/memory_zero_pad.cpp; 16s local 2025-03-14T06:24:38.8818619Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2025-03-14T06:24:38.8819572Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2025-03-14T06:24:38.8820623Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T06:24:38.8821621Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local ... 2025-03-14T06:24:39.1279896Z 2025-03-14T06:24:39.1280810Z  2025-03-14T06:24:39.1281437Z  2025-03-14T06:24:39.1281899Z  2025-03-14T06:24:39.1282313Z  2025-03-14T06:24:39.1282735Z  2025-03-14T06:24:39.1283156Z  2025-03-14T06:24:39.1283603Z  2025-03-14T06:24:39.1284026Z  2025-03-14T06:24:39.1284820Z [10,406 / 20,647] 46 actions, 44 running 2025-03-14T06:24:39.1285545Z Compiling google/fft.cc; 23s local 2025-03-14T06:24:39.1286493Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:24:39.1287529Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:39.1288336Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:39.1289134Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2025-03-14T06:24:39.1290649Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2025-03-14T06:24:39.1291780Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T06:24:39.1292906Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local ... 2025-03-14T06:24:39.3379667Z 2025-03-14T06:24:39.3380528Z  2025-03-14T06:24:39.3381030Z  2025-03-14T06:24:39.3381437Z  2025-03-14T06:24:39.3382337Z  2025-03-14T06:24:39.3382747Z  2025-03-14T06:24:39.3383355Z  2025-03-14T06:24:39.3383901Z  2025-03-14T06:24:39.3384466Z  2025-03-14T06:24:39.3385203Z [10,406 / 20,647] 47 actions running 2025-03-14T06:24:39.3386047Z Compiling google/fft.cc; 24s local 2025-03-14T06:24:39.3387375Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:24:39.3388579Z Compiling src/common/memory_zero_pad.cpp; 20s local 2025-03-14T06:24:39.3389535Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:39.3390709Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2025-03-14T06:24:39.3391754Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2025-03-14T06:24:39.3393021Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T06:24:39.3394164Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local ... 2025-03-14T06:24:39.6543653Z 2025-03-14T06:24:39.6544446Z  2025-03-14T06:24:39.6544970Z  2025-03-14T06:24:39.6545396Z  2025-03-14T06:24:39.6545805Z  2025-03-14T06:24:39.6546240Z  2025-03-14T06:24:39.6546675Z  2025-03-14T06:24:39.6547119Z  2025-03-14T06:24:39.6547544Z  2025-03-14T06:24:39.6548181Z [10,421 / 20,647] 48 actions, 46 running 2025-03-14T06:24:39.6548923Z Compiling google/fft.cc; 24s local 2025-03-14T06:24:39.6549865Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:24:39.6550956Z Compiling src/common/memory_zero_pad.cpp; 20s local 2025-03-14T06:24:39.6551826Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:39.6552591Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:39.6553523Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2025-03-14T06:24:39.6554469Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T06:24:39.6555698Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local ... 2025-03-14T06:24:39.8557847Z 2025-03-14T06:24:39.8558711Z  2025-03-14T06:24:39.8559208Z  2025-03-14T06:24:39.8561764Z  2025-03-14T06:24:39.8565012Z  2025-03-14T06:24:39.8573840Z  2025-03-14T06:24:39.8576873Z  2025-03-14T06:24:39.8579917Z  2025-03-14T06:24:39.8582920Z  2025-03-14T06:24:39.8583956Z [10,425 / 20,647] 48 actions, 47 running 2025-03-14T06:24:39.8584853Z Compiling google/fft.cc; 24s local 2025-03-14T06:24:39.8585919Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T06:24:39.8587156Z Compiling src/common/memory_zero_pad.cpp; 20s local 2025-03-14T06:24:39.8588293Z Compiling src/common/memory_zero_pad.cpp; 17s local 2025-03-14T06:24:39.8589640Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:39.8590560Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2025-03-14T06:24:39.8591629Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T06:24:39.8592575Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local ... 2025-03-14T06:24:40.1221955Z 2025-03-14T06:24:40.1222788Z  2025-03-14T06:24:40.1223284Z  2025-03-14T06:24:40.1223723Z  2025-03-14T06:24:40.1224134Z  2025-03-14T06:24:40.1224590Z  2025-03-14T06:24:40.1224993Z  2025-03-14T06:24:40.1225409Z  2025-03-14T06:24:40.1225816Z  2025-03-14T06:24:40.1226438Z [10,429 / 20,647] 48 actions, 47 running 2025-03-14T06:24:40.1227122Z Compiling google/fft.cc; 24s local 2025-03-14T06:24:40.1228070Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T06:24:40.1229122Z Compiling src/common/memory_zero_pad.cpp; 20s local 2025-03-14T06:24:40.1229952Z Compiling src/common/memory_zero_pad.cpp; 18s local 2025-03-14T06:24:40.1230706Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:40.1231535Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2025-03-14T06:24:40.1232467Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:24:40.1233409Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local ... 2025-03-14T06:24:40.3388127Z 2025-03-14T06:24:40.3389013Z  2025-03-14T06:24:40.3389706Z  2025-03-14T06:24:40.3390137Z  2025-03-14T06:24:40.3390551Z  2025-03-14T06:24:40.3390915Z  2025-03-14T06:24:40.3391299Z  2025-03-14T06:24:40.3391837Z  2025-03-14T06:24:40.3392256Z  2025-03-14T06:24:40.3392867Z [10,434 / 20,647] 48 actions running 2025-03-14T06:24:40.3393715Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:40.3394647Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T06:24:40.3395802Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:40.3396637Z Compiling src/common/memory_zero_pad.cpp; 18s local 2025-03-14T06:24:40.3397438Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:40.3398357Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2025-03-14T06:24:40.3399432Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:24:40.3400440Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local ... 2025-03-14T06:24:40.5392389Z 2025-03-14T06:24:40.5393256Z  2025-03-14T06:24:40.5393755Z  2025-03-14T06:24:40.5394164Z  2025-03-14T06:24:40.5394576Z  2025-03-14T06:24:40.5394965Z  2025-03-14T06:24:40.5395491Z  2025-03-14T06:24:40.5395944Z  2025-03-14T06:24:40.5396330Z  2025-03-14T06:24:40.5396989Z [10,441 / 20,647] 48 actions running 2025-03-14T06:24:40.5397647Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:40.5398591Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T06:24:40.5399607Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:40.5400667Z Compiling src/common/memory_zero_pad.cpp; 18s local 2025-03-14T06:24:40.5401480Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:40.5402357Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2025-03-14T06:24:40.5403362Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:24:40.5404338Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local ... 2025-03-14T06:24:40.7437511Z 2025-03-14T06:24:40.7438390Z  2025-03-14T06:24:40.7438891Z  2025-03-14T06:24:40.7439346Z  2025-03-14T06:24:40.7439798Z  2025-03-14T06:24:40.7440226Z  2025-03-14T06:24:40.7440635Z  2025-03-14T06:24:40.7441037Z  2025-03-14T06:24:40.7441453Z  2025-03-14T06:24:40.7442093Z [10,452 / 20,647] 48 actions, 47 running 2025-03-14T06:24:40.7442818Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:40.7443743Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:24:40.7445003Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:40.7445811Z Compiling src/common/memory_zero_pad.cpp; 18s local 2025-03-14T06:24:40.7446630Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:40.7447528Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2025-03-14T06:24:40.7448522Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:24:40.7449530Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local ... 2025-03-14T06:24:41.0250691Z 2025-03-14T06:24:41.0251583Z  2025-03-14T06:24:41.0252210Z  2025-03-14T06:24:41.0252592Z  2025-03-14T06:24:41.0252968Z  2025-03-14T06:24:41.0253361Z  2025-03-14T06:24:41.0253757Z  2025-03-14T06:24:41.0254183Z  2025-03-14T06:24:41.0254584Z  2025-03-14T06:24:41.0255185Z [10,456 / 20,647] 48 actions, 47 running 2025-03-14T06:24:41.0255863Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:41.0256739Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:24:41.0257742Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:41.0258622Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:41.0259321Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:41.0260396Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2025-03-14T06:24:41.0261353Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:24:41.0262265Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local ... 2025-03-14T06:24:41.2436890Z 2025-03-14T06:24:41.2437690Z  2025-03-14T06:24:41.2438157Z  2025-03-14T06:24:41.2438526Z  2025-03-14T06:24:41.2438892Z  2025-03-14T06:24:41.2439285Z  2025-03-14T06:24:41.2439689Z  2025-03-14T06:24:41.2440409Z  2025-03-14T06:24:41.2440850Z  2025-03-14T06:24:41.2441455Z [10,468 / 20,647] 48 actions, 47 running 2025-03-14T06:24:41.2442140Z Compiling google/fft.cc; 25s local 2025-03-14T06:24:41.2442984Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:24:41.2443983Z Compiling src/common/memory_zero_pad.cpp; 22s local 2025-03-14T06:24:41.2444970Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:41.2445783Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:41.2446685Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2025-03-14T06:24:41.2447831Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:24:41.2448813Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local ... 2025-03-14T06:24:41.4536416Z 2025-03-14T06:24:41.4537273Z  2025-03-14T06:24:41.4537787Z  2025-03-14T06:24:41.4538227Z  2025-03-14T06:24:41.4538683Z  2025-03-14T06:24:41.4539074Z  2025-03-14T06:24:41.4539498Z  2025-03-14T06:24:41.4539901Z  2025-03-14T06:24:41.4540348Z  2025-03-14T06:24:41.4541343Z [10,477 / 20,647] 48 actions, 47 running 2025-03-14T06:24:41.4542066Z Compiling google/fft.cc; 26s local 2025-03-14T06:24:41.4542943Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:24:41.4543923Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:41.4544762Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:41.4545657Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2025-03-14T06:24:41.4546630Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:24:41.4547580Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:24:41.4548484Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local ... 2025-03-14T06:24:41.6586982Z 2025-03-14T06:24:41.6587842Z  2025-03-14T06:24:41.6588356Z  2025-03-14T06:24:41.6588769Z  2025-03-14T06:24:41.6589151Z  2025-03-14T06:24:41.6589525Z  2025-03-14T06:24:41.6589938Z  2025-03-14T06:24:41.6590338Z  2025-03-14T06:24:41.6590738Z  2025-03-14T06:24:41.6591355Z [10,479 / 20,647] 48 actions, 47 running 2025-03-14T06:24:41.6592003Z Compiling google/fft.cc; 26s local 2025-03-14T06:24:41.6592831Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:24:41.6593843Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:41.6594628Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2025-03-14T06:24:41.6595430Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2025-03-14T06:24:41.6596402Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:24:41.6597326Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:24:41.6598197Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local ... 2025-03-14T06:24:41.8737548Z 2025-03-14T06:24:41.8738375Z  2025-03-14T06:24:41.8738984Z  2025-03-14T06:24:41.8739464Z  2025-03-14T06:24:41.8739846Z  2025-03-14T06:24:41.8740203Z  2025-03-14T06:24:41.8740574Z  2025-03-14T06:24:41.8740927Z  2025-03-14T06:24:41.8741326Z  2025-03-14T06:24:41.8741939Z [10,487 / 20,647] 48 actions, 47 running 2025-03-14T06:24:41.8742804Z Compiling google/fft.cc; 26s local 2025-03-14T06:24:41.8743665Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T06:24:41.8744638Z Compiling src/common/memory_zero_pad.cpp; 19s local 2025-03-14T06:24:41.8745405Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2025-03-14T06:24:41.8746422Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2025-03-14T06:24:41.8747317Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:24:41.8748372Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:24:41.8749223Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local ... 2025-03-14T06:24:42.0769415Z 2025-03-14T06:24:42.0770319Z  2025-03-14T06:24:42.0770958Z  2025-03-14T06:24:42.0771341Z  2025-03-14T06:24:42.0771749Z  2025-03-14T06:24:42.0772159Z  2025-03-14T06:24:42.0772562Z  2025-03-14T06:24:42.0772963Z  2025-03-14T06:24:42.0773375Z  2025-03-14T06:24:42.0774023Z [10,497 / 20,647] 48 actions, 47 running 2025-03-14T06:24:42.0774737Z Compiling google/fft.cc; 26s local 2025-03-14T06:24:42.0775588Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T06:24:42.0776588Z Compiling src/common/memory_zero_pad.cpp; 20s local 2025-03-14T06:24:42.0777393Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2025-03-14T06:24:42.0778248Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2025-03-14T06:24:42.0779248Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2025-03-14T06:24:42.0780137Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:24:42.0781247Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local ... 2025-03-14T06:24:42.3193706Z 2025-03-14T06:24:42.3194568Z  2025-03-14T06:24:42.3195075Z  2025-03-14T06:24:42.3195535Z  2025-03-14T06:24:42.3195957Z  2025-03-14T06:24:42.3196374Z  2025-03-14T06:24:42.3196835Z  2025-03-14T06:24:42.3197228Z  2025-03-14T06:24:42.3197664Z  2025-03-14T06:24:42.3198315Z [10,506 / 20,647] 48 actions, 47 running 2025-03-14T06:24:42.3199044Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:42.3199996Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T06:24:42.3201494Z Compiling src/common/memory_zero_pad.cpp; 20s local 2025-03-14T06:24:42.3202339Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2025-03-14T06:24:42.3203456Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2025-03-14T06:24:42.3204689Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:24:42.3205691Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2025-03-14T06:24:42.3206720Z Compiling src/cpu/cpu_inner_product_list.cpp; 9s local ... 2025-03-14T06:24:42.5420447Z 2025-03-14T06:24:42.5421318Z  2025-03-14T06:24:42.5421827Z  2025-03-14T06:24:42.5422278Z  2025-03-14T06:24:42.5422755Z  2025-03-14T06:24:42.5423189Z  2025-03-14T06:24:42.5423893Z  2025-03-14T06:24:42.5424445Z  2025-03-14T06:24:42.5424996Z  2025-03-14T06:24:42.5425760Z [10,512 / 20,647] 48 actions, 47 running 2025-03-14T06:24:42.5426571Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:42.5427583Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T06:24:42.5428721Z Compiling src/common/memory_zero_pad.cpp; 20s local 2025-03-14T06:24:42.5430316Z Compiling src/cpu/cpu_pooling_list.cpp; 19s local 2025-03-14T06:24:42.5431177Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2025-03-14T06:24:42.5432071Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2025-03-14T06:24:42.5432955Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2025-03-14T06:24:42.5433969Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local ... 2025-03-14T06:24:42.7852614Z 2025-03-14T06:24:42.7853779Z  2025-03-14T06:24:42.7854249Z  2025-03-14T06:24:42.7854673Z  2025-03-14T06:24:42.7855094Z  2025-03-14T06:24:42.7855527Z  2025-03-14T06:24:42.7855962Z  2025-03-14T06:24:42.7856356Z  2025-03-14T06:24:42.7856780Z  2025-03-14T06:24:42.7857610Z [10,520 / 20,647] 48 actions, 47 running 2025-03-14T06:24:42.7858326Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:42.7859249Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T06:24:42.7860422Z Compiling src/common/memory_zero_pad.cpp; 20s local 2025-03-14T06:24:42.7861257Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2025-03-14T06:24:42.7862100Z Compiling src/cpu/cpu_deconvolution_list.cpp; 15s local 2025-03-14T06:24:42.7862996Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2025-03-14T06:24:42.7863963Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2025-03-14T06:24:42.7865031Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 9s local ... 2025-03-14T06:24:42.9935643Z 2025-03-14T06:24:42.9936449Z  2025-03-14T06:24:42.9936945Z  2025-03-14T06:24:42.9937335Z  2025-03-14T06:24:42.9937740Z  2025-03-14T06:24:42.9938110Z  2025-03-14T06:24:42.9938535Z  2025-03-14T06:24:42.9938935Z  2025-03-14T06:24:42.9939332Z  2025-03-14T06:24:42.9939938Z [10,528 / 20,647] 48 actions, 47 running 2025-03-14T06:24:42.9940575Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:42.9941474Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T06:24:42.9942619Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:42.9943363Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2025-03-14T06:24:42.9944164Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2025-03-14T06:24:42.9945059Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 10s local 2025-03-14T06:24:42.9946094Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2025-03-14T06:24:42.9947094Z Compiling src/cpu/cpu_lrn_list.cpp; 8s local ... 2025-03-14T06:24:43.2001611Z 2025-03-14T06:24:43.2002510Z  2025-03-14T06:24:43.2003095Z  2025-03-14T06:24:43.2003607Z  2025-03-14T06:24:43.2004075Z  2025-03-14T06:24:43.2004686Z  2025-03-14T06:24:43.2005237Z  2025-03-14T06:24:43.2005651Z  2025-03-14T06:24:43.2006068Z  2025-03-14T06:24:43.2006711Z [10,534 / 20,647] 48 actions, 47 running 2025-03-14T06:24:43.2007398Z Compiling google/fft.cc; 27s local 2025-03-14T06:24:43.2008305Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T06:24:43.2009275Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:43.2009928Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2025-03-14T06:24:43.2010809Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2025-03-14T06:24:43.2011802Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2025-03-14T06:24:43.2012742Z Compiling src/cpu/cpu_lrn_list.cpp; 8s local 2025-03-14T06:24:43.2013403Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:24:43.4026401Z 2025-03-14T06:24:43.4027315Z  2025-03-14T06:24:43.4027799Z  2025-03-14T06:24:43.4028161Z  2025-03-14T06:24:43.4028590Z  2025-03-14T06:24:43.4028987Z  2025-03-14T06:24:43.4029393Z  2025-03-14T06:24:43.4029794Z  2025-03-14T06:24:43.4030216Z  2025-03-14T06:24:43.4030839Z [10,540 / 20,647] 48 actions, 47 running 2025-03-14T06:24:43.4031519Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:43.4032370Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T06:24:43.4033308Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:43.4034100Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:24:43.4034870Z Compiling src/cpu/cpu_inner_product_list.cpp; 10s local 2025-03-14T06:24:43.4036069Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2025-03-14T06:24:43.4036955Z Compiling src/cpu/cpu_lrn_list.cpp; 8s local 2025-03-14T06:24:43.4037610Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:24:43.6221480Z 2025-03-14T06:24:43.6222299Z  2025-03-14T06:24:43.6222790Z  2025-03-14T06:24:43.6223207Z  2025-03-14T06:24:43.6223612Z  2025-03-14T06:24:43.6224017Z  2025-03-14T06:24:43.6224673Z  2025-03-14T06:24:43.6225094Z  2025-03-14T06:24:43.6225498Z  2025-03-14T06:24:43.6226112Z [10,548 / 20,647] 48 actions, 47 running 2025-03-14T06:24:43.6226818Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:43.6227689Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T06:24:43.6228670Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:43.6229460Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:24:43.6230319Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local 2025-03-14T06:24:43.6231285Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2025-03-14T06:24:43.6232220Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local 2025-03-14T06:24:43.6232990Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:24:43.8261009Z 2025-03-14T06:24:43.8261863Z  2025-03-14T06:24:43.8262345Z  2025-03-14T06:24:43.8262720Z  2025-03-14T06:24:43.8263170Z  2025-03-14T06:24:43.8263585Z  2025-03-14T06:24:43.8263980Z  2025-03-14T06:24:43.8264398Z  2025-03-14T06:24:43.8264832Z  2025-03-14T06:24:43.8265961Z [10,557 / 20,647] 48 actions, 47 running 2025-03-14T06:24:43.8266677Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:43.8267582Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T06:24:43.8268620Z Compiling src/common/memory_zero_pad.cpp; 21s local 2025-03-14T06:24:43.8269488Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:24:43.8270355Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local 2025-03-14T06:24:43.8271427Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2025-03-14T06:24:43.8272460Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local 2025-03-14T06:24:43.8273152Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:24:44.1384796Z 2025-03-14T06:24:44.1385683Z  2025-03-14T06:24:44.1386550Z  2025-03-14T06:24:44.1387100Z  2025-03-14T06:24:44.1387641Z  2025-03-14T06:24:44.1388163Z  2025-03-14T06:24:44.1388682Z  2025-03-14T06:24:44.1389225Z  2025-03-14T06:24:44.1389721Z  2025-03-14T06:24:44.1390491Z [10,563 / 20,647] 48 actions, 47 running 2025-03-14T06:24:44.1391362Z Compiling google/fft.cc; 28s local 2025-03-14T06:24:44.1392399Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T06:24:44.1393560Z Compiling src/common/memory_zero_pad.cpp; 22s local 2025-03-14T06:24:44.1394542Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:24:44.1395488Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local 2025-03-14T06:24:44.1396661Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2025-03-14T06:24:44.1397740Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local 2025-03-14T06:24:44.1398546Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:24:44.3415428Z 2025-03-14T06:24:44.3416300Z  2025-03-14T06:24:44.3416819Z  2025-03-14T06:24:44.3417254Z  2025-03-14T06:24:44.3417655Z  2025-03-14T06:24:44.3418087Z  2025-03-14T06:24:44.3418490Z  2025-03-14T06:24:44.3418902Z  2025-03-14T06:24:44.3419304Z  2025-03-14T06:24:44.3419888Z [10,576 / 20,647] 48 actions running 2025-03-14T06:24:44.3420564Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:44.3421779Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T06:24:44.3422729Z Compiling src/common/memory_zero_pad.cpp; 22s local 2025-03-14T06:24:44.3423497Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:24:44.3424493Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local 2025-03-14T06:24:44.3425497Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2025-03-14T06:24:44.3426462Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local 2025-03-14T06:24:44.3427346Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local ... 2025-03-14T06:24:44.5492759Z 2025-03-14T06:24:44.5493593Z  2025-03-14T06:24:44.5494264Z  2025-03-14T06:24:44.5505499Z  2025-03-14T06:24:44.5505977Z  2025-03-14T06:24:44.5506379Z  2025-03-14T06:24:44.5506787Z  2025-03-14T06:24:44.5507184Z  2025-03-14T06:24:44.5507560Z  2025-03-14T06:24:44.5508153Z [10,586 / 20,647] 48 actions, 47 running 2025-03-14T06:24:44.5508871Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:44.5509742Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T06:24:44.5510699Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2025-03-14T06:24:44.5511569Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2025-03-14T06:24:44.5512555Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2025-03-14T06:24:44.5513509Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:44.5514260Z Compiling src/cpu/cpu_reduction_list.cpp; 7s local 2025-03-14T06:24:44.5515311Z Compiling src/cpu/cpu_resampling_list.cpp; 6s local ... 2025-03-14T06:24:44.7801107Z 2025-03-14T06:24:44.7802376Z  2025-03-14T06:24:44.7802891Z  2025-03-14T06:24:44.7803312Z  2025-03-14T06:24:44.7803726Z  2025-03-14T06:24:44.7804131Z  2025-03-14T06:24:44.7804690Z  2025-03-14T06:24:44.7805090Z  2025-03-14T06:24:44.7805517Z  2025-03-14T06:24:44.7806132Z [10,595 / 20,647] 48 actions, 47 running 2025-03-14T06:24:44.7806828Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:44.7807703Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T06:24:44.7808734Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2025-03-14T06:24:44.7809557Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2025-03-14T06:24:44.7810534Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T06:24:44.7811506Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:44.7812297Z Compiling src/cpu/cpu_reduction_list.cpp; 7s local 2025-03-14T06:24:44.7813120Z Compiling src/cpu/cpu_resampling_list.cpp; 6s local ... 2025-03-14T06:24:45.0557873Z 2025-03-14T06:24:45.0559065Z  2025-03-14T06:24:45.0559842Z  2025-03-14T06:24:45.0560456Z  2025-03-14T06:24:45.0563484Z  2025-03-14T06:24:45.0564087Z  2025-03-14T06:24:45.0567364Z  2025-03-14T06:24:45.0567979Z  2025-03-14T06:24:45.0570829Z  2025-03-14T06:24:45.0571610Z [10,599 / 20,647] 48 actions, 47 running 2025-03-14T06:24:45.0572505Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:45.0573698Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T06:24:45.0574903Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2025-03-14T06:24:45.0575971Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2025-03-14T06:24:45.0577154Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T06:24:45.0578382Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:45.0579339Z Compiling src/cpu/cpu_reduction_list.cpp; 7s local 2025-03-14T06:24:45.0580499Z Compiling src/cpu/cpu_resampling_list.cpp; 6s local ... 2025-03-14T06:24:45.2862194Z 2025-03-14T06:24:45.2863014Z  2025-03-14T06:24:45.2863502Z  2025-03-14T06:24:45.2864261Z  2025-03-14T06:24:45.2864709Z  2025-03-14T06:24:45.2865155Z  2025-03-14T06:24:45.2865829Z  2025-03-14T06:24:45.2866276Z  2025-03-14T06:24:45.2866689Z  2025-03-14T06:24:45.2867324Z [10,606 / 20,647] 48 actions, 47 running 2025-03-14T06:24:45.2868229Z Compiling google/fft.cc; 29s local 2025-03-14T06:24:45.2869182Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T06:24:45.2870496Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2025-03-14T06:24:45.2871385Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2025-03-14T06:24:45.2872450Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T06:24:45.2873478Z Compiling src/cpu/cpu_pooling_list.cpp; 8s local 2025-03-14T06:24:45.2874295Z Compiling src/cpu/cpu_reduction_list.cpp; 8s local 2025-03-14T06:24:45.2875165Z Compiling src/cpu/cpu_resampling_list.cpp; 6s local ... 2025-03-14T06:24:45.5202829Z 2025-03-14T06:24:45.5203714Z  2025-03-14T06:24:45.5204202Z  2025-03-14T06:24:45.5204791Z  2025-03-14T06:24:45.5205229Z  2025-03-14T06:24:45.5205667Z  2025-03-14T06:24:45.5206071Z  2025-03-14T06:24:45.5206482Z  2025-03-14T06:24:45.5206945Z  2025-03-14T06:24:45.5207559Z [10,612 / 20,647] 48 actions, 47 running 2025-03-14T06:24:45.5208270Z Compiling google/fft.cc; 30s local 2025-03-14T06:24:45.5209310Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T06:24:45.5210223Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2025-03-14T06:24:45.5211329Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:24:45.5212355Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T06:24:45.5213311Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2025-03-14T06:24:45.5214100Z Compiling src/cpu/cpu_reduction_list.cpp; 8s local 2025-03-14T06:24:45.5214957Z Compiling src/cpu/cpu_resampling_list.cpp; 7s local ... 2025-03-14T06:24:45.7336120Z 2025-03-14T06:24:45.7336999Z  2025-03-14T06:24:45.7337472Z  2025-03-14T06:24:45.7337900Z  2025-03-14T06:24:45.7338292Z  2025-03-14T06:24:45.7338711Z  2025-03-14T06:24:45.7339156Z  2025-03-14T06:24:45.7339527Z  2025-03-14T06:24:45.7339859Z  2025-03-14T06:24:45.7340397Z [10,620 / 20,647] 48 actions, 47 running 2025-03-14T06:24:45.7341074Z Compiling google/fft.cc; 30s local 2025-03-14T06:24:45.7341926Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:24:45.7342845Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2025-03-14T06:24:45.7343578Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:24:45.7344446Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:24:45.7345464Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2025-03-14T06:24:45.7346403Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T06:24:45.7347338Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local ... 2025-03-14T06:24:45.9425923Z 2025-03-14T06:24:45.9426900Z  2025-03-14T06:24:45.9427443Z  2025-03-14T06:24:45.9427852Z  2025-03-14T06:24:45.9428226Z  2025-03-14T06:24:45.9428629Z  2025-03-14T06:24:45.9429006Z  2025-03-14T06:24:45.9429410Z  2025-03-14T06:24:45.9429831Z  2025-03-14T06:24:45.9430429Z [10,627 / 20,647] 48 actions running 2025-03-14T06:24:45.9431343Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:24:45.9432362Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2025-03-14T06:24:45.9433178Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:24:45.9434182Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:24:45.9435152Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2025-03-14T06:24:45.9436451Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T06:24:45.9437458Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local 2025-03-14T06:24:45.9438170Z Compiling src/cpu/rnn/cell_gru_lbr.cpp; 5s local ... 2025-03-14T06:24:46.2054501Z 2025-03-14T06:24:46.2055816Z  2025-03-14T06:24:46.2056331Z  2025-03-14T06:24:46.2056755Z  2025-03-14T06:24:46.2057175Z  2025-03-14T06:24:46.2057588Z  2025-03-14T06:24:46.2058297Z  2025-03-14T06:24:46.2058739Z  2025-03-14T06:24:46.2059153Z  2025-03-14T06:24:46.2059794Z [10,630 / 20,647] 48 actions, 47 running 2025-03-14T06:24:46.2060809Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:24:46.2061829Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2025-03-14T06:24:46.2062687Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:24:46.2063753Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:24:46.2064759Z Compiling src/cpu/cpu_pooling_list.cpp; 9s local 2025-03-14T06:24:46.2065973Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 5s local 2025-03-14T06:24:46.2066957Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local 2025-03-14T06:24:46.2067723Z Compiling src/cpu/rnn/cell_gru_lbr.cpp; 5s local ... 2025-03-14T06:24:46.4108975Z 2025-03-14T06:24:46.4109842Z  2025-03-14T06:24:46.4110318Z  2025-03-14T06:24:46.4110724Z  2025-03-14T06:24:46.4111102Z  2025-03-14T06:24:46.4111500Z  2025-03-14T06:24:46.4111893Z  2025-03-14T06:24:46.4112490Z  2025-03-14T06:24:46.4112901Z  2025-03-14T06:24:46.4113476Z [10,635 / 20,647] 48 actions, 47 running 2025-03-14T06:24:46.4114346Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:24:46.4115329Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T06:24:46.4116138Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:24:46.4117070Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:24:46.4117958Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2025-03-14T06:24:46.4118908Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:46.4119837Z Compiling src/cpu/cpu_rnn_list.cpp; 5s local 2025-03-14T06:24:46.4120563Z Compiling src/cpu/rnn/cell_gru_lbr.cpp; 5s local ... 2025-03-14T06:24:46.7027172Z 2025-03-14T06:24:46.7028022Z  2025-03-14T06:24:46.7028531Z  2025-03-14T06:24:46.7028980Z  2025-03-14T06:24:46.7029455Z  2025-03-14T06:24:46.7029889Z  2025-03-14T06:24:46.7030325Z  2025-03-14T06:24:46.7030750Z  2025-03-14T06:24:46.7031186Z  2025-03-14T06:24:46.7031826Z [10,641 / 20,647] 48 actions, 47 running 2025-03-14T06:24:46.7032868Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:24:46.7033979Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T06:24:46.7034888Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2025-03-14T06:24:46.7035976Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:24:46.7037037Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2025-03-14T06:24:46.7038084Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:46.7039119Z Compiling src/cpu/cpu_rnn_list.cpp; 6s local 2025-03-14T06:24:46.7039934Z Compiling src/cpu/rnn/cell_gru_lbr.cpp; 6s local ... 2025-03-14T06:24:46.9433843Z 2025-03-14T06:24:46.9434737Z  2025-03-14T06:24:46.9435261Z  2025-03-14T06:24:46.9437677Z  2025-03-14T06:24:46.9438534Z  2025-03-14T06:24:46.9439193Z  2025-03-14T06:24:46.9439793Z  2025-03-14T06:24:46.9440506Z  2025-03-14T06:24:46.9441362Z  2025-03-14T06:24:46.9442290Z [10,645 / 20,647] 48 actions running 2025-03-14T06:24:46.9443343Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T06:24:46.9444631Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T06:24:46.9445718Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2025-03-14T06:24:46.9446857Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:24:46.9447954Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2025-03-14T06:24:46.9449115Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:46.9450181Z Compiling src/cpu/cpu_rnn_list.cpp; 6s local 2025-03-14T06:24:46.9450979Z Compiling src/cpu/ref_lrn.cpp; 6s local ... 2025-03-14T06:24:47.1613221Z 2025-03-14T06:24:47.1614069Z  2025-03-14T06:24:47.1614582Z  2025-03-14T06:24:47.1614991Z  2025-03-14T06:24:47.1615430Z  2025-03-14T06:24:47.1615860Z  2025-03-14T06:24:47.1616307Z  2025-03-14T06:24:47.1616725Z  2025-03-14T06:24:47.1617151Z  2025-03-14T06:24:47.1617771Z [10,650 / 20,647] 48 actions, 47 running 2025-03-14T06:24:47.1618809Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T06:24:47.1619906Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T06:24:47.1620824Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2025-03-14T06:24:47.1621918Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:24:47.1622984Z Compiling src/cpu/cpu_pooling_list.cpp; 10s local 2025-03-14T06:24:47.1624296Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 6s local 2025-03-14T06:24:47.1625327Z Compiling src/cpu/cpu_rnn_list.cpp; 6s local 2025-03-14T06:24:47.1626059Z Compiling src/cpu/ref_lrn.cpp; 6s local ... 2025-03-14T06:24:47.3668236Z 2025-03-14T06:24:47.3669076Z  2025-03-14T06:24:47.3669572Z  2025-03-14T06:24:47.3670015Z  2025-03-14T06:24:47.3670404Z  2025-03-14T06:24:47.3670821Z  2025-03-14T06:24:47.3671227Z  2025-03-14T06:24:47.3671641Z  2025-03-14T06:24:47.3672045Z  2025-03-14T06:24:47.3672664Z [10,653 / 20,647] 48 actions, 47 running 2025-03-14T06:24:47.3673625Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T06:24:47.3674608Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:24:47.3675465Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2025-03-14T06:24:47.3676421Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:24:47.3677410Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:47.3678390Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T06:24:47.3679366Z Compiling src/cpu/cpu_rnn_list.cpp; 6s local 2025-03-14T06:24:47.3680138Z Compiling src/cpu/ref_lrn.cpp; 6s local ... 2025-03-14T06:24:47.5809412Z 2025-03-14T06:24:47.5810261Z  2025-03-14T06:24:47.5810753Z  2025-03-14T06:24:47.5811143Z  2025-03-14T06:24:47.5811519Z  2025-03-14T06:24:47.5811893Z  2025-03-14T06:24:47.5812289Z  2025-03-14T06:24:47.5812674Z  2025-03-14T06:24:47.5813098Z  2025-03-14T06:24:47.5813691Z [10,661 / 20,647] 48 actions, 47 running 2025-03-14T06:24:47.5814609Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T06:24:47.5815574Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:24:47.5816367Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2025-03-14T06:24:47.5817345Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:24:47.5818274Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:47.5819184Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T06:24:47.5820094Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:47.5821020Z Compiling src/cpu/ref_lrn.cpp; 6s local ... 2025-03-14T06:24:47.8086775Z 2025-03-14T06:24:47.8087642Z  2025-03-14T06:24:47.8088127Z  2025-03-14T06:24:47.8088541Z  2025-03-14T06:24:47.8088961Z  2025-03-14T06:24:47.8089728Z  2025-03-14T06:24:47.8090156Z  2025-03-14T06:24:47.8090585Z  2025-03-14T06:24:47.8090969Z  2025-03-14T06:24:47.8091700Z [10,670 / 20,647] 48 actions, 47 running 2025-03-14T06:24:47.8092828Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:24:47.8093877Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:24:47.8094774Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2025-03-14T06:24:47.8095833Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:24:47.8096858Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:47.8097875Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T06:24:47.8098824Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:47.8099543Z Compiling src/cpu/ref_lrn.cpp; 6s local ... 2025-03-14T06:24:48.0846826Z 2025-03-14T06:24:48.0847723Z  2025-03-14T06:24:48.0848319Z  2025-03-14T06:24:48.0848784Z  2025-03-14T06:24:48.0849190Z  2025-03-14T06:24:48.0849607Z  2025-03-14T06:24:48.0849968Z  2025-03-14T06:24:48.0850457Z  2025-03-14T06:24:48.0850889Z  2025-03-14T06:24:48.0851511Z [10,676 / 20,647] 48 actions, 47 running 2025-03-14T06:24:48.0852761Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:24:48.0853798Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:24:48.0854674Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2025-03-14T06:24:48.0855742Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:24:48.0856741Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:48.0857670Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 7s local 2025-03-14T06:24:48.0858677Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:48.0859358Z Compiling src/cpu/ref_lrn.cpp; 7s local ... 2025-03-14T06:24:48.2919338Z 2025-03-14T06:24:48.2920195Z  2025-03-14T06:24:48.2920686Z  2025-03-14T06:24:48.2923035Z  2025-03-14T06:24:48.2926138Z  2025-03-14T06:24:48.2929031Z  2025-03-14T06:24:48.2931965Z  2025-03-14T06:24:48.2934093Z  2025-03-14T06:24:48.2934754Z  2025-03-14T06:24:48.2935719Z [10,678 / 20,647] 48 actions, 47 running 2025-03-14T06:24:48.2936982Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:24:48.2938425Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:24:48.2939576Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2025-03-14T06:24:48.2940860Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:24:48.2942130Z Compiling src/cpu/cpu_pooling_list.cpp; 11s local 2025-03-14T06:24:48.2943419Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:48.2944597Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:48.2945536Z Compiling src/cpu/ref_lrn.cpp; 7s local ... 2025-03-14T06:24:48.5017057Z 2025-03-14T06:24:48.5017903Z  2025-03-14T06:24:48.5018407Z  2025-03-14T06:24:48.5018801Z  2025-03-14T06:24:48.5019208Z  2025-03-14T06:24:48.5019591Z  2025-03-14T06:24:48.5020102Z  2025-03-14T06:24:48.5020498Z  2025-03-14T06:24:48.5020890Z  2025-03-14T06:24:48.5021476Z [10,690 / 20,647] 48 actions, 47 running 2025-03-14T06:24:48.5022570Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:24:48.5023633Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:24:48.5024732Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:24:48.5025712Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:24:48.5026783Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:48.5028015Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:48.5028904Z Compiling src/cpu/cpu_rnn_list.cpp; 7s local 2025-03-14T06:24:48.5029713Z Compiling src/cpu/cpu_sum.cpp; 6s local ... 2025-03-14T06:24:48.7023173Z 2025-03-14T06:24:48.7024049Z  2025-03-14T06:24:48.7024531Z  2025-03-14T06:24:48.7024910Z  2025-03-14T06:24:48.7025321Z  2025-03-14T06:24:48.7025712Z  2025-03-14T06:24:48.7026116Z  2025-03-14T06:24:48.7026490Z  2025-03-14T06:24:48.7026873Z  2025-03-14T06:24:48.7027494Z [10,696 / 20,647] 48 actions, 47 running 2025-03-14T06:24:48.7028479Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:24:48.7029519Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:24:48.7030360Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:24:48.7031313Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:24:48.7032229Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:48.7033290Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:48.7034156Z Compiling src/cpu/cpu_rnn_list.cpp; 8s local 2025-03-14T06:24:48.7034827Z Compiling src/cpu/cpu_sum.cpp; 6s local ... 2025-03-14T06:24:48.9062824Z 2025-03-14T06:24:48.9063887Z  2025-03-14T06:24:48.9064324Z  2025-03-14T06:24:48.9064673Z  2025-03-14T06:24:48.9065009Z  2025-03-14T06:24:48.9065560Z  2025-03-14T06:24:48.9065912Z  2025-03-14T06:24:48.9066244Z  2025-03-14T06:24:48.9066590Z  2025-03-14T06:24:48.9067133Z [10,710 / 20,647] 48 actions, 47 running 2025-03-14T06:24:48.9067963Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T06:24:48.9068789Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:24:48.9069499Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:24:48.9070319Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:24:48.9071130Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:48.9071955Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:48.9072702Z Compiling src/cpu/cpu_rnn_list.cpp; 8s local 2025-03-14T06:24:48.9073257Z Compiling src/cpu/cpu_sum.cpp; 6s local ... 2025-03-14T06:24:49.1301188Z 2025-03-14T06:24:49.1302085Z  2025-03-14T06:24:49.1302542Z  2025-03-14T06:24:49.1303057Z  2025-03-14T06:24:49.1303488Z  2025-03-14T06:24:49.1303884Z  2025-03-14T06:24:49.1304298Z  2025-03-14T06:24:49.1304686Z  2025-03-14T06:24:49.1305049Z  2025-03-14T06:24:49.1305636Z [10,723 / 20,647] 48 actions, 47 running 2025-03-14T06:24:49.1306586Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T06:24:49.1307574Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:24:49.1308371Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:24:49.1309374Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:24:49.1310278Z Compiling src/cpu/cpu_pooling_list.cpp; 12s local 2025-03-14T06:24:49.1311212Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 8s local 2025-03-14T06:24:49.1312082Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:49.1312782Z Compiling src/cpu/rnn/ref_postgemm_lstm.cpp; 6s local ... 2025-03-14T06:24:49.3355725Z 2025-03-14T06:24:49.3356588Z  2025-03-14T06:24:49.3357075Z  2025-03-14T06:24:49.3357754Z  2025-03-14T06:24:49.3358142Z  2025-03-14T06:24:49.3358624Z  2025-03-14T06:24:49.3359034Z  2025-03-14T06:24:49.3359456Z  2025-03-14T06:24:49.3359884Z  2025-03-14T06:24:49.3360525Z [10,731 / 20,647] 48 actions, 47 running 2025-03-14T06:24:49.3361685Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T06:24:49.3362699Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:24:49.3363677Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:24:49.3364867Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:24:49.3366094Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:49.3367034Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:49.3367985Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:49.3368711Z Compiling src/cpu/ref_reduction.cpp; 5s local ... 2025-03-14T06:24:49.5454757Z 2025-03-14T06:24:49.5455581Z  2025-03-14T06:24:49.5456074Z  2025-03-14T06:24:49.5456493Z  2025-03-14T06:24:49.5456904Z  2025-03-14T06:24:49.5457308Z  2025-03-14T06:24:49.5457712Z  2025-03-14T06:24:49.5458157Z  2025-03-14T06:24:49.5458665Z  2025-03-14T06:24:49.5459258Z [10,740 / 20,647] 48 actions running 2025-03-14T06:24:49.5460193Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T06:24:49.5461115Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T06:24:49.5461993Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2025-03-14T06:24:49.5463284Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:24:49.5464335Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:49.5465589Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:49.5466546Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:49.5467286Z Compiling src/cpu/ref_reduction.cpp; 6s local ... 2025-03-14T06:24:49.7542443Z 2025-03-14T06:24:49.7543308Z  2025-03-14T06:24:49.7543821Z  2025-03-14T06:24:49.7544260Z  2025-03-14T06:24:49.7544689Z  2025-03-14T06:24:49.7545099Z  2025-03-14T06:24:49.7545505Z  2025-03-14T06:24:49.7545885Z  2025-03-14T06:24:49.7546294Z  2025-03-14T06:24:49.7546910Z [10,747 / 20,647] 48 actions, 47 running 2025-03-14T06:24:49.7547885Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T06:24:49.7548898Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T06:24:49.7549715Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2025-03-14T06:24:49.7550717Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T06:24:49.7551680Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:49.7552680Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:49.7553613Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:49.7554328Z Compiling src/cpu/ref_reduction.cpp; 6s local ... 2025-03-14T06:24:49.9766628Z 2025-03-14T06:24:49.9767653Z  2025-03-14T06:24:49.9768138Z  2025-03-14T06:24:49.9768538Z  2025-03-14T06:24:49.9768952Z  2025-03-14T06:24:49.9769339Z  2025-03-14T06:24:49.9769739Z  2025-03-14T06:24:49.9770146Z  2025-03-14T06:24:49.9770577Z  2025-03-14T06:24:49.9771195Z [10,755 / 20,647] 48 actions, 47 running 2025-03-14T06:24:49.9772078Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T06:24:49.9773100Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T06:24:49.9773985Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2025-03-14T06:24:49.9775010Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T06:24:49.9776241Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:49.9777191Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:49.9778120Z Compiling src/cpu/cpu_sum.cpp; 7s local 2025-03-14T06:24:49.9779016Z Compiling src/cpu/ref_reduction.cpp; 6s local ... 2025-03-14T06:24:50.1771286Z 2025-03-14T06:24:50.1772278Z  2025-03-14T06:24:50.1772797Z  2025-03-14T06:24:50.1773243Z  2025-03-14T06:24:50.1773625Z  2025-03-14T06:24:50.1774242Z  2025-03-14T06:24:50.1774660Z  2025-03-14T06:24:50.1775042Z  2025-03-14T06:24:50.1775436Z  2025-03-14T06:24:50.1776043Z [10,760 / 20,647] 48 actions, 47 running 2025-03-14T06:24:50.1776990Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T06:24:50.1777957Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T06:24:50.1778852Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2025-03-14T06:24:50.1779887Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T06:24:50.1780819Z Compiling src/cpu/cpu_pooling_list.cpp; 13s local 2025-03-14T06:24:50.1781801Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 9s local 2025-03-14T06:24:50.1782719Z Compiling src/cpu/cpu_sum.cpp; 8s local 2025-03-14T06:24:50.1783422Z Compiling src/cpu/ref_reduction.cpp; 6s local ... 2025-03-14T06:24:50.3818527Z 2025-03-14T06:24:50.3819515Z  2025-03-14T06:24:50.3820078Z  2025-03-14T06:24:50.3820533Z  2025-03-14T06:24:50.3820890Z  2025-03-14T06:24:50.3821240Z  2025-03-14T06:24:50.3821585Z  2025-03-14T06:24:50.3822156Z  2025-03-14T06:24:50.3822523Z  2025-03-14T06:24:50.3823087Z [10,767 / 20,647] 48 actions, 47 running 2025-03-14T06:24:50.3823962Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T06:24:50.3824827Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T06:24:50.3825663Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2025-03-14T06:24:50.3826327Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:50.3827218Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T06:24:50.3828132Z Compiling src/cpu/cpu_sum.cpp; 8s local 2025-03-14T06:24:50.3828715Z Compiling src/cpu/ref_reduction.cpp; 6s local 2025-03-14T06:24:50.3829310Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:24:50.6298925Z 2025-03-14T06:24:50.6299777Z  2025-03-14T06:24:50.6300276Z  2025-03-14T06:24:50.6300679Z  2025-03-14T06:24:50.6301081Z  2025-03-14T06:24:50.6301498Z  2025-03-14T06:24:50.6301912Z  2025-03-14T06:24:50.6302312Z  2025-03-14T06:24:50.6302722Z  2025-03-14T06:24:50.6303336Z [10,774 / 20,647] 48 actions, 47 running 2025-03-14T06:24:50.6304230Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T06:24:50.6305247Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T06:24:50.6306093Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2025-03-14T06:24:50.6306897Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:50.6307877Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T06:24:50.6308810Z Compiling src/cpu/cpu_sum.cpp; 8s local 2025-03-14T06:24:50.6309522Z Compiling src/cpu/ref_reduction.cpp; 7s local 2025-03-14T06:24:50.6310208Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:24:50.9461117Z 2025-03-14T06:24:50.9462002Z  2025-03-14T06:24:50.9462570Z  2025-03-14T06:24:50.9463026Z  2025-03-14T06:24:50.9463407Z  2025-03-14T06:24:50.9463817Z  2025-03-14T06:24:50.9464234Z  2025-03-14T06:24:50.9464659Z  2025-03-14T06:24:50.9465068Z  2025-03-14T06:24:50.9465887Z [10,779 / 20,647] 48 actions running 2025-03-14T06:24:50.9467125Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T06:24:50.9468193Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T06:24:50.9469074Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2025-03-14T06:24:50.9470055Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:50.9471080Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T06:24:50.9472062Z Compiling src/cpu/cpu_sum.cpp; 8s local 2025-03-14T06:24:50.9472851Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:24:50.9473635Z Compiling torch_xla/csrc/runtime/cache_test.cc; 5s local ... 2025-03-14T06:24:51.1540861Z 2025-03-14T06:24:51.1541842Z  2025-03-14T06:24:51.1542356Z  2025-03-14T06:24:51.1542764Z  2025-03-14T06:24:51.1543141Z  2025-03-14T06:24:51.1543540Z  2025-03-14T06:24:51.1543914Z  2025-03-14T06:24:51.1544338Z  2025-03-14T06:24:51.1544734Z  2025-03-14T06:24:51.1545374Z [10,789 / 20,647] 48 actions, 47 running 2025-03-14T06:24:51.1546356Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T06:24:51.1547384Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T06:24:51.1548245Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2025-03-14T06:24:51.1549064Z Compiling src/cpu/cpu_pooling_list.cpp; 14s local 2025-03-14T06:24:51.1550068Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 10s local 2025-03-14T06:24:51.1550955Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:51.1551581Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:24:51.1552673Z Compiling src/cpu/gemm_convolution_utils.cpp; 4s local ... 2025-03-14T06:24:51.3644027Z 2025-03-14T06:24:51.3645118Z  2025-03-14T06:24:51.3645612Z  2025-03-14T06:24:51.3646012Z  2025-03-14T06:24:51.3646414Z  2025-03-14T06:24:51.3646818Z  2025-03-14T06:24:51.3647258Z  2025-03-14T06:24:51.3647650Z  2025-03-14T06:24:51.3648061Z  2025-03-14T06:24:51.3648684Z [10,796 / 20,647] 48 actions, 47 running 2025-03-14T06:24:51.3649571Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T06:24:51.3650472Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:24:51.3651215Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2025-03-14T06:24:51.3651942Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2025-03-14T06:24:51.3652820Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:51.3653724Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:51.3654343Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:24:51.3655072Z Compiling src/cpu/gemm_convolution_utils.cpp; 5s local ... 2025-03-14T06:24:51.5648093Z 2025-03-14T06:24:51.5648965Z  2025-03-14T06:24:51.5649437Z  2025-03-14T06:24:51.5649838Z  2025-03-14T06:24:51.5650234Z  2025-03-14T06:24:51.5650627Z  2025-03-14T06:24:51.5651148Z  2025-03-14T06:24:51.5651552Z  2025-03-14T06:24:51.5651955Z  2025-03-14T06:24:51.5652559Z [10,802 / 20,647] 48 actions, 47 running 2025-03-14T06:24:51.5653535Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T06:24:51.5654529Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:24:51.5655347Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2025-03-14T06:24:51.5656183Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2025-03-14T06:24:51.5657106Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:51.5658020Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:51.5658681Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:24:51.5659436Z Compiling src/cpu/gemm_convolution_utils.cpp; 5s local ... 2025-03-14T06:24:51.8488016Z 2025-03-14T06:24:51.8488873Z  2025-03-14T06:24:51.8489658Z  2025-03-14T06:24:51.8490102Z  2025-03-14T06:24:51.8490533Z  2025-03-14T06:24:51.8490961Z  2025-03-14T06:24:51.8491375Z  2025-03-14T06:24:51.8491818Z  2025-03-14T06:24:51.8492240Z  2025-03-14T06:24:51.8493035Z [10,810 / 20,647] 48 actions, 47 running 2025-03-14T06:24:51.8494004Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T06:24:51.8495043Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:24:51.8496031Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2025-03-14T06:24:51.8496869Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2025-03-14T06:24:51.8497850Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:51.8498932Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:51.8499614Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:24:51.8500404Z Compiling src/cpu/gemm_convolution_utils.cpp; 5s local ... 2025-03-14T06:24:52.0824064Z 2025-03-14T06:24:52.0824928Z  2025-03-14T06:24:52.0825438Z  2025-03-14T06:24:52.0825870Z  2025-03-14T06:24:52.0826305Z  2025-03-14T06:24:52.0826726Z  2025-03-14T06:24:52.0827142Z  2025-03-14T06:24:52.0827572Z  2025-03-14T06:24:52.0827994Z  2025-03-14T06:24:52.0828632Z [10,819 / 20,647] 48 actions, 47 running 2025-03-14T06:24:52.0829643Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T06:24:52.0830690Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:24:52.0831561Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2025-03-14T06:24:52.0832691Z Compiling src/cpu/cpu_pooling_list.cpp; 15s local 2025-03-14T06:24:52.0833709Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 11s local 2025-03-14T06:24:52.0834656Z Compiling src/cpu/cpu_sum.cpp; 9s local 2025-03-14T06:24:52.0835325Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:24:52.0836105Z Compiling src/cpu/gemm_convolution_utils.cpp; 5s local ... 2025-03-14T06:24:52.3084893Z 2025-03-14T06:24:52.3085777Z  2025-03-14T06:24:52.3086283Z  2025-03-14T06:24:52.3086715Z  2025-03-14T06:24:52.3087126Z  2025-03-14T06:24:52.3087573Z  2025-03-14T06:24:52.3088008Z  2025-03-14T06:24:52.3088412Z  2025-03-14T06:24:52.3088801Z  2025-03-14T06:24:52.3089401Z [10,825 / 20,647] 48 actions, 47 running 2025-03-14T06:24:52.3090374Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T06:24:52.3091413Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:24:52.3092278Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2025-03-14T06:24:52.3093070Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:52.3094038Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:52.3094995Z Compiling src/cpu/cpu_sum.cpp; 10s local 2025-03-14T06:24:52.3095677Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:24:52.3096452Z Compiling src/cpu/gemm_convolution_utils.cpp; 6s local ... 2025-03-14T06:24:52.5225871Z 2025-03-14T06:24:52.5226729Z  2025-03-14T06:24:52.5227255Z  2025-03-14T06:24:52.5227681Z  2025-03-14T06:24:52.5228086Z  2025-03-14T06:24:52.5228500Z  2025-03-14T06:24:52.5228918Z  2025-03-14T06:24:52.5229337Z  2025-03-14T06:24:52.5229726Z  2025-03-14T06:24:52.5230339Z [10,829 / 20,647] 48 actions, 47 running 2025-03-14T06:24:52.5231266Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T06:24:52.5232271Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T06:24:52.5233094Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:24:52.5233917Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:52.5235018Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:52.5236249Z Compiling src/cpu/cpu_sum.cpp; 10s local 2025-03-14T06:24:52.5236997Z Compiling src/cpu/gemm_convolution_utils.cpp; 6s local 2025-03-14T06:24:52.5237765Z Compiling src/cpu/gemm_inner_product.cpp; 6s local ... 2025-03-14T06:24:52.7338805Z 2025-03-14T06:24:52.7339697Z  2025-03-14T06:24:52.7340202Z  2025-03-14T06:24:52.7340631Z  2025-03-14T06:24:52.7341026Z  2025-03-14T06:24:52.7341417Z  2025-03-14T06:24:52.7341813Z  2025-03-14T06:24:52.7342466Z  2025-03-14T06:24:52.7342902Z  2025-03-14T06:24:52.7343515Z [10,836 / 20,647] 48 actions, 47 running 2025-03-14T06:24:52.7344506Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2025-03-14T06:24:52.7345533Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T06:24:52.7346220Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:24:52.7346881Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:52.7347853Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:52.7348803Z Compiling src/cpu/cpu_sum.cpp; 10s local 2025-03-14T06:24:52.7349570Z Compiling src/cpu/gemm_convolution_utils.cpp; 6s local 2025-03-14T06:24:52.7350388Z Compiling src/cpu/simple_concat.cpp; 6s local ... 2025-03-14T06:24:52.9368812Z 2025-03-14T06:24:52.9369653Z  2025-03-14T06:24:52.9370097Z  2025-03-14T06:24:52.9370449Z  2025-03-14T06:24:52.9370832Z  2025-03-14T06:24:52.9371315Z  2025-03-14T06:24:52.9371692Z  2025-03-14T06:24:52.9372076Z  2025-03-14T06:24:52.9372681Z  2025-03-14T06:24:52.9373224Z [10,843 / 20,647] 48 actions, 47 running 2025-03-14T06:24:52.9374076Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2025-03-14T06:24:52.9375002Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T06:24:52.9375763Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:24:52.9376510Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:52.9377407Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:52.9378241Z Compiling src/cpu/cpu_sum.cpp; 10s local 2025-03-14T06:24:52.9378936Z Compiling src/cpu/gemm_convolution_utils.cpp; 6s local 2025-03-14T06:24:52.9379705Z Compiling src/cpu/simple_concat.cpp; 6s local ... 2025-03-14T06:24:53.1478740Z 2025-03-14T06:24:53.1479539Z  2025-03-14T06:24:53.1479963Z  2025-03-14T06:24:53.1480322Z  2025-03-14T06:24:53.1480679Z  2025-03-14T06:24:53.1481013Z  2025-03-14T06:24:53.1481353Z  2025-03-14T06:24:53.1481701Z  2025-03-14T06:24:53.1482049Z  2025-03-14T06:24:53.1482552Z [10,847 / 20,647] 48 actions running 2025-03-14T06:24:53.1483365Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2025-03-14T06:24:53.1484235Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T06:24:53.1485114Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:24:53.1485811Z Compiling src/cpu/cpu_pooling_list.cpp; 16s local 2025-03-14T06:24:53.1486636Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 12s local 2025-03-14T06:24:53.1487429Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:53.1488041Z Compiling src/cpu/gemm_convolution_utils.cpp; 6s local 2025-03-14T06:24:53.1488737Z Compiling src/cpu/simple_concat.cpp; 6s local ... 2025-03-14T06:24:53.3703702Z 2025-03-14T06:24:53.3704564Z  2025-03-14T06:24:53.3705039Z  2025-03-14T06:24:53.3705515Z  2025-03-14T06:24:53.3705920Z  2025-03-14T06:24:53.3706312Z  2025-03-14T06:24:53.3706738Z  2025-03-14T06:24:53.3707092Z  2025-03-14T06:24:53.3707451Z  2025-03-14T06:24:53.3708011Z [10,855 / 20,647] 48 actions, 47 running 2025-03-14T06:24:53.3709046Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T06:24:53.3709844Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:24:53.3710656Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:53.3711659Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:53.3712764Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:53.3713458Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local 2025-03-14T06:24:53.3714366Z Compiling src/cpu/simple_concat.cpp; 6s local 2025-03-14T06:24:53.3715250Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 5s local ... 2025-03-14T06:24:53.6377211Z 2025-03-14T06:24:53.6378100Z  2025-03-14T06:24:53.6378578Z  2025-03-14T06:24:53.6378980Z  2025-03-14T06:24:53.6379382Z  2025-03-14T06:24:53.6379785Z  2025-03-14T06:24:53.6380176Z  2025-03-14T06:24:53.6380552Z  2025-03-14T06:24:53.6380947Z  2025-03-14T06:24:53.6381515Z [10,861 / 20,647] 48 actions, 47 running 2025-03-14T06:24:53.6382283Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T06:24:53.6383084Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T06:24:53.6384013Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:53.6384997Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:53.6385922Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:53.6386676Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local 2025-03-14T06:24:53.6387468Z Compiling src/cpu/simple_concat.cpp; 6s local 2025-03-14T06:24:53.6388606Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 6s local ... 2025-03-14T06:24:53.8402151Z 2025-03-14T06:24:53.8402976Z  2025-03-14T06:24:53.8403413Z  2025-03-14T06:24:53.8403785Z  2025-03-14T06:24:53.8404152Z  2025-03-14T06:24:53.8404668Z  2025-03-14T06:24:53.8405065Z  2025-03-14T06:24:53.8405486Z  2025-03-14T06:24:53.8405859Z  2025-03-14T06:24:53.8406448Z [10,877 / 20,647] 48 actions, 47 running 2025-03-14T06:24:53.8407190Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T06:24:53.8407969Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T06:24:53.8408771Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:53.8409721Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:53.8410654Z Compiling src/cpu/cpu_sum.cpp; 11s local 2025-03-14T06:24:53.8411339Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local 2025-03-14T06:24:53.8412125Z Compiling src/cpu/simple_concat.cpp; 7s local 2025-03-14T06:24:53.8412973Z Compiling llvm/lib/Support/CommandLine.cpp [for tool]; 6s local ... 2025-03-14T06:24:54.1487010Z 2025-03-14T06:24:54.1487801Z  2025-03-14T06:24:54.1488234Z  2025-03-14T06:24:54.1488551Z  2025-03-14T06:24:54.1488985Z  2025-03-14T06:24:54.1489372Z  2025-03-14T06:24:54.1489768Z  2025-03-14T06:24:54.1490157Z  2025-03-14T06:24:54.1490613Z  2025-03-14T06:24:54.1491055Z [10,896 / 20,647] 48 actions running 2025-03-14T06:24:54.1491667Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T06:24:54.1492396Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T06:24:54.1493128Z Compiling src/cpu/cpu_pooling_list.cpp; 17s local 2025-03-14T06:24:54.1494009Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 13s local 2025-03-14T06:24:54.1494885Z Compiling src/cpu/cpu_sum.cpp; 12s local 2025-03-14T06:24:54.1495590Z Compiling src/cpu/gemm_convolution_utils.cpp; 7s local 2025-03-14T06:24:54.1496314Z Compiling src/cpu/simple_concat.cpp; 7s local 2025-03-14T06:24:54.1497149Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 5s local ... 2025-03-14T06:24:54.3513616Z 2025-03-14T06:24:54.3514468Z  2025-03-14T06:24:54.3515241Z  2025-03-14T06:24:54.3515757Z  2025-03-14T06:24:54.3516183Z  2025-03-14T06:24:54.3516563Z  2025-03-14T06:24:54.3516951Z  2025-03-14T06:24:54.3517341Z  2025-03-14T06:24:54.3517750Z  2025-03-14T06:24:54.3518577Z [10,903 / 20,647] 48 actions, 47 running 2025-03-14T06:24:54.3519357Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:24:54.3529877Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T06:24:54.3531141Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2025-03-14T06:24:54.3532082Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:54.3532989Z Compiling src/cpu/cpu_sum.cpp; 12s local 2025-03-14T06:24:54.3533704Z Compiling src/cpu/gemm_convolution_utils.cpp; 8s local 2025-03-14T06:24:54.3534608Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 5s local 2025-03-14T06:24:54.3535438Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:24:54.5596005Z 2025-03-14T06:24:54.5596847Z  2025-03-14T06:24:54.5597321Z  2025-03-14T06:24:54.5597714Z  2025-03-14T06:24:54.5598105Z  2025-03-14T06:24:54.5598501Z  2025-03-14T06:24:54.5598876Z  2025-03-14T06:24:54.5599219Z  2025-03-14T06:24:54.5599522Z  2025-03-14T06:24:54.5599973Z [10,905 / 20,647] 48 actions, 47 running 2025-03-14T06:24:54.5600718Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:24:54.5601460Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T06:24:54.5602254Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2025-03-14T06:24:54.5603373Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:54.5604100Z Compiling src/cpu/cpu_sum.cpp; 12s local 2025-03-14T06:24:54.5604852Z Compiling src/cpu/gemm_convolution_utils.cpp; 8s local 2025-03-14T06:24:54.5605717Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T06:24:54.5606612Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:24:54.7924626Z 2025-03-14T06:24:54.7925454Z  2025-03-14T06:24:54.7925901Z  2025-03-14T06:24:54.7926291Z  2025-03-14T06:24:54.7926668Z  2025-03-14T06:24:54.7927079Z  2025-03-14T06:24:54.7927449Z  2025-03-14T06:24:54.7927813Z  2025-03-14T06:24:54.7928173Z  2025-03-14T06:24:54.7928710Z [10,911 / 20,647] 48 actions, 47 running 2025-03-14T06:24:54.7929438Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:24:54.7930216Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T06:24:54.7930943Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2025-03-14T06:24:54.7931805Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:54.7932636Z Compiling src/cpu/cpu_sum.cpp; 12s local 2025-03-14T06:24:54.7933279Z Compiling src/cpu/gemm_convolution_utils.cpp; 8s local 2025-03-14T06:24:54.7934085Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T06:24:54.7934820Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:24:54.9981373Z 2025-03-14T06:24:54.9982196Z  2025-03-14T06:24:54.9982665Z  2025-03-14T06:24:54.9983101Z  2025-03-14T06:24:54.9983509Z  2025-03-14T06:24:54.9983942Z  2025-03-14T06:24:54.9984351Z  2025-03-14T06:24:54.9984774Z  2025-03-14T06:24:54.9985174Z  2025-03-14T06:24:54.9985809Z [10,918 / 20,647] 48 actions, 47 running 2025-03-14T06:24:54.9986547Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:24:54.9987398Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T06:24:54.9988247Z Compiling src/cpu/cpu_pooling_list.cpp; 18s local 2025-03-14T06:24:54.9989152Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:54.9990243Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T06:24:54.9991514Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local 2025-03-14T06:24:54.9992377Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 4s local 2025-03-14T06:24:54.9993296Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 4s local ... 2025-03-14T06:24:55.2282379Z 2025-03-14T06:24:55.2283247Z  2025-03-14T06:24:55.2283744Z  2025-03-14T06:24:55.2284136Z  2025-03-14T06:24:55.2284682Z  2025-03-14T06:24:55.2285110Z  2025-03-14T06:24:55.2285513Z  2025-03-14T06:24:55.2286380Z  2025-03-14T06:24:55.2286830Z  2025-03-14T06:24:55.2287451Z [10,925 / 20,647] 48 actions, 47 running 2025-03-14T06:24:55.2288270Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:24:55.2289137Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T06:24:55.2290123Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 14s local 2025-03-14T06:24:55.2291213Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T06:24:55.2292232Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local 2025-03-14T06:24:55.2293055Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 4s local 2025-03-14T06:24:55.2293884Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 4s local 2025-03-14T06:24:55.2294654Z Compiling src/common/verbose.cpp; 4s local ... 2025-03-14T06:24:55.4435222Z 2025-03-14T06:24:55.4436094Z  2025-03-14T06:24:55.4436584Z  2025-03-14T06:24:55.4436987Z  2025-03-14T06:24:55.4437423Z  2025-03-14T06:24:55.4437817Z  2025-03-14T06:24:55.4438201Z  2025-03-14T06:24:55.4438568Z  2025-03-14T06:24:55.4439285Z  2025-03-14T06:24:55.4439898Z [10,936 / 20,647] 48 actions, 47 running 2025-03-14T06:24:55.4440784Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T06:24:55.4441650Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T06:24:55.4442666Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T06:24:55.4443798Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 6s local 2025-03-14T06:24:55.4444892Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 5s local 2025-03-14T06:24:55.4445758Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 5s local 2025-03-14T06:24:55.4446586Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 5s local 2025-03-14T06:24:55.4447328Z Compiling src/common/verbose.cpp; 5s local ... 2025-03-14T06:24:55.7385462Z 2025-03-14T06:24:55.7386327Z  2025-03-14T06:24:55.7386788Z  2025-03-14T06:24:55.7387154Z  2025-03-14T06:24:55.7387541Z  2025-03-14T06:24:55.7387919Z  2025-03-14T06:24:55.7388312Z  2025-03-14T06:24:55.7388692Z  2025-03-14T06:24:55.7389091Z  2025-03-14T06:24:55.7389693Z [10,941 / 20,647] 48 actions, 47 running 2025-03-14T06:24:55.7390541Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T06:24:55.7391363Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T06:24:55.7392398Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T06:24:55.7393489Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T06:24:55.7394413Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:55.7395210Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 5s local 2025-03-14T06:24:55.7396061Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 5s local 2025-03-14T06:24:55.7396850Z Compiling src/common/verbose.cpp; 5s local ... 2025-03-14T06:24:55.9498662Z 2025-03-14T06:24:55.9499517Z  2025-03-14T06:24:55.9500039Z  2025-03-14T06:24:55.9500454Z  2025-03-14T06:24:55.9500854Z  2025-03-14T06:24:55.9501258Z  2025-03-14T06:24:55.9501665Z  2025-03-14T06:24:55.9502063Z  2025-03-14T06:24:55.9502490Z  2025-03-14T06:24:55.9503064Z [10,945 / 20,647] 48 actions running 2025-03-14T06:24:55.9504084Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T06:24:55.9504903Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T06:24:55.9505948Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T06:24:55.9507218Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T06:24:55.9508159Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:55.9509132Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 5s local 2025-03-14T06:24:55.9509966Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 5s local 2025-03-14T06:24:55.9510787Z Compiling src/common/verbose.cpp; 5s local ... 2025-03-14T06:24:56.1832288Z 2025-03-14T06:24:56.1833179Z  2025-03-14T06:24:56.1833676Z  2025-03-14T06:24:56.1834110Z  2025-03-14T06:24:56.1834534Z  2025-03-14T06:24:56.1834959Z  2025-03-14T06:24:56.1835377Z  2025-03-14T06:24:56.1835806Z  2025-03-14T06:24:56.1836264Z  2025-03-14T06:24:56.1836874Z [10,949 / 20,647] 48 actions, 47 running 2025-03-14T06:24:56.1837607Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T06:24:56.1838433Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T06:24:56.1839419Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 15s local 2025-03-14T06:24:56.1840471Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T06:24:56.1841387Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:56.1842224Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 5s local 2025-03-14T06:24:56.1843324Z Compiling src/cpu/matmul/gemm_f32_matmul.cpp; 5s local 2025-03-14T06:24:56.1844129Z Compiling src/common/verbose.cpp; 5s local ... 2025-03-14T06:24:56.4284907Z 2025-03-14T06:24:56.4285783Z  2025-03-14T06:24:56.4286296Z  2025-03-14T06:24:56.4286719Z  2025-03-14T06:24:56.4287139Z  2025-03-14T06:24:56.4287589Z  2025-03-14T06:24:56.4288007Z  2025-03-14T06:24:56.4288416Z  2025-03-14T06:24:56.4288829Z  2025-03-14T06:24:56.4289439Z [10,954 / 20,647] 48 actions, 47 running 2025-03-14T06:24:56.4290249Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:24:56.4291132Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T06:24:56.4292173Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T06:24:56.4293296Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local 2025-03-14T06:24:56.4294269Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:56.4295161Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local 2025-03-14T06:24:56.4295974Z Compiling src/common/verbose.cpp; 6s local 2025-03-14T06:24:56.4296836Z Compiling src/cpu/matmul/gemm_x8s8s32x_matmul.cpp; 5s local ... 2025-03-14T06:24:56.6920453Z 2025-03-14T06:24:56.6921342Z  2025-03-14T06:24:56.6921986Z  2025-03-14T06:24:56.6922515Z  2025-03-14T06:24:56.6923021Z  2025-03-14T06:24:56.6923489Z  2025-03-14T06:24:56.6923881Z  2025-03-14T06:24:56.6924275Z  2025-03-14T06:24:56.6924826Z  2025-03-14T06:24:56.6925516Z [10,959 / 20,647] 48 actions, 47 running 2025-03-14T06:24:56.6926315Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:24:56.6927095Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T06:24:56.6928124Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T06:24:56.6929248Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2025-03-14T06:24:56.6930166Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 6s local 2025-03-14T06:24:56.6931034Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local 2025-03-14T06:24:56.6931919Z Compiling src/common/verbose.cpp; 6s local 2025-03-14T06:24:56.6932779Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 6s local ... 2025-03-14T06:24:56.9081793Z 2025-03-14T06:24:56.9082702Z  2025-03-14T06:24:56.9083224Z  2025-03-14T06:24:56.9083639Z  2025-03-14T06:24:56.9084052Z  2025-03-14T06:24:56.9084641Z  2025-03-14T06:24:56.9085406Z  2025-03-14T06:24:56.9085827Z  2025-03-14T06:24:56.9086254Z  2025-03-14T06:24:56.9086906Z [10,965 / 20,647] 48 actions, 47 running 2025-03-14T06:24:56.9087717Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:24:56.9088804Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T06:24:56.9089907Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T06:24:56.9091010Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2025-03-14T06:24:56.9091994Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2025-03-14T06:24:56.9092810Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local 2025-03-14T06:24:56.9093595Z Compiling src/common/verbose.cpp; 6s local 2025-03-14T06:24:56.9094471Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 6s local ... 2025-03-14T06:24:57.1386331Z 2025-03-14T06:24:57.1387207Z  2025-03-14T06:24:57.1387729Z  2025-03-14T06:24:57.1388197Z  2025-03-14T06:24:57.1388624Z  2025-03-14T06:24:57.1389029Z  2025-03-14T06:24:57.1389451Z  2025-03-14T06:24:57.1389886Z  2025-03-14T06:24:57.1390321Z  2025-03-14T06:24:57.1390985Z [10,967 / 20,647] 48 actions, 47 running 2025-03-14T06:24:57.1391822Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:24:57.1392947Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T06:24:57.1393785Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 16s local 2025-03-14T06:24:57.1394751Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2025-03-14T06:24:57.1395509Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2025-03-14T06:24:57.1396236Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local 2025-03-14T06:24:57.1396946Z Compiling src/common/verbose.cpp; 6s local 2025-03-14T06:24:57.1397882Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 6s local ... 2025-03-14T06:24:57.3508024Z 2025-03-14T06:24:57.3508890Z  2025-03-14T06:24:57.3509391Z  2025-03-14T06:24:57.3509828Z  2025-03-14T06:24:57.3510264Z  2025-03-14T06:24:57.3510708Z  2025-03-14T06:24:57.3511131Z  2025-03-14T06:24:57.3511603Z  2025-03-14T06:24:57.3512018Z  2025-03-14T06:24:57.3512607Z [10,969 / 20,647] 48 actions running 2025-03-14T06:24:57.3513412Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:24:57.3514305Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T06:24:57.3515416Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:57.3517325Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local 2025-03-14T06:24:57.3518383Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2025-03-14T06:24:57.3519312Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 6s local 2025-03-14T06:24:57.3520074Z Compiling src/common/verbose.cpp; 6s local 2025-03-14T06:24:57.3520973Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 6s local ... 2025-03-14T06:24:57.5750296Z 2025-03-14T06:24:57.5751081Z  2025-03-14T06:24:57.5751584Z  2025-03-14T06:24:57.5752033Z  2025-03-14T06:24:57.5752503Z  2025-03-14T06:24:57.5752938Z  2025-03-14T06:24:57.5753373Z  2025-03-14T06:24:57.5753809Z  2025-03-14T06:24:57.5754260Z  2025-03-14T06:24:57.5754906Z [10,974 / 20,647] 48 actions, 47 running 2025-03-14T06:24:57.5755758Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:24:57.5756693Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T06:24:57.5757813Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:57.5759249Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T06:24:57.5760279Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 7s local 2025-03-14T06:24:57.5761302Z Compiling src/cpu/matmul/gemm_bf16_matmul.cpp; 7s local 2025-03-14T06:24:57.5762137Z Compiling src/common/verbose.cpp; 7s local 2025-03-14T06:24:57.5763102Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 6s local ... 2025-03-14T06:24:57.7775448Z 2025-03-14T06:24:57.7776294Z  2025-03-14T06:24:57.7776807Z  2025-03-14T06:24:57.7777258Z  2025-03-14T06:24:57.7777707Z  2025-03-14T06:24:57.7778161Z  2025-03-14T06:24:57.7778593Z  2025-03-14T06:24:57.7779032Z  2025-03-14T06:24:57.7779472Z  2025-03-14T06:24:57.7780101Z [10,980 / 20,647] 48 actions, 47 running 2025-03-14T06:24:57.7780960Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:24:57.7781898Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T06:24:57.7783018Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:57.7784218Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T06:24:57.7785245Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:57.7786089Z Compiling src/common/verbose.cpp; 7s local 2025-03-14T06:24:57.7787016Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local 2025-03-14T06:24:57.7787985Z Compiling googletest/src/gtest.cc; 6s local ... 2025-03-14T06:24:58.0107589Z 2025-03-14T06:24:58.0108396Z  2025-03-14T06:24:58.0109158Z  2025-03-14T06:24:58.0109611Z  2025-03-14T06:24:58.0110058Z  2025-03-14T06:24:58.0110501Z  2025-03-14T06:24:58.0110941Z  2025-03-14T06:24:58.0111375Z  2025-03-14T06:24:58.0111812Z  2025-03-14T06:24:58.0112450Z [10,990 / 20,647] 48 actions, 47 running 2025-03-14T06:24:58.0113322Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:24:58.0114244Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T06:24:58.0115368Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:58.0116591Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T06:24:58.0118298Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:58.0119156Z Compiling src/common/verbose.cpp; 7s local 2025-03-14T06:24:58.0120082Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local 2025-03-14T06:24:58.0121065Z Compiling googletest/src/gtest.cc; 7s local ... 2025-03-14T06:24:58.2231969Z 2025-03-14T06:24:58.2232817Z  2025-03-14T06:24:58.2233339Z  2025-03-14T06:24:58.2233787Z  2025-03-14T06:24:58.2234222Z  2025-03-14T06:24:58.2234662Z  2025-03-14T06:24:58.2235106Z  2025-03-14T06:24:58.2235557Z  2025-03-14T06:24:58.2236025Z  2025-03-14T06:24:58.2236676Z [10,993 / 20,647] 48 actions, 47 running 2025-03-14T06:24:58.2237536Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:24:58.2238483Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T06:24:58.2239615Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 17s local 2025-03-14T06:24:58.2240836Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T06:24:58.2241852Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:58.2242705Z Compiling src/common/verbose.cpp; 7s local 2025-03-14T06:24:58.2243639Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local 2025-03-14T06:24:58.2244756Z Compiling googletest/src/gtest.cc; 7s local ... 2025-03-14T06:24:58.5513412Z 2025-03-14T06:24:58.5514509Z  2025-03-14T06:24:58.5515445Z  2025-03-14T06:24:58.5516147Z  2025-03-14T06:24:58.5517256Z  2025-03-14T06:24:58.5518057Z  2025-03-14T06:24:58.5518516Z  2025-03-14T06:24:58.5518935Z  2025-03-14T06:24:58.5519377Z  2025-03-14T06:24:58.5520003Z [11,002 / 20,647] 48 actions running 2025-03-14T06:24:58.5520847Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T06:24:58.5521886Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T06:24:58.5522923Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T06:24:58.5524267Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T06:24:58.5525423Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 8s local 2025-03-14T06:24:58.5526276Z Compiling src/common/verbose.cpp; 8s local 2025-03-14T06:24:58.5527143Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 7s local 2025-03-14T06:24:58.5527971Z Compiling googletest/src/gtest.cc; 7s local ... 2025-03-14T06:24:58.7787211Z 2025-03-14T06:24:58.7788061Z  2025-03-14T06:24:58.7788583Z  2025-03-14T06:24:58.7789010Z  2025-03-14T06:24:58.7789408Z  2025-03-14T06:24:58.7789816Z  2025-03-14T06:24:58.7790214Z  2025-03-14T06:24:58.7790630Z  2025-03-14T06:24:58.7791015Z  2025-03-14T06:24:58.7791610Z [11,007 / 20,647] 48 actions, 47 running 2025-03-14T06:24:58.7792314Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T06:24:58.7793108Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T06:24:58.7794110Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T06:24:58.7795448Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T06:24:58.7796397Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2025-03-14T06:24:58.7797153Z Compiling src/common/verbose.cpp; 8s local 2025-03-14T06:24:58.7797989Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 8s local 2025-03-14T06:24:58.7798918Z Compiling googletest/src/gtest.cc; 7s local ... 2025-03-14T06:24:58.9998223Z 2025-03-14T06:24:58.9999095Z  2025-03-14T06:24:58.9999593Z  2025-03-14T06:24:59.0000015Z  2025-03-14T06:24:59.0000434Z  2025-03-14T06:24:59.0000843Z  2025-03-14T06:24:59.0001266Z  2025-03-14T06:24:59.0001667Z  2025-03-14T06:24:59.0002064Z  2025-03-14T06:24:59.0002682Z [11,015 / 20,647] 48 actions, 47 running 2025-03-14T06:24:59.0003462Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T06:24:59.0004296Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T06:24:59.0005488Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T06:24:59.0006601Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T06:24:59.0007537Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2025-03-14T06:24:59.0008299Z Compiling src/common/verbose.cpp; 8s local 2025-03-14T06:24:59.0009140Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 8s local 2025-03-14T06:24:59.0010050Z Compiling googletest/src/gtest.cc; 8s local ... 2025-03-14T06:24:59.2147382Z 2025-03-14T06:24:59.2148691Z  2025-03-14T06:24:59.2149482Z  2025-03-14T06:24:59.2150204Z  2025-03-14T06:24:59.2151328Z  2025-03-14T06:24:59.2151839Z  2025-03-14T06:24:59.2152289Z  2025-03-14T06:24:59.2152730Z  2025-03-14T06:24:59.2153190Z  2025-03-14T06:24:59.2153879Z [11,021 / 20,647] 48 actions, 47 running 2025-03-14T06:24:59.2154670Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T06:24:59.2155535Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T06:24:59.2156569Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 18s local 2025-03-14T06:24:59.2157739Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T06:24:59.2158707Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2025-03-14T06:24:59.2159784Z Compiling src/common/verbose.cpp; 8s local 2025-03-14T06:24:59.2160689Z Compiling src/cpu/reorder/cpu_reorder_regular_bf16.cpp; 8s local 2025-03-14T06:24:59.2161594Z Compiling googletest/src/gtest.cc; 8s local ... 2025-03-14T06:24:59.4520103Z 2025-03-14T06:24:59.4521068Z  2025-03-14T06:24:59.4521524Z  2025-03-14T06:24:59.4522121Z  2025-03-14T06:24:59.4522579Z  2025-03-14T06:24:59.4523125Z  2025-03-14T06:24:59.4523647Z  2025-03-14T06:24:59.4524185Z  2025-03-14T06:24:59.4525102Z  2025-03-14T06:24:59.4525895Z [11,032 / 20,647] 48 actions, 47 running 2025-03-14T06:24:59.4526846Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T06:24:59.4527879Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T06:24:59.4529061Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T06:24:59.4530362Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T06:24:59.4531455Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 9s local 2025-03-14T06:24:59.4532388Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:24:59.4533195Z Compiling googletest/src/gtest.cc; 8s local 2025-03-14T06:24:59.4534238Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 7s local ... 2025-03-14T06:24:59.7522566Z 2025-03-14T06:24:59.7523431Z  2025-03-14T06:24:59.7523951Z  2025-03-14T06:24:59.7524369Z  2025-03-14T06:24:59.7524945Z  2025-03-14T06:24:59.7525387Z  2025-03-14T06:24:59.7525781Z  2025-03-14T06:24:59.7526289Z  2025-03-14T06:24:59.7526828Z  2025-03-14T06:24:59.7527828Z [11,038 / 20,647] 48 actions running 2025-03-14T06:24:59.7528680Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T06:24:59.7529585Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T06:24:59.7530655Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T06:24:59.7531757Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T06:24:59.7532655Z Compiling src/cpu/matmul/cpu_matmul_list.cpp; 10s local 2025-03-14T06:24:59.7533459Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:24:59.7534198Z Compiling googletest/src/gtest.cc; 8s local 2025-03-14T06:24:59.7535008Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 8s local ... 2025-03-14T06:25:00.0349460Z 2025-03-14T06:25:00.0350300Z  2025-03-14T06:25:00.0350838Z  2025-03-14T06:25:00.0351282Z  2025-03-14T06:25:00.0351721Z  2025-03-14T06:25:00.0352119Z  2025-03-14T06:25:00.0352653Z  2025-03-14T06:25:00.0353057Z  2025-03-14T06:25:00.0353462Z  2025-03-14T06:25:00.0354092Z [11,044 / 20,647] 48 actions, 47 running 2025-03-14T06:25:00.0354895Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T06:25:00.0355713Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T06:25:00.0356710Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 19s local 2025-03-14T06:25:00.0357771Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T06:25:00.0358615Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:25:00.0359330Z Compiling googletest/src/gtest.cc; 9s local 2025-03-14T06:25:00.0360199Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 8s local 2025-03-14T06:25:00.0361042Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:25:00.2746632Z 2025-03-14T06:25:00.2747520Z  2025-03-14T06:25:00.2748037Z  2025-03-14T06:25:00.2748464Z  2025-03-14T06:25:00.2748888Z  2025-03-14T06:25:00.2749303Z  2025-03-14T06:25:00.2749701Z  2025-03-14T06:25:00.2750130Z  2025-03-14T06:25:00.2750552Z  2025-03-14T06:25:00.2751167Z [11,050 / 20,647] 48 actions, 47 running 2025-03-14T06:25:00.2751976Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T06:25:00.2753102Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T06:25:00.2754147Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:25:00.2755417Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T06:25:00.2756397Z Compiling src/common/verbose.cpp; 9s local 2025-03-14T06:25:00.2757082Z Compiling googletest/src/gtest.cc; 9s local 2025-03-14T06:25:00.2758048Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 8s local 2025-03-14T06:25:00.2758850Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:25:00.5116023Z 2025-03-14T06:25:00.5116886Z  2025-03-14T06:25:00.5118218Z  2025-03-14T06:25:00.5118643Z  2025-03-14T06:25:00.5119064Z  2025-03-14T06:25:00.5119474Z  2025-03-14T06:25:00.5119870Z  2025-03-14T06:25:00.5120254Z  2025-03-14T06:25:00.5120666Z  2025-03-14T06:25:00.5121270Z [11,062 / 20,648] 48 actions, 47 running 2025-03-14T06:25:00.5122068Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T06:25:00.5123197Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:25:00.5124286Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:00.5125376Z Compiling src/common/verbose.cpp; 10s local 2025-03-14T06:25:00.5126256Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 8s local 2025-03-14T06:25:00.5127049Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:25:00.5127637Z @onednn//:mkl_dnn; 6s local 2025-03-14T06:25:00.5128772Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 5s local ... 2025-03-14T06:25:00.7542912Z 2025-03-14T06:25:00.7543742Z  2025-03-14T06:25:00.7544253Z  2025-03-14T06:25:00.7544693Z  2025-03-14T06:25:00.7545072Z  2025-03-14T06:25:00.7545479Z  2025-03-14T06:25:00.7545891Z  2025-03-14T06:25:00.7546305Z  2025-03-14T06:25:00.7546763Z  2025-03-14T06:25:00.7547712Z [11,065 / 20,648] 1 / 17 tests; 48 actions running; last test: ...ys_util_test 2025-03-14T06:25:00.7548736Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T06:25:00.7549749Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:25:00.7550844Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:00.7551720Z Compiling src/common/verbose.cpp; 10s local 2025-03-14T06:25:00.7552666Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 9s local 2025-03-14T06:25:00.7553485Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:00.7554061Z @onednn//:mkl_dnn; 6s local 2025-03-14T06:25:00.7554903Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local ... 2025-03-14T06:25:00.9550510Z 2025-03-14T06:25:00.9551664Z  2025-03-14T06:25:00.9552316Z  2025-03-14T06:25:00.9552832Z  2025-03-14T06:25:00.9553415Z  2025-03-14T06:25:00.9553956Z  2025-03-14T06:25:00.9554491Z  2025-03-14T06:25:00.9555031Z  2025-03-14T06:25:00.9555576Z  2025-03-14T06:25:00.9556813Z [11,068 / 20,649] 1 / 17 tests; 48 actions running; last test: ...ys_util_test 2025-03-14T06:25:00.9558221Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T06:25:00.9559569Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:25:00.9561047Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:00.9562378Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 9s local 2025-03-14T06:25:00.9563453Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:00.9564233Z @onednn//:mkl_dnn; 6s local 2025-03-14T06:25:00.9565596Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local 2025-03-14T06:25:00.9566834Z Compiling src/cpu/nhwc_pooling.cpp; 6s local ... 2025-03-14T06:25:01.1553394Z 2025-03-14T06:25:01.1554240Z  2025-03-14T06:25:01.1554720Z  2025-03-14T06:25:01.1555108Z  2025-03-14T06:25:01.1555507Z  2025-03-14T06:25:01.1555886Z  2025-03-14T06:25:01.1556254Z  2025-03-14T06:25:01.1556653Z  2025-03-14T06:25:01.1557403Z  2025-03-14T06:25:01.1558406Z [11,072 / 20,649] 1 / 17 tests; 48 actions running; last test: ...ys_util_test 2025-03-14T06:25:01.1559476Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T06:25:01.1560678Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 20s local 2025-03-14T06:25:01.1561797Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:01.1562793Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 9s local 2025-03-14T06:25:01.1563601Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:01.1564636Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local 2025-03-14T06:25:01.1565807Z Compiling src/cpu/nhwc_pooling.cpp; 6s local 2025-03-14T06:25:01.1566654Z Compiling src/cpu/nspc_batch_normalization.cpp; 6s local ... 2025-03-14T06:25:01.4169381Z 2025-03-14T06:25:01.4170282Z  2025-03-14T06:25:01.4170785Z  2025-03-14T06:25:01.4171219Z  2025-03-14T06:25:01.4171580Z  2025-03-14T06:25:01.4171969Z  2025-03-14T06:25:01.4172362Z  2025-03-14T06:25:01.4172746Z  2025-03-14T06:25:01.4173128Z  2025-03-14T06:25:01.4174057Z [11,080 / 20,649] 1 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:25:01.4175114Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:01.4176438Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:25:01.4177507Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:01.4178495Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 9s local 2025-03-14T06:25:01.4179202Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:01.4179933Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local 2025-03-14T06:25:01.4180724Z Compiling src/cpu/nhwc_pooling.cpp; 6s local 2025-03-14T06:25:01.4181450Z Compiling src/cpu/nspc_batch_normalization.cpp; 6s local ... 2025-03-14T06:25:01.6276233Z 2025-03-14T06:25:01.6277102Z  2025-03-14T06:25:01.6277565Z  2025-03-14T06:25:01.6277981Z  2025-03-14T06:25:01.6278388Z  2025-03-14T06:25:01.6278799Z  2025-03-14T06:25:01.6279240Z  2025-03-14T06:25:01.6279640Z  2025-03-14T06:25:01.6280050Z  2025-03-14T06:25:01.6281009Z [11,084 / 20,650] 2 / 17 tests; 48 actions, 47 running; last test: ...che_test 2025-03-14T06:25:01.6281978Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:01.6283128Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:25:01.6284295Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T06:25:01.6285560Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local 2025-03-14T06:25:01.6286441Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:25:01.6287356Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 6s local 2025-03-14T06:25:01.6288319Z Compiling src/cpu/nhwc_pooling.cpp; 6s local 2025-03-14T06:25:01.6289095Z Compiling src/cpu/nspc_batch_normalization.cpp; 6s local ... 2025-03-14T06:25:01.8818852Z 2025-03-14T06:25:01.8819754Z  2025-03-14T06:25:01.8820270Z  2025-03-14T06:25:01.8820689Z  2025-03-14T06:25:01.8821119Z  2025-03-14T06:25:01.8821539Z  2025-03-14T06:25:01.8821972Z  2025-03-14T06:25:01.8822381Z  2025-03-14T06:25:01.8822801Z  2025-03-14T06:25:01.8823747Z [11,086 / 20,650] 2 / 17 tests; 48 actions, 47 running; last test: ...che_test 2025-03-14T06:25:01.8824817Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:01.8826187Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:25:01.8827320Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T06:25:01.8828357Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local 2025-03-14T06:25:01.8829379Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:25:01.8830249Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2025-03-14T06:25:01.8831381Z Compiling src/cpu/nhwc_pooling.cpp; 6s local 2025-03-14T06:25:01.8832244Z Compiling src/cpu/nspc_batch_normalization.cpp; 6s local ... 2025-03-14T06:25:02.0849611Z 2025-03-14T06:25:02.0850527Z  2025-03-14T06:25:02.0850981Z  2025-03-14T06:25:02.0851381Z  2025-03-14T06:25:02.0851777Z  2025-03-14T06:25:02.0852161Z  2025-03-14T06:25:02.0852571Z  2025-03-14T06:25:02.0852948Z  2025-03-14T06:25:02.0853351Z  2025-03-14T06:25:02.0854393Z [11,090 / 20,650] 2 / 17 tests; 48 actions, 47 running; last test: ...che_test 2025-03-14T06:25:02.0855407Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:02.0856437Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 21s local 2025-03-14T06:25:02.0857626Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T06:25:02.0858650Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local 2025-03-14T06:25:02.0859485Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:25:02.0860356Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2025-03-14T06:25:02.0861658Z Compiling src/cpu/nhwc_pooling.cpp; 7s local 2025-03-14T06:25:02.0862544Z Compiling src/cpu/nspc_batch_normalization.cpp; 7s local ... 2025-03-14T06:25:02.2906653Z 2025-03-14T06:25:02.2907492Z  2025-03-14T06:25:02.2908000Z  2025-03-14T06:25:02.2908390Z  2025-03-14T06:25:02.2908791Z  2025-03-14T06:25:02.2909230Z  2025-03-14T06:25:02.2909635Z  2025-03-14T06:25:02.2910036Z  2025-03-14T06:25:02.2910449Z  2025-03-14T06:25:02.2911410Z [11,094 / 20,650] 2 / 17 tests; 47 actions, 46 running; last test: ...che_test 2025-03-14T06:25:02.2912456Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:02.2913441Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:25:02.2914543Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T06:25:02.2915553Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local 2025-03-14T06:25:02.2916672Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2025-03-14T06:25:02.2918428Z Compiling src/cpu/nhwc_pooling.cpp; 7s local 2025-03-14T06:25:02.2919185Z Compiling src/cpu/nspc_batch_normalization.cpp; 7s local 2025-03-14T06:25:02.2920108Z Compiling src/cpu/ref_batch_normalization.cpp; 6s local ... 2025-03-14T06:25:02.5366149Z 2025-03-14T06:25:02.5367050Z  2025-03-14T06:25:02.5367544Z  2025-03-14T06:25:02.5367967Z  2025-03-14T06:25:02.5368375Z  2025-03-14T06:25:02.5368796Z  2025-03-14T06:25:02.5369228Z  2025-03-14T06:25:02.5369674Z  2025-03-14T06:25:02.5370095Z  2025-03-14T06:25:02.5371052Z [11,105 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:02.5372174Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T06:25:02.5373202Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:25:02.5374204Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:02.5375224Z Compiling src/cpu/x64/brgemm/jit_brgemm_amx_uker.cpp; 10s local 2025-03-14T06:25:02.5376343Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 7s local 2025-03-14T06:25:02.5377399Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2025-03-14T06:25:02.5378542Z Compiling src/cpu/ref_deconvolution.cpp; 4s local 2025-03-14T06:25:02.5379351Z Compiling src/cpu/ref_eltwise.cpp; 4s local ... 2025-03-14T06:25:02.7564960Z 2025-03-14T06:25:02.7571760Z  2025-03-14T06:25:02.7572586Z  2025-03-14T06:25:02.7573001Z  2025-03-14T06:25:02.7573407Z  2025-03-14T06:25:02.7573810Z  2025-03-14T06:25:02.7574235Z  2025-03-14T06:25:02.7574651Z  2025-03-14T06:25:02.7575078Z  2025-03-14T06:25:02.7576195Z [11,112 / 20,650] 3 / 17 tests; 46 actions running; last test: ...nv_hash_test 2025-03-14T06:25:02.7577416Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T06:25:02.7578466Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:25:02.7579599Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:02.7580729Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 8s local 2025-03-14T06:25:02.7581795Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2025-03-14T06:25:02.7588074Z Compiling src/cpu/ref_deconvolution.cpp; 5s local 2025-03-14T06:25:02.7588839Z Compiling src/cpu/ref_eltwise.cpp; 5s local 2025-03-14T06:25:02.7589508Z @onednn//:mkl_dnn; 4s local ... 2025-03-14T06:25:02.9658947Z 2025-03-14T06:25:02.9659782Z  2025-03-14T06:25:02.9660294Z  2025-03-14T06:25:02.9660728Z  2025-03-14T06:25:02.9661090Z  2025-03-14T06:25:02.9661501Z  2025-03-14T06:25:02.9661943Z  2025-03-14T06:25:02.9662358Z  2025-03-14T06:25:02.9662781Z  2025-03-14T06:25:02.9664271Z [11,115 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:02.9665677Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T06:25:02.9666736Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:25:02.9667938Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:02.9669005Z Compiling llvm/lib/Support/VirtualFileSystem.cpp [for tool]; 8s local 2025-03-14T06:25:02.9670004Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2025-03-14T06:25:02.9670723Z Compiling src/cpu/ref_deconvolution.cpp; 5s local 2025-03-14T06:25:02.9671582Z Compiling src/cpu/ref_eltwise.cpp; 5s local 2025-03-14T06:25:02.9672230Z @onednn//:mkl_dnn; 4s local ... 2025-03-14T06:25:03.2174056Z 2025-03-14T06:25:03.2174888Z  2025-03-14T06:25:03.2175294Z  2025-03-14T06:25:03.2175619Z  2025-03-14T06:25:03.2175968Z  2025-03-14T06:25:03.2176382Z  2025-03-14T06:25:03.2176799Z  2025-03-14T06:25:03.2177217Z  2025-03-14T06:25:03.2177623Z  2025-03-14T06:25:03.2178609Z [11,123 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:03.2179675Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T06:25:03.2180726Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 22s local 2025-03-14T06:25:03.2181928Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:03.2182835Z Compiling src/cpu/ref_batch_normalization.cpp; 7s local 2025-03-14T06:25:03.2183682Z Compiling src/cpu/ref_deconvolution.cpp; 5s local 2025-03-14T06:25:03.2184439Z Compiling src/cpu/ref_eltwise.cpp; 5s local 2025-03-14T06:25:03.2185328Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 4s local 2025-03-14T06:25:03.2186470Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_f16.cpp; 4s local ... 2025-03-14T06:25:03.5572888Z 2025-03-14T06:25:03.5573805Z  2025-03-14T06:25:03.5574314Z  2025-03-14T06:25:03.5574733Z  2025-03-14T06:25:03.5575121Z  2025-03-14T06:25:03.5575524Z  2025-03-14T06:25:03.5575938Z  2025-03-14T06:25:03.5576339Z  2025-03-14T06:25:03.5576786Z  2025-03-14T06:25:03.5578037Z [11,128 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:03.5579162Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T06:25:03.5580191Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T06:25:03.5581419Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T06:25:03.5582361Z Compiling src/cpu/ref_batch_normalization.cpp; 8s local 2025-03-14T06:25:03.5583373Z Compiling src/cpu/ref_deconvolution.cpp; 5s local 2025-03-14T06:25:03.5584151Z Compiling src/cpu/ref_eltwise.cpp; 5s local 2025-03-14T06:25:03.5585111Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 5s local 2025-03-14T06:25:03.5586207Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_f16.cpp; 4s local ... 2025-03-14T06:25:03.8875771Z 2025-03-14T06:25:03.8876599Z  2025-03-14T06:25:03.8877088Z  2025-03-14T06:25:03.8877503Z  2025-03-14T06:25:03.8877916Z  2025-03-14T06:25:03.8878306Z  2025-03-14T06:25:03.8878686Z  2025-03-14T06:25:03.8879081Z  2025-03-14T06:25:03.8879454Z  2025-03-14T06:25:03.8880414Z [11,133 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:03.8881441Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T06:25:03.8882350Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T06:25:03.8883340Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T06:25:03.8884133Z Compiling src/cpu/ref_deconvolution.cpp; 6s local 2025-03-14T06:25:03.8885340Z Compiling src/cpu/ref_eltwise.cpp; 6s local 2025-03-14T06:25:03.8886244Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 5s local 2025-03-14T06:25:03.8887319Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_f16.cpp; 5s local 2025-03-14T06:25:03.8888378Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s32.cpp; 4s local ... 2025-03-14T06:25:04.1578751Z 2025-03-14T06:25:04.1579546Z  2025-03-14T06:25:04.1580059Z  2025-03-14T06:25:04.1580517Z  2025-03-14T06:25:04.1580972Z  2025-03-14T06:25:04.1581421Z  2025-03-14T06:25:04.1581895Z  2025-03-14T06:25:04.1582330Z  2025-03-14T06:25:04.1582754Z  2025-03-14T06:25:04.1583740Z [11,136 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:04.1584869Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T06:25:04.1585920Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 23s local 2025-03-14T06:25:04.1587067Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T06:25:04.1588013Z Compiling src/cpu/ref_deconvolution.cpp; 6s local 2025-03-14T06:25:04.1588814Z Compiling src/cpu/ref_eltwise.cpp; 6s local 2025-03-14T06:25:04.1589759Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 5s local 2025-03-14T06:25:04.1590908Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_f16.cpp; 5s local 2025-03-14T06:25:04.1592041Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s32.cpp; 4s local ... 2025-03-14T06:25:04.3583887Z 2025-03-14T06:25:04.3584817Z  2025-03-14T06:25:04.3585325Z  2025-03-14T06:25:04.3585752Z  2025-03-14T06:25:04.3586176Z  2025-03-14T06:25:04.3586568Z  2025-03-14T06:25:04.3586996Z  2025-03-14T06:25:04.3587396Z  2025-03-14T06:25:04.3587841Z  2025-03-14T06:25:04.3588814Z [11,137 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:04.3589866Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T06:25:04.3591002Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:25:04.3592006Z Compiling src/cpu/ref_deconvolution.cpp; 6s local 2025-03-14T06:25:04.3593011Z Compiling src/cpu/ref_eltwise.cpp; 6s local 2025-03-14T06:25:04.3593963Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 5s local 2025-03-14T06:25:04.3595100Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_f16.cpp; 5s local 2025-03-14T06:25:04.3596341Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s32.cpp; 4s local 2025-03-14T06:25:04.3597205Z @onednn//:mkl_dnn; 4s local ... 2025-03-14T06:25:04.6674967Z 2025-03-14T06:25:04.6675789Z  2025-03-14T06:25:04.6676284Z  2025-03-14T06:25:04.6676959Z  2025-03-14T06:25:04.6677400Z  2025-03-14T06:25:04.6677796Z  2025-03-14T06:25:04.6678194Z  2025-03-14T06:25:04.6678597Z  2025-03-14T06:25:04.6679005Z  2025-03-14T06:25:04.6679956Z [11,141 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:04.6680959Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T06:25:04.6681938Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:25:04.6682930Z Compiling src/cpu/ref_deconvolution.cpp; 6s local 2025-03-14T06:25:04.6683645Z Compiling src/cpu/ref_eltwise.cpp; 6s local 2025-03-14T06:25:04.6684705Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 6s local 2025-03-14T06:25:04.6685957Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_f16.cpp; 6s local 2025-03-14T06:25:04.6696916Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s32.cpp; 5s local 2025-03-14T06:25:04.6698102Z @onednn//:mkl_dnn; 4s local ... 2025-03-14T06:25:04.9578037Z 2025-03-14T06:25:04.9578877Z  2025-03-14T06:25:04.9579380Z  2025-03-14T06:25:04.9580041Z  2025-03-14T06:25:04.9580495Z  2025-03-14T06:25:04.9580916Z  2025-03-14T06:25:04.9581329Z  2025-03-14T06:25:04.9581713Z  2025-03-14T06:25:04.9582103Z  2025-03-14T06:25:04.9583080Z [11,145 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:04.9584130Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T06:25:04.9585156Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:25:04.9586148Z Compiling src/cpu/ref_deconvolution.cpp; 7s local 2025-03-14T06:25:04.9586900Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2025-03-14T06:25:04.9587772Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 6s local 2025-03-14T06:25:04.9588843Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_f16.cpp; 6s local 2025-03-14T06:25:04.9589851Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s32.cpp; 5s local 2025-03-14T06:25:04.9590625Z @onednn//:mkl_dnn; 5s local ... 2025-03-14T06:25:05.1591137Z 2025-03-14T06:25:05.1592009Z  2025-03-14T06:25:05.1592460Z  2025-03-14T06:25:05.1592852Z  2025-03-14T06:25:05.1593227Z  2025-03-14T06:25:05.1593589Z  2025-03-14T06:25:05.1593972Z  2025-03-14T06:25:05.1594396Z  2025-03-14T06:25:05.1594794Z  2025-03-14T06:25:05.1595724Z [11,149 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:05.1596724Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T06:25:05.1597749Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 24s local 2025-03-14T06:25:05.1598633Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2025-03-14T06:25:05.1599532Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 6s local 2025-03-14T06:25:05.1600754Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s32.cpp; 5s local 2025-03-14T06:25:05.1601607Z @onednn//:mkl_dnn; 5s local 2025-03-14T06:25:05.1602276Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2025-03-14T06:25:05.1603059Z @onednn//:onednn_autogen; 4s local ... 2025-03-14T06:25:05.3595812Z 2025-03-14T06:25:05.3596639Z  2025-03-14T06:25:05.3597165Z  2025-03-14T06:25:05.3597883Z  2025-03-14T06:25:05.3598291Z  2025-03-14T06:25:05.3598692Z  2025-03-14T06:25:05.3599101Z  2025-03-14T06:25:05.3599490Z  2025-03-14T06:25:05.3599906Z  2025-03-14T06:25:05.3600849Z [11,151 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:05.3602099Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T06:25:05.3603077Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T06:25:05.3604169Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2025-03-14T06:25:05.3605213Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 6s local 2025-03-14T06:25:05.3606298Z Compiling src/cpu/reorder/cpu_reorder_regular_f32_s32.cpp; 5s local 2025-03-14T06:25:05.3607081Z @onednn//:mkl_dnn; 5s local 2025-03-14T06:25:05.3607765Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2025-03-14T06:25:05.3608539Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:25:05.6944504Z 2025-03-14T06:25:05.6945355Z  2025-03-14T06:25:05.6945810Z  2025-03-14T06:25:05.6946224Z  2025-03-14T06:25:05.6946630Z  2025-03-14T06:25:05.6947013Z  2025-03-14T06:25:05.6947416Z  2025-03-14T06:25:05.6947862Z  2025-03-14T06:25:05.6948239Z  2025-03-14T06:25:05.6949167Z [11,155 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:05.6950335Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T06:25:05.6951318Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T06:25:05.6952516Z Compiling src/cpu/ref_eltwise.cpp; 7s local 2025-03-14T06:25:05.6953510Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 7s local 2025-03-14T06:25:05.6954361Z @onednn//:mkl_dnn; 5s local 2025-03-14T06:25:05.6955059Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2025-03-14T06:25:05.6955872Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:25:05.6956510Z Compiling src/cpu/ref_lrn.cpp; 5s local ... 2025-03-14T06:25:05.9131157Z 2025-03-14T06:25:05.9132019Z  2025-03-14T06:25:05.9132482Z  2025-03-14T06:25:05.9132894Z  2025-03-14T06:25:05.9133323Z  2025-03-14T06:25:05.9133714Z  2025-03-14T06:25:05.9134096Z  2025-03-14T06:25:05.9134504Z  2025-03-14T06:25:05.9134909Z  2025-03-14T06:25:05.9135868Z [11,159 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:05.9136927Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T06:25:05.9137929Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T06:25:05.9139095Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 7s local 2025-03-14T06:25:05.9139982Z @onednn//:mkl_dnn; 6s local 2025-03-14T06:25:05.9140674Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 5s local 2025-03-14T06:25:05.9141478Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:25:05.9142111Z Compiling src/cpu/ref_lrn.cpp; 5s local 2025-03-14T06:25:05.9142821Z Compiling src/cpu/ref_pooling.cpp; 5s local ... 2025-03-14T06:25:06.1496685Z 2025-03-14T06:25:06.1497564Z  2025-03-14T06:25:06.1498044Z  2025-03-14T06:25:06.1498469Z  2025-03-14T06:25:06.1498875Z  2025-03-14T06:25:06.1499280Z  2025-03-14T06:25:06.1499681Z  2025-03-14T06:25:06.1500092Z  2025-03-14T06:25:06.1500490Z  2025-03-14T06:25:06.1501473Z [11,159 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:06.1502550Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T06:25:06.1503598Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 25s local 2025-03-14T06:25:06.1504802Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 7s local 2025-03-14T06:25:06.1505952Z @onednn//:mkl_dnn; 6s local 2025-03-14T06:25:06.1506669Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 6s local 2025-03-14T06:25:06.1507480Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:25:06.1508132Z Compiling src/cpu/ref_lrn.cpp; 5s local 2025-03-14T06:25:06.1508969Z Compiling src/cpu/ref_pooling.cpp; 5s local ... 2025-03-14T06:25:06.5502934Z 2025-03-14T06:25:06.5503726Z  2025-03-14T06:25:06.5504313Z  2025-03-14T06:25:06.5504773Z  2025-03-14T06:25:06.5505163Z  2025-03-14T06:25:06.5505812Z  2025-03-14T06:25:06.5506238Z  2025-03-14T06:25:06.5506618Z  2025-03-14T06:25:06.5507005Z  2025-03-14T06:25:06.5507942Z [11,163 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:06.5508980Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T06:25:06.5509968Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T06:25:06.5511120Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 8s local 2025-03-14T06:25:06.5511974Z @onednn//:mkl_dnn; 6s local 2025-03-14T06:25:06.5512666Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 6s local 2025-03-14T06:25:06.5513471Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:25:06.5514091Z Compiling src/cpu/ref_lrn.cpp; 6s local 2025-03-14T06:25:06.5514792Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:25:06.7507184Z 2025-03-14T06:25:06.7507995Z  2025-03-14T06:25:06.7508509Z  2025-03-14T06:25:06.7508931Z  2025-03-14T06:25:06.7509339Z  2025-03-14T06:25:06.7509757Z  2025-03-14T06:25:06.7510446Z  2025-03-14T06:25:06.7510862Z  2025-03-14T06:25:06.7511259Z  2025-03-14T06:25:06.7512215Z [11,165 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:06.7513280Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T06:25:06.7514310Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T06:25:06.7515520Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 8s local 2025-03-14T06:25:06.7516403Z @onednn//:mkl_dnn; 6s local 2025-03-14T06:25:06.7517147Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 6s local 2025-03-14T06:25:06.7517927Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:25:06.7519281Z Compiling src/cpu/ref_lrn.cpp; 6s local 2025-03-14T06:25:06.7520030Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:25:06.9813058Z 2025-03-14T06:25:06.9813916Z  2025-03-14T06:25:06.9814530Z  2025-03-14T06:25:06.9815001Z  2025-03-14T06:25:06.9815435Z  2025-03-14T06:25:06.9815817Z  2025-03-14T06:25:06.9816235Z  2025-03-14T06:25:06.9816661Z  2025-03-14T06:25:06.9817080Z  2025-03-14T06:25:06.9818749Z [11,168 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:06.9819830Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T06:25:06.9820865Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 26s local 2025-03-14T06:25:06.9822024Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 8s local 2025-03-14T06:25:06.9822819Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:06.9823541Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 6s local 2025-03-14T06:25:06.9824309Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:25:06.9824952Z Compiling src/cpu/ref_lrn.cpp; 6s local 2025-03-14T06:25:06.9825694Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:25:07.3513221Z 2025-03-14T06:25:07.3514104Z  2025-03-14T06:25:07.3514655Z  2025-03-14T06:25:07.3515101Z  2025-03-14T06:25:07.3515509Z  2025-03-14T06:25:07.3515909Z  2025-03-14T06:25:07.3516403Z  2025-03-14T06:25:07.3516854Z  2025-03-14T06:25:07.3517512Z  2025-03-14T06:25:07.3519157Z [11,169 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:07.3520128Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T06:25:07.3521116Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T06:25:07.3522468Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 8s local 2025-03-14T06:25:07.3523263Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:07.3524080Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 7s local 2025-03-14T06:25:07.3525048Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:25:07.3525681Z Compiling src/cpu/ref_lrn.cpp; 6s local 2025-03-14T06:25:07.3526384Z Compiling src/cpu/ref_pooling.cpp; 6s local ... 2025-03-14T06:25:07.6336341Z 2025-03-14T06:25:07.6337172Z  2025-03-14T06:25:07.6337663Z  2025-03-14T06:25:07.6338073Z  2025-03-14T06:25:07.6338479Z  2025-03-14T06:25:07.6338921Z  2025-03-14T06:25:07.6339340Z  2025-03-14T06:25:07.6339757Z  2025-03-14T06:25:07.6340181Z  2025-03-14T06:25:07.6341138Z [11,171 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:07.6342240Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T06:25:07.6343312Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T06:25:07.6344572Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 9s local 2025-03-14T06:25:07.6345576Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:07.6346293Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 7s local 2025-03-14T06:25:07.6347368Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:25:07.6348021Z Compiling src/cpu/ref_lrn.cpp; 7s local 2025-03-14T06:25:07.6348755Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2025-03-14T06:25:07.8336921Z 2025-03-14T06:25:07.8337751Z  2025-03-14T06:25:07.8338296Z  2025-03-14T06:25:07.8338728Z  2025-03-14T06:25:07.8339155Z  2025-03-14T06:25:07.8339590Z  2025-03-14T06:25:07.8340024Z  2025-03-14T06:25:07.8340461Z  2025-03-14T06:25:07.8340899Z  2025-03-14T06:25:07.8341889Z [11,174 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:07.8343004Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T06:25:07.8344098Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T06:25:07.8345342Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 9s local 2025-03-14T06:25:07.8346277Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:07.8347030Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 7s local 2025-03-14T06:25:07.8347873Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:25:07.8348535Z Compiling src/cpu/ref_lrn.cpp; 7s local 2025-03-14T06:25:07.8349322Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2025-03-14T06:25:08.1520994Z 2025-03-14T06:25:08.1521840Z  2025-03-14T06:25:08.1522348Z  2025-03-14T06:25:08.1522793Z  2025-03-14T06:25:08.1523232Z  2025-03-14T06:25:08.1523664Z  2025-03-14T06:25:08.1524095Z  2025-03-14T06:25:08.1524617Z  2025-03-14T06:25:08.1525061Z  2025-03-14T06:25:08.1526083Z [11,175 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:08.1527229Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T06:25:08.1528337Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 27s local 2025-03-14T06:25:08.1529621Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 9s local 2025-03-14T06:25:08.1530567Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:08.1531350Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local 2025-03-14T06:25:08.1532210Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:25:08.1533135Z Compiling src/cpu/ref_lrn.cpp; 7s local 2025-03-14T06:25:08.1533882Z Compiling src/cpu/ref_pooling.cpp; 7s local ... 2025-03-14T06:25:08.3816340Z 2025-03-14T06:25:08.3817124Z  2025-03-14T06:25:08.3817641Z  2025-03-14T06:25:08.3818085Z  2025-03-14T06:25:08.3819428Z  2025-03-14T06:25:08.3819870Z  2025-03-14T06:25:08.3820317Z  2025-03-14T06:25:08.3820765Z  2025-03-14T06:25:08.3821208Z  2025-03-14T06:25:08.3822333Z [11,176 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:08.3823478Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T06:25:08.3824614Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T06:25:08.3825892Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 10s local 2025-03-14T06:25:08.3826843Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:08.3827626Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local 2025-03-14T06:25:08.3828490Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:08.3829174Z Compiling src/cpu/ref_lrn.cpp; 7s local 2025-03-14T06:25:08.3829846Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:25:08.7527679Z 2025-03-14T06:25:08.7528558Z  2025-03-14T06:25:08.7529076Z  2025-03-14T06:25:08.7529516Z  2025-03-14T06:25:08.7529973Z  2025-03-14T06:25:08.7530419Z  2025-03-14T06:25:08.7530869Z  2025-03-14T06:25:08.7531310Z  2025-03-14T06:25:08.7531767Z  2025-03-14T06:25:08.7532785Z [11,181 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:08.7534330Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T06:25:08.7535415Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T06:25:08.7536659Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 10s local 2025-03-14T06:25:08.7537580Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:08.7538341Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local 2025-03-14T06:25:08.7539175Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:08.7539795Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:08.7540469Z Compiling src/cpu/ref_reduction.cpp; 6s local ... 2025-03-14T06:25:08.9565036Z 2025-03-14T06:25:08.9566142Z  2025-03-14T06:25:08.9566688Z  2025-03-14T06:25:08.9567036Z  2025-03-14T06:25:08.9567390Z  2025-03-14T06:25:08.9567733Z  2025-03-14T06:25:08.9568206Z  2025-03-14T06:25:08.9568658Z  2025-03-14T06:25:08.9569098Z  2025-03-14T06:25:08.9570210Z [11,187 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:08.9571449Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T06:25:08.9572649Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 28s local 2025-03-14T06:25:08.9573754Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 10s local 2025-03-14T06:25:08.9574492Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:08.9575195Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 8s local 2025-03-14T06:25:08.9576036Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:08.9576653Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:08.9577222Z Compiling src/cpu/ref_reduction.cpp; 7s local ... 2025-03-14T06:25:09.2689500Z 2025-03-14T06:25:09.2690389Z  2025-03-14T06:25:09.2690946Z  2025-03-14T06:25:09.2691381Z  2025-03-14T06:25:09.2691787Z  2025-03-14T06:25:09.2692210Z  2025-03-14T06:25:09.2692631Z  2025-03-14T06:25:09.2693039Z  2025-03-14T06:25:09.2693444Z  2025-03-14T06:25:09.2694400Z [11,190 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:09.2695452Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T06:25:09.2696771Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:25:09.2697948Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 10s local 2025-03-14T06:25:09.2698827Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:09.2699737Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local 2025-03-14T06:25:09.2700535Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:09.2701125Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:09.2701654Z @onednn//:mkl_dnn; 6s local ... 2025-03-14T06:25:09.5349124Z 2025-03-14T06:25:09.5350020Z  2025-03-14T06:25:09.5350531Z  2025-03-14T06:25:09.5350957Z  2025-03-14T06:25:09.5351369Z  2025-03-14T06:25:09.5351753Z  2025-03-14T06:25:09.5352167Z  2025-03-14T06:25:09.5352575Z  2025-03-14T06:25:09.5352987Z  2025-03-14T06:25:09.5353892Z [11,192 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:09.5354971Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T06:25:09.5355936Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:25:09.5357112Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 11s local 2025-03-14T06:25:09.5357995Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:09.5358717Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local 2025-03-14T06:25:09.5359520Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:25:09.5360124Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:09.5360664Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:25:09.7536811Z 2025-03-14T06:25:09.7537665Z  2025-03-14T06:25:09.7538476Z  2025-03-14T06:25:09.7538914Z  2025-03-14T06:25:09.7539348Z  2025-03-14T06:25:09.7539785Z  2025-03-14T06:25:09.7540213Z  2025-03-14T06:25:09.7540625Z  2025-03-14T06:25:09.7541052Z  2025-03-14T06:25:09.7542026Z [11,194 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:09.7543114Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T06:25:09.7544179Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:25:09.7545386Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 11s local 2025-03-14T06:25:09.7546287Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:09.7547025Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local 2025-03-14T06:25:09.7547823Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:09.7548364Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:09.7549169Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local ... 2025-03-14T06:25:10.0053151Z 2025-03-14T06:25:10.0054010Z  2025-03-14T06:25:10.0054543Z  2025-03-14T06:25:10.0054934Z  2025-03-14T06:25:10.0055321Z  2025-03-14T06:25:10.0055701Z  2025-03-14T06:25:10.0056081Z  2025-03-14T06:25:10.0056541Z  2025-03-14T06:25:10.0056963Z  2025-03-14T06:25:10.0057902Z [11,198 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:10.0058940Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T06:25:10.0059961Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 29s local 2025-03-14T06:25:10.0061109Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 11s local 2025-03-14T06:25:10.0061965Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:10.0062699Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 9s local 2025-03-14T06:25:10.0063476Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:10.0064007Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:10.0064727Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local ... 2025-03-14T06:25:10.3191032Z 2025-03-14T06:25:10.3191893Z  2025-03-14T06:25:10.3192290Z  2025-03-14T06:25:10.3192625Z  2025-03-14T06:25:10.3193353Z  2025-03-14T06:25:10.3193671Z  2025-03-14T06:25:10.3193984Z  2025-03-14T06:25:10.3194310Z  2025-03-14T06:25:10.3194646Z  2025-03-14T06:25:10.3195517Z [11,202 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:10.3196543Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T06:25:10.3197368Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T06:25:10.3198560Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 11s local 2025-03-14T06:25:10.3199487Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:10.3200268Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2025-03-14T06:25:10.3201088Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:10.3201647Z @onednn//:mkl_dnn; 7s local 2025-03-14T06:25:10.3202344Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 7s local ... 2025-03-14T06:25:10.5546465Z 2025-03-14T06:25:10.5547367Z  2025-03-14T06:25:10.5547869Z  2025-03-14T06:25:10.5548321Z  2025-03-14T06:25:10.5548749Z  2025-03-14T06:25:10.5549184Z  2025-03-14T06:25:10.5549610Z  2025-03-14T06:25:10.5550034Z  2025-03-14T06:25:10.5550579Z  2025-03-14T06:25:10.5551518Z [11,205 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:10.5552526Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T06:25:10.5553499Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T06:25:10.5554760Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 12s local 2025-03-14T06:25:10.5555600Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:10.5556287Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2025-03-14T06:25:10.5557018Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:10.5557558Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:10.5558290Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local ... 2025-03-14T06:25:10.8976634Z 2025-03-14T06:25:10.8977505Z  2025-03-14T06:25:10.8978038Z  2025-03-14T06:25:10.8978453Z  2025-03-14T06:25:10.8978864Z  2025-03-14T06:25:10.8979323Z  2025-03-14T06:25:10.8979753Z  2025-03-14T06:25:10.8980182Z  2025-03-14T06:25:10.8980586Z  2025-03-14T06:25:10.8981631Z [11,209 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:10.8982658Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T06:25:10.8983673Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T06:25:10.8984811Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 12s local 2025-03-14T06:25:10.8985604Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:10.8986290Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 10s local 2025-03-14T06:25:10.8987061Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:10.8987591Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:10.8988342Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local ... 2025-03-14T06:25:11.1553125Z 2025-03-14T06:25:11.1553943Z  2025-03-14T06:25:11.1554456Z  2025-03-14T06:25:11.1554860Z  2025-03-14T06:25:11.1555281Z  2025-03-14T06:25:11.1555688Z  2025-03-14T06:25:11.1556115Z  2025-03-14T06:25:11.1556533Z  2025-03-14T06:25:11.1556943Z  2025-03-14T06:25:11.1557904Z [11,215 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:11.1559007Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T06:25:11.1560022Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 30s local 2025-03-14T06:25:11.1561303Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 12s local 2025-03-14T06:25:11.1562123Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:11.1563076Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:25:11.1563850Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:11.1564385Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:11.1565500Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local ... 2025-03-14T06:25:11.3557431Z 2025-03-14T06:25:11.3558296Z  2025-03-14T06:25:11.3558817Z  2025-03-14T06:25:11.3559250Z  2025-03-14T06:25:11.3559688Z  2025-03-14T06:25:11.3560214Z  2025-03-14T06:25:11.3560868Z  2025-03-14T06:25:11.3561266Z  2025-03-14T06:25:11.3561688Z  2025-03-14T06:25:11.3562619Z [11,216 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:11.3563668Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T06:25:11.3564793Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:25:11.3566239Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 12s local 2025-03-14T06:25:11.3567190Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:11.3568057Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:25:11.3568976Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:11.3569504Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:25:11.3570372Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 8s local ... 2025-03-14T06:25:11.6025308Z 2025-03-14T06:25:11.6026184Z  2025-03-14T06:25:11.6026712Z  2025-03-14T06:25:11.6027167Z  2025-03-14T06:25:11.6027563Z  2025-03-14T06:25:11.6027968Z  2025-03-14T06:25:11.6028377Z  2025-03-14T06:25:11.6029017Z  2025-03-14T06:25:11.6029442Z  2025-03-14T06:25:11.6030374Z [11,218 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:11.6031401Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T06:25:11.6032429Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:25:11.6033505Z Compiling src/cpu/x64/gemm/f32/jit_avx2_kernel_sgemm_kern.cpp; 13s local 2025-03-14T06:25:11.6034485Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:11.6035193Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:25:11.6035985Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:11.6036538Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:11.6037326Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local ... 2025-03-14T06:25:11.9044802Z 2025-03-14T06:25:11.9045647Z  2025-03-14T06:25:11.9046172Z  2025-03-14T06:25:11.9046629Z  2025-03-14T06:25:11.9047112Z  2025-03-14T06:25:11.9047571Z  2025-03-14T06:25:11.9048003Z  2025-03-14T06:25:11.9048447Z  2025-03-14T06:25:11.9048901Z  2025-03-14T06:25:11.9049905Z [11,222 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:11.9051088Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T06:25:11.9052108Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:25:11.9053028Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:11.9053796Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 11s local 2025-03-14T06:25:11.9054586Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:11.9055157Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:11.9055916Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T06:25:11.9056949Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 8s local ... 2025-03-14T06:25:12.1565954Z 2025-03-14T06:25:12.1566798Z  2025-03-14T06:25:12.1567300Z  2025-03-14T06:25:12.1567733Z  2025-03-14T06:25:12.1568160Z  2025-03-14T06:25:12.1568589Z  2025-03-14T06:25:12.1569021Z  2025-03-14T06:25:12.1569422Z  2025-03-14T06:25:12.1569903Z  2025-03-14T06:25:12.1571193Z [11,223 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:12.1572224Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T06:25:12.1573269Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 31s local 2025-03-14T06:25:12.1574369Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:12.1575123Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2025-03-14T06:25:12.1575940Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:12.1576611Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:25:12.1577369Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T06:25:12.1578452Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local ... 2025-03-14T06:25:12.5269868Z 2025-03-14T06:25:12.5270867Z  2025-03-14T06:25:12.5271417Z  2025-03-14T06:25:12.5271859Z  2025-03-14T06:25:12.5272256Z  2025-03-14T06:25:12.5272657Z  2025-03-14T06:25:12.5273085Z  2025-03-14T06:25:12.5273523Z  2025-03-14T06:25:12.5273998Z  2025-03-14T06:25:12.5274900Z [11,230 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:12.5275874Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T06:25:12.5276890Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T06:25:12.5277946Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2025-03-14T06:25:12.5278784Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:12.5279328Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:12.5280379Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 9s local 2025-03-14T06:25:12.5281421Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2025-03-14T06:25:12.5282400Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2025-03-14T06:25:12.7352631Z 2025-03-14T06:25:12.7353591Z  2025-03-14T06:25:12.7354141Z  2025-03-14T06:25:12.7354548Z  2025-03-14T06:25:12.7354949Z  2025-03-14T06:25:12.7355335Z  2025-03-14T06:25:12.7355737Z  2025-03-14T06:25:12.7356120Z  2025-03-14T06:25:12.7356533Z  2025-03-14T06:25:12.7357527Z [11,235 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:12.7358625Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T06:25:12.7359598Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T06:25:12.7360680Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2025-03-14T06:25:12.7361460Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:12.7361988Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:12.7362720Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T06:25:12.7363668Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2025-03-14T06:25:12.7364804Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2025-03-14T06:25:12.9573796Z 2025-03-14T06:25:12.9574673Z  2025-03-14T06:25:12.9575193Z  2025-03-14T06:25:12.9575633Z  2025-03-14T06:25:12.9576022Z  2025-03-14T06:25:12.9576436Z  2025-03-14T06:25:12.9576897Z  2025-03-14T06:25:12.9577303Z  2025-03-14T06:25:12.9577675Z  2025-03-14T06:25:12.9578635Z [11,239 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:12.9579708Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T06:25:12.9580669Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T06:25:12.9581695Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 12s local 2025-03-14T06:25:12.9582442Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:12.9582972Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:12.9583659Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T06:25:12.9584895Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 9s local 2025-03-14T06:25:12.9585884Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 9s local ... 2025-03-14T06:25:13.1753723Z 2025-03-14T06:25:13.1754579Z  2025-03-14T06:25:13.1755367Z  2025-03-14T06:25:13.1755781Z  2025-03-14T06:25:13.1756208Z  2025-03-14T06:25:13.1756625Z  2025-03-14T06:25:13.1757047Z  2025-03-14T06:25:13.1757561Z  2025-03-14T06:25:13.1758076Z  2025-03-14T06:25:13.1759285Z [11,242 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:13.1760376Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T06:25:13.1761374Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 32s local 2025-03-14T06:25:13.1762454Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2025-03-14T06:25:13.1763150Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:13.1763714Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:13.1764604Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 10s local 2025-03-14T06:25:13.1765653Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2025-03-14T06:25:13.1766501Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2025-03-14T06:25:13.5579487Z 2025-03-14T06:25:13.5580337Z  2025-03-14T06:25:13.5580816Z  2025-03-14T06:25:13.5581219Z  2025-03-14T06:25:13.5581608Z  2025-03-14T06:25:13.5582014Z  2025-03-14T06:25:13.5582399Z  2025-03-14T06:25:13.5582793Z  2025-03-14T06:25:13.5583181Z  2025-03-14T06:25:13.5584321Z [11,244 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:13.5585342Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T06:25:13.5586294Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T06:25:13.5587321Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2025-03-14T06:25:13.5588062Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:13.5588587Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:13.5589336Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T06:25:13.5590306Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2025-03-14T06:25:13.5591301Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2025-03-14T06:25:13.7580972Z 2025-03-14T06:25:13.7582151Z  2025-03-14T06:25:13.7582664Z  2025-03-14T06:25:13.7583087Z  2025-03-14T06:25:13.7583517Z  2025-03-14T06:25:13.7583963Z  2025-03-14T06:25:13.7584415Z  2025-03-14T06:25:13.7584860Z  2025-03-14T06:25:13.7585289Z  2025-03-14T06:25:13.7586240Z [11,249 / 20,650] 3 / 17 tests; 47 actions running; last test: ...nv_hash_test 2025-03-14T06:25:13.7587245Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T06:25:13.7588316Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T06:25:13.7589477Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 13s local 2025-03-14T06:25:13.7590244Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:13.7590777Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:13.7591564Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T06:25:13.7592609Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 10s local 2025-03-14T06:25:13.7593716Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 10s local ... 2025-03-14T06:25:14.1587542Z 2025-03-14T06:25:14.1588412Z  2025-03-14T06:25:14.1588882Z  2025-03-14T06:25:14.1589293Z  2025-03-14T06:25:14.1589716Z  2025-03-14T06:25:14.1590135Z  2025-03-14T06:25:14.1590554Z  2025-03-14T06:25:14.1590969Z  2025-03-14T06:25:14.1591392Z  2025-03-14T06:25:14.1592336Z [11,250 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:14.1593521Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T06:25:14.1594446Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 33s local 2025-03-14T06:25:14.1595585Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2025-03-14T06:25:14.1596316Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:14.1596825Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:14.1597650Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T06:25:14.1598591Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T06:25:14.1599536Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local ... 2025-03-14T06:25:14.3940602Z 2025-03-14T06:25:14.3941484Z  2025-03-14T06:25:14.3942002Z  2025-03-14T06:25:14.3942410Z  2025-03-14T06:25:14.3942812Z  2025-03-14T06:25:14.3943217Z  2025-03-14T06:25:14.3943657Z  2025-03-14T06:25:14.3944058Z  2025-03-14T06:25:14.3944488Z  2025-03-14T06:25:14.3945428Z [11,251 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:14.3946511Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T06:25:14.3947539Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T06:25:14.3948661Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2025-03-14T06:25:14.3949445Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:14.3950002Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:14.3951075Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 11s local 2025-03-14T06:25:14.3952155Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T06:25:14.3953167Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local ... 2025-03-14T06:25:14.6326874Z 2025-03-14T06:25:14.6327693Z  2025-03-14T06:25:14.6328222Z  2025-03-14T06:25:14.6328651Z  2025-03-14T06:25:14.6329041Z  2025-03-14T06:25:14.6329406Z  2025-03-14T06:25:14.6329794Z  2025-03-14T06:25:14.6330186Z  2025-03-14T06:25:14.6330580Z  2025-03-14T06:25:14.6331575Z [11,255 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:14.6332617Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T06:25:14.6333678Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T06:25:14.6334723Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2025-03-14T06:25:14.6335457Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:14.6335985Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:14.6336776Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:14.6337760Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T06:25:14.6338846Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local ... 2025-03-14T06:25:14.8918966Z 2025-03-14T06:25:14.8919817Z  2025-03-14T06:25:14.8920337Z  2025-03-14T06:25:14.8920758Z  2025-03-14T06:25:14.8921157Z  2025-03-14T06:25:14.8921605Z  2025-03-14T06:25:14.8922032Z  2025-03-14T06:25:14.8922405Z  2025-03-14T06:25:14.8922821Z  2025-03-14T06:25:14.8923807Z [11,258 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:14.8925226Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T06:25:14.8926131Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T06:25:14.8927051Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 14s local 2025-03-14T06:25:14.8927739Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:14.8928233Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:14.8929025Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:14.8930394Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 11s local 2025-03-14T06:25:14.8931495Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 11s local ... 2025-03-14T06:25:15.0969909Z 2025-03-14T06:25:15.0971051Z  2025-03-14T06:25:15.0971559Z  2025-03-14T06:25:15.0971989Z  2025-03-14T06:25:15.0972423Z  2025-03-14T06:25:15.0972853Z  2025-03-14T06:25:15.0973281Z  2025-03-14T06:25:15.0973698Z  2025-03-14T06:25:15.0974397Z  2025-03-14T06:25:15.0975322Z [11,259 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:15.0976318Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T06:25:15.0977383Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 34s local 2025-03-14T06:25:15.0978426Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2025-03-14T06:25:15.0979263Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:15.0980045Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:15.0981083Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T06:25:15.0982084Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2025-03-14T06:25:15.0983004Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local ... 2025-03-14T06:25:15.3597722Z 2025-03-14T06:25:15.3598543Z  2025-03-14T06:25:15.3599005Z  2025-03-14T06:25:15.3599393Z  2025-03-14T06:25:15.3599811Z  2025-03-14T06:25:15.3600178Z  2025-03-14T06:25:15.3600548Z  2025-03-14T06:25:15.3600914Z  2025-03-14T06:25:15.3601508Z  2025-03-14T06:25:15.3602431Z [11,262 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:15.3603417Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T06:25:15.3604381Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T06:25:15.3605591Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2025-03-14T06:25:15.3606574Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 12s local 2025-03-14T06:25:15.3607495Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T06:25:15.3608490Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2025-03-14T06:25:15.3609384Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2025-03-14T06:25:15.3610157Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local ... 2025-03-14T06:25:15.5601669Z 2025-03-14T06:25:15.5602533Z  2025-03-14T06:25:15.5602993Z  2025-03-14T06:25:15.5603412Z  2025-03-14T06:25:15.5603773Z  2025-03-14T06:25:15.5604151Z  2025-03-14T06:25:15.5604640Z  2025-03-14T06:25:15.5605171Z  2025-03-14T06:25:15.5605539Z  2025-03-14T06:25:15.5606502Z [11,265 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:15.5607755Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T06:25:15.5608909Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T06:25:15.5610057Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2025-03-14T06:25:15.5611138Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T06:25:15.5612765Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T06:25:15.5614011Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2025-03-14T06:25:15.5614976Z Compiling src/cpu/rnn/ref_rnn.cpp; 9s local 2025-03-14T06:25:15.5615950Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local ... 2025-03-14T06:25:15.7693264Z 2025-03-14T06:25:15.7694152Z  2025-03-14T06:25:15.7694669Z  2025-03-14T06:25:15.7695200Z  2025-03-14T06:25:15.7695633Z  2025-03-14T06:25:15.7696039Z  2025-03-14T06:25:15.7696732Z  2025-03-14T06:25:15.7697133Z  2025-03-14T06:25:15.7697539Z  2025-03-14T06:25:15.7698477Z [11,270 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:15.7699520Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T06:25:15.7700730Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T06:25:15.7701787Z Compiling src/cpu/cpu_batch_normalization_list.cpp; 15s local 2025-03-14T06:25:15.7702966Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T06:25:15.7704005Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 12s local 2025-03-14T06:25:15.7704982Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 12s local 2025-03-14T06:25:15.7705828Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2025-03-14T06:25:15.7706681Z Compiling src/cpu/reorder/cpu_reorder_regular_fp8.cpp; 8s local ... 2025-03-14T06:25:16.1083099Z 2025-03-14T06:25:16.1084356Z  2025-03-14T06:25:16.1085029Z  2025-03-14T06:25:16.1085471Z  2025-03-14T06:25:16.1085871Z  2025-03-14T06:25:16.1086243Z  2025-03-14T06:25:16.1086649Z  2025-03-14T06:25:16.1087014Z  2025-03-14T06:25:16.1087521Z  2025-03-14T06:25:16.1088447Z [11,277 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:16.1089343Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T06:25:16.1090448Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 35s local 2025-03-14T06:25:16.1091822Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T06:25:16.1092845Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:25:16.1093885Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T06:25:16.1094716Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2025-03-14T06:25:16.1095452Z Compiling src/cpu/cpu_convolution_list.cpp; 8s local 2025-03-14T06:25:16.1096356Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 6s local ... 2025-03-14T06:25:16.3608783Z 2025-03-14T06:25:16.3610050Z  2025-03-14T06:25:16.3610541Z  2025-03-14T06:25:16.3611003Z  2025-03-14T06:25:16.3621104Z  2025-03-14T06:25:16.3621966Z  2025-03-14T06:25:16.3622366Z  2025-03-14T06:25:16.3622737Z  2025-03-14T06:25:16.3623087Z  2025-03-14T06:25:16.3624062Z [11,278 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:16.3625009Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T06:25:16.3625862Z Compiling mlir/lib/ExecutionEngine/SparseTensorRuntime.cpp; 36s local 2025-03-14T06:25:16.3626961Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 13s local 2025-03-14T06:25:16.3628021Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:25:16.3628971Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T06:25:16.3629886Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2025-03-14T06:25:16.3630698Z Compiling src/cpu/cpu_convolution_list.cpp; 8s local 2025-03-14T06:25:16.3631650Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 7s local ... 2025-03-14T06:25:16.5614596Z 2025-03-14T06:25:16.5615447Z  2025-03-14T06:25:16.5615916Z  2025-03-14T06:25:16.5616263Z  2025-03-14T06:25:16.5616608Z  2025-03-14T06:25:16.5616990Z  2025-03-14T06:25:16.5617317Z  2025-03-14T06:25:16.5617635Z  2025-03-14T06:25:16.5617956Z  2025-03-14T06:25:16.5618755Z [11,280 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:16.5620223Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T06:25:16.5620956Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:16.5622016Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:25:16.5622803Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T06:25:16.5623478Z Compiling src/cpu/rnn/ref_rnn.cpp; 10s local 2025-03-14T06:25:16.5624234Z Compiling src/cpu/cpu_convolution_list.cpp; 8s local 2025-03-14T06:25:16.5625065Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 7s local 2025-03-14T06:25:16.5626005Z Compiling src/cpu/simple_resampling.cpp; 7s local ... 2025-03-14T06:25:16.7726227Z 2025-03-14T06:25:16.7727136Z  2025-03-14T06:25:16.7727598Z  2025-03-14T06:25:16.7728011Z  2025-03-14T06:25:16.7728410Z  2025-03-14T06:25:16.7728808Z  2025-03-14T06:25:16.7729203Z  2025-03-14T06:25:16.7729600Z  2025-03-14T06:25:16.7729978Z  2025-03-14T06:25:16.7730919Z [11,285 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:16.7731964Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T06:25:16.7732803Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:16.7733799Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:25:16.7734801Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T06:25:16.7735703Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2025-03-14T06:25:16.7736564Z Compiling src/cpu/cpu_convolution_list.cpp; 8s local 2025-03-14T06:25:16.7737479Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 7s local 2025-03-14T06:25:16.7738385Z Compiling src/cpu/simple_resampling.cpp; 7s local ... 2025-03-14T06:25:17.0130643Z 2025-03-14T06:25:17.0131796Z  2025-03-14T06:25:17.0133648Z  2025-03-14T06:25:17.0134100Z  2025-03-14T06:25:17.0134550Z  2025-03-14T06:25:17.0134935Z  2025-03-14T06:25:17.0135338Z  2025-03-14T06:25:17.0135724Z  2025-03-14T06:25:17.0136107Z  2025-03-14T06:25:17.0137020Z [11,291 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:17.0138094Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T06:25:17.0139012Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:17.0140001Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 13s local 2025-03-14T06:25:17.0141107Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 13s local 2025-03-14T06:25:17.0141958Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2025-03-14T06:25:17.0142663Z Compiling src/cpu/cpu_convolution_list.cpp; 9s local 2025-03-14T06:25:17.0143547Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 7s local 2025-03-14T06:25:17.0144430Z Compiling src/cpu/simple_resampling.cpp; 7s local ... 2025-03-14T06:25:17.2523342Z 2025-03-14T06:25:17.2524714Z  2025-03-14T06:25:17.2525405Z  2025-03-14T06:25:17.2526057Z  2025-03-14T06:25:17.2527186Z  2025-03-14T06:25:17.2527678Z  2025-03-14T06:25:17.2528139Z  2025-03-14T06:25:17.2528576Z  2025-03-14T06:25:17.2529020Z  2025-03-14T06:25:17.2530048Z [11,293 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:17.2531228Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T06:25:17.2532162Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:17.2533242Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:25:17.2534328Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2025-03-14T06:25:17.2535262Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2025-03-14T06:25:17.2536116Z Compiling src/cpu/cpu_convolution_list.cpp; 9s local 2025-03-14T06:25:17.2537074Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local 2025-03-14T06:25:17.2538080Z Compiling src/cpu/simple_resampling.cpp; 7s local ... 2025-03-14T06:25:17.5059226Z 2025-03-14T06:25:17.5060167Z  2025-03-14T06:25:17.5060622Z  2025-03-14T06:25:17.5060997Z  2025-03-14T06:25:17.5061345Z  2025-03-14T06:25:17.5061725Z  2025-03-14T06:25:17.5062079Z  2025-03-14T06:25:17.5062686Z  2025-03-14T06:25:17.5063044Z  2025-03-14T06:25:17.5063865Z [11,295 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:17.5064862Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T06:25:17.5065947Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 14s local 2025-03-14T06:25:17.5066813Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:25:17.5067779Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2025-03-14T06:25:17.5068490Z Compiling src/cpu/rnn/ref_rnn.cpp; 11s local 2025-03-14T06:25:17.5069142Z Compiling src/cpu/cpu_convolution_list.cpp; 9s local 2025-03-14T06:25:17.5069943Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local 2025-03-14T06:25:17.5070787Z Compiling src/cpu/simple_resampling.cpp; 8s local ... 2025-03-14T06:25:17.7623292Z 2025-03-14T06:25:17.7624126Z  2025-03-14T06:25:17.7624632Z  2025-03-14T06:25:17.7625071Z  2025-03-14T06:25:17.7625467Z  2025-03-14T06:25:17.7625872Z  2025-03-14T06:25:17.7626258Z  2025-03-14T06:25:17.7626647Z  2025-03-14T06:25:17.7627041Z  2025-03-14T06:25:17.7627980Z [11,297 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:17.7629353Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T06:25:17.7630307Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T06:25:17.7631337Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:25:17.7632293Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2025-03-14T06:25:17.7633127Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T06:25:17.7633899Z Compiling src/cpu/cpu_convolution_list.cpp; 9s local 2025-03-14T06:25:17.7634777Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local 2025-03-14T06:25:17.7635666Z Compiling src/cpu/simple_resampling.cpp; 8s local ... 2025-03-14T06:25:17.9784386Z 2025-03-14T06:25:17.9785224Z  2025-03-14T06:25:17.9785693Z  2025-03-14T06:25:17.9786066Z  2025-03-14T06:25:17.9786452Z  2025-03-14T06:25:17.9786852Z  2025-03-14T06:25:17.9787213Z  2025-03-14T06:25:17.9787590Z  2025-03-14T06:25:17.9787981Z  2025-03-14T06:25:17.9788948Z [11,301 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:17.9789970Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T06:25:17.9790898Z Compiling src/cpu/reorder/cpu_reorder_comp_bf16_s8.cpp; 15s local 2025-03-14T06:25:17.9791922Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 14s local 2025-03-14T06:25:17.9792918Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 14s local 2025-03-14T06:25:17.9793743Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T06:25:17.9794558Z Compiling src/cpu/cpu_convolution_list.cpp; 10s local 2025-03-14T06:25:17.9795478Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 8s local 2025-03-14T06:25:17.9796373Z Compiling src/cpu/simple_resampling.cpp; 8s local ... 2025-03-14T06:25:18.2216468Z 2025-03-14T06:25:18.2217339Z  2025-03-14T06:25:18.2217871Z  2025-03-14T06:25:18.2218310Z  2025-03-14T06:25:18.2218727Z  2025-03-14T06:25:18.2219142Z  2025-03-14T06:25:18.2219522Z  2025-03-14T06:25:18.2220628Z  2025-03-14T06:25:18.2221119Z  2025-03-14T06:25:18.2222235Z [11,303 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:18.2223518Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T06:25:18.2224522Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2025-03-14T06:25:18.2225505Z Compiling src/cpu/reorder/cpu_reorder_comp_s8_s8.cpp; 15s local 2025-03-14T06:25:18.2226561Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T06:25:18.2227298Z Compiling src/cpu/cpu_convolution_list.cpp; 10s local 2025-03-14T06:25:18.2228188Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2025-03-14T06:25:18.2229246Z Compiling src/cpu/simple_resampling.cpp; 8s local 2025-03-14T06:25:18.2229982Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:25:18.4206167Z 2025-03-14T06:25:18.4207070Z  2025-03-14T06:25:18.4207540Z  2025-03-14T06:25:18.4207920Z  2025-03-14T06:25:18.4208246Z  2025-03-14T06:25:18.4208623Z  2025-03-14T06:25:18.4209099Z  2025-03-14T06:25:18.4209444Z  2025-03-14T06:25:18.4209843Z  2025-03-14T06:25:18.4210849Z [11,308 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:18.4211907Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T06:25:18.4212844Z Compiling src/cpu/reorder/cpu_reorder_comp_f32_s8.cpp; 15s local 2025-03-14T06:25:18.4213641Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T06:25:18.4214348Z Compiling src/cpu/cpu_convolution_list.cpp; 10s local 2025-03-14T06:25:18.4215213Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2025-03-14T06:25:18.4216043Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T06:25:18.4216689Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:25:18.4217671Z Compiling src/cpu/cpu_deconvolution_list.cpp; 8s local ... 2025-03-14T06:25:18.6572884Z 2025-03-14T06:25:18.6573752Z  2025-03-14T06:25:18.6574265Z  2025-03-14T06:25:18.6574702Z  2025-03-14T06:25:18.6575119Z  2025-03-14T06:25:18.6575546Z  2025-03-14T06:25:18.6575998Z  2025-03-14T06:25:18.6576404Z  2025-03-14T06:25:18.6576817Z  2025-03-14T06:25:18.6577774Z [11,315 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:18.6578842Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T06:25:18.6579658Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T06:25:18.6580447Z Compiling src/cpu/cpu_convolution_list.cpp; 10s local 2025-03-14T06:25:18.6581376Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2025-03-14T06:25:18.6582288Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T06:25:18.6583158Z Compiling src/cpu/cpu_deconvolution_list.cpp; 8s local 2025-03-14T06:25:18.6584052Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 8s local 2025-03-14T06:25:18.6584990Z Compiling src/cpu/rnn/brgemm_cell_common.cpp; 7s local ... 2025-03-14T06:25:18.9680148Z 2025-03-14T06:25:18.9681031Z  2025-03-14T06:25:18.9681551Z  2025-03-14T06:25:18.9681962Z  2025-03-14T06:25:18.9682379Z  2025-03-14T06:25:18.9682782Z  2025-03-14T06:25:18.9683180Z  2025-03-14T06:25:18.9683867Z  2025-03-14T06:25:18.9684386Z  2025-03-14T06:25:18.9685604Z [11,317 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:18.9686782Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T06:25:18.9687682Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T06:25:18.9688660Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2025-03-14T06:25:18.9689595Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 9s local 2025-03-14T06:25:18.9690478Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T06:25:18.9691396Z Compiling src/cpu/cpu_deconvolution_list.cpp; 8s local 2025-03-14T06:25:18.9692378Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 8s local 2025-03-14T06:25:18.9693770Z Compiling src/cpu/rnn/brgemm_cell_common.cpp; 7s local ... 2025-03-14T06:25:19.1684170Z 2025-03-14T06:25:19.1685230Z  2025-03-14T06:25:19.1685812Z  2025-03-14T06:25:19.1686320Z  2025-03-14T06:25:19.1686728Z  2025-03-14T06:25:19.1687412Z  2025-03-14T06:25:19.1687851Z  2025-03-14T06:25:19.1688300Z  2025-03-14T06:25:19.1688690Z  2025-03-14T06:25:19.1689632Z [11,321 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:19.1691011Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T06:25:19.1691816Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T06:25:19.1692589Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2025-03-14T06:25:19.1693482Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 10s local 2025-03-14T06:25:19.1694397Z Compiling src/cpu/simple_resampling.cpp; 9s local 2025-03-14T06:25:19.1695169Z Compiling src/cpu/cpu_deconvolution_list.cpp; 8s local 2025-03-14T06:25:19.1696052Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 8s local 2025-03-14T06:25:19.1696972Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 6s local ... 2025-03-14T06:25:19.3735898Z 2025-03-14T06:25:19.3736775Z  2025-03-14T06:25:19.3737256Z  2025-03-14T06:25:19.3737642Z  2025-03-14T06:25:19.3738036Z  2025-03-14T06:25:19.3738476Z  2025-03-14T06:25:19.3738860Z  2025-03-14T06:25:19.3739253Z  2025-03-14T06:25:19.3739673Z  2025-03-14T06:25:19.3740627Z [11,324 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:19.3741902Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T06:25:19.3742692Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T06:25:19.3743406Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2025-03-14T06:25:19.3744861Z Compiling src/cpu/reorder/cpu_reorder_regular_s8.cpp; 10s local 2025-03-14T06:25:19.3745963Z Compiling src/cpu/simple_resampling.cpp; 10s local 2025-03-14T06:25:19.3746908Z Compiling src/cpu/cpu_deconvolution_list.cpp; 9s local 2025-03-14T06:25:19.3747925Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 9s local 2025-03-14T06:25:19.3749023Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 7s local ... 2025-03-14T06:25:19.7026577Z 2025-03-14T06:25:19.7027455Z  2025-03-14T06:25:19.7027928Z  2025-03-14T06:25:19.7028336Z  2025-03-14T06:25:19.7028720Z  2025-03-14T06:25:19.7029101Z  2025-03-14T06:25:19.7029490Z  2025-03-14T06:25:19.7029889Z  2025-03-14T06:25:19.7030303Z  2025-03-14T06:25:19.7031236Z [11,329 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:19.7032250Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T06:25:19.7033008Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:19.7033775Z Compiling src/cpu/cpu_convolution_list.cpp; 11s local 2025-03-14T06:25:19.7034561Z Compiling src/cpu/simple_resampling.cpp; 10s local 2025-03-14T06:25:19.7035374Z Compiling src/cpu/cpu_deconvolution_list.cpp; 9s local 2025-03-14T06:25:19.7036272Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 9s local 2025-03-14T06:25:19.7037185Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 7s local 2025-03-14T06:25:19.7037950Z @onednn//:mkl_dnn; 6s local ... 2025-03-14T06:25:19.9011369Z 2025-03-14T06:25:19.9012272Z  2025-03-14T06:25:19.9012811Z  2025-03-14T06:25:19.9015179Z  2025-03-14T06:25:19.9018209Z  2025-03-14T06:25:19.9022035Z  2025-03-14T06:25:19.9025033Z  2025-03-14T06:25:19.9028062Z  2025-03-14T06:25:19.9031000Z  2025-03-14T06:25:19.9034460Z [11,332 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:19.9037997Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T06:25:19.9039472Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:19.9040901Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2025-03-14T06:25:19.9041840Z Compiling src/cpu/simple_resampling.cpp; 10s local 2025-03-14T06:25:19.9042915Z Compiling src/cpu/cpu_deconvolution_list.cpp; 9s local 2025-03-14T06:25:19.9043808Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 9s local 2025-03-14T06:25:19.9045076Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 7s local 2025-03-14T06:25:19.9045932Z @onednn//:mkl_dnn; 6s local ... 2025-03-14T06:25:20.1473823Z 2025-03-14T06:25:20.1474636Z  2025-03-14T06:25:20.1475173Z  2025-03-14T06:25:20.1475620Z  2025-03-14T06:25:20.1476060Z  2025-03-14T06:25:20.1476487Z  2025-03-14T06:25:20.1476929Z  2025-03-14T06:25:20.1477378Z  2025-03-14T06:25:20.1477808Z  2025-03-14T06:25:20.1478818Z [11,336 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:20.1479964Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T06:25:20.1480814Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:20.1481643Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2025-03-14T06:25:20.1482555Z Compiling src/cpu/simple_resampling.cpp; 10s local 2025-03-14T06:25:20.1483457Z Compiling src/cpu/cpu_deconvolution_list.cpp; 9s local 2025-03-14T06:25:20.1484573Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 9s local 2025-03-14T06:25:20.1485599Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 7s local 2025-03-14T06:25:20.1486678Z @onednn//:mkl_dnn; 6s local ... 2025-03-14T06:25:20.3537223Z 2025-03-14T06:25:20.3538098Z  2025-03-14T06:25:20.3538596Z  2025-03-14T06:25:20.3539034Z  2025-03-14T06:25:20.3539476Z  2025-03-14T06:25:20.3539865Z  2025-03-14T06:25:20.3540311Z  2025-03-14T06:25:20.3540744Z  2025-03-14T06:25:20.3541213Z  2025-03-14T06:25:20.3542229Z [11,339 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:20.3543347Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T06:25:20.3544180Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:20.3544995Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2025-03-14T06:25:20.3545863Z Compiling src/cpu/simple_resampling.cpp; 11s local 2025-03-14T06:25:20.3546778Z Compiling src/cpu/cpu_deconvolution_list.cpp; 10s local 2025-03-14T06:25:20.3547737Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 10s local 2025-03-14T06:25:20.3548691Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2025-03-14T06:25:20.3549480Z @onednn//:mkl_dnn; 6s local ... 2025-03-14T06:25:20.5657872Z 2025-03-14T06:25:20.5658741Z  2025-03-14T06:25:20.5659327Z  2025-03-14T06:25:20.5659837Z  2025-03-14T06:25:20.5660381Z  2025-03-14T06:25:20.5660881Z  2025-03-14T06:25:20.5661374Z  2025-03-14T06:25:20.5661800Z  2025-03-14T06:25:20.5662270Z  2025-03-14T06:25:20.5663521Z [11,343 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:20.5664553Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T06:25:20.5668244Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:20.5669143Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2025-03-14T06:25:20.5669998Z Compiling src/cpu/simple_resampling.cpp; 11s local 2025-03-14T06:25:20.5670804Z Compiling src/cpu/cpu_deconvolution_list.cpp; 10s local 2025-03-14T06:25:20.5671706Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 10s local 2025-03-14T06:25:20.5672669Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2025-03-14T06:25:20.5673398Z @onednn//:mkl_dnn; 6s local ... 2025-03-14T06:25:20.7696158Z 2025-03-14T06:25:20.7697367Z  2025-03-14T06:25:20.7697863Z  2025-03-14T06:25:20.7698270Z  2025-03-14T06:25:20.7698660Z  2025-03-14T06:25:20.7699048Z  2025-03-14T06:25:20.7699440Z  2025-03-14T06:25:20.7699851Z  2025-03-14T06:25:20.7700260Z  2025-03-14T06:25:20.7701421Z [11,345 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:20.7702451Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T06:25:20.7703389Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:20.7704185Z Compiling src/cpu/cpu_convolution_list.cpp; 12s local 2025-03-14T06:25:20.7705012Z Compiling src/cpu/simple_resampling.cpp; 11s local 2025-03-14T06:25:20.7705830Z Compiling src/cpu/cpu_deconvolution_list.cpp; 10s local 2025-03-14T06:25:20.7706681Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 10s local 2025-03-14T06:25:20.7707585Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2025-03-14T06:25:20.7708477Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:25:21.1700606Z 2025-03-14T06:25:21.1701476Z  2025-03-14T06:25:21.1701977Z  2025-03-14T06:25:21.1702413Z  2025-03-14T06:25:21.1702853Z  2025-03-14T06:25:21.1703287Z  2025-03-14T06:25:21.1703734Z  2025-03-14T06:25:21.1704176Z  2025-03-14T06:25:21.1704610Z  2025-03-14T06:25:21.1705588Z [11,348 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:21.1706677Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T06:25:21.1707476Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:21.1708567Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2025-03-14T06:25:21.1709429Z Compiling src/cpu/simple_resampling.cpp; 11s local 2025-03-14T06:25:21.1710288Z Compiling src/cpu/cpu_deconvolution_list.cpp; 10s local 2025-03-14T06:25:21.1711218Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 10s local 2025-03-14T06:25:21.1712183Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2025-03-14T06:25:21.1712949Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:25:21.3775905Z 2025-03-14T06:25:21.3776747Z  2025-03-14T06:25:21.3777372Z  2025-03-14T06:25:21.3777873Z  2025-03-14T06:25:21.3778333Z  2025-03-14T06:25:21.3778798Z  2025-03-14T06:25:21.3779260Z  2025-03-14T06:25:21.3779699Z  2025-03-14T06:25:21.3780158Z  2025-03-14T06:25:21.3781188Z [11,350 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:21.3782732Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T06:25:21.3783711Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:21.3784660Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2025-03-14T06:25:21.3785652Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T06:25:21.3786650Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local 2025-03-14T06:25:21.3787743Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local 2025-03-14T06:25:21.3788825Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2025-03-14T06:25:21.3789745Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:25:21.5780389Z 2025-03-14T06:25:21.5781265Z  2025-03-14T06:25:21.5781794Z  2025-03-14T06:25:21.5782241Z  2025-03-14T06:25:21.5782646Z  2025-03-14T06:25:21.5783049Z  2025-03-14T06:25:21.5783522Z  2025-03-14T06:25:21.5783956Z  2025-03-14T06:25:21.5784376Z  2025-03-14T06:25:21.5785362Z [11,351 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:21.5786475Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T06:25:21.5787282Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:21.5788077Z Compiling src/cpu/cpu_convolution_list.cpp; 13s local 2025-03-14T06:25:21.5789686Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T06:25:21.5790682Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local 2025-03-14T06:25:21.5791793Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local 2025-03-14T06:25:21.5793084Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2025-03-14T06:25:21.5793977Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:25:21.8754304Z 2025-03-14T06:25:21.8755168Z  2025-03-14T06:25:21.8755661Z  2025-03-14T06:25:21.8756322Z  2025-03-14T06:25:21.8756723Z  2025-03-14T06:25:21.8757132Z  2025-03-14T06:25:21.8757539Z  2025-03-14T06:25:21.8757942Z  2025-03-14T06:25:21.8758357Z  2025-03-14T06:25:21.8759334Z [11,353 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:21.8760374Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T06:25:21.8761106Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T06:25:21.8761895Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:25:21.8762725Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T06:25:21.8763568Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local 2025-03-14T06:25:21.8765210Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local 2025-03-14T06:25:21.8766510Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2025-03-14T06:25:21.8767386Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:25:22.1457392Z 2025-03-14T06:25:22.1458252Z  2025-03-14T06:25:22.1458750Z  2025-03-14T06:25:22.1459140Z  2025-03-14T06:25:22.1459755Z  2025-03-14T06:25:22.1460155Z  2025-03-14T06:25:22.1460537Z  2025-03-14T06:25:22.1460899Z  2025-03-14T06:25:22.1461277Z  2025-03-14T06:25:22.1462145Z [11,354 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:22.1463091Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T06:25:22.1463788Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T06:25:22.1464483Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:25:22.1465235Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T06:25:22.1466205Z Compiling src/cpu/cpu_deconvolution_list.cpp; 11s local 2025-03-14T06:25:22.1467013Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local 2025-03-14T06:25:22.1467830Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2025-03-14T06:25:22.1468511Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:25:22.3498581Z 2025-03-14T06:25:22.3499530Z  2025-03-14T06:25:22.3500026Z  2025-03-14T06:25:22.3500456Z  2025-03-14T06:25:22.3500877Z  2025-03-14T06:25:22.3501303Z  2025-03-14T06:25:22.3501723Z  2025-03-14T06:25:22.3502124Z  2025-03-14T06:25:22.3502479Z  2025-03-14T06:25:22.3503363Z [11,360 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:22.3504419Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:25:22.3505198Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T06:25:22.3506025Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:25:22.3506855Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:22.3507719Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local 2025-03-14T06:25:22.3508660Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2025-03-14T06:25:22.3509565Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2025-03-14T06:25:22.3510355Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:25:22.5735517Z 2025-03-14T06:25:22.5736348Z  2025-03-14T06:25:22.5736857Z  2025-03-14T06:25:22.5737231Z  2025-03-14T06:25:22.5737647Z  2025-03-14T06:25:22.5738073Z  2025-03-14T06:25:22.5738775Z  2025-03-14T06:25:22.5739201Z  2025-03-14T06:25:22.5739635Z  2025-03-14T06:25:22.5740640Z [11,367 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:22.5741716Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:25:22.5742688Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T06:25:22.5743464Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:25:22.5744415Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:22.5745291Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local 2025-03-14T06:25:22.5746367Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2025-03-14T06:25:22.5747337Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2025-03-14T06:25:22.5748134Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:25:22.7792092Z 2025-03-14T06:25:22.7792954Z  2025-03-14T06:25:22.7793465Z  2025-03-14T06:25:22.7793909Z  2025-03-14T06:25:22.7794323Z  2025-03-14T06:25:22.7794727Z  2025-03-14T06:25:22.7795140Z  2025-03-14T06:25:22.7795571Z  2025-03-14T06:25:22.7796000Z  2025-03-14T06:25:22.7797010Z [11,369 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:22.7798083Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:25:22.7798850Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:22.7799663Z Compiling src/cpu/cpu_convolution_list.cpp; 14s local 2025-03-14T06:25:22.7800534Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:22.7801683Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local 2025-03-14T06:25:22.7802621Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2025-03-14T06:25:22.7803562Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2025-03-14T06:25:22.7804351Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:25:22.9796615Z 2025-03-14T06:25:22.9797421Z  2025-03-14T06:25:22.9797899Z  2025-03-14T06:25:22.9798324Z  2025-03-14T06:25:22.9798734Z  2025-03-14T06:25:22.9799142Z  2025-03-14T06:25:22.9799569Z  2025-03-14T06:25:22.9799987Z  2025-03-14T06:25:22.9800448Z  2025-03-14T06:25:22.9801439Z [11,371 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:22.9802472Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:25:22.9803315Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:22.9804122Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2025-03-14T06:25:22.9805115Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:22.9805952Z Compiling src/cpu/cpu_deconvolution_list.cpp; 12s local 2025-03-14T06:25:22.9806883Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2025-03-14T06:25:22.9807841Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2025-03-14T06:25:22.9808635Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:25:23.1817039Z 2025-03-14T06:25:23.1817896Z  2025-03-14T06:25:23.1818399Z  2025-03-14T06:25:23.1818820Z  2025-03-14T06:25:23.1819268Z  2025-03-14T06:25:23.1819669Z  2025-03-14T06:25:23.1820087Z  2025-03-14T06:25:23.1821196Z  2025-03-14T06:25:23.1821668Z  2025-03-14T06:25:23.1822674Z [11,374 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:23.1823752Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:25:23.1824533Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:23.1825259Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2025-03-14T06:25:23.1826100Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:23.1826940Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2025-03-14T06:25:23.1828154Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local 2025-03-14T06:25:23.1829115Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T06:25:23.1829898Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:25:23.4564223Z 2025-03-14T06:25:23.4565647Z  2025-03-14T06:25:23.4566180Z  2025-03-14T06:25:23.4566608Z  2025-03-14T06:25:23.4567046Z  2025-03-14T06:25:23.4567478Z  2025-03-14T06:25:23.4567905Z  2025-03-14T06:25:23.4568331Z  2025-03-14T06:25:23.4568918Z  2025-03-14T06:25:23.4569948Z [11,378 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:23.4571094Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T06:25:23.4571934Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:23.4572733Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2025-03-14T06:25:23.4573533Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T06:25:23.4574351Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2025-03-14T06:25:23.4575283Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2025-03-14T06:25:23.4576245Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T06:25:23.4576900Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:25:23.6891949Z 2025-03-14T06:25:23.6892723Z  2025-03-14T06:25:23.6893159Z  2025-03-14T06:25:23.6893517Z  2025-03-14T06:25:23.6893871Z  2025-03-14T06:25:23.6894247Z  2025-03-14T06:25:23.6894608Z  2025-03-14T06:25:23.6895028Z  2025-03-14T06:25:23.6895437Z  2025-03-14T06:25:23.6896654Z [11,379 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:23.6897692Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T06:25:23.6898451Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:23.6899221Z Compiling src/cpu/cpu_convolution_list.cpp; 15s local 2025-03-14T06:25:23.6900087Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T06:25:23.6900815Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2025-03-14T06:25:23.6901592Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2025-03-14T06:25:23.6902401Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T06:25:23.6903068Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:25:23.9471920Z 2025-03-14T06:25:23.9472802Z  2025-03-14T06:25:23.9473307Z  2025-03-14T06:25:23.9473692Z  2025-03-14T06:25:23.9474194Z  2025-03-14T06:25:23.9474701Z  2025-03-14T06:25:23.9475229Z  2025-03-14T06:25:23.9475615Z  2025-03-14T06:25:23.9476054Z  2025-03-14T06:25:23.9477114Z [11,382 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:23.9478139Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T06:25:23.9479065Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T06:25:23.9479910Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:25:23.9480684Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T06:25:23.9481538Z Compiling src/cpu/cpu_deconvolution_list.cpp; 13s local 2025-03-14T06:25:23.9482470Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2025-03-14T06:25:23.9483403Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T06:25:23.9484209Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:25:24.1806581Z 2025-03-14T06:25:24.1807445Z  2025-03-14T06:25:24.1807957Z  2025-03-14T06:25:24.1808439Z  2025-03-14T06:25:24.1808851Z  2025-03-14T06:25:24.1809255Z  2025-03-14T06:25:24.1809676Z  2025-03-14T06:25:24.1810104Z  2025-03-14T06:25:24.1810533Z  2025-03-14T06:25:24.1811550Z [11,384 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:24.1812906Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T06:25:24.1813737Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T06:25:24.1814554Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:25:24.1815492Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T06:25:24.1816365Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2025-03-14T06:25:24.1817411Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local 2025-03-14T06:25:24.1818373Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T06:25:24.1819177Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:25:24.5379784Z 2025-03-14T06:25:24.5380584Z  2025-03-14T06:25:24.5381096Z  2025-03-14T06:25:24.5381522Z  2025-03-14T06:25:24.5381923Z  2025-03-14T06:25:24.5382333Z  2025-03-14T06:25:24.5382739Z  2025-03-14T06:25:24.5383164Z  2025-03-14T06:25:24.5383602Z  2025-03-14T06:25:24.5384555Z [11,389 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:24.5385599Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T06:25:24.5386415Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T06:25:24.5387205Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:25:24.5388046Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T06:25:24.5388938Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2025-03-14T06:25:24.5389858Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2025-03-14T06:25:24.5391024Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T06:25:24.5391846Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:25:24.7813954Z 2025-03-14T06:25:24.7814824Z  2025-03-14T06:25:24.7815295Z  2025-03-14T06:25:24.7815689Z  2025-03-14T06:25:24.7816092Z  2025-03-14T06:25:24.7816529Z  2025-03-14T06:25:24.7816925Z  2025-03-14T06:25:24.7817338Z  2025-03-14T06:25:24.7817753Z  2025-03-14T06:25:24.7818683Z [11,390 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:24.7819750Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T06:25:24.7820544Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:24.7822048Z Compiling src/cpu/cpu_convolution_list.cpp; 16s local 2025-03-14T06:25:24.7822913Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T06:25:24.7823757Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2025-03-14T06:25:24.7824687Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2025-03-14T06:25:24.7825634Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T06:25:24.7826411Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:25.0596199Z 2025-03-14T06:25:25.0597030Z  2025-03-14T06:25:25.0597581Z  2025-03-14T06:25:25.0598015Z  2025-03-14T06:25:25.0598447Z  2025-03-14T06:25:25.0598868Z  2025-03-14T06:25:25.0599284Z  2025-03-14T06:25:25.0599699Z  2025-03-14T06:25:25.0600119Z  2025-03-14T06:25:25.0601112Z [11,391 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:25.0602202Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T06:25:25.0603032Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:25.0603838Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2025-03-14T06:25:25.0604884Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T06:25:25.0605743Z Compiling src/cpu/cpu_deconvolution_list.cpp; 14s local 2025-03-14T06:25:25.0606700Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2025-03-14T06:25:25.0607693Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T06:25:25.0608800Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:25.2630322Z 2025-03-14T06:25:25.2631073Z  2025-03-14T06:25:25.2631535Z  2025-03-14T06:25:25.2631962Z  2025-03-14T06:25:25.2632355Z  2025-03-14T06:25:25.2632746Z  2025-03-14T06:25:25.2633406Z  2025-03-14T06:25:25.2633834Z  2025-03-14T06:25:25.2634272Z  2025-03-14T06:25:25.2635342Z [11,395 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:25.2636485Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T06:25:25.2637283Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:25.2638092Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2025-03-14T06:25:25.2638889Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T06:25:25.2639769Z Compiling src/cpu/cpu_deconvolution_list.cpp; 15s local 2025-03-14T06:25:25.2640719Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local 2025-03-14T06:25:25.2641701Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T06:25:25.2642490Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:25.5035112Z 2025-03-14T06:25:25.5036131Z  2025-03-14T06:25:25.5036630Z  2025-03-14T06:25:25.5037085Z  2025-03-14T06:25:25.5037493Z  2025-03-14T06:25:25.5037919Z  2025-03-14T06:25:25.5038345Z  2025-03-14T06:25:25.5038744Z  2025-03-14T06:25:25.5039171Z  2025-03-14T06:25:25.5040180Z [11,396 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:25.5041471Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T06:25:25.5042285Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:25.5043118Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2025-03-14T06:25:25.5043988Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:25.5044966Z Compiling src/cpu/cpu_deconvolution_list.cpp; 15s local 2025-03-14T06:25:25.5045798Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T06:25:25.5046645Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T06:25:25.5047417Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:25.7025542Z 2025-03-14T06:25:25.7026371Z  2025-03-14T06:25:25.7026919Z  2025-03-14T06:25:25.7027322Z  2025-03-14T06:25:25.7027736Z  2025-03-14T06:25:25.7028174Z  2025-03-14T06:25:25.7028633Z  2025-03-14T06:25:25.7029078Z  2025-03-14T06:25:25.7029517Z  2025-03-14T06:25:25.7030547Z [11,400 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:25.7031695Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T06:25:25.7032549Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:25.7033360Z Compiling src/cpu/cpu_convolution_list.cpp; 17s local 2025-03-14T06:25:25.7034248Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:25.7035195Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T06:25:25.7036183Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T06:25:25.7037004Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:25.7037811Z Compiling src/cpu/x64/jit_avx2_1x1_convolution.cpp; 10s local ... 2025-03-14T06:25:25.9409599Z 2025-03-14T06:25:25.9410511Z  2025-03-14T06:25:25.9411044Z  2025-03-14T06:25:25.9411483Z  2025-03-14T06:25:25.9411875Z  2025-03-14T06:25:25.9412263Z  2025-03-14T06:25:25.9412677Z  2025-03-14T06:25:25.9413091Z  2025-03-14T06:25:25.9413527Z  2025-03-14T06:25:25.9414587Z [11,402 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:25.9415602Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T06:25:25.9416372Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:25.9417433Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2025-03-14T06:25:25.9418283Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:25.9419147Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T06:25:25.9420215Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T06:25:25.9420998Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:25.9421884Z Compiling src/cpu/x64/jit_avx2_1x1_convolution.cpp; 10s local ... 2025-03-14T06:25:26.1483928Z 2025-03-14T06:25:26.1484967Z  2025-03-14T06:25:26.1485496Z  2025-03-14T06:25:26.1485908Z  2025-03-14T06:25:26.1486359Z  2025-03-14T06:25:26.1486778Z  2025-03-14T06:25:26.1487216Z  2025-03-14T06:25:26.1487632Z  2025-03-14T06:25:26.1488041Z  2025-03-14T06:25:26.1489015Z [11,408 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:26.1490109Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T06:25:26.1490899Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:26.1491674Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2025-03-14T06:25:26.1492507Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:26.1493439Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T06:25:26.1494386Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T06:25:26.1495147Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:26.1495722Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:25:26.3824944Z 2025-03-14T06:25:26.3825786Z  2025-03-14T06:25:26.3826584Z  2025-03-14T06:25:26.3827023Z  2025-03-14T06:25:26.3827438Z  2025-03-14T06:25:26.3827847Z  2025-03-14T06:25:26.3828243Z  2025-03-14T06:25:26.3828617Z  2025-03-14T06:25:26.3829022Z  2025-03-14T06:25:26.3829998Z [11,410 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:26.3831122Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T06:25:26.3831932Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:26.3832705Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2025-03-14T06:25:26.3833539Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T06:25:26.3834436Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:26.3835240Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:26.3835805Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:25:26.3836543Z Compiling src/cpu/cpu_eltwise_list.cpp; 10s local ... 2025-03-14T06:25:26.6924608Z 2025-03-14T06:25:26.6925451Z  2025-03-14T06:25:26.6925879Z  2025-03-14T06:25:26.6926260Z  2025-03-14T06:25:26.6926629Z  2025-03-14T06:25:26.6926995Z  2025-03-14T06:25:26.6927350Z  2025-03-14T06:25:26.6927710Z  2025-03-14T06:25:26.6928090Z  2025-03-14T06:25:26.6937462Z [11,412 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:26.6938535Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T06:25:26.6939244Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:26.6939928Z Compiling src/cpu/cpu_convolution_list.cpp; 18s local 2025-03-14T06:25:26.6940645Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T06:25:26.6941398Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:26.6942081Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:26.6942583Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:26.6943146Z Compiling src/cpu/cpu_eltwise_list.cpp; 10s local ... 2025-03-14T06:25:26.9226543Z 2025-03-14T06:25:26.9227405Z  2025-03-14T06:25:26.9227903Z  2025-03-14T06:25:26.9228328Z  2025-03-14T06:25:26.9228743Z  2025-03-14T06:25:26.9229458Z  2025-03-14T06:25:26.9229832Z  2025-03-14T06:25:26.9230218Z  2025-03-14T06:25:26.9230616Z  2025-03-14T06:25:26.9231573Z [11,414 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:26.9232741Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T06:25:26.9233527Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2025-03-14T06:25:26.9234294Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T06:25:26.9235259Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T06:25:26.9236133Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:26.9236880Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:26.9237374Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:26.9238150Z Compiling src/cpu/cpu_eltwise_list.cpp; 11s local ... 2025-03-14T06:25:27.1832388Z 2025-03-14T06:25:27.1833333Z  2025-03-14T06:25:27.1833807Z  2025-03-14T06:25:27.1834229Z  2025-03-14T06:25:27.1834612Z  2025-03-14T06:25:27.1834991Z  2025-03-14T06:25:27.1835382Z  2025-03-14T06:25:27.1835765Z  2025-03-14T06:25:27.1836105Z  2025-03-14T06:25:27.1836992Z [11,418 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:27.1837998Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T06:25:27.1838738Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2025-03-14T06:25:27.1839466Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T06:25:27.1840225Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T06:25:27.1841356Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:27.1842084Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:27.1842588Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:27.1843198Z Compiling src/cpu/cpu_eltwise_list.cpp; 11s local ... 2025-03-14T06:25:27.4762629Z 2025-03-14T06:25:27.4763523Z  2025-03-14T06:25:27.4764041Z  2025-03-14T06:25:27.4764588Z  2025-03-14T06:25:27.4765017Z  2025-03-14T06:25:27.4765668Z  2025-03-14T06:25:27.4766109Z  2025-03-14T06:25:27.4766532Z  2025-03-14T06:25:27.4766917Z  2025-03-14T06:25:27.4767844Z [11,421 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:27.4768888Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T06:25:27.4769681Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2025-03-14T06:25:27.4770463Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T06:25:27.4771353Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T06:25:27.4772231Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T06:25:27.4773026Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:27.4773576Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:27.4774244Z Compiling src/cpu/cpu_eltwise_list.cpp; 11s local ... 2025-03-14T06:25:27.7838514Z 2025-03-14T06:25:27.7839420Z  2025-03-14T06:25:27.7840027Z  2025-03-14T06:25:27.7840547Z  2025-03-14T06:25:27.7841067Z  2025-03-14T06:25:27.7841584Z  2025-03-14T06:25:27.7842143Z  2025-03-14T06:25:27.7842669Z  2025-03-14T06:25:27.7843189Z  2025-03-14T06:25:27.7844310Z [11,423 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:27.7845435Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T06:25:27.7846144Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T06:25:27.7847002Z Compiling src/cpu/cpu_convolution_list.cpp; 19s local 2025-03-14T06:25:27.7847843Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T06:25:27.7848711Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T06:25:27.7849487Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:25:27.7850427Z Compiling src/cpu/cpu_eltwise_list.cpp; 12s local 2025-03-14T06:25:27.7851351Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 11s local ... 2025-03-14T06:25:27.9842273Z 2025-03-14T06:25:27.9843142Z  2025-03-14T06:25:27.9843769Z  2025-03-14T06:25:27.9844630Z  2025-03-14T06:25:27.9845073Z  2025-03-14T06:25:27.9845505Z  2025-03-14T06:25:27.9845928Z  2025-03-14T06:25:27.9846341Z  2025-03-14T06:25:27.9846764Z  2025-03-14T06:25:27.9847948Z [11,425 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:27.9849116Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T06:25:27.9849912Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T06:25:27.9850738Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:25:27.9851615Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T06:25:27.9852513Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T06:25:27.9853359Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:25:27.9853995Z Compiling src/cpu/cpu_eltwise_list.cpp; 12s local 2025-03-14T06:25:27.9854946Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local ... 2025-03-14T06:25:28.2005084Z 2025-03-14T06:25:28.2006005Z  2025-03-14T06:25:28.2006495Z  2025-03-14T06:25:28.2006936Z  2025-03-14T06:25:28.2007396Z  2025-03-14T06:25:28.2007823Z  2025-03-14T06:25:28.2008238Z  2025-03-14T06:25:28.2008695Z  2025-03-14T06:25:28.2009141Z  2025-03-14T06:25:28.2010237Z [11,430 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:28.2011313Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T06:25:28.2012082Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T06:25:28.2012817Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:25:28.2013612Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T06:25:28.2014453Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T06:25:28.2015192Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:25:28.2015806Z Compiling src/cpu/cpu_eltwise_list.cpp; 12s local 2025-03-14T06:25:28.2016731Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local ... 2025-03-14T06:25:28.4797765Z 2025-03-14T06:25:28.4798641Z  2025-03-14T06:25:28.4799116Z  2025-03-14T06:25:28.4799537Z  2025-03-14T06:25:28.4799921Z  2025-03-14T06:25:28.4800307Z  2025-03-14T06:25:28.4800684Z  2025-03-14T06:25:28.4801056Z  2025-03-14T06:25:28.4801443Z  2025-03-14T06:25:28.4802329Z [11,434 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:28.4803279Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T06:25:28.4803965Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T06:25:28.4804809Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:25:28.4805559Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T06:25:28.4806352Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T06:25:28.4807242Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local 2025-03-14T06:25:28.4808060Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T06:25:28.4808791Z Compiling src/cpu/simple_resampling.cpp; 10s local ... 2025-03-14T06:25:28.7138638Z 2025-03-14T06:25:28.7139543Z  2025-03-14T06:25:28.7140054Z  2025-03-14T06:25:28.7140469Z  2025-03-14T06:25:28.7140924Z  2025-03-14T06:25:28.7141317Z  2025-03-14T06:25:28.7141735Z  2025-03-14T06:25:28.7142157Z  2025-03-14T06:25:28.7142576Z  2025-03-14T06:25:28.7143531Z [11,436 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:28.7144809Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T06:25:28.7145574Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T06:25:28.7146287Z Compiling src/cpu/cpu_convolution_list.cpp; 20s local 2025-03-14T06:25:28.7147252Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T06:25:28.7148120Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T06:25:28.7149101Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 12s local 2025-03-14T06:25:28.7150122Z Compiling src/cpu/rnn/ref_rnn.cpp; 12s local 2025-03-14T06:25:28.7150945Z Compiling src/cpu/simple_resampling.cpp; 10s local ... 2025-03-14T06:25:28.9852892Z 2025-03-14T06:25:28.9853718Z  2025-03-14T06:25:28.9854233Z  2025-03-14T06:25:28.9854674Z  2025-03-14T06:25:28.9855100Z  2025-03-14T06:25:28.9855524Z  2025-03-14T06:25:28.9855945Z  2025-03-14T06:25:28.9856377Z  2025-03-14T06:25:28.9856803Z  2025-03-14T06:25:28.9857822Z [11,438 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:28.9858918Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T06:25:28.9859734Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T06:25:28.9860544Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:25:28.9861379Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T06:25:28.9862325Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T06:25:28.9863270Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local 2025-03-14T06:25:28.9864394Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T06:25:28.9865225Z Compiling src/cpu/simple_resampling.cpp; 10s local ... 2025-03-14T06:25:29.2048089Z 2025-03-14T06:25:29.2048970Z  2025-03-14T06:25:29.2049473Z  2025-03-14T06:25:29.2049900Z  2025-03-14T06:25:29.2050340Z  2025-03-14T06:25:29.2050770Z  2025-03-14T06:25:29.2051196Z  2025-03-14T06:25:29.2051629Z  2025-03-14T06:25:29.2052044Z  2025-03-14T06:25:29.2053086Z [11,441 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:29.2054215Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T06:25:29.2054983Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T06:25:29.2055755Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:25:29.2056620Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T06:25:29.2057527Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T06:25:29.2058561Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local 2025-03-14T06:25:29.2059528Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T06:25:29.2060282Z Compiling src/cpu/simple_resampling.cpp; 10s local ... 2025-03-14T06:25:29.4389289Z 2025-03-14T06:25:29.4390193Z  2025-03-14T06:25:29.4390685Z  2025-03-14T06:25:29.4391115Z  2025-03-14T06:25:29.4391521Z  2025-03-14T06:25:29.4391946Z  2025-03-14T06:25:29.4392378Z  2025-03-14T06:25:29.4392794Z  2025-03-14T06:25:29.4393207Z  2025-03-14T06:25:29.4394244Z [11,443 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:29.4395310Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T06:25:29.4396655Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T06:25:29.4397630Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:25:29.4398645Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T06:25:29.4399693Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T06:25:29.4400832Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local 2025-03-14T06:25:29.4401868Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T06:25:29.4403098Z Compiling src/cpu/simple_resampling.cpp; 11s local ... 2025-03-14T06:25:29.6581962Z 2025-03-14T06:25:29.6582900Z  2025-03-14T06:25:29.6583358Z  2025-03-14T06:25:29.6583780Z  2025-03-14T06:25:29.6584218Z  2025-03-14T06:25:29.6584902Z  2025-03-14T06:25:29.6585322Z  2025-03-14T06:25:29.6585744Z  2025-03-14T06:25:29.6586181Z  2025-03-14T06:25:29.6587202Z [11,446 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:29.6588168Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T06:25:29.6588929Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T06:25:29.6589666Z Compiling src/cpu/cpu_convolution_list.cpp; 21s local 2025-03-14T06:25:29.6590454Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T06:25:29.6591189Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T06:25:29.6592044Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 13s local 2025-03-14T06:25:29.6592815Z Compiling src/cpu/rnn/ref_rnn.cpp; 13s local 2025-03-14T06:25:29.6593579Z Compiling src/cpu/simple_resampling.cpp; 11s local ... 2025-03-14T06:25:29.9820306Z 2025-03-14T06:25:29.9821280Z  2025-03-14T06:25:29.9822372Z  2025-03-14T06:25:29.9822736Z  2025-03-14T06:25:29.9823086Z  2025-03-14T06:25:29.9823454Z  2025-03-14T06:25:29.9823830Z  2025-03-14T06:25:29.9824214Z  2025-03-14T06:25:29.9824599Z  2025-03-14T06:25:29.9825481Z [11,447 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:29.9826660Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T06:25:29.9827397Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T06:25:29.9828224Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T06:25:29.9828970Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T06:25:29.9829745Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T06:25:29.9830577Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local 2025-03-14T06:25:29.9831338Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:29.9832026Z Compiling src/cpu/simple_resampling.cpp; 11s local ... 2025-03-14T06:25:30.1864388Z 2025-03-14T06:25:30.1865222Z  2025-03-14T06:25:30.1865922Z  2025-03-14T06:25:30.1866339Z  2025-03-14T06:25:30.1866788Z  2025-03-14T06:25:30.1867196Z  2025-03-14T06:25:30.1867633Z  2025-03-14T06:25:30.1868068Z  2025-03-14T06:25:30.1868506Z  2025-03-14T06:25:30.1869454Z [11,449 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:30.1870530Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T06:25:30.1871363Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T06:25:30.1872165Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T06:25:30.1873030Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T06:25:30.1873950Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T06:25:30.1874971Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local 2025-03-14T06:25:30.1875862Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:30.1876651Z Compiling src/cpu/simple_resampling.cpp; 11s local ... 2025-03-14T06:25:30.4826017Z 2025-03-14T06:25:30.4826914Z  2025-03-14T06:25:30.4827399Z  2025-03-14T06:25:30.4827822Z  2025-03-14T06:25:30.4828234Z  2025-03-14T06:25:30.4828658Z  2025-03-14T06:25:30.4829079Z  2025-03-14T06:25:30.4829481Z  2025-03-14T06:25:30.4829904Z  2025-03-14T06:25:30.4830870Z [11,451 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:30.4831799Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T06:25:30.4832711Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T06:25:30.4833439Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T06:25:30.4834181Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T06:25:30.4835207Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2025-03-14T06:25:30.4836101Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local 2025-03-14T06:25:30.4837131Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:30.4837857Z Compiling src/cpu/simple_resampling.cpp; 12s local ... 2025-03-14T06:25:30.7231884Z 2025-03-14T06:25:30.7232742Z  2025-03-14T06:25:30.7233244Z  2025-03-14T06:25:30.7233654Z  2025-03-14T06:25:30.7234063Z  2025-03-14T06:25:30.7234468Z  2025-03-14T06:25:30.7234880Z  2025-03-14T06:25:30.7235311Z  2025-03-14T06:25:30.7235742Z  2025-03-14T06:25:30.7236715Z [11,455 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:30.7237737Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T06:25:30.7238505Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:30.7239273Z Compiling src/cpu/cpu_convolution_list.cpp; 22s local 2025-03-14T06:25:30.7240082Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T06:25:30.7240941Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2025-03-14T06:25:30.7241958Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 14s local 2025-03-14T06:25:30.7242833Z Compiling src/cpu/rnn/ref_rnn.cpp; 14s local 2025-03-14T06:25:30.7243891Z Compiling src/cpu/simple_resampling.cpp; 12s local ... 2025-03-14T06:25:30.9670838Z 2025-03-14T06:25:30.9671648Z  2025-03-14T06:25:30.9672170Z  2025-03-14T06:25:30.9672611Z  2025-03-14T06:25:30.9673045Z  2025-03-14T06:25:30.9673448Z  2025-03-14T06:25:30.9673858Z  2025-03-14T06:25:30.9674270Z  2025-03-14T06:25:30.9674630Z  2025-03-14T06:25:30.9675594Z [11,458 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:30.9676662Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T06:25:30.9677470Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:30.9678251Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T06:25:30.9679071Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T06:25:30.9679941Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2025-03-14T06:25:30.9680941Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local 2025-03-14T06:25:30.9681806Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:30.9682568Z Compiling src/cpu/simple_resampling.cpp; 12s local ... 2025-03-14T06:25:31.1761315Z 2025-03-14T06:25:31.1762199Z  2025-03-14T06:25:31.1762742Z  2025-03-14T06:25:31.1763182Z  2025-03-14T06:25:31.1763620Z  2025-03-14T06:25:31.1764061Z  2025-03-14T06:25:31.1764669Z  2025-03-14T06:25:31.1765111Z  2025-03-14T06:25:31.1765787Z  2025-03-14T06:25:31.1766788Z [11,464 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:31.1767888Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T06:25:31.1768689Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:31.1769503Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T06:25:31.1770318Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T06:25:31.1771263Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local 2025-03-14T06:25:31.1772186Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:31.1772979Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T06:25:31.1773949Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 12s local ... 2025-03-14T06:25:31.3872766Z 2025-03-14T06:25:31.3873714Z  2025-03-14T06:25:31.3874223Z  2025-03-14T06:25:31.3874645Z  2025-03-14T06:25:31.3875056Z  2025-03-14T06:25:31.3875489Z  2025-03-14T06:25:31.3876210Z  2025-03-14T06:25:31.3876640Z  2025-03-14T06:25:31.3877048Z  2025-03-14T06:25:31.3878048Z [11,465 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:31.3879298Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T06:25:31.3880054Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:31.3880841Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T06:25:31.3881669Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T06:25:31.3882611Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local 2025-03-14T06:25:31.3883515Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:31.3884333Z Compiling src/cpu/simple_resampling.cpp; 12s local 2025-03-14T06:25:31.3885560Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 12s local ... 2025-03-14T06:25:31.6074903Z 2025-03-14T06:25:31.6075787Z  2025-03-14T06:25:31.6076312Z  2025-03-14T06:25:31.6076701Z  2025-03-14T06:25:31.6077091Z  2025-03-14T06:25:31.6077491Z  2025-03-14T06:25:31.6077894Z  2025-03-14T06:25:31.6078317Z  2025-03-14T06:25:31.6078704Z  2025-03-14T06:25:31.6079642Z [11,470 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:31.6080965Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T06:25:31.6081787Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:31.6082546Z Compiling src/cpu/cpu_convolution_list.cpp; 23s local 2025-03-14T06:25:31.6083355Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T06:25:31.6084289Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local 2025-03-14T06:25:31.6085383Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:31.6086147Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:31.6087134Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 12s local ... 2025-03-14T06:25:31.8973343Z 2025-03-14T06:25:31.8974293Z  2025-03-14T06:25:31.8974826Z  2025-03-14T06:25:31.8975237Z  2025-03-14T06:25:31.8975625Z  2025-03-14T06:25:31.8976061Z  2025-03-14T06:25:31.8976466Z  2025-03-14T06:25:31.8976874Z  2025-03-14T06:25:31.8977288Z  2025-03-14T06:25:31.8978265Z [11,474 / 20,650] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2025-03-14T06:25:31.8979269Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T06:25:31.8980014Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T06:25:31.8980783Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:25:31.8981611Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T06:25:31.8982419Z Compiling src/cpu/rnn/ref_rnn.cpp; 15s local 2025-03-14T06:25:31.8983207Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:31.8984278Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 13s local 2025-03-14T06:25:31.8985271Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 11s local ... 2025-03-14T06:25:32.1878793Z 2025-03-14T06:25:32.1880784Z  2025-03-14T06:25:32.1881309Z  2025-03-14T06:25:32.1881745Z  2025-03-14T06:25:32.1882163Z  2025-03-14T06:25:32.1882573Z  2025-03-14T06:25:32.1882982Z  2025-03-14T06:25:32.1883389Z  2025-03-14T06:25:32.1883809Z  2025-03-14T06:25:32.1884872Z [11,475 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:32.1885917Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T06:25:32.1886998Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T06:25:32.1887781Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:25:32.1888554Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T06:25:32.1889516Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T06:25:32.1890252Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:32.1891275Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 13s local 2025-03-14T06:25:32.1892500Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2025-03-14T06:25:32.3886195Z 2025-03-14T06:25:32.3887055Z  2025-03-14T06:25:32.3887585Z  2025-03-14T06:25:32.3888005Z  2025-03-14T06:25:32.3888445Z  2025-03-14T06:25:32.3888808Z  2025-03-14T06:25:32.3889174Z  2025-03-14T06:25:32.3889548Z  2025-03-14T06:25:32.3889912Z  2025-03-14T06:25:32.3890869Z [11,477 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:32.3891932Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T06:25:32.3892659Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T06:25:32.3893387Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:25:32.3894204Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T06:25:32.3894900Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T06:25:32.3895648Z Compiling src/cpu/simple_resampling.cpp; 13s local 2025-03-14T06:25:32.3896559Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 13s local 2025-03-14T06:25:32.3897838Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2025-03-14T06:25:32.7888411Z 2025-03-14T06:25:32.7889852Z  2025-03-14T06:25:32.7890510Z  2025-03-14T06:25:32.7891138Z  2025-03-14T06:25:32.7892054Z  2025-03-14T06:25:32.7892370Z  2025-03-14T06:25:32.7892674Z  2025-03-14T06:25:32.7892929Z  2025-03-14T06:25:32.7893183Z  2025-03-14T06:25:32.7893781Z [11,480 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:32.7894424Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T06:25:32.7894909Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:32.7895372Z Compiling src/cpu/cpu_convolution_list.cpp; 24s local 2025-03-14T06:25:32.7895873Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T06:25:32.7896335Z Compiling src/cpu/rnn/ref_rnn.cpp; 16s local 2025-03-14T06:25:32.7896796Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T06:25:32.7897350Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local 2025-03-14T06:25:32.7897968Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2025-03-14T06:25:32.9893777Z 2025-03-14T06:25:32.9894657Z  2025-03-14T06:25:32.9895176Z  2025-03-14T06:25:32.9895623Z  2025-03-14T06:25:32.9896061Z  2025-03-14T06:25:32.9896499Z  2025-03-14T06:25:32.9896918Z  2025-03-14T06:25:32.9897353Z  2025-03-14T06:25:32.9897781Z  2025-03-14T06:25:32.9898788Z [11,481 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:32.9899904Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T06:25:32.9900712Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:32.9901536Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T06:25:32.9902384Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T06:25:32.9903150Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:32.9903936Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T06:25:32.9904855Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local 2025-03-14T06:25:32.9905924Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 12s local ... 2025-03-14T06:25:33.2074750Z 2025-03-14T06:25:33.2075567Z  2025-03-14T06:25:33.2076054Z  2025-03-14T06:25:33.2076456Z  2025-03-14T06:25:33.2076874Z  2025-03-14T06:25:33.2077291Z  2025-03-14T06:25:33.2078043Z  2025-03-14T06:25:33.2078451Z  2025-03-14T06:25:33.2078860Z  2025-03-14T06:25:33.2079807Z [11,484 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:33.2081097Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T06:25:33.2081902Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:33.2082717Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T06:25:33.2083563Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T06:25:33.2084354Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:33.2085276Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T06:25:33.2086214Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local 2025-03-14T06:25:33.2087234Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local ... 2025-03-14T06:25:33.4024658Z 2025-03-14T06:25:33.4025561Z  2025-03-14T06:25:33.4026021Z  2025-03-14T06:25:33.4026425Z  2025-03-14T06:25:33.4026825Z  2025-03-14T06:25:33.4027221Z  2025-03-14T06:25:33.4027621Z  2025-03-14T06:25:33.4028011Z  2025-03-14T06:25:33.4028401Z  2025-03-14T06:25:33.4029340Z [11,487 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:33.4030610Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:25:33.4031358Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:33.4032056Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T06:25:33.4033005Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T06:25:33.4033747Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:33.4034630Z Compiling src/cpu/simple_resampling.cpp; 14s local 2025-03-14T06:25:33.4035672Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local 2025-03-14T06:25:33.4036817Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local ... 2025-03-14T06:25:33.6469993Z 2025-03-14T06:25:33.6470899Z  2025-03-14T06:25:33.6471414Z  2025-03-14T06:25:33.6471857Z  2025-03-14T06:25:33.6472298Z  2025-03-14T06:25:33.6472710Z  2025-03-14T06:25:33.6473182Z  2025-03-14T06:25:33.6473616Z  2025-03-14T06:25:33.6474045Z  2025-03-14T06:25:33.6475050Z [11,490 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:33.6476159Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:25:33.6476959Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:33.6477743Z Compiling src/cpu/cpu_convolution_list.cpp; 25s local 2025-03-14T06:25:33.6478594Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T06:25:33.6479398Z Compiling src/cpu/rnn/ref_rnn.cpp; 17s local 2025-03-14T06:25:33.6480187Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T06:25:33.6481167Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 14s local 2025-03-14T06:25:33.6482260Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local ... 2025-03-14T06:25:33.9905133Z 2025-03-14T06:25:33.9906000Z  2025-03-14T06:25:33.9906531Z  2025-03-14T06:25:33.9906955Z  2025-03-14T06:25:33.9907373Z  2025-03-14T06:25:33.9907789Z  2025-03-14T06:25:33.9908210Z  2025-03-14T06:25:33.9908629Z  2025-03-14T06:25:33.9909049Z  2025-03-14T06:25:33.9910025Z [11,490 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:33.9911132Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:25:33.9912190Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T06:25:33.9912971Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T06:25:33.9913816Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T06:25:33.9914593Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T06:25:33.9915530Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T06:25:33.9916488Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2025-03-14T06:25:33.9917775Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 13s local ... 2025-03-14T06:25:34.2344795Z 2025-03-14T06:25:34.2345681Z  2025-03-14T06:25:34.2346192Z  2025-03-14T06:25:34.2346606Z  2025-03-14T06:25:34.2347007Z  2025-03-14T06:25:34.2347390Z  2025-03-14T06:25:34.2347803Z  2025-03-14T06:25:34.2348210Z  2025-03-14T06:25:34.2348626Z  2025-03-14T06:25:34.2349573Z [11,496 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:34.2350628Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:25:34.2351420Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T06:25:34.2352198Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T06:25:34.2353057Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T06:25:34.2353815Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T06:25:34.2354597Z Compiling src/cpu/simple_resampling.cpp; 15s local 2025-03-14T06:25:34.2355552Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2025-03-14T06:25:34.2357045Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local ... 2025-03-14T06:25:34.5310277Z 2025-03-14T06:25:34.5311127Z  2025-03-14T06:25:34.5311629Z  2025-03-14T06:25:34.5312031Z  2025-03-14T06:25:34.5312421Z  2025-03-14T06:25:34.5312816Z  2025-03-14T06:25:34.5313237Z  2025-03-14T06:25:34.5313699Z  2025-03-14T06:25:34.5314222Z  2025-03-14T06:25:34.5315242Z [11,498 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:34.5316365Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T06:25:34.5317202Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T06:25:34.5317955Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T06:25:34.5318712Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T06:25:34.5319430Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T06:25:34.5320153Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:34.5321083Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 15s local 2025-03-14T06:25:34.5323072Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local ... 2025-03-14T06:25:34.7657691Z 2025-03-14T06:25:34.7658549Z  2025-03-14T06:25:34.7659068Z  2025-03-14T06:25:34.7659543Z  2025-03-14T06:25:34.7659976Z  2025-03-14T06:25:34.7660410Z  2025-03-14T06:25:34.7660848Z  2025-03-14T06:25:34.7661277Z  2025-03-14T06:25:34.7661709Z  2025-03-14T06:25:34.7662673Z [11,502 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:34.7663769Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T06:25:34.7664580Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:34.7665667Z Compiling src/cpu/cpu_convolution_list.cpp; 26s local 2025-03-14T06:25:34.7666530Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T06:25:34.7667326Z Compiling src/cpu/rnn/ref_rnn.cpp; 18s local 2025-03-14T06:25:34.7668103Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:34.7669063Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2025-03-14T06:25:34.7670138Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local ... 2025-03-14T06:25:34.9870116Z 2025-03-14T06:25:34.9871023Z  2025-03-14T06:25:34.9871547Z  2025-03-14T06:25:34.9871973Z  2025-03-14T06:25:34.9872397Z  2025-03-14T06:25:34.9872790Z  2025-03-14T06:25:34.9873188Z  2025-03-14T06:25:34.9873902Z  2025-03-14T06:25:34.9874314Z  2025-03-14T06:25:34.9875298Z [11,508 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:34.9876538Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T06:25:34.9877317Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:34.9878129Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:25:34.9878945Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T06:25:34.9879715Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:34.9880462Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:34.9881403Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2025-03-14T06:25:34.9882457Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 14s local ... 2025-03-14T06:25:35.1916489Z 2025-03-14T06:25:35.1917335Z  2025-03-14T06:25:35.1917812Z  2025-03-14T06:25:35.1918238Z  2025-03-14T06:25:35.1918656Z  2025-03-14T06:25:35.1919031Z  2025-03-14T06:25:35.1919413Z  2025-03-14T06:25:35.1919796Z  2025-03-14T06:25:35.1920166Z  2025-03-14T06:25:35.1921077Z [11,510 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:35.1922072Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T06:25:35.1923842Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:35.1924701Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:25:35.1925441Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T06:25:35.1926137Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:35.1926835Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:35.1927637Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2025-03-14T06:25:35.1928583Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local ... 2025-03-14T06:25:35.3916566Z 2025-03-14T06:25:35.3917447Z  2025-03-14T06:25:35.3917932Z  2025-03-14T06:25:35.3918347Z  2025-03-14T06:25:35.3918754Z  2025-03-14T06:25:35.3919131Z  2025-03-14T06:25:35.3919537Z  2025-03-14T06:25:35.3919951Z  2025-03-14T06:25:35.3920366Z  2025-03-14T06:25:35.3921331Z [11,514 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:35.3923132Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T06:25:35.3923926Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:35.3924767Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:25:35.3925627Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T06:25:35.3926383Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:35.3927125Z Compiling src/cpu/simple_resampling.cpp; 16s local 2025-03-14T06:25:35.3928005Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2025-03-14T06:25:35.3928985Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local ... 2025-03-14T06:25:35.6451419Z 2025-03-14T06:25:35.6452294Z  2025-03-14T06:25:35.6452806Z  2025-03-14T06:25:35.6453267Z  2025-03-14T06:25:35.6453685Z  2025-03-14T06:25:35.6454108Z  2025-03-14T06:25:35.6454521Z  2025-03-14T06:25:35.6454965Z  2025-03-14T06:25:35.6455390Z  2025-03-14T06:25:35.6456351Z [11,515 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:35.6457453Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T06:25:35.6458313Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:35.6459412Z Compiling src/cpu/cpu_convolution_list.cpp; 27s local 2025-03-14T06:25:35.6460273Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T06:25:35.6461180Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:35.6462040Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T06:25:35.6462953Z Compiling src/cpu/x64/jit_avx512_core_amx_conv_kernel.cpp; 16s local 2025-03-14T06:25:35.6464147Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local ... 2025-03-14T06:25:35.9240946Z 2025-03-14T06:25:35.9241781Z  2025-03-14T06:25:35.9242293Z  2025-03-14T06:25:35.9242705Z  2025-03-14T06:25:35.9243169Z  2025-03-14T06:25:35.9243593Z  2025-03-14T06:25:35.9244020Z  2025-03-14T06:25:35.9244424Z  2025-03-14T06:25:35.9244996Z  2025-03-14T06:25:35.9245962Z [11,517 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:35.9246995Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T06:25:35.9247776Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T06:25:35.9248530Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T06:25:35.9249351Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T06:25:35.9250061Z Compiling src/cpu/rnn/ref_rnn.cpp; 19s local 2025-03-14T06:25:35.9250874Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T06:25:35.9251769Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 15s local 2025-03-14T06:25:35.9252524Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:36.1875260Z 2025-03-14T06:25:36.1876641Z  2025-03-14T06:25:36.1877134Z  2025-03-14T06:25:36.1877510Z  2025-03-14T06:25:36.1877895Z  2025-03-14T06:25:36.1878271Z  2025-03-14T06:25:36.1878668Z  2025-03-14T06:25:36.1879055Z  2025-03-14T06:25:36.1879447Z  2025-03-14T06:25:36.1880410Z [11,519 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:36.1881510Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T06:25:36.1882341Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T06:25:36.1883093Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T06:25:36.1883852Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T06:25:36.1884716Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:36.1885430Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T06:25:36.1886273Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:36.1887022Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:25:36.3925842Z 2025-03-14T06:25:36.3926677Z  2025-03-14T06:25:36.3927217Z  2025-03-14T06:25:36.3927661Z  2025-03-14T06:25:36.3928103Z  2025-03-14T06:25:36.3928540Z  2025-03-14T06:25:36.3928996Z  2025-03-14T06:25:36.3929447Z  2025-03-14T06:25:36.3929897Z  2025-03-14T06:25:36.3930929Z [11,523 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:36.3932096Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2025-03-14T06:25:36.3932842Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T06:25:36.3933622Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T06:25:36.3934480Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T06:25:36.3935287Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:36.3936053Z Compiling src/cpu/simple_resampling.cpp; 17s local 2025-03-14T06:25:36.3937073Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:36.3937887Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:36.6442446Z 2025-03-14T06:25:36.6443284Z  2025-03-14T06:25:36.6443791Z  2025-03-14T06:25:36.6444218Z  2025-03-14T06:25:36.6445057Z  2025-03-14T06:25:36.6445482Z  2025-03-14T06:25:36.6445891Z  2025-03-14T06:25:36.6446308Z  2025-03-14T06:25:36.6446719Z  2025-03-14T06:25:36.6447702Z [11,524 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:36.6448919Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2025-03-14T06:25:36.6449729Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T06:25:36.6450639Z Compiling src/cpu/cpu_convolution_list.cpp; 28s local 2025-03-14T06:25:36.6451444Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T06:25:36.6452189Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:36.6452947Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T06:25:36.6453826Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:36.6454620Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:36.9132328Z 2025-03-14T06:25:36.9133238Z  2025-03-14T06:25:36.9133719Z  2025-03-14T06:25:36.9134231Z  2025-03-14T06:25:36.9134750Z  2025-03-14T06:25:36.9135199Z  2025-03-14T06:25:36.9135583Z  2025-03-14T06:25:36.9136040Z  2025-03-14T06:25:36.9136511Z  2025-03-14T06:25:36.9137469Z [11,526 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:36.9138428Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2025-03-14T06:25:36.9139194Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T06:25:36.9139958Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:25:36.9141109Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T06:25:36.9141813Z Compiling src/cpu/rnn/ref_rnn.cpp; 20s local 2025-03-14T06:25:36.9142524Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T06:25:36.9143406Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:36.9144193Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:37.1359999Z 2025-03-14T06:25:37.1360858Z  2025-03-14T06:25:37.1361481Z  2025-03-14T06:25:37.1361850Z  2025-03-14T06:25:37.1362229Z  2025-03-14T06:25:37.1362598Z  2025-03-14T06:25:37.1363024Z  2025-03-14T06:25:37.1363410Z  2025-03-14T06:25:37.1363809Z  2025-03-14T06:25:37.1364868Z [11,527 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:37.1366157Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2025-03-14T06:25:37.1366886Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T06:25:37.1367671Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:25:37.1368493Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T06:25:37.1369223Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2025-03-14T06:25:37.1369926Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T06:25:37.1370758Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 16s local 2025-03-14T06:25:37.1371518Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:25:37.3933358Z 2025-03-14T06:25:37.3934208Z  2025-03-14T06:25:37.3934726Z  2025-03-14T06:25:37.3935188Z  2025-03-14T06:25:37.3935625Z  2025-03-14T06:25:37.3936062Z  2025-03-14T06:25:37.3936448Z  2025-03-14T06:25:37.3936860Z  2025-03-14T06:25:37.3937256Z  2025-03-14T06:25:37.3938291Z [11,531 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:37.3939375Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T06:25:37.3940155Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T06:25:37.3940928Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:25:37.3941758Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T06:25:37.3942520Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2025-03-14T06:25:37.3943636Z Compiling src/cpu/simple_resampling.cpp; 18s local 2025-03-14T06:25:37.3954356Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T06:25:37.3955201Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:25:37.5937816Z 2025-03-14T06:25:37.5938640Z  2025-03-14T06:25:37.5939171Z  2025-03-14T06:25:37.5939624Z  2025-03-14T06:25:37.5940073Z  2025-03-14T06:25:37.5940524Z  2025-03-14T06:25:37.5940968Z  2025-03-14T06:25:37.5941783Z  2025-03-14T06:25:37.5942254Z  2025-03-14T06:25:37.5943235Z [11,532 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:37.5944311Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T06:25:37.5945107Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T06:25:37.5945899Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:25:37.5946720Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T06:25:37.5947489Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2025-03-14T06:25:37.5948242Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T06:25:37.5949129Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T06:25:37.5949937Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:25:37.7989708Z 2025-03-14T06:25:37.7990644Z  2025-03-14T06:25:37.7991147Z  2025-03-14T06:25:37.7991563Z  2025-03-14T06:25:37.7991978Z  2025-03-14T06:25:37.7992425Z  2025-03-14T06:25:37.7992830Z  2025-03-14T06:25:37.7993216Z  2025-03-14T06:25:37.7993615Z  2025-03-14T06:25:37.7994810Z [11,534 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:37.7995860Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T06:25:37.7996665Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T06:25:37.7997459Z Compiling src/cpu/cpu_convolution_list.cpp; 29s local 2025-03-14T06:25:37.7998281Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T06:25:37.7999049Z Compiling src/cpu/rnn/ref_rnn.cpp; 21s local 2025-03-14T06:25:37.7999821Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T06:25:37.8000733Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T06:25:37.8001554Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:25:38.0092195Z 2025-03-14T06:25:38.0093015Z  2025-03-14T06:25:38.0093552Z  2025-03-14T06:25:38.0093996Z  2025-03-14T06:25:38.0094389Z  2025-03-14T06:25:38.0094790Z  2025-03-14T06:25:38.0095218Z  2025-03-14T06:25:38.0095643Z  2025-03-14T06:25:38.0096019Z  2025-03-14T06:25:38.0097018Z [11,536 / 20,650] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2025-03-14T06:25:38.0098058Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T06:25:38.0098854Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T06:25:38.0099634Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:25:38.0100460Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T06:25:38.0101256Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T06:25:38.0102027Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T06:25:38.0102910Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 17s local 2025-03-14T06:25:38.0103744Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:25:38.2953770Z 2025-03-14T06:25:38.2954644Z  2025-03-14T06:25:38.2955125Z  2025-03-14T06:25:38.2955533Z  2025-03-14T06:25:38.2955947Z  2025-03-14T06:25:38.2956347Z  2025-03-14T06:25:38.2956731Z  2025-03-14T06:25:38.2957127Z  2025-03-14T06:25:38.2957539Z  2025-03-14T06:25:38.2958463Z [11,538 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:38.2959793Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T06:25:38.2960583Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T06:25:38.2961346Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:25:38.2962261Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T06:25:38.2962979Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T06:25:38.2963674Z Compiling src/cpu/simple_resampling.cpp; 19s local 2025-03-14T06:25:38.2964784Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T06:25:38.2965743Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T06:25:38.4998449Z 2025-03-14T06:25:38.4999371Z  2025-03-14T06:25:38.4999897Z  2025-03-14T06:25:38.5000367Z  2025-03-14T06:25:38.5000831Z  2025-03-14T06:25:38.5001204Z  2025-03-14T06:25:38.5001585Z  2025-03-14T06:25:38.5001961Z  2025-03-14T06:25:38.5002331Z  2025-03-14T06:25:38.5003326Z [11,543 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:38.5004224Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T06:25:38.5005086Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:25:38.5005863Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T06:25:38.5006545Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T06:25:38.5007236Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T06:25:38.5008034Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T06:25:38.5009165Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 12s local 2025-03-14T06:25:38.5010101Z Compiling src/cpu/x64/jit_avx2_conv_kernel_f32.cpp; 10s local ... 2025-03-14T06:25:38.7394036Z 2025-03-14T06:25:38.7394865Z  2025-03-14T06:25:38.7395376Z  2025-03-14T06:25:38.7395798Z  2025-03-14T06:25:38.7396185Z  2025-03-14T06:25:38.7396578Z  2025-03-14T06:25:38.7396971Z  2025-03-14T06:25:38.7397360Z  2025-03-14T06:25:38.7397721Z  2025-03-14T06:25:38.7398694Z [11,544 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:38.7399774Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T06:25:38.7400521Z Compiling src/cpu/cpu_convolution_list.cpp; 30s local 2025-03-14T06:25:38.7401279Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T06:25:38.7402050Z Compiling src/cpu/rnn/ref_rnn.cpp; 22s local 2025-03-14T06:25:38.7402772Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T06:25:38.7403640Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T06:25:38.7404873Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 12s local 2025-03-14T06:25:38.7405919Z Compiling src/cpu/x64/jit_avx2_conv_kernel_f32.cpp; 11s local ... 2025-03-14T06:25:38.9948921Z 2025-03-14T06:25:38.9949811Z  2025-03-14T06:25:38.9950321Z  2025-03-14T06:25:38.9950751Z  2025-03-14T06:25:38.9951192Z  2025-03-14T06:25:38.9951622Z  2025-03-14T06:25:38.9952060Z  2025-03-14T06:25:38.9952487Z  2025-03-14T06:25:38.9952922Z  2025-03-14T06:25:38.9953952Z [11,545 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:38.9955027Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T06:25:38.9955886Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T06:25:38.9956785Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T06:25:38.9957615Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T06:25:38.9958434Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T06:25:38.9959391Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 18s local 2025-03-14T06:25:38.9960490Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 12s local 2025-03-14T06:25:38.9961892Z Compiling src/cpu/x64/jit_avx2_conv_kernel_f32.cpp; 11s local ... 2025-03-14T06:25:39.3954854Z 2025-03-14T06:25:39.3955684Z  2025-03-14T06:25:39.3956198Z  2025-03-14T06:25:39.3956608Z  2025-03-14T06:25:39.3957029Z  2025-03-14T06:25:39.3957748Z  2025-03-14T06:25:39.3958139Z  2025-03-14T06:25:39.3958516Z  2025-03-14T06:25:39.3958876Z  2025-03-14T06:25:39.3959992Z [11,547 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:39.3960973Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T06:25:39.3961787Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T06:25:39.3962600Z Compiling src/cpu/simple_resampling.cpp; 30s local 2025-03-14T06:25:39.3963354Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T06:25:39.3964222Z Compiling src/cpu/simple_resampling.cpp; 20s local 2025-03-14T06:25:39.3965561Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T06:25:39.3966573Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 13s local 2025-03-14T06:25:39.3967607Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local ... 2025-03-14T06:25:39.7960592Z 2025-03-14T06:25:39.7961491Z  2025-03-14T06:25:39.7961978Z  2025-03-14T06:25:39.7962387Z  2025-03-14T06:25:39.7962849Z  2025-03-14T06:25:39.7963287Z  2025-03-14T06:25:39.7963702Z  2025-03-14T06:25:39.7964125Z  2025-03-14T06:25:39.7964747Z  2025-03-14T06:25:39.7966009Z [11,549 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:39.7967291Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T06:25:39.7968114Z Compiling src/cpu/cpu_convolution_list.cpp; 31s local 2025-03-14T06:25:39.7968979Z Compiling src/cpu/simple_resampling.cpp; 30s local 2025-03-14T06:25:39.7969689Z Compiling src/cpu/rnn/ref_rnn.cpp; 23s local 2025-03-14T06:25:39.7970435Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T06:25:39.7971296Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T06:25:39.7972307Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 13s local 2025-03-14T06:25:39.7973348Z Compiling src/cpu/cpu_inner_product_list.cpp; 11s local ... 2025-03-14T06:25:39.9965937Z 2025-03-14T06:25:39.9966834Z  2025-03-14T06:25:39.9967297Z  2025-03-14T06:25:39.9967684Z  2025-03-14T06:25:39.9968131Z  2025-03-14T06:25:39.9968542Z  2025-03-14T06:25:39.9968962Z  2025-03-14T06:25:39.9969380Z  2025-03-14T06:25:39.9969820Z  2025-03-14T06:25:39.9970819Z [11,550 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:39.9971804Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T06:25:39.9972616Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T06:25:39.9973495Z Compiling src/cpu/simple_resampling.cpp; 30s local 2025-03-14T06:25:39.9974281Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T06:25:39.9975047Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T06:25:39.9975963Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 19s local 2025-03-14T06:25:39.9977000Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 13s local 2025-03-14T06:25:39.9978024Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local ... 2025-03-14T06:25:40.3684621Z 2025-03-14T06:25:40.3685821Z  2025-03-14T06:25:40.3686319Z  2025-03-14T06:25:40.3686711Z  2025-03-14T06:25:40.3687108Z  2025-03-14T06:25:40.3687525Z  2025-03-14T06:25:40.3687912Z  2025-03-14T06:25:40.3688303Z  2025-03-14T06:25:40.3688699Z  2025-03-14T06:25:40.3689637Z [11,553 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:40.3690893Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T06:25:40.3691675Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T06:25:40.3692374Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T06:25:40.3693119Z Compiling src/cpu/simple_resampling.cpp; 21s local 2025-03-14T06:25:40.3694143Z Compiling src/cpu/x64/brgemm/jit_brgemm_kernel.cpp; 20s local 2025-03-14T06:25:40.3695119Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 14s local 2025-03-14T06:25:40.3696184Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2025-03-14T06:25:40.3696752Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:40.5972586Z 2025-03-14T06:25:40.5973479Z  2025-03-14T06:25:40.5973973Z  2025-03-14T06:25:40.5974380Z  2025-03-14T06:25:40.5974786Z  2025-03-14T06:25:40.5975226Z  2025-03-14T06:25:40.5975631Z  2025-03-14T06:25:40.5976013Z  2025-03-14T06:25:40.5976424Z  2025-03-14T06:25:40.5977384Z [11,556 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:40.5978379Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T06:25:40.5979168Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T06:25:40.5979925Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T06:25:40.5980681Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T06:25:40.5981628Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 14s local 2025-03-14T06:25:40.5982626Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2025-03-14T06:25:40.5983375Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:40.5984259Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:40.7977578Z 2025-03-14T06:25:40.7978382Z  2025-03-14T06:25:40.7978880Z  2025-03-14T06:25:40.7979317Z  2025-03-14T06:25:40.7979753Z  2025-03-14T06:25:40.7980180Z  2025-03-14T06:25:40.7980598Z  2025-03-14T06:25:40.7981060Z  2025-03-14T06:25:40.7981465Z  2025-03-14T06:25:40.7982449Z [11,560 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:40.7983484Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T06:25:40.7984297Z Compiling src/cpu/cpu_convolution_list.cpp; 32s local 2025-03-14T06:25:40.7985092Z Compiling src/cpu/rnn/ref_rnn.cpp; 24s local 2025-03-14T06:25:40.7985867Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T06:25:40.7986845Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 14s local 2025-03-14T06:25:40.7987849Z Compiling src/cpu/cpu_inner_product_list.cpp; 12s local 2025-03-14T06:25:40.7988628Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:25:40.7989203Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:41.0642204Z 2025-03-14T06:25:41.0643037Z  2025-03-14T06:25:41.0643551Z  2025-03-14T06:25:41.0643992Z  2025-03-14T06:25:41.0644429Z  2025-03-14T06:25:41.0645042Z  2025-03-14T06:25:41.0645472Z  2025-03-14T06:25:41.0645894Z  2025-03-14T06:25:41.0646339Z  2025-03-14T06:25:41.0647297Z [11,563 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:41.0648296Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T06:25:41.0649101Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T06:25:41.0649905Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:41.0650730Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T06:25:41.0651698Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 14s local 2025-03-14T06:25:41.0652721Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:25:41.0653467Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:41.0654053Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:41.3008363Z 2025-03-14T06:25:41.3009271Z  2025-03-14T06:25:41.3010055Z  2025-03-14T06:25:41.3010471Z  2025-03-14T06:25:41.3010886Z  2025-03-14T06:25:41.3011315Z  2025-03-14T06:25:41.3011724Z  2025-03-14T06:25:41.3012115Z  2025-03-14T06:25:41.3012526Z  2025-03-14T06:25:41.3013507Z [11,566 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:41.3014767Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T06:25:41.3015538Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T06:25:41.3016438Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:41.3017193Z Compiling src/cpu/simple_resampling.cpp; 22s local 2025-03-14T06:25:41.3018124Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local 2025-03-14T06:25:41.3019089Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:25:41.3019815Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:41.3020372Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:41.5984432Z 2025-03-14T06:25:41.5985297Z  2025-03-14T06:25:41.5985817Z  2025-03-14T06:25:41.5986202Z  2025-03-14T06:25:41.5986633Z  2025-03-14T06:25:41.5987051Z  2025-03-14T06:25:41.5987449Z  2025-03-14T06:25:41.5987859Z  2025-03-14T06:25:41.5988303Z  2025-03-14T06:25:41.5989284Z [11,566 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:41.5990268Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T06:25:41.5991083Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T06:25:41.5991886Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:41.5992905Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T06:25:41.5993960Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local 2025-03-14T06:25:41.5994892Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:25:41.5995601Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:41.5996161Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:41.8214010Z 2025-03-14T06:25:41.8214887Z  2025-03-14T06:25:41.8215375Z  2025-03-14T06:25:41.8215748Z  2025-03-14T06:25:41.8216267Z  2025-03-14T06:25:41.8216805Z  2025-03-14T06:25:41.8217322Z  2025-03-14T06:25:41.8217826Z  2025-03-14T06:25:41.8218250Z  2025-03-14T06:25:41.8219274Z [11,573 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:41.8220221Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T06:25:41.8220898Z Compiling src/cpu/cpu_convolution_list.cpp; 33s local 2025-03-14T06:25:41.8221655Z Compiling src/cpu/rnn/ref_rnn.cpp; 25s local 2025-03-14T06:25:41.8222443Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T06:25:41.8224079Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local 2025-03-14T06:25:41.8225047Z Compiling src/cpu/cpu_inner_product_list.cpp; 13s local 2025-03-14T06:25:41.8225788Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:25:41.8226328Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:42.0701406Z 2025-03-14T06:25:42.0702312Z  2025-03-14T06:25:42.0702787Z  2025-03-14T06:25:42.0703238Z  2025-03-14T06:25:42.0703653Z  2025-03-14T06:25:42.0704062Z  2025-03-14T06:25:42.0704482Z  2025-03-14T06:25:42.0704895Z  2025-03-14T06:25:42.0705331Z  2025-03-14T06:25:42.0706330Z [11,577 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:42.0707333Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T06:25:42.0708113Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:42.0708869Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T06:25:42.0709611Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T06:25:42.0710580Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local 2025-03-14T06:25:42.0711779Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2025-03-14T06:25:42.0712462Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:42.0712988Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:42.2734261Z 2025-03-14T06:25:42.2735044Z  2025-03-14T06:25:42.2735523Z  2025-03-14T06:25:42.2735916Z  2025-03-14T06:25:42.2736320Z  2025-03-14T06:25:42.2736725Z  2025-03-14T06:25:42.2737140Z  2025-03-14T06:25:42.2737839Z  2025-03-14T06:25:42.2738234Z  2025-03-14T06:25:42.2739217Z [11,578 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:42.2740195Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T06:25:42.2740979Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:42.2741713Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T06:25:42.2742435Z Compiling src/cpu/simple_resampling.cpp; 23s local 2025-03-14T06:25:42.2743324Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T06:25:42.2744323Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2025-03-14T06:25:42.2745057Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:42.2745635Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:42.5237520Z 2025-03-14T06:25:42.5238397Z  2025-03-14T06:25:42.5238889Z  2025-03-14T06:25:42.5239302Z  2025-03-14T06:25:42.5239728Z  2025-03-14T06:25:42.5240175Z  2025-03-14T06:25:42.5240591Z  2025-03-14T06:25:42.5241030Z  2025-03-14T06:25:42.5241449Z  2025-03-14T06:25:42.5242677Z [11,583 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:42.5243639Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T06:25:42.5244413Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:42.5245241Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T06:25:42.5246002Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T06:25:42.5246804Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T06:25:42.5247697Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2025-03-14T06:25:42.5248446Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:42.5248910Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:25:42.7993908Z 2025-03-14T06:25:42.7994816Z  2025-03-14T06:25:42.7995313Z  2025-03-14T06:25:42.7995762Z  2025-03-14T06:25:42.7996149Z  2025-03-14T06:25:42.7996564Z  2025-03-14T06:25:42.7996948Z  2025-03-14T06:25:42.7997373Z  2025-03-14T06:25:42.7997802Z  2025-03-14T06:25:42.7998790Z [11,584 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:42.7999809Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T06:25:42.8000603Z Compiling src/cpu/cpu_convolution_list.cpp; 34s local 2025-03-14T06:25:42.8001525Z Compiling src/cpu/rnn/ref_rnn.cpp; 26s local 2025-03-14T06:25:42.8002298Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T06:25:42.8003219Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T06:25:42.8004213Z Compiling src/cpu/cpu_inner_product_list.cpp; 14s local 2025-03-14T06:25:42.8005147Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:42.8005907Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 8s local ... 2025-03-14T06:25:42.9998388Z 2025-03-14T06:25:42.9999180Z  2025-03-14T06:25:42.9999697Z  2025-03-14T06:25:43.0000140Z  2025-03-14T06:25:43.0000619Z  2025-03-14T06:25:43.0001027Z  2025-03-14T06:25:43.0001465Z  2025-03-14T06:25:43.0001874Z  2025-03-14T06:25:43.0002274Z  2025-03-14T06:25:43.0003258Z [11,585 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:43.0004801Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T06:25:43.0005645Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T06:25:43.0006445Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:43.0007410Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T06:25:43.0008402Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T06:25:43.0009434Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2025-03-14T06:25:43.0010308Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:43.0011133Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 8s local ... 2025-03-14T06:25:43.3499655Z 2025-03-14T06:25:43.3500532Z  2025-03-14T06:25:43.3501002Z  2025-03-14T06:25:43.3501368Z  2025-03-14T06:25:43.3501757Z  2025-03-14T06:25:43.3502146Z  2025-03-14T06:25:43.3502552Z  2025-03-14T06:25:43.3502945Z  2025-03-14T06:25:43.3503343Z  2025-03-14T06:25:43.3504310Z [11,589 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:43.3505284Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T06:25:43.3506059Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T06:25:43.3506828Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:43.3507579Z Compiling src/cpu/simple_resampling.cpp; 24s local 2025-03-14T06:25:43.3508512Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:25:43.3509487Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2025-03-14T06:25:43.3510472Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:25:43.3511254Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 8s local ... 2025-03-14T06:25:43.6010631Z 2025-03-14T06:25:43.6011267Z  2025-03-14T06:25:43.6011731Z  2025-03-14T06:25:43.6012150Z  2025-03-14T06:25:43.6012525Z  2025-03-14T06:25:43.6012929Z  2025-03-14T06:25:43.6013322Z  2025-03-14T06:25:43.6013721Z  2025-03-14T06:25:43.6014116Z  2025-03-14T06:25:43.6015093Z [11,589 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:43.6016131Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T06:25:43.6016927Z Compiling src/cpu/cpu_convolution_list.cpp; 35s local 2025-03-14T06:25:43.6017704Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:43.6018419Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T06:25:43.6019339Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:25:43.6020294Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2025-03-14T06:25:43.6021006Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:25:43.6021725Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 9s local ... 2025-03-14T06:25:43.8760448Z 2025-03-14T06:25:43.8761324Z  2025-03-14T06:25:43.8761864Z  2025-03-14T06:25:43.8762303Z  2025-03-14T06:25:43.8762714Z  2025-03-14T06:25:43.8763148Z  2025-03-14T06:25:43.8763573Z  2025-03-14T06:25:43.8764000Z  2025-03-14T06:25:43.8764425Z  2025-03-14T06:25:43.8765802Z [11,593 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:43.8766876Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T06:25:43.8767686Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T06:25:43.8768500Z Compiling src/cpu/rnn/ref_rnn.cpp; 27s local 2025-03-14T06:25:43.8769275Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T06:25:43.8770236Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:25:43.8771250Z Compiling src/cpu/cpu_inner_product_list.cpp; 15s local 2025-03-14T06:25:43.8772212Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 9s local 2025-03-14T06:25:43.8773258Z Compiling src/cpu/cpu_lrn_list.cpp; 8s local ... 2025-03-14T06:25:44.2011517Z 2025-03-14T06:25:44.2012448Z  2025-03-14T06:25:44.2012866Z  2025-03-14T06:25:44.2013205Z  2025-03-14T06:25:44.2013554Z  2025-03-14T06:25:44.2013891Z  2025-03-14T06:25:44.2014482Z  2025-03-14T06:25:44.2014817Z  2025-03-14T06:25:44.2015151Z  2025-03-14T06:25:44.2015940Z [11,594 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:44.2016867Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T06:25:44.2017512Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T06:25:44.2018171Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T06:25:44.2018821Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T06:25:44.2019577Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:25:44.2020343Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:25:44.2021093Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 9s local 2025-03-14T06:25:44.2021811Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local ... 2025-03-14T06:25:44.4016440Z 2025-03-14T06:25:44.4017276Z  2025-03-14T06:25:44.4017807Z  2025-03-14T06:25:44.4018216Z  2025-03-14T06:25:44.4018609Z  2025-03-14T06:25:44.4019014Z  2025-03-14T06:25:44.4019423Z  2025-03-14T06:25:44.4019808Z  2025-03-14T06:25:44.4020182Z  2025-03-14T06:25:44.4021134Z [11,595 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:44.4022319Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T06:25:44.4023080Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T06:25:44.4024673Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T06:25:44.4025403Z Compiling src/cpu/simple_resampling.cpp; 25s local 2025-03-14T06:25:44.4026284Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2025-03-14T06:25:44.4027173Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:25:44.4028059Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 9s local 2025-03-14T06:25:44.4028918Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local ... 2025-03-14T06:25:44.7229554Z 2025-03-14T06:25:44.7230412Z  2025-03-14T06:25:44.7230889Z  2025-03-14T06:25:44.7231297Z  2025-03-14T06:25:44.7231672Z  2025-03-14T06:25:44.7232063Z  2025-03-14T06:25:44.7232424Z  2025-03-14T06:25:44.7232811Z  2025-03-14T06:25:44.7233188Z  2025-03-14T06:25:44.7234078Z [11,597 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:44.7234981Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T06:25:44.7235698Z Compiling src/cpu/cpu_convolution_list.cpp; 36s local 2025-03-14T06:25:44.7236417Z Compiling src/cpu/rnn/ref_rnn.cpp; 28s local 2025-03-14T06:25:44.7237135Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T06:25:44.7237978Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2025-03-14T06:25:44.7238844Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:25:44.7239671Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 10s local 2025-03-14T06:25:44.7240491Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local ... 2025-03-14T06:25:44.9253526Z 2025-03-14T06:25:44.9254330Z  2025-03-14T06:25:44.9254864Z  2025-03-14T06:25:44.9255271Z  2025-03-14T06:25:44.9255685Z  2025-03-14T06:25:44.9256088Z  2025-03-14T06:25:44.9256466Z  2025-03-14T06:25:44.9256863Z  2025-03-14T06:25:44.9257236Z  2025-03-14T06:25:44.9258164Z [11,598 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:44.9259085Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T06:25:44.9260151Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T06:25:44.9260900Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:44.9261626Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T06:25:44.9262541Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2025-03-14T06:25:44.9263654Z Compiling src/cpu/cpu_inner_product_list.cpp; 16s local 2025-03-14T06:25:44.9264552Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 10s local 2025-03-14T06:25:44.9265807Z Compiling src/cpu/cpu_lrn_list.cpp; 9s local ... 2025-03-14T06:25:45.2024870Z 2025-03-14T06:25:45.2025707Z  2025-03-14T06:25:45.2026216Z  2025-03-14T06:25:45.2026646Z  2025-03-14T06:25:45.2027054Z  2025-03-14T06:25:45.2027474Z  2025-03-14T06:25:45.2027854Z  2025-03-14T06:25:45.2028223Z  2025-03-14T06:25:45.2028604Z  2025-03-14T06:25:45.2029497Z [11,600 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:45.2030402Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T06:25:45.2031146Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T06:25:45.2031873Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:45.2032539Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T06:25:45.2033382Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 18s local 2025-03-14T06:25:45.2034320Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2025-03-14T06:25:45.2035196Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 10s local 2025-03-14T06:25:45.2036508Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local ... 2025-03-14T06:25:45.4026181Z 2025-03-14T06:25:45.4026973Z  2025-03-14T06:25:45.4027455Z  2025-03-14T06:25:45.4027848Z  2025-03-14T06:25:45.4028240Z  2025-03-14T06:25:45.4028620Z  2025-03-14T06:25:45.4029008Z  2025-03-14T06:25:45.4029542Z  2025-03-14T06:25:45.4029945Z  2025-03-14T06:25:45.4030883Z [11,601 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:45.4031862Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T06:25:45.4032653Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T06:25:45.4033382Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:45.4034097Z Compiling src/cpu/simple_resampling.cpp; 26s local 2025-03-14T06:25:45.4035028Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 19s local 2025-03-14T06:25:45.4035977Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2025-03-14T06:25:45.4036879Z Compiling src/cpu/x64/jit_brgemm_transpose_utils.cpp; 10s local 2025-03-14T06:25:45.4037803Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local ... 2025-03-14T06:25:45.8030975Z 2025-03-14T06:25:45.8031796Z  2025-03-14T06:25:45.8032316Z  2025-03-14T06:25:45.8032740Z  2025-03-14T06:25:45.8033166Z  2025-03-14T06:25:45.8033569Z  2025-03-14T06:25:45.8033979Z  2025-03-14T06:25:45.8034384Z  2025-03-14T06:25:45.8034794Z  2025-03-14T06:25:45.8035762Z [11,604 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:45.8036765Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T06:25:45.8037492Z Compiling src/cpu/cpu_convolution_list.cpp; 37s local 2025-03-14T06:25:45.8038270Z Compiling src/cpu/rnn/ref_rnn.cpp; 29s local 2025-03-14T06:25:45.8039029Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T06:25:45.8039882Z Compiling src/cpu/cpu_inner_product_list.cpp; 17s local 2025-03-14T06:25:45.8040755Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 8s local 2025-03-14T06:25:45.8041588Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 8s local 2025-03-14T06:25:45.8042408Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 8s local ... 2025-03-14T06:25:46.0874415Z 2025-03-14T06:25:46.0875210Z  2025-03-14T06:25:46.0875690Z  2025-03-14T06:25:46.0876113Z  2025-03-14T06:25:46.0876522Z  2025-03-14T06:25:46.3954153Z  2025-03-14T06:25:46.3954987Z  2025-03-14T06:25:46.3955415Z  2025-03-14T06:25:46.3955823Z  2025-03-14T06:25:46.3956808Z [11,606 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:46.3957986Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T06:25:46.3958801Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T06:25:46.3959618Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T06:25:46.3960387Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T06:25:46.3961218Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2025-03-14T06:25:46.3962097Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2025-03-14T06:25:46.3962986Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 8s local 2025-03-14T06:25:46.3963963Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 8s local ... 2025-03-14T06:25:46.3964796Z 2025-03-14T06:25:46.3966264Z  2025-03-14T06:25:46.3966957Z  2025-03-14T06:25:46.3967671Z  2025-03-14T06:25:46.3968314Z  2025-03-14T06:25:46.3968895Z  2025-03-14T06:25:46.3971134Z  2025-03-14T06:25:46.3971782Z  2025-03-14T06:25:46.3972381Z  2025-03-14T06:25:46.3973538Z [11,609 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:46.4063112Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T06:25:46.4063994Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T06:25:46.4064787Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T06:25:46.4065842Z Compiling src/cpu/simple_resampling.cpp; 27s local 2025-03-14T06:25:46.4066668Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2025-03-14T06:25:46.4067546Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2025-03-14T06:25:46.4068419Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 9s local 2025-03-14T06:25:46.4069331Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 9s local ... 2025-03-14T06:25:46.6038331Z 2025-03-14T06:25:46.6039227Z  2025-03-14T06:25:46.6039705Z  2025-03-14T06:25:46.6040119Z  2025-03-14T06:25:46.6040524Z  2025-03-14T06:25:46.6040910Z  2025-03-14T06:25:46.6041352Z  2025-03-14T06:25:46.6041744Z  2025-03-14T06:25:46.6042154Z  2025-03-14T06:25:46.6043188Z [11,609 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:46.6044194Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T06:25:46.6045154Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T06:25:46.6045958Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T06:25:46.6046760Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T06:25:46.6047622Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2025-03-14T06:25:46.6048523Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2025-03-14T06:25:46.6049482Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 9s local 2025-03-14T06:25:46.6050477Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 9s local ... 2025-03-14T06:25:46.8046672Z 2025-03-14T06:25:46.8047490Z  2025-03-14T06:25:46.8048048Z  2025-03-14T06:25:46.8048474Z  2025-03-14T06:25:46.8048905Z  2025-03-14T06:25:46.8049346Z  2025-03-14T06:25:46.8049788Z  2025-03-14T06:25:46.8050217Z  2025-03-14T06:25:46.8050643Z  2025-03-14T06:25:46.8051664Z [11,612 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:46.8052733Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T06:25:46.8053937Z Compiling src/cpu/cpu_convolution_list.cpp; 38s local 2025-03-14T06:25:46.8054749Z Compiling src/cpu/rnn/ref_rnn.cpp; 30s local 2025-03-14T06:25:46.8055505Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T06:25:46.8056352Z Compiling src/cpu/cpu_inner_product_list.cpp; 18s local 2025-03-14T06:25:46.8057594Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 9s local 2025-03-14T06:25:46.8058498Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 9s local 2025-03-14T06:25:46.8059583Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 9s local ... 2025-03-14T06:25:47.0389425Z 2025-03-14T06:25:47.0390254Z  2025-03-14T06:25:47.0390724Z  2025-03-14T06:25:47.0391215Z  2025-03-14T06:25:47.0391613Z  2025-03-14T06:25:47.0392013Z  2025-03-14T06:25:47.0392515Z  2025-03-14T06:25:47.0392902Z  2025-03-14T06:25:47.0393284Z  2025-03-14T06:25:47.0394198Z [11,616 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:47.0395171Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T06:25:47.0395951Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T06:25:47.0396692Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T06:25:47.0397450Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T06:25:47.0398268Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2025-03-14T06:25:47.0399099Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2025-03-14T06:25:47.0400061Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 9s local 2025-03-14T06:25:47.0401230Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 9s local ... 2025-03-14T06:25:47.3106886Z 2025-03-14T06:25:47.3107792Z  2025-03-14T06:25:47.3108310Z  2025-03-14T06:25:47.3108754Z  2025-03-14T06:25:47.3109190Z  2025-03-14T06:25:47.3109604Z  2025-03-14T06:25:47.3110006Z  2025-03-14T06:25:47.3110412Z  2025-03-14T06:25:47.3110862Z  2025-03-14T06:25:47.3111826Z [11,619 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:47.3112798Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T06:25:47.3113611Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T06:25:47.3114419Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T06:25:47.3115193Z Compiling src/cpu/simple_resampling.cpp; 28s local 2025-03-14T06:25:47.3116050Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2025-03-14T06:25:47.3116959Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2025-03-14T06:25:47.3117921Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 10s local 2025-03-14T06:25:47.3118832Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 10s local ... 2025-03-14T06:25:47.5136711Z 2025-03-14T06:25:47.5137552Z  2025-03-14T06:25:47.5138083Z  2025-03-14T06:25:47.5138504Z  2025-03-14T06:25:47.5138934Z  2025-03-14T06:25:47.5139366Z  2025-03-14T06:25:47.5139784Z  2025-03-14T06:25:47.5140179Z  2025-03-14T06:25:47.5140599Z  2025-03-14T06:25:47.5141624Z [11,620 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:47.5142670Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T06:25:47.5143511Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T06:25:47.5144323Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T06:25:47.5145154Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T06:25:47.5146011Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2025-03-14T06:25:47.5146941Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2025-03-14T06:25:47.5147870Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 10s local 2025-03-14T06:25:47.5148832Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 10s local ... 2025-03-14T06:25:47.7238268Z 2025-03-14T06:25:47.7239105Z  2025-03-14T06:25:47.7239595Z  2025-03-14T06:25:47.7240003Z  2025-03-14T06:25:47.7240441Z  2025-03-14T06:25:47.7240884Z  2025-03-14T06:25:47.7241310Z  2025-03-14T06:25:47.7241754Z  2025-03-14T06:25:47.7242481Z  2025-03-14T06:25:47.7243447Z [11,624 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:47.7244597Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T06:25:47.7245584Z Compiling src/cpu/cpu_convolution_list.cpp; 39s local 2025-03-14T06:25:47.7246397Z Compiling src/cpu/rnn/ref_rnn.cpp; 31s local 2025-03-14T06:25:47.7247192Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T06:25:47.7248067Z Compiling src/cpu/cpu_inner_product_list.cpp; 19s local 2025-03-14T06:25:47.7249007Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 10s local 2025-03-14T06:25:47.7249904Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 10s local 2025-03-14T06:25:47.7250882Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 10s local ... 2025-03-14T06:25:48.0056883Z 2025-03-14T06:25:48.0057739Z  2025-03-14T06:25:48.0058240Z  2025-03-14T06:25:48.0058682Z  2025-03-14T06:25:48.0059143Z  2025-03-14T06:25:48.0059577Z  2025-03-14T06:25:48.0060014Z  2025-03-14T06:25:48.0060446Z  2025-03-14T06:25:48.0060877Z  2025-03-14T06:25:48.0061883Z [11,627 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:48.0062905Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T06:25:48.0063941Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T06:25:48.0064752Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T06:25:48.0065818Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T06:25:48.0066702Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:25:48.0067667Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T06:25:48.0068600Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 10s local 2025-03-14T06:25:48.0069603Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 10s local ... 2025-03-14T06:25:48.2733810Z 2025-03-14T06:25:48.2734736Z  2025-03-14T06:25:48.2735272Z  2025-03-14T06:25:48.2735595Z  2025-03-14T06:25:48.2736040Z  2025-03-14T06:25:48.2736453Z  2025-03-14T06:25:48.2736792Z  2025-03-14T06:25:48.2737204Z  2025-03-14T06:25:48.2737661Z  2025-03-14T06:25:48.2738554Z [11,630 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:48.2739536Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T06:25:48.2740341Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T06:25:48.2741121Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T06:25:48.2741780Z Compiling src/cpu/simple_resampling.cpp; 29s local 2025-03-14T06:25:48.2742655Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:25:48.2743519Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T06:25:48.2744412Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 11s local 2025-03-14T06:25:48.2745361Z Compiling src/cpu/x64/gemm_bf16_inner_product.cpp; 11s local ... 2025-03-14T06:25:48.6063594Z 2025-03-14T06:25:48.6064454Z  2025-03-14T06:25:48.6064956Z  2025-03-14T06:25:48.6065601Z  2025-03-14T06:25:48.6066083Z  2025-03-14T06:25:48.6066527Z  2025-03-14T06:25:48.6066967Z  2025-03-14T06:25:48.6067385Z  2025-03-14T06:25:48.6067791Z  2025-03-14T06:25:48.6068811Z [11,632 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:48.6069829Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T06:25:48.6070652Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T06:25:48.6071698Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T06:25:48.6072460Z Compiling src/cpu/simple_resampling.cpp; 30s local 2025-03-14T06:25:48.6073336Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:25:48.6074401Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T06:25:48.6075273Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 11s local 2025-03-14T06:25:48.6076283Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local ... 2025-03-14T06:25:48.8068325Z 2025-03-14T06:25:48.8069232Z  2025-03-14T06:25:48.8069805Z  2025-03-14T06:25:48.8070308Z  2025-03-14T06:25:48.8080763Z  2025-03-14T06:25:48.8081684Z  2025-03-14T06:25:48.8082088Z  2025-03-14T06:25:48.8082486Z  2025-03-14T06:25:48.8082921Z  2025-03-14T06:25:48.8083892Z [11,633 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:48.8085048Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T06:25:48.8085829Z Compiling src/cpu/cpu_convolution_list.cpp; 40s local 2025-03-14T06:25:48.8086722Z Compiling src/cpu/rnn/ref_rnn.cpp; 32s local 2025-03-14T06:25:48.8087455Z Compiling src/cpu/simple_resampling.cpp; 30s local 2025-03-14T06:25:48.8088320Z Compiling src/cpu/cpu_inner_product_list.cpp; 20s local 2025-03-14T06:25:48.8089297Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 11s local 2025-03-14T06:25:48.8090197Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 11s local 2025-03-14T06:25:48.8091275Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local ... 2025-03-14T06:25:49.0615970Z 2025-03-14T06:25:49.0616879Z  2025-03-14T06:25:49.0617407Z  2025-03-14T06:25:49.0617802Z  2025-03-14T06:25:49.0618184Z  2025-03-14T06:25:49.0618602Z  2025-03-14T06:25:49.0619125Z  2025-03-14T06:25:49.0619498Z  2025-03-14T06:25:49.0619906Z  2025-03-14T06:25:49.0620888Z [11,639 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:49.0621855Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T06:25:49.0622606Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T06:25:49.0623410Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T06:25:49.0624153Z Compiling src/cpu/simple_resampling.cpp; 30s local 2025-03-14T06:25:49.0624937Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T06:25:49.0625989Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T06:25:49.0626865Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 11s local 2025-03-14T06:25:49.0627860Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local ... 2025-03-14T06:25:49.4082629Z 2025-03-14T06:25:49.4083522Z  2025-03-14T06:25:49.4084011Z  2025-03-14T06:25:49.4084408Z  2025-03-14T06:25:49.4084902Z  2025-03-14T06:25:49.4085339Z  2025-03-14T06:25:49.4085744Z  2025-03-14T06:25:49.4086139Z  2025-03-14T06:25:49.4086539Z  2025-03-14T06:25:49.4087499Z [11,643 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:49.4088480Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T06:25:49.4089249Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T06:25:49.4090005Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T06:25:49.4090834Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T06:25:49.4091701Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T06:25:49.4092550Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 12s local 2025-03-14T06:25:49.4093511Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 11s local 2025-03-14T06:25:49.4094452Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:49.6099859Z 2025-03-14T06:25:49.6100971Z  2025-03-14T06:25:49.6101460Z  2025-03-14T06:25:49.6101892Z  2025-03-14T06:25:49.6102332Z  2025-03-14T06:25:49.6102750Z  2025-03-14T06:25:49.6103138Z  2025-03-14T06:25:49.6103537Z  2025-03-14T06:25:49.6103960Z  2025-03-14T06:25:49.6105168Z [11,644 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:49.6106149Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T06:25:49.6107069Z Compiling src/cpu/cpu_convolution_list.cpp; 41s local 2025-03-14T06:25:49.6107897Z Compiling src/cpu/rnn/ref_rnn.cpp; 33s local 2025-03-14T06:25:49.6108695Z Compiling src/cpu/cpu_inner_product_list.cpp; 21s local 2025-03-14T06:25:49.6109548Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 12s local 2025-03-14T06:25:49.6110471Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 12s local 2025-03-14T06:25:49.6111435Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2025-03-14T06:25:49.6112336Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:50.0080502Z 2025-03-14T06:25:50.0081408Z  2025-03-14T06:25:50.0081986Z  2025-03-14T06:25:50.0082468Z  2025-03-14T06:25:50.0082936Z  2025-03-14T06:25:50.0083381Z  2025-03-14T06:25:50.0083881Z  2025-03-14T06:25:50.0084348Z  2025-03-14T06:25:50.0084935Z  2025-03-14T06:25:50.0085954Z [11,644 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:50.0087017Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T06:25:50.0087848Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T06:25:50.0088898Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T06:25:50.0089770Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T06:25:50.0090704Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T06:25:50.0091763Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 12s local 2025-03-14T06:25:50.0092830Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2025-03-14T06:25:50.0093786Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:25:50.2085469Z 2025-03-14T06:25:50.2086347Z  2025-03-14T06:25:50.2086899Z  2025-03-14T06:25:50.2087314Z  2025-03-14T06:25:50.2087740Z  2025-03-14T06:25:50.2088152Z  2025-03-14T06:25:50.2088560Z  2025-03-14T06:25:50.2088979Z  2025-03-14T06:25:50.2089395Z  2025-03-14T06:25:50.2090369Z [11,646 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:50.2091381Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T06:25:50.2092178Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T06:25:50.2092989Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T06:25:50.2093807Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T06:25:50.2094744Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T06:25:50.2095656Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 12s local 2025-03-14T06:25:50.2096681Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local 2025-03-14T06:25:50.2097626Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:50.5308403Z 2025-03-14T06:25:50.5309230Z  2025-03-14T06:25:50.5309743Z  2025-03-14T06:25:50.5310181Z  2025-03-14T06:25:50.5310594Z  2025-03-14T06:25:50.5310992Z  2025-03-14T06:25:50.5311442Z  2025-03-14T06:25:50.5311858Z  2025-03-14T06:25:50.5312279Z  2025-03-14T06:25:50.5313249Z [11,648 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:50.5314243Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T06:25:50.5315052Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T06:25:50.5315839Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T06:25:50.5316921Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T06:25:50.5317828Z Compiling src/cpu/x64/gemm_bf16_convolution.cpp; 13s local 2025-03-14T06:25:50.5318771Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local 2025-03-14T06:25:50.5319933Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T06:25:50.5320741Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:25:50.7658141Z 2025-03-14T06:25:50.7658970Z  2025-03-14T06:25:50.7659727Z  2025-03-14T06:25:50.7660176Z  2025-03-14T06:25:50.7660584Z  2025-03-14T06:25:50.7660985Z  2025-03-14T06:25:50.7661459Z  2025-03-14T06:25:50.7661885Z  2025-03-14T06:25:50.7662280Z  2025-03-14T06:25:50.7663269Z [11,652 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:50.7664273Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T06:25:50.7665078Z Compiling src/cpu/cpu_convolution_list.cpp; 42s local 2025-03-14T06:25:50.7666053Z Compiling src/cpu/rnn/ref_rnn.cpp; 34s local 2025-03-14T06:25:50.7666783Z Compiling src/cpu/cpu_inner_product_list.cpp; 22s local 2025-03-14T06:25:50.7667545Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local 2025-03-14T06:25:50.7668553Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T06:25:50.7669779Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 12s local 2025-03-14T06:25:50.7670900Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 11s local ... 2025-03-14T06:25:51.0092762Z 2025-03-14T06:25:51.0093623Z  2025-03-14T06:25:51.0094417Z  2025-03-14T06:25:51.0094843Z  2025-03-14T06:25:51.0095254Z  2025-03-14T06:25:51.0095653Z  2025-03-14T06:25:51.0096044Z  2025-03-14T06:25:51.0096470Z  2025-03-14T06:25:51.0096897Z  2025-03-14T06:25:51.0097830Z [11,652 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:51.0098771Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T06:25:51.0099575Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T06:25:51.0100363Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T06:25:51.0101157Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T06:25:51.0101963Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local 2025-03-14T06:25:51.0102908Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T06:25:51.0104016Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2025-03-14T06:25:51.0105102Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 11s local ... 2025-03-14T06:25:51.2097499Z 2025-03-14T06:25:51.2098385Z  2025-03-14T06:25:51.2098907Z  2025-03-14T06:25:51.2099300Z  2025-03-14T06:25:51.2099688Z  2025-03-14T06:25:51.2100092Z  2025-03-14T06:25:51.2100531Z  2025-03-14T06:25:51.2100936Z  2025-03-14T06:25:51.2101341Z  2025-03-14T06:25:51.2102279Z [11,653 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:51.2103255Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T06:25:51.2103979Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T06:25:51.2104714Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T06:25:51.2105468Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T06:25:51.2106294Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local 2025-03-14T06:25:51.2107271Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T06:25:51.2108333Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2025-03-14T06:25:51.2109394Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local ... 2025-03-14T06:25:51.4773114Z 2025-03-14T06:25:51.4774268Z  2025-03-14T06:25:51.4774766Z  2025-03-14T06:25:51.4775200Z  2025-03-14T06:25:51.4775619Z  2025-03-14T06:25:51.4776025Z  2025-03-14T06:25:51.4776429Z  2025-03-14T06:25:51.4776849Z  2025-03-14T06:25:51.4777257Z  2025-03-14T06:25:51.4778466Z [11,655 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:51.4779469Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T06:25:51.4780396Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T06:25:51.4781162Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T06:25:51.4781989Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T06:25:51.4782872Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local 2025-03-14T06:25:51.4783898Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T06:25:51.4785043Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2025-03-14T06:25:51.4786230Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local ... 2025-03-14T06:25:51.8104196Z 2025-03-14T06:25:51.8105034Z  2025-03-14T06:25:51.8105564Z  2025-03-14T06:25:51.8106012Z  2025-03-14T06:25:51.8106484Z  2025-03-14T06:25:51.8106892Z  2025-03-14T06:25:51.8107291Z  2025-03-14T06:25:51.8107725Z  2025-03-14T06:25:51.8108148Z  2025-03-14T06:25:51.8109180Z [11,658 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:51.8110243Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T06:25:51.8111328Z Compiling src/cpu/cpu_convolution_list.cpp; 43s local 2025-03-14T06:25:51.8112144Z Compiling src/cpu/rnn/ref_rnn.cpp; 35s local 2025-03-14T06:25:51.8112967Z Compiling src/cpu/cpu_inner_product_list.cpp; 23s local 2025-03-14T06:25:51.8113893Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local 2025-03-14T06:25:51.8114947Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T06:25:51.8116161Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 13s local 2025-03-14T06:25:51.8117340Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local ... 2025-03-14T06:25:52.0109209Z 2025-03-14T06:25:52.0110071Z  2025-03-14T06:25:52.0110580Z  2025-03-14T06:25:52.0111005Z  2025-03-14T06:25:52.0111449Z  2025-03-14T06:25:52.0111882Z  2025-03-14T06:25:52.0112352Z  2025-03-14T06:25:52.0112786Z  2025-03-14T06:25:52.0113214Z  2025-03-14T06:25:52.0114207Z [11,659 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:52.0115234Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T06:25:52.0116069Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T06:25:52.0116897Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T06:25:52.0117736Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T06:25:52.0118554Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local 2025-03-14T06:25:52.0119619Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T06:25:52.0120777Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2025-03-14T06:25:52.0121950Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 12s local ... 2025-03-14T06:25:52.4115408Z 2025-03-14T06:25:52.4116310Z  2025-03-14T06:25:52.4116849Z  2025-03-14T06:25:52.4117293Z  2025-03-14T06:25:52.4117725Z  2025-03-14T06:25:52.4118164Z  2025-03-14T06:25:52.4118602Z  2025-03-14T06:25:52.4119043Z  2025-03-14T06:25:52.4119482Z  2025-03-14T06:25:52.4120469Z [11,660 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:52.4121492Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T06:25:52.4122692Z Compiling src/cpu/cpu_convolution_list.cpp; 44s local 2025-03-14T06:25:52.4123435Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T06:25:52.4124207Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T06:25:52.4125600Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2025-03-14T06:25:52.4126647Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T06:25:52.4127991Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2025-03-14T06:25:52.4129179Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local ... 2025-03-14T06:25:52.8574390Z 2025-03-14T06:25:52.8575283Z  2025-03-14T06:25:52.8575706Z  2025-03-14T06:25:52.8576095Z  2025-03-14T06:25:52.8576468Z  2025-03-14T06:25:52.8576846Z  2025-03-14T06:25:52.8577235Z  2025-03-14T06:25:52.8577613Z  2025-03-14T06:25:52.8577995Z  2025-03-14T06:25:52.8578861Z [11,661 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:52.8579749Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T06:25:52.8580443Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T06:25:52.8581123Z Compiling src/cpu/rnn/ref_rnn.cpp; 36s local 2025-03-14T06:25:52.8581826Z Compiling src/cpu/cpu_inner_product_list.cpp; 24s local 2025-03-14T06:25:52.8582599Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2025-03-14T06:25:52.8583546Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T06:25:52.8584955Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 14s local 2025-03-14T06:25:52.8585880Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 13s local ... 2025-03-14T06:25:53.1938509Z 2025-03-14T06:25:53.1939377Z  2025-03-14T06:25:53.1939827Z  2025-03-14T06:25:53.1940171Z  2025-03-14T06:25:53.1940497Z  2025-03-14T06:25:53.1940883Z  2025-03-14T06:25:53.1941303Z  2025-03-14T06:25:53.1941658Z  2025-03-14T06:25:53.1942003Z  2025-03-14T06:25:53.1942812Z [11,662 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:53.1943769Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T06:25:53.1944503Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T06:25:53.1945164Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T06:25:53.1945882Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T06:25:53.1946627Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local 2025-03-14T06:25:53.1947438Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T06:25:53.1948494Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T06:25:53.1949463Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local ... 2025-03-14T06:25:53.4120786Z 2025-03-14T06:25:53.4121797Z  2025-03-14T06:25:53.4122351Z  2025-03-14T06:25:53.4122791Z  2025-03-14T06:25:53.4123227Z  2025-03-14T06:25:53.4123664Z  2025-03-14T06:25:53.4124092Z  2025-03-14T06:25:53.4124607Z  2025-03-14T06:25:53.4125081Z  2025-03-14T06:25:53.4126111Z [11,666 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:53.4127169Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T06:25:53.4128002Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T06:25:53.4128833Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T06:25:53.4129657Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T06:25:53.4130580Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local 2025-03-14T06:25:53.4131607Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T06:25:53.4132729Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T06:25:53.4134172Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local ... 2025-03-14T06:25:53.6124954Z 2025-03-14T06:25:53.6126100Z  2025-03-14T06:25:53.6126882Z  2025-03-14T06:25:53.6127838Z  2025-03-14T06:25:53.6129005Z  2025-03-14T06:25:53.6129514Z  2025-03-14T06:25:53.6129955Z  2025-03-14T06:25:53.6130414Z  2025-03-14T06:25:53.6130877Z  2025-03-14T06:25:53.6132223Z [11,669 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:53.6133285Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T06:25:53.6134000Z Compiling src/cpu/cpu_convolution_list.cpp; 45s local 2025-03-14T06:25:53.6134782Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T06:25:53.6135613Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T06:25:53.6136549Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local 2025-03-14T06:25:53.6137657Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T06:25:53.6138806Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T06:25:53.6140006Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local ... 2025-03-14T06:25:53.9117095Z 2025-03-14T06:25:53.9117946Z  2025-03-14T06:25:53.9118390Z  2025-03-14T06:25:53.9118947Z  2025-03-14T06:25:53.9119320Z  2025-03-14T06:25:53.9119743Z  2025-03-14T06:25:53.9120141Z  2025-03-14T06:25:53.9120557Z  2025-03-14T06:25:53.9120981Z  2025-03-14T06:25:53.9122257Z [11,670 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:53.9123185Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T06:25:53.9123991Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T06:25:53.9125133Z Compiling src/cpu/rnn/ref_rnn.cpp; 37s local 2025-03-14T06:25:53.9125955Z Compiling src/cpu/cpu_inner_product_list.cpp; 25s local 2025-03-14T06:25:53.9126853Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local 2025-03-14T06:25:53.9127880Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T06:25:53.9128973Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T06:25:53.9130100Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 14s local ... 2025-03-14T06:25:54.2132107Z 2025-03-14T06:25:54.2132991Z  2025-03-14T06:25:54.2133457Z  2025-03-14T06:25:54.2133838Z  2025-03-14T06:25:54.2134226Z  2025-03-14T06:25:54.2134639Z  2025-03-14T06:25:54.2135122Z  2025-03-14T06:25:54.2135605Z  2025-03-14T06:25:54.2135970Z  2025-03-14T06:25:54.2136972Z [11,670 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:54.2138050Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T06:25:54.2138910Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T06:25:54.2139654Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T06:25:54.2140464Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T06:25:54.2141383Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2025-03-14T06:25:54.2142317Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T06:25:54.2143422Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T06:25:54.2144511Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local ... 2025-03-14T06:25:54.5931656Z 2025-03-14T06:25:54.5932535Z  2025-03-14T06:25:54.5933036Z  2025-03-14T06:25:54.5933482Z  2025-03-14T06:25:54.5933937Z  2025-03-14T06:25:54.5934388Z  2025-03-14T06:25:54.5934850Z  2025-03-14T06:25:54.5935278Z  2025-03-14T06:25:54.5935707Z  2025-03-14T06:25:54.5936955Z [11,672 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:54.5937999Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T06:25:54.5938834Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T06:25:54.5939835Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T06:25:54.5940684Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T06:25:54.5941769Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2025-03-14T06:25:54.5942791Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T06:25:54.5943945Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T06:25:54.5945051Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local ... 2025-03-14T06:25:54.8137925Z 2025-03-14T06:25:54.8139045Z  2025-03-14T06:25:54.8139601Z  2025-03-14T06:25:54.8140028Z  2025-03-14T06:25:54.8140498Z  2025-03-14T06:25:54.8140935Z  2025-03-14T06:25:54.8141328Z  2025-03-14T06:25:54.8141753Z  2025-03-14T06:25:54.8142181Z  2025-03-14T06:25:54.8143158Z [11,674 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:54.8144223Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T06:25:54.8145375Z Compiling src/cpu/cpu_convolution_list.cpp; 46s local 2025-03-14T06:25:54.8146189Z Compiling src/cpu/rnn/ref_rnn.cpp; 38s local 2025-03-14T06:25:54.8146809Z Compiling src/cpu/cpu_inner_product_list.cpp; 26s local 2025-03-14T06:25:54.8147931Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2025-03-14T06:25:54.8148907Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T06:25:54.8149976Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T06:25:54.8151028Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local ... 2025-03-14T06:25:55.0142171Z 2025-03-14T06:25:55.0143024Z  2025-03-14T06:25:55.0143586Z  2025-03-14T06:25:55.0144037Z  2025-03-14T06:25:55.0144521Z  2025-03-14T06:25:55.0144973Z  2025-03-14T06:25:55.0145418Z  2025-03-14T06:25:55.0145886Z  2025-03-14T06:25:55.0146310Z  2025-03-14T06:25:55.0147322Z [11,676 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:55.0148380Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T06:25:55.0149136Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T06:25:55.0149970Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T06:25:55.0150783Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T06:25:55.0151690Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local 2025-03-14T06:25:55.0152732Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T06:25:55.0153937Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T06:25:55.0155083Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 15s local ... 2025-03-14T06:25:55.2200332Z 2025-03-14T06:25:55.2201186Z  2025-03-14T06:25:55.2201671Z  2025-03-14T06:25:55.2202078Z  2025-03-14T06:25:55.2202497Z  2025-03-14T06:25:55.2202888Z  2025-03-14T06:25:55.2203274Z  2025-03-14T06:25:55.2203631Z  2025-03-14T06:25:55.2204027Z  2025-03-14T06:25:55.2205120Z [11,677 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:55.2206129Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T06:25:55.2206895Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T06:25:55.2207669Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T06:25:55.2208477Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T06:25:55.2209619Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2025-03-14T06:25:55.2210640Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T06:25:55.2211796Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T06:25:55.2213121Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local ... 2025-03-14T06:25:55.6149354Z 2025-03-14T06:25:55.6150204Z  2025-03-14T06:25:55.6150738Z  2025-03-14T06:25:55.6153218Z  2025-03-14T06:25:55.6156301Z  2025-03-14T06:25:55.6159568Z  2025-03-14T06:25:55.6160448Z  2025-03-14T06:25:55.6161472Z  2025-03-14T06:25:55.6161969Z  2025-03-14T06:25:55.6163001Z [11,677 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:55.6164019Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T06:25:55.6165031Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T06:25:55.6166054Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T06:25:55.6166891Z Compiling src/cpu/cpu_inner_product_list.cpp; 27s local 2025-03-14T06:25:55.6167754Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2025-03-14T06:25:55.6168734Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T06:25:55.6169974Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T06:25:55.6171207Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local ... 2025-03-14T06:25:55.8203878Z 2025-03-14T06:25:55.8204885Z  2025-03-14T06:25:55.8205432Z  2025-03-14T06:25:55.8205887Z  2025-03-14T06:25:55.8206561Z  2025-03-14T06:25:55.8207020Z  2025-03-14T06:25:55.8207453Z  2025-03-14T06:25:55.8207890Z  2025-03-14T06:25:55.8208313Z  2025-03-14T06:25:55.8209305Z [11,678 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:55.8210361Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T06:25:55.8211164Z Compiling src/cpu/cpu_convolution_list.cpp; 47s local 2025-03-14T06:25:55.8211891Z Compiling src/cpu/rnn/ref_rnn.cpp; 39s local 2025-03-14T06:25:55.8212603Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2025-03-14T06:25:55.8213582Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T06:25:55.8214752Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T06:25:55.8215884Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 16s local 2025-03-14T06:25:55.8216929Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local ... 2025-03-14T06:25:56.1109108Z 2025-03-14T06:25:56.1109944Z  2025-03-14T06:25:56.1110432Z  2025-03-14T06:25:56.1110808Z  2025-03-14T06:25:56.1111219Z  2025-03-14T06:25:56.1111631Z  2025-03-14T06:25:56.1112046Z  2025-03-14T06:25:56.1112464Z  2025-03-14T06:25:56.1112926Z  2025-03-14T06:25:56.1113924Z [11,681 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:56.1114930Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T06:25:56.1115722Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T06:25:56.1116547Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T06:25:56.1117344Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local 2025-03-14T06:25:56.1118394Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T06:25:56.1119618Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T06:25:56.1120754Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2025-03-14T06:25:56.1121797Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local ... 2025-03-14T06:25:56.3851097Z 2025-03-14T06:25:56.3853110Z  2025-03-14T06:25:56.3853548Z  2025-03-14T06:25:56.3854350Z  2025-03-14T06:25:56.3856065Z  2025-03-14T06:25:56.3856542Z  2025-03-14T06:25:56.3856966Z  2025-03-14T06:25:56.3857398Z  2025-03-14T06:25:56.3857837Z  2025-03-14T06:25:56.3858887Z [11,685 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:56.3860186Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T06:25:56.3860974Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T06:25:56.3861955Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T06:25:56.3862939Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T06:25:56.3864160Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T06:25:56.3865509Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2025-03-14T06:25:56.3866605Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 16s local 2025-03-14T06:25:56.3867624Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2025-03-14T06:25:56.6157186Z 2025-03-14T06:25:56.6158070Z  2025-03-14T06:25:56.6158611Z  2025-03-14T06:25:56.6159052Z  2025-03-14T06:25:56.6159499Z  2025-03-14T06:25:56.6159867Z  2025-03-14T06:25:56.6160324Z  2025-03-14T06:25:56.6160771Z  2025-03-14T06:25:56.6161223Z  2025-03-14T06:25:56.6162272Z [11,686 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:56.6163401Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T06:25:56.6164254Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T06:25:56.6165834Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T06:25:56.6166792Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T06:25:56.6167960Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T06:25:56.6169069Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2025-03-14T06:25:56.6170079Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local 2025-03-14T06:25:56.6171125Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2025-03-14T06:25:56.8163712Z 2025-03-14T06:25:56.8164852Z  2025-03-14T06:25:56.8165575Z  2025-03-14T06:25:56.8166030Z  2025-03-14T06:25:56.8166467Z  2025-03-14T06:25:56.8166901Z  2025-03-14T06:25:56.8167337Z  2025-03-14T06:25:56.8167780Z  2025-03-14T06:25:56.8168234Z  2025-03-14T06:25:56.8169190Z [11,687 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:56.8170169Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T06:25:56.8170986Z Compiling src/cpu/cpu_convolution_list.cpp; 48s local 2025-03-14T06:25:56.8171779Z Compiling src/cpu/rnn/ref_rnn.cpp; 40s local 2025-03-14T06:25:56.8172722Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T06:25:56.8173820Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T06:25:56.8174828Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 17s local 2025-03-14T06:25:56.8175813Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local 2025-03-14T06:25:56.8176785Z Compiling src/cpu/x64/jit_avx512_common_conv_kernel.cpp; 15s local ... 2025-03-14T06:25:57.2038189Z 2025-03-14T06:25:57.2039083Z  2025-03-14T06:25:57.2039586Z  2025-03-14T06:25:57.2039973Z  2025-03-14T06:25:57.2040379Z  2025-03-14T06:25:57.2040764Z  2025-03-14T06:25:57.2041157Z  2025-03-14T06:25:57.2041564Z  2025-03-14T06:25:57.2041990Z  2025-03-14T06:25:57.2042965Z [11,690 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:57.2043917Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T06:25:57.2045111Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T06:25:57.2045920Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T06:25:57.2046859Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T06:25:57.2048041Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T06:25:57.2049340Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2025-03-14T06:25:57.2050424Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local 2025-03-14T06:25:57.2051526Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 15s local ... 2025-03-14T06:25:57.4167925Z 2025-03-14T06:25:57.4168748Z  2025-03-14T06:25:57.4169217Z  2025-03-14T06:25:57.4169593Z  2025-03-14T06:25:57.4169959Z  2025-03-14T06:25:57.4170358Z  2025-03-14T06:25:57.4170719Z  2025-03-14T06:25:57.4171085Z  2025-03-14T06:25:57.4171451Z  2025-03-14T06:25:57.4172317Z [11,691 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:57.4173578Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T06:25:57.4174386Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T06:25:57.4175220Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T06:25:57.4176211Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T06:25:57.4177330Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T06:25:57.4178390Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2025-03-14T06:25:57.4179583Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 17s local 2025-03-14T06:25:57.4180590Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 15s local ... 2025-03-14T06:25:57.6173297Z 2025-03-14T06:25:57.6174144Z  2025-03-14T06:25:57.6174617Z  2025-03-14T06:25:57.6175003Z  2025-03-14T06:25:57.6175396Z  2025-03-14T06:25:57.6175796Z  2025-03-14T06:25:57.6176162Z  2025-03-14T06:25:57.6176555Z  2025-03-14T06:25:57.6176920Z  2025-03-14T06:25:57.6177824Z [11,692 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:57.6178700Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T06:25:57.6179435Z Compiling src/cpu/cpu_convolution_list.cpp; 49s local 2025-03-14T06:25:57.6180116Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T06:25:57.6180927Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T06:25:57.6181925Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T06:25:57.6182874Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2025-03-14T06:25:57.6183719Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local 2025-03-14T06:25:57.6184551Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local ... 2025-03-14T06:25:57.8819913Z 2025-03-14T06:25:57.8820775Z  2025-03-14T06:25:57.8821243Z  2025-03-14T06:25:57.8821631Z  2025-03-14T06:25:57.8821998Z  2025-03-14T06:25:57.8822380Z  2025-03-14T06:25:57.8822764Z  2025-03-14T06:25:57.8823146Z  2025-03-14T06:25:57.8823566Z  2025-03-14T06:25:57.8824466Z [11,694 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:57.8825386Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T06:25:57.8826160Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T06:25:57.8826911Z Compiling src/cpu/rnn/ref_rnn.cpp; 41s local 2025-03-14T06:25:57.8827829Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T06:25:57.8828844Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T06:25:57.8829925Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 18s local 2025-03-14T06:25:57.8831225Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local 2025-03-14T06:25:57.8832162Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local ... 2025-03-14T06:25:58.1293349Z 2025-03-14T06:25:58.1294221Z  2025-03-14T06:25:58.1294662Z  2025-03-14T06:25:58.1295329Z  2025-03-14T06:25:58.1295702Z  2025-03-14T06:25:58.1296100Z  2025-03-14T06:25:58.1296490Z  2025-03-14T06:25:58.1296870Z  2025-03-14T06:25:58.1297247Z  2025-03-14T06:25:58.1298316Z [11,697 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:58.1299284Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T06:25:58.1300032Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T06:25:58.1300782Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T06:25:58.1301685Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T06:25:58.1302837Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T06:25:58.1304018Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2025-03-14T06:25:58.1304993Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local 2025-03-14T06:25:58.1306028Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local ... 2025-03-14T06:25:58.4182841Z 2025-03-14T06:25:58.4183698Z  2025-03-14T06:25:58.4184218Z  2025-03-14T06:25:58.4184658Z  2025-03-14T06:25:58.4185096Z  2025-03-14T06:25:58.4185555Z  2025-03-14T06:25:58.4185987Z  2025-03-14T06:25:58.4186380Z  2025-03-14T06:25:58.4186788Z  2025-03-14T06:25:58.4188076Z [11,697 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:58.4189131Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T06:25:58.4189968Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T06:25:58.4190812Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T06:25:58.4191744Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T06:25:58.4192844Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T06:25:58.4194043Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2025-03-14T06:25:58.4195060Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 18s local 2025-03-14T06:25:58.4196082Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 16s local ... 2025-03-14T06:25:58.6354458Z 2025-03-14T06:25:58.6355332Z  2025-03-14T06:25:58.6355838Z  2025-03-14T06:25:58.6356242Z  2025-03-14T06:25:58.6356653Z  2025-03-14T06:25:58.6357056Z  2025-03-14T06:25:58.6357482Z  2025-03-14T06:25:58.6357879Z  2025-03-14T06:25:58.6358295Z  2025-03-14T06:25:58.6359260Z [11,698 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:58.6360286Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T06:25:58.6361060Z Compiling src/cpu/cpu_convolution_list.cpp; 50s local 2025-03-14T06:25:58.6361834Z Compiling src/cpu/rnn/ref_rnn.cpp; 42s local 2025-03-14T06:25:58.6362814Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T06:25:58.6364050Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T06:25:58.6365553Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2025-03-14T06:25:58.6366571Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2025-03-14T06:25:58.6367601Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local ... 2025-03-14T06:25:59.0189771Z 2025-03-14T06:25:59.0190597Z  2025-03-14T06:25:59.0191062Z  2025-03-14T06:25:59.0191472Z  2025-03-14T06:25:59.0191889Z  2025-03-14T06:25:59.0192265Z  2025-03-14T06:25:59.0192650Z  2025-03-14T06:25:59.0193046Z  2025-03-14T06:25:59.0193735Z  2025-03-14T06:25:59.0194667Z [11,700 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:59.0195624Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T06:25:59.0196591Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T06:25:59.0197372Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T06:25:59.0198288Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T06:25:59.0199586Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T06:25:59.0200708Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 19s local 2025-03-14T06:25:59.0201697Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2025-03-14T06:25:59.0202691Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local ... 2025-03-14T06:25:59.2232618Z 2025-03-14T06:25:59.2233448Z  2025-03-14T06:25:59.2233954Z  2025-03-14T06:25:59.2234393Z  2025-03-14T06:25:59.2234803Z  2025-03-14T06:25:59.2235241Z  2025-03-14T06:25:59.2235659Z  2025-03-14T06:25:59.2236056Z  2025-03-14T06:25:59.2236461Z  2025-03-14T06:25:59.2237443Z [11,701 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:59.2238463Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T06:25:59.2239281Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T06:25:59.2240080Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T06:25:59.2241002Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T06:25:59.2242429Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T06:25:59.2243599Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 20s local 2025-03-14T06:25:59.2244786Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 19s local 2025-03-14T06:25:59.2245806Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local ... 2025-03-14T06:25:59.6036206Z 2025-03-14T06:25:59.6037090Z  2025-03-14T06:25:59.6037597Z  2025-03-14T06:25:59.6038010Z  2025-03-14T06:25:59.6038421Z  2025-03-14T06:25:59.6038848Z  2025-03-14T06:25:59.6039266Z  2025-03-14T06:25:59.6039673Z  2025-03-14T06:25:59.6040087Z  2025-03-14T06:25:59.6041070Z [11,703 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:25:59.6042070Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T06:25:59.6042874Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T06:25:59.6043641Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T06:25:59.6044706Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T06:25:59.6045837Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T06:25:59.6046911Z Compiling src/cpu/x64/jit_uni_batch_normalization.cpp; 20s local 2025-03-14T06:25:59.6047857Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local 2025-03-14T06:25:59.6048865Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 17s local ... 2025-03-14T06:25:59.8197082Z 2025-03-14T06:25:59.8197969Z  2025-03-14T06:25:59.8198454Z  2025-03-14T06:25:59.8198838Z  2025-03-14T06:25:59.8199245Z  2025-03-14T06:25:59.8199658Z  2025-03-14T06:25:59.8200090Z  2025-03-14T06:25:59.8200526Z  2025-03-14T06:25:59.8200944Z  2025-03-14T06:25:59.8201909Z [11,704 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:25:59.8202878Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2025-03-14T06:25:59.8203543Z Compiling src/cpu/cpu_convolution_list.cpp; 51s local 2025-03-14T06:25:59.8204182Z Compiling src/cpu/rnn/ref_rnn.cpp; 43s local 2025-03-14T06:25:59.8205087Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T06:25:59.8206446Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T06:25:59.8207456Z Compiling src/cpu/x64/jit_uni_binary_kernel.cpp; 20s local 2025-03-14T06:25:59.8208572Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2025-03-14T06:25:59.8209566Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 14s local ... 2025-03-14T06:26:00.0743040Z 2025-03-14T06:26:00.0743899Z  2025-03-14T06:26:00.0744673Z  2025-03-14T06:26:00.0745115Z  2025-03-14T06:26:00.0745555Z  2025-03-14T06:26:00.0745956Z  2025-03-14T06:26:00.0746366Z  2025-03-14T06:26:00.0746793Z  2025-03-14T06:26:00.0747218Z  2025-03-14T06:26:00.0748168Z [11,706 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:00.0749117Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2025-03-14T06:26:00.0749900Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T06:26:00.0750670Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T06:26:00.0751551Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T06:26:00.0752676Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T06:26:00.0753742Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2025-03-14T06:26:00.0754676Z Compiling src/cpu/x64/jit_uni_i8i8_pooling.cpp; 14s local 2025-03-14T06:26:00.0755407Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T06:26:00.3333984Z 2025-03-14T06:26:00.3334832Z  2025-03-14T06:26:00.3335320Z  2025-03-14T06:26:00.3336018Z  2025-03-14T06:26:00.3336458Z  2025-03-14T06:26:00.3336867Z  2025-03-14T06:26:00.3337266Z  2025-03-14T06:26:00.3337667Z  2025-03-14T06:26:00.3338067Z  2025-03-14T06:26:00.3339034Z [11,708 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:00.3340027Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2025-03-14T06:26:00.3340814Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T06:26:00.3341643Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T06:26:00.3342587Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T06:26:00.3343677Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T06:26:00.3344737Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2025-03-14T06:26:00.3345857Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 14s local 2025-03-14T06:26:00.3346946Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 13s local ... 2025-03-14T06:26:00.6106372Z 2025-03-14T06:26:00.6107219Z  2025-03-14T06:26:00.6107735Z  2025-03-14T06:26:00.6108159Z  2025-03-14T06:26:00.6108600Z  2025-03-14T06:26:00.6109033Z  2025-03-14T06:26:00.6109501Z  2025-03-14T06:26:00.6121991Z  2025-03-14T06:26:00.6122476Z  2025-03-14T06:26:00.6123470Z [11,709 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:00.6124611Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2025-03-14T06:26:00.6125467Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T06:26:00.6126274Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T06:26:00.6127229Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T06:26:00.6128409Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T06:26:00.6129529Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local 2025-03-14T06:26:00.6130631Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 14s local 2025-03-14T06:26:00.6131803Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 13s local ... 2025-03-14T06:26:00.8206138Z 2025-03-14T06:26:00.8206997Z  2025-03-14T06:26:00.8207497Z  2025-03-14T06:26:00.8207918Z  2025-03-14T06:26:00.8208334Z  2025-03-14T06:26:00.8208762Z  2025-03-14T06:26:00.8209178Z  2025-03-14T06:26:00.8209581Z  2025-03-14T06:26:00.8210283Z  2025-03-14T06:26:00.8211259Z [11,710 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:00.8212201Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T06:26:00.8213196Z Compiling src/cpu/cpu_convolution_list.cpp; 52s local 2025-03-14T06:26:00.8214002Z Compiling src/cpu/rnn/ref_rnn.cpp; 44s local 2025-03-14T06:26:00.8214932Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T06:26:00.8216110Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T06:26:00.8217226Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2025-03-14T06:26:00.8218347Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 14s local 2025-03-14T06:26:00.8219493Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 14s local ... 2025-03-14T06:26:01.3487649Z 2025-03-14T06:26:01.3488537Z  2025-03-14T06:26:01.3489064Z  2025-03-14T06:26:01.3489472Z  2025-03-14T06:26:01.3489892Z  2025-03-14T06:26:01.3490294Z  2025-03-14T06:26:01.3490709Z  2025-03-14T06:26:01.3491127Z  2025-03-14T06:26:01.3491536Z  2025-03-14T06:26:01.3492515Z [11,711 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:01.3493743Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T06:26:01.3494550Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T06:26:01.3495346Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T06:26:01.3496237Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T06:26:01.3497158Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T06:26:01.3498041Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local 2025-03-14T06:26:01.3498911Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2025-03-14T06:26:01.3499916Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 14s local ... 2025-03-14T06:26:01.6215330Z 2025-03-14T06:26:01.6216194Z  2025-03-14T06:26:01.6216717Z  2025-03-14T06:26:01.6217143Z  2025-03-14T06:26:01.6217578Z  2025-03-14T06:26:01.6217967Z  2025-03-14T06:26:01.6218389Z  2025-03-14T06:26:01.6218801Z  2025-03-14T06:26:01.6219220Z  2025-03-14T06:26:01.6220207Z [11,711 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:01.6221211Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T06:26:01.6222030Z Compiling src/cpu/cpu_convolution_list.cpp; 53s local 2025-03-14T06:26:01.6222841Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T06:26:01.6223838Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:26:01.6224985Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T06:26:01.6226082Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2025-03-14T06:26:01.6227137Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2025-03-14T06:26:01.6228296Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 14s local ... 2025-03-14T06:26:01.8601490Z 2025-03-14T06:26:01.8602363Z  2025-03-14T06:26:01.8602879Z  2025-03-14T06:26:01.8603330Z  2025-03-14T06:26:01.8603774Z  2025-03-14T06:26:01.8604159Z  2025-03-14T06:26:01.8604632Z  2025-03-14T06:26:01.8605041Z  2025-03-14T06:26:01.8605440Z  2025-03-14T06:26:01.8606374Z [11,712 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:01.8607518Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T06:26:01.8608189Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T06:26:01.8608823Z Compiling src/cpu/rnn/ref_rnn.cpp; 45s local 2025-03-14T06:26:01.8609858Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:26:01.8610963Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T06:26:01.8612137Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2025-03-14T06:26:01.8613182Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 16s local 2025-03-14T06:26:01.8614337Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local ... 2025-03-14T06:26:02.0726397Z 2025-03-14T06:26:02.0727233Z  2025-03-14T06:26:02.0727652Z  2025-03-14T06:26:02.0728050Z  2025-03-14T06:26:02.0728431Z  2025-03-14T06:26:02.0728847Z  2025-03-14T06:26:02.0729208Z  2025-03-14T06:26:02.0729613Z  2025-03-14T06:26:02.0729988Z  2025-03-14T06:26:02.0730917Z [11,714 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:02.0731815Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T06:26:02.0732581Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T06:26:02.0733330Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T06:26:02.0734149Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:26:02.0735234Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:26:02.0736426Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2025-03-14T06:26:02.0737377Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 16s local 2025-03-14T06:26:02.0738385Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local ... 2025-03-14T06:26:02.2795576Z 2025-03-14T06:26:02.2796380Z  2025-03-14T06:26:02.2796815Z  2025-03-14T06:26:02.2797172Z  2025-03-14T06:26:02.2797532Z  2025-03-14T06:26:02.2797884Z  2025-03-14T06:26:02.2798236Z  2025-03-14T06:26:02.2798628Z  2025-03-14T06:26:02.2798975Z  2025-03-14T06:26:02.2799825Z [11,716 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:02.2800748Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T06:26:02.2801405Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T06:26:02.2802045Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T06:26:02.2802793Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:26:02.2803722Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:26:02.2804764Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local 2025-03-14T06:26:02.2805623Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local 2025-03-14T06:26:02.2806427Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local ... 2025-03-14T06:26:02.6215034Z 2025-03-14T06:26:02.6215929Z  2025-03-14T06:26:02.6216425Z  2025-03-14T06:26:02.6216845Z  2025-03-14T06:26:02.6217249Z  2025-03-14T06:26:02.6217643Z  2025-03-14T06:26:02.6218040Z  2025-03-14T06:26:02.6218447Z  2025-03-14T06:26:02.6218850Z  2025-03-14T06:26:02.6219787Z [11,719 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:02.6220720Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T06:26:02.6221488Z Compiling src/cpu/cpu_convolution_list.cpp; 54s local 2025-03-14T06:26:02.6222248Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T06:26:02.6223091Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T06:26:02.6224489Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:26:02.6225576Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2025-03-14T06:26:02.6226571Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 15s local 2025-03-14T06:26:02.6227676Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local ... 2025-03-14T06:26:02.8476354Z 2025-03-14T06:26:02.8477176Z  2025-03-14T06:26:02.8477667Z  2025-03-14T06:26:02.8478084Z  2025-03-14T06:26:02.8478496Z  2025-03-14T06:26:02.8479159Z  2025-03-14T06:26:02.8479577Z  2025-03-14T06:26:02.8479983Z  2025-03-14T06:26:02.8480403Z  2025-03-14T06:26:02.8481407Z [11,722 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:02.8482397Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T06:26:02.8483194Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:26:02.8483988Z Compiling src/cpu/rnn/ref_rnn.cpp; 46s local 2025-03-14T06:26:02.8485074Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T06:26:02.8486209Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:26:02.8487296Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2025-03-14T06:26:02.8488334Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T06:26:02.8489337Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 15s local ... 2025-03-14T06:26:03.0756228Z 2025-03-14T06:26:03.0757116Z  2025-03-14T06:26:03.0757616Z  2025-03-14T06:26:03.0758027Z  2025-03-14T06:26:03.0758684Z  2025-03-14T06:26:03.0759129Z  2025-03-14T06:26:03.0759538Z  2025-03-14T06:26:03.0759938Z  2025-03-14T06:26:03.0760357Z  2025-03-14T06:26:03.0761344Z [11,724 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:03.0762287Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T06:26:03.0763026Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:26:03.0763733Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T06:26:03.0764783Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T06:26:03.0766120Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T06:26:03.0767197Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2025-03-14T06:26:03.0768189Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T06:26:03.0769147Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local ... 2025-03-14T06:26:03.4227515Z 2025-03-14T06:26:03.4228349Z  2025-03-14T06:26:03.4228854Z  2025-03-14T06:26:03.4229277Z  2025-03-14T06:26:03.4229704Z  2025-03-14T06:26:03.4230083Z  2025-03-14T06:26:03.4230493Z  2025-03-14T06:26:03.4230944Z  2025-03-14T06:26:03.4231319Z  2025-03-14T06:26:03.4232319Z [11,725 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:03.4233427Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T06:26:03.4234405Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:26:03.4235154Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T06:26:03.4236010Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T06:26:03.4237105Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T06:26:03.4238145Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local 2025-03-14T06:26:03.4239158Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 16s local 2025-03-14T06:26:03.4240071Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local ... 2025-03-14T06:26:03.7275024Z 2025-03-14T06:26:03.7275916Z  2025-03-14T06:26:03.7276778Z  2025-03-14T06:26:03.7277244Z  2025-03-14T06:26:03.7277712Z  2025-03-14T06:26:03.7278157Z  2025-03-14T06:26:03.7278625Z  2025-03-14T06:26:03.7279037Z  2025-03-14T06:26:03.7279486Z  2025-03-14T06:26:03.7280501Z [11,726 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:03.7281655Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:03.7282487Z Compiling src/cpu/cpu_convolution_list.cpp; 55s local 2025-03-14T06:26:03.7283401Z Compiling src/cpu/rnn/ref_rnn.cpp; 47s local 2025-03-14T06:26:03.7284320Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2025-03-14T06:26:03.7285565Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T06:26:03.7286629Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2025-03-14T06:26:03.7287633Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:26:03.7288606Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local ... 2025-03-14T06:26:03.9414600Z 2025-03-14T06:26:03.9415420Z  2025-03-14T06:26:03.9415935Z  2025-03-14T06:26:03.9416393Z  2025-03-14T06:26:03.9416805Z  2025-03-14T06:26:03.9417278Z  2025-03-14T06:26:03.9417720Z  2025-03-14T06:26:03.9418149Z  2025-03-14T06:26:03.9418527Z  2025-03-14T06:26:03.9419511Z [11,727 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:03.9420474Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:03.9421407Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T06:26:03.9422130Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T06:26:03.9423067Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2025-03-14T06:26:03.9424163Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T06:26:03.9425248Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2025-03-14T06:26:03.9426367Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:26:03.9427346Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 16s local ... 2025-03-14T06:26:04.1937284Z 2025-03-14T06:26:04.1938123Z  2025-03-14T06:26:04.1938630Z  2025-03-14T06:26:04.1939033Z  2025-03-14T06:26:04.1939446Z  2025-03-14T06:26:04.1939850Z  2025-03-14T06:26:04.1940270Z  2025-03-14T06:26:04.1940707Z  2025-03-14T06:26:04.1941127Z  2025-03-14T06:26:04.1942087Z [11,728 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:04.1943058Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:04.1943778Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T06:26:04.1944530Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T06:26:04.1945411Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2025-03-14T06:26:04.1946541Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T06:26:04.1947572Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2025-03-14T06:26:04.1948597Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:26:04.1949559Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local ... 2025-03-14T06:26:04.4084880Z 2025-03-14T06:26:04.4085791Z  2025-03-14T06:26:04.4086334Z  2025-03-14T06:26:04.4086747Z  2025-03-14T06:26:04.4087168Z  2025-03-14T06:26:04.4087584Z  2025-03-14T06:26:04.4087986Z  2025-03-14T06:26:04.4088407Z  2025-03-14T06:26:04.4088815Z  2025-03-14T06:26:04.4089768Z [11,730 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:04.4090728Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:04.4091772Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T06:26:04.4092541Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T06:26:04.4093448Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T06:26:04.4094712Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local 2025-03-14T06:26:04.4095726Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:26:04.4096661Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local 2025-03-14T06:26:04.4097559Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:26:04.6237056Z 2025-03-14T06:26:04.6237889Z  2025-03-14T06:26:04.6238343Z  2025-03-14T06:26:04.6238745Z  2025-03-14T06:26:04.6239115Z  2025-03-14T06:26:04.6239476Z  2025-03-14T06:26:04.6239839Z  2025-03-14T06:26:04.6240211Z  2025-03-14T06:26:04.6240566Z  2025-03-14T06:26:04.6241400Z [11,731 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:04.6242253Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:04.6242907Z Compiling src/cpu/cpu_convolution_list.cpp; 56s local 2025-03-14T06:26:04.6243545Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T06:26:04.6244546Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T06:26:04.6245420Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2025-03-14T06:26:04.6246315Z Compiling src/cpu/x64/jit_avx512_core_bf16_conv_kernel.cpp; 17s local 2025-03-14T06:26:04.6247165Z Compiling src/cpu/x64/jit_uni_pooling.cpp; 17s local 2025-03-14T06:26:04.6248069Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:26:04.9137674Z 2025-03-14T06:26:04.9138514Z  2025-03-14T06:26:04.9138958Z  2025-03-14T06:26:04.9139370Z  2025-03-14T06:26:04.9139733Z  2025-03-14T06:26:04.9140090Z  2025-03-14T06:26:04.9140457Z  2025-03-14T06:26:04.9140860Z  2025-03-14T06:26:04.9141231Z  2025-03-14T06:26:04.9142136Z [11,736 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:04.9143051Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T06:26:04.9143834Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T06:26:04.9144566Z Compiling src/cpu/rnn/ref_rnn.cpp; 48s local 2025-03-14T06:26:04.9145375Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T06:26:04.9146390Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2025-03-14T06:26:04.9147456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T06:26:04.9148300Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:26:04.9149024Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 11s local ... 2025-03-14T06:26:05.2243984Z 2025-03-14T06:26:05.2244992Z  2025-03-14T06:26:05.2245508Z  2025-03-14T06:26:05.2245954Z  2025-03-14T06:26:05.2246369Z  2025-03-14T06:26:05.2246807Z  2025-03-14T06:26:05.2247232Z  2025-03-14T06:26:05.2247619Z  2025-03-14T06:26:05.2248030Z  2025-03-14T06:26:05.2249052Z [11,739 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:05.2250095Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T06:26:05.2250841Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T06:26:05.2251604Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T06:26:05.2252439Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T06:26:05.2253570Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2025-03-14T06:26:05.2254538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T06:26:05.2255334Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:26:05.2256058Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 12s local ... 2025-03-14T06:26:05.5050664Z 2025-03-14T06:26:05.5051522Z  2025-03-14T06:26:05.5052035Z  2025-03-14T06:26:05.5052466Z  2025-03-14T06:26:05.5052908Z  2025-03-14T06:26:05.5053336Z  2025-03-14T06:26:05.5054033Z  2025-03-14T06:26:05.5054453Z  2025-03-14T06:26:05.5054865Z  2025-03-14T06:26:05.5055854Z [11,740 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:05.5057020Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T06:26:05.5057851Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T06:26:05.5058638Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T06:26:05.5059575Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T06:26:05.5060669Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local 2025-03-14T06:26:05.5061780Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T06:26:05.5062712Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:26:05.5063520Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 12s local ... 2025-03-14T06:26:05.7558022Z 2025-03-14T06:26:05.7558881Z  2025-03-14T06:26:05.7559430Z  2025-03-14T06:26:05.7559855Z  2025-03-14T06:26:05.7560291Z  2025-03-14T06:26:05.7560718Z  2025-03-14T06:26:05.7561140Z  2025-03-14T06:26:05.7561568Z  2025-03-14T06:26:05.7561999Z  2025-03-14T06:26:05.7563012Z [11,742 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:05.7564277Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T06:26:05.7565508Z Compiling src/cpu/cpu_convolution_list.cpp; 57s local 2025-03-14T06:26:05.7566315Z Compiling src/cpu/rnn/ref_rnn.cpp; 49s local 2025-03-14T06:26:05.7567274Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T06:26:05.7568426Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2025-03-14T06:26:05.7569584Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T06:26:05.7570499Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:26:05.7571346Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 12s local ... 2025-03-14T06:26:05.9625596Z 2025-03-14T06:26:05.9626467Z  2025-03-14T06:26:05.9626953Z  2025-03-14T06:26:05.9627322Z  2025-03-14T06:26:05.9627707Z  2025-03-14T06:26:05.9628878Z  2025-03-14T06:26:05.9629263Z  2025-03-14T06:26:05.9629623Z  2025-03-14T06:26:05.9630048Z  2025-03-14T06:26:05.9633638Z [11,746 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:05.9635551Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T06:26:05.9636307Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T06:26:05.9637465Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T06:26:05.9640555Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T06:26:05.9642541Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2025-03-14T06:26:05.9643926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T06:26:05.9644953Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:26:05.9645718Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 12s local ... 2025-03-14T06:26:06.2253865Z 2025-03-14T06:26:06.2254756Z  2025-03-14T06:26:06.2255255Z  2025-03-14T06:26:06.2255701Z  2025-03-14T06:26:06.2256141Z  2025-03-14T06:26:06.2256579Z  2025-03-14T06:26:06.2257013Z  2025-03-14T06:26:06.2257438Z  2025-03-14T06:26:06.2257851Z  2025-03-14T06:26:06.2258809Z [11,747 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:06.2259813Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T06:26:06.2260945Z Compiling src/cpu/cpu_convolution_list.cpp; 58s local 2025-03-14T06:26:06.2261686Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T06:26:06.2262669Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T06:26:06.2263945Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2025-03-14T06:26:06.2265051Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T06:26:06.2267855Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:26:06.2268639Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 13s local ... 2025-03-14T06:26:06.8780038Z 2025-03-14T06:26:06.8780920Z  2025-03-14T06:26:06.8781406Z  2025-03-14T06:26:06.8781842Z  2025-03-14T06:26:06.8782220Z  2025-03-14T06:26:06.8782600Z  2025-03-14T06:26:06.8782996Z  2025-03-14T06:26:06.8783389Z  2025-03-14T06:26:06.8783782Z  2025-03-14T06:26:06.8784752Z [11,748 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:06.8785828Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T06:26:06.8786599Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T06:26:06.8787364Z Compiling src/cpu/rnn/ref_rnn.cpp; 50s local 2025-03-14T06:26:06.8788295Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T06:26:06.8789379Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2025-03-14T06:26:06.8790432Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T06:26:06.8791767Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 13s local 2025-03-14T06:26:06.8792752Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local ... 2025-03-14T06:26:07.2263243Z 2025-03-14T06:26:07.2264260Z  2025-03-14T06:26:07.2264793Z  2025-03-14T06:26:07.2265249Z  2025-03-14T06:26:07.2265917Z  2025-03-14T06:26:07.2266402Z  2025-03-14T06:26:07.2266847Z  2025-03-14T06:26:07.2267295Z  2025-03-14T06:26:07.2267696Z  2025-03-14T06:26:07.2268691Z [11,750 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:07.2269932Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T06:26:07.2270764Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T06:26:07.2271599Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T06:26:07.2272534Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T06:26:07.2273615Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2025-03-14T06:26:07.2274777Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T06:26:07.2275893Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 14s local 2025-03-14T06:26:07.2276827Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 13s local ... 2025-03-14T06:26:07.5932999Z 2025-03-14T06:26:07.5933823Z  2025-03-14T06:26:07.5934255Z  2025-03-14T06:26:07.5934633Z  2025-03-14T06:26:07.5935003Z  2025-03-14T06:26:07.5935343Z  2025-03-14T06:26:07.5935709Z  2025-03-14T06:26:07.5936097Z  2025-03-14T06:26:07.5936465Z  2025-03-14T06:26:07.5937401Z [11,751 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:07.5938211Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T06:26:07.5938911Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T06:26:07.5939614Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T06:26:07.5940460Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T06:26:07.5941460Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2025-03-14T06:26:07.5942434Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T06:26:07.5943721Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 14s local 2025-03-14T06:26:07.5944598Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2025-03-14T06:26:07.8268658Z 2025-03-14T06:26:07.8269462Z  2025-03-14T06:26:07.8269864Z  2025-03-14T06:26:07.8270443Z  2025-03-14T06:26:07.8270764Z  2025-03-14T06:26:07.8271079Z  2025-03-14T06:26:07.8271402Z  2025-03-14T06:26:07.8271719Z  2025-03-14T06:26:07.8272040Z  2025-03-14T06:26:07.8272929Z [11,752 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:07.8273709Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T06:26:07.8274311Z Compiling src/cpu/cpu_convolution_list.cpp; 59s local 2025-03-14T06:26:07.8274908Z Compiling src/cpu/rnn/ref_rnn.cpp; 51s local 2025-03-14T06:26:07.8275614Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T06:26:07.8276443Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T06:26:07.8277257Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T06:26:07.8278068Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 14s local 2025-03-14T06:26:07.8278786Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2025-03-14T06:26:08.2274444Z 2025-03-14T06:26:08.2275272Z  2025-03-14T06:26:08.2275734Z  2025-03-14T06:26:08.2276111Z  2025-03-14T06:26:08.2276521Z  2025-03-14T06:26:08.2276943Z  2025-03-14T06:26:08.2277341Z  2025-03-14T06:26:08.2277727Z  2025-03-14T06:26:08.2278113Z  2025-03-14T06:26:08.2279259Z [11,753 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:08.2280227Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T06:26:08.2280994Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T06:26:08.2281684Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T06:26:08.2282539Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T06:26:08.2283577Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T06:26:08.2284779Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T06:26:08.2285780Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local 2025-03-14T06:26:08.2286675Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 14s local ... 2025-03-14T06:26:08.6280038Z 2025-03-14T06:26:08.6280891Z  2025-03-14T06:26:08.6281384Z  2025-03-14T06:26:08.6281758Z  2025-03-14T06:26:08.6282159Z  2025-03-14T06:26:08.6282540Z  2025-03-14T06:26:08.6282904Z  2025-03-14T06:26:08.6283301Z  2025-03-14T06:26:08.6283656Z  2025-03-14T06:26:08.6284746Z [11,755 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:08.6285645Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T06:26:08.6286379Z Compiling src/cpu/cpu_convolution_list.cpp; 60s local 2025-03-14T06:26:08.6287120Z Compiling src/cpu/rnn/ref_rnn.cpp; 52s local 2025-03-14T06:26:08.6288093Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T06:26:08.6289037Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T06:26:08.6289940Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T06:26:08.6290852Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local 2025-03-14T06:26:08.6291654Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2025-03-14T06:26:08.9703143Z 2025-03-14T06:26:08.9703982Z  2025-03-14T06:26:08.9704487Z  2025-03-14T06:26:08.9704905Z  2025-03-14T06:26:08.9705312Z  2025-03-14T06:26:08.9705726Z  2025-03-14T06:26:08.9706145Z  2025-03-14T06:26:08.9706577Z  2025-03-14T06:26:08.9707292Z  2025-03-14T06:26:08.9708290Z [11,756 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:08.9709288Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T06:26:08.9710262Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T06:26:08.9711058Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T06:26:08.9711945Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T06:26:08.9713094Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T06:26:08.9714127Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T06:26:08.9715133Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 15s local 2025-03-14T06:26:08.9716066Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2025-03-14T06:26:09.2287618Z 2025-03-14T06:26:09.2288493Z  2025-03-14T06:26:09.2289003Z  2025-03-14T06:26:09.2289463Z  2025-03-14T06:26:09.2289890Z  2025-03-14T06:26:09.2290309Z  2025-03-14T06:26:09.2290773Z  2025-03-14T06:26:09.2291185Z  2025-03-14T06:26:09.2291671Z  2025-03-14T06:26:09.2292691Z [11,758 / 20,650] 3 / 17 tests; 47 actions running; last test: ...nv_hash_test 2025-03-14T06:26:09.2293764Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T06:26:09.2294593Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T06:26:09.2295445Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T06:26:09.2296422Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T06:26:09.2297818Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T06:26:09.2298999Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T06:26:09.2300105Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2025-03-14T06:26:09.2301128Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 15s local ... 2025-03-14T06:26:09.6113589Z 2025-03-14T06:26:09.6114453Z  2025-03-14T06:26:09.6114952Z  2025-03-14T06:26:09.6115368Z  2025-03-14T06:26:09.6115767Z  2025-03-14T06:26:09.6116223Z  2025-03-14T06:26:09.6116648Z  2025-03-14T06:26:09.6117065Z  2025-03-14T06:26:09.6117503Z  2025-03-14T06:26:09.6118491Z [11,760 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:09.6119549Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T06:26:09.6120356Z Compiling src/cpu/cpu_convolution_list.cpp; 61s local 2025-03-14T06:26:09.6121150Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T06:26:09.6122116Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T06:26:09.6123257Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T06:26:09.6124546Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T06:26:09.6125676Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2025-03-14T06:26:09.6126683Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2025-03-14T06:26:09.8292945Z 2025-03-14T06:26:09.8293779Z  2025-03-14T06:26:09.8294286Z  2025-03-14T06:26:09.8294709Z  2025-03-14T06:26:09.8295128Z  2025-03-14T06:26:09.8295536Z  2025-03-14T06:26:09.8295943Z  2025-03-14T06:26:09.8296364Z  2025-03-14T06:26:09.8296796Z  2025-03-14T06:26:09.8297775Z [11,761 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:09.8298742Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2025-03-14T06:26:09.8299543Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T06:26:09.8300370Z Compiling src/cpu/rnn/ref_rnn.cpp; 53s local 2025-03-14T06:26:09.8301316Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T06:26:09.8302725Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2025-03-14T06:26:09.8303825Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T06:26:09.8304975Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 16s local 2025-03-14T06:26:09.8306179Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 16s local ... 2025-03-14T06:26:10.7059492Z 2025-03-14T06:26:10.7060335Z  2025-03-14T06:26:10.7060851Z  2025-03-14T06:26:10.7061551Z  2025-03-14T06:26:10.7062009Z  2025-03-14T06:26:10.7062454Z  2025-03-14T06:26:10.7062886Z  2025-03-14T06:26:10.7063326Z  2025-03-14T06:26:10.7063774Z  2025-03-14T06:26:10.7064761Z [11,762 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:10.7066061Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T06:26:10.7066917Z Compiling src/cpu/cpu_convolution_list.cpp; 62s local 2025-03-14T06:26:10.7067758Z Compiling src/cpu/rnn/ref_rnn.cpp; 54s local 2025-03-14T06:26:10.7068767Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T06:26:10.7069944Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T06:26:10.7071121Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T06:26:10.7072291Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2025-03-14T06:26:10.7073329Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local ... 2025-03-14T06:26:10.9666139Z 2025-03-14T06:26:10.9667087Z  2025-03-14T06:26:10.9667906Z  2025-03-14T06:26:10.9668387Z  2025-03-14T06:26:10.9668769Z  2025-03-14T06:26:10.9669192Z  2025-03-14T06:26:10.9669641Z  2025-03-14T06:26:10.9670076Z  2025-03-14T06:26:10.9670503Z  2025-03-14T06:26:10.9671494Z [11,763 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:10.9672531Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T06:26:10.9673346Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T06:26:10.9674144Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T06:26:10.9675105Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T06:26:10.9676226Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T06:26:10.9677343Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T06:26:10.9678442Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 17s local 2025-03-14T06:26:10.9679440Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local ... 2025-03-14T06:26:11.2299059Z 2025-03-14T06:26:11.2300181Z  2025-03-14T06:26:11.2300947Z  2025-03-14T06:26:11.2301406Z  2025-03-14T06:26:11.2301870Z  2025-03-14T06:26:11.2302317Z  2025-03-14T06:26:11.2302731Z  2025-03-14T06:26:11.2303129Z  2025-03-14T06:26:11.2303552Z  2025-03-14T06:26:11.2304560Z [11,765 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:11.2305562Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T06:26:11.2306416Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T06:26:11.2307220Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T06:26:11.2308190Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T06:26:11.2309336Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T06:26:11.2310489Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T06:26:11.2311739Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2025-03-14T06:26:11.2312699Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local ... 2025-03-14T06:26:11.4782212Z 2025-03-14T06:26:11.4783468Z  2025-03-14T06:26:11.4784026Z  2025-03-14T06:26:11.4784484Z  2025-03-14T06:26:11.4785055Z  2025-03-14T06:26:11.4785430Z  2025-03-14T06:26:11.4785815Z  2025-03-14T06:26:11.4786210Z  2025-03-14T06:26:11.4786857Z  2025-03-14T06:26:11.4787835Z [11,766 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:11.4788798Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T06:26:11.4789948Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T06:26:11.4790737Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T06:26:11.4791682Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T06:26:11.4792803Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T06:26:11.4793816Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T06:26:11.4794854Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2025-03-14T06:26:11.4795972Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 17s local ... 2025-03-14T06:26:11.6863046Z 2025-03-14T06:26:11.6863924Z  2025-03-14T06:26:11.6864443Z  2025-03-14T06:26:11.6864904Z  2025-03-14T06:26:11.6865532Z  2025-03-14T06:26:11.6865975Z  2025-03-14T06:26:11.6866410Z  2025-03-14T06:26:11.6866828Z  2025-03-14T06:26:11.6867247Z  2025-03-14T06:26:11.6868198Z [11,767 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:11.6869160Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T06:26:11.6870233Z Compiling src/cpu/cpu_convolution_list.cpp; 63s local 2025-03-14T06:26:11.6871046Z Compiling src/cpu/rnn/ref_rnn.cpp; 55s local 2025-03-14T06:26:11.6871991Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T06:26:11.6873101Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T06:26:11.6874490Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T06:26:11.6875577Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2025-03-14T06:26:11.6876493Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local ... 2025-03-14T06:26:12.0307401Z 2025-03-14T06:26:12.0308403Z  2025-03-14T06:26:12.0308960Z  2025-03-14T06:26:12.0310034Z  2025-03-14T06:26:12.0310505Z  2025-03-14T06:26:12.0310960Z  2025-03-14T06:26:12.0311412Z  2025-03-14T06:26:12.0311858Z  2025-03-14T06:26:12.0312295Z  2025-03-14T06:26:12.0313306Z [11,768 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:12.0314392Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T06:26:12.0315185Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T06:26:12.0315936Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T06:26:12.0316903Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T06:26:12.0318031Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T06:26:12.0319140Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T06:26:12.0320256Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 18s local 2025-03-14T06:26:12.0321167Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local ... 2025-03-14T06:26:12.2312328Z 2025-03-14T06:26:12.2313218Z  2025-03-14T06:26:12.2313778Z  2025-03-14T06:26:12.2314240Z  2025-03-14T06:26:12.2314694Z  2025-03-14T06:26:12.2315109Z  2025-03-14T06:26:12.2315505Z  2025-03-14T06:26:12.2315917Z  2025-03-14T06:26:12.2316297Z  2025-03-14T06:26:12.2317234Z [11,769 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:12.2318217Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T06:26:12.2319223Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T06:26:12.2319997Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T06:26:12.2320933Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T06:26:12.2322203Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T06:26:12.2323336Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T06:26:12.2324761Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2025-03-14T06:26:12.2325761Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 18s local ... 2025-03-14T06:26:12.6317305Z 2025-03-14T06:26:12.6318336Z  2025-03-14T06:26:12.6319011Z  2025-03-14T06:26:12.6319844Z  2025-03-14T06:26:12.6320542Z  2025-03-14T06:26:12.6321008Z  2025-03-14T06:26:12.6321479Z  2025-03-14T06:26:12.6321945Z  2025-03-14T06:26:12.6322407Z  2025-03-14T06:26:12.6323438Z [11,771 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:12.6324385Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T06:26:12.6325299Z Compiling src/cpu/cpu_convolution_list.cpp; 64s local 2025-03-14T06:26:12.6326130Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T06:26:12.6327023Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T06:26:12.6328154Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T06:26:12.6329262Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T06:26:12.6330783Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2025-03-14T06:26:12.6331786Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local ... 2025-03-14T06:26:12.8324249Z 2025-03-14T06:26:12.8325272Z  2025-03-14T06:26:12.8325900Z  2025-03-14T06:26:12.8326408Z  2025-03-14T06:26:12.8326882Z  2025-03-14T06:26:12.8327408Z  2025-03-14T06:26:12.8327877Z  2025-03-14T06:26:12.8328370Z  2025-03-14T06:26:12.8328832Z  2025-03-14T06:26:12.8329933Z [11,775 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:12.8331082Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T06:26:12.8331962Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T06:26:12.8332771Z Compiling src/cpu/rnn/ref_rnn.cpp; 56s local 2025-03-14T06:26:12.8333674Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T06:26:12.8334699Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T06:26:12.8335834Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T06:26:12.8336885Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2025-03-14T06:26:12.8337913Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local ... 2025-03-14T06:26:13.0921432Z 2025-03-14T06:26:13.0922433Z  2025-03-14T06:26:13.0922963Z  2025-03-14T06:26:13.0924093Z  2025-03-14T06:26:13.0924693Z  2025-03-14T06:26:13.0925127Z  2025-03-14T06:26:13.0925611Z  2025-03-14T06:26:13.0926060Z  2025-03-14T06:26:13.0926508Z  2025-03-14T06:26:13.0927508Z [11,777 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:13.0928595Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T06:26:13.0929373Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T06:26:13.0930164Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T06:26:13.0931078Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T06:26:13.0932065Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T06:26:13.0933182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T06:26:13.0934671Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2025-03-14T06:26:13.0935666Z Compiling src/cpu/x64/jit_brgemm_1x1_conv.cpp; 19s local ... 2025-03-14T06:26:13.3332166Z 2025-03-14T06:26:13.3334210Z  2025-03-14T06:26:13.3334906Z  2025-03-14T06:26:13.3335523Z  2025-03-14T06:26:13.3336331Z  2025-03-14T06:26:13.3337020Z  2025-03-14T06:26:13.3337650Z  2025-03-14T06:26:13.3338095Z  2025-03-14T06:26:13.3338543Z  2025-03-14T06:26:13.3339804Z [11,780 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:13.3340896Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T06:26:13.3341688Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T06:26:13.3342480Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T06:26:13.3343419Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T06:26:13.3344547Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T06:26:13.3345655Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T06:26:13.3346673Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T06:26:13.3347640Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2025-03-14T06:26:13.6327624Z 2025-03-14T06:26:13.6329055Z  2025-03-14T06:26:13.6329846Z  2025-03-14T06:26:13.6330503Z  2025-03-14T06:26:13.6330990Z  2025-03-14T06:26:13.6331436Z  2025-03-14T06:26:13.6331877Z  2025-03-14T06:26:13.6332323Z  2025-03-14T06:26:13.6342142Z  2025-03-14T06:26:13.6343551Z [11,781 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:13.6344547Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T06:26:13.6345294Z Compiling src/cpu/cpu_convolution_list.cpp; 65s local 2025-03-14T06:26:13.6346070Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T06:26:13.6346964Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T06:26:13.6348018Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T06:26:13.6349094Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:26:13.6350048Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T06:26:13.6350997Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2025-03-14T06:26:13.8336566Z 2025-03-14T06:26:13.8337392Z  2025-03-14T06:26:13.8337885Z  2025-03-14T06:26:13.8338334Z  2025-03-14T06:26:13.8338728Z  2025-03-14T06:26:13.8339146Z  2025-03-14T06:26:13.8339540Z  2025-03-14T06:26:13.8339956Z  2025-03-14T06:26:13.8340346Z  2025-03-14T06:26:13.8341301Z [11,783 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:13.8342273Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T06:26:13.8342973Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:26:13.8343774Z Compiling src/cpu/rnn/ref_rnn.cpp; 57s local 2025-03-14T06:26:13.8344708Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T06:26:13.8345785Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T06:26:13.8346887Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:26:13.8347781Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T06:26:13.8348621Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2025-03-14T06:26:14.0545040Z 2025-03-14T06:26:14.0546006Z  2025-03-14T06:26:14.0546560Z  2025-03-14T06:26:14.0547659Z  2025-03-14T06:26:14.0548120Z  2025-03-14T06:26:14.0548577Z  2025-03-14T06:26:14.0549026Z  2025-03-14T06:26:14.0549764Z  2025-03-14T06:26:14.0550178Z  2025-03-14T06:26:14.0551212Z [11,786 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:14.0552290Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T06:26:14.0553148Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:26:14.0553853Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:14.0554848Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T06:26:14.0555925Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T06:26:14.0556980Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:26:14.0557957Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T06:26:14.0558871Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 18s local ... 2025-03-14T06:26:14.3043956Z 2025-03-14T06:26:14.3045020Z  2025-03-14T06:26:14.3045577Z  2025-03-14T06:26:14.3045990Z  2025-03-14T06:26:14.3046432Z  2025-03-14T06:26:14.3046879Z  2025-03-14T06:26:14.3047328Z  2025-03-14T06:26:14.3047764Z  2025-03-14T06:26:14.3048205Z  2025-03-14T06:26:14.3049055Z [11,787 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:14.3050024Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T06:26:14.3050731Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:26:14.3051504Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:14.3052635Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T06:26:14.3053684Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T06:26:14.3054688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:26:14.3055627Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T06:26:14.3056468Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local ... 2025-03-14T06:26:14.5229093Z 2025-03-14T06:26:14.5230011Z  2025-03-14T06:26:14.5230576Z  2025-03-14T06:26:14.5231035Z  2025-03-14T06:26:14.5231489Z  2025-03-14T06:26:14.5231952Z  2025-03-14T06:26:14.5232357Z  2025-03-14T06:26:14.5232788Z  2025-03-14T06:26:14.5233208Z  2025-03-14T06:26:14.5234152Z [11,788 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:14.5235109Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T06:26:14.5235906Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:26:14.5236630Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:14.5237487Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T06:26:14.5238511Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T06:26:14.5239539Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:26:14.5240431Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T06:26:14.5241351Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local ... 2025-03-14T06:26:14.7418583Z 2025-03-14T06:26:14.7419752Z  2025-03-14T06:26:14.7420287Z  2025-03-14T06:26:14.7420750Z  2025-03-14T06:26:14.7421173Z  2025-03-14T06:26:14.7421521Z  2025-03-14T06:26:14.7421862Z  2025-03-14T06:26:14.7422235Z  2025-03-14T06:26:14.7422578Z  2025-03-14T06:26:14.7423408Z [11,789 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:14.7424227Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T06:26:14.7424879Z Compiling src/cpu/cpu_convolution_list.cpp; 66s local 2025-03-14T06:26:14.7425556Z Compiling src/cpu/rnn/ref_rnn.cpp; 58s local 2025-03-14T06:26:14.7426567Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T06:26:14.7427492Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T06:26:14.7428410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T06:26:14.7429355Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T06:26:14.7430142Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local ... 2025-03-14T06:26:15.0343394Z 2025-03-14T06:26:15.0344311Z  2025-03-14T06:26:15.0345209Z  2025-03-14T06:26:15.0345689Z  2025-03-14T06:26:15.0346124Z  2025-03-14T06:26:15.0346502Z  2025-03-14T06:26:15.0346916Z  2025-03-14T06:26:15.0347291Z  2025-03-14T06:26:15.0347697Z  2025-03-14T06:26:15.0348677Z [11,790 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:15.0349687Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T06:26:15.0350481Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T06:26:15.0351246Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T06:26:15.0352168Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T06:26:15.0353265Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T06:26:15.0354307Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T06:26:15.0355262Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2025-03-14T06:26:15.0356198Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 19s local ... 2025-03-14T06:26:15.4349076Z 2025-03-14T06:26:15.4349996Z  2025-03-14T06:26:15.4350823Z  2025-03-14T06:26:15.4351285Z  2025-03-14T06:26:15.4351725Z  2025-03-14T06:26:15.4352117Z  2025-03-14T06:26:15.4352501Z  2025-03-14T06:26:15.4352882Z  2025-03-14T06:26:15.4353283Z  2025-03-14T06:26:15.4354189Z [11,792 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:15.4355180Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T06:26:15.4355924Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T06:26:15.4356679Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T06:26:15.4357572Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T06:26:15.4358742Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T06:26:15.4359943Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T06:26:15.4360882Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2025-03-14T06:26:15.4361763Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local ... 2025-03-14T06:26:15.6353659Z 2025-03-14T06:26:15.6354601Z  2025-03-14T06:26:15.6355146Z  2025-03-14T06:26:15.6355585Z  2025-03-14T06:26:15.6356035Z  2025-03-14T06:26:15.6356497Z  2025-03-14T06:26:15.6356921Z  2025-03-14T06:26:15.6357386Z  2025-03-14T06:26:15.6357839Z  2025-03-14T06:26:15.6358845Z [11,793 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:15.6359951Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T06:26:15.6360765Z Compiling src/cpu/cpu_convolution_list.cpp; 67s local 2025-03-14T06:26:15.6361587Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T06:26:15.6362611Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T06:26:15.6363806Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T06:26:15.6365106Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T06:26:15.6366412Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2025-03-14T06:26:15.6367366Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local ... 2025-03-14T06:26:15.9204160Z 2025-03-14T06:26:15.9205228Z  2025-03-14T06:26:15.9205796Z  2025-03-14T06:26:15.9206263Z  2025-03-14T06:26:15.9206730Z  2025-03-14T06:26:15.9207143Z  2025-03-14T06:26:15.9207552Z  2025-03-14T06:26:15.9207968Z  2025-03-14T06:26:15.9208637Z  2025-03-14T06:26:15.9209552Z [11,794 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:15.9210485Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T06:26:15.9211503Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T06:26:15.9212265Z Compiling src/cpu/rnn/ref_rnn.cpp; 59s local 2025-03-14T06:26:15.9213184Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T06:26:15.9214330Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T06:26:15.9215399Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T06:26:15.9216368Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:26:15.9217286Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local ... 2025-03-14T06:26:16.1689640Z 2025-03-14T06:26:16.1690836Z  2025-03-14T06:26:16.1691393Z  2025-03-14T06:26:16.1691930Z  2025-03-14T06:26:16.1692356Z  2025-03-14T06:26:16.1692755Z  2025-03-14T06:26:16.1693186Z  2025-03-14T06:26:16.1693604Z  2025-03-14T06:26:16.1694005Z  2025-03-14T06:26:16.1694954Z [11,795 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:16.1695956Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T06:26:16.1697001Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T06:26:16.1697824Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T06:26:16.1698788Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T06:26:16.1699939Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T06:26:16.1701112Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T06:26:16.1702113Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:26:16.1703039Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 20s local ... 2025-03-14T06:26:16.4225065Z 2025-03-14T06:26:16.4225951Z  2025-03-14T06:26:16.4226512Z  2025-03-14T06:26:16.4226963Z  2025-03-14T06:26:16.4227405Z  2025-03-14T06:26:16.4227857Z  2025-03-14T06:26:16.4228257Z  2025-03-14T06:26:16.4228655Z  2025-03-14T06:26:16.4229048Z  2025-03-14T06:26:16.4230016Z [11,797 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:16.4230965Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T06:26:16.4231703Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T06:26:16.4232467Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T06:26:16.4233427Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T06:26:16.4234470Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T06:26:16.4235549Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T06:26:16.4236551Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:26:16.4237461Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local ... 2025-03-14T06:26:16.6361876Z 2025-03-14T06:26:16.6362798Z  2025-03-14T06:26:16.6363273Z  2025-03-14T06:26:16.6363674Z  2025-03-14T06:26:16.6364084Z  2025-03-14T06:26:16.6364677Z  2025-03-14T06:26:16.6365071Z  2025-03-14T06:26:16.6365687Z  2025-03-14T06:26:16.6366106Z  2025-03-14T06:26:16.6367057Z [11,797 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:16.6368306Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T06:26:16.6369070Z Compiling src/cpu/cpu_convolution_list.cpp; 68s local 2025-03-14T06:26:16.6369798Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T06:26:16.6370732Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T06:26:16.6371986Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T06:26:16.6373060Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T06:26:16.6374248Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:26:16.6375220Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local ... 2025-03-14T06:26:16.8672595Z 2025-03-14T06:26:16.8673457Z  2025-03-14T06:26:16.8673946Z  2025-03-14T06:26:16.8674415Z  2025-03-14T06:26:16.8674833Z  2025-03-14T06:26:16.8675252Z  2025-03-14T06:26:16.8675676Z  2025-03-14T06:26:16.8676106Z  2025-03-14T06:26:16.8676549Z  2025-03-14T06:26:16.8677520Z [11,799 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:16.8678498Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T06:26:16.8679284Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2025-03-14T06:26:16.8680083Z Compiling src/cpu/rnn/ref_rnn.cpp; 60s local 2025-03-14T06:26:16.8681035Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T06:26:16.8682199Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T06:26:16.8683345Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T06:26:16.8685342Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:26:16.8686454Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 21s local ... 2025-03-14T06:26:17.2369049Z 2025-03-14T06:26:17.2369924Z  2025-03-14T06:26:17.2370382Z  2025-03-14T06:26:17.2370818Z  2025-03-14T06:26:17.2371243Z  2025-03-14T06:26:17.2371662Z  2025-03-14T06:26:17.2372089Z  2025-03-14T06:26:17.2372525Z  2025-03-14T06:26:17.2372938Z  2025-03-14T06:26:17.2373931Z [11,800 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:17.2374980Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T06:26:17.2375796Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2025-03-14T06:26:17.2376627Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T06:26:17.2377615Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T06:26:17.2378789Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T06:26:17.2379876Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T06:26:17.2380848Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T06:26:17.2381802Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local ... 2025-03-14T06:26:17.5821366Z 2025-03-14T06:26:17.5822309Z  2025-03-14T06:26:17.5822868Z  2025-03-14T06:26:17.5823326Z  2025-03-14T06:26:17.5823769Z  2025-03-14T06:26:17.5824182Z  2025-03-14T06:26:17.5824702Z  2025-03-14T06:26:17.5825114Z  2025-03-14T06:26:17.5825483Z  2025-03-14T06:26:17.5826404Z [11,801 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:17.5827372Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T06:26:17.5828149Z Compiling src/cpu/cpu_convolution_list.cpp; 69s local 2025-03-14T06:26:17.5828896Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T06:26:17.5829834Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T06:26:17.5830856Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T06:26:17.5831918Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T06:26:17.5833173Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T06:26:17.5834113Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local ... 2025-03-14T06:26:17.8376625Z 2025-03-14T06:26:17.8377830Z  2025-03-14T06:26:17.8378384Z  2025-03-14T06:26:17.8378832Z  2025-03-14T06:26:17.8379276Z  2025-03-14T06:26:17.8379726Z  2025-03-14T06:26:17.8380193Z  2025-03-14T06:26:17.8380718Z  2025-03-14T06:26:17.8381371Z  2025-03-14T06:26:17.8382433Z [11,803 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:17.8383348Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T06:26:17.8384055Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T06:26:17.8384809Z Compiling src/cpu/rnn/ref_rnn.cpp; 61s local 2025-03-14T06:26:17.8385814Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T06:26:17.8386943Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T06:26:17.8388070Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T06:26:17.8389138Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T06:26:17.8390074Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local ... 2025-03-14T06:26:18.2008460Z 2025-03-14T06:26:18.2009344Z  2025-03-14T06:26:18.2009857Z  2025-03-14T06:26:18.2010289Z  2025-03-14T06:26:18.2010727Z  2025-03-14T06:26:18.2011161Z  2025-03-14T06:26:18.2011590Z  2025-03-14T06:26:18.2012012Z  2025-03-14T06:26:18.2012685Z  2025-03-14T06:26:18.2013674Z [11,804 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:18.2014680Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T06:26:18.2015485Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T06:26:18.2016292Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T06:26:18.2017263Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T06:26:18.2018388Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T06:26:18.2019526Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T06:26:18.2020566Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T06:26:18.2021509Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 22s local ... 2025-03-14T06:26:18.4382787Z 2025-03-14T06:26:18.4383688Z  2025-03-14T06:26:18.4384256Z  2025-03-14T06:26:18.4384746Z  2025-03-14T06:26:18.4385200Z  2025-03-14T06:26:18.4385633Z  2025-03-14T06:26:18.4386103Z  2025-03-14T06:26:18.4386520Z  2025-03-14T06:26:18.4386930Z  2025-03-14T06:26:18.4387897Z [11,806 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:18.4388945Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T06:26:18.4389752Z Compiling src/cpu/cpu_convolution_list.cpp; 70s local 2025-03-14T06:26:18.4390561Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T06:26:18.4391523Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T06:26:18.4392632Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T06:26:18.4393725Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T06:26:18.4394752Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T06:26:18.4395740Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local ... 2025-03-14T06:26:18.8387900Z 2025-03-14T06:26:18.8388858Z  2025-03-14T06:26:18.8389423Z  2025-03-14T06:26:18.8389856Z  2025-03-14T06:26:18.8390314Z  2025-03-14T06:26:18.8390726Z  2025-03-14T06:26:18.8391219Z  2025-03-14T06:26:18.8391889Z  2025-03-14T06:26:18.8392265Z  2025-03-14T06:26:18.8393227Z [11,807 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:18.8394200Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T06:26:18.8395156Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2025-03-14T06:26:18.8395916Z Compiling src/cpu/rnn/ref_rnn.cpp; 62s local 2025-03-14T06:26:18.8396931Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T06:26:18.8398095Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T06:26:18.8399234Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T06:26:18.8400235Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T06:26:18.8401181Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local ... 2025-03-14T06:26:19.0392594Z 2025-03-14T06:26:19.0393533Z  2025-03-14T06:26:19.0394134Z  2025-03-14T06:26:19.0394584Z  2025-03-14T06:26:19.0395036Z  2025-03-14T06:26:19.0395466Z  2025-03-14T06:26:19.0395946Z  2025-03-14T06:26:19.0396336Z  2025-03-14T06:26:19.0396736Z  2025-03-14T06:26:19.0397731Z [11,809 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:19.0398788Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T06:26:19.0399626Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2025-03-14T06:26:19.0400366Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T06:26:19.0401553Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T06:26:19.0402574Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T06:26:19.0403662Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T06:26:19.0404810Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T06:26:19.0405620Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 23s local ... 2025-03-14T06:26:19.3644609Z 2025-03-14T06:26:19.3645518Z  2025-03-14T06:26:19.3646073Z  2025-03-14T06:26:19.3646527Z  2025-03-14T06:26:19.3646972Z  2025-03-14T06:26:19.3647420Z  2025-03-14T06:26:19.3647894Z  2025-03-14T06:26:19.3648325Z  2025-03-14T06:26:19.3648756Z  2025-03-14T06:26:19.3649771Z [11,810 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:19.3650824Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T06:26:19.3651621Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2025-03-14T06:26:19.3652401Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T06:26:19.3653337Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T06:26:19.3654454Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T06:26:19.3655584Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T06:26:19.3656616Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T06:26:19.3657555Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local ... 2025-03-14T06:26:19.5974924Z 2025-03-14T06:26:19.5975880Z  2025-03-14T06:26:19.5976424Z  2025-03-14T06:26:19.5976884Z  2025-03-14T06:26:19.5977334Z  2025-03-14T06:26:19.5977767Z  2025-03-14T06:26:19.5978244Z  2025-03-14T06:26:19.5978686Z  2025-03-14T06:26:19.5979090Z  2025-03-14T06:26:19.5980179Z [11,813 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:19.5981134Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T06:26:19.5981896Z Compiling src/cpu/cpu_convolution_list.cpp; 71s local 2025-03-14T06:26:19.5982675Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T06:26:19.5983824Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T06:26:19.5984943Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T06:26:19.5986078Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T06:26:19.5987145Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T06:26:19.5988060Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local ... 2025-03-14T06:26:19.8399535Z 2025-03-14T06:26:19.8400418Z  2025-03-14T06:26:19.8401247Z  2025-03-14T06:26:19.8401710Z  2025-03-14T06:26:19.8402107Z  2025-03-14T06:26:19.8402533Z  2025-03-14T06:26:19.8402963Z  2025-03-14T06:26:19.8403378Z  2025-03-14T06:26:19.8403786Z  2025-03-14T06:26:19.8404915Z [11,814 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:19.8405931Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2025-03-14T06:26:19.8406660Z Compiling src/cpu/rnn/ref_rnn.cpp; 63s local 2025-03-14T06:26:19.8407552Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T06:26:19.8408626Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T06:26:19.8409663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T06:26:19.8410655Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T06:26:19.8411561Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 24s local 2025-03-14T06:26:19.8412579Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local ... 2025-03-14T06:26:20.8409039Z 2025-03-14T06:26:20.8410130Z  2025-03-14T06:26:20.8410693Z  2025-03-14T06:26:20.8411140Z  2025-03-14T06:26:20.8411520Z  2025-03-14T06:26:20.8411974Z  2025-03-14T06:26:20.8412416Z  2025-03-14T06:26:20.8412862Z  2025-03-14T06:26:20.8413288Z  2025-03-14T06:26:20.8414308Z [11,814 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:20.8415221Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T06:26:20.8415909Z Compiling src/cpu/rnn/ref_rnn.cpp; 64s local 2025-03-14T06:26:20.8416873Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2025-03-14T06:26:20.8417982Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T06:26:20.8419236Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T06:26:20.8420167Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T06:26:20.8421020Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2025-03-14T06:26:20.8422041Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local ... 2025-03-14T06:26:21.1923830Z 2025-03-14T06:26:21.1924860Z  2025-03-14T06:26:21.1925383Z  2025-03-14T06:26:21.1925773Z  2025-03-14T06:26:21.1926154Z  2025-03-14T06:26:21.1926619Z  2025-03-14T06:26:21.1927008Z  2025-03-14T06:26:21.1927448Z  2025-03-14T06:26:21.1927859Z  2025-03-14T06:26:21.1928884Z [11,815 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:21.1929901Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T06:26:21.1930635Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T06:26:21.1931540Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T06:26:21.1932657Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T06:26:21.1933797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T06:26:21.1934984Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T06:26:21.1935872Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 25s local 2025-03-14T06:26:21.1936899Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local ... 2025-03-14T06:26:21.4417747Z 2025-03-14T06:26:21.4418619Z  2025-03-14T06:26:21.4419131Z  2025-03-14T06:26:21.4419570Z  2025-03-14T06:26:21.4419993Z  2025-03-14T06:26:21.4420356Z  2025-03-14T06:26:21.4420684Z  2025-03-14T06:26:21.4421356Z  2025-03-14T06:26:21.4421761Z  2025-03-14T06:26:21.4422648Z [11,815 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:21.4423690Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T06:26:21.4424420Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T06:26:21.4425416Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T06:26:21.4426714Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T06:26:21.4428000Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T06:26:21.4429030Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T06:26:21.4429965Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T06:26:21.4431072Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local ... 2025-03-14T06:26:21.6557378Z 2025-03-14T06:26:21.6558510Z  2025-03-14T06:26:21.6559087Z  2025-03-14T06:26:21.6559541Z  2025-03-14T06:26:21.6559929Z  2025-03-14T06:26:21.6560341Z  2025-03-14T06:26:21.6560902Z  2025-03-14T06:26:21.6561263Z  2025-03-14T06:26:21.6561666Z  2025-03-14T06:26:21.6562602Z [11,816 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:21.6563811Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T06:26:21.6564666Z Compiling src/cpu/rnn/ref_rnn.cpp; 65s local 2025-03-14T06:26:21.6565832Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T06:26:21.6566844Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T06:26:21.6567897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T06:26:21.6568735Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T06:26:21.6569433Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T06:26:21.6570422Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local ... 2025-03-14T06:26:22.0422731Z 2025-03-14T06:26:22.0423751Z  2025-03-14T06:26:22.0424438Z  2025-03-14T06:26:22.0424903Z  2025-03-14T06:26:22.0425327Z  2025-03-14T06:26:22.0425699Z  2025-03-14T06:26:22.0426057Z  2025-03-14T06:26:22.0426458Z  2025-03-14T06:26:22.0426871Z  2025-03-14T06:26:22.0427815Z [11,816 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:22.0428839Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T06:26:22.0429529Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T06:26:22.0430440Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:26:22.0431541Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T06:26:22.0432606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T06:26:22.0433590Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T06:26:22.0434459Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 26s local 2025-03-14T06:26:22.0435450Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local ... 2025-03-14T06:26:22.2947697Z 2025-03-14T06:26:22.2948526Z  2025-03-14T06:26:22.2949037Z  2025-03-14T06:26:22.2949482Z  2025-03-14T06:26:22.2949881Z  2025-03-14T06:26:22.2950279Z  2025-03-14T06:26:22.2950695Z  2025-03-14T06:26:22.2951109Z  2025-03-14T06:26:22.2951549Z  2025-03-14T06:26:22.2952494Z [11,817 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:22.2953770Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T06:26:22.2954397Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T06:26:22.2955261Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:26:22.2956489Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T06:26:22.2957573Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T06:26:22.2958708Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T06:26:22.2959649Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T06:26:22.2960627Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local ... 2025-03-14T06:26:22.5077406Z 2025-03-14T06:26:22.5078329Z  2025-03-14T06:26:22.5078766Z  2025-03-14T06:26:22.5079141Z  2025-03-14T06:26:22.5079521Z  2025-03-14T06:26:22.5079903Z  2025-03-14T06:26:22.5080282Z  2025-03-14T06:26:22.5080681Z  2025-03-14T06:26:22.5081059Z  2025-03-14T06:26:22.5081930Z [11,818 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:22.5082870Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T06:26:22.5083539Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T06:26:22.5084339Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:26:22.5085431Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T06:26:22.5086401Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T06:26:22.5087520Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T06:26:22.5088346Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T06:26:22.5089274Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local ... 2025-03-14T06:26:22.8429945Z 2025-03-14T06:26:22.8430839Z  2025-03-14T06:26:22.8431397Z  2025-03-14T06:26:22.8431852Z  2025-03-14T06:26:22.8432272Z  2025-03-14T06:26:22.8432754Z  2025-03-14T06:26:22.8433175Z  2025-03-14T06:26:22.8433579Z  2025-03-14T06:26:22.8433961Z  2025-03-14T06:26:22.8434902Z [11,819 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:22.8435876Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T06:26:22.8436605Z Compiling src/cpu/rnn/ref_rnn.cpp; 66s local 2025-03-14T06:26:22.8437538Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:26:22.8438611Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T06:26:22.8439627Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T06:26:22.8440566Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T06:26:22.8441454Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T06:26:22.8442524Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local ... 2025-03-14T06:26:23.0551122Z 2025-03-14T06:26:23.0552005Z  2025-03-14T06:26:23.0552470Z  2025-03-14T06:26:23.0552872Z  2025-03-14T06:26:23.0553300Z  2025-03-14T06:26:23.0553686Z  2025-03-14T06:26:23.0554080Z  2025-03-14T06:26:23.0554480Z  2025-03-14T06:26:23.0554875Z  2025-03-14T06:26:23.0555807Z [11,820 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:23.0556745Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T06:26:23.0557475Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T06:26:23.0558334Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T06:26:23.0559481Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T06:26:23.0560497Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T06:26:23.0561645Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T06:26:23.0562495Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 27s local 2025-03-14T06:26:23.0563412Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local ... 2025-03-14T06:26:23.4436819Z 2025-03-14T06:26:23.4437630Z  2025-03-14T06:26:23.4438111Z  2025-03-14T06:26:23.4438504Z  2025-03-14T06:26:23.4438905Z  2025-03-14T06:26:23.4439295Z  2025-03-14T06:26:23.4439940Z  2025-03-14T06:26:23.4440326Z  2025-03-14T06:26:23.4440744Z  2025-03-14T06:26:23.4441685Z [11,821 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:23.4442625Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T06:26:23.4443285Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T06:26:23.4444163Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T06:26:23.4445397Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T06:26:23.4446411Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T06:26:23.4447394Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T06:26:23.4448259Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2025-03-14T06:26:23.4449234Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local ... 2025-03-14T06:26:23.8005701Z 2025-03-14T06:26:23.8006612Z  2025-03-14T06:26:23.8007173Z  2025-03-14T06:26:23.8007630Z  2025-03-14T06:26:23.8008090Z  2025-03-14T06:26:23.8008517Z  2025-03-14T06:26:23.8009178Z  2025-03-14T06:26:23.8009590Z  2025-03-14T06:26:23.8010035Z  2025-03-14T06:26:23.8011043Z [11,822 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:23.8012122Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T06:26:23.8012916Z Compiling src/cpu/rnn/ref_rnn.cpp; 67s local 2025-03-14T06:26:23.8013941Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T06:26:23.8015124Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T06:26:23.8016277Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2025-03-14T06:26:23.8017358Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T06:26:23.8018362Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2025-03-14T06:26:23.8019471Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local ... 2025-03-14T06:26:24.0443145Z 2025-03-14T06:26:24.0444014Z  2025-03-14T06:26:24.0444656Z  2025-03-14T06:26:24.0445094Z  2025-03-14T06:26:24.0445481Z  2025-03-14T06:26:24.0445865Z  2025-03-14T06:26:24.0446232Z  2025-03-14T06:26:24.0446647Z  2025-03-14T06:26:24.0447055Z  2025-03-14T06:26:24.0448016Z [11,822 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:24.0449015Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T06:26:24.0449761Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T06:26:24.0450713Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T06:26:24.0451804Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T06:26:24.0452895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2025-03-14T06:26:24.0453889Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:26:24.0454810Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 28s local 2025-03-14T06:26:24.0455835Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local ... 2025-03-14T06:26:24.2983147Z 2025-03-14T06:26:24.2983984Z  2025-03-14T06:26:24.2984494Z  2025-03-14T06:26:24.2984926Z  2025-03-14T06:26:24.2985630Z  2025-03-14T06:26:24.2986069Z  2025-03-14T06:26:24.2986504Z  2025-03-14T06:26:24.2986934Z  2025-03-14T06:26:24.2987368Z  2025-03-14T06:26:24.2988379Z [11,824 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:24.2989547Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T06:26:24.2990249Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T06:26:24.2991294Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T06:26:24.2992869Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T06:26:24.2994119Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2025-03-14T06:26:24.2995247Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:26:24.2996300Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T06:26:24.2997458Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local ... 2025-03-14T06:26:24.6450169Z 2025-03-14T06:26:24.6451057Z  2025-03-14T06:26:24.6451535Z  2025-03-14T06:26:24.6451944Z  2025-03-14T06:26:24.6452327Z  2025-03-14T06:26:24.6452705Z  2025-03-14T06:26:24.6453120Z  2025-03-14T06:26:24.6453497Z  2025-03-14T06:26:24.6453886Z  2025-03-14T06:26:24.6454798Z [11,826 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:24.6455841Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T06:26:24.6456546Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T06:26:24.6457711Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T06:26:24.6458802Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:24.6459824Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T06:26:24.6460812Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:26:24.6461706Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T06:26:24.6462752Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local ... 2025-03-14T06:26:24.8455698Z 2025-03-14T06:26:24.8456694Z  2025-03-14T06:26:24.8457232Z  2025-03-14T06:26:24.8458895Z  2025-03-14T06:26:24.8460054Z  2025-03-14T06:26:24.8460571Z  2025-03-14T06:26:24.8461073Z  2025-03-14T06:26:24.8461593Z  2025-03-14T06:26:24.8462113Z  2025-03-14T06:26:24.8463148Z [11,827 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:24.8464168Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T06:26:24.8464961Z Compiling src/cpu/rnn/ref_rnn.cpp; 68s local 2025-03-14T06:26:24.8466249Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T06:26:24.8467290Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:24.8468456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T06:26:24.8469505Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:26:24.8470412Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 29s local 2025-03-14T06:26:24.8471460Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local ... 2025-03-14T06:26:25.2460639Z 2025-03-14T06:26:25.2461934Z  2025-03-14T06:26:25.2462752Z  2025-03-14T06:26:25.2463973Z  2025-03-14T06:26:25.2464501Z  2025-03-14T06:26:25.2464926Z  2025-03-14T06:26:25.2465604Z  2025-03-14T06:26:25.2466267Z  2025-03-14T06:26:25.2466693Z  2025-03-14T06:26:25.2467663Z [11,829 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:25.2468670Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T06:26:25.2469376Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T06:26:25.2470586Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T06:26:25.2471692Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:25.2472793Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T06:26:25.2474056Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T06:26:25.2474996Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T06:26:25.2476186Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local ... 2025-03-14T06:26:25.5822310Z 2025-03-14T06:26:25.5823569Z  2025-03-14T06:26:25.5824084Z  2025-03-14T06:26:25.5824530Z  2025-03-14T06:26:25.5824925Z  2025-03-14T06:26:25.5825331Z  2025-03-14T06:26:25.5825726Z  2025-03-14T06:26:25.5826085Z  2025-03-14T06:26:25.5826471Z  2025-03-14T06:26:25.5827408Z [11,831 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:25.5828358Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T06:26:25.5829044Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T06:26:25.5829974Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T06:26:25.5831106Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:25.5832228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T06:26:25.5833296Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T06:26:25.5834200Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T06:26:25.5835491Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local ... 2025-03-14T06:26:25.8467988Z 2025-03-14T06:26:25.8468857Z  2025-03-14T06:26:25.8469370Z  2025-03-14T06:26:25.8469737Z  2025-03-14T06:26:25.8470162Z  2025-03-14T06:26:25.8470575Z  2025-03-14T06:26:25.8471036Z  2025-03-14T06:26:25.8471452Z  2025-03-14T06:26:25.8471871Z  2025-03-14T06:26:25.8472865Z [11,832 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:25.8473900Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T06:26:25.8474638Z Compiling src/cpu/rnn/ref_rnn.cpp; 69s local 2025-03-14T06:26:25.8475589Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T06:26:25.8476712Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T06:26:25.8477801Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T06:26:25.8478823Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T06:26:25.8479743Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T06:26:25.8480778Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local ... 2025-03-14T06:26:26.0472113Z 2025-03-14T06:26:26.0472995Z  2025-03-14T06:26:26.0473532Z  2025-03-14T06:26:26.0473977Z  2025-03-14T06:26:26.0474421Z  2025-03-14T06:26:26.0474863Z  2025-03-14T06:26:26.0475300Z  2025-03-14T06:26:26.0475729Z  2025-03-14T06:26:26.0476183Z  2025-03-14T06:26:26.0477190Z [11,833 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:26.0478273Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T06:26:26.0479081Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T06:26:26.0480096Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T06:26:26.0481289Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T06:26:26.0482470Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T06:26:26.0483535Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T06:26:26.0484642Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 30s local 2025-03-14T06:26:26.0486008Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local ... 2025-03-14T06:26:26.4477889Z 2025-03-14T06:26:26.4478853Z  2025-03-14T06:26:26.4479363Z  2025-03-14T06:26:26.4480066Z  2025-03-14T06:26:26.4480506Z  2025-03-14T06:26:26.4480963Z  2025-03-14T06:26:26.4481406Z  2025-03-14T06:26:26.4481847Z  2025-03-14T06:26:26.4491465Z  2025-03-14T06:26:26.4493009Z [11,835 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:26.4494044Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T06:26:26.4494830Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T06:26:26.4495846Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T06:26:26.4497037Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T06:26:26.4498207Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T06:26:26.4499205Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T06:26:26.4500082Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T06:26:26.4501110Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local ... 2025-03-14T06:26:26.8075294Z 2025-03-14T06:26:26.8076571Z  2025-03-14T06:26:26.8077041Z  2025-03-14T06:26:26.8077437Z  2025-03-14T06:26:26.8077834Z  2025-03-14T06:26:26.8078262Z  2025-03-14T06:26:26.8078671Z  2025-03-14T06:26:26.8079076Z  2025-03-14T06:26:26.8079447Z  2025-03-14T06:26:26.8080618Z [11,836 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:26.8081573Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T06:26:26.8082251Z Compiling src/cpu/rnn/ref_rnn.cpp; 70s local 2025-03-14T06:26:26.8083123Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T06:26:26.8084177Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T06:26:26.8085391Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T06:26:26.8086370Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T06:26:26.8087269Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T06:26:26.8088257Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local ... 2025-03-14T06:26:27.0484521Z 2025-03-14T06:26:27.0485469Z  2025-03-14T06:26:27.0485984Z  2025-03-14T06:26:27.0486413Z  2025-03-14T06:26:27.0486830Z  2025-03-14T06:26:27.0487268Z  2025-03-14T06:26:27.0487651Z  2025-03-14T06:26:27.0488024Z  2025-03-14T06:26:27.0488410Z  2025-03-14T06:26:27.0489381Z [11,836 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:27.0490290Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T06:26:27.0490954Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T06:26:27.0491784Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T06:26:27.0492772Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T06:26:27.0493766Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T06:26:27.0494742Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T06:26:27.0495578Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 31s local 2025-03-14T06:26:27.0496553Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local ... 2025-03-14T06:26:27.3165898Z 2025-03-14T06:26:27.3166854Z  2025-03-14T06:26:27.3167435Z  2025-03-14T06:26:27.3167859Z  2025-03-14T06:26:27.3168261Z  2025-03-14T06:26:27.3168644Z  2025-03-14T06:26:27.3169030Z  2025-03-14T06:26:27.3169420Z  2025-03-14T06:26:27.3170105Z  2025-03-14T06:26:27.3171044Z [11,840 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:27.3171972Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T06:26:27.3172720Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T06:26:27.3173777Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T06:26:27.3174795Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T06:26:27.3175996Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T06:26:27.3176990Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T06:26:27.3177841Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T06:26:27.3178815Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local ... 2025-03-14T06:26:27.5488722Z 2025-03-14T06:26:27.5489668Z  2025-03-14T06:26:27.5490163Z  2025-03-14T06:26:27.5490617Z  2025-03-14T06:26:27.5490981Z  2025-03-14T06:26:27.5491364Z  2025-03-14T06:26:27.5491780Z  2025-03-14T06:26:27.5492191Z  2025-03-14T06:26:27.5492594Z  2025-03-14T06:26:27.5493545Z [11,843 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:27.5494564Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T06:26:27.5495323Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T06:26:27.5496192Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T06:26:27.5497295Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T06:26:27.5498572Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T06:26:27.5499489Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T06:26:27.5500472Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T06:26:27.5501349Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 14s local ... 2025-03-14T06:26:27.8492135Z 2025-03-14T06:26:27.8493082Z  2025-03-14T06:26:27.8493609Z  2025-03-14T06:26:27.8494058Z  2025-03-14T06:26:27.8494463Z  2025-03-14T06:26:27.8494896Z  2025-03-14T06:26:27.8495313Z  2025-03-14T06:26:27.8495714Z  2025-03-14T06:26:27.8496130Z  2025-03-14T06:26:27.8497107Z [11,844 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:27.8498101Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T06:26:27.8498822Z Compiling src/cpu/rnn/ref_rnn.cpp; 71s local 2025-03-14T06:26:27.8499702Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T06:26:27.8500761Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T06:26:27.8501792Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T06:26:27.8502741Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 32s local 2025-03-14T06:26:27.8503687Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T06:26:27.8504552Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 15s local ... 2025-03-14T06:26:28.4574741Z 2025-03-14T06:26:28.4576114Z  2025-03-14T06:26:28.4576553Z  2025-03-14T06:26:28.4576924Z  2025-03-14T06:26:28.4577317Z  2025-03-14T06:26:28.4577689Z  2025-03-14T06:26:28.4578036Z  2025-03-14T06:26:28.4578387Z  2025-03-14T06:26:28.4578753Z  2025-03-14T06:26:28.4579555Z [11,847 / 20,650] 3 / 17 tests; 47 actions, 45 running; last test: ...ash_test 2025-03-14T06:26:28.4580398Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T06:26:28.4580967Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T06:26:28.4581647Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T06:26:28.4582521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T06:26:28.4583581Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T06:26:28.4584334Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T06:26:28.4585136Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T06:26:28.4586139Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 15s local ... 2025-03-14T06:26:28.8500134Z 2025-03-14T06:26:28.8501026Z  2025-03-14T06:26:28.8501519Z  2025-03-14T06:26:28.8501929Z  2025-03-14T06:26:28.8502634Z  2025-03-14T06:26:28.8503106Z  2025-03-14T06:26:28.8503469Z  2025-03-14T06:26:28.8503858Z  2025-03-14T06:26:28.8504260Z  2025-03-14T06:26:28.8505356Z [11,848 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:28.8506305Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T06:26:28.8507135Z Compiling src/cpu/rnn/ref_rnn.cpp; 72s local 2025-03-14T06:26:28.8507981Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T06:26:28.8509002Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T06:26:28.8509973Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T06:26:28.8510854Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T06:26:28.8511825Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T06:26:28.8512742Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local ... 2025-03-14T06:26:29.0505028Z 2025-03-14T06:26:29.0505907Z  2025-03-14T06:26:29.0506412Z  2025-03-14T06:26:29.0506842Z  2025-03-14T06:26:29.0507562Z  2025-03-14T06:26:29.0507977Z  2025-03-14T06:26:29.0508412Z  2025-03-14T06:26:29.0508841Z  2025-03-14T06:26:29.0509298Z  2025-03-14T06:26:29.0510336Z [11,849 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:29.0511397Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T06:26:29.0512139Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T06:26:29.0513041Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T06:26:29.0514201Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T06:26:29.0515765Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T06:26:29.0516900Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 33s local 2025-03-14T06:26:29.0518042Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T06:26:29.0519287Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local ... 2025-03-14T06:26:29.3262408Z 2025-03-14T06:26:29.3263516Z  2025-03-14T06:26:29.3264056Z  2025-03-14T06:26:29.3264494Z  2025-03-14T06:26:29.3264891Z  2025-03-14T06:26:29.3265553Z  2025-03-14T06:26:29.3265994Z  2025-03-14T06:26:29.3266360Z  2025-03-14T06:26:29.3266804Z  2025-03-14T06:26:29.3267986Z [11,850 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:29.3268979Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T06:26:29.3269766Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T06:26:29.3270655Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T06:26:29.3271760Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T06:26:29.3272810Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T06:26:29.3273803Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T06:26:29.3274840Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T06:26:29.3275791Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local ... 2025-03-14T06:26:29.6510661Z 2025-03-14T06:26:29.6511900Z  2025-03-14T06:26:29.6512452Z  2025-03-14T06:26:29.6513120Z  2025-03-14T06:26:29.6513536Z  2025-03-14T06:26:29.6513944Z  2025-03-14T06:26:29.6514344Z  2025-03-14T06:26:29.6514736Z  2025-03-14T06:26:29.6515115Z  2025-03-14T06:26:29.6516068Z [11,850 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:29.6517267Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T06:26:29.6517979Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T06:26:29.6518962Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T06:26:29.6519976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T06:26:29.6520874Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T06:26:29.6521766Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T06:26:29.6522743Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T06:26:29.6523610Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 16s local ... 2025-03-14T06:26:29.9157361Z 2025-03-14T06:26:29.9158633Z  2025-03-14T06:26:29.9159109Z  2025-03-14T06:26:29.9159501Z  2025-03-14T06:26:29.9159889Z  2025-03-14T06:26:29.9160303Z  2025-03-14T06:26:29.9160740Z  2025-03-14T06:26:29.9161133Z  2025-03-14T06:26:29.9161560Z  2025-03-14T06:26:29.9162519Z [11,852 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:29.9163557Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T06:26:29.9164275Z Compiling src/cpu/rnn/ref_rnn.cpp; 73s local 2025-03-14T06:26:29.9165790Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T06:26:29.9166870Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T06:26:29.9167751Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T06:26:29.9168648Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 34s local 2025-03-14T06:26:29.9169640Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T06:26:29.9170555Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local ... 2025-03-14T06:26:30.2518678Z 2025-03-14T06:26:30.2519510Z  2025-03-14T06:26:30.2520004Z  2025-03-14T06:26:30.2520415Z  2025-03-14T06:26:30.2520804Z  2025-03-14T06:26:30.2521198Z  2025-03-14T06:26:30.2521586Z  2025-03-14T06:26:30.2521979Z  2025-03-14T06:26:30.2522361Z  2025-03-14T06:26:30.2523291Z [11,854 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:30.2524369Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T06:26:30.2525249Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2025-03-14T06:26:30.2526066Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T06:26:30.2527120Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T06:26:30.2528015Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T06:26:30.2528807Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T06:26:30.2529721Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T06:26:30.2530634Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local ... 2025-03-14T06:26:30.5944258Z 2025-03-14T06:26:30.5945260Z  2025-03-14T06:26:30.5945736Z  2025-03-14T06:26:30.5946135Z  2025-03-14T06:26:30.5946575Z  2025-03-14T06:26:30.5946962Z  2025-03-14T06:26:30.5947356Z  2025-03-14T06:26:30.5947749Z  2025-03-14T06:26:30.5948166Z  2025-03-14T06:26:30.5949132Z [11,855 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:30.5950093Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T06:26:30.5950795Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2025-03-14T06:26:30.5951918Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T06:26:30.5952966Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T06:26:30.5953927Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T06:26:30.5954970Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T06:26:30.5955947Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T06:26:30.5957025Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 17s local ... 2025-03-14T06:26:30.7963003Z 2025-03-14T06:26:30.7963958Z  2025-03-14T06:26:30.7964509Z  2025-03-14T06:26:30.7964892Z  2025-03-14T06:26:30.7965472Z  2025-03-14T06:26:30.7965845Z  2025-03-14T06:26:30.7966373Z  2025-03-14T06:26:30.7966792Z  2025-03-14T06:26:30.7967161Z  2025-03-14T06:26:30.7968241Z [11,859 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:30.7969181Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T06:26:30.7969834Z Compiling src/cpu/rnn/ref_rnn.cpp; 74s local 2025-03-14T06:26:30.7970610Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T06:26:30.7971699Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T06:26:30.7972619Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T06:26:30.7973427Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T06:26:30.7974190Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2025-03-14T06:26:30.7975330Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local ... 2025-03-14T06:26:31.0526332Z 2025-03-14T06:26:31.0527321Z  2025-03-14T06:26:31.0527827Z  2025-03-14T06:26:31.0528222Z  2025-03-14T06:26:31.0528621Z  2025-03-14T06:26:31.0529025Z  2025-03-14T06:26:31.0529442Z  2025-03-14T06:26:31.0529884Z  2025-03-14T06:26:31.0530335Z  2025-03-14T06:26:31.0531556Z [11,861 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:31.0532601Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T06:26:31.0533356Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T06:26:31.0534225Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T06:26:31.0535376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T06:26:31.0536440Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T06:26:31.0537385Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 35s local 2025-03-14T06:26:31.0538326Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2025-03-14T06:26:31.0539257Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local ... 2025-03-14T06:26:31.5227285Z 2025-03-14T06:26:31.5228149Z  2025-03-14T06:26:31.5228600Z  2025-03-14T06:26:31.5229000Z  2025-03-14T06:26:31.5229388Z  2025-03-14T06:26:31.5229789Z  2025-03-14T06:26:31.5230195Z  2025-03-14T06:26:31.5230625Z  2025-03-14T06:26:31.5231000Z  2025-03-14T06:26:31.5231943Z [11,862 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:31.5233283Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T06:26:31.5234141Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T06:26:31.5235162Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T06:26:31.5236348Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T06:26:31.5237439Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T06:26:31.5238456Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T06:26:31.5239487Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 18s local 2025-03-14T06:26:31.5240458Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local ... 2025-03-14T06:26:31.8006780Z 2025-03-14T06:26:31.8007655Z  2025-03-14T06:26:31.8008311Z  2025-03-14T06:26:31.8008883Z  2025-03-14T06:26:31.8009283Z  2025-03-14T06:26:31.8009684Z  2025-03-14T06:26:31.8010414Z  2025-03-14T06:26:31.8010825Z  2025-03-14T06:26:31.8011257Z  2025-03-14T06:26:31.8012199Z [11,866 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:31.8013413Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T06:26:31.8014136Z Compiling src/cpu/rnn/ref_rnn.cpp; 75s local 2025-03-14T06:26:31.8015171Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T06:26:31.8016262Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T06:26:31.8017216Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T06:26:31.8018107Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T06:26:31.8019026Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2025-03-14T06:26:31.8019917Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local ... 2025-03-14T06:26:32.0534989Z 2025-03-14T06:26:32.0535815Z  2025-03-14T06:26:32.0536342Z  2025-03-14T06:26:32.0536777Z  2025-03-14T06:26:32.0537164Z  2025-03-14T06:26:32.0537576Z  2025-03-14T06:26:32.0537986Z  2025-03-14T06:26:32.0538407Z  2025-03-14T06:26:32.0538800Z  2025-03-14T06:26:32.0539830Z [11,867 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:32.0541029Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T06:26:32.0541772Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T06:26:32.0542686Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T06:26:32.0543799Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T06:26:32.0544797Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T06:26:32.0545692Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 36s local 2025-03-14T06:26:32.0546584Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2025-03-14T06:26:32.0547452Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local ... 2025-03-14T06:26:32.4541310Z 2025-03-14T06:26:32.4542268Z  2025-03-14T06:26:32.4542853Z  2025-03-14T06:26:32.4543311Z  2025-03-14T06:26:32.4543782Z  2025-03-14T06:26:32.4544198Z  2025-03-14T06:26:32.4544651Z  2025-03-14T06:26:32.4545059Z  2025-03-14T06:26:32.4545502Z  2025-03-14T06:26:32.4546585Z [11,868 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:32.4547524Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T06:26:32.4548274Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T06:26:32.4549235Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T06:26:32.4550369Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T06:26:32.4551220Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T06:26:32.4551983Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T06:26:32.4552747Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local 2025-03-14T06:26:32.4553545Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local ... 2025-03-14T06:26:32.7989530Z 2025-03-14T06:26:32.7990488Z  2025-03-14T06:26:32.7991101Z  2025-03-14T06:26:32.7991538Z  2025-03-14T06:26:32.7991962Z  2025-03-14T06:26:32.7992361Z  2025-03-14T06:26:32.7992775Z  2025-03-14T06:26:32.7993181Z  2025-03-14T06:26:32.7993596Z  2025-03-14T06:26:32.7994560Z [11,871 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:32.7995992Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:32.7996708Z Compiling src/cpu/rnn/ref_rnn.cpp; 76s local 2025-03-14T06:26:32.7997482Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T06:26:32.7998447Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T06:26:32.7999520Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T06:26:32.8000397Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T06:26:32.8003093Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2025-03-14T06:26:32.8004138Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local ... 2025-03-14T06:26:33.0273797Z 2025-03-14T06:26:33.0274678Z  2025-03-14T06:26:33.0275146Z  2025-03-14T06:26:33.0275529Z  2025-03-14T06:26:33.0275906Z  2025-03-14T06:26:33.0276302Z  2025-03-14T06:26:33.0276661Z  2025-03-14T06:26:33.0277058Z  2025-03-14T06:26:33.0277450Z  2025-03-14T06:26:33.0278347Z [11,872 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:33.0279292Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:33.0280014Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T06:26:33.0280876Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T06:26:33.0281962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T06:26:33.0282983Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:26:33.0283876Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 37s local 2025-03-14T06:26:33.0285238Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2025-03-14T06:26:33.0286134Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local ... 2025-03-14T06:26:33.2321786Z 2025-03-14T06:26:33.2322660Z  2025-03-14T06:26:33.2323187Z  2025-03-14T06:26:33.2323642Z  2025-03-14T06:26:33.2324097Z  2025-03-14T06:26:33.2324698Z  2025-03-14T06:26:33.2325148Z  2025-03-14T06:26:33.2326645Z  2025-03-14T06:26:33.2327080Z  2025-03-14T06:26:33.2328112Z [11,873 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:33.2329182Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:33.2329940Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T06:26:33.2330879Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T06:26:33.2332161Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T06:26:33.2333212Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:26:33.2334162Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T06:26:33.2335305Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2025-03-14T06:26:33.2336247Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local ... 2025-03-14T06:26:33.4549384Z 2025-03-14T06:26:33.4550259Z  2025-03-14T06:26:33.4550711Z  2025-03-14T06:26:33.4551105Z  2025-03-14T06:26:33.4551452Z  2025-03-14T06:26:33.4551828Z  2025-03-14T06:26:33.4552205Z  2025-03-14T06:26:33.4552666Z  2025-03-14T06:26:33.4553052Z  2025-03-14T06:26:33.4553953Z [11,874 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:33.4554877Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:33.4555553Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T06:26:33.4556386Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T06:26:33.4557416Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T06:26:33.4558332Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:26:33.4559155Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T06:26:33.4560257Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2025-03-14T06:26:33.4561609Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local ... 2025-03-14T06:26:33.6554002Z 2025-03-14T06:26:33.6554863Z  2025-03-14T06:26:33.6555595Z  2025-03-14T06:26:33.6556115Z  2025-03-14T06:26:33.6556489Z  2025-03-14T06:26:33.6556858Z  2025-03-14T06:26:33.6557230Z  2025-03-14T06:26:33.6557559Z  2025-03-14T06:26:33.6557888Z  2025-03-14T06:26:33.6558802Z [11,876 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:33.6559741Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:33.6560325Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T06:26:33.6560964Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T06:26:33.6561841Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:26:33.6562810Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:26:33.6563538Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T06:26:33.6564318Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2025-03-14T06:26:33.6565503Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local ... 2025-03-14T06:26:33.8565644Z 2025-03-14T06:26:33.8566501Z  2025-03-14T06:26:33.8566916Z  2025-03-14T06:26:33.8567254Z  2025-03-14T06:26:33.8567579Z  2025-03-14T06:26:33.8567942Z  2025-03-14T06:26:33.8568259Z  2025-03-14T06:26:33.8568595Z  2025-03-14T06:26:33.8568933Z  2025-03-14T06:26:33.8569983Z [11,878 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:33.8570774Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T06:26:33.8571347Z Compiling src/cpu/rnn/ref_rnn.cpp; 77s local 2025-03-14T06:26:33.8572015Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T06:26:33.8572883Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:26:33.8573661Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:26:33.8574357Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T06:26:33.8575087Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2025-03-14T06:26:33.8575806Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local ... 2025-03-14T06:26:34.1090652Z 2025-03-14T06:26:34.1091825Z  2025-03-14T06:26:34.1092345Z  2025-03-14T06:26:34.1092735Z  2025-03-14T06:26:34.1093142Z  2025-03-14T06:26:34.1093557Z  2025-03-14T06:26:34.1093949Z  2025-03-14T06:26:34.1094337Z  2025-03-14T06:26:34.1094729Z  2025-03-14T06:26:34.1095643Z [11,880 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:34.1096635Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T06:26:34.1097302Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T06:26:34.1098158Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T06:26:34.1099217Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:26:34.1100196Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T06:26:34.1101055Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 38s local 2025-03-14T06:26:34.1101913Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2025-03-14T06:26:34.1102740Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local ... 2025-03-14T06:26:34.3939953Z 2025-03-14T06:26:34.3940845Z  2025-03-14T06:26:34.3941361Z  2025-03-14T06:26:34.3941793Z  2025-03-14T06:26:34.3942220Z  2025-03-14T06:26:34.3942662Z  2025-03-14T06:26:34.3943073Z  2025-03-14T06:26:34.3943519Z  2025-03-14T06:26:34.3943950Z  2025-03-14T06:26:34.3945202Z [11,881 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:34.3946262Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T06:26:34.3947038Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T06:26:34.3948087Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T06:26:34.3949238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:26:34.3950396Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T06:26:34.3951359Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T06:26:34.3952340Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2025-03-14T06:26:34.3953302Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local ... 2025-03-14T06:26:34.6563940Z 2025-03-14T06:26:34.6565002Z  2025-03-14T06:26:34.6565645Z  2025-03-14T06:26:34.6566006Z  2025-03-14T06:26:34.6566416Z  2025-03-14T06:26:34.6566794Z  2025-03-14T06:26:34.6567167Z  2025-03-14T06:26:34.6567523Z  2025-03-14T06:26:34.6567898Z  2025-03-14T06:26:34.6568749Z [11,882 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:34.6569611Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T06:26:34.6570227Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T06:26:34.6570952Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2025-03-14T06:26:34.6571867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T06:26:34.6572964Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T06:26:34.6573736Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T06:26:34.6574526Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T06:26:34.6575291Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local ... 2025-03-14T06:26:34.8731565Z 2025-03-14T06:26:34.8732563Z  2025-03-14T06:26:34.8733093Z  2025-03-14T06:26:34.8733551Z  2025-03-14T06:26:34.8733963Z  2025-03-14T06:26:34.8734588Z  2025-03-14T06:26:34.8734982Z  2025-03-14T06:26:34.8735468Z  2025-03-14T06:26:34.8735886Z  2025-03-14T06:26:34.8736879Z [11,885 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:34.8737883Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T06:26:34.8738543Z Compiling src/cpu/rnn/ref_rnn.cpp; 78s local 2025-03-14T06:26:34.8739366Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2025-03-14T06:26:34.8740433Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T06:26:34.8741455Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T06:26:34.8742384Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 39s local 2025-03-14T06:26:34.8743277Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T06:26:34.8744194Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local ... 2025-03-14T06:26:35.2572227Z 2025-03-14T06:26:35.2573184Z  2025-03-14T06:26:35.2573715Z  2025-03-14T06:26:35.2574212Z  2025-03-14T06:26:35.2574654Z  2025-03-14T06:26:35.2575096Z  2025-03-14T06:26:35.2575527Z  2025-03-14T06:26:35.2575966Z  2025-03-14T06:26:35.2576424Z  2025-03-14T06:26:35.2577493Z [11,885 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:35.2578592Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T06:26:35.2579378Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T06:26:35.2580466Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 53s local 2025-03-14T06:26:35.2581620Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T06:26:35.2582890Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T06:26:35.2583850Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T06:26:35.2584788Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T06:26:35.2585732Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local ... 2025-03-14T06:26:35.4574980Z 2025-03-14T06:26:35.4575778Z  2025-03-14T06:26:35.4576271Z  2025-03-14T06:26:35.4576705Z  2025-03-14T06:26:35.4577135Z  2025-03-14T06:26:35.4577792Z  2025-03-14T06:26:35.4578240Z  2025-03-14T06:26:35.4578659Z  2025-03-14T06:26:35.4579093Z  2025-03-14T06:26:35.4580106Z [11,887 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:35.4581126Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T06:26:35.4581812Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T06:26:35.4582659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T06:26:35.4583684Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T06:26:35.4584630Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T06:26:35.4585588Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T06:26:35.4586510Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T06:26:35.4587518Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local ... 2025-03-14T06:26:35.8580484Z 2025-03-14T06:26:35.8581409Z  2025-03-14T06:26:35.8581915Z  2025-03-14T06:26:35.8582347Z  2025-03-14T06:26:35.8582788Z  2025-03-14T06:26:35.8583649Z  2025-03-14T06:26:35.8584079Z  2025-03-14T06:26:35.8584512Z  2025-03-14T06:26:35.8584951Z  2025-03-14T06:26:35.8585968Z [11,888 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:35.8587047Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T06:26:35.8587843Z Compiling src/cpu/rnn/ref_rnn.cpp; 79s local 2025-03-14T06:26:35.8588853Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T06:26:35.8589927Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T06:26:35.8590919Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T06:26:35.8591877Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T06:26:35.8592751Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T06:26:35.8593692Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local ... 2025-03-14T06:26:36.0585623Z 2025-03-14T06:26:36.0586450Z  2025-03-14T06:26:36.0586924Z  2025-03-14T06:26:36.0587339Z  2025-03-14T06:26:36.0587734Z  2025-03-14T06:26:36.0588160Z  2025-03-14T06:26:36.0588570Z  2025-03-14T06:26:36.0588984Z  2025-03-14T06:26:36.0589364Z  2025-03-14T06:26:36.0590367Z [11,889 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:36.0591410Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T06:26:36.0592169Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T06:26:36.0593181Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T06:26:36.0594133Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T06:26:36.0595048Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 40s local 2025-03-14T06:26:36.0595998Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T06:26:36.0596885Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T06:26:36.0597916Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local ... 2025-03-14T06:26:36.3882246Z 2025-03-14T06:26:36.3883113Z  2025-03-14T06:26:36.3883849Z  2025-03-14T06:26:36.3884367Z  2025-03-14T06:26:36.3885078Z  2025-03-14T06:26:36.3885953Z  2025-03-14T06:26:36.3886493Z  2025-03-14T06:26:36.3887016Z  2025-03-14T06:26:36.3887566Z  2025-03-14T06:26:36.3888629Z [11,890 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:36.3890017Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T06:26:36.3890892Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T06:26:36.3891947Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T06:26:36.3893253Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T06:26:36.3894296Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T06:26:36.3895337Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T06:26:36.3896357Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T06:26:36.3897499Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local ... 2025-03-14T06:26:36.6590978Z 2025-03-14T06:26:36.6591851Z  2025-03-14T06:26:36.6592354Z  2025-03-14T06:26:36.6592771Z  2025-03-14T06:26:36.6593212Z  2025-03-14T06:26:36.6593621Z  2025-03-14T06:26:36.6594011Z  2025-03-14T06:26:36.6594422Z  2025-03-14T06:26:36.6594862Z  2025-03-14T06:26:36.6595864Z [11,890 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:36.6596872Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T06:26:36.6597633Z Compiling src/cpu/rnn/ref_rnn.cpp; 80s local 2025-03-14T06:26:36.6598605Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T06:26:36.6599905Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T06:26:36.6600705Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T06:26:36.6601531Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 24s local 2025-03-14T06:26:36.6602327Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T06:26:36.6603300Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local ... 2025-03-14T06:26:36.9591278Z 2025-03-14T06:26:36.9592127Z  2025-03-14T06:26:36.9592609Z  2025-03-14T06:26:36.9592998Z  2025-03-14T06:26:36.9593402Z  2025-03-14T06:26:36.9593798Z  2025-03-14T06:26:36.9594194Z  2025-03-14T06:26:36.9594597Z  2025-03-14T06:26:36.9594993Z  2025-03-14T06:26:36.9596243Z [11,891 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:36.9597262Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T06:26:36.9598038Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T06:26:36.9598964Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T06:26:36.9599919Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:26:36.9600844Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 41s local 2025-03-14T06:26:36.9601756Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 24s local 2025-03-14T06:26:36.9602643Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T06:26:36.9603638Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local ... 2025-03-14T06:26:37.2545751Z 2025-03-14T06:26:37.2547695Z  2025-03-14T06:26:37.2548133Z  2025-03-14T06:26:37.2548502Z  2025-03-14T06:26:37.2548924Z  2025-03-14T06:26:37.2549310Z  2025-03-14T06:26:37.2549673Z  2025-03-14T06:26:37.2549991Z  2025-03-14T06:26:37.2550329Z  2025-03-14T06:26:37.2551106Z [11,895 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:37.2551866Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T06:26:37.2552446Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T06:26:37.2553211Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T06:26:37.2554188Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:26:37.2554912Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T06:26:37.2555688Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T06:26:37.2556635Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2025-03-14T06:26:37.2557380Z @onednn//:mkl_dnn; 18s local ... 2025-03-14T06:26:37.4586303Z 2025-03-14T06:26:37.4587102Z  2025-03-14T06:26:37.4587854Z  2025-03-14T06:26:37.4588253Z  2025-03-14T06:26:37.4588592Z  2025-03-14T06:26:37.4588920Z  2025-03-14T06:26:37.4589244Z  2025-03-14T06:26:37.4589600Z  2025-03-14T06:26:37.4589928Z  2025-03-14T06:26:37.4590797Z [11,898 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:37.4591756Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T06:26:37.4592469Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T06:26:37.4593378Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T06:26:37.4594401Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:26:37.4595373Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T06:26:37.4596290Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T06:26:37.4597374Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2025-03-14T06:26:37.4598363Z @onednn//:mkl_dnn; 19s local ... 2025-03-14T06:26:37.6598416Z 2025-03-14T06:26:37.6599277Z  2025-03-14T06:26:37.6599800Z  2025-03-14T06:26:37.6600510Z  2025-03-14T06:26:37.6600988Z  2025-03-14T06:26:37.6601412Z  2025-03-14T06:26:37.6601840Z  2025-03-14T06:26:37.6602264Z  2025-03-14T06:26:37.6602675Z  2025-03-14T06:26:37.6603652Z [11,898 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:37.6604868Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T06:26:37.6605591Z Compiling src/cpu/rnn/ref_rnn.cpp; 81s local 2025-03-14T06:26:37.6606514Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T06:26:37.6607530Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:26:37.6608443Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T06:26:37.6609572Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T06:26:37.6610577Z Compiling src/cpu/x64/jit_uni_resampling_kernel.cpp; 19s local 2025-03-14T06:26:37.6611401Z @onednn//:mkl_dnn; 19s local ... 2025-03-14T06:26:37.9251135Z 2025-03-14T06:26:37.9252056Z  2025-03-14T06:26:37.9252563Z  2025-03-14T06:26:37.9252999Z  2025-03-14T06:26:37.9253454Z  2025-03-14T06:26:37.9253885Z  2025-03-14T06:26:37.9254304Z  2025-03-14T06:26:37.9254713Z  2025-03-14T06:26:37.9255167Z  2025-03-14T06:26:37.9256409Z [11,899 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:37.9257398Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T06:26:37.9258141Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T06:26:37.9259088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T06:26:37.9260099Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T06:26:37.9261026Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 42s local 2025-03-14T06:26:37.9262018Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T06:26:37.9263120Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2025-03-14T06:26:37.9264209Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T06:26:38.2605471Z 2025-03-14T06:26:38.2606180Z  2025-03-14T06:26:38.2606708Z  2025-03-14T06:26:38.2607386Z  2025-03-14T06:26:38.2607833Z  2025-03-14T06:26:38.2608248Z  2025-03-14T06:26:38.2608647Z  2025-03-14T06:26:38.2609040Z  2025-03-14T06:26:38.2609412Z  2025-03-14T06:26:38.2610372Z [11,899 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:38.2611605Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T06:26:38.2612347Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T06:26:38.2613437Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T06:26:38.2614374Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T06:26:38.2615268Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:38.2616253Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T06:26:38.2617364Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2025-03-14T06:26:38.2618432Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T06:26:38.5149461Z 2025-03-14T06:26:38.5150451Z  2025-03-14T06:26:38.5151050Z  2025-03-14T06:26:38.5151571Z  2025-03-14T06:26:38.5151955Z  2025-03-14T06:26:38.5152359Z  2025-03-14T06:26:38.5152782Z  2025-03-14T06:26:38.5153170Z  2025-03-14T06:26:38.5153576Z  2025-03-14T06:26:38.5154551Z [11,902 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:38.5155547Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T06:26:38.5156227Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T06:26:38.5157436Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T06:26:38.5158665Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T06:26:38.5159545Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:38.5160571Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T06:26:38.5161638Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T06:26:38.5162702Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T06:26:38.7554405Z 2025-03-14T06:26:38.7555277Z  2025-03-14T06:26:38.7555787Z  2025-03-14T06:26:38.7556184Z  2025-03-14T06:26:38.7556585Z  2025-03-14T06:26:38.7556999Z  2025-03-14T06:26:38.7557387Z  2025-03-14T06:26:38.7557798Z  2025-03-14T06:26:38.7558193Z  2025-03-14T06:26:38.7559153Z [11,903 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:38.7560147Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T06:26:38.7560866Z Compiling src/cpu/rnn/ref_rnn.cpp; 82s local 2025-03-14T06:26:38.7572651Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T06:26:38.7573907Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T06:26:38.7574838Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:38.7575771Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T06:26:38.7576818Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T06:26:38.7577874Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 19s local ... 2025-03-14T06:26:39.0029174Z 2025-03-14T06:26:39.0029970Z  2025-03-14T06:26:39.0030430Z  2025-03-14T06:26:39.0030865Z  2025-03-14T06:26:39.0031344Z  2025-03-14T06:26:39.0031755Z  2025-03-14T06:26:39.0032216Z  2025-03-14T06:26:39.0032626Z  2025-03-14T06:26:39.0033050Z  2025-03-14T06:26:39.0033990Z [11,906 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:39.0034920Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T06:26:39.0035592Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T06:26:39.0036821Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T06:26:39.0037760Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T06:26:39.0038625Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:39.0039986Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T06:26:39.0041087Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2025-03-14T06:26:39.0042124Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local ... 2025-03-14T06:26:39.2104037Z 2025-03-14T06:26:39.2104895Z  2025-03-14T06:26:39.2105386Z  2025-03-14T06:26:39.2105833Z  2025-03-14T06:26:39.2106277Z  2025-03-14T06:26:39.2106678Z  2025-03-14T06:26:39.2107096Z  2025-03-14T06:26:39.2107500Z  2025-03-14T06:26:39.2107918Z  2025-03-14T06:26:39.2108849Z [11,907 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:39.2109836Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T06:26:39.2110557Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T06:26:39.2111476Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T06:26:39.2112484Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T06:26:39.2113364Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 43s local 2025-03-14T06:26:39.2114442Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T06:26:39.2115436Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2025-03-14T06:26:39.2116610Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local ... 2025-03-14T06:26:39.4615539Z 2025-03-14T06:26:39.4616403Z  2025-03-14T06:26:39.4616833Z  2025-03-14T06:26:39.4617196Z  2025-03-14T06:26:39.4617556Z  2025-03-14T06:26:39.4617908Z  2025-03-14T06:26:39.4618303Z  2025-03-14T06:26:39.4618649Z  2025-03-14T06:26:39.4619018Z  2025-03-14T06:26:39.4619896Z [11,908 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:39.4620792Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T06:26:39.4621854Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T06:26:39.4622791Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T06:26:39.4623823Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T06:26:39.4624731Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T06:26:39.4625848Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T06:26:39.4626841Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 20s local 2025-03-14T06:26:39.4627763Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local ... 2025-03-14T06:26:39.8620996Z 2025-03-14T06:26:39.8621934Z  2025-03-14T06:26:39.8622436Z  2025-03-14T06:26:39.8622873Z  2025-03-14T06:26:39.8623305Z  2025-03-14T06:26:39.8623743Z  2025-03-14T06:26:39.8624184Z  2025-03-14T06:26:39.8624596Z  2025-03-14T06:26:39.8625030Z  2025-03-14T06:26:39.8626045Z [11,909 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:39.8627062Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T06:26:39.8627825Z Compiling src/cpu/rnn/ref_rnn.cpp; 83s local 2025-03-14T06:26:39.8628829Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T06:26:39.8629863Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T06:26:39.8630751Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T06:26:39.8632199Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T06:26:39.8633252Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2025-03-14T06:26:39.8634534Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local ... 2025-03-14T06:26:40.0800833Z 2025-03-14T06:26:40.0801723Z  2025-03-14T06:26:40.0802212Z  2025-03-14T06:26:40.0802741Z  2025-03-14T06:26:40.0803437Z  2025-03-14T06:26:40.0803830Z  2025-03-14T06:26:40.0804220Z  2025-03-14T06:26:40.0804766Z  2025-03-14T06:26:40.0805161Z  2025-03-14T06:26:40.0806284Z [11,914 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:40.0807387Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T06:26:40.0808096Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T06:26:40.0809501Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T06:26:40.0810494Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T06:26:40.0811521Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 44s local 2025-03-14T06:26:40.0812735Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T06:26:40.0813842Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2025-03-14T06:26:40.0814861Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local ... 2025-03-14T06:26:40.4000361Z 2025-03-14T06:26:40.4001283Z  2025-03-14T06:26:40.4001729Z  2025-03-14T06:26:40.4002084Z  2025-03-14T06:26:40.4002419Z  2025-03-14T06:26:40.4002768Z  2025-03-14T06:26:40.4003152Z  2025-03-14T06:26:40.4003512Z  2025-03-14T06:26:40.4003851Z  2025-03-14T06:26:40.4005050Z [11,915 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:40.4005929Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T06:26:40.4006550Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T06:26:40.4007388Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T06:26:40.4008298Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T06:26:40.4009123Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T06:26:40.4010060Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2025-03-14T06:26:40.4010942Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2025-03-14T06:26:40.4011765Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local ... 2025-03-14T06:26:40.6628131Z 2025-03-14T06:26:40.6629076Z  2025-03-14T06:26:40.6629585Z  2025-03-14T06:26:40.6630029Z  2025-03-14T06:26:40.6630468Z  2025-03-14T06:26:40.6630934Z  2025-03-14T06:26:40.6631386Z  2025-03-14T06:26:40.6631775Z  2025-03-14T06:26:40.6632188Z  2025-03-14T06:26:40.6633161Z [11,917 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:40.6634196Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T06:26:40.6635005Z Compiling src/cpu/rnn/ref_rnn.cpp; 84s local 2025-03-14T06:26:40.6636013Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T06:26:40.6637266Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T06:26:40.6638235Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T06:26:40.6639434Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2025-03-14T06:26:40.6640535Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 21s local 2025-03-14T06:26:40.6641547Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 15s local ... 2025-03-14T06:26:40.9722831Z 2025-03-14T06:26:40.9723703Z  2025-03-14T06:26:40.9724193Z  2025-03-14T06:26:40.9724726Z  2025-03-14T06:26:40.9725150Z  2025-03-14T06:26:40.9725590Z  2025-03-14T06:26:40.9726014Z  2025-03-14T06:26:40.9726447Z  2025-03-14T06:26:40.9727108Z  2025-03-14T06:26:40.9728031Z [11,918 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:40.9729036Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T06:26:40.9729748Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T06:26:40.9730872Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T06:26:40.9731881Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T06:26:40.9732969Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 45s local 2025-03-14T06:26:40.9734173Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2025-03-14T06:26:40.9735306Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T06:26:40.9736313Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 16s local ... 2025-03-14T06:26:41.2636134Z 2025-03-14T06:26:41.2637025Z  2025-03-14T06:26:41.2638368Z  2025-03-14T06:26:41.2638871Z  2025-03-14T06:26:41.2640185Z  2025-03-14T06:26:41.2640694Z  2025-03-14T06:26:41.2641169Z  2025-03-14T06:26:41.2641642Z  2025-03-14T06:26:41.2642112Z  2025-03-14T06:26:41.2643201Z [11,919 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:41.2644614Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T06:26:41.2645453Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T06:26:41.2646504Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T06:26:41.2647615Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T06:26:41.2648861Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T06:26:41.2650139Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2025-03-14T06:26:41.2651280Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T06:26:41.2652346Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 16s local ... 2025-03-14T06:26:41.6137600Z 2025-03-14T06:26:41.6138439Z  2025-03-14T06:26:41.6138966Z  2025-03-14T06:26:41.6139410Z  2025-03-14T06:26:41.6139854Z  2025-03-14T06:26:41.6140323Z  2025-03-14T06:26:41.6140786Z  2025-03-14T06:26:41.6141215Z  2025-03-14T06:26:41.6141652Z  2025-03-14T06:26:41.6142665Z [11,921 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:41.6143753Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T06:26:41.6144554Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T06:26:41.6145614Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:26:41.6146709Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T06:26:41.6147708Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T06:26:41.6148959Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 23s local 2025-03-14T06:26:41.6150114Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 22s local 2025-03-14T06:26:41.6151372Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 16s local ... 2025-03-14T06:26:41.8642251Z 2025-03-14T06:26:41.8643164Z  2025-03-14T06:26:41.8643684Z  2025-03-14T06:26:41.8644117Z  2025-03-14T06:26:41.8644702Z  2025-03-14T06:26:41.8645127Z  2025-03-14T06:26:41.8645582Z  2025-03-14T06:26:41.8646019Z  2025-03-14T06:26:41.8646474Z  2025-03-14T06:26:41.8647479Z [11,921 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:41.8648552Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T06:26:41.8649331Z Compiling src/cpu/rnn/ref_rnn.cpp; 85s local 2025-03-14T06:26:41.8650340Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:26:41.8651404Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T06:26:41.8652631Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T06:26:41.8653846Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 23s local 2025-03-14T06:26:41.8654969Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T06:26:41.8656099Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 16s local ... 2025-03-14T06:26:42.1586301Z 2025-03-14T06:26:42.1587193Z  2025-03-14T06:26:42.1587709Z  2025-03-14T06:26:42.1588457Z  2025-03-14T06:26:42.1588899Z  2025-03-14T06:26:42.1589318Z  2025-03-14T06:26:42.1589737Z  2025-03-14T06:26:42.1590167Z  2025-03-14T06:26:42.1590596Z  2025-03-14T06:26:42.1591586Z [11,923 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:42.1592593Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T06:26:42.1593312Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T06:26:42.1594217Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:26:42.1595250Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T06:26:42.1596139Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 46s local 2025-03-14T06:26:42.1597316Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 23s local 2025-03-14T06:26:42.1598412Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T06:26:42.1599424Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local ... 2025-03-14T06:26:42.4223229Z 2025-03-14T06:26:42.4224107Z  2025-03-14T06:26:42.4224702Z  2025-03-14T06:26:42.4225381Z  2025-03-14T06:26:42.4225838Z  2025-03-14T06:26:42.4226206Z  2025-03-14T06:26:42.4226626Z  2025-03-14T06:26:42.4227106Z  2025-03-14T06:26:42.4227514Z  2025-03-14T06:26:42.4228513Z [11,924 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:42.4229656Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T06:26:42.4230343Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T06:26:42.4231290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:26:42.4232329Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T06:26:42.4233274Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T06:26:42.4234249Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T06:26:42.4235195Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local 2025-03-14T06:26:42.4236260Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 10s local ... 2025-03-14T06:26:42.6266437Z 2025-03-14T06:26:42.6267321Z  2025-03-14T06:26:42.6267825Z  2025-03-14T06:26:42.6268281Z  2025-03-14T06:26:42.6268709Z  2025-03-14T06:26:42.6269140Z  2025-03-14T06:26:42.6269606Z  2025-03-14T06:26:42.6270019Z  2025-03-14T06:26:42.6270416Z  2025-03-14T06:26:42.6271433Z [11,926 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:42.6272467Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T06:26:42.6273255Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T06:26:42.6274256Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T06:26:42.6275331Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T06:26:42.6276306Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T06:26:42.6277285Z Compiling src/cpu/x64/jit_uni_softmax.cpp; 23s local 2025-03-14T06:26:42.6278280Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local 2025-03-14T06:26:42.6279389Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local ... 2025-03-14T06:26:42.8651095Z 2025-03-14T06:26:42.8652318Z  2025-03-14T06:26:42.8653114Z  2025-03-14T06:26:42.8653567Z  2025-03-14T06:26:42.8654003Z  2025-03-14T06:26:42.8654448Z  2025-03-14T06:26:42.8654896Z  2025-03-14T06:26:42.8655315Z  2025-03-14T06:26:42.8655764Z  2025-03-14T06:26:42.8658957Z [11,928 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:42.8660028Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T06:26:42.8660935Z Compiling src/cpu/rnn/ref_rnn.cpp; 86s local 2025-03-14T06:26:42.8661862Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T06:26:42.8662863Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T06:26:42.8663775Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T06:26:42.8664884Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 17s local 2025-03-14T06:26:42.8670925Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2025-03-14T06:26:42.8672029Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local ... 2025-03-14T06:26:43.0874646Z 2025-03-14T06:26:43.0875532Z  2025-03-14T06:26:43.0876052Z  2025-03-14T06:26:43.0876489Z  2025-03-14T06:26:43.0876895Z  2025-03-14T06:26:43.0877346Z  2025-03-14T06:26:43.0877790Z  2025-03-14T06:26:43.0878213Z  2025-03-14T06:26:43.0878609Z  2025-03-14T06:26:43.0879588Z [11,930 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:43.0880628Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T06:26:43.0881782Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:43.0882760Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T06:26:43.0883834Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:26:43.0885121Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 47s local 2025-03-14T06:26:43.0886211Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 18s local 2025-03-14T06:26:43.0887286Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2025-03-14T06:26:43.0888298Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local ... 2025-03-14T06:26:43.4534886Z 2025-03-14T06:26:43.4535741Z  2025-03-14T06:26:43.4536267Z  2025-03-14T06:26:43.4536688Z  2025-03-14T06:26:43.4537088Z  2025-03-14T06:26:43.4537501Z  2025-03-14T06:26:43.4537898Z  2025-03-14T06:26:43.4538335Z  2025-03-14T06:26:43.4538734Z  2025-03-14T06:26:43.4539693Z [11,931 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:43.4540655Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T06:26:43.4541375Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:43.4542267Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T06:26:43.4543264Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:26:43.4544175Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T06:26:43.4545198Z Compiling src/cpu/x64/jit_uni_x8s8s32x_deconvolution.cpp; 18s local 2025-03-14T06:26:43.4546219Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2025-03-14T06:26:43.4547160Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local ... 2025-03-14T06:26:43.6661329Z 2025-03-14T06:26:43.6662153Z  2025-03-14T06:26:43.6662676Z  2025-03-14T06:26:43.6663104Z  2025-03-14T06:26:43.6663534Z  2025-03-14T06:26:43.6663949Z  2025-03-14T06:26:43.6664350Z  2025-03-14T06:26:43.6664755Z  2025-03-14T06:26:43.6665163Z  2025-03-14T06:26:43.6666429Z [11,932 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:43.6667396Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T06:26:43.6668332Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:43.6669229Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T06:26:43.6670205Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:26:43.6671263Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T06:26:43.6672221Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2025-03-14T06:26:43.6673124Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 11s local 2025-03-14T06:26:43.6674179Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local ... 2025-03-14T06:26:43.8664583Z 2025-03-14T06:26:43.8665664Z  2025-03-14T06:26:43.8666226Z  2025-03-14T06:26:43.8666716Z  2025-03-14T06:26:43.8667072Z  2025-03-14T06:26:43.8667485Z  2025-03-14T06:26:43.8667861Z  2025-03-14T06:26:43.8668237Z  2025-03-14T06:26:43.8668629Z  2025-03-14T06:26:43.8669567Z [11,934 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:43.8670535Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T06:26:43.8671230Z Compiling src/cpu/rnn/ref_rnn.cpp; 87s local 2025-03-14T06:26:43.8672142Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T06:26:43.8673125Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:26:43.8674013Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T06:26:43.8674984Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2025-03-14T06:26:43.8675920Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2025-03-14T06:26:43.8677032Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local ... 2025-03-14T06:26:44.0834993Z 2025-03-14T06:26:44.0836065Z  2025-03-14T06:26:44.0836555Z  2025-03-14T06:26:44.0836969Z  2025-03-14T06:26:44.0837385Z  2025-03-14T06:26:44.0837810Z  2025-03-14T06:26:44.0838250Z  2025-03-14T06:26:44.0838684Z  2025-03-14T06:26:44.0839094Z  2025-03-14T06:26:44.0840070Z [11,936 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:44.0841104Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T06:26:44.0841869Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T06:26:44.0842825Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T06:26:44.0843808Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T06:26:44.0844876Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 48s local 2025-03-14T06:26:44.0845902Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2025-03-14T06:26:44.0846870Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2025-03-14T06:26:44.0847850Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local ... 2025-03-14T06:26:44.4669317Z 2025-03-14T06:26:44.4670584Z  2025-03-14T06:26:44.4671251Z  2025-03-14T06:26:44.4671758Z  2025-03-14T06:26:44.4672301Z  2025-03-14T06:26:44.4672833Z  2025-03-14T06:26:44.4673315Z  2025-03-14T06:26:44.4673874Z  2025-03-14T06:26:44.4674374Z  2025-03-14T06:26:44.4675468Z [11,937 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:44.4676576Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T06:26:44.4677415Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T06:26:44.4678462Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T06:26:44.4679558Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T06:26:44.4680560Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T06:26:44.4681633Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2025-03-14T06:26:44.4682650Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2025-03-14T06:26:44.4683892Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local ... 2025-03-14T06:26:44.6673797Z 2025-03-14T06:26:44.6674712Z  2025-03-14T06:26:44.6675211Z  2025-03-14T06:26:44.6675626Z  2025-03-14T06:26:44.6676290Z  2025-03-14T06:26:44.6676699Z  2025-03-14T06:26:44.6677120Z  2025-03-14T06:26:44.6677518Z  2025-03-14T06:26:44.6677904Z  2025-03-14T06:26:44.6679048Z [11,938 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:44.6680095Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T06:26:44.6680859Z Compiling src/cpu/rnn/ref_rnn.cpp; 88s local 2025-03-14T06:26:44.6681833Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T06:26:44.6683893Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T06:26:44.6684940Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T06:26:44.6685940Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2025-03-14T06:26:44.6686901Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 12s local 2025-03-14T06:26:44.6687848Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local ... 2025-03-14T06:26:45.0680072Z 2025-03-14T06:26:45.0680872Z  2025-03-14T06:26:45.0681316Z  2025-03-14T06:26:45.0681681Z  2025-03-14T06:26:45.0682038Z  2025-03-14T06:26:45.0682405Z  2025-03-14T06:26:45.0682766Z  2025-03-14T06:26:45.0683199Z  2025-03-14T06:26:45.0683598Z  2025-03-14T06:26:45.0685154Z [11,940 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:45.0686075Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T06:26:45.0686726Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T06:26:45.0687550Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T06:26:45.0688573Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T06:26:45.0689444Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 49s local 2025-03-14T06:26:45.0690340Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2025-03-14T06:26:45.0691501Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2025-03-14T06:26:45.0692485Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local ... 2025-03-14T06:26:45.2686026Z 2025-03-14T06:26:45.2686899Z  2025-03-14T06:26:45.2687384Z  2025-03-14T06:26:45.2687854Z  2025-03-14T06:26:45.2688277Z  2025-03-14T06:26:45.2688714Z  2025-03-14T06:26:45.2689145Z  2025-03-14T06:26:45.2689555Z  2025-03-14T06:26:45.2689976Z  2025-03-14T06:26:45.2690958Z [11,941 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:45.2692017Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T06:26:45.2692782Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T06:26:45.2693705Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T06:26:45.2694720Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T06:26:45.2695668Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T06:26:45.2696697Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2025-03-14T06:26:45.2697654Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2025-03-14T06:26:45.2698635Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local ... 2025-03-14T06:26:45.6181269Z 2025-03-14T06:26:45.6182118Z  2025-03-14T06:26:45.6182671Z  2025-03-14T06:26:45.6183133Z  2025-03-14T06:26:45.6183571Z  2025-03-14T06:26:45.6184021Z  2025-03-14T06:26:45.6184444Z  2025-03-14T06:26:45.6184871Z  2025-03-14T06:26:45.6185293Z  2025-03-14T06:26:45.6186297Z [11,942 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:45.6187697Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T06:26:45.6188448Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T06:26:45.6189380Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:26:45.6190733Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T06:26:45.6191624Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T06:26:45.6192774Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2025-03-14T06:26:45.6193713Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 13s local 2025-03-14T06:26:45.6194726Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local ... 2025-03-14T06:26:45.8186265Z 2025-03-14T06:26:45.8187100Z  2025-03-14T06:26:45.8187596Z  2025-03-14T06:26:45.8188023Z  2025-03-14T06:26:45.8188550Z  2025-03-14T06:26:45.8188933Z  2025-03-14T06:26:45.8189358Z  2025-03-14T06:26:45.8189762Z  2025-03-14T06:26:45.8190139Z  2025-03-14T06:26:45.8191058Z [11,946 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:45.8192075Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T06:26:45.8192816Z Compiling src/cpu/rnn/ref_rnn.cpp; 89s local 2025-03-14T06:26:45.8193770Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:26:45.8194823Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T06:26:45.8195774Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T06:26:45.8197057Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2025-03-14T06:26:45.8198042Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2025-03-14T06:26:45.8199053Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local ... 2025-03-14T06:26:46.0691117Z 2025-03-14T06:26:46.0692186Z  2025-03-14T06:26:46.0692741Z  2025-03-14T06:26:46.0693161Z  2025-03-14T06:26:46.0693562Z  2025-03-14T06:26:46.0693966Z  2025-03-14T06:26:46.0694378Z  2025-03-14T06:26:46.0694788Z  2025-03-14T06:26:46.0695218Z  2025-03-14T06:26:46.0696214Z [11,947 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:46.0697207Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T06:26:46.0697948Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T06:26:46.0698883Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:26:46.0699881Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T06:26:46.0700755Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 50s local 2025-03-14T06:26:46.0701638Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2025-03-14T06:26:46.0702484Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2025-03-14T06:26:46.0703364Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local ... 2025-03-14T06:26:46.2694897Z 2025-03-14T06:26:46.2695729Z  2025-03-14T06:26:46.2696226Z  2025-03-14T06:26:46.2696646Z  2025-03-14T06:26:46.2697050Z  2025-03-14T06:26:46.2697470Z  2025-03-14T06:26:46.2697876Z  2025-03-14T06:26:46.2698281Z  2025-03-14T06:26:46.2698694Z  2025-03-14T06:26:46.2699711Z [11,949 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:46.2700724Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T06:26:46.2701470Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T06:26:46.2702444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:26:46.2703446Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T06:26:46.2704381Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T06:26:46.2705697Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2025-03-14T06:26:46.2706677Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2025-03-14T06:26:46.2707646Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local ... 2025-03-14T06:26:46.6174710Z 2025-03-14T06:26:46.6175702Z  2025-03-14T06:26:46.6176276Z  2025-03-14T06:26:46.6176661Z  2025-03-14T06:26:46.6177071Z  2025-03-14T06:26:46.6177458Z  2025-03-14T06:26:46.6177848Z  2025-03-14T06:26:46.6178518Z  2025-03-14T06:26:46.6178932Z  2025-03-14T06:26:46.6179883Z [11,950 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:46.6180890Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T06:26:46.6181590Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T06:26:46.6182574Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T06:26:46.6183547Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T06:26:46.6184513Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T06:26:46.6185472Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2025-03-14T06:26:46.6186376Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 14s local 2025-03-14T06:26:46.6187345Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local ... 2025-03-14T06:26:46.8492804Z 2025-03-14T06:26:46.8493657Z  2025-03-14T06:26:46.8494170Z  2025-03-14T06:26:46.8494647Z  2025-03-14T06:26:46.8495044Z  2025-03-14T06:26:46.8495448Z  2025-03-14T06:26:46.8495840Z  2025-03-14T06:26:46.8496523Z  2025-03-14T06:26:46.8496985Z  2025-03-14T06:26:46.8497955Z [11,952 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:46.8498920Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T06:26:46.8499607Z Compiling src/cpu/rnn/ref_rnn.cpp; 90s local 2025-03-14T06:26:46.8500585Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T06:26:46.8501553Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T06:26:46.8502433Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T06:26:46.8503341Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2025-03-14T06:26:46.8504260Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2025-03-14T06:26:46.8505207Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local ... 2025-03-14T06:26:47.0702107Z 2025-03-14T06:26:47.0702996Z  2025-03-14T06:26:47.0703462Z  2025-03-14T06:26:47.0703928Z  2025-03-14T06:26:47.0704357Z  2025-03-14T06:26:47.0704755Z  2025-03-14T06:26:47.0705168Z  2025-03-14T06:26:47.0705582Z  2025-03-14T06:26:47.0705981Z  2025-03-14T06:26:47.0706944Z [11,956 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:47.0707981Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T06:26:47.0708748Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T06:26:47.0709653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T06:26:47.0710621Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T06:26:47.0711564Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 51s local 2025-03-14T06:26:47.0712474Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2025-03-14T06:26:47.0713372Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2025-03-14T06:26:47.0714345Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local ... 2025-03-14T06:26:47.3744236Z 2025-03-14T06:26:47.3745120Z  2025-03-14T06:26:47.3745603Z  2025-03-14T06:26:47.3746024Z  2025-03-14T06:26:47.3746426Z  2025-03-14T06:26:47.3746837Z  2025-03-14T06:26:47.3747239Z  2025-03-14T06:26:47.3747920Z  2025-03-14T06:26:47.3748316Z  2025-03-14T06:26:47.3749298Z [11,957 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:47.3750314Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T06:26:47.3751169Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T06:26:47.3752089Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T06:26:47.3753183Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T06:26:47.3754089Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T06:26:47.3755062Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2025-03-14T06:26:47.3755978Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2025-03-14T06:26:47.3756917Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local ... 2025-03-14T06:26:47.6708461Z 2025-03-14T06:26:47.6709326Z  2025-03-14T06:26:47.6709838Z  2025-03-14T06:26:47.6710243Z  2025-03-14T06:26:47.6710624Z  2025-03-14T06:26:47.6711045Z  2025-03-14T06:26:47.6711449Z  2025-03-14T06:26:47.6711879Z  2025-03-14T06:26:47.6712307Z  2025-03-14T06:26:47.6713288Z [11,957 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:47.6714801Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T06:26:47.6715718Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T06:26:47.6716830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T06:26:47.6718322Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T06:26:47.6719440Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T06:26:47.6720588Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2025-03-14T06:26:47.6721686Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 15s local 2025-03-14T06:26:47.6722824Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local ... 2025-03-14T06:26:47.8712936Z 2025-03-14T06:26:47.8713802Z  2025-03-14T06:26:47.8714317Z  2025-03-14T06:26:47.8715181Z  2025-03-14T06:26:47.8715599Z  2025-03-14T06:26:47.8716396Z  2025-03-14T06:26:47.8716971Z  2025-03-14T06:26:47.8717543Z  2025-03-14T06:26:47.8718099Z  2025-03-14T06:26:47.8719284Z [11,958 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:47.8720522Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T06:26:47.8721369Z Compiling src/cpu/rnn/ref_rnn.cpp; 91s local 2025-03-14T06:26:47.8722458Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T06:26:47.8723682Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T06:26:47.8725078Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_strided.cpp; 52s local 2025-03-14T06:26:47.8726209Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2025-03-14T06:26:47.8727254Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2025-03-14T06:26:47.8728375Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local ... 2025-03-14T06:26:48.1924869Z 2025-03-14T06:26:48.1925744Z  2025-03-14T06:26:48.1926231Z  2025-03-14T06:26:48.1926621Z  2025-03-14T06:26:48.1927036Z  2025-03-14T06:26:48.1927405Z  2025-03-14T06:26:48.1927791Z  2025-03-14T06:26:48.1928206Z  2025-03-14T06:26:48.1928645Z  2025-03-14T06:26:48.1929591Z [11,960 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:48.1930564Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T06:26:48.1931266Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T06:26:48.1932661Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T06:26:48.1933741Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T06:26:48.1934996Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2025-03-14T06:26:48.1936011Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2025-03-14T06:26:48.1937022Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2025-03-14T06:26:48.1938314Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 15s local ... 2025-03-14T06:26:48.4720859Z 2025-03-14T06:26:48.4721699Z  2025-03-14T06:26:48.4722146Z  2025-03-14T06:26:48.4722772Z  2025-03-14T06:26:48.4723165Z  2025-03-14T06:26:48.4723539Z  2025-03-14T06:26:48.4723924Z  2025-03-14T06:26:48.4724326Z  2025-03-14T06:26:48.4724833Z  2025-03-14T06:26:48.4725697Z [11,962 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:48.4726622Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T06:26:48.4727255Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T06:26:48.4728096Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T06:26:48.4728944Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T06:26:48.4729733Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2025-03-14T06:26:48.4730552Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2025-03-14T06:26:48.4731335Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2025-03-14T06:26:48.4732261Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 14s local ... 2025-03-14T06:26:48.6728521Z 2025-03-14T06:26:48.6729380Z  2025-03-14T06:26:48.6729790Z  2025-03-14T06:26:48.6730354Z  2025-03-14T06:26:48.6730822Z  2025-03-14T06:26:48.6731192Z  2025-03-14T06:26:48.6731516Z  2025-03-14T06:26:48.6731877Z  2025-03-14T06:26:48.6732197Z  2025-03-14T06:26:48.6733031Z [11,965 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:48.6733849Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T06:26:48.6734446Z Compiling src/cpu/rnn/ref_rnn.cpp; 92s local 2025-03-14T06:26:48.6735192Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T06:26:48.6735995Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T06:26:48.6736705Z Compiling src/cpu/x64/lrn/jit_uni_lrn_kernel.cpp; 16s local 2025-03-14T06:26:48.6737435Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2025-03-14T06:26:48.6738240Z Compiling src/cpu/x64/matmul/brgemm_matmul_copy_utils.cpp; 15s local 2025-03-14T06:26:48.6739103Z Compiling src/cpu/x64/gemm/f32/jit_avx_gemm_f32.cpp; 10s local ... 2025-03-14T06:26:48.9736862Z 2025-03-14T06:26:48.9737674Z  2025-03-14T06:26:48.9738145Z  2025-03-14T06:26:48.9738520Z  2025-03-14T06:26:48.9738911Z  2025-03-14T06:26:48.9739305Z  2025-03-14T06:26:48.9739720Z  2025-03-14T06:26:48.9740089Z  2025-03-14T06:26:48.9740470Z  2025-03-14T06:26:48.9741386Z [11,970 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:48.9742291Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T06:26:48.9742978Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T06:26:48.9743843Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T06:26:48.9744740Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T06:26:48.9745528Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2025-03-14T06:26:48.9746380Z Compiling src/cpu/x64/gemm/f32/jit_avx_gemm_f32.cpp; 10s local 2025-03-14T06:26:48.9747203Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 9s local 2025-03-14T06:26:48.9747871Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:26:49.2734989Z 2025-03-14T06:26:49.2735872Z  2025-03-14T06:26:49.2736378Z  2025-03-14T06:26:49.2737146Z  2025-03-14T06:26:49.2737552Z  2025-03-14T06:26:49.2737975Z  2025-03-14T06:26:49.2738363Z  2025-03-14T06:26:49.2738759Z  2025-03-14T06:26:49.2739152Z  2025-03-14T06:26:49.2740086Z [11,971 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:49.2741303Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T06:26:49.2742004Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T06:26:49.2744879Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T06:26:49.2746149Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T06:26:49.2746961Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2025-03-14T06:26:49.2747887Z Compiling src/cpu/x64/gemm/f32/jit_avx_gemm_f32.cpp; 10s local 2025-03-14T06:26:49.2748810Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local 2025-03-14T06:26:49.2749546Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:26:49.5396085Z 2025-03-14T06:26:49.5396932Z  2025-03-14T06:26:49.5397415Z  2025-03-14T06:26:49.5397827Z  2025-03-14T06:26:49.5398228Z  2025-03-14T06:26:49.5398632Z  2025-03-14T06:26:49.5399053Z  2025-03-14T06:26:49.5399509Z  2025-03-14T06:26:49.5399932Z  2025-03-14T06:26:49.5400910Z [11,972 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:49.5401928Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T06:26:49.5402650Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T06:26:49.5403866Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:26:49.5405008Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T06:26:49.5405865Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2025-03-14T06:26:49.5406791Z Compiling src/cpu/x64/gemm/f32/jit_avx_gemm_f32.cpp; 11s local 2025-03-14T06:26:49.5407697Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local 2025-03-14T06:26:49.5408453Z @onednn//:mkl_dnn; 7s local ... 2025-03-14T06:26:49.7512196Z 2025-03-14T06:26:49.7513068Z  2025-03-14T06:26:49.7513546Z  2025-03-14T06:26:49.7513955Z  2025-03-14T06:26:49.7514347Z  2025-03-14T06:26:49.7514729Z  2025-03-14T06:26:49.7515121Z  2025-03-14T06:26:49.7515516Z  2025-03-14T06:26:49.7515913Z  2025-03-14T06:26:49.7516889Z [11,974 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:49.7517795Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T06:26:49.7518507Z Compiling src/cpu/rnn/ref_rnn.cpp; 93s local 2025-03-14T06:26:49.7519365Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:26:49.7520258Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T06:26:49.7521043Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2025-03-14T06:26:49.7521913Z Compiling src/cpu/x64/gemm/f32/jit_avx_gemm_f32.cpp; 11s local 2025-03-14T06:26:49.7522805Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 10s local 2025-03-14T06:26:49.7523502Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:26:50.0232826Z 2025-03-14T06:26:50.0233734Z  2025-03-14T06:26:50.0234302Z  2025-03-14T06:26:50.0234673Z  2025-03-14T06:26:50.0235051Z  2025-03-14T06:26:50.0235460Z  2025-03-14T06:26:50.0235852Z  2025-03-14T06:26:50.0236257Z  2025-03-14T06:26:50.0236645Z  2025-03-14T06:26:50.0237546Z [11,975 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:50.0238501Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T06:26:50.0239191Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T06:26:50.0240084Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:26:50.0241324Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T06:26:50.0242285Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2025-03-14T06:26:50.0243161Z Compiling src/cpu/x64/gemm/f32/jit_avx_gemm_f32.cpp; 11s local 2025-03-14T06:26:50.0244250Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2025-03-14T06:26:50.0245152Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:26:50.2743187Z 2025-03-14T06:26:50.2744032Z  2025-03-14T06:26:50.2744529Z  2025-03-14T06:26:50.2745254Z  2025-03-14T06:26:50.2745692Z  2025-03-14T06:26:50.2746077Z  2025-03-14T06:26:50.2746481Z  2025-03-14T06:26:50.2746987Z  2025-03-14T06:26:50.2747385Z  2025-03-14T06:26:50.2748365Z [11,976 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:50.2749372Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T06:26:50.2750093Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T06:26:50.2751037Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:26:50.2751999Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T06:26:50.2752837Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2025-03-14T06:26:50.2763778Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2025-03-14T06:26:50.2764697Z @onednn//:mkl_dnn; 8s local 2025-03-14T06:26:50.2767256Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 8s local ... 2025-03-14T06:26:50.6840925Z 2025-03-14T06:26:50.6841762Z  2025-03-14T06:26:50.6842276Z  2025-03-14T06:26:50.6842685Z  2025-03-14T06:26:50.6843395Z  2025-03-14T06:26:50.6843860Z  2025-03-14T06:26:50.6844254Z  2025-03-14T06:26:50.6844752Z  2025-03-14T06:26:50.6845142Z  2025-03-14T06:26:50.6846046Z [11,977 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:50.6847015Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T06:26:50.6847678Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T06:26:50.6848543Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T06:26:50.6849480Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T06:26:50.6850270Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2025-03-14T06:26:50.6851133Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2025-03-14T06:26:50.6851874Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:26:50.6852578Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 8s local ... 2025-03-14T06:26:50.8853965Z 2025-03-14T06:26:50.8854844Z  2025-03-14T06:26:50.8855363Z  2025-03-14T06:26:50.8855749Z  2025-03-14T06:26:50.8856151Z  2025-03-14T06:26:50.8856527Z  2025-03-14T06:26:50.8856909Z  2025-03-14T06:26:50.8857313Z  2025-03-14T06:26:50.8857716Z  2025-03-14T06:26:50.8858679Z [11,978 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:50.8859594Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T06:26:50.8860290Z Compiling src/cpu/rnn/ref_rnn.cpp; 94s local 2025-03-14T06:26:50.8861175Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T06:26:50.8862237Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T06:26:50.8863082Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2025-03-14T06:26:50.8863997Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 11s local 2025-03-14T06:26:50.8864761Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:26:50.8865660Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 8s local ... 2025-03-14T06:26:51.2751030Z 2025-03-14T06:26:51.2751862Z  2025-03-14T06:26:51.2752382Z  2025-03-14T06:26:51.2752798Z  2025-03-14T06:26:51.2753154Z  2025-03-14T06:26:51.2753930Z  2025-03-14T06:26:51.2754316Z  2025-03-14T06:26:51.2754709Z  2025-03-14T06:26:51.2755118Z  2025-03-14T06:26:51.2756044Z [11,979 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:51.2757188Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T06:26:51.2757884Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T06:26:51.2758755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T06:26:51.2759863Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T06:26:51.2760784Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T06:26:51.2761644Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2025-03-14T06:26:51.2762367Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:26:51.2763081Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 9s local ... 2025-03-14T06:26:51.4754579Z 2025-03-14T06:26:51.4755425Z  2025-03-14T06:26:51.4755943Z  2025-03-14T06:26:51.4756371Z  2025-03-14T06:26:51.4756761Z  2025-03-14T06:26:51.4757130Z  2025-03-14T06:26:51.4757489Z  2025-03-14T06:26:51.4757954Z  2025-03-14T06:26:51.4758461Z  2025-03-14T06:26:51.4759665Z [11,980 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:51.4760833Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T06:26:51.4761509Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T06:26:51.4762429Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T06:26:51.4763696Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T06:26:51.4764691Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T06:26:51.4765745Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2025-03-14T06:26:51.4766448Z @onednn//:mkl_dnn; 9s local 2025-03-14T06:26:51.4767174Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 9s local ... 2025-03-14T06:26:51.9032614Z 2025-03-14T06:26:51.9033511Z  2025-03-14T06:26:51.9034008Z  2025-03-14T06:26:51.9034440Z  2025-03-14T06:26:51.9034870Z  2025-03-14T06:26:51.9035280Z  2025-03-14T06:26:51.9035705Z  2025-03-14T06:26:51.9036097Z  2025-03-14T06:26:51.9036485Z  2025-03-14T06:26:51.9037421Z [11,981 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:51.9038463Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T06:26:51.9039117Z Compiling src/cpu/rnn/ref_rnn.cpp; 95s local 2025-03-14T06:26:51.9040005Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T06:26:51.9040922Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T06:26:51.9041747Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T06:26:51.9042589Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 12s local 2025-03-14T06:26:51.9043491Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:26:51.9044211Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 9s local ... 2025-03-14T06:26:52.2762440Z 2025-03-14T06:26:52.2763254Z  2025-03-14T06:26:52.2763778Z  2025-03-14T06:26:52.2764184Z  2025-03-14T06:26:52.2764733Z  2025-03-14T06:26:52.2765136Z  2025-03-14T06:26:52.2765786Z  2025-03-14T06:26:52.2766185Z  2025-03-14T06:26:52.2766575Z  2025-03-14T06:26:52.2767585Z [11,981 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:52.2768533Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T06:26:52.2769200Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T06:26:52.2770164Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T06:26:52.2771109Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T06:26:52.2772217Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T06:26:52.2773085Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2025-03-14T06:26:52.2773855Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:26:52.2774651Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 10s local ... 2025-03-14T06:26:52.4766552Z 2025-03-14T06:26:52.4767381Z  2025-03-14T06:26:52.4767822Z  2025-03-14T06:26:52.4768213Z  2025-03-14T06:26:52.4768599Z  2025-03-14T06:26:52.4768990Z  2025-03-14T06:26:52.4769636Z  2025-03-14T06:26:52.4770033Z  2025-03-14T06:26:52.4770431Z  2025-03-14T06:26:52.4771335Z [11,982 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:52.4772231Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T06:26:52.4772859Z Compiling src/cpu/rnn/ref_rnn.cpp; 96s local 2025-03-14T06:26:52.4773658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T06:26:52.4774519Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T06:26:52.4775247Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T06:26:52.4776050Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2025-03-14T06:26:52.4776734Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:26:52.4777420Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 10s local ... 2025-03-14T06:26:52.9781560Z 2025-03-14T06:26:52.9782390Z  2025-03-14T06:26:52.9782922Z  2025-03-14T06:26:52.9783337Z  2025-03-14T06:26:52.9783724Z  2025-03-14T06:26:52.9784125Z  2025-03-14T06:26:52.9784511Z  2025-03-14T06:26:52.9785142Z  2025-03-14T06:26:52.9785534Z  2025-03-14T06:26:52.9786444Z [11,983 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:52.9787379Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T06:26:52.9788067Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T06:26:52.9788784Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T06:26:52.9789532Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T06:26:52.9790247Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T06:26:52.9791089Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 13s local 2025-03-14T06:26:52.9791790Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:26:52.9792497Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 10s local ... 2025-03-14T06:26:53.2774217Z 2025-03-14T06:26:53.2775077Z  2025-03-14T06:26:53.2775571Z  2025-03-14T06:26:53.2776025Z  2025-03-14T06:26:53.2776427Z  2025-03-14T06:26:53.2776843Z  2025-03-14T06:26:53.2777235Z  2025-03-14T06:26:53.2777655Z  2025-03-14T06:26:53.2778066Z  2025-03-14T06:26:53.2779048Z [11,983 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:53.2780065Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T06:26:53.2780797Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T06:26:53.2781729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T06:26:53.2782735Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T06:26:53.2783584Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T06:26:53.2784521Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2025-03-14T06:26:53.2785274Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:26:53.2786038Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 11s local ... 2025-03-14T06:26:53.4972153Z 2025-03-14T06:26:53.4972952Z  2025-03-14T06:26:53.4973438Z  2025-03-14T06:26:53.4973841Z  2025-03-14T06:26:53.4974241Z  2025-03-14T06:26:53.4974628Z  2025-03-14T06:26:53.4975016Z  2025-03-14T06:26:53.4975412Z  2025-03-14T06:26:53.4976074Z  2025-03-14T06:26:53.4976997Z [11,985 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:53.4977977Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T06:26:53.4978672Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T06:26:53.4979722Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T06:26:53.4980796Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T06:26:53.4981747Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T06:26:53.4982647Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2025-03-14T06:26:53.4983378Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:26:53.4984119Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 11s local ... 2025-03-14T06:26:53.8780546Z 2025-03-14T06:26:53.8781401Z  2025-03-14T06:26:53.8781905Z  2025-03-14T06:26:53.8782320Z  2025-03-14T06:26:53.8782731Z  2025-03-14T06:26:53.8783170Z  2025-03-14T06:26:53.8783585Z  2025-03-14T06:26:53.8783978Z  2025-03-14T06:26:53.8784385Z  2025-03-14T06:26:53.8785351Z [11,986 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:53.8786354Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T06:26:53.8787046Z Compiling src/cpu/rnn/ref_rnn.cpp; 97s local 2025-03-14T06:26:53.8787972Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T06:26:53.8788920Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T06:26:53.8790061Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T06:26:53.8790981Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local 2025-03-14T06:26:53.8791766Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:26:53.8792484Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 11s local ... 2025-03-14T06:26:54.2817845Z 2025-03-14T06:26:54.2818746Z  2025-03-14T06:26:54.2819221Z  2025-03-14T06:26:54.2819612Z  2025-03-14T06:26:54.2819990Z  2025-03-14T06:26:54.2820374Z  2025-03-14T06:26:54.2820754Z  2025-03-14T06:26:54.2821147Z  2025-03-14T06:26:54.2821534Z  2025-03-14T06:26:54.2822496Z [11,987 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:54.2823431Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T06:26:54.2824107Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T06:26:54.2825026Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T06:26:54.2825982Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T06:26:54.2826754Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T06:26:54.2827628Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2025-03-14T06:26:54.2828365Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:26:54.2829097Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local ... 2025-03-14T06:26:54.6787107Z 2025-03-14T06:26:54.6787928Z  2025-03-14T06:26:54.6788383Z  2025-03-14T06:26:54.6788796Z  2025-03-14T06:26:54.6789179Z  2025-03-14T06:26:54.6789592Z  2025-03-14T06:26:54.6789966Z  2025-03-14T06:26:54.6790348Z  2025-03-14T06:26:54.6790702Z  2025-03-14T06:26:54.6791604Z [11,988 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:54.6792514Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T06:26:54.6793299Z Compiling src/cpu/rnn/ref_rnn.cpp; 98s local 2025-03-14T06:26:54.6794149Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T06:26:54.6795066Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T06:26:54.6795855Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T06:26:54.6796950Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local 2025-03-14T06:26:54.6797660Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:26:54.6798353Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local ... 2025-03-14T06:26:55.0792088Z 2025-03-14T06:26:55.0793210Z  2025-03-14T06:26:55.0793697Z  2025-03-14T06:26:55.0794083Z  2025-03-14T06:26:55.0794483Z  2025-03-14T06:26:55.0794874Z  2025-03-14T06:26:55.0795264Z  2025-03-14T06:26:55.0795648Z  2025-03-14T06:26:55.0796262Z  2025-03-14T06:26:55.0797207Z [11,989 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:55.0798171Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T06:26:55.0798881Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T06:26:55.0799766Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T06:26:55.0800705Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T06:26:55.0801540Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T06:26:55.0802416Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2025-03-14T06:26:55.0803137Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:26:55.0803868Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 12s local ... 2025-03-14T06:26:55.2796378Z 2025-03-14T06:26:55.2797253Z  2025-03-14T06:26:55.2797732Z  2025-03-14T06:26:55.2798192Z  2025-03-14T06:26:55.2798605Z  2025-03-14T06:26:55.2799040Z  2025-03-14T06:26:55.2799460Z  2025-03-14T06:26:55.2799857Z  2025-03-14T06:26:55.2800270Z  2025-03-14T06:26:55.2801480Z [11,991 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:55.2802522Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T06:26:55.2803259Z Compiling src/cpu/rnn/ref_rnn.cpp; 99s local 2025-03-14T06:26:55.2804150Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T06:26:55.2805262Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T06:26:55.2806100Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T06:26:55.2806957Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2025-03-14T06:26:55.2807731Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:26:55.2808493Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local ... 2025-03-14T06:26:56.0317412Z 2025-03-14T06:26:56.0318280Z  2025-03-14T06:26:56.0318776Z  2025-03-14T06:26:56.0319200Z  2025-03-14T06:26:56.0319617Z  2025-03-14T06:26:56.0320019Z  2025-03-14T06:26:56.0320429Z  2025-03-14T06:26:56.0320845Z  2025-03-14T06:26:56.0321264Z  2025-03-14T06:26:56.0322238Z [11,992 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:56.0323257Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T06:26:56.0324019Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T06:26:56.0325071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T06:26:56.0326024Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:26:56.0326847Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T06:26:56.0327703Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:26:56.0328468Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:26:56.0329243Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 13s local ... 2025-03-14T06:26:56.2805138Z 2025-03-14T06:26:56.2806025Z  2025-03-14T06:26:56.2806543Z  2025-03-14T06:26:56.2806943Z  2025-03-14T06:26:56.2807327Z  2025-03-14T06:26:56.2807734Z  2025-03-14T06:26:56.2808144Z  2025-03-14T06:26:56.2808534Z  2025-03-14T06:26:56.2808921Z  2025-03-14T06:26:56.2809851Z [11,992 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:56.2811102Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T06:26:56.2811800Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T06:26:56.2812730Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T06:26:56.2813865Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:26:56.2814695Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T06:26:56.2815763Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:26:56.2816476Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:26:56.2817244Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local ... 2025-03-14T06:26:56.4986647Z 2025-03-14T06:26:56.4987530Z  2025-03-14T06:26:56.4988036Z  2025-03-14T06:26:56.4988460Z  2025-03-14T06:26:56.4988902Z  2025-03-14T06:26:56.4989317Z  2025-03-14T06:26:56.4989730Z  2025-03-14T06:26:56.4990199Z  2025-03-14T06:26:56.4990622Z  2025-03-14T06:26:56.4991575Z [11,994 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:56.4992550Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T06:26:56.4993285Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T06:26:56.4994215Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T06:26:56.4995226Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:26:56.4996096Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T06:26:56.4997375Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:26:56.4998152Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:26:56.4998934Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local ... 2025-03-14T06:26:56.8811815Z 2025-03-14T06:26:56.8812672Z  2025-03-14T06:26:56.8813217Z  2025-03-14T06:26:56.8813668Z  2025-03-14T06:26:56.8814099Z  2025-03-14T06:26:56.8814512Z  2025-03-14T06:26:56.8814918Z  2025-03-14T06:26:56.8815327Z  2025-03-14T06:26:56.8815716Z  2025-03-14T06:26:56.8816673Z [11,996 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:56.8817682Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T06:26:56.8818439Z Compiling src/cpu/rnn/ref_rnn.cpp; 100s local 2025-03-14T06:26:56.8819391Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T06:26:56.8820400Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:26:56.8821336Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T06:26:56.8822239Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:26:56.8823216Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local 2025-03-14T06:26:56.8824235Z Compiling src/google/protobuf/descriptor.cc; 12s local ... 2025-03-14T06:26:57.0815737Z 2025-03-14T06:26:57.0816587Z  2025-03-14T06:26:57.0817100Z  2025-03-14T06:26:57.0817521Z  2025-03-14T06:26:57.0817937Z  2025-03-14T06:26:57.0818385Z  2025-03-14T06:26:57.0818819Z  2025-03-14T06:26:57.0819231Z  2025-03-14T06:26:57.0819615Z  2025-03-14T06:26:57.0820614Z [11,997 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:57.0821671Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T06:26:57.0822445Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T06:26:57.0823460Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T06:26:57.0824415Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T06:26:57.0825263Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T06:26:57.0826216Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T06:26:57.0827458Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 14s local 2025-03-14T06:26:57.0828405Z Compiling src/google/protobuf/descriptor.cc; 12s local ... 2025-03-14T06:26:57.3630286Z 2025-03-14T06:26:57.3631121Z  2025-03-14T06:26:57.3631925Z  2025-03-14T06:26:57.3632357Z  2025-03-14T06:26:57.3632779Z  2025-03-14T06:26:57.3633181Z  2025-03-14T06:26:57.3633597Z  2025-03-14T06:26:57.3634012Z  2025-03-14T06:26:57.3634442Z  2025-03-14T06:26:57.3635607Z [11,998 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:57.3636662Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T06:26:57.3637397Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T06:26:57.3638352Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T06:26:57.3639394Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T06:26:57.3640311Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2025-03-14T06:26:57.3641243Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T06:26:57.3642165Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local 2025-03-14T06:26:57.3643151Z Compiling src/google/protobuf/descriptor.cc; 12s local ... 2025-03-14T06:26:57.6821911Z 2025-03-14T06:26:57.6822794Z  2025-03-14T06:26:57.6823314Z  2025-03-14T06:26:57.6823738Z  2025-03-14T06:26:57.6824156Z  2025-03-14T06:26:57.6824622Z  2025-03-14T06:26:57.6825052Z  2025-03-14T06:26:57.6825441Z  2025-03-14T06:26:57.6825844Z  2025-03-14T06:26:57.6827081Z [11,999 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:57.6828094Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T06:26:57.6828853Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T06:26:57.6829828Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T06:26:57.6830853Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T06:26:57.6831738Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2025-03-14T06:26:57.6832692Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T06:26:57.6833683Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local 2025-03-14T06:26:57.6834669Z Compiling src/google/protobuf/descriptor.cc; 12s local ... 2025-03-14T06:26:57.8827183Z 2025-03-14T06:26:57.8828107Z  2025-03-14T06:26:57.8828628Z  2025-03-14T06:26:57.8829052Z  2025-03-14T06:26:57.8829456Z  2025-03-14T06:26:57.8829862Z  2025-03-14T06:26:57.8830270Z  2025-03-14T06:26:57.8830667Z  2025-03-14T06:26:57.8831076Z  2025-03-14T06:26:57.8832045Z [12,001 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:57.8832943Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2025-03-14T06:26:57.8833665Z Compiling src/cpu/rnn/ref_rnn.cpp; 101s local 2025-03-14T06:26:57.8834535Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T06:26:57.8835499Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T06:26:57.8836352Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T06:26:57.8837264Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 15s local 2025-03-14T06:26:57.8838119Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T06:26:57.8839101Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local ... 2025-03-14T06:26:58.4624401Z 2025-03-14T06:26:58.4625252Z  2025-03-14T06:26:58.4625770Z  2025-03-14T06:26:58.4626200Z  2025-03-14T06:26:58.4626617Z  2025-03-14T06:26:58.4627013Z  2025-03-14T06:26:58.4627396Z  2025-03-14T06:26:58.4627805Z  2025-03-14T06:26:58.4628184Z  2025-03-14T06:26:58.4629479Z [12,002 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:58.4630436Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2025-03-14T06:26:58.4631172Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T06:26:58.4632501Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T06:26:58.4633574Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T06:26:58.4634615Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T06:26:58.4635626Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2025-03-14T06:26:58.4636607Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T06:26:58.4637681Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local ... 2025-03-14T06:26:58.6835371Z 2025-03-14T06:26:58.6836215Z  2025-03-14T06:26:58.6836690Z  2025-03-14T06:26:58.6837079Z  2025-03-14T06:26:58.6837494Z  2025-03-14T06:26:58.6837868Z  2025-03-14T06:26:58.6838243Z  2025-03-14T06:26:58.6838592Z  2025-03-14T06:26:58.6838981Z  2025-03-14T06:26:58.6839874Z [12,002 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:58.6840771Z Compiling src/cpu/rnn/ref_rnn.cpp; 112s local 2025-03-14T06:26:58.6841452Z Compiling src/cpu/rnn/ref_rnn.cpp; 102s local 2025-03-14T06:26:58.6842331Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T06:26:58.6843220Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T06:26:58.6844250Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T06:26:58.6845286Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2025-03-14T06:26:58.6846095Z Compiling src/google/protobuf/descriptor.cc; 13s local 2025-03-14T06:26:58.6847002Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 12s local ... 2025-03-14T06:26:58.9854737Z 2025-03-14T06:26:58.9855582Z  2025-03-14T06:26:58.9856087Z  2025-03-14T06:26:58.9856514Z  2025-03-14T06:26:58.9856936Z  2025-03-14T06:26:58.9857360Z  2025-03-14T06:26:58.9857789Z  2025-03-14T06:26:58.9858232Z  2025-03-14T06:26:58.9858660Z  2025-03-14T06:26:58.9859627Z [12,005 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:58.9860664Z Compiling src/cpu/rnn/ref_rnn.cpp; 113s local 2025-03-14T06:26:58.9861432Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T06:26:58.9862417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T06:26:58.9863446Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T06:26:58.9864330Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T06:26:58.9865474Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 16s local 2025-03-14T06:26:58.9866452Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T06:26:58.9867516Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local ... 2025-03-14T06:26:59.2842399Z 2025-03-14T06:26:59.2843232Z  2025-03-14T06:26:59.2843702Z  2025-03-14T06:26:59.2844139Z  2025-03-14T06:26:59.2844734Z  2025-03-14T06:26:59.2845133Z  2025-03-14T06:26:59.2845540Z  2025-03-14T06:26:59.2845938Z  2025-03-14T06:26:59.2846342Z  2025-03-14T06:26:59.2847348Z [12,006 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:59.2848338Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T06:26:59.2849266Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T06:26:59.2850206Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T06:26:59.2851040Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T06:26:59.2852241Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2025-03-14T06:26:59.2853181Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T06:26:59.2854181Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T06:26:59.2855473Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local ... 2025-03-14T06:26:59.4846456Z 2025-03-14T06:26:59.4847326Z  2025-03-14T06:26:59.4847801Z  2025-03-14T06:26:59.4848205Z  2025-03-14T06:26:59.4848584Z  2025-03-14T06:26:59.4849259Z  2025-03-14T06:26:59.4849687Z  2025-03-14T06:26:59.4850102Z  2025-03-14T06:26:59.4850587Z  2025-03-14T06:26:59.4851753Z [12,008 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:26:59.4852678Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T06:26:59.4853617Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T06:26:59.4854534Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T06:26:59.4855397Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T06:26:59.4856279Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2025-03-14T06:26:59.4857174Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T06:26:59.4858110Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T06:26:59.4859175Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local ... 2025-03-14T06:26:59.6904091Z 2025-03-14T06:26:59.6904915Z  2025-03-14T06:26:59.6905401Z  2025-03-14T06:26:59.6905897Z  2025-03-14T06:26:59.6906701Z  2025-03-14T06:26:59.6907263Z  2025-03-14T06:26:59.6907758Z  2025-03-14T06:26:59.6908234Z  2025-03-14T06:26:59.6908675Z  2025-03-14T06:26:59.6909785Z [12,010 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:26:59.6910793Z Compiling src/cpu/rnn/ref_rnn.cpp; 103s local 2025-03-14T06:26:59.6911722Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T06:26:59.6912756Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T06:26:59.6913623Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T06:26:59.6914528Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2025-03-14T06:26:59.6915394Z Compiling src/google/protobuf/descriptor.cc; 14s local 2025-03-14T06:26:59.6916381Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 13s local 2025-03-14T06:26:59.6917528Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local ... 2025-03-14T06:27:00.0853026Z 2025-03-14T06:27:00.0853894Z  2025-03-14T06:27:00.0854396Z  2025-03-14T06:27:00.0854816Z  2025-03-14T06:27:00.0855221Z  2025-03-14T06:27:00.0855633Z  2025-03-14T06:27:00.0856068Z  2025-03-14T06:27:00.0856498Z  2025-03-14T06:27:00.0856915Z  2025-03-14T06:27:00.0857859Z [12,010 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:00.0858836Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T06:27:00.0859848Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T06:27:00.0860761Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:27:00.0861598Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T06:27:00.0862437Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 17s local 2025-03-14T06:27:00.0863276Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T06:27:00.0864210Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T06:27:00.0865178Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 14s local ... 2025-03-14T06:27:00.4087119Z 2025-03-14T06:27:00.4087990Z  2025-03-14T06:27:00.4088763Z  2025-03-14T06:27:00.4089173Z  2025-03-14T06:27:00.4089581Z  2025-03-14T06:27:00.4089999Z  2025-03-14T06:27:00.4090403Z  2025-03-14T06:27:00.4090816Z  2025-03-14T06:27:00.4091225Z  2025-03-14T06:27:00.4092192Z [12,013 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:00.4093348Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T06:27:00.4094397Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T06:27:00.4095381Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:27:00.4096259Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T06:27:00.4097198Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2025-03-14T06:27:00.4098123Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T06:27:00.4099123Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T06:27:00.4100011Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T06:27:00.6539753Z 2025-03-14T06:27:00.6540609Z  2025-03-14T06:27:00.6541094Z  2025-03-14T06:27:00.6541474Z  2025-03-14T06:27:00.6541882Z  2025-03-14T06:27:00.6542318Z  2025-03-14T06:27:00.6542697Z  2025-03-14T06:27:00.6543093Z  2025-03-14T06:27:00.6543501Z  2025-03-14T06:27:00.6544494Z [12,016 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:00.6545471Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T06:27:00.6546614Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T06:27:00.6547597Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:27:00.6548475Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T06:27:00.6549435Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2025-03-14T06:27:00.6550385Z Compiling src/google/protobuf/descriptor.cc; 15s local 2025-03-14T06:27:00.6551382Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 14s local 2025-03-14T06:27:00.6552276Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T06:27:00.8860131Z 2025-03-14T06:27:00.8861013Z  2025-03-14T06:27:00.8861526Z  2025-03-14T06:27:00.8861941Z  2025-03-14T06:27:00.8862353Z  2025-03-14T06:27:00.8862767Z  2025-03-14T06:27:00.8863186Z  2025-03-14T06:27:00.8863603Z  2025-03-14T06:27:00.8864036Z  2025-03-14T06:27:00.8865026Z [12,017 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:00.8866258Z Compiling src/cpu/rnn/ref_rnn.cpp; 104s local 2025-03-14T06:27:00.8867218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T06:27:00.8868222Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:27:00.8869124Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T06:27:00.8870051Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2025-03-14T06:27:00.8870907Z Compiling src/google/protobuf/descriptor.cc; 16s local 2025-03-14T06:27:00.8871926Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T06:27:00.8872850Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T06:27:01.1239639Z 2025-03-14T06:27:01.1240487Z  2025-03-14T06:27:01.1240994Z  2025-03-14T06:27:01.1241418Z  2025-03-14T06:27:01.1241866Z  2025-03-14T06:27:01.1242277Z  2025-03-14T06:27:01.1242678Z  2025-03-14T06:27:01.1243093Z  2025-03-14T06:27:01.1243500Z  2025-03-14T06:27:01.1244591Z [12,018 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:01.1245578Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T06:27:01.1246492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T06:27:01.1247690Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T06:27:01.1248488Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T06:27:01.1249362Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 18s local 2025-03-14T06:27:01.1250552Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T06:27:01.1251621Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T06:27:01.1252903Z Compiling src/google/protobuf/descriptor.cc [for tool]; 13s local ... 2025-03-14T06:27:01.4822511Z 2025-03-14T06:27:01.4823383Z  2025-03-14T06:27:01.4823893Z  2025-03-14T06:27:01.4824351Z  2025-03-14T06:27:01.4824763Z  2025-03-14T06:27:01.4825184Z  2025-03-14T06:27:01.4825575Z  2025-03-14T06:27:01.4825975Z  2025-03-14T06:27:01.4826374Z  2025-03-14T06:27:01.4827331Z [12,021 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:01.4828342Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T06:27:01.4829265Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T06:27:01.4830206Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T06:27:01.4831071Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T06:27:01.4832007Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2025-03-14T06:27:01.4833040Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T06:27:01.4834182Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T06:27:01.4835565Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local ... 2025-03-14T06:27:01.6868059Z 2025-03-14T06:27:01.6868947Z  2025-03-14T06:27:01.6869453Z  2025-03-14T06:27:01.6869884Z  2025-03-14T06:27:01.6870302Z  2025-03-14T06:27:01.6870716Z  2025-03-14T06:27:01.6871162Z  2025-03-14T06:27:01.6871567Z  2025-03-14T06:27:01.6871953Z  2025-03-14T06:27:01.6872842Z [12,021 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:01.6873857Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T06:27:01.6874804Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T06:27:01.6875754Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T06:27:01.6876588Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T06:27:01.6877540Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2025-03-14T06:27:01.6878617Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 15s local 2025-03-14T06:27:01.6879670Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T06:27:01.6880805Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local ... 2025-03-14T06:27:01.8886546Z 2025-03-14T06:27:01.8887376Z  2025-03-14T06:27:01.8887877Z  2025-03-14T06:27:01.8888290Z  2025-03-14T06:27:01.8888713Z  2025-03-14T06:27:01.8889130Z  2025-03-14T06:27:01.8889551Z  2025-03-14T06:27:01.8889956Z  2025-03-14T06:27:01.8890400Z  2025-03-14T06:27:01.8891319Z [12,027 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:01.8892311Z Compiling src/cpu/rnn/ref_rnn.cpp; 105s local 2025-03-14T06:27:01.8893273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T06:27:01.8894271Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T06:27:01.8895130Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T06:27:01.8896059Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 19s local 2025-03-14T06:27:01.8897046Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T06:27:01.8898325Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 15s local 2025-03-14T06:27:01.8899356Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local ... 2025-03-14T06:27:02.2875023Z 2025-03-14T06:27:02.2875911Z  2025-03-14T06:27:02.2876860Z  2025-03-14T06:27:02.2877307Z  2025-03-14T06:27:02.2877738Z  2025-03-14T06:27:02.2878156Z  2025-03-14T06:27:02.2878577Z  2025-03-14T06:27:02.2878988Z  2025-03-14T06:27:02.2879416Z  2025-03-14T06:27:02.2880588Z [12,029 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:02.2881655Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T06:27:02.2882583Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T06:27:02.2883588Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T06:27:02.2884622Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T06:27:02.2885630Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2025-03-14T06:27:02.2886727Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T06:27:02.2887897Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T06:27:02.2889070Z Compiling src/google/protobuf/descriptor.cc [for tool]; 14s local ... 2025-03-14T06:27:02.5547951Z 2025-03-14T06:27:02.5548791Z  2025-03-14T06:27:02.5549289Z  2025-03-14T06:27:02.5549722Z  2025-03-14T06:27:02.5550223Z  2025-03-14T06:27:02.5550727Z  2025-03-14T06:27:02.5551253Z  2025-03-14T06:27:02.5551766Z  2025-03-14T06:27:02.5552427Z  2025-03-14T06:27:02.5553508Z [12,032 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:02.5554632Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T06:27:02.5555540Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:27:02.5556516Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T06:27:02.5557404Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T06:27:02.5558388Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2025-03-14T06:27:02.5559465Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 16s local 2025-03-14T06:27:02.5560661Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T06:27:02.5561868Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local ... 2025-03-14T06:27:02.8370857Z 2025-03-14T06:27:02.8371742Z  2025-03-14T06:27:02.8372279Z  2025-03-14T06:27:02.8372683Z  2025-03-14T06:27:02.8373126Z  2025-03-14T06:27:02.8373545Z  2025-03-14T06:27:02.8373966Z  2025-03-14T06:27:02.8374378Z  2025-03-14T06:27:02.8374778Z  2025-03-14T06:27:02.8376186Z [12,035 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:02.8377210Z Compiling src/cpu/rnn/ref_rnn.cpp; 106s local 2025-03-14T06:27:02.8378141Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:27:02.8379122Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T06:27:02.8379976Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T06:27:02.8380920Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2025-03-14T06:27:02.8381976Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T06:27:02.8383075Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 16s local 2025-03-14T06:27:02.8384162Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local ... 2025-03-14T06:27:03.0680217Z 2025-03-14T06:27:03.0681117Z  2025-03-14T06:27:03.0681606Z  2025-03-14T06:27:03.0682032Z  2025-03-14T06:27:03.0682443Z  2025-03-14T06:27:03.0683125Z  2025-03-14T06:27:03.0683535Z  2025-03-14T06:27:03.0683945Z  2025-03-14T06:27:03.0684337Z  2025-03-14T06:27:03.0685451Z [12,036 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:03.0686655Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T06:27:03.0687643Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:27:03.0688660Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:27:03.0689653Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T06:27:03.0690649Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 20s local 2025-03-14T06:27:03.0691711Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T06:27:03.0692815Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T06:27:03.0693981Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local ... 2025-03-14T06:27:03.2882853Z 2025-03-14T06:27:03.2883709Z  2025-03-14T06:27:03.2884183Z  2025-03-14T06:27:03.2884696Z  2025-03-14T06:27:03.2885094Z  2025-03-14T06:27:03.2885489Z  2025-03-14T06:27:03.2885865Z  2025-03-14T06:27:03.2886306Z  2025-03-14T06:27:03.2886694Z  2025-03-14T06:27:03.2887620Z [12,037 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:03.2888586Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T06:27:03.2889488Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:27:03.2890737Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:27:03.2891602Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T06:27:03.2892525Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2025-03-14T06:27:03.2893552Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T06:27:03.2894714Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T06:27:03.2895904Z Compiling src/google/protobuf/descriptor.cc [for tool]; 15s local ... 2025-03-14T06:27:03.4886634Z 2025-03-14T06:27:03.4887532Z  2025-03-14T06:27:03.4888010Z  2025-03-14T06:27:03.4888432Z  2025-03-14T06:27:03.4888844Z  2025-03-14T06:27:03.4889255Z  2025-03-14T06:27:03.4889656Z  2025-03-14T06:27:03.4890067Z  2025-03-14T06:27:03.4890493Z  2025-03-14T06:27:03.4891483Z [12,041 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:03.4892503Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T06:27:03.4893451Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:27:03.4894433Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:27:03.4895302Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T06:27:03.4896259Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2025-03-14T06:27:03.4897330Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 17s local 2025-03-14T06:27:03.4907699Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T06:27:03.4909163Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local ... 2025-03-14T06:27:03.7812252Z 2025-03-14T06:27:03.7813090Z  2025-03-14T06:27:03.7813578Z  2025-03-14T06:27:03.7814018Z  2025-03-14T06:27:03.7814445Z  2025-03-14T06:27:03.7814871Z  2025-03-14T06:27:03.7815257Z  2025-03-14T06:27:03.7815652Z  2025-03-14T06:27:03.7816059Z  2025-03-14T06:27:03.7817040Z [12,043 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:03.7818034Z Compiling src/cpu/rnn/ref_rnn.cpp; 107s local 2025-03-14T06:27:03.7818938Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T06:27:03.7820281Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:27:03.7821150Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T06:27:03.7822029Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2025-03-14T06:27:03.7823235Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T06:27:03.7824292Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 17s local 2025-03-14T06:27:03.7825519Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local ... 2025-03-14T06:27:04.0892074Z 2025-03-14T06:27:04.0892976Z  2025-03-14T06:27:04.0893525Z  2025-03-14T06:27:04.0893902Z  2025-03-14T06:27:04.0894254Z  2025-03-14T06:27:04.0894588Z  2025-03-14T06:27:04.0894945Z  2025-03-14T06:27:04.0895491Z  2025-03-14T06:27:04.0895831Z  2025-03-14T06:27:04.0896775Z [12,043 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:04.0897753Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T06:27:04.0898673Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T06:27:04.0899586Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T06:27:04.0900381Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T06:27:04.0901287Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 21s local 2025-03-14T06:27:04.0902269Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 18s local 2025-03-14T06:27:04.0903646Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T06:27:04.0904749Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local ... 2025-03-14T06:27:04.7209429Z 2025-03-14T06:27:04.7210269Z  2025-03-14T06:27:04.7210787Z  2025-03-14T06:27:04.7211212Z  2025-03-14T06:27:04.7211612Z  2025-03-14T06:27:04.7212045Z  2025-03-14T06:27:04.7212423Z  2025-03-14T06:27:04.7212803Z  2025-03-14T06:27:04.7213201Z  2025-03-14T06:27:04.7214107Z [12,044 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:04.7215046Z Compiling src/cpu/rnn/ref_rnn.cpp; 108s local 2025-03-14T06:27:04.7215930Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T06:27:04.7216878Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T06:27:04.7217700Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T06:27:04.7218566Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2025-03-14T06:27:04.7219517Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T06:27:04.7220569Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 18s local 2025-03-14T06:27:04.7221636Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local ... 2025-03-14T06:27:05.0458826Z 2025-03-14T06:27:05.0459678Z  2025-03-14T06:27:05.0460157Z  2025-03-14T06:27:05.0460535Z  2025-03-14T06:27:05.0460928Z  2025-03-14T06:27:05.0461334Z  2025-03-14T06:27:05.0461733Z  2025-03-14T06:27:05.0462172Z  2025-03-14T06:27:05.0462580Z  2025-03-14T06:27:05.0463566Z [12,046 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:05.0464554Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T06:27:05.0465630Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T06:27:05.0466540Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T06:27:05.0467320Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T06:27:05.0468270Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 22s local 2025-03-14T06:27:05.0469299Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T06:27:05.0470739Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T06:27:05.0471849Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local ... 2025-03-14T06:27:05.2900595Z 2025-03-14T06:27:05.2901679Z  2025-03-14T06:27:05.2902120Z  2025-03-14T06:27:05.2902488Z  2025-03-14T06:27:05.2902856Z  2025-03-14T06:27:05.2903203Z  2025-03-14T06:27:05.2903565Z  2025-03-14T06:27:05.2903915Z  2025-03-14T06:27:05.2904576Z  2025-03-14T06:27:05.2905452Z [12,048 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:05.2906309Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T06:27:05.2907096Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T06:27:05.2907929Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T06:27:05.2908651Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T06:27:05.2909439Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2025-03-14T06:27:05.2910501Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T06:27:05.2911465Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T06:27:05.2912404Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local ... 2025-03-14T06:27:05.4904939Z 2025-03-14T06:27:05.4905770Z  2025-03-14T06:27:05.4906255Z  2025-03-14T06:27:05.4906714Z  2025-03-14T06:27:05.4907115Z  2025-03-14T06:27:05.4907544Z  2025-03-14T06:27:05.4907959Z  2025-03-14T06:27:05.4908605Z  2025-03-14T06:27:05.4909040Z  2025-03-14T06:27:05.4910019Z [12,050 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:05.4911039Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T06:27:05.4911959Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T06:27:05.4912968Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T06:27:05.4913836Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T06:27:05.4914784Z Compiling src/graph/backend/dnnl/dnnl_backend.cpp; 23s local 2025-03-14T06:27:05.4915809Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 19s local 2025-03-14T06:27:05.4916989Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T06:27:05.4918107Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local ... 2025-03-14T06:27:05.7756177Z 2025-03-14T06:27:05.7757069Z  2025-03-14T06:27:05.7757601Z  2025-03-14T06:27:05.7758020Z  2025-03-14T06:27:05.7758429Z  2025-03-14T06:27:05.7758819Z  2025-03-14T06:27:05.7759225Z  2025-03-14T06:27:05.7759630Z  2025-03-14T06:27:05.7760051Z  2025-03-14T06:27:05.7761029Z [12,053 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:05.7762032Z Compiling src/cpu/rnn/ref_rnn.cpp; 109s local 2025-03-14T06:27:05.7762965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:27:05.7763971Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T06:27:05.7764942Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T06:27:05.7766143Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T06:27:05.7767246Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 19s local 2025-03-14T06:27:05.7768297Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T06:27:05.7769145Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2025-03-14T06:27:06.0910610Z 2025-03-14T06:27:06.0911420Z  2025-03-14T06:27:06.0911923Z  2025-03-14T06:27:06.0912317Z  2025-03-14T06:27:06.0912702Z  2025-03-14T06:27:06.0913385Z  2025-03-14T06:27:06.0913786Z  2025-03-14T06:27:06.0914180Z  2025-03-14T06:27:06.0914575Z  2025-03-14T06:27:06.0915512Z [12,053 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:06.0916710Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T06:27:06.0917622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:27:06.0918612Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T06:27:06.0919613Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T06:27:06.0920632Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T06:27:06.0921755Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T06:27:06.0922796Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T06:27:06.0923621Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2025-03-14T06:27:06.2915629Z 2025-03-14T06:27:06.2916550Z  2025-03-14T06:27:06.2917083Z  2025-03-14T06:27:06.2917475Z  2025-03-14T06:27:06.2917826Z  2025-03-14T06:27:06.2918282Z  2025-03-14T06:27:06.2918816Z  2025-03-14T06:27:06.2919273Z  2025-03-14T06:27:06.2919685Z  2025-03-14T06:27:06.2920717Z [12,054 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:06.2921822Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T06:27:06.2922750Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:27:06.2924136Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T06:27:06.2925290Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T06:27:06.2926245Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T06:27:06.2927345Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T06:27:06.2928579Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T06:27:06.2929422Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2025-03-14T06:27:06.5293097Z 2025-03-14T06:27:06.5293993Z  2025-03-14T06:27:06.5294495Z  2025-03-14T06:27:06.5294958Z  2025-03-14T06:27:06.5295373Z  2025-03-14T06:27:06.5295795Z  2025-03-14T06:27:06.5296211Z  2025-03-14T06:27:06.5296607Z  2025-03-14T06:27:06.5297012Z  2025-03-14T06:27:06.5298016Z [12,055 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:06.5299011Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T06:27:06.5299948Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:27:06.5300935Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T06:27:06.5301810Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T06:27:06.5302871Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 20s local 2025-03-14T06:27:06.5304003Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T06:27:06.5305090Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T06:27:06.5305951Z @llvm-project//llvm:llvm-tblgen; 14s local ... 2025-03-14T06:27:06.8552904Z 2025-03-14T06:27:06.8553755Z  2025-03-14T06:27:06.8554310Z  2025-03-14T06:27:06.8554787Z  2025-03-14T06:27:06.8555225Z  2025-03-14T06:27:06.8555691Z  2025-03-14T06:27:06.8556104Z  2025-03-14T06:27:06.8556548Z  2025-03-14T06:27:06.8556976Z  2025-03-14T06:27:06.8557986Z [12,056 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:06.8558995Z Compiling src/cpu/rnn/ref_rnn.cpp; 110s local 2025-03-14T06:27:06.8559979Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T06:27:06.8561269Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T06:27:06.8562133Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T06:27:06.8563179Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T06:27:06.8564617Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 20s local 2025-03-14T06:27:06.8565880Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T06:27:06.8566917Z @llvm-project//llvm:llvm-tblgen; 14s local ... 2025-03-14T06:27:07.0922104Z 2025-03-14T06:27:07.0922918Z  2025-03-14T06:27:07.0923407Z  2025-03-14T06:27:07.0923846Z  2025-03-14T06:27:07.0924290Z  2025-03-14T06:27:07.0924824Z  2025-03-14T06:27:07.0925231Z  2025-03-14T06:27:07.0925642Z  2025-03-14T06:27:07.0926016Z  2025-03-14T06:27:07.0927014Z [12,059 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:07.0928042Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T06:27:07.0928965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T06:27:07.0929976Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T06:27:07.0930836Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T06:27:07.0932027Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T06:27:07.0933197Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T06:27:07.0934487Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T06:27:07.0935621Z @llvm-project//llvm:llvm-tblgen; 14s local ... 2025-03-14T06:27:07.4927728Z 2025-03-14T06:27:07.4928586Z  2025-03-14T06:27:07.4929132Z  2025-03-14T06:27:07.4929603Z  2025-03-14T06:27:07.4930046Z  2025-03-14T06:27:07.4930497Z  2025-03-14T06:27:07.4930935Z  2025-03-14T06:27:07.4931416Z  2025-03-14T06:27:07.4931840Z  2025-03-14T06:27:07.4932843Z [12,060 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:07.4933838Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T06:27:07.4934828Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T06:27:07.4935851Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T06:27:07.4936765Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T06:27:07.4937839Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 21s local 2025-03-14T06:27:07.4939046Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T06:27:07.4940118Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T06:27:07.4941002Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2025-03-14T06:27:07.8551127Z 2025-03-14T06:27:07.8551951Z  2025-03-14T06:27:07.8552469Z  2025-03-14T06:27:07.8552852Z  2025-03-14T06:27:07.8553252Z  2025-03-14T06:27:07.8553640Z  2025-03-14T06:27:07.8554041Z  2025-03-14T06:27:07.8554458Z  2025-03-14T06:27:07.8554852Z  2025-03-14T06:27:07.8555846Z [12,061 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:07.8556780Z Compiling src/cpu/rnn/ref_rnn.cpp; 111s local 2025-03-14T06:27:07.8557711Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T06:27:07.8558717Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T06:27:07.8559509Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T06:27:07.8560438Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T06:27:07.8561536Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 21s local 2025-03-14T06:27:07.8562610Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T06:27:07.8563706Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2025-03-14T06:27:08.0933538Z 2025-03-14T06:27:08.0934364Z  2025-03-14T06:27:08.0934841Z  2025-03-14T06:27:08.0935232Z  2025-03-14T06:27:08.0935657Z  2025-03-14T06:27:08.0936345Z  2025-03-14T06:27:08.0936772Z  2025-03-14T06:27:08.0937176Z  2025-03-14T06:27:08.0937511Z  2025-03-14T06:27:08.0938588Z [12,064 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:08.0939775Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T06:27:08.0940767Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T06:27:08.0941601Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T06:27:08.0942598Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T06:27:08.0943703Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T06:27:08.0944764Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T06:27:08.0945701Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2025-03-14T06:27:08.0946619Z @onednn//:mkl_dnn; 12s local ... 2025-03-14T06:27:08.4508961Z 2025-03-14T06:27:08.4509819Z  2025-03-14T06:27:08.4510312Z  2025-03-14T06:27:08.4510718Z  2025-03-14T06:27:08.4511118Z  2025-03-14T06:27:08.4511502Z  2025-03-14T06:27:08.4511900Z  2025-03-14T06:27:08.4512301Z  2025-03-14T06:27:08.4512707Z  2025-03-14T06:27:08.4513896Z [12,067 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:08.4515056Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T06:27:08.4515991Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T06:27:08.4516821Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T06:27:08.4517792Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T06:27:08.4518877Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T06:27:08.4519937Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T06:27:08.4521031Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2025-03-14T06:27:08.4521954Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:27:08.6703029Z 2025-03-14T06:27:08.6703921Z  2025-03-14T06:27:08.6704606Z  2025-03-14T06:27:08.6705059Z  2025-03-14T06:27:08.6705512Z  2025-03-14T06:27:08.6705956Z  2025-03-14T06:27:08.6706422Z  2025-03-14T06:27:08.6706857Z  2025-03-14T06:27:08.6707302Z  2025-03-14T06:27:08.6708323Z [12,070 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:08.6709645Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:27:08.6710758Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T06:27:08.6711701Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T06:27:08.6712832Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 22s local 2025-03-14T06:27:08.6714249Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T06:27:08.6715406Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T06:27:08.6716604Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2025-03-14T06:27:08.6717618Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:27:08.8941242Z 2025-03-14T06:27:08.8942106Z  2025-03-14T06:27:08.8942645Z  2025-03-14T06:27:08.8943130Z  2025-03-14T06:27:08.8943548Z  2025-03-14T06:27:08.8943970Z  2025-03-14T06:27:08.8944470Z  2025-03-14T06:27:08.8944845Z  2025-03-14T06:27:08.8945305Z  2025-03-14T06:27:08.8946644Z [12,071 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:08.8947891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:27:08.8948939Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T06:27:08.8950049Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T06:27:08.8951106Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T06:27:08.8952428Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 22s local 2025-03-14T06:27:08.8953494Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T06:27:08.8954561Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 15s local 2025-03-14T06:27:08.8955469Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:27:09.1113841Z 2025-03-14T06:27:09.1114688Z  2025-03-14T06:27:09.1115117Z  2025-03-14T06:27:09.1115491Z  2025-03-14T06:27:09.1115989Z  2025-03-14T06:27:09.1116344Z  2025-03-14T06:27:09.1116886Z  2025-03-14T06:27:09.1117248Z  2025-03-14T06:27:09.1117613Z  2025-03-14T06:27:09.1118455Z [12,072 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:09.1119472Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:27:09.1120327Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T06:27:09.1121076Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T06:27:09.1122196Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T06:27:09.1123305Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T06:27:09.1124194Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T06:27:09.1125470Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2025-03-14T06:27:09.1126292Z @onednn//:mkl_dnn; 13s local ... 2025-03-14T06:27:09.4947157Z 2025-03-14T06:27:09.4948019Z  2025-03-14T06:27:09.4948508Z  2025-03-14T06:27:09.4948921Z  2025-03-14T06:27:09.4949322Z  2025-03-14T06:27:09.4949761Z  2025-03-14T06:27:09.4950155Z  2025-03-14T06:27:09.4950555Z  2025-03-14T06:27:09.4950956Z  2025-03-14T06:27:09.4951906Z [12,073 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:09.4953090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:27:09.4954042Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T06:27:09.4954875Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T06:27:09.4955844Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 23s local 2025-03-14T06:27:09.4956935Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T06:27:09.4957948Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T06:27:09.4958992Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2025-03-14T06:27:09.4959892Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T06:27:09.7690833Z 2025-03-14T06:27:09.7691622Z  2025-03-14T06:27:09.7692085Z  2025-03-14T06:27:09.7692476Z  2025-03-14T06:27:09.7692869Z  2025-03-14T06:27:09.7693274Z  2025-03-14T06:27:09.7693644Z  2025-03-14T06:27:09.7694076Z  2025-03-14T06:27:09.7694465Z  2025-03-14T06:27:09.7695417Z [12,074 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:09.7696569Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T06:27:09.7697518Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T06:27:09.7698359Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T06:27:09.7699576Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:27:09.7700657Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 23s local 2025-03-14T06:27:09.7701697Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T06:27:09.7703018Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 16s local 2025-03-14T06:27:09.7704118Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T06:27:09.9917023Z 2025-03-14T06:27:09.9917941Z  2025-03-14T06:27:09.9918752Z  2025-03-14T06:27:09.9919223Z  2025-03-14T06:27:09.9919648Z  2025-03-14T06:27:09.9920081Z  2025-03-14T06:27:09.9920526Z  2025-03-14T06:27:09.9920963Z  2025-03-14T06:27:09.9921525Z  2025-03-14T06:27:09.9922468Z [12,076 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:09.9923888Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T06:27:09.9925057Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:27:09.9925927Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T06:27:09.9926942Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:27:09.9928154Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:27:09.9929257Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T06:27:09.9930437Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2025-03-14T06:27:09.9931428Z @onednn//:mkl_dnn; 14s local ... 2025-03-14T06:27:10.2273847Z 2025-03-14T06:27:10.2274963Z  2025-03-14T06:27:10.2275470Z  2025-03-14T06:27:10.2275858Z  2025-03-14T06:27:10.2276236Z  2025-03-14T06:27:10.2276624Z  2025-03-14T06:27:10.2277017Z  2025-03-14T06:27:10.2277420Z  2025-03-14T06:27:10.2277967Z  2025-03-14T06:27:10.2279098Z [12,078 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:10.2280343Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T06:27:10.2281367Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:27:10.2282386Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:27:10.2283568Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:27:10.2284802Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T06:27:10.2285951Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2025-03-14T06:27:10.2287226Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2025-03-14T06:27:10.2288458Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 11s local ... 2025-03-14T06:27:10.4276448Z 2025-03-14T06:27:10.4277343Z  2025-03-14T06:27:10.4277877Z  2025-03-14T06:27:10.4278323Z  2025-03-14T06:27:10.4278754Z  2025-03-14T06:27:10.4279177Z  2025-03-14T06:27:10.4279755Z  2025-03-14T06:27:10.4280196Z  2025-03-14T06:27:10.4280647Z  2025-03-14T06:27:10.4281665Z [12,079 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:10.4283174Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T06:27:10.4284291Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:27:10.4285478Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:27:10.4286761Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:27:10.4288113Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T06:27:10.4289302Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2025-03-14T06:27:10.4290583Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2025-03-14T06:27:10.4292103Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 11s local ... 2025-03-14T06:27:10.6957101Z 2025-03-14T06:27:10.6957910Z  2025-03-14T06:27:10.6958430Z  2025-03-14T06:27:10.6959180Z  2025-03-14T06:27:10.6959624Z  2025-03-14T06:27:10.6960070Z  2025-03-14T06:27:10.6960503Z  2025-03-14T06:27:10.6960949Z  2025-03-14T06:27:10.6961373Z  2025-03-14T06:27:10.6962522Z [12,081 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:10.6963833Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T06:27:10.6965025Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:27:10.6966253Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 24s local 2025-03-14T06:27:10.6967482Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:27:10.6968643Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T06:27:10.6969841Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2025-03-14T06:27:10.6971136Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2025-03-14T06:27:10.6972435Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 12s local ... 2025-03-14T06:27:10.9017736Z 2025-03-14T06:27:10.9018587Z  2025-03-14T06:27:10.9019103Z  2025-03-14T06:27:10.9019556Z  2025-03-14T06:27:10.9019970Z  2025-03-14T06:27:10.9020392Z  2025-03-14T06:27:10.9020834Z  2025-03-14T06:27:10.9021482Z  2025-03-14T06:27:10.9021925Z  2025-03-14T06:27:10.9022889Z [12,083 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:10.9024116Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T06:27:10.9025182Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:27:10.9026215Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T06:27:10.9027398Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 24s local 2025-03-14T06:27:10.9028545Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T06:27:10.9029631Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 17s local 2025-03-14T06:27:10.9030885Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2025-03-14T06:27:10.9032132Z Compiling src/graph/backend/dnnl/patterns/pool_post_ops.cpp; 12s local ... 2025-03-14T06:27:11.1769135Z 2025-03-14T06:27:11.1769998Z  2025-03-14T06:27:11.1770524Z  2025-03-14T06:27:11.1770941Z  2025-03-14T06:27:11.1771397Z  2025-03-14T06:27:11.1771816Z  2025-03-14T06:27:11.1772264Z  2025-03-14T06:27:11.1772698Z  2025-03-14T06:27:11.1773145Z  2025-03-14T06:27:11.1774142Z [12,086 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:11.1775436Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T06:27:11.1776495Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T06:27:11.1777557Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T06:27:11.1778778Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T06:27:11.1779924Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T06:27:11.1781120Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2025-03-14T06:27:11.1782401Z Compiling src/cpu/x64/jit_avx512_core_bf16_1x1_convolution.cpp; 15s local 2025-03-14T06:27:11.1783341Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:27:11.4419207Z 2025-03-14T06:27:11.4420038Z  2025-03-14T06:27:11.4420522Z  2025-03-14T06:27:11.4421220Z  2025-03-14T06:27:11.4421630Z  2025-03-14T06:27:11.4422042Z  2025-03-14T06:27:11.4422456Z  2025-03-14T06:27:11.4422854Z  2025-03-14T06:27:11.4423270Z  2025-03-14T06:27:11.4424231Z [12,087 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:11.4425570Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T06:27:11.4426563Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T06:27:11.4427607Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T06:27:11.4428729Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T06:27:11.4429675Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T06:27:11.4430612Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2025-03-14T06:27:11.4431600Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 12s local 2025-03-14T06:27:11.4432370Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:27:11.6965164Z 2025-03-14T06:27:11.6966275Z  2025-03-14T06:27:11.6966786Z  2025-03-14T06:27:11.6967214Z  2025-03-14T06:27:11.6967638Z  2025-03-14T06:27:11.6968094Z  2025-03-14T06:27:11.6968511Z  2025-03-14T06:27:11.6968925Z  2025-03-14T06:27:11.6969356Z  2025-03-14T06:27:11.6971838Z [12,087 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:11.6973104Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T06:27:11.6974375Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T06:27:11.6975290Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 25s local 2025-03-14T06:27:11.6976391Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 25s local 2025-03-14T06:27:11.6977441Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T06:27:11.6978540Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 18s local 2025-03-14T06:27:11.6979769Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 12s local 2025-03-14T06:27:11.6980701Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:27:12.0967763Z 2025-03-14T06:27:12.0969156Z  2025-03-14T06:27:12.0969848Z  2025-03-14T06:27:12.0970514Z  2025-03-14T06:27:12.0971612Z  2025-03-14T06:27:12.0972046Z  2025-03-14T06:27:12.0972450Z  2025-03-14T06:27:12.0972811Z  2025-03-14T06:27:12.0973176Z  2025-03-14T06:27:12.0974083Z [12,090 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:12.0975124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T06:27:12.0976001Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T06:27:12.0976878Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2025-03-14T06:27:12.0978000Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T06:27:12.0979033Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T06:27:12.0980121Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2025-03-14T06:27:12.0981262Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 12s local 2025-03-14T06:27:12.0982136Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:27:12.4116435Z 2025-03-14T06:27:12.4117354Z  2025-03-14T06:27:12.4117915Z  2025-03-14T06:27:12.4118326Z  2025-03-14T06:27:12.4118740Z  2025-03-14T06:27:12.4119187Z  2025-03-14T06:27:12.4119610Z  2025-03-14T06:27:12.4120020Z  2025-03-14T06:27:12.4120438Z  2025-03-14T06:27:12.4121411Z [12,091 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:12.4122927Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T06:27:12.4123967Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T06:27:12.4125190Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2025-03-14T06:27:12.4126503Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T06:27:12.4127610Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T06:27:12.4128874Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2025-03-14T06:27:12.4130074Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2025-03-14T06:27:12.4130903Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:27:12.6214173Z 2025-03-14T06:27:12.6215072Z  2025-03-14T06:27:12.6215533Z  2025-03-14T06:27:12.6215921Z  2025-03-14T06:27:12.6216307Z  2025-03-14T06:27:12.6216686Z  2025-03-14T06:27:12.6217083Z  2025-03-14T06:27:12.6217519Z  2025-03-14T06:27:12.6217895Z  2025-03-14T06:27:12.6218871Z [12,092 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:12.6219975Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T06:27:12.6220931Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T06:27:12.6221851Z Compiling src/cpu/x64/injectors/jit_uni_binary_injector.cpp; 26s local 2025-03-14T06:27:12.6223117Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T06:27:12.6224197Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T06:27:12.6225604Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2025-03-14T06:27:12.6226783Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2025-03-14T06:27:12.6227650Z @onednn//:mkl_dnn; 11s local ... 2025-03-14T06:27:12.8452491Z 2025-03-14T06:27:12.8453367Z  2025-03-14T06:27:12.8453799Z  2025-03-14T06:27:12.8454170Z  2025-03-14T06:27:12.8454541Z  2025-03-14T06:27:12.8454902Z  2025-03-14T06:27:12.8455258Z  2025-03-14T06:27:12.8455626Z  2025-03-14T06:27:12.8455985Z  2025-03-14T06:27:12.8456861Z [12,095 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:12.8457940Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T06:27:12.8458830Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T06:27:12.8459736Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 26s local 2025-03-14T06:27:12.8460727Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T06:27:12.8461743Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 19s local 2025-03-14T06:27:12.8462831Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2025-03-14T06:27:12.8463638Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:27:12.8464319Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 11s local ... 2025-03-14T06:27:13.0979858Z 2025-03-14T06:27:13.0980774Z  2025-03-14T06:27:13.0981267Z  2025-03-14T06:27:13.0981686Z  2025-03-14T06:27:13.0982122Z  2025-03-14T06:27:13.0982514Z  2025-03-14T06:27:13.0982921Z  2025-03-14T06:27:13.0983306Z  2025-03-14T06:27:13.0983704Z  2025-03-14T06:27:13.0984656Z [12,096 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:13.0985824Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T06:27:13.0986753Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T06:27:13.0987693Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T06:27:13.0988705Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T06:27:13.0990089Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T06:27:13.0991227Z Compiling src/cpu/x64/jit_avx512_core_x8s8s32x_conv_kernel.cpp; 13s local 2025-03-14T06:27:13.0992058Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:27:13.0992942Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 11s local ... 2025-03-14T06:27:13.2984404Z 2025-03-14T06:27:13.2985242Z  2025-03-14T06:27:13.2985730Z  2025-03-14T06:27:13.2986136Z  2025-03-14T06:27:13.2986540Z  2025-03-14T06:27:13.2987230Z  2025-03-14T06:27:13.2987682Z  2025-03-14T06:27:13.2988082Z  2025-03-14T06:27:13.2988482Z  2025-03-14T06:27:13.2989426Z [12,098 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:13.2990566Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T06:27:13.2991529Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T06:27:13.2992445Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T06:27:13.2993447Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T06:27:13.2994508Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T06:27:13.2995412Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:27:13.2996076Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2025-03-14T06:27:13.2996860Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:13.6989153Z 2025-03-14T06:27:13.6990052Z  2025-03-14T06:27:13.6990496Z  2025-03-14T06:27:13.6990915Z  2025-03-14T06:27:13.6991338Z  2025-03-14T06:27:13.6992045Z  2025-03-14T06:27:13.6992488Z  2025-03-14T06:27:13.6992923Z  2025-03-14T06:27:13.6993353Z  2025-03-14T06:27:13.6994318Z [12,100 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:13.6995543Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T06:27:13.6996403Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T06:27:13.6997269Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 27s local 2025-03-14T06:27:13.6998371Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T06:27:13.6999475Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 20s local 2025-03-14T06:27:13.7000391Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:27:13.7001082Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2025-03-14T06:27:13.7001872Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:14.0137510Z 2025-03-14T06:27:14.0138428Z  2025-03-14T06:27:14.0138919Z  2025-03-14T06:27:14.0139320Z  2025-03-14T06:27:14.0139718Z  2025-03-14T06:27:14.0140107Z  2025-03-14T06:27:14.0140501Z  2025-03-14T06:27:14.0140891Z  2025-03-14T06:27:14.0141294Z  2025-03-14T06:27:14.0142235Z [12,104 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:14.0143364Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T06:27:14.0144281Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T06:27:14.0145213Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T06:27:14.0146222Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T06:27:14.0147239Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T06:27:14.0148136Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:27:14.0148856Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 12s local 2025-03-14T06:27:14.0149630Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:14.2873576Z 2025-03-14T06:27:14.2874438Z  2025-03-14T06:27:14.2874961Z  2025-03-14T06:27:14.2875388Z  2025-03-14T06:27:14.2876034Z  2025-03-14T06:27:14.2876430Z  2025-03-14T06:27:14.2876815Z  2025-03-14T06:27:14.2877227Z  2025-03-14T06:27:14.2877654Z  2025-03-14T06:27:14.2878613Z [12,109 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:14.2879963Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T06:27:14.2880910Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T06:27:14.2882012Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T06:27:14.2883060Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T06:27:14.2884130Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T06:27:14.2885185Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:27:14.2885910Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2025-03-14T06:27:14.2886809Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 10s local ... 2025-03-14T06:27:14.4996365Z 2025-03-14T06:27:14.4997226Z  2025-03-14T06:27:14.4997658Z  2025-03-14T06:27:14.4998036Z  2025-03-14T06:27:14.4998387Z  2025-03-14T06:27:14.4998731Z  2025-03-14T06:27:14.4999101Z  2025-03-14T06:27:14.4999502Z  2025-03-14T06:27:14.4999862Z  2025-03-14T06:27:14.5000713Z [12,110 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:14.5001819Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T06:27:14.5002657Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T06:27:14.5003772Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T06:27:14.5004844Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T06:27:14.5005801Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T06:27:14.5006647Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:27:14.5007280Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2025-03-14T06:27:14.5008110Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 11s local ... 2025-03-14T06:27:14.8057676Z 2025-03-14T06:27:14.8058522Z  2025-03-14T06:27:14.8058981Z  2025-03-14T06:27:14.8059339Z  2025-03-14T06:27:14.8059696Z  2025-03-14T06:27:14.8060049Z  2025-03-14T06:27:14.8060403Z  2025-03-14T06:27:14.8060771Z  2025-03-14T06:27:14.8061134Z  2025-03-14T06:27:14.8062020Z [12,111 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:14.8063098Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T06:27:14.8063951Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T06:27:14.8064850Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 28s local 2025-03-14T06:27:14.8066037Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T06:27:14.8067016Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 21s local 2025-03-14T06:27:14.8067825Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:27:14.8068496Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2025-03-14T06:27:14.8069309Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 11s local ... 2025-03-14T06:27:15.0340389Z 2025-03-14T06:27:15.0341225Z  2025-03-14T06:27:15.0341670Z  2025-03-14T06:27:15.0342053Z  2025-03-14T06:27:15.0342452Z  2025-03-14T06:27:15.0342831Z  2025-03-14T06:27:15.0343248Z  2025-03-14T06:27:15.0343630Z  2025-03-14T06:27:15.0344006Z  2025-03-14T06:27:15.0344874Z [12,114 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:15.0345913Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T06:27:15.0346752Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:27:15.0347846Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T06:27:15.0348765Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:15.0349751Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2025-03-14T06:27:15.0350785Z @onednn//:mkl_dnn; 13s local 2025-03-14T06:27:15.0351460Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 13s local 2025-03-14T06:27:15.0352402Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 11s local ... 2025-03-14T06:27:15.3003430Z 2025-03-14T06:27:15.3004278Z  2025-03-14T06:27:15.3004807Z  2025-03-14T06:27:15.3005176Z  2025-03-14T06:27:15.3005505Z  2025-03-14T06:27:15.3005843Z  2025-03-14T06:27:15.3006169Z  2025-03-14T06:27:15.3006489Z  2025-03-14T06:27:15.3006807Z  2025-03-14T06:27:15.3007606Z [12,115 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:15.3008541Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T06:27:15.3009313Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:27:15.3010048Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T06:27:15.3010889Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:15.3011739Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2025-03-14T06:27:15.3012465Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:27:15.3013030Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T06:27:15.3014052Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 11s local ... 2025-03-14T06:27:15.5067180Z 2025-03-14T06:27:15.5068168Z  2025-03-14T06:27:15.5068676Z  2025-03-14T06:27:15.5069081Z  2025-03-14T06:27:15.5069493Z  2025-03-14T06:27:15.5069900Z  2025-03-14T06:27:15.5070305Z  2025-03-14T06:27:15.5070753Z  2025-03-14T06:27:15.5071174Z  2025-03-14T06:27:15.5072183Z [12,117 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:15.5073416Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T06:27:15.5074477Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:27:15.5075513Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T06:27:15.5076668Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:15.5077827Z Compiling src/graph/backend/dnnl/patterns/single_op_pattern.cpp; 22s local 2025-03-14T06:27:15.5078708Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:27:15.5079439Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T06:27:15.5080359Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 12s local ... 2025-03-14T06:27:15.7570214Z 2025-03-14T06:27:15.7580176Z  2025-03-14T06:27:15.7581023Z  2025-03-14T06:27:15.7581483Z  2025-03-14T06:27:15.7581925Z  2025-03-14T06:27:15.7582372Z  2025-03-14T06:27:15.7582813Z  2025-03-14T06:27:15.7583260Z  2025-03-14T06:27:15.7583739Z  2025-03-14T06:27:15.7584717Z [12,121 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:15.7585967Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T06:27:15.7586988Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:27:15.7588051Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 29s local 2025-03-14T06:27:15.7589195Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:15.7590076Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:27:15.7590886Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T06:27:15.7591847Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 12s local 2025-03-14T06:27:15.7592869Z @onednn//:onednn_autogen; 12s local ... 2025-03-14T06:27:15.9999524Z 2025-03-14T06:27:16.0000362Z  2025-03-14T06:27:16.0000855Z  2025-03-14T06:27:16.0001234Z  2025-03-14T06:27:16.0001632Z  2025-03-14T06:27:16.0002378Z  2025-03-14T06:27:16.0002799Z  2025-03-14T06:27:16.0003234Z  2025-03-14T06:27:16.0003647Z  2025-03-14T06:27:16.0004924Z [12,125 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:16.0006155Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T06:27:16.0007167Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T06:27:16.0008138Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T06:27:16.0009196Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:16.0010013Z @onednn//:mkl_dnn; 14s local 2025-03-14T06:27:16.0010725Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 14s local 2025-03-14T06:27:16.0011610Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 12s local 2025-03-14T06:27:16.0012332Z @onednn//:onednn_autogen; 12s local ... 2025-03-14T06:27:16.2477537Z 2025-03-14T06:27:16.2478463Z  2025-03-14T06:27:16.2478977Z  2025-03-14T06:27:16.2479414Z  2025-03-14T06:27:16.2479853Z  2025-03-14T06:27:16.2480291Z  2025-03-14T06:27:16.2480715Z  2025-03-14T06:27:16.2481155Z  2025-03-14T06:27:16.2481610Z  2025-03-14T06:27:16.2482599Z [12,127 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:16.2484139Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T06:27:16.2485364Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T06:27:16.2486407Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T06:27:16.2487378Z @onednn//:mkl_dnn; 15s local 2025-03-14T06:27:16.2488163Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T06:27:16.2489142Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 12s local 2025-03-14T06:27:16.2489906Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:16.2490571Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:16.4998844Z 2025-03-14T06:27:16.4999819Z  2025-03-14T06:27:16.5000350Z  2025-03-14T06:27:16.5000796Z  2025-03-14T06:27:16.5001230Z  2025-03-14T06:27:16.5001720Z  2025-03-14T06:27:16.5002155Z  2025-03-14T06:27:16.5002601Z  2025-03-14T06:27:16.5003037Z  2025-03-14T06:27:16.5004053Z [12,131 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:16.5005464Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T06:27:16.5006538Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T06:27:16.5007593Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T06:27:16.5008743Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T06:27:16.5009692Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 13s local 2025-03-14T06:27:16.5010485Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:16.5011143Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:16.5011810Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:16.7010590Z 2025-03-14T06:27:16.7011989Z  2025-03-14T06:27:16.7012523Z  2025-03-14T06:27:16.7012972Z  2025-03-14T06:27:16.7013403Z  2025-03-14T06:27:16.7013821Z  2025-03-14T06:27:16.7014246Z  2025-03-14T06:27:16.7014645Z  2025-03-14T06:27:16.7015060Z  2025-03-14T06:27:16.7016072Z [12,132 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:16.7017368Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T06:27:16.7018700Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T06:27:16.7019754Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 30s local 2025-03-14T06:27:16.7020872Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T06:27:16.7021931Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 13s local 2025-03-14T06:27:16.7022676Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:16.7023318Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:16.7024037Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:17.1015425Z 2025-03-14T06:27:17.1016705Z  2025-03-14T06:27:17.1017181Z  2025-03-14T06:27:17.1017621Z  2025-03-14T06:27:17.1018013Z  2025-03-14T06:27:17.1018413Z  2025-03-14T06:27:17.1018813Z  2025-03-14T06:27:17.1019211Z  2025-03-14T06:27:17.1019604Z  2025-03-14T06:27:17.1020538Z [12,133 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:17.1021698Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T06:27:17.1022667Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T06:27:17.1023630Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T06:27:17.1024711Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 15s local 2025-03-14T06:27:17.1025582Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 13s local 2025-03-14T06:27:17.1026293Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:17.1026919Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:17.1027808Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:17.4249630Z 2025-03-14T06:27:17.4250608Z  2025-03-14T06:27:17.4251165Z  2025-03-14T06:27:17.4251589Z  2025-03-14T06:27:17.4251995Z  2025-03-14T06:27:17.4252422Z  2025-03-14T06:27:17.4252846Z  2025-03-14T06:27:17.4253262Z  2025-03-14T06:27:17.4253698Z  2025-03-14T06:27:17.4254688Z [12,134 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:17.4255914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T06:27:17.4256924Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T06:27:17.4257902Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T06:27:17.4259037Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T06:27:17.4259945Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 14s local 2025-03-14T06:27:17.4260641Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:17.4261231Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:17.4261784Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:27:17.7021408Z 2025-03-14T06:27:17.7022817Z  2025-03-14T06:27:17.7023289Z  2025-03-14T06:27:17.7023669Z  2025-03-14T06:27:17.7024073Z  2025-03-14T06:27:17.7024456Z  2025-03-14T06:27:17.7024805Z  2025-03-14T06:27:17.7025174Z  2025-03-14T06:27:17.7025528Z  2025-03-14T06:27:17.7026422Z [12,135 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:17.7027562Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T06:27:17.7028486Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T06:27:17.7029515Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 31s local 2025-03-14T06:27:17.7030548Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T06:27:17.7031523Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 14s local 2025-03-14T06:27:17.7032204Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:17.7032754Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:17.7033279Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:18.1032563Z 2025-03-14T06:27:18.1033579Z  2025-03-14T06:27:18.1034088Z  2025-03-14T06:27:18.1034505Z  2025-03-14T06:27:18.1034910Z  2025-03-14T06:27:18.1035318Z  2025-03-14T06:27:18.1035702Z  2025-03-14T06:27:18.1036088Z  2025-03-14T06:27:18.1036983Z  2025-03-14T06:27:18.1037898Z [12,136 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:18.1039095Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T06:27:18.1040271Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T06:27:18.1041251Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T06:27:18.1042324Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 16s local 2025-03-14T06:27:18.1043248Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 14s local 2025-03-14T06:27:18.1043962Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:18.1044735Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:18.1045390Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:18.3035630Z 2025-03-14T06:27:18.3036485Z  2025-03-14T06:27:18.3037038Z  2025-03-14T06:27:18.3037505Z  2025-03-14T06:27:18.3037948Z  2025-03-14T06:27:18.3038450Z  2025-03-14T06:27:18.3039106Z  2025-03-14T06:27:18.3039568Z  2025-03-14T06:27:18.3040045Z  2025-03-14T06:27:18.3041213Z [12,139 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:18.3042631Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T06:27:18.3044071Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T06:27:18.3045398Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T06:27:18.3046651Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T06:27:18.3047848Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 14s local 2025-03-14T06:27:18.3048659Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:18.3049352Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:18.3050059Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:18.6076523Z 2025-03-14T06:27:18.6077420Z  2025-03-14T06:27:18.6077863Z  2025-03-14T06:27:18.6078243Z  2025-03-14T06:27:18.6078623Z  2025-03-14T06:27:18.6079019Z  2025-03-14T06:27:18.6079403Z  2025-03-14T06:27:18.6079799Z  2025-03-14T06:27:18.6080209Z  2025-03-14T06:27:18.6081016Z [12,143 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:18.6082082Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T06:27:18.6082960Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T06:27:18.6083911Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T06:27:18.6085053Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T06:27:18.6085896Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local 2025-03-14T06:27:18.6086594Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:18.6087187Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:18.6087776Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:18.8154769Z 2025-03-14T06:27:18.8155860Z  2025-03-14T06:27:18.8156619Z  2025-03-14T06:27:18.8157226Z  2025-03-14T06:27:18.8157794Z  2025-03-14T06:27:18.8158217Z  2025-03-14T06:27:18.8158847Z  2025-03-14T06:27:18.8159423Z  2025-03-14T06:27:18.8159811Z  2025-03-14T06:27:18.8161157Z [12,144 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:18.8162759Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T06:27:18.8164031Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T06:27:18.8166244Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 32s local 2025-03-14T06:27:18.8167580Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T06:27:18.8168596Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local 2025-03-14T06:27:18.8169825Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:18.8170657Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:18.8171449Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:19.1042916Z 2025-03-14T06:27:19.1044035Z  2025-03-14T06:27:19.1044733Z  2025-03-14T06:27:19.1045188Z  2025-03-14T06:27:19.1045604Z  2025-03-14T06:27:19.1046017Z  2025-03-14T06:27:19.1046443Z  2025-03-14T06:27:19.1046807Z  2025-03-14T06:27:19.1047182Z  2025-03-14T06:27:19.1048125Z [12,144 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:19.1049278Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T06:27:19.1050243Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T06:27:19.1051234Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T06:27:19.1052318Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 17s local 2025-03-14T06:27:19.1053265Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local 2025-03-14T06:27:19.1053964Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:19.1054574Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:19.1055213Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:19.3048483Z 2025-03-14T06:27:19.3049384Z  2025-03-14T06:27:19.3050210Z  2025-03-14T06:27:19.3050669Z  2025-03-14T06:27:19.3051130Z  2025-03-14T06:27:19.3051605Z  2025-03-14T06:27:19.3052015Z  2025-03-14T06:27:19.3052452Z  2025-03-14T06:27:19.3052919Z  2025-03-14T06:27:19.3053912Z [12,148 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:19.3055409Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T06:27:19.3056454Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T06:27:19.3057504Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T06:27:19.3058654Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T06:27:19.3059614Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 15s local 2025-03-14T06:27:19.3060372Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:19.3061068Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:19.3061728Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:19.5532781Z 2025-03-14T06:27:19.5533586Z  2025-03-14T06:27:19.5534009Z  2025-03-14T06:27:19.5534359Z  2025-03-14T06:27:19.5534691Z  2025-03-14T06:27:19.5535027Z  2025-03-14T06:27:19.5535416Z  2025-03-14T06:27:19.5535896Z  2025-03-14T06:27:19.5536241Z  2025-03-14T06:27:19.5537082Z [12,149 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:19.5538070Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T06:27:19.5538872Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T06:27:19.5539860Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T06:27:19.5540958Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T06:27:19.5541865Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local 2025-03-14T06:27:19.5542640Z @onednn//:onednn_autogen; 14s local 2025-03-14T06:27:19.5543293Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:19.5543951Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T06:27:19.8316246Z 2025-03-14T06:27:19.8317153Z  2025-03-14T06:27:19.8317605Z  2025-03-14T06:27:19.8317962Z  2025-03-14T06:27:19.8318610Z  2025-03-14T06:27:19.8318993Z  2025-03-14T06:27:19.8319371Z  2025-03-14T06:27:19.8319922Z  2025-03-14T06:27:19.8320277Z  2025-03-14T06:27:19.8321167Z [12,154 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:19.8322449Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T06:27:19.8323337Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T06:27:19.8324349Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 33s local 2025-03-14T06:27:19.8325304Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T06:27:19.8326066Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local 2025-03-14T06:27:19.8326668Z @onednn//:onednn_autogen; 14s local 2025-03-14T06:27:19.8327183Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:19.8327702Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T06:27:20.1056034Z 2025-03-14T06:27:20.1056898Z  2025-03-14T06:27:20.1057427Z  2025-03-14T06:27:20.1057886Z  2025-03-14T06:27:20.1058336Z  2025-03-14T06:27:20.1058777Z  2025-03-14T06:27:20.1059199Z  2025-03-14T06:27:20.1059629Z  2025-03-14T06:27:20.1060090Z  2025-03-14T06:27:20.1061123Z [12,155 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:20.1062427Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T06:27:20.1063640Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:27:20.1064976Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T06:27:20.1066411Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 18s local 2025-03-14T06:27:20.1067482Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local 2025-03-14T06:27:20.1068247Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:20.1068883Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:20.1069684Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 9s local ... 2025-03-14T06:27:20.3558720Z 2025-03-14T06:27:20.3559619Z  2025-03-14T06:27:20.3560143Z  2025-03-14T06:27:20.3560592Z  2025-03-14T06:27:20.3561067Z  2025-03-14T06:27:20.3561484Z  2025-03-14T06:27:20.3561921Z  2025-03-14T06:27:20.3562307Z  2025-03-14T06:27:20.3562700Z  2025-03-14T06:27:20.3564010Z [12,157 / 20,650] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2025-03-14T06:27:20.3565628Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T06:27:20.3566681Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:27:20.3567713Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T06:27:20.3568818Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T06:27:20.3569754Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 16s local 2025-03-14T06:27:20.3570531Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:20.3571307Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2025-03-14T06:27:20.3572240Z Compiling src/cpu/x64/jit_brgemm_conv_bwd_w.cpp; 9s local ... 2025-03-14T06:27:20.6753755Z 2025-03-14T06:27:20.6754597Z  2025-03-14T06:27:20.6755109Z  2025-03-14T06:27:20.6755525Z  2025-03-14T06:27:20.6755926Z  2025-03-14T06:27:20.6756341Z  2025-03-14T06:27:20.6756787Z  2025-03-14T06:27:20.6757229Z  2025-03-14T06:27:20.6757657Z  2025-03-14T06:27:20.6758641Z [12,160 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:20.6759841Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T06:27:20.6760700Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:27:20.6761668Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T06:27:20.6762901Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T06:27:20.6763709Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local 2025-03-14T06:27:20.6764581Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:20.6765814Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2025-03-14T06:27:20.6766585Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:27:20.9062951Z 2025-03-14T06:27:20.9063779Z  2025-03-14T06:27:20.9064524Z  2025-03-14T06:27:20.9064988Z  2025-03-14T06:27:20.9065609Z  2025-03-14T06:27:20.9066060Z  2025-03-14T06:27:20.9066681Z  2025-03-14T06:27:20.9067145Z  2025-03-14T06:27:20.9067639Z  2025-03-14T06:27:20.9068694Z [12,162 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:20.9070060Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T06:27:20.9071189Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:27:20.9072291Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 34s local 2025-03-14T06:27:20.9073498Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T06:27:20.9074519Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local 2025-03-14T06:27:20.9075327Z @onednn//:onednn_autogen; 14s local 2025-03-14T06:27:20.9076175Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2025-03-14T06:27:20.9077059Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:21.1067440Z 2025-03-14T06:27:21.1068300Z  2025-03-14T06:27:21.1068817Z  2025-03-14T06:27:21.1069552Z  2025-03-14T06:27:21.1070010Z  2025-03-14T06:27:21.1070468Z  2025-03-14T06:27:21.1070910Z  2025-03-14T06:27:21.1071345Z  2025-03-14T06:27:21.1071787Z  2025-03-14T06:27:21.1072828Z [12,165 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:21.1074168Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T06:27:21.1075259Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T06:27:21.1076326Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T06:27:21.1077484Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 19s local 2025-03-14T06:27:21.1078450Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 17s local 2025-03-14T06:27:21.1079232Z @onednn//:onednn_autogen; 14s local 2025-03-14T06:27:21.1080059Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 10s local 2025-03-14T06:27:21.1080906Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:21.4538934Z 2025-03-14T06:27:21.4539848Z  2025-03-14T06:27:21.4540273Z  2025-03-14T06:27:21.4540630Z  2025-03-14T06:27:21.4540992Z  2025-03-14T06:27:21.4541367Z  2025-03-14T06:27:21.4541740Z  2025-03-14T06:27:21.4542130Z  2025-03-14T06:27:21.4542484Z  2025-03-14T06:27:21.4543358Z [12,167 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:21.4544432Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T06:27:21.4545340Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T06:27:21.4546205Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T06:27:21.4547198Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T06:27:21.4547884Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2025-03-14T06:27:21.4548468Z @onednn//:onednn_autogen; 14s local 2025-03-14T06:27:21.4549079Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2025-03-14T06:27:21.4549710Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:21.6579362Z 2025-03-14T06:27:21.6580201Z  2025-03-14T06:27:21.6580731Z  2025-03-14T06:27:21.6581442Z  2025-03-14T06:27:21.6581883Z  2025-03-14T06:27:21.6582333Z  2025-03-14T06:27:21.6582778Z  2025-03-14T06:27:21.6583222Z  2025-03-14T06:27:21.6583667Z  2025-03-14T06:27:21.6584696Z [12,168 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:21.6586092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T06:27:21.6587178Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T06:27:21.6588340Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T06:27:21.6589528Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T06:27:21.6590491Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2025-03-14T06:27:21.6591436Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2025-03-14T06:27:21.6592287Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:21.6593077Z Compiling src/cpu/x64/jit_brgemm_deconv.cpp; 9s local ... 2025-03-14T06:27:21.9075519Z 2025-03-14T06:27:21.9076413Z  2025-03-14T06:27:21.9076883Z  2025-03-14T06:27:21.9077314Z  2025-03-14T06:27:21.9077724Z  2025-03-14T06:27:21.9078122Z  2025-03-14T06:27:21.9078538Z  2025-03-14T06:27:21.9078939Z  2025-03-14T06:27:21.9079338Z  2025-03-14T06:27:21.9080261Z [12,169 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:21.9081466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T06:27:21.9082433Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T06:27:21.9083627Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 35s local 2025-03-14T06:27:21.9084891Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 20s local 2025-03-14T06:27:21.9085736Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2025-03-14T06:27:21.9086602Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 11s local 2025-03-14T06:27:21.9087356Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:21.9088097Z Compiling src/cpu/x64/jit_brgemm_deconv.cpp; 9s local ... 2025-03-14T06:27:22.3080973Z 2025-03-14T06:27:22.3081835Z  2025-03-14T06:27:22.3082376Z  2025-03-14T06:27:22.3082819Z  2025-03-14T06:27:22.3083223Z  2025-03-14T06:27:22.3083658Z  2025-03-14T06:27:22.3084078Z  2025-03-14T06:27:22.3084644Z  2025-03-14T06:27:22.3085068Z  2025-03-14T06:27:22.3086059Z [12,170 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:22.3087343Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T06:27:22.3088364Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T06:27:22.3089350Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T06:27:22.3090469Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T06:27:22.3091387Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 18s local 2025-03-14T06:27:22.3092223Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2025-03-14T06:27:22.3093030Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:22.3093833Z Compiling src/cpu/x64/jit_brgemm_deconv.cpp; 9s local ... 2025-03-14T06:27:22.5085008Z 2025-03-14T06:27:22.5085866Z  2025-03-14T06:27:22.5086299Z  2025-03-14T06:27:22.5086661Z  2025-03-14T06:27:22.5087046Z  2025-03-14T06:27:22.5087395Z  2025-03-14T06:27:22.5087720Z  2025-03-14T06:27:22.5088073Z  2025-03-14T06:27:22.5088424Z  2025-03-14T06:27:22.5089248Z [12,172 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:22.5090260Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T06:27:22.5091093Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T06:27:22.5092182Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T06:27:22.5093101Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T06:27:22.5093844Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T06:27:22.5094681Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2025-03-14T06:27:22.5095333Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:22.5096045Z Compiling src/cpu/x64/jit_brgemm_deconv.cpp; 9s local ... 2025-03-14T06:27:22.9090544Z 2025-03-14T06:27:22.9091462Z  2025-03-14T06:27:22.9091903Z  2025-03-14T06:27:22.9092211Z  2025-03-14T06:27:22.9092596Z  2025-03-14T06:27:22.9093031Z  2025-03-14T06:27:22.9093541Z  2025-03-14T06:27:22.9093982Z  2025-03-14T06:27:22.9094353Z  2025-03-14T06:27:22.9095248Z [12,173 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:22.9096543Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T06:27:22.9097729Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 36s local 2025-03-14T06:27:22.9098661Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 21s local 2025-03-14T06:27:22.9099516Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T06:27:22.9100232Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 12s local 2025-03-14T06:27:22.9100992Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:22.9101849Z Compiling src/cpu/x64/jit_brgemm_deconv.cpp; 10s local 2025-03-14T06:27:22.9103276Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 10s local ... 2025-03-14T06:27:23.3094706Z 2025-03-14T06:27:23.3095511Z  2025-03-14T06:27:23.3095919Z  2025-03-14T06:27:23.3096264Z  2025-03-14T06:27:23.3096611Z  2025-03-14T06:27:23.3096929Z  2025-03-14T06:27:23.3097271Z  2025-03-14T06:27:23.3097649Z  2025-03-14T06:27:23.3097987Z  2025-03-14T06:27:23.3098787Z [12,174 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:23.3099763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T06:27:23.3100742Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T06:27:23.3101603Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T06:27:23.3102344Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 19s local 2025-03-14T06:27:23.3103057Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2025-03-14T06:27:23.3103697Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:23.3104301Z Compiling src/cpu/x64/jit_brgemm_deconv.cpp; 10s local 2025-03-14T06:27:23.3105136Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 10s local ... 2025-03-14T06:27:23.7099769Z 2025-03-14T06:27:23.7100557Z  2025-03-14T06:27:23.7100982Z  2025-03-14T06:27:23.7101366Z  2025-03-14T06:27:23.7101716Z  2025-03-14T06:27:23.7102074Z  2025-03-14T06:27:23.7102435Z  2025-03-14T06:27:23.7102770Z  2025-03-14T06:27:23.7103101Z  2025-03-14T06:27:23.7103924Z [12,176 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:23.7104889Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T06:27:23.7105826Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 37s local 2025-03-14T06:27:23.7106671Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 22s local 2025-03-14T06:27:23.7107387Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T06:27:23.7108070Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 13s local 2025-03-14T06:27:23.7108694Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:23.7109322Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 11s local 2025-03-14T06:27:23.7110264Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:27:24.3772396Z 2025-03-14T06:27:24.3773201Z  2025-03-14T06:27:24.3773618Z  2025-03-14T06:27:24.3773958Z  2025-03-14T06:27:24.3774288Z  2025-03-14T06:27:24.3774597Z  2025-03-14T06:27:24.3775195Z  2025-03-14T06:27:24.3775517Z  2025-03-14T06:27:24.3775837Z  2025-03-14T06:27:24.3776607Z [12,177 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:24.3777653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T06:27:24.3778561Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T06:27:24.3779372Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T06:27:24.3780066Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 20s local 2025-03-14T06:27:24.3780738Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2025-03-14T06:27:24.3781342Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:24.3781943Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 11s local 2025-03-14T06:27:24.3782557Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:24.5771200Z 2025-03-14T06:27:24.5771989Z  2025-03-14T06:27:24.5772488Z  2025-03-14T06:27:24.5772833Z  2025-03-14T06:27:24.5773160Z  2025-03-14T06:27:24.5773484Z  2025-03-14T06:27:24.5773847Z  2025-03-14T06:27:24.5774265Z  2025-03-14T06:27:24.5774695Z  2025-03-14T06:27:24.5775712Z [12,178 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:24.5777388Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T06:27:24.5778561Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T06:27:24.5779555Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T06:27:24.5780475Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2025-03-14T06:27:24.5781368Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2025-03-14T06:27:24.5782331Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 11s local 2025-03-14T06:27:24.5783154Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:24.5784015Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 9s local ... 2025-03-14T06:27:24.8522228Z 2025-03-14T06:27:24.8523092Z  2025-03-14T06:27:24.8523520Z  2025-03-14T06:27:24.8523867Z  2025-03-14T06:27:24.8524242Z  2025-03-14T06:27:24.8524706Z  2025-03-14T06:27:24.8525072Z  2025-03-14T06:27:24.8525408Z  2025-03-14T06:27:24.8525753Z  2025-03-14T06:27:24.8526555Z [12,179 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:24.8527523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T06:27:24.8528456Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 38s local 2025-03-14T06:27:24.8529338Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T06:27:24.8530059Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2025-03-14T06:27:24.8530760Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2025-03-14T06:27:24.8531533Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 12s local 2025-03-14T06:27:24.8532189Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:24.8532864Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 9s local ... 2025-03-14T06:27:25.1110538Z 2025-03-14T06:27:25.1111365Z  2025-03-14T06:27:25.1111775Z  2025-03-14T06:27:25.1112151Z  2025-03-14T06:27:25.1112490Z  2025-03-14T06:27:25.1112831Z  2025-03-14T06:27:25.1113167Z  2025-03-14T06:27:25.1113490Z  2025-03-14T06:27:25.1113837Z  2025-03-14T06:27:25.1114658Z [12,180 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:25.1116033Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T06:27:25.1116911Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T06:27:25.1117709Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 23s local 2025-03-14T06:27:25.1118605Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2025-03-14T06:27:25.1119253Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 14s local 2025-03-14T06:27:25.1120171Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 12s local 2025-03-14T06:27:25.1120794Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:25.1121427Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 9s local ... 2025-03-14T06:27:25.3114539Z 2025-03-14T06:27:25.3115467Z  2025-03-14T06:27:25.3116005Z  2025-03-14T06:27:25.3116340Z  2025-03-14T06:27:25.3116663Z  2025-03-14T06:27:25.3116985Z  2025-03-14T06:27:25.3117351Z  2025-03-14T06:27:25.3117692Z  2025-03-14T06:27:25.3118027Z  2025-03-14T06:27:25.3118821Z [12,182 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:25.3119759Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T06:27:25.3120785Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T06:27:25.3121822Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:25.3122647Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 21s local 2025-03-14T06:27:25.3123433Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2025-03-14T06:27:25.3124744Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 12s local 2025-03-14T06:27:25.3125646Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:25.3126535Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 9s local ... 2025-03-14T06:27:25.6255388Z 2025-03-14T06:27:25.6256266Z  2025-03-14T06:27:25.6256769Z  2025-03-14T06:27:25.6257201Z  2025-03-14T06:27:25.6257620Z  2025-03-14T06:27:25.6258038Z  2025-03-14T06:27:25.6258469Z  2025-03-14T06:27:25.6258887Z  2025-03-14T06:27:25.6259326Z  2025-03-14T06:27:25.6260288Z [12,185 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:25.6261504Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T06:27:25.6262729Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 39s local 2025-03-14T06:27:25.6263850Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:25.6264785Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:27:25.6265912Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2025-03-14T06:27:25.6266879Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 12s local 2025-03-14T06:27:25.6267708Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:25.6268586Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 10s local ... 2025-03-14T06:27:25.9121023Z 2025-03-14T06:27:25.9121861Z  2025-03-14T06:27:25.9122287Z  2025-03-14T06:27:25.9122656Z  2025-03-14T06:27:25.9123062Z  2025-03-14T06:27:25.9123588Z  2025-03-14T06:27:25.9123914Z  2025-03-14T06:27:25.9124249Z  2025-03-14T06:27:25.9124718Z  2025-03-14T06:27:25.9125520Z [12,187 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:25.9126438Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T06:27:25.9127368Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T06:27:25.9128275Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:25.9129035Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:27:25.9130059Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2025-03-14T06:27:25.9130889Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 13s local 2025-03-14T06:27:25.9131583Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:25.9132306Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 10s local ... 2025-03-14T06:27:26.1125999Z 2025-03-14T06:27:26.1126908Z  2025-03-14T06:27:26.1127365Z  2025-03-14T06:27:26.1127748Z  2025-03-14T06:27:26.1128244Z  2025-03-14T06:27:26.1128644Z  2025-03-14T06:27:26.1129307Z  2025-03-14T06:27:26.1129882Z  2025-03-14T06:27:26.1130277Z  2025-03-14T06:27:26.1131220Z [12,190 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:26.1132384Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T06:27:26.1133507Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T06:27:26.1134532Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 24s local 2025-03-14T06:27:26.1135441Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:27:26.1136285Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local 2025-03-14T06:27:26.1137158Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 13s local 2025-03-14T06:27:26.1137940Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:26.1138784Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 10s local ... 2025-03-14T06:27:26.3541416Z 2025-03-14T06:27:26.3542209Z  2025-03-14T06:27:26.3542650Z  2025-03-14T06:27:26.3543020Z  2025-03-14T06:27:26.3543387Z  2025-03-14T06:27:26.3544003Z  2025-03-14T06:27:26.3544374Z  2025-03-14T06:27:26.3544756Z  2025-03-14T06:27:26.3545105Z  2025-03-14T06:27:26.3545957Z [12,193 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:26.3547027Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T06:27:26.3548119Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T06:27:26.3549085Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 25s local 2025-03-14T06:27:26.3549882Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 22s local 2025-03-14T06:27:26.3550664Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2025-03-14T06:27:26.3551546Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 13s local 2025-03-14T06:27:26.3552260Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:26.3553009Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 10s local ... 2025-03-14T06:27:26.7133050Z 2025-03-14T06:27:26.7133879Z  2025-03-14T06:27:26.7134260Z  2025-03-14T06:27:26.7134592Z  2025-03-14T06:27:26.7134915Z  2025-03-14T06:27:26.7135241Z  2025-03-14T06:27:26.7135566Z  2025-03-14T06:27:26.7135885Z  2025-03-14T06:27:26.7136224Z  2025-03-14T06:27:26.7136976Z [12,193 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:26.7137885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:27:26.7138784Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 40s local 2025-03-14T06:27:26.7139609Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 25s local 2025-03-14T06:27:26.7140300Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T06:27:26.7140974Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2025-03-14T06:27:26.7141709Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local 2025-03-14T06:27:26.7142338Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:26.7142989Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 11s local ... 2025-03-14T06:27:26.9136161Z 2025-03-14T06:27:26.9136957Z  2025-03-14T06:27:26.9137384Z  2025-03-14T06:27:26.9137993Z  2025-03-14T06:27:26.9138385Z  2025-03-14T06:27:26.9138730Z  2025-03-14T06:27:26.9139080Z  2025-03-14T06:27:26.9139427Z  2025-03-14T06:27:26.9139775Z  2025-03-14T06:27:26.9140651Z [12,194 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:26.9141988Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:27:26.9143051Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T06:27:26.9143999Z Compiling src/graph/backend/dnnl/patterns/sdp.cpp; 25s local 2025-03-14T06:27:26.9144801Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T06:27:26.9145538Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local 2025-03-14T06:27:26.9146288Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local 2025-03-14T06:27:26.9147001Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:26.9147751Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 11s local ... 2025-03-14T06:27:27.2519834Z 2025-03-14T06:27:27.2520693Z  2025-03-14T06:27:27.2521158Z  2025-03-14T06:27:27.2521525Z  2025-03-14T06:27:27.2521905Z  2025-03-14T06:27:27.2522281Z  2025-03-14T06:27:27.2522687Z  2025-03-14T06:27:27.2523058Z  2025-03-14T06:27:27.2523433Z  2025-03-14T06:27:27.2524317Z [12,200 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:27.2525549Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:27:27.2526830Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T06:27:27.2527748Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 23s local 2025-03-14T06:27:27.2528709Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2025-03-14T06:27:27.2529589Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local 2025-03-14T06:27:27.2530342Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:27.2531094Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 11s local 2025-03-14T06:27:27.2531853Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T06:27:27.5142487Z 2025-03-14T06:27:27.5143415Z  2025-03-14T06:27:27.5143911Z  2025-03-14T06:27:27.5144316Z  2025-03-14T06:27:27.5144721Z  2025-03-14T06:27:27.5145123Z  2025-03-14T06:27:27.5145514Z  2025-03-14T06:27:27.5145893Z  2025-03-14T06:27:27.5146315Z  2025-03-14T06:27:27.5147265Z [12,202 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:27.5148455Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:27:27.5149585Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T06:27:27.5150568Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T06:27:27.5151410Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2025-03-14T06:27:27.5152319Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 14s local 2025-03-14T06:27:27.5153085Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:27.5153860Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 11s local 2025-03-14T06:27:27.5154702Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T06:27:27.7146882Z 2025-03-14T06:27:27.7147699Z  2025-03-14T06:27:27.7148207Z  2025-03-14T06:27:27.7148656Z  2025-03-14T06:27:27.7149105Z  2025-03-14T06:27:27.7149528Z  2025-03-14T06:27:27.7149946Z  2025-03-14T06:27:27.7150353Z  2025-03-14T06:27:27.7150777Z  2025-03-14T06:27:27.7151787Z [12,204 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:27.7153103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T06:27:27.7154338Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 41s local 2025-03-14T06:27:27.7155655Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T06:27:27.7156583Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2025-03-14T06:27:27.7157593Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local 2025-03-14T06:27:27.7158561Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:27.7159433Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 12s local 2025-03-14T06:27:27.7160435Z @onednn//:onednn_autogen; 12s local ... 2025-03-14T06:27:28.0715888Z 2025-03-14T06:27:28.0716744Z  2025-03-14T06:27:28.0717178Z  2025-03-14T06:27:28.0726682Z  2025-03-14T06:27:28.0727454Z  2025-03-14T06:27:28.0727863Z  2025-03-14T06:27:28.0728289Z  2025-03-14T06:27:28.0728672Z  2025-03-14T06:27:28.0729069Z  2025-03-14T06:27:28.0730010Z [12,206 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:28.0731103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T06:27:28.0732150Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2025-03-14T06:27:28.0733053Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T06:27:28.0733855Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local 2025-03-14T06:27:28.0734688Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local 2025-03-14T06:27:28.0735552Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 12s local 2025-03-14T06:27:28.0736394Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:28.0737279Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:28.3153174Z 2025-03-14T06:27:28.3154037Z  2025-03-14T06:27:28.3154558Z  2025-03-14T06:27:28.3155012Z  2025-03-14T06:27:28.3155432Z  2025-03-14T06:27:28.3155875Z  2025-03-14T06:27:28.3156312Z  2025-03-14T06:27:28.3156751Z  2025-03-14T06:27:28.3157215Z  2025-03-14T06:27:28.3158214Z [12,207 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:28.3159502Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T06:27:28.3160740Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2025-03-14T06:27:28.3161775Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 24s local 2025-03-14T06:27:28.3162696Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2025-03-14T06:27:28.3163719Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local 2025-03-14T06:27:28.3164941Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 12s local 2025-03-14T06:27:28.3166011Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:28.3166685Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:28.5157436Z 2025-03-14T06:27:28.5158296Z  2025-03-14T06:27:28.5158741Z  2025-03-14T06:27:28.5159142Z  2025-03-14T06:27:28.5159510Z  2025-03-14T06:27:28.5159864Z  2025-03-14T06:27:28.5160229Z  2025-03-14T06:27:28.5160603Z  2025-03-14T06:27:28.5160973Z  2025-03-14T06:27:28.5161837Z [12,213 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:28.5163032Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T06:27:28.5164088Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2025-03-14T06:27:28.5165128Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T06:27:28.5166342Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2025-03-14T06:27:28.5167093Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 15s local 2025-03-14T06:27:28.5167876Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 12s local 2025-03-14T06:27:28.5168527Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:27:28.5169320Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T06:27:28.7598566Z 2025-03-14T06:27:28.7599629Z  2025-03-14T06:27:28.7600503Z  2025-03-14T06:27:28.7601249Z  2025-03-14T06:27:28.7602144Z  2025-03-14T06:27:28.7602597Z  2025-03-14T06:27:28.7603233Z  2025-03-14T06:27:28.7603671Z  2025-03-14T06:27:28.7604104Z  2025-03-14T06:27:28.7605271Z [12,217 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:28.7606691Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T06:27:28.7607922Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 42s local 2025-03-14T06:27:28.7609000Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T06:27:28.7609932Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2025-03-14T06:27:28.7610904Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2025-03-14T06:27:28.7611979Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 13s local 2025-03-14T06:27:28.7612813Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:28.7613472Z @onednn//:onednn_autogen; 11s local ... 2025-03-14T06:27:28.9780594Z 2025-03-14T06:27:28.9781552Z  2025-03-14T06:27:28.9782073Z  2025-03-14T06:27:28.9782502Z  2025-03-14T06:27:28.9782897Z  2025-03-14T06:27:28.9783306Z  2025-03-14T06:27:28.9783702Z  2025-03-14T06:27:28.9784088Z  2025-03-14T06:27:28.9784605Z  2025-03-14T06:27:28.9785557Z [12,226 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:28.9786964Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T06:27:28.9788271Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T06:27:28.9789289Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T06:27:28.9790119Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local 2025-03-14T06:27:28.9791072Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2025-03-14T06:27:28.9792057Z Compiling src/cpu/x64/jit_gemm_inner_product_utils.cpp; 13s local 2025-03-14T06:27:28.9792864Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:28.9793513Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:29.2127342Z 2025-03-14T06:27:29.2128514Z  2025-03-14T06:27:29.2129053Z  2025-03-14T06:27:29.2129507Z  2025-03-14T06:27:29.2129981Z  2025-03-14T06:27:29.2130425Z  2025-03-14T06:27:29.2130864Z  2025-03-14T06:27:29.2131313Z  2025-03-14T06:27:29.2131756Z  2025-03-14T06:27:29.2132757Z [12,231 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:29.2134252Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T06:27:29.2135470Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T06:27:29.2136517Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 25s local 2025-03-14T06:27:29.2137422Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:27:29.2138407Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2025-03-14T06:27:29.2139276Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:29.2139882Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:29.2140596Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T06:27:29.4196680Z 2025-03-14T06:27:29.4197580Z  2025-03-14T06:27:29.4198102Z  2025-03-14T06:27:29.4198535Z  2025-03-14T06:27:29.4198944Z  2025-03-14T06:27:29.4199380Z  2025-03-14T06:27:29.4199803Z  2025-03-14T06:27:29.4200204Z  2025-03-14T06:27:29.4200612Z  2025-03-14T06:27:29.4201572Z [12,239 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:29.4202810Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T06:27:29.4204210Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T06:27:29.4205372Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T06:27:29.4206444Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:27:29.4207341Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2025-03-14T06:27:29.4208198Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:27:29.4209031Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:27:29.4209762Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:29.6601103Z 2025-03-14T06:27:29.6602041Z  2025-03-14T06:27:29.6602476Z  2025-03-14T06:27:29.6602823Z  2025-03-14T06:27:29.6603166Z  2025-03-14T06:27:29.6603529Z  2025-03-14T06:27:29.6603882Z  2025-03-14T06:27:29.6604239Z  2025-03-14T06:27:29.6604757Z  2025-03-14T06:27:29.6605597Z [12,258 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:29.6606756Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T06:27:29.6607990Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T06:27:29.6608993Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T06:27:29.6609835Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:27:29.6610762Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 16s local 2025-03-14T06:27:29.6611565Z @onednn//:onednn_autogen; 14s local 2025-03-14T06:27:29.6612476Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:27:29.6613167Z @onednn//:onednn_autogen; 10s local ... 2025-03-14T06:27:29.8589820Z 2025-03-14T06:27:29.8590692Z  2025-03-14T06:27:29.8591215Z  2025-03-14T06:27:29.8591673Z  2025-03-14T06:27:29.8592127Z  2025-03-14T06:27:29.8592575Z  2025-03-14T06:27:29.8593064Z  2025-03-14T06:27:29.8593477Z  2025-03-14T06:27:29.8593920Z  2025-03-14T06:27:29.8594887Z [12,277 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:29.8596184Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T06:27:29.8597340Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 43s local 2025-03-14T06:27:29.8598411Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T06:27:29.8599363Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:27:29.8600385Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2025-03-14T06:27:29.8601298Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:27:29.8602500Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:29.8603441Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 10s local ... 2025-03-14T06:27:30.0616481Z 2025-03-14T06:27:30.0617562Z  2025-03-14T06:27:30.0618108Z  2025-03-14T06:27:30.0618566Z  2025-03-14T06:27:30.0619013Z  2025-03-14T06:27:30.0619464Z  2025-03-14T06:27:30.0619920Z  2025-03-14T06:27:30.0620659Z  2025-03-14T06:27:30.0621094Z  2025-03-14T06:27:30.0622112Z [12,303 / 20,650] 3 / 17 tests; 48 actions, 46 running; last test: ...ash_test 2025-03-14T06:27:30.0623294Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T06:27:30.0624479Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:27:30.0625552Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T06:27:30.0626475Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:27:30.0627404Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2025-03-14T06:27:30.0628238Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:27:30.0629053Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 10s local 2025-03-14T06:27:30.0630308Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 9s local ... 2025-03-14T06:27:30.2846386Z 2025-03-14T06:27:30.2847327Z  2025-03-14T06:27:30.2847836Z  2025-03-14T06:27:30.2848277Z  2025-03-14T06:27:30.2848952Z  2025-03-14T06:27:30.2849328Z  2025-03-14T06:27:30.2849706Z  2025-03-14T06:27:30.2850124Z  2025-03-14T06:27:30.2850482Z  2025-03-14T06:27:30.2851573Z [12,323 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:30.2852686Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T06:27:30.2853816Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:27:30.2854754Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 26s local 2025-03-14T06:27:30.2855562Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:27:30.2856485Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2025-03-14T06:27:30.2857313Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:27:30.2858050Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 10s local 2025-03-14T06:27:30.2859004Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 9s local ... 2025-03-14T06:27:30.4966837Z 2025-03-14T06:27:30.4967696Z  2025-03-14T06:27:30.4968194Z  2025-03-14T06:27:30.4968603Z  2025-03-14T06:27:30.4969015Z  2025-03-14T06:27:30.4969427Z  2025-03-14T06:27:30.4969894Z  2025-03-14T06:27:30.4970304Z  2025-03-14T06:27:30.4970730Z  2025-03-14T06:27:30.4971957Z [12,352 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:30.4973350Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T06:27:30.4974473Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:27:30.4975498Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T06:27:30.4976350Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:27:30.4977272Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 17s local 2025-03-14T06:27:30.4978093Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:27:30.4978794Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 10s local 2025-03-14T06:27:30.4979649Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 9s local ... 2025-03-14T06:27:30.6984035Z 2025-03-14T06:27:30.6984956Z  2025-03-14T06:27:30.6985468Z  2025-03-14T06:27:30.6985883Z  2025-03-14T06:27:30.6986321Z  2025-03-14T06:27:30.6986758Z  2025-03-14T06:27:30.6987172Z  2025-03-14T06:27:30.6987583Z  2025-03-14T06:27:30.6988003Z  2025-03-14T06:27:30.6988921Z [12,388 / 20,650] 3 / 17 tests; 48 actions, 46 running; last test: ...ash_test 2025-03-14T06:27:30.6990142Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T06:27:30.6991343Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:27:30.6992361Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T06:27:30.6993238Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:27:30.6994062Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2025-03-14T06:27:30.6994759Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:27:30.6995452Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2025-03-14T06:27:30.6996302Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local ... 2025-03-14T06:27:30.8980241Z 2025-03-14T06:27:30.8981065Z  2025-03-14T06:27:30.8981551Z  2025-03-14T06:27:30.8981950Z  2025-03-14T06:27:30.8982355Z  2025-03-14T06:27:30.8982729Z  2025-03-14T06:27:30.8983127Z  2025-03-14T06:27:30.8983566Z  2025-03-14T06:27:30.8984259Z  2025-03-14T06:27:30.8985293Z [12,396 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:30.8986510Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T06:27:30.8987795Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 44s local 2025-03-14T06:27:30.8988773Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T06:27:30.8989661Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:27:30.8990697Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2025-03-14T06:27:30.8991533Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:27:30.8992323Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2025-03-14T06:27:30.8993286Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local ... 2025-03-14T06:27:31.1169936Z 2025-03-14T06:27:31.1170777Z  2025-03-14T06:27:31.1171305Z  2025-03-14T06:27:31.1171774Z  2025-03-14T06:27:31.1172217Z  2025-03-14T06:27:31.1172641Z  2025-03-14T06:27:31.1173064Z  2025-03-14T06:27:31.1173484Z  2025-03-14T06:27:31.1173911Z  2025-03-14T06:27:31.1174917Z [12,401 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:31.1176192Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T06:27:31.1177330Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T06:27:31.1178312Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T06:27:31.1179450Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:27:31.1180408Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2025-03-14T06:27:31.1181298Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:27:31.1182145Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2025-03-14T06:27:31.1183174Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local ... 2025-03-14T06:27:31.3174377Z 2025-03-14T06:27:31.3175262Z  2025-03-14T06:27:31.3175754Z  2025-03-14T06:27:31.3176189Z  2025-03-14T06:27:31.3176593Z  2025-03-14T06:27:31.3177048Z  2025-03-14T06:27:31.3177472Z  2025-03-14T06:27:31.3177919Z  2025-03-14T06:27:31.3178340Z  2025-03-14T06:27:31.3179291Z [12,403 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:31.3180517Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T06:27:31.3181761Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T06:27:31.3182816Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 27s local 2025-03-14T06:27:31.3183738Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2025-03-14T06:27:31.3184695Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2025-03-14T06:27:31.3185567Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:27:31.3186332Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2025-03-14T06:27:31.3187267Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local ... 2025-03-14T06:27:31.5348315Z 2025-03-14T06:27:31.5349179Z  2025-03-14T06:27:31.5349678Z  2025-03-14T06:27:31.5350096Z  2025-03-14T06:27:31.5350492Z  2025-03-14T06:27:31.5350913Z  2025-03-14T06:27:31.5351314Z  2025-03-14T06:27:31.5351754Z  2025-03-14T06:27:31.5352176Z  2025-03-14T06:27:31.5353160Z [12,405 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:31.5354428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:27:31.5355664Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T06:27:31.5356624Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T06:27:31.5357719Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2025-03-14T06:27:31.5358631Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 18s local 2025-03-14T06:27:31.5359500Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T06:27:31.5360467Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 11s local 2025-03-14T06:27:31.5361478Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 10s local ... 2025-03-14T06:27:31.7594119Z 2025-03-14T06:27:31.7594677Z  2025-03-14T06:27:31.7595349Z  2025-03-14T06:27:31.7595806Z  2025-03-14T06:27:31.7596226Z  2025-03-14T06:27:31.7596649Z  2025-03-14T06:27:31.7597073Z  2025-03-14T06:27:31.7597493Z  2025-03-14T06:27:31.7597909Z  2025-03-14T06:27:31.7598859Z [12,411 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:31.7600103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:27:31.7601349Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 45s local 2025-03-14T06:27:31.7602321Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T06:27:31.7603234Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2025-03-14T06:27:31.7604235Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2025-03-14T06:27:31.7605249Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T06:27:31.7606083Z Compiling src/cpu/x64/jit_uni_eltwise_int.cpp; 12s local 2025-03-14T06:27:31.7607085Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 11s local ... 2025-03-14T06:27:31.9903921Z 2025-03-14T06:27:31.9905014Z  2025-03-14T06:27:31.9905531Z  2025-03-14T06:27:31.9905973Z  2025-03-14T06:27:31.9906384Z  2025-03-14T06:27:31.9906795Z  2025-03-14T06:27:31.9907178Z  2025-03-14T06:27:31.9907593Z  2025-03-14T06:27:31.9908009Z  2025-03-14T06:27:31.9908947Z [12,415 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:31.9910197Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:27:31.9911421Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T06:27:31.9912372Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T06:27:31.9913274Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2025-03-14T06:27:31.9914274Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2025-03-14T06:27:31.9915120Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T06:27:31.9916019Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 11s local 2025-03-14T06:27:31.9917119Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 6s local ... 2025-03-14T06:27:32.2182946Z 2025-03-14T06:27:32.2183815Z  2025-03-14T06:27:32.2184286Z  2025-03-14T06:27:32.2184713Z  2025-03-14T06:27:32.2185179Z  2025-03-14T06:27:32.2185603Z  2025-03-14T06:27:32.2185989Z  2025-03-14T06:27:32.2186396Z  2025-03-14T06:27:32.2186797Z  2025-03-14T06:27:32.2187787Z [12,419 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:32.2189031Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:27:32.2190185Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T06:27:32.2191220Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 28s local 2025-03-14T06:27:32.2192101Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:27:32.2193084Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2025-03-14T06:27:32.2193936Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T06:27:32.2194814Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 11s local 2025-03-14T06:27:32.2195913Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 7s local ... 2025-03-14T06:27:32.4474053Z 2025-03-14T06:27:32.4474933Z  2025-03-14T06:27:32.4475474Z  2025-03-14T06:27:32.4475876Z  2025-03-14T06:27:32.4476287Z  2025-03-14T06:27:32.4476717Z  2025-03-14T06:27:32.4477419Z  2025-03-14T06:27:32.4477845Z  2025-03-14T06:27:32.4478272Z  2025-03-14T06:27:32.4479263Z [12,425 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:32.4480662Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:27:32.4481778Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T06:27:32.4482569Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T06:27:32.4483402Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:27:32.4484344Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 19s local 2025-03-14T06:27:32.4485509Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 11s local 2025-03-14T06:27:32.4486596Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 7s local 2025-03-14T06:27:32.4487708Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 6s local ... 2025-03-14T06:27:32.7055921Z 2025-03-14T06:27:32.7056763Z  2025-03-14T06:27:32.7057241Z  2025-03-14T06:27:32.7057674Z  2025-03-14T06:27:32.7058093Z  2025-03-14T06:27:32.7058514Z  2025-03-14T06:27:32.7058927Z  2025-03-14T06:27:32.7059362Z  2025-03-14T06:27:32.7059784Z  2025-03-14T06:27:32.7060987Z [12,428 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:32.7062247Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T06:27:32.7063377Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 46s local 2025-03-14T06:27:32.7064391Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T06:27:32.7065556Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:27:32.7066529Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T06:27:32.7067529Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2025-03-14T06:27:32.7068588Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 7s local 2025-03-14T06:27:32.7069618Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 6s local ... 2025-03-14T06:27:32.9184780Z 2025-03-14T06:27:32.9185805Z  2025-03-14T06:27:32.9186333Z  2025-03-14T06:27:32.9186766Z  2025-03-14T06:27:32.9187211Z  2025-03-14T06:27:32.9187621Z  2025-03-14T06:27:32.9188056Z  2025-03-14T06:27:32.9188474Z  2025-03-14T06:27:32.9188902Z  2025-03-14T06:27:32.9189889Z [12,432 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:32.9191076Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T06:27:32.9192184Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T06:27:32.9193199Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T06:27:32.9194093Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:27:32.9195093Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T06:27:32.9196084Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2025-03-14T06:27:32.9197175Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 7s local 2025-03-14T06:27:32.9198222Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 6s local ... 2025-03-14T06:27:33.1255681Z 2025-03-14T06:27:33.1256665Z  2025-03-14T06:27:33.1259476Z  2025-03-14T06:27:33.1259940Z  2025-03-14T06:27:33.1260358Z  2025-03-14T06:27:33.1260825Z  2025-03-14T06:27:33.1261227Z  2025-03-14T06:27:33.1261615Z  2025-03-14T06:27:33.1264364Z  2025-03-14T06:27:33.1265567Z [12,437 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:33.1266855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T06:27:33.1268282Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T06:27:33.1269197Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 29s local 2025-03-14T06:27:33.1270140Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:27:33.1271042Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T06:27:33.1272016Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2025-03-14T06:27:33.1273041Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 7s local 2025-03-14T06:27:33.1274065Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 7s local ... 2025-03-14T06:27:33.4501505Z 2025-03-14T06:27:33.4502329Z  2025-03-14T06:27:33.4502873Z  2025-03-14T06:27:33.4503322Z  2025-03-14T06:27:33.4503772Z  2025-03-14T06:27:33.4504216Z  2025-03-14T06:27:33.4504665Z  2025-03-14T06:27:33.4505110Z  2025-03-14T06:27:33.4505537Z  2025-03-14T06:27:33.4506552Z [12,441 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:33.4507834Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T06:27:33.4509100Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T06:27:33.4510159Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:27:33.4511337Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:27:33.4512361Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T06:27:33.4513376Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2025-03-14T06:27:33.4514360Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 8s local 2025-03-14T06:27:33.4515454Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 7s local ... 2025-03-14T06:27:33.6705679Z 2025-03-14T06:27:33.6706520Z  2025-03-14T06:27:33.6706987Z  2025-03-14T06:27:33.6707436Z  2025-03-14T06:27:33.6707846Z  2025-03-14T06:27:33.6708209Z  2025-03-14T06:27:33.6708618Z  2025-03-14T06:27:33.6709027Z  2025-03-14T06:27:33.6709429Z  2025-03-14T06:27:33.6710394Z [12,450 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:33.6711612Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T06:27:33.6712805Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T06:27:33.6713815Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:27:33.6714708Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:27:33.6715688Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 20s local 2025-03-14T06:27:33.6716699Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 12s local 2025-03-14T06:27:33.6717761Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 8s local 2025-03-14T06:27:33.6718869Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 7s local ... 2025-03-14T06:27:33.8684518Z 2025-03-14T06:27:33.8685356Z  2025-03-14T06:27:33.8685834Z  2025-03-14T06:27:33.8686243Z  2025-03-14T06:27:33.8686659Z  2025-03-14T06:27:33.8687073Z  2025-03-14T06:27:33.8687483Z  2025-03-14T06:27:33.8687864Z  2025-03-14T06:27:33.8688263Z  2025-03-14T06:27:33.8689226Z [12,458 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:33.8690421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T06:27:33.8691561Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 47s local 2025-03-14T06:27:33.8692780Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:27:33.8693609Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:27:33.8694539Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2025-03-14T06:27:33.8695699Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 13s local 2025-03-14T06:27:33.8696677Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 8s local 2025-03-14T06:27:33.8697812Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 7s local ... 2025-03-14T06:27:34.1163378Z 2025-03-14T06:27:34.1164204Z  2025-03-14T06:27:34.1164886Z  2025-03-14T06:27:34.1165824Z  2025-03-14T06:27:34.1166270Z  2025-03-14T06:27:34.1166708Z  2025-03-14T06:27:34.1167138Z  2025-03-14T06:27:34.1167577Z  2025-03-14T06:27:34.1168014Z  2025-03-14T06:27:34.1168995Z [12,465 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:34.1170168Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T06:27:34.1171308Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T06:27:34.1172338Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:27:34.1173112Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:27:34.1173980Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2025-03-14T06:27:34.1174914Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 13s local 2025-03-14T06:27:34.1176185Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 8s local 2025-03-14T06:27:34.1177287Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 8s local ... 2025-03-14T06:27:34.3194751Z 2025-03-14T06:27:34.3195554Z  2025-03-14T06:27:34.3196018Z  2025-03-14T06:27:34.3196428Z  2025-03-14T06:27:34.3196843Z  2025-03-14T06:27:34.3197314Z  2025-03-14T06:27:34.3197782Z  2025-03-14T06:27:34.3198268Z  2025-03-14T06:27:34.3198774Z  2025-03-14T06:27:34.3199886Z [12,473 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:34.3201121Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T06:27:34.3202288Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T06:27:34.3203294Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 30s local 2025-03-14T06:27:34.3204200Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2025-03-14T06:27:34.3205397Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2025-03-14T06:27:34.3206467Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 13s local 2025-03-14T06:27:34.3207583Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 9s local 2025-03-14T06:27:34.3208740Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 8s local ... 2025-03-14T06:27:34.5740725Z 2025-03-14T06:27:34.5741640Z  2025-03-14T06:27:34.5742132Z  2025-03-14T06:27:34.5742521Z  2025-03-14T06:27:34.5742977Z  2025-03-14T06:27:34.5743398Z  2025-03-14T06:27:34.5743841Z  2025-03-14T06:27:34.5744261Z  2025-03-14T06:27:34.5744692Z  2025-03-14T06:27:34.5745664Z [12,492 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:34.5746901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:27:34.5748096Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T06:27:34.5749132Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T06:27:34.5750116Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2025-03-14T06:27:34.5751084Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 21s local 2025-03-14T06:27:34.5752084Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 13s local 2025-03-14T06:27:34.5753456Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 9s local 2025-03-14T06:27:34.5754549Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 8s local ... 2025-03-14T06:27:34.7862658Z 2025-03-14T06:27:34.7863632Z  2025-03-14T06:27:34.7864370Z  2025-03-14T06:27:34.7865004Z  2025-03-14T06:27:34.7866918Z  2025-03-14T06:27:34.7867327Z  2025-03-14T06:27:34.7867697Z  2025-03-14T06:27:34.7868454Z  2025-03-14T06:27:34.7868908Z  2025-03-14T06:27:34.7870069Z [12,496 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:34.7871286Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:27:34.7872454Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 48s local 2025-03-14T06:27:34.7873458Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T06:27:34.7874347Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2025-03-14T06:27:34.7875308Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T06:27:34.7876292Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2025-03-14T06:27:34.7877236Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 9s local 2025-03-14T06:27:34.7878316Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 8s local ... 2025-03-14T06:27:35.0030809Z 2025-03-14T06:27:35.0031624Z  2025-03-14T06:27:35.0032110Z  2025-03-14T06:27:35.0032516Z  2025-03-14T06:27:35.0032930Z  2025-03-14T06:27:35.0033330Z  2025-03-14T06:27:35.0033965Z  2025-03-14T06:27:35.0034383Z  2025-03-14T06:27:35.0034772Z  2025-03-14T06:27:35.0035744Z [12,498 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:35.0036949Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:27:35.0038111Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T06:27:35.0039102Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T06:27:35.0039951Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2025-03-14T06:27:35.0040900Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T06:27:35.0041873Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2025-03-14T06:27:35.0042919Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 9s local 2025-03-14T06:27:35.0043983Z Compiling src/cpu/x64/jit_uni_x8s8s32x_convolution.cpp; 9s local ... 2025-03-14T06:27:35.2126505Z 2025-03-14T06:27:35.2127385Z  2025-03-14T06:27:35.2127894Z  2025-03-14T06:27:35.2128283Z  2025-03-14T06:27:35.2128659Z  2025-03-14T06:27:35.2129072Z  2025-03-14T06:27:35.2129513Z  2025-03-14T06:27:35.2129904Z  2025-03-14T06:27:35.2130339Z  2025-03-14T06:27:35.2131304Z [12,510 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:35.2132553Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:27:35.2133764Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T06:27:35.2134761Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 31s local 2025-03-14T06:27:35.2135598Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local 2025-03-14T06:27:35.2136547Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T06:27:35.2137570Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2025-03-14T06:27:35.2138646Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 10s local 2025-03-14T06:27:35.2139707Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 9s local ... 2025-03-14T06:27:35.4289632Z 2025-03-14T06:27:35.4290432Z  2025-03-14T06:27:35.4291117Z  2025-03-14T06:27:35.4291480Z  2025-03-14T06:27:35.4291826Z  2025-03-14T06:27:35.4292151Z  2025-03-14T06:27:35.4292485Z  2025-03-14T06:27:35.4292819Z  2025-03-14T06:27:35.4293151Z  2025-03-14T06:27:35.4293990Z [12,514 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:35.4295088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:27:35.4296110Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T06:27:35.4298772Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T06:27:35.4299593Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T06:27:35.4300527Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2025-03-14T06:27:35.4301628Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 10s local 2025-03-14T06:27:35.4302613Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 9s local 2025-03-14T06:27:35.4303302Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:35.6444001Z 2025-03-14T06:27:35.6444984Z  2025-03-14T06:27:35.6445498Z  2025-03-14T06:27:35.6445939Z  2025-03-14T06:27:35.6446411Z  2025-03-14T06:27:35.6446853Z  2025-03-14T06:27:35.6447290Z  2025-03-14T06:27:35.6447720Z  2025-03-14T06:27:35.6448117Z  2025-03-14T06:27:35.6449045Z [12,526 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:35.6450194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:27:35.6451767Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T06:27:35.6452624Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T06:27:35.6453302Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 22s local 2025-03-14T06:27:35.6454124Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 14s local 2025-03-14T06:27:35.6455114Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 10s local 2025-03-14T06:27:35.6456076Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 9s local 2025-03-14T06:27:35.6456856Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:35.8507705Z 2025-03-14T06:27:35.8508615Z  2025-03-14T06:27:35.8509103Z  2025-03-14T06:27:35.8509540Z  2025-03-14T06:27:35.8509970Z  2025-03-14T06:27:35.8510391Z  2025-03-14T06:27:35.8510838Z  2025-03-14T06:27:35.8511263Z  2025-03-14T06:27:35.8511709Z  2025-03-14T06:27:35.8512690Z [12,545 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:35.8513974Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:27:35.8515239Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 49s local 2025-03-14T06:27:35.8516305Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T06:27:35.8517250Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2025-03-14T06:27:35.8518284Z Compiling src/cpu/x64/jit_uni_layer_normalization.cpp; 15s local 2025-03-14T06:27:35.8519396Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 10s local 2025-03-14T06:27:35.8520475Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 9s local 2025-03-14T06:27:35.8521343Z @onednn//:onednn_autogen; 9s local ... 2025-03-14T06:27:36.0656131Z 2025-03-14T06:27:36.0657040Z  2025-03-14T06:27:36.0657541Z  2025-03-14T06:27:36.0657995Z  2025-03-14T06:27:36.0658422Z  2025-03-14T06:27:36.0658853Z  2025-03-14T06:27:36.0659212Z  2025-03-14T06:27:36.0659577Z  2025-03-14T06:27:36.0659961Z  2025-03-14T06:27:36.0660918Z [12,547 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:36.0662135Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:27:36.0663709Z Compiling src/cpu/x64/injectors/jit_uni_eltwise_injector.cpp; 50s local 2025-03-14T06:27:36.0664673Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T06:27:36.0666005Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2025-03-14T06:27:36.0667033Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 10s local 2025-03-14T06:27:36.0668220Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 9s local 2025-03-14T06:27:36.0669037Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:36.0669834Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 8s local ... 2025-03-14T06:27:36.3209320Z 2025-03-14T06:27:36.3210190Z  2025-03-14T06:27:36.3210687Z  2025-03-14T06:27:36.3211102Z  2025-03-14T06:27:36.3211500Z  2025-03-14T06:27:36.3211922Z  2025-03-14T06:27:36.3212323Z  2025-03-14T06:27:36.3212735Z  2025-03-14T06:27:36.3213164Z  2025-03-14T06:27:36.3214109Z [12,555 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:36.3215321Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:27:36.3216299Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 32s local 2025-03-14T06:27:36.3217165Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2025-03-14T06:27:36.3218172Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 11s local 2025-03-14T06:27:36.3219207Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 10s local 2025-03-14T06:27:36.3220021Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:36.3221055Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2025-03-14T06:27:36.3221894Z @llvm-project//llvm:llvm-tblgen; 4s local ... 2025-03-14T06:27:36.5214286Z 2025-03-14T06:27:36.5215126Z  2025-03-14T06:27:36.5215628Z  2025-03-14T06:27:36.5216062Z  2025-03-14T06:27:36.5216523Z  2025-03-14T06:27:36.5216957Z  2025-03-14T06:27:36.5217371Z  2025-03-14T06:27:36.5217796Z  2025-03-14T06:27:36.5218220Z  2025-03-14T06:27:36.5219219Z [12,558 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:36.5220476Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:27:36.5221492Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T06:27:36.5222418Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 23s local 2025-03-14T06:27:36.5223469Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 11s local 2025-03-14T06:27:36.5224557Z Compiling src/cpu/x64/lrn/jit_avx512_common_lrn.cpp; 10s local 2025-03-14T06:27:36.5225406Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:36.5226106Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2025-03-14T06:27:36.5226888Z @llvm-project//llvm:llvm-tblgen; 4s local ... 2025-03-14T06:27:36.7541132Z 2025-03-14T06:27:36.7542068Z  2025-03-14T06:27:36.7542704Z  2025-03-14T06:27:36.7543111Z  2025-03-14T06:27:36.7543511Z  2025-03-14T06:27:36.7543979Z  2025-03-14T06:27:36.7544380Z  2025-03-14T06:27:36.7544809Z  2025-03-14T06:27:36.7545217Z  2025-03-14T06:27:36.7546233Z [12,565 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:36.7547458Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T06:27:36.7548477Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T06:27:36.7549426Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2025-03-14T06:27:36.7550486Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 11s local 2025-03-14T06:27:36.7551352Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:36.7552043Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2025-03-14T06:27:36.7553102Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:27:36.7553763Z @onednn//:mkl_dnn; 4s local ... 2025-03-14T06:27:36.9734406Z 2025-03-14T06:27:36.9735375Z  2025-03-14T06:27:36.9735866Z  2025-03-14T06:27:36.9737374Z  2025-03-14T06:27:36.9737801Z  2025-03-14T06:27:36.9738220Z  2025-03-14T06:27:36.9738640Z  2025-03-14T06:27:36.9739055Z  2025-03-14T06:27:36.9739435Z  2025-03-14T06:27:36.9740573Z [12,567 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:36.9741800Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T06:27:36.9742752Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T06:27:36.9743597Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2025-03-14T06:27:36.9744575Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 11s local 2025-03-14T06:27:36.9745371Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:36.9746076Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2025-03-14T06:27:36.9746765Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:27:36.9747374Z @onednn//:mkl_dnn; 4s local ... 2025-03-14T06:27:37.1980196Z 2025-03-14T06:27:37.1981802Z  2025-03-14T06:27:37.1982359Z  2025-03-14T06:27:37.1982781Z  2025-03-14T06:27:37.1983204Z  2025-03-14T06:27:37.1983600Z  2025-03-14T06:27:37.1984022Z  2025-03-14T06:27:37.1984457Z  2025-03-14T06:27:37.1984869Z  2025-03-14T06:27:37.1986147Z [12,572 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:37.1987389Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T06:27:37.1988423Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 33s local 2025-03-14T06:27:37.1989326Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2025-03-14T06:27:37.1990369Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 12s local 2025-03-14T06:27:37.1991384Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:37.1992081Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 9s local 2025-03-14T06:27:37.1992788Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:27:37.1993359Z @onednn//:mkl_dnn; 4s local ... 2025-03-14T06:27:37.5220367Z 2025-03-14T06:27:37.5221384Z  2025-03-14T06:27:37.5221883Z  2025-03-14T06:27:37.5222328Z  2025-03-14T06:27:37.5222749Z  2025-03-14T06:27:37.5223160Z  2025-03-14T06:27:37.5223575Z  2025-03-14T06:27:37.5223997Z  2025-03-14T06:27:37.5224410Z  2025-03-14T06:27:37.5225470Z [12,582 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:37.5226693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T06:27:37.5227712Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T06:27:37.5228631Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 24s local 2025-03-14T06:27:37.5229668Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 12s local 2025-03-14T06:27:37.5230526Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:37.5231324Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2025-03-14T06:27:37.5232137Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T06:27:37.5232790Z @onednn//:mkl_dnn; 5s local ... 2025-03-14T06:27:37.7223556Z 2025-03-14T06:27:37.7224986Z  2025-03-14T06:27:37.7225610Z  2025-03-14T06:27:37.7226018Z  2025-03-14T06:27:37.7226432Z  2025-03-14T06:27:37.7226862Z  2025-03-14T06:27:37.7227274Z  2025-03-14T06:27:37.7227711Z  2025-03-14T06:27:37.7228142Z  2025-03-14T06:27:37.7229167Z [12,587 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:37.7230666Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T06:27:37.7242428Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T06:27:37.7243371Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T06:27:37.7244749Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 12s local 2025-03-14T06:27:37.7245642Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:37.7246427Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2025-03-14T06:27:37.7247417Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T06:27:37.7248064Z @onednn//:mkl_dnn; 5s local ... 2025-03-14T06:27:37.9247914Z 2025-03-14T06:27:37.9249115Z  2025-03-14T06:27:37.9250050Z  2025-03-14T06:27:37.9250784Z  2025-03-14T06:27:37.9251471Z  2025-03-14T06:27:37.9252613Z  2025-03-14T06:27:37.9253094Z  2025-03-14T06:27:37.9253526Z  2025-03-14T06:27:37.9253950Z  2025-03-14T06:27:37.9254915Z [12,595 / 20,650] 3 / 17 tests; 48 actions, 46 running; last test: ...ash_test 2025-03-14T06:27:37.9256086Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T06:27:37.9257053Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T06:27:37.9257997Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T06:27:37.9259010Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 12s local 2025-03-14T06:27:37.9260006Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2025-03-14T06:27:37.9260858Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T06:27:37.9262101Z Compiling src/cpu/x64/prelu/jit_uni_prelu_backward_kernel.cpp; 5s local 2025-03-14T06:27:37.9263278Z Compiling src/cpu/x64/rnn/brgemm_cell_common_bwd.cpp; 5s local ... 2025-03-14T06:27:38.1440006Z 2025-03-14T06:27:38.1440887Z  2025-03-14T06:27:38.1441379Z  2025-03-14T06:27:38.1441824Z  2025-03-14T06:27:38.1442272Z  2025-03-14T06:27:38.1442674Z  2025-03-14T06:27:38.1443097Z  2025-03-14T06:27:38.1443460Z  2025-03-14T06:27:38.1443814Z  2025-03-14T06:27:38.1444818Z [12,599 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:38.1446012Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T06:27:38.1446980Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T06:27:38.1447910Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T06:27:38.1448929Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 12s local 2025-03-14T06:27:38.1449925Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 10s local 2025-03-14T06:27:38.1450730Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T06:27:38.1451663Z Compiling src/cpu/x64/prelu/jit_uni_prelu_backward_kernel.cpp; 5s local 2025-03-14T06:27:38.1452651Z @com_github_grpc_grpc//:grpc++_base; 4s local ... 2025-03-14T06:27:38.3490476Z 2025-03-14T06:27:38.3491276Z  2025-03-14T06:27:38.3491713Z  2025-03-14T06:27:38.3492136Z  2025-03-14T06:27:38.3492527Z  2025-03-14T06:27:38.3492937Z  2025-03-14T06:27:38.3493299Z  2025-03-14T06:27:38.3493629Z  2025-03-14T06:27:38.3493957Z  2025-03-14T06:27:38.3494815Z [12,607 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:38.3495804Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T06:27:38.3496626Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 34s local 2025-03-14T06:27:38.3497348Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T06:27:38.3498178Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 13s local 2025-03-14T06:27:38.3498977Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2025-03-14T06:27:38.3499618Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T06:27:38.3500706Z Compiling src/cpu/x64/prelu/jit_uni_prelu_backward_kernel.cpp; 5s local 2025-03-14T06:27:38.3501536Z Compiling src/cpp/server/server_cc.cc; 4s local ... 2025-03-14T06:27:38.5717788Z 2025-03-14T06:27:38.5718938Z  2025-03-14T06:27:38.5719456Z  2025-03-14T06:27:38.5719908Z  2025-03-14T06:27:38.5720336Z  2025-03-14T06:27:38.5720745Z  2025-03-14T06:27:38.5721178Z  2025-03-14T06:27:38.5721602Z  2025-03-14T06:27:38.5722038Z  2025-03-14T06:27:38.5723212Z [12,622 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:38.5724671Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:27:38.5725751Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T06:27:38.5726717Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 25s local 2025-03-14T06:27:38.5727803Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 13s local 2025-03-14T06:27:38.5728904Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2025-03-14T06:27:38.5729754Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T06:27:38.5730704Z Compiling src/cpu/x64/prelu/jit_uni_prelu_backward_kernel.cpp; 6s local 2025-03-14T06:27:38.5731734Z Compiling src/cpp/server/server_cc.cc; 4s local ... 2025-03-14T06:27:38.7736647Z 2025-03-14T06:27:38.7737523Z  2025-03-14T06:27:38.7738047Z  2025-03-14T06:27:38.7738527Z  2025-03-14T06:27:38.7738959Z  2025-03-14T06:27:38.7739365Z  2025-03-14T06:27:38.7739764Z  2025-03-14T06:27:38.7740165Z  2025-03-14T06:27:38.7740807Z  2025-03-14T06:27:38.7741834Z [12,638 / 20,650] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2025-03-14T06:27:38.7743068Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:27:38.7743985Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T06:27:38.7744909Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2025-03-14T06:27:38.7745956Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 13s local 2025-03-14T06:27:38.7746955Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2025-03-14T06:27:38.7747798Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T06:27:38.7748560Z Compiling src/cpp/server/server_cc.cc; 4s local 2025-03-14T06:27:38.7749514Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 3s local ... 2025-03-14T06:27:38.9841304Z 2025-03-14T06:27:38.9842155Z  2025-03-14T06:27:38.9842684Z  2025-03-14T06:27:38.9843139Z  2025-03-14T06:27:38.9843555Z  2025-03-14T06:27:38.9843968Z  2025-03-14T06:27:38.9844548Z  2025-03-14T06:27:38.9844969Z  2025-03-14T06:27:38.9845382Z  2025-03-14T06:27:38.9846371Z [12,647 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:38.9847633Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:27:38.9848663Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T06:27:38.9849549Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2025-03-14T06:27:38.9850596Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 13s local 2025-03-14T06:27:38.9851623Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2025-03-14T06:27:38.9852418Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T06:27:38.9853149Z Compiling src/cpp/server/server_cc.cc; 5s local 2025-03-14T06:27:38.9854079Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 3s local ... 2025-03-14T06:27:39.1971302Z 2025-03-14T06:27:39.1972180Z  2025-03-14T06:27:39.1972704Z  2025-03-14T06:27:39.1973132Z  2025-03-14T06:27:39.1973553Z  2025-03-14T06:27:39.1973977Z  2025-03-14T06:27:39.1974407Z  2025-03-14T06:27:39.1975124Z  2025-03-14T06:27:39.1975549Z  2025-03-14T06:27:39.1976529Z [12,653 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:39.1977974Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:27:39.1979175Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 35s local 2025-03-14T06:27:39.1980070Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2025-03-14T06:27:39.1981247Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2025-03-14T06:27:39.1982274Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 11s local 2025-03-14T06:27:39.1983070Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T06:27:39.1983863Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 4s local 2025-03-14T06:27:39.1984816Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 3s local ... 2025-03-14T06:27:39.4930955Z 2025-03-14T06:27:39.4931826Z  2025-03-14T06:27:39.4932323Z  2025-03-14T06:27:39.4932738Z  2025-03-14T06:27:39.4933134Z  2025-03-14T06:27:39.4933530Z  2025-03-14T06:27:39.4933928Z  2025-03-14T06:27:39.4934337Z  2025-03-14T06:27:39.4934741Z  2025-03-14T06:27:39.4935711Z [12,655 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:39.4936889Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:27:39.4937908Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T06:27:39.4938701Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 26s local 2025-03-14T06:27:39.4939946Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2025-03-14T06:27:39.4940952Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local 2025-03-14T06:27:39.4941767Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:27:39.4942618Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 4s local 2025-03-14T06:27:39.4943623Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 4s local ... 2025-03-14T06:27:39.7099798Z 2025-03-14T06:27:39.7100681Z  2025-03-14T06:27:39.7101221Z  2025-03-14T06:27:39.7101643Z  2025-03-14T06:27:39.7102068Z  2025-03-14T06:27:39.7102475Z  2025-03-14T06:27:39.7102880Z  2025-03-14T06:27:39.7103277Z  2025-03-14T06:27:39.7103696Z  2025-03-14T06:27:39.7104660Z [12,660 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:39.7105852Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T06:27:39.7106873Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T06:27:39.7107695Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2025-03-14T06:27:39.7108658Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2025-03-14T06:27:39.7109611Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local 2025-03-14T06:27:39.7110318Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:27:39.7111141Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 4s local 2025-03-14T06:27:39.7112136Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 4s local ... 2025-03-14T06:27:39.9242040Z 2025-03-14T06:27:39.9242941Z  2025-03-14T06:27:39.9243453Z  2025-03-14T06:27:39.9243902Z  2025-03-14T06:27:39.9244338Z  2025-03-14T06:27:39.9244982Z  2025-03-14T06:27:39.9245456Z  2025-03-14T06:27:39.9245925Z  2025-03-14T06:27:39.9246379Z  2025-03-14T06:27:39.9247464Z [12,686 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:39.9248855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T06:27:39.9250002Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T06:27:39.9251008Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2025-03-14T06:27:39.9252389Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2025-03-14T06:27:39.9253795Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local 2025-03-14T06:27:39.9254678Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:27:39.9255702Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 4s local 2025-03-14T06:27:39.9256815Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 4s local ... 2025-03-14T06:27:40.1246184Z 2025-03-14T06:27:40.1247358Z  2025-03-14T06:27:40.1247954Z  2025-03-14T06:27:40.1248416Z  2025-03-14T06:27:40.1248860Z  2025-03-14T06:27:40.1249309Z  2025-03-14T06:27:40.1249728Z  2025-03-14T06:27:40.1250143Z  2025-03-14T06:27:40.1250555Z  2025-03-14T06:27:40.1251541Z [12,701 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:40.1252833Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T06:27:40.1253881Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 36s local 2025-03-14T06:27:40.1254798Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2025-03-14T06:27:40.1255897Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 14s local 2025-03-14T06:27:40.1256932Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 12s local 2025-03-14T06:27:40.1257726Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:27:40.1258598Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 5s local 2025-03-14T06:27:40.1259671Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 4s local ... 2025-03-14T06:27:40.5251469Z 2025-03-14T06:27:40.5252352Z  2025-03-14T06:27:40.5252867Z  2025-03-14T06:27:40.5253304Z  2025-03-14T06:27:40.5253729Z  2025-03-14T06:27:40.5254145Z  2025-03-14T06:27:40.5254577Z  2025-03-14T06:27:40.5255003Z  2025-03-14T06:27:40.5255439Z  2025-03-14T06:27:40.5256427Z [12,706 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:40.5257658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T06:27:40.5258654Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T06:27:40.5259570Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 27s local 2025-03-14T06:27:40.5260464Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 15s local 2025-03-14T06:27:40.5261376Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local 2025-03-14T06:27:40.5262103Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T06:27:40.5263095Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 5s local 2025-03-14T06:27:40.5264305Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local ... 2025-03-14T06:27:40.7366660Z 2025-03-14T06:27:40.7367587Z  2025-03-14T06:27:40.7368143Z  2025-03-14T06:27:40.7368621Z  2025-03-14T06:27:40.7368993Z  2025-03-14T06:27:40.7369381Z  2025-03-14T06:27:40.7369773Z  2025-03-14T06:27:40.7370172Z  2025-03-14T06:27:40.7370565Z  2025-03-14T06:27:40.7371522Z [12,707 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:40.7372749Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T06:27:40.7373749Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T06:27:40.7374641Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T06:27:40.7375648Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 15s local 2025-03-14T06:27:40.7376627Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local 2025-03-14T06:27:40.7377423Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T06:27:40.7378304Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 5s local 2025-03-14T06:27:40.7379332Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local ... 2025-03-14T06:27:40.9439364Z 2025-03-14T06:27:40.9440313Z  2025-03-14T06:27:40.9440855Z  2025-03-14T06:27:40.9441309Z  2025-03-14T06:27:40.9441691Z  2025-03-14T06:27:40.9442034Z  2025-03-14T06:27:40.9442638Z  2025-03-14T06:27:40.9443048Z  2025-03-14T06:27:40.9443394Z  2025-03-14T06:27:40.9444281Z [12,716 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:40.9445766Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T06:27:40.9446722Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T06:27:40.9447398Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T06:27:40.9448293Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 15s local 2025-03-14T06:27:40.9449147Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local 2025-03-14T06:27:40.9449848Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T06:27:40.9450580Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 5s local 2025-03-14T06:27:40.9451442Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local ... 2025-03-14T06:27:41.1749312Z 2025-03-14T06:27:41.1750111Z  2025-03-14T06:27:41.1750620Z  2025-03-14T06:27:41.1751033Z  2025-03-14T06:27:41.1751466Z  2025-03-14T06:27:41.1751941Z  2025-03-14T06:27:41.1752405Z  2025-03-14T06:27:41.1752807Z  2025-03-14T06:27:41.1753238Z  2025-03-14T06:27:41.1754471Z [12,728 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:41.1755735Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T06:27:41.1756770Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T06:27:41.1757633Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T06:27:41.1758677Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 15s local 2025-03-14T06:27:41.1759678Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 13s local 2025-03-14T06:27:41.1760486Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T06:27:41.1761288Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 6s local 2025-03-14T06:27:41.1762370Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local ... 2025-03-14T06:27:41.3828113Z 2025-03-14T06:27:41.3828974Z  2025-03-14T06:27:41.3829476Z  2025-03-14T06:27:41.3829911Z  2025-03-14T06:27:41.3830336Z  2025-03-14T06:27:41.3830805Z  2025-03-14T06:27:41.3831263Z  2025-03-14T06:27:41.3831694Z  2025-03-14T06:27:41.3832101Z  2025-03-14T06:27:41.3833026Z [12,740 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:41.3834329Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T06:27:41.3835352Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 37s local 2025-03-14T06:27:41.3836234Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 28s local 2025-03-14T06:27:41.3837307Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 16s local 2025-03-14T06:27:41.3838352Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local 2025-03-14T06:27:41.3839143Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T06:27:41.3840063Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 6s local 2025-03-14T06:27:41.3841066Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 5s local ... 2025-03-14T06:27:41.7260295Z 2025-03-14T06:27:41.7261153Z  2025-03-14T06:27:41.7261681Z  2025-03-14T06:27:41.7262105Z  2025-03-14T06:27:41.7262502Z  2025-03-14T06:27:41.7262910Z  2025-03-14T06:27:41.7263323Z  2025-03-14T06:27:41.7263725Z  2025-03-14T06:27:41.7264125Z  2025-03-14T06:27:41.7265079Z [12,750 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:41.7266863Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T06:27:41.7267819Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T06:27:41.7268869Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T06:27:41.7269860Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 16s local 2025-03-14T06:27:41.7270998Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local 2025-03-14T06:27:41.7271803Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T06:27:41.7272640Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 6s local 2025-03-14T06:27:41.7273606Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local ... 2025-03-14T06:27:41.9264408Z 2025-03-14T06:27:41.9265487Z  2025-03-14T06:27:41.9266039Z  2025-03-14T06:27:41.9266498Z  2025-03-14T06:27:41.9266927Z  2025-03-14T06:27:41.9267381Z  2025-03-14T06:27:41.9267823Z  2025-03-14T06:27:41.9268258Z  2025-03-14T06:27:41.9268680Z  2025-03-14T06:27:41.9269669Z [12,763 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:41.9271130Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T06:27:41.9272154Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T06:27:41.9273090Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T06:27:41.9274152Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 16s local 2025-03-14T06:27:41.9275416Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local 2025-03-14T06:27:41.9276237Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T06:27:41.9277093Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 6s local 2025-03-14T06:27:41.9278149Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local ... 2025-03-14T06:27:42.1321435Z 2025-03-14T06:27:42.1322328Z  2025-03-14T06:27:42.1322860Z  2025-03-14T06:27:42.1323279Z  2025-03-14T06:27:42.1323708Z  2025-03-14T06:27:42.1324117Z  2025-03-14T06:27:42.1324674Z  2025-03-14T06:27:42.1325115Z  2025-03-14T06:27:42.1325550Z  2025-03-14T06:27:42.1326502Z [12,782 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:42.1327753Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T06:27:42.1328735Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T06:27:42.1329666Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T06:27:42.1330721Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 16s local 2025-03-14T06:27:42.1331738Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 14s local 2025-03-14T06:27:42.1332572Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T06:27:42.1333444Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 7s local 2025-03-14T06:27:42.1334474Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local ... 2025-03-14T06:27:42.3426250Z 2025-03-14T06:27:42.3427094Z  2025-03-14T06:27:42.3427644Z  2025-03-14T06:27:42.3428145Z  2025-03-14T06:27:42.3428777Z  2025-03-14T06:27:42.3429208Z  2025-03-14T06:27:42.3429637Z  2025-03-14T06:27:42.3430065Z  2025-03-14T06:27:42.3430461Z  2025-03-14T06:27:42.3431465Z [12,790 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:42.3432741Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T06:27:42.3433787Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 38s local 2025-03-14T06:27:42.3434695Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T06:27:42.3435841Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local 2025-03-14T06:27:42.3437190Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2025-03-14T06:27:42.3438216Z Compiling src/cpu/x64/rnn/jit_diff_weights_peephole.cpp; 7s local 2025-03-14T06:27:42.3439270Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 6s local 2025-03-14T06:27:42.3440582Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 6s local ... 2025-03-14T06:27:42.5522839Z 2025-03-14T06:27:42.5523656Z  2025-03-14T06:27:42.5524158Z  2025-03-14T06:27:42.5524724Z  2025-03-14T06:27:42.5525425Z  2025-03-14T06:27:42.5525866Z  2025-03-14T06:27:42.5526288Z  2025-03-14T06:27:42.5526718Z  2025-03-14T06:27:42.5527152Z  2025-03-14T06:27:42.5528142Z [12,804 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:42.5529532Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T06:27:42.5530536Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:27:42.5531445Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 29s local 2025-03-14T06:27:42.5532459Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local 2025-03-14T06:27:42.5533646Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2025-03-14T06:27:42.5534575Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T06:27:42.5535621Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 6s local 2025-03-14T06:27:42.5536796Z Compiling src/graph/backend/dnnl/passes/insert_ops.cpp; 6s local ... 2025-03-14T06:27:42.7586995Z 2025-03-14T06:27:42.7590024Z  2025-03-14T06:27:42.7590624Z  2025-03-14T06:27:42.7590979Z  2025-03-14T06:27:42.7591379Z  2025-03-14T06:27:42.7591758Z  2025-03-14T06:27:42.7592161Z  2025-03-14T06:27:42.7592511Z  2025-03-14T06:27:42.7592842Z  2025-03-14T06:27:42.7593697Z [12,816 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:42.7594687Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T06:27:42.7595699Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:27:42.7596477Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T06:27:42.7597339Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local 2025-03-14T06:27:42.7598228Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2025-03-14T06:27:42.7599112Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T06:27:42.7600125Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 6s local 2025-03-14T06:27:42.7601238Z Compiling src/graph/backend/dnnl/passes/insert_ops.cpp; 6s local ... 2025-03-14T06:27:43.0058798Z 2025-03-14T06:27:43.0060041Z  2025-03-14T06:27:43.0060952Z  2025-03-14T06:27:43.0061706Z  2025-03-14T06:27:43.0062842Z  2025-03-14T06:27:43.0063422Z  2025-03-14T06:27:43.0063853Z  2025-03-14T06:27:43.0064289Z  2025-03-14T06:27:43.0064720Z  2025-03-14T06:27:43.0065980Z [12,830 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:43.0067266Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T06:27:43.0068368Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:27:43.0069322Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T06:27:43.0070416Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 17s local 2025-03-14T06:27:43.0071494Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2025-03-14T06:27:43.0072398Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T06:27:43.0073494Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 6s local 2025-03-14T06:27:43.0074673Z Compiling src/graph/backend/dnnl/passes/insert_ops.cpp; 6s local ... 2025-03-14T06:27:43.2535365Z 2025-03-14T06:27:43.2536703Z  2025-03-14T06:27:43.2538026Z  2025-03-14T06:27:43.2538638Z  2025-03-14T06:27:43.2539066Z  2025-03-14T06:27:43.2539461Z  2025-03-14T06:27:43.2540209Z  2025-03-14T06:27:43.2540666Z  2025-03-14T06:27:43.2541115Z  2025-03-14T06:27:43.2542258Z [12,838 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:43.2543744Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T06:27:43.2544882Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 39s local 2025-03-14T06:27:43.2545808Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T06:27:43.2546915Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2025-03-14T06:27:43.2547946Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 15s local 2025-03-14T06:27:43.2548862Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 7s local 2025-03-14T06:27:43.2549935Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 7s local 2025-03-14T06:27:43.2551138Z Compiling src/graph/backend/dnnl/passes/insert_ops.cpp; 6s local ... 2025-03-14T06:27:43.4554474Z 2025-03-14T06:27:43.4555404Z  2025-03-14T06:27:43.4555891Z  2025-03-14T06:27:43.4556291Z  2025-03-14T06:27:43.4556709Z  2025-03-14T06:27:43.4557128Z  2025-03-14T06:27:43.4557548Z  2025-03-14T06:27:43.4557978Z  2025-03-14T06:27:43.4558448Z  2025-03-14T06:27:43.4559686Z [12,846 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:43.4560991Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T06:27:43.4561954Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T06:27:43.4562860Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 30s local 2025-03-14T06:27:43.4563871Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2025-03-14T06:27:43.4565054Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2025-03-14T06:27:43.4566084Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2025-03-14T06:27:43.4566969Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 7s local 2025-03-14T06:27:43.4568000Z Compiling src/graph/backend/dnnl/passes/insert_ops.cpp; 7s local ... 2025-03-14T06:27:43.7277534Z 2025-03-14T06:27:43.7278377Z  2025-03-14T06:27:43.7278898Z  2025-03-14T06:27:43.7279332Z  2025-03-14T06:27:43.7279738Z  2025-03-14T06:27:43.7280175Z  2025-03-14T06:27:43.7280593Z  2025-03-14T06:27:43.7281012Z  2025-03-14T06:27:43.7281439Z  2025-03-14T06:27:43.7282403Z [12,865 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:43.7283563Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T06:27:43.7284727Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T06:27:43.7285647Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T06:27:43.7286667Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2025-03-14T06:27:43.7287673Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2025-03-14T06:27:43.7288562Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2025-03-14T06:27:43.7289570Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 7s local 2025-03-14T06:27:43.7290673Z Compiling src/graph/backend/dnnl/passes/insert_ops.cpp; 7s local ... 2025-03-14T06:27:43.9765925Z 2025-03-14T06:27:43.9766783Z  2025-03-14T06:27:43.9767297Z  2025-03-14T06:27:43.9767719Z  2025-03-14T06:27:43.9768126Z  2025-03-14T06:27:43.9768542Z  2025-03-14T06:27:43.9768962Z  2025-03-14T06:27:43.9769375Z  2025-03-14T06:27:43.9769788Z  2025-03-14T06:27:43.9771019Z [12,871 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:43.9772232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T06:27:43.9773243Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T06:27:43.9774336Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T06:27:43.9775350Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2025-03-14T06:27:43.9776471Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2025-03-14T06:27:43.9777424Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2025-03-14T06:27:43.9778644Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 7s local 2025-03-14T06:27:43.9779797Z Compiling src/graph/backend/dnnl/passes/lower.cpp; 7s local ... 2025-03-14T06:27:44.1834997Z 2025-03-14T06:27:44.1835831Z  2025-03-14T06:27:44.1836329Z  2025-03-14T06:27:44.1836801Z  2025-03-14T06:27:44.1837248Z  2025-03-14T06:27:44.1837661Z  2025-03-14T06:27:44.1838076Z  2025-03-14T06:27:44.1838526Z  2025-03-14T06:27:44.1838967Z  2025-03-14T06:27:44.1840172Z [12,884 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:44.1841487Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T06:27:44.1843225Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 40s local 2025-03-14T06:27:44.1844137Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T06:27:44.1845557Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 18s local 2025-03-14T06:27:44.1846564Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 16s local 2025-03-14T06:27:44.1847391Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2025-03-14T06:27:44.1848179Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 7s local 2025-03-14T06:27:44.1849286Z Compiling src/graph/backend/dnnl/passes/lower.cpp; 7s local ... 2025-03-14T06:27:44.3916913Z 2025-03-14T06:27:44.3917769Z  2025-03-14T06:27:44.3918259Z  2025-03-14T06:27:44.3918662Z  2025-03-14T06:27:44.3919094Z  2025-03-14T06:27:44.3919546Z  2025-03-14T06:27:44.3919955Z  2025-03-14T06:27:44.3920372Z  2025-03-14T06:27:44.3920797Z  2025-03-14T06:27:44.3921780Z [12,917 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:44.3923053Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T06:27:44.3924085Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T06:27:44.3925145Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T06:27:44.3926377Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2025-03-14T06:27:44.3927482Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2025-03-14T06:27:44.3928490Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 8s local 2025-03-14T06:27:44.3929636Z Compiling src/graph/backend/dnnl/kernels/large_partition.cpp; 8s local 2025-03-14T06:27:44.3930929Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 7s local ... 2025-03-14T06:27:44.6167533Z 2025-03-14T06:27:44.6168407Z  2025-03-14T06:27:44.6168924Z  2025-03-14T06:27:44.6169370Z  2025-03-14T06:27:44.6169773Z  2025-03-14T06:27:44.6170145Z  2025-03-14T06:27:44.6170586Z  2025-03-14T06:27:44.6170997Z  2025-03-14T06:27:44.6171375Z  2025-03-14T06:27:44.6172315Z [12,932 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:44.6173595Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T06:27:44.6174667Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T06:27:44.6175564Z Compiling src/cpu/x64/jit_brgemm_inner_product.cpp; 31s local 2025-03-14T06:27:44.6176826Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2025-03-14T06:27:44.6177795Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2025-03-14T06:27:44.6178713Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2025-03-14T06:27:44.6179889Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 8s local 2025-03-14T06:27:44.6181014Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 6s local ... 2025-03-14T06:27:44.9285881Z 2025-03-14T06:27:44.9286707Z  2025-03-14T06:27:44.9287205Z  2025-03-14T06:27:44.9287634Z  2025-03-14T06:27:44.9288022Z  2025-03-14T06:27:44.9288458Z  2025-03-14T06:27:44.9288880Z  2025-03-14T06:27:44.9289310Z  2025-03-14T06:27:44.9289728Z  2025-03-14T06:27:44.9290720Z [12,941 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:44.9292001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T06:27:44.9293029Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T06:27:44.9293939Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2025-03-14T06:27:44.9294969Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2025-03-14T06:27:44.9295865Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2025-03-14T06:27:44.9296848Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 8s local 2025-03-14T06:27:44.9298003Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 7s local 2025-03-14T06:27:44.9299171Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:27:45.1415621Z 2025-03-14T06:27:45.1416476Z  2025-03-14T06:27:45.1416958Z  2025-03-14T06:27:45.1417363Z  2025-03-14T06:27:45.1417759Z  2025-03-14T06:27:45.1418157Z  2025-03-14T06:27:45.1418538Z  2025-03-14T06:27:45.1418943Z  2025-03-14T06:27:45.1419353Z  2025-03-14T06:27:45.1420274Z [12,946 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:45.1421427Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T06:27:45.1422418Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 41s local 2025-03-14T06:27:45.1423314Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 19s local 2025-03-14T06:27:45.1424316Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 17s local 2025-03-14T06:27:45.1425115Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2025-03-14T06:27:45.1426003Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 8s local 2025-03-14T06:27:45.1426928Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 7s local 2025-03-14T06:27:45.1427741Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:27:45.4125994Z 2025-03-14T06:27:45.4126838Z  2025-03-14T06:27:45.4127335Z  2025-03-14T06:27:45.4127777Z  2025-03-14T06:27:45.4128199Z  2025-03-14T06:27:45.4128615Z  2025-03-14T06:27:45.4129019Z  2025-03-14T06:27:45.4129428Z  2025-03-14T06:27:45.4129837Z  2025-03-14T06:27:45.4130801Z [12,952 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:45.4131967Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T06:27:45.4133015Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T06:27:45.4133972Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2025-03-14T06:27:45.4134999Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2025-03-14T06:27:45.4135943Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 9s local 2025-03-14T06:27:45.4136946Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 8s local 2025-03-14T06:27:45.4138023Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 7s local 2025-03-14T06:27:45.4139265Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:27:45.6291130Z 2025-03-14T06:27:45.6292003Z  2025-03-14T06:27:45.6292448Z  2025-03-14T06:27:45.6292880Z  2025-03-14T06:27:45.6293304Z  2025-03-14T06:27:45.6294005Z  2025-03-14T06:27:45.6294419Z  2025-03-14T06:27:45.6294840Z  2025-03-14T06:27:45.6295274Z  2025-03-14T06:27:45.6296260Z [12,960 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:45.6297691Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:27:45.6298785Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T06:27:45.6299793Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2025-03-14T06:27:45.6300850Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2025-03-14T06:27:45.6301792Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T06:27:45.6302815Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 9s local 2025-03-14T06:27:45.6303950Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 7s local 2025-03-14T06:27:45.6304907Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:27:45.8420922Z 2025-03-14T06:27:45.8421791Z  2025-03-14T06:27:45.8422313Z  2025-03-14T06:27:45.8422743Z  2025-03-14T06:27:45.8423153Z  2025-03-14T06:27:45.8423582Z  2025-03-14T06:27:45.8424016Z  2025-03-14T06:27:45.8424448Z  2025-03-14T06:27:45.8424867Z  2025-03-14T06:27:45.8426083Z [12,974 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:45.8427315Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:27:45.8428389Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T06:27:45.8429403Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2025-03-14T06:27:45.8430487Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2025-03-14T06:27:45.8431475Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T06:27:45.8432552Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 9s local 2025-03-14T06:27:45.8433720Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 8s local 2025-03-14T06:27:45.8434691Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:27:46.0556495Z 2025-03-14T06:27:46.0557353Z  2025-03-14T06:27:46.0557914Z  2025-03-14T06:27:46.0558358Z  2025-03-14T06:27:46.0558784Z  2025-03-14T06:27:46.0559196Z  2025-03-14T06:27:46.0559633Z  2025-03-14T06:27:46.0560084Z  2025-03-14T06:27:46.0560486Z  2025-03-14T06:27:46.0561441Z [12,998 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:46.0562667Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:27:46.0563657Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T06:27:46.0564733Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 20s local 2025-03-14T06:27:46.0568254Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2025-03-14T06:27:46.0569194Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T06:27:46.0570170Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 9s local 2025-03-14T06:27:46.0571351Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 8s local 2025-03-14T06:27:46.0572276Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:27:46.2902730Z 2025-03-14T06:27:46.2903627Z  2025-03-14T06:27:46.2904142Z  2025-03-14T06:27:46.2904561Z  2025-03-14T06:27:46.2904944Z  2025-03-14T06:27:46.2905355Z  2025-03-14T06:27:46.2905791Z  2025-03-14T06:27:46.2906206Z  2025-03-14T06:27:46.2906600Z  2025-03-14T06:27:46.2907554Z [13,037 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:46.2909102Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:27:46.2910122Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 42s local 2025-03-14T06:27:46.2911376Z Compiling src/cpu/x64/jit_uni_tbb_batch_normalization.cpp; 21s local 2025-03-14T06:27:46.2912467Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 18s local 2025-03-14T06:27:46.2913752Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 10s local 2025-03-14T06:27:46.2914808Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 9s local 2025-03-14T06:27:46.2916017Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 8s local 2025-03-14T06:27:46.2917011Z @onednn//:onednn_autogen; 8s local ... 2025-03-14T06:27:46.4912517Z 2025-03-14T06:27:46.4913363Z  2025-03-14T06:27:46.4913888Z  2025-03-14T06:27:46.4914320Z  2025-03-14T06:27:46.4914730Z  2025-03-14T06:27:46.4915186Z  2025-03-14T06:27:46.4915588Z  2025-03-14T06:27:46.4916004Z  2025-03-14T06:27:46.4916386Z  2025-03-14T06:27:46.4917359Z [13,073 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:46.4918645Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:27:46.4919698Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:27:46.4920581Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T06:27:46.4921533Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T06:27:46.4922804Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 9s local 2025-03-14T06:27:46.4923964Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 8s local 2025-03-14T06:27:46.4925067Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:27:46.4925715Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:27:46.6943671Z 2025-03-14T06:27:46.6944552Z  2025-03-14T06:27:46.6945085Z  2025-03-14T06:27:46.6945501Z  2025-03-14T06:27:46.6945932Z  2025-03-14T06:27:46.6946371Z  2025-03-14T06:27:46.6946803Z  2025-03-14T06:27:46.6947233Z  2025-03-14T06:27:46.6947710Z  2025-03-14T06:27:46.6948693Z [13,106 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:46.6950181Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:27:46.6951299Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:27:46.6952243Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T06:27:46.6953231Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T06:27:46.6954304Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 10s local 2025-03-14T06:27:46.6955515Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 9s local 2025-03-14T06:27:46.6956485Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:27:46.6957148Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:27:46.9009901Z 2025-03-14T06:27:46.9010799Z  2025-03-14T06:27:46.9011386Z  2025-03-14T06:27:46.9011916Z  2025-03-14T06:27:46.9012469Z  2025-03-14T06:27:46.9013050Z  2025-03-14T06:27:46.9013419Z  2025-03-14T06:27:46.9013765Z  2025-03-14T06:27:46.9014114Z  2025-03-14T06:27:46.9015022Z [13,141 / 20,650] 3 / 17 tests; 48 actions, 46 running; last test: ...ash_test 2025-03-14T06:27:46.9016259Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:27:46.9017225Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:27:46.9017956Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T06:27:46.9018823Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T06:27:46.9019775Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 10s local 2025-03-14T06:27:46.9021141Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 9s local 2025-03-14T06:27:46.9022011Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:46.9022594Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:27:47.1079701Z 2025-03-14T06:27:47.1080558Z  2025-03-14T06:27:47.1081064Z  2025-03-14T06:27:47.1081473Z  2025-03-14T06:27:47.1081858Z  2025-03-14T06:27:47.1082238Z  2025-03-14T06:27:47.1082583Z  2025-03-14T06:27:47.1083198Z  2025-03-14T06:27:47.1083609Z  2025-03-14T06:27:47.1084685Z [13,173 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:47.1085875Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:27:47.1086787Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:27:47.1087698Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 19s local 2025-03-14T06:27:47.1088505Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T06:27:47.1089346Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 10s local 2025-03-14T06:27:47.1090324Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 9s local 2025-03-14T06:27:47.1091162Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:47.1091717Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:27:47.3131695Z 2025-03-14T06:27:47.3132501Z  2025-03-14T06:27:47.3132991Z  2025-03-14T06:27:47.3133431Z  2025-03-14T06:27:47.3133843Z  2025-03-14T06:27:47.3134268Z  2025-03-14T06:27:47.3134660Z  2025-03-14T06:27:47.3135068Z  2025-03-14T06:27:47.3135740Z  2025-03-14T06:27:47.3136719Z [13,227 / 20,650] 3 / 17 tests; 48 actions, 46 running; last test: ...ash_test 2025-03-14T06:27:47.3137923Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:27:47.3138923Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 43s local 2025-03-14T06:27:47.3139768Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T06:27:47.3140664Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 11s local 2025-03-14T06:27:47.3141606Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 10s local 2025-03-14T06:27:47.3143425Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 9s local 2025-03-14T06:27:47.3144313Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:47.3144889Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:27:47.5301477Z 2025-03-14T06:27:47.5302309Z  2025-03-14T06:27:47.5302834Z  2025-03-14T06:27:47.5303274Z  2025-03-14T06:27:47.5303732Z  2025-03-14T06:27:47.5304165Z  2025-03-14T06:27:47.5304580Z  2025-03-14T06:27:47.5305002Z  2025-03-14T06:27:47.5305428Z  2025-03-14T06:27:47.5306435Z [13,345 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:47.5307717Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:27:47.5308785Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T06:27:47.5309604Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T06:27:47.5310557Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2025-03-14T06:27:47.5311567Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 10s local 2025-03-14T06:27:47.5312720Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 9s local 2025-03-14T06:27:47.5313688Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:47.5314330Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:27:47.7306223Z 2025-03-14T06:27:47.7307066Z  2025-03-14T06:27:47.7307569Z  2025-03-14T06:27:47.7308005Z  2025-03-14T06:27:47.7308447Z  2025-03-14T06:27:47.7308884Z  2025-03-14T06:27:47.7309312Z  2025-03-14T06:27:47.7309734Z  2025-03-14T06:27:47.7310451Z  2025-03-14T06:27:47.7311472Z [13,348 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:47.7312722Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T06:27:47.7313917Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T06:27:47.7314793Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T06:27:47.7315746Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2025-03-14T06:27:47.7316935Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 11s local 2025-03-14T06:27:47.7318009Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 10s local 2025-03-14T06:27:47.7318907Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:27:47.7319449Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:27:48.0961154Z 2025-03-14T06:27:48.0962029Z  2025-03-14T06:27:48.0962543Z  2025-03-14T06:27:48.0962992Z  2025-03-14T06:27:48.0963442Z  2025-03-14T06:27:48.0963889Z  2025-03-14T06:27:48.0964336Z  2025-03-14T06:27:48.0964890Z  2025-03-14T06:27:48.0965602Z  2025-03-14T06:27:48.0966626Z [13,350 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:48.0967906Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T06:27:48.0968974Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T06:27:48.0969904Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 20s local 2025-03-14T06:27:48.0970889Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2025-03-14T06:27:48.0972196Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 11s local 2025-03-14T06:27:48.0973317Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 10s local 2025-03-14T06:27:48.0974272Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:48.0974887Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:27:48.3310689Z 2025-03-14T06:27:48.3311496Z  2025-03-14T06:27:48.3311916Z  2025-03-14T06:27:48.3312260Z  2025-03-14T06:27:48.3312607Z  2025-03-14T06:27:48.3312951Z  2025-03-14T06:27:48.3313339Z  2025-03-14T06:27:48.3313770Z  2025-03-14T06:27:48.3314117Z  2025-03-14T06:27:48.3314987Z [13,353 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:48.3316213Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T06:27:48.3317201Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 44s local 2025-03-14T06:27:48.3318052Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T06:27:48.3318921Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 12s local 2025-03-14T06:27:48.3320172Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 11s local 2025-03-14T06:27:48.3321256Z Compiling src/graph/backend/dnnl/patterns/concat_fusion.cpp; 10s local 2025-03-14T06:27:48.3322152Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:48.3322658Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:27:48.5315356Z 2025-03-14T06:27:48.5316225Z  2025-03-14T06:27:48.5316729Z  2025-03-14T06:27:48.5317202Z  2025-03-14T06:27:48.5317628Z  2025-03-14T06:27:48.5318074Z  2025-03-14T06:27:48.5318509Z  2025-03-14T06:27:48.5318935Z  2025-03-14T06:27:48.5319371Z  2025-03-14T06:27:48.5320397Z [13,360 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:48.5321671Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T06:27:48.5322691Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T06:27:48.5323590Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T06:27:48.5324654Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T06:27:48.5325993Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 11s local 2025-03-14T06:27:48.5326843Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:48.5327478Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:27:48.5328043Z @onednn//:mkl_dnn; 9s local ... 2025-03-14T06:27:48.7571282Z 2025-03-14T06:27:48.7572138Z  2025-03-14T06:27:48.7572643Z  2025-03-14T06:27:48.7573066Z  2025-03-14T06:27:48.7573485Z  2025-03-14T06:27:48.7573915Z  2025-03-14T06:27:48.7574332Z  2025-03-14T06:27:48.7575029Z  2025-03-14T06:27:48.7575478Z  2025-03-14T06:27:48.7576459Z [13,362 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:48.7577693Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T06:27:48.7578741Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T06:27:48.7579603Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T06:27:48.7580562Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T06:27:48.7581553Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local 2025-03-14T06:27:48.7582425Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:27:48.7583045Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:27:48.7583619Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:27:49.1322994Z 2025-03-14T06:27:49.1323846Z  2025-03-14T06:27:49.1324378Z  2025-03-14T06:27:49.1324963Z  2025-03-14T06:27:49.1325446Z  2025-03-14T06:27:49.1325878Z  2025-03-14T06:27:49.1326308Z  2025-03-14T06:27:49.1326736Z  2025-03-14T06:27:49.1327287Z  2025-03-14T06:27:49.1328540Z [13,366 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:49.1330199Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T06:27:49.1331196Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T06:27:49.1332180Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 21s local 2025-03-14T06:27:49.1333090Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T06:27:49.1334044Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local 2025-03-14T06:27:49.1334990Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:49.1335561Z @onednn//:mkl_dnn; 10s local 2025-03-14T06:27:49.1336152Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:27:49.3326713Z 2025-03-14T06:27:49.3327629Z  2025-03-14T06:27:49.3328134Z  2025-03-14T06:27:49.3328545Z  2025-03-14T06:27:49.3328931Z  2025-03-14T06:27:49.3329281Z  2025-03-14T06:27:49.3329706Z  2025-03-14T06:27:49.3330106Z  2025-03-14T06:27:49.3330498Z  2025-03-14T06:27:49.3331463Z [13,368 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:49.3332676Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T06:27:49.3333679Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 45s local 2025-03-14T06:27:49.3334575Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T06:27:49.3335440Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 13s local 2025-03-14T06:27:49.3336383Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local 2025-03-14T06:27:49.3337195Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:27:49.3337782Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:27:49.3338301Z @onednn//:mkl_dnn; 10s local ... 2025-03-14T06:27:49.5408331Z 2025-03-14T06:27:49.5409163Z  2025-03-14T06:27:49.5409651Z  2025-03-14T06:27:49.5410075Z  2025-03-14T06:27:49.5410494Z  2025-03-14T06:27:49.5410898Z  2025-03-14T06:27:49.5411295Z  2025-03-14T06:27:49.5411709Z  2025-03-14T06:27:49.5412111Z  2025-03-14T06:27:49.5413031Z [13,374 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:49.5414522Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2025-03-14T06:27:49.5415515Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T06:27:49.5416396Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T06:27:49.5417530Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2025-03-14T06:27:49.5418543Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 12s local 2025-03-14T06:27:49.5419505Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:27:49.5420354Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 10s local 2025-03-14T06:27:49.5421255Z @onednn//:mkl_dnn; 8s local ... 2025-03-14T06:27:49.9275372Z 2025-03-14T06:27:49.9276251Z  2025-03-14T06:27:49.9276769Z  2025-03-14T06:27:49.9277176Z  2025-03-14T06:27:49.9277615Z  2025-03-14T06:27:49.9277982Z  2025-03-14T06:27:49.9278366Z  2025-03-14T06:27:49.9278796Z  2025-03-14T06:27:49.9279196Z  2025-03-14T06:27:49.9280116Z [13,380 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:49.9281172Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T06:27:49.9282037Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T06:27:49.9282960Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2025-03-14T06:27:49.9284005Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local 2025-03-14T06:27:49.9285002Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:27:49.9286148Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 11s local 2025-03-14T06:27:49.9287457Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 8s local 2025-03-14T06:27:49.9288741Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 7s local ... 2025-03-14T06:27:50.1294900Z 2025-03-14T06:27:50.1295805Z  2025-03-14T06:27:50.1296312Z  2025-03-14T06:27:50.1296722Z  2025-03-14T06:27:50.1297136Z  2025-03-14T06:27:50.1297561Z  2025-03-14T06:27:50.1297977Z  2025-03-14T06:27:50.1298387Z  2025-03-14T06:27:50.1298805Z  2025-03-14T06:27:50.1299805Z [13,386 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:50.1300811Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T06:27:50.1301675Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 22s local 2025-03-14T06:27:50.1302539Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2025-03-14T06:27:50.1303524Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local 2025-03-14T06:27:50.1304335Z @onednn//:mkl_dnn; 11s local 2025-03-14T06:27:50.1305207Z Compiling src/graph/backend/dnnl/patterns/layernorm_fusion.cpp; 11s local 2025-03-14T06:27:50.1306418Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 8s local 2025-03-14T06:27:50.1307658Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 7s local ... 2025-03-14T06:27:50.3333872Z 2025-03-14T06:27:50.3334744Z  2025-03-14T06:27:50.3335441Z  2025-03-14T06:27:50.3335880Z  2025-03-14T06:27:50.3336337Z  2025-03-14T06:27:50.3336758Z  2025-03-14T06:27:50.3337179Z  2025-03-14T06:27:50.3337605Z  2025-03-14T06:27:50.3338031Z  2025-03-14T06:27:50.3339001Z [13,390 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:50.3340076Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 46s local 2025-03-14T06:27:50.3340974Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T06:27:50.3341830Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 14s local 2025-03-14T06:27:50.3343511Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local 2025-03-14T06:27:50.3344386Z @onednn//:mkl_dnn; 12s local 2025-03-14T06:27:50.3345533Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 9s local 2025-03-14T06:27:50.3346730Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 7s local 2025-03-14T06:27:50.3347898Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 6s local ... 2025-03-14T06:27:50.5390131Z 2025-03-14T06:27:50.5391059Z  2025-03-14T06:27:50.5391608Z  2025-03-14T06:27:50.5392046Z  2025-03-14T06:27:50.5392542Z  2025-03-14T06:27:50.5392965Z  2025-03-14T06:27:50.5393733Z  2025-03-14T06:27:50.5394233Z  2025-03-14T06:27:50.5394667Z  2025-03-14T06:27:50.5395686Z [13,393 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:50.5396782Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T06:27:50.5397667Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T06:27:50.5398604Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T06:27:50.5399643Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 13s local 2025-03-14T06:27:50.5400766Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 9s local 2025-03-14T06:27:50.5402006Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 8s local 2025-03-14T06:27:50.5403208Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 6s local 2025-03-14T06:27:50.5404213Z Compiling src/graph/interface/graph.cpp; 6s local ... 2025-03-14T06:27:50.8239634Z 2025-03-14T06:27:50.8240492Z  2025-03-14T06:27:50.8240997Z  2025-03-14T06:27:50.8241418Z  2025-03-14T06:27:50.8241844Z  2025-03-14T06:27:50.8242540Z  2025-03-14T06:27:50.8243770Z  2025-03-14T06:27:50.8244204Z  2025-03-14T06:27:50.8244708Z  2025-03-14T06:27:50.8245688Z [13,398 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:50.8246745Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T06:27:50.8247626Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T06:27:50.8248564Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T06:27:50.8249592Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 14s local 2025-03-14T06:27:50.8250791Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 9s local 2025-03-14T06:27:50.8252009Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 8s local 2025-03-14T06:27:50.8253159Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 7s local 2025-03-14T06:27:50.8254197Z Compiling src/graph/interface/graph.cpp; 6s local ... 2025-03-14T06:27:51.0316037Z 2025-03-14T06:27:51.0316942Z  2025-03-14T06:27:51.0317441Z  2025-03-14T06:27:51.0317846Z  2025-03-14T06:27:51.0318253Z  2025-03-14T06:27:51.0318645Z  2025-03-14T06:27:51.0319066Z  2025-03-14T06:27:51.0319515Z  2025-03-14T06:27:51.0319983Z  2025-03-14T06:27:51.0321010Z [13,403 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:51.0322123Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T06:27:51.0322976Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T06:27:51.0323915Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T06:27:51.0325151Z Compiling src/graph/backend/dnnl/passes/transform.cpp; 14s local 2025-03-14T06:27:51.0326464Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 9s local 2025-03-14T06:27:51.0327646Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 8s local 2025-03-14T06:27:51.0328953Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 7s local 2025-03-14T06:27:51.0329904Z Compiling src/graph/interface/graph.cpp; 6s local ... 2025-03-14T06:27:51.2799877Z 2025-03-14T06:27:51.2800722Z  2025-03-14T06:27:51.2801246Z  2025-03-14T06:27:51.2801949Z  2025-03-14T06:27:51.2802374Z  2025-03-14T06:27:51.2802782Z  2025-03-14T06:27:51.2803206Z  2025-03-14T06:27:51.2803631Z  2025-03-14T06:27:51.2804057Z  2025-03-14T06:27:51.2805164Z [13,405 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:51.2806388Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 47s local 2025-03-14T06:27:51.2807421Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 23s local 2025-03-14T06:27:51.2808609Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T06:27:51.2809725Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2025-03-14T06:27:51.2810937Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 8s local 2025-03-14T06:27:51.2811997Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 7s local 2025-03-14T06:27:51.2812909Z Compiling src/graph/interface/graph.cpp; 6s local 2025-03-14T06:27:51.2813864Z Compiling src/graph/interface/op_schema.cpp; 6s local ... 2025-03-14T06:27:51.5345449Z 2025-03-14T06:27:51.5346332Z  2025-03-14T06:27:51.5346787Z  2025-03-14T06:27:51.5347196Z  2025-03-14T06:27:51.5347595Z  2025-03-14T06:27:51.5348037Z  2025-03-14T06:27:51.5348405Z  2025-03-14T06:27:51.5348845Z  2025-03-14T06:27:51.5349295Z  2025-03-14T06:27:51.5350291Z [13,409 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:51.5351331Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T06:27:51.5352460Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T06:27:51.5353401Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:27:51.5354466Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2025-03-14T06:27:51.5355636Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 9s local 2025-03-14T06:27:51.5356812Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 7s local 2025-03-14T06:27:51.5357768Z Compiling src/graph/interface/graph.cpp; 7s local 2025-03-14T06:27:51.5358661Z Compiling src/graph/interface/op_schema.cpp; 6s local ... 2025-03-14T06:27:51.7348073Z 2025-03-14T06:27:51.7348979Z  2025-03-14T06:27:51.7349569Z  2025-03-14T06:27:51.7350001Z  2025-03-14T06:27:51.7350411Z  2025-03-14T06:27:51.7350803Z  2025-03-14T06:27:51.7351213Z  2025-03-14T06:27:51.7351713Z  2025-03-14T06:27:51.7352173Z  2025-03-14T06:27:51.7353208Z [13,415 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:51.7354307Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T06:27:51.7355216Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T06:27:51.7356149Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:27:51.7357298Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2025-03-14T06:27:51.7358479Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 9s local 2025-03-14T06:27:51.7359656Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 7s local 2025-03-14T06:27:51.7360660Z Compiling src/graph/interface/graph.cpp; 7s local 2025-03-14T06:27:51.7361560Z Compiling src/graph/interface/op_schema.cpp; 7s local ... 2025-03-14T06:27:52.0847918Z 2025-03-14T06:27:52.0848736Z  2025-03-14T06:27:52.0849291Z  2025-03-14T06:27:52.0849736Z  2025-03-14T06:27:52.0850169Z  2025-03-14T06:27:52.0850595Z  2025-03-14T06:27:52.0851034Z  2025-03-14T06:27:52.0851469Z  2025-03-14T06:27:52.0851894Z  2025-03-14T06:27:52.0852877Z [13,418 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:52.0853914Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T06:27:52.0855023Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 24s local 2025-03-14T06:27:52.0855930Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:27:52.0857021Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 10s local 2025-03-14T06:27:52.0858392Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 9s local 2025-03-14T06:27:52.0859531Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 8s local 2025-03-14T06:27:52.0860631Z Compiling src/graph/interface/graph.cpp; 7s local 2025-03-14T06:27:52.0861507Z Compiling src/graph/interface/op_schema.cpp; 7s local ... 2025-03-14T06:27:52.2994454Z 2025-03-14T06:27:52.2995341Z  2025-03-14T06:27:52.2995840Z  2025-03-14T06:27:52.2996232Z  2025-03-14T06:27:52.2996682Z  2025-03-14T06:27:52.2997202Z  2025-03-14T06:27:52.2997613Z  2025-03-14T06:27:52.2998010Z  2025-03-14T06:27:52.2998460Z  2025-03-14T06:27:52.2999529Z [13,422 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:52.3000648Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 48s local 2025-03-14T06:27:52.3001579Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2025-03-14T06:27:52.3002580Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:27:52.3003935Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2025-03-14T06:27:52.3005484Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 9s local 2025-03-14T06:27:52.3006716Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 8s local 2025-03-14T06:27:52.3007975Z Compiling src/graph/interface/graph.cpp; 7s local 2025-03-14T06:27:52.3008923Z Compiling src/graph/interface/op_schema.cpp; 7s local ... 2025-03-14T06:27:52.5088640Z 2025-03-14T06:27:52.5089551Z  2025-03-14T06:27:52.5090095Z  2025-03-14T06:27:52.5090669Z  2025-03-14T06:27:52.5091096Z  2025-03-14T06:27:52.5091512Z  2025-03-14T06:27:52.5091903Z  2025-03-14T06:27:52.5092301Z  2025-03-14T06:27:52.5092719Z  2025-03-14T06:27:52.5093858Z [13,427 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:52.5094896Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:27:52.5095770Z Compiling src/cpu/x64/matmul/brgemm_matmul.cpp; 25s local 2025-03-14T06:27:52.5096720Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:27:52.5097809Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2025-03-14T06:27:52.5098943Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 10s local 2025-03-14T06:27:52.5100077Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 8s local 2025-03-14T06:27:52.5100991Z Compiling src/graph/interface/graph.cpp; 8s local 2025-03-14T06:27:52.5101858Z Compiling src/graph/interface/op_schema.cpp; 7s local ... 2025-03-14T06:27:52.7355925Z 2025-03-14T06:27:52.7356769Z  2025-03-14T06:27:52.7357262Z  2025-03-14T06:27:52.7357704Z  2025-03-14T06:27:52.7358133Z  2025-03-14T06:27:52.7358566Z  2025-03-14T06:27:52.7359015Z  2025-03-14T06:27:52.7359435Z  2025-03-14T06:27:52.7359859Z  2025-03-14T06:27:52.7360833Z [13,431 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:52.7361938Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:27:52.7362801Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:27:52.7363894Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2025-03-14T06:27:52.7365504Z Compiling src/graph/backend/dnnl/patterns/shuffle_fusion.cpp; 10s local 2025-03-14T06:27:52.7366721Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 8s local 2025-03-14T06:27:52.7368049Z Compiling src/graph/interface/graph.cpp; 8s local 2025-03-14T06:27:52.7368863Z Compiling src/graph/interface/op_schema.cpp; 8s local 2025-03-14T06:27:52.7369777Z Compiling src/graph/interface/partition.cpp; 6s local ... 2025-03-14T06:27:52.9601779Z 2025-03-14T06:27:52.9603013Z  2025-03-14T06:27:52.9603550Z  2025-03-14T06:27:52.9604011Z  2025-03-14T06:27:52.9604615Z  2025-03-14T06:27:52.9605053Z  2025-03-14T06:27:52.9605506Z  2025-03-14T06:27:52.9605874Z  2025-03-14T06:27:52.9606434Z  2025-03-14T06:27:52.9607393Z [13,437 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:52.9608402Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:27:52.9609264Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:27:52.9610327Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2025-03-14T06:27:52.9611465Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 9s local 2025-03-14T06:27:52.9612412Z Compiling src/graph/interface/graph.cpp; 8s local 2025-03-14T06:27:52.9613181Z Compiling src/graph/interface/op_schema.cpp; 8s local 2025-03-14T06:27:52.9613999Z Compiling src/graph/interface/partition.cpp; 6s local 2025-03-14T06:27:52.9614815Z Compiling src/crypto/fipsmodule/bcm.c; 6s local ... 2025-03-14T06:27:53.1622204Z 2025-03-14T06:27:53.1623316Z  2025-03-14T06:27:53.1624175Z  2025-03-14T06:27:53.1624996Z  2025-03-14T06:27:53.1625702Z  2025-03-14T06:27:53.1626170Z  2025-03-14T06:27:53.1626635Z  2025-03-14T06:27:53.1627098Z  2025-03-14T06:27:53.1627822Z  2025-03-14T06:27:53.1628782Z [13,443 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:53.1630088Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:27:53.1630902Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:27:53.1631947Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 11s local 2025-03-14T06:27:53.1633065Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 9s local 2025-03-14T06:27:53.1633965Z Compiling src/graph/interface/graph.cpp; 8s local 2025-03-14T06:27:53.1634766Z Compiling src/graph/interface/op_schema.cpp; 8s local 2025-03-14T06:27:53.1635558Z Compiling src/graph/interface/partition.cpp; 6s local 2025-03-14T06:27:53.1636250Z Compiling src/crypto/fipsmodule/bcm.c; 6s local ... 2025-03-14T06:27:53.3703084Z 2025-03-14T06:27:53.3704186Z  2025-03-14T06:27:53.3704842Z  2025-03-14T06:27:53.3705512Z  2025-03-14T06:27:53.3706152Z  2025-03-14T06:27:53.3706614Z  2025-03-14T06:27:53.3707073Z  2025-03-14T06:27:53.3707520Z  2025-03-14T06:27:53.3707975Z  2025-03-14T06:27:53.3708959Z [13,450 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:53.3710003Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 49s local 2025-03-14T06:27:53.3710876Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:27:53.3711980Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2025-03-14T06:27:53.3713202Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 9s local 2025-03-14T06:27:53.3714208Z Compiling src/graph/interface/graph.cpp; 8s local 2025-03-14T06:27:53.3715054Z Compiling src/graph/interface/op_schema.cpp; 8s local 2025-03-14T06:27:53.3715934Z Compiling src/graph/interface/partition.cpp; 7s local 2025-03-14T06:27:53.5969224Z Compiling src/crypto/fipsmodule/bcm.c; 6s local ... 2025-03-14T06:27:53.5969931Z 2025-03-14T06:27:53.5970551Z  2025-03-14T06:27:53.5971036Z  2025-03-14T06:27:53.5971479Z  2025-03-14T06:27:53.5971855Z  2025-03-14T06:27:53.5972240Z  2025-03-14T06:27:53.5972614Z  2025-03-14T06:27:53.5973232Z  2025-03-14T06:27:53.5973645Z  2025-03-14T06:27:53.5974527Z [13,454 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:53.5975503Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T06:27:53.5976537Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T06:27:53.5977649Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2025-03-14T06:27:53.5979186Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 9s local 2025-03-14T06:27:53.5980159Z Compiling src/graph/interface/graph.cpp; 9s local 2025-03-14T06:27:53.5981014Z Compiling src/graph/interface/op_schema.cpp; 8s local 2025-03-14T06:27:53.5982365Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T06:27:53.5983332Z Compiling .../cpu/runtime_single_threaded_matmul_c64.cc; 6s local ... 2025-03-14T06:27:53.8550580Z 2025-03-14T06:27:53.8552020Z  2025-03-14T06:27:53.8552862Z  2025-03-14T06:27:53.8553502Z  2025-03-14T06:27:53.8553924Z  2025-03-14T06:27:53.8554368Z  2025-03-14T06:27:53.8554812Z  2025-03-14T06:27:53.8555241Z  2025-03-14T06:27:53.8555683Z  2025-03-14T06:27:53.8556586Z [13,458 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:53.8557476Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T06:27:53.8558310Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T06:27:53.8559356Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2025-03-14T06:27:53.8560721Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 10s local 2025-03-14T06:27:53.8561746Z Compiling src/graph/interface/op_schema.cpp; 9s local 2025-03-14T06:27:53.8562588Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T06:27:53.8563482Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 6s local 2025-03-14T06:27:53.8564719Z Compiling .../cpu/runtime_single_threaded_matmul_c128.cc; 6s local ... 2025-03-14T06:27:54.1361688Z 2025-03-14T06:27:54.1362924Z  2025-03-14T06:27:54.1363479Z  2025-03-14T06:27:54.1363947Z  2025-03-14T06:27:54.1364415Z  2025-03-14T06:27:54.1364997Z  2025-03-14T06:27:54.1365653Z  2025-03-14T06:27:54.1366091Z  2025-03-14T06:27:54.1366491Z  2025-03-14T06:27:54.1367518Z [13,464 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:54.1368618Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T06:27:54.1369537Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T06:27:54.1370658Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 12s local 2025-03-14T06:27:54.1371869Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 10s local 2025-03-14T06:27:54.1372848Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T06:27:54.1373859Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 6s local 2025-03-14T06:27:54.1375092Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2025-03-14T06:27:54.1376443Z Compiling .../cpu/runtime_single_threaded_matmul_f32.cc; 6s local ... 2025-03-14T06:27:54.3429242Z 2025-03-14T06:27:54.3430126Z  2025-03-14T06:27:54.3430661Z  2025-03-14T06:27:54.3431070Z  2025-03-14T06:27:54.3431483Z  2025-03-14T06:27:54.3431952Z  2025-03-14T06:27:54.3432353Z  2025-03-14T06:27:54.3432777Z  2025-03-14T06:27:54.3433204Z  2025-03-14T06:27:54.3434199Z [13,467 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:54.3435259Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 50s local 2025-03-14T06:27:54.3436226Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T06:27:54.3437355Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 13s local 2025-03-14T06:27:54.3438820Z Compiling src/graph/backend/dnnl/patterns/sum_fusion.cpp; 10s local 2025-03-14T06:27:54.3439782Z Compiling src/crypto/fipsmodule/bcm.c; 7s local 2025-03-14T06:27:54.3440752Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 6s local 2025-03-14T06:27:54.3442152Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 6s local 2025-03-14T06:27:54.3443358Z Compiling .../cpu/runtime_single_threaded_matmul_f32.cc; 6s local ... 2025-03-14T06:27:54.5636848Z 2025-03-14T06:27:54.5638888Z  2025-03-14T06:27:54.5639405Z  2025-03-14T06:27:54.5639817Z  2025-03-14T06:27:54.5640268Z  2025-03-14T06:27:54.5640685Z  2025-03-14T06:27:54.5641115Z  2025-03-14T06:27:54.5641524Z  2025-03-14T06:27:54.5641948Z  2025-03-14T06:27:54.5642930Z [13,470 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:54.5643808Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T06:27:54.5644743Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T06:27:54.5645839Z Compiling src/graph/backend/dnnl/patterns/matmul_post_ops.cpp; 13s local 2025-03-14T06:27:54.5646874Z Compiling src/crypto/fipsmodule/bcm.c; 8s local 2025-03-14T06:27:54.5647845Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2025-03-14T06:27:54.5649054Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 7s local 2025-03-14T06:27:54.5650283Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2025-03-14T06:27:54.5651758Z Compiling .../cpu/runtime_single_threaded_matmul_f16.cc; 7s local ... 2025-03-14T06:27:54.7801320Z 2025-03-14T06:27:54.7802257Z  2025-03-14T06:27:54.7802828Z  2025-03-14T06:27:54.7803292Z  2025-03-14T06:27:54.7803744Z  2025-03-14T06:27:54.7804151Z  2025-03-14T06:27:54.7804763Z  2025-03-14T06:27:54.7805172Z  2025-03-14T06:27:54.7805582Z  2025-03-14T06:27:54.7806520Z [13,476 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:54.7807546Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T06:27:54.7808419Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T06:27:54.7809222Z Compiling src/crypto/fipsmodule/bcm.c; 8s local 2025-03-14T06:27:54.7810236Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2025-03-14T06:27:54.7811468Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c128.cc; 7s local 2025-03-14T06:27:54.7812698Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2025-03-14T06:27:54.7813882Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2025-03-14T06:27:54.7815012Z Compiling .../cpu/runtime_single_threaded_matmul_f8.cc; 7s local ... 2025-03-14T06:27:55.0027770Z 2025-03-14T06:27:55.0028636Z  2025-03-14T06:27:55.0029204Z  2025-03-14T06:27:55.0029674Z  2025-03-14T06:27:55.0030139Z  2025-03-14T06:27:55.0030572Z  2025-03-14T06:27:55.0030945Z  2025-03-14T06:27:55.0031381Z  2025-03-14T06:27:55.0031786Z  2025-03-14T06:27:55.0032735Z [13,479 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:55.0033755Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T06:27:55.0034667Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T06:27:55.0035423Z Compiling src/crypto/fipsmodule/bcm.c; 8s local 2025-03-14T06:27:55.0036395Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2025-03-14T06:27:55.0037528Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2025-03-14T06:27:55.0038699Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2025-03-14T06:27:55.0040107Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2025-03-14T06:27:55.0041184Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 7s local ... 2025-03-14T06:27:55.3047309Z 2025-03-14T06:27:55.3048427Z  2025-03-14T06:27:55.3048951Z  2025-03-14T06:27:55.3049346Z  2025-03-14T06:27:55.3049758Z  2025-03-14T06:27:55.3050177Z  2025-03-14T06:27:55.3050569Z  2025-03-14T06:27:55.3050954Z  2025-03-14T06:27:55.3051538Z  2025-03-14T06:27:55.3052495Z [13,488 / 20,650] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2025-03-14T06:27:55.3053531Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 51s local 2025-03-14T06:27:55.3054375Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T06:27:55.3055191Z Compiling src/crypto/fipsmodule/bcm.c; 8s local 2025-03-14T06:27:55.3056101Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 7s local 2025-03-14T06:27:55.3057213Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 7s local 2025-03-14T06:27:55.3058326Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 7s local 2025-03-14T06:27:55.3059409Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 7s local 2025-03-14T06:27:55.3060483Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 7s local ... 2025-03-14T06:27:55.5377188Z 2025-03-14T06:27:55.5378001Z  2025-03-14T06:27:55.5378451Z  2025-03-14T06:27:55.5378803Z  2025-03-14T06:27:55.5379165Z  2025-03-14T06:27:55.5379516Z  2025-03-14T06:27:55.5380077Z  2025-03-14T06:27:55.5380440Z  2025-03-14T06:27:55.5380787Z  2025-03-14T06:27:55.5381643Z [13,490 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:55.5382523Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T06:27:55.5383274Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T06:27:55.5383991Z Compiling src/crypto/fipsmodule/bcm.c; 9s local 2025-03-14T06:27:55.5384807Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2025-03-14T06:27:55.5385820Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f32.cc; 8s local 2025-03-14T06:27:55.5386824Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2025-03-14T06:27:55.5387824Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2025-03-14T06:27:55.5388760Z Compiling .../cpu/runtime_single_threaded_matmul_s32.cc; 8s local ... 2025-03-14T06:27:55.7525696Z 2025-03-14T06:27:55.7526566Z  2025-03-14T06:27:55.7527077Z  2025-03-14T06:27:55.7527476Z  2025-03-14T06:27:55.7527898Z  2025-03-14T06:27:55.7528286Z  2025-03-14T06:27:55.7528674Z  2025-03-14T06:27:55.7529077Z  2025-03-14T06:27:55.7529503Z  2025-03-14T06:27:55.7530459Z [13,495 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:55.7531488Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T06:27:55.7532353Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T06:27:55.7533224Z Compiling src/crypto/fipsmodule/bcm.c; 9s local 2025-03-14T06:27:55.7534209Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2025-03-14T06:27:55.7535391Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2025-03-14T06:27:55.7536547Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2025-03-14T06:27:55.7537635Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2025-03-14T06:27:55.7538548Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:27:55.9573783Z 2025-03-14T06:27:55.9574618Z  2025-03-14T06:27:55.9575134Z  2025-03-14T06:27:55.9575820Z  2025-03-14T06:27:55.9576246Z  2025-03-14T06:27:55.9576680Z  2025-03-14T06:27:55.9577116Z  2025-03-14T06:27:55.9577542Z  2025-03-14T06:27:55.9577956Z  2025-03-14T06:27:55.9578982Z [13,501 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:55.9580203Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T06:27:55.9581137Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T06:27:55.9582152Z Compiling src/crypto/fipsmodule/bcm.c; 9s local 2025-03-14T06:27:55.9583196Z Compiling xla/service/cpu/runtime_single_threaded_matmul_c64.cc; 8s local 2025-03-14T06:27:55.9584618Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2025-03-14T06:27:55.9585924Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2025-03-14T06:27:55.9587412Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2025-03-14T06:27:55.9588421Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:27:56.1648601Z 2025-03-14T06:27:56.1649428Z  2025-03-14T06:27:56.1649915Z  2025-03-14T06:27:56.1650310Z  2025-03-14T06:27:56.1650720Z  2025-03-14T06:27:56.1651159Z  2025-03-14T06:27:56.1651583Z  2025-03-14T06:27:56.1651982Z  2025-03-14T06:27:56.1652393Z  2025-03-14T06:27:56.1653355Z [13,508 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:56.1654345Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 52s local 2025-03-14T06:27:56.1655388Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T06:27:56.1656173Z Compiling src/crypto/fipsmodule/bcm.c; 9s local 2025-03-14T06:27:56.1657068Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 8s local 2025-03-14T06:27:56.1658185Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 8s local 2025-03-14T06:27:56.1659388Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 8s local 2025-03-14T06:27:56.1660530Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T06:27:56.1661434Z @onednn//:onednn_autogen; 4s local ... 2025-03-14T06:27:56.5278311Z 2025-03-14T06:27:56.5279176Z  2025-03-14T06:27:56.5279719Z  2025-03-14T06:27:56.5280144Z  2025-03-14T06:27:56.5280473Z  2025-03-14T06:27:56.5280797Z  2025-03-14T06:27:56.5281118Z  2025-03-14T06:27:56.5281477Z  2025-03-14T06:27:56.5281787Z  2025-03-14T06:27:56.5282747Z [13,514 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:56.5283866Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T06:27:56.5284842Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:27:56.5285787Z Compiling src/crypto/fipsmodule/bcm.c; 10s local 2025-03-14T06:27:56.5286649Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2025-03-14T06:27:56.5287647Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2025-03-14T06:27:56.5288624Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:27:56.5289623Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T06:27:56.5290381Z @onednn//:onednn_autogen; 4s local ... 2025-03-14T06:27:56.7386352Z 2025-03-14T06:27:56.7387150Z  2025-03-14T06:27:56.7387610Z  2025-03-14T06:27:56.7387964Z  2025-03-14T06:27:56.7388314Z  2025-03-14T06:27:56.7388659Z  2025-03-14T06:27:56.7389016Z  2025-03-14T06:27:56.7389359Z  2025-03-14T06:27:56.7389704Z  2025-03-14T06:27:56.7390538Z [13,515 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:56.7391391Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T06:27:56.7392367Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:27:56.7393056Z Compiling src/crypto/fipsmodule/bcm.c; 10s local 2025-03-14T06:27:56.7393841Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2025-03-14T06:27:56.7394945Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2025-03-14T06:27:56.7395872Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:27:56.7396882Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:27:56.7397642Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:27:56.9488030Z 2025-03-14T06:27:56.9488878Z  2025-03-14T06:27:56.9489390Z  2025-03-14T06:27:56.9489818Z  2025-03-14T06:27:56.9490243Z  2025-03-14T06:27:56.9490676Z  2025-03-14T06:27:56.9491107Z  2025-03-14T06:27:56.9491517Z  2025-03-14T06:27:56.9491948Z  2025-03-14T06:27:56.9492968Z [13,521 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:56.9494032Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T06:27:56.9494989Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:27:56.9495915Z Compiling src/crypto/fipsmodule/bcm.c; 10s local 2025-03-14T06:27:56.9496961Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f16.cc; 9s local 2025-03-14T06:27:56.9498240Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2025-03-14T06:27:56.9499475Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:27:56.9500972Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:27:56.9501947Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:27:57.3392073Z 2025-03-14T06:27:57.3392950Z  2025-03-14T06:27:57.3393460Z  2025-03-14T06:27:57.3393896Z  2025-03-14T06:27:57.3394365Z  2025-03-14T06:27:57.3394798Z  2025-03-14T06:27:57.3395205Z  2025-03-14T06:27:57.3395586Z  2025-03-14T06:27:57.3395989Z  2025-03-14T06:27:57.3396971Z [13,533 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:57.3398045Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 53s local 2025-03-14T06:27:57.3398912Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:27:57.3399973Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 9s local 2025-03-14T06:27:57.3401252Z Compiling xla/service/cpu/runtime_single_threaded_matmul_s32.cc; 9s local 2025-03-14T06:27:57.3402523Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:27:57.3403390Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:57.3403998Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:57.3404752Z @onednn//:onednn_autogen; 4s local ... 2025-03-14T06:27:57.5396430Z 2025-03-14T06:27:57.5397310Z  2025-03-14T06:27:57.5397785Z  2025-03-14T06:27:57.5398209Z  2025-03-14T06:27:57.5398629Z  2025-03-14T06:27:57.5399040Z  2025-03-14T06:27:57.5399479Z  2025-03-14T06:27:57.5399900Z  2025-03-14T06:27:57.5400383Z  2025-03-14T06:27:57.5401433Z [13,541 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:57.5402625Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T06:27:57.5403710Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T06:27:57.5404953Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2025-03-14T06:27:57.5406128Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:27:57.5407014Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:57.5407624Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:57.5408219Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:27:57.5409101Z @onednn//:onednn_autogen; 4s local ... 2025-03-14T06:27:57.7792570Z 2025-03-14T06:27:57.7793440Z  2025-03-14T06:27:57.7793964Z  2025-03-14T06:27:57.7794599Z  2025-03-14T06:27:57.7795045Z  2025-03-14T06:27:57.7795726Z  2025-03-14T06:27:57.7796180Z  2025-03-14T06:27:57.7796614Z  2025-03-14T06:27:57.7797055Z  2025-03-14T06:27:57.7798154Z [13,549 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:57.7799268Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T06:27:57.7800209Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T06:27:57.7801350Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2025-03-14T06:27:57.7802616Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T06:27:57.7803577Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:57.7804224Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:57.7804987Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:57.7805648Z @onednn//:onednn_autogen; 4s local ... 2025-03-14T06:27:57.9881912Z 2025-03-14T06:27:57.9882783Z  2025-03-14T06:27:57.9883468Z  2025-03-14T06:27:57.9883906Z  2025-03-14T06:27:57.9884615Z  2025-03-14T06:27:57.9885058Z  2025-03-14T06:27:57.9885501Z  2025-03-14T06:27:57.9885938Z  2025-03-14T06:27:57.9886364Z  2025-03-14T06:27:57.9887386Z [13,554 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:57.9888743Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T06:27:57.9889692Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T06:27:57.9890834Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2025-03-14T06:27:57.9892104Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T06:27:57.9893084Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:57.9893743Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:57.9894399Z @onednn//:onednn_autogen; 4s local 2025-03-14T06:27:57.9895043Z @onednn//:onednn_autogen; 4s local ... 2025-03-14T06:27:58.3412284Z 2025-03-14T06:27:58.3413117Z  2025-03-14T06:27:58.3413839Z  2025-03-14T06:27:58.3425294Z  2025-03-14T06:27:58.3425795Z  2025-03-14T06:27:58.3426241Z  2025-03-14T06:27:58.3426722Z  2025-03-14T06:27:58.3427159Z  2025-03-14T06:27:58.3427596Z  2025-03-14T06:27:58.3428573Z [13,560 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:58.3429680Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 54s local 2025-03-14T06:27:58.3430572Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T06:27:58.3431679Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 10s local 2025-03-14T06:27:58.3432908Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T06:27:58.3433876Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:58.3434523Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:58.3435176Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:58.3435828Z @onednn//:onednn_autogen; 4s local ... 2025-03-14T06:27:58.5405038Z 2025-03-14T06:27:58.5405853Z  2025-03-14T06:27:58.5406358Z  2025-03-14T06:27:58.5406839Z  2025-03-14T06:27:58.5407285Z  2025-03-14T06:27:58.5407728Z  2025-03-14T06:27:58.5408179Z  2025-03-14T06:27:58.5408622Z  2025-03-14T06:27:58.5409070Z  2025-03-14T06:27:58.5410095Z [13,562 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:58.5411222Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T06:27:58.5412166Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T06:27:58.5413511Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T06:27:58.5414778Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T06:27:58.5415833Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:58.5416497Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:58.5417151Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:58.5417817Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:27:58.9203489Z 2025-03-14T06:27:58.9204396Z  2025-03-14T06:27:58.9205044Z  2025-03-14T06:27:58.9205481Z  2025-03-14T06:27:58.9205888Z  2025-03-14T06:27:58.9206315Z  2025-03-14T06:27:58.9206703Z  2025-03-14T06:27:58.9207103Z  2025-03-14T06:27:58.9207510Z  2025-03-14T06:27:58.9208462Z [13,567 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:58.9209541Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T06:27:58.9210456Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T06:27:58.9211509Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T06:27:58.9212698Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T06:27:58.9213546Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:58.9214178Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:58.9214810Z @onednn//:onednn_autogen; 5s local 2025-03-14T06:27:58.9215425Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:27:59.1410313Z 2025-03-14T06:27:59.1411128Z  2025-03-14T06:27:59.1411891Z  2025-03-14T06:27:59.1412324Z  2025-03-14T06:27:59.1412726Z  2025-03-14T06:27:59.1413130Z  2025-03-14T06:27:59.1413561Z  2025-03-14T06:27:59.1414179Z  2025-03-14T06:27:59.1414587Z  2025-03-14T06:27:59.1415589Z [13,575 / 20,650] 3 / 17 tests; 47 actions running; last test: ...nv_hash_test 2025-03-14T06:27:59.1416770Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T06:27:59.1417733Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T06:27:59.1418899Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T06:27:59.1420067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T06:27:59.1420984Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.1421658Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.1422263Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.1422909Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:27:59.3411988Z 2025-03-14T06:27:59.3413151Z  2025-03-14T06:27:59.3413934Z  2025-03-14T06:27:59.3414583Z  2025-03-14T06:27:59.3415678Z  2025-03-14T06:27:59.3416283Z  2025-03-14T06:27:59.3416698Z  2025-03-14T06:27:59.3417189Z  2025-03-14T06:27:59.3417585Z  2025-03-14T06:27:59.3418628Z [13,580 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:27:59.3419730Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 55s local 2025-03-14T06:27:59.3420717Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T06:27:59.3421766Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 11s local 2025-03-14T06:27:59.3423052Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T06:27:59.3423934Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.3424572Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.3425190Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.3425666Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:27:59.5500005Z 2025-03-14T06:27:59.5500784Z  2025-03-14T06:27:59.5501228Z  2025-03-14T06:27:59.5501629Z  2025-03-14T06:27:59.5502011Z  2025-03-14T06:27:59.5502668Z  2025-03-14T06:27:59.5503050Z  2025-03-14T06:27:59.5503429Z  2025-03-14T06:27:59.5503816Z  2025-03-14T06:27:59.5504687Z [13,587 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:59.5505785Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T06:27:59.5506597Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:27:59.5507682Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:27:59.5508753Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T06:27:59.5509605Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.5510185Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.5510740Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.5511269Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:27:59.7611965Z 2025-03-14T06:27:59.7612894Z  2025-03-14T06:27:59.7613318Z  2025-03-14T06:27:59.7613664Z  2025-03-14T06:27:59.7614002Z  2025-03-14T06:27:59.7614338Z  2025-03-14T06:27:59.7614680Z  2025-03-14T06:27:59.7615016Z  2025-03-14T06:27:59.7615361Z  2025-03-14T06:27:59.7616162Z [13,590 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:59.7617033Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T06:27:59.7617749Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:27:59.7618607Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:27:59.7619796Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:27:59.7620562Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:27:59.7621067Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.7621567Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.7622085Z @onednn//:onednn_autogen; 5s local ... 2025-03-14T06:27:59.9787725Z 2025-03-14T06:27:59.9788589Z  2025-03-14T06:27:59.9789098Z  2025-03-14T06:27:59.9789489Z  2025-03-14T06:27:59.9789913Z  2025-03-14T06:27:59.9790332Z  2025-03-14T06:27:59.9790778Z  2025-03-14T06:27:59.9791183Z  2025-03-14T06:27:59.9791566Z  2025-03-14T06:27:59.9792530Z [13,592 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:27:59.9793594Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T06:27:59.9794488Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:27:59.9795510Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:27:59.9796704Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:27:59.9797649Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:27:59.9798244Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:27:59.9798859Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:27:59.9799492Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:28:00.2052825Z 2025-03-14T06:28:00.2053723Z  2025-03-14T06:28:00.2054231Z  2025-03-14T06:28:00.2054617Z  2025-03-14T06:28:00.2054966Z  2025-03-14T06:28:00.2055310Z  2025-03-14T06:28:00.2055642Z  2025-03-14T06:28:00.2055951Z  2025-03-14T06:28:00.2056260Z  2025-03-14T06:28:00.2057251Z [13,599 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:00.2058359Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 56s local 2025-03-14T06:28:00.2059308Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:28:00.2060451Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:28:00.2061732Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:28:00.2062794Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:00.2063302Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:00.2063797Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:28:00.2064295Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:28:00.4178640Z 2025-03-14T06:28:00.4179468Z  2025-03-14T06:28:00.4179903Z  2025-03-14T06:28:00.4180353Z  2025-03-14T06:28:00.4180703Z  2025-03-14T06:28:00.4181046Z  2025-03-14T06:28:00.4181381Z  2025-03-14T06:28:00.4181786Z  2025-03-14T06:28:00.4182441Z  2025-03-14T06:28:00.4183267Z [13,606 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:00.4184064Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T06:28:00.4184739Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:28:00.4185538Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 12s local 2025-03-14T06:28:00.4186456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:28:00.4187142Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:00.4187644Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:00.4188136Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:28:00.4188639Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:28:00.6515008Z 2025-03-14T06:28:00.6515889Z  2025-03-14T06:28:00.6516407Z  2025-03-14T06:28:00.6516841Z  2025-03-14T06:28:00.6517286Z  2025-03-14T06:28:00.6517753Z  2025-03-14T06:28:00.6518182Z  2025-03-14T06:28:00.6518622Z  2025-03-14T06:28:00.6519053Z  2025-03-14T06:28:00.6520294Z [13,609 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:00.6521368Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T06:28:00.6522294Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T06:28:00.6523423Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:28:00.6524832Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:28:00.6525798Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:00.6526419Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:00.6527049Z @onednn//:onednn_autogen; 6s local 2025-03-14T06:28:00.6527706Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:28:00.8910622Z 2025-03-14T06:28:00.8911444Z  2025-03-14T06:28:00.8911949Z  2025-03-14T06:28:00.8912359Z  2025-03-14T06:28:00.8912783Z  2025-03-14T06:28:00.8913176Z  2025-03-14T06:28:00.8913591Z  2025-03-14T06:28:00.8914152Z  2025-03-14T06:28:00.8914550Z  2025-03-14T06:28:00.8915538Z [13,623 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:00.8916359Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T06:28:00.8917060Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T06:28:00.8917928Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:28:00.8918900Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T06:28:00.8919726Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:00.8920277Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:00.8920835Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:00.8921400Z @onednn//:onednn_autogen; 6s local ... 2025-03-14T06:28:01.1114854Z 2025-03-14T06:28:01.1115728Z  2025-03-14T06:28:01.1116204Z  2025-03-14T06:28:01.1116642Z  2025-03-14T06:28:01.1117038Z  2025-03-14T06:28:01.1117431Z  2025-03-14T06:28:01.1117819Z  2025-03-14T06:28:01.1118197Z  2025-03-14T06:28:01.1118579Z  2025-03-14T06:28:01.1119444Z [13,629 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:01.1120693Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T06:28:01.1121540Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T06:28:01.1122522Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:28:01.1123755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T06:28:01.1124758Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:01.1125318Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:01.1125998Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:01.1126578Z @onednn//:onednn_autogen; 7s local ... 2025-03-14T06:28:01.3194520Z 2025-03-14T06:28:01.3195376Z  2025-03-14T06:28:01.3195827Z  2025-03-14T06:28:01.3196216Z  2025-03-14T06:28:01.3196566Z  2025-03-14T06:28:01.3196943Z  2025-03-14T06:28:01.3197304Z  2025-03-14T06:28:01.3197657Z  2025-03-14T06:28:01.3198015Z  2025-03-14T06:28:01.3199004Z [13,639 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:01.3199965Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 57s local 2025-03-14T06:28:01.3200771Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T06:28:01.3201765Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 13s local 2025-03-14T06:28:01.3203073Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T06:28:01.3203980Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:01.3204782Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:01.3205611Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:01.3206399Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local ... 2025-03-14T06:28:01.5319255Z 2025-03-14T06:28:01.5320120Z  2025-03-14T06:28:01.5320665Z  2025-03-14T06:28:01.5321107Z  2025-03-14T06:28:01.5321495Z  2025-03-14T06:28:01.5321902Z  2025-03-14T06:28:01.5322246Z  2025-03-14T06:28:01.5322603Z  2025-03-14T06:28:01.5322984Z  2025-03-14T06:28:01.5323968Z [13,652 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:01.5325107Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T06:28:01.5325943Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:01.5326939Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:28:01.5327901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T06:28:01.5328682Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:01.5329237Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:01.5329822Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:01.5330643Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local ... 2025-03-14T06:28:01.7430916Z 2025-03-14T06:28:01.7431718Z  2025-03-14T06:28:01.7432250Z  2025-03-14T06:28:01.7432653Z  2025-03-14T06:28:01.7433038Z  2025-03-14T06:28:01.7433442Z  2025-03-14T06:28:01.7433868Z  2025-03-14T06:28:01.7434258Z  2025-03-14T06:28:01.7434646Z  2025-03-14T06:28:01.7435691Z [13,661 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:01.7436721Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T06:28:01.7437585Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:01.7438585Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:28:01.7439750Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:01.7440643Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:01.7441233Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:01.7441818Z @onednn//:onednn_autogen; 7s local 2025-03-14T06:28:01.7442596Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local ... 2025-03-14T06:28:01.9435229Z 2025-03-14T06:28:01.9436082Z  2025-03-14T06:28:01.9436591Z  2025-03-14T06:28:01.9436981Z  2025-03-14T06:28:01.9437388Z  2025-03-14T06:28:01.9437796Z  2025-03-14T06:28:01.9438538Z  2025-03-14T06:28:01.9438942Z  2025-03-14T06:28:01.9439364Z  2025-03-14T06:28:01.9440313Z [13,666 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:01.9441547Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T06:28:01.9442414Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:01.9443441Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:28:01.9444761Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:01.9445624Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:01.9446237Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:01.9446826Z @onednn//:onednn_autogen; 8s local 2025-03-14T06:28:01.9447673Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 5s local ... 2025-03-14T06:28:02.1805189Z 2025-03-14T06:28:02.1806078Z  2025-03-14T06:28:02.1806634Z  2025-03-14T06:28:02.1807068Z  2025-03-14T06:28:02.1807472Z  2025-03-14T06:28:02.1807837Z  2025-03-14T06:28:02.1808210Z  2025-03-14T06:28:02.1808593Z  2025-03-14T06:28:02.1808983Z  2025-03-14T06:28:02.1809874Z [13,671 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:02.1811813Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T06:28:02.1812669Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:02.1813653Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:28:02.1814733Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:02.1815596Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:02.1816167Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:02.1816898Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2025-03-14T06:28:02.1817723Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2025-03-14T06:28:02.3812651Z 2025-03-14T06:28:02.3813487Z  2025-03-14T06:28:02.3814001Z  2025-03-14T06:28:02.3814441Z  2025-03-14T06:28:02.3814872Z  2025-03-14T06:28:02.3815310Z  2025-03-14T06:28:02.3815753Z  2025-03-14T06:28:02.3816199Z  2025-03-14T06:28:02.3816625Z  2025-03-14T06:28:02.3817615Z [13,680 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:02.3818717Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 58s local 2025-03-14T06:28:02.3819650Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:02.3820780Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 14s local 2025-03-14T06:28:02.3822055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:02.3823029Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:02.3823667Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:02.3824493Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2025-03-14T06:28:02.3825398Z @llvm-project//llvm:llvm-tblgen; 5s local ... 2025-03-14T06:28:02.6574700Z 2025-03-14T06:28:02.6575541Z  2025-03-14T06:28:02.6576077Z  2025-03-14T06:28:02.6576488Z  2025-03-14T06:28:02.6576909Z  2025-03-14T06:28:02.6577349Z  2025-03-14T06:28:02.6577789Z  2025-03-14T06:28:02.6578217Z  2025-03-14T06:28:02.6578630Z  2025-03-14T06:28:02.6579561Z [13,686 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:02.6580756Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T06:28:02.6581774Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T06:28:02.6582621Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:28:02.6583582Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:02.6584468Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:02.6585004Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:02.6585637Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2025-03-14T06:28:02.6586449Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2025-03-14T06:28:02.8650330Z 2025-03-14T06:28:02.8651168Z  2025-03-14T06:28:02.8651632Z  2025-03-14T06:28:02.8652068Z  2025-03-14T06:28:02.8652465Z  2025-03-14T06:28:02.8652867Z  2025-03-14T06:28:02.8653258Z  2025-03-14T06:28:02.8653634Z  2025-03-14T06:28:02.8654051Z  2025-03-14T06:28:02.8655029Z [13,693 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:02.8656081Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T06:28:02.8656870Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T06:28:02.8657831Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:28:02.8658988Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T06:28:02.8659871Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:28:02.8660484Z @onednn//:onednn_autogen; 9s local 2025-03-14T06:28:02.8661203Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2025-03-14T06:28:02.8662294Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2025-03-14T06:28:03.0759367Z 2025-03-14T06:28:03.0760270Z  2025-03-14T06:28:03.0760734Z  2025-03-14T06:28:03.0761098Z  2025-03-14T06:28:03.0761455Z  2025-03-14T06:28:03.0761820Z  2025-03-14T06:28:03.0762176Z  2025-03-14T06:28:03.0762578Z  2025-03-14T06:28:03.0762944Z  2025-03-14T06:28:03.0763798Z [13,699 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:03.0764837Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T06:28:03.0765893Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T06:28:03.0766831Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:28:03.0767903Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T06:28:03.0768713Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:28:03.0769263Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:28:03.0769966Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 6s local 2025-03-14T06:28:03.0770719Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2025-03-14T06:28:03.2823869Z 2025-03-14T06:28:03.2824681Z  2025-03-14T06:28:03.2825130Z  2025-03-14T06:28:03.2825549Z  2025-03-14T06:28:03.2825955Z  2025-03-14T06:28:03.2826327Z  2025-03-14T06:28:03.2826754Z  2025-03-14T06:28:03.2827129Z  2025-03-14T06:28:03.2827530Z  2025-03-14T06:28:03.2828394Z [13,711 / 20,650] 3 / 17 tests; 47 actions, 45 running; last test: ...ash_test 2025-03-14T06:28:03.2829325Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 59s local 2025-03-14T06:28:03.2830130Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T06:28:03.2831172Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 15s local 2025-03-14T06:28:03.2832205Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T06:28:03.2832954Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:28:03.2833481Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:28:03.2834218Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2025-03-14T06:28:03.2834977Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2025-03-14T06:28:03.5448036Z 2025-03-14T06:28:03.5448916Z  2025-03-14T06:28:03.5449543Z  2025-03-14T06:28:03.5449896Z  2025-03-14T06:28:03.5450234Z  2025-03-14T06:28:03.5450574Z  2025-03-14T06:28:03.5450906Z  2025-03-14T06:28:03.5451564Z  2025-03-14T06:28:03.5451940Z  2025-03-14T06:28:03.5452848Z [13,714 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:03.5454391Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T06:28:03.5455277Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T06:28:03.5456327Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T06:28:03.5457111Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:28:03.5457634Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:28:03.5458314Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2025-03-14T06:28:03.5459050Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:28:03.5459689Z Compiling googletest/src/gtest.cc; 4s local ... 2025-03-14T06:28:03.7598381Z 2025-03-14T06:28:03.7599090Z  2025-03-14T06:28:03.7599573Z  2025-03-14T06:28:03.7599993Z  2025-03-14T06:28:03.7600433Z  2025-03-14T06:28:03.7600842Z  2025-03-14T06:28:03.7601278Z  2025-03-14T06:28:03.7601700Z  2025-03-14T06:28:03.7602097Z  2025-03-14T06:28:03.7603103Z [13,722 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:03.7604028Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T06:28:03.7605330Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T06:28:03.7606427Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:03.7607247Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:28:03.7607821Z @onednn//:onednn_autogen; 10s local 2025-03-14T06:28:03.7608535Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2025-03-14T06:28:03.7609208Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:28:03.7609874Z Compiling googletest/src/gtest.cc; 4s local ... 2025-03-14T06:28:03.9760928Z 2025-03-14T06:28:03.9761790Z  2025-03-14T06:28:03.9762239Z  2025-03-14T06:28:03.9762621Z  2025-03-14T06:28:03.9763002Z  2025-03-14T06:28:03.9763405Z  2025-03-14T06:28:03.9763812Z  2025-03-14T06:28:03.9764207Z  2025-03-14T06:28:03.9764773Z  2025-03-14T06:28:03.9765914Z [13,732 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:03.9766910Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T06:28:03.9767872Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T06:28:03.9768990Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:03.9769864Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:28:03.9770441Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:28:03.9771199Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 7s local 2025-03-14T06:28:03.9772010Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:28:03.9772690Z Compiling googletest/src/gtest.cc; 4s local ... 2025-03-14T06:28:04.2864415Z 2025-03-14T06:28:04.2865518Z  2025-03-14T06:28:04.2866032Z  2025-03-14T06:28:04.2866400Z  2025-03-14T06:28:04.2866821Z  2025-03-14T06:28:04.2867212Z  2025-03-14T06:28:04.2867623Z  2025-03-14T06:28:04.2868017Z  2025-03-14T06:28:04.2868411Z  2025-03-14T06:28:04.2869405Z [13,737 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:04.2870448Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 60s local 2025-03-14T06:28:04.2871412Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 16s local 2025-03-14T06:28:04.2873058Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:04.2873976Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:28:04.2874696Z Compiling llvm/lib/Support/VirtualFileSystem.cpp; 8s local 2025-03-14T06:28:04.2877521Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:28:04.2878226Z Compiling googletest/src/gtest.cc; 5s local 2025-03-14T06:28:04.2878989Z Compiling tsl/platform/protobuf.cc; 3s local ... 2025-03-14T06:28:04.4920517Z 2025-03-14T06:28:04.4921633Z  2025-03-14T06:28:04.4922273Z  2025-03-14T06:28:04.4922686Z  2025-03-14T06:28:04.4923147Z  2025-03-14T06:28:04.4923587Z  2025-03-14T06:28:04.4923956Z  2025-03-14T06:28:04.4924357Z  2025-03-14T06:28:04.4924899Z  2025-03-14T06:28:04.4925854Z [13,743 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:04.4926958Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T06:28:04.4928097Z Compiling xla/service/cpu/runtime_single_threaded_matmul_f8.cc; 17s local 2025-03-14T06:28:04.4929298Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:04.4930248Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:28:04.4930928Z @llvm-project//llvm:llvm-tblgen; 7s local 2025-03-14T06:28:04.4931604Z Compiling googletest/src/gtest.cc; 5s local 2025-03-14T06:28:04.4932328Z Compiling tsl/platform/protobuf.cc; 3s local 2025-03-14T06:28:04.4933116Z Compiling tsl/platform/protobuf_util.cc; 3s local ... 2025-03-14T06:28:04.7300618Z 2025-03-14T06:28:04.7301473Z  2025-03-14T06:28:04.7302229Z  2025-03-14T06:28:04.7302686Z  2025-03-14T06:28:04.7303210Z  2025-03-14T06:28:04.7303688Z  2025-03-14T06:28:04.7304069Z  2025-03-14T06:28:04.7304475Z  2025-03-14T06:28:04.7304965Z  2025-03-14T06:28:04.7305947Z [13,749 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:04.7307072Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T06:28:04.7308102Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:04.7309024Z @onednn//:onednn_autogen; 11s local 2025-03-14T06:28:04.7309695Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T06:28:04.7310376Z Compiling googletest/src/gtest.cc; 5s local 2025-03-14T06:28:04.7311169Z Compiling absl/strings/cord.cc; 3s local 2025-03-14T06:28:04.7311887Z Compiling tsl/platform/protobuf.cc; 2s local 2025-03-14T06:28:04.7312600Z @com_google_protobuf//:protoc_lib; 2s local ... 2025-03-14T06:28:04.9455338Z 2025-03-14T06:28:04.9456164Z  2025-03-14T06:28:04.9456588Z  2025-03-14T06:28:04.9456922Z  2025-03-14T06:28:04.9457273Z  2025-03-14T06:28:04.9457618Z  2025-03-14T06:28:04.9457988Z  2025-03-14T06:28:04.9458352Z  2025-03-14T06:28:04.9458784Z  2025-03-14T06:28:04.9459747Z [13,749 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:04.9460766Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T06:28:04.9461798Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:04.9462755Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:28:04.9463442Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T06:28:04.9464183Z Compiling googletest/src/gtest.cc; 5s local 2025-03-14T06:28:04.9464904Z Compiling absl/strings/cord.cc; 3s local 2025-03-14T06:28:04.9465868Z Compiling tsl/platform/protobuf.cc; 2s local 2025-03-14T06:28:04.9466651Z @com_google_protobuf//:protoc_lib; 2s local ... 2025-03-14T06:28:05.2725398Z 2025-03-14T06:28:05.2726258Z  2025-03-14T06:28:05.2726765Z  2025-03-14T06:28:05.2727204Z  2025-03-14T06:28:05.2727637Z  2025-03-14T06:28:05.2728333Z  2025-03-14T06:28:05.2728759Z  2025-03-14T06:28:05.2729183Z  2025-03-14T06:28:05.2729599Z  2025-03-14T06:28:05.2730593Z [13,751 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:05.2731860Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 61s local 2025-03-14T06:28:05.2732902Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:05.2733827Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:28:05.2734635Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T06:28:05.2735375Z Compiling googletest/src/gtest.cc; 6s local 2025-03-14T06:28:05.2736143Z Compiling tsl/platform/protobuf.cc; 3s local 2025-03-14T06:28:05.2736868Z @com_google_protobuf//:protoc_lib; 3s local 2025-03-14T06:28:05.2737551Z Compiling tsl/platform/hash.cc; 2s local ... 2025-03-14T06:28:05.4743907Z 2025-03-14T06:28:05.4744990Z  2025-03-14T06:28:05.4745402Z  2025-03-14T06:28:05.4745817Z  2025-03-14T06:28:05.4746165Z  2025-03-14T06:28:05.4746521Z  2025-03-14T06:28:05.4746874Z  2025-03-14T06:28:05.4747228Z  2025-03-14T06:28:05.4747575Z  2025-03-14T06:28:05.4748437Z [13,755 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:05.4749475Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:28:05.4750423Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:05.4751350Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:28:05.4752003Z @llvm-project//llvm:llvm-tblgen; 8s local 2025-03-14T06:28:05.4752970Z Compiling googletest/src/gtest.cc; 6s local 2025-03-14T06:28:05.4753659Z Compiling tsl/platform/protobuf.cc; 3s local 2025-03-14T06:28:05.4754376Z @com_google_protobuf//:protoc_lib; 3s local 2025-03-14T06:28:05.4755191Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 2s local ... 2025-03-14T06:28:05.6948653Z 2025-03-14T06:28:05.6949535Z  2025-03-14T06:28:05.6950051Z  2025-03-14T06:28:05.6950499Z  2025-03-14T06:28:05.6950932Z  2025-03-14T06:28:05.6951350Z  2025-03-14T06:28:05.6951758Z  2025-03-14T06:28:05.6952180Z  2025-03-14T06:28:05.6952687Z  2025-03-14T06:28:05.6953703Z [13,757 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:05.6954778Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:28:05.6955742Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:05.6956647Z @onednn//:onednn_autogen; 12s local 2025-03-14T06:28:05.6957274Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T06:28:05.6957975Z Compiling googletest/src/gtest.cc; 6s local 2025-03-14T06:28:05.6958686Z Compiling tsl/platform/protobuf.cc; 3s local 2025-03-14T06:28:05.6959426Z @com_google_protobuf//:protoc_lib; 3s local 2025-03-14T06:28:05.6960319Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 2s local ... 2025-03-14T06:28:05.9220371Z 2025-03-14T06:28:05.9221359Z  2025-03-14T06:28:05.9221956Z  2025-03-14T06:28:05.9222402Z  2025-03-14T06:28:05.9222846Z  2025-03-14T06:28:05.9223297Z  2025-03-14T06:28:05.9223727Z  2025-03-14T06:28:05.9224131Z  2025-03-14T06:28:05.9224531Z  2025-03-14T06:28:05.9225498Z [13,760 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:05.9226542Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:28:05.9227526Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T06:28:05.9228414Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:28:05.9229051Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T06:28:05.9229731Z Compiling googletest/src/gtest.cc; 6s local 2025-03-14T06:28:05.9230418Z @com_google_protobuf//:protoc_lib; 3s local 2025-03-14T06:28:05.9231577Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 2s local 2025-03-14T06:28:05.9232666Z ...lvm:RISCVTargetParserDefGen__gen_riscv_target_def_genrule; 2s local ... 2025-03-14T06:28:06.1466140Z 2025-03-14T06:28:06.1467327Z  2025-03-14T06:28:06.1467820Z  2025-03-14T06:28:06.1468235Z  2025-03-14T06:28:06.1468651Z  2025-03-14T06:28:06.1469040Z  2025-03-14T06:28:06.1469450Z  2025-03-14T06:28:06.1469853Z  2025-03-14T06:28:06.1470441Z  2025-03-14T06:28:06.1471467Z [13,768 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:06.1472534Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:28:06.1473529Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T06:28:06.1474438Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:28:06.1475097Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T06:28:06.1475806Z Compiling googletest/src/gtest.cc; 7s local 2025-03-14T06:28:06.1476695Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 3s local 2025-03-14T06:28:06.1477634Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 3s local 2025-03-14T06:28:06.1478647Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 3s local ... 2025-03-14T06:28:06.3469697Z 2025-03-14T06:28:06.3471645Z  2025-03-14T06:28:06.3472166Z  2025-03-14T06:28:06.3472590Z  2025-03-14T06:28:06.3473030Z  2025-03-14T06:28:06.3473447Z  2025-03-14T06:28:06.3473871Z  2025-03-14T06:28:06.3474291Z  2025-03-14T06:28:06.3474697Z  2025-03-14T06:28:06.3475935Z [13,774 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:06.3477039Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 62s local 2025-03-14T06:28:06.3478059Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T06:28:06.3478996Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:28:06.3479641Z @llvm-project//llvm:llvm-tblgen; 9s local 2025-03-14T06:28:06.3480325Z Compiling googletest/src/gtest.cc; 7s local 2025-03-14T06:28:06.3481166Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 3s local 2025-03-14T06:28:06.3482206Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 3s local 2025-03-14T06:28:06.3483210Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 3s local ... 2025-03-14T06:28:06.6464849Z 2025-03-14T06:28:06.6465957Z  2025-03-14T06:28:06.6466455Z  2025-03-14T06:28:06.6466860Z  2025-03-14T06:28:06.6467253Z  2025-03-14T06:28:06.6467654Z  2025-03-14T06:28:06.6468039Z  2025-03-14T06:28:06.6468446Z  2025-03-14T06:28:06.6468844Z  2025-03-14T06:28:06.6469821Z [13,783 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:06.6470880Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T06:28:06.6471847Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T06:28:06.6472767Z @onednn//:onednn_autogen; 13s local 2025-03-14T06:28:06.6473436Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T06:28:06.6474128Z Compiling googletest/src/gtest.cc; 7s local 2025-03-14T06:28:06.6475026Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 3s local 2025-03-14T06:28:06.6476007Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 3s local 2025-03-14T06:28:06.6477092Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 3s local ... 2025-03-14T06:28:06.9476490Z 2025-03-14T06:28:06.9477344Z  2025-03-14T06:28:06.9477822Z  2025-03-14T06:28:06.9478211Z  2025-03-14T06:28:06.9478607Z  2025-03-14T06:28:06.9479000Z  2025-03-14T06:28:06.9479382Z  2025-03-14T06:28:06.9479771Z  2025-03-14T06:28:06.9480143Z  2025-03-14T06:28:06.9481328Z [13,783 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:06.9482333Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T06:28:06.9483392Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T06:28:06.9484619Z @onednn//:onednn_autogen; 14s local 2025-03-14T06:28:06.9485276Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T06:28:06.9485988Z Compiling googletest/src/gtest.cc; 7s local 2025-03-14T06:28:06.9487511Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 4s local 2025-03-14T06:28:06.9488545Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 3s local 2025-03-14T06:28:06.9489562Z Compiling xla/tsl/lib/strings/proto_serialization.cc; 3s local ... 2025-03-14T06:28:07.1780124Z 2025-03-14T06:28:07.1780927Z  2025-03-14T06:28:07.1781380Z  2025-03-14T06:28:07.1781706Z  2025-03-14T06:28:07.1782092Z  2025-03-14T06:28:07.1782478Z  2025-03-14T06:28:07.1782894Z  2025-03-14T06:28:07.1783313Z  2025-03-14T06:28:07.1783688Z  2025-03-14T06:28:07.1784589Z [13,791 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:07.1785605Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 63s local 2025-03-14T06:28:07.1786465Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T06:28:07.1787341Z @onednn//:onednn_autogen; 14s local 2025-03-14T06:28:07.1787899Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T06:28:07.1788525Z Compiling googletest/src/gtest.cc; 8s local 2025-03-14T06:28:07.1789574Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local 2025-03-14T06:28:07.1790317Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 3s local 2025-03-14T06:28:07.1791112Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 3s local ... 2025-03-14T06:28:07.4210516Z 2025-03-14T06:28:07.4211366Z  2025-03-14T06:28:07.4211922Z  2025-03-14T06:28:07.4212348Z  2025-03-14T06:28:07.4212768Z  2025-03-14T06:28:07.4213177Z  2025-03-14T06:28:07.4213589Z  2025-03-14T06:28:07.4213991Z  2025-03-14T06:28:07.4214425Z  2025-03-14T06:28:07.4215437Z [13,795 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:07.4216527Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T06:28:07.4217555Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T06:28:07.4218497Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T06:28:07.4219236Z Compiling googletest/src/gtest.cc; 8s local 2025-03-14T06:28:07.4220079Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local 2025-03-14T06:28:07.4221046Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 4s local 2025-03-14T06:28:07.4221988Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 3s local 2025-03-14T06:28:07.4222868Z @llvm-project//llvm:TargetParser; 3s local ... 2025-03-14T06:28:07.6824804Z 2025-03-14T06:28:07.6825723Z  2025-03-14T06:28:07.6826242Z  2025-03-14T06:28:07.6826686Z  2025-03-14T06:28:07.6827129Z  2025-03-14T06:28:07.6827580Z  2025-03-14T06:28:07.6828042Z  2025-03-14T06:28:07.6828461Z  2025-03-14T06:28:07.6828900Z  2025-03-14T06:28:07.6829897Z [13,802 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:07.6830992Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T06:28:07.6832054Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T06:28:07.6833047Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:28:07.6833729Z Compiling googletest/src/gtest.cc; 8s local 2025-03-14T06:28:07.6835071Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local 2025-03-14T06:28:07.6836151Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 4s local 2025-03-14T06:28:07.6837468Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 3s local 2025-03-14T06:28:07.6838488Z Compiling tsl/platform/numbers.cc; 3s local ... 2025-03-14T06:28:07.9114810Z 2025-03-14T06:28:07.9115698Z  2025-03-14T06:28:07.9116601Z  2025-03-14T06:28:07.9117060Z  2025-03-14T06:28:07.9117496Z  2025-03-14T06:28:07.9117908Z  2025-03-14T06:28:07.9118328Z  2025-03-14T06:28:07.9118763Z  2025-03-14T06:28:07.9119195Z  2025-03-14T06:28:07.9120389Z [13,806 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:07.9121496Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T06:28:07.9122535Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T06:28:07.9123501Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:28:07.9124220Z Compiling googletest/src/gtest.cc; 8s local 2025-03-14T06:28:07.9125283Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local 2025-03-14T06:28:07.9126241Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 4s local 2025-03-14T06:28:07.9127179Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local 2025-03-14T06:28:07.9128306Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp [for tool]; 2s local ... 2025-03-14T06:28:08.1483771Z 2025-03-14T06:28:08.1484796Z  2025-03-14T06:28:08.1485317Z  2025-03-14T06:28:08.1485743Z  2025-03-14T06:28:08.1486146Z  2025-03-14T06:28:08.1486554Z  2025-03-14T06:28:08.1486956Z  2025-03-14T06:28:08.1487358Z  2025-03-14T06:28:08.1487781Z  2025-03-14T06:28:08.1488991Z [13,808 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:08.1490048Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T06:28:08.1491054Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T06:28:08.1492053Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:28:08.1492781Z Compiling googletest/src/gtest.cc; 9s local 2025-03-14T06:28:08.1493627Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2025-03-14T06:28:08.1494534Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 4s local 2025-03-14T06:28:08.1495427Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local 2025-03-14T06:28:08.1496514Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp [for tool]; 2s local ... 2025-03-14T06:28:08.3562823Z 2025-03-14T06:28:08.3563810Z  2025-03-14T06:28:08.3564304Z  2025-03-14T06:28:08.3564842Z  2025-03-14T06:28:08.3565899Z  2025-03-14T06:28:08.3566811Z  2025-03-14T06:28:08.3567237Z  2025-03-14T06:28:08.3567651Z  2025-03-14T06:28:08.3568065Z  2025-03-14T06:28:08.3568984Z [13,811 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:08.3569982Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 64s local 2025-03-14T06:28:08.3580608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T06:28:08.3581895Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:28:08.3582618Z Compiling googletest/src/gtest.cc; 9s local 2025-03-14T06:28:08.3583485Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2025-03-14T06:28:08.3584449Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 4s local 2025-03-14T06:28:08.3585420Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local 2025-03-14T06:28:08.3586534Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp [for tool]; 2s local ... 2025-03-14T06:28:08.5740258Z 2025-03-14T06:28:08.5741238Z  2025-03-14T06:28:08.5741723Z  2025-03-14T06:28:08.5742161Z  2025-03-14T06:28:08.5742539Z  2025-03-14T06:28:08.5744485Z  2025-03-14T06:28:08.5745373Z  2025-03-14T06:28:08.5746048Z  2025-03-14T06:28:08.5746709Z  2025-03-14T06:28:08.5747618Z [13,816 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:08.5748651Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T06:28:08.5749467Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T06:28:08.5750413Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:28:08.5751065Z Compiling googletest/src/gtest.cc; 9s local 2025-03-14T06:28:08.5752009Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2025-03-14T06:28:08.5753070Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 5s local 2025-03-14T06:28:08.5753893Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 4s local 2025-03-14T06:28:08.5754941Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp [for tool]; 3s local ... 2025-03-14T06:28:08.8838785Z 2025-03-14T06:28:08.8839713Z  2025-03-14T06:28:08.8841504Z  2025-03-14T06:28:08.8841996Z  2025-03-14T06:28:08.8842418Z  2025-03-14T06:28:08.8842834Z  2025-03-14T06:28:08.8843261Z  2025-03-14T06:28:08.8843876Z  2025-03-14T06:28:08.8844301Z  2025-03-14T06:28:08.8845397Z [13,820 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:08.8846322Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T06:28:08.8847268Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T06:28:08.8848327Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:28:08.8849088Z Compiling googletest/src/gtest.cc; 9s local 2025-03-14T06:28:08.8850163Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2025-03-14T06:28:08.8851231Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 5s local 2025-03-14T06:28:08.8852322Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2025-03-14T06:28:08.8853713Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp [for tool]; 3s local ... 2025-03-14T06:28:09.1493279Z 2025-03-14T06:28:09.1494128Z  2025-03-14T06:28:09.1494607Z  2025-03-14T06:28:09.1495038Z  2025-03-14T06:28:09.1495472Z  2025-03-14T06:28:09.1495899Z  2025-03-14T06:28:09.1496353Z  2025-03-14T06:28:09.1496816Z  2025-03-14T06:28:09.1497228Z  2025-03-14T06:28:09.1498264Z [13,824 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:09.1499675Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 65s local 2025-03-14T06:28:09.1500613Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T06:28:09.1501575Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:28:09.1502389Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 6s local 2025-03-14T06:28:09.1503333Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 5s local 2025-03-14T06:28:09.1504263Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2025-03-14T06:28:09.1505316Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp [for tool]; 3s local 2025-03-14T06:28:09.1506305Z @com_google_protobuf//:protoc_lib; 2s local ... 2025-03-14T06:28:09.4102606Z 2025-03-14T06:28:09.4103484Z  2025-03-14T06:28:09.4103989Z  2025-03-14T06:28:09.4104363Z  2025-03-14T06:28:09.4104725Z  2025-03-14T06:28:09.4105093Z  2025-03-14T06:28:09.4105467Z  2025-03-14T06:28:09.4105821Z  2025-03-14T06:28:09.4106193Z  2025-03-14T06:28:09.4107135Z [13,827 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:09.4108128Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:28:09.4109062Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T06:28:09.4109961Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:28:09.4110761Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local 2025-03-14T06:28:09.4113879Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2025-03-14T06:28:09.4114826Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp [for tool]; 3s local 2025-03-14T06:28:09.4115722Z @com_google_protobuf//:protoc_lib; 3s local 2025-03-14T06:28:09.4116705Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local ... 2025-03-14T06:28:09.6429971Z 2025-03-14T06:28:09.6430842Z  2025-03-14T06:28:09.6431338Z  2025-03-14T06:28:09.6431752Z  2025-03-14T06:28:09.6432163Z  2025-03-14T06:28:09.6432839Z  2025-03-14T06:28:09.6433264Z  2025-03-14T06:28:09.6433673Z  2025-03-14T06:28:09.6434087Z  2025-03-14T06:28:09.6435062Z [13,829 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:09.6436106Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:28:09.6437095Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T06:28:09.6438041Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T06:28:09.6438845Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local 2025-03-14T06:28:09.6439776Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 5s local 2025-03-14T06:28:09.6440842Z Compiling llvm/lib/TargetParser/RISCVISAInfo.cpp [for tool]; 4s local 2025-03-14T06:28:09.6441779Z @com_google_protobuf//:protoc_lib; 3s local 2025-03-14T06:28:09.6442609Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local ... 2025-03-14T06:28:09.8867861Z 2025-03-14T06:28:09.8868775Z  2025-03-14T06:28:09.8870676Z  2025-03-14T06:28:09.8871170Z  2025-03-14T06:28:09.8871875Z  2025-03-14T06:28:09.8872319Z  2025-03-14T06:28:09.8872713Z  2025-03-14T06:28:09.8873130Z  2025-03-14T06:28:09.8873538Z  2025-03-14T06:28:09.8874513Z [13,836 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:09.8875619Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:28:09.8876631Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:09.8877529Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T06:28:09.8878334Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local 2025-03-14T06:28:09.8879428Z Compiling xla/tsl/profiler/utils/xplane_schema.cc; 6s local 2025-03-14T06:28:09.8880285Z @com_google_protobuf//:protoc_lib; 3s local 2025-03-14T06:28:09.8881125Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2025-03-14T06:28:09.8881983Z Compiling xla/pjrt/pjrt_future.cc; 2s local ... 2025-03-14T06:28:10.1393361Z 2025-03-14T06:28:10.1394246Z  2025-03-14T06:28:10.1394755Z  2025-03-14T06:28:10.1395207Z  2025-03-14T06:28:10.1395648Z  2025-03-14T06:28:10.1396084Z  2025-03-14T06:28:10.1396525Z  2025-03-14T06:28:10.1396962Z  2025-03-14T06:28:10.1397388Z  2025-03-14T06:28:10.1398395Z [13,841 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:10.1399493Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:28:10.1400481Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:10.1401473Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T06:28:10.1402299Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local 2025-03-14T06:28:10.1403168Z @com_google_protobuf//:protoc_lib; 3s local 2025-03-14T06:28:10.1403964Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2025-03-14T06:28:10.1404796Z Compiling xla/ef57.cc; 2s local 2025-03-14T06:28:10.1405560Z Compiling llvm/lib/TargetParser/Triple.cpp [for tool]; 2s local ... 2025-03-14T06:28:10.3502831Z 2025-03-14T06:28:10.3503836Z  2025-03-14T06:28:10.3504376Z  2025-03-14T06:28:10.3504821Z  2025-03-14T06:28:10.3505202Z  2025-03-14T06:28:10.3505585Z  2025-03-14T06:28:10.3506297Z  2025-03-14T06:28:10.3506710Z  2025-03-14T06:28:10.3507116Z  2025-03-14T06:28:10.3508098Z [13,844 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:10.3509324Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 66s local 2025-03-14T06:28:10.3510342Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:10.3511286Z @llvm-project//llvm:llvm-tblgen; 13s local 2025-03-14T06:28:10.3512205Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 6s local 2025-03-14T06:28:10.3513010Z @com_google_protobuf//:protoc_lib; 4s local 2025-03-14T06:28:10.3513818Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2025-03-14T06:28:10.3514760Z Compiling llvm/lib/TargetParser/Triple.cpp [for tool]; 3s local 2025-03-14T06:28:10.3515717Z Compiling llvm/lib/TargetParser/Triple.cpp; 2s local ... 2025-03-14T06:28:10.6321580Z 2025-03-14T06:28:10.6322435Z  2025-03-14T06:28:10.6323003Z  2025-03-14T06:28:10.6323437Z  2025-03-14T06:28:10.6323872Z  2025-03-14T06:28:10.6324293Z  2025-03-14T06:28:10.6324881Z  2025-03-14T06:28:10.6325284Z  2025-03-14T06:28:10.6325720Z  2025-03-14T06:28:10.6326697Z [13,848 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:10.6327747Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T06:28:10.6328751Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:10.6329695Z @llvm-project//llvm:llvm-tblgen; 14s local 2025-03-14T06:28:10.6330720Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2025-03-14T06:28:10.6331503Z @com_google_protobuf//:protoc_lib; 4s local 2025-03-14T06:28:10.6332293Z Compiling llvm/lib/TargetParser/Triple.cpp; 3s local 2025-03-14T06:28:10.6333110Z Compiling xla/stream_executor/kernel_spec.cc; 3s local 2025-03-14T06:28:10.6333953Z Compiling tsl/platform/numbers.cc; 2s local ... 2025-03-14T06:28:10.8459816Z 2025-03-14T06:28:10.8460702Z  2025-03-14T06:28:10.8461198Z  2025-03-14T06:28:10.8461590Z  2025-03-14T06:28:10.8461998Z  2025-03-14T06:28:10.8462437Z  2025-03-14T06:28:10.8462853Z  2025-03-14T06:28:10.8463267Z  2025-03-14T06:28:10.8463685Z  2025-03-14T06:28:10.8464770Z [13,857 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:10.8467274Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T06:28:10.8468276Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T06:28:10.8469345Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2025-03-14T06:28:10.8470184Z @com_google_protobuf//:protoc_lib; 4s local 2025-03-14T06:28:10.8471080Z Compiling xla/service/llvm_ir/llvm_command_line_options.cc; 2s local 2025-03-14T06:28:10.8472208Z Compiling xla/service/cpu/runtime_single_threaded_conv2d.cc; 2s local 2025-03-14T06:28:10.8473124Z @llvm-project//llvm:llvm-tblgen; 2s local 2025-03-14T06:28:10.8474009Z Compiling xla/service/cpu/runtime_single_threaded_conv2d.cc; 2s local ... 2025-03-14T06:28:11.1409759Z 2025-03-14T06:28:11.1410607Z  2025-03-14T06:28:11.1411094Z  2025-03-14T06:28:11.1411502Z  2025-03-14T06:28:11.1411913Z  2025-03-14T06:28:11.1412326Z  2025-03-14T06:28:11.1412712Z  2025-03-14T06:28:11.1413150Z  2025-03-14T06:28:11.1413566Z  2025-03-14T06:28:11.1414510Z [13,863 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:11.1415533Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T06:28:11.1416479Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T06:28:11.1417490Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2025-03-14T06:28:11.1418533Z @com_google_protobuf//:protoc_lib; 4s local 2025-03-14T06:28:11.1419376Z Compiling xla/service/llvm_ir/llvm_command_line_options.cc; 3s local 2025-03-14T06:28:11.1420454Z Compiling xla/service/cpu/runtime_single_threaded_conv2d.cc; 3s local 2025-03-14T06:28:11.1421464Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:11.1422357Z Compiling xla/service/cpu/runtime_single_threaded_conv2d.cc; 2s local ... 2025-03-14T06:28:11.3511499Z 2025-03-14T06:28:11.3512392Z  2025-03-14T06:28:11.3513173Z  2025-03-14T06:28:11.3513611Z  2025-03-14T06:28:11.3514043Z  2025-03-14T06:28:11.3514465Z  2025-03-14T06:28:11.3514883Z  2025-03-14T06:28:11.3515318Z  2025-03-14T06:28:11.3515743Z  2025-03-14T06:28:11.3516716Z [13,865 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:11.3517739Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 67s local 2025-03-14T06:28:11.3518788Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T06:28:11.3519877Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 7s local 2025-03-14T06:28:11.3520707Z @com_google_protobuf//:protoc_lib; 5s local 2025-03-14T06:28:11.3521428Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:11.3522346Z Compiling xla/service/cpu/runtime_single_threaded_conv2d.cc; 3s local 2025-03-14T06:28:11.3523571Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 2s local 2025-03-14T06:28:11.3524798Z Compiling mlir/lib/TableGen/Class.cpp [for tool]; 2s local ... 2025-03-14T06:28:11.5516151Z 2025-03-14T06:28:11.5516985Z  2025-03-14T06:28:11.5517746Z  2025-03-14T06:28:11.5518194Z  2025-03-14T06:28:11.5518593Z  2025-03-14T06:28:11.5519003Z  2025-03-14T06:28:11.5519403Z  2025-03-14T06:28:11.5519807Z  2025-03-14T06:28:11.5520227Z  2025-03-14T06:28:11.5521241Z [13,868 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:11.5522298Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T06:28:11.5523298Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T06:28:11.5524347Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local 2025-03-14T06:28:11.5525304Z @com_google_protobuf//:protoc_lib; 5s local 2025-03-14T06:28:11.5525998Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:11.5526934Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 3s local 2025-03-14T06:28:11.5527995Z Compiling mlir/lib/TableGen/Class.cpp [for tool]; 3s local 2025-03-14T06:28:11.5529066Z Compiling xla/service/cpu/runtime_single_threaded_conv3d.cc; 2s local ... 2025-03-14T06:28:11.7525973Z 2025-03-14T06:28:11.7526889Z  2025-03-14T06:28:11.7527394Z  2025-03-14T06:28:11.7527812Z  2025-03-14T06:28:11.7528252Z  2025-03-14T06:28:11.7528668Z  2025-03-14T06:28:11.7529126Z  2025-03-14T06:28:11.7529539Z  2025-03-14T06:28:11.7529958Z  2025-03-14T06:28:11.7530926Z [13,870 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:11.7531998Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T06:28:11.7533016Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:11.7534082Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local 2025-03-14T06:28:11.7534913Z @com_google_protobuf//:protoc_lib; 5s local 2025-03-14T06:28:11.7535626Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:11.7536695Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 3s local 2025-03-14T06:28:11.7537741Z Compiling mlir/lib/TableGen/Class.cpp [for tool]; 3s local 2025-03-14T06:28:11.7538812Z Compiling xla/service/cpu/runtime_single_threaded_conv3d.cc; 3s local ... 2025-03-14T06:28:11.9628631Z 2025-03-14T06:28:11.9629807Z  2025-03-14T06:28:11.9630204Z  2025-03-14T06:28:11.9630614Z  2025-03-14T06:28:11.9631050Z  2025-03-14T06:28:11.9631466Z  2025-03-14T06:28:11.9631871Z  2025-03-14T06:28:11.9632265Z  2025-03-14T06:28:11.9632862Z  2025-03-14T06:28:11.9633859Z [13,874 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:11.9634916Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T06:28:11.9636152Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:11.9637232Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local 2025-03-14T06:28:11.9638017Z @com_google_protobuf//:protoc_lib; 5s local 2025-03-14T06:28:11.9638707Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:11.9639644Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 3s local 2025-03-14T06:28:11.9640729Z Compiling mlir/lib/TableGen/Class.cpp [for tool]; 3s local 2025-03-14T06:28:11.9641768Z Compiling mlir/lib/TableGen/CodeGenHelpers.cpp [for tool]; 3s local ... 2025-03-14T06:28:12.1837679Z 2025-03-14T06:28:12.1838517Z  2025-03-14T06:28:12.1839017Z  2025-03-14T06:28:12.1839453Z  2025-03-14T06:28:12.1839905Z  2025-03-14T06:28:12.1840337Z  2025-03-14T06:28:12.1840761Z  2025-03-14T06:28:12.1841151Z  2025-03-14T06:28:12.1841542Z  2025-03-14T06:28:12.1842510Z [13,876 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:12.1843547Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 68s local 2025-03-14T06:28:12.1845106Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:12.1846081Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 8s local 2025-03-14T06:28:12.1846756Z @com_google_protobuf//:protoc_lib; 6s local 2025-03-14T06:28:12.1847411Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:28:12.1848319Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 3s local 2025-03-14T06:28:12.1849315Z Compiling mlir/lib/TableGen/Class.cpp [for tool]; 3s local 2025-03-14T06:28:12.1850359Z Compiling xla/service/cpu/runtime_single_threaded_conv3d.cc; 3s local ... 2025-03-14T06:28:12.3938617Z 2025-03-14T06:28:12.3939504Z  2025-03-14T06:28:12.3940020Z  2025-03-14T06:28:12.3940463Z  2025-03-14T06:28:12.3940890Z  2025-03-14T06:28:12.3941314Z  2025-03-14T06:28:12.3941755Z  2025-03-14T06:28:12.3942171Z  2025-03-14T06:28:12.3942591Z  2025-03-14T06:28:12.3943633Z [13,884 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:12.3944869Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:28:12.3945979Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:12.3946901Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2025-03-14T06:28:12.3947780Z @com_google_protobuf//:protoc_lib; 6s local 2025-03-14T06:28:12.3948689Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 4s local 2025-03-14T06:28:12.3949708Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2025-03-14T06:28:12.3950544Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:12.3951512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 3s local ... 2025-03-14T06:28:12.6621424Z 2025-03-14T06:28:12.6622312Z  2025-03-14T06:28:12.6622799Z  2025-03-14T06:28:12.6623206Z  2025-03-14T06:28:12.6623606Z  2025-03-14T06:28:12.6624022Z  2025-03-14T06:28:12.6624451Z  2025-03-14T06:28:12.6624858Z  2025-03-14T06:28:12.6625213Z  2025-03-14T06:28:12.6626102Z [13,885 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:12.6627108Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:28:12.6628350Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:12.6629320Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2025-03-14T06:28:12.6630059Z @com_google_protobuf//:protoc_lib; 6s local 2025-03-14T06:28:12.6631053Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 4s local 2025-03-14T06:28:12.6632043Z Compiling xla/service/cpu/runtime_fork_join.cc; 3s local 2025-03-14T06:28:12.6632987Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:12.6633909Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 3s local ... 2025-03-14T06:28:12.8630495Z 2025-03-14T06:28:12.8631357Z  2025-03-14T06:28:12.8631865Z  2025-03-14T06:28:12.8632303Z  2025-03-14T06:28:12.8632731Z  2025-03-14T06:28:12.8633160Z  2025-03-14T06:28:12.8633582Z  2025-03-14T06:28:12.8633977Z  2025-03-14T06:28:12.8634299Z  2025-03-14T06:28:12.8635262Z [13,892 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:12.8636329Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:28:12.8637273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T06:28:12.8638252Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2025-03-14T06:28:12.8639337Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 4s local 2025-03-14T06:28:12.8640268Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:12.8641180Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 3s local 2025-03-14T06:28:12.8642638Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 3s local 2025-03-14T06:28:12.8643745Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 2s local ... 2025-03-14T06:28:13.0682196Z 2025-03-14T06:28:13.0683090Z  2025-03-14T06:28:13.0683599Z  2025-03-14T06:28:13.0684078Z  2025-03-14T06:28:13.0684631Z  2025-03-14T06:28:13.0685059Z  2025-03-14T06:28:13.0685463Z  2025-03-14T06:28:13.0685883Z  2025-03-14T06:28:13.0686296Z  2025-03-14T06:28:13.0687238Z [13,898 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:13.0688262Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:28:13.0689249Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T06:28:13.0690310Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2025-03-14T06:28:13.0691337Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 4s local 2025-03-14T06:28:13.0692259Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:28:13.0693151Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 3s local 2025-03-14T06:28:13.0694309Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 3s local 2025-03-14T06:28:13.0695427Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 3s local ... 2025-03-14T06:28:13.2909971Z 2025-03-14T06:28:13.2910819Z  2025-03-14T06:28:13.2911322Z  2025-03-14T06:28:13.2911744Z  2025-03-14T06:28:13.2912149Z  2025-03-14T06:28:13.2912593Z  2025-03-14T06:28:13.2913006Z  2025-03-14T06:28:13.2913366Z  2025-03-14T06:28:13.2913752Z  2025-03-14T06:28:13.2915151Z [13,901 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:13.2916364Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 69s local 2025-03-14T06:28:13.2917468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T06:28:13.2918646Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 9s local 2025-03-14T06:28:13.2919754Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 4s local 2025-03-14T06:28:13.2921008Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 3s local 2025-03-14T06:28:13.2922429Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 3s local 2025-03-14T06:28:13.2923708Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 3s local 2025-03-14T06:28:13.2924852Z Compiling xla/parse_flags_from_env.cc; 3s local ... 2025-03-14T06:28:13.5528665Z 2025-03-14T06:28:13.5529562Z  2025-03-14T06:28:13.5530163Z  2025-03-14T06:28:13.5530703Z  2025-03-14T06:28:13.5531229Z  2025-03-14T06:28:13.5531771Z  2025-03-14T06:28:13.5532260Z  2025-03-14T06:28:13.5533054Z  2025-03-14T06:28:13.5533560Z  2025-03-14T06:28:13.5534585Z [13,904 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:13.5535742Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T06:28:13.5536847Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T06:28:13.5537999Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local 2025-03-14T06:28:13.5539177Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 5s local 2025-03-14T06:28:13.5540443Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2025-03-14T06:28:13.5541648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2025-03-14T06:28:13.5542750Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 2s local 2025-03-14T06:28:13.5543700Z @llvm-project//llvm:llvm-tblgen; 2s local ... 2025-03-14T06:28:13.7533975Z 2025-03-14T06:28:13.7534985Z  2025-03-14T06:28:13.7536604Z  2025-03-14T06:28:13.7537086Z  2025-03-14T06:28:13.7537504Z  2025-03-14T06:28:13.7537907Z  2025-03-14T06:28:13.7538613Z  2025-03-14T06:28:13.7539083Z  2025-03-14T06:28:13.7539490Z  2025-03-14T06:28:13.7540453Z [13,908 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:13.7541503Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T06:28:13.7542518Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:13.7543607Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local 2025-03-14T06:28:13.7544607Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 5s local 2025-03-14T06:28:13.7545700Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2025-03-14T06:28:13.7546659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2025-03-14T06:28:13.7547666Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 3s local 2025-03-14T06:28:13.7548389Z @llvm-project//llvm:llvm-tblgen; 2s local ... 2025-03-14T06:28:14.1030661Z 2025-03-14T06:28:14.1031481Z  2025-03-14T06:28:14.1031997Z  2025-03-14T06:28:14.1032409Z  2025-03-14T06:28:14.1032868Z  2025-03-14T06:28:14.1033389Z  2025-03-14T06:28:14.1033809Z  2025-03-14T06:28:14.1034202Z  2025-03-14T06:28:14.1034613Z  2025-03-14T06:28:14.1035554Z [13,911 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:14.1036597Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T06:28:14.1037577Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:14.1038639Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local 2025-03-14T06:28:14.1039634Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 5s local 2025-03-14T06:28:14.1040795Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2025-03-14T06:28:14.1041962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2025-03-14T06:28:14.1043016Z Compiling xla/backends/cpu/codegen/cpu_features.cc; 3s local 2025-03-14T06:28:14.1043884Z @llvm-project//llvm:llvm-tblgen; 3s local ... 2025-03-14T06:28:14.3237766Z 2025-03-14T06:28:14.3238641Z  2025-03-14T06:28:14.3239127Z  2025-03-14T06:28:14.3241585Z  2025-03-14T06:28:14.3244942Z  2025-03-14T06:28:14.3247915Z  2025-03-14T06:28:14.3250950Z  2025-03-14T06:28:14.3253951Z  2025-03-14T06:28:14.3256927Z  2025-03-14T06:28:14.3260037Z [13,914 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:14.3261659Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 70s local 2025-03-14T06:28:14.3262872Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:14.3264315Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 10s local 2025-03-14T06:28:14.3266058Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 5s local 2025-03-14T06:28:14.3267450Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 4s local 2025-03-14T06:28:14.3268653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 4s local 2025-03-14T06:28:14.3269770Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:14.3271132Z Compiling xla/tsl/concurrency/async_value.cc; 2s local ... 2025-03-14T06:28:14.5543767Z 2025-03-14T06:28:14.5544617Z  2025-03-14T06:28:14.5545143Z  2025-03-14T06:28:14.5545580Z  2025-03-14T06:28:14.5546014Z  2025-03-14T06:28:14.5546388Z  2025-03-14T06:28:14.5546705Z  2025-03-14T06:28:14.5547071Z  2025-03-14T06:28:14.5547478Z  2025-03-14T06:28:14.5548490Z [13,916 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:14.5549548Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T06:28:14.5550797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:14.5551889Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local 2025-03-14T06:28:14.5552914Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 6s local 2025-03-14T06:28:14.5554048Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2025-03-14T06:28:14.5555171Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2025-03-14T06:28:14.5556026Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:14.5556661Z Compiling re2/dfa.cc; 3s local ... 2025-03-14T06:28:14.7547931Z 2025-03-14T06:28:14.7548749Z  2025-03-14T06:28:14.7549231Z  2025-03-14T06:28:14.7549742Z  2025-03-14T06:28:14.7550123Z  2025-03-14T06:28:14.7550512Z  2025-03-14T06:28:14.7550904Z  2025-03-14T06:28:14.7551323Z  2025-03-14T06:28:14.7551731Z  2025-03-14T06:28:14.7552660Z [13,919 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:14.7553604Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T06:28:14.7554583Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T06:28:14.7555593Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local 2025-03-14T06:28:14.7556616Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 6s local 2025-03-14T06:28:14.7557776Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2025-03-14T06:28:14.7559055Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2025-03-14T06:28:14.7559970Z @llvm-project//llvm:llvm-tblgen; 3s local 2025-03-14T06:28:14.7560624Z Compiling re2/dfa.cc; 3s local ... 2025-03-14T06:28:14.9614206Z 2025-03-14T06:28:14.9615061Z  2025-03-14T06:28:14.9615579Z  2025-03-14T06:28:14.9615970Z  2025-03-14T06:28:14.9616413Z  2025-03-14T06:28:14.9616793Z  2025-03-14T06:28:14.9617208Z  2025-03-14T06:28:14.9617637Z  2025-03-14T06:28:14.9618053Z  2025-03-14T06:28:14.9619001Z [13,920 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:14.9620066Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T06:28:14.9621350Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T06:28:14.9622395Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local 2025-03-14T06:28:14.9623458Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 6s local 2025-03-14T06:28:14.9624760Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2025-03-14T06:28:14.9625913Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2025-03-14T06:28:14.9627012Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:28:14.9627683Z Compiling re2/dfa.cc; 3s local ... 2025-03-14T06:28:15.2162715Z 2025-03-14T06:28:15.2163563Z  2025-03-14T06:28:15.2164061Z  2025-03-14T06:28:15.2164621Z  2025-03-14T06:28:15.2165025Z  2025-03-14T06:28:15.2165615Z  2025-03-14T06:28:15.2166022Z  2025-03-14T06:28:15.2166437Z  2025-03-14T06:28:15.2166850Z  2025-03-14T06:28:15.2167829Z [13,922 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:15.2168917Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 71s local 2025-03-14T06:28:15.2169961Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T06:28:15.2171091Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 11s local 2025-03-14T06:28:15.2172203Z Compiling mlir/tools/mlir-tblgen/SPIRVUtilsGen.cpp [for tool]; 6s local 2025-03-14T06:28:15.2173528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 5s local 2025-03-14T06:28:15.2174722Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 5s local 2025-03-14T06:28:15.2175929Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:28:15.2176632Z Compiling re2/dfa.cc; 3s local ... 2025-03-14T06:28:15.4801772Z 2025-03-14T06:28:15.4802613Z  2025-03-14T06:28:15.4803126Z  2025-03-14T06:28:15.4803555Z  2025-03-14T06:28:15.4803985Z  2025-03-14T06:28:15.4804394Z  2025-03-14T06:28:15.4805072Z  2025-03-14T06:28:15.4805497Z  2025-03-14T06:28:15.4805854Z  2025-03-14T06:28:15.4806794Z [13,932 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:15.4807856Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T06:28:15.4808867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T06:28:15.4809970Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2025-03-14T06:28:15.4811045Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2025-03-14T06:28:15.4812232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T06:28:15.4813192Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:28:15.4813864Z Compiling re2/dfa.cc; 4s local 2025-03-14T06:28:15.4814688Z Compiling mlir/lib/TableGen/Operator.cpp [for tool]; 3s local ... 2025-03-14T06:28:15.7199948Z 2025-03-14T06:28:15.7200828Z  2025-03-14T06:28:15.7201316Z  2025-03-14T06:28:15.7201719Z  2025-03-14T06:28:15.7202115Z  2025-03-14T06:28:15.7202515Z  2025-03-14T06:28:15.7202901Z  2025-03-14T06:28:15.7203276Z  2025-03-14T06:28:15.7203654Z  2025-03-14T06:28:15.7204751Z [13,935 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:15.7205755Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T06:28:15.7206702Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:15.7207687Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2025-03-14T06:28:15.7208616Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2025-03-14T06:28:15.7209662Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T06:28:15.7210502Z Compiling re2/dfa.cc; 4s local 2025-03-14T06:28:15.7211220Z Compiling mlir/lib/TableGen/Operator.cpp [for tool]; 3s local 2025-03-14T06:28:15.7212484Z @llvm-project//llvm:llvm-tblgen; 3s local ... 2025-03-14T06:28:15.9557561Z 2025-03-14T06:28:15.9558447Z  2025-03-14T06:28:15.9558945Z  2025-03-14T06:28:15.9559363Z  2025-03-14T06:28:15.9560115Z  2025-03-14T06:28:15.9560533Z  2025-03-14T06:28:15.9560946Z  2025-03-14T06:28:15.9561335Z  2025-03-14T06:28:15.9561757Z  2025-03-14T06:28:15.9562884Z [13,939 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:15.9563938Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T06:28:15.9565149Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:15.9570480Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2025-03-14T06:28:15.9571530Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2025-03-14T06:28:15.9572664Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T06:28:15.9573770Z Compiling mlir/lib/TableGen/Operator.cpp [for tool]; 3s local 2025-03-14T06:28:15.9574872Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 3s local 2025-03-14T06:28:15.9576052Z Compiling mlir/lib/TableGen/Pattern.cpp [for tool]; 3s local ... 2025-03-14T06:28:16.1672073Z 2025-03-14T06:28:16.1672923Z  2025-03-14T06:28:16.1673448Z  2025-03-14T06:28:16.1673886Z  2025-03-14T06:28:16.1674315Z  2025-03-14T06:28:16.1674779Z  2025-03-14T06:28:16.1675226Z  2025-03-14T06:28:16.1675652Z  2025-03-14T06:28:16.1676079Z  2025-03-14T06:28:16.1677325Z [13,942 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:16.1678422Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 72s local 2025-03-14T06:28:16.1679407Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:16.1680419Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 12s local 2025-03-14T06:28:16.1681522Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 6s local 2025-03-14T06:28:16.1682729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 6s local 2025-03-14T06:28:16.1683810Z Compiling mlir/lib/TableGen/Operator.cpp [for tool]; 4s local 2025-03-14T06:28:16.1685028Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 3s local 2025-03-14T06:28:16.1686209Z Compiling mlir/lib/TableGen/Pattern.cpp [for tool]; 3s local ... 2025-03-14T06:28:16.4193943Z 2025-03-14T06:28:16.4194737Z  2025-03-14T06:28:16.4195218Z  2025-03-14T06:28:16.4195655Z  2025-03-14T06:28:16.4196084Z  2025-03-14T06:28:16.4196468Z  2025-03-14T06:28:16.4196856Z  2025-03-14T06:28:16.4197244Z  2025-03-14T06:28:16.4197649Z  2025-03-14T06:28:16.4198552Z [13,945 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:16.4199607Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T06:28:16.4200538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:16.4201573Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2025-03-14T06:28:16.4202645Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2025-03-14T06:28:16.4203806Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:28:16.4205118Z Compiling mlir/lib/TableGen/Operator.cpp [for tool]; 4s local 2025-03-14T06:28:16.4206180Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 4s local 2025-03-14T06:28:16.4207252Z Compiling mlir/lib/TableGen/Pattern.cpp [for tool]; 4s local ... 2025-03-14T06:28:16.6551200Z 2025-03-14T06:28:16.6552062Z  2025-03-14T06:28:16.6552563Z  2025-03-14T06:28:16.6552997Z  2025-03-14T06:28:16.6553424Z  2025-03-14T06:28:16.6553844Z  2025-03-14T06:28:16.6554570Z  2025-03-14T06:28:16.6555006Z  2025-03-14T06:28:16.6555439Z  2025-03-14T06:28:16.6556419Z [13,946 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:16.6557598Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T06:28:16.6558604Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:16.6559668Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2025-03-14T06:28:16.6560830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2025-03-14T06:28:16.6562025Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:28:16.6563144Z Compiling mlir/lib/TableGen/Operator.cpp [for tool]; 4s local 2025-03-14T06:28:16.6564224Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 4s local 2025-03-14T06:28:16.6565770Z Compiling mlir/lib/TableGen/Pattern.cpp [for tool]; 4s local ... 2025-03-14T06:28:16.8594466Z 2025-03-14T06:28:16.8595338Z  2025-03-14T06:28:16.8595838Z  2025-03-14T06:28:16.8596276Z  2025-03-14T06:28:16.8596695Z  2025-03-14T06:28:16.8597127Z  2025-03-14T06:28:16.8597554Z  2025-03-14T06:28:16.8598018Z  2025-03-14T06:28:16.8598427Z  2025-03-14T06:28:16.8599429Z [13,954 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:16.8600437Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T06:28:16.8601460Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T06:28:16.8602831Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2025-03-14T06:28:16.8603884Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2025-03-14T06:28:16.8605153Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:28:16.8606266Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 4s local 2025-03-14T06:28:16.8607275Z Compiling mlir/lib/TableGen/Pattern.cpp [for tool]; 4s local 2025-03-14T06:28:16.8608091Z @llvm-project//llvm:llvm-tblgen; 4s local ... 2025-03-14T06:28:17.0647457Z 2025-03-14T06:28:17.0648355Z  2025-03-14T06:28:17.0648859Z  2025-03-14T06:28:17.0649289Z  2025-03-14T06:28:17.0649679Z  2025-03-14T06:28:17.0650014Z  2025-03-14T06:28:17.0650385Z  2025-03-14T06:28:17.0650824Z  2025-03-14T06:28:17.0651225Z  2025-03-14T06:28:17.0652174Z [13,957 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:17.0653132Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T06:28:17.0654036Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T06:28:17.0654955Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2025-03-14T06:28:17.0655873Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2025-03-14T06:28:17.0656931Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:28:17.0658018Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 4s local 2025-03-14T06:28:17.0659002Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:28:17.0659709Z @com_google_protobuf//:protoc_lib; 4s local ... 2025-03-14T06:28:17.3199157Z 2025-03-14T06:28:17.3199970Z  2025-03-14T06:28:17.3200464Z  2025-03-14T06:28:17.3200931Z  2025-03-14T06:28:17.3201351Z  2025-03-14T06:28:17.3201770Z  2025-03-14T06:28:17.3202174Z  2025-03-14T06:28:17.3202574Z  2025-03-14T06:28:17.3203004Z  2025-03-14T06:28:17.3203976Z [13,965 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:17.3205175Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 73s local 2025-03-14T06:28:17.3206175Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T06:28:17.3207562Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local 2025-03-14T06:28:17.3208586Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 7s local 2025-03-14T06:28:17.3209714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 7s local 2025-03-14T06:28:17.3211076Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 5s local 2025-03-14T06:28:17.3212021Z @llvm-project//llvm:llvm-tblgen; 4s local 2025-03-14T06:28:17.3212870Z @com_google_protobuf//:protoc_lib; 4s local ... 2025-03-14T06:28:17.5569628Z 2025-03-14T06:28:17.5570512Z  2025-03-14T06:28:17.5571022Z  2025-03-14T06:28:17.5571473Z  2025-03-14T06:28:17.5571893Z  2025-03-14T06:28:17.5572324Z  2025-03-14T06:28:17.5572746Z  2025-03-14T06:28:17.5573177Z  2025-03-14T06:28:17.5573594Z  2025-03-14T06:28:17.5574601Z [13,969 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:17.5575715Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T06:28:17.5576731Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T06:28:17.5577835Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2025-03-14T06:28:17.5578846Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2025-03-14T06:28:17.5580030Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T06:28:17.5581265Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 5s local 2025-03-14T06:28:17.5582511Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T06:28:17.5583271Z @com_google_protobuf//:protoc_lib; 4s local ... 2025-03-14T06:28:17.9310752Z 2025-03-14T06:28:17.9311655Z  2025-03-14T06:28:17.9312201Z  2025-03-14T06:28:17.9312636Z  2025-03-14T06:28:17.9313029Z  2025-03-14T06:28:17.9313393Z  2025-03-14T06:28:17.9313821Z  2025-03-14T06:28:17.9314210Z  2025-03-14T06:28:17.9314603Z  2025-03-14T06:28:17.9315522Z [13,973 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:17.9316559Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T06:28:17.9317527Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T06:28:17.9318569Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2025-03-14T06:28:17.9319642Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2025-03-14T06:28:17.9320732Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T06:28:17.9321872Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 5s local 2025-03-14T06:28:17.9322814Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T06:28:17.9323504Z @com_google_protobuf//:protoc_lib; 5s local ... 2025-03-14T06:28:18.1576428Z 2025-03-14T06:28:18.1577286Z  2025-03-14T06:28:18.1577793Z  2025-03-14T06:28:18.1578228Z  2025-03-14T06:28:18.1578642Z  2025-03-14T06:28:18.1579057Z  2025-03-14T06:28:18.1579469Z  2025-03-14T06:28:18.1579886Z  2025-03-14T06:28:18.1580347Z  2025-03-14T06:28:18.1581351Z [13,974 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:18.1582453Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 74s local 2025-03-14T06:28:18.1583492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T06:28:18.1584599Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local 2025-03-14T06:28:18.1585711Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 8s local 2025-03-14T06:28:18.1586805Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T06:28:18.1588011Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 5s local 2025-03-14T06:28:18.1589263Z @llvm-project//llvm:llvm-tblgen; 5s local 2025-03-14T06:28:18.1590008Z @com_google_protobuf//:protoc_lib; 5s local ... 2025-03-14T06:28:18.4081512Z 2025-03-14T06:28:18.4082388Z  2025-03-14T06:28:18.4082864Z  2025-03-14T06:28:18.4083534Z  2025-03-14T06:28:18.4083929Z  2025-03-14T06:28:18.4084320Z  2025-03-14T06:28:18.4084891Z  2025-03-14T06:28:18.4085278Z  2025-03-14T06:28:18.4085675Z  2025-03-14T06:28:18.4086717Z [13,979 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:18.4087687Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T06:28:18.4088622Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T06:28:18.4089621Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2025-03-14T06:28:18.4090576Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2025-03-14T06:28:18.4091651Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 8s local 2025-03-14T06:28:18.4092721Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 6s local 2025-03-14T06:28:18.4093597Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T06:28:18.4094270Z @com_google_protobuf//:protoc_lib; 5s local ... 2025-03-14T06:28:18.7577128Z 2025-03-14T06:28:18.7577989Z  2025-03-14T06:28:18.7578479Z  2025-03-14T06:28:18.7578903Z  2025-03-14T06:28:18.7579310Z  2025-03-14T06:28:18.7579740Z  2025-03-14T06:28:18.7580133Z  2025-03-14T06:28:18.7580533Z  2025-03-14T06:28:18.7580931Z  2025-03-14T06:28:18.7582138Z [13,983 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:18.7583180Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T06:28:18.7584169Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:18.7585198Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2025-03-14T06:28:18.7586163Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2025-03-14T06:28:18.7587286Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T06:28:18.7588409Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 6s local 2025-03-14T06:28:18.7589326Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T06:28:18.7590036Z @com_google_protobuf//:protoc_lib; 5s local ... 2025-03-14T06:28:18.9581182Z 2025-03-14T06:28:18.9582134Z  2025-03-14T06:28:18.9582646Z  2025-03-14T06:28:18.9583455Z  2025-03-14T06:28:18.9583893Z  2025-03-14T06:28:18.9584328Z  2025-03-14T06:28:18.9584756Z  2025-03-14T06:28:18.9585161Z  2025-03-14T06:28:18.9585590Z  2025-03-14T06:28:18.9586563Z [13,986 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:18.9587668Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T06:28:18.9588668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:18.9589752Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2025-03-14T06:28:18.9590802Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2025-03-14T06:28:18.9592008Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T06:28:18.9593235Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 6s local 2025-03-14T06:28:18.9594239Z @llvm-project//llvm:llvm-tblgen; 6s local 2025-03-14T06:28:18.9594994Z @llvm-project//llvm:llvm-tblgen; 6s local ... 2025-03-14T06:28:19.1993838Z 2025-03-14T06:28:19.1995117Z  2025-03-14T06:28:19.1996471Z  2025-03-14T06:28:19.1997111Z  2025-03-14T06:28:19.1997759Z  2025-03-14T06:28:19.1998400Z  2025-03-14T06:28:19.1999196Z  2025-03-14T06:28:19.2000327Z  2025-03-14T06:28:19.2001131Z  2025-03-14T06:28:19.2002063Z [13,989 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:19.2003064Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 75s local 2025-03-14T06:28:19.2004232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:19.2005495Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local 2025-03-14T06:28:19.2006702Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 9s local 2025-03-14T06:28:19.2007834Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 9s local 2025-03-14T06:28:19.2008954Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:19.2010148Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 6s local 2025-03-14T06:28:19.2011102Z @com_google_protobuf//:protoc_lib; 3s local ... 2025-03-14T06:28:19.4310852Z 2025-03-14T06:28:19.4311724Z  2025-03-14T06:28:19.4312277Z  2025-03-14T06:28:19.4312706Z  2025-03-14T06:28:19.4313132Z  2025-03-14T06:28:19.4313565Z  2025-03-14T06:28:19.4313986Z  2025-03-14T06:28:19.4314416Z  2025-03-14T06:28:19.4314820Z  2025-03-14T06:28:19.4315821Z [13,992 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:19.4316898Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:28:19.4317901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:19.4318940Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2025-03-14T06:28:19.4320330Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2025-03-14T06:28:19.4321545Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:28:19.4322770Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:19.4324078Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 6s local 2025-03-14T06:28:19.4325334Z @com_google_protobuf//:protoc_lib; 4s local ... 2025-03-14T06:28:19.6639920Z 2025-03-14T06:28:19.6640785Z  2025-03-14T06:28:19.6641253Z  2025-03-14T06:28:19.6641723Z  2025-03-14T06:28:19.6642150Z  2025-03-14T06:28:19.6642550Z  2025-03-14T06:28:19.6642980Z  2025-03-14T06:28:19.6643402Z  2025-03-14T06:28:19.6643794Z  2025-03-14T06:28:19.6644970Z [13,998 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:19.6646014Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:28:19.6647080Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:19.6648139Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2025-03-14T06:28:19.6649192Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2025-03-14T06:28:19.6650450Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:28:19.6651579Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:19.6652774Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 6s local 2025-03-14T06:28:19.6653868Z @com_google_protobuf//:protoc_lib; 4s local ... 2025-03-14T06:28:19.8650051Z 2025-03-14T06:28:19.8650922Z  2025-03-14T06:28:19.8651438Z  2025-03-14T06:28:19.8651853Z  2025-03-14T06:28:19.8652292Z  2025-03-14T06:28:19.8652696Z  2025-03-14T06:28:19.8653092Z  2025-03-14T06:28:19.8653487Z  2025-03-14T06:28:19.8653876Z  2025-03-14T06:28:19.8654830Z [14,006 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:19.8655832Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:28:19.8656731Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:19.8658022Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2025-03-14T06:28:19.8659044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2025-03-14T06:28:19.8660184Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:28:19.8661566Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:19.8662761Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 6s local 2025-03-14T06:28:19.8663909Z @com_google_protobuf//:protoc_lib; 4s local ... 2025-03-14T06:28:20.0881397Z 2025-03-14T06:28:20.0882247Z  2025-03-14T06:28:20.0882757Z  2025-03-14T06:28:20.0883183Z  2025-03-14T06:28:20.0883582Z  2025-03-14T06:28:20.0883992Z  2025-03-14T06:28:20.0884393Z  2025-03-14T06:28:20.0884952Z  2025-03-14T06:28:20.0885339Z  2025-03-14T06:28:20.0886284Z [14,008 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:20.0887324Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:28:20.0888275Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:20.0889296Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2025-03-14T06:28:20.0890275Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 10s local 2025-03-14T06:28:20.0891345Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:28:20.0892496Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:20.0893937Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:20.0894932Z @com_google_protobuf//:protoc_lib; 4s local ... 2025-03-14T06:28:20.3592372Z 2025-03-14T06:28:20.3593248Z  2025-03-14T06:28:20.3593768Z  2025-03-14T06:28:20.3594200Z  2025-03-14T06:28:20.3594623Z  2025-03-14T06:28:20.3595077Z  2025-03-14T06:28:20.3595496Z  2025-03-14T06:28:20.3595925Z  2025-03-14T06:28:20.3596310Z  2025-03-14T06:28:20.3597295Z [14,009 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:20.3598410Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 76s local 2025-03-14T06:28:20.3599371Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:20.3600433Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local 2025-03-14T06:28:20.3601507Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2025-03-14T06:28:20.3602701Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 10s local 2025-03-14T06:28:20.3603913Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 8s local 2025-03-14T06:28:20.3605350Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:20.3606416Z @com_google_protobuf//:protoc_lib; 5s local ... 2025-03-14T06:28:20.5596935Z 2025-03-14T06:28:20.5597807Z  2025-03-14T06:28:20.5598307Z  2025-03-14T06:28:20.5598757Z  2025-03-14T06:28:20.5599184Z  2025-03-14T06:28:20.5599622Z  2025-03-14T06:28:20.5600071Z  2025-03-14T06:28:20.5600486Z  2025-03-14T06:28:20.5600897Z  2025-03-14T06:28:20.5601899Z [14,012 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:20.5602976Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T06:28:20.5603987Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:20.5605261Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2025-03-14T06:28:20.5606315Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2025-03-14T06:28:20.5607553Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T06:28:20.5609149Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 8s local 2025-03-14T06:28:20.5610425Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:20.5611514Z @com_google_protobuf//:protoc_lib; 5s local ... 2025-03-14T06:28:20.7817472Z 2025-03-14T06:28:20.7818311Z  2025-03-14T06:28:20.7818788Z  2025-03-14T06:28:20.7819204Z  2025-03-14T06:28:20.7819614Z  2025-03-14T06:28:20.7819989Z  2025-03-14T06:28:20.7820355Z  2025-03-14T06:28:20.7821046Z  2025-03-14T06:28:20.7821459Z  2025-03-14T06:28:20.7822455Z [14,014 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:20.7823446Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T06:28:20.7824369Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T06:28:20.7825420Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2025-03-14T06:28:20.7826496Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2025-03-14T06:28:20.7827655Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T06:28:20.7828866Z Compiling llvm/utils/TableGen/SubtargetEmitter.cpp [for tool]; 8s local 2025-03-14T06:28:20.7830182Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 7s local 2025-03-14T06:28:20.7831257Z @com_google_protobuf//:protoc_lib; 5s local ... 2025-03-14T06:28:21.0889715Z 2025-03-14T06:28:21.0890734Z  2025-03-14T06:28:21.0891252Z  2025-03-14T06:28:21.0891638Z  2025-03-14T06:28:21.0892045Z  2025-03-14T06:28:21.0892453Z  2025-03-14T06:28:21.0893144Z  2025-03-14T06:28:21.0893573Z  2025-03-14T06:28:21.0893988Z  2025-03-14T06:28:21.0894965Z [14,016 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:21.0895988Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T06:28:21.0896985Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T06:28:21.0898065Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2025-03-14T06:28:21.0899101Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 11s local 2025-03-14T06:28:21.0900241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T06:28:21.0901461Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2025-03-14T06:28:21.0902674Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 5s local 2025-03-14T06:28:21.0903804Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local ... 2025-03-14T06:28:21.3316372Z 2025-03-14T06:28:21.3317253Z  2025-03-14T06:28:21.3317712Z  2025-03-14T06:28:21.3318139Z  2025-03-14T06:28:21.3318545Z  2025-03-14T06:28:21.3318955Z  2025-03-14T06:28:21.3319374Z  2025-03-14T06:28:21.3319814Z  2025-03-14T06:28:21.3320243Z  2025-03-14T06:28:21.3321214Z [14,020 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:21.3322269Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 77s local 2025-03-14T06:28:21.3323276Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T06:28:21.3324316Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local 2025-03-14T06:28:21.3325509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T06:28:21.3326719Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 11s local 2025-03-14T06:28:21.3327890Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2025-03-14T06:28:21.3329195Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 6s local 2025-03-14T06:28:21.3330310Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 5s local ... 2025-03-14T06:28:21.5413699Z 2025-03-14T06:28:21.5414807Z  2025-03-14T06:28:21.5415303Z  2025-03-14T06:28:21.5415730Z  2025-03-14T06:28:21.5416158Z  2025-03-14T06:28:21.5416581Z  2025-03-14T06:28:21.5416995Z  2025-03-14T06:28:21.5417402Z  2025-03-14T06:28:21.5417956Z  2025-03-14T06:28:21.5418911Z [14,025 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:21.5419885Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T06:28:21.5420992Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T06:28:21.5422063Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2025-03-14T06:28:21.5423106Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T06:28:21.5424410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:21.5425628Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2025-03-14T06:28:21.5426892Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 6s local 2025-03-14T06:28:21.5428005Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local ... 2025-03-14T06:28:21.7606834Z 2025-03-14T06:28:21.7607593Z  2025-03-14T06:28:21.7608091Z  2025-03-14T06:28:21.7608514Z  2025-03-14T06:28:21.7608931Z  2025-03-14T06:28:21.7609329Z  2025-03-14T06:28:21.7609740Z  2025-03-14T06:28:21.7610127Z  2025-03-14T06:28:21.7610507Z  2025-03-14T06:28:21.7611465Z [14,026 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:21.7612716Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T06:28:21.7613690Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T06:28:21.7614670Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2025-03-14T06:28:21.7615635Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T06:28:21.7616745Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:21.7617907Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 8s local 2025-03-14T06:28:21.7619140Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 6s local 2025-03-14T06:28:21.7620329Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local ... 2025-03-14T06:28:22.1126140Z 2025-03-14T06:28:22.1127016Z  2025-03-14T06:28:22.1127534Z  2025-03-14T06:28:22.1127952Z  2025-03-14T06:28:22.1128386Z  2025-03-14T06:28:22.1128810Z  2025-03-14T06:28:22.1129219Z  2025-03-14T06:28:22.1129645Z  2025-03-14T06:28:22.1130064Z  2025-03-14T06:28:22.1131040Z [14,029 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:22.1132045Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T06:28:22.1132913Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T06:28:22.1133828Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2025-03-14T06:28:22.1134742Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T06:28:22.1135769Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:22.1136797Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2025-03-14T06:28:22.1138017Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 6s local 2025-03-14T06:28:22.1139066Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local ... 2025-03-14T06:28:22.3114895Z 2025-03-14T06:28:22.3115730Z  2025-03-14T06:28:22.3116193Z  2025-03-14T06:28:22.3116700Z  2025-03-14T06:28:22.3117126Z  2025-03-14T06:28:22.3117501Z  2025-03-14T06:28:22.3117895Z  2025-03-14T06:28:22.3118298Z  2025-03-14T06:28:22.3118722Z  2025-03-14T06:28:22.3119943Z [14,034 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:22.3120947Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 78s local 2025-03-14T06:28:22.3121756Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T06:28:22.3122973Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local 2025-03-14T06:28:22.3124006Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 12s local 2025-03-14T06:28:22.3125541Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 12s local 2025-03-14T06:28:22.3126584Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2025-03-14T06:28:22.3127738Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2025-03-14T06:28:22.3128779Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 6s local ... 2025-03-14T06:28:22.5281668Z 2025-03-14T06:28:22.5282532Z  2025-03-14T06:28:22.5283028Z  2025-03-14T06:28:22.5283426Z  2025-03-14T06:28:22.5283811Z  2025-03-14T06:28:22.5284208Z  2025-03-14T06:28:22.5284778Z  2025-03-14T06:28:22.5285180Z  2025-03-14T06:28:22.5285578Z  2025-03-14T06:28:22.5286518Z [14,035 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:22.5287420Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T06:28:22.5288170Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T06:28:22.5288983Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2025-03-14T06:28:22.5290206Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T06:28:22.5291139Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T06:28:22.5292092Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2025-03-14T06:28:22.5293219Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2025-03-14T06:28:22.5294196Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local ... 2025-03-14T06:28:22.7615203Z 2025-03-14T06:28:22.7615958Z  2025-03-14T06:28:22.7616460Z  2025-03-14T06:28:22.7616929Z  2025-03-14T06:28:22.7617365Z  2025-03-14T06:28:22.7617790Z  2025-03-14T06:28:22.7618229Z  2025-03-14T06:28:22.7618645Z  2025-03-14T06:28:22.7619076Z  2025-03-14T06:28:22.7620088Z [14,037 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:22.7621186Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T06:28:22.7622221Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T06:28:22.7623320Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2025-03-14T06:28:22.7624406Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T06:28:22.7625633Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T06:28:22.7626848Z Compiling llvm/utils/TableGen/RegisterInfoEmitter.cpp [for tool]; 9s local 2025-03-14T06:28:22.7628165Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2025-03-14T06:28:22.7629163Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local ... 2025-03-14T06:28:23.0221628Z 2025-03-14T06:28:23.0222473Z  2025-03-14T06:28:23.0222983Z  2025-03-14T06:28:23.0223419Z  2025-03-14T06:28:23.0223918Z  2025-03-14T06:28:23.0224328Z  2025-03-14T06:28:23.0224777Z  2025-03-14T06:28:23.0225194Z  2025-03-14T06:28:23.0225618Z  2025-03-14T06:28:23.0226606Z [14,038 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:23.0227660Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T06:28:23.0228660Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T06:28:23.0229990Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2025-03-14T06:28:23.0231020Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T06:28:23.0232182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T06:28:23.0233324Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T06:28:23.0234326Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 7s local 2025-03-14T06:28:23.0235668Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local ... 2025-03-14T06:28:23.2927323Z 2025-03-14T06:28:23.2928194Z  2025-03-14T06:28:23.2928745Z  2025-03-14T06:28:23.2929204Z  2025-03-14T06:28:23.2929656Z  2025-03-14T06:28:23.2930107Z  2025-03-14T06:28:23.2930545Z  2025-03-14T06:28:23.2930981Z  2025-03-14T06:28:23.2931422Z  2025-03-14T06:28:23.2932433Z [14,042 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:23.2933548Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 79s local 2025-03-14T06:28:23.2934610Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T06:28:23.2935864Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2025-03-14T06:28:23.2937083Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 13s local 2025-03-14T06:28:23.2938155Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 13s local 2025-03-14T06:28:23.2939032Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T06:28:23.2940205Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 8s local 2025-03-14T06:28:23.2941261Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 7s local ... 2025-03-14T06:28:23.5622812Z 2025-03-14T06:28:23.5623651Z  2025-03-14T06:28:23.5624119Z  2025-03-14T06:28:23.5624499Z  2025-03-14T06:28:23.5624880Z  2025-03-14T06:28:23.5625304Z  2025-03-14T06:28:23.5625710Z  2025-03-14T06:28:23.5626148Z  2025-03-14T06:28:23.5626562Z  2025-03-14T06:28:23.5627527Z [14,043 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:23.5628558Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T06:28:23.5629435Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T06:28:23.5630445Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2025-03-14T06:28:23.5631524Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T06:28:23.5632659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:23.5633566Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T06:28:23.5634666Z Compiling src/google/protobuf/compiler/cpp/message.cc [for tool]; 8s local 2025-03-14T06:28:23.5635791Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local ... 2025-03-14T06:28:23.7627933Z 2025-03-14T06:28:23.7628758Z  2025-03-14T06:28:23.7629270Z  2025-03-14T06:28:23.7629684Z  2025-03-14T06:28:23.7630104Z  2025-03-14T06:28:23.7630528Z  2025-03-14T06:28:23.7630908Z  2025-03-14T06:28:23.7631343Z  2025-03-14T06:28:23.7631761Z  2025-03-14T06:28:23.7632901Z [14,046 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:23.7633871Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T06:28:23.7634806Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:23.7636055Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2025-03-14T06:28:23.7637130Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T06:28:23.7638337Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:23.7639312Z @llvm-project//llvm:llvm-tblgen; 10s local 2025-03-14T06:28:23.7640415Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2025-03-14T06:28:23.7641543Z Compiling mlir/tools/mlir-tblgen/RewriterGen.cpp [for tool]; 8s local ... 2025-03-14T06:28:23.9808183Z 2025-03-14T06:28:23.9809239Z  2025-03-14T06:28:23.9809708Z  2025-03-14T06:28:23.9810122Z  2025-03-14T06:28:23.9810535Z  2025-03-14T06:28:23.9810966Z  2025-03-14T06:28:23.9811374Z  2025-03-14T06:28:23.9811767Z  2025-03-14T06:28:23.9812334Z  2025-03-14T06:28:23.9813329Z [14,049 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:23.9814384Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T06:28:23.9815404Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:23.9816438Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2025-03-14T06:28:23.9817426Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T06:28:23.9818582Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:23.9819494Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:28:23.9820278Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2025-03-14T06:28:23.9821352Z Compiling mlir/tools/mlir-tblgen/RewriterGen.cpp [for tool]; 8s local ... 2025-03-14T06:28:24.1860110Z 2025-03-14T06:28:24.1860928Z  2025-03-14T06:28:24.1861423Z  2025-03-14T06:28:24.1861852Z  2025-03-14T06:28:24.1862269Z  2025-03-14T06:28:24.1862659Z  2025-03-14T06:28:24.1863091Z  2025-03-14T06:28:24.1863780Z  2025-03-14T06:28:24.1864212Z  2025-03-14T06:28:24.1865180Z [14,053 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:24.1866437Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 80s local 2025-03-14T06:28:24.1867390Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:24.1868396Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2025-03-14T06:28:24.1869400Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 14s local 2025-03-14T06:28:24.1870561Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:24.1871478Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:28:24.1872237Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 8s local 2025-03-14T06:28:24.1873077Z Compiling llvm/lib/IR/Verifier.cpp; 8s local ... 2025-03-14T06:28:24.4133200Z 2025-03-14T06:28:24.4134085Z  2025-03-14T06:28:24.4134637Z  2025-03-14T06:28:24.4135029Z  2025-03-14T06:28:24.4135427Z  2025-03-14T06:28:24.4135826Z  2025-03-14T06:28:24.4136344Z  2025-03-14T06:28:24.4136875Z  2025-03-14T06:28:24.4137251Z  2025-03-14T06:28:24.4138175Z [14,056 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:24.4139211Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:28:24.4140039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:24.4140982Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:24.4141976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T06:28:24.4142845Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 14s local 2025-03-14T06:28:24.4143640Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:28:24.4144424Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T06:28:24.4145227Z Compiling llvm/lib/IR/Verifier.cpp; 8s local ... 2025-03-14T06:28:24.6580781Z 2025-03-14T06:28:24.6581627Z  2025-03-14T06:28:24.6582134Z  2025-03-14T06:28:24.6582552Z  2025-03-14T06:28:24.6582939Z  2025-03-14T06:28:24.6583338Z  2025-03-14T06:28:24.6584041Z  2025-03-14T06:28:24.6584447Z  2025-03-14T06:28:24.6584871Z  2025-03-14T06:28:24.6585817Z [14,060 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:24.6587013Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:28:24.6587986Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:24.6588989Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:24.6590181Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T06:28:24.6591321Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:24.6592255Z @llvm-project//llvm:llvm-tblgen; 11s local 2025-03-14T06:28:24.6593050Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T06:28:24.6593899Z Compiling llvm/lib/IR/Verifier.cpp; 9s local ... 2025-03-14T06:28:24.8966153Z 2025-03-14T06:28:24.8967035Z  2025-03-14T06:28:24.8967559Z  2025-03-14T06:28:24.8967970Z  2025-03-14T06:28:24.8968363Z  2025-03-14T06:28:24.8968777Z  2025-03-14T06:28:24.8969174Z  2025-03-14T06:28:24.8969580Z  2025-03-14T06:28:24.8970006Z  2025-03-14T06:28:24.8970959Z [14,063 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:24.8971990Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:28:24.8972993Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T06:28:24.8974331Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:24.8975372Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T06:28:24.8976494Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:24.8977423Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:28:24.8978227Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T06:28:24.8979054Z Compiling llvm/lib/IR/Verifier.cpp; 9s local ... 2025-03-14T06:28:25.0964609Z 2025-03-14T06:28:25.0965778Z  2025-03-14T06:28:25.0966329Z  2025-03-14T06:28:25.0967885Z  2025-03-14T06:28:25.0968503Z  2025-03-14T06:28:25.0968920Z  2025-03-14T06:28:25.0969373Z  2025-03-14T06:28:25.0969826Z  2025-03-14T06:28:25.0970255Z  2025-03-14T06:28:25.0971237Z [14,069 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:25.0972202Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:28:25.0973177Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T06:28:25.0974205Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:25.0975289Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 15s local 2025-03-14T06:28:25.0976287Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:25.0977107Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:28:25.0977920Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T06:28:25.0978753Z Compiling llvm/lib/IR/Verifier.cpp; 9s local ... 2025-03-14T06:28:25.3636008Z 2025-03-14T06:28:25.3637150Z  2025-03-14T06:28:25.3638086Z  2025-03-14T06:28:25.3638896Z  2025-03-14T06:28:25.3639587Z  2025-03-14T06:28:25.3640056Z  2025-03-14T06:28:25.3640537Z  2025-03-14T06:28:25.3640977Z  2025-03-14T06:28:25.3641405Z  2025-03-14T06:28:25.3642379Z [14,071 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:25.3643383Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 81s local 2025-03-14T06:28:25.3644368Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T06:28:25.3645467Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:25.3646696Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T06:28:25.3647854Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 15s local 2025-03-14T06:28:25.3648908Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:28:25.3649657Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 9s local 2025-03-14T06:28:25.3650451Z Compiling llvm/lib/IR/Verifier.cpp; 9s local ... 2025-03-14T06:28:25.7641413Z 2025-03-14T06:28:25.7642643Z  2025-03-14T06:28:25.7643230Z  2025-03-14T06:28:25.7643689Z  2025-03-14T06:28:25.7644148Z  2025-03-14T06:28:25.7644664Z  2025-03-14T06:28:25.7645057Z  2025-03-14T06:28:25.7645437Z  2025-03-14T06:28:25.7645826Z  2025-03-14T06:28:25.7646708Z [14,075 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:25.7647692Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T06:28:25.7648665Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T06:28:25.7649672Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2025-03-14T06:28:25.7650596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T06:28:25.7651682Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T06:28:25.7652521Z @llvm-project//llvm:llvm-tblgen; 12s local 2025-03-14T06:28:25.7653294Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2025-03-14T06:28:25.7654148Z Compiling llvm/lib/IR/Verifier.cpp; 10s local ... 2025-03-14T06:28:26.0017986Z 2025-03-14T06:28:26.0018893Z  2025-03-14T06:28:26.0019428Z  2025-03-14T06:28:26.0019892Z  2025-03-14T06:28:26.0020343Z  2025-03-14T06:28:26.0020767Z  2025-03-14T06:28:26.0021265Z  2025-03-14T06:28:26.0021630Z  2025-03-14T06:28:26.0022001Z  2025-03-14T06:28:26.0022845Z [14,079 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:26.0023730Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T06:28:26.0024569Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T06:28:26.0025436Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2025-03-14T06:28:26.0026291Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T06:28:26.0027272Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T06:28:26.0028161Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2025-03-14T06:28:26.0029048Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T06:28:26.0029724Z @llvm-project//llvm:llvm-tblgen; 9s local ... 2025-03-14T06:28:26.2351574Z 2025-03-14T06:28:26.2352697Z  2025-03-14T06:28:26.2353349Z  2025-03-14T06:28:26.2353964Z  2025-03-14T06:28:26.2354607Z  2025-03-14T06:28:26.2355050Z  2025-03-14T06:28:26.2355489Z  2025-03-14T06:28:26.2355928Z  2025-03-14T06:28:26.2356367Z  2025-03-14T06:28:26.2357352Z [14,083 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:26.2358257Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 82s local 2025-03-14T06:28:26.2359078Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T06:28:26.2359958Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2025-03-14T06:28:26.2360830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 16s local 2025-03-14T06:28:26.2361817Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 16s local 2025-03-14T06:28:26.2362691Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 10s local 2025-03-14T06:28:26.2363402Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T06:28:26.2364037Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T06:28:26.4421624Z 2025-03-14T06:28:26.4422753Z  2025-03-14T06:28:26.4423613Z  2025-03-14T06:28:26.4424359Z  2025-03-14T06:28:26.4425020Z  2025-03-14T06:28:26.4425489Z  2025-03-14T06:28:26.4426274Z  2025-03-14T06:28:26.4426722Z  2025-03-14T06:28:26.4427168Z  2025-03-14T06:28:26.4428047Z [14,087 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:26.4429085Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T06:28:26.4429962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T06:28:26.4430890Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:26.4431776Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T06:28:26.4432779Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T06:28:26.4433711Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2025-03-14T06:28:26.4434487Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T06:28:26.4435202Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T06:28:26.7649715Z 2025-03-14T06:28:26.7650846Z  2025-03-14T06:28:26.7651531Z  2025-03-14T06:28:26.7652129Z  2025-03-14T06:28:26.7652754Z  2025-03-14T06:28:26.7653198Z  2025-03-14T06:28:26.7653655Z  2025-03-14T06:28:26.7654081Z  2025-03-14T06:28:26.7654556Z  2025-03-14T06:28:26.7655545Z [14,087 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:26.7656825Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T06:28:26.7657798Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T06:28:26.7658825Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:26.7659865Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T06:28:26.7661024Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T06:28:26.7662067Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2025-03-14T06:28:26.7663000Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T06:28:26.7663719Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T06:28:26.9652697Z 2025-03-14T06:28:26.9653684Z  2025-03-14T06:28:26.9654229Z  2025-03-14T06:28:26.9654716Z  2025-03-14T06:28:26.9655145Z  2025-03-14T06:28:26.9655561Z  2025-03-14T06:28:26.9656004Z  2025-03-14T06:28:26.9656439Z  2025-03-14T06:28:26.9656893Z  2025-03-14T06:28:26.9657909Z [14,091 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:26.9659008Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T06:28:26.9660077Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T06:28:26.9661208Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:26.9662326Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T06:28:26.9663565Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T06:28:26.9664701Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2025-03-14T06:28:26.9666025Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T06:28:26.9666837Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T06:28:27.1711997Z 2025-03-14T06:28:27.1713134Z  2025-03-14T06:28:27.1713896Z  2025-03-14T06:28:27.1714565Z  2025-03-14T06:28:27.1715201Z  2025-03-14T06:28:27.1715649Z  2025-03-14T06:28:27.1716093Z  2025-03-14T06:28:27.1716530Z  2025-03-14T06:28:27.1716972Z  2025-03-14T06:28:27.1717936Z [14,094 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:27.1719204Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 83s local 2025-03-14T06:28:27.1720157Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T06:28:27.1721195Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:27.1722390Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 17s local 2025-03-14T06:28:27.1723628Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 17s local 2025-03-14T06:28:27.1725035Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 11s local 2025-03-14T06:28:27.1725888Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T06:28:27.1726687Z @llvm-project//llvm:llvm-tblgen; 10s local ... 2025-03-14T06:28:27.5456812Z 2025-03-14T06:28:27.5457925Z  2025-03-14T06:28:27.5458597Z  2025-03-14T06:28:27.5459231Z  2025-03-14T06:28:27.5459846Z  2025-03-14T06:28:27.5460297Z  2025-03-14T06:28:27.5460782Z  2025-03-14T06:28:27.5461224Z  2025-03-14T06:28:27.5461671Z  2025-03-14T06:28:27.5462642Z [14,096 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:27.5463854Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T06:28:27.5464892Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T06:28:27.5466254Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2025-03-14T06:28:27.5467394Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T06:28:27.5468844Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T06:28:27.5469958Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2025-03-14T06:28:27.5470877Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T06:28:27.5471653Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T06:28:27.7562170Z 2025-03-14T06:28:27.7563300Z  2025-03-14T06:28:27.7564026Z  2025-03-14T06:28:27.7564809Z  2025-03-14T06:28:27.7567014Z  2025-03-14T06:28:27.7567446Z  2025-03-14T06:28:27.7567877Z  2025-03-14T06:28:27.7568256Z  2025-03-14T06:28:27.7568648Z  2025-03-14T06:28:27.7569627Z [14,100 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:27.7570552Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T06:28:27.7571540Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T06:28:27.7572628Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2025-03-14T06:28:27.7573666Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T06:28:27.7574837Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T06:28:27.7575927Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2025-03-14T06:28:27.7576812Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T06:28:27.7577592Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T06:28:27.9662526Z 2025-03-14T06:28:27.9663560Z  2025-03-14T06:28:27.9663988Z  2025-03-14T06:28:27.9664349Z  2025-03-14T06:28:27.9664815Z  2025-03-14T06:28:27.9665273Z  2025-03-14T06:28:27.9667200Z  2025-03-14T06:28:27.9667555Z  2025-03-14T06:28:27.9667908Z  2025-03-14T06:28:27.9668727Z [14,103 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:27.9669578Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T06:28:27.9670516Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T06:28:27.9671596Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2025-03-14T06:28:27.9672586Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T06:28:27.9673560Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T06:28:27.9674752Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2025-03-14T06:28:27.9675469Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T06:28:27.9676111Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T06:28:28.1845717Z 2025-03-14T06:28:28.1847238Z  2025-03-14T06:28:28.1847756Z  2025-03-14T06:28:28.1849250Z  2025-03-14T06:28:28.1850150Z  2025-03-14T06:28:28.1851348Z  2025-03-14T06:28:28.1852078Z  2025-03-14T06:28:28.1852569Z  2025-03-14T06:28:28.1853066Z  2025-03-14T06:28:28.1854084Z [14,107 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:28.1855205Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 84s local 2025-03-14T06:28:28.1856252Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T06:28:28.1857339Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2025-03-14T06:28:28.1858428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 18s local 2025-03-14T06:28:28.1859645Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 18s local 2025-03-14T06:28:28.1860773Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 12s local 2025-03-14T06:28:28.1861647Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T06:28:28.1862378Z @llvm-project//llvm:llvm-tblgen; 11s local ... 2025-03-14T06:28:28.4515768Z 2025-03-14T06:28:28.4517098Z  2025-03-14T06:28:28.4517606Z  2025-03-14T06:28:28.4518006Z  2025-03-14T06:28:28.4518374Z  2025-03-14T06:28:28.4518961Z  2025-03-14T06:28:28.4519350Z  2025-03-14T06:28:28.4519723Z  2025-03-14T06:28:28.4520128Z  2025-03-14T06:28:28.4521070Z [14,112 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:28.4522130Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T06:28:28.4523175Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T06:28:28.4524137Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:28.4525373Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T06:28:28.4526557Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T06:28:28.4527614Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T06:28:28.4528485Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T06:28:28.4529278Z @llvm-project//llvm:llvm-tblgen; 12s local ... 2025-03-14T06:28:28.7636191Z 2025-03-14T06:28:28.7637649Z  2025-03-14T06:28:28.7638147Z  2025-03-14T06:28:28.7639642Z  2025-03-14T06:28:28.7640500Z  2025-03-14T06:28:28.7641739Z  2025-03-14T06:28:28.7642838Z  2025-03-14T06:28:28.7644089Z  2025-03-14T06:28:28.7645382Z  2025-03-14T06:28:28.7647310Z [14,115 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:28.7648306Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T06:28:28.7649234Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T06:28:28.7650279Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:28.7651273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T06:28:28.7652386Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T06:28:28.7653432Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T06:28:28.7654278Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T06:28:28.7655007Z @llvm-project//llvm:llvm-tblgen; 12s local ... 2025-03-14T06:28:28.9669857Z 2025-03-14T06:28:28.9671360Z  2025-03-14T06:28:28.9671872Z  2025-03-14T06:28:28.9673443Z  2025-03-14T06:28:28.9674203Z  2025-03-14T06:28:28.9675563Z  2025-03-14T06:28:28.9676942Z  2025-03-14T06:28:28.9678280Z  2025-03-14T06:28:28.9679554Z  2025-03-14T06:28:28.9681258Z [14,115 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:28.9682637Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T06:28:28.9683660Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T06:28:28.9685081Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:28.9686138Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T06:28:28.9687429Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T06:28:28.9688597Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T06:28:28.9689506Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T06:28:28.9690318Z @llvm-project//llvm:llvm-tblgen; 12s local ... 2025-03-14T06:28:29.2254438Z 2025-03-14T06:28:29.2255317Z  2025-03-14T06:28:29.2255761Z  2025-03-14T06:28:29.2256171Z  2025-03-14T06:28:29.2256578Z  2025-03-14T06:28:29.2256969Z  2025-03-14T06:28:29.2257363Z  2025-03-14T06:28:29.2257800Z  2025-03-14T06:28:29.2258198Z  2025-03-14T06:28:29.2259123Z [14,116 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:29.2260189Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 85s local 2025-03-14T06:28:29.2261235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T06:28:29.2262576Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:29.2263633Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 19s local 2025-03-14T06:28:29.2264855Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 19s local 2025-03-14T06:28:29.2266104Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 13s local 2025-03-14T06:28:29.2266903Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T06:28:29.2267598Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2025-03-14T06:28:29.4459262Z 2025-03-14T06:28:29.4470222Z  2025-03-14T06:28:29.4471202Z  2025-03-14T06:28:29.4471547Z  2025-03-14T06:28:29.4471886Z  2025-03-14T06:28:29.4472214Z  2025-03-14T06:28:29.4472542Z  2025-03-14T06:28:29.4472863Z  2025-03-14T06:28:29.4473183Z  2025-03-14T06:28:29.4473970Z [14,120 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:29.4474779Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:28:29.4475515Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T06:28:29.4476293Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:29.4477065Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T06:28:29.4477934Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:29.4478723Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T06:28:29.4479346Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T06:28:29.4479935Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2025-03-14T06:28:29.7266112Z 2025-03-14T06:28:29.7267008Z  2025-03-14T06:28:29.7267419Z  2025-03-14T06:28:29.7267759Z  2025-03-14T06:28:29.7268395Z  2025-03-14T06:28:29.7268785Z  2025-03-14T06:28:29.7269143Z  2025-03-14T06:28:29.7269488Z  2025-03-14T06:28:29.7269996Z  2025-03-14T06:28:29.7271028Z [14,124 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:29.7272049Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:28:29.7273040Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T06:28:29.7274354Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:29.7275379Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T06:28:29.7276492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:29.7277682Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T06:28:29.7278537Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T06:28:29.7279396Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2025-03-14T06:28:29.9249608Z 2025-03-14T06:28:29.9250441Z  2025-03-14T06:28:29.9250870Z  2025-03-14T06:28:29.9251250Z  2025-03-14T06:28:29.9251608Z  2025-03-14T06:28:29.9251957Z  2025-03-14T06:28:29.9252299Z  2025-03-14T06:28:29.9252635Z  2025-03-14T06:28:29.9252983Z  2025-03-14T06:28:29.9253803Z [14,126 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:29.9254668Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:28:29.9255488Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T06:28:29.9256340Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:29.9257190Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T06:28:29.9258115Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:29.9258966Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T06:28:29.9259648Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T06:28:29.9260503Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2025-03-14T06:28:30.1677683Z 2025-03-14T06:28:30.1678601Z  2025-03-14T06:28:30.1678984Z  2025-03-14T06:28:30.1679314Z  2025-03-14T06:28:30.1679641Z  2025-03-14T06:28:30.1679959Z  2025-03-14T06:28:30.1680279Z  2025-03-14T06:28:30.1680636Z  2025-03-14T06:28:30.1680955Z  2025-03-14T06:28:30.1682098Z [14,128 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:30.1683067Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:28:30.1684021Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T06:28:30.1685111Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:30.1686107Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 20s local 2025-03-14T06:28:30.1687141Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:30.1688105Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T06:28:30.1688880Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T06:28:30.1689583Z @llvm-project//llvm:llvm-tblgen; 13s local ... 2025-03-14T06:28:30.3682024Z 2025-03-14T06:28:30.3682944Z  2025-03-14T06:28:30.3683483Z  2025-03-14T06:28:30.3683866Z  2025-03-14T06:28:30.3684224Z  2025-03-14T06:28:30.3684786Z  2025-03-14T06:28:30.3685213Z  2025-03-14T06:28:30.3685574Z  2025-03-14T06:28:30.3685944Z  2025-03-14T06:28:30.3686784Z [14,130 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:30.3687661Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 86s local 2025-03-14T06:28:30.3688492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T06:28:30.3689349Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:30.3690175Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T06:28:30.3691083Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 20s local 2025-03-14T06:28:30.3691910Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 14s local 2025-03-14T06:28:30.3692597Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T06:28:30.3695507Z @llvm-project//llvm:llvm-tblgen; 14s local ... 2025-03-14T06:28:30.7687946Z 2025-03-14T06:28:30.7688788Z  2025-03-14T06:28:30.7689267Z  2025-03-14T06:28:30.7689668Z  2025-03-14T06:28:30.7690357Z  2025-03-14T06:28:30.7690776Z  2025-03-14T06:28:30.7691149Z  2025-03-14T06:28:30.7691547Z  2025-03-14T06:28:30.7691920Z  2025-03-14T06:28:30.7693004Z [14,134 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:30.7693976Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T06:28:30.7694932Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T06:28:30.7695914Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T06:28:30.7696871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T06:28:30.7698029Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T06:28:30.7699044Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2025-03-14T06:28:30.7699831Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T06:28:30.7700544Z @llvm-project//llvm:llvm-tblgen; 14s local ... 2025-03-14T06:28:30.9692862Z 2025-03-14T06:28:30.9693775Z  2025-03-14T06:28:30.9694283Z  2025-03-14T06:28:30.9694667Z  2025-03-14T06:28:30.9695083Z  2025-03-14T06:28:30.9695465Z  2025-03-14T06:28:30.9695924Z  2025-03-14T06:28:30.9696310Z  2025-03-14T06:28:30.9696709Z  2025-03-14T06:28:30.9697869Z [14,135 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:30.9698907Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T06:28:30.9699826Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T06:28:30.9700807Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T06:28:30.9701818Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T06:28:30.9702876Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T06:28:30.9703868Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2025-03-14T06:28:30.9704720Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T06:28:30.9705412Z @llvm-project//llvm:llvm-tblgen; 14s local ... 2025-03-14T06:28:31.2473393Z 2025-03-14T06:28:31.2474323Z  2025-03-14T06:28:31.2474819Z  2025-03-14T06:28:31.2475228Z  2025-03-14T06:28:31.2475625Z  2025-03-14T06:28:31.2476041Z  2025-03-14T06:28:31.2476453Z  2025-03-14T06:28:31.2476836Z  2025-03-14T06:28:31.2477260Z  2025-03-14T06:28:31.2478247Z [14,142 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:31.2479270Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 87s local 2025-03-14T06:28:31.2480232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T06:28:31.2481185Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T06:28:31.2482196Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 21s local 2025-03-14T06:28:31.2483427Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 21s local 2025-03-14T06:28:31.2484634Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 15s local 2025-03-14T06:28:31.2485466Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T06:28:31.2486210Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2025-03-14T06:28:31.4686337Z 2025-03-14T06:28:31.4687831Z  2025-03-14T06:28:31.4688358Z  2025-03-14T06:28:31.4688738Z  2025-03-14T06:28:31.4689151Z  2025-03-14T06:28:31.4689563Z  2025-03-14T06:28:31.4689959Z  2025-03-14T06:28:31.4690377Z  2025-03-14T06:28:31.4690793Z  2025-03-14T06:28:31.4692017Z [14,147 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:31.4693212Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T06:28:31.4694238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T06:28:31.4695560Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T06:28:31.4696594Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:28:31.4697907Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:31.4698999Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2025-03-14T06:28:31.4699891Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T06:28:31.4700656Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2025-03-14T06:28:31.7118755Z 2025-03-14T06:28:31.7120133Z  2025-03-14T06:28:31.7120644Z  2025-03-14T06:28:31.7121063Z  2025-03-14T06:28:31.7121492Z  2025-03-14T06:28:31.7121915Z  2025-03-14T06:28:31.7122310Z  2025-03-14T06:28:31.7122729Z  2025-03-14T06:28:31.7123154Z  2025-03-14T06:28:31.7124126Z [14,153 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:31.7125349Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T06:28:31.7126348Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T06:28:31.7127424Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T06:28:31.7128463Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:28:31.7129880Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:31.7131011Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2025-03-14T06:28:31.7131869Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T06:28:31.7132598Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2025-03-14T06:28:31.9700865Z 2025-03-14T06:28:31.9701733Z  2025-03-14T06:28:31.9702167Z  2025-03-14T06:28:31.9702561Z  2025-03-14T06:28:31.9702920Z  2025-03-14T06:28:31.9703286Z  2025-03-14T06:28:31.9703641Z  2025-03-14T06:28:31.9704009Z  2025-03-14T06:28:31.9704355Z  2025-03-14T06:28:31.9705248Z [14,154 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:31.9706196Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T06:28:31.9707080Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T06:28:31.9708019Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T06:28:31.9708911Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:28:31.9709872Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:31.9710756Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2025-03-14T06:28:31.9711474Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T06:28:31.9712115Z @llvm-project//llvm:llvm-tblgen; 15s local ... 2025-03-14T06:28:32.2302368Z 2025-03-14T06:28:32.2303252Z  2025-03-14T06:28:32.2303762Z  2025-03-14T06:28:32.2304168Z  2025-03-14T06:28:32.2304603Z  2025-03-14T06:28:32.2305006Z  2025-03-14T06:28:32.2305408Z  2025-03-14T06:28:32.2305810Z  2025-03-14T06:28:32.2306149Z  2025-03-14T06:28:32.2306974Z [14,159 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:32.2307816Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 88s local 2025-03-14T06:28:32.2308611Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T06:28:32.2309430Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T06:28:32.2310240Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 22s local 2025-03-14T06:28:32.2311453Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 22s local 2025-03-14T06:28:32.2312317Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 16s local 2025-03-14T06:28:32.2313002Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T06:28:32.2313777Z @llvm-project//llvm:llvm-tblgen; 16s local ... 2025-03-14T06:28:32.4407449Z 2025-03-14T06:28:32.4408313Z  2025-03-14T06:28:32.4408838Z  2025-03-14T06:28:32.4409270Z  2025-03-14T06:28:32.4409885Z  2025-03-14T06:28:32.4410262Z  2025-03-14T06:28:32.4410669Z  2025-03-14T06:28:32.4411070Z  2025-03-14T06:28:32.4411493Z  2025-03-14T06:28:32.4412478Z [14,161 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:32.4413556Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 89s local 2025-03-14T06:28:32.4414674Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T06:28:32.4415726Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T06:28:32.4416761Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T06:28:32.4417917Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T06:28:32.4418988Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2025-03-14T06:28:32.4419824Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T06:28:32.4420561Z @llvm-project//llvm:llvm-tblgen; 16s local ... 2025-03-14T06:28:32.7709101Z 2025-03-14T06:28:32.7709939Z  2025-03-14T06:28:32.7710547Z  2025-03-14T06:28:32.7711261Z  2025-03-14T06:28:32.7711780Z  2025-03-14T06:28:32.7712171Z  2025-03-14T06:28:32.7712552Z  2025-03-14T06:28:32.7712922Z  2025-03-14T06:28:32.7713303Z  2025-03-14T06:28:32.7714441Z [14,165 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:32.7715466Z Compiling src/cpu/x64/jit_brgemm_conv.cpp; 89s local 2025-03-14T06:28:32.7716500Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:32.7717562Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T06:28:32.7718610Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T06:28:32.7719786Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T06:28:32.7720841Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2025-03-14T06:28:32.7721784Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T06:28:32.7722702Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local ... 2025-03-14T06:28:32.9712848Z 2025-03-14T06:28:32.9713730Z  2025-03-14T06:28:32.9714247Z  2025-03-14T06:28:32.9714696Z  2025-03-14T06:28:32.9715138Z  2025-03-14T06:28:32.9715552Z  2025-03-14T06:28:32.9715986Z  2025-03-14T06:28:32.9716401Z  2025-03-14T06:28:32.9716822Z  2025-03-14T06:28:32.9717810Z [14,170 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:32.9719051Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:32.9720113Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T06:28:32.9721124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T06:28:32.9722280Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T06:28:32.9723334Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2025-03-14T06:28:32.9724178Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T06:28:32.9725169Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T06:28:32.9726126Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local ... 2025-03-14T06:28:33.2170409Z 2025-03-14T06:28:33.2171540Z  2025-03-14T06:28:33.2172075Z  2025-03-14T06:28:33.2172502Z  2025-03-14T06:28:33.2172917Z  2025-03-14T06:28:33.2173338Z  2025-03-14T06:28:33.2173762Z  2025-03-14T06:28:33.2174187Z  2025-03-14T06:28:33.2174605Z  2025-03-14T06:28:33.2175796Z [14,172 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:33.2177016Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:33.2178250Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T06:28:33.2179326Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 23s local 2025-03-14T06:28:33.2180484Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 23s local 2025-03-14T06:28:33.2181557Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 17s local 2025-03-14T06:28:33.2182378Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T06:28:33.2183158Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T06:28:33.2184110Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local ... 2025-03-14T06:28:33.4668293Z 2025-03-14T06:28:33.4669228Z  2025-03-14T06:28:33.4669734Z  2025-03-14T06:28:33.4670144Z  2025-03-14T06:28:33.4670527Z  2025-03-14T06:28:33.4670922Z  2025-03-14T06:28:33.4671331Z  2025-03-14T06:28:33.4671729Z  2025-03-14T06:28:33.4672104Z  2025-03-14T06:28:33.4673076Z [14,179 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:33.4674542Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:33.4675558Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:33.4676573Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T06:28:33.4677712Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:33.4678718Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T06:28:33.4679545Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T06:28:33.4680380Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 15s local 2025-03-14T06:28:33.4681299Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local ... 2025-03-14T06:28:33.7259054Z 2025-03-14T06:28:33.7259968Z  2025-03-14T06:28:33.7260489Z  2025-03-14T06:28:33.7260931Z  2025-03-14T06:28:33.7261395Z  2025-03-14T06:28:33.7261830Z  2025-03-14T06:28:33.7262223Z  2025-03-14T06:28:33.7262598Z  2025-03-14T06:28:33.7263017Z  2025-03-14T06:28:33.7264004Z [14,182 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:33.7265147Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:33.7266430Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:33.7267498Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T06:28:33.7268717Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:33.7269834Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T06:28:33.7270688Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:28:33.7271485Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:28:33.7272472Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 14s local ... 2025-03-14T06:28:33.9426401Z 2025-03-14T06:28:33.9427607Z  2025-03-14T06:28:33.9428423Z  2025-03-14T06:28:33.9429095Z  2025-03-14T06:28:33.9429738Z  2025-03-14T06:28:33.9430334Z  2025-03-14T06:28:33.9547622Z  2025-03-14T06:28:33.9548149Z  2025-03-14T06:28:33.9548589Z  2025-03-14T06:28:33.9549726Z [14,186 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:33.9551200Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:33.9552249Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:33.9553437Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T06:28:33.9554642Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:33.9555676Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T06:28:33.9556702Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:28:33.9557540Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:28:33.9558541Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local ... 2025-03-14T06:28:34.1735880Z 2025-03-14T06:28:34.1736862Z  2025-03-14T06:28:34.1737420Z  2025-03-14T06:28:34.1737856Z  2025-03-14T06:28:34.1738283Z  2025-03-14T06:28:34.1738723Z  2025-03-14T06:28:34.1739186Z  2025-03-14T06:28:34.1739640Z  2025-03-14T06:28:34.1740060Z  2025-03-14T06:28:34.1741081Z [14,189 / 20,650] 3 / 17 tests; 46 actions, 45 running; last test: ...ash_test 2025-03-14T06:28:34.1742375Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:34.1743511Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:34.1744605Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 24s local 2025-03-14T06:28:34.1745830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:34.1748149Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T06:28:34.1749145Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:28:34.1750022Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:28:34.1751025Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local ... 2025-03-14T06:28:34.3726768Z 2025-03-14T06:28:34.3727617Z  2025-03-14T06:28:34.3728114Z  2025-03-14T06:28:34.3728500Z  2025-03-14T06:28:34.3728903Z  2025-03-14T06:28:34.3729308Z  2025-03-14T06:28:34.3729741Z  2025-03-14T06:28:34.3730132Z  2025-03-14T06:28:34.3730571Z  2025-03-14T06:28:34.3731544Z [14,191 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:34.3732690Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:34.3733685Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:34.3734709Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T06:28:34.3735810Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 24s local 2025-03-14T06:28:34.3736819Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 18s local 2025-03-14T06:28:34.3737628Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:28:34.3738427Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:28:34.3739344Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local ... 2025-03-14T06:28:34.5736488Z 2025-03-14T06:28:34.5737301Z  2025-03-14T06:28:34.5737762Z  2025-03-14T06:28:34.5738197Z  2025-03-14T06:28:34.5738590Z  2025-03-14T06:28:34.5739030Z  2025-03-14T06:28:34.5739436Z  2025-03-14T06:28:34.5739840Z  2025-03-14T06:28:34.5740243Z  2025-03-14T06:28:34.5741222Z [14,193 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:34.5742417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:34.5743457Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T06:28:34.5744470Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T06:28:34.5745568Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T06:28:34.5746926Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2025-03-14T06:28:34.5747749Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:28:34.5748539Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 16s local 2025-03-14T06:28:34.5749665Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 15s local ... 2025-03-14T06:28:34.8804873Z 2025-03-14T06:28:34.8805722Z  2025-03-14T06:28:34.8806224Z  2025-03-14T06:28:34.8806640Z  2025-03-14T06:28:34.8807324Z  2025-03-14T06:28:34.8807735Z  2025-03-14T06:28:34.8808122Z  2025-03-14T06:28:34.8808492Z  2025-03-14T06:28:34.8808878Z  2025-03-14T06:28:34.8809804Z [14,198 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:34.8810913Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T06:28:34.8811877Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T06:28:34.8812876Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T06:28:34.8813947Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T06:28:34.8814932Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2025-03-14T06:28:34.8815769Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2025-03-14T06:28:34.8816566Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:28:34.8817453Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local ... 2025-03-14T06:28:35.1105586Z 2025-03-14T06:28:35.1106408Z  2025-03-14T06:28:35.1106887Z  2025-03-14T06:28:35.1107529Z  2025-03-14T06:28:35.1107915Z  2025-03-14T06:28:35.1108294Z  2025-03-14T06:28:35.1108680Z  2025-03-14T06:28:35.1109068Z  2025-03-14T06:28:35.1109457Z  2025-03-14T06:28:35.1110394Z [14,200 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:35.1111613Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T06:28:35.1112679Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T06:28:35.1113726Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 25s local 2025-03-14T06:28:35.1114891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T06:28:35.1115946Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2025-03-14T06:28:35.1116692Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2025-03-14T06:28:35.1117545Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:28:35.1118460Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local ... 2025-03-14T06:28:35.3734355Z 2025-03-14T06:28:35.3735229Z  2025-03-14T06:28:35.3735928Z  2025-03-14T06:28:35.3736368Z  2025-03-14T06:28:35.3736777Z  2025-03-14T06:28:35.3737168Z  2025-03-14T06:28:35.3737620Z  2025-03-14T06:28:35.3738040Z  2025-03-14T06:28:35.3738460Z  2025-03-14T06:28:35.3739458Z [14,202 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:35.3740654Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T06:28:35.3741755Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T06:28:35.3742834Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T06:28:35.3744038Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 25s local 2025-03-14T06:28:35.3745103Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 19s local 2025-03-14T06:28:35.3746065Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:28:35.3746971Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2025-03-14T06:28:35.3747943Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2025-03-14T06:28:35.6022009Z 2025-03-14T06:28:35.6022829Z  2025-03-14T06:28:35.6023334Z  2025-03-14T06:28:35.6023763Z  2025-03-14T06:28:35.6024216Z  2025-03-14T06:28:35.6024635Z  2025-03-14T06:28:35.6025055Z  2025-03-14T06:28:35.6025470Z  2025-03-14T06:28:35.6026178Z  2025-03-14T06:28:35.6027141Z [14,205 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:35.6028539Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T06:28:35.6029613Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:35.6030692Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T06:28:35.6031825Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:35.6032818Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2025-03-14T06:28:35.6033744Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 17s local 2025-03-14T06:28:35.6034675Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 16s local 2025-03-14T06:28:35.6035638Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2025-03-14T06:28:35.8356704Z 2025-03-14T06:28:35.8357624Z  2025-03-14T06:28:35.8358200Z  2025-03-14T06:28:35.8358621Z  2025-03-14T06:28:35.8359076Z  2025-03-14T06:28:35.8359584Z  2025-03-14T06:28:35.8360220Z  2025-03-14T06:28:35.8360633Z  2025-03-14T06:28:35.8361161Z  2025-03-14T06:28:35.8362222Z [14,208 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:35.8363866Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T06:28:35.8365246Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:35.8366483Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T06:28:35.8367608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:35.8368644Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2025-03-14T06:28:35.8369544Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T06:28:35.8370582Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:28:35.8371681Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 13s local ... 2025-03-14T06:28:36.1017843Z 2025-03-14T06:28:36.1018731Z  2025-03-14T06:28:36.1019249Z  2025-03-14T06:28:36.1019735Z  2025-03-14T06:28:36.1020143Z  2025-03-14T06:28:36.1020542Z  2025-03-14T06:28:36.1020954Z  2025-03-14T06:28:36.1021403Z  2025-03-14T06:28:36.1021846Z  2025-03-14T06:28:36.1022848Z [14,211 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:36.1024117Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T06:28:36.1025135Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:36.1026199Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 26s local 2025-03-14T06:28:36.1027327Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:36.1028426Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2025-03-14T06:28:36.1029323Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T06:28:36.1030126Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:28:36.1031042Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2025-03-14T06:28:36.3553903Z 2025-03-14T06:28:36.3554634Z  2025-03-14T06:28:36.3554947Z  2025-03-14T06:28:36.3555206Z  2025-03-14T06:28:36.3555457Z  2025-03-14T06:28:36.3555703Z  2025-03-14T06:28:36.3555951Z  2025-03-14T06:28:36.3556198Z  2025-03-14T06:28:36.3556451Z  2025-03-14T06:28:36.3557027Z [14,214 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:36.3557917Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T06:28:36.3558525Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:36.3559179Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T06:28:36.3559825Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 26s local 2025-03-14T06:28:36.3560524Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 20s local 2025-03-14T06:28:36.3561060Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T06:28:36.3561595Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:28:36.3562137Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2025-03-14T06:28:36.5628650Z 2025-03-14T06:28:36.5629528Z  2025-03-14T06:28:36.5630076Z  2025-03-14T06:28:36.5630497Z  2025-03-14T06:28:36.5630978Z  2025-03-14T06:28:36.5631431Z  2025-03-14T06:28:36.5631862Z  2025-03-14T06:28:36.5632305Z  2025-03-14T06:28:36.5632739Z  2025-03-14T06:28:36.5633739Z [14,217 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:36.5634993Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T06:28:36.5636079Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T06:28:36.5637196Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T06:28:36.5638684Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T06:28:36.5639824Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2025-03-14T06:28:36.5640826Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 18s local 2025-03-14T06:28:36.5642086Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:28:36.5643097Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2025-03-14T06:28:36.7743611Z 2025-03-14T06:28:36.7744436Z  2025-03-14T06:28:36.7744944Z  2025-03-14T06:28:36.7745400Z  2025-03-14T06:28:36.7745838Z  2025-03-14T06:28:36.7746274Z  2025-03-14T06:28:36.7746718Z  2025-03-14T06:28:36.7747131Z  2025-03-14T06:28:36.7747542Z  2025-03-14T06:28:36.7748495Z [14,218 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:36.7749777Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T06:28:36.7750895Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T06:28:36.7752007Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T06:28:36.7753137Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T06:28:36.7754182Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2025-03-14T06:28:36.7755131Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T06:28:36.7756130Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 17s local 2025-03-14T06:28:36.7757115Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 14s local ... 2025-03-14T06:28:37.0677823Z 2025-03-14T06:28:37.0678696Z  2025-03-14T06:28:37.0679170Z  2025-03-14T06:28:37.0679556Z  2025-03-14T06:28:37.0679968Z  2025-03-14T06:28:37.0680370Z  2025-03-14T06:28:37.0680781Z  2025-03-14T06:28:37.0681227Z  2025-03-14T06:28:37.0681628Z  2025-03-14T06:28:37.0682693Z [14,220 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:37.0683837Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T06:28:37.0684948Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T06:28:37.0685895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 27s local 2025-03-14T06:28:37.0687208Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T06:28:37.0688081Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2025-03-14T06:28:37.0688865Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T06:28:37.0689741Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T06:28:37.0690543Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T06:28:37.3750498Z 2025-03-14T06:28:37.3751678Z  2025-03-14T06:28:37.3752297Z  2025-03-14T06:28:37.3752747Z  2025-03-14T06:28:37.3753186Z  2025-03-14T06:28:37.3753645Z  2025-03-14T06:28:37.3754071Z  2025-03-14T06:28:37.3754508Z  2025-03-14T06:28:37.3754926Z  2025-03-14T06:28:37.3755925Z [14,226 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:37.3757205Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T06:28:37.3758315Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T06:28:37.3759410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T06:28:37.3760608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 27s local 2025-03-14T06:28:37.3761695Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 21s local 2025-03-14T06:28:37.3762638Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T06:28:37.3763606Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T06:28:37.3765003Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T06:28:37.5754428Z 2025-03-14T06:28:37.5755266Z  2025-03-14T06:28:37.5755764Z  2025-03-14T06:28:37.5756196Z  2025-03-14T06:28:37.5756630Z  2025-03-14T06:28:37.5757062Z  2025-03-14T06:28:37.5757461Z  2025-03-14T06:28:37.5757892Z  2025-03-14T06:28:37.5758350Z  2025-03-14T06:28:37.5759363Z [14,230 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:37.5760665Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T06:28:37.5761771Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T06:28:37.5762877Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T06:28:37.5764022Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T06:28:37.5765274Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T06:28:37.5766469Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 19s local 2025-03-14T06:28:37.5767423Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 18s local 2025-03-14T06:28:37.5768413Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T06:28:37.8268636Z 2025-03-14T06:28:37.8269509Z  2025-03-14T06:28:37.8270050Z  2025-03-14T06:28:37.8270490Z  2025-03-14T06:28:37.8270925Z  2025-03-14T06:28:37.8271344Z  2025-03-14T06:28:37.8271766Z  2025-03-14T06:28:37.8272177Z  2025-03-14T06:28:37.8272593Z  2025-03-14T06:28:37.8273579Z [14,232 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:37.8274802Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T06:28:37.8276057Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T06:28:37.8277127Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T06:28:37.8278309Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T06:28:37.8279400Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T06:28:37.8280324Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T06:28:37.8281284Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T06:28:37.8282572Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 15s local ... 2025-03-14T06:28:38.0285421Z 2025-03-14T06:28:38.0286290Z  2025-03-14T06:28:38.0286796Z  2025-03-14T06:28:38.0287527Z  2025-03-14T06:28:38.0287930Z  2025-03-14T06:28:38.0288331Z  2025-03-14T06:28:38.0288734Z  2025-03-14T06:28:38.0289149Z  2025-03-14T06:28:38.0289559Z  2025-03-14T06:28:38.0290671Z [14,238 / 20,650] 3 / 17 tests; 48 actions, 46 running; last test: ...ash_test 2025-03-14T06:28:38.0291889Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T06:28:38.0292954Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T06:28:38.0293951Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T06:28:38.0295075Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T06:28:38.0296154Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T06:28:38.0297096Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T06:28:38.0298029Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T06:28:38.0299023Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2025-03-14T06:28:38.3147164Z 2025-03-14T06:28:38.3148008Z  2025-03-14T06:28:38.3148532Z  2025-03-14T06:28:38.3148959Z  2025-03-14T06:28:38.3149391Z  2025-03-14T06:28:38.3149842Z  2025-03-14T06:28:38.3150279Z  2025-03-14T06:28:38.3150700Z  2025-03-14T06:28:38.3151100Z  2025-03-14T06:28:38.3152497Z [14,245 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:38.3153835Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T06:28:38.3154877Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T06:28:38.3155939Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 28s local 2025-03-14T06:28:38.3157113Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 28s local 2025-03-14T06:28:38.3158184Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 22s local 2025-03-14T06:28:38.3159120Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T06:28:38.3160059Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T06:28:38.3161041Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2025-03-14T06:28:38.5160733Z 2025-03-14T06:28:38.5161549Z  2025-03-14T06:28:38.5162018Z  2025-03-14T06:28:38.5162440Z  2025-03-14T06:28:38.5162859Z  2025-03-14T06:28:38.5163215Z  2025-03-14T06:28:38.5163598Z  2025-03-14T06:28:38.5163985Z  2025-03-14T06:28:38.5164400Z  2025-03-14T06:28:38.5165594Z [14,248 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:38.5166528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T06:28:38.5167329Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T06:28:38.5168142Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T06:28:38.5169223Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:38.5170068Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T06:28:38.5170869Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 20s local 2025-03-14T06:28:38.5171664Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T06:28:38.5172525Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2025-03-14T06:28:38.7450418Z 2025-03-14T06:28:38.7451318Z  2025-03-14T06:28:38.7451845Z  2025-03-14T06:28:38.7452267Z  2025-03-14T06:28:38.7452681Z  2025-03-14T06:28:38.7453106Z  2025-03-14T06:28:38.7453836Z  2025-03-14T06:28:38.7454265Z  2025-03-14T06:28:38.7454685Z  2025-03-14T06:28:38.7455686Z [14,252 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:38.7456861Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:38.7458066Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T06:28:38.7459088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T06:28:38.7461976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:38.7463160Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T06:28:38.7464131Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:28:38.7465090Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 19s local 2025-03-14T06:28:38.7466350Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 16s local ... 2025-03-14T06:28:38.9763913Z 2025-03-14T06:28:38.9764984Z  2025-03-14T06:28:38.9765751Z  2025-03-14T06:28:38.9766184Z  2025-03-14T06:28:38.9766626Z  2025-03-14T06:28:38.9767048Z  2025-03-14T06:28:38.9767481Z  2025-03-14T06:28:38.9767959Z  2025-03-14T06:28:38.9768602Z  2025-03-14T06:28:38.9769590Z [14,256 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:38.9770828Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:38.9771890Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T06:28:38.9773338Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T06:28:38.9774476Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:38.9775532Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T06:28:38.9776453Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:28:38.9777433Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T06:28:38.9778409Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T06:28:39.2062975Z 2025-03-14T06:28:39.2064043Z  2025-03-14T06:28:39.2064545Z  2025-03-14T06:28:39.2064976Z  2025-03-14T06:28:39.2065619Z  2025-03-14T06:28:39.2066042Z  2025-03-14T06:28:39.2066437Z  2025-03-14T06:28:39.2066846Z  2025-03-14T06:28:39.2067239Z  2025-03-14T06:28:39.2068215Z [14,259 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:39.2069425Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:39.2070492Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T06:28:39.2071522Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 29s local 2025-03-14T06:28:39.2072689Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 29s local 2025-03-14T06:28:39.2073760Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 23s local 2025-03-14T06:28:39.2074694Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:28:39.2075608Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T06:28:39.2076550Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T06:28:39.4200601Z 2025-03-14T06:28:39.4201480Z  2025-03-14T06:28:39.4202012Z  2025-03-14T06:28:39.4202495Z  2025-03-14T06:28:39.4202923Z  2025-03-14T06:28:39.4203329Z  2025-03-14T06:28:39.4203741Z  2025-03-14T06:28:39.4204191Z  2025-03-14T06:28:39.4204757Z  2025-03-14T06:28:39.4205704Z [14,262 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:39.4206925Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:39.4208294Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:39.4209375Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T06:28:39.4210541Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:39.4211789Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T06:28:39.4212728Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:28:39.4213812Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T06:28:39.4214738Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T06:28:39.6301632Z 2025-03-14T06:28:39.6302497Z  2025-03-14T06:28:39.6303026Z  2025-03-14T06:28:39.6303466Z  2025-03-14T06:28:39.6303920Z  2025-03-14T06:28:39.6304374Z  2025-03-14T06:28:39.6304823Z  2025-03-14T06:28:39.6305265Z  2025-03-14T06:28:39.6305722Z  2025-03-14T06:28:39.6306761Z [14,267 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:39.6308039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:39.6309329Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:39.6310594Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T06:28:39.6311845Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:39.6312977Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T06:28:39.6313962Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 21s local 2025-03-14T06:28:39.6315275Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 20s local 2025-03-14T06:28:39.6316313Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T06:28:39.8537274Z 2025-03-14T06:28:39.8538148Z  2025-03-14T06:28:39.8538672Z  2025-03-14T06:28:39.8539126Z  2025-03-14T06:28:39.8539586Z  2025-03-14T06:28:39.8540032Z  2025-03-14T06:28:39.8540464Z  2025-03-14T06:28:39.8551745Z  2025-03-14T06:28:39.8552246Z  2025-03-14T06:28:39.8553164Z [14,272 / 20,650] 3 / 17 tests; 47 actions, 46 running; last test: ...ash_test 2025-03-14T06:28:39.8554414Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T06:28:39.8555457Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:39.8556545Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T06:28:39.8557714Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:39.8558829Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T06:28:39.8559809Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T06:28:39.8560776Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T06:28:39.8561780Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 17s local ... 2025-03-14T06:28:40.1772991Z 2025-03-14T06:28:40.1773861Z  2025-03-14T06:28:40.1774350Z  2025-03-14T06:28:40.1774783Z  2025-03-14T06:28:40.1775210Z  2025-03-14T06:28:40.1775651Z  2025-03-14T06:28:40.1776089Z  2025-03-14T06:28:40.1776526Z  2025-03-14T06:28:40.1776952Z  2025-03-14T06:28:40.1777954Z [14,274 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:40.1779245Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T06:28:40.1780305Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:40.1781393Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 30s local 2025-03-14T06:28:40.1782592Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:40.1783699Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 24s local 2025-03-14T06:28:40.1784975Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T06:28:40.1785905Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T06:28:40.1786857Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local ... 2025-03-14T06:28:40.3777403Z 2025-03-14T06:28:40.3778299Z  2025-03-14T06:28:40.3778828Z  2025-03-14T06:28:40.3779279Z  2025-03-14T06:28:40.3779693Z  2025-03-14T06:28:40.3780123Z  2025-03-14T06:28:40.3780864Z  2025-03-14T06:28:40.3781310Z  2025-03-14T06:28:40.3781730Z  2025-03-14T06:28:40.3782728Z [14,275 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:40.3783969Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T06:28:40.3785020Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:40.3786049Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T06:28:40.3787154Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 30s local 2025-03-14T06:28:40.3788164Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T06:28:40.3789064Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T06:28:40.3790011Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T06:28:40.3790959Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local ... 2025-03-14T06:28:40.6510209Z 2025-03-14T06:28:40.6511127Z  2025-03-14T06:28:40.6511601Z  2025-03-14T06:28:40.6512027Z  2025-03-14T06:28:40.6512429Z  2025-03-14T06:28:40.6513105Z  2025-03-14T06:28:40.6513567Z  2025-03-14T06:28:40.6513957Z  2025-03-14T06:28:40.6514358Z  2025-03-14T06:28:40.6515333Z [14,277 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:40.6516455Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T06:28:40.6517483Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T06:28:40.6518618Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T06:28:40.6519768Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T06:28:40.6520789Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T06:28:40.6521713Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 22s local 2025-03-14T06:28:40.6522670Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 21s local 2025-03-14T06:28:40.6523656Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local ... 2025-03-14T06:28:40.9032103Z 2025-03-14T06:28:40.9032990Z  2025-03-14T06:28:40.9033524Z  2025-03-14T06:28:40.9033971Z  2025-03-14T06:28:40.9034395Z  2025-03-14T06:28:40.9034823Z  2025-03-14T06:28:40.9035248Z  2025-03-14T06:28:40.9035659Z  2025-03-14T06:28:40.9036098Z  2025-03-14T06:28:40.9037042Z [14,282 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:40.9038211Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T06:28:40.9039275Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T06:28:40.9040445Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T06:28:40.9041639Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T06:28:40.9042850Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T06:28:40.9043800Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T06:28:40.9044908Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T06:28:40.9045883Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 18s local ... 2025-03-14T06:28:41.1784148Z 2025-03-14T06:28:41.1785005Z  2025-03-14T06:28:41.1785838Z  2025-03-14T06:28:41.1786255Z  2025-03-14T06:28:41.1786674Z  2025-03-14T06:28:41.1787099Z  2025-03-14T06:28:41.1787520Z  2025-03-14T06:28:41.1787932Z  2025-03-14T06:28:41.1788367Z  2025-03-14T06:28:41.1789536Z [14,288 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:41.1790798Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T06:28:41.1792052Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T06:28:41.1793134Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 31s local 2025-03-14T06:28:41.1794302Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T06:28:41.1795346Z Compiling xla/service/cpu/runtime_matmul_c128.cc; 25s local 2025-03-14T06:28:41.1796300Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T06:28:41.1797235Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T06:28:41.1798223Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local ... 2025-03-14T06:28:41.3830898Z 2025-03-14T06:28:41.3831791Z  2025-03-14T06:28:41.3832303Z  2025-03-14T06:28:41.3832760Z  2025-03-14T06:28:41.3833181Z  2025-03-14T06:28:41.3833565Z  2025-03-14T06:28:41.3833975Z  2025-03-14T06:28:41.3834388Z  2025-03-14T06:28:41.3834805Z  2025-03-14T06:28:41.3835815Z [14,292 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:41.3837288Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T06:28:41.3838412Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T06:28:41.3839488Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2025-03-14T06:28:41.3840668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 31s local 2025-03-14T06:28:41.3841736Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 23s local 2025-03-14T06:28:41.3842652Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T06:28:41.3843581Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2025-03-14T06:28:41.3844560Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local ... 2025-03-14T06:28:41.7790716Z 2025-03-14T06:28:41.7791636Z  2025-03-14T06:28:41.7792131Z  2025-03-14T06:28:41.7792550Z  2025-03-14T06:28:41.7793004Z  2025-03-14T06:28:41.7793435Z  2025-03-14T06:28:41.7793877Z  2025-03-14T06:28:41.7794279Z  2025-03-14T06:28:41.7794696Z  2025-03-14T06:28:41.7795575Z [14,296 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:41.7796617Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:28:41.7797769Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T06:28:41.7798918Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2025-03-14T06:28:41.7800084Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T06:28:41.7801109Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:28:41.7802044Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 22s local 2025-03-14T06:28:41.7802942Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 19s local 2025-03-14T06:28:41.7803921Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local ... 2025-03-14T06:28:41.9794555Z 2025-03-14T06:28:41.9795394Z  2025-03-14T06:28:41.9795914Z  2025-03-14T06:28:41.9796367Z  2025-03-14T06:28:41.9796770Z  2025-03-14T06:28:41.9797172Z  2025-03-14T06:28:41.9797555Z  2025-03-14T06:28:41.9797936Z  2025-03-14T06:28:41.9798320Z  2025-03-14T06:28:41.9799279Z [14,298 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:41.9800765Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:28:41.9801813Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T06:28:41.9802832Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2025-03-14T06:28:41.9804124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T06:28:41.9805331Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:28:41.9806385Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T06:28:41.9807270Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2025-03-14T06:28:41.9808426Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 15s local ... 2025-03-14T06:28:42.2751262Z 2025-03-14T06:28:42.2752164Z  2025-03-14T06:28:42.2752671Z  2025-03-14T06:28:42.2753104Z  2025-03-14T06:28:42.2753510Z  2025-03-14T06:28:42.2753933Z  2025-03-14T06:28:42.2754395Z  2025-03-14T06:28:42.2754768Z  2025-03-14T06:28:42.2755135Z  2025-03-14T06:28:42.2756135Z [14,299 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:42.2757399Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:28:42.2758454Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T06:28:42.2759464Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 32s local 2025-03-14T06:28:42.2760516Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 32s local 2025-03-14T06:28:42.2761839Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:28:42.2762740Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T06:28:42.2763597Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2025-03-14T06:28:42.2764520Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local ... 2025-03-14T06:28:42.5801197Z 2025-03-14T06:28:42.5802194Z  2025-03-14T06:28:42.5802731Z  2025-03-14T06:28:42.5803175Z  2025-03-14T06:28:42.5803631Z  2025-03-14T06:28:42.5804081Z  2025-03-14T06:28:42.5804521Z  2025-03-14T06:28:42.5805171Z  2025-03-14T06:28:42.5805618Z  2025-03-14T06:28:42.5806641Z [14,303 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:42.5808140Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:28:42.5809229Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:28:42.5810175Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T06:28:42.5811388Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T06:28:42.5812466Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 24s local 2025-03-14T06:28:42.5813441Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T06:28:42.5814427Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2025-03-14T06:28:42.5815412Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local ... 2025-03-14T06:28:42.7804988Z 2025-03-14T06:28:42.7805866Z  2025-03-14T06:28:42.7806409Z  2025-03-14T06:28:42.7806784Z  2025-03-14T06:28:42.7807147Z  2025-03-14T06:28:42.7807505Z  2025-03-14T06:28:42.7807854Z  2025-03-14T06:28:42.7808161Z  2025-03-14T06:28:42.7808526Z  2025-03-14T06:28:42.7809431Z [14,308 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:42.7810663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T06:28:42.7811691Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:28:42.7812743Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T06:28:42.7814167Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T06:28:42.7815243Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T06:28:42.7816196Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 23s local 2025-03-14T06:28:42.7817202Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 20s local 2025-03-14T06:28:42.7818088Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local ... 2025-03-14T06:28:43.0458663Z 2025-03-14T06:28:43.0459551Z  2025-03-14T06:28:43.0460075Z  2025-03-14T06:28:43.0460722Z  2025-03-14T06:28:43.0461151Z  2025-03-14T06:28:43.0461550Z  2025-03-14T06:28:43.0461941Z  2025-03-14T06:28:43.0462370Z  2025-03-14T06:28:43.0462774Z  2025-03-14T06:28:43.0463701Z [14,314 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:43.0464888Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T06:28:43.0466372Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:28:43.0467342Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T06:28:43.0468434Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T06:28:43.0469457Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T06:28:43.0470362Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T06:28:43.0471242Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:43.0472183Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 16s local ... 2025-03-14T06:28:43.2929348Z 2025-03-14T06:28:43.2930368Z  2025-03-14T06:28:43.2930890Z  2025-03-14T06:28:43.2931321Z  2025-03-14T06:28:43.2931742Z  2025-03-14T06:28:43.2932167Z  2025-03-14T06:28:43.2932583Z  2025-03-14T06:28:43.2932982Z  2025-03-14T06:28:43.2933394Z  2025-03-14T06:28:43.2934373Z [14,318 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:43.2935621Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T06:28:43.2936641Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:28:43.2937676Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 33s local 2025-03-14T06:28:43.2938955Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 33s local 2025-03-14T06:28:43.2940057Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T06:28:43.2941026Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T06:28:43.2942025Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:43.2943139Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local ... 2025-03-14T06:28:43.5807335Z 2025-03-14T06:28:43.5808639Z  2025-03-14T06:28:43.5809402Z  2025-03-14T06:28:43.5810060Z  2025-03-14T06:28:43.5810663Z  2025-03-14T06:28:43.5811995Z  2025-03-14T06:28:43.5812608Z  2025-03-14T06:28:43.5813211Z  2025-03-14T06:28:43.5813786Z  2025-03-14T06:28:43.5814964Z [14,324 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:43.5816459Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T06:28:43.5817750Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T06:28:43.5819114Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T06:28:43.5820520Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:43.5821789Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 25s local 2025-03-14T06:28:43.5825790Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T06:28:43.5827166Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:43.5828781Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local ... 2025-03-14T06:28:43.7813858Z 2025-03-14T06:28:43.7814714Z  2025-03-14T06:28:43.7815222Z  2025-03-14T06:28:43.7815651Z  2025-03-14T06:28:43.7816066Z  2025-03-14T06:28:43.7816813Z  2025-03-14T06:28:43.7817216Z  2025-03-14T06:28:43.7817598Z  2025-03-14T06:28:43.7818004Z  2025-03-14T06:28:43.7818994Z [14,326 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:43.7820409Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:28:43.7821478Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T06:28:43.7822467Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T06:28:43.7823567Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:43.7824592Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:43.7825535Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 24s local 2025-03-14T06:28:43.7826439Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 21s local 2025-03-14T06:28:43.7827408Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local ... 2025-03-14T06:28:44.0051712Z 2025-03-14T06:28:44.0052531Z  2025-03-14T06:28:44.0053001Z  2025-03-14T06:28:44.0053404Z  2025-03-14T06:28:44.0053804Z  2025-03-14T06:28:44.0054198Z  2025-03-14T06:28:44.0054583Z  2025-03-14T06:28:44.0055004Z  2025-03-14T06:28:44.0055380Z  2025-03-14T06:28:44.0056594Z [14,329 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:44.0057775Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:28:44.0058799Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T06:28:44.0059729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T06:28:44.0060819Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:44.0061820Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:44.0062671Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T06:28:44.0063618Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2025-03-14T06:28:44.0064555Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 17s local ... 2025-03-14T06:28:44.2200285Z 2025-03-14T06:28:44.2201201Z  2025-03-14T06:28:44.2201728Z  2025-03-14T06:28:44.2202117Z  2025-03-14T06:28:44.2202529Z  2025-03-14T06:28:44.2202963Z  2025-03-14T06:28:44.2203404Z  2025-03-14T06:28:44.2203832Z  2025-03-14T06:28:44.2204249Z  2025-03-14T06:28:44.2205391Z [14,332 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:44.2206624Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:28:44.2207715Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T06:28:44.2208903Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 34s local 2025-03-14T06:28:44.2210070Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 34s local 2025-03-14T06:28:44.2211102Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:44.2212041Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T06:28:44.2212995Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2025-03-14T06:28:44.2214130Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local ... 2025-03-14T06:28:44.4203694Z 2025-03-14T06:28:44.4204552Z  2025-03-14T06:28:44.4205203Z  2025-03-14T06:28:44.4205638Z  2025-03-14T06:28:44.4206074Z  2025-03-14T06:28:44.4206480Z  2025-03-14T06:28:44.4206903Z  2025-03-14T06:28:44.4207331Z  2025-03-14T06:28:44.4208047Z  2025-03-14T06:28:44.4209034Z [14,335 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:44.4210267Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:28:44.4211480Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:28:44.4212515Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T06:28:44.4213826Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T06:28:44.4214903Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 26s local 2025-03-14T06:28:44.4215859Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T06:28:44.4216794Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2025-03-14T06:28:44.4217771Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local ... 2025-03-14T06:28:44.6668978Z 2025-03-14T06:28:44.6669875Z  2025-03-14T06:28:44.6670414Z  2025-03-14T06:28:44.6670851Z  2025-03-14T06:28:44.6671278Z  2025-03-14T06:28:44.6671711Z  2025-03-14T06:28:44.6672154Z  2025-03-14T06:28:44.6672597Z  2025-03-14T06:28:44.6673031Z  2025-03-14T06:28:44.6673997Z [14,341 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:44.6675169Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:28:44.6676260Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:28:44.6677341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T06:28:44.6678817Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T06:28:44.6679913Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T06:28:44.6680868Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 25s local 2025-03-14T06:28:44.6681790Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 22s local 2025-03-14T06:28:44.6682754Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local ... 2025-03-14T06:28:44.9507367Z 2025-03-14T06:28:44.9508316Z  2025-03-14T06:28:44.9508821Z  2025-03-14T06:28:44.9509287Z  2025-03-14T06:28:44.9509717Z  2025-03-14T06:28:44.9510148Z  2025-03-14T06:28:44.9510561Z  2025-03-14T06:28:44.9510977Z  2025-03-14T06:28:44.9511409Z  2025-03-14T06:28:44.9512414Z [14,343 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:44.9513655Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T06:28:44.9514711Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:28:44.9515746Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T06:28:44.9516904Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T06:28:44.9517977Z Compiling xla/service/cpu/runtime_matmul_c64.cc; 27s local 2025-03-14T06:28:44.9518922Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T06:28:44.9519853Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:44.9520826Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 18s local ... 2025-03-14T06:28:45.1821584Z 2025-03-14T06:28:45.1822885Z  2025-03-14T06:28:45.1823479Z  2025-03-14T06:28:45.1823884Z  2025-03-14T06:28:45.1824321Z  2025-03-14T06:28:45.1824789Z  2025-03-14T06:28:45.1825189Z  2025-03-14T06:28:45.1825577Z  2025-03-14T06:28:45.1825951Z  2025-03-14T06:28:45.1827062Z [14,346 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:45.1828344Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T06:28:45.1829341Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:28:45.1830682Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 35s local 2025-03-14T06:28:45.1831800Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T06:28:45.1832811Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T06:28:45.1833947Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:45.1834906Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:28:45.1835986Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local ... 2025-03-14T06:28:45.3833715Z 2025-03-14T06:28:45.3834622Z  2025-03-14T06:28:45.3835107Z  2025-03-14T06:28:45.3835573Z  2025-03-14T06:28:45.3836005Z  2025-03-14T06:28:45.3836430Z  2025-03-14T06:28:45.3836862Z  2025-03-14T06:28:45.3837257Z  2025-03-14T06:28:45.3837646Z  2025-03-14T06:28:45.3838652Z [14,351 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:45.3839885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T06:28:45.3840947Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:28:45.3841988Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T06:28:45.3843121Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 35s local 2025-03-14T06:28:45.3844118Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T06:28:45.3845185Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:45.3846047Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:28:45.3847256Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 18s local ... 2025-03-14T06:28:45.6785020Z 2025-03-14T06:28:45.6785962Z  2025-03-14T06:28:45.6787823Z  2025-03-14T06:28:45.6788314Z  2025-03-14T06:28:45.6788751Z  2025-03-14T06:28:45.6789155Z  2025-03-14T06:28:45.6789593Z  2025-03-14T06:28:45.6790007Z  2025-03-14T06:28:45.6790423Z  2025-03-14T06:28:45.6791405Z [14,353 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:45.6792689Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T06:28:45.6793850Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T06:28:45.6794985Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T06:28:45.6796262Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T06:28:45.6797487Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 26s local 2025-03-14T06:28:45.6798429Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:45.6799416Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:28:45.6800399Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local ... 2025-03-14T06:28:45.8805383Z 2025-03-14T06:28:45.8806281Z  2025-03-14T06:28:45.8806741Z  2025-03-14T06:28:45.8807117Z  2025-03-14T06:28:45.8807486Z  2025-03-14T06:28:45.8809609Z  2025-03-14T06:28:45.8810436Z  2025-03-14T06:28:45.8811178Z  2025-03-14T06:28:45.8811601Z  2025-03-14T06:28:45.8812486Z [14,357 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:45.8813647Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T06:28:45.8814661Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T06:28:45.8815753Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T06:28:45.8817049Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T06:28:45.8818012Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T06:28:45.8818872Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 23s local 2025-03-14T06:28:45.8819973Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 19s local 2025-03-14T06:28:45.8820832Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local ... 2025-03-14T06:28:46.1800584Z 2025-03-14T06:28:46.1801484Z  2025-03-14T06:28:46.1802278Z  2025-03-14T06:28:46.1804267Z  2025-03-14T06:28:46.1805735Z  2025-03-14T06:28:46.1806336Z  2025-03-14T06:28:46.1806929Z  2025-03-14T06:28:46.1807548Z  2025-03-14T06:28:46.1808103Z  2025-03-14T06:28:46.1809477Z [14,362 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:46.1811025Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T06:28:46.1812287Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T06:28:46.1813378Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 36s local 2025-03-14T06:28:46.1814882Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T06:28:46.1816103Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T06:28:46.1817155Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2025-03-14T06:28:46.1818280Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:28:46.1819445Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local ... 2025-03-14T06:28:46.3834483Z 2025-03-14T06:28:46.3835304Z  2025-03-14T06:28:46.3835820Z  2025-03-14T06:28:46.3836239Z  2025-03-14T06:28:46.3836663Z  2025-03-14T06:28:46.3837089Z  2025-03-14T06:28:46.3837509Z  2025-03-14T06:28:46.3838173Z  2025-03-14T06:28:46.3838593Z  2025-03-14T06:28:46.3839587Z [14,366 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:46.3840859Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T06:28:46.3841966Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T06:28:46.3843057Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T06:28:46.3844265Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 36s local 2025-03-14T06:28:46.3845502Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T06:28:46.3846468Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2025-03-14T06:28:46.3847447Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:28:46.3848447Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 19s local ... 2025-03-14T06:28:46.6196572Z 2025-03-14T06:28:46.6197444Z  2025-03-14T06:28:46.6197965Z  2025-03-14T06:28:46.6198386Z  2025-03-14T06:28:46.6198834Z  2025-03-14T06:28:46.6199261Z  2025-03-14T06:28:46.6199703Z  2025-03-14T06:28:46.6200125Z  2025-03-14T06:28:46.6200559Z  2025-03-14T06:28:46.6201550Z [14,370 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:46.6202793Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T06:28:46.6203869Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T06:28:46.6205090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T06:28:46.6206301Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T06:28:46.6207408Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 27s local 2025-03-14T06:28:46.6208328Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 24s local 2025-03-14T06:28:46.6209221Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:28:46.6210204Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local ... 2025-03-14T06:28:46.9841454Z 2025-03-14T06:28:46.9842276Z  2025-03-14T06:28:46.9842801Z  2025-03-14T06:28:46.9843242Z  2025-03-14T06:28:46.9843955Z  2025-03-14T06:28:46.9844338Z  2025-03-14T06:28:46.9844910Z  2025-03-14T06:28:46.9845302Z  2025-03-14T06:28:46.9845700Z  2025-03-14T06:28:46.9846685Z [14,371 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:46.9848124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T06:28:46.9849168Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T06:28:46.9850364Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T06:28:46.9851653Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T06:28:46.9852659Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T06:28:46.9853605Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:46.9854542Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 20s local 2025-03-14T06:28:46.9855512Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local ... 2025-03-14T06:28:47.1845981Z 2025-03-14T06:28:47.1846863Z  2025-03-14T06:28:47.1847542Z  2025-03-14T06:28:47.1847958Z  2025-03-14T06:28:47.1848374Z  2025-03-14T06:28:47.1848797Z  2025-03-14T06:28:47.1849294Z  2025-03-14T06:28:47.1849724Z  2025-03-14T06:28:47.1850128Z  2025-03-14T06:28:47.1851137Z [14,374 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:47.1852400Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T06:28:47.1853753Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T06:28:47.1854838Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 37s local 2025-03-14T06:28:47.1856029Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T06:28:47.1857119Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T06:28:47.1858086Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:47.1858989Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2025-03-14T06:28:47.1859973Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local ... 2025-03-14T06:28:47.3908141Z 2025-03-14T06:28:47.3908983Z  2025-03-14T06:28:47.3909490Z  2025-03-14T06:28:47.3909875Z  2025-03-14T06:28:47.3910254Z  2025-03-14T06:28:47.3910680Z  2025-03-14T06:28:47.3911099Z  2025-03-14T06:28:47.3911547Z  2025-03-14T06:28:47.3911968Z  2025-03-14T06:28:47.3912999Z [14,375 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:47.3914267Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T06:28:47.3915349Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T06:28:47.3916445Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T06:28:47.3917668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 37s local 2025-03-14T06:28:47.3918774Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T06:28:47.3919724Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:47.3920699Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2025-03-14T06:28:47.3921684Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 20s local ... 2025-03-14T06:28:47.6285443Z 2025-03-14T06:28:47.6286352Z  2025-03-14T06:28:47.6286862Z  2025-03-14T06:28:47.6287255Z  2025-03-14T06:28:47.6287695Z  2025-03-14T06:28:47.6288102Z  2025-03-14T06:28:47.6288499Z  2025-03-14T06:28:47.6288887Z  2025-03-14T06:28:47.6289294Z  2025-03-14T06:28:47.6290241Z [14,378 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:47.6291412Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T06:28:47.6292700Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T06:28:47.6293694Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T06:28:47.6294989Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T06:28:47.6296026Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 28s local 2025-03-14T06:28:47.6296902Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:47.6297888Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2025-03-14T06:28:47.6298833Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local ... 2025-03-14T06:28:47.9186215Z 2025-03-14T06:28:47.9187030Z  2025-03-14T06:28:47.9187525Z  2025-03-14T06:28:47.9187946Z  2025-03-14T06:28:47.9188371Z  2025-03-14T06:28:47.9188790Z  2025-03-14T06:28:47.9189200Z  2025-03-14T06:28:47.9189616Z  2025-03-14T06:28:47.9190085Z  2025-03-14T06:28:47.9191022Z [14,379 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:47.9192207Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T06:28:47.9193224Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T06:28:47.9194250Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T06:28:47.9195408Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T06:28:47.9196457Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T06:28:47.9197602Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 25s local 2025-03-14T06:28:47.9198546Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 21s local 2025-03-14T06:28:47.9199487Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local ... 2025-03-14T06:28:48.1854050Z 2025-03-14T06:28:48.1854912Z  2025-03-14T06:28:48.1855456Z  2025-03-14T06:28:48.1855889Z  2025-03-14T06:28:48.1856317Z  2025-03-14T06:28:48.1856728Z  2025-03-14T06:28:48.1857159Z  2025-03-14T06:28:48.1857577Z  2025-03-14T06:28:48.1857976Z  2025-03-14T06:28:48.1858961Z [14,382 / 20,650] 3 / 17 tests; 48 actions running; last test: ...nv_hash_test 2025-03-14T06:28:48.1860206Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T06:28:48.1861272Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T06:28:48.1862325Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 38s local 2025-03-14T06:28:48.1863517Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T06:28:48.1864573Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T06:28:48.1865736Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:48.1866652Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:28:48.1867619Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local ... 2025-03-14T06:28:48.3896494Z 2025-03-14T06:28:48.3897390Z  2025-03-14T06:28:48.3897918Z  2025-03-14T06:28:48.3898352Z  2025-03-14T06:28:48.3898792Z  2025-03-14T06:28:48.3899219Z  2025-03-14T06:28:48.3899653Z  2025-03-14T06:28:48.3900084Z  2025-03-14T06:28:48.3900494Z  2025-03-14T06:28:48.3901328Z [14,392 / 20,650] 3 / 17 tests; 48 actions, 47 running; last test: ...ash_test 2025-03-14T06:28:48.3902521Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T06:28:48.3903578Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:28:48.3904625Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T06:28:48.3905796Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 38s local 2025-03-14T06:28:48.3907103Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T06:28:48.3908030Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:48.3908937Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:28:48.3910036Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 21s local ... 2025-03-14T06:28:48.6746350Z 2025-03-14T06:28:48.6747162Z  2025-03-14T06:28:48.6747643Z  2025-03-14T06:28:48.6748071Z  2025-03-14T06:28:48.6748510Z  2025-03-14T06:28:48.6749178Z  2025-03-14T06:28:48.6749616Z  2025-03-14T06:28:48.6750029Z  2025-03-14T06:28:48.6750437Z  2025-03-14T06:28:48.6751424Z [14,397 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:48.6752604Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T06:28:48.6753707Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:28:48.6754719Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T06:28:48.6755754Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T06:28:48.6756743Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 29s local 2025-03-14T06:28:48.6757628Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:48.6758537Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:28:48.6759502Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2025-03-14T06:28:48.8761462Z 2025-03-14T06:28:48.8762320Z  2025-03-14T06:28:48.8762798Z  2025-03-14T06:28:48.8763453Z  2025-03-14T06:28:48.8763877Z  2025-03-14T06:28:48.8764309Z  2025-03-14T06:28:48.8764950Z  2025-03-14T06:28:48.8765584Z  2025-03-14T06:28:48.8765980Z  2025-03-14T06:28:48.8766902Z [14,403 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:48.8768094Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T06:28:48.8769135Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:28:48.8770157Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T06:28:48.8771302Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T06:28:48.8772245Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T06:28:48.8773139Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 26s local 2025-03-14T06:28:48.8774015Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 22s local 2025-03-14T06:28:48.8774941Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2025-03-14T06:28:49.1862694Z 2025-03-14T06:28:49.1863544Z  2025-03-14T06:28:49.1864052Z  2025-03-14T06:28:49.1864490Z  2025-03-14T06:28:49.1864908Z  2025-03-14T06:28:49.1865606Z  2025-03-14T06:28:49.1866081Z  2025-03-14T06:28:49.1866486Z  2025-03-14T06:28:49.1866922Z  2025-03-14T06:28:49.1867906Z [14,403 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:49.1869063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T06:28:49.1870110Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:28:49.1871119Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 39s local 2025-03-14T06:28:49.1872164Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T06:28:49.1873150Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T06:28:49.1873998Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T06:28:49.1875066Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:28:49.1875974Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2025-03-14T06:28:49.3866947Z 2025-03-14T06:28:49.3867797Z  2025-03-14T06:28:49.3868261Z  2025-03-14T06:28:49.3868634Z  2025-03-14T06:28:49.3869010Z  2025-03-14T06:28:49.3869385Z  2025-03-14T06:28:49.3869751Z  2025-03-14T06:28:49.3870114Z  2025-03-14T06:28:49.3870777Z  2025-03-14T06:28:49.3871642Z [14,405 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:49.3872822Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T06:28:49.3873732Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:28:49.3874618Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T06:28:49.3875631Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 39s local 2025-03-14T06:28:49.3876571Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T06:28:49.3877381Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T06:28:49.3878215Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:28:49.3879036Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 22s local ... 2025-03-14T06:28:49.5875999Z 2025-03-14T06:28:49.5876844Z  2025-03-14T06:28:49.5877365Z  2025-03-14T06:28:49.5877777Z  2025-03-14T06:28:49.5878149Z  2025-03-14T06:28:49.5878499Z  2025-03-14T06:28:49.5878894Z  2025-03-14T06:28:49.5879275Z  2025-03-14T06:28:49.5879675Z  2025-03-14T06:28:49.5880549Z [14,407 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:49.5881848Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T06:28:49.5882725Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T06:28:49.5883739Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T06:28:49.5884963Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T06:28:49.5885977Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 30s local 2025-03-14T06:28:49.5886795Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T06:28:49.5887692Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:28:49.5888555Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2025-03-14T06:28:49.8326792Z 2025-03-14T06:28:49.8327680Z  2025-03-14T06:28:49.8328189Z  2025-03-14T06:28:49.8328664Z  2025-03-14T06:28:49.8329117Z  2025-03-14T06:28:49.8329559Z  2025-03-14T06:28:49.8329964Z  2025-03-14T06:28:49.8330423Z  2025-03-14T06:28:49.8330818Z  2025-03-14T06:28:49.8331807Z [14,410 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:49.8332953Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T06:28:49.8333923Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T06:28:49.8334794Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T06:28:49.8335870Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T06:28:49.8336912Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 31s local 2025-03-14T06:28:49.8337656Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 27s local 2025-03-14T06:28:49.8338510Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:28:49.8339467Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2025-03-14T06:28:50.0351569Z 2025-03-14T06:28:50.0352607Z  2025-03-14T06:28:50.0353124Z  2025-03-14T06:28:50.0353589Z  2025-03-14T06:28:50.0353992Z  2025-03-14T06:28:50.0354445Z  2025-03-14T06:28:50.0354886Z  2025-03-14T06:28:50.0355329Z  2025-03-14T06:28:50.0355753Z  2025-03-14T06:28:50.0356701Z [14,415 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:50.0358158Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T06:28:50.0359198Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T06:28:50.0360353Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T06:28:50.0361466Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T06:28:50.0362596Z Compiling xla/service/cpu/runtime_matmul_f16.cc; 31s local 2025-03-14T06:28:50.0363519Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T06:28:50.0364416Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 23s local 2025-03-14T06:28:50.0367902Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2025-03-14T06:28:50.2902129Z 2025-03-14T06:28:50.2903002Z  2025-03-14T06:28:50.2903504Z  2025-03-14T06:28:50.2903943Z  2025-03-14T06:28:50.2904412Z  2025-03-14T06:28:50.2904847Z  2025-03-14T06:28:50.2905269Z  2025-03-14T06:28:50.2905684Z  2025-03-14T06:28:50.2906117Z  2025-03-14T06:28:50.2907119Z [14,418 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:50.2908331Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T06:28:50.2909389Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T06:28:50.2910435Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 40s local 2025-03-14T06:28:50.2911841Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 40s local 2025-03-14T06:28:50.2912958Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T06:28:50.2913925Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2025-03-14T06:28:50.2914879Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local 2025-03-14T06:28:50.2915813Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2025-03-14T06:28:50.4908040Z 2025-03-14T06:28:50.4908932Z  2025-03-14T06:28:50.4909435Z  2025-03-14T06:28:50.4909877Z  2025-03-14T06:28:50.4910291Z  2025-03-14T06:28:50.4910710Z  2025-03-14T06:28:50.4911156Z  2025-03-14T06:28:50.4911577Z  2025-03-14T06:28:50.4912000Z  2025-03-14T06:28:50.4912958Z [14,422 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:50.4914205Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T06:28:50.4925599Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T06:28:50.4926648Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T06:28:50.4927785Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T06:28:50.4928802Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T06:28:50.4929752Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2025-03-14T06:28:50.4930677Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T06:28:50.4931651Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2025-03-14T06:28:50.7877231Z 2025-03-14T06:28:50.7878073Z  2025-03-14T06:28:50.7878574Z  2025-03-14T06:28:50.7878994Z  2025-03-14T06:28:50.7879407Z  2025-03-14T06:28:50.7879796Z  2025-03-14T06:28:50.7880310Z  2025-03-14T06:28:50.7880810Z  2025-03-14T06:28:50.7881205Z  2025-03-14T06:28:50.7882265Z [14,429 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:50.7883469Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T06:28:50.7884519Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T06:28:50.7885676Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T06:28:50.7887071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T06:28:50.7888210Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 28s local 2025-03-14T06:28:50.7889089Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2025-03-14T06:28:50.7890286Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T06:28:50.7891185Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2025-03-14T06:28:51.1387507Z 2025-03-14T06:28:51.1388604Z  2025-03-14T06:28:51.1389138Z  2025-03-14T06:28:51.1389550Z  2025-03-14T06:28:51.1389967Z  2025-03-14T06:28:51.1390383Z  2025-03-14T06:28:51.1390788Z  2025-03-14T06:28:51.1391196Z  2025-03-14T06:28:51.1391607Z  2025-03-14T06:28:51.1392576Z [14,430 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:51.1393906Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T06:28:51.1395207Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T06:28:51.1396290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 41s local 2025-03-14T06:28:51.1397442Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T06:28:51.1398396Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T06:28:51.1399314Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 24s local 2025-03-14T06:28:51.1400260Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T06:28:51.1401443Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 23s local ... 2025-03-14T06:28:51.3883199Z 2025-03-14T06:28:51.3884005Z  2025-03-14T06:28:51.3884496Z  2025-03-14T06:28:51.3885079Z  2025-03-14T06:28:51.3885502Z  2025-03-14T06:28:51.3885918Z  2025-03-14T06:28:51.3886331Z  2025-03-14T06:28:51.3886731Z  2025-03-14T06:28:51.3887148Z  2025-03-14T06:28:51.3888282Z [14,432 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:51.3889487Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T06:28:51.3890579Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T06:28:51.3891602Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:28:51.3892761Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 41s local 2025-03-14T06:28:51.3893823Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T06:28:51.3894764Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local 2025-03-14T06:28:51.3895708Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T06:28:51.3896656Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local ... 2025-03-14T06:28:51.5886955Z 2025-03-14T06:28:51.5887833Z  2025-03-14T06:28:51.5888385Z  2025-03-14T06:28:51.5888875Z  2025-03-14T06:28:51.5889347Z  2025-03-14T06:28:51.5889740Z  2025-03-14T06:28:51.5890264Z  2025-03-14T06:28:51.5890661Z  2025-03-14T06:28:51.5891065Z  2025-03-14T06:28:51.5892069Z [14,444 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:51.5893383Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T06:28:51.5894450Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T06:28:51.5895505Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:28:51.5896644Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T06:28:51.5897682Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T06:28:51.5898574Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local 2025-03-14T06:28:51.5899604Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:51.5900943Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local ... 2025-03-14T06:28:51.8330258Z 2025-03-14T06:28:51.8331140Z  2025-03-14T06:28:51.8331655Z  2025-03-14T06:28:51.8332079Z  2025-03-14T06:28:51.8332778Z  2025-03-14T06:28:51.8333198Z  2025-03-14T06:28:51.8333607Z  2025-03-14T06:28:51.8334027Z  2025-03-14T06:28:51.8334440Z  2025-03-14T06:28:51.8335576Z [14,451 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:51.8336824Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:28:51.8337905Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T06:28:51.8338953Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:28:51.8339997Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T06:28:51.8341107Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 29s local 2025-03-14T06:28:51.8342079Z Compiling xla/service/cpu/runtime_matmul_f64.cc; 25s local 2025-03-14T06:28:51.8343066Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:51.8344075Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local ... 2025-03-14T06:28:52.0377792Z 2025-03-14T06:28:52.0378691Z  2025-03-14T06:28:52.0379157Z  2025-03-14T06:28:52.0379577Z  2025-03-14T06:28:52.0380045Z  2025-03-14T06:28:52.0380477Z  2025-03-14T06:28:52.0380898Z  2025-03-14T06:28:52.0381298Z  2025-03-14T06:28:52.0381706Z  2025-03-14T06:28:52.0382923Z [14,466 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:52.0384158Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:28:52.0385155Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T06:28:52.0386158Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:28:52.0387262Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T06:28:52.0388322Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:52.0389243Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:52.0390098Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 24s local 2025-03-14T06:28:52.0391012Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local ... 2025-03-14T06:28:52.2517480Z 2025-03-14T06:28:52.2518366Z  2025-03-14T06:28:52.2518887Z  2025-03-14T06:28:52.2519383Z  2025-03-14T06:28:52.2519846Z  2025-03-14T06:28:52.2520242Z  2025-03-14T06:28:52.2520675Z  2025-03-14T06:28:52.2521103Z  2025-03-14T06:28:52.2521539Z  2025-03-14T06:28:52.2522546Z [14,470 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:52.2523797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:28:52.2525001Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T06:28:52.2526216Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 42s local 2025-03-14T06:28:52.2527383Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 42s local 2025-03-14T06:28:52.2528370Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:52.2529246Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:52.2530116Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:52.2531061Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local ... 2025-03-14T06:28:52.4632550Z 2025-03-14T06:28:52.4633403Z  2025-03-14T06:28:52.4633884Z  2025-03-14T06:28:52.4634305Z  2025-03-14T06:28:52.4634673Z  2025-03-14T06:28:52.4635060Z  2025-03-14T06:28:52.4635717Z  2025-03-14T06:28:52.4636111Z  2025-03-14T06:28:52.4636508Z  2025-03-14T06:28:52.4637439Z [14,477 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:52.4638654Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:28:52.4639859Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:28:52.4640911Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T06:28:52.4642154Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:52.4643229Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:52.4644126Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:52.4645107Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:52.4646015Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local ... 2025-03-14T06:28:52.6746144Z 2025-03-14T06:28:52.6747004Z  2025-03-14T06:28:52.6747514Z  2025-03-14T06:28:52.6747982Z  2025-03-14T06:28:52.6748400Z  2025-03-14T06:28:52.6748791Z  2025-03-14T06:28:52.6749197Z  2025-03-14T06:28:52.6749626Z  2025-03-14T06:28:52.6750064Z  2025-03-14T06:28:52.6751008Z [14,489 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:52.6752269Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:28:52.6753329Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:28:52.6754684Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T06:28:52.6755804Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:52.6756870Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:52.6757808Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:52.6758768Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:52.6759690Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local ... 2025-03-14T06:28:52.8917695Z 2025-03-14T06:28:52.8918505Z  2025-03-14T06:28:52.8918972Z  2025-03-14T06:28:52.8919333Z  2025-03-14T06:28:52.8919686Z  2025-03-14T06:28:52.8920042Z  2025-03-14T06:28:52.8920411Z  2025-03-14T06:28:52.8920761Z  2025-03-14T06:28:52.8921122Z  2025-03-14T06:28:52.8921962Z [14,500 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:52.8923018Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T06:28:52.8923892Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:28:52.8924907Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T06:28:52.8925918Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:52.8926823Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 30s local 2025-03-14T06:28:52.8927652Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:52.8928415Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:52.8929204Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local ... 2025-03-14T06:28:53.1288836Z 2025-03-14T06:28:53.1289650Z  2025-03-14T06:28:53.1290128Z  2025-03-14T06:28:53.1290561Z  2025-03-14T06:28:53.1290956Z  2025-03-14T06:28:53.1291347Z  2025-03-14T06:28:53.1291731Z  2025-03-14T06:28:53.1292082Z  2025-03-14T06:28:53.1292415Z  2025-03-14T06:28:53.1293211Z [14,509 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:53.1294361Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T06:28:53.1295388Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:28:53.1296705Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 43s local 2025-03-14T06:28:53.1297808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:53.1298941Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T06:28:53.1299820Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:53.1300734Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 25s local 2025-03-14T06:28:53.1303424Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local ... 2025-03-14T06:28:53.3311695Z 2025-03-14T06:28:53.3312541Z  2025-03-14T06:28:53.3313066Z  2025-03-14T06:28:53.3313464Z  2025-03-14T06:28:53.3313880Z  2025-03-14T06:28:53.3314283Z  2025-03-14T06:28:53.3314686Z  2025-03-14T06:28:53.3315096Z  2025-03-14T06:28:53.3315505Z  2025-03-14T06:28:53.3316473Z [14,517 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:53.3317699Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T06:28:53.3318777Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:28:53.3319808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T06:28:53.3321039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 43s local 2025-03-14T06:28:53.3322120Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T06:28:53.3323252Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:53.3324422Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:53.3325612Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local ... 2025-03-14T06:28:53.5679749Z 2025-03-14T06:28:53.5680546Z  2025-03-14T06:28:53.5681080Z  2025-03-14T06:28:53.5681495Z  2025-03-14T06:28:53.5681939Z  2025-03-14T06:28:53.5682351Z  2025-03-14T06:28:53.5682770Z  2025-03-14T06:28:53.5683161Z  2025-03-14T06:28:53.5683578Z  2025-03-14T06:28:53.5684752Z [14,532 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:53.5686042Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T06:28:53.5687159Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T06:28:53.5688148Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T06:28:53.5689263Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:53.5690286Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T06:28:53.5691189Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:53.5692127Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:53.5693126Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local ... 2025-03-14T06:28:53.7889641Z 2025-03-14T06:28:53.7890514Z  2025-03-14T06:28:53.7891000Z  2025-03-14T06:28:53.7891404Z  2025-03-14T06:28:53.7891806Z  2025-03-14T06:28:53.7892196Z  2025-03-14T06:28:53.7892626Z  2025-03-14T06:28:53.7893050Z  2025-03-14T06:28:53.7893464Z  2025-03-14T06:28:53.7894419Z [14,547 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:28:53.7895636Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:28:53.7896646Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T06:28:53.7897642Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T06:28:53.7898739Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:53.7899770Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 31s local 2025-03-14T06:28:53.7900874Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:53.7901771Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:53.7902670Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local ... 2025-03-14T06:28:53.9898088Z 2025-03-14T06:28:53.9898881Z  2025-03-14T06:28:53.9899400Z  2025-03-14T06:28:53.9899845Z  2025-03-14T06:28:53.9900290Z  2025-03-14T06:28:53.9900704Z  2025-03-14T06:28:53.9901140Z  2025-03-14T06:28:53.9901576Z  2025-03-14T06:28:53.9902316Z  2025-03-14T06:28:53.9903356Z [14,557 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:53.9904657Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:28:53.9905731Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T06:28:53.9906808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T06:28:53.9908046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:53.9909156Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:53.9910130Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:53.9911100Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 26s local 2025-03-14T06:28:53.9911926Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local ... 2025-03-14T06:28:54.1903128Z 2025-03-14T06:28:54.1903951Z  2025-03-14T06:28:54.1904512Z  2025-03-14T06:28:54.1904912Z  2025-03-14T06:28:54.1905347Z  2025-03-14T06:28:54.1905790Z  2025-03-14T06:28:54.1906482Z  2025-03-14T06:28:54.1906921Z  2025-03-14T06:28:54.1907354Z  2025-03-14T06:28:54.1908352Z [14,570 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:54.1909640Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:28:54.1910742Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T06:28:54.1911768Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 44s local 2025-03-14T06:28:54.1912890Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:54.1913956Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:54.1914914Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:54.1915895Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:54.1916908Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local ... 2025-03-14T06:28:54.4074558Z 2025-03-14T06:28:54.4075702Z  2025-03-14T06:28:54.4076615Z  2025-03-14T06:28:54.4077424Z  2025-03-14T06:28:54.4078506Z  2025-03-14T06:28:54.4078997Z  2025-03-14T06:28:54.4079424Z  2025-03-14T06:28:54.4079841Z  2025-03-14T06:28:54.4080220Z  2025-03-14T06:28:54.4081262Z [14,582 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:54.4082571Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:28:54.4083692Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T06:28:54.4084925Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T06:28:54.4086194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 44s local 2025-03-14T06:28:54.4087334Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:54.4088307Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:54.4089253Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:54.4090282Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local ... 2025-03-14T06:28:54.6191714Z 2025-03-14T06:28:54.6192924Z  2025-03-14T06:28:54.6193450Z  2025-03-14T06:28:54.6194139Z  2025-03-14T06:28:54.6194552Z  2025-03-14T06:28:54.6194972Z  2025-03-14T06:28:54.6195392Z  2025-03-14T06:28:54.6195851Z  2025-03-14T06:28:54.6196285Z  2025-03-14T06:28:54.6197299Z [14,590 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:54.6198751Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:28:54.6199987Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T06:28:54.6201016Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T06:28:54.6202195Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T06:28:54.6203262Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:54.6204186Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T06:28:54.6205312Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:54.6206301Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local ... 2025-03-14T06:28:54.8502423Z 2025-03-14T06:28:54.8503398Z  2025-03-14T06:28:54.8503946Z  2025-03-14T06:28:54.8504373Z  2025-03-14T06:28:54.8504798Z  2025-03-14T06:28:54.8505269Z  2025-03-14T06:28:54.8505690Z  2025-03-14T06:28:54.8506085Z  2025-03-14T06:28:54.8506507Z  2025-03-14T06:28:54.8507527Z [14,593 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:54.8508771Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T06:28:54.8510115Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T06:28:54.8511198Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T06:28:54.8512426Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T06:28:54.8513466Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 32s local 2025-03-14T06:28:54.8514438Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 27s local 2025-03-14T06:28:54.8515350Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2025-03-14T06:28:54.8516264Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local ... 2025-03-14T06:28:55.1909729Z 2025-03-14T06:28:55.1910973Z  2025-03-14T06:28:55.1911487Z  2025-03-14T06:28:55.1911913Z  2025-03-14T06:28:55.1912329Z  2025-03-14T06:28:55.1912757Z  2025-03-14T06:28:55.1913210Z  2025-03-14T06:28:55.1913622Z  2025-03-14T06:28:55.1914059Z  2025-03-14T06:28:55.1915054Z [14,596 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:55.1916409Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T06:28:55.1917458Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T06:28:55.1918417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 45s local 2025-03-14T06:28:55.1919585Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 45s local 2025-03-14T06:28:55.1920704Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T06:28:55.1921664Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T06:28:55.1922620Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2025-03-14T06:28:55.1923495Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local ... 2025-03-14T06:28:55.4246840Z 2025-03-14T06:28:55.4247690Z  2025-03-14T06:28:55.4248179Z  2025-03-14T06:28:55.4248606Z  2025-03-14T06:28:55.4249027Z  2025-03-14T06:28:55.4249458Z  2025-03-14T06:28:55.4249889Z  2025-03-14T06:28:55.4250275Z  2025-03-14T06:28:55.4250652Z  2025-03-14T06:28:55.4251640Z [14,603 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:55.4252956Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T06:28:55.4254153Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T06:28:55.4255116Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T06:28:55.4256410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T06:28:55.4257441Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T06:28:55.4258189Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T06:28:55.4259233Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2025-03-14T06:28:55.4260125Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local ... 2025-03-14T06:28:55.6453938Z 2025-03-14T06:28:55.6454817Z  2025-03-14T06:28:55.6455361Z  2025-03-14T06:28:55.6455797Z  2025-03-14T06:28:55.6456212Z  2025-03-14T06:28:55.6456693Z  2025-03-14T06:28:55.6457073Z  2025-03-14T06:28:55.6457502Z  2025-03-14T06:28:55.6457944Z  2025-03-14T06:28:55.6458895Z [14,607 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:55.6460120Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T06:28:55.6461205Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T06:28:55.6462276Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T06:28:55.6463409Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T06:28:55.6464450Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 33s local 2025-03-14T06:28:55.6465917Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T06:28:55.6466778Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T06:28:55.6467658Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local ... 2025-03-14T06:28:55.9917543Z 2025-03-14T06:28:55.9918395Z  2025-03-14T06:28:55.9918939Z  2025-03-14T06:28:55.9919370Z  2025-03-14T06:28:55.9919770Z  2025-03-14T06:28:55.9920196Z  2025-03-14T06:28:55.9920600Z  2025-03-14T06:28:55.9920988Z  2025-03-14T06:28:55.9921399Z  2025-03-14T06:28:55.9922368Z [14,612 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:55.9923602Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T06:28:55.9924851Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T06:28:55.9925920Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T06:28:55.9927102Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T06:28:55.9928192Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T06:28:55.9929147Z Compiling xla/service/cpu/runtime_matmul_s32.cc; 28s local 2025-03-14T06:28:55.9930020Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T06:28:55.9930942Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 10s local ... 2025-03-14T06:28:56.1921709Z 2025-03-14T06:28:56.1922525Z  2025-03-14T06:28:56.1922978Z  2025-03-14T06:28:56.1923318Z  2025-03-14T06:28:56.1923713Z  2025-03-14T06:28:56.1924075Z  2025-03-14T06:28:56.1924420Z  2025-03-14T06:28:56.1924923Z  2025-03-14T06:28:56.1925269Z  2025-03-14T06:28:56.1926097Z [14,614 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:56.1927075Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T06:28:56.1927942Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T06:28:56.1928771Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 46s local 2025-03-14T06:28:56.1929671Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 46s local 2025-03-14T06:28:56.1930492Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T06:28:56.1931415Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T06:28:56.1932078Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2025-03-14T06:28:56.1932788Z Compiling external/xla/xla/xla_data.pb.cc; 9s local ... 2025-03-14T06:28:56.4592757Z 2025-03-14T06:28:56.4593647Z  2025-03-14T06:28:56.4594215Z  2025-03-14T06:28:56.4594599Z  2025-03-14T06:28:56.4595026Z  2025-03-14T06:28:56.4595461Z  2025-03-14T06:28:56.4596099Z  2025-03-14T06:28:56.4596548Z  2025-03-14T06:28:56.4596932Z  2025-03-14T06:28:56.4597905Z [14,618 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:56.4599133Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T06:28:56.4600157Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T06:28:56.4601270Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T06:28:56.4602492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T06:28:56.4603576Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T06:28:56.4604498Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T06:28:56.4605520Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2025-03-14T06:28:56.4606405Z Compiling external/xla/xla/xla_data.pb.cc; 10s local ... 2025-03-14T06:28:56.7933576Z 2025-03-14T06:28:56.7934434Z  2025-03-14T06:28:56.7934948Z  2025-03-14T06:28:56.7935382Z  2025-03-14T06:28:56.7935812Z  2025-03-14T06:28:56.7936472Z  2025-03-14T06:28:56.7936913Z  2025-03-14T06:28:56.7937304Z  2025-03-14T06:28:56.7937734Z  2025-03-14T06:28:56.7938720Z [14,620 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:56.7939913Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T06:28:56.7941416Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T06:28:56.7942407Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T06:28:56.7943790Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T06:28:56.7945031Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 34s local 2025-03-14T06:28:56.7946051Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T06:28:56.7947036Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2025-03-14T06:28:56.7948060Z Compiling external/xla/xla/xla_data.pb.cc; 10s local ... 2025-03-14T06:28:56.9949548Z 2025-03-14T06:28:56.9950498Z  2025-03-14T06:28:56.9951013Z  2025-03-14T06:28:56.9951423Z  2025-03-14T06:28:56.9951838Z  2025-03-14T06:28:56.9952287Z  2025-03-14T06:28:56.9952707Z  2025-03-14T06:28:56.9953119Z  2025-03-14T06:28:56.9953576Z  2025-03-14T06:28:56.9954770Z [14,623 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:56.9955944Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T06:28:56.9957004Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T06:28:56.9957971Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T06:28:56.9959090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T06:28:56.9960144Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T06:28:56.9960994Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T06:28:56.9961846Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 11s local 2025-03-14T06:28:56.9962723Z Compiling external/xla/xla/xla_data.pb.cc; 10s local ... 2025-03-14T06:28:57.2555032Z 2025-03-14T06:28:57.2555831Z  2025-03-14T06:28:57.2556309Z  2025-03-14T06:28:57.2557033Z  2025-03-14T06:28:57.2557392Z  2025-03-14T06:28:57.2557752Z  2025-03-14T06:28:57.2558143Z  2025-03-14T06:28:57.2558556Z  2025-03-14T06:28:57.2558974Z  2025-03-14T06:28:57.2559947Z [14,627 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:57.2561285Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T06:28:57.2562444Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T06:28:57.2563402Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 47s local 2025-03-14T06:28:57.2564881Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 47s local 2025-03-14T06:28:57.2566010Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T06:28:57.2566926Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T06:28:57.2567599Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2025-03-14T06:28:57.2568398Z Compiling external/xla/xla/xla_data.pb.cc; 10s local ... 2025-03-14T06:28:57.4923539Z 2025-03-14T06:28:57.4924440Z  2025-03-14T06:28:57.4925052Z  2025-03-14T06:28:57.4925424Z  2025-03-14T06:28:57.4925823Z  2025-03-14T06:28:57.4926264Z  2025-03-14T06:28:57.4926676Z  2025-03-14T06:28:57.4927086Z  2025-03-14T06:28:57.4927476Z  2025-03-14T06:28:57.4928487Z [14,629 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:57.4929645Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T06:28:57.4930926Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T06:28:57.4931898Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T06:28:57.4933092Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T06:28:57.4934061Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T06:28:57.4934891Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T06:28:57.4935695Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2025-03-14T06:28:57.4936496Z Compiling external/xla/xla/xla_data.pb.cc; 11s local ... 2025-03-14T06:28:57.7934058Z 2025-03-14T06:28:57.7935025Z  2025-03-14T06:28:57.7935510Z  2025-03-14T06:28:57.7935919Z  2025-03-14T06:28:57.7936360Z  2025-03-14T06:28:57.7936762Z  2025-03-14T06:28:57.7937159Z  2025-03-14T06:28:57.7937583Z  2025-03-14T06:28:57.7937973Z  2025-03-14T06:28:57.7938958Z [14,634 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:57.7940161Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T06:28:57.7941155Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T06:28:57.7942150Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T06:28:57.7943271Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T06:28:57.7944257Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 35s local 2025-03-14T06:28:57.7945096Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T06:28:57.7945933Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2025-03-14T06:28:57.7946824Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2025-03-14T06:28:58.0170925Z 2025-03-14T06:28:58.0171827Z  2025-03-14T06:28:58.0172342Z  2025-03-14T06:28:58.0172752Z  2025-03-14T06:28:58.0173184Z  2025-03-14T06:28:58.0173614Z  2025-03-14T06:28:58.0174042Z  2025-03-14T06:28:58.0174456Z  2025-03-14T06:28:58.0174857Z  2025-03-14T06:28:58.0175780Z [14,636 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:58.0176981Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T06:28:58.0178159Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T06:28:58.0179130Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T06:28:58.0180266Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T06:28:58.0181421Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:58.0182198Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T06:28:58.0183108Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 12s local 2025-03-14T06:28:58.0183969Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2025-03-14T06:28:58.2829583Z 2025-03-14T06:28:58.2830479Z  2025-03-14T06:28:58.2830994Z  2025-03-14T06:28:58.2831424Z  2025-03-14T06:28:58.2831849Z  2025-03-14T06:28:58.2832264Z  2025-03-14T06:28:58.2832648Z  2025-03-14T06:28:58.2833051Z  2025-03-14T06:28:58.2833458Z  2025-03-14T06:28:58.2834447Z [14,639 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:58.2835686Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T06:28:58.2836757Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T06:28:58.2837832Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 48s local 2025-03-14T06:28:58.2838995Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 48s local 2025-03-14T06:28:58.2840087Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:58.2841199Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T06:28:58.2842046Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2025-03-14T06:28:58.2843032Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local ... 2025-03-14T06:28:58.4818997Z 2025-03-14T06:28:58.4820345Z  2025-03-14T06:28:58.4820838Z  2025-03-14T06:28:58.4821221Z  2025-03-14T06:28:58.4821582Z  2025-03-14T06:28:58.4821956Z  2025-03-14T06:28:58.4822355Z  2025-03-14T06:28:58.4822781Z  2025-03-14T06:28:58.4823179Z  2025-03-14T06:28:58.4824075Z [14,644 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:58.4825230Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T06:28:58.4826251Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T06:28:58.4827223Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T06:28:58.4828334Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:58.4829369Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:58.4830315Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T06:28:58.4831155Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2025-03-14T06:28:58.4832105Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local ... 2025-03-14T06:28:58.7503988Z 2025-03-14T06:28:58.7504858Z  2025-03-14T06:28:58.7505379Z  2025-03-14T06:28:58.7505794Z  2025-03-14T06:28:58.7506196Z  2025-03-14T06:28:58.7506641Z  2025-03-14T06:28:58.7507075Z  2025-03-14T06:28:58.7507487Z  2025-03-14T06:28:58.7507891Z  2025-03-14T06:28:58.7508882Z [14,648 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:58.7510163Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T06:28:58.7511266Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T06:28:58.7512331Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T06:28:58.7513479Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:58.7514548Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 36s local 2025-03-14T06:28:58.7515748Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T06:28:58.7516641Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2025-03-14T06:28:58.7517581Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local ... 2025-03-14T06:28:58.9942529Z 2025-03-14T06:28:58.9943404Z  2025-03-14T06:28:58.9943878Z  2025-03-14T06:28:58.9944275Z  2025-03-14T06:28:58.9944645Z  2025-03-14T06:28:58.9945059Z  2025-03-14T06:28:58.9945464Z  2025-03-14T06:28:58.9946240Z  2025-03-14T06:28:58.9946692Z  2025-03-14T06:28:58.9947712Z [14,651 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:58.9948914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T06:28:58.9950442Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T06:28:58.9951678Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 49s local 2025-03-14T06:28:58.9952959Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:58.9954153Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T06:28:58.9955175Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T06:28:58.9956206Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 13s local 2025-03-14T06:28:58.9957292Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local ... 2025-03-14T06:28:59.3948007Z 2025-03-14T06:28:59.3948846Z  2025-03-14T06:28:59.3949358Z  2025-03-14T06:28:59.3949769Z  2025-03-14T06:28:59.3950187Z  2025-03-14T06:28:59.3950578Z  2025-03-14T06:28:59.3951283Z  2025-03-14T06:28:59.3951731Z  2025-03-14T06:28:59.3952163Z  2025-03-14T06:28:59.3953173Z [14,654 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:28:59.3954448Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T06:28:59.3955490Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:28:59.3956492Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:28:59.3957656Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 49s local 2025-03-14T06:28:59.3958629Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T06:28:59.3959475Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T06:28:59.3960333Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2025-03-14T06:28:59.3961255Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 12s local ... 2025-03-14T06:28:59.6075869Z 2025-03-14T06:28:59.6076767Z  2025-03-14T06:28:59.6077268Z  2025-03-14T06:28:59.6077706Z  2025-03-14T06:28:59.6078120Z  2025-03-14T06:28:59.6078631Z  2025-03-14T06:28:59.6079083Z  2025-03-14T06:28:59.6079559Z  2025-03-14T06:28:59.6079972Z  2025-03-14T06:28:59.6080980Z [14,656 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:28:59.6082248Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T06:28:59.6083342Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:28:59.6084398Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:28:59.6085711Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T06:28:59.6086801Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T06:28:59.6087657Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T06:28:59.6089015Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2025-03-14T06:28:59.6090230Z Compiling external/xla/xla/service/hlo.pb.cc; 6s local ... 2025-03-14T06:28:59.8188039Z 2025-03-14T06:28:59.8189028Z  2025-03-14T06:28:59.8190442Z  2025-03-14T06:28:59.8191706Z  2025-03-14T06:28:59.8192535Z  2025-03-14T06:28:59.8193975Z  2025-03-14T06:28:59.8194798Z  2025-03-14T06:28:59.8195566Z  2025-03-14T06:28:59.8196018Z  2025-03-14T06:28:59.8196976Z [14,658 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:28:59.8198477Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:28:59.8199558Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:28:59.8202713Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:28:59.8204018Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T06:28:59.8205259Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 37s local 2025-03-14T06:28:59.8206084Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T06:28:59.8206933Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2025-03-14T06:28:59.8207856Z Compiling external/xla/xla/service/hlo.pb.cc; 6s local ... 2025-03-14T06:29:00.0318139Z 2025-03-14T06:29:00.0319150Z  2025-03-14T06:29:00.0320545Z  2025-03-14T06:29:00.0321424Z  2025-03-14T06:29:00.0322326Z  2025-03-14T06:29:00.0322817Z  2025-03-14T06:29:00.0323248Z  2025-03-14T06:29:00.0323643Z  2025-03-14T06:29:00.0324057Z  2025-03-14T06:29:00.0325211Z [14,661 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:00.0326683Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:29:00.0328005Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:29:00.0329073Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:29:00.0330258Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T06:29:00.0331373Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T06:29:00.0332319Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T06:29:00.0333208Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 14s local 2025-03-14T06:29:00.0334147Z Compiling external/xla/xla/service/hlo.pb.cc; 6s local ... 2025-03-14T06:29:00.2418808Z 2025-03-14T06:29:00.2419693Z  2025-03-14T06:29:00.2420143Z  2025-03-14T06:29:00.2420541Z  2025-03-14T06:29:00.2420907Z  2025-03-14T06:29:00.2421307Z  2025-03-14T06:29:00.2421684Z  2025-03-14T06:29:00.2422090Z  2025-03-14T06:29:00.2422457Z  2025-03-14T06:29:00.2423360Z [14,664 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:00.2424399Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:29:00.2425314Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:29:00.2426242Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 50s local 2025-03-14T06:29:00.2427274Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 50s local 2025-03-14T06:29:00.2428232Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T06:29:00.2429029Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T06:29:00.2429878Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2025-03-14T06:29:00.2430746Z Compiling external/xla/xla/service/hlo.pb.cc; 6s local ... 2025-03-14T06:29:00.4674640Z 2025-03-14T06:29:00.4675841Z  2025-03-14T06:29:00.4676613Z  2025-03-14T06:29:00.4677607Z  2025-03-14T06:29:00.4678083Z  2025-03-14T06:29:00.4678523Z  2025-03-14T06:29:00.4678944Z  2025-03-14T06:29:00.4679364Z  2025-03-14T06:29:00.4679767Z  2025-03-14T06:29:00.4680805Z [14,668 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:00.4682107Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:29:00.4683460Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T06:29:00.4684790Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T06:29:00.4685921Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T06:29:00.4687116Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T06:29:00.4688004Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T06:29:00.4689040Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2025-03-14T06:29:00.4689954Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2025-03-14T06:29:00.6846409Z 2025-03-14T06:29:00.6847339Z  2025-03-14T06:29:00.6847772Z  2025-03-14T06:29:00.6848270Z  2025-03-14T06:29:00.6848643Z  2025-03-14T06:29:00.6849011Z  2025-03-14T06:29:00.6849376Z  2025-03-14T06:29:00.6849745Z  2025-03-14T06:29:00.6850110Z  2025-03-14T06:29:00.6851035Z [14,670 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:00.6852125Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:29:00.6853085Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T06:29:00.6854137Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T06:29:00.6855540Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T06:29:00.6856366Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 38s local 2025-03-14T06:29:00.6857082Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T06:29:00.6858009Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2025-03-14T06:29:00.6858802Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2025-03-14T06:29:00.9901591Z 2025-03-14T06:29:00.9902462Z  2025-03-14T06:29:00.9902944Z  2025-03-14T06:29:00.9903382Z  2025-03-14T06:29:00.9903777Z  2025-03-14T06:29:00.9904191Z  2025-03-14T06:29:00.9904584Z  2025-03-14T06:29:00.9904976Z  2025-03-14T06:29:00.9905385Z  2025-03-14T06:29:00.9906318Z [14,671 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:00.9907511Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T06:29:00.9908543Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T06:29:00.9909578Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T06:29:00.9921251Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T06:29:00.9922275Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:29:00.9923118Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T06:29:00.9923948Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 15s local 2025-03-14T06:29:00.9924994Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2025-03-14T06:29:01.1961125Z 2025-03-14T06:29:01.1962002Z  2025-03-14T06:29:01.1962564Z  2025-03-14T06:29:01.1963029Z  2025-03-14T06:29:01.1963482Z  2025-03-14T06:29:01.1963966Z  2025-03-14T06:29:01.1964383Z  2025-03-14T06:29:01.1965001Z  2025-03-14T06:29:01.1965580Z  2025-03-14T06:29:01.1966543Z [14,674 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:01.1967782Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T06:29:01.1968869Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T06:29:01.1969899Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 51s local 2025-03-14T06:29:01.1971070Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 51s local 2025-03-14T06:29:01.1972127Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:29:01.1973312Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2025-03-14T06:29:01.1974166Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local 2025-03-14T06:29:01.1975053Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2025-03-14T06:29:01.4499102Z 2025-03-14T06:29:01.4500018Z  2025-03-14T06:29:01.4500536Z  2025-03-14T06:29:01.4500975Z  2025-03-14T06:29:01.4501406Z  2025-03-14T06:29:01.4501831Z  2025-03-14T06:29:01.4502251Z  2025-03-14T06:29:01.4502971Z  2025-03-14T06:29:01.4503410Z  2025-03-14T06:29:01.4504399Z [14,677 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:01.4505661Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T06:29:01.4506736Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T06:29:01.4507941Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T06:29:01.4513672Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:29:01.4514904Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:29:01.4515722Z Compiling llvm/lib/MC/MCParser/MasmParser.cpp; 16s local 2025-03-14T06:29:01.4516474Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:01.4517188Z Compiling external/xla/xla/service/hlo.pb.cc; 7s local ... 2025-03-14T06:29:01.7202865Z 2025-03-14T06:29:01.7203726Z  2025-03-14T06:29:01.7204226Z  2025-03-14T06:29:01.7204772Z  2025-03-14T06:29:01.7205194Z  2025-03-14T06:29:01.7205590Z  2025-03-14T06:29:01.7206305Z  2025-03-14T06:29:01.7206698Z  2025-03-14T06:29:01.7207102Z  2025-03-14T06:29:01.7207992Z [14,680 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:01.7209149Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T06:29:01.7210146Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T06:29:01.7211154Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T06:29:01.7212213Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:29:01.7213222Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:29:01.7214098Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:01.7214941Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:01.7215846Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T06:29:01.9241356Z 2025-03-14T06:29:01.9242369Z  2025-03-14T06:29:01.9243072Z  2025-03-14T06:29:01.9243640Z  2025-03-14T06:29:01.9244173Z  2025-03-14T06:29:01.9244840Z  2025-03-14T06:29:01.9245502Z  2025-03-14T06:29:01.9246017Z  2025-03-14T06:29:01.9246514Z  2025-03-14T06:29:01.9247593Z [14,681 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:01.9248928Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T06:29:01.9250075Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T06:29:01.9251197Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T06:29:01.9252452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:29:01.9253582Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 39s local 2025-03-14T06:29:01.9254576Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:01.9255499Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:01.9256521Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T06:29:02.1968890Z 2025-03-14T06:29:02.1969743Z  2025-03-14T06:29:02.1970212Z  2025-03-14T06:29:02.1970634Z  2025-03-14T06:29:02.1971059Z  2025-03-14T06:29:02.1971475Z  2025-03-14T06:29:02.1971890Z  2025-03-14T06:29:02.1972277Z  2025-03-14T06:29:02.1972681Z  2025-03-14T06:29:02.1973656Z [14,682 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:02.1975185Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T06:29:02.1976415Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T06:29:02.1977482Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 52s local 2025-03-14T06:29:02.1978658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:29:02.1979677Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T06:29:02.1980570Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:02.1981338Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:02.1982278Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T06:29:02.3972812Z 2025-03-14T06:29:02.3973681Z  2025-03-14T06:29:02.3974211Z  2025-03-14T06:29:02.3974655Z  2025-03-14T06:29:02.3975112Z  2025-03-14T06:29:02.3975545Z  2025-03-14T06:29:02.3975977Z  2025-03-14T06:29:02.3976405Z  2025-03-14T06:29:02.3976843Z  2025-03-14T06:29:02.3977846Z [14,685 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:02.3979119Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T06:29:02.3980483Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 59s local 2025-03-14T06:29:02.3981598Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T06:29:02.3982763Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 52s local 2025-03-14T06:29:02.3983830Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T06:29:02.3984728Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:02.3985655Z Compiling external/xla/xla/service/hlo.pb.cc; 8s local 2025-03-14T06:29:02.3986671Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 7s local ... 2025-03-14T06:29:02.7978642Z 2025-03-14T06:29:02.7979689Z  2025-03-14T06:29:02.7980254Z  2025-03-14T06:29:02.7980665Z  2025-03-14T06:29:02.7981059Z  2025-03-14T06:29:02.7981498Z  2025-03-14T06:29:02.7981899Z  2025-03-14T06:29:02.7982299Z  2025-03-14T06:29:02.7982744Z  2025-03-14T06:29:02.7983796Z [14,686 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:02.7985089Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:02.7986146Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 59s local 2025-03-14T06:29:02.7987141Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T06:29:02.7988282Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T06:29:02.7989328Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 40s local 2025-03-14T06:29:02.7990242Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2025-03-14T06:29:02.7991103Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2025-03-14T06:29:02.7992087Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local ... 2025-03-14T06:29:02.9982862Z 2025-03-14T06:29:02.9983765Z  2025-03-14T06:29:02.9984361Z  2025-03-14T06:29:02.9984896Z  2025-03-14T06:29:02.9985291Z  2025-03-14T06:29:02.9985690Z  2025-03-14T06:29:02.9986082Z  2025-03-14T06:29:02.9986493Z  2025-03-14T06:29:02.9986915Z  2025-03-14T06:29:02.9987911Z [14,688 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:02.9989090Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:02.9990184Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 59s local 2025-03-14T06:29:02.9991238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T06:29:02.9992711Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T06:29:02.9993776Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:29:02.9994801Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2025-03-14T06:29:02.9995632Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2025-03-14T06:29:02.9996608Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local ... 2025-03-14T06:29:03.2040957Z 2025-03-14T06:29:03.2041924Z  2025-03-14T06:29:03.2042450Z  2025-03-14T06:29:03.2042845Z  2025-03-14T06:29:03.2043270Z  2025-03-14T06:29:03.2043678Z  2025-03-14T06:29:03.2044051Z  2025-03-14T06:29:03.2044448Z  2025-03-14T06:29:03.2045381Z  2025-03-14T06:29:03.2046299Z [14,692 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:03.2047468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:03.2048650Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 53s local 2025-03-14T06:29:03.2049798Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 53s local 2025-03-14T06:29:03.2050775Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:29:03.2051866Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2025-03-14T06:29:03.2052731Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2025-03-14T06:29:03.2053612Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2025-03-14T06:29:03.2054459Z Compiling external/xla/xla/xla.pb.cc; 8s local ... 2025-03-14T06:29:03.4380772Z 2025-03-14T06:29:03.4381636Z  2025-03-14T06:29:03.4382231Z  2025-03-14T06:29:03.4382673Z  2025-03-14T06:29:03.4383115Z  2025-03-14T06:29:03.4383572Z  2025-03-14T06:29:03.4384002Z  2025-03-14T06:29:03.4384469Z  2025-03-14T06:29:03.4384902Z  2025-03-14T06:29:03.4385819Z [14,702 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:03.4386999Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:03.4388201Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:29:03.4389357Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:29:03.4390418Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:29:03.4391319Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:03.4392146Z Compiling external/xla/xla/service/hlo.pb.cc; 9s local 2025-03-14T06:29:03.4393132Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 8s local 2025-03-14T06:29:03.4393987Z Compiling external/xla/xla/xla.pb.cc; 8s local ... 2025-03-14T06:29:03.6480775Z 2025-03-14T06:29:03.6481714Z  2025-03-14T06:29:03.6482228Z  2025-03-14T06:29:03.6482721Z  2025-03-14T06:29:03.6483172Z  2025-03-14T06:29:03.6483617Z  2025-03-14T06:29:03.6484063Z  2025-03-14T06:29:03.6484437Z  2025-03-14T06:29:03.6485025Z  2025-03-14T06:29:03.6485949Z [14,716 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:03.6487016Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:03.6488036Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:29:03.6488996Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:29:03.6489900Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:29:03.6490745Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:03.6491523Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:03.6492372Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T06:29:03.6493715Z Compiling external/xla/xla/xla.pb.cc; 9s local ... 2025-03-14T06:29:03.8559649Z 2025-03-14T06:29:03.8560616Z  2025-03-14T06:29:03.8561094Z  2025-03-14T06:29:03.8561485Z  2025-03-14T06:29:03.8562141Z  2025-03-14T06:29:03.8562601Z  2025-03-14T06:29:03.8562967Z  2025-03-14T06:29:03.8563350Z  2025-03-14T06:29:03.8563731Z  2025-03-14T06:29:03.8564815Z [14,732 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:03.8566198Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T06:29:03.8567373Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:29:03.8568725Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:29:03.8569758Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 41s local 2025-03-14T06:29:03.8570614Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:03.8571512Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:03.8572491Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T06:29:03.8573384Z Compiling external/xla/xla/xla.pb.cc; 9s local ... 2025-03-14T06:29:04.0573302Z 2025-03-14T06:29:04.0574252Z  2025-03-14T06:29:04.0574791Z  2025-03-14T06:29:04.0575511Z  2025-03-14T06:29:04.0575989Z  2025-03-14T06:29:04.0576453Z  2025-03-14T06:29:04.0576824Z  2025-03-14T06:29:04.0577219Z  2025-03-14T06:29:04.0577631Z  2025-03-14T06:29:04.0578655Z [14,743 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:04.0579905Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T06:29:04.0581089Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:29:04.0582266Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:29:04.0583325Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T06:29:04.0584283Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:04.0585189Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:04.0586192Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T06:29:04.0587153Z Compiling external/xla/xla/xla.pb.cc; 9s local ... 2025-03-14T06:29:04.2672749Z 2025-03-14T06:29:04.2673694Z  2025-03-14T06:29:04.2674197Z  2025-03-14T06:29:04.2674688Z  2025-03-14T06:29:04.2675087Z  2025-03-14T06:29:04.2675434Z  2025-03-14T06:29:04.2675785Z  2025-03-14T06:29:04.2676144Z  2025-03-14T06:29:04.2676464Z  2025-03-14T06:29:04.2677270Z [14,754 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:04.2678470Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T06:29:04.2679636Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 54s local 2025-03-14T06:29:04.2680792Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 54s local 2025-03-14T06:29:04.2681821Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T06:29:04.2682752Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:04.2683557Z Compiling external/xla/xla/service/hlo.pb.cc; 10s local 2025-03-14T06:29:04.2684509Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T06:29:04.2685584Z Compiling external/xla/xla/xla.pb.cc; 9s local ... 2025-03-14T06:29:04.5993837Z 2025-03-14T06:29:04.5994792Z  2025-03-14T06:29:04.5995333Z  2025-03-14T06:29:04.5995797Z  2025-03-14T06:29:04.5996207Z  2025-03-14T06:29:04.5996671Z  2025-03-14T06:29:04.5997094Z  2025-03-14T06:29:04.5997472Z  2025-03-14T06:29:04.5998138Z  2025-03-14T06:29:04.5999082Z [14,760 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:04.6000434Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T06:29:04.6001597Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T06:29:04.6002764Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T06:29:04.6003752Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T06:29:04.6004782Z Compiling external/xla/xla/service/hlo.pb.cc; 11s local 2025-03-14T06:29:04.6005644Z Compiling external/xla/xla/service/hlo.pb.cc; 11s local 2025-03-14T06:29:04.6006607Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T06:29:04.6007709Z Compiling external/xla/xla/xla.pb.cc; 9s local ... 2025-03-14T06:29:04.8692322Z 2025-03-14T06:29:04.8693246Z  2025-03-14T06:29:04.8693719Z  2025-03-14T06:29:04.8694096Z  2025-03-14T06:29:04.8694463Z  2025-03-14T06:29:04.8694838Z  2025-03-14T06:29:04.8695213Z  2025-03-14T06:29:04.8695574Z  2025-03-14T06:29:04.8695985Z  2025-03-14T06:29:04.8696902Z [14,765 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:04.8698189Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T06:29:04.8699220Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T06:29:04.8700258Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T06:29:04.8701181Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 42s local 2025-03-14T06:29:04.8702123Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T06:29:04.8702934Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:04.8703744Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 9s local 2025-03-14T06:29:04.8704681Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local ... 2025-03-14T06:29:05.1343407Z 2025-03-14T06:29:05.1344386Z  2025-03-14T06:29:05.1345007Z  2025-03-14T06:29:05.1345495Z  2025-03-14T06:29:05.1345929Z  2025-03-14T06:29:05.1346347Z  2025-03-14T06:29:05.1346819Z  2025-03-14T06:29:05.1347218Z  2025-03-14T06:29:05.1347581Z  2025-03-14T06:29:05.1348421Z [14,770 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:05.1349658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T06:29:05.1350865Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 55s local 2025-03-14T06:29:05.1351910Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T06:29:05.1352834Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T06:29:05.1353746Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T06:29:05.1354566Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:05.1355377Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T06:29:05.1356295Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 8s local ... 2025-03-14T06:29:05.3700542Z 2025-03-14T06:29:05.3701537Z  2025-03-14T06:29:05.3702085Z  2025-03-14T06:29:05.3702778Z  2025-03-14T06:29:05.3703322Z  2025-03-14T06:29:05.3703841Z  2025-03-14T06:29:05.3704356Z  2025-03-14T06:29:05.3704868Z  2025-03-14T06:29:05.3705387Z  2025-03-14T06:29:05.3706468Z [14,774 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:05.3707758Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T06:29:05.3708992Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T06:29:05.3710503Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 55s local 2025-03-14T06:29:05.3711595Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T06:29:05.3712859Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T06:29:05.3713843Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:05.3714868Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T06:29:05.3715982Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2025-03-14T06:29:05.5768150Z 2025-03-14T06:29:05.5769101Z  2025-03-14T06:29:05.5769613Z  2025-03-14T06:29:05.5770049Z  2025-03-14T06:29:05.5770485Z  2025-03-14T06:29:05.5771172Z  2025-03-14T06:29:05.5771604Z  2025-03-14T06:29:05.5772026Z  2025-03-14T06:29:05.5772449Z  2025-03-14T06:29:05.5773454Z [14,779 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:05.5774631Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T06:29:05.5775741Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T06:29:05.5776871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T06:29:05.5778015Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T06:29:05.5778991Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T06:29:05.5779909Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:05.5780779Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T06:29:05.5781734Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2025-03-14T06:29:05.8001424Z 2025-03-14T06:29:05.8002286Z  2025-03-14T06:29:05.8002794Z  2025-03-14T06:29:05.8003365Z  2025-03-14T06:29:05.8003777Z  2025-03-14T06:29:05.8004234Z  2025-03-14T06:29:05.8004858Z  2025-03-14T06:29:05.8005343Z  2025-03-14T06:29:05.8005951Z  2025-03-14T06:29:05.8006907Z [14,779 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:05.8008150Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T06:29:05.8009351Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T06:29:05.8010487Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T06:29:05.8011546Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 43s local 2025-03-14T06:29:05.8012588Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T06:29:05.8013524Z Compiling external/xla/xla/xla.pb.cc; 11s local 2025-03-14T06:29:05.8014471Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 10s local 2025-03-14T06:29:05.8015484Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2025-03-14T06:29:06.1191071Z 2025-03-14T06:29:06.1192064Z  2025-03-14T06:29:06.1192607Z  2025-03-14T06:29:06.1193063Z  2025-03-14T06:29:06.1194708Z  2025-03-14T06:29:06.1195305Z  2025-03-14T06:29:06.1195795Z  2025-03-14T06:29:06.1196238Z  2025-03-14T06:29:06.1196675Z  2025-03-14T06:29:06.1197695Z [14,781 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:06.1198921Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T06:29:06.1200028Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 56s local 2025-03-14T06:29:06.1201135Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T06:29:06.1202180Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T06:29:06.1203194Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T06:29:06.1204276Z Compiling external/xla/xla/xla.pb.cc; 11s local 2025-03-14T06:29:06.1205449Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T06:29:06.3519190Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 9s local ... 2025-03-14T06:29:06.3520140Z 2025-03-14T06:29:06.3520635Z  2025-03-14T06:29:06.3521100Z  2025-03-14T06:29:06.3521539Z  2025-03-14T06:29:06.3521971Z  2025-03-14T06:29:06.3522420Z  2025-03-14T06:29:06.3522841Z  2025-03-14T06:29:06.3523303Z  2025-03-14T06:29:06.3523683Z  2025-03-14T06:29:06.3524572Z [14,785 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:06.3525767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T06:29:06.3527102Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T06:29:06.3528243Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 56s local 2025-03-14T06:29:06.3529279Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T06:29:06.3530266Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T06:29:06.3531169Z Compiling external/xla/xla/xla.pb.cc; 11s local 2025-03-14T06:29:06.3532078Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T06:29:06.3533274Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2025-03-14T06:29:06.5753817Z 2025-03-14T06:29:06.5754682Z  2025-03-14T06:29:06.5755213Z  2025-03-14T06:29:06.5755601Z  2025-03-14T06:29:06.5756026Z  2025-03-14T06:29:06.5756447Z  2025-03-14T06:29:06.5756875Z  2025-03-14T06:29:06.5757288Z  2025-03-14T06:29:06.5757716Z  2025-03-14T06:29:06.5758736Z [14,788 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:06.5759981Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T06:29:06.5761238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T06:29:06.5762398Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T06:29:06.5763416Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T06:29:06.5764444Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T06:29:06.5765899Z Compiling external/xla/xla/xla.pb.cc; 11s local 2025-03-14T06:29:06.5766825Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T06:29:06.5767910Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2025-03-14T06:29:06.8016220Z 2025-03-14T06:29:06.8017094Z  2025-03-14T06:29:06.8017613Z  2025-03-14T06:29:06.8018084Z  2025-03-14T06:29:06.8018526Z  2025-03-14T06:29:06.8018951Z  2025-03-14T06:29:06.8019371Z  2025-03-14T06:29:06.8019796Z  2025-03-14T06:29:06.8020220Z  2025-03-14T06:29:06.8021210Z [14,790 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:06.8022491Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:06.8023721Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T06:29:06.8024933Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T06:29:06.8026014Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 44s local 2025-03-14T06:29:06.8027050Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T06:29:06.8027985Z Compiling external/xla/xla/xla.pb.cc; 12s local 2025-03-14T06:29:06.8028883Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 11s local 2025-03-14T06:29:06.8029924Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2025-03-14T06:29:07.0372041Z 2025-03-14T06:29:07.0372892Z  2025-03-14T06:29:07.0373381Z  2025-03-14T06:29:07.0374057Z  2025-03-14T06:29:07.0374467Z  2025-03-14T06:29:07.0374857Z  2025-03-14T06:29:07.0375255Z  2025-03-14T06:29:07.0375671Z  2025-03-14T06:29:07.0376095Z  2025-03-14T06:29:07.0377204Z [14,792 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:07.0378410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:07.0379582Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 57s local 2025-03-14T06:29:07.0380716Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T06:29:07.0381785Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:29:07.0382832Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T06:29:07.0383955Z Compiling external/xla/xla/xla.pb.cc; 12s local 2025-03-14T06:29:07.0384901Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T06:29:07.0385874Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 10s local ... 2025-03-14T06:29:07.3459241Z 2025-03-14T06:29:07.3460116Z  2025-03-14T06:29:07.3460617Z  2025-03-14T06:29:07.3461060Z  2025-03-14T06:29:07.3461498Z  2025-03-14T06:29:07.3461900Z  2025-03-14T06:29:07.3462345Z  2025-03-14T06:29:07.3462747Z  2025-03-14T06:29:07.3463426Z  2025-03-14T06:29:07.3464375Z [14,797 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:29:07.3465884Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:07.3467014Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:29:07.3468072Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 57s local 2025-03-14T06:29:07.3469071Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:29:07.3470063Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T06:29:07.3470986Z Compiling external/xla/xla/xla.pb.cc; 12s local 2025-03-14T06:29:07.3471888Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T06:29:07.3472937Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local ... 2025-03-14T06:29:07.6022057Z 2025-03-14T06:29:07.6022892Z  2025-03-14T06:29:07.6023432Z  2025-03-14T06:29:07.6023878Z  2025-03-14T06:29:07.6024306Z  2025-03-14T06:29:07.6024725Z  2025-03-14T06:29:07.6025154Z  2025-03-14T06:29:07.6025595Z  2025-03-14T06:29:07.6026027Z  2025-03-14T06:29:07.6027057Z [14,799 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:07.6028338Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:07.6029452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:29:07.6030610Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T06:29:07.6031617Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:29:07.6032618Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T06:29:07.6033553Z Compiling external/xla/xla/xla.pb.cc; 12s local 2025-03-14T06:29:07.6034472Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T06:29:07.6035478Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local ... 2025-03-14T06:29:07.8041467Z 2025-03-14T06:29:07.8042319Z  2025-03-14T06:29:07.8042810Z  2025-03-14T06:29:07.8043221Z  2025-03-14T06:29:07.8043630Z  2025-03-14T06:29:07.8044054Z  2025-03-14T06:29:07.8044489Z  2025-03-14T06:29:07.8045025Z  2025-03-14T06:29:07.8045435Z  2025-03-14T06:29:07.8046388Z [14,801 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:07.8047840Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T06:29:07.8048999Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:29:07.8050264Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T06:29:07.8051311Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 45s local 2025-03-14T06:29:07.8052308Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T06:29:07.8053228Z Compiling external/xla/xla/xla.pb.cc; 13s local 2025-03-14T06:29:07.8054136Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 12s local 2025-03-14T06:29:07.8055148Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local ... 2025-03-14T06:29:08.0721497Z 2025-03-14T06:29:08.0722376Z  2025-03-14T06:29:08.0722861Z  2025-03-14T06:29:08.0723271Z  2025-03-14T06:29:08.0723676Z  2025-03-14T06:29:08.0724100Z  2025-03-14T06:29:08.0724550Z  2025-03-14T06:29:08.0725139Z  2025-03-14T06:29:08.0725551Z  2025-03-14T06:29:08.0726560Z [14,804 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:08.0727789Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T06:29:08.0729216Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:29:08.0730367Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T06:29:08.0731357Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T06:29:08.0732316Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T06:29:08.0733429Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T06:29:08.0734413Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 11s local 2025-03-14T06:29:08.0735422Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 6s local ... 2025-03-14T06:29:08.2721158Z 2025-03-14T06:29:08.2722196Z  2025-03-14T06:29:08.2722739Z  2025-03-14T06:29:08.2723181Z  2025-03-14T06:29:08.2723596Z  2025-03-14T06:29:08.2723965Z  2025-03-14T06:29:08.2724361Z  2025-03-14T06:29:08.2724884Z  2025-03-14T06:29:08.2725258Z  2025-03-14T06:29:08.2726221Z [14,809 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:08.2727505Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T06:29:08.2728624Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 58s local 2025-03-14T06:29:08.2729764Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 58s local 2025-03-14T06:29:08.2730747Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T06:29:08.2731768Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T06:29:08.2732860Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T06:29:08.2733849Z Compiling llvm/lib/MC/MCParser/AsmParser.cpp; 12s local 2025-03-14T06:29:08.2734862Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 6s local ... 2025-03-14T06:29:08.6026356Z 2025-03-14T06:29:08.6027668Z  2025-03-14T06:29:08.6028085Z  2025-03-14T06:29:08.6028398Z  2025-03-14T06:29:08.6028748Z  2025-03-14T06:29:08.6029078Z  2025-03-14T06:29:08.6029412Z  2025-03-14T06:29:08.6029738Z  2025-03-14T06:29:08.6030074Z  2025-03-14T06:29:08.6030874Z [14,812 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:08.6031832Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T06:29:08.6032744Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T06:29:08.6033634Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T06:29:08.6034703Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T06:29:08.6035500Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:08.6036464Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T06:29:08.6037322Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 7s local 2025-03-14T06:29:08.6038213Z @tsl//tsl/profiler/protobuf:profiler_service_cc_grpc_proto; 6s local ... 2025-03-14T06:29:08.8030770Z 2025-03-14T06:29:08.8032079Z  2025-03-14T06:29:08.8032559Z  2025-03-14T06:29:08.8032986Z  2025-03-14T06:29:08.8033397Z  2025-03-14T06:29:08.8033791Z  2025-03-14T06:29:08.8034165Z  2025-03-14T06:29:08.8034900Z  2025-03-14T06:29:08.8035298Z  2025-03-14T06:29:08.8036234Z [14,815 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:08.8037428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T06:29:08.8038560Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T06:29:08.8039672Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T06:29:08.8040727Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 46s local 2025-03-14T06:29:08.8041936Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:08.8043018Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 13s local 2025-03-14T06:29:08.8044088Z Compiling .../rpc/coordination/grpc_coordination_client.cc; 7s local 2025-03-14T06:29:08.8045359Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 5s local ... 2025-03-14T06:29:09.0873396Z 2025-03-14T06:29:09.0874251Z  2025-03-14T06:29:09.0874751Z  2025-03-14T06:29:09.0875139Z  2025-03-14T06:29:09.0875528Z  2025-03-14T06:29:09.0875913Z  2025-03-14T06:29:09.0876319Z  2025-03-14T06:29:09.0876702Z  2025-03-14T06:29:09.0877102Z  2025-03-14T06:29:09.0878056Z [14,819 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:09.0879210Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T06:29:09.0880289Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T06:29:09.0881382Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T06:29:09.0882364Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T06:29:09.0883352Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:09.0884306Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:09.0885496Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 5s local 2025-03-14T06:29:09.0886370Z Compiling xla/debug_options_flags.cc; 4s local ... 2025-03-14T06:29:09.3201413Z 2025-03-14T06:29:09.3202360Z  2025-03-14T06:29:09.3202870Z  2025-03-14T06:29:09.3203284Z  2025-03-14T06:29:09.3203699Z  2025-03-14T06:29:09.3204119Z  2025-03-14T06:29:09.3204540Z  2025-03-14T06:29:09.3205151Z  2025-03-14T06:29:09.3205573Z  2025-03-14T06:29:09.3206548Z [14,821 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:09.3207736Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T06:29:09.3208891Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 59s local 2025-03-14T06:29:09.3210132Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 59s local 2025-03-14T06:29:09.3211157Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T06:29:09.3212117Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:09.3213155Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:09.3214485Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 5s local 2025-03-14T06:29:09.3215398Z Compiling xla/debug_options_flags.cc; 5s local ... 2025-03-14T06:29:09.5527078Z 2025-03-14T06:29:09.5528188Z  2025-03-14T06:29:09.5528705Z  2025-03-14T06:29:09.5529134Z  2025-03-14T06:29:09.5529570Z  2025-03-14T06:29:09.5530014Z  2025-03-14T06:29:09.5530427Z  2025-03-14T06:29:09.5530842Z  2025-03-14T06:29:09.5531250Z  2025-03-14T06:29:09.5532219Z [14,825 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:09.5533464Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T06:29:09.5534828Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T06:29:09.5536001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T06:29:09.5537083Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T06:29:09.5538122Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:09.5539205Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:09.5540304Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T06:29:09.5541441Z Compiling xla/debug_options_flags.cc; 5s local ... 2025-03-14T06:29:09.7840654Z 2025-03-14T06:29:09.7841517Z  2025-03-14T06:29:09.7842021Z  2025-03-14T06:29:09.7842441Z  2025-03-14T06:29:09.7842868Z  2025-03-14T06:29:09.7843284Z  2025-03-14T06:29:09.7843704Z  2025-03-14T06:29:09.7844088Z  2025-03-14T06:29:09.7844481Z  2025-03-14T06:29:09.7845676Z [14,828 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:29:09.7846829Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T06:29:09.7848088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T06:29:09.7849255Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T06:29:09.7850315Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 47s local 2025-03-14T06:29:09.7851317Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T06:29:09.7852419Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 14s local 2025-03-14T06:29:09.7853516Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T06:29:09.7854469Z Compiling xla/debug_options_flags.cc; 5s local ... 2025-03-14T06:29:10.0044311Z 2025-03-14T06:29:10.0045322Z  2025-03-14T06:29:10.0045826Z  2025-03-14T06:29:10.0046269Z  2025-03-14T06:29:10.0046682Z  2025-03-14T06:29:10.0047103Z  2025-03-14T06:29:10.0047517Z  2025-03-14T06:29:10.0047937Z  2025-03-14T06:29:10.0048359Z  2025-03-14T06:29:10.0049343Z [14,828 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:10.0050577Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T06:29:10.0051725Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T06:29:10.0052957Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T06:29:10.0053998Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T06:29:10.0054948Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T06:29:10.0055924Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T06:29:10.0056924Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T06:29:10.0057774Z Compiling xla/debug_options_flags.cc; 5s local ... 2025-03-14T06:29:10.2056772Z 2025-03-14T06:29:10.2057646Z  2025-03-14T06:29:10.2058435Z  2025-03-14T06:29:10.2058840Z  2025-03-14T06:29:10.2059232Z  2025-03-14T06:29:10.2059624Z  2025-03-14T06:29:10.2060043Z  2025-03-14T06:29:10.2060468Z  2025-03-14T06:29:10.2060887Z  2025-03-14T06:29:10.2062093Z [14,832 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:10.2063357Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T06:29:10.2064538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 60s local 2025-03-14T06:29:10.2065964Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 60s local 2025-03-14T06:29:10.2066936Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T06:29:10.2068112Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T06:29:10.2069186Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T06:29:10.2070253Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T06:29:10.2071183Z Compiling xla/debug_options_flags.cc; 6s local ... 2025-03-14T06:29:10.4380333Z 2025-03-14T06:29:10.4381173Z  2025-03-14T06:29:10.4381692Z  2025-03-14T06:29:10.4382127Z  2025-03-14T06:29:10.4382518Z  2025-03-14T06:29:10.4382919Z  2025-03-14T06:29:10.4383337Z  2025-03-14T06:29:10.4384036Z  2025-03-14T06:29:10.4384481Z  2025-03-14T06:29:10.4385449Z [14,834 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:10.4386612Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T06:29:10.4387770Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T06:29:10.4388976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T06:29:10.4390019Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T06:29:10.4391015Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T06:29:10.4392092Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T06:29:10.4393178Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 6s local 2025-03-14T06:29:10.4394078Z Compiling xla/debug_options_flags.cc; 6s local ... 2025-03-14T06:29:10.7756092Z 2025-03-14T06:29:10.7757009Z  2025-03-14T06:29:10.7757489Z  2025-03-14T06:29:10.7757886Z  2025-03-14T06:29:10.7758218Z  2025-03-14T06:29:10.7758616Z  2025-03-14T06:29:10.7759000Z  2025-03-14T06:29:10.7771752Z  2025-03-14T06:29:10.7772597Z  2025-03-14T06:29:10.7773496Z [14,837 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:10.7774657Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T06:29:10.7775725Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T06:29:10.7776788Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T06:29:10.7777802Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 48s local 2025-03-14T06:29:10.7778776Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T06:29:10.7780920Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 15s local 2025-03-14T06:29:10.7782028Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2025-03-14T06:29:10.7783008Z Compiling xla/debug_options_flags.cc; 6s local ... 2025-03-14T06:29:11.0049920Z 2025-03-14T06:29:11.0050756Z  2025-03-14T06:29:11.0051264Z  2025-03-14T06:29:11.0051690Z  2025-03-14T06:29:11.0052149Z  2025-03-14T06:29:11.0052591Z  2025-03-14T06:29:11.0053007Z  2025-03-14T06:29:11.0053412Z  2025-03-14T06:29:11.0053821Z  2025-03-14T06:29:11.0054806Z [14,838 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:11.0056323Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T06:29:11.0057524Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T06:29:11.0058670Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T06:29:11.0059716Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:29:11.0060728Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T06:29:11.0061794Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T06:29:11.0062864Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2025-03-14T06:29:11.0064041Z Compiling xla/debug_options_flags.cc; 6s local ... 2025-03-14T06:29:11.2053397Z 2025-03-14T06:29:11.2054254Z  2025-03-14T06:29:11.2054740Z  2025-03-14T06:29:11.2055158Z  2025-03-14T06:29:11.2055590Z  2025-03-14T06:29:11.2056021Z  2025-03-14T06:29:11.2056449Z  2025-03-14T06:29:11.2056863Z  2025-03-14T06:29:11.2057247Z  2025-03-14T06:29:11.2058207Z [14,841 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:11.2059473Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T06:29:11.2060954Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 61s local 2025-03-14T06:29:11.2062153Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 61s local 2025-03-14T06:29:11.2063221Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:29:11.2064268Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T06:29:11.2065678Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T06:29:11.2066797Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 7s local 2025-03-14T06:29:11.2067771Z Compiling xla/debug_options_flags.cc; 7s local ... 2025-03-14T06:29:11.4832723Z 2025-03-14T06:29:11.4833707Z  2025-03-14T06:29:11.4834227Z  2025-03-14T06:29:11.4834648Z  2025-03-14T06:29:11.4835087Z  2025-03-14T06:29:11.4835507Z  2025-03-14T06:29:11.4835946Z  2025-03-14T06:29:11.4836365Z  2025-03-14T06:29:11.4836800Z  2025-03-14T06:29:11.4837794Z [14,843 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:11.4839043Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T06:29:11.4840271Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T06:29:11.4841537Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:29:11.4842677Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:29:11.4843776Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T06:29:11.4845051Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T06:29:11.4846170Z Compiling xla/tsl/distributed_runtime/rpc/grpc_channel.cc; 8s local 2025-03-14T06:29:11.4847184Z Compiling xla/debug_options_flags.cc; 7s local ... 2025-03-14T06:29:11.7296653Z 2025-03-14T06:29:11.7297735Z  2025-03-14T06:29:11.7298445Z  2025-03-14T06:29:11.7299181Z  2025-03-14T06:29:11.7300164Z  2025-03-14T06:29:11.7300664Z  2025-03-14T06:29:11.7301104Z  2025-03-14T06:29:11.7301549Z  2025-03-14T06:29:11.7301966Z  2025-03-14T06:29:11.7302978Z [14,848 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:11.7304317Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T06:29:11.7305583Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T06:29:11.7306874Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:29:11.7308275Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 49s local 2025-03-14T06:29:11.7309382Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T06:29:11.7310675Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 16s local 2025-03-14T06:29:11.7311681Z Compiling xla/debug_options_flags.cc; 7s local 2025-03-14T06:29:11.7312519Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2025-03-14T06:29:11.9651098Z 2025-03-14T06:29:11.9652421Z  2025-03-14T06:29:11.9652917Z  2025-03-14T06:29:11.9653334Z  2025-03-14T06:29:11.9653746Z  2025-03-14T06:29:11.9654156Z  2025-03-14T06:29:11.9654579Z  2025-03-14T06:29:11.9655269Z  2025-03-14T06:29:11.9655673Z  2025-03-14T06:29:11.9656648Z [14,852 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:11.9657872Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T06:29:11.9659031Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T06:29:11.9660232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:29:11.9661340Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T06:29:11.9662505Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T06:29:11.9663465Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T06:29:11.9664375Z Compiling xla/debug_options_flags.cc; 7s local 2025-03-14T06:29:11.9665173Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2025-03-14T06:29:12.2061847Z 2025-03-14T06:29:12.2063044Z  2025-03-14T06:29:12.2064558Z  2025-03-14T06:29:12.2065066Z  2025-03-14T06:29:12.2065762Z  2025-03-14T06:29:12.2066150Z  2025-03-14T06:29:12.2066539Z  2025-03-14T06:29:12.2066922Z  2025-03-14T06:29:12.2067347Z  2025-03-14T06:29:12.2068283Z [14,853 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:12.2069543Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T06:29:12.2070688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 62s local 2025-03-14T06:29:12.2071836Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 62s local 2025-03-14T06:29:12.2072920Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T06:29:12.2074038Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T06:29:12.2075183Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T06:29:12.2076098Z Compiling xla/debug_options_flags.cc; 8s local 2025-03-14T06:29:12.2076858Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2025-03-14T06:29:12.5914961Z 2025-03-14T06:29:12.5915858Z  2025-03-14T06:29:12.5916435Z  2025-03-14T06:29:12.5916869Z  2025-03-14T06:29:12.5917274Z  2025-03-14T06:29:12.5917675Z  2025-03-14T06:29:12.5918087Z  2025-03-14T06:29:12.5918509Z  2025-03-14T06:29:12.5918905Z  2025-03-14T06:29:12.5919932Z [14,856 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:12.5921163Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T06:29:12.5922370Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T06:29:12.5923530Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T06:29:12.5924736Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T06:29:12.5925812Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2025-03-14T06:29:12.5926943Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T06:29:12.5928202Z Compiling xla/debug_options_flags.cc; 8s local 2025-03-14T06:29:12.5928991Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local ... 2025-03-14T06:29:12.8069062Z 2025-03-14T06:29:12.8070220Z  2025-03-14T06:29:12.8070959Z  2025-03-14T06:29:12.8071940Z  2025-03-14T06:29:12.8072986Z  2025-03-14T06:29:12.8073468Z  2025-03-14T06:29:12.8073865Z  2025-03-14T06:29:12.8074292Z  2025-03-14T06:29:12.8074738Z  2025-03-14T06:29:12.8075707Z [14,857 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:12.8076949Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T06:29:12.8078169Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T06:29:12.8079587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T06:29:12.8080686Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 50s local 2025-03-14T06:29:12.8081750Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2025-03-14T06:29:12.8082871Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 17s local 2025-03-14T06:29:12.8083826Z Compiling xla/debug_options_flags.cc; 8s local 2025-03-14T06:29:12.8084816Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local ... 2025-03-14T06:29:13.0074608Z 2025-03-14T06:29:13.0075764Z  2025-03-14T06:29:13.0076798Z  2025-03-14T06:29:13.0077471Z  2025-03-14T06:29:13.0078521Z  2025-03-14T06:29:13.0079017Z  2025-03-14T06:29:13.0079478Z  2025-03-14T06:29:13.0079904Z  2025-03-14T06:29:13.0080329Z  2025-03-14T06:29:13.0081396Z [14,859 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:13.0082782Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T06:29:13.0084060Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T06:29:13.0085512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T06:29:13.0086673Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T06:29:13.0087762Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2025-03-14T06:29:13.0088797Z Compiling xla/debug_options_flags.cc; 8s local 2025-03-14T06:29:13.0089662Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T06:29:13.0090493Z Compiling xla/debug_options_flags.cc; 8s local ... 2025-03-14T06:29:13.2690936Z 2025-03-14T06:29:13.2691741Z  2025-03-14T06:29:13.2692214Z  2025-03-14T06:29:13.2692671Z  2025-03-14T06:29:13.2693060Z  2025-03-14T06:29:13.2693492Z  2025-03-14T06:29:13.2693879Z  2025-03-14T06:29:13.2694315Z  2025-03-14T06:29:13.2694720Z  2025-03-14T06:29:13.2695624Z [14,865 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:13.2696805Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T06:29:13.2697860Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 63s local 2025-03-14T06:29:13.2698945Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 63s local 2025-03-14T06:29:13.2699893Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T06:29:13.2700835Z @xla//xla/tsl/protobuf:coordination_service_cc_grpc_proto; 18s local 2025-03-14T06:29:13.2701669Z Compiling xla/debug_options_flags.cc; 9s local 2025-03-14T06:29:13.2702414Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T06:29:13.2703127Z Compiling xla/debug_options_flags.cc; 8s local ... 2025-03-14T06:29:13.5388322Z 2025-03-14T06:29:13.5389137Z  2025-03-14T06:29:13.5389591Z  2025-03-14T06:29:13.5389930Z  2025-03-14T06:29:13.5390269Z  2025-03-14T06:29:13.5390636Z  2025-03-14T06:29:13.5390989Z  2025-03-14T06:29:13.5391286Z  2025-03-14T06:29:13.5391892Z  2025-03-14T06:29:13.5392846Z [14,867 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:13.5394320Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T06:29:13.5395679Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T06:29:13.5397011Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:29:13.5397934Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T06:29:13.5398656Z Compiling xla/debug_options_flags.cc; 9s local 2025-03-14T06:29:13.5399304Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T06:29:13.5400074Z Compiling xla/debug_options_flags.cc; 8s local 2025-03-14T06:29:13.5401000Z Compiling external/xla/xla/xla.pb.cc; 5s local ... 2025-03-14T06:29:13.8083606Z 2025-03-14T06:29:13.8084471Z  2025-03-14T06:29:13.8085120Z  2025-03-14T06:29:13.8085586Z  2025-03-14T06:29:13.8086008Z  2025-03-14T06:29:13.8086410Z  2025-03-14T06:29:13.8086832Z  2025-03-14T06:29:13.8087227Z  2025-03-14T06:29:13.8087648Z  2025-03-14T06:29:13.8088658Z [14,871 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:13.8090195Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T06:29:13.8091200Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T06:29:13.8092311Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:29:13.8093357Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 51s local 2025-03-14T06:29:13.8094197Z Compiling xla/debug_options_flags.cc; 9s local 2025-03-14T06:29:13.8094968Z Compiling llvm/lib/IR/DebugInfo.cpp; 9s local 2025-03-14T06:29:13.8095702Z Compiling xla/debug_options_flags.cc; 8s local 2025-03-14T06:29:13.8096469Z Compiling external/xla/xla/xla.pb.cc; 5s local ... 2025-03-14T06:29:14.0087887Z 2025-03-14T06:29:14.0088727Z  2025-03-14T06:29:14.0089234Z  2025-03-14T06:29:14.0089680Z  2025-03-14T06:29:14.0090119Z  2025-03-14T06:29:14.0090544Z  2025-03-14T06:29:14.0090986Z  2025-03-14T06:29:14.0091413Z  2025-03-14T06:29:14.0091838Z  2025-03-14T06:29:14.0092964Z [14,873 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:14.0094241Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T06:29:14.0095421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T06:29:14.0096560Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:29:14.0097595Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T06:29:14.0098455Z Compiling xla/debug_options_flags.cc; 9s local 2025-03-14T06:29:14.0099179Z Compiling llvm/lib/IR/DebugInfo.cpp; 9s local 2025-03-14T06:29:14.0099902Z Compiling xla/debug_options_flags.cc; 9s local 2025-03-14T06:29:14.0100675Z Compiling external/xla/xla/xla.pb.cc; 6s local ... 2025-03-14T06:29:14.2171002Z 2025-03-14T06:29:14.2171907Z  2025-03-14T06:29:14.2172333Z  2025-03-14T06:29:14.2172688Z  2025-03-14T06:29:14.2173034Z  2025-03-14T06:29:14.2173388Z  2025-03-14T06:29:14.2173740Z  2025-03-14T06:29:14.2174085Z  2025-03-14T06:29:14.2174424Z  2025-03-14T06:29:14.2175213Z [14,876 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:14.2176202Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T06:29:14.2177175Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 64s local 2025-03-14T06:29:14.2178130Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 64s local 2025-03-14T06:29:14.2179268Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T06:29:14.2179975Z Compiling xla/debug_options_flags.cc; 10s local 2025-03-14T06:29:14.2180737Z Compiling llvm/lib/IR/DebugInfo.cpp; 9s local 2025-03-14T06:29:14.2181480Z Compiling xla/debug_options_flags.cc; 9s local 2025-03-14T06:29:14.2182129Z Compiling external/xla/xla/xla.pb.cc; 6s local ... 2025-03-14T06:29:14.4949404Z 2025-03-14T06:29:14.4950351Z  2025-03-14T06:29:14.4950918Z  2025-03-14T06:29:14.4951350Z  2025-03-14T06:29:14.4951784Z  2025-03-14T06:29:14.4952206Z  2025-03-14T06:29:14.4952658Z  2025-03-14T06:29:14.4953079Z  2025-03-14T06:29:14.4953512Z  2025-03-14T06:29:14.4954465Z [14,880 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:14.4956096Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T06:29:14.4957228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T06:29:14.4958402Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T06:29:14.4959544Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T06:29:14.4960373Z Compiling xla/debug_options_flags.cc; 10s local 2025-03-14T06:29:14.4961093Z Compiling llvm/lib/IR/DebugInfo.cpp; 9s local 2025-03-14T06:29:14.4962021Z Compiling xla/debug_options_flags.cc; 9s local 2025-03-14T06:29:14.4962779Z Compiling external/xla/xla/xla.pb.cc; 6s local ... 2025-03-14T06:29:14.8094186Z 2025-03-14T06:29:14.8095022Z  2025-03-14T06:29:14.8095525Z  2025-03-14T06:29:14.8095928Z  2025-03-14T06:29:14.8096308Z  2025-03-14T06:29:14.8096721Z  2025-03-14T06:29:14.8097176Z  2025-03-14T06:29:14.8097584Z  2025-03-14T06:29:14.8097991Z  2025-03-14T06:29:14.8098983Z [14,881 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:14.8103439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T06:29:14.8104591Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T06:29:14.8105821Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T06:29:14.8106986Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 52s local 2025-03-14T06:29:14.8107825Z Compiling xla/debug_options_flags.cc; 10s local 2025-03-14T06:29:14.8108569Z Compiling xla/debug_options_flags.cc; 9s local 2025-03-14T06:29:14.8109260Z Compiling external/xla/xla/xla.pb.cc; 6s local 2025-03-14T06:29:14.8110214Z @tsl//tsl/profiler/protobuf:profiler_service_cc_grpc_proto; 6s local ... 2025-03-14T06:29:15.0859604Z 2025-03-14T06:29:15.0860520Z  2025-03-14T06:29:15.0860982Z  2025-03-14T06:29:15.0861372Z  2025-03-14T06:29:15.0861761Z  2025-03-14T06:29:15.0862152Z  2025-03-14T06:29:15.0862546Z  2025-03-14T06:29:15.0862948Z  2025-03-14T06:29:15.0863328Z  2025-03-14T06:29:15.0864223Z [14,883 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:15.0865609Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T06:29:15.0866675Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T06:29:15.0867754Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T06:29:15.0868734Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T06:29:15.0869523Z Compiling xla/debug_options_flags.cc; 10s local 2025-03-14T06:29:15.0870348Z Compiling xla/debug_options_flags.cc; 10s local 2025-03-14T06:29:15.0870973Z Compiling external/xla/xla/xla.pb.cc; 7s local 2025-03-14T06:29:15.0871822Z @tsl//tsl/profiler/protobuf:profiler_service_cc_grpc_proto; 6s local ... 2025-03-14T06:29:15.2911405Z 2025-03-14T06:29:15.2915313Z  2025-03-14T06:29:15.2916099Z  2025-03-14T06:29:15.2916525Z  2025-03-14T06:29:15.2916921Z  2025-03-14T06:29:15.2917275Z  2025-03-14T06:29:15.2917630Z  2025-03-14T06:29:15.2917988Z  2025-03-14T06:29:15.2918364Z  2025-03-14T06:29:15.2919437Z [14,885 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:29:15.2920652Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T06:29:15.2921830Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 65s local 2025-03-14T06:29:15.2922985Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 65s local 2025-03-14T06:29:15.2924001Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T06:29:15.2925205Z Compiling xla/debug_options_flags.cc; 11s local 2025-03-14T06:29:15.2925950Z Compiling xla/debug_options_flags.cc; 10s local 2025-03-14T06:29:15.2926647Z Compiling external/xla/xla/xla.pb.cc; 7s local 2025-03-14T06:29:15.2927503Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 5s local ... 2025-03-14T06:29:15.6098331Z 2025-03-14T06:29:15.6099226Z  2025-03-14T06:29:15.6099747Z  2025-03-14T06:29:15.6101821Z  2025-03-14T06:29:15.6102674Z  2025-03-14T06:29:15.6103527Z  2025-03-14T06:29:15.6104089Z  2025-03-14T06:29:15.6104634Z  2025-03-14T06:29:15.6105467Z  2025-03-14T06:29:15.6106610Z [14,890 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:15.6107811Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T06:29:15.6109069Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T06:29:15.6110226Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T06:29:15.6111262Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T06:29:15.6112131Z Compiling xla/debug_options_flags.cc; 11s local 2025-03-14T06:29:15.6112926Z Compiling xla/debug_options_flags.cc; 10s local 2025-03-14T06:29:15.6113673Z Compiling external/xla/xla/xla.pb.cc; 7s local 2025-03-14T06:29:15.6114641Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 5s local ... 2025-03-14T06:29:15.8101447Z 2025-03-14T06:29:15.8102777Z  2025-03-14T06:29:15.8103290Z  2025-03-14T06:29:15.8103713Z  2025-03-14T06:29:15.8104136Z  2025-03-14T06:29:15.8104525Z  2025-03-14T06:29:15.8104893Z  2025-03-14T06:29:15.8105282Z  2025-03-14T06:29:15.8105670Z  2025-03-14T06:29:15.8106616Z [14,892 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:15.8107854Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T06:29:15.8108929Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T06:29:15.8110009Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T06:29:15.8111019Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 53s local 2025-03-14T06:29:15.8111861Z Compiling xla/debug_options_flags.cc; 11s local 2025-03-14T06:29:15.8112636Z Compiling xla/debug_options_flags.cc; 10s local 2025-03-14T06:29:15.8113509Z Compiling external/xla/xla/xla.pb.cc; 7s local 2025-03-14T06:29:15.8114583Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 5s local ... 2025-03-14T06:29:16.1116398Z 2025-03-14T06:29:16.1117694Z  2025-03-14T06:29:16.1118188Z  2025-03-14T06:29:16.1118592Z  2025-03-14T06:29:16.1118999Z  2025-03-14T06:29:16.1119331Z  2025-03-14T06:29:16.1119712Z  2025-03-14T06:29:16.1120120Z  2025-03-14T06:29:16.1120544Z  2025-03-14T06:29:16.1121544Z [14,896 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:16.1122767Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T06:29:16.1126322Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 66s local 2025-03-14T06:29:16.1127552Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T06:29:16.1128631Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T06:29:16.1129476Z Compiling xla/debug_options_flags.cc; 11s local 2025-03-14T06:29:16.1130189Z Compiling xla/debug_options_flags.cc; 11s local 2025-03-14T06:29:16.1130899Z Compiling external/xla/xla/xla.pb.cc; 8s local 2025-03-14T06:29:16.1131810Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 5s local ... 2025-03-14T06:29:16.4107664Z 2025-03-14T06:29:16.4109015Z  2025-03-14T06:29:16.4109520Z  2025-03-14T06:29:16.4110208Z  2025-03-14T06:29:16.4110623Z  2025-03-14T06:29:16.4111034Z  2025-03-14T06:29:16.4111439Z  2025-03-14T06:29:16.4111844Z  2025-03-14T06:29:16.4112231Z  2025-03-14T06:29:16.4113218Z [14,899 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:16.4114421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T06:29:16.4115513Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T06:29:16.4116595Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 66s local 2025-03-14T06:29:16.4117912Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T06:29:16.4118764Z Compiling xla/debug_options_flags.cc; 12s local 2025-03-14T06:29:16.4119489Z Compiling xla/debug_options_flags.cc; 11s local 2025-03-14T06:29:16.4120300Z Compiling external/xla/xla/xla.pb.cc; 8s local 2025-03-14T06:29:16.4121183Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 6s local ... 2025-03-14T06:29:16.6111467Z 2025-03-14T06:29:16.6112294Z  2025-03-14T06:29:16.6112726Z  2025-03-14T06:29:16.6113068Z  2025-03-14T06:29:16.6113445Z  2025-03-14T06:29:16.6113782Z  2025-03-14T06:29:16.6114126Z  2025-03-14T06:29:16.6114463Z  2025-03-14T06:29:16.6114801Z  2025-03-14T06:29:16.6115630Z [14,902 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:16.6116588Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T06:29:16.6117497Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T06:29:16.6118417Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T06:29:16.6119246Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T06:29:16.6119927Z Compiling xla/debug_options_flags.cc; 12s local 2025-03-14T06:29:16.6120532Z Compiling xla/debug_options_flags.cc; 11s local 2025-03-14T06:29:16.6121581Z Compiling external/xla/xla/xla.pb.cc; 8s local 2025-03-14T06:29:16.6122427Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 6s local ... 2025-03-14T06:29:16.9116014Z 2025-03-14T06:29:16.9116841Z  2025-03-14T06:29:16.9117300Z  2025-03-14T06:29:16.9117671Z  2025-03-14T06:29:16.9118035Z  2025-03-14T06:29:16.9118390Z  2025-03-14T06:29:16.9118775Z  2025-03-14T06:29:16.9119127Z  2025-03-14T06:29:16.9119488Z  2025-03-14T06:29:16.9120354Z [14,906 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:16.9121425Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T06:29:16.9122446Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T06:29:16.9123468Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T06:29:16.9124409Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 54s local 2025-03-14T06:29:16.9125284Z Compiling xla/debug_options_flags.cc; 12s local 2025-03-14T06:29:16.9125944Z Compiling xla/debug_options_flags.cc; 12s local 2025-03-14T06:29:16.9126922Z Compiling external/xla/xla/xla.pb.cc; 9s local 2025-03-14T06:29:16.9127754Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 6s local ... 2025-03-14T06:29:17.2117407Z 2025-03-14T06:29:17.2118975Z  2025-03-14T06:29:17.2119539Z  2025-03-14T06:29:17.2119963Z  2025-03-14T06:29:17.2120369Z  2025-03-14T06:29:17.2120758Z  2025-03-14T06:29:17.2121170Z  2025-03-14T06:29:17.2121568Z  2025-03-14T06:29:17.2121974Z  2025-03-14T06:29:17.2122933Z [14,907 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:17.2124166Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T06:29:17.2125729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 67s local 2025-03-14T06:29:17.2126883Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T06:29:17.2127911Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T06:29:17.2128768Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:17.2129479Z Compiling xla/debug_options_flags.cc; 12s local 2025-03-14T06:29:17.2130250Z Compiling external/xla/xla/xla.pb.cc; 9s local 2025-03-14T06:29:17.2131133Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 7s local ... 2025-03-14T06:29:17.4121902Z 2025-03-14T06:29:17.4123486Z  2025-03-14T06:29:17.4124024Z  2025-03-14T06:29:17.4124440Z  2025-03-14T06:29:17.4125103Z  2025-03-14T06:29:17.4125510Z  2025-03-14T06:29:17.4126062Z  2025-03-14T06:29:17.4126462Z  2025-03-14T06:29:17.4126850Z  2025-03-14T06:29:17.4127801Z [14,910 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:17.4129013Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T06:29:17.4130151Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T06:29:17.4131338Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 67s local 2025-03-14T06:29:17.4132369Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T06:29:17.4133190Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:17.4133927Z Compiling xla/debug_options_flags.cc; 12s local 2025-03-14T06:29:17.4134654Z Compiling external/xla/xla/xla.pb.cc; 9s local 2025-03-14T06:29:17.4135553Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 7s local ... 2025-03-14T06:29:17.6626920Z 2025-03-14T06:29:17.6628223Z  2025-03-14T06:29:17.6628746Z  2025-03-14T06:29:17.6629160Z  2025-03-14T06:29:17.6629567Z  2025-03-14T06:29:17.6629978Z  2025-03-14T06:29:17.6630410Z  2025-03-14T06:29:17.6630804Z  2025-03-14T06:29:17.6631198Z  2025-03-14T06:29:17.6632238Z [14,911 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:17.6633443Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T06:29:17.6634571Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T06:29:17.6635740Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T06:29:17.6636768Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T06:29:17.6637606Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:17.6638325Z Compiling xla/debug_options_flags.cc; 12s local 2025-03-14T06:29:17.6639081Z Compiling external/xla/xla/xla.pb.cc; 9s local 2025-03-14T06:29:17.6639978Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 7s local ... 2025-03-14T06:29:17.9130393Z 2025-03-14T06:29:17.9131274Z  2025-03-14T06:29:17.9131778Z  2025-03-14T06:29:17.9132208Z  2025-03-14T06:29:17.9132643Z  2025-03-14T06:29:17.9133053Z  2025-03-14T06:29:17.9133471Z  2025-03-14T06:29:17.9134129Z  2025-03-14T06:29:17.9134542Z  2025-03-14T06:29:17.9135501Z [14,912 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:17.9136823Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T06:29:17.9138006Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T06:29:17.9139187Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T06:29:17.9140161Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 55s local 2025-03-14T06:29:17.9141041Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:17.9141829Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:17.9142750Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:17.9143669Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 7s local ... 2025-03-14T06:29:18.1630510Z 2025-03-14T06:29:18.1631404Z  2025-03-14T06:29:18.1631966Z  2025-03-14T06:29:18.1632323Z  2025-03-14T06:29:18.1632678Z  2025-03-14T06:29:18.1633040Z  2025-03-14T06:29:18.1633400Z  2025-03-14T06:29:18.1633757Z  2025-03-14T06:29:18.1634138Z  2025-03-14T06:29:18.1635037Z [14,914 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:18.1636408Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T06:29:18.1637561Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 68s local 2025-03-14T06:29:18.1638690Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T06:29:18.1639788Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:29:18.1640672Z Compiling xla/debug_options_flags.cc; 14s local 2025-03-14T06:29:18.1641338Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:18.1642057Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:18.1642847Z Compiling xla/ffi/call_frame.cc; 6s local ... 2025-03-14T06:29:18.4133022Z 2025-03-14T06:29:18.4133939Z  2025-03-14T06:29:18.4134452Z  2025-03-14T06:29:18.4134895Z  2025-03-14T06:29:18.4135364Z  2025-03-14T06:29:18.4135773Z  2025-03-14T06:29:18.4136204Z  2025-03-14T06:29:18.4136631Z  2025-03-14T06:29:18.4137053Z  2025-03-14T06:29:18.4138056Z [14,918 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:18.4139445Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T06:29:18.4140734Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T06:29:18.4142189Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 68s local 2025-03-14T06:29:18.4143358Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:29:18.4144280Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:18.4145111Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:18.4145895Z Compiling xla/ffi/call_frame.cc; 7s local 2025-03-14T06:29:18.4146635Z Compiling xla/pjrt/transpose.cc; 7s local ... 2025-03-14T06:29:18.6136040Z 2025-03-14T06:29:18.6136845Z  2025-03-14T06:29:18.6137308Z  2025-03-14T06:29:18.6137739Z  2025-03-14T06:29:18.6138210Z  2025-03-14T06:29:18.6138635Z  2025-03-14T06:29:18.6139033Z  2025-03-14T06:29:18.6139447Z  2025-03-14T06:29:18.6139836Z  2025-03-14T06:29:18.6140800Z [14,919 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:18.6142041Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T06:29:18.6143231Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T06:29:18.6144469Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T06:29:18.6145851Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:29:18.6146670Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:18.6147535Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:18.6148248Z Compiling xla/ffi/call_frame.cc; 7s local 2025-03-14T06:29:18.6148950Z Compiling xla/pjrt/transpose.cc; 7s local ... 2025-03-14T06:29:18.8209954Z 2025-03-14T06:29:18.8210795Z  2025-03-14T06:29:18.8211234Z  2025-03-14T06:29:18.8211613Z  2025-03-14T06:29:18.8211984Z  2025-03-14T06:29:18.8212327Z  2025-03-14T06:29:18.8212682Z  2025-03-14T06:29:18.8213039Z  2025-03-14T06:29:18.8213387Z  2025-03-14T06:29:18.8214242Z [14,921 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:18.8215524Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T06:29:18.8216560Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T06:29:18.8217562Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T06:29:18.8218462Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 56s local 2025-03-14T06:29:18.8219193Z Compiling xla/debug_options_flags.cc; 13s local 2025-03-14T06:29:18.8219995Z Compiling external/xla/xla/xla.pb.cc; 10s local 2025-03-14T06:29:18.8220622Z Compiling xla/ffi/call_frame.cc; 7s local 2025-03-14T06:29:18.8221233Z Compiling xla/pjrt/transpose.cc; 7s local ... 2025-03-14T06:29:19.1279594Z 2025-03-14T06:29:19.1280581Z  2025-03-14T06:29:19.1281168Z  2025-03-14T06:29:19.1281538Z  2025-03-14T06:29:19.1282063Z  2025-03-14T06:29:19.1282633Z  2025-03-14T06:29:19.1283044Z  2025-03-14T06:29:19.1283575Z  2025-03-14T06:29:19.1284116Z  2025-03-14T06:29:19.1285307Z [14,926 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:19.1286721Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T06:29:19.1288020Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 69s local 2025-03-14T06:29:19.1289075Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T06:29:19.1290126Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T06:29:19.1290906Z Compiling external/xla/xla/xla.pb.cc; 11s local 2025-03-14T06:29:19.1291483Z Compiling xla/ffi/call_frame.cc; 7s local 2025-03-14T06:29:19.1292176Z Compiling xla/pjrt/transpose.cc; 7s local 2025-03-14T06:29:19.1293008Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 7s local ... 2025-03-14T06:29:19.3316866Z 2025-03-14T06:29:19.3317706Z  2025-03-14T06:29:19.3318193Z  2025-03-14T06:29:19.3318611Z  2025-03-14T06:29:19.3319000Z  2025-03-14T06:29:19.3319410Z  2025-03-14T06:29:19.3319820Z  2025-03-14T06:29:19.3320305Z  2025-03-14T06:29:19.3320803Z  2025-03-14T06:29:19.3321850Z [14,928 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:19.3323185Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T06:29:19.3324454Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T06:29:19.3325877Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 69s local 2025-03-14T06:29:19.3327020Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T06:29:19.3327953Z Compiling external/xla/xla/xla.pb.cc; 11s local 2025-03-14T06:29:19.3328707Z Compiling xla/ffi/call_frame.cc; 8s local 2025-03-14T06:29:19.3329315Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:19.3330104Z Compiling mlir/lib/Bytecode/Writer/IRNumbering.cpp; 7s local ... 2025-03-14T06:29:19.5325346Z 2025-03-14T06:29:19.5326215Z  2025-03-14T06:29:19.5327041Z  2025-03-14T06:29:19.5327471Z  2025-03-14T06:29:19.5327870Z  2025-03-14T06:29:19.5328243Z  2025-03-14T06:29:19.5328658Z  2025-03-14T06:29:19.5329038Z  2025-03-14T06:29:19.5329409Z  2025-03-14T06:29:19.5330470Z [14,930 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:19.5331661Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T06:29:19.5332812Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T06:29:19.5333954Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:29:19.5335033Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T06:29:19.5336070Z Compiling external/xla/xla/xla.pb.cc; 11s local 2025-03-14T06:29:19.5336828Z Compiling xla/ffi/call_frame.cc; 8s local 2025-03-14T06:29:19.5337522Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:19.5338313Z Compiling llvm/lib/IR/Dominators.cpp; 7s local ... 2025-03-14T06:29:19.8145409Z 2025-03-14T06:29:19.8146242Z  2025-03-14T06:29:19.8146761Z  2025-03-14T06:29:19.8147188Z  2025-03-14T06:29:19.8147601Z  2025-03-14T06:29:19.8148040Z  2025-03-14T06:29:19.8148452Z  2025-03-14T06:29:19.8148858Z  2025-03-14T06:29:19.8149262Z  2025-03-14T06:29:19.8150479Z [14,931 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:19.8151737Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T06:29:19.8152953Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T06:29:19.8154100Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:29:19.8155193Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 57s local 2025-03-14T06:29:19.8156035Z Compiling external/xla/xla/xla.pb.cc; 11s local 2025-03-14T06:29:19.8156756Z Compiling xla/ffi/call_frame.cc; 8s local 2025-03-14T06:29:19.8157431Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:19.8158194Z Compiling llvm/lib/IR/Dominators.cpp; 7s local ... 2025-03-14T06:29:20.0912743Z 2025-03-14T06:29:20.0913638Z  2025-03-14T06:29:20.0914114Z  2025-03-14T06:29:20.0914539Z  2025-03-14T06:29:20.0914965Z  2025-03-14T06:29:20.0915409Z  2025-03-14T06:29:20.0915819Z  2025-03-14T06:29:20.0916240Z  2025-03-14T06:29:20.0916612Z  2025-03-14T06:29:20.0917568Z [14,932 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:20.0918790Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T06:29:20.0920104Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T06:29:20.0921213Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:29:20.0922275Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T06:29:20.0923099Z Compiling external/xla/xla/xla.pb.cc; 12s local 2025-03-14T06:29:20.0923817Z Compiling xla/ffi/call_frame.cc; 8s local 2025-03-14T06:29:20.0924526Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:20.0925388Z Compiling llvm/lib/IR/Dominators.cpp; 7s local ... 2025-03-14T06:29:20.3061679Z 2025-03-14T06:29:20.3062531Z  2025-03-14T06:29:20.3063016Z  2025-03-14T06:29:20.3063417Z  2025-03-14T06:29:20.3063817Z  2025-03-14T06:29:20.3064214Z  2025-03-14T06:29:20.3064619Z  2025-03-14T06:29:20.3065034Z  2025-03-14T06:29:20.3065748Z  2025-03-14T06:29:20.3066727Z [14,933 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:20.3067935Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T06:29:20.3069124Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 70s local 2025-03-14T06:29:20.3070555Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 70s local 2025-03-14T06:29:20.3071716Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T06:29:20.3072719Z Compiling external/xla/xla/xla.pb.cc; 12s local 2025-03-14T06:29:20.3073447Z Compiling xla/ffi/call_frame.cc; 9s local 2025-03-14T06:29:20.3074089Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T06:29:20.3074809Z Compiling llvm/lib/IR/Dominators.cpp; 8s local ... 2025-03-14T06:29:20.5497137Z 2025-03-14T06:29:20.5497982Z  2025-03-14T06:29:20.5498511Z  2025-03-14T06:29:20.5498943Z  2025-03-14T06:29:20.5499369Z  2025-03-14T06:29:20.5499792Z  2025-03-14T06:29:20.5500490Z  2025-03-14T06:29:20.5500931Z  2025-03-14T06:29:20.5501331Z  2025-03-14T06:29:20.5502335Z [14,936 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:20.5503606Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T06:29:20.5504718Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:29:20.5505825Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T06:29:20.5506782Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T06:29:20.5507713Z Compiling external/xla/xla/xla.pb.cc; 12s local 2025-03-14T06:29:20.5508450Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T06:29:20.5509147Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2025-03-14T06:29:20.5510052Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local ... 2025-03-14T06:29:20.8154838Z 2025-03-14T06:29:20.8155752Z  2025-03-14T06:29:20.8156257Z  2025-03-14T06:29:20.8156659Z  2025-03-14T06:29:20.8157063Z  2025-03-14T06:29:20.8157473Z  2025-03-14T06:29:20.8157904Z  2025-03-14T06:29:20.8158336Z  2025-03-14T06:29:20.8158747Z  2025-03-14T06:29:20.8159743Z [14,938 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:20.8160962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T06:29:20.8162117Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:29:20.8163225Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T06:29:20.8164206Z Compiling xla/service/cpu/runtime_matmul_f32.cc; 58s local 2025-03-14T06:29:20.8165166Z Compiling external/xla/xla/xla.pb.cc; 12s local 2025-03-14T06:29:20.8166091Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T06:29:20.8166768Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2025-03-14T06:29:20.8167748Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local ... 2025-03-14T06:29:21.0465993Z 2025-03-14T06:29:21.0466904Z  2025-03-14T06:29:21.0467471Z  2025-03-14T06:29:21.0467899Z  2025-03-14T06:29:21.0468337Z  2025-03-14T06:29:21.0468777Z  2025-03-14T06:29:21.0469198Z  2025-03-14T06:29:21.0469576Z  2025-03-14T06:29:21.0469970Z  2025-03-14T06:29:21.0470947Z [14,942 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:21.0472173Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T06:29:21.0473341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:29:21.0474347Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T06:29:21.0475260Z Compiling external/xla/xla/xla.pb.cc; 13s local 2025-03-14T06:29:21.0476014Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T06:29:21.0476713Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2025-03-14T06:29:21.0477560Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:21.0478833Z Compiling xla/python/ifrt/ir/sharding_param.cc; 7s local ... 2025-03-14T06:29:21.3208616Z 2025-03-14T06:29:21.3209827Z  2025-03-14T06:29:21.3210676Z  2025-03-14T06:29:21.3211454Z  2025-03-14T06:29:21.3212470Z  2025-03-14T06:29:21.3212955Z  2025-03-14T06:29:21.3213400Z  2025-03-14T06:29:21.3213841Z  2025-03-14T06:29:21.3214285Z  2025-03-14T06:29:21.3215239Z [14,945 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:21.3216408Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T06:29:21.3217503Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 71s local 2025-03-14T06:29:21.3218789Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 71s local 2025-03-14T06:29:21.3219689Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T06:29:21.3220407Z Compiling llvm/lib/IR/Dominators.cpp; 9s local 2025-03-14T06:29:21.3221340Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:21.3222336Z Compiling xla/python/ifrt/ir/sharding_param.cc; 7s local 2025-03-14T06:29:21.3223260Z Compiling xla/python/ifrt/ir/sharding_param.cc; 7s local ... 2025-03-14T06:29:21.6156916Z 2025-03-14T06:29:21.6158148Z  2025-03-14T06:29:21.6158679Z  2025-03-14T06:29:21.6159129Z  2025-03-14T06:29:21.6159897Z  2025-03-14T06:29:21.6160286Z  2025-03-14T06:29:21.6160682Z  2025-03-14T06:29:21.6161086Z  2025-03-14T06:29:21.6161469Z  2025-03-14T06:29:21.6162434Z [14,946 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:21.6163629Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T06:29:21.6164929Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T06:29:21.6166326Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T06:29:21.6167184Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T06:29:21.6178114Z Compiling llvm/lib/IR/Dominators.cpp; 9s local 2025-03-14T06:29:21.6179176Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:21.6180153Z Compiling xla/python/ifrt/ir/sharding_param.cc; 7s local 2025-03-14T06:29:21.6181082Z Compiling xla/python/ifrt/ir/sharding_param.cc; 7s local ... 2025-03-14T06:29:21.8162073Z 2025-03-14T06:29:21.8162976Z  2025-03-14T06:29:21.8163540Z  2025-03-14T06:29:21.8163996Z  2025-03-14T06:29:21.8164447Z  2025-03-14T06:29:21.8164997Z  2025-03-14T06:29:21.8165537Z  2025-03-14T06:29:21.8165933Z  2025-03-14T06:29:21.8166343Z  2025-03-14T06:29:21.8167239Z [14,951 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:21.8168439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T06:29:21.8169545Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T06:29:21.8170663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T06:29:21.8171552Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T06:29:21.8172377Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:21.8173351Z Compiling xla/python/ifrt/ir/sharding_param.cc; 7s local 2025-03-14T06:29:21.8174108Z Compiling xla/pjrt/transpose.cc; 6s local 2025-03-14T06:29:21.8174817Z Compiling xla/stream_executor/dnn.cc; 6s local ... 2025-03-14T06:29:22.0249652Z 2025-03-14T06:29:22.0250750Z  2025-03-14T06:29:22.0251333Z  2025-03-14T06:29:22.0251794Z  2025-03-14T06:29:22.0252397Z  2025-03-14T06:29:22.0252829Z  2025-03-14T06:29:22.0253243Z  2025-03-14T06:29:22.0253673Z  2025-03-14T06:29:22.0254099Z  2025-03-14T06:29:22.0255045Z [14,954 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:22.0256454Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T06:29:22.0257710Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 72s local 2025-03-14T06:29:22.0258936Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T06:29:22.0259883Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T06:29:22.0260702Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:22.0261479Z Compiling xla/pjrt/transpose.cc; 6s local 2025-03-14T06:29:22.0262188Z Compiling xla/stream_executor/dnn.cc; 6s local 2025-03-14T06:29:22.0262948Z Compiling llvm/lib/MC/MCContext.cpp; 5s local ... 2025-03-14T06:29:22.3350068Z 2025-03-14T06:29:22.3351245Z  2025-03-14T06:29:22.3352016Z  2025-03-14T06:29:22.3352825Z  2025-03-14T06:29:22.3353461Z  2025-03-14T06:29:22.3353949Z  2025-03-14T06:29:22.3354382Z  2025-03-14T06:29:22.3354829Z  2025-03-14T06:29:22.3355283Z  2025-03-14T06:29:22.3356256Z [14,959 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:22.3357313Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T06:29:22.3358720Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T06:29:22.3359868Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 72s local 2025-03-14T06:29:22.3360764Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:22.3361412Z Compiling xla/pjrt/transpose.cc; 6s local 2025-03-14T06:29:22.3362096Z Compiling xla/stream_executor/dnn.cc; 6s local 2025-03-14T06:29:22.3362850Z Compiling llvm/lib/MC/MCContext.cpp; 6s local 2025-03-14T06:29:22.3363742Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 5s local ... 2025-03-14T06:29:22.6169379Z 2025-03-14T06:29:22.6170290Z  2025-03-14T06:29:22.6170820Z  2025-03-14T06:29:22.6171260Z  2025-03-14T06:29:22.6171691Z  2025-03-14T06:29:22.6172114Z  2025-03-14T06:29:22.6172482Z  2025-03-14T06:29:22.6172850Z  2025-03-14T06:29:22.6173254Z  2025-03-14T06:29:22.6174123Z [14,959 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:22.6175258Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T06:29:22.6176315Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T06:29:22.6177355Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:22.6178266Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:22.6179048Z Compiling xla/pjrt/transpose.cc; 7s local 2025-03-14T06:29:22.6179760Z Compiling xla/stream_executor/dnn.cc; 6s local 2025-03-14T06:29:22.6180504Z Compiling llvm/lib/MC/MCContext.cpp; 6s local 2025-03-14T06:29:22.6181424Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 5s local ... 2025-03-14T06:29:22.8173785Z 2025-03-14T06:29:22.8174781Z  2025-03-14T06:29:22.8175342Z  2025-03-14T06:29:22.8175817Z  2025-03-14T06:29:22.8176268Z  2025-03-14T06:29:22.8176700Z  2025-03-14T06:29:22.8177063Z  2025-03-14T06:29:22.8177455Z  2025-03-14T06:29:22.8177847Z  2025-03-14T06:29:22.8178796Z [14,961 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:22.8179956Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T06:29:22.8180961Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T06:29:22.8182050Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:22.8182958Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:22.8183626Z Compiling xla/pjrt/transpose.cc; 7s local 2025-03-14T06:29:22.8184566Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:22.8185279Z Compiling llvm/lib/MC/MCContext.cpp; 6s local 2025-03-14T06:29:22.8186367Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 6s local ... 2025-03-14T06:29:23.1320825Z 2025-03-14T06:29:23.1321726Z  2025-03-14T06:29:23.1322266Z  2025-03-14T06:29:23.1322755Z  2025-03-14T06:29:23.1323203Z  2025-03-14T06:29:23.1323654Z  2025-03-14T06:29:23.1324035Z  2025-03-14T06:29:23.1324410Z  2025-03-14T06:29:23.1324785Z  2025-03-14T06:29:23.1325809Z [14,964 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:23.1326945Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T06:29:23.1328265Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 73s local 2025-03-14T06:29:23.1329378Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:23.1330293Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:23.1330950Z Compiling xla/pjrt/transpose.cc; 7s local 2025-03-14T06:29:23.1331653Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:23.1332371Z Compiling llvm/lib/MC/MCContext.cpp; 6s local 2025-03-14T06:29:23.1333453Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 6s local ... 2025-03-14T06:29:23.3824848Z 2025-03-14T06:29:23.3825964Z  2025-03-14T06:29:23.3826506Z  2025-03-14T06:29:23.3826957Z  2025-03-14T06:29:23.3827397Z  2025-03-14T06:29:23.3827839Z  2025-03-14T06:29:23.3828193Z  2025-03-14T06:29:23.3828583Z  2025-03-14T06:29:23.3828990Z  2025-03-14T06:29:23.3829932Z [14,967 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:23.3831104Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T06:29:23.3832218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:29:23.3833322Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 73s local 2025-03-14T06:29:23.3834228Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T06:29:23.3834874Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:23.3835565Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:23.3836300Z Compiling llvm/lib/MC/MCContext.cpp; 7s local 2025-03-14T06:29:23.3837146Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 6s local ... 2025-03-14T06:29:23.5999755Z 2025-03-14T06:29:23.6000527Z  2025-03-14T06:29:23.6001003Z  2025-03-14T06:29:23.6001373Z  2025-03-14T06:29:23.6001789Z  2025-03-14T06:29:23.6002149Z  2025-03-14T06:29:23.6002517Z  2025-03-14T06:29:23.6002885Z  2025-03-14T06:29:23.6003252Z  2025-03-14T06:29:23.6004140Z [14,970 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:23.6005354Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T06:29:23.6006337Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:29:23.6007305Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T06:29:23.6008177Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T06:29:23.6008826Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:23.6009464Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:23.6010078Z Compiling llvm/lib/MC/MCContext.cpp; 7s local 2025-03-14T06:29:23.6010877Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 6s local ... 2025-03-14T06:29:23.8180450Z 2025-03-14T06:29:23.8181564Z  2025-03-14T06:29:23.8182252Z  2025-03-14T06:29:23.8182838Z  2025-03-14T06:29:23.8183460Z  2025-03-14T06:29:23.8183934Z  2025-03-14T06:29:23.8184660Z  2025-03-14T06:29:23.8185115Z  2025-03-14T06:29:23.8185555Z  2025-03-14T06:29:23.8186493Z [14,975 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:23.8187754Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T06:29:23.8188860Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:29:23.8189955Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T06:29:23.8190897Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T06:29:23.8191531Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:23.8192164Z Compiling xla/stream_executor/dnn.cc; 8s local 2025-03-14T06:29:23.8193198Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local 2025-03-14T06:29:23.8194082Z Compiling mlir/lib/IR/Operation.cpp; 4s local ... 2025-03-14T06:29:24.0836121Z 2025-03-14T06:29:24.0837196Z  2025-03-14T06:29:24.0837727Z  2025-03-14T06:29:24.0838170Z  2025-03-14T06:29:24.0838600Z  2025-03-14T06:29:24.0838995Z  2025-03-14T06:29:24.0839341Z  2025-03-14T06:29:24.0839756Z  2025-03-14T06:29:24.0840130Z  2025-03-14T06:29:24.0841076Z [14,977 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:24.0842459Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T06:29:24.0843517Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:29:24.0844596Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T06:29:24.0845634Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T06:29:24.0846320Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:24.0847016Z Compiling xla/stream_executor/dnn.cc; 8s local 2025-03-14T06:29:24.0847876Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local 2025-03-14T06:29:24.0848804Z Compiling mlir/lib/IR/Operation.cpp; 5s local ... 2025-03-14T06:29:24.2964150Z 2025-03-14T06:29:24.2965148Z  2025-03-14T06:29:24.2965827Z  2025-03-14T06:29:24.2966216Z  2025-03-14T06:29:24.2966634Z  2025-03-14T06:29:24.2967055Z  2025-03-14T06:29:24.2967433Z  2025-03-14T06:29:24.2967824Z  2025-03-14T06:29:24.2968216Z  2025-03-14T06:29:24.2969199Z [14,980 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:24.2970330Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T06:29:24.2971445Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 74s local 2025-03-14T06:29:24.2972708Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 74s local 2025-03-14T06:29:24.2973563Z Compiling xla/pjrt/transpose.cc; 8s local 2025-03-14T06:29:24.2974389Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local 2025-03-14T06:29:24.2975290Z Compiling mlir/lib/IR/Operation.cpp; 5s local 2025-03-14T06:29:24.2976047Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2025-03-14T06:29:24.2976967Z @xla//xla/stream_executor:stream_executor_memory_allocator; 5s local ... 2025-03-14T06:29:24.6187928Z 2025-03-14T06:29:24.6188991Z  2025-03-14T06:29:24.6189526Z  2025-03-14T06:29:24.6190005Z  2025-03-14T06:29:24.6190389Z  2025-03-14T06:29:24.6190783Z  2025-03-14T06:29:24.6191179Z  2025-03-14T06:29:24.6191557Z  2025-03-14T06:29:24.6191933Z  2025-03-14T06:29:24.6192852Z [14,983 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:24.6194039Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T06:29:24.6195100Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T06:29:24.6196232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T06:29:24.6197416Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T06:29:24.6198203Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 7s local 2025-03-14T06:29:24.6199234Z Compiling mlir/lib/IR/Operation.cpp; 5s local 2025-03-14T06:29:24.6200013Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2025-03-14T06:29:24.6200994Z @tsl//tsl/profiler/protobuf:profiler_analysis_cc_grpc_proto; 5s local ... 2025-03-14T06:29:24.8194933Z 2025-03-14T06:29:24.8195770Z  2025-03-14T06:29:24.8196244Z  2025-03-14T06:29:24.8196662Z  2025-03-14T06:29:24.8197068Z  2025-03-14T06:29:24.8197465Z  2025-03-14T06:29:24.8197853Z  2025-03-14T06:29:24.8198264Z  2025-03-14T06:29:24.8199059Z  2025-03-14T06:29:24.8200036Z [14,986 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:24.8201305Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T06:29:24.8202526Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T06:29:24.8203709Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T06:29:24.8204658Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T06:29:24.8205664Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:24.8206781Z Compiling mlir/lib/IR/Operation.cpp; 5s local 2025-03-14T06:29:24.8207566Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2025-03-14T06:29:24.8208573Z @tsl//tsl/profiler/protobuf:profiler_analysis_cc_grpc_proto; 5s local ... 2025-03-14T06:29:25.0646346Z 2025-03-14T06:29:25.0647180Z  2025-03-14T06:29:25.0647683Z  2025-03-14T06:29:25.0648153Z  2025-03-14T06:29:25.0648580Z  2025-03-14T06:29:25.0648983Z  2025-03-14T06:29:25.0649405Z  2025-03-14T06:29:25.0649820Z  2025-03-14T06:29:25.0650249Z  2025-03-14T06:29:25.0651226Z [14,987 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:25.0652325Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T06:29:25.0653438Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 75s local 2025-03-14T06:29:25.0654554Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T06:29:25.0655481Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T06:29:25.0656331Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:25.0657220Z Compiling mlir/lib/IR/Operation.cpp; 6s local 2025-03-14T06:29:25.0658008Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2025-03-14T06:29:25.0658994Z @tsl//tsl/profiler/protobuf:profiler_analysis_cc_grpc_proto; 5s local ... 2025-03-14T06:29:25.3656402Z 2025-03-14T06:29:25.3657286Z  2025-03-14T06:29:25.3657799Z  2025-03-14T06:29:25.3658257Z  2025-03-14T06:29:25.3658686Z  2025-03-14T06:29:25.3659105Z  2025-03-14T06:29:25.3659507Z  2025-03-14T06:29:25.3659921Z  2025-03-14T06:29:25.3660335Z  2025-03-14T06:29:25.3661323Z [14,990 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:25.3662565Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T06:29:25.3663692Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T06:29:25.3664843Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 75s local 2025-03-14T06:29:25.3665971Z Compiling xla/pjrt/transpose.cc; 9s local 2025-03-14T06:29:25.3666801Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:25.3667682Z Compiling mlir/lib/IR/Operation.cpp; 6s local 2025-03-14T06:29:25.3668435Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2025-03-14T06:29:25.3669396Z @tsl//tsl/profiler/protobuf:profiler_analysis_cc_grpc_proto; 6s local ... 2025-03-14T06:29:25.6202561Z 2025-03-14T06:29:25.6203379Z  2025-03-14T06:29:25.6203882Z  2025-03-14T06:29:25.6204309Z  2025-03-14T06:29:25.6204726Z  2025-03-14T06:29:25.6205601Z  2025-03-14T06:29:25.6206029Z  2025-03-14T06:29:25.6206427Z  2025-03-14T06:29:25.6206807Z  2025-03-14T06:29:25.6207769Z [14,994 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:25.6208948Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T06:29:25.6210071Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T06:29:25.6211146Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T06:29:25.6212380Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T06:29:25.6213173Z Compiling mlir/lib/Bytecode/Writer/BytecodeWriter.cpp; 8s local 2025-03-14T06:29:25.6214021Z Compiling mlir/lib/IR/Operation.cpp; 6s local 2025-03-14T06:29:25.6214760Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2025-03-14T06:29:25.6215724Z @tsl//tsl/profiler/protobuf:profiler_analysis_cc_grpc_proto; 6s local ... 2025-03-14T06:29:25.8206804Z 2025-03-14T06:29:25.8207647Z  2025-03-14T06:29:25.8208161Z  2025-03-14T06:29:25.8208561Z  2025-03-14T06:29:25.8209280Z  2025-03-14T06:29:25.8209710Z  2025-03-14T06:29:25.8210095Z  2025-03-14T06:29:25.8210478Z  2025-03-14T06:29:25.8210879Z  2025-03-14T06:29:25.8211814Z [14,995 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:25.8212929Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T06:29:25.8214063Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T06:29:25.8215204Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T06:29:25.8216122Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T06:29:25.8216831Z Compiling mlir/lib/IR/Operation.cpp; 6s local 2025-03-14T06:29:25.8217582Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2025-03-14T06:29:25.8218556Z Compiling external/tsl/.../protobuf/profiler_analysis.grpc.pb.cc; 6s local 2025-03-14T06:29:25.8219541Z Compiling xla/stream_executor/dnn.cc; 6s local ... 2025-03-14T06:29:26.1200004Z 2025-03-14T06:29:26.1200782Z  2025-03-14T06:29:26.1201190Z  2025-03-14T06:29:26.1201533Z  2025-03-14T06:29:26.1201870Z  2025-03-14T06:29:26.1202213Z  2025-03-14T06:29:26.1202556Z  2025-03-14T06:29:26.1202888Z  2025-03-14T06:29:26.1203225Z  2025-03-14T06:29:26.1204124Z [14,998 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:26.1205375Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T06:29:26.1206426Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 76s local 2025-03-14T06:29:26.1207443Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 76s local 2025-03-14T06:29:26.1208269Z Compiling xla/pjrt/transpose.cc; 10s local 2025-03-14T06:29:26.1208879Z Compiling mlir/lib/IR/Operation.cpp; 7s local 2025-03-14T06:29:26.1209545Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2025-03-14T06:29:26.1210243Z Compiling xla/stream_executor/dnn.cc; 6s local 2025-03-14T06:29:26.1210925Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 5s local ... 2025-03-14T06:29:26.4213342Z 2025-03-14T06:29:26.4214223Z  2025-03-14T06:29:26.4214747Z  2025-03-14T06:29:26.4215171Z  2025-03-14T06:29:26.4215591Z  2025-03-14T06:29:26.4216046Z  2025-03-14T06:29:26.4216466Z  2025-03-14T06:29:26.4216882Z  2025-03-14T06:29:26.4217303Z  2025-03-14T06:29:26.4218259Z [14,999 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:26.4219731Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T06:29:26.4221088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:29:26.4222259Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:26.4223193Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:26.4223901Z Compiling mlir/lib/IR/Operation.cpp; 7s local 2025-03-14T06:29:26.4224676Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2025-03-14T06:29:26.4225473Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:26.4226301Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2025-03-14T06:29:26.6217775Z 2025-03-14T06:29:26.6218643Z  2025-03-14T06:29:26.6219143Z  2025-03-14T06:29:26.6219580Z  2025-03-14T06:29:26.6220007Z  2025-03-14T06:29:26.6220432Z  2025-03-14T06:29:26.6220881Z  2025-03-14T06:29:26.6221276Z  2025-03-14T06:29:26.6221684Z  2025-03-14T06:29:26.6222635Z [15,001 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:26.6223859Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T06:29:26.6225259Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:29:26.6226460Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:26.6227417Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:26.6228152Z Compiling mlir/lib/IR/Operation.cpp; 7s local 2025-03-14T06:29:26.6228961Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2025-03-14T06:29:26.6229747Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:26.6230639Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2025-03-14T06:29:26.8236569Z 2025-03-14T06:29:26.8237393Z  2025-03-14T06:29:26.8237890Z  2025-03-14T06:29:26.8238378Z  2025-03-14T06:29:26.8238726Z  2025-03-14T06:29:26.8239107Z  2025-03-14T06:29:26.8239456Z  2025-03-14T06:29:26.8239789Z  2025-03-14T06:29:26.8240160Z  2025-03-14T06:29:26.8241087Z [15,003 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:26.8242239Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T06:29:26.8243334Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:29:26.8244448Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:26.8245453Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:26.8246172Z Compiling mlir/lib/IR/Operation.cpp; 8s local 2025-03-14T06:29:26.8246908Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2025-03-14T06:29:26.8247629Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:26.8248451Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2025-03-14T06:29:27.0613267Z 2025-03-14T06:29:27.0614120Z  2025-03-14T06:29:27.0614614Z  2025-03-14T06:29:27.0615035Z  2025-03-14T06:29:27.0615480Z  2025-03-14T06:29:27.0615876Z  2025-03-14T06:29:27.0616279Z  2025-03-14T06:29:27.0616673Z  2025-03-14T06:29:27.0617093Z  2025-03-14T06:29:27.0618010Z [15,006 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:27.0619228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T06:29:27.0620397Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:29:27.0621546Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:27.0622427Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:27.0623161Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2025-03-14T06:29:27.0624199Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:27.0624910Z Compiling xla/ffi/call_frame.cc; 6s local 2025-03-14T06:29:27.0625963Z Compiling mlir/lib/Interfaces/DataLayoutInterfaces.cpp; 6s local ... 2025-03-14T06:29:27.2895631Z 2025-03-14T06:29:27.2896493Z  2025-03-14T06:29:27.2897016Z  2025-03-14T06:29:27.2897462Z  2025-03-14T06:29:27.2897908Z  2025-03-14T06:29:27.2898350Z  2025-03-14T06:29:27.2898792Z  2025-03-14T06:29:27.2899247Z  2025-03-14T06:29:27.2899681Z  2025-03-14T06:29:27.2900693Z [15,012 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:29:27.2901962Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T06:29:27.2903425Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 77s local 2025-03-14T06:29:27.2904650Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 77s local 2025-03-14T06:29:27.2905654Z Compiling xla/pjrt/transpose.cc; 11s local 2025-03-14T06:29:27.2906450Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2025-03-14T06:29:27.2907319Z Compiling xla/stream_executor/dnn.cc; 7s local 2025-03-14T06:29:27.2908081Z Compiling xla/ffi/call_frame.cc; 6s local 2025-03-14T06:29:27.2908975Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 5s local ... 2025-03-14T06:29:27.5904622Z 2025-03-14T06:29:27.5905514Z  2025-03-14T06:29:27.5906002Z  2025-03-14T06:29:27.5906403Z  2025-03-14T06:29:27.5906783Z  2025-03-14T06:29:27.5907191Z  2025-03-14T06:29:27.5907582Z  2025-03-14T06:29:27.5907965Z  2025-03-14T06:29:27.5908350Z  2025-03-14T06:29:27.5909279Z [15,017 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:27.5910428Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T06:29:27.5911484Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T06:29:27.5912556Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T06:29:27.5913439Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T06:29:27.5914150Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2025-03-14T06:29:27.5914892Z Compiling xla/stream_executor/dnn.cc; 8s local 2025-03-14T06:29:27.5915543Z Compiling xla/ffi/call_frame.cc; 7s local 2025-03-14T06:29:27.5916271Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 5s local ... 2025-03-14T06:29:27.8228044Z 2025-03-14T06:29:27.8228928Z  2025-03-14T06:29:27.8229394Z  2025-03-14T06:29:27.8229803Z  2025-03-14T06:29:27.8230234Z  2025-03-14T06:29:27.8230655Z  2025-03-14T06:29:27.8231067Z  2025-03-14T06:29:27.8231451Z  2025-03-14T06:29:27.8231810Z  2025-03-14T06:29:27.8232684Z [15,019 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:27.8233761Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T06:29:27.8234937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T06:29:27.8236070Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T06:29:27.8237006Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T06:29:27.8237774Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2025-03-14T06:29:27.8238575Z Compiling xla/stream_executor/dnn.cc; 8s local 2025-03-14T06:29:27.8239309Z Compiling xla/ffi/call_frame.cc; 7s local 2025-03-14T06:29:27.8240085Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 5s local ... 2025-03-14T06:29:28.2491465Z 2025-03-14T06:29:28.2492353Z  2025-03-14T06:29:28.2492846Z  2025-03-14T06:29:28.2493242Z  2025-03-14T06:29:28.2493633Z  2025-03-14T06:29:28.2494020Z  2025-03-14T06:29:28.2494412Z  2025-03-14T06:29:28.2495146Z  2025-03-14T06:29:28.2495533Z  2025-03-14T06:29:28.2496439Z [15,021 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:28.2497803Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T06:29:28.2498931Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 78s local 2025-03-14T06:29:28.2500059Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 78s local 2025-03-14T06:29:28.2500943Z Compiling xla/pjrt/transpose.cc; 12s local 2025-03-14T06:29:28.2501633Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2025-03-14T06:29:28.2502384Z Compiling xla/stream_executor/dnn.cc; 8s local 2025-03-14T06:29:28.2503089Z Compiling xla/ffi/call_frame.cc; 7s local 2025-03-14T06:29:28.2504022Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local ... 2025-03-14T06:29:28.4495321Z 2025-03-14T06:29:28.4496209Z  2025-03-14T06:29:28.4496711Z  2025-03-14T06:29:28.4497159Z  2025-03-14T06:29:28.4497564Z  2025-03-14T06:29:28.4497943Z  2025-03-14T06:29:28.4498342Z  2025-03-14T06:29:28.4498741Z  2025-03-14T06:29:28.4499148Z  2025-03-14T06:29:28.4500112Z [15,023 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:28.4501609Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T06:29:28.4502759Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T06:29:28.4503863Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T06:29:28.4504760Z Compiling xla/pjrt/transpose.cc; 13s local 2025-03-14T06:29:28.4505487Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2025-03-14T06:29:28.4506241Z Compiling xla/ffi/call_frame.cc; 8s local 2025-03-14T06:29:28.4506932Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local 2025-03-14T06:29:28.4508014Z Compiling mlir/lib/Interfaces/SideEffectInterfaces.cpp; 5s local ... 2025-03-14T06:29:28.7208001Z 2025-03-14T06:29:28.7208839Z  2025-03-14T06:29:28.7209315Z  2025-03-14T06:29:28.7209747Z  2025-03-14T06:29:28.7210149Z  2025-03-14T06:29:28.7210584Z  2025-03-14T06:29:28.7210981Z  2025-03-14T06:29:28.7211395Z  2025-03-14T06:29:28.7211800Z  2025-03-14T06:29:28.7212756Z [15,027 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:28.7213886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:28.7215001Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T06:29:28.7216014Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T06:29:28.7216936Z Compiling xla/pjrt/transpose.cc; 13s local 2025-03-14T06:29:28.7217582Z Compiling xla/ffi/call_frame.cc; 8s local 2025-03-14T06:29:28.7218293Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local 2025-03-14T06:29:28.7219020Z Compiling llvm/lib/IR/Metadata.cpp; 5s local 2025-03-14T06:29:28.7219760Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 5s local ... 2025-03-14T06:29:28.9225124Z 2025-03-14T06:29:28.9226045Z  2025-03-14T06:29:28.9226536Z  2025-03-14T06:29:28.9226944Z  2025-03-14T06:29:28.9227336Z  2025-03-14T06:29:28.9227752Z  2025-03-14T06:29:28.9228166Z  2025-03-14T06:29:28.9228561Z  2025-03-14T06:29:28.9228945Z  2025-03-14T06:29:28.9229976Z [15,029 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:28.9231044Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:28.9232338Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T06:29:28.9233464Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T06:29:28.9234663Z Compiling xla/ffi/call_frame.cc; 8s local 2025-03-14T06:29:28.9235356Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2025-03-14T06:29:28.9236079Z Compiling llvm/lib/IR/Metadata.cpp; 5s local 2025-03-14T06:29:28.9236974Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 5s local 2025-03-14T06:29:28.9237822Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 5s local ... 2025-03-14T06:29:29.2121493Z 2025-03-14T06:29:29.2122463Z  2025-03-14T06:29:29.2122952Z  2025-03-14T06:29:29.2123369Z  2025-03-14T06:29:29.2123779Z  2025-03-14T06:29:29.2124187Z  2025-03-14T06:29:29.2124572Z  2025-03-14T06:29:29.2125111Z  2025-03-14T06:29:29.2125516Z  2025-03-14T06:29:29.2126451Z [15,030 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:29.2127885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:29.2128976Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 79s local 2025-03-14T06:29:29.2130096Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 79s local 2025-03-14T06:29:29.2130983Z Compiling xla/ffi/call_frame.cc; 8s local 2025-03-14T06:29:29.2131730Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2025-03-14T06:29:29.2132490Z Compiling llvm/lib/IR/Metadata.cpp; 5s local 2025-03-14T06:29:29.2133402Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 5s local 2025-03-14T06:29:29.2134296Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 5s local ... 2025-03-14T06:29:29.4502869Z 2025-03-14T06:29:29.4503746Z  2025-03-14T06:29:29.4504242Z  2025-03-14T06:29:29.4504671Z  2025-03-14T06:29:29.4505080Z  2025-03-14T06:29:29.4505476Z  2025-03-14T06:29:29.4505920Z  2025-03-14T06:29:29.4506321Z  2025-03-14T06:29:29.4506733Z  2025-03-14T06:29:29.4507728Z [15,033 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:29:29.4508951Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:29.4510069Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T06:29:29.4511138Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T06:29:29.4512019Z Compiling xla/ffi/call_frame.cc; 9s local 2025-03-14T06:29:29.4512775Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2025-03-14T06:29:29.4513506Z Compiling llvm/lib/IR/Metadata.cpp; 6s local 2025-03-14T06:29:29.4514193Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 5s local 2025-03-14T06:29:29.4515001Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 5s local ... 2025-03-14T06:29:29.6507078Z 2025-03-14T06:29:29.6508017Z  2025-03-14T06:29:29.6508507Z  2025-03-14T06:29:29.6508934Z  2025-03-14T06:29:29.6509334Z  2025-03-14T06:29:29.6509749Z  2025-03-14T06:29:29.6510151Z  2025-03-14T06:29:29.6510581Z  2025-03-14T06:29:29.6510985Z  2025-03-14T06:29:29.6511896Z [15,035 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:29:29.6513056Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:29.6514147Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T06:29:29.6515240Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T06:29:29.6516171Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2025-03-14T06:29:29.6516949Z Compiling llvm/lib/IR/Metadata.cpp; 6s local 2025-03-14T06:29:29.6517723Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local 2025-03-14T06:29:29.6518541Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local 2025-03-14T06:29:29.6519508Z @xla//xla/stream_executor:stream_executor_memory_allocator; 5s local ... 2025-03-14T06:29:29.8987584Z 2025-03-14T06:29:29.8988457Z  2025-03-14T06:29:29.8989430Z  2025-03-14T06:29:29.8989844Z  2025-03-14T06:29:29.8990260Z  2025-03-14T06:29:29.8990652Z  2025-03-14T06:29:29.8991044Z  2025-03-14T06:29:29.8991422Z  2025-03-14T06:29:29.8991796Z  2025-03-14T06:29:29.8992907Z [15,037 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:29.8994062Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T06:29:29.8995116Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T06:29:29.8996194Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T06:29:29.8997139Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2025-03-14T06:29:29.8998117Z Compiling llvm/lib/IR/Metadata.cpp; 6s local 2025-03-14T06:29:29.8998877Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local 2025-03-14T06:29:29.8999597Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local 2025-03-14T06:29:29.9000388Z Compiling llvm/lib/MC/MCPseudoProbe.cpp; 5s local ... 2025-03-14T06:29:30.2424355Z 2025-03-14T06:29:30.2425262Z  2025-03-14T06:29:30.2425747Z  2025-03-14T06:29:30.2426170Z  2025-03-14T06:29:30.2426613Z  2025-03-14T06:29:30.2426997Z  2025-03-14T06:29:30.2427382Z  2025-03-14T06:29:30.2427764Z  2025-03-14T06:29:30.2428146Z  2025-03-14T06:29:30.2429331Z [15,039 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:30.2430480Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T06:29:30.2431568Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 80s local 2025-03-14T06:29:30.2432644Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 80s local 2025-03-14T06:29:30.2433526Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2025-03-14T06:29:30.2434237Z Compiling llvm/lib/IR/Metadata.cpp; 6s local 2025-03-14T06:29:30.2434994Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 6s local 2025-03-14T06:29:30.2435764Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local 2025-03-14T06:29:30.2436559Z Compiling xla/service/cpu/metrics.cc; 5s local ... 2025-03-14T06:29:30.5637203Z 2025-03-14T06:29:30.5638066Z  2025-03-14T06:29:30.5638487Z  2025-03-14T06:29:30.5638837Z  2025-03-14T06:29:30.5639198Z  2025-03-14T06:29:30.5639538Z  2025-03-14T06:29:30.5639876Z  2025-03-14T06:29:30.5640219Z  2025-03-14T06:29:30.5640554Z  2025-03-14T06:29:30.5641335Z [15,043 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:30.5642288Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T06:29:30.5643205Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T06:29:30.5644079Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T06:29:30.5644843Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2025-03-14T06:29:30.5645599Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2025-03-14T06:29:30.5646202Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2025-03-14T06:29:30.5646802Z Compiling xla/service/cpu/metrics.cc; 5s local 2025-03-14T06:29:30.5647502Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 5s local ... 2025-03-14T06:29:30.8559188Z 2025-03-14T06:29:30.8560033Z  2025-03-14T06:29:30.8560516Z  2025-03-14T06:29:30.8560915Z  2025-03-14T06:29:30.8561307Z  2025-03-14T06:29:30.8561719Z  2025-03-14T06:29:30.8562123Z  2025-03-14T06:29:30.8562515Z  2025-03-14T06:29:30.8562898Z  2025-03-14T06:29:30.8563873Z [15,046 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:30.8565191Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T06:29:30.8566823Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T06:29:30.8567916Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T06:29:30.8569011Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2025-03-14T06:29:30.8569715Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2025-03-14T06:29:30.8570463Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2025-03-14T06:29:30.8571252Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 5s local 2025-03-14T06:29:30.8572091Z Compiling xla/hlo/ir/tile_assignment.cc; 5s local ... 2025-03-14T06:29:31.1644753Z 2025-03-14T06:29:31.1645833Z  2025-03-14T06:29:31.1646336Z  2025-03-14T06:29:31.1646751Z  2025-03-14T06:29:31.1647445Z  2025-03-14T06:29:31.1647841Z  2025-03-14T06:29:31.1648211Z  2025-03-14T06:29:31.1648599Z  2025-03-14T06:29:31.1649011Z  2025-03-14T06:29:31.1649950Z [15,048 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:31.1651200Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T06:29:31.1652332Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 81s local 2025-03-14T06:29:31.1653332Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T06:29:31.1654478Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2025-03-14T06:29:31.1655164Z Compiling llvm/lib/IR/Metadata.cpp; 7s local 2025-03-14T06:29:31.1655804Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2025-03-14T06:29:31.1656518Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 6s local 2025-03-14T06:29:31.1657281Z Compiling xla/hlo/ir/tile_assignment.cc; 5s local ... 2025-03-14T06:29:31.4167496Z 2025-03-14T06:29:31.4168418Z  2025-03-14T06:29:31.4168889Z  2025-03-14T06:29:31.4169314Z  2025-03-14T06:29:31.4169706Z  2025-03-14T06:29:31.4170136Z  2025-03-14T06:29:31.4170526Z  2025-03-14T06:29:31.4170909Z  2025-03-14T06:29:31.4171294Z  2025-03-14T06:29:31.4172204Z [15,050 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:31.4173347Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T06:29:31.4174424Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T06:29:31.4175473Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 81s local 2025-03-14T06:29:31.4176407Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2025-03-14T06:29:31.4177162Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T06:29:31.4177795Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 7s local 2025-03-14T06:29:31.4178570Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 6s local 2025-03-14T06:29:31.4179455Z Compiling xla/tsl/profiler/rpc/client/capture_profile.cc; 5s local ... 2025-03-14T06:29:31.6957105Z 2025-03-14T06:29:31.6957951Z  2025-03-14T06:29:31.6958414Z  2025-03-14T06:29:31.6958774Z  2025-03-14T06:29:31.6959142Z  2025-03-14T06:29:31.6959514Z  2025-03-14T06:29:31.6959889Z  2025-03-14T06:29:31.6960312Z  2025-03-14T06:29:31.6960689Z  2025-03-14T06:29:31.6961571Z [15,053 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:31.6962663Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T06:29:31.6963731Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T06:29:31.6965078Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T06:29:31.6966220Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2025-03-14T06:29:31.6966900Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T06:29:31.6967571Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2025-03-14T06:29:31.6968690Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 6s local 2025-03-14T06:29:31.6969688Z Compiling xla/tsl/profiler/rpc/client/capture_profile.cc; 5s local ... 2025-03-14T06:29:31.9653364Z 2025-03-14T06:29:31.9654242Z  2025-03-14T06:29:31.9655000Z  2025-03-14T06:29:31.9655434Z  2025-03-14T06:29:31.9655854Z  2025-03-14T06:29:31.9656276Z  2025-03-14T06:29:31.9656693Z  2025-03-14T06:29:31.9657094Z  2025-03-14T06:29:31.9657477Z  2025-03-14T06:29:31.9658408Z [15,055 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:31.9659565Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T06:29:31.9660856Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T06:29:31.9661927Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T06:29:31.9662881Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2025-03-14T06:29:31.9663624Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T06:29:31.9664358Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2025-03-14T06:29:31.9665190Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 6s local 2025-03-14T06:29:31.9666461Z Compiling xla/tsl/profiler/rpc/client/capture_profile.cc; 5s local ... 2025-03-14T06:29:32.1657653Z 2025-03-14T06:29:32.1658831Z  2025-03-14T06:29:32.1659397Z  2025-03-14T06:29:32.1659822Z  2025-03-14T06:29:32.1660261Z  2025-03-14T06:29:32.1660706Z  2025-03-14T06:29:32.1661139Z  2025-03-14T06:29:32.1661536Z  2025-03-14T06:29:32.1661939Z  2025-03-14T06:29:32.1662861Z [15,056 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:32.1664265Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T06:29:32.1665756Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 82s local 2025-03-14T06:29:32.1666871Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 82s local 2025-03-14T06:29:32.1667865Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2025-03-14T06:29:32.1668673Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T06:29:32.1669477Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2025-03-14T06:29:32.1670380Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 7s local 2025-03-14T06:29:32.1671480Z Compiling xla/tsl/profiler/rpc/client/capture_profile.cc; 6s local ... 2025-03-14T06:29:32.4490248Z 2025-03-14T06:29:32.4491138Z  2025-03-14T06:29:32.4491614Z  2025-03-14T06:29:32.4492008Z  2025-03-14T06:29:32.4492396Z  2025-03-14T06:29:32.4492850Z  2025-03-14T06:29:32.4493232Z  2025-03-14T06:29:32.4493616Z  2025-03-14T06:29:32.4494001Z  2025-03-14T06:29:32.4494901Z [15,059 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:32.4496169Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T06:29:32.4497140Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T06:29:32.4498098Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T06:29:32.4499100Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2025-03-14T06:29:32.4499847Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T06:29:32.4500607Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 8s local 2025-03-14T06:29:32.4501361Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 7s local 2025-03-14T06:29:32.4502124Z Compiling .../coordination/coordination_service_agent.cc; 5s local ... 2025-03-14T06:29:32.7431069Z 2025-03-14T06:29:32.7434643Z  2025-03-14T06:29:32.7435132Z  2025-03-14T06:29:32.7435490Z  2025-03-14T06:29:32.7435843Z  2025-03-14T06:29:32.7436194Z  2025-03-14T06:29:32.7436822Z  2025-03-14T06:29:32.7437172Z  2025-03-14T06:29:32.7437505Z  2025-03-14T06:29:32.7438338Z [15,061 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:32.7439566Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T06:29:32.7440589Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T06:29:32.7441550Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T06:29:32.7442475Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2025-03-14T06:29:32.7443142Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T06:29:32.7443803Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2025-03-14T06:29:32.7444791Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 7s local 2025-03-14T06:29:32.7455030Z Compiling .../coordination/coordination_service_agent.cc; 5s local ... 2025-03-14T06:29:32.9664261Z 2025-03-14T06:29:32.9666821Z  2025-03-14T06:29:32.9667333Z  2025-03-14T06:29:32.9669537Z  2025-03-14T06:29:32.9672715Z  2025-03-14T06:29:32.9674216Z  2025-03-14T06:29:32.9674888Z  2025-03-14T06:29:32.9675560Z  2025-03-14T06:29:32.9676217Z  2025-03-14T06:29:32.9677754Z [15,063 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:32.9679511Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T06:29:32.9680914Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 83s local 2025-03-14T06:29:32.9682153Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T06:29:32.9683365Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2025-03-14T06:29:32.9684334Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T06:29:32.9685335Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2025-03-14T06:29:32.9686431Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 7s local 2025-03-14T06:29:32.9687669Z Compiling .../coordination/coordination_service_agent.cc; 6s local ... 2025-03-14T06:29:33.3666952Z 2025-03-14T06:29:33.3668368Z  2025-03-14T06:29:33.3669144Z  2025-03-14T06:29:33.3670292Z  2025-03-14T06:29:33.3670770Z  2025-03-14T06:29:33.3671157Z  2025-03-14T06:29:33.3671587Z  2025-03-14T06:29:33.3672001Z  2025-03-14T06:29:33.3672401Z  2025-03-14T06:29:33.3673335Z [15,068 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:33.3674512Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T06:29:33.3675729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T06:29:33.3676912Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 83s local 2025-03-14T06:29:33.3677938Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2025-03-14T06:29:33.3678868Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T06:29:33.3679682Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 9s local 2025-03-14T06:29:33.3680644Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 8s local 2025-03-14T06:29:33.3681735Z Compiling .../coordination/coordination_service_agent.cc; 6s local ... 2025-03-14T06:29:33.5671701Z 2025-03-14T06:29:33.5673016Z  2025-03-14T06:29:33.5673532Z  2025-03-14T06:29:33.5673957Z  2025-03-14T06:29:33.5674404Z  2025-03-14T06:29:33.5674819Z  2025-03-14T06:29:33.5675253Z  2025-03-14T06:29:33.5675671Z  2025-03-14T06:29:33.5676065Z  2025-03-14T06:29:33.5677001Z [15,070 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:33.5678258Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T06:29:33.5679456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T06:29:33.5680937Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T06:29:33.5681918Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2025-03-14T06:29:33.5682861Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T06:29:33.5683650Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2025-03-14T06:29:33.5684566Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 8s local 2025-03-14T06:29:33.5685768Z Compiling .../coordination/coordination_service_agent.cc; 6s local ... 2025-03-14T06:29:33.7698283Z 2025-03-14T06:29:33.7699234Z  2025-03-14T06:29:33.7703270Z  2025-03-14T06:29:33.7703983Z  2025-03-14T06:29:33.7704893Z  2025-03-14T06:29:33.7705603Z  2025-03-14T06:29:33.7706011Z  2025-03-14T06:29:33.7706435Z  2025-03-14T06:29:33.7706840Z  2025-03-14T06:29:33.7707781Z [15,080 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:33.7709045Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T06:29:33.7710233Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T06:29:33.7711377Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T06:29:33.7712574Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2025-03-14T06:29:33.7713429Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T06:29:33.7714243Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2025-03-14T06:29:33.7715163Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 8s local 2025-03-14T06:29:33.7716238Z Compiling .../coordination/coordination_service_agent.cc; 6s local ... 2025-03-14T06:29:34.0129332Z 2025-03-14T06:29:34.0130616Z  2025-03-14T06:29:34.0131116Z  2025-03-14T06:29:34.0131545Z  2025-03-14T06:29:34.0131927Z  2025-03-14T06:29:34.0132361Z  2025-03-14T06:29:34.0132790Z  2025-03-14T06:29:34.0133187Z  2025-03-14T06:29:34.0133583Z  2025-03-14T06:29:34.0134512Z [15,086 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:34.0135658Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T06:29:34.0136863Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 84s local 2025-03-14T06:29:34.0137960Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T06:29:34.0139058Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T06:29:34.0139815Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T06:29:34.0140544Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2025-03-14T06:29:34.0141420Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 8s local 2025-03-14T06:29:34.0142444Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2025-03-14T06:29:34.3685225Z 2025-03-14T06:29:34.3686188Z  2025-03-14T06:29:34.3686678Z  2025-03-14T06:29:34.3687100Z  2025-03-14T06:29:34.3687504Z  2025-03-14T06:29:34.3687916Z  2025-03-14T06:29:34.3688288Z  2025-03-14T06:29:34.3688704Z  2025-03-14T06:29:34.3689086Z  2025-03-14T06:29:34.3690037Z [15,089 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:34.3691275Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T06:29:34.3692447Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T06:29:34.3693595Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 84s local 2025-03-14T06:29:34.3694584Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T06:29:34.3695415Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T06:29:34.3696190Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 10s local 2025-03-14T06:29:34.3697466Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 9s local 2025-03-14T06:29:34.3698529Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2025-03-14T06:29:34.7490282Z 2025-03-14T06:29:34.7491220Z  2025-03-14T06:29:34.7492014Z  2025-03-14T06:29:34.7492436Z  2025-03-14T06:29:34.7492854Z  2025-03-14T06:29:34.7493278Z  2025-03-14T06:29:34.7493709Z  2025-03-14T06:29:34.7494094Z  2025-03-14T06:29:34.7494513Z  2025-03-14T06:29:34.7495424Z [15,091 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:34.7496631Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T06:29:34.7497778Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T06:29:34.7499116Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T06:29:34.7500079Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T06:29:34.7500841Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T06:29:34.7501595Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2025-03-14T06:29:34.7502509Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 9s local 2025-03-14T06:29:34.7503562Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2025-03-14T06:29:34.9690851Z 2025-03-14T06:29:34.9692552Z  2025-03-14T06:29:34.9693098Z  2025-03-14T06:29:34.9693480Z  2025-03-14T06:29:34.9693884Z  2025-03-14T06:29:34.9694286Z  2025-03-14T06:29:34.9694704Z  2025-03-14T06:29:34.9695120Z  2025-03-14T06:29:34.9695545Z  2025-03-14T06:29:34.9696490Z [15,093 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:34.9697704Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T06:29:34.9698916Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 85s local 2025-03-14T06:29:34.9700169Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T06:29:34.9701202Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T06:29:34.9702048Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T06:29:34.9702873Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2025-03-14T06:29:34.9703796Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 9s local 2025-03-14T06:29:34.9704788Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2025-03-14T06:29:35.3696317Z 2025-03-14T06:29:35.3697584Z  2025-03-14T06:29:35.3698101Z  2025-03-14T06:29:35.3698642Z  2025-03-14T06:29:35.3699074Z  2025-03-14T06:29:35.3699486Z  2025-03-14T06:29:35.3699892Z  2025-03-14T06:29:35.3700311Z  2025-03-14T06:29:35.3700701Z  2025-03-14T06:29:35.3701724Z [15,095 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:35.3703069Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T06:29:35.3704314Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T06:29:35.3705564Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 85s local 2025-03-14T06:29:35.3706643Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T06:29:35.3707480Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T06:29:35.3708321Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 11s local 2025-03-14T06:29:35.3709261Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 10s local 2025-03-14T06:29:35.3710347Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2025-03-14T06:29:35.5702382Z 2025-03-14T06:29:35.5703316Z  2025-03-14T06:29:35.5703825Z  2025-03-14T06:29:35.5704208Z  2025-03-14T06:29:35.5704618Z  2025-03-14T06:29:35.5705038Z  2025-03-14T06:29:35.5705779Z  2025-03-14T06:29:35.5706168Z  2025-03-14T06:29:35.5706532Z  2025-03-14T06:29:35.5707527Z [15,097 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:35.5708963Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T06:29:35.5710174Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T06:29:35.5711356Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T06:29:35.5712403Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T06:29:35.5713184Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T06:29:35.5713975Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T06:29:35.5715093Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 10s local 2025-03-14T06:29:35.5716181Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2025-03-14T06:29:35.9096362Z 2025-03-14T06:29:35.9097206Z  2025-03-14T06:29:35.9097681Z  2025-03-14T06:29:35.9098061Z  2025-03-14T06:29:35.9098560Z  2025-03-14T06:29:35.9099224Z  2025-03-14T06:29:35.9099878Z  2025-03-14T06:29:35.9100564Z  2025-03-14T06:29:35.9101197Z  2025-03-14T06:29:35.9102771Z [15,098 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:35.9104322Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T06:29:35.9105692Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T06:29:35.9106959Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T06:29:35.9108120Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:35.9108945Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T06:29:35.9109776Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T06:29:35.9110738Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 10s local 2025-03-14T06:29:35.9111805Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2025-03-14T06:29:36.1183751Z 2025-03-14T06:29:36.1184669Z  2025-03-14T06:29:36.1185210Z  2025-03-14T06:29:36.1185603Z  2025-03-14T06:29:36.1186032Z  2025-03-14T06:29:36.1186465Z  2025-03-14T06:29:36.1186893Z  2025-03-14T06:29:36.1187301Z  2025-03-14T06:29:36.1187713Z  2025-03-14T06:29:36.1188705Z [15,100 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:36.1189958Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T06:29:36.1191191Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 86s local 2025-03-14T06:29:36.1192374Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T06:29:36.1193451Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:36.1194250Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T06:29:36.1195086Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T06:29:36.1196043Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 10s local 2025-03-14T06:29:36.1197145Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2025-03-14T06:29:36.3709628Z 2025-03-14T06:29:36.3710637Z  2025-03-14T06:29:36.3711212Z  2025-03-14T06:29:36.3711648Z  2025-03-14T06:29:36.3712039Z  2025-03-14T06:29:36.3712381Z  2025-03-14T06:29:36.3712799Z  2025-03-14T06:29:36.3713294Z  2025-03-14T06:29:36.3713756Z  2025-03-14T06:29:36.3714768Z [15,101 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:36.3716058Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T06:29:36.3717383Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T06:29:36.3718766Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 86s local 2025-03-14T06:29:36.3719759Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:36.3720713Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T06:29:36.3721498Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 12s local 2025-03-14T06:29:36.3722413Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local 2025-03-14T06:29:36.3723462Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2025-03-14T06:29:36.5714028Z 2025-03-14T06:29:36.5715037Z  2025-03-14T06:29:36.5715641Z  2025-03-14T06:29:36.5716044Z  2025-03-14T06:29:36.5716443Z  2025-03-14T06:29:36.5717169Z  2025-03-14T06:29:36.5717569Z  2025-03-14T06:29:36.5717971Z  2025-03-14T06:29:36.5718380Z  2025-03-14T06:29:36.5719372Z [15,103 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:36.5720620Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T06:29:36.5721768Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T06:29:36.5722917Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T06:29:36.5724098Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:36.5725042Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T06:29:36.5725841Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T06:29:36.5726725Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local 2025-03-14T06:29:36.5727745Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2025-03-14T06:29:36.7965978Z 2025-03-14T06:29:36.7966938Z  2025-03-14T06:29:36.7967606Z  2025-03-14T06:29:36.7968057Z  2025-03-14T06:29:36.7968405Z  2025-03-14T06:29:36.7968774Z  2025-03-14T06:29:36.7969203Z  2025-03-14T06:29:36.7969582Z  2025-03-14T06:29:36.7969958Z  2025-03-14T06:29:36.7970836Z [15,106 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:36.7972000Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T06:29:36.7973161Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T06:29:36.7974501Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T06:29:36.7975655Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:36.7976528Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T06:29:36.7977393Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T06:29:36.7978393Z Compiling mlir/lib/AsmParser/Parser.cpp [for tool]; 11s local 2025-03-14T06:29:36.7979366Z Compiling xla/ffi/attribute_map.cc; 7s local ... 2025-03-14T06:29:37.0158140Z 2025-03-14T06:29:37.0158977Z  2025-03-14T06:29:37.0159468Z  2025-03-14T06:29:37.0159879Z  2025-03-14T06:29:37.0160306Z  2025-03-14T06:29:37.0160711Z  2025-03-14T06:29:37.0161127Z  2025-03-14T06:29:37.0161698Z  2025-03-14T06:29:37.0162165Z  2025-03-14T06:29:37.0163192Z [15,110 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:37.0164452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T06:29:37.0165886Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 87s local 2025-03-14T06:29:37.0166849Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T06:29:37.0167691Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T06:29:37.0168385Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T06:29:37.0169082Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T06:29:37.0170029Z Compiling xla/ffi/attribute_map.cc; 7s local 2025-03-14T06:29:37.0170782Z Compiling .../coordination/coordination_service.cc; 5s local ... 2025-03-14T06:29:37.3725386Z 2025-03-14T06:29:37.3726261Z  2025-03-14T06:29:37.3726848Z  2025-03-14T06:29:37.3727528Z  2025-03-14T06:29:37.3727935Z  2025-03-14T06:29:37.3728343Z  2025-03-14T06:29:37.3728813Z  2025-03-14T06:29:37.3729221Z  2025-03-14T06:29:37.3729635Z  2025-03-14T06:29:37.3730642Z [15,112 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:37.3731892Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T06:29:37.3733104Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T06:29:37.3734536Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 87s local 2025-03-14T06:29:37.3735578Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T06:29:37.3736404Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T06:29:37.3737207Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 13s local 2025-03-14T06:29:37.3737982Z Compiling xla/ffi/attribute_map.cc; 7s local 2025-03-14T06:29:37.3738842Z Compiling .../coordination/coordination_service.cc; 5s local ... 2025-03-14T06:29:37.7489510Z 2025-03-14T06:29:37.7490346Z  2025-03-14T06:29:37.7491069Z  2025-03-14T06:29:37.7491614Z  2025-03-14T06:29:37.7492029Z  2025-03-14T06:29:37.7492438Z  2025-03-14T06:29:37.7492836Z  2025-03-14T06:29:37.7493239Z  2025-03-14T06:29:37.7493632Z  2025-03-14T06:29:37.7494562Z [15,114 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:37.7495748Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:37.7496879Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T06:29:37.7498010Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T06:29:37.7498964Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T06:29:37.7499703Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T06:29:37.7500464Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:37.7501236Z Compiling xla/ffi/attribute_map.cc; 8s local 2025-03-14T06:29:37.7502174Z Compiling .../coordination/coordination_service.cc; 6s local ... 2025-03-14T06:29:37.9728928Z 2025-03-14T06:29:37.9729856Z  2025-03-14T06:29:37.9730368Z  2025-03-14T06:29:37.9730797Z  2025-03-14T06:29:37.9731202Z  2025-03-14T06:29:37.9731609Z  2025-03-14T06:29:37.9732016Z  2025-03-14T06:29:37.9732452Z  2025-03-14T06:29:37.9732860Z  2025-03-14T06:29:37.9733831Z [15,116 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:37.9735067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:37.9736244Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T06:29:37.9737410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T06:29:37.9738344Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T06:29:37.9739159Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:37.9739885Z Compiling xla/ffi/attribute_map.cc; 8s local 2025-03-14T06:29:37.9740701Z Compiling .../coordination/coordination_service.cc; 6s local 2025-03-14T06:29:37.9741671Z Compiling .../coordination/coordination_service.cc; 6s local ... 2025-03-14T06:29:38.1733129Z 2025-03-14T06:29:38.1734130Z  2025-03-14T06:29:38.1734692Z  2025-03-14T06:29:38.1735133Z  2025-03-14T06:29:38.1735537Z  2025-03-14T06:29:38.1735905Z  2025-03-14T06:29:38.1736336Z  2025-03-14T06:29:38.1736747Z  2025-03-14T06:29:38.1737428Z  2025-03-14T06:29:38.1738439Z [15,119 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:38.1739673Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:38.1740925Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 88s local 2025-03-14T06:29:38.1742168Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T06:29:38.1743107Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T06:29:38.1743892Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:38.1744678Z Compiling xla/ffi/attribute_map.cc; 8s local 2025-03-14T06:29:38.1745484Z Compiling .../coordination/coordination_service.cc; 6s local 2025-03-14T06:29:38.1746616Z Compiling .../coordination/coordination_service.cc; 6s local ... 2025-03-14T06:29:38.4074151Z 2025-03-14T06:29:38.4075112Z  2025-03-14T06:29:38.4075649Z  2025-03-14T06:29:38.4076148Z  2025-03-14T06:29:38.4076501Z  2025-03-14T06:29:38.4076878Z  2025-03-14T06:29:38.4077257Z  2025-03-14T06:29:38.4077644Z  2025-03-14T06:29:38.4078041Z  2025-03-14T06:29:38.4078996Z [15,120 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:38.4080460Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:38.4081668Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T06:29:38.4082828Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 88s local 2025-03-14T06:29:38.4083772Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2025-03-14T06:29:38.4084491Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 14s local 2025-03-14T06:29:38.4085390Z Compiling xla/ffi/attribute_map.cc; 8s local 2025-03-14T06:29:38.4086233Z Compiling .../coordination/coordination_service.cc; 6s local 2025-03-14T06:29:38.4087349Z Compiling .../coordination/coordination_service.cc; 6s local ... 2025-03-14T06:29:38.6510934Z 2025-03-14T06:29:38.6511919Z  2025-03-14T06:29:38.6512445Z  2025-03-14T06:29:38.6512900Z  2025-03-14T06:29:38.6513304Z  2025-03-14T06:29:38.6513707Z  2025-03-14T06:29:38.6514101Z  2025-03-14T06:29:38.6514485Z  2025-03-14T06:29:38.6514900Z  2025-03-14T06:29:38.6515901Z [15,122 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:38.6517067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:38.6518247Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T06:29:38.6519414Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T06:29:38.6520555Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2025-03-14T06:29:38.6521388Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T06:29:38.6522102Z Compiling xla/ffi/attribute_map.cc; 8s local 2025-03-14T06:29:38.6522896Z Compiling .../coordination/coordination_service.cc; 6s local 2025-03-14T06:29:38.6523893Z Compiling .../coordination/coordination_service.cc; 6s local ... 2025-03-14T06:29:38.9134731Z 2025-03-14T06:29:38.9135676Z  2025-03-14T06:29:38.9136200Z  2025-03-14T06:29:38.9136641Z  2025-03-14T06:29:38.9137022Z  2025-03-14T06:29:38.9137412Z  2025-03-14T06:29:38.9137859Z  2025-03-14T06:29:38.9138379Z  2025-03-14T06:29:38.9138822Z  2025-03-14T06:29:38.9139790Z [15,124 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:38.9141059Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T06:29:38.9142189Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T06:29:38.9143181Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T06:29:38.9144397Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T06:29:38.9145107Z Compiling xla/ffi/attribute_map.cc; 9s local 2025-03-14T06:29:38.9146074Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T06:29:38.9147237Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T06:29:38.9148324Z Compiling .../coordination/grpc_coordination_service_impl.cc; 5s local ... 2025-03-14T06:29:39.1202430Z 2025-03-14T06:29:39.1203415Z  2025-03-14T06:29:39.1203950Z  2025-03-14T06:29:39.1204389Z  2025-03-14T06:29:39.1204793Z  2025-03-14T06:29:39.1205321Z  2025-03-14T06:29:39.1205721Z  2025-03-14T06:29:39.1206128Z  2025-03-14T06:29:39.1206536Z  2025-03-14T06:29:39.1207839Z [15,127 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:39.1209043Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T06:29:39.1210182Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 89s local 2025-03-14T06:29:39.1211340Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T06:29:39.1212341Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T06:29:39.1213226Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T06:29:39.1214365Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T06:29:39.1215465Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 6s local 2025-03-14T06:29:39.1216495Z Compiling mlir/lib/IR/SymbolTable.cpp; 6s local ... 2025-03-14T06:29:39.3476621Z 2025-03-14T06:29:39.3477576Z  2025-03-14T06:29:39.3478109Z  2025-03-14T06:29:39.3478562Z  2025-03-14T06:29:39.3478943Z  2025-03-14T06:29:39.3479318Z  2025-03-14T06:29:39.3479697Z  2025-03-14T06:29:39.3480100Z  2025-03-14T06:29:39.3480488Z  2025-03-14T06:29:39.3481468Z [15,129 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:39.3482688Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T06:29:39.3483860Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T06:29:39.3485295Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 89s local 2025-03-14T06:29:39.3486277Z Compiling mlir/lib/Dialect/PDL/IR/PDL.cpp; 15s local 2025-03-14T06:29:39.3487099Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T06:29:39.3488033Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T06:29:39.3489083Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 6s local 2025-03-14T06:29:39.3490085Z Compiling mlir/lib/IR/SymbolTable.cpp; 6s local ... 2025-03-14T06:29:39.5743944Z 2025-03-14T06:29:39.5744897Z  2025-03-14T06:29:39.5745414Z  2025-03-14T06:29:39.5745895Z  2025-03-14T06:29:39.5746260Z  2025-03-14T06:29:39.5746645Z  2025-03-14T06:29:39.5747058Z  2025-03-14T06:29:39.5747467Z  2025-03-14T06:29:39.5747869Z  2025-03-14T06:29:39.5748826Z [15,132 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:39.5750052Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T06:29:39.5751201Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T06:29:39.5752337Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T06:29:39.5753373Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T06:29:39.5754311Z Compiling .../coordination/coordination_service.cc; 7s local 2025-03-14T06:29:39.5755276Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 6s local 2025-03-14T06:29:39.5756170Z Compiling mlir/lib/IR/SymbolTable.cpp; 6s local 2025-03-14T06:29:39.5757244Z Compiling mlir/lib/IR/AsmPrinter.cpp; 6s local ... 2025-03-14T06:29:40.0164134Z 2025-03-14T06:29:40.0165216Z  2025-03-14T06:29:40.0165931Z  2025-03-14T06:29:40.0166391Z  2025-03-14T06:29:40.0167172Z  2025-03-14T06:29:40.0167644Z  2025-03-14T06:29:40.0168047Z  2025-03-14T06:29:40.0168443Z  2025-03-14T06:29:40.0168842Z  2025-03-14T06:29:40.0169848Z [15,133 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:40.0170911Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T06:29:40.0171857Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T06:29:40.0172977Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T06:29:40.0173828Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T06:29:40.0174601Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T06:29:40.0175496Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 7s local 2025-03-14T06:29:40.0176298Z Compiling mlir/lib/IR/SymbolTable.cpp; 6s local 2025-03-14T06:29:40.0176956Z Compiling mlir/lib/IR/AsmPrinter.cpp; 6s local ... 2025-03-14T06:29:40.2402174Z 2025-03-14T06:29:40.2403129Z  2025-03-14T06:29:40.2403939Z  2025-03-14T06:29:40.2404363Z  2025-03-14T06:29:40.2404811Z  2025-03-14T06:29:40.2405377Z  2025-03-14T06:29:40.2405740Z  2025-03-14T06:29:40.2406129Z  2025-03-14T06:29:40.2406505Z  2025-03-14T06:29:40.2407407Z [15,146 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:40.2408611Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T06:29:40.2409505Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 90s local 2025-03-14T06:29:40.2410620Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 90s local 2025-03-14T06:29:40.2411639Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T06:29:40.2412561Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T06:29:40.2413591Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 7s local 2025-03-14T06:29:40.2414546Z Compiling mlir/lib/IR/SymbolTable.cpp; 7s local 2025-03-14T06:29:40.2415321Z Compiling mlir/lib/IR/AsmPrinter.cpp; 7s local ... 2025-03-14T06:29:40.5683513Z 2025-03-14T06:29:40.5684491Z  2025-03-14T06:29:40.5685606Z  2025-03-14T06:29:40.5686084Z  2025-03-14T06:29:40.5686520Z  2025-03-14T06:29:40.5686995Z  2025-03-14T06:29:40.5687359Z  2025-03-14T06:29:40.5687786Z  2025-03-14T06:29:40.5688222Z  2025-03-14T06:29:40.5689207Z [15,148 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:40.5690421Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T06:29:40.5691646Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T06:29:40.5692884Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T06:29:40.5693831Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T06:29:40.5694712Z Compiling .../coordination/coordination_service.cc; 8s local 2025-03-14T06:29:40.5695797Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 7s local 2025-03-14T06:29:40.5696807Z Compiling mlir/lib/IR/SymbolTable.cpp; 7s local 2025-03-14T06:29:40.5697661Z Compiling mlir/lib/IR/AsmPrinter.cpp; 7s local ... 2025-03-14T06:29:40.7754229Z 2025-03-14T06:29:40.7755208Z  2025-03-14T06:29:40.7755757Z  2025-03-14T06:29:40.7756216Z  2025-03-14T06:29:40.7756639Z  2025-03-14T06:29:40.7757125Z  2025-03-14T06:29:40.7757515Z  2025-03-14T06:29:40.7758154Z  2025-03-14T06:29:40.7758564Z  2025-03-14T06:29:40.7759525Z [15,150 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:40.7760895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2025-03-14T06:29:40.7762081Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T06:29:40.7763183Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T06:29:40.7764157Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T06:29:40.7765240Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T06:29:40.7766468Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 7s local 2025-03-14T06:29:40.7767662Z Compiling mlir/lib/IR/SymbolTable.cpp; 7s local 2025-03-14T06:29:40.7768428Z Compiling mlir/lib/IR/AsmPrinter.cpp; 7s local ... 2025-03-14T06:29:41.2527734Z 2025-03-14T06:29:41.2528702Z  2025-03-14T06:29:41.2529245Z  2025-03-14T06:29:41.2529692Z  2025-03-14T06:29:41.2530114Z  2025-03-14T06:29:41.2530576Z  2025-03-14T06:29:41.2531039Z  2025-03-14T06:29:41.2531442Z  2025-03-14T06:29:41.2531831Z  2025-03-14T06:29:41.2532748Z [15,152 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:29:41.2534243Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2025-03-14T06:29:41.2535447Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 91s local 2025-03-14T06:29:41.2536538Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 91s local 2025-03-14T06:29:41.2537563Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T06:29:41.2538447Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T06:29:41.2539427Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 8s local 2025-03-14T06:29:41.2540411Z Compiling mlir/lib/IR/AsmPrinter.cpp; 8s local 2025-03-14T06:29:41.2541322Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2025-03-14T06:29:41.4531656Z 2025-03-14T06:29:41.4532630Z  2025-03-14T06:29:41.4533149Z  2025-03-14T06:29:41.4533571Z  2025-03-14T06:29:41.4533995Z  2025-03-14T06:29:41.4534396Z  2025-03-14T06:29:41.4534819Z  2025-03-14T06:29:41.4535235Z  2025-03-14T06:29:41.4535657Z  2025-03-14T06:29:41.4536629Z [15,155 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:41.4537755Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2025-03-14T06:29:41.4538737Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T06:29:41.4539990Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T06:29:41.4541033Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T06:29:41.4541996Z Compiling .../coordination/coordination_service.cc; 9s local 2025-03-14T06:29:41.4543055Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 8s local 2025-03-14T06:29:41.4544035Z Compiling mlir/lib/IR/AsmPrinter.cpp; 8s local 2025-03-14T06:29:41.4544956Z Compiling .../coordination/coordination_service_agent.cc; 7s local ... 2025-03-14T06:29:41.8536235Z 2025-03-14T06:29:41.8537162Z  2025-03-14T06:29:41.8537686Z  2025-03-14T06:29:41.8538143Z  2025-03-14T06:29:41.8538557Z  2025-03-14T06:29:41.8539041Z  2025-03-14T06:29:41.8539465Z  2025-03-14T06:29:41.8539875Z  2025-03-14T06:29:41.8540279Z  2025-03-14T06:29:41.8541264Z [15,157 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:41.8542552Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T06:29:41.8544031Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T06:29:41.8545232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T06:29:41.8546473Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T06:29:41.8547490Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T06:29:41.8548479Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 8s local 2025-03-14T06:29:41.8549430Z Compiling mlir/lib/IR/AsmPrinter.cpp; 8s local 2025-03-14T06:29:41.8550317Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2025-03-14T06:29:42.2541667Z 2025-03-14T06:29:42.2542574Z  2025-03-14T06:29:42.2543073Z  2025-03-14T06:29:42.2543769Z  2025-03-14T06:29:42.2544184Z  2025-03-14T06:29:42.2544607Z  2025-03-14T06:29:42.2545008Z  2025-03-14T06:29:42.2545391Z  2025-03-14T06:29:42.2545836Z  2025-03-14T06:29:42.2546807Z [15,159 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:42.2548020Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T06:29:42.2549233Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 92s local 2025-03-14T06:29:42.2550405Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 92s local 2025-03-14T06:29:42.2551684Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T06:29:42.2552662Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T06:29:42.2553676Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2025-03-14T06:29:42.2554666Z Compiling mlir/lib/IR/AsmPrinter.cpp; 9s local 2025-03-14T06:29:42.2555604Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2025-03-14T06:29:42.5173256Z 2025-03-14T06:29:42.5174188Z  2025-03-14T06:29:42.5174719Z  2025-03-14T06:29:42.5175195Z  2025-03-14T06:29:42.5175624Z  2025-03-14T06:29:42.5176111Z  2025-03-14T06:29:42.5176530Z  2025-03-14T06:29:42.5176930Z  2025-03-14T06:29:42.5177347Z  2025-03-14T06:29:42.5178307Z [15,160 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:42.5179518Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T06:29:42.5180669Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T06:29:42.5181799Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T06:29:42.5182838Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T06:29:42.5183820Z Compiling .../coordination/coordination_service.cc; 10s local 2025-03-14T06:29:42.5184902Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2025-03-14T06:29:42.5185969Z Compiling mlir/lib/IR/AsmPrinter.cpp; 9s local 2025-03-14T06:29:42.5187027Z Compiling .../coordination/coordination_service_agent.cc; 8s local ... 2025-03-14T06:29:42.8089930Z 2025-03-14T06:29:42.8090922Z  2025-03-14T06:29:42.8091435Z  2025-03-14T06:29:42.8091881Z  2025-03-14T06:29:42.8092309Z  2025-03-14T06:29:42.8092762Z  2025-03-14T06:29:42.8093182Z  2025-03-14T06:29:42.8093567Z  2025-03-14T06:29:42.8093955Z  2025-03-14T06:29:42.8094837Z [15,163 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:42.8096003Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T06:29:42.8097066Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T06:29:42.8098140Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T06:29:42.8099142Z Compiling .../coordination/coordination_service.cc; 11s local 2025-03-14T06:29:42.8100280Z Compiling .../coordination/coordination_service.cc; 11s local 2025-03-14T06:29:42.8101311Z Compiling .../rpc/coordination/grpc_coordination_service_impl.cc; 9s local 2025-03-14T06:29:42.8102267Z Compiling mlir/lib/IR/AsmPrinter.cpp; 9s local 2025-03-14T06:29:42.8103294Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2025-03-14T06:29:43.0548570Z 2025-03-14T06:29:43.0549560Z  2025-03-14T06:29:43.0550127Z  2025-03-14T06:29:43.0550575Z  2025-03-14T06:29:43.0550994Z  2025-03-14T06:29:43.0551482Z  2025-03-14T06:29:43.0551884Z  2025-03-14T06:29:43.0552274Z  2025-03-14T06:29:43.0552673Z  2025-03-14T06:29:43.0553644Z [15,164 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:43.0555126Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T06:29:43.0556283Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T06:29:43.0557413Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T06:29:43.0558373Z Compiling .../coordination/coordination_service.cc; 11s local 2025-03-14T06:29:43.0559349Z Compiling .../coordination/coordination_service.cc; 11s local 2025-03-14T06:29:43.0560372Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T06:29:43.0561474Z Compiling mlir/lib/IR/AsmPrinter.cpp; 9s local 2025-03-14T06:29:43.0562223Z Compiling .../coordination/coordination_service_agent.cc; 9s local ... 2025-03-14T06:29:43.2552029Z 2025-03-14T06:29:43.2552881Z  2025-03-14T06:29:43.2553331Z  2025-03-14T06:29:43.2553710Z  2025-03-14T06:29:43.2554094Z  2025-03-14T06:29:43.2554495Z  2025-03-14T06:29:43.2554857Z  2025-03-14T06:29:43.2555215Z  2025-03-14T06:29:43.2555577Z  2025-03-14T06:29:43.2556435Z [15,169 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:43.2557553Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T06:29:43.2558543Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 93s local 2025-03-14T06:29:43.2559572Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 93s local 2025-03-14T06:29:43.2560489Z Compiling .../coordination/coordination_service.cc; 11s local 2025-03-14T06:29:43.2561408Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T06:29:43.2562217Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local 2025-03-14T06:29:43.2562911Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 9s local 2025-03-14T06:29:43.2563635Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local ... 2025-03-14T06:29:43.4579836Z 2025-03-14T06:29:43.4580760Z  2025-03-14T06:29:43.4581181Z  2025-03-14T06:29:43.4581525Z  2025-03-14T06:29:43.4581860Z  2025-03-14T06:29:43.4582178Z  2025-03-14T06:29:43.4582554Z  2025-03-14T06:29:43.4582895Z  2025-03-14T06:29:43.4583225Z  2025-03-14T06:29:43.4584040Z [15,172 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:43.4585005Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T06:29:43.4585988Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T06:29:43.4586905Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T06:29:43.4587779Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T06:29:43.4588546Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local 2025-03-14T06:29:43.4589194Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 9s local 2025-03-14T06:29:43.4589845Z Compiling llvm/lib/IR/AsmWriter.cpp; 8s local 2025-03-14T06:29:43.4590599Z Compiling .../coordination/grpc_coordination_service_impl.cc; 8s local ... 2025-03-14T06:29:43.8559739Z 2025-03-14T06:29:43.8560681Z  2025-03-14T06:29:43.8561185Z  2025-03-14T06:29:43.8561589Z  2025-03-14T06:29:43.8561968Z  2025-03-14T06:29:43.8562385Z  2025-03-14T06:29:43.8562771Z  2025-03-14T06:29:43.8563418Z  2025-03-14T06:29:43.8563842Z  2025-03-14T06:29:43.8564824Z [15,172 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:43.8566331Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T06:29:43.8567368Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T06:29:43.8568380Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T06:29:43.8571588Z Compiling .../coordination/grpc_coordination_service_impl.cc; 10s local 2025-03-14T06:29:43.8572660Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local 2025-03-14T06:29:43.8573381Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 9s local 2025-03-14T06:29:43.8574097Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2025-03-14T06:29:43.8575003Z Compiling .../coordination/grpc_coordination_service_impl.cc; 8s local ... 2025-03-14T06:29:44.0562696Z 2025-03-14T06:29:44.0563676Z  2025-03-14T06:29:44.0564202Z  2025-03-14T06:29:44.0564640Z  2025-03-14T06:29:44.0565198Z  2025-03-14T06:29:44.0565822Z  2025-03-14T06:29:44.0566481Z  2025-03-14T06:29:44.0566907Z  2025-03-14T06:29:44.0567334Z  2025-03-14T06:29:44.0568314Z [15,176 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:44.0569439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T06:29:44.0570551Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 94s local 2025-03-14T06:29:44.0571697Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T06:29:44.0572791Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T06:29:44.0573778Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local 2025-03-14T06:29:44.0574623Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2025-03-14T06:29:44.0575478Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2025-03-14T06:29:44.0576483Z Compiling .../coordination/grpc_coordination_service_impl.cc; 8s local ... 2025-03-14T06:29:44.3815593Z 2025-03-14T06:29:44.3816447Z  2025-03-14T06:29:44.3816911Z  2025-03-14T06:29:44.3817303Z  2025-03-14T06:29:44.3817680Z  2025-03-14T06:29:44.3818076Z  2025-03-14T06:29:44.3818443Z  2025-03-14T06:29:44.3818806Z  2025-03-14T06:29:44.3819184Z  2025-03-14T06:29:44.3820057Z [15,178 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:44.3821246Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T06:29:44.3822510Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:29:44.3823564Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 94s local 2025-03-14T06:29:44.3824685Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T06:29:44.3825616Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2025-03-14T06:29:44.3826440Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2025-03-14T06:29:44.3827251Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local 2025-03-14T06:29:44.3828210Z Compiling .../coordination/grpc_coordination_service_impl.cc; 8s local ... 2025-03-14T06:29:44.5980782Z 2025-03-14T06:29:44.5981630Z  2025-03-14T06:29:44.5982128Z  2025-03-14T06:29:44.5982533Z  2025-03-14T06:29:44.5982996Z  2025-03-14T06:29:44.5983419Z  2025-03-14T06:29:44.5983822Z  2025-03-14T06:29:44.5984233Z  2025-03-14T06:29:44.5984653Z  2025-03-14T06:29:44.5985646Z [15,181 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:44.5987260Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T06:29:44.5988559Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:29:44.5989697Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T06:29:44.5990871Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T06:29:44.5991791Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2025-03-14T06:29:44.5992612Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2025-03-14T06:29:44.5993442Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T06:29:44.5994358Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2025-03-14T06:29:44.8572512Z 2025-03-14T06:29:44.8573354Z  2025-03-14T06:29:44.8573869Z  2025-03-14T06:29:44.8574302Z  2025-03-14T06:29:44.8574747Z  2025-03-14T06:29:44.8575168Z  2025-03-14T06:29:44.8575585Z  2025-03-14T06:29:44.8576003Z  2025-03-14T06:29:44.8576352Z  2025-03-14T06:29:44.8577296Z [15,184 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:44.8578528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T06:29:44.8579948Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:29:44.8581162Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T06:29:44.8582462Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T06:29:44.8583478Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2025-03-14T06:29:44.8584314Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 10s local 2025-03-14T06:29:44.8585162Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T06:29:44.8586180Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2025-03-14T06:29:45.0576712Z 2025-03-14T06:29:45.0577587Z  2025-03-14T06:29:45.0578050Z  2025-03-14T06:29:45.0578436Z  2025-03-14T06:29:45.0578844Z  2025-03-14T06:29:45.0579295Z  2025-03-14T06:29:45.0579711Z  2025-03-14T06:29:45.0580249Z  2025-03-14T06:29:45.0580879Z  2025-03-14T06:29:45.0582171Z [15,186 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:45.0583592Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T06:29:45.0584826Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:29:45.0586049Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T06:29:45.0587244Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T06:29:45.0588222Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local 2025-03-14T06:29:45.0589085Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2025-03-14T06:29:45.0589926Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T06:29:45.0598371Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2025-03-14T06:29:45.2584582Z 2025-03-14T06:29:45.2585434Z  2025-03-14T06:29:45.2585936Z  2025-03-14T06:29:45.2586372Z  2025-03-14T06:29:45.2586815Z  2025-03-14T06:29:45.2587231Z  2025-03-14T06:29:45.2587649Z  2025-03-14T06:29:45.2588075Z  2025-03-14T06:29:45.2588505Z  2025-03-14T06:29:45.2589552Z [15,188 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:29:45.2590753Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T06:29:45.2591933Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 95s local 2025-03-14T06:29:45.2593127Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 95s local 2025-03-14T06:29:45.2594555Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T06:29:45.2595534Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2025-03-14T06:29:45.2596440Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2025-03-14T06:29:45.2597272Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T06:29:45.2598365Z Compiling .../coordination/grpc_coordination_service_impl.cc; 9s local ... 2025-03-14T06:29:45.5334999Z 2025-03-14T06:29:45.5335900Z  2025-03-14T06:29:45.5336396Z  2025-03-14T06:29:45.5336809Z  2025-03-14T06:29:45.5337168Z  2025-03-14T06:29:45.5337566Z  2025-03-14T06:29:45.5337972Z  2025-03-14T06:29:45.5338364Z  2025-03-14T06:29:45.5339091Z  2025-03-14T06:29:45.5340037Z [15,191 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:45.5341294Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T06:29:45.5342448Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T06:29:45.5343568Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T06:29:45.5344689Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T06:29:45.5345775Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2025-03-14T06:29:45.5346605Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2025-03-14T06:29:45.5347377Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T06:29:45.5348237Z .../rpc/coordination:grpc_coordination_service_impl; 10s local ... 2025-03-14T06:29:45.8580478Z 2025-03-14T06:29:45.8581375Z  2025-03-14T06:29:45.8581895Z  2025-03-14T06:29:45.8582315Z  2025-03-14T06:29:45.8582711Z  2025-03-14T06:29:45.8583135Z  2025-03-14T06:29:45.8583546Z  2025-03-14T06:29:45.8583966Z  2025-03-14T06:29:45.8584336Z  2025-03-14T06:29:45.8585311Z [15,191 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:45.8586440Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T06:29:45.8587619Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T06:29:45.8588781Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T06:29:45.8589941Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T06:29:45.8590813Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2025-03-14T06:29:45.8591588Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local 2025-03-14T06:29:45.8592377Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T06:29:45.8593272Z .../rpc/coordination:grpc_coordination_service_impl; 10s local ... 2025-03-14T06:29:46.2587064Z 2025-03-14T06:29:46.2588508Z  2025-03-14T06:29:46.2589033Z  2025-03-14T06:29:46.2589489Z  2025-03-14T06:29:46.2589928Z  2025-03-14T06:29:46.2590331Z  2025-03-14T06:29:46.2590727Z  2025-03-14T06:29:46.2591158Z  2025-03-14T06:29:46.2591564Z  2025-03-14T06:29:46.2592847Z [15,192 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:46.2594014Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T06:29:46.2595099Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 96s local 2025-03-14T06:29:46.2596255Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 96s local 2025-03-14T06:29:46.2597354Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2025-03-14T06:29:46.2598310Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T06:29:46.2599211Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2025-03-14T06:29:46.2600032Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T06:29:46.2601109Z .../rpc/coordination:grpc_coordination_service_impl; 10s local ... 2025-03-14T06:29:46.5419043Z 2025-03-14T06:29:46.5420347Z  2025-03-14T06:29:46.5420819Z  2025-03-14T06:29:46.5421210Z  2025-03-14T06:29:46.5421636Z  2025-03-14T06:29:46.5422016Z  2025-03-14T06:29:46.5422390Z  2025-03-14T06:29:46.5422786Z  2025-03-14T06:29:46.5423156Z  2025-03-14T06:29:46.5424081Z [15,196 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:46.5425210Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T06:29:46.5426272Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T06:29:46.5427576Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T06:29:46.5428439Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T06:29:46.5429217Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2025-03-14T06:29:46.5429952Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T06:29:46.5430766Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T06:29:46.5431793Z Compiling llvm/lib/Bitcode/Reader/MetadataLoader.cpp; 10s local ... 2025-03-14T06:29:46.7895684Z 2025-03-14T06:29:46.7896513Z  2025-03-14T06:29:46.7896981Z  2025-03-14T06:29:46.7897631Z  2025-03-14T06:29:46.7897994Z  2025-03-14T06:29:46.7898350Z  2025-03-14T06:29:46.7898822Z  2025-03-14T06:29:46.7899179Z  2025-03-14T06:29:46.7899526Z  2025-03-14T06:29:46.7900393Z [15,198 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:46.7901454Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T06:29:46.7902443Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T06:29:46.7903396Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T06:29:46.7904226Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T06:29:46.7904937Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local 2025-03-14T06:29:46.7905652Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T06:29:46.7906448Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T06:29:46.7907290Z Compiling mlir/lib/IR/MLIRContext.cpp; 8s local ... 2025-03-14T06:29:47.0592936Z 2025-03-14T06:29:47.0593780Z  2025-03-14T06:29:47.0594276Z  2025-03-14T06:29:47.0594670Z  2025-03-14T06:29:47.0595063Z  2025-03-14T06:29:47.0595461Z  2025-03-14T06:29:47.0595851Z  2025-03-14T06:29:47.0596361Z  2025-03-14T06:29:47.0596804Z  2025-03-14T06:29:47.0597765Z [15,199 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:47.0599017Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T06:29:47.0600093Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T06:29:47.0601170Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T06:29:47.0602416Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T06:29:47.0603229Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T06:29:47.0604162Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T06:29:47.0605299Z Compiling mlir/lib/IR/MLIRContext.cpp; 8s local 2025-03-14T06:29:47.0606075Z Compiling xla/ffi/attribute_map.cc; 8s local ... 2025-03-14T06:29:47.2663720Z 2025-03-14T06:29:47.2664538Z  2025-03-14T06:29:47.2665046Z  2025-03-14T06:29:47.2665714Z  2025-03-14T06:29:47.2666132Z  2025-03-14T06:29:47.2666531Z  2025-03-14T06:29:47.2666933Z  2025-03-14T06:29:47.2667363Z  2025-03-14T06:29:47.2667810Z  2025-03-14T06:29:47.2669154Z [15,203 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:47.2670312Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T06:29:47.2671448Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 97s local 2025-03-14T06:29:47.2672530Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 97s local 2025-03-14T06:29:47.2673576Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T06:29:47.2674407Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T06:29:47.2675340Z Compiling .../coordination/grpc_coordination_service_impl.cc; 11s local 2025-03-14T06:29:47.2676258Z Compiling xla/ffi/attribute_map.cc; 8s local 2025-03-14T06:29:47.2677429Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local ... 2025-03-14T06:29:47.6298689Z 2025-03-14T06:29:47.6299548Z  2025-03-14T06:29:47.6300052Z  2025-03-14T06:29:47.6300497Z  2025-03-14T06:29:47.6300908Z  2025-03-14T06:29:47.6301313Z  2025-03-14T06:29:47.6301722Z  2025-03-14T06:29:47.6302133Z  2025-03-14T06:29:47.6302538Z  2025-03-14T06:29:47.6303491Z [15,207 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:47.6305041Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T06:29:47.6306247Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T06:29:47.6307519Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T06:29:47.6308563Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T06:29:47.6309400Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2025-03-14T06:29:47.6310360Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T06:29:47.6311295Z Compiling xla/ffi/attribute_map.cc; 8s local 2025-03-14T06:29:47.6312230Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local ... 2025-03-14T06:29:47.8601328Z 2025-03-14T06:29:47.8602205Z  2025-03-14T06:29:47.8602717Z  2025-03-14T06:29:47.8603125Z  2025-03-14T06:29:47.8603534Z  2025-03-14T06:29:47.8603986Z  2025-03-14T06:29:47.8604417Z  2025-03-14T06:29:47.8604834Z  2025-03-14T06:29:47.8605464Z  2025-03-14T06:29:47.8606467Z [15,208 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:47.8607729Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T06:29:47.8608931Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T06:29:47.8610103Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T06:29:47.8611204Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T06:29:47.8611992Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2025-03-14T06:29:47.8612957Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T06:29:47.8613905Z Compiling xla/ffi/attribute_map.cc; 8s local 2025-03-14T06:29:47.8615093Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local ... 2025-03-14T06:29:48.1337946Z 2025-03-14T06:29:48.1338772Z  2025-03-14T06:29:48.1339286Z  2025-03-14T06:29:48.1339743Z  2025-03-14T06:29:48.1340155Z  2025-03-14T06:29:48.1340572Z  2025-03-14T06:29:48.1340997Z  2025-03-14T06:29:48.1341407Z  2025-03-14T06:29:48.1341796Z  2025-03-14T06:29:48.1342764Z [15,212 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:48.1343981Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T06:29:48.1345178Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 98s local 2025-03-14T06:29:48.1346328Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 98s local 2025-03-14T06:29:48.1347600Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T06:29:48.1348623Z Compiling .../coordination/grpc_coordination_service_impl.cc; 12s local 2025-03-14T06:29:48.1349699Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local 2025-03-14T06:29:48.1350657Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2025-03-14T06:29:48.1351494Z Compiling llvm/lib/AsmParser/LLParser.cpp; 6s local ... 2025-03-14T06:29:48.4608390Z 2025-03-14T06:29:48.4609268Z  2025-03-14T06:29:48.4609760Z  2025-03-14T06:29:48.4610183Z  2025-03-14T06:29:48.4610616Z  2025-03-14T06:29:48.4611018Z  2025-03-14T06:29:48.4611431Z  2025-03-14T06:29:48.4611841Z  2025-03-14T06:29:48.4612630Z  2025-03-14T06:29:48.4613596Z [15,214 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:48.4614808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T06:29:48.4615994Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T06:29:48.4617048Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:48.4618099Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T06:29:48.4619333Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2025-03-14T06:29:48.4620492Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2025-03-14T06:29:48.4621384Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:48.4622253Z Compiling llvm/lib/AsmParser/LLParser.cpp; 6s local ... 2025-03-14T06:29:48.6611435Z 2025-03-14T06:29:48.6612418Z  2025-03-14T06:29:48.6612970Z  2025-03-14T06:29:48.6613381Z  2025-03-14T06:29:48.6613774Z  2025-03-14T06:29:48.6614175Z  2025-03-14T06:29:48.6614572Z  2025-03-14T06:29:48.6614961Z  2025-03-14T06:29:48.6615406Z  2025-03-14T06:29:48.6616338Z [15,215 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:48.6617502Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T06:29:48.6618660Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T06:29:48.6619835Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:48.6620891Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T06:29:48.6621874Z Compiling .../coordination/grpc_coordination_service_impl.cc; 13s local 2025-03-14T06:29:48.6622936Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2025-03-14T06:29:48.6623869Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:48.6625311Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local ... 2025-03-14T06:29:48.9008440Z 2025-03-14T06:29:48.9009315Z  2025-03-14T06:29:48.9009844Z  2025-03-14T06:29:48.9010268Z  2025-03-14T06:29:48.9010683Z  2025-03-14T06:29:48.9011077Z  2025-03-14T06:29:48.9011580Z  2025-03-14T06:29:48.9011937Z  2025-03-14T06:29:48.9012300Z  2025-03-14T06:29:48.9013391Z [15,219 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:48.9014520Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T06:29:48.9015572Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T06:29:48.9016611Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:48.9017593Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T06:29:48.9018490Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2025-03-14T06:29:48.9019401Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:48.9020183Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2025-03-14T06:29:48.9021205Z Compiling mlir/lib/IR/SymbolTable.cpp; 6s local ... 2025-03-14T06:29:49.1321168Z 2025-03-14T06:29:49.1322048Z  2025-03-14T06:29:49.1322548Z  2025-03-14T06:29:49.1322959Z  2025-03-14T06:29:49.1323406Z  2025-03-14T06:29:49.1323827Z  2025-03-14T06:29:49.1324242Z  2025-03-14T06:29:49.1324652Z  2025-03-14T06:29:49.1325270Z  2025-03-14T06:29:49.1326237Z [15,224 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:49.1327444Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T06:29:49.1328567Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 99s local 2025-03-14T06:29:49.1330009Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:49.1331039Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T06:29:49.1332015Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2025-03-14T06:29:49.1332886Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:49.1333676Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2025-03-14T06:29:49.1334381Z Compiling xla/shape_util.cc; 5s local ... 2025-03-14T06:29:49.3434068Z 2025-03-14T06:29:49.3434944Z  2025-03-14T06:29:49.3435458Z  2025-03-14T06:29:49.3436112Z  2025-03-14T06:29:49.3436537Z  2025-03-14T06:29:49.3437003Z  2025-03-14T06:29:49.3437408Z  2025-03-14T06:29:49.3437815Z  2025-03-14T06:29:49.3438209Z  2025-03-14T06:29:49.3439164Z [15,225 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:49.3440410Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T06:29:49.3441613Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:29:49.3442885Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 99s local 2025-03-14T06:29:49.3443974Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T06:29:49.3445113Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local 2025-03-14T06:29:49.3446099Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:49.3446940Z Compiling llvm/lib/AsmParser/LLParser.cpp; 7s local 2025-03-14T06:29:49.3447522Z Compiling xla/shape_util.cc; 6s local ... 2025-03-14T06:29:49.5569678Z 2025-03-14T06:29:49.5570560Z  2025-03-14T06:29:49.5571088Z  2025-03-14T06:29:49.5571496Z  2025-03-14T06:29:49.5571890Z  2025-03-14T06:29:49.5572286Z  2025-03-14T06:29:49.5572664Z  2025-03-14T06:29:49.5573042Z  2025-03-14T06:29:49.5573488Z  2025-03-14T06:29:49.5574483Z [15,228 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:49.5575795Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T06:29:49.5577111Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:29:49.5578312Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T06:29:49.5579665Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T06:29:49.5580705Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2025-03-14T06:29:49.5581646Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T06:29:49.5582570Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2025-03-14T06:29:49.5583314Z Compiling xla/shape_util.cc; 6s local ... 2025-03-14T06:29:49.7999661Z 2025-03-14T06:29:49.8000609Z  2025-03-14T06:29:49.8001012Z  2025-03-14T06:29:49.8001486Z  2025-03-14T06:29:49.8001922Z  2025-03-14T06:29:49.8002339Z  2025-03-14T06:29:49.8002773Z  2025-03-14T06:29:49.8003199Z  2025-03-14T06:29:49.8003585Z  2025-03-14T06:29:49.8004595Z [15,229 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:49.8005820Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T06:29:49.8007062Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:29:49.8008227Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T06:29:49.8009237Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T06:29:49.8010139Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2025-03-14T06:29:49.8011063Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T06:29:49.8011923Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2025-03-14T06:29:49.8012914Z Compiling xla/shape_util.cc; 6s local ... 2025-03-14T06:29:50.0620931Z 2025-03-14T06:29:50.0621850Z  2025-03-14T06:29:50.0622326Z  2025-03-14T06:29:50.0622746Z  2025-03-14T06:29:50.0623148Z  2025-03-14T06:29:50.0623536Z  2025-03-14T06:29:50.0623945Z  2025-03-14T06:29:50.0624343Z  2025-03-14T06:29:50.0624792Z  2025-03-14T06:29:50.0625792Z [15,233 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:50.0627012Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T06:29:50.0628415Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 100s local 2025-03-14T06:29:50.0629645Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T06:29:50.0630681Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T06:29:50.0631643Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2025-03-14T06:29:50.0632612Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T06:29:50.0633435Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2025-03-14T06:29:50.0634213Z Compiling xla/shape_util.cc; 6s local ... 2025-03-14T06:29:50.3729768Z 2025-03-14T06:29:50.3730637Z  2025-03-14T06:29:50.3731135Z  2025-03-14T06:29:50.3731540Z  2025-03-14T06:29:50.3731960Z  2025-03-14T06:29:50.3732359Z  2025-03-14T06:29:50.3732814Z  2025-03-14T06:29:50.3733234Z  2025-03-14T06:29:50.3733628Z  2025-03-14T06:29:50.3734603Z [15,234 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:50.3735866Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T06:29:50.3737040Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T06:29:50.3738222Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 100s local 2025-03-14T06:29:50.3739324Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T06:29:50.3740323Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T06:29:50.3741324Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T06:29:50.3742176Z Compiling llvm/lib/AsmParser/LLParser.cpp; 8s local 2025-03-14T06:29:50.3742965Z Compiling xla/shape_util.cc; 7s local ... 2025-03-14T06:29:50.6628783Z 2025-03-14T06:29:50.6629958Z  2025-03-14T06:29:50.6630487Z  2025-03-14T06:29:50.6630894Z  2025-03-14T06:29:50.6631310Z  2025-03-14T06:29:50.6631753Z  2025-03-14T06:29:50.6632187Z  2025-03-14T06:29:50.6632607Z  2025-03-14T06:29:50.6633030Z  2025-03-14T06:29:50.6633994Z [15,234 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:50.6635258Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T06:29:50.6636537Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T06:29:50.6637797Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T06:29:50.6639098Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T06:29:50.6640055Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T06:29:50.6641013Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T06:29:50.6641907Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:50.6642703Z Compiling xla/shape_util.cc; 7s local ... 2025-03-14T06:29:50.8634259Z 2025-03-14T06:29:50.8635118Z  2025-03-14T06:29:50.8635615Z  2025-03-14T06:29:50.8636027Z  2025-03-14T06:29:50.8636447Z  2025-03-14T06:29:50.8636829Z  2025-03-14T06:29:50.8637225Z  2025-03-14T06:29:50.8637655Z  2025-03-14T06:29:50.8638082Z  2025-03-14T06:29:50.8639014Z [15,236 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:50.8640480Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T06:29:50.8641701Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T06:29:50.8642906Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T06:29:50.8643922Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T06:29:50.8645111Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T06:29:50.8646272Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T06:29:50.8647115Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:50.8647905Z Compiling xla/shape_util.cc; 7s local ... 2025-03-14T06:29:51.1174316Z 2025-03-14T06:29:51.1175334Z  2025-03-14T06:29:51.1175861Z  2025-03-14T06:29:51.1176287Z  2025-03-14T06:29:51.1176687Z  2025-03-14T06:29:51.1177165Z  2025-03-14T06:29:51.1177586Z  2025-03-14T06:29:51.1177953Z  2025-03-14T06:29:51.1178324Z  2025-03-14T06:29:51.1179234Z [15,238 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:51.1180452Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T06:29:51.1181506Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 101s local 2025-03-14T06:29:51.1182625Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T06:29:51.1183632Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T06:29:51.1184577Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T06:29:51.1185479Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T06:29:51.1186265Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:51.1186972Z Compiling xla/shape_util.cc; 7s local ... 2025-03-14T06:29:51.4037257Z 2025-03-14T06:29:51.4038168Z  2025-03-14T06:29:51.4038686Z  2025-03-14T06:29:51.4039128Z  2025-03-14T06:29:51.4039554Z  2025-03-14T06:29:51.4039995Z  2025-03-14T06:29:51.4040474Z  2025-03-14T06:29:51.4040857Z  2025-03-14T06:29:51.4041267Z  2025-03-14T06:29:51.4042189Z [15,240 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:51.4043599Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T06:29:51.4044965Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T06:29:51.4046136Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 101s local 2025-03-14T06:29:51.4047172Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T06:29:51.4048080Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:29:51.4049020Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:51.4049835Z Compiling llvm/lib/AsmParser/LLParser.cpp; 9s local 2025-03-14T06:29:51.4050541Z Compiling xla/shape_util.cc; 8s local ... 2025-03-14T06:29:51.6640216Z 2025-03-14T06:29:51.6641324Z  2025-03-14T06:29:51.6641807Z  2025-03-14T06:29:51.6642228Z  2025-03-14T06:29:51.6642625Z  2025-03-14T06:29:51.6643032Z  2025-03-14T06:29:51.6643461Z  2025-03-14T06:29:51.6643912Z  2025-03-14T06:29:51.6644344Z  2025-03-14T06:29:51.6645444Z [15,241 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:51.6646674Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T06:29:51.6647863Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T06:29:51.6649050Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T06:29:51.6650102Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T06:29:51.6651279Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:29:51.6652161Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:51.6652965Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T06:29:51.6653690Z Compiling xla/shape_util.cc; 8s local ... 2025-03-14T06:29:51.8643093Z 2025-03-14T06:29:51.8644045Z  2025-03-14T06:29:51.8644713Z  2025-03-14T06:29:51.8645157Z  2025-03-14T06:29:51.8645563Z  2025-03-14T06:29:51.8645973Z  2025-03-14T06:29:51.8646383Z  2025-03-14T06:29:51.8647041Z  2025-03-14T06:29:51.8647458Z  2025-03-14T06:29:51.8648453Z [15,242 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:51.8649718Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T06:29:51.8650928Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T06:29:51.8652290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T06:29:51.8653308Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T06:29:51.8654226Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:29:51.8655189Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:51.8656050Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T06:29:51.8656815Z Compiling xla/shape_util.cc; 8s local ... 2025-03-14T06:29:52.1886400Z 2025-03-14T06:29:52.1887390Z  2025-03-14T06:29:52.1887970Z  2025-03-14T06:29:52.1888409Z  2025-03-14T06:29:52.1888864Z  2025-03-14T06:29:52.1889297Z  2025-03-14T06:29:52.1889695Z  2025-03-14T06:29:52.1890052Z  2025-03-14T06:29:52.1890429Z  2025-03-14T06:29:52.1891361Z [15,244 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:52.1892574Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T06:29:52.1893758Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 102s local 2025-03-14T06:29:52.1894952Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T06:29:52.1895974Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T06:29:52.1897170Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:29:52.1898131Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:52.1898981Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T06:29:52.1899743Z Compiling xla/shape_util.cc; 8s local ... 2025-03-14T06:29:52.3978442Z 2025-03-14T06:29:52.3979356Z  2025-03-14T06:29:52.3979877Z  2025-03-14T06:29:52.3980309Z  2025-03-14T06:29:52.3980744Z  2025-03-14T06:29:52.3981159Z  2025-03-14T06:29:52.3981613Z  2025-03-14T06:29:52.3982176Z  2025-03-14T06:29:52.3982580Z  2025-03-14T06:29:52.3983584Z [15,247 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:52.3985104Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T06:29:52.3986333Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:29:52.3987607Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 102s local 2025-03-14T06:29:52.3988711Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T06:29:52.3989748Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T06:29:52.3990663Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:52.3991496Z Compiling llvm/lib/AsmParser/LLParser.cpp; 10s local 2025-03-14T06:29:52.3992292Z Compiling xla/shape_util.cc; 9s local ... 2025-03-14T06:29:52.6110253Z 2025-03-14T06:29:52.6111167Z  2025-03-14T06:29:52.6111984Z  2025-03-14T06:29:52.6112404Z  2025-03-14T06:29:52.6112855Z  2025-03-14T06:29:52.6113291Z  2025-03-14T06:29:52.6113666Z  2025-03-14T06:29:52.6114060Z  2025-03-14T06:29:52.6114473Z  2025-03-14T06:29:52.6115424Z [15,250 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:52.6116584Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T06:29:52.6117717Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:29:52.6118994Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T06:29:52.6120013Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T06:29:52.6121145Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T06:29:52.6122055Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T06:29:52.6122877Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T06:29:52.6123652Z Compiling xla/shape_util.cc; 9s local ... 2025-03-14T06:29:52.8652813Z 2025-03-14T06:29:52.8653772Z  2025-03-14T06:29:52.8654303Z  2025-03-14T06:29:52.8654794Z  2025-03-14T06:29:52.8655225Z  2025-03-14T06:29:52.8655666Z  2025-03-14T06:29:52.8656113Z  2025-03-14T06:29:52.8656524Z  2025-03-14T06:29:52.8656932Z  2025-03-14T06:29:52.8657907Z [15,251 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:52.8659164Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T06:29:52.8660376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:29:52.8661537Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T06:29:52.8662705Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T06:29:52.8663656Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T06:29:52.8664634Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T06:29:52.8665763Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T06:29:52.8666564Z Compiling xla/shape_util.cc; 9s local ... 2025-03-14T06:29:53.1066572Z 2025-03-14T06:29:53.1067422Z  2025-03-14T06:29:53.1067879Z  2025-03-14T06:29:53.1068277Z  2025-03-14T06:29:53.1068675Z  2025-03-14T06:29:53.1069338Z  2025-03-14T06:29:53.1069736Z  2025-03-14T06:29:53.1070132Z  2025-03-14T06:29:53.1070528Z  2025-03-14T06:29:53.1071475Z [15,252 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:53.1072679Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T06:29:53.1073759Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 103s local 2025-03-14T06:29:53.1074895Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 103s local 2025-03-14T06:29:53.1075929Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:29:53.1076763Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T06:29:53.1077806Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T06:29:53.1078550Z Compiling xla/shape_util.cc; 9s local 2025-03-14T06:29:53.1079231Z Compiling llvm/lib/IR/Constants.cpp; 9s local ... 2025-03-14T06:29:53.4461224Z 2025-03-14T06:29:53.4462268Z  2025-03-14T06:29:53.4462836Z  2025-03-14T06:29:53.4463268Z  2025-03-14T06:29:53.4463685Z  2025-03-14T06:29:53.4464098Z  2025-03-14T06:29:53.4464518Z  2025-03-14T06:29:53.4464944Z  2025-03-14T06:29:53.4465604Z  2025-03-14T06:29:53.4466630Z [15,255 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:53.4467897Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T06:29:53.4469295Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:29:53.4470500Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T06:29:53.4471598Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:29:53.4472502Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T06:29:53.4473361Z Compiling llvm/lib/AsmParser/LLParser.cpp; 11s local 2025-03-14T06:29:53.4474171Z Compiling xla/shape_util.cc; 10s local 2025-03-14T06:29:53.4474943Z Compiling llvm/lib/IR/Constants.cpp; 9s local ... 2025-03-14T06:29:53.6577089Z 2025-03-14T06:29:53.6578072Z  2025-03-14T06:29:53.6578575Z  2025-03-14T06:29:53.6578947Z  2025-03-14T06:29:53.6579325Z  2025-03-14T06:29:53.6579687Z  2025-03-14T06:29:53.6580031Z  2025-03-14T06:29:53.6580397Z  2025-03-14T06:29:53.6580792Z  2025-03-14T06:29:53.6581658Z [15,266 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:53.6582738Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T06:29:53.6583877Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:29:53.6584966Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T06:29:53.6585923Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:29:53.6586789Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T06:29:53.6587646Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:53.6588286Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2025-03-14T06:29:53.6588956Z Compiling llvm/lib/IR/Core.cpp; 9s local ... 2025-03-14T06:29:53.8660989Z 2025-03-14T06:29:53.8661839Z  2025-03-14T06:29:53.8662321Z  2025-03-14T06:29:53.8662731Z  2025-03-14T06:29:53.8663177Z  2025-03-14T06:29:53.8663606Z  2025-03-14T06:29:53.8664006Z  2025-03-14T06:29:53.8664413Z  2025-03-14T06:29:53.8664813Z  2025-03-14T06:29:53.8666038Z [15,277 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:53.8667218Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T06:29:53.8668391Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:29:53.8669783Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T06:29:53.8670861Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:29:53.8671705Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T06:29:53.8672539Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:53.8673338Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2025-03-14T06:29:53.8674045Z Compiling llvm/lib/IR/Core.cpp; 9s local ... 2025-03-14T06:29:54.0828368Z 2025-03-14T06:29:54.0829328Z  2025-03-14T06:29:54.0829834Z  2025-03-14T06:29:54.0830262Z  2025-03-14T06:29:54.0830688Z  2025-03-14T06:29:54.0831128Z  2025-03-14T06:29:54.0831518Z  2025-03-14T06:29:54.0834339Z  2025-03-14T06:29:54.0834780Z  2025-03-14T06:29:54.0835745Z [15,290 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:54.0837015Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T06:29:54.0838298Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 104s local 2025-03-14T06:29:54.0839447Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 104s local 2025-03-14T06:29:54.0840413Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T06:29:54.0841223Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T06:29:54.0841962Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:54.0842888Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:29:54.0843757Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 7s local ... 2025-03-14T06:29:54.4429461Z 2025-03-14T06:29:54.4430343Z  2025-03-14T06:29:54.4430852Z  2025-03-14T06:29:54.4431294Z  2025-03-14T06:29:54.4431767Z  2025-03-14T06:29:54.4432166Z  2025-03-14T06:29:54.4432596Z  2025-03-14T06:29:54.4433010Z  2025-03-14T06:29:54.4433445Z  2025-03-14T06:29:54.4434442Z [15,294 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:54.4435940Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T06:29:54.4437231Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T06:29:54.4438494Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T06:29:54.4439602Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T06:29:54.4440518Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T06:29:54.4441428Z Compiling llvm/lib/AsmParser/LLParser.cpp; 12s local 2025-03-14T06:29:54.4442279Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:29:54.4443263Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 7s local ... 2025-03-14T06:29:54.6671760Z 2025-03-14T06:29:54.6672656Z  2025-03-14T06:29:54.6673177Z  2025-03-14T06:29:54.6673670Z  2025-03-14T06:29:54.6674096Z  2025-03-14T06:29:54.6674501Z  2025-03-14T06:29:54.6674877Z  2025-03-14T06:29:54.6675299Z  2025-03-14T06:29:54.6675729Z  2025-03-14T06:29:54.6676728Z [15,298 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:54.6677872Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T06:29:54.6679046Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T06:29:54.6680238Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T06:29:54.6681208Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T06:29:54.6682057Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T06:29:54.6682849Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T06:29:54.6683626Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:29:54.6684974Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 7s local ... 2025-03-14T06:29:54.8675498Z 2025-03-14T06:29:54.8676369Z  2025-03-14T06:29:54.8676890Z  2025-03-14T06:29:54.8677307Z  2025-03-14T06:29:54.8677710Z  2025-03-14T06:29:54.8678125Z  2025-03-14T06:29:54.8678532Z  2025-03-14T06:29:54.8678942Z  2025-03-14T06:29:54.8679347Z  2025-03-14T06:29:54.8680300Z [15,299 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:54.8681483Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:29:54.8682620Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T06:29:54.8684086Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T06:29:54.8685264Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T06:29:54.8686053Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T06:29:54.8686858Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T06:29:54.8687615Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:29:54.8688565Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local ... 2025-03-14T06:29:55.1130920Z 2025-03-14T06:29:55.1131776Z  2025-03-14T06:29:55.1132270Z  2025-03-14T06:29:55.1132717Z  2025-03-14T06:29:55.1133237Z  2025-03-14T06:29:55.1133789Z  2025-03-14T06:29:55.1134180Z  2025-03-14T06:29:55.1134952Z  2025-03-14T06:29:55.1135375Z  2025-03-14T06:29:55.1136810Z [15,301 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:55.1138228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:29:55.1139556Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 105s local 2025-03-14T06:29:55.1140865Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 105s local 2025-03-14T06:29:55.1142022Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T06:29:55.1143194Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T06:29:55.1144161Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T06:29:55.1145050Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T06:29:55.1146045Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local ... 2025-03-14T06:29:55.4672436Z 2025-03-14T06:29:55.4673326Z  2025-03-14T06:29:55.4674025Z  2025-03-14T06:29:55.4674477Z  2025-03-14T06:29:55.4674929Z  2025-03-14T06:29:55.4675367Z  2025-03-14T06:29:55.4675814Z  2025-03-14T06:29:55.4676264Z  2025-03-14T06:29:55.4676659Z  2025-03-14T06:29:55.4677620Z [15,303 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:55.4678821Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:29:55.4679985Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T06:29:55.4681157Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T06:29:55.4682218Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T06:29:55.4683074Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T06:29:55.4683903Z Compiling llvm/lib/AsmParser/LLParser.cpp; 13s local 2025-03-14T06:29:55.4684855Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T06:29:55.4685772Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local ... 2025-03-14T06:29:55.6771794Z 2025-03-14T06:29:55.6772671Z  2025-03-14T06:29:55.6773242Z  2025-03-14T06:29:55.6773682Z  2025-03-14T06:29:55.6774113Z  2025-03-14T06:29:55.6774531Z  2025-03-14T06:29:55.6774961Z  2025-03-14T06:29:55.6775401Z  2025-03-14T06:29:55.6787322Z  2025-03-14T06:29:55.6788624Z [15,304 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:55.6789893Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:29:55.6791076Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T06:29:55.6792174Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T06:29:55.6793192Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T06:29:55.6794032Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T06:29:55.6794860Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T06:29:55.6795752Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local 2025-03-14T06:29:55.6797046Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local ... 2025-03-14T06:29:56.0682050Z 2025-03-14T06:29:56.0682949Z  2025-03-14T06:29:56.0683508Z  2025-03-14T06:29:56.0683952Z  2025-03-14T06:29:56.0684523Z  2025-03-14T06:29:56.0684957Z  2025-03-14T06:29:56.0685411Z  2025-03-14T06:29:56.0685850Z  2025-03-14T06:29:56.0686391Z  2025-03-14T06:29:56.0687345Z [15,304 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:56.0688493Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T06:29:56.0689636Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 106s local 2025-03-14T06:29:56.0690977Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 106s local 2025-03-14T06:29:56.0691909Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2025-03-14T06:29:56.0692822Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T06:29:56.0693753Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T06:29:56.0694578Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2025-03-14T06:29:56.0695510Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 8s local ... 2025-03-14T06:29:56.4189991Z 2025-03-14T06:29:56.4191986Z  2025-03-14T06:29:56.4192485Z  2025-03-14T06:29:56.4193155Z  2025-03-14T06:29:56.4193611Z  2025-03-14T06:29:56.4193999Z  2025-03-14T06:29:56.4194402Z  2025-03-14T06:29:56.4194797Z  2025-03-14T06:29:56.4195187Z  2025-03-14T06:29:56.4196130Z [15,306 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:56.4197337Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T06:29:56.4198493Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:29:56.4199690Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T06:29:56.4200735Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2025-03-14T06:29:56.4201569Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T06:29:56.4202394Z Compiling llvm/lib/AsmParser/LLParser.cpp; 14s local 2025-03-14T06:29:56.4203295Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2025-03-14T06:29:56.4204331Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local ... 2025-03-14T06:29:56.6693440Z 2025-03-14T06:29:56.6694241Z  2025-03-14T06:29:56.6694701Z  2025-03-14T06:29:56.6695100Z  2025-03-14T06:29:56.6695490Z  2025-03-14T06:29:56.6695874Z  2025-03-14T06:29:56.6696278Z  2025-03-14T06:29:56.6696735Z  2025-03-14T06:29:56.6697082Z  2025-03-14T06:29:56.6697951Z [15,308 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:56.6699069Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T06:29:56.6700083Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:29:56.6701347Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T06:29:56.6702318Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2025-03-14T06:29:56.6703145Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T06:29:56.6703867Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T06:29:56.6704631Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2025-03-14T06:29:56.6705558Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local ... 2025-03-14T06:29:56.8697743Z 2025-03-14T06:29:56.8698796Z  2025-03-14T06:29:56.8699314Z  2025-03-14T06:29:56.8699751Z  2025-03-14T06:29:56.8700189Z  2025-03-14T06:29:56.8700607Z  2025-03-14T06:29:56.8701035Z  2025-03-14T06:29:56.8701762Z  2025-03-14T06:29:56.8702201Z  2025-03-14T06:29:56.8703221Z [15,311 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:56.8704472Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T06:29:56.8705724Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:29:56.8706955Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T06:29:56.8707972Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T06:29:56.8708827Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T06:29:56.8709793Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T06:29:56.8711035Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2025-03-14T06:29:56.8711998Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 9s local ... 2025-03-14T06:29:57.1386051Z 2025-03-14T06:29:57.1386959Z  2025-03-14T06:29:57.1387487Z  2025-03-14T06:29:57.1387938Z  2025-03-14T06:29:57.1388354Z  2025-03-14T06:29:57.1388761Z  2025-03-14T06:29:57.1389167Z  2025-03-14T06:29:57.1389582Z  2025-03-14T06:29:57.1389992Z  2025-03-14T06:29:57.1390984Z [15,316 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:57.1392439Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T06:29:57.1393636Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 107s local 2025-03-14T06:29:57.1394808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 107s local 2025-03-14T06:29:57.1395872Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T06:29:57.1396700Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T06:29:57.1397614Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T06:29:57.1398613Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 9s local 2025-03-14T06:29:57.1399556Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 9s local ... 2025-03-14T06:29:57.4703361Z 2025-03-14T06:29:57.4704218Z  2025-03-14T06:29:57.4704715Z  2025-03-14T06:29:57.4705157Z  2025-03-14T06:29:57.4705583Z  2025-03-14T06:29:57.4706006Z  2025-03-14T06:29:57.4706418Z  2025-03-14T06:29:57.4706849Z  2025-03-14T06:29:57.4707269Z  2025-03-14T06:29:57.4708228Z [15,317 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:57.4709467Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T06:29:57.4710647Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T06:29:57.4711831Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:57.4712852Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T06:29:57.4713667Z Compiling llvm/lib/AsmParser/LLParser.cpp; 15s local 2025-03-14T06:29:57.4714576Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T06:29:57.4715607Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T06:29:57.4716878Z @llvm-project//mlir:mlir-linalg-ods-yaml-gen; 9s local ... 2025-03-14T06:29:57.7477204Z 2025-03-14T06:29:57.7478068Z  2025-03-14T06:29:57.7478572Z  2025-03-14T06:29:57.7478970Z  2025-03-14T06:29:57.7479370Z  2025-03-14T06:29:57.7479756Z  2025-03-14T06:29:57.7480145Z  2025-03-14T06:29:57.7480547Z  2025-03-14T06:29:57.7480960Z  2025-03-14T06:29:57.7481887Z [15,318 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:57.7483028Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T06:29:57.7484040Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T06:29:57.7485537Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:57.7486496Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T06:29:57.7487267Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T06:29:57.7488169Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T06:29:57.7489202Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T06:29:57.7490193Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 9s local ... 2025-03-14T06:29:58.0709821Z 2025-03-14T06:29:58.0710648Z  2025-03-14T06:29:58.0711143Z  2025-03-14T06:29:58.0711560Z  2025-03-14T06:29:58.0711979Z  2025-03-14T06:29:58.0712516Z  2025-03-14T06:29:58.0713262Z  2025-03-14T06:29:58.0713663Z  2025-03-14T06:29:58.0714087Z  2025-03-14T06:29:58.0715052Z [15,322 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:58.0716302Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T06:29:58.0717427Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T06:29:58.0718633Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:58.0719669Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T06:29:58.0720718Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T06:29:58.0721623Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T06:29:58.0722675Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T06:29:58.0723753Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local ... 2025-03-14T06:29:58.2714227Z 2025-03-14T06:29:58.2715099Z  2025-03-14T06:29:58.2715717Z  2025-03-14T06:29:58.2716152Z  2025-03-14T06:29:58.2716554Z  2025-03-14T06:29:58.2716972Z  2025-03-14T06:29:58.2717516Z  2025-03-14T06:29:58.2718003Z  2025-03-14T06:29:58.2718399Z  2025-03-14T06:29:58.2719264Z [15,323 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:58.2720422Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T06:29:58.2721561Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 108s local 2025-03-14T06:29:58.2722715Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 108s local 2025-03-14T06:29:58.2723782Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T06:29:58.2724860Z Compiling llvm/lib/AsmParser/LLParser.cpp; 16s local 2025-03-14T06:29:58.2725655Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T06:29:58.2726682Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 10s local 2025-03-14T06:29:58.2727763Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local ... 2025-03-14T06:29:58.5104790Z 2025-03-14T06:29:58.5105588Z  2025-03-14T06:29:58.5106019Z  2025-03-14T06:29:58.5106356Z  2025-03-14T06:29:58.5106735Z  2025-03-14T06:29:58.5107139Z  2025-03-14T06:29:58.5107524Z  2025-03-14T06:29:58.5108168Z  2025-03-14T06:29:58.5108576Z  2025-03-14T06:29:58.5109531Z [15,324 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:58.5110754Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T06:29:58.5111957Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T06:29:58.5113152Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T06:29:58.5114205Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T06:29:58.5114998Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T06:29:58.5115792Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T06:29:58.5116980Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T06:29:58.5118036Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local ... 2025-03-14T06:29:58.8720864Z 2025-03-14T06:29:58.8721751Z  2025-03-14T06:29:58.8722260Z  2025-03-14T06:29:58.8722689Z  2025-03-14T06:29:58.8723103Z  2025-03-14T06:29:58.8723529Z  2025-03-14T06:29:58.8723952Z  2025-03-14T06:29:58.8724349Z  2025-03-14T06:29:58.8724935Z  2025-03-14T06:29:58.8725888Z [15,326 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:58.8727140Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T06:29:58.8728620Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T06:29:58.8729815Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T06:29:58.8730854Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T06:29:58.8731709Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T06:29:58.8732639Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:29:58.8733717Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T06:29:58.8735022Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local ... 2025-03-14T06:29:59.0725307Z 2025-03-14T06:29:59.0726166Z  2025-03-14T06:29:59.0726655Z  2025-03-14T06:29:59.0727083Z  2025-03-14T06:29:59.0727509Z  2025-03-14T06:29:59.0727912Z  2025-03-14T06:29:59.0728293Z  2025-03-14T06:29:59.0728668Z  2025-03-14T06:29:59.0729052Z  2025-03-14T06:29:59.0730053Z [15,330 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:29:59.0731349Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T06:29:59.0732572Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T06:29:59.0733793Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T06:29:59.0734893Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T06:29:59.0735766Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T06:29:59.0736674Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:29:59.0737643Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T06:29:59.0738717Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local ... 2025-03-14T06:29:59.2784602Z 2025-03-14T06:29:59.2785436Z  2025-03-14T06:29:59.2785952Z  2025-03-14T06:29:59.2786412Z  2025-03-14T06:29:59.2786829Z  2025-03-14T06:29:59.2787253Z  2025-03-14T06:29:59.2787651Z  2025-03-14T06:29:59.2788058Z  2025-03-14T06:29:59.2788468Z  2025-03-14T06:29:59.2789413Z [15,333 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:59.2790510Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T06:29:59.2791798Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 109s local 2025-03-14T06:29:59.2792980Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 109s local 2025-03-14T06:29:59.2793930Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T06:29:59.2794722Z Compiling llvm/lib/AsmParser/LLParser.cpp; 17s local 2025-03-14T06:29:59.2795638Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:29:59.2796611Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 11s local 2025-03-14T06:29:59.2797673Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local ... 2025-03-14T06:29:59.5111413Z 2025-03-14T06:29:59.5112293Z  2025-03-14T06:29:59.5112778Z  2025-03-14T06:29:59.5113425Z  2025-03-14T06:29:59.5113802Z  2025-03-14T06:29:59.5114204Z  2025-03-14T06:29:59.5114603Z  2025-03-14T06:29:59.5115002Z  2025-03-14T06:29:59.5115395Z  2025-03-14T06:29:59.5116333Z [15,334 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:59.5117334Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T06:29:59.5118456Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T06:29:59.5119608Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T06:29:59.5120647Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T06:29:59.5121452Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T06:29:59.5122660Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:29:59.5123674Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:29:59.5124901Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local ... 2025-03-14T06:29:59.7548379Z 2025-03-14T06:29:59.7549171Z  2025-03-14T06:29:59.7549598Z  2025-03-14T06:29:59.7549971Z  2025-03-14T06:29:59.7550369Z  2025-03-14T06:29:59.7550729Z  2025-03-14T06:29:59.7551083Z  2025-03-14T06:29:59.7551445Z  2025-03-14T06:29:59.7552034Z  2025-03-14T06:29:59.7552864Z [15,337 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:29:59.7553883Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 130s local 2025-03-14T06:29:59.7554901Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T06:29:59.7555926Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T06:29:59.7556839Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T06:29:59.7557583Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T06:29:59.7558357Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:29:59.7559192Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:29:59.7560124Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local ... 2025-03-14T06:30:00.0733983Z 2025-03-14T06:30:00.0734877Z  2025-03-14T06:30:00.0735391Z  2025-03-14T06:30:00.0735796Z  2025-03-14T06:30:00.0736201Z  2025-03-14T06:30:00.0736585Z  2025-03-14T06:30:00.0736977Z  2025-03-14T06:30:00.0737366Z  2025-03-14T06:30:00.0737766Z  2025-03-14T06:30:00.0738738Z [15,341 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:00.0739955Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T06:30:00.0741123Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T06:30:00.0742088Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T06:30:00.0742858Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T06:30:00.0743679Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T06:30:00.0744886Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:30:00.0745963Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2025-03-14T06:30:00.0746916Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local ... 2025-03-14T06:30:00.2760388Z 2025-03-14T06:30:00.2761164Z  2025-03-14T06:30:00.2761643Z  2025-03-14T06:30:00.2762032Z  2025-03-14T06:30:00.2762439Z  2025-03-14T06:30:00.2762823Z  2025-03-14T06:30:00.2763227Z  2025-03-14T06:30:00.2763650Z  2025-03-14T06:30:00.2764019Z  2025-03-14T06:30:00.2765113Z [15,344 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:00.2766743Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 110s local 2025-03-14T06:30:00.2767850Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 110s local 2025-03-14T06:30:00.2768809Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T06:30:00.2769578Z Compiling llvm/lib/AsmParser/LLParser.cpp; 18s local 2025-03-14T06:30:00.2770409Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T06:30:00.2771350Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 12s local 2025-03-14T06:30:00.2772323Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2025-03-14T06:30:00.2773367Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local ... 2025-03-14T06:30:00.6741172Z 2025-03-14T06:30:00.6742235Z  2025-03-14T06:30:00.6742752Z  2025-03-14T06:30:00.6743160Z  2025-03-14T06:30:00.6743561Z  2025-03-14T06:30:00.6743971Z  2025-03-14T06:30:00.6744365Z  2025-03-14T06:30:00.6744789Z  2025-03-14T06:30:00.6745178Z  2025-03-14T06:30:00.6746146Z [15,347 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:00.6747352Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T06:30:00.6748494Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2025-03-14T06:30:00.6749665Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T06:30:00.6750485Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T06:30:00.6751401Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T06:30:00.6752400Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T06:30:00.6753402Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local 2025-03-14T06:30:00.6754441Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 10s local ... 2025-03-14T06:30:01.1249740Z 2025-03-14T06:30:01.1250600Z  2025-03-14T06:30:01.1251144Z  2025-03-14T06:30:01.1251551Z  2025-03-14T06:30:01.1251951Z  2025-03-14T06:30:01.1252370Z  2025-03-14T06:30:01.1252761Z  2025-03-14T06:30:01.1253171Z  2025-03-14T06:30:01.1253571Z  2025-03-14T06:30:01.1254502Z [15,348 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:01.1255705Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 111s local 2025-03-14T06:30:01.1256919Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 111s local 2025-03-14T06:30:01.1258012Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T06:30:01.1258836Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T06:30:01.1259723Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T06:30:01.1260763Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 13s local 2025-03-14T06:30:01.1261794Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T06:30:01.1262873Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local ... 2025-03-14T06:30:01.4748502Z 2025-03-14T06:30:01.4749341Z  2025-03-14T06:30:01.4749847Z  2025-03-14T06:30:01.4750502Z  2025-03-14T06:30:01.4750937Z  2025-03-14T06:30:01.4751363Z  2025-03-14T06:30:01.4751790Z  2025-03-14T06:30:01.4752236Z  2025-03-14T06:30:01.4752670Z  2025-03-14T06:30:01.4753673Z [15,348 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:01.4754988Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T06:30:01.4756214Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T06:30:01.4757240Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T06:30:01.4758115Z Compiling llvm/lib/AsmParser/LLParser.cpp; 19s local 2025-03-14T06:30:01.4759287Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T06:30:01.4760374Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T06:30:01.4761463Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T06:30:01.4762606Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local ... 2025-03-14T06:30:01.8746720Z 2025-03-14T06:30:01.8747625Z  2025-03-14T06:30:01.8748123Z  2025-03-14T06:30:01.8748544Z  2025-03-14T06:30:01.8748961Z  2025-03-14T06:30:01.8749381Z  2025-03-14T06:30:01.8749773Z  2025-03-14T06:30:01.8750139Z  2025-03-14T06:30:01.8750490Z  2025-03-14T06:30:01.8751359Z [15,349 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:01.8752774Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T06:30:01.8753983Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T06:30:01.8755041Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T06:30:01.8755910Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T06:30:01.8756827Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T06:30:01.8757848Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T06:30:01.8758981Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T06:30:01.8760003Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 11s local ... 2025-03-14T06:30:02.0754857Z 2025-03-14T06:30:02.0755674Z  2025-03-14T06:30:02.0756159Z  2025-03-14T06:30:02.0756565Z  2025-03-14T06:30:02.0757011Z  2025-03-14T06:30:02.0757480Z  2025-03-14T06:30:02.0757845Z  2025-03-14T06:30:02.0758226Z  2025-03-14T06:30:02.0758590Z  2025-03-14T06:30:02.0759519Z [15,352 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:02.0760659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 112s local 2025-03-14T06:30:02.0761959Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 112s local 2025-03-14T06:30:02.0762915Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T06:30:02.0763799Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T06:30:02.0764920Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T06:30:02.0766099Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 14s local 2025-03-14T06:30:02.0767181Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T06:30:02.0768340Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local ... 2025-03-14T06:30:02.4760826Z 2025-03-14T06:30:02.4761627Z  2025-03-14T06:30:02.4762139Z  2025-03-14T06:30:02.4762574Z  2025-03-14T06:30:02.4762993Z  2025-03-14T06:30:02.4763436Z  2025-03-14T06:30:02.4763836Z  2025-03-14T06:30:02.4764252Z  2025-03-14T06:30:02.4764803Z  2025-03-14T06:30:02.4766032Z [15,355 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:02.4767593Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T06:30:02.4768808Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T06:30:02.4769805Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T06:30:02.4770633Z Compiling llvm/lib/AsmParser/LLParser.cpp; 20s local 2025-03-14T06:30:02.4771566Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T06:30:02.4772632Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T06:30:02.4773714Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T06:30:02.4774844Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local ... 2025-03-14T06:30:02.6764691Z 2025-03-14T06:30:02.6765679Z  2025-03-14T06:30:02.6766213Z  2025-03-14T06:30:02.6766608Z  2025-03-14T06:30:02.6767011Z  2025-03-14T06:30:02.6767421Z  2025-03-14T06:30:02.6767848Z  2025-03-14T06:30:02.6768298Z  2025-03-14T06:30:02.6768719Z  2025-03-14T06:30:02.6769667Z [15,357 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:02.6771067Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T06:30:02.6772276Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T06:30:02.6773334Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T06:30:02.6774422Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T06:30:02.6775391Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T06:30:02.6776444Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T06:30:02.6777562Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T06:30:02.6778681Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 12s local ... 2025-03-14T06:30:03.0770546Z 2025-03-14T06:30:03.0771414Z  2025-03-14T06:30:03.0771907Z  2025-03-14T06:30:03.0772350Z  2025-03-14T06:30:03.0772784Z  2025-03-14T06:30:03.0773433Z  2025-03-14T06:30:03.0773843Z  2025-03-14T06:30:03.0774275Z  2025-03-14T06:30:03.0774711Z  2025-03-14T06:30:03.0775714Z [15,362 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:03.0776997Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T06:30:03.0778269Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T06:30:03.0779296Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T06:30:03.0780175Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T06:30:03.0781175Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T06:30:03.0782236Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T06:30:03.0783332Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T06:30:03.0784427Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local ... 2025-03-14T06:30:03.2774571Z 2025-03-14T06:30:03.2775378Z  2025-03-14T06:30:03.2775900Z  2025-03-14T06:30:03.2776350Z  2025-03-14T06:30:03.2776785Z  2025-03-14T06:30:03.2777216Z  2025-03-14T06:30:03.2777642Z  2025-03-14T06:30:03.2778066Z  2025-03-14T06:30:03.2778482Z  2025-03-14T06:30:03.2779511Z [15,364 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:03.2780791Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 113s local 2025-03-14T06:30:03.2782019Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 113s local 2025-03-14T06:30:03.2783084Z Compiling llvm/lib/AsmParser/LLParser.cpp; 21s local 2025-03-14T06:30:03.2784301Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T06:30:03.2785373Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 15s local 2025-03-14T06:30:03.2786492Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T06:30:03.2787623Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T06:30:03.2788622Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local ... 2025-03-14T06:30:03.4975927Z 2025-03-14T06:30:03.4976985Z  2025-03-14T06:30:03.4977478Z  2025-03-14T06:30:03.4977921Z  2025-03-14T06:30:03.4978398Z  2025-03-14T06:30:03.4978834Z  2025-03-14T06:30:03.4979260Z  2025-03-14T06:30:03.4979697Z  2025-03-14T06:30:03.4980127Z  2025-03-14T06:30:03.4981094Z [15,369 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:03.4982587Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:30:03.4983796Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T06:30:03.4984867Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T06:30:03.4985879Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T06:30:03.4986988Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T06:30:03.4988113Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T06:30:03.4989253Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T06:30:03.4990415Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local ... 2025-03-14T06:30:03.7272998Z 2025-03-14T06:30:03.7273850Z  2025-03-14T06:30:03.7274370Z  2025-03-14T06:30:03.7274782Z  2025-03-14T06:30:03.7275234Z  2025-03-14T06:30:03.7275645Z  2025-03-14T06:30:03.7276061Z  2025-03-14T06:30:03.7276473Z  2025-03-14T06:30:03.7276878Z  2025-03-14T06:30:03.7277874Z [15,371 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:03.7279136Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:30:03.7281953Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T06:30:03.7283153Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T06:30:03.7284104Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T06:30:03.7285289Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T06:30:03.7286238Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T06:30:03.7287547Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 13s local 2025-03-14T06:30:03.7288566Z Compiling mlir/lib/AsmParser/Parser.cpp; 11s local ... 2025-03-14T06:30:04.0779872Z 2025-03-14T06:30:04.0781207Z  2025-03-14T06:30:04.0781737Z  2025-03-14T06:30:04.0782174Z  2025-03-14T06:30:04.0782589Z  2025-03-14T06:30:04.0783015Z  2025-03-14T06:30:04.0783372Z  2025-03-14T06:30:04.0783776Z  2025-03-14T06:30:04.0784188Z  2025-03-14T06:30:04.0785140Z [15,374 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:04.0786341Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:30:04.0787522Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T06:30:04.0788493Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T06:30:04.0789393Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T06:30:04.0790401Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T06:30:04.0791410Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T06:30:04.0792444Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T06:30:04.0793726Z Compiling mlir/lib/Bytecode/Reader/BytecodeReader.cpp; 10s local ... 2025-03-14T06:30:04.2783403Z 2025-03-14T06:30:04.2784373Z  2025-03-14T06:30:04.2784889Z  2025-03-14T06:30:04.2785340Z  2025-03-14T06:30:04.2785778Z  2025-03-14T06:30:04.2786219Z  2025-03-14T06:30:04.2786645Z  2025-03-14T06:30:04.2787069Z  2025-03-14T06:30:04.2787497Z  2025-03-14T06:30:04.2788461Z [15,376 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:04.2789677Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 114s local 2025-03-14T06:30:04.2790942Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 114s local 2025-03-14T06:30:04.2792001Z Compiling llvm/lib/AsmParser/LLParser.cpp; 22s local 2025-03-14T06:30:04.2793244Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T06:30:04.2794324Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 16s local 2025-03-14T06:30:04.2795433Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T06:30:04.2796568Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T06:30:04.2797554Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2025-03-14T06:30:04.5228729Z 2025-03-14T06:30:04.5230046Z  2025-03-14T06:30:04.5230516Z  2025-03-14T06:30:04.5230880Z  2025-03-14T06:30:04.5231274Z  2025-03-14T06:30:04.5231672Z  2025-03-14T06:30:04.5232066Z  2025-03-14T06:30:04.5232462Z  2025-03-14T06:30:04.5233145Z  2025-03-14T06:30:04.5234080Z [15,380 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:04.5235232Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:30:04.5236387Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T06:30:04.5237452Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T06:30:04.5238321Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T06:30:04.5239442Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T06:30:04.5240370Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T06:30:04.5241298Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T06:30:04.5242143Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2025-03-14T06:30:04.7533679Z 2025-03-14T06:30:04.7534937Z  2025-03-14T06:30:04.7535449Z  2025-03-14T06:30:04.7535880Z  2025-03-14T06:30:04.7536273Z  2025-03-14T06:30:04.7536644Z  2025-03-14T06:30:04.7537065Z  2025-03-14T06:30:04.7537429Z  2025-03-14T06:30:04.7537797Z  2025-03-14T06:30:04.7538726Z [15,381 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:04.7539867Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:30:04.7541118Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T06:30:04.7542217Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T06:30:04.7543357Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T06:30:04.7544504Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T06:30:04.7545665Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T06:30:04.7546849Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 14s local 2025-03-14T06:30:04.7547896Z Compiling mlir/lib/IR/AsmPrinter.cpp; 10s local ... 2025-03-14T06:30:05.0452463Z 2025-03-14T06:30:05.0453244Z  2025-03-14T06:30:05.0453601Z  2025-03-14T06:30:05.0453837Z  2025-03-14T06:30:05.0454083Z  2025-03-14T06:30:05.0454331Z  2025-03-14T06:30:05.0454580Z  2025-03-14T06:30:05.0454823Z  2025-03-14T06:30:05.0455069Z  2025-03-14T06:30:05.0455824Z [15,384 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:05.0456528Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:30:05.0457187Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T06:30:05.0457756Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T06:30:05.0458284Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T06:30:05.0458857Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T06:30:05.0459451Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T06:30:05.0460043Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T06:30:05.0460638Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local ... 2025-03-14T06:30:05.2790392Z 2025-03-14T06:30:05.2791673Z  2025-03-14T06:30:05.2792187Z  2025-03-14T06:30:05.2792620Z  2025-03-14T06:30:05.2793069Z  2025-03-14T06:30:05.2793509Z  2025-03-14T06:30:05.2793937Z  2025-03-14T06:30:05.2794369Z  2025-03-14T06:30:05.2794808Z  2025-03-14T06:30:05.2795827Z [15,386 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:05.2797127Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 115s local 2025-03-14T06:30:05.2798383Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 115s local 2025-03-14T06:30:05.2799741Z Compiling llvm/lib/AsmParser/LLParser.cpp; 23s local 2025-03-14T06:30:05.2800708Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T06:30:05.2801786Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 17s local 2025-03-14T06:30:05.2802882Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T06:30:05.2803964Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T06:30:05.5429588Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local ... 2025-03-14T06:30:05.5430168Z 2025-03-14T06:30:05.5430680Z  2025-03-14T06:30:05.5431477Z  2025-03-14T06:30:05.5431914Z  2025-03-14T06:30:05.5432316Z  2025-03-14T06:30:05.5432722Z  2025-03-14T06:30:05.5433141Z  2025-03-14T06:30:05.5433539Z  2025-03-14T06:30:05.5433929Z  2025-03-14T06:30:05.5434849Z [15,388 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:05.5436052Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T06:30:05.5437228Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T06:30:05.5438261Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local 2025-03-14T06:30:05.5439197Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T06:30:05.5440284Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T06:30:05.5441342Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T06:30:05.5442498Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T06:30:05.5443407Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local ... 2025-03-14T06:30:05.7835568Z 2025-03-14T06:30:05.7836807Z  2025-03-14T06:30:05.7837292Z  2025-03-14T06:30:05.7837800Z  2025-03-14T06:30:05.7838340Z  2025-03-14T06:30:05.7838745Z  2025-03-14T06:30:05.7839128Z  2025-03-14T06:30:05.7839560Z  2025-03-14T06:30:05.7839961Z  2025-03-14T06:30:05.7840985Z [15,391 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:05.7842235Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T06:30:05.7843478Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T06:30:05.7844969Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local 2025-03-14T06:30:05.7845963Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T06:30:05.7847028Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T06:30:05.7848079Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T06:30:05.7849165Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 15s local 2025-03-14T06:30:05.7850119Z Compiling mlir/lib/IR/AsmPrinter.cpp; 11s local ... 2025-03-14T06:30:06.0411432Z 2025-03-14T06:30:06.0412361Z  2025-03-14T06:30:06.0412865Z  2025-03-14T06:30:06.0413293Z  2025-03-14T06:30:06.0413712Z  2025-03-14T06:30:06.0414133Z  2025-03-14T06:30:06.0414517Z  2025-03-14T06:30:06.0415231Z  2025-03-14T06:30:06.0415653Z  2025-03-14T06:30:06.0416618Z [15,393 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:06.0417862Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T06:30:06.0419088Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T06:30:06.0420130Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local 2025-03-14T06:30:06.0421046Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T06:30:06.0422066Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T06:30:06.0423115Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T06:30:06.0424391Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T06:30:06.0425318Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local ... 2025-03-14T06:30:06.2800100Z 2025-03-14T06:30:06.2800993Z  2025-03-14T06:30:06.2801494Z  2025-03-14T06:30:06.2801919Z  2025-03-14T06:30:06.2802285Z  2025-03-14T06:30:06.2802659Z  2025-03-14T06:30:06.2803064Z  2025-03-14T06:30:06.2803459Z  2025-03-14T06:30:06.2803826Z  2025-03-14T06:30:06.2804983Z [15,394 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:06.2806373Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 116s local 2025-03-14T06:30:06.2807536Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 116s local 2025-03-14T06:30:06.2808497Z Compiling llvm/lib/AsmParser/LLParser.cpp; 24s local 2025-03-14T06:30:06.2809406Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T06:30:06.2810389Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 18s local 2025-03-14T06:30:06.2811424Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T06:30:06.2812526Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T06:30:06.2813495Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local ... 2025-03-14T06:30:06.4804143Z 2025-03-14T06:30:06.4805112Z  2025-03-14T06:30:06.4805591Z  2025-03-14T06:30:06.4806013Z  2025-03-14T06:30:06.4806438Z  2025-03-14T06:30:06.4806832Z  2025-03-14T06:30:06.4807218Z  2025-03-14T06:30:06.4807607Z  2025-03-14T06:30:06.4808015Z  2025-03-14T06:30:06.4808920Z [15,395 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:06.4810172Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T06:30:06.4811286Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T06:30:06.4812375Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T06:30:06.4813396Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T06:30:06.4814441Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T06:30:06.4815478Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T06:30:06.4816635Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2025-03-14T06:30:06.4817388Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 11s local ... 2025-03-14T06:30:06.7305566Z 2025-03-14T06:30:06.7306417Z  2025-03-14T06:30:06.7306915Z  2025-03-14T06:30:06.7307318Z  2025-03-14T06:30:06.7307692Z  2025-03-14T06:30:06.7308063Z  2025-03-14T06:30:06.7308457Z  2025-03-14T06:30:06.7308843Z  2025-03-14T06:30:06.7309227Z  2025-03-14T06:30:06.7310127Z [15,397 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:06.7311290Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T06:30:06.7312409Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T06:30:06.7313739Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T06:30:06.7314696Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T06:30:06.7315699Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T06:30:06.7316725Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 16s local 2025-03-14T06:30:06.7317747Z Compiling mlir/lib/IR/AsmPrinter.cpp; 12s local 2025-03-14T06:30:06.7318580Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local ... 2025-03-14T06:30:06.9876867Z 2025-03-14T06:30:06.9877751Z  2025-03-14T06:30:06.9878178Z  2025-03-14T06:30:06.9878570Z  2025-03-14T06:30:06.9878920Z  2025-03-14T06:30:06.9879326Z  2025-03-14T06:30:06.9879945Z  2025-03-14T06:30:06.9880323Z  2025-03-14T06:30:06.9880713Z  2025-03-14T06:30:06.9881580Z [15,399 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:06.9882721Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T06:30:06.9883810Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T06:30:06.9884944Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T06:30:06.9885862Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T06:30:06.9887010Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T06:30:06.9887937Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T06:30:06.9888779Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T06:30:06.9889503Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local ... 2025-03-14T06:30:07.2811216Z 2025-03-14T06:30:07.2812131Z  2025-03-14T06:30:07.2812616Z  2025-03-14T06:30:07.2813028Z  2025-03-14T06:30:07.2813450Z  2025-03-14T06:30:07.2813864Z  2025-03-14T06:30:07.2814272Z  2025-03-14T06:30:07.2814657Z  2025-03-14T06:30:07.2815046Z  2025-03-14T06:30:07.2815989Z [15,405 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:07.2817243Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 117s local 2025-03-14T06:30:07.2818443Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 117s local 2025-03-14T06:30:07.2819509Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T06:30:07.2820534Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 19s local 2025-03-14T06:30:07.2821538Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T06:30:07.2822569Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T06:30:07.2823471Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T06:30:07.2824321Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local ... 2025-03-14T06:30:07.5407344Z 2025-03-14T06:30:07.5408203Z  2025-03-14T06:30:07.5408703Z  2025-03-14T06:30:07.5409132Z  2025-03-14T06:30:07.5409553Z  2025-03-14T06:30:07.5409979Z  2025-03-14T06:30:07.5410378Z  2025-03-14T06:30:07.5411014Z  2025-03-14T06:30:07.5411449Z  2025-03-14T06:30:07.5423060Z [15,408 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:07.5424197Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2025-03-14T06:30:07.5425273Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T06:30:07.5426309Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T06:30:07.5427325Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T06:30:07.5428368Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T06:30:07.5429434Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T06:30:07.5431143Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T06:30:07.5432157Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 12s local ... 2025-03-14T06:30:07.8220641Z 2025-03-14T06:30:07.8221640Z  2025-03-14T06:30:07.8222184Z  2025-03-14T06:30:07.8222578Z  2025-03-14T06:30:07.8222990Z  2025-03-14T06:30:07.8223398Z  2025-03-14T06:30:07.8224378Z  2025-03-14T06:30:07.8224777Z  2025-03-14T06:30:07.8225180Z  2025-03-14T06:30:07.8226118Z [15,414 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:07.8227291Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2025-03-14T06:30:07.8228878Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T06:30:07.8230002Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T06:30:07.8231008Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T06:30:07.8232040Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T06:30:07.8233060Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 17s local 2025-03-14T06:30:07.8233991Z Compiling mlir/lib/IR/AsmPrinter.cpp; 13s local 2025-03-14T06:30:07.8234889Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local ... 2025-03-14T06:30:08.0503434Z 2025-03-14T06:30:08.0504240Z  2025-03-14T06:30:08.0504739Z  2025-03-14T06:30:08.0505172Z  2025-03-14T06:30:08.0505599Z  2025-03-14T06:30:08.0506021Z  2025-03-14T06:30:08.0506444Z  2025-03-14T06:30:08.0506859Z  2025-03-14T06:30:08.0507274Z  2025-03-14T06:30:08.0508215Z [15,418 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:08.0509483Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2025-03-14T06:30:08.0510722Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T06:30:08.0511876Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T06:30:08.0512936Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T06:30:08.0514215Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T06:30:08.0515360Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T06:30:08.0516413Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T06:30:08.0517281Z Compiling mlir/lib/IR/Dominance.cpp; 9s local ... 2025-03-14T06:30:08.2821520Z 2025-03-14T06:30:08.2822348Z  2025-03-14T06:30:08.2822845Z  2025-03-14T06:30:08.2823249Z  2025-03-14T06:30:08.2823678Z  2025-03-14T06:30:08.2824137Z  2025-03-14T06:30:08.2824518Z  2025-03-14T06:30:08.2824927Z  2025-03-14T06:30:08.2825342Z  2025-03-14T06:30:08.2826393Z [15,420 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:08.2827695Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 118s local 2025-03-14T06:30:08.2829128Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 118s local 2025-03-14T06:30:08.2830264Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T06:30:08.2831239Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 20s local 2025-03-14T06:30:08.2832289Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T06:30:08.2833390Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T06:30:08.2834357Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T06:30:08.2835220Z Compiling mlir/lib/IR/Dominance.cpp; 9s local ... 2025-03-14T06:30:08.4825546Z 2025-03-14T06:30:08.4826435Z  2025-03-14T06:30:08.4826914Z  2025-03-14T06:30:08.4827345Z  2025-03-14T06:30:08.4827754Z  2025-03-14T06:30:08.4828438Z  2025-03-14T06:30:08.4828859Z  2025-03-14T06:30:08.4829290Z  2025-03-14T06:30:08.4829701Z  2025-03-14T06:30:08.4830715Z [15,424 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:08.4831986Z Compiling xla/backends/cpu/runtime/convolution_thunk_f16.cc; 119s local 2025-03-14T06:30:08.4833265Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T06:30:08.4834441Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T06:30:08.4835537Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T06:30:08.4836647Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T06:30:08.4837940Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T06:30:08.4838970Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 13s local 2025-03-14T06:30:08.4839817Z Compiling mlir/lib/IR/Dominance.cpp; 9s local ... 2025-03-14T06:30:08.7424834Z 2025-03-14T06:30:08.7425659Z  2025-03-14T06:30:08.7426180Z  2025-03-14T06:30:08.7426605Z  2025-03-14T06:30:08.7427023Z  2025-03-14T06:30:08.7427444Z  2025-03-14T06:30:08.7427885Z  2025-03-14T06:30:08.7428320Z  2025-03-14T06:30:08.7428747Z  2025-03-14T06:30:08.7429968Z [15,425 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:08.7431244Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T06:30:08.7432360Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T06:30:08.7433386Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T06:30:08.7434439Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T06:30:08.7435504Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 18s local 2025-03-14T06:30:08.7436493Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T06:30:08.7437321Z Compiling mlir/lib/IR/Dominance.cpp; 10s local 2025-03-14T06:30:08.7438218Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2025-03-14T06:30:09.0831583Z 2025-03-14T06:30:09.0832616Z  2025-03-14T06:30:09.0833112Z  2025-03-14T06:30:09.0833528Z  2025-03-14T06:30:09.0833950Z  2025-03-14T06:30:09.0834373Z  2025-03-14T06:30:09.0834793Z  2025-03-14T06:30:09.0835192Z  2025-03-14T06:30:09.0835607Z  2025-03-14T06:30:09.0836568Z [15,426 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:09.0837800Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T06:30:09.0838921Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T06:30:09.0839901Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 21s local 2025-03-14T06:30:09.0840963Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T06:30:09.0841990Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T06:30:09.0842873Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T06:30:09.0843938Z Compiling mlir/lib/IR/Dominance.cpp; 10s local 2025-03-14T06:30:09.0844984Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local ... 2025-03-14T06:30:09.3833582Z 2025-03-14T06:30:09.3834454Z  2025-03-14T06:30:09.3834944Z  2025-03-14T06:30:09.3835377Z  2025-03-14T06:30:09.3835797Z  2025-03-14T06:30:09.3836138Z  2025-03-14T06:30:09.3836531Z  2025-03-14T06:30:09.3836943Z  2025-03-14T06:30:09.3837361Z  2025-03-14T06:30:09.3838309Z [15,427 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:09.3839499Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 119s local 2025-03-14T06:30:09.3840928Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T06:30:09.3841994Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T06:30:09.3843063Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T06:30:09.3844187Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T06:30:09.3845326Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T06:30:09.3846215Z Compiling llvm/lib/IR/SafepointIRVerifier.cpp; 6s local 2025-03-14T06:30:09.3847163Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 6s local ... 2025-03-14T06:30:09.6838689Z 2025-03-14T06:30:09.6839548Z  2025-03-14T06:30:09.6840048Z  2025-03-14T06:30:09.6840482Z  2025-03-14T06:30:09.6841164Z  2025-03-14T06:30:09.6841599Z  2025-03-14T06:30:09.6842033Z  2025-03-14T06:30:09.6842460Z  2025-03-14T06:30:09.6842882Z  2025-03-14T06:30:09.6843888Z [15,431 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:09.6845330Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T06:30:09.6846501Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T06:30:09.6847568Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T06:30:09.6848839Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T06:30:09.6849973Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 19s local 2025-03-14T06:30:09.6851487Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 14s local 2025-03-14T06:30:09.6852447Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 6s local 2025-03-14T06:30:09.6853521Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local ... 2025-03-14T06:30:09.8844236Z 2025-03-14T06:30:09.8845362Z  2025-03-14T06:30:09.8845850Z  2025-03-14T06:30:09.8846235Z  2025-03-14T06:30:09.8846671Z  2025-03-14T06:30:09.8847137Z  2025-03-14T06:30:09.8847542Z  2025-03-14T06:30:09.8848619Z  2025-03-14T06:30:09.8849488Z  2025-03-14T06:30:09.8853019Z [15,434 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:09.8856408Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T06:30:09.8857713Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T06:30:09.8858731Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T06:30:09.8859716Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T06:30:09.8860705Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T06:30:09.8861770Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T06:30:09.8862731Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 7s local 2025-03-14T06:30:09.8863787Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local ... 2025-03-14T06:30:10.1489419Z 2025-03-14T06:30:10.1490255Z  2025-03-14T06:30:10.1490736Z  2025-03-14T06:30:10.1491150Z  2025-03-14T06:30:10.1491536Z  2025-03-14T06:30:10.1491895Z  2025-03-14T06:30:10.1492270Z  2025-03-14T06:30:10.1492909Z  2025-03-14T06:30:10.1493323Z  2025-03-14T06:30:10.1494250Z [15,440 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:10.1495544Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 120s local 2025-03-14T06:30:10.1496613Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T06:30:10.1497647Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 22s local 2025-03-14T06:30:10.1498638Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T06:30:10.1499596Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T06:30:10.1500528Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T06:30:10.1503580Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 7s local 2025-03-14T06:30:10.1504495Z Compiling llvm/lib/IR/ModuleSummaryIndex.cpp; 6s local ... 2025-03-14T06:30:10.4853984Z 2025-03-14T06:30:10.4854835Z  2025-03-14T06:30:10.4855339Z  2025-03-14T06:30:10.4855771Z  2025-03-14T06:30:10.4856180Z  2025-03-14T06:30:10.4856621Z  2025-03-14T06:30:10.4857042Z  2025-03-14T06:30:10.4857436Z  2025-03-14T06:30:10.4857839Z  2025-03-14T06:30:10.4858844Z [15,442 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:10.4860048Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T06:30:10.4861426Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T06:30:10.4862489Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T06:30:10.4863457Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T06:30:10.4864536Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T06:30:10.4865725Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T06:30:10.4866657Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 7s local 2025-03-14T06:30:10.4867441Z Compiling llvm/lib/IR/Verifier.cpp; 4s local ... 2025-03-14T06:30:10.6859264Z 2025-03-14T06:30:10.6860153Z  2025-03-14T06:30:10.6860660Z  2025-03-14T06:30:10.6861200Z  2025-03-14T06:30:10.6861565Z  2025-03-14T06:30:10.6861958Z  2025-03-14T06:30:10.6862351Z  2025-03-14T06:30:10.6862742Z  2025-03-14T06:30:10.6863124Z  2025-03-14T06:30:10.6864218Z [15,444 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:10.6865659Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T06:30:10.6866659Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T06:30:10.6867601Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T06:30:10.6868506Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T06:30:10.6869468Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 20s local 2025-03-14T06:30:10.6870410Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 15s local 2025-03-14T06:30:10.6871256Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 7s local 2025-03-14T06:30:10.6872058Z Compiling llvm/lib/IR/Verifier.cpp; 5s local ... 2025-03-14T06:30:11.0864591Z 2025-03-14T06:30:11.0865592Z  2025-03-14T06:30:11.0866071Z  2025-03-14T06:30:11.0866488Z  2025-03-14T06:30:11.0866922Z  2025-03-14T06:30:11.0867372Z  2025-03-14T06:30:11.0867777Z  2025-03-14T06:30:11.0868190Z  2025-03-14T06:30:11.0868593Z  2025-03-14T06:30:11.0869679Z [15,445 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:11.0870942Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T06:30:11.0872044Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:11.0873303Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 23s local 2025-03-14T06:30:11.0874367Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T06:30:11.0875420Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T06:30:11.0876351Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T06:30:11.0877219Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 8s local 2025-03-14T06:30:11.0878011Z Compiling llvm/lib/IR/Verifier.cpp; 5s local ... 2025-03-14T06:30:11.2868974Z 2025-03-14T06:30:11.2869792Z  2025-03-14T06:30:11.2870308Z  2025-03-14T06:30:11.2870734Z  2025-03-14T06:30:11.2871147Z  2025-03-14T06:30:11.2871910Z  2025-03-14T06:30:11.2872307Z  2025-03-14T06:30:11.2872704Z  2025-03-14T06:30:11.2873105Z  2025-03-14T06:30:11.2874083Z [15,446 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:11.2875316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 121s local 2025-03-14T06:30:11.2876367Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:11.2877331Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:11.2878378Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T06:30:11.2879398Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T06:30:11.2880304Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T06:30:11.2881438Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 8s local 2025-03-14T06:30:11.2882260Z Compiling llvm/lib/IR/Verifier.cpp; 5s local ... 2025-03-14T06:30:11.5055856Z 2025-03-14T06:30:11.5056825Z  2025-03-14T06:30:11.5057319Z  2025-03-14T06:30:11.5057711Z  2025-03-14T06:30:11.5058097Z  2025-03-14T06:30:11.5058502Z  2025-03-14T06:30:11.5058922Z  2025-03-14T06:30:11.5059352Z  2025-03-14T06:30:11.5059746Z  2025-03-14T06:30:11.5060898Z [15,453 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:11.5062107Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T06:30:11.5063185Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:11.5064172Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:11.5065144Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T06:30:11.5066443Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T06:30:11.5067336Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 16s local 2025-03-14T06:30:11.5068141Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 8s local 2025-03-14T06:30:11.5068943Z Compiling llvm/lib/IR/Verifier.cpp; 5s local ... 2025-03-14T06:30:11.7169282Z 2025-03-14T06:30:11.7170122Z  2025-03-14T06:30:11.7170632Z  2025-03-14T06:30:11.7171058Z  2025-03-14T06:30:11.7171462Z  2025-03-14T06:30:11.7171882Z  2025-03-14T06:30:11.7172313Z  2025-03-14T06:30:11.7172716Z  2025-03-14T06:30:11.7173140Z  2025-03-14T06:30:11.7174106Z [15,461 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:11.7175362Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T06:30:11.7176600Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:11.7177607Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:11.7178611Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T06:30:11.7179647Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 21s local 2025-03-14T06:30:11.7180524Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T06:30:11.7181600Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 8s local 2025-03-14T06:30:11.7182393Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2025-03-14T06:30:11.9227449Z 2025-03-14T06:30:11.9228382Z  2025-03-14T06:30:11.9228882Z  2025-03-14T06:30:11.9229305Z  2025-03-14T06:30:11.9229679Z  2025-03-14T06:30:11.9230066Z  2025-03-14T06:30:11.9230602Z  2025-03-14T06:30:11.9231006Z  2025-03-14T06:30:11.9231403Z  2025-03-14T06:30:11.9232366Z [15,464 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:11.9233563Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T06:30:11.9234576Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T06:30:11.9235878Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:11.9236901Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T06:30:11.9237968Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T06:30:11.9238958Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T06:30:11.9239859Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 9s local 2025-03-14T06:30:11.9240733Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2025-03-14T06:30:12.2325782Z 2025-03-14T06:30:12.2326617Z  2025-03-14T06:30:12.2327065Z  2025-03-14T06:30:12.2327458Z  2025-03-14T06:30:12.2327834Z  2025-03-14T06:30:12.2328203Z  2025-03-14T06:30:12.2328876Z  2025-03-14T06:30:12.2329262Z  2025-03-14T06:30:12.2329640Z  2025-03-14T06:30:12.2330538Z [15,468 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:12.2331687Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 122s local 2025-03-14T06:30:12.2332706Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T06:30:12.2333662Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 24s local 2025-03-14T06:30:12.2334765Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T06:30:12.2336017Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T06:30:12.2337014Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T06:30:12.2337904Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 9s local 2025-03-14T06:30:12.2338701Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2025-03-14T06:30:12.4878315Z 2025-03-14T06:30:12.4879184Z  2025-03-14T06:30:12.4879666Z  2025-03-14T06:30:12.4880100Z  2025-03-14T06:30:12.4880453Z  2025-03-14T06:30:12.4880852Z  2025-03-14T06:30:12.4881299Z  2025-03-14T06:30:12.4881697Z  2025-03-14T06:30:12.4882117Z  2025-03-14T06:30:12.4883051Z [15,469 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:12.4884319Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T06:30:12.4885615Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T06:30:12.4886683Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T06:30:12.4887750Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T06:30:12.4888872Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T06:30:12.4889825Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 17s local 2025-03-14T06:30:12.4890660Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 9s local 2025-03-14T06:30:12.4891583Z Compiling llvm/lib/IR/Verifier.cpp; 6s local ... 2025-03-14T06:30:12.6885254Z 2025-03-14T06:30:12.6886158Z  2025-03-14T06:30:12.6886628Z  2025-03-14T06:30:12.6887031Z  2025-03-14T06:30:12.6887429Z  2025-03-14T06:30:12.6887802Z  2025-03-14T06:30:12.6888187Z  2025-03-14T06:30:12.6888594Z  2025-03-14T06:30:12.6889246Z  2025-03-14T06:30:12.6890152Z [15,470 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:12.6891338Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T06:30:12.6892383Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T06:30:12.6893329Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T06:30:12.6894358Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T06:30:12.6895436Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 22s local 2025-03-14T06:30:12.6896374Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T06:30:12.6897491Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 9s local 2025-03-14T06:30:12.6898298Z Compiling llvm/lib/IR/Verifier.cpp; 7s local ... 2025-03-14T06:30:13.0884647Z 2025-03-14T06:30:13.0885508Z  2025-03-14T06:30:13.0885999Z  2025-03-14T06:30:13.0886411Z  2025-03-14T06:30:13.0886825Z  2025-03-14T06:30:13.0887218Z  2025-03-14T06:30:13.0887637Z  2025-03-14T06:30:13.0888055Z  2025-03-14T06:30:13.0888445Z  2025-03-14T06:30:13.0889549Z [15,472 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:13.0890794Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T06:30:13.0891930Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T06:30:13.0893277Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 25s local 2025-03-14T06:30:13.0894310Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T06:30:13.0895432Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T06:30:13.0896443Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T06:30:13.0897388Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local 2025-03-14T06:30:13.0898204Z Compiling llvm/lib/IR/Verifier.cpp; 7s local ... 2025-03-14T06:30:13.3955174Z 2025-03-14T06:30:13.3956016Z  2025-03-14T06:30:13.3956762Z  2025-03-14T06:30:13.3957221Z  2025-03-14T06:30:13.3957643Z  2025-03-14T06:30:13.3958059Z  2025-03-14T06:30:13.3958477Z  2025-03-14T06:30:13.3958897Z  2025-03-14T06:30:13.3959301Z  2025-03-14T06:30:13.3960249Z [15,474 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:13.3961487Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 123s local 2025-03-14T06:30:13.3962626Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T06:30:13.3963727Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T06:30:13.3964931Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T06:30:13.3966186Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T06:30:13.3967166Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 18s local 2025-03-14T06:30:13.3968074Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local 2025-03-14T06:30:13.3968929Z Compiling llvm/lib/IR/Verifier.cpp; 7s local ... 2025-03-14T06:30:13.6891432Z 2025-03-14T06:30:13.6892292Z  2025-03-14T06:30:13.6892765Z  2025-03-14T06:30:13.6893179Z  2025-03-14T06:30:13.6893571Z  2025-03-14T06:30:13.6893981Z  2025-03-14T06:30:13.6894361Z  2025-03-14T06:30:13.6894793Z  2025-03-14T06:30:13.6895196Z  2025-03-14T06:30:13.6896164Z [15,475 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:13.6897430Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T06:30:13.6898519Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T06:30:13.6899749Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T06:30:13.6900867Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T06:30:13.6901990Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 23s local 2025-03-14T06:30:13.6902964Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:30:13.6903844Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 10s local 2025-03-14T06:30:13.6904705Z Compiling llvm/lib/IR/Verifier.cpp; 8s local ... 2025-03-14T06:30:13.9231544Z 2025-03-14T06:30:13.9232441Z  2025-03-14T06:30:13.9232988Z  2025-03-14T06:30:13.9233384Z  2025-03-14T06:30:13.9233796Z  2025-03-14T06:30:13.9234215Z  2025-03-14T06:30:13.9234640Z  2025-03-14T06:30:13.9235330Z  2025-03-14T06:30:13.9235751Z  2025-03-14T06:30:13.9236609Z [15,476 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:13.9237744Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T06:30:13.9238820Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T06:30:13.9239903Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T06:30:13.9241007Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:13.9242116Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T06:30:13.9243102Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:30:13.9244045Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2025-03-14T06:30:13.9245289Z Compiling llvm/lib/IR/Verifier.cpp; 8s local ... 2025-03-14T06:30:14.1742380Z 2025-03-14T06:30:14.1743229Z  2025-03-14T06:30:14.1743777Z  2025-03-14T06:30:14.1744233Z  2025-03-14T06:30:14.1744716Z  2025-03-14T06:30:14.1745117Z  2025-03-14T06:30:14.1745511Z  2025-03-14T06:30:14.1745883Z  2025-03-14T06:30:14.1746272Z  2025-03-14T06:30:14.1747274Z [15,480 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:14.1748736Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 124s local 2025-03-14T06:30:14.1749854Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T06:30:14.1750893Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 26s local 2025-03-14T06:30:14.1751967Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:14.1753066Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T06:30:14.1754074Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:30:14.1754967Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2025-03-14T06:30:14.1755852Z Compiling llvm/lib/IR/Verifier.cpp; 8s local ... 2025-03-14T06:30:14.4498550Z 2025-03-14T06:30:14.4499427Z  2025-03-14T06:30:14.4499923Z  2025-03-14T06:30:14.4500331Z  2025-03-14T06:30:14.4500762Z  2025-03-14T06:30:14.4501166Z  2025-03-14T06:30:14.4501551Z  2025-03-14T06:30:14.4501928Z  2025-03-14T06:30:14.4502333Z  2025-03-14T06:30:14.4503232Z [15,490 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:14.4504312Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:30:14.4505336Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T06:30:14.4506332Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T06:30:14.4507339Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:14.4508362Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T06:30:14.4509310Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:30:14.4510174Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2025-03-14T06:30:14.4511329Z Compiling llvm/lib/IR/Verifier.cpp; 8s local ... 2025-03-14T06:30:14.6539501Z 2025-03-14T06:30:14.6540423Z  2025-03-14T06:30:14.6540914Z  2025-03-14T06:30:14.6541358Z  2025-03-14T06:30:14.6541771Z  2025-03-14T06:30:14.6542177Z  2025-03-14T06:30:14.6542560Z  2025-03-14T06:30:14.6542954Z  2025-03-14T06:30:14.6543353Z  2025-03-14T06:30:14.6544281Z [15,504 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:14.6545509Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:30:14.6546606Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T06:30:14.6547539Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T06:30:14.6548860Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:14.6549868Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 24s local 2025-03-14T06:30:14.6550779Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 19s local 2025-03-14T06:30:14.6551684Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 11s local 2025-03-14T06:30:14.6552535Z Compiling llvm/lib/IR/Verifier.cpp; 9s local ... 2025-03-14T06:30:14.8901255Z 2025-03-14T06:30:14.8902104Z  2025-03-14T06:30:14.8902616Z  2025-03-14T06:30:14.8903053Z  2025-03-14T06:30:14.8903488Z  2025-03-14T06:30:14.8903914Z  2025-03-14T06:30:14.8904332Z  2025-03-14T06:30:14.8904748Z  2025-03-14T06:30:14.8905428Z  2025-03-14T06:30:14.8906398Z [15,506 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:14.8907624Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:30:14.8908683Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T06:30:14.8909716Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T06:30:14.8910798Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:14.8912069Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T06:30:14.8913023Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T06:30:14.8913919Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2025-03-14T06:30:14.8914819Z Compiling llvm/lib/IR/Verifier.cpp; 9s local ... 2025-03-14T06:30:15.0925184Z 2025-03-14T06:30:15.0926075Z  2025-03-14T06:30:15.0926628Z  2025-03-14T06:30:15.0927020Z  2025-03-14T06:30:15.0927413Z  2025-03-14T06:30:15.0927846Z  2025-03-14T06:30:15.0928247Z  2025-03-14T06:30:15.0928618Z  2025-03-14T06:30:15.0929005Z  2025-03-14T06:30:15.0929943Z [15,507 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:15.0931146Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:30:15.0932270Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T06:30:15.0933330Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 27s local 2025-03-14T06:30:15.0934357Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:15.0935432Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T06:30:15.0936441Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T06:30:15.0937347Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2025-03-14T06:30:15.0938213Z Compiling llvm/lib/IR/Verifier.cpp; 9s local ... 2025-03-14T06:30:15.3211468Z 2025-03-14T06:30:15.3212306Z  2025-03-14T06:30:15.3212796Z  2025-03-14T06:30:15.3213268Z  2025-03-14T06:30:15.3213679Z  2025-03-14T06:30:15.3214089Z  2025-03-14T06:30:15.3214528Z  2025-03-14T06:30:15.3214949Z  2025-03-14T06:30:15.3215350Z  2025-03-14T06:30:15.3216560Z [15,509 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:15.3217839Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 125s local 2025-03-14T06:30:15.3219005Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T06:30:15.3220051Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T06:30:15.3221141Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:15.3222244Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T06:30:15.3223228Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T06:30:15.3224144Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2025-03-14T06:30:15.3225223Z Compiling llvm/lib/IR/Verifier.cpp; 9s local ... 2025-03-14T06:30:15.6534296Z 2025-03-14T06:30:15.6535146Z  2025-03-14T06:30:15.6535686Z  2025-03-14T06:30:15.6536107Z  2025-03-14T06:30:15.6536542Z  2025-03-14T06:30:15.6536996Z  2025-03-14T06:30:15.6537392Z  2025-03-14T06:30:15.6537797Z  2025-03-14T06:30:15.6538209Z  2025-03-14T06:30:15.6539183Z [15,512 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:15.6540336Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T06:30:15.6541489Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T06:30:15.6542548Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T06:30:15.6543834Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:15.6544898Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 25s local 2025-03-14T06:30:15.6545917Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 20s local 2025-03-14T06:30:15.6546875Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 12s local 2025-03-14T06:30:15.6547643Z Compiling llvm/lib/IR/Verifier.cpp; 10s local ... 2025-03-14T06:30:15.8910853Z 2025-03-14T06:30:15.8911731Z  2025-03-14T06:30:15.8912237Z  2025-03-14T06:30:15.8912667Z  2025-03-14T06:30:15.8913337Z  2025-03-14T06:30:15.8913780Z  2025-03-14T06:30:15.8914214Z  2025-03-14T06:30:15.8914619Z  2025-03-14T06:30:15.8915030Z  2025-03-14T06:30:15.8916023Z [15,514 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:15.8917254Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T06:30:15.8918411Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T06:30:15.8919442Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:15.8920590Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:15.8921599Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T06:30:15.8922487Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2025-03-14T06:30:15.8923254Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T06:30:15.8924023Z @llvm-project//mlir:PDLToPDLInterp; 9s local ... 2025-03-14T06:30:16.0915615Z 2025-03-14T06:30:16.0916471Z  2025-03-14T06:30:16.0916967Z  2025-03-14T06:30:16.0917391Z  2025-03-14T06:30:16.0917816Z  2025-03-14T06:30:16.0918247Z  2025-03-14T06:30:16.0918674Z  2025-03-14T06:30:16.0919098Z  2025-03-14T06:30:16.0919477Z  2025-03-14T06:30:16.0920462Z [15,516 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:16.0921715Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T06:30:16.0922859Z Compiling llvm/lib/Bitcode/Reader/BitcodeReader.cpp; 28s local 2025-03-14T06:30:16.0923977Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T06:30:16.0925510Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:16.0926529Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T06:30:16.0927449Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2025-03-14T06:30:16.0928303Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T06:30:16.0929121Z @llvm-project//mlir:PDLToPDLInterp; 9s local ... 2025-03-14T06:30:16.2931055Z 2025-03-14T06:30:16.2931939Z  2025-03-14T06:30:16.2932419Z  2025-03-14T06:30:16.2932834Z  2025-03-14T06:30:16.2933275Z  2025-03-14T06:30:16.2933660Z  2025-03-14T06:30:16.2934056Z  2025-03-14T06:30:16.2934448Z  2025-03-14T06:30:16.2934869Z  2025-03-14T06:30:16.2935853Z [15,521 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:16.2937479Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 126s local 2025-03-14T06:30:16.2938631Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T06:30:16.2939679Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:16.2940642Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 21s local 2025-03-14T06:30:16.2941528Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2025-03-14T06:30:16.2942390Z Compiling llvm/lib/IR/Verifier.cpp; 10s local 2025-03-14T06:30:16.2943352Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 9s local 2025-03-14T06:30:16.2944407Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local ... 2025-03-14T06:30:16.6921300Z 2025-03-14T06:30:16.6922149Z  2025-03-14T06:30:16.6922642Z  2025-03-14T06:30:16.6923081Z  2025-03-14T06:30:16.6923612Z  2025-03-14T06:30:16.6924053Z  2025-03-14T06:30:16.6924446Z  2025-03-14T06:30:16.6925024Z  2025-03-14T06:30:16.6925429Z  2025-03-14T06:30:16.6926418Z [15,522 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:16.6927644Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T06:30:16.6929002Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T06:30:16.6930057Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 26s local 2025-03-14T06:30:16.6931041Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2025-03-14T06:30:16.6931973Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 13s local 2025-03-14T06:30:16.6932796Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T06:30:16.6933774Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 9s local 2025-03-14T06:30:16.6934827Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local ... 2025-03-14T06:30:16.8926508Z 2025-03-14T06:30:16.8927359Z  2025-03-14T06:30:16.8927881Z  2025-03-14T06:30:16.8928309Z  2025-03-14T06:30:16.8928728Z  2025-03-14T06:30:16.8929135Z  2025-03-14T06:30:16.8929516Z  2025-03-14T06:30:16.8929927Z  2025-03-14T06:30:16.8930321Z  2025-03-14T06:30:16.8931260Z [15,526 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:16.8932429Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T06:30:16.8933491Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T06:30:16.8934453Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:16.8935342Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2025-03-14T06:30:16.8936258Z Compiling mlir/lib/IR/AsmPrinter.cpp [for tool]; 14s local 2025-03-14T06:30:16.8937092Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T06:30:16.8938087Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 10s local 2025-03-14T06:30:16.8939056Z Compiling llvm/lib/IR/AsmWriter.cpp; 9s local ... 2025-03-14T06:30:17.2043511Z 2025-03-14T06:30:17.2044415Z  2025-03-14T06:30:17.2045380Z  2025-03-14T06:30:17.2045869Z  2025-03-14T06:30:17.2046221Z  2025-03-14T06:30:17.2046579Z  2025-03-14T06:30:17.2046943Z  2025-03-14T06:30:17.2047298Z  2025-03-14T06:30:17.2047644Z  2025-03-14T06:30:17.2048471Z [15,528 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:17.2049493Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T06:30:17.2050357Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 29s local 2025-03-14T06:30:17.2051157Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:17.2051898Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2025-03-14T06:30:17.2052707Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T06:30:17.2053454Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 10s local 2025-03-14T06:30:17.2054218Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T06:30:17.2054872Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local ... 2025-03-14T06:30:17.4130642Z 2025-03-14T06:30:17.4131539Z  2025-03-14T06:30:17.4132055Z  2025-03-14T06:30:17.4132477Z  2025-03-14T06:30:17.4132881Z  2025-03-14T06:30:17.4133261Z  2025-03-14T06:30:17.4133656Z  2025-03-14T06:30:17.4134078Z  2025-03-14T06:30:17.4134486Z  2025-03-14T06:30:17.4135441Z [15,535 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:17.4136949Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 127s local 2025-03-14T06:30:17.4138083Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:17.4139070Z Compiling mlir/lib/IR/BuiltinAttributes.cpp; 22s local 2025-03-14T06:30:17.4139825Z Compiling llvm/lib/IR/Verifier.cpp; 11s local 2025-03-14T06:30:17.4140869Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 10s local 2025-03-14T06:30:17.4141840Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T06:30:17.4142754Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2025-03-14T06:30:17.4143505Z @llvm-project//mlir:PDLToPDLInterp; 7s local ... 2025-03-14T06:30:17.6454723Z 2025-03-14T06:30:17.6455585Z  2025-03-14T06:30:17.6456040Z  2025-03-14T06:30:17.6456387Z  2025-03-14T06:30:17.6456762Z  2025-03-14T06:30:17.6457138Z  2025-03-14T06:30:17.6457502Z  2025-03-14T06:30:17.6457893Z  2025-03-14T06:30:17.6458219Z  2025-03-14T06:30:17.6459023Z [15,540 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:17.6460042Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T06:30:17.6460963Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:17.6461715Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T06:30:17.6462530Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 10s local 2025-03-14T06:30:17.6463424Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T06:30:17.6464075Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2025-03-14T06:30:17.6464886Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 8s local 2025-03-14T06:30:17.6465993Z Compiling mlir/lib/Pass/Pass.cpp; 7s local ... 2025-03-14T06:30:17.8571593Z 2025-03-14T06:30:17.8572457Z  2025-03-14T06:30:17.8572981Z  2025-03-14T06:30:17.8573409Z  2025-03-14T06:30:17.8573803Z  2025-03-14T06:30:17.8574203Z  2025-03-14T06:30:17.8574603Z  2025-03-14T06:30:17.8574993Z  2025-03-14T06:30:17.8575423Z  2025-03-14T06:30:17.8576328Z [15,544 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:17.8577423Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T06:30:17.8578728Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 27s local 2025-03-14T06:30:17.8579618Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T06:30:17.8580617Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:17.8581672Z Compiling llvm/lib/IR/AsmWriter.cpp; 10s local 2025-03-14T06:30:17.8582397Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 9s local 2025-03-14T06:30:17.8583432Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 8s local 2025-03-14T06:30:17.8584469Z @llvm-project//mlir:PDLToPDLInterp; 7s local ... 2025-03-14T06:30:18.0698121Z 2025-03-14T06:30:18.0699017Z  2025-03-14T06:30:18.0699503Z  2025-03-14T06:30:18.0700237Z  2025-03-14T06:30:18.0700639Z  2025-03-14T06:30:18.0701038Z  2025-03-14T06:30:18.0701440Z  2025-03-14T06:30:18.0701843Z  2025-03-14T06:30:18.0702262Z  2025-03-14T06:30:18.0703259Z [15,549 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:18.0704470Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T06:30:18.0705478Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T06:30:18.0706388Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T06:30:18.0707408Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:18.0708427Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T06:30:18.0709379Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2025-03-14T06:30:18.0710282Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 8s local 2025-03-14T06:30:18.0711302Z @llvm-project//mlir:PDLToPDLInterp; 7s local ... 2025-03-14T06:30:18.2937141Z 2025-03-14T06:30:18.2937948Z  2025-03-14T06:30:18.2938445Z  2025-03-14T06:30:18.2938884Z  2025-03-14T06:30:18.2939309Z  2025-03-14T06:30:18.2939755Z  2025-03-14T06:30:18.2940173Z  2025-03-14T06:30:18.2940576Z  2025-03-14T06:30:18.2940970Z  2025-03-14T06:30:18.2942233Z [15,558 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:18.2943475Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 128s local 2025-03-14T06:30:18.2944677Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T06:30:18.2945545Z Compiling llvm/lib/IR/Verifier.cpp; 12s local 2025-03-14T06:30:18.2946590Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:18.2947684Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T06:30:18.2948525Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2025-03-14T06:30:18.2949590Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 8s local 2025-03-14T06:30:18.2950685Z @llvm-project//mlir:PDLToPDLInterp; 7s local ... 2025-03-14T06:30:18.6227488Z 2025-03-14T06:30:18.6228329Z  2025-03-14T06:30:18.6228814Z  2025-03-14T06:30:18.6229227Z  2025-03-14T06:30:18.6229635Z  2025-03-14T06:30:18.6230061Z  2025-03-14T06:30:18.6230472Z  2025-03-14T06:30:18.6230873Z  2025-03-14T06:30:18.6231272Z  2025-03-14T06:30:18.6232209Z [15,559 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:18.6233351Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T06:30:18.6234483Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T06:30:18.6235383Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T06:30:18.6236356Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:18.6247629Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T06:30:18.6248674Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2025-03-14T06:30:18.6250043Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 9s local 2025-03-14T06:30:18.6251111Z @llvm-project//mlir:PDLToPDLInterp; 8s local ... 2025-03-14T06:30:18.8382531Z 2025-03-14T06:30:18.8383393Z  2025-03-14T06:30:18.8383881Z  2025-03-14T06:30:18.8384288Z  2025-03-14T06:30:18.8384685Z  2025-03-14T06:30:18.8385066Z  2025-03-14T06:30:18.8385438Z  2025-03-14T06:30:18.8385845Z  2025-03-14T06:30:18.8386226Z  2025-03-14T06:30:18.8387156Z [15,560 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:18.8388316Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T06:30:18.8389703Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 28s local 2025-03-14T06:30:18.8390544Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T06:30:18.8391591Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 12s local 2025-03-14T06:30:18.8392669Z Compiling llvm/lib/IR/AsmWriter.cpp; 11s local 2025-03-14T06:30:18.8393480Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 10s local 2025-03-14T06:30:18.8394507Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 9s local 2025-03-14T06:30:18.8395453Z @llvm-project//mlir:PDLToPDLInterp; 8s local ... 2025-03-14T06:30:19.0944824Z 2025-03-14T06:30:19.0945689Z  2025-03-14T06:30:19.0946183Z  2025-03-14T06:30:19.0946613Z  2025-03-14T06:30:19.0947000Z  2025-03-14T06:30:19.0947691Z  2025-03-14T06:30:19.0948086Z  2025-03-14T06:30:19.0948485Z  2025-03-14T06:30:19.0948875Z  2025-03-14T06:30:19.0949819Z [15,565 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:19.0951013Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T06:30:19.0952117Z Compiling mlir/lib/Dialect/PDLInterp/IR/PDLInterp.cpp; 29s local 2025-03-14T06:30:19.0953020Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T06:30:19.0954275Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 12s local 2025-03-14T06:30:19.0955228Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T06:30:19.0955981Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T06:30:19.0957011Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 9s local 2025-03-14T06:30:19.0957999Z @llvm-project//mlir:PDLToPDLInterp; 8s local ... 2025-03-14T06:30:19.3210260Z 2025-03-14T06:30:19.3211129Z  2025-03-14T06:30:19.3211645Z  2025-03-14T06:30:19.3212062Z  2025-03-14T06:30:19.3212462Z  2025-03-14T06:30:19.3212850Z  2025-03-14T06:30:19.3213302Z  2025-03-14T06:30:19.3213738Z  2025-03-14T06:30:19.3214161Z  2025-03-14T06:30:19.3215177Z [15,570 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:19.3216376Z Compiling xla/backends/cpu/runtime/convolution_thunk_f32.cc; 129s local 2025-03-14T06:30:19.3217322Z Compiling llvm/lib/IR/Verifier.cpp; 13s local 2025-03-14T06:30:19.3218145Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T06:30:19.3218940Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T06:30:19.3219921Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 9s local 2025-03-14T06:30:19.3221136Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 8s local 2025-03-14T06:30:19.3222183Z Compiling mlir/lib/AsmParser/Parser.cpp; 8s local 2025-03-14T06:30:19.3222984Z Compiling llvm/lib/Object/ELF.cpp; 7s local ... 2025-03-14T06:30:19.5974814Z 2025-03-14T06:30:19.5975729Z  2025-03-14T06:30:19.5976255Z  2025-03-14T06:30:19.5976699Z  2025-03-14T06:30:19.5977099Z  2025-03-14T06:30:19.5977486Z  2025-03-14T06:30:19.5977915Z  2025-03-14T06:30:19.5978316Z  2025-03-14T06:30:19.5978754Z  2025-03-14T06:30:19.5980031Z [15,573 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:19.5981059Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T06:30:19.5981785Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T06:30:19.5982607Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 11s local 2025-03-14T06:30:19.5983695Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 10s local 2025-03-14T06:30:19.5985008Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 9s local 2025-03-14T06:30:19.5986070Z Compiling mlir/lib/AsmParser/Parser.cpp; 9s local 2025-03-14T06:30:19.5986854Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2025-03-14T06:30:19.5987927Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 7s local ... 2025-03-14T06:30:19.8952493Z 2025-03-14T06:30:19.8953344Z  2025-03-14T06:30:19.8953846Z  2025-03-14T06:30:19.8954276Z  2025-03-14T06:30:19.8954645Z  2025-03-14T06:30:19.8955081Z  2025-03-14T06:30:19.8955506Z  2025-03-14T06:30:19.8955933Z  2025-03-14T06:30:19.8956343Z  2025-03-14T06:30:19.8957306Z [15,575 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:19.8958319Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T06:30:19.8959054Z Compiling llvm/lib/IR/AsmWriter.cpp; 12s local 2025-03-14T06:30:19.8959806Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T06:30:19.8961205Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 10s local 2025-03-14T06:30:19.8962490Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 9s local 2025-03-14T06:30:19.8963521Z Compiling mlir/lib/AsmParser/Parser.cpp; 9s local 2025-03-14T06:30:19.8964282Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2025-03-14T06:30:19.8965494Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 7s local ... 2025-03-14T06:30:20.2571611Z 2025-03-14T06:30:20.2572500Z  2025-03-14T06:30:20.2572994Z  2025-03-14T06:30:20.2573428Z  2025-03-14T06:30:20.2573845Z  2025-03-14T06:30:20.2574532Z  2025-03-14T06:30:20.2574952Z  2025-03-14T06:30:20.2575350Z  2025-03-14T06:30:20.2575788Z  2025-03-14T06:30:20.2576881Z [15,576 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:20.2577901Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T06:30:20.2578670Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2025-03-14T06:30:20.2579435Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T06:30:20.2580484Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 10s local 2025-03-14T06:30:20.2581801Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 9s local 2025-03-14T06:30:20.2582880Z Compiling mlir/lib/AsmParser/Parser.cpp; 9s local 2025-03-14T06:30:20.2583634Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2025-03-14T06:30:20.2584482Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local ... 2025-03-14T06:30:20.4960452Z 2025-03-14T06:30:20.4961298Z  2025-03-14T06:30:20.4961748Z  2025-03-14T06:30:20.4962157Z  2025-03-14T06:30:20.4962522Z  2025-03-14T06:30:20.4962864Z  2025-03-14T06:30:20.4963274Z  2025-03-14T06:30:20.4963668Z  2025-03-14T06:30:20.4964072Z  2025-03-14T06:30:20.4965121Z [15,577 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:20.4966206Z Compiling llvm/lib/IR/Verifier.cpp; 14s local 2025-03-14T06:30:20.4966843Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2025-03-14T06:30:20.4967545Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T06:30:20.4968579Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 11s local 2025-03-14T06:30:20.4970216Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 10s local 2025-03-14T06:30:20.4971277Z Compiling mlir/lib/AsmParser/Parser.cpp; 9s local 2025-03-14T06:30:20.4972076Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2025-03-14T06:30:20.4972950Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local ... 2025-03-14T06:30:20.6964409Z 2025-03-14T06:30:20.6965628Z  2025-03-14T06:30:20.6966126Z  2025-03-14T06:30:20.6966556Z  2025-03-14T06:30:20.6966953Z  2025-03-14T06:30:20.6967373Z  2025-03-14T06:30:20.6967782Z  2025-03-14T06:30:20.6968211Z  2025-03-14T06:30:20.6968615Z  2025-03-14T06:30:20.6969587Z [15,578 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:20.6970918Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T06:30:20.6971693Z Compiling llvm/lib/IR/AsmWriter.cpp; 13s local 2025-03-14T06:30:20.6972490Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 12s local 2025-03-14T06:30:20.6973539Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 11s local 2025-03-14T06:30:20.6974725Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 10s local 2025-03-14T06:30:20.6975768Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local 2025-03-14T06:30:20.6976566Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2025-03-14T06:30:20.6977458Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local ... 2025-03-14T06:30:20.9084695Z 2025-03-14T06:30:20.9085559Z  2025-03-14T06:30:20.9086394Z  2025-03-14T06:30:20.9086786Z  2025-03-14T06:30:20.9087179Z  2025-03-14T06:30:20.9087585Z  2025-03-14T06:30:20.9087980Z  2025-03-14T06:30:20.9088390Z  2025-03-14T06:30:20.9088798Z  2025-03-14T06:30:20.9089779Z [15,582 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:20.9090824Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T06:30:20.9091654Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T06:30:20.9092728Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 11s local 2025-03-14T06:30:20.9094255Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 10s local 2025-03-14T06:30:20.9095348Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local 2025-03-14T06:30:20.9096095Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2025-03-14T06:30:20.9096919Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local 2025-03-14T06:30:20.9097769Z Compiling xla/literal.cc; 8s local ... 2025-03-14T06:30:21.2971247Z 2025-03-14T06:30:21.2972088Z  2025-03-14T06:30:21.2972578Z  2025-03-14T06:30:21.2972988Z  2025-03-14T06:30:21.2973367Z  2025-03-14T06:30:21.2973805Z  2025-03-14T06:30:21.2974200Z  2025-03-14T06:30:21.2974600Z  2025-03-14T06:30:21.2974959Z  2025-03-14T06:30:21.2975942Z [15,584 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:21.2976938Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T06:30:21.2977682Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T06:30:21.2978628Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 11s local 2025-03-14T06:30:21.2979772Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 10s local 2025-03-14T06:30:21.2980954Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local 2025-03-14T06:30:21.2981710Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T06:30:21.2982552Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local 2025-03-14T06:30:21.2983352Z Compiling xla/literal.cc; 8s local ... 2025-03-14T06:30:21.4975908Z 2025-03-14T06:30:21.4976744Z  2025-03-14T06:30:21.4977262Z  2025-03-14T06:30:21.4977702Z  2025-03-14T06:30:21.4978135Z  2025-03-14T06:30:21.4978563Z  2025-03-14T06:30:21.4979009Z  2025-03-14T06:30:21.4979442Z  2025-03-14T06:30:21.4980212Z  2025-03-14T06:30:21.4981237Z [15,586 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:21.4982240Z Compiling llvm/lib/IR/Verifier.cpp; 15s local 2025-03-14T06:30:21.4983051Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T06:30:21.4984139Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 12s local 2025-03-14T06:30:21.4985478Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 11s local 2025-03-14T06:30:21.4986455Z Compiling mlir/lib/AsmParser/Parser.cpp; 10s local 2025-03-14T06:30:21.4987216Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T06:30:21.4988080Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local 2025-03-14T06:30:21.4989176Z Compiling xla/literal.cc; 8s local ... 2025-03-14T06:30:21.8042265Z 2025-03-14T06:30:21.8043094Z  2025-03-14T06:30:21.8043536Z  2025-03-14T06:30:21.8043946Z  2025-03-14T06:30:21.8044365Z  2025-03-14T06:30:21.8044870Z  2025-03-14T06:30:21.8045273Z  2025-03-14T06:30:21.8045678Z  2025-03-14T06:30:21.8046078Z  2025-03-14T06:30:21.8046999Z [15,588 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:21.8047929Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T06:30:21.8048624Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 13s local 2025-03-14T06:30:21.8049622Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 12s local 2025-03-14T06:30:21.8051169Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 11s local 2025-03-14T06:30:21.8052225Z Compiling mlir/lib/AsmParser/Parser.cpp; 11s local 2025-03-14T06:30:21.8053027Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T06:30:21.8053856Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local 2025-03-14T06:30:21.8054711Z Compiling xla/literal.cc; 9s local ... 2025-03-14T06:30:22.0374953Z 2025-03-14T06:30:22.0376328Z  2025-03-14T06:30:22.0377386Z  2025-03-14T06:30:22.0378542Z  2025-03-14T06:30:22.0379030Z  2025-03-14T06:30:22.0379701Z  2025-03-14T06:30:22.0380172Z  2025-03-14T06:30:22.0380621Z  2025-03-14T06:30:22.0381075Z  2025-03-14T06:30:22.0382113Z [15,601 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:22.0383231Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T06:30:22.0384065Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T06:30:22.0385195Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 11s local 2025-03-14T06:30:22.0386317Z Compiling mlir/lib/AsmParser/Parser.cpp; 11s local 2025-03-14T06:30:22.0387089Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T06:30:22.0387905Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local 2025-03-14T06:30:22.0388789Z Compiling xla/literal.cc; 9s local 2025-03-14T06:30:22.0389815Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local ... 2025-03-14T06:30:22.2536051Z 2025-03-14T06:30:22.2536990Z  2025-03-14T06:30:22.2537505Z  2025-03-14T06:30:22.2537932Z  2025-03-14T06:30:22.2538367Z  2025-03-14T06:30:22.2538807Z  2025-03-14T06:30:22.2539230Z  2025-03-14T06:30:22.2539646Z  2025-03-14T06:30:22.2540079Z  2025-03-14T06:30:22.2541041Z [15,616 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:22.2542078Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T06:30:22.2542884Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T06:30:22.2543926Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 11s local 2025-03-14T06:30:22.2544988Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T06:30:22.2545828Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2025-03-14T06:30:22.2546975Z Compiling xla/literal.cc; 9s local 2025-03-14T06:30:22.2547818Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local 2025-03-14T06:30:22.2548787Z Compiling llvm/lib/IR/Constants.cpp; 8s local ... 2025-03-14T06:30:22.4691988Z 2025-03-14T06:30:22.4692965Z  2025-03-14T06:30:22.4693449Z  2025-03-14T06:30:22.4693861Z  2025-03-14T06:30:22.4694269Z  2025-03-14T06:30:22.4694676Z  2025-03-14T06:30:22.4695055Z  2025-03-14T06:30:22.4695442Z  2025-03-14T06:30:22.4695841Z  2025-03-14T06:30:22.4696755Z [15,628 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:22.4697704Z Compiling llvm/lib/IR/Verifier.cpp; 16s local 2025-03-14T06:30:22.4698705Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T06:30:22.4699768Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 12s local 2025-03-14T06:30:22.4700807Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T06:30:22.4701634Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2025-03-14T06:30:22.4702467Z Compiling xla/literal.cc; 9s local 2025-03-14T06:30:22.4703273Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T06:30:22.4704203Z Compiling llvm/lib/IR/Constants.cpp; 8s local ... 2025-03-14T06:30:22.6961121Z 2025-03-14T06:30:22.6962138Z  2025-03-14T06:30:22.6962873Z  2025-03-14T06:30:22.6963459Z  2025-03-14T06:30:22.6964375Z  2025-03-14T06:30:22.6965098Z  2025-03-14T06:30:22.6965871Z  2025-03-14T06:30:22.6966421Z  2025-03-14T06:30:22.6966963Z  2025-03-14T06:30:22.6968083Z [15,645 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:22.6969403Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T06:30:22.6970293Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 14s local 2025-03-14T06:30:22.6971457Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PredicateTree.cpp; 12s local 2025-03-14T06:30:22.6972620Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T06:30:22.6973781Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2025-03-14T06:30:22.6974758Z Compiling xla/literal.cc; 10s local 2025-03-14T06:30:22.6975668Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T06:30:22.6976691Z Compiling llvm/lib/IR/Constants.cpp; 8s local ... 2025-03-14T06:30:22.8980661Z 2025-03-14T06:30:22.8981557Z  2025-03-14T06:30:22.8982048Z  2025-03-14T06:30:22.8982448Z  2025-03-14T06:30:22.8982947Z  2025-03-14T06:30:22.8983357Z  2025-03-14T06:30:22.8983763Z  2025-03-14T06:30:22.8984170Z  2025-03-14T06:30:22.8984542Z  2025-03-14T06:30:22.8985509Z [15,652 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:22.8986529Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T06:30:22.8987260Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T06:30:22.8987995Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T06:30:22.8988814Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2025-03-14T06:30:22.8989615Z Compiling xla/literal.cc; 10s local 2025-03-14T06:30:22.8990394Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T06:30:22.8991177Z Compiling llvm/lib/IR/Constants.cpp; 8s local 2025-03-14T06:30:22.8991878Z Compiling llvm/lib/IR/Core.cpp; 7s local ... 2025-03-14T06:30:23.2986638Z 2025-03-14T06:30:23.2987620Z  2025-03-14T06:30:23.2988330Z  2025-03-14T06:30:23.2988859Z  2025-03-14T06:30:23.2989412Z  2025-03-14T06:30:23.2990053Z  2025-03-14T06:30:23.2990548Z  2025-03-14T06:30:23.2991055Z  2025-03-14T06:30:23.2991557Z  2025-03-14T06:30:23.2992851Z [15,656 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:23.2994052Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T06:30:23.2994934Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T06:30:23.2995706Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T06:30:23.2996649Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2025-03-14T06:30:23.2997529Z Compiling xla/literal.cc; 10s local 2025-03-14T06:30:23.2998419Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T06:30:23.2999398Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2025-03-14T06:30:23.3000245Z Compiling llvm/lib/IR/Core.cpp; 7s local ... 2025-03-14T06:30:23.4991385Z 2025-03-14T06:30:23.4992567Z  2025-03-14T06:30:23.4995202Z  2025-03-14T06:30:23.4997316Z  2025-03-14T06:30:23.4997768Z  2025-03-14T06:30:23.4998190Z  2025-03-14T06:30:23.4998623Z  2025-03-14T06:30:23.4999052Z  2025-03-14T06:30:23.4999482Z  2025-03-14T06:30:23.5000534Z [15,660 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:23.5001602Z Compiling llvm/lib/IR/Verifier.cpp; 17s local 2025-03-14T06:30:23.5002413Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T06:30:23.5003180Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T06:30:23.5004067Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2025-03-14T06:30:23.5005061Z Compiling xla/literal.cc; 10s local 2025-03-14T06:30:23.5006142Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T06:30:23.5007083Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2025-03-14T06:30:23.5007828Z Compiling llvm/lib/IR/Core.cpp; 8s local ... 2025-03-14T06:30:23.7594007Z 2025-03-14T06:30:23.7595017Z  2025-03-14T06:30:23.7595354Z  2025-03-14T06:30:23.7595663Z  2025-03-14T06:30:23.7595913Z  2025-03-14T06:30:23.7596165Z  2025-03-14T06:30:23.7596435Z  2025-03-14T06:30:23.7596681Z  2025-03-14T06:30:23.7596941Z  2025-03-14T06:30:23.7599086Z [15,662 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:23.7599691Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:30:23.7600141Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 15s local 2025-03-14T06:30:23.7600577Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T06:30:23.7601061Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2025-03-14T06:30:23.7601533Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:23.7602004Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T06:30:23.7602522Z Compiling llvm/lib/IR/Constants.cpp; 9s local 2025-03-14T06:30:23.7602941Z Compiling llvm/lib/IR/Core.cpp; 8s local ... 2025-03-14T06:30:24.0012514Z 2025-03-14T06:30:24.0013407Z  2025-03-14T06:30:24.0013911Z  2025-03-14T06:30:24.0014342Z  2025-03-14T06:30:24.0014848Z  2025-03-14T06:30:24.0015266Z  2025-03-14T06:30:24.0015673Z  2025-03-14T06:30:24.0016074Z  2025-03-14T06:30:24.0016516Z  2025-03-14T06:30:24.0017485Z [15,665 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:24.0018495Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:30:24.0019275Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T06:30:24.0020010Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T06:30:24.0020883Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2025-03-14T06:30:24.0021713Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:24.0022564Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T06:30:24.0023498Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:30:24.0024243Z Compiling llvm/lib/IR/Core.cpp; 8s local ... 2025-03-14T06:30:24.2180705Z 2025-03-14T06:30:24.2181821Z  2025-03-14T06:30:24.2182385Z  2025-03-14T06:30:24.2182804Z  2025-03-14T06:30:24.2183223Z  2025-03-14T06:30:24.2183671Z  2025-03-14T06:30:24.2184078Z  2025-03-14T06:30:24.2184501Z  2025-03-14T06:30:24.2184917Z  2025-03-14T06:30:24.2185916Z [15,667 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:24.2186931Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:30:24.2187712Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T06:30:24.2188462Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T06:30:24.2189332Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2025-03-14T06:30:24.2190384Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:24.2191191Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T06:30:24.2192101Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:30:24.2192872Z Compiling llvm/lib/IR/Core.cpp; 8s local ... 2025-03-14T06:30:24.4775133Z 2025-03-14T06:30:24.4775939Z  2025-03-14T06:30:24.4776424Z  2025-03-14T06:30:24.4776847Z  2025-03-14T06:30:24.4777228Z  2025-03-14T06:30:24.4777636Z  2025-03-14T06:30:24.4778040Z  2025-03-14T06:30:24.4778461Z  2025-03-14T06:30:24.4778875Z  2025-03-14T06:30:24.4779857Z [15,670 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:24.4781177Z Compiling llvm/lib/IR/Verifier.cpp; 18s local 2025-03-14T06:30:24.4781941Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T06:30:24.4782681Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T06:30:24.4783567Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2025-03-14T06:30:24.4784375Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:24.4785262Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2025-03-14T06:30:24.4786201Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:30:24.4786948Z Compiling llvm/lib/IR/Core.cpp; 9s local ... 2025-03-14T06:30:24.7001126Z 2025-03-14T06:30:24.7001999Z  2025-03-14T06:30:24.7002501Z  2025-03-14T06:30:24.7002914Z  2025-03-14T06:30:24.7003337Z  2025-03-14T06:30:24.7003743Z  2025-03-14T06:30:24.7004165Z  2025-03-14T06:30:24.7004703Z  2025-03-14T06:30:24.7005128Z  2025-03-14T06:30:24.7006082Z [15,673 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:24.7007097Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2025-03-14T06:30:24.7007806Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 16s local 2025-03-14T06:30:24.7008521Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T06:30:24.7009358Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2025-03-14T06:30:24.7010151Z Compiling xla/literal.cc; 12s local 2025-03-14T06:30:24.7010831Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:30:24.7011650Z Compiling llvm/lib/IR/Core.cpp; 9s local 2025-03-14T06:30:24.7012398Z @llvm-project//mlir:PDLToPDLInterp; 9s local ... 2025-03-14T06:30:24.9117219Z 2025-03-14T06:30:24.9118031Z  2025-03-14T06:30:24.9118538Z  2025-03-14T06:30:24.9118977Z  2025-03-14T06:30:24.9119421Z  2025-03-14T06:30:24.9119854Z  2025-03-14T06:30:24.9120287Z  2025-03-14T06:30:24.9120712Z  2025-03-14T06:30:24.9121154Z  2025-03-14T06:30:24.9122149Z [15,676 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:24.9123150Z Compiling llvm/lib/IR/Verifier.cpp; 19s local 2025-03-14T06:30:24.9123929Z Compiling llvm/lib/IR/AutoUpgrade.cpp; 17s local 2025-03-14T06:30:24.9124859Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T06:30:24.9125932Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2025-03-14T06:30:24.9126752Z Compiling xla/literal.cc; 12s local 2025-03-14T06:30:24.9127417Z Compiling llvm/lib/IR/Constants.cpp; 10s local 2025-03-14T06:30:24.9128131Z Compiling llvm/lib/IR/Core.cpp; 9s local 2025-03-14T06:30:24.9128870Z @llvm-project//mlir:PDLToPDLInterp; 9s local ... 2025-03-14T06:30:25.2182716Z 2025-03-14T06:30:25.2183812Z  2025-03-14T06:30:25.2184536Z  2025-03-14T06:30:25.2185109Z  2025-03-14T06:30:25.2185652Z  2025-03-14T06:30:25.2186178Z  2025-03-14T06:30:25.2186873Z  2025-03-14T06:30:25.2187411Z  2025-03-14T06:30:25.2187950Z  2025-03-14T06:30:25.2189142Z [15,682 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:25.2190610Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T06:30:25.2191592Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:25.2192477Z Compiling xla/literal.cc; 12s local 2025-03-14T06:30:25.2193288Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T06:30:25.2194458Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 9s local 2025-03-14T06:30:25.2195695Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2025-03-14T06:30:25.2196531Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T06:30:25.2197551Z Compiling llvm/lib/DebugInfo/Symbolize/Symbolize.cpp; 7s local ... 2025-03-14T06:30:25.4211729Z 2025-03-14T06:30:25.4212644Z  2025-03-14T06:30:25.4213754Z  2025-03-14T06:30:25.4214342Z  2025-03-14T06:30:25.4214884Z  2025-03-14T06:30:25.4215419Z  2025-03-14T06:30:25.4215969Z  2025-03-14T06:30:25.4216507Z  2025-03-14T06:30:25.4217056Z  2025-03-14T06:30:25.4218138Z [15,687 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:25.4219265Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T06:30:25.4220297Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:25.4221219Z Compiling xla/literal.cc; 12s local 2025-03-14T06:30:25.4222216Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T06:30:25.4223345Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 9s local 2025-03-14T06:30:25.4224497Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2025-03-14T06:30:25.4225360Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T06:30:25.4226216Z Compiling llvm/lib/IR/DebugInfo.cpp; 6s local ... 2025-03-14T06:30:25.6651300Z 2025-03-14T06:30:25.6652276Z  2025-03-14T06:30:25.6652776Z  2025-03-14T06:30:25.6653180Z  2025-03-14T06:30:25.6653596Z  2025-03-14T06:30:25.6654272Z  2025-03-14T06:30:25.6654684Z  2025-03-14T06:30:25.6655244Z  2025-03-14T06:30:25.6655861Z  2025-03-14T06:30:25.6656988Z [15,689 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:25.6658109Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T06:30:25.6659009Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:25.6659850Z Compiling xla/literal.cc; 12s local 2025-03-14T06:30:25.6660571Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T06:30:25.6661642Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 10s local 2025-03-14T06:30:25.6662741Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2025-03-14T06:30:25.6663585Z Compiling llvm/lib/IR/Metadata.cpp; 8s local 2025-03-14T06:30:25.6664433Z Compiling llvm/lib/IR/DebugInfo.cpp; 6s local ... 2025-03-14T06:30:25.9011210Z 2025-03-14T06:30:25.9012192Z  2025-03-14T06:30:25.9012678Z  2025-03-14T06:30:25.9013048Z  2025-03-14T06:30:25.9013406Z  2025-03-14T06:30:25.9013839Z  2025-03-14T06:30:25.9014255Z  2025-03-14T06:30:25.9014644Z  2025-03-14T06:30:25.9015047Z  2025-03-14T06:30:25.9016213Z [15,689 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:25.9017248Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T06:30:25.9017999Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:25.9018713Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:25.9019340Z Compiling llvm/lib/IR/Constants.cpp; 11s local 2025-03-14T06:30:25.9020301Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 10s local 2025-03-14T06:30:25.9021363Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2025-03-14T06:30:25.9022127Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T06:30:25.9022857Z Compiling llvm/lib/IR/DebugInfo.cpp; 6s local ... 2025-03-14T06:30:26.1014954Z 2025-03-14T06:30:26.1016522Z  2025-03-14T06:30:26.1017048Z  2025-03-14T06:30:26.1018433Z  2025-03-14T06:30:26.1019641Z  2025-03-14T06:30:26.1020697Z  2025-03-14T06:30:26.1022018Z  2025-03-14T06:30:26.1023270Z  2025-03-14T06:30:26.1024662Z  2025-03-14T06:30:26.1026358Z [15,692 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:26.1027281Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:30:26.1028036Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:26.1028768Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:26.1029633Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 10s local 2025-03-14T06:30:26.1030809Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2025-03-14T06:30:26.1031473Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T06:30:26.1032151Z Compiling llvm/lib/IR/DebugInfo.cpp; 6s local 2025-03-14T06:30:26.1032853Z Compiling xla/service/shaped_buffer.cc; 6s local ... 2025-03-14T06:30:26.3674163Z 2025-03-14T06:30:26.3676317Z  2025-03-14T06:30:26.3677426Z  2025-03-14T06:30:26.3678387Z  2025-03-14T06:30:26.3679608Z  2025-03-14T06:30:26.3680807Z  2025-03-14T06:30:26.3682254Z  2025-03-14T06:30:26.3683582Z  2025-03-14T06:30:26.3685439Z  2025-03-14T06:30:26.3686926Z [15,693 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:26.3687851Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:30:26.3688709Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T06:30:26.3689548Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:26.3690415Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 10s local 2025-03-14T06:30:26.3691441Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2025-03-14T06:30:26.3692221Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T06:30:26.3692954Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2025-03-14T06:30:26.3693687Z Compiling xla/service/shaped_buffer.cc; 7s local ... 2025-03-14T06:30:26.6540408Z 2025-03-14T06:30:26.6541866Z  2025-03-14T06:30:26.6542374Z  2025-03-14T06:30:26.6543879Z  2025-03-14T06:30:26.6544379Z  2025-03-14T06:30:26.6544833Z  2025-03-14T06:30:26.6545237Z  2025-03-14T06:30:26.6545677Z  2025-03-14T06:30:26.6546091Z  2025-03-14T06:30:26.6547065Z [15,695 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:26.6548094Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:30:26.6548964Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T06:30:26.6549824Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:26.6550744Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:26.6551696Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2025-03-14T06:30:26.6552312Z Compiling llvm/lib/IR/Metadata.cpp; 9s local 2025-03-14T06:30:26.6553268Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2025-03-14T06:30:26.6554073Z Compiling xla/service/shaped_buffer.cc; 7s local ... 2025-03-14T06:30:26.9021715Z 2025-03-14T06:30:26.9023189Z  2025-03-14T06:30:26.9023710Z  2025-03-14T06:30:26.9025308Z  2025-03-14T06:30:26.9026756Z  2025-03-14T06:30:26.9028133Z  2025-03-14T06:30:26.9029522Z  2025-03-14T06:30:26.9030858Z  2025-03-14T06:30:26.9032262Z  2025-03-14T06:30:26.9034190Z [15,697 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:26.9035236Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:30:26.9036078Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T06:30:26.9037120Z Compiling xla/literal.cc; 14s local 2025-03-14T06:30:26.9038083Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:26.9039116Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2025-03-14T06:30:26.9039877Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T06:30:26.9040620Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2025-03-14T06:30:26.9041407Z Compiling xla/service/shaped_buffer.cc; 7s local ... 2025-03-14T06:30:27.1115676Z 2025-03-14T06:30:27.1117377Z  2025-03-14T06:30:27.1117893Z  2025-03-14T06:30:27.1119459Z  2025-03-14T06:30:27.1119963Z  2025-03-14T06:30:27.1120437Z  2025-03-14T06:30:27.1122501Z  2025-03-14T06:30:27.1122960Z  2025-03-14T06:30:27.1123767Z  2025-03-14T06:30:27.1126514Z [15,698 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:27.1127530Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T06:30:27.1128365Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T06:30:27.1129074Z Compiling xla/literal.cc; 14s local 2025-03-14T06:30:27.1130036Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:27.1131143Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2025-03-14T06:30:27.1132122Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T06:30:27.1132871Z Compiling llvm/lib/IR/DebugInfo.cpp; 7s local 2025-03-14T06:30:27.1133751Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 7s local ... 2025-03-14T06:30:27.4469508Z 2025-03-14T06:30:27.4470588Z  2025-03-14T06:30:27.4471084Z  2025-03-14T06:30:27.4471532Z  2025-03-14T06:30:27.4471936Z  2025-03-14T06:30:27.4472383Z  2025-03-14T06:30:27.4472788Z  2025-03-14T06:30:27.4473168Z  2025-03-14T06:30:27.4473549Z  2025-03-14T06:30:27.4474495Z [15,699 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:27.4475484Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T06:30:27.4476206Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T06:30:27.4477026Z Compiling xla/literal.cc; 14s local 2025-03-14T06:30:27.4477945Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:27.4478906Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2025-03-14T06:30:27.4479641Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T06:30:27.4480346Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T06:30:27.4481196Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 7s local ... 2025-03-14T06:30:27.6479829Z 2025-03-14T06:30:27.6481069Z  2025-03-14T06:30:27.6481589Z  2025-03-14T06:30:27.6481996Z  2025-03-14T06:30:27.6482375Z  2025-03-14T06:30:27.6482771Z  2025-03-14T06:30:27.6483173Z  2025-03-14T06:30:27.6483591Z  2025-03-14T06:30:27.6483985Z  2025-03-14T06:30:27.6485001Z [15,704 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:27.6485893Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T06:30:27.6486815Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T06:30:27.6487426Z Compiling xla/literal.cc; 14s local 2025-03-14T06:30:27.6488279Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 11s local 2025-03-14T06:30:27.6489259Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2025-03-14T06:30:27.6489984Z Compiling llvm/lib/IR/Metadata.cpp; 10s local 2025-03-14T06:30:27.6490686Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T06:30:27.6491486Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2025-03-14T06:30:27.9030760Z 2025-03-14T06:30:27.9032015Z  2025-03-14T06:30:27.9032521Z  2025-03-14T06:30:27.9032910Z  2025-03-14T06:30:27.9033311Z  2025-03-14T06:30:27.9033984Z  2025-03-14T06:30:27.9034376Z  2025-03-14T06:30:27.9034762Z  2025-03-14T06:30:27.9035136Z  2025-03-14T06:30:27.9036061Z [15,706 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:27.9036938Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T06:30:27.9037719Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T06:30:27.9038629Z Compiling xla/literal.cc; 15s local 2025-03-14T06:30:27.9039522Z Compiling mlir/lib/Conversion/PDLToPDLInterp/PDLToPDLInterp.cpp; 12s local 2025-03-14T06:30:27.9040494Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2025-03-14T06:30:27.9041227Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T06:30:27.9042227Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T06:30:27.9043027Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local ... 2025-03-14T06:30:28.1158492Z 2025-03-14T06:30:28.1159789Z  2025-03-14T06:30:28.1160238Z  2025-03-14T06:30:28.1160633Z  2025-03-14T06:30:28.1161000Z  2025-03-14T06:30:28.1161376Z  2025-03-14T06:30:28.1161742Z  2025-03-14T06:30:28.1162118Z  2025-03-14T06:30:28.1162497Z  2025-03-14T06:30:28.1163494Z [15,709 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:28.1164857Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T06:30:28.1165954Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T06:30:28.1166674Z Compiling xla/literal.cc; 15s local 2025-03-14T06:30:28.1167256Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T06:30:28.1167924Z Compiling llvm/lib/IR/DebugInfo.cpp; 8s local 2025-03-14T06:30:28.1168693Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2025-03-14T06:30:28.1169403Z Compiling xla/shape_util.cc; 7s local 2025-03-14T06:30:28.1170046Z Compiling xla/hlo/ir/hlo_sharding.cc; 5s local ... 2025-03-14T06:30:28.3984135Z 2025-03-14T06:30:28.3985111Z  2025-03-14T06:30:28.3985642Z  2025-03-14T06:30:28.3988030Z  2025-03-14T06:30:28.3991110Z  2025-03-14T06:30:28.3994128Z  2025-03-14T06:30:28.3997182Z  2025-03-14T06:30:28.4000153Z  2025-03-14T06:30:28.4003618Z  2025-03-14T06:30:28.4007723Z [15,711 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:28.4011707Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T06:30:28.4014982Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T06:30:28.4017113Z Compiling xla/literal.cc; 15s local 2025-03-14T06:30:28.4017947Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T06:30:28.4018866Z Compiling llvm/lib/IR/DebugInfo.cpp; 9s local 2025-03-14T06:30:28.4019833Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 8s local 2025-03-14T06:30:28.4020938Z Compiling xla/shape_util.cc; 7s local 2025-03-14T06:30:28.4022144Z Compiling xla/hlo/ir/hlo_sharding.cc; 6s local ... 2025-03-14T06:30:28.7037391Z 2025-03-14T06:30:28.7038776Z  2025-03-14T06:30:28.7039537Z  2025-03-14T06:30:28.7040674Z  2025-03-14T06:30:28.7041446Z  2025-03-14T06:30:28.7041889Z  2025-03-14T06:30:28.7042302Z  2025-03-14T06:30:28.7042728Z  2025-03-14T06:30:28.7043139Z  2025-03-14T06:30:28.7044039Z [15,713 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:28.7045164Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T06:30:28.7045990Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T06:30:28.7046746Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:28.7047466Z Compiling llvm/lib/IR/Metadata.cpp; 11s local 2025-03-14T06:30:28.7048222Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2025-03-14T06:30:28.7048991Z Compiling xla/shape_util.cc; 7s local 2025-03-14T06:30:28.7049842Z Compiling xla/hlo/ir/hlo_sharding.cc; 6s local 2025-03-14T06:30:28.7050611Z Compiling xla/service/shaped_buffer.cc; 5s local ... 2025-03-14T06:30:28.9043239Z 2025-03-14T06:30:28.9044177Z  2025-03-14T06:30:28.9044772Z  2025-03-14T06:30:28.9045153Z  2025-03-14T06:30:28.9045496Z  2025-03-14T06:30:28.9045851Z  2025-03-14T06:30:28.9046214Z  2025-03-14T06:30:28.9046565Z  2025-03-14T06:30:28.9046920Z  2025-03-14T06:30:28.9047770Z [15,719 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:28.9048623Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T06:30:28.9049363Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T06:30:28.9050326Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:28.9050909Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T06:30:28.9051568Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2025-03-14T06:30:28.9052226Z Compiling xla/shape_util.cc; 8s local 2025-03-14T06:30:28.9052818Z Compiling xla/hlo/ir/hlo_sharding.cc; 6s local 2025-03-14T06:30:28.9053466Z Compiling xla/service/shaped_buffer.cc; 6s local ... 2025-03-14T06:30:29.2135367Z 2025-03-14T06:30:29.2136640Z  2025-03-14T06:30:29.2137092Z  2025-03-14T06:30:29.2137485Z  2025-03-14T06:30:29.2138104Z  2025-03-14T06:30:29.2138495Z  2025-03-14T06:30:29.2138875Z  2025-03-14T06:30:29.2139243Z  2025-03-14T06:30:29.2139604Z  2025-03-14T06:30:29.2140440Z [15,723 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:29.2141315Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T06:30:29.2142118Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T06:30:29.2142867Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:29.2143511Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T06:30:29.2144264Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2025-03-14T06:30:29.2144971Z Compiling xla/shape_util.cc; 8s local 2025-03-14T06:30:29.2145601Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2025-03-14T06:30:29.2146305Z Compiling xla/service/shaped_buffer.cc; 6s local ... 2025-03-14T06:30:29.4373744Z 2025-03-14T06:30:29.4374989Z  2025-03-14T06:30:29.4375438Z  2025-03-14T06:30:29.4375776Z  2025-03-14T06:30:29.4376140Z  2025-03-14T06:30:29.4376505Z  2025-03-14T06:30:29.4376873Z  2025-03-14T06:30:29.4377239Z  2025-03-14T06:30:29.4377601Z  2025-03-14T06:30:29.4378451Z [15,724 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:29.4379355Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T06:30:29.4380080Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T06:30:29.4380778Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:29.4381387Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T06:30:29.4382083Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 9s local 2025-03-14T06:30:29.4394734Z Compiling xla/shape_util.cc; 8s local 2025-03-14T06:30:29.4395569Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2025-03-14T06:30:29.4396305Z Compiling xla/service/shaped_buffer.cc; 6s local ... 2025-03-14T06:30:29.6411974Z 2025-03-14T06:30:29.6413202Z  2025-03-14T06:30:29.6413614Z  2025-03-14T06:30:29.6413921Z  2025-03-14T06:30:29.6414245Z  2025-03-14T06:30:29.6414569Z  2025-03-14T06:30:29.6414890Z  2025-03-14T06:30:29.6415222Z  2025-03-14T06:30:29.6415551Z  2025-03-14T06:30:29.6416341Z [15,727 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:29.6417125Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T06:30:29.6418026Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T06:30:29.6418773Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:29.6419316Z Compiling llvm/lib/IR/Metadata.cpp; 12s local 2025-03-14T06:30:29.6419973Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2025-03-14T06:30:29.6420568Z Compiling xla/shape_util.cc; 8s local 2025-03-14T06:30:29.6421129Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2025-03-14T06:30:29.6421766Z Compiling xla/service/shaped_buffer.cc; 6s local ... 2025-03-14T06:30:29.9050517Z 2025-03-14T06:30:29.9051798Z  2025-03-14T06:30:29.9052335Z  2025-03-14T06:30:29.9052758Z  2025-03-14T06:30:29.9053157Z  2025-03-14T06:30:29.9053561Z  2025-03-14T06:30:29.9053947Z  2025-03-14T06:30:29.9054659Z  2025-03-14T06:30:29.9055030Z  2025-03-14T06:30:29.9056020Z [15,727 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:29.9056981Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T06:30:29.9057769Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T06:30:29.9058532Z Compiling xla/literal.cc; 17s local 2025-03-14T06:30:29.9059198Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T06:30:29.9059966Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2025-03-14T06:30:29.9060911Z Compiling xla/shape_util.cc; 9s local 2025-03-14T06:30:29.9061608Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2025-03-14T06:30:29.9062367Z Compiling xla/service/shaped_buffer.cc; 7s local ... 2025-03-14T06:30:30.1459533Z 2025-03-14T06:30:30.1460363Z  2025-03-14T06:30:30.1460857Z  2025-03-14T06:30:30.1461250Z  2025-03-14T06:30:30.1461688Z  2025-03-14T06:30:30.1462081Z  2025-03-14T06:30:30.1462450Z  2025-03-14T06:30:30.1462850Z  2025-03-14T06:30:30.1463222Z  2025-03-14T06:30:30.1464144Z [15,731 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:30.1465145Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T06:30:30.1466253Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:30.1467232Z Compiling xla/literal.cc; 17s local 2025-03-14T06:30:30.1467855Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T06:30:30.1468604Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2025-03-14T06:30:30.1469844Z Compiling xla/shape_util.cc; 9s local 2025-03-14T06:30:30.1470654Z Compiling xla/hlo/ir/hlo_sharding.cc; 7s local 2025-03-14T06:30:30.1471541Z Compiling xla/service/shaped_buffer.cc; 7s local ... 2025-03-14T06:30:30.4156493Z 2025-03-14T06:30:30.4157443Z  2025-03-14T06:30:30.6783741Z  2025-03-14T06:30:30.6784177Z  2025-03-14T06:30:30.6784531Z  2025-03-14T06:30:30.6784912Z  2025-03-14T06:30:30.6785302Z  2025-03-14T06:30:30.6785706Z  2025-03-14T06:30:30.6786082Z  2025-03-14T06:30:30.6786883Z [15,733 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:30.6787799Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T06:30:30.6788794Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:30.6789463Z Compiling xla/literal.cc; 17s local 2025-03-14T06:30:30.6790099Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T06:30:30.6790766Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 10s local 2025-03-14T06:30:30.6791562Z Compiling xla/shape_util.cc; 9s local 2025-03-14T06:30:30.6792242Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2025-03-14T06:30:30.6792978Z Compiling xla/service/shaped_buffer.cc; 7s local ... 2025-03-14T06:30:30.6793430Z 2025-03-14T06:30:30.6793648Z  2025-03-14T06:30:30.6794042Z  2025-03-14T06:30:30.6794448Z  2025-03-14T06:30:30.6794822Z  2025-03-14T06:30:30.6795175Z  2025-03-14T06:30:30.6795681Z  2025-03-14T06:30:30.6796081Z  2025-03-14T06:30:30.6796524Z  2025-03-14T06:30:30.6797360Z [15,737 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:30.6798205Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T06:30:30.6798996Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:30.6799702Z Compiling xla/literal.cc; 17s local 2025-03-14T06:30:30.6800320Z Compiling llvm/lib/IR/Metadata.cpp; 13s local 2025-03-14T06:30:30.6801103Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2025-03-14T06:30:30.6801799Z Compiling xla/shape_util.cc; 9s local 2025-03-14T06:30:30.6802405Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2025-03-14T06:30:30.6803292Z Compiling xla/service/shaped_buffer.cc; 7s local ... 2025-03-14T06:30:30.9058710Z 2025-03-14T06:30:30.9059600Z  2025-03-14T06:30:30.9060083Z  2025-03-14T06:30:30.9060546Z  2025-03-14T06:30:30.9060961Z  2025-03-14T06:30:30.9061361Z  2025-03-14T06:30:30.9061761Z  2025-03-14T06:30:30.9062168Z  2025-03-14T06:30:30.9062592Z  2025-03-14T06:30:30.9063591Z [15,739 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:30.9065072Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:30.9067165Z Compiling xla/literal.cc; 18s local 2025-03-14T06:30:30.9067883Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T06:30:30.9068699Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2025-03-14T06:30:30.9069485Z Compiling xla/shape_util.cc; 10s local 2025-03-14T06:30:30.9070202Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2025-03-14T06:30:30.9071108Z Compiling llvm/lib/ProfileData/SampleProfWriter.cpp; 7s local 2025-03-14T06:30:30.9072144Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local ... 2025-03-14T06:30:31.1064815Z 2025-03-14T06:30:31.1065855Z  2025-03-14T06:30:31.1066392Z  2025-03-14T06:30:31.1066848Z  2025-03-14T06:30:31.1067279Z  2025-03-14T06:30:31.1067715Z  2025-03-14T06:30:31.1068157Z  2025-03-14T06:30:31.1068585Z  2025-03-14T06:30:31.1069056Z  2025-03-14T06:30:31.1070061Z [15,741 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:31.1071237Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:31.1072079Z Compiling xla/literal.cc; 18s local 2025-03-14T06:30:31.1072741Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T06:30:31.1073551Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2025-03-14T06:30:31.1074350Z Compiling xla/shape_util.cc; 10s local 2025-03-14T06:30:31.1074968Z Compiling xla/hlo/ir/hlo_sharding.cc; 8s local 2025-03-14T06:30:31.1075779Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T06:30:31.1076674Z Compiling llvm/lib/IR/Dominators.cpp; 6s local ... 2025-03-14T06:30:31.3470744Z 2025-03-14T06:30:31.3471630Z  2025-03-14T06:30:31.3472138Z  2025-03-14T06:30:31.3472543Z  2025-03-14T06:30:31.3472970Z  2025-03-14T06:30:31.3473636Z  2025-03-14T06:30:31.3474072Z  2025-03-14T06:30:31.3474483Z  2025-03-14T06:30:31.3474885Z  2025-03-14T06:30:31.3475860Z [15,746 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:31.3477007Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T06:30:31.3477884Z Compiling xla/literal.cc; 18s local 2025-03-14T06:30:31.3478549Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T06:30:31.3479359Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 11s local 2025-03-14T06:30:31.3480168Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2025-03-14T06:30:31.3480916Z Compiling llvm/lib/IR/Dominators.cpp; 6s local 2025-03-14T06:30:31.3481952Z Compiling llvm/lib/ObjectYAML/yaml2obj.cpp; 6s local 2025-03-14T06:30:31.3482767Z Compiling xla/mlir/utils/type_util.cc; 5s local ... 2025-03-14T06:30:31.7025966Z 2025-03-14T06:30:31.7026803Z  2025-03-14T06:30:31.7027357Z  2025-03-14T06:30:31.7027776Z  2025-03-14T06:30:31.7028217Z  2025-03-14T06:30:31.7028625Z  2025-03-14T06:30:31.7029027Z  2025-03-14T06:30:31.7029448Z  2025-03-14T06:30:31.7029856Z  2025-03-14T06:30:31.7030798Z [15,748 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:31.7031863Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T06:30:31.7032677Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:31.7033958Z Compiling llvm/lib/IR/Metadata.cpp; 14s local 2025-03-14T06:30:31.7034868Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2025-03-14T06:30:31.7035630Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2025-03-14T06:30:31.7036319Z Compiling llvm/lib/IR/Dominators.cpp; 6s local 2025-03-14T06:30:31.7037059Z Compiling llvm/lib/ObjectYAML/yaml2obj.cpp; 6s local 2025-03-14T06:30:31.7037826Z Compiling xla/mlir/utils/type_util.cc; 6s local ... 2025-03-14T06:30:31.9080441Z 2025-03-14T06:30:31.9081258Z  2025-03-14T06:30:31.9081647Z  2025-03-14T06:30:31.9081970Z  2025-03-14T06:30:31.9082641Z  2025-03-14T06:30:31.9083179Z  2025-03-14T06:30:31.9083641Z  2025-03-14T06:30:31.9084029Z  2025-03-14T06:30:31.9084421Z  2025-03-14T06:30:31.9085599Z [15,748 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:31.9086716Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T06:30:31.9087499Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:31.9088285Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2025-03-14T06:30:31.9089186Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2025-03-14T06:30:31.9090065Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2025-03-14T06:30:31.9090889Z Compiling llvm/lib/IR/Dominators.cpp; 7s local 2025-03-14T06:30:31.9091786Z Compiling llvm/lib/ObjectYAML/yaml2obj.cpp; 6s local 2025-03-14T06:30:31.9092677Z Compiling xla/mlir/utils/type_util.cc; 6s local ... 2025-03-14T06:30:32.1316973Z 2025-03-14T06:30:32.1317816Z  2025-03-14T06:30:32.1318321Z  2025-03-14T06:30:32.1318730Z  2025-03-14T06:30:32.1319141Z  2025-03-14T06:30:32.1319537Z  2025-03-14T06:30:32.1319923Z  2025-03-14T06:30:32.1320284Z  2025-03-14T06:30:32.1320692Z  2025-03-14T06:30:32.1321563Z [15,751 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:32.1322661Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T06:30:32.1323467Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:32.1324120Z Compiling llvm/lib/IR/Metadata.cpp; 15s local 2025-03-14T06:30:32.1325096Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2025-03-14T06:30:32.1325883Z Compiling xla/hlo/ir/hlo_sharding.cc; 9s local 2025-03-14T06:30:32.1326898Z Compiling llvm/lib/IR/Dominators.cpp; 7s local 2025-03-14T06:30:32.1327607Z Compiling llvm/lib/ObjectYAML/yaml2obj.cpp; 7s local 2025-03-14T06:30:32.1328391Z Compiling xla/mlir/utils/type_util.cc; 6s local ... 2025-03-14T06:30:32.5057424Z 2025-03-14T06:30:32.5058311Z  2025-03-14T06:30:32.5058850Z  2025-03-14T06:30:32.5059280Z  2025-03-14T06:30:32.5059707Z  2025-03-14T06:30:32.5060152Z  2025-03-14T06:30:32.5060579Z  2025-03-14T06:30:32.5060997Z  2025-03-14T06:30:32.5061442Z  2025-03-14T06:30:32.5062447Z [15,753 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:32.5063570Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T06:30:32.5064713Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:32.5065702Z Compiling llvm/lib/IR/DebugInfoMetadata.cpp; 12s local 2025-03-14T06:30:32.5066549Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2025-03-14T06:30:32.5067278Z Compiling llvm/lib/IR/Dominators.cpp; 7s local 2025-03-14T06:30:32.5068076Z Compiling xla/mlir/utils/type_util.cc; 6s local 2025-03-14T06:30:32.5068812Z Compiling llvm/lib/IR/InlineAsm.cpp; 4s local 2025-03-14T06:30:32.5069575Z Compiling llvm/lib/IR/Instruction.cpp; 4s local ... 2025-03-14T06:30:32.7080419Z 2025-03-14T06:30:32.7081296Z  2025-03-14T06:30:32.7081776Z  2025-03-14T06:30:32.7082160Z  2025-03-14T06:30:32.7082561Z  2025-03-14T06:30:32.7083253Z  2025-03-14T06:30:32.7083661Z  2025-03-14T06:30:32.7084080Z  2025-03-14T06:30:32.7084648Z  2025-03-14T06:30:32.7085649Z [15,760 / 20,651] 4 / 17 tests; 46 actions running; last test: ...me:util_test 2025-03-14T06:30:32.7086759Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T06:30:32.7087609Z Compiling xla/literal.cc; 20s local 2025-03-14T06:30:32.7088328Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2025-03-14T06:30:32.7089096Z Compiling llvm/lib/IR/Dominators.cpp; 7s local 2025-03-14T06:30:32.7090077Z Compiling llvm/lib/IR/InlineAsm.cpp; 5s local 2025-03-14T06:30:32.7090847Z Compiling llvm/lib/IR/Instruction.cpp; 5s local 2025-03-14T06:30:32.7091643Z Compiling xla/service/computation_placer.cc; 4s local 2025-03-14T06:30:32.7092611Z Compiling xla/pjrt/cpu/tracked_tfrt_cpu_device_buffer.cc; 4s local ... 2025-03-14T06:30:32.9086969Z 2025-03-14T06:30:32.9087829Z  2025-03-14T06:30:32.9088405Z  2025-03-14T06:30:32.9088804Z  2025-03-14T06:30:32.9089213Z  2025-03-14T06:30:32.9089614Z  2025-03-14T06:30:32.9089966Z  2025-03-14T06:30:32.9090367Z  2025-03-14T06:30:32.9090795Z  2025-03-14T06:30:32.9091774Z [15,763 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:32.9092917Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T06:30:32.9093738Z Compiling xla/literal.cc; 20s local 2025-03-14T06:30:32.9094545Z Compiling xla/hlo/ir/hlo_sharding.cc; 10s local 2025-03-14T06:30:32.9095317Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2025-03-14T06:30:32.9096079Z Compiling llvm/lib/IR/Instruction.cpp; 5s local 2025-03-14T06:30:32.9096799Z Compiling xla/service/computation_placer.cc; 4s local 2025-03-14T06:30:32.9097786Z Compiling xla/pjrt/cpu/tracked_tfrt_cpu_device_buffer.cc; 4s local 2025-03-14T06:30:32.9098730Z Compiling llvm/lib/IR/Instructions.cpp; 4s local ... 2025-03-14T06:30:33.2699837Z 2025-03-14T06:30:33.2700616Z  2025-03-14T06:30:33.2701049Z  2025-03-14T06:30:33.2701442Z  2025-03-14T06:30:33.2701839Z  2025-03-14T06:30:33.2702264Z  2025-03-14T06:30:33.2702674Z  2025-03-14T06:30:33.2703052Z  2025-03-14T06:30:33.2703452Z  2025-03-14T06:30:33.2704410Z [15,765 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:33.2705811Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:30:33.2706637Z Compiling xla/literal.cc; 20s local 2025-03-14T06:30:33.2707341Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2025-03-14T06:30:33.2708115Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2025-03-14T06:30:33.2708914Z Compiling xla/service/computation_placer.cc; 5s local 2025-03-14T06:30:33.2709898Z Compiling xla/pjrt/cpu/tracked_tfrt_cpu_device_buffer.cc; 4s local 2025-03-14T06:30:33.2710845Z Compiling llvm/lib/IR/Instructions.cpp; 4s local 2025-03-14T06:30:33.2711639Z Compiling llvm/lib/IR/Intrinsics.cpp; 4s local ... 2025-03-14T06:30:33.4791512Z 2025-03-14T06:30:33.4792338Z  2025-03-14T06:30:33.4793061Z  2025-03-14T06:30:33.4793468Z  2025-03-14T06:30:33.4793886Z  2025-03-14T06:30:33.4794285Z  2025-03-14T06:30:33.4794689Z  2025-03-14T06:30:33.4795091Z  2025-03-14T06:30:33.4795453Z  2025-03-14T06:30:33.4796428Z [15,767 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:33.4797547Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:30:33.4798382Z Compiling xla/literal.cc; 20s local 2025-03-14T06:30:33.4799084Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2025-03-14T06:30:33.4799841Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2025-03-14T06:30:33.4800637Z Compiling xla/service/computation_placer.cc; 5s local 2025-03-14T06:30:33.4801774Z Compiling xla/pjrt/cpu/tracked_tfrt_cpu_device_buffer.cc; 5s local 2025-03-14T06:30:33.4802710Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2025-03-14T06:30:33.4803441Z Compiling llvm/lib/IR/Intrinsics.cpp; 4s local ... 2025-03-14T06:30:33.6988590Z 2025-03-14T06:30:33.6989419Z  2025-03-14T06:30:33.6989932Z  2025-03-14T06:30:33.6990330Z  2025-03-14T06:30:33.6990772Z  2025-03-14T06:30:33.6991174Z  2025-03-14T06:30:33.6991597Z  2025-03-14T06:30:33.6991979Z  2025-03-14T06:30:33.6992375Z  2025-03-14T06:30:33.6993572Z [15,776 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:33.6994694Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:30:33.6995455Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:33.6996024Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2025-03-14T06:30:33.6996701Z Compiling llvm/lib/IR/Dominators.cpp; 8s local 2025-03-14T06:30:33.6997652Z Compiling xla/service/computation_placer.cc; 5s local 2025-03-14T06:30:33.6998583Z Compiling xla/pjrt/cpu/tracked_tfrt_cpu_device_buffer.cc; 5s local 2025-03-14T06:30:33.6999482Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2025-03-14T06:30:33.7000257Z Compiling llvm/lib/IR/Intrinsics.cpp; 4s local ... 2025-03-14T06:30:33.9094613Z 2025-03-14T06:30:33.9095468Z  2025-03-14T06:30:33.9095886Z  2025-03-14T06:30:33.9096254Z  2025-03-14T06:30:33.9096615Z  2025-03-14T06:30:33.9097091Z  2025-03-14T06:30:33.9097454Z  2025-03-14T06:30:33.9097820Z  2025-03-14T06:30:33.9098186Z  2025-03-14T06:30:33.9099036Z [15,785 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:33.9100044Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:30:33.9100800Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:33.9101414Z Compiling xla/hlo/ir/hlo_sharding.cc; 11s local 2025-03-14T06:30:33.9102101Z Compiling llvm/lib/IR/Dominators.cpp; 9s local 2025-03-14T06:30:33.9102868Z Compiling xla/service/computation_placer.cc; 5s local 2025-03-14T06:30:33.9103751Z Compiling xla/pjrt/cpu/tracked_tfrt_cpu_device_buffer.cc; 5s local 2025-03-14T06:30:33.9104559Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2025-03-14T06:30:33.9105500Z Compiling llvm/lib/IR/Intrinsics.cpp; 5s local ... 2025-03-14T06:30:34.1427778Z 2025-03-14T06:30:34.1428624Z  2025-03-14T06:30:34.1429139Z  2025-03-14T06:30:34.1429570Z  2025-03-14T06:30:34.1430060Z  2025-03-14T06:30:34.1430442Z  2025-03-14T06:30:34.1430850Z  2025-03-14T06:30:34.1431247Z  2025-03-14T06:30:34.1431630Z  2025-03-14T06:30:34.1432524Z [15,789 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:34.1433434Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:34.1434088Z Compiling llvm/lib/IR/Dominators.cpp; 9s local 2025-03-14T06:30:34.1434875Z Compiling xla/service/computation_placer.cc; 6s local 2025-03-14T06:30:34.1435687Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2025-03-14T06:30:34.1436625Z Compiling llvm/lib/IR/Intrinsics.cpp; 5s local 2025-03-14T06:30:34.1437289Z Compiling xla/literal_util.cc; 5s local 2025-03-14T06:30:34.1438016Z Compiling mlir/lib/IR/Builders.cpp [for tool]; 5s local 2025-03-14T06:30:34.1438793Z Compiling xla/literal_comparison.cc; 5s local ... 2025-03-14T06:30:34.3662640Z 2025-03-14T06:30:34.3663499Z  2025-03-14T06:30:34.3664052Z  2025-03-14T06:30:34.3664482Z  2025-03-14T06:30:34.3664870Z  2025-03-14T06:30:34.3665512Z  2025-03-14T06:30:34.3665951Z  2025-03-14T06:30:34.3666356Z  2025-03-14T06:30:34.3666772Z  2025-03-14T06:30:34.3667759Z [15,794 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:34.3669012Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:34.3669699Z Compiling llvm/lib/IR/Dominators.cpp; 9s local 2025-03-14T06:30:34.3670503Z Compiling xla/service/computation_placer.cc; 6s local 2025-03-14T06:30:34.3671332Z Compiling llvm/lib/IR/Instructions.cpp; 5s local 2025-03-14T06:30:34.3672093Z Compiling llvm/lib/IR/Intrinsics.cpp; 5s local 2025-03-14T06:30:34.3672819Z Compiling xla/literal_util.cc; 5s local 2025-03-14T06:30:34.3673508Z Compiling xla/literal_comparison.cc; 5s local 2025-03-14T06:30:34.3674556Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDie.cpp; 4s local ... 2025-03-14T06:30:34.5774611Z 2025-03-14T06:30:34.5775469Z  2025-03-14T06:30:34.5775980Z  2025-03-14T06:30:34.5776402Z  2025-03-14T06:30:34.5776831Z  2025-03-14T06:30:34.5777349Z  2025-03-14T06:30:34.5777771Z  2025-03-14T06:30:34.5778163Z  2025-03-14T06:30:34.5778567Z  2025-03-14T06:30:34.5779513Z [15,797 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:34.5780455Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:34.5781160Z Compiling llvm/lib/IR/Instructions.cpp; 6s local 2025-03-14T06:30:34.5781927Z Compiling llvm/lib/IR/Intrinsics.cpp; 5s local 2025-03-14T06:30:34.5782609Z Compiling xla/literal_util.cc; 5s local 2025-03-14T06:30:34.5783275Z Compiling xla/literal_comparison.cc; 5s local 2025-03-14T06:30:34.5784075Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDie.cpp; 4s local 2025-03-14T06:30:34.5784934Z Compiling llvm/lib/IR/LLVMContext.cpp; 4s local 2025-03-14T06:30:34.5785832Z Compiling mlir/lib/Dialect/Quant/IR/TypeParser.cpp; 4s local ... 2025-03-14T06:30:34.8463706Z 2025-03-14T06:30:34.8464551Z  2025-03-14T06:30:34.8465036Z  2025-03-14T06:30:34.8465672Z  2025-03-14T06:30:34.8466046Z  2025-03-14T06:30:34.8466434Z  2025-03-14T06:30:34.8466815Z  2025-03-14T06:30:34.8467222Z  2025-03-14T06:30:34.8467605Z  2025-03-14T06:30:34.8468555Z [15,799 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:34.8469416Z Compiling xla/literal.cc; 22s local 2025-03-14T06:30:34.8470047Z Compiling llvm/lib/IR/Instructions.cpp; 6s local 2025-03-14T06:30:34.8470797Z Compiling llvm/lib/IR/Intrinsics.cpp; 6s local 2025-03-14T06:30:34.8471779Z Compiling xla/literal_util.cc; 6s local 2025-03-14T06:30:34.8472452Z Compiling xla/literal_comparison.cc; 5s local 2025-03-14T06:30:34.8473246Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDie.cpp; 4s local 2025-03-14T06:30:34.8474008Z Compiling llvm/lib/IR/LLVMContext.cpp; 4s local 2025-03-14T06:30:34.8474717Z Compiling xla/index_util.cc; 4s local ... 2025-03-14T06:30:35.0808628Z 2025-03-14T06:30:35.0809520Z  2025-03-14T06:30:35.0810020Z  2025-03-14T06:30:35.0810412Z  2025-03-14T06:30:35.0810816Z  2025-03-14T06:30:35.0811236Z  2025-03-14T06:30:35.0811627Z  2025-03-14T06:30:35.0812023Z  2025-03-14T06:30:35.0812412Z  2025-03-14T06:30:35.0813345Z [15,804 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:35.0814595Z Compiling xla/literal.cc; 22s local 2025-03-14T06:30:35.0815298Z Compiling llvm/lib/IR/Instructions.cpp; 6s local 2025-03-14T06:30:35.0816074Z Compiling llvm/lib/IR/Intrinsics.cpp; 6s local 2025-03-14T06:30:35.0816813Z Compiling xla/literal_util.cc; 6s local 2025-03-14T06:30:35.0817510Z Compiling xla/literal_comparison.cc; 6s local 2025-03-14T06:30:35.0818242Z Compiling llvm/lib/IR/LLVMContext.cpp; 4s local 2025-03-14T06:30:35.0819145Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDebugLine.cpp; 4s local 2025-03-14T06:30:35.0820109Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 4s local ... 2025-03-14T06:30:35.3106034Z 2025-03-14T06:30:35.3106830Z  2025-03-14T06:30:35.3107669Z  2025-03-14T06:30:35.3108086Z  2025-03-14T06:30:35.3108503Z  2025-03-14T06:30:35.3108933Z  2025-03-14T06:30:35.3109358Z  2025-03-14T06:30:35.3109772Z  2025-03-14T06:30:35.3110213Z  2025-03-14T06:30:35.3111198Z [15,807 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:35.3112191Z Compiling xla/literal.cc; 22s local 2025-03-14T06:30:35.3112908Z Compiling llvm/lib/IR/Instructions.cpp; 6s local 2025-03-14T06:30:35.3113695Z Compiling llvm/lib/IR/Intrinsics.cpp; 6s local 2025-03-14T06:30:35.3114602Z Compiling xla/literal_util.cc; 6s local 2025-03-14T06:30:35.3115334Z Compiling xla/literal_comparison.cc; 6s local 2025-03-14T06:30:35.3116264Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDebugLine.cpp; 4s local 2025-03-14T06:30:35.3117231Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 4s local 2025-03-14T06:30:35.3118108Z Compiling torch_xla/csrc/shape_builder.cpp; 4s local ... 2025-03-14T06:30:35.5774443Z 2025-03-14T06:30:35.5775261Z  2025-03-14T06:30:35.5775786Z  2025-03-14T06:30:35.5776223Z  2025-03-14T06:30:35.5776658Z  2025-03-14T06:30:35.5777092Z  2025-03-14T06:30:35.5777552Z  2025-03-14T06:30:35.5777987Z  2025-03-14T06:30:35.5778431Z  2025-03-14T06:30:35.5779416Z [15,810 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:35.5780423Z Compiling xla/literal.cc; 22s local 2025-03-14T06:30:35.5781191Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2025-03-14T06:30:35.5781988Z Compiling xla/literal_util.cc; 6s local 2025-03-14T06:30:35.5782729Z Compiling xla/literal_comparison.cc; 6s local 2025-03-14T06:30:35.5783699Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDebugLine.cpp; 5s local 2025-03-14T06:30:35.5784696Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 4s local 2025-03-14T06:30:35.5785674Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 4s local 2025-03-14T06:30:35.5786613Z Compiling xla/primitive_util.cc; 4s local ... 2025-03-14T06:30:35.7794649Z 2025-03-14T06:30:35.7795506Z  2025-03-14T06:30:35.7796003Z  2025-03-14T06:30:35.7796455Z  2025-03-14T06:30:35.7796878Z  2025-03-14T06:30:35.7797301Z  2025-03-14T06:30:35.7797715Z  2025-03-14T06:30:35.7798138Z  2025-03-14T06:30:35.7798548Z  2025-03-14T06:30:35.7799761Z [15,812 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:35.7800744Z Compiling xla/literal.cc; 23s local 2025-03-14T06:30:35.7801447Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2025-03-14T06:30:35.7802208Z Compiling xla/literal_util.cc; 6s local 2025-03-14T06:30:35.7802889Z Compiling xla/literal_comparison.cc; 6s local 2025-03-14T06:30:35.7803818Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDebugLine.cpp; 5s local 2025-03-14T06:30:35.7805005Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2025-03-14T06:30:35.7805987Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 4s local 2025-03-14T06:30:35.7806920Z Compiling xla/primitive_util.cc; 4s local ... 2025-03-14T06:30:36.0520877Z 2025-03-14T06:30:36.0521712Z  2025-03-14T06:30:36.0522166Z  2025-03-14T06:30:36.0522553Z  2025-03-14T06:30:36.0522928Z  2025-03-14T06:30:36.0523295Z  2025-03-14T06:30:36.0523652Z  2025-03-14T06:30:36.0524056Z  2025-03-14T06:30:36.0524428Z  2025-03-14T06:30:36.0525453Z [15,815 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:36.0526307Z Compiling xla/literal.cc; 23s local 2025-03-14T06:30:36.0526941Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2025-03-14T06:30:36.0527595Z Compiling xla/literal_util.cc; 7s local 2025-03-14T06:30:36.0528211Z Compiling xla/literal_comparison.cc; 7s local 2025-03-14T06:30:36.0529008Z Compiling llvm/lib/DebugInfo/DWARF/DWARFDebugLine.cpp; 5s local 2025-03-14T06:30:36.0530090Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2025-03-14T06:30:36.0530934Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 4s local 2025-03-14T06:30:36.0531871Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 4s local ... 2025-03-14T06:30:36.3114039Z 2025-03-14T06:30:36.3114896Z  2025-03-14T06:30:36.3115353Z  2025-03-14T06:30:36.3115726Z  2025-03-14T06:30:36.3116117Z  2025-03-14T06:30:36.3116465Z  2025-03-14T06:30:36.3116831Z  2025-03-14T06:30:36.3117185Z  2025-03-14T06:30:36.3117832Z  2025-03-14T06:30:36.3118702Z [15,817 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:36.3119542Z Compiling xla/literal.cc; 23s local 2025-03-14T06:30:36.3120277Z Compiling llvm/lib/IR/Instructions.cpp; 7s local 2025-03-14T06:30:36.3120916Z Compiling xla/literal_util.cc; 7s local 2025-03-14T06:30:36.3121523Z Compiling xla/literal_comparison.cc; 7s local 2025-03-14T06:30:36.3122202Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2025-03-14T06:30:36.3123000Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 5s local 2025-03-14T06:30:36.3123856Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 4s local 2025-03-14T06:30:36.3124659Z Compiling xla/literal.cc; 4s local ... 2025-03-14T06:30:36.5755043Z 2025-03-14T06:30:36.5755916Z  2025-03-14T06:30:36.5756453Z  2025-03-14T06:30:36.5756893Z  2025-03-14T06:30:36.5757308Z  2025-03-14T06:30:36.5757844Z  2025-03-14T06:30:36.5758245Z  2025-03-14T06:30:36.5758656Z  2025-03-14T06:30:36.5759043Z  2025-03-14T06:30:36.5759955Z [15,819 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:36.5760884Z Compiling xla/literal.cc; 23s local 2025-03-14T06:30:36.5761551Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2025-03-14T06:30:36.5762275Z Compiling xla/literal_util.cc; 7s local 2025-03-14T06:30:36.5762952Z Compiling xla/literal_comparison.cc; 7s local 2025-03-14T06:30:36.5763712Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 5s local 2025-03-14T06:30:36.5764835Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 5s local 2025-03-14T06:30:36.5766016Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 5s local 2025-03-14T06:30:36.5767088Z Compiling xla/literal.cc; 4s local ... 2025-03-14T06:30:36.8301751Z 2025-03-14T06:30:36.8302592Z  2025-03-14T06:30:36.8303081Z  2025-03-14T06:30:36.8303484Z  2025-03-14T06:30:36.8303912Z  2025-03-14T06:30:36.8304324Z  2025-03-14T06:30:36.8304721Z  2025-03-14T06:30:36.8305166Z  2025-03-14T06:30:36.8305665Z  2025-03-14T06:30:36.8306590Z [15,823 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:36.8307476Z Compiling xla/literal.cc; 24s local 2025-03-14T06:30:36.8308186Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2025-03-14T06:30:36.8308864Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:36.8309524Z Compiling xla/literal_comparison.cc; 7s local 2025-03-14T06:30:36.8310789Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2025-03-14T06:30:36.8311722Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 5s local 2025-03-14T06:30:36.8312660Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 5s local 2025-03-14T06:30:36.8313450Z Compiling xla/literal.cc; 5s local ... 2025-03-14T06:30:37.1107183Z 2025-03-14T06:30:37.1108122Z  2025-03-14T06:30:37.1108650Z  2025-03-14T06:30:37.1109067Z  2025-03-14T06:30:37.1109470Z  2025-03-14T06:30:37.1109888Z  2025-03-14T06:30:37.1110309Z  2025-03-14T06:30:37.1110727Z  2025-03-14T06:30:37.1111135Z  2025-03-14T06:30:37.1112125Z [15,829 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:37.1113393Z Compiling xla/literal.cc; 24s local 2025-03-14T06:30:37.1114095Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2025-03-14T06:30:37.1114821Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:37.1115504Z Compiling xla/literal_comparison.cc; 8s local 2025-03-14T06:30:37.1116288Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2025-03-14T06:30:37.1117229Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 6s local 2025-03-14T06:30:37.1118168Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 5s local 2025-03-14T06:30:37.1119187Z Compiling xla/literal.cc; 5s local ... 2025-03-14T06:30:37.3122285Z 2025-03-14T06:30:37.3123106Z  2025-03-14T06:30:37.3123629Z  2025-03-14T06:30:37.3124062Z  2025-03-14T06:30:37.3124636Z  2025-03-14T06:30:37.3125075Z  2025-03-14T06:30:37.3125504Z  2025-03-14T06:30:37.3125898Z  2025-03-14T06:30:37.3126297Z  2025-03-14T06:30:37.3127337Z [15,831 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:37.3128286Z Compiling xla/literal.cc; 24s local 2025-03-14T06:30:37.3129028Z Compiling llvm/lib/IR/Instructions.cpp; 8s local 2025-03-14T06:30:37.3129820Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:37.3130587Z Compiling xla/literal_comparison.cc; 8s local 2025-03-14T06:30:37.3131435Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2025-03-14T06:30:37.3132436Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 6s local 2025-03-14T06:30:37.3133466Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 5s local 2025-03-14T06:30:37.3134239Z Compiling xla/literal.cc; 5s local ... 2025-03-14T06:30:37.5221415Z 2025-03-14T06:30:37.5222261Z  2025-03-14T06:30:37.5222773Z  2025-03-14T06:30:37.5223196Z  2025-03-14T06:30:37.5223602Z  2025-03-14T06:30:37.5224011Z  2025-03-14T06:30:37.5224425Z  2025-03-14T06:30:37.5224845Z  2025-03-14T06:30:37.5225279Z  2025-03-14T06:30:37.5226213Z [15,834 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:37.5227174Z Compiling xla/literal.cc; 24s local 2025-03-14T06:30:37.5227820Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:37.5228531Z Compiling xla/literal_comparison.cc; 8s local 2025-03-14T06:30:37.5229601Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 6s local 2025-03-14T06:30:37.5230548Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 6s local 2025-03-14T06:30:37.5231528Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T06:30:37.5232309Z Compiling xla/literal.cc; 5s local 2025-03-14T06:30:37.5233089Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 5s local ... 2025-03-14T06:30:37.8527239Z 2025-03-14T06:30:37.8528134Z  2025-03-14T06:30:37.8528653Z  2025-03-14T06:30:37.8529101Z  2025-03-14T06:30:37.8529536Z  2025-03-14T06:30:37.8529919Z  2025-03-14T06:30:37.8530308Z  2025-03-14T06:30:37.8530713Z  2025-03-14T06:30:37.8531111Z  2025-03-14T06:30:37.8532097Z [15,836 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:37.8533286Z Compiling xla/literal.cc; 25s local 2025-03-14T06:30:37.8533936Z Compiling xla/literal_util.cc; 9s local 2025-03-14T06:30:37.8534627Z Compiling xla/literal_comparison.cc; 8s local 2025-03-14T06:30:37.8535360Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2025-03-14T06:30:37.8536187Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 6s local 2025-03-14T06:30:37.8537258Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T06:30:37.8537975Z Compiling xla/literal.cc; 6s local 2025-03-14T06:30:37.8538702Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 5s local ... 2025-03-14T06:30:38.1130502Z 2025-03-14T06:30:38.1131689Z  2025-03-14T06:30:38.1132171Z  2025-03-14T06:30:38.1132580Z  2025-03-14T06:30:38.1132983Z  2025-03-14T06:30:38.1133376Z  2025-03-14T06:30:38.1133788Z  2025-03-14T06:30:38.1134177Z  2025-03-14T06:30:38.1134535Z  2025-03-14T06:30:38.1135394Z [15,837 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:38.1136314Z Compiling xla/literal.cc; 25s local 2025-03-14T06:30:38.1136970Z Compiling xla/literal_util.cc; 9s local 2025-03-14T06:30:38.1137633Z Compiling xla/literal_comparison.cc; 9s local 2025-03-14T06:30:38.1138566Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2025-03-14T06:30:38.1139492Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2025-03-14T06:30:38.1140511Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T06:30:38.1141262Z Compiling xla/literal.cc; 6s local 2025-03-14T06:30:38.1141993Z Compiling llvm/lib/IR/LegacyPassManager.cpp; 6s local ... 2025-03-14T06:30:38.3134825Z 2025-03-14T06:30:38.3135719Z  2025-03-14T06:30:38.3136241Z  2025-03-14T06:30:38.3136674Z  2025-03-14T06:30:38.3137073Z  2025-03-14T06:30:38.3137524Z  2025-03-14T06:30:38.3137943Z  2025-03-14T06:30:38.3138351Z  2025-03-14T06:30:38.3138744Z  2025-03-14T06:30:38.3139751Z [15,839 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:38.3140738Z Compiling xla/literal.cc; 25s local 2025-03-14T06:30:38.3141401Z Compiling xla/literal_util.cc; 9s local 2025-03-14T06:30:38.3142110Z Compiling xla/literal_comparison.cc; 9s local 2025-03-14T06:30:38.3142881Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2025-03-14T06:30:38.3143777Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2025-03-14T06:30:38.3144742Z Compiling xla/service/float8_fnuz_ir_emitter.cc; 6s local 2025-03-14T06:30:38.3145530Z Compiling xla/literal.cc; 6s local 2025-03-14T06:30:38.3146414Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 6s local ... 2025-03-14T06:30:38.5231783Z 2025-03-14T06:30:38.5232628Z  2025-03-14T06:30:38.5233104Z  2025-03-14T06:30:38.5233497Z  2025-03-14T06:30:38.5233890Z  2025-03-14T06:30:38.5234258Z  2025-03-14T06:30:38.5234620Z  2025-03-14T06:30:38.5234976Z  2025-03-14T06:30:38.5235351Z  2025-03-14T06:30:38.5236511Z [15,842 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:38.5237368Z Compiling xla/literal.cc; 25s local 2025-03-14T06:30:38.5237947Z Compiling xla/literal_util.cc; 9s local 2025-03-14T06:30:38.5238585Z Compiling xla/literal_comparison.cc; 9s local 2025-03-14T06:30:38.5239301Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 7s local 2025-03-14T06:30:38.5240132Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2025-03-14T06:30:38.5240879Z Compiling xla/literal.cc; 6s local 2025-03-14T06:30:38.5241644Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 6s local 2025-03-14T06:30:38.5242604Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 5s local ... 2025-03-14T06:30:38.9141238Z 2025-03-14T06:30:38.9142028Z  2025-03-14T06:30:38.9142543Z  2025-03-14T06:30:38.9142991Z  2025-03-14T06:30:38.9143430Z  2025-03-14T06:30:38.9143858Z  2025-03-14T06:30:38.9144331Z  2025-03-14T06:30:38.9144770Z  2025-03-14T06:30:38.9145196Z  2025-03-14T06:30:38.9146183Z [15,846 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:38.9147166Z Compiling xla/literal.cc; 26s local 2025-03-14T06:30:38.9147833Z Compiling xla/literal_util.cc; 10s local 2025-03-14T06:30:38.9148562Z Compiling xla/literal_comparison.cc; 9s local 2025-03-14T06:30:38.9149379Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2025-03-14T06:30:38.9150587Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2025-03-14T06:30:38.9151444Z Compiling xla/literal.cc; 7s local 2025-03-14T06:30:38.9152305Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 6s local 2025-03-14T06:30:38.9153376Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local ... 2025-03-14T06:30:39.1145279Z 2025-03-14T06:30:39.1146145Z  2025-03-14T06:30:39.1146751Z  2025-03-14T06:30:39.1147124Z  2025-03-14T06:30:39.1147545Z  2025-03-14T06:30:39.1147956Z  2025-03-14T06:30:39.1148349Z  2025-03-14T06:30:39.1148729Z  2025-03-14T06:30:39.1149389Z  2025-03-14T06:30:39.1150346Z [15,847 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:39.1151259Z Compiling xla/literal.cc; 26s local 2025-03-14T06:30:39.1151915Z Compiling xla/literal_util.cc; 10s local 2025-03-14T06:30:39.1152637Z Compiling xla/literal_comparison.cc; 10s local 2025-03-14T06:30:39.1153453Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2025-03-14T06:30:39.1154339Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2025-03-14T06:30:39.1155157Z Compiling xla/literal.cc; 7s local 2025-03-14T06:30:39.1155958Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 6s local 2025-03-14T06:30:39.1156937Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local ... 2025-03-14T06:30:39.4159927Z 2025-03-14T06:30:39.4160817Z  2025-03-14T06:30:39.4161313Z  2025-03-14T06:30:39.4161724Z  2025-03-14T06:30:39.4162124Z  2025-03-14T06:30:39.4162545Z  2025-03-14T06:30:39.4162972Z  2025-03-14T06:30:39.4163411Z  2025-03-14T06:30:39.4163762Z  2025-03-14T06:30:39.4164795Z [15,851 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:39.4165935Z Compiling xla/literal.cc; 26s local 2025-03-14T06:30:39.4166581Z Compiling xla/literal_util.cc; 10s local 2025-03-14T06:30:39.4167248Z Compiling xla/literal_comparison.cc; 10s local 2025-03-14T06:30:39.4167995Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2025-03-14T06:30:39.4168897Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2025-03-14T06:30:39.4169726Z Compiling xla/literal.cc; 7s local 2025-03-14T06:30:39.4170643Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 7s local 2025-03-14T06:30:39.4171873Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 6s local ... 2025-03-14T06:30:39.6242090Z 2025-03-14T06:30:39.6242972Z  2025-03-14T06:30:39.6243457Z  2025-03-14T06:30:39.6243835Z  2025-03-14T06:30:39.6244208Z  2025-03-14T06:30:39.6244737Z  2025-03-14T06:30:39.6245115Z  2025-03-14T06:30:39.6245508Z  2025-03-14T06:30:39.6245872Z  2025-03-14T06:30:39.6246746Z [15,855 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:39.6247589Z Compiling xla/literal.cc; 26s local 2025-03-14T06:30:39.6248166Z Compiling xla/literal_util.cc; 10s local 2025-03-14T06:30:39.6248775Z Compiling xla/literal_comparison.cc; 10s local 2025-03-14T06:30:39.6249726Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 8s local 2025-03-14T06:30:39.6250526Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2025-03-14T06:30:39.6251245Z Compiling xla/literal.cc; 7s local 2025-03-14T06:30:39.6251967Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 7s local 2025-03-14T06:30:39.6252870Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local ... 2025-03-14T06:30:39.9152530Z 2025-03-14T06:30:39.9153439Z  2025-03-14T06:30:39.9153910Z  2025-03-14T06:30:39.9154331Z  2025-03-14T06:30:39.9154740Z  2025-03-14T06:30:39.9155149Z  2025-03-14T06:30:39.9155530Z  2025-03-14T06:30:39.9155923Z  2025-03-14T06:30:39.9156319Z  2025-03-14T06:30:39.9157954Z [15,858 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:39.9159128Z Compiling xla/literal.cc; 27s local 2025-03-14T06:30:39.9159821Z Compiling xla/literal_util.cc; 11s local 2025-03-14T06:30:39.9160622Z Compiling xla/literal_comparison.cc; 10s local 2025-03-14T06:30:39.9161373Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2025-03-14T06:30:39.9162287Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2025-03-14T06:30:39.9163114Z Compiling xla/literal.cc; 8s local 2025-03-14T06:30:39.9164189Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 7s local 2025-03-14T06:30:39.9165584Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local ... 2025-03-14T06:30:40.1559862Z 2025-03-14T06:30:40.1560723Z  2025-03-14T06:30:40.1561242Z  2025-03-14T06:30:40.1561672Z  2025-03-14T06:30:40.1562077Z  2025-03-14T06:30:40.1562499Z  2025-03-14T06:30:40.1562947Z  2025-03-14T06:30:40.1563367Z  2025-03-14T06:30:40.1563764Z  2025-03-14T06:30:40.1564905Z [15,865 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:40.1566105Z Compiling xla/literal.cc; 27s local 2025-03-14T06:30:40.1566787Z Compiling xla/literal_util.cc; 11s local 2025-03-14T06:30:40.1567464Z Compiling xla/literal_comparison.cc; 11s local 2025-03-14T06:30:40.1568282Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2025-03-14T06:30:40.1569232Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T06:30:40.1570582Z Compiling xla/literal.cc; 8s local 2025-03-14T06:30:40.1571615Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 8s local 2025-03-14T06:30:40.1572862Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local ... 2025-03-14T06:30:40.4169206Z 2025-03-14T06:30:40.4170147Z  2025-03-14T06:30:40.4170894Z  2025-03-14T06:30:40.4171508Z  2025-03-14T06:30:40.4172043Z  2025-03-14T06:30:40.4182336Z  2025-03-14T06:30:40.4183361Z  2025-03-14T06:30:40.4183958Z  2025-03-14T06:30:40.4184510Z  2025-03-14T06:30:40.4185638Z [15,872 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:40.4186735Z Compiling xla/literal.cc; 27s local 2025-03-14T06:30:40.4187615Z Compiling xla/literal_util.cc; 11s local 2025-03-14T06:30:40.4188737Z Compiling xla/literal_comparison.cc; 11s local 2025-03-14T06:30:40.4189719Z Compiling llvm/lib/IR/LLVMContextImpl.cpp; 9s local 2025-03-14T06:30:40.4190809Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T06:30:40.4191777Z Compiling xla/literal.cc; 8s local 2025-03-14T06:30:40.4192760Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 8s local 2025-03-14T06:30:40.4193946Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 7s local ... 2025-03-14T06:30:40.7156891Z 2025-03-14T06:30:40.7157877Z  2025-03-14T06:30:40.7158633Z  2025-03-14T06:30:40.7159235Z  2025-03-14T06:30:40.7159827Z  2025-03-14T06:30:40.7160380Z  2025-03-14T06:30:40.7160938Z  2025-03-14T06:30:40.7161848Z  2025-03-14T06:30:40.7162378Z  2025-03-14T06:30:40.7163457Z [15,875 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:40.7164655Z Compiling xla/literal.cc; 28s local 2025-03-14T06:30:40.7168058Z Compiling xla/literal_util.cc; 11s local 2025-03-14T06:30:40.7168860Z Compiling xla/literal_comparison.cc; 11s local 2025-03-14T06:30:40.7169750Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T06:30:40.7170585Z Compiling xla/literal.cc; 9s local 2025-03-14T06:30:40.7171379Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 8s local 2025-03-14T06:30:40.7172379Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local 2025-03-14T06:30:40.7173541Z Compiling xla/service/hlo_module_config.cc; 7s local ... 2025-03-14T06:30:40.9162550Z 2025-03-14T06:30:40.9163524Z  2025-03-14T06:30:40.9165729Z  2025-03-14T06:30:40.9166212Z  2025-03-14T06:30:40.9166665Z  2025-03-14T06:30:40.9167084Z  2025-03-14T06:30:40.9167521Z  2025-03-14T06:30:40.9167947Z  2025-03-14T06:30:40.9168375Z  2025-03-14T06:30:40.9169402Z [15,876 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:40.9170438Z Compiling xla/literal.cc; 28s local 2025-03-14T06:30:40.9171396Z Compiling xla/literal_util.cc; 12s local 2025-03-14T06:30:40.9172174Z Compiling xla/literal_comparison.cc; 11s local 2025-03-14T06:30:40.9173136Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T06:30:40.9173996Z Compiling xla/literal.cc; 9s local 2025-03-14T06:30:40.9174890Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 8s local 2025-03-14T06:30:40.9175958Z Compiling llvm/lib/Object/MachOObjectFile.cpp; 8s local 2025-03-14T06:30:40.9176889Z Compiling xla/service/hlo_module_config.cc; 7s local ... 2025-03-14T06:30:41.2296575Z 2025-03-14T06:30:41.2297465Z  2025-03-14T06:30:41.2297970Z  2025-03-14T06:30:41.2298410Z  2025-03-14T06:30:41.2298849Z  2025-03-14T06:30:41.2299284Z  2025-03-14T06:30:41.2299714Z  2025-03-14T06:30:41.2300136Z  2025-03-14T06:30:41.2300694Z  2025-03-14T06:30:41.2301694Z [15,880 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:41.2302667Z Compiling xla/literal.cc; 28s local 2025-03-14T06:30:41.2303314Z Compiling xla/literal_util.cc; 12s local 2025-03-14T06:30:41.2304010Z Compiling xla/literal_comparison.cc; 12s local 2025-03-14T06:30:41.2304929Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T06:30:41.2305792Z Compiling xla/literal.cc; 9s local 2025-03-14T06:30:41.2306682Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 9s local 2025-03-14T06:30:41.2307677Z Compiling xla/service/hlo_module_config.cc; 7s local 2025-03-14T06:30:41.2308568Z Compiling xla/client/executable_build_options.cc; 6s local ... 2025-03-14T06:30:41.5169251Z 2025-03-14T06:30:41.5170127Z  2025-03-14T06:30:41.5170598Z  2025-03-14T06:30:41.5171009Z  2025-03-14T06:30:41.5171425Z  2025-03-14T06:30:41.5172114Z  2025-03-14T06:30:41.5172524Z  2025-03-14T06:30:41.5172936Z  2025-03-14T06:30:41.5173367Z  2025-03-14T06:30:41.5174396Z [15,882 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:41.5175301Z Compiling xla/literal.cc; 28s local 2025-03-14T06:30:41.5175910Z Compiling xla/literal_util.cc; 12s local 2025-03-14T06:30:41.5176660Z Compiling xla/literal_comparison.cc; 12s local 2025-03-14T06:30:41.5177593Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T06:30:41.5178308Z Compiling xla/literal.cc; 9s local 2025-03-14T06:30:41.5179131Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 9s local 2025-03-14T06:30:41.5180296Z Compiling xla/service/hlo_module_config.cc; 8s local 2025-03-14T06:30:41.5181137Z Compiling xla/client/executable_build_options.cc; 7s local ... 2025-03-14T06:30:41.7172878Z 2025-03-14T06:30:41.7173865Z  2025-03-14T06:30:41.7174573Z  2025-03-14T06:30:41.7175116Z  2025-03-14T06:30:41.7175643Z  2025-03-14T06:30:41.7176178Z  2025-03-14T06:30:41.7176711Z  2025-03-14T06:30:41.7177221Z  2025-03-14T06:30:41.7177761Z  2025-03-14T06:30:41.7178869Z [15,884 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:41.7179971Z Compiling xla/literal.cc; 29s local 2025-03-14T06:30:41.7180740Z Compiling xla/literal_util.cc; 12s local 2025-03-14T06:30:41.7181885Z Compiling xla/literal_comparison.cc; 12s local 2025-03-14T06:30:41.7182898Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T06:30:41.7183866Z Compiling xla/literal.cc; 10s local 2025-03-14T06:30:41.7184706Z Compiling xla/service/hlo_module_config.cc; 8s local 2025-03-14T06:30:41.7185678Z Compiling xla/client/executable_build_options.cc; 7s local 2025-03-14T06:30:41.7186612Z Compiling xla/literal_util.cc; 6s local ... 2025-03-14T06:30:41.9599673Z 2025-03-14T06:30:41.9600524Z  2025-03-14T06:30:41.9601000Z  2025-03-14T06:30:41.9601401Z  2025-03-14T06:30:41.9602078Z  2025-03-14T06:30:41.9602490Z  2025-03-14T06:30:41.9602871Z  2025-03-14T06:30:41.9603267Z  2025-03-14T06:30:41.9603669Z  2025-03-14T06:30:41.9604712Z [15,887 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:41.9605624Z Compiling xla/literal.cc; 29s local 2025-03-14T06:30:41.9606246Z Compiling xla/literal_util.cc; 13s local 2025-03-14T06:30:41.9606926Z Compiling xla/literal_comparison.cc; 13s local 2025-03-14T06:30:41.9607630Z Compiling xla/literal.cc; 10s local 2025-03-14T06:30:41.9608354Z Compiling xla/service/hlo_module_config.cc; 8s local 2025-03-14T06:30:41.9609216Z Compiling xla/client/executable_build_options.cc; 7s local 2025-03-14T06:30:41.9609959Z Compiling xla/literal_util.cc; 7s local 2025-03-14T06:30:41.9610706Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local ... 2025-03-14T06:30:42.3179097Z 2025-03-14T06:30:42.3179965Z  2025-03-14T06:30:42.3180488Z  2025-03-14T06:30:42.3180906Z  2025-03-14T06:30:42.3181308Z  2025-03-14T06:30:42.3181704Z  2025-03-14T06:30:42.3182078Z  2025-03-14T06:30:42.3182496Z  2025-03-14T06:30:42.3182921Z  2025-03-14T06:30:42.3184299Z [15,890 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:42.3185418Z Compiling xla/literal.cc; 29s local 2025-03-14T06:30:42.3186210Z Compiling xla/literal_util.cc; 13s local 2025-03-14T06:30:42.3187042Z Compiling xla/literal_comparison.cc; 13s local 2025-03-14T06:30:42.3187918Z Compiling xla/literal.cc; 10s local 2025-03-14T06:30:42.3188729Z Compiling xla/service/hlo_module_config.cc; 9s local 2025-03-14T06:30:42.3189726Z Compiling xla/client/executable_build_options.cc; 7s local 2025-03-14T06:30:42.3190854Z Compiling xla/literal_util.cc; 7s local 2025-03-14T06:30:42.3191778Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local ... 2025-03-14T06:30:42.5184292Z 2025-03-14T06:30:42.5185287Z  2025-03-14T06:30:42.5185847Z  2025-03-14T06:30:42.5186281Z  2025-03-14T06:30:42.5186721Z  2025-03-14T06:30:42.5187132Z  2025-03-14T06:30:42.5187545Z  2025-03-14T06:30:42.5187954Z  2025-03-14T06:30:42.5188382Z  2025-03-14T06:30:42.5189379Z [15,892 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:42.5190387Z Compiling xla/literal.cc; 29s local 2025-03-14T06:30:42.5191050Z Compiling xla/literal_util.cc; 13s local 2025-03-14T06:30:42.5192015Z Compiling xla/literal_comparison.cc; 13s local 2025-03-14T06:30:42.5192678Z Compiling xla/literal.cc; 10s local 2025-03-14T06:30:42.5193381Z Compiling xla/service/hlo_module_config.cc; 9s local 2025-03-14T06:30:42.5194205Z Compiling xla/client/executable_build_options.cc; 8s local 2025-03-14T06:30:42.5194998Z Compiling xla/literal_util.cc; 7s local 2025-03-14T06:30:42.5195761Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local ... 2025-03-14T06:30:42.7801385Z 2025-03-14T06:30:42.7802329Z  2025-03-14T06:30:42.7802900Z  2025-03-14T06:30:42.7803320Z  2025-03-14T06:30:42.7803756Z  2025-03-14T06:30:42.7804120Z  2025-03-14T06:30:42.7804625Z  2025-03-14T06:30:42.7805020Z  2025-03-14T06:30:42.7805679Z  2025-03-14T06:30:42.7806639Z [15,895 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:42.7807586Z Compiling xla/literal.cc; 30s local 2025-03-14T06:30:42.7808244Z Compiling xla/literal_util.cc; 13s local 2025-03-14T06:30:42.7808927Z Compiling xla/literal_comparison.cc; 13s local 2025-03-14T06:30:42.7809636Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:42.7810378Z Compiling xla/service/hlo_module_config.cc; 9s local 2025-03-14T06:30:42.7811220Z Compiling xla/client/executable_build_options.cc; 8s local 2025-03-14T06:30:42.7812187Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:42.7812973Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 7s local ... 2025-03-14T06:30:42.9984610Z 2025-03-14T06:30:42.9985611Z  2025-03-14T06:30:42.9986163Z  2025-03-14T06:30:42.9986639Z  2025-03-14T06:30:42.9986983Z  2025-03-14T06:30:42.9987329Z  2025-03-14T06:30:42.9987711Z  2025-03-14T06:30:42.9988063Z  2025-03-14T06:30:42.9988415Z  2025-03-14T06:30:42.9989214Z [15,905 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:42.9990013Z Compiling xla/literal.cc; 30s local 2025-03-14T06:30:42.9990532Z Compiling xla/literal_util.cc; 14s local 2025-03-14T06:30:42.9991124Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:42.9991722Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:42.9992310Z Compiling xla/service/hlo_module_config.cc; 9s local 2025-03-14T06:30:42.9992935Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:42.9993561Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2025-03-14T06:30:42.9994314Z Compiling xla/client/executable_build_options.cc; 7s local ... 2025-03-14T06:30:43.2033059Z 2025-03-14T06:30:43.2034175Z  2025-03-14T06:30:43.2034578Z  2025-03-14T06:30:43.2034907Z  2025-03-14T06:30:43.2035264Z  2025-03-14T06:30:43.2035604Z  2025-03-14T06:30:43.2035926Z  2025-03-14T06:30:43.2036246Z  2025-03-14T06:30:43.2036568Z  2025-03-14T06:30:43.2037331Z [15,915 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:43.2038089Z Compiling xla/literal.cc; 30s local 2025-03-14T06:30:43.2038585Z Compiling xla/literal_util.cc; 14s local 2025-03-14T06:30:43.2039412Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:43.2039950Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:43.2040507Z Compiling xla/service/hlo_module_config.cc; 9s local 2025-03-14T06:30:43.2041077Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:43.2041647Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2025-03-14T06:30:43.2042355Z Compiling xla/client/executable_build_options.cc; 7s local ... 2025-03-14T06:30:43.4274229Z 2025-03-14T06:30:43.4275554Z  2025-03-14T06:30:43.4277733Z  2025-03-14T06:30:43.4278354Z  2025-03-14T06:30:43.4280229Z  2025-03-14T06:30:43.4280829Z  2025-03-14T06:30:43.4282646Z  2025-03-14T06:30:43.4283235Z  2025-03-14T06:30:43.4285739Z  2025-03-14T06:30:43.4286984Z [15,923 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:43.4289374Z Compiling xla/literal.cc; 30s local 2025-03-14T06:30:43.4290210Z Compiling xla/literal_util.cc; 14s local 2025-03-14T06:30:43.4292428Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:43.4293302Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:43.4295526Z Compiling xla/service/hlo_module_config.cc; 10s local 2025-03-14T06:30:43.4296447Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:43.4298627Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2025-03-14T06:30:43.4299792Z Compiling xla/client/executable_build_options.cc; 7s local ... 2025-03-14T06:30:43.6532397Z 2025-03-14T06:30:43.6533342Z  2025-03-14T06:30:43.6533812Z  2025-03-14T06:30:43.6534227Z  2025-03-14T06:30:43.6534662Z  2025-03-14T06:30:43.6535116Z  2025-03-14T06:30:43.6535554Z  2025-03-14T06:30:43.6535987Z  2025-03-14T06:30:43.6536423Z  2025-03-14T06:30:43.6537425Z [15,932 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:43.6538462Z Compiling xla/literal.cc; 30s local 2025-03-14T06:30:43.6539156Z Compiling xla/literal_util.cc; 14s local 2025-03-14T06:30:43.6540161Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:43.6540925Z Compiling xla/literal.cc; 11s local 2025-03-14T06:30:43.6541674Z Compiling xla/service/hlo_module_config.cc; 10s local 2025-03-14T06:30:43.6542470Z Compiling xla/literal_util.cc; 8s local 2025-03-14T06:30:43.6543257Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2025-03-14T06:30:43.6544215Z Compiling xla/client/executable_build_options.cc; 8s local ... 2025-03-14T06:30:43.8724899Z 2025-03-14T06:30:43.8725741Z  2025-03-14T06:30:43.8726242Z  2025-03-14T06:30:43.8726691Z  2025-03-14T06:30:43.8727125Z  2025-03-14T06:30:43.8727544Z  2025-03-14T06:30:43.8727972Z  2025-03-14T06:30:43.8728415Z  2025-03-14T06:30:43.8728843Z  2025-03-14T06:30:43.8729829Z [15,939 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:43.8730855Z Compiling xla/literal.cc; 31s local 2025-03-14T06:30:43.8731565Z Compiling xla/literal_util.cc; 15s local 2025-03-14T06:30:43.8732324Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:43.8733041Z Compiling xla/literal.cc; 12s local 2025-03-14T06:30:43.8733733Z Compiling xla/service/hlo_module_config.cc; 10s local 2025-03-14T06:30:43.8734458Z Compiling xla/literal_util.cc; 9s local 2025-03-14T06:30:43.8735200Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 8s local 2025-03-14T06:30:43.8736094Z Compiling xla/client/executable_build_options.cc; 8s local ... 2025-03-14T06:30:44.1195594Z 2025-03-14T06:30:44.1196550Z  2025-03-14T06:30:44.1197072Z  2025-03-14T06:30:44.1197491Z  2025-03-14T06:30:44.1197912Z  2025-03-14T06:30:44.1198338Z  2025-03-14T06:30:44.1198763Z  2025-03-14T06:30:44.1199170Z  2025-03-14T06:30:44.1199600Z  2025-03-14T06:30:44.1200868Z [15,947 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:30:44.1201868Z Compiling xla/literal.cc; 31s local 2025-03-14T06:30:44.1202545Z Compiling xla/literal_util.cc; 15s local 2025-03-14T06:30:44.1203288Z Compiling xla/literal_comparison.cc; 15s local 2025-03-14T06:30:44.1204001Z Compiling xla/literal.cc; 12s local 2025-03-14T06:30:44.1204926Z Compiling xla/service/hlo_module_config.cc; 10s local 2025-03-14T06:30:44.1205751Z Compiling xla/literal_util.cc; 9s local 2025-03-14T06:30:44.1206485Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2025-03-14T06:30:44.1207316Z Compiling xla/literal_comparison.cc; 8s local ... 2025-03-14T06:30:44.3736316Z 2025-03-14T06:30:44.3737235Z  2025-03-14T06:30:44.3737727Z  2025-03-14T06:30:44.3738173Z  2025-03-14T06:30:44.3738613Z  2025-03-14T06:30:44.3739014Z  2025-03-14T06:30:44.3739413Z  2025-03-14T06:30:44.3739872Z  2025-03-14T06:30:44.3740299Z  2025-03-14T06:30:44.3741239Z [15,950 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:44.3742217Z Compiling xla/literal.cc; 31s local 2025-03-14T06:30:44.3742853Z Compiling xla/literal_comparison.cc; 15s local 2025-03-14T06:30:44.3743564Z Compiling xla/literal.cc; 12s local 2025-03-14T06:30:44.3744306Z Compiling xla/service/hlo_module_config.cc; 11s local 2025-03-14T06:30:44.3745369Z Compiling xla/literal_util.cc; 9s local 2025-03-14T06:30:44.3746167Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2025-03-14T06:30:44.3747000Z Compiling xla/literal_comparison.cc; 8s local 2025-03-14T06:30:44.3748002Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 7s local ... 2025-03-14T06:30:44.7134292Z 2025-03-14T06:30:44.7135126Z  2025-03-14T06:30:44.7135659Z  2025-03-14T06:30:44.7136086Z  2025-03-14T06:30:44.7136541Z  2025-03-14T06:30:44.7136975Z  2025-03-14T06:30:44.7137400Z  2025-03-14T06:30:44.7137811Z  2025-03-14T06:30:44.7138232Z  2025-03-14T06:30:44.7139460Z [15,955 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:44.7140418Z Compiling xla/literal.cc; 32s local 2025-03-14T06:30:44.7141103Z Compiling xla/literal_comparison.cc; 15s local 2025-03-14T06:30:44.7141839Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:44.7142490Z Compiling xla/literal_util.cc; 9s local 2025-03-14T06:30:44.7143247Z Compiling llvm/lib/Analysis/VectorUtils.cpp; 9s local 2025-03-14T06:30:44.7144012Z Compiling xla/literal_comparison.cc; 9s local 2025-03-14T06:30:44.7144889Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 8s local 2025-03-14T06:30:44.7145999Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 7s local ... 2025-03-14T06:30:44.9202344Z 2025-03-14T06:30:44.9203212Z  2025-03-14T06:30:44.9203741Z  2025-03-14T06:30:44.9204160Z  2025-03-14T06:30:44.9204726Z  2025-03-14T06:30:44.9205165Z  2025-03-14T06:30:44.9205582Z  2025-03-14T06:30:44.9206010Z  2025-03-14T06:30:44.9206428Z  2025-03-14T06:30:44.9207408Z [15,957 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:44.9208384Z Compiling xla/literal.cc; 32s local 2025-03-14T06:30:44.9209081Z Compiling xla/literal_comparison.cc; 15s local 2025-03-14T06:30:44.9209818Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:44.9210465Z Compiling xla/literal_util.cc; 10s local 2025-03-14T06:30:44.9211171Z Compiling xla/literal_comparison.cc; 9s local 2025-03-14T06:30:44.9212052Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 8s local 2025-03-14T06:30:44.9213134Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2025-03-14T06:30:44.9214489Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local ... 2025-03-14T06:30:45.1366611Z 2025-03-14T06:30:45.1367437Z  2025-03-14T06:30:45.1367933Z  2025-03-14T06:30:45.1368381Z  2025-03-14T06:30:45.1368775Z  2025-03-14T06:30:45.1369203Z  2025-03-14T06:30:45.1369613Z  2025-03-14T06:30:45.1370002Z  2025-03-14T06:30:45.1370392Z  2025-03-14T06:30:45.1371451Z [15,960 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:45.1372354Z Compiling xla/literal.cc; 32s local 2025-03-14T06:30:45.1373148Z Compiling xla/literal_comparison.cc; 16s local 2025-03-14T06:30:45.1373828Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:45.1374814Z Compiling xla/literal_util.cc; 10s local 2025-03-14T06:30:45.1375605Z Compiling xla/literal_comparison.cc; 9s local 2025-03-14T06:30:45.1376444Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 8s local 2025-03-14T06:30:45.1377434Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2025-03-14T06:30:45.1378510Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 7s local ... 2025-03-14T06:30:45.4171370Z 2025-03-14T06:30:45.4172274Z  2025-03-14T06:30:45.4172757Z  2025-03-14T06:30:45.4173179Z  2025-03-14T06:30:45.4173624Z  2025-03-14T06:30:45.4174003Z  2025-03-14T06:30:45.4174383Z  2025-03-14T06:30:45.4174791Z  2025-03-14T06:30:45.4175184Z  2025-03-14T06:30:45.4176104Z [15,963 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:45.4177339Z Compiling xla/literal.cc; 32s local 2025-03-14T06:30:45.4177995Z Compiling xla/literal_comparison.cc; 16s local 2025-03-14T06:30:45.4178680Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:45.4179269Z Compiling xla/literal_util.cc; 10s local 2025-03-14T06:30:45.4179968Z Compiling xla/literal_comparison.cc; 9s local 2025-03-14T06:30:45.4180827Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 8s local 2025-03-14T06:30:45.4181876Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2025-03-14T06:30:45.4183139Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local ... 2025-03-14T06:30:45.6144476Z 2025-03-14T06:30:45.6145309Z  2025-03-14T06:30:45.6145814Z  2025-03-14T06:30:45.6146193Z  2025-03-14T06:30:45.6146599Z  2025-03-14T06:30:45.6147011Z  2025-03-14T06:30:45.6147430Z  2025-03-14T06:30:45.6147900Z  2025-03-14T06:30:45.6148301Z  2025-03-14T06:30:45.6149281Z [15,969 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:45.6150270Z Compiling xla/literal.cc; 32s local 2025-03-14T06:30:45.6150948Z Compiling xla/literal_comparison.cc; 16s local 2025-03-14T06:30:45.6151669Z Compiling xla/literal.cc; 13s local 2025-03-14T06:30:45.6152317Z Compiling xla/literal_util.cc; 10s local 2025-03-14T06:30:45.6153024Z Compiling xla/literal_comparison.cc; 10s local 2025-03-14T06:30:45.6153940Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 9s local 2025-03-14T06:30:45.6155022Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 8s local 2025-03-14T06:30:45.6156147Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local ... 2025-03-14T06:30:45.8318924Z 2025-03-14T06:30:45.8319798Z  2025-03-14T06:30:45.8320405Z  2025-03-14T06:30:45.8320785Z  2025-03-14T06:30:45.8321177Z  2025-03-14T06:30:45.8321545Z  2025-03-14T06:30:45.8321923Z  2025-03-14T06:30:45.8322337Z  2025-03-14T06:30:45.8322753Z  2025-03-14T06:30:45.8323703Z [15,973 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:45.8324786Z Compiling xla/literal.cc; 33s local 2025-03-14T06:30:45.8325453Z Compiling xla/literal_comparison.cc; 16s local 2025-03-14T06:30:45.8326401Z Compiling xla/literal.cc; 14s local 2025-03-14T06:30:45.8327057Z Compiling xla/literal_util.cc; 11s local 2025-03-14T06:30:45.8327769Z Compiling xla/literal_comparison.cc; 10s local 2025-03-14T06:30:45.8328580Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 9s local 2025-03-14T06:30:45.8329606Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2025-03-14T06:30:45.8330630Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local ... 2025-03-14T06:30:46.1211990Z 2025-03-14T06:30:46.1212858Z  2025-03-14T06:30:46.1213329Z  2025-03-14T06:30:46.1213736Z  2025-03-14T06:30:46.1214150Z  2025-03-14T06:30:46.1214558Z  2025-03-14T06:30:46.1214935Z  2025-03-14T06:30:46.1215580Z  2025-03-14T06:30:46.1215977Z  2025-03-14T06:30:46.1216929Z [15,974 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:46.1217844Z Compiling xla/literal.cc; 33s local 2025-03-14T06:30:46.1218534Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T06:30:46.1219258Z Compiling xla/literal.cc; 14s local 2025-03-14T06:30:46.1219832Z Compiling xla/literal_util.cc; 11s local 2025-03-14T06:30:46.1220548Z Compiling xla/literal_comparison.cc; 10s local 2025-03-14T06:30:46.1221433Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 9s local 2025-03-14T06:30:46.1222434Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2025-03-14T06:30:46.1223506Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 8s local ... 2025-03-14T06:30:46.5216451Z 2025-03-14T06:30:46.5217330Z  2025-03-14T06:30:46.5217852Z  2025-03-14T06:30:46.5218339Z  2025-03-14T06:30:46.5218805Z  2025-03-14T06:30:46.5219233Z  2025-03-14T06:30:46.5219717Z  2025-03-14T06:30:46.5220124Z  2025-03-14T06:30:46.5220537Z  2025-03-14T06:30:46.5221722Z [15,977 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:30:46.5222723Z Compiling xla/literal.cc; 33s local 2025-03-14T06:30:46.5223697Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T06:30:46.5224417Z Compiling xla/literal.cc; 14s local 2025-03-14T06:30:46.5225036Z Compiling xla/literal_util.cc; 11s local 2025-03-14T06:30:46.5225742Z Compiling xla/literal_comparison.cc; 10s local 2025-03-14T06:30:46.5226695Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 9s local 2025-03-14T06:30:46.5227790Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2025-03-14T06:30:46.5228770Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local ... 2025-03-14T06:30:46.7220577Z 2025-03-14T06:30:46.7221476Z  2025-03-14T06:30:46.7221956Z  2025-03-14T06:30:46.7222374Z  2025-03-14T06:30:46.7222788Z  2025-03-14T06:30:46.7223183Z  2025-03-14T06:30:46.7223570Z  2025-03-14T06:30:46.7223957Z  2025-03-14T06:30:46.7224379Z  2025-03-14T06:30:46.7225322Z [15,980 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:46.7226962Z Compiling xla/literal.cc; 34s local 2025-03-14T06:30:46.7227910Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T06:30:46.7228770Z Compiling xla/literal.cc; 15s local 2025-03-14T06:30:46.7229530Z Compiling xla/literal_util.cc; 11s local 2025-03-14T06:30:46.7230425Z Compiling xla/literal_comparison.cc; 11s local 2025-03-14T06:30:46.7231589Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2025-03-14T06:30:46.7232836Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 9s local 2025-03-14T06:30:46.7234223Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local ... 2025-03-14T06:30:46.9636775Z 2025-03-14T06:30:46.9638883Z  2025-03-14T06:30:46.9641720Z  2025-03-14T06:30:46.9642122Z  2025-03-14T06:30:46.9642505Z  2025-03-14T06:30:46.9642907Z  2025-03-14T06:30:46.9643539Z  2025-03-14T06:30:46.9643977Z  2025-03-14T06:30:46.9644372Z  2025-03-14T06:30:46.9645479Z [15,982 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:46.9646406Z Compiling xla/literal.cc; 34s local 2025-03-14T06:30:46.9647120Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T06:30:46.9647833Z Compiling xla/literal.cc; 15s local 2025-03-14T06:30:46.9648473Z Compiling xla/literal_util.cc; 12s local 2025-03-14T06:30:46.9649205Z Compiling xla/literal_comparison.cc; 11s local 2025-03-14T06:30:46.9650110Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2025-03-14T06:30:46.9651444Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2025-03-14T06:30:46.9652510Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local ... 2025-03-14T06:30:47.1683900Z 2025-03-14T06:30:47.1685019Z  2025-03-14T06:30:47.1685557Z  2025-03-14T06:30:47.1686023Z  2025-03-14T06:30:47.1686449Z  2025-03-14T06:30:47.1686871Z  2025-03-14T06:30:47.1687287Z  2025-03-14T06:30:47.1687730Z  2025-03-14T06:30:47.1688162Z  2025-03-14T06:30:47.1689119Z [15,990 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:47.1690081Z Compiling xla/literal.cc; 34s local 2025-03-14T06:30:47.1690788Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T06:30:47.1691780Z Compiling xla/literal.cc; 15s local 2025-03-14T06:30:47.1692437Z Compiling xla/literal_util.cc; 12s local 2025-03-14T06:30:47.1693143Z Compiling xla/literal_comparison.cc; 11s local 2025-03-14T06:30:47.1694090Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2025-03-14T06:30:47.1695194Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2025-03-14T06:30:47.1696305Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 9s local ... 2025-03-14T06:30:47.3844963Z 2025-03-14T06:30:47.3845837Z  2025-03-14T06:30:47.3846331Z  2025-03-14T06:30:47.3846750Z  2025-03-14T06:30:47.3847409Z  2025-03-14T06:30:47.3847837Z  2025-03-14T06:30:47.3848250Z  2025-03-14T06:30:47.3848653Z  2025-03-14T06:30:47.3849063Z  2025-03-14T06:30:47.3850036Z [15,999 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:47.3850994Z Compiling xla/literal.cc; 34s local 2025-03-14T06:30:47.3851733Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T06:30:47.3852435Z Compiling xla/literal.cc; 15s local 2025-03-14T06:30:47.3853036Z Compiling xla/literal_util.cc; 12s local 2025-03-14T06:30:47.3853721Z Compiling xla/literal_comparison.cc; 11s local 2025-03-14T06:30:47.3854603Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 10s local 2025-03-14T06:30:47.3855703Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLSymbols.cpp; 10s local 2025-03-14T06:30:47.3856833Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local ... 2025-03-14T06:30:47.6649699Z 2025-03-14T06:30:47.6650754Z  2025-03-14T06:30:47.6651315Z  2025-03-14T06:30:47.6651702Z  2025-03-14T06:30:47.6652061Z  2025-03-14T06:30:47.6652409Z  2025-03-14T06:30:47.6652797Z  2025-03-14T06:30:47.6653156Z  2025-03-14T06:30:47.6653550Z  2025-03-14T06:30:47.6654487Z [16,006 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:47.6655402Z Compiling xla/literal.cc; 34s local 2025-03-14T06:30:47.6655995Z Compiling xla/literal.cc; 15s local 2025-03-14T06:30:47.6656670Z Compiling xla/literal_util.cc; 12s local 2025-03-14T06:30:47.6657398Z Compiling xla/literal_comparison.cc; 12s local 2025-03-14T06:30:47.6658405Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local 2025-03-14T06:30:47.6659717Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2025-03-14T06:30:47.6660603Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:30:47.6661424Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 7s local ... 2025-03-14T06:30:47.9210026Z 2025-03-14T06:30:47.9210845Z  2025-03-14T06:30:47.9211299Z  2025-03-14T06:30:47.9211682Z  2025-03-14T06:30:47.9212056Z  2025-03-14T06:30:47.9212426Z  2025-03-14T06:30:47.9212788Z  2025-03-14T06:30:47.9213147Z  2025-03-14T06:30:47.9213565Z  2025-03-14T06:30:47.9214414Z [16,007 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:47.9215240Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:47.9217996Z Compiling xla/literal_util.cc; 13s local 2025-03-14T06:30:47.9218592Z Compiling xla/literal_comparison.cc; 12s local 2025-03-14T06:30:47.9219363Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local 2025-03-14T06:30:47.9220363Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2025-03-14T06:30:47.9221273Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:30:47.9222038Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2025-03-14T06:30:47.9222868Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 7s local ... 2025-03-14T06:30:48.1235225Z 2025-03-14T06:30:48.1236076Z  2025-03-14T06:30:48.1236700Z  2025-03-14T06:30:48.1237124Z  2025-03-14T06:30:48.1237841Z  2025-03-14T06:30:48.1238249Z  2025-03-14T06:30:48.1238661Z  2025-03-14T06:30:48.1239065Z  2025-03-14T06:30:48.1239491Z  2025-03-14T06:30:48.1240473Z [16,011 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:48.1241490Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:48.1242154Z Compiling xla/literal_util.cc; 13s local 2025-03-14T06:30:48.1242897Z Compiling xla/literal_comparison.cc; 12s local 2025-03-14T06:30:48.1243823Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local 2025-03-14T06:30:48.1245241Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 10s local 2025-03-14T06:30:48.1246260Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:30:48.1247139Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2025-03-14T06:30:48.1248056Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local ... 2025-03-14T06:30:48.3252373Z 2025-03-14T06:30:48.3253271Z  2025-03-14T06:30:48.3253793Z  2025-03-14T06:30:48.3254310Z  2025-03-14T06:30:48.3254771Z  2025-03-14T06:30:48.3255195Z  2025-03-14T06:30:48.3255644Z  2025-03-14T06:30:48.3256102Z  2025-03-14T06:30:48.3256539Z  2025-03-14T06:30:48.3257528Z [16,016 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:48.3258526Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:48.3259201Z Compiling xla/literal_util.cc; 13s local 2025-03-14T06:30:48.3259878Z Compiling xla/literal_comparison.cc; 12s local 2025-03-14T06:30:48.3260835Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local 2025-03-14T06:30:48.3261948Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T06:30:48.3262959Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:30:48.3263810Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2025-03-14T06:30:48.3264795Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local ... 2025-03-14T06:30:48.5478255Z 2025-03-14T06:30:48.5479072Z  2025-03-14T06:30:48.5479547Z  2025-03-14T06:30:48.5480111Z  2025-03-14T06:30:48.5480646Z  2025-03-14T06:30:48.5481182Z  2025-03-14T06:30:48.5481713Z  2025-03-14T06:30:48.5482169Z  2025-03-14T06:30:48.5482657Z  2025-03-14T06:30:48.5483802Z [16,021 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:48.5485056Z Compiling xla/literal.cc; 16s local 2025-03-14T06:30:48.5485785Z Compiling xla/literal_util.cc; 13s local 2025-03-14T06:30:48.5486483Z Compiling xla/literal_comparison.cc; 12s local 2025-03-14T06:30:48.5487452Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 11s local 2025-03-14T06:30:48.5488543Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T06:30:48.5489549Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:30:48.5490401Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 8s local 2025-03-14T06:30:48.5491307Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local ... 2025-03-14T06:30:48.7581746Z 2025-03-14T06:30:48.7582625Z  2025-03-14T06:30:48.7583133Z  2025-03-14T06:30:48.7583572Z  2025-03-14T06:30:48.7583987Z  2025-03-14T06:30:48.7584387Z  2025-03-14T06:30:48.7584784Z  2025-03-14T06:30:48.7585218Z  2025-03-14T06:30:48.7585626Z  2025-03-14T06:30:48.7586576Z [16,024 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:48.7587536Z Compiling xla/literal.cc; 17s local 2025-03-14T06:30:48.7588145Z Compiling xla/literal_util.cc; 14s local 2025-03-14T06:30:48.7588820Z Compiling xla/literal_comparison.cc; 13s local 2025-03-14T06:30:48.7589719Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2025-03-14T06:30:48.7591106Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T06:30:48.7592002Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2025-03-14T06:30:48.7592834Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2025-03-14T06:30:48.7593784Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local ... 2025-03-14T06:30:48.9690204Z 2025-03-14T06:30:48.9691055Z  2025-03-14T06:30:48.9691561Z  2025-03-14T06:30:48.9692005Z  2025-03-14T06:30:48.9692395Z  2025-03-14T06:30:48.9692785Z  2025-03-14T06:30:48.9693192Z  2025-03-14T06:30:48.9693608Z  2025-03-14T06:30:48.9694277Z  2025-03-14T06:30:48.9695244Z [16,026 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:48.9696137Z Compiling xla/literal.cc; 17s local 2025-03-14T06:30:48.9696719Z Compiling xla/literal_util.cc; 14s local 2025-03-14T06:30:48.9697383Z Compiling xla/literal_comparison.cc; 13s local 2025-03-14T06:30:48.9698281Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2025-03-14T06:30:48.9699321Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 11s local 2025-03-14T06:30:48.9700197Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2025-03-14T06:30:48.9700972Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2025-03-14T06:30:48.9701819Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 8s local ... 2025-03-14T06:30:49.3083373Z 2025-03-14T06:30:49.3084250Z  2025-03-14T06:30:49.3084874Z  2025-03-14T06:30:49.3085297Z  2025-03-14T06:30:49.3085688Z  2025-03-14T06:30:49.3086037Z  2025-03-14T06:30:49.3086427Z  2025-03-14T06:30:49.3086834Z  2025-03-14T06:30:49.3087230Z  2025-03-14T06:30:49.3088197Z [16,028 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:49.3089136Z Compiling xla/literal.cc; 17s local 2025-03-14T06:30:49.3089809Z Compiling xla/literal_util.cc; 14s local 2025-03-14T06:30:49.3090506Z Compiling xla/literal_comparison.cc; 13s local 2025-03-14T06:30:49.3091419Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2025-03-14T06:30:49.3092423Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:30:49.3093301Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2025-03-14T06:30:49.3094447Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2025-03-14T06:30:49.3095374Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local ... 2025-03-14T06:30:49.5247379Z 2025-03-14T06:30:49.5248295Z  2025-03-14T06:30:49.5248819Z  2025-03-14T06:30:49.5249226Z  2025-03-14T06:30:49.5249661Z  2025-03-14T06:30:49.5250085Z  2025-03-14T06:30:49.5250503Z  2025-03-14T06:30:49.5250919Z  2025-03-14T06:30:49.5251328Z  2025-03-14T06:30:49.5252309Z [16,032 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:49.5253298Z Compiling xla/literal.cc; 17s local 2025-03-14T06:30:49.5253963Z Compiling xla/literal_util.cc; 14s local 2025-03-14T06:30:49.5254990Z Compiling xla/literal_comparison.cc; 13s local 2025-03-14T06:30:49.5255813Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 12s local 2025-03-14T06:30:49.5256768Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:30:49.5257702Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2025-03-14T06:30:49.5258516Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 9s local 2025-03-14T06:30:49.5259406Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local ... 2025-03-14T06:30:49.7575399Z 2025-03-14T06:30:49.7576219Z  2025-03-14T06:30:49.7576711Z  2025-03-14T06:30:49.7577128Z  2025-03-14T06:30:49.7577546Z  2025-03-14T06:30:49.7577931Z  2025-03-14T06:30:49.7578309Z  2025-03-14T06:30:49.7579041Z  2025-03-14T06:30:49.7579464Z  2025-03-14T06:30:49.7580408Z [16,033 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:49.7581352Z Compiling xla/literal.cc; 18s local 2025-03-14T06:30:49.7582010Z Compiling xla/literal_util.cc; 15s local 2025-03-14T06:30:49.7582704Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:49.7583548Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2025-03-14T06:30:49.7584516Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:30:49.7585599Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T06:30:49.7586479Z Compiling llvm/lib/ObjectYAML/DWARFYAML.cpp; 10s local 2025-03-14T06:30:49.7587378Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local ... 2025-03-14T06:30:49.9634574Z 2025-03-14T06:30:49.9635429Z  2025-03-14T06:30:49.9635889Z  2025-03-14T06:30:49.9636330Z  2025-03-14T06:30:49.9636749Z  2025-03-14T06:30:49.9637149Z  2025-03-14T06:30:49.9637561Z  2025-03-14T06:30:49.9637972Z  2025-03-14T06:30:49.9638375Z  2025-03-14T06:30:49.9639347Z [16,036 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:49.9640263Z Compiling xla/literal.cc; 18s local 2025-03-14T06:30:49.9640840Z Compiling xla/literal_util.cc; 15s local 2025-03-14T06:30:49.9641524Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:49.9642370Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2025-03-14T06:30:49.9643450Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:30:49.9644345Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T06:30:49.9645362Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 9s local 2025-03-14T06:30:49.9646308Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 8s local ... 2025-03-14T06:30:50.1862733Z 2025-03-14T06:30:50.1863545Z  2025-03-14T06:30:50.1864019Z  2025-03-14T06:30:50.1864445Z  2025-03-14T06:30:50.1864868Z  2025-03-14T06:30:50.1865261Z  2025-03-14T06:30:50.1866042Z  2025-03-14T06:30:50.1866418Z  2025-03-14T06:30:50.1866822Z  2025-03-14T06:30:50.1867707Z [16,037 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:50.1868803Z Compiling xla/literal.cc; 18s local 2025-03-14T06:30:50.1869439Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:50.1870286Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2025-03-14T06:30:50.1871294Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 12s local 2025-03-14T06:30:50.1872277Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T06:30:50.1873140Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2025-03-14T06:30:50.1874065Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 8s local 2025-03-14T06:30:50.1875153Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 8s local ... 2025-03-14T06:30:50.4620877Z 2025-03-14T06:30:50.4622051Z  2025-03-14T06:30:50.4622537Z  2025-03-14T06:30:50.4622928Z  2025-03-14T06:30:50.4623346Z  2025-03-14T06:30:50.4623743Z  2025-03-14T06:30:50.4624148Z  2025-03-14T06:30:50.4624539Z  2025-03-14T06:30:50.4624952Z  2025-03-14T06:30:50.4625912Z [16,041 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:50.4626861Z Compiling xla/literal.cc; 18s local 2025-03-14T06:30:50.4627556Z Compiling xla/literal_comparison.cc; 14s local 2025-03-14T06:30:50.4628417Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 13s local 2025-03-14T06:30:50.4629506Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T06:30:50.4630659Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T06:30:50.4631522Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2025-03-14T06:30:50.4632480Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 9s local 2025-03-14T06:30:50.4633620Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 8s local ... 2025-03-14T06:30:50.7256070Z 2025-03-14T06:30:50.7256947Z  2025-03-14T06:30:50.7257433Z  2025-03-14T06:30:50.7257855Z  2025-03-14T06:30:50.7258287Z  2025-03-14T06:30:50.7258722Z  2025-03-14T06:30:50.7259064Z  2025-03-14T06:30:50.7259444Z  2025-03-14T06:30:50.7260094Z  2025-03-14T06:30:50.7261047Z [16,042 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:50.7261991Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:50.7262636Z Compiling xla/literal_comparison.cc; 15s local 2025-03-14T06:30:50.7263504Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2025-03-14T06:30:50.7264526Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T06:30:50.7265689Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:30:50.7266684Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2025-03-14T06:30:50.7267606Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 9s local 2025-03-14T06:30:50.7268666Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local ... 2025-03-14T06:30:50.9552171Z 2025-03-14T06:30:50.9552993Z  2025-03-14T06:30:50.9553502Z  2025-03-14T06:30:50.9553960Z  2025-03-14T06:30:50.9554386Z  2025-03-14T06:30:50.9554809Z  2025-03-14T06:30:50.9555229Z  2025-03-14T06:30:50.9555667Z  2025-03-14T06:30:50.9556095Z  2025-03-14T06:30:50.9557072Z [16,047 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:50.9558063Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:50.9569412Z Compiling xla/literal_comparison.cc; 15s local 2025-03-14T06:30:50.9570383Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2025-03-14T06:30:50.9571455Z Compiling llvm/lib/DebugInfo/DWARF/DWARFVerifier.cpp; 13s local 2025-03-14T06:30:50.9572386Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:30:50.9573292Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 10s local 2025-03-14T06:30:50.9574540Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 9s local 2025-03-14T06:30:50.9575759Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local ... 2025-03-14T06:30:51.1733722Z 2025-03-14T06:30:51.1734594Z  2025-03-14T06:30:51.1735089Z  2025-03-14T06:30:51.1735493Z  2025-03-14T06:30:51.1735918Z  2025-03-14T06:30:51.1736340Z  2025-03-14T06:30:51.1736728Z  2025-03-14T06:30:51.1737159Z  2025-03-14T06:30:51.1737577Z  2025-03-14T06:30:51.1738578Z [16,051 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:51.1739552Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:51.1740501Z Compiling xla/literal_comparison.cc; 15s local 2025-03-14T06:30:51.1741364Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2025-03-14T06:30:51.1742269Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:30:51.1743157Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2025-03-14T06:30:51.1744124Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 9s local 2025-03-14T06:30:51.1745345Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local 2025-03-14T06:30:51.1746455Z Compiling mlir/lib/Dialect/Quant/IR/QuantOps.cpp; 7s local ... 2025-03-14T06:30:51.3959203Z 2025-03-14T06:30:51.3960038Z  2025-03-14T06:30:51.3960512Z  2025-03-14T06:30:51.3960913Z  2025-03-14T06:30:51.3961553Z  2025-03-14T06:30:51.3961954Z  2025-03-14T06:30:51.3962347Z  2025-03-14T06:30:51.3962742Z  2025-03-14T06:30:51.3963079Z  2025-03-14T06:30:51.3963991Z [16,055 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:51.3965086Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:51.3965951Z Compiling xla/literal_comparison.cc; 15s local 2025-03-14T06:30:51.3966807Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 14s local 2025-03-14T06:30:51.3967738Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:30:51.3968838Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2025-03-14T06:30:51.3969777Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 9s local 2025-03-14T06:30:51.3970891Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local 2025-03-14T06:30:51.3971937Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 6s local ... 2025-03-14T06:30:51.6387050Z 2025-03-14T06:30:51.6387915Z  2025-03-14T06:30:51.6388408Z  2025-03-14T06:30:51.6388843Z  2025-03-14T06:30:51.6389261Z  2025-03-14T06:30:51.6389667Z  2025-03-14T06:30:51.6390119Z  2025-03-14T06:30:51.6390544Z  2025-03-14T06:30:51.6390958Z  2025-03-14T06:30:51.6391902Z [16,060 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:51.6392877Z Compiling xla/literal.cc; 19s local 2025-03-14T06:30:51.6393567Z Compiling xla/literal_comparison.cc; 16s local 2025-03-14T06:30:51.6394500Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2025-03-14T06:30:51.6395442Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:30:51.6396375Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2025-03-14T06:30:51.6397405Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 10s local 2025-03-14T06:30:51.6398359Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2025-03-14T06:30:51.6399177Z Compiling xla/service/cpu/cpu_options.cc; 6s local ... 2025-03-14T06:30:51.8458981Z 2025-03-14T06:30:51.8459824Z  2025-03-14T06:30:51.8460327Z  2025-03-14T06:30:51.8460760Z  2025-03-14T06:30:51.8461157Z  2025-03-14T06:30:51.8461561Z  2025-03-14T06:30:51.8461942Z  2025-03-14T06:30:51.8462337Z  2025-03-14T06:30:51.8462729Z  2025-03-14T06:30:51.8463913Z [16,066 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:51.8464845Z Compiling xla/literal.cc; 20s local 2025-03-14T06:30:51.8465802Z Compiling xla/literal_comparison.cc; 16s local 2025-03-14T06:30:51.8466683Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2025-03-14T06:30:51.8467623Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T06:30:51.8468521Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 11s local 2025-03-14T06:30:51.8469486Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 10s local 2025-03-14T06:30:51.8470423Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2025-03-14T06:30:51.8471416Z Compiling xla/service/cpu/cpu_options.cc; 7s local ... 2025-03-14T06:30:52.1267026Z 2025-03-14T06:30:52.1267879Z  2025-03-14T06:30:52.1268357Z  2025-03-14T06:30:52.1268798Z  2025-03-14T06:30:52.1269198Z  2025-03-14T06:30:52.1269646Z  2025-03-14T06:30:52.1270063Z  2025-03-14T06:30:52.1270491Z  2025-03-14T06:30:52.1270897Z  2025-03-14T06:30:52.1271845Z [16,066 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:52.1272782Z Compiling xla/literal.cc; 20s local 2025-03-14T06:30:52.1273471Z Compiling xla/literal_comparison.cc; 16s local 2025-03-14T06:30:52.1274340Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2025-03-14T06:30:52.1275499Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T06:30:52.1276387Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2025-03-14T06:30:52.1277343Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 10s local 2025-03-14T06:30:52.1278258Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2025-03-14T06:30:52.1279034Z Compiling xla/service/cpu/cpu_options.cc; 7s local ... 2025-03-14T06:30:52.3360680Z 2025-03-14T06:30:52.3361505Z  2025-03-14T06:30:52.3361983Z  2025-03-14T06:30:52.3362351Z  2025-03-14T06:30:52.3362807Z  2025-03-14T06:30:52.3363178Z  2025-03-14T06:30:52.3363827Z  2025-03-14T06:30:52.3364227Z  2025-03-14T06:30:52.3364761Z  2025-03-14T06:30:52.3365895Z [16,068 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:52.3366925Z Compiling xla/literal.cc; 20s local 2025-03-14T06:30:52.3367599Z Compiling xla/literal_comparison.cc; 16s local 2025-03-14T06:30:52.3368528Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 15s local 2025-03-14T06:30:52.3369502Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T06:30:52.3370454Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2025-03-14T06:30:52.3371497Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 10s local 2025-03-14T06:30:52.3372415Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 7s local 2025-03-14T06:30:52.3373235Z Compiling xla/service/cpu/cpu_options.cc; 7s local ... 2025-03-14T06:30:52.6050877Z 2025-03-14T06:30:52.6051740Z  2025-03-14T06:30:52.6052264Z  2025-03-14T06:30:52.6052669Z  2025-03-14T06:30:52.6053088Z  2025-03-14T06:30:52.6053500Z  2025-03-14T06:30:52.6053906Z  2025-03-14T06:30:52.6054312Z  2025-03-14T06:30:52.6054728Z  2025-03-14T06:30:52.6055712Z [16,069 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:52.6056696Z Compiling xla/literal.cc; 20s local 2025-03-14T06:30:52.6057409Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T06:30:52.6058285Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2025-03-14T06:30:52.6059300Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T06:30:52.6060267Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2025-03-14T06:30:52.6061511Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 11s local 2025-03-14T06:30:52.6062474Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2025-03-14T06:30:52.6063304Z Compiling xla/service/cpu/cpu_options.cc; 7s local ... 2025-03-14T06:30:52.8874873Z 2025-03-14T06:30:52.8875720Z  2025-03-14T06:30:52.8876202Z  2025-03-14T06:30:52.8876624Z  2025-03-14T06:30:52.8877013Z  2025-03-14T06:30:52.8877441Z  2025-03-14T06:30:52.8877873Z  2025-03-14T06:30:52.8878256Z  2025-03-14T06:30:52.8878696Z  2025-03-14T06:30:52.8879659Z [16,070 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:52.8880566Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:52.8881626Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T06:30:52.8882564Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2025-03-14T06:30:52.8883614Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 12s local 2025-03-14T06:30:52.8884760Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 11s local 2025-03-14T06:30:52.8885621Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2025-03-14T06:30:52.8886430Z Compiling xla/service/cpu/cpu_options.cc; 8s local 2025-03-14T06:30:52.8887297Z Compiling mlir/lib/Dialect/Arith/Utils/Utils.cpp; 8s local ... 2025-03-14T06:30:53.1274827Z 2025-03-14T06:30:53.1275707Z  2025-03-14T06:30:53.1276164Z  2025-03-14T06:30:53.1276652Z  2025-03-14T06:30:53.1277296Z  2025-03-14T06:30:53.1277681Z  2025-03-14T06:30:53.1277995Z  2025-03-14T06:30:53.1278317Z  2025-03-14T06:30:53.1278712Z  2025-03-14T06:30:53.1279644Z [16,073 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:53.1280634Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:53.1281291Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T06:30:53.1282167Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2025-03-14T06:30:53.1283135Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:53.1284547Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 11s local 2025-03-14T06:30:53.1285458Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2025-03-14T06:30:53.1286341Z Compiling mlir/lib/Dialect/Arith/Utils/Utils.cpp; 8s local 2025-03-14T06:30:53.1287199Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local ... 2025-03-14T06:30:53.3987525Z 2025-03-14T06:30:53.3988491Z  2025-03-14T06:30:53.3988980Z  2025-03-14T06:30:53.3989415Z  2025-03-14T06:30:53.3989839Z  2025-03-14T06:30:53.3990203Z  2025-03-14T06:30:53.3990636Z  2025-03-14T06:30:53.3991035Z  2025-03-14T06:30:53.3991432Z  2025-03-14T06:30:53.3992370Z [16,077 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:53.3993310Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:53.3993985Z Compiling xla/literal_comparison.cc; 17s local 2025-03-14T06:30:53.3994871Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 16s local 2025-03-14T06:30:53.3995836Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:53.3996802Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 11s local 2025-03-14T06:30:53.3997717Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 8s local 2025-03-14T06:30:53.3998478Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2025-03-14T06:30:53.3999397Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 7s local ... 2025-03-14T06:30:53.7048898Z 2025-03-14T06:30:53.7049685Z  2025-03-14T06:30:53.7050141Z  2025-03-14T06:30:53.7050512Z  2025-03-14T06:30:53.7050866Z  2025-03-14T06:30:53.7051231Z  2025-03-14T06:30:53.7051586Z  2025-03-14T06:30:53.7051928Z  2025-03-14T06:30:53.7052311Z  2025-03-14T06:30:53.7053518Z [16,083 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:53.7054431Z Compiling xla/literal.cc; 21s local 2025-03-14T06:30:53.7055040Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T06:30:53.7055803Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2025-03-14T06:30:53.7056767Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:53.7057644Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 12s local 2025-03-14T06:30:53.7058540Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2025-03-14T06:30:53.7059285Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 8s local 2025-03-14T06:30:53.7060233Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 8s local ... 2025-03-14T06:30:53.9162077Z 2025-03-14T06:30:53.9162962Z  2025-03-14T06:30:53.9163467Z  2025-03-14T06:30:53.9163894Z  2025-03-14T06:30:53.9164329Z  2025-03-14T06:30:53.9164924Z  2025-03-14T06:30:53.9165575Z  2025-03-14T06:30:53.9166010Z  2025-03-14T06:30:53.9166415Z  2025-03-14T06:30:53.9167412Z [16,087 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:53.9168418Z Compiling xla/literal.cc; 22s local 2025-03-14T06:30:53.9169140Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T06:30:53.9170092Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2025-03-14T06:30:53.9171346Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 13s local 2025-03-14T06:30:53.9172334Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 12s local 2025-03-14T06:30:53.9173237Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2025-03-14T06:30:53.9174109Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T06:30:53.9175100Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 8s local ... 2025-03-14T06:30:54.1283702Z 2025-03-14T06:30:54.1284747Z  2025-03-14T06:30:54.1285303Z  2025-03-14T06:30:54.1285711Z  2025-03-14T06:30:54.1286121Z  2025-03-14T06:30:54.1286520Z  2025-03-14T06:30:54.1287195Z  2025-03-14T06:30:54.1287629Z  2025-03-14T06:30:54.1288026Z  2025-03-14T06:30:54.1288855Z [16,088 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:54.1289815Z Compiling xla/literal.cc; 22s local 2025-03-14T06:30:54.1290516Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T06:30:54.1291463Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2025-03-14T06:30:54.1292490Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T06:30:54.1293470Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 12s local 2025-03-14T06:30:54.1294408Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2025-03-14T06:30:54.1295237Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T06:30:54.1296191Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 8s local ... 2025-03-14T06:30:54.3287973Z 2025-03-14T06:30:54.3288878Z  2025-03-14T06:30:54.3289379Z  2025-03-14T06:30:54.3289811Z  2025-03-14T06:30:54.3290247Z  2025-03-14T06:30:54.3290652Z  2025-03-14T06:30:54.3291038Z  2025-03-14T06:30:54.3291428Z  2025-03-14T06:30:54.3291862Z  2025-03-14T06:30:54.3292862Z [16,092 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:54.3293863Z Compiling xla/literal.cc; 22s local 2025-03-14T06:30:54.3294550Z Compiling xla/literal_comparison.cc; 18s local 2025-03-14T06:30:54.3295455Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2025-03-14T06:30:54.3296490Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T06:30:54.3297555Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 12s local 2025-03-14T06:30:54.3298743Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 9s local 2025-03-14T06:30:54.3299616Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T06:30:54.3300593Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 8s local ... 2025-03-14T06:30:54.5644883Z 2025-03-14T06:30:54.5645777Z  2025-03-14T06:30:54.5646299Z  2025-03-14T06:30:54.5646726Z  2025-03-14T06:30:54.5647157Z  2025-03-14T06:30:54.5647577Z  2025-03-14T06:30:54.5648000Z  2025-03-14T06:30:54.5648441Z  2025-03-14T06:30:54.5648855Z  2025-03-14T06:30:54.5649877Z [16,096 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:54.5650880Z Compiling xla/literal.cc; 22s local 2025-03-14T06:30:54.5651990Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 17s local 2025-03-14T06:30:54.5653066Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T06:30:54.5654113Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 13s local 2025-03-14T06:30:54.5655099Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2025-03-14T06:30:54.5656005Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T06:30:54.5656964Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 8s local 2025-03-14T06:30:54.5657920Z Compiling mlir/lib/Dialect/DLTI/DLTI.cpp; 7s local ... 2025-03-14T06:30:54.7668219Z 2025-03-14T06:30:54.7669511Z  2025-03-14T06:30:54.7670496Z  2025-03-14T06:30:54.7671572Z  2025-03-14T06:30:54.7672197Z  2025-03-14T06:30:54.7673345Z  2025-03-14T06:30:54.7673808Z  2025-03-14T06:30:54.7674213Z  2025-03-14T06:30:54.7674612Z  2025-03-14T06:30:54.7675580Z [16,097 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:54.7676480Z Compiling xla/literal.cc; 23s local 2025-03-14T06:30:54.7677311Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2025-03-14T06:30:54.7678303Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 14s local 2025-03-14T06:30:54.7679531Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 13s local 2025-03-14T06:30:54.7680492Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2025-03-14T06:30:54.7681353Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 9s local 2025-03-14T06:30:54.7682267Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 9s local 2025-03-14T06:30:54.7683190Z Compiling mlir/lib/Dialect/DLTI/DLTI.cpp; 7s local ... 2025-03-14T06:30:55.1291343Z 2025-03-14T06:30:55.1292753Z  2025-03-14T06:30:55.1293226Z  2025-03-14T06:30:55.1293627Z  2025-03-14T06:30:55.1294068Z  2025-03-14T06:30:55.1294528Z  2025-03-14T06:30:55.1294923Z  2025-03-14T06:30:55.1295301Z  2025-03-14T06:30:55.1295675Z  2025-03-14T06:30:55.1296610Z [16,100 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:55.1297615Z Compiling xla/literal.cc; 23s local 2025-03-14T06:30:55.1298503Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2025-03-14T06:30:55.1299531Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T06:30:55.1300626Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 13s local 2025-03-14T06:30:55.1301588Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2025-03-14T06:30:55.1302445Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2025-03-14T06:30:55.1303357Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 9s local 2025-03-14T06:30:55.1304269Z Compiling mlir/lib/Dialect/DLTI/DLTI.cpp; 7s local ... 2025-03-14T06:30:55.3412114Z 2025-03-14T06:30:55.3413551Z  2025-03-14T06:30:55.3414080Z  2025-03-14T06:30:55.3414502Z  2025-03-14T06:30:55.3414890Z  2025-03-14T06:30:55.3415308Z  2025-03-14T06:30:55.3415843Z  2025-03-14T06:30:55.3416283Z  2025-03-14T06:30:55.3416989Z  2025-03-14T06:30:55.3417939Z [16,104 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:55.3418902Z Compiling xla/literal.cc; 23s local 2025-03-14T06:30:55.3419709Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 18s local 2025-03-14T06:30:55.3420687Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T06:30:55.3421695Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 13s local 2025-03-14T06:30:55.3422681Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 10s local 2025-03-14T06:30:55.3423497Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2025-03-14T06:30:55.3424403Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 9s local 2025-03-14T06:30:55.3425545Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 6s local ... 2025-03-14T06:30:55.7038225Z 2025-03-14T06:30:55.7039201Z  2025-03-14T06:30:55.7039864Z  2025-03-14T06:30:55.7040271Z  2025-03-14T06:30:55.7040718Z  2025-03-14T06:30:55.7041158Z  2025-03-14T06:30:55.7041598Z  2025-03-14T06:30:55.7041989Z  2025-03-14T06:30:55.7042430Z  2025-03-14T06:30:55.7043477Z [16,106 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:55.7044580Z Compiling xla/literal.cc; 23s local 2025-03-14T06:30:55.7045479Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2025-03-14T06:30:55.7046475Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T06:30:55.7048011Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2025-03-14T06:30:55.7048939Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2025-03-14T06:30:55.7049802Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2025-03-14T06:30:55.7050678Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 10s local 2025-03-14T06:30:55.7051656Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 6s local ... 2025-03-14T06:30:55.9243582Z 2025-03-14T06:30:55.9245092Z  2025-03-14T06:30:55.9245604Z  2025-03-14T06:30:55.9246028Z  2025-03-14T06:30:55.9246712Z  2025-03-14T06:30:55.9247142Z  2025-03-14T06:30:55.9247576Z  2025-03-14T06:30:55.9248004Z  2025-03-14T06:30:55.9248397Z  2025-03-14T06:30:55.9249339Z [16,110 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:55.9250258Z Compiling xla/literal.cc; 24s local 2025-03-14T06:30:55.9251195Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2025-03-14T06:30:55.9252168Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 15s local 2025-03-14T06:30:55.9253116Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2025-03-14T06:30:55.9254005Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2025-03-14T06:30:55.9254803Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T06:30:55.9255681Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 10s local 2025-03-14T06:30:55.9256595Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 6s local ... 2025-03-14T06:30:56.1300107Z 2025-03-14T06:30:56.1300986Z  2025-03-14T06:30:56.1301545Z  2025-03-14T06:30:56.1301999Z  2025-03-14T06:30:56.1302446Z  2025-03-14T06:30:56.1302890Z  2025-03-14T06:30:56.1303295Z  2025-03-14T06:30:56.1303691Z  2025-03-14T06:30:56.1304126Z  2025-03-14T06:30:56.1305155Z [16,112 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:56.1306138Z Compiling xla/literal.cc; 24s local 2025-03-14T06:30:56.1307034Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2025-03-14T06:30:56.1308122Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T06:30:56.1309226Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2025-03-14T06:30:56.1310552Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2025-03-14T06:30:56.1311501Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T06:30:56.1312530Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 10s local 2025-03-14T06:30:56.1313507Z Compiling llvm/lib/SandboxIR/Context.cpp; 6s local ... 2025-03-14T06:30:56.3304951Z 2025-03-14T06:30:56.3305864Z  2025-03-14T06:30:56.3306439Z  2025-03-14T06:30:56.3306867Z  2025-03-14T06:30:56.3307321Z  2025-03-14T06:30:56.3307803Z  2025-03-14T06:30:56.3308242Z  2025-03-14T06:30:56.3308704Z  2025-03-14T06:30:56.3309118Z  2025-03-14T06:30:56.3310088Z [16,113 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:56.3311342Z Compiling xla/literal.cc; 24s local 2025-03-14T06:30:56.3312208Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2025-03-14T06:30:56.3313274Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T06:30:56.3314302Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local 2025-03-14T06:30:56.3315294Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 11s local 2025-03-14T06:30:56.3316179Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T06:30:56.3317142Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 10s local 2025-03-14T06:30:56.3318092Z Compiling llvm/lib/SandboxIR/Context.cpp; 6s local ... 2025-03-14T06:30:56.5674705Z 2025-03-14T06:30:56.5675887Z  2025-03-14T06:30:56.5676876Z  2025-03-14T06:30:56.5677897Z  2025-03-14T06:30:56.5678403Z  2025-03-14T06:30:56.5678848Z  2025-03-14T06:30:56.5679277Z  2025-03-14T06:30:56.5679722Z  2025-03-14T06:30:56.5680117Z  2025-03-14T06:30:56.5681029Z [16,116 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:56.5681941Z Compiling xla/literal.cc; 24s local 2025-03-14T06:30:56.5682761Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 19s local 2025-03-14T06:30:56.5683949Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T06:30:56.5685117Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2025-03-14T06:30:56.5686019Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2025-03-14T06:30:56.5686835Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T06:30:56.5687759Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 10s local 2025-03-14T06:30:56.5688746Z Compiling llvm/lib/SandboxIR/Context.cpp; 6s local ... 2025-03-14T06:30:56.9126163Z 2025-03-14T06:30:56.9127186Z  2025-03-14T06:30:56.9127769Z  2025-03-14T06:30:56.9128233Z  2025-03-14T06:30:56.9128690Z  2025-03-14T06:30:56.9129152Z  2025-03-14T06:30:56.9129594Z  2025-03-14T06:30:56.9130027Z  2025-03-14T06:30:56.9130417Z  2025-03-14T06:30:56.9131398Z [16,119 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:56.9132397Z Compiling xla/literal.cc; 25s local 2025-03-14T06:30:56.9133241Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2025-03-14T06:30:56.9134327Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 16s local 2025-03-14T06:30:56.9135385Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2025-03-14T06:30:56.9136285Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2025-03-14T06:30:56.9137194Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T06:30:56.9138183Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 11s local 2025-03-14T06:30:56.9139167Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local ... 2025-03-14T06:30:57.1309461Z 2025-03-14T06:30:57.1310760Z  2025-03-14T06:30:57.1311263Z  2025-03-14T06:30:57.1311694Z  2025-03-14T06:30:57.1312121Z  2025-03-14T06:30:57.1312859Z  2025-03-14T06:30:57.1313305Z  2025-03-14T06:30:57.1313710Z  2025-03-14T06:30:57.1314118Z  2025-03-14T06:30:57.1315095Z [16,122 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:57.1316117Z Compiling xla/literal.cc; 25s local 2025-03-14T06:30:57.1316924Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2025-03-14T06:30:57.1317896Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T06:30:57.1318884Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2025-03-14T06:30:57.1319770Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2025-03-14T06:30:57.1320612Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T06:30:57.1321773Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 11s local 2025-03-14T06:30:57.1322642Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local ... 2025-03-14T06:30:57.3555308Z 2025-03-14T06:30:57.3556387Z  2025-03-14T06:30:57.3556930Z  2025-03-14T06:30:57.3557346Z  2025-03-14T06:30:57.3557766Z  2025-03-14T06:30:57.3558198Z  2025-03-14T06:30:57.3558603Z  2025-03-14T06:30:57.3559044Z  2025-03-14T06:30:57.3559472Z  2025-03-14T06:30:57.3560431Z [16,124 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:57.3561350Z Compiling xla/literal.cc; 25s local 2025-03-14T06:30:57.3562188Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 20s local 2025-03-14T06:30:57.3563454Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T06:30:57.3564615Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local 2025-03-14T06:30:57.3565701Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 12s local 2025-03-14T06:30:57.3566471Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T06:30:57.3567616Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 11s local 2025-03-14T06:30:57.3568691Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local ... 2025-03-14T06:30:57.6016696Z 2025-03-14T06:30:57.6018231Z  2025-03-14T06:30:57.6018775Z  2025-03-14T06:30:57.6019193Z  2025-03-14T06:30:57.6019610Z  2025-03-14T06:30:57.6020039Z  2025-03-14T06:30:57.6020444Z  2025-03-14T06:30:57.6020835Z  2025-03-14T06:30:57.6021250Z  2025-03-14T06:30:57.6022180Z [16,126 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:57.6023117Z Compiling xla/literal.cc; 25s local 2025-03-14T06:30:57.6023915Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T06:30:57.6024882Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T06:30:57.6025838Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T06:30:57.6026773Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2025-03-14T06:30:57.6027593Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T06:30:57.6028468Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 11s local 2025-03-14T06:30:57.6029312Z Compiling llvm/lib/SandboxIR/Context.cpp; 7s local ... 2025-03-14T06:30:57.8528604Z 2025-03-14T06:30:57.8529923Z  2025-03-14T06:30:57.8530405Z  2025-03-14T06:30:57.8530797Z  2025-03-14T06:30:57.8531211Z  2025-03-14T06:30:57.8531634Z  2025-03-14T06:30:57.8532043Z  2025-03-14T06:30:57.8532489Z  2025-03-14T06:30:57.8532886Z  2025-03-14T06:30:57.8533837Z [16,131 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:57.8534751Z Compiling xla/literal.cc; 26s local 2025-03-14T06:30:57.8535585Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T06:30:57.8536581Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 17s local 2025-03-14T06:30:57.8537774Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T06:30:57.8538714Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2025-03-14T06:30:57.8539569Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:30:57.8540458Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2025-03-14T06:30:57.8541341Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local ... 2025-03-14T06:30:58.0762705Z 2025-03-14T06:30:58.0763596Z  2025-03-14T06:30:58.0764113Z  2025-03-14T06:30:58.0764704Z  2025-03-14T06:30:58.0765133Z  2025-03-14T06:30:58.0765745Z  2025-03-14T06:30:58.0766152Z  2025-03-14T06:30:58.0766549Z  2025-03-14T06:30:58.0766953Z  2025-03-14T06:30:58.0768087Z [16,135 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:58.0769025Z Compiling xla/literal.cc; 26s local 2025-03-14T06:30:58.0769874Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T06:30:58.0770975Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:58.0771938Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T06:30:58.0772852Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2025-03-14T06:30:58.0773675Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:30:58.0774586Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2025-03-14T06:30:58.0775420Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local ... 2025-03-14T06:30:58.3035011Z 2025-03-14T06:30:58.3035998Z  2025-03-14T06:30:58.3037354Z  2025-03-14T06:30:58.3038935Z  2025-03-14T06:30:58.3039407Z  2025-03-14T06:30:58.3039809Z  2025-03-14T06:30:58.3040221Z  2025-03-14T06:30:58.3040631Z  2025-03-14T06:30:58.3041059Z  2025-03-14T06:30:58.3042018Z [16,143 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:58.3042930Z Compiling xla/literal.cc; 26s local 2025-03-14T06:30:58.3044030Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T06:30:58.3045285Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:58.3046306Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T06:30:58.3047302Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 13s local 2025-03-14T06:30:58.3048183Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:30:58.3049133Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2025-03-14T06:30:58.3050099Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local ... 2025-03-14T06:30:58.5143429Z 2025-03-14T06:30:58.5144348Z  2025-03-14T06:30:58.5144800Z  2025-03-14T06:30:58.5145214Z  2025-03-14T06:30:58.5145629Z  2025-03-14T06:30:58.5146039Z  2025-03-14T06:30:58.5146466Z  2025-03-14T06:30:58.5146860Z  2025-03-14T06:30:58.5147310Z  2025-03-14T06:30:58.5148381Z [16,151 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:30:58.5149191Z Compiling xla/literal.cc; 26s local 2025-03-14T06:30:58.5149994Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 21s local 2025-03-14T06:30:58.5151017Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:58.5152014Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T06:30:58.5152977Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2025-03-14T06:30:58.5153861Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:30:58.5154590Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 12s local 2025-03-14T06:30:58.5155276Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local ... 2025-03-14T06:30:58.7175089Z 2025-03-14T06:30:58.7175908Z  2025-03-14T06:30:58.7176381Z  2025-03-14T06:30:58.7176995Z  2025-03-14T06:30:58.7177386Z  2025-03-14T06:30:58.7177781Z  2025-03-14T06:30:58.7178173Z  2025-03-14T06:30:58.7178555Z  2025-03-14T06:30:58.7178954Z  2025-03-14T06:30:58.7179866Z [16,162 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:30:58.7180791Z Compiling xla/literal.cc; 27s local 2025-03-14T06:30:58.7181634Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2025-03-14T06:30:58.7182695Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:58.7183778Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T06:30:58.7184638Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2025-03-14T06:30:58.7185648Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:30:58.7186619Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T06:30:58.7187484Z Compiling llvm/lib/SandboxIR/Context.cpp; 8s local ... 2025-03-14T06:30:58.9187008Z 2025-03-14T06:30:58.9187844Z  2025-03-14T06:30:58.9188331Z  2025-03-14T06:30:58.9188774Z  2025-03-14T06:30:58.9189192Z  2025-03-14T06:30:58.9189592Z  2025-03-14T06:30:58.9190008Z  2025-03-14T06:30:58.9190421Z  2025-03-14T06:30:58.9190825Z  2025-03-14T06:30:58.9191795Z [16,173 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:58.9193003Z Compiling xla/literal.cc; 27s local 2025-03-14T06:30:58.9193809Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2025-03-14T06:30:58.9194809Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 18s local 2025-03-14T06:30:58.9195811Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T06:30:58.9196728Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2025-03-14T06:30:58.9197596Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:30:58.9198520Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T06:30:58.9199543Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local ... 2025-03-14T06:30:59.1356634Z 2025-03-14T06:30:59.1357475Z  2025-03-14T06:30:59.1357943Z  2025-03-14T06:30:59.1358338Z  2025-03-14T06:30:59.1358732Z  2025-03-14T06:30:59.1359125Z  2025-03-14T06:30:59.1359519Z  2025-03-14T06:30:59.1359924Z  2025-03-14T06:30:59.1360411Z  2025-03-14T06:30:59.1361421Z [16,186 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:30:59.1362366Z Compiling xla/literal.cc; 27s local 2025-03-14T06:30:59.1363246Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2025-03-14T06:30:59.1364276Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T06:30:59.1365701Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T06:30:59.1366655Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2025-03-14T06:30:59.1367546Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:30:59.1368450Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T06:30:59.1369473Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 7s local ... 2025-03-14T06:30:59.3414737Z 2025-03-14T06:30:59.3415622Z  2025-03-14T06:30:59.3416130Z  2025-03-14T06:30:59.3416542Z  2025-03-14T06:30:59.3416959Z  2025-03-14T06:30:59.3417355Z  2025-03-14T06:30:59.3417778Z  2025-03-14T06:30:59.3418175Z  2025-03-14T06:30:59.3418584Z  2025-03-14T06:30:59.3419508Z [16,195 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:59.3420404Z Compiling xla/literal.cc; 27s local 2025-03-14T06:30:59.3421217Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2025-03-14T06:30:59.3422450Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T06:30:59.3423384Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 14s local 2025-03-14T06:30:59.3424235Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:30:59.3425150Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T06:30:59.3426128Z Compiling llvm/lib/Analysis/BlockFrequencyInfo.cpp; 8s local 2025-03-14T06:30:59.3427257Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 7s local ... 2025-03-14T06:30:59.5670198Z 2025-03-14T06:30:59.5671078Z  2025-03-14T06:30:59.5671558Z  2025-03-14T06:30:59.5671970Z  2025-03-14T06:30:59.5672365Z  2025-03-14T06:30:59.5672762Z  2025-03-14T06:30:59.5673449Z  2025-03-14T06:30:59.5673849Z  2025-03-14T06:30:59.5674264Z  2025-03-14T06:30:59.5675192Z [16,209 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:59.5676112Z Compiling xla/literal.cc; 27s local 2025-03-14T06:30:59.5676908Z Compiling mlir/lib/IR/BuiltinAttributes.cpp [for tool]; 22s local 2025-03-14T06:30:59.5677894Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T06:30:59.5678760Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T06:30:59.5679591Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:30:59.5680520Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local 2025-03-14T06:30:59.5681763Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 8s local 2025-03-14T06:30:59.5682817Z Compiling xla/service/cpu/cpu_options.cc; 6s local ... 2025-03-14T06:30:59.7858533Z 2025-03-14T06:30:59.7859380Z  2025-03-14T06:30:59.7859849Z  2025-03-14T06:30:59.7860226Z  2025-03-14T06:30:59.7860610Z  2025-03-14T06:30:59.7861007Z  2025-03-14T06:30:59.7861406Z  2025-03-14T06:30:59.7861789Z  2025-03-14T06:30:59.7862192Z  2025-03-14T06:30:59.7863088Z [16,223 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:30:59.7864193Z Compiling xla/literal.cc; 28s local 2025-03-14T06:30:59.7864945Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T06:30:59.7866041Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T06:30:59.7866833Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:30:59.7867688Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T06:30:59.7868678Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 8s local 2025-03-14T06:30:59.7869545Z Compiling xla/service/cpu/cpu_options.cc; 6s local 2025-03-14T06:30:59.7870325Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 6s local ... 2025-03-14T06:31:00.0280971Z 2025-03-14T06:31:00.0282312Z  2025-03-14T06:31:00.0282788Z  2025-03-14T06:31:00.0283168Z  2025-03-14T06:31:00.0283579Z  2025-03-14T06:31:00.0283967Z  2025-03-14T06:31:00.0284357Z  2025-03-14T06:31:00.0284873Z  2025-03-14T06:31:00.0285242Z  2025-03-14T06:31:00.0286078Z [16,231 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:00.0286881Z Compiling xla/literal.cc; 28s local 2025-03-14T06:31:00.0287559Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 19s local 2025-03-14T06:31:00.0288330Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T06:31:00.0289088Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T06:31:00.0289905Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T06:31:00.0290885Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 8s local 2025-03-14T06:31:00.0291762Z Compiling xla/service/cpu/cpu_options.cc; 7s local 2025-03-14T06:31:00.0292495Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local ... 2025-03-14T06:31:00.2321683Z 2025-03-14T06:31:00.2322601Z  2025-03-14T06:31:00.2323103Z  2025-03-14T06:31:00.2323521Z  2025-03-14T06:31:00.2323958Z  2025-03-14T06:31:00.2324326Z  2025-03-14T06:31:00.2324883Z  2025-03-14T06:31:00.2325285Z  2025-03-14T06:31:00.2325705Z  2025-03-14T06:31:00.2326631Z [16,244 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:00.2327559Z Compiling xla/literal.cc; 28s local 2025-03-14T06:31:00.2328329Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T06:31:00.2329168Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T06:31:00.2330068Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T06:31:00.2331213Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T06:31:00.2332213Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 8s local 2025-03-14T06:31:00.2333227Z Compiling xla/service/cpu/cpu_options.cc; 7s local 2025-03-14T06:31:00.2334091Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local ... 2025-03-14T06:31:00.4393139Z 2025-03-14T06:31:00.4394117Z  2025-03-14T06:31:00.4394637Z  2025-03-14T06:31:00.4396747Z  2025-03-14T06:31:00.4397843Z  2025-03-14T06:31:00.4398518Z  2025-03-14T06:31:00.4399144Z  2025-03-14T06:31:00.4399761Z  2025-03-14T06:31:00.4400382Z  2025-03-14T06:31:00.4401717Z [16,265 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:00.4403344Z Compiling xla/literal.cc; 28s local 2025-03-14T06:31:00.4404307Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T06:31:00.4405597Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local 2025-03-14T06:31:00.4406726Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T06:31:00.4407793Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T06:31:00.4409067Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 8s local 2025-03-14T06:31:00.4410501Z Compiling xla/service/cpu/cpu_options.cc; 7s local 2025-03-14T06:31:00.4411555Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local ... 2025-03-14T06:31:00.6425233Z 2025-03-14T06:31:00.6426609Z  2025-03-14T06:31:00.6427428Z  2025-03-14T06:31:00.6428610Z  2025-03-14T06:31:00.6429079Z  2025-03-14T06:31:00.6429482Z  2025-03-14T06:31:00.6429915Z  2025-03-14T06:31:00.6430311Z  2025-03-14T06:31:00.6430705Z  2025-03-14T06:31:00.6431618Z [16,279 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:00.6432505Z Compiling xla/literal.cc; 28s local 2025-03-14T06:31:00.6433281Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T06:31:00.6434115Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2025-03-14T06:31:00.6434941Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T06:31:00.6435845Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:00.6436903Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local 2025-03-14T06:31:00.6437862Z Compiling xla/service/cpu/cpu_options.cc; 7s local 2025-03-14T06:31:00.6438693Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local ... 2025-03-14T06:31:00.8826891Z 2025-03-14T06:31:00.8827869Z  2025-03-14T06:31:00.8828378Z  2025-03-14T06:31:00.8828796Z  2025-03-14T06:31:00.8829224Z  2025-03-14T06:31:00.8829659Z  2025-03-14T06:31:00.8830048Z  2025-03-14T06:31:00.8830413Z  2025-03-14T06:31:00.8830813Z  2025-03-14T06:31:00.8831704Z [16,288 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:00.8832643Z Compiling xla/literal.cc; 29s local 2025-03-14T06:31:00.8833648Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 20s local 2025-03-14T06:31:00.8834476Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2025-03-14T06:31:00.8835261Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T06:31:00.8836094Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:00.8837107Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local 2025-03-14T06:31:00.8838044Z Compiling xla/service/cpu/cpu_options.cc; 7s local 2025-03-14T06:31:00.8838893Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 7s local ... 2025-03-14T06:31:01.0808601Z 2025-03-14T06:31:01.0809569Z  2025-03-14T06:31:01.0810068Z  2025-03-14T06:31:01.0810487Z  2025-03-14T06:31:01.0811186Z  2025-03-14T06:31:01.0811588Z  2025-03-14T06:31:01.0811992Z  2025-03-14T06:31:01.0812409Z  2025-03-14T06:31:01.0812799Z  2025-03-14T06:31:01.0813709Z [16,291 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:01.0814582Z Compiling xla/literal.cc; 29s local 2025-03-14T06:31:01.0815351Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:31:01.0816186Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2025-03-14T06:31:01.0817006Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T06:31:01.0817879Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:01.0818894Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local 2025-03-14T06:31:01.0834152Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:31:01.0834997Z Compiling mlir/lib/Dialect/Arith/Utils/Utils.cpp; 7s local ... 2025-03-14T06:31:01.3374831Z 2025-03-14T06:31:01.3375689Z  2025-03-14T06:31:01.3376213Z  2025-03-14T06:31:01.3376639Z  2025-03-14T06:31:01.3377052Z  2025-03-14T06:31:01.3377468Z  2025-03-14T06:31:01.3377886Z  2025-03-14T06:31:01.3378329Z  2025-03-14T06:31:01.3378709Z  2025-03-14T06:31:01.3379894Z [16,292 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:01.3380876Z Compiling xla/literal.cc; 29s local 2025-03-14T06:31:01.3381675Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:31:01.3382607Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local 2025-03-14T06:31:01.3383493Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T06:31:01.3384468Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:01.3385588Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramDialect.cpp; 9s local 2025-03-14T06:31:01.3386673Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:31:01.3387632Z Compiling mlir/lib/Dialect/Arith/Utils/Utils.cpp; 8s local ... 2025-03-14T06:31:01.5403543Z 2025-03-14T06:31:01.5405014Z  2025-03-14T06:31:01.5405476Z  2025-03-14T06:31:01.5405871Z  2025-03-14T06:31:01.5406220Z  2025-03-14T06:31:01.5406578Z  2025-03-14T06:31:01.5406941Z  2025-03-14T06:31:01.5407316Z  2025-03-14T06:31:01.5407669Z  2025-03-14T06:31:01.5408513Z [16,295 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:01.5409331Z Compiling xla/literal.cc; 29s local 2025-03-14T06:31:01.5410018Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:31:01.5410789Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T06:31:01.5411512Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T06:31:01.5412301Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:01.5413094Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:31:01.5413854Z Compiling mlir/lib/Dialect/Arith/Utils/Utils.cpp; 8s local 2025-03-14T06:31:01.5415087Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 6s local ... 2025-03-14T06:31:01.7911312Z 2025-03-14T06:31:01.7912117Z  2025-03-14T06:31:01.7912630Z  2025-03-14T06:31:01.7913065Z  2025-03-14T06:31:01.7913475Z  2025-03-14T06:31:01.7913895Z  2025-03-14T06:31:01.7914327Z  2025-03-14T06:31:01.7914753Z  2025-03-14T06:31:01.7915168Z  2025-03-14T06:31:01.7916155Z [16,298 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:01.7917159Z Compiling xla/literal.cc; 30s local 2025-03-14T06:31:01.7918001Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:31:01.7919067Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T06:31:01.7920231Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T06:31:01.7921158Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T06:31:01.7922105Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 8s local 2025-03-14T06:31:01.7923014Z Compiling mlir/lib/Dialect/Arith/Utils/Utils.cpp; 8s local 2025-03-14T06:31:01.7924170Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local ... 2025-03-14T06:31:02.0552513Z 2025-03-14T06:31:02.0553371Z  2025-03-14T06:31:02.0553901Z  2025-03-14T06:31:02.0554316Z  2025-03-14T06:31:02.0554762Z  2025-03-14T06:31:02.0555199Z  2025-03-14T06:31:02.0555620Z  2025-03-14T06:31:02.0556036Z  2025-03-14T06:31:02.0556716Z  2025-03-14T06:31:02.0557686Z [16,301 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:02.0558684Z Compiling xla/literal.cc; 30s local 2025-03-14T06:31:02.0559483Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 21s local 2025-03-14T06:31:02.0560432Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T06:31:02.0561341Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T06:31:02.0562312Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T06:31:02.0563480Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2025-03-14T06:31:02.0564716Z Compiling llvm/lib/ObjectYAML/CodeViewYAMLDebugSections.cpp; 7s local 2025-03-14T06:31:02.0566072Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 6s local ... 2025-03-14T06:31:02.3378294Z 2025-03-14T06:31:02.3379411Z  2025-03-14T06:31:02.3380172Z  2025-03-14T06:31:02.3380698Z  2025-03-14T06:31:02.3381111Z  2025-03-14T06:31:02.3381477Z  2025-03-14T06:31:02.3381865Z  2025-03-14T06:31:02.3382234Z  2025-03-14T06:31:02.3382650Z  2025-03-14T06:31:02.3383643Z [16,304 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:02.3384666Z Compiling xla/literal.cc; 30s local 2025-03-14T06:31:02.3385493Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 22s local 2025-03-14T06:31:02.3386425Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T06:31:02.3387329Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T06:31:02.3388298Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T06:31:02.3389237Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2025-03-14T06:31:02.3390191Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local 2025-03-14T06:31:02.3391297Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 6s local ... 2025-03-14T06:31:02.5382551Z 2025-03-14T06:31:02.5383541Z  2025-03-14T06:31:02.5384069Z  2025-03-14T06:31:02.5384518Z  2025-03-14T06:31:02.5384955Z  2025-03-14T06:31:02.5385398Z  2025-03-14T06:31:02.5385954Z  2025-03-14T06:31:02.5386377Z  2025-03-14T06:31:02.5386796Z  2025-03-14T06:31:02.5387819Z [16,307 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:02.5389045Z Compiling xla/literal.cc; 30s local 2025-03-14T06:31:02.5389871Z Compiling mlir/lib/Dialect/Index/IR/IndexOps.cpp; 22s local 2025-03-14T06:31:02.5390821Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2025-03-14T06:31:02.5391621Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T06:31:02.5392491Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T06:31:02.5393423Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2025-03-14T06:31:02.5394317Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local 2025-03-14T06:31:02.5395261Z Compiling llvm/lib/ObjectYAML/DXContainerEmitter.cpp; 6s local ... 2025-03-14T06:31:02.7870164Z 2025-03-14T06:31:02.7871339Z  2025-03-14T06:31:02.7871871Z  2025-03-14T06:31:02.7872301Z  2025-03-14T06:31:02.7872724Z  2025-03-14T06:31:02.7873140Z  2025-03-14T06:31:02.7873576Z  2025-03-14T06:31:02.7873984Z  2025-03-14T06:31:02.7874407Z  2025-03-14T06:31:02.7875413Z [16,312 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:02.7876402Z Compiling xla/literal.cc; 31s local 2025-03-14T06:31:02.7877177Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2025-03-14T06:31:02.7878087Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T06:31:02.7879035Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T06:31:02.7879976Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 9s local 2025-03-14T06:31:02.7881132Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local 2025-03-14T06:31:02.7882070Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local 2025-03-14T06:31:02.7882996Z Compiling llvm/lib/ObjectYAML/MachOYAML.cpp; 5s local ... 2025-03-14T06:31:03.1389013Z 2025-03-14T06:31:03.1389935Z  2025-03-14T06:31:03.1390434Z  2025-03-14T06:31:03.1390878Z  2025-03-14T06:31:03.1391265Z  2025-03-14T06:31:03.1391708Z  2025-03-14T06:31:03.1392126Z  2025-03-14T06:31:03.1392544Z  2025-03-14T06:31:03.1392962Z  2025-03-14T06:31:03.1394224Z [16,316 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:03.1395195Z Compiling xla/literal.cc; 31s local 2025-03-14T06:31:03.1395962Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2025-03-14T06:31:03.1396927Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T06:31:03.1397858Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T06:31:03.1398778Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 7s local 2025-03-14T06:31:03.1399691Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local 2025-03-14T06:31:03.1400460Z Compiling llvm/lib/Object/ELF.cpp; 4s local 2025-03-14T06:31:03.1401268Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 4s local ... 2025-03-14T06:31:03.3391258Z 2025-03-14T06:31:03.3392562Z  2025-03-14T06:31:03.3393085Z  2025-03-14T06:31:03.3393529Z  2025-03-14T06:31:03.3393960Z  2025-03-14T06:31:03.3394362Z  2025-03-14T06:31:03.3394778Z  2025-03-14T06:31:03.3395203Z  2025-03-14T06:31:03.3395639Z  2025-03-14T06:31:03.3396615Z [16,319 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:03.3397592Z Compiling xla/literal.cc; 31s local 2025-03-14T06:31:03.3398388Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T06:31:03.3399328Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T06:31:03.3400263Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local 2025-03-14T06:31:03.3401226Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local 2025-03-14T06:31:03.3402035Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2025-03-14T06:31:03.3402837Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 4s local 2025-03-14T06:31:03.3404121Z Compiling llvm/lib/ObjectYAML/MinidumpYAML.cpp; 4s local ... 2025-03-14T06:31:03.6118963Z 2025-03-14T06:31:03.6121444Z  2025-03-14T06:31:03.6124043Z  2025-03-14T06:31:03.6124702Z  2025-03-14T06:31:03.6125116Z  2025-03-14T06:31:03.6125535Z  2025-03-14T06:31:03.6125936Z  2025-03-14T06:31:03.6126351Z  2025-03-14T06:31:03.6126770Z  2025-03-14T06:31:03.6127719Z [16,321 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:03.6128702Z Compiling xla/literal.cc; 31s local 2025-03-14T06:31:03.6129558Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T06:31:03.6130506Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T06:31:03.6131812Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local 2025-03-14T06:31:03.6132783Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 6s local 2025-03-14T06:31:03.6133594Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2025-03-14T06:31:03.6134411Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 5s local 2025-03-14T06:31:03.6135274Z @llvm-project//mlir:SparseTensorDialect; 4s local ... 2025-03-14T06:31:03.8207336Z 2025-03-14T06:31:03.8208176Z  2025-03-14T06:31:03.8208669Z  2025-03-14T06:31:03.8209065Z  2025-03-14T06:31:03.8209471Z  2025-03-14T06:31:03.8209879Z  2025-03-14T06:31:03.8210274Z  2025-03-14T06:31:03.8210690Z  2025-03-14T06:31:03.8211382Z  2025-03-14T06:31:03.8212337Z [16,334 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:03.8213251Z Compiling xla/literal.cc; 32s local 2025-03-14T06:31:03.8214034Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T06:31:03.8215014Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 10s local 2025-03-14T06:31:03.8216146Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local 2025-03-14T06:31:03.8217286Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2025-03-14T06:31:03.8218341Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2025-03-14T06:31:03.8219148Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 5s local 2025-03-14T06:31:03.8219936Z @llvm-project//mlir:SparseTensorDialect; 4s local ... 2025-03-14T06:31:04.1398547Z 2025-03-14T06:31:04.1399396Z  2025-03-14T06:31:04.1399886Z  2025-03-14T06:31:04.1400275Z  2025-03-14T06:31:04.1400647Z  2025-03-14T06:31:04.1401165Z  2025-03-14T06:31:04.1401564Z  2025-03-14T06:31:04.1401971Z  2025-03-14T06:31:04.1402389Z  2025-03-14T06:31:04.1403328Z [16,343 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:04.1404336Z Compiling xla/literal.cc; 32s local 2025-03-14T06:31:04.1405278Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T06:31:04.1406190Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:31:04.1407070Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 8s local 2025-03-14T06:31:04.1408006Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2025-03-14T06:31:04.1408773Z Compiling llvm/lib/Object/ELF.cpp; 5s local 2025-03-14T06:31:04.1409513Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 5s local 2025-03-14T06:31:04.1410387Z @llvm-project//mlir:SparseTensorDialect; 5s local ... 2025-03-14T06:31:04.3402541Z 2025-03-14T06:31:04.3404024Z  2025-03-14T06:31:04.3404741Z  2025-03-14T06:31:04.3405195Z  2025-03-14T06:31:04.3405652Z  2025-03-14T06:31:04.3406097Z  2025-03-14T06:31:04.3406552Z  2025-03-14T06:31:04.3407130Z  2025-03-14T06:31:04.3407559Z  2025-03-14T06:31:04.3408558Z [16,344 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:04.3409431Z Compiling xla/literal.cc; 32s local 2025-03-14T06:31:04.3410429Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T06:31:04.3411400Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:31:04.3412363Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T06:31:04.3413334Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 7s local 2025-03-14T06:31:04.3414126Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2025-03-14T06:31:04.3414790Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 5s local 2025-03-14T06:31:04.3415713Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 5s local ... 2025-03-14T06:31:04.7407633Z 2025-03-14T06:31:04.7409032Z  2025-03-14T06:31:04.7409535Z  2025-03-14T06:31:04.7409931Z  2025-03-14T06:31:04.7410724Z  2025-03-14T06:31:04.7411144Z  2025-03-14T06:31:04.7411599Z  2025-03-14T06:31:04.7412017Z  2025-03-14T06:31:04.7412425Z  2025-03-14T06:31:04.7413381Z [16,345 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:04.7414447Z Compiling xla/literal.cc; 33s local 2025-03-14T06:31:04.7415175Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T06:31:04.7416014Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:31:04.7416927Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T06:31:04.7417826Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2025-03-14T06:31:04.7418578Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2025-03-14T06:31:04.7419583Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 6s local 2025-03-14T06:31:04.7420624Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 5s local ... 2025-03-14T06:31:04.9412442Z 2025-03-14T06:31:04.9413349Z  2025-03-14T06:31:04.9413852Z  2025-03-14T06:31:04.9415724Z  2025-03-14T06:31:04.9416376Z  2025-03-14T06:31:04.9417072Z  2025-03-14T06:31:04.9417538Z  2025-03-14T06:31:04.9417997Z  2025-03-14T06:31:04.9418433Z  2025-03-14T06:31:04.9419683Z [16,346 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:04.9420660Z Compiling xla/literal.cc; 33s local 2025-03-14T06:31:04.9421520Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T06:31:04.9422442Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 11s local 2025-03-14T06:31:04.9423408Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 9s local 2025-03-14T06:31:04.9424418Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2025-03-14T06:31:04.9425254Z Compiling llvm/lib/Object/ELF.cpp; 6s local 2025-03-14T06:31:04.9426063Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 6s local 2025-03-14T06:31:04.9427143Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 5s local ... 2025-03-14T06:31:05.2574115Z 2025-03-14T06:31:05.2574970Z  2025-03-14T06:31:05.2575570Z  2025-03-14T06:31:05.2576025Z  2025-03-14T06:31:05.2576432Z  2025-03-14T06:31:05.2576822Z  2025-03-14T06:31:05.2577230Z  2025-03-14T06:31:05.2577643Z  2025-03-14T06:31:05.2578046Z  2025-03-14T06:31:05.2578995Z [16,348 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:05.2579885Z Compiling xla/literal.cc; 33s local 2025-03-14T06:31:05.2580669Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T06:31:05.2581509Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T06:31:05.2582375Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T06:31:05.2583292Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2025-03-14T06:31:05.2584083Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2025-03-14T06:31:05.2584863Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 6s local 2025-03-14T06:31:05.2586137Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 5s local ... 2025-03-14T06:31:05.5416598Z 2025-03-14T06:31:05.5417914Z  2025-03-14T06:31:05.5418971Z  2025-03-14T06:31:05.5420169Z  2025-03-14T06:31:05.5420766Z  2025-03-14T06:31:05.5421168Z  2025-03-14T06:31:05.5421561Z  2025-03-14T06:31:05.5421977Z  2025-03-14T06:31:05.5422373Z  2025-03-14T06:31:05.5423308Z [16,348 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:05.5424267Z Compiling xla/literal.cc; 33s local 2025-03-14T06:31:05.5425023Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T06:31:05.5425924Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T06:31:05.5427183Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T06:31:05.5428144Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 8s local 2025-03-14T06:31:05.5428931Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2025-03-14T06:31:05.5429713Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 7s local 2025-03-14T06:31:05.5430722Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 6s local ... 2025-03-14T06:31:05.7421581Z 2025-03-14T06:31:05.7422532Z  2025-03-14T06:31:05.7423043Z  2025-03-14T06:31:05.7423465Z  2025-03-14T06:31:05.7423863Z  2025-03-14T06:31:05.7424239Z  2025-03-14T06:31:05.7424647Z  2025-03-14T06:31:05.7425044Z  2025-03-14T06:31:05.7425451Z  2025-03-14T06:31:05.7426716Z [16,349 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:05.7427642Z Compiling xla/literal.cc; 34s local 2025-03-14T06:31:05.7428407Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T06:31:05.7429311Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 12s local 2025-03-14T06:31:05.7430231Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T06:31:05.7431172Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2025-03-14T06:31:05.7431937Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2025-03-14T06:31:05.7432899Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 7s local 2025-03-14T06:31:05.7433908Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 6s local ... 2025-03-14T06:31:06.0874200Z 2025-03-14T06:31:06.0877834Z  2025-03-14T06:31:06.0878334Z  2025-03-14T06:31:06.0878748Z  2025-03-14T06:31:06.0879153Z  2025-03-14T06:31:06.0879604Z  2025-03-14T06:31:06.0880025Z  2025-03-14T06:31:06.0880438Z  2025-03-14T06:31:06.0880836Z  2025-03-14T06:31:06.0881824Z [16,350 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:06.0882816Z Compiling xla/literal.cc; 34s local 2025-03-14T06:31:06.0883636Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T06:31:06.0884662Z Compiling llvm/lib/Object/ELFObjectFile.cpp; 13s local 2025-03-14T06:31:06.0885570Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 10s local 2025-03-14T06:31:06.0886556Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2025-03-14T06:31:06.0887363Z Compiling llvm/lib/Object/ELF.cpp; 7s local 2025-03-14T06:31:06.0888141Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 7s local 2025-03-14T06:31:06.0889166Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 6s local ... 2025-03-14T06:31:06.3431081Z 2025-03-14T06:31:06.3431961Z  2025-03-14T06:31:06.3432467Z  2025-03-14T06:31:06.3432905Z  2025-03-14T06:31:06.3433337Z  2025-03-14T06:31:06.3433754Z  2025-03-14T06:31:06.3434175Z  2025-03-14T06:31:06.3434598Z  2025-03-14T06:31:06.3435023Z  2025-03-14T06:31:06.3436007Z [16,351 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:06.3436985Z Compiling xla/literal.cc; 34s local 2025-03-14T06:31:06.3438013Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T06:31:06.3439074Z Compiling llvm/lib/DebugInfo/DWARF/DWARFContext.cpp; 11s local 2025-03-14T06:31:06.3440082Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2025-03-14T06:31:06.3441053Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2025-03-14T06:31:06.3441898Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 7s local 2025-03-14T06:31:06.3442924Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 7s local 2025-03-14T06:31:06.3444012Z Compiling llvm/lib/Analysis/CGSCCPassManager.cpp; 6s local ... 2025-03-14T06:31:06.5438255Z 2025-03-14T06:31:06.5439138Z  2025-03-14T06:31:06.5439648Z  2025-03-14T06:31:06.5440304Z  2025-03-14T06:31:06.5440709Z  2025-03-14T06:31:06.5441133Z  2025-03-14T06:31:06.5441569Z  2025-03-14T06:31:06.5441990Z  2025-03-14T06:31:06.5442386Z  2025-03-14T06:31:06.5443425Z [16,353 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:06.5446524Z Compiling xla/literal.cc; 34s local 2025-03-14T06:31:06.5447382Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T06:31:06.5448335Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 9s local 2025-03-14T06:31:06.5449160Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2025-03-14T06:31:06.5449890Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 8s local 2025-03-14T06:31:06.5450886Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 7s local 2025-03-14T06:31:06.5452182Z Compiling llvm/lib/Analysis/CGSCCPassManager.cpp; 7s local 2025-03-14T06:31:06.5454062Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 6s local ... 2025-03-14T06:31:06.8336495Z 2025-03-14T06:31:06.8337327Z  2025-03-14T06:31:06.8337822Z  2025-03-14T06:31:06.8338228Z  2025-03-14T06:31:06.8338641Z  2025-03-14T06:31:06.8339040Z  2025-03-14T06:31:06.8339489Z  2025-03-14T06:31:06.8339896Z  2025-03-14T06:31:06.8340290Z  2025-03-14T06:31:06.8341477Z [16,355 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:06.8342675Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T06:31:06.8343500Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2025-03-14T06:31:06.8344195Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2025-03-14T06:31:06.8344874Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 8s local 2025-03-14T06:31:06.8345730Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 7s local 2025-03-14T06:31:06.8346680Z Compiling llvm/lib/Analysis/CGSCCPassManager.cpp; 7s local 2025-03-14T06:31:06.8347709Z Compiling llvm/lib/DebugInfo/PDB/Native/SymbolCache.cpp; 7s local 2025-03-14T06:31:06.8348785Z Compiling mlir/lib/IR/BuiltinDialect.cpp [for tool]; 7s local ... 2025-03-14T06:31:07.1352485Z 2025-03-14T06:31:07.1353369Z  2025-03-14T06:31:07.1353849Z  2025-03-14T06:31:07.1354298Z  2025-03-14T06:31:07.1354712Z  2025-03-14T06:31:07.1355132Z  2025-03-14T06:31:07.1355540Z  2025-03-14T06:31:07.1355930Z  2025-03-14T06:31:07.1356323Z  2025-03-14T06:31:07.1357265Z [16,358 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:07.1358462Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T06:31:07.1359390Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2025-03-14T06:31:07.1360217Z Compiling llvm/lib/Object/ELF.cpp; 8s local 2025-03-14T06:31:07.1360999Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 8s local 2025-03-14T06:31:07.1362003Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 7s local 2025-03-14T06:31:07.1363119Z Compiling mlir/lib/IR/BuiltinDialect.cpp [for tool]; 7s local 2025-03-14T06:31:07.1364318Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 6s local 2025-03-14T06:31:07.1365684Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 6s local ... 2025-03-14T06:31:07.3442831Z 2025-03-14T06:31:07.3443681Z  2025-03-14T06:31:07.3444164Z  2025-03-14T06:31:07.3444716Z  2025-03-14T06:31:07.3445114Z  2025-03-14T06:31:07.3445510Z  2025-03-14T06:31:07.3445907Z  2025-03-14T06:31:07.3446290Z  2025-03-14T06:31:07.3446690Z  2025-03-14T06:31:07.3447631Z [16,358 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:07.3448698Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T06:31:07.3449490Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2025-03-14T06:31:07.3450457Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T06:31:07.3451152Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 8s local 2025-03-14T06:31:07.3452077Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 8s local 2025-03-14T06:31:07.3453099Z Compiling mlir/lib/IR/BuiltinDialect.cpp [for tool]; 7s local 2025-03-14T06:31:07.3453968Z Compiling llvm/lib/ObjectYAML/WasmEmitter.cpp; 7s local 2025-03-14T06:31:07.3454915Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 6s local ... 2025-03-14T06:31:07.5446894Z 2025-03-14T06:31:07.5447773Z  2025-03-14T06:31:07.5448237Z  2025-03-14T06:31:07.5448656Z  2025-03-14T06:31:07.5449072Z  2025-03-14T06:31:07.5449618Z  2025-03-14T06:31:07.5450047Z  2025-03-14T06:31:07.5450744Z  2025-03-14T06:31:07.5451177Z  2025-03-14T06:31:07.5452179Z [16,362 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:07.5453399Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T06:31:07.5454393Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 10s local 2025-03-14T06:31:07.5455233Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T06:31:07.5456058Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 9s local 2025-03-14T06:31:07.5457226Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 8s local 2025-03-14T06:31:07.5458331Z Compiling mlir/lib/IR/BuiltinDialect.cpp [for tool]; 7s local 2025-03-14T06:31:07.5459318Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 7s local 2025-03-14T06:31:07.5460295Z Compiling llvm/lib/ObjectYAML/XCOFFEmitter.cpp; 6s local ... 2025-03-14T06:31:07.8809931Z 2025-03-14T06:31:07.8810811Z  2025-03-14T06:31:07.8811339Z  2025-03-14T06:31:07.8811754Z  2025-03-14T06:31:07.8812271Z  2025-03-14T06:31:07.8812705Z  2025-03-14T06:31:07.8813081Z  2025-03-14T06:31:07.8813459Z  2025-03-14T06:31:07.8813873Z  2025-03-14T06:31:07.8814870Z [16,363 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:07.8815986Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T06:31:07.8816938Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2025-03-14T06:31:07.8817666Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T06:31:07.8818412Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 9s local 2025-03-14T06:31:07.8819354Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 8s local 2025-03-14T06:31:07.8820363Z Compiling mlir/lib/IR/BuiltinDialect.cpp [for tool]; 8s local 2025-03-14T06:31:07.8821325Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 7s local 2025-03-14T06:31:07.8822212Z Compiling llvm/lib/ObjectYAML/XCOFFEmitter.cpp; 7s local ... 2025-03-14T06:31:08.1453735Z 2025-03-14T06:31:08.1454551Z  2025-03-14T06:31:08.1455059Z  2025-03-14T06:31:08.1455463Z  2025-03-14T06:31:08.1455918Z  2025-03-14T06:31:08.1456344Z  2025-03-14T06:31:08.1456694Z  2025-03-14T06:31:08.1457151Z  2025-03-14T06:31:08.1457669Z  2025-03-14T06:31:08.1459111Z [16,365 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:08.1460232Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T06:31:08.1461117Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2025-03-14T06:31:08.1461895Z Compiling llvm/lib/Object/ELF.cpp; 9s local 2025-03-14T06:31:08.1462572Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 9s local 2025-03-14T06:31:08.1463526Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 8s local 2025-03-14T06:31:08.1464515Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 7s local 2025-03-14T06:31:08.1465698Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 7s local 2025-03-14T06:31:08.1466658Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 7s local ... 2025-03-14T06:31:08.3457444Z 2025-03-14T06:31:08.3458303Z  2025-03-14T06:31:08.3458776Z  2025-03-14T06:31:08.3459197Z  2025-03-14T06:31:08.3459608Z  2025-03-14T06:31:08.3460006Z  2025-03-14T06:31:08.3460439Z  2025-03-14T06:31:08.3460846Z  2025-03-14T06:31:08.3461224Z  2025-03-14T06:31:08.3462174Z [16,366 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:08.3463266Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T06:31:08.3464151Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2025-03-14T06:31:08.3464934Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T06:31:08.3465962Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 9s local 2025-03-14T06:31:08.3467240Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 9s local 2025-03-14T06:31:08.3468128Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 7s local 2025-03-14T06:31:08.3468975Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 7s local 2025-03-14T06:31:08.3469856Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 7s local ... 2025-03-14T06:31:08.6770183Z 2025-03-14T06:31:08.6771067Z  2025-03-14T06:31:08.6771577Z  2025-03-14T06:31:08.6771999Z  2025-03-14T06:31:08.6772419Z  2025-03-14T06:31:08.6772838Z  2025-03-14T06:31:08.6773561Z  2025-03-14T06:31:08.6773982Z  2025-03-14T06:31:08.6774394Z  2025-03-14T06:31:08.6775348Z [16,367 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:08.6776411Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T06:31:08.6777353Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 11s local 2025-03-14T06:31:08.6778128Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T06:31:08.6778964Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 10s local 2025-03-14T06:31:08.6779969Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 9s local 2025-03-14T06:31:08.6781121Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 8s local 2025-03-14T06:31:08.6782014Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 7s local 2025-03-14T06:31:08.6782918Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 7s local ... 2025-03-14T06:31:08.9463632Z 2025-03-14T06:31:08.9464468Z  2025-03-14T06:31:08.9464957Z  2025-03-14T06:31:08.9465662Z  2025-03-14T06:31:08.9466142Z  2025-03-14T06:31:08.9466537Z  2025-03-14T06:31:08.9466920Z  2025-03-14T06:31:08.9467294Z  2025-03-14T06:31:08.9467644Z  2025-03-14T06:31:08.9468534Z [16,368 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:08.9469567Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T06:31:08.9470419Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2025-03-14T06:31:08.9471171Z Compiling llvm/lib/Object/ELF.cpp; 10s local 2025-03-14T06:31:08.9471897Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 10s local 2025-03-14T06:31:08.9473063Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 9s local 2025-03-14T06:31:08.9474030Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 8s local 2025-03-14T06:31:08.9474879Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 8s local 2025-03-14T06:31:08.9475779Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 7s local ... 2025-03-14T06:31:09.3776415Z 2025-03-14T06:31:09.3777254Z  2025-03-14T06:31:09.3777754Z  2025-03-14T06:31:09.3778178Z  2025-03-14T06:31:09.3778589Z  2025-03-14T06:31:09.3778986Z  2025-03-14T06:31:09.3779430Z  2025-03-14T06:31:09.3779841Z  2025-03-14T06:31:09.3780227Z  2025-03-14T06:31:09.3781193Z [16,369 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:09.3782696Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T06:31:09.3783636Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 12s local 2025-03-14T06:31:09.3784454Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T06:31:09.3785198Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 10s local 2025-03-14T06:31:09.3786221Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 10s local 2025-03-14T06:31:09.3787163Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 8s local 2025-03-14T06:31:09.3788048Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 8s local 2025-03-14T06:31:09.3789002Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 8s local ... 2025-03-14T06:31:09.7471100Z 2025-03-14T06:31:09.7471893Z  2025-03-14T06:31:09.7472721Z  2025-03-14T06:31:09.7473086Z  2025-03-14T06:31:09.7473438Z  2025-03-14T06:31:09.7473797Z  2025-03-14T06:31:09.7474139Z  2025-03-14T06:31:09.7474505Z  2025-03-14T06:31:09.7474891Z  2025-03-14T06:31:09.7475778Z [16,370 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:09.7476766Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T06:31:09.7477599Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T06:31:09.7478466Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T06:31:09.7479163Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 11s local 2025-03-14T06:31:09.7480042Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 10s local 2025-03-14T06:31:09.7480932Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 9s local 2025-03-14T06:31:09.7481707Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 8s local 2025-03-14T06:31:09.7482571Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 8s local ... 2025-03-14T06:31:09.9475593Z 2025-03-14T06:31:09.9476460Z  2025-03-14T06:31:09.9476929Z  2025-03-14T06:31:09.9477371Z  2025-03-14T06:31:09.9477761Z  2025-03-14T06:31:09.9478163Z  2025-03-14T06:31:09.9478577Z  2025-03-14T06:31:09.9478942Z  2025-03-14T06:31:09.9479331Z  2025-03-14T06:31:09.9480283Z [16,371 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:09.9481351Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T06:31:09.9482240Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T06:31:09.9482984Z Compiling llvm/lib/Object/ELF.cpp; 11s local 2025-03-14T06:31:09.9483716Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 11s local 2025-03-14T06:31:09.9484844Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 10s local 2025-03-14T06:31:09.9485859Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 9s local 2025-03-14T06:31:09.9486717Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 9s local 2025-03-14T06:31:09.9487627Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 8s local ... 2025-03-14T06:31:10.3479966Z 2025-03-14T06:31:10.3480794Z  2025-03-14T06:31:10.3481283Z  2025-03-14T06:31:10.3481690Z  2025-03-14T06:31:10.3482098Z  2025-03-14T06:31:10.3482752Z  2025-03-14T06:31:10.3483163Z  2025-03-14T06:31:10.3483537Z  2025-03-14T06:31:10.3483882Z  2025-03-14T06:31:10.3485010Z [16,373 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:10.3486082Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T06:31:10.3486947Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T06:31:10.3487701Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T06:31:10.3488598Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 11s local 2025-03-14T06:31:10.3489536Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 9s local 2025-03-14T06:31:10.3490387Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 9s local 2025-03-14T06:31:10.3491499Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2025-03-14T06:31:10.3492521Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 8s local ... 2025-03-14T06:31:10.5484209Z 2025-03-14T06:31:10.5485249Z  2025-03-14T06:31:10.5485741Z  2025-03-14T06:31:10.5486160Z  2025-03-14T06:31:10.5486564Z  2025-03-14T06:31:10.5487000Z  2025-03-14T06:31:10.5487419Z  2025-03-14T06:31:10.5487803Z  2025-03-14T06:31:10.5488182Z  2025-03-14T06:31:10.5489067Z [16,374 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:10.5490103Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T06:31:10.5491191Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 13s local 2025-03-14T06:31:10.5491940Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T06:31:10.5492786Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 11s local 2025-03-14T06:31:10.5493774Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 10s local 2025-03-14T06:31:10.5494611Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 9s local 2025-03-14T06:31:10.5495501Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2025-03-14T06:31:10.5496752Z Compiling mlir/lib/Dialect/MLProgram/IR/MLProgramOps.cpp; 9s local ... 2025-03-14T06:31:10.9317456Z 2025-03-14T06:31:10.9318366Z  2025-03-14T06:31:10.9318894Z  2025-03-14T06:31:10.9319336Z  2025-03-14T06:31:10.9319754Z  2025-03-14T06:31:10.9320172Z  2025-03-14T06:31:10.9320581Z  2025-03-14T06:31:10.9320994Z  2025-03-14T06:31:10.9321421Z  2025-03-14T06:31:10.9322368Z [16,375 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:10.9323454Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2025-03-14T06:31:10.9324394Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2025-03-14T06:31:10.9325436Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T06:31:10.9326353Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 11s local 2025-03-14T06:31:10.9327415Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 10s local 2025-03-14T06:31:10.9328339Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 10s local 2025-03-14T06:31:10.9329286Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 9s local 2025-03-14T06:31:10.9330353Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local ... 2025-03-14T06:31:11.1489912Z 2025-03-14T06:31:11.1490738Z  2025-03-14T06:31:11.1491225Z  2025-03-14T06:31:11.1491622Z  2025-03-14T06:31:11.1492017Z  2025-03-14T06:31:11.1492426Z  2025-03-14T06:31:11.1492822Z  2025-03-14T06:31:11.1493234Z  2025-03-14T06:31:11.1493635Z  2025-03-14T06:31:11.1494610Z [16,376 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:11.1495765Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2025-03-14T06:31:11.1496701Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2025-03-14T06:31:11.1497807Z Compiling llvm/lib/Object/ELF.cpp; 12s local 2025-03-14T06:31:11.1498760Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 11s local 2025-03-14T06:31:11.1499798Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 10s local 2025-03-14T06:31:11.1500745Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 10s local 2025-03-14T06:31:11.1501734Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2025-03-14T06:31:11.1502782Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local ... 2025-03-14T06:31:11.3493582Z 2025-03-14T06:31:11.3494476Z  2025-03-14T06:31:11.3494945Z  2025-03-14T06:31:11.3495355Z  2025-03-14T06:31:11.3495765Z  2025-03-14T06:31:11.3496169Z  2025-03-14T06:31:11.3496842Z  2025-03-14T06:31:11.3497232Z  2025-03-14T06:31:11.3497635Z  2025-03-14T06:31:11.3498566Z [16,377 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:11.3499665Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2025-03-14T06:31:11.3500584Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2025-03-14T06:31:11.3501364Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T06:31:11.3502250Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 12s local 2025-03-14T06:31:11.3503221Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 10s local 2025-03-14T06:31:11.3504104Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 10s local 2025-03-14T06:31:11.3505241Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2025-03-14T06:31:11.3506285Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 9s local ... 2025-03-14T06:31:11.6361737Z 2025-03-14T06:31:11.6362570Z  2025-03-14T06:31:11.6363049Z  2025-03-14T06:31:11.6365180Z  2025-03-14T06:31:11.6365795Z  2025-03-14T06:31:11.6366191Z  2025-03-14T06:31:11.6366588Z  2025-03-14T06:31:11.6366984Z  2025-03-14T06:31:11.6367365Z  2025-03-14T06:31:11.6368285Z [16,378 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:11.6369548Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T06:31:11.6371138Z Compiling llvm/lib/ObjectYAML/ELFEmitter.cpp; 14s local 2025-03-14T06:31:11.6371921Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T06:31:11.6372874Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 12s local 2025-03-14T06:31:11.6373883Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 11s local 2025-03-14T06:31:11.6374741Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 10s local 2025-03-14T06:31:11.6376537Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2025-03-14T06:31:11.6377503Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local ... 2025-03-14T06:31:11.9499798Z 2025-03-14T06:31:11.9500600Z  2025-03-14T06:31:11.9501072Z  2025-03-14T06:31:11.9501491Z  2025-03-14T06:31:11.9501869Z  2025-03-14T06:31:11.9502244Z  2025-03-14T06:31:11.9502631Z  2025-03-14T06:31:11.9503021Z  2025-03-14T06:31:11.9503378Z  2025-03-14T06:31:11.9504314Z [16,379 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:11.9505459Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T06:31:11.9506299Z Compiling llvm/lib/Object/ELF.cpp; 13s local 2025-03-14T06:31:11.9507238Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 12s local 2025-03-14T06:31:11.9508248Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 11s local 2025-03-14T06:31:11.9509161Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 11s local 2025-03-14T06:31:11.9510108Z Compiling .../mhlo_to_hlo/module_attributes_exporter.cc; 10s local 2025-03-14T06:31:11.9511012Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2025-03-14T06:31:11.9512140Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local ... 2025-03-14T06:31:12.2039442Z 2025-03-14T06:31:12.2040309Z  2025-03-14T06:31:12.2040710Z  2025-03-14T06:31:12.2041076Z  2025-03-14T06:31:12.2041414Z  2025-03-14T06:31:12.2041754Z  2025-03-14T06:31:12.2042087Z  2025-03-14T06:31:12.2042445Z  2025-03-14T06:31:12.2042773Z  2025-03-14T06:31:12.2043654Z [16,381 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:12.2044865Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T06:31:12.2045503Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:31:12.2046270Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 12s local 2025-03-14T06:31:12.2047399Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 11s local 2025-03-14T06:31:12.2048131Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 11s local 2025-03-14T06:31:12.2049194Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2025-03-14T06:31:12.2050215Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2025-03-14T06:31:12.2051204Z Compiling xla/service/gpu/cublas_cudnn.cc; 10s local ... 2025-03-14T06:31:12.4101706Z 2025-03-14T06:31:12.4102567Z  2025-03-14T06:31:12.4103090Z  2025-03-14T06:31:12.4103531Z  2025-03-14T06:31:12.4103973Z  2025-03-14T06:31:12.4104410Z  2025-03-14T06:31:12.4104839Z  2025-03-14T06:31:12.4105231Z  2025-03-14T06:31:12.4105941Z  2025-03-14T06:31:12.4106917Z [16,382 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:12.4108039Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T06:31:12.4109065Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:31:12.4110004Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 13s local 2025-03-14T06:31:12.4111066Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 11s local 2025-03-14T06:31:12.4111981Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 11s local 2025-03-14T06:31:12.4113129Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2025-03-14T06:31:12.4113989Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2025-03-14T06:31:12.4114821Z Compiling xla/service/gpu/cublas_cudnn.cc; 10s local ... 2025-03-14T06:31:12.6496019Z 2025-03-14T06:31:12.6496861Z  2025-03-14T06:31:12.6497333Z  2025-03-14T06:31:12.6497740Z  2025-03-14T06:31:12.6498167Z  2025-03-14T06:31:12.6498559Z  2025-03-14T06:31:12.6498939Z  2025-03-14T06:31:12.6499336Z  2025-03-14T06:31:12.6499722Z  2025-03-14T06:31:12.6500621Z [16,384 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:12.6501691Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T06:31:12.6502464Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:31:12.6503349Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 13s local 2025-03-14T06:31:12.6504339Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 12s local 2025-03-14T06:31:12.6505256Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 11s local 2025-03-14T06:31:12.6506182Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T06:31:12.6507051Z Compiling xla/hlo/ir/hlo_module_group.cc; 10s local 2025-03-14T06:31:12.6507878Z Compiling xla/service/gpu/cublas_cudnn.cc; 10s local ... 2025-03-14T06:31:12.9097944Z 2025-03-14T06:31:12.9098800Z  2025-03-14T06:31:12.9109909Z  2025-03-14T06:31:12.9110686Z  2025-03-14T06:31:12.9111119Z  2025-03-14T06:31:12.9111575Z  2025-03-14T06:31:12.9111973Z  2025-03-14T06:31:12.9112394Z  2025-03-14T06:31:12.9112811Z  2025-03-14T06:31:12.9113729Z [16,387 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:12.9115060Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T06:31:12.9115936Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:31:12.9116855Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 13s local 2025-03-14T06:31:12.9117856Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 12s local 2025-03-14T06:31:12.9118785Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T06:31:12.9119753Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T06:31:12.9120654Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2025-03-14T06:31:12.9121471Z Compiling xla/service/gpu/cublas_cudnn.cc; 10s local ... 2025-03-14T06:31:13.1369378Z 2025-03-14T06:31:13.1370448Z  2025-03-14T06:31:13.1370926Z  2025-03-14T06:31:13.1371317Z  2025-03-14T06:31:13.1371667Z  2025-03-14T06:31:13.1372082Z  2025-03-14T06:31:13.1372475Z  2025-03-14T06:31:13.1372890Z  2025-03-14T06:31:13.1373302Z  2025-03-14T06:31:13.1374221Z [16,389 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:13.1375352Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T06:31:13.1376182Z Compiling llvm/lib/Object/ELF.cpp; 14s local 2025-03-14T06:31:13.1377083Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 13s local 2025-03-14T06:31:13.1378129Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 12s local 2025-03-14T06:31:13.1379251Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T06:31:13.1380175Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T06:31:13.1381057Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2025-03-14T06:31:13.1381892Z Compiling xla/service/gpu/cublas_cudnn.cc; 11s local ... 2025-03-14T06:31:13.3509083Z 2025-03-14T06:31:13.3509998Z  2025-03-14T06:31:13.3510518Z  2025-03-14T06:31:13.3510899Z  2025-03-14T06:31:13.3511344Z  2025-03-14T06:31:13.3511754Z  2025-03-14T06:31:13.3512177Z  2025-03-14T06:31:13.3512604Z  2025-03-14T06:31:13.3513283Z  2025-03-14T06:31:13.3514266Z [16,392 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:13.3515385Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T06:31:13.3516215Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T06:31:13.3517144Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 14s local 2025-03-14T06:31:13.3518207Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 12s local 2025-03-14T06:31:13.3519113Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T06:31:13.3520002Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T06:31:13.3520895Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2025-03-14T06:31:13.3521839Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 11s local ... 2025-03-14T06:31:13.7513909Z 2025-03-14T06:31:13.7514723Z  2025-03-14T06:31:13.7515187Z  2025-03-14T06:31:13.7515617Z  2025-03-14T06:31:13.7516014Z  2025-03-14T06:31:13.7516393Z  2025-03-14T06:31:13.7516785Z  2025-03-14T06:31:13.7517151Z  2025-03-14T06:31:13.7517544Z  2025-03-14T06:31:13.7518489Z [16,393 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:13.7519596Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T06:31:13.7520456Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T06:31:13.7521402Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 14s local 2025-03-14T06:31:13.7522404Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 13s local 2025-03-14T06:31:13.7523329Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T06:31:13.7524680Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2025-03-14T06:31:13.7525641Z Compiling xla/hlo/ir/hlo_module_group.cc; 11s local 2025-03-14T06:31:13.7526587Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 11s local ... 2025-03-14T06:31:14.0684625Z 2025-03-14T06:31:14.0685512Z  2025-03-14T06:31:14.0686089Z  2025-03-14T06:31:14.0686490Z  2025-03-14T06:31:14.0686893Z  2025-03-14T06:31:14.0687292Z  2025-03-14T06:31:14.0687697Z  2025-03-14T06:31:14.0688116Z  2025-03-14T06:31:14.0688518Z  2025-03-14T06:31:14.0689537Z [16,396 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:14.0690677Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T06:31:14.0691821Z Compiling llvm/lib/Object/ELF.cpp; 15s local 2025-03-14T06:31:14.0692743Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 14s local 2025-03-14T06:31:14.0693798Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 13s local 2025-03-14T06:31:14.0694720Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T06:31:14.0695601Z Compiling xla/hlo/ir/hlo_module_group.cc; 12s local 2025-03-14T06:31:14.0696521Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 11s local 2025-03-14T06:31:14.0697437Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 11s local ... 2025-03-14T06:31:14.3165223Z 2025-03-14T06:31:14.3166233Z  2025-03-14T06:31:14.3166773Z  2025-03-14T06:31:14.3167113Z  2025-03-14T06:31:14.3167662Z  2025-03-14T06:31:14.3167997Z  2025-03-14T06:31:14.3168365Z  2025-03-14T06:31:14.3168685Z  2025-03-14T06:31:14.3169028Z  2025-03-14T06:31:14.3169824Z [16,400 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:14.3170814Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T06:31:14.3171507Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T06:31:14.3172431Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T06:31:14.3173647Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 13s local 2025-03-14T06:31:14.3174614Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T06:31:14.3175510Z Compiling xla/hlo/ir/hlo_module_group.cc; 12s local 2025-03-14T06:31:14.3176343Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 12s local 2025-03-14T06:31:14.3177095Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 11s local ... 2025-03-14T06:31:14.5521015Z 2025-03-14T06:31:14.5521841Z  2025-03-14T06:31:14.5522344Z  2025-03-14T06:31:14.5522767Z  2025-03-14T06:31:14.5523179Z  2025-03-14T06:31:14.5523626Z  2025-03-14T06:31:14.5524042Z  2025-03-14T06:31:14.5524610Z  2025-03-14T06:31:14.5525049Z  2025-03-14T06:31:14.5526028Z [16,401 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:14.5527191Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T06:31:14.5528079Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T06:31:14.5529042Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T06:31:14.5530101Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local 2025-03-14T06:31:14.5531017Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T06:31:14.5531983Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 12s local 2025-03-14T06:31:14.5532989Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T06:31:14.5534041Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 12s local ... 2025-03-14T06:31:14.7525895Z 2025-03-14T06:31:14.7526794Z  2025-03-14T06:31:14.7527285Z  2025-03-14T06:31:14.7527711Z  2025-03-14T06:31:14.7528129Z  2025-03-14T06:31:14.7528559Z  2025-03-14T06:31:14.7528961Z  2025-03-14T06:31:14.7529344Z  2025-03-14T06:31:14.7530004Z  2025-03-14T06:31:14.7531046Z [16,403 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:14.7532218Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T06:31:14.7533055Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T06:31:14.7534017Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T06:31:14.7535088Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local 2025-03-14T06:31:14.7536040Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T06:31:14.7537139Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 12s local 2025-03-14T06:31:14.7538257Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T06:31:14.7539287Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 12s local ... 2025-03-14T06:31:15.1531097Z 2025-03-14T06:31:15.1531971Z  2025-03-14T06:31:15.1532467Z  2025-03-14T06:31:15.1532857Z  2025-03-14T06:31:15.1533224Z  2025-03-14T06:31:15.1533611Z  2025-03-14T06:31:15.1534004Z  2025-03-14T06:31:15.1534433Z  2025-03-14T06:31:15.1534839Z  2025-03-14T06:31:15.1535847Z [16,404 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:15.1537046Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T06:31:15.1537974Z Compiling llvm/lib/Object/ELF.cpp; 16s local 2025-03-14T06:31:15.1539226Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T06:31:15.1540316Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local 2025-03-14T06:31:15.1541333Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T06:31:15.1542306Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 13s local 2025-03-14T06:31:15.1543274Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T06:31:15.1544267Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 12s local ... 2025-03-14T06:31:15.3534961Z 2025-03-14T06:31:15.3535834Z  2025-03-14T06:31:15.3536539Z  2025-03-14T06:31:15.3536983Z  2025-03-14T06:31:15.3537394Z  2025-03-14T06:31:15.3537784Z  2025-03-14T06:31:15.3538183Z  2025-03-14T06:31:15.3538578Z  2025-03-14T06:31:15.3538973Z  2025-03-14T06:31:15.3539911Z [16,405 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:15.3541032Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T06:31:15.3541863Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T06:31:15.3542787Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 16s local 2025-03-14T06:31:15.3543816Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local 2025-03-14T06:31:15.3544691Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T06:31:15.3545599Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 13s local 2025-03-14T06:31:15.3546495Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 12s local 2025-03-14T06:31:15.3547484Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 12s local ... 2025-03-14T06:31:15.7055066Z 2025-03-14T06:31:15.7055886Z  2025-03-14T06:31:15.7056393Z  2025-03-14T06:31:15.7056814Z  2025-03-14T06:31:15.7057230Z  2025-03-14T06:31:15.7057628Z  2025-03-14T06:31:15.7058048Z  2025-03-14T06:31:15.7058509Z  2025-03-14T06:31:15.7058932Z  2025-03-14T06:31:15.7059918Z [16,408 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:15.7061058Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T06:31:15.7061921Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T06:31:15.7062758Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T06:31:15.7063948Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T06:31:15.7064926Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 13s local 2025-03-14T06:31:15.7066118Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T06:31:15.7067115Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 13s local 2025-03-14T06:31:15.7068281Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 13s local ... 2025-03-14T06:31:15.9402006Z 2025-03-14T06:31:15.9402857Z  2025-03-14T06:31:15.9403385Z  2025-03-14T06:31:15.9403800Z  2025-03-14T06:31:15.9404202Z  2025-03-14T06:31:15.9404720Z  2025-03-14T06:31:15.9405126Z  2025-03-14T06:31:15.9405532Z  2025-03-14T06:31:15.9406210Z  2025-03-14T06:31:15.9407141Z [16,409 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:15.9408206Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T06:31:15.9409056Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T06:31:15.9409836Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T06:31:15.9410740Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T06:31:15.9411648Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 13s local 2025-03-14T06:31:15.9412613Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T06:31:15.9413474Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 13s local 2025-03-14T06:31:15.9414863Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 13s local ... 2025-03-14T06:31:16.1541327Z 2025-03-14T06:31:16.1542182Z  2025-03-14T06:31:16.1542701Z  2025-03-14T06:31:16.1543149Z  2025-03-14T06:31:16.1543568Z  2025-03-14T06:31:16.1543979Z  2025-03-14T06:31:16.1544378Z  2025-03-14T06:31:16.1544770Z  2025-03-14T06:31:16.1545181Z  2025-03-14T06:31:16.1546156Z [16,409 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:16.1547518Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T06:31:16.1548351Z Compiling llvm/lib/Object/ELF.cpp; 17s local 2025-03-14T06:31:16.1549163Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T06:31:16.1550036Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T06:31:16.1550965Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2025-03-14T06:31:16.1551904Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T06:31:16.1552866Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 13s local 2025-03-14T06:31:16.1553903Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 13s local ... 2025-03-14T06:31:16.3545363Z 2025-03-14T06:31:16.3546355Z  2025-03-14T06:31:16.3546852Z  2025-03-14T06:31:16.3547271Z  2025-03-14T06:31:16.3547678Z  2025-03-14T06:31:16.3548098Z  2025-03-14T06:31:16.3548531Z  2025-03-14T06:31:16.3548871Z  2025-03-14T06:31:16.3549239Z  2025-03-14T06:31:16.3550160Z [16,410 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:16.3551254Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T06:31:16.3552077Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T06:31:16.3552866Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T06:31:16.3553758Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T06:31:16.3554679Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2025-03-14T06:31:16.3555603Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 13s local 2025-03-14T06:31:16.3556661Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 13s local 2025-03-14T06:31:16.3557808Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 13s local ... 2025-03-14T06:31:16.7435058Z 2025-03-14T06:31:16.7436188Z  2025-03-14T06:31:16.7436691Z  2025-03-14T06:31:16.7437102Z  2025-03-14T06:31:16.7437487Z  2025-03-14T06:31:16.7437895Z  2025-03-14T06:31:16.7438275Z  2025-03-14T06:31:16.7438667Z  2025-03-14T06:31:16.7439044Z  2025-03-14T06:31:16.7439917Z [16,413 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:16.7440991Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T06:31:16.7441801Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T06:31:16.7442586Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local 2025-03-14T06:31:16.7443466Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T06:31:16.7444782Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2025-03-14T06:31:16.7445817Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T06:31:16.7446828Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local 2025-03-14T06:31:16.7447975Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 14s local ... 2025-03-14T06:31:16.9550909Z 2025-03-14T06:31:16.9551762Z  2025-03-14T06:31:16.9552281Z  2025-03-14T06:31:16.9552707Z  2025-03-14T06:31:16.9553103Z  2025-03-14T06:31:16.9553511Z  2025-03-14T06:31:16.9553917Z  2025-03-14T06:31:16.9554321Z  2025-03-14T06:31:16.9554753Z  2025-03-14T06:31:16.9555723Z [16,416 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:16.9557163Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T06:31:16.9558025Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T06:31:16.9558876Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local 2025-03-14T06:31:16.9559821Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T06:31:16.9560773Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2025-03-14T06:31:16.9561775Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T06:31:16.9562931Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local 2025-03-14T06:31:16.9564072Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 14s local ... 2025-03-14T06:31:17.1555500Z 2025-03-14T06:31:17.1556370Z  2025-03-14T06:31:17.1556874Z  2025-03-14T06:31:17.1557289Z  2025-03-14T06:31:17.1557682Z  2025-03-14T06:31:17.1558123Z  2025-03-14T06:31:17.1558508Z  2025-03-14T06:31:17.1558898Z  2025-03-14T06:31:17.1559308Z  2025-03-14T06:31:17.1560341Z [16,417 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:17.1561456Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T06:31:17.1562241Z Compiling llvm/lib/Object/ELF.cpp; 18s local 2025-03-14T06:31:17.1563073Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local 2025-03-14T06:31:17.1563937Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T06:31:17.1565018Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2025-03-14T06:31:17.1566133Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 14s local 2025-03-14T06:31:17.1567050Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local 2025-03-14T06:31:17.1568138Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 14s local ... 2025-03-14T06:31:17.4293911Z 2025-03-14T06:31:17.4294776Z  2025-03-14T06:31:17.4295247Z  2025-03-14T06:31:17.4295636Z  2025-03-14T06:31:17.4296020Z  2025-03-14T06:31:17.4296371Z  2025-03-14T06:31:17.4296773Z  2025-03-14T06:31:17.4297158Z  2025-03-14T06:31:17.4297551Z  2025-03-14T06:31:17.4298443Z [16,421 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:17.4299806Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T06:31:17.4300692Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local 2025-03-14T06:31:17.4301542Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T06:31:17.4302433Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2025-03-14T06:31:17.4303329Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T06:31:17.4304442Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2025-03-14T06:31:17.4305499Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 14s local 2025-03-14T06:31:17.4306608Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 14s local ... 2025-03-14T06:31:17.7560377Z 2025-03-14T06:31:17.7561201Z  2025-03-14T06:31:17.7561670Z  2025-03-14T06:31:17.7562097Z  2025-03-14T06:31:17.7562509Z  2025-03-14T06:31:17.7562924Z  2025-03-14T06:31:17.7563332Z  2025-03-14T06:31:17.7563722Z  2025-03-14T06:31:17.7564154Z  2025-03-14T06:31:17.7565258Z [16,423 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:17.7566567Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T06:31:17.7567436Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T06:31:17.7568271Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T06:31:17.7569124Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2025-03-14T06:31:17.7570237Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T06:31:17.7571111Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2025-03-14T06:31:17.7572116Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T06:31:17.7573140Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local ... 2025-03-14T06:31:17.9565989Z 2025-03-14T06:31:17.9566884Z  2025-03-14T06:31:17.9567433Z  2025-03-14T06:31:17.9567860Z  2025-03-14T06:31:17.9568276Z  2025-03-14T06:31:17.9568693Z  2025-03-14T06:31:17.9569093Z  2025-03-14T06:31:17.9569753Z  2025-03-14T06:31:17.9570203Z  2025-03-14T06:31:17.9571213Z [16,424 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:17.9572355Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T06:31:17.9573298Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T06:31:17.9574077Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T06:31:17.9574902Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2025-03-14T06:31:17.9575805Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T06:31:17.9576776Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2025-03-14T06:31:17.9577818Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T06:31:17.9578929Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local ... 2025-03-14T06:31:18.1688115Z 2025-03-14T06:31:18.1689027Z  2025-03-14T06:31:18.1689552Z  2025-03-14T06:31:18.1689980Z  2025-03-14T06:31:18.1690386Z  2025-03-14T06:31:18.1690811Z  2025-03-14T06:31:18.1691241Z  2025-03-14T06:31:18.1691676Z  2025-03-14T06:31:18.1692092Z  2025-03-14T06:31:18.1693072Z [16,426 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:18.1694220Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T06:31:18.1695174Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T06:31:18.1696091Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T06:31:18.1697046Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2025-03-14T06:31:18.1698260Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 15s local 2025-03-14T06:31:18.1699284Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2025-03-14T06:31:18.1700410Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T06:31:18.1701563Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local ... 2025-03-14T06:31:18.5572890Z 2025-03-14T06:31:18.5573712Z  2025-03-14T06:31:18.5574129Z  2025-03-14T06:31:18.5574483Z  2025-03-14T06:31:18.5574853Z  2025-03-14T06:31:18.5575233Z  2025-03-14T06:31:18.5575657Z  2025-03-14T06:31:18.5576160Z  2025-03-14T06:31:18.5576530Z  2025-03-14T06:31:18.5577446Z [16,426 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:18.5578817Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T06:31:18.5579729Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T06:31:18.5580574Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T06:31:18.5581510Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2025-03-14T06:31:18.5582433Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T06:31:18.5583382Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2025-03-14T06:31:18.5584426Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 15s local 2025-03-14T06:31:18.5585485Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 15s local ... 2025-03-14T06:31:18.7574682Z 2025-03-14T06:31:18.7575517Z  2025-03-14T06:31:18.7575945Z  2025-03-14T06:31:18.7576296Z  2025-03-14T06:31:18.7576643Z  2025-03-14T06:31:18.7577008Z  2025-03-14T06:31:18.7577393Z  2025-03-14T06:31:18.7577753Z  2025-03-14T06:31:18.7578085Z  2025-03-14T06:31:18.7578919Z [16,427 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:18.7579933Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T06:31:18.7580746Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T06:31:18.7581775Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T06:31:18.7582641Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2025-03-14T06:31:18.7583516Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T06:31:18.7584402Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2025-03-14T06:31:18.7585438Z Compiling mlir/lib/Dialect/Complex/IR/ComplexDialect.cpp; 16s local 2025-03-14T06:31:18.7586536Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local ... 2025-03-14T06:31:19.1528720Z 2025-03-14T06:31:19.1529885Z  2025-03-14T06:31:19.1530382Z  2025-03-14T06:31:19.1530949Z  2025-03-14T06:31:19.1531528Z  2025-03-14T06:31:19.1531937Z  2025-03-14T06:31:19.1532520Z  2025-03-14T06:31:19.1533105Z  2025-03-14T06:31:19.1533656Z  2025-03-14T06:31:19.1534811Z [16,434 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:19.1536262Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T06:31:19.1537337Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T06:31:19.1538538Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T06:31:19.1539585Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2025-03-14T06:31:19.1540580Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T06:31:19.1541588Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2025-03-14T06:31:19.1542618Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T06:31:19.1543575Z Compiling xla/service/shape_inference.cc; 16s local ... 2025-03-14T06:31:19.3580719Z 2025-03-14T06:31:19.3581602Z  2025-03-14T06:31:19.3582066Z  2025-03-14T06:31:19.3582757Z  2025-03-14T06:31:19.3583179Z  2025-03-14T06:31:19.3583566Z  2025-03-14T06:31:19.3583968Z  2025-03-14T06:31:19.3584388Z  2025-03-14T06:31:19.3584780Z  2025-03-14T06:31:19.3585750Z [16,434 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:19.3586820Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T06:31:19.3587764Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T06:31:19.3588693Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T06:31:19.3589665Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2025-03-14T06:31:19.3590571Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 16s local 2025-03-14T06:31:19.3591726Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2025-03-14T06:31:19.3592761Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T06:31:19.3593721Z Compiling xla/service/shape_inference.cc; 16s local ... 2025-03-14T06:31:19.5584073Z 2025-03-14T06:31:19.5584927Z  2025-03-14T06:31:19.5585433Z  2025-03-14T06:31:19.5585842Z  2025-03-14T06:31:19.5586232Z  2025-03-14T06:31:19.5586627Z  2025-03-14T06:31:19.5587020Z  2025-03-14T06:31:19.5587544Z  2025-03-14T06:31:19.5587955Z  2025-03-14T06:31:19.5588933Z [16,436 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:31:19.5590315Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T06:31:19.5591080Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T06:31:19.5591823Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T06:31:19.5592718Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2025-03-14T06:31:19.5593508Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T06:31:19.5594501Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T06:31:19.5595585Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 16s local 2025-03-14T06:31:19.5596421Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local ... 2025-03-14T06:31:19.8573066Z 2025-03-14T06:31:19.8573915Z  2025-03-14T06:31:19.8574332Z  2025-03-14T06:31:19.8574717Z  2025-03-14T06:31:19.8575167Z  2025-03-14T06:31:19.8575608Z  2025-03-14T06:31:19.8575995Z  2025-03-14T06:31:19.8576407Z  2025-03-14T06:31:19.8576804Z  2025-03-14T06:31:19.8577723Z [16,438 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:19.8578817Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T06:31:19.8579820Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T06:31:19.8580753Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T06:31:19.8581717Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2025-03-14T06:31:19.8582718Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T06:31:19.8583756Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T06:31:19.8584853Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T06:31:19.8585824Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local ... 2025-03-14T06:31:20.1560423Z 2025-03-14T06:31:20.1561288Z  2025-03-14T06:31:20.1561760Z  2025-03-14T06:31:20.1562112Z  2025-03-14T06:31:20.1562490Z  2025-03-14T06:31:20.1562843Z  2025-03-14T06:31:20.1563219Z  2025-03-14T06:31:20.1563577Z  2025-03-14T06:31:20.1563969Z  2025-03-14T06:31:20.1564980Z [16,440 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:20.1566238Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T06:31:20.1567341Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T06:31:20.1568186Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T06:31:20.1569040Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2025-03-14T06:31:20.1569903Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T06:31:20.1570775Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T06:31:20.1571698Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T06:31:20.1572563Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local ... 2025-03-14T06:31:20.3591299Z 2025-03-14T06:31:20.3592117Z  2025-03-14T06:31:20.3592568Z  2025-03-14T06:31:20.3593218Z  2025-03-14T06:31:20.3593595Z  2025-03-14T06:31:20.3593986Z  2025-03-14T06:31:20.3594349Z  2025-03-14T06:31:20.3594721Z  2025-03-14T06:31:20.3595082Z  2025-03-14T06:31:20.3595977Z [16,440 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:20.3597015Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T06:31:20.3597873Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T06:31:20.3598695Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T06:31:20.3599551Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2025-03-14T06:31:20.3600414Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 17s local 2025-03-14T06:31:20.3603372Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T06:31:20.3604560Z Compiling mlir/lib/Dialect/Complex/IR/ComplexOps.cpp; 17s local 2025-03-14T06:31:20.3605390Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local ... 2025-03-14T06:31:20.8022209Z 2025-03-14T06:31:20.8023097Z  2025-03-14T06:31:20.8023682Z  2025-03-14T06:31:20.8024112Z  2025-03-14T06:31:20.8024571Z  2025-03-14T06:31:20.8025025Z  2025-03-14T06:31:20.8025629Z  2025-03-14T06:31:20.8026018Z  2025-03-14T06:31:20.8026382Z  2025-03-14T06:31:20.8027522Z [16,441 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:20.8028572Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T06:31:20.8029456Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T06:31:20.8030303Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T06:31:20.8031212Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2025-03-14T06:31:20.8032113Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T06:31:20.8033041Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T06:31:20.8033941Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T06:31:20.8034785Z Compiling xla/hlo/builder/xla_builder.cc; 17s local ... 2025-03-14T06:31:21.1598787Z 2025-03-14T06:31:21.1599718Z  2025-03-14T06:31:21.1600241Z  2025-03-14T06:31:21.1600645Z  2025-03-14T06:31:21.1601054Z  2025-03-14T06:31:21.1601478Z  2025-03-14T06:31:21.1601846Z  2025-03-14T06:31:21.1602221Z  2025-03-14T06:31:21.1602602Z  2025-03-14T06:31:21.1603574Z [16,443 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:21.1604840Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T06:31:21.1605820Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T06:31:21.1606760Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T06:31:21.1607737Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2025-03-14T06:31:21.1608670Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 18s local 2025-03-14T06:31:21.1609601Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T06:31:21.1610763Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T06:31:21.1611556Z Compiling xla/hlo/builder/xla_builder.cc; 17s local ... 2025-03-14T06:31:21.3862258Z 2025-03-14T06:31:21.3863133Z  2025-03-14T06:31:21.3863635Z  2025-03-14T06:31:21.3864052Z  2025-03-14T06:31:21.3864475Z  2025-03-14T06:31:21.3864879Z  2025-03-14T06:31:21.3865457Z  2025-03-14T06:31:21.3865882Z  2025-03-14T06:31:21.3866299Z  2025-03-14T06:31:21.3867273Z [16,445 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:21.3868412Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T06:31:21.3869354Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T06:31:21.3870468Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T06:31:21.3871397Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2025-03-14T06:31:21.3872361Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T06:31:21.3873342Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:21.3874239Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T06:31:21.3874899Z Compiling xla/hlo/builder/xla_builder.cc; 18s local ... 2025-03-14T06:31:21.7126568Z 2025-03-14T06:31:21.7127484Z  2025-03-14T06:31:21.7127974Z  2025-03-14T06:31:21.7128411Z  2025-03-14T06:31:21.7128832Z  2025-03-14T06:31:21.7129259Z  2025-03-14T06:31:21.7129973Z  2025-03-14T06:31:21.7130394Z  2025-03-14T06:31:21.7130820Z  2025-03-14T06:31:21.7131778Z [16,446 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:21.7132883Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:21.7133804Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T06:31:21.7134694Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T06:31:21.7135608Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2025-03-14T06:31:21.7136731Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T06:31:21.7137671Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:21.7138599Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T06:31:21.7139331Z Compiling xla/hlo/builder/xla_builder.cc; 18s local ... 2025-03-14T06:31:21.9470392Z 2025-03-14T06:31:21.9471284Z  2025-03-14T06:31:21.9471785Z  2025-03-14T06:31:21.9472204Z  2025-03-14T06:31:21.9472600Z  2025-03-14T06:31:21.9473005Z  2025-03-14T06:31:21.9473401Z  2025-03-14T06:31:21.9473808Z  2025-03-14T06:31:21.9474201Z  2025-03-14T06:31:21.9474990Z [16,448 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:21.9476059Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:21.9476938Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T06:31:21.9477837Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T06:31:21.9478931Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2025-03-14T06:31:21.9479885Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T06:31:21.9480893Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:21.9481839Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T06:31:21.9482694Z Compiling xla/hlo/builder/xla_builder.cc; 18s local ... 2025-03-14T06:31:22.1478245Z 2025-03-14T06:31:22.1479092Z  2025-03-14T06:31:22.1479600Z  2025-03-14T06:31:22.1480046Z  2025-03-14T06:31:22.1480457Z  2025-03-14T06:31:22.1480865Z  2025-03-14T06:31:22.1481283Z  2025-03-14T06:31:22.1481698Z  2025-03-14T06:31:22.1482112Z  2025-03-14T06:31:22.1483290Z [16,449 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:22.1484552Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:22.1485496Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T06:31:22.1486412Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T06:31:22.1487320Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 20s local 2025-03-14T06:31:22.1488154Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T06:31:22.1489106Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:22.1490182Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T06:31:22.1491347Z Compiling xla/hlo/builder/xla_builder.cc; 18s local ... 2025-03-14T06:31:22.3607835Z 2025-03-14T06:31:22.3608709Z  2025-03-14T06:31:22.3609195Z  2025-03-14T06:31:22.3609604Z  2025-03-14T06:31:22.3610001Z  2025-03-14T06:31:22.3610445Z  2025-03-14T06:31:22.3610857Z  2025-03-14T06:31:22.3611265Z  2025-03-14T06:31:22.3611683Z  2025-03-14T06:31:22.3612671Z [16,449 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:22.3613824Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:22.3614723Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T06:31:22.3615577Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T06:31:22.3616798Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 20s local 2025-03-14T06:31:22.3617743Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 19s local 2025-03-14T06:31:22.3618720Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:22.3619708Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T06:31:22.3620471Z Compiling xla/hlo/builder/xla_builder.cc; 19s local ... 2025-03-14T06:31:22.5814487Z 2025-03-14T06:31:22.5815362Z  2025-03-14T06:31:22.5815873Z  2025-03-14T06:31:22.5816302Z  2025-03-14T06:31:22.5816724Z  2025-03-14T06:31:22.5817367Z  2025-03-14T06:31:22.5817796Z  2025-03-14T06:31:22.5818207Z  2025-03-14T06:31:22.5818625Z  2025-03-14T06:31:22.5819614Z [16,452 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:22.5820712Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:22.5821779Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T06:31:22.5822661Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T06:31:22.5823554Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T06:31:22.5824520Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T06:31:22.5825411Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T06:31:22.5826193Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T06:31:22.5827002Z @llvm-project//mlir:SparseTensorDialect; 18s local ... 2025-03-14T06:31:22.9614635Z 2025-03-14T06:31:22.9615480Z  2025-03-14T06:31:22.9615973Z  2025-03-14T06:31:22.9616384Z  2025-03-14T06:31:22.9616771Z  2025-03-14T06:31:22.9617170Z  2025-03-14T06:31:22.9617564Z  2025-03-14T06:31:22.9617959Z  2025-03-14T06:31:22.9618326Z  2025-03-14T06:31:22.9619384Z [16,455 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:22.9620506Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T06:31:22.9621417Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T06:31:22.9622309Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T06:31:22.9623196Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T06:31:22.9624413Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T06:31:22.9625328Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T06:31:22.9626128Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T06:31:22.9626921Z @llvm-project//mlir:SparseTensorDialect; 18s local ... 2025-03-14T06:31:23.1617752Z 2025-03-14T06:31:23.1618600Z  2025-03-14T06:31:23.1619100Z  2025-03-14T06:31:23.1619516Z  2025-03-14T06:31:23.1619926Z  2025-03-14T06:31:23.1620333Z  2025-03-14T06:31:23.1620770Z  2025-03-14T06:31:23.1621176Z  2025-03-14T06:31:23.1621566Z  2025-03-14T06:31:23.1622508Z [16,457 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:23.1623839Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T06:31:23.1624685Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T06:31:23.1625534Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T06:31:23.1626400Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 20s local 2025-03-14T06:31:23.1627351Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T06:31:23.1628237Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T06:31:23.1628996Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T06:31:23.1629791Z @llvm-project//mlir:SparseTensorDialect; 18s local ... 2025-03-14T06:31:23.5063890Z 2025-03-14T06:31:23.5064711Z  2025-03-14T06:31:23.5065682Z  2025-03-14T06:31:23.5066070Z  2025-03-14T06:31:23.5066450Z  2025-03-14T06:31:23.5066844Z  2025-03-14T06:31:23.5067258Z  2025-03-14T06:31:23.5067642Z  2025-03-14T06:31:23.5068058Z  2025-03-14T06:31:23.5068972Z [16,459 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:23.5069998Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T06:31:23.5070880Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T06:31:23.5071836Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T06:31:23.5072649Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T06:31:23.5073559Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T06:31:23.5074436Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T06:31:23.5075036Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T06:31:23.5075798Z @llvm-project//mlir:SparseTensorDialect; 19s local ... 2025-03-14T06:31:23.7623632Z 2025-03-14T06:31:23.7624502Z  2025-03-14T06:31:23.7625019Z  2025-03-14T06:31:23.7625447Z  2025-03-14T06:31:23.7625862Z  2025-03-14T06:31:23.7626250Z  2025-03-14T06:31:23.7626656Z  2025-03-14T06:31:23.7627058Z  2025-03-14T06:31:23.7627454Z  2025-03-14T06:31:23.7628436Z [16,461 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:23.7629550Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T06:31:23.7630478Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T06:31:23.7631351Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T06:31:23.7632230Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T06:31:23.7633171Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T06:31:23.7634059Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T06:31:23.7634828Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T06:31:23.7635622Z @llvm-project//mlir:SparseTensorDialect; 19s local ... 2025-03-14T06:31:24.1155159Z 2025-03-14T06:31:24.1155971Z  2025-03-14T06:31:24.1156457Z  2025-03-14T06:31:24.1156891Z  2025-03-14T06:31:24.1157303Z  2025-03-14T06:31:24.1157721Z  2025-03-14T06:31:24.1158396Z  2025-03-14T06:31:24.1158850Z  2025-03-14T06:31:24.1159252Z  2025-03-14T06:31:24.1160240Z [16,462 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:24.1161317Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T06:31:24.1162240Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T06:31:24.1163122Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T06:31:24.1163901Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T06:31:24.1164826Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T06:31:24.1165800Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T06:31:24.1166756Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T06:31:24.1167544Z @llvm-project//mlir:SparseTensorDialect; 19s local ... 2025-03-14T06:31:24.3629500Z 2025-03-14T06:31:24.3630404Z  2025-03-14T06:31:24.3630928Z  2025-03-14T06:31:24.3631341Z  2025-03-14T06:31:24.3631809Z  2025-03-14T06:31:24.3632199Z  2025-03-14T06:31:24.3632636Z  2025-03-14T06:31:24.3633036Z  2025-03-14T06:31:24.3633475Z  2025-03-14T06:31:24.3634436Z [16,463 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:24.3635568Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T06:31:24.3636438Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T06:31:24.3637626Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 21s local 2025-03-14T06:31:24.3638624Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T06:31:24.3639568Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T06:31:24.3640300Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T06:31:24.3641035Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T06:31:24.3641821Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2025-03-14T06:31:24.6565648Z 2025-03-14T06:31:24.6566531Z  2025-03-14T06:31:24.6567418Z  2025-03-14T06:31:24.6567821Z  2025-03-14T06:31:24.6568182Z  2025-03-14T06:31:24.6568570Z  2025-03-14T06:31:24.6578752Z  2025-03-14T06:31:24.6579550Z  2025-03-14T06:31:24.6579965Z  2025-03-14T06:31:24.6580919Z [16,465 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:24.6581970Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2025-03-14T06:31:24.6582995Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T06:31:24.6583856Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T06:31:24.6584781Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T06:31:24.6585682Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T06:31:24.6586451Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T06:31:24.6587206Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T06:31:24.6587975Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2025-03-14T06:31:24.9210365Z 2025-03-14T06:31:24.9211248Z  2025-03-14T06:31:24.9211765Z  2025-03-14T06:31:24.9212152Z  2025-03-14T06:31:24.9212590Z  2025-03-14T06:31:24.9212968Z  2025-03-14T06:31:24.9213357Z  2025-03-14T06:31:24.9213755Z  2025-03-14T06:31:24.9214185Z  2025-03-14T06:31:24.9215140Z [16,466 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:24.9216277Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2025-03-14T06:31:24.9217208Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T06:31:24.9218027Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T06:31:24.9219141Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T06:31:24.9219968Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T06:31:24.9220749Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T06:31:24.9221453Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T06:31:24.9222178Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2025-03-14T06:31:25.1511055Z 2025-03-14T06:31:25.1511972Z  2025-03-14T06:31:25.1512644Z  2025-03-14T06:31:25.1513061Z  2025-03-14T06:31:25.1513487Z  2025-03-14T06:31:25.1513890Z  2025-03-14T06:31:25.1514256Z  2025-03-14T06:31:25.1514672Z  2025-03-14T06:31:25.1515052Z  2025-03-14T06:31:25.1515973Z [16,469 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:25.1517320Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2025-03-14T06:31:25.1518210Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T06:31:25.1519145Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T06:31:25.1520072Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T06:31:25.1520925Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T06:31:25.1521638Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T06:31:25.1522351Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T06:31:25.1523101Z Compiling xla/hlo/ir/hlo_schedule.cc; 15s local ... 2025-03-14T06:31:25.3638010Z 2025-03-14T06:31:25.3638882Z  2025-03-14T06:31:25.3639368Z  2025-03-14T06:31:25.3639778Z  2025-03-14T06:31:25.3640193Z  2025-03-14T06:31:25.3640672Z  2025-03-14T06:31:25.3641116Z  2025-03-14T06:31:25.3641506Z  2025-03-14T06:31:25.3641919Z  2025-03-14T06:31:25.3642959Z [16,469 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:25.3644142Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2025-03-14T06:31:25.3645166Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T06:31:25.3646317Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 22s local 2025-03-14T06:31:25.3647322Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T06:31:25.3648188Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T06:31:25.3649025Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T06:31:25.3649753Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T06:31:25.3650585Z Compiling xla/hlo/ir/hlo_schedule.cc; 15s local ... 2025-03-14T06:31:25.5857107Z 2025-03-14T06:31:25.5857957Z  2025-03-14T06:31:25.5858442Z  2025-03-14T06:31:25.5858832Z  2025-03-14T06:31:25.5859227Z  2025-03-14T06:31:25.5859643Z  2025-03-14T06:31:25.5860014Z  2025-03-14T06:31:25.5860391Z  2025-03-14T06:31:25.5860774Z  2025-03-14T06:31:25.5861644Z [16,470 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:25.5862692Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2025-03-14T06:31:25.5863549Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T06:31:25.5864355Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T06:31:25.5865267Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T06:31:25.5866315Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T06:31:25.5867168Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T06:31:25.5867874Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T06:31:25.5868651Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local ... 2025-03-14T06:31:25.8704960Z 2025-03-14T06:31:25.8705854Z  2025-03-14T06:31:25.8706333Z  2025-03-14T06:31:25.8706816Z  2025-03-14T06:31:25.8707206Z  2025-03-14T06:31:25.8707969Z  2025-03-14T06:31:25.8708375Z  2025-03-14T06:31:25.8708777Z  2025-03-14T06:31:25.8709187Z  2025-03-14T06:31:25.8710166Z [16,473 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:25.8711288Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T06:31:25.8712241Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T06:31:25.8713161Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T06:31:25.8714131Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T06:31:25.8714983Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T06:31:25.8715944Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T06:31:25.8716723Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T06:31:25.8717637Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local ... 2025-03-14T06:31:26.1388025Z 2025-03-14T06:31:26.1388839Z  2025-03-14T06:31:26.1389283Z  2025-03-14T06:31:26.1389642Z  2025-03-14T06:31:26.1390019Z  2025-03-14T06:31:26.1390392Z  2025-03-14T06:31:26.1390765Z  2025-03-14T06:31:26.1391104Z  2025-03-14T06:31:26.1391480Z  2025-03-14T06:31:26.1392314Z [16,475 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:26.1393277Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T06:31:26.1394396Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T06:31:26.1395191Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T06:31:26.1396011Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T06:31:26.1396829Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T06:31:26.1397518Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T06:31:26.1398201Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T06:31:26.1398917Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local ... 2025-03-14T06:31:26.3646677Z 2025-03-14T06:31:26.3647770Z  2025-03-14T06:31:26.3648295Z  2025-03-14T06:31:26.3648693Z  2025-03-14T06:31:26.3649073Z  2025-03-14T06:31:26.3649454Z  2025-03-14T06:31:26.3649834Z  2025-03-14T06:31:26.3650212Z  2025-03-14T06:31:26.3650579Z  2025-03-14T06:31:26.3651488Z [16,476 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:26.3652552Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T06:31:26.3653447Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T06:31:26.3654296Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 23s local 2025-03-14T06:31:26.3655228Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T06:31:26.3656102Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T06:31:26.3656790Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T06:31:26.3657501Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T06:31:26.3658240Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 15s local ... 2025-03-14T06:31:26.5850726Z 2025-03-14T06:31:26.5851597Z  2025-03-14T06:31:26.5852113Z  2025-03-14T06:31:26.5852522Z  2025-03-14T06:31:26.5852986Z  2025-03-14T06:31:26.5853493Z  2025-03-14T06:31:26.5853972Z  2025-03-14T06:31:26.5854439Z  2025-03-14T06:31:26.5854908Z  2025-03-14T06:31:26.5855981Z [16,478 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:26.5857142Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T06:31:26.5858008Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T06:31:26.5858844Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T06:31:26.5860076Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T06:31:26.5860973Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T06:31:26.5861736Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T06:31:26.5862541Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T06:31:26.5863453Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local ... 2025-03-14T06:31:26.9309162Z 2025-03-14T06:31:26.9310047Z  2025-03-14T06:31:26.9310593Z  2025-03-14T06:31:26.9311006Z  2025-03-14T06:31:26.9311393Z  2025-03-14T06:31:26.9311788Z  2025-03-14T06:31:26.9312176Z  2025-03-14T06:31:26.9312559Z  2025-03-14T06:31:26.9313252Z  2025-03-14T06:31:26.9314163Z [16,480 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:26.9315206Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T06:31:26.9316128Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T06:31:26.9317029Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T06:31:26.9317972Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T06:31:26.9318864Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T06:31:26.9319609Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T06:31:26.9320383Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T06:31:26.9321371Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local ... 2025-03-14T06:31:27.1653611Z 2025-03-14T06:31:27.1654465Z  2025-03-14T06:31:27.1654955Z  2025-03-14T06:31:27.1655368Z  2025-03-14T06:31:27.1655806Z  2025-03-14T06:31:27.1656227Z  2025-03-14T06:31:27.1656637Z  2025-03-14T06:31:27.1657034Z  2025-03-14T06:31:27.1657446Z  2025-03-14T06:31:27.1658432Z [16,481 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:27.1659539Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T06:31:27.1660711Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T06:31:27.1661583Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 24s local 2025-03-14T06:31:27.1662504Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T06:31:27.1663389Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T06:31:27.1664088Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T06:31:27.1664847Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T06:31:27.1665906Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local ... 2025-03-14T06:31:27.4152797Z 2025-03-14T06:31:27.4153597Z  2025-03-14T06:31:27.4154084Z  2025-03-14T06:31:27.4154498Z  2025-03-14T06:31:27.4154889Z  2025-03-14T06:31:27.4155270Z  2025-03-14T06:31:27.4155669Z  2025-03-14T06:31:27.4156083Z  2025-03-14T06:31:27.4156471Z  2025-03-14T06:31:27.4157416Z [16,482 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:27.4158452Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T06:31:27.4159325Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T06:31:27.4160185Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T06:31:27.4161121Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T06:31:27.4161996Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T06:31:27.4162736Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T06:31:27.4163534Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T06:31:27.4164315Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 16s local ... 2025-03-14T06:31:27.7659701Z 2025-03-14T06:31:27.7660591Z  2025-03-14T06:31:27.7661109Z  2025-03-14T06:31:27.7661835Z  2025-03-14T06:31:27.7662279Z  2025-03-14T06:31:27.7662670Z  2025-03-14T06:31:27.7663072Z  2025-03-14T06:31:27.7663488Z  2025-03-14T06:31:27.7663877Z  2025-03-14T06:31:27.7664850Z [16,485 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:27.7666173Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2025-03-14T06:31:27.7667039Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T06:31:27.7667906Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T06:31:27.7668822Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T06:31:27.7669985Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T06:31:27.7670756Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T06:31:27.7671528Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T06:31:27.7672317Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local ... 2025-03-14T06:31:27.9664132Z 2025-03-14T06:31:27.9664977Z  2025-03-14T06:31:27.9665765Z  2025-03-14T06:31:27.9666219Z  2025-03-14T06:31:27.9666648Z  2025-03-14T06:31:27.9667048Z  2025-03-14T06:31:27.9667459Z  2025-03-14T06:31:27.9667834Z  2025-03-14T06:31:27.9668219Z  2025-03-14T06:31:27.9669180Z [16,487 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:27.9670504Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T06:31:27.9671339Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T06:31:27.9672282Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T06:31:27.9673196Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T06:31:27.9673926Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T06:31:27.9674719Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T06:31:27.9675424Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T06:31:27.9676394Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 13s local ... 2025-03-14T06:31:28.3668846Z 2025-03-14T06:31:28.3669719Z  2025-03-14T06:31:28.3670207Z  2025-03-14T06:31:28.3670605Z  2025-03-14T06:31:28.3670995Z  2025-03-14T06:31:28.3671411Z  2025-03-14T06:31:28.3671809Z  2025-03-14T06:31:28.3672216Z  2025-03-14T06:31:28.3672605Z  2025-03-14T06:31:28.3673547Z [16,489 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:28.3674566Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T06:31:28.3675406Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 25s local 2025-03-14T06:31:28.3676226Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T06:31:28.3677097Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T06:31:28.3677854Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T06:31:28.3678615Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T06:31:28.3679374Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 17s local 2025-03-14T06:31:28.3680267Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local ... 2025-03-14T06:31:28.6271226Z 2025-03-14T06:31:28.6272138Z  2025-03-14T06:31:28.6272641Z  2025-03-14T06:31:28.6273049Z  2025-03-14T06:31:28.6273489Z  2025-03-14T06:31:28.6273886Z  2025-03-14T06:31:28.6274270Z  2025-03-14T06:31:28.6274648Z  2025-03-14T06:31:28.6275021Z  2025-03-14T06:31:28.6275832Z [16,490 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:28.6276855Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T06:31:28.6277687Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T06:31:28.6279025Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T06:31:28.6279932Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T06:31:28.6280698Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T06:31:28.6281458Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T06:31:28.6282234Z Compiling llvm/lib/ObjectYAML/ELFYAML.cpp; 18s local 2025-03-14T06:31:28.6283113Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local ... 2025-03-14T06:31:28.8458747Z 2025-03-14T06:31:28.8459613Z  2025-03-14T06:31:28.8460100Z  2025-03-14T06:31:28.8460481Z  2025-03-14T06:31:28.8460871Z  2025-03-14T06:31:28.8461239Z  2025-03-14T06:31:28.8461887Z  2025-03-14T06:31:28.8462267Z  2025-03-14T06:31:28.8462651Z  2025-03-14T06:31:28.8463549Z [16,491 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:28.8464603Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T06:31:28.8465887Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T06:31:28.8466874Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T06:31:28.8467771Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T06:31:28.8468535Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T06:31:28.8469325Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T06:31:28.8470217Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T06:31:28.8471437Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local ... 2025-03-14T06:31:29.1675883Z 2025-03-14T06:31:29.1676760Z  2025-03-14T06:31:29.1677250Z  2025-03-14T06:31:29.1677649Z  2025-03-14T06:31:29.1677993Z  2025-03-14T06:31:29.1678384Z  2025-03-14T06:31:29.1678730Z  2025-03-14T06:31:29.1679090Z  2025-03-14T06:31:29.1679556Z  2025-03-14T06:31:29.1680492Z [16,491 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:29.1681781Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T06:31:29.1682623Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 26s local 2025-03-14T06:31:29.1683584Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T06:31:29.1684536Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T06:31:29.1685235Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T06:31:29.1685923Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T06:31:29.1686798Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 14s local 2025-03-14T06:31:29.1687747Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local ... 2025-03-14T06:31:29.4324147Z 2025-03-14T06:31:29.4325158Z  2025-03-14T06:31:29.4325658Z  2025-03-14T06:31:29.4326073Z  2025-03-14T06:31:29.4326533Z  2025-03-14T06:31:29.4326947Z  2025-03-14T06:31:29.4327369Z  2025-03-14T06:31:29.4327767Z  2025-03-14T06:31:29.4328164Z  2025-03-14T06:31:29.4329137Z [16,493 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:29.4330199Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T06:31:29.4331056Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T06:31:29.4331875Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T06:31:29.4332669Z Compiling xla/hlo/builder/xla_builder.cc; 26s local 2025-03-14T06:31:29.4333502Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T06:31:29.4334374Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:29.4335369Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local 2025-03-14T06:31:29.4336359Z Compiling xla/service/hlo_execution_profile.cc; 12s local ... 2025-03-14T06:31:29.6957972Z 2025-03-14T06:31:29.6958853Z  2025-03-14T06:31:29.6959362Z  2025-03-14T06:31:29.6959822Z  2025-03-14T06:31:29.6960244Z  2025-03-14T06:31:29.6960656Z  2025-03-14T06:31:29.6961053Z  2025-03-14T06:31:29.6961444Z  2025-03-14T06:31:29.6961877Z  2025-03-14T06:31:29.6962814Z [16,496 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:29.6963925Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T06:31:29.6964918Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T06:31:29.6965966Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T06:31:29.6966726Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T06:31:29.6967781Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:29.6968752Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 14s local 2025-03-14T06:31:29.6969684Z Compiling xla/service/shape_inference.cc; 12s local 2025-03-14T06:31:29.6970460Z @llvm-project//mlir:ControlFlowDialect; 12s local ... 2025-03-14T06:31:29.9685194Z 2025-03-14T06:31:29.9686100Z  2025-03-14T06:31:29.9686636Z  2025-03-14T06:31:29.9687062Z  2025-03-14T06:31:29.9687496Z  2025-03-14T06:31:29.9687897Z  2025-03-14T06:31:29.9688315Z  2025-03-14T06:31:29.9688744Z  2025-03-14T06:31:29.9689131Z  2025-03-14T06:31:29.9690056Z [16,497 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:29.9691432Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T06:31:29.9692323Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T06:31:29.9693198Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T06:31:29.9694011Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T06:31:29.9694916Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:29.9695897Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2025-03-14T06:31:29.9696949Z Compiling xla/service/shape_inference.cc; 12s local 2025-03-14T06:31:29.9697790Z @llvm-project//mlir:ControlFlowDialect; 12s local ... 2025-03-14T06:31:30.2979377Z 2025-03-14T06:31:30.2980250Z  2025-03-14T06:31:30.2980769Z  2025-03-14T06:31:30.2981185Z  2025-03-14T06:31:30.2981616Z  2025-03-14T06:31:30.2982027Z  2025-03-14T06:31:30.2982484Z  2025-03-14T06:31:30.2982900Z  2025-03-14T06:31:30.2983309Z  2025-03-14T06:31:30.2984244Z [16,498 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:30.2985289Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T06:31:30.2986189Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 27s local 2025-03-14T06:31:30.2987058Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T06:31:30.2987828Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T06:31:30.2988742Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 15s local 2025-03-14T06:31:30.2989712Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2025-03-14T06:31:30.2990654Z Compiling xla/service/shape_inference.cc; 12s local 2025-03-14T06:31:30.2991487Z @llvm-project//mlir:ControlFlowDialect; 12s local ... 2025-03-14T06:31:30.5688379Z 2025-03-14T06:31:30.5689275Z  2025-03-14T06:31:30.5689838Z  2025-03-14T06:31:30.5690279Z  2025-03-14T06:31:30.5690710Z  2025-03-14T06:31:30.5691145Z  2025-03-14T06:31:30.5691571Z  2025-03-14T06:31:30.5692004Z  2025-03-14T06:31:30.5692435Z  2025-03-14T06:31:30.5693451Z [16,498 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:30.5694591Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T06:31:30.5695776Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T06:31:30.5696649Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T06:31:30.5697424Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T06:31:30.5698322Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T06:31:30.5699342Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 15s local 2025-03-14T06:31:30.5700279Z Compiling xla/service/shape_inference.cc; 13s local 2025-03-14T06:31:30.5701123Z @llvm-project//mlir:ControlFlowDialect; 12s local ... 2025-03-14T06:31:30.8046166Z 2025-03-14T06:31:30.8047026Z  2025-03-14T06:31:30.8047508Z  2025-03-14T06:31:30.8047924Z  2025-03-14T06:31:30.8048592Z  2025-03-14T06:31:30.8049003Z  2025-03-14T06:31:30.8049366Z  2025-03-14T06:31:30.8049768Z  2025-03-14T06:31:30.8050160Z  2025-03-14T06:31:30.8051088Z [16,500 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:30.8052167Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T06:31:30.8053082Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T06:31:30.8053896Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T06:31:30.8054680Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T06:31:30.8055586Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T06:31:30.8056576Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2025-03-14T06:31:30.8057688Z Compiling xla/service/shape_inference.cc; 13s local 2025-03-14T06:31:30.8058496Z @llvm-project//mlir:ControlFlowDialect; 13s local ... 2025-03-14T06:31:31.1690033Z 2025-03-14T06:31:31.1690865Z  2025-03-14T06:31:31.1691349Z  2025-03-14T06:31:31.1691770Z  2025-03-14T06:31:31.1692181Z  2025-03-14T06:31:31.1692561Z  2025-03-14T06:31:31.1692962Z  2025-03-14T06:31:31.1693403Z  2025-03-14T06:31:31.1693789Z  2025-03-14T06:31:31.1695004Z [16,501 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:31.1696096Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T06:31:31.1697148Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 28s local 2025-03-14T06:31:31.1698019Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T06:31:31.1698839Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T06:31:31.1699697Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 16s local 2025-03-14T06:31:31.1700612Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2025-03-14T06:31:31.1701548Z Compiling xla/service/shape_inference.cc; 13s local 2025-03-14T06:31:31.1702363Z @llvm-project//mlir:ControlFlowDialect; 13s local ... 2025-03-14T06:31:31.4611044Z 2025-03-14T06:31:31.4611903Z  2025-03-14T06:31:31.4612394Z  2025-03-14T06:31:31.4612822Z  2025-03-14T06:31:31.4613225Z  2025-03-14T06:31:31.4613669Z  2025-03-14T06:31:31.4614107Z  2025-03-14T06:31:31.4614533Z  2025-03-14T06:31:31.4614914Z  2025-03-14T06:31:31.4615863Z [16,502 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:31.4616961Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T06:31:31.4617849Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T06:31:31.4618701Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T06:31:31.4619517Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T06:31:31.4620405Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T06:31:31.4621368Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 16s local 2025-03-14T06:31:31.4622287Z Compiling xla/service/shape_inference.cc; 14s local 2025-03-14T06:31:31.4623305Z @llvm-project//mlir:ControlFlowDialect; 13s local ... 2025-03-14T06:31:31.7700759Z 2025-03-14T06:31:31.7701494Z  2025-03-14T06:31:31.7701914Z  2025-03-14T06:31:31.7702313Z  2025-03-14T06:31:31.7702676Z  2025-03-14T06:31:31.7703075Z  2025-03-14T06:31:31.7703474Z  2025-03-14T06:31:31.7703873Z  2025-03-14T06:31:31.7704244Z  2025-03-14T06:31:31.7705158Z [16,503 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:31.7706173Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T06:31:31.7707056Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T06:31:31.7707868Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T06:31:31.7708897Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T06:31:31.7709763Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T06:31:31.7710682Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T06:31:31.7711519Z Compiling xla/service/shape_inference.cc; 14s local 2025-03-14T06:31:31.7712376Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local ... 2025-03-14T06:31:31.9706432Z 2025-03-14T06:31:31.9707303Z  2025-03-14T06:31:31.9707807Z  2025-03-14T06:31:31.9708242Z  2025-03-14T06:31:31.9708624Z  2025-03-14T06:31:31.9709037Z  2025-03-14T06:31:31.9709444Z  2025-03-14T06:31:31.9709838Z  2025-03-14T06:31:31.9710224Z  2025-03-14T06:31:31.9711474Z [16,504 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:31.9712708Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T06:31:31.9713641Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T06:31:31.9714497Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T06:31:31.9715252Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T06:31:31.9716133Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 17s local 2025-03-14T06:31:31.9717258Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T06:31:31.9718193Z Compiling xla/service/shape_inference.cc; 14s local 2025-03-14T06:31:31.9718960Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local ... 2025-03-14T06:31:32.3400461Z 2025-03-14T06:31:32.3401306Z  2025-03-14T06:31:32.3401731Z  2025-03-14T06:31:32.3402147Z  2025-03-14T06:31:32.3402583Z  2025-03-14T06:31:32.3403044Z  2025-03-14T06:31:32.3403412Z  2025-03-14T06:31:32.3403761Z  2025-03-14T06:31:32.3404110Z  2025-03-14T06:31:32.3405226Z [16,505 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:32.3406288Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T06:31:32.3407051Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 29s local 2025-03-14T06:31:32.3407730Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T06:31:32.3408385Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T06:31:32.3409170Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T06:31:32.3410089Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T06:31:32.3410896Z Compiling xla/service/shape_inference.cc; 15s local 2025-03-14T06:31:32.3411553Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local ... 2025-03-14T06:31:32.5711462Z 2025-03-14T06:31:32.5712324Z  2025-03-14T06:31:32.5712839Z  2025-03-14T06:31:32.5713251Z  2025-03-14T06:31:32.5713663Z  2025-03-14T06:31:32.5714083Z  2025-03-14T06:31:32.5714533Z  2025-03-14T06:31:32.5714948Z  2025-03-14T06:31:32.5715364Z  2025-03-14T06:31:32.5716317Z [16,506 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:32.5717637Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T06:31:32.5718558Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T06:31:32.5719573Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T06:31:32.5720394Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T06:31:32.5721275Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T06:31:32.5722218Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 17s local 2025-03-14T06:31:32.5723085Z Compiling xla/service/shape_inference.cc; 15s local 2025-03-14T06:31:32.5723866Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local ... 2025-03-14T06:31:32.7714849Z 2025-03-14T06:31:32.7715687Z  2025-03-14T06:31:32.7716472Z  2025-03-14T06:31:32.7716899Z  2025-03-14T06:31:32.7717338Z  2025-03-14T06:31:32.7717763Z  2025-03-14T06:31:32.7718199Z  2025-03-14T06:31:32.7718630Z  2025-03-14T06:31:32.7719056Z  2025-03-14T06:31:32.7720040Z [16,511 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:32.7721111Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T06:31:32.7722036Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T06:31:32.7722896Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T06:31:32.7723703Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T06:31:32.7724709Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T06:31:32.7725661Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T06:31:32.7726468Z Compiling xla/service/shape_inference.cc; 15s local 2025-03-14T06:31:32.7727275Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local ... 2025-03-14T06:31:33.1720294Z 2025-03-14T06:31:33.1721182Z  2025-03-14T06:31:33.1721709Z  2025-03-14T06:31:33.1722121Z  2025-03-14T06:31:33.1722539Z  2025-03-14T06:31:33.1722987Z  2025-03-14T06:31:33.1723390Z  2025-03-14T06:31:33.1723801Z  2025-03-14T06:31:33.1724203Z  2025-03-14T06:31:33.1725566Z [16,512 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:33.1726705Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T06:31:33.1727581Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 30s local 2025-03-14T06:31:33.1728306Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T06:31:33.1729086Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T06:31:33.1729990Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 18s local 2025-03-14T06:31:33.1730933Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T06:31:33.1731843Z Compiling xla/service/shape_inference.cc; 15s local 2025-03-14T06:31:33.1732646Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local ... 2025-03-14T06:31:33.3724328Z 2025-03-14T06:31:33.3725265Z  2025-03-14T06:31:33.3725742Z  2025-03-14T06:31:33.3726133Z  2025-03-14T06:31:33.3726518Z  2025-03-14T06:31:33.3726924Z  2025-03-14T06:31:33.3727340Z  2025-03-14T06:31:33.3727751Z  2025-03-14T06:31:33.3728150Z  2025-03-14T06:31:33.3729080Z [16,513 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:33.3730120Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T06:31:33.3731025Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T06:31:33.3731845Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T06:31:33.3732580Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T06:31:33.3733394Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T06:31:33.3734354Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 18s local 2025-03-14T06:31:33.3735445Z Compiling xla/service/shape_inference.cc; 16s local 2025-03-14T06:31:33.3736251Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local ... 2025-03-14T06:31:33.7464667Z 2025-03-14T06:31:33.7465781Z  2025-03-14T06:31:33.7466392Z  2025-03-14T06:31:33.7466804Z  2025-03-14T06:31:33.7467257Z  2025-03-14T06:31:33.7467649Z  2025-03-14T06:31:33.7468026Z  2025-03-14T06:31:33.7468404Z  2025-03-14T06:31:33.7468780Z  2025-03-14T06:31:33.7469677Z [16,516 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:33.7470734Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T06:31:33.7471589Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T06:31:33.7472642Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T06:31:33.7473388Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T06:31:33.7474180Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T06:31:33.7475109Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:33.7475995Z Compiling xla/service/shape_inference.cc; 16s local 2025-03-14T06:31:33.7476624Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local ... 2025-03-14T06:31:33.9689342Z 2025-03-14T06:31:33.9690178Z  2025-03-14T06:31:33.9690689Z  2025-03-14T06:31:33.9691230Z  2025-03-14T06:31:33.9691659Z  2025-03-14T06:31:33.9692073Z  2025-03-14T06:31:33.9692471Z  2025-03-14T06:31:33.9693160Z  2025-03-14T06:31:33.9693575Z  2025-03-14T06:31:33.9694546Z [16,520 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:33.9695666Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T06:31:33.9696452Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T06:31:33.9697279Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T06:31:33.9698118Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T06:31:33.9699011Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:33.9700068Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T06:31:33.9700902Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 11s local 2025-03-14T06:31:33.9701829Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 10s local ... 2025-03-14T06:31:34.1731364Z 2025-03-14T06:31:34.1732240Z  2025-03-14T06:31:34.1732742Z  2025-03-14T06:31:34.1733168Z  2025-03-14T06:31:34.1733560Z  2025-03-14T06:31:34.1733968Z  2025-03-14T06:31:34.1734376Z  2025-03-14T06:31:34.1734796Z  2025-03-14T06:31:34.1735308Z  2025-03-14T06:31:34.1736380Z [16,522 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:34.1737409Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 31s local 2025-03-14T06:31:34.1738237Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T06:31:34.1739020Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T06:31:34.1739904Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 19s local 2025-03-14T06:31:34.1740803Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:34.1741695Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T06:31:34.1742584Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 11s local 2025-03-14T06:31:34.1743450Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local ... 2025-03-14T06:31:34.3735085Z 2025-03-14T06:31:34.3735943Z  2025-03-14T06:31:34.3736462Z  2025-03-14T06:31:34.3736850Z  2025-03-14T06:31:34.3737263Z  2025-03-14T06:31:34.3737646Z  2025-03-14T06:31:34.3738150Z  2025-03-14T06:31:34.3738534Z  2025-03-14T06:31:34.3738931Z  2025-03-14T06:31:34.3741849Z [16,523 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:34.3743148Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T06:31:34.3744022Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T06:31:34.3744831Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T06:31:34.3745650Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T06:31:34.3746611Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 19s local 2025-03-14T06:31:34.3747516Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T06:31:34.3748367Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 11s local 2025-03-14T06:31:34.3749213Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local ... 2025-03-14T06:31:34.7740248Z 2025-03-14T06:31:34.7741097Z  2025-03-14T06:31:34.7741593Z  2025-03-14T06:31:34.7741994Z  2025-03-14T06:31:34.7742393Z  2025-03-14T06:31:34.7742764Z  2025-03-14T06:31:34.7743171Z  2025-03-14T06:31:34.7743599Z  2025-03-14T06:31:34.7743992Z  2025-03-14T06:31:34.7744935Z [16,524 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:34.7745965Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T06:31:34.7746792Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T06:31:34.7747567Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T06:31:34.7748399Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T06:31:34.7749645Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T06:31:34.7750450Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T06:31:34.7751168Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 12s local 2025-03-14T06:31:34.7752069Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local ... 2025-03-14T06:31:34.9744506Z 2025-03-14T06:31:34.9745310Z  2025-03-14T06:31:34.9745812Z  2025-03-14T06:31:34.9746244Z  2025-03-14T06:31:34.9746635Z  2025-03-14T06:31:34.9747041Z  2025-03-14T06:31:34.9747470Z  2025-03-14T06:31:34.9748024Z  2025-03-14T06:31:34.9748482Z  2025-03-14T06:31:34.9749431Z [16,526 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:34.9750527Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 32s local 2025-03-14T06:31:34.9751367Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T06:31:34.9752182Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T06:31:34.9753044Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 20s local 2025-03-14T06:31:34.9753993Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T06:31:34.9754910Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T06:31:34.9755709Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 12s local 2025-03-14T06:31:34.9756637Z Compiling mlir/lib/Dialect/Func/IR/FuncOps.cpp; 11s local ... 2025-03-14T06:31:35.3738475Z 2025-03-14T06:31:35.3739351Z  2025-03-14T06:31:35.3739867Z  2025-03-14T06:31:35.3740336Z  2025-03-14T06:31:35.3740744Z  2025-03-14T06:31:35.3741164Z  2025-03-14T06:31:35.3741589Z  2025-03-14T06:31:35.3742010Z  2025-03-14T06:31:35.3742416Z  2025-03-14T06:31:35.3743363Z [16,530 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:35.3744478Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 33s local 2025-03-14T06:31:35.3745356Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T06:31:35.3746181Z @llvm-project//mlir:SparseTensorDialect; 31s local 2025-03-14T06:31:35.3747092Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T06:31:35.3748108Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T06:31:35.3749333Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T06:31:35.3750160Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 12s local 2025-03-14T06:31:35.3751087Z Compiling xla/service/hlo_cost_analysis.cc; 11s local ... 2025-03-14T06:31:35.5749667Z 2025-03-14T06:31:35.5750565Z  2025-03-14T06:31:35.5751075Z  2025-03-14T06:31:35.5751491Z  2025-03-14T06:31:35.5751870Z  2025-03-14T06:31:35.5752237Z  2025-03-14T06:31:35.5752601Z  2025-03-14T06:31:35.5752976Z  2025-03-14T06:31:35.5753417Z  2025-03-14T06:31:35.5754355Z [16,530 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:35.5755385Z Compiling mlir/lib/Dialect/Mesh/IR/MeshOps.cpp; 33s local 2025-03-14T06:31:35.5756535Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T06:31:35.5757402Z @llvm-project//mlir:SparseTensorDialect; 31s local 2025-03-14T06:31:35.5758295Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T06:31:35.5759205Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 20s local 2025-03-14T06:31:35.5760099Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T06:31:35.5760897Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 13s local 2025-03-14T06:31:35.5761758Z Compiling xla/service/hlo_cost_analysis.cc; 12s local ... 2025-03-14T06:31:35.7753884Z 2025-03-14T06:31:35.7754751Z  2025-03-14T06:31:35.7755239Z  2025-03-14T06:31:35.7755653Z  2025-03-14T06:31:35.7756472Z  2025-03-14T06:31:35.7756895Z  2025-03-14T06:31:35.7757318Z  2025-03-14T06:31:35.7757735Z  2025-03-14T06:31:35.7758151Z  2025-03-14T06:31:35.7759141Z [16,531 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:35.7760218Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T06:31:35.7761019Z @llvm-project//mlir:SparseTensorDialect; 31s local 2025-03-14T06:31:35.7761938Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T06:31:35.7763180Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T06:31:35.7764130Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T06:31:35.7765140Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 13s local 2025-03-14T06:31:35.7766225Z Compiling xla/service/hlo_cost_analysis.cc; 12s local 2025-03-14T06:31:35.7767189Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 11s local ... 2025-03-14T06:31:35.9816127Z 2025-03-14T06:31:35.9817012Z  2025-03-14T06:31:35.9817513Z  2025-03-14T06:31:35.9817942Z  2025-03-14T06:31:35.9818362Z  2025-03-14T06:31:35.9818769Z  2025-03-14T06:31:35.9819218Z  2025-03-14T06:31:35.9819618Z  2025-03-14T06:31:35.9820013Z  2025-03-14T06:31:35.9820987Z [16,534 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:35.9822032Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T06:31:35.9822818Z @llvm-project//mlir:SparseTensorDialect; 31s local 2025-03-14T06:31:35.9823698Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 21s local 2025-03-14T06:31:35.9824648Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T06:31:35.9825554Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T06:31:35.9826364Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 13s local 2025-03-14T06:31:35.9827286Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 11s local 2025-03-14T06:31:35.9828073Z Compiling xla/hlo/ir/hlo_module.cc; 10s local ... 2025-03-14T06:31:36.3350035Z 2025-03-14T06:31:36.3350889Z  2025-03-14T06:31:36.3351433Z  2025-03-14T06:31:36.3351876Z  2025-03-14T06:31:36.3352285Z  2025-03-14T06:31:36.3352701Z  2025-03-14T06:31:36.3353108Z  2025-03-14T06:31:36.3353517Z  2025-03-14T06:31:36.3353924Z  2025-03-14T06:31:36.3355101Z [16,535 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:36.3355911Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T06:31:36.3367650Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T06:31:36.3368525Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T06:31:36.3369482Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T06:31:36.3370356Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T06:31:36.3371243Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 13s local 2025-03-14T06:31:36.3372212Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 12s local 2025-03-14T06:31:36.3373317Z Compiling xla/hlo/ir/hlo_module.cc; 10s local ... 2025-03-14T06:31:36.5760940Z 2025-03-14T06:31:36.5761802Z  2025-03-14T06:31:36.5762302Z  2025-03-14T06:31:36.5762742Z  2025-03-14T06:31:36.5763177Z  2025-03-14T06:31:36.5763635Z  2025-03-14T06:31:36.5764085Z  2025-03-14T06:31:36.5764627Z  2025-03-14T06:31:36.5765014Z  2025-03-14T06:31:36.5766191Z [16,537 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:36.5767242Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T06:31:36.5768058Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T06:31:36.5768949Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T06:31:36.5770179Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 21s local 2025-03-14T06:31:36.5771118Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T06:31:36.5772139Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local 2025-03-14T06:31:36.5773185Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 12s local 2025-03-14T06:31:36.5774145Z Compiling xla/hlo/ir/hlo_module.cc; 10s local ... 2025-03-14T06:31:36.7764917Z 2025-03-14T06:31:36.7766143Z  2025-03-14T06:31:36.7766667Z  2025-03-14T06:31:36.7767091Z  2025-03-14T06:31:36.7767484Z  2025-03-14T06:31:36.7768155Z  2025-03-14T06:31:36.7768561Z  2025-03-14T06:31:36.7768964Z  2025-03-14T06:31:36.7769362Z  2025-03-14T06:31:36.7770309Z [16,538 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:36.7771274Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T06:31:36.7772081Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T06:31:36.7772942Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T06:31:36.7773899Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T06:31:36.7774924Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T06:31:36.7775706Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local 2025-03-14T06:31:36.7776584Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 12s local 2025-03-14T06:31:36.7777319Z Compiling xla/hlo/ir/hlo_module.cc; 11s local ... 2025-03-14T06:31:37.1770614Z 2025-03-14T06:31:37.1771494Z  2025-03-14T06:31:37.1772010Z  2025-03-14T06:31:37.1772432Z  2025-03-14T06:31:37.1772824Z  2025-03-14T06:31:37.1773202Z  2025-03-14T06:31:37.1773601Z  2025-03-14T06:31:37.1774000Z  2025-03-14T06:31:37.1774374Z  2025-03-14T06:31:37.1775301Z [16,539 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:37.1776309Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T06:31:37.1776954Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T06:31:37.1777811Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 22s local 2025-03-14T06:31:37.1778781Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T06:31:37.1779949Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T06:31:37.1780806Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local 2025-03-14T06:31:37.1781746Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 12s local 2025-03-14T06:31:37.1782555Z Compiling xla/hlo/ir/hlo_module.cc; 11s local ... 2025-03-14T06:31:37.3773795Z 2025-03-14T06:31:37.3774651Z  2025-03-14T06:31:37.3775243Z  2025-03-14T06:31:37.3775912Z  2025-03-14T06:31:37.3776373Z  2025-03-14T06:31:37.3776725Z  2025-03-14T06:31:37.3777035Z  2025-03-14T06:31:37.3777420Z  2025-03-14T06:31:37.3777797Z  2025-03-14T06:31:37.3778718Z [16,541 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:37.3780100Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T06:31:37.3781014Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T06:31:37.3781862Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T06:31:37.3782816Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T06:31:37.3783693Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T06:31:37.3784475Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 14s local 2025-03-14T06:31:37.3785354Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 13s local 2025-03-14T06:31:37.3786209Z Compiling xla/hlo/ir/hlo_module.cc; 11s local ... 2025-03-14T06:31:37.6522876Z 2025-03-14T06:31:37.6523796Z  2025-03-14T06:31:37.6524808Z  2025-03-14T06:31:37.6525222Z  2025-03-14T06:31:37.6525625Z  2025-03-14T06:31:37.6526043Z  2025-03-14T06:31:37.6526448Z  2025-03-14T06:31:37.6526821Z  2025-03-14T06:31:37.6527205Z  2025-03-14T06:31:37.6528127Z [16,542 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:37.6529066Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T06:31:37.6529968Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T06:31:37.6530796Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T06:31:37.6531977Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 22s local 2025-03-14T06:31:37.6532846Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T06:31:37.6533638Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T06:31:37.6534499Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 13s local 2025-03-14T06:31:37.6535343Z Compiling xla/hlo/ir/hlo_module.cc; 11s local ... 2025-03-14T06:31:37.9780202Z 2025-03-14T06:31:37.9781072Z  2025-03-14T06:31:37.9781552Z  2025-03-14T06:31:37.9781965Z  2025-03-14T06:31:37.9782416Z  2025-03-14T06:31:37.9782842Z  2025-03-14T06:31:37.9783236Z  2025-03-14T06:31:37.9783625Z  2025-03-14T06:31:37.9784043Z  2025-03-14T06:31:37.9785016Z [16,546 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:37.9786178Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T06:31:37.9786965Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T06:31:37.9787854Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 23s local 2025-03-14T06:31:37.9788806Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T06:31:37.9789681Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T06:31:37.9790495Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T06:31:37.9791421Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 13s local 2025-03-14T06:31:37.9792248Z Compiling xla/hlo/ir/hlo_module.cc; 12s local ... 2025-03-14T06:31:38.3225777Z 2025-03-14T06:31:38.3226659Z  2025-03-14T06:31:38.3227124Z  2025-03-14T06:31:38.3227508Z  2025-03-14T06:31:38.3227895Z  2025-03-14T06:31:38.3228283Z  2025-03-14T06:31:38.3228673Z  2025-03-14T06:31:38.3229045Z  2025-03-14T06:31:38.3229669Z  2025-03-14T06:31:38.3230617Z [16,547 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:38.3231668Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T06:31:38.3232569Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T06:31:38.3233310Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T06:31:38.3234203Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T06:31:38.3235111Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T06:31:38.3235880Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 15s local 2025-03-14T06:31:38.3236769Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2025-03-14T06:31:38.3237986Z Compiling xla/hlo/ir/hlo_module.cc; 12s local ... 2025-03-14T06:31:38.5786611Z 2025-03-14T06:31:38.5787450Z  2025-03-14T06:31:38.5787977Z  2025-03-14T06:31:38.5788425Z  2025-03-14T06:31:38.5788864Z  2025-03-14T06:31:38.5789300Z  2025-03-14T06:31:38.5789715Z  2025-03-14T06:31:38.5790103Z  2025-03-14T06:31:38.5790525Z  2025-03-14T06:31:38.5791528Z [16,549 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:38.5792588Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T06:31:38.5793402Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T06:31:38.5794678Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T06:31:38.5795703Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 23s local 2025-03-14T06:31:38.5796641Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T06:31:38.5797518Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local 2025-03-14T06:31:38.5798477Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2025-03-14T06:31:38.5799345Z Compiling xla/hlo/ir/hlo_module.cc; 12s local ... 2025-03-14T06:31:38.9495498Z 2025-03-14T06:31:38.9496417Z  2025-03-14T06:31:38.9496951Z  2025-03-14T06:31:38.9497692Z  2025-03-14T06:31:38.9498129Z  2025-03-14T06:31:38.9498530Z  2025-03-14T06:31:38.9498941Z  2025-03-14T06:31:38.9499431Z  2025-03-14T06:31:38.9499886Z  2025-03-14T06:31:38.9500932Z [16,555 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:38.9501954Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T06:31:38.9502715Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T06:31:38.9503510Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T06:31:38.9504470Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T06:31:38.9505351Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T06:31:38.9506160Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local 2025-03-14T06:31:38.9507084Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2025-03-14T06:31:38.9508038Z Compiling xla/hlo/ir/hlo_module.cc; 13s local ... 2025-03-14T06:31:39.1791897Z 2025-03-14T06:31:39.1792795Z  2025-03-14T06:31:39.1793356Z  2025-03-14T06:31:39.1793800Z  2025-03-14T06:31:39.1794202Z  2025-03-14T06:31:39.1794626Z  2025-03-14T06:31:39.1795053Z  2025-03-14T06:31:39.1795480Z  2025-03-14T06:31:39.1795891Z  2025-03-14T06:31:39.1796933Z [16,556 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:39.1797929Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T06:31:39.1798750Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T06:31:39.1799634Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 24s local 2025-03-14T06:31:39.1800633Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 24s local 2025-03-14T06:31:39.1801782Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T06:31:39.1802637Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 16s local 2025-03-14T06:31:39.1803567Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 14s local 2025-03-14T06:31:39.1804674Z Compiling xla/hlo/ir/hlo_module.cc; 13s local ... 2025-03-14T06:31:39.8773634Z 2025-03-14T06:31:39.8774492Z  2025-03-14T06:31:39.8775060Z  2025-03-14T06:31:39.8775438Z  2025-03-14T06:31:39.8775800Z  2025-03-14T06:31:39.8776219Z  2025-03-14T06:31:39.8776580Z  2025-03-14T06:31:39.8776965Z  2025-03-14T06:31:39.8777285Z  2025-03-14T06:31:39.8778174Z [16,557 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:39.8779347Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T06:31:39.8780044Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T06:31:39.8780955Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2025-03-14T06:31:39.8781908Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T06:31:39.8782836Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T06:31:39.8783692Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T06:31:39.8784546Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2025-03-14T06:31:39.8785395Z Compiling xla/hlo/ir/hlo_module.cc; 14s local ... 2025-03-14T06:31:40.1799051Z 2025-03-14T06:31:40.1800233Z  2025-03-14T06:31:40.1800756Z  2025-03-14T06:31:40.1801210Z  2025-03-14T06:31:40.1801626Z  2025-03-14T06:31:40.1802013Z  2025-03-14T06:31:40.1802392Z  2025-03-14T06:31:40.1802814Z  2025-03-14T06:31:40.1803209Z  2025-03-14T06:31:40.1804190Z [16,557 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:40.1805358Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T06:31:40.1806208Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T06:31:40.1807229Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 25s local 2025-03-14T06:31:40.1808180Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T06:31:40.1809126Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T06:31:40.1809886Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 17s local 2025-03-14T06:31:40.1810754Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 15s local 2025-03-14T06:31:40.1811584Z Compiling xla/hlo/ir/hlo_module.cc; 14s local ... 2025-03-14T06:31:40.4947886Z 2025-03-14T06:31:40.4948818Z  2025-03-14T06:31:40.4949351Z  2025-03-14T06:31:40.4949799Z  2025-03-14T06:31:40.4950226Z  2025-03-14T06:31:40.4950634Z  2025-03-14T06:31:40.4951063Z  2025-03-14T06:31:40.4951490Z  2025-03-14T06:31:40.4951920Z  2025-03-14T06:31:40.4952897Z [16,559 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:40.4953935Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T06:31:40.4954694Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T06:31:40.4955534Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T06:31:40.4956476Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 25s local 2025-03-14T06:31:40.4957385Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T06:31:40.4958228Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T06:31:40.4959126Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2025-03-14T06:31:40.4959938Z Compiling xla/hlo/ir/hlo_module.cc; 14s local ... 2025-03-14T06:31:40.7805432Z 2025-03-14T06:31:40.7806288Z  2025-03-14T06:31:40.7806791Z  2025-03-14T06:31:40.7807207Z  2025-03-14T06:31:40.7807602Z  2025-03-14T06:31:40.7808006Z  2025-03-14T06:31:40.7808670Z  2025-03-14T06:31:40.7809074Z  2025-03-14T06:31:40.7809502Z  2025-03-14T06:31:40.7810463Z [16,559 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:40.7811444Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T06:31:40.7812230Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T06:31:40.7813029Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T06:31:40.7813964Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T06:31:40.7814962Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T06:31:40.7815727Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T06:31:40.7816824Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2025-03-14T06:31:40.7817628Z Compiling xla/hlo/ir/hlo_module.cc; 15s local ... 2025-03-14T06:31:40.9860868Z 2025-03-14T06:31:40.9861781Z  2025-03-14T06:31:40.9862319Z  2025-03-14T06:31:40.9862718Z  2025-03-14T06:31:40.9863119Z  2025-03-14T06:31:40.9863512Z  2025-03-14T06:31:40.9863942Z  2025-03-14T06:31:40.9864339Z  2025-03-14T06:31:40.9864713Z  2025-03-14T06:31:40.9865870Z [16,560 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:40.9866856Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T06:31:40.9867614Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T06:31:40.9868692Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T06:31:40.9869694Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T06:31:40.9870617Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T06:31:40.9871417Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T06:31:40.9872345Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2025-03-14T06:31:40.9873162Z Compiling xla/hlo/ir/hlo_module.cc; 15s local ... 2025-03-14T06:31:41.2358580Z 2025-03-14T06:31:41.2359418Z  2025-03-14T06:31:41.2360174Z  2025-03-14T06:31:41.2360623Z  2025-03-14T06:31:41.2361028Z  2025-03-14T06:31:41.2361432Z  2025-03-14T06:31:41.2361836Z  2025-03-14T06:31:41.2362231Z  2025-03-14T06:31:41.2362630Z  2025-03-14T06:31:41.2363555Z [16,562 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:41.2364713Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T06:31:41.2365700Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T06:31:41.2366578Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 26s local 2025-03-14T06:31:41.2367533Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T06:31:41.2368454Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T06:31:41.2369295Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 18s local 2025-03-14T06:31:41.2370239Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 16s local 2025-03-14T06:31:41.2371124Z Compiling xla/hlo/ir/hlo_module.cc; 15s local ... 2025-03-14T06:31:41.5811888Z 2025-03-14T06:31:41.5812752Z  2025-03-14T06:31:41.5813236Z  2025-03-14T06:31:41.5813669Z  2025-03-14T06:31:41.5814051Z  2025-03-14T06:31:41.5814454Z  2025-03-14T06:31:41.5814879Z  2025-03-14T06:31:41.5815280Z  2025-03-14T06:31:41.5815736Z  2025-03-14T06:31:41.5816696Z [16,563 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:41.5817746Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T06:31:41.5818602Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T06:31:41.5819496Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T06:31:41.5820810Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 26s local 2025-03-14T06:31:41.5821781Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T06:31:41.5822700Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T06:31:41.5823663Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2025-03-14T06:31:41.5824591Z Compiling xla/hlo/ir/hlo_module.cc; 15s local ... 2025-03-14T06:31:41.7872844Z 2025-03-14T06:31:41.7873731Z  2025-03-14T06:31:41.7874208Z  2025-03-14T06:31:41.7874617Z  2025-03-14T06:31:41.7875034Z  2025-03-14T06:31:41.7875435Z  2025-03-14T06:31:41.7875834Z  2025-03-14T06:31:41.7876241Z  2025-03-14T06:31:41.7876647Z  2025-03-14T06:31:41.7877512Z [16,564 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:41.7878764Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T06:31:41.7879561Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T06:31:41.7880566Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T06:31:41.7881605Z Compiling mlir/lib/Dialect/Arith/IR/ArithDialect.cpp; 27s local 2025-03-14T06:31:41.7882548Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T06:31:41.7883401Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T06:31:41.7884490Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2025-03-14T06:31:41.7885362Z Compiling xla/hlo/ir/hlo_module.cc; 16s local ... 2025-03-14T06:31:42.1818199Z 2025-03-14T06:31:42.1819014Z  2025-03-14T06:31:42.1819428Z  2025-03-14T06:31:42.1819772Z  2025-03-14T06:31:42.1820095Z  2025-03-14T06:31:42.1820436Z  2025-03-14T06:31:42.1820799Z  2025-03-14T06:31:42.1821140Z  2025-03-14T06:31:42.1821470Z  2025-03-14T06:31:42.1822288Z [16,567 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:42.1823121Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2025-03-14T06:31:42.1823754Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T06:31:42.1824717Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 27s local 2025-03-14T06:31:42.1825402Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T06:31:42.1826061Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 19s local 2025-03-14T06:31:42.1826792Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 17s local 2025-03-14T06:31:42.1827478Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T06:31:42.1828200Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 9s local ... 2025-03-14T06:31:42.4487453Z 2025-03-14T06:31:42.4488297Z  2025-03-14T06:31:42.4488754Z  2025-03-14T06:31:42.4489098Z  2025-03-14T06:31:42.4489445Z  2025-03-14T06:31:42.4489808Z  2025-03-14T06:31:42.4490169Z  2025-03-14T06:31:42.4490506Z  2025-03-14T06:31:42.4490846Z  2025-03-14T06:31:42.4491644Z [16,568 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:42.4492572Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2025-03-14T06:31:42.4493320Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T06:31:42.4494149Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T06:31:42.4494827Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T06:31:42.4495510Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T06:31:42.4496345Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2025-03-14T06:31:42.4497057Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T06:31:42.4497786Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 9s local ... 2025-03-14T06:31:42.6625814Z 2025-03-14T06:31:42.6626631Z  2025-03-14T06:31:42.6627136Z  2025-03-14T06:31:42.6627567Z  2025-03-14T06:31:42.6628000Z  2025-03-14T06:31:42.6628698Z  2025-03-14T06:31:42.6629152Z  2025-03-14T06:31:42.6629571Z  2025-03-14T06:31:42.6629987Z  2025-03-14T06:31:42.6630976Z [16,570 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:42.6632007Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T06:31:42.6632981Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T06:31:42.6633872Z Compiling xla/hlo/ir/hlo_instructions.cc; 23s local 2025-03-14T06:31:42.6634723Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T06:31:42.6635639Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2025-03-14T06:31:42.6636710Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T06:31:42.6637513Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 9s local 2025-03-14T06:31:42.6638577Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local ... 2025-03-14T06:31:42.9825143Z 2025-03-14T06:31:42.9826038Z  2025-03-14T06:31:42.9826556Z  2025-03-14T06:31:42.9826991Z  2025-03-14T06:31:42.9827422Z  2025-03-14T06:31:42.9827872Z  2025-03-14T06:31:42.9828282Z  2025-03-14T06:31:42.9828694Z  2025-03-14T06:31:42.9829109Z  2025-03-14T06:31:42.9830068Z [16,573 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:42.9831147Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T06:31:42.9832357Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 28s local 2025-03-14T06:31:42.9833348Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T06:31:42.9834343Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 18s local 2025-03-14T06:31:42.9835231Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T06:31:42.9836078Z Compiling mlir/lib/IR/Dominance.cpp [for tool]; 10s local 2025-03-14T06:31:42.9837157Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local 2025-03-14T06:31:42.9838339Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 9s local ... 2025-03-14T06:31:43.3830913Z 2025-03-14T06:31:43.3831710Z  2025-03-14T06:31:43.3832200Z  2025-03-14T06:31:43.3832584Z  2025-03-14T06:31:43.3832978Z  2025-03-14T06:31:43.3833389Z  2025-03-14T06:31:43.3833811Z  2025-03-14T06:31:43.3834220Z  2025-03-14T06:31:43.3834611Z  2025-03-14T06:31:43.3835640Z [16,574 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:43.3836692Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T06:31:43.3837500Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T06:31:43.3838474Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 20s local 2025-03-14T06:31:43.3839417Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2025-03-14T06:31:43.3840267Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T06:31:43.3841238Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local 2025-03-14T06:31:43.3842361Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 9s local 2025-03-14T06:31:43.3843465Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local ... 2025-03-14T06:31:43.5835449Z 2025-03-14T06:31:43.5836371Z  2025-03-14T06:31:43.5836858Z  2025-03-14T06:31:43.5837269Z  2025-03-14T06:31:43.5837696Z  2025-03-14T06:31:43.5838148Z  2025-03-14T06:31:43.5838569Z  2025-03-14T06:31:43.5838986Z  2025-03-14T06:31:43.5839402Z  2025-03-14T06:31:43.5840393Z [16,579 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:43.5841479Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T06:31:43.5842375Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T06:31:43.5843575Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T06:31:43.5844583Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2025-03-14T06:31:43.5845432Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T06:31:43.5846357Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T06:31:43.5847459Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 9s local 2025-03-14T06:31:43.5848541Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local ... 2025-03-14T06:31:43.8700336Z 2025-03-14T06:31:43.8701130Z  2025-03-14T06:31:43.8701613Z  2025-03-14T06:31:43.8702044Z  2025-03-14T06:31:43.8702430Z  2025-03-14T06:31:43.8702843Z  2025-03-14T06:31:43.8703564Z  2025-03-14T06:31:43.8703942Z  2025-03-14T06:31:43.8704356Z  2025-03-14T06:31:43.8705354Z [16,584 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:43.8706624Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T06:31:43.8707585Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T06:31:43.8708509Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T06:31:43.8709402Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2025-03-14T06:31:43.8710239Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T06:31:43.8711159Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T06:31:43.8712595Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 9s local 2025-03-14T06:31:43.8713674Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 9s local ... 2025-03-14T06:31:44.1841184Z 2025-03-14T06:31:44.1842028Z  2025-03-14T06:31:44.1842521Z  2025-03-14T06:31:44.1842932Z  2025-03-14T06:31:44.1843342Z  2025-03-14T06:31:44.1843737Z  2025-03-14T06:31:44.1844140Z  2025-03-14T06:31:44.1844711Z  2025-03-14T06:31:44.1845273Z  2025-03-14T06:31:44.1846610Z [16,585 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:44.1847685Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T06:31:44.1848630Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 29s local 2025-03-14T06:31:44.1849623Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 21s local 2025-03-14T06:31:44.1850570Z Compiling mlir/lib/Dialect/Math/IR/MathDialect.cpp; 19s local 2025-03-14T06:31:44.1851448Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T06:31:44.1852390Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T06:31:44.1853528Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local 2025-03-14T06:31:44.1854626Z Compiling .../transforms/simplifiers/tuple_simplifier.cc; 10s local ... 2025-03-14T06:31:44.4397426Z 2025-03-14T06:31:44.4398307Z  2025-03-14T06:31:44.4398847Z  2025-03-14T06:31:44.4399259Z  2025-03-14T06:31:44.4399660Z  2025-03-14T06:31:44.4400074Z  2025-03-14T06:31:44.4400501Z  2025-03-14T06:31:44.4401041Z  2025-03-14T06:31:44.4401466Z  2025-03-14T06:31:44.4402439Z [16,586 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:44.4403451Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T06:31:44.4404235Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T06:31:44.4405327Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T06:31:44.4406110Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T06:31:44.4407061Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T06:31:44.4408204Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local 2025-03-14T06:31:44.4409314Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T06:31:44.4410688Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local ... 2025-03-14T06:31:44.7847391Z 2025-03-14T06:31:44.7848236Z  2025-03-14T06:31:44.7848782Z  2025-03-14T06:31:44.7849211Z  2025-03-14T06:31:44.7849625Z  2025-03-14T06:31:44.7850153Z  2025-03-14T06:31:44.7850558Z  2025-03-14T06:31:44.7850982Z  2025-03-14T06:31:44.7851378Z  2025-03-14T06:31:44.7852326Z [16,588 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:44.7853375Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T06:31:44.7854233Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T06:31:44.7855502Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T06:31:44.7856283Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T06:31:44.7857219Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 11s local 2025-03-14T06:31:44.7858327Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local 2025-03-14T06:31:44.7859395Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 10s local 2025-03-14T06:31:44.7860497Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local ... 2025-03-14T06:31:45.1295251Z 2025-03-14T06:31:45.1296090Z  2025-03-14T06:31:45.1296605Z  2025-03-14T06:31:45.1297015Z  2025-03-14T06:31:45.1297369Z  2025-03-14T06:31:45.1297807Z  2025-03-14T06:31:45.1298538Z  2025-03-14T06:31:45.1298973Z  2025-03-14T06:31:45.1299370Z  2025-03-14T06:31:45.1300360Z [16,590 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:45.1301374Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T06:31:45.1302297Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 30s local 2025-03-14T06:31:45.1303355Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T06:31:45.1304178Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T06:31:45.1305166Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T06:31:45.1306222Z Compiling xla/hlo/transforms/simplifiers/tuple_simplifier.cc; 11s local 2025-03-14T06:31:45.1307230Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2025-03-14T06:31:45.1308237Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 9s local ... 2025-03-14T06:31:45.3853627Z 2025-03-14T06:31:45.3854522Z  2025-03-14T06:31:45.3855040Z  2025-03-14T06:31:45.3855456Z  2025-03-14T06:31:45.3855865Z  2025-03-14T06:31:45.3856270Z  2025-03-14T06:31:45.3856686Z  2025-03-14T06:31:45.3857113Z  2025-03-14T06:31:45.3857557Z  2025-03-14T06:31:45.3858535Z [16,592 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:45.3859585Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T06:31:45.3860496Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T06:31:45.3861404Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 22s local 2025-03-14T06:31:45.3862244Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T06:31:45.3863027Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T06:31:45.3863950Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2025-03-14T06:31:45.3864851Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 9s local 2025-03-14T06:31:45.3866148Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local ... 2025-03-14T06:31:45.6198181Z 2025-03-14T06:31:45.6199025Z  2025-03-14T06:31:45.6199536Z  2025-03-14T06:31:45.6199970Z  2025-03-14T06:31:45.6200357Z  2025-03-14T06:31:45.6200729Z  2025-03-14T06:31:45.6201197Z  2025-03-14T06:31:45.6201598Z  2025-03-14T06:31:45.6201989Z  2025-03-14T06:31:45.6203282Z [16,593 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:45.6204637Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T06:31:45.6205449Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T06:31:45.6206356Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T06:31:45.6207177Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T06:31:45.6207957Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T06:31:45.6208917Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2025-03-14T06:31:45.6209829Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 9s local 2025-03-14T06:31:45.6210799Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 9s local ... 2025-03-14T06:31:45.9860411Z 2025-03-14T06:31:45.9861264Z  2025-03-14T06:31:45.9861753Z  2025-03-14T06:31:45.9862224Z  2025-03-14T06:31:45.9862604Z  2025-03-14T06:31:45.9862990Z  2025-03-14T06:31:45.9863404Z  2025-03-14T06:31:45.9863792Z  2025-03-14T06:31:45.9864167Z  2025-03-14T06:31:45.9865101Z [16,594 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:45.9866632Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T06:31:45.9867503Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T06:31:45.9868402Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T06:31:45.9869531Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T06:31:45.9870354Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 12s local 2025-03-14T06:31:45.9871338Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2025-03-14T06:31:45.9872308Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local 2025-03-14T06:31:45.9873372Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local ... 2025-03-14T06:31:46.2994776Z 2025-03-14T06:31:46.2995636Z  2025-03-14T06:31:46.2996301Z  2025-03-14T06:31:46.2996698Z  2025-03-14T06:31:46.2997078Z  2025-03-14T06:31:46.2997730Z  2025-03-14T06:31:46.2998162Z  2025-03-14T06:31:46.2998560Z  2025-03-14T06:31:46.2998928Z  2025-03-14T06:31:46.2999813Z [16,595 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:46.3000902Z @llvm-project//mlir:SparseTensorDialect; 42s local 2025-03-14T06:31:46.3001840Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 31s local 2025-03-14T06:31:46.3002771Z Compiling mlir/lib/Dialect/Math/IR/MathOps.cpp; 23s local 2025-03-14T06:31:46.3003601Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T06:31:46.3004649Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2025-03-14T06:31:46.3005573Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local 2025-03-14T06:31:46.3006519Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2025-03-14T06:31:46.3007376Z Compiling xla/service/call_graph.cc; 9s local ... 2025-03-14T06:31:46.5865896Z 2025-03-14T06:31:46.5866746Z  2025-03-14T06:31:46.5867213Z  2025-03-14T06:31:46.5867614Z  2025-03-14T06:31:46.5868012Z  2025-03-14T06:31:46.5868416Z  2025-03-14T06:31:46.5868817Z  2025-03-14T06:31:46.5869210Z  2025-03-14T06:31:46.5869604Z  2025-03-14T06:31:46.5870570Z [16,598 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:46.5871608Z @llvm-project//mlir:SparseTensorDialect; 42s local 2025-03-14T06:31:46.5872462Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T06:31:46.5873301Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T06:31:46.5874099Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2025-03-14T06:31:46.5875053Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 10s local 2025-03-14T06:31:46.5876423Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local 2025-03-14T06:31:46.5877315Z Compiling xla/service/call_graph.cc; 10s local 2025-03-14T06:31:46.5878141Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local ... 2025-03-14T06:31:47.2829172Z 2025-03-14T06:31:47.2830024Z  2025-03-14T06:31:47.2830466Z  2025-03-14T06:31:47.2830847Z  2025-03-14T06:31:47.2831226Z  2025-03-14T06:31:47.2831631Z  2025-03-14T06:31:47.2831981Z  2025-03-14T06:31:47.2832363Z  2025-03-14T06:31:47.2832745Z  2025-03-14T06:31:47.2833639Z [16,599 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:47.2834896Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T06:31:47.2835663Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 32s local 2025-03-14T06:31:47.2836386Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T06:31:47.2837125Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2025-03-14T06:31:47.2837958Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T06:31:47.2838805Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T06:31:47.2839553Z Compiling xla/service/call_graph.cc; 10s local 2025-03-14T06:31:47.2840323Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 10s local ... 2025-03-14T06:31:47.5567529Z 2025-03-14T06:31:47.5568415Z  2025-03-14T06:31:47.5568961Z  2025-03-14T06:31:47.5569683Z  2025-03-14T06:31:47.5570121Z  2025-03-14T06:31:47.5570530Z  2025-03-14T06:31:47.5570884Z  2025-03-14T06:31:47.5571231Z  2025-03-14T06:31:47.5571592Z  2025-03-14T06:31:47.5572417Z [16,601 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:47.5573309Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T06:31:47.5574095Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T06:31:47.5574820Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T06:31:47.5575691Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2025-03-14T06:31:47.5576532Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 11s local 2025-03-14T06:31:47.5577390Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T06:31:47.5578121Z Compiling xla/service/call_graph.cc; 11s local 2025-03-14T06:31:47.5578822Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local ... 2025-03-14T06:31:47.7870195Z 2025-03-14T06:31:47.7871364Z  2025-03-14T06:31:47.7871897Z  2025-03-14T06:31:47.7872345Z  2025-03-14T06:31:47.7872795Z  2025-03-14T06:31:47.7873277Z  2025-03-14T06:31:47.7873724Z  2025-03-14T06:31:47.7874075Z  2025-03-14T06:31:47.7874440Z  2025-03-14T06:31:47.7875370Z [16,604 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:47.7876421Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T06:31:47.7877492Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T06:31:47.7878343Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2025-03-14T06:31:47.7879128Z Compiling xla/hlo/transforms/simplifiers/hlo_dce.cc; 12s local 2025-03-14T06:31:47.7880031Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T06:31:47.7880926Z Compiling xla/service/call_graph.cc; 11s local 2025-03-14T06:31:47.7881805Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T06:31:47.7882681Z @llvm-project//mlir:SparseTensorDialect; 11s local ... 2025-03-14T06:31:48.1875867Z 2025-03-14T06:31:48.1876803Z  2025-03-14T06:31:48.1877360Z  2025-03-14T06:31:48.1877797Z  2025-03-14T06:31:48.1878201Z  2025-03-14T06:31:48.1878520Z  2025-03-14T06:31:48.1878833Z  2025-03-14T06:31:48.1879648Z  2025-03-14T06:31:48.1880098Z  2025-03-14T06:31:48.1880983Z [16,605 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:48.1881793Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T06:31:48.1882513Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 33s local 2025-03-14T06:31:48.1883290Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2025-03-14T06:31:48.1884088Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T06:31:48.1884939Z Compiling xla/service/call_graph.cc; 11s local 2025-03-14T06:31:48.1885802Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 11s local 2025-03-14T06:31:48.1886853Z @llvm-project//mlir:SparseTensorDialect; 11s local 2025-03-14T06:31:48.1887622Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local ... 2025-03-14T06:31:48.4276812Z 2025-03-14T06:31:48.4277665Z  2025-03-14T06:31:48.4278187Z  2025-03-14T06:31:48.4278537Z  2025-03-14T06:31:48.4278867Z  2025-03-14T06:31:48.4279309Z  2025-03-14T06:31:48.4279766Z  2025-03-14T06:31:48.4280196Z  2025-03-14T06:31:48.4280533Z  2025-03-14T06:31:48.4281431Z [16,608 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:48.4282495Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T06:31:48.4283413Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2025-03-14T06:31:48.4284746Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T06:31:48.4285588Z Compiling xla/service/call_graph.cc; 12s local 2025-03-14T06:31:48.4286434Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T06:31:48.4287941Z @llvm-project//mlir:SparseTensorDialect; 11s local 2025-03-14T06:31:48.4288856Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 10s local 2025-03-14T06:31:48.4289779Z Compiling xla/service/call_graph.cc; 10s local ... 2025-03-14T06:31:48.6945110Z 2025-03-14T06:31:48.6946306Z  2025-03-14T06:31:48.6946840Z  2025-03-14T06:31:48.6947606Z  2025-03-14T06:31:48.6948052Z  2025-03-14T06:31:48.6948441Z  2025-03-14T06:31:48.6948833Z  2025-03-14T06:31:48.6949241Z  2025-03-14T06:31:48.6949680Z  2025-03-14T06:31:48.6950643Z [16,610 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:48.6951775Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T06:31:48.6952718Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2025-03-14T06:31:48.6953662Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T06:31:48.6954562Z Compiling xla/service/call_graph.cc; 12s local 2025-03-14T06:31:48.6955466Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T06:31:48.6956395Z @llvm-project//mlir:SparseTensorDialect; 12s local 2025-03-14T06:31:48.6957272Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T06:31:48.6958172Z Compiling xla/service/call_graph.cc; 10s local ... 2025-03-14T06:31:48.9883160Z 2025-03-14T06:31:48.9884104Z  2025-03-14T06:31:48.9884730Z  2025-03-14T06:31:48.9885177Z  2025-03-14T06:31:48.9885619Z  2025-03-14T06:31:48.9886031Z  2025-03-14T06:31:48.9886470Z  2025-03-14T06:31:48.9886887Z  2025-03-14T06:31:48.9887284Z  2025-03-14T06:31:48.9888225Z [16,610 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:48.9889236Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T06:31:48.9890170Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2025-03-14T06:31:48.9891073Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T06:31:48.9891923Z Compiling xla/service/call_graph.cc; 12s local 2025-03-14T06:31:48.9893045Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T06:31:48.9893947Z @llvm-project//mlir:SparseTensorDialect; 12s local 2025-03-14T06:31:48.9894808Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T06:31:48.9895610Z Compiling xla/service/call_graph.cc; 11s local ... 2025-03-14T06:31:49.2214749Z 2025-03-14T06:31:49.2216041Z  2025-03-14T06:31:49.2216941Z  2025-03-14T06:31:49.2217599Z  2025-03-14T06:31:49.2219535Z  2025-03-14T06:31:49.2220139Z  2025-03-14T06:31:49.2220775Z  2025-03-14T06:31:49.2336963Z  2025-03-14T06:31:49.2337424Z  2025-03-14T06:31:49.2338395Z [16,612 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:49.2339690Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 34s local 2025-03-14T06:31:49.2340604Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T06:31:49.2341553Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T06:31:49.2342314Z Compiling xla/service/call_graph.cc; 12s local 2025-03-14T06:31:49.2343143Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 12s local 2025-03-14T06:31:49.2343982Z @llvm-project//mlir:SparseTensorDialect; 12s local 2025-03-14T06:31:49.2344800Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T06:31:49.2345624Z Compiling xla/service/call_graph.cc; 11s local ... 2025-03-14T06:31:49.4229141Z 2025-03-14T06:31:49.4230018Z  2025-03-14T06:31:49.4230457Z  2025-03-14T06:31:49.4230833Z  2025-03-14T06:31:49.4231209Z  2025-03-14T06:31:49.4231589Z  2025-03-14T06:31:49.4231960Z  2025-03-14T06:31:49.4232410Z  2025-03-14T06:31:49.4232773Z  2025-03-14T06:31:49.4233615Z [16,613 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:49.4234632Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T06:31:49.4235459Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T06:31:49.4236600Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T06:31:49.4237384Z Compiling xla/service/call_graph.cc; 13s local 2025-03-14T06:31:49.4238215Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T06:31:49.4239061Z @llvm-project//mlir:SparseTensorDialect; 12s local 2025-03-14T06:31:49.4249820Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 11s local 2025-03-14T06:31:49.4250645Z Compiling xla/service/call_graph.cc; 11s local ... 2025-03-14T06:31:49.7800144Z 2025-03-14T06:31:49.7800969Z  2025-03-14T06:31:49.7801480Z  2025-03-14T06:31:49.7801893Z  2025-03-14T06:31:49.7802305Z  2025-03-14T06:31:49.7802733Z  2025-03-14T06:31:49.7803148Z  2025-03-14T06:31:49.7803510Z  2025-03-14T06:31:49.7803921Z  2025-03-14T06:31:49.7805110Z [16,615 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:49.7806130Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T06:31:49.7807036Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T06:31:49.7807974Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T06:31:49.7808827Z Compiling xla/service/call_graph.cc; 13s local 2025-03-14T06:31:49.7809657Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T06:31:49.7810657Z @llvm-project//mlir:SparseTensorDialect; 13s local 2025-03-14T06:31:49.7811489Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T06:31:49.7812346Z Compiling xla/service/call_graph.cc; 11s local ... 2025-03-14T06:31:49.9891633Z 2025-03-14T06:31:49.9892531Z  2025-03-14T06:31:49.9893053Z  2025-03-14T06:31:49.9893461Z  2025-03-14T06:31:49.9893880Z  2025-03-14T06:31:49.9894304Z  2025-03-14T06:31:49.9894988Z  2025-03-14T06:31:49.9895420Z  2025-03-14T06:31:49.9895843Z  2025-03-14T06:31:49.9896860Z [16,615 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:49.9898013Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T06:31:49.9898971Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T06:31:49.9899939Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T06:31:49.9900850Z Compiling xla/service/call_graph.cc; 13s local 2025-03-14T06:31:49.9901774Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T06:31:49.9902711Z @llvm-project//mlir:SparseTensorDialect; 13s local 2025-03-14T06:31:49.9903861Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T06:31:49.9904705Z Compiling xla/service/call_graph.cc; 12s local ... 2025-03-14T06:31:50.3003334Z 2025-03-14T06:31:50.3004219Z  2025-03-14T06:31:50.3004889Z  2025-03-14T06:31:50.3005325Z  2025-03-14T06:31:50.3005773Z  2025-03-14T06:31:50.3006183Z  2025-03-14T06:31:50.3006608Z  2025-03-14T06:31:50.3007041Z  2025-03-14T06:31:50.3007480Z  2025-03-14T06:31:50.3008475Z [16,616 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:50.3009643Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 35s local 2025-03-14T06:31:50.3010857Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T06:31:50.3011802Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T06:31:50.3012709Z Compiling xla/service/call_graph.cc; 13s local 2025-03-14T06:31:50.3013632Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 13s local 2025-03-14T06:31:50.3014556Z @llvm-project//mlir:SparseTensorDialect; 13s local 2025-03-14T06:31:50.3015451Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T06:31:50.3016331Z Compiling xla/service/call_graph.cc; 12s local ... 2025-03-14T06:31:50.5896671Z 2025-03-14T06:31:50.5898731Z  2025-03-14T06:31:50.5899444Z  2025-03-14T06:31:50.5899848Z  2025-03-14T06:31:50.5900229Z  2025-03-14T06:31:50.5900611Z  2025-03-14T06:31:50.5900974Z  2025-03-14T06:31:50.5901336Z  2025-03-14T06:31:50.5901700Z  2025-03-14T06:31:50.5902601Z [16,618 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:50.5903620Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:50.5904480Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T06:31:50.5905504Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T06:31:50.5906324Z Compiling xla/service/call_graph.cc; 14s local 2025-03-14T06:31:50.5907201Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T06:31:50.5908139Z @llvm-project//mlir:SparseTensorDialect; 13s local 2025-03-14T06:31:50.5909013Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 12s local 2025-03-14T06:31:50.5909915Z Compiling xla/service/call_graph.cc; 12s local ... 2025-03-14T06:31:50.7900447Z 2025-03-14T06:31:50.7901321Z  2025-03-14T06:31:50.7901849Z  2025-03-14T06:31:50.7902281Z  2025-03-14T06:31:50.7902708Z  2025-03-14T06:31:50.7903154Z  2025-03-14T06:31:50.7903586Z  2025-03-14T06:31:50.7904067Z  2025-03-14T06:31:50.7904521Z  2025-03-14T06:31:50.7905512Z [16,620 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:50.7906629Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:50.7907537Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T06:31:50.7908509Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T06:31:50.7909595Z Compiling xla/service/call_graph.cc; 14s local 2025-03-14T06:31:50.7910502Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T06:31:50.7911423Z @llvm-project//mlir:SparseTensorDialect; 14s local 2025-03-14T06:31:50.7912289Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:31:50.7913143Z Compiling xla/service/call_graph.cc; 12s local ... 2025-03-14T06:31:51.0559552Z 2025-03-14T06:31:51.0560381Z  2025-03-14T06:31:51.0560877Z  2025-03-14T06:31:51.0561308Z  2025-03-14T06:31:51.0561703Z  2025-03-14T06:31:51.0562086Z  2025-03-14T06:31:51.0562484Z  2025-03-14T06:31:51.0562879Z  2025-03-14T06:31:51.0563256Z  2025-03-14T06:31:51.0564593Z [16,622 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:51.0565865Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:51.0566879Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T06:31:51.0567725Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T06:31:51.0568581Z Compiling xla/service/call_graph.cc; 14s local 2025-03-14T06:31:51.0569392Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T06:31:51.0570194Z @llvm-project//mlir:SparseTensorDialect; 14s local 2025-03-14T06:31:51.0570993Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:31:51.0571810Z Compiling xla/service/call_graph.cc; 13s local ... 2025-03-14T06:31:51.3119418Z 2025-03-14T06:31:51.3120282Z  2025-03-14T06:31:51.3120788Z  2025-03-14T06:31:51.3121206Z  2025-03-14T06:31:51.3121606Z  2025-03-14T06:31:51.3122038Z  2025-03-14T06:31:51.3122441Z  2025-03-14T06:31:51.3123039Z  2025-03-14T06:31:51.3123443Z  2025-03-14T06:31:51.3124518Z [16,625 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:51.3125620Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 36s local 2025-03-14T06:31:51.3126815Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T06:31:51.3127755Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T06:31:51.3128578Z Compiling xla/service/call_graph.cc; 14s local 2025-03-14T06:31:51.3129412Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 14s local 2025-03-14T06:31:51.3130280Z @llvm-project//mlir:SparseTensorDialect; 14s local 2025-03-14T06:31:51.3131100Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:31:51.3131929Z Compiling xla/service/call_graph.cc; 13s local ... 2025-03-14T06:31:51.5907958Z 2025-03-14T06:31:51.5908812Z  2025-03-14T06:31:51.5909307Z  2025-03-14T06:31:51.5909709Z  2025-03-14T06:31:51.5910142Z  2025-03-14T06:31:51.5910565Z  2025-03-14T06:31:51.5910976Z  2025-03-14T06:31:51.5911388Z  2025-03-14T06:31:51.5911811Z  2025-03-14T06:31:51.5912794Z [16,626 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:51.5913949Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T06:31:51.5914902Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T06:31:51.5915894Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T06:31:51.5916707Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T06:31:51.5917521Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T06:31:51.5918366Z @llvm-project//mlir:SparseTensorDialect; 14s local 2025-03-14T06:31:51.5919239Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 13s local 2025-03-14T06:31:51.5920047Z Compiling xla/service/call_graph.cc; 13s local ... 2025-03-14T06:31:51.7911976Z 2025-03-14T06:31:51.7912831Z  2025-03-14T06:31:51.7913447Z  2025-03-14T06:31:51.7913862Z  2025-03-14T06:31:51.7914522Z  2025-03-14T06:31:51.7914914Z  2025-03-14T06:31:51.7915293Z  2025-03-14T06:31:51.7915679Z  2025-03-14T06:31:51.7916057Z  2025-03-14T06:31:51.7916943Z [16,627 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:51.7917932Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T06:31:51.7918828Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T06:31:51.7919760Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T06:31:51.7920625Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T06:31:51.7921435Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T06:31:51.7922533Z @llvm-project//mlir:SparseTensorDialect; 15s local 2025-03-14T06:31:51.7923382Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:31:51.7924330Z Compiling xla/service/call_graph.cc; 13s local ... 2025-03-14T06:31:52.1866238Z 2025-03-14T06:31:52.1867085Z  2025-03-14T06:31:52.1867523Z  2025-03-14T06:31:52.1867938Z  2025-03-14T06:31:52.1868339Z  2025-03-14T06:31:52.1868748Z  2025-03-14T06:31:52.1869152Z  2025-03-14T06:31:52.1869569Z  2025-03-14T06:31:52.1869973Z  2025-03-14T06:31:52.1871001Z [16,628 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:52.1872163Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 37s local 2025-03-14T06:31:52.1873404Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T06:31:52.1874354Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T06:31:52.1875237Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T06:31:52.1876129Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 15s local 2025-03-14T06:31:52.1877049Z @llvm-project//mlir:SparseTensorDialect; 15s local 2025-03-14T06:31:52.1877944Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:31:52.1879554Z Compiling xla/service/call_graph.cc; 14s local ... 2025-03-14T06:31:52.3918276Z 2025-03-14T06:31:52.3919110Z  2025-03-14T06:31:52.3919603Z  2025-03-14T06:31:52.3920010Z  2025-03-14T06:31:52.3920426Z  2025-03-14T06:31:52.3920831Z  2025-03-14T06:31:52.3921229Z  2025-03-14T06:31:52.3921602Z  2025-03-14T06:31:52.3921991Z  2025-03-14T06:31:52.3922934Z [16,628 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:52.3924224Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T06:31:52.3925200Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T06:31:52.3926186Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T06:31:52.3927002Z Compiling xla/service/call_graph.cc; 16s local 2025-03-14T06:31:52.3927872Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T06:31:52.3928791Z @llvm-project//mlir:SparseTensorDialect; 15s local 2025-03-14T06:31:52.3929689Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:31:52.3930583Z Compiling xla/service/call_graph.cc; 14s local ... 2025-03-14T06:31:52.5921787Z 2025-03-14T06:31:52.5922685Z  2025-03-14T06:31:52.5923194Z  2025-03-14T06:31:52.5923627Z  2025-03-14T06:31:52.5924191Z  2025-03-14T06:31:52.5924550Z  2025-03-14T06:31:52.5924985Z  2025-03-14T06:31:52.5925387Z  2025-03-14T06:31:52.5925783Z  2025-03-14T06:31:52.5926712Z [16,629 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:52.5927873Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T06:31:52.5928852Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T06:31:52.5930101Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T06:31:52.5930991Z Compiling xla/service/call_graph.cc; 16s local 2025-03-14T06:31:52.5931879Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T06:31:52.5932784Z @llvm-project//mlir:SparseTensorDialect; 15s local 2025-03-14T06:31:52.5933663Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 14s local 2025-03-14T06:31:52.5934542Z Compiling xla/service/call_graph.cc; 14s local ... 2025-03-14T06:31:52.9891056Z 2025-03-14T06:31:52.9891889Z  2025-03-14T06:31:52.9892448Z  2025-03-14T06:31:52.9892841Z  2025-03-14T06:31:52.9893230Z  2025-03-14T06:31:52.9893626Z  2025-03-14T06:31:52.9894040Z  2025-03-14T06:31:52.9894421Z  2025-03-14T06:31:52.9895082Z  2025-03-14T06:31:52.9896074Z [16,630 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:52.9897060Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T06:31:52.9897922Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T06:31:52.9898813Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T06:31:52.9899673Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T06:31:52.9900484Z @llvm-project//mlir:SparseTensorDialect; 16s local 2025-03-14T06:31:52.9901245Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T06:31:52.9901958Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T06:31:52.9902842Z Compiling xla/hlo/ir/hlo_module.cc; 11s local ... 2025-03-14T06:31:53.1932158Z 2025-03-14T06:31:53.1933005Z  2025-03-14T06:31:53.1933488Z  2025-03-14T06:31:53.1933902Z  2025-03-14T06:31:53.1934349Z  2025-03-14T06:31:53.1934752Z  2025-03-14T06:31:53.1935126Z  2025-03-14T06:31:53.1935515Z  2025-03-14T06:31:53.1935910Z  2025-03-14T06:31:53.1936841Z [16,631 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:53.1937898Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 38s local 2025-03-14T06:31:53.1939001Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2025-03-14T06:31:53.1939925Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T06:31:53.1940835Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 16s local 2025-03-14T06:31:53.1941680Z @llvm-project//mlir:SparseTensorDialect; 16s local 2025-03-14T06:31:53.1942500Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T06:31:53.1943269Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T06:31:53.1943996Z Compiling xla/hlo/ir/hlo_module.cc; 12s local ... 2025-03-14T06:31:53.3935513Z 2025-03-14T06:31:53.3936322Z  2025-03-14T06:31:53.3936813Z  2025-03-14T06:31:53.3937219Z  2025-03-14T06:31:53.3937598Z  2025-03-14T06:31:53.3937991Z  2025-03-14T06:31:53.3938413Z  2025-03-14T06:31:53.3938832Z  2025-03-14T06:31:53.3939239Z  2025-03-14T06:31:53.3940276Z [16,633 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:53.3941457Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 39s local 2025-03-14T06:31:53.3942474Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2025-03-14T06:31:53.3943459Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T06:31:53.3944439Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T06:31:53.3945357Z @llvm-project//mlir:SparseTensorDialect; 16s local 2025-03-14T06:31:53.3946229Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 15s local 2025-03-14T06:31:53.3947123Z Compiling xla/service/call_graph.cc; 15s local 2025-03-14T06:31:53.3947916Z Compiling xla/hlo/ir/hlo_module.cc; 12s local ... 2025-03-14T06:31:54.3280507Z 2025-03-14T06:31:54.3281332Z  2025-03-14T06:31:54.3281832Z  2025-03-14T06:31:54.3282526Z  2025-03-14T06:31:54.3282891Z  2025-03-14T06:31:54.3283246Z  2025-03-14T06:31:54.3283624Z  2025-03-14T06:31:54.3284160Z  2025-03-14T06:31:54.3284562Z  2025-03-14T06:31:54.3285460Z [16,634 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:54.3286488Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T06:31:54.3287500Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T06:31:54.3288499Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T06:31:54.3289504Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 17s local 2025-03-14T06:31:54.3290613Z @llvm-project//mlir:SparseTensorDialect; 17s local 2025-03-14T06:31:54.3291503Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T06:31:54.3292321Z Compiling xla/service/call_graph.cc; 16s local 2025-03-14T06:31:54.3293077Z Compiling xla/hlo/ir/hlo_module.cc; 13s local ... 2025-03-14T06:31:54.5943928Z 2025-03-14T06:31:54.5944806Z  2025-03-14T06:31:54.5945289Z  2025-03-14T06:31:54.5945687Z  2025-03-14T06:31:54.5946031Z  2025-03-14T06:31:54.5946385Z  2025-03-14T06:31:54.5946754Z  2025-03-14T06:31:54.5947100Z  2025-03-14T06:31:54.5947463Z  2025-03-14T06:31:54.5948343Z [16,637 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:54.5949610Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T06:31:54.5950450Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T06:31:54.5951274Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T06:31:54.5952192Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T06:31:54.5953053Z @llvm-project//mlir:SparseTensorDialect; 17s local 2025-03-14T06:31:54.5954038Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 16s local 2025-03-14T06:31:54.5954836Z Compiling xla/hlo/ir/hlo_module.cc; 13s local 2025-03-14T06:31:54.5955802Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local ... 2025-03-14T06:31:54.8683250Z 2025-03-14T06:31:54.8684251Z  2025-03-14T06:31:54.8684771Z  2025-03-14T06:31:54.8685168Z  2025-03-14T06:31:54.8685532Z  2025-03-14T06:31:54.8685929Z  2025-03-14T06:31:54.8686335Z  2025-03-14T06:31:54.8686685Z  2025-03-14T06:31:54.8687108Z  2025-03-14T06:31:54.8688038Z [16,639 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:54.8689080Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T06:31:54.8690030Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T06:31:54.8690958Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T06:31:54.8691855Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T06:31:54.8692674Z @llvm-project//mlir:SparseTensorDialect; 18s local 2025-03-14T06:31:54.8693468Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T06:31:54.8694223Z Compiling xla/hlo/ir/hlo_module.cc; 13s local 2025-03-14T06:31:54.8694920Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local ... 2025-03-14T06:31:55.1949517Z 2025-03-14T06:31:55.1950394Z  2025-03-14T06:31:55.1950902Z  2025-03-14T06:31:55.1951322Z  2025-03-14T06:31:55.1951784Z  2025-03-14T06:31:55.1952208Z  2025-03-14T06:31:55.1952624Z  2025-03-14T06:31:55.1953062Z  2025-03-14T06:31:55.1953503Z  2025-03-14T06:31:55.1954496Z [16,639 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:55.1955721Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 40s local 2025-03-14T06:31:55.1956719Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T06:31:55.1957944Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T06:31:55.1958928Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 18s local 2025-03-14T06:31:55.1959941Z @llvm-project//mlir:SparseTensorDialect; 18s local 2025-03-14T06:31:55.1960751Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T06:31:55.1961570Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T06:31:55.1962353Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local ... 2025-03-14T06:31:55.3953885Z 2025-03-14T06:31:55.3954762Z  2025-03-14T06:31:55.3955210Z  2025-03-14T06:31:55.3955623Z  2025-03-14T06:31:55.3956025Z  2025-03-14T06:31:55.3956439Z  2025-03-14T06:31:55.3957135Z  2025-03-14T06:31:55.3957532Z  2025-03-14T06:31:55.3957933Z  2025-03-14T06:31:55.3958933Z [16,640 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:31:55.3960037Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T06:31:55.3960912Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T06:31:55.3961863Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T06:31:55.3962782Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T06:31:55.3963654Z @llvm-project//mlir:SparseTensorDialect; 18s local 2025-03-14T06:31:55.3964621Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 17s local 2025-03-14T06:31:55.3965881Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T06:31:55.3966655Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local ... 2025-03-14T06:31:55.6645878Z 2025-03-14T06:31:55.6646733Z  2025-03-14T06:31:55.6647258Z  2025-03-14T06:31:55.6647659Z  2025-03-14T06:31:55.6648065Z  2025-03-14T06:31:55.6648449Z  2025-03-14T06:31:55.6648827Z  2025-03-14T06:31:55.6649230Z  2025-03-14T06:31:55.6649735Z  2025-03-14T06:31:55.6650728Z [16,642 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:55.6652024Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T06:31:55.6652853Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T06:31:55.6653777Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T06:31:55.6654716Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T06:31:55.6655583Z @llvm-project//mlir:SparseTensorDialect; 19s local 2025-03-14T06:31:55.6656386Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2025-03-14T06:31:55.6657149Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T06:31:55.6658025Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local ... 2025-03-14T06:31:55.9959588Z 2025-03-14T06:31:55.9960440Z  2025-03-14T06:31:55.9960903Z  2025-03-14T06:31:55.9961305Z  2025-03-14T06:31:55.9961697Z  2025-03-14T06:31:55.9962103Z  2025-03-14T06:31:55.9962489Z  2025-03-14T06:31:55.9962872Z  2025-03-14T06:31:55.9963259Z  2025-03-14T06:31:55.9964354Z [16,644 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:55.9965603Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T06:31:55.9966513Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T06:31:55.9967402Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T06:31:55.9968334Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T06:31:55.9969167Z @llvm-project//mlir:SparseTensorDialect; 19s local 2025-03-14T06:31:55.9969976Z Compiling llvm/lib/Analysis/ValueTracking.cpp; 18s local 2025-03-14T06:31:55.9970740Z Compiling xla/hlo/ir/hlo_module.cc; 14s local 2025-03-14T06:31:55.9971492Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local ... 2025-03-14T06:31:56.1964511Z 2025-03-14T06:31:56.1965854Z  2025-03-14T06:31:56.1966495Z  2025-03-14T06:31:56.1966939Z  2025-03-14T06:31:56.1967377Z  2025-03-14T06:31:56.1967801Z  2025-03-14T06:31:56.1968235Z  2025-03-14T06:31:56.1968612Z  2025-03-14T06:31:56.1968984Z  2025-03-14T06:31:56.1969975Z [16,647 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:56.1971154Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 41s local 2025-03-14T06:31:56.1972191Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:31:56.1973223Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T06:31:56.1974279Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 19s local 2025-03-14T06:31:56.1975432Z @llvm-project//mlir:SparseTensorDialect; 19s local 2025-03-14T06:31:56.1976229Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2025-03-14T06:31:56.1977011Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T06:31:56.1977792Z Compiling xla/hlo/builder/xla_builder.cc; 14s local ... 2025-03-14T06:31:56.5164136Z 2025-03-14T06:31:56.5165015Z  2025-03-14T06:31:56.5165716Z  2025-03-14T06:31:56.5166096Z  2025-03-14T06:31:56.5166454Z  2025-03-14T06:31:56.5166828Z  2025-03-14T06:31:56.5167192Z  2025-03-14T06:31:56.5167556Z  2025-03-14T06:31:56.5167910Z  2025-03-14T06:31:56.5168811Z [16,648 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:56.5170106Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2025-03-14T06:31:56.5170996Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:31:56.5171892Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T06:31:56.5172782Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T06:31:56.5173619Z @llvm-project//mlir:SparseTensorDialect; 19s local 2025-03-14T06:31:56.5174328Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2025-03-14T06:31:56.5175201Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T06:31:56.5176004Z Compiling xla/hlo/builder/xla_builder.cc; 14s local ... 2025-03-14T06:31:56.7967524Z 2025-03-14T06:31:56.7968486Z  2025-03-14T06:31:56.7969022Z  2025-03-14T06:31:56.7969470Z  2025-03-14T06:31:56.7969921Z  2025-03-14T06:31:56.7970366Z  2025-03-14T06:31:56.7970780Z  2025-03-14T06:31:56.7971207Z  2025-03-14T06:31:56.7971605Z  2025-03-14T06:31:56.7972572Z [16,649 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:56.7973705Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2025-03-14T06:31:56.7974706Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:31:56.7975707Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T06:31:56.7976681Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T06:31:56.7977592Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T06:31:56.7978385Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2025-03-14T06:31:56.7979889Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T06:31:56.7980762Z Compiling xla/hlo/builder/xla_builder.cc; 14s local ... 2025-03-14T06:31:56.9973228Z 2025-03-14T06:31:56.9975037Z  2025-03-14T06:31:56.9975604Z  2025-03-14T06:31:56.9976084Z  2025-03-14T06:31:56.9976435Z  2025-03-14T06:31:56.9976828Z  2025-03-14T06:31:56.9977222Z  2025-03-14T06:31:56.9977624Z  2025-03-14T06:31:56.9978032Z  2025-03-14T06:31:56.9979006Z [16,650 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:56.9980798Z Compiling mlir/lib/Dialect/Arith/IR/ArithOps.cpp; 42s local 2025-03-14T06:31:56.9981944Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:31:56.9982899Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T06:31:56.9983932Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T06:31:56.9984829Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T06:31:56.9985715Z Compiling xla/hlo/ir/hlo_module.cc; 15s local 2025-03-14T06:31:56.9986396Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T06:31:56.9987244Z Compiling xla/hlo/builder/xla_builder.cc; 15s local ... 2025-03-14T06:31:57.2350945Z 2025-03-14T06:31:57.2351903Z  2025-03-14T06:31:57.2352432Z  2025-03-14T06:31:57.2352869Z  2025-03-14T06:31:57.2353298Z  2025-03-14T06:31:57.2354030Z  2025-03-14T06:31:57.2354442Z  2025-03-14T06:31:57.2354830Z  2025-03-14T06:31:57.2355196Z  2025-03-14T06:31:57.2356106Z [16,652 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:57.2357185Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T06:31:57.2358167Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T06:31:57.2359088Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 20s local 2025-03-14T06:31:57.2359973Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T06:31:57.2360714Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T06:31:57.2361485Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T06:31:57.2362485Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2025-03-14T06:31:57.2363350Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 12s local ... 2025-03-14T06:31:57.5977548Z 2025-03-14T06:31:57.5978525Z  2025-03-14T06:31:57.5979069Z  2025-03-14T06:31:57.5980272Z  2025-03-14T06:31:57.5980800Z  2025-03-14T06:31:57.5981224Z  2025-03-14T06:31:57.5981652Z  2025-03-14T06:31:57.5982071Z  2025-03-14T06:31:57.5982516Z  2025-03-14T06:31:57.5983519Z [16,653 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:57.5984933Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T06:31:57.5985911Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T06:31:57.5986845Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T06:31:57.5987651Z @llvm-project//mlir:SparseTensorDialect; 20s local 2025-03-14T06:31:57.5988474Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T06:31:57.5989294Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T06:31:57.5990136Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2025-03-14T06:31:57.5991046Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local ... 2025-03-14T06:31:57.7980734Z 2025-03-14T06:31:57.7981838Z  2025-03-14T06:31:57.7982366Z  2025-03-14T06:31:57.7982808Z  2025-03-14T06:31:57.7983298Z  2025-03-14T06:31:57.7983735Z  2025-03-14T06:31:57.7984111Z  2025-03-14T06:31:57.7984493Z  2025-03-14T06:31:57.7984930Z  2025-03-14T06:31:57.7985824Z [16,655 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:57.7986896Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T06:31:57.7987863Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T06:31:57.7988782Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T06:31:57.7989659Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T06:31:57.7990430Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T06:31:57.7991239Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T06:31:57.7992083Z Compiling xla/hlo/builder/xla_builder.cc; 15s local 2025-03-14T06:31:57.7992978Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local ... 2025-03-14T06:31:58.0801914Z 2025-03-14T06:31:58.0802876Z  2025-03-14T06:31:58.0803441Z  2025-03-14T06:31:58.0803894Z  2025-03-14T06:31:58.0804527Z  2025-03-14T06:31:58.0804909Z  2025-03-14T06:31:58.0805300Z  2025-03-14T06:31:58.0805675Z  2025-03-14T06:31:58.0806044Z  2025-03-14T06:31:58.0806953Z [16,657 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:58.0808028Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T06:31:58.0808969Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T06:31:58.0809876Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 21s local 2025-03-14T06:31:58.0810924Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T06:31:58.0811659Z Compiling xla/hlo/ir/hlo_module.cc; 16s local 2025-03-14T06:31:58.0812370Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T06:31:58.0813089Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2025-03-14T06:31:58.0813776Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local ... 2025-03-14T06:31:58.3987589Z 2025-03-14T06:31:58.3988492Z  2025-03-14T06:31:58.3989033Z  2025-03-14T06:31:58.3989494Z  2025-03-14T06:31:58.3989935Z  2025-03-14T06:31:58.3990359Z  2025-03-14T06:31:58.3990818Z  2025-03-14T06:31:58.3991244Z  2025-03-14T06:31:58.3991613Z  2025-03-14T06:31:58.3992543Z [16,657 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:58.3993841Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T06:31:58.3994806Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T06:31:58.3995740Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T06:31:58.3996576Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T06:31:58.3997313Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T06:31:58.3998015Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T06:31:58.3999075Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2025-03-14T06:31:58.3999959Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 13s local ... 2025-03-14T06:31:58.5991462Z 2025-03-14T06:31:58.5992428Z  2025-03-14T06:31:58.5992987Z  2025-03-14T06:31:58.5993445Z  2025-03-14T06:31:58.5993900Z  2025-03-14T06:31:58.5994327Z  2025-03-14T06:31:58.5994753Z  2025-03-14T06:31:58.5995160Z  2025-03-14T06:31:58.5995563Z  2025-03-14T06:31:58.5996509Z [16,659 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:58.5997644Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T06:31:58.5998620Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T06:31:58.5999626Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T06:31:58.6000560Z @llvm-project//mlir:SparseTensorDialect; 21s local 2025-03-14T06:31:58.6001317Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T06:31:58.6002079Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T06:31:58.6002919Z Compiling xla/hlo/builder/xla_builder.cc; 16s local 2025-03-14T06:31:58.6003823Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local ... 2025-03-14T06:31:58.9995673Z 2025-03-14T06:31:58.9996883Z  2025-03-14T06:31:58.9997452Z  2025-03-14T06:31:58.9997891Z  2025-03-14T06:31:58.9998323Z  2025-03-14T06:31:58.9998678Z  2025-03-14T06:31:58.9999028Z  2025-03-14T06:31:58.9999371Z  2025-03-14T06:31:58.9999724Z  2025-03-14T06:31:59.0000567Z [16,660 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:59.0001513Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T06:31:59.0004213Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T06:31:59.0005434Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T06:31:59.0006294Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T06:31:59.0007031Z Compiling xla/hlo/ir/hlo_module.cc; 17s local 2025-03-14T06:31:59.0007769Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T06:31:59.0008555Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2025-03-14T06:31:59.0009498Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local ... 2025-03-14T06:31:59.2000794Z 2025-03-14T06:31:59.2001790Z  2025-03-14T06:31:59.2002342Z  2025-03-14T06:31:59.2003620Z  2025-03-14T06:31:59.2004506Z  2025-03-14T06:31:59.2004937Z  2025-03-14T06:31:59.2005376Z  2025-03-14T06:31:59.2005821Z  2025-03-14T06:31:59.2006219Z  2025-03-14T06:31:59.2007268Z [16,664 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:31:59.2008466Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T06:31:59.2009361Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T06:31:59.2010335Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 22s local 2025-03-14T06:31:59.2011238Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T06:31:59.2011978Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T06:31:59.2012741Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T06:31:59.2013834Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2025-03-14T06:31:59.2014690Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local ... 2025-03-14T06:31:59.4801488Z 2025-03-14T06:31:59.4802531Z  2025-03-14T06:31:59.4803055Z  2025-03-14T06:31:59.4803493Z  2025-03-14T06:31:59.4803928Z  2025-03-14T06:31:59.4804434Z  2025-03-14T06:31:59.4804853Z  2025-03-14T06:31:59.4805310Z  2025-03-14T06:31:59.4805768Z  2025-03-14T06:31:59.4807086Z [16,665 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:31:59.4808094Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T06:31:59.4809001Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T06:31:59.4809973Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T06:31:59.4810822Z @llvm-project//mlir:SparseTensorDialect; 22s local 2025-03-14T06:31:59.4811475Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T06:31:59.4812110Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T06:31:59.4812849Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2025-03-14T06:31:59.4813602Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local ... 2025-03-14T06:31:59.8008404Z 2025-03-14T06:31:59.8009260Z  2025-03-14T06:31:59.8009790Z  2025-03-14T06:31:59.8010245Z  2025-03-14T06:31:59.8010713Z  2025-03-14T06:31:59.8011152Z  2025-03-14T06:31:59.8011592Z  2025-03-14T06:31:59.8012009Z  2025-03-14T06:31:59.8012434Z  2025-03-14T06:31:59.8013376Z [16,666 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:31:59.8014459Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T06:31:59.8015455Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T06:31:59.8016459Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T06:31:59.8017310Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T06:31:59.8018038Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T06:31:59.8018737Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T06:31:59.8019490Z Compiling xla/hlo/builder/xla_builder.cc; 17s local 2025-03-14T06:31:59.8020289Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local ... 2025-03-14T06:32:00.0608168Z 2025-03-14T06:32:00.0609005Z  2025-03-14T06:32:00.0609491Z  2025-03-14T06:32:00.0609910Z  2025-03-14T06:32:00.0610344Z  2025-03-14T06:32:00.0610763Z  2025-03-14T06:32:00.0611173Z  2025-03-14T06:32:00.0611581Z  2025-03-14T06:32:00.0611993Z  2025-03-14T06:32:00.0612963Z [16,667 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:00.0614084Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T06:32:00.0615076Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2025-03-14T06:32:00.0616108Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T06:32:00.0617250Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T06:32:00.0618006Z Compiling xla/hlo/ir/hlo_module.cc; 18s local 2025-03-14T06:32:00.0618735Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T06:32:00.0619493Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2025-03-14T06:32:00.0620319Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local ... 2025-03-14T06:32:00.2818156Z 2025-03-14T06:32:00.2818981Z  2025-03-14T06:32:00.2819455Z  2025-03-14T06:32:00.2819862Z  2025-03-14T06:32:00.2820252Z  2025-03-14T06:32:00.2820642Z  2025-03-14T06:32:00.2821025Z  2025-03-14T06:32:00.2821403Z  2025-03-14T06:32:00.2821774Z  2025-03-14T06:32:00.2822676Z [16,670 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:00.2824049Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T06:32:00.2824989Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 23s local 2025-03-14T06:32:00.2825843Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T06:32:00.2826581Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T06:32:00.2827284Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T06:32:00.2828050Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2025-03-14T06:32:00.2829045Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2025-03-14T06:32:00.2829871Z Compiling mlir/lib/Rewrite/ByteCode.cpp; 13s local ... 2025-03-14T06:32:00.6013536Z 2025-03-14T06:32:00.6014456Z  2025-03-14T06:32:00.6014972Z  2025-03-14T06:32:00.6015431Z  2025-03-14T06:32:00.6015848Z  2025-03-14T06:32:00.6016311Z  2025-03-14T06:32:00.6016703Z  2025-03-14T06:32:00.6017017Z  2025-03-14T06:32:00.6017339Z  2025-03-14T06:32:00.6018082Z [16,671 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:00.6018985Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T06:32:00.6019828Z Compiling llvm/lib/Analysis/TargetLibraryInfo.cpp; 24s local 2025-03-14T06:32:00.6020659Z @llvm-project//mlir:SparseTensorDialect; 23s local 2025-03-14T06:32:00.6021368Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T06:32:00.6022063Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T06:32:00.6022821Z Compiling xla/hlo/builder/xla_builder.cc; 18s local 2025-03-14T06:32:00.6023635Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T06:32:00.6024524Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local ... 2025-03-14T06:32:01.0625510Z 2025-03-14T06:32:01.0626480Z  2025-03-14T06:32:01.0627006Z  2025-03-14T06:32:01.0627500Z  2025-03-14T06:32:01.0627924Z  2025-03-14T06:32:01.0628386Z  2025-03-14T06:32:01.0628797Z  2025-03-14T06:32:01.0629204Z  2025-03-14T06:32:01.0629604Z  2025-03-14T06:32:01.0630546Z [16,672 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:01.0631668Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T06:32:01.0632775Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T06:32:01.0633557Z Compiling xla/hlo/ir/hlo_module.cc; 19s local 2025-03-14T06:32:01.0634381Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T06:32:01.0635231Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T06:32:01.0636091Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T06:32:01.0637097Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2025-03-14T06:32:01.0637890Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local ... 2025-03-14T06:32:01.3163857Z 2025-03-14T06:32:01.3164951Z  2025-03-14T06:32:01.3166022Z  2025-03-14T06:32:01.3166441Z  2025-03-14T06:32:01.3166925Z  2025-03-14T06:32:01.3167628Z  2025-03-14T06:32:01.3168031Z  2025-03-14T06:32:01.3168411Z  2025-03-14T06:32:01.3168832Z  2025-03-14T06:32:01.3169786Z [16,674 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:01.3170914Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T06:32:01.3171863Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T06:32:01.3172637Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T06:32:01.3173393Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T06:32:01.3174180Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T06:32:01.3175045Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T06:32:01.3176125Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 14s local 2025-03-14T06:32:01.3176954Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local ... 2025-03-14T06:32:01.6021985Z 2025-03-14T06:32:01.6023028Z  2025-03-14T06:32:01.6023588Z  2025-03-14T06:32:01.6024027Z  2025-03-14T06:32:01.6024438Z  2025-03-14T06:32:01.6024907Z  2025-03-14T06:32:01.6025304Z  2025-03-14T06:32:01.6025699Z  2025-03-14T06:32:01.6026110Z  2025-03-14T06:32:01.6027040Z [16,674 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:01.6028419Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T06:32:01.6029253Z @llvm-project//mlir:SparseTensorDialect; 24s local 2025-03-14T06:32:01.6029966Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T06:32:01.6030727Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T06:32:01.6031559Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T06:32:01.6032414Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T06:32:01.6033256Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2025-03-14T06:32:01.6034083Z Compiling xla/hlo/ir/hlo_schedule.cc; 13s local ... 2025-03-14T06:32:01.8423382Z 2025-03-14T06:32:01.8424281Z  2025-03-14T06:32:01.8424856Z  2025-03-14T06:32:01.8425257Z  2025-03-14T06:32:01.8425665Z  2025-03-14T06:32:01.8426083Z  2025-03-14T06:32:01.8426463Z  2025-03-14T06:32:01.8426982Z  2025-03-14T06:32:01.8427501Z  2025-03-14T06:32:01.8428478Z [16,677 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:01.8429540Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T06:32:01.8430464Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T06:32:01.8431186Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T06:32:01.8431914Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T06:32:01.8432742Z Compiling xla/hlo/builder/xla_builder.cc; 19s local 2025-03-14T06:32:01.8433541Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T06:32:01.8434362Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2025-03-14T06:32:01.8435118Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2025-03-14T06:32:02.0695653Z 2025-03-14T06:32:02.0696521Z  2025-03-14T06:32:02.0697279Z  2025-03-14T06:32:02.0697712Z  2025-03-14T06:32:02.0709295Z  2025-03-14T06:32:02.0709768Z  2025-03-14T06:32:02.0710223Z  2025-03-14T06:32:02.0710634Z  2025-03-14T06:32:02.0711020Z  2025-03-14T06:32:02.0711925Z [16,678 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:02.0712993Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T06:32:02.0713811Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T06:32:02.0714536Z Compiling xla/hlo/ir/hlo_module.cc; 20s local 2025-03-14T06:32:02.0715318Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T06:32:02.0716406Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T06:32:02.0717136Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T06:32:02.0717928Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2025-03-14T06:32:02.0719307Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2025-03-14T06:32:02.4029110Z 2025-03-14T06:32:02.4030049Z  2025-03-14T06:32:02.4030591Z  2025-03-14T06:32:02.4032400Z  2025-03-14T06:32:02.4035438Z  2025-03-14T06:32:02.4037218Z  2025-03-14T06:32:02.4037833Z  2025-03-14T06:32:02.4038540Z  2025-03-14T06:32:02.4039334Z  2025-03-14T06:32:02.4040546Z [16,680 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:02.4042050Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T06:32:02.4042967Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T06:32:02.4043822Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T06:32:02.4044999Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T06:32:02.4045732Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T06:32:02.4046464Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T06:32:02.4047354Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 15s local 2025-03-14T06:32:02.4048342Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2025-03-14T06:32:02.6032873Z 2025-03-14T06:32:02.6033767Z  2025-03-14T06:32:02.6034248Z  2025-03-14T06:32:02.6034649Z  2025-03-14T06:32:02.6035053Z  2025-03-14T06:32:02.6035438Z  2025-03-14T06:32:02.6035828Z  2025-03-14T06:32:02.6036232Z  2025-03-14T06:32:02.6036758Z  2025-03-14T06:32:02.6037775Z [16,681 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:02.6038886Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T06:32:02.6039810Z @llvm-project//mlir:SparseTensorDialect; 25s local 2025-03-14T06:32:02.6040577Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T06:32:02.6041357Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T06:32:02.6042179Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T06:32:02.6043552Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T06:32:02.6044533Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T06:32:02.6045521Z Compiling xla/hlo/ir/hlo_schedule.cc; 14s local ... 2025-03-14T06:32:02.8235111Z 2025-03-14T06:32:02.8236033Z  2025-03-14T06:32:02.8236580Z  2025-03-14T06:32:02.8238387Z  2025-03-14T06:32:02.8239206Z  2025-03-14T06:32:02.8239835Z  2025-03-14T06:32:02.8240313Z  2025-03-14T06:32:02.8240756Z  2025-03-14T06:32:02.8241199Z  2025-03-14T06:32:02.8242219Z [16,682 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:02.8243425Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T06:32:02.8244534Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T06:32:02.8245488Z Compiling xla/hlo/ir/hlo_module.cc; 21s local 2025-03-14T06:32:02.8246255Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T06:32:02.8247038Z Compiling xla/hlo/builder/xla_builder.cc; 20s local 2025-03-14T06:32:02.8247838Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T06:32:02.8248701Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T06:32:02.8249530Z Compiling xla/hlo/ir/hlo_schedule.cc; 15s local ... 2025-03-14T06:32:03.0844082Z 2025-03-14T06:32:03.0845195Z  2025-03-14T06:32:03.0845757Z  2025-03-14T06:32:03.0846145Z  2025-03-14T06:32:03.0846514Z  2025-03-14T06:32:03.0846873Z  2025-03-14T06:32:03.0847285Z  2025-03-14T06:32:03.0847701Z  2025-03-14T06:32:03.0848455Z  2025-03-14T06:32:03.0849419Z [16,683 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:03.0850466Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T06:32:03.0851343Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T06:32:03.0852143Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T06:32:03.0852924Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T06:32:03.0853737Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T06:32:03.0854567Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T06:32:03.0855359Z Compiling xla/hlo/ir/hlo_schedule.cc; 15s local 2025-03-14T06:32:03.0856223Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local ... 2025-03-14T06:32:03.4039981Z 2025-03-14T06:32:03.4040909Z  2025-03-14T06:32:03.4041510Z  2025-03-14T06:32:03.4041910Z  2025-03-14T06:32:03.4042384Z  2025-03-14T06:32:03.4042810Z  2025-03-14T06:32:03.4043312Z  2025-03-14T06:32:03.4043835Z  2025-03-14T06:32:03.4044545Z  2025-03-14T06:32:03.4045613Z [16,684 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:03.4046809Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T06:32:03.4048100Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T06:32:03.4049078Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T06:32:03.4049999Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T06:32:03.4050904Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T06:32:03.4051820Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 16s local 2025-03-14T06:32:03.4052661Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2025-03-14T06:32:03.4053621Z Compiling xla/service/hlo_cse.cc; 12s local ... 2025-03-14T06:32:03.6194991Z 2025-03-14T06:32:03.6195883Z  2025-03-14T06:32:03.6196376Z  2025-03-14T06:32:03.6196789Z  2025-03-14T06:32:03.6197166Z  2025-03-14T06:32:03.6197544Z  2025-03-14T06:32:03.6197946Z  2025-03-14T06:32:03.6198348Z  2025-03-14T06:32:03.6198755Z  2025-03-14T06:32:03.6199696Z [16,687 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:03.6200772Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T06:32:03.6201623Z @llvm-project//mlir:SparseTensorDialect; 26s local 2025-03-14T06:32:03.6202362Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T06:32:03.6203119Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T06:32:03.6203937Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T06:32:03.6204908Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T06:32:03.6205849Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T06:32:03.6206662Z Compiling xla/service/hlo_cse.cc; 13s local ... 2025-03-14T06:32:03.8533884Z 2025-03-14T06:32:03.8534754Z  2025-03-14T06:32:03.8535256Z  2025-03-14T06:32:03.8535668Z  2025-03-14T06:32:03.8536323Z  2025-03-14T06:32:03.8536749Z  2025-03-14T06:32:03.8537158Z  2025-03-14T06:32:03.8537566Z  2025-03-14T06:32:03.8537979Z  2025-03-14T06:32:03.8538926Z [16,691 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:03.8539998Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T06:32:03.8540855Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T06:32:03.8541634Z Compiling xla/hlo/builder/xla_builder.cc; 21s local 2025-03-14T06:32:03.8542393Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T06:32:03.8543212Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T06:32:03.8544293Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T06:32:03.8545170Z Compiling xla/service/hlo_creation_utils.cc; 10s local 2025-03-14T06:32:03.8546145Z Compiling .../translate/hlo_to_mhlo/stack_location_utils.cc; 10s local ... 2025-03-14T06:32:04.1808803Z 2025-03-14T06:32:04.1809643Z  2025-03-14T06:32:04.1810127Z  2025-03-14T06:32:04.1810590Z  2025-03-14T06:32:04.1811002Z  2025-03-14T06:32:04.1811422Z  2025-03-14T06:32:04.1811832Z  2025-03-14T06:32:04.1812210Z  2025-03-14T06:32:04.1812647Z  2025-03-14T06:32:04.1813585Z [16,693 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:04.1814659Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T06:32:04.1815841Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T06:32:04.1816651Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T06:32:04.1817489Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T06:32:04.1818246Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T06:32:04.1819164Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T06:32:04.1820062Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2025-03-14T06:32:04.1821202Z Compiling .../translate/hlo_to_mhlo/stack_location_utils.cc; 10s local ... 2025-03-14T06:32:04.4050646Z 2025-03-14T06:32:04.4051502Z  2025-03-14T06:32:04.4051997Z  2025-03-14T06:32:04.4052437Z  2025-03-14T06:32:04.4052858Z  2025-03-14T06:32:04.4053285Z  2025-03-14T06:32:04.4053713Z  2025-03-14T06:32:04.4054145Z  2025-03-14T06:32:04.4054552Z  2025-03-14T06:32:04.4055549Z [16,695 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:04.4056675Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T06:32:04.4057587Z @llvm-project//mlir:SparseTensorDialect; 27s local 2025-03-14T06:32:04.4058449Z Compiling xla/hlo/builder/xla_builder.cc; 22s local 2025-03-14T06:32:04.4059286Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T06:32:04.4060088Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 17s local 2025-03-14T06:32:04.4060998Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T06:32:04.4061881Z Compiling xla/service/hlo_creation_utils.cc; 11s local 2025-03-14T06:32:04.4062857Z Compiling .../translate/hlo_to_mhlo/stack_location_utils.cc; 11s local ... 2025-03-14T06:32:05.3697263Z 2025-03-14T06:32:05.3698095Z  2025-03-14T06:32:05.3698553Z  2025-03-14T06:32:05.3698945Z  2025-03-14T06:32:05.3699366Z  2025-03-14T06:32:05.3699756Z  2025-03-14T06:32:05.3700139Z  2025-03-14T06:32:05.3700527Z  2025-03-14T06:32:05.3700925Z  2025-03-14T06:32:05.3701845Z [16,696 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:05.3702875Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2025-03-14T06:32:05.3703685Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T06:32:05.3704651Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T06:32:05.3705399Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2025-03-14T06:32:05.3706213Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 18s local 2025-03-14T06:32:05.3707125Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2025-03-14T06:32:05.3708076Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2025-03-14T06:32:05.3709021Z Compiling .../translate/hlo_to_mhlo/stack_location_utils.cc; 12s local ... 2025-03-14T06:32:05.5715434Z 2025-03-14T06:32:05.5716289Z  2025-03-14T06:32:05.5716788Z  2025-03-14T06:32:05.5717179Z  2025-03-14T06:32:05.5717579Z  2025-03-14T06:32:05.5718298Z  2025-03-14T06:32:05.5718683Z  2025-03-14T06:32:05.5719063Z  2025-03-14T06:32:05.5719447Z  2025-03-14T06:32:05.5720326Z [16,697 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:05.5721418Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2025-03-14T06:32:05.5722277Z @llvm-project//mlir:SparseTensorDialect; 28s local 2025-03-14T06:32:05.5723096Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T06:32:05.5723844Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T06:32:05.5724798Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T06:32:05.5725698Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T06:32:05.5726859Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2025-03-14T06:32:05.5727845Z Compiling .../translate/hlo_to_mhlo/stack_location_utils.cc; 12s local ... 2025-03-14T06:32:05.7945039Z 2025-03-14T06:32:05.7945892Z  2025-03-14T06:32:05.7946424Z  2025-03-14T06:32:05.7946808Z  2025-03-14T06:32:05.7947215Z  2025-03-14T06:32:05.7947634Z  2025-03-14T06:32:05.7948031Z  2025-03-14T06:32:05.7948431Z  2025-03-14T06:32:05.7948862Z  2025-03-14T06:32:05.7950083Z [16,698 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:05.7951109Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T06:32:05.7951903Z Compiling xla/hlo/builder/xla_builder.cc; 23s local 2025-03-14T06:32:05.7952743Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T06:32:05.7953621Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T06:32:05.7954505Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T06:32:05.7955383Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2025-03-14T06:32:05.7956375Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2025-03-14T06:32:05.7957356Z Compiling xla/hlo/parser/hlo_parser.cc; 11s local ... 2025-03-14T06:32:06.0062303Z 2025-03-14T06:32:06.0063137Z  2025-03-14T06:32:06.0063605Z  2025-03-14T06:32:06.0064011Z  2025-03-14T06:32:06.0064376Z  2025-03-14T06:32:06.0064760Z  2025-03-14T06:32:06.0065136Z  2025-03-14T06:32:06.0065758Z  2025-03-14T06:32:06.0066145Z  2025-03-14T06:32:06.0067079Z [16,698 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:06.0068001Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T06:32:06.0068857Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T06:32:06.0069665Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T06:32:06.0070457Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T06:32:06.0071378Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T06:32:06.0072341Z Compiling xla/service/hlo_creation_utils.cc; 12s local 2025-03-14T06:32:06.0073377Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2025-03-14T06:32:06.0074647Z Compiling xla/hlo/parser/hlo_parser.cc; 11s local ... 2025-03-14T06:32:06.2066181Z 2025-03-14T06:32:06.2067052Z  2025-03-14T06:32:06.2067514Z  2025-03-14T06:32:06.2067955Z  2025-03-14T06:32:06.2068348Z  2025-03-14T06:32:06.2068728Z  2025-03-14T06:32:06.2069109Z  2025-03-14T06:32:06.2069503Z  2025-03-14T06:32:06.2069897Z  2025-03-14T06:32:06.2070812Z [16,700 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:06.2071792Z @llvm-project//mlir:SparseTensorDialect; 29s local 2025-03-14T06:32:06.2072547Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T06:32:06.2073324Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T06:32:06.2074396Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 19s local 2025-03-14T06:32:06.2075277Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T06:32:06.2076164Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2025-03-14T06:32:06.2077134Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2025-03-14T06:32:06.2078111Z Compiling xla/hlo/parser/hlo_parser.cc; 11s local ... 2025-03-14T06:32:06.6316154Z 2025-03-14T06:32:06.6317002Z  2025-03-14T06:32:06.6317483Z  2025-03-14T06:32:06.6317884Z  2025-03-14T06:32:06.6318271Z  2025-03-14T06:32:06.6318670Z  2025-03-14T06:32:06.6319052Z  2025-03-14T06:32:06.6319439Z  2025-03-14T06:32:06.6319803Z  2025-03-14T06:32:06.6320972Z [16,701 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:06.6321956Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T06:32:06.6322748Z Compiling xla/hlo/builder/xla_builder.cc; 24s local 2025-03-14T06:32:06.6323559Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T06:32:06.6324601Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2025-03-14T06:32:06.6325563Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2025-03-14T06:32:06.6326706Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2025-03-14T06:32:06.6327773Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 13s local 2025-03-14T06:32:06.6328781Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local ... 2025-03-14T06:32:06.9022429Z 2025-03-14T06:32:06.9023283Z  2025-03-14T06:32:06.9023727Z  2025-03-14T06:32:06.9024080Z  2025-03-14T06:32:06.9024473Z  2025-03-14T06:32:06.9024814Z  2025-03-14T06:32:06.9025166Z  2025-03-14T06:32:06.9025521Z  2025-03-14T06:32:06.9025867Z  2025-03-14T06:32:06.9026797Z [16,702 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:06.9027673Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T06:32:06.9028332Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T06:32:06.9029011Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T06:32:06.9029736Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2025-03-14T06:32:06.9030493Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2025-03-14T06:32:06.9031249Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2025-03-14T06:32:06.9032063Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 13s local 2025-03-14T06:32:06.9032904Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local ... 2025-03-14T06:32:07.1131866Z 2025-03-14T06:32:07.1132758Z  2025-03-14T06:32:07.1133281Z  2025-03-14T06:32:07.1133686Z  2025-03-14T06:32:07.1134104Z  2025-03-14T06:32:07.1134558Z  2025-03-14T06:32:07.1134966Z  2025-03-14T06:32:07.1135372Z  2025-03-14T06:32:07.1135785Z  2025-03-14T06:32:07.1136740Z [16,704 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:07.1138082Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T06:32:07.1138919Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T06:32:07.1139775Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T06:32:07.1140638Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2025-03-14T06:32:07.1141387Z Compiling xla/service/hlo_creation_utils.cc; 13s local 2025-03-14T06:32:07.1142397Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 13s local 2025-03-14T06:32:07.1143433Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local 2025-03-14T06:32:07.1144389Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local ... 2025-03-14T06:32:07.3648157Z 2025-03-14T06:32:07.3649325Z  2025-03-14T06:32:07.3649808Z  2025-03-14T06:32:07.3650222Z  2025-03-14T06:32:07.3650630Z  2025-03-14T06:32:07.3651040Z  2025-03-14T06:32:07.3651464Z  2025-03-14T06:32:07.3651885Z  2025-03-14T06:32:07.3652305Z  2025-03-14T06:32:07.3653234Z [16,706 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:07.3654310Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T06:32:07.3655224Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T06:32:07.3656000Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T06:32:07.3656855Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 20s local 2025-03-14T06:32:07.3657846Z Compiling xla/hlo/parser/hlo_parser.cc; 12s local 2025-03-14T06:32:07.3658720Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2025-03-14T06:32:07.3659797Z Compiling xla/hlo/transforms/expanders/op_expander_pass.cc; 11s local 2025-03-14T06:32:07.3660904Z @xla//xla/hlo/transforms:batch_dot_simplification; 11s local ... 2025-03-14T06:32:07.6006387Z 2025-03-14T06:32:07.6007371Z  2025-03-14T06:32:07.6007875Z  2025-03-14T06:32:07.6008305Z  2025-03-14T06:32:07.6008753Z  2025-03-14T06:32:07.6009175Z  2025-03-14T06:32:07.6009605Z  2025-03-14T06:32:07.6010018Z  2025-03-14T06:32:07.6010728Z  2025-03-14T06:32:07.6011706Z [16,710 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:07.6012730Z @llvm-project//mlir:SparseTensorDialect; 30s local 2025-03-14T06:32:07.6013477Z Compiling xla/hlo/builder/xla_builder.cc; 25s local 2025-03-14T06:32:07.6014278Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T06:32:07.6015108Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2025-03-14T06:32:07.6016046Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2025-03-14T06:32:07.6017076Z @xla//xla/hlo/transforms:batch_dot_simplification; 11s local 2025-03-14T06:32:07.6018091Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2025-03-14T06:32:07.6019128Z Compiling xla/service/all_to_all_decomposer.cc; 10s local ... 2025-03-14T06:32:07.8077715Z 2025-03-14T06:32:07.8078694Z  2025-03-14T06:32:07.8079187Z  2025-03-14T06:32:07.8079747Z  2025-03-14T06:32:07.8080148Z  2025-03-14T06:32:07.8080550Z  2025-03-14T06:32:07.8081662Z  2025-03-14T06:32:07.8082115Z  2025-03-14T06:32:07.8082489Z  2025-03-14T06:32:07.8083468Z [16,713 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:07.8084620Z @llvm-project//mlir:SparseTensorDialect; 31s local 2025-03-14T06:32:07.8085427Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T06:32:07.8086258Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2025-03-14T06:32:07.8087182Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T06:32:07.8088198Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 10s local 2025-03-14T06:32:07.8089308Z Compiling xla/service/all_to_all_decomposer.cc; 10s local 2025-03-14T06:32:07.8090105Z Compiling xla/service/batched_gather_scatter_normalizer.cc; 10s local 2025-03-14T06:32:07.8091042Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local ... 2025-03-14T06:32:08.0875379Z 2025-03-14T06:32:08.0876215Z  2025-03-14T06:32:08.0876690Z  2025-03-14T06:32:08.0877068Z  2025-03-14T06:32:08.0877464Z  2025-03-14T06:32:08.0877876Z  2025-03-14T06:32:08.0878273Z  2025-03-14T06:32:08.0878688Z  2025-03-14T06:32:08.0879149Z  2025-03-14T06:32:08.0880064Z [16,715 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:08.0881797Z @llvm-project//mlir:SparseTensorDialect; 31s local 2025-03-14T06:32:08.0882901Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T06:32:08.0883659Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2025-03-14T06:32:08.0884623Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T06:32:08.0885572Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T06:32:08.0886521Z Compiling xla/service/all_to_all_decomposer.cc; 11s local 2025-03-14T06:32:08.0887486Z Compiling xla/service/batched_gather_scatter_normalizer.cc; 10s local 2025-03-14T06:32:08.0888595Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local ... 2025-03-14T06:32:08.2889003Z 2025-03-14T06:32:08.2889898Z  2025-03-14T06:32:08.2890390Z  2025-03-14T06:32:08.2891059Z  2025-03-14T06:32:08.2891471Z  2025-03-14T06:32:08.2891877Z  2025-03-14T06:32:08.2892270Z  2025-03-14T06:32:08.2892650Z  2025-03-14T06:32:08.2893005Z  2025-03-14T06:32:08.2893940Z [16,717 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:08.2894881Z @llvm-project//mlir:SparseTensorDialect; 31s local 2025-03-14T06:32:08.2895828Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 21s local 2025-03-14T06:32:08.2896649Z Compiling xla/hlo/parser/hlo_parser.cc; 13s local 2025-03-14T06:32:08.2897742Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T06:32:08.2898766Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T06:32:08.2899691Z Compiling xla/service/all_to_all_decomposer.cc; 11s local 2025-03-14T06:32:08.2900705Z Compiling xla/service/batched_gather_scatter_normalizer.cc; 10s local 2025-03-14T06:32:08.2901806Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local ... 2025-03-14T06:32:08.6085042Z 2025-03-14T06:32:08.6085850Z  2025-03-14T06:32:08.6086318Z  2025-03-14T06:32:08.6086699Z  2025-03-14T06:32:08.6087128Z  2025-03-14T06:32:08.6087506Z  2025-03-14T06:32:08.6087899Z  2025-03-14T06:32:08.6088287Z  2025-03-14T06:32:08.6088651Z  2025-03-14T06:32:08.6089584Z [16,717 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:08.6090605Z @llvm-project//mlir:SparseTensorDialect; 31s local 2025-03-14T06:32:08.6091429Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T06:32:08.6092191Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2025-03-14T06:32:08.6093057Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T06:32:08.6093892Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T06:32:08.6094715Z Compiling xla/service/all_to_all_decomposer.cc; 11s local 2025-03-14T06:32:08.6095691Z Compiling xla/service/batched_gather_scatter_normalizer.cc; 11s local 2025-03-14T06:32:08.6096567Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local ... 2025-03-14T06:32:09.0733802Z 2025-03-14T06:32:09.0734672Z  2025-03-14T06:32:09.0735135Z  2025-03-14T06:32:09.0735550Z  2025-03-14T06:32:09.0735948Z  2025-03-14T06:32:09.0736301Z  2025-03-14T06:32:09.0736689Z  2025-03-14T06:32:09.0737347Z  2025-03-14T06:32:09.0737771Z  2025-03-14T06:32:09.0738872Z [16,718 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:09.0739860Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T06:32:09.0740704Z Compiling xla/hlo/utils/hlo_sharding_util.cc; 22s local 2025-03-14T06:32:09.0741517Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2025-03-14T06:32:09.0742423Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T06:32:09.0743433Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T06:32:09.0744351Z Compiling xla/service/all_to_all_decomposer.cc; 12s local 2025-03-14T06:32:09.0745552Z Compiling xla/service/batched_gather_scatter_normalizer.cc; 11s local 2025-03-14T06:32:09.0746697Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local ... 2025-03-14T06:32:09.3202112Z 2025-03-14T06:32:09.3202909Z  2025-03-14T06:32:09.3203457Z  2025-03-14T06:32:09.3203882Z  2025-03-14T06:32:09.3204444Z  2025-03-14T06:32:09.3204871Z  2025-03-14T06:32:09.3205272Z  2025-03-14T06:32:09.3205663Z  2025-03-14T06:32:09.3206058Z  2025-03-14T06:32:09.3207005Z [16,723 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:09.3208006Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T06:32:09.3208769Z Compiling xla/hlo/parser/hlo_parser.cc; 14s local 2025-03-14T06:32:09.3209967Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T06:32:09.3211109Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T06:32:09.3212138Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T06:32:09.3213107Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 10s local 2025-03-14T06:32:09.3213990Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T06:32:09.3214779Z Compiling xla/service/sharding_remover.cc; 9s local ... 2025-03-14T06:32:09.6093738Z 2025-03-14T06:32:09.6094844Z  2025-03-14T06:32:09.6095354Z  2025-03-14T06:32:09.6095776Z  2025-03-14T06:32:09.6096180Z  2025-03-14T06:32:09.6096588Z  2025-03-14T06:32:09.6096990Z  2025-03-14T06:32:09.6097405Z  2025-03-14T06:32:09.6097805Z  2025-03-14T06:32:09.6098746Z [16,724 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:09.6099758Z @llvm-project//mlir:SparseTensorDialect; 32s local 2025-03-14T06:32:09.6100535Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2025-03-14T06:32:09.6101444Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T06:32:09.6102455Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T06:32:09.6103507Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T06:32:09.6104513Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 11s local 2025-03-14T06:32:09.6105382Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T06:32:09.6106208Z Compiling xla/service/sharding_remover.cc; 9s local ... 2025-03-14T06:32:09.9486878Z 2025-03-14T06:32:09.9487717Z  2025-03-14T06:32:09.9488145Z  2025-03-14T06:32:09.9488520Z  2025-03-14T06:32:09.9488894Z  2025-03-14T06:32:09.9489275Z  2025-03-14T06:32:09.9489609Z  2025-03-14T06:32:09.9489987Z  2025-03-14T06:32:09.9490335Z  2025-03-14T06:32:09.9491137Z [16,727 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:09.9492099Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T06:32:09.9492844Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2025-03-14T06:32:09.9493662Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T06:32:09.9494846Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T06:32:09.9495789Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 11s local 2025-03-14T06:32:09.9496587Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T06:32:09.9497274Z Compiling xla/service/sharding_remover.cc; 9s local 2025-03-14T06:32:09.9498094Z Compiling .../transforms/simplifiers/float_normalization.cc; 9s local ... 2025-03-14T06:32:10.2100355Z 2025-03-14T06:32:10.2101164Z  2025-03-14T06:32:10.2101607Z  2025-03-14T06:32:10.2101941Z  2025-03-14T06:32:10.2102270Z  2025-03-14T06:32:10.2102598Z  2025-03-14T06:32:10.2102922Z  2025-03-14T06:32:10.2103235Z  2025-03-14T06:32:10.2103836Z  2025-03-14T06:32:10.2104605Z [16,728 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:10.2105421Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T06:32:10.2106063Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2025-03-14T06:32:10.2106767Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T06:32:10.2107587Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T06:32:10.2108379Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 11s local 2025-03-14T06:32:10.2109074Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T06:32:10.2109706Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T06:32:10.2110652Z Compiling .../transforms/simplifiers/float_normalization.cc; 9s local ... 2025-03-14T06:32:10.4104770Z 2025-03-14T06:32:10.4105652Z  2025-03-14T06:32:10.4106161Z  2025-03-14T06:32:10.4106594Z  2025-03-14T06:32:10.4106988Z  2025-03-14T06:32:10.4107363Z  2025-03-14T06:32:10.4107787Z  2025-03-14T06:32:10.4108169Z  2025-03-14T06:32:10.4108553Z  2025-03-14T06:32:10.4109511Z [16,731 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:10.4110492Z @llvm-project//mlir:SparseTensorDialect; 33s local 2025-03-14T06:32:10.4111558Z Compiling xla/hlo/parser/hlo_parser.cc; 15s local 2025-03-14T06:32:10.4112471Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T06:32:10.4113481Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2025-03-14T06:32:10.4114362Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T06:32:10.4115340Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 10s local 2025-03-14T06:32:10.4116561Z Compiling .../transforms/expanders/rng_bit_generator_expander.cc; 9s local 2025-03-14T06:32:10.4117574Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local ... 2025-03-14T06:32:10.6876045Z 2025-03-14T06:32:10.6876873Z  2025-03-14T06:32:10.6877359Z  2025-03-14T06:32:10.6877769Z  2025-03-14T06:32:10.6878155Z  2025-03-14T06:32:10.6878595Z  2025-03-14T06:32:10.6878999Z  2025-03-14T06:32:10.6879401Z  2025-03-14T06:32:10.6879771Z  2025-03-14T06:32:10.6880702Z [16,732 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:10.6881674Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T06:32:10.6882428Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2025-03-14T06:32:10.6883291Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T06:32:10.6884245Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2025-03-14T06:32:10.6885240Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T06:32:10.6886206Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 10s local 2025-03-14T06:32:10.6887271Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T06:32:10.6888151Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local ... 2025-03-14T06:32:11.0059961Z 2025-03-14T06:32:11.0060815Z  2025-03-14T06:32:11.0061232Z  2025-03-14T06:32:11.0061587Z  2025-03-14T06:32:11.0061927Z  2025-03-14T06:32:11.0062309Z  2025-03-14T06:32:11.0062693Z  2025-03-14T06:32:11.0063087Z  2025-03-14T06:32:11.0063482Z  2025-03-14T06:32:11.0064383Z [16,734 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:11.0065604Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T06:32:11.0066406Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2025-03-14T06:32:11.0067196Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2025-03-14T06:32:11.0068065Z Compiling xla/service/sharding_remover.cc; 10s local 2025-03-14T06:32:11.0069246Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 10s local 2025-03-14T06:32:11.0070281Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T06:32:11.0071198Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T06:32:11.0071953Z Compiling xla/hlo/builder/lib/math.cc; 9s local ... 2025-03-14T06:32:11.2110875Z 2025-03-14T06:32:11.2111753Z  2025-03-14T06:32:11.2112247Z  2025-03-14T06:32:11.2112655Z  2025-03-14T06:32:11.2113077Z  2025-03-14T06:32:11.2113479Z  2025-03-14T06:32:11.2113892Z  2025-03-14T06:32:11.2114284Z  2025-03-14T06:32:11.2114700Z  2025-03-14T06:32:11.2115659Z [16,736 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:11.2117010Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T06:32:11.2117793Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2025-03-14T06:32:11.2118623Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2025-03-14T06:32:11.2119466Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T06:32:11.2120455Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 10s local 2025-03-14T06:32:11.2121522Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T06:32:11.2122594Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T06:32:11.2123368Z Compiling xla/hlo/builder/lib/math.cc; 9s local ... 2025-03-14T06:32:11.4115262Z 2025-03-14T06:32:11.4116121Z  2025-03-14T06:32:11.4116635Z  2025-03-14T06:32:11.4117034Z  2025-03-14T06:32:11.4117427Z  2025-03-14T06:32:11.4117850Z  2025-03-14T06:32:11.4118321Z  2025-03-14T06:32:11.4118765Z  2025-03-14T06:32:11.4119162Z  2025-03-14T06:32:11.4120207Z [16,737 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:11.4121144Z @llvm-project//mlir:SparseTensorDialect; 34s local 2025-03-14T06:32:11.4121795Z Compiling xla/hlo/parser/hlo_parser.cc; 16s local 2025-03-14T06:32:11.4122532Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2025-03-14T06:32:11.4123378Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T06:32:11.4124545Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 11s local 2025-03-14T06:32:11.4125663Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T06:32:11.4126524Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T06:32:11.4127307Z Compiling xla/hlo/builder/lib/math.cc; 9s local ... 2025-03-14T06:32:11.6465143Z 2025-03-14T06:32:11.6466262Z  2025-03-14T06:32:11.6466761Z  2025-03-14T06:32:11.6467164Z  2025-03-14T06:32:11.6467567Z  2025-03-14T06:32:11.6467941Z  2025-03-14T06:32:11.6468334Z  2025-03-14T06:32:11.6468740Z  2025-03-14T06:32:11.6469127Z  2025-03-14T06:32:11.6470050Z [16,739 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:11.6471032Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T06:32:11.6472120Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T06:32:11.6472962Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2025-03-14T06:32:11.6473806Z Compiling xla/service/sharding_remover.cc; 11s local 2025-03-14T06:32:11.6474745Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 11s local 2025-03-14T06:32:11.6475810Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T06:32:11.6476708Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T06:32:11.6477506Z Compiling xla/hlo/builder/lib/math.cc; 10s local ... 2025-03-14T06:32:11.9350831Z 2025-03-14T06:32:11.9351677Z  2025-03-14T06:32:11.9352150Z  2025-03-14T06:32:11.9352824Z  2025-03-14T06:32:11.9353217Z  2025-03-14T06:32:11.9353605Z  2025-03-14T06:32:11.9354001Z  2025-03-14T06:32:11.9354350Z  2025-03-14T06:32:11.9354728Z  2025-03-14T06:32:11.9355658Z [16,740 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:11.9356646Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T06:32:11.9357400Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T06:32:11.9358229Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2025-03-14T06:32:11.9359296Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 11s local 2025-03-14T06:32:11.9360321Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T06:32:11.9361428Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T06:32:11.9362181Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2025-03-14T06:32:11.9363052Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local ... 2025-03-14T06:32:12.2121300Z 2025-03-14T06:32:12.2122269Z  2025-03-14T06:32:12.2122740Z  2025-03-14T06:32:12.2123137Z  2025-03-14T06:32:12.2123513Z  2025-03-14T06:32:12.2123910Z  2025-03-14T06:32:12.2124442Z  2025-03-14T06:32:12.2124827Z  2025-03-14T06:32:12.2125216Z  2025-03-14T06:32:12.2126351Z [16,740 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:12.2127367Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T06:32:12.2128118Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T06:32:12.2128945Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2025-03-14T06:32:12.2130022Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 11s local 2025-03-14T06:32:12.2131062Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T06:32:12.2131893Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 11s local 2025-03-14T06:32:12.2132574Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2025-03-14T06:32:12.2133616Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local ... 2025-03-14T06:32:12.4125349Z 2025-03-14T06:32:12.4126208Z  2025-03-14T06:32:12.4126710Z  2025-03-14T06:32:12.4127148Z  2025-03-14T06:32:12.4127576Z  2025-03-14T06:32:12.4127951Z  2025-03-14T06:32:12.4128323Z  2025-03-14T06:32:12.4128717Z  2025-03-14T06:32:12.4129103Z  2025-03-14T06:32:12.4130024Z [16,743 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:32:12.4131041Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T06:32:12.4131869Z Compiling xla/hlo/parser/hlo_parser.cc; 17s local 2025-03-14T06:32:12.4132699Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:32:12.4133785Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T06:32:12.4134899Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T06:32:12.4135781Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2025-03-14T06:32:12.4136994Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2025-03-14T06:32:12.4138006Z Compiling xla/hlo/ir/hlo_instructions.cc; 9s local ... 2025-03-14T06:32:12.6166609Z 2025-03-14T06:32:12.6167437Z  2025-03-14T06:32:12.6167934Z  2025-03-14T06:32:12.6168345Z  2025-03-14T06:32:12.6168749Z  2025-03-14T06:32:12.6169173Z  2025-03-14T06:32:12.6169567Z  2025-03-14T06:32:12.6169948Z  2025-03-14T06:32:12.6170336Z  2025-03-14T06:32:12.6171259Z [16,744 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:12.6172251Z @llvm-project//mlir:SparseTensorDialect; 35s local 2025-03-14T06:32:12.6173035Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T06:32:12.6174147Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:32:12.6175258Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T06:32:12.6176354Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local 2025-03-14T06:32:12.6177200Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2025-03-14T06:32:12.6178064Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2025-03-14T06:32:12.6178962Z Compiling xla/hlo/ir/hlo_instructions.cc; 9s local ... 2025-03-14T06:32:12.9018605Z 2025-03-14T06:32:12.9019474Z  2025-03-14T06:32:12.9019981Z  2025-03-14T06:32:12.9020386Z  2025-03-14T06:32:12.9020778Z  2025-03-14T06:32:12.9021498Z  2025-03-14T06:32:12.9021918Z  2025-03-14T06:32:12.9022339Z  2025-03-14T06:32:12.9022762Z  2025-03-14T06:32:12.9023812Z [16,746 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:12.9024862Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T06:32:12.9025651Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T06:32:12.9026428Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:32:12.9027438Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T06:32:12.9028705Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local 2025-03-14T06:32:12.9029551Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2025-03-14T06:32:12.9030422Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T06:32:12.9031320Z Compiling xla/hlo/ir/hlo_instructions.cc; 9s local ... 2025-03-14T06:32:13.1467432Z 2025-03-14T06:32:13.1468277Z  2025-03-14T06:32:13.1468751Z  2025-03-14T06:32:13.1469160Z  2025-03-14T06:32:13.1469520Z  2025-03-14T06:32:13.1469892Z  2025-03-14T06:32:13.1470266Z  2025-03-14T06:32:13.1470659Z  2025-03-14T06:32:13.1471030Z  2025-03-14T06:32:13.1471925Z [16,748 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:13.1472881Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T06:32:13.1473631Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T06:32:13.1474449Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:32:13.1475506Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T06:32:13.1476424Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2025-03-14T06:32:13.1477278Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T06:32:13.1478186Z Compiling xla/hlo/ir/hlo_instructions.cc; 10s local 2025-03-14T06:32:13.1479076Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 9s local ... 2025-03-14T06:32:13.3905116Z 2025-03-14T06:32:13.3905944Z  2025-03-14T06:32:13.3906490Z  2025-03-14T06:32:13.3906899Z  2025-03-14T06:32:13.3907286Z  2025-03-14T06:32:13.3907690Z  2025-03-14T06:32:13.3908080Z  2025-03-14T06:32:13.3908483Z  2025-03-14T06:32:13.3908871Z  2025-03-14T06:32:13.3910076Z [16,748 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:13.3911102Z @llvm-project//mlir:SparseTensorDialect; 36s local 2025-03-14T06:32:13.3911875Z Compiling xla/hlo/parser/hlo_parser.cc; 18s local 2025-03-14T06:32:13.3912745Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:32:13.3913799Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2025-03-14T06:32:13.3914783Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2025-03-14T06:32:13.3915673Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T06:32:13.3916582Z Compiling xla/hlo/ir/hlo_instructions.cc; 10s local 2025-03-14T06:32:13.3917630Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 9s local ... 2025-03-14T06:32:13.6947042Z 2025-03-14T06:32:13.6947929Z  2025-03-14T06:32:13.6948417Z  2025-03-14T06:32:13.6948824Z  2025-03-14T06:32:13.6949235Z  2025-03-14T06:32:13.6949636Z  2025-03-14T06:32:13.6950024Z  2025-03-14T06:32:13.6950415Z  2025-03-14T06:32:13.6950824Z  2025-03-14T06:32:13.6951765Z [16,750 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:13.6952738Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T06:32:13.6953464Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T06:32:13.6954323Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2025-03-14T06:32:13.6955742Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2025-03-14T06:32:13.6956719Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T06:32:13.6957579Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T06:32:13.6958479Z Compiling xla/hlo/ir/hlo_instructions.cc; 10s local 2025-03-14T06:32:13.6959359Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 9s local ... 2025-03-14T06:32:13.9131018Z 2025-03-14T06:32:13.9131860Z  2025-03-14T06:32:13.9132343Z  2025-03-14T06:32:13.9132744Z  2025-03-14T06:32:13.9133461Z  2025-03-14T06:32:13.9133893Z  2025-03-14T06:32:13.9144865Z  2025-03-14T06:32:13.9145306Z  2025-03-14T06:32:13.9145663Z  2025-03-14T06:32:13.9146588Z [16,752 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:13.9147583Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T06:32:13.9148357Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T06:32:13.9149162Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2025-03-14T06:32:13.9149992Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T06:32:13.9150863Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T06:32:13.9151741Z Compiling xla/hlo/ir/hlo_instructions.cc; 10s local 2025-03-14T06:32:13.9153083Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 10s local 2025-03-14T06:32:13.9153943Z Compiling xla/service/hlo_cse.cc; 10s local ... 2025-03-14T06:32:14.1926773Z 2025-03-14T06:32:14.1927619Z  2025-03-14T06:32:14.1928100Z  2025-03-14T06:32:14.1928486Z  2025-03-14T06:32:14.1928931Z  2025-03-14T06:32:14.1929307Z  2025-03-14T06:32:14.1929681Z  2025-03-14T06:32:14.1930059Z  2025-03-14T06:32:14.1930422Z  2025-03-14T06:32:14.1931320Z [16,753 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:14.1932316Z @llvm-project//mlir:SparseTensorDialect; 37s local 2025-03-14T06:32:14.1933077Z Compiling xla/hlo/parser/hlo_parser.cc; 19s local 2025-03-14T06:32:14.1933880Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2025-03-14T06:32:14.1934622Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T06:32:14.1935774Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T06:32:14.1936675Z Compiling xla/hlo/ir/hlo_instructions.cc; 11s local 2025-03-14T06:32:14.1937663Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 10s local 2025-03-14T06:32:14.1938505Z Compiling xla/service/hlo_cse.cc; 10s local ... 2025-03-14T06:32:15.1224831Z 2025-03-14T06:32:15.1225656Z  2025-03-14T06:32:15.1226132Z  2025-03-14T06:32:15.1226521Z  2025-03-14T06:32:15.1226916Z  2025-03-14T06:32:15.1227305Z  2025-03-14T06:32:15.1227734Z  2025-03-14T06:32:15.1228114Z  2025-03-14T06:32:15.1228479Z  2025-03-14T06:32:15.1229398Z [16,754 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:15.1230765Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T06:32:15.1231509Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T06:32:15.1232344Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2025-03-14T06:32:15.1233172Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T06:32:15.1234028Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local 2025-03-14T06:32:15.1234895Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local 2025-03-14T06:32:15.1235738Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 11s local 2025-03-14T06:32:15.1236615Z Compiling xla/service/hlo_cse.cc; 11s local ... 2025-03-14T06:32:15.3958342Z 2025-03-14T06:32:15.3959174Z  2025-03-14T06:32:15.3960041Z  2025-03-14T06:32:15.3960424Z  2025-03-14T06:32:15.3960804Z  2025-03-14T06:32:15.3961323Z  2025-03-14T06:32:15.3961714Z  2025-03-14T06:32:15.3962120Z  2025-03-14T06:32:15.3962539Z  2025-03-14T06:32:15.3963487Z [16,756 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:15.3964642Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T06:32:15.3965672Z Compiling xla/hlo/parser/hlo_parser.cc; 20s local 2025-03-14T06:32:15.3966734Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2025-03-14T06:32:15.3967569Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T06:32:15.3968415Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local 2025-03-14T06:32:15.3969298Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local 2025-03-14T06:32:15.3970160Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 11s local 2025-03-14T06:32:15.3971037Z Compiling xla/service/hlo_cse.cc; 11s local ... 2025-03-14T06:32:15.5963757Z 2025-03-14T06:32:15.5964666Z  2025-03-14T06:32:15.5965119Z  2025-03-14T06:32:15.5965687Z  2025-03-14T06:32:15.5966099Z  2025-03-14T06:32:15.5966468Z  2025-03-14T06:32:15.5966852Z  2025-03-14T06:32:15.5967206Z  2025-03-14T06:32:15.5967573Z  2025-03-14T06:32:15.5968488Z [16,758 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:15.5969489Z @llvm-project//mlir:SparseTensorDialect; 38s local 2025-03-14T06:32:15.5970278Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T06:32:15.5971105Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2025-03-14T06:32:15.5971926Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T06:32:15.5972773Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local 2025-03-14T06:32:15.5973648Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local 2025-03-14T06:32:15.5974329Z Compiling xla/service/hlo_cse.cc; 11s local 2025-03-14T06:32:15.5975199Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 8s local ... 2025-03-14T06:32:15.9975691Z 2025-03-14T06:32:15.9976558Z  2025-03-14T06:32:15.9977051Z  2025-03-14T06:32:15.9977462Z  2025-03-14T06:32:15.9977878Z  2025-03-14T06:32:15.9978268Z  2025-03-14T06:32:15.9978679Z  2025-03-14T06:32:15.9979363Z  2025-03-14T06:32:15.9979786Z  2025-03-14T06:32:15.9980727Z [16,760 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:15.9981798Z @llvm-project//mlir:SparseTensorDialect; 39s local 2025-03-14T06:32:15.9982610Z Compiling xla/hlo/parser/hlo_parser.cc; 21s local 2025-03-14T06:32:15.9983387Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2025-03-14T06:32:15.9984199Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T06:32:15.9984938Z Compiling xla/hlo/ir/hlo_instructions.cc; 12s local 2025-03-14T06:32:15.9985681Z Compiling xla/service/hlo_cse.cc; 12s local 2025-03-14T06:32:15.9986516Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 8s local 2025-03-14T06:32:15.9987760Z Compiling .../translate/hlo_to_mhlo/stack_location_utils.cc; 8s local ... 2025-03-14T06:32:16.7621722Z 2025-03-14T06:32:16.7622549Z  2025-03-14T06:32:16.7623045Z  2025-03-14T06:32:16.7623480Z  2025-03-14T06:32:16.7623884Z  2025-03-14T06:32:16.7624304Z  2025-03-14T06:32:16.7624733Z  2025-03-14T06:32:16.7625149Z  2025-03-14T06:32:16.7625565Z  2025-03-14T06:32:16.7626521Z [16,761 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:16.7627556Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T06:32:16.7628312Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T06:32:16.7629450Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T06:32:16.7630283Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2025-03-14T06:32:16.7631044Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2025-03-14T06:32:16.7631760Z Compiling xla/service/hlo_cse.cc; 12s local 2025-03-14T06:32:16.7632577Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 9s local 2025-03-14T06:32:16.7633605Z Compiling .../translate/hlo_to_mhlo/stack_location_utils.cc; 9s local ... 2025-03-14T06:32:17.0002126Z 2025-03-14T06:32:17.0003002Z  2025-03-14T06:32:17.0003463Z  2025-03-14T06:32:17.0004152Z  2025-03-14T06:32:17.0004670Z  2025-03-14T06:32:17.0005071Z  2025-03-14T06:32:17.0005446Z  2025-03-14T06:32:17.0005839Z  2025-03-14T06:32:17.0006221Z  2025-03-14T06:32:17.0007128Z [16,763 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:17.0008140Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T06:32:17.0008921Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T06:32:17.0009789Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T06:32:17.0010610Z Compiling xla/hlo/ir/hlo_instructions.cc; 13s local 2025-03-14T06:32:17.0011299Z Compiling xla/service/hlo_cse.cc; 13s local 2025-03-14T06:32:17.0012114Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 9s local 2025-03-14T06:32:17.0013242Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 9s local 2025-03-14T06:32:17.0014355Z @xla//xla/hlo/transforms:bitcast_dtypes_expander; 9s local ... 2025-03-14T06:32:17.2008220Z 2025-03-14T06:32:17.2009051Z  2025-03-14T06:32:17.2009523Z  2025-03-14T06:32:17.2009913Z  2025-03-14T06:32:17.2010286Z  2025-03-14T06:32:17.2010678Z  2025-03-14T06:32:17.2011066Z  2025-03-14T06:32:17.2011456Z  2025-03-14T06:32:17.2011875Z  2025-03-14T06:32:17.2012809Z [16,764 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:17.2013807Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T06:32:17.2014578Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T06:32:17.2015423Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T06:32:17.2016511Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T06:32:17.2017234Z Compiling xla/service/hlo_cse.cc; 13s local 2025-03-14T06:32:17.2018044Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 10s local 2025-03-14T06:32:17.2019086Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 9s local 2025-03-14T06:32:17.2020095Z @xla//xla/hlo/transforms:bitcast_dtypes_expander; 9s local ... 2025-03-14T06:32:17.4276512Z 2025-03-14T06:32:17.4277381Z  2025-03-14T06:32:17.4277868Z  2025-03-14T06:32:17.4278277Z  2025-03-14T06:32:17.4278693Z  2025-03-14T06:32:17.4279067Z  2025-03-14T06:32:17.4279468Z  2025-03-14T06:32:17.4279873Z  2025-03-14T06:32:17.4280218Z  2025-03-14T06:32:17.4281094Z [16,765 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:17.4282447Z @llvm-project//mlir:SparseTensorDialect; 40s local 2025-03-14T06:32:17.4283209Z Compiling xla/hlo/parser/hlo_parser.cc; 22s local 2025-03-14T06:32:17.4284038Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T06:32:17.4285079Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T06:32:17.4285970Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 10s local 2025-03-14T06:32:17.4286830Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 10s local 2025-03-14T06:32:17.4287939Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2025-03-14T06:32:17.4288985Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local ... 2025-03-14T06:32:17.8024197Z 2025-03-14T06:32:17.8025086Z  2025-03-14T06:32:17.8025580Z  2025-03-14T06:32:17.8025989Z  2025-03-14T06:32:17.8026438Z  2025-03-14T06:32:17.8026838Z  2025-03-14T06:32:17.8027222Z  2025-03-14T06:32:17.8027625Z  2025-03-14T06:32:17.8028003Z  2025-03-14T06:32:17.8028983Z [16,766 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:32:17.8030066Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T06:32:17.8031017Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T06:32:17.8031853Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T06:32:17.8032701Z Compiling xla/hlo/ir/hlo_instructions.cc; 14s local 2025-03-14T06:32:17.8033644Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 10s local 2025-03-14T06:32:17.8034825Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 10s local 2025-03-14T06:32:17.8035926Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2025-03-14T06:32:17.8037010Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local ... 2025-03-14T06:32:18.1306927Z 2025-03-14T06:32:18.1307746Z  2025-03-14T06:32:18.1308254Z  2025-03-14T06:32:18.1308680Z  2025-03-14T06:32:18.1309112Z  2025-03-14T06:32:18.1309546Z  2025-03-14T06:32:18.1309958Z  2025-03-14T06:32:18.1310306Z  2025-03-14T06:32:18.1310633Z  2025-03-14T06:32:18.1311414Z [16,768 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:18.1312421Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T06:32:18.1313103Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T06:32:18.1313808Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T06:32:18.1314585Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T06:32:18.1315519Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T06:32:18.1316700Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 10s local 2025-03-14T06:32:18.1317896Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2025-03-14T06:32:18.1319067Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local ... 2025-03-14T06:32:18.3766457Z 2025-03-14T06:32:18.3767638Z  2025-03-14T06:32:18.3768188Z  2025-03-14T06:32:18.3768593Z  2025-03-14T06:32:18.3768947Z  2025-03-14T06:32:18.3769366Z  2025-03-14T06:32:18.3769768Z  2025-03-14T06:32:18.3770170Z  2025-03-14T06:32:18.3770588Z  2025-03-14T06:32:18.3771549Z [16,770 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:18.3772483Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T06:32:18.3773225Z Compiling xla/hlo/parser/hlo_parser.cc; 23s local 2025-03-14T06:32:18.3774086Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T06:32:18.3774938Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T06:32:18.3775989Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T06:32:18.3777043Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 11s local 2025-03-14T06:32:18.3778148Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 10s local 2025-03-14T06:32:18.3779197Z Compiling llvm/lib/Analysis/StackSafetyAnalysis.cpp; 10s local ... 2025-03-14T06:32:18.6045822Z 2025-03-14T06:32:18.6046672Z  2025-03-14T06:32:18.6047134Z  2025-03-14T06:32:18.6047540Z  2025-03-14T06:32:18.6047922Z  2025-03-14T06:32:18.6048310Z  2025-03-14T06:32:18.6048681Z  2025-03-14T06:32:18.6049067Z  2025-03-14T06:32:18.6049455Z  2025-03-14T06:32:18.6050717Z [16,775 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:18.6051709Z @llvm-project//mlir:SparseTensorDialect; 41s local 2025-03-14T06:32:18.6052510Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T06:32:18.6053337Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T06:32:18.6054201Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T06:32:18.6055105Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T06:32:18.6056487Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 11s local 2025-03-14T06:32:18.6057641Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T06:32:18.6058790Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 10s local ... 2025-03-14T06:32:18.8308757Z 2025-03-14T06:32:18.8309619Z  2025-03-14T06:32:18.8310091Z  2025-03-14T06:32:18.8310502Z  2025-03-14T06:32:18.8310943Z  2025-03-14T06:32:18.8311348Z  2025-03-14T06:32:18.8311743Z  2025-03-14T06:32:18.8312139Z  2025-03-14T06:32:18.8312528Z  2025-03-14T06:32:18.8313457Z [16,776 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:18.8314451Z @llvm-project//mlir:SparseTensorDialect; 42s local 2025-03-14T06:32:18.8315213Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T06:32:18.8316067Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T06:32:18.8316921Z Compiling xla/hlo/ir/hlo_instructions.cc; 15s local 2025-03-14T06:32:18.8317796Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T06:32:18.8318962Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 11s local 2025-03-14T06:32:18.8319930Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T06:32:18.8320989Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local ... 2025-03-14T06:32:19.1123175Z 2025-03-14T06:32:19.1124102Z  2025-03-14T06:32:19.1124691Z  2025-03-14T06:32:19.1125098Z  2025-03-14T06:32:19.1125549Z  2025-03-14T06:32:19.1125961Z  2025-03-14T06:32:19.1126352Z  2025-03-14T06:32:19.1126751Z  2025-03-14T06:32:19.1127154Z  2025-03-14T06:32:19.1128417Z [16,778 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:19.1129449Z @llvm-project//mlir:SparseTensorDialect; 42s local 2025-03-14T06:32:19.1130239Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T06:32:19.1131076Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T06:32:19.1131949Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T06:32:19.1132913Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 11s local 2025-03-14T06:32:19.1134074Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T06:32:19.1135176Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T06:32:19.1136186Z @xla//xla/hlo/transforms:batch_dot_simplification; 11s local ... 2025-03-14T06:32:19.4068002Z 2025-03-14T06:32:19.4068857Z  2025-03-14T06:32:19.4069355Z  2025-03-14T06:32:19.4069768Z  2025-03-14T06:32:19.4070173Z  2025-03-14T06:32:19.4070569Z  2025-03-14T06:32:19.4071006Z  2025-03-14T06:32:19.4071398Z  2025-03-14T06:32:19.4071799Z  2025-03-14T06:32:19.4072720Z [16,780 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:19.4073700Z @llvm-project//mlir:SparseTensorDialect; 42s local 2025-03-14T06:32:19.4074442Z Compiling xla/hlo/parser/hlo_parser.cc; 24s local 2025-03-14T06:32:19.4075306Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T06:32:19.4076164Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T06:32:19.4077406Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2025-03-14T06:32:19.4078478Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T06:32:19.4079552Z @xla//xla/hlo/transforms:stochastic_convert_decomposer; 11s local 2025-03-14T06:32:19.4080462Z Compiling xla/service/all_to_all_decomposer.cc; 11s local ... 2025-03-14T06:32:19.7198267Z 2025-03-14T06:32:19.7199193Z  2025-03-14T06:32:19.7199660Z  2025-03-14T06:32:19.7200046Z  2025-03-14T06:32:19.7200436Z  2025-03-14T06:32:19.7201112Z  2025-03-14T06:32:19.7201496Z  2025-03-14T06:32:19.7201857Z  2025-03-14T06:32:19.7202331Z  2025-03-14T06:32:19.7203210Z [16,782 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:19.7204147Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T06:32:19.7205098Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T06:32:19.7205943Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T06:32:19.7206796Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T06:32:19.7207776Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2025-03-14T06:32:19.7208915Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T06:32:19.7209887Z Compiling xla/service/all_to_all_decomposer.cc; 11s local 2025-03-14T06:32:19.7210904Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 10s local ... 2025-03-14T06:32:20.0082716Z 2025-03-14T06:32:20.0083536Z  2025-03-14T06:32:20.0084024Z  2025-03-14T06:32:20.0084563Z  2025-03-14T06:32:20.0084975Z  2025-03-14T06:32:20.0085384Z  2025-03-14T06:32:20.0085787Z  2025-03-14T06:32:20.0086187Z  2025-03-14T06:32:20.0086602Z  2025-03-14T06:32:20.0087569Z [16,784 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:20.0088632Z @llvm-project//mlir:SparseTensorDialect; 43s local 2025-03-14T06:32:20.0089444Z Compiling xla/hlo/parser/hlo_parser.cc; 25s local 2025-03-14T06:32:20.0090342Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T06:32:20.0091235Z Compiling xla/hlo/ir/hlo_instructions.cc; 16s local 2025-03-14T06:32:20.0092491Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 12s local 2025-03-14T06:32:20.0093682Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T06:32:20.0094812Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 10s local 2025-03-14T06:32:20.0095937Z @xla//xla/hlo/transforms:optimization_barrier_expander; 10s local ... 2025-03-14T06:32:20.6379454Z 2025-03-14T06:32:20.6380323Z  2025-03-14T06:32:20.6380824Z  2025-03-14T06:32:20.6381242Z  2025-03-14T06:32:20.6381683Z  2025-03-14T06:32:20.6382097Z  2025-03-14T06:32:20.6382508Z  2025-03-14T06:32:20.6382929Z  2025-03-14T06:32:20.6383342Z  2025-03-14T06:32:20.6384205Z [16,785 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:20.6385374Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T06:32:20.6386188Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2025-03-14T06:32:20.6387033Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T06:32:20.6387908Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 13s local 2025-03-14T06:32:20.6388986Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 13s local 2025-03-14T06:32:20.6390037Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local 2025-03-14T06:32:20.6391015Z @xla//xla/hlo/transforms:optimization_barrier_expander; 11s local 2025-03-14T06:32:20.6391871Z Compiling xla/service/hlo_value.cc; 10s local ... 2025-03-14T06:32:20.9470053Z 2025-03-14T06:32:20.9470956Z  2025-03-14T06:32:20.9471445Z  2025-03-14T06:32:20.9471830Z  2025-03-14T06:32:20.9472215Z  2025-03-14T06:32:20.9472640Z  2025-03-14T06:32:20.9473091Z  2025-03-14T06:32:20.9473506Z  2025-03-14T06:32:20.9473895Z  2025-03-14T06:32:20.9474878Z [16,788 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:20.9475913Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T06:32:20.9477076Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2025-03-14T06:32:20.9478033Z Compiling xla/hlo/ir/hlo_instructions.cc; 17s local 2025-03-14T06:32:20.9478961Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 13s local 2025-03-14T06:32:20.9479832Z Compiling xla/service/hlo_value.cc; 10s local 2025-03-14T06:32:20.9480626Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 10s local 2025-03-14T06:32:20.9481526Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T06:32:20.9482507Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local ... 2025-03-14T06:32:21.1511544Z 2025-03-14T06:32:21.1512345Z  2025-03-14T06:32:21.1512758Z  2025-03-14T06:32:21.1513129Z  2025-03-14T06:32:21.1513492Z  2025-03-14T06:32:21.1513851Z  2025-03-14T06:32:21.1514207Z  2025-03-14T06:32:21.1514591Z  2025-03-14T06:32:21.1514970Z  2025-03-14T06:32:21.1515821Z [16,789 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:21.1516710Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T06:32:21.1517465Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2025-03-14T06:32:21.1518223Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T06:32:21.1519077Z Compiling xla/hlo/translate/hlo_to_mhlo/stack_location_utils.cc; 13s local 2025-03-14T06:32:21.1519927Z Compiling xla/service/hlo_value.cc; 11s local 2025-03-14T06:32:21.1520666Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T06:32:21.1521514Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T06:32:21.1522378Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local ... 2025-03-14T06:32:21.4119851Z 2025-03-14T06:32:21.4120698Z  2025-03-14T06:32:21.4121400Z  2025-03-14T06:32:21.4121770Z  2025-03-14T06:32:21.4122148Z  2025-03-14T06:32:21.4122489Z  2025-03-14T06:32:21.4122832Z  2025-03-14T06:32:21.4123175Z  2025-03-14T06:32:21.4123512Z  2025-03-14T06:32:21.4124441Z [16,791 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:21.4125296Z Compiling xla/hlo/parser/hlo_parser.cc; 26s local 2025-03-14T06:32:21.4126043Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T06:32:21.4126780Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T06:32:21.4127414Z Compiling xla/service/hlo_value.cc; 11s local 2025-03-14T06:32:21.4128322Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T06:32:21.4129095Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T06:32:21.4129879Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 10s local 2025-03-14T06:32:21.4130699Z Compiling xla/service/batchnorm_expander.cc; 9s local ... 2025-03-14T06:32:21.6125761Z 2025-03-14T06:32:21.6126586Z  2025-03-14T06:32:21.6127128Z  2025-03-14T06:32:21.6127536Z  2025-03-14T06:32:21.6127948Z  2025-03-14T06:32:21.6128340Z  2025-03-14T06:32:21.6128735Z  2025-03-14T06:32:21.6129122Z  2025-03-14T06:32:21.6129510Z  2025-03-14T06:32:21.6130451Z [16,792 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:21.6131807Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T06:32:21.6132657Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T06:32:21.6133496Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T06:32:21.6134245Z Compiling xla/service/hlo_value.cc; 11s local 2025-03-14T06:32:21.6135065Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T06:32:21.6135950Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T06:32:21.6136894Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T06:32:21.6138047Z Compiling xla/service/batchnorm_expander.cc; 9s local ... 2025-03-14T06:32:21.9549244Z 2025-03-14T06:32:21.9550111Z  2025-03-14T06:32:21.9550626Z  2025-03-14T06:32:21.9551085Z  2025-03-14T06:32:21.9551548Z  2025-03-14T06:32:21.9552015Z  2025-03-14T06:32:21.9552512Z  2025-03-14T06:32:21.9553003Z  2025-03-14T06:32:21.9553486Z  2025-03-14T06:32:21.9554509Z [16,793 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:21.9555634Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T06:32:21.9556731Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T06:32:21.9557539Z Compiling xla/hlo/ir/hlo_instructions.cc; 18s local 2025-03-14T06:32:21.9558191Z Compiling xla/service/hlo_value.cc; 12s local 2025-03-14T06:32:21.9558940Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T06:32:21.9559781Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T06:32:21.9560766Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T06:32:21.9561806Z Compiling xla/service/batchnorm_expander.cc; 10s local ... 2025-03-14T06:32:22.2142214Z 2025-03-14T06:32:22.2143071Z  2025-03-14T06:32:22.2143570Z  2025-03-14T06:32:22.2144012Z  2025-03-14T06:32:22.2144442Z  2025-03-14T06:32:22.2144873Z  2025-03-14T06:32:22.2145282Z  2025-03-14T06:32:22.2145703Z  2025-03-14T06:32:22.2146091Z  2025-03-14T06:32:22.2147075Z [16,793 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:22.2148114Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T06:32:22.2149343Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T06:32:22.2150236Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T06:32:22.2151024Z Compiling xla/service/hlo_value.cc; 12s local 2025-03-14T06:32:22.2151934Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 12s local 2025-03-14T06:32:22.2152917Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T06:32:22.2153928Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 11s local 2025-03-14T06:32:22.2154998Z Compiling xla/service/batchnorm_expander.cc; 10s local ... 2025-03-14T06:32:22.4147394Z 2025-03-14T06:32:22.4148227Z  2025-03-14T06:32:22.4148713Z  2025-03-14T06:32:22.4149122Z  2025-03-14T06:32:22.4149527Z  2025-03-14T06:32:22.4150190Z  2025-03-14T06:32:22.4150595Z  2025-03-14T06:32:22.4150996Z  2025-03-14T06:32:22.4151370Z  2025-03-14T06:32:22.4152320Z [16,794 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:22.4153464Z Compiling xla/hlo/parser/hlo_parser.cc; 27s local 2025-03-14T06:32:22.4154356Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T06:32:22.4155232Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T06:32:22.4156140Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 12s local 2025-03-14T06:32:22.4157091Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T06:32:22.4157963Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T06:32:22.4159182Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T06:32:22.4160140Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 9s local ... 2025-03-14T06:32:22.6529058Z 2025-03-14T06:32:22.6529939Z  2025-03-14T06:32:22.6530433Z  2025-03-14T06:32:22.6530858Z  2025-03-14T06:32:22.6531268Z  2025-03-14T06:32:22.6531671Z  2025-03-14T06:32:22.6532095Z  2025-03-14T06:32:22.6532549Z  2025-03-14T06:32:22.6532974Z  2025-03-14T06:32:22.6534247Z [16,797 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:22.6535442Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T06:32:22.6536320Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T06:32:22.6537243Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T06:32:22.6538052Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T06:32:22.6539005Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T06:32:22.6539987Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T06:32:22.6540913Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2025-03-14T06:32:22.6541885Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local ... 2025-03-14T06:32:22.9035921Z 2025-03-14T06:32:22.9036778Z  2025-03-14T06:32:22.9037236Z  2025-03-14T06:32:22.9037691Z  2025-03-14T06:32:22.9038110Z  2025-03-14T06:32:22.9038534Z  2025-03-14T06:32:22.9038950Z  2025-03-14T06:32:22.9039362Z  2025-03-14T06:32:22.9039774Z  2025-03-14T06:32:22.9040703Z [16,801 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:22.9041690Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T06:32:22.9042543Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T06:32:22.9043464Z Compiling xla/hlo/ir/hlo_instructions.cc; 19s local 2025-03-14T06:32:22.9044262Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T06:32:22.9045399Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T06:32:22.9046369Z Compiling xla/service/batchnorm_expander.cc; 10s local 2025-03-14T06:32:22.9047347Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2025-03-14T06:32:22.9048526Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local ... 2025-03-14T06:32:23.2167491Z 2025-03-14T06:32:23.2168328Z  2025-03-14T06:32:23.2168802Z  2025-03-14T06:32:23.2169193Z  2025-03-14T06:32:23.2169631Z  2025-03-14T06:32:23.2169966Z  2025-03-14T06:32:23.2170367Z  2025-03-14T06:32:23.2170746Z  2025-03-14T06:32:23.2171171Z  2025-03-14T06:32:23.2171991Z [16,803 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:23.2172891Z Compiling xla/hlo/parser/hlo_parser.cc; 28s local 2025-03-14T06:32:23.2173687Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T06:32:23.2174391Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T06:32:23.2175440Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T06:32:23.2176314Z Compiling xla/hlo/transforms/expanders/rng_expander.cc; 12s local 2025-03-14T06:32:23.2177127Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T06:32:23.2177953Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2025-03-14T06:32:23.2178651Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local ... 2025-03-14T06:32:23.6178330Z 2025-03-14T06:32:23.6179182Z  2025-03-14T06:32:23.6179683Z  2025-03-14T06:32:23.6180120Z  2025-03-14T06:32:23.6180531Z  2025-03-14T06:32:23.6180958Z  2025-03-14T06:32:23.6181374Z  2025-03-14T06:32:23.6181770Z  2025-03-14T06:32:23.6182461Z  2025-03-14T06:32:23.6183451Z [16,807 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:23.6184513Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T06:32:23.6185452Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T06:32:23.6186370Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T06:32:23.6187205Z Compiling xla/service/batchnorm_expander.cc; 13s local 2025-03-14T06:32:23.6188096Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T06:32:23.6189233Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2025-03-14T06:32:23.6190192Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local 2025-03-14T06:32:23.6191158Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local ... 2025-03-14T06:32:23.8184186Z 2025-03-14T06:32:23.8184985Z  2025-03-14T06:32:23.8185561Z  2025-03-14T06:32:23.8185935Z  2025-03-14T06:32:23.8186338Z  2025-03-14T06:32:23.8186699Z  2025-03-14T06:32:23.8187056Z  2025-03-14T06:32:23.8187415Z  2025-03-14T06:32:23.8187767Z  2025-03-14T06:32:23.8188631Z [16,808 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:23.8189546Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T06:32:23.8190325Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T06:32:23.8191122Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T06:32:23.8191838Z Compiling xla/service/batchnorm_expander.cc; 13s local 2025-03-14T06:32:23.8192577Z Compiling xla/service/batchnorm_expander.cc; 11s local 2025-03-14T06:32:23.8193391Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2025-03-14T06:32:23.8194189Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2025-03-14T06:32:23.8194973Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local ... 2025-03-14T06:32:24.0215824Z 2025-03-14T06:32:24.0216664Z  2025-03-14T06:32:24.0217119Z  2025-03-14T06:32:24.0217492Z  2025-03-14T06:32:24.0217861Z  2025-03-14T06:32:24.0218271Z  2025-03-14T06:32:24.0218637Z  2025-03-14T06:32:24.0218999Z  2025-03-14T06:32:24.0219355Z  2025-03-14T06:32:24.0220214Z [16,811 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:24.0221315Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T06:32:24.0222107Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T06:32:24.0222882Z Compiling xla/hlo/ir/hlo_instructions.cc; 20s local 2025-03-14T06:32:24.0223603Z Compiling xla/service/batchnorm_expander.cc; 13s local 2025-03-14T06:32:24.0224347Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T06:32:24.0225238Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2025-03-14T06:32:24.0226073Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2025-03-14T06:32:24.0226882Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local ... 2025-03-14T06:32:24.3140701Z 2025-03-14T06:32:24.3141833Z  2025-03-14T06:32:24.3142369Z  2025-03-14T06:32:24.3142781Z  2025-03-14T06:32:24.3143181Z  2025-03-14T06:32:24.3143596Z  2025-03-14T06:32:24.3144008Z  2025-03-14T06:32:24.3144403Z  2025-03-14T06:32:24.3144819Z  2025-03-14T06:32:24.3145863Z [16,813 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:24.3146917Z Compiling xla/hlo/parser/hlo_parser.cc; 29s local 2025-03-14T06:32:24.3147732Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T06:32:24.3148575Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T06:32:24.3149366Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T06:32:24.3150485Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2025-03-14T06:32:24.3151513Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2025-03-14T06:32:24.3152440Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 10s local 2025-03-14T06:32:24.3153579Z Compiling .../transforms/simplifiers/float_normalization.cc; 10s local ... 2025-03-14T06:32:24.6099847Z 2025-03-14T06:32:24.6100681Z  2025-03-14T06:32:24.6101197Z  2025-03-14T06:32:24.6101644Z  2025-03-14T06:32:24.6102070Z  2025-03-14T06:32:24.6102469Z  2025-03-14T06:32:24.6102887Z  2025-03-14T06:32:24.6103263Z  2025-03-14T06:32:24.6103916Z  2025-03-14T06:32:24.6105010Z [16,814 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:24.6106036Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T06:32:24.6106914Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T06:32:24.6107827Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T06:32:24.6108700Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T06:32:24.6109687Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2025-03-14T06:32:24.6110606Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2025-03-14T06:32:24.6111542Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T06:32:24.6112707Z Compiling .../transforms/simplifiers/float_normalization.cc; 10s local ... 2025-03-14T06:32:24.8210584Z 2025-03-14T06:32:24.8211375Z  2025-03-14T06:32:24.8211883Z  2025-03-14T06:32:24.8212321Z  2025-03-14T06:32:24.8212763Z  2025-03-14T06:32:24.8213162Z  2025-03-14T06:32:24.8213565Z  2025-03-14T06:32:24.8213974Z  2025-03-14T06:32:24.8214360Z  2025-03-14T06:32:24.8215332Z [16,814 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:24.8216365Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T06:32:24.8217247Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T06:32:24.8218144Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T06:32:24.8218977Z Compiling xla/service/batchnorm_expander.cc; 12s local 2025-03-14T06:32:24.8219874Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2025-03-14T06:32:24.8220979Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T06:32:24.8221837Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T06:32:24.8222892Z Compiling .../transforms/simplifiers/float_normalization.cc; 10s local ... 2025-03-14T06:32:25.0215511Z 2025-03-14T06:32:25.0216320Z  2025-03-14T06:32:25.0216815Z  2025-03-14T06:32:25.0217216Z  2025-03-14T06:32:25.0217641Z  2025-03-14T06:32:25.0218061Z  2025-03-14T06:32:25.0218486Z  2025-03-14T06:32:25.0218913Z  2025-03-14T06:32:25.0219364Z  2025-03-14T06:32:25.0220356Z [16,815 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:25.0221385Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T06:32:25.0222601Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T06:32:25.0223492Z Compiling xla/hlo/ir/hlo_instructions.cc; 21s local 2025-03-14T06:32:25.0224342Z Compiling xla/service/batchnorm_expander.cc; 13s local 2025-03-14T06:32:25.0225328Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2025-03-14T06:32:25.0226233Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T06:32:25.0227079Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T06:32:25.0228083Z Compiling .../transforms/simplifiers/float_normalization.cc; 11s local ... 2025-03-14T06:32:25.2911699Z 2025-03-14T06:32:25.2912512Z  2025-03-14T06:32:25.2913005Z  2025-03-14T06:32:25.2913722Z  2025-03-14T06:32:25.2914093Z  2025-03-14T06:32:25.2914451Z  2025-03-14T06:32:25.2914822Z  2025-03-14T06:32:25.2915186Z  2025-03-14T06:32:25.2915578Z  2025-03-14T06:32:25.2916553Z [16,818 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:25.2917710Z Compiling xla/hlo/parser/hlo_parser.cc; 30s local 2025-03-14T06:32:25.2918539Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T06:32:25.2919319Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T06:32:25.2920294Z Compiling xla/service/batchnorm_expander.cc; 13s local 2025-03-14T06:32:25.2921068Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2025-03-14T06:32:25.2921940Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T06:32:25.2922795Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 11s local 2025-03-14T06:32:25.2924041Z Compiling .../transforms/simplifiers/float_normalization.cc; 11s local ... 2025-03-14T06:32:25.5975890Z 2025-03-14T06:32:25.5976769Z  2025-03-14T06:32:25.5977275Z  2025-03-14T06:32:25.5977697Z  2025-03-14T06:32:25.5978131Z  2025-03-14T06:32:25.5978520Z  2025-03-14T06:32:25.5978914Z  2025-03-14T06:32:25.5979303Z  2025-03-14T06:32:25.5979698Z  2025-03-14T06:32:25.5980667Z [16,821 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:25.5981648Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T06:32:25.5982516Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T06:32:25.5983383Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T06:32:25.5984140Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T06:32:25.5984938Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local 2025-03-14T06:32:25.5986047Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 11s local 2025-03-14T06:32:25.5987189Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 10s local 2025-03-14T06:32:25.5988063Z Compiling xla/hlo/builder/lib/math.cc; 8s local ... 2025-03-14T06:32:25.8236715Z 2025-03-14T06:32:25.8237568Z  2025-03-14T06:32:25.8238056Z  2025-03-14T06:32:25.8238452Z  2025-03-14T06:32:25.8238863Z  2025-03-14T06:32:25.8239272Z  2025-03-14T06:32:25.8239678Z  2025-03-14T06:32:25.8240369Z  2025-03-14T06:32:25.8240817Z  2025-03-14T06:32:25.8241731Z [16,822 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:25.8242686Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T06:32:25.8243489Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T06:32:25.8244492Z Compiling xla/hlo/ir/hlo_instructions.cc; 22s local 2025-03-14T06:32:25.8245220Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T06:32:25.8246232Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local 2025-03-14T06:32:25.8247366Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 11s local 2025-03-14T06:32:25.8248761Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 10s local 2025-03-14T06:32:25.8249682Z Compiling xla/hlo/builder/lib/math.cc; 8s local ... 2025-03-14T06:32:26.1585703Z 2025-03-14T06:32:26.1586522Z  2025-03-14T06:32:26.1586996Z  2025-03-14T06:32:26.1587371Z  2025-03-14T06:32:26.1587746Z  2025-03-14T06:32:26.1588108Z  2025-03-14T06:32:26.1588497Z  2025-03-14T06:32:26.1588856Z  2025-03-14T06:32:26.1589212Z  2025-03-14T06:32:26.1590064Z [16,824 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:26.1590945Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T06:32:26.1591715Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T06:32:26.1592826Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T06:32:26.1593619Z @xla//xla/hlo/transforms:rng_bit_generator_expander; 12s local 2025-03-14T06:32:26.1594650Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T06:32:26.1595699Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 10s local 2025-03-14T06:32:26.1596460Z Compiling xla/hlo/builder/lib/math.cc; 9s local 2025-03-14T06:32:26.1597222Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 7s local ... 2025-03-14T06:32:26.4252702Z 2025-03-14T06:32:26.4253543Z  2025-03-14T06:32:26.4254335Z  2025-03-14T06:32:26.4254786Z  2025-03-14T06:32:26.4255165Z  2025-03-14T06:32:26.4255494Z  2025-03-14T06:32:26.4255841Z  2025-03-14T06:32:26.4256197Z  2025-03-14T06:32:26.4256561Z  2025-03-14T06:32:26.4257474Z [16,827 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:26.4258476Z Compiling xla/hlo/parser/hlo_parser.cc; 31s local 2025-03-14T06:32:26.4259321Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T06:32:26.4260156Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T06:32:26.4261155Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 12s local 2025-03-14T06:32:26.4262252Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 10s local 2025-03-14T06:32:26.4263133Z Compiling xla/hlo/builder/lib/math.cc; 9s local 2025-03-14T06:32:26.4263886Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 8s local 2025-03-14T06:32:26.4264803Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 7s local ... 2025-03-14T06:32:27.0097214Z 2025-03-14T06:32:27.0098118Z  2025-03-14T06:32:27.0098600Z  2025-03-14T06:32:27.0099006Z  2025-03-14T06:32:27.0099394Z  2025-03-14T06:32:27.0099777Z  2025-03-14T06:32:27.0100172Z  2025-03-14T06:32:27.0100616Z  2025-03-14T06:32:27.0101008Z  2025-03-14T06:32:27.0102101Z [16,828 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:27.0103193Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T06:32:27.0104082Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T06:32:27.0104956Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T06:32:27.0106257Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2025-03-14T06:32:27.0107448Z @xla//xla/hlo/transforms:dynamic_dimension_simplifier; 11s local 2025-03-14T06:32:27.0108397Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2025-03-14T06:32:27.0109171Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 8s local 2025-03-14T06:32:27.0110090Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local ... 2025-03-14T06:32:27.2281126Z 2025-03-14T06:32:27.2282013Z  2025-03-14T06:32:27.2282540Z  2025-03-14T06:32:27.2282943Z  2025-03-14T06:32:27.2283308Z  2025-03-14T06:32:27.2283671Z  2025-03-14T06:32:27.2284049Z  2025-03-14T06:32:27.2284570Z  2025-03-14T06:32:27.2285266Z  2025-03-14T06:32:27.2286188Z [16,830 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:27.2297119Z Compiling xla/hlo/parser/hlo_parser.cc; 32s local 2025-03-14T06:32:27.2298340Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T06:32:27.2299390Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T06:32:27.2300457Z Compiling xla/hlo/transforms/simplifiers/float_normalization.cc; 13s local 2025-03-14T06:32:27.2301417Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2025-03-14T06:32:27.2302216Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 8s local 2025-03-14T06:32:27.2303138Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 8s local 2025-03-14T06:32:27.2304480Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 8s local ... 2025-03-14T06:32:27.5649261Z 2025-03-14T06:32:27.5650104Z  2025-03-14T06:32:27.5650576Z  2025-03-14T06:32:27.5651012Z  2025-03-14T06:32:27.5651412Z  2025-03-14T06:32:27.5651802Z  2025-03-14T06:32:27.5652203Z  2025-03-14T06:32:27.5652588Z  2025-03-14T06:32:27.5652977Z  2025-03-14T06:32:27.5654031Z [16,831 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:27.5655334Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T06:32:27.5656229Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T06:32:27.5657100Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T06:32:27.5657882Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2025-03-14T06:32:27.5658674Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 9s local 2025-03-14T06:32:27.5659593Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2025-03-14T06:32:27.5660616Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 8s local 2025-03-14T06:32:27.5661657Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 8s local ... 2025-03-14T06:32:27.7775773Z 2025-03-14T06:32:27.7776640Z  2025-03-14T06:32:27.7777105Z  2025-03-14T06:32:27.7777510Z  2025-03-14T06:32:27.7777876Z  2025-03-14T06:32:27.7778265Z  2025-03-14T06:32:27.7778675Z  2025-03-14T06:32:27.7779049Z  2025-03-14T06:32:27.7779480Z  2025-03-14T06:32:27.7780412Z [16,834 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:27.7781342Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T06:32:27.7782174Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T06:32:27.7783072Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T06:32:27.7783754Z Compiling xla/hlo/builder/lib/math.cc; 10s local 2025-03-14T06:32:27.7784517Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 9s local 2025-03-14T06:32:27.7785386Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2025-03-14T06:32:27.7786392Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 8s local 2025-03-14T06:32:27.7787539Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 8s local ... 2025-03-14T06:32:28.0296272Z 2025-03-14T06:32:28.0297450Z  2025-03-14T06:32:28.0298063Z  2025-03-14T06:32:28.0298464Z  2025-03-14T06:32:28.0298856Z  2025-03-14T06:32:28.0299281Z  2025-03-14T06:32:28.0299672Z  2025-03-14T06:32:28.0300069Z  2025-03-14T06:32:28.0300475Z  2025-03-14T06:32:28.0301498Z [16,834 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:28.0302492Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T06:32:28.0303429Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T06:32:28.0304264Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T06:32:28.0304978Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2025-03-14T06:32:28.0306035Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 9s local 2025-03-14T06:32:28.0306933Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2025-03-14T06:32:28.0307974Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 9s local 2025-03-14T06:32:28.0309019Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 8s local ... 2025-03-14T06:32:28.4304772Z 2025-03-14T06:32:28.4305740Z  2025-03-14T06:32:28.4306249Z  2025-03-14T06:32:28.4306649Z  2025-03-14T06:32:28.4307039Z  2025-03-14T06:32:28.4307435Z  2025-03-14T06:32:28.4307819Z  2025-03-14T06:32:28.4308219Z  2025-03-14T06:32:28.4308608Z  2025-03-14T06:32:28.4309553Z [16,835 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:28.4310857Z Compiling xla/hlo/parser/hlo_parser.cc; 33s local 2025-03-14T06:32:28.4311707Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T06:32:28.4312620Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T06:32:28.4313380Z Compiling xla/hlo/builder/lib/math.cc; 11s local 2025-03-14T06:32:28.4314197Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 10s local 2025-03-14T06:32:28.4315161Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 9s local 2025-03-14T06:32:28.4316411Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 9s local 2025-03-14T06:32:28.4317394Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 9s local ... 2025-03-14T06:32:28.8315507Z 2025-03-14T06:32:28.8316446Z  2025-03-14T06:32:28.8316943Z  2025-03-14T06:32:28.8317349Z  2025-03-14T06:32:28.8317743Z  2025-03-14T06:32:28.8318145Z  2025-03-14T06:32:28.8318589Z  2025-03-14T06:32:28.8318994Z  2025-03-14T06:32:28.8319373Z  2025-03-14T06:32:28.8320359Z [16,836 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:28.8321391Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T06:32:28.8322262Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T06:32:28.8323145Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T06:32:28.8323914Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T06:32:28.8324866Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 10s local 2025-03-14T06:32:28.8325785Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2025-03-14T06:32:28.8326823Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 9s local 2025-03-14T06:32:28.8327945Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 9s local ... 2025-03-14T06:32:29.0621508Z 2025-03-14T06:32:29.0622821Z  2025-03-14T06:32:29.0623354Z  2025-03-14T06:32:29.0623775Z  2025-03-14T06:32:29.0624216Z  2025-03-14T06:32:29.0624627Z  2025-03-14T06:32:29.0625043Z  2025-03-14T06:32:29.0625446Z  2025-03-14T06:32:29.0625908Z  2025-03-14T06:32:29.0626793Z [16,837 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:29.0627801Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T06:32:29.0629165Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T06:32:29.0630215Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T06:32:29.0630980Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T06:32:29.0631896Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 10s local 2025-03-14T06:32:29.0632799Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2025-03-14T06:32:29.0633863Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local 2025-03-14T06:32:29.0634972Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 9s local ... 2025-03-14T06:32:29.3185062Z 2025-03-14T06:32:29.3185928Z  2025-03-14T06:32:29.3186452Z  2025-03-14T06:32:29.3187119Z  2025-03-14T06:32:29.3187503Z  2025-03-14T06:32:29.3187900Z  2025-03-14T06:32:29.3188325Z  2025-03-14T06:32:29.3188738Z  2025-03-14T06:32:29.3189160Z  2025-03-14T06:32:29.3190123Z [16,840 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:29.3191113Z Compiling xla/hlo/parser/hlo_parser.cc; 34s local 2025-03-14T06:32:29.3191993Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T06:32:29.3192845Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T06:32:29.3193637Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T06:32:29.3194424Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 10s local 2025-03-14T06:32:29.3195571Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 10s local 2025-03-14T06:32:29.3196578Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local 2025-03-14T06:32:29.3197582Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 10s local ... 2025-03-14T06:32:29.6103258Z 2025-03-14T06:32:29.6104225Z  2025-03-14T06:32:29.6104724Z  2025-03-14T06:32:29.6105138Z  2025-03-14T06:32:29.6105564Z  2025-03-14T06:32:29.6106127Z  2025-03-14T06:32:29.6106573Z  2025-03-14T06:32:29.6107095Z  2025-03-14T06:32:29.6107616Z  2025-03-14T06:32:29.6108988Z [16,842 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:29.6110257Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T06:32:29.6111137Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T06:32:29.6111985Z Compiling xla/hlo/builder/lib/math.cc; 12s local 2025-03-14T06:32:29.6112872Z Compiling xla/hlo/ir/hlo_sharding_metadata.cc; 11s local 2025-03-14T06:32:29.6113903Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2025-03-14T06:32:29.6115048Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local 2025-03-14T06:32:29.6116286Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T06:32:29.6117579Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local ... 2025-03-14T06:32:29.8340807Z 2025-03-14T06:32:29.8341719Z  2025-03-14T06:32:29.8342211Z  2025-03-14T06:32:29.8342637Z  2025-03-14T06:32:29.8343046Z  2025-03-14T06:32:29.8343450Z  2025-03-14T06:32:29.8343866Z  2025-03-14T06:32:29.8344255Z  2025-03-14T06:32:29.8344654Z  2025-03-14T06:32:29.8345749Z [16,843 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:29.8347225Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T06:32:29.8348226Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T06:32:29.8349128Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T06:32:29.8350157Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2025-03-14T06:32:29.8351399Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local 2025-03-14T06:32:29.8352729Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T06:32:29.8354289Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local 2025-03-14T06:32:29.8355678Z Compiling llvm/lib/Analysis/ConstantFolding.cpp; 10s local ... 2025-03-14T06:32:30.0769700Z 2025-03-14T06:32:30.0770668Z  2025-03-14T06:32:30.0771217Z  2025-03-14T06:32:30.0771675Z  2025-03-14T06:32:30.0772103Z  2025-03-14T06:32:30.0772549Z  2025-03-14T06:32:30.0772979Z  2025-03-14T06:32:30.0773429Z  2025-03-14T06:32:30.0773852Z  2025-03-14T06:32:30.0774867Z [16,845 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:30.0775975Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T06:32:30.0776812Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T06:32:30.0777953Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T06:32:30.0778896Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2025-03-14T06:32:30.0780037Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T06:32:30.0781290Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T06:32:30.0783064Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local 2025-03-14T06:32:30.0784439Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 10s local ... 2025-03-14T06:32:30.4357711Z 2025-03-14T06:32:30.4359811Z  2025-03-14T06:32:30.4360364Z  2025-03-14T06:32:30.4360796Z  2025-03-14T06:32:30.4361585Z  2025-03-14T06:32:30.4361994Z  2025-03-14T06:32:30.4362413Z  2025-03-14T06:32:30.4362851Z  2025-03-14T06:32:30.4363308Z  2025-03-14T06:32:30.4364314Z [16,846 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:30.4365800Z Compiling xla/hlo/parser/hlo_parser.cc; 35s local 2025-03-14T06:32:30.4366573Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T06:32:30.4367464Z Compiling xla/hlo/builder/lib/math.cc; 13s local 2025-03-14T06:32:30.4368338Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 11s local 2025-03-14T06:32:30.4369651Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T06:32:30.4370822Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2025-03-14T06:32:30.4371968Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 10s local 2025-03-14T06:32:30.4373050Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 10s local ... 2025-03-14T06:32:30.8865632Z 2025-03-14T06:32:30.8866558Z  2025-03-14T06:32:30.8867092Z  2025-03-14T06:32:30.8867546Z  2025-03-14T06:32:30.8868023Z  2025-03-14T06:32:30.8868443Z  2025-03-14T06:32:30.8868879Z  2025-03-14T06:32:30.8869337Z  2025-03-14T06:32:30.8869799Z  2025-03-14T06:32:30.8870813Z [16,847 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:30.8871946Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T06:32:30.8872815Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T06:32:30.8873601Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T06:32:30.8874486Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2025-03-14T06:32:30.8875633Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T06:32:30.8876830Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T06:32:30.8878134Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local 2025-03-14T06:32:30.8879168Z Compiling .../translate/hlo_to_mhlo/location_importer.cc; 10s local ... 2025-03-14T06:32:31.1164092Z 2025-03-14T06:32:31.1165070Z  2025-03-14T06:32:31.1165796Z  2025-03-14T06:32:31.1166201Z  2025-03-14T06:32:31.1166595Z  2025-03-14T06:32:31.1167002Z  2025-03-14T06:32:31.1167672Z  2025-03-14T06:32:31.1168077Z  2025-03-14T06:32:31.1168471Z  2025-03-14T06:32:31.1169436Z [16,848 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:31.1170419Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T06:32:31.1171192Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T06:32:31.1171949Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T06:32:31.1172805Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2025-03-14T06:32:31.1173887Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 12s local 2025-03-14T06:32:31.1175000Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T06:32:31.1176486Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local 2025-03-14T06:32:31.1177589Z Compiling .../translate/hlo_to_mhlo/location_importer.cc; 10s local ... 2025-03-14T06:32:31.3417157Z 2025-03-14T06:32:31.3418040Z  2025-03-14T06:32:31.3418583Z  2025-03-14T06:32:31.3418923Z  2025-03-14T06:32:31.3419311Z  2025-03-14T06:32:31.3419746Z  2025-03-14T06:32:31.3420134Z  2025-03-14T06:32:31.3420520Z  2025-03-14T06:32:31.3420928Z  2025-03-14T06:32:31.3421868Z [16,851 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:31.3422863Z Compiling xla/hlo/parser/hlo_parser.cc; 36s local 2025-03-14T06:32:31.3423917Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T06:32:31.3424667Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T06:32:31.3425504Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 12s local 2025-03-14T06:32:31.3426574Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 11s local 2025-03-14T06:32:31.3427693Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local 2025-03-14T06:32:31.3428943Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 10s local 2025-03-14T06:32:31.3429973Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local ... 2025-03-14T06:32:31.6136706Z 2025-03-14T06:32:31.6137548Z  2025-03-14T06:32:31.6138038Z  2025-03-14T06:32:31.6138449Z  2025-03-14T06:32:31.6138831Z  2025-03-14T06:32:31.6139233Z  2025-03-14T06:32:31.6139636Z  2025-03-14T06:32:31.6140039Z  2025-03-14T06:32:31.6140433Z  2025-03-14T06:32:31.6141365Z [16,855 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:32:31.6142343Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T06:32:31.6143090Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T06:32:31.6143975Z Compiling xla/hlo/builder/lib/math.cc; 14s local 2025-03-14T06:32:31.6144857Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2025-03-14T06:32:31.6145865Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 12s local 2025-03-14T06:32:31.6146880Z Compiling xla/hlo/transforms/simplifiers/result_caster.cc; 11s local 2025-03-14T06:32:31.6147976Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 10s local 2025-03-14T06:32:31.6149093Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local ... 2025-03-14T06:32:31.8396482Z 2025-03-14T06:32:31.8397336Z  2025-03-14T06:32:31.8397811Z  2025-03-14T06:32:31.8398235Z  2025-03-14T06:32:31.8398661Z  2025-03-14T06:32:31.8399088Z  2025-03-14T06:32:31.8399473Z  2025-03-14T06:32:31.8399852Z  2025-03-14T06:32:31.8400288Z  2025-03-14T06:32:31.8401283Z [16,856 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:31.8402287Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T06:32:31.8402932Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T06:32:31.8403972Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2025-03-14T06:32:31.8404987Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2025-03-14T06:32:31.8406022Z Compiling xla/hlo/transforms/simplifiers/reshape_mover.cc; 12s local 2025-03-14T06:32:31.8407224Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 11s local 2025-03-14T06:32:31.8408275Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T06:32:31.8409179Z @xla//xla/hlo/transforms:optimization_barrier_expander; 11s local ... 2025-03-14T06:32:32.0756705Z 2025-03-14T06:32:32.0757575Z  2025-03-14T06:32:32.0758117Z  2025-03-14T06:32:32.0758531Z  2025-03-14T06:32:32.0758913Z  2025-03-14T06:32:32.0759336Z  2025-03-14T06:32:32.0760050Z  2025-03-14T06:32:32.0760464Z  2025-03-14T06:32:32.0760881Z  2025-03-14T06:32:32.0761807Z [16,858 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:32.0762864Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T06:32:32.0763623Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T06:32:32.0764527Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2025-03-14T06:32:32.0765610Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2025-03-14T06:32:32.0766635Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 11s local 2025-03-14T06:32:32.0767661Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T06:32:32.0768842Z @xla//xla/hlo/transforms:optimization_barrier_expander; 11s local 2025-03-14T06:32:32.0769827Z @xla//xla/hlo/transforms:bitcast_dtypes_expander; 11s local ... 2025-03-14T06:32:32.3693757Z 2025-03-14T06:32:32.3694640Z  2025-03-14T06:32:32.3695166Z  2025-03-14T06:32:32.3695562Z  2025-03-14T06:32:32.3695956Z  2025-03-14T06:32:32.3696368Z  2025-03-14T06:32:32.3696767Z  2025-03-14T06:32:32.3697172Z  2025-03-14T06:32:32.3697564Z  2025-03-14T06:32:32.3698569Z [16,861 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:32.3699873Z Compiling xla/hlo/parser/hlo_parser.cc; 37s local 2025-03-14T06:32:32.3700700Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T06:32:32.3701566Z Compiling xla/hlo/builder/lib/math.cc; 15s local 2025-03-14T06:32:32.3702421Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 13s local 2025-03-14T06:32:32.3703521Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 11s local 2025-03-14T06:32:32.3704549Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T06:32:32.3705557Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T06:32:32.3706521Z Compiling xla/service/hlo_value.cc; 9s local ... 2025-03-14T06:32:32.6418173Z 2025-03-14T06:32:32.6419030Z  2025-03-14T06:32:32.6419504Z  2025-03-14T06:32:32.6420069Z  2025-03-14T06:32:32.6420483Z  2025-03-14T06:32:32.6420894Z  2025-03-14T06:32:32.6421304Z  2025-03-14T06:32:32.6421712Z  2025-03-14T06:32:32.6422123Z  2025-03-14T06:32:32.6423091Z [16,865 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:32.6424118Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T06:32:32.6424907Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T06:32:32.6425832Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T06:32:32.6426898Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 11s local 2025-03-14T06:32:32.6428051Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 11s local 2025-03-14T06:32:32.6429021Z Compiling xla/service/hlo_value.cc; 10s local 2025-03-14T06:32:32.6429893Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 10s local 2025-03-14T06:32:32.6431163Z Compiling xla/hlo/ir/hlo_computation.cc; 9s local ... 2025-03-14T06:32:33.1531206Z 2025-03-14T06:32:33.1531992Z  2025-03-14T06:32:33.1532433Z  2025-03-14T06:32:33.1532820Z  2025-03-14T06:32:33.1533156Z  2025-03-14T06:32:33.1533514Z  2025-03-14T06:32:33.1533866Z  2025-03-14T06:32:33.1534215Z  2025-03-14T06:32:33.1534684Z  2025-03-14T06:32:33.1535477Z [16,866 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:33.1536318Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T06:32:33.1536963Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T06:32:33.1537704Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T06:32:33.1538831Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 12s local 2025-03-14T06:32:33.1539735Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T06:32:33.1540506Z Compiling xla/service/hlo_value.cc; 10s local 2025-03-14T06:32:33.1541187Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 10s local 2025-03-14T06:32:33.1541946Z Compiling xla/hlo/ir/hlo_computation.cc; 9s local ... 2025-03-14T06:32:33.4439873Z 2025-03-14T06:32:33.4440736Z  2025-03-14T06:32:33.4441176Z  2025-03-14T06:32:33.4441567Z  2025-03-14T06:32:33.4441998Z  2025-03-14T06:32:33.4442352Z  2025-03-14T06:32:33.4442731Z  2025-03-14T06:32:33.4443134Z  2025-03-14T06:32:33.4443874Z  2025-03-14T06:32:33.4444936Z [16,867 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:33.4445938Z Compiling xla/hlo/parser/hlo_parser.cc; 38s local 2025-03-14T06:32:33.4446694Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T06:32:33.4447556Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 14s local 2025-03-14T06:32:33.4448589Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 12s local 2025-03-14T06:32:33.4449780Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T06:32:33.4450861Z Compiling xla/service/hlo_value.cc; 11s local 2025-03-14T06:32:33.4451709Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T06:32:33.4452618Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local ... 2025-03-14T06:32:33.7876563Z 2025-03-14T06:32:33.7877424Z  2025-03-14T06:32:33.7877931Z  2025-03-14T06:32:33.7878362Z  2025-03-14T06:32:33.7878739Z  2025-03-14T06:32:33.7879117Z  2025-03-14T06:32:33.7879547Z  2025-03-14T06:32:33.7879957Z  2025-03-14T06:32:33.7880362Z  2025-03-14T06:32:33.7881315Z [16,868 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:33.7882341Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2025-03-14T06:32:33.7883175Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T06:32:33.7884090Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2025-03-14T06:32:33.7885354Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2025-03-14T06:32:33.7886414Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 12s local 2025-03-14T06:32:33.7887277Z Compiling xla/service/hlo_value.cc; 11s local 2025-03-14T06:32:33.7888103Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T06:32:33.7889053Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local ... 2025-03-14T06:32:33.9862171Z 2025-03-14T06:32:33.9862999Z  2025-03-14T06:32:33.9863449Z  2025-03-14T06:32:33.9863829Z  2025-03-14T06:32:33.9864220Z  2025-03-14T06:32:33.9864596Z  2025-03-14T06:32:33.9864966Z  2025-03-14T06:32:33.9865562Z  2025-03-14T06:32:33.9865959Z  2025-03-14T06:32:33.9867106Z [16,871 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:33.9868028Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2025-03-14T06:32:33.9868722Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T06:32:33.9869551Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2025-03-14T06:32:33.9870517Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2025-03-14T06:32:33.9871516Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 13s local 2025-03-14T06:32:33.9872416Z Compiling xla/service/hlo_value.cc; 11s local 2025-03-14T06:32:33.9873220Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T06:32:33.9874063Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local ... 2025-03-14T06:32:34.2461114Z 2025-03-14T06:32:34.2461956Z  2025-03-14T06:32:34.2462459Z  2025-03-14T06:32:34.2462880Z  2025-03-14T06:32:34.2463276Z  2025-03-14T06:32:34.2463702Z  2025-03-14T06:32:34.2464090Z  2025-03-14T06:32:34.2464527Z  2025-03-14T06:32:34.2464949Z  2025-03-14T06:32:34.2466117Z [16,872 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:34.2466981Z Compiling xla/hlo/parser/hlo_parser.cc; 39s local 2025-03-14T06:32:34.2467658Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T06:32:34.2468472Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2025-03-14T06:32:34.2469474Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2025-03-14T06:32:34.2472907Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 13s local 2025-03-14T06:32:34.2473796Z Compiling xla/service/hlo_value.cc; 11s local 2025-03-14T06:32:34.2474628Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 11s local 2025-03-14T06:32:34.2475538Z Compiling xla/hlo/ir/hlo_computation.cc; 10s local ... 2025-03-14T06:32:34.4627623Z 2025-03-14T06:32:34.4628488Z  2025-03-14T06:32:34.4628969Z  2025-03-14T06:32:34.4629343Z  2025-03-14T06:32:34.4629724Z  2025-03-14T06:32:34.4630095Z  2025-03-14T06:32:34.4630708Z  2025-03-14T06:32:34.4631076Z  2025-03-14T06:32:34.4631426Z  2025-03-14T06:32:34.4632258Z [16,873 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:34.4633103Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T06:32:34.4633900Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 15s local 2025-03-14T06:32:34.4634802Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2025-03-14T06:32:34.4635758Z Compiling .../transforms/expanders/bitcast_dtypes_expander.cc; 13s local 2025-03-14T06:32:34.4636554Z Compiling xla/service/hlo_value.cc; 12s local 2025-03-14T06:32:34.4637284Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 12s local 2025-03-14T06:32:34.4638084Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2025-03-14T06:32:34.4638939Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 11s local ... 2025-03-14T06:32:34.7145085Z 2025-03-14T06:32:34.7145970Z  2025-03-14T06:32:34.7146472Z  2025-03-14T06:32:34.7146883Z  2025-03-14T06:32:34.7147280Z  2025-03-14T06:32:34.7147706Z  2025-03-14T06:32:34.7148088Z  2025-03-14T06:32:34.7148481Z  2025-03-14T06:32:34.7148872Z  2025-03-14T06:32:34.7149838Z [16,877 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:34.7150879Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T06:32:34.7151775Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T06:32:34.7152818Z Compiling xla/hlo/analysis/logical_buffer_analysis.cc; 12s local 2025-03-14T06:32:34.7153731Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2025-03-14T06:32:34.7154941Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 11s local 2025-03-14T06:32:34.7156040Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 10s local 2025-03-14T06:32:34.7157033Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T06:32:34.7158044Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 9s local ... 2025-03-14T06:32:35.0476441Z 2025-03-14T06:32:35.0477325Z  2025-03-14T06:32:35.0477792Z  2025-03-14T06:32:35.0478171Z  2025-03-14T06:32:35.0478565Z  2025-03-14T06:32:35.0478991Z  2025-03-14T06:32:35.0479371Z  2025-03-14T06:32:35.0479721Z  2025-03-14T06:32:35.0480102Z  2025-03-14T06:32:35.0481045Z [16,881 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:35.0482373Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T06:32:35.0483217Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T06:32:35.0484081Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2025-03-14T06:32:35.0485066Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T06:32:35.0486076Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T06:32:35.0486965Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 9s local 2025-03-14T06:32:35.2480771Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 9s local 2025-03-14T06:32:35.2481654Z Compiling xla/hlo/ir/hlo_instruction.cc; 8s local ... 2025-03-14T06:32:35.2482428Z 2025-03-14T06:32:35.2482861Z  2025-03-14T06:32:35.2483275Z  2025-03-14T06:32:35.2483682Z  2025-03-14T06:32:35.2484049Z  2025-03-14T06:32:35.2484557Z  2025-03-14T06:32:35.2485012Z  2025-03-14T06:32:35.2485409Z  2025-03-14T06:32:35.2485787Z  2025-03-14T06:32:35.2487168Z [16,882 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:35.2488411Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T06:32:35.2489443Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T06:32:35.2490690Z Compiling xla/hlo/ir/hlo_computation.cc; 11s local 2025-03-14T06:32:35.2491762Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T06:32:35.2492821Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 11s local 2025-03-14T06:32:35.2493893Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 9s local 2025-03-14T06:32:35.2494969Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 9s local 2025-03-14T06:32:35.2495918Z Compiling xla/hlo/ir/hlo_instruction.cc; 9s local ... 2025-03-14T06:32:35.5097216Z 2025-03-14T06:32:35.5098180Z  2025-03-14T06:32:35.5098693Z  2025-03-14T06:32:35.5099129Z  2025-03-14T06:32:35.5099521Z  2025-03-14T06:32:35.5099922Z  2025-03-14T06:32:35.5100316Z  2025-03-14T06:32:35.5100735Z  2025-03-14T06:32:35.5101135Z  2025-03-14T06:32:35.5102108Z [16,884 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:35.5103174Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T06:32:35.5104064Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 16s local 2025-03-14T06:32:35.5104926Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2025-03-14T06:32:35.5105771Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 11s local 2025-03-14T06:32:35.5106725Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2025-03-14T06:32:35.5107705Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 9s local 2025-03-14T06:32:35.5108527Z Compiling xla/hlo/ir/hlo_instruction.cc; 9s local 2025-03-14T06:32:35.5109643Z Compiling .../transforms/expanders/comparison_expander.cc; 9s local ... 2025-03-14T06:32:35.8486926Z 2025-03-14T06:32:35.8487760Z  2025-03-14T06:32:35.8488151Z  2025-03-14T06:32:35.8488492Z  2025-03-14T06:32:35.8489107Z  2025-03-14T06:32:35.8489501Z  2025-03-14T06:32:35.8489894Z  2025-03-14T06:32:35.8490247Z  2025-03-14T06:32:35.8490613Z  2025-03-14T06:32:35.8491439Z [16,885 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:35.8492377Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T06:32:35.8493136Z Compiling llvm/lib/Bitcode/Writer/BitcodeWriter.cpp; 17s local 2025-03-14T06:32:35.8494017Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2025-03-14T06:32:35.8494798Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2025-03-14T06:32:35.8495593Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2025-03-14T06:32:35.8496618Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T06:32:35.8497343Z Compiling xla/hlo/ir/hlo_instruction.cc; 9s local 2025-03-14T06:32:35.8498255Z Compiling .../transforms/expanders/comparison_expander.cc; 9s local ... 2025-03-14T06:32:36.0490985Z 2025-03-14T06:32:36.0491883Z  2025-03-14T06:32:36.0492384Z  2025-03-14T06:32:36.0492838Z  2025-03-14T06:32:36.0493268Z  2025-03-14T06:32:36.0493670Z  2025-03-14T06:32:36.0494099Z  2025-03-14T06:32:36.0494538Z  2025-03-14T06:32:36.0494956Z  2025-03-14T06:32:36.0495962Z [16,887 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:36.0497056Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T06:32:36.0498100Z Compiling xla/hlo/ir/hlo_computation.cc; 12s local 2025-03-14T06:32:36.0498981Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2025-03-14T06:32:36.0499917Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2025-03-14T06:32:36.0500933Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T06:32:36.0501866Z Compiling xla/hlo/ir/hlo_instruction.cc; 9s local 2025-03-14T06:32:36.0502890Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 9s local 2025-03-14T06:32:36.0504263Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 8s local ... 2025-03-14T06:32:36.4497935Z 2025-03-14T06:32:36.4498816Z  2025-03-14T06:32:36.4499380Z  2025-03-14T06:32:36.4499785Z  2025-03-14T06:32:36.4500209Z  2025-03-14T06:32:36.4500607Z  2025-03-14T06:32:36.4501015Z  2025-03-14T06:32:36.4501411Z  2025-03-14T06:32:36.4501845Z  2025-03-14T06:32:36.4502794Z [16,888 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:36.4503831Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T06:32:36.4504634Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2025-03-14T06:32:36.4505467Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2025-03-14T06:32:36.4506383Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 10s local 2025-03-14T06:32:36.4507297Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 10s local 2025-03-14T06:32:36.4508164Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local 2025-03-14T06:32:36.4509110Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 10s local 2025-03-14T06:32:36.4510262Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 9s local ... 2025-03-14T06:32:36.7026041Z 2025-03-14T06:32:36.7026896Z  2025-03-14T06:32:36.7027380Z  2025-03-14T06:32:36.7027819Z  2025-03-14T06:32:36.7028194Z  2025-03-14T06:32:36.7028571Z  2025-03-14T06:32:36.7029369Z  2025-03-14T06:32:36.7029903Z  2025-03-14T06:32:36.7030388Z  2025-03-14T06:32:36.7031356Z [16,889 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:36.7032401Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T06:32:36.7033538Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2025-03-14T06:32:36.7034669Z Compiling llvm/lib/ProfileData/MemProfReader.cpp; 12s local 2025-03-14T06:32:36.7035755Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2025-03-14T06:32:36.7036877Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 11s local 2025-03-14T06:32:36.7037850Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local 2025-03-14T06:32:36.7038971Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 10s local 2025-03-14T06:32:36.7040298Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 9s local ... 2025-03-14T06:32:36.9732839Z 2025-03-14T06:32:36.9733791Z  2025-03-14T06:32:36.9734314Z  2025-03-14T06:32:36.9734722Z  2025-03-14T06:32:36.9735426Z  2025-03-14T06:32:36.9735848Z  2025-03-14T06:32:36.9736251Z  2025-03-14T06:32:36.9736666Z  2025-03-14T06:32:36.9737059Z  2025-03-14T06:32:36.9738041Z [16,892 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:36.9739064Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T06:32:36.9739795Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2025-03-14T06:32:36.9740602Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2025-03-14T06:32:36.9741505Z @xla//xla/hlo/transforms:zero_sized_hlo_elimination; 11s local 2025-03-14T06:32:36.9742371Z Compiling xla/hlo/ir/hlo_instruction.cc; 10s local 2025-03-14T06:32:36.9743559Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 10s local 2025-03-14T06:32:36.9744767Z Compiling xla/hlo/transforms/expanders/dynamic_index_splitter.cc; 9s local 2025-03-14T06:32:36.9745943Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 9s local ... 2025-03-14T06:32:37.2507920Z 2025-03-14T06:32:37.2508846Z  2025-03-14T06:32:37.2509345Z  2025-03-14T06:32:37.2509721Z  2025-03-14T06:32:37.2510101Z  2025-03-14T06:32:37.2510514Z  2025-03-14T06:32:37.2510916Z  2025-03-14T06:32:37.2511315Z  2025-03-14T06:32:37.2511724Z  2025-03-14T06:32:37.2512909Z [16,893 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:37.2513893Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T06:32:37.2514579Z Compiling xla/hlo/ir/hlo_computation.cc; 13s local 2025-03-14T06:32:37.2515312Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2025-03-14T06:32:37.2516150Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2025-03-14T06:32:37.2517022Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 10s local 2025-03-14T06:32:37.2518080Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 10s local 2025-03-14T06:32:37.2519275Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 9s local 2025-03-14T06:32:37.2520409Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local ... 2025-03-14T06:32:37.4510650Z 2025-03-14T06:32:37.4511867Z  2025-03-14T06:32:37.4512294Z  2025-03-14T06:32:37.4512674Z  2025-03-14T06:32:37.4513063Z  2025-03-14T06:32:37.4513444Z  2025-03-14T06:32:37.4513813Z  2025-03-14T06:32:37.4514168Z  2025-03-14T06:32:37.4514524Z  2025-03-14T06:32:37.4515410Z [16,895 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:37.4516312Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T06:32:37.4517019Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T06:32:37.4517822Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 11s local 2025-03-14T06:32:37.4518672Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2025-03-14T06:32:37.4519536Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T06:32:37.4520839Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 10s local 2025-03-14T06:32:37.4521895Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 9s local 2025-03-14T06:32:37.4522994Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 9s local ... 2025-03-14T06:32:37.9334244Z 2025-03-14T06:32:37.9335465Z  2025-03-14T06:32:37.9335943Z  2025-03-14T06:32:37.9336341Z  2025-03-14T06:32:37.9336747Z  2025-03-14T06:32:37.9337134Z  2025-03-14T06:32:37.9337517Z  2025-03-14T06:32:37.9337897Z  2025-03-14T06:32:37.9338317Z  2025-03-14T06:32:37.9339238Z [16,896 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:37.9340232Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T06:32:37.9341280Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T06:32:37.9342145Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2025-03-14T06:32:37.9343028Z Compiling xla/hlo/ir/hlo_instruction.cc; 11s local 2025-03-14T06:32:37.9343987Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T06:32:37.9345113Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 10s local 2025-03-14T06:32:37.9346221Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 10s local 2025-03-14T06:32:37.9347356Z Compiling llvm/lib/Analysis/IRSimilarityIdentifier.cpp; 10s local ... 2025-03-14T06:32:38.1814268Z 2025-03-14T06:32:38.1815490Z  2025-03-14T06:32:38.1815997Z  2025-03-14T06:32:38.1816691Z  2025-03-14T06:32:38.1817103Z  2025-03-14T06:32:38.1817625Z  2025-03-14T06:32:38.1818031Z  2025-03-14T06:32:38.1818459Z  2025-03-14T06:32:38.1818875Z  2025-03-14T06:32:38.1819886Z [16,898 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:38.1820921Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T06:32:38.1821753Z Compiling xla/hlo/ir/hlo_computation.cc; 14s local 2025-03-14T06:32:38.1822681Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2025-03-14T06:32:38.1823786Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T06:32:38.1824821Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T06:32:38.1826086Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 11s local 2025-03-14T06:32:38.1827172Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 10s local 2025-03-14T06:32:38.1828312Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 8s local ... 2025-03-14T06:32:38.4519980Z 2025-03-14T06:32:38.4520852Z  2025-03-14T06:32:38.4521372Z  2025-03-14T06:32:38.4521830Z  2025-03-14T06:32:38.4522256Z  2025-03-14T06:32:38.4522686Z  2025-03-14T06:32:38.4523087Z  2025-03-14T06:32:38.4523494Z  2025-03-14T06:32:38.4523873Z  2025-03-14T06:32:38.4525001Z [16,898 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:38.4526055Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T06:32:38.4526871Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T06:32:38.4527736Z Compiling xla/hlo/ir/hlo_input_output_alias_config.cc; 12s local 2025-03-14T06:32:38.4528601Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T06:32:38.4529584Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 12s local 2025-03-14T06:32:38.4530844Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 11s local 2025-03-14T06:32:38.4532076Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 10s local 2025-03-14T06:32:38.4533300Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 8s local ... 2025-03-14T06:32:38.6524348Z 2025-03-14T06:32:38.6525373Z  2025-03-14T06:32:38.6525921Z  2025-03-14T06:32:38.6526362Z  2025-03-14T06:32:38.6527076Z  2025-03-14T06:32:38.6527474Z  2025-03-14T06:32:38.6527897Z  2025-03-14T06:32:38.6528300Z  2025-03-14T06:32:38.6528720Z  2025-03-14T06:32:38.6529850Z [16,900 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:38.6530884Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T06:32:38.6531659Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T06:32:38.6532422Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T06:32:38.6533431Z Compiling .../transforms/expanders/dynamic_index_splitter.cc; 11s local 2025-03-14T06:32:38.6534633Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 11s local 2025-03-14T06:32:38.6536091Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 8s local 2025-03-14T06:32:38.6537096Z Compiling llvm/lib/Analysis/InlineCost.cpp; 8s local 2025-03-14T06:32:38.6538014Z @xla//xla/hlo/transforms:broadcast_canonicalizer; 7s local ... 2025-03-14T06:32:38.9382325Z 2025-03-14T06:32:38.9383149Z  2025-03-14T06:32:38.9383586Z  2025-03-14T06:32:38.9383945Z  2025-03-14T06:32:38.9384272Z  2025-03-14T06:32:38.9384604Z  2025-03-14T06:32:38.9384928Z  2025-03-14T06:32:38.9385261Z  2025-03-14T06:32:38.9385584Z  2025-03-14T06:32:38.9386346Z [16,902 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:38.9387180Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T06:32:38.9388050Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T06:32:38.9388678Z Compiling xla/hlo/ir/hlo_instruction.cc; 12s local 2025-03-14T06:32:38.9389510Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 11s local 2025-03-14T06:32:38.9390558Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 9s local 2025-03-14T06:32:38.9391494Z Compiling llvm/lib/Analysis/InlineCost.cpp; 8s local 2025-03-14T06:32:38.9392251Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 8s local 2025-03-14T06:32:38.9393404Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 7s local ... 2025-03-14T06:32:39.2236215Z 2025-03-14T06:32:39.2237097Z  2025-03-14T06:32:39.2237618Z  2025-03-14T06:32:39.2238034Z  2025-03-14T06:32:39.2238470Z  2025-03-14T06:32:39.2238916Z  2025-03-14T06:32:39.2239360Z  2025-03-14T06:32:39.2239807Z  2025-03-14T06:32:39.2240258Z  2025-03-14T06:32:39.2241255Z [16,903 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:39.2242256Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T06:32:39.2243103Z Compiling xla/hlo/ir/hlo_computation.cc; 15s local 2025-03-14T06:32:39.2243903Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T06:32:39.2245064Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 11s local 2025-03-14T06:32:39.2246238Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 9s local 2025-03-14T06:32:39.2247268Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2025-03-14T06:32:39.2248295Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 8s local 2025-03-14T06:32:39.2249554Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 7s local ... 2025-03-14T06:32:39.4531834Z 2025-03-14T06:32:39.4532655Z  2025-03-14T06:32:39.4533180Z  2025-03-14T06:32:39.4533619Z  2025-03-14T06:32:39.4534060Z  2025-03-14T06:32:39.4534491Z  2025-03-14T06:32:39.4534925Z  2025-03-14T06:32:39.4535359Z  2025-03-14T06:32:39.4535795Z  2025-03-14T06:32:39.4536811Z [16,904 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:39.4537866Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T06:32:39.4549144Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T06:32:39.4550288Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T06:32:39.4551360Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 9s local 2025-03-14T06:32:39.4552405Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2025-03-14T06:32:39.4553443Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 8s local 2025-03-14T06:32:39.4554686Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 8s local 2025-03-14T06:32:39.4555755Z Compiling xla/service/hlo_phi_graph.cc; 7s local ... 2025-03-14T06:32:39.8226765Z 2025-03-14T06:32:39.8227621Z  2025-03-14T06:32:39.8228066Z  2025-03-14T06:32:39.8228440Z  2025-03-14T06:32:39.8229207Z  2025-03-14T06:32:39.8229589Z  2025-03-14T06:32:39.8229940Z  2025-03-14T06:32:39.8230313Z  2025-03-14T06:32:39.8230670Z  2025-03-14T06:32:39.8231572Z [16,905 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:39.8232521Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T06:32:39.8233216Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T06:32:39.8233886Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T06:32:39.8234723Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 10s local 2025-03-14T06:32:39.8235612Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2025-03-14T06:32:39.8236629Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 8s local 2025-03-14T06:32:39.8237944Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 8s local 2025-03-14T06:32:39.8238855Z Compiling xla/service/hlo_phi_graph.cc; 8s local ... 2025-03-14T06:32:40.0538366Z 2025-03-14T06:32:40.0539361Z  2025-03-14T06:32:40.0539888Z  2025-03-14T06:32:40.0540343Z  2025-03-14T06:32:40.0540765Z  2025-03-14T06:32:40.0541206Z  2025-03-14T06:32:40.0541693Z  2025-03-14T06:32:40.0542134Z  2025-03-14T06:32:40.0542588Z  2025-03-14T06:32:40.0543943Z [16,905 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:40.0545003Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T06:32:40.0545824Z Compiling xla/hlo/ir/hlo_computation.cc; 16s local 2025-03-14T06:32:40.0546742Z Compiling xla/hlo/ir/hlo_instruction.cc; 13s local 2025-03-14T06:32:40.0547688Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 10s local 2025-03-14T06:32:40.0548709Z Compiling llvm/lib/Analysis/InlineCost.cpp; 9s local 2025-03-14T06:32:40.0549670Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 9s local 2025-03-14T06:32:40.0550802Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 8s local 2025-03-14T06:32:40.0551761Z Compiling xla/service/hlo_phi_graph.cc; 8s local ... 2025-03-14T06:32:40.3016044Z 2025-03-14T06:32:40.3016968Z  2025-03-14T06:32:40.3017485Z  2025-03-14T06:32:40.3017912Z  2025-03-14T06:32:40.3018323Z  2025-03-14T06:32:40.3018757Z  2025-03-14T06:32:40.3019131Z  2025-03-14T06:32:40.3019530Z  2025-03-14T06:32:40.3019959Z  2025-03-14T06:32:40.3020918Z [16,906 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:40.3022324Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T06:32:40.3023185Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T06:32:40.3024132Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T06:32:40.3025303Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 10s local 2025-03-14T06:32:40.3026470Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2025-03-14T06:32:40.3027625Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 9s local 2025-03-14T06:32:40.3029115Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 8s local 2025-03-14T06:32:40.3030226Z Compiling xla/service/hlo_phi_graph.cc; 8s local ... 2025-03-14T06:32:40.6544269Z 2025-03-14T06:32:40.6545167Z  2025-03-14T06:32:40.6545705Z  2025-03-14T06:32:40.6546151Z  2025-03-14T06:32:40.6546622Z  2025-03-14T06:32:40.6547123Z  2025-03-14T06:32:40.6547535Z  2025-03-14T06:32:40.6547916Z  2025-03-14T06:32:40.6548309Z  2025-03-14T06:32:40.6549315Z [16,906 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:40.6550462Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T06:32:40.6551243Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T06:32:40.6552405Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T06:32:40.6553373Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 10s local 2025-03-14T06:32:40.6554404Z Compiling llvm/lib/Analysis/InlineCost.cpp; 10s local 2025-03-14T06:32:40.6555424Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 9s local 2025-03-14T06:32:40.6556644Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local 2025-03-14T06:32:40.6557697Z Compiling xla/service/hlo_phi_graph.cc; 9s local ... 2025-03-14T06:32:40.9251816Z 2025-03-14T06:32:40.9252700Z  2025-03-14T06:32:40.9253430Z  2025-03-14T06:32:40.9253969Z  2025-03-14T06:32:40.9254497Z  2025-03-14T06:32:40.9255009Z  2025-03-14T06:32:40.9255852Z  2025-03-14T06:32:40.9256380Z  2025-03-14T06:32:40.9256913Z  2025-03-14T06:32:40.9257975Z [16,909 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:40.9259169Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T06:32:40.9260113Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T06:32:40.9261024Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T06:32:40.9262127Z Compiling xla/hlo/transforms/expanders/logistic_expander.cc; 11s local 2025-03-14T06:32:40.9263599Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T06:32:40.9264907Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local 2025-03-14T06:32:40.9266390Z Compiling xla/service/hlo_phi_graph.cc; 9s local 2025-03-14T06:32:40.9267400Z Compiling xla/hlo/transforms/operand_upcaster.cc; 9s local ... 2025-03-14T06:32:41.1262283Z 2025-03-14T06:32:41.1263263Z  2025-03-14T06:32:41.1263775Z  2025-03-14T06:32:41.1264205Z  2025-03-14T06:32:41.1264636Z  2025-03-14T06:32:41.1265054Z  2025-03-14T06:32:41.1265651Z  2025-03-14T06:32:41.1266080Z  2025-03-14T06:32:41.1266601Z  2025-03-14T06:32:41.1267542Z [16,911 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:41.1268538Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T06:32:41.1269321Z Compiling xla/hlo/ir/hlo_computation.cc; 17s local 2025-03-14T06:32:41.1270074Z Compiling xla/hlo/ir/hlo_instruction.cc; 14s local 2025-03-14T06:32:41.1270972Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T06:32:41.1272055Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local 2025-03-14T06:32:41.1272988Z Compiling xla/service/hlo_phi_graph.cc; 9s local 2025-03-14T06:32:41.1273824Z Compiling xla/hlo/transforms/operand_upcaster.cc; 9s local 2025-03-14T06:32:41.1274919Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local ... 2025-03-14T06:32:41.3342286Z 2025-03-14T06:32:41.3343147Z  2025-03-14T06:32:41.3343711Z  2025-03-14T06:32:41.3344104Z  2025-03-14T06:32:41.3344489Z  2025-03-14T06:32:41.3344901Z  2025-03-14T06:32:41.3345336Z  2025-03-14T06:32:41.3345702Z  2025-03-14T06:32:41.3346074Z  2025-03-14T06:32:41.3347204Z [16,914 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:41.3348219Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T06:32:41.3349009Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T06:32:41.3349844Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T06:32:41.3350792Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T06:32:41.3351926Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T06:32:41.3352918Z Compiling xla/service/hlo_phi_graph.cc; 9s local 2025-03-14T06:32:41.3353708Z Compiling xla/hlo/transforms/operand_upcaster.cc; 9s local 2025-03-14T06:32:41.3354969Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local ... 2025-03-14T06:32:41.6552873Z 2025-03-14T06:32:41.6553755Z  2025-03-14T06:32:41.6554274Z  2025-03-14T06:32:41.6554691Z  2025-03-14T06:32:41.6555131Z  2025-03-14T06:32:41.6555543Z  2025-03-14T06:32:41.6555944Z  2025-03-14T06:32:41.6556348Z  2025-03-14T06:32:41.6556783Z  2025-03-14T06:32:41.6557736Z [16,915 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:41.6558773Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T06:32:41.6559573Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T06:32:41.6560333Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T06:32:41.6561584Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 10s local 2025-03-14T06:32:41.6562752Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T06:32:41.6563731Z Compiling xla/service/hlo_phi_graph.cc; 10s local 2025-03-14T06:32:41.6564763Z Compiling xla/hlo/transforms/operand_upcaster.cc; 9s local 2025-03-14T06:32:41.6566084Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 9s local ... 2025-03-14T06:32:42.0261004Z 2025-03-14T06:32:42.0261890Z  2025-03-14T06:32:42.0262365Z  2025-03-14T06:32:42.0263035Z  2025-03-14T06:32:42.0263441Z  2025-03-14T06:32:42.0263850Z  2025-03-14T06:32:42.0264214Z  2025-03-14T06:32:42.0264813Z  2025-03-14T06:32:42.0265738Z  2025-03-14T06:32:42.0266778Z [16,917 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:42.0267770Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T06:32:42.0268539Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T06:32:42.0269336Z Compiling xla/hlo/ir/hlo_instruction.cc; 15s local 2025-03-14T06:32:42.0270334Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2025-03-14T06:32:42.0271516Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T06:32:42.0272602Z Compiling xla/service/hlo_phi_graph.cc; 10s local 2025-03-14T06:32:42.0273490Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local 2025-03-14T06:32:42.0274515Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local ... 2025-03-14T06:32:42.2229559Z 2025-03-14T06:32:42.2230423Z  2025-03-14T06:32:42.2230895Z  2025-03-14T06:32:42.2231298Z  2025-03-14T06:32:42.2231683Z  2025-03-14T06:32:42.2232083Z  2025-03-14T06:32:42.2232471Z  2025-03-14T06:32:42.2232868Z  2025-03-14T06:32:42.2233277Z  2025-03-14T06:32:42.2234190Z [16,921 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:42.2235173Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T06:32:42.2235874Z Compiling xla/hlo/ir/hlo_computation.cc; 18s local 2025-03-14T06:32:42.2237100Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T06:32:42.2238334Z Compiling .../transforms/simplifiers/broadcast_canonicalizer.cc; 11s local 2025-03-14T06:32:42.2239712Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T06:32:42.2240827Z Compiling xla/service/hlo_phi_graph.cc; 10s local 2025-03-14T06:32:42.2241794Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local 2025-03-14T06:32:42.2242981Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local ... 2025-03-14T06:32:42.4559380Z 2025-03-14T06:32:42.4560262Z  2025-03-14T06:32:42.4560752Z  2025-03-14T06:32:42.4561209Z  2025-03-14T06:32:42.4561601Z  2025-03-14T06:32:42.4562013Z  2025-03-14T06:32:42.4562424Z  2025-03-14T06:32:42.4562822Z  2025-03-14T06:32:42.4563214Z  2025-03-14T06:32:42.4564661Z [16,923 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:42.4565869Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T06:32:42.4566649Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T06:32:42.4567418Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T06:32:42.4568345Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T06:32:42.4569437Z Compiling xla/service/hlo_phi_graph.cc; 10s local 2025-03-14T06:32:42.4570266Z Compiling xla/hlo/transforms/operand_upcaster.cc; 10s local 2025-03-14T06:32:42.4571279Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T06:32:42.4574473Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local ... 2025-03-14T06:32:42.8606123Z 2025-03-14T06:32:42.8607101Z  2025-03-14T06:32:42.8607798Z  2025-03-14T06:32:42.8608246Z  2025-03-14T06:32:42.8608675Z  2025-03-14T06:32:42.8609063Z  2025-03-14T06:32:42.8609437Z  2025-03-14T06:32:42.8609829Z  2025-03-14T06:32:42.8610227Z  2025-03-14T06:32:42.8611162Z [16,924 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:42.8612151Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T06:32:42.8613235Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T06:32:42.8614035Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T06:32:42.8614990Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T06:32:42.8615888Z Compiling xla/service/hlo_phi_graph.cc; 11s local 2025-03-14T06:32:42.8616736Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T06:32:42.8617793Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 10s local 2025-03-14T06:32:42.8618914Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 10s local ... 2025-03-14T06:32:43.1503922Z 2025-03-14T06:32:43.1504775Z  2025-03-14T06:32:43.1505241Z  2025-03-14T06:32:43.1505662Z  2025-03-14T06:32:43.1506046Z  2025-03-14T06:32:43.1506479Z  2025-03-14T06:32:43.1506908Z  2025-03-14T06:32:43.1507297Z  2025-03-14T06:32:43.1507689Z  2025-03-14T06:32:43.1508592Z [16,925 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:43.1509622Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T06:32:43.1510394Z Compiling xla/hlo/ir/hlo_computation.cc; 19s local 2025-03-14T06:32:43.1511142Z Compiling xla/hlo/ir/hlo_instruction.cc; 16s local 2025-03-14T06:32:43.1512050Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T06:32:43.1512979Z Compiling xla/service/hlo_phi_graph.cc; 11s local 2025-03-14T06:32:43.1513738Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T06:32:43.1514725Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T06:32:43.1515732Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local ... 2025-03-14T06:32:43.4315236Z 2025-03-14T06:32:43.4316088Z  2025-03-14T06:32:43.4316953Z  2025-03-14T06:32:43.4317641Z  2025-03-14T06:32:43.4318150Z  2025-03-14T06:32:43.4318734Z  2025-03-14T06:32:43.4319314Z  2025-03-14T06:32:43.4319876Z  2025-03-14T06:32:43.4320382Z  2025-03-14T06:32:43.4321421Z [16,926 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:43.4322535Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T06:32:43.4323387Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T06:32:43.4324390Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T06:32:43.4325433Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 12s local 2025-03-14T06:32:43.4327011Z Compiling xla/service/hlo_phi_graph.cc; 11s local 2025-03-14T06:32:43.4327914Z Compiling xla/hlo/transforms/operand_upcaster.cc; 11s local 2025-03-14T06:32:43.4329027Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T06:32:43.4330227Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local ... 2025-03-14T06:32:43.6570466Z 2025-03-14T06:32:43.6571367Z  2025-03-14T06:32:43.6571879Z  2025-03-14T06:32:43.6572230Z  2025-03-14T06:32:43.6572634Z  2025-03-14T06:32:43.6573034Z  2025-03-14T06:32:43.6573433Z  2025-03-14T06:32:43.6573837Z  2025-03-14T06:32:43.6574245Z  2025-03-14T06:32:43.6575102Z [16,928 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:43.6576462Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T06:32:43.6577261Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T06:32:43.6578018Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T06:32:43.6578765Z Compiling xla/service/hlo_phi_graph.cc; 12s local 2025-03-14T06:32:43.6579730Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T06:32:43.6580847Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2025-03-14T06:32:43.6581926Z Compiling xla/pjrt/layout_mode.cc; 9s local 2025-03-14T06:32:43.6582834Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 9s local ... 2025-03-14T06:32:43.8730691Z 2025-03-14T06:32:43.8731628Z  2025-03-14T06:32:43.8732141Z  2025-03-14T06:32:43.8732581Z  2025-03-14T06:32:43.8732999Z  2025-03-14T06:32:43.8733410Z  2025-03-14T06:32:43.8733814Z  2025-03-14T06:32:43.8734246Z  2025-03-14T06:32:43.8734657Z  2025-03-14T06:32:43.8735614Z [16,929 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:43.8736750Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T06:32:43.8737490Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T06:32:43.8738219Z Compiling xla/hlo/ir/hlo_instruction.cc; 17s local 2025-03-14T06:32:43.8739197Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 11s local 2025-03-14T06:32:43.8740407Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 11s local 2025-03-14T06:32:43.8741185Z Compiling xla/pjrt/layout_mode.cc; 9s local 2025-03-14T06:32:43.8741971Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 9s local 2025-03-14T06:32:43.8742851Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 9s local ... 2025-03-14T06:32:44.2575828Z 2025-03-14T06:32:44.2577982Z  2025-03-14T06:32:44.2578514Z  2025-03-14T06:32:44.2578926Z  2025-03-14T06:32:44.2579308Z  2025-03-14T06:32:44.2579681Z  2025-03-14T06:32:44.2580066Z  2025-03-14T06:32:44.2580448Z  2025-03-14T06:32:44.2580857Z  2025-03-14T06:32:44.2581776Z [16,929 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:44.2582770Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T06:32:44.2583816Z Compiling xla/hlo/ir/hlo_computation.cc; 20s local 2025-03-14T06:32:44.2584580Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T06:32:44.2585521Z Compiling xla/hlo/transforms/expanders/reduce_decomposer.cc; 12s local 2025-03-14T06:32:44.2586917Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2025-03-14T06:32:44.2587655Z Compiling xla/pjrt/layout_mode.cc; 9s local 2025-03-14T06:32:44.2588554Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 9s local 2025-03-14T06:32:44.2589739Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 9s local ... 2025-03-14T06:32:44.6579629Z 2025-03-14T06:32:44.6580466Z  2025-03-14T06:32:44.6580896Z  2025-03-14T06:32:44.6581253Z  2025-03-14T06:32:44.6581875Z  2025-03-14T06:32:44.6582215Z  2025-03-14T06:32:44.6582565Z  2025-03-14T06:32:44.6582885Z  2025-03-14T06:32:44.6583230Z  2025-03-14T06:32:44.6584069Z [16,930 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:44.6584941Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T06:32:44.6585619Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T06:32:44.6586284Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T06:32:44.6587414Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2025-03-14T06:32:44.6588145Z Compiling xla/pjrt/layout_mode.cc; 10s local 2025-03-14T06:32:44.6588989Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local 2025-03-14T06:32:44.6590191Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 10s local 2025-03-14T06:32:44.6591292Z Compiling .../translate/hlo_to_mhlo/location_importer.cc; 10s local ... 2025-03-14T06:32:44.9783475Z 2025-03-14T06:32:44.9784349Z  2025-03-14T06:32:44.9784866Z  2025-03-14T06:32:44.9785299Z  2025-03-14T06:32:44.9785716Z  2025-03-14T06:32:44.9786132Z  2025-03-14T06:32:44.9786571Z  2025-03-14T06:32:44.9786986Z  2025-03-14T06:32:44.9787397Z  2025-03-14T06:32:44.9788591Z [16,931 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:44.9789645Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T06:32:44.9790459Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T06:32:44.9791265Z Compiling xla/hlo/ir/hlo_instruction.cc; 18s local 2025-03-14T06:32:44.9792187Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 12s local 2025-03-14T06:32:44.9793036Z Compiling xla/pjrt/layout_mode.cc; 10s local 2025-03-14T06:32:44.9793801Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local 2025-03-14T06:32:44.9794829Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 10s local 2025-03-14T06:32:44.9795961Z Compiling .../translate/hlo_to_mhlo/location_importer.cc; 10s local ... 2025-03-14T06:32:45.2303872Z 2025-03-14T06:32:45.2304768Z  2025-03-14T06:32:45.2305261Z  2025-03-14T06:32:45.2305709Z  2025-03-14T06:32:45.2306137Z  2025-03-14T06:32:45.2306558Z  2025-03-14T06:32:45.2306986Z  2025-03-14T06:32:45.2307395Z  2025-03-14T06:32:45.2307813Z  2025-03-14T06:32:45.2308782Z [16,933 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:45.2309841Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T06:32:45.2310752Z Compiling xla/hlo/ir/hlo_computation.cc; 21s local 2025-03-14T06:32:45.2311543Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T06:32:45.2312445Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T06:32:45.2313497Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local 2025-03-14T06:32:45.2314602Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 10s local 2025-03-14T06:32:45.2316073Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 10s local 2025-03-14T06:32:45.2317185Z @xla//xla/hlo/transforms:tree_reduction_rewriter; 10s local ... 2025-03-14T06:32:45.4587657Z 2025-03-14T06:32:45.4588534Z  2025-03-14T06:32:45.4589023Z  2025-03-14T06:32:45.4589433Z  2025-03-14T06:32:45.4589847Z  2025-03-14T06:32:45.4590254Z  2025-03-14T06:32:45.4590650Z  2025-03-14T06:32:45.4591009Z  2025-03-14T06:32:45.4591387Z  2025-03-14T06:32:45.4592201Z [16,935 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:45.4593048Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T06:32:45.4593707Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T06:32:45.4594808Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T06:32:45.4595828Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local 2025-03-14T06:32:45.4596815Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 10s local 2025-03-14T06:32:45.4597866Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 10s local 2025-03-14T06:32:45.4598900Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 10s local 2025-03-14T06:32:45.4599881Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local ... 2025-03-14T06:32:45.6593874Z 2025-03-14T06:32:45.6594704Z  2025-03-14T06:32:45.6595194Z  2025-03-14T06:32:45.6595615Z  2025-03-14T06:32:45.6596327Z  2025-03-14T06:32:45.6596723Z  2025-03-14T06:32:45.6597132Z  2025-03-14T06:32:45.6597537Z  2025-03-14T06:32:45.6597946Z  2025-03-14T06:32:45.6598903Z [16,936 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:45.6600026Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T06:32:45.6600805Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T06:32:45.6601650Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T06:32:45.6602828Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T06:32:45.6603833Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 11s local 2025-03-14T06:32:45.6605101Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 11s local 2025-03-14T06:32:45.6606165Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 10s local 2025-03-14T06:32:45.6607247Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local ... 2025-03-14T06:32:45.9042822Z 2025-03-14T06:32:45.9043644Z  2025-03-14T06:32:45.9044129Z  2025-03-14T06:32:45.9044662Z  2025-03-14T06:32:45.9045104Z  2025-03-14T06:32:45.9045509Z  2025-03-14T06:32:45.9045904Z  2025-03-14T06:32:45.9046297Z  2025-03-14T06:32:45.9046687Z  2025-03-14T06:32:45.9047588Z [16,937 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:45.9048599Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T06:32:45.9049421Z Compiling xla/hlo/ir/hlo_instruction.cc; 19s local 2025-03-14T06:32:45.9050351Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 13s local 2025-03-14T06:32:45.9051426Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T06:32:45.9052623Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 11s local 2025-03-14T06:32:45.9053789Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 11s local 2025-03-14T06:32:45.9054984Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 11s local 2025-03-14T06:32:45.9056155Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 10s local ... 2025-03-14T06:32:46.2598283Z 2025-03-14T06:32:46.2599154Z  2025-03-14T06:32:46.2599639Z  2025-03-14T06:32:46.2600052Z  2025-03-14T06:32:46.2600485Z  2025-03-14T06:32:46.2601119Z  2025-03-14T06:32:46.2601538Z  2025-03-14T06:32:46.2601928Z  2025-03-14T06:32:46.2602316Z  2025-03-14T06:32:46.2603272Z [16,938 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:46.2604373Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T06:32:46.2605128Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T06:32:46.2606002Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T06:32:46.2606987Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T06:32:46.2608044Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 11s local 2025-03-14T06:32:46.2609320Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 11s local 2025-03-14T06:32:46.2610419Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 11s local 2025-03-14T06:32:46.2611511Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local ... 2025-03-14T06:32:46.4602360Z 2025-03-14T06:32:46.4603190Z  2025-03-14T06:32:46.4603691Z  2025-03-14T06:32:46.4604095Z  2025-03-14T06:32:46.4604671Z  2025-03-14T06:32:46.4605047Z  2025-03-14T06:32:46.4605412Z  2025-03-14T06:32:46.4605781Z  2025-03-14T06:32:46.4606154Z  2025-03-14T06:32:46.4607089Z [16,940 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:46.4608371Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T06:32:46.4609108Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T06:32:46.4609907Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T06:32:46.4610945Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T06:32:46.4612031Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 11s local 2025-03-14T06:32:46.4613126Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 11s local 2025-03-14T06:32:46.4614400Z Compiling .../transforms/simplifiers/tree_reduction_rewriter.cc; 11s local 2025-03-14T06:32:46.4615671Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local ... 2025-03-14T06:32:46.8610338Z 2025-03-14T06:32:46.8611243Z  2025-03-14T06:32:46.8611735Z  2025-03-14T06:32:46.8612162Z  2025-03-14T06:32:46.8612584Z  2025-03-14T06:32:46.8612990Z  2025-03-14T06:32:46.8613392Z  2025-03-14T06:32:46.8613841Z  2025-03-14T06:32:46.8614252Z  2025-03-14T06:32:46.8615231Z [16,943 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:46.8616369Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T06:32:46.8617171Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T06:32:46.8618073Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T06:32:46.8619139Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T06:32:46.8620241Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 12s local 2025-03-14T06:32:46.8621318Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 11s local 2025-03-14T06:32:46.8622345Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T06:32:46.8623304Z @xla//xla/hlo/transforms:sub_byte_normalization; 11s local ... 2025-03-14T06:32:47.0614419Z 2025-03-14T06:32:47.0615294Z  2025-03-14T06:32:47.0615813Z  2025-03-14T06:32:47.0616248Z  2025-03-14T06:32:47.0616691Z  2025-03-14T06:32:47.0617106Z  2025-03-14T06:32:47.0617537Z  2025-03-14T06:32:47.0617989Z  2025-03-14T06:32:47.0618432Z  2025-03-14T06:32:47.0619427Z [16,945 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:47.0620515Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T06:32:47.0621613Z Compiling xla/hlo/ir/hlo_instruction.cc; 20s local 2025-03-14T06:32:47.0622557Z Compiling llvm/lib/Analysis/InstructionSimplify.cpp; 14s local 2025-03-14T06:32:47.0623651Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T06:32:47.0624792Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 12s local 2025-03-14T06:32:47.0625918Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T06:32:47.0626997Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 11s local 2025-03-14T06:32:47.0628019Z @xla//xla/hlo/transforms:sub_byte_normalization; 11s local ... 2025-03-14T06:32:47.3680835Z 2025-03-14T06:32:47.3681704Z  2025-03-14T06:32:47.3682616Z  2025-03-14T06:32:47.3683027Z  2025-03-14T06:32:47.3683449Z  2025-03-14T06:32:47.3683848Z  2025-03-14T06:32:47.3684378Z  2025-03-14T06:32:47.3684783Z  2025-03-14T06:32:47.3685179Z  2025-03-14T06:32:47.3686227Z [16,947 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:47.3687231Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T06:32:47.3687958Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T06:32:47.3688816Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T06:32:47.3689796Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 12s local 2025-03-14T06:32:47.3690863Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T06:32:47.3692204Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T06:32:47.3693190Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 11s local 2025-03-14T06:32:47.3694192Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local ... 2025-03-14T06:32:47.6620941Z 2025-03-14T06:32:47.6621863Z  2025-03-14T06:32:47.6622406Z  2025-03-14T06:32:47.6622808Z  2025-03-14T06:32:47.6623278Z  2025-03-14T06:32:47.6623686Z  2025-03-14T06:32:47.6624071Z  2025-03-14T06:32:47.6624461Z  2025-03-14T06:32:47.6625119Z  2025-03-14T06:32:47.6626189Z [16,948 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:47.6627233Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T06:32:47.6627989Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T06:32:47.6628880Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T06:32:47.6629981Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2025-03-14T06:32:47.6631044Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T06:32:47.6632084Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T06:32:47.6633213Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 12s local 2025-03-14T06:32:47.6634263Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local ... 2025-03-14T06:32:47.8624647Z 2025-03-14T06:32:47.8625619Z  2025-03-14T06:32:47.8626147Z  2025-03-14T06:32:47.8626557Z  2025-03-14T06:32:47.8626965Z  2025-03-14T06:32:47.8627391Z  2025-03-14T06:32:47.8627792Z  2025-03-14T06:32:47.8628182Z  2025-03-14T06:32:47.8628593Z  2025-03-14T06:32:47.8629499Z [16,949 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:47.8630490Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T06:32:47.8631251Z Compiling xla/hlo/ir/hlo_instruction.cc; 21s local 2025-03-14T06:32:47.8632114Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T06:32:47.8633198Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2025-03-14T06:32:47.8634227Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 12s local 2025-03-14T06:32:47.8635536Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 12s local 2025-03-14T06:32:47.8636635Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 12s local 2025-03-14T06:32:47.8637731Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local ... 2025-03-14T06:32:48.2630178Z 2025-03-14T06:32:48.2631018Z  2025-03-14T06:32:48.2631455Z  2025-03-14T06:32:48.2631838Z  2025-03-14T06:32:48.2632201Z  2025-03-14T06:32:48.2632580Z  2025-03-14T06:32:48.2632972Z  2025-03-14T06:32:48.2633353Z  2025-03-14T06:32:48.2633725Z  2025-03-14T06:32:48.2634613Z [16,952 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:48.2635806Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T06:32:48.2636528Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T06:32:48.2637393Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T06:32:48.2638336Z Compiling xla/hlo/translate/hlo_to_mhlo/location_importer.cc; 13s local 2025-03-14T06:32:48.2639313Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T06:32:48.2640228Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T06:32:48.2641129Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T06:32:48.2642060Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local ... 2025-03-14T06:32:48.5230590Z 2025-03-14T06:32:48.5231382Z  2025-03-14T06:32:48.5231808Z  2025-03-14T06:32:48.5232133Z  2025-03-14T06:32:48.5232460Z  2025-03-14T06:32:48.5232786Z  2025-03-14T06:32:48.5233097Z  2025-03-14T06:32:48.5233472Z  2025-03-14T06:32:48.5233783Z  2025-03-14T06:32:48.5234559Z [16,953 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:48.5235363Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T06:32:48.5235992Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T06:32:48.5236938Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:48.5237723Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T06:32:48.5238503Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T06:32:48.5239411Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T06:32:48.5240182Z @xla//xla/hlo/transforms:convolution_group_converter; 11s local 2025-03-14T06:32:48.5240940Z @xla//xla/hlo/transforms:sub_byte_normalization; 11s local ... 2025-03-14T06:32:48.8098104Z 2025-03-14T06:32:48.8099000Z  2025-03-14T06:32:48.8099519Z  2025-03-14T06:32:48.8099952Z  2025-03-14T06:32:48.8100362Z  2025-03-14T06:32:48.8100775Z  2025-03-14T06:32:48.8101160Z  2025-03-14T06:32:48.8101585Z  2025-03-14T06:32:48.8101993Z  2025-03-14T06:32:48.8102944Z [16,954 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:48.8103961Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T06:32:48.8104745Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T06:32:48.8105635Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:48.8106650Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 13s local 2025-03-14T06:32:48.8107786Z Compiling llvm/lib/Analysis/LoopAccessAnalysis.cpp; 13s local 2025-03-14T06:32:48.8108797Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T06:32:48.8109802Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T06:32:48.8110794Z @xla//xla/hlo/transforms:sub_byte_normalization; 11s local ... 2025-03-14T06:32:49.0107552Z 2025-03-14T06:32:49.0108458Z  2025-03-14T06:32:49.0108959Z  2025-03-14T06:32:49.0109624Z  2025-03-14T06:32:49.0110073Z  2025-03-14T06:32:49.0110477Z  2025-03-14T06:32:49.0110896Z  2025-03-14T06:32:49.0111315Z  2025-03-14T06:32:49.0111727Z  2025-03-14T06:32:49.0112697Z [16,957 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:49.0113696Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T06:32:49.0114473Z Compiling xla/hlo/ir/hlo_instruction.cc; 22s local 2025-03-14T06:32:49.0115400Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:49.0116433Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:49.0117441Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T06:32:49.0118734Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 11s local 2025-03-14T06:32:49.0119871Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local 2025-03-14T06:32:49.0120842Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local ... 2025-03-14T06:32:49.2125333Z 2025-03-14T06:32:49.2126165Z  2025-03-14T06:32:49.2126696Z  2025-03-14T06:32:49.2127107Z  2025-03-14T06:32:49.2127504Z  2025-03-14T06:32:49.2127878Z  2025-03-14T06:32:49.2128264Z  2025-03-14T06:32:49.2128649Z  2025-03-14T06:32:49.2129034Z  2025-03-14T06:32:49.2129964Z [16,958 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:49.2131242Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T06:32:49.2132005Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T06:32:49.2132876Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:49.2133864Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:49.2134820Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T06:32:49.2135856Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 12s local 2025-03-14T06:32:49.2137107Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local 2025-03-14T06:32:49.2138057Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local ... 2025-03-14T06:32:49.4336713Z 2025-03-14T06:32:49.4337587Z  2025-03-14T06:32:49.4338089Z  2025-03-14T06:32:49.4338506Z  2025-03-14T06:32:49.4338913Z  2025-03-14T06:32:49.4339321Z  2025-03-14T06:32:49.4339731Z  2025-03-14T06:32:49.4340152Z  2025-03-14T06:32:49.4340543Z  2025-03-14T06:32:49.4341464Z [16,959 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:49.4342444Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T06:32:49.4343254Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T06:32:49.4344158Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:49.4345210Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:49.4346221Z @xla//xla/hlo/transforms:convolution_group_converter; 12s local 2025-03-14T06:32:49.4347292Z Compiling .../transforms/simplifiers/sub_byte_normalization.cc; 12s local 2025-03-14T06:32:49.4348389Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local 2025-03-14T06:32:49.4349281Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local ... 2025-03-14T06:32:49.6640193Z 2025-03-14T06:32:49.6641081Z  2025-03-14T06:32:49.6641584Z  2025-03-14T06:32:49.6641992Z  2025-03-14T06:32:49.6642370Z  2025-03-14T06:32:49.6642766Z  2025-03-14T06:32:49.6643167Z  2025-03-14T06:32:49.6643555Z  2025-03-14T06:32:49.6643978Z  2025-03-14T06:32:49.6645058Z [16,961 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:49.6646004Z Compiling xla/hlo/ir/hlo_instruction.cc; 37s local 2025-03-14T06:32:49.6647163Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T06:32:49.6648117Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T06:32:49.6649179Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:49.6650219Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local 2025-03-14T06:32:49.6651164Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T06:32:49.6652062Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T06:32:49.6653151Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 10s local ... 2025-03-14T06:32:49.8940370Z 2025-03-14T06:32:49.8941214Z  2025-03-14T06:32:49.8941982Z  2025-03-14T06:32:49.8942396Z  2025-03-14T06:32:49.8942800Z  2025-03-14T06:32:49.8943189Z  2025-03-14T06:32:49.8943587Z  2025-03-14T06:32:49.8943957Z  2025-03-14T06:32:49.8944332Z  2025-03-14T06:32:49.8945357Z [16,963 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:49.8946331Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T06:32:49.8947215Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T06:32:49.8948199Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 14s local 2025-03-14T06:32:49.8949204Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local 2025-03-14T06:32:49.8950112Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T06:32:49.8951283Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T06:32:49.8952309Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2025-03-14T06:32:49.8953246Z @xla//xla/hlo/transforms:dynamic_index_splitter; 10s local ... 2025-03-14T06:32:50.1622258Z 2025-03-14T06:32:50.1623160Z  2025-03-14T06:32:50.1623697Z  2025-03-14T06:32:50.1624080Z  2025-03-14T06:32:50.1624512Z  2025-03-14T06:32:50.1624905Z  2025-03-14T06:32:50.1625339Z  2025-03-14T06:32:50.1625717Z  2025-03-14T06:32:50.1626365Z  2025-03-14T06:32:50.1627348Z [16,967 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:50.1628336Z Compiling xla/hlo/ir/hlo_instruction.cc; 23s local 2025-03-14T06:32:50.1629224Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T06:32:50.1630170Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T06:32:50.1631162Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local 2025-03-14T06:32:50.1632037Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T06:32:50.1632999Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T06:32:50.1634005Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2025-03-14T06:32:50.1634994Z @xla//xla/hlo/transforms:dynamic_index_splitter; 11s local ... 2025-03-14T06:32:50.4647599Z 2025-03-14T06:32:50.4648450Z  2025-03-14T06:32:50.4648925Z  2025-03-14T06:32:50.4649347Z  2025-03-14T06:32:50.4649733Z  2025-03-14T06:32:50.4650127Z  2025-03-14T06:32:50.4650512Z  2025-03-14T06:32:50.4650878Z  2025-03-14T06:32:50.4651271Z  2025-03-14T06:32:50.4652162Z [16,967 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:50.4653138Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T06:32:50.4653995Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T06:32:50.4654960Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T06:32:50.4655955Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local 2025-03-14T06:32:50.4656825Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T06:32:50.4658094Z Compiling xla/hlo/transforms/expanders/comparison_expander.cc; 11s local 2025-03-14T06:32:50.4659115Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 11s local 2025-03-14T06:32:50.4660035Z @xla//xla/hlo/transforms:dynamic_index_splitter; 11s local ... 2025-03-14T06:32:50.7640446Z 2025-03-14T06:32:50.7641365Z  2025-03-14T06:32:50.7641859Z  2025-03-14T06:32:50.7642247Z  2025-03-14T06:32:50.7642663Z  2025-03-14T06:32:50.7643041Z  2025-03-14T06:32:50.7643443Z  2025-03-14T06:32:50.7643837Z  2025-03-14T06:32:50.7644383Z  2025-03-14T06:32:50.7645294Z [16,972 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:50.7646283Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T06:32:50.7647570Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 15s local 2025-03-14T06:32:50.7648561Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local 2025-03-14T06:32:50.7649501Z Compiling xla/hlo/builder/lib/matrix.cc; 12s local 2025-03-14T06:32:50.7650235Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2025-03-14T06:32:50.7651197Z Compiling xla/hlo/transforms/expanders/reshape_decomposer.cc; 11s local 2025-03-14T06:32:50.7652145Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T06:32:50.7653068Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 8s local ... 2025-03-14T06:32:51.0230622Z 2025-03-14T06:32:51.0231465Z  2025-03-14T06:32:51.0232323Z  2025-03-14T06:32:51.0232733Z  2025-03-14T06:32:51.0233153Z  2025-03-14T06:32:51.0233570Z  2025-03-14T06:32:51.0233988Z  2025-03-14T06:32:51.0234397Z  2025-03-14T06:32:51.0234811Z  2025-03-14T06:32:51.0235743Z [16,973 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:51.0236838Z Compiling xla/hlo/ir/hlo_instruction.cc; 24s local 2025-03-14T06:32:51.0237742Z Compiling xla/hlo/analysis/tuple_points_to_analysis.cc; 16s local 2025-03-14T06:32:51.0238755Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2025-03-14T06:32:51.0239861Z Compiling xla/hlo/builder/lib/matrix.cc; 12s local 2025-03-14T06:32:51.0240663Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2025-03-14T06:32:51.0241431Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T06:32:51.0242251Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 8s local 2025-03-14T06:32:51.0243132Z Compiling xla/service/tuple_util.cc; 8s local ... 2025-03-14T06:32:51.2655038Z 2025-03-14T06:32:51.2655943Z  2025-03-14T06:32:51.2656397Z  2025-03-14T06:32:51.2656779Z  2025-03-14T06:32:51.2657205Z  2025-03-14T06:32:51.2657589Z  2025-03-14T06:32:51.2657980Z  2025-03-14T06:32:51.2658393Z  2025-03-14T06:32:51.2658791Z  2025-03-14T06:32:51.2659755Z [16,976 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:51.2660792Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T06:32:51.2661743Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2025-03-14T06:32:51.2662743Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2025-03-14T06:32:51.2663628Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 9s local 2025-03-14T06:32:51.2664645Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2025-03-14T06:32:51.2676470Z Compiling xla/service/tuple_util.cc; 9s local 2025-03-14T06:32:51.2677745Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 8s local 2025-03-14T06:32:51.2678694Z Compiling xla/hlo/builder/lib/sorting.cc; 8s local ... 2025-03-14T06:32:51.6660041Z 2025-03-14T06:32:51.6660870Z  2025-03-14T06:32:51.6661356Z  2025-03-14T06:32:51.6661762Z  2025-03-14T06:32:51.6662170Z  2025-03-14T06:32:51.6662561Z  2025-03-14T06:32:51.6662954Z  2025-03-14T06:32:51.6663623Z  2025-03-14T06:32:51.6664045Z  2025-03-14T06:32:51.6665002Z [16,977 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:51.6666205Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T06:32:51.6667114Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2025-03-14T06:32:51.6668096Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 12s local 2025-03-14T06:32:51.6668928Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T06:32:51.6669844Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2025-03-14T06:32:51.6670712Z Compiling xla/service/tuple_util.cc; 9s local 2025-03-14T06:32:51.6671811Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local 2025-03-14T06:32:51.6672773Z Compiling xla/hlo/builder/lib/sorting.cc; 8s local ... 2025-03-14T06:32:51.9195144Z 2025-03-14T06:32:51.9196015Z  2025-03-14T06:32:51.9196516Z  2025-03-14T06:32:51.9196900Z  2025-03-14T06:32:51.9197285Z  2025-03-14T06:32:51.9197676Z  2025-03-14T06:32:51.9198073Z  2025-03-14T06:32:51.9198459Z  2025-03-14T06:32:51.9198841Z  2025-03-14T06:32:51.9199740Z [16,978 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:51.9200725Z Compiling xla/hlo/ir/hlo_instruction.cc; 25s local 2025-03-14T06:32:51.9201573Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2025-03-14T06:32:51.9202809Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2025-03-14T06:32:51.9203654Z Compiling llvm/lib/Analysis/MemorySSA.cpp; 10s local 2025-03-14T06:32:51.9204695Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 9s local 2025-03-14T06:32:51.9205710Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local 2025-03-14T06:32:51.9206673Z Compiling xla/hlo/builder/lib/sorting.cc; 9s local 2025-03-14T06:32:51.9207451Z Compiling xla/hlo/builder/lib/sorting.cc; 8s local ... 2025-03-14T06:32:52.2665873Z 2025-03-14T06:32:52.2666743Z  2025-03-14T06:32:52.2667490Z  2025-03-14T06:32:52.2667903Z  2025-03-14T06:32:52.2668293Z  2025-03-14T06:32:52.2668674Z  2025-03-14T06:32:52.2669043Z  2025-03-14T06:32:52.2669416Z  2025-03-14T06:32:52.2669795Z  2025-03-14T06:32:52.2670705Z [16,979 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:52.2671751Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T06:32:52.2672628Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2025-03-14T06:32:52.2673584Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 13s local 2025-03-14T06:32:52.2674566Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2025-03-14T06:32:52.2675672Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local 2025-03-14T06:32:52.2676559Z Compiling xla/hlo/builder/lib/sorting.cc; 9s local 2025-03-14T06:32:52.2677263Z Compiling xla/hlo/builder/lib/sorting.cc; 8s local 2025-03-14T06:32:52.2678123Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 8s local ... 2025-03-14T06:32:52.9237722Z 2025-03-14T06:32:52.9238574Z  2025-03-14T06:32:52.9239064Z  2025-03-14T06:32:52.9239477Z  2025-03-14T06:32:52.9239884Z  2025-03-14T06:32:52.9240285Z  2025-03-14T06:32:52.9240709Z  2025-03-14T06:32:52.9241110Z  2025-03-14T06:32:52.9241490Z  2025-03-14T06:32:52.9242384Z [16,980 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:52.9243395Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T06:32:52.9244559Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2025-03-14T06:32:52.9245815Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2025-03-14T06:32:52.9246770Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 10s local 2025-03-14T06:32:52.9247852Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 10s local 2025-03-14T06:32:52.9248778Z Compiling xla/hlo/builder/lib/sorting.cc; 10s local 2025-03-14T06:32:52.9249518Z Compiling xla/hlo/builder/lib/sorting.cc; 9s local 2025-03-14T06:32:52.9250438Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local ... 2025-03-14T06:32:53.1267254Z 2025-03-14T06:32:53.1268175Z  2025-03-14T06:32:53.1268663Z  2025-03-14T06:32:53.1269067Z  2025-03-14T06:32:53.1269480Z  2025-03-14T06:32:53.1269864Z  2025-03-14T06:32:53.1270249Z  2025-03-14T06:32:53.1271030Z  2025-03-14T06:32:53.1271404Z  2025-03-14T06:32:53.1272337Z [16,982 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:53.1273305Z Compiling xla/hlo/ir/hlo_instruction.cc; 26s local 2025-03-14T06:32:53.1274203Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2025-03-14T06:32:53.1275183Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2025-03-14T06:32:53.1276147Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T06:32:53.1277193Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 10s local 2025-03-14T06:32:53.1278098Z Compiling xla/hlo/builder/lib/sorting.cc; 10s local 2025-03-14T06:32:53.1278827Z Compiling xla/hlo/builder/lib/sorting.cc; 9s local 2025-03-14T06:32:53.1279995Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local ... 2025-03-14T06:32:53.4675550Z 2025-03-14T06:32:53.4676391Z  2025-03-14T06:32:53.4676928Z  2025-03-14T06:32:53.4677336Z  2025-03-14T06:32:53.4677763Z  2025-03-14T06:32:53.4678197Z  2025-03-14T06:32:53.4678594Z  2025-03-14T06:32:53.4678971Z  2025-03-14T06:32:53.4679373Z  2025-03-14T06:32:53.4680324Z [16,983 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:53.4681634Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T06:32:53.4682535Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2025-03-14T06:32:53.4683448Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 14s local 2025-03-14T06:32:53.4684488Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T06:32:53.4685564Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T06:32:53.4686596Z Compiling xla/hlo/builder/lib/sorting.cc; 9s local 2025-03-14T06:32:53.4687512Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 9s local 2025-03-14T06:32:53.4688472Z Compiling xla/service/hlo_phi_graph.cc; 9s local ... 2025-03-14T06:32:53.7985579Z 2025-03-14T06:32:53.7986388Z  2025-03-14T06:32:53.7986895Z  2025-03-14T06:32:53.7987307Z  2025-03-14T06:32:53.7987744Z  2025-03-14T06:32:53.7988159Z  2025-03-14T06:32:53.7988539Z  2025-03-14T06:32:53.7988926Z  2025-03-14T06:32:53.7989336Z  2025-03-14T06:32:53.7990211Z [16,984 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:53.7991162Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T06:32:53.7992043Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2025-03-14T06:32:53.7992926Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T06:32:53.7993973Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 11s local 2025-03-14T06:32:53.7995001Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T06:32:53.7996138Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 10s local 2025-03-14T06:32:53.7997057Z Compiling xla/service/hlo_phi_graph.cc; 9s local 2025-03-14T06:32:53.7998021Z Compiling xla/hlo/builder/lib/matrix.cc; 9s local ... 2025-03-14T06:32:54.0681912Z 2025-03-14T06:32:54.0682800Z  2025-03-14T06:32:54.0683289Z  2025-03-14T06:32:54.0683705Z  2025-03-14T06:32:54.0684108Z  2025-03-14T06:32:54.0684622Z  2025-03-14T06:32:54.0685006Z  2025-03-14T06:32:54.0685373Z  2025-03-14T06:32:54.0685765Z  2025-03-14T06:32:54.0686673Z [16,984 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:54.0687688Z Compiling xla/hlo/ir/hlo_instruction.cc; 27s local 2025-03-14T06:32:54.0688559Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2025-03-14T06:32:54.0689505Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T06:32:54.0690770Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T06:32:54.0691851Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T06:32:54.0692976Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 10s local 2025-03-14T06:32:54.0693913Z Compiling xla/service/hlo_phi_graph.cc; 10s local 2025-03-14T06:32:54.0694691Z Compiling xla/hlo/builder/lib/matrix.cc; 9s local ... 2025-03-14T06:32:54.3813570Z 2025-03-14T06:32:54.3814393Z  2025-03-14T06:32:54.3814861Z  2025-03-14T06:32:54.3815241Z  2025-03-14T06:32:54.3815620Z  2025-03-14T06:32:54.3815982Z  2025-03-14T06:32:54.3816353Z  2025-03-14T06:32:54.3816704Z  2025-03-14T06:32:54.3817380Z  2025-03-14T06:32:54.3818233Z [16,985 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:54.3819121Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T06:32:54.3819964Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2025-03-14T06:32:54.3820831Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T06:32:54.3821726Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T06:32:54.3822677Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 12s local 2025-03-14T06:32:54.3825600Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 10s local 2025-03-14T06:32:54.3826720Z Compiling xla/service/hlo_phi_graph.cc; 10s local 2025-03-14T06:32:54.3827427Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local ... 2025-03-14T06:32:54.6455408Z 2025-03-14T06:32:54.6456283Z  2025-03-14T06:32:54.6456807Z  2025-03-14T06:32:54.6457210Z  2025-03-14T06:32:54.6457584Z  2025-03-14T06:32:54.6457977Z  2025-03-14T06:32:54.6458370Z  2025-03-14T06:32:54.6458680Z  2025-03-14T06:32:54.6459033Z  2025-03-14T06:32:54.6459812Z [16,986 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:54.6460776Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T06:32:54.6461651Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2025-03-14T06:32:54.6462562Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 15s local 2025-03-14T06:32:54.6463496Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T06:32:54.6464461Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T06:32:54.6465672Z Compiling xla/service/hlo_phi_graph.cc; 10s local 2025-03-14T06:32:54.6466393Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local 2025-03-14T06:32:54.6467115Z Compiling xla/pjrt/layout_mode.cc; 9s local ... 2025-03-14T06:32:54.8688715Z 2025-03-14T06:32:54.8689551Z  2025-03-14T06:32:54.8690051Z  2025-03-14T06:32:54.8690467Z  2025-03-14T06:32:54.8690904Z  2025-03-14T06:32:54.8691313Z  2025-03-14T06:32:54.8691700Z  2025-03-14T06:32:54.8692091Z  2025-03-14T06:32:54.8692488Z  2025-03-14T06:32:54.8693670Z [16,987 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:54.8694671Z Compiling xla/hlo/ir/hlo_instruction.cc; 28s local 2025-03-14T06:32:54.8695584Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2025-03-14T06:32:54.8696536Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T06:32:54.8697571Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 12s local 2025-03-14T06:32:54.8698658Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T06:32:54.8699593Z Compiling xla/service/hlo_phi_graph.cc; 10s local 2025-03-14T06:32:54.8700341Z Compiling xla/hlo/builder/lib/matrix.cc; 10s local 2025-03-14T06:32:54.8701071Z Compiling xla/pjrt/layout_mode.cc; 9s local ... 2025-03-14T06:32:55.3178569Z 2025-03-14T06:32:55.3179384Z  2025-03-14T06:32:55.3179854Z  2025-03-14T06:32:55.3180258Z  2025-03-14T06:32:55.3180634Z  2025-03-14T06:32:55.3181003Z  2025-03-14T06:32:55.3181367Z  2025-03-14T06:32:55.3181789Z  2025-03-14T06:32:55.3182164Z  2025-03-14T06:32:55.3183092Z [16,988 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:55.3184011Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T06:32:55.3184893Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2025-03-14T06:32:55.3185799Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T06:32:55.3186626Z Compiling llvm/lib/Analysis/ModuleSummaryAnalysis.cpp; 13s local 2025-03-14T06:32:55.3187893Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 11s local 2025-03-14T06:32:55.3188767Z Compiling xla/service/hlo_phi_graph.cc; 11s local 2025-03-14T06:32:55.3189490Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T06:32:55.3190174Z Compiling xla/pjrt/layout_mode.cc; 10s local ... 2025-03-14T06:32:55.6129056Z 2025-03-14T06:32:55.6130013Z  2025-03-14T06:32:55.6130553Z  2025-03-14T06:32:55.6131013Z  2025-03-14T06:32:55.6131402Z  2025-03-14T06:32:55.6131816Z  2025-03-14T06:32:55.6132483Z  2025-03-14T06:32:55.6132932Z  2025-03-14T06:32:55.6133341Z  2025-03-14T06:32:55.6134278Z [16,990 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:55.6135263Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T06:32:55.6136181Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2025-03-14T06:32:55.6137118Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 16s local 2025-03-14T06:32:55.6138087Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 12s local 2025-03-14T06:32:55.6139001Z Compiling xla/service/hlo_phi_graph.cc; 11s local 2025-03-14T06:32:55.6139725Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T06:32:55.6140450Z Compiling xla/pjrt/layout_mode.cc; 10s local 2025-03-14T06:32:55.6141163Z Compiling xla/hlo/builder/lib/svd.cc; 10s local ... 2025-03-14T06:32:55.8696423Z 2025-03-14T06:32:55.8697319Z  2025-03-14T06:32:55.8697826Z  2025-03-14T06:32:55.8698228Z  2025-03-14T06:32:55.8698638Z  2025-03-14T06:32:55.8699021Z  2025-03-14T06:32:55.8699415Z  2025-03-14T06:32:55.8699762Z  2025-03-14T06:32:55.8700140Z  2025-03-14T06:32:55.8701116Z [16,990 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:55.8702088Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T06:32:55.8702920Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2025-03-14T06:32:55.8703863Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T06:32:55.8704887Z Compiling xla/hlo/transforms/simplifiers/sort_simplifier.cc; 12s local 2025-03-14T06:32:55.8705834Z Compiling xla/service/hlo_phi_graph.cc; 11s local 2025-03-14T06:32:55.8706814Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T06:32:55.8707533Z Compiling xla/pjrt/layout_mode.cc; 10s local 2025-03-14T06:32:55.8708239Z Compiling xla/hlo/builder/lib/svd.cc; 10s local ... 2025-03-14T06:32:56.1053876Z 2025-03-14T06:32:56.1054698Z  2025-03-14T06:32:56.1055160Z  2025-03-14T06:32:56.1055558Z  2025-03-14T06:32:56.1055963Z  2025-03-14T06:32:56.1056379Z  2025-03-14T06:32:56.1056784Z  2025-03-14T06:32:56.1057172Z  2025-03-14T06:32:56.1057690Z  2025-03-14T06:32:56.1058581Z [16,994 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:56.1059503Z Compiling xla/hlo/ir/hlo_instruction.cc; 29s local 2025-03-14T06:32:56.1060665Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2025-03-14T06:32:56.1061629Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T06:32:56.1062459Z Compiling xla/hlo/builder/lib/matrix.cc; 11s local 2025-03-14T06:32:56.1063187Z Compiling xla/hlo/builder/lib/svd.cc; 10s local 2025-03-14T06:32:56.1064126Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 9s local 2025-03-14T06:32:56.1065180Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 9s local 2025-03-14T06:32:56.1066510Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 9s local ... 2025-03-14T06:32:56.3891984Z 2025-03-14T06:32:56.3892850Z  2025-03-14T06:32:56.3893301Z  2025-03-14T06:32:56.3893964Z  2025-03-14T06:32:56.3894350Z  2025-03-14T06:32:56.3894737Z  2025-03-14T06:32:56.3895098Z  2025-03-14T06:32:56.3895526Z  2025-03-14T06:32:56.3895926Z  2025-03-14T06:32:56.3896843Z [16,996 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:56.3897783Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T06:32:56.3898743Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2025-03-14T06:32:56.3899681Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T06:32:56.3900862Z Compiling xla/hlo/builder/lib/matrix.cc; 12s local 2025-03-14T06:32:56.3901602Z Compiling xla/hlo/builder/lib/svd.cc; 11s local 2025-03-14T06:32:56.3902507Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 9s local 2025-03-14T06:32:56.3903567Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 9s local 2025-03-14T06:32:56.3904609Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 9s local ... 2025-03-14T06:32:56.6703037Z 2025-03-14T06:32:56.6703832Z  2025-03-14T06:32:56.6704275Z  2025-03-14T06:32:56.6704664Z  2025-03-14T06:32:56.6705056Z  2025-03-14T06:32:56.6705420Z  2025-03-14T06:32:56.6705789Z  2025-03-14T06:32:56.6706164Z  2025-03-14T06:32:56.6706506Z  2025-03-14T06:32:56.6707409Z [16,998 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:56.6708336Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T06:32:56.6709163Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 17s local 2025-03-14T06:32:56.6709960Z Compiling xla/hlo/builder/lib/svd.cc; 11s local 2025-03-14T06:32:56.6710815Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 10s local 2025-03-14T06:32:56.6711804Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 10s local 2025-03-14T06:32:56.6712821Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 10s local 2025-03-14T06:32:56.6713872Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 9s local 2025-03-14T06:32:56.6714833Z @xla//xla/hlo/transforms:reduce_window_rewriter; 8s local ... 2025-03-14T06:32:56.8706978Z 2025-03-14T06:32:56.8707816Z  2025-03-14T06:32:56.8708232Z  2025-03-14T06:32:56.8708566Z  2025-03-14T06:32:56.8708927Z  2025-03-14T06:32:56.8709242Z  2025-03-14T06:32:56.8709878Z  2025-03-14T06:32:56.8710242Z  2025-03-14T06:32:56.8710568Z  2025-03-14T06:32:56.8711394Z [16,999 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:56.8712212Z Compiling xla/hlo/ir/hlo_instruction.cc; 30s local 2025-03-14T06:32:56.8712932Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T06:32:56.8713627Z Compiling xla/hlo/builder/lib/svd.cc; 11s local 2025-03-14T06:32:56.8714397Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 10s local 2025-03-14T06:32:56.8715305Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 10s local 2025-03-14T06:32:56.8716182Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 10s local 2025-03-14T06:32:56.8717376Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 9s local 2025-03-14T06:32:56.8718212Z @xla//xla/hlo/transforms:reduce_window_rewriter; 8s local ... 2025-03-14T06:32:57.2711021Z 2025-03-14T06:32:57.2711720Z  2025-03-14T06:32:57.2712151Z  2025-03-14T06:32:57.2712535Z  2025-03-14T06:32:57.2712916Z  2025-03-14T06:32:57.2713320Z  2025-03-14T06:32:57.2713726Z  2025-03-14T06:32:57.2714099Z  2025-03-14T06:32:57.2714466Z  2025-03-14T06:32:57.2715373Z [17,000 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:57.2716354Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T06:32:57.2717458Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T06:32:57.2718257Z Compiling xla/hlo/builder/lib/svd.cc; 11s local 2025-03-14T06:32:57.2719154Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 10s local 2025-03-14T06:32:57.2720202Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 10s local 2025-03-14T06:32:57.2721204Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 10s local 2025-03-14T06:32:57.2722270Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 9s local 2025-03-14T06:32:57.2723513Z @xla//xla/hlo/transforms:reduce_window_rewriter; 9s local ... 2025-03-14T06:32:57.4715488Z 2025-03-14T06:32:57.4716367Z  2025-03-14T06:32:57.4716882Z  2025-03-14T06:32:57.4717308Z  2025-03-14T06:32:57.4717742Z  2025-03-14T06:32:57.4718164Z  2025-03-14T06:32:57.4718583Z  2025-03-14T06:32:57.4718960Z  2025-03-14T06:32:57.4719335Z  2025-03-14T06:32:57.4720194Z [17,001 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:57.4721175Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T06:32:57.4721916Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T06:32:57.4722774Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local 2025-03-14T06:32:57.4723707Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 11s local 2025-03-14T06:32:57.4724804Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 10s local 2025-03-14T06:32:57.4725757Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 10s local 2025-03-14T06:32:57.4726727Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 9s local 2025-03-14T06:32:57.4727648Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local ... 2025-03-14T06:32:57.6778022Z 2025-03-14T06:32:57.6778875Z  2025-03-14T06:32:57.6779382Z  2025-03-14T06:32:57.6779819Z  2025-03-14T06:32:57.6780229Z  2025-03-14T06:32:57.6780651Z  2025-03-14T06:32:57.6781040Z  2025-03-14T06:32:57.6781435Z  2025-03-14T06:32:57.6781790Z  2025-03-14T06:32:57.6782736Z [17,002 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:57.6783725Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T06:32:57.6784994Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 18s local 2025-03-14T06:32:57.6786036Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local 2025-03-14T06:32:57.6787215Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 11s local 2025-03-14T06:32:57.6788374Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 11s local 2025-03-14T06:32:57.6789540Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 10s local 2025-03-14T06:32:57.6790708Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 9s local 2025-03-14T06:32:57.6791789Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 9s local ... 2025-03-14T06:32:58.0721848Z 2025-03-14T06:32:58.0722725Z  2025-03-14T06:32:58.0723562Z  2025-03-14T06:32:58.0723979Z  2025-03-14T06:32:58.0724476Z  2025-03-14T06:32:58.0724868Z  2025-03-14T06:32:58.0725255Z  2025-03-14T06:32:58.0725651Z  2025-03-14T06:32:58.0726056Z  2025-03-14T06:32:58.0727061Z [17,003 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:58.0728065Z Compiling xla/hlo/ir/hlo_instruction.cc; 31s local 2025-03-14T06:32:58.0729044Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2025-03-14T06:32:58.0729996Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local 2025-03-14T06:32:58.0731113Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 11s local 2025-03-14T06:32:58.0732186Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 11s local 2025-03-14T06:32:58.0733607Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 10s local 2025-03-14T06:32:58.0734739Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 10s local 2025-03-14T06:32:58.0735810Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local ... 2025-03-14T06:32:58.2724907Z 2025-03-14T06:32:58.2725681Z  2025-03-14T06:32:58.2726147Z  2025-03-14T06:32:58.2726564Z  2025-03-14T06:32:58.2726965Z  2025-03-14T06:32:58.2727341Z  2025-03-14T06:32:58.2727731Z  2025-03-14T06:32:58.2728115Z  2025-03-14T06:32:58.2728716Z  2025-03-14T06:32:58.2729651Z [17,005 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:58.2730633Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T06:32:58.2731491Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2025-03-14T06:32:58.2732469Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local 2025-03-14T06:32:58.2733466Z Compiling xla/hlo/transforms/simplifiers/slice_sinker.cc; 11s local 2025-03-14T06:32:58.2734501Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 10s local 2025-03-14T06:32:58.2735620Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 10s local 2025-03-14T06:32:58.2736622Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2025-03-14T06:32:58.2737553Z @xla//xla/hlo/transforms:reduce_window_rewriter; 9s local ... 2025-03-14T06:32:58.5969122Z 2025-03-14T06:32:58.5970017Z  2025-03-14T06:32:58.5970504Z  2025-03-14T06:32:58.5970919Z  2025-03-14T06:32:58.5971341Z  2025-03-14T06:32:58.5971746Z  2025-03-14T06:32:58.5972156Z  2025-03-14T06:32:58.5972562Z  2025-03-14T06:32:58.5972951Z  2025-03-14T06:32:58.5973911Z [17,008 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:58.5974948Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T06:32:58.5975957Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 19s local 2025-03-14T06:32:58.5977057Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2025-03-14T06:32:58.5978278Z Compiling .../transforms/simplifiers/simplify_fp_conversions.cc; 11s local 2025-03-14T06:32:58.5979743Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 10s local 2025-03-14T06:32:58.5980890Z Compiling llvm/lib/ProfileData/InstrProfWriter.cpp; 10s local 2025-03-14T06:32:58.5982036Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 10s local 2025-03-14T06:32:58.5983151Z @llvm-project//mlir:TransformDialectInterfaces; 9s local ... 2025-03-14T06:32:58.8276719Z 2025-03-14T06:32:58.8277556Z  2025-03-14T06:32:58.8278168Z  2025-03-14T06:32:58.8278572Z  2025-03-14T06:32:58.8279112Z  2025-03-14T06:32:58.8279529Z  2025-03-14T06:32:58.8279915Z  2025-03-14T06:32:58.8280325Z  2025-03-14T06:32:58.8280724Z  2025-03-14T06:32:58.8281719Z [17,010 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:58.8282872Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T06:32:58.8283756Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T06:32:58.8284981Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2025-03-14T06:32:58.8286149Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 10s local 2025-03-14T06:32:58.8287292Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 10s local 2025-03-14T06:32:58.8288324Z @llvm-project//mlir:TransformDialectInterfaces; 9s local 2025-03-14T06:32:58.8289170Z Compiling xla/service/topk_rewriter.cc; 9s local 2025-03-14T06:32:58.8290054Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 9s local ... 2025-03-14T06:32:59.0732234Z 2025-03-14T06:32:59.0733073Z  2025-03-14T06:32:59.0733574Z  2025-03-14T06:32:59.0733979Z  2025-03-14T06:32:59.0734378Z  2025-03-14T06:32:59.0734812Z  2025-03-14T06:32:59.0735191Z  2025-03-14T06:32:59.0735581Z  2025-03-14T06:32:59.0735979Z  2025-03-14T06:32:59.0736924Z [17,011 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:32:59.0737951Z Compiling xla/hlo/ir/hlo_instruction.cc; 32s local 2025-03-14T06:32:59.0738778Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T06:32:59.0740137Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2025-03-14T06:32:59.0741264Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 11s local 2025-03-14T06:32:59.0742354Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 10s local 2025-03-14T06:32:59.0743294Z @llvm-project//mlir:TransformDialectInterfaces; 10s local 2025-03-14T06:32:59.0744083Z Compiling xla/service/topk_rewriter.cc; 10s local 2025-03-14T06:32:59.0745007Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 10s local ... 2025-03-14T06:32:59.6823401Z 2025-03-14T06:32:59.6824295Z  2025-03-14T06:32:59.6824795Z  2025-03-14T06:32:59.6825199Z  2025-03-14T06:32:59.6825606Z  2025-03-14T06:32:59.6825997Z  2025-03-14T06:32:59.6826384Z  2025-03-14T06:32:59.6826790Z  2025-03-14T06:32:59.6827173Z  2025-03-14T06:32:59.6828089Z [17,012 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:59.6829047Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T06:32:59.6829875Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 20s local 2025-03-14T06:32:59.6830850Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2025-03-14T06:32:59.6832093Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 11s local 2025-03-14T06:32:59.6833255Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 11s local 2025-03-14T06:32:59.6834247Z @llvm-project//mlir:TransformDialectInterfaces; 10s local 2025-03-14T06:32:59.6835100Z Compiling xla/service/topk_rewriter.cc; 10s local 2025-03-14T06:32:59.6836026Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 10s local ... 2025-03-14T06:32:59.9355065Z 2025-03-14T06:32:59.9356179Z  2025-03-14T06:32:59.9356810Z  2025-03-14T06:32:59.9357249Z  2025-03-14T06:32:59.9357646Z  2025-03-14T06:32:59.9358095Z  2025-03-14T06:32:59.9358498Z  2025-03-14T06:32:59.9358897Z  2025-03-14T06:32:59.9359266Z  2025-03-14T06:32:59.9360188Z [17,015 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:32:59.9361215Z Compiling xla/hlo/ir/hlo_instruction.cc; 33s local 2025-03-14T06:32:59.9362100Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T06:32:59.9363198Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2025-03-14T06:32:59.9364528Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T06:32:59.9366197Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 11s local 2025-03-14T06:32:59.9367228Z @llvm-project//mlir:TransformDialectInterfaces; 11s local 2025-03-14T06:32:59.9368069Z Compiling xla/service/topk_rewriter.cc; 10s local 2025-03-14T06:32:59.9369134Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 10s local ... 2025-03-14T06:33:00.1741512Z 2025-03-14T06:33:00.1742369Z  2025-03-14T06:33:00.1742900Z  2025-03-14T06:33:00.1743323Z  2025-03-14T06:33:00.1743817Z  2025-03-14T06:33:00.1744197Z  2025-03-14T06:33:00.1744631Z  2025-03-14T06:33:00.1745085Z  2025-03-14T06:33:00.1745480Z  2025-03-14T06:33:00.1746505Z [17,017 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:00.1747726Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T06:33:00.1748582Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T06:33:00.1749639Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2025-03-14T06:33:00.1750660Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T06:33:00.1751715Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 11s local 2025-03-14T06:33:00.1752949Z @llvm-project//mlir:TransformDialectInterfaces; 11s local 2025-03-14T06:33:00.1753756Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T06:33:00.1754659Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 11s local ... 2025-03-14T06:33:00.4742643Z 2025-03-14T06:33:00.4743544Z  2025-03-14T06:33:00.4744046Z  2025-03-14T06:33:00.4744464Z  2025-03-14T06:33:00.4744890Z  2025-03-14T06:33:00.4745295Z  2025-03-14T06:33:00.4745696Z  2025-03-14T06:33:00.4746099Z  2025-03-14T06:33:00.4746514Z  2025-03-14T06:33:00.4747471Z [17,018 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:00.4748531Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T06:33:00.4749443Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 21s local 2025-03-14T06:33:00.4750496Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2025-03-14T06:33:00.4751631Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T06:33:00.4752896Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 11s local 2025-03-14T06:33:00.4753867Z @llvm-project//mlir:TransformDialectInterfaces; 11s local 2025-03-14T06:33:00.4754753Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T06:33:00.4755742Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 11s local ... 2025-03-14T06:33:00.8199958Z 2025-03-14T06:33:00.8200825Z  2025-03-14T06:33:00.8201324Z  2025-03-14T06:33:00.8201813Z  2025-03-14T06:33:00.8202259Z  2025-03-14T06:33:00.8202737Z  2025-03-14T06:33:00.8203121Z  2025-03-14T06:33:00.8203518Z  2025-03-14T06:33:00.8203892Z  2025-03-14T06:33:00.8205243Z [17,019 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:00.8206310Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T06:33:00.8207188Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:33:00.8208182Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2025-03-14T06:33:00.8209300Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T06:33:00.8210406Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T06:33:00.8211485Z @llvm-project//mlir:TransformDialectInterfaces; 11s local 2025-03-14T06:33:00.8212250Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T06:33:00.8213137Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 11s local ... 2025-03-14T06:33:01.0425419Z 2025-03-14T06:33:01.0426287Z  2025-03-14T06:33:01.0426775Z  2025-03-14T06:33:01.0427178Z  2025-03-14T06:33:01.0427613Z  2025-03-14T06:33:01.0428065Z  2025-03-14T06:33:01.0428464Z  2025-03-14T06:33:01.0428865Z  2025-03-14T06:33:01.0429242Z  2025-03-14T06:33:01.0430186Z [17,022 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:01.0431176Z Compiling xla/hlo/ir/hlo_instruction.cc; 34s local 2025-03-14T06:33:01.0432035Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:33:01.0433020Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2025-03-14T06:33:01.0434458Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T06:33:01.0435438Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2025-03-14T06:33:01.0436269Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T06:33:01.0437150Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T06:33:01.0438250Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local ... 2025-03-14T06:33:01.2750242Z 2025-03-14T06:33:01.2751120Z  2025-03-14T06:33:01.2751632Z  2025-03-14T06:33:01.2752018Z  2025-03-14T06:33:01.2752715Z  2025-03-14T06:33:01.2753122Z  2025-03-14T06:33:01.2753507Z  2025-03-14T06:33:01.2753874Z  2025-03-14T06:33:01.2754254Z  2025-03-14T06:33:01.2755186Z [17,022 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:01.2756164Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T06:33:01.2757016Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:33:01.2758016Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2025-03-14T06:33:01.2759108Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T06:33:01.2760105Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2025-03-14T06:33:01.2760912Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T06:33:01.2761813Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T06:33:01.2762864Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local ... 2025-03-14T06:33:01.4753848Z 2025-03-14T06:33:01.4754691Z  2025-03-14T06:33:01.4755115Z  2025-03-14T06:33:01.4755473Z  2025-03-14T06:33:01.4755830Z  2025-03-14T06:33:01.4756185Z  2025-03-14T06:33:01.4756529Z  2025-03-14T06:33:01.4756874Z  2025-03-14T06:33:01.4757275Z  2025-03-14T06:33:01.4758133Z [17,023 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:01.4759099Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T06:33:01.4759897Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:33:01.4760820Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 15s local 2025-03-14T06:33:01.4762186Z Compiling .../transforms/simplifiers/reduce_window_rewriter.cc; 12s local 2025-03-14T06:33:01.4763141Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2025-03-14T06:33:01.4764059Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T06:33:01.4765048Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T06:33:01.4766251Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 11s local ... 2025-03-14T06:33:01.7102339Z 2025-03-14T06:33:01.7103158Z  2025-03-14T06:33:01.7103552Z  2025-03-14T06:33:01.7103897Z  2025-03-14T06:33:01.7104209Z  2025-03-14T06:33:01.7104521Z  2025-03-14T06:33:01.7104835Z  2025-03-14T06:33:01.7105145Z  2025-03-14T06:33:01.7105457Z  2025-03-14T06:33:01.7106481Z [17,026 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:01.7107238Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T06:33:01.7107902Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 22s local 2025-03-14T06:33:01.7108588Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2025-03-14T06:33:01.7109230Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T06:33:01.7109915Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T06:33:01.7110719Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local 2025-03-14T06:33:01.7111513Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T06:33:01.7112347Z Compiling xla/pjrt/utils.cc; 12s local ... 2025-03-14T06:33:02.0390069Z 2025-03-14T06:33:02.0391008Z  2025-03-14T06:33:02.0391424Z  2025-03-14T06:33:02.0391779Z  2025-03-14T06:33:02.0392146Z  2025-03-14T06:33:02.0392478Z  2025-03-14T06:33:02.0392822Z  2025-03-14T06:33:02.0393164Z  2025-03-14T06:33:02.0393501Z  2025-03-14T06:33:02.0394333Z [17,030 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:02.0395173Z Compiling xla/hlo/ir/hlo_instruction.cc; 35s local 2025-03-14T06:33:02.0396151Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T06:33:02.0396877Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T06:33:02.0397633Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local 2025-03-14T06:33:02.0398521Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T06:33:02.0399249Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T06:33:02.0399897Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2025-03-14T06:33:02.0400732Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 11s local ... 2025-03-14T06:33:02.2761508Z 2025-03-14T06:33:02.2762384Z  2025-03-14T06:33:02.2762845Z  2025-03-14T06:33:02.2763232Z  2025-03-14T06:33:02.2763626Z  2025-03-14T06:33:02.2764023Z  2025-03-14T06:33:02.2764549Z  2025-03-14T06:33:02.2764989Z  2025-03-14T06:33:02.2765624Z  2025-03-14T06:33:02.2766661Z [17,031 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:02.2767583Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T06:33:02.2768372Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T06:33:02.2769196Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T06:33:02.2770074Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local 2025-03-14T06:33:02.2771151Z @xla//xla/hlo/transforms:optimize_input_output_buffer_alias; 12s local 2025-03-14T06:33:02.2771951Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T06:33:02.2772761Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2025-03-14T06:33:02.2773763Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local ... 2025-03-14T06:33:02.4765145Z 2025-03-14T06:33:02.4766165Z  2025-03-14T06:33:02.4766962Z  2025-03-14T06:33:02.4767395Z  2025-03-14T06:33:02.4767833Z  2025-03-14T06:33:02.4768244Z  2025-03-14T06:33:02.4768678Z  2025-03-14T06:33:02.4769095Z  2025-03-14T06:33:02.4769524Z  2025-03-14T06:33:02.4770521Z [17,032 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:02.4771599Z Compiling xla/hlo/ir/hlo_instruction.cc; 36s local 2025-03-14T06:33:02.4772514Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T06:33:02.4773438Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T06:33:02.4774370Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 12s local 2025-03-14T06:33:02.4775393Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T06:33:02.4776228Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2025-03-14T06:33:02.4777233Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2025-03-14T06:33:02.4778323Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 11s local ... 2025-03-14T06:33:02.6777724Z 2025-03-14T06:33:02.6778572Z  2025-03-14T06:33:02.6779125Z  2025-03-14T06:33:02.6779554Z  2025-03-14T06:33:02.6780071Z  2025-03-14T06:33:02.6780463Z  2025-03-14T06:33:02.6780862Z  2025-03-14T06:33:02.6781247Z  2025-03-14T06:33:02.6781662Z  2025-03-14T06:33:02.6782619Z [17,035 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:02.6784000Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 23s local 2025-03-14T06:33:02.6784911Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T06:33:02.6785880Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2025-03-14T06:33:02.6786752Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T06:33:02.6787567Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 12s local 2025-03-14T06:33:02.6788583Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2025-03-14T06:33:02.6789838Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 11s local 2025-03-14T06:33:02.6791001Z Compiling xla/service/triangular_solve_expander.cc; 11s local ... 2025-03-14T06:33:03.0495309Z 2025-03-14T06:33:03.0496192Z  2025-03-14T06:33:03.0496699Z  2025-03-14T06:33:03.0497092Z  2025-03-14T06:33:03.0497592Z  2025-03-14T06:33:03.0498116Z  2025-03-14T06:33:03.0498638Z  2025-03-14T06:33:03.0499100Z  2025-03-14T06:33:03.0499525Z  2025-03-14T06:33:03.0500461Z [17,036 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:03.0501575Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T06:33:03.0502401Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T06:33:03.0503333Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2025-03-14T06:33:03.0504224Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T06:33:03.0505008Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2025-03-14T06:33:03.0506007Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 12s local 2025-03-14T06:33:03.0507051Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T06:33:03.0508076Z Compiling xla/service/triangular_solve_expander.cc; 11s local ... 2025-03-14T06:33:03.2768876Z 2025-03-14T06:33:03.2769864Z  2025-03-14T06:33:03.2770416Z  2025-03-14T06:33:03.2770816Z  2025-03-14T06:33:03.2771217Z  2025-03-14T06:33:03.2771630Z  2025-03-14T06:33:03.2772009Z  2025-03-14T06:33:03.2772399Z  2025-03-14T06:33:03.2772827Z  2025-03-14T06:33:03.2773811Z [17,037 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:33:03.2774843Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T06:33:03.2775930Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T06:33:03.2776859Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2025-03-14T06:33:03.2777734Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T06:33:03.2778519Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2025-03-14T06:33:03.2779443Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2025-03-14T06:33:03.2780476Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T06:33:03.2781590Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2025-03-14T06:33:03.4774379Z 2025-03-14T06:33:03.4775602Z  2025-03-14T06:33:03.4776531Z  2025-03-14T06:33:03.4777751Z  2025-03-14T06:33:03.4778856Z  2025-03-14T06:33:03.4779367Z  2025-03-14T06:33:03.4779777Z  2025-03-14T06:33:03.4780177Z  2025-03-14T06:33:03.4780575Z  2025-03-14T06:33:03.4781532Z [17,038 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:03.4782703Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 24s local 2025-03-14T06:33:03.4783627Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T06:33:03.4784516Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 13s local 2025-03-14T06:33:03.4785424Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T06:33:03.4786275Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2025-03-14T06:33:03.4787565Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2025-03-14T06:33:03.4788691Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T06:33:03.4789854Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2025-03-14T06:33:03.8037783Z 2025-03-14T06:33:03.8038676Z  2025-03-14T06:33:03.8039242Z  2025-03-14T06:33:03.8039688Z  2025-03-14T06:33:03.8040115Z  2025-03-14T06:33:03.8040568Z  2025-03-14T06:33:03.8041003Z  2025-03-14T06:33:03.8041430Z  2025-03-14T06:33:03.8041865Z  2025-03-14T06:33:03.8043107Z [17,039 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:03.8044440Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T06:33:03.8045347Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T06:33:03.8046273Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2025-03-14T06:33:03.8047326Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T06:33:03.8048144Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 13s local 2025-03-14T06:33:03.8049065Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2025-03-14T06:33:03.8050152Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T06:33:03.8061467Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2025-03-14T06:33:04.0777539Z 2025-03-14T06:33:04.0778859Z  2025-03-14T06:33:04.0779381Z  2025-03-14T06:33:04.0779782Z  2025-03-14T06:33:04.0780195Z  2025-03-14T06:33:04.0780675Z  2025-03-14T06:33:04.0781054Z  2025-03-14T06:33:04.0781434Z  2025-03-14T06:33:04.0781832Z  2025-03-14T06:33:04.0782745Z [17,040 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:04.0783765Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T06:33:04.0784578Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T06:33:04.0785424Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2025-03-14T06:33:04.0786191Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T06:33:04.0786916Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:33:04.0787837Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 13s local 2025-03-14T06:33:04.0789277Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 13s local 2025-03-14T06:33:04.0790367Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2025-03-14T06:33:04.2781284Z 2025-03-14T06:33:04.2782678Z  2025-03-14T06:33:04.2783181Z  2025-03-14T06:33:04.2783594Z  2025-03-14T06:33:04.2784018Z  2025-03-14T06:33:04.2784418Z  2025-03-14T06:33:04.2784848Z  2025-03-14T06:33:04.2785250Z  2025-03-14T06:33:04.2785633Z  2025-03-14T06:33:04.2786672Z [17,041 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:04.2787772Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T06:33:04.2788639Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T06:33:04.2789910Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 14s local 2025-03-14T06:33:04.2790783Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T06:33:04.2791729Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:33:04.2792707Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2025-03-14T06:33:04.2793768Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 13s local 2025-03-14T06:33:04.2794841Z Compiling xla/service/triangular_solve_expander.cc; 13s local ... 2025-03-14T06:33:04.5862137Z 2025-03-14T06:33:04.5863416Z  2025-03-14T06:33:04.5863897Z  2025-03-14T06:33:04.5864352Z  2025-03-14T06:33:04.5864764Z  2025-03-14T06:33:04.5865695Z  2025-03-14T06:33:04.5866133Z  2025-03-14T06:33:04.5866561Z  2025-03-14T06:33:04.5866973Z  2025-03-14T06:33:04.5867850Z [17,043 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:04.5868906Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 25s local 2025-03-14T06:33:04.5869723Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T06:33:04.5870654Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2025-03-14T06:33:04.5871498Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T06:33:04.5872501Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:33:04.5873510Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2025-03-14T06:33:04.5874542Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 13s local 2025-03-14T06:33:04.5875644Z Compiling xla/service/triangular_solve_expander.cc; 13s local ... 2025-03-14T06:33:04.8788091Z 2025-03-14T06:33:04.8789033Z  2025-03-14T06:33:04.8789498Z  2025-03-14T06:33:04.8789892Z  2025-03-14T06:33:04.8790285Z  2025-03-14T06:33:04.8790705Z  2025-03-14T06:33:04.8791149Z  2025-03-14T06:33:04.8791575Z  2025-03-14T06:33:04.8791942Z  2025-03-14T06:33:04.8792910Z [17,046 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:04.8793970Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T06:33:04.8794759Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T06:33:04.8795633Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2025-03-14T06:33:04.8796465Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:04.8797239Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 14s local 2025-03-14T06:33:04.8798172Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2025-03-14T06:33:04.8799084Z Compiling xla/service/triangular_solve_expander.cc; 13s local 2025-03-14T06:33:04.8800234Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local ... 2025-03-14T06:33:05.0790762Z 2025-03-14T06:33:05.0791955Z  2025-03-14T06:33:05.0792970Z  2025-03-14T06:33:05.0794116Z  2025-03-14T06:33:05.0794588Z  2025-03-14T06:33:05.0795004Z  2025-03-14T06:33:05.0795425Z  2025-03-14T06:33:05.0795860Z  2025-03-14T06:33:05.0796281Z  2025-03-14T06:33:05.0797543Z [17,047 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:05.0798879Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T06:33:05.0799864Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T06:33:05.0800754Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2025-03-14T06:33:05.0801691Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:05.0802558Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2025-03-14T06:33:05.0803511Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 14s local 2025-03-14T06:33:05.0804705Z Compiling xla/service/triangular_solve_expander.cc; 13s local 2025-03-14T06:33:05.0806033Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local ... 2025-03-14T06:33:05.3588918Z 2025-03-14T06:33:05.3590467Z  2025-03-14T06:33:05.3591138Z  2025-03-14T06:33:05.3591789Z  2025-03-14T06:33:05.3592898Z  2025-03-14T06:33:05.3593343Z  2025-03-14T06:33:05.3593752Z  2025-03-14T06:33:05.3594180Z  2025-03-14T06:33:05.3594597Z  2025-03-14T06:33:05.3595578Z [17,051 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:05.3596664Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T06:33:05.3597506Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T06:33:05.3598428Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 15s local 2025-03-14T06:33:05.3599543Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:05.3600371Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2025-03-14T06:33:05.3601456Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2025-03-14T06:33:05.3602486Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T06:33:05.3603530Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local ... 2025-03-14T06:33:05.6508550Z 2025-03-14T06:33:05.6509416Z  2025-03-14T06:33:05.6509928Z  2025-03-14T06:33:05.6510600Z  2025-03-14T06:33:05.6511068Z  2025-03-14T06:33:05.6511494Z  2025-03-14T06:33:05.6511930Z  2025-03-14T06:33:05.6512339Z  2025-03-14T06:33:05.6512726Z  2025-03-14T06:33:05.6513696Z [17,053 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:05.6514825Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 26s local 2025-03-14T06:33:05.6515738Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T06:33:05.6516732Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2025-03-14T06:33:05.6517629Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:05.6518471Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2025-03-14T06:33:05.6519528Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2025-03-14T06:33:05.6520439Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2025-03-14T06:33:05.6521467Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2025-03-14T06:33:05.8799912Z 2025-03-14T06:33:05.8800738Z  2025-03-14T06:33:05.8801273Z  2025-03-14T06:33:05.8801710Z  2025-03-14T06:33:05.8802116Z  2025-03-14T06:33:05.8802507Z  2025-03-14T06:33:05.8802923Z  2025-03-14T06:33:05.8803317Z  2025-03-14T06:33:05.8803707Z  2025-03-14T06:33:05.8804839Z [17,053 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:05.8806041Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T06:33:05.8806938Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T06:33:05.8807890Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2025-03-14T06:33:05.8808782Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T06:33:05.8809825Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 15s local 2025-03-14T06:33:05.8810778Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2025-03-14T06:33:05.8811697Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2025-03-14T06:33:05.8812608Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2025-03-14T06:33:06.0803700Z 2025-03-14T06:33:06.0804753Z  2025-03-14T06:33:06.0805353Z  2025-03-14T06:33:06.0805709Z  2025-03-14T06:33:06.0806137Z  2025-03-14T06:33:06.0806521Z  2025-03-14T06:33:06.0806920Z  2025-03-14T06:33:06.0807295Z  2025-03-14T06:33:06.0807680Z  2025-03-14T06:33:06.0808607Z [17,054 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:06.0809993Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T06:33:06.0810851Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T06:33:06.0811759Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2025-03-14T06:33:06.0812628Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T06:33:06.0813365Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2025-03-14T06:33:06.0814270Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 15s local 2025-03-14T06:33:06.0815200Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T06:33:06.0816300Z Compiling xla/service/triangular_solve_expander.cc; 12s local ... 2025-03-14T06:33:06.3833249Z 2025-03-14T06:33:06.3834121Z  2025-03-14T06:33:06.3834717Z  2025-03-14T06:33:06.3835144Z  2025-03-14T06:33:06.3835513Z  2025-03-14T06:33:06.3835920Z  2025-03-14T06:33:06.3836314Z  2025-03-14T06:33:06.3836684Z  2025-03-14T06:33:06.3837090Z  2025-03-14T06:33:06.3838025Z [17,055 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:06.3839103Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T06:33:06.3840250Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T06:33:06.3841184Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 16s local 2025-03-14T06:33:06.3842020Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T06:33:06.3842798Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2025-03-14T06:33:06.3843742Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2025-03-14T06:33:06.3844901Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T06:33:06.3845831Z Compiling xla/service/triangular_solve_expander.cc; 13s local ... 2025-03-14T06:33:06.6232306Z 2025-03-14T06:33:06.6233216Z  2025-03-14T06:33:06.6235014Z  2025-03-14T06:33:06.6235452Z  2025-03-14T06:33:06.6235841Z  2025-03-14T06:33:06.6236256Z  2025-03-14T06:33:06.6236706Z  2025-03-14T06:33:06.6237083Z  2025-03-14T06:33:06.6237530Z  2025-03-14T06:33:06.6238510Z [17,056 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:06.6239603Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 27s local 2025-03-14T06:33:06.6240425Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T06:33:06.6241391Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2025-03-14T06:33:06.6242247Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T06:33:06.6243028Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2025-03-14T06:33:06.6244041Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2025-03-14T06:33:06.6245255Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T06:33:06.6246282Z Compiling xla/service/triangular_solve_expander.cc; 13s local ... 2025-03-14T06:33:06.8811649Z 2025-03-14T06:33:06.8812460Z  2025-03-14T06:33:06.8812885Z  2025-03-14T06:33:06.8813497Z  2025-03-14T06:33:06.8813876Z  2025-03-14T06:33:06.8814232Z  2025-03-14T06:33:06.8814562Z  2025-03-14T06:33:06.8814917Z  2025-03-14T06:33:06.8815463Z  2025-03-14T06:33:06.8816341Z [17,057 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:06.8817322Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T06:33:06.8818060Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T06:33:06.8818835Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2025-03-14T06:33:06.8819708Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T06:33:06.8820399Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 16s local 2025-03-14T06:33:06.8821414Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMTypes.cpp; 16s local 2025-03-14T06:33:06.8822227Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T06:33:06.8823089Z Compiling xla/service/triangular_solve_expander.cc; 13s local ... 2025-03-14T06:33:07.2502234Z 2025-03-14T06:33:07.2503037Z  2025-03-14T06:33:07.2503444Z  2025-03-14T06:33:07.2503821Z  2025-03-14T06:33:07.2504159Z  2025-03-14T06:33:07.2504494Z  2025-03-14T06:33:07.2504821Z  2025-03-14T06:33:07.2505148Z  2025-03-14T06:33:07.2505454Z  2025-03-14T06:33:07.2506332Z [17,059 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:07.2507382Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T06:33:07.2508016Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T06:33:07.2508687Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2025-03-14T06:33:07.2509333Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T06:33:07.2509922Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2025-03-14T06:33:07.2510636Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T06:33:07.2511349Z Compiling xla/service/triangular_solve_expander.cc; 14s local 2025-03-14T06:33:07.2512330Z Compiling mlir/lib/Conversion/LLVMCommon/VectorPattern.cpp; 11s local ... 2025-03-14T06:33:07.4816635Z 2025-03-14T06:33:07.4817535Z  2025-03-14T06:33:07.4818041Z  2025-03-14T06:33:07.4818441Z  2025-03-14T06:33:07.4818849Z  2025-03-14T06:33:07.4819227Z  2025-03-14T06:33:07.4819625Z  2025-03-14T06:33:07.4820020Z  2025-03-14T06:33:07.4820464Z  2025-03-14T06:33:07.4821429Z [17,062 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:07.4822530Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T06:33:07.4823405Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T06:33:07.4824316Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 17s local 2025-03-14T06:33:07.4825200Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T06:33:07.4825993Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2025-03-14T06:33:07.4826994Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T06:33:07.4828055Z Compiling mlir/lib/Conversion/LLVMCommon/VectorPattern.cpp; 11s local 2025-03-14T06:33:07.4828976Z Compiling xla/pjrt/utils.cc; 11s local ... 2025-03-14T06:33:07.7039701Z 2025-03-14T06:33:07.7040594Z  2025-03-14T06:33:07.7041099Z  2025-03-14T06:33:07.7041515Z  2025-03-14T06:33:07.7041955Z  2025-03-14T06:33:07.7042344Z  2025-03-14T06:33:07.7042736Z  2025-03-14T06:33:07.7043123Z  2025-03-14T06:33:07.7043523Z  2025-03-14T06:33:07.7044608Z [17,063 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:07.7045710Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 28s local 2025-03-14T06:33:07.7046802Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T06:33:07.7047692Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2025-03-14T06:33:07.7048547Z Compiling xla/pjrt/utils.cc; 18s local 2025-03-14T06:33:07.7049340Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2025-03-14T06:33:07.7050317Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T06:33:07.7051406Z Compiling mlir/lib/Conversion/LLVMCommon/VectorPattern.cpp; 11s local 2025-03-14T06:33:07.7052375Z Compiling xla/pjrt/utils.cc; 11s local ... 2025-03-14T06:33:07.9045904Z 2025-03-14T06:33:07.9046745Z  2025-03-14T06:33:07.9047229Z  2025-03-14T06:33:07.9047619Z  2025-03-14T06:33:07.9048041Z  2025-03-14T06:33:07.9048755Z  2025-03-14T06:33:07.9049148Z  2025-03-14T06:33:07.9049540Z  2025-03-14T06:33:07.9049950Z  2025-03-14T06:33:07.9050900Z [17,065 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:07.9052001Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T06:33:07.9052844Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T06:33:07.9053753Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2025-03-14T06:33:07.9054524Z Compiling xla/pjrt/utils.cc; 18s local 2025-03-14T06:33:07.9055286Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 17s local 2025-03-14T06:33:07.9056196Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T06:33:07.9057453Z Compiling mlir/lib/Conversion/LLVMCommon/VectorPattern.cpp; 12s local 2025-03-14T06:33:07.9058351Z Compiling xla/pjrt/utils.cc; 12s local ... 2025-03-14T06:33:08.1695052Z 2025-03-14T06:33:08.1695957Z  2025-03-14T06:33:08.1696445Z  2025-03-14T06:33:08.1696827Z  2025-03-14T06:33:08.1697312Z  2025-03-14T06:33:08.1697668Z  2025-03-14T06:33:08.1698023Z  2025-03-14T06:33:08.1698383Z  2025-03-14T06:33:08.1698770Z  2025-03-14T06:33:08.1699612Z [17,068 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:08.1700838Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T06:33:08.1701604Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T06:33:08.1702407Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefDialect.cpp; 18s local 2025-03-14T06:33:08.1703077Z Compiling xla/pjrt/utils.cc; 18s local 2025-03-14T06:33:08.1703739Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T06:33:08.1704696Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T06:33:08.1705660Z Compiling mlir/lib/Conversion/LLVMCommon/VectorPattern.cpp; 12s local 2025-03-14T06:33:08.1706494Z Compiling xla/pjrt/utils.cc; 12s local ... 2025-03-14T06:33:08.3718298Z 2025-03-14T06:33:08.3719177Z  2025-03-14T06:33:08.3719683Z  2025-03-14T06:33:08.3720086Z  2025-03-14T06:33:08.3720487Z  2025-03-14T06:33:08.3720877Z  2025-03-14T06:33:08.3721280Z  2025-03-14T06:33:08.3721675Z  2025-03-14T06:33:08.3722069Z  2025-03-14T06:33:08.3723034Z [17,070 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:08.3724147Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T06:33:08.3725145Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T06:33:08.3726010Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T06:33:08.3727032Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T06:33:08.3728143Z Compiling mlir/lib/Conversion/LLVMCommon/VectorPattern.cpp; 12s local 2025-03-14T06:33:08.3729065Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T06:33:08.3730000Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T06:33:08.3731457Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 11s local ... 2025-03-14T06:33:08.6826053Z 2025-03-14T06:33:08.6826916Z  2025-03-14T06:33:08.6827408Z  2025-03-14T06:33:08.6827834Z  2025-03-14T06:33:08.6828236Z  2025-03-14T06:33:08.6828641Z  2025-03-14T06:33:08.6829043Z  2025-03-14T06:33:08.6829453Z  2025-03-14T06:33:08.6829876Z  2025-03-14T06:33:08.6830869Z [17,072 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:08.6831998Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 29s local 2025-03-14T06:33:08.6832913Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T06:33:08.6833804Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 18s local 2025-03-14T06:33:08.6835153Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T06:33:08.6836035Z Compiling xla/pjrt/utils.cc; 12s local 2025-03-14T06:33:08.6836938Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T06:33:08.6838116Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T06:33:08.6839220Z @llvm-project//mlir:TransformDialectInterfaces; 10s local ... 2025-03-14T06:33:09.0013602Z 2025-03-14T06:33:09.0014482Z  2025-03-14T06:33:09.0015009Z  2025-03-14T06:33:09.0015446Z  2025-03-14T06:33:09.0015875Z  2025-03-14T06:33:09.0016261Z  2025-03-14T06:33:09.0016692Z  2025-03-14T06:33:09.0017114Z  2025-03-14T06:33:09.0017843Z  2025-03-14T06:33:09.0018848Z [17,074 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:09.0020029Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T06:33:09.0020974Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T06:33:09.0021935Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T06:33:09.0023000Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T06:33:09.0023892Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T06:33:09.0024930Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T06:33:09.0026016Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T06:33:09.0027087Z @llvm-project//mlir:TransformDialectInterfaces; 11s local ... 2025-03-14T06:33:09.2105367Z 2025-03-14T06:33:09.2106237Z  2025-03-14T06:33:09.2106725Z  2025-03-14T06:33:09.2107138Z  2025-03-14T06:33:09.2107596Z  2025-03-14T06:33:09.2108022Z  2025-03-14T06:33:09.2108460Z  2025-03-14T06:33:09.2108863Z  2025-03-14T06:33:09.2109302Z  2025-03-14T06:33:09.2110276Z [17,075 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:09.2111342Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T06:33:09.2112231Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T06:33:09.2113135Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T06:33:09.2114195Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T06:33:09.2114988Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T06:33:09.2115984Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T06:33:09.2117170Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T06:33:09.2118312Z @llvm-project//mlir:TransformDialectInterfaces; 11s local ... 2025-03-14T06:33:09.4832384Z 2025-03-14T06:33:09.4833280Z  2025-03-14T06:33:09.4833773Z  2025-03-14T06:33:09.4834185Z  2025-03-14T06:33:09.4834589Z  2025-03-14T06:33:09.4835024Z  2025-03-14T06:33:09.4835409Z  2025-03-14T06:33:09.4835772Z  2025-03-14T06:33:09.4836171Z  2025-03-14T06:33:09.4837441Z [17,075 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:09.4838559Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T06:33:09.4839414Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T06:33:09.4840288Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T06:33:09.4841278Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T06:33:09.4842080Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T06:33:09.4842917Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T06:33:09.4844024Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 12s local 2025-03-14T06:33:09.4845241Z @llvm-project//mlir:TransformDialectInterfaces; 11s local ... 2025-03-14T06:33:09.6982106Z 2025-03-14T06:33:09.6983081Z  2025-03-14T06:33:09.6983581Z  2025-03-14T06:33:09.6984055Z  2025-03-14T06:33:09.6984498Z  2025-03-14T06:33:09.6984925Z  2025-03-14T06:33:09.6985368Z  2025-03-14T06:33:09.6985826Z  2025-03-14T06:33:09.6986246Z  2025-03-14T06:33:09.6987209Z [17,078 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:09.6988358Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 30s local 2025-03-14T06:33:09.6989278Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T06:33:09.6990194Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 19s local 2025-03-14T06:33:09.6991242Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T06:33:09.6992402Z Compiling xla/pjrt/utils.cc; 13s local 2025-03-14T06:33:09.6993279Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T06:33:09.6994455Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 13s local 2025-03-14T06:33:09.6995546Z @llvm-project//mlir:TransformDialectInterfaces; 11s local ... 2025-03-14T06:33:10.0069138Z 2025-03-14T06:33:10.0070079Z  2025-03-14T06:33:10.0070609Z  2025-03-14T06:33:10.0071051Z  2025-03-14T06:33:10.0071500Z  2025-03-14T06:33:10.0071919Z  2025-03-14T06:33:10.0072352Z  2025-03-14T06:33:10.0073027Z  2025-03-14T06:33:10.0073467Z  2025-03-14T06:33:10.0074450Z [17,079 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:10.0075614Z Compiling llvm/lib/Analysis/ScalarEvolution.cpp; 31s local 2025-03-14T06:33:10.0076547Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:10.0077486Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T06:33:10.0078550Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T06:33:10.0079445Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T06:33:10.0080317Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T06:33:10.0081395Z Compiling xla/hlo/transforms/expanders/cholesky_expander.cc; 13s local 2025-03-14T06:33:10.0082517Z @llvm-project//mlir:TransformDialectInterfaces; 12s local ... 2025-03-14T06:33:10.2838565Z 2025-03-14T06:33:10.2839450Z  2025-03-14T06:33:10.2839987Z  2025-03-14T06:33:10.2840391Z  2025-03-14T06:33:10.2840795Z  2025-03-14T06:33:10.2841194Z  2025-03-14T06:33:10.2841578Z  2025-03-14T06:33:10.2841977Z  2025-03-14T06:33:10.2842489Z  2025-03-14T06:33:10.2843466Z [17,082 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:10.2844702Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:10.2845599Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T06:33:10.2846652Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T06:33:10.2847520Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T06:33:10.2848392Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T06:33:10.2849722Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2025-03-14T06:33:10.2850762Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 11s local 2025-03-14T06:33:10.2851946Z Compiling xla/hlo/builder/lib/logdet.cc; 9s local ... 2025-03-14T06:33:10.5063196Z 2025-03-14T06:33:10.5064058Z  2025-03-14T06:33:10.5064580Z  2025-03-14T06:33:10.5065106Z  2025-03-14T06:33:10.5071500Z  2025-03-14T06:33:10.5071935Z  2025-03-14T06:33:10.5072320Z  2025-03-14T06:33:10.5072734Z  2025-03-14T06:33:10.5073124Z  2025-03-14T06:33:10.5074078Z [17,083 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:10.5075115Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:10.5076399Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T06:33:10.5077514Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T06:33:10.5078400Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T06:33:10.5079301Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T06:33:10.5080393Z @llvm-project//mlir:TransformDialectInterfaces; 12s local 2025-03-14T06:33:10.5081437Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 11s local 2025-03-14T06:33:10.5082392Z Compiling xla/hlo/builder/lib/logdet.cc; 9s local ... 2025-03-14T06:33:10.7411921Z 2025-03-14T06:33:10.7412818Z  2025-03-14T06:33:10.7413330Z  2025-03-14T06:33:10.7414056Z  2025-03-14T06:33:10.7414535Z  2025-03-14T06:33:10.7415004Z  2025-03-14T06:33:10.7415480Z  2025-03-14T06:33:10.7415921Z  2025-03-14T06:33:10.7416446Z  2025-03-14T06:33:10.7417435Z [17,086 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:10.7418522Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:10.7419428Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 20s local 2025-03-14T06:33:10.7420448Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T06:33:10.7421547Z Compiling xla/pjrt/utils.cc; 14s local 2025-03-14T06:33:10.7422423Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T06:33:10.7423503Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 11s local 2025-03-14T06:33:10.7424417Z Compiling xla/hlo/builder/lib/logdet.cc; 9s local 2025-03-14T06:33:10.7425358Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 9s local ... 2025-03-14T06:33:10.9468004Z 2025-03-14T06:33:10.9469043Z  2025-03-14T06:33:10.9469546Z  2025-03-14T06:33:10.9469963Z  2025-03-14T06:33:10.9470430Z  2025-03-14T06:33:10.9470977Z  2025-03-14T06:33:10.9471367Z  2025-03-14T06:33:10.9471760Z  2025-03-14T06:33:10.9472142Z  2025-03-14T06:33:10.9473107Z [17,088 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:10.9474135Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:10.9475029Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T06:33:10.9475956Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2025-03-14T06:33:10.9476798Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:10.9477673Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T06:33:10.9478777Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2025-03-14T06:33:10.9479750Z Compiling xla/hlo/builder/lib/logdet.cc; 9s local 2025-03-14T06:33:10.9480694Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 9s local ... 2025-03-14T06:33:11.1470740Z 2025-03-14T06:33:11.1471597Z  2025-03-14T06:33:11.1472158Z  2025-03-14T06:33:11.1472638Z  2025-03-14T06:33:11.1473119Z  2025-03-14T06:33:11.1473601Z  2025-03-14T06:33:11.1474038Z  2025-03-14T06:33:11.1474743Z  2025-03-14T06:33:11.1475208Z  2025-03-14T06:33:11.1476375Z [17,091 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:11.1477447Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T06:33:11.1478383Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T06:33:11.1479442Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2025-03-14T06:33:11.1480330Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:11.1481259Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T06:33:11.1482378Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2025-03-14T06:33:11.1483521Z Compiling xla/hlo/builder/lib/logdet.cc; 10s local 2025-03-14T06:33:11.1484606Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 9s local ... 2025-03-14T06:33:11.4564201Z 2025-03-14T06:33:11.4565253Z  2025-03-14T06:33:11.4565957Z  2025-03-14T06:33:11.4566404Z  2025-03-14T06:33:11.4566804Z  2025-03-14T06:33:11.4567192Z  2025-03-14T06:33:11.4567577Z  2025-03-14T06:33:11.4567947Z  2025-03-14T06:33:11.4568359Z  2025-03-14T06:33:11.4569424Z [17,092 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:11.4570474Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T06:33:11.4571371Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T06:33:11.4572637Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2025-03-14T06:33:11.4573512Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:11.4574420Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T06:33:11.4575504Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2025-03-14T06:33:11.4576533Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 10s local 2025-03-14T06:33:11.4577572Z Compiling llvm/lib/ProfileData/InstrProf.cpp; 8s local ... 2025-03-14T06:33:11.6575017Z 2025-03-14T06:33:11.6575963Z  2025-03-14T06:33:11.6576717Z  2025-03-14T06:33:11.6577164Z  2025-03-14T06:33:11.6577605Z  2025-03-14T06:33:11.6578009Z  2025-03-14T06:33:11.6578410Z  2025-03-14T06:33:11.6578803Z  2025-03-14T06:33:11.6579219Z  2025-03-14T06:33:11.6580148Z [17,094 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:11.6581167Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T06:33:11.6582032Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T06:33:11.6582829Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:11.6583614Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T06:33:11.6584673Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 12s local 2025-03-14T06:33:11.6585716Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 10s local 2025-03-14T06:33:11.6586664Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2025-03-14T06:33:11.6587729Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 7s local ... 2025-03-14T06:33:11.8738864Z 2025-03-14T06:33:11.8739743Z  2025-03-14T06:33:11.8740175Z  2025-03-14T06:33:11.8740531Z  2025-03-14T06:33:11.8740918Z  2025-03-14T06:33:11.8741323Z  2025-03-14T06:33:11.8741697Z  2025-03-14T06:33:11.8742061Z  2025-03-14T06:33:11.8742403Z  2025-03-14T06:33:11.8743327Z [17,096 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:11.8744274Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T06:33:11.8745016Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 21s local 2025-03-14T06:33:11.8745782Z Compiling xla/pjrt/utils.cc; 15s local 2025-03-14T06:33:11.8746775Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T06:33:11.8747756Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T06:33:11.8748731Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 10s local 2025-03-14T06:33:11.8749486Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2025-03-14T06:33:11.8750465Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 7s local ... 2025-03-14T06:33:12.0852317Z 2025-03-14T06:33:12.0853202Z  2025-03-14T06:33:12.0853673Z  2025-03-14T06:33:12.0854065Z  2025-03-14T06:33:12.0854416Z  2025-03-14T06:33:12.0854797Z  2025-03-14T06:33:12.0855161Z  2025-03-14T06:33:12.0855505Z  2025-03-14T06:33:12.0856209Z  2025-03-14T06:33:12.0857057Z [17,096 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:12.0857850Z Compiling xla/service/topk_rewriter.cc; 23s local 2025-03-14T06:33:12.0858693Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2025-03-14T06:33:12.0859552Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T06:33:12.0860440Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T06:33:12.0861541Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T06:33:12.0862588Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 10s local 2025-03-14T06:33:12.0863599Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 8s local 2025-03-14T06:33:12.0864903Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 7s local ... 2025-03-14T06:33:12.4857616Z 2025-03-14T06:33:12.4858450Z  2025-03-14T06:33:12.4858910Z  2025-03-14T06:33:12.4859325Z  2025-03-14T06:33:12.4859703Z  2025-03-14T06:33:12.4860098Z  2025-03-14T06:33:12.4860482Z  2025-03-14T06:33:12.4860865Z  2025-03-14T06:33:12.4861245Z  2025-03-14T06:33:12.4862243Z [17,098 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:12.4863313Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2025-03-14T06:33:12.4864417Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T06:33:12.4865243Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T06:33:12.4866460Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local 2025-03-14T06:33:12.4867345Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2025-03-14T06:33:12.4868304Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 8s local 2025-03-14T06:33:12.4869189Z @llvm-project//llvm:AggressiveInstCombine; 7s local 2025-03-14T06:33:12.4870058Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 6s local ... 2025-03-14T06:33:12.6861088Z 2025-03-14T06:33:12.6861950Z  2025-03-14T06:33:12.6862403Z  2025-03-14T06:33:12.6862774Z  2025-03-14T06:33:12.6863150Z  2025-03-14T06:33:12.6863540Z  2025-03-14T06:33:12.6863930Z  2025-03-14T06:33:12.6864298Z  2025-03-14T06:33:12.6864662Z  2025-03-14T06:33:12.6865808Z [17,100 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:12.6866810Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 22s local 2025-03-14T06:33:12.6867568Z Compiling xla/pjrt/utils.cc; 16s local 2025-03-14T06:33:12.6868450Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 13s local 2025-03-14T06:33:12.6869358Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local 2025-03-14T06:33:12.6870214Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2025-03-14T06:33:12.6871115Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 8s local 2025-03-14T06:33:12.6871948Z @llvm-project//llvm:AggressiveInstCombine; 7s local 2025-03-14T06:33:12.6872806Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local ... 2025-03-14T06:33:13.0867158Z 2025-03-14T06:33:13.0868272Z  2025-03-14T06:33:13.0868933Z  2025-03-14T06:33:13.0869404Z  2025-03-14T06:33:13.0869828Z  2025-03-14T06:33:13.0870244Z  2025-03-14T06:33:13.0870648Z  2025-03-14T06:33:13.0871068Z  2025-03-14T06:33:13.0871483Z  2025-03-14T06:33:13.0872477Z [17,103 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:13.0873643Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T06:33:13.0874502Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T06:33:13.0875350Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 14s local 2025-03-14T06:33:13.0876396Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local 2025-03-14T06:33:13.0877626Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 9s local 2025-03-14T06:33:13.0878683Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 8s local 2025-03-14T06:33:13.0879673Z @llvm-project//llvm:AggressiveInstCombine; 8s local 2025-03-14T06:33:13.0880649Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local ... 2025-03-14T06:33:13.2870825Z 2025-03-14T06:33:13.2871635Z  2025-03-14T06:33:13.2872129Z  2025-03-14T06:33:13.2872509Z  2025-03-14T06:33:13.2872926Z  2025-03-14T06:33:13.2873334Z  2025-03-14T06:33:13.2873753Z  2025-03-14T06:33:13.2874180Z  2025-03-14T06:33:13.2874576Z  2025-03-14T06:33:13.2875636Z [17,105 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:13.2877058Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T06:33:13.2877957Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T06:33:13.2878819Z Compiling xla/hlo/transforms/expanders/qr_expander.cc; 14s local 2025-03-14T06:33:13.2879899Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 11s local 2025-03-14T06:33:13.2880891Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2025-03-14T06:33:13.2881962Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 9s local 2025-03-14T06:33:13.2883307Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 7s local 2025-03-14T06:33:13.2884258Z Compiling llvm/lib/Linker/IRMover.cpp; 6s local ... 2025-03-14T06:33:13.6838607Z 2025-03-14T06:33:13.6839583Z  2025-03-14T06:33:13.6840030Z  2025-03-14T06:33:13.6840434Z  2025-03-14T06:33:13.6840812Z  2025-03-14T06:33:13.6841202Z  2025-03-14T06:33:13.6841587Z  2025-03-14T06:33:13.6841969Z  2025-03-14T06:33:13.6842332Z  2025-03-14T06:33:13.6843200Z [17,107 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:13.6844188Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T06:33:13.6845039Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T06:33:13.6845753Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local 2025-03-14T06:33:13.6846633Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2025-03-14T06:33:13.6847573Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 9s local 2025-03-14T06:33:13.6848504Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2025-03-14T06:33:13.6849268Z Compiling llvm/lib/Linker/IRMover.cpp; 6s local 2025-03-14T06:33:13.6850078Z Compiling llvm/lib/Transforms/Utils/CloneFunction.cpp; 6s local ... 2025-03-14T06:33:13.8876057Z 2025-03-14T06:33:13.8876971Z  2025-03-14T06:33:13.8877454Z  2025-03-14T06:33:13.8877872Z  2025-03-14T06:33:13.8878292Z  2025-03-14T06:33:13.8878711Z  2025-03-14T06:33:13.8879136Z  2025-03-14T06:33:13.8879571Z  2025-03-14T06:33:13.8879993Z  2025-03-14T06:33:13.8881279Z [17,109 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:13.8882814Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 23s local 2025-03-14T06:33:13.8883810Z Compiling xla/pjrt/utils.cc; 17s local 2025-03-14T06:33:13.8884945Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local 2025-03-14T06:33:13.8886082Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2025-03-14T06:33:13.8887223Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 9s local 2025-03-14T06:33:13.8888373Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2025-03-14T06:33:13.8889351Z Compiling llvm/lib/Linker/IRMover.cpp; 6s local 2025-03-14T06:33:13.8890412Z Compiling llvm/lib/Transforms/Utils/CloneFunction.cpp; 6s local ... 2025-03-14T06:33:14.0879891Z 2025-03-14T06:33:14.0880737Z  2025-03-14T06:33:14.0881567Z  2025-03-14T06:33:14.0882015Z  2025-03-14T06:33:14.0882453Z  2025-03-14T06:33:14.0882884Z  2025-03-14T06:33:14.0883293Z  2025-03-14T06:33:14.0883715Z  2025-03-14T06:33:14.0884117Z  2025-03-14T06:33:14.0885289Z [17,110 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:14.0886463Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T06:33:14.0887285Z Compiling xla/pjrt/utils.cc; 18s local 2025-03-14T06:33:14.0888138Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local 2025-03-14T06:33:14.0889181Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 10s local 2025-03-14T06:33:14.0890244Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 9s local 2025-03-14T06:33:14.0891559Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2025-03-14T06:33:14.0892515Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local 2025-03-14T06:33:14.0893472Z Compiling llvm/lib/Transforms/Utils/CloneFunction.cpp; 6s local ... 2025-03-14T06:33:14.4884900Z 2025-03-14T06:33:14.4885900Z  2025-03-14T06:33:14.4886462Z  2025-03-14T06:33:14.4886929Z  2025-03-14T06:33:14.4887315Z  2025-03-14T06:33:14.4887809Z  2025-03-14T06:33:14.4888217Z  2025-03-14T06:33:14.4888610Z  2025-03-14T06:33:14.4889041Z  2025-03-14T06:33:14.4890395Z [17,111 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:14.4891539Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T06:33:14.4892379Z Compiling xla/pjrt/utils.cc; 18s local 2025-03-14T06:33:14.4893177Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2025-03-14T06:33:14.4894274Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2025-03-14T06:33:14.4895839Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 10s local 2025-03-14T06:33:14.4897337Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 8s local 2025-03-14T06:33:14.4898418Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local 2025-03-14T06:33:14.4899573Z Compiling llvm/lib/Transforms/Utils/CloneFunction.cpp; 7s local ... 2025-03-14T06:33:14.6935604Z 2025-03-14T06:33:14.6936498Z  2025-03-14T06:33:14.6937030Z  2025-03-14T06:33:14.6937438Z  2025-03-14T06:33:14.6937852Z  2025-03-14T06:33:14.6938280Z  2025-03-14T06:33:14.6938677Z  2025-03-14T06:33:14.6939061Z  2025-03-14T06:33:14.6939457Z  2025-03-14T06:33:14.6940424Z [17,113 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:14.6941520Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 24s local 2025-03-14T06:33:14.6942505Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2025-03-14T06:33:14.6943490Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2025-03-14T06:33:14.6944500Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 10s local 2025-03-14T06:33:14.6945608Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T06:33:14.6946446Z Compiling llvm/lib/Linker/IRMover.cpp; 7s local 2025-03-14T06:33:14.6947598Z Compiling llvm/lib/Transforms/Utils/CloneFunction.cpp; 7s local 2025-03-14T06:33:14.6948455Z Compiling mlir/lib/Transforms/CSE.cpp; 6s local ... 2025-03-14T06:33:15.0351684Z 2025-03-14T06:33:15.0352540Z  2025-03-14T06:33:15.0353030Z  2025-03-14T06:33:15.0353420Z  2025-03-14T06:33:15.0353829Z  2025-03-14T06:33:15.0354189Z  2025-03-14T06:33:15.0354577Z  2025-03-14T06:33:15.0354971Z  2025-03-14T06:33:15.0355474Z  2025-03-14T06:33:15.0356426Z [17,115 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:15.0357560Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T06:33:15.0358835Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2025-03-14T06:33:15.0359826Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 11s local 2025-03-14T06:33:15.0360857Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 10s local 2025-03-14T06:33:15.0361858Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T06:33:15.0362724Z Compiling llvm/lib/Linker/IRMover.cpp; 8s local 2025-03-14T06:33:15.0363600Z Compiling llvm/lib/Transforms/Utils/CloneFunction.cpp; 7s local 2025-03-14T06:33:15.0364679Z Compiling mlir/lib/Transforms/CSE.cpp; 7s local ... 2025-03-14T06:33:15.2892515Z 2025-03-14T06:33:15.2893352Z  2025-03-14T06:33:15.2893853Z  2025-03-14T06:33:15.2894274Z  2025-03-14T06:33:15.2906414Z  2025-03-14T06:33:15.2906875Z  2025-03-14T06:33:15.2907269Z  2025-03-14T06:33:15.2907644Z  2025-03-14T06:33:15.2908045Z  2025-03-14T06:33:15.2909010Z [17,117 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:15.2910155Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T06:33:15.2911131Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local 2025-03-14T06:33:15.2912119Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2025-03-14T06:33:15.2913451Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 11s local 2025-03-14T06:33:15.2914526Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T06:33:15.2915396Z Compiling llvm/lib/Linker/IRMover.cpp; 8s local 2025-03-14T06:33:15.2916298Z Compiling llvm/lib/Transforms/Utils/CloneFunction.cpp; 7s local 2025-03-14T06:33:15.2917157Z Compiling mlir/lib/Transforms/CSE.cpp; 7s local ... 2025-03-14T06:33:15.4910067Z 2025-03-14T06:33:15.4910895Z  2025-03-14T06:33:15.4911346Z  2025-03-14T06:33:15.4911744Z  2025-03-14T06:33:15.4912150Z  2025-03-14T06:33:15.4912596Z  2025-03-14T06:33:15.4913123Z  2025-03-14T06:33:15.4913525Z  2025-03-14T06:33:15.4913928Z  2025-03-14T06:33:15.4914870Z [17,120 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:15.4915986Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T06:33:15.4916982Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2025-03-14T06:33:15.4917966Z Compiling llvm/lib/ProfileData/InstrProfReader.cpp; 12s local 2025-03-14T06:33:15.4918992Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 11s local 2025-03-14T06:33:15.4920025Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 9s local 2025-03-14T06:33:15.4920928Z Compiling llvm/lib/Linker/IRMover.cpp; 8s local 2025-03-14T06:33:15.4921816Z Compiling llvm/lib/Transforms/Utils/CloneFunction.cpp; 8s local 2025-03-14T06:33:15.4922724Z Compiling xla/service/hlo_graph_dumper.cc; 7s local ... 2025-03-14T06:33:15.7900127Z 2025-03-14T06:33:15.7901000Z  2025-03-14T06:33:15.7901487Z  2025-03-14T06:33:15.7901876Z  2025-03-14T06:33:15.7902251Z  2025-03-14T06:33:15.7902676Z  2025-03-14T06:33:15.7903024Z  2025-03-14T06:33:15.7903638Z  2025-03-14T06:33:15.7904115Z  2025-03-14T06:33:15.7905092Z [17,124 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:15.7906151Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 25s local 2025-03-14T06:33:15.7907168Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2025-03-14T06:33:15.7908157Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 11s local 2025-03-14T06:33:15.7909252Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T06:33:15.7910196Z Compiling xla/service/hlo_graph_dumper.cc; 7s local 2025-03-14T06:33:15.7911062Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 7s local 2025-03-14T06:33:15.7912240Z Compiling xla/service/sharding_propagation.cc; 7s local 2025-03-14T06:33:15.7913307Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 7s local ... 2025-03-14T06:33:16.0900135Z 2025-03-14T06:33:16.0900990Z  2025-03-14T06:33:16.0901555Z  2025-03-14T06:33:16.0901986Z  2025-03-14T06:33:16.0902413Z  2025-03-14T06:33:16.0902836Z  2025-03-14T06:33:16.0903256Z  2025-03-14T06:33:16.0903669Z  2025-03-14T06:33:16.0904073Z  2025-03-14T06:33:16.0904993Z [17,124 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:16.0906197Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T06:33:16.0907093Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2025-03-14T06:33:16.0908377Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 11s local 2025-03-14T06:33:16.0909334Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T06:33:16.0910206Z Compiling xla/service/hlo_graph_dumper.cc; 8s local 2025-03-14T06:33:16.0911067Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 7s local 2025-03-14T06:33:16.0912026Z Compiling xla/service/sharding_propagation.cc; 7s local 2025-03-14T06:33:16.0913009Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 7s local ... 2025-03-14T06:33:16.2905537Z 2025-03-14T06:33:16.2906693Z  2025-03-14T06:33:16.2907174Z  2025-03-14T06:33:16.2907564Z  2025-03-14T06:33:16.2907969Z  2025-03-14T06:33:16.2908366Z  2025-03-14T06:33:16.2908749Z  2025-03-14T06:33:16.2909157Z  2025-03-14T06:33:16.2909551Z  2025-03-14T06:33:16.2910510Z [17,125 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:16.2911636Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T06:33:16.2912587Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2025-03-14T06:33:16.2913594Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T06:33:16.2914630Z Compiling llvm/lib/ProfileData/SampleProfReader.cpp; 10s local 2025-03-14T06:33:16.2915646Z Compiling xla/service/hlo_graph_dumper.cc; 8s local 2025-03-14T06:33:16.2916563Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 8s local 2025-03-14T06:33:16.2917543Z Compiling xla/service/sharding_propagation.cc; 7s local 2025-03-14T06:33:16.2918598Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 7s local ... 2025-03-14T06:33:16.5349561Z 2025-03-14T06:33:16.5350350Z  2025-03-14T06:33:16.5350770Z  2025-03-14T06:33:16.5351125Z  2025-03-14T06:33:16.5351486Z  2025-03-14T06:33:16.5351877Z  2025-03-14T06:33:16.5352230Z  2025-03-14T06:33:16.5352592Z  2025-03-14T06:33:16.5352921Z  2025-03-14T06:33:16.5353763Z [17,127 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:16.5354769Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T06:33:16.5355594Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2025-03-14T06:33:16.5356680Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T06:33:16.5357488Z Compiling xla/service/hlo_graph_dumper.cc; 8s local 2025-03-14T06:33:16.5358283Z Compiling llvm/lib/Transforms/ObjCARC/ObjCARCOpts.cpp; 8s local 2025-03-14T06:33:16.5359104Z Compiling xla/service/sharding_propagation.cc; 8s local 2025-03-14T06:33:16.5359953Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 7s local 2025-03-14T06:33:16.5360861Z Compiling xla/service/collective_ops_utils.cc; 7s local ... 2025-03-14T06:33:16.8911252Z 2025-03-14T06:33:16.8912039Z  2025-03-14T06:33:16.8912457Z  2025-03-14T06:33:16.8912804Z  2025-03-14T06:33:16.8913142Z  2025-03-14T06:33:16.8913478Z  2025-03-14T06:33:16.8914110Z  2025-03-14T06:33:16.8914447Z  2025-03-14T06:33:16.8914790Z  2025-03-14T06:33:16.8915582Z [17,128 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:16.8916585Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 26s local 2025-03-14T06:33:16.8917422Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2025-03-14T06:33:16.8918258Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T06:33:16.8919025Z Compiling xla/service/hlo_graph_dumper.cc; 8s local 2025-03-14T06:33:16.8919697Z Compiling xla/service/sharding_propagation.cc; 8s local 2025-03-14T06:33:16.8920510Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 8s local 2025-03-14T06:33:16.8921497Z Compiling xla/service/collective_ops_utils.cc; 8s local 2025-03-14T06:33:16.8922298Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 7s local ... 2025-03-14T06:33:17.0915353Z 2025-03-14T06:33:17.0916268Z  2025-03-14T06:33:17.0916750Z  2025-03-14T06:33:17.0917150Z  2025-03-14T06:33:17.0917567Z  2025-03-14T06:33:17.0917944Z  2025-03-14T06:33:17.0918288Z  2025-03-14T06:33:17.0918605Z  2025-03-14T06:33:17.0918943Z  2025-03-14T06:33:17.0920092Z [17,129 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:17.0921287Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T06:33:17.0922240Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2025-03-14T06:33:17.0923215Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 12s local 2025-03-14T06:33:17.0924127Z Compiling xla/service/hlo_graph_dumper.cc; 9s local 2025-03-14T06:33:17.0925128Z Compiling xla/service/sharding_propagation.cc; 8s local 2025-03-14T06:33:17.0925986Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 8s local 2025-03-14T06:33:17.0927030Z Compiling xla/service/collective_ops_utils.cc; 8s local 2025-03-14T06:33:17.0927927Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local ... 2025-03-14T06:33:17.4280272Z 2025-03-14T06:33:17.4281105Z  2025-03-14T06:33:17.4281657Z  2025-03-14T06:33:17.4282111Z  2025-03-14T06:33:17.4282554Z  2025-03-14T06:33:17.4282943Z  2025-03-14T06:33:17.4283396Z  2025-03-14T06:33:17.4283830Z  2025-03-14T06:33:17.4284256Z  2025-03-14T06:33:17.4285410Z [17,131 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:17.4286562Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T06:33:17.4287561Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2025-03-14T06:33:17.4288625Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T06:33:17.4289590Z Compiling xla/service/hlo_graph_dumper.cc; 9s local 2025-03-14T06:33:17.4290444Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T06:33:17.4291466Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 8s local 2025-03-14T06:33:17.4292782Z Compiling xla/service/collective_ops_utils.cc; 8s local 2025-03-14T06:33:17.4293804Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local ... 2025-03-14T06:33:17.6921083Z 2025-03-14T06:33:17.6921983Z  2025-03-14T06:33:17.6922505Z  2025-03-14T06:33:17.6922922Z  2025-03-14T06:33:17.6923313Z  2025-03-14T06:33:17.6923684Z  2025-03-14T06:33:17.6924081Z  2025-03-14T06:33:17.6924725Z  2025-03-14T06:33:17.6925149Z  2025-03-14T06:33:17.6926090Z [17,133 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:17.6927026Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 27s local 2025-03-14T06:33:17.6927946Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2025-03-14T06:33:17.6929288Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T06:33:17.6930116Z Compiling xla/service/hlo_graph_dumper.cc; 9s local 2025-03-14T06:33:17.6930910Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T06:33:17.6931870Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 9s local 2025-03-14T06:33:17.6932854Z Compiling xla/service/collective_ops_utils.cc; 8s local 2025-03-14T06:33:17.6933680Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 8s local ... 2025-03-14T06:33:18.0417588Z 2025-03-14T06:33:18.0418482Z  2025-03-14T06:33:18.0418964Z  2025-03-14T06:33:18.0419369Z  2025-03-14T06:33:18.0419779Z  2025-03-14T06:33:18.0420150Z  2025-03-14T06:33:18.0420800Z  2025-03-14T06:33:18.0421191Z  2025-03-14T06:33:18.0421583Z  2025-03-14T06:33:18.0422522Z [17,134 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:18.0423651Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T06:33:18.0424609Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2025-03-14T06:33:18.0425631Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 13s local 2025-03-14T06:33:18.0426515Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T06:33:18.0427541Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T06:33:18.0428544Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 9s local 2025-03-14T06:33:18.0429424Z Compiling xla/service/collective_ops_utils.cc; 9s local 2025-03-14T06:33:18.0430358Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local ... 2025-03-14T06:33:18.2927668Z 2025-03-14T06:33:18.2928471Z  2025-03-14T06:33:18.2928947Z  2025-03-14T06:33:18.2929301Z  2025-03-14T06:33:18.2929681Z  2025-03-14T06:33:18.2930069Z  2025-03-14T06:33:18.2930481Z  2025-03-14T06:33:18.2930858Z  2025-03-14T06:33:18.2931213Z  2025-03-14T06:33:18.2932143Z [17,134 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:18.2933254Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T06:33:18.2934230Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2025-03-14T06:33:18.2935233Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T06:33:18.2936205Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T06:33:18.2937024Z Compiling xla/service/sharding_propagation.cc; 9s local 2025-03-14T06:33:18.2937921Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 9s local 2025-03-14T06:33:18.2938924Z Compiling xla/service/collective_ops_utils.cc; 9s local 2025-03-14T06:33:18.2939862Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local ... 2025-03-14T06:33:18.5733282Z 2025-03-14T06:33:18.5734157Z  2025-03-14T06:33:18.5734655Z  2025-03-14T06:33:18.5735064Z  2025-03-14T06:33:18.5735491Z  2025-03-14T06:33:18.5735885Z  2025-03-14T06:33:18.5736265Z  2025-03-14T06:33:18.5736653Z  2025-03-14T06:33:18.5737311Z  2025-03-14T06:33:18.5738313Z [17,137 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:33:18.5739436Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T06:33:18.5740400Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T06:33:18.5741429Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T06:33:18.5742400Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T06:33:18.5743262Z Compiling xla/service/sharding_propagation.cc; 10s local 2025-03-14T06:33:18.5744204Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 10s local 2025-03-14T06:33:18.5745337Z Compiling xla/service/collective_ops_utils.cc; 9s local 2025-03-14T06:33:18.5746269Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local ... 2025-03-14T06:33:18.8464786Z 2025-03-14T06:33:18.8465847Z  2025-03-14T06:33:18.8466342Z  2025-03-14T06:33:18.8466758Z  2025-03-14T06:33:18.8467147Z  2025-03-14T06:33:18.8467533Z  2025-03-14T06:33:18.8467900Z  2025-03-14T06:33:18.8468275Z  2025-03-14T06:33:18.8468661Z  2025-03-14T06:33:18.8469610Z [17,138 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:18.8470638Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 28s local 2025-03-14T06:33:18.8471531Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T06:33:18.8472714Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T06:33:18.8473617Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T06:33:18.8474457Z Compiling xla/service/sharding_propagation.cc; 10s local 2025-03-14T06:33:18.8475396Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 10s local 2025-03-14T06:33:18.8476472Z Compiling xla/service/collective_ops_utils.cc; 10s local 2025-03-14T06:33:18.8477432Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 9s local ... 2025-03-14T06:33:19.0934034Z 2025-03-14T06:33:19.0934890Z  2025-03-14T06:33:19.0935643Z  2025-03-14T06:33:19.0936050Z  2025-03-14T06:33:19.0936482Z  2025-03-14T06:33:19.0936986Z  2025-03-14T06:33:19.0937394Z  2025-03-14T06:33:19.0937810Z  2025-03-14T06:33:19.0938204Z  2025-03-14T06:33:19.0939141Z [17,138 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:19.0940232Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T06:33:19.0941169Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T06:33:19.0942137Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 14s local 2025-03-14T06:33:19.0943074Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T06:33:19.0943875Z Compiling xla/service/sharding_propagation.cc; 10s local 2025-03-14T06:33:19.0944882Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 10s local 2025-03-14T06:33:19.0945907Z Compiling xla/service/collective_ops_utils.cc; 10s local 2025-03-14T06:33:19.0946784Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local ... 2025-03-14T06:33:19.3468404Z 2025-03-14T06:33:19.3469258Z  2025-03-14T06:33:19.3469767Z  2025-03-14T06:33:19.3470192Z  2025-03-14T06:33:19.3470623Z  2025-03-14T06:33:19.3471045Z  2025-03-14T06:33:19.3471459Z  2025-03-14T06:33:19.3471844Z  2025-03-14T06:33:19.3472242Z  2025-03-14T06:33:19.3473308Z [17,143 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:19.3474400Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T06:33:19.3477058Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T06:33:19.3478259Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T06:33:19.3479149Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T06:33:19.3479950Z Compiling xla/service/sharding_propagation.cc; 10s local 2025-03-14T06:33:19.3480930Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 10s local 2025-03-14T06:33:19.3481864Z Compiling xla/service/collective_ops_utils.cc; 10s local 2025-03-14T06:33:19.3482822Z Compiling llvm/lib/Transforms/Utils/CodeExtractor.cpp; 10s local ... 2025-03-14T06:33:19.6126801Z 2025-03-14T06:33:19.6127628Z  2025-03-14T06:33:19.6128142Z  2025-03-14T06:33:19.6128553Z  2025-03-14T06:33:19.6128970Z  2025-03-14T06:33:19.6129355Z  2025-03-14T06:33:19.6129753Z  2025-03-14T06:33:19.6130474Z  2025-03-14T06:33:19.6130892Z  2025-03-14T06:33:19.6131790Z [17,146 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:19.6132895Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T06:33:19.6133893Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2025-03-14T06:33:19.6134915Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T06:33:19.6135868Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T06:33:19.6136709Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T06:33:19.6137683Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 11s local 2025-03-14T06:33:19.6138911Z Compiling xla/service/collective_ops_utils.cc; 10s local 2025-03-14T06:33:19.6139662Z Compiling xla/hlo/utils/hlo_query.cc; 9s local ... 2025-03-14T06:33:19.8939340Z 2025-03-14T06:33:19.8940162Z  2025-03-14T06:33:19.8940678Z  2025-03-14T06:33:19.8941086Z  2025-03-14T06:33:19.8941496Z  2025-03-14T06:33:19.8941896Z  2025-03-14T06:33:19.8942294Z  2025-03-14T06:33:19.8942707Z  2025-03-14T06:33:19.8943095Z  2025-03-14T06:33:19.8944051Z [17,146 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:19.8945520Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 29s local 2025-03-14T06:33:19.8946483Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2025-03-14T06:33:19.8947511Z Compiling xla/hlo/transforms/expanders/eigh_expander.cc; 15s local 2025-03-14T06:33:19.8948457Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T06:33:19.8949250Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T06:33:19.8950194Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 11s local 2025-03-14T06:33:19.8951172Z Compiling xla/service/collective_ops_utils.cc; 11s local 2025-03-14T06:33:19.8952117Z Compiling xla/hlo/utils/hlo_query.cc; 9s local ... 2025-03-14T06:33:20.0943367Z 2025-03-14T06:33:20.0944278Z  2025-03-14T06:33:20.0944820Z  2025-03-14T06:33:20.0947043Z  2025-03-14T06:33:20.0948111Z  2025-03-14T06:33:20.0948848Z  2025-03-14T06:33:20.0949665Z  2025-03-14T06:33:20.0950136Z  2025-03-14T06:33:20.0950586Z  2025-03-14T06:33:20.0951524Z [17,148 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:20.0952603Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T06:33:20.0953560Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2025-03-14T06:33:20.0954489Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T06:33:20.0955496Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T06:33:20.0956591Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 11s local 2025-03-14T06:33:20.0957677Z Compiling xla/service/collective_ops_utils.cc; 11s local 2025-03-14T06:33:20.0958541Z Compiling xla/hlo/utils/hlo_query.cc; 10s local 2025-03-14T06:33:20.0959663Z Compiling xla/service/host_offload_utils.cc; 9s local ... 2025-03-14T06:33:20.3174885Z 2025-03-14T06:33:20.3175777Z  2025-03-14T06:33:20.3176274Z  2025-03-14T06:33:20.3176686Z  2025-03-14T06:33:20.3177125Z  2025-03-14T06:33:20.3177525Z  2025-03-14T06:33:20.3177899Z  2025-03-14T06:33:20.3178267Z  2025-03-14T06:33:20.3178656Z  2025-03-14T06:33:20.3179559Z [17,150 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:20.3180596Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T06:33:20.3181514Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2025-03-14T06:33:20.3182348Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T06:33:20.3183524Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T06:33:20.3184479Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 11s local 2025-03-14T06:33:20.3185453Z Compiling xla/service/collective_ops_utils.cc; 11s local 2025-03-14T06:33:20.3186196Z Compiling xla/hlo/utils/hlo_query.cc; 10s local 2025-03-14T06:33:20.3186980Z Compiling xla/service/host_offload_utils.cc; 10s local ... 2025-03-14T06:33:20.6949413Z 2025-03-14T06:33:20.6950235Z  2025-03-14T06:33:20.6950732Z  2025-03-14T06:33:20.6951138Z  2025-03-14T06:33:20.6951524Z  2025-03-14T06:33:20.6951890Z  2025-03-14T06:33:20.6952273Z  2025-03-14T06:33:20.6952648Z  2025-03-14T06:33:20.6953050Z  2025-03-14T06:33:20.6954386Z [17,152 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:20.6955490Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 30s local 2025-03-14T06:33:20.6956512Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T06:33:20.6957354Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T06:33:20.6958233Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T06:33:20.6959279Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local 2025-03-14T06:33:20.6960504Z Compiling xla/service/collective_ops_utils.cc; 11s local 2025-03-14T06:33:20.6961319Z Compiling xla/hlo/utils/hlo_query.cc; 10s local 2025-03-14T06:33:20.6962064Z Compiling xla/service/host_offload_utils.cc; 10s local ... 2025-03-14T06:33:20.9191339Z 2025-03-14T06:33:20.9192211Z  2025-03-14T06:33:20.9192691Z  2025-03-14T06:33:20.9193097Z  2025-03-14T06:33:20.9193784Z  2025-03-14T06:33:20.9194308Z  2025-03-14T06:33:20.9194839Z  2025-03-14T06:33:20.9195368Z  2025-03-14T06:33:20.9195886Z  2025-03-14T06:33:20.9196943Z [17,153 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:20.9198189Z Compiling mlir/lib/Dialect/MemRef/IR/MemRefOps.cpp; 31s local 2025-03-14T06:33:20.9199246Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T06:33:20.9200270Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T06:33:20.9201221Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T06:33:20.9202340Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local 2025-03-14T06:33:20.9203458Z Compiling xla/service/collective_ops_utils.cc; 12s local 2025-03-14T06:33:20.9204520Z Compiling xla/hlo/utils/hlo_query.cc; 10s local 2025-03-14T06:33:20.9205460Z Compiling xla/service/host_offload_utils.cc; 10s local ... 2025-03-14T06:33:21.1455492Z 2025-03-14T06:33:21.1456367Z  2025-03-14T06:33:21.1456863Z  2025-03-14T06:33:21.1457280Z  2025-03-14T06:33:21.1457937Z  2025-03-14T06:33:21.1458383Z  2025-03-14T06:33:21.1458908Z  2025-03-14T06:33:21.1459535Z  2025-03-14T06:33:21.1460046Z  2025-03-14T06:33:21.1461106Z [17,157 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:21.1462555Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T06:33:21.1463573Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T06:33:21.1464497Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T06:33:21.1465777Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local 2025-03-14T06:33:21.1466857Z Compiling xla/service/collective_ops_utils.cc; 12s local 2025-03-14T06:33:21.1467573Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2025-03-14T06:33:21.1468302Z Compiling xla/service/host_offload_utils.cc; 10s local 2025-03-14T06:33:21.1469127Z Compiling xla/service/hlo_domain_verifier.cc; 10s local ... 2025-03-14T06:33:21.4955821Z 2025-03-14T06:33:21.4957349Z  2025-03-14T06:33:21.4957870Z  2025-03-14T06:33:21.4958278Z  2025-03-14T06:33:21.4958693Z  2025-03-14T06:33:21.4959112Z  2025-03-14T06:33:21.4959527Z  2025-03-14T06:33:21.4959942Z  2025-03-14T06:33:21.4960371Z  2025-03-14T06:33:21.4961359Z [17,159 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:21.4962487Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T06:33:21.4963380Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T06:33:21.4964255Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T06:33:21.4965579Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 12s local 2025-03-14T06:33:21.4966912Z Compiling xla/service/collective_ops_utils.cc; 12s local 2025-03-14T06:33:21.4967701Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2025-03-14T06:33:21.4968495Z Compiling xla/service/host_offload_utils.cc; 11s local 2025-03-14T06:33:21.4969407Z Compiling xla/service/hlo_domain_verifier.cc; 10s local ... 2025-03-14T06:33:21.6959728Z 2025-03-14T06:33:21.6960925Z  2025-03-14T06:33:21.6961430Z  2025-03-14T06:33:21.6961837Z  2025-03-14T06:33:21.6962285Z  2025-03-14T06:33:21.6962754Z  2025-03-14T06:33:21.6963223Z  2025-03-14T06:33:21.6963621Z  2025-03-14T06:33:21.6964280Z  2025-03-14T06:33:21.6965794Z [17,161 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:21.6966887Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T06:33:21.6967758Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T06:33:21.6968656Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T06:33:21.6969718Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2025-03-14T06:33:21.6970922Z Compiling xla/service/collective_ops_utils.cc; 12s local 2025-03-14T06:33:21.6971704Z Compiling xla/hlo/utils/hlo_query.cc; 11s local 2025-03-14T06:33:21.6972439Z Compiling xla/service/host_offload_utils.cc; 11s local 2025-03-14T06:33:21.6973302Z Compiling xla/service/hlo_domain_verifier.cc; 10s local ... 2025-03-14T06:33:21.9728341Z 2025-03-14T06:33:21.9729680Z  2025-03-14T06:33:21.9730146Z  2025-03-14T06:33:21.9730545Z  2025-03-14T06:33:21.9730904Z  2025-03-14T06:33:21.9731261Z  2025-03-14T06:33:21.9731744Z  2025-03-14T06:33:21.9732116Z  2025-03-14T06:33:21.9732485Z  2025-03-14T06:33:21.9733375Z [17,163 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:21.9734430Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T06:33:21.9735296Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T06:33:21.9736112Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T06:33:21.9737083Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2025-03-14T06:33:21.9738047Z Compiling xla/service/collective_ops_utils.cc; 13s local 2025-03-14T06:33:21.9739109Z Compiling xla/service/host_offload_utils.cc; 11s local 2025-03-14T06:33:21.9739912Z Compiling xla/service/hlo_domain_verifier.cc; 11s local 2025-03-14T06:33:21.9740746Z Compiling xla/service/hlo_domain_remover.cc; 10s local ... 2025-03-14T06:33:22.2966347Z 2025-03-14T06:33:22.2967597Z  2025-03-14T06:33:22.2968002Z  2025-03-14T06:33:22.2968326Z  2025-03-14T06:33:22.2968657Z  2025-03-14T06:33:22.2968997Z  2025-03-14T06:33:22.2969321Z  2025-03-14T06:33:22.2969640Z  2025-03-14T06:33:22.2969963Z  2025-03-14T06:33:22.2970783Z [17,163 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:22.2971657Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T06:33:22.2972591Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T06:33:22.2973253Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T06:33:22.2974040Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local 2025-03-14T06:33:22.2974830Z Compiling xla/service/collective_ops_utils.cc; 13s local 2025-03-14T06:33:22.2975494Z Compiling xla/service/host_offload_utils.cc; 12s local 2025-03-14T06:33:22.2976161Z Compiling xla/service/hlo_domain_verifier.cc; 11s local 2025-03-14T06:33:22.2976856Z Compiling xla/service/hlo_domain_remover.cc; 10s local ... 2025-03-14T06:33:22.5573012Z 2025-03-14T06:33:22.5574297Z  2025-03-14T06:33:22.5575102Z  2025-03-14T06:33:22.5576187Z  2025-03-14T06:33:22.5576992Z  2025-03-14T06:33:22.5577409Z  2025-03-14T06:33:22.5577833Z  2025-03-14T06:33:22.5578209Z  2025-03-14T06:33:22.5578609Z  2025-03-14T06:33:22.5579577Z [17,164 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:22.5580700Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T06:33:22.5581609Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T06:33:22.5582394Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T06:33:22.5583647Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2025-03-14T06:33:22.5584682Z Compiling xla/service/collective_ops_utils.cc; 13s local 2025-03-14T06:33:22.5585543Z Compiling xla/service/host_offload_utils.cc; 12s local 2025-03-14T06:33:22.5586331Z Compiling xla/service/hlo_domain_remover.cc; 11s local 2025-03-14T06:33:22.5587179Z Compiling xla/hlo/analysis/hlo_ordering.cc; 10s local ... 2025-03-14T06:33:22.7602262Z 2025-03-14T06:33:22.7603567Z  2025-03-14T06:33:22.7604113Z  2025-03-14T06:33:22.7604716Z  2025-03-14T06:33:22.7605091Z  2025-03-14T06:33:22.7605511Z  2025-03-14T06:33:22.7605891Z  2025-03-14T06:33:22.7606262Z  2025-03-14T06:33:22.7606633Z  2025-03-14T06:33:22.7607560Z [17,165 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:22.7608757Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T06:33:22.7609683Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T06:33:22.7610570Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T06:33:22.7611547Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2025-03-14T06:33:22.7612508Z Compiling xla/service/collective_ops_utils.cc; 13s local 2025-03-14T06:33:22.7613396Z Compiling xla/service/hlo_domain_remover.cc; 11s local 2025-03-14T06:33:22.7614255Z Compiling xla/hlo/analysis/hlo_ordering.cc; 11s local 2025-03-14T06:33:22.7615081Z Compiling xla/service/topk_rewriter.cc; 10s local ... 2025-03-14T06:33:23.0244471Z 2025-03-14T06:33:23.0245727Z  2025-03-14T06:33:23.0246208Z  2025-03-14T06:33:23.0246601Z  2025-03-14T06:33:23.0247002Z  2025-03-14T06:33:23.0247407Z  2025-03-14T06:33:23.0247807Z  2025-03-14T06:33:23.0248194Z  2025-03-14T06:33:23.0248891Z  2025-03-14T06:33:23.0249908Z [17,166 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:23.0251144Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T06:33:23.0252047Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T06:33:23.0252867Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T06:33:23.0253855Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local 2025-03-14T06:33:23.0254820Z Compiling xla/service/collective_ops_utils.cc; 14s local 2025-03-14T06:33:23.0255606Z Compiling xla/hlo/analysis/hlo_ordering.cc; 11s local 2025-03-14T06:33:23.0256392Z Compiling xla/service/topk_rewriter.cc; 10s local 2025-03-14T06:33:23.0257584Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 10s local ... 2025-03-14T06:33:23.2949446Z 2025-03-14T06:33:23.2950372Z  2025-03-14T06:33:23.2951821Z  2025-03-14T06:33:23.2952716Z  2025-03-14T06:33:23.2953503Z  2025-03-14T06:33:23.2954838Z  2025-03-14T06:33:23.2955632Z  2025-03-14T06:33:23.2956449Z  2025-03-14T06:33:23.2957750Z  2025-03-14T06:33:23.2959085Z [17,170 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:23.2960534Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T06:33:23.2961724Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T06:33:23.2963154Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T06:33:23.2964467Z Compiling xla/service/collective_ops_utils.cc; 14s local 2025-03-14T06:33:23.2965835Z Compiling xla/hlo/analysis/hlo_ordering.cc; 11s local 2025-03-14T06:33:23.2966934Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T06:33:23.2968160Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 10s local 2025-03-14T06:33:23.2969615Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 10s local ... 2025-03-14T06:33:23.4975594Z 2025-03-14T06:33:23.4976820Z  2025-03-14T06:33:23.4977650Z  2025-03-14T06:33:23.4978002Z  2025-03-14T06:33:23.4978368Z  2025-03-14T06:33:23.4978714Z  2025-03-14T06:33:23.4979052Z  2025-03-14T06:33:23.4979389Z  2025-03-14T06:33:23.4979731Z  2025-03-14T06:33:23.4980547Z [17,172 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:23.4981495Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T06:33:23.4982251Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T06:33:23.4982959Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T06:33:23.4983722Z Compiling xla/service/collective_ops_utils.cc; 14s local 2025-03-14T06:33:23.4984443Z Compiling xla/hlo/analysis/hlo_ordering.cc; 11s local 2025-03-14T06:33:23.4985116Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T06:33:23.4985922Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 10s local 2025-03-14T06:33:23.4986877Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 10s local ... 2025-03-14T06:33:23.7474688Z 2025-03-14T06:33:23.7475572Z  2025-03-14T06:33:23.7476032Z  2025-03-14T06:33:23.7476417Z  2025-03-14T06:33:23.7476823Z  2025-03-14T06:33:23.7477219Z  2025-03-14T06:33:23.7477639Z  2025-03-14T06:33:23.7478047Z  2025-03-14T06:33:23.7478501Z  2025-03-14T06:33:23.7479425Z [17,173 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:23.7480547Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T06:33:23.7481488Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T06:33:23.7482320Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T06:33:23.7483453Z Compiling xla/service/collective_ops_utils.cc; 14s local 2025-03-14T06:33:23.7484248Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T06:33:23.7485136Z Compiling xla/service/topk_rewriter.cc; 11s local 2025-03-14T06:33:23.7486028Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local 2025-03-14T06:33:23.7487123Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 11s local ... 2025-03-14T06:33:24.0984312Z 2025-03-14T06:33:24.0985172Z  2025-03-14T06:33:24.0985693Z  2025-03-14T06:33:24.0986157Z  2025-03-14T06:33:24.0986557Z  2025-03-14T06:33:24.0986937Z  2025-03-14T06:33:24.0987349Z  2025-03-14T06:33:24.0987767Z  2025-03-14T06:33:24.0988187Z  2025-03-14T06:33:24.0989430Z [17,175 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:24.0990586Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T06:33:24.0991531Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T06:33:24.0992622Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T06:33:24.0993525Z Compiling xla/service/collective_ops_utils.cc; 15s local 2025-03-14T06:33:24.0994390Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T06:33:24.0995200Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T06:33:24.0996164Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local 2025-03-14T06:33:24.0997629Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 11s local ... 2025-03-14T06:33:24.3398746Z 2025-03-14T06:33:24.3399599Z  2025-03-14T06:33:24.3400101Z  2025-03-14T06:33:24.3400522Z  2025-03-14T06:33:24.3400973Z  2025-03-14T06:33:24.3401383Z  2025-03-14T06:33:24.3401795Z  2025-03-14T06:33:24.3402198Z  2025-03-14T06:33:24.3402613Z  2025-03-14T06:33:24.3403587Z [17,178 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:24.3404900Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T06:33:24.3406109Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T06:33:24.3406979Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T06:33:24.3407880Z Compiling xla/service/collective_ops_utils.cc; 15s local 2025-03-14T06:33:24.3408762Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T06:33:24.3409577Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T06:33:24.3410592Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 11s local 2025-03-14T06:33:24.3411856Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 11s local ... 2025-03-14T06:33:24.6067386Z 2025-03-14T06:33:24.6068213Z  2025-03-14T06:33:24.6068707Z  2025-03-14T06:33:24.6069101Z  2025-03-14T06:33:24.6069477Z  2025-03-14T06:33:24.6069864Z  2025-03-14T06:33:24.6070284Z  2025-03-14T06:33:24.6070705Z  2025-03-14T06:33:24.6071103Z  2025-03-14T06:33:24.6072090Z [17,179 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:24.6073270Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T06:33:24.6074221Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T06:33:24.6075043Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T06:33:24.6075887Z Compiling xla/service/collective_ops_utils.cc; 15s local 2025-03-14T06:33:24.6076758Z Compiling xla/hlo/analysis/hlo_ordering.cc; 12s local 2025-03-14T06:33:24.6077577Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T06:33:24.6078549Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2025-03-14T06:33:24.6079758Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 11s local ... 2025-03-14T06:33:24.8991331Z 2025-03-14T06:33:24.8992484Z  2025-03-14T06:33:24.8992983Z  2025-03-14T06:33:24.8993391Z  2025-03-14T06:33:24.8993802Z  2025-03-14T06:33:24.8994146Z  2025-03-14T06:33:24.8994543Z  2025-03-14T06:33:24.8994947Z  2025-03-14T06:33:24.8995352Z  2025-03-14T06:33:24.8996350Z [17,179 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:24.8997521Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T06:33:24.8998463Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T06:33:24.8999363Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T06:33:24.9000252Z Compiling xla/service/collective_ops_utils.cc; 16s local 2025-03-14T06:33:24.9001382Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2025-03-14T06:33:24.9002196Z Compiling xla/service/topk_rewriter.cc; 12s local 2025-03-14T06:33:24.9003234Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2025-03-14T06:33:24.9004597Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local ... 2025-03-14T06:33:25.0994676Z 2025-03-14T06:33:25.0995564Z  2025-03-14T06:33:25.0996158Z  2025-03-14T06:33:25.0996576Z  2025-03-14T06:33:25.0997002Z  2025-03-14T06:33:25.0997417Z  2025-03-14T06:33:25.0997805Z  2025-03-14T06:33:25.0998200Z  2025-03-14T06:33:25.0998623Z  2025-03-14T06:33:25.0999639Z [17,182 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:25.1001152Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T06:33:25.1002066Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T06:33:25.1002971Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T06:33:25.1003780Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2025-03-14T06:33:25.1004778Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T06:33:25.1005784Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2025-03-14T06:33:25.1007186Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local 2025-03-14T06:33:25.1008270Z Compiling xla/service/hlo_domain_verifier.cc; 11s local ... 2025-03-14T06:33:25.5000004Z 2025-03-14T06:33:25.5000872Z  2025-03-14T06:33:25.5001378Z  2025-03-14T06:33:25.5001816Z  2025-03-14T06:33:25.5002214Z  2025-03-14T06:33:25.5002619Z  2025-03-14T06:33:25.5003040Z  2025-03-14T06:33:25.5003415Z  2025-03-14T06:33:25.5003827Z  2025-03-14T06:33:25.5004945Z [17,183 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:25.5006109Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T06:33:25.5007008Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T06:33:25.5007845Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T06:33:25.5008724Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local 2025-03-14T06:33:25.5009543Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T06:33:25.5010541Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 12s local 2025-03-14T06:33:25.5011715Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 12s local 2025-03-14T06:33:25.5012828Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 9s local ... 2025-03-14T06:33:25.7004522Z 2025-03-14T06:33:25.7005406Z  2025-03-14T06:33:25.7005896Z  2025-03-14T06:33:25.7006317Z  2025-03-14T06:33:25.7006712Z  2025-03-14T06:33:25.7007129Z  2025-03-14T06:33:25.7007547Z  2025-03-14T06:33:25.7007980Z  2025-03-14T06:33:25.7008393Z  2025-03-14T06:33:25.7009336Z [17,185 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:25.7010700Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T06:33:25.7011628Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T06:33:25.7012550Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T06:33:25.7013423Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local 2025-03-14T06:33:25.7014213Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T06:33:25.7015209Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2025-03-14T06:33:25.7016378Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2025-03-14T06:33:25.7017460Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 9s local ... 2025-03-14T06:33:26.0355755Z 2025-03-14T06:33:26.0356620Z  2025-03-14T06:33:26.0357381Z  2025-03-14T06:33:26.0357766Z  2025-03-14T06:33:26.0358162Z  2025-03-14T06:33:26.0358535Z  2025-03-14T06:33:26.0358924Z  2025-03-14T06:33:26.0359293Z  2025-03-14T06:33:26.0359674Z  2025-03-14T06:33:26.0360574Z [17,186 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:26.0361622Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T06:33:26.0362427Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T06:33:26.0363230Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T06:33:26.0363978Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local 2025-03-14T06:33:26.0364867Z Compiling xla/service/topk_rewriter.cc; 13s local 2025-03-14T06:33:26.0366210Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2025-03-14T06:33:26.0367242Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2025-03-14T06:33:26.0368305Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local ... 2025-03-14T06:33:26.2520002Z 2025-03-14T06:33:26.2520856Z  2025-03-14T06:33:26.2521349Z  2025-03-14T06:33:26.2521771Z  2025-03-14T06:33:26.2522237Z  2025-03-14T06:33:26.2522633Z  2025-03-14T06:33:26.2523027Z  2025-03-14T06:33:26.2523409Z  2025-03-14T06:33:26.2523815Z  2025-03-14T06:33:26.2526602Z [17,188 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:26.2527936Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T06:33:26.2528796Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T06:33:26.2529631Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T06:33:26.2530489Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T06:33:26.2531438Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2025-03-14T06:33:26.2532559Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2025-03-14T06:33:26.2533469Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2025-03-14T06:33:26.2534357Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 9s local ... 2025-03-14T06:33:26.5009513Z 2025-03-14T06:33:26.5010350Z  2025-03-14T06:33:26.5010859Z  2025-03-14T06:33:26.5011272Z  2025-03-14T06:33:26.5011714Z  2025-03-14T06:33:26.5012134Z  2025-03-14T06:33:26.5012538Z  2025-03-14T06:33:26.5012916Z  2025-03-14T06:33:26.5013292Z  2025-03-14T06:33:26.5014241Z [17,189 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:26.5015448Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T06:33:26.5016418Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T06:33:26.5017259Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T06:33:26.5018084Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T06:33:26.5019045Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 13s local 2025-03-14T06:33:26.5020506Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 13s local 2025-03-14T06:33:26.5021503Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 10s local 2025-03-14T06:33:26.5022527Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local ... 2025-03-14T06:33:27.0745721Z 2025-03-14T06:33:27.0746531Z  2025-03-14T06:33:27.0747000Z  2025-03-14T06:33:27.0747392Z  2025-03-14T06:33:27.0747784Z  2025-03-14T06:33:27.0748170Z  2025-03-14T06:33:27.0748549Z  2025-03-14T06:33:27.0761298Z  2025-03-14T06:33:27.0762116Z  2025-03-14T06:33:27.0763040Z [17,190 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:27.0764093Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T06:33:27.0765669Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T06:33:27.0766441Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T06:33:27.0767193Z Compiling xla/service/topk_rewriter.cc; 14s local 2025-03-14T06:33:27.0768092Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2025-03-14T06:33:27.0769158Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 14s local 2025-03-14T06:33:27.0770155Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2025-03-14T06:33:27.0771108Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local ... 2025-03-14T06:33:27.3020354Z 2025-03-14T06:33:27.3021210Z  2025-03-14T06:33:27.3021709Z  2025-03-14T06:33:27.3022361Z  2025-03-14T06:33:27.3022737Z  2025-03-14T06:33:27.3023129Z  2025-03-14T06:33:27.3023500Z  2025-03-14T06:33:27.3023889Z  2025-03-14T06:33:27.3024264Z  2025-03-14T06:33:27.3025212Z [17,191 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:27.3026252Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T06:33:27.3027125Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T06:33:27.3027938Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T06:33:27.3028942Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T06:33:27.3029881Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2025-03-14T06:33:27.3030973Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 14s local 2025-03-14T06:33:27.3031982Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2025-03-14T06:33:27.3032930Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local ... 2025-03-14T06:33:27.5024002Z 2025-03-14T06:33:27.5024858Z  2025-03-14T06:33:27.5025312Z  2025-03-14T06:33:27.5025706Z  2025-03-14T06:33:27.5026099Z  2025-03-14T06:33:27.5026481Z  2025-03-14T06:33:27.5026868Z  2025-03-14T06:33:27.5027237Z  2025-03-14T06:33:27.5027633Z  2025-03-14T06:33:27.5028590Z [17,192 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:27.5029668Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T06:33:27.5030560Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T06:33:27.5031326Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T06:33:27.5032111Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T06:33:27.5033022Z Compiling mlir/lib/Transforms/Utils/DialectConversion.cpp; 14s local 2025-03-14T06:33:27.5034086Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 14s local 2025-03-14T06:33:27.5035091Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 11s local 2025-03-14T06:33:27.5036047Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local ... 2025-03-14T06:33:27.9140996Z 2025-03-14T06:33:27.9141809Z  2025-03-14T06:33:27.9142232Z  2025-03-14T06:33:27.9142564Z  2025-03-14T06:33:27.9142936Z  2025-03-14T06:33:27.9143299Z  2025-03-14T06:33:27.9143898Z  2025-03-14T06:33:27.9144330Z  2025-03-14T06:33:27.9144866Z  2025-03-14T06:33:27.9145983Z [17,193 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:27.9147320Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T06:33:27.9148397Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2025-03-14T06:33:27.9149404Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T06:33:27.9150203Z Compiling xla/service/topk_rewriter.cc; 15s local 2025-03-14T06:33:27.9150961Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMMemorySlot.cpp; 15s local 2025-03-14T06:33:27.9151930Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2025-03-14T06:33:27.9153016Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2025-03-14T06:33:27.9153871Z Compiling xla/service/hlo_graph_dumper.cc; 8s local ... 2025-03-14T06:33:28.3031277Z 2025-03-14T06:33:28.3032240Z  2025-03-14T06:33:28.3032784Z  2025-03-14T06:33:28.3033237Z  2025-03-14T06:33:28.3033672Z  2025-03-14T06:33:28.3034098Z  2025-03-14T06:33:28.3034561Z  2025-03-14T06:33:28.3034963Z  2025-03-14T06:33:28.3035378Z  2025-03-14T06:33:28.3036336Z [17,197 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:28.3037479Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T06:33:28.3038758Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2025-03-14T06:33:28.3039595Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T06:33:28.3040417Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T06:33:28.3041317Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2025-03-14T06:33:28.3042266Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2025-03-14T06:33:28.3043152Z Compiling xla/service/hlo_graph_dumper.cc; 9s local 2025-03-14T06:33:28.3044120Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 8s local ... 2025-03-14T06:33:28.5035089Z 2025-03-14T06:33:28.5036212Z  2025-03-14T06:33:28.5036737Z  2025-03-14T06:33:28.5037157Z  2025-03-14T06:33:28.5037579Z  2025-03-14T06:33:28.5037983Z  2025-03-14T06:33:28.5038334Z  2025-03-14T06:33:28.5038693Z  2025-03-14T06:33:28.5039058Z  2025-03-14T06:33:28.5040137Z [17,198 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:28.5041245Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T06:33:28.5042118Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T06:33:28.5042868Z Compiling xla/service/topk_rewriter.cc; 16s local 2025-03-14T06:33:28.5043704Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 12s local 2025-03-14T06:33:28.5044820Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T06:33:28.5045656Z Compiling xla/service/hlo_graph_dumper.cc; 9s local 2025-03-14T06:33:28.5046555Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2025-03-14T06:33:28.5047478Z Compiling xla/service/instruction_fusion.cc; 8s local ... 2025-03-14T06:33:29.3319209Z 2025-03-14T06:33:29.3320044Z  2025-03-14T06:33:29.3320526Z  2025-03-14T06:33:29.3320938Z  2025-03-14T06:33:29.3321339Z  2025-03-14T06:33:29.3321731Z  2025-03-14T06:33:29.3322147Z  2025-03-14T06:33:29.3322545Z  2025-03-14T06:33:29.3322958Z  2025-03-14T06:33:29.3323868Z [17,199 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:29.3325110Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T06:33:29.3326012Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T06:33:29.3326807Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T06:33:29.3327949Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2025-03-14T06:33:29.3328871Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T06:33:29.3329658Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T06:33:29.3330546Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 9s local 2025-03-14T06:33:29.3331508Z Compiling xla/service/instruction_fusion.cc; 9s local ... 2025-03-14T06:33:29.6518925Z 2025-03-14T06:33:29.6519829Z  2025-03-14T06:33:29.6520360Z  2025-03-14T06:33:29.6520760Z  2025-03-14T06:33:29.6521157Z  2025-03-14T06:33:29.6521546Z  2025-03-14T06:33:29.6521946Z  2025-03-14T06:33:29.6522346Z  2025-03-14T06:33:29.6523067Z  2025-03-14T06:33:29.6523980Z [17,200 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:29.6525204Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T06:33:29.6526124Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T06:33:29.6526984Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T06:33:29.6527868Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 13s local 2025-03-14T06:33:29.6528762Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T06:33:29.6529585Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T06:33:29.6530458Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2025-03-14T06:33:29.6531685Z Compiling xla/service/instruction_fusion.cc; 9s local ... 2025-03-14T06:33:29.9047431Z 2025-03-14T06:33:29.9048289Z  2025-03-14T06:33:29.9048790Z  2025-03-14T06:33:29.9049250Z  2025-03-14T06:33:29.9049640Z  2025-03-14T06:33:29.9049999Z  2025-03-14T06:33:29.9050397Z  2025-03-14T06:33:29.9050787Z  2025-03-14T06:33:29.9051165Z  2025-03-14T06:33:29.9052123Z [17,200 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:29.9053493Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T06:33:29.9054431Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T06:33:29.9055218Z Compiling xla/service/topk_rewriter.cc; 17s local 2025-03-14T06:33:29.9056086Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T06:33:29.9057031Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T06:33:29.9057870Z Compiling xla/service/hlo_graph_dumper.cc; 10s local 2025-03-14T06:33:29.9058738Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2025-03-14T06:33:29.9059649Z Compiling xla/service/instruction_fusion.cc; 9s local ... 2025-03-14T06:33:30.2264157Z 2025-03-14T06:33:30.2265026Z  2025-03-14T06:33:30.2265737Z  2025-03-14T06:33:30.2266067Z  2025-03-14T06:33:30.2266425Z  2025-03-14T06:33:30.2266800Z  2025-03-14T06:33:30.2267207Z  2025-03-14T06:33:30.2267595Z  2025-03-14T06:33:30.2267979Z  2025-03-14T06:33:30.2268898Z [17,202 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:30.2269908Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T06:33:30.2270791Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T06:33:30.2271594Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T06:33:30.2272440Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T06:33:30.2273327Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T06:33:30.2274137Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T06:33:30.2275051Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 10s local 2025-03-14T06:33:30.2276083Z Compiling xla/service/instruction_fusion.cc; 10s local ... 2025-03-14T06:33:30.4499163Z 2025-03-14T06:33:30.4500239Z  2025-03-14T06:33:30.4500708Z  2025-03-14T06:33:30.4501105Z  2025-03-14T06:33:30.4501500Z  2025-03-14T06:33:30.4501881Z  2025-03-14T06:33:30.4502239Z  2025-03-14T06:33:30.4502619Z  2025-03-14T06:33:30.4503027Z  2025-03-14T06:33:30.4503896Z [17,204 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:30.4504936Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T06:33:30.4505908Z Compiling xla/service/sharding_propagation.cc; 22s local 2025-03-14T06:33:30.4506634Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T06:33:30.4507427Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T06:33:30.4508388Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T06:33:30.4509115Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T06:33:30.4509888Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2025-03-14T06:33:30.4510742Z Compiling xla/service/instruction_fusion.cc; 10s local ... 2025-03-14T06:33:30.7053730Z 2025-03-14T06:33:30.7054513Z  2025-03-14T06:33:30.7054892Z  2025-03-14T06:33:30.7055210Z  2025-03-14T06:33:30.7055524Z  2025-03-14T06:33:30.7055834Z  2025-03-14T06:33:30.7056143Z  2025-03-14T06:33:30.7056455Z  2025-03-14T06:33:30.7056748Z  2025-03-14T06:33:30.7057494Z [17,204 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:30.7058596Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T06:33:30.7059289Z Compiling xla/service/sharding_propagation.cc; 22s local 2025-03-14T06:33:30.7059919Z Compiling xla/service/topk_rewriter.cc; 18s local 2025-03-14T06:33:30.7060569Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 14s local 2025-03-14T06:33:30.7061286Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T06:33:30.7061929Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T06:33:30.7062766Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2025-03-14T06:33:30.7063521Z Compiling xla/service/instruction_fusion.cc; 10s local ... 2025-03-14T06:33:31.1298276Z 2025-03-14T06:33:31.1299195Z  2025-03-14T06:33:31.1299697Z  2025-03-14T06:33:31.1300136Z  2025-03-14T06:33:31.1300592Z  2025-03-14T06:33:31.1301053Z  2025-03-14T06:33:31.1301490Z  2025-03-14T06:33:31.1301930Z  2025-03-14T06:33:31.1302326Z  2025-03-14T06:33:31.1303336Z [17,205 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:31.1304612Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T06:33:31.1305649Z Compiling xla/service/sharding_propagation.cc; 22s local 2025-03-14T06:33:31.1306559Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T06:33:31.1307557Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T06:33:31.1308641Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T06:33:31.1309501Z Compiling xla/service/hlo_graph_dumper.cc; 11s local 2025-03-14T06:33:31.1310394Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2025-03-14T06:33:31.1311356Z Compiling xla/service/instruction_fusion.cc; 11s local ... 2025-03-14T06:33:31.5061156Z 2025-03-14T06:33:31.5062150Z  2025-03-14T06:33:31.5062641Z  2025-03-14T06:33:31.5063077Z  2025-03-14T06:33:31.5063520Z  2025-03-14T06:33:31.5063917Z  2025-03-14T06:33:31.5064310Z  2025-03-14T06:33:31.5064717Z  2025-03-14T06:33:31.5065138Z  2025-03-14T06:33:31.5071296Z [17,205 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:31.5072726Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T06:33:31.5073652Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T06:33:31.5074508Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T06:33:31.5075311Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T06:33:31.5076370Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2025-03-14T06:33:31.5077178Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T06:33:31.5078074Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T06:33:31.5078978Z Compiling xla/service/instruction_fusion.cc; 11s local ... 2025-03-14T06:33:31.7064799Z 2025-03-14T06:33:31.7065890Z  2025-03-14T06:33:31.7066722Z  2025-03-14T06:33:31.7067105Z  2025-03-14T06:33:31.7067457Z  2025-03-14T06:33:31.7067828Z  2025-03-14T06:33:31.7068222Z  2025-03-14T06:33:31.7068610Z  2025-03-14T06:33:31.7068950Z  2025-03-14T06:33:31.7069945Z [17,207 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:31.7070946Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T06:33:31.7071791Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T06:33:31.7072658Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T06:33:31.7073468Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 15s local 2025-03-14T06:33:31.7074348Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2025-03-14T06:33:31.7075400Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T06:33:31.7076288Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T06:33:31.7077183Z Compiling xla/service/instruction_fusion.cc; 11s local ... 2025-03-14T06:33:31.9263315Z 2025-03-14T06:33:31.9264200Z  2025-03-14T06:33:31.9264696Z  2025-03-14T06:33:31.9265088Z  2025-03-14T06:33:31.9265734Z  2025-03-14T06:33:31.9266087Z  2025-03-14T06:33:31.9266450Z  2025-03-14T06:33:31.9266855Z  2025-03-14T06:33:31.9267212Z  2025-03-14T06:33:31.9268374Z [17,209 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:31.9269449Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T06:33:31.9270328Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T06:33:31.9271121Z Compiling xla/service/topk_rewriter.cc; 19s local 2025-03-14T06:33:31.9271955Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T06:33:31.9272655Z Compiling xla/service/hlo_graph_dumper.cc; 12s local 2025-03-14T06:33:31.9273492Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T06:33:31.9274528Z Compiling xla/service/instruction_fusion.cc; 11s local 2025-03-14T06:33:31.9275382Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 11s local ... 2025-03-14T06:33:32.3067582Z 2025-03-14T06:33:32.3068569Z  2025-03-14T06:33:32.3069077Z  2025-03-14T06:33:32.3069522Z  2025-03-14T06:33:32.3069959Z  2025-03-14T06:33:32.3070359Z  2025-03-14T06:33:32.3070777Z  2025-03-14T06:33:32.3071180Z  2025-03-14T06:33:32.3071585Z  2025-03-14T06:33:32.3072584Z [17,210 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:32.3073762Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T06:33:32.3074665Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T06:33:32.3075530Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T06:33:32.3076359Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T06:33:32.3077491Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T06:33:32.3078689Z Compiling xla/service/instruction_fusion.cc; 12s local 2025-03-14T06:33:32.3080004Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2025-03-14T06:33:32.3080866Z Compiling xla/service/layout_assignment.cc; 11s local ... 2025-03-14T06:33:32.5798127Z 2025-03-14T06:33:32.5799021Z  2025-03-14T06:33:32.5799513Z  2025-03-14T06:33:32.5799945Z  2025-03-14T06:33:32.5800347Z  2025-03-14T06:33:32.5800763Z  2025-03-14T06:33:32.5801157Z  2025-03-14T06:33:32.5801551Z  2025-03-14T06:33:32.5801955Z  2025-03-14T06:33:32.5802955Z [17,212 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:32.5804108Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T06:33:32.5805412Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T06:33:32.5806294Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T06:33:32.5807160Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T06:33:32.5808030Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T06:33:32.5808972Z Compiling xla/service/instruction_fusion.cc; 12s local 2025-03-14T06:33:32.5809788Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2025-03-14T06:33:32.5810664Z Compiling xla/service/layout_assignment.cc; 11s local ... 2025-03-14T06:33:32.7834470Z 2025-03-14T06:33:32.7835257Z  2025-03-14T06:33:32.7835682Z  2025-03-14T06:33:32.7836029Z  2025-03-14T06:33:32.7836382Z  2025-03-14T06:33:32.7836998Z  2025-03-14T06:33:32.7837356Z  2025-03-14T06:33:32.7837732Z  2025-03-14T06:33:32.7838103Z  2025-03-14T06:33:32.7838966Z [17,214 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:32.7839964Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T06:33:32.7840758Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T06:33:32.7841557Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 16s local 2025-03-14T06:33:32.7842343Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T06:33:32.7843368Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T06:33:32.7844170Z Compiling xla/service/instruction_fusion.cc; 12s local 2025-03-14T06:33:32.7845072Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2025-03-14T06:33:32.7845818Z Compiling xla/service/layout_assignment.cc; 11s local ... 2025-03-14T06:33:33.0637627Z 2025-03-14T06:33:33.0638462Z  2025-03-14T06:33:33.0639001Z  2025-03-14T06:33:33.0639368Z  2025-03-14T06:33:33.0639731Z  2025-03-14T06:33:33.0640086Z  2025-03-14T06:33:33.0640447Z  2025-03-14T06:33:33.0640804Z  2025-03-14T06:33:33.0641167Z  2025-03-14T06:33:33.0642055Z [17,218 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:33.0643094Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T06:33:33.0643912Z Compiling xla/service/topk_rewriter.cc; 20s local 2025-03-14T06:33:33.0644873Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T06:33:33.0645711Z Compiling xla/service/hlo_graph_dumper.cc; 13s local 2025-03-14T06:33:33.0646595Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T06:33:33.0647443Z Compiling xla/service/instruction_fusion.cc; 13s local 2025-03-14T06:33:33.0648223Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 12s local 2025-03-14T06:33:33.0649018Z Compiling xla/service/layout_assignment.cc; 11s local ... 2025-03-14T06:33:33.2734045Z 2025-03-14T06:33:33.2734896Z  2025-03-14T06:33:33.2735404Z  2025-03-14T06:33:33.2735817Z  2025-03-14T06:33:33.2736218Z  2025-03-14T06:33:33.2736610Z  2025-03-14T06:33:33.2737012Z  2025-03-14T06:33:33.2737414Z  2025-03-14T06:33:33.2737804Z  2025-03-14T06:33:33.2739122Z [17,219 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:33.2740256Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T06:33:33.2741128Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:33.2742036Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T06:33:33.2743016Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T06:33:33.2744005Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T06:33:33.2744977Z Compiling xla/service/instruction_fusion.cc; 13s local 2025-03-14T06:33:33.2745800Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2025-03-14T06:33:33.2746861Z Compiling xla/service/layout_assignment.cc; 12s local ... 2025-03-14T06:33:33.5076862Z 2025-03-14T06:33:33.5077703Z  2025-03-14T06:33:33.5078193Z  2025-03-14T06:33:33.5078632Z  2025-03-14T06:33:33.5079148Z  2025-03-14T06:33:33.5079517Z  2025-03-14T06:33:33.5079888Z  2025-03-14T06:33:33.5080256Z  2025-03-14T06:33:33.5080640Z  2025-03-14T06:33:33.5081565Z [17,219 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:33.5082642Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T06:33:33.5083454Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:33.5084248Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 17s local 2025-03-14T06:33:33.5085621Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T06:33:33.5086517Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T06:33:33.5087413Z Compiling xla/service/instruction_fusion.cc; 13s local 2025-03-14T06:33:33.5088239Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2025-03-14T06:33:33.5089079Z Compiling xla/service/layout_assignment.cc; 12s local ... 2025-03-14T06:33:33.8145383Z 2025-03-14T06:33:33.8146266Z  2025-03-14T06:33:33.8146766Z  2025-03-14T06:33:33.8147192Z  2025-03-14T06:33:33.8147847Z  2025-03-14T06:33:33.8148304Z  2025-03-14T06:33:33.8148737Z  2025-03-14T06:33:33.8149237Z  2025-03-14T06:33:33.8149631Z  2025-03-14T06:33:33.8150538Z [17,222 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:33.8151568Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T06:33:33.8152441Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:33.8153304Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T06:33:33.8154143Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T06:33:33.8155049Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T06:33:33.8155977Z Compiling xla/service/instruction_fusion.cc; 13s local 2025-03-14T06:33:33.8156795Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2025-03-14T06:33:33.8157664Z Compiling xla/service/layout_assignment.cc; 12s local ... 2025-03-14T06:33:34.0486398Z 2025-03-14T06:33:34.0487242Z  2025-03-14T06:33:34.0487747Z  2025-03-14T06:33:34.0488133Z  2025-03-14T06:33:34.0488509Z  2025-03-14T06:33:34.0488876Z  2025-03-14T06:33:34.0489253Z  2025-03-14T06:33:34.0489614Z  2025-03-14T06:33:34.0489963Z  2025-03-14T06:33:34.0490932Z [17,223 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:34.0492017Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T06:33:34.0492935Z Compiling xla/service/topk_rewriter.cc; 21s local 2025-03-14T06:33:34.0493798Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T06:33:34.0494633Z Compiling xla/service/hlo_graph_dumper.cc; 14s local 2025-03-14T06:33:34.0495786Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T06:33:34.0496739Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T06:33:34.0497577Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local 2025-03-14T06:33:34.0498447Z Compiling xla/service/layout_assignment.cc; 12s local ... 2025-03-14T06:33:34.3084908Z 2025-03-14T06:33:34.3085733Z  2025-03-14T06:33:34.3086208Z  2025-03-14T06:33:34.3086610Z  2025-03-14T06:33:34.3087010Z  2025-03-14T06:33:34.3087449Z  2025-03-14T06:33:34.3087834Z  2025-03-14T06:33:34.3088225Z  2025-03-14T06:33:34.3088617Z  2025-03-14T06:33:34.3089566Z [17,224 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:34.3090899Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T06:33:34.3091739Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T06:33:34.3092599Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 18s local 2025-03-14T06:33:34.3093480Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T06:33:34.3094398Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T06:33:34.3095478Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T06:33:34.3096323Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2025-03-14T06:33:34.3097212Z Compiling xla/service/layout_assignment.cc; 13s local ... 2025-03-14T06:33:34.9090675Z 2025-03-14T06:33:34.9091489Z  2025-03-14T06:33:34.9091978Z  2025-03-14T06:33:34.9092431Z  2025-03-14T06:33:34.9092821Z  2025-03-14T06:33:34.9093202Z  2025-03-14T06:33:34.9093624Z  2025-03-14T06:33:34.9094018Z  2025-03-14T06:33:34.9094402Z  2025-03-14T06:33:34.9095466Z [17,225 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:33:34.9096603Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T06:33:34.9097487Z Compiling xla/service/topk_rewriter.cc; 22s local 2025-03-14T06:33:34.9098675Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2025-03-14T06:33:34.9099613Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T06:33:34.9100527Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T06:33:34.9101482Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T06:33:34.9102362Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2025-03-14T06:33:34.9103241Z Compiling xla/service/layout_assignment.cc; 13s local ... 2025-03-14T06:33:35.1094469Z 2025-03-14T06:33:35.1095327Z  2025-03-14T06:33:35.1095871Z  2025-03-14T06:33:35.1096281Z  2025-03-14T06:33:35.1096674Z  2025-03-14T06:33:35.1097076Z  2025-03-14T06:33:35.1097461Z  2025-03-14T06:33:35.1097854Z  2025-03-14T06:33:35.1098238Z  2025-03-14T06:33:35.1099209Z [17,226 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:35.1100295Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T06:33:35.1101242Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2025-03-14T06:33:35.1102099Z Compiling xla/service/hlo_graph_dumper.cc; 15s local 2025-03-14T06:33:35.1102979Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T06:33:35.1103924Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T06:33:35.1104754Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 15s local 2025-03-14T06:33:35.1105594Z Compiling xla/service/layout_assignment.cc; 14s local 2025-03-14T06:33:35.1106385Z Compiling xla/hlo/analysis/hlo_ordering.cc; 13s local ... 2025-03-14T06:33:35.4070202Z 2025-03-14T06:33:35.4071089Z  2025-03-14T06:33:35.4071544Z  2025-03-14T06:33:35.4071961Z  2025-03-14T06:33:35.4072681Z  2025-03-14T06:33:35.4073104Z  2025-03-14T06:33:35.4073492Z  2025-03-14T06:33:35.4073864Z  2025-03-14T06:33:35.4074259Z  2025-03-14T06:33:35.4075207Z [17,230 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:35.4076312Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T06:33:35.4077291Z Compiling xla/hlo/analysis/hlo_dataflow_analysis.cc; 19s local 2025-03-14T06:33:35.4078144Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T06:33:35.4079076Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T06:33:35.4080006Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T06:33:35.4081111Z Compiling xla/service/layout_assignment.cc; 14s local 2025-03-14T06:33:35.4081922Z Compiling xla/hlo/analysis/hlo_ordering.cc; 14s local 2025-03-14T06:33:35.4082902Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local ... 2025-03-14T06:33:35.6309789Z 2025-03-14T06:33:35.6310668Z  2025-03-14T06:33:35.6311151Z  2025-03-14T06:33:35.6311581Z  2025-03-14T06:33:35.6311987Z  2025-03-14T06:33:35.6312401Z  2025-03-14T06:33:35.6312811Z  2025-03-14T06:33:35.6313227Z  2025-03-14T06:33:35.6313624Z  2025-03-14T06:33:35.6314565Z [17,233 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:35.6315615Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T06:33:35.6316832Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T06:33:35.6317761Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 16s local 2025-03-14T06:33:35.6318679Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T06:33:35.6319495Z Compiling xla/service/layout_assignment.cc; 14s local 2025-03-14T06:33:35.6320581Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2025-03-14T06:33:35.6321609Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T06:33:35.6322665Z Compiling xla/service/call_inliner.cc; 12s local ... 2025-03-14T06:33:35.9101120Z 2025-03-14T06:33:35.9101970Z  2025-03-14T06:33:35.9102472Z  2025-03-14T06:33:35.9102815Z  2025-03-14T06:33:35.9103162Z  2025-03-14T06:33:35.9103508Z  2025-03-14T06:33:35.9103871Z  2025-03-14T06:33:35.9104211Z  2025-03-14T06:33:35.9104559Z  2025-03-14T06:33:35.9105424Z [17,234 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:35.9106416Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T06:33:35.9107300Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T06:33:35.9108203Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 16s local 2025-03-14T06:33:35.9109125Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T06:33:35.9109868Z Compiling xla/service/layout_assignment.cc; 14s local 2025-03-14T06:33:35.9110727Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2025-03-14T06:33:35.9111620Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T06:33:35.9112501Z Compiling xla/service/call_inliner.cc; 12s local ... 2025-03-14T06:33:36.1105369Z 2025-03-14T06:33:36.1106212Z  2025-03-14T06:33:36.1106729Z  2025-03-14T06:33:36.1107164Z  2025-03-14T06:33:36.1107620Z  2025-03-14T06:33:36.1108046Z  2025-03-14T06:33:36.1108472Z  2025-03-14T06:33:36.1108897Z  2025-03-14T06:33:36.1109327Z  2025-03-14T06:33:36.1110240Z [17,235 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:36.1111261Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T06:33:36.1112146Z Compiling xla/service/hlo_graph_dumper.cc; 16s local 2025-03-14T06:33:36.1113106Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T06:33:36.1113920Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T06:33:36.1114785Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2025-03-14T06:33:36.1115834Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T06:33:36.1116588Z Compiling xla/service/call_inliner.cc; 13s local 2025-03-14T06:33:36.1117431Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local ... 2025-03-14T06:33:36.4136392Z 2025-03-14T06:33:36.4137170Z  2025-03-14T06:33:36.4137665Z  2025-03-14T06:33:36.4138107Z  2025-03-14T06:33:36.4138546Z  2025-03-14T06:33:36.4138932Z  2025-03-14T06:33:36.4139614Z  2025-03-14T06:33:36.4140011Z  2025-03-14T06:33:36.4140379Z  2025-03-14T06:33:36.4141269Z [17,238 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:36.4142303Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2025-03-14T06:33:36.4143325Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T06:33:36.4144130Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T06:33:36.4144966Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T06:33:36.4145870Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2025-03-14T06:33:36.4146843Z Compiling xla/service/instruction_fusion.cc; 14s local 2025-03-14T06:33:36.4147872Z Compiling xla/service/call_inliner.cc; 13s local 2025-03-14T06:33:36.4148784Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local ... 2025-03-14T06:33:36.6664048Z 2025-03-14T06:33:36.6664918Z  2025-03-14T06:33:36.6665805Z  2025-03-14T06:33:36.6666238Z  2025-03-14T06:33:36.6666634Z  2025-03-14T06:33:36.6667051Z  2025-03-14T06:33:36.6667484Z  2025-03-14T06:33:36.6667878Z  2025-03-14T06:33:36.6668311Z  2025-03-14T06:33:36.6669302Z [17,239 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:36.6670764Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2025-03-14T06:33:36.6671687Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T06:33:36.6672538Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T06:33:36.6673427Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T06:33:36.6674550Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2025-03-14T06:33:36.6675551Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T06:33:36.6676473Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2025-03-14T06:33:36.6677513Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 10s local ... 2025-03-14T06:33:36.9112648Z 2025-03-14T06:33:36.9113513Z  2025-03-14T06:33:36.9113990Z  2025-03-14T06:33:36.9114426Z  2025-03-14T06:33:36.9114936Z  2025-03-14T06:33:36.9115317Z  2025-03-14T06:33:36.9115722Z  2025-03-14T06:33:36.9116151Z  2025-03-14T06:33:36.9116567Z  2025-03-14T06:33:36.9117512Z [17,241 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:36.9118578Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2025-03-14T06:33:36.9119421Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T06:33:36.9120208Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T06:33:36.9121040Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T06:33:36.9121958Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2025-03-14T06:33:36.9122953Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T06:33:36.9123863Z Compiling xla/service/cpu/in_process_collectives.cc; 11s local 2025-03-14T06:33:36.9125310Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 10s local ... 2025-03-14T06:33:37.1116026Z 2025-03-14T06:33:37.1116867Z  2025-03-14T06:33:37.1117331Z  2025-03-14T06:33:37.1117768Z  2025-03-14T06:33:37.1118202Z  2025-03-14T06:33:37.1118631Z  2025-03-14T06:33:37.1119064Z  2025-03-14T06:33:37.1119498Z  2025-03-14T06:33:37.1119906Z  2025-03-14T06:33:37.1120869Z [17,242 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:37.1122011Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2025-03-14T06:33:37.1122963Z Compiling xla/service/hlo_graph_dumper.cc; 17s local 2025-03-14T06:33:37.1123796Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T06:33:37.1125082Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T06:33:37.1126096Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2025-03-14T06:33:37.1127092Z Compiling xla/service/instruction_fusion.cc; 15s local 2025-03-14T06:33:37.1128025Z Compiling xla/service/cpu/in_process_collectives.cc; 12s local 2025-03-14T06:33:37.1129005Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 11s local ... 2025-03-14T06:33:37.7857020Z 2025-03-14T06:33:37.7857880Z  2025-03-14T06:33:37.7858375Z  2025-03-14T06:33:37.7858769Z  2025-03-14T06:33:37.7859189Z  2025-03-14T06:33:37.7859604Z  2025-03-14T06:33:37.7859993Z  2025-03-14T06:33:37.7860395Z  2025-03-14T06:33:37.7861111Z  2025-03-14T06:33:37.7862094Z [17,243 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:37.7863263Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 36s local 2025-03-14T06:33:37.7864132Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T06:33:37.7864966Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T06:33:37.7866065Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T06:33:37.7867072Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2025-03-14T06:33:37.7868296Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T06:33:37.7869171Z Compiling xla/service/cpu/in_process_collectives.cc; 12s local 2025-03-14T06:33:37.7870091Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 11s local ... 2025-03-14T06:33:38.1124779Z 2025-03-14T06:33:38.1125586Z  2025-03-14T06:33:38.1126059Z  2025-03-14T06:33:38.1126502Z  2025-03-14T06:33:38.1126907Z  2025-03-14T06:33:38.1127328Z  2025-03-14T06:33:38.1127798Z  2025-03-14T06:33:38.1128232Z  2025-03-14T06:33:38.1128657Z  2025-03-14T06:33:38.1129654Z [17,245 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:38.1130674Z Compiling xla/service/hlo_graph_dumper.cc; 18s local 2025-03-14T06:33:38.1131510Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T06:33:38.1132344Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T06:33:38.1133247Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2025-03-14T06:33:38.1134229Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T06:33:38.1135123Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2025-03-14T06:33:38.1136079Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 12s local 2025-03-14T06:33:38.1136963Z Compiling xla/hlo/utils/hlo_live_range.cc; 11s local ... 2025-03-14T06:33:38.5129586Z 2025-03-14T06:33:38.5130446Z  2025-03-14T06:33:38.5130920Z  2025-03-14T06:33:38.5131297Z  2025-03-14T06:33:38.5131705Z  2025-03-14T06:33:38.5132121Z  2025-03-14T06:33:38.5132531Z  2025-03-14T06:33:38.5132937Z  2025-03-14T06:33:38.5133346Z  2025-03-14T06:33:38.5134516Z [17,246 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:38.5135558Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T06:33:38.5136384Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T06:33:38.5137214Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T06:33:38.5138214Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2025-03-14T06:33:38.5139240Z Compiling xla/service/instruction_fusion.cc; 16s local 2025-03-14T06:33:38.5140186Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2025-03-14T06:33:38.5141150Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 12s local 2025-03-14T06:33:38.5141955Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local ... 2025-03-14T06:33:38.7532756Z 2025-03-14T06:33:38.7533634Z  2025-03-14T06:33:38.7534112Z  2025-03-14T06:33:38.7534529Z  2025-03-14T06:33:38.7534937Z  2025-03-14T06:33:38.7535345Z  2025-03-14T06:33:38.7535755Z  2025-03-14T06:33:38.7536135Z  2025-03-14T06:33:38.7536561Z  2025-03-14T06:33:38.7537500Z [17,247 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:38.7538548Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T06:33:38.7539518Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T06:33:38.7540338Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T06:33:38.7541329Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2025-03-14T06:33:38.7542603Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T06:33:38.7543506Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2025-03-14T06:33:38.7544448Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 12s local 2025-03-14T06:33:38.7545356Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local ... 2025-03-14T06:33:38.9831747Z 2025-03-14T06:33:38.9832724Z  2025-03-14T06:33:38.9833203Z  2025-03-14T06:33:38.9833627Z  2025-03-14T06:33:38.9834029Z  2025-03-14T06:33:38.9834425Z  2025-03-14T06:33:38.9834841Z  2025-03-14T06:33:38.9835490Z  2025-03-14T06:33:38.9836033Z  2025-03-14T06:33:38.9836943Z [17,250 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:38.9837977Z Compiling xla/service/hlo_graph_dumper.cc; 19s local 2025-03-14T06:33:38.9838795Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T06:33:38.9839742Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2025-03-14T06:33:38.9840746Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T06:33:38.9841649Z Compiling xla/service/cpu/in_process_collectives.cc; 13s local 2025-03-14T06:33:38.9842516Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 12s local 2025-03-14T06:33:38.9843357Z Compiling xla/hlo/utils/hlo_live_range.cc; 12s local 2025-03-14T06:33:38.9844367Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 11s local ... 2025-03-14T06:33:39.3135637Z 2025-03-14T06:33:39.3136485Z  2025-03-14T06:33:39.3136967Z  2025-03-14T06:33:39.3137331Z  2025-03-14T06:33:39.3137683Z  2025-03-14T06:33:39.3138045Z  2025-03-14T06:33:39.3138378Z  2025-03-14T06:33:39.3138726Z  2025-03-14T06:33:39.3139071Z  2025-03-14T06:33:39.3139938Z [17,251 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:39.3140992Z Compiling xla/service/hlo_graph_dumper.cc; 20s local 2025-03-14T06:33:39.3141758Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T06:33:39.3142629Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2025-03-14T06:33:39.3143551Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T06:33:39.3144391Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2025-03-14T06:33:39.3145487Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 13s local 2025-03-14T06:33:39.3146281Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2025-03-14T06:33:39.3147253Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local ... 2025-03-14T06:33:39.5373576Z 2025-03-14T06:33:39.5374388Z  2025-03-14T06:33:39.5374897Z  2025-03-14T06:33:39.5375324Z  2025-03-14T06:33:39.5375742Z  2025-03-14T06:33:39.5376129Z  2025-03-14T06:33:39.5376527Z  2025-03-14T06:33:39.5376967Z  2025-03-14T06:33:39.5377382Z  2025-03-14T06:33:39.5378366Z [17,252 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:39.5379439Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T06:33:39.5380695Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2025-03-14T06:33:39.5381701Z Compiling xla/service/instruction_fusion.cc; 17s local 2025-03-14T06:33:39.5382643Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2025-03-14T06:33:39.5383597Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 13s local 2025-03-14T06:33:39.5384453Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2025-03-14T06:33:39.5385382Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local 2025-03-14T06:33:39.5386500Z Compiling mlir/lib/Dialect/Affine/Analysis/Utils.cpp; 11s local ... 2025-03-14T06:33:39.7414368Z 2025-03-14T06:33:39.7415224Z  2025-03-14T06:33:39.7415970Z  2025-03-14T06:33:39.7416386Z  2025-03-14T06:33:39.7416789Z  2025-03-14T06:33:39.7417205Z  2025-03-14T06:33:39.7417593Z  2025-03-14T06:33:39.7417974Z  2025-03-14T06:33:39.7418397Z  2025-03-14T06:33:39.7419473Z [17,254 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:39.7420540Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T06:33:39.7421570Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2025-03-14T06:33:39.7422821Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T06:33:39.7423709Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2025-03-14T06:33:39.7424585Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 13s local 2025-03-14T06:33:39.7425428Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2025-03-14T06:33:39.7426420Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local 2025-03-14T06:33:39.7427614Z Compiling mlir/lib/Dialect/Affine/Analysis/Utils.cpp; 11s local ... 2025-03-14T06:33:39.9807436Z 2025-03-14T06:33:39.9808275Z  2025-03-14T06:33:39.9808694Z  2025-03-14T06:33:39.9809066Z  2025-03-14T06:33:39.9809379Z  2025-03-14T06:33:39.9809739Z  2025-03-14T06:33:39.9810145Z  2025-03-14T06:33:39.9810541Z  2025-03-14T06:33:39.9810864Z  2025-03-14T06:33:39.9811661Z [17,255 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:39.9812508Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T06:33:39.9813369Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2025-03-14T06:33:39.9824581Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T06:33:39.9825505Z Compiling xla/service/cpu/in_process_collectives.cc; 14s local 2025-03-14T06:33:39.9826478Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 13s local 2025-03-14T06:33:39.9827421Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2025-03-14T06:33:39.9828348Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local 2025-03-14T06:33:39.9829541Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 11s local ... 2025-03-14T06:33:40.2223361Z 2025-03-14T06:33:40.2224182Z  2025-03-14T06:33:40.2224694Z  2025-03-14T06:33:40.2225139Z  2025-03-14T06:33:40.2225586Z  2025-03-14T06:33:40.2226309Z  2025-03-14T06:33:40.2226767Z  2025-03-14T06:33:40.2227209Z  2025-03-14T06:33:40.2227646Z  2025-03-14T06:33:40.2228675Z [17,256 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:40.2229828Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T06:33:40.2230860Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2025-03-14T06:33:40.2231919Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T06:33:40.2232902Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2025-03-14T06:33:40.2233899Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 14s local 2025-03-14T06:33:40.2234936Z Compiling xla/hlo/utils/hlo_live_range.cc; 13s local 2025-03-14T06:33:40.2235949Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMInterfaces.cpp; 12s local 2025-03-14T06:33:40.2236941Z Compiling xla/service/while_util.cc; 11s local ... 2025-03-14T06:33:40.4352398Z 2025-03-14T06:33:40.4353278Z  2025-03-14T06:33:40.4353753Z  2025-03-14T06:33:40.4354163Z  2025-03-14T06:33:40.4354592Z  2025-03-14T06:33:40.4355016Z  2025-03-14T06:33:40.4355412Z  2025-03-14T06:33:40.4355824Z  2025-03-14T06:33:40.4356239Z  2025-03-14T06:33:40.4357168Z [17,257 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:40.4358178Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T06:33:40.4359424Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2025-03-14T06:33:40.4360413Z Compiling xla/service/instruction_fusion.cc; 18s local 2025-03-14T06:33:40.4361358Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2025-03-14T06:33:40.4362312Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 14s local 2025-03-14T06:33:40.4363118Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2025-03-14T06:33:40.4363920Z Compiling xla/service/while_util.cc; 12s local 2025-03-14T06:33:40.4365219Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 10s local ... 2025-03-14T06:33:40.7147661Z 2025-03-14T06:33:40.7148519Z  2025-03-14T06:33:40.7149024Z  2025-03-14T06:33:40.7149494Z  2025-03-14T06:33:40.7149952Z  2025-03-14T06:33:40.7150339Z  2025-03-14T06:33:40.7150719Z  2025-03-14T06:33:40.7151116Z  2025-03-14T06:33:40.7151497Z  2025-03-14T06:33:40.7152625Z [17,261 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:40.7153713Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T06:33:40.7154655Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2025-03-14T06:33:40.7155831Z Compiling xla/service/cpu/in_process_collectives.cc; 15s local 2025-03-14T06:33:40.7156787Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 14s local 2025-03-14T06:33:40.7157630Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2025-03-14T06:33:40.7158450Z Compiling xla/service/while_util.cc; 12s local 2025-03-14T06:33:40.7159514Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 10s local 2025-03-14T06:33:40.7160498Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 9s local ... 2025-03-14T06:33:41.1150844Z 2025-03-14T06:33:41.1151741Z  2025-03-14T06:33:41.1152255Z  2025-03-14T06:33:41.1152683Z  2025-03-14T06:33:41.1153113Z  2025-03-14T06:33:41.1153558Z  2025-03-14T06:33:41.1153954Z  2025-03-14T06:33:41.1154372Z  2025-03-14T06:33:41.1154785Z  2025-03-14T06:33:41.1155762Z [17,262 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:41.1156847Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T06:33:41.1157845Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2025-03-14T06:33:41.1159218Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2025-03-14T06:33:41.1160209Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local 2025-03-14T06:33:41.1161083Z Compiling xla/hlo/utils/hlo_live_range.cc; 14s local 2025-03-14T06:33:41.1161844Z Compiling xla/service/while_util.cc; 12s local 2025-03-14T06:33:41.1162774Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 11s local 2025-03-14T06:33:41.1163938Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 9s local ... 2025-03-14T06:33:41.3154317Z 2025-03-14T06:33:41.3155173Z  2025-03-14T06:33:41.3155675Z  2025-03-14T06:33:41.3156101Z  2025-03-14T06:33:41.3156509Z  2025-03-14T06:33:41.3156908Z  2025-03-14T06:33:41.3157651Z  2025-03-14T06:33:41.3158028Z  2025-03-14T06:33:41.3158456Z  2025-03-14T06:33:41.3159418Z [17,263 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:41.3160340Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T06:33:41.3161239Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2025-03-14T06:33:41.3162216Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2025-03-14T06:33:41.3163149Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local 2025-03-14T06:33:41.3163948Z Compiling xla/service/while_util.cc; 12s local 2025-03-14T06:33:41.3165257Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 11s local 2025-03-14T06:33:41.3166714Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 9s local 2025-03-14T06:33:41.3167676Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 9s local ... 2025-03-14T06:33:42.2824074Z 2025-03-14T06:33:42.2824950Z  2025-03-14T06:33:42.2825428Z  2025-03-14T06:33:42.2825831Z  2025-03-14T06:33:42.2826195Z  2025-03-14T06:33:42.2826588Z  2025-03-14T06:33:42.2826989Z  2025-03-14T06:33:42.2827380Z  2025-03-14T06:33:42.2827803Z  2025-03-14T06:33:42.2828732Z [17,264 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:42.2830013Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T06:33:42.2830969Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2025-03-14T06:33:42.2831978Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T06:33:42.2832882Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2025-03-14T06:33:42.2833700Z Compiling xla/service/while_util.cc; 13s local 2025-03-14T06:33:42.2834562Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 12s local 2025-03-14T06:33:42.2835587Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 10s local 2025-03-14T06:33:42.2836593Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local ... 2025-03-14T06:33:42.5162929Z 2025-03-14T06:33:42.5163757Z  2025-03-14T06:33:42.5164273Z  2025-03-14T06:33:42.5164863Z  2025-03-14T06:33:42.5165259Z  2025-03-14T06:33:42.5165836Z  2025-03-14T06:33:42.5166246Z  2025-03-14T06:33:42.5166657Z  2025-03-14T06:33:42.5166970Z  2025-03-14T06:33:42.5167903Z [17,265 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:42.5168897Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T06:33:42.5169752Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2025-03-14T06:33:42.5170768Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T06:33:42.5171653Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2025-03-14T06:33:42.5172453Z Compiling xla/service/while_util.cc; 14s local 2025-03-14T06:33:42.5173388Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 12s local 2025-03-14T06:33:42.5174425Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 10s local 2025-03-14T06:33:42.5175612Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local ... 2025-03-14T06:33:42.7166990Z 2025-03-14T06:33:42.7167776Z  2025-03-14T06:33:42.7168274Z  2025-03-14T06:33:42.7168658Z  2025-03-14T06:33:42.7169052Z  2025-03-14T06:33:42.7169447Z  2025-03-14T06:33:42.7169858Z  2025-03-14T06:33:42.7170257Z  2025-03-14T06:33:42.7170647Z  2025-03-14T06:33:42.7171549Z [17,266 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:42.7172517Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T06:33:42.7173446Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2025-03-14T06:33:42.7174690Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T06:33:42.7175546Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2025-03-14T06:33:42.7176289Z Compiling xla/service/while_util.cc; 14s local 2025-03-14T06:33:42.7177166Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 12s local 2025-03-14T06:33:42.7178150Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 11s local 2025-03-14T06:33:42.7179150Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 10s local ... 2025-03-14T06:33:43.2722514Z 2025-03-14T06:33:43.2723382Z  2025-03-14T06:33:43.2723860Z  2025-03-14T06:33:43.2724268Z  2025-03-14T06:33:43.2724839Z  2025-03-14T06:33:43.2725229Z  2025-03-14T06:33:43.2725737Z  2025-03-14T06:33:43.2726424Z  2025-03-14T06:33:43.2726812Z  2025-03-14T06:33:43.2727737Z [17,267 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:43.2728789Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T06:33:43.2729754Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2025-03-14T06:33:43.2730725Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T06:33:43.2731516Z Compiling xla/service/while_util.cc; 14s local 2025-03-14T06:33:43.2732560Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 13s local 2025-03-14T06:33:43.2733553Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 11s local 2025-03-14T06:33:43.2734447Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2025-03-14T06:33:43.2735320Z Compiling xla/service/sharding_propagation.cc; 10s local ... 2025-03-14T06:33:43.5174406Z 2025-03-14T06:33:43.5175277Z  2025-03-14T06:33:43.5175870Z  2025-03-14T06:33:43.5176229Z  2025-03-14T06:33:43.5176580Z  2025-03-14T06:33:43.5177028Z  2025-03-14T06:33:43.5177442Z  2025-03-14T06:33:43.5177843Z  2025-03-14T06:33:43.5178248Z  2025-03-14T06:33:43.5179137Z [17,268 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:43.5180173Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T06:33:43.5181157Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2025-03-14T06:33:43.5182205Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T06:33:43.5183070Z Compiling xla/service/while_util.cc; 15s local 2025-03-14T06:33:43.5183938Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 13s local 2025-03-14T06:33:43.5184925Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 11s local 2025-03-14T06:33:43.5185786Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2025-03-14T06:33:43.5186660Z Compiling xla/service/sharding_propagation.cc; 11s local ... 2025-03-14T06:33:43.7990352Z 2025-03-14T06:33:43.7991183Z  2025-03-14T06:33:43.7991689Z  2025-03-14T06:33:43.7992121Z  2025-03-14T06:33:43.7992546Z  2025-03-14T06:33:43.7992951Z  2025-03-14T06:33:43.7993354Z  2025-03-14T06:33:43.7993755Z  2025-03-14T06:33:43.7994165Z  2025-03-14T06:33:43.7995434Z [17,269 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:43.7996546Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T06:33:43.7997568Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2025-03-14T06:33:43.7998628Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T06:33:43.7999440Z Compiling xla/service/while_util.cc; 15s local 2025-03-14T06:33:43.8000357Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 13s local 2025-03-14T06:33:43.8001566Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 12s local 2025-03-14T06:33:43.8002529Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 11s local 2025-03-14T06:33:43.8003475Z Compiling xla/service/sharding_propagation.cc; 11s local ... 2025-03-14T06:33:44.0704614Z 2025-03-14T06:33:44.0705493Z  2025-03-14T06:33:44.0705967Z  2025-03-14T06:33:44.0706360Z  2025-03-14T06:33:44.0706777Z  2025-03-14T06:33:44.0707216Z  2025-03-14T06:33:44.0707622Z  2025-03-14T06:33:44.0708031Z  2025-03-14T06:33:44.0708431Z  2025-03-14T06:33:44.0709485Z [17,271 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:44.0710504Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T06:33:44.0711440Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2025-03-14T06:33:44.0712383Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T06:33:44.0713643Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2025-03-14T06:33:44.0714665Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 12s local 2025-03-14T06:33:44.0715587Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T06:33:44.0716470Z Compiling xla/service/sharding_propagation.cc; 11s local 2025-03-14T06:33:44.0717425Z Compiling xla/service/select_and_scatter_expander.cc; 11s local ... 2025-03-14T06:33:44.3180799Z 2025-03-14T06:33:44.3181638Z  2025-03-14T06:33:44.3182098Z  2025-03-14T06:33:44.3182422Z  2025-03-14T06:33:44.3183070Z  2025-03-14T06:33:44.3183491Z  2025-03-14T06:33:44.3183889Z  2025-03-14T06:33:44.3184285Z  2025-03-14T06:33:44.3184669Z  2025-03-14T06:33:44.3185589Z [17,272 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:44.3186633Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T06:33:44.3187617Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2025-03-14T06:33:44.3188570Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T06:33:44.3189450Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2025-03-14T06:33:44.3190397Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 12s local 2025-03-14T06:33:44.3191216Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T06:33:44.3192137Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T06:33:44.3192922Z Compiling xla/service/select_and_scatter_expander.cc; 11s local ... 2025-03-14T06:33:44.5424798Z 2025-03-14T06:33:44.5425657Z  2025-03-14T06:33:44.5426207Z  2025-03-14T06:33:44.5426616Z  2025-03-14T06:33:44.5427019Z  2025-03-14T06:33:44.5427431Z  2025-03-14T06:33:44.5427820Z  2025-03-14T06:33:44.5428209Z  2025-03-14T06:33:44.5428610Z  2025-03-14T06:33:44.5429593Z [17,273 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:44.5430606Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T06:33:44.5431607Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2025-03-14T06:33:44.5432640Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T06:33:44.5433929Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2025-03-14T06:33:44.5434997Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 12s local 2025-03-14T06:33:44.5435921Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T06:33:44.5436830Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T06:33:44.5437796Z Compiling xla/service/select_and_scatter_expander.cc; 12s local ... 2025-03-14T06:33:44.7750776Z 2025-03-14T06:33:44.7751625Z  2025-03-14T06:33:44.7752120Z  2025-03-14T06:33:44.7752586Z  2025-03-14T06:33:44.7753014Z  2025-03-14T06:33:44.7753437Z  2025-03-14T06:33:44.7753865Z  2025-03-14T06:33:44.7754267Z  2025-03-14T06:33:44.7754670Z  2025-03-14T06:33:44.7755636Z [17,276 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:44.7756968Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T06:33:44.7757978Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2025-03-14T06:33:44.7759004Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T06:33:44.7760047Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 14s local 2025-03-14T06:33:44.7761160Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 13s local 2025-03-14T06:33:44.7762094Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 12s local 2025-03-14T06:33:44.7762986Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T06:33:44.7763803Z @llvm-project//llvm:InstCombine; 11s local ... 2025-03-14T06:33:45.1187020Z 2025-03-14T06:33:45.1187819Z  2025-03-14T06:33:45.1188252Z  2025-03-14T06:33:45.1188616Z  2025-03-14T06:33:45.1188970Z  2025-03-14T06:33:45.1189364Z  2025-03-14T06:33:45.1189730Z  2025-03-14T06:33:45.1190103Z  2025-03-14T06:33:45.1190489Z  2025-03-14T06:33:45.1191355Z [17,276 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:45.1192281Z Compiling xla/service/layout_assignment.cc; 24s local 2025-03-14T06:33:45.1193441Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2025-03-14T06:33:45.1194310Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T06:33:45.1195170Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2025-03-14T06:33:45.1196048Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 13s local 2025-03-14T06:33:45.1196828Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T06:33:45.1197602Z Compiling xla/service/sharding_propagation.cc; 12s local 2025-03-14T06:33:45.1198330Z @llvm-project//llvm:InstCombine; 12s local ... 2025-03-14T06:33:45.3882512Z 2025-03-14T06:33:45.3883339Z  2025-03-14T06:33:45.3883782Z  2025-03-14T06:33:45.3884164Z  2025-03-14T06:33:45.3884681Z  2025-03-14T06:33:45.3885068Z  2025-03-14T06:33:45.3885441Z  2025-03-14T06:33:45.3885846Z  2025-03-14T06:33:45.3886226Z  2025-03-14T06:33:45.3887062Z [17,277 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:45.3887931Z Compiling xla/service/layout_assignment.cc; 24s local 2025-03-14T06:33:45.3888752Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2025-03-14T06:33:45.3889585Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T06:33:45.3890413Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2025-03-14T06:33:45.3891281Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 13s local 2025-03-14T06:33:45.3892059Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T06:33:45.3892816Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T06:33:45.3893502Z @llvm-project//llvm:InstCombine; 12s local ... 2025-03-14T06:33:45.6451342Z 2025-03-14T06:33:45.6452300Z  2025-03-14T06:33:45.6453066Z  2025-03-14T06:33:45.6453496Z  2025-03-14T06:33:45.6453881Z  2025-03-14T06:33:45.6454267Z  2025-03-14T06:33:45.6454661Z  2025-03-14T06:33:45.6455060Z  2025-03-14T06:33:45.6455457Z  2025-03-14T06:33:45.6456380Z [17,279 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:45.6457480Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2025-03-14T06:33:45.6458399Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T06:33:45.6459304Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2025-03-14T06:33:45.6460307Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local 2025-03-14T06:33:45.6461395Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T06:33:45.6462232Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T06:33:45.6462981Z @llvm-project//llvm:InstCombine; 12s local 2025-03-14T06:33:45.6463796Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local ... 2025-03-14T06:33:45.9193910Z 2025-03-14T06:33:45.9194770Z  2025-03-14T06:33:45.9195216Z  2025-03-14T06:33:45.9195585Z  2025-03-14T06:33:45.9195935Z  2025-03-14T06:33:45.9196295Z  2025-03-14T06:33:45.9196654Z  2025-03-14T06:33:45.9197035Z  2025-03-14T06:33:45.9197376Z  2025-03-14T06:33:45.9198257Z [17,279 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:45.9199676Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2025-03-14T06:33:45.9200532Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T06:33:45.9201397Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 15s local 2025-03-14T06:33:45.9202275Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local 2025-03-14T06:33:45.9203070Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 13s local 2025-03-14T06:33:45.9203859Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T06:33:45.9204923Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T06:33:45.9205694Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local ... 2025-03-14T06:33:46.2630213Z 2025-03-14T06:33:46.2631088Z  2025-03-14T06:33:46.2631588Z  2025-03-14T06:33:46.2632032Z  2025-03-14T06:33:46.2632467Z  2025-03-14T06:33:46.2632895Z  2025-03-14T06:33:46.2633349Z  2025-03-14T06:33:46.2633774Z  2025-03-14T06:33:46.2634163Z  2025-03-14T06:33:46.2635126Z [17,280 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:46.2636310Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2025-03-14T06:33:46.2637293Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2025-03-14T06:33:46.2638272Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2025-03-14T06:33:46.2639168Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local 2025-03-14T06:33:46.2640105Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T06:33:46.2641032Z Compiling xla/service/sharding_propagation.cc; 13s local 2025-03-14T06:33:46.2641821Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T06:33:46.2642706Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 12s local ... 2025-03-14T06:33:46.5077740Z 2025-03-14T06:33:46.5078615Z  2025-03-14T06:33:46.5079083Z  2025-03-14T06:33:46.5079458Z  2025-03-14T06:33:46.5079863Z  2025-03-14T06:33:46.5080263Z  2025-03-14T06:33:46.5080677Z  2025-03-14T06:33:46.5081073Z  2025-03-14T06:33:46.5081454Z  2025-03-14T06:33:46.5082399Z [17,282 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:46.5083873Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2025-03-14T06:33:46.5084936Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2025-03-14T06:33:46.5085868Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2025-03-14T06:33:46.5086844Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 14s local 2025-03-14T06:33:46.5087740Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T06:33:46.5088631Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T06:33:46.5089398Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T06:33:46.5090252Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local ... 2025-03-14T06:33:46.7200434Z 2025-03-14T06:33:46.7201356Z  2025-03-14T06:33:46.7202192Z  2025-03-14T06:33:46.7202626Z  2025-03-14T06:33:46.7203074Z  2025-03-14T06:33:46.7203501Z  2025-03-14T06:33:46.7203925Z  2025-03-14T06:33:46.7204344Z  2025-03-14T06:33:46.7204872Z  2025-03-14T06:33:46.7205811Z [17,282 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:46.7207032Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2025-03-14T06:33:46.7208059Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2025-03-14T06:33:46.7209057Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 16s local 2025-03-14T06:33:46.7210160Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local 2025-03-14T06:33:46.7211164Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 14s local 2025-03-14T06:33:46.7212326Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T06:33:46.7213174Z @llvm-project//llvm:InstCombine; 13s local 2025-03-14T06:33:46.7214050Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 13s local ... 2025-03-14T06:33:47.2845960Z 2025-03-14T06:33:47.2846805Z  2025-03-14T06:33:47.2847368Z  2025-03-14T06:33:47.2847785Z  2025-03-14T06:33:47.2848208Z  2025-03-14T06:33:47.2848635Z  2025-03-14T06:33:47.2849055Z  2025-03-14T06:33:47.2849460Z  2025-03-14T06:33:47.2849879Z  2025-03-14T06:33:47.2851143Z [17,283 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:47.2852369Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2025-03-14T06:33:47.2853369Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T06:33:47.2854301Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2025-03-14T06:33:47.2855421Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local 2025-03-14T06:33:47.2856306Z Compiling xla/hlo/analysis/hlo_alias_analysis.cc; 15s local 2025-03-14T06:33:47.2857168Z Compiling xla/service/sharding_propagation.cc; 14s local 2025-03-14T06:33:47.2857907Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T06:33:47.2858693Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local ... 2025-03-14T06:33:47.5208836Z 2025-03-14T06:33:47.5209668Z  2025-03-14T06:33:47.5210138Z  2025-03-14T06:33:47.5210530Z  2025-03-14T06:33:47.5210951Z  2025-03-14T06:33:47.5211347Z  2025-03-14T06:33:47.5211737Z  2025-03-14T06:33:47.5212136Z  2025-03-14T06:33:47.5212522Z  2025-03-14T06:33:47.5213472Z [17,284 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:47.5214632Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2025-03-14T06:33:47.5215621Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T06:33:47.5216602Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2025-03-14T06:33:47.5217623Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 15s local 2025-03-14T06:33:47.5218526Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T06:33:47.5219542Z @llvm-project//llvm:InstCombine; 14s local 2025-03-14T06:33:47.5220358Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2025-03-14T06:33:47.5221374Z Compiling mlir/lib/Conversion/LLVMCommon/Pattern.cpp; 12s local ... 2025-03-14T06:33:47.9044059Z 2025-03-14T06:33:47.9045101Z  2025-03-14T06:33:47.9045730Z  2025-03-14T06:33:47.9046120Z  2025-03-14T06:33:47.9046518Z  2025-03-14T06:33:47.9046932Z  2025-03-14T06:33:47.9047317Z  2025-03-14T06:33:47.9047716Z  2025-03-14T06:33:47.9048111Z  2025-03-14T06:33:47.9049051Z [17,286 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:47.9050200Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2025-03-14T06:33:47.9051447Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T06:33:47.9052443Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 17s local 2025-03-14T06:33:47.9053465Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2025-03-14T06:33:47.9054361Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T06:33:47.9055136Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T06:33:47.9055943Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2025-03-14T06:33:47.9057077Z Compiling mlir/lib/Conversion/LLVMCommon/Pattern.cpp; 12s local ... 2025-03-14T06:33:48.1215158Z 2025-03-14T06:33:48.1215953Z  2025-03-14T06:33:48.1216441Z  2025-03-14T06:33:48.1217110Z  2025-03-14T06:33:48.1217524Z  2025-03-14T06:33:48.1217918Z  2025-03-14T06:33:48.1218307Z  2025-03-14T06:33:48.1218702Z  2025-03-14T06:33:48.1219088Z  2025-03-14T06:33:48.1220027Z [17,287 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:48.1221181Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2025-03-14T06:33:48.1222265Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2025-03-14T06:33:48.1223266Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2025-03-14T06:33:48.1224518Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2025-03-14T06:33:48.1225417Z Compiling xla/service/sharding_propagation.cc; 15s local 2025-03-14T06:33:48.1226199Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T06:33:48.1227035Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 14s local 2025-03-14T06:33:48.1228021Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local ... 2025-03-14T06:33:48.5217272Z 2025-03-14T06:33:48.5218191Z  2025-03-14T06:33:48.5218698Z  2025-03-14T06:33:48.5219145Z  2025-03-14T06:33:48.5219597Z  2025-03-14T06:33:48.5220002Z  2025-03-14T06:33:48.5220369Z  2025-03-14T06:33:48.5220746Z  2025-03-14T06:33:48.5221131Z  2025-03-14T06:33:48.5222052Z [17,288 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:48.5223222Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2025-03-14T06:33:48.5224184Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2025-03-14T06:33:48.5225174Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2025-03-14T06:33:48.5226191Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 16s local 2025-03-14T06:33:48.5227131Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T06:33:48.5227933Z @llvm-project//llvm:InstCombine; 15s local 2025-03-14T06:33:48.5228720Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2025-03-14T06:33:48.5229778Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local ... 2025-03-14T06:33:48.8531708Z 2025-03-14T06:33:48.8532787Z  2025-03-14T06:33:48.8533334Z  2025-03-14T06:33:48.8533758Z  2025-03-14T06:33:48.8534164Z  2025-03-14T06:33:48.8534583Z  2025-03-14T06:33:48.8535263Z  2025-03-14T06:33:48.8535714Z  2025-03-14T06:33:48.8536098Z  2025-03-14T06:33:48.8537085Z [17,289 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:48.8538233Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2025-03-14T06:33:48.8539122Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2025-03-14T06:33:48.8540054Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 18s local 2025-03-14T06:33:48.8541103Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2025-03-14T06:33:48.8542139Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T06:33:48.8542931Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T06:33:48.8544014Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2025-03-14T06:33:48.8545103Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local ... 2025-03-14T06:33:49.0758270Z 2025-03-14T06:33:49.0759624Z  2025-03-14T06:33:49.0760143Z  2025-03-14T06:33:49.0760572Z  2025-03-14T06:33:49.0761006Z  2025-03-14T06:33:49.0761430Z  2025-03-14T06:33:49.0761866Z  2025-03-14T06:33:49.0762280Z  2025-03-14T06:33:49.0762707Z  2025-03-14T06:33:49.0763629Z [17,290 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:49.0764911Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2025-03-14T06:33:49.0766489Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T06:33:49.0767380Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2025-03-14T06:33:49.0768207Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2025-03-14T06:33:49.0769241Z Compiling xla/service/sharding_propagation.cc; 16s local 2025-03-14T06:33:49.0770052Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T06:33:49.0770928Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 15s local 2025-03-14T06:33:49.0771967Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local ... 2025-03-14T06:33:49.3223228Z 2025-03-14T06:33:49.3224440Z  2025-03-14T06:33:49.3224886Z  2025-03-14T06:33:49.3225258Z  2025-03-14T06:33:49.3225630Z  2025-03-14T06:33:49.3225984Z  2025-03-14T06:33:49.3226375Z  2025-03-14T06:33:49.3226734Z  2025-03-14T06:33:49.3227101Z  2025-03-14T06:33:49.3227957Z [17,290 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:49.3229058Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2025-03-14T06:33:49.3229982Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T06:33:49.3230889Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2025-03-14T06:33:49.3231786Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2025-03-14T06:33:49.3232652Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T06:33:49.3233380Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T06:33:49.3234090Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2025-03-14T06:33:49.3235019Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local ... 2025-03-14T06:33:49.7228338Z 2025-03-14T06:33:49.7229576Z  2025-03-14T06:33:49.7230102Z  2025-03-14T06:33:49.7230520Z  2025-03-14T06:33:49.7230934Z  2025-03-14T06:33:49.7231385Z  2025-03-14T06:33:49.7231792Z  2025-03-14T06:33:49.7232170Z  2025-03-14T06:33:49.7232563Z  2025-03-14T06:33:49.7233535Z [17,291 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:49.7234787Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2025-03-14T06:33:49.7235831Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T06:33:49.7237231Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 19s local 2025-03-14T06:33:49.7238055Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2025-03-14T06:33:49.7239030Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T06:33:49.7239839Z @llvm-project//llvm:InstCombine; 16s local 2025-03-14T06:33:49.7240703Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2025-03-14T06:33:49.7241554Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local ... 2025-03-14T06:33:50.1820983Z 2025-03-14T06:33:50.1822189Z  2025-03-14T06:33:50.1822701Z  2025-03-14T06:33:50.1823125Z  2025-03-14T06:33:50.1823543Z  2025-03-14T06:33:50.1823965Z  2025-03-14T06:33:50.1824687Z  2025-03-14T06:33:50.1825224Z  2025-03-14T06:33:50.1825629Z  2025-03-14T06:33:50.1826526Z [17,292 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:50.1827711Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2025-03-14T06:33:50.1828702Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T06:33:50.1829604Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2025-03-14T06:33:50.1830592Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2025-03-14T06:33:50.1831443Z Compiling xla/service/sharding_propagation.cc; 17s local 2025-03-14T06:33:50.1832210Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T06:33:50.1833253Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 16s local 2025-03-14T06:33:50.1834155Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local ... 2025-03-14T06:33:50.4876871Z 2025-03-14T06:33:50.4877740Z  2025-03-14T06:33:50.4878137Z  2025-03-14T06:33:50.4878503Z  2025-03-14T06:33:50.4878907Z  2025-03-14T06:33:50.4879420Z  2025-03-14T06:33:50.4879900Z  2025-03-14T06:33:50.4880295Z  2025-03-14T06:33:50.4880723Z  2025-03-14T06:33:50.4881888Z [17,294 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:50.4883068Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2025-03-14T06:33:50.4884060Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T06:33:50.4885020Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2025-03-14T06:33:50.4885953Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2025-03-14T06:33:50.4886866Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T06:33:50.4887630Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T06:33:50.4888423Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T06:33:50.4889360Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local ... 2025-03-14T06:33:50.7237903Z 2025-03-14T06:33:50.7238851Z  2025-03-14T06:33:50.7239397Z  2025-03-14T06:33:50.7239807Z  2025-03-14T06:33:50.7240233Z  2025-03-14T06:33:50.7240616Z  2025-03-14T06:33:50.7241056Z  2025-03-14T06:33:50.7241608Z  2025-03-14T06:33:50.7242124Z  2025-03-14T06:33:50.7243088Z [17,294 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:50.7244191Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2025-03-14T06:33:50.7245354Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T06:33:50.7246345Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 20s local 2025-03-14T06:33:50.7247338Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2025-03-14T06:33:50.7248292Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T06:33:50.7249115Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T06:33:50.7249917Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T06:33:50.7251217Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local ... 2025-03-14T06:33:51.2274362Z 2025-03-14T06:33:51.2275604Z  2025-03-14T06:33:51.2276138Z  2025-03-14T06:33:51.2276551Z  2025-03-14T06:33:51.2276965Z  2025-03-14T06:33:51.2277342Z  2025-03-14T06:33:51.2277730Z  2025-03-14T06:33:51.2278086Z  2025-03-14T06:33:51.2278465Z  2025-03-14T06:33:51.2279321Z [17,295 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:51.2280364Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2025-03-14T06:33:51.2281249Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T06:33:51.2282432Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2025-03-14T06:33:51.2283417Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2025-03-14T06:33:51.2284283Z Compiling xla/service/sharding_propagation.cc; 18s local 2025-03-14T06:33:51.2285199Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:33:51.2286017Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 17s local 2025-03-14T06:33:51.2287001Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local ... 2025-03-14T06:33:51.5246489Z 2025-03-14T06:33:51.5247369Z  2025-03-14T06:33:51.5247798Z  2025-03-14T06:33:51.5248169Z  2025-03-14T06:33:51.5248522Z  2025-03-14T06:33:51.5248882Z  2025-03-14T06:33:51.5249514Z  2025-03-14T06:33:51.5249884Z  2025-03-14T06:33:51.5250261Z  2025-03-14T06:33:51.5251155Z [17,295 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:51.5252226Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2025-03-14T06:33:51.5253100Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T06:33:51.5253959Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2025-03-14T06:33:51.5254872Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2025-03-14T06:33:51.5255864Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T06:33:51.5256560Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:33:51.5257294Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2025-03-14T06:33:51.5258176Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local ... 2025-03-14T06:33:51.7350175Z 2025-03-14T06:33:51.7351128Z  2025-03-14T06:33:51.7351603Z  2025-03-14T06:33:51.7351965Z  2025-03-14T06:33:51.7352309Z  2025-03-14T06:33:51.7352631Z  2025-03-14T06:33:51.7352969Z  2025-03-14T06:33:51.7353319Z  2025-03-14T06:33:51.7353651Z  2025-03-14T06:33:51.7354456Z [17,296 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:51.7355449Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2025-03-14T06:33:51.7356266Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T06:33:51.7357080Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 21s local 2025-03-14T06:33:51.7357988Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2025-03-14T06:33:51.7358736Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T06:33:51.7359373Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:33:51.7360046Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2025-03-14T06:33:51.7360882Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local ... 2025-03-14T06:33:52.0029173Z 2025-03-14T06:33:52.0030414Z  2025-03-14T06:33:52.0030941Z  2025-03-14T06:33:52.0031377Z  2025-03-14T06:33:52.0031764Z  2025-03-14T06:33:52.0032147Z  2025-03-14T06:33:52.0032534Z  2025-03-14T06:33:52.0032926Z  2025-03-14T06:33:52.0033317Z  2025-03-14T06:33:52.0034490Z [17,298 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:52.0035570Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T06:33:52.0036553Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2025-03-14T06:33:52.0037615Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2025-03-14T06:33:52.0038462Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T06:33:52.0039119Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T06:33:52.0039898Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2025-03-14T06:33:52.0040834Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2025-03-14T06:33:52.0042110Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local ... 2025-03-14T06:33:52.2320115Z 2025-03-14T06:33:52.2321308Z  2025-03-14T06:33:52.2321827Z  2025-03-14T06:33:52.2322261Z  2025-03-14T06:33:52.2322680Z  2025-03-14T06:33:52.2323097Z  2025-03-14T06:33:52.2323576Z  2025-03-14T06:33:52.2323996Z  2025-03-14T06:33:52.2324425Z  2025-03-14T06:33:52.2325512Z [17,299 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:52.2326584Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T06:33:52.2327598Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2025-03-14T06:33:52.2329054Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2025-03-14T06:33:52.2330025Z Compiling xla/service/sharding_propagation.cc; 19s local 2025-03-14T06:33:52.2330779Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T06:33:52.2331598Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 18s local 2025-03-14T06:33:52.2332846Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T06:33:52.2334143Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local ... 2025-03-14T06:33:52.5336443Z 2025-03-14T06:33:52.5337359Z  2025-03-14T06:33:52.5337990Z  2025-03-14T06:33:52.5338643Z  2025-03-14T06:33:52.5339060Z  2025-03-14T06:33:52.5339470Z  2025-03-14T06:33:52.5339873Z  2025-03-14T06:33:52.5340282Z  2025-03-14T06:33:52.5340682Z  2025-03-14T06:33:52.5341635Z [17,302 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:52.5342687Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T06:33:52.5343703Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2025-03-14T06:33:52.5344699Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2025-03-14T06:33:52.5345633Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T06:33:52.5346390Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T06:33:52.5347143Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T06:33:52.5347990Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T06:33:52.5348862Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local ... 2025-03-14T06:33:52.7341584Z 2025-03-14T06:33:52.7342501Z  2025-03-14T06:33:52.7342938Z  2025-03-14T06:33:52.7343320Z  2025-03-14T06:33:52.7343702Z  2025-03-14T06:33:52.7344112Z  2025-03-14T06:33:52.7344496Z  2025-03-14T06:33:52.7344886Z  2025-03-14T06:33:52.7345322Z  2025-03-14T06:33:52.7346232Z [17,303 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:52.7347203Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T06:33:52.7348179Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 22s local 2025-03-14T06:33:52.7349155Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2025-03-14T06:33:52.7350251Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T06:33:52.7351014Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T06:33:52.7351817Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T06:33:52.7352774Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T06:33:52.7353805Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local ... 2025-03-14T06:33:53.0345989Z 2025-03-14T06:33:53.0346802Z  2025-03-14T06:33:53.0347225Z  2025-03-14T06:33:53.0347606Z  2025-03-14T06:33:53.0347947Z  2025-03-14T06:33:53.0348289Z  2025-03-14T06:33:53.0348632Z  2025-03-14T06:33:53.0348967Z  2025-03-14T06:33:53.0349309Z  2025-03-14T06:33:53.0350417Z [17,306 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:53.0351297Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T06:33:53.0352137Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2025-03-14T06:33:53.0352990Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2025-03-14T06:33:53.0353772Z Compiling xla/service/sharding_propagation.cc; 20s local 2025-03-14T06:33:53.0354550Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 19s local 2025-03-14T06:33:53.0355378Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T06:33:53.0356217Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T06:33:53.0357136Z @llvm-project//mlir:TransformDialect; 17s local ... 2025-03-14T06:33:53.3347059Z 2025-03-14T06:33:53.3347929Z  2025-03-14T06:33:53.3348400Z  2025-03-14T06:33:53.3348796Z  2025-03-14T06:33:53.3349382Z  2025-03-14T06:33:53.3349790Z  2025-03-14T06:33:53.3350188Z  2025-03-14T06:33:53.3350562Z  2025-03-14T06:33:53.3350970Z  2025-03-14T06:33:53.3351937Z [17,306 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:53.3352986Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T06:33:53.3354219Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2025-03-14T06:33:53.3355269Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2025-03-14T06:33:53.3356179Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T06:33:53.3357030Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T06:33:53.3368438Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T06:33:53.3369859Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T06:33:53.3370739Z @llvm-project//mlir:TransformDialect; 17s local ... 2025-03-14T06:33:53.7104034Z 2025-03-14T06:33:53.7104976Z  2025-03-14T06:33:53.7105436Z  2025-03-14T06:33:53.7105825Z  2025-03-14T06:33:53.7106219Z  2025-03-14T06:33:53.7106631Z  2025-03-14T06:33:53.7107056Z  2025-03-14T06:33:53.7107471Z  2025-03-14T06:33:53.7107865Z  2025-03-14T06:33:53.7108820Z [17,307 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:53.7109803Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T06:33:53.7110774Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2025-03-14T06:33:53.7111750Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T06:33:53.7112623Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T06:33:53.7113413Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T06:33:53.7114412Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T06:33:53.7115392Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T06:33:53.7116273Z @llvm-project//mlir:TransformDialect; 17s local ... 2025-03-14T06:33:53.9352870Z 2025-03-14T06:33:53.9354052Z  2025-03-14T06:33:53.9354576Z  2025-03-14T06:33:53.9354982Z  2025-03-14T06:33:53.9355375Z  2025-03-14T06:33:53.9355787Z  2025-03-14T06:33:53.9356165Z  2025-03-14T06:33:53.9356555Z  2025-03-14T06:33:53.9356962Z  2025-03-14T06:33:53.9357818Z [17,307 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:53.9358788Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T06:33:53.9359877Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 23s local 2025-03-14T06:33:53.9360926Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T06:33:53.9361821Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T06:33:53.9363014Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T06:33:53.9364025Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T06:33:53.9365115Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T06:33:53.9366363Z @llvm-project//mlir:TransformDialect; 18s local ... 2025-03-14T06:33:54.2236196Z 2025-03-14T06:33:54.2237069Z  2025-03-14T06:33:54.2237590Z  2025-03-14T06:33:54.2237958Z  2025-03-14T06:33:54.2238399Z  2025-03-14T06:33:54.2238784Z  2025-03-14T06:33:54.2239215Z  2025-03-14T06:33:54.2239612Z  2025-03-14T06:33:54.2240039Z  2025-03-14T06:33:54.2240952Z [17,309 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:54.2242346Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2025-03-14T06:33:54.2243759Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2025-03-14T06:33:54.2245047Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T06:33:54.2246030Z Compiling xla/service/sharding_propagation.cc; 21s local 2025-03-14T06:33:54.2247054Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 20s local 2025-03-14T06:33:54.2248283Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T06:33:54.2249391Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T06:33:54.2250307Z @llvm-project//mlir:TransformDialect; 18s local ... 2025-03-14T06:33:54.5360068Z 2025-03-14T06:33:54.5361025Z  2025-03-14T06:33:54.5361484Z  2025-03-14T06:33:54.5361880Z  2025-03-14T06:33:54.5362267Z  2025-03-14T06:33:54.5362703Z  2025-03-14T06:33:54.5363096Z  2025-03-14T06:33:54.5363487Z  2025-03-14T06:33:54.5363869Z  2025-03-14T06:33:54.5364987Z [17,310 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:54.5366313Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2025-03-14T06:33:54.5367278Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 24s local 2025-03-14T06:33:54.5368272Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T06:33:54.5369205Z Compiling xla/service/sharding_propagation.cc; 22s local 2025-03-14T06:33:54.5370026Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T06:33:54.5370904Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T06:33:54.5371924Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T06:33:54.5372831Z @llvm-project//mlir:TransformDialect; 18s local ... 2025-03-14T06:33:55.1424280Z 2025-03-14T06:33:55.1425241Z  2025-03-14T06:33:55.1425764Z  2025-03-14T06:33:55.1426170Z  2025-03-14T06:33:55.1426596Z  2025-03-14T06:33:55.1427043Z  2025-03-14T06:33:55.1427462Z  2025-03-14T06:33:55.1427872Z  2025-03-14T06:33:55.1428269Z  2025-03-14T06:33:55.1429235Z [17,311 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:55.1430622Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T06:33:55.1431594Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2025-03-14T06:33:55.1432622Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2025-03-14T06:33:55.1433571Z Compiling xla/service/sharding_propagation.cc; 22s local 2025-03-14T06:33:55.1434495Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 21s local 2025-03-14T06:33:55.1435587Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T06:33:55.1436631Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2025-03-14T06:33:55.1437520Z @llvm-project//mlir:TransformDialect; 19s local ... 2025-03-14T06:33:55.5368966Z 2025-03-14T06:33:55.5369772Z  2025-03-14T06:33:55.5370258Z  2025-03-14T06:33:55.5370659Z  2025-03-14T06:33:55.5371076Z  2025-03-14T06:33:55.5371491Z  2025-03-14T06:33:55.5371911Z  2025-03-14T06:33:55.5372424Z  2025-03-14T06:33:55.5372817Z  2025-03-14T06:33:55.5373786Z [17,311 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:55.5374832Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T06:33:55.5375837Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 25s local 2025-03-14T06:33:55.5376859Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2025-03-14T06:33:55.5377790Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T06:33:55.5378998Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T06:33:55.5380005Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T06:33:55.5381065Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2025-03-14T06:33:55.5382012Z @llvm-project//mlir:TransformDialect; 19s local ... 2025-03-14T06:33:55.9624387Z 2025-03-14T06:33:55.9625262Z  2025-03-14T06:33:55.9625785Z  2025-03-14T06:33:55.9626155Z  2025-03-14T06:33:55.9626475Z  2025-03-14T06:33:55.9626793Z  2025-03-14T06:33:55.9627384Z  2025-03-14T06:33:55.9627844Z  2025-03-14T06:33:55.9628389Z  2025-03-14T06:33:55.9629666Z [17,312 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:55.9630681Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T06:33:55.9631613Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2025-03-14T06:33:55.9632683Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T06:33:55.9633582Z Compiling xla/service/sharding_propagation.cc; 23s local 2025-03-14T06:33:55.9634473Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T06:33:55.9635449Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T06:33:55.9636442Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T06:33:55.9637372Z @llvm-project//mlir:TransformDialect; 20s local ... 2025-03-14T06:33:56.2076103Z 2025-03-14T06:33:56.2077018Z  2025-03-14T06:33:56.2077495Z  2025-03-14T06:33:56.2077878Z  2025-03-14T06:33:56.2078287Z  2025-03-14T06:33:56.2078671Z  2025-03-14T06:33:56.2079095Z  2025-03-14T06:33:56.2079485Z  2025-03-14T06:33:56.2079883Z  2025-03-14T06:33:56.2081204Z [17,314 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:56.2082429Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T06:33:56.2083520Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2025-03-14T06:33:56.2084806Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T06:33:56.2086069Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 22s local 2025-03-14T06:33:56.2087431Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T06:33:56.2088648Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T06:33:56.2089960Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2025-03-14T06:33:56.2091137Z Compiling xla/service/hlo_verifier.cc; 19s local ... 2025-03-14T06:33:56.4962486Z 2025-03-14T06:33:56.4963487Z  2025-03-14T06:33:56.4963978Z  2025-03-14T06:33:56.4964400Z  2025-03-14T06:33:56.4965047Z  2025-03-14T06:33:56.4965654Z  2025-03-14T06:33:56.4966224Z  2025-03-14T06:33:56.4966667Z  2025-03-14T06:33:56.4967054Z  2025-03-14T06:33:56.4968026Z [17,319 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:56.4969404Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T06:33:56.4970356Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2025-03-14T06:33:56.4971376Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T06:33:56.4972379Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T06:33:56.4973344Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T06:33:56.4974368Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T06:33:56.4975251Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T06:33:56.4976154Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local ... 2025-03-14T06:33:56.7378042Z 2025-03-14T06:33:56.7378921Z  2025-03-14T06:33:56.7379427Z  2025-03-14T06:33:56.7379838Z  2025-03-14T06:33:56.7380222Z  2025-03-14T06:33:56.7380600Z  2025-03-14T06:33:56.7381035Z  2025-03-14T06:33:56.7381442Z  2025-03-14T06:33:56.7381830Z  2025-03-14T06:33:56.7382589Z [17,320 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:56.7383550Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T06:33:56.7384567Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 26s local 2025-03-14T06:33:56.7386042Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2025-03-14T06:33:56.7387074Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T06:33:56.7387989Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T06:33:56.7388884Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T06:33:56.7389850Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T06:33:56.7390708Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local ... 2025-03-14T06:33:57.1948573Z 2025-03-14T06:33:57.1949780Z  2025-03-14T06:33:57.1950242Z  2025-03-14T06:33:57.1950612Z  2025-03-14T06:33:57.1951006Z  2025-03-14T06:33:57.1951387Z  2025-03-14T06:33:57.1951749Z  2025-03-14T06:33:57.1952143Z  2025-03-14T06:33:57.1952578Z  2025-03-14T06:33:57.1953506Z [17,321 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:57.1954482Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T06:33:57.1955401Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2025-03-14T06:33:57.1956316Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2025-03-14T06:33:57.1957186Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 23s local 2025-03-14T06:33:57.1958155Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T06:33:57.1959125Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T06:33:57.1959976Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T06:33:57.1960872Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local ... 2025-03-14T06:33:57.4488769Z 2025-03-14T06:33:57.4489613Z  2025-03-14T06:33:57.4490085Z  2025-03-14T06:33:57.4490732Z  2025-03-14T06:33:57.4491122Z  2025-03-14T06:33:57.4491454Z  2025-03-14T06:33:57.4491938Z  2025-03-14T06:33:57.4492339Z  2025-03-14T06:33:57.4492735Z  2025-03-14T06:33:57.4493661Z [17,325 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:57.4494689Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T06:33:57.4495691Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2025-03-14T06:33:57.4496744Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2025-03-14T06:33:57.4497734Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T06:33:57.4498891Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T06:33:57.4499902Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T06:33:57.4500906Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T06:33:57.4501774Z @llvm-project//llvm:InstCombine; 18s local ... 2025-03-14T06:33:57.7384169Z 2025-03-14T06:33:57.7384920Z  2025-03-14T06:33:57.7385393Z  2025-03-14T06:33:57.7385762Z  2025-03-14T06:33:57.7386130Z  2025-03-14T06:33:57.7386483Z  2025-03-14T06:33:57.7387050Z  2025-03-14T06:33:57.7387435Z  2025-03-14T06:33:57.7387780Z  2025-03-14T06:33:57.7388591Z [17,327 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:57.7389807Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T06:33:57.7390711Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 27s local 2025-03-14T06:33:57.7391850Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2025-03-14T06:33:57.7392847Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 24s local 2025-03-14T06:33:57.7393840Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T06:33:57.7394978Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T06:33:57.7396134Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T06:33:57.7396976Z @llvm-project//llvm:InstCombine; 18s local ... 2025-03-14T06:33:58.5508095Z 2025-03-14T06:33:58.5509034Z  2025-03-14T06:33:58.5509536Z  2025-03-14T06:33:58.5509960Z  2025-03-14T06:33:58.5510479Z  2025-03-14T06:33:58.5510965Z  2025-03-14T06:33:58.5511357Z  2025-03-14T06:33:58.5511745Z  2025-03-14T06:33:58.5512128Z  2025-03-14T06:33:58.5513046Z [17,328 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:58.5514079Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2025-03-14T06:33:58.5515011Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2025-03-14T06:33:58.5516009Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2025-03-14T06:33:58.5516930Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T06:33:58.5517855Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T06:33:58.5518799Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T06:33:58.5519752Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2025-03-14T06:33:58.5520552Z @llvm-project//llvm:InstCombine; 19s local ... 2025-03-14T06:33:58.9393962Z 2025-03-14T06:33:58.9394804Z  2025-03-14T06:33:58.9395286Z  2025-03-14T06:33:58.9395744Z  2025-03-14T06:33:58.9396135Z  2025-03-14T06:33:58.9396518Z  2025-03-14T06:33:58.9396911Z  2025-03-14T06:33:58.9397321Z  2025-03-14T06:33:58.9397697Z  2025-03-14T06:33:58.9398748Z [17,328 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:58.9400050Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2025-03-14T06:33:58.9401014Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 28s local 2025-03-14T06:33:58.9402011Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T06:33:58.9403000Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T06:33:58.9404001Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T06:33:58.9405171Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2025-03-14T06:33:58.9406203Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T06:33:58.9407092Z @llvm-project//llvm:InstCombine; 19s local ... 2025-03-14T06:33:59.1768511Z 2025-03-14T06:33:59.1769337Z  2025-03-14T06:33:59.1770141Z  2025-03-14T06:33:59.1770537Z  2025-03-14T06:33:59.1770929Z  2025-03-14T06:33:59.1771328Z  2025-03-14T06:33:59.1771713Z  2025-03-14T06:33:59.1772096Z  2025-03-14T06:33:59.1772484Z  2025-03-14T06:33:59.1773453Z [17,330 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:33:59.1774505Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2025-03-14T06:33:59.1775500Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2025-03-14T06:33:59.1776493Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T06:33:59.1777472Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 25s local 2025-03-14T06:33:59.1778703Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T06:33:59.1779655Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T06:33:59.1780484Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T06:33:59.1781371Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 18s local ... 2025-03-14T06:33:59.5399931Z 2025-03-14T06:33:59.5400787Z  2025-03-14T06:33:59.5401255Z  2025-03-14T06:33:59.5401665Z  2025-03-14T06:33:59.5402133Z  2025-03-14T06:33:59.5402548Z  2025-03-14T06:33:59.5402941Z  2025-03-14T06:33:59.5403326Z  2025-03-14T06:33:59.5403954Z  2025-03-14T06:33:59.5405105Z [17,333 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:59.5406131Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2025-03-14T06:33:59.5407079Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2025-03-14T06:33:59.5408126Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T06:33:59.5409106Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T06:33:59.5410069Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T06:33:59.5411076Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T06:33:59.5412010Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2025-03-14T06:33:59.5413013Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local ... 2025-03-14T06:33:59.7403885Z 2025-03-14T06:33:59.7404923Z  2025-03-14T06:33:59.7405497Z  2025-03-14T06:33:59.7407067Z  2025-03-14T06:33:59.7407547Z  2025-03-14T06:33:59.7407926Z  2025-03-14T06:33:59.7408375Z  2025-03-14T06:33:59.7408784Z  2025-03-14T06:33:59.7409199Z  2025-03-14T06:33:59.7410178Z [17,336 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:33:59.7411235Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2025-03-14T06:33:59.7412309Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 29s local 2025-03-14T06:33:59.7413299Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T06:33:59.7414226Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T06:33:59.7415175Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T06:33:59.7416428Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T06:33:59.7417453Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2025-03-14T06:33:59.7418523Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local ... 2025-03-14T06:34:00.0107613Z 2025-03-14T06:34:00.0108421Z  2025-03-14T06:34:00.0108921Z  2025-03-14T06:34:00.0109286Z  2025-03-14T06:34:00.0109656Z  2025-03-14T06:34:00.0110066Z  2025-03-14T06:34:00.0110460Z  2025-03-14T06:34:00.0110823Z  2025-03-14T06:34:00.0111218Z  2025-03-14T06:34:00.0112161Z [17,337 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:00.0113487Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2025-03-14T06:34:00.0114464Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2025-03-14T06:34:00.0115466Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T06:34:00.0116371Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T06:34:00.0117317Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T06:34:00.0118284Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2025-03-14T06:34:00.0119218Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2025-03-14T06:34:00.0120093Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local ... 2025-03-14T06:34:00.2122933Z 2025-03-14T06:34:00.2123792Z  2025-03-14T06:34:00.2124358Z  2025-03-14T06:34:00.2124929Z  2025-03-14T06:34:00.2125399Z  2025-03-14T06:34:00.2125862Z  2025-03-14T06:34:00.2126361Z  2025-03-14T06:34:00.2126826Z  2025-03-14T06:34:00.2127289Z  2025-03-14T06:34:00.2128376Z [17,338 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:00.2129621Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2025-03-14T06:34:00.2130790Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2025-03-14T06:34:00.2132133Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T06:34:00.2133156Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 26s local 2025-03-14T06:34:00.2134296Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T06:34:00.2135478Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 19s local 2025-03-14T06:34:00.2136647Z Compiling xla/service/cpu/in_process_collectives.cc; 16s local 2025-03-14T06:34:00.2137802Z Compiling xla/service/conditional_simplifier.cc; 15s local ... 2025-03-14T06:34:00.5411953Z 2025-03-14T06:34:00.5412846Z  2025-03-14T06:34:00.5413338Z  2025-03-14T06:34:00.5413766Z  2025-03-14T06:34:00.5414165Z  2025-03-14T06:34:00.5414562Z  2025-03-14T06:34:00.5414953Z  2025-03-14T06:34:00.5415373Z  2025-03-14T06:34:00.5415804Z  2025-03-14T06:34:00.5416742Z [17,338 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:00.5417769Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2025-03-14T06:34:00.5418860Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2025-03-14T06:34:00.5419914Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T06:34:00.5420828Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T06:34:00.5421897Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T06:34:00.5422914Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2025-03-14T06:34:00.5423910Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T06:34:00.5424874Z Compiling xla/service/conditional_simplifier.cc; 15s local ... 2025-03-14T06:34:00.8319880Z 2025-03-14T06:34:00.8320777Z  2025-03-14T06:34:00.8321570Z  2025-03-14T06:34:00.8321973Z  2025-03-14T06:34:00.8322341Z  2025-03-14T06:34:00.8322740Z  2025-03-14T06:34:00.8323140Z  2025-03-14T06:34:00.8323665Z  2025-03-14T06:34:00.8324129Z  2025-03-14T06:34:00.8325173Z [17,341 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:00.8326232Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2025-03-14T06:34:00.8327156Z Compiling mlir/lib/Dialect/Transform/IR/TransformOps.cpp; 30s local 2025-03-14T06:34:00.8328155Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T06:34:00.8329208Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T06:34:00.8330434Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T06:34:00.8331443Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2025-03-14T06:34:00.8332542Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T06:34:00.8333478Z Compiling xla/service/layout_assignment.cc; 15s local ... 2025-03-14T06:34:01.1417090Z 2025-03-14T06:34:01.1417964Z  2025-03-14T06:34:01.1418431Z  2025-03-14T06:34:01.1418819Z  2025-03-14T06:34:01.1419202Z  2025-03-14T06:34:01.1419712Z  2025-03-14T06:34:01.1420136Z  2025-03-14T06:34:01.1420550Z  2025-03-14T06:34:01.1420944Z  2025-03-14T06:34:01.1421907Z [17,344 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:01.1423348Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T06:34:01.1424285Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T06:34:01.1425242Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 27s local 2025-03-14T06:34:01.1426230Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T06:34:01.1427318Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2025-03-14T06:34:01.1428264Z Compiling xla/service/cpu/in_process_collectives.cc; 17s local 2025-03-14T06:34:01.1429331Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T06:34:01.1430215Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local ... 2025-03-14T06:34:01.3421036Z 2025-03-14T06:34:01.3421914Z  2025-03-14T06:34:01.3422403Z  2025-03-14T06:34:01.3422837Z  2025-03-14T06:34:01.3423284Z  2025-03-14T06:34:01.3423744Z  2025-03-14T06:34:01.3424152Z  2025-03-14T06:34:01.3424575Z  2025-03-14T06:34:01.3425122Z  2025-03-14T06:34:01.3426106Z [17,346 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:01.3427232Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T06:34:01.3428180Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T06:34:01.3429191Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T06:34:01.3430114Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T06:34:01.3431186Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 20s local 2025-03-14T06:34:01.3432155Z Compiling xla/service/layout_assignment.cc; 15s local 2025-03-14T06:34:01.3433150Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2025-03-14T06:34:01.3434367Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local ... 2025-03-14T06:34:01.5663266Z 2025-03-14T06:34:01.5664159Z  2025-03-14T06:34:01.5664668Z  2025-03-14T06:34:01.5665084Z  2025-03-14T06:34:01.5665722Z  2025-03-14T06:34:01.5666095Z  2025-03-14T06:34:01.5666499Z  2025-03-14T06:34:01.5666861Z  2025-03-14T06:34:01.5667230Z  2025-03-14T06:34:01.5668090Z [17,349 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:01.5669279Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T06:34:01.5670163Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T06:34:01.5671038Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T06:34:01.5671954Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T06:34:01.5672898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2025-03-14T06:34:01.5673813Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T06:34:01.5674831Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T06:34:01.5675976Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 13s local ... 2025-03-14T06:34:01.7851933Z 2025-03-14T06:34:01.7852810Z  2025-03-14T06:34:01.7853328Z  2025-03-14T06:34:01.7853707Z  2025-03-14T06:34:01.7854117Z  2025-03-14T06:34:01.7854483Z  2025-03-14T06:34:01.7854898Z  2025-03-14T06:34:01.7855327Z  2025-03-14T06:34:01.7855756Z  2025-03-14T06:34:01.7856735Z [17,352 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:01.7857828Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T06:34:01.7858796Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T06:34:01.7859790Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T06:34:01.7860869Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T06:34:01.7862210Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2025-03-14T06:34:01.7863112Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T06:34:01.7864089Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T06:34:01.7865621Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local ... 2025-03-14T06:34:02.1322899Z 2025-03-14T06:34:02.1323846Z  2025-03-14T06:34:02.1324345Z  2025-03-14T06:34:02.1324881Z  2025-03-14T06:34:02.1325294Z  2025-03-14T06:34:02.1326076Z  2025-03-14T06:34:02.1326533Z  2025-03-14T06:34:02.1326924Z  2025-03-14T06:34:02.1327308Z  2025-03-14T06:34:02.1328235Z [17,353 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:02.1329304Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T06:34:02.1330256Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T06:34:02.1331224Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 28s local 2025-03-14T06:34:02.1332223Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T06:34:02.1333276Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2025-03-14T06:34:02.1334201Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T06:34:02.1335170Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T06:34:02.1336322Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local ... 2025-03-14T06:34:02.3429693Z 2025-03-14T06:34:02.3430618Z  2025-03-14T06:34:02.3431105Z  2025-03-14T06:34:02.3431530Z  2025-03-14T06:34:02.3431961Z  2025-03-14T06:34:02.3432388Z  2025-03-14T06:34:02.3432822Z  2025-03-14T06:34:02.3433238Z  2025-03-14T06:34:02.3433654Z  2025-03-14T06:34:02.3434596Z [17,355 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:02.3435726Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T06:34:02.3436691Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T06:34:02.3437672Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T06:34:02.3438667Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T06:34:02.3439955Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 21s local 2025-03-14T06:34:02.3440850Z Compiling xla/service/layout_assignment.cc; 16s local 2025-03-14T06:34:02.3441798Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T06:34:02.3443000Z Compiling mlir/lib/Conversion/LLVMCommon/TypeConverter.cpp; 14s local ... 2025-03-14T06:34:02.5433275Z 2025-03-14T06:34:02.5434164Z  2025-03-14T06:34:02.5434646Z  2025-03-14T06:34:02.5435059Z  2025-03-14T06:34:02.5435496Z  2025-03-14T06:34:02.5435901Z  2025-03-14T06:34:02.5436298Z  2025-03-14T06:34:02.5436703Z  2025-03-14T06:34:02.5437117Z  2025-03-14T06:34:02.5438059Z [17,356 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:02.5439365Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T06:34:02.5440313Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T06:34:02.5441303Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T06:34:02.5442293Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T06:34:02.5443345Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2025-03-14T06:34:02.5444290Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T06:34:02.5445434Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T06:34:02.5446544Z Compiling xla/service/conditional_simplifier.cc; 13s local ... 2025-03-14T06:34:02.9438520Z 2025-03-14T06:34:02.9439443Z  2025-03-14T06:34:02.9439988Z  2025-03-14T06:34:02.9440421Z  2025-03-14T06:34:02.9440888Z  2025-03-14T06:34:02.9441307Z  2025-03-14T06:34:02.9441718Z  2025-03-14T06:34:02.9442179Z  2025-03-14T06:34:02.9442556Z  2025-03-14T06:34:02.9443502Z [17,357 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:02.9444741Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T06:34:02.9445926Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T06:34:02.9447546Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T06:34:02.9448511Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T06:34:02.9449520Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2025-03-14T06:34:02.9450470Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T06:34:02.9451373Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T06:34:02.9452411Z Compiling xla/service/conditional_simplifier.cc; 13s local ... 2025-03-14T06:34:03.1442587Z 2025-03-14T06:34:03.1444039Z  2025-03-14T06:34:03.1444660Z  2025-03-14T06:34:03.1445077Z  2025-03-14T06:34:03.1445456Z  2025-03-14T06:34:03.1445870Z  2025-03-14T06:34:03.1446310Z  2025-03-14T06:34:03.1446735Z  2025-03-14T06:34:03.1447146Z  2025-03-14T06:34:03.1448112Z [17,358 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:03.1449216Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T06:34:03.1450205Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T06:34:03.1451215Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 29s local 2025-03-14T06:34:03.1452364Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2025-03-14T06:34:03.1453308Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T06:34:03.1454145Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T06:34:03.1455164Z Compiling xla/service/conditional_simplifier.cc; 14s local 2025-03-14T06:34:03.3592576Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local ... 2025-03-14T06:34:03.3593543Z 2025-03-14T06:34:03.3594010Z  2025-03-14T06:34:03.3594446Z  2025-03-14T06:34:03.3594863Z  2025-03-14T06:34:03.3595439Z  2025-03-14T06:34:03.3595835Z  2025-03-14T06:34:03.3596190Z  2025-03-14T06:34:03.3596570Z  2025-03-14T06:34:03.3596953Z  2025-03-14T06:34:03.3597825Z [17,361 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:03.3598875Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T06:34:03.3599813Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T06:34:03.3600807Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T06:34:03.3601851Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 22s local 2025-03-14T06:34:03.3602692Z Compiling xla/service/layout_assignment.cc; 17s local 2025-03-14T06:34:03.3603567Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T06:34:03.3604874Z Compiling xla/service/conditional_simplifier.cc; 14s local 2025-03-14T06:34:03.3605920Z Compiling xla/service/memory_space_assignment/slice.cc; 12s local ... 2025-03-14T06:34:03.7448637Z 2025-03-14T06:34:03.7449493Z  2025-03-14T06:34:03.7449989Z  2025-03-14T06:34:03.7450371Z  2025-03-14T06:34:03.7450755Z  2025-03-14T06:34:03.7451146Z  2025-03-14T06:34:03.7451532Z  2025-03-14T06:34:03.7451953Z  2025-03-14T06:34:03.7452360Z  2025-03-14T06:34:03.7453580Z [17,362 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:03.7454610Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T06:34:03.7455547Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T06:34:03.7456485Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T06:34:03.7457499Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2025-03-14T06:34:03.7458538Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T06:34:03.7459726Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2025-03-14T06:34:03.7460793Z Compiling xla/service/conditional_simplifier.cc; 14s local 2025-03-14T06:34:03.7461782Z Compiling xla/service/memory_space_assignment/slice.cc; 13s local ... 2025-03-14T06:34:03.9452848Z 2025-03-14T06:34:03.9453690Z  2025-03-14T06:34:03.9454154Z  2025-03-14T06:34:03.9454560Z  2025-03-14T06:34:03.9454991Z  2025-03-14T06:34:03.9455407Z  2025-03-14T06:34:03.9455788Z  2025-03-14T06:34:03.9456171Z  2025-03-14T06:34:03.9456582Z  2025-03-14T06:34:03.9457535Z [17,364 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:03.9458534Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T06:34:03.9459467Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T06:34:03.9460628Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 30s local 2025-03-14T06:34:03.9461583Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2025-03-14T06:34:03.9462590Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T06:34:03.9463582Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2025-03-14T06:34:03.9464614Z Compiling xla/service/conditional_simplifier.cc; 14s local 2025-03-14T06:34:03.9465720Z @llvm-project//mlir:TransformDialect; 12s local ... 2025-03-14T06:34:04.2854383Z 2025-03-14T06:34:04.2855232Z  2025-03-14T06:34:04.2855637Z  2025-03-14T06:34:04.2855962Z  2025-03-14T06:34:04.2856294Z  2025-03-14T06:34:04.2856667Z  2025-03-14T06:34:04.2856983Z  2025-03-14T06:34:04.2857303Z  2025-03-14T06:34:04.2857613Z  2025-03-14T06:34:04.2858612Z [17,366 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:04.2859457Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2025-03-14T06:34:04.2860181Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T06:34:04.2860939Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T06:34:04.2861726Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 23s local 2025-03-14T06:34:04.2862453Z Compiling xla/service/layout_assignment.cc; 18s local 2025-03-14T06:34:04.2863138Z Compiling xla/service/conditional_simplifier.cc; 15s local 2025-03-14T06:34:04.2863986Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 12s local 2025-03-14T06:34:04.2864787Z @llvm-project//mlir:ControlFlowToLLVM; 11s local ... 2025-03-14T06:34:04.5459106Z 2025-03-14T06:34:04.5459973Z  2025-03-14T06:34:04.5460498Z  2025-03-14T06:34:04.5460989Z  2025-03-14T06:34:04.5461470Z  2025-03-14T06:34:04.5461914Z  2025-03-14T06:34:04.5462384Z  2025-03-14T06:34:04.5462854Z  2025-03-14T06:34:04.5463335Z  2025-03-14T06:34:04.5464318Z [17,368 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:04.5465649Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2025-03-14T06:34:04.5466531Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T06:34:04.5467455Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T06:34:04.5468352Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T06:34:04.5469688Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T06:34:04.5470576Z Compiling xla/service/conditional_simplifier.cc; 15s local 2025-03-14T06:34:04.5471646Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 12s local 2025-03-14T06:34:04.5472609Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2025-03-14T06:34:04.7463026Z 2025-03-14T06:34:04.7463907Z  2025-03-14T06:34:04.7464417Z  2025-03-14T06:34:04.7464825Z  2025-03-14T06:34:04.7465241Z  2025-03-14T06:34:04.7465871Z  2025-03-14T06:34:04.7466529Z  2025-03-14T06:34:04.7467018Z  2025-03-14T06:34:04.7467536Z  2025-03-14T06:34:04.7468512Z [17,369 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:04.7469561Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2025-03-14T06:34:04.7470450Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T06:34:04.7471379Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T06:34:04.7472339Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T06:34:04.7473336Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T06:34:04.7474166Z Compiling xla/service/conditional_simplifier.cc; 15s local 2025-03-14T06:34:04.7475287Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 12s local 2025-03-14T06:34:04.7476294Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2025-03-14T06:34:05.0915151Z 2025-03-14T06:34:05.0916035Z  2025-03-14T06:34:05.0916529Z  2025-03-14T06:34:05.0916919Z  2025-03-14T06:34:05.0917379Z  2025-03-14T06:34:05.0917879Z  2025-03-14T06:34:05.0918265Z  2025-03-14T06:34:05.0918726Z  2025-03-14T06:34:05.0919128Z  2025-03-14T06:34:05.0920020Z [17,371 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:05.0921038Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T06:34:05.0921955Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T06:34:05.0922906Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 31s local 2025-03-14T06:34:05.0923994Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T06:34:05.0925423Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T06:34:05.0926336Z Compiling xla/service/conditional_simplifier.cc; 16s local 2025-03-14T06:34:05.0927439Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2025-03-14T06:34:05.0928445Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2025-03-14T06:34:05.2983473Z 2025-03-14T06:34:05.2984303Z  2025-03-14T06:34:05.2984728Z  2025-03-14T06:34:05.2985070Z  2025-03-14T06:34:05.2985434Z  2025-03-14T06:34:05.2985806Z  2025-03-14T06:34:05.2986184Z  2025-03-14T06:34:05.2986525Z  2025-03-14T06:34:05.2986872Z  2025-03-14T06:34:05.2987667Z [17,375 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:05.2988837Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T06:34:05.2989603Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T06:34:05.2990416Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T06:34:05.2991237Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T06:34:05.2992008Z Compiling xla/service/layout_assignment.cc; 19s local 2025-03-14T06:34:05.2992732Z Compiling xla/service/conditional_simplifier.cc; 16s local 2025-03-14T06:34:05.2993610Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2025-03-14T06:34:05.2994448Z @llvm-project//mlir:ControlFlowToLLVM; 12s local ... 2025-03-14T06:34:05.5469429Z 2025-03-14T06:34:05.5471616Z  2025-03-14T06:34:05.5473347Z  2025-03-14T06:34:05.5474881Z  2025-03-14T06:34:05.5476373Z  2025-03-14T06:34:05.5477843Z  2025-03-14T06:34:05.5479324Z  2025-03-14T06:34:05.5480932Z  2025-03-14T06:34:05.5482483Z  2025-03-14T06:34:05.5484691Z [17,375 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:05.5486932Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T06:34:05.5488994Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T06:34:05.5491234Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T06:34:05.5493396Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T06:34:05.5495463Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T06:34:05.5497414Z Compiling xla/service/conditional_simplifier.cc; 16s local 2025-03-14T06:34:05.5499694Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 13s local 2025-03-14T06:34:05.5501811Z @llvm-project//mlir:ControlFlowToLLVM; 13s local ... 2025-03-14T06:34:05.9165937Z 2025-03-14T06:34:05.9168099Z  2025-03-14T06:34:05.9169752Z  2025-03-14T06:34:05.9170912Z  2025-03-14T06:34:05.9171374Z  2025-03-14T06:34:05.9171806Z  2025-03-14T06:34:05.9172206Z  2025-03-14T06:34:05.9172625Z  2025-03-14T06:34:05.9173045Z  2025-03-14T06:34:05.9174042Z [17,376 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:05.9175227Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T06:34:05.9176130Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T06:34:05.9177050Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T06:34:05.9178033Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T06:34:05.9178985Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T06:34:05.9179943Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2025-03-14T06:34:05.9180948Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2025-03-14T06:34:05.9181916Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local ... 2025-03-14T06:34:06.1475531Z 2025-03-14T06:34:06.1476486Z  2025-03-14T06:34:06.1476952Z  2025-03-14T06:34:06.1477648Z  2025-03-14T06:34:06.1478053Z  2025-03-14T06:34:06.1478409Z  2025-03-14T06:34:06.1478767Z  2025-03-14T06:34:06.1479147Z  2025-03-14T06:34:06.1479497Z  2025-03-14T06:34:06.1480396Z [17,376 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:06.1481524Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T06:34:06.1482383Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T06:34:06.1483293Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 32s local 2025-03-14T06:34:06.1484240Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T06:34:06.1485250Z Compiling xla/service/layout_assignment.cc; 20s local 2025-03-14T06:34:06.1486389Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2025-03-14T06:34:06.1487763Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2025-03-14T06:34:06.1488830Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local ... 2025-03-14T06:34:06.4363254Z 2025-03-14T06:34:06.4364143Z  2025-03-14T06:34:06.4364788Z  2025-03-14T06:34:06.4365199Z  2025-03-14T06:34:06.4365823Z  2025-03-14T06:34:06.4366210Z  2025-03-14T06:34:06.4366596Z  2025-03-14T06:34:06.4366994Z  2025-03-14T06:34:06.4367399Z  2025-03-14T06:34:06.4368341Z [17,377 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:06.4369690Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T06:34:06.4370631Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T06:34:06.4371611Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T06:34:06.4372630Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T06:34:06.4373570Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T06:34:06.4384953Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2025-03-14T06:34:06.4385910Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2025-03-14T06:34:06.4387083Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local ... 2025-03-14T06:34:06.7482184Z 2025-03-14T06:34:06.7483081Z  2025-03-14T06:34:06.7483584Z  2025-03-14T06:34:06.7485918Z  2025-03-14T06:34:06.7489067Z  2025-03-14T06:34:06.7492118Z  2025-03-14T06:34:06.7495217Z  2025-03-14T06:34:06.7498285Z  2025-03-14T06:34:06.7501319Z  2025-03-14T06:34:06.7504905Z [17,377 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:06.7508708Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T06:34:06.7512148Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2025-03-14T06:34:06.7515616Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T06:34:06.7519098Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T06:34:06.7520482Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T06:34:06.7521768Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 14s local 2025-03-14T06:34:06.7523008Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2025-03-14T06:34:06.7524192Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local ... 2025-03-14T06:34:06.9720278Z 2025-03-14T06:34:06.9721655Z  2025-03-14T06:34:06.9722434Z  2025-03-14T06:34:06.9723628Z  2025-03-14T06:34:06.9724123Z  2025-03-14T06:34:06.9724730Z  2025-03-14T06:34:06.9725197Z  2025-03-14T06:34:06.9725641Z  2025-03-14T06:34:06.9726099Z  2025-03-14T06:34:06.9727128Z [17,379 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:34:06.9728425Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T06:34:06.9729708Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2025-03-14T06:34:06.9730626Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 33s local 2025-03-14T06:34:06.9731593Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T06:34:06.9732730Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T06:34:06.9733948Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2025-03-14T06:34:06.9735201Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2025-03-14T06:34:06.9736375Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local ... 2025-03-14T06:34:07.3486737Z 2025-03-14T06:34:07.3487609Z  2025-03-14T06:34:07.3488417Z  2025-03-14T06:34:07.3488842Z  2025-03-14T06:34:07.3489243Z  2025-03-14T06:34:07.3489622Z  2025-03-14T06:34:07.3490011Z  2025-03-14T06:34:07.3490419Z  2025-03-14T06:34:07.3490831Z  2025-03-14T06:34:07.3491794Z [17,379 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:07.3492865Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2025-03-14T06:34:07.3493786Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2025-03-14T06:34:07.3495260Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T06:34:07.3496407Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T06:34:07.3497468Z Compiling xla/service/layout_assignment.cc; 21s local 2025-03-14T06:34:07.3498858Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2025-03-14T06:34:07.3499999Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2025-03-14T06:34:07.3501085Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local ... 2025-03-14T06:34:07.6787115Z 2025-03-14T06:34:07.6788110Z  2025-03-14T06:34:07.6788605Z  2025-03-14T06:34:07.6789008Z  2025-03-14T06:34:07.6789472Z  2025-03-14T06:34:07.6789861Z  2025-03-14T06:34:07.6790255Z  2025-03-14T06:34:07.6790640Z  2025-03-14T06:34:07.6791044Z  2025-03-14T06:34:07.6792273Z [17,380 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:07.6793411Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T06:34:07.6794378Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T06:34:07.6795375Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T06:34:07.6796337Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T06:34:07.6797349Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 15s local 2025-03-14T06:34:07.6798340Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2025-03-14T06:34:07.6799220Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T06:34:07.6800181Z @llvm-project//mlir:LLVMCommonConversion; 11s local ... 2025-03-14T06:34:07.9492669Z 2025-03-14T06:34:07.9493566Z  2025-03-14T06:34:07.9494050Z  2025-03-14T06:34:07.9494445Z  2025-03-14T06:34:07.9494989Z  2025-03-14T06:34:07.9495397Z  2025-03-14T06:34:07.9495785Z  2025-03-14T06:34:07.9496285Z  2025-03-14T06:34:07.9496781Z  2025-03-14T06:34:07.9497884Z [17,380 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:07.9499009Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T06:34:07.9499999Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T06:34:07.9500990Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T06:34:07.9501956Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T06:34:07.9502917Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2025-03-14T06:34:07.9504147Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2025-03-14T06:34:07.9505026Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T06:34:07.9505968Z @llvm-project//mlir:LLVMCommonConversion; 11s local ... 2025-03-14T06:34:08.2188212Z 2025-03-14T06:34:08.2189040Z  2025-03-14T06:34:08.2189537Z  2025-03-14T06:34:08.2189941Z  2025-03-14T06:34:08.2190347Z  2025-03-14T06:34:08.2190748Z  2025-03-14T06:34:08.2191153Z  2025-03-14T06:34:08.2191515Z  2025-03-14T06:34:08.2191939Z  2025-03-14T06:34:08.2192856Z [17,384 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:08.2193934Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T06:34:08.2195123Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 34s local 2025-03-14T06:34:08.2196491Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T06:34:08.2197466Z Compiling xla/service/layout_assignment.cc; 22s local 2025-03-14T06:34:08.2198558Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2025-03-14T06:34:08.2199655Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T06:34:08.2200893Z Compiling mlir/lib/Conversion/LLVMCommon/ConversionTarget.cpp; 12s local 2025-03-14T06:34:08.2202193Z Compiling xla/service/hlo_verifier.cc; 11s local ... 2025-03-14T06:34:08.4602888Z 2025-03-14T06:34:08.4603861Z  2025-03-14T06:34:08.4604392Z  2025-03-14T06:34:08.4605291Z  2025-03-14T06:34:08.4605710Z  2025-03-14T06:34:08.4606140Z  2025-03-14T06:34:08.4606561Z  2025-03-14T06:34:08.4606988Z  2025-03-14T06:34:08.4607417Z  2025-03-14T06:34:08.4608379Z [17,386 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:08.4609450Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T06:34:08.4610424Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2025-03-14T06:34:08.4611399Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T06:34:08.4612553Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T06:34:08.4613554Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2025-03-14T06:34:08.4614785Z Compiling mlir/lib/Conversion/LLVMCommon/ConversionTarget.cpp; 12s local 2025-03-14T06:34:08.4615775Z Compiling xla/service/hlo_verifier.cc; 12s local 2025-03-14T06:34:08.4616604Z Compiling xla/service/scatter_expander.cc; 12s local ... 2025-03-14T06:34:08.7499207Z 2025-03-14T06:34:08.7500090Z  2025-03-14T06:34:08.7500574Z  2025-03-14T06:34:08.7501029Z  2025-03-14T06:34:08.7501429Z  2025-03-14T06:34:08.7501812Z  2025-03-14T06:34:08.7502256Z  2025-03-14T06:34:08.7502662Z  2025-03-14T06:34:08.7503072Z  2025-03-14T06:34:08.7504099Z [17,387 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:08.7505266Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T06:34:08.7506257Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2025-03-14T06:34:08.7507224Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T06:34:08.7508120Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T06:34:08.7509133Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 16s local 2025-03-14T06:34:08.7510216Z Compiling xla/service/hlo_verifier.cc; 12s local 2025-03-14T06:34:08.7510991Z Compiling xla/service/scatter_expander.cc; 12s local 2025-03-14T06:34:08.7511755Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2025-03-14T06:34:09.0766619Z 2025-03-14T06:34:09.0767631Z  2025-03-14T06:34:09.0768074Z  2025-03-14T06:34:09.0768519Z  2025-03-14T06:34:09.0768926Z  2025-03-14T06:34:09.0769317Z  2025-03-14T06:34:09.0769945Z  2025-03-14T06:34:09.0770355Z  2025-03-14T06:34:09.0770724Z  2025-03-14T06:34:09.0771877Z [17,388 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:09.0773031Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T06:34:09.0773961Z Compiling mlir/lib/Dialect/Affine/IR/AffineOps.cpp; 35s local 2025-03-14T06:34:09.0774995Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T06:34:09.0775928Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T06:34:09.0776960Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2025-03-14T06:34:09.0778143Z Compiling xla/service/hlo_verifier.cc; 12s local 2025-03-14T06:34:09.0779041Z Compiling xla/service/scatter_expander.cc; 12s local 2025-03-14T06:34:09.0779799Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2025-03-14T06:34:09.3504846Z 2025-03-14T06:34:09.3506048Z  2025-03-14T06:34:09.3506497Z  2025-03-14T06:34:09.3506860Z  2025-03-14T06:34:09.3507227Z  2025-03-14T06:34:09.3507642Z  2025-03-14T06:34:09.3507998Z  2025-03-14T06:34:09.3508335Z  2025-03-14T06:34:09.3508734Z  2025-03-14T06:34:09.3509598Z [17,390 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:09.3510567Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T06:34:09.3511722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T06:34:09.3512498Z Compiling xla/service/layout_assignment.cc; 23s local 2025-03-14T06:34:09.3513358Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2025-03-14T06:34:09.3514236Z Compiling xla/service/hlo_verifier.cc; 13s local 2025-03-14T06:34:09.3514865Z Compiling xla/service/scatter_expander.cc; 13s local 2025-03-14T06:34:09.3515677Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2025-03-14T06:34:09.3516777Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 11s local ... 2025-03-14T06:34:09.5739498Z 2025-03-14T06:34:09.5740528Z  2025-03-14T06:34:09.5740995Z  2025-03-14T06:34:09.5741395Z  2025-03-14T06:34:09.5741768Z  2025-03-14T06:34:09.5742155Z  2025-03-14T06:34:09.5742548Z  2025-03-14T06:34:09.5742929Z  2025-03-14T06:34:09.5743314Z  2025-03-14T06:34:09.5744209Z [17,391 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:09.5745283Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T06:34:09.5746239Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T06:34:09.5747305Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 17s local 2025-03-14T06:34:09.5748234Z Compiling xla/service/hlo_verifier.cc; 13s local 2025-03-14T06:34:09.5748990Z Compiling xla/service/scatter_expander.cc; 13s local 2025-03-14T06:34:09.5750503Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 12s local 2025-03-14T06:34:09.5751469Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2025-03-14T06:34:09.5752515Z Compiling xla/service/gather_expander.cc; 11s local ... 2025-03-14T06:34:09.9385927Z 2025-03-14T06:34:09.9387811Z  2025-03-14T06:34:09.9388293Z  2025-03-14T06:34:09.9389286Z  2025-03-14T06:34:09.9390906Z  2025-03-14T06:34:09.9392388Z  2025-03-14T06:34:09.9393792Z  2025-03-14T06:34:09.9395434Z  2025-03-14T06:34:09.9396453Z  2025-03-14T06:34:09.9397393Z [17,394 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:09.9398507Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 38s local 2025-03-14T06:34:09.9399363Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T06:34:09.9400557Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2025-03-14T06:34:09.9401435Z Compiling xla/service/hlo_verifier.cc; 13s local 2025-03-14T06:34:09.9402228Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2025-03-14T06:34:09.9403135Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2025-03-14T06:34:09.9403920Z Compiling xla/service/gather_expander.cc; 11s local 2025-03-14T06:34:09.9404763Z @llvm-project//llvm:InstCombine; 10s local ... 2025-03-14T06:34:10.1512882Z 2025-03-14T06:34:10.1513829Z  2025-03-14T06:34:10.1514324Z  2025-03-14T06:34:10.1514768Z  2025-03-14T06:34:10.1515193Z  2025-03-14T06:34:10.1515986Z  2025-03-14T06:34:10.1516407Z  2025-03-14T06:34:10.1516802Z  2025-03-14T06:34:10.1517218Z  2025-03-14T06:34:10.1518562Z [17,396 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:10.1519900Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T06:34:10.1521126Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2025-03-14T06:34:10.1522227Z Compiling xla/service/hlo_verifier.cc; 13s local 2025-03-14T06:34:10.1523242Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2025-03-14T06:34:10.1524441Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 12s local 2025-03-14T06:34:10.1525809Z Compiling xla/service/gather_expander.cc; 11s local 2025-03-14T06:34:10.1526986Z @llvm-project//llvm:InstCombine; 10s local 2025-03-14T06:34:10.1528067Z Compiling xla/service/memory_space_assignment/utils.cc; 10s local ... 2025-03-14T06:34:10.5469497Z 2025-03-14T06:34:10.5470425Z  2025-03-14T06:34:10.5470907Z  2025-03-14T06:34:10.5472778Z  2025-03-14T06:34:10.5473214Z  2025-03-14T06:34:10.5474942Z  2025-03-14T06:34:10.5475364Z  2025-03-14T06:34:10.5477179Z  2025-03-14T06:34:10.5477539Z  2025-03-14T06:34:10.5480259Z [17,399 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:10.5481449Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T06:34:10.5482586Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2025-03-14T06:34:10.5483611Z Compiling xla/service/hlo_verifier.cc; 14s local 2025-03-14T06:34:10.5484754Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 13s local 2025-03-14T06:34:10.5485847Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2025-03-14T06:34:10.5486680Z Compiling xla/service/memory_space_assignment/utils.cc; 10s local 2025-03-14T06:34:10.5487542Z Compiling xla/service/dynamic_padder.cc; 10s local 2025-03-14T06:34:10.5488304Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T06:34:10.7518709Z 2025-03-14T06:34:10.7520580Z  2025-03-14T06:34:10.7522034Z  2025-03-14T06:34:10.7523332Z  2025-03-14T06:34:10.7524678Z  2025-03-14T06:34:10.7525156Z  2025-03-14T06:34:10.7525563Z  2025-03-14T06:34:10.7525990Z  2025-03-14T06:34:10.7526427Z  2025-03-14T06:34:10.7527461Z [17,399 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:10.7528678Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T06:34:10.7529784Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 18s local 2025-03-14T06:34:10.7530818Z Compiling xla/service/hlo_verifier.cc; 14s local 2025-03-14T06:34:10.7531779Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2025-03-14T06:34:10.7532868Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2025-03-14T06:34:10.7533924Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local 2025-03-14T06:34:10.7535091Z Compiling xla/service/dynamic_padder.cc; 10s local 2025-03-14T06:34:10.7535842Z @llvm-project//llvm:InstCombine; 9s local ... 2025-03-14T06:34:11.2033539Z 2025-03-14T06:34:11.2034616Z  2025-03-14T06:34:11.2035205Z  2025-03-14T06:34:11.2035622Z  2025-03-14T06:34:11.2036018Z  2025-03-14T06:34:11.2036404Z  2025-03-14T06:34:11.2036799Z  2025-03-14T06:34:11.2037200Z  2025-03-14T06:34:11.2037614Z  2025-03-14T06:34:11.2038567Z [17,400 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:11.2039739Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T06:34:11.2040891Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2025-03-14T06:34:11.2042179Z Compiling xla/service/hlo_verifier.cc; 14s local 2025-03-14T06:34:11.2043118Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2025-03-14T06:34:11.2044209Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 13s local 2025-03-14T06:34:11.2045355Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local 2025-03-14T06:34:11.2046252Z Compiling xla/service/dynamic_padder.cc; 10s local 2025-03-14T06:34:11.2047033Z @llvm-project//llvm:InstCombine; 10s local ... 2025-03-14T06:34:11.5526130Z 2025-03-14T06:34:11.5527540Z  2025-03-14T06:34:11.5528061Z  2025-03-14T06:34:11.5529619Z  2025-03-14T06:34:11.5530843Z  2025-03-14T06:34:11.5531998Z  2025-03-14T06:34:11.5533504Z  2025-03-14T06:34:11.5534647Z  2025-03-14T06:34:11.5536163Z  2025-03-14T06:34:11.5538009Z [17,400 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:11.5539198Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T06:34:11.5540362Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 19s local 2025-03-14T06:34:11.5541426Z Compiling xla/service/hlo_verifier.cc; 15s local 2025-03-14T06:34:11.5542396Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 14s local 2025-03-14T06:34:11.5543704Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2025-03-14T06:34:11.5544730Z Compiling xla/service/memory_space_assignment/utils.cc; 11s local 2025-03-14T06:34:11.5545673Z Compiling xla/service/dynamic_padder.cc; 11s local 2025-03-14T06:34:11.5546436Z @llvm-project//llvm:InstCombine; 10s local ... 2025-03-14T06:34:11.9498028Z 2025-03-14T06:34:11.9499192Z  2025-03-14T06:34:11.9499791Z  2025-03-14T06:34:11.9500186Z  2025-03-14T06:34:11.9500573Z  2025-03-14T06:34:11.9501004Z  2025-03-14T06:34:11.9501389Z  2025-03-14T06:34:11.9501779Z  2025-03-14T06:34:11.9502157Z  2025-03-14T06:34:11.9503172Z [17,401 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:11.9504294Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T06:34:11.9505304Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2025-03-14T06:34:11.9506214Z Compiling xla/service/hlo_verifier.cc; 15s local 2025-03-14T06:34:11.9507098Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2025-03-14T06:34:11.9508062Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2025-03-14T06:34:11.9509064Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local 2025-03-14T06:34:11.9509953Z Compiling xla/service/dynamic_padder.cc; 11s local 2025-03-14T06:34:11.9510702Z @llvm-project//llvm:InstCombine; 11s local ... 2025-03-14T06:34:12.1531334Z 2025-03-14T06:34:12.1532526Z  2025-03-14T06:34:12.1533042Z  2025-03-14T06:34:12.1533445Z  2025-03-14T06:34:12.1533852Z  2025-03-14T06:34:12.1534256Z  2025-03-14T06:34:12.1534615Z  2025-03-14T06:34:12.1534993Z  2025-03-14T06:34:12.1535336Z  2025-03-14T06:34:12.1536489Z [17,401 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:12.1537543Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T06:34:12.1538606Z Compiling mlir/lib/Dialect/Transform/IR/TransformDialect.cpp; 20s local 2025-03-14T06:34:12.1539507Z Compiling xla/service/hlo_verifier.cc; 15s local 2025-03-14T06:34:12.1540409Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 15s local 2025-03-14T06:34:12.1541457Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 14s local 2025-03-14T06:34:12.1542453Z Compiling xla/service/memory_space_assignment/utils.cc; 12s local 2025-03-14T06:34:12.1543332Z Compiling xla/service/dynamic_padder.cc; 11s local 2025-03-14T06:34:12.1544302Z @llvm-project//llvm:InstCombine; 11s local ... 2025-03-14T06:34:12.6641276Z 2025-03-14T06:34:12.6642729Z  2025-03-14T06:34:12.6643200Z  2025-03-14T06:34:12.6645137Z  2025-03-14T06:34:12.6645655Z  2025-03-14T06:34:12.6646444Z  2025-03-14T06:34:12.6648066Z  2025-03-14T06:34:12.6649602Z  2025-03-14T06:34:12.6651088Z  2025-03-14T06:34:12.6653084Z [17,402 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:12.6655317Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T06:34:12.6657319Z Compiling xla/service/hlo_verifier.cc; 16s local 2025-03-14T06:34:12.6659293Z Compiling .../evaluator/hlo_evaluator_typed_visitor_uint64.cc; 16s local 2025-03-14T06:34:12.6661691Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T06:34:12.6663765Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T06:34:12.6665992Z Compiling xla/service/dynamic_padder.cc; 12s local 2025-03-14T06:34:12.6668000Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 11s local 2025-03-14T06:34:12.6670418Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 11s local ... 2025-03-14T06:34:12.9538103Z 2025-03-14T06:34:12.9540260Z  2025-03-14T06:34:12.9542182Z  2025-03-14T06:34:12.9543820Z  2025-03-14T06:34:12.9545292Z  2025-03-14T06:34:12.9546732Z  2025-03-14T06:34:12.9548193Z  2025-03-14T06:34:12.9549323Z  2025-03-14T06:34:12.9549754Z  2025-03-14T06:34:12.9550638Z [17,403 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:12.9551770Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T06:34:12.9552596Z Compiling xla/service/hlo_verifier.cc; 16s local 2025-03-14T06:34:12.9553416Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T06:34:12.9554372Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T06:34:12.9555263Z Compiling xla/service/dynamic_padder.cc; 12s local 2025-03-14T06:34:12.9556290Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2025-03-14T06:34:12.9557511Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 11s local 2025-03-14T06:34:12.9558497Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local ... 2025-03-14T06:34:13.1543002Z 2025-03-14T06:34:13.1544199Z  2025-03-14T06:34:13.1544639Z  2025-03-14T06:34:13.1545106Z  2025-03-14T06:34:13.1545448Z  2025-03-14T06:34:13.1545796Z  2025-03-14T06:34:13.1546129Z  2025-03-14T06:34:13.1546506Z  2025-03-14T06:34:13.1546835Z  2025-03-14T06:34:13.1547663Z [17,404 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:13.1548650Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T06:34:13.1549423Z Compiling xla/service/hlo_verifier.cc; 16s local 2025-03-14T06:34:13.1550161Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T06:34:13.1551312Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T06:34:13.1552105Z Compiling xla/service/dynamic_padder.cc; 12s local 2025-03-14T06:34:13.1552988Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2025-03-14T06:34:13.1554022Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 11s local 2025-03-14T06:34:13.1554870Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local ... 2025-03-14T06:34:13.3684264Z 2025-03-14T06:34:13.3685442Z  2025-03-14T06:34:13.3685952Z  2025-03-14T06:34:13.3686581Z  2025-03-14T06:34:13.3687020Z  2025-03-14T06:34:13.3687405Z  2025-03-14T06:34:13.3687752Z  2025-03-14T06:34:13.3688116Z  2025-03-14T06:34:13.3688778Z  2025-03-14T06:34:13.3689696Z [17,407 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:13.3690794Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T06:34:13.3692109Z Compiling xla/service/hlo_verifier.cc; 17s local 2025-03-14T06:34:13.3693132Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 15s local 2025-03-14T06:34:13.3694249Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T06:34:13.3695218Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T06:34:13.3696492Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2025-03-14T06:34:13.3697717Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 11s local 2025-03-14T06:34:13.3699052Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local ... 2025-03-14T06:34:13.5762470Z 2025-03-14T06:34:13.5763398Z  2025-03-14T06:34:13.5763920Z  2025-03-14T06:34:13.5765930Z  2025-03-14T06:34:13.5766349Z  2025-03-14T06:34:13.5768080Z  2025-03-14T06:34:13.5768486Z  2025-03-14T06:34:13.5770195Z  2025-03-14T06:34:13.5770598Z  2025-03-14T06:34:13.5772915Z [17,408 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:13.5774352Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T06:34:13.5775250Z Compiling xla/service/hlo_verifier.cc; 17s local 2025-03-14T06:34:13.5776114Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2025-03-14T06:34:13.5777104Z Compiling xla/service/memory_space_assignment/utils.cc; 13s local 2025-03-14T06:34:13.5778008Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T06:34:13.5779018Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 12s local 2025-03-14T06:34:13.5780202Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local 2025-03-14T06:34:13.5781209Z Compiling xla/service/cpu/cpu_runtime.cc; 11s local ... 2025-03-14T06:34:13.9026655Z 2025-03-14T06:34:13.9027623Z  2025-03-14T06:34:13.9028099Z  2025-03-14T06:34:13.9028505Z  2025-03-14T06:34:13.9028911Z  2025-03-14T06:34:13.9029313Z  2025-03-14T06:34:13.9029703Z  2025-03-14T06:34:13.9030108Z  2025-03-14T06:34:13.9030496Z  2025-03-14T06:34:13.9031418Z [17,411 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:13.9032512Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T06:34:13.9033390Z Compiling xla/service/hlo_verifier.cc; 17s local 2025-03-14T06:34:13.9034375Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2025-03-14T06:34:13.9035277Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T06:34:13.9036295Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2025-03-14T06:34:13.9037517Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local 2025-03-14T06:34:13.9038483Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T06:34:14.1553570Z Compiling .../transforms/simplifiers/flatten_call_graph.cc; 11s local ... 2025-03-14T06:34:14.1554362Z 2025-03-14T06:34:14.1554846Z  2025-03-14T06:34:14.1555265Z  2025-03-14T06:34:14.1555691Z  2025-03-14T06:34:14.1556062Z  2025-03-14T06:34:14.1556431Z  2025-03-14T06:34:14.1556828Z  2025-03-14T06:34:14.1557194Z  2025-03-14T06:34:14.1557534Z  2025-03-14T06:34:14.1558392Z [17,411 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:14.1559489Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T06:34:14.1560349Z Compiling xla/service/hlo_verifier.cc; 17s local 2025-03-14T06:34:14.1561231Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2025-03-14T06:34:14.1562285Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T06:34:14.1563258Z Compiling llvm/lib/Transforms/InstCombine/InstCombineSelect.cpp; 13s local 2025-03-14T06:34:14.1564439Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local 2025-03-14T06:34:14.1565979Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T06:34:14.1566962Z Compiling .../transforms/simplifiers/flatten_call_graph.cc; 11s local ... 2025-03-14T06:34:14.3562339Z 2025-03-14T06:34:14.3564920Z  2025-03-14T06:34:14.3567180Z  2025-03-14T06:34:14.3568950Z  2025-03-14T06:34:14.3570768Z  2025-03-14T06:34:14.3572574Z  2025-03-14T06:34:14.3574412Z  2025-03-14T06:34:14.3576549Z  2025-03-14T06:34:14.3578379Z  2025-03-14T06:34:14.3580612Z [17,414 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:14.3583003Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T06:34:14.3585210Z Compiling xla/service/hlo_verifier.cc; 18s local 2025-03-14T06:34:14.3587386Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 16s local 2025-03-14T06:34:14.3589740Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T06:34:14.3592075Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 12s local 2025-03-14T06:34:14.3594640Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T06:34:14.3596967Z Compiling xla/service/heap_simulator/heap_simulator.cc; 11s local 2025-03-14T06:34:14.3599435Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local ... 2025-03-14T06:34:14.7557688Z 2025-03-14T06:34:14.7560017Z  2025-03-14T06:34:14.7561908Z  2025-03-14T06:34:14.7563641Z  2025-03-14T06:34:14.7565773Z  2025-03-14T06:34:14.7567524Z  2025-03-14T06:34:14.7569255Z  2025-03-14T06:34:14.7570988Z  2025-03-14T06:34:14.7572736Z  2025-03-14T06:34:14.7574958Z [17,415 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:14.7577285Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T06:34:14.7579391Z Compiling xla/service/hlo_verifier.cc; 18s local 2025-03-14T06:34:14.7581492Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T06:34:14.7583644Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T06:34:14.7585794Z Compiling mlir/lib/Conversion/LLVMCommon/MemRefBuilder.cpp; 13s local 2025-03-14T06:34:14.7587957Z Compiling xla/service/cpu/cpu_runtime.cc; 12s local 2025-03-14T06:34:14.7590055Z Compiling xla/service/heap_simulator/heap_simulator.cc; 11s local 2025-03-14T06:34:14.7592320Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local ... 2025-03-14T06:34:14.9562645Z 2025-03-14T06:34:14.9565588Z  2025-03-14T06:34:14.9568190Z  2025-03-14T06:34:14.9570537Z  2025-03-14T06:34:14.9572615Z  2025-03-14T06:34:14.9574754Z  2025-03-14T06:34:14.9576898Z  2025-03-14T06:34:14.9579025Z  2025-03-14T06:34:14.9581148Z  2025-03-14T06:34:14.9584051Z [17,416 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:14.9588285Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T06:34:14.9589122Z Compiling xla/service/hlo_verifier.cc; 18s local 2025-03-14T06:34:14.9589925Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 17s local 2025-03-14T06:34:14.9590817Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T06:34:14.9591566Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2025-03-14T06:34:14.9592392Z Compiling xla/service/heap_simulator/heap_simulator.cc; 11s local 2025-03-14T06:34:14.9593348Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 11s local 2025-03-14T06:34:14.9594371Z Compiling xla/service/memory_space_assignment/allocation.cc; 11s local ... 2025-03-14T06:34:15.7775411Z 2025-03-14T06:34:15.7776215Z  2025-03-14T06:34:15.7776680Z  2025-03-14T06:34:15.7777060Z  2025-03-14T06:34:15.7777438Z  2025-03-14T06:34:15.7777825Z  2025-03-14T06:34:15.7778204Z  2025-03-14T06:34:15.7778578Z  2025-03-14T06:34:15.7778934Z  2025-03-14T06:34:15.7779821Z [17,417 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:15.7780879Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T06:34:15.7781701Z Compiling xla/service/hlo_verifier.cc; 19s local 2025-03-14T06:34:15.7782521Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T06:34:15.7783701Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T06:34:15.7784453Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local 2025-03-14T06:34:15.7785315Z Compiling xla/service/heap_simulator/heap_simulator.cc; 12s local 2025-03-14T06:34:15.7786376Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T06:34:15.7787365Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local ... 2025-03-14T06:34:16.1572390Z 2025-03-14T06:34:16.1573234Z  2025-03-14T06:34:16.1573712Z  2025-03-14T06:34:16.1574123Z  2025-03-14T06:34:16.1574857Z  2025-03-14T06:34:16.1575267Z  2025-03-14T06:34:16.1575672Z  2025-03-14T06:34:16.1576084Z  2025-03-14T06:34:16.1576503Z  2025-03-14T06:34:16.1577483Z [17,417 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:16.1578516Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T06:34:16.1579361Z Compiling xla/service/hlo_verifier.cc; 19s local 2025-03-14T06:34:16.1580242Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T06:34:16.1581123Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T06:34:16.1581815Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T06:34:16.1582593Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2025-03-14T06:34:16.1583603Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 12s local 2025-03-14T06:34:16.1584672Z Compiling xla/service/memory_space_assignment/allocation.cc; 12s local ... 2025-03-14T06:34:16.3575965Z 2025-03-14T06:34:16.3576790Z  2025-03-14T06:34:16.3577276Z  2025-03-14T06:34:16.3577700Z  2025-03-14T06:34:16.3578092Z  2025-03-14T06:34:16.3578512Z  2025-03-14T06:34:16.3578900Z  2025-03-14T06:34:16.3579277Z  2025-03-14T06:34:16.3579658Z  2025-03-14T06:34:16.3580632Z [17,418 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:16.3581764Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T06:34:16.3582699Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T06:34:16.3583553Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 18s local 2025-03-14T06:34:16.3584511Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T06:34:16.3585535Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T06:34:16.3586414Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2025-03-14T06:34:16.3587390Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T06:34:16.3588359Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local ... 2025-03-14T06:34:16.5835234Z 2025-03-14T06:34:16.5836053Z  2025-03-14T06:34:16.5836519Z  2025-03-14T06:34:16.5836919Z  2025-03-14T06:34:16.5837339Z  2025-03-14T06:34:16.5837727Z  2025-03-14T06:34:16.5838128Z  2025-03-14T06:34:16.5838490Z  2025-03-14T06:34:16.5838875Z  2025-03-14T06:34:16.5839809Z [17,420 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:16.5841126Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T06:34:16.5841996Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T06:34:16.5842842Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2025-03-14T06:34:16.5843720Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T06:34:16.5844456Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T06:34:16.5845455Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2025-03-14T06:34:16.5846457Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T06:34:16.5847539Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local ... 2025-03-14T06:34:16.8653670Z 2025-03-14T06:34:16.8654518Z  2025-03-14T06:34:16.8655023Z  2025-03-14T06:34:16.8655450Z  2025-03-14T06:34:16.8655834Z  2025-03-14T06:34:16.8656227Z  2025-03-14T06:34:16.8656598Z  2025-03-14T06:34:16.8656968Z  2025-03-14T06:34:16.8657353Z  2025-03-14T06:34:16.8658265Z [17,424 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:16.8659343Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T06:34:16.8660390Z Compiling xla/service/hlo_verifier.cc; 20s local 2025-03-14T06:34:16.8661222Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2025-03-14T06:34:16.8662078Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T06:34:16.8662931Z Compiling xla/service/heap_simulator/heap_simulator.cc; 13s local 2025-03-14T06:34:16.8663884Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T06:34:16.8664932Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2025-03-14T06:34:16.8666354Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local ... 2025-03-14T06:34:17.1583479Z 2025-03-14T06:34:17.1584295Z  2025-03-14T06:34:17.1584815Z  2025-03-14T06:34:17.1585282Z  2025-03-14T06:34:17.1585725Z  2025-03-14T06:34:17.1586106Z  2025-03-14T06:34:17.1586516Z  2025-03-14T06:34:17.1586906Z  2025-03-14T06:34:17.1587290Z  2025-03-14T06:34:17.1588219Z [17,427 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:17.1589320Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T06:34:17.1590242Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 19s local 2025-03-14T06:34:17.1591116Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T06:34:17.1592050Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2025-03-14T06:34:17.1593042Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 13s local 2025-03-14T06:34:17.1594028Z Compiling xla/service/memory_space_assignment/allocation.cc; 13s local 2025-03-14T06:34:17.1595103Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 13s local 2025-03-14T06:34:17.1596154Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local ... 2025-03-14T06:34:17.5588982Z 2025-03-14T06:34:17.5589860Z  2025-03-14T06:34:17.5590308Z  2025-03-14T06:34:17.5590678Z  2025-03-14T06:34:17.5591057Z  2025-03-14T06:34:17.5591423Z  2025-03-14T06:34:17.5591806Z  2025-03-14T06:34:17.5592151Z  2025-03-14T06:34:17.5592519Z  2025-03-14T06:34:17.5593404Z [17,428 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:17.5594548Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T06:34:17.5595501Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T06:34:17.5596283Z Compiling xla/service/dynamic_padder.cc; 17s local 2025-03-14T06:34:17.5597300Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2025-03-14T06:34:17.5598222Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T06:34:17.5599205Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T06:34:17.5600229Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2025-03-14T06:34:17.5601220Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 13s local ... 2025-03-14T06:34:17.8609445Z 2025-03-14T06:34:17.8610217Z  2025-03-14T06:34:17.8610704Z  2025-03-14T06:34:17.8611093Z  2025-03-14T06:34:17.8611478Z  2025-03-14T06:34:17.8611864Z  2025-03-14T06:34:17.8612248Z  2025-03-14T06:34:17.8612632Z  2025-03-14T06:34:17.8613262Z  2025-03-14T06:34:17.8614144Z [17,430 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:17.8615226Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T06:34:17.8616191Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T06:34:17.8617034Z Compiling xla/service/dynamic_padder.cc; 17s local 2025-03-14T06:34:17.8617898Z Compiling xla/service/heap_simulator/heap_simulator.cc; 14s local 2025-03-14T06:34:17.8619014Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T06:34:17.8620236Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T06:34:17.8621332Z Compiling llvm/lib/Transforms/Vectorize/VectorCombine.cpp; 14s local 2025-03-14T06:34:17.8622417Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local ... 2025-03-14T06:34:18.1593864Z 2025-03-14T06:34:18.1594675Z  2025-03-14T06:34:18.1595189Z  2025-03-14T06:34:18.1595596Z  2025-03-14T06:34:18.1596001Z  2025-03-14T06:34:18.1596388Z  2025-03-14T06:34:18.1596780Z  2025-03-14T06:34:18.1597162Z  2025-03-14T06:34:18.1597563Z  2025-03-14T06:34:18.1598601Z [17,431 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:18.1599711Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T06:34:18.1600729Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T06:34:18.1601621Z Compiling xla/service/dynamic_padder.cc; 17s local 2025-03-14T06:34:18.1602515Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2025-03-14T06:34:18.1603508Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 14s local 2025-03-14T06:34:18.1604766Z Compiling xla/service/memory_space_assignment/allocation.cc; 14s local 2025-03-14T06:34:18.1605822Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2025-03-14T06:34:18.1606781Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local ... 2025-03-14T06:34:18.4332323Z 2025-03-14T06:34:18.4333133Z  2025-03-14T06:34:18.4333609Z  2025-03-14T06:34:18.4334024Z  2025-03-14T06:34:18.4334407Z  2025-03-14T06:34:18.4334817Z  2025-03-14T06:34:18.4335203Z  2025-03-14T06:34:18.4335596Z  2025-03-14T06:34:18.4335967Z  2025-03-14T06:34:18.4337067Z [17,432 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:18.4338266Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T06:34:18.4339199Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 20s local 2025-03-14T06:34:18.4339999Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T06:34:18.4340809Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2025-03-14T06:34:18.4341762Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T06:34:18.4342772Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T06:34:18.4343727Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2025-03-14T06:34:18.4344777Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local ... 2025-03-14T06:34:18.7505522Z 2025-03-14T06:34:18.7506352Z  2025-03-14T06:34:18.7506859Z  2025-03-14T06:34:18.7507279Z  2025-03-14T06:34:18.7507734Z  2025-03-14T06:34:18.7508142Z  2025-03-14T06:34:18.7508531Z  2025-03-14T06:34:18.7508950Z  2025-03-14T06:34:18.7509346Z  2025-03-14T06:34:18.7510326Z [17,433 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:18.7511437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T06:34:18.7512463Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T06:34:18.7513344Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T06:34:18.7514532Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2025-03-14T06:34:18.7515663Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T06:34:18.7516708Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T06:34:18.7517716Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 14s local 2025-03-14T06:34:18.7518675Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local ... 2025-03-14T06:34:18.9601325Z 2025-03-14T06:34:18.9602224Z  2025-03-14T06:34:18.9602737Z  2025-03-14T06:34:18.9603404Z  2025-03-14T06:34:18.9603847Z  2025-03-14T06:34:18.9604249Z  2025-03-14T06:34:18.9604786Z  2025-03-14T06:34:18.9605181Z  2025-03-14T06:34:18.9605585Z  2025-03-14T06:34:18.9606538Z [17,434 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:18.9607675Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T06:34:18.9608789Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T06:34:18.9609632Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T06:34:18.9610540Z Compiling xla/service/heap_simulator/heap_simulator.cc; 15s local 2025-03-14T06:34:18.9611555Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 15s local 2025-03-14T06:34:18.9612611Z Compiling xla/service/memory_space_assignment/allocation.cc; 15s local 2025-03-14T06:34:18.9613633Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T06:34:18.9614589Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 13s local ... 2025-03-14T06:34:19.3284244Z 2025-03-14T06:34:19.3285219Z  2025-03-14T06:34:19.3285704Z  2025-03-14T06:34:19.3286099Z  2025-03-14T06:34:19.3286489Z  2025-03-14T06:34:19.3286913Z  2025-03-14T06:34:19.3287282Z  2025-03-14T06:34:19.3287706Z  2025-03-14T06:34:19.3288091Z  2025-03-14T06:34:19.3289007Z [17,435 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:19.3290124Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T06:34:19.3291067Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 21s local 2025-03-14T06:34:19.3291899Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T06:34:19.3293059Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2025-03-14T06:34:19.3294093Z Compiling llvm/lib/Transforms/Utils/InlineFunction.cpp; 16s local 2025-03-14T06:34:19.3295134Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2025-03-14T06:34:19.3296196Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T06:34:19.3297140Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local ... 2025-03-14T06:34:19.5607217Z 2025-03-14T06:34:19.5608078Z  2025-03-14T06:34:19.5608558Z  2025-03-14T06:34:19.5608959Z  2025-03-14T06:34:19.5609350Z  2025-03-14T06:34:19.5609730Z  2025-03-14T06:34:19.5610122Z  2025-03-14T06:34:19.5610851Z  2025-03-14T06:34:19.5611238Z  2025-03-14T06:34:19.5612147Z [17,436 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:19.5613248Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T06:34:19.5614244Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T06:34:19.5615114Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T06:34:19.5615998Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2025-03-14T06:34:19.5617013Z Compiling xla/service/memory_space_assignment/allocation.cc; 16s local 2025-03-14T06:34:19.5631370Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T06:34:19.5632319Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2025-03-14T06:34:19.5633424Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 11s local ... 2025-03-14T06:34:19.8466756Z 2025-03-14T06:34:19.8467594Z  2025-03-14T06:34:19.8468109Z  2025-03-14T06:34:19.8468528Z  2025-03-14T06:34:19.8469053Z  2025-03-14T06:34:19.8469486Z  2025-03-14T06:34:19.8469913Z  2025-03-14T06:34:19.8470327Z  2025-03-14T06:34:19.8470725Z  2025-03-14T06:34:19.8471706Z [17,438 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:19.8473129Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T06:34:19.8474164Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T06:34:19.8475206Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T06:34:19.8476092Z Compiling xla/service/heap_simulator/heap_simulator.cc; 16s local 2025-03-14T06:34:19.8477075Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 15s local 2025-03-14T06:34:19.8477966Z Compiling llvm/lib/Transforms/Utils/Local.cpp; 14s local 2025-03-14T06:34:19.8478821Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 12s local 2025-03-14T06:34:19.8479647Z @llvm-project//mlir:ControlFlowToLLVM; 11s local ... 2025-03-14T06:34:20.1362475Z 2025-03-14T06:34:20.1363339Z  2025-03-14T06:34:20.1363806Z  2025-03-14T06:34:20.1364219Z  2025-03-14T06:34:20.1364777Z  2025-03-14T06:34:20.1365192Z  2025-03-14T06:34:20.1365793Z  2025-03-14T06:34:20.1366208Z  2025-03-14T06:34:20.1366613Z  2025-03-14T06:34:20.1367565Z [17,442 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:20.1368739Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T06:34:20.1369794Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T06:34:20.1370691Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T06:34:20.1371667Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T06:34:20.1372704Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2025-03-14T06:34:20.1373654Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 12s local 2025-03-14T06:34:20.1374488Z @llvm-project//mlir:ControlFlowToLLVM; 11s local 2025-03-14T06:34:20.1375729Z Compiling .../memory_space_assignment/tuning_utils.cc; 11s local ... 2025-03-14T06:34:20.3615927Z 2025-03-14T06:34:20.3616748Z  2025-03-14T06:34:20.3617245Z  2025-03-14T06:34:20.3617633Z  2025-03-14T06:34:20.3618047Z  2025-03-14T06:34:20.3618444Z  2025-03-14T06:34:20.3618852Z  2025-03-14T06:34:20.3619230Z  2025-03-14T06:34:20.3619632Z  2025-03-14T06:34:20.3620565Z [17,442 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:20.3621704Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T06:34:20.3622715Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 22s local 2025-03-14T06:34:20.3623598Z Compiling xla/service/dynamic_padder.cc; 20s local 2025-03-14T06:34:20.3624749Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T06:34:20.3625727Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2025-03-14T06:34:20.3626651Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 12s local 2025-03-14T06:34:20.3627439Z @llvm-project//mlir:ControlFlowToLLVM; 12s local 2025-03-14T06:34:20.3628330Z Compiling .../memory_space_assignment/tuning_utils.cc; 12s local ... 2025-03-14T06:34:20.6452527Z 2025-03-14T06:34:20.6453410Z  2025-03-14T06:34:20.6453919Z  2025-03-14T06:34:20.6454330Z  2025-03-14T06:34:20.6454719Z  2025-03-14T06:34:20.6455111Z  2025-03-14T06:34:20.6455491Z  2025-03-14T06:34:20.6455881Z  2025-03-14T06:34:20.6456256Z  2025-03-14T06:34:20.6457510Z [17,444 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:20.6458586Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T06:34:20.6459601Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2025-03-14T06:34:20.6460542Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T06:34:20.6461545Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 16s local 2025-03-14T06:34:20.6462476Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 12s local 2025-03-14T06:34:20.6463507Z @llvm-project//mlir:ControlFlowToLLVM; 12s local 2025-03-14T06:34:20.6464433Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 12s local 2025-03-14T06:34:20.6465718Z Compiling xla/service/scatter_expander.cc; 12s local ... 2025-03-14T06:34:20.9621306Z 2025-03-14T06:34:20.9622209Z  2025-03-14T06:34:20.9622703Z  2025-03-14T06:34:20.9623168Z  2025-03-14T06:34:20.9623596Z  2025-03-14T06:34:20.9624013Z  2025-03-14T06:34:20.9624407Z  2025-03-14T06:34:20.9624779Z  2025-03-14T06:34:20.9625182Z  2025-03-14T06:34:20.9626170Z [17,444 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:20.9627495Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T06:34:20.9628559Z Compiling llvm/lib/Transforms/Utils/SimplifyCFG.cpp; 23s local 2025-03-14T06:34:20.9629572Z Compiling xla/service/heap_simulator/heap_simulator.cc; 17s local 2025-03-14T06:34:20.9630596Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2025-03-14T06:34:20.9631534Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 13s local 2025-03-14T06:34:20.9632314Z @llvm-project//mlir:ControlFlowToLLVM; 12s local 2025-03-14T06:34:20.9633232Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 12s local 2025-03-14T06:34:20.9634279Z Compiling xla/service/scatter_expander.cc; 12s local ... 2025-03-14T06:34:21.3438375Z 2025-03-14T06:34:21.3439236Z  2025-03-14T06:34:21.3439713Z  2025-03-14T06:34:21.3440096Z  2025-03-14T06:34:21.3440478Z  2025-03-14T06:34:21.3440844Z  2025-03-14T06:34:21.3441210Z  2025-03-14T06:34:21.3441563Z  2025-03-14T06:34:21.3441894Z  2025-03-14T06:34:21.3443017Z [17,446 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:34:21.3444040Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T06:34:21.3445127Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T06:34:21.3446027Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2025-03-14T06:34:21.3446873Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 13s local 2025-03-14T06:34:21.3447624Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2025-03-14T06:34:21.3448463Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T06:34:21.3449393Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2025-03-14T06:34:21.3450176Z @llvm-project//llvm:InstCombine; 12s local ... 2025-03-14T06:34:21.5626333Z 2025-03-14T06:34:21.5627191Z  2025-03-14T06:34:21.5627629Z  2025-03-14T06:34:21.5628018Z  2025-03-14T06:34:21.5628413Z  2025-03-14T06:34:21.5628775Z  2025-03-14T06:34:21.5629185Z  2025-03-14T06:34:21.5629568Z  2025-03-14T06:34:21.5629950Z  2025-03-14T06:34:21.5630888Z [17,447 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:21.5631928Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2025-03-14T06:34:21.5632844Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T06:34:21.5633765Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 17s local 2025-03-14T06:34:21.5634940Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 13s local 2025-03-14T06:34:21.5635821Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2025-03-14T06:34:21.5636672Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T06:34:21.5637633Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2025-03-14T06:34:21.5638407Z @llvm-project//llvm:InstCombine; 12s local ... 2025-03-14T06:34:21.8728221Z 2025-03-14T06:34:21.8729177Z  2025-03-14T06:34:21.8729605Z  2025-03-14T06:34:21.8730110Z  2025-03-14T06:34:21.8730479Z  2025-03-14T06:34:21.8731185Z  2025-03-14T06:34:21.8731641Z  2025-03-14T06:34:21.8732108Z  2025-03-14T06:34:21.8732558Z  2025-03-14T06:34:21.8733513Z [17,450 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:21.8734579Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2025-03-14T06:34:21.8735585Z Compiling xla/service/heap_simulator/heap_simulator.cc; 18s local 2025-03-14T06:34:21.8736565Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T06:34:21.8737487Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 14s local 2025-03-14T06:34:21.8738302Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2025-03-14T06:34:21.8739257Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T06:34:21.8740342Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2025-03-14T06:34:21.8741339Z Compiling .../memory_space_assignment/tuning_utils.cc; 12s local ... 2025-03-14T06:34:22.0729483Z 2025-03-14T06:34:22.0730373Z  2025-03-14T06:34:22.0730793Z  2025-03-14T06:34:22.0731117Z  2025-03-14T06:34:22.0731434Z  2025-03-14T06:34:22.0731734Z  2025-03-14T06:34:22.0732048Z  2025-03-14T06:34:22.0732360Z  2025-03-14T06:34:22.0732673Z  2025-03-14T06:34:22.0733471Z [17,452 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:22.0734357Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2025-03-14T06:34:22.0735151Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T06:34:22.0735930Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T06:34:22.0736653Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 14s local 2025-03-14T06:34:22.0737566Z @llvm-project//mlir:ControlFlowToLLVM; 13s local 2025-03-14T06:34:22.0738319Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T06:34:22.0739133Z Compiling xla/service/dynamic_dimension_inference.cc; 12s local 2025-03-14T06:34:22.0739890Z Compiling .../memory_space_assignment/tuning_utils.cc; 12s local ... 2025-03-14T06:34:22.3631483Z 2025-03-14T06:34:22.3632338Z  2025-03-14T06:34:22.3632849Z  2025-03-14T06:34:22.3633250Z  2025-03-14T06:34:22.3633701Z  2025-03-14T06:34:22.3634103Z  2025-03-14T06:34:22.3634518Z  2025-03-14T06:34:22.3634917Z  2025-03-14T06:34:22.3635349Z  2025-03-14T06:34:22.3636313Z [17,453 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:22.3637817Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2025-03-14T06:34:22.3638860Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T06:34:22.3639859Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T06:34:22.3640807Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 14s local 2025-03-14T06:34:22.3641626Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2025-03-14T06:34:22.3643076Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 14s local 2025-03-14T06:34:22.3644375Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2025-03-14T06:34:22.3645643Z Compiling .../memory_space_assignment/tuning_utils.cc; 12s local ... 2025-03-14T06:34:22.7636963Z 2025-03-14T06:34:22.7637854Z  2025-03-14T06:34:22.7638335Z  2025-03-14T06:34:22.7638756Z  2025-03-14T06:34:22.7639198Z  2025-03-14T06:34:22.7639619Z  2025-03-14T06:34:22.7639979Z  2025-03-14T06:34:22.7640393Z  2025-03-14T06:34:22.7640787Z  2025-03-14T06:34:22.7641748Z [17,454 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:22.7642881Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2025-03-14T06:34:22.7646264Z Compiling xla/service/heap_simulator/heap_simulator.cc; 19s local 2025-03-14T06:34:22.7647960Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 18s local 2025-03-14T06:34:22.7648976Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local 2025-03-14T06:34:22.7649809Z @llvm-project//mlir:ControlFlowToLLVM; 14s local 2025-03-14T06:34:22.7650948Z Compiling xla/service/dynamic_dimension_inference.cc; 13s local 2025-03-14T06:34:22.7652163Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T06:34:22.7653500Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 12s local ... 2025-03-14T06:34:23.4458545Z 2025-03-14T06:34:23.4459525Z  2025-03-14T06:34:23.4460078Z  2025-03-14T06:34:23.4460542Z  2025-03-14T06:34:23.4460911Z  2025-03-14T06:34:23.4461278Z  2025-03-14T06:34:23.4461674Z  2025-03-14T06:34:23.4462025Z  2025-03-14T06:34:23.4462402Z  2025-03-14T06:34:23.4463295Z [17,455 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:23.4464347Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T06:34:23.4465526Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T06:34:23.4466503Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2025-03-14T06:34:23.4467402Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 15s local 2025-03-14T06:34:23.4468222Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2025-03-14T06:34:23.4468962Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2025-03-14T06:34:23.4469858Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 13s local 2025-03-14T06:34:23.4470839Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local ... 2025-03-14T06:34:23.7646332Z 2025-03-14T06:34:23.7647280Z  2025-03-14T06:34:23.7647794Z  2025-03-14T06:34:23.7648223Z  2025-03-14T06:34:23.7648657Z  2025-03-14T06:34:23.7649087Z  2025-03-14T06:34:23.7649492Z  2025-03-14T06:34:23.7649893Z  2025-03-14T06:34:23.7650328Z  2025-03-14T06:34:23.7651312Z [17,456 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:23.7652464Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T06:34:23.7653574Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T06:34:23.7654701Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 19s local 2025-03-14T06:34:23.7655964Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2025-03-14T06:34:23.7656866Z @llvm-project//mlir:ControlFlowToLLVM; 15s local 2025-03-14T06:34:23.7657795Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2025-03-14T06:34:23.7659039Z Compiling xla/service/memory_space_assignment/tuning_utils.cc; 14s local 2025-03-14T06:34:23.7660152Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 13s local ... 2025-03-14T06:34:23.9649017Z 2025-03-14T06:34:23.9649892Z  2025-03-14T06:34:23.9650348Z  2025-03-14T06:34:23.9650722Z  2025-03-14T06:34:23.9651110Z  2025-03-14T06:34:23.9651486Z  2025-03-14T06:34:23.9651857Z  2025-03-14T06:34:23.9652203Z  2025-03-14T06:34:23.9652844Z  2025-03-14T06:34:23.9653830Z [17,461 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:23.9654816Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T06:34:23.9655709Z Compiling xla/service/heap_simulator/heap_simulator.cc; 20s local 2025-03-14T06:34:23.9656608Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2025-03-14T06:34:23.9657447Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2025-03-14T06:34:23.9658261Z Compiling xla/service/dynamic_dimension_inference.cc; 14s local 2025-03-14T06:34:23.9659370Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2025-03-14T06:34:23.9660342Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 14s local 2025-03-14T06:34:23.9661166Z @llvm-project//llvm:InstCombine; 13s local ... 2025-03-14T06:34:24.3654637Z 2025-03-14T06:34:24.3655503Z  2025-03-14T06:34:24.3656029Z  2025-03-14T06:34:24.3656472Z  2025-03-14T06:34:24.3656887Z  2025-03-14T06:34:24.3657268Z  2025-03-14T06:34:24.3657681Z  2025-03-14T06:34:24.3658078Z  2025-03-14T06:34:24.3658486Z  2025-03-14T06:34:24.3659481Z [17,462 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:24.3660632Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T06:34:24.3661699Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T06:34:24.3662692Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2025-03-14T06:34:24.3663665Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 16s local 2025-03-14T06:34:24.3664600Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2025-03-14T06:34:24.3665884Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2025-03-14T06:34:24.3666971Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 14s local 2025-03-14T06:34:24.3667873Z @llvm-project//llvm:InstCombine; 14s local ... 2025-03-14T06:34:24.7171608Z 2025-03-14T06:34:24.7172478Z  2025-03-14T06:34:24.7172967Z  2025-03-14T06:34:24.7173418Z  2025-03-14T06:34:24.7173817Z  2025-03-14T06:34:24.7174227Z  2025-03-14T06:34:24.7174604Z  2025-03-14T06:34:24.7174971Z  2025-03-14T06:34:24.7175353Z  2025-03-14T06:34:24.7176562Z [17,464 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:24.7177728Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2025-03-14T06:34:24.7178686Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T06:34:24.7179637Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 20s local 2025-03-14T06:34:24.7180552Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T06:34:24.7181490Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2025-03-14T06:34:24.7182521Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2025-03-14T06:34:24.7183584Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 14s local 2025-03-14T06:34:24.7184744Z @xla//xla/hlo/transforms:algebraic_simplifier; 14s local ... 2025-03-14T06:34:24.9659891Z 2025-03-14T06:34:24.9660783Z  2025-03-14T06:34:24.9661253Z  2025-03-14T06:34:24.9661686Z  2025-03-14T06:34:24.9662074Z  2025-03-14T06:34:24.9662511Z  2025-03-14T06:34:24.9662915Z  2025-03-14T06:34:24.9663304Z  2025-03-14T06:34:24.9663696Z  2025-03-14T06:34:24.9664614Z [17,465 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:24.9665962Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2025-03-14T06:34:24.9667009Z Compiling xla/service/heap_simulator/heap_simulator.cc; 21s local 2025-03-14T06:34:24.9668144Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2025-03-14T06:34:24.9669378Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T06:34:24.9670318Z Compiling xla/service/dynamic_dimension_inference.cc; 15s local 2025-03-14T06:34:24.9671409Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T06:34:24.9672485Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 15s local 2025-03-14T06:34:24.9673486Z @xla//xla/hlo/transforms:algebraic_simplifier; 14s local ... 2025-03-14T06:34:25.5525975Z 2025-03-14T06:34:25.5526912Z  2025-03-14T06:34:25.5527422Z  2025-03-14T06:34:25.5528073Z  2025-03-14T06:34:25.5528499Z  2025-03-14T06:34:25.5528883Z  2025-03-14T06:34:25.5529259Z  2025-03-14T06:34:25.5529661Z  2025-03-14T06:34:25.5530072Z  2025-03-14T06:34:25.5531039Z [17,466 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:25.5532175Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T06:34:25.5533245Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T06:34:25.5534316Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2025-03-14T06:34:25.5535305Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 17s local 2025-03-14T06:34:25.5536252Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2025-03-14T06:34:25.5537451Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T06:34:25.5538531Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 15s local 2025-03-14T06:34:25.5539488Z @xla//xla/hlo/transforms:algebraic_simplifier; 15s local ... 2025-03-14T06:34:25.7667722Z 2025-03-14T06:34:25.7668589Z  2025-03-14T06:34:25.7669080Z  2025-03-14T06:34:25.7669497Z  2025-03-14T06:34:25.7669921Z  2025-03-14T06:34:25.7670326Z  2025-03-14T06:34:25.7670722Z  2025-03-14T06:34:25.7671135Z  2025-03-14T06:34:25.7671542Z  2025-03-14T06:34:25.7672444Z [17,466 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:25.7673646Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T06:34:25.7674837Z Compiling xla/service/heap_simulator/heap_simulator.cc; 22s local 2025-03-14T06:34:25.7675883Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 21s local 2025-03-14T06:34:25.7677101Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T06:34:25.7678090Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2025-03-14T06:34:25.7679192Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T06:34:25.7680316Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 15s local 2025-03-14T06:34:25.7681322Z @xla//xla/hlo/transforms:algebraic_simplifier; 15s local ... 2025-03-14T06:34:26.1148089Z 2025-03-14T06:34:26.1148935Z  2025-03-14T06:34:26.1149600Z  2025-03-14T06:34:26.1150028Z  2025-03-14T06:34:26.1150443Z  2025-03-14T06:34:26.1150868Z  2025-03-14T06:34:26.1151281Z  2025-03-14T06:34:26.1151705Z  2025-03-14T06:34:26.1152353Z  2025-03-14T06:34:26.1153299Z [17,467 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:26.1154359Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T06:34:26.1155365Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T06:34:26.1156448Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2025-03-14T06:34:26.1157415Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T06:34:26.1158366Z Compiling xla/service/dynamic_dimension_inference.cc; 16s local 2025-03-14T06:34:26.1159411Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T06:34:26.1160447Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 16s local 2025-03-14T06:34:26.1161682Z @xla//xla/hlo/transforms:algebraic_simplifier; 15s local ... 2025-03-14T06:34:26.3676468Z 2025-03-14T06:34:26.3677392Z  2025-03-14T06:34:26.3677908Z  2025-03-14T06:34:26.3678287Z  2025-03-14T06:34:26.3678639Z  2025-03-14T06:34:26.3679119Z  2025-03-14T06:34:26.3679623Z  2025-03-14T06:34:26.3680036Z  2025-03-14T06:34:26.3680483Z  2025-03-14T06:34:26.3681445Z [17,470 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:26.3685101Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T06:34:26.3686477Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T06:34:26.3687462Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2025-03-14T06:34:26.3688406Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 18s local 2025-03-14T06:34:26.3689320Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2025-03-14T06:34:26.3690303Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T06:34:26.3691338Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 16s local 2025-03-14T06:34:26.3692450Z @xla//xla/hlo/transforms:algebraic_simplifier; 15s local ... 2025-03-14T06:34:26.7678532Z 2025-03-14T06:34:26.7679359Z  2025-03-14T06:34:26.7679775Z  2025-03-14T06:34:26.7680181Z  2025-03-14T06:34:26.7680567Z  2025-03-14T06:34:26.7680960Z  2025-03-14T06:34:26.7681339Z  2025-03-14T06:34:26.7681753Z  2025-03-14T06:34:26.7682152Z  2025-03-14T06:34:26.7683063Z [17,471 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:26.7684174Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T06:34:26.7685359Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T06:34:26.7686373Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local 2025-03-14T06:34:26.7687418Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T06:34:26.7688422Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2025-03-14T06:34:26.7689508Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T06:34:26.7690607Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 16s local 2025-03-14T06:34:26.7691824Z @xla//xla/hlo/transforms:algebraic_simplifier; 16s local ... 2025-03-14T06:34:27.0152148Z 2025-03-14T06:34:27.0152970Z  2025-03-14T06:34:27.0153593Z  2025-03-14T06:34:27.0153998Z  2025-03-14T06:34:27.0154374Z  2025-03-14T06:34:27.0154766Z  2025-03-14T06:34:27.0155145Z  2025-03-14T06:34:27.0155532Z  2025-03-14T06:34:27.0155886Z  2025-03-14T06:34:27.0156787Z [17,472 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:27.0157979Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T06:34:27.0158937Z Compiling xla/service/heap_simulator/heap_simulator.cc; 23s local 2025-03-14T06:34:27.0160253Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2025-03-14T06:34:27.0161145Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T06:34:27.0162094Z Compiling xla/service/dynamic_dimension_inference.cc; 17s local 2025-03-14T06:34:27.0163134Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T06:34:27.0164259Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 17s local 2025-03-14T06:34:27.0165724Z @xla//xla/hlo/transforms:algebraic_simplifier; 16s local ... 2025-03-14T06:34:27.3684146Z 2025-03-14T06:34:27.3685157Z  2025-03-14T06:34:27.3685689Z  2025-03-14T06:34:27.3686115Z  2025-03-14T06:34:27.3686475Z  2025-03-14T06:34:27.3686813Z  2025-03-14T06:34:27.3687502Z  2025-03-14T06:34:27.3687887Z  2025-03-14T06:34:27.3688276Z  2025-03-14T06:34:27.3689214Z [17,472 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:27.3690353Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T06:34:27.3691337Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T06:34:27.3692361Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2025-03-14T06:34:27.3693296Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 19s local 2025-03-14T06:34:27.3694440Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T06:34:27.3695493Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T06:34:27.3696513Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 17s local 2025-03-14T06:34:27.3697421Z @xla//xla/hlo/transforms:algebraic_simplifier; 16s local ... 2025-03-14T06:34:27.7688311Z 2025-03-14T06:34:27.7689035Z  2025-03-14T06:34:27.7689502Z  2025-03-14T06:34:27.7689905Z  2025-03-14T06:34:27.7690304Z  2025-03-14T06:34:27.7690692Z  2025-03-14T06:34:27.7691093Z  2025-03-14T06:34:27.7691509Z  2025-03-14T06:34:27.7691911Z  2025-03-14T06:34:27.7692805Z [17,475 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:27.7693932Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T06:34:27.7694940Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T06:34:27.7695965Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local 2025-03-14T06:34:27.7696882Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2025-03-14T06:34:27.7697843Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T06:34:27.7698840Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T06:34:27.7699920Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 17s local 2025-03-14T06:34:27.7700886Z @xla//xla/hlo/transforms:algebraic_simplifier; 17s local ... 2025-03-14T06:34:27.9692808Z 2025-03-14T06:34:27.9693944Z  2025-03-14T06:34:27.9694405Z  2025-03-14T06:34:27.9694822Z  2025-03-14T06:34:27.9695210Z  2025-03-14T06:34:27.9695634Z  2025-03-14T06:34:27.9696020Z  2025-03-14T06:34:27.9696387Z  2025-03-14T06:34:27.9698862Z  2025-03-14T06:34:27.9700192Z [17,476 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:27.9701331Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T06:34:27.9702309Z Compiling xla/service/heap_simulator/heap_simulator.cc; 24s local 2025-03-14T06:34:27.9703311Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2025-03-14T06:34:27.9704257Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2025-03-14T06:34:27.9705142Z Compiling xla/service/dynamic_dimension_inference.cc; 18s local 2025-03-14T06:34:27.9706181Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2025-03-14T06:34:27.9707495Z Compiling mlir/lib/Dialect/Tensor/IR/TensorDialect.cpp; 18s local 2025-03-14T06:34:27.9708418Z @xla//xla/hlo/transforms:algebraic_simplifier; 17s local ... 2025-03-14T06:34:28.3697981Z 2025-03-14T06:34:28.3698832Z  2025-03-14T06:34:28.3699367Z  2025-03-14T06:34:28.3699826Z  2025-03-14T06:34:28.3700255Z  2025-03-14T06:34:28.3700656Z  2025-03-14T06:34:28.3701098Z  2025-03-14T06:34:28.3701526Z  2025-03-14T06:34:28.3701942Z  2025-03-14T06:34:28.3702913Z [17,477 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:28.3704083Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T06:34:28.3705249Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T06:34:28.3706576Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2025-03-14T06:34:28.3707553Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 20s local 2025-03-14T06:34:28.3708529Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2025-03-14T06:34:28.3709606Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2025-03-14T06:34:28.3710785Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2025-03-14T06:34:28.3711800Z @llvm-project//llvm:InstCombine; 16s local ... 2025-03-14T06:34:28.6840291Z 2025-03-14T06:34:28.6841395Z  2025-03-14T06:34:28.6841900Z  2025-03-14T06:34:28.6842272Z  2025-03-14T06:34:28.6842612Z  2025-03-14T06:34:28.6842951Z  2025-03-14T06:34:28.6843310Z  2025-03-14T06:34:28.6843665Z  2025-03-14T06:34:28.6843976Z  2025-03-14T06:34:28.6844898Z [17,478 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:28.6845842Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2025-03-14T06:34:28.6846692Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T06:34:28.6847527Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local 2025-03-14T06:34:28.6848286Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T06:34:28.6849216Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2025-03-14T06:34:28.6850064Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2025-03-14T06:34:28.6850929Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T06:34:28.6851719Z @llvm-project//llvm:InstCombine; 16s local ... 2025-03-14T06:34:28.9704520Z 2025-03-14T06:34:28.9705890Z  2025-03-14T06:34:28.9706417Z  2025-03-14T06:34:28.9706861Z  2025-03-14T06:34:28.9707309Z  2025-03-14T06:34:28.9707783Z  2025-03-14T06:34:28.9708194Z  2025-03-14T06:34:28.9708613Z  2025-03-14T06:34:28.9709038Z  2025-03-14T06:34:28.9710050Z [17,479 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:28.9711265Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2025-03-14T06:34:28.9712371Z Compiling xla/service/heap_simulator/heap_simulator.cc; 25s local 2025-03-14T06:34:28.9713864Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2025-03-14T06:34:28.9714873Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T06:34:28.9715812Z Compiling xla/service/dynamic_dimension_inference.cc; 19s local 2025-03-14T06:34:28.9716889Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T06:34:28.9718009Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T06:34:28.9718903Z @llvm-project//llvm:InstCombine; 17s local ... 2025-03-14T06:34:29.5710161Z 2025-03-14T06:34:29.5711054Z  2025-03-14T06:34:29.5711597Z  2025-03-14T06:34:29.5712055Z  2025-03-14T06:34:29.5712492Z  2025-03-14T06:34:29.5715434Z  2025-03-14T06:34:29.5715847Z  2025-03-14T06:34:29.5716237Z  2025-03-14T06:34:29.5716638Z  2025-03-14T06:34:29.5717584Z [17,480 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:34:29.5718694Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T06:34:29.5719648Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T06:34:29.5720627Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local 2025-03-14T06:34:29.5721523Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 21s local 2025-03-14T06:34:29.5722426Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T06:34:29.5723464Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T06:34:29.5725067Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T06:34:29.5725970Z @llvm-project//llvm:InstCombine; 17s local ... 2025-03-14T06:34:29.9715804Z 2025-03-14T06:34:29.9716743Z  2025-03-14T06:34:29.9717262Z  2025-03-14T06:34:29.9717700Z  2025-03-14T06:34:29.9718117Z  2025-03-14T06:34:29.9718439Z  2025-03-14T06:34:29.9718757Z  2025-03-14T06:34:29.9719101Z  2025-03-14T06:34:29.9719415Z  2025-03-14T06:34:29.9720496Z [17,481 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:29.9721416Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T06:34:29.9722225Z Compiling xla/service/heap_simulator/heap_simulator.cc; 26s local 2025-03-14T06:34:29.9723002Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2025-03-14T06:34:29.9723800Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2025-03-14T06:34:29.9724574Z Compiling xla/service/dynamic_dimension_inference.cc; 20s local 2025-03-14T06:34:29.9725594Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T06:34:29.9726550Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T06:34:29.9727332Z @llvm-project//llvm:InstCombine; 16s local ... 2025-03-14T06:34:30.1719736Z 2025-03-14T06:34:30.1720712Z  2025-03-14T06:34:30.1721245Z  2025-03-14T06:34:30.1721711Z  2025-03-14T06:34:30.1722164Z  2025-03-14T06:34:30.1722582Z  2025-03-14T06:34:30.1723075Z  2025-03-14T06:34:30.1723454Z  2025-03-14T06:34:30.1723808Z  2025-03-14T06:34:30.1724797Z [17,482 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:30.1725944Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T06:34:30.1726962Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T06:34:30.1727984Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2025-03-14T06:34:30.1728908Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2025-03-14T06:34:30.1729861Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2025-03-14T06:34:30.1730941Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T06:34:30.1732457Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T06:34:30.1733410Z @llvm-project//llvm:InstCombine; 17s local ... 2025-03-14T06:34:30.4515456Z 2025-03-14T06:34:30.4516383Z  2025-03-14T06:34:30.4516944Z  2025-03-14T06:34:30.4517381Z  2025-03-14T06:34:30.4517795Z  2025-03-14T06:34:30.4518235Z  2025-03-14T06:34:30.4518673Z  2025-03-14T06:34:30.4519000Z  2025-03-14T06:34:30.4519310Z  2025-03-14T06:34:30.4520054Z [17,483 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:30.4521037Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T06:34:30.4521951Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T06:34:30.4523121Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2025-03-14T06:34:30.4523935Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 22s local 2025-03-14T06:34:30.4524859Z Compiling xla/service/dynamic_dimension_inference.cc; 21s local 2025-03-14T06:34:30.4525731Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T06:34:30.4526624Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T06:34:30.4527356Z @llvm-project//llvm:InstCombine; 17s local ... 2025-03-14T06:34:30.7580949Z 2025-03-14T06:34:30.7582002Z  2025-03-14T06:34:30.7582470Z  2025-03-14T06:34:30.7582897Z  2025-03-14T06:34:30.7583670Z  2025-03-14T06:34:30.7584131Z  2025-03-14T06:34:30.7584579Z  2025-03-14T06:34:30.7585163Z  2025-03-14T06:34:30.7585619Z  2025-03-14T06:34:30.7586456Z [17,484 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:30.7587538Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T06:34:30.7588502Z Compiling xla/service/heap_simulator/heap_simulator.cc; 27s local 2025-03-14T06:34:30.7589470Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local 2025-03-14T06:34:30.7590600Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T06:34:30.7591587Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T06:34:30.7592668Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T06:34:30.7593503Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T06:34:30.7594221Z Compiling xla/service/cpu/cpu_runtime.cc; 13s local ... 2025-03-14T06:34:30.9601906Z 2025-03-14T06:34:30.9602818Z  2025-03-14T06:34:30.9603361Z  2025-03-14T06:34:30.9603799Z  2025-03-14T06:34:30.9604235Z  2025-03-14T06:34:30.9604789Z  2025-03-14T06:34:30.9605263Z  2025-03-14T06:34:30.9605684Z  2025-03-14T06:34:30.9606016Z  2025-03-14T06:34:30.9606882Z [17,487 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:30.9608088Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T06:34:30.9609031Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2025-03-14T06:34:30.9609890Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T06:34:30.9610799Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T06:34:30.9611837Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T06:34:30.9612670Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T06:34:30.9613356Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T06:34:30.9614283Z @llvm-project//llvm:TransformUtils; 11s local ... 2025-03-14T06:34:31.1727920Z 2025-03-14T06:34:31.1728943Z  2025-03-14T06:34:31.1729504Z  2025-03-14T06:34:31.1729964Z  2025-03-14T06:34:31.1730373Z  2025-03-14T06:34:31.1730792Z  2025-03-14T06:34:31.1731217Z  2025-03-14T06:34:31.1731643Z  2025-03-14T06:34:31.1732312Z  2025-03-14T06:34:31.1733350Z [17,488 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:31.1734573Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T06:34:31.1735654Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2025-03-14T06:34:31.1736644Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T06:34:31.1737674Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T06:34:31.1738884Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T06:34:31.1739837Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:34:31.1740756Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T06:34:31.1741599Z Compiling xla/tools/hlo_extractor.cc; 11s local ... 2025-03-14T06:34:31.6218069Z 2025-03-14T06:34:31.6219137Z  2025-03-14T06:34:31.6219542Z  2025-03-14T06:34:31.6219877Z  2025-03-14T06:34:31.6220225Z  2025-03-14T06:34:31.6220538Z  2025-03-14T06:34:31.6220867Z  2025-03-14T06:34:31.6221202Z  2025-03-14T06:34:31.6221527Z  2025-03-14T06:34:31.6222307Z [17,489 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:31.6223213Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2025-03-14T06:34:31.6224061Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local 2025-03-14T06:34:31.6225066Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 23s local 2025-03-14T06:34:31.6225861Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T06:34:31.6226795Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T06:34:31.6227563Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:34:31.6228172Z Compiling xla/service/cpu/cpu_runtime.cc; 14s local 2025-03-14T06:34:31.6228826Z Compiling xla/tools/hlo_extractor.cc; 11s local ... 2025-03-14T06:34:31.9195031Z 2025-03-14T06:34:31.9195908Z  2025-03-14T06:34:31.9196684Z  2025-03-14T06:34:31.9197089Z  2025-03-14T06:34:31.9197445Z  2025-03-14T06:34:31.9197807Z  2025-03-14T06:34:31.9198199Z  2025-03-14T06:34:31.9198589Z  2025-03-14T06:34:31.9198978Z  2025-03-14T06:34:31.9199899Z [17,491 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:31.9200798Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2025-03-14T06:34:31.9201811Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2025-03-14T06:34:31.9202730Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T06:34:31.9203659Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T06:34:31.9204987Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T06:34:31.9205891Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:34:31.9206573Z Compiling xla/tools/hlo_extractor.cc; 12s local 2025-03-14T06:34:31.9207379Z @xla//xla/hlo/transforms:algebraic_simplifier; 11s local ... 2025-03-14T06:34:32.1737151Z 2025-03-14T06:34:32.1737965Z  2025-03-14T06:34:32.1738442Z  2025-03-14T06:34:32.1738878Z  2025-03-14T06:34:32.1739292Z  2025-03-14T06:34:32.1739670Z  2025-03-14T06:34:32.1740078Z  2025-03-14T06:34:32.1740522Z  2025-03-14T06:34:32.1740948Z  2025-03-14T06:34:32.1741907Z [17,492 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:32.1743049Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2025-03-14T06:34:32.1744123Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2025-03-14T06:34:32.1744991Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T06:34:32.1746292Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 22s local 2025-03-14T06:34:32.1747463Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T06:34:32.1748343Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T06:34:32.1748989Z Compiling xla/tools/hlo_extractor.cc; 12s local 2025-03-14T06:34:32.1749791Z @xla//xla/hlo/transforms:algebraic_simplifier; 12s local ... 2025-03-14T06:34:32.5741988Z 2025-03-14T06:34:32.5742825Z  2025-03-14T06:34:32.5743289Z  2025-03-14T06:34:32.5743718Z  2025-03-14T06:34:32.5744110Z  2025-03-14T06:34:32.5744508Z  2025-03-14T06:34:32.5744912Z  2025-03-14T06:34:32.5745296Z  2025-03-14T06:34:32.5745694Z  2025-03-14T06:34:32.5747074Z [17,493 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:34:32.5748144Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T06:34:32.5749193Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local 2025-03-14T06:34:32.5750129Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 24s local 2025-03-14T06:34:32.5751142Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T06:34:32.5752031Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T06:34:32.5752723Z Compiling xla/tools/hlo_extractor.cc; 12s local 2025-03-14T06:34:32.5753674Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 12s local 2025-03-14T06:34:32.5754819Z Compiling xla/service/dynamic_padder.cc; 12s local ... 2025-03-14T06:34:32.8506604Z 2025-03-14T06:34:32.8507410Z  2025-03-14T06:34:32.8507887Z  2025-03-14T06:34:32.8508289Z  2025-03-14T06:34:32.8508734Z  2025-03-14T06:34:32.8509159Z  2025-03-14T06:34:32.8509567Z  2025-03-14T06:34:32.8509940Z  2025-03-14T06:34:32.8510310Z  2025-03-14T06:34:32.8511216Z [17,495 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:32.8512342Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T06:34:32.8513588Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2025-03-14T06:34:32.8514583Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T06:34:32.8515605Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T06:34:32.8516525Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T06:34:32.8517289Z Compiling xla/tools/hlo_extractor.cc; 12s local 2025-03-14T06:34:32.8518184Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 12s local 2025-03-14T06:34:32.8519122Z Compiling xla/service/dynamic_padder.cc; 12s local ... 2025-03-14T06:34:33.0713038Z 2025-03-14T06:34:33.0713857Z  2025-03-14T06:34:33.0714324Z  2025-03-14T06:34:33.0714693Z  2025-03-14T06:34:33.0715071Z  2025-03-14T06:34:33.0715436Z  2025-03-14T06:34:33.0715842Z  2025-03-14T06:34:33.0716234Z  2025-03-14T06:34:33.0716605Z  2025-03-14T06:34:33.0717540Z [17,496 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:33.0718598Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T06:34:33.0719580Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2025-03-14T06:34:33.0720480Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T06:34:33.0721444Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T06:34:33.0722313Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T06:34:33.0722997Z Compiling xla/tools/hlo_extractor.cc; 13s local 2025-03-14T06:34:33.0723874Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 12s local 2025-03-14T06:34:33.0724969Z Compiling xla/service/dynamic_padder.cc; 12s local ... 2025-03-14T06:34:33.3752298Z 2025-03-14T06:34:33.3753432Z  2025-03-14T06:34:33.3753951Z  2025-03-14T06:34:33.3754352Z  2025-03-14T06:34:33.3754746Z  2025-03-14T06:34:33.3755153Z  2025-03-14T06:34:33.3755576Z  2025-03-14T06:34:33.3755923Z  2025-03-14T06:34:33.3756312Z  2025-03-14T06:34:33.3757343Z [17,498 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:33.3758450Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T06:34:33.3759459Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2025-03-14T06:34:33.3760375Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T06:34:33.3761337Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T06:34:33.3762446Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T06:34:33.3773512Z Compiling xla/tools/hlo_extractor.cc; 13s local 2025-03-14T06:34:33.3774807Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2025-03-14T06:34:33.3775724Z Compiling xla/service/dynamic_padder.cc; 12s local ... 2025-03-14T06:34:33.5756580Z 2025-03-14T06:34:33.5757468Z  2025-03-14T06:34:33.5757929Z  2025-03-14T06:34:33.5758303Z  2025-03-14T06:34:33.5758714Z  2025-03-14T06:34:33.5759146Z  2025-03-14T06:34:33.5759573Z  2025-03-14T06:34:33.5760004Z  2025-03-14T06:34:33.5760432Z  2025-03-14T06:34:33.5761263Z [17,500 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:33.5762627Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T06:34:33.5763566Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local 2025-03-14T06:34:33.5764494Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 25s local 2025-03-14T06:34:33.5765810Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T06:34:33.5766704Z Compiling xla/tools/hlo_extractor.cc; 13s local 2025-03-14T06:34:33.5767551Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2025-03-14T06:34:33.5768814Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T06:34:33.5769692Z @llvm-project//mlir:ArithAttrToLLVMConversion; 12s local ... 2025-03-14T06:34:33.9846322Z 2025-03-14T06:34:33.9847164Z  2025-03-14T06:34:33.9847648Z  2025-03-14T06:34:33.9848037Z  2025-03-14T06:34:33.9848435Z  2025-03-14T06:34:33.9848844Z  2025-03-14T06:34:33.9849204Z  2025-03-14T06:34:33.9849583Z  2025-03-14T06:34:33.9849964Z  2025-03-14T06:34:33.9850901Z [17,501 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:33.9852011Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T06:34:33.9852995Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T06:34:33.9853946Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T06:34:33.9854881Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T06:34:33.9855838Z Compiling xla/tools/hlo_extractor.cc; 14s local 2025-03-14T06:34:33.9856750Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 13s local 2025-03-14T06:34:33.9857661Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T06:34:33.9858605Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 12s local ... 2025-03-14T06:34:34.3764200Z 2025-03-14T06:34:34.3765160Z  2025-03-14T06:34:34.3765879Z  2025-03-14T06:34:34.3766321Z  2025-03-14T06:34:34.3766715Z  2025-03-14T06:34:34.3767144Z  2025-03-14T06:34:34.3767520Z  2025-03-14T06:34:34.3767884Z  2025-03-14T06:34:34.3768242Z  2025-03-14T06:34:34.3769200Z [17,502 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:34.3770628Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T06:34:34.3771699Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T06:34:34.3772663Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 26s local 2025-03-14T06:34:34.3773805Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T06:34:34.3774757Z Compiling xla/tools/hlo_extractor.cc; 14s local 2025-03-14T06:34:34.3775620Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2025-03-14T06:34:34.3776576Z Compiling xla/service/dynamic_padder.cc; 13s local 2025-03-14T06:34:34.3777469Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local ... 2025-03-14T06:34:34.7926638Z 2025-03-14T06:34:34.7927435Z  2025-03-14T06:34:34.7927894Z  2025-03-14T06:34:34.7928267Z  2025-03-14T06:34:34.7928632Z  2025-03-14T06:34:34.7928983Z  2025-03-14T06:34:34.7929330Z  2025-03-14T06:34:34.7929674Z  2025-03-14T06:34:34.7930050Z  2025-03-14T06:34:34.7930923Z [17,503 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:34.7931921Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T06:34:34.7932883Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T06:34:34.7933744Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T06:34:34.7934626Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T06:34:34.7935721Z Compiling xla/tools/hlo_extractor.cc; 14s local 2025-03-14T06:34:34.7936543Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 14s local 2025-03-14T06:34:34.7937380Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T06:34:34.7938232Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local ... 2025-03-14T06:34:35.1550087Z 2025-03-14T06:34:35.1550924Z  2025-03-14T06:34:35.1551378Z  2025-03-14T06:34:35.1551757Z  2025-03-14T06:34:35.1552126Z  2025-03-14T06:34:35.1552503Z  2025-03-14T06:34:35.1553086Z  2025-03-14T06:34:35.1553464Z  2025-03-14T06:34:35.1553829Z  2025-03-14T06:34:35.1554677Z [17,504 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:35.1555660Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T06:34:35.1556633Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 31s local 2025-03-14T06:34:35.1557486Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T06:34:35.1558325Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T06:34:35.1559172Z Compiling xla/tools/hlo_extractor.cc; 15s local 2025-03-14T06:34:35.1560049Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T06:34:35.1560949Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T06:34:35.1561806Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local ... 2025-03-14T06:34:35.3772153Z 2025-03-14T06:34:35.3772940Z  2025-03-14T06:34:35.3773350Z  2025-03-14T06:34:35.3773702Z  2025-03-14T06:34:35.3774033Z  2025-03-14T06:34:35.3774367Z  2025-03-14T06:34:35.3774706Z  2025-03-14T06:34:35.3775065Z  2025-03-14T06:34:35.3775392Z  2025-03-14T06:34:35.3776205Z [17,505 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:35.3777148Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T06:34:35.3777922Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T06:34:35.3778734Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T06:34:35.3779538Z Compiling xla/tools/hlo_extractor.cc; 15s local 2025-03-14T06:34:35.3780601Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T06:34:35.3781389Z Compiling xla/service/dynamic_padder.cc; 14s local 2025-03-14T06:34:35.3782203Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2025-03-14T06:34:35.3783175Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local ... 2025-03-14T06:34:35.5776035Z 2025-03-14T06:34:35.5776830Z  2025-03-14T06:34:35.5777215Z  2025-03-14T06:34:35.5777530Z  2025-03-14T06:34:35.5777838Z  2025-03-14T06:34:35.5778172Z  2025-03-14T06:34:35.5778476Z  2025-03-14T06:34:35.5778779Z  2025-03-14T06:34:35.5779079Z  2025-03-14T06:34:35.5779823Z [17,506 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:35.5780960Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T06:34:35.5781644Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 27s local 2025-03-14T06:34:35.5782371Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T06:34:35.5783057Z Compiling xla/tools/hlo_extractor.cc; 15s local 2025-03-14T06:34:35.5783735Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T06:34:35.5784426Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T06:34:35.5785099Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2025-03-14T06:34:35.5785891Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 13s local ... 2025-03-14T06:34:35.8922855Z 2025-03-14T06:34:35.8923792Z  2025-03-14T06:34:35.8924205Z  2025-03-14T06:34:35.8924556Z  2025-03-14T06:34:35.8925153Z  2025-03-14T06:34:35.8925518Z  2025-03-14T06:34:35.8925925Z  2025-03-14T06:34:35.8926281Z  2025-03-14T06:34:35.8926655Z  2025-03-14T06:34:35.8927575Z [17,507 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:35.8928658Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T06:34:35.8929595Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2025-03-14T06:34:35.8930788Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T06:34:35.8931717Z Compiling xla/tools/hlo_extractor.cc; 16s local 2025-03-14T06:34:35.8932583Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T06:34:35.8933582Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T06:34:35.8934467Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2025-03-14T06:34:35.8935507Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local ... 2025-03-14T06:34:36.1098230Z 2025-03-14T06:34:36.1099496Z  2025-03-14T06:34:36.1100356Z  2025-03-14T06:34:36.1101106Z  2025-03-14T06:34:36.1102067Z  2025-03-14T06:34:36.1102561Z  2025-03-14T06:34:36.1102977Z  2025-03-14T06:34:36.1103390Z  2025-03-14T06:34:36.1103824Z  2025-03-14T06:34:36.1104789Z [17,508 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:36.1105913Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T06:34:36.1106837Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2025-03-14T06:34:36.1107812Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T06:34:36.1108704Z Compiling xla/tools/hlo_extractor.cc; 16s local 2025-03-14T06:34:36.1109679Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 15s local 2025-03-14T06:34:36.1110577Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T06:34:36.1111539Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local 2025-03-14T06:34:36.1112609Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local ... 2025-03-14T06:34:36.3780434Z 2025-03-14T06:34:36.3782405Z  2025-03-14T06:34:36.3783111Z  2025-03-14T06:34:36.3783511Z  2025-03-14T06:34:36.3783896Z  2025-03-14T06:34:36.3784292Z  2025-03-14T06:34:36.3784698Z  2025-03-14T06:34:36.3785077Z  2025-03-14T06:34:36.3785470Z  2025-03-14T06:34:36.3786423Z [17,509 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:36.3787497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T06:34:36.3788419Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 28s local 2025-03-14T06:34:36.3789378Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T06:34:36.3790217Z Compiling xla/tools/hlo_extractor.cc; 16s local 2025-03-14T06:34:36.3791421Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2025-03-14T06:34:36.3792349Z Compiling xla/service/dynamic_padder.cc; 15s local 2025-03-14T06:34:36.3793278Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T06:34:36.3794261Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 14s local ... 2025-03-14T06:34:36.7784071Z 2025-03-14T06:34:36.7785477Z  2025-03-14T06:34:36.7785960Z  2025-03-14T06:34:36.7786322Z  2025-03-14T06:34:36.7786677Z  2025-03-14T06:34:36.7787026Z  2025-03-14T06:34:36.7787390Z  2025-03-14T06:34:36.7787743Z  2025-03-14T06:34:36.7788108Z  2025-03-14T06:34:36.7788960Z [17,510 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:36.7790247Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2025-03-14T06:34:36.7791138Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T06:34:36.7792028Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T06:34:36.7793015Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 16s local 2025-03-14T06:34:36.7793857Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T06:34:36.7794679Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T06:34:36.7795736Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T06:34:36.7796638Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 14s local ... 2025-03-14T06:34:37.1790684Z 2025-03-14T06:34:37.1791639Z  2025-03-14T06:34:37.1792143Z  2025-03-14T06:34:37.1792545Z  2025-03-14T06:34:37.1792950Z  2025-03-14T06:34:37.1793343Z  2025-03-14T06:34:37.1793712Z  2025-03-14T06:34:37.1794105Z  2025-03-14T06:34:37.1794479Z  2025-03-14T06:34:37.1795416Z [17,512 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:37.1796544Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2025-03-14T06:34:37.1797472Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T06:34:37.1798467Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T06:34:37.1799563Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2025-03-14T06:34:37.1800521Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T06:34:37.1801522Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T06:34:37.1802551Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T06:34:37.1803565Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local ... 2025-03-14T06:34:37.3814153Z 2025-03-14T06:34:37.3815065Z  2025-03-14T06:34:37.3815550Z  2025-03-14T06:34:37.3815970Z  2025-03-14T06:34:37.3816399Z  2025-03-14T06:34:37.3816852Z  2025-03-14T06:34:37.3817233Z  2025-03-14T06:34:37.3817627Z  2025-03-14T06:34:37.3818005Z  2025-03-14T06:34:37.3819271Z [17,513 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:37.3820442Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2025-03-14T06:34:37.3821382Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 29s local 2025-03-14T06:34:37.3822386Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T06:34:37.3823485Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2025-03-14T06:34:37.3824396Z Compiling xla/service/dynamic_padder.cc; 16s local 2025-03-14T06:34:37.3825289Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T06:34:37.3826307Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 15s local 2025-03-14T06:34:37.3827361Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local ... 2025-03-14T06:34:37.7795146Z 2025-03-14T06:34:37.7796507Z  2025-03-14T06:34:37.7797045Z  2025-03-14T06:34:37.7797475Z  2025-03-14T06:34:37.7797864Z  2025-03-14T06:34:37.7798263Z  2025-03-14T06:34:37.7798785Z  2025-03-14T06:34:37.7799203Z  2025-03-14T06:34:37.7799597Z  2025-03-14T06:34:37.7800584Z [17,513 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:37.7801781Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2025-03-14T06:34:37.7802755Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T06:34:37.7803753Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T06:34:37.7805301Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 17s local 2025-03-14T06:34:37.7806230Z Compiling xla/service/dynamic_padder.cc; 17s local 2025-03-14T06:34:37.7807171Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T06:34:37.7808286Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T06:34:37.7809346Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 15s local ... 2025-03-14T06:34:38.1800181Z 2025-03-14T06:34:38.1801462Z  2025-03-14T06:34:38.1801975Z  2025-03-14T06:34:38.1802398Z  2025-03-14T06:34:38.1802806Z  2025-03-14T06:34:38.1803500Z  2025-03-14T06:34:38.1803921Z  2025-03-14T06:34:38.1804321Z  2025-03-14T06:34:38.1804906Z  2025-03-14T06:34:38.1805845Z [17,514 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:38.1807021Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2025-03-14T06:34:38.1808044Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T06:34:38.1809070Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T06:34:38.1810247Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T06:34:38.1811260Z Compiling xla/service/dynamic_padder.cc; 17s local 2025-03-14T06:34:38.1812244Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T06:34:38.1813353Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T06:34:38.1814459Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local ... 2025-03-14T06:34:38.4820124Z 2025-03-14T06:34:38.4821286Z  2025-03-14T06:34:38.4822925Z  2025-03-14T06:34:38.4824945Z  2025-03-14T06:34:38.4825479Z  2025-03-14T06:34:38.4825937Z  2025-03-14T06:34:38.4826366Z  2025-03-14T06:34:38.4826817Z  2025-03-14T06:34:38.4827248Z  2025-03-14T06:34:38.4828287Z [17,517 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:38.4829497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T06:34:38.4830528Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 30s local 2025-03-14T06:34:38.4831587Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T06:34:38.4833031Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T06:34:38.4834077Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T06:34:38.4835225Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T06:34:38.4836378Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 16s local 2025-03-14T06:34:38.4837514Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local ... 2025-03-14T06:34:38.7807698Z 2025-03-14T06:34:38.7808652Z  2025-03-14T06:34:38.7809173Z  2025-03-14T06:34:38.7809640Z  2025-03-14T06:34:38.7810071Z  2025-03-14T06:34:38.7810480Z  2025-03-14T06:34:38.7811138Z  2025-03-14T06:34:38.7811540Z  2025-03-14T06:34:38.7811928Z  2025-03-14T06:34:38.7813168Z [17,517 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:38.7814310Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T06:34:38.7815255Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T06:34:38.7816234Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T06:34:38.7817319Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T06:34:38.7818257Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T06:34:38.7819177Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T06:34:38.7820226Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T06:34:38.7821527Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local ... 2025-03-14T06:34:38.9812146Z 2025-03-14T06:34:38.9813038Z  2025-03-14T06:34:38.9814984Z  2025-03-14T06:34:38.9815493Z  2025-03-14T06:34:38.9815889Z  2025-03-14T06:34:38.9816276Z  2025-03-14T06:34:38.9816752Z  2025-03-14T06:34:38.9817219Z  2025-03-14T06:34:38.9817604Z  2025-03-14T06:34:38.9818624Z [17,518 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:38.9819981Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T06:34:38.9820923Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T06:34:38.9821914Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T06:34:38.9823006Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 18s local 2025-03-14T06:34:38.9823999Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T06:34:38.9824944Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T06:34:38.9826009Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T06:34:38.9827010Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 16s local ... 2025-03-14T06:34:39.3480925Z 2025-03-14T06:34:39.3481778Z  2025-03-14T06:34:39.3482372Z  2025-03-14T06:34:39.3482780Z  2025-03-14T06:34:39.3483222Z  2025-03-14T06:34:39.3483636Z  2025-03-14T06:34:39.3484051Z  2025-03-14T06:34:39.3484455Z  2025-03-14T06:34:39.3485023Z  2025-03-14T06:34:39.3485992Z [17,520 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:39.3487124Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T06:34:39.3488089Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T06:34:39.3489119Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T06:34:39.3490256Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T06:34:39.3491215Z Compiling xla/service/dynamic_padder.cc; 18s local 2025-03-14T06:34:39.3492165Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T06:34:39.3493204Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T06:34:39.3494518Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local ... 2025-03-14T06:34:39.5817587Z 2025-03-14T06:34:39.5818585Z  2025-03-14T06:34:39.5819132Z  2025-03-14T06:34:39.5819588Z  2025-03-14T06:34:39.5819997Z  2025-03-14T06:34:39.5820385Z  2025-03-14T06:34:39.5820807Z  2025-03-14T06:34:39.5821234Z  2025-03-14T06:34:39.5821643Z  2025-03-14T06:34:39.5822614Z [17,523 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:39.5823816Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T06:34:39.5824883Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 31s local 2025-03-14T06:34:39.5825955Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T06:34:39.5827698Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T06:34:39.5828716Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T06:34:39.5829810Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T06:34:39.5831043Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 17s local 2025-03-14T06:34:39.5832259Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local ... 2025-03-14T06:34:39.7821499Z 2025-03-14T06:34:39.7822464Z  2025-03-14T06:34:39.7822894Z  2025-03-14T06:34:39.7823260Z  2025-03-14T06:34:39.7823617Z  2025-03-14T06:34:39.7823973Z  2025-03-14T06:34:39.7824346Z  2025-03-14T06:34:39.7825007Z  2025-03-14T06:34:39.7825355Z  2025-03-14T06:34:39.7826220Z [17,525 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:39.7827360Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T06:34:39.7828221Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2025-03-14T06:34:39.7829128Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T06:34:39.7830130Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 19s local 2025-03-14T06:34:39.7831577Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T06:34:39.7832434Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T06:34:39.7833546Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T06:34:39.7834592Z Compiling xla/hlo/analysis/while_loop_analysis.cc; 17s local ... 2025-03-14T06:34:40.1827475Z 2025-03-14T06:34:40.1828421Z  2025-03-14T06:34:40.1830434Z  2025-03-14T06:34:40.1830934Z  2025-03-14T06:34:40.1831345Z  2025-03-14T06:34:40.1831758Z  2025-03-14T06:34:40.1832153Z  2025-03-14T06:34:40.1832624Z  2025-03-14T06:34:40.1833047Z  2025-03-14T06:34:40.1834033Z [17,526 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:40.1835282Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T06:34:40.1836268Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2025-03-14T06:34:40.1837263Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T06:34:40.1838415Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T06:34:40.1839415Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T06:34:40.1840380Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T06:34:40.1841421Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T06:34:40.1842460Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 17s local ... 2025-03-14T06:34:40.3931152Z 2025-03-14T06:34:40.3931972Z  2025-03-14T06:34:40.3932457Z  2025-03-14T06:34:40.3932872Z  2025-03-14T06:34:40.3933280Z  2025-03-14T06:34:40.3933684Z  2025-03-14T06:34:40.3934094Z  2025-03-14T06:34:40.3934483Z  2025-03-14T06:34:40.3935162Z  2025-03-14T06:34:40.3936114Z [17,527 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:40.3937256Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T06:34:40.3938196Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 32s local 2025-03-14T06:34:40.3939175Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T06:34:40.3940274Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T06:34:40.3941224Z Compiling xla/service/dynamic_padder.cc; 19s local 2025-03-14T06:34:40.3942110Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2025-03-14T06:34:40.3943325Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 18s local 2025-03-14T06:34:40.3944305Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 17s local ... 2025-03-14T06:34:40.7832544Z 2025-03-14T06:34:40.7833353Z  2025-03-14T06:34:40.7833865Z  2025-03-14T06:34:40.7834263Z  2025-03-14T06:34:40.7834664Z  2025-03-14T06:34:40.7835069Z  2025-03-14T06:34:40.7835453Z  2025-03-14T06:34:40.7835887Z  2025-03-14T06:34:40.7836290Z  2025-03-14T06:34:40.7837208Z [17,529 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:40.7838290Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2025-03-14T06:34:40.7839238Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 33s local 2025-03-14T06:34:40.7840525Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T06:34:40.7841604Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 20s local 2025-03-14T06:34:40.7842654Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2025-03-14T06:34:40.7843652Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 19s local 2025-03-14T06:34:40.7844877Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 17s local 2025-03-14T06:34:40.7845955Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 16s local ... 2025-03-14T06:34:41.7840347Z 2025-03-14T06:34:41.7841441Z  2025-03-14T06:34:41.7842078Z  2025-03-14T06:34:41.7842635Z  2025-03-14T06:34:41.7843180Z  2025-03-14T06:34:41.7843735Z  2025-03-14T06:34:41.7844259Z  2025-03-14T06:34:41.7844914Z  2025-03-14T06:34:41.7845453Z  2025-03-14T06:34:41.7846552Z [17,529 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:41.7847811Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2025-03-14T06:34:41.7849017Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2025-03-14T06:34:41.7850098Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T06:34:41.7851277Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T06:34:41.7852496Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T06:34:41.7853649Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T06:34:41.7854873Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2025-03-14T06:34:41.7856015Z @xla//xla/hlo/transforms:hlo_memory_scheduler; 17s local ... 2025-03-14T06:34:42.1128019Z 2025-03-14T06:34:42.1128875Z  2025-03-14T06:34:42.1129878Z  2025-03-14T06:34:42.1130669Z  2025-03-14T06:34:42.1131319Z  2025-03-14T06:34:42.1131684Z  2025-03-14T06:34:42.1132041Z  2025-03-14T06:34:42.1132387Z  2025-03-14T06:34:42.1132752Z  2025-03-14T06:34:42.1133599Z [17,533 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:42.1134598Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2025-03-14T06:34:42.1135454Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2025-03-14T06:34:42.1136643Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T06:34:42.1137618Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 21s local 2025-03-14T06:34:42.1138575Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T06:34:42.1139550Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T06:34:42.1140513Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2025-03-14T06:34:42.1141289Z @llvm-project//llvm:InstCombine; 15s local ... 2025-03-14T06:34:42.3846377Z 2025-03-14T06:34:42.3847181Z  2025-03-14T06:34:42.3847674Z  2025-03-14T06:34:42.3848060Z  2025-03-14T06:34:42.3848777Z  2025-03-14T06:34:42.3849168Z  2025-03-14T06:34:42.3849547Z  2025-03-14T06:34:42.3849937Z  2025-03-14T06:34:42.3850294Z  2025-03-14T06:34:42.3851252Z [17,533 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:42.3852363Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2025-03-14T06:34:42.3853283Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2025-03-14T06:34:42.3854235Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T06:34:42.3855279Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T06:34:42.3856316Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2025-03-14T06:34:42.3857596Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T06:34:42.3858598Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 18s local 2025-03-14T06:34:42.3859478Z @llvm-project//llvm:InstCombine; 15s local ... 2025-03-14T06:34:42.5849414Z 2025-03-14T06:34:42.5850412Z  2025-03-14T06:34:42.5851036Z  2025-03-14T06:34:42.5851536Z  2025-03-14T06:34:42.5852062Z  2025-03-14T06:34:42.5852574Z  2025-03-14T06:34:42.5853133Z  2025-03-14T06:34:42.5853635Z  2025-03-14T06:34:42.5854146Z  2025-03-14T06:34:42.5855548Z [17,534 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:42.5856868Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T06:34:42.5857973Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 34s local 2025-03-14T06:34:42.5859095Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T06:34:42.5860361Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T06:34:42.5861609Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2025-03-14T06:34:42.5862838Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 20s local 2025-03-14T06:34:42.5864057Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2025-03-14T06:34:42.5865118Z @llvm-project//llvm:InstCombine; 16s local ... 2025-03-14T06:34:42.9855089Z 2025-03-14T06:34:42.9858882Z  2025-03-14T06:34:42.9859413Z  2025-03-14T06:34:42.9859831Z  2025-03-14T06:34:42.9860265Z  2025-03-14T06:34:42.9860656Z  2025-03-14T06:34:42.9861059Z  2025-03-14T06:34:42.9861465Z  2025-03-14T06:34:42.9861854Z  2025-03-14T06:34:42.9862751Z [17,536 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:42.9863798Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T06:34:42.9864776Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T06:34:42.9866077Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T06:34:42.9867218Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 22s local 2025-03-14T06:34:42.9868332Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2025-03-14T06:34:42.9869687Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2025-03-14T06:34:42.9870770Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2025-03-14T06:34:42.9871724Z @llvm-project//llvm:InstCombine; 16s local ... 2025-03-14T06:34:43.3860281Z 2025-03-14T06:34:43.3861254Z  2025-03-14T06:34:43.3861752Z  2025-03-14T06:34:43.3864751Z  2025-03-14T06:34:43.3871159Z  2025-03-14T06:34:43.3874293Z  2025-03-14T06:34:43.3877325Z  2025-03-14T06:34:43.3880335Z  2025-03-14T06:34:43.3883362Z  2025-03-14T06:34:43.3887008Z [17,537 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:43.3890678Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T06:34:43.3894353Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T06:34:43.3897771Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T06:34:43.3901390Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T06:34:43.3905725Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T06:34:43.3909432Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 21s local 2025-03-14T06:34:43.3912944Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 19s local 2025-03-14T06:34:43.3916651Z @llvm-project//llvm:InstCombine; 16s local ... 2025-03-14T06:34:43.6436391Z 2025-03-14T06:34:43.6439788Z  2025-03-14T06:34:43.6443228Z  2025-03-14T06:34:43.6446223Z  2025-03-14T06:34:43.6449070Z  2025-03-14T06:34:43.6451944Z  2025-03-14T06:34:43.6454793Z  2025-03-14T06:34:43.6457127Z  2025-03-14T06:34:43.6457800Z  2025-03-14T06:34:43.6458913Z [17,540 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:43.6460241Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T06:34:43.6461422Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 35s local 2025-03-14T06:34:43.6462855Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2025-03-14T06:34:43.6464144Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T06:34:43.6465615Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T06:34:43.6466902Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T06:34:43.6468193Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2025-03-14T06:34:43.6469321Z @llvm-project//llvm:InstCombine; 17s local ... 2025-03-14T06:34:43.9864955Z 2025-03-14T06:34:43.9866350Z  2025-03-14T06:34:43.9867126Z  2025-03-14T06:34:43.9867748Z  2025-03-14T06:34:43.9868847Z  2025-03-14T06:34:43.9869381Z  2025-03-14T06:34:43.9869812Z  2025-03-14T06:34:43.9870209Z  2025-03-14T06:34:43.9870660Z  2025-03-14T06:34:43.9871642Z [17,541 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:43.9872764Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T06:34:43.9873760Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T06:34:43.9874871Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2025-03-14T06:34:43.9876070Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 23s local 2025-03-14T06:34:43.9877204Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T06:34:43.9878399Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T06:34:43.9879441Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 20s local 2025-03-14T06:34:43.9880406Z @llvm-project//llvm:InstCombine; 17s local ... 2025-03-14T06:34:44.5542451Z 2025-03-14T06:34:44.5543694Z  2025-03-14T06:34:44.5544135Z  2025-03-14T06:34:44.5544492Z  2025-03-14T06:34:44.5545141Z  2025-03-14T06:34:44.5545493Z  2025-03-14T06:34:44.5545836Z  2025-03-14T06:34:44.5546183Z  2025-03-14T06:34:44.5546536Z  2025-03-14T06:34:44.5547349Z [17,542 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:44.5548299Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T06:34:44.5549100Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 36s local 2025-03-14T06:34:44.5549943Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T06:34:44.5550856Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T06:34:44.5551773Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T06:34:44.5552827Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 22s local 2025-03-14T06:34:44.5553734Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2025-03-14T06:34:44.5554540Z @llvm-project//llvm:InstCombine; 18s local ... 2025-03-14T06:34:44.7707195Z 2025-03-14T06:34:44.7708413Z  2025-03-14T06:34:44.7709267Z  2025-03-14T06:34:44.7710258Z  2025-03-14T06:34:44.7710697Z  2025-03-14T06:34:44.7711096Z  2025-03-14T06:34:44.7711470Z  2025-03-14T06:34:44.7711830Z  2025-03-14T06:34:44.7712212Z  2025-03-14T06:34:44.7713151Z [17,545 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:44.7714435Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T06:34:44.7715338Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T06:34:44.7716334Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T06:34:44.7717375Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T06:34:44.7718436Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T06:34:44.7719424Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T06:34:44.7720629Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2025-03-14T06:34:44.7721565Z @llvm-project//llvm:InstCombine; 18s local ... 2025-03-14T06:34:44.9873283Z 2025-03-14T06:34:44.9874526Z  2025-03-14T06:34:44.9875139Z  2025-03-14T06:34:44.9875513Z  2025-03-14T06:34:44.9875904Z  2025-03-14T06:34:44.9876289Z  2025-03-14T06:34:44.9876731Z  2025-03-14T06:34:44.9877129Z  2025-03-14T06:34:44.9877517Z  2025-03-14T06:34:44.9878481Z [17,547 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:44.9879624Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T06:34:44.9880577Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T06:34:44.9881557Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T06:34:44.9882673Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 24s local 2025-03-14T06:34:44.9883761Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T06:34:44.9884961Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T06:34:44.9885997Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2025-03-14T06:34:44.9886870Z @llvm-project//llvm:InstCombine; 15s local ... 2025-03-14T06:34:45.3878338Z 2025-03-14T06:34:45.3879586Z  2025-03-14T06:34:45.3880119Z  2025-03-14T06:34:45.3880569Z  2025-03-14T06:34:45.3880988Z  2025-03-14T06:34:45.3881417Z  2025-03-14T06:34:45.3881817Z  2025-03-14T06:34:45.3882250Z  2025-03-14T06:34:45.3882657Z  2025-03-14T06:34:45.3883677Z [17,548 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:45.3885377Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T06:34:45.3886383Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 37s local 2025-03-14T06:34:45.3887376Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T06:34:45.3888691Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 25s local 2025-03-14T06:34:45.3889785Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2025-03-14T06:34:45.3890830Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 23s local 2025-03-14T06:34:45.3891891Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 21s local 2025-03-14T06:34:45.3892823Z @llvm-project//llvm:InstCombine; 15s local ... 2025-03-14T06:34:46.3952416Z 2025-03-14T06:34:46.3953548Z  2025-03-14T06:34:46.3954008Z  2025-03-14T06:34:46.3954359Z  2025-03-14T06:34:46.3954729Z  2025-03-14T06:34:46.3955084Z  2025-03-14T06:34:46.3955508Z  2025-03-14T06:34:46.3955934Z  2025-03-14T06:34:46.3956437Z  2025-03-14T06:34:46.3957361Z [17,549 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:46.3958399Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2025-03-14T06:34:46.3959267Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 38s local 2025-03-14T06:34:46.3960169Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2025-03-14T06:34:46.3961272Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T06:34:46.3962603Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T06:34:46.3963644Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 24s local 2025-03-14T06:34:46.3964845Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 22s local 2025-03-14T06:34:46.3965914Z @llvm-project//llvm:InstCombine; 16s local ... 2025-03-14T06:34:46.7747939Z 2025-03-14T06:34:46.7748909Z  2025-03-14T06:34:46.7749393Z  2025-03-14T06:34:46.7749770Z  2025-03-14T06:34:46.7750132Z  2025-03-14T06:34:46.7750477Z  2025-03-14T06:34:46.7751076Z  2025-03-14T06:34:46.7751454Z  2025-03-14T06:34:46.7751814Z  2025-03-14T06:34:46.7752703Z [17,550 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:46.7753787Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T06:34:46.7754664Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T06:34:46.7755645Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T06:34:46.7756536Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T06:34:46.7757429Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T06:34:46.7758338Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T06:34:46.7759219Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2025-03-14T06:34:46.7759960Z @llvm-project//llvm:InstCombine; 17s local ... 2025-03-14T06:34:46.9890885Z 2025-03-14T06:34:46.9891757Z  2025-03-14T06:34:46.9892286Z  2025-03-14T06:34:46.9892729Z  2025-03-14T06:34:46.9893161Z  2025-03-14T06:34:46.9893533Z  2025-03-14T06:34:46.9893895Z  2025-03-14T06:34:46.9894211Z  2025-03-14T06:34:46.9894526Z  2025-03-14T06:34:46.9895410Z [17,550 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:46.9896526Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T06:34:46.9897440Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T06:34:46.9898355Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T06:34:46.9899434Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 26s local 2025-03-14T06:34:46.9900728Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T06:34:46.9901806Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T06:34:46.9902775Z Compiling mlir/lib/Conversion/MathToLLVM/MathToLLVM.cpp; 23s local 2025-03-14T06:34:46.9903654Z @llvm-project//llvm:InstCombine; 17s local ... 2025-03-14T06:34:47.3894234Z 2025-03-14T06:34:47.3895061Z  2025-03-14T06:34:47.3895498Z  2025-03-14T06:34:47.3895875Z  2025-03-14T06:34:47.3896268Z  2025-03-14T06:34:47.3896689Z  2025-03-14T06:34:47.3897298Z  2025-03-14T06:34:47.3897770Z  2025-03-14T06:34:47.3898251Z  2025-03-14T06:34:47.3899231Z [17,552 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:47.3900621Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T06:34:47.3901536Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 39s local 2025-03-14T06:34:47.3902493Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T06:34:47.3903563Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T06:34:47.3904599Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T06:34:47.3905598Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 25s local 2025-03-14T06:34:47.3906390Z @llvm-project//llvm:InstCombine; 17s local 2025-03-14T06:34:47.3907229Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 16s local ... 2025-03-14T06:34:48.0227175Z 2025-03-14T06:34:48.0227941Z  2025-03-14T06:34:48.0228364Z  2025-03-14T06:34:48.0228721Z  2025-03-14T06:34:48.0229083Z  2025-03-14T06:34:48.0229474Z  2025-03-14T06:34:48.0229842Z  2025-03-14T06:34:48.0230214Z  2025-03-14T06:34:48.0230569Z  2025-03-14T06:34:48.0231398Z [17,553 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:48.0232400Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2025-03-14T06:34:48.0233507Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T06:34:48.0234374Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T06:34:48.0235326Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 27s local 2025-03-14T06:34:48.0236252Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T06:34:48.0237188Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T06:34:48.0238089Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:34:48.0238849Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 17s local ... 2025-03-14T06:34:48.3409154Z 2025-03-14T06:34:48.3409935Z  2025-03-14T06:34:48.3410334Z  2025-03-14T06:34:48.3410662Z  2025-03-14T06:34:48.3410985Z  2025-03-14T06:34:48.3411304Z  2025-03-14T06:34:48.3411654Z  2025-03-14T06:34:48.3411954Z  2025-03-14T06:34:48.3412279Z  2025-03-14T06:34:48.3413040Z [17,555 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:34:48.3414240Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2025-03-14T06:34:48.3415104Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T06:34:48.3416179Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T06:34:48.3417240Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T06:34:48.3418289Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T06:34:48.3419211Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T06:34:48.3420023Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:34:48.3420844Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 17s local ... 2025-03-14T06:34:48.5903085Z 2025-03-14T06:34:48.5904207Z  2025-03-14T06:34:48.5904613Z  2025-03-14T06:34:48.5904955Z  2025-03-14T06:34:48.5905288Z  2025-03-14T06:34:48.5905631Z  2025-03-14T06:34:48.5905963Z  2025-03-14T06:34:48.5906292Z  2025-03-14T06:34:48.5906621Z  2025-03-14T06:34:48.5907399Z [17,555 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:48.5908334Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2025-03-14T06:34:48.5909112Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 40s local 2025-03-14T06:34:48.5919218Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T06:34:48.5920410Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 28s local 2025-03-14T06:34:48.5921325Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2025-03-14T06:34:48.5922206Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 26s local 2025-03-14T06:34:48.5922950Z @llvm-project//llvm:InstCombine; 18s local 2025-03-14T06:34:48.5923675Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 17s local ... 2025-03-14T06:34:49.4404363Z 2025-03-14T06:34:49.4408431Z  2025-03-14T06:34:49.4408923Z  2025-03-14T06:34:49.4409297Z  2025-03-14T06:34:49.4409693Z  2025-03-14T06:34:49.4410080Z  2025-03-14T06:34:49.4410473Z  2025-03-14T06:34:49.4410872Z  2025-03-14T06:34:49.4411261Z  2025-03-14T06:34:49.4412578Z [17,556 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:49.4413664Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T06:34:49.4414576Z Compiling mlir/lib/Dialect/Shape/IR/Shape.cpp; 41s local 2025-03-14T06:34:49.4415539Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T06:34:49.4416677Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T06:34:49.4417702Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T06:34:49.4418910Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 27s local 2025-03-14T06:34:49.4419785Z @llvm-project//llvm:InstCombine; 19s local 2025-03-14T06:34:49.4420638Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 18s local ... 2025-03-14T06:34:49.7404799Z 2025-03-14T06:34:49.7405706Z  2025-03-14T06:34:49.7407863Z  2025-03-14T06:34:49.7409885Z  2025-03-14T06:34:49.7411883Z  2025-03-14T06:34:49.7413856Z  2025-03-14T06:34:49.7415790Z  2025-03-14T06:34:49.7417821Z  2025-03-14T06:34:49.7419670Z  2025-03-14T06:34:49.7422078Z [17,558 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:49.7424584Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T06:34:49.7426979Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T06:34:49.7429515Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T06:34:49.7431985Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T06:34:49.7434446Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T06:34:49.7436676Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T06:34:49.7438805Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 18s local 2025-03-14T06:34:49.7441033Z @llvm-project//mlir:BufferizationDialect; 17s local ... 2025-03-14T06:34:49.9916638Z 2025-03-14T06:34:49.9917507Z  2025-03-14T06:34:49.9917988Z  2025-03-14T06:34:49.9918391Z  2025-03-14T06:34:49.9918823Z  2025-03-14T06:34:49.9919208Z  2025-03-14T06:34:49.9919604Z  2025-03-14T06:34:49.9920017Z  2025-03-14T06:34:49.9920538Z  2025-03-14T06:34:49.9921883Z [17,559 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:49.9923174Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T06:34:49.9924228Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T06:34:49.9925399Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 29s local 2025-03-14T06:34:49.9926472Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T06:34:49.9927472Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T06:34:49.9928369Z @llvm-project//llvm:InstCombine; 20s local 2025-03-14T06:34:49.9929177Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local 2025-03-14T06:34:49.9930050Z @llvm-project//mlir:BufferizationDialect; 17s local ... 2025-03-14T06:34:50.3920884Z 2025-03-14T06:34:50.3921758Z  2025-03-14T06:34:50.3922273Z  2025-03-14T06:34:50.3922659Z  2025-03-14T06:34:50.3923071Z  2025-03-14T06:34:50.3923438Z  2025-03-14T06:34:50.3923859Z  2025-03-14T06:34:50.3924228Z  2025-03-14T06:34:50.3924718Z  2025-03-14T06:34:50.3925694Z [17,563 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:50.3926748Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T06:34:50.3927757Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T06:34:50.3928781Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T06:34:50.3930093Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T06:34:50.3931072Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 28s local 2025-03-14T06:34:50.3932055Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local 2025-03-14T06:34:50.3932870Z @llvm-project//mlir:BufferizationDialect; 17s local 2025-03-14T06:34:50.3933820Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local ... 2025-03-14T06:34:50.6560978Z 2025-03-14T06:34:50.6561811Z  2025-03-14T06:34:50.6562283Z  2025-03-14T06:34:50.6562673Z  2025-03-14T06:34:50.6563291Z  2025-03-14T06:34:50.6563697Z  2025-03-14T06:34:50.6564052Z  2025-03-14T06:34:50.6564437Z  2025-03-14T06:34:50.6564946Z  2025-03-14T06:34:50.6566064Z [17,564 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:50.6567273Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T06:34:50.6568241Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T06:34:50.6569219Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T06:34:50.6570255Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T06:34:50.6571193Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T06:34:50.6572092Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local 2025-03-14T06:34:50.6572872Z @llvm-project//mlir:BufferizationDialect; 18s local 2025-03-14T06:34:50.6573757Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local ... 2025-03-14T06:34:50.9611956Z 2025-03-14T06:34:50.9612838Z  2025-03-14T06:34:50.9613349Z  2025-03-14T06:34:50.9613777Z  2025-03-14T06:34:50.9614178Z  2025-03-14T06:34:50.9614615Z  2025-03-14T06:34:50.9615061Z  2025-03-14T06:34:50.9615550Z  2025-03-14T06:34:50.9616002Z  2025-03-14T06:34:50.9617074Z [17,565 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:50.9618353Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T06:34:50.9619687Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T06:34:50.9620919Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 30s local 2025-03-14T06:34:50.9622374Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T06:34:50.9623565Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T06:34:50.9624664Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 19s local 2025-03-14T06:34:50.9625807Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2025-03-14T06:34:50.9626978Z Compiling xla/service/cpu/conv_canonicalization.cc; 15s local ... 2025-03-14T06:34:51.1926278Z 2025-03-14T06:34:51.1927088Z  2025-03-14T06:34:51.1927512Z  2025-03-14T06:34:51.1927906Z  2025-03-14T06:34:51.1928278Z  2025-03-14T06:34:51.1928644Z  2025-03-14T06:34:51.1929003Z  2025-03-14T06:34:51.1929631Z  2025-03-14T06:34:51.1929992Z  2025-03-14T06:34:51.1930894Z [17,568 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:51.1931954Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T06:34:51.1932934Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T06:34:51.1933949Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T06:34:51.1935067Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T06:34:51.1936052Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T06:34:51.1936987Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 20s local 2025-03-14T06:34:51.1938093Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local 2025-03-14T06:34:51.1939104Z Compiling xla/service/cpu/conv_canonicalization.cc; 15s local ... 2025-03-14T06:34:51.5275084Z 2025-03-14T06:34:51.5275921Z  2025-03-14T06:34:51.5276399Z  2025-03-14T06:34:51.5276796Z  2025-03-14T06:34:51.5277191Z  2025-03-14T06:34:51.5277591Z  2025-03-14T06:34:51.5277990Z  2025-03-14T06:34:51.5278421Z  2025-03-14T06:34:51.5278811Z  2025-03-14T06:34:51.5280012Z [17,569 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:51.5281111Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T06:34:51.5282121Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T06:34:51.5283162Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T06:34:51.5284203Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T06:34:51.5285369Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 29s local 2025-03-14T06:34:51.5286329Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 20s local 2025-03-14T06:34:51.5287325Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2025-03-14T06:34:51.5288247Z Compiling xla/tools/hlo_extractor.cc; 14s local ... 2025-03-14T06:34:51.7441880Z 2025-03-14T06:34:51.7442806Z  2025-03-14T06:34:51.7443290Z  2025-03-14T06:34:51.7443708Z  2025-03-14T06:34:51.7444108Z  2025-03-14T06:34:51.7444503Z  2025-03-14T06:34:51.7445069Z  2025-03-14T06:34:51.7445458Z  2025-03-14T06:34:51.7445842Z  2025-03-14T06:34:51.7446747Z [17,570 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:51.7447823Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T06:34:51.7448847Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T06:34:51.7449898Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T06:34:51.7450951Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T06:34:51.7451957Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T06:34:51.7452925Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 20s local 2025-03-14T06:34:51.7454191Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2025-03-14T06:34:51.7455150Z Compiling xla/tools/hlo_extractor.cc; 15s local ... 2025-03-14T06:34:51.9937583Z 2025-03-14T06:34:51.9938423Z  2025-03-14T06:34:51.9938917Z  2025-03-14T06:34:51.9939337Z  2025-03-14T06:34:51.9939770Z  2025-03-14T06:34:51.9940173Z  2025-03-14T06:34:51.9940568Z  2025-03-14T06:34:51.9940934Z  2025-03-14T06:34:51.9941353Z  2025-03-14T06:34:51.9942307Z [17,570 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:51.9943421Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T06:34:51.9944794Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T06:34:51.9945904Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 31s local 2025-03-14T06:34:51.9947009Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T06:34:51.9948161Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T06:34:51.9949110Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2025-03-14T06:34:51.9950115Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2025-03-14T06:34:51.9950992Z Compiling xla/tools/hlo_extractor.cc; 15s local ... 2025-03-14T06:34:52.3942217Z 2025-03-14T06:34:52.3943073Z  2025-03-14T06:34:52.3943526Z  2025-03-14T06:34:52.3944238Z  2025-03-14T06:34:52.3944637Z  2025-03-14T06:34:52.3945045Z  2025-03-14T06:34:52.3945448Z  2025-03-14T06:34:52.3945821Z  2025-03-14T06:34:52.3946215Z  2025-03-14T06:34:52.3947155Z [17,571 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:52.3948236Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T06:34:52.3949306Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T06:34:52.3950390Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T06:34:52.3951663Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T06:34:52.3952707Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T06:34:52.3953734Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2025-03-14T06:34:52.3954770Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local 2025-03-14T06:34:52.3955738Z Compiling xla/tools/hlo_extractor.cc; 15s local ... 2025-03-14T06:34:52.5946172Z 2025-03-14T06:34:52.5946981Z  2025-03-14T06:34:52.5947373Z  2025-03-14T06:34:52.5947742Z  2025-03-14T06:34:52.5948053Z  2025-03-14T06:34:52.5948381Z  2025-03-14T06:34:52.5948705Z  2025-03-14T06:34:52.5949037Z  2025-03-14T06:34:52.5949359Z  2025-03-14T06:34:52.5950327Z [17,572 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:52.5951241Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T06:34:52.5952094Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T06:34:52.5952968Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T06:34:52.5953943Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T06:34:52.5954768Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 30s local 2025-03-14T06:34:52.5955563Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 21s local 2025-03-14T06:34:52.5956359Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2025-03-14T06:34:52.5957123Z Compiling xla/tools/hlo_extractor.cc; 16s local ... 2025-03-14T06:34:52.9950816Z 2025-03-14T06:34:52.9951777Z  2025-03-14T06:34:52.9952226Z  2025-03-14T06:34:52.9952615Z  2025-03-14T06:34:52.9953289Z  2025-03-14T06:34:52.9953695Z  2025-03-14T06:34:52.9954075Z  2025-03-14T06:34:52.9954425Z  2025-03-14T06:34:52.9954802Z  2025-03-14T06:34:52.9955702Z [17,573 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:52.9956766Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T06:34:52.9957784Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T06:34:52.9958854Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 32s local 2025-03-14T06:34:52.9959944Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T06:34:52.9960976Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T06:34:52.9964013Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2025-03-14T06:34:52.9965167Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2025-03-14T06:34:52.9966369Z Compiling xla/tools/hlo_extractor.cc; 16s local ... 2025-03-14T06:34:53.2698847Z 2025-03-14T06:34:53.2699731Z  2025-03-14T06:34:53.2700232Z  2025-03-14T06:34:53.2700655Z  2025-03-14T06:34:53.2701079Z  2025-03-14T06:34:53.2701462Z  2025-03-14T06:34:53.2701889Z  2025-03-14T06:34:53.2702282Z  2025-03-14T06:34:53.2702669Z  2025-03-14T06:34:53.2710317Z [17,574 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:53.2711574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T06:34:53.2712568Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T06:34:53.2713621Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2025-03-14T06:34:53.2714648Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T06:34:53.2715649Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T06:34:53.2716755Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2025-03-14T06:34:53.2717936Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local 2025-03-14T06:34:53.2718837Z Compiling xla/tools/hlo_extractor.cc; 16s local ... 2025-03-14T06:34:53.5956718Z 2025-03-14T06:34:53.5957582Z  2025-03-14T06:34:53.5958102Z  2025-03-14T06:34:53.5958500Z  2025-03-14T06:34:53.5959040Z  2025-03-14T06:34:53.5959443Z  2025-03-14T06:34:53.5959871Z  2025-03-14T06:34:53.5960285Z  2025-03-14T06:34:53.5960691Z  2025-03-14T06:34:53.5961641Z [17,575 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:53.5962805Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T06:34:53.5963874Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2025-03-14T06:34:53.5965152Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 33s local 2025-03-14T06:34:53.5966461Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2025-03-14T06:34:53.5967543Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 31s local 2025-03-14T06:34:53.5968556Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 22s local 2025-03-14T06:34:53.5969574Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2025-03-14T06:34:53.5970765Z Compiling .../memory_space_assignment/cost_analysis.cc; 14s local ... 2025-03-14T06:34:54.1850159Z 2025-03-14T06:34:54.1851036Z  2025-03-14T06:34:54.1851550Z  2025-03-14T06:34:54.1851953Z  2025-03-14T06:34:54.1852349Z  2025-03-14T06:34:54.1852809Z  2025-03-14T06:34:54.1853215Z  2025-03-14T06:34:54.1853622Z  2025-03-14T06:34:54.1854017Z  2025-03-14T06:34:54.1854957Z [17,576 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:54.1856455Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T06:34:54.1857574Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2025-03-14T06:34:54.1858708Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T06:34:54.1859794Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2025-03-14T06:34:54.1860786Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2025-03-14T06:34:54.1861786Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2025-03-14T06:34:54.1862864Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2025-03-14T06:34:54.1863983Z Compiling .../memory_space_assignment/cost_analysis.cc; 15s local ... 2025-03-14T06:34:54.3964323Z 2025-03-14T06:34:54.3965517Z  2025-03-14T06:34:54.3966145Z  2025-03-14T06:34:54.3966541Z  2025-03-14T06:34:54.3966945Z  2025-03-14T06:34:54.3967353Z  2025-03-14T06:34:54.3967793Z  2025-03-14T06:34:54.3968186Z  2025-03-14T06:34:54.3968542Z  2025-03-14T06:34:54.3969466Z [17,579 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:54.3970521Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T06:34:54.3971552Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2025-03-14T06:34:54.3972571Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 34s local 2025-03-14T06:34:54.3973972Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2025-03-14T06:34:54.3975000Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 32s local 2025-03-14T06:34:54.3975973Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 23s local 2025-03-14T06:34:54.3976954Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local 2025-03-14T06:34:54.3978074Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local ... 2025-03-14T06:34:55.2960380Z 2025-03-14T06:34:55.2961282Z  2025-03-14T06:34:55.2961788Z  2025-03-14T06:34:55.2962474Z  2025-03-14T06:34:55.2962869Z  2025-03-14T06:34:55.2963276Z  2025-03-14T06:34:55.2963668Z  2025-03-14T06:34:55.2964053Z  2025-03-14T06:34:55.2964446Z  2025-03-14T06:34:55.2965827Z [17,580 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:55.2966972Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T06:34:55.2968040Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T06:34:55.2969212Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2025-03-14T06:34:55.2970244Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2025-03-14T06:34:55.2971276Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2025-03-14T06:34:55.2972262Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2025-03-14T06:34:55.2973278Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2025-03-14T06:34:55.2974416Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 15s local ... 2025-03-14T06:34:55.5984979Z 2025-03-14T06:34:55.5985845Z  2025-03-14T06:34:55.5986310Z  2025-03-14T06:34:55.5986715Z  2025-03-14T06:34:55.5987101Z  2025-03-14T06:34:55.5987531Z  2025-03-14T06:34:55.5987926Z  2025-03-14T06:34:55.5988353Z  2025-03-14T06:34:55.5988756Z  2025-03-14T06:34:55.5989692Z [17,581 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:55.5990829Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T06:34:55.5991882Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T06:34:55.5993492Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2025-03-14T06:34:55.5994632Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T06:34:55.5995762Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 33s local 2025-03-14T06:34:55.5996797Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2025-03-14T06:34:55.5997823Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T06:34:55.5998932Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local ... 2025-03-14T06:34:55.8196324Z 2025-03-14T06:34:55.8197180Z  2025-03-14T06:34:55.8197642Z  2025-03-14T06:34:55.8198055Z  2025-03-14T06:34:55.8198456Z  2025-03-14T06:34:55.8198841Z  2025-03-14T06:34:55.8199646Z  2025-03-14T06:34:55.8200014Z  2025-03-14T06:34:55.8200404Z  2025-03-14T06:34:55.8201365Z [17,582 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:55.8202507Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T06:34:55.8203567Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T06:34:55.8204797Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 35s local 2025-03-14T06:34:55.8205826Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T06:34:55.8206843Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T06:34:55.8207818Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 24s local 2025-03-14T06:34:55.8209098Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T06:34:55.8210251Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local ... 2025-03-14T06:34:56.1686842Z 2025-03-14T06:34:56.1687720Z  2025-03-14T06:34:56.1688221Z  2025-03-14T06:34:56.1688603Z  2025-03-14T06:34:56.1689002Z  2025-03-14T06:34:56.1689386Z  2025-03-14T06:34:56.1689793Z  2025-03-14T06:34:56.1690177Z  2025-03-14T06:34:56.1690566Z  2025-03-14T06:34:56.1691769Z [17,585 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:56.1692865Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T06:34:56.1693893Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T06:34:56.1694972Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T06:34:56.1696034Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T06:34:56.1697036Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T06:34:56.1698030Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2025-03-14T06:34:56.1699014Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T06:34:56.1700124Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 16s local ... 2025-03-14T06:34:56.3980805Z 2025-03-14T06:34:56.3981692Z  2025-03-14T06:34:56.3982186Z  2025-03-14T06:34:56.3982595Z  2025-03-14T06:34:56.3983040Z  2025-03-14T06:34:56.3983440Z  2025-03-14T06:34:56.3983821Z  2025-03-14T06:34:56.3984167Z  2025-03-14T06:34:56.3984543Z  2025-03-14T06:34:56.3985480Z [17,585 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:56.3986573Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T06:34:56.3987642Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T06:34:56.3988705Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T06:34:56.3989792Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T06:34:56.3990807Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T06:34:56.3992131Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2025-03-14T06:34:56.3993143Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T06:34:56.3994305Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local ... 2025-03-14T06:34:56.6019169Z 2025-03-14T06:34:56.6020044Z  2025-03-14T06:34:56.6020538Z  2025-03-14T06:34:56.6020929Z  2025-03-14T06:34:56.6021326Z  2025-03-14T06:34:56.6021718Z  2025-03-14T06:34:56.6022120Z  2025-03-14T06:34:56.6022532Z  2025-03-14T06:34:56.6022910Z  2025-03-14T06:34:56.6023856Z [17,586 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:56.6025302Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T06:34:56.6026330Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T06:34:56.6027439Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T06:34:56.6028480Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T06:34:56.6029527Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 34s local 2025-03-14T06:34:56.6030503Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2025-03-14T06:34:56.6031513Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2025-03-14T06:34:56.6032653Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local ... 2025-03-14T06:34:56.9315911Z 2025-03-14T06:34:56.9316785Z  2025-03-14T06:34:56.9317273Z  2025-03-14T06:34:56.9317682Z  2025-03-14T06:34:56.9318090Z  2025-03-14T06:34:56.9318497Z  2025-03-14T06:34:56.9318901Z  2025-03-14T06:34:56.9319318Z  2025-03-14T06:34:56.9319695Z  2025-03-14T06:34:56.9320622Z [17,588 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:56.9321756Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T06:34:56.9322827Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T06:34:56.9324209Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 36s local 2025-03-14T06:34:56.9325462Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T06:34:56.9326515Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T06:34:56.9327443Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 25s local 2025-03-14T06:34:56.9328505Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2025-03-14T06:34:56.9329686Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local ... 2025-03-14T06:34:57.1987020Z 2025-03-14T06:34:57.1987879Z  2025-03-14T06:34:57.1988363Z  2025-03-14T06:34:57.1988746Z  2025-03-14T06:34:57.1989115Z  2025-03-14T06:34:57.1989482Z  2025-03-14T06:34:57.1989868Z  2025-03-14T06:34:57.1990301Z  2025-03-14T06:34:57.1990698Z  2025-03-14T06:34:57.1991666Z [17,589 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:57.1992792Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T06:34:57.1993830Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T06:34:57.1994912Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T06:34:57.1995942Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T06:34:57.1996958Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T06:34:57.1997968Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2025-03-14T06:34:57.1999005Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2025-03-14T06:34:57.2000107Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 17s local ... 2025-03-14T06:34:57.4143111Z 2025-03-14T06:34:57.4143980Z  2025-03-14T06:34:57.4144423Z  2025-03-14T06:34:57.4144815Z  2025-03-14T06:34:57.4145185Z  2025-03-14T06:34:57.4145549Z  2025-03-14T06:34:57.4145920Z  2025-03-14T06:34:57.4146261Z  2025-03-14T06:34:57.4146636Z  2025-03-14T06:34:57.4147494Z [17,590 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:57.4148577Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T06:34:57.4149604Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T06:34:57.4150637Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T06:34:57.4151884Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T06:34:57.4152904Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 35s local 2025-03-14T06:34:57.4153948Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2025-03-14T06:34:57.4154979Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2025-03-14T06:34:57.4156142Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local ... 2025-03-14T06:34:57.7993298Z 2025-03-14T06:34:57.7994134Z  2025-03-14T06:34:57.7994645Z  2025-03-14T06:34:57.7995048Z  2025-03-14T06:34:57.7995437Z  2025-03-14T06:34:57.7995849Z  2025-03-14T06:34:57.7996240Z  2025-03-14T06:34:57.7996638Z  2025-03-14T06:34:57.7997342Z  2025-03-14T06:34:57.7998300Z [17,591 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:57.7999426Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2025-03-14T06:34:57.8000537Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T06:34:57.8001655Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T06:34:57.8002738Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T06:34:57.8004121Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T06:34:57.8005257Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 26s local 2025-03-14T06:34:57.8006252Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T06:34:57.8007332Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local ... 2025-03-14T06:34:58.1100561Z 2025-03-14T06:34:58.1101470Z  2025-03-14T06:34:58.1101999Z  2025-03-14T06:34:58.1102392Z  2025-03-14T06:34:58.1102787Z  2025-03-14T06:34:58.1103196Z  2025-03-14T06:34:58.1103618Z  2025-03-14T06:34:58.1104023Z  2025-03-14T06:34:58.1104389Z  2025-03-14T06:34:58.1105409Z [17,592 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:58.1106553Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2025-03-14T06:34:58.1107612Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T06:34:58.1108761Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 37s local 2025-03-14T06:34:58.1109900Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T06:34:58.1110982Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T06:34:58.1111989Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2025-03-14T06:34:58.1113056Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T06:34:58.1114181Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 18s local ... 2025-03-14T06:34:58.3558241Z 2025-03-14T06:34:58.3559103Z  2025-03-14T06:34:58.3559597Z  2025-03-14T06:34:58.3560017Z  2025-03-14T06:34:58.3560433Z  2025-03-14T06:34:58.3560837Z  2025-03-14T06:34:58.3561211Z  2025-03-14T06:34:58.3561639Z  2025-03-14T06:34:58.3562281Z  2025-03-14T06:34:58.3563271Z [17,593 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:58.3564443Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2025-03-14T06:34:58.3565835Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T06:34:58.3566965Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T06:34:58.3568051Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T06:34:58.3569127Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T06:34:58.3570127Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2025-03-14T06:34:58.3571324Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T06:34:58.3572361Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local ... 2025-03-14T06:34:58.6000028Z 2025-03-14T06:34:58.6000949Z  2025-03-14T06:34:58.6001480Z  2025-03-14T06:34:58.6001901Z  2025-03-14T06:34:58.6002336Z  2025-03-14T06:34:58.6002742Z  2025-03-14T06:34:58.6003159Z  2025-03-14T06:34:58.6003597Z  2025-03-14T06:34:58.6004019Z  2025-03-14T06:34:58.6005179Z [17,595 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:58.6006454Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T06:34:58.6007795Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T06:34:58.6008883Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T06:34:58.6009987Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T06:34:58.6011019Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 36s local 2025-03-14T06:34:58.6011961Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2025-03-14T06:34:58.6012908Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T06:34:58.6014190Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local ... 2025-03-14T06:34:58.9271384Z 2025-03-14T06:34:58.9272260Z  2025-03-14T06:34:58.9272708Z  2025-03-14T06:34:58.9273100Z  2025-03-14T06:34:58.9273478Z  2025-03-14T06:34:58.9273880Z  2025-03-14T06:34:58.9274264Z  2025-03-14T06:34:58.9274661Z  2025-03-14T06:34:58.9275092Z  2025-03-14T06:34:58.9275985Z [17,596 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:58.9277033Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T06:34:58.9278016Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T06:34:58.9279098Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 38s local 2025-03-14T06:34:58.9280164Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T06:34:58.9281162Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T06:34:58.9282074Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 27s local 2025-03-14T06:34:58.9282998Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T06:34:58.9284073Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local ... 2025-03-14T06:34:59.2005463Z 2025-03-14T06:34:59.2006297Z  2025-03-14T06:34:59.2006821Z  2025-03-14T06:34:59.2007208Z  2025-03-14T06:34:59.2007591Z  2025-03-14T06:34:59.2007987Z  2025-03-14T06:34:59.2008375Z  2025-03-14T06:34:59.2008757Z  2025-03-14T06:34:59.2009165Z  2025-03-14T06:34:59.2010139Z [17,597 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:34:59.2011583Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T06:34:59.2012701Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T06:34:59.2013896Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T06:34:59.2015020Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T06:34:59.2016107Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T06:34:59.2017175Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2025-03-14T06:34:59.2018246Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T06:34:59.2019449Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 19s local ... 2025-03-14T06:34:59.4172898Z 2025-03-14T06:34:59.4174027Z  2025-03-14T06:34:59.4174517Z  2025-03-14T06:34:59.4174912Z  2025-03-14T06:34:59.4175295Z  2025-03-14T06:34:59.4175705Z  2025-03-14T06:34:59.4176116Z  2025-03-14T06:34:59.4176521Z  2025-03-14T06:34:59.4176957Z  2025-03-14T06:34:59.4177862Z [17,598 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:59.4179117Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T06:34:59.4180427Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T06:34:59.4181494Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T06:34:59.4182555Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T06:34:59.4183853Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 37s local 2025-03-14T06:34:59.4184822Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2025-03-14T06:34:59.4185816Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T06:34:59.4186854Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local ... 2025-03-14T06:34:59.7932262Z 2025-03-14T06:34:59.7933098Z  2025-03-14T06:34:59.7933576Z  2025-03-14T06:34:59.7934001Z  2025-03-14T06:34:59.7934396Z  2025-03-14T06:34:59.7934802Z  2025-03-14T06:34:59.7935440Z  2025-03-14T06:34:59.7935851Z  2025-03-14T06:34:59.7936214Z  2025-03-14T06:34:59.7937122Z [17,600 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:34:59.7938225Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T06:34:59.7939276Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T06:34:59.7940293Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T06:34:59.7941338Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T06:34:59.7942342Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T06:34:59.7943221Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 28s local 2025-03-14T06:34:59.7944190Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T06:34:59.7945307Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local ... 2025-03-14T06:35:00.0012699Z 2025-03-14T06:35:00.0013568Z  2025-03-14T06:35:00.0014049Z  2025-03-14T06:35:00.0014449Z  2025-03-14T06:35:00.0014833Z  2025-03-14T06:35:00.0015225Z  2025-03-14T06:35:00.0015601Z  2025-03-14T06:35:00.0015979Z  2025-03-14T06:35:00.0016359Z  2025-03-14T06:35:00.0017297Z [17,600 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:00.0018371Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T06:35:00.0019398Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T06:35:00.0020441Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 39s local 2025-03-14T06:35:00.0021852Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T06:35:00.0022864Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T06:35:00.0023814Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2025-03-14T06:35:00.0024801Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T06:35:00.0025878Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local ... 2025-03-14T06:35:00.2016349Z 2025-03-14T06:35:00.2017249Z  2025-03-14T06:35:00.2017724Z  2025-03-14T06:35:00.2018121Z  2025-03-14T06:35:00.2018468Z  2025-03-14T06:35:00.2018822Z  2025-03-14T06:35:00.2019162Z  2025-03-14T06:35:00.2019545Z  2025-03-14T06:35:00.2020198Z  2025-03-14T06:35:00.2021035Z [17,601 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:00.2022039Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T06:35:00.2023000Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T06:35:00.2023997Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T06:35:00.2024910Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T06:35:00.2025795Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T06:35:00.2026681Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2025-03-14T06:35:00.2027549Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T06:35:00.2028762Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 20s local ... 2025-03-14T06:35:00.6022202Z 2025-03-14T06:35:00.6023096Z  2025-03-14T06:35:00.6023527Z  2025-03-14T06:35:00.6023891Z  2025-03-14T06:35:00.6024386Z  2025-03-14T06:35:00.6024759Z  2025-03-14T06:35:00.6025130Z  2025-03-14T06:35:00.6025523Z  2025-03-14T06:35:00.6025903Z  2025-03-14T06:35:00.6026792Z [17,602 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:00.6028056Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2025-03-14T06:35:00.6029047Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T06:35:00.6030040Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T06:35:00.6031011Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T06:35:00.6031995Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 38s local 2025-03-14T06:35:00.6032871Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2025-03-14T06:35:00.6033804Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2025-03-14T06:35:00.6034838Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local ... 2025-03-14T06:35:00.8025862Z 2025-03-14T06:35:00.8026707Z  2025-03-14T06:35:00.8027139Z  2025-03-14T06:35:00.8027499Z  2025-03-14T06:35:00.8027857Z  2025-03-14T06:35:00.8028208Z  2025-03-14T06:35:00.8028560Z  2025-03-14T06:35:00.8028917Z  2025-03-14T06:35:00.8029270Z  2025-03-14T06:35:00.8030103Z [17,605 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:00.8031063Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2025-03-14T06:35:00.8031998Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T06:35:00.8032943Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 40s local 2025-03-14T06:35:00.8033980Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T06:35:00.8034887Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T06:35:00.8035728Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 29s local 2025-03-14T06:35:00.8036858Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2025-03-14T06:35:00.8037845Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local ... 2025-03-14T06:35:01.2031435Z 2025-03-14T06:35:01.2032234Z  2025-03-14T06:35:01.2032704Z  2025-03-14T06:35:01.2033060Z  2025-03-14T06:35:01.2033420Z  2025-03-14T06:35:01.2033770Z  2025-03-14T06:35:01.2034126Z  2025-03-14T06:35:01.2034472Z  2025-03-14T06:35:01.2034820Z  2025-03-14T06:35:01.2035692Z [17,607 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:01.2036673Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2025-03-14T06:35:01.2037850Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T06:35:01.2038779Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T06:35:01.2039704Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T06:35:01.2040583Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T06:35:01.2041444Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2025-03-14T06:35:01.2042314Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 21s local 2025-03-14T06:35:01.2043222Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local ... 2025-03-14T06:35:01.4035078Z 2025-03-14T06:35:01.4035921Z  2025-03-14T06:35:01.4036342Z  2025-03-14T06:35:01.4036979Z  2025-03-14T06:35:01.4037307Z  2025-03-14T06:35:01.4037634Z  2025-03-14T06:35:01.4037972Z  2025-03-14T06:35:01.4038329Z  2025-03-14T06:35:01.4038682Z  2025-03-14T06:35:01.4039546Z [17,611 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:01.4040510Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2025-03-14T06:35:01.4041437Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T06:35:01.4042506Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T06:35:01.4043444Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T06:35:01.4044348Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 39s local 2025-03-14T06:35:01.4045364Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2025-03-14T06:35:01.4046243Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T06:35:01.4047126Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local ... 2025-03-14T06:35:01.7470736Z 2025-03-14T06:35:01.7471539Z  2025-03-14T06:35:01.7471971Z  2025-03-14T06:35:01.7472289Z  2025-03-14T06:35:01.7472621Z  2025-03-14T06:35:01.7472955Z  2025-03-14T06:35:01.7473278Z  2025-03-14T06:35:01.7473606Z  2025-03-14T06:35:01.7473934Z  2025-03-14T06:35:01.7474723Z [17,612 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:01.7475645Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T06:35:01.7476500Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T06:35:01.7477378Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T06:35:01.7478242Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T06:35:01.7479084Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T06:35:01.7479877Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 30s local 2025-03-14T06:35:01.7480708Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T06:35:01.7481569Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local ... 2025-03-14T06:35:02.0041065Z 2025-03-14T06:35:02.0042064Z  2025-03-14T06:35:02.0042553Z  2025-03-14T06:35:02.0043245Z  2025-03-14T06:35:02.0043651Z  2025-03-14T06:35:02.0044027Z  2025-03-14T06:35:02.0044410Z  2025-03-14T06:35:02.0044932Z  2025-03-14T06:35:02.0045306Z  2025-03-14T06:35:02.0046178Z [17,612 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:02.0047236Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T06:35:02.0048234Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T06:35:02.0049296Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 41s local 2025-03-14T06:35:02.0050300Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T06:35:02.0051511Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T06:35:02.0052470Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2025-03-14T06:35:02.0053447Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T06:35:02.0054454Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local ... 2025-03-14T06:35:02.2907068Z 2025-03-14T06:35:02.2907927Z  2025-03-14T06:35:02.2908396Z  2025-03-14T06:35:02.2908784Z  2025-03-14T06:35:02.2909169Z  2025-03-14T06:35:02.2909569Z  2025-03-14T06:35:02.2909959Z  2025-03-14T06:35:02.2910335Z  2025-03-14T06:35:02.2910716Z  2025-03-14T06:35:02.2911602Z [17,613 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:02.2912966Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T06:35:02.2924770Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T06:35:02.2925922Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T06:35:02.2926951Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T06:35:02.2927971Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T06:35:02.2929156Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2025-03-14T06:35:02.2930179Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 22s local 2025-03-14T06:35:02.2931252Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local ... 2025-03-14T06:35:02.6047128Z 2025-03-14T06:35:02.6048003Z  2025-03-14T06:35:02.6048494Z  2025-03-14T06:35:02.6048913Z  2025-03-14T06:35:02.6049374Z  2025-03-14T06:35:02.6049772Z  2025-03-14T06:35:02.6050183Z  2025-03-14T06:35:02.6050576Z  2025-03-14T06:35:02.6050976Z  2025-03-14T06:35:02.6051900Z [17,615 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:02.6053044Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2025-03-14T06:35:02.6054158Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T06:35:02.6055291Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 42s local 2025-03-14T06:35:02.6056375Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2025-03-14T06:35:02.6057459Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 40s local 2025-03-14T06:35:02.6058419Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 31s local 2025-03-14T06:35:02.6059467Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 23s local 2025-03-14T06:35:02.6060528Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local ... 2025-03-14T06:35:03.3533589Z 2025-03-14T06:35:03.3534479Z  2025-03-14T06:35:03.3534965Z  2025-03-14T06:35:03.3535392Z  2025-03-14T06:35:03.3535849Z  2025-03-14T06:35:03.3536278Z  2025-03-14T06:35:03.3536705Z  2025-03-14T06:35:03.3537242Z  2025-03-14T06:35:03.3537655Z  2025-03-14T06:35:03.3538853Z [17,616 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:03.3539992Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2025-03-14T06:35:03.3541041Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T06:35:03.3542134Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2025-03-14T06:35:03.3543219Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T06:35:03.3544230Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2025-03-14T06:35:03.3545295Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2025-03-14T06:35:03.3546395Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T06:35:03.3547674Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local ... 2025-03-14T06:35:03.6055487Z 2025-03-14T06:35:03.6056353Z  2025-03-14T06:35:03.6056854Z  2025-03-14T06:35:03.6057270Z  2025-03-14T06:35:03.6057671Z  2025-03-14T06:35:03.6058042Z  2025-03-14T06:35:03.6058430Z  2025-03-14T06:35:03.6058811Z  2025-03-14T06:35:03.6059211Z  2025-03-14T06:35:03.6060218Z [17,616 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:03.6061376Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T06:35:03.6062501Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T06:35:03.6063917Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2025-03-14T06:35:03.6065052Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T06:35:03.6066357Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 41s local 2025-03-14T06:35:03.6067408Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2025-03-14T06:35:03.6068410Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T06:35:03.6069485Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local ... 2025-03-14T06:35:03.9503656Z 2025-03-14T06:35:03.9504515Z  2025-03-14T06:35:03.9505333Z  2025-03-14T06:35:03.9505779Z  2025-03-14T06:35:03.9506201Z  2025-03-14T06:35:03.9506593Z  2025-03-14T06:35:03.9506987Z  2025-03-14T06:35:03.9507371Z  2025-03-14T06:35:03.9507786Z  2025-03-14T06:35:03.9508701Z [17,617 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:03.9509793Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T06:35:03.9510846Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T06:35:03.9511968Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 43s local 2025-03-14T06:35:03.9513214Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T06:35:03.9514292Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T06:35:03.9515316Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 32s local 2025-03-14T06:35:03.9516373Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T06:35:03.9517447Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local ... 2025-03-14T06:35:04.1910558Z 2025-03-14T06:35:04.1911372Z  2025-03-14T06:35:04.1911876Z  2025-03-14T06:35:04.1912289Z  2025-03-14T06:35:04.1912682Z  2025-03-14T06:35:04.1913119Z  2025-03-14T06:35:04.1913531Z  2025-03-14T06:35:04.1913938Z  2025-03-14T06:35:04.1914350Z  2025-03-14T06:35:04.1915307Z [17,620 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:04.1916485Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T06:35:04.1917690Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T06:35:04.1919092Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T06:35:04.1920162Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T06:35:04.1921145Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T06:35:04.1922044Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2025-03-14T06:35:04.1923009Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 24s local 2025-03-14T06:35:04.1924040Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local ... 2025-03-14T06:35:04.4062096Z 2025-03-14T06:35:04.4062969Z  2025-03-14T06:35:04.4063448Z  2025-03-14T06:35:04.4063850Z  2025-03-14T06:35:04.4064236Z  2025-03-14T06:35:04.4065036Z  2025-03-14T06:35:04.4065718Z  2025-03-14T06:35:04.4066106Z  2025-03-14T06:35:04.4066488Z  2025-03-14T06:35:04.4067441Z [17,622 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:04.4068569Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T06:35:04.4069672Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T06:35:04.4070779Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T06:35:04.4071868Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T06:35:04.4072914Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T06:35:04.4074140Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2025-03-14T06:35:04.4075151Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T06:35:04.4076196Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local ... 2025-03-14T06:35:04.6065538Z 2025-03-14T06:35:04.6066435Z  2025-03-14T06:35:04.6066894Z  2025-03-14T06:35:04.6067263Z  2025-03-14T06:35:04.6067641Z  2025-03-14T06:35:04.6068019Z  2025-03-14T06:35:04.6068442Z  2025-03-14T06:35:04.6068822Z  2025-03-14T06:35:04.6069223Z  2025-03-14T06:35:04.6070415Z [17,623 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:04.6071572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T06:35:04.6072653Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T06:35:04.6073707Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T06:35:04.6074839Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T06:35:04.6075831Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 42s local 2025-03-14T06:35:04.6076829Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2025-03-14T06:35:04.6077851Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T06:35:04.6078888Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local ... 2025-03-14T06:35:04.8566764Z 2025-03-14T06:35:04.8567701Z  2025-03-14T06:35:04.8568224Z  2025-03-14T06:35:04.8568708Z  2025-03-14T06:35:04.8569164Z  2025-03-14T06:35:04.8569612Z  2025-03-14T06:35:04.8570036Z  2025-03-14T06:35:04.8570378Z  2025-03-14T06:35:04.8570764Z  2025-03-14T06:35:04.8571634Z [17,624 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:04.8572709Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T06:35:04.8573749Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T06:35:04.8574820Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 44s local 2025-03-14T06:35:04.8575937Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T06:35:04.8576968Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T06:35:04.8578225Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 33s local 2025-03-14T06:35:04.8579294Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T06:35:04.8580312Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local ... 2025-03-14T06:35:05.2067769Z 2025-03-14T06:35:05.2068773Z  2025-03-14T06:35:05.2069321Z  2025-03-14T06:35:05.2069777Z  2025-03-14T06:35:05.2070163Z  2025-03-14T06:35:05.2070548Z  2025-03-14T06:35:05.2070973Z  2025-03-14T06:35:05.2071554Z  2025-03-14T06:35:05.2071942Z  2025-03-14T06:35:05.2072934Z [17,625 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:05.2074394Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T06:35:05.2075468Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T06:35:05.2076540Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T06:35:05.2077575Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T06:35:05.2078610Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T06:35:05.2079613Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2025-03-14T06:35:05.2080806Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 25s local 2025-03-14T06:35:05.2081844Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local ... 2025-03-14T06:35:05.4071435Z 2025-03-14T06:35:05.4072357Z  2025-03-14T06:35:05.4072908Z  2025-03-14T06:35:05.4073344Z  2025-03-14T06:35:05.4073726Z  2025-03-14T06:35:05.4074091Z  2025-03-14T06:35:05.4074495Z  2025-03-14T06:35:05.4074903Z  2025-03-14T06:35:05.4075316Z  2025-03-14T06:35:05.4076373Z [17,626 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:05.4077541Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T06:35:05.4078870Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T06:35:05.4079971Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T06:35:05.4081035Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T06:35:05.4082098Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 43s local 2025-03-14T06:35:05.4083069Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2025-03-14T06:35:05.4084042Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T06:35:05.4085231Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local ... 2025-03-14T06:35:05.6765490Z 2025-03-14T06:35:05.6766368Z  2025-03-14T06:35:05.6766877Z  2025-03-14T06:35:05.6767297Z  2025-03-14T06:35:05.6767726Z  2025-03-14T06:35:05.6768149Z  2025-03-14T06:35:05.6768533Z  2025-03-14T06:35:05.6768950Z  2025-03-14T06:35:05.6769348Z  2025-03-14T06:35:05.6770389Z [17,627 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:05.6771574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T06:35:05.6772724Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 55s local 2025-03-14T06:35:05.6773886Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T06:35:05.6775021Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T06:35:05.6776079Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T06:35:05.6777080Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 34s local 2025-03-14T06:35:05.6778160Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T06:35:05.6779286Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local ... 2025-03-14T06:35:06.0076707Z 2025-03-14T06:35:06.0077560Z  2025-03-14T06:35:06.0077989Z  2025-03-14T06:35:06.0078336Z  2025-03-14T06:35:06.0078701Z  2025-03-14T06:35:06.0079060Z  2025-03-14T06:35:06.0079398Z  2025-03-14T06:35:06.0079741Z  2025-03-14T06:35:06.0080076Z  2025-03-14T06:35:06.0080878Z [17,628 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:06.0081794Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T06:35:06.0082677Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 55s local 2025-03-14T06:35:06.0083567Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 45s local 2025-03-14T06:35:06.0084782Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T06:35:06.0085608Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T06:35:06.0086418Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2025-03-14T06:35:06.0087223Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T06:35:06.0088078Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local ... 2025-03-14T06:35:06.2079741Z 2025-03-14T06:35:06.2080617Z  2025-03-14T06:35:06.2081114Z  2025-03-14T06:35:06.2081495Z  2025-03-14T06:35:06.2081912Z  2025-03-14T06:35:06.2082304Z  2025-03-14T06:35:06.2082694Z  2025-03-14T06:35:06.2083099Z  2025-03-14T06:35:06.2083751Z  2025-03-14T06:35:06.2084829Z [17,629 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:06.2085865Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T06:35:06.2086909Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 55s local 2025-03-14T06:35:06.2087989Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T06:35:06.2089037Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T06:35:06.2090270Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T06:35:06.2091232Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2025-03-14T06:35:06.2092269Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 26s local 2025-03-14T06:35:06.2093332Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local ... 2025-03-14T06:35:06.4092683Z 2025-03-14T06:35:06.4093577Z  2025-03-14T06:35:06.4094062Z  2025-03-14T06:35:06.4094467Z  2025-03-14T06:35:06.4094861Z  2025-03-14T06:35:06.4095249Z  2025-03-14T06:35:06.4095630Z  2025-03-14T06:35:06.4096053Z  2025-03-14T06:35:06.4096439Z  2025-03-14T06:35:06.4097377Z [17,631 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:06.4098474Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T06:35:06.4099509Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 55s local 2025-03-14T06:35:06.4100580Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T06:35:06.4101764Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T06:35:06.4102815Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 44s local 2025-03-14T06:35:06.4103825Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2025-03-14T06:35:06.4104864Z Compiling mlir/lib/Conversion/ArithToLLVM/ArithToLLVM.cpp; 27s local 2025-03-14T06:35:06.4105888Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local ... 2025-03-14T06:35:06.7698896Z 2025-03-14T06:35:06.7699806Z  2025-03-14T06:35:06.7700322Z  2025-03-14T06:35:06.7700789Z  2025-03-14T06:35:06.7701231Z  2025-03-14T06:35:06.7701643Z  2025-03-14T06:35:06.7702010Z  2025-03-14T06:35:06.7702414Z  2025-03-14T06:35:06.7703052Z  2025-03-14T06:35:06.7704040Z [17,635 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:06.7705146Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T06:35:06.7706206Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T06:35:06.7707201Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T06:35:06.7708213Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T06:35:06.7709127Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 35s local 2025-03-14T06:35:06.7710063Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T06:35:06.7711152Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T06:35:06.7712191Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local ... 2025-03-14T06:35:07.0087223Z 2025-03-14T06:35:07.0088306Z  2025-03-14T06:35:07.0089058Z  2025-03-14T06:35:07.0089711Z  2025-03-14T06:35:07.0090312Z  2025-03-14T06:35:07.0090654Z  2025-03-14T06:35:07.0091013Z  2025-03-14T06:35:07.0091367Z  2025-03-14T06:35:07.0091752Z  2025-03-14T06:35:07.0092817Z [17,636 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:07.0094376Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T06:35:07.0095820Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 46s local 2025-03-14T06:35:07.0097645Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T06:35:07.0099088Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T06:35:07.0100473Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2025-03-14T06:35:07.0101773Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T06:35:07.0103258Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 24s local 2025-03-14T06:35:07.0104719Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local ... 2025-03-14T06:35:07.4223181Z 2025-03-14T06:35:07.4224112Z  2025-03-14T06:35:07.4224621Z  2025-03-14T06:35:07.4225020Z  2025-03-14T06:35:07.4225399Z  2025-03-14T06:35:07.4225791Z  2025-03-14T06:35:07.4226189Z  2025-03-14T06:35:07.4226577Z  2025-03-14T06:35:07.4226976Z  2025-03-14T06:35:07.4227928Z [17,637 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:07.4229036Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T06:35:07.4230062Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T06:35:07.4231142Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T06:35:07.4232169Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 45s local 2025-03-14T06:35:07.4233168Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2025-03-14T06:35:07.4234327Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T06:35:07.4235296Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T06:35:07.4236306Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 22s local ... 2025-03-14T06:35:07.8093878Z 2025-03-14T06:35:07.8095166Z  2025-03-14T06:35:07.8095635Z  2025-03-14T06:35:07.8096046Z  2025-03-14T06:35:07.8096606Z  2025-03-14T06:35:07.8097016Z  2025-03-14T06:35:07.8097416Z  2025-03-14T06:35:07.8097783Z  2025-03-14T06:35:07.8098148Z  2025-03-14T06:35:07.8099034Z [17,637 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:07.8100028Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T06:35:07.8101254Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 47s local 2025-03-14T06:35:07.8102327Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T06:35:07.8103416Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T06:35:07.8104436Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local 2025-03-14T06:35:07.8105392Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2025-03-14T06:35:07.8106381Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 25s local 2025-03-14T06:35:07.8107364Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local ... 2025-03-14T06:35:08.2097976Z 2025-03-14T06:35:08.2099433Z  2025-03-14T06:35:08.2099905Z  2025-03-14T06:35:08.2101427Z  2025-03-14T06:35:08.2102521Z  2025-03-14T06:35:08.2103695Z  2025-03-14T06:35:08.2104890Z  2025-03-14T06:35:08.2106221Z  2025-03-14T06:35:08.2107248Z  2025-03-14T06:35:08.2108279Z [17,638 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:08.2109399Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T06:35:08.2110497Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T06:35:08.2111577Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T06:35:08.2112669Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T06:35:08.2113735Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2025-03-14T06:35:08.2117012Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2025-03-14T06:35:08.2118028Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T06:35:08.2119122Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local ... 2025-03-14T06:35:08.4102728Z 2025-03-14T06:35:08.4103637Z  2025-03-14T06:35:08.4104142Z  2025-03-14T06:35:08.4104543Z  2025-03-14T06:35:08.4104968Z  2025-03-14T06:35:08.4105410Z  2025-03-14T06:35:08.4105789Z  2025-03-14T06:35:08.4106180Z  2025-03-14T06:35:08.4106565Z  2025-03-14T06:35:08.4107760Z [17,641 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:08.4108898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T06:35:08.4110005Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T06:35:08.4111108Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T06:35:08.4112221Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 46s local 2025-03-14T06:35:08.4113220Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2025-03-14T06:35:08.4114171Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2025-03-14T06:35:08.4115120Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T06:35:08.4116175Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 23s local ... 2025-03-14T06:35:08.7219852Z 2025-03-14T06:35:08.7220778Z  2025-03-14T06:35:08.7221288Z  2025-03-14T06:35:08.7221768Z  2025-03-14T06:35:08.7222194Z  2025-03-14T06:35:08.7222641Z  2025-03-14T06:35:08.7223057Z  2025-03-14T06:35:08.7223442Z  2025-03-14T06:35:08.7223831Z  2025-03-14T06:35:08.7224748Z [17,644 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:08.7225828Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T06:35:08.7226815Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T06:35:08.7228043Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T06:35:08.7229115Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T06:35:08.7230138Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local 2025-03-14T06:35:08.7231413Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T06:35:08.7232401Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T06:35:08.7233463Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local ... 2025-03-14T06:35:09.0108561Z 2025-03-14T06:35:09.0109420Z  2025-03-14T06:35:09.0109922Z  2025-03-14T06:35:09.0110317Z  2025-03-14T06:35:09.0110691Z  2025-03-14T06:35:09.0111103Z  2025-03-14T06:35:09.0111522Z  2025-03-14T06:35:09.0111959Z  2025-03-14T06:35:09.0112330Z  2025-03-14T06:35:09.0113215Z [17,644 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:09.0114730Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T06:35:09.0115842Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 48s local 2025-03-14T06:35:09.0117011Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T06:35:09.0118084Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T06:35:09.0119170Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2025-03-14T06:35:09.0120189Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T06:35:09.0121171Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 26s local 2025-03-14T06:35:09.0122217Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local ... 2025-03-14T06:35:09.2112163Z 2025-03-14T06:35:09.2113018Z  2025-03-14T06:35:09.2113447Z  2025-03-14T06:35:09.2113841Z  2025-03-14T06:35:09.2114219Z  2025-03-14T06:35:09.2114571Z  2025-03-14T06:35:09.2114956Z  2025-03-14T06:35:09.2115335Z  2025-03-14T06:35:09.2115696Z  2025-03-14T06:35:09.2116587Z [17,646 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:09.2117693Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T06:35:09.2118702Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T06:35:09.2120047Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T06:35:09.2121082Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 47s local 2025-03-14T06:35:09.2122058Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2025-03-14T06:35:09.2123002Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T06:35:09.2123973Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T06:35:09.2125205Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 24s local ... 2025-03-14T06:35:09.6365726Z 2025-03-14T06:35:09.6366698Z  2025-03-14T06:35:09.6367596Z  2025-03-14T06:35:09.6368131Z  2025-03-14T06:35:09.6368659Z  2025-03-14T06:35:09.6369189Z  2025-03-14T06:35:09.6369681Z  2025-03-14T06:35:09.6370196Z  2025-03-14T06:35:09.6370736Z  2025-03-14T06:35:09.6371789Z [17,647 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:09.6373036Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T06:35:09.6374287Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T06:35:09.6375467Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2025-03-14T06:35:09.6376620Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2025-03-14T06:35:09.6377805Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local 2025-03-14T06:35:09.6378936Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T06:35:09.6380068Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T06:35:09.6381314Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local ... 2025-03-14T06:35:10.0119286Z 2025-03-14T06:35:10.0120422Z  2025-03-14T06:35:10.0120924Z  2025-03-14T06:35:10.0121331Z  2025-03-14T06:35:10.0121742Z  2025-03-14T06:35:10.0122158Z  2025-03-14T06:35:10.0122591Z  2025-03-14T06:35:10.0123013Z  2025-03-14T06:35:10.0123426Z  2025-03-14T06:35:10.0124417Z [17,647 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:10.0125707Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T06:35:10.0126799Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 49s local 2025-03-14T06:35:10.0127993Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2025-03-14T06:35:10.0128988Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2025-03-14T06:35:10.0130125Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2025-03-14T06:35:10.0131006Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2025-03-14T06:35:10.0131882Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 27s local 2025-03-14T06:35:10.0132832Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local ... 2025-03-14T06:35:10.5598750Z 2025-03-14T06:35:10.5599632Z  2025-03-14T06:35:10.5600128Z  2025-03-14T06:35:10.5600526Z  2025-03-14T06:35:10.5600926Z  2025-03-14T06:35:10.5601319Z  2025-03-14T06:35:10.5601665Z  2025-03-14T06:35:10.5602061Z  2025-03-14T06:35:10.5602473Z  2025-03-14T06:35:10.5603704Z [17,648 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:10.5604983Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T06:35:10.5606017Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T06:35:10.5607034Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T06:35:10.5607997Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 48s local 2025-03-14T06:35:10.5608861Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2025-03-14T06:35:10.5609906Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2025-03-14T06:35:10.5610754Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T06:35:10.5611702Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 25s local ... 2025-03-14T06:35:10.8128787Z 2025-03-14T06:35:10.8129613Z  2025-03-14T06:35:10.8130105Z  2025-03-14T06:35:10.8130566Z  2025-03-14T06:35:10.8130991Z  2025-03-14T06:35:10.8131402Z  2025-03-14T06:35:10.8131800Z  2025-03-14T06:35:10.8132257Z  2025-03-14T06:35:10.8132663Z  2025-03-14T06:35:10.8133623Z [17,648 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:10.8134794Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T06:35:10.8135921Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T06:35:10.8137040Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T06:35:10.8138138Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T06:35:10.8139185Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2025-03-14T06:35:10.8140174Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T06:35:10.8141216Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 28s local 2025-03-14T06:35:10.8142311Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local ... 2025-03-14T06:35:11.1258224Z 2025-03-14T06:35:11.1259057Z  2025-03-14T06:35:11.1259533Z  2025-03-14T06:35:11.1259997Z  2025-03-14T06:35:11.1260415Z  2025-03-14T06:35:11.1260844Z  2025-03-14T06:35:11.1261260Z  2025-03-14T06:35:11.1261666Z  2025-03-14T06:35:11.1262074Z  2025-03-14T06:35:11.1263303Z [17,649 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:11.1264493Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T06:35:11.1265799Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 50s local 2025-03-14T06:35:11.1266913Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T06:35:11.1267947Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T06:35:11.1269003Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T06:35:11.1270037Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T06:35:11.1271082Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T06:35:11.1272348Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local ... 2025-03-14T06:35:11.3710539Z 2025-03-14T06:35:11.3711386Z  2025-03-14T06:35:11.3711863Z  2025-03-14T06:35:11.3712289Z  2025-03-14T06:35:11.3712744Z  2025-03-14T06:35:11.3713155Z  2025-03-14T06:35:11.3713608Z  2025-03-14T06:35:11.3714013Z  2025-03-14T06:35:11.3714549Z  2025-03-14T06:35:11.3715480Z [17,652 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:11.3716600Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T06:35:11.3717754Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T06:35:11.3719140Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T06:35:11.3720200Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T06:35:11.3721177Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T06:35:11.3722122Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T06:35:11.3722997Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T06:35:11.3724019Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 26s local ... 2025-03-14T06:35:11.6135196Z 2025-03-14T06:35:11.6136083Z  2025-03-14T06:35:11.6136817Z  2025-03-14T06:35:11.6137196Z  2025-03-14T06:35:11.6137557Z  2025-03-14T06:35:11.6137957Z  2025-03-14T06:35:11.6138343Z  2025-03-14T06:35:11.6138742Z  2025-03-14T06:35:11.6139173Z  2025-03-14T06:35:11.6140127Z [17,653 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:11.6141264Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T06:35:11.6142340Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T06:35:11.6143499Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T06:35:11.6144544Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 49s local 2025-03-14T06:35:11.6145560Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T06:35:11.6146478Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T06:35:11.6147609Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T06:35:11.6148730Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local ... 2025-03-14T06:35:11.8690980Z 2025-03-14T06:35:11.8691877Z  2025-03-14T06:35:11.8692386Z  2025-03-14T06:35:11.8692796Z  2025-03-14T06:35:11.8693215Z  2025-03-14T06:35:11.8693631Z  2025-03-14T06:35:11.8694087Z  2025-03-14T06:35:11.8694622Z  2025-03-14T06:35:11.8695025Z  2025-03-14T06:35:11.8695997Z [17,656 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:11.8697245Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T06:35:11.8698367Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 51s local 2025-03-14T06:35:11.8699718Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T06:35:11.8700806Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T06:35:11.8701847Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T06:35:11.8702837Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T06:35:11.8703834Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 29s local 2025-03-14T06:35:11.8704931Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local ... 2025-03-14T06:35:12.2141966Z 2025-03-14T06:35:12.2142801Z  2025-03-14T06:35:12.2143283Z  2025-03-14T06:35:12.2143674Z  2025-03-14T06:35:12.2144059Z  2025-03-14T06:35:12.2144451Z  2025-03-14T06:35:12.2145128Z  2025-03-14T06:35:12.2145541Z  2025-03-14T06:35:12.2145944Z  2025-03-14T06:35:12.2146892Z [17,656 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:12.2148170Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T06:35:12.2149287Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T06:35:12.2150441Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T06:35:12.2151530Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T06:35:12.2152622Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2025-03-14T06:35:12.2153665Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T06:35:12.2154930Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T06:35:12.2155995Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local ... 2025-03-14T06:35:12.4145973Z 2025-03-14T06:35:12.4146841Z  2025-03-14T06:35:12.4147324Z  2025-03-14T06:35:12.4147740Z  2025-03-14T06:35:12.4148139Z  2025-03-14T06:35:12.4148530Z  2025-03-14T06:35:12.4148940Z  2025-03-14T06:35:12.4149370Z  2025-03-14T06:35:12.4149775Z  2025-03-14T06:35:12.4150990Z [17,658 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:12.4152170Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T06:35:12.4153237Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T06:35:12.4154338Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T06:35:12.4155433Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 50s local 2025-03-14T06:35:12.4156465Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2025-03-14T06:35:12.4157386Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T06:35:12.4158418Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T06:35:12.4159499Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 27s local ... 2025-03-14T06:35:12.7694997Z 2025-03-14T06:35:12.7695865Z  2025-03-14T06:35:12.7696348Z  2025-03-14T06:35:12.7696757Z  2025-03-14T06:35:12.7697140Z  2025-03-14T06:35:12.7697549Z  2025-03-14T06:35:12.7697940Z  2025-03-14T06:35:12.7698337Z  2025-03-14T06:35:12.7698709Z  2025-03-14T06:35:12.7699685Z [17,660 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:12.7700843Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T06:35:12.7701998Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T06:35:12.7703154Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T06:35:12.7704231Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T06:35:12.7705244Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2025-03-14T06:35:12.7706214Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2025-03-14T06:35:12.7707509Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T06:35:12.7708628Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local ... 2025-03-14T06:35:13.0151552Z 2025-03-14T06:35:13.0152428Z  2025-03-14T06:35:13.0153068Z  2025-03-14T06:35:13.0153519Z  2025-03-14T06:35:13.0153946Z  2025-03-14T06:35:13.0154387Z  2025-03-14T06:35:13.0154817Z  2025-03-14T06:35:13.0155245Z  2025-03-14T06:35:13.0155673Z  2025-03-14T06:35:13.0156708Z [17,660 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:13.0157852Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T06:35:13.0159187Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 52s local 2025-03-14T06:35:13.0160401Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T06:35:13.0161544Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T06:35:13.0162621Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T06:35:13.0163639Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2025-03-14T06:35:13.0164826Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 30s local 2025-03-14T06:35:13.0165964Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local ... 2025-03-14T06:35:13.4156802Z 2025-03-14T06:35:13.4157639Z  2025-03-14T06:35:13.4158022Z  2025-03-14T06:35:13.4158582Z  2025-03-14T06:35:13.4158902Z  2025-03-14T06:35:13.4159211Z  2025-03-14T06:35:13.4159546Z  2025-03-14T06:35:13.4159956Z  2025-03-14T06:35:13.4160337Z  2025-03-14T06:35:13.4161251Z [17,661 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:13.4162352Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T06:35:13.4163362Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T06:35:13.4164766Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T06:35:13.4165979Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 51s local 2025-03-14T06:35:13.4166931Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T06:35:13.4167961Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2025-03-14T06:35:13.4168904Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T06:35:13.4169880Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 28s local ... 2025-03-14T06:35:13.6779997Z 2025-03-14T06:35:13.6780808Z  2025-03-14T06:35:13.6781294Z  2025-03-14T06:35:13.6781645Z  2025-03-14T06:35:13.6782017Z  2025-03-14T06:35:13.6782377Z  2025-03-14T06:35:13.6782737Z  2025-03-14T06:35:13.6783344Z  2025-03-14T06:35:13.6783850Z  2025-03-14T06:35:13.6784989Z [17,664 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:13.6786196Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T06:35:13.6787303Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T06:35:13.6788432Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T06:35:13.6789538Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T06:35:13.6790611Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T06:35:13.6791629Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T06:35:13.6792685Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T06:35:13.6793795Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local ... 2025-03-14T06:35:13.9580438Z 2025-03-14T06:35:13.9581326Z  2025-03-14T06:35:13.9581820Z  2025-03-14T06:35:13.9582226Z  2025-03-14T06:35:13.9582870Z  2025-03-14T06:35:13.9583297Z  2025-03-14T06:35:13.9583689Z  2025-03-14T06:35:13.9584071Z  2025-03-14T06:35:13.9584487Z  2025-03-14T06:35:13.9585556Z [17,666 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:13.9586622Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T06:35:13.9587689Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 53s local 2025-03-14T06:35:13.9588766Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T06:35:13.9589804Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T06:35:13.9591037Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T06:35:13.9591979Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T06:35:13.9592957Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 31s local 2025-03-14T06:35:13.9593982Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local ... 2025-03-14T06:35:14.2161233Z 2025-03-14T06:35:14.2162076Z  2025-03-14T06:35:14.2162670Z  2025-03-14T06:35:14.2163104Z  2025-03-14T06:35:14.2163455Z  2025-03-14T06:35:14.2163836Z  2025-03-14T06:35:14.2164219Z  2025-03-14T06:35:14.2164743Z  2025-03-14T06:35:14.2165148Z  2025-03-14T06:35:14.2166341Z [17,667 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:14.2167730Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T06:35:14.2169220Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T06:35:14.2170501Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T06:35:14.2171693Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T06:35:14.2172846Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T06:35:14.2173857Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T06:35:14.2175102Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T06:35:14.2176212Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local ... 2025-03-14T06:35:14.4354865Z 2025-03-14T06:35:14.4355812Z  2025-03-14T06:35:14.4356271Z  2025-03-14T06:35:14.4356666Z  2025-03-14T06:35:14.4357014Z  2025-03-14T06:35:14.4357393Z  2025-03-14T06:35:14.4357738Z  2025-03-14T06:35:14.4358101Z  2025-03-14T06:35:14.4358436Z  2025-03-14T06:35:14.4359316Z [17,668 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:14.4360508Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T06:35:14.4361677Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T06:35:14.4362877Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T06:35:14.4363929Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 52s local 2025-03-14T06:35:14.4365051Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T06:35:14.4366132Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T06:35:14.4366954Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T06:35:14.4367908Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 29s local ... 2025-03-14T06:35:14.8042633Z 2025-03-14T06:35:14.8043481Z  2025-03-14T06:35:14.8043978Z  2025-03-14T06:35:14.8044377Z  2025-03-14T06:35:14.8044913Z  2025-03-14T06:35:14.8045347Z  2025-03-14T06:35:14.8045732Z  2025-03-14T06:35:14.8046131Z  2025-03-14T06:35:14.8046515Z  2025-03-14T06:35:14.8047444Z [17,670 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:14.8048833Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T06:35:14.8049913Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T06:35:14.8050970Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T06:35:14.8051948Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T06:35:14.8052929Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T06:35:14.8053876Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T06:35:14.8054872Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T06:35:14.8055832Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local ... 2025-03-14T06:35:15.0171521Z 2025-03-14T06:35:15.0172362Z  2025-03-14T06:35:15.0172851Z  2025-03-14T06:35:15.0173238Z  2025-03-14T06:35:15.0173635Z  2025-03-14T06:35:15.0174057Z  2025-03-14T06:35:15.0174509Z  2025-03-14T06:35:15.0174848Z  2025-03-14T06:35:15.0175224Z  2025-03-14T06:35:15.0176197Z [17,672 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:15.0177350Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T06:35:15.0178449Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 54s local 2025-03-14T06:35:15.0179498Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T06:35:15.0180767Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T06:35:15.0181775Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T06:35:15.0182749Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T06:35:15.0183806Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 32s local 2025-03-14T06:35:15.0184907Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local ... 2025-03-14T06:35:15.2176612Z 2025-03-14T06:35:15.2177480Z  2025-03-14T06:35:15.2178015Z  2025-03-14T06:35:15.2178420Z  2025-03-14T06:35:15.2179083Z  2025-03-14T06:35:15.2179511Z  2025-03-14T06:35:15.2179927Z  2025-03-14T06:35:15.2180335Z  2025-03-14T06:35:15.2192088Z  2025-03-14T06:35:15.2193109Z [17,673 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:15.2194255Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T06:35:15.2195315Z Compiling .../transforms/simplifiers/algebraic_simplifier.cc; 55s local 2025-03-14T06:35:15.2196382Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T06:35:15.2197426Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T06:35:15.2198411Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T06:35:15.2199367Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T06:35:15.2200335Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T06:35:15.2201322Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local ... 2025-03-14T06:35:15.5122472Z 2025-03-14T06:35:15.5123352Z  2025-03-14T06:35:15.5123809Z  2025-03-14T06:35:15.5124182Z  2025-03-14T06:35:15.5124729Z  2025-03-14T06:35:15.5125116Z  2025-03-14T06:35:15.5125502Z  2025-03-14T06:35:15.5125858Z  2025-03-14T06:35:15.5126242Z  2025-03-14T06:35:15.5127109Z [17,675 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:15.5128204Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T06:35:15.5129182Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T06:35:15.5130125Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 53s local 2025-03-14T06:35:15.5131332Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T06:35:15.5132244Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T06:35:15.5133222Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T06:35:15.5134203Z Compiling llvm/lib/Frontend/OpenMP/OMPIRBuilder.cpp; 30s local 2025-03-14T06:35:15.5135023Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local ... 2025-03-14T06:35:15.7892618Z 2025-03-14T06:35:15.7893423Z  2025-03-14T06:35:15.7893898Z  2025-03-14T06:35:15.7894297Z  2025-03-14T06:35:15.7894643Z  2025-03-14T06:35:15.7895028Z  2025-03-14T06:35:15.7895434Z  2025-03-14T06:35:15.7895850Z  2025-03-14T06:35:15.7896246Z  2025-03-14T06:35:15.7897515Z [17,676 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:15.7898567Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T06:35:15.7899600Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T06:35:15.7900629Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T06:35:15.7901505Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T06:35:15.7902433Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T06:35:15.7903383Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T06:35:15.7904262Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local 2025-03-14T06:35:15.7905378Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:35:16.0181011Z 2025-03-14T06:35:16.0181857Z  2025-03-14T06:35:16.0182341Z  2025-03-14T06:35:16.0182783Z  2025-03-14T06:35:16.0183202Z  2025-03-14T06:35:16.0183615Z  2025-03-14T06:35:16.0183982Z  2025-03-14T06:35:16.0184355Z  2025-03-14T06:35:16.0184731Z  2025-03-14T06:35:16.0185700Z [17,676 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:16.0187139Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T06:35:16.0188228Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T06:35:16.0189270Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T06:35:16.0190264Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T06:35:16.0191175Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T06:35:16.0192099Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 33s local 2025-03-14T06:35:16.0192951Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T06:35:16.0193707Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:35:16.3077502Z 2025-03-14T06:35:16.3078368Z  2025-03-14T06:35:16.3078826Z  2025-03-14T06:35:16.3079189Z  2025-03-14T06:35:16.3079560Z  2025-03-14T06:35:16.3079938Z  2025-03-14T06:35:16.3080308Z  2025-03-14T06:35:16.3080665Z  2025-03-14T06:35:16.3081065Z  2025-03-14T06:35:16.3081998Z [17,677 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:16.3082987Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T06:35:16.3084102Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T06:35:16.3085309Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T06:35:16.3086316Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T06:35:16.3087236Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T06:35:16.3088184Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T06:35:16.3089100Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T06:35:16.3089893Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:35:16.6187086Z 2025-03-14T06:35:16.6187972Z  2025-03-14T06:35:16.6188470Z  2025-03-14T06:35:16.6188888Z  2025-03-14T06:35:16.6189289Z  2025-03-14T06:35:16.6189669Z  2025-03-14T06:35:16.6190055Z  2025-03-14T06:35:16.6190412Z  2025-03-14T06:35:16.6190765Z  2025-03-14T06:35:16.6191696Z [17,678 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:16.6192715Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T06:35:16.6193686Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T06:35:16.6194689Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 54s local 2025-03-14T06:35:16.6195844Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T06:35:16.6196744Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T06:35:16.6197641Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T06:35:16.6198551Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T06:35:16.6199387Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:35:17.0190329Z 2025-03-14T06:35:17.0191269Z  2025-03-14T06:35:17.0191764Z  2025-03-14T06:35:17.0192153Z  2025-03-14T06:35:17.0192532Z  2025-03-14T06:35:17.0192954Z  2025-03-14T06:35:17.0193323Z  2025-03-14T06:35:17.0193728Z  2025-03-14T06:35:17.0194109Z  2025-03-14T06:35:17.0195482Z [17,680 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:17.0196594Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T06:35:17.0197647Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T06:35:17.0198677Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T06:35:17.0199626Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T06:35:17.0200573Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T06:35:17.0201692Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 34s local 2025-03-14T06:35:17.0202523Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2025-03-14T06:35:17.0203428Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2025-03-14T06:35:17.2597660Z 2025-03-14T06:35:17.2598638Z  2025-03-14T06:35:17.2599099Z  2025-03-14T06:35:17.2599515Z  2025-03-14T06:35:17.2599866Z  2025-03-14T06:35:17.2600246Z  2025-03-14T06:35:17.2600603Z  2025-03-14T06:35:17.2600981Z  2025-03-14T06:35:17.2601346Z  2025-03-14T06:35:17.2602251Z [17,681 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:17.2603391Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T06:35:17.2604590Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T06:35:17.2605630Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T06:35:17.2606547Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T06:35:17.2607442Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T06:35:17.2608382Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T06:35:17.2609246Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2025-03-14T06:35:17.2610194Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2025-03-14T06:35:17.6196167Z 2025-03-14T06:35:17.6197085Z  2025-03-14T06:35:17.6197517Z  2025-03-14T06:35:17.6197931Z  2025-03-14T06:35:17.6198302Z  2025-03-14T06:35:17.6198662Z  2025-03-14T06:35:17.6199010Z  2025-03-14T06:35:17.6199381Z  2025-03-14T06:35:17.6199751Z  2025-03-14T06:35:17.6201259Z [17,681 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:17.6202506Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2025-03-14T06:35:17.6203571Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2025-03-14T06:35:17.6204610Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 55s local 2025-03-14T06:35:17.6205567Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T06:35:17.6206457Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T06:35:17.6207417Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T06:35:17.6208231Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2025-03-14T06:35:17.6209243Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 16s local ... 2025-03-14T06:35:17.8211528Z 2025-03-14T06:35:17.8212296Z  2025-03-14T06:35:17.8212718Z  2025-03-14T06:35:17.8213092Z  2025-03-14T06:35:17.8213455Z  2025-03-14T06:35:17.8213823Z  2025-03-14T06:35:17.8214183Z  2025-03-14T06:35:17.8214561Z  2025-03-14T06:35:17.8214906Z  2025-03-14T06:35:17.8215772Z [17,682 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:17.8216803Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2025-03-14T06:35:17.8217730Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2025-03-14T06:35:17.8218647Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2025-03-14T06:35:17.8219798Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T06:35:17.8220695Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T06:35:17.8221625Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 35s local 2025-03-14T06:35:17.8222415Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T06:35:17.8223278Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 17s local ... 2025-03-14T06:35:18.2203001Z 2025-03-14T06:35:18.2203856Z  2025-03-14T06:35:18.2204272Z  2025-03-14T06:35:18.2205187Z  2025-03-14T06:35:18.2205559Z  2025-03-14T06:35:18.2205907Z  2025-03-14T06:35:18.2206263Z  2025-03-14T06:35:18.2206620Z  2025-03-14T06:35:18.2206983Z  2025-03-14T06:35:18.2207830Z [17,684 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:18.2208775Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2025-03-14T06:35:18.2209632Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2025-03-14T06:35:18.2210480Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2025-03-14T06:35:18.2211303Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T06:35:18.2212082Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T06:35:18.2212889Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T06:35:18.2213627Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T06:35:18.2214408Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 17s local ... 2025-03-14T06:35:18.4791112Z 2025-03-14T06:35:18.4791988Z  2025-03-14T06:35:18.4792448Z  2025-03-14T06:35:18.4792841Z  2025-03-14T06:35:18.4793236Z  2025-03-14T06:35:18.4793603Z  2025-03-14T06:35:18.4793975Z  2025-03-14T06:35:18.4794353Z  2025-03-14T06:35:18.4794771Z  2025-03-14T06:35:18.4795687Z [17,685 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:18.4796804Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T06:35:18.4797890Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T06:35:18.4798944Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 56s local 2025-03-14T06:35:18.4802244Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T06:35:18.4803508Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T06:35:18.4804690Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T06:35:18.4805601Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T06:35:18.4806590Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 17s local ... 2025-03-14T06:35:18.7604894Z 2025-03-14T06:35:18.7605958Z  2025-03-14T06:35:18.7606490Z  2025-03-14T06:35:18.7606887Z  2025-03-14T06:35:18.7607537Z  2025-03-14T06:35:18.7607984Z  2025-03-14T06:35:18.7608499Z  2025-03-14T06:35:18.7609055Z  2025-03-14T06:35:18.7609857Z  2025-03-14T06:35:18.7610885Z [17,687 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:18.7612156Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T06:35:18.7613351Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T06:35:18.7614585Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T06:35:18.7615739Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T06:35:18.7616856Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T06:35:18.7617982Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T06:35:18.7619044Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T06:35:18.7620363Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2025-03-14T06:35:19.0209624Z 2025-03-14T06:35:19.0210581Z  2025-03-14T06:35:19.0211092Z  2025-03-14T06:35:19.0211530Z  2025-03-14T06:35:19.0211901Z  2025-03-14T06:35:19.0212269Z  2025-03-14T06:35:19.0212640Z  2025-03-14T06:35:19.0213046Z  2025-03-14T06:35:19.0213432Z  2025-03-14T06:35:19.0214370Z [17,689 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:19.0215801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T06:35:19.0216875Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T06:35:19.0217930Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T06:35:19.0218944Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T06:35:19.0219868Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T06:35:19.0220857Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 36s local 2025-03-14T06:35:19.0221773Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T06:35:19.0222744Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2025-03-14T06:35:19.2213044Z 2025-03-14T06:35:19.2214126Z  2025-03-14T06:35:19.2214619Z  2025-03-14T06:35:19.2215013Z  2025-03-14T06:35:19.2215451Z  2025-03-14T06:35:19.2215845Z  2025-03-14T06:35:19.2216240Z  2025-03-14T06:35:19.2216646Z  2025-03-14T06:35:19.2217061Z  2025-03-14T06:35:19.2218028Z [17,690 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:19.2219159Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T06:35:19.2220179Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T06:35:19.2221252Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T06:35:19.2222259Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T06:35:19.2223207Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T06:35:19.2224355Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T06:35:19.2225304Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T06:35:19.2226531Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local ... 2025-03-14T06:35:19.5996166Z 2025-03-14T06:35:19.5997314Z  2025-03-14T06:35:19.5998089Z  2025-03-14T06:35:19.5998775Z  2025-03-14T06:35:19.5999224Z  2025-03-14T06:35:19.5999689Z  2025-03-14T06:35:19.6000049Z  2025-03-14T06:35:19.6000449Z  2025-03-14T06:35:19.6000841Z  2025-03-14T06:35:19.6001813Z [17,692 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:19.6002893Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T06:35:19.6003948Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T06:35:19.6005507Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 57s local 2025-03-14T06:35:19.6006542Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T06:35:19.6007380Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T06:35:19.6008092Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T06:35:19.6009022Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 18s local 2025-03-14T06:35:19.6010143Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local ... 2025-03-14T06:35:19.8218821Z 2025-03-14T06:35:19.8219793Z  2025-03-14T06:35:19.8220359Z  2025-03-14T06:35:19.8220853Z  2025-03-14T06:35:19.8221349Z  2025-03-14T06:35:19.8221733Z  2025-03-14T06:35:19.8222368Z  2025-03-14T06:35:19.8222730Z  2025-03-14T06:35:19.8223131Z  2025-03-14T06:35:19.8224094Z [17,692 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:19.8225211Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T06:35:19.8226267Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T06:35:19.8227309Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T06:35:19.8228285Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T06:35:19.8229471Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 37s local 2025-03-14T06:35:19.8230521Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T06:35:19.8231404Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 19s local 2025-03-14T06:35:19.8232473Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local ... 2025-03-14T06:35:20.3136220Z 2025-03-14T06:35:20.3137311Z  2025-03-14T06:35:20.3138056Z  2025-03-14T06:35:20.3138692Z  2025-03-14T06:35:20.3139123Z  2025-03-14T06:35:20.3139577Z  2025-03-14T06:35:20.3139927Z  2025-03-14T06:35:20.3140243Z  2025-03-14T06:35:20.3140564Z  2025-03-14T06:35:20.3141367Z [17,693 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:20.3142430Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T06:35:20.3143363Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T06:35:20.3144310Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T06:35:20.3145243Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T06:35:20.3146192Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T06:35:20.3147071Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T06:35:20.3147959Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 19s local 2025-03-14T06:35:20.3149075Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 17s local ... 2025-03-14T06:35:20.5981535Z 2025-03-14T06:35:20.5982377Z  2025-03-14T06:35:20.5982962Z  2025-03-14T06:35:20.5983411Z  2025-03-14T06:35:20.5983845Z  2025-03-14T06:35:20.5984381Z  2025-03-14T06:35:20.5984875Z  2025-03-14T06:35:20.5985666Z  2025-03-14T06:35:20.5986196Z  2025-03-14T06:35:20.5987351Z [17,694 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:20.5988748Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T06:35:20.5989937Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T06:35:20.5990881Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 58s local 2025-03-14T06:35:20.5991785Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T06:35:20.5992933Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T06:35:20.5993781Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T06:35:20.5994789Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 19s local 2025-03-14T06:35:20.5995894Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local ... 2025-03-14T06:35:20.8226834Z 2025-03-14T06:35:20.8228079Z  2025-03-14T06:35:20.8228501Z  2025-03-14T06:35:20.8228861Z  2025-03-14T06:35:20.8229252Z  2025-03-14T06:35:20.8229642Z  2025-03-14T06:35:20.8230060Z  2025-03-14T06:35:20.8230471Z  2025-03-14T06:35:20.8230865Z  2025-03-14T06:35:20.8231813Z [17,696 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:35:20.8232979Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T06:35:20.8234299Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T06:35:20.8235356Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T06:35:20.8236392Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T06:35:20.8237619Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T06:35:20.8238761Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T06:35:20.8239904Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local 2025-03-14T06:35:20.8241378Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local ... 2025-03-14T06:35:21.0231621Z 2025-03-14T06:35:21.0232444Z  2025-03-14T06:35:21.0233395Z  2025-03-14T06:35:21.0233939Z  2025-03-14T06:35:21.0234501Z  2025-03-14T06:35:21.0235021Z  2025-03-14T06:35:21.0235489Z  2025-03-14T06:35:21.0236002Z  2025-03-14T06:35:21.0236382Z  2025-03-14T06:35:21.0237412Z [17,696 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:21.0238532Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T06:35:21.0239677Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T06:35:21.0240768Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T06:35:21.0241914Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2025-03-14T06:35:21.0242900Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 38s local 2025-03-14T06:35:21.0243960Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T06:35:21.0245062Z Compiling mlir/lib/Dialect/ArmSVE/IR/ArmSVEDialect.cpp; 20s local 2025-03-14T06:35:21.0246214Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local ... 2025-03-14T06:35:21.3621941Z 2025-03-14T06:35:21.3623336Z  2025-03-14T06:35:21.3623873Z  2025-03-14T06:35:21.3624262Z  2025-03-14T06:35:21.3624692Z  2025-03-14T06:35:21.3625079Z  2025-03-14T06:35:21.3625474Z  2025-03-14T06:35:21.3625880Z  2025-03-14T06:35:21.3626281Z  2025-03-14T06:35:21.3627169Z [17,699 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:21.3628180Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T06:35:21.3629504Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T06:35:21.3630340Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T06:35:21.3631190Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2025-03-14T06:35:21.3632170Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T06:35:21.3633069Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T06:35:21.3634036Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 18s local 2025-03-14T06:35:21.3635260Z .../memory_space_assignment:memory_bound_loop_optimizer; 17s local ... 2025-03-14T06:35:21.6238225Z 2025-03-14T06:35:21.6239797Z  2025-03-14T06:35:21.6240265Z  2025-03-14T06:35:21.6241717Z  2025-03-14T06:35:21.6242506Z  2025-03-14T06:35:21.6243744Z  2025-03-14T06:35:21.6244877Z  2025-03-14T06:35:21.6245906Z  2025-03-14T06:35:21.6247189Z  2025-03-14T06:35:21.6248967Z [17,700 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:21.6250068Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T06:35:21.6251015Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T06:35:21.6251947Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 59s local 2025-03-14T06:35:21.6252896Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2025-03-14T06:35:21.6253792Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T06:35:21.6254923Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T06:35:21.6255788Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2025-03-14T06:35:21.6256801Z .../memory_space_assignment:memory_bound_loop_optimizer; 17s local ... 2025-03-14T06:35:21.8734881Z 2025-03-14T06:35:21.8735902Z  2025-03-14T06:35:21.8736399Z  2025-03-14T06:35:21.8736806Z  2025-03-14T06:35:21.8737221Z  2025-03-14T06:35:21.8737655Z  2025-03-14T06:35:21.8738077Z  2025-03-14T06:35:21.8738500Z  2025-03-14T06:35:21.8738898Z  2025-03-14T06:35:21.8740306Z [17,701 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:21.8741503Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T06:35:21.8742532Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T06:35:21.8743593Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T06:35:21.8744621Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2025-03-14T06:35:21.8745659Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 39s local 2025-03-14T06:35:21.8746591Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T06:35:21.8747520Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2025-03-14T06:35:21.8748627Z .../memory_space_assignment:memory_bound_loop_optimizer; 17s local ... 2025-03-14T06:35:22.2244357Z 2025-03-14T06:35:22.2245823Z  2025-03-14T06:35:22.2246311Z  2025-03-14T06:35:22.2246719Z  2025-03-14T06:35:22.2247092Z  2025-03-14T06:35:22.2247592Z  2025-03-14T06:35:22.2247972Z  2025-03-14T06:35:22.2248361Z  2025-03-14T06:35:22.2248782Z  2025-03-14T06:35:22.2249757Z [17,703 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:22.2250965Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T06:35:22.2252024Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T06:35:22.2253139Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 60s local 2025-03-14T06:35:22.2254123Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2025-03-14T06:35:22.2255090Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T06:35:22.2256298Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T06:35:22.2257314Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 19s local 2025-03-14T06:35:22.2258456Z .../memory_space_assignment:memory_bound_loop_optimizer; 17s local ... 2025-03-14T06:35:22.7868096Z 2025-03-14T06:35:22.7869412Z  2025-03-14T06:35:22.7869888Z  2025-03-14T06:35:22.7870262Z  2025-03-14T06:35:22.7870633Z  2025-03-14T06:35:22.7870991Z  2025-03-14T06:35:22.7871350Z  2025-03-14T06:35:22.7871754Z  2025-03-14T06:35:22.7872107Z  2025-03-14T06:35:22.7872978Z [17,704 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:22.7874231Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2025-03-14T06:35:22.7875193Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2025-03-14T06:35:22.7876146Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2025-03-14T06:35:22.7877042Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2025-03-14T06:35:22.7877947Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T06:35:22.7878761Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T06:35:22.7879641Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2025-03-14T06:35:22.7880635Z .../memory_space_assignment:memory_bound_loop_optimizer; 18s local ... 2025-03-14T06:35:23.0251829Z 2025-03-14T06:35:23.0252980Z  2025-03-14T06:35:23.0253510Z  2025-03-14T06:35:23.0253928Z  2025-03-14T06:35:23.0254328Z  2025-03-14T06:35:23.0254759Z  2025-03-14T06:35:23.0255310Z  2025-03-14T06:35:23.0255711Z  2025-03-14T06:35:23.0256097Z  2025-03-14T06:35:23.0257042Z [17,705 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:23.0258187Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2025-03-14T06:35:23.0259217Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2025-03-14T06:35:23.0260483Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 61s local 2025-03-14T06:35:23.0261390Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2025-03-14T06:35:23.0262311Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 40s local 2025-03-14T06:35:23.0263248Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2025-03-14T06:35:23.0264221Z Compiling llvm/lib/Transforms/Scalar/LoopStrengthReduce.cpp; 20s local 2025-03-14T06:35:23.0265570Z .../memory_space_assignment:memory_bound_loop_optimizer; 18s local ... 2025-03-14T06:35:23.6467267Z 2025-03-14T06:35:23.6468166Z  2025-03-14T06:35:23.6468648Z  2025-03-14T06:35:23.6469103Z  2025-03-14T06:35:23.6469478Z  2025-03-14T06:35:23.6469893Z  2025-03-14T06:35:23.6470306Z  2025-03-14T06:35:23.6470699Z  2025-03-14T06:35:23.6471102Z  2025-03-14T06:35:23.6471964Z [17,706 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:23.6473024Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T06:35:23.6474035Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2025-03-14T06:35:23.6475575Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2025-03-14T06:35:23.6476691Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2025-03-14T06:35:23.6477803Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2025-03-14T06:35:23.6478900Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2025-03-14T06:35:23.6479950Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2025-03-14T06:35:23.6481028Z Compiling stablehlo/dialect/VhloOps.cpp; 17s local ... 2025-03-14T06:35:24.0259775Z 2025-03-14T06:35:24.0260581Z  2025-03-14T06:35:24.0261365Z  2025-03-14T06:35:24.0261852Z  2025-03-14T06:35:24.0262255Z  2025-03-14T06:35:24.0262671Z  2025-03-14T06:35:24.0263100Z  2025-03-14T06:35:24.0263525Z  2025-03-14T06:35:24.0263928Z  2025-03-14T06:35:24.0264879Z [17,708 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:24.0266427Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T06:35:24.0267540Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2025-03-14T06:35:24.0268659Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2025-03-14T06:35:24.0269624Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T06:35:24.0270825Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 41s local 2025-03-14T06:35:24.0271749Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T06:35:24.0272689Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 19s local 2025-03-14T06:35:24.0273686Z Compiling stablehlo/dialect/VhloOps.cpp; 18s local ... 2025-03-14T06:35:24.4266293Z 2025-03-14T06:35:24.4267300Z  2025-03-14T06:35:24.4267853Z  2025-03-14T06:35:24.4268287Z  2025-03-14T06:35:24.4268718Z  2025-03-14T06:35:24.4269111Z  2025-03-14T06:35:24.4269541Z  2025-03-14T06:35:24.4269953Z  2025-03-14T06:35:24.4270371Z  2025-03-14T06:35:24.4271353Z [17,711 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:24.4272914Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T06:35:24.4273987Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T06:35:24.4275081Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 62s local 2025-03-14T06:35:24.4276160Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T06:35:24.4277198Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2025-03-14T06:35:24.4278202Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T06:35:24.4279395Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2025-03-14T06:35:24.4280408Z Compiling stablehlo/dialect/VhloOps.cpp; 18s local ... 2025-03-14T06:35:24.9745004Z 2025-03-14T06:35:24.9746357Z  2025-03-14T06:35:24.9746972Z  2025-03-14T06:35:24.9748388Z  2025-03-14T06:35:24.9749302Z  2025-03-14T06:35:24.9750553Z  2025-03-14T06:35:24.9751918Z  2025-03-14T06:35:24.9753265Z  2025-03-14T06:35:24.9754498Z  2025-03-14T06:35:24.9756226Z [17,712 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:24.9757415Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T06:35:24.9758484Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T06:35:24.9759550Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T06:35:24.9760565Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T06:35:24.9761551Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 42s local 2025-03-14T06:35:24.9762434Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T06:35:24.9763310Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2025-03-14T06:35:24.9764211Z Compiling stablehlo/dialect/VhloOps.cpp; 19s local ... 2025-03-14T06:35:25.2272917Z 2025-03-14T06:35:25.2274274Z  2025-03-14T06:35:25.2274748Z  2025-03-14T06:35:25.2276065Z  2025-03-14T06:35:25.2277020Z  2025-03-14T06:35:25.2277996Z  2025-03-14T06:35:25.2279239Z  2025-03-14T06:35:25.2280407Z  2025-03-14T06:35:25.2281896Z  2025-03-14T06:35:25.2283457Z [17,712 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:25.2284997Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T06:35:25.2286039Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T06:35:25.2287035Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T06:35:25.2287991Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T06:35:25.2288879Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T06:35:25.2289738Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T06:35:25.2290620Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 20s local 2025-03-14T06:35:25.2291557Z Compiling stablehlo/dialect/VhloOps.cpp; 19s local ... 2025-03-14T06:35:25.4290827Z 2025-03-14T06:35:25.4292192Z  2025-03-14T06:35:25.4292628Z  2025-03-14T06:35:25.4294142Z  2025-03-14T06:35:25.4295095Z  2025-03-14T06:35:25.4296336Z  2025-03-14T06:35:25.4297467Z  2025-03-14T06:35:25.4298858Z  2025-03-14T06:35:25.4299915Z  2025-03-14T06:35:25.4301685Z [17,713 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:25.4302754Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T06:35:25.4303765Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T06:35:25.4304952Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 63s local 2025-03-14T06:35:25.4306148Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T06:35:25.4307382Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T06:35:25.4308270Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T06:35:25.4309189Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 21s local 2025-03-14T06:35:25.4310342Z Compiling stablehlo/dialect/VhloOps.cpp; 19s local ... 2025-03-14T06:35:25.8278581Z 2025-03-14T06:35:25.8280020Z  2025-03-14T06:35:25.8280479Z  2025-03-14T06:35:25.8280863Z  2025-03-14T06:35:25.8281261Z  2025-03-14T06:35:25.8281645Z  2025-03-14T06:35:25.8282287Z  2025-03-14T06:35:25.8282718Z  2025-03-14T06:35:25.8283127Z  2025-03-14T06:35:25.8284099Z [17,713 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:25.8285410Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T06:35:25.8286451Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T06:35:25.8287513Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T06:35:25.8288511Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T06:35:25.8289497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T06:35:25.8290415Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T06:35:25.8291402Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 21s local 2025-03-14T06:35:25.8292414Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local ... 2025-03-14T06:35:26.0282595Z 2025-03-14T06:35:26.0283671Z  2025-03-14T06:35:26.0284227Z  2025-03-14T06:35:26.0284888Z  2025-03-14T06:35:26.0285339Z  2025-03-14T06:35:26.0285829Z  2025-03-14T06:35:26.0286293Z  2025-03-14T06:35:26.0286796Z  2025-03-14T06:35:26.0287143Z  2025-03-14T06:35:26.0287999Z [17,714 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:26.0289267Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T06:35:26.0290507Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T06:35:26.0291638Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T06:35:26.0292702Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T06:35:26.0294085Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 43s local 2025-03-14T06:35:26.0295249Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T06:35:26.0296329Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 21s local 2025-03-14T06:35:26.0297218Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local ... 2025-03-14T06:35:26.3719682Z 2025-03-14T06:35:26.3720532Z  2025-03-14T06:35:26.3721019Z  2025-03-14T06:35:26.3721433Z  2025-03-14T06:35:26.3721878Z  2025-03-14T06:35:26.3722268Z  2025-03-14T06:35:26.3722665Z  2025-03-14T06:35:26.3723070Z  2025-03-14T06:35:26.3723459Z  2025-03-14T06:35:26.3724360Z [17,716 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:26.3725940Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T06:35:26.3726930Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:26.3727963Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T06:35:26.3728982Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T06:35:26.3729962Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2025-03-14T06:35:26.3730856Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T06:35:26.3731823Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 22s local 2025-03-14T06:35:26.3732748Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local ... 2025-03-14T06:35:26.6287980Z 2025-03-14T06:35:26.6288852Z  2025-03-14T06:35:26.6289365Z  2025-03-14T06:35:26.6289898Z  2025-03-14T06:35:26.6290464Z  2025-03-14T06:35:26.6290946Z  2025-03-14T06:35:26.6291392Z  2025-03-14T06:35:26.6291918Z  2025-03-14T06:35:26.6292437Z  2025-03-14T06:35:26.6293612Z [17,718 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:26.6294895Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T06:35:26.6296060Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:26.6297216Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 64s local 2025-03-14T06:35:26.6298316Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T06:35:26.6299675Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2025-03-14T06:35:26.6300640Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T06:35:26.6301570Z .../service/memory_space_assignment:memory_bound_loop_optimizer; 22s local 2025-03-14T06:35:26.6302511Z Compiling stablehlo/dialect/VhloOps.cpp; 20s local ... 2025-03-14T06:35:26.8441391Z 2025-03-14T06:35:26.8442248Z  2025-03-14T06:35:26.8442643Z  2025-03-14T06:35:26.8442964Z  2025-03-14T06:35:26.8443276Z  2025-03-14T06:35:26.8443586Z  2025-03-14T06:35:26.8443924Z  2025-03-14T06:35:26.8444239Z  2025-03-14T06:35:26.8444700Z  2025-03-14T06:35:26.8445459Z [17,719 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:26.8446433Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T06:35:26.8447557Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:26.8448629Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:26.8449743Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T06:35:26.8450661Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 44s local 2025-03-14T06:35:26.8451550Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T06:35:26.8452322Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local 2025-03-14T06:35:26.8453196Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local ... 2025-03-14T06:35:27.1240710Z 2025-03-14T06:35:27.1241594Z  2025-03-14T06:35:27.1242056Z  2025-03-14T06:35:27.1242471Z  2025-03-14T06:35:27.1242874Z  2025-03-14T06:35:27.1243293Z  2025-03-14T06:35:27.1243689Z  2025-03-14T06:35:27.1244091Z  2025-03-14T06:35:27.1244805Z  2025-03-14T06:35:27.1245769Z [17,720 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:27.1246910Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T06:35:27.1247982Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:27.1249026Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:27.1250231Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T06:35:27.1251185Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T06:35:27.1252236Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T06:35:27.1253024Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local 2025-03-14T06:35:27.1253964Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local ... 2025-03-14T06:35:27.3258624Z 2025-03-14T06:35:27.3260544Z  2025-03-14T06:35:27.3261802Z  2025-03-14T06:35:27.3262676Z  2025-03-14T06:35:27.3263381Z  2025-03-14T06:35:27.3263801Z  2025-03-14T06:35:27.3264213Z  2025-03-14T06:35:27.3264607Z  2025-03-14T06:35:27.3265004Z  2025-03-14T06:35:27.3266443Z [17,721 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:27.3267500Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T06:35:27.3268347Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:27.3269157Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:27.3269986Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T06:35:27.3270882Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T06:35:27.3271797Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T06:35:27.3272457Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local 2025-03-14T06:35:27.3273216Z Compiling xla/service/memory_space_assignment/algorithm.cc; 18s local ... 2025-03-14T06:35:27.5284005Z 2025-03-14T06:35:27.5286072Z  2025-03-14T06:35:27.5287198Z  2025-03-14T06:35:27.5288173Z  2025-03-14T06:35:27.5288944Z  2025-03-14T06:35:27.5289502Z  2025-03-14T06:35:27.5290064Z  2025-03-14T06:35:27.5290607Z  2025-03-14T06:35:27.5291164Z  2025-03-14T06:35:27.5292403Z [17,722 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:27.5293821Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T06:35:27.5295068Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T06:35:27.5296135Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 65s local 2025-03-14T06:35:27.5297191Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T06:35:27.5298227Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T06:35:27.5299131Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T06:35:27.5299938Z Compiling stablehlo/dialect/VhloOps.cpp; 21s local 2025-03-14T06:35:27.5300872Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local ... 2025-03-14T06:35:27.8297380Z 2025-03-14T06:35:27.8298303Z  2025-03-14T06:35:27.8298805Z  2025-03-14T06:35:27.8299298Z  2025-03-14T06:35:27.8299752Z  2025-03-14T06:35:27.8300134Z  2025-03-14T06:35:27.8300550Z  2025-03-14T06:35:27.8300953Z  2025-03-14T06:35:27.8301358Z  2025-03-14T06:35:27.8302567Z [17,722 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:27.8303741Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T06:35:27.8304814Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T06:35:27.8305903Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T06:35:27.8306918Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T06:35:27.8307930Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 45s local 2025-03-14T06:35:27.8308860Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T06:35:27.8309653Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local 2025-03-14T06:35:27.8310644Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local ... 2025-03-14T06:35:28.1916086Z 2025-03-14T06:35:28.1916906Z  2025-03-14T06:35:28.1917514Z  2025-03-14T06:35:28.1917919Z  2025-03-14T06:35:28.1918327Z  2025-03-14T06:35:28.1918738Z  2025-03-14T06:35:28.1919161Z  2025-03-14T06:35:28.1919559Z  2025-03-14T06:35:28.1919954Z  2025-03-14T06:35:28.1920934Z [17,723 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:28.1922070Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T06:35:28.1923139Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T06:35:28.1924202Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T06:35:28.1925722Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T06:35:28.1926706Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T06:35:28.1927633Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T06:35:28.1928405Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local 2025-03-14T06:35:28.1929236Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local ... 2025-03-14T06:35:28.4042930Z 2025-03-14T06:35:28.4043916Z  2025-03-14T06:35:28.4044552Z  2025-03-14T06:35:28.4045110Z  2025-03-14T06:35:28.4045730Z  2025-03-14T06:35:28.4046152Z  2025-03-14T06:35:28.4046525Z  2025-03-14T06:35:28.4046919Z  2025-03-14T06:35:28.4058060Z  2025-03-14T06:35:28.4059266Z [17,724 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:28.4060562Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T06:35:28.4061825Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T06:35:28.4063001Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T06:35:28.4063990Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T06:35:28.4065077Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T06:35:28.4066143Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T06:35:28.4066872Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local 2025-03-14T06:35:28.4067811Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local ... 2025-03-14T06:35:28.6303749Z 2025-03-14T06:35:28.6305585Z  2025-03-14T06:35:28.6307023Z  2025-03-14T06:35:28.6308377Z  2025-03-14T06:35:28.6309737Z  2025-03-14T06:35:28.6311100Z  2025-03-14T06:35:28.6312462Z  2025-03-14T06:35:28.6313798Z  2025-03-14T06:35:28.6315135Z  2025-03-14T06:35:28.6317101Z [17,724 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:28.6319218Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T06:35:28.6321234Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T06:35:28.6323354Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 66s local 2025-03-14T06:35:28.6325859Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T06:35:28.6327921Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T06:35:28.6329840Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T06:35:28.6331644Z Compiling stablehlo/dialect/VhloOps.cpp; 22s local 2025-03-14T06:35:28.6333648Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local ... 2025-03-14T06:35:28.8320209Z 2025-03-14T06:35:28.8322787Z  2025-03-14T06:35:28.8325348Z  2025-03-14T06:35:28.8327523Z  2025-03-14T06:35:28.8329729Z  2025-03-14T06:35:28.8331816Z  2025-03-14T06:35:28.8333935Z  2025-03-14T06:35:28.8335992Z  2025-03-14T06:35:28.8338067Z  2025-03-14T06:35:28.8340960Z [17,727 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:28.8343847Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T06:35:28.8346467Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T06:35:28.8349063Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T06:35:28.8351736Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T06:35:28.8354317Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 46s local 2025-03-14T06:35:28.8356816Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2025-03-14T06:35:28.8359260Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2025-03-14T06:35:28.8362011Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local ... 2025-03-14T06:35:29.2310418Z 2025-03-14T06:35:29.2312976Z  2025-03-14T06:35:29.2315332Z  2025-03-14T06:35:29.2317697Z  2025-03-14T06:35:29.2318161Z  2025-03-14T06:35:29.2318535Z  2025-03-14T06:35:29.2318937Z  2025-03-14T06:35:29.2319307Z  2025-03-14T06:35:29.2319681Z  2025-03-14T06:35:29.2320562Z [17,727 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:29.2321624Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T06:35:29.2322851Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T06:35:29.2323861Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T06:35:29.2324919Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T06:35:29.2325824Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T06:35:29.2326672Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2025-03-14T06:35:29.2327407Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2025-03-14T06:35:29.2328422Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local ... 2025-03-14T06:35:29.4696565Z 2025-03-14T06:35:29.4697371Z  2025-03-14T06:35:29.4697857Z  2025-03-14T06:35:29.4698236Z  2025-03-14T06:35:29.4698623Z  2025-03-14T06:35:29.4699055Z  2025-03-14T06:35:29.4699454Z  2025-03-14T06:35:29.4699818Z  2025-03-14T06:35:29.4700195Z  2025-03-14T06:35:29.4701062Z [17,728 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:29.4702129Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T06:35:29.4703124Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T06:35:29.4704136Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 67s local 2025-03-14T06:35:29.4705104Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T06:35:29.4706048Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T06:35:29.4706903Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2025-03-14T06:35:29.4707680Z Compiling stablehlo/dialect/VhloOps.cpp; 23s local 2025-03-14T06:35:29.4708890Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local ... 2025-03-14T06:35:29.7245220Z 2025-03-14T06:35:29.7246562Z  2025-03-14T06:35:29.7247009Z  2025-03-14T06:35:29.7247356Z  2025-03-14T06:35:29.7247733Z  2025-03-14T06:35:29.7248100Z  2025-03-14T06:35:29.7248438Z  2025-03-14T06:35:29.7248794Z  2025-03-14T06:35:29.7249119Z  2025-03-14T06:35:29.7249933Z [17,730 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:29.7250899Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T06:35:29.7251781Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T06:35:29.7252648Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T06:35:29.7253744Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T06:35:29.7254564Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T06:35:29.7255339Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2025-03-14T06:35:29.7255996Z Compiling stablehlo/dialect/VhloOps.cpp; 24s local 2025-03-14T06:35:29.7256803Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local ... 2025-03-14T06:35:30.0318173Z 2025-03-14T06:35:30.0319642Z  2025-03-14T06:35:30.0320126Z  2025-03-14T06:35:30.0320510Z  2025-03-14T06:35:30.0320899Z  2025-03-14T06:35:30.0321262Z  2025-03-14T06:35:30.0321642Z  2025-03-14T06:35:30.0322023Z  2025-03-14T06:35:30.0322698Z  2025-03-14T06:35:30.0323634Z [17,730 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:30.0324885Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T06:35:30.0325876Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T06:35:30.0326850Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 68s local 2025-03-14T06:35:30.7733593Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T06:35:30.7734528Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 47s local 2025-03-14T06:35:30.7735531Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T06:35:30.7736206Z Compiling stablehlo/dialect/VhloOps.cpp; 24s local 2025-03-14T06:35:30.7737020Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local ... 2025-03-14T06:35:30.7737594Z 2025-03-14T06:35:30.7738406Z  2025-03-14T06:35:30.7739474Z  2025-03-14T06:35:30.7739926Z  2025-03-14T06:35:30.7740310Z  2025-03-14T06:35:30.7740653Z  2025-03-14T06:35:30.7741022Z  2025-03-14T06:35:30.7741390Z  2025-03-14T06:35:30.7741730Z  2025-03-14T06:35:30.7742563Z [17,731 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:30.7743552Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T06:35:30.7744514Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2025-03-14T06:35:30.7745488Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2025-03-14T06:35:30.7746454Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T06:35:30.7747363Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2025-03-14T06:35:30.7748175Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T06:35:30.7748923Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2025-03-14T06:35:30.7749817Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local ... 2025-03-14T06:35:31.0327264Z 2025-03-14T06:35:31.0328154Z  2025-03-14T06:35:31.0328646Z  2025-03-14T06:35:31.0329105Z  2025-03-14T06:35:31.0329508Z  2025-03-14T06:35:31.0329904Z  2025-03-14T06:35:31.0330302Z  2025-03-14T06:35:31.0330691Z  2025-03-14T06:35:31.0331093Z  2025-03-14T06:35:31.0332309Z [17,733 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:31.0333463Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T06:35:31.0334465Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2025-03-14T06:35:31.0335466Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2025-03-14T06:35:31.0336433Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T06:35:31.0337396Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 48s local 2025-03-14T06:35:31.0338304Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2025-03-14T06:35:31.0339071Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2025-03-14T06:35:31.0340200Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local ... 2025-03-14T06:35:31.2329726Z 2025-03-14T06:35:31.2330613Z  2025-03-14T06:35:31.2331094Z  2025-03-14T06:35:31.2331545Z  2025-03-14T06:35:31.2331952Z  2025-03-14T06:35:31.2332367Z  2025-03-14T06:35:31.2332749Z  2025-03-14T06:35:31.2333125Z  2025-03-14T06:35:31.2333517Z  2025-03-14T06:35:31.2334483Z [17,734 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:31.2335631Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T06:35:31.2336678Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2025-03-14T06:35:31.2337705Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 69s local 2025-03-14T06:35:31.2338988Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T06:35:31.2339952Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T06:35:31.2340867Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2025-03-14T06:35:31.2341632Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2025-03-14T06:35:31.2342548Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local ... 2025-03-14T06:35:31.4678097Z 2025-03-14T06:35:31.4678968Z  2025-03-14T06:35:31.4679447Z  2025-03-14T06:35:31.4680147Z  2025-03-14T06:35:31.4680617Z  2025-03-14T06:35:31.4681012Z  2025-03-14T06:35:31.4681411Z  2025-03-14T06:35:31.4681811Z  2025-03-14T06:35:31.4682208Z  2025-03-14T06:35:31.4683150Z [17,735 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:31.4684300Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T06:35:31.4685511Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2025-03-14T06:35:31.4686518Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T06:35:31.4687538Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T06:35:31.4688465Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2025-03-14T06:35:31.4689280Z Compiling stablehlo/dialect/VhloOps.cpp; 25s local 2025-03-14T06:35:31.4690220Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T06:35:31.4691375Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local ... 2025-03-14T06:35:31.7105847Z 2025-03-14T06:35:31.7107058Z  2025-03-14T06:35:31.7107512Z  2025-03-14T06:35:31.7107896Z  2025-03-14T06:35:31.7108280Z  2025-03-14T06:35:31.7108672Z  2025-03-14T06:35:31.7109048Z  2025-03-14T06:35:31.7109425Z  2025-03-14T06:35:31.7109826Z  2025-03-14T06:35:31.7110706Z [17,736 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:31.7112423Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T06:35:31.7113429Z Compiling mlir/lib/Dialect/OpenMP/IR/OpenMPDialect.cpp; 70s local 2025-03-14T06:35:31.7114356Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T06:35:31.7115491Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T06:35:31.7116324Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2025-03-14T06:35:31.7117180Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T06:35:31.7118132Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2025-03-14T06:35:31.7119054Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local ... 2025-03-14T06:35:31.9429830Z 2025-03-14T06:35:31.9431033Z  2025-03-14T06:35:31.9431504Z  2025-03-14T06:35:31.9431882Z  2025-03-14T06:35:31.9432261Z  2025-03-14T06:35:31.9432632Z  2025-03-14T06:35:31.9433015Z  2025-03-14T06:35:31.9433370Z  2025-03-14T06:35:31.9433943Z  2025-03-14T06:35:31.9434884Z [17,739 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:31.9435930Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T06:35:31.9436873Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T06:35:31.9437750Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 49s local 2025-03-14T06:35:31.9438547Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2025-03-14T06:35:31.9439385Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T06:35:31.9440324Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local 2025-03-14T06:35:31.9441237Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2025-03-14T06:35:31.9442261Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2025-03-14T06:35:32.2312296Z 2025-03-14T06:35:32.2313347Z  2025-03-14T06:35:32.2313826Z  2025-03-14T06:35:32.2314397Z  2025-03-14T06:35:32.2314824Z  2025-03-14T06:35:32.2315298Z  2025-03-14T06:35:32.2315714Z  2025-03-14T06:35:32.2316129Z  2025-03-14T06:35:32.2316540Z  2025-03-14T06:35:32.2317520Z [17,741 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:32.2318898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T06:35:32.2319932Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2025-03-14T06:35:32.2320823Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T06:35:32.2321805Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2025-03-14T06:35:32.2322736Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T06:35:32.2323770Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2025-03-14T06:35:32.2324999Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2025-03-14T06:35:32.2325922Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2025-03-14T06:35:32.4337739Z 2025-03-14T06:35:32.4339000Z  2025-03-14T06:35:32.4339484Z  2025-03-14T06:35:32.4339883Z  2025-03-14T06:35:32.4340277Z  2025-03-14T06:35:32.4340702Z  2025-03-14T06:35:32.4341101Z  2025-03-14T06:35:32.4341489Z  2025-03-14T06:35:32.4341862Z  2025-03-14T06:35:32.4342783Z [17,741 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:32.4343883Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T06:35:32.4344841Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2025-03-14T06:35:32.4345796Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T06:35:32.4346666Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2025-03-14T06:35:32.4347569Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T06:35:32.4348594Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2025-03-14T06:35:32.4349544Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2025-03-14T06:35:32.4350683Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2025-03-14T06:35:32.6341350Z 2025-03-14T06:35:32.6342596Z  2025-03-14T06:35:32.6343119Z  2025-03-14T06:35:32.6343579Z  2025-03-14T06:35:32.6344005Z  2025-03-14T06:35:32.6344405Z  2025-03-14T06:35:32.6344806Z  2025-03-14T06:35:32.6345201Z  2025-03-14T06:35:32.6345622Z  2025-03-14T06:35:32.6346574Z [17,743 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:32.6347733Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T06:35:32.6348748Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 61s local 2025-03-14T06:35:32.6349738Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T06:35:32.6350927Z Compiling stablehlo/dialect/VhloOps.cpp; 26s local 2025-03-14T06:35:32.6351856Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T06:35:32.6352942Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2025-03-14T06:35:32.6353946Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2025-03-14T06:35:32.6355000Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local ... 2025-03-14T06:35:33.0346872Z 2025-03-14T06:35:33.0347754Z  2025-03-14T06:35:33.0348222Z  2025-03-14T06:35:33.0348616Z  2025-03-14T06:35:33.0348993Z  2025-03-14T06:35:33.0349384Z  2025-03-14T06:35:33.0349782Z  2025-03-14T06:35:33.0350160Z  2025-03-14T06:35:33.0350869Z  2025-03-14T06:35:33.0351810Z [17,746 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:33.0352994Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T06:35:33.0354055Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 50s local 2025-03-14T06:35:33.0354983Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2025-03-14T06:35:33.0356003Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T06:35:33.0357060Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local 2025-03-14T06:35:33.0358308Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2025-03-14T06:35:33.0359254Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2025-03-14T06:35:33.0360139Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local ... 2025-03-14T06:35:33.3931870Z 2025-03-14T06:35:33.3932723Z  2025-03-14T06:35:33.3933219Z  2025-03-14T06:35:33.3933662Z  2025-03-14T06:35:33.3934080Z  2025-03-14T06:35:33.3934451Z  2025-03-14T06:35:33.3934823Z  2025-03-14T06:35:33.3935192Z  2025-03-14T06:35:33.3935999Z  2025-03-14T06:35:33.3937133Z [17,747 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:33.3938437Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T06:35:33.3939659Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2025-03-14T06:35:33.3940804Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2025-03-14T06:35:33.3941909Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T06:35:33.3943088Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2025-03-14T06:35:33.3944184Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2025-03-14T06:35:33.3945212Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2025-03-14T06:35:33.3946235Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local ... 2025-03-14T06:35:33.6353103Z 2025-03-14T06:35:33.6353993Z  2025-03-14T06:35:33.6354463Z  2025-03-14T06:35:33.6354832Z  2025-03-14T06:35:33.6355229Z  2025-03-14T06:35:33.6355616Z  2025-03-14T06:35:33.6356008Z  2025-03-14T06:35:33.6356403Z  2025-03-14T06:35:33.6356803Z  2025-03-14T06:35:33.6358029Z [17,748 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:33.6359244Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T06:35:33.6360319Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 51s local 2025-03-14T06:35:33.6361228Z Compiling stablehlo/dialect/VhloOps.cpp; 27s local 2025-03-14T06:35:33.6362192Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T06:35:33.6363245Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2025-03-14T06:35:33.6364294Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2025-03-14T06:35:33.6365591Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T06:35:33.6366434Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local ... 2025-03-14T06:35:34.2882454Z 2025-03-14T06:35:34.2883409Z  2025-03-14T06:35:34.2884051Z  2025-03-14T06:35:34.2884612Z  2025-03-14T06:35:34.2885028Z  2025-03-14T06:35:34.2885461Z  2025-03-14T06:35:34.2885995Z  2025-03-14T06:35:34.2886522Z  2025-03-14T06:35:34.2886901Z  2025-03-14T06:35:34.2887806Z [17,749 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:34.2888928Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T06:35:34.2889977Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T06:35:34.2890909Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2025-03-14T06:35:34.2892185Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T06:35:34.2893306Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2025-03-14T06:35:34.2894377Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2025-03-14T06:35:34.2895360Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T06:35:34.2896391Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local ... 2025-03-14T06:35:34.6362462Z 2025-03-14T06:35:34.6363362Z  2025-03-14T06:35:34.6363864Z  2025-03-14T06:35:34.6364273Z  2025-03-14T06:35:34.6364827Z  2025-03-14T06:35:34.6365622Z  2025-03-14T06:35:34.6366044Z  2025-03-14T06:35:34.6366426Z  2025-03-14T06:35:34.6366822Z  2025-03-14T06:35:34.6367750Z [17,750 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:34.6368869Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T06:35:34.6369907Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T06:35:34.6370789Z Compiling stablehlo/dialect/VhloOps.cpp; 28s local 2025-03-14T06:35:34.6371734Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T06:35:34.6372817Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2025-03-14T06:35:34.6373838Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2025-03-14T06:35:34.6374728Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T06:35:34.6375617Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local ... 2025-03-14T06:35:34.9315410Z 2025-03-14T06:35:34.9316284Z  2025-03-14T06:35:34.9316761Z  2025-03-14T06:35:34.9317177Z  2025-03-14T06:35:34.9317589Z  2025-03-14T06:35:34.9318008Z  2025-03-14T06:35:34.9318419Z  2025-03-14T06:35:34.9318843Z  2025-03-14T06:35:34.9319267Z  2025-03-14T06:35:34.9320241Z [17,752 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:34.9321403Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T06:35:34.9322453Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 52s local 2025-03-14T06:35:34.9323414Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2025-03-14T06:35:34.9324567Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T06:35:34.9325904Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2025-03-14T06:35:34.9326835Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T06:35:34.9327653Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T06:35:34.9328655Z Compiling .../evaluator/hlo_evaluator_typed_visitor_int4.cc; 18s local ... 2025-03-14T06:35:35.2324943Z 2025-03-14T06:35:35.2325782Z  2025-03-14T06:35:35.2326302Z  2025-03-14T06:35:35.2326715Z  2025-03-14T06:35:35.2327155Z  2025-03-14T06:35:35.2327558Z  2025-03-14T06:35:35.2327960Z  2025-03-14T06:35:35.2328368Z  2025-03-14T06:35:35.2328765Z  2025-03-14T06:35:35.2329662Z [17,754 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:35.2331043Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T06:35:35.2332038Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T06:35:35.2332906Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2025-03-14T06:35:35.2333853Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T06:35:35.2334911Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2025-03-14T06:35:35.2335738Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T06:35:35.2336530Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T06:35:35.2337478Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local ... 2025-03-14T06:35:35.4368158Z 2025-03-14T06:35:35.4369034Z  2025-03-14T06:35:35.4369516Z  2025-03-14T06:35:35.4369902Z  2025-03-14T06:35:35.4370330Z  2025-03-14T06:35:35.4370774Z  2025-03-14T06:35:35.4371172Z  2025-03-14T06:35:35.4371526Z  2025-03-14T06:35:35.4371906Z  2025-03-14T06:35:35.4372844Z [17,756 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:35.4373931Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T06:35:35.4375148Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T06:35:35.4376038Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2025-03-14T06:35:35.4376947Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2025-03-14T06:35:35.4377905Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T06:35:35.4378760Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T06:35:35.4379595Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T06:35:35.4380523Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 16s local ... 2025-03-14T06:35:35.6374618Z 2025-03-14T06:35:35.6375469Z  2025-03-14T06:35:35.6375956Z  2025-03-14T06:35:35.6376355Z  2025-03-14T06:35:35.6376753Z  2025-03-14T06:35:35.6377147Z  2025-03-14T06:35:35.6377520Z  2025-03-14T06:35:35.6377930Z  2025-03-14T06:35:35.6378303Z  2025-03-14T06:35:35.6379231Z [17,757 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:35.6380355Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T06:35:35.6381385Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 53s local 2025-03-14T06:35:35.6382284Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local 2025-03-14T06:35:35.6383155Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2025-03-14T06:35:35.6384177Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T06:35:35.6385064Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T06:35:35.6385841Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T06:35:35.6386732Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local ... 2025-03-14T06:35:36.2951606Z 2025-03-14T06:35:36.2952757Z  2025-03-14T06:35:36.2953332Z  2025-03-14T06:35:36.2953768Z  2025-03-14T06:35:36.2954233Z  2025-03-14T06:35:36.2954633Z  2025-03-14T06:35:36.2955092Z  2025-03-14T06:35:36.2955502Z  2025-03-14T06:35:36.2955908Z  2025-03-14T06:35:36.2956937Z [17,758 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:36.2958162Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T06:35:36.2959233Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T06:35:36.2960103Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2025-03-14T06:35:36.2961067Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2025-03-14T06:35:36.2962450Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T06:35:36.2963384Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T06:35:36.2964209Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T06:35:36.2965528Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 17s local ... 2025-03-14T06:35:36.5667980Z 2025-03-14T06:35:36.5668884Z  2025-03-14T06:35:36.5669368Z  2025-03-14T06:35:36.5669757Z  2025-03-14T06:35:36.5670133Z  2025-03-14T06:35:36.5670537Z  2025-03-14T06:35:36.5670948Z  2025-03-14T06:35:36.5671335Z  2025-03-14T06:35:36.5671724Z  2025-03-14T06:35:36.5672666Z [17,759 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:36.5674059Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T06:35:36.5675071Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T06:35:36.5675954Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local 2025-03-14T06:35:36.5676860Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T06:35:36.5677849Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T06:35:36.5678697Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T06:35:36.5679714Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T06:35:36.5680644Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2025-03-14T06:35:36.8380357Z 2025-03-14T06:35:36.8381199Z  2025-03-14T06:35:36.8381649Z  2025-03-14T06:35:36.8382069Z  2025-03-14T06:35:36.8382483Z  2025-03-14T06:35:36.8382921Z  2025-03-14T06:35:36.8383306Z  2025-03-14T06:35:36.8383677Z  2025-03-14T06:35:36.8384072Z  2025-03-14T06:35:36.8385039Z [17,759 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:36.8386126Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T06:35:36.8387071Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 54s local 2025-03-14T06:35:36.8387948Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T06:35:36.8388810Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T06:35:36.8389837Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T06:35:36.8390676Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T06:35:36.8391469Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T06:35:36.8392370Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2025-03-14T06:35:37.2385788Z 2025-03-14T06:35:37.2386761Z  2025-03-14T06:35:37.2387229Z  2025-03-14T06:35:37.2387655Z  2025-03-14T06:35:37.2388069Z  2025-03-14T06:35:37.2388438Z  2025-03-14T06:35:37.2388841Z  2025-03-14T06:35:37.2389240Z  2025-03-14T06:35:37.2389624Z  2025-03-14T06:35:37.2390364Z [17,760 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:37.2391760Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T06:35:37.2392580Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T06:35:37.2393325Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T06:35:37.2394171Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T06:35:37.2395090Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T06:35:37.2395901Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T06:35:37.2396706Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T06:35:37.2397588Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2025-03-14T06:35:37.4558685Z 2025-03-14T06:35:37.4559923Z  2025-03-14T06:35:37.4560389Z  2025-03-14T06:35:37.4560804Z  2025-03-14T06:35:37.4561210Z  2025-03-14T06:35:37.4561590Z  2025-03-14T06:35:37.4561985Z  2025-03-14T06:35:37.4562420Z  2025-03-14T06:35:37.4562820Z  2025-03-14T06:35:37.4563765Z [17,763 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:37.4565042Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T06:35:37.4566301Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T06:35:37.4567206Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T06:35:37.4568177Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T06:35:37.4569416Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T06:35:37.4570305Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T06:35:37.4571114Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T06:35:37.4572057Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 18s local ... 2025-03-14T06:35:37.6614179Z 2025-03-14T06:35:37.6615341Z  2025-03-14T06:35:37.6615840Z  2025-03-14T06:35:37.6616266Z  2025-03-14T06:35:37.6616660Z  2025-03-14T06:35:37.6617046Z  2025-03-14T06:35:37.6617426Z  2025-03-14T06:35:37.6618050Z  2025-03-14T06:35:37.6618458Z  2025-03-14T06:35:37.6619368Z [17,765 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:37.6620428Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T06:35:37.6621549Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T06:35:37.6622488Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T06:35:37.6623481Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T06:35:37.6624589Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T06:35:37.6625485Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T06:35:37.6626379Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T06:35:37.6627397Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local ... 2025-03-14T06:35:37.9659076Z 2025-03-14T06:35:37.9660323Z  2025-03-14T06:35:37.9660842Z  2025-03-14T06:35:37.9661241Z  2025-03-14T06:35:37.9661626Z  2025-03-14T06:35:37.9661987Z  2025-03-14T06:35:37.9662355Z  2025-03-14T06:35:37.9662731Z  2025-03-14T06:35:37.9663114Z  2025-03-14T06:35:37.9664058Z [17,766 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:37.9665133Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T06:35:37.9666246Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 55s local 2025-03-14T06:35:37.9667101Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T06:35:37.9668046Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T06:35:37.9669060Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T06:35:37.9670188Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T06:35:37.9671041Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T06:35:37.9671915Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local ... 2025-03-14T06:35:38.2392114Z 2025-03-14T06:35:38.2393286Z  2025-03-14T06:35:38.2393758Z  2025-03-14T06:35:38.2394158Z  2025-03-14T06:35:38.2394564Z  2025-03-14T06:35:38.2394944Z  2025-03-14T06:35:38.2395338Z  2025-03-14T06:35:38.2395762Z  2025-03-14T06:35:38.2396128Z  2025-03-14T06:35:38.2397047Z [17,766 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:38.2398519Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T06:35:38.2399474Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2025-03-14T06:35:38.2400322Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T06:35:38.2401207Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T06:35:38.2402239Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T06:35:38.2403070Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T06:35:38.2403863Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T06:35:38.2404898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 19s local ... 2025-03-14T06:35:38.6396658Z 2025-03-14T06:35:38.6397845Z  2025-03-14T06:35:38.6398636Z  2025-03-14T06:35:38.6399043Z  2025-03-14T06:35:38.6399442Z  2025-03-14T06:35:38.6399827Z  2025-03-14T06:35:38.6400208Z  2025-03-14T06:35:38.6400604Z  2025-03-14T06:35:38.6400997Z  2025-03-14T06:35:38.6401921Z [17,767 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:38.6403059Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T06:35:38.6404096Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2025-03-14T06:35:38.6405320Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T06:35:38.6406282Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T06:35:38.6407445Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T06:35:38.6408295Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T06:35:38.6409093Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T06:35:38.6410024Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local ... 2025-03-14T06:35:38.8400236Z 2025-03-14T06:35:38.8401491Z  2025-03-14T06:35:38.8402043Z  2025-03-14T06:35:38.8402463Z  2025-03-14T06:35:38.8402836Z  2025-03-14T06:35:38.8403230Z  2025-03-14T06:35:38.8403601Z  2025-03-14T06:35:38.8404003Z  2025-03-14T06:35:38.8404541Z  2025-03-14T06:35:38.8405461Z [17,768 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:38.8406606Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T06:35:38.8407612Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 56s local 2025-03-14T06:35:38.8408491Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2025-03-14T06:35:38.8409373Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T06:35:38.8410399Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T06:35:38.8411320Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T06:35:38.8412130Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T06:35:38.8413086Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local ... 2025-03-14T06:35:39.2405388Z 2025-03-14T06:35:39.2406605Z  2025-03-14T06:35:39.2407114Z  2025-03-14T06:35:39.2407519Z  2025-03-14T06:35:39.2408176Z  2025-03-14T06:35:39.2408568Z  2025-03-14T06:35:39.2408953Z  2025-03-14T06:35:39.2409352Z  2025-03-14T06:35:39.2409760Z  2025-03-14T06:35:39.2410778Z [17,769 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:39.2411950Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T06:35:39.2412920Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2025-03-14T06:35:39.2413835Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2025-03-14T06:35:39.2414777Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T06:35:39.2415816Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T06:35:39.2416961Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T06:35:39.2417783Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T06:35:39.2418712Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 20s local ... 2025-03-14T06:35:39.8972201Z 2025-03-14T06:35:39.8973453Z  2025-03-14T06:35:39.8973961Z  2025-03-14T06:35:39.8974420Z  2025-03-14T06:35:39.8974812Z  2025-03-14T06:35:39.8975227Z  2025-03-14T06:35:39.8975646Z  2025-03-14T06:35:39.8976029Z  2025-03-14T06:35:39.8976445Z  2025-03-14T06:35:39.8977430Z [17,770 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:39.8978616Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2025-03-14T06:35:39.8979986Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 57s local 2025-03-14T06:35:39.8980944Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2025-03-14T06:35:39.8981896Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2025-03-14T06:35:39.8983057Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2025-03-14T06:35:39.8983974Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2025-03-14T06:35:39.8984827Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T06:35:39.8985993Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local ... 2025-03-14T06:35:40.2414205Z 2025-03-14T06:35:40.2415295Z  2025-03-14T06:35:40.2415765Z  2025-03-14T06:35:40.2416155Z  2025-03-14T06:35:40.2416521Z  2025-03-14T06:35:40.2416918Z  2025-03-14T06:35:40.2417303Z  2025-03-14T06:35:40.2417664Z  2025-03-14T06:35:40.2418092Z  2025-03-14T06:35:40.2419022Z [17,770 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:40.2420113Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2025-03-14T06:35:40.2421108Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T06:35:40.2421999Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2025-03-14T06:35:40.2422906Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2025-03-14T06:35:40.2423915Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2025-03-14T06:35:40.2424801Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2025-03-14T06:35:40.2425583Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T06:35:40.2426492Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 21s local ... 2025-03-14T06:35:40.6417579Z 2025-03-14T06:35:40.6418806Z  2025-03-14T06:35:40.6419281Z  2025-03-14T06:35:40.6419703Z  2025-03-14T06:35:40.6420128Z  2025-03-14T06:35:40.6420506Z  2025-03-14T06:35:40.6420863Z  2025-03-14T06:35:40.6421244Z  2025-03-14T06:35:40.6421572Z  2025-03-14T06:35:40.6422328Z [17,773 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:40.6423151Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T06:35:40.6424295Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T06:35:40.6424985Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2025-03-14T06:35:40.6425693Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T06:35:40.6426474Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T06:35:40.6427166Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T06:35:40.6427859Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T06:35:40.6428746Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local ... 2025-03-14T06:35:40.8422782Z 2025-03-14T06:35:40.8423777Z  2025-03-14T06:35:40.8424291Z  2025-03-14T06:35:40.8426321Z  2025-03-14T06:35:40.8427048Z  2025-03-14T06:35:40.8427512Z  2025-03-14T06:35:40.8429529Z  2025-03-14T06:35:40.8429967Z  2025-03-14T06:35:40.8431947Z  2025-03-14T06:35:40.8432945Z [17,774 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:40.8434125Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T06:35:40.8435194Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 58s local 2025-03-14T06:35:40.8436108Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T06:35:40.8437034Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T06:35:40.8438074Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T06:35:40.8439175Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T06:35:40.8439999Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2025-03-14T06:35:40.8440930Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local ... 2025-03-14T06:35:41.3296695Z 2025-03-14T06:35:41.3297982Z  2025-03-14T06:35:41.3298532Z  2025-03-14T06:35:41.3298949Z  2025-03-14T06:35:41.3299354Z  2025-03-14T06:35:41.3299747Z  2025-03-14T06:35:41.3300176Z  2025-03-14T06:35:41.3300582Z  2025-03-14T06:35:41.3300965Z  2025-03-14T06:35:41.3302134Z [17,775 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:41.3303284Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T06:35:41.3304223Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T06:35:41.3305221Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T06:35:41.3306219Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T06:35:41.3307311Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T06:35:41.3308235Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T06:35:41.3309093Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2025-03-14T06:35:41.3310041Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 22s local ... 2025-03-14T06:35:41.6427752Z 2025-03-14T06:35:41.6428745Z  2025-03-14T06:35:41.6429237Z  2025-03-14T06:35:41.6429974Z  2025-03-14T06:35:41.6430403Z  2025-03-14T06:35:41.6431015Z  2025-03-14T06:35:41.6431457Z  2025-03-14T06:35:41.6431913Z  2025-03-14T06:35:41.6432337Z  2025-03-14T06:35:41.6433341Z [17,776 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:41.6434719Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T06:35:41.6435921Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T06:35:41.6436943Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T06:35:41.6438013Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T06:35:41.6439259Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2025-03-14T06:35:41.6440322Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:35:41.6441613Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2025-03-14T06:35:41.6442788Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local ... 2025-03-14T06:35:41.8433973Z 2025-03-14T06:35:41.8435965Z  2025-03-14T06:35:41.8436484Z  2025-03-14T06:35:41.8437501Z  2025-03-14T06:35:41.8439301Z  2025-03-14T06:35:41.8441043Z  2025-03-14T06:35:41.8442612Z  2025-03-14T06:35:41.8444171Z  2025-03-14T06:35:41.8445414Z  2025-03-14T06:35:41.8446912Z [17,779 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:41.8448131Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T06:35:41.8449451Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T06:35:41.8450366Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T06:35:41.8451315Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T06:35:41.8452345Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2025-03-14T06:35:41.8453276Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:35:41.8454143Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T06:35:41.8455057Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local ... 2025-03-14T06:35:42.0491380Z 2025-03-14T06:35:42.0492251Z  2025-03-14T06:35:42.0493004Z  2025-03-14T06:35:42.0493447Z  2025-03-14T06:35:42.0494330Z  2025-03-14T06:35:42.0494883Z  2025-03-14T06:35:42.0495319Z  2025-03-14T06:35:42.0495842Z  2025-03-14T06:35:42.0496269Z  2025-03-14T06:35:42.0497346Z [17,783 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:42.0498655Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T06:35:42.0510539Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 59s local 2025-03-14T06:35:42.0511703Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T06:35:42.0512985Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T06:35:42.0514220Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:35:42.0515171Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T06:35:42.0516188Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2025-03-14T06:35:42.0517117Z @xla//xla/hlo/evaluator:hlo_evaluator; 21s local ... 2025-03-14T06:35:42.3233919Z 2025-03-14T06:35:42.3234998Z  2025-03-14T06:35:42.3235490Z  2025-03-14T06:35:42.3237336Z  2025-03-14T06:35:42.3237740Z  2025-03-14T06:35:42.3239602Z  2025-03-14T06:35:42.3240032Z  2025-03-14T06:35:42.3241852Z  2025-03-14T06:35:42.3242804Z  2025-03-14T06:35:42.3245066Z [17,785 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:42.3247383Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T06:35:42.3249516Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2025-03-14T06:35:42.3251637Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T06:35:42.3253703Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T06:35:42.3255780Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:35:42.3257676Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T06:35:42.3259666Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 23s local 2025-03-14T06:35:42.3261653Z @xla//xla/hlo/evaluator:hlo_evaluator; 21s local ... 2025-03-14T06:35:42.5264949Z 2025-03-14T06:35:42.5267156Z  2025-03-14T06:35:42.5268753Z  2025-03-14T06:35:42.5269768Z  2025-03-14T06:35:42.5270911Z  2025-03-14T06:35:42.5271369Z  2025-03-14T06:35:42.5271756Z  2025-03-14T06:35:42.5272168Z  2025-03-14T06:35:42.5272870Z  2025-03-14T06:35:42.5273895Z [17,787 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:42.5275034Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T06:35:42.5276126Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2025-03-14T06:35:42.5277081Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T06:35:42.5278014Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T06:35:42.5279019Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T06:35:42.5279809Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T06:35:42.5280704Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2025-03-14T06:35:42.5281834Z @xla//xla/hlo/evaluator:hlo_evaluator; 21s local ... 2025-03-14T06:35:42.8440991Z 2025-03-14T06:35:42.8441864Z  2025-03-14T06:35:42.8442349Z  2025-03-14T06:35:42.8442807Z  2025-03-14T06:35:42.8443472Z  2025-03-14T06:35:42.8443906Z  2025-03-14T06:35:42.8444531Z  2025-03-14T06:35:42.8444988Z  2025-03-14T06:35:42.8445418Z  2025-03-14T06:35:42.8446435Z [17,788 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:42.8447730Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T06:35:42.8448879Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2025-03-14T06:35:42.8450171Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T06:35:42.8451222Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T06:35:42.8452322Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T06:35:42.8453271Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T06:35:42.8454302Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2025-03-14T06:35:42.8455289Z @xla//xla/hlo/evaluator:hlo_evaluator; 22s local ... 2025-03-14T06:35:43.0750970Z 2025-03-14T06:35:43.0752883Z  2025-03-14T06:35:43.0754074Z  2025-03-14T06:35:43.0755957Z  2025-03-14T06:35:43.0757589Z  2025-03-14T06:35:43.0759093Z  2025-03-14T06:35:43.0760580Z  2025-03-14T06:35:43.0762057Z  2025-03-14T06:35:43.0763528Z  2025-03-14T06:35:43.0766015Z [17,790 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:43.0767562Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T06:35:43.0768904Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 60s local 2025-03-14T06:35:43.0770214Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T06:35:43.0771508Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T06:35:43.0772795Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T06:35:43.0773916Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T06:35:43.0775142Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2025-03-14T06:35:43.0776338Z @xla//xla/hlo/evaluator:hlo_evaluator; 22s local ... 2025-03-14T06:35:43.3377637Z 2025-03-14T06:35:43.3379753Z  2025-03-14T06:35:43.3380193Z  2025-03-14T06:35:43.3380580Z  2025-03-14T06:35:43.3381433Z  2025-03-14T06:35:43.3381815Z  2025-03-14T06:35:43.3382170Z  2025-03-14T06:35:43.3382537Z  2025-03-14T06:35:43.3382939Z  2025-03-14T06:35:43.3383899Z [17,791 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:43.3384895Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T06:35:43.3385824Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2025-03-14T06:35:43.3386899Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T06:35:43.3387956Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T06:35:43.3389002Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T06:35:43.3389876Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T06:35:43.3390775Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 24s local 2025-03-14T06:35:43.3391658Z @xla//xla/hlo/evaluator:hlo_evaluator; 22s local ... 2025-03-14T06:35:43.6447614Z 2025-03-14T06:35:43.6449762Z  2025-03-14T06:35:43.6450201Z  2025-03-14T06:35:43.6450594Z  2025-03-14T06:35:43.6451343Z  2025-03-14T06:35:43.6451683Z  2025-03-14T06:35:43.6452005Z  2025-03-14T06:35:43.6452343Z  2025-03-14T06:35:43.6452683Z  2025-03-14T06:35:43.6453715Z [17,791 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:43.6454796Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2025-03-14T06:35:43.6455684Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2025-03-14T06:35:43.6456447Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T06:35:43.6457534Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T06:35:43.6458564Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T06:35:43.6459456Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T06:35:43.6460343Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2025-03-14T06:35:43.6461396Z @xla//xla/hlo/evaluator:hlo_evaluator; 22s local ... 2025-03-14T06:35:43.8588954Z 2025-03-14T06:35:43.8591111Z  2025-03-14T06:35:43.8591704Z  2025-03-14T06:35:43.8592101Z  2025-03-14T06:35:43.8592537Z  2025-03-14T06:35:43.8592935Z  2025-03-14T06:35:43.8593305Z  2025-03-14T06:35:43.8593667Z  2025-03-14T06:35:43.8594153Z  2025-03-14T06:35:43.8595036Z [17,792 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:43.8596138Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2025-03-14T06:35:43.8597343Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 61s local 2025-03-14T06:35:43.8598269Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2025-03-14T06:35:43.8599202Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T06:35:43.8600154Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T06:35:43.8601013Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T06:35:43.8601895Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2025-03-14T06:35:43.8602802Z @xla//xla/hlo/evaluator:hlo_evaluator; 23s local ... 2025-03-14T06:35:44.2453316Z 2025-03-14T06:35:44.2455573Z  2025-03-14T06:35:44.2456265Z  2025-03-14T06:35:44.2456703Z  2025-03-14T06:35:44.2457223Z  2025-03-14T06:35:44.2457655Z  2025-03-14T06:35:44.2458352Z  2025-03-14T06:35:44.2458894Z  2025-03-14T06:35:44.2459438Z  2025-03-14T06:35:44.2460536Z [17,793 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:44.2461858Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2025-03-14T06:35:44.2463020Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T06:35:44.2464063Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2025-03-14T06:35:44.2465151Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T06:35:44.2466526Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T06:35:44.2467512Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T06:35:44.2468579Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 25s local 2025-03-14T06:35:44.2469590Z @xla//xla/hlo/evaluator:hlo_evaluator; 23s local ... 2025-03-14T06:35:44.4902356Z 2025-03-14T06:35:44.4904935Z  2025-03-14T06:35:44.4905505Z  2025-03-14T06:35:44.4905935Z  2025-03-14T06:35:44.4906411Z  2025-03-14T06:35:44.4907172Z  2025-03-14T06:35:44.4907606Z  2025-03-14T06:35:44.4908022Z  2025-03-14T06:35:44.4908698Z  2025-03-14T06:35:44.4909676Z [17,795 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:44.4910975Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T06:35:44.4912239Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T06:35:44.4913291Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2025-03-14T06:35:44.4914355Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T06:35:44.4915711Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T06:35:44.4916702Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T06:35:44.4917735Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2025-03-14T06:35:44.4918728Z @xla//xla/hlo/evaluator:hlo_evaluator; 23s local ... 2025-03-14T06:35:44.8459174Z 2025-03-14T06:35:44.8461460Z  2025-03-14T06:35:44.8462197Z  2025-03-14T06:35:44.8462665Z  2025-03-14T06:35:44.8463219Z  2025-03-14T06:35:44.8463665Z  2025-03-14T06:35:44.8464208Z  2025-03-14T06:35:44.8464745Z  2025-03-14T06:35:44.8465181Z  2025-03-14T06:35:44.8466404Z [17,796 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:44.8468130Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T06:35:44.8469294Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T06:35:44.8470327Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2025-03-14T06:35:44.8471367Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T06:35:44.8472456Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T06:35:44.8473401Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T06:35:44.8474598Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2025-03-14T06:35:44.8475604Z @xla//xla/hlo/evaluator:hlo_evaluator; 24s local ... 2025-03-14T06:35:45.0644256Z 2025-03-14T06:35:45.0645534Z  2025-03-14T06:35:45.0645989Z  2025-03-14T06:35:45.0646854Z  2025-03-14T06:35:45.0647190Z  2025-03-14T06:35:45.0647538Z  2025-03-14T06:35:45.0647929Z  2025-03-14T06:35:45.0648274Z  2025-03-14T06:35:45.0648648Z  2025-03-14T06:35:45.0649758Z [17,798 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:45.0650906Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T06:35:45.0651954Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 62s local 2025-03-14T06:35:45.0652930Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2025-03-14T06:35:45.0653891Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T06:35:45.0654879Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T06:35:45.0655736Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T06:35:45.0656635Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2025-03-14T06:35:45.0657501Z @xla//xla/hlo/evaluator:hlo_evaluator; 24s local ... 2025-03-14T06:35:45.3930912Z 2025-03-14T06:35:45.3933109Z  2025-03-14T06:35:45.3933701Z  2025-03-14T06:35:45.3934113Z  2025-03-14T06:35:45.3934535Z  2025-03-14T06:35:45.3934961Z  2025-03-14T06:35:45.3935358Z  2025-03-14T06:35:45.3935790Z  2025-03-14T06:35:45.3936318Z  2025-03-14T06:35:45.3937203Z [17,799 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:45.3938665Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T06:35:45.3939686Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T06:35:45.3940606Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2025-03-14T06:35:45.3941551Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2025-03-14T06:35:45.3942506Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T06:35:45.3943321Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T06:35:45.3944210Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 26s local 2025-03-14T06:35:45.3945107Z @xla//xla/hlo/evaluator:hlo_evaluator; 24s local ... 2025-03-14T06:35:45.6466338Z 2025-03-14T06:35:45.6467767Z  2025-03-14T06:35:45.6468631Z  2025-03-14T06:35:45.6469116Z  2025-03-14T06:35:45.6469615Z  2025-03-14T06:35:45.6470032Z  2025-03-14T06:35:45.6470376Z  2025-03-14T06:35:45.6470707Z  2025-03-14T06:35:45.6471068Z  2025-03-14T06:35:45.6471981Z [17,800 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:45.6473126Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2025-03-14T06:35:45.6473993Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 63s local 2025-03-14T06:35:45.6474790Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2025-03-14T06:35:45.6475616Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2025-03-14T06:35:45.6476480Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T06:35:45.6477385Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T06:35:45.6478182Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T06:35:45.6478955Z @xla//xla/hlo/evaluator:hlo_evaluator; 24s local ... 2025-03-14T06:35:46.1640059Z 2025-03-14T06:35:46.1641655Z  2025-03-14T06:35:46.1642297Z  2025-03-14T06:35:46.1643501Z  2025-03-14T06:35:46.1644984Z  2025-03-14T06:35:46.1645662Z  2025-03-14T06:35:46.1646872Z  2025-03-14T06:35:46.1647462Z  2025-03-14T06:35:46.1648796Z  2025-03-14T06:35:46.1651037Z [17,801 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:46.1652290Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2025-03-14T06:35:46.1653430Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T06:35:46.1654249Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T06:35:46.1655106Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2025-03-14T06:35:46.1655965Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T06:35:46.1656703Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T06:35:46.1657547Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T06:35:46.1658344Z @xla//xla/hlo/evaluator:hlo_evaluator; 25s local ... 2025-03-14T06:35:46.4472096Z 2025-03-14T06:35:46.4473415Z  2025-03-14T06:35:46.4473933Z  2025-03-14T06:35:46.4474368Z  2025-03-14T06:35:46.4474845Z  2025-03-14T06:35:46.4475311Z  2025-03-14T06:35:46.4475766Z  2025-03-14T06:35:46.4476186Z  2025-03-14T06:35:46.4476544Z  2025-03-14T06:35:46.4477296Z [17,801 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:46.4478333Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T06:35:46.4479334Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T06:35:46.4480210Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T06:35:46.4481123Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T06:35:46.4482072Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T06:35:46.4483030Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T06:35:46.4484178Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 27s local 2025-03-14T06:35:46.4485266Z @xla//xla/hlo/evaluator:hlo_evaluator; 25s local ... 2025-03-14T06:35:46.8542948Z 2025-03-14T06:35:46.8546045Z  2025-03-14T06:35:46.8546480Z  2025-03-14T06:35:46.8547473Z  2025-03-14T06:35:46.8549009Z  2025-03-14T06:35:46.8550548Z  2025-03-14T06:35:46.8552035Z  2025-03-14T06:35:46.8553492Z  2025-03-14T06:35:46.8554898Z  2025-03-14T06:35:46.8556893Z [17,802 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:46.8558994Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T06:35:46.8561275Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 64s local 2025-03-14T06:35:46.8563087Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2025-03-14T06:35:46.8565044Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T06:35:46.8567103Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T06:35:46.8568831Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T06:35:46.8570879Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2025-03-14T06:35:46.8572806Z @xla//xla/hlo/evaluator:hlo_evaluator; 26s local ... 2025-03-14T06:35:47.1206810Z 2025-03-14T06:35:47.1208674Z  2025-03-14T06:35:47.1210047Z  2025-03-14T06:35:47.1211343Z  2025-03-14T06:35:47.1212933Z  2025-03-14T06:35:47.1214905Z  2025-03-14T06:35:47.1216218Z  2025-03-14T06:35:47.1217501Z  2025-03-14T06:35:47.1218810Z  2025-03-14T06:35:47.1220593Z [17,805 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:47.1222552Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T06:35:47.1224477Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2025-03-14T06:35:47.1226256Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2025-03-14T06:35:47.1228303Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T06:35:47.1230176Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T06:35:47.1231901Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T06:35:47.1233633Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2025-03-14T06:35:47.1235390Z @xla//xla/hlo/evaluator:hlo_evaluator; 26s local ... 2025-03-14T06:35:47.3950733Z 2025-03-14T06:35:47.3952578Z  2025-03-14T06:35:47.3953940Z  2025-03-14T06:35:47.3955228Z  2025-03-14T06:35:47.3956498Z  2025-03-14T06:35:47.3957764Z  2025-03-14T06:35:47.3959033Z  2025-03-14T06:35:47.3960292Z  2025-03-14T06:35:47.3961502Z  2025-03-14T06:35:47.3963187Z [17,808 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:47.3965191Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T06:35:47.3967151Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2025-03-14T06:35:47.3968222Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2025-03-14T06:35:47.3969554Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T06:35:47.3970381Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T06:35:47.3971061Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T06:35:47.3971871Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 28s local 2025-03-14T06:35:47.3972772Z @xla//xla/hlo/evaluator:hlo_evaluator; 26s local ... 2025-03-14T06:35:47.6204720Z 2025-03-14T06:35:47.6205713Z  2025-03-14T06:35:47.6206149Z  2025-03-14T06:35:47.6206515Z  2025-03-14T06:35:47.6206915Z  2025-03-14T06:35:47.6207268Z  2025-03-14T06:35:47.6207619Z  2025-03-14T06:35:47.6207976Z  2025-03-14T06:35:47.6208617Z  2025-03-14T06:35:47.6209467Z [17,811 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:47.6210425Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T06:35:47.6211298Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2025-03-14T06:35:47.6212085Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2025-03-14T06:35:47.6212877Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T06:35:47.6213698Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T06:35:47.6214407Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T06:35:47.6215332Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T06:35:47.6216065Z @xla//xla/hlo/evaluator:hlo_evaluator; 26s local ... 2025-03-14T06:35:47.8480548Z 2025-03-14T06:35:47.8481476Z  2025-03-14T06:35:47.8482011Z  2025-03-14T06:35:47.8482489Z  2025-03-14T06:35:47.8482935Z  2025-03-14T06:35:47.8483281Z  2025-03-14T06:35:47.8483604Z  2025-03-14T06:35:47.8483943Z  2025-03-14T06:35:47.8484248Z  2025-03-14T06:35:47.8485142Z [17,813 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:47.8486077Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T06:35:47.8486912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 65s local 2025-03-14T06:35:47.8487870Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T06:35:47.8488624Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T06:35:47.8489402Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T06:35:47.8490088Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T06:35:47.8490792Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T06:35:47.8491498Z @xla//xla/hlo/evaluator:hlo_evaluator; 27s local ... 2025-03-14T06:35:48.1997846Z 2025-03-14T06:35:48.1998849Z  2025-03-14T06:35:48.1999496Z  2025-03-14T06:35:48.1999836Z  2025-03-14T06:35:48.2000152Z  2025-03-14T06:35:48.2000478Z  2025-03-14T06:35:48.2000795Z  2025-03-14T06:35:48.2001113Z  2025-03-14T06:35:48.2001429Z  2025-03-14T06:35:48.2002181Z [17,814 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:48.2003061Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T06:35:48.2003850Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T06:35:48.2004685Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T06:35:48.2005401Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T06:35:48.2006154Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T06:35:48.2006774Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T06:35:48.2007468Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T06:35:48.2008139Z @xla//xla/hlo/evaluator:hlo_evaluator; 27s local ... 2025-03-14T06:35:48.4485929Z 2025-03-14T06:35:48.4486841Z  2025-03-14T06:35:48.4487257Z  2025-03-14T06:35:48.4487599Z  2025-03-14T06:35:48.4487947Z  2025-03-14T06:35:48.4488294Z  2025-03-14T06:35:48.4488627Z  2025-03-14T06:35:48.4488974Z  2025-03-14T06:35:48.4489325Z  2025-03-14T06:35:48.4490117Z [17,815 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:48.4491043Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2025-03-14T06:35:48.4491898Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T06:35:48.4492635Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T06:35:48.4493616Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T06:35:48.4494406Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T06:35:48.4495084Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T06:35:48.4495816Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 29s local 2025-03-14T06:35:48.4496526Z @xla//xla/hlo/evaluator:hlo_evaluator; 27s local ... 2025-03-14T06:35:48.7700003Z 2025-03-14T06:35:48.7700849Z  2025-03-14T06:35:48.7701325Z  2025-03-14T06:35:48.7701783Z  2025-03-14T06:35:48.7702163Z  2025-03-14T06:35:48.7702556Z  2025-03-14T06:35:48.7702930Z  2025-03-14T06:35:48.7703330Z  2025-03-14T06:35:48.7703726Z  2025-03-14T06:35:48.7705353Z [17,816 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:48.7706581Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2025-03-14T06:35:48.7707704Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T06:35:48.7708709Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T06:35:48.7709758Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T06:35:48.7710827Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T06:35:48.7711742Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T06:35:48.7712741Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2025-03-14T06:35:48.7713959Z @xla//xla/hlo/evaluator:hlo_evaluator; 27s local ... 2025-03-14T06:35:49.0451830Z 2025-03-14T06:35:49.0452698Z  2025-03-14T06:35:49.0453175Z  2025-03-14T06:35:49.0453579Z  2025-03-14T06:35:49.0454011Z  2025-03-14T06:35:49.0454409Z  2025-03-14T06:35:49.0454803Z  2025-03-14T06:35:49.0455196Z  2025-03-14T06:35:49.0455597Z  2025-03-14T06:35:49.0456554Z [17,819 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:49.0457687Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2025-03-14T06:35:49.0459023Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 66s local 2025-03-14T06:35:49.0459903Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T06:35:49.0460826Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T06:35:49.0462270Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T06:35:49.0463105Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T06:35:49.0464168Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2025-03-14T06:35:49.0465157Z @xla//xla/hlo/evaluator:hlo_evaluator; 28s local ... 2025-03-14T06:35:49.2492153Z 2025-03-14T06:35:49.2493014Z  2025-03-14T06:35:49.2493487Z  2025-03-14T06:35:49.2493883Z  2025-03-14T06:35:49.2494283Z  2025-03-14T06:35:49.2494646Z  2025-03-14T06:35:49.2495044Z  2025-03-14T06:35:49.2495419Z  2025-03-14T06:35:49.2495799Z  2025-03-14T06:35:49.2496759Z [17,820 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:49.2497859Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2025-03-14T06:35:49.2498912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2025-03-14T06:35:49.2499773Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T06:35:49.2500758Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T06:35:49.2501716Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T06:35:49.2502488Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T06:35:49.2503380Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2025-03-14T06:35:49.2504203Z @xla//xla/hlo/evaluator:hlo_evaluator; 28s local ... 2025-03-14T06:35:49.4582446Z 2025-03-14T06:35:49.4583571Z  2025-03-14T06:35:49.4584191Z  2025-03-14T06:35:49.4584574Z  2025-03-14T06:35:49.4584973Z  2025-03-14T06:35:49.4585384Z  2025-03-14T06:35:49.4585765Z  2025-03-14T06:35:49.4586180Z  2025-03-14T06:35:49.4586577Z  2025-03-14T06:35:49.4587491Z [17,822 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:49.4588578Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T06:35:49.4589589Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2025-03-14T06:35:49.4590456Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T06:35:49.4591348Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T06:35:49.4592520Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T06:35:49.4593323Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T06:35:49.4594212Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 30s local 2025-03-14T06:35:49.4595052Z @xla//xla/hlo/evaluator:hlo_evaluator; 28s local ... 2025-03-14T06:35:49.8497986Z 2025-03-14T06:35:49.8498820Z  2025-03-14T06:35:49.8499302Z  2025-03-14T06:35:49.8499715Z  2025-03-14T06:35:49.8500107Z  2025-03-14T06:35:49.8500620Z  2025-03-14T06:35:49.8501003Z  2025-03-14T06:35:49.8501415Z  2025-03-14T06:35:49.8501808Z  2025-03-14T06:35:49.8502712Z [17,823 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:49.8504088Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T06:35:49.8505104Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 67s local 2025-03-14T06:35:49.8506005Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T06:35:49.8506917Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T06:35:49.8507877Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T06:35:49.8508699Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T06:35:49.8509820Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T06:35:49.8510687Z @xla//xla/hlo/evaluator:hlo_evaluator; 29s local ... 2025-03-14T06:35:50.4727158Z 2025-03-14T06:35:50.4728013Z  2025-03-14T06:35:50.4728474Z  2025-03-14T06:35:50.4728866Z  2025-03-14T06:35:50.4729252Z  2025-03-14T06:35:50.4730029Z  2025-03-14T06:35:50.4730613Z  2025-03-14T06:35:50.4731150Z  2025-03-14T06:35:50.4731655Z  2025-03-14T06:35:50.4732703Z [17,824 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:50.4734032Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T06:35:50.4735182Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2025-03-14T06:35:50.4736209Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T06:35:50.4737241Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T06:35:50.4738305Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T06:35:50.4739270Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T06:35:50.4740305Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 31s local 2025-03-14T06:35:50.4741296Z @xla//xla/hlo/evaluator:hlo_evaluator; 29s local ... 2025-03-14T06:35:50.8506473Z 2025-03-14T06:35:50.8507373Z  2025-03-14T06:35:50.8508501Z  2025-03-14T06:35:50.8509516Z  2025-03-14T06:35:50.8510265Z  2025-03-14T06:35:50.8510740Z  2025-03-14T06:35:50.8511166Z  2025-03-14T06:35:50.8511615Z  2025-03-14T06:35:50.8512011Z  2025-03-14T06:35:50.8512934Z [17,824 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:50.8514320Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T06:35:50.8515419Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 68s local 2025-03-14T06:35:50.8516315Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2025-03-14T06:35:50.8517213Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T06:35:50.8518216Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T06:35:50.8519081Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T06:35:50.8520007Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T06:35:50.8520898Z @xla//xla/hlo/evaluator:hlo_evaluator; 30s local ... 2025-03-14T06:35:51.1581642Z 2025-03-14T06:35:51.1582885Z  2025-03-14T06:35:51.1583705Z  2025-03-14T06:35:51.1584167Z  2025-03-14T06:35:51.1584595Z  2025-03-14T06:35:51.1585027Z  2025-03-14T06:35:51.1585450Z  2025-03-14T06:35:51.1585866Z  2025-03-14T06:35:51.1586309Z  2025-03-14T06:35:51.1587435Z [17,828 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:51.1588621Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T06:35:51.1589756Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T06:35:51.1590711Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2025-03-14T06:35:51.1591734Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T06:35:51.1592751Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T06:35:51.1593821Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T06:35:51.1594714Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T06:35:51.1595653Z @xla//xla/hlo/evaluator:hlo_evaluator; 30s local ... 2025-03-14T06:35:51.4510579Z 2025-03-14T06:35:51.4511450Z  2025-03-14T06:35:51.4511923Z  2025-03-14T06:35:51.4512349Z  2025-03-14T06:35:51.4512778Z  2025-03-14T06:35:51.4513240Z  2025-03-14T06:35:51.4513667Z  2025-03-14T06:35:51.4514092Z  2025-03-14T06:35:51.4514505Z  2025-03-14T06:35:51.4515806Z [17,830 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:51.4517038Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T06:35:51.4518135Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T06:35:51.4519546Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2025-03-14T06:35:51.4520701Z Compiling xla/service/memory_space_assignment/algorithm.cc; 43s local 2025-03-14T06:35:51.4521838Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T06:35:51.4522871Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T06:35:51.4523939Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 32s local 2025-03-14T06:35:51.4525157Z @xla//xla/hlo/evaluator:hlo_evaluator; 30s local ... 2025-03-14T06:35:51.6875651Z 2025-03-14T06:35:51.6876557Z  2025-03-14T06:35:51.6877143Z  2025-03-14T06:35:51.6879047Z  2025-03-14T06:35:51.6879516Z  2025-03-14T06:35:51.6881130Z  2025-03-14T06:35:51.6881561Z  2025-03-14T06:35:51.6883182Z  2025-03-14T06:35:51.6883609Z  2025-03-14T06:35:51.6886056Z [17,832 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:51.6887233Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T06:35:51.6888344Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T06:35:51.6889276Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T06:35:51.6890263Z Compiling xla/service/memory_space_assignment/algorithm.cc; 43s local 2025-03-14T06:35:51.6891274Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T06:35:51.6892353Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T06:35:51.6893296Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2025-03-14T06:35:51.6894205Z @xla//xla/hlo/evaluator:hlo_evaluator; 30s local ... 2025-03-14T06:35:51.9167192Z 2025-03-14T06:35:51.9168086Z  2025-03-14T06:35:51.9168585Z  2025-03-14T06:35:51.9168987Z  2025-03-14T06:35:51.9169379Z  2025-03-14T06:35:51.9169775Z  2025-03-14T06:35:51.9170170Z  2025-03-14T06:35:51.9170567Z  2025-03-14T06:35:51.9170961Z  2025-03-14T06:35:51.9171929Z [17,834 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:51.9173040Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T06:35:51.9174338Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 69s local 2025-03-14T06:35:51.9175242Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T06:35:51.9176058Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T06:35:51.9176913Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T06:35:51.9177861Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2025-03-14T06:35:51.9178960Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2025-03-14T06:35:51.9179863Z @llvm-project//mlir:BufferizationDialect; 16s local ... 2025-03-14T06:35:52.2516764Z 2025-03-14T06:35:52.2517607Z  2025-03-14T06:35:52.2518086Z  2025-03-14T06:35:52.2518507Z  2025-03-14T06:35:52.2519271Z  2025-03-14T06:35:52.2519704Z  2025-03-14T06:35:52.2520126Z  2025-03-14T06:35:52.2520553Z  2025-03-14T06:35:52.2520975Z  2025-03-14T06:35:52.2521942Z [17,837 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:52.2523130Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T06:35:52.2524239Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T06:35:52.2525312Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T06:35:52.2526326Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T06:35:52.2527198Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T06:35:52.2528209Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 33s local 2025-03-14T06:35:52.2529248Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2025-03-14T06:35:52.2530278Z @llvm-project//mlir:BufferizationDialect; 16s local ... 2025-03-14T06:35:52.6035122Z 2025-03-14T06:35:52.6035983Z  2025-03-14T06:35:52.6036469Z  2025-03-14T06:35:52.6036889Z  2025-03-14T06:35:52.6037295Z  2025-03-14T06:35:52.6037743Z  2025-03-14T06:35:52.6038139Z  2025-03-14T06:35:52.6038578Z  2025-03-14T06:35:52.6038999Z  2025-03-14T06:35:52.6039980Z [17,838 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:52.6041105Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T06:35:52.6042095Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T06:35:52.6043026Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T06:35:52.6043823Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T06:35:52.6044951Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T06:35:52.6045825Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T06:35:52.6046845Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 31s local 2025-03-14T06:35:52.6047778Z @llvm-project//mlir:BufferizationDialect; 17s local ... 2025-03-14T06:35:52.8522950Z 2025-03-14T06:35:52.8523771Z  2025-03-14T06:35:52.8524264Z  2025-03-14T06:35:52.8524851Z  2025-03-14T06:35:52.8525270Z  2025-03-14T06:35:52.8525691Z  2025-03-14T06:35:52.8526115Z  2025-03-14T06:35:52.8526841Z  2025-03-14T06:35:52.8527278Z  2025-03-14T06:35:52.8528280Z [17,839 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:52.8529481Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T06:35:52.8530572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T06:35:52.8531515Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T06:35:52.8532369Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T06:35:52.8533253Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T06:35:52.8534063Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T06:35:52.8535202Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 32s local 2025-03-14T06:35:52.8536351Z @llvm-project//mlir:BufferizationDialect; 17s local ... 2025-03-14T06:35:53.0535935Z 2025-03-14T06:35:53.0536802Z  2025-03-14T06:35:53.0537324Z  2025-03-14T06:35:53.0537780Z  2025-03-14T06:35:53.0538220Z  2025-03-14T06:35:53.0538633Z  2025-03-14T06:35:53.0539038Z  2025-03-14T06:35:53.0539455Z  2025-03-14T06:35:53.0539866Z  2025-03-14T06:35:53.0540824Z [17,840 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:53.0541927Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T06:35:53.0542972Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 70s local 2025-03-14T06:35:53.0544071Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T06:35:53.0544854Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T06:35:53.0545621Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T06:35:53.0546616Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T06:35:53.0547586Z Compiling .../evaluator/hlo_evaluator_typed_visitor_float8.cc; 32s local 2025-03-14T06:35:53.0548491Z @llvm-project//mlir:BufferizationDialect; 17s local ... 2025-03-14T06:35:53.4201505Z 2025-03-14T06:35:53.4202710Z  2025-03-14T06:35:53.4203256Z  2025-03-14T06:35:53.4203676Z  2025-03-14T06:35:53.4204103Z  2025-03-14T06:35:53.4204484Z  2025-03-14T06:35:53.4205040Z  2025-03-14T06:35:53.4205430Z  2025-03-14T06:35:53.4205842Z  2025-03-14T06:35:53.4206816Z [17,843 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:53.4207933Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T06:35:53.4208912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T06:35:53.4209800Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T06:35:53.4210647Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T06:35:53.4211521Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T06:35:53.4212450Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 34s local 2025-03-14T06:35:53.4213329Z @llvm-project//mlir:BufferizationDialect; 18s local 2025-03-14T06:35:53.4214225Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 11s local ... 2025-03-14T06:35:53.6471543Z 2025-03-14T06:35:53.6472441Z  2025-03-14T06:35:53.6472915Z  2025-03-14T06:35:53.6473340Z  2025-03-14T06:35:53.6473769Z  2025-03-14T06:35:53.6474215Z  2025-03-14T06:35:53.6474754Z  2025-03-14T06:35:53.6475198Z  2025-03-14T06:35:53.6475593Z  2025-03-14T06:35:53.6476581Z [17,844 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:53.6477622Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2025-03-14T06:35:53.6478632Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T06:35:53.6479620Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T06:35:53.6480886Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T06:35:53.6481707Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T06:35:53.6482550Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T06:35:53.6483389Z @llvm-project//mlir:BufferizationDialect; 18s local 2025-03-14T06:35:53.6484298Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 12s local ... 2025-03-14T06:35:53.8530137Z 2025-03-14T06:35:53.8531007Z  2025-03-14T06:35:53.8531583Z  2025-03-14T06:35:53.8531999Z  2025-03-14T06:35:53.8532401Z  2025-03-14T06:35:53.8532798Z  2025-03-14T06:35:53.8533227Z  2025-03-14T06:35:53.8533635Z  2025-03-14T06:35:53.8534367Z  2025-03-14T06:35:53.8535358Z [17,845 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:53.8536513Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2025-03-14T06:35:53.8537601Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T06:35:53.8538528Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T06:35:53.8539289Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T06:35:53.8540122Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T06:35:53.8541053Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T06:35:53.8542016Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 12s local 2025-03-14T06:35:53.8543220Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 11s local ... 2025-03-14T06:35:54.0789341Z 2025-03-14T06:35:54.0790217Z  2025-03-14T06:35:54.0790685Z  2025-03-14T06:35:54.0791091Z  2025-03-14T06:35:54.0791518Z  2025-03-14T06:35:54.0791914Z  2025-03-14T06:35:54.0792295Z  2025-03-14T06:35:54.0792671Z  2025-03-14T06:35:54.0793051Z  2025-03-14T06:35:54.0793997Z [17,846 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:54.0795397Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2025-03-14T06:35:54.0796396Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 71s local 2025-03-14T06:35:54.0797286Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T06:35:54.0798037Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T06:35:54.0798849Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T06:35:54.0799756Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T06:35:54.0800678Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 12s local 2025-03-14T06:35:54.0801773Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 11s local ... 2025-03-14T06:35:54.4535029Z 2025-03-14T06:35:54.4537010Z  2025-03-14T06:35:54.4537543Z  2025-03-14T06:35:54.4537961Z  2025-03-14T06:35:54.4538387Z  2025-03-14T06:35:54.4538784Z  2025-03-14T06:35:54.4539148Z  2025-03-14T06:35:54.4539511Z  2025-03-14T06:35:54.4539907Z  2025-03-14T06:35:54.4540894Z [17,847 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:54.4542074Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T06:35:54.4543122Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T06:35:54.4544047Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T06:35:54.4544905Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T06:35:54.4545742Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T06:35:54.4546698Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 35s local 2025-03-14T06:35:54.4547804Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 13s local 2025-03-14T06:35:54.4548736Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2025-03-14T06:35:54.6539196Z 2025-03-14T06:35:54.6540030Z  2025-03-14T06:35:54.6541147Z  2025-03-14T06:35:54.6542840Z  2025-03-14T06:35:54.6544505Z  2025-03-14T06:35:54.6546241Z  2025-03-14T06:35:54.6547841Z  2025-03-14T06:35:54.6549488Z  2025-03-14T06:35:54.6551283Z  2025-03-14T06:35:54.6563120Z [17,848 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:54.6565532Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T06:35:54.6567656Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T06:35:54.6569641Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T06:35:54.6571547Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T06:35:54.6573690Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T06:35:54.6575679Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T06:35:54.6577763Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 13s local 2025-03-14T06:35:54.6579997Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2025-03-14T06:35:54.8611631Z 2025-03-14T06:35:54.8613834Z  2025-03-14T06:35:54.8616122Z  2025-03-14T06:35:54.8617663Z  2025-03-14T06:35:54.8618754Z  2025-03-14T06:35:54.8619841Z  2025-03-14T06:35:54.8620250Z  2025-03-14T06:35:54.8620591Z  2025-03-14T06:35:54.8620917Z  2025-03-14T06:35:54.8621668Z [17,849 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:54.8622835Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T06:35:54.8623678Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 72s local 2025-03-14T06:35:54.8624462Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T06:35:54.8625164Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T06:35:54.8625884Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T06:35:54.8626641Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T06:35:54.8627608Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 13s local 2025-03-14T06:35:54.8628471Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2025-03-14T06:35:55.1226885Z 2025-03-14T06:35:55.1227835Z  2025-03-14T06:35:55.1228237Z  2025-03-14T06:35:55.1228580Z  2025-03-14T06:35:55.1228921Z  2025-03-14T06:35:55.1229291Z  2025-03-14T06:35:55.1229625Z  2025-03-14T06:35:55.1229965Z  2025-03-14T06:35:55.1230307Z  2025-03-14T06:35:55.1231107Z [17,850 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:55.1232049Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T06:35:55.1232891Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T06:35:55.1233657Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T06:35:55.1234336Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T06:35:55.1235038Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T06:35:55.1235783Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T06:35:55.1236559Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 13s local 2025-03-14T06:35:55.1237801Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 12s local ... 2025-03-14T06:35:55.4546187Z 2025-03-14T06:35:55.4548246Z  2025-03-14T06:35:55.4548681Z  2025-03-14T06:35:55.4549024Z  2025-03-14T06:35:55.4549357Z  2025-03-14T06:35:55.4549697Z  2025-03-14T06:35:55.4550065Z  2025-03-14T06:35:55.4550401Z  2025-03-14T06:35:55.4550729Z  2025-03-14T06:35:55.4551530Z [17,851 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:55.4552733Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T06:35:55.4553593Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T06:35:55.4554431Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T06:35:55.4555069Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T06:35:55.4555708Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T06:35:55.4556410Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 36s local 2025-03-14T06:35:55.4557160Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 14s local 2025-03-14T06:35:55.4557937Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local ... 2025-03-14T06:35:55.7192713Z 2025-03-14T06:35:55.7193893Z  2025-03-14T06:35:55.7194356Z  2025-03-14T06:35:55.7194745Z  2025-03-14T06:35:55.7195140Z  2025-03-14T06:35:55.7195520Z  2025-03-14T06:35:55.7195894Z  2025-03-14T06:35:55.7196283Z  2025-03-14T06:35:55.7196672Z  2025-03-14T06:35:55.7197601Z [17,855 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:55.7198675Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T06:35:55.7199691Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T06:35:55.7200567Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T06:35:55.7201344Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T06:35:55.7202412Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T06:35:55.7203253Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T06:35:55.7204141Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 14s local 2025-03-14T06:35:55.7205249Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local ... 2025-03-14T06:35:56.0551514Z 2025-03-14T06:35:56.0552370Z  2025-03-14T06:35:56.0552864Z  2025-03-14T06:35:56.0553294Z  2025-03-14T06:35:56.0553745Z  2025-03-14T06:35:56.0554160Z  2025-03-14T06:35:56.0554570Z  2025-03-14T06:35:56.0554965Z  2025-03-14T06:35:56.0555644Z  2025-03-14T06:35:56.0556610Z [17,855 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:56.0557720Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T06:35:56.0558759Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 73s local 2025-03-14T06:35:56.0559705Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T06:35:56.0560613Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T06:35:56.0561415Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T06:35:56.0562276Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T06:35:56.0563233Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 14s local 2025-03-14T06:35:56.0564223Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local ... 2025-03-14T06:35:56.3027183Z 2025-03-14T06:35:56.3028038Z  2025-03-14T06:35:56.3028554Z  2025-03-14T06:35:56.3028989Z  2025-03-14T06:35:56.3029413Z  2025-03-14T06:35:56.3029775Z  2025-03-14T06:35:56.3030132Z  2025-03-14T06:35:56.3030490Z  2025-03-14T06:35:56.3030834Z  2025-03-14T06:35:56.3031706Z [17,858 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:56.3032791Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T06:35:56.3033755Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T06:35:56.3034679Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T06:35:56.3035497Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T06:35:56.3036322Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T06:35:56.3037425Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 37s local 2025-03-14T06:35:56.3038388Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 14s local 2025-03-14T06:35:56.3039413Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 13s local ... 2025-03-14T06:35:56.6050788Z 2025-03-14T06:35:56.6051647Z  2025-03-14T06:35:56.6052142Z  2025-03-14T06:35:56.6052542Z  2025-03-14T06:35:56.6052968Z  2025-03-14T06:35:56.6053350Z  2025-03-14T06:35:56.6053747Z  2025-03-14T06:35:56.6054160Z  2025-03-14T06:35:56.6054597Z  2025-03-14T06:35:56.6055523Z [17,859 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:56.6056636Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2025-03-14T06:35:56.6058002Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T06:35:56.6058918Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T06:35:56.6059730Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2025-03-14T06:35:56.6060560Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T06:35:56.6061518Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T06:35:56.6062478Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 15s local 2025-03-14T06:35:56.6063462Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local ... 2025-03-14T06:35:56.8557316Z 2025-03-14T06:35:56.8558536Z  2025-03-14T06:35:56.8559016Z  2025-03-14T06:35:56.8559679Z  2025-03-14T06:35:56.8560083Z  2025-03-14T06:35:56.8560497Z  2025-03-14T06:35:56.8560889Z  2025-03-14T06:35:56.8561277Z  2025-03-14T06:35:56.8561665Z  2025-03-14T06:35:56.8562579Z [17,859 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:56.8563714Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2025-03-14T06:35:56.8564914Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T06:35:56.8565959Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T06:35:56.8566946Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2025-03-14T06:35:56.8567790Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T06:35:56.8568669Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T06:35:56.8569563Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 15s local 2025-03-14T06:35:56.8570577Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local ... 2025-03-14T06:35:57.0560977Z 2025-03-14T06:35:57.0562202Z  2025-03-14T06:35:57.0562695Z  2025-03-14T06:35:57.0563080Z  2025-03-14T06:35:57.0563505Z  2025-03-14T06:35:57.0563903Z  2025-03-14T06:35:57.0564298Z  2025-03-14T06:35:57.0564843Z  2025-03-14T06:35:57.0565216Z  2025-03-14T06:35:57.0566379Z [17,860 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:57.0567461Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2025-03-14T06:35:57.0568481Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 74s local 2025-03-14T06:35:57.0569376Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T06:35:57.0570158Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2025-03-14T06:35:57.0570939Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T06:35:57.0571838Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T06:35:57.0572749Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 15s local 2025-03-14T06:35:57.0573699Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 14s local ... 2025-03-14T06:35:57.4566372Z 2025-03-14T06:35:57.4567592Z  2025-03-14T06:35:57.4568026Z  2025-03-14T06:35:57.4568352Z  2025-03-14T06:35:57.4568671Z  2025-03-14T06:35:57.4568992Z  2025-03-14T06:35:57.4569564Z  2025-03-14T06:35:57.4569906Z  2025-03-14T06:35:57.4570216Z  2025-03-14T06:35:57.4571000Z [17,861 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:57.4571914Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T06:35:57.4572751Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T06:35:57.4573476Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T06:35:57.4574137Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T06:35:57.4574817Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T06:35:57.4575547Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 38s local 2025-03-14T06:35:57.4576465Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 16s local 2025-03-14T06:35:57.4577263Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2025-03-14T06:35:57.6569240Z 2025-03-14T06:35:57.6570101Z  2025-03-14T06:35:57.6570479Z  2025-03-14T06:35:57.6570805Z  2025-03-14T06:35:57.6571265Z  2025-03-14T06:35:57.6571687Z  2025-03-14T06:35:57.6572041Z  2025-03-14T06:35:57.6572333Z  2025-03-14T06:35:57.6572647Z  2025-03-14T06:35:57.6573429Z [17,864 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:57.6574330Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T06:35:57.6575331Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T06:35:57.6576016Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T06:35:57.6576644Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T06:35:57.6577705Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T06:35:57.6578391Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T06:35:57.6579232Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 16s local 2025-03-14T06:35:57.6580096Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2025-03-14T06:35:57.8906134Z 2025-03-14T06:35:57.8906952Z  2025-03-14T06:35:57.8907411Z  2025-03-14T06:35:57.8907921Z  2025-03-14T06:35:57.8908319Z  2025-03-14T06:35:57.8908705Z  2025-03-14T06:35:57.8909093Z  2025-03-14T06:35:57.8909477Z  2025-03-14T06:35:57.8909854Z  2025-03-14T06:35:57.8910764Z [17,867 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:57.8911891Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T06:35:57.8912902Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 75s local 2025-03-14T06:35:57.8913796Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T06:35:57.8914595Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T06:35:57.8915418Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T06:35:57.8916298Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T06:35:57.8917228Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 16s local 2025-03-14T06:35:57.8918227Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2025-03-14T06:35:58.1521809Z 2025-03-14T06:35:58.1522613Z  2025-03-14T06:35:58.1523098Z  2025-03-14T06:35:58.1523481Z  2025-03-14T06:35:58.1523830Z  2025-03-14T06:35:58.1524210Z  2025-03-14T06:35:58.1524695Z  2025-03-14T06:35:58.1525058Z  2025-03-14T06:35:58.1525433Z  2025-03-14T06:35:58.1526462Z [17,870 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:58.1527541Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T06:35:58.1528434Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T06:35:58.1529578Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T06:35:58.1530412Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T06:35:58.1531241Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T06:35:58.1532029Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T06:35:58.1532944Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 16s local 2025-03-14T06:35:58.1533924Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 15s local ... 2025-03-14T06:35:58.4575748Z 2025-03-14T06:35:58.4576644Z  2025-03-14T06:35:58.4577107Z  2025-03-14T06:35:58.4579244Z  2025-03-14T06:35:58.4581155Z  2025-03-14T06:35:58.4582905Z  2025-03-14T06:35:58.4584558Z  2025-03-14T06:35:58.4586519Z  2025-03-14T06:35:58.4587811Z  2025-03-14T06:35:58.4590019Z [17,871 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:58.4592948Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2025-03-14T06:35:58.4594984Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T06:35:58.4596903Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T06:35:58.4598814Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T06:35:58.4600658Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T06:35:58.4602539Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 39s local 2025-03-14T06:35:58.4604667Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 17s local 2025-03-14T06:35:58.4607000Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local ... 2025-03-14T06:35:58.6578850Z 2025-03-14T06:35:58.6580806Z  2025-03-14T06:35:58.6582692Z  2025-03-14T06:35:58.6583298Z  2025-03-14T06:35:58.6584356Z  2025-03-14T06:35:58.6584790Z  2025-03-14T06:35:58.6585161Z  2025-03-14T06:35:58.6585524Z  2025-03-14T06:35:58.6585884Z  2025-03-14T06:35:58.6586770Z [17,872 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:58.6588039Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2025-03-14T06:35:58.6589007Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 76s local 2025-03-14T06:35:58.6590011Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T06:35:58.6590861Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T06:35:58.6591591Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T06:35:58.6592362Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 40s local 2025-03-14T06:35:58.6593164Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 17s local 2025-03-14T06:35:58.6593985Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local ... 2025-03-14T06:35:59.2330499Z 2025-03-14T06:35:59.2331341Z  2025-03-14T06:35:59.2331783Z  2025-03-14T06:35:59.2332150Z  2025-03-14T06:35:59.2332586Z  2025-03-14T06:35:59.2332960Z  2025-03-14T06:35:59.2333324Z  2025-03-14T06:35:59.2333659Z  2025-03-14T06:35:59.2334012Z  2025-03-14T06:35:59.2334858Z [17,873 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:35:59.2335819Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2025-03-14T06:35:59.2336706Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2025-03-14T06:35:59.2337488Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T06:35:59.2338213Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T06:35:59.2338941Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2025-03-14T06:35:59.2339715Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMAttrs.cpp; 40s local 2025-03-14T06:35:59.2340528Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 17s local 2025-03-14T06:35:59.2341618Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 16s local ... 2025-03-14T06:35:59.4584424Z 2025-03-14T06:35:59.4585209Z  2025-03-14T06:35:59.4585629Z  2025-03-14T06:35:59.4586037Z  2025-03-14T06:35:59.4586400Z  2025-03-14T06:35:59.4586777Z  2025-03-14T06:35:59.4587121Z  2025-03-14T06:35:59.4587499Z  2025-03-14T06:35:59.4587844Z  2025-03-14T06:35:59.4588717Z [17,876 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:35:59.4589764Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2025-03-14T06:35:59.4590730Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 77s local 2025-03-14T06:35:59.4591580Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T06:35:59.4592611Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T06:35:59.4593353Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2025-03-14T06:35:59.4594173Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 18s local 2025-03-14T06:35:59.4595034Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2025-03-14T06:35:59.4595835Z @xla//xla/hlo/evaluator:hlo_evaluator; 12s local ... 2025-03-14T06:36:00.2271583Z 2025-03-14T06:36:00.2272441Z  2025-03-14T06:36:00.2274751Z  2025-03-14T06:36:00.2277452Z  2025-03-14T06:36:00.2280049Z  2025-03-14T06:36:00.2282663Z  2025-03-14T06:36:00.2285477Z  2025-03-14T06:36:00.2288003Z  2025-03-14T06:36:00.2290585Z  2025-03-14T06:36:00.2293890Z [17,877 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:00.2296996Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2025-03-14T06:36:00.2300041Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T06:36:00.2302928Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2025-03-14T06:36:00.2305732Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T06:36:00.2308541Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2025-03-14T06:36:00.2311678Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 18s local 2025-03-14T06:36:00.2314651Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 17s local 2025-03-14T06:36:00.2317488Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2025-03-14T06:36:00.4591715Z 2025-03-14T06:36:00.4594902Z  2025-03-14T06:36:00.4597528Z  2025-03-14T06:36:00.4600011Z  2025-03-14T06:36:00.4602497Z  2025-03-14T06:36:00.4605145Z  2025-03-14T06:36:00.4607678Z  2025-03-14T06:36:00.4610139Z  2025-03-14T06:36:00.4612618Z  2025-03-14T06:36:00.4614889Z [17,877 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:00.4615964Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T06:36:00.4616912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 78s local 2025-03-14T06:36:00.4617743Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2025-03-14T06:36:00.4618546Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2025-03-14T06:36:00.4619348Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2025-03-14T06:36:00.4620164Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 19s local 2025-03-14T06:36:00.4621041Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local 2025-03-14T06:36:00.4621894Z @xla//xla/hlo/evaluator:hlo_evaluator; 13s local ... 2025-03-14T06:36:01.1543053Z 2025-03-14T06:36:01.1544261Z  2025-03-14T06:36:01.1544924Z  2025-03-14T06:36:01.1545542Z  2025-03-14T06:36:01.1546623Z  2025-03-14T06:36:01.1547066Z  2025-03-14T06:36:01.1547393Z  2025-03-14T06:36:01.1547714Z  2025-03-14T06:36:01.1548030Z  2025-03-14T06:36:01.1548796Z [17,878 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:01.1549934Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T06:36:01.1550779Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T06:36:01.1551470Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2025-03-14T06:36:01.1552117Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2025-03-14T06:36:01.1552785Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T06:36:01.1553493Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 19s local 2025-03-14T06:36:01.1554302Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 18s local 2025-03-14T06:36:01.1555046Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T06:36:01.4600781Z 2025-03-14T06:36:01.4602325Z  2025-03-14T06:36:01.4602754Z  2025-03-14T06:36:01.4603097Z  2025-03-14T06:36:01.4603442Z  2025-03-14T06:36:01.4603780Z  2025-03-14T06:36:01.4604120Z  2025-03-14T06:36:01.4604440Z  2025-03-14T06:36:01.4604949Z  2025-03-14T06:36:01.4605802Z [17,878 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:01.4606773Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T06:36:01.4607649Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T06:36:01.4608409Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2025-03-14T06:36:01.4609089Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T06:36:01.4612199Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T06:36:01.4612959Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local 2025-03-14T06:36:01.4613772Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2025-03-14T06:36:01.4614546Z @xla//xla/hlo/evaluator:hlo_evaluator; 14s local ... 2025-03-14T06:36:02.0111304Z 2025-03-14T06:36:02.0112570Z  2025-03-14T06:36:02.0113033Z  2025-03-14T06:36:02.0113413Z  2025-03-14T06:36:02.0113807Z  2025-03-14T06:36:02.0114163Z  2025-03-14T06:36:02.0114515Z  2025-03-14T06:36:02.0114877Z  2025-03-14T06:36:02.0115445Z  2025-03-14T06:36:02.0116316Z [17,879 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:02.0117329Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T06:36:02.0118238Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 79s local 2025-03-14T06:36:02.0119052Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2025-03-14T06:36:02.0119767Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T06:36:02.0120522Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T06:36:02.0121335Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local 2025-03-14T06:36:02.0122200Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2025-03-14T06:36:02.0123008Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:36:02.2607315Z 2025-03-14T06:36:02.2608420Z  2025-03-14T06:36:02.2608874Z  2025-03-14T06:36:02.2609259Z  2025-03-14T06:36:02.2609597Z  2025-03-14T06:36:02.2609929Z  2025-03-14T06:36:02.2610264Z  2025-03-14T06:36:02.2610604Z  2025-03-14T06:36:02.2610940Z  2025-03-14T06:36:02.2611766Z [17,879 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:02.2612746Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T06:36:02.2613605Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2025-03-14T06:36:02.2614371Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2025-03-14T06:36:02.2615072Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T06:36:02.2615747Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T06:36:02.2616714Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 20s local 2025-03-14T06:36:02.2617541Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 19s local 2025-03-14T06:36:02.2618301Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:36:02.4781172Z 2025-03-14T06:36:02.4782363Z  2025-03-14T06:36:02.4782799Z  2025-03-14T06:36:02.4783168Z  2025-03-14T06:36:02.4783529Z  2025-03-14T06:36:02.4783889Z  2025-03-14T06:36:02.4784244Z  2025-03-14T06:36:02.4784605Z  2025-03-14T06:36:02.4784958Z  2025-03-14T06:36:02.4785841Z [17,880 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:02.4786835Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2025-03-14T06:36:02.4787977Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2025-03-14T06:36:02.4788771Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2025-03-14T06:36:02.4789496Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T06:36:02.4790223Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T06:36:02.4791015Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local 2025-03-14T06:36:02.4791867Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2025-03-14T06:36:02.4792626Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:36:02.8615186Z 2025-03-14T06:36:02.8616182Z  2025-03-14T06:36:02.8616601Z  2025-03-14T06:36:02.8616944Z  2025-03-14T06:36:02.8617550Z  2025-03-14T06:36:02.8617883Z  2025-03-14T06:36:02.8618221Z  2025-03-14T06:36:02.8618568Z  2025-03-14T06:36:02.8618917Z  2025-03-14T06:36:02.8619712Z [17,880 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:02.8620658Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2025-03-14T06:36:02.8621515Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 80s local 2025-03-14T06:36:02.8622269Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T06:36:02.8623108Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T06:36:02.8623799Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T06:36:02.8624512Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local 2025-03-14T06:36:02.8625276Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2025-03-14T06:36:02.8625977Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:36:03.1859685Z 2025-03-14T06:36:03.1860788Z  2025-03-14T06:36:03.1861185Z  2025-03-14T06:36:03.1861499Z  2025-03-14T06:36:03.1862050Z  2025-03-14T06:36:03.1862411Z  2025-03-14T06:36:03.1862823Z  2025-03-14T06:36:03.1863150Z  2025-03-14T06:36:03.1863509Z  2025-03-14T06:36:03.1864349Z [17,886 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:03.1865521Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2025-03-14T06:36:03.1866962Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T06:36:03.1867860Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T06:36:03.1868554Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T06:36:03.1869292Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T06:36:03.1870116Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local 2025-03-14T06:36:03.1870925Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 20s local 2025-03-14T06:36:03.1871727Z @xla//xla/hlo/evaluator:hlo_evaluator; 15s local ... 2025-03-14T06:36:03.4520875Z 2025-03-14T06:36:03.4522148Z  2025-03-14T06:36:03.4522617Z  2025-03-14T06:36:03.4522997Z  2025-03-14T06:36:03.4523375Z  2025-03-14T06:36:03.4523742Z  2025-03-14T06:36:03.4524114Z  2025-03-14T06:36:03.4524471Z  2025-03-14T06:36:03.4525279Z  2025-03-14T06:36:03.4526213Z [17,887 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:03.4527278Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T06:36:03.4528279Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T06:36:03.4529175Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T06:36:03.4529949Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T06:36:03.4530718Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T06:36:03.4531538Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local 2025-03-14T06:36:03.4532431Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2025-03-14T06:36:03.4533612Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 14s local ... 2025-03-14T06:36:03.6621414Z 2025-03-14T06:36:03.6622353Z  2025-03-14T06:36:03.6622873Z  2025-03-14T06:36:03.6623436Z  2025-03-14T06:36:03.6623824Z  2025-03-14T06:36:03.6624224Z  2025-03-14T06:36:03.6624583Z  2025-03-14T06:36:03.6624982Z  2025-03-14T06:36:03.6625370Z  2025-03-14T06:36:03.6626301Z [17,887 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:03.6627429Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T06:36:03.6628441Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T06:36:03.6629669Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T06:36:03.6630476Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T06:36:03.6631305Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T06:36:03.6632256Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local 2025-03-14T06:36:03.6633148Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2025-03-14T06:36:03.6634218Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 14s local ... 2025-03-14T06:36:03.9629784Z 2025-03-14T06:36:03.9630685Z  2025-03-14T06:36:03.9631360Z  2025-03-14T06:36:03.9631822Z  2025-03-14T06:36:03.9632180Z  2025-03-14T06:36:03.9632566Z  2025-03-14T06:36:03.9632927Z  2025-03-14T06:36:03.9633277Z  2025-03-14T06:36:03.9633624Z  2025-03-14T06:36:03.9634466Z [17,890 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:03.9635466Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T06:36:03.9636454Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 81s local 2025-03-14T06:36:03.9637226Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2025-03-14T06:36:03.9637915Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T06:36:03.9638613Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T06:36:03.9639385Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local 2025-03-14T06:36:03.9640208Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2025-03-14T06:36:03.9641130Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 14s local ... 2025-03-14T06:36:04.2626386Z 2025-03-14T06:36:04.2627892Z  2025-03-14T06:36:04.2628404Z  2025-03-14T06:36:04.2630053Z  2025-03-14T06:36:04.2631272Z  2025-03-14T06:36:04.2632063Z  2025-03-14T06:36:04.2632513Z  2025-03-14T06:36:04.2632931Z  2025-03-14T06:36:04.2633335Z  2025-03-14T06:36:04.2634259Z [17,891 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:04.2635410Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T06:36:04.2636443Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 82s local 2025-03-14T06:36:04.2637347Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2025-03-14T06:36:04.2638441Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T06:36:04.2639293Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T06:36:04.2640171Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local 2025-03-14T06:36:04.2641196Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 21s local 2025-03-14T06:36:04.2642327Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 14s local ... 2025-03-14T06:36:05.2633772Z 2025-03-14T06:36:05.2635307Z  2025-03-14T06:36:05.2635974Z  2025-03-14T06:36:05.2637557Z  2025-03-14T06:36:05.2638813Z  2025-03-14T06:36:05.2640274Z  2025-03-14T06:36:05.2641667Z  2025-03-14T06:36:05.2643019Z  2025-03-14T06:36:05.2644348Z  2025-03-14T06:36:05.2646316Z [17,892 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:36:05.2647524Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2025-03-14T06:36:05.2648583Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T06:36:05.2649502Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2025-03-14T06:36:05.2650357Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2025-03-14T06:36:05.2651267Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2025-03-14T06:36:05.2652181Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local 2025-03-14T06:36:05.2653177Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 22s local 2025-03-14T06:36:05.2654596Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 15s local ... 2025-03-14T06:36:05.6146424Z 2025-03-14T06:36:05.6147620Z  2025-03-14T06:36:05.6148113Z  2025-03-14T06:36:05.6148562Z  2025-03-14T06:36:05.6148990Z  2025-03-14T06:36:05.6149411Z  2025-03-14T06:36:05.6149841Z  2025-03-14T06:36:05.6150278Z  2025-03-14T06:36:05.6150696Z  2025-03-14T06:36:05.6151613Z [17,894 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:05.6153028Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2025-03-14T06:36:05.6154131Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T06:36:05.6155104Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2025-03-14T06:36:05.6155930Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T06:36:05.6156644Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2025-03-14T06:36:05.6157537Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2025-03-14T06:36:05.6158506Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T06:36:05.6159636Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local ... 2025-03-14T06:36:05.8545207Z 2025-03-14T06:36:05.8546164Z  2025-03-14T06:36:05.8546667Z  2025-03-14T06:36:05.8548587Z  2025-03-14T06:36:05.8549042Z  2025-03-14T06:36:05.8550868Z  2025-03-14T06:36:05.8551314Z  2025-03-14T06:36:05.8553118Z  2025-03-14T06:36:05.8553567Z  2025-03-14T06:36:05.8555948Z [17,895 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:05.8557130Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2025-03-14T06:36:05.8558195Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T06:36:05.8559142Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2025-03-14T06:36:05.8559962Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T06:36:05.8560822Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T06:36:05.8561729Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2025-03-14T06:36:05.8562745Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T06:36:05.8563878Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local ... 2025-03-14T06:36:06.0641742Z 2025-03-14T06:36:06.0642871Z  2025-03-14T06:36:06.0644770Z  2025-03-14T06:36:06.0646264Z  2025-03-14T06:36:06.0647864Z  2025-03-14T06:36:06.0649310Z  2025-03-14T06:36:06.0650744Z  2025-03-14T06:36:06.0651801Z  2025-03-14T06:36:06.0652291Z  2025-03-14T06:36:06.0653231Z [17,895 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:06.0654447Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2025-03-14T06:36:06.0655497Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 83s local 2025-03-14T06:36:06.0656452Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2025-03-14T06:36:06.0657557Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T06:36:06.0658478Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T06:36:06.0659460Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local 2025-03-14T06:36:06.0660521Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 23s local 2025-03-14T06:36:06.0661712Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local ... 2025-03-14T06:36:06.7033040Z 2025-03-14T06:36:06.7034021Z  2025-03-14T06:36:06.7034456Z  2025-03-14T06:36:06.7034820Z  2025-03-14T06:36:06.7035207Z  2025-03-14T06:36:06.7035545Z  2025-03-14T06:36:06.7035888Z  2025-03-14T06:36:06.7036250Z  2025-03-14T06:36:06.7036609Z  2025-03-14T06:36:06.7037745Z [17,896 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:06.7038767Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T06:36:06.7039741Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T06:36:06.7040620Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T06:36:06.7041557Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T06:36:06.7042443Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T06:36:06.7043544Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2025-03-14T06:36:06.7044675Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T06:36:06.7045762Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local ... 2025-03-14T06:36:07.0647571Z 2025-03-14T06:36:07.0648763Z  2025-03-14T06:36:07.0649246Z  2025-03-14T06:36:07.0649637Z  2025-03-14T06:36:07.0650068Z  2025-03-14T06:36:07.0650448Z  2025-03-14T06:36:07.0650801Z  2025-03-14T06:36:07.0651135Z  2025-03-14T06:36:07.0651495Z  2025-03-14T06:36:07.0652346Z [17,898 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:07.0653383Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T06:36:07.0654298Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 84s local 2025-03-14T06:36:07.0655227Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T06:36:07.0656003Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T06:36:07.0656759Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T06:36:07.0657567Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2025-03-14T06:36:07.0658445Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T06:36:07.0659399Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local ... 2025-03-14T06:36:07.3413648Z 2025-03-14T06:36:07.3414921Z  2025-03-14T06:36:07.3415431Z  2025-03-14T06:36:07.3415870Z  2025-03-14T06:36:07.3416276Z  2025-03-14T06:36:07.3416708Z  2025-03-14T06:36:07.3417074Z  2025-03-14T06:36:07.3417479Z  2025-03-14T06:36:07.3417857Z  2025-03-14T06:36:07.3419037Z [17,899 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:07.3420197Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T06:36:07.3421159Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T06:36:07.3422140Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T06:36:07.3422944Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T06:36:07.3423783Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T06:36:07.3424677Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local 2025-03-14T06:36:07.3425651Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 24s local 2025-03-14T06:36:07.3426730Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local ... 2025-03-14T06:36:07.6656252Z 2025-03-14T06:36:07.6657439Z  2025-03-14T06:36:07.6657952Z  2025-03-14T06:36:07.6658377Z  2025-03-14T06:36:07.6658806Z  2025-03-14T06:36:07.6659243Z  2025-03-14T06:36:07.6659680Z  2025-03-14T06:36:07.6660104Z  2025-03-14T06:36:07.6660499Z  2025-03-14T06:36:07.6661434Z [17,899 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:07.6662546Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T06:36:07.6663518Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T06:36:07.6664412Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T06:36:07.6665210Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T06:36:07.6666601Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T06:36:07.6667507Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2025-03-14T06:36:07.6668942Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T06:36:07.6670215Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local ... 2025-03-14T06:36:07.8659684Z 2025-03-14T06:36:07.8660809Z  2025-03-14T06:36:07.8661310Z  2025-03-14T06:36:07.8661727Z  2025-03-14T06:36:07.8662124Z  2025-03-14T06:36:07.8662524Z  2025-03-14T06:36:07.8663140Z  2025-03-14T06:36:07.8663538Z  2025-03-14T06:36:07.8663926Z  2025-03-14T06:36:07.8664813Z [17,900 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:07.8666178Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T06:36:07.8667165Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 85s local 2025-03-14T06:36:07.8668095Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T06:36:07.8669397Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T06:36:07.8670461Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2025-03-14T06:36:07.8671530Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T06:36:07.8672727Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2025-03-14T06:36:07.8674024Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local ... 2025-03-14T06:36:08.2569224Z 2025-03-14T06:36:08.2570220Z  2025-03-14T06:36:08.2570696Z  2025-03-14T06:36:08.2572655Z  2025-03-14T06:36:08.2573062Z  2025-03-14T06:36:08.2574897Z  2025-03-14T06:36:08.2575297Z  2025-03-14T06:36:08.2577139Z  2025-03-14T06:36:08.2578137Z  2025-03-14T06:36:08.2580353Z [17,904 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:08.2582704Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T06:36:08.2584086Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T06:36:08.2585389Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T06:36:08.2586501Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T06:36:08.2587968Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local 2025-03-14T06:36:08.2589244Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 25s local 2025-03-14T06:36:08.2590597Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2025-03-14T06:36:08.2592023Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 18s local ... 2025-03-14T06:36:08.4664812Z 2025-03-14T06:36:08.4666121Z  2025-03-14T06:36:08.4666578Z  2025-03-14T06:36:08.4667148Z  2025-03-14T06:36:08.4667547Z  2025-03-14T06:36:08.4668065Z  2025-03-14T06:36:08.4668542Z  2025-03-14T06:36:08.4669009Z  2025-03-14T06:36:08.4669492Z  2025-03-14T06:36:08.4670490Z [17,904 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:08.4671887Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T06:36:08.4672954Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T06:36:08.4673896Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T06:36:08.4674765Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T06:36:08.4675686Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T06:36:08.4676721Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T06:36:08.4677770Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2025-03-14T06:36:08.4679046Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local ... 2025-03-14T06:36:08.8669965Z 2025-03-14T06:36:08.8671009Z  2025-03-14T06:36:08.8671490Z  2025-03-14T06:36:08.8673307Z  2025-03-14T06:36:08.8673725Z  2025-03-14T06:36:08.8675041Z  2025-03-14T06:36:08.8675587Z  2025-03-14T06:36:08.8676101Z  2025-03-14T06:36:08.8676619Z  2025-03-14T06:36:08.8677700Z [17,905 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:08.8679000Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T06:36:08.8680161Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T06:36:08.8681474Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T06:36:08.8682453Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T06:36:08.8683441Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T06:36:08.8684678Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T06:36:08.8685879Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2025-03-14T06:36:08.8687140Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local ... 2025-03-14T06:36:09.0953714Z 2025-03-14T06:36:09.0954640Z  2025-03-14T06:36:09.0955104Z  2025-03-14T06:36:09.0957054Z  2025-03-14T06:36:09.0957479Z  2025-03-14T06:36:09.0959201Z  2025-03-14T06:36:09.0959595Z  2025-03-14T06:36:09.1017751Z  2025-03-14T06:36:09.1018911Z  2025-03-14T06:36:09.1022171Z [17,906 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:09.1024363Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T06:36:09.1026396Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 86s local 2025-03-14T06:36:09.1028295Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T06:36:09.1030043Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T06:36:09.1031882Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T06:36:09.1033788Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T06:36:09.1035782Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2025-03-14T06:36:09.1037928Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local ... 2025-03-14T06:36:09.4008199Z 2025-03-14T06:36:09.4010751Z  2025-03-14T06:36:09.4013718Z  2025-03-14T06:36:09.4014239Z  2025-03-14T06:36:09.4014693Z  2025-03-14T06:36:09.4015124Z  2025-03-14T06:36:09.4015553Z  2025-03-14T06:36:09.4016006Z  2025-03-14T06:36:09.4016446Z  2025-03-14T06:36:09.4017424Z [17,907 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:09.4018618Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T06:36:09.4019710Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T06:36:09.4020688Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T06:36:09.4021552Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T06:36:09.4022805Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T06:36:09.4023915Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 26s local 2025-03-14T06:36:09.4025067Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2025-03-14T06:36:09.4026234Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 19s local ... 2025-03-14T06:36:09.6675767Z 2025-03-14T06:36:09.6677303Z  2025-03-14T06:36:09.6677814Z  2025-03-14T06:36:09.6679410Z  2025-03-14T06:36:09.6680593Z  2025-03-14T06:36:09.6682029Z  2025-03-14T06:36:09.6683465Z  2025-03-14T06:36:09.6685003Z  2025-03-14T06:36:09.6686474Z  2025-03-14T06:36:09.6688390Z [17,908 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:09.6689920Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T06:36:09.6690980Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T06:36:09.6691956Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T06:36:09.6692706Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T06:36:09.6693684Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2025-03-14T06:36:09.6694685Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2025-03-14T06:36:09.6696079Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2025-03-14T06:36:09.6697278Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local ... 2025-03-14T06:36:10.0058119Z 2025-03-14T06:36:10.0059437Z  2025-03-14T06:36:10.0059959Z  2025-03-14T06:36:10.0061536Z  2025-03-14T06:36:10.0062869Z  2025-03-14T06:36:10.0064086Z  2025-03-14T06:36:10.0065706Z  2025-03-14T06:36:10.0067304Z  2025-03-14T06:36:10.0068705Z  2025-03-14T06:36:10.0070593Z [17,909 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:10.0071832Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T06:36:10.0072912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 87s local 2025-03-14T06:36:10.0073909Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2025-03-14T06:36:10.0074755Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T06:36:10.0075684Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2025-03-14T06:36:10.0076676Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2025-03-14T06:36:10.0077768Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2025-03-14T06:36:10.0078884Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local ... 2025-03-14T06:36:10.2500782Z 2025-03-14T06:36:10.2502359Z  2025-03-14T06:36:10.2502862Z  2025-03-14T06:36:10.2504534Z  2025-03-14T06:36:10.2505720Z  2025-03-14T06:36:10.2507268Z  2025-03-14T06:36:10.2507725Z  2025-03-14T06:36:10.2509455Z  2025-03-14T06:36:10.2509891Z  2025-03-14T06:36:10.2512291Z [17,911 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:10.2513664Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T06:36:10.2514736Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T06:36:10.2515631Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2025-03-14T06:36:10.2516435Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T06:36:10.2517291Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2025-03-14T06:36:10.2518269Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 27s local 2025-03-14T06:36:10.2519344Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2025-03-14T06:36:10.2520677Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 20s local ... 2025-03-14T06:36:10.4681252Z 2025-03-14T06:36:10.4682561Z  2025-03-14T06:36:10.4683151Z  2025-03-14T06:36:10.4683596Z  2025-03-14T06:36:10.4683991Z  2025-03-14T06:36:10.4684354Z  2025-03-14T06:36:10.4684865Z  2025-03-14T06:36:10.4685271Z  2025-03-14T06:36:10.4685683Z  2025-03-14T06:36:10.4686631Z [17,913 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:10.4687945Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T06:36:10.4689017Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T06:36:10.4689936Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2025-03-14T06:36:10.4690784Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T06:36:10.4691945Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T06:36:10.4692963Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T06:36:10.4694036Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T06:36:10.4695349Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 21s local ... 2025-03-14T06:36:10.8144844Z 2025-03-14T06:36:10.8145836Z  2025-03-14T06:36:10.8146362Z  2025-03-14T06:36:10.8148487Z  2025-03-14T06:36:10.8148952Z  2025-03-14T06:36:10.8150747Z  2025-03-14T06:36:10.8151196Z  2025-03-14T06:36:10.8153235Z  2025-03-14T06:36:10.8153678Z  2025-03-14T06:36:10.8155939Z [17,914 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:10.8157165Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T06:36:10.8158255Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T06:36:10.8159138Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T06:36:10.8159929Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T06:36:10.8160799Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T06:36:10.8161788Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T06:36:10.8162840Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T06:36:10.8163991Z Compiling llvm/lib/Passes/StandardInstrumentations.cpp; 21s local ... 2025-03-14T06:36:11.0686961Z 2025-03-14T06:36:11.0687831Z  2025-03-14T06:36:11.0688381Z  2025-03-14T06:36:11.0689687Z  2025-03-14T06:36:11.0690237Z  2025-03-14T06:36:11.0690793Z  2025-03-14T06:36:11.0691332Z  2025-03-14T06:36:11.0691858Z  2025-03-14T06:36:11.0692383Z  2025-03-14T06:36:11.0693512Z [17,916 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:11.0694975Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T06:36:11.0696166Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 88s local 2025-03-14T06:36:11.0697233Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T06:36:11.0698191Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T06:36:11.0699212Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T06:36:11.0700600Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T06:36:11.0701836Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T06:36:11.0703020Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local ... 2025-03-14T06:36:11.2690340Z 2025-03-14T06:36:11.2691179Z  2025-03-14T06:36:11.2692255Z  2025-03-14T06:36:11.2693752Z  2025-03-14T06:36:11.2695162Z  2025-03-14T06:36:11.2696596Z  2025-03-14T06:36:11.2698006Z  2025-03-14T06:36:11.2699462Z  2025-03-14T06:36:11.2700934Z  2025-03-14T06:36:11.2702909Z [17,917 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:11.2705539Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T06:36:11.2706794Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T06:36:11.2707901Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T06:36:11.2708909Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T06:36:11.2709984Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T06:36:11.2711148Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 28s local 2025-03-14T06:36:11.2712406Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T06:36:11.2713731Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local ... 2025-03-14T06:36:11.4784558Z 2025-03-14T06:36:11.4785807Z  2025-03-14T06:36:11.4786634Z  2025-03-14T06:36:11.4787063Z  2025-03-14T06:36:11.4787459Z  2025-03-14T06:36:11.4787874Z  2025-03-14T06:36:11.4788276Z  2025-03-14T06:36:11.4788677Z  2025-03-14T06:36:11.4789110Z  2025-03-14T06:36:11.4790058Z [17,918 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:11.4791245Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T06:36:11.4792334Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T06:36:11.4793500Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T06:36:11.4794332Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T06:36:11.4795209Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T06:36:11.4796193Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2025-03-14T06:36:11.4797142Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 19s local 2025-03-14T06:36:11.4798197Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local ... 2025-03-14T06:36:11.7172927Z 2025-03-14T06:36:11.7173785Z  2025-03-14T06:36:11.7174286Z  2025-03-14T06:36:11.7174743Z  2025-03-14T06:36:11.7175141Z  2025-03-14T06:36:11.7175556Z  2025-03-14T06:36:11.7175974Z  2025-03-14T06:36:11.7176382Z  2025-03-14T06:36:11.7176773Z  2025-03-14T06:36:11.7177744Z [17,920 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:11.7179064Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T06:36:11.7180132Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T06:36:11.7181542Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2025-03-14T06:36:11.7182332Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T06:36:11.7183348Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T06:36:11.7184435Z Compiling llvm/lib/Passes/PassBuilderPipelines.cpp; 29s local 2025-03-14T06:36:11.7185518Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2025-03-14T06:36:11.7186663Z Compiling xla/service/memory_space_assignment/algorithm.cc; 19s local ... 2025-03-14T06:36:12.0696522Z 2025-03-14T06:36:12.0697494Z  2025-03-14T06:36:12.0698007Z  2025-03-14T06:36:12.0698430Z  2025-03-14T06:36:12.0698827Z  2025-03-14T06:36:12.0699528Z  2025-03-14T06:36:12.0699966Z  2025-03-14T06:36:12.0700381Z  2025-03-14T06:36:12.0700792Z  2025-03-14T06:36:12.0701752Z [17,923 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:12.0702889Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T06:36:12.0703820Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 89s local 2025-03-14T06:36:12.0704729Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2025-03-14T06:36:12.0705534Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T06:36:12.0706444Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T06:36:12.0707515Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2025-03-14T06:36:12.0708466Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2025-03-14T06:36:12.0709451Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2025-03-14T06:36:12.3368797Z 2025-03-14T06:36:12.3369711Z  2025-03-14T06:36:12.3370195Z  2025-03-14T06:36:12.3370590Z  2025-03-14T06:36:12.3370989Z  2025-03-14T06:36:12.3371393Z  2025-03-14T06:36:12.3371782Z  2025-03-14T06:36:12.3372161Z  2025-03-14T06:36:12.3372556Z  2025-03-14T06:36:12.3373469Z [17,924 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:12.3374582Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T06:36:12.3375870Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T06:36:12.3376688Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2025-03-14T06:36:12.3377453Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T06:36:12.3378297Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T06:36:12.3379161Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 20s local 2025-03-14T06:36:12.3380033Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2025-03-14T06:36:12.3381185Z Compiling llvm/lib/Passes/PassBuilder.cpp; 19s local ... 2025-03-14T06:36:12.6700716Z 2025-03-14T06:36:12.6701586Z  2025-03-14T06:36:12.6702076Z  2025-03-14T06:36:12.6702494Z  2025-03-14T06:36:12.6702901Z  2025-03-14T06:36:12.6703306Z  2025-03-14T06:36:12.6703716Z  2025-03-14T06:36:12.6704090Z  2025-03-14T06:36:12.6704455Z  2025-03-14T06:36:12.6705442Z [17,924 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:12.6706653Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T06:36:12.6707602Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T06:36:12.6708467Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2025-03-14T06:36:12.6709238Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T06:36:12.6710098Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2025-03-14T06:36:12.6710993Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T06:36:12.6711955Z Compiling xla/service/memory_space_assignment/algorithm.cc; 20s local 2025-03-14T06:36:12.6712952Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local ... 2025-03-14T06:36:12.9980740Z 2025-03-14T06:36:12.9981603Z  2025-03-14T06:36:12.9982094Z  2025-03-14T06:36:12.9982509Z  2025-03-14T06:36:12.9982971Z  2025-03-14T06:36:12.9983388Z  2025-03-14T06:36:12.9983785Z  2025-03-14T06:36:12.9984194Z  2025-03-14T06:36:12.9984610Z  2025-03-14T06:36:12.9985588Z [17,926 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:12.9986751Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T06:36:12.9987827Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 90s local 2025-03-14T06:36:12.9989074Z Compiling stablehlo/dialect/VhloOps.cpp; 67s local 2025-03-14T06:36:12.9989953Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T06:36:12.9990808Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2025-03-14T06:36:12.9991736Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T06:36:12.9992751Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2025-03-14T06:36:12.9993794Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local ... 2025-03-14T06:36:13.2706538Z 2025-03-14T06:36:13.2707388Z  2025-03-14T06:36:13.2707819Z  2025-03-14T06:36:13.2708172Z  2025-03-14T06:36:13.2708567Z  2025-03-14T06:36:13.2709218Z  2025-03-14T06:36:13.2709598Z  2025-03-14T06:36:13.2709977Z  2025-03-14T06:36:13.2710335Z  2025-03-14T06:36:13.2711244Z [17,927 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:13.2712451Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T06:36:13.2713403Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T06:36:13.2714279Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T06:36:13.2715130Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2025-03-14T06:36:13.2716002Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T06:36:13.2716990Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2025-03-14T06:36:13.2718195Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2025-03-14T06:36:13.2719152Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local ... 2025-03-14T06:36:13.4709875Z 2025-03-14T06:36:13.4710760Z  2025-03-14T06:36:13.4711232Z  2025-03-14T06:36:13.4711666Z  2025-03-14T06:36:13.4712071Z  2025-03-14T06:36:13.4712476Z  2025-03-14T06:36:13.4712902Z  2025-03-14T06:36:13.4713330Z  2025-03-14T06:36:13.4713733Z  2025-03-14T06:36:13.4714952Z [17,928 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:13.4716259Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T06:36:13.4717351Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T06:36:13.4718283Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T06:36:13.4719133Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T06:36:13.4720019Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 21s local 2025-03-14T06:36:13.4720972Z Compiling xla/service/memory_space_assignment/algorithm.cc; 21s local 2025-03-14T06:36:13.4721936Z Compiling llvm/lib/Passes/PassBuilder.cpp; 20s local 2025-03-14T06:36:13.4722926Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local ... 2025-03-14T06:36:13.9876797Z 2025-03-14T06:36:13.9877683Z  2025-03-14T06:36:13.9878308Z  2025-03-14T06:36:13.9878734Z  2025-03-14T06:36:13.9879188Z  2025-03-14T06:36:13.9879613Z  2025-03-14T06:36:13.9880042Z  2025-03-14T06:36:13.9880467Z  2025-03-14T06:36:13.9880865Z  2025-03-14T06:36:13.9881834Z [17,929 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:13.9883049Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T06:36:13.9884148Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 91s local 2025-03-14T06:36:13.9885265Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T06:36:13.9886194Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T06:36:13.9887162Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T06:36:13.9888196Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2025-03-14T06:36:13.9889435Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T06:36:13.9890526Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 19s local ... 2025-03-14T06:36:14.2716964Z 2025-03-14T06:36:14.2717859Z  2025-03-14T06:36:14.2718336Z  2025-03-14T06:36:14.2718766Z  2025-03-14T06:36:14.2719163Z  2025-03-14T06:36:14.2719548Z  2025-03-14T06:36:14.2719948Z  2025-03-14T06:36:14.2720369Z  2025-03-14T06:36:14.2720766Z  2025-03-14T06:36:14.2721724Z [17,930 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:14.2722911Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T06:36:14.2723914Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T06:36:14.2725305Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T06:36:14.2726128Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T06:36:14.2727014Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T06:36:14.2727967Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2025-03-14T06:36:14.2728902Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T06:36:14.2729719Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local ... 2025-03-14T06:36:14.4719970Z 2025-03-14T06:36:14.4720818Z  2025-03-14T06:36:14.4721271Z  2025-03-14T06:36:14.4721678Z  2025-03-14T06:36:14.4722082Z  2025-03-14T06:36:14.4722807Z  2025-03-14T06:36:14.4723213Z  2025-03-14T06:36:14.4723656Z  2025-03-14T06:36:14.4724048Z  2025-03-14T06:36:14.4725074Z [17,931 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:14.4726215Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T06:36:14.4727290Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T06:36:14.4728257Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T06:36:14.4729152Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2025-03-14T06:36:14.4730274Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 22s local 2025-03-14T06:36:14.4731281Z Compiling xla/service/memory_space_assignment/algorithm.cc; 22s local 2025-03-14T06:36:14.4732246Z Compiling llvm/lib/Passes/PassBuilder.cpp; 21s local 2025-03-14T06:36:14.4733267Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local ... 2025-03-14T06:36:14.8618695Z 2025-03-14T06:36:14.8619555Z  2025-03-14T06:36:14.8620049Z  2025-03-14T06:36:14.8620488Z  2025-03-14T06:36:14.8620907Z  2025-03-14T06:36:14.8621286Z  2025-03-14T06:36:14.8621731Z  2025-03-14T06:36:14.8622109Z  2025-03-14T06:36:14.8622492Z  2025-03-14T06:36:14.8623400Z [17,933 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:14.8624499Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T06:36:14.8625508Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T06:36:14.8626353Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T06:36:14.8627238Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2025-03-14T06:36:14.8628101Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T06:36:14.8629011Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T06:36:14.8629963Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T06:36:14.8630905Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local ... 2025-03-14T06:36:15.0726052Z 2025-03-14T06:36:15.0726930Z  2025-03-14T06:36:15.0727501Z  2025-03-14T06:36:15.0727868Z  2025-03-14T06:36:15.0728250Z  2025-03-14T06:36:15.0728668Z  2025-03-14T06:36:15.0729054Z  2025-03-14T06:36:15.0729450Z  2025-03-14T06:36:15.0730109Z  2025-03-14T06:36:15.0731100Z [17,934 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:15.0732239Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T06:36:15.0733370Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 92s local 2025-03-14T06:36:15.0734274Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T06:36:15.0735109Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2025-03-14T06:36:15.0735972Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T06:36:15.0736973Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T06:36:15.0738167Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T06:36:15.0739172Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 20s local ... 2025-03-14T06:36:15.4360137Z 2025-03-14T06:36:15.4361128Z  2025-03-14T06:36:15.4361642Z  2025-03-14T06:36:15.4362073Z  2025-03-14T06:36:15.4362469Z  2025-03-14T06:36:15.4362863Z  2025-03-14T06:36:15.4363264Z  2025-03-14T06:36:15.4363653Z  2025-03-14T06:36:15.4364064Z  2025-03-14T06:36:15.4365101Z [17,935 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:15.4366438Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T06:36:15.4367467Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T06:36:15.4368663Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T06:36:15.4369506Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T06:36:15.4370432Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 23s local 2025-03-14T06:36:15.4371429Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T06:36:15.4372383Z Compiling llvm/lib/Passes/PassBuilder.cpp; 22s local 2025-03-14T06:36:15.4373355Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local ... 2025-03-14T06:36:15.6731595Z 2025-03-14T06:36:15.6732728Z  2025-03-14T06:36:15.6733293Z  2025-03-14T06:36:15.6733743Z  2025-03-14T06:36:15.6734205Z  2025-03-14T06:36:15.6734580Z  2025-03-14T06:36:15.6734980Z  2025-03-14T06:36:15.6735391Z  2025-03-14T06:36:15.6735797Z  2025-03-14T06:36:15.6736786Z [17,935 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:15.6738014Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T06:36:15.6739132Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T06:36:15.6740009Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T06:36:15.6740893Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T06:36:15.6741822Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T06:36:15.6742843Z Compiling xla/service/memory_space_assignment/algorithm.cc; 23s local 2025-03-14T06:36:15.6743826Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T06:36:15.6744865Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local ... 2025-03-14T06:36:15.9738634Z 2025-03-14T06:36:15.9739488Z  2025-03-14T06:36:15.9740105Z  2025-03-14T06:36:15.9740536Z  2025-03-14T06:36:15.9740928Z  2025-03-14T06:36:15.9741326Z  2025-03-14T06:36:15.9741782Z  2025-03-14T06:36:15.9742213Z  2025-03-14T06:36:15.9742603Z  2025-03-14T06:36:15.9743539Z [17,937 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:15.9744668Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T06:36:15.9745550Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 93s local 2025-03-14T06:36:15.9746618Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T06:36:15.9747576Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T06:36:15.9748463Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T06:36:15.9749434Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T06:36:15.9750369Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T06:36:15.9751325Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local ... 2025-03-14T06:36:16.2736754Z 2025-03-14T06:36:16.2737630Z  2025-03-14T06:36:16.2738115Z  2025-03-14T06:36:16.2738530Z  2025-03-14T06:36:16.2738917Z  2025-03-14T06:36:16.2739308Z  2025-03-14T06:36:16.2739996Z  2025-03-14T06:36:16.2740361Z  2025-03-14T06:36:16.2740758Z  2025-03-14T06:36:16.2741699Z [17,937 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:16.2742901Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T06:36:16.2743973Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T06:36:16.2745074Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T06:36:16.2745967Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T06:36:16.2746852Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T06:36:16.2747814Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T06:36:16.2749027Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T06:36:16.2750022Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local ... 2025-03-14T06:36:16.4739375Z 2025-03-14T06:36:16.4740206Z  2025-03-14T06:36:16.4740626Z  2025-03-14T06:36:16.4740976Z  2025-03-14T06:36:16.4741313Z  2025-03-14T06:36:16.4741670Z  2025-03-14T06:36:16.4742011Z  2025-03-14T06:36:16.4742349Z  2025-03-14T06:36:16.4742697Z  2025-03-14T06:36:16.4743569Z [17,941 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:16.4744857Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T06:36:16.4745647Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T06:36:16.4746379Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T06:36:16.4747203Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T06:36:16.4748022Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 24s local 2025-03-14T06:36:16.4748838Z Compiling xla/service/memory_space_assignment/algorithm.cc; 24s local 2025-03-14T06:36:16.4749650Z Compiling llvm/lib/Passes/PassBuilder.cpp; 23s local 2025-03-14T06:36:16.4750484Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local ... 2025-03-14T06:36:16.7694047Z 2025-03-14T06:36:16.7695043Z  2025-03-14T06:36:16.7695552Z  2025-03-14T06:36:16.7695999Z  2025-03-14T06:36:16.7696464Z  2025-03-14T06:36:16.7696891Z  2025-03-14T06:36:16.7697324Z  2025-03-14T06:36:16.7697758Z  2025-03-14T06:36:16.7698187Z  2025-03-14T06:36:16.7699194Z [17,942 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:16.7700404Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T06:36:16.7701493Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T06:36:16.7702504Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T06:36:16.7703447Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T06:36:16.7704421Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T06:36:16.7705471Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T06:36:16.7706516Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T06:36:16.7707891Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local ... 2025-03-14T06:36:17.0016531Z 2025-03-14T06:36:17.0017418Z  2025-03-14T06:36:17.0018068Z  2025-03-14T06:36:17.0018511Z  2025-03-14T06:36:17.0018931Z  2025-03-14T06:36:17.0019373Z  2025-03-14T06:36:17.0019906Z  2025-03-14T06:36:17.0020322Z  2025-03-14T06:36:17.0020697Z  2025-03-14T06:36:17.0021641Z [17,945 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:17.0022803Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T06:36:17.0023791Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 94s local 2025-03-14T06:36:17.0025133Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T06:36:17.0026001Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T06:36:17.0026894Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T06:36:17.0027950Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T06:36:17.0028889Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T06:36:17.0029944Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local ... 2025-03-14T06:36:17.2629368Z 2025-03-14T06:36:17.2630318Z  2025-03-14T06:36:17.2630788Z  2025-03-14T06:36:17.2631204Z  2025-03-14T06:36:17.2631612Z  2025-03-14T06:36:17.2632062Z  2025-03-14T06:36:17.2632814Z  2025-03-14T06:36:17.2633333Z  2025-03-14T06:36:17.2633853Z  2025-03-14T06:36:17.2634766Z [17,947 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:17.2635883Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T06:36:17.2636885Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T06:36:17.2637821Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T06:36:17.2638673Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T06:36:17.2639721Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T06:36:17.2640711Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T06:36:17.2641667Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T06:36:17.2642853Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local ... 2025-03-14T06:36:17.4746925Z 2025-03-14T06:36:17.4747778Z  2025-03-14T06:36:17.4748247Z  2025-03-14T06:36:17.4748658Z  2025-03-14T06:36:17.4749085Z  2025-03-14T06:36:17.4749486Z  2025-03-14T06:36:17.4749893Z  2025-03-14T06:36:17.4750315Z  2025-03-14T06:36:17.4750726Z  2025-03-14T06:36:17.4751705Z [17,947 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:17.4752896Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T06:36:17.4753964Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T06:36:17.4754919Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T06:36:17.4755825Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T06:36:17.4756742Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 25s local 2025-03-14T06:36:17.4757752Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T06:36:17.4758742Z Compiling llvm/lib/Passes/PassBuilder.cpp; 24s local 2025-03-14T06:36:17.4759754Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local ... 2025-03-14T06:36:17.7048584Z 2025-03-14T06:36:17.7049451Z  2025-03-14T06:36:17.7049838Z  2025-03-14T06:36:17.7050179Z  2025-03-14T06:36:17.7050515Z  2025-03-14T06:36:17.7050846Z  2025-03-14T06:36:17.7051168Z  2025-03-14T06:36:17.7051495Z  2025-03-14T06:36:17.7051825Z  2025-03-14T06:36:17.7052838Z [17,948 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:17.7053817Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T06:36:17.7054737Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T06:36:17.7055511Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T06:36:17.7056220Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T06:36:17.7057097Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T06:36:17.7057891Z Compiling xla/service/memory_space_assignment/algorithm.cc; 25s local 2025-03-14T06:36:17.7058725Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T06:36:17.7059719Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local ... 2025-03-14T06:36:18.0752527Z 2025-03-14T06:36:18.0753380Z  2025-03-14T06:36:18.0753826Z  2025-03-14T06:36:18.0754278Z  2025-03-14T06:36:18.0754667Z  2025-03-14T06:36:18.0755060Z  2025-03-14T06:36:18.0755436Z  2025-03-14T06:36:18.0755845Z  2025-03-14T06:36:18.0756267Z  2025-03-14T06:36:18.0757226Z [17,948 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:18.0758354Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T06:36:18.0759358Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 95s local 2025-03-14T06:36:18.0760598Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T06:36:18.0761458Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T06:36:18.0762262Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T06:36:18.0763200Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T06:36:18.0764128Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T06:36:18.0765605Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local ... 2025-03-14T06:36:18.4318865Z 2025-03-14T06:36:18.4319715Z  2025-03-14T06:36:18.4320443Z  2025-03-14T06:36:18.4320868Z  2025-03-14T06:36:18.4321257Z  2025-03-14T06:36:18.4321646Z  2025-03-14T06:36:18.4322021Z  2025-03-14T06:36:18.4322395Z  2025-03-14T06:36:18.4322758Z  2025-03-14T06:36:18.4323684Z [17,950 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:18.4324980Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T06:36:18.4325975Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T06:36:18.4326937Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T06:36:18.4327740Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T06:36:18.4328572Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 26s local 2025-03-14T06:36:18.4329513Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T06:36:18.4330473Z Compiling llvm/lib/Passes/PassBuilder.cpp; 25s local 2025-03-14T06:36:18.4331463Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local ... 2025-03-14T06:36:18.6757855Z 2025-03-14T06:36:18.6758710Z  2025-03-14T06:36:18.6759205Z  2025-03-14T06:36:18.6759590Z  2025-03-14T06:36:18.6759978Z  2025-03-14T06:36:18.6760349Z  2025-03-14T06:36:18.6760763Z  2025-03-14T06:36:18.6761212Z  2025-03-14T06:36:18.6761629Z  2025-03-14T06:36:18.6762594Z [17,952 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:18.6763666Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T06:36:18.6764803Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T06:36:18.6765880Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T06:36:18.6766918Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T06:36:18.6767790Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2025-03-14T06:36:18.6768705Z Compiling xla/service/memory_space_assignment/algorithm.cc; 26s local 2025-03-14T06:36:18.6769610Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T06:36:18.6770559Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local ... 2025-03-14T06:36:18.8761170Z 2025-03-14T06:36:18.8762055Z  2025-03-14T06:36:18.8762532Z  2025-03-14T06:36:18.8762948Z  2025-03-14T06:36:18.8763371Z  2025-03-14T06:36:18.8763779Z  2025-03-14T06:36:18.8764207Z  2025-03-14T06:36:18.8765102Z  2025-03-14T06:36:18.8765704Z  2025-03-14T06:36:18.8766688Z [17,953 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:18.8767859Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T06:36:18.8768929Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 96s local 2025-03-14T06:36:18.8769916Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T06:36:18.8770761Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T06:36:18.8771591Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2025-03-14T06:36:18.8772467Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2025-03-14T06:36:18.8773477Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T06:36:18.8774707Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local ... 2025-03-14T06:36:19.2765768Z 2025-03-14T06:36:19.2767162Z  2025-03-14T06:36:19.2767656Z  2025-03-14T06:36:19.2768063Z  2025-03-14T06:36:19.2768469Z  2025-03-14T06:36:19.2768875Z  2025-03-14T06:36:19.2769290Z  2025-03-14T06:36:19.2769694Z  2025-03-14T06:36:19.2770104Z  2025-03-14T06:36:19.2771157Z [17,955 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:19.2772572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T06:36:19.2773593Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2025-03-14T06:36:19.2774515Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T06:36:19.2775416Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T06:36:19.2776266Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 27s local 2025-03-14T06:36:19.2777220Z Compiling xla/service/memory_space_assignment/algorithm.cc; 27s local 2025-03-14T06:36:19.2778216Z Compiling llvm/lib/Passes/PassBuilder.cpp; 26s local 2025-03-14T06:36:19.2779260Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local ... 2025-03-14T06:36:19.9873685Z 2025-03-14T06:36:19.9874575Z  2025-03-14T06:36:19.9875072Z  2025-03-14T06:36:19.9875565Z  2025-03-14T06:36:19.9876002Z  2025-03-14T06:36:19.9876424Z  2025-03-14T06:36:19.9876812Z  2025-03-14T06:36:19.9877202Z  2025-03-14T06:36:19.9877596Z  2025-03-14T06:36:19.9878566Z [17,956 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:19.9879721Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2025-03-14T06:36:19.9880785Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 97s local 2025-03-14T06:36:19.9881752Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T06:36:19.9882571Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T06:36:19.9883441Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T06:36:19.9884382Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T06:36:19.9885420Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2025-03-14T06:36:19.9886845Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local ... 2025-03-14T06:36:20.2774009Z 2025-03-14T06:36:20.2774993Z  2025-03-14T06:36:20.2775488Z  2025-03-14T06:36:20.2775942Z  2025-03-14T06:36:20.2776357Z  2025-03-14T06:36:20.2776744Z  2025-03-14T06:36:20.2777144Z  2025-03-14T06:36:20.2777562Z  2025-03-14T06:36:20.2777985Z  2025-03-14T06:36:20.2778986Z [17,956 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:20.2780239Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2025-03-14T06:36:20.2781324Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T06:36:20.2782260Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T06:36:20.2783449Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T06:36:20.2784329Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 28s local 2025-03-14T06:36:20.2785359Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T06:36:20.2786370Z Compiling llvm/lib/Passes/PassBuilder.cpp; 27s local 2025-03-14T06:36:20.2787442Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local ... 2025-03-14T06:36:20.6424158Z 2025-03-14T06:36:20.6425015Z  2025-03-14T06:36:20.6425518Z  2025-03-14T06:36:20.6425956Z  2025-03-14T06:36:20.6426397Z  2025-03-14T06:36:20.6426771Z  2025-03-14T06:36:20.6427171Z  2025-03-14T06:36:20.6427851Z  2025-03-14T06:36:20.6428242Z  2025-03-14T06:36:20.6429179Z [17,957 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:20.6430295Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2025-03-14T06:36:20.6431371Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T06:36:20.6432314Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T06:36:20.6433234Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T06:36:20.6434149Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T06:36:20.6435361Z Compiling xla/service/memory_space_assignment/algorithm.cc; 28s local 2025-03-14T06:36:20.6436297Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T06:36:20.6437230Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local ... 2025-03-14T06:36:20.8780209Z 2025-03-14T06:36:20.8781099Z  2025-03-14T06:36:20.8781605Z  2025-03-14T06:36:20.8781981Z  2025-03-14T06:36:20.8782358Z  2025-03-14T06:36:20.8782726Z  2025-03-14T06:36:20.8783091Z  2025-03-14T06:36:20.8783462Z  2025-03-14T06:36:20.8783852Z  2025-03-14T06:36:20.8784735Z [17,957 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:20.8785757Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2025-03-14T06:36:20.8786683Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 98s local 2025-03-14T06:36:20.8787522Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T06:36:20.8788330Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T06:36:20.8789136Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T06:36:20.8789981Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T06:36:20.8790812Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T06:36:20.8791652Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local ... 2025-03-14T06:36:21.1735302Z 2025-03-14T06:36:21.1736163Z  2025-03-14T06:36:21.1736649Z  2025-03-14T06:36:21.1737021Z  2025-03-14T06:36:21.1737408Z  2025-03-14T06:36:21.1737793Z  2025-03-14T06:36:21.1738171Z  2025-03-14T06:36:21.1738602Z  2025-03-14T06:36:21.1739027Z  2025-03-14T06:36:21.1740270Z [17,961 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:21.1741408Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2025-03-14T06:36:21.1742421Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T06:36:21.1743303Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T06:36:21.1744206Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T06:36:21.1745044Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T06:36:21.1745900Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T06:36:21.1746885Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T06:36:21.1748024Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local ... 2025-03-14T06:36:21.4573977Z 2025-03-14T06:36:21.4574845Z  2025-03-14T06:36:21.4575352Z  2025-03-14T06:36:21.4575775Z  2025-03-14T06:36:21.4576225Z  2025-03-14T06:36:21.4576629Z  2025-03-14T06:36:21.4577044Z  2025-03-14T06:36:21.4577455Z  2025-03-14T06:36:21.4577842Z  2025-03-14T06:36:21.4578781Z [17,962 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:21.4579960Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:36:21.4581037Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T06:36:21.4581989Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T06:36:21.4583241Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T06:36:21.4584165Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 29s local 2025-03-14T06:36:21.4585131Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T06:36:21.4586136Z Compiling llvm/lib/Passes/PassBuilder.cpp; 28s local 2025-03-14T06:36:21.4587177Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local ... 2025-03-14T06:36:21.6786643Z 2025-03-14T06:36:21.6787528Z  2025-03-14T06:36:21.6788048Z  2025-03-14T06:36:21.6788794Z  2025-03-14T06:36:21.6789227Z  2025-03-14T06:36:21.6789655Z  2025-03-14T06:36:21.6790054Z  2025-03-14T06:36:21.6790434Z  2025-03-14T06:36:21.6790840Z  2025-03-14T06:36:21.6802161Z [17,962 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:21.6803664Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:36:21.6804869Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T06:36:21.6805817Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T06:36:21.6806764Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T06:36:21.6807637Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T06:36:21.6808635Z Compiling xla/service/memory_space_assignment/algorithm.cc; 29s local 2025-03-14T06:36:21.6809626Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:36:21.6810701Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local ... 2025-03-14T06:36:21.9169873Z 2025-03-14T06:36:21.9170715Z  2025-03-14T06:36:21.9171220Z  2025-03-14T06:36:21.9171638Z  2025-03-14T06:36:21.9172035Z  2025-03-14T06:36:21.9172448Z  2025-03-14T06:36:21.9172859Z  2025-03-14T06:36:21.9173247Z  2025-03-14T06:36:21.9173698Z  2025-03-14T06:36:21.9174651Z [17,963 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:21.9175785Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:36:21.9176802Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T06:36:21.9177738Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T06:36:21.9178926Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T06:36:21.9179850Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T06:36:21.9180845Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T06:36:21.9181818Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:36:21.9182768Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local ... 2025-03-14T06:36:22.1184379Z 2025-03-14T06:36:22.1185245Z  2025-03-14T06:36:22.1185750Z  2025-03-14T06:36:22.1186180Z  2025-03-14T06:36:22.1186604Z  2025-03-14T06:36:22.1187017Z  2025-03-14T06:36:22.1187420Z  2025-03-14T06:36:22.1187826Z  2025-03-14T06:36:22.1188510Z  2025-03-14T06:36:22.1189480Z [17,965 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:22.1190685Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:36:22.1191809Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 99s local 2025-03-14T06:36:22.1192804Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T06:36:22.1193766Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T06:36:22.1194741Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T06:36:22.1195800Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T06:36:22.1196869Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:36:22.1198092Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local ... 2025-03-14T06:36:22.3715520Z 2025-03-14T06:36:22.3716463Z  2025-03-14T06:36:22.3716904Z  2025-03-14T06:36:22.3717329Z  2025-03-14T06:36:22.3717726Z  2025-03-14T06:36:22.3718151Z  2025-03-14T06:36:22.3718547Z  2025-03-14T06:36:22.3718933Z  2025-03-14T06:36:22.3719303Z  2025-03-14T06:36:22.3720220Z [17,967 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:22.3721579Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:36:22.3722527Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T06:36:22.3723395Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T06:36:22.3724344Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T06:36:22.3725354Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 30s local 2025-03-14T06:36:22.3726255Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T06:36:22.3727127Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:36:22.3728115Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local ... 2025-03-14T06:36:22.5789751Z 2025-03-14T06:36:22.5790633Z  2025-03-14T06:36:22.5791099Z  2025-03-14T06:36:22.5791500Z  2025-03-14T06:36:22.5791890Z  2025-03-14T06:36:22.5792316Z  2025-03-14T06:36:22.5792741Z  2025-03-14T06:36:22.5793145Z  2025-03-14T06:36:22.5793539Z  2025-03-14T06:36:22.5794513Z [17,968 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:22.5795632Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T06:36:22.5796674Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T06:36:22.5797738Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T06:36:22.5798663Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T06:36:22.5799574Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T06:36:22.5800549Z Compiling xla/service/memory_space_assignment/algorithm.cc; 30s local 2025-03-14T06:36:22.5801459Z Compiling llvm/lib/Passes/PassBuilder.cpp; 29s local 2025-03-14T06:36:22.5802664Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local ... 2025-03-14T06:36:22.8794612Z 2025-03-14T06:36:22.8795784Z  2025-03-14T06:36:22.8796289Z  2025-03-14T06:36:22.8796706Z  2025-03-14T06:36:22.8797133Z  2025-03-14T06:36:22.8797530Z  2025-03-14T06:36:22.8797926Z  2025-03-14T06:36:22.8798327Z  2025-03-14T06:36:22.8798744Z  2025-03-14T06:36:22.8799687Z [17,971 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:22.8800798Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T06:36:22.8801892Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 100s local 2025-03-14T06:36:22.8802858Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T06:36:22.8804010Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T06:36:22.8805104Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T06:36:22.8806102Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2025-03-14T06:36:22.8807150Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T06:36:22.8808172Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local ... 2025-03-14T06:36:23.1853218Z 2025-03-14T06:36:23.1854472Z  2025-03-14T06:36:23.1854997Z  2025-03-14T06:36:23.1855428Z  2025-03-14T06:36:23.1855844Z  2025-03-14T06:36:23.1856283Z  2025-03-14T06:36:23.1856716Z  2025-03-14T06:36:23.1857140Z  2025-03-14T06:36:23.1857817Z  2025-03-14T06:36:23.1858830Z [17,972 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:23.1860053Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T06:36:23.1861187Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T06:36:23.1862141Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T06:36:23.1863052Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T06:36:23.1864021Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T06:36:23.1865260Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2025-03-14T06:36:23.1866552Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T06:36:23.1867648Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local ... 2025-03-14T06:36:23.4799788Z 2025-03-14T06:36:23.4801010Z  2025-03-14T06:36:23.4801500Z  2025-03-14T06:36:23.4801942Z  2025-03-14T06:36:23.4802319Z  2025-03-14T06:36:23.4802680Z  2025-03-14T06:36:23.4803045Z  2025-03-14T06:36:23.4803424Z  2025-03-14T06:36:23.4803821Z  2025-03-14T06:36:23.4805017Z [17,972 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:23.4806071Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T06:36:23.4807044Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T06:36:23.4807936Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T06:36:23.4808780Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T06:36:23.4809658Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 31s local 2025-03-14T06:36:23.4810601Z Compiling xla/service/memory_space_assignment/algorithm.cc; 31s local 2025-03-14T06:36:23.4811474Z Compiling llvm/lib/Passes/PassBuilder.cpp; 30s local 2025-03-14T06:36:23.4812487Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local ... 2025-03-14T06:36:23.7732643Z 2025-03-14T06:36:23.7733908Z  2025-03-14T06:36:23.7734433Z  2025-03-14T06:36:23.7734875Z  2025-03-14T06:36:23.7735284Z  2025-03-14T06:36:23.7735653Z  2025-03-14T06:36:23.7736053Z  2025-03-14T06:36:23.7736471Z  2025-03-14T06:36:23.7736875Z  2025-03-14T06:36:23.7738196Z [17,973 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:23.7739346Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T06:36:23.7740367Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T06:36:23.7741300Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T06:36:23.7742190Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T06:36:23.7743058Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T06:36:23.7744019Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T06:36:23.7745026Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T06:36:23.7745989Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local ... 2025-03-14T06:36:23.9847931Z 2025-03-14T06:36:23.9849156Z  2025-03-14T06:36:23.9849683Z  2025-03-14T06:36:23.9850099Z  2025-03-14T06:36:23.9850502Z  2025-03-14T06:36:23.9850937Z  2025-03-14T06:36:23.9851373Z  2025-03-14T06:36:23.9851774Z  2025-03-14T06:36:23.9852175Z  2025-03-14T06:36:23.9853185Z [17,976 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:23.9854367Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T06:36:23.9855408Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 101s local 2025-03-14T06:36:23.9856308Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T06:36:23.9857396Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T06:36:23.9858250Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T06:36:23.9859214Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T06:36:23.9860179Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T06:36:23.9861173Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local ... 2025-03-14T06:36:24.2811347Z 2025-03-14T06:36:24.2812202Z  2025-03-14T06:36:24.2812652Z  2025-03-14T06:36:24.2813063Z  2025-03-14T06:36:24.2813631Z  2025-03-14T06:36:24.2814049Z  2025-03-14T06:36:24.2814452Z  2025-03-14T06:36:24.2814829Z  2025-03-14T06:36:24.2815209Z  2025-03-14T06:36:24.2816128Z [17,977 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:24.2817229Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T06:36:24.2818202Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2025-03-14T06:36:24.2819116Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T06:36:24.2820287Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T06:36:24.2821767Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T06:36:24.2822979Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T06:36:24.2824272Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T06:36:24.2833406Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local ... 2025-03-14T06:36:24.4810555Z 2025-03-14T06:36:24.4811680Z  2025-03-14T06:36:24.4812393Z  2025-03-14T06:36:24.4813058Z  2025-03-14T06:36:24.4813699Z  2025-03-14T06:36:24.4817256Z  2025-03-14T06:36:24.4818134Z  2025-03-14T06:36:24.4818668Z  2025-03-14T06:36:24.4819158Z  2025-03-14T06:36:24.4820385Z [17,979 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:24.4821732Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T06:36:24.4822959Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2025-03-14T06:36:24.4824132Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T06:36:24.4825422Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T06:36:24.4826481Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 32s local 2025-03-14T06:36:24.4827758Z Compiling xla/service/memory_space_assignment/algorithm.cc; 32s local 2025-03-14T06:36:24.4828898Z Compiling llvm/lib/Passes/PassBuilder.cpp; 31s local 2025-03-14T06:36:24.4830168Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local ... 2025-03-14T06:36:24.9677454Z 2025-03-14T06:36:24.9678352Z  2025-03-14T06:36:24.9678854Z  2025-03-14T06:36:24.9679303Z  2025-03-14T06:36:24.9679728Z  2025-03-14T06:36:24.9680155Z  2025-03-14T06:36:24.9680585Z  2025-03-14T06:36:24.9680997Z  2025-03-14T06:36:24.9681361Z  2025-03-14T06:36:24.9682522Z [17,980 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:24.9683620Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T06:36:24.9684805Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 102s local 2025-03-14T06:36:24.9685718Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T06:36:24.9686608Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T06:36:24.9687572Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T06:36:24.9688555Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T06:36:24.9689517Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T06:36:24.9690712Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local ... 2025-03-14T06:36:25.1950904Z 2025-03-14T06:36:25.1951766Z  2025-03-14T06:36:25.1952253Z  2025-03-14T06:36:25.1952647Z  2025-03-14T06:36:25.1953085Z  2025-03-14T06:36:25.1953470Z  2025-03-14T06:36:25.1953840Z  2025-03-14T06:36:25.1954211Z  2025-03-14T06:36:25.1954569Z  2025-03-14T06:36:25.1955539Z [17,982 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:25.1956632Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T06:36:25.1957917Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T06:36:25.1958841Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T06:36:25.1959713Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T06:36:25.1960583Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T06:36:25.1961450Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T06:36:25.1962381Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T06:36:25.1963396Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local ... 2025-03-14T06:36:25.4325880Z 2025-03-14T06:36:25.4326724Z  2025-03-14T06:36:25.4327228Z  2025-03-14T06:36:25.4327638Z  2025-03-14T06:36:25.4328055Z  2025-03-14T06:36:25.4328472Z  2025-03-14T06:36:25.4328964Z  2025-03-14T06:36:25.4329341Z  2025-03-14T06:36:25.4329724Z  2025-03-14T06:36:25.4330687Z [17,983 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:25.4331845Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T06:36:25.4332908Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T06:36:25.4333880Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T06:36:25.4334806Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T06:36:25.4335768Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 33s local 2025-03-14T06:36:25.4336794Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T06:36:25.4337939Z Compiling llvm/lib/Passes/PassBuilder.cpp; 32s local 2025-03-14T06:36:25.4339040Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local ... 2025-03-14T06:36:25.6822784Z 2025-03-14T06:36:25.6823623Z  2025-03-14T06:36:25.6824144Z  2025-03-14T06:36:25.6824568Z  2025-03-14T06:36:25.6824992Z  2025-03-14T06:36:25.6825399Z  2025-03-14T06:36:25.6825763Z  2025-03-14T06:36:25.6826139Z  2025-03-14T06:36:25.6826541Z  2025-03-14T06:36:25.6827492Z [17,985 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:25.6828635Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T06:36:25.6829662Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T06:36:25.6830591Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T06:36:25.6831651Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T06:36:25.6832522Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T06:36:25.6833478Z Compiling xla/service/memory_space_assignment/algorithm.cc; 33s local 2025-03-14T06:36:25.6834436Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T06:36:25.6835549Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local ... 2025-03-14T06:36:25.8934176Z 2025-03-14T06:36:25.8935031Z  2025-03-14T06:36:25.8935519Z  2025-03-14T06:36:25.8935919Z  2025-03-14T06:36:25.8936310Z  2025-03-14T06:36:25.8936707Z  2025-03-14T06:36:25.8937095Z  2025-03-14T06:36:25.8937481Z  2025-03-14T06:36:25.8937888Z  2025-03-14T06:36:25.8939103Z [17,988 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:25.8940111Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T06:36:25.8941118Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 103s local 2025-03-14T06:36:25.8942029Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T06:36:25.8942930Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T06:36:25.8943802Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T06:36:25.8945107Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T06:36:25.8946124Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T06:36:25.8947152Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local ... 2025-03-14T06:36:26.2435441Z 2025-03-14T06:36:26.2436314Z  2025-03-14T06:36:26.2436839Z  2025-03-14T06:36:26.2437249Z  2025-03-14T06:36:26.2437702Z  2025-03-14T06:36:26.2438137Z  2025-03-14T06:36:26.2438531Z  2025-03-14T06:36:26.2438935Z  2025-03-14T06:36:26.2439338Z  2025-03-14T06:36:26.2440318Z [17,989 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:26.2441439Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T06:36:26.2442428Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T06:36:26.2443355Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T06:36:26.2444235Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T06:36:26.2445329Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T06:36:26.2446314Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T06:36:26.2447326Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T06:36:26.2448371Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local ... 2025-03-14T06:36:26.4829119Z 2025-03-14T06:36:26.4829952Z  2025-03-14T06:36:26.4830443Z  2025-03-14T06:36:26.4830844Z  2025-03-14T06:36:26.4831320Z  2025-03-14T06:36:26.4831743Z  2025-03-14T06:36:26.4832159Z  2025-03-14T06:36:26.4832554Z  2025-03-14T06:36:26.4832951Z  2025-03-14T06:36:26.4834237Z [17,990 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:26.4835381Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2025-03-14T06:36:26.4836310Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T06:36:26.4837146Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T06:36:26.4837948Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T06:36:26.4838795Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 34s local 2025-03-14T06:36:26.4839705Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T06:36:26.4840605Z Compiling llvm/lib/Passes/PassBuilder.cpp; 33s local 2025-03-14T06:36:26.4841569Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local ... 2025-03-14T06:36:26.7352393Z 2025-03-14T06:36:26.7353400Z  2025-03-14T06:36:26.7353904Z  2025-03-14T06:36:26.7354353Z  2025-03-14T06:36:26.7354793Z  2025-03-14T06:36:26.7355235Z  2025-03-14T06:36:26.7355700Z  2025-03-14T06:36:26.7356127Z  2025-03-14T06:36:26.7356563Z  2025-03-14T06:36:26.7357591Z [17,993 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:26.7358708Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2025-03-14T06:36:26.7359746Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T06:36:26.7360660Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T06:36:26.7361900Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T06:36:26.7362758Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T06:36:26.7363705Z Compiling xla/service/memory_space_assignment/algorithm.cc; 34s local 2025-03-14T06:36:26.7364818Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T06:36:26.7366015Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local ... 2025-03-14T06:36:27.0834756Z 2025-03-14T06:36:27.0835584Z  2025-03-14T06:36:27.0836074Z  2025-03-14T06:36:27.0836491Z  2025-03-14T06:36:27.0836896Z  2025-03-14T06:36:27.0837558Z  2025-03-14T06:36:27.0837999Z  2025-03-14T06:36:27.0838392Z  2025-03-14T06:36:27.0838790Z  2025-03-14T06:36:27.0839771Z [17,994 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:27.0840932Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2025-03-14T06:36:27.0842036Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 104s local 2025-03-14T06:36:27.0843006Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T06:36:27.0843980Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T06:36:27.0845101Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T06:36:27.0846136Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T06:36:27.0847191Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T06:36:27.0848203Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 32s local ... 2025-03-14T06:36:27.3808203Z 2025-03-14T06:36:27.3809028Z  2025-03-14T06:36:27.3809572Z  2025-03-14T06:36:27.3809976Z  2025-03-14T06:36:27.3810366Z  2025-03-14T06:36:27.3810744Z  2025-03-14T06:36:27.3811104Z  2025-03-14T06:36:27.3811457Z  2025-03-14T06:36:27.3811815Z  2025-03-14T06:36:27.3812925Z [17,997 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:27.3814063Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2025-03-14T06:36:27.3815154Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T06:36:27.3816148Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T06:36:27.3817046Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T06:36:27.3818231Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 35s local 2025-03-14T06:36:27.3819277Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T06:36:27.3820263Z Compiling llvm/lib/Passes/PassBuilder.cpp; 34s local 2025-03-14T06:36:27.3821255Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local ... 2025-03-14T06:36:27.6774422Z 2025-03-14T06:36:27.6775280Z  2025-03-14T06:36:27.6775756Z  2025-03-14T06:36:27.6776146Z  2025-03-14T06:36:27.6776558Z  2025-03-14T06:36:27.6776941Z  2025-03-14T06:36:27.6777326Z  2025-03-14T06:36:27.6777724Z  2025-03-14T06:36:27.6778098Z  2025-03-14T06:36:27.6778980Z [18,000 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:27.6780295Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T06:36:27.6781320Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T06:36:27.6782179Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2025-03-14T06:36:27.6783034Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2025-03-14T06:36:27.6783850Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T06:36:27.6784795Z Compiling xla/service/memory_space_assignment/algorithm.cc; 35s local 2025-03-14T06:36:27.6785758Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T06:36:27.6786715Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local ... 2025-03-14T06:36:27.8840643Z 2025-03-14T06:36:27.8841475Z  2025-03-14T06:36:27.8841950Z  2025-03-14T06:36:27.8842359Z  2025-03-14T06:36:27.8842742Z  2025-03-14T06:36:27.8843182Z  2025-03-14T06:36:27.8843555Z  2025-03-14T06:36:27.8843942Z  2025-03-14T06:36:27.8844360Z  2025-03-14T06:36:27.8845470Z [18,001 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:27.8846525Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T06:36:27.8847827Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 105s local 2025-03-14T06:36:27.8848770Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2025-03-14T06:36:27.8849635Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2025-03-14T06:36:27.8850470Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T06:36:27.8851367Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T06:36:27.8852288Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T06:36:27.8853251Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local ... 2025-03-14T06:36:28.2643731Z 2025-03-14T06:36:28.2644750Z  2025-03-14T06:36:28.2645258Z  2025-03-14T06:36:28.2645677Z  2025-03-14T06:36:28.2646091Z  2025-03-14T06:36:28.2646475Z  2025-03-14T06:36:28.2646882Z  2025-03-14T06:36:28.2647264Z  2025-03-14T06:36:28.2647657Z  2025-03-14T06:36:28.2648620Z [18,002 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:28.2649756Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T06:36:28.2650849Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T06:36:28.2651744Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2025-03-14T06:36:28.2652601Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2025-03-14T06:36:28.2653499Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T06:36:28.2654466Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T06:36:28.2655445Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T06:36:28.2656396Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local ... 2025-03-14T06:36:28.4846589Z 2025-03-14T06:36:28.4847669Z  2025-03-14T06:36:28.4848194Z  2025-03-14T06:36:28.4848630Z  2025-03-14T06:36:28.4849050Z  2025-03-14T06:36:28.4849465Z  2025-03-14T06:36:28.4849898Z  2025-03-14T06:36:28.4850298Z  2025-03-14T06:36:28.4850717Z  2025-03-14T06:36:28.4851710Z [18,002 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:28.4852953Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2025-03-14T06:36:28.4854058Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T06:36:28.4855034Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T06:36:28.4856131Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T06:36:28.4857351Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 36s local 2025-03-14T06:36:28.4858383Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T06:36:28.4859448Z Compiling llvm/lib/Passes/PassBuilder.cpp; 35s local 2025-03-14T06:36:28.4860472Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local ... 2025-03-14T06:36:28.7347194Z 2025-03-14T06:36:28.7348053Z  2025-03-14T06:36:28.7348543Z  2025-03-14T06:36:28.7348988Z  2025-03-14T06:36:28.7349417Z  2025-03-14T06:36:28.7349834Z  2025-03-14T06:36:28.7350235Z  2025-03-14T06:36:28.7350639Z  2025-03-14T06:36:28.7351025Z  2025-03-14T06:36:28.7351995Z [18,003 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:28.7353517Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2025-03-14T06:36:28.7354599Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T06:36:28.7355571Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T06:36:28.7356479Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T06:36:28.7357449Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T06:36:28.7358667Z Compiling xla/service/memory_space_assignment/algorithm.cc; 36s local 2025-03-14T06:36:28.7359712Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T06:36:28.7360727Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local ... 2025-03-14T06:36:29.0851927Z 2025-03-14T06:36:29.0852791Z  2025-03-14T06:36:29.0853291Z  2025-03-14T06:36:29.0853699Z  2025-03-14T06:36:29.0854137Z  2025-03-14T06:36:29.0854514Z  2025-03-14T06:36:29.0854900Z  2025-03-14T06:36:29.0855276Z  2025-03-14T06:36:29.0855667Z  2025-03-14T06:36:29.0856615Z [18,005 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:29.0857901Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2025-03-14T06:36:29.0858966Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 106s local 2025-03-14T06:36:29.0859982Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T06:36:29.0860812Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T06:36:29.0861663Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T06:36:29.0862678Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2025-03-14T06:36:29.0863608Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T06:36:29.0864604Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local ... 2025-03-14T06:36:29.2855283Z 2025-03-14T06:36:29.2856104Z  2025-03-14T06:36:29.2856574Z  2025-03-14T06:36:29.2856989Z  2025-03-14T06:36:29.2857385Z  2025-03-14T06:36:29.2857807Z  2025-03-14T06:36:29.2858172Z  2025-03-14T06:36:29.2858580Z  2025-03-14T06:36:29.2858971Z  2025-03-14T06:36:29.2860258Z [18,006 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:29.2861404Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2025-03-14T06:36:29.2862398Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T06:36:29.2863264Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T06:36:29.2864029Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T06:36:29.2864931Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 37s local 2025-03-14T06:36:29.2866206Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2025-03-14T06:36:29.2867145Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T06:36:29.2868119Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local ... 2025-03-14T06:36:29.5059033Z 2025-03-14T06:36:29.5059872Z  2025-03-14T06:36:29.5060377Z  2025-03-14T06:36:29.5060804Z  2025-03-14T06:36:29.5061203Z  2025-03-14T06:36:29.5061628Z  2025-03-14T06:36:29.5062043Z  2025-03-14T06:36:29.5062470Z  2025-03-14T06:36:29.5062920Z  2025-03-14T06:36:29.5063962Z [18,007 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:29.5065143Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T06:36:29.5066512Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T06:36:29.5067477Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T06:36:29.5068415Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T06:36:29.5069606Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T06:36:29.5070664Z Compiling xla/service/memory_space_assignment/algorithm.cc; 37s local 2025-03-14T06:36:29.5071684Z Compiling llvm/lib/Passes/PassBuilder.cpp; 36s local 2025-03-14T06:36:29.5072732Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local ... 2025-03-14T06:36:29.8214969Z 2025-03-14T06:36:29.8215826Z  2025-03-14T06:36:29.8216318Z  2025-03-14T06:36:29.8216764Z  2025-03-14T06:36:29.8217157Z  2025-03-14T06:36:29.8217541Z  2025-03-14T06:36:29.8218186Z  2025-03-14T06:36:29.8218619Z  2025-03-14T06:36:29.8219037Z  2025-03-14T06:36:29.8220058Z [18,009 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:29.8221212Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T06:36:29.8222198Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T06:36:29.8223084Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T06:36:29.8223864Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T06:36:29.8224688Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T06:36:29.8225576Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T06:36:29.8226500Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T06:36:29.8227426Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local ... 2025-03-14T06:36:30.0226667Z 2025-03-14T06:36:30.0227537Z  2025-03-14T06:36:30.0228037Z  2025-03-14T06:36:30.0228421Z  2025-03-14T06:36:30.0228804Z  2025-03-14T06:36:30.0229206Z  2025-03-14T06:36:30.0229604Z  2025-03-14T06:36:30.0229996Z  2025-03-14T06:36:30.0230370Z  2025-03-14T06:36:30.0231273Z [18,010 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:30.0232390Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T06:36:30.0233359Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 107s local 2025-03-14T06:36:30.0234218Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T06:36:30.0235031Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T06:36:30.0236141Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T06:36:30.0237070Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T06:36:30.0238013Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T06:36:30.0238974Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local ... 2025-03-14T06:36:30.2237341Z 2025-03-14T06:36:30.2238237Z  2025-03-14T06:36:30.2238733Z  2025-03-14T06:36:30.2239125Z  2025-03-14T06:36:30.2239503Z  2025-03-14T06:36:30.2239933Z  2025-03-14T06:36:30.2240323Z  2025-03-14T06:36:30.2240739Z  2025-03-14T06:36:30.2241139Z  2025-03-14T06:36:30.2242057Z [18,011 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:30.2243505Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T06:36:30.2244474Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T06:36:30.2245521Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T06:36:30.2246396Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T06:36:30.2247229Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T06:36:30.2248053Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T06:36:30.2248944Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T06:36:30.2249882Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local ... 2025-03-14T06:36:30.4835994Z 2025-03-14T06:36:30.4836804Z  2025-03-14T06:36:30.4837275Z  2025-03-14T06:36:30.4837689Z  2025-03-14T06:36:30.4838074Z  2025-03-14T06:36:30.4838526Z  2025-03-14T06:36:30.4838937Z  2025-03-14T06:36:30.4839351Z  2025-03-14T06:36:30.4839756Z  2025-03-14T06:36:30.4840720Z [18,013 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:30.4841892Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T06:36:30.4843214Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T06:36:30.4844193Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T06:36:30.4845259Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T06:36:30.4846118Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 38s local 2025-03-14T06:36:30.4847030Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T06:36:30.4847971Z Compiling llvm/lib/Passes/PassBuilder.cpp; 37s local 2025-03-14T06:36:30.4848989Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local ... 2025-03-14T06:36:30.6864652Z 2025-03-14T06:36:30.6865764Z  2025-03-14T06:36:30.6866250Z  2025-03-14T06:36:30.6866652Z  2025-03-14T06:36:30.6867059Z  2025-03-14T06:36:30.6867440Z  2025-03-14T06:36:30.6867841Z  2025-03-14T06:36:30.6868256Z  2025-03-14T06:36:30.6868638Z  2025-03-14T06:36:30.6869570Z [18,013 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:30.6870613Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T06:36:30.6871573Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T06:36:30.6872405Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T06:36:30.6873265Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T06:36:30.6874124Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T06:36:30.6875199Z Compiling xla/service/memory_space_assignment/algorithm.cc; 38s local 2025-03-14T06:36:30.6876180Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T06:36:30.6877242Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local ... 2025-03-14T06:36:30.9196438Z 2025-03-14T06:36:30.9197263Z  2025-03-14T06:36:30.9198106Z  2025-03-14T06:36:30.9198538Z  2025-03-14T06:36:30.9198969Z  2025-03-14T06:36:30.9199401Z  2025-03-14T06:36:30.9199835Z  2025-03-14T06:36:30.9200261Z  2025-03-14T06:36:30.9200686Z  2025-03-14T06:36:30.9201681Z [18,015 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:30.9202917Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T06:36:30.9204049Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 108s local 2025-03-14T06:36:30.9205228Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T06:36:30.9206196Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T06:36:30.9207288Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T06:36:30.9208281Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T06:36:30.9209199Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T06:36:30.9210299Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local ... 2025-03-14T06:36:31.2457829Z 2025-03-14T06:36:31.2458727Z  2025-03-14T06:36:31.2459207Z  2025-03-14T06:36:31.2459639Z  2025-03-14T06:36:31.2460065Z  2025-03-14T06:36:31.2460474Z  2025-03-14T06:36:31.2460887Z  2025-03-14T06:36:31.2461308Z  2025-03-14T06:36:31.2461733Z  2025-03-14T06:36:31.2462656Z [18,018 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:31.2464272Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T06:36:31.2465243Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T06:36:31.2466436Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T06:36:31.2467390Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T06:36:31.2468423Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T06:36:31.2469459Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T06:36:31.2470664Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T06:36:31.2471846Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local ... 2025-03-14T06:36:31.4537219Z 2025-03-14T06:36:31.4538050Z  2025-03-14T06:36:31.4538547Z  2025-03-14T06:36:31.4538989Z  2025-03-14T06:36:31.4539425Z  2025-03-14T06:36:31.4539876Z  2025-03-14T06:36:31.4540287Z  2025-03-14T06:36:31.4540678Z  2025-03-14T06:36:31.4541048Z  2025-03-14T06:36:31.4542127Z [18,020 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:31.4543219Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T06:36:31.4544137Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T06:36:31.4544962Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T06:36:31.4545808Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 39s local 2025-03-14T06:36:31.4546717Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T06:36:31.4547663Z Compiling llvm/lib/Passes/PassBuilder.cpp; 38s local 2025-03-14T06:36:31.4548594Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T06:36:31.4549619Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local ... 2025-03-14T06:36:31.6871901Z 2025-03-14T06:36:31.6872739Z  2025-03-14T06:36:31.6873252Z  2025-03-14T06:36:31.6873664Z  2025-03-14T06:36:31.6874081Z  2025-03-14T06:36:31.6874495Z  2025-03-14T06:36:31.6874926Z  2025-03-14T06:36:31.6875317Z  2025-03-14T06:36:31.6875734Z  2025-03-14T06:36:31.6876700Z [18,021 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:31.6878168Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T06:36:31.6879165Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T06:36:31.6880096Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T06:36:31.6881049Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T06:36:31.6882003Z Compiling xla/service/memory_space_assignment/algorithm.cc; 39s local 2025-03-14T06:36:31.6882981Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T06:36:31.6884038Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T06:36:31.6885339Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local ... 2025-03-14T06:36:31.9298262Z 2025-03-14T06:36:31.9299108Z  2025-03-14T06:36:31.9299564Z  2025-03-14T06:36:31.9300006Z  2025-03-14T06:36:31.9300404Z  2025-03-14T06:36:31.9300805Z  2025-03-14T06:36:31.9301219Z  2025-03-14T06:36:31.9301614Z  2025-03-14T06:36:31.9302044Z  2025-03-14T06:36:31.9303006Z [18,022 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:31.9304126Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 109s local 2025-03-14T06:36:31.9305064Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T06:36:31.9305929Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T06:36:31.9306830Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T06:36:31.9308072Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T06:36:31.9309005Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T06:36:31.9309980Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T06:36:31.9310964Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 36s local ... 2025-03-14T06:36:32.2877349Z 2025-03-14T06:36:32.2878190Z  2025-03-14T06:36:32.2878687Z  2025-03-14T06:36:32.2879110Z  2025-03-14T06:36:32.2879496Z  2025-03-14T06:36:32.2879889Z  2025-03-14T06:36:32.2880257Z  2025-03-14T06:36:32.2880891Z  2025-03-14T06:36:32.2881300Z  2025-03-14T06:36:32.2882288Z [18,022 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:32.2883468Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T06:36:32.2884441Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T06:36:32.2885508Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T06:36:32.2886416Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 40s local 2025-03-14T06:36:32.2887423Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T06:36:32.2888394Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T06:36:32.2889376Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T06:36:32.2890476Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local ... 2025-03-14T06:36:32.5532781Z 2025-03-14T06:36:32.5533641Z  2025-03-14T06:36:32.5534124Z  2025-03-14T06:36:32.5534546Z  2025-03-14T06:36:32.5534959Z  2025-03-14T06:36:32.5535372Z  2025-03-14T06:36:32.5535748Z  2025-03-14T06:36:32.5536158Z  2025-03-14T06:36:32.5536545Z  2025-03-14T06:36:32.5537516Z [18,023 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:32.5538763Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T06:36:32.5539680Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T06:36:32.5540532Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T06:36:32.5541388Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T06:36:32.5542599Z Compiling xla/service/memory_space_assignment/algorithm.cc; 40s local 2025-03-14T06:36:32.5543535Z Compiling llvm/lib/Passes/PassBuilder.cpp; 39s local 2025-03-14T06:36:32.5544439Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T06:36:32.5545460Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local ... 2025-03-14T06:36:32.8882868Z 2025-03-14T06:36:32.8883728Z  2025-03-14T06:36:32.8884203Z  2025-03-14T06:36:32.8884760Z  2025-03-14T06:36:32.8885165Z  2025-03-14T06:36:32.8885517Z  2025-03-14T06:36:32.8885944Z  2025-03-14T06:36:32.8886323Z  2025-03-14T06:36:32.8886718Z  2025-03-14T06:36:32.8887700Z [18,023 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:32.8889153Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 110s local 2025-03-14T06:36:32.8890107Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T06:36:32.8890993Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T06:36:32.8891944Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T06:36:32.8892964Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T06:36:32.8894100Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T06:36:32.8895056Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T06:36:32.8896190Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 37s local ... 2025-03-14T06:36:33.2425448Z 2025-03-14T06:36:33.2426281Z  2025-03-14T06:36:33.2426897Z  2025-03-14T06:36:33.2427258Z  2025-03-14T06:36:33.2427685Z  2025-03-14T06:36:33.2428078Z  2025-03-14T06:36:33.2428468Z  2025-03-14T06:36:33.2428899Z  2025-03-14T06:36:33.2429293Z  2025-03-14T06:36:33.2430227Z [18,024 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:33.2431345Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T06:36:33.2432230Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T06:36:33.2433312Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T06:36:33.2445351Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T06:36:33.2446371Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T06:36:33.2447492Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T06:36:33.2448466Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T06:36:33.2449556Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local ... 2025-03-14T06:36:33.4887852Z 2025-03-14T06:36:33.4888733Z  2025-03-14T06:36:33.4889235Z  2025-03-14T06:36:33.4889673Z  2025-03-14T06:36:33.4890098Z  2025-03-14T06:36:33.4890547Z  2025-03-14T06:36:33.4890974Z  2025-03-14T06:36:33.4891398Z  2025-03-14T06:36:33.4891829Z  2025-03-14T06:36:33.4892839Z [18,025 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:33.4894072Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T06:36:33.4895053Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T06:36:33.4895956Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T06:36:33.4896908Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 41s local 2025-03-14T06:36:33.4897981Z Compiling xla/service/memory_space_assignment/algorithm.cc; 41s local 2025-03-14T06:36:33.4898924Z Compiling llvm/lib/Passes/PassBuilder.cpp; 40s local 2025-03-14T06:36:33.4899985Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T06:36:33.4901129Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local ... 2025-03-14T06:36:33.9528518Z 2025-03-14T06:36:33.9529511Z  2025-03-14T06:36:33.9529991Z  2025-03-14T06:36:33.9530640Z  2025-03-14T06:36:33.9531074Z  2025-03-14T06:36:33.9531481Z  2025-03-14T06:36:33.9531922Z  2025-03-14T06:36:33.9532331Z  2025-03-14T06:36:33.9532704Z  2025-03-14T06:36:33.9533605Z [18,026 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:33.9534779Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local 2025-03-14T06:36:33.9535734Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T06:36:33.9536680Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T06:36:33.9537594Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T06:36:33.9538554Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T06:36:33.9539770Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T06:36:33.9540772Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T06:36:33.9541894Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 38s local ... 2025-03-14T06:36:34.2894370Z 2025-03-14T06:36:34.2895183Z  2025-03-14T06:36:34.2895720Z  2025-03-14T06:36:34.2896136Z  2025-03-14T06:36:34.2896554Z  2025-03-14T06:36:34.2896954Z  2025-03-14T06:36:34.2897334Z  2025-03-14T06:36:34.2897739Z  2025-03-14T06:36:34.2898130Z  2025-03-14T06:36:34.2899113Z [18,026 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:34.2900586Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T06:36:34.2901611Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T06:36:34.2902537Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T06:36:34.2903622Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 42s local 2025-03-14T06:36:34.2904602Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T06:36:34.2905588Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T06:36:34.2906813Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T06:36:34.2907910Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local ... 2025-03-14T06:36:34.5733149Z 2025-03-14T06:36:34.5733951Z  2025-03-14T06:36:34.5734446Z  2025-03-14T06:36:34.5734885Z  2025-03-14T06:36:34.5735322Z  2025-03-14T06:36:34.5735731Z  2025-03-14T06:36:34.5736127Z  2025-03-14T06:36:34.5736553Z  2025-03-14T06:36:34.5736944Z  2025-03-14T06:36:34.5737908Z [18,028 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:34.5739112Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T06:36:34.5740082Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T06:36:34.5740982Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T06:36:34.5741937Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T06:36:34.5742981Z Compiling xla/service/memory_space_assignment/algorithm.cc; 42s local 2025-03-14T06:36:34.5744041Z Compiling llvm/lib/Passes/PassBuilder.cpp; 41s local 2025-03-14T06:36:34.5745094Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T06:36:34.5746252Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local ... 2025-03-14T06:36:34.8079845Z 2025-03-14T06:36:34.8080711Z  2025-03-14T06:36:34.8081214Z  2025-03-14T06:36:34.8081657Z  2025-03-14T06:36:34.8082105Z  2025-03-14T06:36:34.8082519Z  2025-03-14T06:36:34.8082933Z  2025-03-14T06:36:34.8083369Z  2025-03-14T06:36:34.8083800Z  2025-03-14T06:36:34.8084961Z [18,029 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:34.8086467Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T06:36:34.8087425Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T06:36:34.8088360Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T06:36:34.8089286Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T06:36:34.8090122Z Compiling xla/service/memory_space_assignment/algorithm.cc; 43s local 2025-03-14T06:36:34.8091083Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T06:36:34.8092086Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T06:36:34.8093253Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local ... 2025-03-14T06:36:35.0600862Z 2025-03-14T06:36:35.0601666Z  2025-03-14T06:36:35.0602358Z  2025-03-14T06:36:35.0602767Z  2025-03-14T06:36:35.0603157Z  2025-03-14T06:36:35.0603548Z  2025-03-14T06:36:35.0603929Z  2025-03-14T06:36:35.0604343Z  2025-03-14T06:36:35.0604897Z  2025-03-14T06:36:35.0605830Z [18,032 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:35.0606907Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 112s local 2025-03-14T06:36:35.0607832Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T06:36:35.0608711Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T06:36:35.0609635Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T06:36:35.0610464Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T06:36:35.0611665Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T06:36:35.0612731Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 39s local 2025-03-14T06:36:35.0613806Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local ... 2025-03-14T06:36:35.2901533Z 2025-03-14T06:36:35.2902415Z  2025-03-14T06:36:35.2902905Z  2025-03-14T06:36:35.2903306Z  2025-03-14T06:36:35.2903705Z  2025-03-14T06:36:35.2904088Z  2025-03-14T06:36:35.2904509Z  2025-03-14T06:36:35.2904907Z  2025-03-14T06:36:35.2905594Z  2025-03-14T06:36:35.2906614Z [18,033 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:35.2907775Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T06:36:35.2908731Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T06:36:35.2909627Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T06:36:35.2910544Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 43s local 2025-03-14T06:36:35.2911370Z Compiling llvm/lib/Passes/PassBuilder.cpp; 42s local 2025-03-14T06:36:35.2912347Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T06:36:35.2913444Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T06:36:35.2914544Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local ... 2025-03-14T06:36:35.6867336Z 2025-03-14T06:36:35.6868164Z  2025-03-14T06:36:35.6868652Z  2025-03-14T06:36:35.6869099Z  2025-03-14T06:36:35.6869533Z  2025-03-14T06:36:35.6869966Z  2025-03-14T06:36:35.6870400Z  2025-03-14T06:36:35.6870810Z  2025-03-14T06:36:35.6871241Z  2025-03-14T06:36:35.6872209Z [18,034 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:35.6873402Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T06:36:35.6874373Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T06:36:35.6875342Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T06:36:35.6876328Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T06:36:35.6877145Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T06:36:35.6878456Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T06:36:35.6879615Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T06:36:35.6880752Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local ... 2025-03-14T06:36:35.8906570Z 2025-03-14T06:36:35.8907468Z  2025-03-14T06:36:35.8907967Z  2025-03-14T06:36:35.8908400Z  2025-03-14T06:36:35.8908811Z  2025-03-14T06:36:35.8909223Z  2025-03-14T06:36:35.8909636Z  2025-03-14T06:36:35.8910047Z  2025-03-14T06:36:35.8910505Z  2025-03-14T06:36:35.8911510Z [18,034 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:35.8912676Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 113s local 2025-03-14T06:36:35.8914028Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T06:36:35.8914963Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T06:36:35.8915936Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T06:36:35.8916856Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T06:36:35.8917830Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T06:36:35.8918924Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 40s local 2025-03-14T06:36:35.8920070Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local ... 2025-03-14T06:36:36.2392520Z 2025-03-14T06:36:36.2393394Z  2025-03-14T06:36:36.2394157Z  2025-03-14T06:36:36.2394606Z  2025-03-14T06:36:36.2395056Z  2025-03-14T06:36:36.2395461Z  2025-03-14T06:36:36.2395858Z  2025-03-14T06:36:36.2396255Z  2025-03-14T06:36:36.2396696Z  2025-03-14T06:36:36.2397684Z [18,037 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:36.2398890Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T06:36:36.2399879Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T06:36:36.2400838Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T06:36:36.2401933Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T06:36:36.2402822Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T06:36:36.2403954Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T06:36:36.2405179Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2025-03-14T06:36:36.2406212Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local ... 2025-03-14T06:36:36.4911390Z 2025-03-14T06:36:36.4912219Z  2025-03-14T06:36:36.4912742Z  2025-03-14T06:36:36.4913210Z  2025-03-14T06:36:36.4913645Z  2025-03-14T06:36:36.4914082Z  2025-03-14T06:36:36.4914518Z  2025-03-14T06:36:36.4914940Z  2025-03-14T06:36:36.4915373Z  2025-03-14T06:36:36.4916354Z [18,037 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:36.4917505Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T06:36:36.4918486Z Compiling llvm/lib/Passes/PassBuilder.cpp; 84s local 2025-03-14T06:36:36.4919425Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T06:36:36.4920347Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 44s local 2025-03-14T06:36:36.4921194Z Compiling llvm/lib/Passes/PassBuilder.cpp; 43s local 2025-03-14T06:36:36.4922276Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T06:36:36.4923396Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2025-03-14T06:36:36.4924671Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local ... 2025-03-14T06:36:36.9467235Z 2025-03-14T06:36:36.9468110Z  2025-03-14T06:36:36.9468592Z  2025-03-14T06:36:36.9468995Z  2025-03-14T06:36:36.9469362Z  2025-03-14T06:36:36.9470039Z  2025-03-14T06:36:36.9470461Z  2025-03-14T06:36:36.9470856Z  2025-03-14T06:36:36.9471215Z  2025-03-14T06:36:36.9472125Z [18,038 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:36.9473201Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 114s local 2025-03-14T06:36:36.9474110Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T06:36:36.9475014Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2025-03-14T06:36:36.9475799Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2025-03-14T06:36:36.9476669Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T06:36:36.9477877Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 41s local 2025-03-14T06:36:36.9478852Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2025-03-14T06:36:36.9479863Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local ... 2025-03-14T06:36:37.1698968Z 2025-03-14T06:36:37.1699785Z  2025-03-14T06:36:37.1700276Z  2025-03-14T06:36:37.1700705Z  2025-03-14T06:36:37.1701167Z  2025-03-14T06:36:37.1701597Z  2025-03-14T06:36:37.1702010Z  2025-03-14T06:36:37.1702406Z  2025-03-14T06:36:37.1702804Z  2025-03-14T06:36:37.1703754Z [18,040 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:37.1704934Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T06:36:37.1706175Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T06:36:37.1707068Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2025-03-14T06:36:37.1707978Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2025-03-14T06:36:37.1708942Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T06:36:37.1710031Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T06:36:37.1711123Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 36s local 2025-03-14T06:36:37.1712519Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local ... 2025-03-14T06:36:37.4919781Z 2025-03-14T06:36:37.4920655Z  2025-03-14T06:36:37.4921165Z  2025-03-14T06:36:37.4921576Z  2025-03-14T06:36:37.4921990Z  2025-03-14T06:36:37.4922353Z  2025-03-14T06:36:37.4922747Z  2025-03-14T06:36:37.4923121Z  2025-03-14T06:36:37.4923539Z  2025-03-14T06:36:37.4924765Z [18,040 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:37.4925884Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T06:36:37.4926874Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T06:36:37.4927739Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 45s local 2025-03-14T06:36:37.4928521Z Compiling llvm/lib/Passes/PassBuilder.cpp; 44s local 2025-03-14T06:36:37.4929466Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T06:36:37.4930486Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T06:36:37.4931384Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 36s local 2025-03-14T06:36:37.4932539Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 30s local ... 2025-03-14T06:36:37.7584005Z 2025-03-14T06:36:37.7584808Z  2025-03-14T06:36:37.7585344Z  2025-03-14T06:36:37.7585762Z  2025-03-14T06:36:37.7586174Z  2025-03-14T06:36:37.7586571Z  2025-03-14T06:36:37.7586974Z  2025-03-14T06:36:37.7587384Z  2025-03-14T06:36:37.7587775Z  2025-03-14T06:36:37.7588774Z [18,046 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:37.7589955Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T06:36:37.7591298Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T06:36:37.7592177Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2025-03-14T06:36:37.7593036Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T06:36:37.7594035Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T06:36:37.7595125Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T06:36:37.7596175Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2025-03-14T06:36:37.7597165Z @xla//xla/hlo/evaluator:hlo_evaluator; 28s local ... 2025-03-14T06:36:37.9912430Z 2025-03-14T06:36:37.9913246Z  2025-03-14T06:36:37.9913727Z  2025-03-14T06:36:37.9914428Z  2025-03-14T06:36:37.9914828Z  2025-03-14T06:36:37.9915208Z  2025-03-14T06:36:37.9915607Z  2025-03-14T06:36:37.9916013Z  2025-03-14T06:36:37.9916422Z  2025-03-14T06:36:37.9917399Z [18,048 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:36:37.9918559Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 115s local 2025-03-14T06:36:37.9919575Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T06:36:37.9920489Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2025-03-14T06:36:37.9921259Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T06:36:37.9922114Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T06:36:37.9923335Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 42s local 2025-03-14T06:36:37.9924310Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2025-03-14T06:36:37.9925349Z @xla//xla/hlo/evaluator:hlo_evaluator; 28s local ... 2025-03-14T06:36:38.2925180Z 2025-03-14T06:36:38.2925979Z  2025-03-14T06:36:38.2926454Z  2025-03-14T06:36:38.2926885Z  2025-03-14T06:36:38.2927296Z  2025-03-14T06:36:38.2927744Z  2025-03-14T06:36:38.2928166Z  2025-03-14T06:36:38.2928558Z  2025-03-14T06:36:38.2928968Z  2025-03-14T06:36:38.2930207Z [18,048 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:38.2931402Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T06:36:38.2932460Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T06:36:38.2933427Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 46s local 2025-03-14T06:36:38.2934335Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T06:36:38.2935322Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T06:36:38.2936425Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T06:36:38.2937547Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2025-03-14T06:36:38.2938595Z @xla//xla/hlo/evaluator:hlo_evaluator; 28s local ... 2025-03-14T06:36:38.5322319Z 2025-03-14T06:36:38.5323128Z  2025-03-14T06:36:38.5323602Z  2025-03-14T06:36:38.5323959Z  2025-03-14T06:36:38.5324421Z  2025-03-14T06:36:38.5325042Z  2025-03-14T06:36:38.5325405Z  2025-03-14T06:36:38.5325779Z  2025-03-14T06:36:38.5326203Z  2025-03-14T06:36:38.5327152Z [18,050 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:38.5328227Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T06:36:38.5329236Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T06:36:38.5330122Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T06:36:38.5330906Z Compiling llvm/lib/Passes/PassBuilder.cpp; 45s local 2025-03-14T06:36:38.5331792Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T06:36:38.5332837Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T06:36:38.5334116Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 31s local 2025-03-14T06:36:38.5335100Z @xla//xla/hlo/evaluator:hlo_evaluator; 29s local ... 2025-03-14T06:36:38.8931468Z 2025-03-14T06:36:38.8932315Z  2025-03-14T06:36:38.8932810Z  2025-03-14T06:36:38.8933216Z  2025-03-14T06:36:38.8933602Z  2025-03-14T06:36:38.8933999Z  2025-03-14T06:36:38.8934395Z  2025-03-14T06:36:38.8934782Z  2025-03-14T06:36:38.8935189Z  2025-03-14T06:36:38.8936203Z [18,052 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:38.8937315Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T06:36:38.8938523Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T06:36:38.8939383Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T06:36:38.8940163Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T06:36:38.8941113Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T06:36:38.8942166Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T06:36:38.8943229Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2025-03-14T06:36:38.8944205Z @xla//xla/hlo/evaluator:hlo_evaluator; 29s local ... 2025-03-14T06:36:39.0934738Z 2025-03-14T06:36:39.0935555Z  2025-03-14T06:36:39.0936065Z  2025-03-14T06:36:39.0936438Z  2025-03-14T06:36:39.0937144Z  2025-03-14T06:36:39.0937552Z  2025-03-14T06:36:39.0937971Z  2025-03-14T06:36:39.0938391Z  2025-03-14T06:36:39.0938819Z  2025-03-14T06:36:39.0939782Z [18,053 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:39.0940828Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 116s local 2025-03-14T06:36:39.0941834Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T06:36:39.0942774Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T06:36:39.0943785Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T06:36:39.0944680Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T06:36:39.0945665Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 43s local 2025-03-14T06:36:39.0946615Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2025-03-14T06:36:39.0947454Z @xla//xla/hlo/evaluator:hlo_evaluator; 29s local ... 2025-03-14T06:36:39.4194030Z 2025-03-14T06:36:39.4194870Z  2025-03-14T06:36:39.4195360Z  2025-03-14T06:36:39.4195771Z  2025-03-14T06:36:39.4196181Z  2025-03-14T06:36:39.4196638Z  2025-03-14T06:36:39.4197091Z  2025-03-14T06:36:39.4197513Z  2025-03-14T06:36:39.4197942Z  2025-03-14T06:36:39.4198929Z [18,054 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:39.4200123Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T06:36:39.4201150Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T06:36:39.4202086Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 47s local 2025-03-14T06:36:39.4202920Z Compiling llvm/lib/Passes/PassBuilder.cpp; 46s local 2025-03-14T06:36:39.4203953Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T06:36:39.4205196Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T06:36:39.4206309Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2025-03-14T06:36:39.4207298Z @xla//xla/hlo/evaluator:hlo_evaluator; 30s local ... 2025-03-14T06:36:39.6939787Z 2025-03-14T06:36:39.6940609Z  2025-03-14T06:36:39.6941103Z  2025-03-14T06:36:39.6941526Z  2025-03-14T06:36:39.6941930Z  2025-03-14T06:36:39.6942349Z  2025-03-14T06:36:39.6942772Z  2025-03-14T06:36:39.6943433Z  2025-03-14T06:36:39.6943846Z  2025-03-14T06:36:39.6944842Z [18,054 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:39.6946015Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T06:36:39.6947036Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2025-03-14T06:36:39.6947939Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T06:36:39.6948813Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T06:36:39.6949876Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T06:36:39.6950966Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T06:36:39.6952246Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 32s local 2025-03-14T06:36:39.6953175Z @xla//xla/hlo/evaluator:hlo_evaluator; 30s local ... 2025-03-14T06:36:39.8943101Z 2025-03-14T06:36:39.8943927Z  2025-03-14T06:36:39.8944421Z  2025-03-14T06:36:39.8944832Z  2025-03-14T06:36:39.8945213Z  2025-03-14T06:36:39.8945605Z  2025-03-14T06:36:39.8946031Z  2025-03-14T06:36:39.8946394Z  2025-03-14T06:36:39.8946773Z  2025-03-14T06:36:39.8947754Z [18,055 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:39.8948910Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 117s local 2025-03-14T06:36:39.8949930Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2025-03-14T06:36:39.8951114Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T06:36:39.8951964Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T06:36:39.8952954Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T06:36:39.8953980Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 44s local 2025-03-14T06:36:39.8954929Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local 2025-03-14T06:36:39.8955783Z @xla//xla/hlo/evaluator:hlo_evaluator; 30s local ... 2025-03-14T06:36:40.1850930Z 2025-03-14T06:36:40.1852033Z  2025-03-14T06:36:40.1852547Z  2025-03-14T06:36:40.1852948Z  2025-03-14T06:36:40.1853338Z  2025-03-14T06:36:40.1853742Z  2025-03-14T06:36:40.1854162Z  2025-03-14T06:36:40.1854663Z  2025-03-14T06:36:40.1855033Z  2025-03-14T06:36:40.1855958Z [18,056 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:40.1857006Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T06:36:40.1857859Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2025-03-14T06:36:40.1858707Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T06:36:40.1859508Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T06:36:40.1860471Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T06:36:40.1861532Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T06:36:40.1862539Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local 2025-03-14T06:36:40.1863605Z @xla//xla/hlo/evaluator:hlo_evaluator; 30s local ... 2025-03-14T06:36:40.4903415Z 2025-03-14T06:36:40.4904297Z  2025-03-14T06:36:40.4904794Z  2025-03-14T06:36:40.4905214Z  2025-03-14T06:36:40.4905611Z  2025-03-14T06:36:40.4905993Z  2025-03-14T06:36:40.4906443Z  2025-03-14T06:36:40.4906864Z  2025-03-14T06:36:40.4907269Z  2025-03-14T06:36:40.4908237Z [18,058 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:36:40.4909356Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T06:36:40.4910425Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T06:36:40.4911601Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 48s local 2025-03-14T06:36:40.4912472Z Compiling llvm/lib/Passes/PassBuilder.cpp; 47s local 2025-03-14T06:36:40.4913472Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T06:36:40.4914531Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T06:36:40.4915585Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local 2025-03-14T06:36:40.4916570Z @xla//xla/hlo/evaluator:hlo_evaluator; 31s local ... 2025-03-14T06:36:40.6949033Z 2025-03-14T06:36:40.6949901Z  2025-03-14T06:36:40.6950377Z  2025-03-14T06:36:40.6950791Z  2025-03-14T06:36:40.6951179Z  2025-03-14T06:36:40.6951567Z  2025-03-14T06:36:40.6951949Z  2025-03-14T06:36:40.6952651Z  2025-03-14T06:36:40.6953054Z  2025-03-14T06:36:40.6954162Z [18,058 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:40.6955339Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T06:36:40.6956404Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T06:36:40.6957354Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T06:36:40.6958251Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2025-03-14T06:36:40.6959306Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T06:36:40.6960375Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T06:36:40.6961684Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 33s local 2025-03-14T06:36:40.6962605Z @xla//xla/hlo/evaluator:hlo_evaluator; 31s local ... 2025-03-14T06:36:41.1063693Z 2025-03-14T06:36:41.1064569Z  2025-03-14T06:36:41.1065134Z  2025-03-14T06:36:41.1065834Z  2025-03-14T06:36:41.1066241Z  2025-03-14T06:36:41.1066638Z  2025-03-14T06:36:41.1067043Z  2025-03-14T06:36:41.1067442Z  2025-03-14T06:36:41.1067832Z  2025-03-14T06:36:41.1068784Z [18,059 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:41.1070239Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 118s local 2025-03-14T06:36:41.1071241Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T06:36:41.1072093Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 49s local 2025-03-14T06:36:41.1073071Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2025-03-14T06:36:41.1074088Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T06:36:41.1075155Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 45s local 2025-03-14T06:36:41.1076218Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2025-03-14T06:36:41.1077134Z @xla//xla/hlo/evaluator:hlo_evaluator; 31s local ... 2025-03-14T06:36:41.4956072Z 2025-03-14T06:36:41.4956909Z  2025-03-14T06:36:41.4957389Z  2025-03-14T06:36:41.4957817Z  2025-03-14T06:36:41.4958259Z  2025-03-14T06:36:41.4958669Z  2025-03-14T06:36:41.4959040Z  2025-03-14T06:36:41.4959470Z  2025-03-14T06:36:41.4959873Z  2025-03-14T06:36:41.4960821Z [18,061 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:41.4962014Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2025-03-14T06:36:41.4963023Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T06:36:41.4963957Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T06:36:41.4964935Z Compiling llvm/lib/Passes/PassBuilder.cpp; 48s local 2025-03-14T06:36:41.4966113Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T06:36:41.4967212Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T06:36:41.4968270Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 34s local 2025-03-14T06:36:41.4969564Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local ... 2025-03-14T06:36:41.7353055Z 2025-03-14T06:36:41.7353965Z  2025-03-14T06:36:41.7354463Z  2025-03-14T06:36:41.7354923Z  2025-03-14T06:36:41.7355337Z  2025-03-14T06:36:41.7355758Z  2025-03-14T06:36:41.7356180Z  2025-03-14T06:36:41.7356610Z  2025-03-14T06:36:41.7357015Z  2025-03-14T06:36:41.7357955Z [18,062 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:41.7359068Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2025-03-14T06:36:41.7360020Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T06:36:41.7360862Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T06:36:41.7361833Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T06:36:41.7362736Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T06:36:41.7363698Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T06:36:41.7364803Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2025-03-14T06:36:41.7365933Z Compiling stablehlo/dialect/VhloOps.cpp; 29s local ... 2025-03-14T06:36:42.0158939Z 2025-03-14T06:36:42.0159792Z  2025-03-14T06:36:42.0160297Z  2025-03-14T06:36:42.0160701Z  2025-03-14T06:36:42.0161141Z  2025-03-14T06:36:42.0161558Z  2025-03-14T06:36:42.0161995Z  2025-03-14T06:36:42.0162430Z  2025-03-14T06:36:42.0163144Z  2025-03-14T06:36:42.0164145Z [18,065 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:42.0165706Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 119s local 2025-03-14T06:36:42.0166794Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T06:36:42.0167760Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T06:36:42.0168592Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T06:36:42.0169548Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T06:36:42.0170774Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 46s local 2025-03-14T06:36:42.0171745Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2025-03-14T06:36:42.0172729Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local ... 2025-03-14T06:36:42.2963227Z 2025-03-14T06:36:42.2964042Z  2025-03-14T06:36:42.2964715Z  2025-03-14T06:36:42.2965152Z  2025-03-14T06:36:42.2965753Z  2025-03-14T06:36:42.2966147Z  2025-03-14T06:36:42.2966544Z  2025-03-14T06:36:42.2966925Z  2025-03-14T06:36:42.2967348Z  2025-03-14T06:36:42.2968326Z [18,066 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:42.2969492Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T06:36:42.2970541Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T06:36:42.2971466Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 50s local 2025-03-14T06:36:42.2972339Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T06:36:42.2973335Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T06:36:42.2974405Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T06:36:42.2975409Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2025-03-14T06:36:42.2976375Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local ... 2025-03-14T06:36:42.5148144Z 2025-03-14T06:36:42.5148992Z  2025-03-14T06:36:42.5149482Z  2025-03-14T06:36:42.5149939Z  2025-03-14T06:36:42.5150347Z  2025-03-14T06:36:42.5150747Z  2025-03-14T06:36:42.5151153Z  2025-03-14T06:36:42.5151565Z  2025-03-14T06:36:42.5151987Z  2025-03-14T06:36:42.5153183Z [18,069 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:42.5154346Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T06:36:42.5155394Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2025-03-14T06:36:42.5156305Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2025-03-14T06:36:42.5157302Z Compiling llvm/lib/Passes/PassBuilder.cpp; 49s local 2025-03-14T06:36:42.5158362Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T06:36:42.5159364Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T06:36:42.5160398Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 35s local 2025-03-14T06:36:42.5161598Z Compiling stablehlo/dialect/VhloOps.cpp; 30s local ... 2025-03-14T06:36:42.8968799Z 2025-03-14T06:36:42.8969614Z  2025-03-14T06:36:42.8970114Z  2025-03-14T06:36:42.8970554Z  2025-03-14T06:36:42.8971000Z  2025-03-14T06:36:42.8971445Z  2025-03-14T06:36:42.8971843Z  2025-03-14T06:36:42.8972228Z  2025-03-14T06:36:42.8972626Z  2025-03-14T06:36:42.8973605Z [18,070 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:42.8974777Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 120s local 2025-03-14T06:36:42.8975832Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2025-03-14T06:36:42.8976879Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2025-03-14T06:36:42.8977998Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T06:36:42.8979010Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T06:36:42.8980070Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 47s local 2025-03-14T06:36:42.8981132Z Compiling mlir/lib/Conversion/MathToLibm/MathToLibm.cpp; 36s local 2025-03-14T06:36:42.8982136Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local ... 2025-03-14T06:36:43.4824358Z 2025-03-14T06:36:43.4825185Z  2025-03-14T06:36:43.4825665Z  2025-03-14T06:36:43.4826077Z  2025-03-14T06:36:43.4826722Z  2025-03-14T06:36:43.4827138Z  2025-03-14T06:36:43.4827546Z  2025-03-14T06:36:43.4827964Z  2025-03-14T06:36:43.4828344Z  2025-03-14T06:36:43.4829299Z [18,071 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:43.4830441Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T06:36:43.4831527Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T06:36:43.4832397Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 51s local 2025-03-14T06:36:43.4833292Z Compiling llvm/lib/Passes/PassBuilder.cpp; 50s local 2025-03-14T06:36:43.4834237Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T06:36:43.4835260Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T06:36:43.4836161Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T06:36:43.4837087Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local ... 2025-03-14T06:36:43.6974761Z 2025-03-14T06:36:43.6975583Z  2025-03-14T06:36:43.6976082Z  2025-03-14T06:36:43.6976488Z  2025-03-14T06:36:43.6976880Z  2025-03-14T06:36:43.6977288Z  2025-03-14T06:36:43.6977675Z  2025-03-14T06:36:43.6978062Z  2025-03-14T06:36:43.6978448Z  2025-03-14T06:36:43.6979437Z [18,072 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:43.6980579Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T06:36:43.6981517Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T06:36:43.6982388Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T06:36:43.6983234Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T06:36:43.6984431Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T06:36:43.6985503Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T06:36:43.6986381Z Compiling stablehlo/dialect/VhloOps.cpp; 31s local 2025-03-14T06:36:43.6987269Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local ... 2025-03-14T06:36:44.0559531Z 2025-03-14T06:36:44.0560469Z  2025-03-14T06:36:44.0560934Z  2025-03-14T06:36:44.0561341Z  2025-03-14T06:36:44.0561755Z  2025-03-14T06:36:44.0562139Z  2025-03-14T06:36:44.0562502Z  2025-03-14T06:36:44.0562896Z  2025-03-14T06:36:44.0563263Z  2025-03-14T06:36:44.0564179Z [18,074 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:44.0565906Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 121s local 2025-03-14T06:36:44.0566880Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T06:36:44.0567779Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T06:36:44.0568568Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T06:36:44.0569510Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T06:36:44.0570489Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 48s local 2025-03-14T06:36:44.0571349Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T06:36:44.0572235Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local ... 2025-03-14T06:36:44.2979607Z 2025-03-14T06:36:44.2980417Z  2025-03-14T06:36:44.2980913Z  2025-03-14T06:36:44.2981330Z  2025-03-14T06:36:44.2981744Z  2025-03-14T06:36:44.2982189Z  2025-03-14T06:36:44.2982596Z  2025-03-14T06:36:44.2983016Z  2025-03-14T06:36:44.2983516Z  2025-03-14T06:36:44.2984472Z [18,074 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:44.2985634Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T06:36:44.2986904Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T06:36:44.2987820Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 52s local 2025-03-14T06:36:44.2988671Z Compiling llvm/lib/Passes/PassBuilder.cpp; 51s local 2025-03-14T06:36:44.2989620Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T06:36:44.2990649Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T06:36:44.2991550Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T06:36:44.2992443Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local ... 2025-03-14T06:36:44.6346784Z 2025-03-14T06:36:44.6347620Z  2025-03-14T06:36:44.6348086Z  2025-03-14T06:36:44.6348477Z  2025-03-14T06:36:44.6348879Z  2025-03-14T06:36:44.6349270Z  2025-03-14T06:36:44.6349652Z  2025-03-14T06:36:44.6350058Z  2025-03-14T06:36:44.6350469Z  2025-03-14T06:36:44.6351437Z [18,075 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:44.6352568Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T06:36:44.6353478Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T06:36:44.6354379Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T06:36:44.6355237Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2025-03-14T06:36:44.6356185Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T06:36:44.6357247Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T06:36:44.6358098Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T06:36:44.6359005Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local ... 2025-03-14T06:36:44.8368592Z 2025-03-14T06:36:44.8369447Z  2025-03-14T06:36:44.8370131Z  2025-03-14T06:36:44.8370529Z  2025-03-14T06:36:44.8370984Z  2025-03-14T06:36:44.8371362Z  2025-03-14T06:36:44.8371708Z  2025-03-14T06:36:44.8372094Z  2025-03-14T06:36:44.8372499Z  2025-03-14T06:36:44.8373395Z [18,076 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:44.8374434Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T06:36:44.8375369Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T06:36:44.8376245Z Compiling xla/hlo/evaluator/hlo_evaluator.cc; 53s local 2025-03-14T06:36:44.8377054Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2025-03-14T06:36:44.8378206Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T06:36:44.8379246Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T06:36:44.8380055Z Compiling stablehlo/dialect/VhloOps.cpp; 32s local 2025-03-14T06:36:44.8380968Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local ... 2025-03-14T06:36:45.0985722Z 2025-03-14T06:36:45.0986596Z  2025-03-14T06:36:45.0987110Z  2025-03-14T06:36:45.0987532Z  2025-03-14T06:36:45.0987955Z  2025-03-14T06:36:45.0988368Z  2025-03-14T06:36:45.0988795Z  2025-03-14T06:36:45.0989232Z  2025-03-14T06:36:45.0989654Z  2025-03-14T06:36:45.0990633Z [18,077 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:45.0992110Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 122s local 2025-03-14T06:36:45.0993166Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T06:36:45.0994082Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2025-03-14T06:36:45.0995094Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2025-03-14T06:36:45.0996147Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 49s local 2025-03-14T06:36:45.0997135Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2025-03-14T06:36:45.0998110Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2025-03-14T06:36:45.0999153Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 14s local ... 2025-03-14T06:36:45.4990481Z 2025-03-14T06:36:45.4991295Z  2025-03-14T06:36:45.4991789Z  2025-03-14T06:36:45.4992218Z  2025-03-14T06:36:45.4992648Z  2025-03-14T06:36:45.4993152Z  2025-03-14T06:36:45.4993574Z  2025-03-14T06:36:45.4993991Z  2025-03-14T06:36:45.4994375Z  2025-03-14T06:36:45.4995363Z [18,078 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:45.4996572Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 123s local 2025-03-14T06:36:45.4997602Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T06:36:45.4998524Z Compiling llvm/lib/Passes/PassBuilder.cpp; 52s local 2025-03-14T06:36:45.4999578Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2025-03-14T06:36:45.5000660Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 50s local 2025-03-14T06:36:45.5001488Z Compiling stablehlo/dialect/VhloOps.cpp; 33s local 2025-03-14T06:36:45.5002398Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2025-03-14T06:36:45.5003558Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 15s local ... 2025-03-14T06:36:46.3205386Z 2025-03-14T06:36:46.3206299Z  2025-03-14T06:36:46.3206804Z  2025-03-14T06:36:46.3207236Z  2025-03-14T06:36:46.3207645Z  2025-03-14T06:36:46.3208053Z  2025-03-14T06:36:46.3208463Z  2025-03-14T06:36:46.3208898Z  2025-03-14T06:36:46.3209308Z  2025-03-14T06:36:46.3210260Z [18,079 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:46.3211656Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T06:36:46.3212721Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T06:36:46.3213636Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T06:36:46.3214662Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T06:36:46.3215777Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2025-03-14T06:36:46.3216676Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2025-03-14T06:36:46.3217668Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 15s local 2025-03-14T06:36:46.3218619Z Compiling stablehlo/dialect/StablehloOps.cpp; 15s local ... 2025-03-14T06:36:46.5871918Z 2025-03-14T06:36:46.5872982Z  2025-03-14T06:36:46.5873486Z  2025-03-14T06:36:46.5873892Z  2025-03-14T06:36:46.5874268Z  2025-03-14T06:36:46.5874671Z  2025-03-14T06:36:46.5875078Z  2025-03-14T06:36:46.5875487Z  2025-03-14T06:36:46.5875894Z  2025-03-14T06:36:46.5876861Z [18,084 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:46.5878012Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T06:36:46.5879013Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2025-03-14T06:36:46.5879953Z Compiling llvm/lib/Passes/PassBuilder.cpp; 53s local 2025-03-14T06:36:46.5890912Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T06:36:46.5892393Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2025-03-14T06:36:46.5893224Z Compiling stablehlo/dialect/VhloOps.cpp; 34s local 2025-03-14T06:36:46.5894158Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2025-03-14T06:36:46.5895234Z Compiling stablehlo/dialect/StablehloOps.cpp; 15s local ... 2025-03-14T06:36:46.8882507Z 2025-03-14T06:36:46.8883337Z  2025-03-14T06:36:46.8883850Z  2025-03-14T06:36:46.8884325Z  2025-03-14T06:36:46.8884958Z  2025-03-14T06:36:46.8885401Z  2025-03-14T06:36:46.8885805Z  2025-03-14T06:36:46.8886207Z  2025-03-14T06:36:46.8886842Z  2025-03-14T06:36:46.8887862Z [18,087 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:36:46.8889193Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T06:36:46.8890196Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2025-03-14T06:36:46.8891139Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T06:36:46.8892056Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T06:36:46.8893058Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2025-03-14T06:36:46.8893869Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T06:36:46.8894857Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2025-03-14T06:36:46.8895910Z Compiling stablehlo/dialect/StablehloOps.cpp; 15s local ... 2025-03-14T06:36:47.1001215Z 2025-03-14T06:36:47.1002063Z  2025-03-14T06:36:47.1002588Z  2025-03-14T06:36:47.1002991Z  2025-03-14T06:36:47.1003527Z  2025-03-14T06:36:47.1003945Z  2025-03-14T06:36:47.1004349Z  2025-03-14T06:36:47.1004938Z  2025-03-14T06:36:47.1005363Z  2025-03-14T06:36:47.1006377Z [18,087 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:47.1007570Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 124s local 2025-03-14T06:36:47.1008628Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2025-03-14T06:36:47.1009588Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T06:36:47.1010628Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T06:36:47.1011719Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 51s local 2025-03-14T06:36:47.1012892Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T06:36:47.1013956Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2025-03-14T06:36:47.1015042Z Compiling stablehlo/dialect/StablehloOps.cpp; 16s local ... 2025-03-14T06:36:47.3004890Z 2025-03-14T06:36:47.3005819Z  2025-03-14T06:36:47.3006297Z  2025-03-14T06:36:47.3006722Z  2025-03-14T06:36:47.3007145Z  2025-03-14T06:36:47.3007539Z  2025-03-14T06:36:47.3007970Z  2025-03-14T06:36:47.3008396Z  2025-03-14T06:36:47.3008767Z  2025-03-14T06:36:47.3009710Z [18,090 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:47.3011137Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2025-03-14T06:36:47.3012137Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2025-03-14T06:36:47.3013007Z Compiling llvm/lib/Passes/PassBuilder.cpp; 54s local 2025-03-14T06:36:47.3013981Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T06:36:47.3015025Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2025-03-14T06:36:47.3015874Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T06:36:47.3016870Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 16s local 2025-03-14T06:36:47.3017945Z Compiling stablehlo/dialect/StablehloOps.cpp; 16s local ... 2025-03-14T06:36:47.7801475Z 2025-03-14T06:36:47.7802270Z  2025-03-14T06:36:47.7803013Z  2025-03-14T06:36:47.7803430Z  2025-03-14T06:36:47.7803832Z  2025-03-14T06:36:47.7804255Z  2025-03-14T06:36:47.7804800Z  2025-03-14T06:36:47.7805183Z  2025-03-14T06:36:47.7805610Z  2025-03-14T06:36:47.7806534Z [18,091 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:47.7807659Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2025-03-14T06:36:47.7808675Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T06:36:47.7809749Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T06:36:47.7810752Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T06:36:47.7811754Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2025-03-14T06:36:47.7812586Z Compiling stablehlo/dialect/VhloOps.cpp; 35s local 2025-03-14T06:36:47.7813582Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2025-03-14T06:36:47.7814498Z Compiling stablehlo/dialect/StablehloOps.cpp; 16s local ... 2025-03-14T06:36:48.0156699Z 2025-03-14T06:36:48.0157596Z  2025-03-14T06:36:48.0158089Z  2025-03-14T06:36:48.0158477Z  2025-03-14T06:36:48.0158879Z  2025-03-14T06:36:48.0159259Z  2025-03-14T06:36:48.0159632Z  2025-03-14T06:36:48.0160029Z  2025-03-14T06:36:48.0160397Z  2025-03-14T06:36:48.0161295Z [18,092 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:48.0162427Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 125s local 2025-03-14T06:36:48.0163430Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T06:36:48.0164305Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T06:36:48.0165675Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T06:36:48.0166676Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 52s local 2025-03-14T06:36:48.0167560Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T06:36:48.0168500Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2025-03-14T06:36:48.0169504Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local ... 2025-03-14T06:36:48.2172196Z 2025-03-14T06:36:48.2173047Z  2025-03-14T06:36:48.2173523Z  2025-03-14T06:36:48.2173931Z  2025-03-14T06:36:48.2174546Z  2025-03-14T06:36:48.2174969Z  2025-03-14T06:36:48.2175383Z  2025-03-14T06:36:48.2175781Z  2025-03-14T06:36:48.2176182Z  2025-03-14T06:36:48.2177075Z [18,093 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:48.2178092Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T06:36:48.2179018Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T06:36:48.2179944Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T06:36:48.2180889Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T06:36:48.2181899Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T06:36:48.2182919Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T06:36:48.2183844Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 17s local 2025-03-14T06:36:48.2184930Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local ... 2025-03-14T06:36:48.5013311Z 2025-03-14T06:36:48.5014168Z  2025-03-14T06:36:48.5014679Z  2025-03-14T06:36:48.5015243Z  2025-03-14T06:36:48.5015650Z  2025-03-14T06:36:48.5016073Z  2025-03-14T06:36:48.5016489Z  2025-03-14T06:36:48.5016903Z  2025-03-14T06:36:48.5017322Z  2025-03-14T06:36:48.5018276Z [18,093 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:48.5019727Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T06:36:48.5020706Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2025-03-14T06:36:48.5021649Z Compiling llvm/lib/Passes/PassBuilder.cpp; 55s local 2025-03-14T06:36:48.5022635Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T06:36:48.5023673Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T06:36:48.5024500Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T06:36:48.5025434Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2025-03-14T06:36:48.5026710Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local ... 2025-03-14T06:36:48.8105554Z 2025-03-14T06:36:48.8106368Z  2025-03-14T06:36:48.8106855Z  2025-03-14T06:36:48.8107295Z  2025-03-14T06:36:48.8107729Z  2025-03-14T06:36:48.8108152Z  2025-03-14T06:36:48.8108544Z  2025-03-14T06:36:48.8108928Z  2025-03-14T06:36:48.8109325Z  2025-03-14T06:36:48.8110301Z [18,095 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:48.8111502Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T06:36:48.8112504Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2025-03-14T06:36:48.8113421Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T06:36:48.8114402Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T06:36:48.8115492Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T06:36:48.8116398Z Compiling stablehlo/dialect/VhloOps.cpp; 36s local 2025-03-14T06:36:48.8117405Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2025-03-14T06:36:48.8118482Z Compiling stablehlo/dialect/StablehloOps.cpp; 17s local ... 2025-03-14T06:36:49.0511509Z 2025-03-14T06:36:49.0512386Z  2025-03-14T06:36:49.0512901Z  2025-03-14T06:36:49.0513338Z  2025-03-14T06:36:49.0513738Z  2025-03-14T06:36:49.0514135Z  2025-03-14T06:36:49.0514525Z  2025-03-14T06:36:49.0514939Z  2025-03-14T06:36:49.0515341Z  2025-03-14T06:36:49.0516376Z [18,097 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:49.0517585Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 126s local 2025-03-14T06:36:49.0518901Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2025-03-14T06:36:49.0519871Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T06:36:49.0520906Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T06:36:49.0522027Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 53s local 2025-03-14T06:36:49.0522970Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T06:36:49.0523991Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2025-03-14T06:36:49.0525289Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local ... 2025-03-14T06:36:49.3020235Z 2025-03-14T06:36:49.3021108Z  2025-03-14T06:36:49.3021686Z  2025-03-14T06:36:49.3022369Z  2025-03-14T06:36:49.3022742Z  2025-03-14T06:36:49.3023099Z  2025-03-14T06:36:49.3023454Z  2025-03-14T06:36:49.3023872Z  2025-03-14T06:36:49.3024275Z  2025-03-14T06:36:49.3025255Z [18,097 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:49.3026370Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T06:36:49.3027315Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2025-03-14T06:36:49.3028189Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T06:36:49.3029160Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T06:36:49.3030213Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T06:36:49.3031292Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T06:36:49.3032303Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 18s local 2025-03-14T06:36:49.3033450Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local ... 2025-03-14T06:36:49.5022545Z 2025-03-14T06:36:49.5023381Z  2025-03-14T06:36:49.5023873Z  2025-03-14T06:36:49.5024257Z  2025-03-14T06:36:49.5024637Z  2025-03-14T06:36:49.5025072Z  2025-03-14T06:36:49.5025472Z  2025-03-14T06:36:49.5025884Z  2025-03-14T06:36:49.5026302Z  2025-03-14T06:36:49.5027553Z [18,100 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:49.5028734Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T06:36:49.5029767Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 68s local 2025-03-14T06:36:49.5030672Z Compiling llvm/lib/Passes/PassBuilder.cpp; 56s local 2025-03-14T06:36:49.5031588Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T06:36:49.5032804Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T06:36:49.5033768Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T06:36:49.5034835Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2025-03-14T06:36:49.5035987Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local ... 2025-03-14T06:36:49.7129047Z 2025-03-14T06:36:49.7129917Z  2025-03-14T06:36:49.7130407Z  2025-03-14T06:36:49.7130831Z  2025-03-14T06:36:49.7131259Z  2025-03-14T06:36:49.7131651Z  2025-03-14T06:36:49.7132040Z  2025-03-14T06:36:49.7132456Z  2025-03-14T06:36:49.7132874Z  2025-03-14T06:36:49.7133819Z [18,102 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:49.7134999Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T06:36:49.7136068Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 68s local 2025-03-14T06:36:49.7136976Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T06:36:49.7138003Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T06:36:49.7139075Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T06:36:49.7139905Z Compiling stablehlo/dialect/VhloOps.cpp; 37s local 2025-03-14T06:36:49.7141171Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2025-03-14T06:36:49.7142242Z Compiling stablehlo/dialect/StablehloOps.cpp; 18s local ... 2025-03-14T06:36:49.9998725Z 2025-03-14T06:36:49.9999561Z  2025-03-14T06:36:50.0000041Z  2025-03-14T06:36:50.0000404Z  2025-03-14T06:36:50.0000822Z  2025-03-14T06:36:50.0001247Z  2025-03-14T06:36:50.0001652Z  2025-03-14T06:36:50.0002078Z  2025-03-14T06:36:50.0002580Z  2025-03-14T06:36:50.0003514Z [18,107 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:50.0004801Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 127s local 2025-03-14T06:36:50.0006026Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T06:36:50.0007053Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T06:36:50.0008123Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 54s local 2025-03-14T06:36:50.0009015Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2025-03-14T06:36:50.0010026Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2025-03-14T06:36:50.0011048Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local 2025-03-14T06:36:50.0012109Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local ... 2025-03-14T06:36:50.3029574Z 2025-03-14T06:36:50.3030440Z  2025-03-14T06:36:50.3030943Z  2025-03-14T06:36:50.3031662Z  2025-03-14T06:36:50.3032098Z  2025-03-14T06:36:50.3032527Z  2025-03-14T06:36:50.3032932Z  2025-03-14T06:36:50.3033365Z  2025-03-14T06:36:50.3033904Z  2025-03-14T06:36:50.3034904Z [18,107 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:50.3036117Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 128s local 2025-03-14T06:36:50.3037105Z Compiling llvm/lib/Passes/PassBuilder.cpp; 57s local 2025-03-14T06:36:50.3038011Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2025-03-14T06:36:50.3039279Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 55s local 2025-03-14T06:36:50.3040083Z Compiling stablehlo/dialect/VhloOps.cpp; 38s local 2025-03-14T06:36:50.3041017Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 19s local 2025-03-14T06:36:50.3041985Z Compiling stablehlo/dialect/StablehloOps.cpp; 19s local 2025-03-14T06:36:50.3042853Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local ... 2025-03-14T06:36:51.3038329Z 2025-03-14T06:36:51.3039186Z  2025-03-14T06:36:51.3039700Z  2025-03-14T06:36:51.3040137Z  2025-03-14T06:36:51.3040593Z  2025-03-14T06:36:51.3041007Z  2025-03-14T06:36:51.3041440Z  2025-03-14T06:36:51.3041879Z  2025-03-14T06:36:51.3042284Z  2025-03-14T06:36:51.3043247Z [18,107 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:51.3044645Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T06:36:51.3045701Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T06:36:51.3046763Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T06:36:51.3047859Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T06:36:51.3048822Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2025-03-14T06:36:51.3049824Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 20s local 2025-03-14T06:36:51.3050848Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local 2025-03-14T06:36:51.3051843Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local ... 2025-03-14T06:36:51.5316769Z 2025-03-14T06:36:51.5317598Z  2025-03-14T06:36:51.5318073Z  2025-03-14T06:36:51.5318462Z  2025-03-14T06:36:51.5318869Z  2025-03-14T06:36:51.5319515Z  2025-03-14T06:36:51.5319941Z  2025-03-14T06:36:51.5320344Z  2025-03-14T06:36:51.5320756Z  2025-03-14T06:36:51.5321747Z [18,110 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:51.5322912Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T06:36:51.5324026Z Compiling llvm/lib/Passes/PassBuilder.cpp; 58s local 2025-03-14T06:36:51.5325213Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T06:36:51.5326378Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T06:36:51.5327309Z Compiling stablehlo/dialect/VhloOps.cpp; 39s local 2025-03-14T06:36:51.5328633Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2025-03-14T06:36:51.5329647Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local 2025-03-14T06:36:51.5330730Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local ... 2025-03-14T06:36:51.9043538Z 2025-03-14T06:36:51.9044367Z  2025-03-14T06:36:51.9045020Z  2025-03-14T06:36:51.9045439Z  2025-03-14T06:36:51.9045896Z  2025-03-14T06:36:51.9046267Z  2025-03-14T06:36:51.9046677Z  2025-03-14T06:36:51.9047050Z  2025-03-14T06:36:51.9047422Z  2025-03-14T06:36:51.9048379Z [18,111 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:51.9049561Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 129s local 2025-03-14T06:36:51.9050894Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T06:36:51.9051932Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T06:36:51.9052923Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 56s local 2025-03-14T06:36:51.9053818Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T06:36:51.9054843Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2025-03-14T06:36:51.9055888Z Compiling stablehlo/dialect/StablehloOps.cpp; 20s local 2025-03-14T06:36:51.9057152Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local ... 2025-03-14T06:36:52.1561234Z 2025-03-14T06:36:52.1562090Z  2025-03-14T06:36:52.1562591Z  2025-03-14T06:36:52.1563002Z  2025-03-14T06:36:52.1563409Z  2025-03-14T06:36:52.1563812Z  2025-03-14T06:36:52.1564391Z  2025-03-14T06:36:52.1564919Z  2025-03-14T06:36:52.1565568Z  2025-03-14T06:36:52.1566466Z [18,112 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:52.1567502Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T06:36:52.1568412Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T06:36:52.1569303Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T06:36:52.1570270Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T06:36:52.1571082Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T06:36:52.1572003Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 21s local 2025-03-14T06:36:52.1572965Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local 2025-03-14T06:36:52.1573961Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local ... 2025-03-14T06:36:52.4944500Z 2025-03-14T06:36:52.4945308Z  2025-03-14T06:36:52.4945784Z  2025-03-14T06:36:52.4946225Z  2025-03-14T06:36:52.4946626Z  2025-03-14T06:36:52.4947021Z  2025-03-14T06:36:52.4947428Z  2025-03-14T06:36:52.4947811Z  2025-03-14T06:36:52.4948190Z  2025-03-14T06:36:52.4949151Z [18,113 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:52.4950292Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T06:36:52.4951444Z Compiling llvm/lib/Passes/PassBuilder.cpp; 59s local 2025-03-14T06:36:52.4952409Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T06:36:52.4953433Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T06:36:52.4954304Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T06:36:52.4955254Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2025-03-14T06:36:52.4956261Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local 2025-03-14T06:36:52.4957290Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local ... 2025-03-14T06:36:52.7049660Z 2025-03-14T06:36:52.7050529Z  2025-03-14T06:36:52.7051006Z  2025-03-14T06:36:52.7051646Z  2025-03-14T06:36:52.7052011Z  2025-03-14T06:36:52.7052375Z  2025-03-14T06:36:52.7052738Z  2025-03-14T06:36:52.7053107Z  2025-03-14T06:36:52.7053489Z  2025-03-14T06:36:52.7054409Z [18,116 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:52.7055487Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T06:36:52.7056397Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T06:36:52.7057298Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T06:36:52.7058243Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T06:36:52.7059011Z Compiling stablehlo/dialect/VhloOps.cpp; 40s local 2025-03-14T06:36:52.7060095Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2025-03-14T06:36:52.7060988Z Compiling stablehlo/dialect/StablehloOps.cpp; 21s local 2025-03-14T06:36:52.7061905Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local ... 2025-03-14T06:36:53.0580839Z 2025-03-14T06:36:53.0581659Z  2025-03-14T06:36:53.0582146Z  2025-03-14T06:36:53.0582569Z  2025-03-14T06:36:53.0582966Z  2025-03-14T06:36:53.0583396Z  2025-03-14T06:36:53.0583794Z  2025-03-14T06:36:53.0584180Z  2025-03-14T06:36:53.0584572Z  2025-03-14T06:36:53.0585778Z [18,117 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:53.0586945Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 130s local 2025-03-14T06:36:53.0587877Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T06:36:53.0588860Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T06:36:53.0589928Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 57s local 2025-03-14T06:36:53.0590808Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2025-03-14T06:36:53.0591798Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2025-03-14T06:36:53.0592825Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2025-03-14T06:36:53.0593894Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local ... 2025-03-14T06:36:53.2648431Z 2025-03-14T06:36:53.2649293Z  2025-03-14T06:36:53.2649784Z  2025-03-14T06:36:53.2650198Z  2025-03-14T06:36:53.2650619Z  2025-03-14T06:36:53.2651017Z  2025-03-14T06:36:53.2651395Z  2025-03-14T06:36:53.2651792Z  2025-03-14T06:36:53.2652188Z  2025-03-14T06:36:53.2653121Z [18,119 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:53.2654271Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T06:36:53.2655218Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T06:36:53.2656222Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T06:36:53.2657402Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T06:36:53.2658285Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2025-03-14T06:36:53.2659570Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 22s local 2025-03-14T06:36:53.2660615Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2025-03-14T06:36:53.2661635Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local ... 2025-03-14T06:36:53.5056347Z 2025-03-14T06:36:53.5057140Z  2025-03-14T06:36:53.5057608Z  2025-03-14T06:36:53.5058020Z  2025-03-14T06:36:53.5058419Z  2025-03-14T06:36:53.5058815Z  2025-03-14T06:36:53.5059300Z  2025-03-14T06:36:53.5059820Z  2025-03-14T06:36:53.5060355Z  2025-03-14T06:36:53.5061513Z [18,119 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:53.5062608Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T06:36:53.5063771Z Compiling llvm/lib/Passes/PassBuilder.cpp; 60s local 2025-03-14T06:36:53.5064693Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T06:36:53.5067293Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T06:36:53.5068386Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2025-03-14T06:36:53.5069482Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2025-03-14T06:36:53.5070676Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2025-03-14T06:36:53.5071590Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local ... 2025-03-14T06:36:53.7296113Z 2025-03-14T06:36:53.7296999Z  2025-03-14T06:36:53.7297845Z  2025-03-14T06:36:53.7298248Z  2025-03-14T06:36:53.7298637Z  2025-03-14T06:36:53.7299021Z  2025-03-14T06:36:53.7299410Z  2025-03-14T06:36:53.7299813Z  2025-03-14T06:36:53.7300238Z  2025-03-14T06:36:53.7301173Z [18,122 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:53.7302261Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T06:36:53.7303209Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T06:36:53.7304351Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T06:36:53.7305368Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T06:36:53.7306225Z Compiling stablehlo/dialect/VhloOps.cpp; 41s local 2025-03-14T06:36:53.7307169Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2025-03-14T06:36:53.7308168Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2025-03-14T06:36:53.7309200Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local ... 2025-03-14T06:36:53.9470609Z 2025-03-14T06:36:53.9471428Z  2025-03-14T06:36:53.9471955Z  2025-03-14T06:36:53.9472424Z  2025-03-14T06:36:53.9472872Z  2025-03-14T06:36:53.9473330Z  2025-03-14T06:36:53.9473789Z  2025-03-14T06:36:53.9474229Z  2025-03-14T06:36:53.9474663Z  2025-03-14T06:36:53.9475680Z [18,125 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:53.9476948Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 131s local 2025-03-14T06:36:53.9477988Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T06:36:53.9479065Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T06:36:53.9480238Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 58s local 2025-03-14T06:36:53.9481193Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T06:36:53.9482272Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2025-03-14T06:36:53.9483406Z Compiling stablehlo/dialect/StablehloOps.cpp; 22s local 2025-03-14T06:36:53.9484691Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local ... 2025-03-14T06:36:54.1958060Z 2025-03-14T06:36:54.1958903Z  2025-03-14T06:36:54.1959365Z  2025-03-14T06:36:54.1959765Z  2025-03-14T06:36:54.1960409Z  2025-03-14T06:36:54.1960836Z  2025-03-14T06:36:54.1961240Z  2025-03-14T06:36:54.1961648Z  2025-03-14T06:36:54.1962044Z  2025-03-14T06:36:54.1962959Z [18,126 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:54.1964079Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T06:36:54.1965121Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T06:36:54.1966232Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T06:36:54.1967324Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T06:36:54.1968214Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T06:36:54.1969410Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 23s local 2025-03-14T06:36:54.1970446Z Compiling stablehlo/dialect/StablehloOps.cpp; 23s local 2025-03-14T06:36:54.1971441Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local ... 2025-03-14T06:36:54.5063244Z 2025-03-14T06:36:54.5064057Z  2025-03-14T06:36:54.5064510Z  2025-03-14T06:36:54.5064921Z  2025-03-14T06:36:54.5065665Z  2025-03-14T06:36:54.5066065Z  2025-03-14T06:36:54.5066448Z  2025-03-14T06:36:54.5066800Z  2025-03-14T06:36:54.5067161Z  2025-03-14T06:36:54.5068046Z [18,127 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:54.5069417Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T06:36:54.5070273Z Compiling llvm/lib/Passes/PassBuilder.cpp; 61s local 2025-03-14T06:36:54.5071146Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T06:36:54.5072103Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T06:36:54.5072896Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T06:36:54.5073772Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2025-03-14T06:36:54.5074705Z Compiling stablehlo/dialect/StablehloOps.cpp; 23s local 2025-03-14T06:36:54.5075847Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local ... 2025-03-14T06:36:54.7748220Z 2025-03-14T06:36:54.7749050Z  2025-03-14T06:36:54.7749535Z  2025-03-14T06:36:54.7749965Z  2025-03-14T06:36:54.7750366Z  2025-03-14T06:36:54.7750768Z  2025-03-14T06:36:54.7751183Z  2025-03-14T06:36:54.7751607Z  2025-03-14T06:36:54.7752063Z  2025-03-14T06:36:54.7753059Z [18,128 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:54.7754254Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T06:36:54.7755248Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T06:36:54.7756253Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T06:36:54.7757357Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T06:36:54.7758285Z Compiling stablehlo/dialect/VhloOps.cpp; 42s local 2025-03-14T06:36:54.7759343Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2025-03-14T06:36:54.7760401Z Compiling stablehlo/dialect/StablehloOps.cpp; 23s local 2025-03-14T06:36:54.7761452Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local ... 2025-03-14T06:36:55.1069045Z 2025-03-14T06:36:55.1069935Z  2025-03-14T06:36:55.1070446Z  2025-03-14T06:36:55.1070833Z  2025-03-14T06:36:55.1071236Z  2025-03-14T06:36:55.1071619Z  2025-03-14T06:36:55.1072023Z  2025-03-14T06:36:55.1072391Z  2025-03-14T06:36:55.1072821Z  2025-03-14T06:36:55.1073777Z [18,128 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:55.1074918Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 132s local 2025-03-14T06:36:55.1076068Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T06:36:55.1077075Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T06:36:55.1078153Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 59s local 2025-03-14T06:36:55.1079061Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T06:36:55.1080030Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 24s local 2025-03-14T06:36:55.1080999Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2025-03-14T06:36:55.1082085Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local ... 2025-03-14T06:36:55.4994151Z 2025-03-14T06:36:55.4994965Z  2025-03-14T06:36:55.4995761Z  2025-03-14T06:36:55.4996153Z  2025-03-14T06:36:55.4996562Z  2025-03-14T06:36:55.4996961Z  2025-03-14T06:36:55.4997345Z  2025-03-14T06:36:55.4997740Z  2025-03-14T06:36:55.4998132Z  2025-03-14T06:36:55.4999114Z [18,131 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:55.5000392Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2025-03-14T06:36:55.5001282Z Compiling llvm/lib/Passes/PassBuilder.cpp; 62s local 2025-03-14T06:36:55.5002272Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T06:36:55.5003353Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T06:36:55.5004256Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T06:36:55.5005709Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2025-03-14T06:36:55.5006762Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2025-03-14T06:36:55.5007862Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local ... 2025-03-14T06:36:55.7074201Z 2025-03-14T06:36:55.7075030Z  2025-03-14T06:36:55.7075526Z  2025-03-14T06:36:55.7075936Z  2025-03-14T06:36:55.7076351Z  2025-03-14T06:36:55.7076732Z  2025-03-14T06:36:55.7077112Z  2025-03-14T06:36:55.7077487Z  2025-03-14T06:36:55.7078126Z  2025-03-14T06:36:55.7079114Z [18,132 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:55.7080288Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2025-03-14T06:36:55.7081239Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T06:36:55.7082237Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T06:36:55.7083334Z Compiling mlir/lib/Dialect/Vector/IR/VectorOps.cpp; 60s local 2025-03-14T06:36:55.7084226Z Compiling stablehlo/dialect/VhloOps.cpp; 43s local 2025-03-14T06:36:55.7085404Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2025-03-14T06:36:55.7086467Z Compiling stablehlo/dialect/StablehloOps.cpp; 24s local 2025-03-14T06:36:55.7087560Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local ... 2025-03-14T06:36:56.0337853Z 2025-03-14T06:36:56.0338668Z  2025-03-14T06:36:56.0339178Z  2025-03-14T06:36:56.0339623Z  2025-03-14T06:36:56.0340020Z  2025-03-14T06:36:56.0340425Z  2025-03-14T06:36:56.0340835Z  2025-03-14T06:36:56.0341225Z  2025-03-14T06:36:56.0341577Z  2025-03-14T06:36:56.0342543Z [18,135 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:56.0343641Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 133s local 2025-03-14T06:36:56.0344549Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T06:36:56.0345544Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T06:36:56.0346480Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T06:36:56.0347445Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2025-03-14T06:36:56.0348753Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2025-03-14T06:36:56.0349764Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2025-03-14T06:36:56.0350950Z .../service/memory_space_assignment:memory_space_assignment; 21s local ... 2025-03-14T06:36:56.3079497Z 2025-03-14T06:36:56.3080412Z  2025-03-14T06:36:56.3080901Z  2025-03-14T06:36:56.3081296Z  2025-03-14T06:36:56.3081689Z  2025-03-14T06:36:56.3082088Z  2025-03-14T06:36:56.3082487Z  2025-03-14T06:36:56.3082912Z  2025-03-14T06:36:56.3083296Z  2025-03-14T06:36:56.3084236Z [18,135 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:56.3085924Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T06:36:56.3086892Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T06:36:56.3087850Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T06:36:56.3088746Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T06:36:56.3089717Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 25s local 2025-03-14T06:36:56.3090709Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2025-03-14T06:36:56.3091699Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2025-03-14T06:36:56.3092862Z .../service/memory_space_assignment:memory_space_assignment; 21s local ... 2025-03-14T06:36:56.5082689Z 2025-03-14T06:36:56.5083813Z  2025-03-14T06:36:56.5084293Z  2025-03-14T06:36:56.5084866Z  2025-03-14T06:36:56.5085261Z  2025-03-14T06:36:56.5085665Z  2025-03-14T06:36:56.5086081Z  2025-03-14T06:36:56.5086513Z  2025-03-14T06:36:56.5086911Z  2025-03-14T06:36:56.5087841Z [18,137 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:56.5089003Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T06:36:56.5089954Z Compiling llvm/lib/Passes/PassBuilder.cpp; 63s local 2025-03-14T06:36:56.5091154Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T06:36:56.5092154Z Compiling stablehlo/dialect/VhloOps.cpp; 44s local 2025-03-14T06:36:56.5093140Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2025-03-14T06:36:56.5094164Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2025-03-14T06:36:56.5095161Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T06:36:56.5096295Z .../service/memory_space_assignment:memory_space_assignment; 21s local ... 2025-03-14T06:36:56.9087357Z 2025-03-14T06:36:56.9088209Z  2025-03-14T06:36:56.9088680Z  2025-03-14T06:36:56.9089069Z  2025-03-14T06:36:56.9089494Z  2025-03-14T06:36:56.9089894Z  2025-03-14T06:36:56.9090288Z  2025-03-14T06:36:56.9090686Z  2025-03-14T06:36:56.9091086Z  2025-03-14T06:36:56.9092030Z [18,139 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:56.9093180Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 134s local 2025-03-14T06:36:56.9094114Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T06:36:56.9095124Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T06:36:56.9096088Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2025-03-14T06:36:56.9097088Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2025-03-14T06:36:56.9098125Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local 2025-03-14T06:36:56.9099160Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T06:36:56.9100273Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local ... 2025-03-14T06:36:57.2071705Z 2025-03-14T06:36:57.2072525Z  2025-03-14T06:36:57.2073017Z  2025-03-14T06:36:57.2073716Z  2025-03-14T06:36:57.2074146Z  2025-03-14T06:36:57.2074538Z  2025-03-14T06:36:57.2074960Z  2025-03-14T06:36:57.2075373Z  2025-03-14T06:36:57.2075765Z  2025-03-14T06:36:57.2076682Z [18,141 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:57.2077796Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T06:36:57.2078777Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T06:36:57.2079818Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T06:36:57.2080739Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2025-03-14T06:36:57.2081900Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local 2025-03-14T06:36:57.2082803Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2025-03-14T06:36:57.2083690Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T06:36:57.2084872Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local ... 2025-03-14T06:36:57.5092144Z 2025-03-14T06:36:57.5092912Z  2025-03-14T06:36:57.5093367Z  2025-03-14T06:36:57.5093763Z  2025-03-14T06:36:57.5094128Z  2025-03-14T06:36:57.5094488Z  2025-03-14T06:36:57.5094840Z  2025-03-14T06:36:57.5095209Z  2025-03-14T06:36:57.5095555Z  2025-03-14T06:36:57.5096399Z [18,142 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:57.5097747Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T06:36:57.5098598Z Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local 2025-03-14T06:36:57.5099505Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T06:36:57.5100480Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2025-03-14T06:36:57.5101454Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 27s local 2025-03-14T06:36:57.5102472Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2025-03-14T06:36:57.5103682Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T06:36:57.5104785Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local ... 2025-03-14T06:36:57.7255949Z 2025-03-14T06:36:57.7256776Z  2025-03-14T06:36:57.7257280Z  2025-03-14T06:36:57.7257713Z  2025-03-14T06:36:57.7258132Z  2025-03-14T06:36:57.7258562Z  2025-03-14T06:36:57.7259022Z  2025-03-14T06:36:57.7259446Z  2025-03-14T06:36:57.7259871Z  2025-03-14T06:36:57.7260858Z [18,143 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:57.7262100Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T06:36:57.7263146Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T06:36:57.7264181Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T06:36:57.7265255Z Compiling stablehlo/dialect/VhloOps.cpp; 45s local 2025-03-14T06:36:57.7266533Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local 2025-03-14T06:36:57.7267615Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T06:36:57.7268737Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 17s local 2025-03-14T06:36:57.7269635Z @llvm-project//llvm:CodeGen; 17s local ... 2025-03-14T06:36:58.1097303Z 2025-03-14T06:36:58.1098202Z  2025-03-14T06:36:58.1098686Z  2025-03-14T06:36:58.1099099Z  2025-03-14T06:36:58.1099496Z  2025-03-14T06:36:58.1099895Z  2025-03-14T06:36:58.1100288Z  2025-03-14T06:36:58.1100724Z  2025-03-14T06:36:58.1101125Z  2025-03-14T06:36:58.1102186Z [18,144 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:58.1103598Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 135s local 2025-03-14T06:36:58.1104564Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T06:36:58.1105603Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T06:36:58.1106626Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T06:36:58.1107466Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2025-03-14T06:36:58.1108488Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T06:36:58.1109560Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2025-03-14T06:36:58.1110406Z @llvm-project//llvm:CodeGen; 17s local ... 2025-03-14T06:36:58.5275503Z 2025-03-14T06:36:58.5276362Z  2025-03-14T06:36:58.5277079Z  2025-03-14T06:36:58.5277460Z  2025-03-14T06:36:58.5277846Z  2025-03-14T06:36:58.5278242Z  2025-03-14T06:36:58.5278632Z  2025-03-14T06:36:58.5279090Z  2025-03-14T06:36:58.5279506Z  2025-03-14T06:36:58.5280472Z [18,145 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:58.5281589Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2025-03-14T06:36:58.5282519Z Compiling llvm/lib/Passes/PassBuilder.cpp; 65s local 2025-03-14T06:36:58.5283509Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T06:36:58.5284447Z Compiling stablehlo/dialect/VhloOps.cpp; 46s local 2025-03-14T06:36:58.5285462Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2025-03-14T06:36:58.5286736Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T06:36:58.5287813Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 18s local 2025-03-14T06:36:58.5288697Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:36:58.9104241Z 2025-03-14T06:36:58.9105111Z  2025-03-14T06:36:58.9105577Z  2025-03-14T06:36:58.9105987Z  2025-03-14T06:36:58.9106371Z  2025-03-14T06:36:58.9106804Z  2025-03-14T06:36:58.9107217Z  2025-03-14T06:36:58.9107623Z  2025-03-14T06:36:58.9108030Z  2025-03-14T06:36:58.9109197Z [18,147 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:36:58.9110342Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2025-03-14T06:36:58.9111290Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T06:36:58.9112284Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T06:36:58.9113246Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T06:36:58.9114104Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2025-03-14T06:36:58.9115228Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T06:36:58.9116320Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2025-03-14T06:36:58.9117195Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:36:59.1114359Z 2025-03-14T06:36:59.1115242Z  2025-03-14T06:36:59.1115742Z  2025-03-14T06:36:59.1116169Z  2025-03-14T06:36:59.1116583Z  2025-03-14T06:36:59.1116975Z  2025-03-14T06:36:59.1117332Z  2025-03-14T06:36:59.1117875Z  2025-03-14T06:36:59.1118311Z  2025-03-14T06:36:59.1119306Z [18,149 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:59.1120466Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 136s local 2025-03-14T06:36:59.1121440Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T06:36:59.1122455Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T06:36:59.1123472Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T06:36:59.1124328Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T06:36:59.1125510Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T06:36:59.1126891Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2025-03-14T06:36:59.1127774Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:36:59.5110113Z 2025-03-14T06:36:59.5110954Z  2025-03-14T06:36:59.5111483Z  2025-03-14T06:36:59.5111939Z  2025-03-14T06:36:59.5112354Z  2025-03-14T06:36:59.5112750Z  2025-03-14T06:36:59.5113152Z  2025-03-14T06:36:59.5113518Z  2025-03-14T06:36:59.5113926Z  2025-03-14T06:36:59.5114873Z [18,150 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:36:59.5115997Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T06:36:59.5117195Z Compiling llvm/lib/Passes/PassBuilder.cpp; 66s local 2025-03-14T06:36:59.5118130Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T06:36:59.5119071Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T06:36:59.5119866Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T06:36:59.5120902Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T06:36:59.5132086Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2025-03-14T06:36:59.5133204Z @llvm-project//llvm:CodeGen; 19s local ... 2025-03-14T06:36:59.7355768Z 2025-03-14T06:36:59.7356691Z  2025-03-14T06:36:59.7357193Z  2025-03-14T06:36:59.7357604Z  2025-03-14T06:36:59.7358020Z  2025-03-14T06:36:59.7358753Z  2025-03-14T06:36:59.7359191Z  2025-03-14T06:36:59.7359602Z  2025-03-14T06:36:59.7360025Z  2025-03-14T06:36:59.7361009Z [18,151 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:36:59.7362219Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T06:36:59.7363189Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T06:36:59.7364213Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T06:36:59.7365596Z Compiling stablehlo/dialect/VhloOps.cpp; 47s local 2025-03-14T06:36:59.7366651Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T06:36:59.7367700Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T06:36:59.7368744Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 19s local 2025-03-14T06:36:59.7369594Z @llvm-project//llvm:CodeGen; 19s local ... 2025-03-14T06:37:00.1115088Z 2025-03-14T06:37:00.1115971Z  2025-03-14T06:37:00.1116445Z  2025-03-14T06:37:00.1116874Z  2025-03-14T06:37:00.1117282Z  2025-03-14T06:37:00.1117657Z  2025-03-14T06:37:00.1118090Z  2025-03-14T06:37:00.1118487Z  2025-03-14T06:37:00.1118891Z  2025-03-14T06:37:00.1119856Z [18,152 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:00.1121084Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 137s local 2025-03-14T06:37:00.1122020Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T06:37:00.1123040Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T06:37:00.1123959Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T06:37:00.1124976Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T06:37:00.1125940Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T06:37:00.1127024Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2025-03-14T06:37:00.1127862Z @llvm-project//llvm:CodeGen; 19s local ... 2025-03-14T06:37:00.3133796Z 2025-03-14T06:37:00.3134654Z  2025-03-14T06:37:00.3135178Z  2025-03-14T06:37:00.3135610Z  2025-03-14T06:37:00.3136014Z  2025-03-14T06:37:00.3136425Z  2025-03-14T06:37:00.3136846Z  2025-03-14T06:37:00.3137289Z  2025-03-14T06:37:00.3137730Z  2025-03-14T06:37:00.3138965Z [18,153 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:00.3140186Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2025-03-14T06:37:00.3141084Z Compiling llvm/lib/Passes/PassBuilder.cpp; 67s local 2025-03-14T06:37:00.3142095Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T06:37:00.3143184Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T06:37:00.3144080Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T06:37:00.3145069Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T06:37:00.3146132Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2025-03-14T06:37:00.3147194Z @llvm-project//llvm:CodeGen; 19s local ... 2025-03-14T06:37:00.7120318Z 2025-03-14T06:37:00.7121182Z  2025-03-14T06:37:00.7121670Z  2025-03-14T06:37:00.7122219Z  2025-03-14T06:37:00.7122665Z  2025-03-14T06:37:00.7123085Z  2025-03-14T06:37:00.7123517Z  2025-03-14T06:37:00.7123959Z  2025-03-14T06:37:00.7124398Z  2025-03-14T06:37:00.7125527Z [18,154 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:00.7126780Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2025-03-14T06:37:00.7127750Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T06:37:00.7128778Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T06:37:00.7130011Z Compiling stablehlo/dialect/VhloOps.cpp; 48s local 2025-03-14T06:37:00.7130893Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T06:37:00.7131942Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T06:37:00.7133106Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 20s local 2025-03-14T06:37:00.7133938Z @llvm-project//llvm:CodeGen; 20s local ... 2025-03-14T06:37:00.9123791Z 2025-03-14T06:37:00.9124780Z  2025-03-14T06:37:00.9125291Z  2025-03-14T06:37:00.9125716Z  2025-03-14T06:37:00.9126410Z  2025-03-14T06:37:00.9126821Z  2025-03-14T06:37:00.9127202Z  2025-03-14T06:37:00.9127579Z  2025-03-14T06:37:00.9127958Z  2025-03-14T06:37:00.9128792Z [18,156 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:00.9129979Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 138s local 2025-03-14T06:37:00.9130973Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T06:37:00.9131963Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T06:37:00.9132966Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T06:37:00.9133828Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T06:37:00.9134869Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T06:37:00.9135959Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2025-03-14T06:37:00.9136816Z @llvm-project//llvm:CodeGen; 20s local ... 2025-03-14T06:37:01.3114930Z 2025-03-14T06:37:01.3115763Z  2025-03-14T06:37:01.3116141Z  2025-03-14T06:37:01.3116490Z  2025-03-14T06:37:01.3116827Z  2025-03-14T06:37:01.3117158Z  2025-03-14T06:37:01.3117490Z  2025-03-14T06:37:01.3117817Z  2025-03-14T06:37:01.3118149Z  2025-03-14T06:37:01.3118997Z [18,157 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:01.3119946Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2025-03-14T06:37:01.3120734Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T06:37:01.3121522Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T06:37:01.3122592Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T06:37:01.3123294Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T06:37:01.3124150Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T06:37:01.3125140Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2025-03-14T06:37:01.3125793Z @llvm-project//llvm:CodeGen; 20s local ... 2025-03-14T06:37:01.5129937Z 2025-03-14T06:37:01.5130782Z  2025-03-14T06:37:01.5131239Z  2025-03-14T06:37:01.5131598Z  2025-03-14T06:37:01.5131962Z  2025-03-14T06:37:01.5132329Z  2025-03-14T06:37:01.5132686Z  2025-03-14T06:37:01.5133070Z  2025-03-14T06:37:01.5133425Z  2025-03-14T06:37:01.5134429Z [18,160 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:01.5135736Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2025-03-14T06:37:01.5136558Z Compiling llvm/lib/Passes/PassBuilder.cpp; 68s local 2025-03-14T06:37:01.5137422Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T06:37:01.5138263Z Compiling stablehlo/dialect/VhloOps.cpp; 49s local 2025-03-14T06:37:01.5138988Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T06:37:01.5139885Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T06:37:01.5140837Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 21s local 2025-03-14T06:37:01.5141586Z @llvm-project//llvm:CodeGen; 21s local ... 2025-03-14T06:37:01.9419607Z 2025-03-14T06:37:01.9420444Z  2025-03-14T06:37:01.9420894Z  2025-03-14T06:37:01.9421285Z  2025-03-14T06:37:01.9421682Z  2025-03-14T06:37:01.9422109Z  2025-03-14T06:37:01.9422485Z  2025-03-14T06:37:01.9422838Z  2025-03-14T06:37:01.9423211Z  2025-03-14T06:37:01.9424091Z [18,161 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:01.9425159Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 139s local 2025-03-14T06:37:01.9426246Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T06:37:01.9427127Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T06:37:01.9428026Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T06:37:01.9428823Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T06:37:01.9429781Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T06:37:01.9430806Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T06:37:01.9431575Z @llvm-project//llvm:CodeGen; 21s local ... 2025-03-14T06:37:02.3136438Z 2025-03-14T06:37:02.3137350Z  2025-03-14T06:37:02.3137812Z  2025-03-14T06:37:02.3138234Z  2025-03-14T06:37:02.3138647Z  2025-03-14T06:37:02.3139042Z  2025-03-14T06:37:02.3139480Z  2025-03-14T06:37:02.3139886Z  2025-03-14T06:37:02.3140302Z  2025-03-14T06:37:02.3141243Z [18,161 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:02.3142389Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T06:37:02.3143246Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T06:37:02.3144147Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2025-03-14T06:37:02.3145035Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T06:37:02.3146065Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T06:37:02.3147118Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T06:37:02.3148288Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T06:37:02.3149191Z @llvm-project//llvm:CodeGen; 21s local ... 2025-03-14T06:37:02.5858843Z 2025-03-14T06:37:02.5859687Z  2025-03-14T06:37:02.5860145Z  2025-03-14T06:37:02.5860781Z  2025-03-14T06:37:02.5861122Z  2025-03-14T06:37:02.5861463Z  2025-03-14T06:37:02.5861793Z  2025-03-14T06:37:02.5862122Z  2025-03-14T06:37:02.5862480Z  2025-03-14T06:37:02.5863274Z [18,162 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:02.5864170Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T06:37:02.5864933Z Compiling llvm/lib/Passes/PassBuilder.cpp; 69s local 2025-03-14T06:37:02.5865990Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2025-03-14T06:37:02.5866738Z Compiling stablehlo/dialect/VhloOps.cpp; 50s local 2025-03-14T06:37:02.5867490Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T06:37:02.5868929Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T06:37:02.5870069Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 22s local 2025-03-14T06:37:02.5870952Z @llvm-project//llvm:CodeGen; 22s local ... 2025-03-14T06:37:02.9141361Z 2025-03-14T06:37:02.9142178Z  2025-03-14T06:37:02.9142629Z  2025-03-14T06:37:02.9143025Z  2025-03-14T06:37:02.9143393Z  2025-03-14T06:37:02.9143750Z  2025-03-14T06:37:02.9144111Z  2025-03-14T06:37:02.9144462Z  2025-03-14T06:37:02.9144823Z  2025-03-14T06:37:02.9145672Z [18,162 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:02.9147000Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 140s local 2025-03-14T06:37:02.9147812Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T06:37:02.9148655Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2025-03-14T06:37:02.9149508Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T06:37:02.9150234Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T06:37:02.9151119Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T06:37:02.9152026Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2025-03-14T06:37:02.9152997Z @llvm-project//llvm:CodeGen; 22s local ... 2025-03-14T06:37:03.2743328Z 2025-03-14T06:37:03.2744161Z  2025-03-14T06:37:03.2744591Z  2025-03-14T06:37:03.2744957Z  2025-03-14T06:37:03.2745310Z  2025-03-14T06:37:03.2745669Z  2025-03-14T06:37:03.2746039Z  2025-03-14T06:37:03.2746400Z  2025-03-14T06:37:03.2746788Z  2025-03-14T06:37:03.2747644Z [18,163 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:03.2748674Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T06:37:03.2749548Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T06:37:03.2750463Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T06:37:03.2751380Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T06:37:03.2752206Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T06:37:03.2753179Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T06:37:03.2754227Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2025-03-14T06:37:03.2755054Z @llvm-project//llvm:CodeGen; 22s local ... 2025-03-14T06:37:03.5146665Z 2025-03-14T06:37:03.5147463Z  2025-03-14T06:37:03.5147917Z  2025-03-14T06:37:03.5148341Z  2025-03-14T06:37:03.5148754Z  2025-03-14T06:37:03.5149162Z  2025-03-14T06:37:03.5149580Z  2025-03-14T06:37:03.5149948Z  2025-03-14T06:37:03.5150270Z  2025-03-14T06:37:03.5151047Z [18,163 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:03.5151933Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T06:37:03.5152967Z Compiling llvm/lib/Passes/PassBuilder.cpp; 70s local 2025-03-14T06:37:03.5153857Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T06:37:03.5154642Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T06:37:03.5155298Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T06:37:03.5156122Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T06:37:03.5156971Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2025-03-14T06:37:03.5157642Z @llvm-project//llvm:CodeGen; 23s local ... 2025-03-14T06:37:03.7655373Z 2025-03-14T06:37:03.7656209Z  2025-03-14T06:37:03.7656626Z  2025-03-14T06:37:03.7656962Z  2025-03-14T06:37:03.7657296Z  2025-03-14T06:37:03.7657910Z  2025-03-14T06:37:03.7658236Z  2025-03-14T06:37:03.7658570Z  2025-03-14T06:37:03.7658892Z  2025-03-14T06:37:03.7659673Z [18,165 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:03.7660575Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T06:37:03.7661334Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T06:37:03.7662097Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T06:37:03.7662861Z Compiling stablehlo/dialect/VhloOps.cpp; 51s local 2025-03-14T06:37:03.7663540Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T06:37:03.7664335Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T06:37:03.7665648Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 23s local 2025-03-14T06:37:03.7666319Z @llvm-project//llvm:CodeGen; 23s local ... 2025-03-14T06:37:04.1151633Z 2025-03-14T06:37:04.1152497Z  2025-03-14T06:37:04.1152945Z  2025-03-14T06:37:04.1153304Z  2025-03-14T06:37:04.1153652Z  2025-03-14T06:37:04.1153998Z  2025-03-14T06:37:04.1154345Z  2025-03-14T06:37:04.1154730Z  2025-03-14T06:37:04.1155081Z  2025-03-14T06:37:04.1156139Z [18,165 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:04.1157030Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 141s local 2025-03-14T06:37:04.1157806Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T06:37:04.1158547Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T06:37:04.1159312Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T06:37:04.1159994Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2025-03-14T06:37:04.1160793Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T06:37:04.1161667Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T06:37:04.1162338Z @llvm-project//llvm:CodeGen; 23s local ... 2025-03-14T06:37:04.3154930Z 2025-03-14T06:37:04.3155728Z  2025-03-14T06:37:04.3156173Z  2025-03-14T06:37:04.3156518Z  2025-03-14T06:37:04.3156848Z  2025-03-14T06:37:04.3157353Z  2025-03-14T06:37:04.3157694Z  2025-03-14T06:37:04.3158051Z  2025-03-14T06:37:04.3158391Z  2025-03-14T06:37:04.3159222Z [18,166 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:04.3160160Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2025-03-14T06:37:04.3160943Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T06:37:04.3161776Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T06:37:04.3162586Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T06:37:04.3163302Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2025-03-14T06:37:04.3164122Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T06:37:04.3165144Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T06:37:04.3166373Z @llvm-project//llvm:CodeGen; 23s local ... 2025-03-14T06:37:04.5608551Z 2025-03-14T06:37:04.5609434Z  2025-03-14T06:37:04.5609906Z  2025-03-14T06:37:04.5610292Z  2025-03-14T06:37:04.5610679Z  2025-03-14T06:37:04.5611053Z  2025-03-14T06:37:04.5611428Z  2025-03-14T06:37:04.5611801Z  2025-03-14T06:37:04.5612174Z  2025-03-14T06:37:04.5613021Z [18,169 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:04.5614001Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2025-03-14T06:37:04.5614795Z Compiling llvm/lib/Passes/PassBuilder.cpp; 71s local 2025-03-14T06:37:04.5615925Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T06:37:04.5616732Z Compiling stablehlo/dialect/VhloOps.cpp; 52s local 2025-03-14T06:37:04.5617440Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2025-03-14T06:37:04.5618290Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T06:37:04.5619188Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 24s local 2025-03-14T06:37:04.5619886Z @llvm-project//llvm:CodeGen; 24s local ... 2025-03-14T06:37:04.9160053Z 2025-03-14T06:37:04.9160870Z  2025-03-14T06:37:04.9161282Z  2025-03-14T06:37:04.9161634Z  2025-03-14T06:37:04.9161979Z  2025-03-14T06:37:04.9162319Z  2025-03-14T06:37:04.9162653Z  2025-03-14T06:37:04.9163247Z  2025-03-14T06:37:04.9163582Z  2025-03-14T06:37:04.9164409Z [18,170 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:04.9165661Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 142s local 2025-03-14T06:37:04.9166412Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T06:37:04.9167178Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T06:37:04.9167937Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T06:37:04.9168646Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2025-03-14T06:37:04.9169639Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T06:37:04.9170500Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2025-03-14T06:37:04.9171162Z @llvm-project//llvm:CodeGen; 24s local ... 2025-03-14T06:37:05.5726790Z 2025-03-14T06:37:05.5727601Z  2025-03-14T06:37:05.5728063Z  2025-03-14T06:37:05.5728421Z  2025-03-14T06:37:05.5728766Z  2025-03-14T06:37:05.5729113Z  2025-03-14T06:37:05.5729466Z  2025-03-14T06:37:05.5729812Z  2025-03-14T06:37:05.5730167Z  2025-03-14T06:37:05.5731011Z [18,171 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:05.5731989Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T06:37:05.5732813Z Compiling llvm/lib/Passes/PassBuilder.cpp; 72s local 2025-03-14T06:37:05.5733644Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T06:37:05.5734488Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T06:37:05.5735192Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T06:37:05.5736072Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T06:37:05.5736973Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 25s local 2025-03-14T06:37:05.5737685Z @llvm-project//llvm:CodeGen; 25s local ... 2025-03-14T06:37:05.8142271Z 2025-03-14T06:37:05.8143238Z  2025-03-14T06:37:05.8143659Z  2025-03-14T06:37:05.8144013Z  2025-03-14T06:37:05.8144394Z  2025-03-14T06:37:05.8144726Z  2025-03-14T06:37:05.8145071Z  2025-03-14T06:37:05.8145414Z  2025-03-14T06:37:05.8145756Z  2025-03-14T06:37:05.8146860Z [18,173 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:05.8147791Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T06:37:05.8148556Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T06:37:05.8149325Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T06:37:05.8150106Z Compiling stablehlo/dialect/VhloOps.cpp; 53s local 2025-03-14T06:37:05.8150789Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T06:37:05.8151610Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T06:37:05.8152456Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2025-03-14T06:37:05.8153110Z @llvm-project//llvm:CodeGen; 25s local ... 2025-03-14T06:37:06.1169296Z 2025-03-14T06:37:06.1172633Z  2025-03-14T06:37:06.1173136Z  2025-03-14T06:37:06.1173472Z  2025-03-14T06:37:06.1173799Z  2025-03-14T06:37:06.1174152Z  2025-03-14T06:37:06.1174521Z  2025-03-14T06:37:06.1174839Z  2025-03-14T06:37:06.1175172Z  2025-03-14T06:37:06.1175985Z [18,173 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:06.1176916Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 143s local 2025-03-14T06:37:06.1177672Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T06:37:06.1178449Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T06:37:06.1179481Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2025-03-14T06:37:06.1180147Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T06:37:06.1180944Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T06:37:06.1181790Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2025-03-14T06:37:06.1182444Z @llvm-project//llvm:CodeGen; 25s local ... 2025-03-14T06:37:06.3171968Z 2025-03-14T06:37:06.3172838Z  2025-03-14T06:37:06.3173269Z  2025-03-14T06:37:06.3173581Z  2025-03-14T06:37:06.3173898Z  2025-03-14T06:37:06.3174215Z  2025-03-14T06:37:06.3174755Z  2025-03-14T06:37:06.3175081Z  2025-03-14T06:37:06.3175400Z  2025-03-14T06:37:06.3176160Z [18,174 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:06.3177058Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2025-03-14T06:37:06.3177820Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T06:37:06.3178596Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T06:37:06.3179353Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2025-03-14T06:37:06.3180018Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T06:37:06.3180808Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T06:37:06.3181644Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2025-03-14T06:37:06.3182297Z @llvm-project//llvm:CodeGen; 25s local ... 2025-03-14T06:37:06.5516197Z 2025-03-14T06:37:06.5517033Z  2025-03-14T06:37:06.5517449Z  2025-03-14T06:37:06.5517792Z  2025-03-14T06:37:06.5518124Z  2025-03-14T06:37:06.5518443Z  2025-03-14T06:37:06.5518766Z  2025-03-14T06:37:06.5519114Z  2025-03-14T06:37:06.5519455Z  2025-03-14T06:37:06.5520260Z [18,175 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:06.5521258Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2025-03-14T06:37:06.5522075Z Compiling llvm/lib/Passes/PassBuilder.cpp; 73s local 2025-03-14T06:37:06.5522899Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T06:37:06.5523699Z Compiling stablehlo/dialect/VhloOps.cpp; 54s local 2025-03-14T06:37:06.5524844Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T06:37:06.5525654Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T06:37:06.5526474Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 26s local 2025-03-14T06:37:06.5527100Z @llvm-project//llvm:CodeGen; 26s local ... 2025-03-14T06:37:06.9177687Z 2025-03-14T06:37:06.9178511Z  2025-03-14T06:37:06.9178942Z  2025-03-14T06:37:06.9179315Z  2025-03-14T06:37:06.9179672Z  2025-03-14T06:37:06.9180033Z  2025-03-14T06:37:06.9180417Z  2025-03-14T06:37:06.9180767Z  2025-03-14T06:37:06.9181111Z  2025-03-14T06:37:06.9181944Z [18,176 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:06.9183218Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 144s local 2025-03-14T06:37:06.9184122Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T06:37:06.9184930Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T06:37:06.9185704Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2025-03-14T06:37:06.9186383Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T06:37:06.9187200Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T06:37:06.9187985Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T06:37:06.9188693Z @llvm-project//llvm:CodeGen; 26s local ... 2025-03-14T06:37:07.2149232Z 2025-03-14T06:37:07.2150100Z  2025-03-14T06:37:07.2150801Z  2025-03-14T06:37:07.2151168Z  2025-03-14T06:37:07.2151524Z  2025-03-14T06:37:07.2151876Z  2025-03-14T06:37:07.2152242Z  2025-03-14T06:37:07.2152614Z  2025-03-14T06:37:07.2152994Z  2025-03-14T06:37:07.2153820Z [18,177 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:07.2154827Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2025-03-14T06:37:07.2155639Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T06:37:07.2156654Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2025-03-14T06:37:07.2157499Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2025-03-14T06:37:07.2158236Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2025-03-14T06:37:07.2159237Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T06:37:07.2160174Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T06:37:07.2160891Z @llvm-project//llvm:IPO; 25s local ... 2025-03-14T06:37:07.5183166Z 2025-03-14T06:37:07.5183983Z  2025-03-14T06:37:07.5184421Z  2025-03-14T06:37:07.5184817Z  2025-03-14T06:37:07.5185168Z  2025-03-14T06:37:07.5185526Z  2025-03-14T06:37:07.5185879Z  2025-03-14T06:37:07.5186233Z  2025-03-14T06:37:07.5186582Z  2025-03-14T06:37:07.5187448Z [18,179 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:07.5188452Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 145s local 2025-03-14T06:37:07.5189260Z Compiling llvm/lib/Passes/PassBuilder.cpp; 74s local 2025-03-14T06:37:07.5190097Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2025-03-14T06:37:07.5190936Z Compiling stablehlo/dialect/VhloOps.cpp; 55s local 2025-03-14T06:37:07.5191638Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2025-03-14T06:37:07.5192628Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T06:37:07.5193506Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 27s local 2025-03-14T06:37:07.5194180Z @llvm-project//llvm:IPO; 25s local ... 2025-03-14T06:37:08.2527109Z 2025-03-14T06:37:08.2527969Z  2025-03-14T06:37:08.2528415Z  2025-03-14T06:37:08.2528829Z  2025-03-14T06:37:08.2529235Z  2025-03-14T06:37:08.2529615Z  2025-03-14T06:37:08.2530259Z  2025-03-14T06:37:08.2530661Z  2025-03-14T06:37:08.2531081Z  2025-03-14T06:37:08.2532050Z [18,180 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:08.2533341Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T06:37:08.2534332Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2025-03-14T06:37:08.2535179Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2025-03-14T06:37:08.2536047Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2025-03-14T06:37:08.2537083Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T06:37:08.2538180Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T06:37:08.2539118Z @llvm-project//llvm:IPO; 26s local 2025-03-14T06:37:08.2539806Z Compiling stablehlo/dialect/ChloOps.cpp; 24s local ... 2025-03-14T06:37:08.5189552Z 2025-03-14T06:37:08.5190368Z  2025-03-14T06:37:08.5190807Z  2025-03-14T06:37:08.5191222Z  2025-03-14T06:37:08.5191612Z  2025-03-14T06:37:08.5191978Z  2025-03-14T06:37:08.5192420Z  2025-03-14T06:37:08.5192848Z  2025-03-14T06:37:08.5193254Z  2025-03-14T06:37:08.5194075Z [18,180 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:08.5195147Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T06:37:08.5196407Z Compiling llvm/lib/Passes/PassBuilder.cpp; 75s local 2025-03-14T06:37:08.5197138Z Compiling stablehlo/dialect/VhloOps.cpp; 56s local 2025-03-14T06:37:08.5197883Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2025-03-14T06:37:08.5198798Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T06:37:08.5199820Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 28s local 2025-03-14T06:37:08.5200551Z @llvm-project//llvm:IPO; 26s local 2025-03-14T06:37:08.5201213Z Compiling stablehlo/dialect/ChloOps.cpp; 24s local ... 2025-03-14T06:37:09.0703211Z 2025-03-14T06:37:09.0703993Z  2025-03-14T06:37:09.0704659Z  2025-03-14T06:37:09.0705003Z  2025-03-14T06:37:09.0705325Z  2025-03-14T06:37:09.0705646Z  2025-03-14T06:37:09.0705973Z  2025-03-14T06:37:09.0706279Z  2025-03-14T06:37:09.0706597Z  2025-03-14T06:37:09.0707368Z [18,181 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:09.0708291Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 146s local 2025-03-14T06:37:09.0709029Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T06:37:09.0709667Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T06:37:09.0710316Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2025-03-14T06:37:09.0711116Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T06:37:09.0711976Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T06:37:09.0712594Z @llvm-project//llvm:IPO; 27s local 2025-03-14T06:37:09.0713175Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local ... 2025-03-14T06:37:09.3195715Z 2025-03-14T06:37:09.3196494Z  2025-03-14T06:37:09.3196905Z  2025-03-14T06:37:09.3197253Z  2025-03-14T06:37:09.3197588Z  2025-03-14T06:37:09.3197919Z  2025-03-14T06:37:09.3198246Z  2025-03-14T06:37:09.3198610Z  2025-03-14T06:37:09.3198924Z  2025-03-14T06:37:09.3199716Z [18,181 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:09.3200623Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T06:37:09.3201392Z Compiling llvm/lib/Passes/PassBuilder.cpp; 76s local 2025-03-14T06:37:09.3202027Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T06:37:09.3202935Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2025-03-14T06:37:09.3203738Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T06:37:09.3204730Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T06:37:09.3205366Z @llvm-project//llvm:IPO; 27s local 2025-03-14T06:37:09.3206072Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local ... 2025-03-14T06:37:09.6777628Z 2025-03-14T06:37:09.6778421Z  2025-03-14T06:37:09.6778838Z  2025-03-14T06:37:09.6779216Z  2025-03-14T06:37:09.6779552Z  2025-03-14T06:37:09.6779883Z  2025-03-14T06:37:09.6780227Z  2025-03-14T06:37:09.6780570Z  2025-03-14T06:37:09.6780919Z  2025-03-14T06:37:09.6782064Z [18,183 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:09.6783046Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T06:37:09.6783867Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T06:37:09.6784537Z Compiling stablehlo/dialect/VhloOps.cpp; 57s local 2025-03-14T06:37:09.6785277Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2025-03-14T06:37:09.6786127Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2025-03-14T06:37:09.6787049Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 29s local 2025-03-14T06:37:09.6787771Z @llvm-project//llvm:IPO; 27s local 2025-03-14T06:37:09.6788407Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local ... 2025-03-14T06:37:09.9201170Z 2025-03-14T06:37:09.9202026Z  2025-03-14T06:37:09.9202465Z  2025-03-14T06:37:09.9202845Z  2025-03-14T06:37:09.9203225Z  2025-03-14T06:37:09.9203640Z  2025-03-14T06:37:09.9203988Z  2025-03-14T06:37:09.9204360Z  2025-03-14T06:37:09.9204871Z  2025-03-14T06:37:09.9205748Z [18,186 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:09.9206790Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 147s local 2025-03-14T06:37:09.9207918Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T06:37:09.9208656Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2025-03-14T06:37:09.9209404Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2025-03-14T06:37:09.9210205Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T06:37:09.9210920Z @llvm-project//llvm:IPO; 28s local 2025-03-14T06:37:09.9211550Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T06:37:09.9212315Z Compiling stablehlo/dialect/StablehloOps.cpp; 25s local ... 2025-03-14T06:37:10.1206232Z 2025-03-14T06:37:10.1207054Z  2025-03-14T06:37:10.1207493Z  2025-03-14T06:37:10.1208007Z  2025-03-14T06:37:10.1208608Z  2025-03-14T06:37:10.1209102Z  2025-03-14T06:37:10.1209608Z  2025-03-14T06:37:10.1210076Z  2025-03-14T06:37:10.1210510Z  2025-03-14T06:37:10.1211453Z [18,187 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:10.1212460Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T06:37:10.1213234Z Compiling llvm/lib/Passes/PassBuilder.cpp; 77s local 2025-03-14T06:37:10.1213921Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2025-03-14T06:37:10.1214634Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T06:37:10.1215394Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T06:37:10.1216068Z @llvm-project//llvm:IPO; 28s local 2025-03-14T06:37:10.1216627Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T06:37:10.1217314Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local ... 2025-03-14T06:37:10.6320866Z 2025-03-14T06:37:10.6321686Z  2025-03-14T06:37:10.6322084Z  2025-03-14T06:37:10.6322415Z  2025-03-14T06:37:10.6322730Z  2025-03-14T06:37:10.6323327Z  2025-03-14T06:37:10.6323657Z  2025-03-14T06:37:10.6323983Z  2025-03-14T06:37:10.6324309Z  2025-03-14T06:37:10.6325251Z [18,188 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:10.6326152Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T06:37:10.6326918Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T06:37:10.6327584Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2025-03-14T06:37:10.6328270Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T06:37:10.6329004Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 30s local 2025-03-14T06:37:10.6329988Z @llvm-project//llvm:IPO; 28s local 2025-03-14T06:37:10.6330573Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T06:37:10.6331294Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local ... 2025-03-14T06:37:10.8349644Z 2025-03-14T06:37:10.8350529Z  2025-03-14T06:37:10.8350948Z  2025-03-14T06:37:10.8351315Z  2025-03-14T06:37:10.8351673Z  2025-03-14T06:37:10.8352035Z  2025-03-14T06:37:10.8352391Z  2025-03-14T06:37:10.8352740Z  2025-03-14T06:37:10.8353082Z  2025-03-14T06:37:10.8353920Z [18,190 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:10.8354879Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 148s local 2025-03-14T06:37:10.8355891Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T06:37:10.8356685Z Compiling stablehlo/dialect/VhloOps.cpp; 58s local 2025-03-14T06:37:10.8357376Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T06:37:10.8358143Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T06:37:10.8358804Z @llvm-project//llvm:IPO; 29s local 2025-03-14T06:37:10.8359368Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T06:37:10.8360076Z Compiling stablehlo/dialect/StablehloOps.cpp; 26s local ... 2025-03-14T06:37:11.1212079Z 2025-03-14T06:37:11.1212878Z  2025-03-14T06:37:11.1213585Z  2025-03-14T06:37:11.1213938Z  2025-03-14T06:37:11.1214247Z  2025-03-14T06:37:11.1214572Z  2025-03-14T06:37:11.1214895Z  2025-03-14T06:37:11.1215226Z  2025-03-14T06:37:11.1215550Z  2025-03-14T06:37:11.1216321Z [18,190 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:11.1217229Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T06:37:11.1217977Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T06:37:11.1218623Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2025-03-14T06:37:11.1219291Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T06:37:11.1220014Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T06:37:11.1220670Z @llvm-project//llvm:IPO; 29s local 2025-03-14T06:37:11.1221221Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T06:37:11.1221911Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local ... 2025-03-14T06:37:11.3216345Z 2025-03-14T06:37:11.3217194Z  2025-03-14T06:37:11.3217679Z  2025-03-14T06:37:11.3218091Z  2025-03-14T06:37:11.3218512Z  2025-03-14T06:37:11.3218954Z  2025-03-14T06:37:11.3219401Z  2025-03-14T06:37:11.3219845Z  2025-03-14T06:37:11.3220312Z  2025-03-14T06:37:11.3221344Z [18,192 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:11.3222609Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T06:37:11.3223681Z Compiling llvm/lib/Passes/PassBuilder.cpp; 78s local 2025-03-14T06:37:11.3224581Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2025-03-14T06:37:11.3225748Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T06:37:11.3226782Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T06:37:11.3227769Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T06:37:11.3228653Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2025-03-14T06:37:11.3229796Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local ... 2025-03-14T06:37:11.7220094Z 2025-03-14T06:37:11.7220935Z  2025-03-14T06:37:11.7221404Z  2025-03-14T06:37:11.7221838Z  2025-03-14T06:37:11.7222258Z  2025-03-14T06:37:11.7222657Z  2025-03-14T06:37:11.7223051Z  2025-03-14T06:37:11.7223454Z  2025-03-14T06:37:11.7223858Z  2025-03-14T06:37:11.7225098Z [18,193 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:11.7226261Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 149s local 2025-03-14T06:37:11.7227345Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T06:37:11.7228143Z Compiling stablehlo/dialect/VhloOps.cpp; 59s local 2025-03-14T06:37:11.7229014Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T06:37:11.7229948Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 31s local 2025-03-14T06:37:11.7230853Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T06:37:11.7231695Z Compiling stablehlo/dialect/StablehloOps.cpp; 27s local 2025-03-14T06:37:11.7232744Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 21s local ... 2025-03-14T06:37:12.1191792Z 2025-03-14T06:37:12.1192658Z  2025-03-14T06:37:12.1193068Z  2025-03-14T06:37:12.1193390Z  2025-03-14T06:37:12.1193703Z  2025-03-14T06:37:12.1194061Z  2025-03-14T06:37:12.1194375Z  2025-03-14T06:37:12.1194688Z  2025-03-14T06:37:12.1195006Z  2025-03-14T06:37:12.1195799Z [18,194 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:12.1196722Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T06:37:12.1197741Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T06:37:12.1198390Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2025-03-14T06:37:12.1199050Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T06:37:12.1199759Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T06:37:12.1200422Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T06:37:12.1201077Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T06:37:12.1201878Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local ... 2025-03-14T06:37:12.3224981Z 2025-03-14T06:37:12.3225835Z  2025-03-14T06:37:12.3226245Z  2025-03-14T06:37:12.3226596Z  2025-03-14T06:37:12.3227043Z  2025-03-14T06:37:12.3227367Z  2025-03-14T06:37:12.3227693Z  2025-03-14T06:37:12.3228054Z  2025-03-14T06:37:12.3228377Z  2025-03-14T06:37:12.3229183Z [18,194 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:12.3230046Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T06:37:12.3230762Z Compiling llvm/lib/Passes/PassBuilder.cpp; 79s local 2025-03-14T06:37:12.3231371Z Compiling stablehlo/dialect/VhloOps.cpp; 60s local 2025-03-14T06:37:12.3232029Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T06:37:12.3232749Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 32s local 2025-03-14T06:37:12.3233427Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T06:37:12.3234084Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T06:37:12.3234886Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 22s local ... 2025-03-14T06:37:12.8906016Z 2025-03-14T06:37:12.8906819Z  2025-03-14T06:37:12.8907474Z  2025-03-14T06:37:12.8907824Z  2025-03-14T06:37:12.8908154Z  2025-03-14T06:37:12.8908491Z  2025-03-14T06:37:12.8908828Z  2025-03-14T06:37:12.8909173Z  2025-03-14T06:37:12.8909511Z  2025-03-14T06:37:12.8910288Z [18,195 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:12.8911236Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 150s local 2025-03-14T06:37:12.8912010Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T06:37:12.8912701Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T06:37:12.8913424Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T06:37:12.8914415Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T06:37:12.8915204Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T06:37:12.8915961Z Compiling stablehlo/dialect/StablehloOps.cpp; 28s local 2025-03-14T06:37:12.8916905Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local ... 2025-03-14T06:37:13.1231296Z 2025-03-14T06:37:13.1232168Z  2025-03-14T06:37:13.1232676Z  2025-03-14T06:37:13.1233097Z  2025-03-14T06:37:13.1233512Z  2025-03-14T06:37:13.1233893Z  2025-03-14T06:37:13.1234291Z  2025-03-14T06:37:13.1234679Z  2025-03-14T06:37:13.1235077Z  2025-03-14T06:37:13.1235978Z [18,199 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:37:13.1237315Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T06:37:13.1238210Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T06:37:13.1239089Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T06:37:13.1239831Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2025-03-14T06:37:13.1240595Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T06:37:13.1241372Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T06:37:13.1242064Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T06:37:13.1243204Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local ... 2025-03-14T06:37:13.3234647Z 2025-03-14T06:37:13.3235455Z  2025-03-14T06:37:13.3235942Z  2025-03-14T06:37:13.3236357Z  2025-03-14T06:37:13.3236778Z  2025-03-14T06:37:13.3237197Z  2025-03-14T06:37:13.3237612Z  2025-03-14T06:37:13.3238023Z  2025-03-14T06:37:13.3238406Z  2025-03-14T06:37:13.3239381Z [18,199 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:13.3240475Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T06:37:13.3241473Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T06:37:13.3242426Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T06:37:13.3243260Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2025-03-14T06:37:13.3244183Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T06:37:13.3245243Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T06:37:13.3246136Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T06:37:13.3247205Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local ... 2025-03-14T06:37:13.5330396Z 2025-03-14T06:37:13.5340578Z  2025-03-14T06:37:13.5341414Z  2025-03-14T06:37:13.5341845Z  2025-03-14T06:37:13.5342231Z  2025-03-14T06:37:13.5342612Z  2025-03-14T06:37:13.5342961Z  2025-03-14T06:37:13.5343369Z  2025-03-14T06:37:13.5343769Z  2025-03-14T06:37:13.5344741Z [18,201 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:13.5345920Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T06:37:13.5347227Z Compiling llvm/lib/Passes/PassBuilder.cpp; 80s local 2025-03-14T06:37:13.5348049Z Compiling stablehlo/dialect/VhloOps.cpp; 61s local 2025-03-14T06:37:13.5348904Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2025-03-14T06:37:13.5349736Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 33s local 2025-03-14T06:37:13.5350676Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T06:37:13.5351485Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T06:37:13.5352408Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 23s local ... 2025-03-14T06:37:13.9240803Z 2025-03-14T06:37:13.9241648Z  2025-03-14T06:37:13.9242162Z  2025-03-14T06:37:13.9242613Z  2025-03-14T06:37:13.9243322Z  2025-03-14T06:37:13.9243708Z  2025-03-14T06:37:13.9244110Z  2025-03-14T06:37:13.9244676Z  2025-03-14T06:37:13.9245102Z  2025-03-14T06:37:13.9246134Z [18,201 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:13.9247384Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 151s local 2025-03-14T06:37:13.9248400Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T06:37:13.9249250Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T06:37:13.9250105Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2025-03-14T06:37:13.9251063Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T06:37:13.9252005Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T06:37:13.9253109Z Compiling stablehlo/dialect/StablehloOps.cpp; 29s local 2025-03-14T06:37:13.9254254Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local ... 2025-03-14T06:37:14.1243848Z 2025-03-14T06:37:14.1244821Z  2025-03-14T06:37:14.1245410Z  2025-03-14T06:37:14.1245784Z  2025-03-14T06:37:14.1246169Z  2025-03-14T06:37:14.1246562Z  2025-03-14T06:37:14.1246932Z  2025-03-14T06:37:14.1247348Z  2025-03-14T06:37:14.1247702Z  2025-03-14T06:37:14.1248875Z [18,203 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:14.1249976Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T06:37:14.1250890Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T06:37:14.1251666Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T06:37:14.1252530Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T06:37:14.1253432Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T06:37:14.1254273Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T06:37:14.1255077Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T06:37:14.1256076Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local ... 2025-03-14T06:37:14.5248638Z 2025-03-14T06:37:14.5249456Z  2025-03-14T06:37:14.5249995Z  2025-03-14T06:37:14.5250428Z  2025-03-14T06:37:14.5250854Z  2025-03-14T06:37:14.5251275Z  2025-03-14T06:37:14.5251695Z  2025-03-14T06:37:14.5252090Z  2025-03-14T06:37:14.5252488Z  2025-03-14T06:37:14.5253502Z [18,205 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:14.5254704Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T06:37:14.5255717Z Compiling llvm/lib/Passes/PassBuilder.cpp; 81s local 2025-03-14T06:37:14.5256583Z Compiling stablehlo/dialect/VhloOps.cpp; 62s local 2025-03-14T06:37:14.5257428Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T06:37:14.5258417Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 34s local 2025-03-14T06:37:14.5259338Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T06:37:14.5260213Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T06:37:14.5261517Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 24s local ... 2025-03-14T06:37:14.9252217Z 2025-03-14T06:37:14.9253091Z  2025-03-14T06:37:14.9253618Z  2025-03-14T06:37:14.9254018Z  2025-03-14T06:37:14.9254444Z  2025-03-14T06:37:14.9254850Z  2025-03-14T06:37:14.9255253Z  2025-03-14T06:37:14.9255672Z  2025-03-14T06:37:14.9256069Z  2025-03-14T06:37:14.9257025Z [18,208 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:14.9258217Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 152s local 2025-03-14T06:37:14.9259226Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T06:37:14.9260302Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T06:37:14.9261121Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T06:37:14.9262102Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2025-03-14T06:37:14.9263057Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T06:37:14.9263942Z Compiling stablehlo/dialect/StablehloOps.cpp; 30s local 2025-03-14T06:37:14.9265021Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local ... 2025-03-14T06:37:15.1255658Z 2025-03-14T06:37:15.1256540Z  2025-03-14T06:37:15.1257028Z  2025-03-14T06:37:15.1257465Z  2025-03-14T06:37:15.1257848Z  2025-03-14T06:37:15.1258293Z  2025-03-14T06:37:15.1258679Z  2025-03-14T06:37:15.1259434Z  2025-03-14T06:37:15.1259861Z  2025-03-14T06:37:15.1260822Z [18,209 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:15.1262042Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T06:37:15.1263044Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T06:37:15.1263898Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T06:37:15.1264797Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2025-03-14T06:37:15.1266324Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2025-03-14T06:37:15.1267285Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T06:37:15.1268119Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T06:37:15.1269322Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local ... 2025-03-14T06:37:15.4620378Z 2025-03-14T06:37:15.4621193Z  2025-03-14T06:37:15.4621721Z  2025-03-14T06:37:15.4622124Z  2025-03-14T06:37:15.4622531Z  2025-03-14T06:37:15.4622941Z  2025-03-14T06:37:15.4623347Z  2025-03-14T06:37:15.4623762Z  2025-03-14T06:37:15.4624314Z  2025-03-14T06:37:15.4625343Z [18,211 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:15.4626511Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T06:37:15.4627504Z Compiling llvm/lib/Passes/PassBuilder.cpp; 82s local 2025-03-14T06:37:15.4628367Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T06:37:15.4629245Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2025-03-14T06:37:15.4630238Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2025-03-14T06:37:15.4631181Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T06:37:15.4632090Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T06:37:15.4633200Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 25s local ... 2025-03-14T06:37:15.7260700Z 2025-03-14T06:37:15.7261556Z  2025-03-14T06:37:15.7262036Z  2025-03-14T06:37:15.7262514Z  2025-03-14T06:37:15.7262945Z  2025-03-14T06:37:15.7263358Z  2025-03-14T06:37:15.7263778Z  2025-03-14T06:37:15.7264186Z  2025-03-14T06:37:15.7264577Z  2025-03-14T06:37:15.7266196Z [18,212 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:15.7267373Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 153s local 2025-03-14T06:37:15.7268367Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T06:37:15.7269303Z Compiling stablehlo/dialect/VhloOps.cpp; 63s local 2025-03-14T06:37:15.7270151Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2025-03-14T06:37:15.7271062Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 35s local 2025-03-14T06:37:15.7271972Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T06:37:15.7272863Z Compiling stablehlo/dialect/StablehloOps.cpp; 31s local 2025-03-14T06:37:15.7273953Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local ... 2025-03-14T06:37:16.1722473Z 2025-03-14T06:37:16.1723298Z  2025-03-14T06:37:16.1723806Z  2025-03-14T06:37:16.1724228Z  2025-03-14T06:37:16.1724800Z  2025-03-14T06:37:16.1725225Z  2025-03-14T06:37:16.1725688Z  2025-03-14T06:37:16.1726108Z  2025-03-14T06:37:16.1726525Z  2025-03-14T06:37:16.1727500Z [18,213 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:16.1728653Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T06:37:16.1729617Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T06:37:16.1730441Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2025-03-14T06:37:16.1731576Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T06:37:16.1732509Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T06:37:16.1733369Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T06:37:16.1734221Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T06:37:16.1735268Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local ... 2025-03-14T06:37:16.5266619Z 2025-03-14T06:37:16.5267486Z  2025-03-14T06:37:16.5267987Z  2025-03-14T06:37:16.5268388Z  2025-03-14T06:37:16.5268796Z  2025-03-14T06:37:16.5269189Z  2025-03-14T06:37:16.5269838Z  2025-03-14T06:37:16.5270255Z  2025-03-14T06:37:16.5270644Z  2025-03-14T06:37:16.5271603Z [18,214 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:16.5272744Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T06:37:16.5273576Z Compiling llvm/lib/Passes/PassBuilder.cpp; 83s local 2025-03-14T06:37:16.5274260Z Compiling stablehlo/dialect/VhloOps.cpp; 64s local 2025-03-14T06:37:16.5275077Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T06:37:16.5275932Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 36s local 2025-03-14T06:37:16.5276752Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T06:37:16.5277518Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T06:37:16.5278594Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 26s local ... 2025-03-14T06:37:16.9268026Z 2025-03-14T06:37:16.9269001Z  2025-03-14T06:37:16.9269552Z  2025-03-14T06:37:16.9270001Z  2025-03-14T06:37:16.9270447Z  2025-03-14T06:37:16.9270823Z  2025-03-14T06:37:16.9271174Z  2025-03-14T06:37:16.9271553Z  2025-03-14T06:37:16.9271956Z  2025-03-14T06:37:16.9272893Z [18,215 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:37:16.9274011Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 154s local 2025-03-14T06:37:16.9274894Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T06:37:16.9275690Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T06:37:16.9276576Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T06:37:16.9277693Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2025-03-14T06:37:16.9278462Z Compiling stablehlo/dialect/StablehloOps.cpp; 32s local 2025-03-14T06:37:16.9279393Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2025-03-14T06:37:16.9280439Z Compiling xla/service/buffer_assignment.cc; 20s local ... 2025-03-14T06:37:17.1271182Z 2025-03-14T06:37:17.1272060Z  2025-03-14T06:37:17.1272594Z  2025-03-14T06:37:17.1273038Z  2025-03-14T06:37:17.1273477Z  2025-03-14T06:37:17.1273904Z  2025-03-14T06:37:17.1274297Z  2025-03-14T06:37:17.1274710Z  2025-03-14T06:37:17.1275227Z  2025-03-14T06:37:17.1276201Z [18,215 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:17.1277549Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T06:37:17.1278358Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T06:37:17.1279185Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T06:37:17.1280071Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T06:37:17.1280889Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2025-03-14T06:37:17.1281583Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2025-03-14T06:37:17.1282501Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2025-03-14T06:37:17.1283523Z Compiling xla/service/buffer_assignment.cc; 20s local ... 2025-03-14T06:37:17.5275268Z 2025-03-14T06:37:17.5276199Z  2025-03-14T06:37:17.5277125Z  2025-03-14T06:37:17.5277576Z  2025-03-14T06:37:17.5277971Z  2025-03-14T06:37:17.5278357Z  2025-03-14T06:37:17.5278734Z  2025-03-14T06:37:17.5279111Z  2025-03-14T06:37:17.5279523Z  2025-03-14T06:37:17.5280449Z [18,217 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:17.5281574Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T06:37:17.5282315Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T06:37:17.5283400Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T06:37:17.5284239Z Compiling mlir/lib/Dialect/Tensor/IR/TensorOps.cpp; 37s local 2025-03-14T06:37:17.5285181Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2025-03-14T06:37:17.5286095Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2025-03-14T06:37:17.5287106Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 27s local 2025-03-14T06:37:17.5288162Z Compiling xla/service/buffer_assignment.cc; 20s local ... 2025-03-14T06:37:17.8537061Z 2025-03-14T06:37:17.8538168Z  2025-03-14T06:37:17.8538709Z  2025-03-14T06:37:17.8539201Z  2025-03-14T06:37:17.8539662Z  2025-03-14T06:37:17.8540087Z  2025-03-14T06:37:17.8540455Z  2025-03-14T06:37:17.8540815Z  2025-03-14T06:37:17.8541349Z  2025-03-14T06:37:17.8542506Z [18,218 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:17.8543585Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 155s local 2025-03-14T06:37:17.8544530Z Compiling stablehlo/dialect/VhloOps.cpp; 65s local 2025-03-14T06:37:17.8545322Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T06:37:17.8546102Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T06:37:17.8546850Z Compiling stablehlo/dialect/StablehloOps.cpp; 33s local 2025-03-14T06:37:17.8547764Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2025-03-14T06:37:17.8548672Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T06:37:17.8549548Z .../service/memory_space_assignment:memory_space_assignment; 21s local ... 2025-03-14T06:37:18.1280234Z 2025-03-14T06:37:18.1281136Z  2025-03-14T06:37:18.1281682Z  2025-03-14T06:37:18.1282134Z  2025-03-14T06:37:18.1282585Z  2025-03-14T06:37:18.1283272Z  2025-03-14T06:37:18.1283685Z  2025-03-14T06:37:18.1284059Z  2025-03-14T06:37:18.1284588Z  2025-03-14T06:37:18.1285603Z [18,219 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:18.1286524Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T06:37:18.1287300Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2025-03-14T06:37:18.1288149Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T06:37:18.1289127Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T06:37:18.1289975Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T06:37:18.1290858Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2025-03-14T06:37:18.1292127Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T06:37:18.1293100Z .../service/memory_space_assignment:memory_space_assignment; 21s local ... 2025-03-14T06:37:18.3550128Z 2025-03-14T06:37:18.3551035Z  2025-03-14T06:37:18.3551614Z  2025-03-14T06:37:18.3552079Z  2025-03-14T06:37:18.3552536Z  2025-03-14T06:37:18.3552971Z  2025-03-14T06:37:18.3553370Z  2025-03-14T06:37:18.3553772Z  2025-03-14T06:37:18.3554192Z  2025-03-14T06:37:18.3555163Z [18,221 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:18.3556201Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T06:37:18.3557314Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2025-03-14T06:37:18.3558163Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T06:37:18.3558965Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T06:37:18.3559778Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T06:37:18.3560734Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2025-03-14T06:37:18.3561704Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T06:37:18.3562487Z @llvm-project//llvm:IPO; 21s local ... 2025-03-14T06:37:18.6539677Z 2025-03-14T06:37:18.6541103Z  2025-03-14T06:37:18.6541670Z  2025-03-14T06:37:18.6542132Z  2025-03-14T06:37:18.6542589Z  2025-03-14T06:37:18.6542940Z  2025-03-14T06:37:18.6543262Z  2025-03-14T06:37:18.6543580Z  2025-03-14T06:37:18.6543895Z  2025-03-14T06:37:18.6544793Z [18,223 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:18.6545838Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T06:37:18.6546877Z Compiling stablehlo/dialect/VhloOps.cpp; 66s local 2025-03-14T06:37:18.6547689Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T06:37:18.6548463Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T06:37:18.6549306Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T06:37:18.6550148Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 28s local 2025-03-14T06:37:18.6551148Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T06:37:18.6551840Z @llvm-project//llvm:IPO; 21s local ... 2025-03-14T06:37:18.8821571Z 2025-03-14T06:37:18.8822458Z  2025-03-14T06:37:18.8823024Z  2025-03-14T06:37:18.8823476Z  2025-03-14T06:37:18.8823931Z  2025-03-14T06:37:18.8824327Z  2025-03-14T06:37:18.8824686Z  2025-03-14T06:37:18.8825040Z  2025-03-14T06:37:18.8825341Z  2025-03-14T06:37:18.8826217Z [18,225 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:18.8827256Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 156s local 2025-03-14T06:37:18.8828223Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T06:37:18.8829015Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T06:37:18.8830131Z Compiling stablehlo/dialect/StablehloOps.cpp; 34s local 2025-03-14T06:37:18.8831114Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2025-03-14T06:37:18.8832198Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T06:37:18.8832822Z @llvm-project//llvm:IPO; 21s local 2025-03-14T06:37:18.8833635Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2025-03-14T06:37:19.1287036Z 2025-03-14T06:37:19.1287927Z  2025-03-14T06:37:19.1288519Z  2025-03-14T06:37:19.1288981Z  2025-03-14T06:37:19.1289435Z  2025-03-14T06:37:19.1289860Z  2025-03-14T06:37:19.1290208Z  2025-03-14T06:37:19.1290572Z  2025-03-14T06:37:19.1291367Z  2025-03-14T06:37:19.1292316Z [18,226 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:19.1293386Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T06:37:19.1294295Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T06:37:19.1295079Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T06:37:19.1295838Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T06:37:19.1296841Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2025-03-14T06:37:19.1297758Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T06:37:19.1298469Z @llvm-project//llvm:IPO; 22s local 2025-03-14T06:37:19.1299535Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2025-03-14T06:37:19.3290212Z 2025-03-14T06:37:19.3291164Z  2025-03-14T06:37:19.3291707Z  2025-03-14T06:37:19.3292148Z  2025-03-14T06:37:19.3292634Z  2025-03-14T06:37:19.3293050Z  2025-03-14T06:37:19.3293394Z  2025-03-14T06:37:19.3293734Z  2025-03-14T06:37:19.3294092Z  2025-03-14T06:37:19.3295147Z [18,227 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:19.3296057Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T06:37:19.3297320Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T06:37:19.3298113Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T06:37:19.3298914Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T06:37:19.3299888Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 29s local 2025-03-14T06:37:19.3300863Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T06:37:19.3301589Z @llvm-project//llvm:IPO; 22s local 2025-03-14T06:37:19.3302383Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 21s local ... 2025-03-14T06:37:19.9227983Z 2025-03-14T06:37:19.9228974Z  2025-03-14T06:37:19.9229508Z  2025-03-14T06:37:19.9229891Z  2025-03-14T06:37:19.9230258Z  2025-03-14T06:37:19.9230638Z  2025-03-14T06:37:19.9231018Z  2025-03-14T06:37:19.9231427Z  2025-03-14T06:37:19.9231838Z  2025-03-14T06:37:19.9232778Z [18,228 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:19.9233858Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 157s local 2025-03-14T06:37:19.9234783Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T06:37:19.9235563Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T06:37:19.9236348Z Compiling stablehlo/dialect/StablehloOps.cpp; 35s local 2025-03-14T06:37:19.9237320Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2025-03-14T06:37:19.9238268Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T06:37:19.9238995Z @llvm-project//llvm:IPO; 22s local 2025-03-14T06:37:19.9239781Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local ... 2025-03-14T06:37:20.1237643Z 2025-03-14T06:37:20.1238538Z  2025-03-14T06:37:20.1238964Z  2025-03-14T06:37:20.1239696Z  2025-03-14T06:37:20.1240165Z  2025-03-14T06:37:20.1240625Z  2025-03-14T06:37:20.1241187Z  2025-03-14T06:37:20.1241752Z  2025-03-14T06:37:20.1242305Z  2025-03-14T06:37:20.1243675Z [18,229 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:20.1245380Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T06:37:20.1246721Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T06:37:20.1247917Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T06:37:20.1249076Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2025-03-14T06:37:20.1250449Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2025-03-14T06:37:20.1252036Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T06:37:20.1253056Z @llvm-project//llvm:IPO; 23s local 2025-03-14T06:37:20.1254172Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local ... 2025-03-14T06:37:20.3298367Z 2025-03-14T06:37:20.3299269Z  2025-03-14T06:37:20.3299709Z  2025-03-14T06:37:20.3300136Z  2025-03-14T06:37:20.3300521Z  2025-03-14T06:37:20.3300912Z  2025-03-14T06:37:20.3301283Z  2025-03-14T06:37:20.3301644Z  2025-03-14T06:37:20.3301992Z  2025-03-14T06:37:20.3302999Z [18,230 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:20.3304357Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T06:37:20.3305175Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T06:37:20.3305908Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T06:37:20.3306642Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2025-03-14T06:37:20.3307554Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2025-03-14T06:37:20.3308459Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T06:37:20.3309108Z @llvm-project//llvm:IPO; 23s local 2025-03-14T06:37:20.3309989Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 22s local ... 2025-03-14T06:37:20.5301826Z 2025-03-14T06:37:20.5302666Z  2025-03-14T06:37:20.5303093Z  2025-03-14T06:37:20.5303462Z  2025-03-14T06:37:20.5303827Z  2025-03-14T06:37:20.5304193Z  2025-03-14T06:37:20.5304555Z  2025-03-14T06:37:20.5304915Z  2025-03-14T06:37:20.5305285Z  2025-03-14T06:37:20.5306168Z [18,231 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:20.5307171Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T06:37:20.5308044Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T06:37:20.5308796Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T06:37:20.5309524Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2025-03-14T06:37:20.5310358Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 30s local 2025-03-14T06:37:20.5311197Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T06:37:20.5311851Z @llvm-project//llvm:IPO; 23s local 2025-03-14T06:37:20.5312576Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local ... 2025-03-14T06:37:20.9839017Z 2025-03-14T06:37:20.9839802Z  2025-03-14T06:37:20.9840209Z  2025-03-14T06:37:20.9840544Z  2025-03-14T06:37:20.9840873Z  2025-03-14T06:37:20.9841232Z  2025-03-14T06:37:20.9841564Z  2025-03-14T06:37:20.9841897Z  2025-03-14T06:37:20.9842196Z  2025-03-14T06:37:20.9842966Z [18,232 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:20.9843861Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 158s local 2025-03-14T06:37:20.9844760Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T06:37:20.9845699Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2025-03-14T06:37:20.9846342Z Compiling stablehlo/dialect/StablehloOps.cpp; 36s local 2025-03-14T06:37:20.9847129Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2025-03-14T06:37:20.9847899Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T06:37:20.9848468Z @llvm-project//llvm:IPO; 23s local 2025-03-14T06:37:20.9849072Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local ... 2025-03-14T06:37:21.3308616Z 2025-03-14T06:37:21.3309456Z  2025-03-14T06:37:21.3309916Z  2025-03-14T06:37:21.3310299Z  2025-03-14T06:37:21.3310694Z  2025-03-14T06:37:21.3311079Z  2025-03-14T06:37:21.3311741Z  2025-03-14T06:37:21.3312103Z  2025-03-14T06:37:21.3312480Z  2025-03-14T06:37:21.3313423Z [18,234 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:21.3314688Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2025-03-14T06:37:21.3315651Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T06:37:21.3316470Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2025-03-14T06:37:21.3317291Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2025-03-14T06:37:21.3318284Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2025-03-14T06:37:21.3319085Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T06:37:21.3319980Z @llvm-project//llvm:IPO; 24s local 2025-03-14T06:37:21.3320760Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 23s local ... 2025-03-14T06:37:21.5311764Z 2025-03-14T06:37:21.5312587Z  2025-03-14T06:37:21.5313109Z  2025-03-14T06:37:21.5313521Z  2025-03-14T06:37:21.5313952Z  2025-03-14T06:37:21.5314359Z  2025-03-14T06:37:21.5314893Z  2025-03-14T06:37:21.5315311Z  2025-03-14T06:37:21.5315720Z  2025-03-14T06:37:21.5316678Z [18,236 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:21.5318074Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 159s local 2025-03-14T06:37:21.5318806Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T06:37:21.5319426Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2025-03-14T06:37:21.5320045Z Compiling stablehlo/dialect/StablehloOps.cpp; 37s local 2025-03-14T06:37:21.5320903Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 31s local 2025-03-14T06:37:21.5321961Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T06:37:21.5322677Z @llvm-project//llvm:IPO; 24s local 2025-03-14T06:37:21.5323523Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 24s local ... 2025-03-14T06:37:22.7318651Z 2025-03-14T06:37:22.7319644Z  2025-03-14T06:37:22.7320244Z  2025-03-14T06:37:22.7320654Z  2025-03-14T06:37:22.7321065Z  2025-03-14T06:37:22.7321529Z  2025-03-14T06:37:22.7321961Z  2025-03-14T06:37:22.7322390Z  2025-03-14T06:37:22.7322815Z  2025-03-14T06:37:22.7323804Z [18,236 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:22.7325136Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2025-03-14T06:37:22.7326117Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2025-03-14T06:37:22.7326951Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T06:37:22.7327820Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2025-03-14T06:37:22.7328844Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2025-03-14T06:37:22.7329886Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:22.7330592Z @llvm-project//llvm:IPO; 25s local 2025-03-14T06:37:22.7331507Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local ... 2025-03-14T06:37:22.9321929Z 2025-03-14T06:37:22.9323183Z  2025-03-14T06:37:22.9323743Z  2025-03-14T06:37:22.9324153Z  2025-03-14T06:37:22.9324750Z  2025-03-14T06:37:22.9325204Z  2025-03-14T06:37:22.9325604Z  2025-03-14T06:37:22.9325975Z  2025-03-14T06:37:22.9326342Z  2025-03-14T06:37:22.9327199Z [18,238 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:22.9328369Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 160s local 2025-03-14T06:37:22.9329378Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2025-03-14T06:37:22.9330269Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T06:37:22.9331085Z Compiling stablehlo/dialect/StablehloOps.cpp; 38s local 2025-03-14T06:37:22.9332384Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2025-03-14T06:37:22.9333499Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:22.9334187Z @llvm-project//llvm:IPO; 25s local 2025-03-14T06:37:22.9334965Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local ... 2025-03-14T06:37:23.2250202Z 2025-03-14T06:37:23.2251164Z  2025-03-14T06:37:23.2251720Z  2025-03-14T06:37:23.2252166Z  2025-03-14T06:37:23.2252555Z  2025-03-14T06:37:23.2252941Z  2025-03-14T06:37:23.2253459Z  2025-03-14T06:37:23.2253852Z  2025-03-14T06:37:23.2254257Z  2025-03-14T06:37:23.2255190Z [18,242 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:23.2256329Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:37:23.2257038Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T06:37:23.2257666Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T06:37:23.2258275Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T06:37:23.2259053Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2025-03-14T06:37:23.2259815Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:23.2260514Z @llvm-project//llvm:IPO; 26s local 2025-03-14T06:37:23.2261124Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 25s local ... 2025-03-14T06:37:23.4523258Z 2025-03-14T06:37:23.4524264Z  2025-03-14T06:37:23.4524940Z  2025-03-14T06:37:23.4525331Z  2025-03-14T06:37:23.4525765Z  2025-03-14T06:37:23.4526215Z  2025-03-14T06:37:23.4526652Z  2025-03-14T06:37:23.4527069Z  2025-03-14T06:37:23.4527390Z  2025-03-14T06:37:23.4528299Z [18,246 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:23.4529379Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:37:23.4530283Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T06:37:23.4531092Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T06:37:23.4531885Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T06:37:23.4532915Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2025-03-14T06:37:23.4533940Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:23.4534692Z @llvm-project//llvm:IPO; 26s local 2025-03-14T06:37:23.4535468Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local ... 2025-03-14T06:37:23.6531296Z 2025-03-14T06:37:23.6532161Z  2025-03-14T06:37:23.6532711Z  2025-03-14T06:37:23.6533138Z  2025-03-14T06:37:23.6533547Z  2025-03-14T06:37:23.6533943Z  2025-03-14T06:37:23.6534332Z  2025-03-14T06:37:23.6534730Z  2025-03-14T06:37:23.6535098Z  2025-03-14T06:37:23.6536010Z [18,247 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:23.6537139Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:37:23.6538374Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T06:37:23.6539320Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2025-03-14T06:37:23.6540190Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T06:37:23.6541202Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 33s local 2025-03-14T06:37:23.6542199Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:23.6542912Z @llvm-project//llvm:IPO; 26s local 2025-03-14T06:37:23.6543675Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local ... 2025-03-14T06:37:23.9329020Z 2025-03-14T06:37:23.9329882Z  2025-03-14T06:37:23.9330363Z  2025-03-14T06:37:23.9330765Z  2025-03-14T06:37:23.9331525Z  2025-03-14T06:37:23.9331991Z  2025-03-14T06:37:23.9332432Z  2025-03-14T06:37:23.9332815Z  2025-03-14T06:37:23.9333198Z  2025-03-14T06:37:23.9334263Z [18,247 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:23.9335353Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 161s local 2025-03-14T06:37:23.9336396Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T06:37:23.9337251Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2025-03-14T06:37:23.9338116Z Compiling stablehlo/dialect/StablehloOps.cpp; 39s local 2025-03-14T06:37:23.9339091Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2025-03-14T06:37:23.9340131Z Compiling xla/service/buffer_assignment.cc; 27s local 2025-03-14T06:37:23.9341048Z @llvm-project//llvm:IPO; 26s local 2025-03-14T06:37:23.9341785Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local ... 2025-03-14T06:37:24.2334424Z 2025-03-14T06:37:24.2335302Z  2025-03-14T06:37:24.2335832Z  2025-03-14T06:37:24.2336224Z  2025-03-14T06:37:24.2336599Z  2025-03-14T06:37:24.2336963Z  2025-03-14T06:37:24.2337363Z  2025-03-14T06:37:24.2337781Z  2025-03-14T06:37:24.2338140Z  2025-03-14T06:37:24.2339413Z [18,248 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:24.2340511Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T06:37:24.2341416Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2025-03-14T06:37:24.2342173Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2025-03-14T06:37:24.2342943Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T06:37:24.2343751Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2025-03-14T06:37:24.2344635Z Compiling xla/service/buffer_assignment.cc; 27s local 2025-03-14T06:37:24.2345328Z @llvm-project//llvm:IPO; 27s local 2025-03-14T06:37:24.2346025Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 26s local ... 2025-03-14T06:37:24.4555606Z 2025-03-14T06:37:24.4556565Z  2025-03-14T06:37:24.4557119Z  2025-03-14T06:37:24.4557632Z  2025-03-14T06:37:24.4558190Z  2025-03-14T06:37:24.4558568Z  2025-03-14T06:37:24.4559029Z  2025-03-14T06:37:24.4559525Z  2025-03-14T06:37:24.4559976Z  2025-03-14T06:37:24.4561018Z [18,251 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:24.4562233Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T06:37:24.4563288Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2025-03-14T06:37:24.4564225Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T06:37:24.4565258Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 34s local 2025-03-14T06:37:24.4566412Z @llvm-project//llvm:IPO; 27s local 2025-03-14T06:37:24.4567187Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T06:37:24.4568059Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local 2025-03-14T06:37:24.4569324Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 18s local ... 2025-03-14T06:37:24.7334838Z 2025-03-14T06:37:24.7335721Z  2025-03-14T06:37:24.7336200Z  2025-03-14T06:37:24.7336669Z  2025-03-14T06:37:24.7337083Z  2025-03-14T06:37:24.7337498Z  2025-03-14T06:37:24.7337917Z  2025-03-14T06:37:24.7338280Z  2025-03-14T06:37:24.7338680Z  2025-03-14T06:37:24.7339631Z [18,251 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:24.7340777Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T06:37:24.7341711Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2025-03-14T06:37:24.7342612Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T06:37:24.7343920Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2025-03-14T06:37:24.7344787Z @llvm-project//llvm:IPO; 27s local 2025-03-14T06:37:24.7345565Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T06:37:24.7346415Z Compiling stablehlo/dialect/ChloOps.cpp; 25s local 2025-03-14T06:37:24.7347232Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local ... 2025-03-14T06:37:24.9640039Z 2025-03-14T06:37:24.9640896Z  2025-03-14T06:37:24.9641385Z  2025-03-14T06:37:24.9641824Z  2025-03-14T06:37:24.9642226Z  2025-03-14T06:37:24.9642628Z  2025-03-14T06:37:24.9642989Z  2025-03-14T06:37:24.9643374Z  2025-03-14T06:37:24.9643759Z  2025-03-14T06:37:24.9645136Z [18,252 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:24.9646275Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 162s local 2025-03-14T06:37:24.9647272Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T06:37:24.9648149Z Compiling stablehlo/dialect/StablehloOps.cpp; 40s local 2025-03-14T06:37:24.9649205Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2025-03-14T06:37:24.9650088Z @llvm-project//llvm:IPO; 27s local 2025-03-14T06:37:24.9651070Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T06:37:24.9651936Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T06:37:24.9653347Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local ... 2025-03-14T06:37:25.3340510Z 2025-03-14T06:37:25.3341374Z  2025-03-14T06:37:25.3341848Z  2025-03-14T06:37:25.3342242Z  2025-03-14T06:37:25.3342666Z  2025-03-14T06:37:25.3343067Z  2025-03-14T06:37:25.3343602Z  2025-03-14T06:37:25.3344013Z  2025-03-14T06:37:25.3344417Z  2025-03-14T06:37:25.3345412Z [18,253 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:25.3346616Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T06:37:25.3347633Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T06:37:25.3348516Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T06:37:25.3349462Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2025-03-14T06:37:25.3350315Z @llvm-project//llvm:IPO; 28s local 2025-03-14T06:37:25.3351109Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 27s local 2025-03-14T06:37:25.3352126Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T06:37:25.3353024Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local ... 2025-03-14T06:37:25.5491006Z 2025-03-14T06:37:25.5491975Z  2025-03-14T06:37:25.5492515Z  2025-03-14T06:37:25.5492960Z  2025-03-14T06:37:25.5493382Z  2025-03-14T06:37:25.5493786Z  2025-03-14T06:37:25.5494245Z  2025-03-14T06:37:25.5494697Z  2025-03-14T06:37:25.5495132Z  2025-03-14T06:37:25.5496140Z [18,255 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:25.5497520Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T06:37:25.5498418Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T06:37:25.5499230Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T06:37:25.5500170Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 35s local 2025-03-14T06:37:25.5500992Z @llvm-project//llvm:IPO; 28s local 2025-03-14T06:37:25.5501737Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2025-03-14T06:37:25.5502583Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T06:37:25.5503449Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 19s local ... 2025-03-14T06:37:25.8105492Z 2025-03-14T06:37:25.8106348Z  2025-03-14T06:37:25.8107136Z  2025-03-14T06:37:25.8107552Z  2025-03-14T06:37:25.8107943Z  2025-03-14T06:37:25.8108364Z  2025-03-14T06:37:25.8108733Z  2025-03-14T06:37:25.8109261Z  2025-03-14T06:37:25.8109633Z  2025-03-14T06:37:25.8110437Z [18,257 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:25.8111355Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local 2025-03-14T06:37:25.8112279Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T06:37:25.8113113Z Compiling stablehlo/dialect/StablehloOps.cpp; 41s local 2025-03-14T06:37:25.8114071Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2025-03-14T06:37:25.8115381Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2025-03-14T06:37:25.8116280Z Compiling stablehlo/dialect/ChloOps.cpp; 26s local 2025-03-14T06:37:25.8117121Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2025-03-14T06:37:25.8118174Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local ... 2025-03-14T06:37:26.1348121Z 2025-03-14T06:37:26.1349136Z  2025-03-14T06:37:26.1349662Z  2025-03-14T06:37:26.1350143Z  2025-03-14T06:37:26.1350618Z  2025-03-14T06:37:26.1351094Z  2025-03-14T06:37:26.1351516Z  2025-03-14T06:37:26.1351906Z  2025-03-14T06:37:26.1352529Z  2025-03-14T06:37:26.1353494Z [18,257 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:26.1354643Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T06:37:26.1355670Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T06:37:26.1356543Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2025-03-14T06:37:26.1357295Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2025-03-14T06:37:26.1358168Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 28s local 2025-03-14T06:37:26.1359030Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T06:37:26.1359873Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2025-03-14T06:37:26.1360917Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local ... 2025-03-14T06:37:26.4470668Z 2025-03-14T06:37:26.4471623Z  2025-03-14T06:37:26.4472140Z  2025-03-14T06:37:26.4472612Z  2025-03-14T06:37:26.4473033Z  2025-03-14T06:37:26.4473496Z  2025-03-14T06:37:26.4473880Z  2025-03-14T06:37:26.4474218Z  2025-03-14T06:37:26.4474571Z  2025-03-14T06:37:26.4475434Z [18,258 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:26.4476449Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T06:37:26.4477509Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T06:37:26.4478294Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2025-03-14T06:37:26.4479326Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 36s local 2025-03-14T06:37:26.4480434Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T06:37:26.4486360Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T06:37:26.4487236Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 20s local 2025-03-14T06:37:26.4488298Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local ... 2025-03-14T06:37:26.7466625Z 2025-03-14T06:37:26.7467629Z  2025-03-14T06:37:26.7468155Z  2025-03-14T06:37:26.7468605Z  2025-03-14T06:37:26.7469105Z  2025-03-14T06:37:26.7469573Z  2025-03-14T06:37:26.7475085Z  2025-03-14T06:37:26.7475522Z  2025-03-14T06:37:26.7475922Z  2025-03-14T06:37:26.7476907Z [18,258 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:26.7478000Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 164s local 2025-03-14T06:37:26.7478869Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T06:37:26.7479545Z Compiling stablehlo/dialect/StablehloOps.cpp; 42s local 2025-03-14T06:37:26.7480618Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T06:37:26.7481694Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T06:37:26.7482470Z Compiling stablehlo/dialect/ChloOps.cpp; 27s local 2025-03-14T06:37:26.7483250Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2025-03-14T06:37:26.7484287Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local ... 2025-03-14T06:37:27.1356840Z 2025-03-14T06:37:27.1358932Z  2025-03-14T06:37:27.1359416Z  2025-03-14T06:37:27.1359860Z  2025-03-14T06:37:27.1360263Z  2025-03-14T06:37:27.1360668Z  2025-03-14T06:37:27.1361061Z  2025-03-14T06:37:27.1361447Z  2025-03-14T06:37:27.1361841Z  2025-03-14T06:37:27.1362803Z [18,259 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:27.1363965Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T06:37:27.1365123Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2025-03-14T06:37:27.1366581Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T06:37:27.1367544Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T06:37:27.1368550Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 29s local 2025-03-14T06:37:27.1369369Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T06:37:27.1370195Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2025-03-14T06:37:27.1371239Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local ... 2025-03-14T06:37:27.5161196Z 2025-03-14T06:37:27.5162147Z  2025-03-14T06:37:27.5162603Z  2025-03-14T06:37:27.5162988Z  2025-03-14T06:37:27.5163316Z  2025-03-14T06:37:27.5163682Z  2025-03-14T06:37:27.5164059Z  2025-03-14T06:37:27.5164605Z  2025-03-14T06:37:27.5165035Z  2025-03-14T06:37:27.5166153Z [18,260 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:27.5167297Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T06:37:27.5168274Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2025-03-14T06:37:27.5169189Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T06:37:27.5170229Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 37s local 2025-03-14T06:37:27.5171266Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T06:37:27.5172174Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T06:37:27.5173002Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 21s local 2025-03-14T06:37:27.5174054Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local ... 2025-03-14T06:37:27.7363160Z 2025-03-14T06:37:27.7364038Z  2025-03-14T06:37:27.7364607Z  2025-03-14T06:37:27.7365027Z  2025-03-14T06:37:27.7365576Z  2025-03-14T06:37:27.7366435Z  2025-03-14T06:37:27.7366861Z  2025-03-14T06:37:27.7367212Z  2025-03-14T06:37:27.7367597Z  2025-03-14T06:37:27.7368625Z [18,260 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:27.7369690Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T06:37:27.7370616Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2025-03-14T06:37:27.7371637Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T06:37:27.7372584Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T06:37:27.7373584Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T06:37:27.7374415Z Compiling stablehlo/dialect/ChloOps.cpp; 28s local 2025-03-14T06:37:27.7375217Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2025-03-14T06:37:27.7376223Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local ... 2025-03-14T06:37:27.9517444Z 2025-03-14T06:37:27.9518328Z  2025-03-14T06:37:27.9518819Z  2025-03-14T06:37:27.9519240Z  2025-03-14T06:37:27.9519664Z  2025-03-14T06:37:27.9520087Z  2025-03-14T06:37:27.9520508Z  2025-03-14T06:37:27.9520923Z  2025-03-14T06:37:27.9521324Z  2025-03-14T06:37:27.9522233Z [18,263 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:27.9523331Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 165s local 2025-03-14T06:37:27.9524342Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T06:37:27.9525399Z Compiling stablehlo/dialect/StablehloOps.cpp; 43s local 2025-03-14T06:37:27.9526427Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T06:37:27.9527528Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T06:37:27.9528445Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T06:37:27.9529350Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2025-03-14T06:37:27.9530727Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local ... 2025-03-14T06:37:28.3367997Z 2025-03-14T06:37:28.3368834Z  2025-03-14T06:37:28.3369293Z  2025-03-14T06:37:28.3369668Z  2025-03-14T06:37:28.3370033Z  2025-03-14T06:37:28.3370408Z  2025-03-14T06:37:28.3370784Z  2025-03-14T06:37:28.3371271Z  2025-03-14T06:37:28.3371675Z  2025-03-14T06:37:28.3372601Z [18,264 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:28.3373764Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2025-03-14T06:37:28.3374722Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T06:37:28.3375651Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2025-03-14T06:37:28.3376703Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T06:37:28.3377799Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 30s local 2025-03-14T06:37:28.3378682Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T06:37:28.3380047Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2025-03-14T06:37:28.3381293Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local ... 2025-03-14T06:37:28.5371435Z 2025-03-14T06:37:28.5372330Z  2025-03-14T06:37:28.5372834Z  2025-03-14T06:37:28.5373339Z  2025-03-14T06:37:28.5373772Z  2025-03-14T06:37:28.5374201Z  2025-03-14T06:37:28.5374607Z  2025-03-14T06:37:28.5375013Z  2025-03-14T06:37:28.5375450Z  2025-03-14T06:37:28.5376504Z [18,265 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:28.5377684Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 166s local 2025-03-14T06:37:28.5378966Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T06:37:28.5380057Z Compiling stablehlo/dialect/StablehloOps.cpp; 44s local 2025-03-14T06:37:28.5380998Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 38s local 2025-03-14T06:37:28.5382007Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2025-03-14T06:37:28.5382788Z Compiling stablehlo/dialect/ChloOps.cpp; 29s local 2025-03-14T06:37:28.5383516Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 22s local 2025-03-14T06:37:28.5384630Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local ... 2025-03-14T06:37:29.3120969Z 2025-03-14T06:37:29.3121813Z  2025-03-14T06:37:29.3122305Z  2025-03-14T06:37:29.3122732Z  2025-03-14T06:37:29.3123150Z  2025-03-14T06:37:29.3123551Z  2025-03-14T06:37:29.3123953Z  2025-03-14T06:37:29.3124342Z  2025-03-14T06:37:29.3124845Z  2025-03-14T06:37:29.3125798Z [18,266 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:29.3126819Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T06:37:29.3127854Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T06:37:29.3128805Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T06:37:29.3129761Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T06:37:29.3130810Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 31s local 2025-03-14T06:37:29.3131701Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T06:37:29.3132565Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2025-03-14T06:37:29.3133609Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local ... 2025-03-14T06:37:29.5378444Z 2025-03-14T06:37:29.5379395Z  2025-03-14T06:37:29.5381062Z  2025-03-14T06:37:29.5381550Z  2025-03-14T06:37:29.5382101Z  2025-03-14T06:37:29.5382543Z  2025-03-14T06:37:29.5383042Z  2025-03-14T06:37:29.5383463Z  2025-03-14T06:37:29.5383890Z  2025-03-14T06:37:29.5385211Z [18,267 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:29.5386507Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T06:37:29.5387575Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T06:37:29.5388560Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T06:37:29.5389698Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 39s local 2025-03-14T06:37:29.5390819Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T06:37:29.5391757Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T06:37:29.5392617Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 23s local 2025-03-14T06:37:29.5393685Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local ... 2025-03-14T06:37:29.7382646Z 2025-03-14T06:37:29.7383576Z  2025-03-14T06:37:29.7384065Z  2025-03-14T06:37:29.7384480Z  2025-03-14T06:37:29.7384855Z  2025-03-14T06:37:29.7385376Z  2025-03-14T06:37:29.7385767Z  2025-03-14T06:37:29.7386164Z  2025-03-14T06:37:29.7386596Z  2025-03-14T06:37:29.7387530Z [18,268 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:29.7388737Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T06:37:29.7389710Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T06:37:29.7390599Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T06:37:29.7391628Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T06:37:29.7392644Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T06:37:29.7393564Z Compiling stablehlo/dialect/ChloOps.cpp; 30s local 2025-03-14T06:37:29.7394726Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2025-03-14T06:37:29.7396017Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local ... 2025-03-14T06:37:30.0532933Z 2025-03-14T06:37:30.0533971Z  2025-03-14T06:37:30.0534514Z  2025-03-14T06:37:30.0534896Z  2025-03-14T06:37:30.0535266Z  2025-03-14T06:37:30.0535657Z  2025-03-14T06:37:30.0536066Z  2025-03-14T06:37:30.0536488Z  2025-03-14T06:37:30.0536890Z  2025-03-14T06:37:30.0538135Z [18,269 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:30.0539223Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 167s local 2025-03-14T06:37:30.0540181Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T06:37:30.0541051Z Compiling stablehlo/dialect/StablehloOps.cpp; 45s local 2025-03-14T06:37:30.0542053Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T06:37:30.0543158Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T06:37:30.0544028Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T06:37:30.0544849Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2025-03-14T06:37:30.0545836Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local ... 2025-03-14T06:37:30.3388026Z 2025-03-14T06:37:30.3388894Z  2025-03-14T06:37:30.3389322Z  2025-03-14T06:37:30.3389682Z  2025-03-14T06:37:30.3390075Z  2025-03-14T06:37:30.3390433Z  2025-03-14T06:37:30.3390808Z  2025-03-14T06:37:30.3391175Z  2025-03-14T06:37:30.3391558Z  2025-03-14T06:37:30.3392520Z [18,269 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:30.3393658Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2025-03-14T06:37:30.3394592Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T06:37:30.3395480Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T06:37:30.3396715Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T06:37:30.3397750Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 32s local 2025-03-14T06:37:30.3398597Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T06:37:30.3399419Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2025-03-14T06:37:30.3400444Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local ... 2025-03-14T06:37:30.5392792Z 2025-03-14T06:37:30.5393632Z  2025-03-14T06:37:30.5394103Z  2025-03-14T06:37:30.5394539Z  2025-03-14T06:37:30.5394964Z  2025-03-14T06:37:30.5395360Z  2025-03-14T06:37:30.5395759Z  2025-03-14T06:37:30.5396168Z  2025-03-14T06:37:30.5396572Z  2025-03-14T06:37:30.5397562Z [18,270 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:30.5398851Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2025-03-14T06:37:30.5399828Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T06:37:30.5400710Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T06:37:30.5401729Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 40s local 2025-03-14T06:37:30.5402959Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2025-03-14T06:37:30.5403877Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T06:37:30.5404913Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 24s local 2025-03-14T06:37:30.5406001Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local ... 2025-03-14T06:37:30.9053036Z 2025-03-14T06:37:30.9053945Z  2025-03-14T06:37:30.9054445Z  2025-03-14T06:37:30.9054878Z  2025-03-14T06:37:30.9055303Z  2025-03-14T06:37:30.9055725Z  2025-03-14T06:37:30.9056126Z  2025-03-14T06:37:30.9056929Z  2025-03-14T06:37:30.9057371Z  2025-03-14T06:37:30.9058367Z [18,271 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:30.9059528Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 168s local 2025-03-14T06:37:30.9060543Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T06:37:30.9061452Z Compiling stablehlo/dialect/StablehloOps.cpp; 46s local 2025-03-14T06:37:30.9062673Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T06:37:30.9063755Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2025-03-14T06:37:30.9064774Z Compiling stablehlo/dialect/ChloOps.cpp; 31s local 2025-03-14T06:37:30.9065893Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2025-03-14T06:37:30.9067026Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local ... 2025-03-14T06:37:31.1393694Z 2025-03-14T06:37:31.1394606Z  2025-03-14T06:37:31.1395161Z  2025-03-14T06:37:31.1395666Z  2025-03-14T06:37:31.1396067Z  2025-03-14T06:37:31.1396485Z  2025-03-14T06:37:31.1396970Z  2025-03-14T06:37:31.1397409Z  2025-03-14T06:37:31.1397837Z  2025-03-14T06:37:31.1398720Z [18,274 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:31.1399772Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T06:37:31.1400860Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T06:37:31.1401811Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T06:37:31.1402872Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T06:37:31.1404015Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2025-03-14T06:37:31.1405090Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T06:37:31.1405990Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2025-03-14T06:37:31.1407163Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local ... 2025-03-14T06:37:31.3538421Z 2025-03-14T06:37:31.3539622Z  2025-03-14T06:37:31.3540470Z  2025-03-14T06:37:31.3541042Z  2025-03-14T06:37:31.3541585Z  2025-03-14T06:37:31.3542111Z  2025-03-14T06:37:31.3542644Z  2025-03-14T06:37:31.3543289Z  2025-03-14T06:37:31.3543840Z  2025-03-14T06:37:31.3544981Z [18,275 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:31.3546258Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T06:37:31.3547308Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T06:37:31.3548294Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T06:37:31.3549378Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T06:37:31.3550524Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 33s local 2025-03-14T06:37:31.3551499Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T06:37:31.3552483Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2025-03-14T06:37:31.3553414Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local ... 2025-03-14T06:37:31.5585721Z 2025-03-14T06:37:31.5586720Z  2025-03-14T06:37:31.5587193Z  2025-03-14T06:37:31.5587597Z  2025-03-14T06:37:31.5587999Z  2025-03-14T06:37:31.5588437Z  2025-03-14T06:37:31.5588846Z  2025-03-14T06:37:31.5589231Z  2025-03-14T06:37:31.5589646Z  2025-03-14T06:37:31.5590541Z [18,276 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:31.5591564Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T06:37:31.5592446Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T06:37:31.5593512Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T06:37:31.5595090Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 41s local 2025-03-14T06:37:31.5596056Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T06:37:31.5596853Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T06:37:31.5597926Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 25s local 2025-03-14T06:37:31.5599026Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local ... 2025-03-14T06:37:31.8608715Z 2025-03-14T06:37:31.8609654Z  2025-03-14T06:37:31.8610108Z  2025-03-14T06:37:31.8610462Z  2025-03-14T06:37:31.8610937Z  2025-03-14T06:37:31.8611330Z  2025-03-14T06:37:31.8611860Z  2025-03-14T06:37:31.8612421Z  2025-03-14T06:37:31.8612955Z  2025-03-14T06:37:31.8614247Z [18,277 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:31.8615851Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 169s local 2025-03-14T06:37:31.8617196Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T06:37:31.8618411Z Compiling stablehlo/dialect/StablehloOps.cpp; 47s local 2025-03-14T06:37:31.8619782Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T06:37:31.8621211Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T06:37:31.8622418Z Compiling stablehlo/dialect/ChloOps.cpp; 32s local 2025-03-14T06:37:31.8623625Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2025-03-14T06:37:31.8625091Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local ... 2025-03-14T06:37:32.1405059Z 2025-03-14T06:37:32.1405997Z  2025-03-14T06:37:32.1406490Z  2025-03-14T06:37:32.1406903Z  2025-03-14T06:37:32.1407299Z  2025-03-14T06:37:32.1407706Z  2025-03-14T06:37:32.1408097Z  2025-03-14T06:37:32.1408488Z  2025-03-14T06:37:32.1408934Z  2025-03-14T06:37:32.1409905Z [18,279 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:32.1411263Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T06:37:32.1412228Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2025-03-14T06:37:32.1413119Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T06:37:32.1414097Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T06:37:32.1415187Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 34s local 2025-03-14T06:37:32.1416067Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2025-03-14T06:37:32.1416956Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2025-03-14T06:37:32.1418068Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local ... 2025-03-14T06:37:32.5412324Z 2025-03-14T06:37:32.5413168Z  2025-03-14T06:37:32.5413640Z  2025-03-14T06:37:32.5414069Z  2025-03-14T06:37:32.5414433Z  2025-03-14T06:37:32.5414798Z  2025-03-14T06:37:32.5415159Z  2025-03-14T06:37:32.5415535Z  2025-03-14T06:37:32.5415904Z  2025-03-14T06:37:32.5416757Z [18,280 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:32.5417813Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T06:37:32.5418725Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2025-03-14T06:37:32.5419543Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T06:37:32.5420542Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 42s local 2025-03-14T06:37:32.5421592Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T06:37:32.5422600Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2025-03-14T06:37:32.5423506Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 26s local 2025-03-14T06:37:32.5424864Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local ... 2025-03-14T06:37:32.8329572Z 2025-03-14T06:37:32.8330450Z  2025-03-14T06:37:32.8330956Z  2025-03-14T06:37:32.8331358Z  2025-03-14T06:37:32.8331770Z  2025-03-14T06:37:32.8332181Z  2025-03-14T06:37:32.8332587Z  2025-03-14T06:37:32.8333004Z  2025-03-14T06:37:32.8333422Z  2025-03-14T06:37:32.8334352Z [18,281 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:32.8335748Z Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 170s local 2025-03-14T06:37:32.8336851Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2025-03-14T06:37:32.8337787Z Compiling stablehlo/dialect/StablehloOps.cpp; 48s local 2025-03-14T06:37:32.8338801Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T06:37:32.8339933Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T06:37:32.8340903Z Compiling stablehlo/dialect/ChloOps.cpp; 33s local 2025-03-14T06:37:32.8341817Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2025-03-14T06:37:32.8342972Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local ... 2025-03-14T06:37:33.1428661Z 2025-03-14T06:37:33.1429512Z  2025-03-14T06:37:33.1429942Z  2025-03-14T06:37:33.1430316Z  2025-03-14T06:37:33.1430716Z  2025-03-14T06:37:33.1431132Z  2025-03-14T06:37:33.1431547Z  2025-03-14T06:37:33.1431946Z  2025-03-14T06:37:33.1432350Z  2025-03-14T06:37:33.1433314Z [18,283 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:33.1434290Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T06:37:33.1435177Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T06:37:33.1436209Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T06:37:33.1437291Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T06:37:33.1438435Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T06:37:33.1439253Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2025-03-14T06:37:33.1440316Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2025-03-14T06:37:33.1441555Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local ... 2025-03-14T06:37:33.3434478Z 2025-03-14T06:37:33.3435315Z  2025-03-14T06:37:33.3435813Z  2025-03-14T06:37:33.3436195Z  2025-03-14T06:37:33.3436614Z  2025-03-14T06:37:33.3437046Z  2025-03-14T06:37:33.3437475Z  2025-03-14T06:37:33.3437902Z  2025-03-14T06:37:33.3438326Z  2025-03-14T06:37:33.3439346Z [18,284 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:33.3440545Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T06:37:33.3441486Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T06:37:33.3442525Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T06:37:33.3443639Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 35s local 2025-03-14T06:37:33.3444750Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T06:37:33.3445679Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 27s local 2025-03-14T06:37:33.3446767Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T06:37:33.3447962Z Compiling mlir/lib/Conversion/MemRefToLLVM/MemRefToLLVM.cpp; 26s local ... 2025-03-14T06:37:33.7132965Z 2025-03-14T06:37:33.7133920Z  2025-03-14T06:37:33.7134398Z  2025-03-14T06:37:33.7134776Z  2025-03-14T06:37:33.7135149Z  2025-03-14T06:37:33.7135511Z  2025-03-14T06:37:33.7135933Z  2025-03-14T06:37:33.7136357Z  2025-03-14T06:37:33.7136769Z  2025-03-14T06:37:33.7138265Z [18,287 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:33.7139382Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T06:37:33.7140321Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T06:37:33.7141411Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 43s local 2025-03-14T06:37:33.7142551Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T06:37:33.7143773Z Compiling stablehlo/dialect/ChloOps.cpp; 34s local 2025-03-14T06:37:33.7144665Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2025-03-14T06:37:33.7145734Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T06:37:33.7146817Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local ... 2025-03-14T06:37:33.9451370Z 2025-03-14T06:37:33.9452230Z  2025-03-14T06:37:33.9452733Z  2025-03-14T06:37:33.9453166Z  2025-03-14T06:37:33.9453637Z  2025-03-14T06:37:33.9454067Z  2025-03-14T06:37:33.9454493Z  2025-03-14T06:37:33.9454922Z  2025-03-14T06:37:33.9455337Z  2025-03-14T06:37:33.9456363Z [18,289 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:33.9457514Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T06:37:33.9458457Z Compiling stablehlo/dialect/StablehloOps.cpp; 49s local 2025-03-14T06:37:33.9459559Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T06:37:33.9460693Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T06:37:33.9461528Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T06:37:33.9462332Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2025-03-14T06:37:33.9463287Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T06:37:33.9464310Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local ... 2025-03-14T06:37:34.1456507Z 2025-03-14T06:37:34.1457374Z  2025-03-14T06:37:34.1457825Z  2025-03-14T06:37:34.1458188Z  2025-03-14T06:37:34.1458829Z  2025-03-14T06:37:34.1459202Z  2025-03-14T06:37:34.1459561Z  2025-03-14T06:37:34.1459909Z  2025-03-14T06:37:34.1460282Z  2025-03-14T06:37:34.1461150Z [18,291 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:34.1462094Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T06:37:34.1462944Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T06:37:34.1463945Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T06:37:34.1464923Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 36s local 2025-03-14T06:37:34.1465981Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T06:37:34.1466810Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2025-03-14T06:37:34.1467915Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T06:37:34.1468914Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local ... 2025-03-14T06:37:34.3612717Z 2025-03-14T06:37:34.3613586Z  2025-03-14T06:37:34.3614022Z  2025-03-14T06:37:34.3614366Z  2025-03-14T06:37:34.3614759Z  2025-03-14T06:37:34.3615133Z  2025-03-14T06:37:34.3615478Z  2025-03-14T06:37:34.3615886Z  2025-03-14T06:37:34.3616327Z  2025-03-14T06:37:34.3617294Z [18,293 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:34.3618366Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T06:37:34.3619215Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T06:37:34.3620211Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T06:37:34.3621556Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T06:37:34.3623436Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T06:37:34.3624391Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 28s local 2025-03-14T06:37:34.3625446Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T06:37:34.3626593Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local ... 2025-03-14T06:37:34.6990328Z 2025-03-14T06:37:34.6991164Z  2025-03-14T06:37:34.6991659Z  2025-03-14T06:37:34.6992460Z  2025-03-14T06:37:34.6992872Z  2025-03-14T06:37:34.6993259Z  2025-03-14T06:37:34.6993676Z  2025-03-14T06:37:34.6994086Z  2025-03-14T06:37:34.6994500Z  2025-03-14T06:37:34.6995453Z [18,295 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:34.6996512Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T06:37:34.6997421Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T06:37:34.6998355Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 44s local 2025-03-14T06:37:34.6999400Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T06:37:34.7000218Z Compiling stablehlo/dialect/ChloOps.cpp; 35s local 2025-03-14T06:37:34.7001015Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2025-03-14T06:37:34.7001980Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T06:37:34.7002959Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local ... 2025-03-14T06:37:34.9477929Z 2025-03-14T06:37:34.9478830Z  2025-03-14T06:37:34.9479315Z  2025-03-14T06:37:34.9479715Z  2025-03-14T06:37:34.9480105Z  2025-03-14T06:37:34.9480501Z  2025-03-14T06:37:34.9480888Z  2025-03-14T06:37:34.9481265Z  2025-03-14T06:37:34.9481646Z  2025-03-14T06:37:34.9482626Z [18,296 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:34.9483664Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T06:37:34.9484894Z Compiling stablehlo/dialect/StablehloOps.cpp; 50s local 2025-03-14T06:37:34.9485786Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T06:37:34.9486713Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T06:37:34.9487504Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T06:37:34.9488457Z Compiling llvm/lib/Transforms/IPO/OpenMPOpt.cpp; 29s local 2025-03-14T06:37:34.9489432Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T06:37:34.9490354Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local ... 2025-03-14T06:37:35.1483479Z 2025-03-14T06:37:35.1484320Z  2025-03-14T06:37:35.1484960Z  2025-03-14T06:37:35.1485372Z  2025-03-14T06:37:35.1485853Z  2025-03-14T06:37:35.1486294Z  2025-03-14T06:37:35.1486742Z  2025-03-14T06:37:35.1487283Z  2025-03-14T06:37:35.1487630Z  2025-03-14T06:37:35.1488487Z [18,298 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:35.1489398Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T06:37:35.1490344Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2025-03-14T06:37:35.1491353Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T06:37:35.1492469Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 37s local 2025-03-14T06:37:35.1493352Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T06:37:35.1494180Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T06:37:35.1494994Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T06:37:35.1495686Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local ... 2025-03-14T06:37:35.5494777Z 2025-03-14T06:37:35.5495649Z  2025-03-14T06:37:35.5496647Z  2025-03-14T06:37:35.5497078Z  2025-03-14T06:37:35.5497482Z  2025-03-14T06:37:35.5497899Z  2025-03-14T06:37:35.5498333Z  2025-03-14T06:37:35.5498730Z  2025-03-14T06:37:35.5499142Z  2025-03-14T06:37:35.5500109Z [18,299 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:35.5501209Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T06:37:35.5502291Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2025-03-14T06:37:35.5503255Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 45s local 2025-03-14T06:37:35.5504305Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T06:37:35.5505183Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T06:37:35.5506157Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T06:37:35.5507316Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T06:37:35.5508135Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local ... 2025-03-14T06:37:35.8930639Z 2025-03-14T06:37:35.8931518Z  2025-03-14T06:37:35.8932050Z  2025-03-14T06:37:35.8932450Z  2025-03-14T06:37:35.8932830Z  2025-03-14T06:37:35.8933224Z  2025-03-14T06:37:35.8933626Z  2025-03-14T06:37:35.8934024Z  2025-03-14T06:37:35.8934430Z  2025-03-14T06:37:35.8935341Z [18,302 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:35.8936387Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T06:37:35.8937243Z Compiling stablehlo/dialect/StablehloOps.cpp; 51s local 2025-03-14T06:37:35.8938256Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T06:37:35.8939371Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T06:37:35.8940253Z Compiling stablehlo/dialect/ChloOps.cpp; 36s local 2025-03-14T06:37:35.8941236Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T06:37:35.8942483Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2025-03-14T06:37:35.8943371Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local ... 2025-03-14T06:37:36.1511396Z 2025-03-14T06:37:36.1512259Z  2025-03-14T06:37:36.1512725Z  2025-03-14T06:37:36.1513095Z  2025-03-14T06:37:36.1513492Z  2025-03-14T06:37:36.1513879Z  2025-03-14T06:37:36.1514337Z  2025-03-14T06:37:36.1514744Z  2025-03-14T06:37:36.1515157Z  2025-03-14T06:37:36.1516248Z [18,302 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:36.1517230Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T06:37:36.1517993Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T06:37:36.1518903Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T06:37:36.1519892Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T06:37:36.1520728Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2025-03-14T06:37:36.1521631Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T06:37:36.1522589Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2025-03-14T06:37:36.1523456Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local ... 2025-03-14T06:37:36.3516607Z 2025-03-14T06:37:36.3517497Z  2025-03-14T06:37:36.3517919Z  2025-03-14T06:37:36.3518290Z  2025-03-14T06:37:36.3518654Z  2025-03-14T06:37:36.3519014Z  2025-03-14T06:37:36.3519383Z  2025-03-14T06:37:36.3519753Z  2025-03-14T06:37:36.3520126Z  2025-03-14T06:37:36.3521000Z [18,303 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:36.3521933Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T06:37:36.3523114Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T06:37:36.3524073Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T06:37:36.3525263Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 38s local 2025-03-14T06:37:36.3526104Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2025-03-14T06:37:36.3527020Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T06:37:36.3527919Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2025-03-14T06:37:36.3528863Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local ... 2025-03-14T06:37:36.5522606Z 2025-03-14T06:37:36.5523446Z  2025-03-14T06:37:36.5523857Z  2025-03-14T06:37:36.5524215Z  2025-03-14T06:37:36.5524737Z  2025-03-14T06:37:36.5525102Z  2025-03-14T06:37:36.5525449Z  2025-03-14T06:37:36.5525801Z  2025-03-14T06:37:36.5526144Z  2025-03-14T06:37:36.5527012Z [18,304 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:36.5527930Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T06:37:36.5528667Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T06:37:36.5529513Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 46s local 2025-03-14T06:37:36.5530389Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T06:37:36.5531114Z Compiling stablehlo/dialect/ChloOps.cpp; 37s local 2025-03-14T06:37:36.5531929Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T06:37:36.5532741Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2025-03-14T06:37:36.5533440Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local ... 2025-03-14T06:37:36.9533403Z 2025-03-14T06:37:36.9534265Z  2025-03-14T06:37:36.9534749Z  2025-03-14T06:37:36.9535157Z  2025-03-14T06:37:36.9535523Z  2025-03-14T06:37:36.9536037Z  2025-03-14T06:37:36.9536475Z  2025-03-14T06:37:36.9536851Z  2025-03-14T06:37:36.9537223Z  2025-03-14T06:37:36.9538373Z [18,305 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:37:36.9539421Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T06:37:36.9540272Z Compiling stablehlo/dialect/StablehloOps.cpp; 52s local 2025-03-14T06:37:36.9541235Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T06:37:36.9542323Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T06:37:36.9543147Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2025-03-14T06:37:36.9544059Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T06:37:36.9544940Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2025-03-14T06:37:36.9545808Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 20s local ... 2025-03-14T06:37:37.3546352Z 2025-03-14T06:37:37.3547209Z  2025-03-14T06:37:37.3547622Z  2025-03-14T06:37:37.3547940Z  2025-03-14T06:37:37.3548265Z  2025-03-14T06:37:37.3548611Z  2025-03-14T06:37:37.3548941Z  2025-03-14T06:37:37.3549267Z  2025-03-14T06:37:37.3549596Z  2025-03-14T06:37:37.3550400Z [18,305 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:37.3551330Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T06:37:37.3552113Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2025-03-14T06:37:37.3553041Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 47s local 2025-03-14T06:37:37.3554017Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 39s local 2025-03-14T06:37:37.3554824Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2025-03-14T06:37:37.3555715Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2025-03-14T06:37:37.3557022Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local 2025-03-14T06:37:37.3557912Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local ... 2025-03-14T06:37:37.8336288Z 2025-03-14T06:37:37.8337121Z  2025-03-14T06:37:37.8337631Z  2025-03-14T06:37:37.8338028Z  2025-03-14T06:37:37.8338464Z  2025-03-14T06:37:37.8338856Z  2025-03-14T06:37:37.8339258Z  2025-03-14T06:37:37.8339639Z  2025-03-14T06:37:37.8340048Z  2025-03-14T06:37:37.8341423Z [18,306 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:37.8342523Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T06:37:37.8343424Z Compiling stablehlo/dialect/StablehloOps.cpp; 53s local 2025-03-14T06:37:37.8344401Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T06:37:37.8345462Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T06:37:37.8346380Z Compiling stablehlo/dialect/ChloOps.cpp; 38s local 2025-03-14T06:37:37.8347384Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2025-03-14T06:37:37.8348402Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2025-03-14T06:37:37.8349331Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local ... 2025-03-14T06:37:38.1195342Z 2025-03-14T06:37:38.1196163Z  2025-03-14T06:37:38.1196612Z  2025-03-14T06:37:38.1197009Z  2025-03-14T06:37:38.1197437Z  2025-03-14T06:37:38.1197824Z  2025-03-14T06:37:38.1198192Z  2025-03-14T06:37:38.1198571Z  2025-03-14T06:37:38.1198940Z  2025-03-14T06:37:38.1199802Z [18,307 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:38.1200704Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T06:37:38.1201477Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T06:37:38.1202441Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T06:37:38.1203651Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T06:37:38.1204780Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T06:37:38.1205605Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2025-03-14T06:37:38.1206459Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2025-03-14T06:37:38.1207358Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 21s local ... 2025-03-14T06:37:38.3572306Z 2025-03-14T06:37:38.3573140Z  2025-03-14T06:37:38.3573649Z  2025-03-14T06:37:38.3574100Z  2025-03-14T06:37:38.3574538Z  2025-03-14T06:37:38.3574936Z  2025-03-14T06:37:38.3575339Z  2025-03-14T06:37:38.3575732Z  2025-03-14T06:37:38.3576138Z  2025-03-14T06:37:38.3577155Z [18,310 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:38.3578363Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T06:37:38.3593023Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T06:37:38.3594406Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T06:37:38.3595582Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 40s local 2025-03-14T06:37:38.3596511Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T06:37:38.3597366Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2025-03-14T06:37:38.3598349Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2025-03-14T06:37:38.3599470Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2025-03-14T06:37:38.5578098Z 2025-03-14T06:37:38.5578962Z  2025-03-14T06:37:38.5579481Z  2025-03-14T06:37:38.5579898Z  2025-03-14T06:37:38.5580312Z  2025-03-14T06:37:38.5580706Z  2025-03-14T06:37:38.5581089Z  2025-03-14T06:37:38.5581498Z  2025-03-14T06:37:38.5582335Z  2025-03-14T06:37:38.5583316Z [18,311 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:38.5584401Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T06:37:38.5585277Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T06:37:38.5586307Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 48s local 2025-03-14T06:37:38.5587349Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T06:37:38.5588409Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T06:37:38.5589243Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local 2025-03-14T06:37:38.5590173Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2025-03-14T06:37:38.5591275Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2025-03-14T06:37:38.8714050Z 2025-03-14T06:37:38.8714903Z  2025-03-14T06:37:38.8715407Z  2025-03-14T06:37:38.8715857Z  2025-03-14T06:37:38.8716240Z  2025-03-14T06:37:38.8716640Z  2025-03-14T06:37:38.8717054Z  2025-03-14T06:37:38.8717470Z  2025-03-14T06:37:38.8717880Z  2025-03-14T06:37:38.8718836Z [18,312 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:38.8719868Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T06:37:38.8720754Z Compiling stablehlo/dialect/StablehloOps.cpp; 54s local 2025-03-14T06:37:38.8721764Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T06:37:38.8722920Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T06:37:38.8723814Z Compiling stablehlo/dialect/ChloOps.cpp; 39s local 2025-03-14T06:37:38.8724789Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2025-03-14T06:37:38.8725707Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2025-03-14T06:37:38.8726873Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 19s local ... 2025-03-14T06:37:39.1554305Z 2025-03-14T06:37:39.1555160Z  2025-03-14T06:37:39.1555947Z  2025-03-14T06:37:39.1556341Z  2025-03-14T06:37:39.1556723Z  2025-03-14T06:37:39.1557121Z  2025-03-14T06:37:39.1557523Z  2025-03-14T06:37:39.1557909Z  2025-03-14T06:37:39.1558305Z  2025-03-14T06:37:39.1559254Z [18,314 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:39.1560268Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T06:37:39.1561128Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T06:37:39.1562108Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T06:37:39.1563149Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T06:37:39.1564005Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2025-03-14T06:37:39.1565013Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2025-03-14T06:37:39.1566106Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 22s local 2025-03-14T06:37:39.1567125Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local ... 2025-03-14T06:37:39.3598867Z 2025-03-14T06:37:39.3599735Z  2025-03-14T06:37:39.3600241Z  2025-03-14T06:37:39.3600629Z  2025-03-14T06:37:39.3601035Z  2025-03-14T06:37:39.3601459Z  2025-03-14T06:37:39.3601913Z  2025-03-14T06:37:39.3602305Z  2025-03-14T06:37:39.3602711Z  2025-03-14T06:37:39.3603670Z [18,314 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:39.3604895Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T06:37:39.3605742Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T06:37:39.3606738Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T06:37:39.3608129Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 41s local 2025-03-14T06:37:39.3608980Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2025-03-14T06:37:39.3609754Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2025-03-14T06:37:39.3610631Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2025-03-14T06:37:39.3611679Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local ... 2025-03-14T06:37:39.6131679Z 2025-03-14T06:37:39.6134733Z  2025-03-14T06:37:39.6135357Z  2025-03-14T06:37:39.6135781Z  2025-03-14T06:37:39.6136199Z  2025-03-14T06:37:39.6136607Z  2025-03-14T06:37:39.6136997Z  2025-03-14T06:37:39.6137404Z  2025-03-14T06:37:39.6137801Z  2025-03-14T06:37:39.6138708Z [18,315 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:39.6139755Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T06:37:39.6140670Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T06:37:39.6141683Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 49s local 2025-03-14T06:37:39.6142699Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T06:37:39.6143573Z Compiling stablehlo/dialect/ChloOps.cpp; 40s local 2025-03-14T06:37:39.6144371Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local 2025-03-14T06:37:39.6145303Z Compiling llvm/lib/Transforms/IPO/SampleProfile.cpp; 23s local 2025-03-14T06:37:39.6146378Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local ... 2025-03-14T06:37:39.9615774Z 2025-03-14T06:37:39.9616627Z  2025-03-14T06:37:39.9617115Z  2025-03-14T06:37:39.9617510Z  2025-03-14T06:37:39.9617884Z  2025-03-14T06:37:39.9618301Z  2025-03-14T06:37:39.9618706Z  2025-03-14T06:37:39.9619093Z  2025-03-14T06:37:39.9619483Z  2025-03-14T06:37:39.9620438Z [18,316 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:39.9621735Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T06:37:39.9622551Z Compiling stablehlo/dialect/StablehloOps.cpp; 55s local 2025-03-14T06:37:39.9623556Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T06:37:39.9624592Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T06:37:39.9625439Z Compiling stablehlo/dialect/ChloOps.cpp; 41s local 2025-03-14T06:37:39.9626252Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2025-03-14T06:37:39.9627130Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 20s local 2025-03-14T06:37:39.9628073Z Compiling stablehlo/reference/Ops.cpp; 19s local ... 2025-03-14T06:37:40.2277609Z 2025-03-14T06:37:40.2278478Z  2025-03-14T06:37:40.2279008Z  2025-03-14T06:37:40.2279428Z  2025-03-14T06:37:40.2279817Z  2025-03-14T06:37:40.2280306Z  2025-03-14T06:37:40.2280714Z  2025-03-14T06:37:40.2281102Z  2025-03-14T06:37:40.2281507Z  2025-03-14T06:37:40.2282446Z [18,319 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:40.2283511Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T06:37:40.2284541Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2025-03-14T06:37:40.2285508Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T06:37:40.2286610Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 42s local 2025-03-14T06:37:40.2287494Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2025-03-14T06:37:40.2288434Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2025-03-14T06:37:40.2289389Z Compiling stablehlo/reference/Ops.cpp; 19s local 2025-03-14T06:37:40.2290227Z Compiling xla/service/buffer_assignment.cc; 15s local ... 2025-03-14T06:37:40.5629305Z 2025-03-14T06:37:40.5630443Z  2025-03-14T06:37:40.5630966Z  2025-03-14T06:37:40.5631403Z  2025-03-14T06:37:40.5631819Z  2025-03-14T06:37:40.5632243Z  2025-03-14T06:37:40.5632639Z  2025-03-14T06:37:40.5633005Z  2025-03-14T06:37:40.5633386Z  2025-03-14T06:37:40.5634352Z [18,319 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:40.5635340Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T06:37:40.5636476Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2025-03-14T06:37:40.5637532Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 50s local 2025-03-14T06:37:40.5638802Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T06:37:40.5639616Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local 2025-03-14T06:37:40.5640524Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2025-03-14T06:37:40.5641494Z Compiling stablehlo/reference/Ops.cpp; 20s local 2025-03-14T06:37:40.5642316Z Compiling xla/service/buffer_assignment.cc; 16s local ... 2025-03-14T06:37:40.9433421Z 2025-03-14T06:37:40.9434252Z  2025-03-14T06:37:40.9434841Z  2025-03-14T06:37:40.9435203Z  2025-03-14T06:37:40.9435619Z  2025-03-14T06:37:40.9436011Z  2025-03-14T06:37:40.9436420Z  2025-03-14T06:37:40.9436836Z  2025-03-14T06:37:40.9437239Z  2025-03-14T06:37:40.9438251Z [18,320 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:40.9439381Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T06:37:40.9440292Z Compiling stablehlo/dialect/StablehloOps.cpp; 56s local 2025-03-14T06:37:40.9441238Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2025-03-14T06:37:40.9442214Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T06:37:40.9443110Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2025-03-14T06:37:40.9444174Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 21s local 2025-03-14T06:37:40.9445651Z Compiling stablehlo/reference/Ops.cpp; 20s local 2025-03-14T06:37:40.9446642Z Compiling xla/service/buffer_assignment.cc; 16s local ... 2025-03-14T06:37:41.1646350Z 2025-03-14T06:37:41.1647318Z  2025-03-14T06:37:41.1647866Z  2025-03-14T06:37:41.1648313Z  2025-03-14T06:37:41.1648755Z  2025-03-14T06:37:41.1649218Z  2025-03-14T06:37:41.1649642Z  2025-03-14T06:37:41.1650099Z  2025-03-14T06:37:41.1650533Z  2025-03-14T06:37:41.1651632Z [18,320 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:41.1652673Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T06:37:41.1653576Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T06:37:41.1654646Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2025-03-14T06:37:41.1655759Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 43s local 2025-03-14T06:37:41.1656709Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2025-03-14T06:37:41.1657725Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 22s local 2025-03-14T06:37:41.1658758Z Compiling stablehlo/reference/Ops.cpp; 20s local 2025-03-14T06:37:41.1659645Z Compiling xla/service/buffer_assignment.cc; 16s local ... 2025-03-14T06:37:41.3650059Z 2025-03-14T06:37:41.3651278Z  2025-03-14T06:37:41.3651755Z  2025-03-14T06:37:41.3652259Z  2025-03-14T06:37:41.3652656Z  2025-03-14T06:37:41.3653061Z  2025-03-14T06:37:41.3653430Z  2025-03-14T06:37:41.3653838Z  2025-03-14T06:37:41.3654220Z  2025-03-14T06:37:41.3655210Z [18,322 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:41.3656524Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T06:37:41.3657563Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T06:37:41.3658619Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 51s local 2025-03-14T06:37:41.3659717Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T06:37:41.3660568Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2025-03-14T06:37:41.3661474Z Compiling llvm/lib/CodeGen/GlobalISel/LegalizerHelper.cpp; 22s local 2025-03-14T06:37:41.3662560Z Compiling stablehlo/reference/Ops.cpp; 20s local 2025-03-14T06:37:41.3663456Z Compiling xla/service/buffer_assignment.cc; 16s local ... 2025-03-14T06:37:41.7661562Z 2025-03-14T06:37:41.7662744Z  2025-03-14T06:37:41.7663212Z  2025-03-14T06:37:41.7663588Z  2025-03-14T06:37:41.7663963Z  2025-03-14T06:37:41.7664356Z  2025-03-14T06:37:41.7664687Z  2025-03-14T06:37:41.7665016Z  2025-03-14T06:37:41.7665579Z  2025-03-14T06:37:41.7666527Z [18,323 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:41.7667395Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T06:37:41.7668208Z Compiling stablehlo/dialect/StablehloOps.cpp; 57s local 2025-03-14T06:37:41.7669181Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T06:37:41.7670011Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T06:37:41.7670829Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local 2025-03-14T06:37:41.7671516Z Compiling stablehlo/reference/Ops.cpp; 21s local 2025-03-14T06:37:41.7672159Z Compiling xla/service/buffer_assignment.cc; 17s local 2025-03-14T06:37:41.7673039Z Compiling mlir/lib/Dialect/SCF/Utils/Utils.cpp; 12s local ... 2025-03-14T06:37:42.1673159Z 2025-03-14T06:37:42.1673976Z  2025-03-14T06:37:42.1674471Z  2025-03-14T06:37:42.1674852Z  2025-03-14T06:37:42.1675240Z  2025-03-14T06:37:42.1675695Z  2025-03-14T06:37:42.1676056Z  2025-03-14T06:37:42.1676443Z  2025-03-14T06:37:42.1676853Z  2025-03-14T06:37:42.1678114Z [18,325 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:42.1679203Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T06:37:42.1679986Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T06:37:42.1680803Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T06:37:42.1681802Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 44s local 2025-03-14T06:37:42.1682787Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T06:37:42.1683557Z Compiling stablehlo/reference/Ops.cpp; 21s local 2025-03-14T06:37:42.1684328Z Compiling xla/service/buffer_assignment.cc; 17s local 2025-03-14T06:37:42.1685318Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 12s local ... 2025-03-14T06:37:42.5153266Z 2025-03-14T06:37:42.5154216Z  2025-03-14T06:37:42.5154681Z  2025-03-14T06:37:42.5155094Z  2025-03-14T06:37:42.5155509Z  2025-03-14T06:37:42.5156023Z  2025-03-14T06:37:42.5156415Z  2025-03-14T06:37:42.5156838Z  2025-03-14T06:37:42.5157227Z  2025-03-14T06:37:42.5158155Z [18,326 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:42.5159200Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T06:37:42.5160098Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T06:37:42.5161025Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T06:37:42.5162016Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T06:37:42.5162890Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T06:37:42.5163824Z Compiling stablehlo/reference/Ops.cpp; 21s local 2025-03-14T06:37:42.5165218Z Compiling xla/service/buffer_assignment.cc; 18s local 2025-03-14T06:37:42.5166313Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local ... 2025-03-14T06:37:42.7185912Z 2025-03-14T06:37:42.7186800Z  2025-03-14T06:37:42.7187304Z  2025-03-14T06:37:42.7187733Z  2025-03-14T06:37:42.7188118Z  2025-03-14T06:37:42.7188489Z  2025-03-14T06:37:42.7188877Z  2025-03-14T06:37:42.7189270Z  2025-03-14T06:37:42.7189671Z  2025-03-14T06:37:42.7190907Z [18,328 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:42.7191950Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T06:37:42.7192821Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T06:37:42.7193840Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 52s local 2025-03-14T06:37:42.7194875Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T06:37:42.7195790Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T06:37:42.7196568Z Compiling stablehlo/reference/Ops.cpp; 22s local 2025-03-14T06:37:42.7197328Z Compiling xla/service/buffer_assignment.cc; 18s local 2025-03-14T06:37:42.7198335Z Compiling llvm/lib/Transforms/Vectorize/VPlan.cpp; 13s local ... 2025-03-14T06:37:42.9694270Z 2025-03-14T06:37:42.9695147Z  2025-03-14T06:37:42.9695674Z  2025-03-14T06:37:42.9696076Z  2025-03-14T06:37:42.9696530Z  2025-03-14T06:37:42.9696955Z  2025-03-14T06:37:42.9697354Z  2025-03-14T06:37:42.9697768Z  2025-03-14T06:37:42.9698179Z  2025-03-14T06:37:42.9699170Z [18,331 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:42.9700207Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T06:37:42.9701155Z Compiling stablehlo/dialect/StablehloOps.cpp; 58s local 2025-03-14T06:37:42.9702242Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T06:37:42.9703389Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T06:37:42.9704619Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T06:37:42.9705439Z Compiling stablehlo/reference/Ops.cpp; 22s local 2025-03-14T06:37:42.9706204Z Compiling xla/service/buffer_assignment.cc; 18s local 2025-03-14T06:37:42.9707169Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 11s local ... 2025-03-14T06:37:43.2226134Z 2025-03-14T06:37:43.2226966Z  2025-03-14T06:37:43.2227383Z  2025-03-14T06:37:43.2227755Z  2025-03-14T06:37:43.2228108Z  2025-03-14T06:37:43.2228482Z  2025-03-14T06:37:43.2228835Z  2025-03-14T06:37:43.2229170Z  2025-03-14T06:37:43.2229509Z  2025-03-14T06:37:43.2230337Z [18,332 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:43.2231309Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T06:37:43.2232086Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T06:37:43.2232962Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T06:37:43.2233832Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 45s local 2025-03-14T06:37:43.2234600Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T06:37:43.2235290Z Compiling stablehlo/reference/Ops.cpp; 22s local 2025-03-14T06:37:43.2236014Z Compiling xla/service/buffer_assignment.cc; 18s local 2025-03-14T06:37:43.2236878Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 11s local ... 2025-03-14T06:37:43.5710247Z 2025-03-14T06:37:43.5711104Z  2025-03-14T06:37:43.5711632Z  2025-03-14T06:37:43.5712073Z  2025-03-14T06:37:43.5712536Z  2025-03-14T06:37:43.5713068Z  2025-03-14T06:37:43.5713461Z  2025-03-14T06:37:43.5713855Z  2025-03-14T06:37:43.5714283Z  2025-03-14T06:37:43.5715673Z [18,335 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:43.5716774Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T06:37:43.5717640Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T06:37:43.5718611Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 53s local 2025-03-14T06:37:43.5719534Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2025-03-14T06:37:43.5720703Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T06:37:43.5721478Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T06:37:43.5722778Z Compiling xla/service/buffer_assignment.cc; 19s local 2025-03-14T06:37:43.5723825Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 12s local ... 2025-03-14T06:37:43.9720551Z 2025-03-14T06:37:43.9721384Z  2025-03-14T06:37:43.9721811Z  2025-03-14T06:37:43.9722185Z  2025-03-14T06:37:43.9722589Z  2025-03-14T06:37:43.9722930Z  2025-03-14T06:37:43.9723279Z  2025-03-14T06:37:43.9723637Z  2025-03-14T06:37:43.9724005Z  2025-03-14T06:37:43.9724974Z [18,338 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:37:43.9725964Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2025-03-14T06:37:43.9726776Z Compiling stablehlo/dialect/StablehloOps.cpp; 59s local 2025-03-14T06:37:43.9727671Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T06:37:43.9728904Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 46s local 2025-03-14T06:37:43.9729764Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2025-03-14T06:37:43.9730538Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T06:37:43.9731346Z Compiling xla/service/buffer_assignment.cc; 19s local 2025-03-14T06:37:43.9732280Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 12s local ... 2025-03-14T06:37:44.3732152Z 2025-03-14T06:37:44.3733081Z  2025-03-14T06:37:44.3734821Z  2025-03-14T06:37:44.3735308Z  2025-03-14T06:37:44.3736000Z  2025-03-14T06:37:44.3736433Z  2025-03-14T06:37:44.3736865Z  2025-03-14T06:37:44.3737297Z  2025-03-14T06:37:44.3737703Z  2025-03-14T06:37:44.3738699Z [18,341 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:44.3739829Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2025-03-14T06:37:44.3740738Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T06:37:44.3741792Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T06:37:44.3742922Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T06:37:44.3743863Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2025-03-14T06:37:44.3744696Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T06:37:44.3745552Z Compiling xla/service/buffer_assignment.cc; 19s local 2025-03-14T06:37:44.3746506Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 13s local ... 2025-03-14T06:37:44.5819423Z 2025-03-14T06:37:44.5820270Z  2025-03-14T06:37:44.5820763Z  2025-03-14T06:37:44.5821186Z  2025-03-14T06:37:44.5821588Z  2025-03-14T06:37:44.5822001Z  2025-03-14T06:37:44.5822752Z  2025-03-14T06:37:44.5823298Z  2025-03-14T06:37:44.5823837Z  2025-03-14T06:37:44.5824858Z [18,342 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:44.5826062Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2025-03-14T06:37:44.5826988Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T06:37:44.5827980Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 54s local 2025-03-14T06:37:44.5829090Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T06:37:44.5830627Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2025-03-14T06:37:44.5831463Z Compiling stablehlo/reference/Ops.cpp; 24s local 2025-03-14T06:37:44.5832315Z Compiling xla/service/buffer_assignment.cc; 20s local 2025-03-14T06:37:44.5833334Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 13s local ... 2025-03-14T06:37:44.9749474Z 2025-03-14T06:37:44.9751575Z  2025-03-14T06:37:44.9752075Z  2025-03-14T06:37:44.9752482Z  2025-03-14T06:37:44.9753316Z  2025-03-14T06:37:44.9753699Z  2025-03-14T06:37:44.9754059Z  2025-03-14T06:37:44.9754448Z  2025-03-14T06:37:44.9754845Z  2025-03-14T06:37:44.9755733Z [18,342 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:44.9756763Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2025-03-14T06:37:44.9757628Z Compiling stablehlo/dialect/StablehloOps.cpp; 60s local 2025-03-14T06:37:44.9758591Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T06:37:44.9759610Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T06:37:44.9760448Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T06:37:44.9761218Z Compiling stablehlo/reference/Ops.cpp; 24s local 2025-03-14T06:37:44.9761989Z Compiling xla/service/buffer_assignment.cc; 20s local 2025-03-14T06:37:44.9762940Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 13s local ... 2025-03-14T06:37:45.1754120Z 2025-03-14T06:37:45.1755414Z  2025-03-14T06:37:45.1755908Z  2025-03-14T06:37:45.1756315Z  2025-03-14T06:37:45.1756734Z  2025-03-14T06:37:45.1757147Z  2025-03-14T06:37:45.1757555Z  2025-03-14T06:37:45.1757973Z  2025-03-14T06:37:45.1758371Z  2025-03-14T06:37:45.1759359Z [18,343 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:45.1760509Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2025-03-14T06:37:45.1761396Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2025-03-14T06:37:45.1762793Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T06:37:45.1763793Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 47s local 2025-03-14T06:37:45.1764857Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T06:37:45.1765775Z Compiling stablehlo/reference/Ops.cpp; 24s local 2025-03-14T06:37:45.1766546Z Compiling xla/service/buffer_assignment.cc; 20s local 2025-03-14T06:37:45.1767452Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 13s local ... 2025-03-14T06:37:45.3760523Z 2025-03-14T06:37:45.3761484Z  2025-03-14T06:37:45.3761971Z  2025-03-14T06:37:45.3762405Z  2025-03-14T06:37:45.3762786Z  2025-03-14T06:37:45.3763208Z  2025-03-14T06:37:45.3763611Z  2025-03-14T06:37:45.3764006Z  2025-03-14T06:37:45.3764397Z  2025-03-14T06:37:45.3765619Z [18,344 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:45.3766618Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2025-03-14T06:37:45.3767483Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2025-03-14T06:37:45.3768464Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 55s local 2025-03-14T06:37:45.3769461Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T06:37:45.3770354Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T06:37:45.3771041Z Compiling stablehlo/reference/Ops.cpp; 24s local 2025-03-14T06:37:45.3771761Z Compiling xla/service/buffer_assignment.cc; 20s local 2025-03-14T06:37:45.3772664Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 14s local ... 2025-03-14T06:37:45.7770426Z 2025-03-14T06:37:45.7771316Z  2025-03-14T06:37:45.7771807Z  2025-03-14T06:37:45.7772495Z  2025-03-14T06:37:45.7773026Z  2025-03-14T06:37:45.7773444Z  2025-03-14T06:37:45.7773829Z  2025-03-14T06:37:45.7774206Z  2025-03-14T06:37:45.7774607Z  2025-03-14T06:37:45.7775530Z [18,345 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:45.7776586Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2025-03-14T06:37:45.7777471Z Compiling stablehlo/dialect/StablehloOps.cpp; 61s local 2025-03-14T06:37:45.7778684Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2025-03-14T06:37:45.7779747Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T06:37:45.7780607Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T06:37:45.7781403Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T06:37:45.7782165Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T06:37:46.1780685Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 14s local ... 2025-03-14T06:37:46.1781383Z 2025-03-14T06:37:46.1781826Z  2025-03-14T06:37:46.1782238Z  2025-03-14T06:37:46.1782717Z  2025-03-14T06:37:46.1783137Z  2025-03-14T06:37:46.1783532Z  2025-03-14T06:37:46.1783943Z  2025-03-14T06:37:46.1784313Z  2025-03-14T06:37:46.1784722Z  2025-03-14T06:37:46.1785578Z [18,346 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:46.1786647Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T06:37:46.1787466Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T06:37:46.1788458Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2025-03-14T06:37:46.1789529Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 48s local 2025-03-14T06:37:46.1790413Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T06:37:46.1791175Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T06:37:46.1791966Z Compiling xla/service/buffer_assignment.cc; 21s local 2025-03-14T06:37:46.1793109Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 14s local ... 2025-03-14T06:37:46.4637264Z 2025-03-14T06:37:46.4638113Z  2025-03-14T06:37:46.4638585Z  2025-03-14T06:37:46.4638999Z  2025-03-14T06:37:46.4639425Z  2025-03-14T06:37:46.4639826Z  2025-03-14T06:37:46.4640228Z  2025-03-14T06:37:46.4640635Z  2025-03-14T06:37:46.4641032Z  2025-03-14T06:37:46.4641982Z [18,347 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:46.4643021Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T06:37:46.4643878Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T06:37:46.4645008Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 56s local 2025-03-14T06:37:46.4646041Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T06:37:46.4646892Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T06:37:46.4647651Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T06:37:46.4648425Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T06:37:46.4649360Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 15s local ... 2025-03-14T06:37:46.7796183Z 2025-03-14T06:37:46.7796969Z  2025-03-14T06:37:46.7797424Z  2025-03-14T06:37:46.7797835Z  2025-03-14T06:37:46.7798227Z  2025-03-14T06:37:46.7798604Z  2025-03-14T06:37:46.7799013Z  2025-03-14T06:37:46.7799400Z  2025-03-14T06:37:46.7799789Z  2025-03-14T06:37:46.7800708Z [18,347 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:46.7801728Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T06:37:46.7802811Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T06:37:46.7803898Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T06:37:46.7805062Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T06:37:46.7805894Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T06:37:46.7806632Z Compiling stablehlo/reference/Ops.cpp; 26s local 2025-03-14T06:37:46.7807402Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T06:37:46.7808297Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 15s local ... 2025-03-14T06:37:46.9802070Z 2025-03-14T06:37:46.9802953Z  2025-03-14T06:37:46.9803543Z  2025-03-14T06:37:46.9803958Z  2025-03-14T06:37:46.9804354Z  2025-03-14T06:37:46.9804865Z  2025-03-14T06:37:46.9805279Z  2025-03-14T06:37:46.9805688Z  2025-03-14T06:37:46.9806097Z  2025-03-14T06:37:46.9807065Z [18,348 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:46.9808181Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2025-03-14T06:37:46.9809065Z Compiling stablehlo/dialect/StablehloOps.cpp; 62s local 2025-03-14T06:37:46.9810045Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T06:37:46.9811117Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 49s local 2025-03-14T06:37:46.9811982Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2025-03-14T06:37:46.9812743Z Compiling stablehlo/reference/Ops.cpp; 26s local 2025-03-14T06:37:46.9813536Z Compiling xla/service/buffer_assignment.cc; 22s local 2025-03-14T06:37:46.9814443Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 15s local ... 2025-03-14T06:37:47.6433729Z 2025-03-14T06:37:47.6434563Z  2025-03-14T06:37:47.6435012Z  2025-03-14T06:37:47.6435398Z  2025-03-14T06:37:47.6435784Z  2025-03-14T06:37:47.6436152Z  2025-03-14T06:37:47.6436537Z  2025-03-14T06:37:47.6436950Z  2025-03-14T06:37:47.6437324Z  2025-03-14T06:37:47.6438448Z [18,349 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:47.6439433Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2025-03-14T06:37:47.6440195Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T06:37:47.6441084Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 57s local 2025-03-14T06:37:47.6442052Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T06:37:47.6442818Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2025-03-14T06:37:47.6443516Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T06:37:47.6444205Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T06:37:47.6445286Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 16s local ... 2025-03-14T06:37:47.9831823Z 2025-03-14T06:37:47.9832619Z  2025-03-14T06:37:47.9833030Z  2025-03-14T06:37:47.9833427Z  2025-03-14T06:37:47.9833773Z  2025-03-14T06:37:47.9834106Z  2025-03-14T06:37:47.9834471Z  2025-03-14T06:37:47.9834826Z  2025-03-14T06:37:47.9835169Z  2025-03-14T06:37:47.9835984Z [18,353 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:47.9836885Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T06:37:47.9837655Z Compiling stablehlo/dialect/StablehloOps.cpp; 63s local 2025-03-14T06:37:47.9838493Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T06:37:47.9839376Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T06:37:47.9840122Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T06:37:47.9840808Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T06:37:47.9841522Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T06:37:47.9842581Z Compiling .../shardy/mhlo_round_trip/export_shardings.cc; 16s local ... 2025-03-14T06:37:48.1914401Z 2025-03-14T06:37:48.1915251Z  2025-03-14T06:37:48.1915674Z  2025-03-14T06:37:48.1915988Z  2025-03-14T06:37:48.1916286Z  2025-03-14T06:37:48.1916607Z  2025-03-14T06:37:48.1916918Z  2025-03-14T06:37:48.1917233Z  2025-03-14T06:37:48.1917542Z  2025-03-14T06:37:48.1918290Z [18,357 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:48.1919315Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T06:37:48.1919965Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T06:37:48.1920699Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T06:37:48.1921468Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 50s local 2025-03-14T06:37:48.1922106Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T06:37:48.1922704Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T06:37:48.1923321Z Compiling xla/service/buffer_assignment.cc; 23s local 2025-03-14T06:37:48.1923965Z Compiling xla/service/hlo_proto_util.cc; 14s local ... 2025-03-14T06:37:48.5262322Z 2025-03-14T06:37:48.5263159Z  2025-03-14T06:37:48.5263651Z  2025-03-14T06:37:48.5264068Z  2025-03-14T06:37:48.5264450Z  2025-03-14T06:37:48.5264842Z  2025-03-14T06:37:48.5265232Z  2025-03-14T06:37:48.5265913Z  2025-03-14T06:37:48.5266296Z  2025-03-14T06:37:48.5267191Z [18,359 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:48.5268167Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T06:37:48.5268956Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T06:37:48.5270041Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 58s local 2025-03-14T06:37:48.5271064Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T06:37:48.5271877Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T06:37:48.5272895Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T06:37:48.5273640Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T06:37:48.5274441Z Compiling xla/service/hlo_proto_util.cc; 14s local ... 2025-03-14T06:37:48.7424264Z 2025-03-14T06:37:48.7425107Z  2025-03-14T06:37:48.7425596Z  2025-03-14T06:37:48.7426041Z  2025-03-14T06:37:48.7426419Z  2025-03-14T06:37:48.7426781Z  2025-03-14T06:37:48.7427175Z  2025-03-14T06:37:48.7427558Z  2025-03-14T06:37:48.7427937Z  2025-03-14T06:37:48.7428827Z [18,360 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:48.7429814Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T06:37:48.7430684Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T06:37:48.7431654Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T06:37:48.7432685Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T06:37:48.7433689Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T06:37:48.7434364Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T06:37:48.7435621Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T06:37:48.7436559Z Compiling xla/service/hlo_proto_util.cc; 14s local ... 2025-03-14T06:37:48.9856051Z 2025-03-14T06:37:48.9856900Z  2025-03-14T06:37:48.9857388Z  2025-03-14T06:37:48.9857808Z  2025-03-14T06:37:48.9858227Z  2025-03-14T06:37:48.9858638Z  2025-03-14T06:37:48.9859019Z  2025-03-14T06:37:48.9859433Z  2025-03-14T06:37:48.9859844Z  2025-03-14T06:37:48.9860823Z [18,362 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:48.9862354Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T06:37:48.9863275Z Compiling stablehlo/dialect/StablehloOps.cpp; 64s local 2025-03-14T06:37:48.9864333Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T06:37:48.9865681Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T06:37:48.9866597Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T06:37:48.9867417Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T06:37:48.9868399Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T06:37:48.9869209Z Compiling xla/service/hlo_proto_util.cc; 14s local ... 2025-03-14T06:37:49.1862941Z 2025-03-14T06:37:49.1863875Z  2025-03-14T06:37:49.1864393Z  2025-03-14T06:37:49.1864822Z  2025-03-14T06:37:49.1865238Z  2025-03-14T06:37:49.1865860Z  2025-03-14T06:37:49.1866287Z  2025-03-14T06:37:49.1866719Z  2025-03-14T06:37:49.1867186Z  2025-03-14T06:37:49.1868164Z [18,363 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:49.1869261Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T06:37:49.1870113Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T06:37:49.1871170Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T06:37:49.1872252Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 51s local 2025-03-14T06:37:49.1873169Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T06:37:49.1873973Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T06:37:49.1874793Z Compiling xla/service/buffer_assignment.cc; 24s local 2025-03-14T06:37:49.1875617Z Compiling xla/service/hlo_proto_util.cc; 15s local ... 2025-03-14T06:37:49.5083013Z 2025-03-14T06:37:49.5083899Z  2025-03-14T06:37:49.5084382Z  2025-03-14T06:37:49.5084914Z  2025-03-14T06:37:49.5085380Z  2025-03-14T06:37:49.5085782Z  2025-03-14T06:37:49.5086199Z  2025-03-14T06:37:49.5086589Z  2025-03-14T06:37:49.5087292Z  2025-03-14T06:37:49.5088301Z [18,364 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:49.5089348Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T06:37:49.5090266Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T06:37:49.5091190Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 59s local 2025-03-14T06:37:49.5092203Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T06:37:49.5093155Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T06:37:49.5093882Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T06:37:49.5094657Z Compiling xla/service/buffer_assignment.cc; 25s local 2025-03-14T06:37:49.5095467Z @llvm-project//mlir:AffineTransforms; 13s local ... 2025-03-14T06:37:49.7843008Z 2025-03-14T06:37:49.7843893Z  2025-03-14T06:37:49.7844703Z  2025-03-14T06:37:49.7845146Z  2025-03-14T06:37:49.7845651Z  2025-03-14T06:37:49.7846080Z  2025-03-14T06:37:49.7846541Z  2025-03-14T06:37:49.7846920Z  2025-03-14T06:37:49.7847319Z  2025-03-14T06:37:49.7848449Z [18,366 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:49.7849698Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T06:37:49.7850659Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T06:37:49.7851769Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T06:37:49.7852911Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T06:37:49.7853863Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T06:37:49.7854673Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T06:37:49.7856029Z Compiling xla/service/buffer_assignment.cc; 25s local 2025-03-14T06:37:49.7856923Z @llvm-project//mlir:AffineTransforms; 13s local ... 2025-03-14T06:37:49.9883356Z 2025-03-14T06:37:49.9884220Z  2025-03-14T06:37:49.9884832Z  2025-03-14T06:37:49.9885207Z  2025-03-14T06:37:49.9885624Z  2025-03-14T06:37:49.9886047Z  2025-03-14T06:37:49.9886470Z  2025-03-14T06:37:49.9886859Z  2025-03-14T06:37:49.9887254Z  2025-03-14T06:37:49.9888467Z [18,366 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:49.9889536Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T06:37:49.9890398Z Compiling stablehlo/dialect/StablehloOps.cpp; 65s local 2025-03-14T06:37:49.9891369Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T06:37:49.9892365Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T06:37:49.9893285Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T06:37:49.9894063Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T06:37:49.9894771Z Compiling xla/service/buffer_assignment.cc; 25s local 2025-03-14T06:37:49.9895587Z @llvm-project//mlir:AffineTransforms; 14s local ... 2025-03-14T06:37:50.1888860Z 2025-03-14T06:37:50.1889725Z  2025-03-14T06:37:50.1890202Z  2025-03-14T06:37:50.1890615Z  2025-03-14T06:37:50.1891020Z  2025-03-14T06:37:50.1891458Z  2025-03-14T06:37:50.1891873Z  2025-03-14T06:37:50.1892288Z  2025-03-14T06:37:50.1892703Z  2025-03-14T06:37:50.1893693Z [18,367 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:50.1894779Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T06:37:50.1895664Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T06:37:50.1896693Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T06:37:50.1897760Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 52s local 2025-03-14T06:37:50.1898957Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T06:37:50.1899739Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T06:37:50.1900545Z Compiling xla/service/buffer_assignment.cc; 25s local 2025-03-14T06:37:50.1901353Z @llvm-project//mlir:AffineTransforms; 14s local ... 2025-03-14T06:37:50.5568197Z 2025-03-14T06:37:50.5569023Z  2025-03-14T06:37:50.5569486Z  2025-03-14T06:37:50.5569862Z  2025-03-14T06:37:50.5570257Z  2025-03-14T06:37:50.5570656Z  2025-03-14T06:37:50.5570975Z  2025-03-14T06:37:50.5571283Z  2025-03-14T06:37:50.5571595Z  2025-03-14T06:37:50.5572401Z [18,369 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:50.5573357Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T06:37:50.5574211Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T06:37:50.5575228Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 60s local 2025-03-14T06:37:50.5576261Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T06:37:50.5577108Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T06:37:50.5577904Z Compiling stablehlo/reference/Ops.cpp; 30s local 2025-03-14T06:37:50.5578620Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:50.5579399Z @llvm-project//mlir:AffineTransforms; 14s local ... 2025-03-14T06:37:50.7906075Z 2025-03-14T06:37:50.7906882Z  2025-03-14T06:37:50.7907515Z  2025-03-14T06:37:50.7907943Z  2025-03-14T06:37:50.7908359Z  2025-03-14T06:37:50.7908771Z  2025-03-14T06:37:50.7909181Z  2025-03-14T06:37:50.7909588Z  2025-03-14T06:37:50.7909974Z  2025-03-14T06:37:50.7911224Z [18,371 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:50.7912422Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T06:37:50.7913310Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T06:37:50.7914313Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T06:37:50.7915385Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T06:37:50.7916393Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T06:37:50.7917391Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:50.7918363Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2025-03-14T06:37:50.7919305Z @llvm-project//mlir:MathTransforms; 12s local ... 2025-03-14T06:37:50.9910281Z 2025-03-14T06:37:50.9911133Z  2025-03-14T06:37:50.9911566Z  2025-03-14T06:37:50.9911937Z  2025-03-14T06:37:50.9912298Z  2025-03-14T06:37:50.9912655Z  2025-03-14T06:37:50.9913056Z  2025-03-14T06:37:50.9913417Z  2025-03-14T06:37:50.9913775Z  2025-03-14T06:37:50.9914755Z [18,374 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:50.9915736Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T06:37:50.9916501Z Compiling stablehlo/dialect/StablehloOps.cpp; 66s local 2025-03-14T06:37:50.9917387Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T06:37:50.9918306Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T06:37:50.9919049Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T06:37:50.9930361Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:50.9931458Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2025-03-14T06:37:50.9932387Z @llvm-project//mlir:MathTransforms; 12s local ... 2025-03-14T06:37:51.3066012Z 2025-03-14T06:37:51.3075459Z  2025-03-14T06:37:51.3075950Z  2025-03-14T06:37:51.3076358Z  2025-03-14T06:37:51.3076728Z  2025-03-14T06:37:51.3077143Z  2025-03-14T06:37:51.3077807Z  2025-03-14T06:37:51.3078224Z  2025-03-14T06:37:51.3078606Z  2025-03-14T06:37:51.3079510Z [18,375 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:51.3080565Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T06:37:51.3081372Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T06:37:51.3082461Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T06:37:51.3083479Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 53s local 2025-03-14T06:37:51.3084322Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T06:37:51.3085255Z Compiling xla/service/buffer_assignment.cc; 26s local 2025-03-14T06:37:51.3086174Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 14s local 2025-03-14T06:37:51.3087097Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:37:51.5389242Z 2025-03-14T06:37:51.5390109Z  2025-03-14T06:37:51.5390539Z  2025-03-14T06:37:51.5390887Z  2025-03-14T06:37:51.5391220Z  2025-03-14T06:37:51.5391586Z  2025-03-14T06:37:51.5391979Z  2025-03-14T06:37:51.5392365Z  2025-03-14T06:37:51.5392755Z  2025-03-14T06:37:51.5393601Z [18,376 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:51.5394553Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T06:37:51.5395477Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T06:37:51.5396248Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 61s local 2025-03-14T06:37:51.5397241Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T06:37:51.5398215Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T06:37:51.5398966Z Compiling xla/service/buffer_assignment.cc; 27s local 2025-03-14T06:37:51.5399863Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T06:37:51.5400619Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:37:51.7916096Z 2025-03-14T06:37:51.7916948Z  2025-03-14T06:37:51.7917448Z  2025-03-14T06:37:51.7917906Z  2025-03-14T06:37:51.7918350Z  2025-03-14T06:37:51.7919023Z  2025-03-14T06:37:51.7919464Z  2025-03-14T06:37:51.7919889Z  2025-03-14T06:37:51.7920324Z  2025-03-14T06:37:51.7921340Z [18,378 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:51.7922505Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T06:37:51.7923463Z Compiling stablehlo/dialect/StablehloOps.cpp; 67s local 2025-03-14T06:37:51.7924700Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T06:37:51.7925840Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T06:37:51.7926791Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T06:37:51.7927683Z Compiling xla/service/buffer_assignment.cc; 27s local 2025-03-14T06:37:51.7928737Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T06:37:51.7929783Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:37:52.1453828Z 2025-03-14T06:37:52.1454814Z  2025-03-14T06:37:52.1455287Z  2025-03-14T06:37:52.1455719Z  2025-03-14T06:37:52.1456150Z  2025-03-14T06:37:52.1456568Z  2025-03-14T06:37:52.1456990Z  2025-03-14T06:37:52.1457415Z  2025-03-14T06:37:52.1457838Z  2025-03-14T06:37:52.1458809Z [18,379 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:52.1459933Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T06:37:52.1460846Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T06:37:52.1462176Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T06:37:52.1463264Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 54s local 2025-03-14T06:37:52.1464067Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T06:37:52.1464889Z Compiling xla/service/buffer_assignment.cc; 27s local 2025-03-14T06:37:52.1466156Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T06:37:52.1467138Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:37:52.3808406Z 2025-03-14T06:37:52.3809277Z  2025-03-14T06:37:52.3809778Z  2025-03-14T06:37:52.3810154Z  2025-03-14T06:37:52.3810521Z  2025-03-14T06:37:52.3810883Z  2025-03-14T06:37:52.3811225Z  2025-03-14T06:37:52.3811596Z  2025-03-14T06:37:52.3811958Z  2025-03-14T06:37:52.3812850Z [18,380 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:52.3813819Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T06:37:52.3814608Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T06:37:52.3815498Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T06:37:52.3816478Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T06:37:52.3817292Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T06:37:52.3818020Z Compiling xla/service/buffer_assignment.cc; 27s local 2025-03-14T06:37:52.3818883Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 15s local 2025-03-14T06:37:52.3819809Z @llvm-project//mlir:MathTransforms; 14s local ... 2025-03-14T06:37:52.5922641Z 2025-03-14T06:37:52.5923461Z  2025-03-14T06:37:52.5923938Z  2025-03-14T06:37:52.5924350Z  2025-03-14T06:37:52.5924875Z  2025-03-14T06:37:52.5925285Z  2025-03-14T06:37:52.5926060Z  2025-03-14T06:37:52.5926487Z  2025-03-14T06:37:52.5926893Z  2025-03-14T06:37:52.5927884Z [18,380 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:52.5928908Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T06:37:52.5929767Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T06:37:52.5930752Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 62s local 2025-03-14T06:37:52.5931978Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T06:37:52.5932850Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T06:37:52.5933561Z Compiling xla/service/buffer_assignment.cc; 28s local 2025-03-14T06:37:52.5934462Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T06:37:52.5935327Z @llvm-project//mlir:MathTransforms; 14s local ... 2025-03-14T06:37:52.8953486Z 2025-03-14T06:37:52.8954346Z  2025-03-14T06:37:52.8954823Z  2025-03-14T06:37:52.8955236Z  2025-03-14T06:37:52.8955639Z  2025-03-14T06:37:52.8956013Z  2025-03-14T06:37:52.8956401Z  2025-03-14T06:37:52.8956807Z  2025-03-14T06:37:52.8957222Z  2025-03-14T06:37:52.8958215Z [18,381 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:52.8959335Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T06:37:52.8960170Z Compiling stablehlo/dialect/StablehloOps.cpp; 68s local 2025-03-14T06:37:52.8961145Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T06:37:52.8962198Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T06:37:52.8963076Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T06:37:52.8963878Z Compiling xla/service/buffer_assignment.cc; 28s local 2025-03-14T06:37:52.8965076Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T06:37:52.8966204Z @llvm-project//mlir:MathTransforms; 14s local ... 2025-03-14T06:37:53.0960857Z 2025-03-14T06:37:53.0961978Z  2025-03-14T06:37:53.0962490Z  2025-03-14T06:37:53.0962897Z  2025-03-14T06:37:53.0963287Z  2025-03-14T06:37:53.0963784Z  2025-03-14T06:37:53.0964172Z  2025-03-14T06:37:53.0964700Z  2025-03-14T06:37:53.0965100Z  2025-03-14T06:37:53.0966225Z [18,383 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:53.0967281Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T06:37:53.0968214Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T06:37:53.0969234Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T06:37:53.0970283Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 55s local 2025-03-14T06:37:53.0971164Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T06:37:53.0972228Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T06:37:53.0973172Z @llvm-project//mlir:MathTransforms; 14s local 2025-03-14T06:37:53.0973927Z @llvm-project//mlir:BufferizationTransforms; 13s local ... 2025-03-14T06:37:53.3929502Z 2025-03-14T06:37:53.3930348Z  2025-03-14T06:37:53.3930853Z  2025-03-14T06:37:53.3931278Z  2025-03-14T06:37:53.3931717Z  2025-03-14T06:37:53.3932171Z  2025-03-14T06:37:53.3932582Z  2025-03-14T06:37:53.3933005Z  2025-03-14T06:37:53.3933414Z  2025-03-14T06:37:53.3934370Z [18,384 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:53.3935477Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T06:37:53.3936355Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T06:37:53.3937703Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T06:37:53.3938948Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T06:37:53.3939883Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T06:37:53.3940896Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 16s local 2025-03-14T06:37:53.3941700Z @llvm-project//mlir:MathTransforms; 15s local 2025-03-14T06:37:53.3942439Z @llvm-project//mlir:BufferizationTransforms; 13s local ... 2025-03-14T06:37:53.7105304Z 2025-03-14T06:37:53.7106144Z  2025-03-14T06:37:53.7106591Z  2025-03-14T06:37:53.7106966Z  2025-03-14T06:37:53.7107361Z  2025-03-14T06:37:53.7107745Z  2025-03-14T06:37:53.7108128Z  2025-03-14T06:37:53.7108505Z  2025-03-14T06:37:53.7108917Z  2025-03-14T06:37:53.7109787Z [18,385 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:53.7110785Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T06:37:53.7111640Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T06:37:53.7112713Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 63s local 2025-03-14T06:37:53.7113597Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T06:37:53.7114330Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T06:37:53.7115151Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T06:37:53.7115973Z @llvm-project//mlir:MathTransforms; 15s local 2025-03-14T06:37:53.7116691Z @llvm-project//mlir:BufferizationTransforms; 14s local ... 2025-03-14T06:37:53.9934366Z 2025-03-14T06:37:53.9935143Z  2025-03-14T06:37:53.9935545Z  2025-03-14T06:37:53.9935878Z  2025-03-14T06:37:53.9936202Z  2025-03-14T06:37:53.9936524Z  2025-03-14T06:37:53.9936843Z  2025-03-14T06:37:53.9937164Z  2025-03-14T06:37:53.9937461Z  2025-03-14T06:37:53.9938263Z [18,387 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:53.9939444Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T06:37:53.9940135Z Compiling stablehlo/dialect/StablehloOps.cpp; 69s local 2025-03-14T06:37:53.9940906Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T06:37:53.9941689Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T06:37:53.9942368Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T06:37:53.9943082Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T06:37:53.9943794Z @llvm-project//mlir:MathTransforms; 15s local 2025-03-14T06:37:53.9944547Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local ... 2025-03-14T06:37:54.3229842Z 2025-03-14T06:37:54.3230797Z  2025-03-14T06:37:54.3231269Z  2025-03-14T06:37:54.3232028Z  2025-03-14T06:37:54.3232556Z  2025-03-14T06:37:54.3233113Z  2025-03-14T06:37:54.3233636Z  2025-03-14T06:37:54.3234138Z  2025-03-14T06:37:54.3234656Z  2025-03-14T06:37:54.3235815Z [18,389 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:54.3236944Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T06:37:54.3237926Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T06:37:54.3239061Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T06:37:54.3240353Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 56s local 2025-03-14T06:37:54.3241282Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T06:37:54.3242385Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 17s local 2025-03-14T06:37:54.3243620Z @llvm-project//mlir:MathTransforms; 16s local 2025-03-14T06:37:54.3245127Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local ... 2025-03-14T06:37:54.5938315Z 2025-03-14T06:37:54.5939161Z  2025-03-14T06:37:54.5939614Z  2025-03-14T06:37:54.5940000Z  2025-03-14T06:37:54.5940443Z  2025-03-14T06:37:54.5940884Z  2025-03-14T06:37:54.5941321Z  2025-03-14T06:37:54.5941747Z  2025-03-14T06:37:54.5942233Z  2025-03-14T06:37:54.5943277Z [18,390 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:54.5944606Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T06:37:54.5945521Z Compiling stablehlo/dialect/StablehloOps.cpp; 70s local 2025-03-14T06:37:54.5946480Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 64s local 2025-03-14T06:37:54.5947520Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T06:37:54.5948365Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T06:37:54.5949347Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2025-03-14T06:37:54.5950217Z @llvm-project//mlir:MathTransforms; 16s local 2025-03-14T06:37:54.5951027Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 13s local ... 2025-03-14T06:37:55.2943997Z 2025-03-14T06:37:55.2944925Z  2025-03-14T06:37:55.2945413Z  2025-03-14T06:37:55.2945793Z  2025-03-14T06:37:55.2946189Z  2025-03-14T06:37:55.2947013Z  2025-03-14T06:37:55.2947654Z  2025-03-14T06:37:55.2948215Z  2025-03-14T06:37:55.2948764Z  2025-03-14T06:37:55.2949799Z [18,391 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:55.2951013Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T06:37:55.2952063Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T06:37:55.2953172Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T06:37:55.2954359Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 57s local 2025-03-14T06:37:55.2955314Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T06:37:55.2956635Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 18s local 2025-03-14T06:37:55.2957700Z @llvm-project//mlir:MathTransforms; 17s local 2025-03-14T06:37:55.2958790Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local ... 2025-03-14T06:37:55.5945659Z 2025-03-14T06:37:55.5946497Z  2025-03-14T06:37:55.5946968Z  2025-03-14T06:37:55.5947419Z  2025-03-14T06:37:55.5947835Z  2025-03-14T06:37:55.5948243Z  2025-03-14T06:37:55.5948656Z  2025-03-14T06:37:55.5949032Z  2025-03-14T06:37:55.5949398Z  2025-03-14T06:37:55.5950313Z [18,392 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:55.5951317Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T06:37:55.5952180Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T06:37:55.5953186Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 65s local 2025-03-14T06:37:55.5954348Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2025-03-14T06:37:55.5955126Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T06:37:55.5956172Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T06:37:55.5957056Z @llvm-project//mlir:MathTransforms; 17s local 2025-03-14T06:37:55.5957981Z Compiling llvm/lib/Transforms/Vectorize/VPlanTransforms.cpp; 14s local ... 2025-03-14T06:37:55.7948677Z 2025-03-14T06:37:55.7949563Z  2025-03-14T06:37:55.7950013Z  2025-03-14T06:37:55.7950400Z  2025-03-14T06:37:55.7950779Z  2025-03-14T06:37:55.7951174Z  2025-03-14T06:37:55.7951535Z  2025-03-14T06:37:55.7951928Z  2025-03-14T06:37:55.7952326Z  2025-03-14T06:37:55.7953561Z [18,393 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:55.7954712Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T06:37:55.7955530Z Compiling stablehlo/dialect/StablehloOps.cpp; 71s local 2025-03-14T06:37:55.7956501Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T06:37:55.7957501Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2025-03-14T06:37:55.7958321Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T06:37:55.7959378Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T06:37:55.7960287Z @llvm-project//mlir:MathTransforms; 17s local 2025-03-14T06:37:55.7961141Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 14s local ... 2025-03-14T06:37:56.1953201Z 2025-03-14T06:37:56.1954133Z  2025-03-14T06:37:56.1954615Z  2025-03-14T06:37:56.1955009Z  2025-03-14T06:37:56.1955759Z  2025-03-14T06:37:56.1956344Z  2025-03-14T06:37:56.1956874Z  2025-03-14T06:37:56.1957451Z  2025-03-14T06:37:56.1957987Z  2025-03-14T06:37:56.1959138Z [18,395 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:56.1960355Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T06:37:56.1961350Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T06:37:56.1962504Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T06:37:56.1963714Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 58s local 2025-03-14T06:37:56.1964819Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T06:37:56.1966888Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T06:37:56.1967764Z @llvm-project//mlir:MathTransforms; 18s local 2025-03-14T06:37:56.1968578Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 13s local ... 2025-03-14T06:37:56.4574627Z 2025-03-14T06:37:56.4575530Z  2025-03-14T06:37:56.4576054Z  2025-03-14T06:37:56.4576446Z  2025-03-14T06:37:56.4576823Z  2025-03-14T06:37:56.4577215Z  2025-03-14T06:37:56.4577844Z  2025-03-14T06:37:56.4578247Z  2025-03-14T06:37:56.4578639Z  2025-03-14T06:37:56.4579545Z [18,398 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:56.4580526Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T06:37:56.4581352Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T06:37:56.4582240Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 66s local 2025-03-14T06:37:56.4583202Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T06:37:56.4584066Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T06:37:56.4584999Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 19s local 2025-03-14T06:37:56.4585831Z @llvm-project//mlir:MathTransforms; 18s local 2025-03-14T06:37:56.4586651Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 13s local ... 2025-03-14T06:37:56.7345451Z 2025-03-14T06:37:56.7346483Z  2025-03-14T06:37:56.7347005Z  2025-03-14T06:37:56.7347466Z  2025-03-14T06:37:56.7347934Z  2025-03-14T06:37:56.7348402Z  2025-03-14T06:37:56.7348855Z  2025-03-14T06:37:56.7349315Z  2025-03-14T06:37:56.7349779Z  2025-03-14T06:37:56.7350868Z [18,399 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:56.7352096Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T06:37:56.7353105Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T06:37:56.7354271Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T06:37:56.7355477Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T06:37:56.7356481Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T06:37:56.7357932Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T06:37:56.7359020Z @llvm-project//mlir:MathTransforms; 18s local 2025-03-14T06:37:56.7360012Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 14s local ... 2025-03-14T06:37:56.9884182Z 2025-03-14T06:37:56.9885267Z  2025-03-14T06:37:56.9885770Z  2025-03-14T06:37:56.9886154Z  2025-03-14T06:37:56.9886545Z  2025-03-14T06:37:56.9886920Z  2025-03-14T06:37:56.9887572Z  2025-03-14T06:37:56.9887979Z  2025-03-14T06:37:56.9888367Z  2025-03-14T06:37:56.9889282Z [18,403 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:56.9890321Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T06:37:56.9891177Z Compiling stablehlo/dialect/StablehloOps.cpp; 72s local 2025-03-14T06:37:56.9892143Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T06:37:56.9893173Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T06:37:56.9894016Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T06:37:56.9894948Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T06:37:56.9895959Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 14s local 2025-03-14T06:37:56.9896788Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:37:57.1961628Z 2025-03-14T06:37:57.1963288Z  2025-03-14T06:37:57.1964055Z  2025-03-14T06:37:57.1964922Z  2025-03-14T06:37:57.1966153Z  2025-03-14T06:37:57.1966598Z  2025-03-14T06:37:57.1966959Z  2025-03-14T06:37:57.1967321Z  2025-03-14T06:37:57.1967679Z  2025-03-14T06:37:57.1968523Z [18,404 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:57.1969456Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T06:37:57.1970281Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2025-03-14T06:37:57.1971429Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T06:37:57.1972385Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 59s local 2025-03-14T06:37:57.1973207Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T06:37:57.1974091Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 20s local 2025-03-14T06:37:57.1975045Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 14s local 2025-03-14T06:37:57.1975827Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:37:57.5221392Z 2025-03-14T06:37:57.5222306Z  2025-03-14T06:37:57.5222768Z  2025-03-14T06:37:57.5223151Z  2025-03-14T06:37:57.5223547Z  2025-03-14T06:37:57.5223980Z  2025-03-14T06:37:57.5224434Z  2025-03-14T06:37:57.5224801Z  2025-03-14T06:37:57.5225110Z  2025-03-14T06:37:57.5226022Z [18,406 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:57.5227058Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T06:37:57.5227850Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2025-03-14T06:37:57.5228845Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 67s local 2025-03-14T06:37:57.5229913Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T06:37:57.5230776Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T06:37:57.5231702Z Compiling llvm/lib/Transforms/IPO/WholeProgramDevirt.cpp; 21s local 2025-03-14T06:37:57.5232747Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 14s local 2025-03-14T06:37:57.5233599Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:37:57.7966976Z 2025-03-14T06:37:57.7967893Z  2025-03-14T06:37:57.7968388Z  2025-03-14T06:37:57.7969002Z  2025-03-14T06:37:57.7969437Z  2025-03-14T06:37:57.7970212Z  2025-03-14T06:37:57.7970912Z  2025-03-14T06:37:57.7971422Z  2025-03-14T06:37:57.7971935Z  2025-03-14T06:37:57.7973017Z [18,409 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:57.7974195Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T06:37:57.7975169Z Compiling stablehlo/dialect/StablehloOps.cpp; 73s local 2025-03-14T06:37:57.7976267Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2025-03-14T06:37:57.7977562Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 60s local 2025-03-14T06:37:57.7978526Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T06:37:57.7979474Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 15s local 2025-03-14T06:37:57.7980420Z @llvm-project//mlir:MathTransforms; 13s local 2025-03-14T06:37:57.7981247Z Compiling xla/runtime/buffer_use.cc; 10s local ... 2025-03-14T06:37:58.6355645Z 2025-03-14T06:37:58.6356799Z  2025-03-14T06:37:58.6357588Z  2025-03-14T06:37:58.6358215Z  2025-03-14T06:37:58.6358584Z  2025-03-14T06:37:58.6359056Z  2025-03-14T06:37:58.6359458Z  2025-03-14T06:37:58.6359829Z  2025-03-14T06:37:58.6360199Z  2025-03-14T06:37:58.6361087Z [18,410 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:58.6362012Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2025-03-14T06:37:58.6362783Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2025-03-14T06:37:58.6363633Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 68s local 2025-03-14T06:37:58.6364664Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2025-03-14T06:37:58.6365690Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2025-03-14T06:37:58.6366461Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 16s local 2025-03-14T06:37:58.6367208Z @llvm-project//mlir:MathTransforms; 14s local 2025-03-14T06:37:58.6367871Z Compiling xla/runtime/buffer_use.cc; 10s local ... 2025-03-14T06:37:58.9976644Z 2025-03-14T06:37:58.9978058Z  2025-03-14T06:37:58.9978950Z  2025-03-14T06:37:58.9979580Z  2025-03-14T06:37:58.9980022Z  2025-03-14T06:37:58.9980465Z  2025-03-14T06:37:58.9980805Z  2025-03-14T06:37:58.9981185Z  2025-03-14T06:37:58.9981567Z  2025-03-14T06:37:58.9982471Z [18,412 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:58.9983532Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T06:37:58.9984421Z Compiling stablehlo/dialect/StablehloOps.cpp; 74s local 2025-03-14T06:37:58.9985402Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T06:37:58.9986430Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2025-03-14T06:37:58.9987288Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T06:37:58.9988145Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 16s local 2025-03-14T06:37:58.9988951Z @llvm-project//mlir:MathTransforms; 15s local 2025-03-14T06:37:58.9989680Z Compiling xla/runtime/buffer_use.cc; 11s local ... 2025-03-14T06:37:59.1979449Z 2025-03-14T06:37:59.1980926Z  2025-03-14T06:37:59.1981355Z  2025-03-14T06:37:59.1981852Z  2025-03-14T06:37:59.1982244Z  2025-03-14T06:37:59.1982629Z  2025-03-14T06:37:59.1983076Z  2025-03-14T06:37:59.1983454Z  2025-03-14T06:37:59.1983798Z  2025-03-14T06:37:59.1984716Z [18,413 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:59.1985709Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T06:37:59.1986768Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T06:37:59.1987760Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T06:37:59.1989151Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 61s local 2025-03-14T06:37:59.1990035Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T06:37:59.1990808Z Compiling llvm/lib/Target/X86/X86MCInstLower.cpp; 16s local 2025-03-14T06:37:59.1991602Z @llvm-project//mlir:MathTransforms; 15s local 2025-03-14T06:37:59.1992311Z Compiling xla/runtime/buffer_use.cc; 11s local ... 2025-03-14T06:37:59.4112499Z 2025-03-14T06:37:59.4113671Z  2025-03-14T06:37:59.4114750Z  2025-03-14T06:37:59.4115385Z  2025-03-14T06:37:59.4115798Z  2025-03-14T06:37:59.4116209Z  2025-03-14T06:37:59.4116647Z  2025-03-14T06:37:59.4116987Z  2025-03-14T06:37:59.4117318Z  2025-03-14T06:37:59.4118230Z [18,415 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:37:59.4119088Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T06:37:59.4119778Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T06:37:59.4120686Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 69s local 2025-03-14T06:37:59.4121677Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T06:37:59.4122580Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T06:37:59.4123300Z @llvm-project//mlir:MathTransforms; 15s local 2025-03-14T06:37:59.4124006Z Compiling xla/runtime/buffer_use.cc; 11s local 2025-03-14T06:37:59.4124958Z Compiling mlir/lib/Dialect/SCF/Utils/Utils.cpp; 11s local ... 2025-03-14T06:37:59.7984072Z 2025-03-14T06:37:59.7985638Z  2025-03-14T06:37:59.7986107Z  2025-03-14T06:37:59.7987566Z  2025-03-14T06:37:59.7988363Z  2025-03-14T06:37:59.7989570Z  2025-03-14T06:37:59.7990771Z  2025-03-14T06:37:59.7992133Z  2025-03-14T06:37:59.7993331Z  2025-03-14T06:37:59.7995206Z [18,416 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:37:59.7996301Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T06:37:59.7997592Z Compiling stablehlo/dialect/StablehloOps.cpp; 75s local 2025-03-14T06:37:59.7998622Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T06:37:59.7999841Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T06:37:59.8000752Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T06:37:59.8001545Z @llvm-project//mlir:MathTransforms; 15s local 2025-03-14T06:37:59.8002220Z Compiling xla/runtime/buffer_use.cc; 12s local 2025-03-14T06:37:59.8002974Z Compiling mlir/lib/Dialect/SCF/Utils/Utils.cpp; 12s local ... 2025-03-14T06:38:00.1893576Z 2025-03-14T06:38:00.1894585Z  2025-03-14T06:38:00.1895030Z  2025-03-14T06:38:00.1895414Z  2025-03-14T06:38:00.1896015Z  2025-03-14T06:38:00.1896521Z  2025-03-14T06:38:00.1896979Z  2025-03-14T06:38:00.1897381Z  2025-03-14T06:38:00.1897844Z  2025-03-14T06:38:00.1898754Z [18,417 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:00.1899935Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T06:38:00.1900742Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2025-03-14T06:38:00.1901669Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T06:38:00.1902715Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 62s local 2025-03-14T06:38:00.1903500Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T06:38:00.1904250Z @llvm-project//mlir:MathTransforms; 16s local 2025-03-14T06:38:00.1904974Z Compiling xla/runtime/buffer_use.cc; 12s local 2025-03-14T06:38:00.1905849Z @llvm-project//mlir:BufferizationTransforms; 12s local ... 2025-03-14T06:38:00.3988847Z 2025-03-14T06:38:00.3989677Z  2025-03-14T06:38:00.3990141Z  2025-03-14T06:38:00.3990777Z  2025-03-14T06:38:00.3991324Z  2025-03-14T06:38:00.3991718Z  2025-03-14T06:38:00.3992129Z  2025-03-14T06:38:00.3992502Z  2025-03-14T06:38:00.3992916Z  2025-03-14T06:38:00.3993851Z [18,418 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:00.3994945Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T06:38:00.3995789Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2025-03-14T06:38:00.3996976Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 70s local 2025-03-14T06:38:00.3997992Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T06:38:00.3998829Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T06:38:00.3999529Z @llvm-project//mlir:MathTransforms; 16s local 2025-03-14T06:38:00.4000217Z Compiling xla/runtime/buffer_use.cc; 12s local 2025-03-14T06:38:00.4000999Z @llvm-project//mlir:BufferizationTransforms; 12s local ... 2025-03-14T06:38:00.7258456Z 2025-03-14T06:38:00.7259329Z  2025-03-14T06:38:00.7259823Z  2025-03-14T06:38:00.7260233Z  2025-03-14T06:38:00.7260670Z  2025-03-14T06:38:00.7261088Z  2025-03-14T06:38:00.7261508Z  2025-03-14T06:38:00.7261909Z  2025-03-14T06:38:00.7262305Z  2025-03-14T06:38:00.7263264Z [18,419 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:00.7264340Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T06:38:00.7265223Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2025-03-14T06:38:00.7266491Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T06:38:00.7267588Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T06:38:00.7268502Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T06:38:00.7269291Z @llvm-project//mlir:MathTransforms; 16s local 2025-03-14T06:38:00.7270055Z Compiling xla/runtime/buffer_use.cc; 13s local 2025-03-14T06:38:00.7271071Z @llvm-project//mlir:BufferizationTransforms; 12s local ... 2025-03-14T06:38:01.0298837Z 2025-03-14T06:38:01.0299656Z  2025-03-14T06:38:01.0300123Z  2025-03-14T06:38:01.0300536Z  2025-03-14T06:38:01.0300946Z  2025-03-14T06:38:01.0301336Z  2025-03-14T06:38:01.0301734Z  2025-03-14T06:38:01.0302113Z  2025-03-14T06:38:01.0302538Z  2025-03-14T06:38:01.0303600Z [18,420 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:01.0304686Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T06:38:01.0305531Z Compiling stablehlo/dialect/StablehloOps.cpp; 76s local 2025-03-14T06:38:01.0306475Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T06:38:01.0307450Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T06:38:01.0308306Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T06:38:01.0309059Z @llvm-project//mlir:MathTransforms; 17s local 2025-03-14T06:38:01.0309756Z Compiling xla/runtime/buffer_use.cc; 13s local 2025-03-14T06:38:01.0310574Z @llvm-project//mlir:BufferizationTransforms; 13s local ... 2025-03-14T06:38:01.3155932Z 2025-03-14T06:38:01.3156802Z  2025-03-14T06:38:01.3157256Z  2025-03-14T06:38:01.3157617Z  2025-03-14T06:38:01.3157983Z  2025-03-14T06:38:01.3158362Z  2025-03-14T06:38:01.3158729Z  2025-03-14T06:38:01.3159085Z  2025-03-14T06:38:01.3159456Z  2025-03-14T06:38:01.3160284Z [18,423 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:01.3161236Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T06:38:01.3162035Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T06:38:01.3163126Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T06:38:01.3164123Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 63s local 2025-03-14T06:38:01.3165060Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T06:38:01.3165951Z @llvm-project//mlir:MathTransforms; 17s local 2025-03-14T06:38:01.3166632Z Compiling xla/runtime/buffer_use.cc; 13s local 2025-03-14T06:38:01.3167379Z @llvm-project//mlir:BufferizationTransforms; 13s local ... 2025-03-14T06:38:01.5363761Z 2025-03-14T06:38:01.5364903Z  2025-03-14T06:38:01.5365573Z  2025-03-14T06:38:01.5366007Z  2025-03-14T06:38:01.5366416Z  2025-03-14T06:38:01.5366827Z  2025-03-14T06:38:01.5367232Z  2025-03-14T06:38:01.5367614Z  2025-03-14T06:38:01.5368012Z  2025-03-14T06:38:01.5368946Z [18,424 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:01.5369994Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T06:38:01.5370855Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T06:38:01.5371853Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 71s local 2025-03-14T06:38:01.5372910Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T06:38:01.5373787Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T06:38:01.5374561Z @llvm-project//mlir:MathTransforms; 17s local 2025-03-14T06:38:01.5375285Z Compiling xla/runtime/buffer_use.cc; 13s local 2025-03-14T06:38:01.5376193Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 13s local ... 2025-03-14T06:38:01.8305456Z 2025-03-14T06:38:01.8306285Z  2025-03-14T06:38:01.8306733Z  2025-03-14T06:38:01.8307095Z  2025-03-14T06:38:01.8307495Z  2025-03-14T06:38:01.8307892Z  2025-03-14T06:38:01.8308372Z  2025-03-14T06:38:01.8308751Z  2025-03-14T06:38:01.8309154Z  2025-03-14T06:38:01.8310215Z [18,424 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:01.8311489Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T06:38:01.8312418Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T06:38:01.8313307Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T06:38:01.8314241Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T06:38:01.8315060Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T06:38:01.8315784Z @llvm-project//mlir:MathTransforms; 17s local 2025-03-14T06:38:01.8316447Z Compiling xla/runtime/buffer_use.cc; 14s local 2025-03-14T06:38:01.8317279Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 13s local ... 2025-03-14T06:38:02.0473986Z 2025-03-14T06:38:02.0474827Z  2025-03-14T06:38:02.0475295Z  2025-03-14T06:38:02.0475693Z  2025-03-14T06:38:02.0476087Z  2025-03-14T06:38:02.0476490Z  2025-03-14T06:38:02.0476922Z  2025-03-14T06:38:02.0477292Z  2025-03-14T06:38:02.0477661Z  2025-03-14T06:38:02.0478537Z [18,426 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:02.0479558Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T06:38:02.0480387Z Compiling stablehlo/dialect/StablehloOps.cpp; 77s local 2025-03-14T06:38:02.0481380Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T06:38:02.0482382Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T06:38:02.0483228Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T06:38:02.0483922Z @llvm-project//mlir:MathTransforms; 18s local 2025-03-14T06:38:02.0484968Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 13s local 2025-03-14T06:38:02.0485977Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T06:38:02.2584515Z 2025-03-14T06:38:02.2585746Z  2025-03-14T06:38:02.2586153Z  2025-03-14T06:38:02.2586475Z  2025-03-14T06:38:02.2586831Z  2025-03-14T06:38:02.2587218Z  2025-03-14T06:38:02.2587576Z  2025-03-14T06:38:02.2587938Z  2025-03-14T06:38:02.2588317Z  2025-03-14T06:38:02.2589112Z [18,428 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:02.2589958Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T06:38:02.2590866Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T06:38:02.2591646Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T06:38:02.2592471Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 64s local 2025-03-14T06:38:02.2593216Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T06:38:02.2593980Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 14s local 2025-03-14T06:38:02.2594827Z Compiling xla/service/xla_debug_info_manager.cc; 12s local 2025-03-14T06:38:02.2595518Z Compiling stablehlo/reference/Ops.cpp; 11s local ... 2025-03-14T06:38:02.4715674Z 2025-03-14T06:38:02.4716531Z  2025-03-14T06:38:02.4717023Z  2025-03-14T06:38:02.4717428Z  2025-03-14T06:38:02.4717823Z  2025-03-14T06:38:02.4718214Z  2025-03-14T06:38:02.4718607Z  2025-03-14T06:38:02.4718993Z  2025-03-14T06:38:02.4719383Z  2025-03-14T06:38:02.4720323Z [18,429 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:02.4721367Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T06:38:02.4722207Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T06:38:02.4723157Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 72s local 2025-03-14T06:38:02.4724171Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2025-03-14T06:38:02.4725311Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T06:38:02.4726586Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 14s local 2025-03-14T06:38:02.4727613Z Compiling xla/service/xla_debug_info_manager.cc; 12s local 2025-03-14T06:38:02.4728470Z Compiling stablehlo/reference/Ops.cpp; 11s local ... 2025-03-14T06:38:02.8480479Z 2025-03-14T06:38:02.8481355Z  2025-03-14T06:38:02.8481834Z  2025-03-14T06:38:02.8482227Z  2025-03-14T06:38:02.8482625Z  2025-03-14T06:38:02.8482993Z  2025-03-14T06:38:02.8483381Z  2025-03-14T06:38:02.8483757Z  2025-03-14T06:38:02.8484158Z  2025-03-14T06:38:02.8485533Z [18,430 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:02.8486608Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T06:38:02.8487468Z Compiling stablehlo/dialect/StablehloOps.cpp; 78s local 2025-03-14T06:38:02.8488430Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2025-03-14T06:38:02.8489486Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 65s local 2025-03-14T06:38:02.8490345Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2025-03-14T06:38:02.8491261Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 14s local 2025-03-14T06:38:02.8492246Z Compiling xla/service/xla_debug_info_manager.cc; 13s local 2025-03-14T06:38:02.8493080Z Compiling stablehlo/reference/Ops.cpp; 12s local ... 2025-03-14T06:38:03.6934591Z 2025-03-14T06:38:03.6935467Z  2025-03-14T06:38:03.6935982Z  2025-03-14T06:38:03.6936384Z  2025-03-14T06:38:03.6936812Z  2025-03-14T06:38:03.6937203Z  2025-03-14T06:38:03.6937625Z  2025-03-14T06:38:03.6938058Z  2025-03-14T06:38:03.6938482Z  2025-03-14T06:38:03.6939573Z [18,431 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:03.6941020Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2025-03-14T06:38:03.6941906Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T06:38:03.6942988Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 73s local 2025-03-14T06:38:03.6944081Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T06:38:03.6944959Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2025-03-14T06:38:03.6945965Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 15s local 2025-03-14T06:38:03.6947152Z Compiling xla/service/xla_debug_info_manager.cc; 14s local 2025-03-14T06:38:03.6948008Z Compiling stablehlo/reference/Ops.cpp; 12s local ... 2025-03-14T06:38:04.0488227Z 2025-03-14T06:38:04.0489288Z  2025-03-14T06:38:04.0489753Z  2025-03-14T06:38:04.0490168Z  2025-03-14T06:38:04.0490572Z  2025-03-14T06:38:04.0490953Z  2025-03-14T06:38:04.0491295Z  2025-03-14T06:38:04.0491675Z  2025-03-14T06:38:04.0492103Z  2025-03-14T06:38:04.0493059Z [18,432 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:04.0494106Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T06:38:04.0494972Z Compiling stablehlo/dialect/StablehloOps.cpp; 79s local 2025-03-14T06:38:04.0495939Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2025-03-14T06:38:04.0497005Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T06:38:04.0497887Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T06:38:04.0498829Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 15s local 2025-03-14T06:38:04.0499805Z Compiling xla/service/xla_debug_info_manager.cc; 14s local 2025-03-14T06:38:04.0500605Z Compiling stablehlo/reference/Ops.cpp; 13s local ... 2025-03-14T06:38:04.3431397Z 2025-03-14T06:38:04.3432269Z  2025-03-14T06:38:04.3432746Z  2025-03-14T06:38:04.3433230Z  2025-03-14T06:38:04.3433642Z  2025-03-14T06:38:04.3434043Z  2025-03-14T06:38:04.3434434Z  2025-03-14T06:38:04.3435072Z  2025-03-14T06:38:04.3435474Z  2025-03-14T06:38:04.3436438Z [18,433 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:04.3437484Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T06:38:04.3438351Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T06:38:04.3439361Z Compiling llvm/lib/Transforms/Vectorize/SLPVectorizer.cpp; 74s local 2025-03-14T06:38:04.3440390Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 66s local 2025-03-14T06:38:04.3441248Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T06:38:04.3442200Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 16s local 2025-03-14T06:38:04.3443156Z Compiling stablehlo/reference/Ops.cpp; 13s local 2025-03-14T06:38:04.3444047Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 13s local ... 2025-03-14T06:38:04.6363749Z 2025-03-14T06:38:04.6364743Z  2025-03-14T06:38:04.6365458Z  2025-03-14T06:38:04.6365872Z  2025-03-14T06:38:04.6366254Z  2025-03-14T06:38:04.6366643Z  2025-03-14T06:38:04.6367010Z  2025-03-14T06:38:04.6367383Z  2025-03-14T06:38:04.6367793Z  2025-03-14T06:38:04.6368740Z [18,435 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:04.6369780Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T06:38:04.6370623Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T06:38:04.6371498Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2025-03-14T06:38:04.6372292Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T06:38:04.6384381Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 16s local 2025-03-14T06:38:04.6385961Z Compiling stablehlo/reference/Ops.cpp; 13s local 2025-03-14T06:38:04.6386868Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 13s local 2025-03-14T06:38:04.6387710Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:38:04.8494446Z 2025-03-14T06:38:04.8495333Z  2025-03-14T06:38:04.8495849Z  2025-03-14T06:38:04.8496233Z  2025-03-14T06:38:04.8496637Z  2025-03-14T06:38:04.8497137Z  2025-03-14T06:38:04.8497564Z  2025-03-14T06:38:04.8498349Z  2025-03-14T06:38:04.8498736Z  2025-03-14T06:38:04.8499672Z [18,435 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:04.8500717Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T06:38:04.8501616Z Compiling stablehlo/dialect/StablehloOps.cpp; 80s local 2025-03-14T06:38:04.8502505Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2025-03-14T06:38:04.8503380Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T06:38:04.8504360Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 16s local 2025-03-14T06:38:04.8505352Z Compiling stablehlo/reference/Ops.cpp; 14s local 2025-03-14T06:38:04.8506191Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 13s local 2025-03-14T06:38:04.8507039Z @llvm-project//mlir:MathTransforms; 13s local ... 2025-03-14T06:38:05.0821504Z 2025-03-14T06:38:05.0822406Z  2025-03-14T06:38:05.0822872Z  2025-03-14T06:38:05.0823311Z  2025-03-14T06:38:05.0823699Z  2025-03-14T06:38:05.0824067Z  2025-03-14T06:38:05.0824428Z  2025-03-14T06:38:05.0824814Z  2025-03-14T06:38:05.0825212Z  2025-03-14T06:38:05.0826161Z [18,437 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:05.0827187Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T06:38:05.0828095Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T06:38:05.0828948Z Compiling mlir/lib/Dialect/GPU/IR/GPUDialect.cpp; 67s local 2025-03-14T06:38:05.0829976Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T06:38:05.0830895Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 17s local 2025-03-14T06:38:05.0831825Z Compiling stablehlo/reference/Ops.cpp; 14s local 2025-03-14T06:38:05.0832673Z Compiling llvm/lib/Transforms/IPO/IROutliner.cpp; 13s local 2025-03-14T06:38:05.0833445Z Compiling xla/service/dump.cc; 13s local ... 2025-03-14T06:38:05.3983977Z 2025-03-14T06:38:05.3984782Z  2025-03-14T06:38:05.3985215Z  2025-03-14T06:38:05.3985595Z  2025-03-14T06:38:05.3985954Z  2025-03-14T06:38:05.3986316Z  2025-03-14T06:38:05.3986660Z  2025-03-14T06:38:05.3987015Z  2025-03-14T06:38:05.3987356Z  2025-03-14T06:38:05.3988166Z [18,440 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:05.3989084Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T06:38:05.3989856Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T06:38:05.3990534Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T06:38:05.3991288Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 17s local 2025-03-14T06:38:05.3992032Z Compiling stablehlo/reference/Ops.cpp; 14s local 2025-03-14T06:38:05.3992609Z Compiling xla/service/dump.cc; 13s local 2025-03-14T06:38:05.3993160Z @llvm-project//llvm:X86CodeGen; 12s local 2025-03-14T06:38:05.3993775Z Compiling xla/backends/cpu/runtime/thunk.cc; 12s local ... 2025-03-14T06:38:05.6500640Z 2025-03-14T06:38:05.6501503Z  2025-03-14T06:38:05.6502008Z  2025-03-14T06:38:05.6502422Z  2025-03-14T06:38:05.6502838Z  2025-03-14T06:38:05.6503257Z  2025-03-14T06:38:05.6503693Z  2025-03-14T06:38:05.6504128Z  2025-03-14T06:38:05.6504548Z  2025-03-14T06:38:05.6506001Z [18,440 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:05.6507193Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T06:38:05.6508113Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T06:38:05.6509034Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T06:38:05.6510100Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 17s local 2025-03-14T06:38:05.6511205Z Compiling stablehlo/reference/Ops.cpp; 14s local 2025-03-14T06:38:05.6511909Z Compiling xla/service/dump.cc; 13s local 2025-03-14T06:38:05.6512552Z @llvm-project//llvm:X86CodeGen; 12s local 2025-03-14T06:38:05.6513334Z Compiling xla/backends/cpu/runtime/thunk.cc; 12s local ... 2025-03-14T06:38:05.8548064Z 2025-03-14T06:38:05.8548868Z  2025-03-14T06:38:05.8549255Z  2025-03-14T06:38:05.8549594Z  2025-03-14T06:38:05.8549931Z  2025-03-14T06:38:05.8550301Z  2025-03-14T06:38:05.8550670Z  2025-03-14T06:38:05.8551063Z  2025-03-14T06:38:05.8551462Z  2025-03-14T06:38:05.8552237Z [18,441 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:05.8553206Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T06:38:05.8554084Z Compiling stablehlo/dialect/StablehloOps.cpp; 81s local 2025-03-14T06:38:05.8554766Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T06:38:05.8555633Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 17s local 2025-03-14T06:38:05.8556617Z Compiling stablehlo/reference/Ops.cpp; 15s local 2025-03-14T06:38:05.8557191Z Compiling xla/service/dump.cc; 14s local 2025-03-14T06:38:05.8557773Z @llvm-project//llvm:X86CodeGen; 12s local 2025-03-14T06:38:05.8558435Z Compiling xla/backends/cpu/runtime/thunk.cc; 12s local ... 2025-03-14T06:38:06.0834549Z 2025-03-14T06:38:06.0835407Z  2025-03-14T06:38:06.0835940Z  2025-03-14T06:38:06.0836351Z  2025-03-14T06:38:06.0836805Z  2025-03-14T06:38:06.0837226Z  2025-03-14T06:38:06.0837852Z  2025-03-14T06:38:06.0838275Z  2025-03-14T06:38:06.0838677Z  2025-03-14T06:38:06.0839647Z [18,445 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:06.0840772Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T06:38:06.0841723Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T06:38:06.0842629Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T06:38:06.0843693Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2025-03-14T06:38:06.0844968Z Compiling stablehlo/reference/Ops.cpp; 15s local 2025-03-14T06:38:06.0845715Z Compiling xla/service/dump.cc; 14s local 2025-03-14T06:38:06.0846397Z @llvm-project//llvm:X86CodeGen; 13s local 2025-03-14T06:38:06.0847241Z Compiling xla/backends/cpu/runtime/thunk.cc; 12s local ... 2025-03-14T06:38:06.3617801Z 2025-03-14T06:38:06.3618698Z  2025-03-14T06:38:06.3619207Z  2025-03-14T06:38:06.3619623Z  2025-03-14T06:38:06.3620027Z  2025-03-14T06:38:06.3620419Z  2025-03-14T06:38:06.3620767Z  2025-03-14T06:38:06.3621129Z  2025-03-14T06:38:06.3621553Z  2025-03-14T06:38:06.3622510Z [18,446 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:06.3623581Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T06:38:06.3624444Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T06:38:06.3625280Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T06:38:06.3626251Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2025-03-14T06:38:06.3627230Z Compiling stablehlo/reference/Ops.cpp; 15s local 2025-03-14T06:38:06.3628256Z Compiling xla/service/dump.cc; 14s local 2025-03-14T06:38:06.3629047Z @llvm-project//llvm:X86CodeGen; 13s local 2025-03-14T06:38:06.3629881Z Compiling xla/backends/cpu/runtime/thunk.cc; 13s local ... 2025-03-14T06:38:06.6509068Z 2025-03-14T06:38:06.6509929Z  2025-03-14T06:38:06.6510405Z  2025-03-14T06:38:06.6510856Z  2025-03-14T06:38:06.6511277Z  2025-03-14T06:38:06.6511694Z  2025-03-14T06:38:06.6512095Z  2025-03-14T06:38:06.6512514Z  2025-03-14T06:38:06.6513194Z  2025-03-14T06:38:06.6514074Z [18,446 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:06.6515124Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T06:38:06.6516012Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T06:38:06.6516829Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T06:38:06.6517787Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2025-03-14T06:38:06.6518720Z Compiling stablehlo/reference/Ops.cpp; 15s local 2025-03-14T06:38:06.6519443Z Compiling xla/service/dump.cc; 14s local 2025-03-14T06:38:06.6520130Z @llvm-project//llvm:X86CodeGen; 13s local 2025-03-14T06:38:06.6520896Z Compiling xla/backends/cpu/runtime/thunk.cc; 13s local ... 2025-03-14T06:38:07.0264825Z 2025-03-14T06:38:07.0265915Z  2025-03-14T06:38:07.0266413Z  2025-03-14T06:38:07.0266793Z  2025-03-14T06:38:07.0267236Z  2025-03-14T06:38:07.0267624Z  2025-03-14T06:38:07.0268011Z  2025-03-14T06:38:07.0268383Z  2025-03-14T06:38:07.0268758Z  2025-03-14T06:38:07.0269692Z [18,447 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:07.0270749Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T06:38:07.0271619Z Compiling stablehlo/dialect/StablehloOps.cpp; 82s local 2025-03-14T06:38:07.0272561Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T06:38:07.0273580Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2025-03-14T06:38:07.0274876Z Compiling stablehlo/reference/Ops.cpp; 16s local 2025-03-14T06:38:07.0275616Z Compiling xla/service/dump.cc; 15s local 2025-03-14T06:38:07.0276265Z @llvm-project//llvm:X86CodeGen; 14s local 2025-03-14T06:38:07.0277009Z Compiling xla/backends/cpu/runtime/thunk.cc; 13s local ... 2025-03-14T06:38:07.2512983Z 2025-03-14T06:38:07.2513877Z  2025-03-14T06:38:07.2514316Z  2025-03-14T06:38:07.2514679Z  2025-03-14T06:38:07.2515131Z  2025-03-14T06:38:07.2515457Z  2025-03-14T06:38:07.2515782Z  2025-03-14T06:38:07.2516113Z  2025-03-14T06:38:07.2516447Z  2025-03-14T06:38:07.2517228Z [18,449 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:07.2518122Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T06:38:07.2518834Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T06:38:07.2519509Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T06:38:07.2520264Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 19s local 2025-03-14T06:38:07.2521042Z Compiling stablehlo/reference/Ops.cpp; 16s local 2025-03-14T06:38:07.2521610Z Compiling xla/service/dump.cc; 15s local 2025-03-14T06:38:07.2522120Z @llvm-project//llvm:X86CodeGen; 14s local 2025-03-14T06:38:07.2522753Z Compiling xla/backends/cpu/runtime/thunk.cc; 14s local ... 2025-03-14T06:38:07.4573485Z 2025-03-14T06:38:07.4574316Z  2025-03-14T06:38:07.4574759Z  2025-03-14T06:38:07.4575135Z  2025-03-14T06:38:07.4575502Z  2025-03-14T06:38:07.4575866Z  2025-03-14T06:38:07.4576224Z  2025-03-14T06:38:07.4576582Z  2025-03-14T06:38:07.4576939Z  2025-03-14T06:38:07.4578028Z [18,450 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:07.4579058Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T06:38:07.4579845Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T06:38:07.4580591Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T06:38:07.4581415Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 19s local 2025-03-14T06:38:07.4582230Z Compiling stablehlo/reference/Ops.cpp; 16s local 2025-03-14T06:38:07.4582949Z Compiling xla/service/dump.cc; 15s local 2025-03-14T06:38:07.4583601Z Compiling xla/backends/cpu/runtime/thunk.cc; 14s local 2025-03-14T06:38:07.4584409Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 11s local ... 2025-03-14T06:38:07.8101828Z 2025-03-14T06:38:07.8102713Z  2025-03-14T06:38:07.8103193Z  2025-03-14T06:38:07.8103563Z  2025-03-14T06:38:07.8103953Z  2025-03-14T06:38:07.8104355Z  2025-03-14T06:38:07.8104705Z  2025-03-14T06:38:07.8105132Z  2025-03-14T06:38:07.8105535Z  2025-03-14T06:38:07.8106479Z [18,452 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:07.8107537Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T06:38:07.8108391Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T06:38:07.8109248Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T06:38:07.8110224Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 19s local 2025-03-14T06:38:07.8111200Z Compiling stablehlo/reference/Ops.cpp; 17s local 2025-03-14T06:38:07.8111951Z Compiling xla/service/dump.cc; 16s local 2025-03-14T06:38:07.8112726Z Compiling xla/backends/cpu/runtime/thunk.cc; 14s local 2025-03-14T06:38:07.8113609Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 11s local ... 2025-03-14T06:38:08.0520202Z 2025-03-14T06:38:08.0521044Z  2025-03-14T06:38:08.0521509Z  2025-03-14T06:38:08.0521929Z  2025-03-14T06:38:08.0522318Z  2025-03-14T06:38:08.0522669Z  2025-03-14T06:38:08.0523070Z  2025-03-14T06:38:08.0523699Z  2025-03-14T06:38:08.0524092Z  2025-03-14T06:38:08.0525155Z [18,455 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:08.0526183Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2025-03-14T06:38:08.0526929Z Compiling stablehlo/dialect/StablehloOps.cpp; 83s local 2025-03-14T06:38:08.0527644Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2025-03-14T06:38:08.0528356Z Compiling stablehlo/reference/Ops.cpp; 17s local 2025-03-14T06:38:08.0529018Z Compiling xla/service/dump.cc; 16s local 2025-03-14T06:38:08.0529708Z Compiling xla/backends/cpu/runtime/thunk.cc; 14s local 2025-03-14T06:38:08.0530519Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 12s local 2025-03-14T06:38:08.0531422Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 12s local ... 2025-03-14T06:38:08.3876576Z 2025-03-14T06:38:08.3877465Z  2025-03-14T06:38:08.3877902Z  2025-03-14T06:38:08.3878275Z  2025-03-14T06:38:08.3878619Z  2025-03-14T06:38:08.3879067Z  2025-03-14T06:38:08.3879396Z  2025-03-14T06:38:08.3879718Z  2025-03-14T06:38:08.3880052Z  2025-03-14T06:38:08.3880826Z [18,457 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:08.3881671Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2025-03-14T06:38:08.3882364Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T06:38:08.3883021Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2025-03-14T06:38:08.3883640Z Compiling stablehlo/reference/Ops.cpp; 17s local 2025-03-14T06:38:08.3884204Z Compiling xla/service/dump.cc; 16s local 2025-03-14T06:38:08.3884930Z Compiling xla/backends/cpu/runtime/thunk.cc; 15s local 2025-03-14T06:38:08.3885981Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 12s local 2025-03-14T06:38:08.3886766Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 12s local ... 2025-03-14T06:38:08.6235434Z 2025-03-14T06:38:08.6236345Z  2025-03-14T06:38:08.6236849Z  2025-03-14T06:38:08.6237281Z  2025-03-14T06:38:08.6237730Z  2025-03-14T06:38:08.6238153Z  2025-03-14T06:38:08.6238591Z  2025-03-14T06:38:08.6239009Z  2025-03-14T06:38:08.6239671Z  2025-03-14T06:38:08.6240666Z [18,460 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:08.6241801Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2025-03-14T06:38:08.6242744Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T06:38:08.6243658Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2025-03-14T06:38:08.6244657Z Compiling stablehlo/reference/Ops.cpp; 17s local 2025-03-14T06:38:08.6245456Z Compiling xla/service/dump.cc; 16s local 2025-03-14T06:38:08.6246248Z Compiling xla/backends/cpu/runtime/thunk.cc; 15s local 2025-03-14T06:38:08.6247185Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 12s local 2025-03-14T06:38:08.6248220Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 12s local ... 2025-03-14T06:38:08.8526218Z 2025-03-14T06:38:08.8527068Z  2025-03-14T06:38:08.8527579Z  2025-03-14T06:38:08.8527954Z  2025-03-14T06:38:08.8528372Z  2025-03-14T06:38:08.8528749Z  2025-03-14T06:38:08.8529149Z  2025-03-14T06:38:08.8529560Z  2025-03-14T06:38:08.8529979Z  2025-03-14T06:38:08.8530945Z [18,462 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:08.8532044Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2025-03-14T06:38:08.8532898Z Compiling stablehlo/dialect/StablehloOps.cpp; 84s local 2025-03-14T06:38:08.8533752Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T06:38:08.8534544Z Compiling stablehlo/reference/Ops.cpp; 18s local 2025-03-14T06:38:08.8535566Z Compiling xla/service/dump.cc; 17s local 2025-03-14T06:38:08.8536307Z Compiling xla/backends/cpu/runtime/thunk.cc; 15s local 2025-03-14T06:38:08.8537177Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 12s local 2025-03-14T06:38:08.8538151Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 12s local ... 2025-03-14T06:38:09.1621002Z 2025-03-14T06:38:09.1622033Z  2025-03-14T06:38:09.1622549Z  2025-03-14T06:38:09.1622949Z  2025-03-14T06:38:09.1623334Z  2025-03-14T06:38:09.1623706Z  2025-03-14T06:38:09.1624116Z  2025-03-14T06:38:09.1624608Z  2025-03-14T06:38:09.1625074Z  2025-03-14T06:38:09.1626028Z [18,463 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:09.1627064Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T06:38:09.1627973Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T06:38:09.1628799Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T06:38:09.1629583Z Compiling stablehlo/reference/Ops.cpp; 18s local 2025-03-14T06:38:09.1630284Z Compiling xla/service/dump.cc; 17s local 2025-03-14T06:38:09.1631088Z Compiling xla/backends/cpu/runtime/thunk.cc; 16s local 2025-03-14T06:38:09.1631944Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 13s local 2025-03-14T06:38:09.1633029Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 13s local ... 2025-03-14T06:38:09.4466069Z 2025-03-14T06:38:09.4466933Z  2025-03-14T06:38:09.4467442Z  2025-03-14T06:38:09.4467845Z  2025-03-14T06:38:09.4468232Z  2025-03-14T06:38:09.4468620Z  2025-03-14T06:38:09.4469018Z  2025-03-14T06:38:09.4469414Z  2025-03-14T06:38:09.4469802Z  2025-03-14T06:38:09.4471014Z [18,464 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:09.4472095Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T06:38:09.4472850Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T06:38:09.4473590Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T06:38:09.4474301Z Compiling stablehlo/reference/Ops.cpp; 18s local 2025-03-14T06:38:09.4475144Z Compiling xla/service/dump.cc; 17s local 2025-03-14T06:38:09.4476056Z Compiling xla/backends/cpu/runtime/thunk.cc; 16s local 2025-03-14T06:38:09.4476956Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 13s local 2025-03-14T06:38:09.4477987Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 13s local ... 2025-03-14T06:38:09.6533156Z 2025-03-14T06:38:09.6533952Z  2025-03-14T06:38:09.6534416Z  2025-03-14T06:38:09.6534774Z  2025-03-14T06:38:09.6535147Z  2025-03-14T06:38:09.6535531Z  2025-03-14T06:38:09.6535951Z  2025-03-14T06:38:09.6536352Z  2025-03-14T06:38:09.6536706Z  2025-03-14T06:38:09.6537647Z [18,465 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:09.6538648Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T06:38:09.6539502Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T06:38:09.6540320Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T06:38:09.6541075Z Compiling stablehlo/reference/Ops.cpp; 18s local 2025-03-14T06:38:09.6541769Z Compiling xla/service/dump.cc; 17s local 2025-03-14T06:38:09.6542624Z Compiling xla/backends/cpu/runtime/thunk.cc; 16s local 2025-03-14T06:38:09.6543508Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 13s local 2025-03-14T06:38:09.6544516Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 13s local ... 2025-03-14T06:38:09.9055599Z 2025-03-14T06:38:09.9056471Z  2025-03-14T06:38:09.9056957Z  2025-03-14T06:38:09.9057434Z  2025-03-14T06:38:09.9057859Z  2025-03-14T06:38:09.9058273Z  2025-03-14T06:38:09.9058651Z  2025-03-14T06:38:09.9059321Z  2025-03-14T06:38:09.9059730Z  2025-03-14T06:38:09.9060628Z [18,467 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:09.9061634Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T06:38:09.9062506Z Compiling stablehlo/dialect/StablehloOps.cpp; 85s local 2025-03-14T06:38:09.9063306Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T06:38:09.9064029Z Compiling stablehlo/reference/Ops.cpp; 19s local 2025-03-14T06:38:09.9064727Z Compiling xla/service/dump.cc; 18s local 2025-03-14T06:38:09.9065719Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 13s local 2025-03-14T06:38:09.9066678Z Compiling xla/service/llvm_ir/buffer_assignment_util.cc; 13s local 2025-03-14T06:38:09.9067752Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 12s local ... 2025-03-14T06:38:10.1808266Z 2025-03-14T06:38:10.1809131Z  2025-03-14T06:38:10.1809640Z  2025-03-14T06:38:10.1810069Z  2025-03-14T06:38:10.1810516Z  2025-03-14T06:38:10.1810890Z  2025-03-14T06:38:10.1811307Z  2025-03-14T06:38:10.1811681Z  2025-03-14T06:38:10.1812037Z  2025-03-14T06:38:10.1812940Z [18,469 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:10.1814033Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T06:38:10.1814896Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T06:38:10.1815740Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T06:38:10.1816510Z Compiling stablehlo/reference/Ops.cpp; 19s local 2025-03-14T06:38:10.1817190Z Compiling xla/service/dump.cc; 18s local 2025-03-14T06:38:10.1817983Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 14s local 2025-03-14T06:38:10.1819404Z Compiling llvm/lib/Transforms/IPO/FunctionAttrs.cpp; 13s local 2025-03-14T06:38:10.1820429Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local ... 2025-03-14T06:38:10.3890152Z 2025-03-14T06:38:10.3890983Z  2025-03-14T06:38:10.3891471Z  2025-03-14T06:38:10.3891862Z  2025-03-14T06:38:10.3892251Z  2025-03-14T06:38:10.3892637Z  2025-03-14T06:38:10.3893022Z  2025-03-14T06:38:10.3893431Z  2025-03-14T06:38:10.3894216Z  2025-03-14T06:38:10.3895128Z [18,470 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:10.3896149Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T06:38:10.3897001Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T06:38:10.3897806Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T06:38:10.3898552Z Compiling stablehlo/reference/Ops.cpp; 19s local 2025-03-14T06:38:10.3899266Z Compiling xla/service/dump.cc; 18s local 2025-03-14T06:38:10.3900016Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 14s local 2025-03-14T06:38:10.3901138Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2025-03-14T06:38:10.3902225Z Compiling .../round_trip_common/import_sdy_custom_calls.cc; 11s local ... 2025-03-14T06:38:10.5909165Z 2025-03-14T06:38:10.5910058Z  2025-03-14T06:38:10.5910551Z  2025-03-14T06:38:10.5910999Z  2025-03-14T06:38:10.5911394Z  2025-03-14T06:38:10.5911822Z  2025-03-14T06:38:10.5912248Z  2025-03-14T06:38:10.5912675Z  2025-03-14T06:38:10.5913098Z  2025-03-14T06:38:10.5914057Z [18,472 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:10.5915139Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T06:38:10.5916053Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T06:38:10.5916950Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T06:38:10.5917756Z Compiling stablehlo/reference/Ops.cpp; 19s local 2025-03-14T06:38:10.5918833Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 14s local 2025-03-14T06:38:10.5919889Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 12s local 2025-03-14T06:38:10.5921007Z Compiling .../round_trip_common/import_sdy_custom_calls.cc; 11s local 2025-03-14T06:38:10.5922078Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 11s local ... 2025-03-14T06:38:10.8541778Z 2025-03-14T06:38:10.8542651Z  2025-03-14T06:38:10.8543184Z  2025-03-14T06:38:10.8543597Z  2025-03-14T06:38:10.8544070Z  2025-03-14T06:38:10.8544479Z  2025-03-14T06:38:10.8544938Z  2025-03-14T06:38:10.8545368Z  2025-03-14T06:38:10.8545790Z  2025-03-14T06:38:10.8546824Z [18,472 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:10.8548029Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T06:38:10.8548971Z Compiling stablehlo/dialect/StablehloOps.cpp; 86s local 2025-03-14T06:38:10.8549865Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T06:38:10.8550706Z Compiling stablehlo/reference/Ops.cpp; 20s local 2025-03-14T06:38:10.8551682Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 14s local 2025-03-14T06:38:10.8552699Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2025-03-14T06:38:10.8553773Z Compiling .../round_trip_common/import_sdy_custom_calls.cc; 12s local 2025-03-14T06:38:10.8554801Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 11s local ... 2025-03-14T06:38:11.2305855Z 2025-03-14T06:38:11.2306735Z  2025-03-14T06:38:11.2307245Z  2025-03-14T06:38:11.2307666Z  2025-03-14T06:38:11.2308084Z  2025-03-14T06:38:11.2308503Z  2025-03-14T06:38:11.2308923Z  2025-03-14T06:38:11.2309308Z  2025-03-14T06:38:11.2310263Z  2025-03-14T06:38:11.2311260Z [18,473 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:11.2312356Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T06:38:11.2313322Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2025-03-14T06:38:11.2314199Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T06:38:11.2315024Z Compiling stablehlo/reference/Ops.cpp; 20s local 2025-03-14T06:38:11.2316051Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 15s local 2025-03-14T06:38:11.2317123Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2025-03-14T06:38:11.2318139Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 12s local 2025-03-14T06:38:11.2318976Z @llvm-project//llvm:OrcJIT; 10s local ... 2025-03-14T06:38:11.4546314Z 2025-03-14T06:38:11.4547207Z  2025-03-14T06:38:11.4547694Z  2025-03-14T06:38:11.4548117Z  2025-03-14T06:38:11.4548560Z  2025-03-14T06:38:11.4548941Z  2025-03-14T06:38:11.4549341Z  2025-03-14T06:38:11.4549755Z  2025-03-14T06:38:11.4550169Z  2025-03-14T06:38:11.4551116Z [18,475 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:11.4552229Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T06:38:11.4553174Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2025-03-14T06:38:11.4554000Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T06:38:11.4554688Z Compiling stablehlo/reference/Ops.cpp; 20s local 2025-03-14T06:38:11.4555443Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 15s local 2025-03-14T06:38:11.4556402Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 13s local 2025-03-14T06:38:11.4557419Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 12s local 2025-03-14T06:38:11.4558334Z @llvm-project//mlir:BufferizationTransforms; 10s local ... 2025-03-14T06:38:11.6549155Z 2025-03-14T06:38:11.6550068Z  2025-03-14T06:38:11.6550566Z  2025-03-14T06:38:11.6551260Z  2025-03-14T06:38:11.6551690Z  2025-03-14T06:38:11.6552110Z  2025-03-14T06:38:11.6552515Z  2025-03-14T06:38:11.6552914Z  2025-03-14T06:38:11.6553433Z  2025-03-14T06:38:11.6554418Z [18,476 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:11.6555561Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T06:38:11.6556500Z Compiling stablehlo/dialect/StablehloOps.cpp; 87s local 2025-03-14T06:38:11.6557400Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T06:38:11.6558222Z Compiling stablehlo/reference/Ops.cpp; 20s local 2025-03-14T06:38:11.6559087Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 15s local 2025-03-14T06:38:11.6560162Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2025-03-14T06:38:11.6561282Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 12s local 2025-03-14T06:38:11.6562281Z @llvm-project//mlir:BufferizationTransforms; 10s local ... 2025-03-14T06:38:12.1829646Z 2025-03-14T06:38:12.1830532Z  2025-03-14T06:38:12.1831039Z  2025-03-14T06:38:12.1831557Z  2025-03-14T06:38:12.1832063Z  2025-03-14T06:38:12.1832557Z  2025-03-14T06:38:12.1833058Z  2025-03-14T06:38:12.1833503Z  2025-03-14T06:38:12.1833904Z  2025-03-14T06:38:12.1834943Z [18,477 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:12.1836056Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2025-03-14T06:38:12.1836998Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T06:38:12.1837860Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2025-03-14T06:38:12.1838579Z Compiling stablehlo/reference/Ops.cpp; 21s local 2025-03-14T06:38:12.1839880Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 16s local 2025-03-14T06:38:12.1840894Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2025-03-14T06:38:12.1841877Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 13s local 2025-03-14T06:38:12.1842783Z @llvm-project//mlir:BufferizationTransforms; 10s local ... 2025-03-14T06:38:12.4556769Z 2025-03-14T06:38:12.4557605Z  2025-03-14T06:38:12.4558050Z  2025-03-14T06:38:12.4558694Z  2025-03-14T06:38:12.4559079Z  2025-03-14T06:38:12.4559461Z  2025-03-14T06:38:12.4559843Z  2025-03-14T06:38:12.4560232Z  2025-03-14T06:38:12.4560609Z  2025-03-14T06:38:12.4561428Z [18,477 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:12.4562390Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2025-03-14T06:38:12.4563193Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T06:38:12.4563948Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2025-03-14T06:38:12.4564775Z Compiling stablehlo/reference/Ops.cpp; 21s local 2025-03-14T06:38:12.4565727Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 16s local 2025-03-14T06:38:12.4566614Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 14s local 2025-03-14T06:38:12.4567568Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 13s local 2025-03-14T06:38:12.4568427Z @llvm-project//mlir:BufferizationTransforms; 11s local ... 2025-03-14T06:38:12.6559220Z 2025-03-14T06:38:12.6560124Z  2025-03-14T06:38:12.6560626Z  2025-03-14T06:38:12.6560995Z  2025-03-14T06:38:12.6561409Z  2025-03-14T06:38:12.6561825Z  2025-03-14T06:38:12.6562235Z  2025-03-14T06:38:12.6562606Z  2025-03-14T06:38:12.6562998Z  2025-03-14T06:38:12.6563909Z [18,478 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:12.6565157Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2025-03-14T06:38:12.6566480Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T06:38:12.6567316Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2025-03-14T06:38:12.6568135Z Compiling stablehlo/reference/Ops.cpp; 21s local 2025-03-14T06:38:12.6568929Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 16s local 2025-03-14T06:38:12.6569938Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2025-03-14T06:38:12.6570974Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 13s local 2025-03-14T06:38:12.6571968Z Compiling xla/service/cpu/buffer_info_util.cc; 10s local ... 2025-03-14T06:38:12.9699736Z 2025-03-14T06:38:12.9700604Z  2025-03-14T06:38:12.9701116Z  2025-03-14T06:38:12.9701516Z  2025-03-14T06:38:12.9701921Z  2025-03-14T06:38:12.9702327Z  2025-03-14T06:38:12.9702733Z  2025-03-14T06:38:12.9703106Z  2025-03-14T06:38:12.9703567Z  2025-03-14T06:38:12.9704500Z [18,479 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:12.9705559Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2025-03-14T06:38:12.9706473Z Compiling stablehlo/dialect/StablehloOps.cpp; 88s local 2025-03-14T06:38:12.9707313Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2025-03-14T06:38:12.9708101Z Compiling stablehlo/reference/Ops.cpp; 22s local 2025-03-14T06:38:12.9708926Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 17s local 2025-03-14T06:38:12.9709837Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2025-03-14T06:38:12.9710880Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 13s local 2025-03-14T06:38:12.9711805Z Compiling xla/service/cpu/buffer_info_util.cc; 11s local ... 2025-03-14T06:38:13.2564850Z 2025-03-14T06:38:13.2565921Z  2025-03-14T06:38:13.2566429Z  2025-03-14T06:38:13.2566833Z  2025-03-14T06:38:13.2567694Z  2025-03-14T06:38:13.2568215Z  2025-03-14T06:38:13.2568574Z  2025-03-14T06:38:13.2568952Z  2025-03-14T06:38:13.2569342Z  2025-03-14T06:38:13.2570284Z [18,480 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:13.2571259Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2025-03-14T06:38:13.2572097Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T06:38:13.2573136Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2025-03-14T06:38:13.2573977Z Compiling stablehlo/reference/Ops.cpp; 22s local 2025-03-14T06:38:13.2574757Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 17s local 2025-03-14T06:38:13.2575828Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 15s local 2025-03-14T06:38:13.2576942Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 14s local 2025-03-14T06:38:13.2577938Z Compiling xla/service/cpu/buffer_info_util.cc; 11s local ... 2025-03-14T06:38:13.6683298Z 2025-03-14T06:38:13.6684160Z  2025-03-14T06:38:13.6684804Z  2025-03-14T06:38:13.6685248Z  2025-03-14T06:38:13.6685678Z  2025-03-14T06:38:13.6686071Z  2025-03-14T06:38:13.6686441Z  2025-03-14T06:38:13.6686840Z  2025-03-14T06:38:13.6687224Z  2025-03-14T06:38:13.6688153Z [18,481 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:13.6689205Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2025-03-14T06:38:13.6690032Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T06:38:13.6690870Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2025-03-14T06:38:13.6691654Z Compiling stablehlo/reference/Ops.cpp; 22s local 2025-03-14T06:38:13.6692492Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 17s local 2025-03-14T06:38:13.6693493Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2025-03-14T06:38:13.6694522Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 14s local 2025-03-14T06:38:13.6695702Z Compiling xla/service/cpu/buffer_info_util.cc; 11s local ... 2025-03-14T06:38:14.0315536Z 2025-03-14T06:38:14.0316350Z  2025-03-14T06:38:14.0316746Z  2025-03-14T06:38:14.0317070Z  2025-03-14T06:38:14.0317393Z  2025-03-14T06:38:14.0317732Z  2025-03-14T06:38:14.0318098Z  2025-03-14T06:38:14.0318460Z  2025-03-14T06:38:14.0318878Z  2025-03-14T06:38:14.0319744Z [18,482 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:14.0320728Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T06:38:14.0321574Z Compiling stablehlo/dialect/StablehloOps.cpp; 89s local 2025-03-14T06:38:14.0322355Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T06:38:14.0323118Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T06:38:14.0323934Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2025-03-14T06:38:14.0325085Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2025-03-14T06:38:14.0326095Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 14s local 2025-03-14T06:38:14.0326956Z Compiling xla/service/cpu/buffer_info_util.cc; 12s local ... 2025-03-14T06:38:14.2571929Z 2025-03-14T06:38:14.2572934Z  2025-03-14T06:38:14.2573455Z  2025-03-14T06:38:14.2573866Z  2025-03-14T06:38:14.2574199Z  2025-03-14T06:38:14.2574517Z  2025-03-14T06:38:14.2574864Z  2025-03-14T06:38:14.2575249Z  2025-03-14T06:38:14.2575629Z  2025-03-14T06:38:14.2576558Z [18,483 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:14.2577538Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T06:38:14.2578290Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T06:38:14.2579393Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T06:38:14.2580116Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T06:38:14.2580750Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2025-03-14T06:38:14.2581651Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 16s local 2025-03-14T06:38:14.2582610Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 15s local 2025-03-14T06:38:14.2583583Z Compiling xla/service/cpu/buffer_info_util.cc; 12s local ... 2025-03-14T06:38:14.6575893Z 2025-03-14T06:38:14.6576768Z  2025-03-14T06:38:14.6577237Z  2025-03-14T06:38:14.6577627Z  2025-03-14T06:38:14.6578014Z  2025-03-14T06:38:14.6578425Z  2025-03-14T06:38:14.6578829Z  2025-03-14T06:38:14.6579209Z  2025-03-14T06:38:14.6579600Z  2025-03-14T06:38:14.6580590Z [18,484 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:14.6581742Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T06:38:14.6582668Z Compiling stablehlo/dialect/StablehloOps.cpp; 90s local 2025-03-14T06:38:14.6583473Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T06:38:14.6584264Z Compiling stablehlo/reference/Ops.cpp; 23s local 2025-03-14T06:38:14.6585103Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 18s local 2025-03-14T06:38:14.6586134Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2025-03-14T06:38:14.6587198Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 15s local 2025-03-14T06:38:14.6588170Z Compiling xla/service/cpu/buffer_info_util.cc; 12s local ... 2025-03-14T06:38:15.0609817Z 2025-03-14T06:38:15.0610654Z  2025-03-14T06:38:15.0611276Z  2025-03-14T06:38:15.0611691Z  2025-03-14T06:38:15.0612082Z  2025-03-14T06:38:15.0612501Z  2025-03-14T06:38:15.0612893Z  2025-03-14T06:38:15.0613300Z  2025-03-14T06:38:15.0613772Z  2025-03-14T06:38:15.0614929Z [18,485 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:15.0616057Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2025-03-14T06:38:15.0616992Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T06:38:15.0617817Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2025-03-14T06:38:15.0618592Z Compiling stablehlo/reference/Ops.cpp; 24s local 2025-03-14T06:38:15.0619390Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2025-03-14T06:38:15.0620391Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2025-03-14T06:38:15.0621438Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 15s local 2025-03-14T06:38:15.0622384Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local ... 2025-03-14T06:38:15.4581499Z 2025-03-14T06:38:15.4582381Z  2025-03-14T06:38:15.4582858Z  2025-03-14T06:38:15.4583337Z  2025-03-14T06:38:15.4583771Z  2025-03-14T06:38:15.4584197Z  2025-03-14T06:38:15.4584614Z  2025-03-14T06:38:15.4585024Z  2025-03-14T06:38:15.4585458Z  2025-03-14T06:38:15.4586369Z [18,487 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:15.4587426Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2025-03-14T06:38:15.4588271Z Compiling stablehlo/dialect/StablehloOps.cpp; 91s local 2025-03-14T06:38:15.4589089Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2025-03-14T06:38:15.4589889Z Compiling stablehlo/reference/Ops.cpp; 24s local 2025-03-14T06:38:15.4590706Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local 2025-03-14T06:38:15.4591726Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 17s local 2025-03-14T06:38:15.4592773Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 16s local 2025-03-14T06:38:15.4593989Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local ... 2025-03-14T06:38:16.1396492Z 2025-03-14T06:38:16.1397667Z  2025-03-14T06:38:16.1398175Z  2025-03-14T06:38:16.1398594Z  2025-03-14T06:38:16.1398991Z  2025-03-14T06:38:16.1399371Z  2025-03-14T06:38:16.1399807Z  2025-03-14T06:38:16.1400201Z  2025-03-14T06:38:16.1400554Z  2025-03-14T06:38:16.1401628Z [18,488 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:16.1402903Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2025-03-14T06:38:16.1403767Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2025-03-14T06:38:16.1404843Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T06:38:16.1405606Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T06:38:16.1406453Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2025-03-14T06:38:16.1407489Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2025-03-14T06:38:16.1408599Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local 2025-03-14T06:38:16.1409546Z Compiling xla/service/cpu/buffer_info_util.cc; 14s local ... 2025-03-14T06:38:16.3912400Z 2025-03-14T06:38:16.3913250Z  2025-03-14T06:38:16.3913730Z  2025-03-14T06:38:16.3914137Z  2025-03-14T06:38:16.3914536Z  2025-03-14T06:38:16.3914925Z  2025-03-14T06:38:16.3915324Z  2025-03-14T06:38:16.3915717Z  2025-03-14T06:38:16.3916131Z  2025-03-14T06:38:16.3917082Z [18,491 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:16.3918213Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2025-03-14T06:38:16.3919096Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2025-03-14T06:38:16.3920002Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T06:38:16.3920770Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T06:38:16.3921577Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2025-03-14T06:38:16.3922961Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 18s local 2025-03-14T06:38:16.3923969Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local 2025-03-14T06:38:16.3925027Z Compiling xla/service/xla_debug_info_manager.cc; 11s local ... 2025-03-14T06:38:16.6590136Z 2025-03-14T06:38:16.6591296Z  2025-03-14T06:38:16.6591781Z  2025-03-14T06:38:16.6592238Z  2025-03-14T06:38:16.6592600Z  2025-03-14T06:38:16.6593036Z  2025-03-14T06:38:16.6593456Z  2025-03-14T06:38:16.6593883Z  2025-03-14T06:38:16.6594272Z  2025-03-14T06:38:16.6595176Z [18,492 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:16.6596249Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2025-03-14T06:38:16.6597133Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2025-03-14T06:38:16.6597965Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T06:38:16.6598725Z Compiling stablehlo/reference/Ops.cpp; 25s local 2025-03-14T06:38:16.6599552Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local 2025-03-14T06:38:16.6600607Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2025-03-14T06:38:16.6601661Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local 2025-03-14T06:38:16.6602661Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T06:38:17.0049318Z 2025-03-14T06:38:17.0050663Z  2025-03-14T06:38:17.0051293Z  2025-03-14T06:38:17.0052684Z  2025-03-14T06:38:17.0053607Z  2025-03-14T06:38:17.0054670Z  2025-03-14T06:38:17.0055874Z  2025-03-14T06:38:17.0057089Z  2025-03-14T06:38:17.0058433Z  2025-03-14T06:38:17.0060271Z [18,493 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:17.0061362Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2025-03-14T06:38:17.0062128Z Compiling stablehlo/dialect/StablehloOps.cpp; 92s local 2025-03-14T06:38:17.0062838Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T06:38:17.0063474Z Compiling stablehlo/reference/Ops.cpp; 26s local 2025-03-14T06:38:17.0064167Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2025-03-14T06:38:17.0065009Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2025-03-14T06:38:17.0066430Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local 2025-03-14T06:38:17.0067487Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T06:38:17.2595284Z 2025-03-14T06:38:17.2596166Z  2025-03-14T06:38:17.2596644Z  2025-03-14T06:38:17.2597026Z  2025-03-14T06:38:17.2597413Z  2025-03-14T06:38:17.2597785Z  2025-03-14T06:38:17.2598163Z  2025-03-14T06:38:17.2598570Z  2025-03-14T06:38:17.2598989Z  2025-03-14T06:38:17.2599943Z [18,496 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:17.2600971Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2025-03-14T06:38:17.2601835Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T06:38:17.2602695Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T06:38:17.2603413Z Compiling stablehlo/reference/Ops.cpp; 26s local 2025-03-14T06:38:17.2604249Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2025-03-14T06:38:17.2605395Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2025-03-14T06:38:17.2606406Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2025-03-14T06:38:17.2607449Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T06:38:17.5861244Z 2025-03-14T06:38:17.5872659Z  2025-03-14T06:38:17.5874307Z  2025-03-14T06:38:17.5875443Z  2025-03-14T06:38:17.5876529Z  2025-03-14T06:38:17.5877629Z  2025-03-14T06:38:17.5878816Z  2025-03-14T06:38:17.5880380Z  2025-03-14T06:38:17.5881414Z  2025-03-14T06:38:17.5883038Z [18,498 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:17.5884007Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2025-03-14T06:38:17.5885011Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T06:38:17.5885862Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T06:38:17.5886621Z Compiling stablehlo/reference/Ops.cpp; 26s local 2025-03-14T06:38:17.5887417Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2025-03-14T06:38:17.5888356Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 19s local 2025-03-14T06:38:17.5889335Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2025-03-14T06:38:17.5890279Z Compiling xla/service/xla_debug_info_manager.cc; 12s local ... 2025-03-14T06:38:17.7877001Z 2025-03-14T06:38:17.7877876Z  2025-03-14T06:38:17.7878356Z  2025-03-14T06:38:17.7878727Z  2025-03-14T06:38:17.7879090Z  2025-03-14T06:38:17.7879445Z  2025-03-14T06:38:17.7879809Z  2025-03-14T06:38:17.7880154Z  2025-03-14T06:38:17.7880501Z  2025-03-14T06:38:17.7881330Z [18,500 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:17.7882270Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2025-03-14T06:38:17.7883035Z Compiling stablehlo/dialect/StablehloOps.cpp; 93s local 2025-03-14T06:38:17.7883751Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T06:38:17.7884720Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T06:38:17.7885456Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local 2025-03-14T06:38:17.7886594Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2025-03-14T06:38:17.7887623Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2025-03-14T06:38:17.7888470Z Compiling xla/service/xla_debug_info_manager.cc; 13s local ... 2025-03-14T06:38:18.0601237Z 2025-03-14T06:38:18.0602427Z  2025-03-14T06:38:18.0602837Z  2025-03-14T06:38:18.0603189Z  2025-03-14T06:38:18.0603537Z  2025-03-14T06:38:18.0603886Z  2025-03-14T06:38:18.0604234Z  2025-03-14T06:38:18.0605045Z  2025-03-14T06:38:18.0605397Z  2025-03-14T06:38:18.0606256Z [18,500 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:18.0607168Z Compiling stablehlo/dialect/StablehloOps.cpp; 107s local 2025-03-14T06:38:18.0607914Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T06:38:18.0608618Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2025-03-14T06:38:18.0609296Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T06:38:18.0610015Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 22s local 2025-03-14T06:38:18.0610880Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2025-03-14T06:38:18.0611779Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2025-03-14T06:38:18.0612613Z Compiling xla/service/xla_debug_info_manager.cc; 13s local ... 2025-03-14T06:38:18.3500591Z 2025-03-14T06:38:18.3501816Z  2025-03-14T06:38:18.3502331Z  2025-03-14T06:38:18.3502738Z  2025-03-14T06:38:18.3503226Z  2025-03-14T06:38:18.3503593Z  2025-03-14T06:38:18.3503981Z  2025-03-14T06:38:18.3504365Z  2025-03-14T06:38:18.3504755Z  2025-03-14T06:38:18.3505672Z [18,503 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:18.3506716Z Compiling stablehlo/dialect/StablehloOps.cpp; 107s local 2025-03-14T06:38:18.3507617Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T06:38:18.3508435Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2025-03-14T06:38:18.3509515Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T06:38:18.3510477Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 20s local 2025-03-14T06:38:18.3511517Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2025-03-14T06:38:18.3512401Z Compiling xla/service/xla_debug_info_manager.cc; 13s local 2025-03-14T06:38:18.3517574Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 12s local ... 2025-03-14T06:38:18.6607092Z 2025-03-14T06:38:18.6607943Z  2025-03-14T06:38:18.6608441Z  2025-03-14T06:38:18.6608866Z  2025-03-14T06:38:18.6609300Z  2025-03-14T06:38:18.6609699Z  2025-03-14T06:38:18.6610102Z  2025-03-14T06:38:18.6610512Z  2025-03-14T06:38:18.6610899Z  2025-03-14T06:38:18.6611812Z [18,503 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:18.6617081Z Compiling stablehlo/dialect/StablehloOps.cpp; 107s local 2025-03-14T06:38:18.6618115Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T06:38:18.6619105Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2025-03-14T06:38:18.6619912Z Compiling stablehlo/reference/Ops.cpp; 27s local 2025-03-14T06:38:18.6620879Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2025-03-14T06:38:18.6621998Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2025-03-14T06:38:18.6623031Z Compiling xla/service/xla_debug_info_manager.cc; 14s local 2025-03-14T06:38:18.6624023Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 13s local ... 2025-03-14T06:38:18.8609813Z 2025-03-14T06:38:18.8610680Z  2025-03-14T06:38:18.8611158Z  2025-03-14T06:38:18.8611590Z  2025-03-14T06:38:18.8612002Z  2025-03-14T06:38:18.8612395Z  2025-03-14T06:38:18.8612796Z  2025-03-14T06:38:18.8613588Z  2025-03-14T06:38:18.8613998Z  2025-03-14T06:38:18.8615042Z [18,504 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:18.8616271Z Compiling stablehlo/dialect/StablehloOps.cpp; 107s local 2025-03-14T06:38:18.8617194Z Compiling stablehlo/dialect/StablehloOps.cpp; 94s local 2025-03-14T06:38:18.8618020Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T06:38:18.8618926Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T06:38:18.8619913Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2025-03-14T06:38:18.8620943Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2025-03-14T06:38:18.8621923Z Compiling xla/service/xla_debug_info_manager.cc; 14s local 2025-03-14T06:38:18.8622987Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 13s local ... 2025-03-14T06:38:19.4440363Z 2025-03-14T06:38:19.4441727Z  2025-03-14T06:38:19.4442298Z  2025-03-14T06:38:19.4442723Z  2025-03-14T06:38:19.4443150Z  2025-03-14T06:38:19.4443563Z  2025-03-14T06:38:19.4443991Z  2025-03-14T06:38:19.4444391Z  2025-03-14T06:38:19.4444981Z  2025-03-14T06:38:19.4445965Z [18,505 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:19.4447030Z Compiling stablehlo/dialect/StablehloOps.cpp; 108s local 2025-03-14T06:38:19.4447965Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T06:38:19.4448809Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T06:38:19.4449563Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T06:38:19.4450426Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 21s local 2025-03-14T06:38:19.4451428Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T06:38:19.4452330Z Compiling xla/service/xla_debug_info_manager.cc; 14s local 2025-03-14T06:38:19.4453396Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 14s local ... 2025-03-14T06:38:19.6615702Z 2025-03-14T06:38:19.6616546Z  2025-03-14T06:38:19.6617054Z  2025-03-14T06:38:19.6617477Z  2025-03-14T06:38:19.6617890Z  2025-03-14T06:38:19.6618293Z  2025-03-14T06:38:19.6618718Z  2025-03-14T06:38:19.6619141Z  2025-03-14T06:38:19.6619549Z  2025-03-14T06:38:19.6620495Z [18,506 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:19.6621937Z Compiling stablehlo/dialect/StablehloOps.cpp; 108s local 2025-03-14T06:38:19.6622887Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T06:38:19.6623772Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T06:38:19.6624584Z Compiling stablehlo/reference/Ops.cpp; 28s local 2025-03-14T06:38:19.6625550Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T06:38:19.6626651Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T06:38:19.6627770Z Compiling xla/service/xla_debug_info_manager.cc; 15s local 2025-03-14T06:38:19.6628777Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 14s local ... 2025-03-14T06:38:19.8619468Z 2025-03-14T06:38:19.8620582Z  2025-03-14T06:38:19.8621032Z  2025-03-14T06:38:19.8621402Z  2025-03-14T06:38:19.8621759Z  2025-03-14T06:38:19.8622107Z  2025-03-14T06:38:19.8622478Z  2025-03-14T06:38:19.8622827Z  2025-03-14T06:38:19.8623200Z  2025-03-14T06:38:19.8624048Z [18,508 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:19.8624974Z Compiling stablehlo/dialect/StablehloOps.cpp; 95s local 2025-03-14T06:38:19.8625694Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T06:38:19.8626381Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T06:38:19.8627445Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T06:38:19.8628386Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T06:38:19.8629225Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 14s local 2025-03-14T06:38:19.8629985Z Compiling shardy/dialect/sdy/ir/dialect.cc; 13s local 2025-03-14T06:38:19.8630790Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 11s local ... 2025-03-14T06:38:20.0637170Z 2025-03-14T06:38:20.0638010Z  2025-03-14T06:38:20.0638448Z  2025-03-14T06:38:20.0638834Z  2025-03-14T06:38:20.0639193Z  2025-03-14T06:38:20.0639596Z  2025-03-14T06:38:20.0639954Z  2025-03-14T06:38:20.0640315Z  2025-03-14T06:38:20.0640676Z  2025-03-14T06:38:20.0641540Z [18,509 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:20.0642618Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T06:38:20.0643380Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T06:38:20.0644091Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T06:38:20.0645081Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T06:38:20.0646039Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T06:38:20.0646940Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 14s local 2025-03-14T06:38:20.0647808Z Compiling shardy/dialect/sdy/ir/dialect.cc; 13s local 2025-03-14T06:38:20.0648707Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 12s local ... 2025-03-14T06:38:20.3226639Z 2025-03-14T06:38:20.3227859Z  2025-03-14T06:38:20.3228306Z  2025-03-14T06:38:20.3228677Z  2025-03-14T06:38:20.3229055Z  2025-03-14T06:38:20.3229445Z  2025-03-14T06:38:20.3229822Z  2025-03-14T06:38:20.3230196Z  2025-03-14T06:38:20.3230572Z  2025-03-14T06:38:20.3231470Z [18,511 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:20.3232496Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T06:38:20.3233258Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T06:38:20.3233989Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T06:38:20.3234860Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T06:38:20.3235844Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T06:38:20.3237063Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 14s local 2025-03-14T06:38:20.3237929Z Compiling shardy/dialect/sdy/ir/dialect.cc; 14s local 2025-03-14T06:38:20.3238911Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 12s local ... 2025-03-14T06:38:20.5932055Z 2025-03-14T06:38:20.5932927Z  2025-03-14T06:38:20.5933360Z  2025-03-14T06:38:20.5933728Z  2025-03-14T06:38:20.5934079Z  2025-03-14T06:38:20.5934446Z  2025-03-14T06:38:20.5934803Z  2025-03-14T06:38:20.5935162Z  2025-03-14T06:38:20.5935771Z  2025-03-14T06:38:20.5936628Z [18,512 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:20.5937554Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T06:38:20.5938291Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T06:38:20.5938965Z Compiling stablehlo/reference/Ops.cpp; 29s local 2025-03-14T06:38:20.5939801Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 22s local 2025-03-14T06:38:20.5940714Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T06:38:20.5941581Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 15s local 2025-03-14T06:38:20.5942399Z Compiling shardy/dialect/sdy/ir/dialect.cc; 14s local 2025-03-14T06:38:20.5943215Z Compiling .../translate/mhlo_to_hlo/attribute_exporter.cc; 12s local ... 2025-03-14T06:38:20.8626307Z 2025-03-14T06:38:20.8627462Z  2025-03-14T06:38:20.8627902Z  2025-03-14T06:38:20.8628302Z  2025-03-14T06:38:20.8628677Z  2025-03-14T06:38:20.8629042Z  2025-03-14T06:38:20.8629379Z  2025-03-14T06:38:20.8629747Z  2025-03-14T06:38:20.8630129Z  2025-03-14T06:38:20.8631009Z [18,513 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:20.8632223Z Compiling stablehlo/dialect/StablehloOps.cpp; 96s local 2025-03-14T06:38:20.8632995Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2025-03-14T06:38:20.8633863Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2025-03-14T06:38:20.8634808Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T06:38:20.8635705Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 15s local 2025-03-14T06:38:20.8636541Z Compiling shardy/dialect/sdy/ir/dialect.cc; 14s local 2025-03-14T06:38:20.8637437Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 12s local 2025-03-14T06:38:20.8638366Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 12s local ... 2025-03-14T06:38:21.0628960Z 2025-03-14T06:38:21.0629870Z  2025-03-14T06:38:21.0630350Z  2025-03-14T06:38:21.0630777Z  2025-03-14T06:38:21.0631157Z  2025-03-14T06:38:21.0631549Z  2025-03-14T06:38:21.0631963Z  2025-03-14T06:38:21.0632361Z  2025-03-14T06:38:21.0632791Z  2025-03-14T06:38:21.0633702Z [18,514 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:21.0634679Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2025-03-14T06:38:21.0635473Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2025-03-14T06:38:21.0636414Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2025-03-14T06:38:21.0637353Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T06:38:21.0638275Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 15s local 2025-03-14T06:38:21.0639142Z Compiling shardy/dialect/sdy/ir/dialect.cc; 14s local 2025-03-14T06:38:21.0640067Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 13s local 2025-03-14T06:38:21.0641023Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 12s local ... 2025-03-14T06:38:21.4392417Z 2025-03-14T06:38:21.4393254Z  2025-03-14T06:38:21.4393701Z  2025-03-14T06:38:21.4394122Z  2025-03-14T06:38:21.4394504Z  2025-03-14T06:38:21.4395070Z  2025-03-14T06:38:21.4395464Z  2025-03-14T06:38:21.4395819Z  2025-03-14T06:38:21.4396186Z  2025-03-14T06:38:21.4397051Z [18,515 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:21.4397999Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2025-03-14T06:38:21.4398765Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2025-03-14T06:38:21.4399655Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 23s local 2025-03-14T06:38:21.4400780Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2025-03-14T06:38:21.4401681Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 16s local 2025-03-14T06:38:21.4402516Z Compiling shardy/dialect/sdy/ir/dialect.cc; 15s local 2025-03-14T06:38:21.4403434Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 13s local 2025-03-14T06:38:21.4404355Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 12s local ... 2025-03-14T06:38:21.6635162Z 2025-03-14T06:38:21.6636006Z  2025-03-14T06:38:21.6636489Z  2025-03-14T06:38:21.6636928Z  2025-03-14T06:38:21.6637320Z  2025-03-14T06:38:21.6637727Z  2025-03-14T06:38:21.6638148Z  2025-03-14T06:38:21.6638569Z  2025-03-14T06:38:21.6638996Z  2025-03-14T06:38:21.6639975Z [18,516 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:21.6641382Z Compiling stablehlo/dialect/StablehloOps.cpp; 97s local 2025-03-14T06:38:21.6642232Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2025-03-14T06:38:21.6643183Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 24s local 2025-03-14T06:38:21.6644294Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2025-03-14T06:38:21.6645500Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 16s local 2025-03-14T06:38:21.6646671Z Compiling shardy/dialect/sdy/ir/dialect.cc; 15s local 2025-03-14T06:38:21.6647696Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 13s local 2025-03-14T06:38:21.6648725Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 12s local ... 2025-03-14T06:38:22.6642599Z 2025-03-14T06:38:22.6643491Z  2025-03-14T06:38:22.6643969Z  2025-03-14T06:38:22.6644406Z  2025-03-14T06:38:22.6644959Z  2025-03-14T06:38:22.6645351Z  2025-03-14T06:38:22.6645801Z  2025-03-14T06:38:22.6646205Z  2025-03-14T06:38:22.6646621Z  2025-03-14T06:38:22.6647626Z [18,516 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:22.6648661Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T06:38:22.6649502Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2025-03-14T06:38:22.6650482Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2025-03-14T06:38:22.6651581Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T06:38:22.6652611Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 17s local 2025-03-14T06:38:22.6653581Z Compiling shardy/dialect/sdy/ir/dialect.cc; 16s local 2025-03-14T06:38:22.6654590Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 14s local 2025-03-14T06:38:22.6655601Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 13s local ... 2025-03-14T06:38:22.9551018Z 2025-03-14T06:38:22.9551868Z  2025-03-14T06:38:22.9552330Z  2025-03-14T06:38:22.9552739Z  2025-03-14T06:38:22.9553130Z  2025-03-14T06:38:22.9553509Z  2025-03-14T06:38:22.9553885Z  2025-03-14T06:38:22.9554264Z  2025-03-14T06:38:22.9554656Z  2025-03-14T06:38:22.9555574Z [18,518 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:22.9556615Z Compiling stablehlo/dialect/StablehloOps.cpp; 98s local 2025-03-14T06:38:22.9557736Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T06:38:22.9558703Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2025-03-14T06:38:22.9559713Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T06:38:22.9560688Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 17s local 2025-03-14T06:38:22.9561537Z Compiling shardy/dialect/sdy/ir/dialect.cc; 16s local 2025-03-14T06:38:22.9562488Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 15s local 2025-03-14T06:38:22.9563630Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 14s local ... 2025-03-14T06:38:23.2648102Z 2025-03-14T06:38:23.2648995Z  2025-03-14T06:38:23.2649470Z  2025-03-14T06:38:23.2649885Z  2025-03-14T06:38:23.2650296Z  2025-03-14T06:38:23.2650692Z  2025-03-14T06:38:23.2651077Z  2025-03-14T06:38:23.2651489Z  2025-03-14T06:38:23.2651901Z  2025-03-14T06:38:23.2652919Z [18,519 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:23.2653950Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T06:38:23.2654813Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T06:38:23.2655800Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2025-03-14T06:38:23.2656988Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T06:38:23.2657901Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 17s local 2025-03-14T06:38:23.2659310Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local 2025-03-14T06:38:23.2660330Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 15s local 2025-03-14T06:38:23.2661380Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 14s local ... 2025-03-14T06:38:23.4651203Z 2025-03-14T06:38:23.4652012Z  2025-03-14T06:38:23.4652427Z  2025-03-14T06:38:23.4652769Z  2025-03-14T06:38:23.4653473Z  2025-03-14T06:38:23.4653841Z  2025-03-14T06:38:23.4654220Z  2025-03-14T06:38:23.4654575Z  2025-03-14T06:38:23.4654941Z  2025-03-14T06:38:23.4655937Z [18,520 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:23.4656923Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T06:38:23.4657682Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T06:38:23.4658563Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 25s local 2025-03-14T06:38:23.4659729Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T06:38:23.4660667Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T06:38:23.4661584Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local 2025-03-14T06:38:23.4662529Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 15s local 2025-03-14T06:38:23.4663495Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 14s local ... 2025-03-14T06:38:24.0014202Z 2025-03-14T06:38:24.0015127Z  2025-03-14T06:38:24.0015636Z  2025-03-14T06:38:24.0016054Z  2025-03-14T06:38:24.0016445Z  2025-03-14T06:38:24.0016847Z  2025-03-14T06:38:24.0017223Z  2025-03-14T06:38:24.0017614Z  2025-03-14T06:38:24.0018007Z  2025-03-14T06:38:24.0018928Z [18,521 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:24.0019995Z Compiling stablehlo/dialect/StablehloOps.cpp; 99s local 2025-03-14T06:38:24.0020825Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T06:38:24.0021770Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2025-03-14T06:38:24.0022795Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T06:38:24.0023789Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T06:38:24.0024719Z Compiling shardy/dialect/sdy/ir/dialect.cc; 17s local 2025-03-14T06:38:24.0026017Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 16s local 2025-03-14T06:38:24.0027075Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local ... 2025-03-14T06:38:24.2657175Z 2025-03-14T06:38:24.2658058Z  2025-03-14T06:38:24.2658572Z  2025-03-14T06:38:24.2659019Z  2025-03-14T06:38:24.2659442Z  2025-03-14T06:38:24.2659861Z  2025-03-14T06:38:24.2660279Z  2025-03-14T06:38:24.2660687Z  2025-03-14T06:38:24.2661153Z  2025-03-14T06:38:24.2662358Z [18,522 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:24.2663480Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T06:38:24.2664359Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T06:38:24.2665559Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2025-03-14T06:38:24.2666475Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T06:38:24.2667355Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T06:38:24.2668112Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local 2025-03-14T06:38:24.2668943Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 16s local 2025-03-14T06:38:24.2669811Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local ... 2025-03-14T06:38:24.4660241Z 2025-03-14T06:38:24.4661131Z  2025-03-14T06:38:24.4661957Z  2025-03-14T06:38:24.4662404Z  2025-03-14T06:38:24.4662835Z  2025-03-14T06:38:24.4663370Z  2025-03-14T06:38:24.4663888Z  2025-03-14T06:38:24.4664410Z  2025-03-14T06:38:24.4664852Z  2025-03-14T06:38:24.4666008Z [18,524 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:24.4666978Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T06:38:24.4667898Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T06:38:24.4668837Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 26s local 2025-03-14T06:38:24.4669876Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T06:38:24.4670892Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T06:38:24.4671822Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local 2025-03-14T06:38:24.4672793Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 16s local 2025-03-14T06:38:24.4673839Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local ... 2025-03-14T06:38:24.7594879Z 2025-03-14T06:38:24.7595781Z  2025-03-14T06:38:24.7596249Z  2025-03-14T06:38:24.7596693Z  2025-03-14T06:38:24.7597109Z  2025-03-14T06:38:24.7597484Z  2025-03-14T06:38:24.7597883Z  2025-03-14T06:38:24.7598300Z  2025-03-14T06:38:24.7598685Z  2025-03-14T06:38:24.7599632Z [18,525 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:24.7600660Z Compiling stablehlo/dialect/StablehloOps.cpp; 100s local 2025-03-14T06:38:24.7601532Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T06:38:24.7602483Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T06:38:24.7603611Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T06:38:24.7604895Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T06:38:24.7605756Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local 2025-03-14T06:38:24.7606876Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 16s local 2025-03-14T06:38:24.7607691Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 15s local ... 2025-03-14T06:38:25.0665940Z 2025-03-14T06:38:25.0666766Z  2025-03-14T06:38:25.0667260Z  2025-03-14T06:38:25.0667648Z  2025-03-14T06:38:25.0668056Z  2025-03-14T06:38:25.0668486Z  2025-03-14T06:38:25.0668914Z  2025-03-14T06:38:25.0669595Z  2025-03-14T06:38:25.0670155Z  2025-03-14T06:38:25.0671131Z [18,526 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:25.0672233Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2025-03-14T06:38:25.0673133Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T06:38:25.0674102Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T06:38:25.0675206Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T06:38:25.0676392Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T06:38:25.0677280Z Compiling shardy/dialect/sdy/ir/dialect.cc; 18s local 2025-03-14T06:38:25.0678242Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 17s local 2025-03-14T06:38:25.0679201Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local ... 2025-03-14T06:38:25.2668645Z 2025-03-14T06:38:25.2669488Z  2025-03-14T06:38:25.2670035Z  2025-03-14T06:38:25.2670450Z  2025-03-14T06:38:25.2670855Z  2025-03-14T06:38:25.2671235Z  2025-03-14T06:38:25.2671622Z  2025-03-14T06:38:25.2672002Z  2025-03-14T06:38:25.2672409Z  2025-03-14T06:38:25.2673356Z [18,527 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:25.2674405Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2025-03-14T06:38:25.2675488Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T06:38:25.2676494Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T06:38:25.2677549Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T06:38:25.2678501Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T06:38:25.2679419Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local 2025-03-14T06:38:25.2680585Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 17s local 2025-03-14T06:38:25.2681583Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local ... 2025-03-14T06:38:25.6417044Z 2025-03-14T06:38:25.6417942Z  2025-03-14T06:38:25.6418538Z  2025-03-14T06:38:25.6418963Z  2025-03-14T06:38:25.6419363Z  2025-03-14T06:38:25.6419859Z  2025-03-14T06:38:25.6420261Z  2025-03-14T06:38:25.6420664Z  2025-03-14T06:38:25.6421056Z  2025-03-14T06:38:25.6422052Z [18,528 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:25.6423118Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2025-03-14T06:38:25.6424085Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T06:38:25.6425051Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 27s local 2025-03-14T06:38:25.6426106Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T06:38:25.6427146Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local 2025-03-14T06:38:25.6428119Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local 2025-03-14T06:38:25.6429227Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 17s local 2025-03-14T06:38:25.6430239Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 16s local ... 2025-03-14T06:38:25.8674027Z 2025-03-14T06:38:25.8674858Z  2025-03-14T06:38:25.8675299Z  2025-03-14T06:38:25.8675706Z  2025-03-14T06:38:25.8676063Z  2025-03-14T06:38:25.8676442Z  2025-03-14T06:38:25.8676823Z  2025-03-14T06:38:25.8677267Z  2025-03-14T06:38:25.8677660Z  2025-03-14T06:38:25.8678593Z [18,530 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:25.8679739Z Compiling stablehlo/dialect/StablehloOps.cpp; 101s local 2025-03-14T06:38:25.8680564Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T06:38:25.8681611Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T06:38:25.8682729Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T06:38:25.8683668Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local 2025-03-14T06:38:25.8684815Z Compiling shardy/dialect/sdy/ir/dialect.cc; 19s local 2025-03-14T06:38:25.8685706Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 17s local 2025-03-14T06:38:25.8686716Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local ... 2025-03-14T06:38:26.2678023Z 2025-03-14T06:38:26.2679196Z  2025-03-14T06:38:26.2679843Z  2025-03-14T06:38:26.2680314Z  2025-03-14T06:38:26.2680769Z  2025-03-14T06:38:26.2681161Z  2025-03-14T06:38:26.2681613Z  2025-03-14T06:38:26.2682010Z  2025-03-14T06:38:26.2682466Z  2025-03-14T06:38:26.2683365Z [18,531 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:26.2684685Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2025-03-14T06:38:26.2685554Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T06:38:26.2686592Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T06:38:26.2687671Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T06:38:26.2688718Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local 2025-03-14T06:38:26.2689888Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2025-03-14T06:38:26.2690941Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2025-03-14T06:38:26.2691939Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local ... 2025-03-14T06:38:26.4681538Z 2025-03-14T06:38:26.4682411Z  2025-03-14T06:38:26.4682897Z  2025-03-14T06:38:26.4683292Z  2025-03-14T06:38:26.4683687Z  2025-03-14T06:38:26.4684097Z  2025-03-14T06:38:26.4684930Z  2025-03-14T06:38:26.4685341Z  2025-03-14T06:38:26.4685753Z  2025-03-14T06:38:26.4686760Z [18,532 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:26.4687832Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2025-03-14T06:38:26.4688759Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T06:38:26.4689673Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 28s local 2025-03-14T06:38:26.4690769Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T06:38:26.4691767Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T06:38:26.4692675Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2025-03-14T06:38:26.4693660Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2025-03-14T06:38:26.4694635Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 17s local ... 2025-03-14T06:38:26.8234396Z 2025-03-14T06:38:26.8235304Z  2025-03-14T06:38:26.8235779Z  2025-03-14T06:38:26.8236181Z  2025-03-14T06:38:26.8236618Z  2025-03-14T06:38:26.8237111Z  2025-03-14T06:38:26.8237518Z  2025-03-14T06:38:26.8237931Z  2025-03-14T06:38:26.8238318Z  2025-03-14T06:38:26.8239264Z [18,533 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:26.8240267Z Compiling stablehlo/dialect/StablehloOps.cpp; 102s local 2025-03-14T06:38:26.8241069Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T06:38:26.8241895Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T06:38:26.8242914Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T06:38:26.8243775Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T06:38:26.8244731Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2025-03-14T06:38:26.8245628Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 18s local 2025-03-14T06:38:26.8246985Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local ... 2025-03-14T06:38:27.0686177Z 2025-03-14T06:38:27.0687037Z  2025-03-14T06:38:27.0687506Z  2025-03-14T06:38:27.0687884Z  2025-03-14T06:38:27.0688313Z  2025-03-14T06:38:27.0688715Z  2025-03-14T06:38:27.0689120Z  2025-03-14T06:38:27.0689515Z  2025-03-14T06:38:27.0689901Z  2025-03-14T06:38:27.0690812Z [18,533 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:27.0692139Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T06:38:27.0692998Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2025-03-14T06:38:27.0693969Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T06:38:27.0695000Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T06:38:27.0696086Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T06:38:27.0697035Z Compiling shardy/dialect/sdy/ir/dialect.cc; 20s local 2025-03-14T06:38:27.0697980Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 19s local 2025-03-14T06:38:27.0698981Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local ... 2025-03-14T06:38:27.2689281Z 2025-03-14T06:38:27.2690126Z  2025-03-14T06:38:27.2690580Z  2025-03-14T06:38:27.2690951Z  2025-03-14T06:38:27.2691345Z  2025-03-14T06:38:27.2692138Z  2025-03-14T06:38:27.2692549Z  2025-03-14T06:38:27.2692989Z  2025-03-14T06:38:27.2693402Z  2025-03-14T06:38:27.2694358Z [18,535 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:27.2695425Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T06:38:27.2696271Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2025-03-14T06:38:27.2697300Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T06:38:27.2698612Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T06:38:27.2699716Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T06:38:27.2700731Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2025-03-14T06:38:27.2701685Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 19s local 2025-03-14T06:38:27.2702704Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local ... 2025-03-14T06:38:27.5845881Z 2025-03-14T06:38:27.5846778Z  2025-03-14T06:38:27.5847295Z  2025-03-14T06:38:27.5847670Z  2025-03-14T06:38:27.5848078Z  2025-03-14T06:38:27.5848472Z  2025-03-14T06:38:27.5848894Z  2025-03-14T06:38:27.5849288Z  2025-03-14T06:38:27.5849655Z  2025-03-14T06:38:27.5850582Z [18,536 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:27.5851615Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T06:38:27.5852441Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2025-03-14T06:38:27.5853371Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 29s local 2025-03-14T06:38:27.5854400Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T06:38:27.5855394Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T06:38:27.5856294Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2025-03-14T06:38:27.5857273Z Compiling xla/hlo/translate/mhlo_to_hlo/attribute_exporter.cc; 19s local 2025-03-14T06:38:27.5858255Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 18s local ... 2025-03-14T06:38:27.8496852Z 2025-03-14T06:38:27.8497674Z  2025-03-14T06:38:27.8498085Z  2025-03-14T06:38:27.8498464Z  2025-03-14T06:38:27.8498972Z  2025-03-14T06:38:27.8499362Z  2025-03-14T06:38:27.8499766Z  2025-03-14T06:38:27.8500156Z  2025-03-14T06:38:27.8500588Z  2025-03-14T06:38:27.8501830Z [18,538 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:27.8502898Z Compiling stablehlo/dialect/StablehloOps.cpp; 103s local 2025-03-14T06:38:27.8503709Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T06:38:27.8504636Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T06:38:27.8505659Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T06:38:27.8506855Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T06:38:27.8507747Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2025-03-14T06:38:27.8508592Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T06:38:27.8509356Z Compiling xla/service/dump.cc; 17s local ... 2025-03-14T06:38:28.0695023Z 2025-03-14T06:38:28.0695874Z  2025-03-14T06:38:28.0696325Z  2025-03-14T06:38:28.0696755Z  2025-03-14T06:38:28.0697144Z  2025-03-14T06:38:28.0697551Z  2025-03-14T06:38:28.0697946Z  2025-03-14T06:38:28.0698338Z  2025-03-14T06:38:28.0698730Z  2025-03-14T06:38:28.0699705Z [18,538 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:28.0700757Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2025-03-14T06:38:28.0701634Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T06:38:28.0702872Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 30s local 2025-03-14T06:38:28.0703857Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T06:38:28.0704828Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T06:38:28.0705741Z Compiling shardy/dialect/sdy/ir/dialect.cc; 21s local 2025-03-14T06:38:28.0706569Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T06:38:28.0707285Z Compiling xla/service/dump.cc; 17s local ... 2025-03-14T06:38:28.6917863Z 2025-03-14T06:38:28.6918772Z  2025-03-14T06:38:28.6919244Z  2025-03-14T06:38:28.6919650Z  2025-03-14T06:38:28.6920070Z  2025-03-14T06:38:28.6920474Z  2025-03-14T06:38:28.6920865Z  2025-03-14T06:38:28.6921267Z  2025-03-14T06:38:28.6921673Z  2025-03-14T06:38:28.6922621Z [18,539 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:28.6923704Z Compiling stablehlo/dialect/StablehloOps.cpp; 104s local 2025-03-14T06:38:28.6924664Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T06:38:28.6925614Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2025-03-14T06:38:28.6926659Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2025-03-14T06:38:28.6927640Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T06:38:28.6928567Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local 2025-03-14T06:38:28.6929400Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 19s local 2025-03-14T06:38:28.6930130Z Compiling xla/service/dump.cc; 18s local ... 2025-03-14T06:38:29.0702443Z 2025-03-14T06:38:29.0703311Z  2025-03-14T06:38:29.0703814Z  2025-03-14T06:38:29.0704212Z  2025-03-14T06:38:29.0704586Z  2025-03-14T06:38:29.0704962Z  2025-03-14T06:38:29.0705369Z  2025-03-14T06:38:29.0705779Z  2025-03-14T06:38:29.0706241Z  2025-03-14T06:38:29.0707196Z [18,540 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:29.0708199Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2025-03-14T06:38:29.0709016Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T06:38:29.0709942Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2025-03-14T06:38:29.0710953Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2025-03-14T06:38:29.0712188Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T06:38:29.0713106Z Compiling shardy/dialect/sdy/ir/dialect.cc; 22s local 2025-03-14T06:38:29.0713885Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2025-03-14T06:38:29.0714586Z Compiling xla/service/dump.cc; 18s local ... 2025-03-14T06:38:29.2884991Z 2025-03-14T06:38:29.2885831Z  2025-03-14T06:38:29.2886273Z  2025-03-14T06:38:29.2886652Z  2025-03-14T06:38:29.2887016Z  2025-03-14T06:38:29.2887383Z  2025-03-14T06:38:29.2887751Z  2025-03-14T06:38:29.2888435Z  2025-03-14T06:38:29.2888790Z  2025-03-14T06:38:29.2889603Z [18,542 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:29.2890556Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2025-03-14T06:38:29.2891267Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T06:38:29.2892112Z Compiling llvm/lib/Transforms/Vectorize/LoopVectorize.cpp; 31s local 2025-03-14T06:38:29.2893054Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T06:38:29.2893936Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T06:38:29.2894735Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2025-03-14T06:38:29.2895412Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2025-03-14T06:38:29.2896177Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 13s local ... 2025-03-14T06:38:29.5344810Z 2025-03-14T06:38:29.5345659Z  2025-03-14T06:38:29.5346179Z  2025-03-14T06:38:29.5346626Z  2025-03-14T06:38:29.5347019Z  2025-03-14T06:38:29.5347425Z  2025-03-14T06:38:29.5347832Z  2025-03-14T06:38:29.5348240Z  2025-03-14T06:38:29.5348639Z  2025-03-14T06:38:29.5349528Z [18,544 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:29.5350773Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2025-03-14T06:38:29.5351640Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T06:38:29.5352531Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T06:38:29.5353506Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2025-03-14T06:38:29.5354494Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2025-03-14T06:38:29.5355353Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 20s local 2025-03-14T06:38:29.5356223Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 13s local 2025-03-14T06:38:29.5357152Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local ... 2025-03-14T06:38:29.7874349Z 2025-03-14T06:38:29.7875230Z  2025-03-14T06:38:29.7875746Z  2025-03-14T06:38:29.7876156Z  2025-03-14T06:38:29.7876596Z  2025-03-14T06:38:29.7876994Z  2025-03-14T06:38:29.7877386Z  2025-03-14T06:38:29.7877906Z  2025-03-14T06:38:29.7878441Z  2025-03-14T06:38:29.7879428Z [18,545 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:29.7880535Z Compiling stablehlo/dialect/StablehloOps.cpp; 105s local 2025-03-14T06:38:29.7881378Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T06:38:29.7882276Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T06:38:29.7883277Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2025-03-14T06:38:29.7884183Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2025-03-14T06:38:29.7885132Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T06:38:29.7885984Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 13s local 2025-03-14T06:38:29.7886989Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local ... 2025-03-14T06:38:30.0709570Z 2025-03-14T06:38:30.0710416Z  2025-03-14T06:38:30.0710933Z  2025-03-14T06:38:30.0711375Z  2025-03-14T06:38:30.0711780Z  2025-03-14T06:38:30.0712188Z  2025-03-14T06:38:30.0712847Z  2025-03-14T06:38:30.0713283Z  2025-03-14T06:38:30.0713682Z  2025-03-14T06:38:30.0714637Z [18,546 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:30.0715718Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2025-03-14T06:38:30.0716581Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T06:38:30.0729772Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T06:38:30.0731018Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2025-03-14T06:38:30.0731921Z Compiling shardy/dialect/sdy/ir/dialect.cc; 23s local 2025-03-14T06:38:30.0732709Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T06:38:30.0733538Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 13s local 2025-03-14T06:38:30.0734458Z Compiling xla/service/cpu/buffer_info_util.cc; 13s local ... 2025-03-14T06:38:30.4714001Z 2025-03-14T06:38:30.4714890Z  2025-03-14T06:38:30.4715382Z  2025-03-14T06:38:30.4715800Z  2025-03-14T06:38:30.4716197Z  2025-03-14T06:38:30.4716636Z  2025-03-14T06:38:30.4717078Z  2025-03-14T06:38:30.4717475Z  2025-03-14T06:38:30.4717871Z  2025-03-14T06:38:30.4718827Z [18,547 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:30.4720173Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2025-03-14T06:38:30.4721089Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T06:38:30.4722156Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2025-03-14T06:38:30.4723190Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2025-03-14T06:38:30.4724094Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local 2025-03-14T06:38:30.4725038Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 21s local 2025-03-14T06:38:30.4726132Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 14s local 2025-03-14T06:38:30.4727096Z Compiling xla/service/cpu/buffer_info_util.cc; 14s local ... 2025-03-14T06:38:30.8718389Z 2025-03-14T06:38:30.8719696Z  2025-03-14T06:38:30.8720495Z  2025-03-14T06:38:30.8721112Z  2025-03-14T06:38:30.8721739Z  2025-03-14T06:38:30.8722294Z  2025-03-14T06:38:30.8722884Z  2025-03-14T06:38:30.8723499Z  2025-03-14T06:38:30.8724082Z  2025-03-14T06:38:30.8725401Z [18,548 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:30.8726802Z Compiling stablehlo/dialect/StablehloOps.cpp; 106s local 2025-03-14T06:38:30.8727731Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T06:38:30.8728702Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2025-03-14T06:38:30.8729806Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2025-03-14T06:38:30.8730837Z Compiling shardy/dialect/sdy/ir/dialect.cc; 24s local 2025-03-14T06:38:30.8731765Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T06:38:30.8732858Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 14s local 2025-03-14T06:38:30.8733930Z Compiling xla/service/cpu/buffer_info_util.cc; 14s local ... 2025-03-14T06:38:31.2722723Z 2025-03-14T06:38:31.2723897Z  2025-03-14T06:38:31.2724629Z  2025-03-14T06:38:31.2725259Z  2025-03-14T06:38:31.2726458Z  2025-03-14T06:38:31.2726948Z  2025-03-14T06:38:31.2727416Z  2025-03-14T06:38:31.2727841Z  2025-03-14T06:38:31.2728240Z  2025-03-14T06:38:31.2729263Z [18,551 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:31.2730380Z Compiling stablehlo/dialect/StablehloOps.cpp; 107s local 2025-03-14T06:38:31.2731255Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T06:38:31.2732466Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T06:38:31.2733497Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2025-03-14T06:38:31.2734476Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T06:38:31.2735323Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T06:38:31.2736201Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 15s local 2025-03-14T06:38:31.2737208Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 14s local ... 2025-03-14T06:38:31.5187939Z 2025-03-14T06:38:31.5188948Z  2025-03-14T06:38:31.5189731Z  2025-03-14T06:38:31.5190179Z  2025-03-14T06:38:31.5190551Z  2025-03-14T06:38:31.5190930Z  2025-03-14T06:38:31.5191328Z  2025-03-14T06:38:31.5191707Z  2025-03-14T06:38:31.5192107Z  2025-03-14T06:38:31.5193045Z [18,553 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:31.5194143Z Compiling stablehlo/dialect/StablehloOps.cpp; 107s local 2025-03-14T06:38:31.5194992Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T06:38:31.5195890Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T06:38:31.5196873Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 26s local 2025-03-14T06:38:31.5197796Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T06:38:31.5198606Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 22s local 2025-03-14T06:38:31.5199713Z Compiling xla/backends/cpu/runtime/topk_thunk.cc; 15s local 2025-03-14T06:38:31.5200738Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 14s local ... 2025-03-14T06:38:31.8728610Z 2025-03-14T06:38:31.8729479Z  2025-03-14T06:38:31.8729933Z  2025-03-14T06:38:31.8730338Z  2025-03-14T06:38:31.8730733Z  2025-03-14T06:38:31.8731134Z  2025-03-14T06:38:31.8731540Z  2025-03-14T06:38:31.8732241Z  2025-03-14T06:38:31.8732680Z  2025-03-14T06:38:31.8733638Z [18,555 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:31.8734751Z Compiling stablehlo/dialect/StablehloOps.cpp; 107s local 2025-03-14T06:38:31.8735628Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2025-03-14T06:38:31.8736555Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T06:38:31.8737640Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 26s local 2025-03-14T06:38:31.8738746Z Compiling shardy/dialect/sdy/ir/dialect.cc; 25s local 2025-03-14T06:38:31.8739597Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T06:38:31.8740554Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 14s local 2025-03-14T06:38:31.8741699Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 14s local ... 2025-03-14T06:38:32.2068345Z 2025-03-14T06:38:32.2069168Z  2025-03-14T06:38:32.2069627Z  2025-03-14T06:38:32.2070049Z  2025-03-14T06:38:32.2070432Z  2025-03-14T06:38:32.2070826Z  2025-03-14T06:38:32.2071193Z  2025-03-14T06:38:32.2071569Z  2025-03-14T06:38:32.2071941Z  2025-03-14T06:38:32.2072854Z [18,558 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:32.2073794Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2025-03-14T06:38:32.2074629Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T06:38:32.2075500Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2025-03-14T06:38:32.2076291Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T06:38:32.2077168Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 15s local 2025-03-14T06:38:32.2078195Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 14s local 2025-03-14T06:38:32.2079148Z Compiling stablehlo/reference/InterpreterOps.cpp; 14s local 2025-03-14T06:38:32.2080091Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local ... 2025-03-14T06:38:32.4533383Z 2025-03-14T06:38:32.4534275Z  2025-03-14T06:38:32.4534770Z  2025-03-14T06:38:32.4537276Z  2025-03-14T06:38:32.4540383Z  2025-03-14T06:38:32.4543557Z  2025-03-14T06:38:32.4546542Z  2025-03-14T06:38:32.4549398Z  2025-03-14T06:38:32.4552441Z  2025-03-14T06:38:32.4555822Z [18,559 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:32.4559320Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2025-03-14T06:38:32.4562779Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T06:38:32.4566573Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2025-03-14T06:38:32.4569241Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T06:38:32.4570357Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 15s local 2025-03-14T06:38:32.4571595Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 14s local 2025-03-14T06:38:32.4572748Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local 2025-03-14T06:38:32.4573984Z @llvm-project//mlir:AffineToStandard; 13s local ... 2025-03-14T06:38:32.6734492Z 2025-03-14T06:38:32.6735696Z  2025-03-14T06:38:32.6736343Z  2025-03-14T06:38:32.6736937Z  2025-03-14T06:38:32.6738016Z  2025-03-14T06:38:32.6738540Z  2025-03-14T06:38:32.6738977Z  2025-03-14T06:38:32.6739740Z  2025-03-14T06:38:32.6740178Z  2025-03-14T06:38:32.6741227Z [18,559 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:32.6742362Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2025-03-14T06:38:32.6743356Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T06:38:32.6744356Z Compiling shardy/dialect/sdy/ir/dialect.cc; 26s local 2025-03-14T06:38:32.6745249Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 23s local 2025-03-14T06:38:32.6746416Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 15s local 2025-03-14T06:38:32.6747568Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 15s local 2025-03-14T06:38:32.6748674Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local 2025-03-14T06:38:32.6749632Z @llvm-project//mlir:AffineToStandard; 13s local ... 2025-03-14T06:38:33.0738797Z 2025-03-14T06:38:33.0740078Z  2025-03-14T06:38:33.0740557Z  2025-03-14T06:38:33.0741022Z  2025-03-14T06:38:33.0741409Z  2025-03-14T06:38:33.0741818Z  2025-03-14T06:38:33.0742242Z  2025-03-14T06:38:33.0742679Z  2025-03-14T06:38:33.0743099Z  2025-03-14T06:38:33.0744123Z [18,563 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:33.0745161Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2025-03-14T06:38:33.0746069Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T06:38:33.0747010Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T06:38:33.0747993Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 15s local 2025-03-14T06:38:33.0749173Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 15s local 2025-03-14T06:38:33.0750170Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local 2025-03-14T06:38:33.0751036Z @llvm-project//mlir:AffineToStandard; 13s local 2025-03-14T06:38:33.0752041Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 13s local ... 2025-03-14T06:38:33.4743260Z 2025-03-14T06:38:33.4744518Z  2025-03-14T06:38:33.4745058Z  2025-03-14T06:38:33.4745494Z  2025-03-14T06:38:33.4745931Z  2025-03-14T06:38:33.4746367Z  2025-03-14T06:38:33.4746741Z  2025-03-14T06:38:33.4747146Z  2025-03-14T06:38:33.4747572Z  2025-03-14T06:38:33.4748549Z [18,564 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:33.4749938Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2025-03-14T06:38:33.4750912Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2025-03-14T06:38:33.4751809Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 24s local 2025-03-14T06:38:33.4752738Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 16s local 2025-03-14T06:38:33.4753807Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 15s local 2025-03-14T06:38:33.4754808Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2025-03-14T06:38:33.4755868Z @llvm-project//mlir:AffineToStandard; 14s local 2025-03-14T06:38:33.4756879Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local ... 2025-03-14T06:38:33.7827153Z 2025-03-14T06:38:33.7827956Z  2025-03-14T06:38:33.7828465Z  2025-03-14T06:38:33.7828896Z  2025-03-14T06:38:33.7829312Z  2025-03-14T06:38:33.7829735Z  2025-03-14T06:38:33.7830193Z  2025-03-14T06:38:33.7830598Z  2025-03-14T06:38:33.7831021Z  2025-03-14T06:38:33.7831996Z [18,567 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:33.7833403Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2025-03-14T06:38:33.7834444Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2025-03-14T06:38:33.7835488Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T06:38:33.7836544Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 16s local 2025-03-14T06:38:33.7838092Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 16s local 2025-03-14T06:38:33.7839240Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2025-03-14T06:38:33.7840222Z @llvm-project//mlir:AffineToStandard; 14s local 2025-03-14T06:38:33.7841331Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local ... 2025-03-14T06:38:34.0748004Z 2025-03-14T06:38:34.0749192Z  2025-03-14T06:38:34.0749680Z  2025-03-14T06:38:34.0750118Z  2025-03-14T06:38:34.0750565Z  2025-03-14T06:38:34.0751007Z  2025-03-14T06:38:34.0751429Z  2025-03-14T06:38:34.0751839Z  2025-03-14T06:38:34.0752264Z  2025-03-14T06:38:34.0753221Z [18,568 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:34.0754306Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2025-03-14T06:38:34.0755250Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2025-03-14T06:38:34.0756199Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 25s local 2025-03-14T06:38:34.0757172Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 16s local 2025-03-14T06:38:34.0758233Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 16s local 2025-03-14T06:38:34.0759251Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local 2025-03-14T06:38:34.0760332Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 14s local 2025-03-14T06:38:34.0761453Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 14s local ... 2025-03-14T06:38:35.0623957Z 2025-03-14T06:38:35.0624792Z  2025-03-14T06:38:35.0625266Z  2025-03-14T06:38:35.0625667Z  2025-03-14T06:38:35.0626057Z  2025-03-14T06:38:35.0626445Z  2025-03-14T06:38:35.0626845Z  2025-03-14T06:38:35.0627239Z  2025-03-14T06:38:35.0627638Z  2025-03-14T06:38:35.0628582Z [18,569 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:35.0629661Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T06:38:35.0630585Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2025-03-14T06:38:35.0631789Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2025-03-14T06:38:35.0632679Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 17s local 2025-03-14T06:38:35.0633820Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 17s local 2025-03-14T06:38:35.0635205Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2025-03-14T06:38:35.0636355Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2025-03-14T06:38:35.0637588Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local ... 2025-03-14T06:38:35.2758842Z 2025-03-14T06:38:35.2759736Z  2025-03-14T06:38:35.2762232Z  2025-03-14T06:38:35.2765844Z  2025-03-14T06:38:35.2768770Z  2025-03-14T06:38:35.2771667Z  2025-03-14T06:38:35.2774528Z  2025-03-14T06:38:35.2777375Z  2025-03-14T06:38:35.2780520Z  2025-03-14T06:38:35.2783864Z [18,569 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:35.2787269Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T06:38:35.2790475Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T06:38:35.2793645Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2025-03-14T06:38:35.2796854Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local 2025-03-14T06:38:35.2800155Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 17s local 2025-03-14T06:38:35.2803390Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T06:38:35.2808705Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 15s local 2025-03-14T06:38:35.2812136Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local ... 2025-03-14T06:38:35.4760138Z 2025-03-14T06:38:35.4763384Z  2025-03-14T06:38:35.4766508Z  2025-03-14T06:38:35.4768262Z  2025-03-14T06:38:35.4768822Z  2025-03-14T06:38:35.4769332Z  2025-03-14T06:38:35.4769858Z  2025-03-14T06:38:35.4770354Z  2025-03-14T06:38:35.4770868Z  2025-03-14T06:38:35.4771887Z [18,570 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:35.4773001Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T06:38:35.4774246Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T06:38:35.4775453Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2025-03-14T06:38:35.4776901Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local 2025-03-14T06:38:35.4777974Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 17s local 2025-03-14T06:38:35.4779008Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T06:38:35.4780087Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2025-03-14T06:38:35.4781236Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 15s local ... 2025-03-14T06:38:35.7276659Z 2025-03-14T06:38:35.7277851Z  2025-03-14T06:38:35.7278291Z  2025-03-14T06:38:35.7278652Z  2025-03-14T06:38:35.7279015Z  2025-03-14T06:38:35.7279362Z  2025-03-14T06:38:35.7279719Z  2025-03-14T06:38:35.7280084Z  2025-03-14T06:38:35.7280489Z  2025-03-14T06:38:35.7281347Z [18,572 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:35.7282270Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T06:38:35.7283085Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T06:38:35.7283890Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 26s local 2025-03-14T06:38:35.7284820Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local 2025-03-14T06:38:35.7285742Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T06:38:35.7286733Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T06:38:35.7287632Z Compiling llvm/lib/CodeGen/CodeGenTargetMachineImpl.cpp; 16s local 2025-03-14T06:38:35.7288569Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local ... 2025-03-14T06:38:36.0693106Z 2025-03-14T06:38:36.0693920Z  2025-03-14T06:38:36.0694446Z  2025-03-14T06:38:36.0694896Z  2025-03-14T06:38:36.0695324Z  2025-03-14T06:38:36.0695977Z  2025-03-14T06:38:36.0696371Z  2025-03-14T06:38:36.0696763Z  2025-03-14T06:38:36.0697129Z  2025-03-14T06:38:36.0698055Z [18,574 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:36.0699022Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T06:38:36.0699876Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T06:38:36.0700819Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T06:38:36.0703759Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local 2025-03-14T06:38:36.0705124Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T06:38:36.0706061Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T06:38:36.0706966Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2025-03-14T06:38:36.0707798Z @llvm-project//mlir:SCFTransforms; 15s local ... 2025-03-14T06:38:36.2766263Z 2025-03-14T06:38:36.2767164Z  2025-03-14T06:38:36.2767677Z  2025-03-14T06:38:36.2768113Z  2025-03-14T06:38:36.2768525Z  2025-03-14T06:38:36.2768955Z  2025-03-14T06:38:36.2769394Z  2025-03-14T06:38:36.2769817Z  2025-03-14T06:38:36.2770253Z  2025-03-14T06:38:36.2771217Z [18,576 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:36.2772558Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T06:38:36.2773550Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T06:38:36.2774457Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T06:38:36.2775355Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local 2025-03-14T06:38:36.2776361Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T06:38:36.2777323Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T06:38:36.2778890Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2025-03-14T06:38:36.2779861Z @llvm-project//mlir:SCFTransforms; 15s local ... 2025-03-14T06:38:36.4957580Z 2025-03-14T06:38:36.4961348Z  2025-03-14T06:38:36.4961828Z  2025-03-14T06:38:36.4962214Z  2025-03-14T06:38:36.4962594Z  2025-03-14T06:38:36.4962985Z  2025-03-14T06:38:36.4963332Z  2025-03-14T06:38:36.4963638Z  2025-03-14T06:38:36.4963980Z  2025-03-14T06:38:36.4964943Z [18,577 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:36.4966077Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T06:38:36.4966906Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T06:38:36.4967765Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T06:38:36.4968614Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local 2025-03-14T06:38:36.4969649Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 18s local 2025-03-14T06:38:36.4970607Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T06:38:36.4971507Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 16s local 2025-03-14T06:38:36.4972337Z @llvm-project//mlir:SCFTransforms; 15s local ... 2025-03-14T06:38:36.7210305Z 2025-03-14T06:38:36.7211180Z  2025-03-14T06:38:36.7211669Z  2025-03-14T06:38:36.7212117Z  2025-03-14T06:38:36.7212528Z  2025-03-14T06:38:36.7212936Z  2025-03-14T06:38:36.7213356Z  2025-03-14T06:38:36.7213750Z  2025-03-14T06:38:36.7214148Z  2025-03-14T06:38:36.7215121Z [18,578 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:36.7216132Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T06:38:36.7216991Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T06:38:36.7218182Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 27s local 2025-03-14T06:38:36.7219112Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local 2025-03-14T06:38:36.7220121Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T06:38:36.7221112Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T06:38:36.7222165Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T06:38:36.7222994Z @llvm-project//mlir:SCFTransforms; 15s local ... 2025-03-14T06:38:36.9418566Z 2025-03-14T06:38:36.9419424Z  2025-03-14T06:38:36.9420173Z  2025-03-14T06:38:36.9420573Z  2025-03-14T06:38:36.9420945Z  2025-03-14T06:38:36.9421344Z  2025-03-14T06:38:36.9421739Z  2025-03-14T06:38:36.9422096Z  2025-03-14T06:38:36.9422479Z  2025-03-14T06:38:36.9423853Z [18,579 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:36.9425063Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T06:38:36.9426254Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T06:38:36.9427330Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T06:38:36.9428302Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local 2025-03-14T06:38:36.9429392Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T06:38:36.9430450Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T06:38:36.9431745Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T06:38:36.9432697Z @llvm-project//mlir:SCFTransforms; 15s local ... 2025-03-14T06:38:37.2774337Z 2025-03-14T06:38:37.2775271Z  2025-03-14T06:38:37.2777043Z  2025-03-14T06:38:37.2778644Z  2025-03-14T06:38:37.2780117Z  2025-03-14T06:38:37.2781573Z  2025-03-14T06:38:37.2783034Z  2025-03-14T06:38:37.2784864Z  2025-03-14T06:38:37.2786287Z  2025-03-14T06:38:37.2788328Z [18,579 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:37.2789600Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T06:38:37.2790699Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T06:38:37.2791776Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T06:38:37.2793124Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local 2025-03-14T06:38:37.2794186Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 19s local 2025-03-14T06:38:37.2795146Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T06:38:37.2796035Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T06:38:37.2796865Z @llvm-project//mlir:SCFTransforms; 16s local ... 2025-03-14T06:38:37.6253484Z 2025-03-14T06:38:37.6254408Z  2025-03-14T06:38:37.6254886Z  2025-03-14T06:38:37.6255742Z  2025-03-14T06:38:37.6256154Z  2025-03-14T06:38:37.6256527Z  2025-03-14T06:38:37.6256949Z  2025-03-14T06:38:37.6257357Z  2025-03-14T06:38:37.6257762Z  2025-03-14T06:38:37.6258955Z [18,581 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:37.6260124Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T06:38:37.6261154Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T06:38:37.6262154Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 28s local 2025-03-14T06:38:37.6263206Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local 2025-03-14T06:38:37.6264381Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local 2025-03-14T06:38:37.6265644Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T06:38:37.6266656Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 17s local 2025-03-14T06:38:37.6269120Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local ... 2025-03-14T06:38:37.8781411Z 2025-03-14T06:38:37.8783699Z  2025-03-14T06:38:37.8785531Z  2025-03-14T06:38:37.8787303Z  2025-03-14T06:38:37.8789008Z  2025-03-14T06:38:37.8790740Z  2025-03-14T06:38:37.8792459Z  2025-03-14T06:38:37.8794215Z  2025-03-14T06:38:37.8796005Z  2025-03-14T06:38:37.8798299Z [18,581 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:37.8800707Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T06:38:37.8803116Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T06:38:37.8805448Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T06:38:37.8807680Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local 2025-03-14T06:38:37.8810022Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local 2025-03-14T06:38:37.8812344Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T06:38:37.8814565Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T06:38:37.8816853Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local ... 2025-03-14T06:38:38.2784915Z 2025-03-14T06:38:38.2787185Z  2025-03-14T06:38:38.2788986Z  2025-03-14T06:38:38.2790738Z  2025-03-14T06:38:38.2792555Z  2025-03-14T06:38:38.2794254Z  2025-03-14T06:38:38.2795969Z  2025-03-14T06:38:38.2797956Z  2025-03-14T06:38:38.2799636Z  2025-03-14T06:38:38.2801840Z [18,582 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:38.2804278Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T06:38:38.2806595Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T06:38:38.2810907Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T06:38:38.2813088Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2025-03-14T06:38:38.2813951Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 20s local 2025-03-14T06:38:38.2814793Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T06:38:38.2815557Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T06:38:38.2816420Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 16s local ... 2025-03-14T06:38:38.6787920Z 2025-03-14T06:38:38.6789330Z  2025-03-14T06:38:38.6789898Z  2025-03-14T06:38:38.6790440Z  2025-03-14T06:38:38.6791465Z  2025-03-14T06:38:38.6791976Z  2025-03-14T06:38:38.6792367Z  2025-03-14T06:38:38.6792764Z  2025-03-14T06:38:38.6793141Z  2025-03-14T06:38:38.6794093Z [18,583 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:38.6795151Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T06:38:38.6796044Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T06:38:38.6796878Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 29s local 2025-03-14T06:38:38.6797759Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2025-03-14T06:38:38.6798742Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T06:38:38.6799646Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T06:38:38.6800525Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 18s local 2025-03-14T06:38:38.6801520Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local ... 2025-03-14T06:38:38.8791010Z 2025-03-14T06:38:38.8791900Z  2025-03-14T06:38:38.8792383Z  2025-03-14T06:38:38.8792788Z  2025-03-14T06:38:38.8793171Z  2025-03-14T06:38:38.8793557Z  2025-03-14T06:38:38.8793936Z  2025-03-14T06:38:38.8794332Z  2025-03-14T06:38:38.8795046Z  2025-03-14T06:38:38.8796244Z [18,584 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:38.8797286Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2025-03-14T06:38:38.8798142Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T06:38:38.8798983Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T06:38:38.8799850Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2025-03-14T06:38:38.8800872Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T06:38:38.8802017Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T06:38:38.8802943Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T06:38:38.8803927Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local ... 2025-03-14T06:38:39.1011480Z 2025-03-14T06:38:39.1012423Z  2025-03-14T06:38:39.1012912Z  2025-03-14T06:38:39.1013349Z  2025-03-14T06:38:39.1013790Z  2025-03-14T06:38:39.1014255Z  2025-03-14T06:38:39.1014690Z  2025-03-14T06:38:39.1015084Z  2025-03-14T06:38:39.1015448Z  2025-03-14T06:38:39.1016378Z [18,588 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:39.1017324Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2025-03-14T06:38:39.1018141Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T06:38:39.1019003Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T06:38:39.1020102Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2025-03-14T06:38:39.1021101Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T06:38:39.1022022Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T06:38:39.1022913Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T06:38:39.1023829Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local ... 2025-03-14T06:38:39.4797346Z 2025-03-14T06:38:39.4798245Z  2025-03-14T06:38:39.4798824Z  2025-03-14T06:38:39.4799258Z  2025-03-14T06:38:39.4799686Z  2025-03-14T06:38:39.4800046Z  2025-03-14T06:38:39.4800388Z  2025-03-14T06:38:39.4800732Z  2025-03-14T06:38:39.4801142Z  2025-03-14T06:38:39.4802058Z [18,589 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:39.4803055Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2025-03-14T06:38:39.4803892Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T06:38:39.4804841Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 30s local 2025-03-14T06:38:39.4805703Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2025-03-14T06:38:39.4806644Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 21s local 2025-03-14T06:38:39.4807614Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T06:38:39.4808501Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 19s local 2025-03-14T06:38:39.4809451Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 17s local ... 2025-03-14T06:38:39.8772865Z 2025-03-14T06:38:39.8774243Z  2025-03-14T06:38:39.8774724Z  2025-03-14T06:38:39.8775118Z  2025-03-14T06:38:39.8775519Z  2025-03-14T06:38:39.8775929Z  2025-03-14T06:38:39.8776263Z  2025-03-14T06:38:39.8776671Z  2025-03-14T06:38:39.8777120Z  2025-03-14T06:38:39.8778113Z [18,590 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:39.8779049Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T06:38:39.8779900Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T06:38:39.8780786Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T06:38:39.8781684Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2025-03-14T06:38:39.8782905Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T06:38:39.8783886Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T06:38:39.8784773Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T06:38:39.8785707Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local ... 2025-03-14T06:38:40.0802080Z 2025-03-14T06:38:40.0802933Z  2025-03-14T06:38:40.0803423Z  2025-03-14T06:38:40.0803862Z  2025-03-14T06:38:40.0804260Z  2025-03-14T06:38:40.0804802Z  2025-03-14T06:38:40.0805423Z  2025-03-14T06:38:40.0805819Z  2025-03-14T06:38:40.0806217Z  2025-03-14T06:38:40.0807188Z [18,592 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:40.0808175Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T06:38:40.0809062Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T06:38:40.0810012Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T06:38:40.0810896Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2025-03-14T06:38:40.0812011Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T06:38:40.0812930Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T06:38:40.0813830Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T06:38:40.0814812Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local ... 2025-03-14T06:38:40.4805945Z 2025-03-14T06:38:40.4807749Z  2025-03-14T06:38:40.4808789Z  2025-03-14T06:38:40.4809856Z  2025-03-14T06:38:40.4810309Z  2025-03-14T06:38:40.4810757Z  2025-03-14T06:38:40.4811150Z  2025-03-14T06:38:40.4811561Z  2025-03-14T06:38:40.4811983Z  2025-03-14T06:38:40.4812950Z [18,593 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:40.4814451Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T06:38:40.4815360Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2025-03-14T06:38:40.4816243Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T06:38:40.4817165Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2025-03-14T06:38:40.4818191Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 22s local 2025-03-14T06:38:40.4819214Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T06:38:40.4820185Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T06:38:40.4821204Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 18s local ... 2025-03-14T06:38:40.6808901Z 2025-03-14T06:38:40.6809686Z  2025-03-14T06:38:40.6810118Z  2025-03-14T06:38:40.6810483Z  2025-03-14T06:38:40.6810843Z  2025-03-14T06:38:40.6811206Z  2025-03-14T06:38:40.6811590Z  2025-03-14T06:38:40.6811946Z  2025-03-14T06:38:40.6812279Z  2025-03-14T06:38:40.6813161Z [18,594 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:40.6814044Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T06:38:40.6814830Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2025-03-14T06:38:40.6815582Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 31s local 2025-03-14T06:38:40.6816339Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2025-03-14T06:38:40.6817214Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T06:38:40.6818065Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T06:38:40.6818880Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 20s local 2025-03-14T06:38:40.6819767Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local ... 2025-03-14T06:38:41.0076219Z 2025-03-14T06:38:41.0077150Z  2025-03-14T06:38:41.0077643Z  2025-03-14T06:38:41.0078073Z  2025-03-14T06:38:41.0078735Z  2025-03-14T06:38:41.0079170Z  2025-03-14T06:38:41.0079587Z  2025-03-14T06:38:41.0079941Z  2025-03-14T06:38:41.0080307Z  2025-03-14T06:38:41.0081260Z [18,596 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:41.0082249Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2025-03-14T06:38:41.0083132Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2025-03-14T06:38:41.0084173Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2025-03-14T06:38:41.0085195Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2025-03-14T06:38:41.0086616Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T06:38:41.0087687Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T06:38:41.0088721Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T06:38:41.0089890Z Compiling llvm/lib/Transforms/IPO/LowerTypeTests.cpp; 19s local ... 2025-03-14T06:38:41.2416793Z 2025-03-14T06:38:41.2417728Z  2025-03-14T06:38:41.2418284Z  2025-03-14T06:38:41.2418656Z  2025-03-14T06:38:41.2419030Z  2025-03-14T06:38:41.2419411Z  2025-03-14T06:38:41.2419800Z  2025-03-14T06:38:41.2420130Z  2025-03-14T06:38:41.2420461Z  2025-03-14T06:38:41.2421441Z [18,597 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:41.2422744Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2025-03-14T06:38:41.2423581Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T06:38:41.2424471Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2025-03-14T06:38:41.2425350Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2025-03-14T06:38:41.2426349Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T06:38:41.2427470Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2025-03-14T06:38:41.2428406Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T06:38:41.2429332Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 15s local ... 2025-03-14T06:38:41.4815124Z 2025-03-14T06:38:41.4816379Z  2025-03-14T06:38:41.4816919Z  2025-03-14T06:38:41.4817372Z  2025-03-14T06:38:41.4817817Z  2025-03-14T06:38:41.4818296Z  2025-03-14T06:38:41.4818739Z  2025-03-14T06:38:41.4819178Z  2025-03-14T06:38:41.4819627Z  2025-03-14T06:38:41.4820659Z [18,599 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:41.4821807Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2025-03-14T06:38:41.4822801Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T06:38:41.4823800Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 32s local 2025-03-14T06:38:41.4824912Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2025-03-14T06:38:41.4826008Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 23s local 2025-03-14T06:38:41.4827080Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2025-03-14T06:38:41.4828099Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 21s local 2025-03-14T06:38:41.4829183Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 15s local ... 2025-03-14T06:38:42.1159437Z 2025-03-14T06:38:42.1160269Z  2025-03-14T06:38:42.1160760Z  2025-03-14T06:38:42.1161220Z  2025-03-14T06:38:42.1161652Z  2025-03-14T06:38:42.1162025Z  2025-03-14T06:38:42.1162383Z  2025-03-14T06:38:42.1162766Z  2025-03-14T06:38:42.1163498Z  2025-03-14T06:38:42.1164542Z [18,600 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:42.1165689Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2025-03-14T06:38:42.1166804Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T06:38:42.1167699Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T06:38:42.1168558Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2025-03-14T06:38:42.1169527Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2025-03-14T06:38:42.1170568Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T06:38:42.1171531Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T06:38:42.4385052Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local ... 2025-03-14T06:38:42.4385784Z 2025-03-14T06:38:42.4386251Z  2025-03-14T06:38:42.4386640Z  2025-03-14T06:38:42.4387033Z  2025-03-14T06:38:42.4387440Z  2025-03-14T06:38:42.4387827Z  2025-03-14T06:38:42.4388232Z  2025-03-14T06:38:42.4388629Z  2025-03-14T06:38:42.4389051Z  2025-03-14T06:38:42.4389993Z [18,603 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:42.4390982Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2025-03-14T06:38:42.4391868Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2025-03-14T06:38:42.4392724Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T06:38:42.4393582Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2025-03-14T06:38:42.4394791Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 24s local 2025-03-14T06:38:42.4395770Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T06:38:42.4396650Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T06:38:42.4397636Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local ... 2025-03-14T06:38:42.6824375Z 2025-03-14T06:38:42.6825281Z  2025-03-14T06:38:42.6825762Z  2025-03-14T06:38:42.6826430Z  2025-03-14T06:38:42.6826825Z  2025-03-14T06:38:42.6827254Z  2025-03-14T06:38:42.6827660Z  2025-03-14T06:38:42.6828066Z  2025-03-14T06:38:42.6828498Z  2025-03-14T06:38:42.6829448Z [18,604 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:42.6830420Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2025-03-14T06:38:42.6831182Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2025-03-14T06:38:42.6831986Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 33s local 2025-03-14T06:38:42.6832861Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2025-03-14T06:38:42.6833732Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2025-03-14T06:38:42.6834613Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T06:38:42.6835396Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 22s local 2025-03-14T06:38:42.6836269Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local ... 2025-03-14T06:38:43.4332199Z 2025-03-14T06:38:43.4333008Z  2025-03-14T06:38:43.4333500Z  2025-03-14T06:38:43.4333878Z  2025-03-14T06:38:43.4334254Z  2025-03-14T06:38:43.4334730Z  2025-03-14T06:38:43.4335097Z  2025-03-14T06:38:43.4335464Z  2025-03-14T06:38:43.4335827Z  2025-03-14T06:38:43.4336712Z [18,605 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:43.4337678Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2025-03-14T06:38:43.4338552Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2025-03-14T06:38:43.4339404Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2025-03-14T06:38:43.4340248Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T06:38:43.4341196Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 25s local 2025-03-14T06:38:43.4342109Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T06:38:43.4343219Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2025-03-14T06:38:43.4344100Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 17s local ... 2025-03-14T06:38:43.6471910Z 2025-03-14T06:38:43.6473133Z  2025-03-14T06:38:43.6473627Z  2025-03-14T06:38:43.6474031Z  2025-03-14T06:38:43.6474420Z  2025-03-14T06:38:43.6474780Z  2025-03-14T06:38:43.6475176Z  2025-03-14T06:38:43.6475607Z  2025-03-14T06:38:43.6475998Z  2025-03-14T06:38:43.6477108Z [18,606 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:43.6478101Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2025-03-14T06:38:43.6478961Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2025-03-14T06:38:43.6479770Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 34s local 2025-03-14T06:38:43.6480671Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T06:38:43.6481779Z Compiling mlir/lib/Dialect/NVGPU/IR/NVGPUDialect.cpp; 26s local 2025-03-14T06:38:43.6482745Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T06:38:43.6483691Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 23s local 2025-03-14T06:38:43.6484816Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 17s local ... 2025-03-14T06:38:43.8831623Z 2025-03-14T06:38:43.8832877Z  2025-03-14T06:38:43.8833690Z  2025-03-14T06:38:43.8834112Z  2025-03-14T06:38:43.8834531Z  2025-03-14T06:38:43.8834946Z  2025-03-14T06:38:43.8835351Z  2025-03-14T06:38:43.8835747Z  2025-03-14T06:38:43.8836143Z  2025-03-14T06:38:43.8837053Z [18,608 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:43.8838118Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2025-03-14T06:38:43.8839242Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2025-03-14T06:38:43.8840200Z Compiling mlir/lib/Dialect/SCF/IR/SCF.cpp; 35s local 2025-03-14T06:38:43.8841160Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T06:38:43.8842203Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T06:38:43.8843169Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T06:38:43.8844092Z Compiling xla/service/copy_insertion.cc; 14s local 2025-03-14T06:38:43.8845119Z @llvm-project//mlir:LLVMIRTransforms; 12s local ... 2025-03-14T06:38:44.1445325Z 2025-03-14T06:38:44.1446182Z  2025-03-14T06:38:44.1446667Z  2025-03-14T06:38:44.1447071Z  2025-03-14T06:38:44.1447496Z  2025-03-14T06:38:44.1447889Z  2025-03-14T06:38:44.1448289Z  2025-03-14T06:38:44.1448672Z  2025-03-14T06:38:44.1449069Z  2025-03-14T06:38:44.1450071Z [18,609 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:44.1527585Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2025-03-14T06:38:44.1528866Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2025-03-14T06:38:44.1529886Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T06:38:44.1530791Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T06:38:44.1531724Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T06:38:44.1532583Z Compiling xla/service/copy_insertion.cc; 14s local 2025-03-14T06:38:44.1533343Z @llvm-project//mlir:LLVMIRTransforms; 13s local 2025-03-14T06:38:44.1534279Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 13s local ... 2025-03-14T06:38:44.4837544Z 2025-03-14T06:38:44.4838437Z  2025-03-14T06:38:44.4838944Z  2025-03-14T06:38:44.4839383Z  2025-03-14T06:38:44.4839840Z  2025-03-14T06:38:44.4840239Z  2025-03-14T06:38:44.4840655Z  2025-03-14T06:38:44.4841038Z  2025-03-14T06:38:44.4841731Z  2025-03-14T06:38:44.4842696Z [18,610 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:44.4843712Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2025-03-14T06:38:44.4844661Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2025-03-14T06:38:44.4845631Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T06:38:44.4846641Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T06:38:44.4847772Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T06:38:44.4848565Z Compiling xla/service/copy_insertion.cc; 15s local 2025-03-14T06:38:44.4849319Z @llvm-project//mlir:LLVMIRTransforms; 13s local 2025-03-14T06:38:44.4850203Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 13s local ... 2025-03-14T06:38:44.6840635Z 2025-03-14T06:38:44.6841505Z  2025-03-14T06:38:44.6841976Z  2025-03-14T06:38:44.6842380Z  2025-03-14T06:38:44.6842803Z  2025-03-14T06:38:44.6843179Z  2025-03-14T06:38:44.6843553Z  2025-03-14T06:38:44.6843947Z  2025-03-14T06:38:44.6844327Z  2025-03-14T06:38:44.6845422Z [18,611 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:44.6846301Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2025-03-14T06:38:44.6847076Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2025-03-14T06:38:44.6848170Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T06:38:44.6849000Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T06:38:44.6849780Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 24s local 2025-03-14T06:38:44.6850532Z Compiling xla/service/copy_insertion.cc; 15s local 2025-03-14T06:38:44.6851210Z @llvm-project//mlir:LLVMIRTransforms; 13s local 2025-03-14T06:38:44.6852137Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 13s local ... 2025-03-14T06:38:45.0835950Z 2025-03-14T06:38:45.0836841Z  2025-03-14T06:38:45.0837407Z  2025-03-14T06:38:45.0837792Z  2025-03-14T06:38:45.0838138Z  2025-03-14T06:38:45.0838474Z  2025-03-14T06:38:45.0838816Z  2025-03-14T06:38:45.0839147Z  2025-03-14T06:38:45.0839478Z  2025-03-14T06:38:45.0840307Z [18,612 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:45.0841416Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T06:38:45.0842173Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2025-03-14T06:38:45.0843080Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T06:38:45.0843958Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T06:38:45.0844924Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T06:38:45.0845717Z Compiling xla/service/copy_insertion.cc; 15s local 2025-03-14T06:38:45.0846406Z @llvm-project//mlir:LLVMIRTransforms; 14s local 2025-03-14T06:38:45.0847216Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local ... 2025-03-14T06:38:45.2845939Z 2025-03-14T06:38:45.2846928Z  2025-03-14T06:38:45.2847370Z  2025-03-14T06:38:45.2847741Z  2025-03-14T06:38:45.2848116Z  2025-03-14T06:38:45.2848498Z  2025-03-14T06:38:45.2848885Z  2025-03-14T06:38:45.2849218Z  2025-03-14T06:38:45.2849563Z  2025-03-14T06:38:45.2850393Z [18,612 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:45.2851253Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T06:38:45.2852036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T06:38:45.2852897Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T06:38:45.2853972Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T06:38:45.2854771Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T06:38:45.2855523Z Compiling xla/service/copy_insertion.cc; 16s local 2025-03-14T06:38:45.2856227Z @llvm-project//mlir:LLVMIRTransforms; 14s local 2025-03-14T06:38:45.2857042Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local ... 2025-03-14T06:38:45.4848859Z 2025-03-14T06:38:45.4849891Z  2025-03-14T06:38:45.4850342Z  2025-03-14T06:38:45.4850733Z  2025-03-14T06:38:45.4851112Z  2025-03-14T06:38:45.4851719Z  2025-03-14T06:38:45.4852101Z  2025-03-14T06:38:45.4852494Z  2025-03-14T06:38:45.4852883Z  2025-03-14T06:38:45.4853782Z [18,613 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:45.4854704Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T06:38:45.4855570Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T06:38:45.4856466Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T06:38:45.4857349Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T06:38:45.4858197Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T06:38:45.4858991Z Compiling xla/service/copy_insertion.cc; 16s local 2025-03-14T06:38:45.4859715Z @llvm-project//mlir:LLVMIRTransforms; 14s local 2025-03-14T06:38:45.4860751Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local ... 2025-03-14T06:38:45.6861324Z 2025-03-14T06:38:45.6862287Z  2025-03-14T06:38:45.6862739Z  2025-03-14T06:38:45.6863110Z  2025-03-14T06:38:45.6863479Z  2025-03-14T06:38:45.6863843Z  2025-03-14T06:38:45.6864206Z  2025-03-14T06:38:45.6864572Z  2025-03-14T06:38:45.6864931Z  2025-03-14T06:38:45.6866003Z [18,615 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:45.6867124Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T06:38:45.6867909Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T06:38:45.6868801Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T06:38:45.6869674Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T06:38:45.6870470Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 25s local 2025-03-14T06:38:45.6871233Z Compiling xla/service/copy_insertion.cc; 16s local 2025-03-14T06:38:45.6871915Z @llvm-project//mlir:LLVMIRTransforms; 14s local 2025-03-14T06:38:45.6872715Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local ... 2025-03-14T06:38:45.8875256Z 2025-03-14T06:38:45.8876254Z  2025-03-14T06:38:45.8876677Z  2025-03-14T06:38:45.8877014Z  2025-03-14T06:38:45.8877388Z  2025-03-14T06:38:45.8877766Z  2025-03-14T06:38:45.8878117Z  2025-03-14T06:38:45.8878461Z  2025-03-14T06:38:45.8878821Z  2025-03-14T06:38:45.8879629Z [18,617 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:45.8880546Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T06:38:45.8881319Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T06:38:45.8882162Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T06:38:45.8882994Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T06:38:45.8883835Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T06:38:45.8884710Z Compiling xla/service/copy_insertion.cc; 16s local 2025-03-14T06:38:45.8885371Z @llvm-project//mlir:LLVMIRTransforms; 14s local 2025-03-14T06:38:45.8886188Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local ... 2025-03-14T06:38:46.2855342Z 2025-03-14T06:38:46.2860849Z  2025-03-14T06:38:46.2861326Z  2025-03-14T06:38:46.2861917Z  2025-03-14T06:38:46.2862296Z  2025-03-14T06:38:46.2862652Z  2025-03-14T06:38:46.2863013Z  2025-03-14T06:38:46.2863384Z  2025-03-14T06:38:46.2863785Z  2025-03-14T06:38:46.2864756Z [18,619 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:46.2866012Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T06:38:46.2866948Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T06:38:46.2868152Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T06:38:46.2869260Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T06:38:46.2870156Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T06:38:46.2871009Z Compiling xla/service/copy_insertion.cc; 17s local 2025-03-14T06:38:46.2871794Z @llvm-project//mlir:LLVMIRTransforms; 15s local 2025-03-14T06:38:46.2872749Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local ... 2025-03-14T06:38:46.4858770Z 2025-03-14T06:38:46.4859616Z  2025-03-14T06:38:46.4860102Z  2025-03-14T06:38:46.4860526Z  2025-03-14T06:38:46.4860941Z  2025-03-14T06:38:46.4861314Z  2025-03-14T06:38:46.4861704Z  2025-03-14T06:38:46.4862081Z  2025-03-14T06:38:46.4862457Z  2025-03-14T06:38:46.4863361Z [18,620 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:38:46.4864698Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T06:38:46.4865784Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T06:38:46.4866754Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T06:38:46.4867740Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T06:38:46.4868666Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 26s local 2025-03-14T06:38:46.4869752Z Compiling xla/service/copy_insertion.cc; 17s local 2025-03-14T06:38:46.4870701Z @llvm-project//mlir:LLVMIRTransforms; 15s local 2025-03-14T06:38:46.4871618Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local ... 2025-03-14T06:38:46.7854873Z 2025-03-14T06:38:46.7855866Z  2025-03-14T06:38:46.7856354Z  2025-03-14T06:38:46.7856782Z  2025-03-14T06:38:46.7857161Z  2025-03-14T06:38:46.7857553Z  2025-03-14T06:38:46.7857999Z  2025-03-14T06:38:46.7858385Z  2025-03-14T06:38:46.7858800Z  2025-03-14T06:38:46.7859753Z [18,623 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:46.7860767Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T06:38:46.7861656Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T06:38:46.7862623Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T06:38:46.7863654Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T06:38:46.7864538Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T06:38:46.7865614Z Compiling xla/service/copy_insertion.cc; 17s local 2025-03-14T06:38:46.7866543Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local 2025-03-14T06:38:46.7867634Z Compiling xla/backends/cpu/runtime/rng_state_thunk.cc; 15s local ... 2025-03-14T06:38:47.0863746Z 2025-03-14T06:38:47.0864905Z  2025-03-14T06:38:47.0865531Z  2025-03-14T06:38:47.0865895Z  2025-03-14T06:38:47.0866261Z  2025-03-14T06:38:47.0866727Z  2025-03-14T06:38:47.0867153Z  2025-03-14T06:38:47.0867581Z  2025-03-14T06:38:47.0867899Z  2025-03-14T06:38:47.0868680Z [18,625 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:47.0869463Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T06:38:47.0870425Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T06:38:47.0871185Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T06:38:47.0871928Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2025-03-14T06:38:47.0872638Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T06:38:47.0873297Z Compiling xla/service/copy_insertion.cc; 17s local 2025-03-14T06:38:47.0873966Z Compiling stablehlo/reference/InterpreterOps.cpp; 14s local 2025-03-14T06:38:47.0874893Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local ... 2025-03-14T06:38:47.4867965Z 2025-03-14T06:38:47.4869438Z  2025-03-14T06:38:47.4870028Z  2025-03-14T06:38:47.4870529Z  2025-03-14T06:38:47.4871015Z  2025-03-14T06:38:47.4871502Z  2025-03-14T06:38:47.4871988Z  2025-03-14T06:38:47.4872491Z  2025-03-14T06:38:47.4872977Z  2025-03-14T06:38:47.4874080Z [18,626 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:47.4875227Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T06:38:47.4876225Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T06:38:47.4877335Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T06:38:47.4878449Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2025-03-14T06:38:47.4879835Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 27s local 2025-03-14T06:38:47.4880802Z Compiling xla/service/copy_insertion.cc; 18s local 2025-03-14T06:38:47.4881867Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 14s local 2025-03-14T06:38:47.4883168Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local ... 2025-03-14T06:38:47.9350301Z 2025-03-14T06:38:47.9351751Z  2025-03-14T06:38:47.9352277Z  2025-03-14T06:38:47.9352951Z  2025-03-14T06:38:47.9353331Z  2025-03-14T06:38:47.9353728Z  2025-03-14T06:38:47.9354108Z  2025-03-14T06:38:47.9354501Z  2025-03-14T06:38:47.9354900Z  2025-03-14T06:38:47.9355810Z [18,627 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:47.9356780Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2025-03-14T06:38:47.9357616Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T06:38:47.9358598Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T06:38:47.9359545Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2025-03-14T06:38:47.9360460Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T06:38:47.9361251Z Compiling xla/service/copy_insertion.cc; 18s local 2025-03-14T06:38:47.9362171Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2025-03-14T06:38:47.9363461Z Compiling llvm/lib/ExecutionEngine/Orc/MachOPlatform.cpp; 14s local ... 2025-03-14T06:38:48.1718097Z 2025-03-14T06:38:48.1719090Z  2025-03-14T06:38:48.1719563Z  2025-03-14T06:38:48.1719979Z  2025-03-14T06:38:48.1720386Z  2025-03-14T06:38:48.1720790Z  2025-03-14T06:38:48.1721213Z  2025-03-14T06:38:48.1721618Z  2025-03-14T06:38:48.1722036Z  2025-03-14T06:38:48.1722959Z [18,629 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:48.1723987Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2025-03-14T06:38:48.1725050Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T06:38:48.1725986Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2025-03-14T06:38:48.1726924Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T06:38:48.1727780Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T06:38:48.1728578Z Compiling xla/service/copy_insertion.cc; 18s local 2025-03-14T06:38:48.1729825Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2025-03-14T06:38:48.1730945Z Compiling mlir/lib/Dialect/Linalg/Utils/Utils.cpp; 12s local ... 2025-03-14T06:38:48.4223359Z 2025-03-14T06:38:48.4224882Z  2025-03-14T06:38:48.4225383Z  2025-03-14T06:38:48.4225787Z  2025-03-14T06:38:48.4226179Z  2025-03-14T06:38:48.4226587Z  2025-03-14T06:38:48.4226981Z  2025-03-14T06:38:48.4227411Z  2025-03-14T06:38:48.4227798Z  2025-03-14T06:38:48.4228902Z [18,630 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:48.4229875Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2025-03-14T06:38:48.4230750Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T06:38:48.4231736Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2025-03-14T06:38:48.4232658Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T06:38:48.4233545Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T06:38:48.4234367Z Compiling xla/service/copy_insertion.cc; 19s local 2025-03-14T06:38:48.4235327Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2025-03-14T06:38:48.4236374Z Compiling mlir/lib/Dialect/Linalg/Utils/Utils.cpp; 12s local ... 2025-03-14T06:38:48.6875732Z 2025-03-14T06:38:48.6877094Z  2025-03-14T06:38:48.6877799Z  2025-03-14T06:38:48.6878158Z  2025-03-14T06:38:48.6878507Z  2025-03-14T06:38:48.6878896Z  2025-03-14T06:38:48.6879253Z  2025-03-14T06:38:48.6879595Z  2025-03-14T06:38:48.6879945Z  2025-03-14T06:38:48.6880809Z [18,634 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:38:48.6881694Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2025-03-14T06:38:48.6882621Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T06:38:48.6883495Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2025-03-14T06:38:48.6884322Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T06:38:48.6885267Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 28s local 2025-03-14T06:38:48.6886074Z Compiling xla/service/copy_insertion.cc; 19s local 2025-03-14T06:38:48.6886900Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 15s local 2025-03-14T06:38:48.6887867Z Compiling mlir/lib/Dialect/Linalg/Utils/Utils.cpp; 12s local ... 2025-03-14T06:38:48.8879040Z 2025-03-14T06:38:48.8879897Z  2025-03-14T06:38:48.8880389Z  2025-03-14T06:38:48.8880719Z  2025-03-14T06:38:48.8881087Z  2025-03-14T06:38:48.8881472Z  2025-03-14T06:38:48.8881801Z  2025-03-14T06:38:48.8882155Z  2025-03-14T06:38:48.8882509Z  2025-03-14T06:38:48.8883396Z [18,635 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:48.8884245Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T06:38:48.8885116Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T06:38:48.8885930Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2025-03-14T06:38:48.8886743Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T06:38:48.8887469Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2025-03-14T06:38:48.8888141Z Compiling xla/service/copy_insertion.cc; 19s local 2025-03-14T06:38:48.8888870Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2025-03-14T06:38:48.8889697Z Compiling mlir/lib/Dialect/Linalg/Utils/Utils.cpp; 12s local ... 2025-03-14T06:38:49.6058729Z 2025-03-14T06:38:49.6060167Z  2025-03-14T06:38:49.6060794Z  2025-03-14T06:38:49.6061199Z  2025-03-14T06:38:49.6061604Z  2025-03-14T06:38:49.6062012Z  2025-03-14T06:38:49.6062413Z  2025-03-14T06:38:49.6063038Z  2025-03-14T06:38:49.6063420Z  2025-03-14T06:38:49.6064332Z [18,636 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:49.6065509Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T06:38:49.6066364Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2025-03-14T06:38:49.6067156Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T06:38:49.6068237Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T06:38:49.6069132Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 29s local 2025-03-14T06:38:49.6069953Z Compiling xla/service/copy_insertion.cc; 20s local 2025-03-14T06:38:49.6070888Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 16s local 2025-03-14T06:38:49.6071913Z Compiling mlir/lib/Dialect/Linalg/Utils/Utils.cpp; 13s local ... 2025-03-14T06:38:49.8885950Z 2025-03-14T06:38:49.8886947Z  2025-03-14T06:38:49.8887512Z  2025-03-14T06:38:49.8887932Z  2025-03-14T06:38:49.8888313Z  2025-03-14T06:38:49.8888702Z  2025-03-14T06:38:49.8889084Z  2025-03-14T06:38:49.8889465Z  2025-03-14T06:38:49.8889864Z  2025-03-14T06:38:49.8890789Z [18,638 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:49.8891756Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2025-03-14T06:38:49.8892917Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2025-03-14T06:38:49.8893853Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T06:38:49.8894787Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T06:38:49.8895702Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 30s local 2025-03-14T06:38:49.8896524Z Compiling xla/service/copy_insertion.cc; 20s local 2025-03-14T06:38:49.8897589Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2025-03-14T06:38:49.8898625Z Compiling mlir/lib/Dialect/Linalg/Utils/Utils.cpp; 13s local ... 2025-03-14T06:38:50.7121555Z 2025-03-14T06:38:50.7122841Z  2025-03-14T06:38:50.7123368Z  2025-03-14T06:38:50.7123780Z  2025-03-14T06:38:50.7124204Z  2025-03-14T06:38:50.7124744Z  2025-03-14T06:38:50.7125136Z  2025-03-14T06:38:50.7125525Z  2025-03-14T06:38:50.7125946Z  2025-03-14T06:38:50.7126917Z [18,639 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:50.7127921Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2025-03-14T06:38:50.7128807Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T06:38:50.7129796Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2025-03-14T06:38:50.7130697Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2025-03-14T06:38:50.7131631Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T06:38:50.7132549Z Compiling xla/service/copy_insertion.cc; 21s local 2025-03-14T06:38:50.7133434Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 17s local 2025-03-14T06:38:50.7134504Z Compiling mlir/lib/Dialect/Linalg/Utils/Utils.cpp; 14s local ... 2025-03-14T06:38:51.0894168Z 2025-03-14T06:38:51.0895448Z  2025-03-14T06:38:51.0895928Z  2025-03-14T06:38:51.0896385Z  2025-03-14T06:38:51.0896788Z  2025-03-14T06:38:51.0897179Z  2025-03-14T06:38:51.0897574Z  2025-03-14T06:38:51.0898002Z  2025-03-14T06:38:51.0898409Z  2025-03-14T06:38:51.0899354Z [18,642 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:51.0900246Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2025-03-14T06:38:51.0900968Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T06:38:51.0902225Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2025-03-14T06:38:51.0903123Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T06:38:51.0903953Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T06:38:51.0904770Z Compiling xla/service/copy_insertion.cc; 21s local 2025-03-14T06:38:51.0905810Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2025-03-14T06:38:51.0906821Z Compiling mlir/lib/Dialect/Linalg/Utils/Utils.cpp; 15s local ... 2025-03-14T06:38:51.4501930Z 2025-03-14T06:38:51.4503206Z  2025-03-14T06:38:51.4503735Z  2025-03-14T06:38:51.4504127Z  2025-03-14T06:38:51.4504565Z  2025-03-14T06:38:51.4505013Z  2025-03-14T06:38:51.4505422Z  2025-03-14T06:38:51.4505825Z  2025-03-14T06:38:51.4506228Z  2025-03-14T06:38:51.4507210Z [18,644 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:51.4508312Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2025-03-14T06:38:51.4509178Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T06:38:51.4510214Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T06:38:51.4511161Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T06:38:51.4512187Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T06:38:51.4513029Z Compiling xla/service/copy_insertion.cc; 22s local 2025-03-14T06:38:51.4514162Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2025-03-14T06:38:51.4515138Z @llvm-project//llvm:X86CodeGen; 12s local ... 2025-03-14T06:38:51.6899277Z 2025-03-14T06:38:51.6900241Z  2025-03-14T06:38:51.6900711Z  2025-03-14T06:38:51.6901151Z  2025-03-14T06:38:51.6901558Z  2025-03-14T06:38:51.6901948Z  2025-03-14T06:38:51.6902335Z  2025-03-14T06:38:51.6902979Z  2025-03-14T06:38:51.6903378Z  2025-03-14T06:38:51.6904323Z [18,646 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:51.6905445Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2025-03-14T06:38:51.6906297Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T06:38:51.6907250Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T06:38:51.6908197Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T06:38:51.6909153Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 31s local 2025-03-14T06:38:51.6910057Z Compiling xla/service/copy_insertion.cc; 22s local 2025-03-14T06:38:51.6911093Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 18s local 2025-03-14T06:38:51.6912052Z @llvm-project//llvm:X86CodeGen; 12s local ... 2025-03-14T06:38:52.4548766Z 2025-03-14T06:38:52.4549649Z  2025-03-14T06:38:52.4550136Z  2025-03-14T06:38:52.4550513Z  2025-03-14T06:38:52.4550881Z  2025-03-14T06:38:52.4551292Z  2025-03-14T06:38:52.4551646Z  2025-03-14T06:38:52.4552012Z  2025-03-14T06:38:52.4552384Z  2025-03-14T06:38:52.4553257Z [18,647 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:52.4554197Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2025-03-14T06:38:52.4555067Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T06:38:52.4556112Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T06:38:52.4557135Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T06:38:52.4558199Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2025-03-14T06:38:52.4559057Z Compiling xla/service/copy_insertion.cc; 23s local 2025-03-14T06:38:52.4560025Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2025-03-14T06:38:52.4560967Z @llvm-project//llvm:X86CodeGen; 13s local ... 2025-03-14T06:38:52.6906652Z 2025-03-14T06:38:52.6907507Z  2025-03-14T06:38:52.6908025Z  2025-03-14T06:38:52.6908425Z  2025-03-14T06:38:52.6908807Z  2025-03-14T06:38:52.6909195Z  2025-03-14T06:38:52.6909582Z  2025-03-14T06:38:52.6909979Z  2025-03-14T06:38:52.6910360Z  2025-03-14T06:38:52.6911284Z [18,648 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:52.6912320Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2025-03-14T06:38:52.6913498Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T06:38:52.6914500Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T06:38:52.6915481Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T06:38:52.6916381Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 32s local 2025-03-14T06:38:52.6917267Z Compiling xla/service/copy_insertion.cc; 23s local 2025-03-14T06:38:52.6918239Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 19s local 2025-03-14T06:38:52.6919171Z @llvm-project//llvm:X86CodeGen; 13s local ... 2025-03-14T06:38:52.8909883Z 2025-03-14T06:38:52.8910771Z  2025-03-14T06:38:52.8911274Z  2025-03-14T06:38:52.8911686Z  2025-03-14T06:38:52.8912062Z  2025-03-14T06:38:52.8912474Z  2025-03-14T06:38:52.8912856Z  2025-03-14T06:38:52.8913570Z  2025-03-14T06:38:52.8913959Z  2025-03-14T06:38:52.8914948Z [18,649 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:52.8915972Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2025-03-14T06:38:52.8916836Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T06:38:52.8917929Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T06:38:52.8919141Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T06:38:52.8920120Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T06:38:52.8920972Z Compiling xla/service/copy_insertion.cc; 23s local 2025-03-14T06:38:52.8921919Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2025-03-14T06:38:52.8922881Z @llvm-project//llvm:X86CodeGen; 13s local ... 2025-03-14T06:38:53.2914096Z 2025-03-14T06:38:53.2915020Z  2025-03-14T06:38:53.2915556Z  2025-03-14T06:38:53.2915975Z  2025-03-14T06:38:53.2916369Z  2025-03-14T06:38:53.2916800Z  2025-03-14T06:38:53.2917235Z  2025-03-14T06:38:53.2917618Z  2025-03-14T06:38:53.2918008Z  2025-03-14T06:38:53.2918902Z [18,650 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:53.2919828Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2025-03-14T06:38:53.2920713Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T06:38:53.2921746Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T06:38:53.2922713Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T06:38:53.2923674Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T06:38:53.2924717Z Compiling xla/service/copy_insertion.cc; 24s local 2025-03-14T06:38:53.2925680Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2025-03-14T06:38:53.2926678Z @llvm-project//llvm:X86CodeGen; 14s local ... 2025-03-14T06:38:53.6884726Z 2025-03-14T06:38:53.6885627Z  2025-03-14T06:38:53.6886124Z  2025-03-14T06:38:53.6886535Z  2025-03-14T06:38:53.6886936Z  2025-03-14T06:38:53.6887344Z  2025-03-14T06:38:53.6887737Z  2025-03-14T06:38:53.6888153Z  2025-03-14T06:38:53.6888554Z  2025-03-14T06:38:53.6889508Z [18,652 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:53.6890841Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2025-03-14T06:38:53.6891740Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T06:38:53.6892794Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T06:38:53.6893740Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T06:38:53.6894616Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 33s local 2025-03-14T06:38:53.6895628Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local 2025-03-14T06:38:53.6896933Z Compiling llvm/lib/Target/X86/GISel/X86InstructionSelector.cpp; 14s local 2025-03-14T06:38:53.6898119Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 13s local ... 2025-03-14T06:38:53.8889139Z 2025-03-14T06:38:53.8890045Z  2025-03-14T06:38:53.8890511Z  2025-03-14T06:38:53.8890928Z  2025-03-14T06:38:53.8891328Z  2025-03-14T06:38:53.8891779Z  2025-03-14T06:38:53.8892210Z  2025-03-14T06:38:53.8892622Z  2025-03-14T06:38:53.8893032Z  2025-03-14T06:38:53.8893975Z [18,654 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:53.8894961Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2025-03-14T06:38:53.8895803Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T06:38:53.8896752Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T06:38:53.8897988Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T06:38:53.8898871Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T06:38:53.8899861Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2025-03-14T06:38:53.8900990Z Compiling llvm/lib/Target/X86/GISel/X86InstructionSelector.cpp; 14s local 2025-03-14T06:38:53.8902199Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 13s local ... 2025-03-14T06:38:54.0920482Z 2025-03-14T06:38:54.0921403Z  2025-03-14T06:38:54.0921906Z  2025-03-14T06:38:54.0922303Z  2025-03-14T06:38:54.0922641Z  2025-03-14T06:38:54.0922971Z  2025-03-14T06:38:54.0923346Z  2025-03-14T06:38:54.0923735Z  2025-03-14T06:38:54.0924116Z  2025-03-14T06:38:54.0925189Z [18,655 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:54.0926256Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2025-03-14T06:38:54.0927158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T06:38:54.0928169Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T06:38:54.0929181Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2025-03-14T06:38:54.0930119Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T06:38:54.0931208Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2025-03-14T06:38:54.0932470Z Compiling llvm/lib/Target/X86/GISel/X86InstructionSelector.cpp; 15s local 2025-03-14T06:38:54.0933727Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 14s local ... 2025-03-14T06:38:54.3904149Z 2025-03-14T06:38:54.3905039Z  2025-03-14T06:38:54.3905493Z  2025-03-14T06:38:54.3905909Z  2025-03-14T06:38:54.3906310Z  2025-03-14T06:38:54.3906732Z  2025-03-14T06:38:54.3907156Z  2025-03-14T06:38:54.3907603Z  2025-03-14T06:38:54.3908040Z  2025-03-14T06:38:54.3909029Z [18,656 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:54.3910102Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2025-03-14T06:38:54.3910988Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T06:38:54.3912050Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T06:38:54.3913101Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2025-03-14T06:38:54.3914324Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T06:38:54.3915382Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2025-03-14T06:38:54.3916479Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 14s local 2025-03-14T06:38:54.3917512Z Compiling mlir/lib/Dialect/Affine/Transforms/LoopFusion.cpp; 13s local ... 2025-03-14T06:38:54.6925859Z 2025-03-14T06:38:54.6926784Z  2025-03-14T06:38:54.6927264Z  2025-03-14T06:38:54.6927650Z  2025-03-14T06:38:54.6928351Z  2025-03-14T06:38:54.6928757Z  2025-03-14T06:38:54.6929121Z  2025-03-14T06:38:54.6929527Z  2025-03-14T06:38:54.6929907Z  2025-03-14T06:38:54.6930894Z [18,656 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:54.6931912Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2025-03-14T06:38:54.6932835Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T06:38:54.6933803Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T06:38:54.6934820Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2025-03-14T06:38:54.6935750Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 34s local 2025-03-14T06:38:54.6936816Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local 2025-03-14T06:38:54.6937990Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 14s local 2025-03-14T06:38:54.6939539Z Compiling mlir/lib/Dialect/Affine/Transforms/LoopFusion.cpp; 14s local ... 2025-03-14T06:38:54.8928550Z 2025-03-14T06:38:54.8929443Z  2025-03-14T06:38:54.8929959Z  2025-03-14T06:38:54.8930348Z  2025-03-14T06:38:54.8930766Z  2025-03-14T06:38:54.8931180Z  2025-03-14T06:38:54.8931602Z  2025-03-14T06:38:54.8932008Z  2025-03-14T06:38:54.8932400Z  2025-03-14T06:38:54.8935585Z [18,657 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:54.8936576Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T06:38:54.8937510Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T06:38:54.8938553Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T06:38:54.8939580Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2025-03-14T06:38:54.8940589Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T06:38:54.8941701Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2025-03-14T06:38:54.8942895Z Compiling llvm/lib/CodeGen/AssignmentTrackingAnalysis.cpp; 14s local 2025-03-14T06:38:54.8943689Z @llvm-project//mlir:TensorTransforms; 13s local ... 2025-03-14T06:38:55.1327330Z 2025-03-14T06:38:55.1328257Z  2025-03-14T06:38:55.1328757Z  2025-03-14T06:38:55.1329185Z  2025-03-14T06:38:55.1329607Z  2025-03-14T06:38:55.1330034Z  2025-03-14T06:38:55.1330443Z  2025-03-14T06:38:55.1330847Z  2025-03-14T06:38:55.1331261Z  2025-03-14T06:38:55.1332177Z [18,658 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:55.1333171Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T06:38:55.1334041Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T06:38:55.1334985Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T06:38:55.1335913Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T06:38:55.1336782Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T06:38:55.1337797Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2025-03-14T06:38:55.1338759Z @llvm-project//mlir:TensorTransforms; 14s local 2025-03-14T06:38:55.1339633Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 13s local ... 2025-03-14T06:38:55.4934173Z 2025-03-14T06:38:55.4935207Z  2025-03-14T06:38:55.4935701Z  2025-03-14T06:38:55.4936109Z  2025-03-14T06:38:55.4936537Z  2025-03-14T06:38:55.4936967Z  2025-03-14T06:38:55.4937358Z  2025-03-14T06:38:55.4937788Z  2025-03-14T06:38:55.4938181Z  2025-03-14T06:38:55.4939156Z [18,659 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:55.4940255Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T06:38:55.4941382Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T06:38:55.4942413Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2025-03-14T06:38:55.4943332Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T06:38:55.4944281Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 35s local 2025-03-14T06:38:55.4945364Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local 2025-03-14T06:38:55.4946381Z @llvm-project//mlir:TensorTransforms; 14s local 2025-03-14T06:38:55.4947295Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 14s local ... 2025-03-14T06:38:56.4941453Z 2025-03-14T06:38:56.4942258Z  2025-03-14T06:38:56.4942742Z  2025-03-14T06:38:56.4943152Z  2025-03-14T06:38:56.4943542Z  2025-03-14T06:38:56.4943968Z  2025-03-14T06:38:56.4944390Z  2025-03-14T06:38:56.4945113Z  2025-03-14T06:38:56.4945486Z  2025-03-14T06:38:56.4946447Z [18,659 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:56.4947474Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T06:38:56.4948337Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T06:38:56.4949272Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2025-03-14T06:38:56.4950425Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T06:38:56.4951350Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 36s local 2025-03-14T06:38:56.4952362Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local 2025-03-14T06:38:56.4953289Z @llvm-project//mlir:TensorTransforms; 15s local 2025-03-14T06:38:56.4954150Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local ... 2025-03-14T06:38:57.0074512Z 2025-03-14T06:38:57.0075525Z  2025-03-14T06:38:57.0076084Z  2025-03-14T06:38:57.0076475Z  2025-03-14T06:38:57.0076869Z  2025-03-14T06:38:57.0077286Z  2025-03-14T06:38:57.0077687Z  2025-03-14T06:38:57.0078109Z  2025-03-14T06:38:57.0078500Z  2025-03-14T06:38:57.0079461Z [18,660 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:57.0080458Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2025-03-14T06:38:57.0081375Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T06:38:57.0082424Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2025-03-14T06:38:57.0083451Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T06:38:57.0084548Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T06:38:57.0085639Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2025-03-14T06:38:57.0086649Z @llvm-project//mlir:TensorTransforms; 15s local 2025-03-14T06:38:57.0087543Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local ... 2025-03-14T06:38:57.3010589Z 2025-03-14T06:38:57.3011456Z  2025-03-14T06:38:57.3012065Z  2025-03-14T06:38:57.3012487Z  2025-03-14T06:38:57.3012837Z  2025-03-14T06:38:57.3013247Z  2025-03-14T06:38:57.3013627Z  2025-03-14T06:38:57.3013980Z  2025-03-14T06:38:57.3014345Z  2025-03-14T06:38:57.3015314Z [18,663 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:57.3016632Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2025-03-14T06:38:57.3017537Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T06:38:57.3018583Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T06:38:57.3019532Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T06:38:57.3020541Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T06:38:57.3021652Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2025-03-14T06:38:57.3022897Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 15s local 2025-03-14T06:38:57.3024063Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 15s local ... 2025-03-14T06:38:57.6040987Z 2025-03-14T06:38:57.6041868Z  2025-03-14T06:38:57.6042370Z  2025-03-14T06:38:57.6042784Z  2025-03-14T06:38:57.6043203Z  2025-03-14T06:38:57.6043680Z  2025-03-14T06:38:57.6044111Z  2025-03-14T06:38:57.6044620Z  2025-03-14T06:38:57.6045028Z  2025-03-14T06:38:57.6045985Z [18,664 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:57.6047035Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2025-03-14T06:38:57.6047952Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T06:38:57.6048951Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T06:38:57.6050312Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T06:38:57.6051240Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 37s local 2025-03-14T06:38:57.6052279Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local 2025-03-14T06:38:57.6053350Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2025-03-14T06:38:57.6054339Z Compiling xla/backends/cpu/runtime/outfeed_thunk.cc; 15s local ... 2025-03-14T06:38:57.9896822Z 2025-03-14T06:38:57.9897666Z  2025-03-14T06:38:57.9898151Z  2025-03-14T06:38:57.9898555Z  2025-03-14T06:38:57.9898953Z  2025-03-14T06:38:57.9899347Z  2025-03-14T06:38:57.9899726Z  2025-03-14T06:38:57.9900109Z  2025-03-14T06:38:57.9900498Z  2025-03-14T06:38:57.9901409Z [18,666 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:57.9902381Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2025-03-14T06:38:57.9903338Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T06:38:57.9904422Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T06:38:57.9905397Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T06:38:57.9906294Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T06:38:57.9907289Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2025-03-14T06:38:57.9908377Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2025-03-14T06:38:57.9909406Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 15s local ... 2025-03-14T06:38:58.1968121Z 2025-03-14T06:38:58.1969136Z  2025-03-14T06:38:58.1969638Z  2025-03-14T06:38:58.1970023Z  2025-03-14T06:38:58.1970402Z  2025-03-14T06:38:58.1970769Z  2025-03-14T06:38:58.1971188Z  2025-03-14T06:38:58.1971596Z  2025-03-14T06:38:58.1972028Z  2025-03-14T06:38:58.1972989Z [18,668 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:58.1974038Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2025-03-14T06:38:58.1974973Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T06:38:58.1975937Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2025-03-14T06:38:58.1976923Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T06:38:58.1978170Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T06:38:58.1979241Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2025-03-14T06:38:58.1980296Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2025-03-14T06:38:58.1981354Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 15s local ... 2025-03-14T06:38:58.4047051Z 2025-03-14T06:38:58.4047913Z  2025-03-14T06:38:58.4048448Z  2025-03-14T06:38:58.4048879Z  2025-03-14T06:38:58.4049298Z  2025-03-14T06:38:58.4049973Z  2025-03-14T06:38:58.4050437Z  2025-03-14T06:38:58.4050862Z  2025-03-14T06:38:58.4051282Z  2025-03-14T06:38:58.4052278Z [18,668 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:58.4053501Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2025-03-14T06:38:58.4054486Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T06:38:58.4055579Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2025-03-14T06:38:58.4056598Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T06:38:58.4057595Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 38s local 2025-03-14T06:38:58.4058716Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local 2025-03-14T06:38:58.4059838Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local 2025-03-14T06:38:58.4061322Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 15s local ... 2025-03-14T06:38:58.8894963Z 2025-03-14T06:38:58.8895885Z  2025-03-14T06:38:58.8896372Z  2025-03-14T06:38:58.8896769Z  2025-03-14T06:38:58.8897156Z  2025-03-14T06:38:58.8897576Z  2025-03-14T06:38:58.8897984Z  2025-03-14T06:38:58.8898374Z  2025-03-14T06:38:58.8898774Z  2025-03-14T06:38:58.8899760Z [18,669 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:58.8911295Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:38:58.8912235Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T06:38:58.8913260Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2025-03-14T06:38:58.8914226Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T06:38:58.8915183Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T06:38:58.8916305Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T06:38:58.8917380Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T06:38:58.8918521Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local ... 2025-03-14T06:38:59.1461954Z 2025-03-14T06:38:59.1462768Z  2025-03-14T06:38:59.1463290Z  2025-03-14T06:38:59.1463709Z  2025-03-14T06:38:59.1464170Z  2025-03-14T06:38:59.1464582Z  2025-03-14T06:38:59.1465014Z  2025-03-14T06:38:59.1465668Z  2025-03-14T06:38:59.1466083Z  2025-03-14T06:38:59.1467018Z [18,671 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:59.1468039Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:38:59.1468940Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T06:38:59.1469948Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:38:59.1470982Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T06:38:59.1471921Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T06:38:59.1472959Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T06:38:59.1474001Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T06:38:59.1475025Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local ... 2025-03-14T06:38:59.3873224Z 2025-03-14T06:38:59.3874883Z  2025-03-14T06:38:59.3875469Z  2025-03-14T06:38:59.3875895Z  2025-03-14T06:38:59.3876296Z  2025-03-14T06:38:59.3876719Z  2025-03-14T06:38:59.3877135Z  2025-03-14T06:38:59.3877523Z  2025-03-14T06:38:59.3877922Z  2025-03-14T06:38:59.3878895Z [18,673 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:38:59.3879946Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:38:59.3881053Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T06:38:59.3882082Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:38:59.3882999Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T06:38:59.3883862Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T06:38:59.3885075Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T06:38:59.3886193Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T06:38:59.3887293Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 16s local ... 2025-03-14T06:38:59.6055225Z 2025-03-14T06:38:59.6056690Z  2025-03-14T06:38:59.6057212Z  2025-03-14T06:38:59.6057645Z  2025-03-14T06:38:59.6058066Z  2025-03-14T06:38:59.6058438Z  2025-03-14T06:38:59.6058848Z  2025-03-14T06:38:59.6059594Z  2025-03-14T06:38:59.6060017Z  2025-03-14T06:38:59.6061041Z [18,673 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:59.6062112Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:38:59.6063066Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T06:38:59.6064124Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:38:59.6065566Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T06:38:59.6066555Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 39s local 2025-03-14T06:38:59.6067624Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T06:38:59.6068710Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2025-03-14T06:38:59.6069768Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local ... 2025-03-14T06:38:59.8058824Z 2025-03-14T06:38:59.8060236Z  2025-03-14T06:38:59.8060772Z  2025-03-14T06:38:59.8061171Z  2025-03-14T06:38:59.8061580Z  2025-03-14T06:38:59.8061961Z  2025-03-14T06:38:59.8062334Z  2025-03-14T06:38:59.8062723Z  2025-03-14T06:38:59.8063111Z  2025-03-14T06:38:59.8064048Z [18,674 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:38:59.8065032Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:38:59.8066143Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T06:38:59.8067117Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:38:59.8068072Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T06:38:59.8068942Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T06:38:59.8069920Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2025-03-14T06:38:59.8070976Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2025-03-14T06:38:59.8072008Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local ... 2025-03-14T06:39:00.2062865Z 2025-03-14T06:39:00.2064335Z  2025-03-14T06:39:00.2064770Z  2025-03-14T06:39:00.2066463Z  2025-03-14T06:39:00.2067590Z  2025-03-14T06:39:00.2068825Z  2025-03-14T06:39:00.2070133Z  2025-03-14T06:39:00.2071466Z  2025-03-14T06:39:00.2072770Z  2025-03-14T06:39:00.2074914Z [18,676 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:00.2075914Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2025-03-14T06:39:00.2076930Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T06:39:00.2077890Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T06:39:00.2078795Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T06:39:00.2079720Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T06:39:00.2080962Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2025-03-14T06:39:00.2082064Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 17s local 2025-03-14T06:39:00.2083099Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local ... 2025-03-14T06:39:00.6067850Z 2025-03-14T06:39:00.6068747Z  2025-03-14T06:39:00.6069270Z  2025-03-14T06:39:00.6069725Z  2025-03-14T06:39:00.6070177Z  2025-03-14T06:39:00.6070607Z  2025-03-14T06:39:00.6071047Z  2025-03-14T06:39:00.6071478Z  2025-03-14T06:39:00.6071930Z  2025-03-14T06:39:00.6072891Z [18,677 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:00.6073831Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2025-03-14T06:39:00.6074630Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T06:39:00.6075818Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T06:39:00.6076718Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T06:39:00.6077527Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 40s local 2025-03-14T06:39:00.6078425Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2025-03-14T06:39:00.6079425Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2025-03-14T06:39:00.6080632Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 16s local ... 2025-03-14T06:39:00.8070437Z 2025-03-14T06:39:00.8071359Z  2025-03-14T06:39:00.8072550Z  2025-03-14T06:39:00.8074188Z  2025-03-14T06:39:00.8075668Z  2025-03-14T06:39:00.8077190Z  2025-03-14T06:39:00.8078881Z  2025-03-14T06:39:00.8080416Z  2025-03-14T06:39:00.8081929Z  2025-03-14T06:39:00.8085254Z [18,678 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:00.8087565Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2025-03-14T06:39:00.8089558Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T06:39:00.8091618Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T06:39:00.8093666Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T06:39:00.8095674Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T06:39:00.8097797Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2025-03-14T06:39:00.8100087Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2025-03-14T06:39:00.8102329Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 17s local ... 2025-03-14T06:39:01.2074367Z 2025-03-14T06:39:01.2075263Z  2025-03-14T06:39:01.2076318Z  2025-03-14T06:39:01.2078044Z  2025-03-14T06:39:01.2079628Z  2025-03-14T06:39:01.2081164Z  2025-03-14T06:39:01.2082751Z  2025-03-14T06:39:01.2084257Z  2025-03-14T06:39:01.2085985Z  2025-03-14T06:39:01.2088105Z [18,679 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:01.2090379Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T06:39:01.2092366Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T06:39:01.2094456Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T06:39:01.2096830Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T06:39:01.2098899Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T06:39:01.2101047Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2025-03-14T06:39:01.2103286Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 18s local 2025-03-14T06:39:01.2105464Z Compiling xla/backends/cpu/runtime/thunk_executor.cc; 17s local ... 2025-03-14T06:39:01.5210691Z 2025-03-14T06:39:01.5212769Z  2025-03-14T06:39:01.5214339Z  2025-03-14T06:39:01.5216159Z  2025-03-14T06:39:01.5217726Z  2025-03-14T06:39:01.5218578Z  2025-03-14T06:39:01.5219676Z  2025-03-14T06:39:01.5220121Z  2025-03-14T06:39:01.5220672Z  2025-03-14T06:39:01.5221682Z [18,683 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:01.5222762Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T06:39:01.5223757Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T06:39:01.5224883Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T06:39:01.5225775Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T06:39:01.5226726Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 41s local 2025-03-14T06:39:01.5227667Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2025-03-14T06:39:01.5228930Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local 2025-03-14T06:39:01.5229964Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local ... 2025-03-14T06:39:01.8062434Z 2025-03-14T06:39:01.8063235Z  2025-03-14T06:39:01.8063648Z  2025-03-14T06:39:01.8064007Z  2025-03-14T06:39:01.8064344Z  2025-03-14T06:39:01.8064673Z  2025-03-14T06:39:01.8064995Z  2025-03-14T06:39:01.8066463Z  2025-03-14T06:39:01.8067139Z  2025-03-14T06:39:01.8067979Z [18,684 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:01.8068866Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T06:39:01.8069653Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T06:39:01.8070544Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T06:39:01.8071400Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T06:39:01.8072220Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T06:39:01.8073121Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2025-03-14T06:39:01.8074077Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local 2025-03-14T06:39:01.8075124Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 14s local ... 2025-03-14T06:39:02.0078828Z 2025-03-14T06:39:02.0080019Z  2025-03-14T06:39:02.0080465Z  2025-03-14T06:39:02.0080781Z  2025-03-14T06:39:02.0081120Z  2025-03-14T06:39:02.0081448Z  2025-03-14T06:39:02.0081776Z  2025-03-14T06:39:02.0082105Z  2025-03-14T06:39:02.0082436Z  2025-03-14T06:39:02.0083212Z [18,684 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:02.0084047Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2025-03-14T06:39:02.0084912Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T06:39:02.0085730Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T06:39:02.0086624Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T06:39:02.0087340Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T06:39:02.0088122Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2025-03-14T06:39:02.0088986Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local 2025-03-14T06:39:02.0090150Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local ... 2025-03-14T06:39:02.2227207Z 2025-03-14T06:39:02.2228453Z  2025-03-14T06:39:02.2228896Z  2025-03-14T06:39:02.2229265Z  2025-03-14T06:39:02.2229610Z  2025-03-14T06:39:02.2229951Z  2025-03-14T06:39:02.2230305Z  2025-03-14T06:39:02.2230667Z  2025-03-14T06:39:02.2231023Z  2025-03-14T06:39:02.2231870Z [18,686 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:02.2233030Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2025-03-14T06:39:02.2233859Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T06:39:02.2234728Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2025-03-14T06:39:02.2235545Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T06:39:02.2236402Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T06:39:02.2237368Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 19s local 2025-03-14T06:39:02.2238349Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local 2025-03-14T06:39:02.2239314Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local ... 2025-03-14T06:39:02.6083857Z 2025-03-14T06:39:02.6085147Z  2025-03-14T06:39:02.6085569Z  2025-03-14T06:39:02.6085929Z  2025-03-14T06:39:02.6086284Z  2025-03-14T06:39:02.6086916Z  2025-03-14T06:39:02.6087268Z  2025-03-14T06:39:02.6087623Z  2025-03-14T06:39:02.6087971Z  2025-03-14T06:39:02.6088788Z [18,687 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:02.6089625Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2025-03-14T06:39:02.6090365Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T06:39:02.6091196Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2025-03-14T06:39:02.6092204Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T06:39:02.6093056Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 42s local 2025-03-14T06:39:02.6093855Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2025-03-14T06:39:02.6094714Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local 2025-03-14T06:39:02.6095577Z Compiling xla/backends/cpu/runtime/logical_id_thunk.cc; 15s local ... 2025-03-14T06:39:02.9213796Z 2025-03-14T06:39:02.9215043Z  2025-03-14T06:39:02.9215563Z  2025-03-14T06:39:02.9215951Z  2025-03-14T06:39:02.9216326Z  2025-03-14T06:39:02.9216736Z  2025-03-14T06:39:02.9217100Z  2025-03-14T06:39:02.9217468Z  2025-03-14T06:39:02.9217841Z  2025-03-14T06:39:02.9218759Z [18,688 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:02.9219744Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2025-03-14T06:39:02.9220564Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T06:39:02.9221522Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2025-03-14T06:39:02.9222470Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T06:39:02.9223350Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T06:39:02.9224264Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2025-03-14T06:39:02.9225392Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local 2025-03-14T06:39:02.9226552Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local ... 2025-03-14T06:39:03.2062264Z 2025-03-14T06:39:03.2063460Z  2025-03-14T06:39:03.2063993Z  2025-03-14T06:39:03.2064399Z  2025-03-14T06:39:03.2064804Z  2025-03-14T06:39:03.2065216Z  2025-03-14T06:39:03.2065822Z  2025-03-14T06:39:03.2066232Z  2025-03-14T06:39:03.2066598Z  2025-03-14T06:39:03.2067747Z [18,689 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:03.2068751Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2025-03-14T06:39:03.2069656Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T06:39:03.2070652Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T06:39:03.2071578Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T06:39:03.2072712Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T06:39:03.2073711Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2025-03-14T06:39:03.2074791Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local 2025-03-14T06:39:03.2075833Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local ... 2025-03-14T06:39:03.4090156Z 2025-03-14T06:39:03.4091681Z  2025-03-14T06:39:03.4092534Z  2025-03-14T06:39:03.4093595Z  2025-03-14T06:39:03.4094097Z  2025-03-14T06:39:03.4094521Z  2025-03-14T06:39:03.4094958Z  2025-03-14T06:39:03.4095392Z  2025-03-14T06:39:03.4095776Z  2025-03-14T06:39:03.4096693Z [18,690 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:03.4097726Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2025-03-14T06:39:03.4100619Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T06:39:03.4101613Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T06:39:03.4102781Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T06:39:03.4103775Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T06:39:03.4104857Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 20s local 2025-03-14T06:39:03.4106005Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local 2025-03-14T06:39:03.4107330Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local ... 2025-03-14T06:39:03.6335124Z 2025-03-14T06:39:03.6336373Z  2025-03-14T06:39:03.6337013Z  2025-03-14T06:39:03.6337673Z  2025-03-14T06:39:03.6338797Z  2025-03-14T06:39:03.6339290Z  2025-03-14T06:39:03.6339700Z  2025-03-14T06:39:03.6340097Z  2025-03-14T06:39:03.6340510Z  2025-03-14T06:39:03.6341449Z [18,691 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:03.6342555Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2025-03-14T06:39:03.6343408Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T06:39:03.6344443Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T06:39:03.6345505Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T06:39:03.6346462Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 43s local 2025-03-14T06:39:03.6347562Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T06:39:03.6348725Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local 2025-03-14T06:39:03.6349749Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 16s local ... 2025-03-14T06:39:04.0095101Z 2025-03-14T06:39:04.0096324Z  2025-03-14T06:39:04.0096819Z  2025-03-14T06:39:04.0097219Z  2025-03-14T06:39:04.0097644Z  2025-03-14T06:39:04.0098056Z  2025-03-14T06:39:04.0098456Z  2025-03-14T06:39:04.0098850Z  2025-03-14T06:39:04.0099269Z  2025-03-14T06:39:04.0100237Z [18,691 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:04.0101232Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2025-03-14T06:39:04.0102055Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T06:39:04.0103061Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T06:39:04.0104267Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T06:39:04.0105219Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T06:39:04.0106235Z Compiling llvm/lib/Target/X86/X86TargetTransformInfo.cpp; 21s local 2025-03-14T06:39:04.0107236Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local 2025-03-14T06:39:04.0108315Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local ... 2025-03-14T06:39:04.3854218Z 2025-03-14T06:39:04.3855649Z  2025-03-14T06:39:04.3856772Z  2025-03-14T06:39:04.3857395Z  2025-03-14T06:39:04.3858051Z  2025-03-14T06:39:04.3859087Z  2025-03-14T06:39:04.3859561Z  2025-03-14T06:39:04.3859963Z  2025-03-14T06:39:04.3860378Z  2025-03-14T06:39:04.3861336Z [18,693 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:04.3862392Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2025-03-14T06:39:04.3863270Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T06:39:04.3864253Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2025-03-14T06:39:04.3865215Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2025-03-14T06:39:04.3866488Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T06:39:04.3867438Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 19s local 2025-03-14T06:39:04.3868664Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T06:39:04.3869627Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 15s local ... 2025-03-14T06:39:04.6099672Z 2025-03-14T06:39:04.6101174Z  2025-03-14T06:39:04.6101909Z  2025-03-14T06:39:04.6102579Z  2025-03-14T06:39:04.6103658Z  2025-03-14T06:39:04.6104137Z  2025-03-14T06:39:04.6104527Z  2025-03-14T06:39:04.6105228Z  2025-03-14T06:39:04.6105642Z  2025-03-14T06:39:04.6106635Z [18,693 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:04.6107727Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2025-03-14T06:39:04.6108624Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T06:39:04.6109602Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2025-03-14T06:39:04.6110614Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2025-03-14T06:39:04.6111604Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 44s local 2025-03-14T06:39:04.6112672Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 19s local 2025-03-14T06:39:04.6113734Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T06:39:04.6114733Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local ... 2025-03-14T06:39:04.8884235Z 2025-03-14T06:39:04.8885393Z  2025-03-14T06:39:04.8885863Z  2025-03-14T06:39:04.8886243Z  2025-03-14T06:39:04.8886621Z  2025-03-14T06:39:04.8887000Z  2025-03-14T06:39:04.8887394Z  2025-03-14T06:39:04.8887769Z  2025-03-14T06:39:04.8888154Z  2025-03-14T06:39:04.8889101Z [18,695 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:04.8890063Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2025-03-14T06:39:04.8890891Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T06:39:04.8891862Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2025-03-14T06:39:04.8892845Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2025-03-14T06:39:04.8893734Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T06:39:04.8894713Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 19s local 2025-03-14T06:39:04.8895725Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 17s local 2025-03-14T06:39:04.8896993Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local ... 2025-03-14T06:39:05.2105594Z 2025-03-14T06:39:05.2106466Z  2025-03-14T06:39:05.2106981Z  2025-03-14T06:39:05.2107391Z  2025-03-14T06:39:05.2107773Z  2025-03-14T06:39:05.2108173Z  2025-03-14T06:39:05.2108528Z  2025-03-14T06:39:05.2108948Z  2025-03-14T06:39:05.2109379Z  2025-03-14T06:39:05.2110329Z [18,696 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:05.2111474Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2025-03-14T06:39:05.2112339Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T06:39:05.2113248Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T06:39:05.2114169Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T06:39:05.2115106Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T06:39:05.2116071Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 20s local 2025-03-14T06:39:05.2117052Z Compiling xla/backends/cpu/runtime/kernel_thunk.cc; 18s local 2025-03-14T06:39:05.2118019Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local ... 2025-03-14T06:39:05.4587692Z 2025-03-14T06:39:05.4588570Z  2025-03-14T06:39:05.4589069Z  2025-03-14T06:39:05.4589466Z  2025-03-14T06:39:05.4589891Z  2025-03-14T06:39:05.4590643Z  2025-03-14T06:39:05.4591045Z  2025-03-14T06:39:05.4591453Z  2025-03-14T06:39:05.4592301Z  2025-03-14T06:39:05.4593222Z [18,697 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:05.4594171Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2025-03-14T06:39:05.4595055Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T06:39:05.4596053Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T06:39:05.4597567Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T06:39:05.4598672Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T06:39:05.4599817Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 20s local 2025-03-14T06:39:05.4600991Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 16s local 2025-03-14T06:39:05.4602237Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 16s local ... 2025-03-14T06:39:05.6592001Z 2025-03-14T06:39:05.6592917Z  2025-03-14T06:39:05.6593475Z  2025-03-14T06:39:05.6593888Z  2025-03-14T06:39:05.6594253Z  2025-03-14T06:39:05.6594604Z  2025-03-14T06:39:05.6594989Z  2025-03-14T06:39:05.6595366Z  2025-03-14T06:39:05.6595762Z  2025-03-14T06:39:05.6596674Z [18,702 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:05.6597690Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2025-03-14T06:39:05.6598555Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T06:39:05.6599544Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T06:39:05.6600529Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T06:39:05.6601430Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 45s local 2025-03-14T06:39:05.6602349Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2025-03-14T06:39:05.6603465Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2025-03-14T06:39:05.6604745Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local ... 2025-03-14T06:39:06.0111970Z 2025-03-14T06:39:06.0112899Z  2025-03-14T06:39:06.0113410Z  2025-03-14T06:39:06.0115634Z  2025-03-14T06:39:06.0118683Z  2025-03-14T06:39:06.0121596Z  2025-03-14T06:39:06.0124602Z  2025-03-14T06:39:06.0127503Z  2025-03-14T06:39:06.0130420Z  2025-03-14T06:39:06.0134266Z [18,703 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:06.0137943Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2025-03-14T06:39:06.0141425Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T06:39:06.0145015Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T06:39:06.0148556Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T06:39:06.0151419Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 46s local 2025-03-14T06:39:06.0152651Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 17s local 2025-03-14T06:39:06.0153990Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 17s local 2025-03-14T06:39:06.0155393Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local ... 2025-03-14T06:39:06.7963513Z 2025-03-14T06:39:06.7964962Z  2025-03-14T06:39:06.7966150Z  2025-03-14T06:39:06.7967242Z  2025-03-14T06:39:06.7967708Z  2025-03-14T06:39:06.7968095Z  2025-03-14T06:39:06.7968477Z  2025-03-14T06:39:06.7968863Z  2025-03-14T06:39:06.7969229Z  2025-03-14T06:39:06.7970201Z [18,704 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:06.7971228Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2025-03-14T06:39:06.7972414Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T06:39:06.7973432Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2025-03-14T06:39:06.7974485Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2025-03-14T06:39:06.7975454Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T06:39:06.7976441Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2025-03-14T06:39:06.7977462Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2025-03-14T06:39:06.7978918Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local ... 2025-03-14T06:39:07.0118484Z 2025-03-14T06:39:07.0119720Z  2025-03-14T06:39:07.0120238Z  2025-03-14T06:39:07.0120644Z  2025-03-14T06:39:07.0121015Z  2025-03-14T06:39:07.0121435Z  2025-03-14T06:39:07.0121854Z  2025-03-14T06:39:07.0122266Z  2025-03-14T06:39:07.0122654Z  2025-03-14T06:39:07.0123597Z [18,704 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:07.0124831Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T06:39:07.0125710Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T06:39:07.0126706Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2025-03-14T06:39:07.0127660Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2025-03-14T06:39:07.0128561Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T06:39:07.0129479Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2025-03-14T06:39:07.0130457Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2025-03-14T06:39:07.0131566Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local ... 2025-03-14T06:39:07.2507188Z 2025-03-14T06:39:07.2508046Z  2025-03-14T06:39:07.2508677Z  2025-03-14T06:39:07.2509115Z  2025-03-14T06:39:07.2509545Z  2025-03-14T06:39:07.2509968Z  2025-03-14T06:39:07.2510415Z  2025-03-14T06:39:07.2510847Z  2025-03-14T06:39:07.2511625Z  2025-03-14T06:39:07.2512623Z [18,705 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:07.2513839Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T06:39:07.2514930Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2025-03-14T06:39:07.2516099Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T06:39:07.2517503Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T06:39:07.2518612Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T06:39:07.2519748Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 18s local 2025-03-14T06:39:07.2520951Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 18s local 2025-03-14T06:39:07.2522190Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local ... 2025-03-14T06:39:07.6123842Z 2025-03-14T06:39:07.6124846Z  2025-03-14T06:39:07.6125570Z  2025-03-14T06:39:07.6125988Z  2025-03-14T06:39:07.6126376Z  2025-03-14T06:39:07.6126759Z  2025-03-14T06:39:07.6127137Z  2025-03-14T06:39:07.6127516Z  2025-03-14T06:39:07.6127923Z  2025-03-14T06:39:07.6128876Z [18,706 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:07.6129905Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T06:39:07.6130790Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2025-03-14T06:39:07.6131912Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T06:39:07.6132875Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T06:39:07.6133814Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 47s local 2025-03-14T06:39:07.6134745Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2025-03-14T06:39:07.6136015Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2025-03-14T06:39:07.6137153Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local ... 2025-03-14T06:39:08.1281435Z 2025-03-14T06:39:08.1282338Z  2025-03-14T06:39:08.1282879Z  2025-03-14T06:39:08.1283306Z  2025-03-14T06:39:08.1283738Z  2025-03-14T06:39:08.1284161Z  2025-03-14T06:39:08.1284738Z  2025-03-14T06:39:08.1285446Z  2025-03-14T06:39:08.1285845Z  2025-03-14T06:39:08.1286873Z [18,707 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:08.1287968Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T06:39:08.1288914Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T06:39:08.1290158Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T06:39:08.1291262Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T06:39:08.1292306Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2025-03-14T06:39:08.1293344Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2025-03-14T06:39:08.1294500Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2025-03-14T06:39:08.1295445Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local ... 2025-03-14T06:39:08.4130536Z 2025-03-14T06:39:08.4131381Z  2025-03-14T06:39:08.4131886Z  2025-03-14T06:39:08.4132328Z  2025-03-14T06:39:08.4132759Z  2025-03-14T06:39:08.4133177Z  2025-03-14T06:39:08.4133591Z  2025-03-14T06:39:08.4134010Z  2025-03-14T06:39:08.4134413Z  2025-03-14T06:39:08.4135498Z [18,707 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:08.4136575Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T06:39:08.4137494Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T06:39:08.4138512Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2025-03-14T06:39:08.4139520Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T06:39:08.4140473Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 48s local 2025-03-14T06:39:08.4141418Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 19s local 2025-03-14T06:39:08.4142462Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 19s local 2025-03-14T06:39:08.4143919Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local ... 2025-03-14T06:39:08.8134202Z 2025-03-14T06:39:08.8134988Z  2025-03-14T06:39:08.8135465Z  2025-03-14T06:39:08.8135872Z  2025-03-14T06:39:08.8136277Z  2025-03-14T06:39:08.8136612Z  2025-03-14T06:39:08.8136991Z  2025-03-14T06:39:08.8137376Z  2025-03-14T06:39:08.8137750Z  2025-03-14T06:39:08.8138743Z [18,708 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:08.8140106Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T06:39:08.8141037Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T06:39:08.8142054Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2025-03-14T06:39:08.8143055Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T06:39:08.8144004Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T06:39:08.8144960Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2025-03-14T06:39:08.8146018Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2025-03-14T06:39:08.8147205Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local ... 2025-03-14T06:39:09.2138555Z 2025-03-14T06:39:09.2139708Z  2025-03-14T06:39:09.2140216Z  2025-03-14T06:39:09.2140642Z  2025-03-14T06:39:09.2141419Z  2025-03-14T06:39:09.2141860Z  2025-03-14T06:39:09.2142259Z  2025-03-14T06:39:09.2142690Z  2025-03-14T06:39:09.2143097Z  2025-03-14T06:39:09.2144062Z [18,711 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:09.2145177Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T06:39:09.2146040Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T06:39:09.2147300Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T06:39:09.2148314Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T06:39:09.2149302Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T06:39:09.2150246Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 20s local 2025-03-14T06:39:09.2151319Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2025-03-14T06:39:09.2152480Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local ... 2025-03-14T06:39:09.4766214Z 2025-03-14T06:39:09.4767233Z  2025-03-14T06:39:09.4767724Z  2025-03-14T06:39:09.4768134Z  2025-03-14T06:39:09.4768509Z  2025-03-14T06:39:09.4768884Z  2025-03-14T06:39:09.4769262Z  2025-03-14T06:39:09.4769645Z  2025-03-14T06:39:09.4770041Z  2025-03-14T06:39:09.4770942Z [18,712 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:09.4771989Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T06:39:09.4772866Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T06:39:09.4773861Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T06:39:09.4774838Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T06:39:09.4775740Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 49s local 2025-03-14T06:39:09.4776646Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2025-03-14T06:39:09.4777707Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 20s local 2025-03-14T06:39:09.4778841Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local ... 2025-03-14T06:39:09.8143568Z 2025-03-14T06:39:09.8144426Z  2025-03-14T06:39:09.8144903Z  2025-03-14T06:39:09.8145270Z  2025-03-14T06:39:09.8145689Z  2025-03-14T06:39:09.8146082Z  2025-03-14T06:39:09.8146514Z  2025-03-14T06:39:09.8146903Z  2025-03-14T06:39:09.8147595Z  2025-03-14T06:39:09.8148580Z [18,714 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:09.8149547Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T06:39:09.8150422Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T06:39:09.8151399Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T06:39:09.8152922Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T06:39:09.8154174Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T06:39:09.8155166Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2025-03-14T06:39:09.8156328Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2025-03-14T06:39:09.8157557Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local ... 2025-03-14T06:39:10.4130491Z 2025-03-14T06:39:10.4131314Z  2025-03-14T06:39:10.4131815Z  2025-03-14T06:39:10.4132269Z  2025-03-14T06:39:10.4132692Z  2025-03-14T06:39:10.4133092Z  2025-03-14T06:39:10.4133513Z  2025-03-14T06:39:10.4133928Z  2025-03-14T06:39:10.4134334Z  2025-03-14T06:39:10.4135290Z [18,715 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:10.4136360Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2025-03-14T06:39:10.4137553Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T06:39:10.4138599Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T06:39:10.4139603Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2025-03-14T06:39:10.4140529Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T06:39:10.4141480Z Compiling llvm/lib/Transforms/IPO/Attributor.cpp; 21s local 2025-03-14T06:39:10.4142842Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 21s local 2025-03-14T06:39:10.4143995Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local ... 2025-03-14T06:39:10.6149689Z 2025-03-14T06:39:10.6150535Z  2025-03-14T06:39:10.6151042Z  2025-03-14T06:39:10.6153006Z  2025-03-14T06:39:10.6155998Z  2025-03-14T06:39:10.6158906Z  2025-03-14T06:39:10.6162038Z  2025-03-14T06:39:10.6165492Z  2025-03-14T06:39:10.6168551Z  2025-03-14T06:39:10.6172148Z [18,717 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:10.6175681Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2025-03-14T06:39:10.6179075Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T06:39:10.6182578Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T06:39:10.6185996Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2025-03-14T06:39:10.6189478Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 50s local 2025-03-14T06:39:10.6193010Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2025-03-14T06:39:10.6196598Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T06:39:10.6198149Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2025-03-14T06:39:10.9030664Z 2025-03-14T06:39:10.9031823Z  2025-03-14T06:39:10.9032498Z  2025-03-14T06:39:10.9033222Z  2025-03-14T06:39:10.9034351Z  2025-03-14T06:39:10.9034841Z  2025-03-14T06:39:10.9035271Z  2025-03-14T06:39:10.9035690Z  2025-03-14T06:39:10.9036126Z  2025-03-14T06:39:10.9037123Z [18,719 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:10.9038226Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T06:39:10.9039210Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T06:39:10.9040535Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T06:39:10.9041558Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2025-03-14T06:39:10.9042620Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T06:39:10.9043719Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2025-03-14T06:39:10.9045128Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T06:39:10.9046338Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2025-03-14T06:39:11.1061603Z 2025-03-14T06:39:11.1062782Z  2025-03-14T06:39:11.1063278Z  2025-03-14T06:39:11.1063700Z  2025-03-14T06:39:11.1064111Z  2025-03-14T06:39:11.1064510Z  2025-03-14T06:39:11.1064935Z  2025-03-14T06:39:11.1065597Z  2025-03-14T06:39:11.1066022Z  2025-03-14T06:39:11.1066949Z [18,720 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:11.1068000Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T06:39:11.1068873Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T06:39:11.1069878Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T06:39:11.1070878Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T06:39:11.1071799Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T06:39:11.1073143Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2025-03-14T06:39:11.1074279Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T06:39:11.1075385Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2025-03-14T06:39:11.4155036Z 2025-03-14T06:39:11.4156230Z  2025-03-14T06:39:11.4156862Z  2025-03-14T06:39:11.4157266Z  2025-03-14T06:39:11.4157783Z  2025-03-14T06:39:11.4158573Z  2025-03-14T06:39:11.4159103Z  2025-03-14T06:39:11.4159561Z  2025-03-14T06:39:11.4159967Z  2025-03-14T06:39:11.4160858Z [18,721 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:11.4161930Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T06:39:11.4162820Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T06:39:11.4163871Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T06:39:11.4165068Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T06:39:11.4166356Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T06:39:11.4167664Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 22s local 2025-03-14T06:39:11.4168833Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T06:39:11.4170007Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 18s local ... 2025-03-14T06:39:11.6290425Z 2025-03-14T06:39:11.6291633Z  2025-03-14T06:39:11.6292176Z  2025-03-14T06:39:11.6292581Z  2025-03-14T06:39:11.6292972Z  2025-03-14T06:39:11.6293358Z  2025-03-14T06:39:11.6293780Z  2025-03-14T06:39:11.6294186Z  2025-03-14T06:39:11.6294573Z  2025-03-14T06:39:11.6295506Z [18,722 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:11.6296503Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T06:39:11.6297462Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T06:39:11.6298404Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T06:39:11.6299399Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T06:39:11.6300411Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 51s local 2025-03-14T06:39:11.6301465Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2025-03-14T06:39:11.6302893Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T06:39:11.6304048Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2025-03-14T06:39:12.0127323Z 2025-03-14T06:39:12.0128329Z  2025-03-14T06:39:12.0128824Z  2025-03-14T06:39:12.0129236Z  2025-03-14T06:39:12.0129683Z  2025-03-14T06:39:12.0130083Z  2025-03-14T06:39:12.0130480Z  2025-03-14T06:39:12.0130884Z  2025-03-14T06:39:12.0131318Z  2025-03-14T06:39:12.0132563Z [18,723 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:12.0133619Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2025-03-14T06:39:12.0134491Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T06:39:12.0135404Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T06:39:12.0136333Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T06:39:12.0137213Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2025-03-14T06:39:12.0138172Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2025-03-14T06:39:12.0139238Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T06:39:12.0140317Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2025-03-14T06:39:12.2160951Z 2025-03-14T06:39:12.2161933Z  2025-03-14T06:39:12.2162772Z  2025-03-14T06:39:12.2163492Z  2025-03-14T06:39:12.2164006Z  2025-03-14T06:39:12.2164699Z  2025-03-14T06:39:12.2165227Z  2025-03-14T06:39:12.2165942Z  2025-03-14T06:39:12.2166447Z  2025-03-14T06:39:12.2167495Z [18,724 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:12.2168700Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2025-03-14T06:39:12.2179020Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T06:39:12.9126998Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T06:39:12.9128070Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T06:39:12.9128962Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 52s local 2025-03-14T06:39:12.9129969Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 23s local 2025-03-14T06:39:12.9131017Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T06:39:12.9132114Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 19s local ... 2025-03-14T06:39:12.9132788Z 2025-03-14T06:39:12.9133231Z  2025-03-14T06:39:12.9133676Z  2025-03-14T06:39:12.9134181Z  2025-03-14T06:39:12.9134653Z  2025-03-14T06:39:12.9135074Z  2025-03-14T06:39:12.9135480Z  2025-03-14T06:39:12.9135886Z  2025-03-14T06:39:12.9136281Z  2025-03-14T06:39:12.9137190Z [18,725 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:12.9138249Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2025-03-14T06:39:12.9139135Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T06:39:12.9140148Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T06:39:12.9141156Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T06:39:12.9142063Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T06:39:12.9143282Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2025-03-14T06:39:12.9144426Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2025-03-14T06:39:12.9145518Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local ... 2025-03-14T06:39:13.2168282Z 2025-03-14T06:39:13.2169190Z  2025-03-14T06:39:13.2169718Z  2025-03-14T06:39:13.2172634Z  2025-03-14T06:39:13.2175947Z  2025-03-14T06:39:13.2179042Z  2025-03-14T06:39:13.2182093Z  2025-03-14T06:39:13.2185544Z  2025-03-14T06:39:13.2188593Z  2025-03-14T06:39:13.2192202Z [18,726 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:13.2195796Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2025-03-14T06:39:13.2199261Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2025-03-14T06:39:13.2202809Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T06:39:13.2206726Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T06:39:13.2210095Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T06:39:13.2213608Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 24s local 2025-03-14T06:39:13.2217267Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2025-03-14T06:39:13.2220780Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 20s local ... 2025-03-14T06:39:13.6171544Z 2025-03-14T06:39:13.6172758Z  2025-03-14T06:39:13.6173430Z  2025-03-14T06:39:13.6174087Z  2025-03-14T06:39:13.6175166Z  2025-03-14T06:39:13.6175636Z  2025-03-14T06:39:13.6176065Z  2025-03-14T06:39:13.6176458Z  2025-03-14T06:39:13.6176859Z  2025-03-14T06:39:13.6177790Z [18,727 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:39:13.6179089Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2025-03-14T06:39:13.6179960Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2025-03-14T06:39:13.6181089Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T06:39:13.6182779Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T06:39:13.6183873Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 53s local 2025-03-14T06:39:13.6184921Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T06:39:13.6186341Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T06:39:13.6187389Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local ... 2025-03-14T06:39:14.0175512Z 2025-03-14T06:39:14.0176770Z  2025-03-14T06:39:14.0177288Z  2025-03-14T06:39:14.0177727Z  2025-03-14T06:39:14.0178156Z  2025-03-14T06:39:14.0178573Z  2025-03-14T06:39:14.0178988Z  2025-03-14T06:39:14.0179418Z  2025-03-14T06:39:14.0179836Z  2025-03-14T06:39:14.0180865Z [18,727 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:14.0181975Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T06:39:14.0182933Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2025-03-14T06:39:14.0184019Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T06:39:14.0185046Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T06:39:14.0186013Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T06:39:14.0187087Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T06:39:14.0188315Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T06:39:14.0189501Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local ... 2025-03-14T06:39:14.2178636Z 2025-03-14T06:39:14.2179543Z  2025-03-14T06:39:14.2180031Z  2025-03-14T06:39:14.2180453Z  2025-03-14T06:39:14.2180877Z  2025-03-14T06:39:14.2181308Z  2025-03-14T06:39:14.2181703Z  2025-03-14T06:39:14.2182085Z  2025-03-14T06:39:14.2182482Z  2025-03-14T06:39:14.2183432Z [18,728 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:14.2184460Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T06:39:14.2185692Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T06:39:14.2186741Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T06:39:14.2187738Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T06:39:14.2188732Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T06:39:14.2189761Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T06:39:14.2190961Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T06:39:14.2192294Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local ... 2025-03-14T06:39:14.5155818Z 2025-03-14T06:39:14.5156680Z  2025-03-14T06:39:14.5157537Z  2025-03-14T06:39:14.5158100Z  2025-03-14T06:39:14.5158636Z  2025-03-14T06:39:14.5159174Z  2025-03-14T06:39:14.5159719Z  2025-03-14T06:39:14.5160270Z  2025-03-14T06:39:14.5160803Z  2025-03-14T06:39:14.5161974Z [18,730 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:14.5163228Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T06:39:14.5164257Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T06:39:14.5165794Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T06:39:14.5167057Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T06:39:14.5168190Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 54s local 2025-03-14T06:39:14.5169739Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 25s local 2025-03-14T06:39:14.5171095Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T06:39:14.5172386Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 21s local ... 2025-03-14T06:39:14.7336635Z 2025-03-14T06:39:14.7337497Z  2025-03-14T06:39:14.7337993Z  2025-03-14T06:39:14.7338664Z  2025-03-14T06:39:14.7339033Z  2025-03-14T06:39:14.7339411Z  2025-03-14T06:39:14.7339793Z  2025-03-14T06:39:14.7340179Z  2025-03-14T06:39:14.7340583Z  2025-03-14T06:39:14.7341446Z [18,732 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:14.7342414Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T06:39:14.7343259Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T06:39:14.7344170Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T06:39:14.7345093Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T06:39:14.7345921Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T06:39:14.7346896Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T06:39:14.7347955Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T06:39:14.7349127Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local ... 2025-03-14T06:39:15.0185559Z 2025-03-14T06:39:15.0186423Z  2025-03-14T06:39:15.0189018Z  2025-03-14T06:39:15.0192312Z  2025-03-14T06:39:15.0195371Z  2025-03-14T06:39:15.0198386Z  2025-03-14T06:39:15.0201395Z  2025-03-14T06:39:15.0204563Z  2025-03-14T06:39:15.0207473Z  2025-03-14T06:39:15.0210929Z [18,732 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:15.0214338Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2025-03-14T06:39:15.0215643Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T06:39:15.0216854Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T06:39:15.0218023Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T06:39:15.0219171Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T06:39:15.0220659Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T06:39:15.0222021Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T06:39:15.0223307Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local ... 2025-03-14T06:39:15.3034945Z 2025-03-14T06:39:15.3036153Z  2025-03-14T06:39:15.3036807Z  2025-03-14T06:39:15.3037462Z  2025-03-14T06:39:15.3038577Z  2025-03-14T06:39:15.3039028Z  2025-03-14T06:39:15.3039455Z  2025-03-14T06:39:15.3039856Z  2025-03-14T06:39:15.3040235Z  2025-03-14T06:39:15.3041562Z [18,735 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:15.3042649Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2025-03-14T06:39:15.3043580Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T06:39:15.3044770Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T06:39:15.3045822Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T06:39:15.3046776Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T06:39:15.3047830Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 26s local 2025-03-14T06:39:15.3048964Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T06:39:15.3050017Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 22s local ... 2025-03-14T06:39:15.5597049Z 2025-03-14T06:39:15.5598281Z  2025-03-14T06:39:15.5598776Z  2025-03-14T06:39:15.5599217Z  2025-03-14T06:39:15.5599611Z  2025-03-14T06:39:15.5600009Z  2025-03-14T06:39:15.5600417Z  2025-03-14T06:39:15.5600789Z  2025-03-14T06:39:15.5601211Z  2025-03-14T06:39:15.5602222Z [18,739 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:15.5603349Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2025-03-14T06:39:15.5604658Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T06:39:15.5605604Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T06:39:15.5606458Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T06:39:15.5607366Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 55s local 2025-03-14T06:39:15.5608407Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T06:39:15.5609633Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T06:39:15.5610746Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local ... 2025-03-14T06:39:15.8190758Z 2025-03-14T06:39:15.8191735Z  2025-03-14T06:39:15.8192359Z  2025-03-14T06:39:15.8192751Z  2025-03-14T06:39:15.8193263Z  2025-03-14T06:39:15.8193907Z  2025-03-14T06:39:15.8194437Z  2025-03-14T06:39:15.8194974Z  2025-03-14T06:39:15.8195519Z  2025-03-14T06:39:15.8196634Z [18,742 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:15.8197874Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2025-03-14T06:39:15.8198949Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T06:39:15.8200103Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T06:39:15.8201264Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T06:39:15.8202412Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T06:39:15.8203670Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T06:39:15.8205092Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T06:39:15.8206361Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local ... 2025-03-14T06:39:16.0509717Z 2025-03-14T06:39:16.0510647Z  2025-03-14T06:39:16.0511175Z  2025-03-14T06:39:16.0511565Z  2025-03-14T06:39:16.0511957Z  2025-03-14T06:39:16.0512618Z  2025-03-14T06:39:16.0513035Z  2025-03-14T06:39:16.0513442Z  2025-03-14T06:39:16.0513852Z  2025-03-14T06:39:16.0514794Z [18,743 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:16.0515826Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T06:39:16.0516766Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T06:39:16.0517929Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T06:39:16.0518972Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T06:39:16.0519972Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T06:39:16.0521054Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T06:39:16.0522257Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T06:39:16.0523303Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local ... 2025-03-14T06:39:16.2734662Z 2025-03-14T06:39:16.2735520Z  2025-03-14T06:39:16.2736033Z  2025-03-14T06:39:16.2736470Z  2025-03-14T06:39:16.2736910Z  2025-03-14T06:39:16.2737344Z  2025-03-14T06:39:16.2737697Z  2025-03-14T06:39:16.2738099Z  2025-03-14T06:39:16.2738507Z  2025-03-14T06:39:16.2739504Z [18,745 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:16.2740762Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T06:39:16.2741706Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T06:39:16.2742704Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T06:39:16.2743686Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T06:39:16.2744651Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T06:39:16.2745929Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T06:39:16.2747105Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T06:39:16.2748229Z Compiling llvm/lib/CodeGen/AsmPrinter/DwarfDebug.cpp; 23s local ... 2025-03-14T06:39:16.4869732Z 2025-03-14T06:39:16.4870625Z  2025-03-14T06:39:16.4872804Z  2025-03-14T06:39:16.4875547Z  2025-03-14T06:39:16.4878234Z  2025-03-14T06:39:16.4881016Z  2025-03-14T06:39:16.4883759Z  2025-03-14T06:39:16.4886923Z  2025-03-14T06:39:16.4889632Z  2025-03-14T06:39:16.4892841Z [18,746 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:16.4896089Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T06:39:16.4899158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T06:39:16.4902214Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T06:39:16.4905410Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T06:39:16.4908459Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 56s local 2025-03-14T06:39:16.4911712Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 27s local 2025-03-14T06:39:16.4914508Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T06:39:16.4915575Z Compiling xla/service/copy_insertion.cc; 22s local ... 2025-03-14T06:39:16.7397141Z 2025-03-14T06:39:16.7398360Z  2025-03-14T06:39:16.7398922Z  2025-03-14T06:39:16.7399508Z  2025-03-14T06:39:16.7400579Z  2025-03-14T06:39:16.7401043Z  2025-03-14T06:39:16.7401457Z  2025-03-14T06:39:16.7401862Z  2025-03-14T06:39:16.7402238Z  2025-03-14T06:39:16.7403182Z [18,749 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:16.7404161Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T06:39:16.7405434Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T06:39:16.7406437Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T06:39:16.7407413Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T06:39:16.7408388Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T06:39:16.7409470Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T06:39:16.7410689Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2025-03-14T06:39:16.7411857Z Compiling xla/service/copy_insertion.cc; 23s local ... 2025-03-14T06:39:17.0198475Z 2025-03-14T06:39:17.0199687Z  2025-03-14T06:39:17.0200186Z  2025-03-14T06:39:17.0200597Z  2025-03-14T06:39:17.0201005Z  2025-03-14T06:39:17.0201381Z  2025-03-14T06:39:17.0201772Z  2025-03-14T06:39:17.0202171Z  2025-03-14T06:39:17.0202569Z  2025-03-14T06:39:17.0203533Z [18,749 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:17.0204640Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2025-03-14T06:39:17.0205471Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T06:39:17.0206453Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T06:39:17.0207439Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T06:39:17.0208702Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T06:39:17.0209755Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 28s local 2025-03-14T06:39:17.0210978Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2025-03-14T06:39:17.0212030Z Compiling xla/service/copy_insertion.cc; 23s local ... 2025-03-14T06:39:17.6427831Z 2025-03-14T06:39:17.6429051Z  2025-03-14T06:39:17.6429606Z  2025-03-14T06:39:17.6430298Z  2025-03-14T06:39:17.6430700Z  2025-03-14T06:39:17.6431107Z  2025-03-14T06:39:17.6431515Z  2025-03-14T06:39:17.6431932Z  2025-03-14T06:39:17.6432314Z  2025-03-14T06:39:17.6433288Z [18,750 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:17.6434309Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2025-03-14T06:39:17.6435222Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T06:39:17.6436302Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T06:39:17.6437362Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T06:39:17.6438322Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 57s local 2025-03-14T06:39:17.6439286Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T06:39:17.6440341Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T06:39:17.6441339Z Compiling xla/service/copy_insertion.cc; 23s local ... 2025-03-14T06:39:18.0207169Z 2025-03-14T06:39:18.0208390Z  2025-03-14T06:39:18.0208880Z  2025-03-14T06:39:18.0209277Z  2025-03-14T06:39:18.0209704Z  2025-03-14T06:39:18.0210113Z  2025-03-14T06:39:18.0210496Z  2025-03-14T06:39:18.0210910Z  2025-03-14T06:39:18.0211353Z  2025-03-14T06:39:18.0212331Z [18,751 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:18.0213440Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T06:39:18.0214390Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T06:39:18.0215419Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T06:39:18.0216450Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T06:39:18.0217390Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T06:39:18.0218737Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T06:39:18.0219905Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T06:39:18.0220897Z Compiling xla/service/copy_insertion.cc; 24s local ... 2025-03-14T06:39:18.2209839Z 2025-03-14T06:39:18.2210718Z  2025-03-14T06:39:18.2211206Z  2025-03-14T06:39:18.2211636Z  2025-03-14T06:39:18.2212056Z  2025-03-14T06:39:18.2212449Z  2025-03-14T06:39:18.2212880Z  2025-03-14T06:39:18.2213296Z  2025-03-14T06:39:18.2213706Z  2025-03-14T06:39:18.2214920Z [18,754 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:18.2215960Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T06:39:18.2216894Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T06:39:18.2217861Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T06:39:18.2218937Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T06:39:18.2219859Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T06:39:18.2220920Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T06:39:18.2222064Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T06:39:18.2223066Z Compiling xla/service/copy_insertion.cc; 24s local ... 2025-03-14T06:39:18.4826567Z 2025-03-14T06:39:18.4827410Z  2025-03-14T06:39:18.4827908Z  2025-03-14T06:39:18.4828313Z  2025-03-14T06:39:18.4828754Z  2025-03-14T06:39:18.4829190Z  2025-03-14T06:39:18.4829596Z  2025-03-14T06:39:18.4830033Z  2025-03-14T06:39:18.4830434Z  2025-03-14T06:39:18.4831378Z [18,755 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:18.4832436Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T06:39:18.4833698Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T06:39:18.4834721Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T06:39:18.4835821Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T06:39:18.4836761Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 58s local 2025-03-14T06:39:18.4838334Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 29s local 2025-03-14T06:39:18.4839676Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T06:39:18.4840770Z Compiling xla/service/copy_insertion.cc; 24s local ... 2025-03-14T06:39:18.6999330Z 2025-03-14T06:39:18.7000195Z  2025-03-14T06:39:18.7000659Z  2025-03-14T06:39:18.7001143Z  2025-03-14T06:39:18.7001529Z  2025-03-14T06:39:18.7001914Z  2025-03-14T06:39:18.7002313Z  2025-03-14T06:39:18.7002704Z  2025-03-14T06:39:18.7003108Z  2025-03-14T06:39:18.7004095Z [18,757 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:18.7005230Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T06:39:18.7006084Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T06:39:18.7007085Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T06:39:18.7008059Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T06:39:18.7009044Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T06:39:18.7010163Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T06:39:18.7011302Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T06:39:18.7012322Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 15s local ... 2025-03-14T06:39:19.0216865Z 2025-03-14T06:39:19.0217750Z  2025-03-14T06:39:19.0218256Z  2025-03-14T06:39:19.0220233Z  2025-03-14T06:39:19.0221104Z  2025-03-14T06:39:19.0222291Z  2025-03-14T06:39:19.0222810Z  2025-03-14T06:39:19.0224497Z  2025-03-14T06:39:19.0227515Z  2025-03-14T06:39:19.0231039Z [18,757 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:19.0234460Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2025-03-14T06:39:19.0237946Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T06:39:19.0241445Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T06:39:19.0245541Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T06:39:19.0249001Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T06:39:19.0252566Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T06:39:19.0256074Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T06:39:19.0259552Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 16s local ... 2025-03-14T06:39:19.2219018Z 2025-03-14T06:39:19.2222100Z  2025-03-14T06:39:19.2224678Z  2025-03-14T06:39:19.2227521Z  2025-03-14T06:39:19.2229432Z  2025-03-14T06:39:19.2230029Z  2025-03-14T06:39:19.2230604Z  2025-03-14T06:39:19.2231216Z  2025-03-14T06:39:19.2231843Z  2025-03-14T06:39:19.2232966Z [18,758 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:19.2234726Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2025-03-14T06:39:19.2235822Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T06:39:19.2236821Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T06:39:19.2237747Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T06:39:19.2238978Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 59s local 2025-03-14T06:39:19.2240306Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 30s local 2025-03-14T06:39:19.2241636Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T06:39:19.2242896Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 16s local ... 2025-03-14T06:39:20.0571700Z 2025-03-14T06:39:20.0572885Z  2025-03-14T06:39:20.0574673Z  2025-03-14T06:39:20.0575271Z  2025-03-14T06:39:20.0576724Z  2025-03-14T06:39:20.0577266Z  2025-03-14T06:39:20.0578750Z  2025-03-14T06:39:20.0579309Z  2025-03-14T06:39:20.0580719Z  2025-03-14T06:39:20.0581758Z [18,759 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:20.0583938Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2025-03-14T06:39:20.0584968Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T06:39:20.0587096Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T06:39:20.0588346Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T06:39:20.0590355Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T06:39:20.0591501Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T06:39:20.0593774Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T06:39:20.0595059Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 17s local ... 2025-03-14T06:39:20.3044655Z 2025-03-14T06:39:20.3045865Z  2025-03-14T06:39:20.3047679Z  2025-03-14T06:39:20.3049167Z  2025-03-14T06:39:20.3050613Z  2025-03-14T06:39:20.3052079Z  2025-03-14T06:39:20.3053638Z  2025-03-14T06:39:20.3055050Z  2025-03-14T06:39:20.3056433Z  2025-03-14T06:39:20.3058390Z [18,760 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:20.3060528Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2025-03-14T06:39:20.3061777Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2025-03-14T06:39:20.3063825Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2025-03-14T06:39:20.3066229Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T06:39:20.3067201Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T06:39:20.3068162Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 31s local 2025-03-14T06:39:20.3070068Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T06:39:20.3071273Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 17s local ... 2025-03-14T06:39:20.5253943Z 2025-03-14T06:39:20.5255061Z  2025-03-14T06:39:20.5256691Z  2025-03-14T06:39:20.5258083Z  2025-03-14T06:39:20.5259584Z  2025-03-14T06:39:20.5260985Z  2025-03-14T06:39:20.5262348Z  2025-03-14T06:39:20.5263724Z  2025-03-14T06:39:20.5265130Z  2025-03-14T06:39:20.5267420Z [18,761 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:20.5268653Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2025-03-14T06:39:20.5270568Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2025-03-14T06:39:20.5271777Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2025-03-14T06:39:20.5273797Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T06:39:20.5275197Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 60s local 2025-03-14T06:39:20.5277273Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T06:39:20.5278619Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T06:39:20.5280705Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 17s local ... 2025-03-14T06:39:20.8230747Z 2025-03-14T06:39:20.8231684Z  2025-03-14T06:39:20.8232363Z  2025-03-14T06:39:20.8232733Z  2025-03-14T06:39:20.8233116Z  2025-03-14T06:39:20.8233493Z  2025-03-14T06:39:20.8233888Z  2025-03-14T06:39:20.8234300Z  2025-03-14T06:39:20.8234699Z  2025-03-14T06:39:20.8235579Z [18,762 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:20.8236509Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2025-03-14T06:39:20.8237336Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2025-03-14T06:39:20.8238259Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2025-03-14T06:39:20.8239183Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T06:39:20.8240035Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T06:39:20.8241033Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T06:39:20.8242047Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T06:39:20.8243038Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 17s local ... 2025-03-14T06:39:21.1430532Z 2025-03-14T06:39:21.1431334Z  2025-03-14T06:39:21.1431707Z  2025-03-14T06:39:21.1432039Z  2025-03-14T06:39:21.1432359Z  2025-03-14T06:39:21.1432672Z  2025-03-14T06:39:21.1432989Z  2025-03-14T06:39:21.1433308Z  2025-03-14T06:39:21.1433612Z  2025-03-14T06:39:21.1434373Z [18,764 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:21.1435208Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T06:39:21.1435890Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 82s local 2025-03-14T06:39:21.1436642Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T06:39:21.1437377Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T06:39:21.1438098Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T06:39:21.1439174Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T06:39:21.1440044Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T06:39:21.1440854Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 18s local ... 2025-03-14T06:39:21.3555994Z 2025-03-14T06:39:21.3556889Z  2025-03-14T06:39:21.3557392Z  2025-03-14T06:39:21.3557781Z  2025-03-14T06:39:21.3558171Z  2025-03-14T06:39:21.3558603Z  2025-03-14T06:39:21.3558995Z  2025-03-14T06:39:21.3559396Z  2025-03-14T06:39:21.3560079Z  2025-03-14T06:39:21.3561044Z [18,765 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:21.3562037Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T06:39:21.3562903Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 82s local 2025-03-14T06:39:21.3563884Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T06:39:21.3565006Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T06:39:21.3566138Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T06:39:21.3567102Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 32s local 2025-03-14T06:39:21.3568174Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T06:39:21.3569177Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 18s local ... 2025-03-14T06:39:21.6145217Z 2025-03-14T06:39:21.6146178Z  2025-03-14T06:39:21.6146736Z  2025-03-14T06:39:21.6147236Z  2025-03-14T06:39:21.6147750Z  2025-03-14T06:39:21.6148094Z  2025-03-14T06:39:21.6148467Z  2025-03-14T06:39:21.6148855Z  2025-03-14T06:39:21.6149288Z  2025-03-14T06:39:21.6150384Z [18,766 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:21.6151618Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T06:39:21.6152617Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T06:39:21.6153717Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T06:39:21.6154662Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 61s local 2025-03-14T06:39:21.6155683Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T06:39:21.6156785Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T06:39:21.6157849Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 18s local 2025-03-14T06:39:21.6158814Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 16s local ... 2025-03-14T06:39:21.8240172Z 2025-03-14T06:39:21.8241072Z  2025-03-14T06:39:21.8241579Z  2025-03-14T06:39:21.8242002Z  2025-03-14T06:39:21.8242438Z  2025-03-14T06:39:21.8242865Z  2025-03-14T06:39:21.8243290Z  2025-03-14T06:39:21.8243786Z  2025-03-14T06:39:21.8244273Z  2025-03-14T06:39:21.8245437Z [18,766 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:21.8246399Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T06:39:21.8247148Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T06:39:21.8248163Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T06:39:21.8248999Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T06:39:21.8249960Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T06:39:21.8251024Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T06:39:21.8252074Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 18s local 2025-03-14T06:39:21.8253059Z Compiling xla/backends/cpu/runtime/fft_thunk.cc; 16s local ... 2025-03-14T06:39:22.0326443Z 2025-03-14T06:39:22.0327396Z  2025-03-14T06:39:22.0327859Z  2025-03-14T06:39:22.0328229Z  2025-03-14T06:39:22.0328829Z  2025-03-14T06:39:22.0329256Z  2025-03-14T06:39:22.0329657Z  2025-03-14T06:39:22.0330056Z  2025-03-14T06:39:22.0330468Z  2025-03-14T06:39:22.0331410Z [18,767 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:22.0332396Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T06:39:22.0333317Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T06:39:22.0334545Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T06:39:22.0335463Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T06:39:22.0336484Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T06:39:22.0337634Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T06:39:22.0338545Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 19s local 2025-03-14T06:39:22.0339547Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local ... 2025-03-14T06:39:22.4243389Z 2025-03-14T06:39:22.4244253Z  2025-03-14T06:39:22.4245032Z  2025-03-14T06:39:22.4245463Z  2025-03-14T06:39:22.4245845Z  2025-03-14T06:39:22.4246213Z  2025-03-14T06:39:22.4247371Z  2025-03-14T06:39:22.4247787Z  2025-03-14T06:39:22.4248194Z  2025-03-14T06:39:22.4249140Z [18,768 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:22.4250559Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T06:39:22.4251460Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T06:39:22.4252461Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T06:39:22.4253399Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 62s local 2025-03-14T06:39:22.4254453Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 33s local 2025-03-14T06:39:22.4255777Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T06:39:22.4256800Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 19s local 2025-03-14T06:39:22.4257868Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 16s local ... 2025-03-14T06:39:22.8248421Z 2025-03-14T06:39:22.8249403Z  2025-03-14T06:39:22.8249912Z  2025-03-14T06:39:22.8250267Z  2025-03-14T06:39:22.8250625Z  2025-03-14T06:39:22.8251001Z  2025-03-14T06:39:22.8251376Z  2025-03-14T06:39:22.8251778Z  2025-03-14T06:39:22.8252165Z  2025-03-14T06:39:22.8253061Z [18,769 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:22.8254054Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T06:39:22.8254940Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T06:39:22.8255907Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T06:39:22.8256734Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T06:39:22.8257838Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T06:39:22.8258930Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2025-03-14T06:39:22.8259888Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 19s local 2025-03-14T06:39:22.8260900Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local ... 2025-03-14T06:39:23.0249771Z 2025-03-14T06:39:23.0250694Z  2025-03-14T06:39:23.0251190Z  2025-03-14T06:39:23.0251623Z  2025-03-14T06:39:23.0252036Z  2025-03-14T06:39:23.0252432Z  2025-03-14T06:39:23.0252850Z  2025-03-14T06:39:23.0253274Z  2025-03-14T06:39:23.0253694Z  2025-03-14T06:39:23.0254681Z [18,770 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:23.0256065Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T06:39:23.0257037Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T06:39:23.0258067Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T06:39:23.0259067Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T06:39:23.0260145Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T06:39:23.0261262Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2025-03-14T06:39:23.0262448Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 20s local 2025-03-14T06:39:23.0263491Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local ... 2025-03-14T06:39:23.4253819Z 2025-03-14T06:39:23.4254821Z  2025-03-14T06:39:23.4255368Z  2025-03-14T06:39:23.4255787Z  2025-03-14T06:39:23.4256178Z  2025-03-14T06:39:23.4256525Z  2025-03-14T06:39:23.4256927Z  2025-03-14T06:39:23.4257301Z  2025-03-14T06:39:23.4257656Z  2025-03-14T06:39:23.4258592Z [18,771 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:23.4259548Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T06:39:23.4260445Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2025-03-14T06:39:23.4261353Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2025-03-14T06:39:23.4262527Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 63s local 2025-03-14T06:39:23.4263536Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 34s local 2025-03-14T06:39:23.4264604Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2025-03-14T06:39:23.4265815Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 20s local 2025-03-14T06:39:23.4266782Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 17s local ... 2025-03-14T06:39:23.7030185Z 2025-03-14T06:39:23.7031079Z  2025-03-14T06:39:23.7031543Z  2025-03-14T06:39:23.7031933Z  2025-03-14T06:39:23.7032328Z  2025-03-14T06:39:23.7032736Z  2025-03-14T06:39:23.7033125Z  2025-03-14T06:39:23.7033509Z  2025-03-14T06:39:23.7033911Z  2025-03-14T06:39:23.7034818Z [18,772 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:23.7035782Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T06:39:23.7036658Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2025-03-14T06:39:23.7037586Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2025-03-14T06:39:23.7038470Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T06:39:23.7039399Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T06:39:23.7040425Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T06:39:23.7041359Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 20s local 2025-03-14T06:39:23.7042288Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local ... 2025-03-14T06:39:23.9275275Z 2025-03-14T06:39:23.9276203Z  2025-03-14T06:39:23.9277458Z  2025-03-14T06:39:23.9277860Z  2025-03-14T06:39:23.9278244Z  2025-03-14T06:39:23.9278650Z  2025-03-14T06:39:23.9279024Z  2025-03-14T06:39:23.9279415Z  2025-03-14T06:39:23.9279811Z  2025-03-14T06:39:23.9280706Z [18,773 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:23.9281655Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T06:39:23.9282634Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2025-03-14T06:39:23.9283611Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2025-03-14T06:39:23.9284602Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T06:39:23.9285835Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T06:39:23.9287007Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T06:39:23.9287961Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 20s local 2025-03-14T06:39:23.9288990Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local ... 2025-03-14T06:39:24.2260753Z 2025-03-14T06:39:24.2261615Z  2025-03-14T06:39:24.2262098Z  2025-03-14T06:39:24.2262453Z  2025-03-14T06:39:24.2262835Z  2025-03-14T06:39:24.2263225Z  2025-03-14T06:39:24.2266076Z  2025-03-14T06:39:24.2266929Z  2025-03-14T06:39:24.2267295Z  2025-03-14T06:39:24.2268299Z [18,776 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:24.2269290Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T06:39:24.2270158Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T06:39:24.2271111Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T06:39:24.2272023Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T06:39:24.2273035Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T06:39:24.2274068Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T06:39:24.2274996Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 21s local 2025-03-14T06:39:24.2276134Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local ... 2025-03-14T06:39:24.4919327Z 2025-03-14T06:39:24.4920157Z  2025-03-14T06:39:24.4920729Z  2025-03-14T06:39:24.4921164Z  2025-03-14T06:39:24.4921612Z  2025-03-14T06:39:24.4921997Z  2025-03-14T06:39:24.4922366Z  2025-03-14T06:39:24.4922754Z  2025-03-14T06:39:24.4923120Z  2025-03-14T06:39:24.4924000Z [18,777 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:24.4925471Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T06:39:24.4926357Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T06:39:24.4927276Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T06:39:24.4928172Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 64s local 2025-03-14T06:39:24.4929086Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 35s local 2025-03-14T06:39:24.4930079Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T06:39:24.4931217Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 21s local 2025-03-14T06:39:24.4932315Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 18s local ... 2025-03-14T06:39:24.8267534Z 2025-03-14T06:39:24.8268372Z  2025-03-14T06:39:24.8268813Z  2025-03-14T06:39:24.8269172Z  2025-03-14T06:39:24.8269591Z  2025-03-14T06:39:24.8269969Z  2025-03-14T06:39:24.8270327Z  2025-03-14T06:39:24.8270691Z  2025-03-14T06:39:24.8271029Z  2025-03-14T06:39:24.8271934Z [18,777 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:24.8272938Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T06:39:24.8273818Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T06:39:24.8274795Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T06:39:24.8275683Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2025-03-14T06:39:24.8276678Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T06:39:24.8277802Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T06:39:24.8278798Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 21s local 2025-03-14T06:39:24.8279855Z Compiling mlir/lib/Conversion/FuncToLLVM/FuncToLLVM.cpp; 19s local ... 2025-03-14T06:39:25.2271669Z 2025-03-14T06:39:25.2272841Z  2025-03-14T06:39:25.2273416Z  2025-03-14T06:39:25.2273797Z  2025-03-14T06:39:25.2274171Z  2025-03-14T06:39:25.2274564Z  2025-03-14T06:39:25.2274932Z  2025-03-14T06:39:25.2275330Z  2025-03-14T06:39:25.2275719Z  2025-03-14T06:39:25.2276650Z [18,778 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:25.2277648Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T06:39:25.2278711Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2025-03-14T06:39:25.2279656Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T06:39:25.2280550Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2025-03-14T06:39:25.2281545Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T06:39:25.2282567Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T06:39:25.2283547Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local 2025-03-14T06:39:25.2284669Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local ... 2025-03-14T06:39:25.5191647Z 2025-03-14T06:39:25.5192496Z  2025-03-14T06:39:25.5192990Z  2025-03-14T06:39:25.5193378Z  2025-03-14T06:39:25.5193778Z  2025-03-14T06:39:25.5194162Z  2025-03-14T06:39:25.5194558Z  2025-03-14T06:39:25.5195342Z  2025-03-14T06:39:25.5195710Z  2025-03-14T06:39:25.5207013Z [18,779 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:25.5208063Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T06:39:25.5208886Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2025-03-14T06:39:25.5209795Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T06:39:25.5210976Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 65s local 2025-03-14T06:39:25.5211921Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 36s local 2025-03-14T06:39:25.5212845Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T06:39:25.5213833Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local 2025-03-14T06:39:25.5214843Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local ... 2025-03-14T06:39:25.8276386Z 2025-03-14T06:39:25.8277254Z  2025-03-14T06:39:25.8277744Z  2025-03-14T06:39:25.8278067Z  2025-03-14T06:39:25.8278402Z  2025-03-14T06:39:25.8278784Z  2025-03-14T06:39:25.8279149Z  2025-03-14T06:39:25.8279574Z  2025-03-14T06:39:25.8279997Z  2025-03-14T06:39:25.8280926Z [18,780 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:25.8281992Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2025-03-14T06:39:25.8282972Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2025-03-14T06:39:25.8283911Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T06:39:25.8284984Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T06:39:25.8285842Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T06:39:25.8286955Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2025-03-14T06:39:25.8287972Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local 2025-03-14T06:39:25.8288865Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 14s local ... 2025-03-14T06:39:26.2731456Z 2025-03-14T06:39:26.2732269Z  2025-03-14T06:39:26.2732779Z  2025-03-14T06:39:26.2733187Z  2025-03-14T06:39:26.2733603Z  2025-03-14T06:39:26.2733990Z  2025-03-14T06:39:26.2734388Z  2025-03-14T06:39:26.2734786Z  2025-03-14T06:39:26.2735168Z  2025-03-14T06:39:26.2736351Z [18,781 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:26.2737353Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2025-03-14T06:39:26.2738225Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T06:39:26.2739110Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2025-03-14T06:39:26.2739990Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T06:39:26.2740968Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 37s local 2025-03-14T06:39:26.2742212Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2025-03-14T06:39:26.2743203Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local 2025-03-14T06:39:26.2744198Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local ... 2025-03-14T06:39:26.6280111Z 2025-03-14T06:39:26.6280931Z  2025-03-14T06:39:26.6281414Z  2025-03-14T06:39:26.6281858Z  2025-03-14T06:39:26.6282264Z  2025-03-14T06:39:26.6282670Z  2025-03-14T06:39:26.6283058Z  2025-03-14T06:39:26.6283445Z  2025-03-14T06:39:26.6283840Z  2025-03-14T06:39:26.6284910Z [18,781 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:26.6285896Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2025-03-14T06:39:26.6286691Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T06:39:26.6287895Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2025-03-14T06:39:26.6288722Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 66s local 2025-03-14T06:39:26.6289719Z Compiling llvm/lib/Transforms/IPO/AttributorAttributes.cpp; 38s local 2025-03-14T06:39:26.6290807Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T06:39:26.6291814Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local 2025-03-14T06:39:26.6292951Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local ... 2025-03-14T06:39:26.8450064Z 2025-03-14T06:39:26.8450953Z  2025-03-14T06:39:26.8451451Z  2025-03-14T06:39:26.8451849Z  2025-03-14T06:39:26.8452314Z  2025-03-14T06:39:26.8452702Z  2025-03-14T06:39:26.8453120Z  2025-03-14T06:39:26.8453493Z  2025-03-14T06:39:26.8453872Z  2025-03-14T06:39:26.8454744Z [18,783 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:26.8455768Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 136s local 2025-03-14T06:39:26.8456632Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T06:39:26.8457600Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2025-03-14T06:39:26.8458453Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T06:39:26.8459343Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T06:39:26.8460418Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local 2025-03-14T06:39:26.8461455Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 15s local 2025-03-14T06:39:26.8462523Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local ... 2025-03-14T06:39:27.2285488Z 2025-03-14T06:39:27.2286328Z  2025-03-14T06:39:27.2286806Z  2025-03-14T06:39:27.2287227Z  2025-03-14T06:39:27.2287623Z  2025-03-14T06:39:27.2288044Z  2025-03-14T06:39:27.2288497Z  2025-03-14T06:39:27.2288906Z  2025-03-14T06:39:27.2289290Z  2025-03-14T06:39:27.2290256Z [18,783 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:27.2291280Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 136s local 2025-03-14T06:39:27.2292177Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2025-03-14T06:39:27.2293324Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2025-03-14T06:39:27.2294583Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T06:39:27.2295668Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T06:39:27.2296783Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local 2025-03-14T06:39:27.2297842Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2025-03-14T06:39:27.2298970Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local ... 2025-03-14T06:39:27.5941981Z 2025-03-14T06:39:27.5942857Z  2025-03-14T06:39:27.5943354Z  2025-03-14T06:39:27.5944033Z  2025-03-14T06:39:27.5944460Z  2025-03-14T06:39:27.5944883Z  2025-03-14T06:39:27.5945262Z  2025-03-14T06:39:27.5945665Z  2025-03-14T06:39:27.5946090Z  2025-03-14T06:39:27.5947072Z [18,784 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:27.5948112Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 136s local 2025-03-14T06:39:27.5949055Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2025-03-14T06:39:27.5950062Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2025-03-14T06:39:27.5950971Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 67s local 2025-03-14T06:39:27.5952009Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T06:39:27.5953060Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local 2025-03-14T06:39:27.5954276Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2025-03-14T06:39:27.5955348Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 15s local ... 2025-03-14T06:39:27.8292219Z 2025-03-14T06:39:27.8293062Z  2025-03-14T06:39:27.8293468Z  2025-03-14T06:39:27.8293829Z  2025-03-14T06:39:27.8294186Z  2025-03-14T06:39:27.8294547Z  2025-03-14T06:39:27.8294887Z  2025-03-14T06:39:27.8295235Z  2025-03-14T06:39:27.8295923Z  2025-03-14T06:39:27.8296779Z [18,784 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:27.8297659Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 137s local 2025-03-14T06:39:27.8298446Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2025-03-14T06:39:27.8299319Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2025-03-14T06:39:27.8300115Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2025-03-14T06:39:27.8300991Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T06:39:27.8301895Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local 2025-03-14T06:39:27.8302819Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 16s local 2025-03-14T06:39:27.8303795Z Compiling xla/backends/cpu/runtime/infeed_thunk.cc; 16s local ... 2025-03-14T06:39:28.2296322Z 2025-03-14T06:39:28.2297163Z  2025-03-14T06:39:28.2297685Z  2025-03-14T06:39:28.2298125Z  2025-03-14T06:39:28.2298565Z  2025-03-14T06:39:28.2298975Z  2025-03-14T06:39:28.2299401Z  2025-03-14T06:39:28.2299827Z  2025-03-14T06:39:28.2300247Z  2025-03-14T06:39:28.2301249Z [18,786 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:28.2302456Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T06:39:28.2303507Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T06:39:28.2304522Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2025-03-14T06:39:28.2305583Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T06:39:28.2306667Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local 2025-03-14T06:39:28.2307661Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2025-03-14T06:39:28.2308657Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local 2025-03-14T06:39:28.2309881Z @llvm-project//mlir:SCFToControlFlow; 13s local ... 2025-03-14T06:39:28.6300702Z 2025-03-14T06:39:28.6301596Z  2025-03-14T06:39:28.6302049Z  2025-03-14T06:39:28.6302446Z  2025-03-14T06:39:28.6302915Z  2025-03-14T06:39:28.6303444Z  2025-03-14T06:39:28.6303959Z  2025-03-14T06:39:28.6304441Z  2025-03-14T06:39:28.6304926Z  2025-03-14T06:39:28.6305888Z [18,788 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:28.6307471Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T06:39:28.6308583Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T06:39:28.6309449Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 68s local 2025-03-14T06:39:28.6310448Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T06:39:28.6311539Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local 2025-03-14T06:39:28.6312551Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2025-03-14T06:39:28.6313549Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local 2025-03-14T06:39:28.6314497Z @llvm-project//mlir:SCFToControlFlow; 14s local ... 2025-03-14T06:39:28.9205865Z 2025-03-14T06:39:28.9206787Z  2025-03-14T06:39:28.9207263Z  2025-03-14T06:39:28.9207679Z  2025-03-14T06:39:28.9208162Z  2025-03-14T06:39:28.9208570Z  2025-03-14T06:39:28.9209275Z  2025-03-14T06:39:28.9209670Z  2025-03-14T06:39:28.9210095Z  2025-03-14T06:39:28.9211101Z [18,790 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:28.9212244Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T06:39:28.9213234Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T06:39:28.9214172Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2025-03-14T06:39:28.9215402Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T06:39:28.9216468Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local 2025-03-14T06:39:28.9217552Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 17s local 2025-03-14T06:39:28.9218580Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local 2025-03-14T06:39:28.9219995Z @llvm-project//mlir:SCFToControlFlow; 14s local ... 2025-03-14T06:39:29.2304561Z 2025-03-14T06:39:29.2305657Z  2025-03-14T06:39:29.2306157Z  2025-03-14T06:39:29.2306590Z  2025-03-14T06:39:29.2307008Z  2025-03-14T06:39:29.2307417Z  2025-03-14T06:39:29.2307800Z  2025-03-14T06:39:29.2308205Z  2025-03-14T06:39:29.2308607Z  2025-03-14T06:39:29.2309557Z [18,791 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:29.2310750Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2025-03-14T06:39:29.2311670Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2025-03-14T06:39:29.2312639Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 69s local 2025-03-14T06:39:29.2313651Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T06:39:29.2314739Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local 2025-03-14T06:39:29.2315753Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 18s local 2025-03-14T06:39:29.2316805Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local 2025-03-14T06:39:29.2317891Z @llvm-project//mlir:SCFToControlFlow; 14s local ... 2025-03-14T06:39:30.1328445Z 2025-03-14T06:39:30.1329265Z  2025-03-14T06:39:30.1329741Z  2025-03-14T06:39:30.1330155Z  2025-03-14T06:39:30.1330559Z  2025-03-14T06:39:30.1330941Z  2025-03-14T06:39:30.1331296Z  2025-03-14T06:39:30.1331702Z  2025-03-14T06:39:30.1332145Z  2025-03-14T06:39:30.1333346Z [18,792 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:30.1334517Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2025-03-14T06:39:30.1335526Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T06:39:30.1336466Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T06:39:30.1337472Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T06:39:30.1338525Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2025-03-14T06:39:30.1339742Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2025-03-14T06:39:30.1340757Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2025-03-14T06:39:30.1341644Z @llvm-project//mlir:SCFToControlFlow; 15s local ... 2025-03-14T06:39:30.4312810Z 2025-03-14T06:39:30.4313631Z  2025-03-14T06:39:30.4314105Z  2025-03-14T06:39:30.4314516Z  2025-03-14T06:39:30.4314988Z  2025-03-14T06:39:30.4315512Z  2025-03-14T06:39:30.4315907Z  2025-03-14T06:39:30.4316324Z  2025-03-14T06:39:30.4316761Z  2025-03-14T06:39:30.4317723Z [18,792 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:30.4318718Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T06:39:30.4319655Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T06:39:30.4320824Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T06:39:30.4321844Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T06:39:30.4322818Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2025-03-14T06:39:30.4323859Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2025-03-14T06:39:30.4325023Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2025-03-14T06:39:30.4326082Z @llvm-project//mlir:SCFToControlFlow; 16s local ... 2025-03-14T06:39:30.6672236Z 2025-03-14T06:39:30.6674879Z  2025-03-14T06:39:30.6675290Z  2025-03-14T06:39:30.6675645Z  2025-03-14T06:39:30.6675994Z  2025-03-14T06:39:30.6676351Z  2025-03-14T06:39:30.6676694Z  2025-03-14T06:39:30.6677052Z  2025-03-14T06:39:30.6677400Z  2025-03-14T06:39:30.6678362Z [18,794 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:30.6679355Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T06:39:30.6680185Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T06:39:30.6680958Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 70s local 2025-03-14T06:39:30.6681808Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T06:39:30.6682671Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2025-03-14T06:39:30.6683551Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2025-03-14T06:39:30.6684552Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local 2025-03-14T06:39:30.6685302Z @llvm-project//mlir:SCFToControlFlow; 16s local ... 2025-03-14T06:39:31.0320421Z 2025-03-14T06:39:31.0321240Z  2025-03-14T06:39:31.0321726Z  2025-03-14T06:39:31.0322120Z  2025-03-14T06:39:31.0322498Z  2025-03-14T06:39:31.0322884Z  2025-03-14T06:39:31.0323276Z  2025-03-14T06:39:31.0323669Z  2025-03-14T06:39:31.0324045Z  2025-03-14T06:39:31.0325081Z [18,796 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:31.0326180Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T06:39:31.0327058Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T06:39:31.0327903Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2025-03-14T06:39:31.0329104Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T06:39:31.0330085Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local 2025-03-14T06:39:31.0331036Z Compiling llvm/lib/CodeGen/AsmPrinter/CodeViewDebug.cpp; 19s local 2025-03-14T06:39:31.0331875Z @llvm-project//mlir:SCFToControlFlow; 16s local 2025-03-14T06:39:31.0332578Z @llvm-project//llvm:CodeGen; 16s local ... 2025-03-14T06:39:31.2323244Z 2025-03-14T06:39:31.2324144Z  2025-03-14T06:39:31.2324753Z  2025-03-14T06:39:31.2325107Z  2025-03-14T06:39:31.2325773Z  2025-03-14T06:39:31.2326160Z  2025-03-14T06:39:31.2326542Z  2025-03-14T06:39:31.2326926Z  2025-03-14T06:39:31.2327319Z  2025-03-14T06:39:31.2328288Z [18,798 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:31.2329409Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T06:39:31.2330562Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T06:39:31.2331453Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2025-03-14T06:39:31.2332419Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T06:39:31.2333439Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local 2025-03-14T06:39:31.2334288Z @llvm-project//mlir:SCFToControlFlow; 16s local 2025-03-14T06:39:31.2335315Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 16s local 2025-03-14T06:39:31.2336810Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 15s local ... 2025-03-14T06:39:31.6642199Z 2025-03-14T06:39:31.6643024Z  2025-03-14T06:39:31.6643510Z  2025-03-14T06:39:31.6643918Z  2025-03-14T06:39:31.6644326Z  2025-03-14T06:39:31.6644977Z  2025-03-14T06:39:31.6645349Z  2025-03-14T06:39:31.6645778Z  2025-03-14T06:39:31.6646200Z  2025-03-14T06:39:31.6647409Z [18,799 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:31.6648760Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T06:39:31.6649905Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T06:39:31.6650733Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 71s local 2025-03-14T06:39:31.6651629Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T06:39:31.6652607Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local 2025-03-14T06:39:31.6653463Z @llvm-project//mlir:SCFToControlFlow; 17s local 2025-03-14T06:39:31.6654459Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeVectorTypes.cpp; 17s local 2025-03-14T06:39:31.6655653Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 16s local ... 2025-03-14T06:39:32.0255056Z 2025-03-14T06:39:32.0255910Z  2025-03-14T06:39:32.0256388Z  2025-03-14T06:39:32.0256837Z  2025-03-14T06:39:32.0257242Z  2025-03-14T06:39:32.0257665Z  2025-03-14T06:39:32.0258086Z  2025-03-14T06:39:32.0258502Z  2025-03-14T06:39:32.0258879Z  2025-03-14T06:39:32.0259809Z [18,801 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:32.0260895Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T06:39:32.0261971Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T06:39:32.0262979Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T06:39:32.0263980Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T06:39:32.0265014Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T06:39:32.0266246Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 16s local 2025-03-14T06:39:32.0267142Z @llvm-project//mlir:SCFToControlFlow; 16s local 2025-03-14T06:39:32.0268016Z Compiling .../translate/hlo_to_mhlo/custom_call_importer.cc; 16s local ... 2025-03-14T06:39:32.2331125Z 2025-03-14T06:39:32.2332010Z  2025-03-14T06:39:32.2332516Z  2025-03-14T06:39:32.2332900Z  2025-03-14T06:39:32.2333343Z  2025-03-14T06:39:32.2333758Z  2025-03-14T06:39:32.2334161Z  2025-03-14T06:39:32.2334570Z  2025-03-14T06:39:32.2334971Z  2025-03-14T06:39:32.2335939Z [18,803 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:32.2337101Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:39:32.2338279Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T06:39:32.2339233Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T06:39:32.2340261Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T06:39:32.2341329Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T06:39:32.2342352Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 16s local 2025-03-14T06:39:32.2343246Z @llvm-project//mlir:SCFToControlFlow; 16s local 2025-03-14T06:39:32.2344249Z Compiling .../translate/hlo_to_mhlo/custom_call_importer.cc; 16s local ... 2025-03-14T06:39:32.4336062Z 2025-03-14T06:39:32.4336891Z  2025-03-14T06:39:32.4337405Z  2025-03-14T06:39:32.4337826Z  2025-03-14T06:39:32.4338242Z  2025-03-14T06:39:32.4338644Z  2025-03-14T06:39:32.4339369Z  2025-03-14T06:39:32.4339755Z  2025-03-14T06:39:32.4340155Z  2025-03-14T06:39:32.4341104Z [18,804 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:32.4342236Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:39:32.4343191Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T06:39:32.4344083Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T06:39:32.4345284Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T06:39:32.4346293Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T06:39:32.4347255Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 16s local 2025-03-14T06:39:32.4348157Z @llvm-project//mlir:SCFToControlFlow; 16s local 2025-03-14T06:39:32.4349060Z Compiling .../translate/hlo_to_mhlo/custom_call_importer.cc; 16s local ... 2025-03-14T06:39:32.6351510Z 2025-03-14T06:39:32.6352405Z  2025-03-14T06:39:32.6352871Z  2025-03-14T06:39:32.6353298Z  2025-03-14T06:39:32.6353732Z  2025-03-14T06:39:32.6354127Z  2025-03-14T06:39:32.6354526Z  2025-03-14T06:39:32.6354938Z  2025-03-14T06:39:32.6355343Z  2025-03-14T06:39:32.6356278Z [18,805 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:32.6357458Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:39:32.6358538Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T06:39:32.6359499Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 72s local 2025-03-14T06:39:32.6360536Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T06:39:32.6361534Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T06:39:32.6362630Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 17s local 2025-03-14T06:39:32.6363520Z @llvm-project//mlir:SCFToControlFlow; 17s local 2025-03-14T06:39:32.6364562Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 16s local ... 2025-03-14T06:39:32.9491976Z 2025-03-14T06:39:32.9492741Z  2025-03-14T06:39:32.9493181Z  2025-03-14T06:39:32.9493559Z  2025-03-14T06:39:32.9493909Z  2025-03-14T06:39:32.9494261Z  2025-03-14T06:39:32.9494615Z  2025-03-14T06:39:32.9494980Z  2025-03-14T06:39:32.9495328Z  2025-03-14T06:39:32.9496430Z [18,806 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:32.9497483Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:39:32.9498405Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T06:39:32.9499182Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T06:39:32.9500018Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T06:39:32.9500919Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T06:39:32.9501903Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 17s local 2025-03-14T06:39:32.9502660Z @llvm-project//mlir:SCFToControlFlow; 17s local 2025-03-14T06:39:32.9503456Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local ... 2025-03-14T06:39:33.2341903Z 2025-03-14T06:39:33.2342741Z  2025-03-14T06:39:33.2343168Z  2025-03-14T06:39:33.2343568Z  2025-03-14T06:39:33.2343943Z  2025-03-14T06:39:33.2344315Z  2025-03-14T06:39:33.2344683Z  2025-03-14T06:39:33.2345046Z  2025-03-14T06:39:33.2345418Z  2025-03-14T06:39:33.2346287Z [18,807 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:33.2347345Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T06:39:33.2348199Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T06:39:33.2349288Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T06:39:33.2350204Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T06:39:33.2351137Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T06:39:33.2352026Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 17s local 2025-03-14T06:39:33.2352960Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2025-03-14T06:39:33.2354096Z Compiling xla/backends/cpu/runtime/convolution_thunk.cc; 17s local ... 2025-03-14T06:39:33.5216099Z 2025-03-14T06:39:33.5216921Z  2025-03-14T06:39:33.5217315Z  2025-03-14T06:39:33.5217639Z  2025-03-14T06:39:33.5217955Z  2025-03-14T06:39:33.5218267Z  2025-03-14T06:39:33.5218578Z  2025-03-14T06:39:33.5218894Z  2025-03-14T06:39:33.5219208Z  2025-03-14T06:39:33.5219953Z [18,808 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:33.5220833Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T06:39:33.5221568Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T06:39:33.5222262Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 73s local 2025-03-14T06:39:33.5223005Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T06:39:33.5223760Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T06:39:33.5224518Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local 2025-03-14T06:39:33.5225305Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local 2025-03-14T06:39:33.5226018Z Compiling xla/service/llvm_ir/llvm_util.cc; 14s local ... 2025-03-14T06:39:33.8246149Z 2025-03-14T06:39:33.8246972Z  2025-03-14T06:39:33.8247439Z  2025-03-14T06:39:33.8247832Z  2025-03-14T06:39:33.8248232Z  2025-03-14T06:39:33.8248598Z  2025-03-14T06:39:33.8249006Z  2025-03-14T06:39:33.8249388Z  2025-03-14T06:39:33.8249763Z  2025-03-14T06:39:33.8250668Z [18,810 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:33.8251765Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T06:39:33.8252735Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T06:39:33.8253629Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T06:39:33.8254869Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2025-03-14T06:39:33.8255910Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T06:39:33.8256916Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local 2025-03-14T06:39:33.8257952Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2025-03-14T06:39:33.8258884Z Compiling xla/service/llvm_ir/llvm_util.cc; 15s local ... 2025-03-14T06:39:34.0350050Z 2025-03-14T06:39:34.0350900Z  2025-03-14T06:39:34.0351389Z  2025-03-14T06:39:34.0352042Z  2025-03-14T06:39:34.0352467Z  2025-03-14T06:39:34.0352838Z  2025-03-14T06:39:34.0353266Z  2025-03-14T06:39:34.0353638Z  2025-03-14T06:39:34.0354011Z  2025-03-14T06:39:34.0354932Z [18,811 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:34.0355958Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T06:39:34.0356886Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T06:39:34.0357763Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T06:39:34.0358699Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2025-03-14T06:39:34.0359645Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T06:39:34.0360537Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local 2025-03-14T06:39:34.0361738Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2025-03-14T06:39:34.0362672Z Compiling xla/service/llvm_ir/llvm_util.cc; 15s local ... 2025-03-14T06:39:34.3584388Z 2025-03-14T06:39:34.3585176Z  2025-03-14T06:39:34.3585593Z  2025-03-14T06:39:34.3585939Z  2025-03-14T06:39:34.3586307Z  2025-03-14T06:39:34.3586636Z  2025-03-14T06:39:34.3586981Z  2025-03-14T06:39:34.3587345Z  2025-03-14T06:39:34.3587972Z  2025-03-14T06:39:34.3588782Z [18,812 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:34.3589780Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T06:39:34.3590747Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T06:39:34.3591568Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T06:39:34.3592427Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2025-03-14T06:39:34.3593368Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T06:39:34.3594263Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 18s local 2025-03-14T06:39:34.3595313Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2025-03-14T06:39:34.3596129Z Compiling xla/service/llvm_ir/llvm_util.cc; 15s local ... 2025-03-14T06:39:34.6354917Z 2025-03-14T06:39:34.6355785Z  2025-03-14T06:39:34.6356285Z  2025-03-14T06:39:34.6356687Z  2025-03-14T06:39:34.6357070Z  2025-03-14T06:39:34.6357491Z  2025-03-14T06:39:34.6357867Z  2025-03-14T06:39:34.6358275Z  2025-03-14T06:39:34.6358680Z  2025-03-14T06:39:34.6359663Z [18,813 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:34.6360809Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T06:39:34.6361820Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T06:39:34.6362792Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 74s local 2025-03-14T06:39:34.6363757Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T06:39:34.6364948Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T06:39:34.6366154Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local 2025-03-14T06:39:34.6367194Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local 2025-03-14T06:39:34.6368520Z Compiling xla/service/llvm_ir/llvm_util.cc; 16s local ... 2025-03-14T06:39:35.0359216Z 2025-03-14T06:39:35.0360051Z  2025-03-14T06:39:35.0360572Z  2025-03-14T06:39:35.0361005Z  2025-03-14T06:39:35.0361440Z  2025-03-14T06:39:35.0361871Z  2025-03-14T06:39:35.0362323Z  2025-03-14T06:39:35.0362744Z  2025-03-14T06:39:35.0363173Z  2025-03-14T06:39:35.0364173Z [18,814 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:35.0366147Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T06:39:35.0367249Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T06:39:35.0368288Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T06:39:35.0369409Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T06:39:35.0370556Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T06:39:35.0371676Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 19s local 2025-03-14T06:39:35.0372830Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2025-03-14T06:39:35.0373903Z Compiling xla/service/llvm_ir/llvm_util.cc; 16s local ... 2025-03-14T06:39:35.6148701Z 2025-03-14T06:39:35.6149504Z  2025-03-14T06:39:35.6150000Z  2025-03-14T06:39:35.6150423Z  2025-03-14T06:39:35.6150799Z  2025-03-14T06:39:35.6151486Z  2025-03-14T06:39:35.6151882Z  2025-03-14T06:39:35.6152284Z  2025-03-14T06:39:35.6152673Z  2025-03-14T06:39:35.6153629Z [18,815 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:35.6154747Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2025-03-14T06:39:35.6155732Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T06:39:35.6156618Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 75s local 2025-03-14T06:39:35.6157796Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T06:39:35.6158800Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T06:39:35.6159690Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local 2025-03-14T06:39:35.6160673Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local 2025-03-14T06:39:35.6161599Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2025-03-14T06:39:35.8366444Z 2025-03-14T06:39:35.8367247Z  2025-03-14T06:39:35.8367734Z  2025-03-14T06:39:35.8368142Z  2025-03-14T06:39:35.8368539Z  2025-03-14T06:39:35.8368934Z  2025-03-14T06:39:35.8369324Z  2025-03-14T06:39:35.8369735Z  2025-03-14T06:39:35.8370117Z  2025-03-14T06:39:35.8371066Z [18,815 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:35.8372164Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2025-03-14T06:39:35.8373106Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T06:39:35.8373980Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T06:39:35.8375009Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T06:39:35.8376073Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T06:39:35.8377110Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 20s local 2025-03-14T06:39:35.8378212Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2025-03-14T06:39:35.8379248Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2025-03-14T06:39:36.5035637Z 2025-03-14T06:39:36.5036404Z  2025-03-14T06:39:36.5036822Z  2025-03-14T06:39:36.5037174Z  2025-03-14T06:39:36.5037510Z  2025-03-14T06:39:36.5037868Z  2025-03-14T06:39:36.5038208Z  2025-03-14T06:39:36.5038577Z  2025-03-14T06:39:36.5038903Z  2025-03-14T06:39:36.5039973Z [18,816 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:36.5041025Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T06:39:36.5041888Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T06:39:36.5042671Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 76s local 2025-03-14T06:39:36.5043543Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T06:39:36.5044893Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2025-03-14T06:39:36.5045824Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2025-03-14T06:39:36.5046867Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2025-03-14T06:39:36.5047804Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2025-03-14T06:39:36.7501366Z 2025-03-14T06:39:36.7502236Z  2025-03-14T06:39:36.7502777Z  2025-03-14T06:39:36.7503194Z  2025-03-14T06:39:36.7503603Z  2025-03-14T06:39:36.7504010Z  2025-03-14T06:39:36.7504410Z  2025-03-14T06:39:36.7504816Z  2025-03-14T06:39:36.7505213Z  2025-03-14T06:39:36.7506160Z [18,817 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:36.7507218Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T06:39:36.7508137Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T06:39:36.7509258Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T06:39:36.7510181Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2025-03-14T06:39:36.7511141Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2025-03-14T06:39:36.7512037Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2025-03-14T06:39:36.7513073Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local 2025-03-14T06:39:36.7514087Z @llvm-project//llvm:CodeGen; 16s local ... 2025-03-14T06:39:37.0374297Z 2025-03-14T06:39:37.0375110Z  2025-03-14T06:39:37.0375607Z  2025-03-14T06:39:37.0376026Z  2025-03-14T06:39:37.0376452Z  2025-03-14T06:39:37.0376855Z  2025-03-14T06:39:37.0377282Z  2025-03-14T06:39:37.0377709Z  2025-03-14T06:39:37.0378115Z  2025-03-14T06:39:37.0379105Z [18,817 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:37.0380339Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T06:39:37.0381362Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T06:39:37.0382349Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T06:39:37.0383387Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2025-03-14T06:39:37.0384440Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T06:39:37.0385345Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2025-03-14T06:39:37.0386394Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2025-03-14T06:39:37.0387274Z @llvm-project//llvm:CodeGen; 16s local ... 2025-03-14T06:39:37.4378265Z 2025-03-14T06:39:37.4379049Z  2025-03-14T06:39:37.4379489Z  2025-03-14T06:39:37.4379859Z  2025-03-14T06:39:37.4380234Z  2025-03-14T06:39:37.4380627Z  2025-03-14T06:39:37.4380996Z  2025-03-14T06:39:37.4381359Z  2025-03-14T06:39:37.4381729Z  2025-03-14T06:39:37.4382594Z [18,818 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:37.4383572Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2025-03-14T06:39:37.4384502Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T06:39:37.4385403Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T06:39:37.4386580Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2025-03-14T06:39:37.4387633Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T06:39:37.4388668Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 21s local 2025-03-14T06:39:37.4389642Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2025-03-14T06:39:37.4390493Z @llvm-project//llvm:CodeGen; 16s local ... 2025-03-14T06:39:37.6381009Z 2025-03-14T06:39:37.6381825Z  2025-03-14T06:39:37.6382244Z  2025-03-14T06:39:37.6382823Z  2025-03-14T06:39:37.6383177Z  2025-03-14T06:39:37.6383515Z  2025-03-14T06:39:37.6383856Z  2025-03-14T06:39:37.6384197Z  2025-03-14T06:39:37.6384548Z  2025-03-14T06:39:37.6385416Z [18,821 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:37.6386494Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2025-03-14T06:39:37.6387463Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T06:39:37.6388351Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 77s local 2025-03-14T06:39:37.6389165Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2025-03-14T06:39:37.6389994Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T06:39:37.6390789Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2025-03-14T06:39:37.6391956Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local 2025-03-14T06:39:37.6392698Z @llvm-project//llvm:CodeGen; 16s local ... 2025-03-14T06:39:38.0386625Z 2025-03-14T06:39:38.0387448Z  2025-03-14T06:39:38.0388074Z  2025-03-14T06:39:38.0388508Z  2025-03-14T06:39:38.0388933Z  2025-03-14T06:39:38.0389357Z  2025-03-14T06:39:38.0389778Z  2025-03-14T06:39:38.0390187Z  2025-03-14T06:39:38.0390853Z  2025-03-14T06:39:38.0391850Z [18,823 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:38.0393046Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2025-03-14T06:39:38.0394078Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T06:39:38.0395036Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T06:39:38.0396099Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2025-03-14T06:39:38.0397206Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T06:39:38.0398231Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2025-03-14T06:39:38.0399248Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2025-03-14T06:39:38.0400143Z @llvm-project//llvm:CodeGen; 17s local ... 2025-03-14T06:39:38.4390008Z 2025-03-14T06:39:38.4390823Z  2025-03-14T06:39:38.4391254Z  2025-03-14T06:39:38.4391648Z  2025-03-14T06:39:38.4391997Z  2025-03-14T06:39:38.4392368Z  2025-03-14T06:39:38.4392729Z  2025-03-14T06:39:38.4393087Z  2025-03-14T06:39:38.4393426Z  2025-03-14T06:39:38.4394277Z [18,824 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:38.4395262Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T06:39:38.4396104Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T06:39:38.4396927Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 78s local 2025-03-14T06:39:38.4397795Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2025-03-14T06:39:38.4398694Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T06:39:38.4399583Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 22s local 2025-03-14T06:39:38.4400478Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local 2025-03-14T06:39:38.4401298Z @llvm-project//llvm:CodeGen; 17s local ... 2025-03-14T06:39:38.8486543Z 2025-03-14T06:39:38.8487333Z  2025-03-14T06:39:38.8487747Z  2025-03-14T06:39:38.8488087Z  2025-03-14T06:39:38.8488438Z  2025-03-14T06:39:38.8488782Z  2025-03-14T06:39:38.8489116Z  2025-03-14T06:39:38.8489452Z  2025-03-14T06:39:38.8489765Z  2025-03-14T06:39:38.8490555Z [18,825 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:38.8491475Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T06:39:38.8492416Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T06:39:38.8493153Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T06:39:38.8494081Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T06:39:38.8494931Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T06:39:38.8495761Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2025-03-14T06:39:38.8496594Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2025-03-14T06:39:38.8497299Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:39:39.1274134Z 2025-03-14T06:39:39.1274927Z  2025-03-14T06:39:39.1275354Z  2025-03-14T06:39:39.1275710Z  2025-03-14T06:39:39.1276067Z  2025-03-14T06:39:39.1276424Z  2025-03-14T06:39:39.1276774Z  2025-03-14T06:39:39.1277401Z  2025-03-14T06:39:39.1277748Z  2025-03-14T06:39:39.1278598Z [18,827 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:39.1279555Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T06:39:39.1280475Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T06:39:39.1281236Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T06:39:39.1282190Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T06:39:39.1283048Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T06:39:39.1283856Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2025-03-14T06:39:39.1284840Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2025-03-14T06:39:39.1285576Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:39:39.3532443Z 2025-03-14T06:39:39.3533311Z  2025-03-14T06:39:39.3533835Z  2025-03-14T06:39:39.3534277Z  2025-03-14T06:39:39.3534684Z  2025-03-14T06:39:39.3535109Z  2025-03-14T06:39:39.3535533Z  2025-03-14T06:39:39.3535895Z  2025-03-14T06:39:39.3536302Z  2025-03-14T06:39:39.3537271Z [18,828 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:39.3538367Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T06:39:39.3539322Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T06:39:39.3540260Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T06:39:39.3541272Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T06:39:39.3542261Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T06:39:39.3543221Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 23s local 2025-03-14T06:39:39.3544221Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2025-03-14T06:39:39.3545177Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:39:39.6397802Z 2025-03-14T06:39:39.6398610Z  2025-03-14T06:39:39.6399049Z  2025-03-14T06:39:39.6399421Z  2025-03-14T06:39:39.6399782Z  2025-03-14T06:39:39.6400138Z  2025-03-14T06:39:39.6400505Z  2025-03-14T06:39:39.6400866Z  2025-03-14T06:39:39.6401224Z  2025-03-14T06:39:39.6402389Z [18,829 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:39:39.6403441Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T06:39:39.6404316Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T06:39:39.6405268Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 79s local 2025-03-14T06:39:39.6406166Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T06:39:39.6407100Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T06:39:39.6408167Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2025-03-14T06:39:39.6409110Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local 2025-03-14T06:39:39.6409878Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:39:39.8401169Z 2025-03-14T06:39:39.8401998Z  2025-03-14T06:39:39.8402430Z  2025-03-14T06:39:39.8402790Z  2025-03-14T06:39:39.8403146Z  2025-03-14T06:39:39.8403524Z  2025-03-14T06:39:39.8403867Z  2025-03-14T06:39:39.8404213Z  2025-03-14T06:39:39.8404725Z  2025-03-14T06:39:39.8414222Z [18,829 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:39.8415244Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T06:39:39.8416096Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T06:39:39.8416917Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T06:39:39.8418108Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T06:39:39.8419016Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T06:39:39.8419870Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2025-03-14T06:39:39.8420775Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2025-03-14T06:39:39.8421545Z @llvm-project//llvm:CodeGen; 19s local ... 2025-03-14T06:39:40.2405824Z 2025-03-14T06:39:40.2406659Z  2025-03-14T06:39:40.2407128Z  2025-03-14T06:39:40.2407503Z  2025-03-14T06:39:40.2407863Z  2025-03-14T06:39:40.2408229Z  2025-03-14T06:39:40.2408588Z  2025-03-14T06:39:40.2408957Z  2025-03-14T06:39:40.2409326Z  2025-03-14T06:39:40.2410207Z [18,831 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:40.2411183Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T06:39:40.2412047Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T06:39:40.2412948Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T06:39:40.2413874Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T06:39:40.2414766Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 24s local 2025-03-14T06:39:40.2415704Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2025-03-14T06:39:40.2416752Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGISel.cpp; 19s local 2025-03-14T06:39:40.2417780Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 16s local ... 2025-03-14T06:39:40.6005024Z 2025-03-14T06:39:40.6005853Z  2025-03-14T06:39:40.6006262Z  2025-03-14T06:39:40.6006608Z  2025-03-14T06:39:40.6006944Z  2025-03-14T06:39:40.6007288Z  2025-03-14T06:39:40.6007631Z  2025-03-14T06:39:40.6007948Z  2025-03-14T06:39:40.6008307Z  2025-03-14T06:39:40.6009099Z [18,833 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:40.6009953Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T06:39:40.6010753Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 80s local 2025-03-14T06:39:40.6011560Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T06:39:40.6012386Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T06:39:40.6013518Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2025-03-14T06:39:40.6014366Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2025-03-14T06:39:40.6015166Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 16s local 2025-03-14T06:39:40.6015974Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 15s local ... 2025-03-14T06:39:40.8411782Z 2025-03-14T06:39:40.8412787Z  2025-03-14T06:39:40.8413347Z  2025-03-14T06:39:40.8413802Z  2025-03-14T06:39:40.8414246Z  2025-03-14T06:39:40.8414951Z  2025-03-14T06:39:40.8415399Z  2025-03-14T06:39:40.8415836Z  2025-03-14T06:39:40.8416253Z  2025-03-14T06:39:40.8417292Z [18,833 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:40.8418498Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T06:39:40.8419569Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T06:39:40.8420697Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2025-03-14T06:39:40.8421849Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T06:39:40.8423082Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2025-03-14T06:39:40.8424193Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T06:39:40.8425281Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 16s local 2025-03-14T06:39:40.8426526Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 15s local ... 2025-03-14T06:39:41.0475652Z 2025-03-14T06:39:41.0476519Z  2025-03-14T06:39:41.0477017Z  2025-03-14T06:39:41.0477404Z  2025-03-14T06:39:41.0477808Z  2025-03-14T06:39:41.0478216Z  2025-03-14T06:39:41.0478616Z  2025-03-14T06:39:41.0479022Z  2025-03-14T06:39:41.0479410Z  2025-03-14T06:39:41.0480848Z [18,835 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:41.0482016Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T06:39:41.0482940Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T06:39:41.0483959Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2025-03-14T06:39:41.0485167Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T06:39:41.0486166Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2025-03-14T06:39:41.0487225Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T06:39:41.0488257Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local 2025-03-14T06:39:41.0489346Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 15s local ... 2025-03-14T06:39:41.4417101Z 2025-03-14T06:39:41.4417913Z  2025-03-14T06:39:41.4418430Z  2025-03-14T06:39:41.4418863Z  2025-03-14T06:39:41.4419236Z  2025-03-14T06:39:41.4419635Z  2025-03-14T06:39:41.4420028Z  2025-03-14T06:39:41.4420425Z  2025-03-14T06:39:41.4420850Z  2025-03-14T06:39:41.4421806Z [18,835 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:41.4422857Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T06:39:41.4423762Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 81s local 2025-03-14T06:39:41.4424816Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2025-03-14T06:39:41.4425872Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T06:39:41.4426878Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 25s local 2025-03-14T06:39:41.4427921Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T06:39:41.4428933Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local 2025-03-14T06:39:41.4430326Z Compiling xla/backends/cpu/runtime/collective_thunk.cc; 15s local ... 2025-03-14T06:39:41.7046316Z 2025-03-14T06:39:41.7047185Z  2025-03-14T06:39:41.7047646Z  2025-03-14T06:39:41.7048027Z  2025-03-14T06:39:41.7048444Z  2025-03-14T06:39:41.7048843Z  2025-03-14T06:39:41.7049244Z  2025-03-14T06:39:41.7049654Z  2025-03-14T06:39:41.7050062Z  2025-03-14T06:39:41.7051024Z [18,836 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:41.7052375Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T06:39:41.7053264Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T06:39:41.7054290Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T06:39:41.7055286Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T06:39:41.7056255Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T06:39:41.7057269Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T06:39:41.7058234Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local 2025-03-14T06:39:41.7059336Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local ... 2025-03-14T06:39:41.9232241Z 2025-03-14T06:39:41.9233032Z  2025-03-14T06:39:41.9233514Z  2025-03-14T06:39:41.9233910Z  2025-03-14T06:39:41.9234305Z  2025-03-14T06:39:41.9234840Z  2025-03-14T06:39:41.9235575Z  2025-03-14T06:39:41.9235998Z  2025-03-14T06:39:41.9236398Z  2025-03-14T06:39:41.9237364Z [18,839 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:41.9238477Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T06:39:41.9239469Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T06:39:41.9240508Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T06:39:41.9241734Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T06:39:41.9242761Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T06:39:41.9243789Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T06:39:41.9244936Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 17s local 2025-03-14T06:39:41.9246122Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local ... 2025-03-14T06:39:42.2423250Z 2025-03-14T06:39:42.2424081Z  2025-03-14T06:39:42.2424617Z  2025-03-14T06:39:42.2425053Z  2025-03-14T06:39:42.2425470Z  2025-03-14T06:39:42.2425845Z  2025-03-14T06:39:42.2426226Z  2025-03-14T06:39:42.2426604Z  2025-03-14T06:39:42.2426953Z  2025-03-14T06:39:42.2427883Z [18,839 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:42.2428933Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T06:39:42.2429821Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T06:39:42.2430815Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T06:39:42.2431804Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T06:39:42.2432792Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T06:39:42.2433778Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T06:39:42.2434765Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2025-03-14T06:39:42.2435829Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local ... 2025-03-14T06:39:42.4601087Z 2025-03-14T06:39:42.4601936Z  2025-03-14T06:39:42.4602415Z  2025-03-14T06:39:42.4602795Z  2025-03-14T06:39:42.4603190Z  2025-03-14T06:39:42.4603591Z  2025-03-14T06:39:42.4604005Z  2025-03-14T06:39:42.4604417Z  2025-03-14T06:39:42.4604963Z  2025-03-14T06:39:42.4606180Z [18,842 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:42.4607246Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T06:39:42.4608166Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 82s local 2025-03-14T06:39:42.4609088Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T06:39:42.4610106Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 26s local 2025-03-14T06:39:42.4611316Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T06:39:42.4612279Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2025-03-14T06:39:42.4613396Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 16s local 2025-03-14T06:39:42.4614399Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local ... 2025-03-14T06:39:42.8428625Z 2025-03-14T06:39:42.8429491Z  2025-03-14T06:39:42.8429981Z  2025-03-14T06:39:42.8430401Z  2025-03-14T06:39:42.8430821Z  2025-03-14T06:39:42.8431210Z  2025-03-14T06:39:42.8431591Z  2025-03-14T06:39:42.8431997Z  2025-03-14T06:39:42.8432412Z  2025-03-14T06:39:42.8433386Z [18,842 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:42.8434459Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T06:39:42.8435756Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T06:39:42.8436664Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T06:39:42.8437621Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T06:39:42.8438631Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2025-03-14T06:39:42.8439621Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 18s local 2025-03-14T06:39:42.8440629Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2025-03-14T06:39:42.8441927Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 14s local ... 2025-03-14T06:39:43.4718617Z 2025-03-14T06:39:43.4719476Z  2025-03-14T06:39:43.4719953Z  2025-03-14T06:39:43.4720390Z  2025-03-14T06:39:43.4720785Z  2025-03-14T06:39:43.4721168Z  2025-03-14T06:39:43.4721532Z  2025-03-14T06:39:43.4721921Z  2025-03-14T06:39:43.4722316Z  2025-03-14T06:39:43.4723229Z [18,843 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:43.4724351Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T06:39:43.4725363Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 83s local 2025-03-14T06:39:43.4726489Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2025-03-14T06:39:43.4727595Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 27s local 2025-03-14T06:39:43.4728595Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2025-03-14T06:39:43.4729597Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2025-03-14T06:39:43.4730714Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 17s local 2025-03-14T06:39:43.4731800Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local ... 2025-03-14T06:39:43.8091301Z 2025-03-14T06:39:43.8092093Z  2025-03-14T06:39:43.8092569Z  2025-03-14T06:39:43.8093009Z  2025-03-14T06:39:43.8093573Z  2025-03-14T06:39:43.8093964Z  2025-03-14T06:39:43.8094442Z  2025-03-14T06:39:43.8094884Z  2025-03-14T06:39:43.8095386Z  2025-03-14T06:39:43.8096330Z [18,844 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:43.8097394Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T06:39:43.8098458Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T06:39:43.8099653Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2025-03-14T06:39:43.8100793Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T06:39:43.8101802Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T06:39:43.8102819Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 19s local 2025-03-14T06:39:43.8103730Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2025-03-14T06:39:43.8104719Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 15s local ... 2025-03-14T06:39:44.0437522Z 2025-03-14T06:39:44.0438624Z  2025-03-14T06:39:44.0439208Z  2025-03-14T06:39:44.0439599Z  2025-03-14T06:39:44.0440021Z  2025-03-14T06:39:44.0440412Z  2025-03-14T06:39:44.0440837Z  2025-03-14T06:39:44.0441234Z  2025-03-14T06:39:44.0441607Z  2025-03-14T06:39:44.0442578Z [18,845 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:44.0443880Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T06:39:44.0445026Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T06:39:44.0445921Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T06:39:44.0446896Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T06:39:44.0447912Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T06:39:44.0449296Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T06:39:44.0450263Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2025-03-14T06:39:44.0451266Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local ... 2025-03-14T06:39:44.4184576Z 2025-03-14T06:39:44.4185532Z  2025-03-14T06:39:44.4186012Z  2025-03-14T06:39:44.4186411Z  2025-03-14T06:39:44.4186805Z  2025-03-14T06:39:44.4187194Z  2025-03-14T06:39:44.4187851Z  2025-03-14T06:39:44.4188245Z  2025-03-14T06:39:44.4188623Z  2025-03-14T06:39:44.4189540Z [18,846 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:44.4190587Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T06:39:44.4191478Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T06:39:44.4192398Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T06:39:44.4193369Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 28s local 2025-03-14T06:39:44.4194369Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T06:39:44.4195334Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T06:39:44.4196322Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2025-03-14T06:39:44.4197342Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local ... 2025-03-14T06:39:44.6442962Z 2025-03-14T06:39:44.6443768Z  2025-03-14T06:39:44.6444322Z  2025-03-14T06:39:44.6445027Z  2025-03-14T06:39:44.6445538Z  2025-03-14T06:39:44.6445967Z  2025-03-14T06:39:44.6446341Z  2025-03-14T06:39:44.6446703Z  2025-03-14T06:39:44.6447096Z  2025-03-14T06:39:44.6447987Z [18,846 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:44.6449023Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T06:39:44.6450104Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 84s local 2025-03-14T06:39:44.6450993Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T06:39:44.6451955Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T06:39:44.6453060Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T06:39:44.6454024Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T06:39:44.6455454Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local 2025-03-14T06:39:44.6456450Z Compiling xla/backends/cpu/runtime/copy_thunk.cc; 16s local ... 2025-03-14T06:39:44.8729296Z 2025-03-14T06:39:44.8730055Z  2025-03-14T06:39:44.8730461Z  2025-03-14T06:39:44.8730808Z  2025-03-14T06:39:44.8731159Z  2025-03-14T06:39:44.8731505Z  2025-03-14T06:39:44.8731847Z  2025-03-14T06:39:44.8732193Z  2025-03-14T06:39:44.8732543Z  2025-03-14T06:39:44.8733596Z [18,848 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:44.8734518Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T06:39:44.8735311Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T06:39:44.8736116Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T06:39:44.8736955Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T06:39:44.8737851Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T06:39:44.8738719Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 20s local 2025-03-14T06:39:44.8739692Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T06:39:44.8740633Z @llvm-project//llvm:CodeGen; 14s local ... 2025-03-14T06:39:45.2447939Z 2025-03-14T06:39:45.2448772Z  2025-03-14T06:39:45.2449167Z  2025-03-14T06:39:45.2449765Z  2025-03-14T06:39:45.2450084Z  2025-03-14T06:39:45.2450402Z  2025-03-14T06:39:45.2450730Z  2025-03-14T06:39:45.2451047Z  2025-03-14T06:39:45.2451364Z  2025-03-14T06:39:45.2452121Z [18,849 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:45.2452953Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2025-03-14T06:39:45.2453640Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T06:39:45.2454501Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T06:39:45.2455254Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 29s local 2025-03-14T06:39:45.2456032Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T06:39:45.2456787Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T06:39:45.2457563Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T06:39:45.2458268Z @llvm-project//llvm:CodeGen; 14s local ... 2025-03-14T06:39:45.6264466Z 2025-03-14T06:39:45.6265511Z  2025-03-14T06:39:45.6266039Z  2025-03-14T06:39:45.6266456Z  2025-03-14T06:39:45.6266878Z  2025-03-14T06:39:45.6267301Z  2025-03-14T06:39:45.6267724Z  2025-03-14T06:39:45.6268131Z  2025-03-14T06:39:45.6268556Z  2025-03-14T06:39:45.6269473Z [18,850 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:45.6270705Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2025-03-14T06:39:45.6271687Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 85s local 2025-03-14T06:39:45.6272673Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T06:39:45.6273733Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T06:39:45.6274842Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T06:39:45.6275914Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T06:39:45.6277168Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T06:39:45.6278264Z @llvm-project//llvm:CodeGen; 15s local ... 2025-03-14T06:39:45.8453744Z 2025-03-14T06:39:45.8454569Z  2025-03-14T06:39:45.8455019Z  2025-03-14T06:39:45.8455400Z  2025-03-14T06:39:45.8455807Z  2025-03-14T06:39:45.8456229Z  2025-03-14T06:39:45.8456650Z  2025-03-14T06:39:45.8457008Z  2025-03-14T06:39:45.8457367Z  2025-03-14T06:39:45.8458439Z [18,850 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:45.8459417Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2025-03-14T06:39:45.8460302Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T06:39:45.8461180Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T06:39:45.8462184Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T06:39:45.8463365Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T06:39:45.8464346Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 21s local 2025-03-14T06:39:45.8465585Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T06:39:45.8466430Z @llvm-project//llvm:CodeGen; 15s local ... 2025-03-14T06:39:46.1908041Z 2025-03-14T06:39:46.1908893Z  2025-03-14T06:39:46.1909310Z  2025-03-14T06:39:46.1909713Z  2025-03-14T06:39:46.1910094Z  2025-03-14T06:39:46.1910469Z  2025-03-14T06:39:46.1910844Z  2025-03-14T06:39:46.1911235Z  2025-03-14T06:39:46.1911629Z  2025-03-14T06:39:46.1912544Z [18,852 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:46.1913721Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T06:39:46.1914896Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T06:39:46.1915856Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T06:39:46.1916808Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T06:39:46.1917800Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T06:39:46.1918754Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2025-03-14T06:39:46.1920077Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T06:39:46.1920945Z @llvm-project//llvm:CodeGen; 15s local ... 2025-03-14T06:39:46.4458593Z 2025-03-14T06:39:46.4459436Z  2025-03-14T06:39:46.4459940Z  2025-03-14T06:39:46.4460358Z  2025-03-14T06:39:46.4460730Z  2025-03-14T06:39:46.4461116Z  2025-03-14T06:39:46.4461490Z  2025-03-14T06:39:46.4461880Z  2025-03-14T06:39:46.4462271Z  2025-03-14T06:39:46.4463220Z [18,852 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:46.4464283Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T06:39:46.4465256Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 86s local 2025-03-14T06:39:46.4466388Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T06:39:46.4467307Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 30s local 2025-03-14T06:39:46.4468303Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T06:39:46.4469251Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 22s local 2025-03-14T06:39:46.4470213Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T06:39:46.4471086Z @llvm-project//llvm:CodeGen; 15s local ... 2025-03-14T06:39:47.2606598Z 2025-03-14T06:39:47.2607502Z  2025-03-14T06:39:47.2607946Z  2025-03-14T06:39:47.2608334Z  2025-03-14T06:39:47.2608705Z  2025-03-14T06:39:47.2609111Z  2025-03-14T06:39:47.2609493Z  2025-03-14T06:39:47.2609876Z  2025-03-14T06:39:47.2610255Z  2025-03-14T06:39:47.2611154Z [18,853 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:47.2612191Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T06:39:47.2613051Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2025-03-14T06:39:47.2613968Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2025-03-14T06:39:47.2615063Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 31s local 2025-03-14T06:39:47.2615918Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2025-03-14T06:39:47.2616775Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T06:39:47.2617644Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2025-03-14T06:39:47.2618378Z @llvm-project//llvm:CodeGen; 16s local ... 2025-03-14T06:39:47.5348387Z 2025-03-14T06:39:47.5349235Z  2025-03-14T06:39:47.5349709Z  2025-03-14T06:39:47.5350403Z  2025-03-14T06:39:47.5350806Z  2025-03-14T06:39:47.5351237Z  2025-03-14T06:39:47.5351636Z  2025-03-14T06:39:47.5352031Z  2025-03-14T06:39:47.5352444Z  2025-03-14T06:39:47.5353391Z [18,854 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:47.5354499Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T06:39:47.5355483Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 87s local 2025-03-14T06:39:47.5356409Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2025-03-14T06:39:47.5357444Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T06:39:47.5358514Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2025-03-14T06:39:47.5359564Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T06:39:47.5360831Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2025-03-14T06:39:47.5361764Z @llvm-project//llvm:CodeGen; 17s local ... 2025-03-14T06:39:47.8098656Z 2025-03-14T06:39:47.8099567Z  2025-03-14T06:39:47.8100031Z  2025-03-14T06:39:47.8100401Z  2025-03-14T06:39:47.8100816Z  2025-03-14T06:39:47.8101183Z  2025-03-14T06:39:47.8101537Z  2025-03-14T06:39:47.8101898Z  2025-03-14T06:39:47.8102566Z  2025-03-14T06:39:47.8103435Z [18,855 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:47.8104393Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T06:39:47.8105211Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T06:39:47.8106021Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2025-03-14T06:39:47.8106847Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T06:39:47.8107725Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T06:39:47.8108546Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 23s local 2025-03-14T06:39:47.8109377Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T06:39:47.8110141Z @llvm-project//llvm:CodeGen; 17s local ... 2025-03-14T06:39:48.0469456Z 2025-03-14T06:39:48.0470228Z  2025-03-14T06:39:48.0470660Z  2025-03-14T06:39:48.0471039Z  2025-03-14T06:39:48.0471395Z  2025-03-14T06:39:48.0471760Z  2025-03-14T06:39:48.0472115Z  2025-03-14T06:39:48.0472460Z  2025-03-14T06:39:48.0472788Z  2025-03-14T06:39:48.0473629Z [18,855 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:48.0474573Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T06:39:48.0475370Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T06:39:48.0476195Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T06:39:48.0477058Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T06:39:48.0477928Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T06:39:48.0478736Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T06:39:48.0479563Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T06:39:48.0480294Z @llvm-project//llvm:CodeGen; 17s local ... 2025-03-14T06:39:48.2473966Z 2025-03-14T06:39:48.2474914Z  2025-03-14T06:39:48.2475445Z  2025-03-14T06:39:48.2475889Z  2025-03-14T06:39:48.2476314Z  2025-03-14T06:39:48.2476734Z  2025-03-14T06:39:48.2477171Z  2025-03-14T06:39:48.2477612Z  2025-03-14T06:39:48.2478058Z  2025-03-14T06:39:48.2479030Z [18,857 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:48.2480487Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T06:39:48.2481409Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T06:39:48.2482386Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T06:39:48.2483347Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T06:39:48.2484390Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T06:39:48.2485554Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T06:39:48.2486578Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T06:39:48.2487459Z @llvm-project//llvm:CodeGen; 17s local ... 2025-03-14T06:39:48.4947609Z 2025-03-14T06:39:48.4948443Z  2025-03-14T06:39:48.4948904Z  2025-03-14T06:39:48.4949279Z  2025-03-14T06:39:48.4949643Z  2025-03-14T06:39:48.4950011Z  2025-03-14T06:39:48.4950678Z  2025-03-14T06:39:48.4951044Z  2025-03-14T06:39:48.4951423Z  2025-03-14T06:39:48.4952313Z [18,860 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:48.4953305Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T06:39:48.4954150Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 88s local 2025-03-14T06:39:48.4955016Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T06:39:48.4956107Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 32s local 2025-03-14T06:39:48.4957060Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T06:39:48.4957993Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T06:39:48.4958939Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T06:39:48.4959774Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:39:48.7379136Z 2025-03-14T06:39:48.7379977Z  2025-03-14T06:39:48.7380430Z  2025-03-14T06:39:48.7380822Z  2025-03-14T06:39:48.7381221Z  2025-03-14T06:39:48.7381596Z  2025-03-14T06:39:48.7381978Z  2025-03-14T06:39:48.7382331Z  2025-03-14T06:39:48.7382699Z  2025-03-14T06:39:48.7383580Z [18,862 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:48.7384555Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T06:39:48.7385431Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T06:39:48.7386304Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T06:39:48.7387205Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2025-03-14T06:39:48.7388149Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T06:39:48.7389083Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 24s local 2025-03-14T06:39:48.7390047Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T06:39:48.7390919Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:39:49.0479352Z 2025-03-14T06:39:49.0480211Z  2025-03-14T06:39:49.0480659Z  2025-03-14T06:39:49.0481038Z  2025-03-14T06:39:49.0481384Z  2025-03-14T06:39:49.0481744Z  2025-03-14T06:39:49.0482101Z  2025-03-14T06:39:49.0482490Z  2025-03-14T06:39:49.0482864Z  2025-03-14T06:39:49.0484041Z [18,862 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:49.0485184Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T06:39:49.0486035Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T06:39:49.0486880Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T06:39:49.0487799Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2025-03-14T06:39:49.0488739Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2025-03-14T06:39:49.0489819Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T06:39:49.0490745Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T06:39:49.0491559Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:39:49.2482354Z 2025-03-14T06:39:49.2483147Z  2025-03-14T06:39:49.2483572Z  2025-03-14T06:39:49.2483923Z  2025-03-14T06:39:49.2484301Z  2025-03-14T06:39:49.2484757Z  2025-03-14T06:39:49.2485106Z  2025-03-14T06:39:49.2485458Z  2025-03-14T06:39:49.2485804Z  2025-03-14T06:39:49.2486636Z [18,864 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:49.2487534Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2025-03-14T06:39:49.2488313Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T06:39:49.2489108Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T06:39:49.2490282Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 33s local 2025-03-14T06:39:49.2491149Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2025-03-14T06:39:49.2491985Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T06:39:49.2492850Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T06:39:49.2493617Z @llvm-project//llvm:CodeGen; 18s local ... 2025-03-14T06:39:49.5865837Z 2025-03-14T06:39:49.5866788Z  2025-03-14T06:39:49.5867225Z  2025-03-14T06:39:49.5867617Z  2025-03-14T06:39:49.5867984Z  2025-03-14T06:39:49.5868331Z  2025-03-14T06:39:49.5868695Z  2025-03-14T06:39:49.5869046Z  2025-03-14T06:39:49.5869431Z  2025-03-14T06:39:49.5870284Z [18,865 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:49.5871247Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2025-03-14T06:39:49.5872088Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 89s local 2025-03-14T06:39:49.5872930Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T06:39:49.5873791Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T06:39:49.5874836Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2025-03-14T06:39:49.5875768Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T06:39:49.5876729Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T06:39:49.5877538Z @llvm-project//llvm:CodeGen; 19s local ... 2025-03-14T06:39:49.8487462Z 2025-03-14T06:39:49.8488243Z  2025-03-14T06:39:49.8488653Z  2025-03-14T06:39:49.8488996Z  2025-03-14T06:39:49.8489332Z  2025-03-14T06:39:49.8489659Z  2025-03-14T06:39:49.8489990Z  2025-03-14T06:39:49.8490326Z  2025-03-14T06:39:49.8490676Z  2025-03-14T06:39:49.8491481Z [18,865 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:49.8492346Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2025-03-14T06:39:49.8493074Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T06:39:49.8493821Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T06:39:49.8494616Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T06:39:49.8495670Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T06:39:49.8496479Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 25s local 2025-03-14T06:39:49.8497280Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2025-03-14T06:39:49.8497991Z @llvm-project//llvm:CodeGen; 19s local ... 2025-03-14T06:39:50.2492039Z 2025-03-14T06:39:50.2492889Z  2025-03-14T06:39:50.2493396Z  2025-03-14T06:39:50.2493866Z  2025-03-14T06:39:50.2494271Z  2025-03-14T06:39:50.2494652Z  2025-03-14T06:39:50.2495274Z  2025-03-14T06:39:50.2495694Z  2025-03-14T06:39:50.2496089Z  2025-03-14T06:39:50.2497053Z [18,866 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:50.2498130Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T06:39:50.2499056Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T06:39:50.2500028Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2025-03-14T06:39:50.2501031Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 34s local 2025-03-14T06:39:50.2502085Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T06:39:50.2503105Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T06:39:50.2504143Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2025-03-14T06:39:50.2505255Z @llvm-project//llvm:CodeGen; 19s local ... 2025-03-14T06:39:50.6496183Z 2025-03-14T06:39:50.6497052Z  2025-03-14T06:39:50.6497574Z  2025-03-14T06:39:50.6498003Z  2025-03-14T06:39:50.6498424Z  2025-03-14T06:39:50.6498822Z  2025-03-14T06:39:50.6499216Z  2025-03-14T06:39:50.6499622Z  2025-03-14T06:39:50.6499990Z  2025-03-14T06:39:50.6500985Z [18,868 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:50.6502449Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T06:39:50.6503389Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 90s local 2025-03-14T06:39:50.6504347Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2025-03-14T06:39:50.6505400Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T06:39:50.6506442Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T06:39:50.6507459Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T06:39:50.6508469Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2025-03-14T06:39:50.6509371Z @llvm-project//llvm:CodeGen; 20s local ... 2025-03-14T06:39:50.9077395Z 2025-03-14T06:39:50.9078204Z  2025-03-14T06:39:50.9078757Z  2025-03-14T06:39:50.9079162Z  2025-03-14T06:39:50.9079574Z  2025-03-14T06:39:50.9080000Z  2025-03-14T06:39:50.9080438Z  2025-03-14T06:39:50.9080841Z  2025-03-14T06:39:50.9081249Z  2025-03-14T06:39:50.9082264Z [18,869 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:50.9083420Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T06:39:50.9084361Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2025-03-14T06:39:50.9085445Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2025-03-14T06:39:50.9086395Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T06:39:50.9087463Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T06:39:50.9088500Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 26s local 2025-03-14T06:39:50.9089512Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2025-03-14T06:39:50.9090434Z @llvm-project//llvm:CodeGen; 20s local ... 2025-03-14T06:39:51.2500839Z 2025-03-14T06:39:51.2501696Z  2025-03-14T06:39:51.2502242Z  2025-03-14T06:39:51.2502909Z  2025-03-14T06:39:51.2503369Z  2025-03-14T06:39:51.2503797Z  2025-03-14T06:39:51.2504182Z  2025-03-14T06:39:51.2504571Z  2025-03-14T06:39:51.2504994Z  2025-03-14T06:39:51.2505951Z [18,870 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:51.2506992Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2025-03-14T06:39:51.2507912Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 91s local 2025-03-14T06:39:51.2509007Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T06:39:51.2510008Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 35s local 2025-03-14T06:39:51.2511079Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T06:39:51.2512035Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T06:39:51.2513057Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2025-03-14T06:39:51.2513935Z @llvm-project//llvm:CodeGen; 20s local ... 2025-03-14T06:39:51.7166513Z 2025-03-14T06:39:51.7167292Z  2025-03-14T06:39:51.7167787Z  2025-03-14T06:39:51.7168202Z  2025-03-14T06:39:51.7168587Z  2025-03-14T06:39:51.7168970Z  2025-03-14T06:39:51.7169385Z  2025-03-14T06:39:51.7169773Z  2025-03-14T06:39:51.7170162Z  2025-03-14T06:39:51.7171213Z [18,871 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:51.7172777Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T06:39:51.7173769Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T06:39:51.7174825Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T06:39:51.7175824Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T06:39:51.7177028Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 27s local 2025-03-14T06:39:51.7178151Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T06:39:51.7179440Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2025-03-14T06:39:51.7180648Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 18s local ... 2025-03-14T06:39:52.0507691Z 2025-03-14T06:39:52.0508514Z  2025-03-14T06:39:52.0509098Z  2025-03-14T06:39:52.0509526Z  2025-03-14T06:39:52.0509926Z  2025-03-14T06:39:52.0510387Z  2025-03-14T06:39:52.0510794Z  2025-03-14T06:39:52.0511203Z  2025-03-14T06:39:52.0511599Z  2025-03-14T06:39:52.0512553Z [18,872 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:52.0513680Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T06:39:52.0514620Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T06:39:52.0515736Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T06:39:52.0516772Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T06:39:52.0517830Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T06:39:52.0518833Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T06:39:52.0520008Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2025-03-14T06:39:52.0521200Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 19s local ... 2025-03-14T06:39:52.4510843Z 2025-03-14T06:39:52.4511717Z  2025-03-14T06:39:52.4512201Z  2025-03-14T06:39:52.4512610Z  2025-03-14T06:39:52.4513018Z  2025-03-14T06:39:52.4513397Z  2025-03-14T06:39:52.4513777Z  2025-03-14T06:39:52.4514155Z  2025-03-14T06:39:52.4514561Z  2025-03-14T06:39:52.4515516Z [18,873 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:52.4516943Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 92s local 2025-03-14T06:39:52.4517894Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T06:39:52.4518806Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 36s local 2025-03-14T06:39:52.4519793Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T06:39:52.4520812Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 28s local 2025-03-14T06:39:52.4522093Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T06:39:52.4523328Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 21s local 2025-03-14T06:39:52.4524713Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 19s local ... 2025-03-14T06:39:53.0994851Z 2025-03-14T06:39:53.0995641Z  2025-03-14T06:39:53.0996124Z  2025-03-14T06:39:53.0996554Z  2025-03-14T06:39:53.0997082Z  2025-03-14T06:39:53.0997506Z  2025-03-14T06:39:53.0997915Z  2025-03-14T06:39:53.0998302Z  2025-03-14T06:39:53.0998736Z  2025-03-14T06:39:53.0999683Z [18,874 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:53.1000751Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2025-03-14T06:39:53.1001716Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T06:39:53.1002691Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T06:39:53.1004044Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T06:39:53.1005176Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2025-03-14T06:39:53.1006185Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T06:39:53.1007401Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2025-03-14T06:39:53.1008526Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local ... 2025-03-14T06:39:53.3934120Z 2025-03-14T06:39:53.3934974Z  2025-03-14T06:39:53.3935467Z  2025-03-14T06:39:53.3935981Z  2025-03-14T06:39:53.3936445Z  2025-03-14T06:39:53.3936858Z  2025-03-14T06:39:53.3937260Z  2025-03-14T06:39:53.3937655Z  2025-03-14T06:39:53.3938041Z  2025-03-14T06:39:53.3939000Z [18,876 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:53.3940106Z Compiling xla/backends/cpu/runtime/sort_thunk.cc; 93s local 2025-03-14T06:39:53.3941062Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T06:39:53.3942078Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 37s local 2025-03-14T06:39:53.3943097Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T06:39:53.3944241Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2025-03-14T06:39:53.3945294Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T06:39:53.3946474Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 22s local 2025-03-14T06:39:53.3947635Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local ... 2025-03-14T06:39:53.6017114Z 2025-03-14T06:39:53.6096957Z  2025-03-14T06:39:53.6097767Z  2025-03-14T06:39:53.6098167Z  2025-03-14T06:39:53.6098563Z  2025-03-14T06:39:53.6098950Z  2025-03-14T06:39:53.6099346Z  2025-03-14T06:39:53.6099664Z  2025-03-14T06:39:53.6100046Z  2025-03-14T06:39:53.6100987Z [18,878 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:53.6102098Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T06:39:53.6103093Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2025-03-14T06:39:53.6104114Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T06:39:53.6105429Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2025-03-14T06:39:53.6106428Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T06:39:53.6107547Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2025-03-14T06:39:53.6108592Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2025-03-14T06:39:53.6109541Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 17s local ... 2025-03-14T06:39:53.8518103Z 2025-03-14T06:39:53.8518944Z  2025-03-14T06:39:53.8519423Z  2025-03-14T06:39:53.8520045Z  2025-03-14T06:39:53.8520450Z  2025-03-14T06:39:53.8520840Z  2025-03-14T06:39:53.8530072Z  2025-03-14T06:39:53.8530752Z  2025-03-14T06:39:53.8531152Z  2025-03-14T06:39:53.8532081Z [18,878 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:53.8533162Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T06:39:53.8534121Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2025-03-14T06:39:53.8535098Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T06:39:53.8536058Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 29s local 2025-03-14T06:39:53.8537035Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2025-03-14T06:39:53.8538168Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2025-03-14T06:39:53.8539529Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 20s local 2025-03-14T06:39:53.8540474Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local ... 2025-03-14T06:39:54.0586079Z 2025-03-14T06:39:54.0586889Z  2025-03-14T06:39:54.0587293Z  2025-03-14T06:39:54.0587623Z  2025-03-14T06:39:54.0587957Z  2025-03-14T06:39:54.0588351Z  2025-03-14T06:39:54.0588731Z  2025-03-14T06:39:54.0589375Z  2025-03-14T06:39:54.0589692Z  2025-03-14T06:39:54.0590487Z [18,879 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:54.0591481Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2025-03-14T06:39:54.0592265Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2025-03-14T06:39:54.0593252Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T06:39:54.0594158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T06:39:54.0595015Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2025-03-14T06:39:54.0596075Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2025-03-14T06:39:54.0596997Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2025-03-14T06:39:54.0597990Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local ... 2025-03-14T06:39:54.4523217Z 2025-03-14T06:39:54.4524051Z  2025-03-14T06:39:54.4524469Z  2025-03-14T06:39:54.4524966Z  2025-03-14T06:39:54.4525308Z  2025-03-14T06:39:54.4525645Z  2025-03-14T06:39:54.4526021Z  2025-03-14T06:39:54.4526344Z  2025-03-14T06:39:54.4526701Z  2025-03-14T06:39:54.4527523Z [18,879 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:54.4528443Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2025-03-14T06:39:54.4529291Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 38s local 2025-03-14T06:39:54.4530158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T06:39:54.4531024Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T06:39:54.4531939Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2025-03-14T06:39:54.4532913Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 23s local 2025-03-14T06:39:54.4534136Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2025-03-14T06:39:54.4534961Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 18s local ... 2025-03-14T06:39:54.8531240Z 2025-03-14T06:39:54.8532164Z  2025-03-14T06:39:54.8532676Z  2025-03-14T06:39:54.8533082Z  2025-03-14T06:39:54.8533612Z  2025-03-14T06:39:54.8534005Z  2025-03-14T06:39:54.8534358Z  2025-03-14T06:39:54.8534745Z  2025-03-14T06:39:54.8535163Z  2025-03-14T06:39:54.8536361Z [18,881 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:54.8537479Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2025-03-14T06:39:54.8538448Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2025-03-14T06:39:54.8539477Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T06:39:54.8540551Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 30s local 2025-03-14T06:39:54.8541586Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2025-03-14T06:39:54.8542712Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2025-03-14T06:39:54.8543839Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 21s local 2025-03-14T06:39:54.8544809Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local ... 2025-03-14T06:39:55.2831735Z 2025-03-14T06:39:55.2832626Z  2025-03-14T06:39:55.2833433Z  2025-03-14T06:39:55.2833830Z  2025-03-14T06:39:55.2834228Z  2025-03-14T06:39:55.2834622Z  2025-03-14T06:39:55.2835034Z  2025-03-14T06:39:55.2835432Z  2025-03-14T06:39:55.2835836Z  2025-03-14T06:39:55.2836787Z [18,882 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:55.2837892Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T06:39:55.2839082Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 39s local 2025-03-14T06:39:55.2840082Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T06:39:55.2841106Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2025-03-14T06:39:55.2842168Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2025-03-14T06:39:55.2843458Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 24s local 2025-03-14T06:39:55.2844846Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2025-03-14T06:39:55.2845904Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 19s local ... 2025-03-14T06:39:55.6298160Z 2025-03-14T06:39:55.6299006Z  2025-03-14T06:39:55.6299483Z  2025-03-14T06:39:55.6299879Z  2025-03-14T06:39:55.6300280Z  2025-03-14T06:39:55.6300672Z  2025-03-14T06:39:55.6301056Z  2025-03-14T06:39:55.6301437Z  2025-03-14T06:39:55.6301821Z  2025-03-14T06:39:55.6302790Z [18,885 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:55.6304016Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T06:39:55.6305136Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T06:39:55.6306398Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T06:39:55.6307635Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2025-03-14T06:39:55.6308706Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2025-03-14T06:39:55.6309804Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2025-03-14T06:39:55.6310733Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2025-03-14T06:39:55.6311472Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 17s local ... 2025-03-14T06:39:55.8538260Z 2025-03-14T06:39:55.8539129Z  2025-03-14T06:39:55.8539746Z  2025-03-14T06:39:55.8540267Z  2025-03-14T06:39:55.8540675Z  2025-03-14T06:39:55.8541313Z  2025-03-14T06:39:55.8541753Z  2025-03-14T06:39:55.8542168Z  2025-03-14T06:39:55.8542582Z  2025-03-14T06:39:55.8543559Z [18,885 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:55.8544688Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T06:39:55.8545716Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T06:39:55.8546809Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T06:39:55.8548004Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 31s local 2025-03-14T06:39:55.8549216Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2025-03-14T06:39:55.8550362Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 22s local 2025-03-14T06:39:55.8551223Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2025-03-14T06:39:55.8552214Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local ... 2025-03-14T06:39:56.0668928Z 2025-03-14T06:39:56.0669839Z  2025-03-14T06:39:56.0670274Z  2025-03-14T06:39:56.0670651Z  2025-03-14T06:39:56.0671042Z  2025-03-14T06:39:56.0671410Z  2025-03-14T06:39:56.0671757Z  2025-03-14T06:39:56.0672114Z  2025-03-14T06:39:56.0672478Z  2025-03-14T06:39:56.0673377Z [18,886 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:56.0674651Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T06:39:56.0675775Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T06:39:56.0676747Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T06:39:56.0677833Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T06:39:56.0679100Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2025-03-14T06:39:56.0680612Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2025-03-14T06:39:56.0681609Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2025-03-14T06:39:56.0682527Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local ... 2025-03-14T06:39:56.4544336Z 2025-03-14T06:39:56.4545196Z  2025-03-14T06:39:56.4545679Z  2025-03-14T06:39:56.4546065Z  2025-03-14T06:39:56.4546439Z  2025-03-14T06:39:56.4546859Z  2025-03-14T06:39:56.4547268Z  2025-03-14T06:39:56.4547660Z  2025-03-14T06:39:56.4548090Z  2025-03-14T06:39:56.4549151Z [18,887 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:56.4550301Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T06:39:56.4551254Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 40s local 2025-03-14T06:39:56.4552294Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T06:39:56.4553277Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T06:39:56.4554366Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 25s local 2025-03-14T06:39:56.4555447Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2025-03-14T06:39:56.4556402Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 20s local 2025-03-14T06:39:56.4557308Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 18s local ... 2025-03-14T06:39:56.7013029Z 2025-03-14T06:39:56.7013912Z  2025-03-14T06:39:56.7014429Z  2025-03-14T06:39:56.7014795Z  2025-03-14T06:39:56.7015230Z  2025-03-14T06:39:56.7015621Z  2025-03-14T06:39:56.7015997Z  2025-03-14T06:39:56.7016404Z  2025-03-14T06:39:56.7016779Z  2025-03-14T06:39:56.7017743Z [18,888 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:56.7019193Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T06:39:56.7020445Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2025-03-14T06:39:56.7021738Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T06:39:56.7022788Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 32s local 2025-03-14T06:39:56.7023751Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2025-03-14T06:39:56.7024874Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local 2025-03-14T06:39:56.7026033Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2025-03-14T06:39:56.7027089Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local ... 2025-03-14T06:39:57.0549637Z 2025-03-14T06:39:57.0550466Z  2025-03-14T06:39:57.0550962Z  2025-03-14T06:39:57.0551383Z  2025-03-14T06:39:57.0551770Z  2025-03-14T06:39:57.0552138Z  2025-03-14T06:39:57.0552532Z  2025-03-14T06:39:57.0552890Z  2025-03-14T06:39:57.0553247Z  2025-03-14T06:39:57.0554112Z [18,890 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:57.0555153Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T06:39:57.0556053Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2025-03-14T06:39:57.0557096Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T06:39:57.0558369Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T06:39:57.0559431Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2025-03-14T06:39:57.0560504Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T06:39:57.0561441Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2025-03-14T06:39:57.0562413Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local ... 2025-03-14T06:39:57.2552937Z 2025-03-14T06:39:57.2553782Z  2025-03-14T06:39:57.2554300Z  2025-03-14T06:39:57.2554692Z  2025-03-14T06:39:57.2555085Z  2025-03-14T06:39:57.2555475Z  2025-03-14T06:39:57.2555863Z  2025-03-14T06:39:57.2556237Z  2025-03-14T06:39:57.2556651Z  2025-03-14T06:39:57.2557624Z [18,891 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:57.2558742Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T06:39:57.2559765Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 41s local 2025-03-14T06:39:57.2560831Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T06:39:57.2561798Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T06:39:57.2562932Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 26s local 2025-03-14T06:39:57.2564047Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T06:39:57.2565203Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2025-03-14T06:39:57.2566445Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local ... 2025-03-14T06:39:57.5387757Z 2025-03-14T06:39:57.5388613Z  2025-03-14T06:39:57.5389102Z  2025-03-14T06:39:57.5389518Z  2025-03-14T06:39:57.5389897Z  2025-03-14T06:39:57.5390293Z  2025-03-14T06:39:57.5390685Z  2025-03-14T06:39:57.5391065Z  2025-03-14T06:39:57.5391508Z  2025-03-14T06:39:57.5392448Z [18,892 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:57.5393558Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T06:39:57.5394516Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:39:57.5395551Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T06:39:57.5396556Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T06:39:57.5397995Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2025-03-14T06:39:57.5399137Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T06:39:57.5400086Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local 2025-03-14T06:39:57.5401086Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 19s local ... 2025-03-14T06:39:57.7520167Z 2025-03-14T06:39:57.7521016Z  2025-03-14T06:39:57.7521504Z  2025-03-14T06:39:57.7521911Z  2025-03-14T06:39:57.7522825Z  2025-03-14T06:39:57.7523269Z  2025-03-14T06:39:57.7523654Z  2025-03-14T06:39:57.7524037Z  2025-03-14T06:39:57.7524414Z  2025-03-14T06:39:57.7525511Z [18,894 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:57.7526578Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T06:39:57.7527616Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:39:57.7528610Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T06:39:57.7529602Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 33s local 2025-03-14T06:39:57.7530685Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2025-03-14T06:39:57.7531807Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T06:39:57.7532993Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2025-03-14T06:39:57.7533993Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local ... 2025-03-14T06:39:58.0258815Z 2025-03-14T06:39:58.0259672Z  2025-03-14T06:39:58.0260155Z  2025-03-14T06:39:58.0260544Z  2025-03-14T06:39:58.0260930Z  2025-03-14T06:39:58.0261305Z  2025-03-14T06:39:58.0261694Z  2025-03-14T06:39:58.0262099Z  2025-03-14T06:39:58.0262777Z  2025-03-14T06:39:58.0263745Z [18,896 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:58.0264763Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T06:39:58.0265968Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:39:58.0266948Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T06:39:58.0267867Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2025-03-14T06:39:58.0268923Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2025-03-14T06:39:58.0270017Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local 2025-03-14T06:39:58.0270905Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2025-03-14T06:39:58.0271854Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local ... 2025-03-14T06:39:58.2560098Z 2025-03-14T06:39:58.2560913Z  2025-03-14T06:39:58.2561360Z  2025-03-14T06:39:58.2561685Z  2025-03-14T06:39:58.2562033Z  2025-03-14T06:39:58.2562367Z  2025-03-14T06:39:58.2562705Z  2025-03-14T06:39:58.2563055Z  2025-03-14T06:39:58.2563409Z  2025-03-14T06:39:58.2564248Z [18,896 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:58.2565541Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T06:39:58.2566376Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:39:58.2567296Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T06:39:58.2568212Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2025-03-14T06:39:58.2569213Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2025-03-14T06:39:58.2570234Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2025-03-14T06:39:58.2571095Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2025-03-14T06:39:58.2572339Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local ... 2025-03-14T06:39:58.4563924Z 2025-03-14T06:39:58.4564921Z  2025-03-14T06:39:58.4565635Z  2025-03-14T06:39:58.4566052Z  2025-03-14T06:39:58.4566441Z  2025-03-14T06:39:58.4566827Z  2025-03-14T06:39:58.4567215Z  2025-03-14T06:39:58.4567578Z  2025-03-14T06:39:58.4567971Z  2025-03-14T06:39:58.4568895Z [18,897 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:58.4570240Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T06:39:58.4571228Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 42s local 2025-03-14T06:39:58.4572207Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T06:39:58.4573190Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2025-03-14T06:39:58.4574274Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 27s local 2025-03-14T06:39:58.4575353Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2025-03-14T06:39:58.4576284Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local 2025-03-14T06:39:58.4577287Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 20s local ... 2025-03-14T06:39:58.8955617Z 2025-03-14T06:39:58.8956433Z  2025-03-14T06:39:58.8956936Z  2025-03-14T06:39:58.8957330Z  2025-03-14T06:39:58.8958081Z  2025-03-14T06:39:58.8958462Z  2025-03-14T06:39:58.8958844Z  2025-03-14T06:39:58.8959252Z  2025-03-14T06:39:58.8959638Z  2025-03-14T06:39:58.8960534Z [18,898 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:58.8961609Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T06:39:58.8962506Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T06:39:58.8963732Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T06:39:58.8964847Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 34s local 2025-03-14T06:39:58.8966077Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2025-03-14T06:39:58.8967135Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local 2025-03-14T06:39:58.8968044Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2025-03-14T06:39:58.8969025Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local ... 2025-03-14T06:39:59.1600427Z 2025-03-14T06:39:59.1601272Z  2025-03-14T06:39:59.1601772Z  2025-03-14T06:39:59.1602202Z  2025-03-14T06:39:59.1602627Z  2025-03-14T06:39:59.1603046Z  2025-03-14T06:39:59.1603466Z  2025-03-14T06:39:59.1603894Z  2025-03-14T06:39:59.1604323Z  2025-03-14T06:39:59.1605459Z [18,899 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:59.1606639Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T06:39:59.1607708Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T06:39:59.1608819Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T06:39:59.1609889Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2025-03-14T06:39:59.1611334Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2025-03-14T06:39:59.1612562Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2025-03-14T06:39:59.1613586Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2025-03-14T06:39:59.1614689Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local ... 2025-03-14T06:39:59.4571591Z 2025-03-14T06:39:59.4572543Z  2025-03-14T06:39:59.4573022Z  2025-03-14T06:39:59.4573430Z  2025-03-14T06:39:59.4573891Z  2025-03-14T06:39:59.4574409Z  2025-03-14T06:39:59.4574860Z  2025-03-14T06:39:59.4575548Z  2025-03-14T06:39:59.4575986Z  2025-03-14T06:39:59.4576876Z [18,901 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:39:59.4577967Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T06:39:59.4578973Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 43s local 2025-03-14T06:39:59.4580141Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T06:39:59.4581297Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2025-03-14T06:39:59.4582515Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 28s local 2025-03-14T06:39:59.4583731Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2025-03-14T06:39:59.4584813Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local 2025-03-14T06:39:59.4585911Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 21s local ... 2025-03-14T06:39:59.7468492Z 2025-03-14T06:39:59.7469385Z  2025-03-14T06:39:59.7469893Z  2025-03-14T06:39:59.7470300Z  2025-03-14T06:39:59.7470701Z  2025-03-14T06:39:59.7471109Z  2025-03-14T06:39:59.7471485Z  2025-03-14T06:39:59.7471850Z  2025-03-14T06:39:59.7472205Z  2025-03-14T06:39:59.7473035Z [18,902 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:39:59.7474397Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T06:39:59.7475562Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T06:39:59.7476632Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T06:39:59.7477700Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 35s local 2025-03-14T06:39:59.7478835Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2025-03-14T06:39:59.7480167Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local 2025-03-14T06:39:59.7481213Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2025-03-14T06:39:59.7482291Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local ... 2025-03-14T06:40:00.0577286Z 2025-03-14T06:40:00.0578172Z  2025-03-14T06:40:00.0578656Z  2025-03-14T06:40:00.0579050Z  2025-03-14T06:40:00.0579447Z  2025-03-14T06:40:00.0579858Z  2025-03-14T06:40:00.0580250Z  2025-03-14T06:40:00.0580670Z  2025-03-14T06:40:00.0581030Z  2025-03-14T06:40:00.0581944Z [18,902 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:00.0582957Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T06:40:00.0583892Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 44s local 2025-03-14T06:40:00.0584922Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2025-03-14T06:40:00.0585914Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T06:40:00.0587000Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 29s local 2025-03-14T06:40:00.0588125Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2025-03-14T06:40:00.0589076Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2025-03-14T06:40:00.0590095Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local ... 2025-03-14T06:40:00.5176379Z 2025-03-14T06:40:00.5177277Z  2025-03-14T06:40:00.5177765Z  2025-03-14T06:40:00.5178172Z  2025-03-14T06:40:00.5178626Z  2025-03-14T06:40:00.5179143Z  2025-03-14T06:40:00.5179586Z  2025-03-14T06:40:00.5180015Z  2025-03-14T06:40:00.5180457Z  2025-03-14T06:40:00.5181440Z [18,903 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:00.5182596Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T06:40:00.5183929Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2025-03-14T06:40:00.5185054Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2025-03-14T06:40:00.5186166Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T06:40:00.5187376Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2025-03-14T06:40:00.5188579Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2025-03-14T06:40:00.5189623Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local 2025-03-14T06:40:00.5190871Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 22s local ... 2025-03-14T06:40:00.8582668Z 2025-03-14T06:40:00.8583532Z  2025-03-14T06:40:00.8583975Z  2025-03-14T06:40:00.8584341Z  2025-03-14T06:40:00.8584711Z  2025-03-14T06:40:00.8585073Z  2025-03-14T06:40:00.8585428Z  2025-03-14T06:40:00.8585760Z  2025-03-14T06:40:00.8586152Z  2025-03-14T06:40:00.8587064Z [18,904 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:00.8588101Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T06:40:00.8589097Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2025-03-14T06:40:00.8590121Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T06:40:00.8591098Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 36s local 2025-03-14T06:40:00.8592562Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2025-03-14T06:40:00.8593636Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local 2025-03-14T06:40:00.8594479Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T06:40:00.8595419Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local ... 2025-03-14T06:40:01.2586876Z 2025-03-14T06:40:01.2587972Z  2025-03-14T06:40:01.2588481Z  2025-03-14T06:40:01.2588919Z  2025-03-14T06:40:01.2589339Z  2025-03-14T06:40:01.2589766Z  2025-03-14T06:40:01.2590180Z  2025-03-14T06:40:01.2590592Z  2025-03-14T06:40:01.2591003Z  2025-03-14T06:40:01.2591976Z [18,905 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:01.2593136Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2025-03-14T06:40:01.2594278Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 45s local 2025-03-14T06:40:01.2595467Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T06:40:01.2596458Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T06:40:01.2597567Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 30s local 2025-03-14T06:40:01.2598709Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2025-03-14T06:40:01.2599698Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T06:40:01.2600927Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local ... 2025-03-14T06:40:01.6259218Z 2025-03-14T06:40:01.6260059Z  2025-03-14T06:40:01.6260536Z  2025-03-14T06:40:01.6260912Z  2025-03-14T06:40:01.6261280Z  2025-03-14T06:40:01.6261655Z  2025-03-14T06:40:01.6262029Z  2025-03-14T06:40:01.6262402Z  2025-03-14T06:40:01.6262792Z  2025-03-14T06:40:01.6263720Z [18,906 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:01.6264808Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2025-03-14T06:40:01.6265887Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T06:40:01.6266743Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T06:40:01.6267577Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T06:40:01.6268786Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2025-03-14T06:40:01.6269699Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2025-03-14T06:40:01.6270474Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T06:40:01.6271398Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 23s local ... 2025-03-14T06:40:01.8591992Z 2025-03-14T06:40:01.8592890Z  2025-03-14T06:40:01.8593371Z  2025-03-14T06:40:01.8593810Z  2025-03-14T06:40:01.8594232Z  2025-03-14T06:40:01.8594653Z  2025-03-14T06:40:01.8595271Z  2025-03-14T06:40:01.8595685Z  2025-03-14T06:40:01.8596105Z  2025-03-14T06:40:01.8597099Z [18,907 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:01.8598250Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2025-03-14T06:40:01.8599289Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T06:40:01.8600361Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T06:40:01.8601384Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 37s local 2025-03-14T06:40:01.8602486Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2025-03-14T06:40:01.8603654Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local 2025-03-14T06:40:01.8604797Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T06:40:01.8605940Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local ... 2025-03-14T06:40:02.2596255Z 2025-03-14T06:40:02.2597117Z  2025-03-14T06:40:02.2597540Z  2025-03-14T06:40:02.2597905Z  2025-03-14T06:40:02.2598261Z  2025-03-14T06:40:02.2598605Z  2025-03-14T06:40:02.2598937Z  2025-03-14T06:40:02.2599286Z  2025-03-14T06:40:02.2599761Z  2025-03-14T06:40:02.2600607Z [18,909 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:02.2601879Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 59s local 2025-03-14T06:40:02.2602772Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 46s local 2025-03-14T06:40:02.2603677Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T06:40:02.2604722Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T06:40:02.2605698Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 31s local 2025-03-14T06:40:02.2606688Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local 2025-03-14T06:40:02.2607526Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T06:40:02.2608466Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local ... 2025-03-14T06:40:02.5422417Z 2025-03-14T06:40:02.5423212Z  2025-03-14T06:40:02.5423621Z  2025-03-14T06:40:02.5423963Z  2025-03-14T06:40:02.5424338Z  2025-03-14T06:40:02.5424672Z  2025-03-14T06:40:02.5425007Z  2025-03-14T06:40:02.5425345Z  2025-03-14T06:40:02.5425679Z  2025-03-14T06:40:02.5426491Z [18,912 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:02.5427394Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2025-03-14T06:40:02.5428247Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T06:40:02.5429072Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T06:40:02.5429989Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2025-03-14T06:40:02.5430897Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local 2025-03-14T06:40:02.5431680Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T06:40:02.5432482Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 24s local 2025-03-14T06:40:02.5433300Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 23s local ... 2025-03-14T06:40:02.8603070Z 2025-03-14T06:40:02.8603950Z  2025-03-14T06:40:02.8604424Z  2025-03-14T06:40:02.8604961Z  2025-03-14T06:40:02.8605363Z  2025-03-14T06:40:02.8605782Z  2025-03-14T06:40:02.8606167Z  2025-03-14T06:40:02.8606549Z  2025-03-14T06:40:02.8606919Z  2025-03-14T06:40:02.8607825Z [18,913 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:02.8608949Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2025-03-14T06:40:02.8610182Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T06:40:02.8611218Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 38s local 2025-03-14T06:40:02.8612364Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2025-03-14T06:40:02.8613476Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local 2025-03-14T06:40:02.8614469Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T06:40:02.8615386Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T06:40:02.8616389Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 23s local ... 2025-03-14T06:40:03.2751552Z 2025-03-14T06:40:03.2752415Z  2025-03-14T06:40:03.2752955Z  2025-03-14T06:40:03.2753380Z  2025-03-14T06:40:03.2753788Z  2025-03-14T06:40:03.2754180Z  2025-03-14T06:40:03.2754861Z  2025-03-14T06:40:03.2755260Z  2025-03-14T06:40:03.2755688Z  2025-03-14T06:40:03.2756680Z [18,914 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:03.2757769Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 47s local 2025-03-14T06:40:03.2758873Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T06:40:03.2759844Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T06:40:03.2761209Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 32s local 2025-03-14T06:40:03.2762381Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T06:40:03.2763377Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T06:40:03.2764398Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T06:40:03.2765794Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 24s local ... 2025-03-14T06:40:03.5710839Z 2025-03-14T06:40:03.5711720Z  2025-03-14T06:40:03.5712250Z  2025-03-14T06:40:03.5712684Z  2025-03-14T06:40:03.5713083Z  2025-03-14T06:40:03.5713510Z  2025-03-14T06:40:03.5713908Z  2025-03-14T06:40:03.5714296Z  2025-03-14T06:40:03.5714738Z  2025-03-14T06:40:03.5715673Z [18,917 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:03.5716781Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T06:40:03.5717866Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T06:40:03.5718871Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T06:40:03.5719976Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2025-03-14T06:40:03.5721146Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T06:40:03.5722127Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T06:40:03.5723175Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 25s local 2025-03-14T06:40:03.5724225Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 24s local ... 2025-03-14T06:40:03.8527299Z 2025-03-14T06:40:03.8528111Z  2025-03-14T06:40:03.8528605Z  2025-03-14T06:40:03.8529006Z  2025-03-14T06:40:03.8529384Z  2025-03-14T06:40:03.8529763Z  2025-03-14T06:40:03.8530128Z  2025-03-14T06:40:03.8530535Z  2025-03-14T06:40:03.8530936Z  2025-03-14T06:40:03.8532169Z [18,918 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:03.8533282Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T06:40:03.8534243Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2025-03-14T06:40:03.8535207Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 39s local 2025-03-14T06:40:03.8536271Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2025-03-14T06:40:03.8537561Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T06:40:03.8538522Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T06:40:03.8539509Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T06:40:03.8540641Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 24s local ... 2025-03-14T06:40:04.0610105Z 2025-03-14T06:40:04.0610988Z  2025-03-14T06:40:04.0611521Z  2025-03-14T06:40:04.0612059Z  2025-03-14T06:40:04.0612559Z  2025-03-14T06:40:04.0612956Z  2025-03-14T06:40:04.0613376Z  2025-03-14T06:40:04.0613862Z  2025-03-14T06:40:04.0614290Z  2025-03-14T06:40:04.0615205Z [18,919 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:04.0616471Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T06:40:04.0617896Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2025-03-14T06:40:04.0618935Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T06:40:04.0620060Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2025-03-14T06:40:04.0621225Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T06:40:04.0622232Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T06:40:04.0623491Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T06:40:04.0624531Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 25s local ... 2025-03-14T06:40:04.2613266Z 2025-03-14T06:40:04.2614151Z  2025-03-14T06:40:04.2614676Z  2025-03-14T06:40:04.2615083Z  2025-03-14T06:40:04.2615482Z  2025-03-14T06:40:04.2615875Z  2025-03-14T06:40:04.2616271Z  2025-03-14T06:40:04.2616682Z  2025-03-14T06:40:04.2617081Z  2025-03-14T06:40:04.2618083Z [18,920 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:04.2619134Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 48s local 2025-03-14T06:40:04.2620177Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2025-03-14T06:40:04.2621088Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T06:40:04.2622142Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 33s local 2025-03-14T06:40:04.2623272Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T06:40:04.2624349Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T06:40:04.2625329Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T06:40:04.2626384Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 25s local ... 2025-03-14T06:40:04.6580262Z 2025-03-14T06:40:04.6581577Z  2025-03-14T06:40:04.6582354Z  2025-03-14T06:40:04.6583007Z  2025-03-14T06:40:04.6584118Z  2025-03-14T06:40:04.6584608Z  2025-03-14T06:40:04.6585022Z  2025-03-14T06:40:04.6585449Z  2025-03-14T06:40:04.6585867Z  2025-03-14T06:40:04.6586920Z [18,921 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:04.6588068Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2025-03-14T06:40:04.6589191Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2025-03-14T06:40:04.6590455Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T06:40:04.6591654Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2025-03-14T06:40:04.6592841Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T06:40:04.6593799Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T06:40:04.6594819Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 26s local 2025-03-14T06:40:04.6596056Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 25s local ... 2025-03-14T06:40:04.8614288Z 2025-03-14T06:40:04.8615184Z  2025-03-14T06:40:04.8615702Z  2025-03-14T06:40:04.8616138Z  2025-03-14T06:40:04.8616613Z  2025-03-14T06:40:04.8617101Z  2025-03-14T06:40:04.8617507Z  2025-03-14T06:40:04.8617907Z  2025-03-14T06:40:04.8618388Z  2025-03-14T06:40:04.8619454Z [18,921 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:04.8620633Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2025-03-14T06:40:04.8621767Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T06:40:04.8622792Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 40s local 2025-03-14T06:40:04.8623984Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2025-03-14T06:40:04.8625383Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T06:40:04.8626410Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T06:40:04.8627923Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2025-03-14T06:40:04.8628947Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 25s local ... 2025-03-14T06:40:05.1885444Z 2025-03-14T06:40:05.1886311Z  2025-03-14T06:40:05.1886822Z  2025-03-14T06:40:05.1887522Z  2025-03-14T06:40:05.1887927Z  2025-03-14T06:40:05.1888347Z  2025-03-14T06:40:05.1888769Z  2025-03-14T06:40:05.1889179Z  2025-03-14T06:40:05.1889574Z  2025-03-14T06:40:05.1890648Z [18,923 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:05.1891815Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2025-03-14T06:40:05.1892900Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T06:40:05.1893919Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2025-03-14T06:40:05.1895009Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2025-03-14T06:40:05.1896165Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T06:40:05.1897138Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T06:40:05.1898659Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2025-03-14T06:40:05.1899823Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 26s local ... 2025-03-14T06:40:05.4619270Z 2025-03-14T06:40:05.4620163Z  2025-03-14T06:40:05.4620660Z  2025-03-14T06:40:05.4621096Z  2025-03-14T06:40:05.4621526Z  2025-03-14T06:40:05.4621941Z  2025-03-14T06:40:05.4622359Z  2025-03-14T06:40:05.4622783Z  2025-03-14T06:40:05.4623191Z  2025-03-14T06:40:05.4624288Z [18,923 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:05.4625449Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 49s local 2025-03-14T06:40:05.4626474Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T06:40:05.4627533Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2025-03-14T06:40:05.4628703Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 34s local 2025-03-14T06:40:05.4629887Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T06:40:05.4631172Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T06:40:05.4632254Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 27s local 2025-03-14T06:40:05.4633306Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 26s local ... 2025-03-14T06:40:05.7456041Z 2025-03-14T06:40:05.7456908Z  2025-03-14T06:40:05.7457404Z  2025-03-14T06:40:05.7459502Z  2025-03-14T06:40:05.7462226Z  2025-03-14T06:40:05.7464975Z  2025-03-14T06:40:05.7467955Z  2025-03-14T06:40:05.7468699Z  2025-03-14T06:40:05.7469950Z  2025-03-14T06:40:05.7471023Z [18,925 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:05.7472192Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T06:40:05.7473329Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T06:40:05.7474253Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 41s local 2025-03-14T06:40:05.7475343Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2025-03-14T06:40:05.7476444Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T06:40:05.7477391Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T06:40:05.7478384Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T06:40:05.7479391Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 26s local ... 2025-03-14T06:40:05.9638820Z 2025-03-14T06:40:05.9639695Z  2025-03-14T06:40:05.9640221Z  2025-03-14T06:40:05.9640665Z  2025-03-14T06:40:05.9641086Z  2025-03-14T06:40:05.9641476Z  2025-03-14T06:40:05.9641884Z  2025-03-14T06:40:05.9642305Z  2025-03-14T06:40:05.9642713Z  2025-03-14T06:40:05.9643633Z [18,927 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:05.9645259Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T06:40:05.9646282Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T06:40:05.9647288Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T06:40:05.9648466Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAGBuilder.cpp; 35s local 2025-03-14T06:40:05.9649559Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T06:40:05.9650528Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T06:40:05.9651592Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T06:40:05.9652603Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 26s local ... 2025-03-14T06:40:06.2208990Z 2025-03-14T06:40:06.2209828Z  2025-03-14T06:40:06.2210313Z  2025-03-14T06:40:06.2210723Z  2025-03-14T06:40:06.2211107Z  2025-03-14T06:40:06.2211487Z  2025-03-14T06:40:06.2211899Z  2025-03-14T06:40:06.2212293Z  2025-03-14T06:40:06.2212690Z  2025-03-14T06:40:06.2213635Z [18,929 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:06.2214751Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T06:40:06.2215758Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T06:40:06.2216674Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T06:40:06.2217648Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T06:40:06.2218547Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T06:40:06.2219482Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T06:40:06.2220425Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2025-03-14T06:40:06.2221346Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local ... 2025-03-14T06:40:06.4626427Z 2025-03-14T06:40:06.4627425Z  2025-03-14T06:40:06.4628175Z  2025-03-14T06:40:06.4628525Z  2025-03-14T06:40:06.4629069Z  2025-03-14T06:40:06.4629735Z  2025-03-14T06:40:06.4630243Z  2025-03-14T06:40:06.4630777Z  2025-03-14T06:40:06.4631295Z  2025-03-14T06:40:06.4632381Z [18,929 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:06.4633704Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 50s local 2025-03-14T06:40:06.4635144Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T06:40:06.4636341Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 42s local 2025-03-14T06:40:06.4637487Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T06:40:06.4638577Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T06:40:06.4639734Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 28s local 2025-03-14T06:40:06.4641030Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2025-03-14T06:40:06.4642192Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local ... 2025-03-14T06:40:07.0094300Z 2025-03-14T06:40:07.0095127Z  2025-03-14T06:40:07.0095610Z  2025-03-14T06:40:07.0097926Z  2025-03-14T06:40:07.0100899Z  2025-03-14T06:40:07.0113114Z  2025-03-14T06:40:07.0114346Z  2025-03-14T06:40:07.0115193Z  2025-03-14T06:40:07.0116066Z  2025-03-14T06:40:07.0116976Z [18,930 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:07.0118081Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2025-03-14T06:40:07.0119125Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T06:40:07.0120148Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2025-03-14T06:40:07.0121129Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T06:40:07.0122208Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T06:40:07.0123200Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T06:40:07.0124268Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2025-03-14T06:40:07.0125403Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local ... 2025-03-14T06:40:07.2634148Z 2025-03-14T06:40:07.2634988Z  2025-03-14T06:40:07.2635551Z  2025-03-14T06:40:07.2635985Z  2025-03-14T06:40:07.2636391Z  2025-03-14T06:40:07.2636838Z  2025-03-14T06:40:07.2637265Z  2025-03-14T06:40:07.2637684Z  2025-03-14T06:40:07.2638113Z  2025-03-14T06:40:07.2639084Z [18,931 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:07.2640277Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 51s local 2025-03-14T06:40:07.2641396Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T06:40:07.2642502Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2025-03-14T06:40:07.2643499Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T06:40:07.2644761Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T06:40:07.2645821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T06:40:07.2646906Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2025-03-14T06:40:07.2647992Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local ... 2025-03-14T06:40:07.5408878Z 2025-03-14T06:40:07.5409772Z  2025-03-14T06:40:07.5410255Z  2025-03-14T06:40:07.5410673Z  2025-03-14T06:40:07.5411054Z  2025-03-14T06:40:07.5411420Z  2025-03-14T06:40:07.5411789Z  2025-03-14T06:40:07.5412213Z  2025-03-14T06:40:07.5412623Z  2025-03-14T06:40:07.5413941Z [18,932 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:07.5415045Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T06:40:07.5416040Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T06:40:07.5417021Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2025-03-14T06:40:07.5417942Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T06:40:07.5419414Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T06:40:07.5420776Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 29s local 2025-03-14T06:40:07.5421966Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2025-03-14T06:40:07.5423118Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local ... 2025-03-14T06:40:07.8592697Z 2025-03-14T06:40:07.8593641Z  2025-03-14T06:40:07.8594135Z  2025-03-14T06:40:07.8594588Z  2025-03-14T06:40:07.8594960Z  2025-03-14T06:40:07.8595277Z  2025-03-14T06:40:07.8595622Z  2025-03-14T06:40:07.8596041Z  2025-03-14T06:40:07.8596416Z  2025-03-14T06:40:07.8597353Z [18,934 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:07.8598247Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T06:40:07.8599196Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T06:40:07.8600516Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 43s local 2025-03-14T06:40:07.8601475Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T06:40:07.8602414Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T06:40:07.8603386Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T06:40:07.8604400Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2025-03-14T06:40:07.8605796Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local ... 2025-03-14T06:40:08.0641779Z 2025-03-14T06:40:08.0642576Z  2025-03-14T06:40:08.0642987Z  2025-03-14T06:40:08.0643375Z  2025-03-14T06:40:08.0643755Z  2025-03-14T06:40:08.0644130Z  2025-03-14T06:40:08.0644503Z  2025-03-14T06:40:08.0645005Z  2025-03-14T06:40:08.0645375Z  2025-03-14T06:40:08.0646234Z [18,935 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:08.0647256Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T06:40:08.0648215Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T06:40:08.0649182Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2025-03-14T06:40:08.0650137Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T06:40:08.0651035Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T06:40:08.0652034Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T06:40:08.0653120Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2025-03-14T06:40:08.0654087Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local ... 2025-03-14T06:40:08.4643075Z 2025-03-14T06:40:08.4643865Z  2025-03-14T06:40:08.4644303Z  2025-03-14T06:40:08.4645064Z  2025-03-14T06:40:08.4645458Z  2025-03-14T06:40:08.4645955Z  2025-03-14T06:40:08.4646410Z  2025-03-14T06:40:08.4646857Z  2025-03-14T06:40:08.4647294Z  2025-03-14T06:40:08.4648210Z [18,939 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:08.4649288Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 52s local 2025-03-14T06:40:08.4650290Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T06:40:08.4651293Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 44s local 2025-03-14T06:40:08.4652506Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T06:40:08.4653450Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T06:40:08.4654427Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 30s local 2025-03-14T06:40:08.4655461Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2025-03-14T06:40:08.4656480Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 19s local ... 2025-03-14T06:40:09.3674708Z 2025-03-14T06:40:09.3675648Z  2025-03-14T06:40:09.3676416Z  2025-03-14T06:40:09.3676873Z  2025-03-14T06:40:09.3677277Z  2025-03-14T06:40:09.3677638Z  2025-03-14T06:40:09.3677997Z  2025-03-14T06:40:09.3678399Z  2025-03-14T06:40:09.3678904Z  2025-03-14T06:40:09.3680005Z [18,940 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:09.3681055Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 53s local 2025-03-14T06:40:09.3682821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T06:40:09.3683899Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2025-03-14T06:40:09.3684906Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T06:40:09.3685898Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2025-03-14T06:40:09.3686987Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2025-03-14T06:40:09.3688277Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2025-03-14T06:40:09.3689350Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 20s local ... 2025-03-14T06:40:09.6027809Z 2025-03-14T06:40:09.6028799Z  2025-03-14T06:40:09.6029317Z  2025-03-14T06:40:09.6029717Z  2025-03-14T06:40:09.6030106Z  2025-03-14T06:40:09.6030500Z  2025-03-14T06:40:09.6030880Z  2025-03-14T06:40:09.6031567Z  2025-03-14T06:40:09.6031964Z  2025-03-14T06:40:09.6032933Z [18,942 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:09.6033893Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T06:40:09.6034891Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T06:40:09.6035892Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2025-03-14T06:40:09.6036826Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T06:40:09.6037761Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2025-03-14T06:40:09.6038868Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 31s local 2025-03-14T06:40:09.6039914Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2025-03-14T06:40:09.6040930Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2025-03-14T06:40:09.8654319Z 2025-03-14T06:40:09.8655258Z  2025-03-14T06:40:09.8655773Z  2025-03-14T06:40:09.8656222Z  2025-03-14T06:40:09.8656613Z  2025-03-14T06:40:09.8656987Z  2025-03-14T06:40:09.8657380Z  2025-03-14T06:40:09.8657783Z  2025-03-14T06:40:09.8658187Z  2025-03-14T06:40:09.8659099Z [18,942 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:09.8660170Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T06:40:09.8661220Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T06:40:09.8662254Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 45s local 2025-03-14T06:40:09.8663233Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T06:40:09.8664231Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T06:40:09.8665213Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T06:40:09.8666717Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2025-03-14T06:40:09.8667743Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2025-03-14T06:40:10.2659370Z 2025-03-14T06:40:10.2660202Z  2025-03-14T06:40:10.2660700Z  2025-03-14T06:40:10.2661139Z  2025-03-14T06:40:10.2661545Z  2025-03-14T06:40:10.2661955Z  2025-03-14T06:40:10.2662348Z  2025-03-14T06:40:10.2662745Z  2025-03-14T06:40:10.2663137Z  2025-03-14T06:40:10.2664399Z [18,943 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:10.2665843Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T06:40:10.2666856Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T06:40:10.2667992Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T06:40:10.2668887Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T06:40:10.2669855Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T06:40:10.2670838Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T06:40:10.2671925Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T06:40:10.2672934Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2025-03-14T06:40:10.4661684Z 2025-03-14T06:40:10.4662645Z  2025-03-14T06:40:10.4663525Z  2025-03-14T06:40:10.4663929Z  2025-03-14T06:40:10.4664330Z  2025-03-14T06:40:10.4664720Z  2025-03-14T06:40:10.4665131Z  2025-03-14T06:40:10.4665758Z  2025-03-14T06:40:10.4666203Z  2025-03-14T06:40:10.4667157Z [18,944 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:10.4668249Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 54s local 2025-03-14T06:40:10.4669563Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T06:40:10.4670790Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T06:40:10.4671794Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T06:40:10.4672789Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T06:40:10.4673879Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 32s local 2025-03-14T06:40:10.4674985Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T06:40:10.4676050Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 21s local ... 2025-03-14T06:40:10.9206862Z 2025-03-14T06:40:10.9207759Z  2025-03-14T06:40:10.9208333Z  2025-03-14T06:40:10.9208744Z  2025-03-14T06:40:10.9209122Z  2025-03-14T06:40:10.9209518Z  2025-03-14T06:40:10.9209898Z  2025-03-14T06:40:10.9210232Z  2025-03-14T06:40:10.9210616Z  2025-03-14T06:40:10.9211573Z [18,945 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:10.9212804Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T06:40:10.9213865Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T06:40:10.9214861Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 46s local 2025-03-14T06:40:10.9215852Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T06:40:10.9216817Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T06:40:10.9217829Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2025-03-14T06:40:10.9218864Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T06:40:10.9219956Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2025-03-14T06:40:11.1980932Z 2025-03-14T06:40:11.1981771Z  2025-03-14T06:40:11.1982268Z  2025-03-14T06:40:11.1982659Z  2025-03-14T06:40:11.1983086Z  2025-03-14T06:40:11.1983506Z  2025-03-14T06:40:11.1984191Z  2025-03-14T06:40:11.1984640Z  2025-03-14T06:40:11.1985055Z  2025-03-14T06:40:11.1986006Z [18,947 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:11.1987160Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T06:40:11.1988119Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T06:40:11.1989145Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T06:40:11.1990272Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T06:40:11.1991204Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T06:40:11.1992199Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2025-03-14T06:40:11.1993283Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2025-03-14T06:40:11.1994351Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2025-03-14T06:40:11.4256296Z 2025-03-14T06:40:11.4257125Z  2025-03-14T06:40:11.4257620Z  2025-03-14T06:40:11.4258003Z  2025-03-14T06:40:11.4258407Z  2025-03-14T06:40:11.4258792Z  2025-03-14T06:40:11.4259183Z  2025-03-14T06:40:11.4259574Z  2025-03-14T06:40:11.4259987Z  2025-03-14T06:40:11.4260927Z [18,948 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:11.4262412Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 55s local 2025-03-14T06:40:11.4263476Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T06:40:11.4264421Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T06:40:11.4265778Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T06:40:11.4266814Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T06:40:11.4267991Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2025-03-14T06:40:11.4269005Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2025-03-14T06:40:11.4270015Z Compiling .../hlo_to_mhlo/hlo_function_importer.cc; 22s local ... 2025-03-14T06:40:11.6498897Z 2025-03-14T06:40:11.6499821Z  2025-03-14T06:40:11.6500571Z  2025-03-14T06:40:11.6501147Z  2025-03-14T06:40:11.6501672Z  2025-03-14T06:40:11.6502197Z  2025-03-14T06:40:11.6502762Z  2025-03-14T06:40:11.6503292Z  2025-03-14T06:40:11.6503843Z  2025-03-14T06:40:11.6504904Z [18,952 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:11.6506113Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T06:40:11.6507248Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T06:40:11.6508371Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T06:40:11.6509514Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T06:40:11.6510598Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T06:40:11.6511835Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 33s local 2025-03-14T06:40:11.6513038Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2025-03-14T06:40:11.6514122Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local ... 2025-03-14T06:40:11.8671069Z 2025-03-14T06:40:11.8671865Z  2025-03-14T06:40:11.8672367Z  2025-03-14T06:40:11.8672824Z  2025-03-14T06:40:11.8673229Z  2025-03-14T06:40:11.8673647Z  2025-03-14T06:40:11.8674078Z  2025-03-14T06:40:11.8674474Z  2025-03-14T06:40:11.8674863Z  2025-03-14T06:40:11.8675771Z [18,952 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:11.8676909Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T06:40:11.8677996Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T06:40:11.8678969Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 47s local 2025-03-14T06:40:11.8679839Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T06:40:11.8680882Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T06:40:11.8681910Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T06:40:11.8683210Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2025-03-14T06:40:11.8684168Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local ... 2025-03-14T06:40:12.3574130Z 2025-03-14T06:40:12.3574988Z  2025-03-14T06:40:12.3575466Z  2025-03-14T06:40:12.3575880Z  2025-03-14T06:40:12.3576294Z  2025-03-14T06:40:12.3576704Z  2025-03-14T06:40:12.3577118Z  2025-03-14T06:40:12.3577534Z  2025-03-14T06:40:12.3577925Z  2025-03-14T06:40:12.3578833Z [18,953 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:12.3579934Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 56s local 2025-03-14T06:40:12.3580989Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T06:40:12.3581983Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T06:40:12.3582985Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T06:40:12.3584273Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T06:40:12.3585265Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T06:40:12.3586316Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 23s local 2025-03-14T06:40:12.3587314Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 22s local ... 2025-03-14T06:40:12.6420570Z 2025-03-14T06:40:12.6421760Z  2025-03-14T06:40:12.6422240Z  2025-03-14T06:40:12.6422662Z  2025-03-14T06:40:12.6423074Z  2025-03-14T06:40:12.6423468Z  2025-03-14T06:40:12.6423878Z  2025-03-14T06:40:12.6424281Z  2025-03-14T06:40:12.6424691Z  2025-03-14T06:40:12.6425641Z [18,955 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:12.6426807Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T06:40:12.6427888Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T06:40:12.6428953Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T06:40:12.6429955Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T06:40:12.6430931Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2025-03-14T06:40:12.6431946Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 34s local 2025-03-14T06:40:12.6433049Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2025-03-14T06:40:12.6434093Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local ... 2025-03-14T06:40:12.8679164Z 2025-03-14T06:40:12.8680048Z  2025-03-14T06:40:12.8680570Z  2025-03-14T06:40:12.8681015Z  2025-03-14T06:40:12.8681414Z  2025-03-14T06:40:12.8681818Z  2025-03-14T06:40:12.8682180Z  2025-03-14T06:40:12.8682558Z  2025-03-14T06:40:12.8682966Z  2025-03-14T06:40:12.8683884Z [18,955 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:12.8685117Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T06:40:12.8686127Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T06:40:12.8687153Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 48s local 2025-03-14T06:40:12.8688116Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T06:40:12.8689109Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2025-03-14T06:40:12.8690365Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T06:40:12.8691502Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2025-03-14T06:40:12.8692489Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local ... 2025-03-14T06:40:13.0682374Z 2025-03-14T06:40:13.0683224Z  2025-03-14T06:40:13.0683697Z  2025-03-14T06:40:13.0684120Z  2025-03-14T06:40:13.0684729Z  2025-03-14T06:40:13.0685182Z  2025-03-14T06:40:13.0685592Z  2025-03-14T06:40:13.0686314Z  2025-03-14T06:40:13.0686725Z  2025-03-14T06:40:13.0687728Z [18,956 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:13.0688938Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T06:40:13.0690050Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T06:40:13.0691205Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T06:40:13.0692079Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T06:40:13.0693005Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2025-03-14T06:40:13.0694001Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T06:40:13.0695101Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2025-03-14T06:40:13.0696313Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local ... 2025-03-14T06:40:13.3648995Z 2025-03-14T06:40:13.3649919Z  2025-03-14T06:40:13.3650410Z  2025-03-14T06:40:13.3650778Z  2025-03-14T06:40:13.3651130Z  2025-03-14T06:40:13.3651521Z  2025-03-14T06:40:13.3651890Z  2025-03-14T06:40:13.3652272Z  2025-03-14T06:40:13.3652646Z  2025-03-14T06:40:13.3653539Z [18,958 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:13.3654830Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 57s local 2025-03-14T06:40:13.3655801Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T06:40:13.3656753Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T06:40:13.3657636Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T06:40:13.3658510Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2025-03-14T06:40:13.3659433Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T06:40:13.3660405Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 24s local 2025-03-14T06:40:13.3661309Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 23s local ... 2025-03-14T06:40:13.6687328Z 2025-03-14T06:40:13.6688153Z  2025-03-14T06:40:13.6688624Z  2025-03-14T06:40:13.6689030Z  2025-03-14T06:40:13.6689441Z  2025-03-14T06:40:13.6689888Z  2025-03-14T06:40:13.6690299Z  2025-03-14T06:40:13.6690713Z  2025-03-14T06:40:13.6691146Z  2025-03-14T06:40:13.6692144Z [18,958 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:13.6693294Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T06:40:13.6694338Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T06:40:13.6695342Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T06:40:13.6696332Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T06:40:13.6697322Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T06:40:13.6698314Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 35s local 2025-03-14T06:40:13.6699341Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2025-03-14T06:40:13.6700303Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local ... 2025-03-14T06:40:13.8799613Z 2025-03-14T06:40:13.8800470Z  2025-03-14T06:40:13.8801261Z  2025-03-14T06:40:13.8801706Z  2025-03-14T06:40:13.8802124Z  2025-03-14T06:40:13.8802533Z  2025-03-14T06:40:13.8802925Z  2025-03-14T06:40:13.8803302Z  2025-03-14T06:40:13.8803731Z  2025-03-14T06:40:13.8804775Z [18,959 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:13.8805922Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T06:40:13.8807184Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T06:40:13.8808160Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 49s local 2025-03-14T06:40:13.8809114Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T06:40:13.8810108Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T06:40:13.8811100Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T06:40:13.8812214Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2025-03-14T06:40:13.8813125Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local ... 2025-03-14T06:40:14.1710613Z 2025-03-14T06:40:14.1711491Z  2025-03-14T06:40:14.1711975Z  2025-03-14T06:40:14.1712349Z  2025-03-14T06:40:14.1712775Z  2025-03-14T06:40:14.1713194Z  2025-03-14T06:40:14.1713602Z  2025-03-14T06:40:14.1713991Z  2025-03-14T06:40:14.1714676Z  2025-03-14T06:40:14.1715643Z [18,961 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:14.1716794Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T06:40:14.1717831Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T06:40:14.1718882Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2025-03-14T06:40:14.1719888Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T06:40:14.1721058Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T06:40:14.1722053Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T06:40:14.1723161Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2025-03-14T06:40:14.1724167Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local ... 2025-03-14T06:40:14.4693502Z 2025-03-14T06:40:14.4694332Z  2025-03-14T06:40:14.4694890Z  2025-03-14T06:40:14.4695334Z  2025-03-14T06:40:14.4695896Z  2025-03-14T06:40:14.4696329Z  2025-03-14T06:40:14.4696752Z  2025-03-14T06:40:14.4697172Z  2025-03-14T06:40:14.4697585Z  2025-03-14T06:40:14.4698568Z [18,961 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:14.4699738Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 58s local 2025-03-14T06:40:14.4700804Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T06:40:14.4701864Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2025-03-14T06:40:14.4702855Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T06:40:14.4703851Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T06:40:14.4704841Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T06:40:14.4705855Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 25s local 2025-03-14T06:40:14.4706847Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 24s local ... 2025-03-14T06:40:14.6701549Z 2025-03-14T06:40:14.6702434Z  2025-03-14T06:40:14.6702917Z  2025-03-14T06:40:14.6703314Z  2025-03-14T06:40:14.6703734Z  2025-03-14T06:40:14.6704148Z  2025-03-14T06:40:14.6704567Z  2025-03-14T06:40:14.6704976Z  2025-03-14T06:40:14.6705393Z  2025-03-14T06:40:14.6706618Z [18,962 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:14.6707830Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T06:40:14.6708907Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T06:40:14.6710058Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 50s local 2025-03-14T06:40:14.6710995Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T06:40:14.6711893Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T06:40:14.6713137Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 36s local 2025-03-14T06:40:14.6714274Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 26s local 2025-03-14T06:40:14.6715245Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local ... 2025-03-14T06:40:15.0698723Z 2025-03-14T06:40:15.0699569Z  2025-03-14T06:40:15.0700055Z  2025-03-14T06:40:15.0700483Z  2025-03-14T06:40:15.0700911Z  2025-03-14T06:40:15.0701299Z  2025-03-14T06:40:15.0701695Z  2025-03-14T06:40:15.0702088Z  2025-03-14T06:40:15.0702474Z  2025-03-14T06:40:15.0703445Z [18,962 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:15.0704717Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T06:40:15.0705717Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T06:40:15.0706947Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T06:40:15.0707890Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T06:40:15.0708862Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T06:40:15.0709833Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T06:40:15.0710878Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 26s local 2025-03-14T06:40:15.0712030Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local ... 2025-03-14T06:40:15.2700585Z 2025-03-14T06:40:15.2701456Z  2025-03-14T06:40:15.2701947Z  2025-03-14T06:40:15.2702369Z  2025-03-14T06:40:15.2702808Z  2025-03-14T06:40:15.2703255Z  2025-03-14T06:40:15.2703679Z  2025-03-14T06:40:15.2704106Z  2025-03-14T06:40:15.2704523Z  2025-03-14T06:40:15.2705529Z [18,963 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:15.2706736Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 59s local 2025-03-14T06:40:15.2707843Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T06:40:15.2708929Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T06:40:15.2709944Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T06:40:15.2710994Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T06:40:15.2712093Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T06:40:15.2713243Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 26s local 2025-03-14T06:40:15.2714265Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local ... 2025-03-14T06:40:15.5149905Z 2025-03-14T06:40:15.5150791Z  2025-03-14T06:40:15.5151285Z  2025-03-14T06:40:15.5151709Z  2025-03-14T06:40:15.5152122Z  2025-03-14T06:40:15.5152512Z  2025-03-14T06:40:15.5152930Z  2025-03-14T06:40:15.5153330Z  2025-03-14T06:40:15.5153719Z  2025-03-14T06:40:15.5154736Z [18,964 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:15.5155967Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T06:40:15.5157096Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T06:40:15.5158150Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T06:40:15.5159385Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T06:40:15.5160395Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T06:40:15.5161387Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 37s local 2025-03-14T06:40:15.5162469Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2025-03-14T06:40:15.5163431Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 25s local ... 2025-03-14T06:40:15.8707927Z 2025-03-14T06:40:15.8708770Z  2025-03-14T06:40:15.8709280Z  2025-03-14T06:40:15.8709939Z  2025-03-14T06:40:15.8710303Z  2025-03-14T06:40:15.8710673Z  2025-03-14T06:40:15.8711091Z  2025-03-14T06:40:15.8711501Z  2025-03-14T06:40:15.8711904Z  2025-03-14T06:40:15.8712882Z [18,965 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:15.8714180Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T06:40:15.8715203Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T06:40:15.8716227Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 51s local 2025-03-14T06:40:15.8717172Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T06:40:15.8718111Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T06:40:15.8719146Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T06:40:15.8720485Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2025-03-14T06:40:15.8721513Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local ... 2025-03-14T06:40:16.0747622Z 2025-03-14T06:40:16.0748495Z  2025-03-14T06:40:16.0748991Z  2025-03-14T06:40:16.0749384Z  2025-03-14T06:40:16.0749802Z  2025-03-14T06:40:16.0750219Z  2025-03-14T06:40:16.0750610Z  2025-03-14T06:40:16.0751016Z  2025-03-14T06:40:16.0751694Z  2025-03-14T06:40:16.0752671Z [18,966 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:16.0753794Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T06:40:16.0754797Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T06:40:16.0755778Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T06:40:16.0756649Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T06:40:16.0757593Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T06:40:16.0758610Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T06:40:16.0759674Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2025-03-14T06:40:16.0760786Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local ... 2025-03-14T06:40:16.3115588Z 2025-03-14T06:40:16.3116392Z  2025-03-14T06:40:16.3116891Z  2025-03-14T06:40:16.3117324Z  2025-03-14T06:40:16.3117736Z  2025-03-14T06:40:16.3118158Z  2025-03-14T06:40:16.3118565Z  2025-03-14T06:40:16.3118971Z  2025-03-14T06:40:16.3119387Z  2025-03-14T06:40:16.3120377Z [18,967 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:16.3121534Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 60s local 2025-03-14T06:40:16.3122607Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T06:40:16.3123697Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T06:40:16.3124883Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T06:40:16.3125921Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T06:40:16.3126926Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T06:40:16.3127945Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 27s local 2025-03-14T06:40:16.3129209Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local ... 2025-03-14T06:40:16.5660806Z 2025-03-14T06:40:16.5661658Z  2025-03-14T06:40:16.5662079Z  2025-03-14T06:40:16.5662432Z  2025-03-14T06:40:16.5662807Z  2025-03-14T06:40:16.5663184Z  2025-03-14T06:40:16.5663550Z  2025-03-14T06:40:16.5663934Z  2025-03-14T06:40:16.5664328Z  2025-03-14T06:40:16.5665665Z [18,969 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:16.5666955Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T06:40:16.5667918Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T06:40:16.5668850Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T06:40:16.5669709Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T06:40:16.5670553Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T06:40:16.5671472Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 38s local 2025-03-14T06:40:16.5672413Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2025-03-14T06:40:16.5673300Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 26s local ... 2025-03-14T06:40:16.8715469Z 2025-03-14T06:40:16.8716335Z  2025-03-14T06:40:16.8716840Z  2025-03-14T06:40:16.8717260Z  2025-03-14T06:40:16.8717924Z  2025-03-14T06:40:16.8718311Z  2025-03-14T06:40:16.8718699Z  2025-03-14T06:40:16.8719101Z  2025-03-14T06:40:16.8719460Z  2025-03-14T06:40:16.8720404Z [18,969 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:16.8721522Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T06:40:16.8722590Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2025-03-14T06:40:16.8723775Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 52s local 2025-03-14T06:40:16.8724899Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T06:40:16.8725843Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T06:40:16.8726821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T06:40:16.8727848Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2025-03-14T06:40:16.8728844Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local ... 2025-03-14T06:40:17.0891375Z 2025-03-14T06:40:17.0892192Z  2025-03-14T06:40:17.0892712Z  2025-03-14T06:40:17.0893114Z  2025-03-14T06:40:17.0893512Z  2025-03-14T06:40:17.0893914Z  2025-03-14T06:40:17.0894310Z  2025-03-14T06:40:17.0894696Z  2025-03-14T06:40:17.0895061Z  2025-03-14T06:40:17.0895963Z [18,970 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:17.0897126Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T06:40:17.0898221Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2025-03-14T06:40:17.0899273Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T06:40:17.0900221Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T06:40:17.0901225Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T06:40:17.0902247Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T06:40:17.0903356Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2025-03-14T06:40:17.0904331Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local ... 2025-03-14T06:40:17.4720601Z 2025-03-14T06:40:17.4721567Z  2025-03-14T06:40:17.4722030Z  2025-03-14T06:40:17.4722416Z  2025-03-14T06:40:17.4722786Z  2025-03-14T06:40:17.4723171Z  2025-03-14T06:40:17.4723569Z  2025-03-14T06:40:17.4723947Z  2025-03-14T06:40:17.4724576Z  2025-03-14T06:40:17.4725628Z [18,970 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:17.4726609Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 61s local 2025-03-14T06:40:17.4727500Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2025-03-14T06:40:17.4728272Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T06:40:17.4729077Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T06:40:17.4730096Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T06:40:17.4730954Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T06:40:17.4731807Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 28s local 2025-03-14T06:40:17.4732601Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 27s local ... 2025-03-14T06:40:17.6724097Z 2025-03-14T06:40:17.6725079Z  2025-03-14T06:40:17.6725559Z  2025-03-14T06:40:17.6725917Z  2025-03-14T06:40:17.6726288Z  2025-03-14T06:40:17.6726653Z  2025-03-14T06:40:17.6727019Z  2025-03-14T06:40:17.6727375Z  2025-03-14T06:40:17.6727746Z  2025-03-14T06:40:17.6728613Z [18,973 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:17.6729726Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T06:40:17.6731028Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2025-03-14T06:40:17.6731927Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 53s local 2025-03-14T06:40:17.6732818Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T06:40:17.6733672Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T06:40:17.6734528Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 39s local 2025-03-14T06:40:17.6735726Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2025-03-14T06:40:17.6736649Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local ... 2025-03-14T06:40:17.9395405Z 2025-03-14T06:40:17.9396281Z  2025-03-14T06:40:17.9396732Z  2025-03-14T06:40:17.9397106Z  2025-03-14T06:40:17.9397461Z  2025-03-14T06:40:17.9397830Z  2025-03-14T06:40:17.9398198Z  2025-03-14T06:40:17.9398547Z  2025-03-14T06:40:17.9398943Z  2025-03-14T06:40:17.9399837Z [18,974 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:17.9400846Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T06:40:17.9401786Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T06:40:17.9402667Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T06:40:17.9403536Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T06:40:17.9404368Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T06:40:17.9405367Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T06:40:17.9406317Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2025-03-14T06:40:17.9407150Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local ... 2025-03-14T06:40:18.2729701Z 2025-03-14T06:40:18.2730566Z  2025-03-14T06:40:18.2730993Z  2025-03-14T06:40:18.2731389Z  2025-03-14T06:40:18.2731732Z  2025-03-14T06:40:18.2732068Z  2025-03-14T06:40:18.2732415Z  2025-03-14T06:40:18.2732739Z  2025-03-14T06:40:18.2733088Z  2025-03-14T06:40:18.2733899Z [18,974 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:18.2734845Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T06:40:18.2735675Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T06:40:18.2736839Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T06:40:18.2737674Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T06:40:18.2738488Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T06:40:18.2739335Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T06:40:18.2740250Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2025-03-14T06:40:18.2741064Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local ... 2025-03-14T06:40:18.4733690Z 2025-03-14T06:40:18.4734512Z  2025-03-14T06:40:18.4734958Z  2025-03-14T06:40:18.4735334Z  2025-03-14T06:40:18.4735713Z  2025-03-14T06:40:18.4736063Z  2025-03-14T06:40:18.4736433Z  2025-03-14T06:40:18.4736825Z  2025-03-14T06:40:18.4737211Z  2025-03-14T06:40:18.4738136Z [18,976 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:18.4739251Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 62s local 2025-03-14T06:40:18.4740254Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T06:40:18.4741201Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T06:40:18.4742118Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T06:40:18.4743027Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T06:40:18.4744180Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 40s local 2025-03-14T06:40:18.4745191Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 29s local 2025-03-14T06:40:18.4746068Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 28s local ... 2025-03-14T06:40:18.8737102Z 2025-03-14T06:40:18.8737876Z  2025-03-14T06:40:18.8738291Z  2025-03-14T06:40:18.8738628Z  2025-03-14T06:40:18.8739270Z  2025-03-14T06:40:18.8739604Z  2025-03-14T06:40:18.8739942Z  2025-03-14T06:40:18.8740250Z  2025-03-14T06:40:18.8740578Z  2025-03-14T06:40:18.8741372Z [18,977 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:18.8742271Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2025-03-14T06:40:18.8743091Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2025-03-14T06:40:18.8743904Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 54s local 2025-03-14T06:40:18.8744669Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T06:40:18.8745426Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T06:40:18.8746213Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T06:40:18.8747041Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2025-03-14T06:40:18.8747813Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local ... 2025-03-14T06:40:19.2741445Z 2025-03-14T06:40:19.2742317Z  2025-03-14T06:40:19.2742837Z  2025-03-14T06:40:19.2743261Z  2025-03-14T06:40:19.2743645Z  2025-03-14T06:40:19.2744047Z  2025-03-14T06:40:19.2744446Z  2025-03-14T06:40:19.2744854Z  2025-03-14T06:40:19.2745271Z  2025-03-14T06:40:19.2746230Z [18,978 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:19.2747439Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2025-03-14T06:40:19.2748549Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2025-03-14T06:40:19.2749628Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T06:40:19.2750630Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T06:40:19.2751572Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T06:40:19.2752605Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T06:40:19.2753907Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2025-03-14T06:40:19.2754915Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local ... 2025-03-14T06:40:19.4745153Z 2025-03-14T06:40:19.4745963Z  2025-03-14T06:40:19.4746428Z  2025-03-14T06:40:19.4746815Z  2025-03-14T06:40:19.4747186Z  2025-03-14T06:40:19.4747581Z  2025-03-14T06:40:19.4747959Z  2025-03-14T06:40:19.4748372Z  2025-03-14T06:40:19.4748761Z  2025-03-14T06:40:19.4749891Z [18,979 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:19.4750901Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 63s local 2025-03-14T06:40:19.4751837Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2025-03-14T06:40:19.4752712Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T06:40:19.4753733Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T06:40:19.4754541Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T06:40:19.4755498Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 41s local 2025-03-14T06:40:19.4756499Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 30s local 2025-03-14T06:40:19.4757443Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 29s local ... 2025-03-14T06:40:19.7529256Z 2025-03-14T06:40:19.7530359Z  2025-03-14T06:40:19.7530826Z  2025-03-14T06:40:19.7531226Z  2025-03-14T06:40:19.7531646Z  2025-03-14T06:40:19.7532058Z  2025-03-14T06:40:19.7532425Z  2025-03-14T06:40:19.7532839Z  2025-03-14T06:40:19.7542891Z  2025-03-14T06:40:19.7544192Z [18,980 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:19.7545494Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T06:40:19.7546805Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2025-03-14T06:40:19.7547829Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 55s local 2025-03-14T06:40:19.7548795Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T06:40:19.7549805Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T06:40:19.7550844Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T06:40:19.7551962Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T06:40:19.7552926Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local ... 2025-03-14T06:40:20.0750378Z 2025-03-14T06:40:20.0751233Z  2025-03-14T06:40:20.0751745Z  2025-03-14T06:40:20.0752158Z  2025-03-14T06:40:20.0752563Z  2025-03-14T06:40:20.0752984Z  2025-03-14T06:40:20.0753363Z  2025-03-14T06:40:20.0753784Z  2025-03-14T06:40:20.0754237Z  2025-03-14T06:40:20.0755201Z [18,980 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:20.0756352Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T06:40:20.0757410Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T06:40:20.0758407Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T06:40:20.0759371Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T06:40:20.0760349Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T06:40:20.0761335Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T06:40:20.0762412Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T06:40:20.0763408Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local ... 2025-03-14T06:40:20.3216865Z 2025-03-14T06:40:20.3217665Z  2025-03-14T06:40:20.3218240Z  2025-03-14T06:40:20.3218743Z  2025-03-14T06:40:20.3219195Z  2025-03-14T06:40:20.3219831Z  2025-03-14T06:40:20.3220274Z  2025-03-14T06:40:20.3220656Z  2025-03-14T06:40:20.3221113Z  2025-03-14T06:40:20.3222035Z [18,981 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:20.3223103Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 64s local 2025-03-14T06:40:20.3224004Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T06:40:20.3225493Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T06:40:20.3226489Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T06:40:20.3227436Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T06:40:20.3228428Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T06:40:20.3229468Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 31s local 2025-03-14T06:40:20.3230439Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 30s local ... 2025-03-14T06:40:20.6757600Z 2025-03-14T06:40:20.6758442Z  2025-03-14T06:40:20.6758949Z  2025-03-14T06:40:20.6759268Z  2025-03-14T06:40:20.6759587Z  2025-03-14T06:40:20.6759900Z  2025-03-14T06:40:20.6760209Z  2025-03-14T06:40:20.6760517Z  2025-03-14T06:40:20.6760826Z  2025-03-14T06:40:20.6761583Z [18,981 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:20.6762770Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T06:40:20.6763543Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T06:40:20.6764384Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 56s local 2025-03-14T06:40:20.6765752Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T06:40:20.6766656Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T06:40:20.6767821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 42s local 2025-03-14T06:40:20.6768716Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2025-03-14T06:40:20.6769647Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local ... 2025-03-14T06:40:21.0761518Z 2025-03-14T06:40:21.0762354Z  2025-03-14T06:40:21.0762820Z  2025-03-14T06:40:21.0763202Z  2025-03-14T06:40:21.0763575Z  2025-03-14T06:40:21.0763993Z  2025-03-14T06:40:21.0764401Z  2025-03-14T06:40:21.0764971Z  2025-03-14T06:40:21.0765897Z  2025-03-14T06:40:21.0766880Z [18,983 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:21.0767993Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T06:40:21.0769008Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T06:40:21.0770052Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T06:40:21.0771042Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T06:40:21.0771990Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T06:40:21.0772992Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T06:40:21.0774012Z Compiling .../translate/hlo_to_mhlo/hlo_function_importer.cc; 32s local 2025-03-14T06:40:21.0774967Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local ... 2025-03-14T06:40:21.2763481Z 2025-03-14T06:40:21.2764349Z  2025-03-14T06:40:21.2764993Z  2025-03-14T06:40:21.2765564Z  2025-03-14T06:40:21.2765943Z  2025-03-14T06:40:21.2766346Z  2025-03-14T06:40:21.2766741Z  2025-03-14T06:40:21.2767127Z  2025-03-14T06:40:21.2767498Z  2025-03-14T06:40:21.2768417Z [18,985 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:21.2769719Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T06:40:21.2770697Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T06:40:21.2771659Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T06:40:21.2772568Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T06:40:21.2773458Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T06:40:21.2774400Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T06:40:21.2775445Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T06:40:21.2776162Z @llvm-project//llvm:CodeGen; 30s local ... 2025-03-14T06:40:21.4860160Z 2025-03-14T06:40:21.4860957Z  2025-03-14T06:40:21.4861434Z  2025-03-14T06:40:21.4861821Z  2025-03-14T06:40:21.4862208Z  2025-03-14T06:40:21.4862599Z  2025-03-14T06:40:21.4862994Z  2025-03-14T06:40:21.4863423Z  2025-03-14T06:40:21.4863799Z  2025-03-14T06:40:21.4864835Z [18,987 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:21.4866218Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 65s local 2025-03-14T06:40:21.4867216Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T06:40:21.4868171Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T06:40:21.4869109Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T06:40:21.4870360Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T06:40:21.4871347Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 43s local 2025-03-14T06:40:21.4872235Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 31s local 2025-03-14T06:40:21.4872958Z @llvm-project//llvm:CodeGen; 31s local ... 2025-03-14T06:40:21.8582795Z 2025-03-14T06:40:21.8583593Z  2025-03-14T06:40:21.8584384Z  2025-03-14T06:40:21.8584786Z  2025-03-14T06:40:21.8585169Z  2025-03-14T06:40:21.8585556Z  2025-03-14T06:40:21.8585917Z  2025-03-14T06:40:21.8586282Z  2025-03-14T06:40:21.8586672Z  2025-03-14T06:40:21.8587547Z [18,989 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:21.8588626Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2025-03-14T06:40:21.8589683Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T06:40:21.8590705Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 57s local 2025-03-14T06:40:21.8591606Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T06:40:21.8592509Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2025-03-14T06:40:21.8593465Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2025-03-14T06:40:21.8594320Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T06:40:21.8595003Z @llvm-project//llvm:CodeGen; 31s local ... 2025-03-14T06:40:22.0767892Z 2025-03-14T06:40:22.0768743Z  2025-03-14T06:40:22.0769241Z  2025-03-14T06:40:22.0769647Z  2025-03-14T06:40:22.0770047Z  2025-03-14T06:40:22.0770441Z  2025-03-14T06:40:22.0770874Z  2025-03-14T06:40:22.0771272Z  2025-03-14T06:40:22.0771673Z  2025-03-14T06:40:22.0772597Z [18,989 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:22.0773790Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 66s local 2025-03-14T06:40:22.0774777Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T06:40:22.0775723Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T06:40:22.0776661Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T06:40:22.0777587Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2025-03-14T06:40:22.0778850Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2025-03-14T06:40:22.0779779Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T06:40:22.0780515Z @llvm-project//llvm:CodeGen; 31s local ... 2025-03-14T06:40:22.5780802Z 2025-03-14T06:40:22.5782005Z  2025-03-14T06:40:22.5782448Z  2025-03-14T06:40:22.5782832Z  2025-03-14T06:40:22.5783201Z  2025-03-14T06:40:22.5783559Z  2025-03-14T06:40:22.5783926Z  2025-03-14T06:40:22.5784299Z  2025-03-14T06:40:22.5784658Z  2025-03-14T06:40:22.5785792Z [18,990 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:22.5786812Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T06:40:22.5787745Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T06:40:22.5788679Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T06:40:22.5789570Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T06:40:22.5790443Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2025-03-14T06:40:22.5791312Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 44s local 2025-03-14T06:40:22.5792122Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 32s local 2025-03-14T06:40:22.5792790Z @llvm-project//llvm:CodeGen; 32s local ... 2025-03-14T06:40:22.8777291Z 2025-03-14T06:40:22.8778174Z  2025-03-14T06:40:22.8779145Z  2025-03-14T06:40:22.8779558Z  2025-03-14T06:40:22.8779954Z  2025-03-14T06:40:22.8780333Z  2025-03-14T06:40:22.8780818Z  2025-03-14T06:40:22.8781220Z  2025-03-14T06:40:22.8781776Z  2025-03-14T06:40:22.8782839Z [18,990 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:22.8784008Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T06:40:22.8785337Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T06:40:22.8786295Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 58s local 2025-03-14T06:40:22.8787329Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T06:40:22.8788409Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2025-03-14T06:40:22.8789415Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T06:40:22.8790332Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2025-03-14T06:40:22.8791127Z @llvm-project//llvm:CodeGen; 32s local ... 2025-03-14T06:40:23.1834471Z 2025-03-14T06:40:23.1835289Z  2025-03-14T06:40:23.1835802Z  2025-03-14T06:40:23.1836219Z  2025-03-14T06:40:23.1836605Z  2025-03-14T06:40:23.1837003Z  2025-03-14T06:40:23.1837381Z  2025-03-14T06:40:23.1837791Z  2025-03-14T06:40:23.1838180Z  2025-03-14T06:40:23.1839076Z [18,991 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:23.1840377Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T06:40:23.1841498Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T06:40:23.1842492Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T06:40:23.1843418Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T06:40:23.1844315Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2025-03-14T06:40:23.1845525Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T06:40:23.1846409Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2025-03-14T06:40:23.1847121Z @llvm-project//llvm:CodeGen; 32s local ... 2025-03-14T06:40:23.4762905Z 2025-03-14T06:40:23.4763751Z  2025-03-14T06:40:23.4764195Z  2025-03-14T06:40:23.4764716Z  2025-03-14T06:40:23.4765079Z  2025-03-14T06:40:23.4765688Z  2025-03-14T06:40:23.4766038Z  2025-03-14T06:40:23.4766683Z  2025-03-14T06:40:23.4767070Z  2025-03-14T06:40:23.4767955Z [18,992 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:23.4769004Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 67s local 2025-03-14T06:40:23.4769934Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T06:40:23.4770839Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T06:40:23.4771932Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T06:40:23.4772773Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2025-03-14T06:40:23.4773642Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T06:40:23.4774440Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 33s local 2025-03-14T06:40:23.4775056Z @llvm-project//llvm:CodeGen; 33s local ... 2025-03-14T06:40:23.6783400Z 2025-03-14T06:40:23.6784199Z  2025-03-14T06:40:23.6784652Z  2025-03-14T06:40:23.6785010Z  2025-03-14T06:40:23.6785357Z  2025-03-14T06:40:23.6785702Z  2025-03-14T06:40:23.6786050Z  2025-03-14T06:40:23.6786387Z  2025-03-14T06:40:23.6786711Z  2025-03-14T06:40:23.6787554Z [18,993 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:23.6788564Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2025-03-14T06:40:23.6789717Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T06:40:23.6790558Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 59s local 2025-03-14T06:40:23.6791375Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T06:40:23.6792189Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T06:40:23.6793040Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 45s local 2025-03-14T06:40:23.6794091Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T06:40:23.6794708Z @llvm-project//llvm:CodeGen; 33s local ... 2025-03-14T06:40:23.9498095Z 2025-03-14T06:40:23.9498918Z  2025-03-14T06:40:23.9499325Z  2025-03-14T06:40:23.9499664Z  2025-03-14T06:40:23.9500000Z  2025-03-14T06:40:23.9500318Z  2025-03-14T06:40:23.9500653Z  2025-03-14T06:40:23.9500982Z  2025-03-14T06:40:23.9501420Z  2025-03-14T06:40:23.9502238Z [18,996 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:23.9503141Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2025-03-14T06:40:23.9503970Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T06:40:23.9504750Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T06:40:23.9505493Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T06:40:23.9506276Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T06:40:23.9507063Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T06:40:23.9507793Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T06:40:23.9508382Z @llvm-project//llvm:CodeGen; 33s local ... 2025-03-14T06:40:24.2787806Z 2025-03-14T06:40:24.2788627Z  2025-03-14T06:40:24.2789133Z  2025-03-14T06:40:24.2789537Z  2025-03-14T06:40:24.2789989Z  2025-03-14T06:40:24.2790419Z  2025-03-14T06:40:24.2790813Z  2025-03-14T06:40:24.2791219Z  2025-03-14T06:40:24.2791601Z  2025-03-14T06:40:24.2792566Z [18,996 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:24.2793603Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 68s local 2025-03-14T06:40:24.2794706Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T06:40:24.2795947Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T06:40:24.2797050Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T06:40:24.2797994Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T06:40:24.2798967Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T06:40:24.2799899Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 34s local 2025-03-14T06:40:24.2800671Z @llvm-project//llvm:CodeGen; 33s local ... 2025-03-14T06:40:24.6788511Z 2025-03-14T06:40:24.6789382Z  2025-03-14T06:40:24.6790114Z  2025-03-14T06:40:24.6790534Z  2025-03-14T06:40:24.6790924Z  2025-03-14T06:40:24.6791640Z  2025-03-14T06:40:24.6792150Z  2025-03-14T06:40:24.6792655Z  2025-03-14T06:40:24.6793119Z  2025-03-14T06:40:24.6794158Z [18,997 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:24.6795468Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T06:40:24.6796699Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T06:40:24.6797859Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T06:40:24.6798923Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T06:40:24.6799953Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T06:40:24.6801071Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 46s local 2025-03-14T06:40:24.6802473Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T06:40:24.6803397Z @llvm-project//llvm:CodeGen; 34s local ... 2025-03-14T06:40:24.8792645Z 2025-03-14T06:40:24.8793539Z  2025-03-14T06:40:24.8794038Z  2025-03-14T06:40:24.8794439Z  2025-03-14T06:40:24.8794821Z  2025-03-14T06:40:24.8795218Z  2025-03-14T06:40:24.8795632Z  2025-03-14T06:40:24.8796019Z  2025-03-14T06:40:24.8796730Z  2025-03-14T06:40:24.8797705Z [18,999 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:24.8798772Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T06:40:24.8799800Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T06:40:24.8800844Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 60s local 2025-03-14T06:40:24.8801809Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T06:40:24.8802810Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T06:40:24.8803755Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T06:40:24.8804855Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T06:40:24.8805589Z @llvm-project//llvm:CodeGen; 34s local ... 2025-03-14T06:40:25.3790117Z 2025-03-14T06:40:25.3791084Z  2025-03-14T06:40:25.3791581Z  2025-03-14T06:40:25.3792037Z  2025-03-14T06:40:25.3792462Z  2025-03-14T06:40:25.3792866Z  2025-03-14T06:40:25.3793271Z  2025-03-14T06:40:25.3793677Z  2025-03-14T06:40:25.3794044Z  2025-03-14T06:40:25.3795004Z [19,000 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:25.3796122Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 69s local 2025-03-14T06:40:25.3797178Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T06:40:25.3798187Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T06:40:25.3799136Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2025-03-14T06:40:25.3800066Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T06:40:25.3801047Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T06:40:25.3801999Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 35s local 2025-03-14T06:40:25.3802715Z @llvm-project//llvm:CodeGen; 34s local ... 2025-03-14T06:40:25.6799439Z 2025-03-14T06:40:25.6800300Z  2025-03-14T06:40:25.6800804Z  2025-03-14T06:40:25.6801210Z  2025-03-14T06:40:25.6801640Z  2025-03-14T06:40:25.6802060Z  2025-03-14T06:40:25.6802477Z  2025-03-14T06:40:25.6802870Z  2025-03-14T06:40:25.6803267Z  2025-03-14T06:40:25.6804167Z [19,002 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:25.6805453Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2025-03-14T06:40:25.6806668Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T06:40:25.6807790Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 61s local 2025-03-14T06:40:25.6808639Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2025-03-14T06:40:25.6809555Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2025-03-14T06:40:25.6810588Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 47s local 2025-03-14T06:40:25.6811488Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2025-03-14T06:40:25.6812193Z @llvm-project//llvm:CodeGen; 35s local ... 2025-03-14T06:40:26.0098142Z 2025-03-14T06:40:26.0099357Z  2025-03-14T06:40:26.0100059Z  2025-03-14T06:40:26.0100432Z  2025-03-14T06:40:26.0100807Z  2025-03-14T06:40:26.0101179Z  2025-03-14T06:40:26.0101563Z  2025-03-14T06:40:26.0102194Z  2025-03-14T06:40:26.0102564Z  2025-03-14T06:40:26.0103466Z [19,003 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:26.0104691Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2025-03-14T06:40:26.0105713Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T06:40:26.0106753Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T06:40:26.0107683Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2025-03-14T06:40:26.0108476Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2025-03-14T06:40:26.0109302Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2025-03-14T06:40:26.0110093Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2025-03-14T06:40:26.0110763Z @llvm-project//llvm:CodeGen; 35s local ... 2025-03-14T06:40:26.2803703Z 2025-03-14T06:40:26.2804503Z  2025-03-14T06:40:26.2805161Z  2025-03-14T06:40:26.2805603Z  2025-03-14T06:40:26.2806043Z  2025-03-14T06:40:26.2806496Z  2025-03-14T06:40:26.2806935Z  2025-03-14T06:40:26.2807354Z  2025-03-14T06:40:26.2807792Z  2025-03-14T06:40:26.2808814Z [19,004 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:26.2810189Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 70s local 2025-03-14T06:40:26.2811330Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T06:40:26.2812430Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T06:40:26.2813475Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2025-03-14T06:40:26.2814504Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2025-03-14T06:40:26.2815579Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2025-03-14T06:40:26.2816571Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2025-03-14T06:40:26.2817557Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 23s local ... 2025-03-14T06:40:26.5298374Z 2025-03-14T06:40:26.5299372Z  2025-03-14T06:40:26.5299908Z  2025-03-14T06:40:26.5300333Z  2025-03-14T06:40:26.5300751Z  2025-03-14T06:40:26.5301174Z  2025-03-14T06:40:26.5301595Z  2025-03-14T06:40:26.5302019Z  2025-03-14T06:40:26.5302437Z  2025-03-14T06:40:26.5303680Z [19,006 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:26.5305008Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T06:40:26.5306056Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T06:40:26.5307079Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T06:40:26.5308099Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2025-03-14T06:40:26.5309079Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2025-03-14T06:40:26.5310269Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 48s local 2025-03-14T06:40:26.5311211Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 36s local 2025-03-14T06:40:26.5312135Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local ... 2025-03-14T06:40:26.8636710Z 2025-03-14T06:40:26.8637601Z  2025-03-14T06:40:26.8638077Z  2025-03-14T06:40:26.8638445Z  2025-03-14T06:40:26.8638849Z  2025-03-14T06:40:26.8639173Z  2025-03-14T06:40:26.8639573Z  2025-03-14T06:40:26.8639957Z  2025-03-14T06:40:26.8640358Z  2025-03-14T06:40:26.8641286Z [19,009 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:26.8642345Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T06:40:26.8643377Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T06:40:26.8644875Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 62s local 2025-03-14T06:40:26.8645835Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2025-03-14T06:40:26.8646732Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T06:40:26.8647654Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T06:40:26.8648510Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T06:40:26.8649360Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local ... 2025-03-14T06:40:27.0809387Z 2025-03-14T06:40:27.0810269Z  2025-03-14T06:40:27.0810737Z  2025-03-14T06:40:27.0811111Z  2025-03-14T06:40:27.0811488Z  2025-03-14T06:40:27.0811875Z  2025-03-14T06:40:27.0812261Z  2025-03-14T06:40:27.0812660Z  2025-03-14T06:40:27.0813117Z  2025-03-14T06:40:27.0814044Z [19,010 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:27.0815160Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T06:40:27.0816117Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T06:40:27.0817022Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T06:40:27.0817886Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T06:40:27.0818799Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T06:40:27.0819803Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T06:40:27.0820714Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T06:40:27.0821590Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 24s local ... 2025-03-14T06:40:27.4813288Z 2025-03-14T06:40:27.4814129Z  2025-03-14T06:40:27.4814613Z  2025-03-14T06:40:27.4815003Z  2025-03-14T06:40:27.4815740Z  2025-03-14T06:40:27.4816288Z  2025-03-14T06:40:27.4816822Z  2025-03-14T06:40:27.4817391Z  2025-03-14T06:40:27.4817907Z  2025-03-14T06:40:27.4818996Z [19,011 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:27.4820281Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 71s local 2025-03-14T06:40:27.4821471Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T06:40:27.4822589Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T06:40:27.4823711Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T06:40:27.4825039Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T06:40:27.4826238Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 49s local 2025-03-14T06:40:27.4827291Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 37s local 2025-03-14T06:40:27.4828355Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local ... 2025-03-14T06:40:27.8244980Z 2025-03-14T06:40:27.8248599Z  2025-03-14T06:40:27.8249062Z  2025-03-14T06:40:27.8249457Z  2025-03-14T06:40:27.8249845Z  2025-03-14T06:40:27.8250503Z  2025-03-14T06:40:27.8250915Z  2025-03-14T06:40:27.8251317Z  2025-03-14T06:40:27.8251705Z  2025-03-14T06:40:27.8252659Z [19,012 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:27.8253750Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2025-03-14T06:40:27.8254778Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T06:40:27.8255819Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 63s local 2025-03-14T06:40:27.8256745Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T06:40:27.8257673Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T06:40:27.8258630Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T06:40:27.8259503Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T06:40:27.8260667Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local ... 2025-03-14T06:40:28.0820559Z 2025-03-14T06:40:28.0821396Z  2025-03-14T06:40:28.0821845Z  2025-03-14T06:40:28.0822196Z  2025-03-14T06:40:28.0822539Z  2025-03-14T06:40:28.0822880Z  2025-03-14T06:40:28.0823233Z  2025-03-14T06:40:28.0823566Z  2025-03-14T06:40:28.0823907Z  2025-03-14T06:40:28.0824987Z [19,013 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:28.0825916Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2025-03-14T06:40:28.0826773Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T06:40:28.0827602Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T06:40:28.0828391Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T06:40:28.0829173Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T06:40:28.0829983Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T06:40:28.0830747Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T06:40:28.0831493Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local ... 2025-03-14T06:40:28.3612385Z 2025-03-14T06:40:28.3613271Z  2025-03-14T06:40:28.3613779Z  2025-03-14T06:40:28.3614198Z  2025-03-14T06:40:28.3614738Z  2025-03-14T06:40:28.3615135Z  2025-03-14T06:40:28.3615538Z  2025-03-14T06:40:28.3615945Z  2025-03-14T06:40:28.3616353Z  2025-03-14T06:40:28.3617327Z [19,015 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:28.3618411Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 72s local 2025-03-14T06:40:28.3619428Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T06:40:28.3620455Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T06:40:28.3621413Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T06:40:28.3622320Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T06:40:28.3623285Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T06:40:28.3624215Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 38s local 2025-03-14T06:40:28.3625202Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 25s local ... 2025-03-14T06:40:28.6750167Z 2025-03-14T06:40:28.6751150Z  2025-03-14T06:40:28.6751637Z  2025-03-14T06:40:28.6752031Z  2025-03-14T06:40:28.6752457Z  2025-03-14T06:40:28.6752864Z  2025-03-14T06:40:28.6753271Z  2025-03-14T06:40:28.6753667Z  2025-03-14T06:40:28.6754076Z  2025-03-14T06:40:28.6754984Z [19,017 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:28.6756081Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T06:40:28.6757329Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T06:40:28.6758304Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T06:40:28.6759209Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T06:40:28.6760148Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T06:40:28.6761139Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 50s local 2025-03-14T06:40:28.6762026Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T06:40:28.6762919Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local ... 2025-03-14T06:40:28.8827222Z 2025-03-14T06:40:28.8828130Z  2025-03-14T06:40:28.8828642Z  2025-03-14T06:40:28.8829063Z  2025-03-14T06:40:28.8829475Z  2025-03-14T06:40:28.8829881Z  2025-03-14T06:40:28.8830274Z  2025-03-14T06:40:28.8831034Z  2025-03-14T06:40:28.8831427Z  2025-03-14T06:40:28.8832396Z [19,017 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:28.8833488Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T06:40:28.8834498Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T06:40:28.8835444Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 64s local 2025-03-14T06:40:28.8836549Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T06:40:28.8837469Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T06:40:28.8838431Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T06:40:28.8839276Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T06:40:28.8840154Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local ... 2025-03-14T06:40:29.0829656Z 2025-03-14T06:40:29.0830571Z  2025-03-14T06:40:29.0831050Z  2025-03-14T06:40:29.0831428Z  2025-03-14T06:40:29.0831807Z  2025-03-14T06:40:29.0832186Z  2025-03-14T06:40:29.0832552Z  2025-03-14T06:40:29.0832919Z  2025-03-14T06:40:29.0833284Z  2025-03-14T06:40:29.0834193Z [19,018 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:29.0835277Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T06:40:29.0836274Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T06:40:29.0837338Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T06:40:29.0838309Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T06:40:29.0839265Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T06:40:29.0840298Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T06:40:29.0841249Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T06:40:29.0842118Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local ... 2025-03-14T06:40:29.3729925Z 2025-03-14T06:40:29.3730793Z  2025-03-14T06:40:29.3731327Z  2025-03-14T06:40:29.3731782Z  2025-03-14T06:40:29.3732225Z  2025-03-14T06:40:29.3732673Z  2025-03-14T06:40:29.3733117Z  2025-03-14T06:40:29.3733571Z  2025-03-14T06:40:29.3734138Z  2025-03-14T06:40:29.3735391Z [19,019 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:29.3736617Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 73s local 2025-03-14T06:40:29.3737753Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T06:40:29.3738856Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T06:40:29.3739891Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T06:40:29.3740936Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T06:40:29.3742116Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T06:40:29.3743122Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 39s local 2025-03-14T06:40:29.3744103Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 26s local ... 2025-03-14T06:40:29.5962410Z 2025-03-14T06:40:29.5963707Z  2025-03-14T06:40:29.5964136Z  2025-03-14T06:40:29.5964666Z  2025-03-14T06:40:29.5965011Z  2025-03-14T06:40:29.5965563Z  2025-03-14T06:40:29.5965921Z  2025-03-14T06:40:29.5966296Z  2025-03-14T06:40:29.5966625Z  2025-03-14T06:40:29.5967494Z [19,021 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:29.5968461Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T06:40:29.5969968Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T06:40:29.5971069Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T06:40:29.5971894Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T06:40:29.5972714Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T06:40:29.5973567Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 51s local 2025-03-14T06:40:29.5974482Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T06:40:29.5975406Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local ... 2025-03-14T06:40:29.8836714Z 2025-03-14T06:40:29.8837644Z  2025-03-14T06:40:29.8838156Z  2025-03-14T06:40:29.8838565Z  2025-03-14T06:40:29.8839030Z  2025-03-14T06:40:29.8839500Z  2025-03-14T06:40:29.8839927Z  2025-03-14T06:40:29.8840339Z  2025-03-14T06:40:29.8840733Z  2025-03-14T06:40:29.8841643Z [19,022 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:29.8842890Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T06:40:29.8843849Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T06:40:29.8844979Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 65s local 2025-03-14T06:40:29.8845931Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T06:40:29.8846827Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T06:40:29.8847854Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T06:40:29.8848754Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T06:40:29.8849674Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local ... 2025-03-14T06:40:30.0839865Z 2025-03-14T06:40:30.0840735Z  2025-03-14T06:40:30.0841266Z  2025-03-14T06:40:30.0841652Z  2025-03-14T06:40:30.0842023Z  2025-03-14T06:40:30.0842422Z  2025-03-14T06:40:30.0842851Z  2025-03-14T06:40:30.0843246Z  2025-03-14T06:40:30.0843644Z  2025-03-14T06:40:30.0844826Z [19,023 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:30.0845981Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 74s local 2025-03-14T06:40:30.0846983Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T06:40:30.0847957Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T06:40:30.0849196Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T06:40:30.0850234Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T06:40:30.0851225Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T06:40:30.0852187Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T06:40:30.0853139Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 27s local ... 2025-03-14T06:40:30.5104086Z 2025-03-14T06:40:30.5104981Z  2025-03-14T06:40:30.5105488Z  2025-03-14T06:40:30.5106166Z  2025-03-14T06:40:30.5106592Z  2025-03-14T06:40:30.5107004Z  2025-03-14T06:40:30.5107404Z  2025-03-14T06:40:30.5108009Z  2025-03-14T06:40:30.5108416Z  2025-03-14T06:40:30.5109362Z [19,024 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:30.5110602Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:40:30.5111673Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T06:40:30.5112655Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T06:40:30.5113606Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T06:40:30.5114543Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T06:40:30.5115492Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 52s local 2025-03-14T06:40:30.5116674Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 40s local 2025-03-14T06:40:30.5117539Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local ... 2025-03-14T06:40:30.7563197Z 2025-03-14T06:40:30.7564105Z  2025-03-14T06:40:30.7564719Z  2025-03-14T06:40:30.7565145Z  2025-03-14T06:40:30.7565771Z  2025-03-14T06:40:30.7566181Z  2025-03-14T06:40:30.7566572Z  2025-03-14T06:40:30.7566960Z  2025-03-14T06:40:30.7567687Z  2025-03-14T06:40:30.7568659Z [19,025 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:30.7569773Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:40:30.7570825Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T06:40:30.7571870Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 66s local 2025-03-14T06:40:30.7572821Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T06:40:30.7573766Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T06:40:30.7574756Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T06:40:30.7575686Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T06:40:30.7576575Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local ... 2025-03-14T06:40:31.0701319Z 2025-03-14T06:40:31.0702137Z  2025-03-14T06:40:31.0702637Z  2025-03-14T06:40:31.0703073Z  2025-03-14T06:40:31.0703480Z  2025-03-14T06:40:31.0703851Z  2025-03-14T06:40:31.0704239Z  2025-03-14T06:40:31.0704621Z  2025-03-14T06:40:31.0705006Z  2025-03-14T06:40:31.0705877Z [19,026 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:31.0706974Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:40:31.0707966Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T06:40:31.0708916Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T06:40:31.0709850Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T06:40:31.0710797Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T06:40:31.0711841Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T06:40:31.0712736Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T06:40:31.0713931Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local ... 2025-03-14T06:40:31.2850451Z 2025-03-14T06:40:31.2851321Z  2025-03-14T06:40:31.2851816Z  2025-03-14T06:40:31.2852238Z  2025-03-14T06:40:31.2852627Z  2025-03-14T06:40:31.2853038Z  2025-03-14T06:40:31.2853434Z  2025-03-14T06:40:31.2853836Z  2025-03-14T06:40:31.2854237Z  2025-03-14T06:40:31.2855160Z [19,027 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:31.2856577Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:40:31.2857589Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T06:40:31.2858682Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T06:40:31.2859677Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T06:40:31.2860647Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T06:40:31.2861671Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T06:40:31.2862547Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T06:40:31.2863488Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 28s local ... 2025-03-14T06:40:31.4854119Z 2025-03-14T06:40:31.4854980Z  2025-03-14T06:40:31.4855451Z  2025-03-14T06:40:31.4855839Z  2025-03-14T06:40:31.4856208Z  2025-03-14T06:40:31.4856935Z  2025-03-14T06:40:31.4857314Z  2025-03-14T06:40:31.4857705Z  2025-03-14T06:40:31.4858101Z  2025-03-14T06:40:31.4859050Z [19,029 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:31.4860132Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 75s local 2025-03-14T06:40:31.4861219Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T06:40:31.4862281Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T06:40:31.4863480Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T06:40:31.4864430Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T06:40:31.4865750Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 53s local 2025-03-14T06:40:31.4866648Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 41s local 2025-03-14T06:40:31.4867570Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local ... 2025-03-14T06:40:31.8858539Z 2025-03-14T06:40:31.8859413Z  2025-03-14T06:40:31.8859933Z  2025-03-14T06:40:31.8860403Z  2025-03-14T06:40:31.8860841Z  2025-03-14T06:40:31.8861285Z  2025-03-14T06:40:31.8861833Z  2025-03-14T06:40:31.8862253Z  2025-03-14T06:40:31.8862678Z  2025-03-14T06:40:31.8863670Z [19,030 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:31.8864906Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T06:40:31.8866299Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T06:40:31.8867386Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 67s local 2025-03-14T06:40:31.8868427Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T06:40:31.8869466Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T06:40:31.8870521Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T06:40:31.8871527Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T06:40:31.8872514Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local ... 2025-03-14T06:40:32.2144413Z 2025-03-14T06:40:32.2145342Z  2025-03-14T06:40:32.2145801Z  2025-03-14T06:40:32.2146203Z  2025-03-14T06:40:32.2146577Z  2025-03-14T06:40:32.2146987Z  2025-03-14T06:40:32.2147381Z  2025-03-14T06:40:32.2147784Z  2025-03-14T06:40:32.2148190Z  2025-03-14T06:40:32.2149358Z [19,031 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:32.2150465Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T06:40:32.2151493Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T06:40:32.2152473Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2025-03-14T06:40:32.2153635Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 59s local 2025-03-14T06:40:32.2154684Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T06:40:32.2155638Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T06:40:32.2156463Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T06:40:32.2157321Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 29s local ... 2025-03-14T06:40:32.4864030Z 2025-03-14T06:40:32.4864859Z  2025-03-14T06:40:32.4865638Z  2025-03-14T06:40:32.4866067Z  2025-03-14T06:40:32.4866507Z  2025-03-14T06:40:32.4866917Z  2025-03-14T06:40:32.4867310Z  2025-03-14T06:40:32.4867709Z  2025-03-14T06:40:32.4877525Z  2025-03-14T06:40:32.4878722Z [19,032 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:32.4879944Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 76s local 2025-03-14T06:40:32.4881044Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T06:40:32.4882427Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2025-03-14T06:40:32.4883481Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 59s local 2025-03-14T06:40:32.4884651Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T06:40:32.4885762Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 54s local 2025-03-14T06:40:32.4886774Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 42s local 2025-03-14T06:40:32.4887914Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local ... 2025-03-14T06:40:32.7980499Z 2025-03-14T06:40:32.7981339Z  2025-03-14T06:40:32.7981832Z  2025-03-14T06:40:32.7982247Z  2025-03-14T06:40:32.7982656Z  2025-03-14T06:40:32.7983071Z  2025-03-14T06:40:32.7983446Z  2025-03-14T06:40:32.7983821Z  2025-03-14T06:40:32.7984239Z  2025-03-14T06:40:32.7985166Z [19,033 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:32.7986411Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T06:40:32.7987473Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T06:40:32.7988474Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 68s local 2025-03-14T06:40:32.7989456Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T06:40:32.7990463Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T06:40:32.7991460Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T06:40:32.7992378Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T06:40:32.7993399Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 19s local ... 2025-03-14T06:40:33.0869115Z 2025-03-14T06:40:33.0869978Z  2025-03-14T06:40:33.0870479Z  2025-03-14T06:40:33.0870893Z  2025-03-14T06:40:33.0871301Z  2025-03-14T06:40:33.0871742Z  2025-03-14T06:40:33.0872150Z  2025-03-14T06:40:33.0872558Z  2025-03-14T06:40:33.0873087Z  2025-03-14T06:40:33.0874183Z [19,034 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:33.0875322Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T06:40:33.0876469Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T06:40:33.0877550Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T06:40:33.0878926Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T06:40:33.0879983Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T06:40:33.0880930Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T06:40:33.0881802Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T06:40:33.0882811Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local ... 2025-03-14T06:40:33.3355926Z 2025-03-14T06:40:33.3356791Z  2025-03-14T06:40:33.3357286Z  2025-03-14T06:40:33.3358276Z  2025-03-14T06:40:33.3358728Z  2025-03-14T06:40:33.3359102Z  2025-03-14T06:40:33.3359503Z  2025-03-14T06:40:33.3359887Z  2025-03-14T06:40:33.3360402Z  2025-03-14T06:40:33.3361323Z [19,035 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:33.3362437Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 77s local 2025-03-14T06:40:33.3363477Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T06:40:33.3364449Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T06:40:33.3365709Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T06:40:33.3366727Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T06:40:33.3367656Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 43s local 2025-03-14T06:40:33.3368771Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 30s local 2025-03-14T06:40:33.3369646Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local ... 2025-03-14T06:40:33.6607713Z 2025-03-14T06:40:33.6608594Z  2025-03-14T06:40:33.6609092Z  2025-03-14T06:40:33.6609506Z  2025-03-14T06:40:33.6609935Z  2025-03-14T06:40:33.6610352Z  2025-03-14T06:40:33.6610769Z  2025-03-14T06:40:33.6611466Z  2025-03-14T06:40:33.6611891Z  2025-03-14T06:40:33.6612884Z [19,038 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:33.6614057Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2025-03-14T06:40:33.6615300Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T06:40:33.6616375Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T06:40:33.6617404Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2025-03-14T06:40:33.6618511Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 55s local 2025-03-14T06:40:33.6619508Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T06:40:33.6620405Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T06:40:33.6621429Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local ... 2025-03-14T06:40:33.8875611Z 2025-03-14T06:40:33.8876531Z  2025-03-14T06:40:33.8877068Z  2025-03-14T06:40:33.8877501Z  2025-03-14T06:40:33.8877912Z  2025-03-14T06:40:33.8878328Z  2025-03-14T06:40:33.8878739Z  2025-03-14T06:40:33.8879146Z  2025-03-14T06:40:33.8879535Z  2025-03-14T06:40:33.8880500Z [19,038 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:33.8881679Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2025-03-14T06:40:33.8882708Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T06:40:33.8883734Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 69s local 2025-03-14T06:40:33.8884775Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2025-03-14T06:40:33.8885766Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T06:40:33.8886674Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T06:40:33.8887512Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 31s local 2025-03-14T06:40:33.8888844Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 20s local ... 2025-03-14T06:40:34.4039889Z 2025-03-14T06:40:34.4040781Z  2025-03-14T06:40:34.4041264Z  2025-03-14T06:40:34.4041645Z  2025-03-14T06:40:34.4042108Z  2025-03-14T06:40:34.4042503Z  2025-03-14T06:40:34.4042886Z  2025-03-14T06:40:34.4043309Z  2025-03-14T06:40:34.4043740Z  2025-03-14T06:40:34.4044811Z [19,039 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:34.4046353Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 78s local 2025-03-14T06:40:34.4047388Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T06:40:34.4048360Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T06:40:34.4049226Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2025-03-14T06:40:34.4050206Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T06:40:34.4051070Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 44s local 2025-03-14T06:40:34.4051963Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T06:40:34.4052899Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local ... 2025-03-14T06:40:34.6881496Z 2025-03-14T06:40:34.6882382Z  2025-03-14T06:40:34.6882886Z  2025-03-14T06:40:34.6883306Z  2025-03-14T06:40:34.6883706Z  2025-03-14T06:40:34.6884413Z  2025-03-14T06:40:34.6884916Z  2025-03-14T06:40:34.6885340Z  2025-03-14T06:40:34.6885888Z  2025-03-14T06:40:34.6886838Z [19,040 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:34.6887951Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T06:40:34.6888973Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T06:40:34.6890308Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 70s local 2025-03-14T06:40:34.6891235Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T06:40:34.6892213Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 56s local 2025-03-14T06:40:34.6893113Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T06:40:34.6893985Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T06:40:34.6894912Z Compiling llvm/lib/Target/X86/X86InstrInfo.cpp; 21s local ... 2025-03-14T06:40:35.1728332Z 2025-03-14T06:40:35.1729119Z  2025-03-14T06:40:35.1729546Z  2025-03-14T06:40:35.1729944Z  2025-03-14T06:40:35.1730309Z  2025-03-14T06:40:35.1730678Z  2025-03-14T06:40:35.1731045Z  2025-03-14T06:40:35.1731442Z  2025-03-14T06:40:35.1731811Z  2025-03-14T06:40:35.1732661Z [19,041 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:35.1733655Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T06:40:35.1734578Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T06:40:35.1735463Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T06:40:35.1736340Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T06:40:35.1737242Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T06:40:35.1738071Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T06:40:35.1738864Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 32s local 2025-03-14T06:40:35.1739773Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local ... 2025-03-14T06:40:35.4887680Z 2025-03-14T06:40:35.4888568Z  2025-03-14T06:40:35.4889084Z  2025-03-14T06:40:35.4889462Z  2025-03-14T06:40:35.4889862Z  2025-03-14T06:40:35.4890258Z  2025-03-14T06:40:35.4890678Z  2025-03-14T06:40:35.4891121Z  2025-03-14T06:40:35.4891527Z  2025-03-14T06:40:35.4892774Z [19,043 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:35.4893982Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 79s local 2025-03-14T06:40:35.4894925Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T06:40:35.4895994Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 71s local 2025-03-14T06:40:35.4896946Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T06:40:35.4897914Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 57s local 2025-03-14T06:40:35.4898799Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 45s local 2025-03-14T06:40:35.4899668Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T06:40:35.4900659Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local ... 2025-03-14T06:40:36.0092142Z 2025-03-14T06:40:36.0092947Z  2025-03-14T06:40:36.0093455Z  2025-03-14T06:40:36.0093870Z  2025-03-14T06:40:36.0094290Z  2025-03-14T06:40:36.0094688Z  2025-03-14T06:40:36.0095080Z  2025-03-14T06:40:36.0095483Z  2025-03-14T06:40:36.0095868Z  2025-03-14T06:40:36.0096805Z [19,044 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:36.0097930Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2025-03-14T06:40:36.0099255Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2025-03-14T06:40:36.0100267Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T06:40:36.0101210Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T06:40:36.0102184Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T06:40:36.0103099Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T06:40:36.0103957Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T06:40:36.0105130Z Compiling llvm/lib/CodeGen/AsmPrinter/AsmPrinter.cpp; 20s local ... 2025-03-14T06:40:36.2893582Z 2025-03-14T06:40:36.2894448Z  2025-03-14T06:40:36.2894933Z  2025-03-14T06:40:36.2895305Z  2025-03-14T06:40:36.2895710Z  2025-03-14T06:40:36.2896084Z  2025-03-14T06:40:36.2896468Z  2025-03-14T06:40:36.2896861Z  2025-03-14T06:40:36.2897226Z  2025-03-14T06:40:36.2898175Z [19,046 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:36.2899381Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 80s local 2025-03-14T06:40:36.2900458Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2025-03-14T06:40:36.2901454Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T06:40:36.2902408Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T06:40:36.2903425Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T06:40:36.2904376Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 46s local 2025-03-14T06:40:36.2905214Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 33s local 2025-03-14T06:40:36.2906013Z @llvm-project//mlir:VectorTransforms; 15s local ... 2025-03-14T06:40:36.5979531Z 2025-03-14T06:40:36.5980406Z  2025-03-14T06:40:36.5980903Z  2025-03-14T06:40:36.5981427Z  2025-03-14T06:40:36.5981792Z  2025-03-14T06:40:36.5982224Z  2025-03-14T06:40:36.5982598Z  2025-03-14T06:40:36.5982986Z  2025-03-14T06:40:36.5983378Z  2025-03-14T06:40:36.5984292Z [19,047 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:36.5985397Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T06:40:36.5986397Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2025-03-14T06:40:36.5987392Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T06:40:36.5988652Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T06:40:36.5989610Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 58s local 2025-03-14T06:40:36.5990487Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2025-03-14T06:40:36.5991216Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T06:40:36.5992007Z @llvm-project//mlir:VectorTransforms; 16s local ... 2025-03-14T06:40:36.8898967Z 2025-03-14T06:40:36.8899767Z  2025-03-14T06:40:36.8900273Z  2025-03-14T06:40:36.8900949Z  2025-03-14T06:40:36.8901405Z  2025-03-14T06:40:36.8901842Z  2025-03-14T06:40:36.8902279Z  2025-03-14T06:40:36.8902726Z  2025-03-14T06:40:36.8903128Z  2025-03-14T06:40:36.8904130Z [19,048 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:36.8905314Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T06:40:36.8906366Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T06:40:36.8907426Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 72s local 2025-03-14T06:40:36.8908501Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2025-03-14T06:40:36.8909523Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T06:40:36.8910493Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2025-03-14T06:40:36.8911586Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T06:40:36.8912434Z @llvm-project//mlir:VectorTransforms; 16s local ... 2025-03-14T06:40:37.0901855Z 2025-03-14T06:40:37.0902717Z  2025-03-14T06:40:37.0903241Z  2025-03-14T06:40:37.0903647Z  2025-03-14T06:40:37.0904018Z  2025-03-14T06:40:37.0904405Z  2025-03-14T06:40:37.0904806Z  2025-03-14T06:40:37.0905196Z  2025-03-14T06:40:37.0905983Z  2025-03-14T06:40:37.0906945Z [19,049 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:37.0908098Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T06:40:37.0909287Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T06:40:37.0910300Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T06:40:37.0911245Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2025-03-14T06:40:37.0912274Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T06:40:37.0913220Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2025-03-14T06:40:37.0914109Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T06:40:37.0914987Z @llvm-project//mlir:VectorTransforms; 16s local ... 2025-03-14T06:40:37.3333909Z 2025-03-14T06:40:37.3334827Z  2025-03-14T06:40:37.3335328Z  2025-03-14T06:40:37.3335777Z  2025-03-14T06:40:37.3336196Z  2025-03-14T06:40:37.3336578Z  2025-03-14T06:40:37.3336936Z  2025-03-14T06:40:37.3337302Z  2025-03-14T06:40:37.3337724Z  2025-03-14T06:40:37.3338643Z [19,051 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:37.3339707Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 81s local 2025-03-14T06:40:37.3340648Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T06:40:37.3341687Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T06:40:37.3342566Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2025-03-14T06:40:37.3343507Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T06:40:37.3344363Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 47s local 2025-03-14T06:40:37.3345167Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 34s local 2025-03-14T06:40:37.3346033Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:40:37.6512196Z 2025-03-14T06:40:37.6513038Z  2025-03-14T06:40:37.6513511Z  2025-03-14T06:40:37.6513888Z  2025-03-14T06:40:37.6514225Z  2025-03-14T06:40:37.6514567Z  2025-03-14T06:40:37.6514926Z  2025-03-14T06:40:37.6515309Z  2025-03-14T06:40:37.6515660Z  2025-03-14T06:40:37.6516505Z [19,052 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:37.6517704Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T06:40:37.6518619Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T06:40:37.6519491Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T06:40:37.6520323Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T06:40:37.6521192Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 59s local 2025-03-14T06:40:37.6521995Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T06:40:37.6522743Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T06:40:37.6523493Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:40:37.8907854Z 2025-03-14T06:40:37.8908668Z  2025-03-14T06:40:37.8909094Z  2025-03-14T06:40:37.8909447Z  2025-03-14T06:40:37.8909785Z  2025-03-14T06:40:37.8910133Z  2025-03-14T06:40:37.8910703Z  2025-03-14T06:40:37.8911048Z  2025-03-14T06:40:37.8911402Z  2025-03-14T06:40:37.8912257Z [19,053 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:40:37.8913243Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T06:40:37.8914149Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T06:40:37.8915087Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 73s local 2025-03-14T06:40:37.8916057Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T06:40:37.8916892Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T06:40:37.8917684Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T06:40:37.8918442Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T06:40:37.8919216Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:40:38.0912657Z 2025-03-14T06:40:38.0913460Z  2025-03-14T06:40:38.0913879Z  2025-03-14T06:40:38.0914234Z  2025-03-14T06:40:38.0914585Z  2025-03-14T06:40:38.0914926Z  2025-03-14T06:40:38.0915259Z  2025-03-14T06:40:38.0915599Z  2025-03-14T06:40:38.0915920Z  2025-03-14T06:40:38.0916730Z [19,053 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:38.0917671Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T06:40:38.0918541Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T06:40:38.0919370Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2025-03-14T06:40:38.0920144Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T06:40:38.0920961Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T06:40:38.0921716Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T06:40:38.0922447Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 35s local 2025-03-14T06:40:38.0923212Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:40:38.4208542Z 2025-03-14T06:40:38.4209394Z  2025-03-14T06:40:38.4209838Z  2025-03-14T06:40:38.4210213Z  2025-03-14T06:40:38.4210595Z  2025-03-14T06:40:38.4210967Z  2025-03-14T06:40:38.4211309Z  2025-03-14T06:40:38.4211673Z  2025-03-14T06:40:38.4212030Z  2025-03-14T06:40:38.4213186Z [19,054 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:38.4214210Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 82s local 2025-03-14T06:40:38.4215140Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T06:40:38.4216087Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2025-03-14T06:40:38.4216963Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T06:40:38.4217875Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T06:40:38.4218827Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 48s local 2025-03-14T06:40:38.4219637Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T06:40:38.4220558Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:38.6917479Z 2025-03-14T06:40:38.6918328Z  2025-03-14T06:40:38.6918812Z  2025-03-14T06:40:38.6919213Z  2025-03-14T06:40:38.6919640Z  2025-03-14T06:40:38.6920046Z  2025-03-14T06:40:38.6920455Z  2025-03-14T06:40:38.6920850Z  2025-03-14T06:40:38.6921237Z  2025-03-14T06:40:38.6922111Z [19,054 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:38.6923154Z Compiling mlir/lib/Dialect/LLVMIR/IR/NVVMDialect.cpp; 83s local 2025-03-14T06:40:38.6924141Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T06:40:38.6925568Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 74s local 2025-03-14T06:40:38.6926504Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T06:40:38.6927504Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 60s local 2025-03-14T06:40:38.6928447Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T06:40:38.6929370Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T06:40:38.6930246Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:39.1098085Z 2025-03-14T06:40:39.1099013Z  2025-03-14T06:40:39.1099510Z  2025-03-14T06:40:39.1099923Z  2025-03-14T06:40:39.1100329Z  2025-03-14T06:40:39.1100704Z  2025-03-14T06:40:39.1101079Z  2025-03-14T06:40:39.1101443Z  2025-03-14T06:40:39.1101811Z  2025-03-14T06:40:39.1102710Z [19,055 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:39.1103804Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2025-03-14T06:40:39.1104766Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T06:40:39.1105667Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T06:40:39.1106575Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2025-03-14T06:40:39.1107421Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T06:40:39.1108215Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 36s local 2025-03-14T06:40:39.1109030Z @llvm-project//mlir:VectorTransforms; 18s local 2025-03-14T06:40:39.1109751Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:40:39.4924398Z 2025-03-14T06:40:39.4925354Z  2025-03-14T06:40:39.4925823Z  2025-03-14T06:40:39.4926214Z  2025-03-14T06:40:39.4926605Z  2025-03-14T06:40:39.4927001Z  2025-03-14T06:40:39.4927408Z  2025-03-14T06:40:39.4927821Z  2025-03-14T06:40:39.4928292Z  2025-03-14T06:40:39.4929357Z [19,055 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:39.4930573Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2025-03-14T06:40:39.4931667Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T06:40:39.4932703Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T06:40:39.4933774Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 61s local 2025-03-14T06:40:39.4935143Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 49s local 2025-03-14T06:40:39.4936078Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T06:40:39.4936966Z @llvm-project//mlir:VectorTransforms; 19s local 2025-03-14T06:40:39.4937766Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:39.8929248Z 2025-03-14T06:40:39.8930106Z  2025-03-14T06:40:39.8930560Z  2025-03-14T06:40:39.8930961Z  2025-03-14T06:40:39.8931386Z  2025-03-14T06:40:39.8931774Z  2025-03-14T06:40:39.8932155Z  2025-03-14T06:40:39.8932912Z  2025-03-14T06:40:39.8933324Z  2025-03-14T06:40:39.8934250Z [19,057 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:39.8935366Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T06:40:39.8936472Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 75s local 2025-03-14T06:40:39.8937443Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T06:40:39.8938445Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T06:40:39.8939371Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T06:40:39.8940263Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T06:40:39.8941130Z @llvm-project//mlir:VectorTransforms; 19s local 2025-03-14T06:40:39.8941884Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:40.0933008Z 2025-03-14T06:40:40.0933884Z  2025-03-14T06:40:40.0934431Z  2025-03-14T06:40:40.0934848Z  2025-03-14T06:40:40.0935234Z  2025-03-14T06:40:40.0935645Z  2025-03-14T06:40:40.0936055Z  2025-03-14T06:40:40.0936461Z  2025-03-14T06:40:40.0936867Z  2025-03-14T06:40:40.0937848Z [19,059 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:40.0939492Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T06:40:40.0940544Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T06:40:40.0941556Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T06:40:40.0942602Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T06:40:40.0943578Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T06:40:40.0944508Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T06:40:40.0945461Z @llvm-project//mlir:VectorTransforms; 19s local 2025-03-14T06:40:40.0946268Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:40.3014229Z 2025-03-14T06:40:40.3015092Z  2025-03-14T06:40:40.3015611Z  2025-03-14T06:40:40.3016028Z  2025-03-14T06:40:40.3016425Z  2025-03-14T06:40:40.3016823Z  2025-03-14T06:40:40.3017227Z  2025-03-14T06:40:40.3017649Z  2025-03-14T06:40:40.3018055Z  2025-03-14T06:40:40.3019012Z [19,060 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:40.3020170Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T06:40:40.3021150Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T06:40:40.3022089Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T06:40:40.3023022Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T06:40:40.3023934Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T06:40:40.3024827Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 37s local 2025-03-14T06:40:40.3025666Z @llvm-project//mlir:VectorTransforms; 19s local 2025-03-14T06:40:40.3026410Z @llvm-project//mlir:VectorTransforms; 19s local ... 2025-03-14T06:40:40.5599592Z 2025-03-14T06:40:40.5600475Z  2025-03-14T06:40:40.5600960Z  2025-03-14T06:40:40.5601430Z  2025-03-14T06:40:40.5601956Z  2025-03-14T06:40:40.5602635Z  2025-03-14T06:40:40.5603080Z  2025-03-14T06:40:40.5603470Z  2025-03-14T06:40:40.5603859Z  2025-03-14T06:40:40.5604929Z [19,061 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:40.5606064Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T06:40:40.5607081Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T06:40:40.5608285Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T06:40:40.5609310Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 62s local 2025-03-14T06:40:40.5610194Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 50s local 2025-03-14T06:40:40.5611079Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T06:40:40.5611946Z @llvm-project//mlir:VectorTransforms; 20s local 2025-03-14T06:40:40.5612716Z @llvm-project//mlir:VectorTransforms; 19s local ... 2025-03-14T06:40:40.7750107Z 2025-03-14T06:40:40.7750954Z  2025-03-14T06:40:40.7751439Z  2025-03-14T06:40:40.7751838Z  2025-03-14T06:40:40.7752233Z  2025-03-14T06:40:40.7752742Z  2025-03-14T06:40:40.7753139Z  2025-03-14T06:40:40.7753528Z  2025-03-14T06:40:40.7753921Z  2025-03-14T06:40:40.7754897Z [19,063 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:40.7756415Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T06:40:40.7757498Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 76s local 2025-03-14T06:40:40.7758515Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T06:40:40.7759607Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2025-03-14T06:40:40.7760571Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T06:40:40.7761647Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T06:40:40.7762579Z @llvm-project//mlir:VectorTransforms; 19s local 2025-03-14T06:40:40.7763483Z @llvm-project//mlir:VectorTransforms; 14s local ... 2025-03-14T06:40:41.0940776Z 2025-03-14T06:40:41.0941666Z  2025-03-14T06:40:41.0942170Z  2025-03-14T06:40:41.0942620Z  2025-03-14T06:40:41.0943046Z  2025-03-14T06:40:41.0943475Z  2025-03-14T06:40:41.0943910Z  2025-03-14T06:40:41.0944373Z  2025-03-14T06:40:41.0944801Z  2025-03-14T06:40:41.0945784Z [19,063 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:41.0947091Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T06:40:41.0948109Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T06:40:41.0949054Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T06:40:41.0950073Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2025-03-14T06:40:41.0951034Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T06:40:41.0951993Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 38s local 2025-03-14T06:40:41.0952909Z @llvm-project//mlir:VectorTransforms; 19s local 2025-03-14T06:40:41.0953711Z @llvm-project//mlir:VectorTransforms; 14s local ... 2025-03-14T06:40:41.4944760Z 2025-03-14T06:40:41.4945653Z  2025-03-14T06:40:41.4946219Z  2025-03-14T06:40:41.4946626Z  2025-03-14T06:40:41.4947006Z  2025-03-14T06:40:41.4947422Z  2025-03-14T06:40:41.4947823Z  2025-03-14T06:40:41.4948256Z  2025-03-14T06:40:41.4948672Z  2025-03-14T06:40:41.4949652Z [19,065 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:41.4950848Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T06:40:41.4951870Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T06:40:41.4953108Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T06:40:41.4954261Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 63s local 2025-03-14T06:40:41.4955206Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 51s local 2025-03-14T06:40:41.4956077Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T06:40:41.4956970Z @llvm-project//mlir:VectorTransforms; 14s local 2025-03-14T06:40:41.4957918Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 13s local ... 2025-03-14T06:40:41.7886132Z 2025-03-14T06:40:41.7886969Z  2025-03-14T06:40:41.7887445Z  2025-03-14T06:40:41.7887859Z  2025-03-14T06:40:41.7888260Z  2025-03-14T06:40:41.7888653Z  2025-03-14T06:40:41.7889045Z  2025-03-14T06:40:41.7889466Z  2025-03-14T06:40:41.7889866Z  2025-03-14T06:40:41.7890807Z [19,067 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:41.7891997Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T06:40:41.7893026Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 77s local 2025-03-14T06:40:41.7893998Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T06:40:41.7894973Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T06:40:41.7895896Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2025-03-14T06:40:41.7896999Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T06:40:41.7897884Z @llvm-project//mlir:VectorTransforms; 15s local 2025-03-14T06:40:41.7898849Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 13s local ... 2025-03-14T06:40:42.0167182Z 2025-03-14T06:40:42.0168023Z  2025-03-14T06:40:42.0168504Z  2025-03-14T06:40:42.0168922Z  2025-03-14T06:40:42.0169308Z  2025-03-14T06:40:42.0170016Z  2025-03-14T06:40:42.0170409Z  2025-03-14T06:40:42.0170802Z  2025-03-14T06:40:42.0171203Z  2025-03-14T06:40:42.0172150Z [19,069 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:42.0173308Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T06:40:42.0174324Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T06:40:42.0175255Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T06:40:42.0176263Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T06:40:42.0177198Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2025-03-14T06:40:42.0178091Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T06:40:42.0179160Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 14s local 2025-03-14T06:40:42.0180417Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local ... 2025-03-14T06:40:42.2951105Z 2025-03-14T06:40:42.2951993Z  2025-03-14T06:40:42.2952522Z  2025-03-14T06:40:42.2952930Z  2025-03-14T06:40:42.2953338Z  2025-03-14T06:40:42.2953760Z  2025-03-14T06:40:42.2954129Z  2025-03-14T06:40:42.2954488Z  2025-03-14T06:40:42.2954859Z  2025-03-14T06:40:42.2955879Z [19,070 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:42.2957020Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T06:40:42.2958045Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T06:40:42.2959027Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T06:40:42.2960017Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T06:40:42.2961022Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2025-03-14T06:40:42.2961875Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 39s local 2025-03-14T06:40:42.2963210Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 14s local 2025-03-14T06:40:42.2964392Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 13s local ... 2025-03-14T06:40:42.5861523Z 2025-03-14T06:40:42.5862371Z  2025-03-14T06:40:42.5862851Z  2025-03-14T06:40:42.5863272Z  2025-03-14T06:40:42.5863673Z  2025-03-14T06:40:42.5864078Z  2025-03-14T06:40:42.5864479Z  2025-03-14T06:40:42.5864907Z  2025-03-14T06:40:42.5865512Z  2025-03-14T06:40:42.5866713Z [19,071 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:42.5867848Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T06:40:42.5868839Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T06:40:42.5869761Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T06:40:42.5870751Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 64s local 2025-03-14T06:40:42.5871697Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 52s local 2025-03-14T06:40:42.5872564Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T06:40:42.5873605Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 14s local 2025-03-14T06:40:42.5874731Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local ... 2025-03-14T06:40:42.8956281Z 2025-03-14T06:40:42.8957089Z  2025-03-14T06:40:42.8957857Z  2025-03-14T06:40:42.8958237Z  2025-03-14T06:40:42.8958638Z  2025-03-14T06:40:42.8959049Z  2025-03-14T06:40:42.8959459Z  2025-03-14T06:40:42.8959854Z  2025-03-14T06:40:42.8960205Z  2025-03-14T06:40:42.8961110Z [19,072 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:42.8962262Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T06:40:42.8963480Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 78s local 2025-03-14T06:40:42.8964403Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T06:40:42.8965745Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T06:40:42.8966678Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T06:40:42.8967548Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T06:40:42.8968545Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 14s local 2025-03-14T06:40:42.8969654Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local ... 2025-03-14T06:40:43.1031139Z 2025-03-14T06:40:43.1032071Z  2025-03-14T06:40:43.1032543Z  2025-03-14T06:40:43.1032973Z  2025-03-14T06:40:43.1033391Z  2025-03-14T06:40:43.1033725Z  2025-03-14T06:40:43.1034177Z  2025-03-14T06:40:43.1034629Z  2025-03-14T06:40:43.1034994Z  2025-03-14T06:40:43.1035903Z [19,073 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:43.1037005Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T06:40:43.1038070Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T06:40:43.1038975Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T06:40:43.1039990Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T06:40:43.1040826Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T06:40:43.1041520Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T06:40:43.1042561Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 15s local 2025-03-14T06:40:43.1043509Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 14s local ... 2025-03-14T06:40:43.3691473Z 2025-03-14T06:40:43.3692269Z  2025-03-14T06:40:43.3692726Z  2025-03-14T06:40:43.3693167Z  2025-03-14T06:40:43.3693568Z  2025-03-14T06:40:43.3694193Z  2025-03-14T06:40:43.3694590Z  2025-03-14T06:40:43.3694986Z  2025-03-14T06:40:43.3695357Z  2025-03-14T06:40:43.3696298Z [19,075 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:43.3697393Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T06:40:43.3698379Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T06:40:43.3699345Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T06:40:43.3700506Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 65s local 2025-03-14T06:40:43.3701409Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 53s local 2025-03-14T06:40:43.3702217Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 40s local 2025-03-14T06:40:43.3703263Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 15s local 2025-03-14T06:40:43.3704449Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local ... 2025-03-14T06:40:43.6962178Z 2025-03-14T06:40:43.6963093Z  2025-03-14T06:40:43.6963583Z  2025-03-14T06:40:43.6963983Z  2025-03-14T06:40:43.6964393Z  2025-03-14T06:40:43.6964957Z  2025-03-14T06:40:43.6965541Z  2025-03-14T06:40:43.6965930Z  2025-03-14T06:40:43.6966312Z  2025-03-14T06:40:43.6967355Z [19,076 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:43.6968767Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T06:40:43.6969739Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 79s local 2025-03-14T06:40:43.6970646Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T06:40:43.6971635Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T06:40:43.6972627Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T06:40:43.6973779Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T06:40:43.6974743Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 15s local 2025-03-14T06:40:43.6975897Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local ... 2025-03-14T06:40:44.1687019Z 2025-03-14T06:40:44.1687820Z  2025-03-14T06:40:44.1688311Z  2025-03-14T06:40:44.1688679Z  2025-03-14T06:40:44.1689050Z  2025-03-14T06:40:44.1689425Z  2025-03-14T06:40:44.1689849Z  2025-03-14T06:40:44.1690237Z  2025-03-14T06:40:44.1690611Z  2025-03-14T06:40:44.1691522Z [19,077 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:44.1692639Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2025-03-14T06:40:44.1693634Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T06:40:44.1694533Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T06:40:44.1695513Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T06:40:44.1696430Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T06:40:44.1697262Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 41s local 2025-03-14T06:40:44.1698221Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 16s local 2025-03-14T06:40:44.1699338Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 15s local ... 2025-03-14T06:40:44.4842086Z 2025-03-14T06:40:44.4842956Z  2025-03-14T06:40:44.4843448Z  2025-03-14T06:40:44.4843871Z  2025-03-14T06:40:44.4844282Z  2025-03-14T06:40:44.4844800Z  2025-03-14T06:40:44.4845180Z  2025-03-14T06:40:44.4845574Z  2025-03-14T06:40:44.4845938Z  2025-03-14T06:40:44.4846859Z [19,078 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:44.4847982Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2025-03-14T06:40:44.4849256Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T06:40:44.4850157Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T06:40:44.4851088Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 66s local 2025-03-14T06:40:44.4851951Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 54s local 2025-03-14T06:40:44.4852747Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T06:40:44.4853931Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 16s local 2025-03-14T06:40:44.4855248Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local ... 2025-03-14T06:40:44.6970736Z 2025-03-14T06:40:44.6971644Z  2025-03-14T06:40:44.6972102Z  2025-03-14T06:40:44.6972528Z  2025-03-14T06:40:44.6972926Z  2025-03-14T06:40:44.6973321Z  2025-03-14T06:40:44.6973716Z  2025-03-14T06:40:44.6974142Z  2025-03-14T06:40:44.6974527Z  2025-03-14T06:40:44.6975482Z [19,078 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:44.6976606Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2025-03-14T06:40:44.6977551Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T06:40:44.6978438Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T06:40:44.6979352Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T06:40:44.6980486Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T06:40:44.6981336Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T06:40:44.6982268Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 16s local 2025-03-14T06:40:44.6983349Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local ... 2025-03-14T06:40:44.8973400Z 2025-03-14T06:40:44.8974445Z  2025-03-14T06:40:44.8974877Z  2025-03-14T06:40:44.8975244Z  2025-03-14T06:40:44.8975654Z  2025-03-14T06:40:44.8976066Z  2025-03-14T06:40:44.8976455Z  2025-03-14T06:40:44.8976843Z  2025-03-14T06:40:44.8977243Z  2025-03-14T06:40:44.8978120Z [19,080 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:44.8979155Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T06:40:44.8980069Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 80s local 2025-03-14T06:40:44.8980886Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T06:40:44.8981733Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T06:40:44.8982518Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T06:40:44.8983272Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T06:40:44.8984180Z Compiling mlir/lib/Conversion/VectorToSCF/VectorToSCF.cpp; 16s local 2025-03-14T06:40:44.8985158Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local ... 2025-03-14T06:40:45.2786848Z 2025-03-14T06:40:45.2787716Z  2025-03-14T06:40:45.2788201Z  2025-03-14T06:40:45.2788623Z  2025-03-14T06:40:45.2789032Z  2025-03-14T06:40:45.2789441Z  2025-03-14T06:40:45.2789858Z  2025-03-14T06:40:45.2790278Z  2025-03-14T06:40:45.2790694Z  2025-03-14T06:40:45.2791679Z [19,081 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:45.2792939Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T06:40:45.2794019Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2025-03-14T06:40:45.2795033Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T06:40:45.2796110Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T06:40:45.2797089Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T06:40:45.2798313Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 42s local 2025-03-14T06:40:45.2799535Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local 2025-03-14T06:40:45.2800732Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 15s local ... 2025-03-14T06:40:45.4976990Z 2025-03-14T06:40:45.4977842Z  2025-03-14T06:40:45.4978352Z  2025-03-14T06:40:45.4978748Z  2025-03-14T06:40:45.4979180Z  2025-03-14T06:40:45.4979561Z  2025-03-14T06:40:45.4979965Z  2025-03-14T06:40:45.4980677Z  2025-03-14T06:40:45.4981101Z  2025-03-14T06:40:45.4991402Z [19,082 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:45.4992916Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T06:40:45.4993957Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2025-03-14T06:40:45.4994941Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T06:40:45.4995924Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 67s local 2025-03-14T06:40:45.4996850Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 55s local 2025-03-14T06:40:45.4997699Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T06:40:45.4998720Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T06:40:45.4999802Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 15s local ... 2025-03-14T06:40:45.8640775Z 2025-03-14T06:40:45.8641686Z  2025-03-14T06:40:45.8642194Z  2025-03-14T06:40:45.8642605Z  2025-03-14T06:40:45.8643000Z  2025-03-14T06:40:45.8643397Z  2025-03-14T06:40:45.8643784Z  2025-03-14T06:40:45.8644181Z  2025-03-14T06:40:45.8644716Z  2025-03-14T06:40:45.8645626Z [19,084 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:45.8647034Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:40:45.8648009Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 81s local 2025-03-14T06:40:45.8648924Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2025-03-14T06:40:45.8649881Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T06:40:45.8650782Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T06:40:45.8651636Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T06:40:45.8652638Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T06:40:45.8653698Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local ... 2025-03-14T06:40:46.0981674Z 2025-03-14T06:40:46.0982560Z  2025-03-14T06:40:46.0983046Z  2025-03-14T06:40:46.0983428Z  2025-03-14T06:40:46.0983812Z  2025-03-14T06:40:46.0984229Z  2025-03-14T06:40:46.0984628Z  2025-03-14T06:40:46.0985040Z  2025-03-14T06:40:46.0985470Z  2025-03-14T06:40:46.0986446Z [19,085 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:46.0987613Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:40:46.0988765Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgOps.cpp; 82s local 2025-03-14T06:40:46.0989684Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2025-03-14T06:40:46.0990659Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T06:40:46.0991543Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T06:40:46.0992363Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T06:40:46.0993311Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T06:40:46.0994353Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local ... 2025-03-14T06:40:46.3138585Z 2025-03-14T06:40:46.3139412Z  2025-03-14T06:40:46.3140117Z  2025-03-14T06:40:46.3140534Z  2025-03-14T06:40:46.3140918Z  2025-03-14T06:40:46.3141308Z  2025-03-14T06:40:46.3141691Z  2025-03-14T06:40:46.3142069Z  2025-03-14T06:40:46.3142461Z  2025-03-14T06:40:46.3143349Z [19,086 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:46.3144434Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:40:46.3145578Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2025-03-14T06:40:46.3146540Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T06:40:46.3147400Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T06:40:46.3148232Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 43s local 2025-03-14T06:40:46.3149248Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T06:40:46.3150315Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local 2025-03-14T06:40:46.3151513Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 14s local ... 2025-03-14T06:40:46.5150897Z 2025-03-14T06:40:46.5151780Z  2025-03-14T06:40:46.5152273Z  2025-03-14T06:40:46.5152670Z  2025-03-14T06:40:46.5153075Z  2025-03-14T06:40:46.5153483Z  2025-03-14T06:40:46.5153898Z  2025-03-14T06:40:46.5154311Z  2025-03-14T06:40:46.5155041Z  2025-03-14T06:40:46.5156013Z [19,089 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:46.5157161Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:40:46.5158159Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2025-03-14T06:40:46.5159187Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 68s local 2025-03-14T06:40:46.5160111Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 56s local 2025-03-14T06:40:46.5161160Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T06:40:46.5162124Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2025-03-14T06:40:46.5163233Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local 2025-03-14T06:40:46.5164218Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 15s local ... 2025-03-14T06:40:46.7503303Z 2025-03-14T06:40:46.7504144Z  2025-03-14T06:40:46.7504656Z  2025-03-14T06:40:46.7505067Z  2025-03-14T06:40:46.7505482Z  2025-03-14T06:40:46.7505894Z  2025-03-14T06:40:46.7506284Z  2025-03-14T06:40:46.7506654Z  2025-03-14T06:40:46.7507037Z  2025-03-14T06:40:46.7507958Z [19,090 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:46.7509052Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:40:46.7510042Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T06:40:46.7511193Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T06:40:46.7512175Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2025-03-14T06:40:46.7513053Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T06:40:46.7514134Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2025-03-14T06:40:46.7515243Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 17s local 2025-03-14T06:40:46.7516312Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 15s local ... 2025-03-14T06:40:47.0988734Z 2025-03-14T06:40:47.0989609Z  2025-03-14T06:40:47.0990091Z  2025-03-14T06:40:47.0990498Z  2025-03-14T06:40:47.0990920Z  2025-03-14T06:40:47.0991456Z  2025-03-14T06:40:47.0991857Z  2025-03-14T06:40:47.0992248Z  2025-03-14T06:40:47.0992630Z  2025-03-14T06:40:47.0993860Z [19,090 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:47.0995090Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2025-03-14T06:40:47.0996179Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T06:40:47.0997252Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 69s local 2025-03-14T06:40:47.0998267Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 57s local 2025-03-14T06:40:47.0999192Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 44s local 2025-03-14T06:40:47.1000427Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2025-03-14T06:40:47.1001576Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 17s local 2025-03-14T06:40:47.1002632Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 15s local ... 2025-03-14T06:40:47.8685868Z 2025-03-14T06:40:47.8686760Z  2025-03-14T06:40:47.8687247Z  2025-03-14T06:40:47.8687656Z  2025-03-14T06:40:47.8688108Z  2025-03-14T06:40:47.8688504Z  2025-03-14T06:40:47.8688909Z  2025-03-14T06:40:47.8689331Z  2025-03-14T06:40:47.8689734Z  2025-03-14T06:40:47.8690659Z [19,091 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:47.8691825Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T06:40:47.8692817Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T06:40:47.8694139Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T06:40:47.8695043Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T06:40:47.8695936Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T06:40:47.8696997Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T06:40:47.8698051Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2025-03-14T06:40:47.8699188Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 16s local ... 2025-03-14T06:40:48.0995498Z 2025-03-14T06:40:48.0996334Z  2025-03-14T06:40:48.0996814Z  2025-03-14T06:40:48.0997221Z  2025-03-14T06:40:48.0997615Z  2025-03-14T06:40:48.0998019Z  2025-03-14T06:40:48.0998429Z  2025-03-14T06:40:48.0998820Z  2025-03-14T06:40:48.0999196Z  2025-03-14T06:40:48.1000162Z [19,092 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:48.1001342Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T06:40:48.1002360Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T06:40:48.1003340Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T06:40:48.1004281Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T06:40:48.1005281Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 45s local 2025-03-14T06:40:48.1006280Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T06:40:48.1007409Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2025-03-14T06:40:48.1008434Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 16s local ... 2025-03-14T06:40:48.4390780Z 2025-03-14T06:40:48.4391668Z  2025-03-14T06:40:48.4392188Z  2025-03-14T06:40:48.4392629Z  2025-03-14T06:40:48.4393028Z  2025-03-14T06:40:48.4393471Z  2025-03-14T06:40:48.4393905Z  2025-03-14T06:40:48.4394432Z  2025-03-14T06:40:48.4394854Z  2025-03-14T06:40:48.4395804Z [19,093 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:48.4397041Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T06:40:48.4398103Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T06:40:48.4399183Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 70s local 2025-03-14T06:40:48.4400410Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 58s local 2025-03-14T06:40:48.4401379Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T06:40:48.4402491Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T06:40:48.4403800Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2025-03-14T06:40:48.4404990Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 17s local ... 2025-03-14T06:40:48.6999925Z 2025-03-14T06:40:48.7000726Z  2025-03-14T06:40:48.7001157Z  2025-03-14T06:40:48.7001519Z  2025-03-14T06:40:48.7002174Z  2025-03-14T06:40:48.7002646Z  2025-03-14T06:40:48.7003048Z  2025-03-14T06:40:48.7003451Z  2025-03-14T06:40:48.7003809Z  2025-03-14T06:40:48.7004842Z [19,093 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:48.7005828Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T06:40:48.7006698Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T06:40:48.7007550Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T06:40:48.7008373Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T06:40:48.7009122Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T06:40:48.7009952Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T06:40:48.7011074Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2025-03-14T06:40:48.7011871Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 17s local ... 2025-03-14T06:40:48.9003391Z 2025-03-14T06:40:48.9004226Z  2025-03-14T06:40:48.9004819Z  2025-03-14T06:40:48.9005197Z  2025-03-14T06:40:48.9005557Z  2025-03-14T06:40:48.9005917Z  2025-03-14T06:40:48.9006278Z  2025-03-14T06:40:48.9006639Z  2025-03-14T06:40:48.9007252Z  2025-03-14T06:40:48.9008314Z [19,094 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:48.9009461Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2025-03-14T06:40:48.9010294Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T06:40:48.9011104Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T06:40:48.9011854Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T06:40:48.9012666Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T06:40:48.9013711Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T06:40:48.9014745Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2025-03-14T06:40:48.9015631Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 17s local ... 2025-03-14T06:40:49.3008288Z 2025-03-14T06:40:49.3009108Z  2025-03-14T06:40:49.3009587Z  2025-03-14T06:40:49.3010003Z  2025-03-14T06:40:49.3010395Z  2025-03-14T06:40:49.3010793Z  2025-03-14T06:40:49.3011169Z  2025-03-14T06:40:49.3011543Z  2025-03-14T06:40:49.3011915Z  2025-03-14T06:40:49.3012858Z [19,096 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:49.3013984Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2025-03-14T06:40:49.3014940Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T06:40:49.3015961Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T06:40:49.3016868Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T06:40:49.3017761Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 46s local 2025-03-14T06:40:49.3018766Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T06:40:49.3019868Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2025-03-14T06:40:49.3021322Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 17s local ... 2025-03-14T06:40:49.5480604Z 2025-03-14T06:40:49.5481410Z  2025-03-14T06:40:49.5481878Z  2025-03-14T06:40:49.5482261Z  2025-03-14T06:40:49.5482636Z  2025-03-14T06:40:49.5483004Z  2025-03-14T06:40:49.5483373Z  2025-03-14T06:40:49.5483748Z  2025-03-14T06:40:49.5484124Z  2025-03-14T06:40:49.5485172Z [19,097 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:49.5486572Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2025-03-14T06:40:49.5487404Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T06:40:49.5488215Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 71s local 2025-03-14T06:40:49.5488950Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 59s local 2025-03-14T06:40:49.5489742Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T06:40:49.5490591Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T06:40:49.5491548Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2025-03-14T06:40:49.5492461Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 18s local ... 2025-03-14T06:40:49.8789895Z 2025-03-14T06:40:49.8790733Z  2025-03-14T06:40:49.8791257Z  2025-03-14T06:40:49.8791700Z  2025-03-14T06:40:49.8792130Z  2025-03-14T06:40:49.8792844Z  2025-03-14T06:40:49.8793239Z  2025-03-14T06:40:49.8793656Z  2025-03-14T06:40:49.8794037Z  2025-03-14T06:40:49.8794996Z [19,098 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:49.8796128Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2025-03-14T06:40:49.8797159Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2025-03-14T06:40:49.8798383Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T06:40:49.8799343Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T06:40:49.8800261Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T06:40:49.8801304Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T06:40:49.8802504Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2025-03-14T06:40:49.8803548Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 18s local ... 2025-03-14T06:40:50.1014419Z 2025-03-14T06:40:50.1015253Z  2025-03-14T06:40:50.1015773Z  2025-03-14T06:40:50.1016170Z  2025-03-14T06:40:50.1016574Z  2025-03-14T06:40:50.1016963Z  2025-03-14T06:40:50.1017383Z  2025-03-14T06:40:50.1017777Z  2025-03-14T06:40:50.1018163Z  2025-03-14T06:40:50.1019089Z [19,100 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:50.1020224Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2025-03-14T06:40:50.1021210Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2025-03-14T06:40:50.1022154Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T06:40:50.1023076Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T06:40:50.1023955Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 47s local 2025-03-14T06:40:50.1024971Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T06:40:50.1026096Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2025-03-14T06:40:50.1027072Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 18s local ... 2025-03-14T06:40:50.5018838Z 2025-03-14T06:40:50.5019638Z  2025-03-14T06:40:50.5020059Z  2025-03-14T06:40:50.5020442Z  2025-03-14T06:40:50.5020830Z  2025-03-14T06:40:50.5021231Z  2025-03-14T06:40:50.5021595Z  2025-03-14T06:40:50.5022050Z  2025-03-14T06:40:50.5022428Z  2025-03-14T06:40:50.5023676Z [19,103 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:50.5024752Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2025-03-14T06:40:50.5025707Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 72s local 2025-03-14T06:40:50.5026704Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 60s local 2025-03-14T06:40:50.5027568Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T06:40:50.5028792Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 22s local 2025-03-14T06:40:50.5029911Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2025-03-14T06:40:50.5031005Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 19s local 2025-03-14T06:40:50.5032127Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 18s local ... 2025-03-14T06:40:50.7020826Z 2025-03-14T06:40:50.7021677Z  2025-03-14T06:40:50.7022126Z  2025-03-14T06:40:50.7022532Z  2025-03-14T06:40:50.7022907Z  2025-03-14T06:40:50.7023258Z  2025-03-14T06:40:50.7023603Z  2025-03-14T06:40:50.7023952Z  2025-03-14T06:40:50.7024308Z  2025-03-14T06:40:50.7025126Z [19,105 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:50.7026084Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T06:40:50.7027303Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T06:40:50.7028123Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2025-03-14T06:40:50.7028899Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T06:40:50.7029751Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2025-03-14T06:40:50.7030759Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 19s local 2025-03-14T06:40:50.7031915Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T06:40:50.7032854Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 17s local ... 2025-03-14T06:40:51.0181739Z 2025-03-14T06:40:51.0182518Z  2025-03-14T06:40:51.0182942Z  2025-03-14T06:40:51.0183295Z  2025-03-14T06:40:51.0183640Z  2025-03-14T06:40:51.0183975Z  2025-03-14T06:40:51.0184313Z  2025-03-14T06:40:51.0184657Z  2025-03-14T06:40:51.0185032Z  2025-03-14T06:40:51.0185812Z [19,106 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:51.0186767Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T06:40:51.0187598Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T06:40:51.0188365Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2025-03-14T06:40:51.0189079Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T06:40:51.0189953Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2025-03-14T06:40:51.0190884Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 19s local 2025-03-14T06:40:51.0191793Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T06:40:51.0192674Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 18s local ... 2025-03-14T06:40:51.3024543Z 2025-03-14T06:40:51.3025457Z  2025-03-14T06:40:51.3025998Z  2025-03-14T06:40:51.3026409Z  2025-03-14T06:40:51.3026829Z  2025-03-14T06:40:51.3027259Z  2025-03-14T06:40:51.3027651Z  2025-03-14T06:40:51.3028032Z  2025-03-14T06:40:51.3028434Z  2025-03-14T06:40:51.3029362Z [19,107 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:51.3030442Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T06:40:51.3031408Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T06:40:51.3032749Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2025-03-14T06:40:51.3033613Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 48s local 2025-03-14T06:40:51.3034641Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2025-03-14T06:40:51.3035803Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 19s local 2025-03-14T06:40:51.3036940Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 19s local 2025-03-14T06:40:51.3038144Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 18s local ... 2025-03-14T06:40:51.5773084Z 2025-03-14T06:40:51.5773999Z  2025-03-14T06:40:51.5774574Z  2025-03-14T06:40:51.5774970Z  2025-03-14T06:40:51.5775368Z  2025-03-14T06:40:51.5775788Z  2025-03-14T06:40:51.5776195Z  2025-03-14T06:40:51.5776596Z  2025-03-14T06:40:51.5776986Z  2025-03-14T06:40:51.5777972Z [19,109 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:51.5779073Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T06:40:51.5780036Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 73s local 2025-03-14T06:40:51.5780915Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 61s local 2025-03-14T06:40:51.5781800Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T06:40:51.5783105Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2025-03-14T06:40:51.5784148Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 20s local 2025-03-14T06:40:51.5785280Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T06:40:51.5786303Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 18s local ... 2025-03-14T06:40:51.9030502Z 2025-03-14T06:40:51.9031512Z  2025-03-14T06:40:51.9032236Z  2025-03-14T06:40:51.9032960Z  2025-03-14T06:40:51.9033345Z  2025-03-14T06:40:51.9033763Z  2025-03-14T06:40:51.9034173Z  2025-03-14T06:40:51.9034573Z  2025-03-14T06:40:51.9034998Z  2025-03-14T06:40:51.9035937Z [19,110 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:51.9037035Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2025-03-14T06:40:51.9038006Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T06:40:51.9038865Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2025-03-14T06:40:51.9039723Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T06:40:51.9040723Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2025-03-14T06:40:51.9041799Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 20s local 2025-03-14T06:40:51.9042809Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T06:40:51.9043819Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 19s local ... 2025-03-14T06:40:52.3033943Z 2025-03-14T06:40:52.3035928Z  2025-03-14T06:40:52.3036434Z  2025-03-14T06:40:52.3036859Z  2025-03-14T06:40:52.3037287Z  2025-03-14T06:40:52.3037717Z  2025-03-14T06:40:52.3038148Z  2025-03-14T06:40:52.3038542Z  2025-03-14T06:40:52.3038933Z  2025-03-14T06:40:52.3039865Z [19,111 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:52.3040991Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2025-03-14T06:40:52.3041994Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T06:40:52.3042943Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2025-03-14T06:40:52.3043792Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 49s local 2025-03-14T06:40:52.3044996Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2025-03-14T06:40:52.3046372Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 20s local 2025-03-14T06:40:52.3047510Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T06:40:52.3048583Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 19s local ... 2025-03-14T06:40:52.5118491Z 2025-03-14T06:40:52.5119359Z  2025-03-14T06:40:52.5119985Z  2025-03-14T06:40:52.5120579Z  2025-03-14T06:40:52.5120960Z  2025-03-14T06:40:52.5121363Z  2025-03-14T06:40:52.5122213Z  2025-03-14T06:40:52.5122747Z  2025-03-14T06:40:52.5123523Z  2025-03-14T06:40:52.5124779Z [19,114 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:52.5126042Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2025-03-14T06:40:52.5127339Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 74s local 2025-03-14T06:40:52.5128503Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 62s local 2025-03-14T06:40:52.5129565Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T06:40:52.5130714Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2025-03-14T06:40:52.5131954Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 20s local 2025-03-14T06:40:52.5133173Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 19s local 2025-03-14T06:40:52.5134204Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 18s local ... 2025-03-14T06:40:52.7542912Z 2025-03-14T06:40:52.7543801Z  2025-03-14T06:40:52.7544318Z  2025-03-14T06:40:52.7544710Z  2025-03-14T06:40:52.7545089Z  2025-03-14T06:40:52.7545473Z  2025-03-14T06:40:52.7545866Z  2025-03-14T06:40:52.7546275Z  2025-03-14T06:40:52.7546680Z  2025-03-14T06:40:52.7547617Z [19,115 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:52.7549021Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T06:40:52.7549988Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T06:40:52.7550915Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T06:40:52.7551814Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T06:40:52.7552829Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2025-03-14T06:40:52.7553976Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2025-03-14T06:40:52.7554955Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 19s local 2025-03-14T06:40:52.7555863Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 18s local ... 2025-03-14T06:40:53.1039354Z 2025-03-14T06:40:53.1040210Z  2025-03-14T06:40:53.1040678Z  2025-03-14T06:40:53.1041066Z  2025-03-14T06:40:53.1041511Z  2025-03-14T06:40:53.1042000Z  2025-03-14T06:40:53.1042501Z  2025-03-14T06:40:53.1042900Z  2025-03-14T06:40:53.1043323Z  2025-03-14T06:40:53.1044435Z [19,115 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:53.1045832Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T06:40:53.1047283Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T06:40:53.1048305Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T06:40:53.1049402Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 50s local 2025-03-14T06:40:53.1050624Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2025-03-14T06:40:53.1051946Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2025-03-14T06:40:53.1053191Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local 2025-03-14T06:40:53.1054315Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 18s local ... 2025-03-14T06:40:53.4198844Z 2025-03-14T06:40:53.4199736Z  2025-03-14T06:40:53.4201614Z  2025-03-14T06:40:53.4202383Z  2025-03-14T06:40:53.4202830Z  2025-03-14T06:40:53.4203374Z  2025-03-14T06:40:53.4203887Z  2025-03-14T06:40:53.4204305Z  2025-03-14T06:40:53.4204939Z  2025-03-14T06:40:53.4205943Z [19,116 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:53.4207183Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T06:40:53.4208430Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T06:40:53.4209609Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 63s local 2025-03-14T06:40:53.4210608Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T06:40:53.4211692Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2025-03-14T06:40:53.4212910Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 21s local 2025-03-14T06:40:53.4214033Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local 2025-03-14T06:40:53.4214991Z @xla//xla/mlir_hlo:legalize_to_linalg_utils; 19s local ... 2025-03-14T06:40:53.6728896Z 2025-03-14T06:40:53.6729703Z  2025-03-14T06:40:53.6730140Z  2025-03-14T06:40:53.6730530Z  2025-03-14T06:40:53.6730924Z  2025-03-14T06:40:53.6731318Z  2025-03-14T06:40:53.6731682Z  2025-03-14T06:40:53.6732062Z  2025-03-14T06:40:53.6732441Z  2025-03-14T06:40:53.6733752Z [19,119 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:53.6734705Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T06:40:53.6735604Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 75s local 2025-03-14T06:40:53.6736449Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2025-03-14T06:40:53.6737216Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T06:40:53.6738264Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T06:40:53.6739189Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local 2025-03-14T06:40:53.6740148Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 19s local 2025-03-14T06:40:53.6741045Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:40:53.9046792Z 2025-03-14T06:40:53.9047674Z  2025-03-14T06:40:53.9048181Z  2025-03-14T06:40:53.9048613Z  2025-03-14T06:40:53.9049064Z  2025-03-14T06:40:53.9049491Z  2025-03-14T06:40:53.9049908Z  2025-03-14T06:40:53.9050347Z  2025-03-14T06:40:53.9050765Z  2025-03-14T06:40:53.9051789Z [19,120 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:53.9052953Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T06:40:53.9054010Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T06:40:53.9055011Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2025-03-14T06:40:53.9055946Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T06:40:53.9057052Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T06:40:53.9057962Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 21s local 2025-03-14T06:40:53.9058930Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 19s local 2025-03-14T06:40:53.9059882Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:40:54.1049735Z 2025-03-14T06:40:54.1050618Z  2025-03-14T06:40:54.1051071Z  2025-03-14T06:40:54.1051481Z  2025-03-14T06:40:54.1051885Z  2025-03-14T06:40:54.1052285Z  2025-03-14T06:40:54.1052673Z  2025-03-14T06:40:54.1053074Z  2025-03-14T06:40:54.1053464Z  2025-03-14T06:40:54.1054399Z [19,121 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:54.1055777Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T06:40:54.1056794Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T06:40:54.1057731Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2025-03-14T06:40:54.1058616Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T06:40:54.1059646Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T06:40:54.1060693Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 21s local 2025-03-14T06:40:54.1061836Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 19s local 2025-03-14T06:40:54.1062766Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:40:54.3574789Z 2025-03-14T06:40:54.3575602Z  2025-03-14T06:40:54.3576064Z  2025-03-14T06:40:54.3576472Z  2025-03-14T06:40:54.3576808Z  2025-03-14T06:40:54.3577212Z  2025-03-14T06:40:54.3577661Z  2025-03-14T06:40:54.3578069Z  2025-03-14T06:40:54.3578471Z  2025-03-14T06:40:54.3579321Z [19,123 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:54.3580404Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T06:40:54.3581387Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T06:40:54.3582393Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 64s local 2025-03-14T06:40:54.3583544Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 51s local 2025-03-14T06:40:54.3584586Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 22s local 2025-03-14T06:40:54.3585648Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 21s local 2025-03-14T06:40:54.3586682Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 19s local 2025-03-14T06:40:54.3587616Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:40:54.6032324Z 2025-03-14T06:40:54.6033151Z  2025-03-14T06:40:54.6033590Z  2025-03-14T06:40:54.6033996Z  2025-03-14T06:40:54.6034367Z  2025-03-14T06:40:54.6034725Z  2025-03-14T06:40:54.6035087Z  2025-03-14T06:40:54.6035446Z  2025-03-14T06:40:54.6035801Z  2025-03-14T06:40:54.6036658Z [19,125 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:54.6037635Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T06:40:54.6038557Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 76s local 2025-03-14T06:40:54.6039378Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T06:40:54.6040207Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2025-03-14T06:40:54.6041129Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T06:40:54.6042097Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 21s local 2025-03-14T06:40:54.6043015Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 20s local 2025-03-14T06:40:54.6043931Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:40:54.9055214Z 2025-03-14T06:40:54.9056027Z  2025-03-14T06:40:54.9056487Z  2025-03-14T06:40:54.9056834Z  2025-03-14T06:40:54.9057181Z  2025-03-14T06:40:54.9057520Z  2025-03-14T06:40:54.9057858Z  2025-03-14T06:40:54.9058193Z  2025-03-14T06:40:54.9058528Z  2025-03-14T06:40:54.9059330Z [19,126 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:54.9060233Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2025-03-14T06:40:54.9061068Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T06:40:54.9061851Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T06:40:54.9062561Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 52s local 2025-03-14T06:40:54.9063715Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T06:40:54.9065008Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local 2025-03-14T06:40:54.9066963Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 20s local 2025-03-14T06:40:54.9067963Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2025-03-14T06:40:55.4545773Z 2025-03-14T06:40:55.4546722Z  2025-03-14T06:40:55.4547222Z  2025-03-14T06:40:55.4547651Z  2025-03-14T06:40:55.4548063Z  2025-03-14T06:40:55.4548447Z  2025-03-14T06:40:55.4549108Z  2025-03-14T06:40:55.4549524Z  2025-03-14T06:40:55.4549945Z  2025-03-14T06:40:55.4550917Z [19,127 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:55.4552050Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2025-03-14T06:40:55.4553109Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 77s local 2025-03-14T06:40:55.4554114Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 65s local 2025-03-14T06:40:55.4555017Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2025-03-14T06:40:55.4556015Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 23s local 2025-03-14T06:40:55.4557099Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local 2025-03-14T06:40:55.4558259Z Compiling xla/mlir_hlo/mhlo/utils/legalize_to_linalg_utils.cc; 21s local 2025-03-14T06:40:55.4559431Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2025-03-14T06:40:55.7062526Z 2025-03-14T06:40:55.7063605Z  2025-03-14T06:40:55.7064147Z  2025-03-14T06:40:55.7064553Z  2025-03-14T06:40:55.7064993Z  2025-03-14T06:40:55.7065653Z  2025-03-14T06:40:55.7066080Z  2025-03-14T06:40:55.7066511Z  2025-03-14T06:40:55.7066954Z  2025-03-14T06:40:55.7067928Z [19,129 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:55.7069397Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T06:40:55.7070433Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T06:40:55.7071383Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T06:40:55.7072295Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2025-03-14T06:40:55.7073337Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2025-03-14T06:40:55.7074518Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local 2025-03-14T06:40:55.7075602Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 17s local 2025-03-14T06:40:55.7076781Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 15s local ... 2025-03-14T06:40:56.1177372Z 2025-03-14T06:40:56.1178242Z  2025-03-14T06:40:56.1178705Z  2025-03-14T06:40:56.1179117Z  2025-03-14T06:40:56.1179502Z  2025-03-14T06:40:56.1179916Z  2025-03-14T06:40:56.1180313Z  2025-03-14T06:40:56.1181017Z  2025-03-14T06:40:56.1181549Z  2025-03-14T06:40:56.1182621Z [19,130 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:56.1183837Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T06:40:56.1184956Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T06:40:56.1185982Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T06:40:56.1186981Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 53s local 2025-03-14T06:40:56.1188021Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2025-03-14T06:40:56.1189107Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local 2025-03-14T06:40:56.1190488Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2025-03-14T06:40:56.1191930Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local ... 2025-03-14T06:40:56.4652199Z 2025-03-14T06:40:56.4653440Z  2025-03-14T06:40:56.4654071Z  2025-03-14T06:40:56.4654601Z  2025-03-14T06:40:56.4655114Z  2025-03-14T06:40:56.4655488Z  2025-03-14T06:40:56.4655858Z  2025-03-14T06:40:56.4656240Z  2025-03-14T06:40:56.4656634Z  2025-03-14T06:40:56.4657557Z [19,131 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:56.4658443Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T06:40:56.4659617Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 78s local 2025-03-14T06:40:56.4660719Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 66s local 2025-03-14T06:40:56.4661741Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T06:40:56.4662898Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 24s local 2025-03-14T06:40:56.4663947Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local 2025-03-14T06:40:56.4664874Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2025-03-14T06:40:56.4666345Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local ... 2025-03-14T06:40:56.7068851Z 2025-03-14T06:40:56.7069770Z  2025-03-14T06:40:56.7070376Z  2025-03-14T06:40:56.7070808Z  2025-03-14T06:40:56.7071302Z  2025-03-14T06:40:56.7071676Z  2025-03-14T06:40:56.7072050Z  2025-03-14T06:40:56.7072703Z  2025-03-14T06:40:56.7073101Z  2025-03-14T06:40:56.7074087Z [19,132 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:56.7075163Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T06:40:56.7076574Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T06:40:56.7077648Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2025-03-14T06:40:56.7078922Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T06:40:56.7080045Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2025-03-14T06:40:56.7081184Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local 2025-03-14T06:40:56.7082373Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2025-03-14T06:40:56.7083593Z Compiling xla/backends/cpu/codegen/vector_ir_builder.cc; 16s local ... 2025-03-14T06:40:56.9948031Z 2025-03-14T06:40:56.9948978Z  2025-03-14T06:40:56.9949505Z  2025-03-14T06:40:56.9949983Z  2025-03-14T06:40:56.9950440Z  2025-03-14T06:40:56.9950865Z  2025-03-14T06:40:56.9951375Z  2025-03-14T06:40:56.9951921Z  2025-03-14T06:40:56.9952390Z  2025-03-14T06:40:56.9953637Z [19,133 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:56.9954875Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T06:40:56.9955821Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T06:40:56.9956635Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2025-03-14T06:40:56.9957465Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T06:40:56.9958442Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2025-03-14T06:40:56.9959401Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local 2025-03-14T06:40:56.9960470Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 19s local 2025-03-14T06:40:56.9961608Z @llvm-project//mlir:VectorTransforms; 16s local ... 2025-03-14T06:40:57.3073949Z 2025-03-14T06:40:57.3074857Z  2025-03-14T06:40:57.3075430Z  2025-03-14T06:40:57.3075875Z  2025-03-14T06:40:57.3076334Z  2025-03-14T06:40:57.3076793Z  2025-03-14T06:40:57.3077282Z  2025-03-14T06:40:57.3077759Z  2025-03-14T06:40:57.3078197Z  2025-03-14T06:40:57.3079666Z [19,133 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:57.3080790Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T06:40:57.3081926Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 79s local 2025-03-14T06:40:57.3082809Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 67s local 2025-03-14T06:40:57.3083558Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 54s local 2025-03-14T06:40:57.3084663Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 25s local 2025-03-14T06:40:57.3085864Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local 2025-03-14T06:40:57.3086946Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 19s local 2025-03-14T06:40:57.3087973Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:40:57.9130722Z 2025-03-14T06:40:57.9131660Z  2025-03-14T06:40:57.9132224Z  2025-03-14T06:40:57.9132675Z  2025-03-14T06:40:57.9133212Z  2025-03-14T06:40:57.9133752Z  2025-03-14T06:40:57.9134135Z  2025-03-14T06:40:57.9134520Z  2025-03-14T06:40:57.9135026Z  2025-03-14T06:40:57.9136103Z [19,134 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:57.9137379Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T06:40:57.9138569Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2025-03-14T06:40:57.9139853Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T06:40:57.9140714Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T06:40:57.9141833Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T06:40:57.9142927Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2025-03-14T06:40:57.9144027Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2025-03-14T06:40:57.9145228Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:40:58.1645506Z 2025-03-14T06:40:58.1646369Z  2025-03-14T06:40:58.1646912Z  2025-03-14T06:40:58.1647358Z  2025-03-14T06:40:58.1647766Z  2025-03-14T06:40:58.1648162Z  2025-03-14T06:40:58.1648713Z  2025-03-14T06:40:58.1649166Z  2025-03-14T06:40:58.1649589Z  2025-03-14T06:40:58.1650626Z [19,135 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:58.1651826Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T06:40:58.1652908Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2025-03-14T06:40:58.1653915Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T06:40:58.1654884Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 55s local 2025-03-14T06:40:58.1656386Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T06:40:58.1657511Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2025-03-14T06:40:58.1658838Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2025-03-14T06:40:58.1659998Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:40:58.4542442Z 2025-03-14T06:40:58.4543307Z  2025-03-14T06:40:58.4544008Z  2025-03-14T06:40:58.4544447Z  2025-03-14T06:40:58.4544830Z  2025-03-14T06:40:58.4545236Z  2025-03-14T06:40:58.4545671Z  2025-03-14T06:40:58.4546078Z  2025-03-14T06:40:58.4546476Z  2025-03-14T06:40:58.4547447Z [19,137 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:40:58.4548586Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T06:40:58.4549627Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2025-03-14T06:40:58.4550594Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 68s local 2025-03-14T06:40:58.4551818Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T06:40:58.4553011Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 26s local 2025-03-14T06:40:58.4554064Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2025-03-14T06:40:58.4555181Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2025-03-14T06:40:58.4556224Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:58.6854821Z 2025-03-14T06:40:58.6856271Z  2025-03-14T06:40:58.6856879Z  2025-03-14T06:40:58.6857401Z  2025-03-14T06:40:58.6858063Z  2025-03-14T06:40:58.6858461Z  2025-03-14T06:40:58.6858844Z  2025-03-14T06:40:58.6859265Z  2025-03-14T06:40:58.6859672Z  2025-03-14T06:40:58.6860645Z [19,140 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:58.6872831Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T06:40:58.6873896Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 80s local 2025-03-14T06:40:58.6874843Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T06:40:58.6875734Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T06:40:58.6876768Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T06:40:58.6877736Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2025-03-14T06:40:58.6879117Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2025-03-14T06:40:58.6880079Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:58.9082088Z 2025-03-14T06:40:58.9083313Z  2025-03-14T06:40:58.9083828Z  2025-03-14T06:40:58.9084205Z  2025-03-14T06:40:58.9084740Z  2025-03-14T06:40:58.9085123Z  2025-03-14T06:40:58.9085492Z  2025-03-14T06:40:58.9085861Z  2025-03-14T06:40:58.9086231Z  2025-03-14T06:40:58.9087482Z [19,142 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:58.9088575Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T06:40:58.9089537Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T06:40:58.9090417Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T06:40:58.9091237Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T06:40:58.9092242Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T06:40:58.9093249Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2025-03-14T06:40:58.9094328Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2025-03-14T06:40:58.9095262Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:59.1226621Z 2025-03-14T06:40:59.1227863Z  2025-03-14T06:40:59.1228345Z  2025-03-14T06:40:59.1228797Z  2025-03-14T06:40:59.1229216Z  2025-03-14T06:40:59.1229652Z  2025-03-14T06:40:59.1230056Z  2025-03-14T06:40:59.1230401Z  2025-03-14T06:40:59.1230789Z  2025-03-14T06:40:59.1231756Z [19,143 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:59.1232870Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T06:40:59.1233859Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T06:40:59.1234884Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T06:40:59.1235705Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 56s local 2025-03-14T06:40:59.1236635Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T06:40:59.1237575Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2025-03-14T06:40:59.1238641Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2025-03-14T06:40:59.1239669Z @llvm-project//mlir:VectorTransforms; 18s local ... 2025-03-14T06:40:59.5085918Z 2025-03-14T06:40:59.5087188Z  2025-03-14T06:40:59.5087758Z  2025-03-14T06:40:59.5088234Z  2025-03-14T06:40:59.5088648Z  2025-03-14T06:40:59.5089050Z  2025-03-14T06:40:59.5089451Z  2025-03-14T06:40:59.5089860Z  2025-03-14T06:40:59.5090304Z  2025-03-14T06:40:59.5091389Z [19,144 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:40:59.5094643Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T06:40:59.5095909Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 81s local 2025-03-14T06:40:59.5096916Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 69s local 2025-03-14T06:40:59.5097837Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T06:40:59.5098911Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 27s local 2025-03-14T06:40:59.5100040Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2025-03-14T06:40:59.5101190Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2025-03-14T06:40:59.5102262Z @llvm-project//mlir:VectorTransforms; 19s local ... 2025-03-14T06:40:59.8863368Z 2025-03-14T06:40:59.8864607Z  2025-03-14T06:40:59.8865120Z  2025-03-14T06:40:59.8865735Z  2025-03-14T06:40:59.8866134Z  2025-03-14T06:40:59.8866538Z  2025-03-14T06:40:59.8867244Z  2025-03-14T06:40:59.8867650Z  2025-03-14T06:40:59.8868061Z  2025-03-14T06:40:59.8869031Z [19,145 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:40:59.8870157Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2025-03-14T06:40:59.8871153Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T06:40:59.8872087Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2025-03-14T06:40:59.8873193Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T06:40:59.8874252Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2025-03-14T06:40:59.8875339Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2025-03-14T06:40:59.8876460Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2025-03-14T06:40:59.8877512Z @llvm-project//mlir:VectorTransforms; 19s local ... 2025-03-14T06:41:00.1091421Z 2025-03-14T06:41:00.1092692Z  2025-03-14T06:41:00.1093197Z  2025-03-14T06:41:00.1093599Z  2025-03-14T06:41:00.1094049Z  2025-03-14T06:41:00.1094470Z  2025-03-14T06:41:00.1094862Z  2025-03-14T06:41:00.1095254Z  2025-03-14T06:41:00.1095644Z  2025-03-14T06:41:00.1096623Z [19,146 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:00.1097701Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2025-03-14T06:41:00.1098714Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T06:41:00.1099606Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 70s local 2025-03-14T06:41:00.1100478Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 57s local 2025-03-14T06:41:00.1101524Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 28s local 2025-03-14T06:41:00.1102559Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2025-03-14T06:41:00.1103635Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2025-03-14T06:41:00.1104652Z @llvm-project//mlir:VectorTransforms; 19s local ... 2025-03-14T06:41:00.6417604Z 2025-03-14T06:41:00.6418536Z  2025-03-14T06:41:00.6420151Z  2025-03-14T06:41:00.6421259Z  2025-03-14T06:41:00.6421997Z  2025-03-14T06:41:00.6423543Z  2025-03-14T06:41:00.6425738Z  2025-03-14T06:41:00.6426219Z  2025-03-14T06:41:00.6426704Z  2025-03-14T06:41:00.6427790Z [19,147 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:00.6428703Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T06:41:00.6429538Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 82s local 2025-03-14T06:41:00.6430299Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2025-03-14T06:41:00.6431063Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T06:41:00.6431951Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2025-03-14T06:41:00.6432995Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2025-03-14T06:41:00.6433962Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2025-03-14T06:41:00.6434861Z @llvm-project//mlir:VectorTransforms; 20s local ... 2025-03-14T06:41:00.9097175Z 2025-03-14T06:41:00.9097973Z  2025-03-14T06:41:00.9098367Z  2025-03-14T06:41:00.9098729Z  2025-03-14T06:41:00.9099051Z  2025-03-14T06:41:00.9099382Z  2025-03-14T06:41:00.9099693Z  2025-03-14T06:41:00.9100001Z  2025-03-14T06:41:00.9100293Z  2025-03-14T06:41:00.9101033Z [19,147 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:00.9101877Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T06:41:00.9102643Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2025-03-14T06:41:00.9103604Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2025-03-14T06:41:00.9104309Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T06:41:00.9105110Z Compiling llvm/lib/CodeGen/SelectionDAG/SelectionDAG.cpp; 29s local 2025-03-14T06:41:00.9105925Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2025-03-14T06:41:00.9106823Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 23s local 2025-03-14T06:41:00.9107763Z @llvm-project//mlir:VectorTransforms; 20s local ... 2025-03-14T06:41:01.1100309Z 2025-03-14T06:41:01.1101119Z  2025-03-14T06:41:01.1101520Z  2025-03-14T06:41:01.1101853Z  2025-03-14T06:41:01.1102399Z  2025-03-14T06:41:01.1102729Z  2025-03-14T06:41:01.1103159Z  2025-03-14T06:41:01.1103593Z  2025-03-14T06:41:01.1104021Z  2025-03-14T06:41:01.1104928Z [19,149 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:01.1105978Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T06:41:01.1106875Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2025-03-14T06:41:01.1107722Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2025-03-14T06:41:01.1108540Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 58s local 2025-03-14T06:41:01.1109437Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2025-03-14T06:41:01.1110422Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 23s local 2025-03-14T06:41:01.1111386Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2025-03-14T06:41:01.1112128Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:41:01.4729633Z 2025-03-14T06:41:01.4730551Z  2025-03-14T06:41:01.4731128Z  2025-03-14T06:41:01.4731526Z  2025-03-14T06:41:01.4731906Z  2025-03-14T06:41:01.4732286Z  2025-03-14T06:41:01.4732693Z  2025-03-14T06:41:01.4733075Z  2025-03-14T06:41:01.4733462Z  2025-03-14T06:41:01.4734376Z [19,151 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:01.4735480Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T06:41:01.4736437Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 83s local 2025-03-14T06:41:01.4737306Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 71s local 2025-03-14T06:41:01.4738397Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 59s local 2025-03-14T06:41:01.4739351Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2025-03-14T06:41:01.4740396Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 23s local 2025-03-14T06:41:01.4741426Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2025-03-14T06:41:01.4742132Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:41:01.7106162Z 2025-03-14T06:41:01.7107522Z  2025-03-14T06:41:01.7107975Z  2025-03-14T06:41:01.7108366Z  2025-03-14T06:41:01.7108960Z  2025-03-14T06:41:01.7109330Z  2025-03-14T06:41:01.7109673Z  2025-03-14T06:41:01.7110034Z  2025-03-14T06:41:01.7110386Z  2025-03-14T06:41:01.7111229Z [19,152 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:01.7112188Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T06:41:01.7113115Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T06:41:01.7113903Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T06:41:01.7114677Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 59s local 2025-03-14T06:41:01.7115568Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2025-03-14T06:41:01.7116546Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 23s local 2025-03-14T06:41:01.7117509Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2025-03-14T06:41:01.7118424Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:41:01.9108907Z 2025-03-14T06:41:01.9109883Z  2025-03-14T06:41:01.9110398Z  2025-03-14T06:41:01.9110837Z  2025-03-14T06:41:01.9111190Z  2025-03-14T06:41:01.9111538Z  2025-03-14T06:41:01.9111881Z  2025-03-14T06:41:01.9112221Z  2025-03-14T06:41:01.9112578Z  2025-03-14T06:41:01.9113473Z [19,154 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:01.9114686Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T06:41:01.9115539Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T06:41:01.9116370Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T06:41:01.9117128Z Compiling xla/backends/cpu/runtime/dot_thunk_s32.cc; 59s local 2025-03-14T06:41:01.9117965Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local 2025-03-14T06:41:01.9118922Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 24s local 2025-03-14T06:41:01.9119866Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2025-03-14T06:41:01.9120535Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:41:02.2156323Z 2025-03-14T06:41:02.2157322Z  2025-03-14T06:41:02.2157778Z  2025-03-14T06:41:02.2158146Z  2025-03-14T06:41:02.2158533Z  2025-03-14T06:41:02.2158948Z  2025-03-14T06:41:02.2159351Z  2025-03-14T06:41:02.2159768Z  2025-03-14T06:41:02.2160209Z  2025-03-14T06:41:02.2161194Z [19,157 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:02.2162354Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T06:41:02.2163430Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T06:41:02.2164435Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T06:41:02.2165694Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local 2025-03-14T06:41:02.2166686Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2025-03-14T06:41:02.2167506Z @stablehlo//:linalg_passes; 16s local 2025-03-14T06:41:02.2168420Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 14s local 2025-03-14T06:41:02.2169460Z @llvm-project//mlir:VectorTransforms; 12s local ... 2025-03-14T06:41:02.4704422Z 2025-03-14T06:41:02.4705405Z  2025-03-14T06:41:02.4706252Z  2025-03-14T06:41:02.4706661Z  2025-03-14T06:41:02.4707043Z  2025-03-14T06:41:02.4707424Z  2025-03-14T06:41:02.4707783Z  2025-03-14T06:41:02.4708165Z  2025-03-14T06:41:02.4708558Z  2025-03-14T06:41:02.4709486Z [19,158 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:02.4710562Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T06:41:02.4711573Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 84s local 2025-03-14T06:41:02.4712710Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 72s local 2025-03-14T06:41:02.4713609Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local 2025-03-14T06:41:02.4714526Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2025-03-14T06:41:02.4715267Z @stablehlo//:linalg_passes; 16s local 2025-03-14T06:41:02.4716095Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 14s local 2025-03-14T06:41:02.4717068Z @llvm-project//mlir:VectorTransforms; 12s local ... 2025-03-14T06:41:02.7115893Z 2025-03-14T06:41:02.7116865Z  2025-03-14T06:41:02.7117378Z  2025-03-14T06:41:02.7117848Z  2025-03-14T06:41:02.7118321Z  2025-03-14T06:41:02.7118748Z  2025-03-14T06:41:02.7119141Z  2025-03-14T06:41:02.7119506Z  2025-03-14T06:41:02.7119892Z  2025-03-14T06:41:02.7120806Z [19,158 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:02.7122211Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T06:41:02.7123072Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T06:41:02.7123923Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T06:41:02.7124876Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local 2025-03-14T06:41:02.7125883Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2025-03-14T06:41:02.7126653Z @stablehlo//:linalg_passes; 16s local 2025-03-14T06:41:02.7127476Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 14s local 2025-03-14T06:41:02.7128409Z @llvm-project//mlir:VectorTransforms; 12s local ... 2025-03-14T06:41:03.1024921Z 2025-03-14T06:41:03.1025937Z  2025-03-14T06:41:03.1026473Z  2025-03-14T06:41:03.1026946Z  2025-03-14T06:41:03.1027413Z  2025-03-14T06:41:03.1027876Z  2025-03-14T06:41:03.1028262Z  2025-03-14T06:41:03.1028651Z  2025-03-14T06:41:03.1029066Z  2025-03-14T06:41:03.1030024Z [19,159 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:03.1031146Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T06:41:03.1032146Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T06:41:03.1033076Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T06:41:03.1033990Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local 2025-03-14T06:41:03.1034878Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2025-03-14T06:41:03.1035641Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:03.1036492Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2025-03-14T06:41:03.1037480Z @llvm-project//mlir:VectorTransforms; 12s local ... 2025-03-14T06:41:03.3120975Z 2025-03-14T06:41:03.3121976Z  2025-03-14T06:41:03.3122505Z  2025-03-14T06:41:03.3122936Z  2025-03-14T06:41:03.3123324Z  2025-03-14T06:41:03.3123730Z  2025-03-14T06:41:03.3124163Z  2025-03-14T06:41:03.3124697Z  2025-03-14T06:41:03.3125116Z  2025-03-14T06:41:03.3126075Z [19,159 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:03.3127123Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T06:41:03.3128469Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T06:41:03.3129434Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 73s local 2025-03-14T06:41:03.3130313Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local 2025-03-14T06:41:03.3131186Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2025-03-14T06:41:03.3131982Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:03.3132883Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2025-03-14T06:41:03.3134080Z @llvm-project//mlir:VectorTransforms; 13s local ... 2025-03-14T06:41:03.6050564Z 2025-03-14T06:41:03.6051509Z  2025-03-14T06:41:03.6052035Z  2025-03-14T06:41:03.6052501Z  2025-03-14T06:41:03.6052876Z  2025-03-14T06:41:03.6053218Z  2025-03-14T06:41:03.6053546Z  2025-03-14T06:41:03.6053923Z  2025-03-14T06:41:03.6054308Z  2025-03-14T06:41:03.6055214Z [19,160 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:03.6056326Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T06:41:03.6057172Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 85s local 2025-03-14T06:41:03.6057958Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T06:41:03.6058713Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local 2025-03-14T06:41:03.6059495Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2025-03-14T06:41:03.6060403Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:03.6061185Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2025-03-14T06:41:03.6062106Z @llvm-project//mlir:VectorTransforms; 13s local ... 2025-03-14T06:41:03.9097762Z 2025-03-14T06:41:03.9098694Z  2025-03-14T06:41:03.9099240Z  2025-03-14T06:41:03.9099741Z  2025-03-14T06:41:03.9100195Z  2025-03-14T06:41:03.9100927Z  2025-03-14T06:41:03.9101301Z  2025-03-14T06:41:03.9101685Z  2025-03-14T06:41:03.9102089Z  2025-03-14T06:41:03.9103008Z [19,163 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:03.9104107Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T06:41:03.9105158Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T06:41:03.9106087Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T06:41:03.9107026Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local 2025-03-14T06:41:03.9107871Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2025-03-14T06:41:03.9108577Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:03.9109399Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 15s local 2025-03-14T06:41:03.9110435Z @llvm-project//mlir:VectorTransforms; 13s local ... 2025-03-14T06:41:04.1127502Z 2025-03-14T06:41:04.1128523Z  2025-03-14T06:41:04.1129071Z  2025-03-14T06:41:04.1129531Z  2025-03-14T06:41:04.1129956Z  2025-03-14T06:41:04.1130363Z  2025-03-14T06:41:04.1130779Z  2025-03-14T06:41:04.1131206Z  2025-03-14T06:41:04.1131624Z  2025-03-14T06:41:04.1132599Z [19,166 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:04.1133707Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T06:41:04.1134735Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T06:41:04.1135604Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T06:41:04.1136435Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local 2025-03-14T06:41:04.1137396Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2025-03-14T06:41:04.1138156Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:04.1139023Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2025-03-14T06:41:04.1140605Z Compiling llvm/lib/Target/X86/GISel/X86LegalizerInfo.cpp; 13s local ... 2025-03-14T06:41:04.4364800Z 2025-03-14T06:41:04.4366297Z  2025-03-14T06:41:04.4366734Z  2025-03-14T06:41:04.4367106Z  2025-03-14T06:41:04.4367509Z  2025-03-14T06:41:04.4367898Z  2025-03-14T06:41:04.4368292Z  2025-03-14T06:41:04.4368652Z  2025-03-14T06:41:04.4369035Z  2025-03-14T06:41:04.4369971Z [19,167 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:04.4371360Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T06:41:04.4372418Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T06:41:04.4373389Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 74s local 2025-03-14T06:41:04.4374300Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local 2025-03-14T06:41:04.4375256Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2025-03-14T06:41:04.4376015Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:04.4376871Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2025-03-14T06:41:04.4378047Z Compiling llvm/lib/Target/X86/GISel/X86LegalizerInfo.cpp; 13s local ... 2025-03-14T06:41:04.6591645Z 2025-03-14T06:41:04.6592621Z  2025-03-14T06:41:04.6593145Z  2025-03-14T06:41:04.6593658Z  2025-03-14T06:41:04.6594109Z  2025-03-14T06:41:04.6594766Z  2025-03-14T06:41:04.6595133Z  2025-03-14T06:41:04.6595491Z  2025-03-14T06:41:04.6595864Z  2025-03-14T06:41:04.6596738Z [19,168 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:04.6597744Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T06:41:04.6598646Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 86s local 2025-03-14T06:41:04.6599499Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T06:41:04.6600459Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local 2025-03-14T06:41:04.6601289Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2025-03-14T06:41:04.6601945Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:04.6602712Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2025-03-14T06:41:04.6603748Z Compiling llvm/lib/Target/X86/GISel/X86LegalizerInfo.cpp; 13s local ... 2025-03-14T06:41:04.9133133Z 2025-03-14T06:41:04.9134096Z  2025-03-14T06:41:04.9134631Z  2025-03-14T06:41:04.9135123Z  2025-03-14T06:41:04.9135591Z  2025-03-14T06:41:04.9135994Z  2025-03-14T06:41:04.9136394Z  2025-03-14T06:41:04.9136777Z  2025-03-14T06:41:04.9137178Z  2025-03-14T06:41:04.9138142Z [19,168 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:04.9139208Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T06:41:04.9140261Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T06:41:04.9141241Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T06:41:04.9142169Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2025-03-14T06:41:04.9143073Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2025-03-14T06:41:04.9143852Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:04.9144732Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 16s local 2025-03-14T06:41:04.9145956Z Compiling llvm/lib/Target/X86/GISel/X86LegalizerInfo.cpp; 14s local ... 2025-03-14T06:41:05.3086116Z 2025-03-14T06:41:05.3087048Z  2025-03-14T06:41:05.3087585Z  2025-03-14T06:41:05.3088049Z  2025-03-14T06:41:05.3088486Z  2025-03-14T06:41:05.3088946Z  2025-03-14T06:41:05.3089331Z  2025-03-14T06:41:05.3089661Z  2025-03-14T06:41:05.3090001Z  2025-03-14T06:41:05.3091119Z [19,170 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:05.3092161Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T06:41:05.3093092Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T06:41:05.3093981Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T06:41:05.3094840Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2025-03-14T06:41:05.3095709Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2025-03-14T06:41:05.3096522Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:05.3097321Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local 2025-03-14T06:41:05.3098366Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local ... 2025-03-14T06:41:05.5138868Z 2025-03-14T06:41:05.5139866Z  2025-03-14T06:41:05.5140435Z  2025-03-14T06:41:05.5140841Z  2025-03-14T06:41:05.5141241Z  2025-03-14T06:41:05.5141574Z  2025-03-14T06:41:05.5141935Z  2025-03-14T06:41:05.5142296Z  2025-03-14T06:41:05.5142774Z  2025-03-14T06:41:05.5143596Z [19,171 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:05.5144546Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T06:41:05.5145416Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 87s local 2025-03-14T06:41:05.5146498Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 75s local 2025-03-14T06:41:05.5147269Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2025-03-14T06:41:05.5148052Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2025-03-14T06:41:05.5148721Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:05.5149501Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 17s local 2025-03-14T06:41:05.5150545Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 14s local ... 2025-03-14T06:41:06.5145933Z 2025-03-14T06:41:06.5146960Z  2025-03-14T06:41:06.5147543Z  2025-03-14T06:41:06.5147932Z  2025-03-14T06:41:06.5148268Z  2025-03-14T06:41:06.5148603Z  2025-03-14T06:41:06.5148936Z  2025-03-14T06:41:06.5149270Z  2025-03-14T06:41:06.5149599Z  2025-03-14T06:41:06.5150406Z [19,171 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:06.5151326Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2025-03-14T06:41:06.5152271Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 88s local 2025-03-14T06:41:06.5153012Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 76s local 2025-03-14T06:41:06.5153710Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2025-03-14T06:41:06.5154454Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2025-03-14T06:41:06.5155069Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:06.5155797Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local 2025-03-14T06:41:06.5156733Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 15s local ... 2025-03-14T06:41:06.7876940Z 2025-03-14T06:41:06.7877886Z  2025-03-14T06:41:06.7878584Z  2025-03-14T06:41:06.7879093Z  2025-03-14T06:41:06.7879510Z  2025-03-14T06:41:06.7879888Z  2025-03-14T06:41:06.7880268Z  2025-03-14T06:41:06.7880639Z  2025-03-14T06:41:06.7881037Z  2025-03-14T06:41:06.7881873Z [19,172 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:06.7882825Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2025-03-14T06:41:06.7883724Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T06:41:06.7884824Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T06:41:06.7885719Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2025-03-14T06:41:06.7886780Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2025-03-14T06:41:06.7887447Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:06.7888191Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 18s local 2025-03-14T06:41:06.7889148Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local ... 2025-03-14T06:41:07.1150277Z 2025-03-14T06:41:07.1151266Z  2025-03-14T06:41:07.1151659Z  2025-03-14T06:41:07.1152017Z  2025-03-14T06:41:07.1152346Z  2025-03-14T06:41:07.1152657Z  2025-03-14T06:41:07.1153285Z  2025-03-14T06:41:07.1153629Z  2025-03-14T06:41:07.1153958Z  2025-03-14T06:41:07.1154756Z [19,174 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:07.1155654Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2025-03-14T06:41:07.1156499Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T06:41:07.1157289Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T06:41:07.1158014Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2025-03-14T06:41:07.1158779Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2025-03-14T06:41:07.1159416Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:07.1160123Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 19s local 2025-03-14T06:41:07.1161222Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local ... 2025-03-14T06:41:07.3641619Z 2025-03-14T06:41:07.3642636Z  2025-03-14T06:41:07.3643162Z  2025-03-14T06:41:07.3643627Z  2025-03-14T06:41:07.3643988Z  2025-03-14T06:41:07.3644349Z  2025-03-14T06:41:07.3644822Z  2025-03-14T06:41:07.3645200Z  2025-03-14T06:41:07.3645558Z  2025-03-14T06:41:07.3646381Z [19,176 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:07.3647591Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2025-03-14T06:41:07.3648438Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T06:41:07.3649218Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T06:41:07.3649963Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2025-03-14T06:41:07.3650745Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2025-03-14T06:41:07.3651410Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:07.3652127Z Compiling llvm/lib/Target/X86/X86InstCombineIntrinsic.cpp; 19s local 2025-03-14T06:41:07.3653066Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local ... 2025-03-14T06:41:07.5881144Z 2025-03-14T06:41:07.5882110Z  2025-03-14T06:41:07.5882564Z  2025-03-14T06:41:07.5882978Z  2025-03-14T06:41:07.5883398Z  2025-03-14T06:41:07.5883807Z  2025-03-14T06:41:07.5884270Z  2025-03-14T06:41:07.5884766Z  2025-03-14T06:41:07.5885198Z  2025-03-14T06:41:07.5886159Z [19,178 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:07.5887249Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2025-03-14T06:41:07.5888289Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 89s local 2025-03-14T06:41:07.5889125Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 77s local 2025-03-14T06:41:07.5889904Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2025-03-14T06:41:07.5890690Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2025-03-14T06:41:07.5891302Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:07.5892008Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 16s local 2025-03-14T06:41:07.5892808Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 15s local ... 2025-03-14T06:41:07.9156615Z 2025-03-14T06:41:07.9157627Z  2025-03-14T06:41:07.9158019Z  2025-03-14T06:41:07.9158330Z  2025-03-14T06:41:07.9158866Z  2025-03-14T06:41:07.9159184Z  2025-03-14T06:41:07.9159498Z  2025-03-14T06:41:07.9159825Z  2025-03-14T06:41:07.9160175Z  2025-03-14T06:41:07.9161025Z [19,178 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:07.9162072Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T06:41:07.9162969Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:41:07.9163992Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T06:41:07.9164926Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2025-03-14T06:41:07.9166006Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2025-03-14T06:41:07.9166644Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:07.9167364Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2025-03-14T06:41:07.9168260Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 15s local ... 2025-03-14T06:41:08.1159186Z 2025-03-14T06:41:08.1160148Z  2025-03-14T06:41:08.1160668Z  2025-03-14T06:41:08.1161145Z  2025-03-14T06:41:08.1161534Z  2025-03-14T06:41:08.1161966Z  2025-03-14T06:41:08.1162382Z  2025-03-14T06:41:08.1162814Z  2025-03-14T06:41:08.1163240Z  2025-03-14T06:41:08.1164236Z [19,179 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:08.1166053Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T06:41:08.1167278Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:41:08.1168316Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T06:41:08.1169299Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2025-03-14T06:41:08.1170343Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2025-03-14T06:41:08.1171358Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:08.1172317Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2025-03-14T06:41:08.1173428Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 15s local ... 2025-03-14T06:41:08.3578572Z 2025-03-14T06:41:08.3579552Z  2025-03-14T06:41:08.3580089Z  2025-03-14T06:41:08.3580503Z  2025-03-14T06:41:08.3580881Z  2025-03-14T06:41:08.3581248Z  2025-03-14T06:41:08.3581661Z  2025-03-14T06:41:08.3582006Z  2025-03-14T06:41:08.3582343Z  2025-03-14T06:41:08.3583231Z [19,180 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:08.3584167Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T06:41:08.3585102Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:41:08.3585967Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 78s local 2025-03-14T06:41:08.3586785Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2025-03-14T06:41:08.3587613Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2025-03-14T06:41:08.3588294Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:08.3589083Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2025-03-14T06:41:08.3589941Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 15s local ... 2025-03-14T06:41:08.6712254Z 2025-03-14T06:41:08.6713216Z  2025-03-14T06:41:08.6713802Z  2025-03-14T06:41:08.6714275Z  2025-03-14T06:41:08.6714612Z  2025-03-14T06:41:08.6714963Z  2025-03-14T06:41:08.6715320Z  2025-03-14T06:41:08.6715693Z  2025-03-14T06:41:08.6716097Z  2025-03-14T06:41:08.6717169Z [19,181 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:08.6718181Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T06:41:08.6719441Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 90s local 2025-03-14T06:41:08.6720317Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T06:41:08.6721132Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2025-03-14T06:41:08.6722042Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2025-03-14T06:41:08.6722748Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:08.6723615Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 17s local 2025-03-14T06:41:08.6724478Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 16s local ... 2025-03-14T06:41:08.9166418Z 2025-03-14T06:41:08.9167432Z  2025-03-14T06:41:08.9167950Z  2025-03-14T06:41:08.9168424Z  2025-03-14T06:41:08.9168914Z  2025-03-14T06:41:08.9169341Z  2025-03-14T06:41:08.9169728Z  2025-03-14T06:41:08.9170114Z  2025-03-14T06:41:08.9170503Z  2025-03-14T06:41:08.9171450Z [19,181 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:08.9172556Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T06:41:08.9173510Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2025-03-14T06:41:08.9174423Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T06:41:08.9175262Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2025-03-14T06:41:08.9176105Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2025-03-14T06:41:08.9177058Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:08.9177931Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2025-03-14T06:41:08.9178960Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 16s local ... 2025-03-14T06:41:09.2130514Z 2025-03-14T06:41:09.2131519Z  2025-03-14T06:41:09.2131976Z  2025-03-14T06:41:09.2132445Z  2025-03-14T06:41:09.2132883Z  2025-03-14T06:41:09.2133354Z  2025-03-14T06:41:09.2134039Z  2025-03-14T06:41:09.2134444Z  2025-03-14T06:41:09.2134853Z  2025-03-14T06:41:09.2135792Z [19,185 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:09.2136887Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T06:41:09.2137902Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2025-03-14T06:41:09.2138837Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T06:41:09.2139743Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2025-03-14T06:41:09.2140692Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2025-03-14T06:41:09.2141715Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2025-03-14T06:41:09.2142643Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 16s local 2025-03-14T06:41:09.2143569Z Compiling .../translate/hlo_to_mhlo/hlo_module_importer.cc; 15s local ... 2025-03-14T06:41:09.5171096Z 2025-03-14T06:41:09.5172124Z  2025-03-14T06:41:09.5172676Z  2025-03-14T06:41:09.5173129Z  2025-03-14T06:41:09.5173581Z  2025-03-14T06:41:09.5174025Z  2025-03-14T06:41:09.5174371Z  2025-03-14T06:41:09.5174720Z  2025-03-14T06:41:09.5175068Z  2025-03-14T06:41:09.5175892Z [19,187 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:09.5176841Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T06:41:09.5177757Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 91s local 2025-03-14T06:41:09.5178705Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 79s local 2025-03-14T06:41:09.5179504Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2025-03-14T06:41:09.5180456Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 18s local 2025-03-14T06:41:09.5181331Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 17s local 2025-03-14T06:41:09.5182525Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local 2025-03-14T06:41:09.5183556Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local ... 2025-03-14T06:41:09.7631114Z 2025-03-14T06:41:09.7632189Z  2025-03-14T06:41:09.7632662Z  2025-03-14T06:41:09.7633091Z  2025-03-14T06:41:09.7633571Z  2025-03-14T06:41:09.7634041Z  2025-03-14T06:41:09.7634480Z  2025-03-14T06:41:09.7634845Z  2025-03-14T06:41:09.7635229Z  2025-03-14T06:41:09.7636325Z [19,188 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:09.7637354Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2025-03-14T06:41:09.7638276Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T06:41:09.7639119Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T06:41:09.7639908Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2025-03-14T06:41:09.7640870Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2025-03-14T06:41:09.7641741Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 17s local 2025-03-14T06:41:09.7642628Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local 2025-03-14T06:41:09.7643648Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 15s local ... 2025-03-14T06:41:10.1177127Z 2025-03-14T06:41:10.1178163Z  2025-03-14T06:41:10.1178618Z  2025-03-14T06:41:10.1179472Z  2025-03-14T06:41:10.1179931Z  2025-03-14T06:41:10.1180326Z  2025-03-14T06:41:10.1180652Z  2025-03-14T06:41:10.1180969Z  2025-03-14T06:41:10.1181295Z  2025-03-14T06:41:10.1182073Z [19,188 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:10.1182943Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2025-03-14T06:41:10.1183730Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T06:41:10.1184635Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T06:41:10.1185343Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2025-03-14T06:41:10.1186164Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2025-03-14T06:41:10.1186930Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 17s local 2025-03-14T06:41:10.1187719Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 16s local 2025-03-14T06:41:10.1188587Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 16s local ... 2025-03-14T06:41:10.5178660Z 2025-03-14T06:41:10.5179648Z  2025-03-14T06:41:10.5180228Z  2025-03-14T06:41:10.5180668Z  2025-03-14T06:41:10.5181049Z  2025-03-14T06:41:10.5181469Z  2025-03-14T06:41:10.5181875Z  2025-03-14T06:41:10.5182260Z  2025-03-14T06:41:10.5182648Z  2025-03-14T06:41:10.5183620Z [19,190 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:10.5184658Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2025-03-14T06:41:10.5185490Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 92s local 2025-03-14T06:41:10.5186384Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 80s local 2025-03-14T06:41:10.5187281Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2025-03-14T06:41:10.5188344Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 19s local 2025-03-14T06:41:10.5189319Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 18s local 2025-03-14T06:41:10.5190280Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 17s local 2025-03-14T06:41:10.5191438Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 16s local ... 2025-03-14T06:41:10.9182260Z 2025-03-14T06:41:10.9183187Z  2025-03-14T06:41:10.9183731Z  2025-03-14T06:41:10.9184142Z  2025-03-14T06:41:10.9184577Z  2025-03-14T06:41:10.9185084Z  2025-03-14T06:41:10.9185484Z  2025-03-14T06:41:10.9186137Z  2025-03-14T06:41:10.9186546Z  2025-03-14T06:41:10.9187485Z [19,192 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:10.9188571Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T06:41:10.9189626Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 93s local 2025-03-14T06:41:10.9190572Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 81s local 2025-03-14T06:41:10.9191604Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2025-03-14T06:41:10.9192782Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 20s local 2025-03-14T06:41:10.9193780Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 18s local 2025-03-14T06:41:10.9194798Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 17s local 2025-03-14T06:41:10.9195891Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 16s local ... 2025-03-14T06:41:11.9189439Z 2025-03-14T06:41:11.9190500Z  2025-03-14T06:41:11.9190963Z  2025-03-14T06:41:11.9191447Z  2025-03-14T06:41:11.9191905Z  2025-03-14T06:41:11.9192375Z  2025-03-14T06:41:11.9192781Z  2025-03-14T06:41:11.9193167Z  2025-03-14T06:41:11.9193582Z  2025-03-14T06:41:11.9194520Z [19,192 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:11.9195978Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2025-03-14T06:41:11.9197062Z Compiling mlir/lib/Dialect/Linalg/IR/LinalgDialect.cpp; 94s local 2025-03-14T06:41:11.9198060Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2025-03-14T06:41:11.9198934Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2025-03-14T06:41:11.9199944Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2025-03-14T06:41:11.9201062Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 19s local 2025-03-14T06:41:11.9202043Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2025-03-14T06:41:11.9203151Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 17s local ... 2025-03-14T06:41:12.2381463Z 2025-03-14T06:41:12.2382473Z  2025-03-14T06:41:12.2382989Z  2025-03-14T06:41:12.2383507Z  2025-03-14T06:41:12.2383991Z  2025-03-14T06:41:12.2384533Z  2025-03-14T06:41:12.2384993Z  2025-03-14T06:41:12.2385415Z  2025-03-14T06:41:12.2385837Z  2025-03-14T06:41:12.2386845Z [19,193 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:12.2388033Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2025-03-14T06:41:12.2388851Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2025-03-14T06:41:12.2389764Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2025-03-14T06:41:12.2390818Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2025-03-14T06:41:12.2391757Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 19s local 2025-03-14T06:41:12.2392698Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 18s local 2025-03-14T06:41:12.2393774Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2025-03-14T06:41:12.2394719Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 16s local ... 2025-03-14T06:41:12.5194316Z 2025-03-14T06:41:12.5195366Z  2025-03-14T06:41:12.5195826Z  2025-03-14T06:41:12.5196290Z  2025-03-14T06:41:12.5196781Z  2025-03-14T06:41:12.5197249Z  2025-03-14T06:41:12.5197623Z  2025-03-14T06:41:12.5198019Z  2025-03-14T06:41:12.5198396Z  2025-03-14T06:41:12.5199396Z [19,194 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:12.5200529Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2025-03-14T06:41:12.5211659Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 82s local 2025-03-14T06:41:12.5212840Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2025-03-14T06:41:12.5213741Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 21s local 2025-03-14T06:41:12.5214642Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 20s local 2025-03-14T06:41:12.5215624Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2025-03-14T06:41:12.5216797Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2025-03-14T06:41:12.5217947Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 17s local ... 2025-03-14T06:41:12.7295333Z 2025-03-14T06:41:12.7296339Z  2025-03-14T06:41:12.7296800Z  2025-03-14T06:41:12.7297271Z  2025-03-14T06:41:12.7297695Z  2025-03-14T06:41:12.7298179Z  2025-03-14T06:41:12.7298664Z  2025-03-14T06:41:12.7299157Z  2025-03-14T06:41:12.7299519Z  2025-03-14T06:41:12.7300462Z [19,195 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:12.7301449Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T06:41:12.7302343Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2025-03-14T06:41:12.7303106Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2025-03-14T06:41:12.7304115Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2025-03-14T06:41:12.7305181Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 20s local 2025-03-14T06:41:12.7306030Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2025-03-14T06:41:12.7307095Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 18s local 2025-03-14T06:41:12.7308126Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 17s local ... 2025-03-14T06:41:13.1200192Z 2025-03-14T06:41:13.1201233Z  2025-03-14T06:41:13.1201693Z  2025-03-14T06:41:13.1202499Z  2025-03-14T06:41:13.1202999Z  2025-03-14T06:41:13.1203432Z  2025-03-14T06:41:13.1203816Z  2025-03-14T06:41:13.1204207Z  2025-03-14T06:41:13.1204730Z  2025-03-14T06:41:13.1205693Z [19,195 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:13.1206799Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T06:41:13.1207685Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2025-03-14T06:41:13.1208626Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2025-03-14T06:41:13.1209682Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2025-03-14T06:41:13.1210697Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 20s local 2025-03-14T06:41:13.1211739Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 19s local 2025-03-14T06:41:13.1213493Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2025-03-14T06:41:13.1214437Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 17s local ... 2025-03-14T06:41:13.5204245Z 2025-03-14T06:41:13.5205343Z  2025-03-14T06:41:13.5205819Z  2025-03-14T06:41:13.5206212Z  2025-03-14T06:41:13.5206624Z  2025-03-14T06:41:13.5207053Z  2025-03-14T06:41:13.5207472Z  2025-03-14T06:41:13.5207887Z  2025-03-14T06:41:13.5208281Z  2025-03-14T06:41:13.5209231Z [19,196 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:13.5210374Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T06:41:13.5211259Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 83s local 2025-03-14T06:41:13.5212158Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2025-03-14T06:41:13.5213225Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 22s local 2025-03-14T06:41:13.5214382Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local 2025-03-14T06:41:13.5215780Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2025-03-14T06:41:13.5216843Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2025-03-14T06:41:13.5217654Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local ... 2025-03-14T06:41:13.7377953Z 2025-03-14T06:41:13.7378806Z  2025-03-14T06:41:13.7379287Z  2025-03-14T06:41:13.7379725Z  2025-03-14T06:41:13.7380134Z  2025-03-14T06:41:13.7380598Z  2025-03-14T06:41:13.7381124Z  2025-03-14T06:41:13.7381475Z  2025-03-14T06:41:13.7381857Z  2025-03-14T06:41:13.7383164Z [19,199 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:13.7384310Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T06:41:13.7385158Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T06:41:13.7386004Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2025-03-14T06:41:13.7387051Z Compiling llvm/lib/CodeGen/GlobalISel/CombinerHelper.cpp; 23s local 2025-03-14T06:41:13.7387975Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local 2025-03-14T06:41:13.7388919Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2025-03-14T06:41:13.7389995Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2025-03-14T06:41:13.7390867Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local ... 2025-03-14T06:41:13.9511144Z 2025-03-14T06:41:13.9511999Z  2025-03-14T06:41:13.9512478Z  2025-03-14T06:41:13.9512890Z  2025-03-14T06:41:13.9513300Z  2025-03-14T06:41:13.9513689Z  2025-03-14T06:41:13.9514068Z  2025-03-14T06:41:13.9514463Z  2025-03-14T06:41:13.9514984Z  2025-03-14T06:41:13.9515937Z [19,201 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:13.9517036Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T06:41:13.9518214Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T06:41:13.9519053Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2025-03-14T06:41:13.9519896Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local 2025-03-14T06:41:13.9520819Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2025-03-14T06:41:13.9521951Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 19s local 2025-03-14T06:41:13.9522940Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local 2025-03-14T06:41:13.9523721Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:41:14.3210357Z 2025-03-14T06:41:14.3211239Z  2025-03-14T06:41:14.3211727Z  2025-03-14T06:41:14.3212112Z  2025-03-14T06:41:14.3212511Z  2025-03-14T06:41:14.3212893Z  2025-03-14T06:41:14.3213283Z  2025-03-14T06:41:14.3213657Z  2025-03-14T06:41:14.3214028Z  2025-03-14T06:41:14.3215002Z [19,201 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:14.3216068Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T06:41:14.3216928Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T06:41:14.3217781Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2025-03-14T06:41:14.3218653Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local 2025-03-14T06:41:14.3219596Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 20s local 2025-03-14T06:41:14.3220692Z Compiling llvm/lib/CodeGen/GlobalISel/IRTranslator.cpp; 20s local 2025-03-14T06:41:14.3221621Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local 2025-03-14T06:41:14.3222414Z @llvm-project//mlir:VectorTransforms; 17s local ... 2025-03-14T06:41:14.5700103Z 2025-03-14T06:41:14.5701109Z  2025-03-14T06:41:14.5701564Z  2025-03-14T06:41:14.5701913Z  2025-03-14T06:41:14.5702309Z  2025-03-14T06:41:14.5702696Z  2025-03-14T06:41:14.5703264Z  2025-03-14T06:41:14.5703641Z  2025-03-14T06:41:14.5704020Z  2025-03-14T06:41:14.5704910Z [19,204 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:14.5705920Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T06:41:14.5706715Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 84s local 2025-03-14T06:41:14.5707562Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2025-03-14T06:41:14.5708561Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2025-03-14T06:41:14.5709453Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2025-03-14T06:41:14.5710325Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local 2025-03-14T06:41:14.5711017Z @llvm-project//mlir:VectorTransforms; 18s local 2025-03-14T06:41:14.5711677Z @llvm-project//mlir:MemRefTransforms; 13s local ... 2025-03-14T06:41:14.9216090Z 2025-03-14T06:41:14.9217075Z  2025-03-14T06:41:14.9217595Z  2025-03-14T06:41:14.9218037Z  2025-03-14T06:41:14.9218522Z  2025-03-14T06:41:14.9219005Z  2025-03-14T06:41:14.9219489Z  2025-03-14T06:41:14.9219972Z  2025-03-14T06:41:14.9220456Z  2025-03-14T06:41:14.9221522Z [19,205 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:14.9222726Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T06:41:14.9224051Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T06:41:14.9225013Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2025-03-14T06:41:14.9225867Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2025-03-14T06:41:14.9226824Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2025-03-14T06:41:14.9227815Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local 2025-03-14T06:41:14.9228796Z @llvm-project//mlir:VectorTransforms; 18s local 2025-03-14T06:41:14.9229533Z @llvm-project//mlir:MemRefTransforms; 13s local ... 2025-03-14T06:41:15.1322199Z 2025-03-14T06:41:15.1323639Z  2025-03-14T06:41:15.1324171Z  2025-03-14T06:41:15.1324711Z  2025-03-14T06:41:15.1325121Z  2025-03-14T06:41:15.1325547Z  2025-03-14T06:41:15.1325955Z  2025-03-14T06:41:15.1326368Z  2025-03-14T06:41:15.1326792Z  2025-03-14T06:41:15.1327829Z [19,207 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:15.1328809Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T06:41:15.1329635Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2025-03-14T06:41:15.1330546Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2025-03-14T06:41:15.1331512Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2025-03-14T06:41:15.1332521Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local 2025-03-14T06:41:15.1333334Z @llvm-project//mlir:VectorTransforms; 18s local 2025-03-14T06:41:15.1334094Z @llvm-project//mlir:MemRefTransforms; 13s local 2025-03-14T06:41:15.1335007Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local ... 2025-03-14T06:41:15.3797292Z 2025-03-14T06:41:15.3798382Z  2025-03-14T06:41:15.3798899Z  2025-03-14T06:41:15.3799350Z  2025-03-14T06:41:15.3799806Z  2025-03-14T06:41:15.3800225Z  2025-03-14T06:41:15.3800586Z  2025-03-14T06:41:15.3800976Z  2025-03-14T06:41:15.3801378Z  2025-03-14T06:41:15.3802321Z [19,209 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:15.3803343Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 85s local 2025-03-14T06:41:15.3804217Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2025-03-14T06:41:15.3805337Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2025-03-14T06:41:15.3806638Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 21s local 2025-03-14T06:41:15.3807764Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local 2025-03-14T06:41:15.3808622Z @llvm-project//mlir:VectorTransforms; 18s local 2025-03-14T06:41:15.3809450Z @llvm-project//mlir:MemRefTransforms; 13s local 2025-03-14T06:41:15.3810407Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local ... 2025-03-14T06:41:15.6087060Z 2025-03-14T06:41:15.6088528Z  2025-03-14T06:41:15.6089171Z  2025-03-14T06:41:15.6089853Z  2025-03-14T06:41:15.6090277Z  2025-03-14T06:41:15.6090692Z  2025-03-14T06:41:15.6091101Z  2025-03-14T06:41:15.6091507Z  2025-03-14T06:41:15.6091891Z  2025-03-14T06:41:15.6092869Z [19,211 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:15.6093914Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T06:41:15.6094843Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2025-03-14T06:41:15.6095770Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local 2025-03-14T06:41:15.6096777Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2025-03-14T06:41:15.6097786Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local 2025-03-14T06:41:15.6098679Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 13s local 2025-03-14T06:41:15.6099767Z @xla//xla/mlir_hlo:shape_component_analysis; 13s local 2025-03-14T06:41:15.6100599Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2025-03-14T06:41:15.9222799Z 2025-03-14T06:41:15.9223996Z  2025-03-14T06:41:15.9224485Z  2025-03-14T06:41:15.9224912Z  2025-03-14T06:41:15.9225320Z  2025-03-14T06:41:15.9225746Z  2025-03-14T06:41:15.9226159Z  2025-03-14T06:41:15.9226553Z  2025-03-14T06:41:15.9226909Z  2025-03-14T06:41:15.9228126Z [19,211 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:15.9229077Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T06:41:15.9230045Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2025-03-14T06:41:15.9230958Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local 2025-03-14T06:41:15.9231879Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2025-03-14T06:41:15.9232873Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local 2025-03-14T06:41:15.9233735Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2025-03-14T06:41:15.9234632Z @xla//xla/mlir_hlo:shape_component_analysis; 13s local 2025-03-14T06:41:15.9235455Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2025-03-14T06:41:16.2824396Z 2025-03-14T06:41:16.2825245Z  2025-03-14T06:41:16.2825760Z  2025-03-14T06:41:16.2826139Z  2025-03-14T06:41:16.2826546Z  2025-03-14T06:41:16.2826928Z  2025-03-14T06:41:16.2827309Z  2025-03-14T06:41:16.2827688Z  2025-03-14T06:41:16.2828107Z  2025-03-14T06:41:16.2829407Z [19,213 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:16.2830384Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T06:41:16.2831443Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2025-03-14T06:41:16.2832511Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local 2025-03-14T06:41:16.2833602Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 22s local 2025-03-14T06:41:16.2834681Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local 2025-03-14T06:41:16.2835631Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2025-03-14T06:41:16.2836585Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:41:16.2837516Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 14s local ... 2025-03-14T06:41:16.5228357Z 2025-03-14T06:41:16.5229537Z  2025-03-14T06:41:16.5230152Z  2025-03-14T06:41:16.5230674Z  2025-03-14T06:41:16.5231182Z  2025-03-14T06:41:16.5231649Z  2025-03-14T06:41:16.5232116Z  2025-03-14T06:41:16.5232592Z  2025-03-14T06:41:16.5233137Z  2025-03-14T06:41:16.5234136Z [19,213 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:16.5235176Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 86s local 2025-03-14T06:41:16.5236302Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2025-03-14T06:41:16.5237212Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2025-03-14T06:41:16.5238169Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2025-03-14T06:41:16.5239160Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local 2025-03-14T06:41:16.5240056Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2025-03-14T06:41:16.5240903Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:41:16.5241779Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 14s local ... 2025-03-14T06:41:16.7231595Z 2025-03-14T06:41:16.7232522Z  2025-03-14T06:41:16.7233702Z  2025-03-14T06:41:16.7235267Z  2025-03-14T06:41:16.7236700Z  2025-03-14T06:41:16.7238156Z  2025-03-14T06:41:16.7239614Z  2025-03-14T06:41:16.7241085Z  2025-03-14T06:41:16.7242898Z  2025-03-14T06:41:16.7245228Z [19,215 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:16.7247415Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T06:41:16.7248610Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2025-03-14T06:41:16.7249814Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2025-03-14T06:41:16.7251084Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2025-03-14T06:41:16.7252592Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local 2025-03-14T06:41:16.7253728Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 14s local 2025-03-14T06:41:16.7254957Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 14s local 2025-03-14T06:41:16.7256245Z Compiling stablehlo/transforms/VhloToVersion.cpp; 14s local ... 2025-03-14T06:41:17.1192008Z 2025-03-14T06:41:17.1193180Z  2025-03-14T06:41:17.1193682Z  2025-03-14T06:41:17.1194078Z  2025-03-14T06:41:17.1194448Z  2025-03-14T06:41:17.1194846Z  2025-03-14T06:41:17.1195210Z  2025-03-14T06:41:17.1195591Z  2025-03-14T06:41:17.1195952Z  2025-03-14T06:41:17.1196775Z [19,217 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:17.1197627Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T06:41:17.1198477Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2025-03-14T06:41:17.1199655Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2025-03-14T06:41:17.1200478Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2025-03-14T06:41:17.1201448Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local 2025-03-14T06:41:17.1202336Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2025-03-14T06:41:17.1203228Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 14s local 2025-03-14T06:41:17.1204198Z Compiling stablehlo/transforms/VhloToVersion.cpp; 14s local ... 2025-03-14T06:41:17.3236527Z 2025-03-14T06:41:17.3237408Z  2025-03-14T06:41:17.3237849Z  2025-03-14T06:41:17.3238227Z  2025-03-14T06:41:17.3238598Z  2025-03-14T06:41:17.3238986Z  2025-03-14T06:41:17.3239460Z  2025-03-14T06:41:17.3239821Z  2025-03-14T06:41:17.3240152Z  2025-03-14T06:41:17.3241114Z [19,218 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:17.3242421Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T06:41:17.3243342Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2025-03-14T06:41:17.3244268Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2025-03-14T06:41:17.3245377Z Compiling xla/hlo/translate/hlo_to_mhlo/hlo_module_importer.cc; 23s local 2025-03-14T06:41:17.3246391Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local 2025-03-14T06:41:17.3247297Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2025-03-14T06:41:17.3248374Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 15s local 2025-03-14T06:41:17.3249389Z Compiling stablehlo/transforms/VhloToVersion.cpp; 14s local ... 2025-03-14T06:41:17.5239809Z 2025-03-14T06:41:17.5240689Z  2025-03-14T06:41:17.5241123Z  2025-03-14T06:41:17.5241507Z  2025-03-14T06:41:17.5241878Z  2025-03-14T06:41:17.5242259Z  2025-03-14T06:41:17.5242667Z  2025-03-14T06:41:17.5243036Z  2025-03-14T06:41:17.5243424Z  2025-03-14T06:41:17.5244306Z [19,219 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:17.5245436Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 87s local 2025-03-14T06:41:17.5246238Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2025-03-14T06:41:17.5247059Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2025-03-14T06:41:17.5248033Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local 2025-03-14T06:41:17.5248840Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 15s local 2025-03-14T06:41:17.5249689Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 15s local 2025-03-14T06:41:17.5250549Z Compiling stablehlo/transforms/VhloToVersion.cpp; 15s local 2025-03-14T06:41:17.5251260Z @stablehlo//:linalg_passes; 13s local ... 2025-03-14T06:41:17.9244718Z 2025-03-14T06:41:17.9245525Z  2025-03-14T06:41:17.9246250Z  2025-03-14T06:41:17.9246607Z  2025-03-14T06:41:17.9246957Z  2025-03-14T06:41:17.9247297Z  2025-03-14T06:41:17.9247633Z  2025-03-14T06:41:17.9247951Z  2025-03-14T06:41:17.9248299Z  2025-03-14T06:41:17.9249123Z [19,220 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:17.9250115Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2025-03-14T06:41:17.9250875Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2025-03-14T06:41:17.9251680Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2025-03-14T06:41:17.9252396Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local 2025-03-14T06:41:17.9253179Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2025-03-14T06:41:17.9253999Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 15s local 2025-03-14T06:41:17.9254836Z Compiling stablehlo/transforms/VhloToVersion.cpp; 15s local 2025-03-14T06:41:17.9255561Z @stablehlo//:linalg_passes; 13s local ... 2025-03-14T06:41:18.3249610Z 2025-03-14T06:41:18.3250638Z  2025-03-14T06:41:18.3251658Z  2025-03-14T06:41:18.3253197Z  2025-03-14T06:41:18.3254663Z  2025-03-14T06:41:18.3256115Z  2025-03-14T06:41:18.3256964Z  2025-03-14T06:41:18.3257356Z  2025-03-14T06:41:18.3257717Z  2025-03-14T06:41:18.3258571Z [19,221 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:18.3259498Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2025-03-14T06:41:18.3260248Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2025-03-14T06:41:18.3261025Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2025-03-14T06:41:18.3261725Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local 2025-03-14T06:41:18.3262472Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2025-03-14T06:41:18.3263309Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 16s local 2025-03-14T06:41:18.3264385Z Compiling stablehlo/transforms/VhloToVersion.cpp; 15s local 2025-03-14T06:41:18.3265039Z @stablehlo//:linalg_passes; 14s local ... 2025-03-14T06:41:18.5250886Z 2025-03-14T06:41:18.5251897Z  2025-03-14T06:41:18.5252415Z  2025-03-14T06:41:18.5252888Z  2025-03-14T06:41:18.5253320Z  2025-03-14T06:41:18.5253772Z  2025-03-14T06:41:18.5254239Z  2025-03-14T06:41:18.5254739Z  2025-03-14T06:41:18.5255165Z  2025-03-14T06:41:18.5256448Z [19,224 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:41:18.5257553Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 88s local 2025-03-14T06:41:18.5258509Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2025-03-14T06:41:18.5259480Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2025-03-14T06:41:18.5260349Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2025-03-14T06:41:18.5261421Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2025-03-14T06:41:18.5262398Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 16s local 2025-03-14T06:41:18.5263371Z Compiling stablehlo/transforms/VhloToVersion.cpp; 16s local 2025-03-14T06:41:18.5264212Z @stablehlo//:linalg_passes; 14s local ... 2025-03-14T06:41:18.7287219Z 2025-03-14T06:41:18.7288119Z  2025-03-14T06:41:18.7289281Z  2025-03-14T06:41:18.7291209Z  2025-03-14T06:41:18.7292744Z  2025-03-14T06:41:18.7294346Z  2025-03-14T06:41:18.7295908Z  2025-03-14T06:41:18.7297434Z  2025-03-14T06:41:18.7298975Z  2025-03-14T06:41:18.7300727Z [19,226 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:18.7302076Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T06:41:18.7303164Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2025-03-14T06:41:18.7304599Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2025-03-14T06:41:18.7305675Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2025-03-14T06:41:18.7306796Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 16s local 2025-03-14T06:41:18.7308004Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 16s local 2025-03-14T06:41:18.7309255Z Compiling stablehlo/transforms/VhloToVersion.cpp; 16s local 2025-03-14T06:41:18.7310371Z @stablehlo//:linalg_passes; 14s local ... 2025-03-14T06:41:19.0466510Z 2025-03-14T06:41:19.0467772Z  2025-03-14T06:41:19.0468266Z  2025-03-14T06:41:19.0468642Z  2025-03-14T06:41:19.0469018Z  2025-03-14T06:41:19.0469387Z  2025-03-14T06:41:19.0469748Z  2025-03-14T06:41:19.0470129Z  2025-03-14T06:41:19.0470495Z  2025-03-14T06:41:19.0471374Z [19,228 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:19.0472324Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T06:41:19.0473128Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2025-03-14T06:41:19.0473960Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2025-03-14T06:41:19.0474717Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2025-03-14T06:41:19.0475527Z Compiling llvm/lib/ExecutionEngine/Orc/Core.cpp; 17s local 2025-03-14T06:41:19.0476381Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 16s local 2025-03-14T06:41:19.0477123Z @stablehlo//:linalg_passes; 14s local 2025-03-14T06:41:19.0477814Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 14s local ... 2025-03-14T06:41:19.2861865Z 2025-03-14T06:41:19.2863082Z  2025-03-14T06:41:19.2863510Z  2025-03-14T06:41:19.2863856Z  2025-03-14T06:41:19.2864193Z  2025-03-14T06:41:19.2864534Z  2025-03-14T06:41:19.2864851Z  2025-03-14T06:41:19.2865191Z  2025-03-14T06:41:19.2865786Z  2025-03-14T06:41:19.2866821Z [19,229 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:19.2867658Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T06:41:19.2868380Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2025-03-14T06:41:19.2869199Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2025-03-14T06:41:19.2869841Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2025-03-14T06:41:19.2870556Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 17s local 2025-03-14T06:41:19.2871317Z @stablehlo//:linalg_passes; 15s local 2025-03-14T06:41:19.2871902Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 14s local 2025-03-14T06:41:19.2872507Z @llvm-project//llvm:X86CodeGen; 13s local ... 2025-03-14T06:41:19.5257367Z 2025-03-14T06:41:19.5258526Z  2025-03-14T06:41:19.5258984Z  2025-03-14T06:41:19.5259364Z  2025-03-14T06:41:19.5259774Z  2025-03-14T06:41:19.5260139Z  2025-03-14T06:41:19.5260526Z  2025-03-14T06:41:19.5260889Z  2025-03-14T06:41:19.5261262Z  2025-03-14T06:41:19.5262145Z [19,229 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:19.5263100Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 89s local 2025-03-14T06:41:19.5263929Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2025-03-14T06:41:19.5264790Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T06:41:19.5266093Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local 2025-03-14T06:41:19.5266951Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 17s local 2025-03-14T06:41:19.5267705Z @stablehlo//:linalg_passes; 15s local 2025-03-14T06:41:19.5268347Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 15s local 2025-03-14T06:41:19.5269055Z @llvm-project//llvm:X86CodeGen; 14s local ... 2025-03-14T06:41:19.9329633Z 2025-03-14T06:41:19.9331207Z  2025-03-14T06:41:19.9331845Z  2025-03-14T06:41:19.9332387Z  2025-03-14T06:41:19.9332840Z  2025-03-14T06:41:19.9333274Z  2025-03-14T06:41:19.9333674Z  2025-03-14T06:41:19.9334086Z  2025-03-14T06:41:19.9334503Z  2025-03-14T06:41:19.9335516Z [19,230 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:19.9336566Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2025-03-14T06:41:19.9337422Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2025-03-14T06:41:19.9338347Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T06:41:19.9339182Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local 2025-03-14T06:41:19.9340091Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 17s local 2025-03-14T06:41:19.9340922Z @stablehlo//:linalg_passes; 15s local 2025-03-14T06:41:19.9341645Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 15s local 2025-03-14T06:41:19.9342449Z @llvm-project//llvm:X86CodeGen; 14s local ... 2025-03-14T06:41:20.3266817Z 2025-03-14T06:41:20.3268100Z  2025-03-14T06:41:20.3268591Z  2025-03-14T06:41:20.3269004Z  2025-03-14T06:41:20.3269412Z  2025-03-14T06:41:20.3269823Z  2025-03-14T06:41:20.3270230Z  2025-03-14T06:41:20.3270653Z  2025-03-14T06:41:20.3271091Z  2025-03-14T06:41:20.3272042Z [19,231 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:20.3273109Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2025-03-14T06:41:20.3273992Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2025-03-14T06:41:20.3274930Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T06:41:20.3275769Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local 2025-03-14T06:41:20.3276668Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 18s local 2025-03-14T06:41:20.3277477Z @stablehlo//:linalg_passes; 16s local 2025-03-14T06:41:20.3278570Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 15s local 2025-03-14T06:41:20.3279385Z @llvm-project//llvm:X86CodeGen; 15s local ... 2025-03-14T06:41:20.5490248Z 2025-03-14T06:41:20.5491088Z  2025-03-14T06:41:20.5491615Z  2025-03-14T06:41:20.5492053Z  2025-03-14T06:41:20.5492484Z  2025-03-14T06:41:20.5492928Z  2025-03-14T06:41:20.5493344Z  2025-03-14T06:41:20.5493791Z  2025-03-14T06:41:20.5494185Z  2025-03-14T06:41:20.5495464Z [19,234 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:20.5496526Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 90s local 2025-03-14T06:41:20.5497402Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2025-03-14T06:41:20.5498291Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2025-03-14T06:41:20.5499085Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2025-03-14T06:41:20.5499941Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 18s local 2025-03-14T06:41:20.5500737Z @stablehlo//:linalg_passes; 16s local 2025-03-14T06:41:20.5501553Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 16s local 2025-03-14T06:41:20.5502281Z @llvm-project//llvm:X86CodeGen; 15s local ... 2025-03-14T06:41:20.9138127Z 2025-03-14T06:41:20.9139022Z  2025-03-14T06:41:20.9139530Z  2025-03-14T06:41:20.9140245Z  2025-03-14T06:41:20.9140695Z  2025-03-14T06:41:20.9141116Z  2025-03-14T06:41:20.9141543Z  2025-03-14T06:41:20.9141985Z  2025-03-14T06:41:20.9142433Z  2025-03-14T06:41:20.9143393Z [19,236 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:20.9144448Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2025-03-14T06:41:20.9145384Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T06:41:20.9146596Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2025-03-14T06:41:20.9147556Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2025-03-14T06:41:20.9148453Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 18s local 2025-03-14T06:41:20.9149279Z @stablehlo//:linalg_passes; 16s local 2025-03-14T06:41:20.9150015Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 16s local 2025-03-14T06:41:20.9150776Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:41:21.1270326Z 2025-03-14T06:41:21.1271193Z  2025-03-14T06:41:21.1271682Z  2025-03-14T06:41:21.1272153Z  2025-03-14T06:41:21.1272539Z  2025-03-14T06:41:21.1272925Z  2025-03-14T06:41:21.1273315Z  2025-03-14T06:41:21.1273712Z  2025-03-14T06:41:21.1274118Z  2025-03-14T06:41:21.1275073Z [19,237 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:21.1276115Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2025-03-14T06:41:21.1277010Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T06:41:21.1277895Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2025-03-14T06:41:21.1278708Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2025-03-14T06:41:21.1279598Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 18s local 2025-03-14T06:41:21.1280950Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:21.1281835Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 16s local 2025-03-14T06:41:21.1282772Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:41:21.5275148Z 2025-03-14T06:41:21.5276421Z  2025-03-14T06:41:21.5276911Z  2025-03-14T06:41:21.5277294Z  2025-03-14T06:41:21.5277677Z  2025-03-14T06:41:21.5278066Z  2025-03-14T06:41:21.5278428Z  2025-03-14T06:41:21.5278799Z  2025-03-14T06:41:21.5279196Z  2025-03-14T06:41:21.5280456Z [19,238 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:21.5281740Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 91s local 2025-03-14T06:41:21.5282606Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T06:41:21.5283574Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2025-03-14T06:41:21.5284243Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2025-03-14T06:41:21.5285267Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 19s local 2025-03-14T06:41:21.5286295Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:21.5287010Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 17s local 2025-03-14T06:41:21.5287855Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:41:22.5281020Z 2025-03-14T06:41:22.5282256Z  2025-03-14T06:41:22.5282701Z  2025-03-14T06:41:22.5283069Z  2025-03-14T06:41:22.5283416Z  2025-03-14T06:41:22.5283798Z  2025-03-14T06:41:22.5284142Z  2025-03-14T06:41:22.5284635Z  2025-03-14T06:41:22.5285002Z  2025-03-14T06:41:22.5285853Z [19,238 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:22.5286747Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 92s local 2025-03-14T06:41:22.5287497Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2025-03-14T06:41:22.5288301Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2025-03-14T06:41:22.5289301Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T06:41:22.5290118Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local 2025-03-14T06:41:22.5290896Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:22.5291610Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local 2025-03-14T06:41:22.5292433Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:41:22.8167750Z 2025-03-14T06:41:22.8169255Z  2025-03-14T06:41:22.8169714Z  2025-03-14T06:41:22.8170093Z  2025-03-14T06:41:22.8170519Z  2025-03-14T06:41:22.8170906Z  2025-03-14T06:41:22.8171288Z  2025-03-14T06:41:22.8171683Z  2025-03-14T06:41:22.8172063Z  2025-03-14T06:41:22.8172975Z [19,239 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:22.8173984Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2025-03-14T06:41:22.8174785Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T06:41:22.8175657Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2025-03-14T06:41:22.8176465Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T06:41:22.8177333Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local 2025-03-14T06:41:22.8178093Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:22.8178801Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local 2025-03-14T06:41:22.8179620Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:41:23.1286048Z 2025-03-14T06:41:23.1287076Z  2025-03-14T06:41:23.1287577Z  2025-03-14T06:41:23.1288003Z  2025-03-14T06:41:23.1288423Z  2025-03-14T06:41:23.1288833Z  2025-03-14T06:41:23.1289222Z  2025-03-14T06:41:23.1289609Z  2025-03-14T06:41:23.1290023Z  2025-03-14T06:41:23.1291005Z [19,239 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:23.1292088Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2025-03-14T06:41:23.1292955Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T06:41:23.1293903Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2025-03-14T06:41:23.1294751Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T06:41:23.1295653Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 20s local 2025-03-14T06:41:23.1296992Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:23.1298184Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 18s local 2025-03-14T06:41:23.1299205Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:41:23.5374530Z 2025-03-14T06:41:23.5375383Z  2025-03-14T06:41:23.5375877Z  2025-03-14T06:41:23.5376247Z  2025-03-14T06:41:23.5376612Z  2025-03-14T06:41:23.5376964Z  2025-03-14T06:41:23.5377346Z  2025-03-14T06:41:23.5377712Z  2025-03-14T06:41:23.5378144Z  2025-03-14T06:41:23.5379343Z [19,240 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:23.5380323Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 93s local 2025-03-14T06:41:23.5381164Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T06:41:23.5382040Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T06:41:23.5382863Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2025-03-14T06:41:23.5383796Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 21s local 2025-03-14T06:41:23.5384576Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:23.5385271Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local 2025-03-14T06:41:23.5386014Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:41:23.9292581Z 2025-03-14T06:41:23.9293537Z  2025-03-14T06:41:23.9294180Z  2025-03-14T06:41:23.9296194Z  2025-03-14T06:41:23.9299570Z  2025-03-14T06:41:23.9302514Z  2025-03-14T06:41:23.9305424Z  2025-03-14T06:41:23.9308364Z  2025-03-14T06:41:23.9311437Z  2025-03-14T06:41:23.9315180Z [19,240 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:23.9318848Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T06:41:23.9322329Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T06:41:23.9325207Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T06:41:23.9326370Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2025-03-14T06:41:23.9327478Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 21s local 2025-03-14T06:41:23.9328597Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:23.9329812Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local 2025-03-14T06:41:23.9330736Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2025-03-14T06:41:24.3295236Z 2025-03-14T06:41:24.3296579Z  2025-03-14T06:41:24.3297061Z  2025-03-14T06:41:24.3297487Z  2025-03-14T06:41:24.3297860Z  2025-03-14T06:41:24.3298237Z  2025-03-14T06:41:24.3298618Z  2025-03-14T06:41:24.3299031Z  2025-03-14T06:41:24.3299416Z  2025-03-14T06:41:24.3300289Z [19,241 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:24.3301246Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T06:41:24.3302187Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T06:41:24.3303005Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T06:41:24.3303742Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2025-03-14T06:41:24.3304544Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local 2025-03-14T06:41:24.3305300Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:24.3305992Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 19s local 2025-03-14T06:41:24.3306765Z @llvm-project//mlir:MemRefTransforms; 17s local ... 2025-03-14T06:41:24.5809532Z 2025-03-14T06:41:24.5810514Z  2025-03-14T06:41:24.5810935Z  2025-03-14T06:41:24.5811289Z  2025-03-14T06:41:24.5811629Z  2025-03-14T06:41:24.5811975Z  2025-03-14T06:41:24.5812304Z  2025-03-14T06:41:24.5812638Z  2025-03-14T06:41:24.5812985Z  2025-03-14T06:41:24.5814142Z [19,242 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:24.5815029Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 94s local 2025-03-14T06:41:24.5815785Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T06:41:24.5816868Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T06:41:24.5817679Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T06:41:24.5818538Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local 2025-03-14T06:41:24.5819337Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:24.5820222Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local 2025-03-14T06:41:24.5821045Z @llvm-project//mlir:MemRefTransforms; 17s local ... 2025-03-14T06:41:24.9300777Z 2025-03-14T06:41:24.9301731Z  2025-03-14T06:41:24.9302190Z  2025-03-14T06:41:24.9302775Z  2025-03-14T06:41:24.9303222Z  2025-03-14T06:41:24.9303597Z  2025-03-14T06:41:24.9304014Z  2025-03-14T06:41:24.9304362Z  2025-03-14T06:41:24.9304733Z  2025-03-14T06:41:24.9305608Z [19,242 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:24.9306782Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T06:41:24.9307717Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T06:41:24.9308705Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T06:41:24.9309962Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T06:41:24.9310982Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 22s local 2025-03-14T06:41:24.9311881Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:24.9312679Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local 2025-03-14T06:41:24.9313603Z @llvm-project//mlir:MemRefTransforms; 17s local ... 2025-03-14T06:41:25.2467958Z 2025-03-14T06:41:25.2468657Z  2025-03-14T06:41:25.2469199Z  2025-03-14T06:41:25.2469460Z  2025-03-14T06:41:25.2469714Z  2025-03-14T06:41:25.2469954Z  2025-03-14T06:41:25.2470193Z  2025-03-14T06:41:25.2470437Z  2025-03-14T06:41:25.2470676Z  2025-03-14T06:41:25.2471233Z [19,243 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:25.2471822Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T06:41:25.2472333Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T06:41:25.2472862Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T06:41:25.2473345Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T06:41:25.2473871Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local 2025-03-14T06:41:25.2474339Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:25.2475068Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 20s local 2025-03-14T06:41:25.2475568Z @llvm-project//mlir:MemRefTransforms; 18s local ... 2025-03-14T06:41:25.5266595Z 2025-03-14T06:41:25.5267589Z  2025-03-14T06:41:25.5268057Z  2025-03-14T06:41:25.5271083Z  2025-03-14T06:41:25.5274374Z  2025-03-14T06:41:25.5277570Z  2025-03-14T06:41:25.5280862Z  2025-03-14T06:41:25.5283897Z  2025-03-14T06:41:25.5287034Z  2025-03-14T06:41:25.5290604Z [19,244 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:25.5294156Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 95s local 2025-03-14T06:41:25.5297678Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T06:41:25.5301225Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T06:41:25.5304689Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T06:41:25.5307086Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local 2025-03-14T06:41:25.5308196Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:25.5309328Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local 2025-03-14T06:41:25.5310389Z @llvm-project//mlir:MemRefTransforms; 18s local ... 2025-03-14T06:41:25.7300971Z 2025-03-14T06:41:25.7302231Z  2025-03-14T06:41:25.7302901Z  2025-03-14T06:41:25.7303579Z  2025-03-14T06:41:25.7304768Z  2025-03-14T06:41:25.7305196Z  2025-03-14T06:41:25.7305555Z  2025-03-14T06:41:25.7305922Z  2025-03-14T06:41:25.7306320Z  2025-03-14T06:41:25.7307459Z [19,245 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:25.7308400Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T06:41:25.7309244Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T06:41:25.7310111Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T06:41:25.7310876Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T06:41:25.7311739Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local 2025-03-14T06:41:25.7312508Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:25.7313132Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local 2025-03-14T06:41:25.7313874Z @llvm-project//mlir:MemRefTransforms; 18s local ... 2025-03-14T06:41:25.9309557Z 2025-03-14T06:41:25.9310401Z  2025-03-14T06:41:25.9310948Z  2025-03-14T06:41:25.9311319Z  2025-03-14T06:41:25.9311923Z  2025-03-14T06:41:25.9312296Z  2025-03-14T06:41:25.9312659Z  2025-03-14T06:41:25.9313035Z  2025-03-14T06:41:25.9313388Z  2025-03-14T06:41:25.9326681Z [19,246 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:25.9327853Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T06:41:25.9328635Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T06:41:25.9329652Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T06:41:25.9330375Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T06:41:25.9331164Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 23s local 2025-03-14T06:41:25.9331886Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:25.9332533Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local 2025-03-14T06:41:25.9333256Z @llvm-project//mlir:MemRefTransforms; 18s local ... 2025-03-14T06:41:26.3310228Z 2025-03-14T06:41:26.3311102Z  2025-03-14T06:41:26.3311549Z  2025-03-14T06:41:26.3311945Z  2025-03-14T06:41:26.3312311Z  2025-03-14T06:41:26.3312679Z  2025-03-14T06:41:26.3313024Z  2025-03-14T06:41:26.3313380Z  2025-03-14T06:41:26.3313747Z  2025-03-14T06:41:26.3314620Z [19,246 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:26.3315548Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T06:41:26.3316360Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T06:41:26.3317170Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T06:41:26.3317913Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T06:41:26.3318739Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local 2025-03-14T06:41:26.3319470Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:26.3320163Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 21s local 2025-03-14T06:41:26.3320943Z @llvm-project//mlir:MemRefTransforms; 19s local ... 2025-03-14T06:41:26.5739413Z 2025-03-14T06:41:26.5740493Z  2025-03-14T06:41:26.5743093Z  2025-03-14T06:41:26.5746357Z  2025-03-14T06:41:26.5749499Z  2025-03-14T06:41:26.5752462Z  2025-03-14T06:41:26.5755469Z  2025-03-14T06:41:26.5758543Z  2025-03-14T06:41:26.5761519Z  2025-03-14T06:41:26.5765719Z [19,247 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:26.5769493Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 96s local 2025-03-14T06:41:26.5772920Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T06:41:26.5776451Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T06:41:26.5780050Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T06:41:26.5783558Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local 2025-03-14T06:41:26.5786855Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:26.5790091Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local 2025-03-14T06:41:26.5791180Z @llvm-project//mlir:MemRefTransforms; 19s local ... 2025-03-14T06:41:26.9314573Z 2025-03-14T06:41:26.9315817Z  2025-03-14T06:41:26.9316563Z  2025-03-14T06:41:26.9317247Z  2025-03-14T06:41:26.9318518Z  2025-03-14T06:41:26.9318978Z  2025-03-14T06:41:26.9319438Z  2025-03-14T06:41:26.9319767Z  2025-03-14T06:41:26.9320138Z  2025-03-14T06:41:26.9321111Z [19,247 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:26.9322217Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2025-03-14T06:41:26.9322992Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T06:41:26.9324045Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T06:41:26.9325325Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T06:41:26.9326268Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local 2025-03-14T06:41:26.9327196Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:26.9327944Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local 2025-03-14T06:41:26.9328825Z @llvm-project//mlir:MemRefTransforms; 19s local ... 2025-03-14T06:41:27.1606998Z 2025-03-14T06:41:27.1607853Z  2025-03-14T06:41:27.1608624Z  2025-03-14T06:41:27.1608997Z  2025-03-14T06:41:27.1609380Z  2025-03-14T06:41:27.1609747Z  2025-03-14T06:41:27.1610118Z  2025-03-14T06:41:27.1610474Z  2025-03-14T06:41:27.1610834Z  2025-03-14T06:41:27.1611698Z [19,249 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:27.1612615Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2025-03-14T06:41:27.1613419Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T06:41:27.1614253Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T06:41:27.1614986Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T06:41:27.1615790Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 24s local 2025-03-14T06:41:27.1616489Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:41:27.1617137Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 22s local 2025-03-14T06:41:27.1617884Z @llvm-project//mlir:MemRefTransforms; 19s local ... 2025-03-14T06:41:27.5320393Z 2025-03-14T06:41:27.5321296Z  2025-03-14T06:41:27.5321750Z  2025-03-14T06:41:27.5322148Z  2025-03-14T06:41:27.5322525Z  2025-03-14T06:41:27.5322897Z  2025-03-14T06:41:27.5323275Z  2025-03-14T06:41:27.5323647Z  2025-03-14T06:41:27.5324021Z  2025-03-14T06:41:27.5325037Z [19,251 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:27.5325999Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 97s local 2025-03-14T06:41:27.5326838Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T06:41:27.5327672Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T06:41:27.5328443Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T06:41:27.5329282Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2025-03-14T06:41:27.5330027Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:41:27.5330957Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2025-03-14T06:41:27.5331729Z @llvm-project//mlir:MemRefTransforms; 20s local ... 2025-03-14T06:41:27.7361042Z 2025-03-14T06:41:27.7361917Z  2025-03-14T06:41:27.7362332Z  2025-03-14T06:41:27.7362660Z  2025-03-14T06:41:27.7362991Z  2025-03-14T06:41:27.7363321Z  2025-03-14T06:41:27.7363908Z  2025-03-14T06:41:27.7364345Z  2025-03-14T06:41:27.7364927Z  2025-03-14T06:41:27.7366347Z [19,252 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:27.7367317Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T06:41:27.7368124Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T06:41:27.7368948Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T06:41:27.7369702Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T06:41:27.7370543Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2025-03-14T06:41:27.7371273Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:41:27.7371946Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2025-03-14T06:41:27.7372688Z @llvm-project//mlir:MemRefTransforms; 20s local ... 2025-03-14T06:41:27.9428588Z 2025-03-14T06:41:27.9429534Z  2025-03-14T06:41:27.9429977Z  2025-03-14T06:41:27.9430790Z  2025-03-14T06:41:27.9431293Z  2025-03-14T06:41:27.9432010Z  2025-03-14T06:41:27.9432488Z  2025-03-14T06:41:27.9433026Z  2025-03-14T06:41:27.9433507Z  2025-03-14T06:41:27.9434492Z [19,254 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:27.9435552Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T06:41:27.9436468Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2025-03-14T06:41:27.9437529Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T06:41:27.9438375Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T06:41:27.9439299Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 25s local 2025-03-14T06:41:27.9440147Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:41:27.9440916Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2025-03-14T06:41:27.9441710Z @stablehlo//:linalg_passes; 18s local ... 2025-03-14T06:41:28.3327032Z 2025-03-14T06:41:28.3327937Z  2025-03-14T06:41:28.3328449Z  2025-03-14T06:41:28.3328884Z  2025-03-14T06:41:28.3329340Z  2025-03-14T06:41:28.3329775Z  2025-03-14T06:41:28.3330201Z  2025-03-14T06:41:28.3330597Z  2025-03-14T06:41:28.3331019Z  2025-03-14T06:41:28.3332484Z [19,254 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:28.3333764Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T06:41:28.3334829Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2025-03-14T06:41:28.3335874Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T06:41:28.3336861Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T06:41:28.3337904Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2025-03-14T06:41:28.3338880Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:41:28.3339755Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 23s local 2025-03-14T06:41:28.3340801Z @stablehlo//:linalg_passes; 19s local ... 2025-03-14T06:41:28.5330852Z 2025-03-14T06:41:28.5331751Z  2025-03-14T06:41:28.5332538Z  2025-03-14T06:41:28.5332951Z  2025-03-14T06:41:28.5333505Z  2025-03-14T06:41:28.5334056Z  2025-03-14T06:41:28.5334591Z  2025-03-14T06:41:28.5335122Z  2025-03-14T06:41:28.5335644Z  2025-03-14T06:41:28.5336728Z [19,255 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:28.5338096Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 98s local 2025-03-14T06:41:28.5339077Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2025-03-14T06:41:28.5340136Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T06:41:28.5341114Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T06:41:28.5342136Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2025-03-14T06:41:28.5343060Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:41:28.5344063Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local 2025-03-14T06:41:28.5344957Z @stablehlo//:linalg_passes; 19s local ... 2025-03-14T06:41:28.9335010Z 2025-03-14T06:41:28.9335992Z  2025-03-14T06:41:28.9336506Z  2025-03-14T06:41:28.9339167Z  2025-03-14T06:41:28.9342327Z  2025-03-14T06:41:28.9345351Z  2025-03-14T06:41:28.9348381Z  2025-03-14T06:41:28.9351488Z  2025-03-14T06:41:28.9354523Z  2025-03-14T06:41:28.9358124Z [19,257 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:28.9361695Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2025-03-14T06:41:28.9365720Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2025-03-14T06:41:28.9369006Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T06:41:28.9372251Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T06:41:28.9375982Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2025-03-14T06:41:28.9379274Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:41:28.9382496Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local 2025-03-14T06:41:28.9385807Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2025-03-14T06:41:29.1769956Z 2025-03-14T06:41:29.1773425Z  2025-03-14T06:41:29.1776503Z  2025-03-14T06:41:29.1779487Z  2025-03-14T06:41:29.1782794Z  2025-03-14T06:41:29.1785765Z  2025-03-14T06:41:29.1788833Z  2025-03-14T06:41:29.1791934Z  2025-03-14T06:41:29.1795075Z  2025-03-14T06:41:29.1798733Z [19,259 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:29.1802366Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2025-03-14T06:41:29.1805790Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T06:41:29.1809063Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T06:41:29.1811172Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 26s local 2025-03-14T06:41:29.1812186Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:41:29.1813082Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 24s local 2025-03-14T06:41:29.1813989Z @llvm-project//mlir:VectorToLLVM; 18s local 2025-03-14T06:41:29.1814839Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:41:29.5131812Z 2025-03-14T06:41:29.5133031Z  2025-03-14T06:41:29.5133834Z  2025-03-14T06:41:29.5135497Z  2025-03-14T06:41:29.5136714Z  2025-03-14T06:41:29.5137217Z  2025-03-14T06:41:29.5137621Z  2025-03-14T06:41:29.5138122Z  2025-03-14T06:41:29.5138547Z  2025-03-14T06:41:29.5139547Z [19,260 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:29.5140626Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 99s local 2025-03-14T06:41:29.5141465Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T06:41:29.5142341Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2025-03-14T06:41:29.5143392Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2025-03-14T06:41:29.5144214Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:41:29.5144918Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2025-03-14T06:41:29.5145701Z @llvm-project//mlir:VectorToLLVM; 18s local 2025-03-14T06:41:29.5146662Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:41:29.7342001Z 2025-03-14T06:41:29.7342862Z  2025-03-14T06:41:29.7343362Z  2025-03-14T06:41:29.7343760Z  2025-03-14T06:41:29.7344190Z  2025-03-14T06:41:29.7344857Z  2025-03-14T06:41:29.7345288Z  2025-03-14T06:41:29.7345824Z  2025-03-14T06:41:29.7346358Z  2025-03-14T06:41:29.7347482Z [19,261 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:29.7350780Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2025-03-14T06:41:29.7352162Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2025-03-14T06:41:29.7353242Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2025-03-14T06:41:29.7354286Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2025-03-14T06:41:29.7355238Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:41:29.7356056Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2025-03-14T06:41:29.7356975Z @llvm-project//mlir:VectorToLLVM; 19s local 2025-03-14T06:41:29.7357774Z @stablehlo//:linalg_passes; 16s local ... 2025-03-14T06:41:30.1345515Z 2025-03-14T06:41:30.1346408Z  2025-03-14T06:41:30.1346930Z  2025-03-14T06:41:30.1347338Z  2025-03-14T06:41:30.1347741Z  2025-03-14T06:41:30.1348125Z  2025-03-14T06:41:30.1348520Z  2025-03-14T06:41:30.1348992Z  2025-03-14T06:41:30.1349773Z  2025-03-14T06:41:30.1350748Z [19,264 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:30.1351766Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 100s local 2025-03-14T06:41:30.1352599Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2025-03-14T06:41:30.1353458Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2025-03-14T06:41:30.1354382Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 27s local 2025-03-14T06:41:30.1355973Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:41:30.1356810Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 25s local 2025-03-14T06:41:30.1357777Z @llvm-project//mlir:VectorToLLVM; 19s local 2025-03-14T06:41:30.1358557Z @stablehlo//:linalg_passes; 16s local ... 2025-03-14T06:41:30.6159566Z 2025-03-14T06:41:30.6160504Z  2025-03-14T06:41:30.6161007Z  2025-03-14T06:41:30.6163748Z  2025-03-14T06:41:30.6166095Z  2025-03-14T06:41:30.6166658Z  2025-03-14T06:41:30.6167047Z  2025-03-14T06:41:30.6167412Z  2025-03-14T06:41:30.6167778Z  2025-03-14T06:41:30.6168601Z [19,265 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:30.6169483Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2025-03-14T06:41:30.6170202Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T06:41:30.6170937Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T06:41:30.6171758Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2025-03-14T06:41:30.6172488Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:41:30.6173125Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2025-03-14T06:41:30.6173814Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T06:41:30.6174448Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:41:30.9351438Z 2025-03-14T06:41:30.9352428Z  2025-03-14T06:41:30.9352956Z  2025-03-14T06:41:30.9353357Z  2025-03-14T06:41:30.9353751Z  2025-03-14T06:41:30.9354174Z  2025-03-14T06:41:30.9354572Z  2025-03-14T06:41:30.9354965Z  2025-03-14T06:41:30.9355370Z  2025-03-14T06:41:30.9356312Z [19,266 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:30.9357315Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2025-03-14T06:41:30.9358129Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T06:41:30.9359217Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T06:41:30.9360114Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2025-03-14T06:41:30.9360910Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:41:30.9361619Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2025-03-14T06:41:30.9362397Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T06:41:30.9363047Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:41:31.1727207Z 2025-03-14T06:41:31.1728072Z  2025-03-14T06:41:31.1730690Z  2025-03-14T06:41:31.1731348Z  2025-03-14T06:41:31.1731728Z  2025-03-14T06:41:31.1732076Z  2025-03-14T06:41:31.1732461Z  2025-03-14T06:41:31.1732823Z  2025-03-14T06:41:31.1733192Z  2025-03-14T06:41:31.1734082Z [19,267 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:31.1735025Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2025-03-14T06:41:31.1735784Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T06:41:31.1736582Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T06:41:31.1737403Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 28s local 2025-03-14T06:41:31.1738181Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:41:31.1738765Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 26s local 2025-03-14T06:41:31.1739586Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T06:41:31.1740155Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:41:31.4701925Z 2025-03-14T06:41:31.4702880Z  2025-03-14T06:41:31.4703406Z  2025-03-14T06:41:31.4703820Z  2025-03-14T06:41:31.4704250Z  2025-03-14T06:41:31.4704688Z  2025-03-14T06:41:31.4705099Z  2025-03-14T06:41:31.4705539Z  2025-03-14T06:41:31.4705971Z  2025-03-14T06:41:31.4707211Z [19,268 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:31.4708202Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 101s local 2025-03-14T06:41:31.4709004Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T06:41:31.4709761Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T06:41:31.4710594Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local 2025-03-14T06:41:31.4711371Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:41:31.4711992Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T06:41:31.4712641Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T06:41:31.4713195Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:41:31.7359210Z 2025-03-14T06:41:31.7360226Z  2025-03-14T06:41:31.7360807Z  2025-03-14T06:41:31.7361316Z  2025-03-14T06:41:31.7363118Z  2025-03-14T06:41:31.7363592Z  2025-03-14T06:41:31.7364953Z  2025-03-14T06:41:31.7365566Z  2025-03-14T06:41:31.7365986Z  2025-03-14T06:41:31.7367053Z [19,268 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:31.7368042Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2025-03-14T06:41:31.7368858Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T06:41:31.7369667Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T06:41:31.7370590Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local 2025-03-14T06:41:31.7371387Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:41:31.7372115Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T06:41:31.7372867Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T06:41:31.7373499Z @stablehlo//:linalg_passes; 18s local ... 2025-03-14T06:41:31.9361472Z 2025-03-14T06:41:31.9362502Z  2025-03-14T06:41:31.9363077Z  2025-03-14T06:41:31.9363765Z  2025-03-14T06:41:31.9365494Z  2025-03-14T06:41:31.9366314Z  2025-03-14T06:41:31.9366965Z  2025-03-14T06:41:31.9367505Z  2025-03-14T06:41:31.9367883Z  2025-03-14T06:41:31.9368951Z [19,270 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:31.9369955Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2025-03-14T06:41:31.9370629Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T06:41:31.9371354Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T06:41:31.9372358Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 29s local 2025-03-14T06:41:31.9373127Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:41:31.9373808Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T06:41:31.9374498Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:31.9375159Z Compiling xla/service/llvm_ir/llvm_util.cc; 17s local ... 2025-03-14T06:41:32.3365189Z 2025-03-14T06:41:32.3366453Z  2025-03-14T06:41:32.3366953Z  2025-03-14T06:41:32.3367388Z  2025-03-14T06:41:32.3367782Z  2025-03-14T06:41:32.3368162Z  2025-03-14T06:41:32.3368525Z  2025-03-14T06:41:32.3368875Z  2025-03-14T06:41:32.3369233Z  2025-03-14T06:41:32.3370132Z [19,271 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:32.3371192Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 102s local 2025-03-14T06:41:32.3372386Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T06:41:32.3373308Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T06:41:32.3374189Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local 2025-03-14T06:41:32.3374986Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:41:32.3375702Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 27s local 2025-03-14T06:41:32.3376630Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:32.3377497Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 17s local ... 2025-03-14T06:41:32.6392734Z 2025-03-14T06:41:32.6393651Z  2025-03-14T06:41:32.6394141Z  2025-03-14T06:41:32.6394529Z  2025-03-14T06:41:32.6394910Z  2025-03-14T06:41:32.6395313Z  2025-03-14T06:41:32.6395763Z  2025-03-14T06:41:32.6396215Z  2025-03-14T06:41:32.6396619Z  2025-03-14T06:41:32.6397557Z [19,273 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:32.6398703Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2025-03-14T06:41:32.6399505Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2025-03-14T06:41:32.6400381Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2025-03-14T06:41:32.6401242Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local 2025-03-14T06:41:32.6402009Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:41:32.6402743Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2025-03-14T06:41:32.6403456Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:32.6404315Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 17s local ... 2025-03-14T06:41:32.9376268Z 2025-03-14T06:41:32.9377093Z  2025-03-14T06:41:32.9377566Z  2025-03-14T06:41:32.9378016Z  2025-03-14T06:41:32.9378515Z  2025-03-14T06:41:32.9378920Z  2025-03-14T06:41:32.9379321Z  2025-03-14T06:41:32.9379701Z  2025-03-14T06:41:32.9380561Z  2025-03-14T06:41:32.9381553Z [19,273 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:32.9382931Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 103s local 2025-03-14T06:41:32.9383931Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2025-03-14T06:41:32.9384819Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2025-03-14T06:41:32.9385809Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 30s local 2025-03-14T06:41:32.9386934Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:41:32.9387794Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 28s local 2025-03-14T06:41:32.9388615Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:32.9389534Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 17s local ... 2025-03-14T06:41:33.6941660Z 2025-03-14T06:41:33.6942512Z  2025-03-14T06:41:33.6942982Z  2025-03-14T06:41:33.6943460Z  2025-03-14T06:41:33.6943817Z  2025-03-14T06:41:33.6944209Z  2025-03-14T06:41:33.6944795Z  2025-03-14T06:41:33.6945197Z  2025-03-14T06:41:33.6945586Z  2025-03-14T06:41:33.6946470Z [19,274 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:33.6947394Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T06:41:33.6948199Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2025-03-14T06:41:33.6949078Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T06:41:33.6950027Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local 2025-03-14T06:41:33.6950851Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:41:33.6951426Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T06:41:33.6951999Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:33.6952630Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 18s local ... 2025-03-14T06:41:33.9377820Z 2025-03-14T06:41:33.9378834Z  2025-03-14T06:41:33.9379434Z  2025-03-14T06:41:33.9381039Z  2025-03-14T06:41:33.9381622Z  2025-03-14T06:41:33.9383068Z  2025-03-14T06:41:33.9383541Z  2025-03-14T06:41:33.9385061Z  2025-03-14T06:41:33.9385531Z  2025-03-14T06:41:33.9387671Z [19,275 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:33.9389094Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T06:41:33.9389873Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2025-03-14T06:41:33.9390618Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T06:41:33.9391475Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 31s local 2025-03-14T06:41:33.9392233Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:41:33.9392942Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T06:41:33.9393675Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:33.9394555Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 18s local ... 2025-03-14T06:41:34.4017710Z 2025-03-14T06:41:34.4018592Z  2025-03-14T06:41:34.4019075Z  2025-03-14T06:41:34.4019457Z  2025-03-14T06:41:34.4019845Z  2025-03-14T06:41:34.4020222Z  2025-03-14T06:41:34.4020581Z  2025-03-14T06:41:34.4020952Z  2025-03-14T06:41:34.4021316Z  2025-03-14T06:41:34.4022266Z [19,276 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:34.4023241Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 104s local 2025-03-14T06:41:34.4024002Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2025-03-14T06:41:34.4024975Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T06:41:34.4025780Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2025-03-14T06:41:34.4026559Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:41:34.4027266Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 29s local 2025-03-14T06:41:34.4027965Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:34.4028812Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 19s local ... 2025-03-14T06:41:34.7383639Z 2025-03-14T06:41:34.7384641Z  2025-03-14T06:41:34.7385209Z  2025-03-14T06:41:34.7386870Z  2025-03-14T06:41:34.7387368Z  2025-03-14T06:41:34.7387909Z  2025-03-14T06:41:34.7389839Z  2025-03-14T06:41:34.7390626Z  2025-03-14T06:41:34.7391017Z  2025-03-14T06:41:34.7392071Z [19,276 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:34.7393159Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T06:41:34.7393973Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2025-03-14T06:41:34.7394737Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2025-03-14T06:41:34.7395678Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2025-03-14T06:41:34.7396688Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:41:34.7397401Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T06:41:34.7398120Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:34.7399076Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 19s local ... 2025-03-14T06:41:34.9787212Z 2025-03-14T06:41:34.9788144Z  2025-03-14T06:41:34.9788698Z  2025-03-14T06:41:34.9789173Z  2025-03-14T06:41:34.9789627Z  2025-03-14T06:41:34.9790107Z  2025-03-14T06:41:34.9790588Z  2025-03-14T06:41:34.9791047Z  2025-03-14T06:41:34.9791478Z  2025-03-14T06:41:34.9792484Z [19,278 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:34.9793564Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T06:41:34.9794674Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2025-03-14T06:41:34.9795392Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2025-03-14T06:41:34.9796074Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 32s local 2025-03-14T06:41:34.9796695Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:41:34.9797258Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T06:41:34.9797984Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 19s local 2025-03-14T06:41:34.9798931Z @llvm-project//mlir:MemRefTransforms; 19s local ... 2025-03-14T06:41:35.3012467Z 2025-03-14T06:41:35.3013344Z  2025-03-14T06:41:35.3013782Z  2025-03-14T06:41:35.3014154Z  2025-03-14T06:41:35.3014554Z  2025-03-14T06:41:35.3014909Z  2025-03-14T06:41:35.3015299Z  2025-03-14T06:41:35.3015710Z  2025-03-14T06:41:35.3016115Z  2025-03-14T06:41:35.3017073Z [19,279 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:35.3018159Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T06:41:35.3018989Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2025-03-14T06:41:35.3019811Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2025-03-14T06:41:35.3020709Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2025-03-14T06:41:35.3021519Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:41:35.3022231Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 30s local 2025-03-14T06:41:35.3023168Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 20s local 2025-03-14T06:41:35.3024106Z @llvm-project//mlir:MemRefTransforms; 19s local ... 2025-03-14T06:41:35.5389696Z 2025-03-14T06:41:35.5390833Z  2025-03-14T06:41:35.5392394Z  2025-03-14T06:41:35.5393863Z  2025-03-14T06:41:35.5395389Z  2025-03-14T06:41:35.5396914Z  2025-03-14T06:41:35.5398380Z  2025-03-14T06:41:35.5399239Z  2025-03-14T06:41:35.5399903Z  2025-03-14T06:41:35.5400904Z [19,280 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:35.5401775Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 105s local 2025-03-14T06:41:35.5402458Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T06:41:35.5403159Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2025-03-14T06:41:35.5403917Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2025-03-14T06:41:35.5404979Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:41:35.5405589Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T06:41:35.5406396Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 20s local 2025-03-14T06:41:35.5407191Z @llvm-project//mlir:MemRefTransforms; 19s local ... 2025-03-14T06:41:35.8537369Z 2025-03-14T06:41:35.8538295Z  2025-03-14T06:41:35.8538816Z  2025-03-14T06:41:35.8539489Z  2025-03-14T06:41:35.8539943Z  2025-03-14T06:41:35.8540455Z  2025-03-14T06:41:35.8540969Z  2025-03-14T06:41:35.8541723Z  2025-03-14T06:41:35.8542217Z  2025-03-14T06:41:35.8543248Z [19,281 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:35.8544340Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2025-03-14T06:41:35.8545233Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T06:41:35.8546164Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2025-03-14T06:41:35.8547119Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2025-03-14T06:41:35.8547943Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:41:35.8548725Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T06:41:35.8549686Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 20s local 2025-03-14T06:41:35.8550540Z @llvm-project//mlir:MemRefTransforms; 20s local ... 2025-03-14T06:41:36.1394342Z 2025-03-14T06:41:36.1395612Z  2025-03-14T06:41:36.1397180Z  2025-03-14T06:41:36.1398733Z  2025-03-14T06:41:36.1400213Z  2025-03-14T06:41:36.1401703Z  2025-03-14T06:41:36.1403181Z  2025-03-14T06:41:36.1404834Z  2025-03-14T06:41:36.1405968Z  2025-03-14T06:41:36.1407371Z [19,282 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:36.1408595Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2025-03-14T06:41:36.1409348Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T06:41:36.1410113Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2025-03-14T06:41:36.1410942Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 33s local 2025-03-14T06:41:36.1411703Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:41:36.1412405Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 31s local 2025-03-14T06:41:36.1413339Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 21s local 2025-03-14T06:41:36.1414300Z @llvm-project//mlir:MemRefTransforms; 20s local ... 2025-03-14T06:41:36.4972488Z 2025-03-14T06:41:36.4973441Z  2025-03-14T06:41:36.4973915Z  2025-03-14T06:41:36.4974360Z  2025-03-14T06:41:36.4975147Z  2025-03-14T06:41:36.4975682Z  2025-03-14T06:41:36.4976188Z  2025-03-14T06:41:36.4976701Z  2025-03-14T06:41:36.4977207Z  2025-03-14T06:41:36.4978295Z [19,283 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:36.4979447Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 106s local 2025-03-14T06:41:36.4980348Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T06:41:36.4981277Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T06:41:36.4982254Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2025-03-14T06:41:36.4983105Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:41:36.4983968Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T06:41:36.4984985Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 21s local 2025-03-14T06:41:36.4986078Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 20s local ... 2025-03-14T06:41:36.6979879Z 2025-03-14T06:41:36.6981039Z  2025-03-14T06:41:36.6982703Z  2025-03-14T06:41:36.6984212Z  2025-03-14T06:41:36.6985735Z  2025-03-14T06:41:36.6987242Z  2025-03-14T06:41:36.6988706Z  2025-03-14T06:41:36.6989864Z  2025-03-14T06:41:36.6990311Z  2025-03-14T06:41:36.6991209Z [19,284 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:36.6992157Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2025-03-14T06:41:36.6992946Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T06:41:36.6993708Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T06:41:36.6994759Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2025-03-14T06:41:36.6995520Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:41:36.6996316Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T06:41:36.6997266Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 21s local 2025-03-14T06:41:36.6998246Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local ... 2025-03-14T06:41:36.9399332Z 2025-03-14T06:41:36.9400278Z  2025-03-14T06:41:36.9400714Z  2025-03-14T06:41:36.9401091Z  2025-03-14T06:41:36.9401431Z  2025-03-14T06:41:36.9401773Z  2025-03-14T06:41:36.9402111Z  2025-03-14T06:41:36.9402697Z  2025-03-14T06:41:36.9403186Z  2025-03-14T06:41:36.9404204Z [19,284 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:36.9405322Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2025-03-14T06:41:36.9406423Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T06:41:36.9407261Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T06:41:36.9408166Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 34s local 2025-03-14T06:41:36.9408944Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:41:36.9409686Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T06:41:36.9410617Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 21s local 2025-03-14T06:41:36.9411720Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local ... 2025-03-14T06:41:37.3403751Z 2025-03-14T06:41:37.3405767Z  2025-03-14T06:41:37.3406518Z  2025-03-14T06:41:37.3407177Z  2025-03-14T06:41:37.3407664Z  2025-03-14T06:41:37.3408062Z  2025-03-14T06:41:37.3408425Z  2025-03-14T06:41:37.3408800Z  2025-03-14T06:41:37.3409172Z  2025-03-14T06:41:37.3410125Z [19,285 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:37.3411190Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 107s local 2025-03-14T06:41:37.3411997Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T06:41:37.3412834Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T06:41:37.3413606Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2025-03-14T06:41:37.3414366Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:41:37.3415155Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 32s local 2025-03-14T06:41:37.3416105Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 22s local 2025-03-14T06:41:37.3417184Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local ... 2025-03-14T06:41:37.6123319Z 2025-03-14T06:41:37.6124309Z  2025-03-14T06:41:37.6125048Z  2025-03-14T06:41:37.6125474Z  2025-03-14T06:41:37.6125905Z  2025-03-14T06:41:37.6126556Z  2025-03-14T06:41:37.6127026Z  2025-03-14T06:41:37.6127555Z  2025-03-14T06:41:37.6128067Z  2025-03-14T06:41:37.6129116Z [19,286 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:37.6130441Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:41:37.6131328Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 45s local 2025-03-14T06:41:37.6132220Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T06:41:37.6133476Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2025-03-14T06:41:37.6134465Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:41:37.6135296Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T06:41:37.6136418Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 22s local 2025-03-14T06:41:37.6137564Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 21s local ... 2025-03-14T06:41:37.8663820Z 2025-03-14T06:41:37.8665018Z  2025-03-14T06:41:37.8666830Z  2025-03-14T06:41:37.8668334Z  2025-03-14T06:41:37.8669829Z  2025-03-14T06:41:37.8671674Z  2025-03-14T06:41:37.8673086Z  2025-03-14T06:41:37.8674536Z  2025-03-14T06:41:37.8675966Z  2025-03-14T06:41:37.8677998Z [19,288 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:37.8680087Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:41:37.8682017Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T06:41:37.8683204Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2025-03-14T06:41:37.8684266Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:41:37.8685369Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T06:41:37.8686552Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 22s local 2025-03-14T06:41:37.8687717Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2025-03-14T06:41:37.8689165Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local ... 2025-03-14T06:41:38.1410601Z 2025-03-14T06:41:38.1411818Z  2025-03-14T06:41:38.1412293Z  2025-03-14T06:41:38.1412707Z  2025-03-14T06:41:38.1413113Z  2025-03-14T06:41:38.1413507Z  2025-03-14T06:41:38.1413918Z  2025-03-14T06:41:38.1414310Z  2025-03-14T06:41:38.1414706Z  2025-03-14T06:41:38.1415580Z [19,289 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:38.1416907Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:41:38.1417755Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T06:41:38.1418790Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 35s local 2025-03-14T06:41:38.1419554Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:41:38.1420260Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T06:41:38.1421175Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local 2025-03-14T06:41:38.1422080Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2025-03-14T06:41:38.1422977Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local ... 2025-03-14T06:41:38.3997889Z 2025-03-14T06:41:38.3998752Z  2025-03-14T06:41:38.3999200Z  2025-03-14T06:41:38.3999565Z  2025-03-14T06:41:38.3999933Z  2025-03-14T06:41:38.4000303Z  2025-03-14T06:41:38.4000665Z  2025-03-14T06:41:38.4001070Z  2025-03-14T06:41:38.4001424Z  2025-03-14T06:41:38.4002299Z [19,290 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:38.4003190Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 108s local 2025-03-14T06:41:38.4003870Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T06:41:38.4004791Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2025-03-14T06:41:38.4005482Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:41:38.4006133Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 33s local 2025-03-14T06:41:38.4006966Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local 2025-03-14T06:41:38.4007824Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2025-03-14T06:41:38.6032059Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local ... 2025-03-14T06:41:38.6032947Z 2025-03-14T06:41:38.6033757Z  2025-03-14T06:41:38.6034327Z  2025-03-14T06:41:38.6034842Z  2025-03-14T06:41:38.6035360Z  2025-03-14T06:41:38.6036124Z  2025-03-14T06:41:38.6036689Z  2025-03-14T06:41:38.6037195Z  2025-03-14T06:41:38.6037698Z  2025-03-14T06:41:38.6038754Z [19,293 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:38.6040095Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2025-03-14T06:41:38.6041012Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2025-03-14T06:41:38.6042224Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2025-03-14T06:41:38.6043282Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:41:38.6044143Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2025-03-14T06:41:38.6045308Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local 2025-03-14T06:41:38.6046356Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 22s local 2025-03-14T06:41:38.6047474Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local ... 2025-03-14T06:41:38.9417107Z 2025-03-14T06:41:38.9418316Z  2025-03-14T06:41:38.9420033Z  2025-03-14T06:41:38.9421558Z  2025-03-14T06:41:38.9423094Z  2025-03-14T06:41:38.9424622Z  2025-03-14T06:41:38.9426138Z  2025-03-14T06:41:38.9427664Z  2025-03-14T06:41:38.9429220Z  2025-03-14T06:41:38.9431370Z [19,294 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:38.9433854Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2025-03-14T06:41:38.9435828Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2025-03-14T06:41:38.9437851Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 36s local 2025-03-14T06:41:38.9439016Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 34s local 2025-03-14T06:41:38.9440282Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local 2025-03-14T06:41:38.9441814Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local 2025-03-14T06:41:38.9443010Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2025-03-14T06:41:38.9444367Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 19s local ... 2025-03-14T06:41:39.5273993Z 2025-03-14T06:41:39.5274878Z  2025-03-14T06:41:39.5275377Z  2025-03-14T06:41:39.5275758Z  2025-03-14T06:41:39.5276140Z  2025-03-14T06:41:39.5276504Z  2025-03-14T06:41:39.5276874Z  2025-03-14T06:41:39.5277303Z  2025-03-14T06:41:39.5288699Z  2025-03-14T06:41:39.5290061Z [19,295 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:39.5291086Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 109s local 2025-03-14T06:41:39.5291848Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2025-03-14T06:41:39.5292703Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2025-03-14T06:41:39.5293561Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T06:41:39.5294431Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local 2025-03-14T06:41:39.5295337Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 23s local 2025-03-14T06:41:39.5296219Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T06:41:39.5297286Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 20s local ... 2025-03-14T06:41:39.7346349Z 2025-03-14T06:41:39.7347630Z  2025-03-14T06:41:39.7349378Z  2025-03-14T06:41:39.7350845Z  2025-03-14T06:41:39.7351492Z  2025-03-14T06:41:39.7352011Z  2025-03-14T06:41:39.7352414Z  2025-03-14T06:41:39.7352797Z  2025-03-14T06:41:39.7353179Z  2025-03-14T06:41:39.7354140Z [19,296 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:39.7355068Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T06:41:39.7355839Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2025-03-14T06:41:39.7357007Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2025-03-14T06:41:39.7357916Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T06:41:39.7358815Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local 2025-03-14T06:41:39.7359733Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2025-03-14T06:41:39.7360638Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T06:41:39.7361949Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 20s local ... 2025-03-14T06:41:39.9423520Z 2025-03-14T06:41:39.9424469Z  2025-03-14T06:41:39.9424966Z  2025-03-14T06:41:39.9425350Z  2025-03-14T06:41:39.9426018Z  2025-03-14T06:41:39.9426540Z  2025-03-14T06:41:39.9427033Z  2025-03-14T06:41:39.9427527Z  2025-03-14T06:41:39.9428037Z  2025-03-14T06:41:39.9429059Z [19,296 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:39.9430223Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T06:41:39.9431127Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2025-03-14T06:41:39.9432112Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 37s local 2025-03-14T06:41:39.9433073Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T06:41:39.9434086Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local 2025-03-14T06:41:39.9435477Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2025-03-14T06:41:39.9436458Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T06:41:39.9437573Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 20s local ... 2025-03-14T06:41:40.2656912Z 2025-03-14T06:41:40.2658106Z  2025-03-14T06:41:40.2659734Z  2025-03-14T06:41:40.2661236Z  2025-03-14T06:41:40.2663076Z  2025-03-14T06:41:40.2664560Z  2025-03-14T06:41:40.2666264Z  2025-03-14T06:41:40.2667824Z  2025-03-14T06:41:40.2669322Z  2025-03-14T06:41:40.2671436Z [19,297 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:40.2672850Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T06:41:40.2674043Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2025-03-14T06:41:40.2675215Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2025-03-14T06:41:40.2676404Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 35s local 2025-03-14T06:41:40.2677626Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local 2025-03-14T06:41:40.2678849Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2025-03-14T06:41:40.2680012Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T06:41:40.2681415Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local ... 2025-03-14T06:41:40.5428847Z 2025-03-14T06:41:40.5429849Z  2025-03-14T06:41:40.5430330Z  2025-03-14T06:41:40.5430729Z  2025-03-14T06:41:40.5431364Z  2025-03-14T06:41:40.5431773Z  2025-03-14T06:41:40.5432304Z  2025-03-14T06:41:40.5432805Z  2025-03-14T06:41:40.5433301Z  2025-03-14T06:41:40.5434330Z [19,297 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:40.5435594Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 110s local 2025-03-14T06:41:40.5436573Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T06:41:40.5437580Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2025-03-14T06:41:40.5438549Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T06:41:40.5439586Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local 2025-03-14T06:41:40.5440616Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 24s local 2025-03-14T06:41:40.5441894Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T06:41:40.5443142Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local ... 2025-03-14T06:41:40.8113019Z 2025-03-14T06:41:40.8113898Z  2025-03-14T06:41:40.8114542Z  2025-03-14T06:41:40.8115003Z  2025-03-14T06:41:40.8115443Z  2025-03-14T06:41:40.8115890Z  2025-03-14T06:41:40.8116322Z  2025-03-14T06:41:40.8116761Z  2025-03-14T06:41:40.8117230Z  2025-03-14T06:41:40.8118493Z [19,300 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:41:40.8119630Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2025-03-14T06:41:40.8120903Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T06:41:40.8121946Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2025-03-14T06:41:40.8123033Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T06:41:40.8124271Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local 2025-03-14T06:41:40.8125528Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2025-03-14T06:41:40.8126567Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T06:41:40.8127845Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local ... 2025-03-14T06:41:41.1297154Z 2025-03-14T06:41:41.1298072Z  2025-03-14T06:41:41.1298564Z  2025-03-14T06:41:41.1299456Z  2025-03-14T06:41:41.1301400Z  2025-03-14T06:41:41.1301854Z  2025-03-14T06:41:41.1303552Z  2025-03-14T06:41:41.1304002Z  2025-03-14T06:41:41.1305731Z  2025-03-14T06:41:41.1306739Z [19,301 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:41.1307847Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2025-03-14T06:41:41.1308667Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T06:41:41.1309865Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 38s local 2025-03-14T06:41:41.1310912Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T06:41:41.1311860Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local 2025-03-14T06:41:41.1312806Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2025-03-14T06:41:41.1313693Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T06:41:41.1314868Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local ... 2025-03-14T06:41:41.3435434Z 2025-03-14T06:41:41.3436732Z  2025-03-14T06:41:41.3437249Z  2025-03-14T06:41:41.3437685Z  2025-03-14T06:41:41.3438106Z  2025-03-14T06:41:41.3438524Z  2025-03-14T06:41:41.3438946Z  2025-03-14T06:41:41.3439352Z  2025-03-14T06:41:41.3439777Z  2025-03-14T06:41:41.3440748Z [19,302 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:41.3441836Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2025-03-14T06:41:41.3442667Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T06:41:41.3443559Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2025-03-14T06:41:41.3444443Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 36s local 2025-03-14T06:41:41.3445524Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local 2025-03-14T06:41:41.3446497Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2025-03-14T06:41:41.3447380Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T06:41:41.3448550Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local ... 2025-03-14T06:41:41.5439121Z 2025-03-14T06:41:41.5440349Z  2025-03-14T06:41:41.5440875Z  2025-03-14T06:41:41.5441317Z  2025-03-14T06:41:41.5441762Z  2025-03-14T06:41:41.5442206Z  2025-03-14T06:41:41.5442793Z  2025-03-14T06:41:41.5443248Z  2025-03-14T06:41:41.5443953Z  2025-03-14T06:41:41.5445147Z [19,303 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:41.5446324Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 111s local 2025-03-14T06:41:41.5447251Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T06:41:41.5448275Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2025-03-14T06:41:41.5449309Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2025-03-14T06:41:41.5450500Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local 2025-03-14T06:41:41.5451588Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 25s local 2025-03-14T06:41:41.5452628Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2025-03-14T06:41:41.5453856Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local ... 2025-03-14T06:41:41.9542682Z 2025-03-14T06:41:41.9543939Z  2025-03-14T06:41:41.9544412Z  2025-03-14T06:41:41.9544832Z  2025-03-14T06:41:41.9545222Z  2025-03-14T06:41:41.9545593Z  2025-03-14T06:41:41.9545972Z  2025-03-14T06:41:41.9546351Z  2025-03-14T06:41:41.9546730Z  2025-03-14T06:41:41.9547586Z [19,304 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:41.9548521Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2025-03-14T06:41:41.9549566Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T06:41:41.9550428Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 39s local 2025-03-14T06:41:41.9551264Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2025-03-14T06:41:41.9552130Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local 2025-03-14T06:41:41.9553010Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2025-03-14T06:41:41.9553845Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2025-03-14T06:41:41.9555017Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local ... 2025-03-14T06:41:42.3444918Z 2025-03-14T06:41:42.3446136Z  2025-03-14T06:41:42.3446563Z  2025-03-14T06:41:42.3446920Z  2025-03-14T06:41:42.3447280Z  2025-03-14T06:41:42.3447627Z  2025-03-14T06:41:42.3447979Z  2025-03-14T06:41:42.3448336Z  2025-03-14T06:41:42.3448677Z  2025-03-14T06:41:42.3449524Z [19,304 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:42.3450423Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 112s local 2025-03-14T06:41:42.3451133Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T06:41:42.3451904Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2025-03-14T06:41:42.3452668Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 37s local 2025-03-14T06:41:42.3453497Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2025-03-14T06:41:42.3454324Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2025-03-14T06:41:42.3455107Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2025-03-14T06:41:42.3456055Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local ... 2025-03-14T06:41:42.6114035Z 2025-03-14T06:41:42.6115277Z  2025-03-14T06:41:42.6115764Z  2025-03-14T06:41:42.6116116Z  2025-03-14T06:41:42.6116512Z  2025-03-14T06:41:42.6116868Z  2025-03-14T06:41:42.6117233Z  2025-03-14T06:41:42.6117605Z  2025-03-14T06:41:42.6117957Z  2025-03-14T06:41:42.6118819Z [19,305 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:42.6119715Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2025-03-14T06:41:42.6120450Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T06:41:42.6121246Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2025-03-14T06:41:42.6122319Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T06:41:42.6123156Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2025-03-14T06:41:42.6123987Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 26s local 2025-03-14T06:41:42.6124941Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2025-03-14T06:41:42.6125898Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local ... 2025-03-14T06:41:42.9450279Z 2025-03-14T06:41:42.9451466Z  2025-03-14T06:41:42.9452163Z  2025-03-14T06:41:42.9452549Z  2025-03-14T06:41:42.9452915Z  2025-03-14T06:41:42.9453396Z  2025-03-14T06:41:42.9453776Z  2025-03-14T06:41:42.9454146Z  2025-03-14T06:41:42.9454520Z  2025-03-14T06:41:42.9455415Z [19,305 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:42.9456382Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2025-03-14T06:41:42.9457168Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T06:41:42.9458006Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 40s local 2025-03-14T06:41:42.9458823Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T06:41:42.9459707Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2025-03-14T06:41:42.9460570Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T06:41:42.9461607Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2025-03-14T06:41:42.9462632Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local ... 2025-03-14T06:41:43.3454905Z 2025-03-14T06:41:43.3456118Z  2025-03-14T06:41:43.3456587Z  2025-03-14T06:41:43.3456987Z  2025-03-14T06:41:43.3457379Z  2025-03-14T06:41:43.3457741Z  2025-03-14T06:41:43.3458106Z  2025-03-14T06:41:43.3458745Z  2025-03-14T06:41:43.3459087Z  2025-03-14T06:41:43.3460090Z [19,307 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:43.3461046Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 113s local 2025-03-14T06:41:43.3461809Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T06:41:43.3462627Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2025-03-14T06:41:43.3463459Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 38s local 2025-03-14T06:41:43.3464231Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 27s local 2025-03-14T06:41:43.3465055Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2025-03-14T06:41:43.3466293Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2025-03-14T06:41:43.3467157Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:41:43.7458006Z 2025-03-14T06:41:43.7459455Z  2025-03-14T06:41:43.7459926Z  2025-03-14T06:41:43.7460354Z  2025-03-14T06:41:43.7460787Z  2025-03-14T06:41:43.7461158Z  2025-03-14T06:41:43.7461574Z  2025-03-14T06:41:43.7461970Z  2025-03-14T06:41:43.7462380Z  2025-03-14T06:41:43.7463339Z [19,310 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:43.7464335Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2025-03-14T06:41:43.7465115Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T06:41:43.7466243Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2025-03-14T06:41:43.7467126Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2025-03-14T06:41:43.7467900Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2025-03-14T06:41:43.7468889Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2025-03-14T06:41:43.7469737Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:43.7470516Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2025-03-14T06:41:44.1462133Z 2025-03-14T06:41:44.1463552Z  2025-03-14T06:41:44.1464032Z  2025-03-14T06:41:44.1464414Z  2025-03-14T06:41:44.1464792Z  2025-03-14T06:41:44.1465176Z  2025-03-14T06:41:44.1465922Z  2025-03-14T06:41:44.1466299Z  2025-03-14T06:41:44.1466664Z  2025-03-14T06:41:44.1467526Z [19,312 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:44.1468492Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 114s local 2025-03-14T06:41:44.1469399Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T06:41:44.1470233Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 41s local 2025-03-14T06:41:44.1471070Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 39s local 2025-03-14T06:41:44.1471824Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 28s local 2025-03-14T06:41:44.1472740Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:41:44.1473626Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:44.1474335Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 16s local ... 2025-03-14T06:41:45.1301651Z 2025-03-14T06:41:45.1302906Z  2025-03-14T06:41:45.1303434Z  2025-03-14T06:41:45.1303815Z  2025-03-14T06:41:45.1304216Z  2025-03-14T06:41:45.1304641Z  2025-03-14T06:41:45.1305054Z  2025-03-14T06:41:45.1305466Z  2025-03-14T06:41:45.1306181Z  2025-03-14T06:41:45.1307139Z [19,313 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:45.1308224Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2025-03-14T06:41:45.1309027Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2025-03-14T06:41:45.1310038Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 42s local 2025-03-14T06:41:45.1310962Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2025-03-14T06:41:45.1311981Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2025-03-14T06:41:45.1312988Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:41:45.1313993Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 17s local 2025-03-14T06:41:45.1314766Z @stablehlo//:linalg_passes; 16s local ... 2025-03-14T06:41:45.3471230Z 2025-03-14T06:41:45.3472139Z  2025-03-14T06:41:45.3472630Z  2025-03-14T06:41:45.3473212Z  2025-03-14T06:41:45.3473686Z  2025-03-14T06:41:45.3474179Z  2025-03-14T06:41:45.3474673Z  2025-03-14T06:41:45.3475194Z  2025-03-14T06:41:45.3475680Z  2025-03-14T06:41:45.3476740Z [19,313 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:45.3477863Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 115s local 2025-03-14T06:41:45.3478748Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2025-03-14T06:41:45.3479733Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2025-03-14T06:41:45.3480696Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 40s local 2025-03-14T06:41:45.3481588Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 29s local 2025-03-14T06:41:45.3482645Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:41:45.3483716Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2025-03-14T06:41:45.3484479Z @stablehlo//:linalg_passes; 16s local ... 2025-03-14T06:41:45.7458263Z 2025-03-14T06:41:45.7459143Z  2025-03-14T06:41:45.7459756Z  2025-03-14T06:41:45.7460203Z  2025-03-14T06:41:45.7460607Z  2025-03-14T06:41:45.7461021Z  2025-03-14T06:41:45.7461408Z  2025-03-14T06:41:45.7461781Z  2025-03-14T06:41:45.7462154Z  2025-03-14T06:41:45.7463079Z [19,314 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:45.7464059Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T06:41:45.7465134Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2025-03-14T06:41:45.7466282Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2025-03-14T06:41:45.7467151Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T06:41:45.7467887Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2025-03-14T06:41:45.7468890Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:41:45.7469874Z Compiling xla/hlo/pass/hlo_pass_pipeline.cc; 18s local 2025-03-14T06:41:45.7470777Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:41:45.9475217Z 2025-03-14T06:41:45.9476103Z  2025-03-14T06:41:45.9476576Z  2025-03-14T06:41:45.9476974Z  2025-03-14T06:41:45.9477367Z  2025-03-14T06:41:45.9477778Z  2025-03-14T06:41:45.9478177Z  2025-03-14T06:41:45.9478571Z  2025-03-14T06:41:45.9478978Z  2025-03-14T06:41:45.9479973Z [19,315 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:45.9481031Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T06:41:45.9481871Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2025-03-14T06:41:45.9482793Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2025-03-14T06:41:45.9483680Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T06:41:45.9484962Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2025-03-14T06:41:45.9485938Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:41:45.9486886Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:45.9487811Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 17s local ... 2025-03-14T06:41:46.1479214Z 2025-03-14T06:41:46.1480274Z  2025-03-14T06:41:46.1480738Z  2025-03-14T06:41:46.1481098Z  2025-03-14T06:41:46.1481829Z  2025-03-14T06:41:46.1482239Z  2025-03-14T06:41:46.1482646Z  2025-03-14T06:41:46.1483042Z  2025-03-14T06:41:46.1483463Z  2025-03-14T06:41:46.1484432Z [19,317 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:46.1485576Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T06:41:46.1486368Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2025-03-14T06:41:46.1487245Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 43s local 2025-03-14T06:41:46.1488147Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 41s local 2025-03-14T06:41:46.1488953Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2025-03-14T06:41:46.1489951Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:41:46.1490853Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:46.1491789Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 17s local ... 2025-03-14T06:41:46.4563133Z 2025-03-14T06:41:46.4564715Z  2025-03-14T06:41:46.4565240Z  2025-03-14T06:41:46.4568215Z  2025-03-14T06:41:46.4568759Z  2025-03-14T06:41:46.4569187Z  2025-03-14T06:41:46.4569610Z  2025-03-14T06:41:46.4570041Z  2025-03-14T06:41:46.4570450Z  2025-03-14T06:41:46.4571393Z [19,319 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:46.4572441Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 116s local 2025-03-14T06:41:46.4573399Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2025-03-14T06:41:46.4574334Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T06:41:46.4575176Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 30s local 2025-03-14T06:41:46.4576186Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:41:46.4577136Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:41:46.4578341Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 17s local 2025-03-14T06:41:46.4579497Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 17s local ... 2025-03-14T06:41:46.7484441Z 2025-03-14T06:41:46.7485506Z  2025-03-14T06:41:46.7485982Z  2025-03-14T06:41:46.7487926Z  2025-03-14T06:41:46.7488446Z  2025-03-14T06:41:46.7489026Z  2025-03-14T06:41:46.7491000Z  2025-03-14T06:41:46.7491534Z  2025-03-14T06:41:46.7493200Z  2025-03-14T06:41:46.7494494Z [19,319 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:46.7495489Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T06:41:46.7496285Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2025-03-14T06:41:46.7497120Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T06:41:46.7497936Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T06:41:46.7498814Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:41:46.7499693Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:46.7500534Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local 2025-03-14T06:41:46.7501559Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 17s local ... 2025-03-14T06:41:47.1487558Z 2025-03-14T06:41:47.1489389Z  2025-03-14T06:41:47.1490739Z  2025-03-14T06:41:47.1491981Z  2025-03-14T06:41:47.1493503Z  2025-03-14T06:41:47.1494718Z  2025-03-14T06:41:47.1495954Z  2025-03-14T06:41:47.1497201Z  2025-03-14T06:41:47.1498418Z  2025-03-14T06:41:47.1500123Z [19,320 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:47.1501871Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T06:41:47.1503466Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 44s local 2025-03-14T06:41:47.1505286Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T06:41:47.1506859Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T06:41:47.1508644Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:41:47.1510295Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:47.1511924Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local 2025-03-14T06:41:47.1513693Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 17s local ... 2025-03-14T06:41:47.3490875Z 2025-03-14T06:41:47.3492810Z  2025-03-14T06:41:47.3494319Z  2025-03-14T06:41:47.3495737Z  2025-03-14T06:41:47.3497151Z  2025-03-14T06:41:47.3498545Z  2025-03-14T06:41:47.3499954Z  2025-03-14T06:41:47.3501186Z  2025-03-14T06:41:47.3502305Z  2025-03-14T06:41:47.3503341Z [19,321 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:47.3504421Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 117s local 2025-03-14T06:41:47.3505358Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2025-03-14T06:41:47.3506268Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 42s local 2025-03-14T06:41:47.3507099Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 31s local 2025-03-14T06:41:47.3508130Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:41:47.3509096Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:41:47.3510033Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local 2025-03-14T06:41:47.3511238Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 18s local ... 2025-03-14T06:41:47.9068523Z 2025-03-14T06:41:47.9069702Z  2025-03-14T06:41:47.9070235Z  2025-03-14T06:41:47.9070658Z  2025-03-14T06:41:47.9071037Z  2025-03-14T06:41:47.9071420Z  2025-03-14T06:41:47.9071788Z  2025-03-14T06:41:47.9072216Z  2025-03-14T06:41:47.9072764Z  2025-03-14T06:41:47.9074132Z [19,322 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:47.9075186Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T06:41:47.9076005Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2025-03-14T06:41:47.9076841Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2025-03-14T06:41:47.9077591Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T06:41:47.9078741Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:41:47.9079839Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:47.9080692Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local 2025-03-14T06:41:47.9081806Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 18s local ... 2025-03-14T06:41:48.1497348Z 2025-03-14T06:41:48.1498280Z  2025-03-14T06:41:48.1498976Z  2025-03-14T06:41:48.1501815Z  2025-03-14T06:41:48.1503356Z  2025-03-14T06:41:48.1504818Z  2025-03-14T06:41:48.1506288Z  2025-03-14T06:41:48.1507774Z  2025-03-14T06:41:48.1509238Z  2025-03-14T06:41:48.1511244Z [19,323 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:48.1513378Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T06:41:48.1515389Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 45s local 2025-03-14T06:41:48.1517724Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2025-03-14T06:41:48.1519664Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T06:41:48.1521821Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:41:48.1523856Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:48.1526036Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local 2025-03-14T06:41:48.1528488Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 18s local ... 2025-03-14T06:41:48.3500623Z 2025-03-14T06:41:48.3502624Z  2025-03-14T06:41:48.3504159Z  2025-03-14T06:41:48.3505492Z  2025-03-14T06:41:48.3506836Z  2025-03-14T06:41:48.3508240Z  2025-03-14T06:41:48.3509673Z  2025-03-14T06:41:48.3511087Z  2025-03-14T06:41:48.3512470Z  2025-03-14T06:41:48.3514412Z [19,324 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:48.3516509Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T06:41:48.3518409Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2025-03-14T06:41:48.3520394Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 43s local 2025-03-14T06:41:48.3522197Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T06:41:48.3524121Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:41:48.3526166Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:48.3528063Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local 2025-03-14T06:41:48.3530195Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 19s local ... 2025-03-14T06:41:48.5519218Z 2025-03-14T06:41:48.5521095Z  2025-03-14T06:41:48.5522545Z  2025-03-14T06:41:48.5523873Z  2025-03-14T06:41:48.5525333Z  2025-03-14T06:41:48.5526643Z  2025-03-14T06:41:48.5527939Z  2025-03-14T06:41:48.5529266Z  2025-03-14T06:41:48.5530563Z  2025-03-14T06:41:48.5532417Z [19,325 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:48.5534276Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 118s local 2025-03-14T06:41:48.5535923Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2025-03-14T06:41:48.5537722Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2025-03-14T06:41:48.5539417Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 32s local 2025-03-14T06:41:48.5541490Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:41:48.5543407Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:41:48.5545153Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local 2025-03-14T06:41:48.5547084Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 19s local ... 2025-03-14T06:41:48.9505028Z 2025-03-14T06:41:48.9506878Z  2025-03-14T06:41:48.9508371Z  2025-03-14T06:41:48.9509746Z  2025-03-14T06:41:48.9511128Z  2025-03-14T06:41:48.9512770Z  2025-03-14T06:41:48.9514199Z  2025-03-14T06:41:48.9515535Z  2025-03-14T06:41:48.9517090Z  2025-03-14T06:41:48.9518993Z [19,327 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:48.9520969Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 119s local 2025-03-14T06:41:48.9529573Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 46s local 2025-03-14T06:41:48.9530433Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 44s local 2025-03-14T06:41:48.9531193Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 33s local 2025-03-14T06:41:48.9532140Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:41:48.9532999Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:41:48.9533840Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local 2025-03-14T06:41:48.9535176Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 19s local ... 2025-03-14T06:41:49.8430753Z 2025-03-14T06:41:49.8431439Z  2025-03-14T06:41:49.8431751Z  2025-03-14T06:41:49.8432014Z  2025-03-14T06:41:49.8432264Z  2025-03-14T06:41:49.8432496Z  2025-03-14T06:41:49.8432749Z  2025-03-14T06:41:49.8432995Z  2025-03-14T06:41:49.8433237Z  2025-03-14T06:41:49.8433786Z [19,328 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:49.8434572Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T06:41:49.8435088Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2025-03-14T06:41:49.8435607Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T06:41:49.8436084Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T06:41:49.8436654Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:41:49.8437179Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:49.8437694Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2025-03-14T06:41:49.8438315Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 20s local ... 2025-03-14T06:41:50.0934697Z 2025-03-14T06:41:50.0935507Z  2025-03-14T06:41:50.0936016Z  2025-03-14T06:41:50.0936441Z  2025-03-14T06:41:50.0936827Z  2025-03-14T06:41:50.0937293Z  2025-03-14T06:41:50.0937723Z  2025-03-14T06:41:50.0938136Z  2025-03-14T06:41:50.0938571Z  2025-03-14T06:41:50.0939552Z [19,330 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:50.0940627Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T06:41:50.0941571Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 47s local 2025-03-14T06:41:50.0942536Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T06:41:50.0943420Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T06:41:50.0944495Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:41:50.0945471Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:50.0946408Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2025-03-14T06:41:50.0947588Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 20s local ... 2025-03-14T06:41:50.3516962Z 2025-03-14T06:41:50.3517791Z  2025-03-14T06:41:50.3518299Z  2025-03-14T06:41:50.3519053Z  2025-03-14T06:41:50.3519489Z  2025-03-14T06:41:50.3519902Z  2025-03-14T06:41:50.3520291Z  2025-03-14T06:41:50.3520697Z  2025-03-14T06:41:50.3521107Z  2025-03-14T06:41:50.3522073Z [19,330 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:50.3523139Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 120s local 2025-03-14T06:41:50.3524083Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T06:41:50.3525382Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 45s local 2025-03-14T06:41:50.3526232Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 34s local 2025-03-14T06:41:50.3527247Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:41:50.3528100Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:41:50.3528991Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2025-03-14T06:41:50.3530083Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 21s local ... 2025-03-14T06:41:50.7521260Z 2025-03-14T06:41:50.7522152Z  2025-03-14T06:41:50.7522743Z  2025-03-14T06:41:50.7523138Z  2025-03-14T06:41:50.7523532Z  2025-03-14T06:41:50.7523928Z  2025-03-14T06:41:50.7524339Z  2025-03-14T06:41:50.7524900Z  2025-03-14T06:41:50.7525304Z  2025-03-14T06:41:50.7526232Z [19,331 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:50.7527613Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2025-03-14T06:41:50.7528507Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T06:41:50.7529460Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T06:41:50.7530277Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T06:41:50.7531226Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:41:50.7532398Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:50.7533284Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2025-03-14T06:41:50.7534394Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 21s local ... 2025-03-14T06:41:51.0365896Z 2025-03-14T06:41:51.0366780Z  2025-03-14T06:41:51.0367263Z  2025-03-14T06:41:51.0367646Z  2025-03-14T06:41:51.0368021Z  2025-03-14T06:41:51.0368451Z  2025-03-14T06:41:51.0368848Z  2025-03-14T06:41:51.0369248Z  2025-03-14T06:41:51.0369653Z  2025-03-14T06:41:51.0370613Z [19,333 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:51.0371799Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2025-03-14T06:41:51.0372761Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 48s local 2025-03-14T06:41:51.0373746Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T06:41:51.0374676Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T06:41:51.0375757Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:41:51.0376756Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:51.0377725Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2025-03-14T06:41:51.0378925Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 21s local ... 2025-03-14T06:41:51.3525072Z 2025-03-14T06:41:51.3525936Z  2025-03-14T06:41:51.3526481Z  2025-03-14T06:41:51.3526966Z  2025-03-14T06:41:51.3527405Z  2025-03-14T06:41:51.3527838Z  2025-03-14T06:41:51.3528190Z  2025-03-14T06:41:51.3528573Z  2025-03-14T06:41:51.3528960Z  2025-03-14T06:41:51.3529891Z [19,333 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:51.3530911Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 121s local 2025-03-14T06:41:51.3532028Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2025-03-14T06:41:51.3532913Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 46s local 2025-03-14T06:41:51.3533740Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 35s local 2025-03-14T06:41:51.3534775Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:41:51.3535737Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:51.3536629Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2025-03-14T06:41:51.3537936Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 22s local ... 2025-03-14T06:41:51.6620545Z 2025-03-14T06:41:51.6621360Z  2025-03-14T06:41:51.6621818Z  2025-03-14T06:41:51.6622190Z  2025-03-14T06:41:51.6622579Z  2025-03-14T06:41:51.6622969Z  2025-03-14T06:41:51.6623376Z  2025-03-14T06:41:51.6623774Z  2025-03-14T06:41:51.6624158Z  2025-03-14T06:41:51.6625223Z [19,334 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:51.6626224Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2025-03-14T06:41:51.6627117Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2025-03-14T06:41:51.6627981Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T06:41:51.6628758Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T06:41:51.6629961Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:41:51.6630805Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:41:51.6631656Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2025-03-14T06:41:51.6632692Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 22s local ... 2025-03-14T06:41:51.9533644Z 2025-03-14T06:41:51.9534525Z  2025-03-14T06:41:51.9534986Z  2025-03-14T06:41:51.9535394Z  2025-03-14T06:41:51.9536134Z  2025-03-14T06:41:51.9536525Z  2025-03-14T06:41:51.9536959Z  2025-03-14T06:41:51.9537376Z  2025-03-14T06:41:51.9537775Z  2025-03-14T06:41:51.9538738Z [19,335 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:51.9539751Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2025-03-14T06:41:51.9540593Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 49s local 2025-03-14T06:41:51.9541505Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T06:41:51.9542355Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T06:41:51.9543336Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:41:51.9544238Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:41:51.9545095Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T06:41:51.9546170Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 22s local ... 2025-03-14T06:41:52.3344322Z 2025-03-14T06:41:52.3345154Z  2025-03-14T06:41:52.3345664Z  2025-03-14T06:41:52.3346094Z  2025-03-14T06:41:52.3346508Z  2025-03-14T06:41:52.3346891Z  2025-03-14T06:41:52.3347291Z  2025-03-14T06:41:52.3347694Z  2025-03-14T06:41:52.3348064Z  2025-03-14T06:41:52.3349044Z [19,336 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:52.3350141Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2025-03-14T06:41:52.3351055Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T06:41:52.3351985Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 47s local 2025-03-14T06:41:52.3352829Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T06:41:52.3353848Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:41:52.3354804Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:41:52.3355985Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T06:41:52.3357168Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 23s local ... 2025-03-14T06:41:52.5538744Z 2025-03-14T06:41:52.5539580Z  2025-03-14T06:41:52.5540035Z  2025-03-14T06:41:52.5540416Z  2025-03-14T06:41:52.5540891Z  2025-03-14T06:41:52.5541266Z  2025-03-14T06:41:52.5541656Z  2025-03-14T06:41:52.5542029Z  2025-03-14T06:41:52.5542432Z  2025-03-14T06:41:52.5543553Z [19,338 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:52.5544491Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 122s local 2025-03-14T06:41:52.5545297Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T06:41:52.5546064Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T06:41:52.5546779Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 36s local 2025-03-14T06:41:52.5547662Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:41:52.5548480Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:41:52.5549273Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T06:41:52.5550283Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 23s local ... 2025-03-14T06:41:52.8985988Z 2025-03-14T06:41:52.8986922Z  2025-03-14T06:41:52.8987498Z  2025-03-14T06:41:52.8988286Z  2025-03-14T06:41:52.8988670Z  2025-03-14T06:41:52.8989059Z  2025-03-14T06:41:52.8989478Z  2025-03-14T06:41:52.8989864Z  2025-03-14T06:41:52.8990255Z  2025-03-14T06:41:52.8991162Z [19,340 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:52.8992207Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T06:41:52.8993139Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T06:41:52.8994367Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T06:41:52.8995165Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2025-03-14T06:41:52.8996080Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:41:52.8997076Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:41:52.8997963Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T06:41:52.8999011Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 23s local ... 2025-03-14T06:41:53.1544216Z 2025-03-14T06:41:53.1545132Z  2025-03-14T06:41:53.1545618Z  2025-03-14T06:41:53.1546042Z  2025-03-14T06:41:53.1546454Z  2025-03-14T06:41:53.1546839Z  2025-03-14T06:41:53.1547329Z  2025-03-14T06:41:53.1547818Z  2025-03-14T06:41:53.1548223Z  2025-03-14T06:41:53.1549199Z [19,341 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:53.1550344Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T06:41:53.1551282Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 50s local 2025-03-14T06:41:53.1552234Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T06:41:53.1553124Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2025-03-14T06:41:53.1554096Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:41:53.1554961Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:41:53.1555887Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T06:41:53.1556968Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 23s local ... 2025-03-14T06:41:53.3904033Z 2025-03-14T06:41:53.3904845Z  2025-03-14T06:41:53.3905315Z  2025-03-14T06:41:53.3905719Z  2025-03-14T06:41:53.3906205Z  2025-03-14T06:41:53.3906655Z  2025-03-14T06:41:53.3907025Z  2025-03-14T06:41:53.3907509Z  2025-03-14T06:41:53.3907881Z  2025-03-14T06:41:53.3909012Z [19,342 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:53.3909978Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 123s local 2025-03-14T06:41:53.3910864Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T06:41:53.3911732Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 48s local 2025-03-14T06:41:53.3912545Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 37s local 2025-03-14T06:41:53.3913724Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:41:53.3914647Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:41:53.3915449Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T06:41:53.3916539Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local ... 2025-03-14T06:41:53.7549616Z 2025-03-14T06:41:53.7550503Z  2025-03-14T06:41:53.7551030Z  2025-03-14T06:41:53.7551444Z  2025-03-14T06:41:53.7551862Z  2025-03-14T06:41:53.7552242Z  2025-03-14T06:41:53.7563571Z  2025-03-14T06:41:53.7564481Z  2025-03-14T06:41:53.7565053Z  2025-03-14T06:41:53.7566226Z [19,343 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:53.7567253Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2025-03-14T06:41:53.7568295Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T06:41:53.7569608Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2025-03-14T06:41:53.7570506Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T06:41:53.7571505Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:41:53.7572462Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:41:53.7573319Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2025-03-14T06:41:53.7574595Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local ... 2025-03-14T06:41:53.9552485Z 2025-03-14T06:41:53.9553355Z  2025-03-14T06:41:53.9553796Z  2025-03-14T06:41:53.9554149Z  2025-03-14T06:41:53.9554498Z  2025-03-14T06:41:53.9554852Z  2025-03-14T06:41:53.9555191Z  2025-03-14T06:41:53.9555538Z  2025-03-14T06:41:53.9555888Z  2025-03-14T06:41:53.9556709Z [19,344 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:53.9557603Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2025-03-14T06:41:53.9558320Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 51s local 2025-03-14T06:41:53.9559055Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2025-03-14T06:41:53.9559730Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T06:41:53.9560539Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:41:53.9561289Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:41:53.9562020Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2025-03-14T06:41:53.9562918Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 24s local ... 2025-03-14T06:41:54.3557165Z 2025-03-14T06:41:54.3558041Z  2025-03-14T06:41:54.3558529Z  2025-03-14T06:41:54.3558928Z  2025-03-14T06:41:54.3559431Z  2025-03-14T06:41:54.3559823Z  2025-03-14T06:41:54.3560218Z  2025-03-14T06:41:54.3560606Z  2025-03-14T06:41:54.3560999Z  2025-03-14T06:41:54.3561947Z [19,345 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:54.3562946Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 124s local 2025-03-14T06:41:54.3563808Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T06:41:54.3564872Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 49s local 2025-03-14T06:41:54.3566135Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 38s local 2025-03-14T06:41:54.3567102Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:41:54.3567971Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:41:54.3568851Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2025-03-14T06:41:54.3569885Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2025-03-14T06:41:54.7561470Z 2025-03-14T06:41:54.7562359Z  2025-03-14T06:41:54.7562860Z  2025-03-14T06:41:54.7563303Z  2025-03-14T06:41:54.7563907Z  2025-03-14T06:41:54.7564347Z  2025-03-14T06:41:54.7564955Z  2025-03-14T06:41:54.7565533Z  2025-03-14T06:41:54.7565982Z  2025-03-14T06:41:54.7566910Z [19,347 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:54.7567886Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T06:41:54.7568787Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T06:41:54.7569647Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2025-03-14T06:41:54.7570410Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T06:41:54.7571488Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:41:54.7572359Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:41:54.7573225Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 26s local 2025-03-14T06:41:54.7574595Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2025-03-14T06:41:54.9564981Z 2025-03-14T06:41:54.9566035Z  2025-03-14T06:41:54.9566490Z  2025-03-14T06:41:54.9566870Z  2025-03-14T06:41:54.9567239Z  2025-03-14T06:41:54.9567599Z  2025-03-14T06:41:54.9567961Z  2025-03-14T06:41:54.9568340Z  2025-03-14T06:41:54.9568711Z  2025-03-14T06:41:54.9569634Z [19,348 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:54.9571039Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T06:41:54.9571859Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 52s local 2025-03-14T06:41:54.9572714Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2025-03-14T06:41:54.9573485Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T06:41:54.9574395Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:41:54.9575187Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:41:54.9575890Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local 2025-03-14T06:41:54.9576633Z @llvm-project//mlir:VectorToLLVM; 23s local ... 2025-03-14T06:41:55.2589878Z 2025-03-14T06:41:55.2590736Z  2025-03-14T06:41:55.2591233Z  2025-03-14T06:41:55.2591639Z  2025-03-14T06:41:55.2592068Z  2025-03-14T06:41:55.2592503Z  2025-03-14T06:41:55.2592950Z  2025-03-14T06:41:55.2593416Z  2025-03-14T06:41:55.2593829Z  2025-03-14T06:41:55.2594771Z [19,351 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:55.2595816Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T06:41:55.2596734Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T06:41:55.2597587Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 50s local 2025-03-14T06:41:55.2598453Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T06:41:55.2599467Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:41:55.2600330Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:41:55.2601112Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T06:41:55.2601976Z @llvm-project//mlir:VectorToLLVM; 23s local ... 2025-03-14T06:41:55.5569942Z 2025-03-14T06:41:55.5570815Z  2025-03-14T06:41:55.5571268Z  2025-03-14T06:41:55.5571662Z  2025-03-14T06:41:55.5572392Z  2025-03-14T06:41:55.5572798Z  2025-03-14T06:41:55.5573192Z  2025-03-14T06:41:55.5573676Z  2025-03-14T06:41:55.5574208Z  2025-03-14T06:41:55.5575221Z [19,352 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:55.5575999Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 125s local 2025-03-14T06:41:55.5576895Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T06:41:55.5577953Z @xla//xla/mlir_hlo:hlo_legalize_to_stablehlo; 51s local 2025-03-14T06:41:55.5578741Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 39s local 2025-03-14T06:41:55.5579746Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:41:55.5580601Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:41:55.5581398Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T06:41:55.5582319Z @llvm-project//mlir:VectorToLLVM; 23s local ... 2025-03-14T06:41:55.7573710Z 2025-03-14T06:41:55.7574588Z  2025-03-14T06:41:55.7575112Z  2025-03-14T06:41:55.7575552Z  2025-03-14T06:41:55.7575985Z  2025-03-14T06:41:55.7576405Z  2025-03-14T06:41:55.7576834Z  2025-03-14T06:41:55.7577248Z  2025-03-14T06:41:55.7577680Z  2025-03-14T06:41:55.7578672Z [19,353 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:55.7580083Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2025-03-14T06:41:55.7581057Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 53s local 2025-03-14T06:41:55.7582029Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2025-03-14T06:41:55.7583046Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:41:55.7583942Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:41:55.7584870Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T06:41:55.7585732Z @llvm-project//mlir:VectorToLLVM; 23s local 2025-03-14T06:41:55.7586509Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 23s local ... 2025-03-14T06:41:56.4498837Z 2025-03-14T06:41:56.4499698Z  2025-03-14T06:41:56.4500210Z  2025-03-14T06:41:56.4500618Z  2025-03-14T06:41:56.4501010Z  2025-03-14T06:41:56.4501432Z  2025-03-14T06:41:56.4501896Z  2025-03-14T06:41:56.4502334Z  2025-03-14T06:41:56.4502750Z  2025-03-14T06:41:56.4503734Z [19,354 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:56.4504756Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 126s local 2025-03-14T06:41:56.4505655Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T06:41:56.4506562Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 40s local 2025-03-14T06:41:56.4507549Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:41:56.4508480Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:41:56.4509274Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T06:41:56.4510109Z @llvm-project//mlir:VectorToLLVM; 24s local 2025-03-14T06:41:56.4510909Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 23s local ... 2025-03-14T06:41:56.7580313Z 2025-03-14T06:41:56.7581199Z  2025-03-14T06:41:56.7581663Z  2025-03-14T06:41:56.7582099Z  2025-03-14T06:41:56.7582508Z  2025-03-14T06:41:56.7582905Z  2025-03-14T06:41:56.7583312Z  2025-03-14T06:41:56.7583723Z  2025-03-14T06:41:56.7584101Z  2025-03-14T06:41:56.7585027Z [19,354 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:56.7585938Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T06:41:56.7586627Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T06:41:56.7587819Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2025-03-14T06:41:56.7588843Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:41:56.7589728Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:41:56.7590514Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T06:41:56.7591342Z @llvm-project//mlir:VectorToLLVM; 24s local 2025-03-14T06:41:56.7592150Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local ... 2025-03-14T06:41:56.9583456Z 2025-03-14T06:41:56.9584354Z  2025-03-14T06:41:56.9585115Z  2025-03-14T06:41:56.9585571Z  2025-03-14T06:41:56.9585993Z  2025-03-14T06:41:56.9586409Z  2025-03-14T06:41:56.9586837Z  2025-03-14T06:41:56.9587233Z  2025-03-14T06:41:56.9587623Z  2025-03-14T06:41:56.9588568Z [19,355 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:56.9589527Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T06:41:56.9590434Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 54s local 2025-03-14T06:41:56.9591327Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2025-03-14T06:41:56.9592294Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:41:56.9593169Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:41:56.9593944Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T06:41:56.9595014Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T06:41:56.9595791Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local ... 2025-03-14T06:41:57.4277895Z 2025-03-14T06:41:57.4278794Z  2025-03-14T06:41:57.4279224Z  2025-03-14T06:41:57.4279594Z  2025-03-14T06:41:57.4279965Z  2025-03-14T06:41:57.4280354Z  2025-03-14T06:41:57.4280736Z  2025-03-14T06:41:57.4281259Z  2025-03-14T06:41:57.4282106Z  2025-03-14T06:41:57.4283064Z [19,356 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:57.4284015Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 127s local 2025-03-14T06:41:57.4285001Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2025-03-14T06:41:57.4285858Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 41s local 2025-03-14T06:41:57.4286853Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2025-03-14T06:41:57.4287779Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:41:57.4288660Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2025-03-14T06:41:57.4289446Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T06:41:57.4290216Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local ... 2025-03-14T06:41:57.7589702Z 2025-03-14T06:41:57.7590650Z  2025-03-14T06:41:57.7591147Z  2025-03-14T06:41:57.7591519Z  2025-03-14T06:41:57.7591929Z  2025-03-14T06:41:57.7592344Z  2025-03-14T06:41:57.7592757Z  2025-03-14T06:41:57.7593155Z  2025-03-14T06:41:57.7593580Z  2025-03-14T06:41:57.7594492Z [19,358 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:57.7595484Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2025-03-14T06:41:57.7596402Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 55s local 2025-03-14T06:41:57.7597246Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2025-03-14T06:41:57.7598219Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2025-03-14T06:41:57.7599088Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:41:57.7599863Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2025-03-14T06:41:57.7600677Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T06:41:57.7601413Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local ... 2025-03-14T06:41:58.3998790Z 2025-03-14T06:41:58.3999651Z  2025-03-14T06:41:58.4000456Z  2025-03-14T06:41:58.4000886Z  2025-03-14T06:41:58.4001282Z  2025-03-14T06:41:58.4001680Z  2025-03-14T06:41:58.4002038Z  2025-03-14T06:41:58.4002339Z  2025-03-14T06:41:58.4002741Z  2025-03-14T06:41:58.4003672Z [19,359 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:58.4004841Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 128s local 2025-03-14T06:41:58.4005863Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2025-03-14T06:41:58.4006634Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 42s local 2025-03-14T06:41:58.4007593Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T06:41:58.4008500Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:41:58.4009394Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T06:41:58.4010264Z @llvm-project//mlir:VectorToLLVM; 26s local 2025-03-14T06:41:58.4011082Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local ... 2025-03-14T06:41:58.7596600Z 2025-03-14T06:41:58.7597417Z  2025-03-14T06:41:58.7597832Z  2025-03-14T06:41:58.7598171Z  2025-03-14T06:41:58.7598522Z  2025-03-14T06:41:58.7598867Z  2025-03-14T06:41:58.7599214Z  2025-03-14T06:41:58.7599555Z  2025-03-14T06:41:58.7599908Z  2025-03-14T06:41:58.7600745Z [19,360 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:58.7601890Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2025-03-14T06:41:58.7602769Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 56s local 2025-03-14T06:41:58.7603555Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T06:41:58.7604420Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T06:41:58.7605526Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:41:58.7606217Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T06:41:58.7606945Z @llvm-project//mlir:VectorToLLVM; 26s local 2025-03-14T06:41:58.7607632Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2025-03-14T06:41:59.4435546Z 2025-03-14T06:41:59.4436409Z  2025-03-14T06:41:59.4436895Z  2025-03-14T06:41:59.4437315Z  2025-03-14T06:41:59.4437742Z  2025-03-14T06:41:59.4438151Z  2025-03-14T06:41:59.4438579Z  2025-03-14T06:41:59.4439011Z  2025-03-14T06:41:59.4439548Z  2025-03-14T06:41:59.4440551Z [19,361 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:41:59.4441500Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 129s local 2025-03-14T06:41:59.4442424Z Compiling xla/backends/cpu/runtime/dot_thunk_f64.cc; 57s local 2025-03-14T06:41:59.4443294Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 43s local 2025-03-14T06:41:59.4444275Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2025-03-14T06:41:59.4445283Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:41:59.4446036Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T06:41:59.4446866Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T06:41:59.4447624Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local ... 2025-03-14T06:41:59.7605048Z 2025-03-14T06:41:59.7605896Z  2025-03-14T06:41:59.7606438Z  2025-03-14T06:41:59.7606812Z  2025-03-14T06:41:59.7607222Z  2025-03-14T06:41:59.7607656Z  2025-03-14T06:41:59.7608059Z  2025-03-14T06:41:59.7608470Z  2025-03-14T06:41:59.7608872Z  2025-03-14T06:41:59.7609868Z [19,363 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:41:59.7610914Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T06:41:59.7611753Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T06:41:59.7613035Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2025-03-14T06:41:59.7613967Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:41:59.7614734Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T06:41:59.7615510Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T06:41:59.7616282Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2025-03-14T06:41:59.7617032Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T06:42:00.0213128Z 2025-03-14T06:42:00.0214237Z  2025-03-14T06:42:00.0214787Z  2025-03-14T06:42:00.0215224Z  2025-03-14T06:42:00.0215617Z  2025-03-14T06:42:00.0216037Z  2025-03-14T06:42:00.0216464Z  2025-03-14T06:42:00.0216884Z  2025-03-14T06:42:00.0217316Z  2025-03-14T06:42:00.0218301Z [19,364 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:00.0219360Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T06:42:00.0220151Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T06:42:00.0221182Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2025-03-14T06:42:00.0222100Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:00.0222895Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T06:42:00.0223723Z @llvm-project//mlir:VectorToLLVM; 28s local 2025-03-14T06:42:00.0224725Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2025-03-14T06:42:00.0225521Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T06:42:00.2473749Z 2025-03-14T06:42:00.2474613Z  2025-03-14T06:42:00.2475118Z  2025-03-14T06:42:00.2475529Z  2025-03-14T06:42:00.2475912Z  2025-03-14T06:42:00.2476307Z  2025-03-14T06:42:00.2476695Z  2025-03-14T06:42:00.2477099Z  2025-03-14T06:42:00.2477797Z  2025-03-14T06:42:00.2478769Z [19,365 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:00.2479755Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T06:42:00.2480555Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T06:42:00.2481542Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2025-03-14T06:42:00.2482430Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:00.2483238Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T06:42:00.2484092Z @llvm-project//mlir:VectorToLLVM; 28s local 2025-03-14T06:42:00.2484987Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2025-03-14T06:42:00.2485689Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T06:42:00.4545038Z 2025-03-14T06:42:00.4545912Z  2025-03-14T06:42:00.4546435Z  2025-03-14T06:42:00.4546871Z  2025-03-14T06:42:00.4547284Z  2025-03-14T06:42:00.4547749Z  2025-03-14T06:42:00.4548184Z  2025-03-14T06:42:00.4548636Z  2025-03-14T06:42:00.4549031Z  2025-03-14T06:42:00.4550007Z [19,366 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:00.4551063Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 130s local 2025-03-14T06:42:00.4551887Z @xla//xla/mlir_hlo:stablehlo_legalize_to_hlo; 44s local 2025-03-14T06:42:00.4552924Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2025-03-14T06:42:00.4553893Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:00.4554766Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T06:42:00.4555630Z @llvm-project//mlir:VectorToLLVM; 28s local 2025-03-14T06:42:00.4556390Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2025-03-14T06:42:00.4557145Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T06:42:00.7611487Z 2025-03-14T06:42:00.7612329Z  2025-03-14T06:42:00.7612780Z  2025-03-14T06:42:00.7613391Z  2025-03-14T06:42:00.7613753Z  2025-03-14T06:42:00.7614097Z  2025-03-14T06:42:00.7614439Z  2025-03-14T06:42:00.7614790Z  2025-03-14T06:42:00.7615148Z  2025-03-14T06:42:00.7615973Z [19,368 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:00.7616886Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T06:42:00.7617761Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2025-03-14T06:42:00.7618690Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:00.7619364Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T06:42:00.7620089Z @llvm-project//mlir:VectorToLLVM; 28s local 2025-03-14T06:42:00.7620781Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2025-03-14T06:42:00.7621448Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:42:00.7622189Z Compiling xla/service/spmd/spmd_partitioner.cc; 17s local ... 2025-03-14T06:42:00.9614915Z 2025-03-14T06:42:00.9615687Z  2025-03-14T06:42:00.9616123Z  2025-03-14T06:42:00.9616480Z  2025-03-14T06:42:00.9616830Z  2025-03-14T06:42:00.9617168Z  2025-03-14T06:42:00.9617526Z  2025-03-14T06:42:00.9617859Z  2025-03-14T06:42:00.9618206Z  2025-03-14T06:42:00.9619067Z [19,369 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:00.9620215Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T06:42:00.9621090Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2025-03-14T06:42:00.9621944Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:00.9622708Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T06:42:00.9623526Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2025-03-14T06:42:00.9624293Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:42:00.9624995Z Compiling xla/service/spmd/spmd_partitioner.cc; 17s local 2025-03-14T06:42:00.9625703Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:42:01.3619385Z 2025-03-14T06:42:01.3620258Z  2025-03-14T06:42:01.3620724Z  2025-03-14T06:42:01.3621128Z  2025-03-14T06:42:01.3621525Z  2025-03-14T06:42:01.3621916Z  2025-03-14T06:42:01.3622316Z  2025-03-14T06:42:01.3622707Z  2025-03-14T06:42:01.3623103Z  2025-03-14T06:42:01.3624072Z [19,370 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:01.3625094Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T06:42:01.3626098Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2025-03-14T06:42:01.3626998Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:01.3627779Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T06:42:01.3628692Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2025-03-14T06:42:01.3629442Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:42:01.3630122Z Compiling xla/service/spmd/spmd_partitioner.cc; 17s local 2025-03-14T06:42:01.3630868Z @stablehlo//:linalg_passes; 16s local ... 2025-03-14T06:42:01.5622311Z 2025-03-14T06:42:01.5623238Z  2025-03-14T06:42:01.5623733Z  2025-03-14T06:42:01.5624127Z  2025-03-14T06:42:01.5624566Z  2025-03-14T06:42:01.5625002Z  2025-03-14T06:42:01.5625393Z  2025-03-14T06:42:01.5625783Z  2025-03-14T06:42:01.5626174Z  2025-03-14T06:42:01.5627093Z [19,371 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:01.5628132Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 131s local 2025-03-14T06:42:01.5629118Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2025-03-14T06:42:01.5630029Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:01.5631138Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T06:42:01.5632110Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2025-03-14T06:42:01.5632813Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:42:01.5633552Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local 2025-03-14T06:42:01.5634294Z @stablehlo//:linalg_passes; 16s local ... 2025-03-14T06:42:02.4820490Z 2025-03-14T06:42:02.4821340Z  2025-03-14T06:42:02.4821898Z  2025-03-14T06:42:02.4822320Z  2025-03-14T06:42:02.4822720Z  2025-03-14T06:42:02.4823366Z  2025-03-14T06:42:02.4823796Z  2025-03-14T06:42:02.4824202Z  2025-03-14T06:42:02.4824597Z  2025-03-14T06:42:02.4825573Z [19,372 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:02.4826623Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 132s local 2025-03-14T06:42:02.4827657Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2025-03-14T06:42:02.4828584Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:02.4829389Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T06:42:02.4830285Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T06:42:02.4831043Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:42:02.4831777Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2025-03-14T06:42:02.4832792Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:42:02.7033791Z 2025-03-14T06:42:02.7034679Z  2025-03-14T06:42:02.7035190Z  2025-03-14T06:42:02.7035610Z  2025-03-14T06:42:02.7035975Z  2025-03-14T06:42:02.7036362Z  2025-03-14T06:42:02.7036761Z  2025-03-14T06:42:02.7037149Z  2025-03-14T06:42:02.7037542Z  2025-03-14T06:42:02.7038476Z [19,374 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:02.7039810Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T06:42:02.7040797Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2025-03-14T06:42:02.7041631Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:02.7042406Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T06:42:02.7043249Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T06:42:02.7043961Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:42:02.7044893Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2025-03-14T06:42:02.7045677Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:42:02.9218023Z 2025-03-14T06:42:02.9218855Z  2025-03-14T06:42:02.9219335Z  2025-03-14T06:42:02.9219734Z  2025-03-14T06:42:02.9220118Z  2025-03-14T06:42:02.9220496Z  2025-03-14T06:42:02.9220887Z  2025-03-14T06:42:02.9221282Z  2025-03-14T06:42:02.9221704Z  2025-03-14T06:42:02.9222729Z [19,376 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:02.9223732Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T06:42:02.9224694Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2025-03-14T06:42:02.9225626Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:02.9226425Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T06:42:02.9227395Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T06:42:02.9228100Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:42:02.9228841Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2025-03-14T06:42:02.9229623Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:42:03.1632935Z 2025-03-14T06:42:03.1633806Z  2025-03-14T06:42:03.1634277Z  2025-03-14T06:42:03.1634674Z  2025-03-14T06:42:03.1635050Z  2025-03-14T06:42:03.1635482Z  2025-03-14T06:42:03.1635865Z  2025-03-14T06:42:03.1636500Z  2025-03-14T06:42:03.1636901Z  2025-03-14T06:42:03.1637798Z [19,376 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:03.1638771Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T06:42:03.1639708Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2025-03-14T06:42:03.1640574Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:03.1641333Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T06:42:03.1642330Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T06:42:03.1643089Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:42:03.1643807Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2025-03-14T06:42:03.1644508Z @stablehlo//:linalg_passes; 18s local ... 2025-03-14T06:42:03.4554547Z 2025-03-14T06:42:03.4555422Z  2025-03-14T06:42:03.4555922Z  2025-03-14T06:42:03.4556309Z  2025-03-14T06:42:03.4556740Z  2025-03-14T06:42:03.4557122Z  2025-03-14T06:42:03.4557568Z  2025-03-14T06:42:03.4557910Z  2025-03-14T06:42:03.4558252Z  2025-03-14T06:42:03.4559174Z [19,377 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:03.4560019Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 133s local 2025-03-14T06:42:03.4560803Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2025-03-14T06:42:03.4561862Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:03.4562497Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T06:42:03.4563240Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T06:42:03.4563844Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:42:03.4564454Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2025-03-14T06:42:03.4565580Z @stablehlo//:linalg_passes; 18s local ... 2025-03-14T06:42:03.7638974Z 2025-03-14T06:42:03.7639861Z  2025-03-14T06:42:03.7640358Z  2025-03-14T06:42:03.7640788Z  2025-03-14T06:42:03.7641206Z  2025-03-14T06:42:03.7641737Z  2025-03-14T06:42:03.7642132Z  2025-03-14T06:42:03.7642559Z  2025-03-14T06:42:03.7642957Z  2025-03-14T06:42:03.7643908Z [19,377 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:03.7645111Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T06:42:03.7646144Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2025-03-14T06:42:03.7647105Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:03.7647926Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T06:42:03.7648871Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2025-03-14T06:42:03.7649626Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:42:03.7650409Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2025-03-14T06:42:03.7651211Z @stablehlo//:linalg_passes; 18s local ... 2025-03-14T06:42:04.1408563Z 2025-03-14T06:42:04.1409453Z  2025-03-14T06:42:04.1409941Z  2025-03-14T06:42:04.1410362Z  2025-03-14T06:42:04.1410779Z  2025-03-14T06:42:04.1411199Z  2025-03-14T06:42:04.1411607Z  2025-03-14T06:42:04.1412021Z  2025-03-14T06:42:04.1412445Z  2025-03-14T06:42:04.1413444Z [19,379 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:04.1414494Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T06:42:04.1415534Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T06:42:04.1416447Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:04.1417272Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T06:42:04.1418231Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2025-03-14T06:42:04.1419335Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:42:04.1420180Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2025-03-14T06:42:04.1420997Z @stablehlo//:linalg_passes; 19s local ... 2025-03-14T06:42:04.3645076Z 2025-03-14T06:42:04.3645893Z  2025-03-14T06:42:04.3646339Z  2025-03-14T06:42:04.3646733Z  2025-03-14T06:42:04.3647120Z  2025-03-14T06:42:04.3647502Z  2025-03-14T06:42:04.3647922Z  2025-03-14T06:42:04.3648309Z  2025-03-14T06:42:04.3648697Z  2025-03-14T06:42:04.3649850Z [19,381 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:04.3650812Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 134s local 2025-03-14T06:42:04.3651725Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T06:42:04.3652577Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:04.3653388Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T06:42:04.3654208Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2025-03-14T06:42:04.3654903Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:42:04.3655587Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2025-03-14T06:42:04.3656438Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 18s local ... 2025-03-14T06:42:04.7649311Z 2025-03-14T06:42:04.7650157Z  2025-03-14T06:42:04.7651020Z  2025-03-14T06:42:04.7651413Z  2025-03-14T06:42:04.7651802Z  2025-03-14T06:42:04.7652186Z  2025-03-14T06:42:04.7652572Z  2025-03-14T06:42:04.7652951Z  2025-03-14T06:42:04.7653350Z  2025-03-14T06:42:04.7654220Z [19,383 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:04.7655147Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2025-03-14T06:42:04.7656277Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T06:42:04.7657152Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:04.7657849Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T06:42:04.7658675Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2025-03-14T06:42:04.7659370Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:04.7660059Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2025-03-14T06:42:04.7660883Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 18s local ... 2025-03-14T06:42:05.1653431Z 2025-03-14T06:42:05.1654354Z  2025-03-14T06:42:05.1654836Z  2025-03-14T06:42:05.1655235Z  2025-03-14T06:42:05.1655663Z  2025-03-14T06:42:05.1656120Z  2025-03-14T06:42:05.1656582Z  2025-03-14T06:42:05.1657010Z  2025-03-14T06:42:05.1657429Z  2025-03-14T06:42:05.1658420Z [19,384 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:05.1659466Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2025-03-14T06:42:05.1660481Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2025-03-14T06:42:05.1661387Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:05.1662205Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T06:42:05.1663137Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2025-03-14T06:42:05.1663924Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:05.1664698Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2025-03-14T06:42:05.1665880Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 18s local ... 2025-03-14T06:42:05.5025156Z 2025-03-14T06:42:05.5026035Z  2025-03-14T06:42:05.5026482Z  2025-03-14T06:42:05.5026860Z  2025-03-14T06:42:05.5027251Z  2025-03-14T06:42:05.5027645Z  2025-03-14T06:42:05.5028009Z  2025-03-14T06:42:05.5028377Z  2025-03-14T06:42:05.5028791Z  2025-03-14T06:42:05.5030034Z [19,386 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:05.5030973Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 135s local 2025-03-14T06:42:05.5031892Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2025-03-14T06:42:05.5032704Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:05.5033403Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T06:42:05.5034253Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T06:42:05.5035142Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:05.5035851Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2025-03-14T06:42:05.5036665Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 19s local ... 2025-03-14T06:42:05.7658501Z 2025-03-14T06:42:05.7659331Z  2025-03-14T06:42:05.7659788Z  2025-03-14T06:42:05.7660186Z  2025-03-14T06:42:05.7660656Z  2025-03-14T06:42:05.7661022Z  2025-03-14T06:42:05.7661415Z  2025-03-14T06:42:05.7661779Z  2025-03-14T06:42:05.7662120Z  2025-03-14T06:42:05.7662990Z [19,386 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:05.7663933Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 136s local 2025-03-14T06:42:05.7664839Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2025-03-14T06:42:05.7666232Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:05.7666914Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T06:42:05.7667734Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T06:42:05.7668367Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:05.7669004Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2025-03-14T06:42:05.7669853Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 19s local ... 2025-03-14T06:42:06.1212739Z 2025-03-14T06:42:06.1213657Z  2025-03-14T06:42:06.1214192Z  2025-03-14T06:42:06.1214596Z  2025-03-14T06:42:06.1214945Z  2025-03-14T06:42:06.1215342Z  2025-03-14T06:42:06.1215738Z  2025-03-14T06:42:06.1216128Z  2025-03-14T06:42:06.1216494Z  2025-03-14T06:42:06.1217429Z [19,388 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:06.1218368Z Compiling xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 136s local 2025-03-14T06:42:06.1219355Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2025-03-14T06:42:06.1220204Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:06.1220893Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T06:42:06.1221717Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T06:42:06.1222376Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:06.1223093Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2025-03-14T06:42:06.1223959Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 19s local ... 2025-03-14T06:42:06.3663496Z 2025-03-14T06:42:06.3664390Z  2025-03-14T06:42:06.3664891Z  2025-03-14T06:42:06.3665476Z  2025-03-14T06:42:06.3665882Z  2025-03-14T06:42:06.3666258Z  2025-03-14T06:42:06.3666637Z  2025-03-14T06:42:06.3667023Z  2025-03-14T06:42:06.3667425Z  2025-03-14T06:42:06.3668332Z [19,390 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:06.3669544Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2025-03-14T06:42:06.3670420Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:06.3671139Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T06:42:06.3671961Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T06:42:06.3672621Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:06.3673616Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2025-03-14T06:42:06.3674420Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 20s local 2025-03-14T06:42:06.3675380Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local ... 2025-03-14T06:42:06.7667694Z 2025-03-14T06:42:06.7668598Z  2025-03-14T06:42:06.7669081Z  2025-03-14T06:42:06.7669471Z  2025-03-14T06:42:06.7669860Z  2025-03-14T06:42:06.7670234Z  2025-03-14T06:42:06.7670641Z  2025-03-14T06:42:06.7671031Z  2025-03-14T06:42:06.7671424Z  2025-03-14T06:42:06.7672696Z [19,391 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:06.7673841Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2025-03-14T06:42:06.7674690Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:06.7675438Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T06:42:06.7676332Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2025-03-14T06:42:06.7677020Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:06.7677734Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2025-03-14T06:42:06.7678542Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 20s local 2025-03-14T06:42:06.7679468Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 16s local ... 2025-03-14T06:42:07.2073379Z 2025-03-14T06:42:07.2074372Z  2025-03-14T06:42:07.2075287Z  2025-03-14T06:42:07.2075713Z  2025-03-14T06:42:07.2076144Z  2025-03-14T06:42:07.2076574Z  2025-03-14T06:42:07.2076981Z  2025-03-14T06:42:07.2077393Z  2025-03-14T06:42:07.2077838Z  2025-03-14T06:42:07.2078777Z [19,392 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:07.2079943Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T06:42:07.2080934Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:07.2081712Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T06:42:07.2082567Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2025-03-14T06:42:07.2083285Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:07.2084023Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2025-03-14T06:42:07.2084976Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 20s local 2025-03-14T06:42:07.2085944Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local ... 2025-03-14T06:42:07.5070145Z 2025-03-14T06:42:07.5071029Z  2025-03-14T06:42:07.5071496Z  2025-03-14T06:42:07.5071887Z  2025-03-14T06:42:07.5072269Z  2025-03-14T06:42:07.5072665Z  2025-03-14T06:42:07.5073048Z  2025-03-14T06:42:07.5073447Z  2025-03-14T06:42:07.5073845Z  2025-03-14T06:42:07.5074742Z [19,393 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:07.5075883Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T06:42:07.5076717Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:07.5077434Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T06:42:07.5078166Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:07.5078851Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T06:42:07.5079653Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 21s local 2025-03-14T06:42:07.5080535Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T06:42:07.5081342Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:42:07.7674733Z 2025-03-14T06:42:07.7675636Z  2025-03-14T06:42:07.7676043Z  2025-03-14T06:42:07.7676405Z  2025-03-14T06:42:07.7676750Z  2025-03-14T06:42:07.7677098Z  2025-03-14T06:42:07.7677458Z  2025-03-14T06:42:07.7677800Z  2025-03-14T06:42:07.7678188Z  2025-03-14T06:42:07.7679245Z [19,393 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:07.7680268Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T06:42:07.7680991Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:07.7681621Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T06:42:07.7682280Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:07.7682906Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T06:42:07.7683797Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 21s local 2025-03-14T06:42:07.7684763Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 17s local 2025-03-14T06:42:07.7685480Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:42:08.2710952Z 2025-03-14T06:42:08.2711810Z  2025-03-14T06:42:08.2712314Z  2025-03-14T06:42:08.2712723Z  2025-03-14T06:42:08.2713144Z  2025-03-14T06:42:08.2713537Z  2025-03-14T06:42:08.2713929Z  2025-03-14T06:42:08.2714318Z  2025-03-14T06:42:08.2714681Z  2025-03-14T06:42:08.2715569Z [19,394 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:08.2716709Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 49s local 2025-03-14T06:42:08.2717545Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:08.2718248Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T06:42:08.2719355Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:08.2720047Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T06:42:08.2720857Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 21s local 2025-03-14T06:42:08.2721737Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2025-03-14T06:42:08.2722566Z @stablehlo//:linalg_passes; 15s local ... 2025-03-14T06:42:08.5680917Z 2025-03-14T06:42:08.5681808Z  2025-03-14T06:42:08.5682343Z  2025-03-14T06:42:08.5682745Z  2025-03-14T06:42:08.5683137Z  2025-03-14T06:42:08.5683529Z  2025-03-14T06:42:08.5683925Z  2025-03-14T06:42:08.5684335Z  2025-03-14T06:42:08.5684839Z  2025-03-14T06:42:08.5685788Z [19,394 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:08.5686891Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 49s local 2025-03-14T06:42:08.5697760Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:08.5698733Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T06:42:08.5699525Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:08.5700253Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T06:42:08.5701082Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 22s local 2025-03-14T06:42:08.5701996Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 18s local 2025-03-14T06:42:08.5702839Z @stablehlo//:linalg_passes; 16s local ... 2025-03-14T06:42:09.0491575Z 2025-03-14T06:42:09.0492445Z  2025-03-14T06:42:09.0493074Z  2025-03-14T06:42:09.0493434Z  2025-03-14T06:42:09.0493776Z  2025-03-14T06:42:09.0494117Z  2025-03-14T06:42:09.0494459Z  2025-03-14T06:42:09.0494818Z  2025-03-14T06:42:09.0495203Z  2025-03-14T06:42:09.0496011Z [19,395 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:09.0496894Z @stablehlo//:linalg_passes; 40s local 2025-03-14T06:42:09.0497559Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T06:42:09.0498249Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:09.0498894Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T06:42:09.0499631Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 22s local 2025-03-14T06:42:09.0500453Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T06:42:09.0501519Z @stablehlo//:linalg_passes; 16s local 2025-03-14T06:42:09.0502364Z Compiling llvm/lib/Target/X86/X86ISelLoweringCall.cpp; 16s local ... 2025-03-14T06:42:09.3687080Z 2025-03-14T06:42:09.3687984Z  2025-03-14T06:42:09.3688465Z  2025-03-14T06:42:09.3688825Z  2025-03-14T06:42:09.3689203Z  2025-03-14T06:42:09.3689575Z  2025-03-14T06:42:09.3689966Z  2025-03-14T06:42:09.3690393Z  2025-03-14T06:42:09.3690799Z  2025-03-14T06:42:09.3691958Z [19,396 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:09.3692841Z @stablehlo//:linalg_passes; 40s local 2025-03-14T06:42:09.3693601Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2025-03-14T06:42:09.3694386Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:09.3695104Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T06:42:09.3695968Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 23s local 2025-03-14T06:42:09.3696888Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T06:42:09.3697642Z @stablehlo//:linalg_passes; 16s local 2025-03-14T06:42:09.3698392Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 15s local ... 2025-03-14T06:42:09.7691793Z 2025-03-14T06:42:09.7692642Z  2025-03-14T06:42:09.7693144Z  2025-03-14T06:42:09.7693845Z  2025-03-14T06:42:09.7694271Z  2025-03-14T06:42:09.7694700Z  2025-03-14T06:42:09.7695110Z  2025-03-14T06:42:09.7695536Z  2025-03-14T06:42:09.7695968Z  2025-03-14T06:42:09.7696950Z [19,398 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:09.7697865Z @stablehlo//:linalg_passes; 41s local 2025-03-14T06:42:09.7698652Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2025-03-14T06:42:09.7699673Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:09.7700444Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T06:42:09.7701290Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 23s local 2025-03-14T06:42:09.7702214Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 19s local 2025-03-14T06:42:09.7703073Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:42:09.7703876Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local ... 2025-03-14T06:42:09.9694223Z 2025-03-14T06:42:09.9695102Z  2025-03-14T06:42:09.9695579Z  2025-03-14T06:42:09.9696031Z  2025-03-14T06:42:09.9696465Z  2025-03-14T06:42:09.9696894Z  2025-03-14T06:42:09.9697328Z  2025-03-14T06:42:09.9697735Z  2025-03-14T06:42:09.9698121Z  2025-03-14T06:42:09.9699000Z [19,399 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:09.9699873Z @stablehlo//:linalg_passes; 41s local 2025-03-14T06:42:09.9700624Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2025-03-14T06:42:09.9701342Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:09.9702030Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T06:42:09.9702845Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 23s local 2025-03-14T06:42:09.9703748Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T06:42:09.9704609Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:42:09.9705421Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local ... 2025-03-14T06:42:10.3698215Z 2025-03-14T06:42:10.3699120Z  2025-03-14T06:42:10.3699608Z  2025-03-14T06:42:10.3700053Z  2025-03-14T06:42:10.3700483Z  2025-03-14T06:42:10.3700884Z  2025-03-14T06:42:10.3701274Z  2025-03-14T06:42:10.3701671Z  2025-03-14T06:42:10.3702085Z  2025-03-14T06:42:10.3703242Z [19,400 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:10.3704183Z @stablehlo//:linalg_passes; 41s local 2025-03-14T06:42:10.3704959Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T06:42:10.3705719Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:10.3706467Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T06:42:10.3707332Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local 2025-03-14T06:42:10.3708313Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T06:42:10.3709358Z @stablehlo//:linalg_passes; 17s local 2025-03-14T06:42:10.3710177Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 16s local ... 2025-03-14T06:42:10.6478440Z 2025-03-14T06:42:10.6479352Z  2025-03-14T06:42:10.6479858Z  2025-03-14T06:42:10.6480264Z  2025-03-14T06:42:10.6480692Z  2025-03-14T06:42:10.6481123Z  2025-03-14T06:42:10.6481571Z  2025-03-14T06:42:10.6481987Z  2025-03-14T06:42:10.6482419Z  2025-03-14T06:42:10.6483388Z [19,401 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:10.6484311Z @stablehlo//:linalg_passes; 41s local 2025-03-14T06:42:10.6485228Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T06:42:10.6486035Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:10.6486775Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T06:42:10.6487957Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local 2025-03-14T06:42:10.6488934Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 20s local 2025-03-14T06:42:10.6489809Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:42:10.6490617Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 17s local ... 2025-03-14T06:42:10.9358788Z 2025-03-14T06:42:10.9359681Z  2025-03-14T06:42:10.9360167Z  2025-03-14T06:42:10.9360858Z  2025-03-14T06:42:10.9361251Z  2025-03-14T06:42:10.9361663Z  2025-03-14T06:42:10.9362064Z  2025-03-14T06:42:10.9362482Z  2025-03-14T06:42:10.9362870Z  2025-03-14T06:42:10.9363746Z [19,403 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:10.9364776Z @stablehlo//:linalg_passes; 42s local 2025-03-14T06:42:10.9365766Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T06:42:10.9366568Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:10.9367305Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T06:42:10.9368118Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local 2025-03-14T06:42:10.9369027Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T06:42:10.9369807Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:42:10.9370526Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 17s local ... 2025-03-14T06:42:11.1420655Z 2025-03-14T06:42:11.1421572Z  2025-03-14T06:42:11.1422087Z  2025-03-14T06:42:11.1422518Z  2025-03-14T06:42:11.1422932Z  2025-03-14T06:42:11.1423330Z  2025-03-14T06:42:11.1423730Z  2025-03-14T06:42:11.1424129Z  2025-03-14T06:42:11.1424522Z  2025-03-14T06:42:11.1425569Z [19,406 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:11.1426505Z @stablehlo//:linalg_passes; 42s local 2025-03-14T06:42:11.1427319Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T06:42:11.1428079Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:11.1428785Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T06:42:11.1429619Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 24s local 2025-03-14T06:42:11.1430490Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T06:42:11.1431324Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:42:11.1432395Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 17s local ... 2025-03-14T06:42:11.3592471Z 2025-03-14T06:42:11.3593385Z  2025-03-14T06:42:11.3593888Z  2025-03-14T06:42:11.3594308Z  2025-03-14T06:42:11.3594796Z  2025-03-14T06:42:11.3595234Z  2025-03-14T06:42:11.3595686Z  2025-03-14T06:42:11.3596094Z  2025-03-14T06:42:11.3596491Z  2025-03-14T06:42:11.3597432Z [19,407 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:11.3598646Z @stablehlo//:linalg_passes; 42s local 2025-03-14T06:42:11.3599409Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2025-03-14T06:42:11.3600204Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:11.3600939Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T06:42:11.3601788Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local 2025-03-14T06:42:11.3602734Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T06:42:11.3603568Z @stablehlo//:linalg_passes; 18s local 2025-03-14T06:42:11.3604343Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 17s local ... 2025-03-14T06:42:11.5706016Z 2025-03-14T06:42:11.5706951Z  2025-03-14T06:42:11.5707468Z  2025-03-14T06:42:11.5707892Z  2025-03-14T06:42:11.5708330Z  2025-03-14T06:42:11.5708753Z  2025-03-14T06:42:11.5709512Z  2025-03-14T06:42:11.5709925Z  2025-03-14T06:42:11.5710334Z  2025-03-14T06:42:11.5711339Z [19,407 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:11.5712264Z @stablehlo//:linalg_passes; 42s local 2025-03-14T06:42:11.5713016Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2025-03-14T06:42:11.5713831Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:11.5714600Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T06:42:11.5715688Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local 2025-03-14T06:42:11.5716604Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T06:42:11.5717412Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:42:11.5718224Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local ... 2025-03-14T06:42:11.8174171Z 2025-03-14T06:42:11.8175007Z  2025-03-14T06:42:11.8175467Z  2025-03-14T06:42:11.8175898Z  2025-03-14T06:42:11.8176280Z  2025-03-14T06:42:11.8176696Z  2025-03-14T06:42:11.8177097Z  2025-03-14T06:42:11.8177494Z  2025-03-14T06:42:11.8177878Z  2025-03-14T06:42:11.8178791Z [19,408 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:11.8179636Z @stablehlo//:linalg_passes; 43s local 2025-03-14T06:42:11.8180357Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2025-03-14T06:42:11.8181142Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:11.8181854Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T06:42:11.8182676Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local 2025-03-14T06:42:11.8183545Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 21s local 2025-03-14T06:42:11.8184270Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:42:11.8184989Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local ... 2025-03-14T06:42:12.1711022Z 2025-03-14T06:42:12.1711954Z  2025-03-14T06:42:12.1712481Z  2025-03-14T06:42:12.1712903Z  2025-03-14T06:42:12.1713301Z  2025-03-14T06:42:12.1713694Z  2025-03-14T06:42:12.1714094Z  2025-03-14T06:42:12.1714488Z  2025-03-14T06:42:12.1714892Z  2025-03-14T06:42:12.1715882Z [19,408 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:12.1716834Z @stablehlo//:linalg_passes; 43s local 2025-03-14T06:42:12.1717862Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2025-03-14T06:42:12.1718643Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:12.1719373Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T06:42:12.1720261Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 25s local 2025-03-14T06:42:12.1721175Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 22s local 2025-03-14T06:42:12.1721997Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:42:12.1722971Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 18s local ... 2025-03-14T06:42:12.7765104Z 2025-03-14T06:42:12.7766189Z  2025-03-14T06:42:12.7766672Z  2025-03-14T06:42:12.7767078Z  2025-03-14T06:42:12.7767477Z  2025-03-14T06:42:12.7767911Z  2025-03-14T06:42:12.7768280Z  2025-03-14T06:42:12.7768661Z  2025-03-14T06:42:12.7769030Z  2025-03-14T06:42:12.7769965Z [19,409 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:12.7770805Z @stablehlo//:linalg_passes; 44s local 2025-03-14T06:42:12.7771494Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T06:42:12.7772223Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:12.7772908Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2025-03-14T06:42:12.7773813Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local 2025-03-14T06:42:12.7775018Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 22s local 2025-03-14T06:42:12.7775782Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:42:12.7776485Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 19s local ... 2025-03-14T06:42:13.1716999Z 2025-03-14T06:42:13.1717808Z  2025-03-14T06:42:13.1718263Z  2025-03-14T06:42:13.1718676Z  2025-03-14T06:42:13.1719047Z  2025-03-14T06:42:13.1719375Z  2025-03-14T06:42:13.1720013Z  2025-03-14T06:42:13.1720419Z  2025-03-14T06:42:13.1720827Z  2025-03-14T06:42:13.1721731Z [19,409 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:13.1722514Z @stablehlo//:linalg_passes; 44s local 2025-03-14T06:42:13.1723291Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T06:42:13.1723924Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:13.1724548Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2025-03-14T06:42:13.1725641Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 26s local 2025-03-14T06:42:13.1726482Z Compiling llvm/lib/Target/X86/X86CodeGenPassBuilder.cpp; 23s local 2025-03-14T06:42:13.1727194Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:42:13.1727964Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 19s local ... 2025-03-14T06:42:13.4673668Z 2025-03-14T06:42:13.4674735Z  2025-03-14T06:42:13.4675282Z  2025-03-14T06:42:13.4675713Z  2025-03-14T06:42:13.4676152Z  2025-03-14T06:42:13.4676587Z  2025-03-14T06:42:13.4677024Z  2025-03-14T06:42:13.4677453Z  2025-03-14T06:42:13.4677890Z  2025-03-14T06:42:13.4678863Z [19,412 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:13.4679855Z @stablehlo//:linalg_passes; 44s local 2025-03-14T06:42:13.4680689Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2025-03-14T06:42:13.4681518Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:13.4682316Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T06:42:13.4683251Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2025-03-14T06:42:13.4684018Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:42:13.4684975Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2025-03-14T06:42:13.4685911Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2025-03-14T06:42:13.7354494Z 2025-03-14T06:42:13.7355620Z  2025-03-14T06:42:13.7356114Z  2025-03-14T06:42:13.7356495Z  2025-03-14T06:42:13.7356889Z  2025-03-14T06:42:13.7357264Z  2025-03-14T06:42:13.7357634Z  2025-03-14T06:42:13.7358118Z  2025-03-14T06:42:13.7358507Z  2025-03-14T06:42:13.7359402Z [19,417 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:13.7360285Z @stablehlo//:linalg_passes; 45s local 2025-03-14T06:42:13.7361213Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2025-03-14T06:42:13.7361977Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:13.7362677Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T06:42:13.7363497Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2025-03-14T06:42:13.7364199Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:42:13.7365095Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2025-03-14T06:42:13.7366141Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2025-03-14T06:42:13.9720887Z 2025-03-14T06:42:13.9721750Z  2025-03-14T06:42:13.9722232Z  2025-03-14T06:42:13.9722607Z  2025-03-14T06:42:13.9722991Z  2025-03-14T06:42:13.9723341Z  2025-03-14T06:42:13.9723714Z  2025-03-14T06:42:13.9724077Z  2025-03-14T06:42:13.9724452Z  2025-03-14T06:42:13.9725421Z [19,417 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:13.9726577Z @stablehlo//:linalg_passes; 45s local 2025-03-14T06:42:13.9727266Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2025-03-14T06:42:13.9727965Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:13.9728627Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T06:42:13.9729378Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 27s local 2025-03-14T06:42:13.9730157Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:42:13.9730854Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 20s local 2025-03-14T06:42:13.9731618Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2025-03-14T06:42:14.5844388Z 2025-03-14T06:42:14.5845399Z  2025-03-14T06:42:14.5845875Z  2025-03-14T06:42:14.5846275Z  2025-03-14T06:42:14.5846666Z  2025-03-14T06:42:14.5847056Z  2025-03-14T06:42:14.5847435Z  2025-03-14T06:42:14.5847852Z  2025-03-14T06:42:14.5848228Z  2025-03-14T06:42:14.5849154Z [19,418 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:14.5850145Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T06:42:14.5850851Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:14.5851531Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2025-03-14T06:42:14.5852324Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2025-03-14T06:42:14.5853015Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:42:14.5853714Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local 2025-03-14T06:42:14.5854488Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:42:14.5855124Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:42:14.9727211Z 2025-03-14T06:42:14.9728077Z  2025-03-14T06:42:14.9728600Z  2025-03-14T06:42:14.9729046Z  2025-03-14T06:42:14.9729511Z  2025-03-14T06:42:14.9729917Z  2025-03-14T06:42:14.9730312Z  2025-03-14T06:42:14.9730746Z  2025-03-14T06:42:14.9731169Z  2025-03-14T06:42:14.9732137Z [19,418 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:14.9733236Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T06:42:14.9734089Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:14.9734891Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2025-03-14T06:42:14.9736125Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2025-03-14T06:42:14.9736886Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:42:14.9737682Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local 2025-03-14T06:42:14.9738456Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:42:14.9739133Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:42:15.1731177Z 2025-03-14T06:42:15.1732044Z  2025-03-14T06:42:15.1732557Z  2025-03-14T06:42:15.1732968Z  2025-03-14T06:42:15.1733691Z  2025-03-14T06:42:15.1734110Z  2025-03-14T06:42:15.1734512Z  2025-03-14T06:42:15.1734917Z  2025-03-14T06:42:15.1735320Z  2025-03-14T06:42:15.1736270Z [19,420 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:15.1737376Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T06:42:15.1738193Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:15.1738948Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2025-03-14T06:42:15.1739824Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 28s local 2025-03-14T06:42:15.1740560Z @stablehlo//:linalg_passes; 22s local 2025-03-14T06:42:15.1741336Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 21s local 2025-03-14T06:42:15.1742183Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:42:15.1743071Z @stablehlo//:linalg_passes; 17s local ... 2025-03-14T06:42:16.0147353Z 2025-03-14T06:42:16.0148288Z  2025-03-14T06:42:16.0148776Z  2025-03-14T06:42:16.0149164Z  2025-03-14T06:42:16.0149549Z  2025-03-14T06:42:16.0149950Z  2025-03-14T06:42:16.0150364Z  2025-03-14T06:42:16.0150755Z  2025-03-14T06:42:16.0151160Z  2025-03-14T06:42:16.0152098Z [19,421 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:16.0153486Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T06:42:16.0154269Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:16.0155058Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2025-03-14T06:42:16.0155995Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2025-03-14T06:42:16.0156756Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:42:16.0157547Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2025-03-14T06:42:16.0158453Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:42:16.0159174Z @stablehlo//:linalg_passes; 18s local ... 2025-03-14T06:42:16.2582864Z 2025-03-14T06:42:16.2583719Z  2025-03-14T06:42:16.2584211Z  2025-03-14T06:42:16.2584630Z  2025-03-14T06:42:16.2585014Z  2025-03-14T06:42:16.2585383Z  2025-03-14T06:42:16.2585776Z  2025-03-14T06:42:16.2586170Z  2025-03-14T06:42:16.2586585Z  2025-03-14T06:42:16.2587619Z [19,422 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:16.2588774Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T06:42:16.2589632Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:16.2590413Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2025-03-14T06:42:16.2591865Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 29s local 2025-03-14T06:42:16.2592647Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:42:16.2593665Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 22s local 2025-03-14T06:42:16.2594648Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:42:16.2595429Z @stablehlo//:linalg_passes; 18s local ... 2025-03-14T06:42:16.4784728Z 2025-03-14T06:42:16.4785628Z  2025-03-14T06:42:16.4786134Z  2025-03-14T06:42:16.4786542Z  2025-03-14T06:42:16.4786922Z  2025-03-14T06:42:16.4787320Z  2025-03-14T06:42:16.4787725Z  2025-03-14T06:42:16.4788077Z  2025-03-14T06:42:16.4788703Z  2025-03-14T06:42:16.4789610Z [19,423 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:16.4790670Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T06:42:16.4791458Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:16.4792201Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2025-03-14T06:42:16.4793103Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T06:42:16.4794052Z @stablehlo//:linalg_passes; 23s local 2025-03-14T06:42:16.4794861Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2025-03-14T06:42:16.4795728Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:42:16.4796425Z @stablehlo//:linalg_passes; 19s local ... 2025-03-14T06:42:16.7740885Z 2025-03-14T06:42:16.7741755Z  2025-03-14T06:42:16.7742263Z  2025-03-14T06:42:16.7742703Z  2025-03-14T06:42:16.7743122Z  2025-03-14T06:42:16.7743531Z  2025-03-14T06:42:16.7743938Z  2025-03-14T06:42:16.7744352Z  2025-03-14T06:42:16.7744781Z  2025-03-14T06:42:16.7745759Z [19,423 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:16.7746940Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T06:42:16.7747769Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:16.7750986Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2025-03-14T06:42:16.7751920Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T06:42:16.7752711Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:42:16.7753540Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2025-03-14T06:42:16.7754462Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:42:16.7755150Z @stablehlo//:linalg_passes; 19s local ... 2025-03-14T06:42:17.1746471Z 2025-03-14T06:42:17.1747435Z  2025-03-14T06:42:17.1747962Z  2025-03-14T06:42:17.1748376Z  2025-03-14T06:42:17.1748759Z  2025-03-14T06:42:17.1749162Z  2025-03-14T06:42:17.1749563Z  2025-03-14T06:42:17.1749957Z  2025-03-14T06:42:17.1750338Z  2025-03-14T06:42:17.1751285Z [19,424 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:17.1752330Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T06:42:17.1753158Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:17.1753828Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 30s local 2025-03-14T06:42:17.1754492Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:42:17.1755222Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 23s local 2025-03-14T06:42:17.1756075Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:42:17.1756763Z @stablehlo//:linalg_passes; 19s local 2025-03-14T06:42:17.1757506Z Compiling xla/service/executable.cc; 17s local ... 2025-03-14T06:42:17.8146601Z 2025-03-14T06:42:17.8147473Z  2025-03-14T06:42:17.8147909Z  2025-03-14T06:42:17.8148260Z  2025-03-14T06:42:17.8148609Z  2025-03-14T06:42:17.8148967Z  2025-03-14T06:42:17.8149322Z  2025-03-14T06:42:17.8149677Z  2025-03-14T06:42:17.8150036Z  2025-03-14T06:42:17.8150872Z [19,425 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:17.8151873Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T06:42:17.8152575Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:17.8153206Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2025-03-14T06:42:17.8153860Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:42:17.8154544Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2025-03-14T06:42:17.8155309Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:42:17.8156177Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:42:17.8156810Z Compiling xla/service/executable.cc; 18s local ... 2025-03-14T06:42:18.1203145Z 2025-03-14T06:42:18.1203973Z  2025-03-14T06:42:18.1204473Z  2025-03-14T06:42:18.1205063Z  2025-03-14T06:42:18.1205478Z  2025-03-14T06:42:18.1205878Z  2025-03-14T06:42:18.1206279Z  2025-03-14T06:42:18.1206668Z  2025-03-14T06:42:18.1207131Z  2025-03-14T06:42:18.1208395Z [19,427 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:18.1209436Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T06:42:18.1210232Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:18.1210969Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 31s local 2025-03-14T06:42:18.1211730Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:42:18.1212540Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 24s local 2025-03-14T06:42:18.1213439Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:42:18.1214151Z @stablehlo//:linalg_passes; 20s local 2025-03-14T06:42:18.1214875Z Compiling xla/service/executable.cc; 18s local ... 2025-03-14T06:42:18.5214063Z 2025-03-14T06:42:18.5214926Z  2025-03-14T06:42:18.5215425Z  2025-03-14T06:42:18.5215848Z  2025-03-14T06:42:18.5216269Z  2025-03-14T06:42:18.5216691Z  2025-03-14T06:42:18.5217422Z  2025-03-14T06:42:18.5217824Z  2025-03-14T06:42:18.5218204Z  2025-03-14T06:42:18.5219284Z [19,429 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:18.5220320Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T06:42:18.5221062Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:18.5221749Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2025-03-14T06:42:18.5222671Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:18.5223460Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2025-03-14T06:42:18.5224344Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:42:18.5225046Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:42:18.5225737Z Compiling xla/service/executable.cc; 19s local ... 2025-03-14T06:42:18.7221165Z 2025-03-14T06:42:18.7222057Z  2025-03-14T06:42:18.7222568Z  2025-03-14T06:42:18.7222992Z  2025-03-14T06:42:18.7223392Z  2025-03-14T06:42:18.7223802Z  2025-03-14T06:42:18.7224216Z  2025-03-14T06:42:18.7224599Z  2025-03-14T06:42:18.7224980Z  2025-03-14T06:42:18.7225938Z [19,430 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:18.7227051Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T06:42:18.7227822Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:18.7228662Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2025-03-14T06:42:18.7229343Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:18.7230076Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2025-03-14T06:42:18.7230880Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:42:18.7231514Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:42:18.7232184Z Compiling xla/service/executable.cc; 19s local ... 2025-03-14T06:42:19.0201459Z 2025-03-14T06:42:19.0202252Z  2025-03-14T06:42:19.0202757Z  2025-03-14T06:42:19.0203224Z  2025-03-14T06:42:19.0203664Z  2025-03-14T06:42:19.0204090Z  2025-03-14T06:42:19.0204528Z  2025-03-14T06:42:19.0205085Z  2025-03-14T06:42:19.0205488Z  2025-03-14T06:42:19.0206464Z [19,433 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:19.0207601Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T06:42:19.0208804Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 32s local 2025-03-14T06:42:19.0209591Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:19.0210417Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2025-03-14T06:42:19.0211326Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:42:19.0212063Z @stablehlo//:linalg_passes; 21s local 2025-03-14T06:42:19.0212890Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 19s local 2025-03-14T06:42:19.0213805Z @llvm-project//mlir:VectorToLLVM; 18s local ... 2025-03-14T06:42:19.3237698Z 2025-03-14T06:42:19.3238561Z  2025-03-14T06:42:19.3239026Z  2025-03-14T06:42:19.3239415Z  2025-03-14T06:42:19.3239850Z  2025-03-14T06:42:19.3240348Z  2025-03-14T06:42:19.3240721Z  2025-03-14T06:42:19.3241126Z  2025-03-14T06:42:19.3241489Z  2025-03-14T06:42:19.3242400Z [19,437 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:19.3243473Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T06:42:19.3244393Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T06:42:19.3245202Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:19.3245929Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 25s local 2025-03-14T06:42:19.3246754Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:42:19.3247802Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 19s local 2025-03-14T06:42:19.3248635Z @llvm-project//mlir:VectorToLLVM; 18s local 2025-03-14T06:42:19.3249440Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 18s local ... 2025-03-14T06:42:19.5240749Z 2025-03-14T06:42:19.5241555Z  2025-03-14T06:42:19.5242054Z  2025-03-14T06:42:19.5242481Z  2025-03-14T06:42:19.5242910Z  2025-03-14T06:42:19.5243342Z  2025-03-14T06:42:19.5244047Z  2025-03-14T06:42:19.5244461Z  2025-03-14T06:42:19.5244982Z  2025-03-14T06:42:19.5245957Z [19,440 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:19.5247066Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T06:42:19.5248000Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T06:42:19.5248638Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:19.5249541Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2025-03-14T06:42:19.5250418Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:42:19.5251289Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 20s local 2025-03-14T06:42:19.5252085Z @llvm-project//mlir:VectorToLLVM; 19s local 2025-03-14T06:42:19.5252878Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 18s local ... 2025-03-14T06:42:19.8010817Z 2025-03-14T06:42:19.8011706Z  2025-03-14T06:42:19.8012223Z  2025-03-14T06:42:19.8012624Z  2025-03-14T06:42:19.8013001Z  2025-03-14T06:42:19.8013434Z  2025-03-14T06:42:19.8013818Z  2025-03-14T06:42:19.8014200Z  2025-03-14T06:42:19.8014603Z  2025-03-14T06:42:19.8015497Z [19,442 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:19.8016481Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T06:42:19.8017371Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T06:42:19.8018067Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:19.8018848Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2025-03-14T06:42:19.8019679Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:42:19.8020507Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 20s local 2025-03-14T06:42:19.8021310Z @llvm-project//mlir:VectorToLLVM; 19s local 2025-03-14T06:42:19.8022145Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 19s local ... 2025-03-14T06:42:20.1260103Z 2025-03-14T06:42:20.1261259Z  2025-03-14T06:42:20.1261766Z  2025-03-14T06:42:20.1262159Z  2025-03-14T06:42:20.1262561Z  2025-03-14T06:42:20.1262931Z  2025-03-14T06:42:20.1263321Z  2025-03-14T06:42:20.1263701Z  2025-03-14T06:42:20.1264094Z  2025-03-14T06:42:20.1265020Z [19,442 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:20.1266315Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T06:42:20.1267420Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 33s local 2025-03-14T06:42:20.1268056Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:20.1268727Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local 2025-03-14T06:42:20.1269464Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:42:20.1270408Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 20s local 2025-03-14T06:42:20.1271243Z @llvm-project//mlir:VectorToLLVM; 19s local 2025-03-14T06:42:20.1272039Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 19s local ... 2025-03-14T06:42:20.5414500Z 2025-03-14T06:42:20.5415331Z  2025-03-14T06:42:20.5415786Z  2025-03-14T06:42:20.5416164Z  2025-03-14T06:42:20.5416510Z  2025-03-14T06:42:20.5416882Z  2025-03-14T06:42:20.5417383Z  2025-03-14T06:42:20.5417885Z  2025-03-14T06:42:20.5418360Z  2025-03-14T06:42:20.5419639Z [19,443 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:20.5420654Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T06:42:20.5421553Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2025-03-14T06:42:20.5422292Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:20.5423063Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2025-03-14T06:42:20.5424329Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:42:20.5425231Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 21s local 2025-03-14T06:42:20.5426069Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T06:42:20.5426890Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 19s local ... 2025-03-14T06:42:20.9292927Z 2025-03-14T06:42:20.9293810Z  2025-03-14T06:42:20.9294328Z  2025-03-14T06:42:20.9294740Z  2025-03-14T06:42:20.9295156Z  2025-03-14T06:42:20.9295584Z  2025-03-14T06:42:20.9295966Z  2025-03-14T06:42:20.9296364Z  2025-03-14T06:42:20.9296746Z  2025-03-14T06:42:20.9297795Z [19,443 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:20.9298756Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T06:42:20.9299561Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2025-03-14T06:42:20.9300289Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:20.9301024Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2025-03-14T06:42:20.9301831Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:42:20.9302632Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 21s local 2025-03-14T06:42:20.9303335Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T06:42:20.9304061Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 20s local ... 2025-03-14T06:42:21.1812108Z 2025-03-14T06:42:21.1812986Z  2025-03-14T06:42:21.1813488Z  2025-03-14T06:42:21.1813863Z  2025-03-14T06:42:21.1814282Z  2025-03-14T06:42:21.1814677Z  2025-03-14T06:42:21.1815083Z  2025-03-14T06:42:21.1815498Z  2025-03-14T06:42:21.1815880Z  2025-03-14T06:42:21.1816856Z [19,444 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:21.1817987Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T06:42:21.1819416Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 34s local 2025-03-14T06:42:21.1820136Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:21.1820899Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local 2025-03-14T06:42:21.1821713Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:42:21.1822527Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 21s local 2025-03-14T06:42:21.1823327Z @llvm-project//mlir:VectorToLLVM; 20s local 2025-03-14T06:42:21.1824169Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 20s local ... 2025-03-14T06:42:21.5299616Z 2025-03-14T06:42:21.5300512Z  2025-03-14T06:42:21.5301065Z  2025-03-14T06:42:21.5301486Z  2025-03-14T06:42:21.5301855Z  2025-03-14T06:42:21.5302222Z  2025-03-14T06:42:21.5302578Z  2025-03-14T06:42:21.5302926Z  2025-03-14T06:42:21.5303300Z  2025-03-14T06:42:21.5304263Z [19,444 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:21.5305618Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T06:42:21.5306572Z @llvm-project//mlir:LLVMToLLVMIRTranslation; 35s local 2025-03-14T06:42:21.5307392Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:21.5308219Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T06:42:21.5309033Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:42:21.5310096Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local 2025-03-14T06:42:21.5310965Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T06:42:21.5311726Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 20s local ... 2025-03-14T06:42:21.7304454Z 2025-03-14T06:42:21.7305313Z  2025-03-14T06:42:21.7305832Z  2025-03-14T06:42:21.7306277Z  2025-03-14T06:42:21.7306659Z  2025-03-14T06:42:21.7307222Z  2025-03-14T06:42:21.7308135Z  2025-03-14T06:42:21.7308566Z  2025-03-14T06:42:21.7309073Z  2025-03-14T06:42:21.7310157Z [19,445 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:21.7311376Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T06:42:21.7312227Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:21.7313013Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T06:42:21.7313875Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:42:21.7314675Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local 2025-03-14T06:42:21.7315469Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T06:42:21.7316243Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 21s local 2025-03-14T06:42:21.7317296Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local ... 2025-03-14T06:42:21.9557884Z 2025-03-14T06:42:21.9558742Z  2025-03-14T06:42:21.9559391Z  2025-03-14T06:42:21.9559852Z  2025-03-14T06:42:21.9560320Z  2025-03-14T06:42:21.9560786Z  2025-03-14T06:42:21.9561150Z  2025-03-14T06:42:21.9561590Z  2025-03-14T06:42:21.9562055Z  2025-03-14T06:42:21.9563009Z [19,446 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:21.9564171Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T06:42:21.9565194Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:21.9566142Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T06:42:21.9567073Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T06:42:21.9567936Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local 2025-03-14T06:42:21.9568690Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T06:42:21.9569391Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 21s local 2025-03-14T06:42:21.9570454Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 20s local ... 2025-03-14T06:42:22.2675306Z 2025-03-14T06:42:22.2676183Z  2025-03-14T06:42:22.2676674Z  2025-03-14T06:42:22.2677091Z  2025-03-14T06:42:22.2677600Z  2025-03-14T06:42:22.2678034Z  2025-03-14T06:42:22.2678421Z  2025-03-14T06:42:22.2678857Z  2025-03-14T06:42:22.2679267Z  2025-03-14T06:42:22.2680227Z [19,447 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:22.2681345Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T06:42:22.2682293Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:22.2683144Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T06:42:22.2683954Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T06:42:22.2684922Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 22s local 2025-03-14T06:42:22.2685735Z @llvm-project//mlir:VectorToLLVM; 21s local 2025-03-14T06:42:22.2686571Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 21s local 2025-03-14T06:42:22.2687649Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local ... 2025-03-14T06:42:22.5325597Z 2025-03-14T06:42:22.5326444Z  2025-03-14T06:42:22.5326905Z  2025-03-14T06:42:22.5327301Z  2025-03-14T06:42:22.5327665Z  2025-03-14T06:42:22.5328057Z  2025-03-14T06:42:22.5328418Z  2025-03-14T06:42:22.5329074Z  2025-03-14T06:42:22.5329456Z  2025-03-14T06:42:22.5330371Z [19,447 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:22.5331430Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T06:42:22.5332102Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:22.5332727Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2025-03-14T06:42:22.5333430Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T06:42:22.5334522Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local 2025-03-14T06:42:22.5335398Z @llvm-project//mlir:VectorToLLVM; 22s local 2025-03-14T06:42:22.5336136Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 21s local 2025-03-14T06:42:22.5337151Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local ... 2025-03-14T06:42:22.7880034Z 2025-03-14T06:42:22.7880814Z  2025-03-14T06:42:22.7881250Z  2025-03-14T06:42:22.7881638Z  2025-03-14T06:42:22.7882007Z  2025-03-14T06:42:22.7882378Z  2025-03-14T06:42:22.7882758Z  2025-03-14T06:42:22.7883126Z  2025-03-14T06:42:22.7883497Z  2025-03-14T06:42:22.7884382Z [19,449 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:22.7885529Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T06:42:22.7886252Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:22.7886991Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2025-03-14T06:42:22.7896762Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T06:42:22.7897827Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local 2025-03-14T06:42:22.7898604Z @llvm-project//mlir:VectorToLLVM; 22s local 2025-03-14T06:42:22.7899335Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 22s local 2025-03-14T06:42:22.7900308Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 21s local ... 2025-03-14T06:42:23.1339026Z 2025-03-14T06:42:23.1339832Z  2025-03-14T06:42:23.1340281Z  2025-03-14T06:42:23.1340647Z  2025-03-14T06:42:23.1341014Z  2025-03-14T06:42:23.1341383Z  2025-03-14T06:42:23.1341749Z  2025-03-14T06:42:23.1342114Z  2025-03-14T06:42:23.1342494Z  2025-03-14T06:42:23.1343322Z [19,449 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:23.1344569Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T06:42:23.1345270Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:23.1345981Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2025-03-14T06:42:23.1346741Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T06:42:23.1347475Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local 2025-03-14T06:42:23.1348168Z @llvm-project//mlir:VectorToLLVM; 22s local 2025-03-14T06:42:23.1348867Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 22s local 2025-03-14T06:42:23.1349914Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local ... 2025-03-14T06:42:23.4356891Z 2025-03-14T06:42:23.4357704Z  2025-03-14T06:42:23.4358169Z  2025-03-14T06:42:23.4358581Z  2025-03-14T06:42:23.4358958Z  2025-03-14T06:42:23.4359360Z  2025-03-14T06:42:23.4359778Z  2025-03-14T06:42:23.4360175Z  2025-03-14T06:42:23.4360590Z  2025-03-14T06:42:23.4361508Z [19,450 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:23.4362627Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T06:42:23.4363460Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:23.4364252Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T06:42:23.4365496Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T06:42:23.4366755Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 23s local 2025-03-14T06:42:23.4367462Z @llvm-project//mlir:VectorToLLVM; 22s local 2025-03-14T06:42:23.4368139Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 22s local 2025-03-14T06:42:23.4369137Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local ... 2025-03-14T06:42:23.7354850Z 2025-03-14T06:42:23.7356318Z  2025-03-14T06:42:23.7357084Z  2025-03-14T06:42:23.7357726Z  2025-03-14T06:42:23.7358534Z  2025-03-14T06:42:23.7358973Z  2025-03-14T06:42:23.7359425Z  2025-03-14T06:42:23.7359872Z  2025-03-14T06:42:23.7360293Z  2025-03-14T06:42:23.7361152Z [19,450 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:23.7362188Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T06:42:23.7362944Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:23.7363761Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T06:42:23.7364853Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T06:42:23.7365959Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local 2025-03-14T06:42:23.7366920Z @llvm-project//mlir:VectorToLLVM; 23s local 2025-03-14T06:42:23.7367676Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 23s local 2025-03-14T06:42:23.7368720Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local ... 2025-03-14T06:42:23.9361166Z 2025-03-14T06:42:23.9362114Z  2025-03-14T06:42:23.9362660Z  2025-03-14T06:42:23.9363109Z  2025-03-14T06:42:23.9363553Z  2025-03-14T06:42:23.9363944Z  2025-03-14T06:42:23.9364318Z  2025-03-14T06:42:23.9364847Z  2025-03-14T06:42:23.9365240Z  2025-03-14T06:42:23.9366463Z [19,451 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:23.9367558Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T06:42:23.9368364Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:23.9369158Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T06:42:23.9369972Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T06:42:23.9370751Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 24s local 2025-03-14T06:42:23.9371575Z @llvm-project//mlir:VectorToLLVM; 23s local 2025-03-14T06:42:23.9372346Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 23s local 2025-03-14T06:42:23.9373720Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 22s local ... 2025-03-14T06:42:24.5096292Z 2025-03-14T06:42:24.5097224Z  2025-03-14T06:42:24.5097785Z  2025-03-14T06:42:24.5098230Z  2025-03-14T06:42:24.5098672Z  2025-03-14T06:42:24.5099117Z  2025-03-14T06:42:24.5099486Z  2025-03-14T06:42:24.5099870Z  2025-03-14T06:42:24.5100245Z  2025-03-14T06:42:24.5101453Z [19,452 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:24.5102576Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T06:42:24.5103319Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:24.5104106Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T06:42:24.5104981Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T06:42:24.5105777Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local 2025-03-14T06:42:24.5106604Z @llvm-project//mlir:VectorToLLVM; 23s local 2025-03-14T06:42:24.5107364Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 23s local 2025-03-14T06:42:24.5108422Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local ... 2025-03-14T06:42:24.7383433Z 2025-03-14T06:42:24.7384304Z  2025-03-14T06:42:24.7384854Z  2025-03-14T06:42:24.7385309Z  2025-03-14T06:42:24.7385756Z  2025-03-14T06:42:24.7386462Z  2025-03-14T06:42:24.7386832Z  2025-03-14T06:42:24.7387193Z  2025-03-14T06:42:24.7387545Z  2025-03-14T06:42:24.7388367Z [19,453 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:24.7389308Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T06:42:24.7390006Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:24.7390689Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T06:42:24.7391657Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T06:42:24.7392409Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 25s local 2025-03-14T06:42:24.7393164Z @llvm-project//mlir:VectorToLLVM; 24s local 2025-03-14T06:42:24.7393930Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 24s local 2025-03-14T06:42:24.7394880Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 23s local ... 2025-03-14T06:42:25.6819293Z 2025-03-14T06:42:25.6820180Z  2025-03-14T06:42:25.6820643Z  2025-03-14T06:42:25.6821096Z  2025-03-14T06:42:25.6821564Z  2025-03-14T06:42:25.6821933Z  2025-03-14T06:42:25.6822421Z  2025-03-14T06:42:25.6822970Z  2025-03-14T06:42:25.6823518Z  2025-03-14T06:42:25.6824782Z [19,454 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:25.6826283Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T06:42:25.6827389Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:25.6828465Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T06:42:25.6829632Z @llvm-project//mlir:LinalgTransforms; 30s local 2025-03-14T06:42:25.6830792Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local 2025-03-14T06:42:25.6831924Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T06:42:25.6833020Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T06:42:25.6834529Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local ... 2025-03-14T06:42:25.9416348Z 2025-03-14T06:42:25.9417425Z  2025-03-14T06:42:25.9417855Z  2025-03-14T06:42:25.9418181Z  2025-03-14T06:42:25.9418510Z  2025-03-14T06:42:25.9418826Z  2025-03-14T06:42:25.9419145Z  2025-03-14T06:42:25.9419467Z  2025-03-14T06:42:25.9419899Z  2025-03-14T06:42:25.9421187Z [19,455 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:25.9422302Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T06:42:25.9423056Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:25.9423951Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T06:42:25.9424843Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T06:42:25.9425595Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local 2025-03-14T06:42:25.9426307Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T06:42:25.9427258Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T06:42:25.9428362Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 24s local ... 2025-03-14T06:42:26.1423258Z 2025-03-14T06:42:26.1424129Z  2025-03-14T06:42:26.1424602Z  2025-03-14T06:42:26.1424998Z  2025-03-14T06:42:26.1425388Z  2025-03-14T06:42:26.1425805Z  2025-03-14T06:42:26.1426198Z  2025-03-14T06:42:26.1426606Z  2025-03-14T06:42:26.1427009Z  2025-03-14T06:42:26.1427917Z [19,456 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:26.1428991Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T06:42:26.1429684Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:26.1430622Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T06:42:26.1432015Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T06:42:26.1432954Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 26s local 2025-03-14T06:42:26.1433746Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T06:42:26.1434483Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T06:42:26.1435478Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local ... 2025-03-14T06:42:26.5074415Z 2025-03-14T06:42:26.5075628Z  2025-03-14T06:42:26.5076152Z  2025-03-14T06:42:26.5076597Z  2025-03-14T06:42:26.5077061Z  2025-03-14T06:42:26.5077496Z  2025-03-14T06:42:26.5077888Z  2025-03-14T06:42:26.5078276Z  2025-03-14T06:42:26.5078655Z  2025-03-14T06:42:26.5079581Z [19,458 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:26.5080583Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T06:42:26.5081349Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:26.5082099Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T06:42:26.5082970Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T06:42:26.5083807Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2025-03-14T06:42:26.5084816Z @llvm-project//mlir:VectorToLLVM; 25s local 2025-03-14T06:42:26.5085612Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T06:42:26.5086673Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local ... 2025-03-14T06:42:26.7438963Z 2025-03-14T06:42:26.7439860Z  2025-03-14T06:42:26.7440334Z  2025-03-14T06:42:26.7440735Z  2025-03-14T06:42:26.7441135Z  2025-03-14T06:42:26.7441550Z  2025-03-14T06:42:26.7441937Z  2025-03-14T06:42:26.7442309Z  2025-03-14T06:42:26.7442688Z  2025-03-14T06:42:26.7443629Z [19,458 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:26.7444836Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T06:42:26.7445609Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:26.7446366Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T06:42:26.7447244Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T06:42:26.7448035Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2025-03-14T06:42:26.7448849Z @llvm-project//mlir:VectorToLLVM; 26s local 2025-03-14T06:42:26.7449926Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 26s local 2025-03-14T06:42:26.7450858Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 25s local ... 2025-03-14T06:42:27.3209004Z 2025-03-14T06:42:27.3209942Z  2025-03-14T06:42:27.3210438Z  2025-03-14T06:42:27.3210827Z  2025-03-14T06:42:27.3211212Z  2025-03-14T06:42:27.3211605Z  2025-03-14T06:42:27.3212055Z  2025-03-14T06:42:27.3212455Z  2025-03-14T06:42:27.3212836Z  2025-03-14T06:42:27.3213986Z [19,459 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:27.3215063Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T06:42:27.3215867Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:27.3216607Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T06:42:27.3217482Z @llvm-project//mlir:LinalgTransforms; 32s local 2025-03-14T06:42:27.3218264Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 27s local 2025-03-14T06:42:27.3219073Z @llvm-project//mlir:VectorToLLVM; 26s local 2025-03-14T06:42:27.3219837Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 26s local 2025-03-14T06:42:27.3220861Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local ... 2025-03-14T06:42:27.5459759Z 2025-03-14T06:42:27.5460719Z  2025-03-14T06:42:27.5461583Z  2025-03-14T06:42:27.5462012Z  2025-03-14T06:42:27.5462488Z  2025-03-14T06:42:27.5462899Z  2025-03-14T06:42:27.5463252Z  2025-03-14T06:42:27.5463605Z  2025-03-14T06:42:27.5463936Z  2025-03-14T06:42:27.5464738Z [19,459 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:27.5465903Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T06:42:27.5466757Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:27.5467430Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T06:42:27.5468151Z @llvm-project//mlir:LinalgTransforms; 32s local 2025-03-14T06:42:27.5468870Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local 2025-03-14T06:42:27.5469549Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T06:42:27.5470229Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 27s local 2025-03-14T06:42:27.5471141Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local ... 2025-03-14T06:42:27.9667677Z 2025-03-14T06:42:27.9668668Z  2025-03-14T06:42:27.9669191Z  2025-03-14T06:42:27.9669628Z  2025-03-14T06:42:27.9670057Z  2025-03-14T06:42:27.9670528Z  2025-03-14T06:42:27.9670899Z  2025-03-14T06:42:27.9671225Z  2025-03-14T06:42:27.9671548Z  2025-03-14T06:42:27.9672302Z [19,460 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:27.9673220Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T06:42:27.9673869Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:27.9674520Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T06:42:27.9675227Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T06:42:27.9675912Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local 2025-03-14T06:42:27.9676590Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T06:42:27.9677354Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 26s local 2025-03-14T06:42:27.9678267Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 24s local ... 2025-03-14T06:42:28.3483318Z 2025-03-14T06:42:28.3484148Z  2025-03-14T06:42:28.3484752Z  2025-03-14T06:42:28.3485147Z  2025-03-14T06:42:28.3485521Z  2025-03-14T06:42:28.3485895Z  2025-03-14T06:42:28.3486303Z  2025-03-14T06:42:28.3486693Z  2025-03-14T06:42:28.3487047Z  2025-03-14T06:42:28.3488201Z [19,462 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:28.3489295Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T06:42:28.3490051Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:28.3490750Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T06:42:28.3491568Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T06:42:28.3492577Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 28s local 2025-03-14T06:42:28.3493389Z @llvm-project//mlir:VectorToLLVM; 27s local 2025-03-14T06:42:28.3494213Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2025-03-14T06:42:28.3495274Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 24s local ... 2025-03-14T06:42:28.6541093Z 2025-03-14T06:42:28.6542000Z  2025-03-14T06:42:28.6542445Z  2025-03-14T06:42:28.6542805Z  2025-03-14T06:42:28.6543154Z  2025-03-14T06:42:28.6543503Z  2025-03-14T06:42:28.6543874Z  2025-03-14T06:42:28.6544218Z  2025-03-14T06:42:28.6544572Z  2025-03-14T06:42:28.6545400Z [19,463 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:28.6546321Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T06:42:28.6546993Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:28.6548142Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T06:42:28.6548895Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T06:42:28.6549625Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T06:42:28.6550301Z @llvm-project//mlir:VectorToLLVM; 28s local 2025-03-14T06:42:28.6551120Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2025-03-14T06:42:28.6552223Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local ... 2025-03-14T06:42:28.9497533Z 2025-03-14T06:42:28.9498407Z  2025-03-14T06:42:28.9498929Z  2025-03-14T06:42:28.9499358Z  2025-03-14T06:42:28.9499751Z  2025-03-14T06:42:28.9500125Z  2025-03-14T06:42:28.9500523Z  2025-03-14T06:42:28.9500934Z  2025-03-14T06:42:28.9501338Z  2025-03-14T06:42:28.9502339Z [19,464 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:28.9503548Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T06:42:28.9504304Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:28.9505055Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T06:42:28.9505912Z @llvm-project//mlir:LinalgTransforms; 34s local 2025-03-14T06:42:28.9506701Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T06:42:28.9507569Z @llvm-project//mlir:VectorToLLVM; 28s local 2025-03-14T06:42:29.2536191Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 27s local 2025-03-14T06:42:29.2537402Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local ... 2025-03-14T06:42:29.2538185Z 2025-03-14T06:42:29.2538637Z  2025-03-14T06:42:29.2539034Z  2025-03-14T06:42:29.2539456Z  2025-03-14T06:42:29.2539857Z  2025-03-14T06:42:29.2540218Z  2025-03-14T06:42:29.2540597Z  2025-03-14T06:42:29.2540994Z  2025-03-14T06:42:29.2541352Z  2025-03-14T06:42:29.2542276Z [19,465 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:29.2543325Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T06:42:29.2544091Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:29.2544870Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T06:42:29.2545782Z @llvm-project//mlir:LinalgTransforms; 34s local 2025-03-14T06:42:29.2546874Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 29s local 2025-03-14T06:42:29.2547722Z @llvm-project//mlir:VectorToLLVM; 28s local 2025-03-14T06:42:29.2548617Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2025-03-14T06:42:29.2550293Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 25s local ... 2025-03-14T06:42:29.5174256Z 2025-03-14T06:42:29.5175170Z  2025-03-14T06:42:29.5175714Z  2025-03-14T06:42:29.5176132Z  2025-03-14T06:42:29.5176544Z  2025-03-14T06:42:29.5177167Z  2025-03-14T06:42:29.5177590Z  2025-03-14T06:42:29.5177995Z  2025-03-14T06:42:29.5178402Z  2025-03-14T06:42:29.5179319Z [19,467 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:29.5180412Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T06:42:29.5181281Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:29.5182089Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T06:42:29.5182972Z @llvm-project//mlir:LinalgTransforms; 34s local 2025-03-14T06:42:29.5183854Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T06:42:29.5188826Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2025-03-14T06:42:29.5190065Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local 2025-03-14T06:42:29.5191119Z @stablehlo//:linalg_passes; 25s local ... 2025-03-14T06:42:29.7524228Z 2025-03-14T06:42:29.7525301Z  2025-03-14T06:42:29.7525821Z  2025-03-14T06:42:29.7526247Z  2025-03-14T06:42:29.7526653Z  2025-03-14T06:42:29.7527079Z  2025-03-14T06:42:29.7527510Z  2025-03-14T06:42:29.7527929Z  2025-03-14T06:42:29.7528360Z  2025-03-14T06:42:29.7529360Z [19,468 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:29.7530790Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T06:42:29.7531633Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:29.7532440Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T06:42:29.7533344Z @llvm-project//mlir:LinalgTransforms; 34s local 2025-03-14T06:42:29.7534196Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T06:42:29.7535307Z Compiling llvm/lib/CodeGen/SelectionDAG/TargetLowering.cpp; 28s local 2025-03-14T06:42:29.7536473Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local 2025-03-14T06:42:29.7537360Z @stablehlo//:linalg_passes; 25s local ... 2025-03-14T06:42:30.1534920Z 2025-03-14T06:42:30.1535699Z  2025-03-14T06:42:30.1536116Z  2025-03-14T06:42:30.1536464Z  2025-03-14T06:42:30.1536813Z  2025-03-14T06:42:30.1537157Z  2025-03-14T06:42:30.1537498Z  2025-03-14T06:42:30.1537870Z  2025-03-14T06:42:30.1538214Z  2025-03-14T06:42:30.1539041Z [19,471 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:30.1539978Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T06:42:30.1540702Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:30.1541382Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T06:42:30.1542126Z @llvm-project//mlir:LinalgTransforms; 35s local 2025-03-14T06:42:30.1542869Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 30s local 2025-03-14T06:42:30.1543717Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 26s local 2025-03-14T06:42:30.1544434Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:42:30.1545177Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 23s local ... 2025-03-14T06:42:30.6137968Z 2025-03-14T06:42:30.6138843Z  2025-03-14T06:42:30.6139336Z  2025-03-14T06:42:30.6139777Z  2025-03-14T06:42:30.6140177Z  2025-03-14T06:42:30.6140868Z  2025-03-14T06:42:30.6141285Z  2025-03-14T06:42:30.6141643Z  2025-03-14T06:42:30.6142026Z  2025-03-14T06:42:30.6142924Z [19,472 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:30.6143817Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:30.6144606Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T06:42:30.6145486Z @llvm-project//mlir:LinalgTransforms; 35s local 2025-03-14T06:42:30.6146536Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T06:42:30.6147527Z Compiling xla/mlir_hlo/transforms/generic_host_to_llvm.cc; 27s local 2025-03-14T06:42:30.6148383Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:30.6149139Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local 2025-03-14T06:42:30.6150210Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local ... 2025-03-14T06:42:30.8212281Z 2025-03-14T06:42:30.8213167Z  2025-03-14T06:42:30.8213652Z  2025-03-14T06:42:30.8214015Z  2025-03-14T06:42:30.8214398Z  2025-03-14T06:42:30.8214786Z  2025-03-14T06:42:30.8215216Z  2025-03-14T06:42:30.8215633Z  2025-03-14T06:42:30.8216056Z  2025-03-14T06:42:30.8216959Z [19,474 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:30.8217983Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:30.8218675Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T06:42:30.8219479Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T06:42:30.8220313Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T06:42:30.8221089Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:30.8221924Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local 2025-03-14T06:42:30.8223191Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2025-03-14T06:42:30.8224226Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local ... 2025-03-14T06:42:31.0251867Z 2025-03-14T06:42:31.0252712Z  2025-03-14T06:42:31.0253162Z  2025-03-14T06:42:31.0253528Z  2025-03-14T06:42:31.0253949Z  2025-03-14T06:42:31.0254333Z  2025-03-14T06:42:31.0254732Z  2025-03-14T06:42:31.0255135Z  2025-03-14T06:42:31.0255565Z  2025-03-14T06:42:31.0256644Z [19,477 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:31.0257507Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:31.0258289Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T06:42:31.0259155Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T06:42:31.0260012Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T06:42:31.0260806Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:31.0261611Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 24s local 2025-03-14T06:42:31.0262648Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2025-03-14T06:42:31.0263705Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 21s local ... 2025-03-14T06:42:31.2738335Z 2025-03-14T06:42:31.2739234Z  2025-03-14T06:42:31.2739701Z  2025-03-14T06:42:31.2740095Z  2025-03-14T06:42:31.2740531Z  2025-03-14T06:42:31.2740936Z  2025-03-14T06:42:31.2741334Z  2025-03-14T06:42:31.2741748Z  2025-03-14T06:42:31.2742145Z  2025-03-14T06:42:31.2743035Z [19,478 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:31.2743949Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:31.2744729Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T06:42:31.2745604Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T06:42:31.2746778Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 31s local 2025-03-14T06:42:31.2747567Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:31.2748496Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local 2025-03-14T06:42:31.2749572Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T06:42:31.2750679Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local ... 2025-03-14T06:42:31.5572675Z 2025-03-14T06:42:31.5573505Z  2025-03-14T06:42:31.5574014Z  2025-03-14T06:42:31.5574690Z  2025-03-14T06:42:31.5575131Z  2025-03-14T06:42:31.5575577Z  2025-03-14T06:42:31.5575990Z  2025-03-14T06:42:31.5576360Z  2025-03-14T06:42:31.5576750Z  2025-03-14T06:42:31.5577718Z [19,479 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:31.5578640Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:31.5579403Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T06:42:31.5580248Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T06:42:31.5581079Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T06:42:31.5581856Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:31.5582571Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local 2025-03-14T06:42:31.5583456Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T06:42:31.5584653Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local ... 2025-03-14T06:42:31.9612801Z 2025-03-14T06:42:31.9613689Z  2025-03-14T06:42:31.9614192Z  2025-03-14T06:42:31.9614600Z  2025-03-14T06:42:31.9615002Z  2025-03-14T06:42:31.9615417Z  2025-03-14T06:42:31.9615840Z  2025-03-14T06:42:31.9616236Z  2025-03-14T06:42:31.9616622Z  2025-03-14T06:42:31.9617906Z [19,480 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:31.9618882Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:31.9619689Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T06:42:31.9620584Z @llvm-project//mlir:LinalgTransforms; 37s local 2025-03-14T06:42:31.9621469Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T06:42:31.9622434Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:31.9623314Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 25s local 2025-03-14T06:42:31.9624423Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T06:42:31.9625516Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 22s local ... 2025-03-14T06:42:32.3580213Z 2025-03-14T06:42:32.3581058Z  2025-03-14T06:42:32.3581452Z  2025-03-14T06:42:32.3581819Z  2025-03-14T06:42:32.3582174Z  2025-03-14T06:42:32.3582566Z  2025-03-14T06:42:32.3582925Z  2025-03-14T06:42:32.3583290Z  2025-03-14T06:42:32.3583648Z  2025-03-14T06:42:32.3584512Z [19,480 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:32.3585360Z @stablehlo//:linalg_passes; 39s local 2025-03-14T06:42:32.3586085Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T06:42:32.3586871Z @llvm-project//mlir:LinalgTransforms; 37s local 2025-03-14T06:42:32.3587657Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 32s local 2025-03-14T06:42:32.3588390Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:32.3589156Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 26s local 2025-03-14T06:42:32.3590124Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2025-03-14T06:42:32.3591060Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 23s local ... 2025-03-14T06:42:33.3589255Z 2025-03-14T06:42:33.3590069Z  2025-03-14T06:42:33.3590539Z  2025-03-14T06:42:33.3591187Z  2025-03-14T06:42:33.3591583Z  2025-03-14T06:42:33.3591958Z  2025-03-14T06:42:33.3592334Z  2025-03-14T06:42:33.3592723Z  2025-03-14T06:42:33.3593114Z  2025-03-14T06:42:33.3594044Z [19,480 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:33.3594941Z @stablehlo//:linalg_passes; 40s local 2025-03-14T06:42:33.3595740Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2025-03-14T06:42:33.3596778Z @llvm-project//mlir:LinalgTransforms; 38s local 2025-03-14T06:42:33.3597596Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 33s local 2025-03-14T06:42:33.3598365Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:33.3599031Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2025-03-14T06:42:33.3599958Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2025-03-14T06:42:33.3601050Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local ... 2025-03-14T06:42:33.7591994Z 2025-03-14T06:42:33.7592851Z  2025-03-14T06:42:33.7593377Z  2025-03-14T06:42:33.7593750Z  2025-03-14T06:42:33.7594128Z  2025-03-14T06:42:33.7594534Z  2025-03-14T06:42:33.7594928Z  2025-03-14T06:42:33.7595314Z  2025-03-14T06:42:33.7595702Z  2025-03-14T06:42:33.7596659Z [19,482 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:33.7597890Z @stablehlo//:linalg_passes; 41s local 2025-03-14T06:42:33.7598639Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T06:42:33.7599469Z @llvm-project//mlir:LinalgTransforms; 38s local 2025-03-14T06:42:33.7600314Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T06:42:33.7601082Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:33.7602102Z Compiling mlir/lib/Target/LLVMIR/ModuleTranslation.cpp; 27s local 2025-03-14T06:42:33.7603131Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2025-03-14T06:42:33.7604193Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 24s local ... 2025-03-14T06:42:34.2266086Z 2025-03-14T06:42:34.2266949Z  2025-03-14T06:42:34.2267421Z  2025-03-14T06:42:34.2267792Z  2025-03-14T06:42:34.2268203Z  2025-03-14T06:42:34.2268601Z  2025-03-14T06:42:34.2269041Z  2025-03-14T06:42:34.2269441Z  2025-03-14T06:42:34.2269842Z  2025-03-14T06:42:34.2270781Z [19,483 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:34.2271716Z @stablehlo//:linalg_passes; 41s local 2025-03-14T06:42:34.2272524Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T06:42:34.2273531Z @llvm-project//mlir:LinalgTransforms; 39s local 2025-03-14T06:42:34.2274375Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 34s local 2025-03-14T06:42:34.2275124Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:34.2275955Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T06:42:34.2277001Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T06:42:34.2278041Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local ... 2025-03-14T06:42:34.5594963Z 2025-03-14T06:42:34.5595887Z  2025-03-14T06:42:34.5596464Z  2025-03-14T06:42:34.5596918Z  2025-03-14T06:42:34.5597360Z  2025-03-14T06:42:34.5597803Z  2025-03-14T06:42:34.5598247Z  2025-03-14T06:42:34.5598616Z  2025-03-14T06:42:34.5598953Z  2025-03-14T06:42:34.5599771Z [19,483 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:34.5600566Z @stablehlo//:linalg_passes; 42s local 2025-03-14T06:42:34.5601247Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T06:42:34.5602182Z @llvm-project//mlir:LinalgTransforms; 39s local 2025-03-14T06:42:34.5602904Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T06:42:34.5603581Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:34.5604274Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T06:42:34.5605264Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T06:42:34.5606098Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local ... 2025-03-14T06:42:35.0514670Z 2025-03-14T06:42:35.0515878Z  2025-03-14T06:42:35.0516451Z  2025-03-14T06:42:35.0516904Z  2025-03-14T06:42:35.0517308Z  2025-03-14T06:42:35.0517764Z  2025-03-14T06:42:35.0518170Z  2025-03-14T06:42:35.0518495Z  2025-03-14T06:42:35.0518829Z  2025-03-14T06:42:35.0519613Z [19,484 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:35.0520385Z @stablehlo//:linalg_passes; 42s local 2025-03-14T06:42:35.0521019Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T06:42:35.0521703Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T06:42:35.0522383Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T06:42:35.0523017Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:35.0523675Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T06:42:35.0524830Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 25s local 2025-03-14T06:42:35.0525626Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local ... 2025-03-14T06:42:35.3601307Z 2025-03-14T06:42:35.3602220Z  2025-03-14T06:42:35.3602759Z  2025-03-14T06:42:35.3603194Z  2025-03-14T06:42:35.3603629Z  2025-03-14T06:42:35.3604042Z  2025-03-14T06:42:35.3604502Z  2025-03-14T06:42:35.3605390Z  2025-03-14T06:42:35.3605799Z  2025-03-14T06:42:35.3606912Z [19,484 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:35.3607908Z @stablehlo//:linalg_passes; 42s local 2025-03-14T06:42:35.3608758Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T06:42:35.3609673Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T06:42:35.3610591Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 35s local 2025-03-14T06:42:35.3611459Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:35.3612363Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T06:42:35.3613461Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T06:42:35.3614537Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local ... 2025-03-14T06:42:35.9270177Z 2025-03-14T06:42:35.9271093Z  2025-03-14T06:42:35.9271643Z  2025-03-14T06:42:35.9272117Z  2025-03-14T06:42:35.9272554Z  2025-03-14T06:42:35.9272987Z  2025-03-14T06:42:35.9273454Z  2025-03-14T06:42:35.9273842Z  2025-03-14T06:42:35.9274204Z  2025-03-14T06:42:35.9275228Z [19,485 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:35.9276178Z @stablehlo//:linalg_passes; 43s local 2025-03-14T06:42:35.9276899Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2025-03-14T06:42:35.9277749Z @llvm-project//mlir:LinalgTransforms; 41s local 2025-03-14T06:42:35.9278573Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T06:42:35.9279331Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:35.9280138Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T06:42:35.9281050Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T06:42:35.9282009Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local ... 2025-03-14T06:42:36.1610353Z 2025-03-14T06:42:36.1611493Z  2025-03-14T06:42:36.1612053Z  2025-03-14T06:42:36.1612477Z  2025-03-14T06:42:36.1612871Z  2025-03-14T06:42:36.1613293Z  2025-03-14T06:42:36.1613701Z  2025-03-14T06:42:36.1614107Z  2025-03-14T06:42:36.1614532Z  2025-03-14T06:42:36.1615502Z [19,486 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:36.1616495Z @stablehlo//:linalg_passes; 43s local 2025-03-14T06:42:36.1617481Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2025-03-14T06:42:36.1618372Z @llvm-project//mlir:LinalgTransforms; 41s local 2025-03-14T06:42:36.1619252Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T06:42:36.1620074Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:36.1620919Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T06:42:36.1621920Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 26s local 2025-03-14T06:42:36.1622875Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local ... 2025-03-14T06:42:36.3610850Z 2025-03-14T06:42:36.3611827Z  2025-03-14T06:42:36.3612374Z  2025-03-14T06:42:36.3613443Z  2025-03-14T06:42:36.3613884Z  2025-03-14T06:42:36.3614327Z  2025-03-14T06:42:36.3614777Z  2025-03-14T06:42:36.3615215Z  2025-03-14T06:42:36.3615951Z  2025-03-14T06:42:36.3616911Z [19,487 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:36.3617835Z @stablehlo//:linalg_passes; 43s local 2025-03-14T06:42:36.3618613Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2025-03-14T06:42:36.3619461Z @llvm-project//mlir:LinalgTransforms; 41s local 2025-03-14T06:42:36.3620288Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 36s local 2025-03-14T06:42:36.3621214Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:36.3622046Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2025-03-14T06:42:36.3623012Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T06:42:36.7044040Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local ... 2025-03-14T06:42:36.7044938Z 2025-03-14T06:42:36.7045427Z  2025-03-14T06:42:36.7045841Z  2025-03-14T06:42:36.7046283Z  2025-03-14T06:42:36.7046762Z  2025-03-14T06:42:36.7047194Z  2025-03-14T06:42:36.7047620Z  2025-03-14T06:42:36.7048038Z  2025-03-14T06:42:36.7048395Z  2025-03-14T06:42:36.7049190Z [19,488 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:36.7050010Z @stablehlo//:linalg_passes; 44s local 2025-03-14T06:42:36.7050688Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T06:42:36.7051438Z @llvm-project//mlir:LinalgTransforms; 41s local 2025-03-14T06:42:36.7052182Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T06:42:36.7052871Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:36.7053609Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2025-03-14T06:42:36.7054501Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T06:42:36.7055413Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local ... 2025-03-14T06:42:36.9615968Z 2025-03-14T06:42:36.9616832Z  2025-03-14T06:42:36.9617387Z  2025-03-14T06:42:36.9617885Z  2025-03-14T06:42:36.9618356Z  2025-03-14T06:42:36.9618771Z  2025-03-14T06:42:36.9619236Z  2025-03-14T06:42:36.9619641Z  2025-03-14T06:42:36.9620021Z  2025-03-14T06:42:36.9620918Z [19,488 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:36.9621810Z @stablehlo//:linalg_passes; 44s local 2025-03-14T06:42:36.9622788Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T06:42:36.9623650Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T06:42:36.9624490Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T06:42:36.9625405Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:36.9626178Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2025-03-14T06:42:36.9627155Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T06:42:36.9628314Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local ... 2025-03-14T06:42:37.1619287Z 2025-03-14T06:42:37.1620186Z  2025-03-14T06:42:37.1620749Z  2025-03-14T06:42:37.1621206Z  2025-03-14T06:42:37.1621660Z  2025-03-14T06:42:37.1622108Z  2025-03-14T06:42:37.1622470Z  2025-03-14T06:42:37.1622857Z  2025-03-14T06:42:37.1623267Z  2025-03-14T06:42:37.1624304Z [19,489 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:37.1625242Z @stablehlo//:linalg_passes; 44s local 2025-03-14T06:42:37.1626020Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T06:42:37.1626883Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T06:42:37.1627736Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 37s local 2025-03-14T06:42:37.1628548Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:37.1629838Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2025-03-14T06:42:37.1630920Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 27s local 2025-03-14T06:42:37.1632102Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local ... 2025-03-14T06:42:37.7649426Z 2025-03-14T06:42:37.7650311Z  2025-03-14T06:42:37.7650876Z  2025-03-14T06:42:37.7651329Z  2025-03-14T06:42:37.7651781Z  2025-03-14T06:42:37.7652468Z  2025-03-14T06:42:37.7652813Z  2025-03-14T06:42:37.7653204Z  2025-03-14T06:42:37.7653754Z  2025-03-14T06:42:37.7654719Z [19,490 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:37.7655695Z @stablehlo//:linalg_passes; 45s local 2025-03-14T06:42:37.7656525Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T06:42:37.7657431Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T06:42:37.7658319Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T06:42:37.7659173Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:37.7660057Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2025-03-14T06:42:37.7661142Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T06:42:37.7662043Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local ... 2025-03-14T06:42:38.1567847Z 2025-03-14T06:42:38.1568773Z  2025-03-14T06:42:38.1569317Z  2025-03-14T06:42:38.1569782Z  2025-03-14T06:42:38.1570222Z  2025-03-14T06:42:38.1570653Z  2025-03-14T06:42:38.1571128Z  2025-03-14T06:42:38.1571509Z  2025-03-14T06:42:38.1571905Z  2025-03-14T06:42:38.1572881Z [19,491 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:38.1573905Z @stablehlo//:linalg_passes; 45s local 2025-03-14T06:42:38.1574763Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T06:42:38.1575673Z @llvm-project//mlir:LinalgTransforms; 43s local 2025-03-14T06:42:38.1576581Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T06:42:38.1577389Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:38.1578265Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2025-03-14T06:42:38.1579217Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 28s local 2025-03-14T06:42:38.1580455Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local ... 2025-03-14T06:42:38.3585893Z 2025-03-14T06:42:38.3586696Z  2025-03-14T06:42:38.3587178Z  2025-03-14T06:42:38.3587571Z  2025-03-14T06:42:38.3587972Z  2025-03-14T06:42:38.3588382Z  2025-03-14T06:42:38.3588816Z  2025-03-14T06:42:38.3589225Z  2025-03-14T06:42:38.3589610Z  2025-03-14T06:42:38.3590565Z [19,494 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:42:38.3591960Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T06:42:38.3592848Z @llvm-project//mlir:LinalgTransforms; 43s local 2025-03-14T06:42:38.3593672Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 38s local 2025-03-14T06:42:38.3594466Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:38.3605921Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T06:42:38.3607058Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T06:42:38.3608040Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T06:42:38.3609077Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local ... 2025-03-14T06:42:38.5628499Z 2025-03-14T06:42:38.5629446Z  2025-03-14T06:42:38.5629978Z  2025-03-14T06:42:38.5631131Z  2025-03-14T06:42:38.5631567Z  2025-03-14T06:42:38.5632004Z  2025-03-14T06:42:38.5632777Z  2025-03-14T06:42:38.5633215Z  2025-03-14T06:42:38.5633607Z  2025-03-14T06:42:38.5634568Z [19,495 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:38.5635627Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T06:42:38.5636474Z @llvm-project//mlir:LinalgTransforms; 43s local 2025-03-14T06:42:38.5637296Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T06:42:38.5638258Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:38.5639083Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T06:42:38.5640057Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T06:42:38.5640996Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T06:42:38.5641967Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local ... 2025-03-14T06:42:38.7631721Z 2025-03-14T06:42:38.7632705Z  2025-03-14T06:42:38.7633237Z  2025-03-14T06:42:38.7634392Z  2025-03-14T06:42:38.7634852Z  2025-03-14T06:42:38.7635287Z  2025-03-14T06:42:38.7635733Z  2025-03-14T06:42:38.7636170Z  2025-03-14T06:42:38.7636608Z  2025-03-14T06:42:38.7637610Z [19,496 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:38.7638850Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T06:42:38.7639805Z @llvm-project//mlir:LinalgTransforms; 43s local 2025-03-14T06:42:38.7640624Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T06:42:38.7641366Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:38.7642193Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T06:42:38.7643275Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T06:42:38.7644422Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T06:42:38.7645746Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local ... 2025-03-14T06:42:39.1634899Z 2025-03-14T06:42:39.1636029Z  2025-03-14T06:42:39.1636556Z  2025-03-14T06:42:39.1636987Z  2025-03-14T06:42:39.1637427Z  2025-03-14T06:42:39.1637812Z  2025-03-14T06:42:39.1638245Z  2025-03-14T06:42:39.1638690Z  2025-03-14T06:42:39.1639119Z  2025-03-14T06:42:39.1640343Z [19,497 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:39.1641264Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T06:42:39.1642012Z @llvm-project//mlir:LinalgTransforms; 44s local 2025-03-14T06:42:39.1642811Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T06:42:39.1643533Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:39.1644294Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T06:42:39.1645339Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 29s local 2025-03-14T06:42:39.1646160Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T06:42:39.1647071Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local ... 2025-03-14T06:42:39.3638380Z 2025-03-14T06:42:39.3639719Z  2025-03-14T06:42:39.3640241Z  2025-03-14T06:42:39.3640685Z  2025-03-14T06:42:39.3641134Z  2025-03-14T06:42:39.3641537Z  2025-03-14T06:42:39.3641885Z  2025-03-14T06:42:39.3642271Z  2025-03-14T06:42:39.3642641Z  2025-03-14T06:42:39.3643516Z [19,499 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:39.3644547Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T06:42:39.3645474Z @llvm-project//mlir:LinalgTransforms; 44s local 2025-03-14T06:42:39.3646220Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 39s local 2025-03-14T06:42:39.3647197Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:39.3647959Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T06:42:39.3648917Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T06:42:39.3649834Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T06:42:39.3650736Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local ... 2025-03-14T06:42:39.7644517Z 2025-03-14T06:42:39.7645534Z  2025-03-14T06:42:39.7646130Z  2025-03-14T06:42:39.7646581Z  2025-03-14T06:42:39.7647018Z  2025-03-14T06:42:39.7647446Z  2025-03-14T06:42:39.7647912Z  2025-03-14T06:42:39.7648289Z  2025-03-14T06:42:39.7648642Z  2025-03-14T06:42:39.7649546Z [19,500 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:39.7650609Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T06:42:39.7651591Z @llvm-project//mlir:LinalgTransforms; 44s local 2025-03-14T06:42:39.7652412Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2025-03-14T06:42:39.7653198Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:39.7653973Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T06:42:39.7654872Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 30s local 2025-03-14T06:42:39.7655774Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2025-03-14T06:42:39.7656722Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local ... 2025-03-14T06:42:40.2527224Z 2025-03-14T06:42:40.2528105Z  2025-03-14T06:42:40.2528658Z  2025-03-14T06:42:40.2529107Z  2025-03-14T06:42:40.2529668Z  2025-03-14T06:42:40.2530079Z  2025-03-14T06:42:40.2530433Z  2025-03-14T06:42:40.2530786Z  2025-03-14T06:42:40.2531136Z  2025-03-14T06:42:40.2532079Z [19,501 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:40.2533103Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T06:42:40.2533891Z @llvm-project//mlir:LinalgTransforms; 45s local 2025-03-14T06:42:40.2534656Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 40s local 2025-03-14T06:42:40.2535404Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:40.2536211Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2025-03-14T06:42:40.2537485Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T06:42:40.2538368Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2025-03-14T06:42:40.2539283Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local ... 2025-03-14T06:42:40.5651548Z 2025-03-14T06:42:40.5652460Z  2025-03-14T06:42:40.5652998Z  2025-03-14T06:42:40.5653439Z  2025-03-14T06:42:40.5653916Z  2025-03-14T06:42:40.5654323Z  2025-03-14T06:42:40.5654704Z  2025-03-14T06:42:40.5655453Z  2025-03-14T06:42:40.5655843Z  2025-03-14T06:42:40.5656804Z [19,503 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:40.5657928Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T06:42:40.5658778Z @llvm-project//mlir:LinalgTransforms; 45s local 2025-03-14T06:42:40.5659634Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T06:42:40.5660383Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:40.5661153Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2025-03-14T06:42:40.5662139Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T06:42:40.5663105Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T06:42:40.5663844Z @stablehlo//:linalg_passes; 21s local ... 2025-03-14T06:42:40.8887274Z 2025-03-14T06:42:40.8888268Z  2025-03-14T06:42:40.8888829Z  2025-03-14T06:42:40.8889327Z  2025-03-14T06:42:40.8889775Z  2025-03-14T06:42:40.8890212Z  2025-03-14T06:42:40.8890556Z  2025-03-14T06:42:40.8890939Z  2025-03-14T06:42:40.8891318Z  2025-03-14T06:42:40.8892227Z [19,504 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:40.8893547Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T06:42:40.8894396Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T06:42:40.8895219Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T06:42:40.8896007Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:40.8896794Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2025-03-14T06:42:40.8897908Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T06:42:40.8898859Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T06:42:40.8899689Z @stablehlo//:linalg_passes; 22s local ... 2025-03-14T06:42:41.1655960Z 2025-03-14T06:42:41.1656830Z  2025-03-14T06:42:41.1657351Z  2025-03-14T06:42:41.1657794Z  2025-03-14T06:42:41.1658230Z  2025-03-14T06:42:41.1658649Z  2025-03-14T06:42:41.1659055Z  2025-03-14T06:42:41.1659475Z  2025-03-14T06:42:41.1659877Z  2025-03-14T06:42:41.1660906Z [19,504 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:41.1662101Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T06:42:41.1663035Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T06:42:41.1663954Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T06:42:41.1664820Z @stablehlo//:linalg_passes; 36s local 2025-03-14T06:42:41.1665921Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2025-03-14T06:42:41.1667046Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 31s local 2025-03-14T06:42:41.1668091Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T06:42:41.1668974Z @stablehlo//:linalg_passes; 22s local ... 2025-03-14T06:42:41.3659124Z 2025-03-14T06:42:41.3660073Z  2025-03-14T06:42:41.3660598Z  2025-03-14T06:42:41.3661800Z  2025-03-14T06:42:41.3662237Z  2025-03-14T06:42:41.3662686Z  2025-03-14T06:42:41.3663111Z  2025-03-14T06:42:41.3663791Z  2025-03-14T06:42:41.3664222Z  2025-03-14T06:42:41.3665217Z [19,505 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:41.3666769Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T06:42:41.3667657Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T06:42:41.3668476Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 41s local 2025-03-14T06:42:41.3669240Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:41.3670241Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2025-03-14T06:42:41.3671273Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T06:42:41.3672224Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T06:42:41.3673048Z @stablehlo//:linalg_passes; 22s local ... 2025-03-14T06:42:41.5890600Z 2025-03-14T06:42:41.5891578Z  2025-03-14T06:42:41.5892116Z  2025-03-14T06:42:41.5893369Z  2025-03-14T06:42:41.5893797Z  2025-03-14T06:42:41.5894241Z  2025-03-14T06:42:41.5894678Z  2025-03-14T06:42:41.5895118Z  2025-03-14T06:42:41.5895558Z  2025-03-14T06:42:41.5896546Z [19,506 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:41.5898268Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T06:42:41.5899647Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T06:42:41.5900556Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T06:42:41.5901350Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:41.5902159Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2025-03-14T06:42:41.5903157Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T06:42:41.5904144Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T06:42:41.5905221Z @stablehlo//:linalg_passes; 22s local ... 2025-03-14T06:42:41.8934532Z 2025-03-14T06:42:41.8935483Z  2025-03-14T06:42:41.8936083Z  2025-03-14T06:42:41.8937281Z  2025-03-14T06:42:41.8937729Z  2025-03-14T06:42:41.8938176Z  2025-03-14T06:42:41.8938608Z  2025-03-14T06:42:41.8939051Z  2025-03-14T06:42:41.8939500Z  2025-03-14T06:42:41.8940471Z [19,508 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:41.8941730Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T06:42:41.8942692Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T06:42:41.8943527Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T06:42:41.8944260Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:41.8945100Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2025-03-14T06:42:41.8945981Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T06:42:41.8946851Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T06:42:41.8947623Z @stablehlo//:linalg_passes; 23s local ... 2025-03-14T06:42:42.0999103Z 2025-03-14T06:42:42.1000044Z  2025-03-14T06:42:42.1000579Z  2025-03-14T06:42:42.1001810Z  2025-03-14T06:42:42.1002256Z  2025-03-14T06:42:42.1002690Z  2025-03-14T06:42:42.1003162Z  2025-03-14T06:42:42.1003593Z  2025-03-14T06:42:42.1004018Z  2025-03-14T06:42:42.1005124Z [19,509 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:42.1006309Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T06:42:42.1007134Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T06:42:42.1007989Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T06:42:42.1008897Z @stablehlo//:linalg_passes; 37s local 2025-03-14T06:42:42.1009949Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2025-03-14T06:42:42.1010860Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 32s local 2025-03-14T06:42:42.1011726Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T06:42:42.1012454Z @stablehlo//:linalg_passes; 23s local ... 2025-03-14T06:42:42.3668830Z 2025-03-14T06:42:42.3669793Z  2025-03-14T06:42:42.3670314Z  2025-03-14T06:42:42.3670722Z  2025-03-14T06:42:42.3671127Z  2025-03-14T06:42:42.3671807Z  2025-03-14T06:42:42.3672200Z  2025-03-14T06:42:42.3672609Z  2025-03-14T06:42:42.3673018Z  2025-03-14T06:42:42.3674002Z [19,509 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:42.3675157Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T06:42:42.3676095Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T06:42:42.3677000Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 42s local 2025-03-14T06:42:42.3677850Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:42.3678845Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T06:42:42.3679875Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2025-03-14T06:42:42.3680853Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T06:42:42.3681841Z @stablehlo//:linalg_passes; 23s local ... 2025-03-14T06:42:42.5672261Z 2025-03-14T06:42:42.5673184Z  2025-03-14T06:42:42.5673671Z  2025-03-14T06:42:42.5674105Z  2025-03-14T06:42:42.5674535Z  2025-03-14T06:42:42.5674959Z  2025-03-14T06:42:42.5675401Z  2025-03-14T06:42:42.5675828Z  2025-03-14T06:42:42.5676241Z  2025-03-14T06:42:42.5677228Z [19,510 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:42.5678654Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T06:42:42.5679591Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T06:42:42.5680516Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T06:42:42.5681371Z @stablehlo//:linalg_passes; 38s local 2025-03-14T06:42:42.5682293Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T06:42:42.5683388Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2025-03-14T06:42:42.5684442Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2025-03-14T06:42:42.5685456Z @stablehlo//:linalg_passes; 23s local ... 2025-03-14T06:42:43.1432100Z 2025-03-14T06:42:43.1432898Z  2025-03-14T06:42:43.1433337Z  2025-03-14T06:42:43.1433701Z  2025-03-14T06:42:43.1434063Z  2025-03-14T06:42:43.1434422Z  2025-03-14T06:42:43.1434773Z  2025-03-14T06:42:43.1435178Z  2025-03-14T06:42:43.1435529Z  2025-03-14T06:42:43.1436387Z [19,511 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:43.1437349Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T06:42:43.1438098Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T06:42:43.1438834Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T06:42:43.1439726Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T06:42:43.1440659Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 33s local 2025-03-14T06:42:43.1441491Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2025-03-14T06:42:43.1442194Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:42:43.1442889Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local ... 2025-03-14T06:42:43.3444136Z 2025-03-14T06:42:43.3445242Z  2025-03-14T06:42:43.3445820Z  2025-03-14T06:42:43.3446259Z  2025-03-14T06:42:43.3446626Z  2025-03-14T06:42:43.3447254Z  2025-03-14T06:42:43.3447678Z  2025-03-14T06:42:43.3448066Z  2025-03-14T06:42:43.3448473Z  2025-03-14T06:42:43.3449423Z [19,512 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:43.3450535Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T06:42:43.3451390Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T06:42:43.3452449Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 43s local 2025-03-14T06:42:43.3453518Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2025-03-14T06:42:43.3454531Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T06:42:43.3455512Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2025-03-14T06:42:43.3456328Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:42:43.3457210Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local ... 2025-03-14T06:42:43.5677640Z 2025-03-14T06:42:43.5678557Z  2025-03-14T06:42:43.5679057Z  2025-03-14T06:42:43.5679436Z  2025-03-14T06:42:43.5679818Z  2025-03-14T06:42:43.5680196Z  2025-03-14T06:42:43.5680590Z  2025-03-14T06:42:43.5681003Z  2025-03-14T06:42:43.5681539Z  2025-03-14T06:42:43.5682463Z [19,512 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:43.5683916Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T06:42:43.5684898Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T06:42:43.5685763Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2025-03-14T06:42:43.5686911Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2025-03-14T06:42:43.5688025Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T06:42:43.5689222Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2025-03-14T06:42:43.5690040Z @stablehlo//:linalg_passes; 24s local 2025-03-14T06:42:43.5690852Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local ... 2025-03-14T06:42:43.7679777Z 2025-03-14T06:42:43.7680762Z  2025-03-14T06:42:43.7681289Z  2025-03-14T06:42:43.7681742Z  2025-03-14T06:42:43.7682172Z  2025-03-14T06:42:43.7682664Z  2025-03-14T06:42:43.7683062Z  2025-03-14T06:42:43.7683497Z  2025-03-14T06:42:43.7683914Z  2025-03-14T06:42:43.7685028Z [19,513 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:43.7686170Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T06:42:43.7687024Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T06:42:43.7687889Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 44s local 2025-03-14T06:42:43.7688940Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2025-03-14T06:42:43.7690119Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 34s local 2025-03-14T06:42:43.7691088Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2025-03-14T06:42:43.7691907Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:42:43.7692718Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local ... 2025-03-14T06:42:44.5133919Z 2025-03-14T06:42:44.5134896Z  2025-03-14T06:42:44.5135458Z  2025-03-14T06:42:44.5135910Z  2025-03-14T06:42:44.5136343Z  2025-03-14T06:42:44.5136802Z  2025-03-14T06:42:44.5137171Z  2025-03-14T06:42:44.5137535Z  2025-03-14T06:42:44.5137914Z  2025-03-14T06:42:44.5138830Z [19,514 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:44.5139899Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T06:42:44.5140804Z @llvm-project//mlir:LinalgTransforms; 49s local 2025-03-14T06:42:44.5141916Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T06:42:44.5142927Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T06:42:44.5143891Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T06:42:44.5144786Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T06:42:44.5145615Z @stablehlo//:linalg_passes; 25s local 2025-03-14T06:42:44.5146326Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local ... 2025-03-14T06:42:44.7686131Z 2025-03-14T06:42:44.7686948Z  2025-03-14T06:42:44.7687432Z  2025-03-14T06:42:44.7687851Z  2025-03-14T06:42:44.7688251Z  2025-03-14T06:42:44.7688650Z  2025-03-14T06:42:44.7689047Z  2025-03-14T06:42:44.7689427Z  2025-03-14T06:42:44.7689822Z  2025-03-14T06:42:44.7690713Z [19,515 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:44.7691808Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T06:42:44.7692663Z @llvm-project//mlir:LinalgTransforms; 49s local 2025-03-14T06:42:44.7693497Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T06:42:44.7694495Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T06:42:44.7695519Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T06:42:44.7696565Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T06:42:44.7697282Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:44.7698186Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local ... 2025-03-14T06:42:44.9690121Z 2025-03-14T06:42:44.9691055Z  2025-03-14T06:42:44.9691597Z  2025-03-14T06:42:44.9693217Z  2025-03-14T06:42:44.9695164Z  2025-03-14T06:42:44.9695769Z  2025-03-14T06:42:44.9696910Z  2025-03-14T06:42:44.9697514Z  2025-03-14T06:42:44.9697978Z  2025-03-14T06:42:44.9699016Z [19,516 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:44.9700185Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T06:42:44.9701130Z @llvm-project//mlir:LinalgTransforms; 50s local 2025-03-14T06:42:44.9702047Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T06:42:44.9702971Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T06:42:44.9703951Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 35s local 2025-03-14T06:42:44.9704839Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T06:42:44.9705594Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:44.9706310Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local ... 2025-03-14T06:42:45.3818887Z 2025-03-14T06:42:45.3819738Z  2025-03-14T06:42:45.3820190Z  2025-03-14T06:42:45.3820584Z  2025-03-14T06:42:45.3820977Z  2025-03-14T06:42:45.3821376Z  2025-03-14T06:42:45.3821740Z  2025-03-14T06:42:45.3822068Z  2025-03-14T06:42:45.3822462Z  2025-03-14T06:42:45.3823449Z [19,517 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:45.3824590Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T06:42:45.3825459Z @llvm-project//mlir:LinalgTransforms; 50s local 2025-03-14T06:42:45.3826300Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 45s local 2025-03-14T06:42:45.3827314Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T06:42:45.3828229Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T06:42:45.3829195Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T06:42:45.3830007Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:45.3831040Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local ... 2025-03-14T06:42:45.7262257Z 2025-03-14T06:42:45.7263161Z  2025-03-14T06:42:45.7263703Z  2025-03-14T06:42:45.7264295Z  2025-03-14T06:42:45.7264703Z  2025-03-14T06:42:45.7265148Z  2025-03-14T06:42:45.7265787Z  2025-03-14T06:42:45.7266224Z  2025-03-14T06:42:45.7266678Z  2025-03-14T06:42:45.7267693Z [19,519 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:45.7268947Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T06:42:45.7269751Z @llvm-project//mlir:LinalgTransforms; 50s local 2025-03-14T06:42:45.7270536Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T06:42:45.7271522Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T06:42:45.7272511Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T06:42:45.7273466Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T06:42:45.7274094Z @stablehlo//:linalg_passes; 26s local 2025-03-14T06:42:45.7274736Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local ... 2025-03-14T06:42:45.9696867Z 2025-03-14T06:42:45.9697731Z  2025-03-14T06:42:45.9698278Z  2025-03-14T06:42:45.9698729Z  2025-03-14T06:42:45.9699162Z  2025-03-14T06:42:45.9699595Z  2025-03-14T06:42:45.9700306Z  2025-03-14T06:42:45.9700725Z  2025-03-14T06:42:45.9701115Z  2025-03-14T06:42:45.9702094Z [19,519 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:45.9703209Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T06:42:45.9704091Z @llvm-project//mlir:LinalgTransforms; 51s local 2025-03-14T06:42:45.9704905Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 46s local 2025-03-14T06:42:45.9705835Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T06:42:45.9706637Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 36s local 2025-03-14T06:42:45.9707707Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T06:42:45.9708700Z @stablehlo//:linalg_passes; 27s local 2025-03-14T06:42:45.9709461Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local ... 2025-03-14T06:42:46.9703730Z 2025-03-14T06:42:46.9704623Z  2025-03-14T06:42:46.9705127Z  2025-03-14T06:42:46.9705558Z  2025-03-14T06:42:46.9705991Z  2025-03-14T06:42:46.9706407Z  2025-03-14T06:42:46.9706838Z  2025-03-14T06:42:46.9707250Z  2025-03-14T06:42:46.9707657Z  2025-03-14T06:42:46.9708626Z [19,519 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:46.9709538Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2025-03-14T06:42:46.9710339Z @llvm-project//mlir:LinalgTransforms; 52s local 2025-03-14T06:42:46.9711533Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2025-03-14T06:42:46.9712853Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2025-03-14T06:42:46.9714146Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 37s local 2025-03-14T06:42:46.9715291Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T06:42:46.9716162Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:46.9717007Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local ... 2025-03-14T06:42:47.4443962Z 2025-03-14T06:42:47.4445045Z  2025-03-14T06:42:47.4445574Z  2025-03-14T06:42:47.4447190Z  2025-03-14T06:42:47.4449756Z  2025-03-14T06:42:47.4450491Z  2025-03-14T06:42:47.4450993Z  2025-03-14T06:42:47.4451504Z  2025-03-14T06:42:47.4451992Z  2025-03-14T06:42:47.4453533Z [19,520 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:47.4454812Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T06:42:47.4455777Z @llvm-project//mlir:LinalgTransforms; 52s local 2025-03-14T06:42:47.4456785Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 47s local 2025-03-14T06:42:47.4458031Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T06:42:47.4459045Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T06:42:47.4460272Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T06:42:47.4461210Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:47.4462104Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local ... 2025-03-14T06:42:47.7089278Z 2025-03-14T06:42:47.7090046Z  2025-03-14T06:42:47.7090487Z  2025-03-14T06:42:47.7090840Z  2025-03-14T06:42:47.7091185Z  2025-03-14T06:42:47.7091561Z  2025-03-14T06:42:47.7091912Z  2025-03-14T06:42:47.7092267Z  2025-03-14T06:42:47.7092613Z  2025-03-14T06:42:47.7093423Z [19,521 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:47.7094340Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T06:42:47.7095085Z @llvm-project//mlir:LinalgTransforms; 52s local 2025-03-14T06:42:47.7095789Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T06:42:47.7096907Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T06:42:47.7097774Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T06:42:47.7098611Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T06:42:47.7099336Z @stablehlo//:linalg_passes; 28s local 2025-03-14T06:42:47.7100017Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local ... 2025-03-14T06:42:47.9714398Z 2025-03-14T06:42:47.9715169Z  2025-03-14T06:42:47.9715592Z  2025-03-14T06:42:47.9715918Z  2025-03-14T06:42:47.9716244Z  2025-03-14T06:42:47.9716556Z  2025-03-14T06:42:47.9716870Z  2025-03-14T06:42:47.9717168Z  2025-03-14T06:42:47.9717484Z  2025-03-14T06:42:47.9718250Z [19,524 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:47.9719112Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T06:42:47.9719803Z @llvm-project//mlir:LinalgTransforms; 53s local 2025-03-14T06:42:47.9720502Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T06:42:47.9721285Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T06:42:47.9722063Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 38s local 2025-03-14T06:42:47.9722805Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T06:42:47.9723438Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:47.9724062Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local ... 2025-03-14T06:42:48.2183652Z 2025-03-14T06:42:48.2184536Z  2025-03-14T06:42:48.2185141Z  2025-03-14T06:42:48.2185671Z  2025-03-14T06:42:48.2186193Z  2025-03-14T06:42:48.2186710Z  2025-03-14T06:42:48.2187236Z  2025-03-14T06:42:48.2187755Z  2025-03-14T06:42:48.2188295Z  2025-03-14T06:42:48.2189233Z [19,527 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:48.2190362Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T06:42:48.2191226Z @llvm-project//mlir:LinalgTransforms; 53s local 2025-03-14T06:42:48.2192088Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T06:42:48.2193104Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2025-03-14T06:42:48.2194168Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T06:42:48.2195405Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T06:42:48.2196251Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:48.2197048Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local ... 2025-03-14T06:42:48.4503987Z 2025-03-14T06:42:48.4504794Z  2025-03-14T06:42:48.4505308Z  2025-03-14T06:42:48.4505736Z  2025-03-14T06:42:48.4506144Z  2025-03-14T06:42:48.4506578Z  2025-03-14T06:42:48.4507006Z  2025-03-14T06:42:48.4507404Z  2025-03-14T06:42:48.4508083Z  2025-03-14T06:42:48.4509070Z [19,528 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:48.4510186Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T06:42:48.4511184Z @llvm-project//mlir:LinalgTransforms; 53s local 2025-03-14T06:42:48.4512042Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 48s local 2025-03-14T06:42:48.4513018Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2025-03-14T06:42:48.4514023Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T06:42:48.4514908Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T06:42:48.4515672Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:48.4516430Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local ... 2025-03-14T06:42:48.6940105Z 2025-03-14T06:42:48.6940936Z  2025-03-14T06:42:48.6941456Z  2025-03-14T06:42:48.6941924Z  2025-03-14T06:42:48.6942356Z  2025-03-14T06:42:48.6942779Z  2025-03-14T06:42:48.6943210Z  2025-03-14T06:42:48.6943638Z  2025-03-14T06:42:48.6944055Z  2025-03-14T06:42:48.6945004Z [19,530 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:48.6946409Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T06:42:48.6947272Z @llvm-project//mlir:LinalgTransforms; 53s local 2025-03-14T06:42:48.6948192Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T06:42:48.6949172Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2025-03-14T06:42:48.6950165Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T06:42:48.6951110Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T06:42:48.6951927Z @stablehlo//:linalg_passes; 29s local 2025-03-14T06:42:48.6952707Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local ... 2025-03-14T06:42:48.9584008Z 2025-03-14T06:42:48.9584883Z  2025-03-14T06:42:48.9585360Z  2025-03-14T06:42:48.9585759Z  2025-03-14T06:42:48.9586125Z  2025-03-14T06:42:48.9586503Z  2025-03-14T06:42:48.9586880Z  2025-03-14T06:42:48.9587274Z  2025-03-14T06:42:48.9587714Z  2025-03-14T06:42:48.9588627Z [19,532 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:48.9589643Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T06:42:48.9590452Z @llvm-project//mlir:LinalgTransforms; 54s local 2025-03-14T06:42:48.9591285Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T06:42:48.9592194Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 39s local 2025-03-14T06:42:48.9593154Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T06:42:48.9593941Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:48.9594662Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T06:42:48.9595619Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local ... 2025-03-14T06:42:49.1722930Z 2025-03-14T06:42:49.1723747Z  2025-03-14T06:42:49.1724208Z  2025-03-14T06:42:49.1724765Z  2025-03-14T06:42:49.1725216Z  2025-03-14T06:42:49.1725604Z  2025-03-14T06:42:49.1726288Z  2025-03-14T06:42:49.1726704Z  2025-03-14T06:42:49.1727101Z  2025-03-14T06:42:49.1728043Z [19,532 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:49.1729143Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T06:42:49.1730015Z @llvm-project//mlir:LinalgTransforms; 54s local 2025-03-14T06:42:49.1730885Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 49s local 2025-03-14T06:42:49.1732049Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T06:42:49.1733050Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T06:42:49.1733874Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:49.1734654Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T06:42:49.1735647Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local ... 2025-03-14T06:42:49.5727368Z 2025-03-14T06:42:49.5728239Z  2025-03-14T06:42:49.5728795Z  2025-03-14T06:42:49.5729189Z  2025-03-14T06:42:49.5729579Z  2025-03-14T06:42:49.5729986Z  2025-03-14T06:42:49.5730482Z  2025-03-14T06:42:49.5730811Z  2025-03-14T06:42:49.5731209Z  2025-03-14T06:42:49.5732163Z [19,534 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:49.5733300Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T06:42:49.5734476Z @llvm-project//mlir:LinalgTransforms; 54s local 2025-03-14T06:42:49.5735311Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T06:42:49.5736260Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T06:42:49.5737265Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T06:42:49.5738103Z @stablehlo//:linalg_passes; 30s local 2025-03-14T06:42:49.5739080Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T06:42:49.5740071Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local ... 2025-03-14T06:42:49.9904934Z 2025-03-14T06:42:49.9905756Z  2025-03-14T06:42:49.9906366Z  2025-03-14T06:42:49.9906888Z  2025-03-14T06:42:49.9907341Z  2025-03-14T06:42:49.9907714Z  2025-03-14T06:42:49.9908104Z  2025-03-14T06:42:49.9908463Z  2025-03-14T06:42:49.9908868Z  2025-03-14T06:42:49.9909870Z [19,535 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:49.9911126Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T06:42:49.9912008Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T06:42:49.9912838Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T06:42:49.9913764Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 40s local 2025-03-14T06:42:49.9914727Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T06:42:49.9915524Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:49.9916295Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2025-03-14T06:42:49.9917251Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local ... 2025-03-14T06:42:50.2061992Z 2025-03-14T06:42:50.2062852Z  2025-03-14T06:42:50.2063365Z  2025-03-14T06:42:50.2063795Z  2025-03-14T06:42:50.2064223Z  2025-03-14T06:42:50.2064664Z  2025-03-14T06:42:50.2065072Z  2025-03-14T06:42:50.2065769Z  2025-03-14T06:42:50.2066202Z  2025-03-14T06:42:50.2067114Z [19,536 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:50.2068212Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T06:42:50.2069025Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T06:42:50.2069875Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 50s local 2025-03-14T06:42:50.2071067Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T06:42:50.2072124Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T06:42:50.2072898Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:50.2073615Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2025-03-14T06:42:50.2074464Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local ... 2025-03-14T06:42:50.5734667Z 2025-03-14T06:42:50.5735514Z  2025-03-14T06:42:50.5735935Z  2025-03-14T06:42:50.5736575Z  2025-03-14T06:42:50.5736997Z  2025-03-14T06:42:50.5737382Z  2025-03-14T06:42:50.5737749Z  2025-03-14T06:42:50.5738030Z  2025-03-14T06:42:50.5738331Z  2025-03-14T06:42:50.5739096Z [19,537 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:50.5740020Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2025-03-14T06:42:50.5740833Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T06:42:50.5741614Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 51s local 2025-03-14T06:42:50.5742513Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 41s local 2025-03-14T06:42:50.5743447Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2025-03-14T06:42:50.5744241Z @stablehlo//:linalg_passes; 31s local 2025-03-14T06:42:50.5745201Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2025-03-14T06:42:50.5746140Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local ... 2025-03-14T06:42:51.5130468Z 2025-03-14T06:42:51.5131301Z  2025-03-14T06:42:51.5131785Z  2025-03-14T06:42:51.5132206Z  2025-03-14T06:42:51.5132622Z  2025-03-14T06:42:51.5132967Z  2025-03-14T06:42:51.5133417Z  2025-03-14T06:42:51.5133813Z  2025-03-14T06:42:51.5134493Z  2025-03-14T06:42:51.5135408Z [19,538 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:51.5136495Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T06:42:51.5137316Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T06:42:51.5138098Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T06:42:51.5138942Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T06:42:51.5139853Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T06:42:51.5140605Z @stablehlo//:linalg_passes; 32s local 2025-03-14T06:42:51.5141287Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2025-03-14T06:42:51.5142217Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local ... 2025-03-14T06:42:51.7743082Z 2025-03-14T06:42:51.7743903Z  2025-03-14T06:42:51.7744295Z  2025-03-14T06:42:51.7744613Z  2025-03-14T06:42:51.7744961Z  2025-03-14T06:42:51.7745277Z  2025-03-14T06:42:51.7745599Z  2025-03-14T06:42:51.7745906Z  2025-03-14T06:42:51.7746205Z  2025-03-14T06:42:51.7746921Z [19,541 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:51.7747738Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T06:42:51.7748400Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T06:42:51.7749115Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T06:42:51.7750018Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 42s local 2025-03-14T06:42:51.7750814Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T06:42:51.7751851Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:51.7752767Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2025-03-14T06:42:51.7753939Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local ... 2025-03-14T06:42:52.3612026Z 2025-03-14T06:42:52.3613079Z  2025-03-14T06:42:52.3613627Z  2025-03-14T06:42:52.3614045Z  2025-03-14T06:42:52.3614472Z  2025-03-14T06:42:52.3614903Z  2025-03-14T06:42:52.3615323Z  2025-03-14T06:42:52.3615734Z  2025-03-14T06:42:52.3616160Z  2025-03-14T06:42:52.3617148Z [19,542 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:52.3618341Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T06:42:52.3619456Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T06:42:52.3620409Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 52s local 2025-03-14T06:42:52.3621469Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T06:42:52.3622520Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T06:42:52.3623411Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:52.3624279Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T06:42:52.3625346Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local ... 2025-03-14T06:42:52.5739191Z 2025-03-14T06:42:52.5740053Z  2025-03-14T06:42:52.5740575Z  2025-03-14T06:42:52.5740994Z  2025-03-14T06:42:52.5741410Z  2025-03-14T06:42:52.5741822Z  2025-03-14T06:42:52.5742229Z  2025-03-14T06:42:52.5742629Z  2025-03-14T06:42:52.5743056Z  2025-03-14T06:42:52.5744290Z [19,544 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:52.5745272Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T06:42:52.5746133Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T06:42:52.5747062Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T06:42:52.5748029Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T06:42:52.5749156Z @stablehlo//:linalg_passes; 33s local 2025-03-14T06:42:52.5749874Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T06:42:52.5750737Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 32s local 2025-03-14T06:42:52.5751660Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 24s local ... 2025-03-14T06:42:52.7750926Z 2025-03-14T06:42:52.7751752Z  2025-03-14T06:42:52.7752228Z  2025-03-14T06:42:52.7752603Z  2025-03-14T06:42:52.7753030Z  2025-03-14T06:42:52.7753427Z  2025-03-14T06:42:52.7753802Z  2025-03-14T06:42:52.7754223Z  2025-03-14T06:42:52.7754612Z  2025-03-14T06:42:52.7755556Z [19,544 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:52.7756565Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T06:42:52.7757431Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T06:42:52.7758404Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T06:42:52.7759380Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T06:42:52.7760235Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:52.7760999Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T06:42:52.7762082Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 32s local 2025-03-14T06:42:52.7763042Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 24s local ... 2025-03-14T06:42:52.9753881Z 2025-03-14T06:42:52.9754741Z  2025-03-14T06:42:52.9755243Z  2025-03-14T06:42:52.9755695Z  2025-03-14T06:42:52.9756071Z  2025-03-14T06:42:52.9756464Z  2025-03-14T06:42:52.9756857Z  2025-03-14T06:42:52.9757272Z  2025-03-14T06:42:52.9757661Z  2025-03-14T06:42:52.9758637Z [19,545 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:52.9759654Z @llvm-project//mlir:LinalgTransforms; 58s local 2025-03-14T06:42:52.9760811Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T06:42:52.9761742Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 43s local 2025-03-14T06:42:52.9762646Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T06:42:52.9763428Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:52.9764182Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T06:42:52.9765527Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 24s local 2025-03-14T06:42:52.9766599Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2025-03-14T06:42:53.3758342Z 2025-03-14T06:42:53.3759184Z  2025-03-14T06:42:53.3759672Z  2025-03-14T06:42:53.3760105Z  2025-03-14T06:42:53.3760525Z  2025-03-14T06:42:53.3760951Z  2025-03-14T06:42:53.3761365Z  2025-03-14T06:42:53.3761757Z  2025-03-14T06:42:53.3762280Z  2025-03-14T06:42:53.3763337Z [19,546 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:53.3764392Z @llvm-project//mlir:LinalgTransforms; 58s local 2025-03-14T06:42:53.3765657Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 53s local 2025-03-14T06:42:53.3766689Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T06:42:53.3767723Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T06:42:53.3768911Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:53.3769734Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T06:42:53.3770738Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T06:42:53.3771675Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2025-03-14T06:42:53.6859903Z 2025-03-14T06:42:53.6860706Z  2025-03-14T06:42:53.6861197Z  2025-03-14T06:42:53.6861611Z  2025-03-14T06:42:53.6862009Z  2025-03-14T06:42:53.6862721Z  2025-03-14T06:42:53.6863122Z  2025-03-14T06:42:53.6863502Z  2025-03-14T06:42:53.6863899Z  2025-03-14T06:42:53.6864804Z [19,548 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:53.6866013Z @llvm-project//mlir:LinalgTransforms; 58s local 2025-03-14T06:42:53.6866757Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T06:42:53.6867604Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T06:42:53.6868584Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T06:42:53.6869374Z @stablehlo//:linalg_passes; 34s local 2025-03-14T06:42:53.6870115Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T06:42:53.6871037Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T06:42:53.6871940Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2025-03-14T06:42:53.9763677Z 2025-03-14T06:42:53.9764527Z  2025-03-14T06:42:53.9765170Z  2025-03-14T06:42:53.9765773Z  2025-03-14T06:42:53.9766167Z  2025-03-14T06:42:53.9766557Z  2025-03-14T06:42:53.9766935Z  2025-03-14T06:42:53.9767292Z  2025-03-14T06:42:53.9767673Z  2025-03-14T06:42:53.9768618Z [19,549 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:42:53.9769617Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T06:42:53.9770521Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T06:42:53.9771483Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 44s local 2025-03-14T06:42:53.9772417Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T06:42:53.9773249Z @stablehlo//:linalg_passes; 35s local 2025-03-14T06:42:53.9773962Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T06:42:53.9774915Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 25s local 2025-03-14T06:42:53.9776075Z @llvm-project//mlir:LinalgTransforms; 25s local ... 2025-03-14T06:42:54.1854105Z 2025-03-14T06:42:54.1854993Z  2025-03-14T06:42:54.1855538Z  2025-03-14T06:42:54.1855940Z  2025-03-14T06:42:54.1856335Z  2025-03-14T06:42:54.1856739Z  2025-03-14T06:42:54.1857135Z  2025-03-14T06:42:54.1857665Z  2025-03-14T06:42:54.1858061Z  2025-03-14T06:42:54.1858973Z [19,551 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:54.1860224Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T06:42:54.1861035Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 54s local 2025-03-14T06:42:54.1861954Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T06:42:54.1862856Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T06:42:54.1863774Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T06:42:54.1864695Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 26s local 2025-03-14T06:42:54.1865787Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:42:54.1866581Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local ... 2025-03-14T06:42:54.5356842Z 2025-03-14T06:42:54.5357659Z  2025-03-14T06:42:54.5358097Z  2025-03-14T06:42:54.5358477Z  2025-03-14T06:42:54.5359006Z  2025-03-14T06:42:54.5359432Z  2025-03-14T06:42:54.5360085Z  2025-03-14T06:42:54.5360452Z  2025-03-14T06:42:54.5360825Z  2025-03-14T06:42:54.5361734Z [19,553 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:54.5362637Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T06:42:54.5363438Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T06:42:54.5364319Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T06:42:54.5365756Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2025-03-14T06:42:54.5366768Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T06:42:54.5367571Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 26s local 2025-03-14T06:42:54.5368252Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:42:54.5368971Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local ... 2025-03-14T06:42:54.7771916Z 2025-03-14T06:42:54.7772967Z  2025-03-14T06:42:54.7773476Z  2025-03-14T06:42:54.7773910Z  2025-03-14T06:42:54.7774353Z  2025-03-14T06:42:54.7774793Z  2025-03-14T06:42:54.7775216Z  2025-03-14T06:42:54.7775647Z  2025-03-14T06:42:54.7776082Z  2025-03-14T06:42:54.7777057Z [19,553 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:54.7778072Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T06:42:54.7778958Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 55s local 2025-03-14T06:42:54.7779924Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 45s local 2025-03-14T06:42:54.7780896Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2025-03-14T06:42:54.7781836Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T06:42:54.7782757Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 26s local 2025-03-14T06:42:54.7783614Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:42:54.7784509Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 23s local ... 2025-03-14T06:42:55.7777881Z 2025-03-14T06:42:55.7778701Z  2025-03-14T06:42:55.7779164Z  2025-03-14T06:42:55.7779558Z  2025-03-14T06:42:55.7779955Z  2025-03-14T06:42:55.7780361Z  2025-03-14T06:42:55.7780693Z  2025-03-14T06:42:55.7781069Z  2025-03-14T06:42:55.7781452Z  2025-03-14T06:42:55.7782726Z [19,553 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:55.7783763Z @llvm-project//mlir:LinalgTransforms; 60s local 2025-03-14T06:42:55.7784592Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T06:42:55.7785450Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2025-03-14T06:42:55.7786367Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T06:42:55.7787304Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2025-03-14T06:42:55.7788461Z Compiling xla/backends/cpu/codegen/ir_compiler.cc; 27s local 2025-03-14T06:42:55.7789276Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:42:55.7790141Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 24s local ... 2025-03-14T06:42:56.0533573Z 2025-03-14T06:42:56.0534487Z  2025-03-14T06:42:56.0535051Z  2025-03-14T06:42:56.0535408Z  2025-03-14T06:42:56.0535792Z  2025-03-14T06:42:56.0536218Z  2025-03-14T06:42:56.0536619Z  2025-03-14T06:42:56.0537035Z  2025-03-14T06:42:56.0537448Z  2025-03-14T06:42:56.0538392Z [19,556 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:56.0539389Z @llvm-project//mlir:LinalgTransforms; 61s local 2025-03-14T06:42:56.0540248Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T06:42:56.0541177Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 46s local 2025-03-14T06:42:56.0542430Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T06:42:56.0543339Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2025-03-14T06:42:56.0544302Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T06:42:56.0545155Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2025-03-14T06:42:56.0546240Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 18s local ... 2025-03-14T06:42:56.3315462Z 2025-03-14T06:42:56.3316362Z  2025-03-14T06:42:56.3316919Z  2025-03-14T06:42:56.3317330Z  2025-03-14T06:42:56.3317753Z  2025-03-14T06:42:56.3318144Z  2025-03-14T06:42:56.3318557Z  2025-03-14T06:42:56.3318959Z  2025-03-14T06:42:56.3319363Z  2025-03-14T06:42:56.3320329Z [19,558 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:56.3321319Z @llvm-project//mlir:LinalgTransforms; 61s local 2025-03-14T06:42:56.3322185Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 56s local 2025-03-14T06:42:56.3323161Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2025-03-14T06:42:56.3324141Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T06:42:56.3325254Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2025-03-14T06:42:56.3326138Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2025-03-14T06:42:56.3327106Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local 2025-03-14T06:42:56.3328163Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local ... 2025-03-14T06:42:56.5784019Z 2025-03-14T06:42:56.5784858Z  2025-03-14T06:42:56.5785355Z  2025-03-14T06:42:56.5785759Z  2025-03-14T06:42:56.5786172Z  2025-03-14T06:42:56.5786583Z  2025-03-14T06:42:56.5786996Z  2025-03-14T06:42:56.5787366Z  2025-03-14T06:42:56.5787762Z  2025-03-14T06:42:56.5788725Z [19,561 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:56.5789711Z @llvm-project//mlir:LinalgTransforms; 61s local 2025-03-14T06:42:56.5790566Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T06:42:56.5791541Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2025-03-14T06:42:56.5792439Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T06:42:56.5793672Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2025-03-14T06:42:56.5794568Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 25s local 2025-03-14T06:42:56.5795468Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local 2025-03-14T06:42:56.5796453Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local ... 2025-03-14T06:42:56.8740739Z 2025-03-14T06:42:56.8741609Z  2025-03-14T06:42:56.8742103Z  2025-03-14T06:42:56.8742568Z  2025-03-14T06:42:56.8743001Z  2025-03-14T06:42:56.8743421Z  2025-03-14T06:42:56.8744103Z  2025-03-14T06:42:56.8744525Z  2025-03-14T06:42:56.8744932Z  2025-03-14T06:42:56.8745907Z [19,562 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:56.8746932Z @llvm-project//mlir:LinalgTransforms; 62s local 2025-03-14T06:42:56.8747788Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T06:42:56.8748778Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 47s local 2025-03-14T06:42:56.8749796Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T06:42:56.8750811Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2025-03-14T06:42:56.8751806Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 19s local 2025-03-14T06:42:56.8752844Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local 2025-03-14T06:42:56.8754280Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 17s local ... 2025-03-14T06:42:57.1788919Z 2025-03-14T06:42:57.1789761Z  2025-03-14T06:42:57.1790253Z  2025-03-14T06:42:57.1790665Z  2025-03-14T06:42:57.1791064Z  2025-03-14T06:42:57.1791462Z  2025-03-14T06:42:57.1791848Z  2025-03-14T06:42:57.1792257Z  2025-03-14T06:42:57.1792655Z  2025-03-14T06:42:57.1793623Z [19,563 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:57.1794991Z @llvm-project//mlir:LinalgTransforms; 62s local 2025-03-14T06:42:57.1795864Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 57s local 2025-03-14T06:42:57.1796792Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T06:42:57.1797689Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T06:42:57.1798689Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2025-03-14T06:42:57.1799646Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2025-03-14T06:42:57.1800464Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local 2025-03-14T06:42:57.1801495Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 17s local ... 2025-03-14T06:42:57.5161228Z 2025-03-14T06:42:57.5162004Z  2025-03-14T06:42:57.5162461Z  2025-03-14T06:42:57.5162846Z  2025-03-14T06:42:57.5163245Z  2025-03-14T06:42:57.5163650Z  2025-03-14T06:42:57.5164087Z  2025-03-14T06:42:57.5164474Z  2025-03-14T06:42:57.5165043Z  2025-03-14T06:42:57.5166223Z [19,566 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:57.5167131Z @llvm-project//mlir:LinalgTransforms; 62s local 2025-03-14T06:42:57.5167938Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2025-03-14T06:42:57.5168982Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T06:42:57.5169937Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T06:42:57.5170884Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2025-03-14T06:42:57.5171822Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2025-03-14T06:42:57.5172800Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local 2025-03-14T06:42:57.5173869Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 18s local ... 2025-03-14T06:42:57.7794445Z 2025-03-14T06:42:57.7795281Z  2025-03-14T06:42:57.7796093Z  2025-03-14T06:42:57.7796498Z  2025-03-14T06:42:57.7796889Z  2025-03-14T06:42:57.7797280Z  2025-03-14T06:42:57.7797658Z  2025-03-14T06:42:57.7798046Z  2025-03-14T06:42:57.7798420Z  2025-03-14T06:42:57.7799331Z [19,566 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:57.7800273Z @llvm-project//mlir:LinalgTransforms; 62s local 2025-03-14T06:42:57.7801121Z Compiling xla/backends/cpu/runtime/dot_thunk_f32.cc; 58s local 2025-03-14T06:42:57.7802508Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T06:42:57.7803685Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T06:42:57.7804835Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 26s local 2025-03-14T06:42:57.7805858Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2025-03-14T06:42:57.7806798Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local 2025-03-14T06:42:57.7807862Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 18s local ... 2025-03-14T06:42:58.0083121Z 2025-03-14T06:42:58.0083949Z  2025-03-14T06:42:58.0084424Z  2025-03-14T06:42:58.0085008Z  2025-03-14T06:42:58.0085407Z  2025-03-14T06:42:58.0085768Z  2025-03-14T06:42:58.0086134Z  2025-03-14T06:42:58.0086463Z  2025-03-14T06:42:58.0086785Z  2025-03-14T06:42:58.0088072Z [19,567 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:58.0089050Z @llvm-project//mlir:LinalgTransforms; 63s local 2025-03-14T06:42:58.0089973Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 48s local 2025-03-14T06:42:58.0090892Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T06:42:58.0091840Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2025-03-14T06:42:58.0092980Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 20s local 2025-03-14T06:42:58.0093955Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local 2025-03-14T06:42:58.0095024Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 18s local 2025-03-14T06:42:58.0096033Z Compiling xla/service/cpu/cpu_executable.cc; 17s local ... 2025-03-14T06:42:58.2781786Z 2025-03-14T06:42:58.2782637Z  2025-03-14T06:42:58.2783138Z  2025-03-14T06:42:58.2783602Z  2025-03-14T06:42:58.2784023Z  2025-03-14T06:42:58.2784435Z  2025-03-14T06:42:58.2784845Z  2025-03-14T06:42:58.2785275Z  2025-03-14T06:42:58.2785693Z  2025-03-14T06:42:58.2786610Z [19,569 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:58.2787574Z @llvm-project//mlir:LinalgTransforms; 63s local 2025-03-14T06:42:58.2788402Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T06:42:58.2789404Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T06:42:58.2790370Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2025-03-14T06:42:58.2791243Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2025-03-14T06:42:58.2792235Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local 2025-03-14T06:42:58.2793307Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 18s local 2025-03-14T06:42:58.2794374Z Compiling xla/service/cpu/cpu_executable.cc; 18s local ... 2025-03-14T06:42:58.5800354Z 2025-03-14T06:42:58.5801197Z  2025-03-14T06:42:58.5801701Z  2025-03-14T06:42:58.5802131Z  2025-03-14T06:42:58.5802518Z  2025-03-14T06:42:58.5802907Z  2025-03-14T06:42:58.5803298Z  2025-03-14T06:42:58.5803691Z  2025-03-14T06:42:58.5804091Z  2025-03-14T06:42:58.5805192Z [19,570 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:58.5806499Z @llvm-project//mlir:LinalgTransforms; 63s local 2025-03-14T06:42:58.5807381Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T06:42:58.5808301Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T06:42:58.5809299Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2025-03-14T06:42:58.5810271Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2025-03-14T06:42:58.5811400Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local 2025-03-14T06:42:58.5812669Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 19s local 2025-03-14T06:42:58.5813690Z Compiling xla/service/cpu/cpu_executable.cc; 18s local ... 2025-03-14T06:42:58.7803113Z 2025-03-14T06:42:58.7803952Z  2025-03-14T06:42:58.7804457Z  2025-03-14T06:42:58.7805032Z  2025-03-14T06:42:58.7805410Z  2025-03-14T06:42:58.7805766Z  2025-03-14T06:42:58.7806118Z  2025-03-14T06:42:58.7806449Z  2025-03-14T06:42:58.7806771Z  2025-03-14T06:42:58.7807695Z [19,572 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:58.7808662Z @llvm-project//mlir:LinalgTransforms; 63s local 2025-03-14T06:42:58.7809501Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 49s local 2025-03-14T06:42:58.7810487Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T06:42:58.7811772Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 27s local 2025-03-14T06:42:58.7812720Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 21s local 2025-03-14T06:42:58.7813713Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local 2025-03-14T06:42:58.7814815Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 19s local 2025-03-14T06:42:58.7815852Z Compiling xla/service/cpu/cpu_executable.cc; 18s local ... 2025-03-14T06:42:59.1807278Z 2025-03-14T06:42:59.1808088Z  2025-03-14T06:42:59.1808566Z  2025-03-14T06:42:59.1808990Z  2025-03-14T06:42:59.1809517Z  2025-03-14T06:42:59.1809930Z  2025-03-14T06:42:59.1810340Z  2025-03-14T06:42:59.1810721Z  2025-03-14T06:42:59.1811141Z  2025-03-14T06:42:59.1812157Z [19,573 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:59.1813110Z @llvm-project//mlir:LinalgTransforms; 64s local 2025-03-14T06:42:59.1814005Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2025-03-14T06:42:59.1815003Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T06:42:59.1815994Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2025-03-14T06:42:59.1817021Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2025-03-14T06:42:59.1818051Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local 2025-03-14T06:42:59.1819114Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 19s local 2025-03-14T06:42:59.1820084Z Compiling xla/service/cpu/cpu_executable.cc; 18s local ... 2025-03-14T06:42:59.5756819Z 2025-03-14T06:42:59.5757605Z  2025-03-14T06:42:59.5758044Z  2025-03-14T06:42:59.5758414Z  2025-03-14T06:42:59.5758795Z  2025-03-14T06:42:59.5759154Z  2025-03-14T06:42:59.5759499Z  2025-03-14T06:42:59.5759858Z  2025-03-14T06:42:59.5760209Z  2025-03-14T06:42:59.5761120Z [19,575 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:42:59.5762033Z @llvm-project//mlir:LinalgTransforms; 64s local 2025-03-14T06:42:59.5762807Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2025-03-14T06:42:59.5763729Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2025-03-14T06:42:59.5764749Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2025-03-14T06:42:59.5765890Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2025-03-14T06:42:59.5767117Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2025-03-14T06:42:59.5768013Z Compiling xla/service/cpu/cpu_executable.cc; 19s local 2025-03-14T06:42:59.5768680Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T06:42:59.7812636Z 2025-03-14T06:42:59.7813485Z  2025-03-14T06:42:59.7813912Z  2025-03-14T06:42:59.7814261Z  2025-03-14T06:42:59.7814617Z  2025-03-14T06:42:59.7815008Z  2025-03-14T06:42:59.7815355Z  2025-03-14T06:42:59.7815703Z  2025-03-14T06:42:59.7816295Z  2025-03-14T06:42:59.7817132Z [19,577 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:42:59.7818013Z @llvm-project//mlir:LinalgTransforms; 64s local 2025-03-14T06:42:59.7818793Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 50s local 2025-03-14T06:42:59.7819669Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2025-03-14T06:42:59.7820524Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 28s local 2025-03-14T06:42:59.7821319Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 22s local 2025-03-14T06:42:59.7822192Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2025-03-14T06:42:59.7823052Z Compiling xla/service/cpu/cpu_executable.cc; 19s local 2025-03-14T06:42:59.7823740Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T06:43:00.1817183Z 2025-03-14T06:43:00.1817957Z  2025-03-14T06:43:00.1818453Z  2025-03-14T06:43:00.1818877Z  2025-03-14T06:43:00.1819283Z  2025-03-14T06:43:00.1819675Z  2025-03-14T06:43:00.1820046Z  2025-03-14T06:43:00.1820433Z  2025-03-14T06:43:00.1820826Z  2025-03-14T06:43:00.1821758Z [19,578 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:00.1823013Z @llvm-project//mlir:LinalgTransforms; 65s local 2025-03-14T06:43:00.1823851Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T06:43:00.1824751Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2025-03-14T06:43:00.1825703Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2025-03-14T06:43:00.1826788Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2025-03-14T06:43:00.1827830Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2025-03-14T06:43:00.1828828Z Compiling xla/service/cpu/cpu_executable.cc; 19s local 2025-03-14T06:43:00.1829609Z @stablehlo//:stablehlo_passes; 19s local ... 2025-03-14T06:43:00.5821388Z 2025-03-14T06:43:00.5822277Z  2025-03-14T06:43:00.5822766Z  2025-03-14T06:43:00.5823183Z  2025-03-14T06:43:00.5823603Z  2025-03-14T06:43:00.5824019Z  2025-03-14T06:43:00.5824423Z  2025-03-14T06:43:00.5824825Z  2025-03-14T06:43:00.5825212Z  2025-03-14T06:43:00.5826229Z [19,580 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:00.5827185Z @llvm-project//mlir:LinalgTransforms; 65s local 2025-03-14T06:43:00.5828051Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T06:43:00.5829004Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T06:43:00.5829933Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2025-03-14T06:43:00.5830905Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2025-03-14T06:43:00.5832049Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2025-03-14T06:43:00.5832947Z Compiling xla/service/cpu/cpu_executable.cc; 20s local 2025-03-14T06:43:00.5833901Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local ... 2025-03-14T06:43:00.7824561Z 2025-03-14T06:43:00.7825450Z  2025-03-14T06:43:00.7825922Z  2025-03-14T06:43:00.7826343Z  2025-03-14T06:43:00.7826748Z  2025-03-14T06:43:00.7827448Z  2025-03-14T06:43:00.7827855Z  2025-03-14T06:43:00.7828239Z  2025-03-14T06:43:00.7828636Z  2025-03-14T06:43:00.7829602Z [19,581 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:00.7830628Z @llvm-project//mlir:LinalgTransforms; 65s local 2025-03-14T06:43:00.7831479Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T06:43:00.7832448Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T06:43:00.7833575Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 29s local 2025-03-14T06:43:00.7834542Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 23s local 2025-03-14T06:43:00.7835558Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2025-03-14T06:43:00.7836541Z Compiling xla/service/cpu/cpu_executable.cc; 20s local 2025-03-14T06:43:00.7837528Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local ... 2025-03-14T06:43:01.1545447Z 2025-03-14T06:43:01.1546288Z  2025-03-14T06:43:01.1546790Z  2025-03-14T06:43:01.1547193Z  2025-03-14T06:43:01.1547561Z  2025-03-14T06:43:01.1547940Z  2025-03-14T06:43:01.1548292Z  2025-03-14T06:43:01.1548683Z  2025-03-14T06:43:01.1549083Z  2025-03-14T06:43:01.1550003Z [19,583 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:01.1551251Z @llvm-project//mlir:LinalgTransforms; 66s local 2025-03-14T06:43:01.1552100Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 51s local 2025-03-14T06:43:01.1553083Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T06:43:01.1554030Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2025-03-14T06:43:01.1554974Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2025-03-14T06:43:01.1556192Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2025-03-14T06:43:01.1557125Z Compiling xla/service/cpu/cpu_executable.cc; 20s local 2025-03-14T06:43:01.1557856Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local ... 2025-03-14T06:43:01.3831002Z 2025-03-14T06:43:01.3831823Z  2025-03-14T06:43:01.3832314Z  2025-03-14T06:43:01.3832741Z  2025-03-14T06:43:01.3833156Z  2025-03-14T06:43:01.3833534Z  2025-03-14T06:43:01.3833876Z  2025-03-14T06:43:01.3834297Z  2025-03-14T06:43:01.3834673Z  2025-03-14T06:43:01.3835681Z [19,583 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:01.3836656Z @llvm-project//mlir:LinalgTransforms; 66s local 2025-03-14T06:43:01.3837514Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T06:43:01.3838446Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T06:43:01.3839443Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2025-03-14T06:43:01.3840419Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2025-03-14T06:43:01.3841480Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2025-03-14T06:43:01.3842490Z Compiling xla/service/cpu/cpu_executable.cc; 21s local 2025-03-14T06:43:01.3843486Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local ... 2025-03-14T06:43:01.7296472Z 2025-03-14T06:43:01.7297331Z  2025-03-14T06:43:01.7297819Z  2025-03-14T06:43:01.7298239Z  2025-03-14T06:43:01.7298652Z  2025-03-14T06:43:01.7299042Z  2025-03-14T06:43:01.7299422Z  2025-03-14T06:43:01.7299828Z  2025-03-14T06:43:01.7300220Z  2025-03-14T06:43:01.7301140Z [19,584 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:01.7302087Z @llvm-project//mlir:LinalgTransforms; 66s local 2025-03-14T06:43:01.7303177Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T06:43:01.7304130Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2025-03-14T06:43:01.7305050Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 30s local 2025-03-14T06:43:01.7305970Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2025-03-14T06:43:01.7306982Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2025-03-14T06:43:01.7307954Z Compiling xla/service/cpu/cpu_executable.cc; 21s local 2025-03-14T06:43:01.7309124Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 17s local ... 2025-03-14T06:43:01.9835827Z 2025-03-14T06:43:01.9836658Z  2025-03-14T06:43:01.9837179Z  2025-03-14T06:43:01.9837615Z  2025-03-14T06:43:01.9838002Z  2025-03-14T06:43:01.9838342Z  2025-03-14T06:43:01.9838663Z  2025-03-14T06:43:01.9838966Z  2025-03-14T06:43:01.9839319Z  2025-03-14T06:43:01.9840306Z [19,585 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:01.9841289Z @llvm-project//mlir:LinalgTransforms; 67s local 2025-03-14T06:43:01.9842104Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 52s local 2025-03-14T06:43:01.9842920Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2025-03-14T06:43:01.9843749Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2025-03-14T06:43:01.9844731Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 24s local 2025-03-14T06:43:01.9845940Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2025-03-14T06:43:01.9846863Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 17s local 2025-03-14T06:43:01.9847578Z @xla//xla/mlir_hlo:mhlo_passes; 16s local ... 2025-03-14T06:43:02.3839513Z 2025-03-14T06:43:02.3840364Z  2025-03-14T06:43:02.3840832Z  2025-03-14T06:43:02.3841203Z  2025-03-14T06:43:02.3841861Z  2025-03-14T06:43:02.3842267Z  2025-03-14T06:43:02.3842647Z  2025-03-14T06:43:02.3843032Z  2025-03-14T06:43:02.3843535Z  2025-03-14T06:43:02.3844474Z [19,586 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:02.3845556Z @llvm-project//mlir:LinalgTransforms; 67s local 2025-03-14T06:43:02.3846387Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T06:43:02.3847363Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2025-03-14T06:43:02.3848305Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2025-03-14T06:43:02.3849228Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2025-03-14T06:43:02.3850225Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2025-03-14T06:43:02.3851133Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:43:02.3851864Z Compiling xla/service/transfer_manager.cc; 14s local ... 2025-03-14T06:43:02.5843318Z 2025-03-14T06:43:02.5844124Z  2025-03-14T06:43:02.5844786Z  2025-03-14T06:43:02.5845198Z  2025-03-14T06:43:02.5845603Z  2025-03-14T06:43:02.5846015Z  2025-03-14T06:43:02.5846413Z  2025-03-14T06:43:02.5846808Z  2025-03-14T06:43:02.5847212Z  2025-03-14T06:43:02.5848194Z [19,588 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:02.5849204Z @llvm-project//mlir:LinalgTransforms; 67s local 2025-03-14T06:43:02.5850096Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T06:43:02.5851067Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T06:43:02.5852156Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 31s local 2025-03-14T06:43:02.5853093Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2025-03-14T06:43:02.5854130Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2025-03-14T06:43:02.5855317Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:43:02.5856071Z Compiling xla/service/transfer_manager.cc; 15s local ... 2025-03-14T06:43:02.8492484Z 2025-03-14T06:43:02.8493348Z  2025-03-14T06:43:02.8493812Z  2025-03-14T06:43:02.8494198Z  2025-03-14T06:43:02.8494597Z  2025-03-14T06:43:02.8494986Z  2025-03-14T06:43:02.8495385Z  2025-03-14T06:43:02.8495803Z  2025-03-14T06:43:02.8496222Z  2025-03-14T06:43:02.8497402Z [19,590 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:02.8498345Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T06:43:02.8499188Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 53s local 2025-03-14T06:43:02.8500268Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T06:43:02.8501234Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 32s local 2025-03-14T06:43:02.8502225Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 25s local 2025-03-14T06:43:02.8503216Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2025-03-14T06:43:02.8504127Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:43:02.8504849Z Compiling xla/service/transfer_manager.cc; 15s local ... 2025-03-14T06:43:03.1842021Z 2025-03-14T06:43:03.1842846Z  2025-03-14T06:43:03.1843335Z  2025-03-14T06:43:03.1843764Z  2025-03-14T06:43:03.1844205Z  2025-03-14T06:43:03.1845005Z  2025-03-14T06:43:03.1845376Z  2025-03-14T06:43:03.1845731Z  2025-03-14T06:43:03.1846126Z  2025-03-14T06:43:03.1847046Z [19,591 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:03.1847953Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T06:43:03.1848767Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T06:43:03.1849955Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T06:43:03.1850913Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 32s local 2025-03-14T06:43:03.1851838Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2025-03-14T06:43:03.1852904Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2025-03-14T06:43:03.1853790Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:43:03.1854445Z Compiling xla/service/transfer_manager.cc; 15s local ... 2025-03-14T06:43:03.3849525Z 2025-03-14T06:43:03.3850362Z  2025-03-14T06:43:03.3850857Z  2025-03-14T06:43:03.3851296Z  2025-03-14T06:43:03.3851708Z  2025-03-14T06:43:03.3852093Z  2025-03-14T06:43:03.3852483Z  2025-03-14T06:43:03.3852840Z  2025-03-14T06:43:03.3853244Z  2025-03-14T06:43:03.3854168Z [19,591 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:03.3855155Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T06:43:03.3855913Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T06:43:03.3856786Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T06:43:03.3857665Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 32s local 2025-03-14T06:43:03.3858544Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2025-03-14T06:43:03.3859535Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2025-03-14T06:43:03.3860432Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:43:03.3861152Z Compiling xla/service/transfer_manager.cc; 15s local ... 2025-03-14T06:43:03.5852637Z 2025-03-14T06:43:03.5853497Z  2025-03-14T06:43:03.5854002Z  2025-03-14T06:43:03.5854443Z  2025-03-14T06:43:03.5854856Z  2025-03-14T06:43:03.5855264Z  2025-03-14T06:43:03.5855688Z  2025-03-14T06:43:03.5856126Z  2025-03-14T06:43:03.5856564Z  2025-03-14T06:43:03.5857902Z [19,593 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:03.5858880Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T06:43:03.5859695Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T06:43:03.5860686Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T06:43:03.5861612Z Compiling xla/mlir_hlo/transforms/bufferize_pass.cc; 32s local 2025-03-14T06:43:03.5862498Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2025-03-14T06:43:03.5863653Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2025-03-14T06:43:03.5864535Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:43:03.5865552Z Compiling xla/service/transfer_manager.cc; 16s local ... 2025-03-14T06:43:03.8228776Z 2025-03-14T06:43:03.8229587Z  2025-03-14T06:43:03.8230091Z  2025-03-14T06:43:03.8230509Z  2025-03-14T06:43:03.8230960Z  2025-03-14T06:43:03.8231307Z  2025-03-14T06:43:03.8231684Z  2025-03-14T06:43:03.8232048Z  2025-03-14T06:43:03.8232401Z  2025-03-14T06:43:03.8233334Z [19,599 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:03.8234290Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T06:43:03.8235142Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T06:43:03.8236073Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T06:43:03.8237334Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 26s local 2025-03-14T06:43:03.8238286Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2025-03-14T06:43:03.8239159Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:43:03.8239887Z Compiling xla/service/transfer_manager.cc; 16s local 2025-03-14T06:43:03.8240775Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local ... 2025-03-14T06:43:04.1562759Z 2025-03-14T06:43:04.1563612Z  2025-03-14T06:43:04.1564076Z  2025-03-14T06:43:04.1564443Z  2025-03-14T06:43:04.1564963Z  2025-03-14T06:43:04.1565518Z  2025-03-14T06:43:04.1565904Z  2025-03-14T06:43:04.1566262Z  2025-03-14T06:43:04.1566605Z  2025-03-14T06:43:04.1567582Z [19,601 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:04.1568472Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T06:43:04.1569256Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 54s local 2025-03-14T06:43:04.1570102Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T06:43:04.1570911Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2025-03-14T06:43:04.1571826Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2025-03-14T06:43:04.1572640Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:43:04.1573294Z Compiling xla/service/transfer_manager.cc; 16s local 2025-03-14T06:43:04.1574113Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local ... 2025-03-14T06:43:04.3858382Z 2025-03-14T06:43:04.3859223Z  2025-03-14T06:43:04.3859628Z  2025-03-14T06:43:04.3859967Z  2025-03-14T06:43:04.3860305Z  2025-03-14T06:43:04.3860648Z  2025-03-14T06:43:04.3860975Z  2025-03-14T06:43:04.3861287Z  2025-03-14T06:43:04.3861615Z  2025-03-14T06:43:04.3862459Z [19,601 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:04.3863273Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T06:43:04.3863962Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T06:43:04.3864739Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T06:43:04.3865800Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2025-03-14T06:43:04.3866946Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2025-03-14T06:43:04.3867686Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:43:04.3868284Z Compiling xla/service/transfer_manager.cc; 16s local 2025-03-14T06:43:04.3869002Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local ... 2025-03-14T06:43:04.6747588Z 2025-03-14T06:43:04.6748383Z  2025-03-14T06:43:04.6748886Z  2025-03-14T06:43:04.6749321Z  2025-03-14T06:43:04.6749781Z  2025-03-14T06:43:04.6750206Z  2025-03-14T06:43:04.6750629Z  2025-03-14T06:43:04.6751055Z  2025-03-14T06:43:04.6751718Z  2025-03-14T06:43:04.6752712Z [19,602 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:04.6753778Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T06:43:04.6754727Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T06:43:04.6755789Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T06:43:04.6756951Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2025-03-14T06:43:04.6758117Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T06:43:04.6759136Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:43:04.6759939Z Compiling xla/service/transfer_manager.cc; 17s local 2025-03-14T06:43:04.6760926Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 16s local ... 2025-03-14T06:43:04.9451598Z 2025-03-14T06:43:04.9452466Z  2025-03-14T06:43:04.9452958Z  2025-03-14T06:43:04.9453385Z  2025-03-14T06:43:04.9453767Z  2025-03-14T06:43:04.9454145Z  2025-03-14T06:43:04.9454514Z  2025-03-14T06:43:04.9454902Z  2025-03-14T06:43:04.9455288Z  2025-03-14T06:43:04.9456193Z [19,606 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:04.9457154Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T06:43:04.9458249Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 55s local 2025-03-14T06:43:04.9459202Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T06:43:04.9460124Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 27s local 2025-03-14T06:43:04.9461269Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T06:43:04.9462177Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:43:04.9462937Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 17s local 2025-03-14T06:43:04.9463977Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local ... 2025-03-14T06:43:05.1722799Z 2025-03-14T06:43:05.1723584Z  2025-03-14T06:43:05.1724054Z  2025-03-14T06:43:05.1724458Z  2025-03-14T06:43:05.1725028Z  2025-03-14T06:43:05.1725417Z  2025-03-14T06:43:05.1725798Z  2025-03-14T06:43:05.1726190Z  2025-03-14T06:43:05.1726597Z  2025-03-14T06:43:05.1727512Z [19,607 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:05.1728490Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T06:43:05.1729335Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T06:43:05.1730238Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T06:43:05.1731399Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 28s local 2025-03-14T06:43:05.1732458Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T06:43:05.1733359Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:43:05.1734120Z Compiling xla/backends/cpu/runtime/dot_thunk.cc; 17s local 2025-03-14T06:43:05.1735251Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 16s local ... 2025-03-14T06:43:05.3866672Z 2025-03-14T06:43:05.3867685Z  2025-03-14T06:43:05.3868264Z  2025-03-14T06:43:05.3868798Z  2025-03-14T06:43:05.3869236Z  2025-03-14T06:43:05.3869667Z  2025-03-14T06:43:05.3870326Z  2025-03-14T06:43:05.3870740Z  2025-03-14T06:43:05.3871128Z  2025-03-14T06:43:05.3872058Z [19,608 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:05.3872899Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T06:43:05.3873607Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T06:43:05.3874409Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T06:43:05.3875467Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 28s local 2025-03-14T06:43:05.3876484Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T06:43:05.3877384Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:43:05.3878227Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2025-03-14T06:43:05.3879346Z Compiling mlir/lib/Dialect/Linalg/Transforms/Specialize.cpp; 16s local ... 2025-03-14T06:43:05.6617810Z 2025-03-14T06:43:05.6618604Z  2025-03-14T06:43:05.6619084Z  2025-03-14T06:43:05.6619509Z  2025-03-14T06:43:05.6619921Z  2025-03-14T06:43:05.6620323Z  2025-03-14T06:43:05.6620730Z  2025-03-14T06:43:05.6621114Z  2025-03-14T06:43:05.6621508Z  2025-03-14T06:43:05.6622434Z [19,609 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:05.6623788Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T06:43:05.6624657Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T06:43:05.6625642Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T06:43:05.6626639Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 28s local 2025-03-14T06:43:05.6627761Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T06:43:05.6628804Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:43:05.6629728Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2025-03-14T06:43:05.6630905Z Compiling mlir/lib/Dialect/Linalg/Transforms/Specialize.cpp; 16s local ... 2025-03-14T06:43:05.9871783Z 2025-03-14T06:43:05.9872628Z  2025-03-14T06:43:05.9882474Z  2025-03-14T06:43:05.9883211Z  2025-03-14T06:43:05.9883629Z  2025-03-14T06:43:05.9884074Z  2025-03-14T06:43:05.9884489Z  2025-03-14T06:43:05.9885116Z  2025-03-14T06:43:05.9885491Z  2025-03-14T06:43:05.9886444Z [19,611 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:05.9887486Z @llvm-project//mlir:LinalgTransforms; 71s local 2025-03-14T06:43:05.9888345Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 56s local 2025-03-14T06:43:05.9889328Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T06:43:05.9890316Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 28s local 2025-03-14T06:43:05.9891446Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T06:43:05.9892376Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:43:05.9893275Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2025-03-14T06:43:05.9894464Z Compiling mlir/lib/Dialect/Linalg/Transforms/Specialize.cpp; 17s local ... 2025-03-14T06:43:06.1875244Z 2025-03-14T06:43:06.1876077Z  2025-03-14T06:43:06.1876598Z  2025-03-14T06:43:06.1877005Z  2025-03-14T06:43:06.1877423Z  2025-03-14T06:43:06.1877860Z  2025-03-14T06:43:06.1878267Z  2025-03-14T06:43:06.1878669Z  2025-03-14T06:43:06.1879087Z  2025-03-14T06:43:06.1880067Z [19,612 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:06.1881053Z @llvm-project//mlir:LinalgTransforms; 71s local 2025-03-14T06:43:06.1881906Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T06:43:06.1883151Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T06:43:06.1884132Z Compiling llvm/lib/Target/X86/X86ISelDAGToDAG.cpp; 29s local 2025-03-14T06:43:06.1885267Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T06:43:06.1886176Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:43:06.1886984Z Compiling llvm/lib/CodeGen/SelectionDAG/LegalizeDAG.cpp; 17s local 2025-03-14T06:43:06.1888074Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 17s local ... 2025-03-14T06:43:06.5799446Z 2025-03-14T06:43:06.5800335Z  2025-03-14T06:43:06.5800847Z  2025-03-14T06:43:06.5801275Z  2025-03-14T06:43:06.5801710Z  2025-03-14T06:43:06.5802134Z  2025-03-14T06:43:06.5802552Z  2025-03-14T06:43:06.5802960Z  2025-03-14T06:43:06.5803372Z  2025-03-14T06:43:06.5804362Z [19,615 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:06.5805590Z @llvm-project//mlir:LinalgTransforms; 71s local 2025-03-14T06:43:06.5806484Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T06:43:06.5807609Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T06:43:06.5808640Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T06:43:06.5809529Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:43:06.5810608Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 17s local 2025-03-14T06:43:06.5811618Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2025-03-14T06:43:06.5812581Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 14s local ... 2025-03-14T06:43:06.7878506Z 2025-03-14T06:43:06.7879353Z  2025-03-14T06:43:06.7879853Z  2025-03-14T06:43:06.7880271Z  2025-03-14T06:43:06.7880708Z  2025-03-14T06:43:06.7881516Z  2025-03-14T06:43:06.7881962Z  2025-03-14T06:43:06.7882409Z  2025-03-14T06:43:06.7882790Z  2025-03-14T06:43:06.7883704Z [19,616 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:06.7884927Z @llvm-project//mlir:LinalgTransforms; 71s local 2025-03-14T06:43:06.7885858Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 57s local 2025-03-14T06:43:06.7886868Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T06:43:06.7887990Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T06:43:06.7888956Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:43:06.7889855Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 17s local 2025-03-14T06:43:06.7890959Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 17s local 2025-03-14T06:43:06.7891973Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 14s local ... 2025-03-14T06:43:07.1879242Z 2025-03-14T06:43:07.1880094Z  2025-03-14T06:43:07.1880642Z  2025-03-14T06:43:07.1881068Z  2025-03-14T06:43:07.1881482Z  2025-03-14T06:43:07.1881890Z  2025-03-14T06:43:07.1882293Z  2025-03-14T06:43:07.1882701Z  2025-03-14T06:43:07.1883111Z  2025-03-14T06:43:07.1884054Z [19,617 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:07.1885258Z @llvm-project//mlir:LinalgTransforms; 72s local 2025-03-14T06:43:07.1886127Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2025-03-14T06:43:07.1887152Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T06:43:07.1888204Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T06:43:07.1889107Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:43:07.1889952Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 18s local 2025-03-14T06:43:07.1890975Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2025-03-14T06:43:07.1892245Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 14s local ... 2025-03-14T06:43:07.8690799Z 2025-03-14T06:43:07.8691637Z  2025-03-14T06:43:07.8692154Z  2025-03-14T06:43:07.8692617Z  2025-03-14T06:43:07.8693041Z  2025-03-14T06:43:07.8693471Z  2025-03-14T06:43:07.8693893Z  2025-03-14T06:43:07.8694318Z  2025-03-14T06:43:07.8694733Z  2025-03-14T06:43:07.8695962Z [19,618 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:07.8696968Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T06:43:07.8697833Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 58s local 2025-03-14T06:43:07.8698792Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T06:43:07.8699787Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T06:43:07.8700737Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:43:07.8701566Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 19s local 2025-03-14T06:43:07.8702546Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 18s local 2025-03-14T06:43:07.8703559Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 15s local ... 2025-03-14T06:43:08.1886658Z 2025-03-14T06:43:08.1887670Z  2025-03-14T06:43:08.1888204Z  2025-03-14T06:43:08.1888686Z  2025-03-14T06:43:08.1889378Z  2025-03-14T06:43:08.1889771Z  2025-03-14T06:43:08.1890162Z  2025-03-14T06:43:08.1890556Z  2025-03-14T06:43:08.1890935Z  2025-03-14T06:43:08.1891756Z [19,618 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:08.1892666Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T06:43:08.1893481Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T06:43:08.1894671Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T06:43:08.1895711Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T06:43:08.1896566Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:43:08.1897416Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 19s local 2025-03-14T06:43:08.1898288Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2025-03-14T06:43:08.1899239Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 15s local ... 2025-03-14T06:43:08.3888698Z 2025-03-14T06:43:08.3890002Z  2025-03-14T06:43:08.3890537Z  2025-03-14T06:43:08.3890950Z  2025-03-14T06:43:08.3891351Z  2025-03-14T06:43:08.3891739Z  2025-03-14T06:43:08.3892133Z  2025-03-14T06:43:08.3892528Z  2025-03-14T06:43:08.3892914Z  2025-03-14T06:43:08.3893874Z [19,619 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:08.3894862Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T06:43:08.3895675Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T06:43:08.3896604Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T06:43:08.3897658Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T06:43:08.3898581Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:43:08.3899362Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 19s local 2025-03-14T06:43:08.3900283Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2025-03-14T06:43:08.3901217Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local ... 2025-03-14T06:43:08.8343804Z 2025-03-14T06:43:08.8344658Z  2025-03-14T06:43:08.8345144Z  2025-03-14T06:43:08.8345551Z  2025-03-14T06:43:08.8345996Z  2025-03-14T06:43:08.8346432Z  2025-03-14T06:43:08.8346829Z  2025-03-14T06:43:08.8347254Z  2025-03-14T06:43:08.8347642Z  2025-03-14T06:43:08.8348850Z [19,620 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:08.8349918Z @llvm-project//mlir:LinalgTransforms; 74s local 2025-03-14T06:43:08.8350719Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 59s local 2025-03-14T06:43:08.8351589Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2025-03-14T06:43:08.8352632Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2025-03-14T06:43:08.8353570Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:43:08.8354598Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 19s local 2025-03-14T06:43:08.8355607Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 19s local 2025-03-14T06:43:08.8356553Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local ... 2025-03-14T06:43:09.1894567Z 2025-03-14T06:43:09.1895483Z  2025-03-14T06:43:09.1896014Z  2025-03-14T06:43:09.1896464Z  2025-03-14T06:43:09.1896867Z  2025-03-14T06:43:09.1897284Z  2025-03-14T06:43:09.1897674Z  2025-03-14T06:43:09.1898079Z  2025-03-14T06:43:09.1898483Z  2025-03-14T06:43:09.1899411Z [19,620 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:09.1900400Z @llvm-project//mlir:LinalgTransforms; 74s local 2025-03-14T06:43:09.1901228Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T06:43:09.1902465Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2025-03-14T06:43:09.1903569Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2025-03-14T06:43:09.1904477Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:43:09.1905291Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 20s local 2025-03-14T06:43:09.1906254Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2025-03-14T06:43:09.1907479Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 16s local ... 2025-03-14T06:43:09.5898816Z 2025-03-14T06:43:09.5899623Z  2025-03-14T06:43:09.5900045Z  2025-03-14T06:43:09.5900390Z  2025-03-14T06:43:09.5900740Z  2025-03-14T06:43:09.5901080Z  2025-03-14T06:43:09.5901421Z  2025-03-14T06:43:09.5901949Z  2025-03-14T06:43:09.5902307Z  2025-03-14T06:43:09.5903162Z [19,621 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:09.5904046Z @llvm-project//mlir:LinalgTransforms; 74s local 2025-03-14T06:43:09.5904767Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T06:43:09.5905593Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T06:43:09.5906494Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T06:43:09.5907253Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:43:09.5908014Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 20s local 2025-03-14T06:43:09.5908897Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2025-03-14T06:43:09.5909714Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local ... 2025-03-14T06:43:09.8869268Z 2025-03-14T06:43:09.8870128Z  2025-03-14T06:43:09.8870563Z  2025-03-14T06:43:09.8870979Z  2025-03-14T06:43:09.8871377Z  2025-03-14T06:43:09.8871745Z  2025-03-14T06:43:09.8872102Z  2025-03-14T06:43:09.8872508Z  2025-03-14T06:43:09.8872910Z  2025-03-14T06:43:09.8873884Z [19,622 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:09.8874813Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T06:43:09.8875659Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T06:43:09.8876565Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T06:43:09.8878022Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T06:43:09.8878893Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:43:09.8879690Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local 2025-03-14T06:43:09.8880582Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 20s local 2025-03-14T06:43:09.8881394Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local ... 2025-03-14T06:43:10.1647283Z 2025-03-14T06:43:10.1648219Z  2025-03-14T06:43:10.1648683Z  2025-03-14T06:43:10.1649121Z  2025-03-14T06:43:10.1649538Z  2025-03-14T06:43:10.1650176Z  2025-03-14T06:43:10.1650630Z  2025-03-14T06:43:10.1651056Z  2025-03-14T06:43:10.1651459Z  2025-03-14T06:43:10.1652462Z [19,624 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:10.1653435Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T06:43:10.1654318Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 60s local 2025-03-14T06:43:10.1655298Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T06:43:10.1656338Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T06:43:10.1657285Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:43:10.1658137Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local 2025-03-14T06:43:10.1659107Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2025-03-14T06:43:10.1660321Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local ... 2025-03-14T06:43:10.3750782Z 2025-03-14T06:43:10.3751609Z  2025-03-14T06:43:10.3752087Z  2025-03-14T06:43:10.3752494Z  2025-03-14T06:43:10.3752912Z  2025-03-14T06:43:10.3753316Z  2025-03-14T06:43:10.3753698Z  2025-03-14T06:43:10.3754052Z  2025-03-14T06:43:10.3754448Z  2025-03-14T06:43:10.3755383Z [19,628 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:10.3756553Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T06:43:10.3757316Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2025-03-14T06:43:10.3758336Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T06:43:10.3759365Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T06:43:10.3760262Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:43:10.3761085Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local 2025-03-14T06:43:10.3762014Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2025-03-14T06:43:10.3763039Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 17s local ... 2025-03-14T06:43:10.5906368Z 2025-03-14T06:43:10.5907220Z  2025-03-14T06:43:10.5907700Z  2025-03-14T06:43:10.5908094Z  2025-03-14T06:43:10.5908485Z  2025-03-14T06:43:10.5908896Z  2025-03-14T06:43:10.5909306Z  2025-03-14T06:43:10.5909741Z  2025-03-14T06:43:10.5910179Z  2025-03-14T06:43:10.5911127Z [19,630 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:10.5912171Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T06:43:10.5913045Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2025-03-14T06:43:10.5914125Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2025-03-14T06:43:10.5915041Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:43:10.5915933Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 21s local 2025-03-14T06:43:10.5916970Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2025-03-14T06:43:10.5917953Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2025-03-14T06:43:10.5919161Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 16s local ... 2025-03-14T06:43:10.8850492Z 2025-03-14T06:43:10.8851262Z  2025-03-14T06:43:10.8852269Z  2025-03-14T06:43:10.8852705Z  2025-03-14T06:43:10.8853100Z  2025-03-14T06:43:10.8853498Z  2025-03-14T06:43:10.8853881Z  2025-03-14T06:43:10.8854266Z  2025-03-14T06:43:10.8854665Z  2025-03-14T06:43:10.8855597Z [19,631 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:10.8856623Z @llvm-project//mlir:LinalgTransforms; 76s local 2025-03-14T06:43:10.8857765Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 61s local 2025-03-14T06:43:10.8858833Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2025-03-14T06:43:10.8859759Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:43:10.8860632Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local 2025-03-14T06:43:10.8861653Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 21s local 2025-03-14T06:43:10.8862650Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2025-03-14T06:43:10.8863771Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 16s local ... 2025-03-14T06:43:11.1816987Z 2025-03-14T06:43:11.1817931Z  2025-03-14T06:43:11.1818407Z  2025-03-14T06:43:11.1818853Z  2025-03-14T06:43:11.1819318Z  2025-03-14T06:43:11.1819686Z  2025-03-14T06:43:11.1820056Z  2025-03-14T06:43:11.1820426Z  2025-03-14T06:43:11.1820796Z  2025-03-14T06:43:11.1822021Z [19,633 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:11.1822940Z @llvm-project//mlir:LinalgTransforms; 76s local 2025-03-14T06:43:11.1823724Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T06:43:11.1824749Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2025-03-14T06:43:11.1825609Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:43:11.1826640Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local 2025-03-14T06:43:11.1827448Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2025-03-14T06:43:11.1828358Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 18s local 2025-03-14T06:43:11.1829237Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 16s local ... 2025-03-14T06:43:11.3912539Z 2025-03-14T06:43:11.3913401Z  2025-03-14T06:43:11.3913912Z  2025-03-14T06:43:11.3914345Z  2025-03-14T06:43:11.3914783Z  2025-03-14T06:43:11.3915184Z  2025-03-14T06:43:11.3915608Z  2025-03-14T06:43:11.3916014Z  2025-03-14T06:43:11.3916430Z  2025-03-14T06:43:11.3917408Z [19,634 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:11.3918480Z @llvm-project//mlir:LinalgTransforms; 76s local 2025-03-14T06:43:11.3919388Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T06:43:11.3920498Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2025-03-14T06:43:11.3921445Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:43:11.3922355Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local 2025-03-14T06:43:11.3923389Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2025-03-14T06:43:11.3924375Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2025-03-14T06:43:11.3925585Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 17s local ... 2025-03-14T06:43:11.7109480Z 2025-03-14T06:43:11.7110336Z  2025-03-14T06:43:11.7110850Z  2025-03-14T06:43:11.7111350Z  2025-03-14T06:43:11.7111753Z  2025-03-14T06:43:11.7112170Z  2025-03-14T06:43:11.7112556Z  2025-03-14T06:43:11.7112925Z  2025-03-14T06:43:11.7113334Z  2025-03-14T06:43:11.7114434Z [19,636 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:11.7115769Z @llvm-project//mlir:LinalgTransforms; 76s local 2025-03-14T06:43:11.7117154Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T06:43:11.7118228Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2025-03-14T06:43:11.7119327Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:43:11.7120318Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 22s local 2025-03-14T06:43:11.7121498Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 22s local 2025-03-14T06:43:11.7122834Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2025-03-14T06:43:11.7124243Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 17s local ... 2025-03-14T06:43:11.9712849Z 2025-03-14T06:43:11.9713719Z  2025-03-14T06:43:11.9714216Z  2025-03-14T06:43:11.9714697Z  2025-03-14T06:43:11.9715083Z  2025-03-14T06:43:11.9715462Z  2025-03-14T06:43:11.9715848Z  2025-03-14T06:43:11.9716278Z  2025-03-14T06:43:11.9716692Z  2025-03-14T06:43:11.9717652Z [19,639 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:11.9718626Z @llvm-project//mlir:LinalgTransforms; 77s local 2025-03-14T06:43:11.9719463Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 62s local 2025-03-14T06:43:11.9720486Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2025-03-14T06:43:11.9721415Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T06:43:11.9722577Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2025-03-14T06:43:11.9723554Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2025-03-14T06:43:11.9724464Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2025-03-14T06:43:11.9725625Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 17s local ... 2025-03-14T06:43:12.1919250Z 2025-03-14T06:43:12.1920109Z  2025-03-14T06:43:12.1920975Z  2025-03-14T06:43:12.1921403Z  2025-03-14T06:43:12.1921821Z  2025-03-14T06:43:12.1922228Z  2025-03-14T06:43:12.1922634Z  2025-03-14T06:43:12.1923041Z  2025-03-14T06:43:12.1923441Z  2025-03-14T06:43:12.1924388Z [19,640 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:12.1925478Z @llvm-project//mlir:LinalgTransforms; 77s local 2025-03-14T06:43:12.1926328Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T06:43:12.1927886Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2025-03-14T06:43:12.1928984Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T06:43:12.1929910Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2025-03-14T06:43:12.1931049Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2025-03-14T06:43:12.1932144Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 19s local 2025-03-14T06:43:12.1933410Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local ... 2025-03-14T06:43:12.7479683Z 2025-03-14T06:43:12.7481590Z  2025-03-14T06:43:12.7482145Z  2025-03-14T06:43:12.7482603Z  2025-03-14T06:43:12.7483030Z  2025-03-14T06:43:12.7483437Z  2025-03-14T06:43:12.7483866Z  2025-03-14T06:43:12.7484286Z  2025-03-14T06:43:12.7484859Z  2025-03-14T06:43:12.7485862Z [19,641 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:12.7486920Z @llvm-project//mlir:LinalgTransforms; 77s local 2025-03-14T06:43:12.7487816Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T06:43:12.7489025Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2025-03-14T06:43:12.7489969Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:43:12.7490812Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 23s local 2025-03-14T06:43:12.7492079Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 23s local 2025-03-14T06:43:12.7493040Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2025-03-14T06:43:12.7493969Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local ... 2025-03-14T06:43:12.9926009Z 2025-03-14T06:43:12.9926914Z  2025-03-14T06:43:12.9927415Z  2025-03-14T06:43:12.9927859Z  2025-03-14T06:43:12.9928277Z  2025-03-14T06:43:12.9928653Z  2025-03-14T06:43:12.9929071Z  2025-03-14T06:43:12.9929485Z  2025-03-14T06:43:12.9929929Z  2025-03-14T06:43:12.9931162Z [19,641 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:12.9932181Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T06:43:12.9933038Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 63s local 2025-03-14T06:43:12.9934116Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2025-03-14T06:43:12.9935064Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:43:12.9935947Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T06:43:12.9936947Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2025-03-14T06:43:12.9937826Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2025-03-14T06:43:12.9938837Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 18s local ... 2025-03-14T06:43:13.1928648Z 2025-03-14T06:43:13.1929481Z  2025-03-14T06:43:13.1929915Z  2025-03-14T06:43:13.1930240Z  2025-03-14T06:43:13.1930606Z  2025-03-14T06:43:13.1930954Z  2025-03-14T06:43:13.1931291Z  2025-03-14T06:43:13.1931627Z  2025-03-14T06:43:13.1931986Z  2025-03-14T06:43:13.1932823Z [19,644 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:13.1933748Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T06:43:13.1934792Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T06:43:13.1935770Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2025-03-14T06:43:13.1936597Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:43:13.1937309Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T06:43:13.1938228Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2025-03-14T06:43:13.1939078Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 20s local 2025-03-14T06:43:13.1940085Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local ... 2025-03-14T06:43:13.4950042Z 2025-03-14T06:43:13.4950882Z  2025-03-14T06:43:13.4951288Z  2025-03-14T06:43:13.4951607Z  2025-03-14T06:43:13.4951928Z  2025-03-14T06:43:13.4952246Z  2025-03-14T06:43:13.4952554Z  2025-03-14T06:43:13.4952872Z  2025-03-14T06:43:13.4953181Z  2025-03-14T06:43:13.4953978Z [19,646 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:13.4954751Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T06:43:13.4955406Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T06:43:13.4956205Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T06:43:13.4957026Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:43:13.4957687Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T06:43:13.4958507Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2025-03-14T06:43:13.4959225Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2025-03-14T06:43:13.4960034Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local ... 2025-03-14T06:43:13.7934015Z 2025-03-14T06:43:13.7934881Z  2025-03-14T06:43:13.7935333Z  2025-03-14T06:43:13.7935679Z  2025-03-14T06:43:13.7936067Z  2025-03-14T06:43:13.7936432Z  2025-03-14T06:43:13.7937167Z  2025-03-14T06:43:13.7937603Z  2025-03-14T06:43:13.7937981Z  2025-03-14T06:43:13.7939043Z [19,648 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:13.7940032Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T06:43:13.7940867Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 64s local 2025-03-14T06:43:13.7941919Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T06:43:13.7942951Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:43:13.7943798Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 24s local 2025-03-14T06:43:13.7944702Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 24s local 2025-03-14T06:43:13.7945633Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2025-03-14T06:43:13.7946544Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 19s local ... 2025-03-14T06:43:14.1938746Z 2025-03-14T06:43:14.1939656Z  2025-03-14T06:43:14.1940172Z  2025-03-14T06:43:14.1940601Z  2025-03-14T06:43:14.1941009Z  2025-03-14T06:43:14.1941450Z  2025-03-14T06:43:14.1941877Z  2025-03-14T06:43:14.1942310Z  2025-03-14T06:43:14.1942716Z  2025-03-14T06:43:14.1943692Z [19,649 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:14.1945000Z @llvm-project//mlir:LinalgTransforms; 79s local 2025-03-14T06:43:14.1945906Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T06:43:14.1946982Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T06:43:14.1947920Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:43:14.1948815Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2025-03-14T06:43:14.1949850Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2025-03-14T06:43:14.1951035Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 21s local 2025-03-14T06:43:14.1952129Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local ... 2025-03-14T06:43:14.3941346Z 2025-03-14T06:43:14.3942197Z  2025-03-14T06:43:14.3942628Z  2025-03-14T06:43:14.3943033Z  2025-03-14T06:43:14.3943400Z  2025-03-14T06:43:14.3943783Z  2025-03-14T06:43:14.3944147Z  2025-03-14T06:43:14.3944508Z  2025-03-14T06:43:14.3944912Z  2025-03-14T06:43:14.3945776Z [19,650 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:14.3946691Z @llvm-project//mlir:LinalgTransforms; 79s local 2025-03-14T06:43:14.3947486Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T06:43:14.3948386Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T06:43:14.3949189Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:43:14.3949936Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2025-03-14T06:43:14.3950833Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2025-03-14T06:43:14.3951670Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2025-03-14T06:43:14.3952617Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local ... 2025-03-14T06:43:14.6666046Z 2025-03-14T06:43:14.6666896Z  2025-03-14T06:43:14.6667513Z  2025-03-14T06:43:14.6667998Z  2025-03-14T06:43:14.6668431Z  2025-03-14T06:43:14.6668830Z  2025-03-14T06:43:14.6669253Z  2025-03-14T06:43:14.6669646Z  2025-03-14T06:43:14.6670073Z  2025-03-14T06:43:14.6670996Z [19,651 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:14.6671971Z @llvm-project//mlir:LinalgTransforms; 79s local 2025-03-14T06:43:14.6672815Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T06:43:14.6674164Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T06:43:14.6675094Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:43:14.6675943Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 25s local 2025-03-14T06:43:14.6677007Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 25s local 2025-03-14T06:43:14.6678029Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2025-03-14T06:43:14.6679157Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local ... 2025-03-14T06:43:14.9947305Z 2025-03-14T06:43:14.9948284Z  2025-03-14T06:43:14.9948788Z  2025-03-14T06:43:14.9949210Z  2025-03-14T06:43:14.9949678Z  2025-03-14T06:43:14.9950111Z  2025-03-14T06:43:14.9950530Z  2025-03-14T06:43:14.9950961Z  2025-03-14T06:43:14.9951386Z  2025-03-14T06:43:14.9952397Z [19,651 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:14.9953218Z @llvm-project//mlir:LinalgTransforms; 80s local 2025-03-14T06:43:14.9953973Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 65s local 2025-03-14T06:43:14.9955080Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T06:43:14.9956044Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:43:14.9956750Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2025-03-14T06:43:14.9957871Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2025-03-14T06:43:14.9958784Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 22s local 2025-03-14T06:43:14.9959835Z Compiling xla/backends/cpu/runtime/custom_call_thunk.cc; 20s local ... 2025-03-14T06:43:15.4185661Z 2025-03-14T06:43:15.4187107Z  2025-03-14T06:43:15.4187611Z  2025-03-14T06:43:15.4189199Z  2025-03-14T06:43:15.4190225Z  2025-03-14T06:43:15.4191425Z  2025-03-14T06:43:15.4192956Z  2025-03-14T06:43:15.4194233Z  2025-03-14T06:43:15.4195680Z  2025-03-14T06:43:15.4197619Z [19,652 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:15.4198734Z @llvm-project//mlir:LinalgTransforms; 80s local 2025-03-14T06:43:15.4199545Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T06:43:15.4200609Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T06:43:15.4201552Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:43:15.4202426Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2025-03-14T06:43:15.4203391Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2025-03-14T06:43:15.4204327Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2025-03-14T06:43:15.4205388Z Compiling xla/service/spmd/dot_handler.cc; 19s local ... 2025-03-14T06:43:15.7953962Z 2025-03-14T06:43:15.7955510Z  2025-03-14T06:43:15.7956039Z  2025-03-14T06:43:15.7957449Z  2025-03-14T06:43:15.7958532Z  2025-03-14T06:43:15.7959671Z  2025-03-14T06:43:15.7961091Z  2025-03-14T06:43:15.7962365Z  2025-03-14T06:43:15.7963691Z  2025-03-14T06:43:15.7966110Z [19,652 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:15.7967119Z @llvm-project//mlir:LinalgTransforms; 80s local 2025-03-14T06:43:15.7967932Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T06:43:15.7968722Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T06:43:15.7969454Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:43:15.7970302Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 26s local 2025-03-14T06:43:15.7971331Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 26s local 2025-03-14T06:43:15.7972308Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2025-03-14T06:43:15.7973527Z Compiling xla/service/spmd/dot_handler.cc; 19s local ... 2025-03-14T06:43:16.0051915Z 2025-03-14T06:43:16.0052772Z  2025-03-14T06:43:16.0053258Z  2025-03-14T06:43:16.0053641Z  2025-03-14T06:43:16.0054007Z  2025-03-14T06:43:16.0054401Z  2025-03-14T06:43:16.0054801Z  2025-03-14T06:43:16.0055197Z  2025-03-14T06:43:16.0055589Z  2025-03-14T06:43:16.0056496Z [19,654 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:16.0057773Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T06:43:16.0058613Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 66s local 2025-03-14T06:43:16.0059628Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T06:43:16.0060474Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:43:16.0061306Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T06:43:16.0062292Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2025-03-14T06:43:16.0063221Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 23s local 2025-03-14T06:43:16.0064099Z Compiling xla/service/spmd/dot_handler.cc; 19s local ... 2025-03-14T06:43:16.3960214Z 2025-03-14T06:43:16.3961053Z  2025-03-14T06:43:16.3961503Z  2025-03-14T06:43:16.3961889Z  2025-03-14T06:43:16.3962275Z  2025-03-14T06:43:16.3962657Z  2025-03-14T06:43:16.3963418Z  2025-03-14T06:43:16.3963855Z  2025-03-14T06:43:16.3964271Z  2025-03-14T06:43:16.3965617Z [19,654 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:16.3966602Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T06:43:16.3967476Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T06:43:16.3968549Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T06:43:16.3969734Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:43:16.3970646Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T06:43:16.3971668Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2025-03-14T06:43:16.3972607Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T06:43:16.3973580Z Compiling xla/service/spmd/dot_handler.cc; 20s local ... 2025-03-14T06:43:16.6545084Z 2025-03-14T06:43:16.6546018Z  2025-03-14T06:43:16.6546518Z  2025-03-14T06:43:16.6546939Z  2025-03-14T06:43:16.6547358Z  2025-03-14T06:43:16.6547792Z  2025-03-14T06:43:16.6548221Z  2025-03-14T06:43:16.6548609Z  2025-03-14T06:43:16.6549034Z  2025-03-14T06:43:16.6549999Z [19,655 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:16.6551012Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T06:43:16.6551907Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T06:43:16.6552999Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2025-03-14T06:43:16.6553886Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:43:16.6554590Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 27s local 2025-03-14T06:43:16.6555490Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2025-03-14T06:43:16.6556511Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T06:43:16.6557465Z Compiling xla/service/spmd/dot_handler.cc; 20s local ... 2025-03-14T06:43:16.8619827Z 2025-03-14T06:43:16.8620691Z  2025-03-14T06:43:16.8621151Z  2025-03-14T06:43:16.8621551Z  2025-03-14T06:43:16.8621947Z  2025-03-14T06:43:16.8622342Z  2025-03-14T06:43:16.8622727Z  2025-03-14T06:43:16.8623109Z  2025-03-14T06:43:16.8623498Z  2025-03-14T06:43:16.8624675Z [19,658 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:16.8625662Z @llvm-project//mlir:LinalgTransforms; 82s local 2025-03-14T06:43:16.8626506Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 67s local 2025-03-14T06:43:16.8627530Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2025-03-14T06:43:16.8628896Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:43:16.8629817Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T06:43:16.8631137Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 27s local 2025-03-14T06:43:16.8632210Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T06:43:16.8633210Z Compiling xla/service/spmd/dot_handler.cc; 20s local ... 2025-03-14T06:43:17.1966719Z 2025-03-14T06:43:17.1967626Z  2025-03-14T06:43:17.1970281Z  2025-03-14T06:43:17.1970725Z  2025-03-14T06:43:17.1971124Z  2025-03-14T06:43:17.1971555Z  2025-03-14T06:43:17.1971950Z  2025-03-14T06:43:17.1972349Z  2025-03-14T06:43:17.1972761Z  2025-03-14T06:43:17.1973728Z [19,658 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:17.1974784Z @llvm-project//mlir:LinalgTransforms; 82s local 2025-03-14T06:43:17.1975650Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T06:43:17.1976675Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2025-03-14T06:43:17.1977821Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:43:17.1978743Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T06:43:17.1979772Z Compiling llvm/lib/CodeGen/CodeGenPrepare.cpp; 28s local 2025-03-14T06:43:17.1980682Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 24s local 2025-03-14T06:43:17.1981599Z Compiling xla/service/spmd/dot_handler.cc; 21s local ... 2025-03-14T06:43:17.8127736Z 2025-03-14T06:43:17.8128568Z  2025-03-14T06:43:17.8129047Z  2025-03-14T06:43:17.8129407Z  2025-03-14T06:43:17.8129762Z  2025-03-14T06:43:17.8130136Z  2025-03-14T06:43:17.8130489Z  2025-03-14T06:43:17.8130826Z  2025-03-14T06:43:17.8131176Z  2025-03-14T06:43:17.8132002Z [19,660 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:43:17.8132872Z @llvm-project//mlir:LinalgTransforms; 83s local 2025-03-14T06:43:17.8133658Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 68s local 2025-03-14T06:43:17.8134618Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2025-03-14T06:43:17.8135459Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:43:17.8136222Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 28s local 2025-03-14T06:43:17.8137156Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T06:43:17.8138017Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2025-03-14T06:43:17.8138979Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 21s local ... 2025-03-14T06:43:18.1976164Z 2025-03-14T06:43:18.1976945Z  2025-03-14T06:43:18.1977358Z  2025-03-14T06:43:18.1977688Z  2025-03-14T06:43:18.1978013Z  2025-03-14T06:43:18.1978340Z  2025-03-14T06:43:18.1978668Z  2025-03-14T06:43:18.1978993Z  2025-03-14T06:43:18.1979315Z  2025-03-14T06:43:18.1980125Z [19,660 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:18.1980903Z @llvm-project//mlir:LinalgTransforms; 83s local 2025-03-14T06:43:18.1981582Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T06:43:18.1982388Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2025-03-14T06:43:18.1983103Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:43:18.1983780Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2025-03-14T06:43:18.1984898Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 25s local 2025-03-14T06:43:18.1985606Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2025-03-14T06:43:18.1986384Z Compiling mlir/lib/Dialect/Linalg/Transforms/Promotion.cpp; 22s local ... 2025-03-14T06:43:18.3986191Z 2025-03-14T06:43:18.3987049Z  2025-03-14T06:43:18.3987534Z  2025-03-14T06:43:18.3987927Z  2025-03-14T06:43:18.3988411Z  2025-03-14T06:43:18.3988826Z  2025-03-14T06:43:18.3989211Z  2025-03-14T06:43:18.3989882Z  2025-03-14T06:43:18.3990317Z  2025-03-14T06:43:18.3991261Z [19,661 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:18.3992206Z @llvm-project//mlir:LinalgTransforms; 83s local 2025-03-14T06:43:18.3992994Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T06:43:18.3994181Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2025-03-14T06:43:18.3995045Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:43:18.3995894Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2025-03-14T06:43:18.3996914Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2025-03-14T06:43:18.3997810Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2025-03-14T06:43:18.3998734Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 21s local ... 2025-03-14T06:43:18.7981461Z 2025-03-14T06:43:18.7982302Z  2025-03-14T06:43:18.7982823Z  2025-03-14T06:43:18.7983231Z  2025-03-14T06:43:18.7983609Z  2025-03-14T06:43:18.7984000Z  2025-03-14T06:43:18.7984379Z  2025-03-14T06:43:18.7984763Z  2025-03-14T06:43:18.7985156Z  2025-03-14T06:43:18.7986051Z [19,661 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:18.7987294Z @llvm-project//mlir:LinalgTransforms; 83s local 2025-03-14T06:43:18.7988114Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 69s local 2025-03-14T06:43:18.7989169Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2025-03-14T06:43:18.7990063Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:43:18.7990905Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 29s local 2025-03-14T06:43:18.7991905Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2025-03-14T06:43:18.7992721Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2025-03-14T06:43:18.7993623Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 21s local ... 2025-03-14T06:43:19.2797699Z 2025-03-14T06:43:19.2798606Z  2025-03-14T06:43:19.2799131Z  2025-03-14T06:43:19.2799651Z  2025-03-14T06:43:19.2800089Z  2025-03-14T06:43:19.2800467Z  2025-03-14T06:43:19.2800902Z  2025-03-14T06:43:19.2801334Z  2025-03-14T06:43:19.2801776Z  2025-03-14T06:43:19.2802744Z [19,662 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:19.2803694Z @llvm-project//mlir:LinalgTransforms; 84s local 2025-03-14T06:43:19.2804526Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2025-03-14T06:43:19.2805738Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2025-03-14T06:43:19.2806672Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:43:19.2807530Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2025-03-14T06:43:19.2808610Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 26s local 2025-03-14T06:43:19.2809504Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2025-03-14T06:43:19.2810346Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 22s local ... 2025-03-14T06:43:19.5987681Z 2025-03-14T06:43:19.5988568Z  2025-03-14T06:43:19.5989056Z  2025-03-14T06:43:19.5989496Z  2025-03-14T06:43:19.5989904Z  2025-03-14T06:43:19.5990586Z  2025-03-14T06:43:19.5990987Z  2025-03-14T06:43:19.5991379Z  2025-03-14T06:43:19.5991780Z  2025-03-14T06:43:19.5992749Z [19,663 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:19.5993736Z @llvm-project//mlir:LinalgTransforms; 84s local 2025-03-14T06:43:19.5994585Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2025-03-14T06:43:19.5995644Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2025-03-14T06:43:19.5996766Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:43:19.5997726Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 30s local 2025-03-14T06:43:19.5998761Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T06:43:19.5999654Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2025-03-14T06:43:19.6000553Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 22s local ... 2025-03-14T06:43:19.9130389Z 2025-03-14T06:43:19.9131246Z  2025-03-14T06:43:19.9142451Z  2025-03-14T06:43:19.9143290Z  2025-03-14T06:43:19.9143713Z  2025-03-14T06:43:19.9144126Z  2025-03-14T06:43:19.9144538Z  2025-03-14T06:43:19.9144935Z  2025-03-14T06:43:19.9145320Z  2025-03-14T06:43:19.9146271Z [19,667 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:19.9147582Z @llvm-project//mlir:LinalgTransforms; 85s local 2025-03-14T06:43:19.9148460Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 70s local 2025-03-14T06:43:19.9149675Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2025-03-14T06:43:19.9150635Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:43:19.9151538Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T06:43:19.9152617Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T06:43:19.9153703Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2025-03-14T06:43:19.9154644Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local ... 2025-03-14T06:43:20.1929909Z 2025-03-14T06:43:20.1930809Z  2025-03-14T06:43:20.1931325Z  2025-03-14T06:43:20.1931729Z  2025-03-14T06:43:20.1932164Z  2025-03-14T06:43:20.1932595Z  2025-03-14T06:43:20.1933025Z  2025-03-14T06:43:20.1933439Z  2025-03-14T06:43:20.1933876Z  2025-03-14T06:43:20.1934888Z [19,668 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:20.1935894Z @llvm-project//mlir:LinalgTransforms; 85s local 2025-03-14T06:43:20.1936733Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T06:43:20.1937763Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2025-03-14T06:43:20.1938778Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:43:20.1939650Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T06:43:20.1940718Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 27s local 2025-03-14T06:43:20.1941642Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T06:43:20.1942546Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local ... 2025-03-14T06:43:20.3993886Z 2025-03-14T06:43:20.3994757Z  2025-03-14T06:43:20.3995273Z  2025-03-14T06:43:20.3995751Z  2025-03-14T06:43:20.3996184Z  2025-03-14T06:43:20.3996605Z  2025-03-14T06:43:20.3997059Z  2025-03-14T06:43:20.3997464Z  2025-03-14T06:43:20.3997874Z  2025-03-14T06:43:20.3998890Z [19,672 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:20.3999926Z @llvm-project//mlir:LinalgTransforms; 85s local 2025-03-14T06:43:20.4000730Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T06:43:20.4002138Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2025-03-14T06:43:20.4003035Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:43:20.4003876Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T06:43:20.4004973Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T06:43:20.4005872Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T06:43:20.4006683Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local ... 2025-03-14T06:43:20.6406242Z 2025-03-14T06:43:20.6407381Z  2025-03-14T06:43:20.6407898Z  2025-03-14T06:43:20.6408353Z  2025-03-14T06:43:20.6408775Z  2025-03-14T06:43:20.6409217Z  2025-03-14T06:43:20.6409646Z  2025-03-14T06:43:20.6410064Z  2025-03-14T06:43:20.6410479Z  2025-03-14T06:43:20.6411452Z [19,674 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:20.6412512Z @llvm-project//mlir:LinalgTransforms; 85s local 2025-03-14T06:43:20.6413370Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T06:43:20.6414359Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T06:43:20.6415220Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:43:20.6416179Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 31s local 2025-03-14T06:43:20.6417387Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T06:43:20.6418264Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T06:43:20.6418969Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 23s local ... 2025-03-14T06:43:20.9066772Z 2025-03-14T06:43:20.9067641Z  2025-03-14T06:43:20.9068166Z  2025-03-14T06:43:20.9068609Z  2025-03-14T06:43:20.9069035Z  2025-03-14T06:43:20.9069473Z  2025-03-14T06:43:20.9070182Z  2025-03-14T06:43:20.9070571Z  2025-03-14T06:43:20.9071005Z  2025-03-14T06:43:20.9072012Z [19,677 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:20.9073065Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T06:43:20.9073984Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 71s local 2025-03-14T06:43:20.9075124Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T06:43:20.9076123Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:43:20.9076970Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T06:43:20.9078192Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T06:43:20.9079069Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T06:43:20.9079950Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local ... 2025-03-14T06:43:21.1999389Z 2025-03-14T06:43:21.2000270Z  2025-03-14T06:43:21.2000806Z  2025-03-14T06:43:21.2001233Z  2025-03-14T06:43:21.2001641Z  2025-03-14T06:43:21.2002055Z  2025-03-14T06:43:21.2002483Z  2025-03-14T06:43:21.2002873Z  2025-03-14T06:43:21.2003410Z  2025-03-14T06:43:21.2004692Z [19,677 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:21.2005649Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T06:43:21.2006463Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T06:43:21.2007587Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T06:43:21.2008553Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:43:21.2009435Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T06:43:21.2010472Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 28s local 2025-03-14T06:43:21.2011371Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T06:43:21.2012434Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local ... 2025-03-14T06:43:21.4002990Z 2025-03-14T06:43:21.4003851Z  2025-03-14T06:43:21.4004338Z  2025-03-14T06:43:21.4004925Z  2025-03-14T06:43:21.4005342Z  2025-03-14T06:43:21.4005750Z  2025-03-14T06:43:21.4006225Z  2025-03-14T06:43:21.4006744Z  2025-03-14T06:43:21.4007201Z  2025-03-14T06:43:21.4008149Z [19,679 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:21.4009419Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T06:43:21.4010255Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T06:43:21.4011330Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T06:43:21.4012273Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:43:21.4013168Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T06:43:21.4014326Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2025-03-14T06:43:21.4015238Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T06:43:21.4016189Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local ... 2025-03-14T06:43:21.8350182Z 2025-03-14T06:43:21.8351018Z  2025-03-14T06:43:21.8351531Z  2025-03-14T06:43:21.8351940Z  2025-03-14T06:43:21.8352333Z  2025-03-14T06:43:21.8352729Z  2025-03-14T06:43:21.8353423Z  2025-03-14T06:43:21.8353822Z  2025-03-14T06:43:21.8354212Z  2025-03-14T06:43:21.8355291Z [19,680 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:21.8356297Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T06:43:21.8357155Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 72s local 2025-03-14T06:43:21.8358205Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2025-03-14T06:43:21.8359331Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:43:21.8360212Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 32s local 2025-03-14T06:43:21.8361209Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2025-03-14T06:43:21.8362140Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T06:43:21.8363025Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 24s local ... 2025-03-14T06:43:22.2009340Z 2025-03-14T06:43:22.2010198Z  2025-03-14T06:43:22.2010697Z  2025-03-14T06:43:22.2011102Z  2025-03-14T06:43:22.2011525Z  2025-03-14T06:43:22.2011930Z  2025-03-14T06:43:22.2012335Z  2025-03-14T06:43:22.2012731Z  2025-03-14T06:43:22.2013147Z  2025-03-14T06:43:22.2014119Z [19,680 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:22.2015119Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T06:43:22.2016026Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T06:43:22.2017121Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2025-03-14T06:43:22.2018050Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:43:22.2018919Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2025-03-14T06:43:22.2019992Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 29s local 2025-03-14T06:43:22.2020851Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2025-03-14T06:43:22.2021758Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local ... 2025-03-14T06:43:22.8249428Z 2025-03-14T06:43:22.8250281Z  2025-03-14T06:43:22.8250712Z  2025-03-14T06:43:22.8251105Z  2025-03-14T06:43:22.8251516Z  2025-03-14T06:43:22.8251872Z  2025-03-14T06:43:22.8252232Z  2025-03-14T06:43:22.8252691Z  2025-03-14T06:43:22.8253146Z  2025-03-14T06:43:22.8254318Z [19,681 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:22.8255184Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T06:43:22.8256033Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 73s local 2025-03-14T06:43:22.8257062Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2025-03-14T06:43:22.8257974Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:43:22.8258939Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 33s local 2025-03-14T06:43:22.8260041Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2025-03-14T06:43:22.8261089Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2025-03-14T06:43:22.8262027Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 25s local ... 2025-03-14T06:43:23.2017527Z 2025-03-14T06:43:23.2018425Z  2025-03-14T06:43:23.2018937Z  2025-03-14T06:43:23.2019357Z  2025-03-14T06:43:23.2019812Z  2025-03-14T06:43:23.2020279Z  2025-03-14T06:43:23.2020714Z  2025-03-14T06:43:23.2021170Z  2025-03-14T06:43:23.2021608Z  2025-03-14T06:43:23.2022612Z [19,685 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:23.2023708Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T06:43:23.2024644Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2025-03-14T06:43:23.2025782Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2025-03-14T06:43:23.2027072Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:43:23.2028037Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2025-03-14T06:43:23.2029134Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 30s local 2025-03-14T06:43:23.2030111Z Compiling xla/service/spmd/dot_handler.cc; 27s local 2025-03-14T06:43:23.2031089Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local ... 2025-03-14T06:43:23.6022382Z 2025-03-14T06:43:23.6023273Z  2025-03-14T06:43:23.6023835Z  2025-03-14T06:43:23.6024280Z  2025-03-14T06:43:23.6024754Z  2025-03-14T06:43:23.6025146Z  2025-03-14T06:43:23.6025551Z  2025-03-14T06:43:23.6025940Z  2025-03-14T06:43:23.6026432Z  2025-03-14T06:43:23.6027418Z [19,687 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:23.6028595Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T06:43:23.6029458Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2025-03-14T06:43:23.6030583Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2025-03-14T06:43:23.6031550Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:43:23.6032399Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2025-03-14T06:43:23.6033423Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T06:43:23.6034369Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2025-03-14T06:43:23.6035450Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local ... 2025-03-14T06:43:23.8110728Z 2025-03-14T06:43:23.8111596Z  2025-03-14T06:43:23.8112097Z  2025-03-14T06:43:23.8112510Z  2025-03-14T06:43:23.8113031Z  2025-03-14T06:43:23.8113545Z  2025-03-14T06:43:23.8113979Z  2025-03-14T06:43:23.8114376Z  2025-03-14T06:43:23.8114834Z  2025-03-14T06:43:23.8115946Z [19,689 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:23.8116972Z @llvm-project//mlir:LinalgTransforms; 89s local 2025-03-14T06:43:23.8117836Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 74s local 2025-03-14T06:43:23.8118866Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2025-03-14T06:43:23.8120020Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 34s local 2025-03-14T06:43:23.8121453Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T06:43:23.8122427Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 26s local 2025-03-14T06:43:23.8123459Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 25s local 2025-03-14T06:43:23.8124297Z @stablehlo//:stablehlo_passes; 23s local ... 2025-03-14T06:43:24.2027203Z 2025-03-14T06:43:24.2028033Z  2025-03-14T06:43:24.2028509Z  2025-03-14T06:43:24.2028916Z  2025-03-14T06:43:24.2029346Z  2025-03-14T06:43:24.2029721Z  2025-03-14T06:43:24.2030104Z  2025-03-14T06:43:24.2030832Z  2025-03-14T06:43:24.2031239Z  2025-03-14T06:43:24.2032102Z [19,690 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:24.2033068Z @llvm-project//mlir:LinalgTransforms; 89s local 2025-03-14T06:43:24.2033822Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T06:43:24.2034866Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2025-03-14T06:43:24.2036000Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T06:43:24.2037025Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 31s local 2025-03-14T06:43:24.2038008Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2025-03-14T06:43:24.2038945Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T06:43:24.2039766Z @stablehlo//:stablehlo_passes; 23s local ... 2025-03-14T06:43:24.5466870Z 2025-03-14T06:43:24.5467754Z  2025-03-14T06:43:24.5468271Z  2025-03-14T06:43:24.5468686Z  2025-03-14T06:43:24.5469087Z  2025-03-14T06:43:24.5469626Z  2025-03-14T06:43:24.5470027Z  2025-03-14T06:43:24.5470421Z  2025-03-14T06:43:24.5470826Z  2025-03-14T06:43:24.5471763Z [19,691 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:24.5473001Z @llvm-project//mlir:LinalgTransforms; 89s local 2025-03-14T06:43:24.5473864Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T06:43:24.5474903Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T06:43:24.5476011Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T06:43:24.5477032Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T06:43:24.5477970Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2025-03-14T06:43:24.5478932Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T06:43:24.5479764Z @stablehlo//:stablehlo_passes; 24s local ... 2025-03-14T06:43:24.8032963Z 2025-03-14T06:43:24.8033848Z  2025-03-14T06:43:24.8034363Z  2025-03-14T06:43:24.8034778Z  2025-03-14T06:43:24.8035202Z  2025-03-14T06:43:24.8035560Z  2025-03-14T06:43:24.8035958Z  2025-03-14T06:43:24.8036370Z  2025-03-14T06:43:24.8036806Z  2025-03-14T06:43:24.8037791Z [19,692 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:24.8038785Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T06:43:24.8039679Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T06:43:24.8040749Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T06:43:24.8041861Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 35s local 2025-03-14T06:43:24.8042936Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T06:43:24.8043898Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 27s local 2025-03-14T06:43:24.8045022Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 26s local 2025-03-14T06:43:24.8045862Z @stablehlo//:stablehlo_passes; 24s local ... 2025-03-14T06:43:25.1350708Z 2025-03-14T06:43:25.1351515Z  2025-03-14T06:43:25.1352003Z  2025-03-14T06:43:25.1352446Z  2025-03-14T06:43:25.1352835Z  2025-03-14T06:43:25.1353482Z  2025-03-14T06:43:25.1353902Z  2025-03-14T06:43:25.1354285Z  2025-03-14T06:43:25.1354706Z  2025-03-14T06:43:25.1355618Z [19,693 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:25.1356602Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T06:43:25.1357395Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 75s local 2025-03-14T06:43:25.1358452Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T06:43:25.1359753Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2025-03-14T06:43:25.1360767Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 32s local 2025-03-14T06:43:25.1361688Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2025-03-14T06:43:25.1362614Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T06:43:25.1363350Z @stablehlo//:stablehlo_passes; 24s local ... 2025-03-14T06:43:25.4039038Z 2025-03-14T06:43:25.4039907Z  2025-03-14T06:43:25.4040416Z  2025-03-14T06:43:25.4040815Z  2025-03-14T06:43:25.4041218Z  2025-03-14T06:43:25.4041611Z  2025-03-14T06:43:25.4041992Z  2025-03-14T06:43:25.4042397Z  2025-03-14T06:43:25.4042811Z  2025-03-14T06:43:25.4043752Z [19,694 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:25.4045228Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T06:43:25.4046102Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2025-03-14T06:43:25.4047176Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T06:43:25.4048325Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2025-03-14T06:43:25.4049358Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T06:43:25.4050484Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2025-03-14T06:43:25.4051417Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T06:43:25.4052270Z @stablehlo//:stablehlo_passes; 25s local ... 2025-03-14T06:43:25.7451821Z 2025-03-14T06:43:25.7452610Z  2025-03-14T06:43:25.7453051Z  2025-03-14T06:43:25.7453411Z  2025-03-14T06:43:25.7453809Z  2025-03-14T06:43:25.7454191Z  2025-03-14T06:43:25.7454574Z  2025-03-14T06:43:25.7454957Z  2025-03-14T06:43:25.7455291Z  2025-03-14T06:43:25.7456159Z [19,695 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:25.7457051Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T06:43:25.7457804Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2025-03-14T06:43:25.7458763Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2025-03-14T06:43:25.7459854Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 36s local 2025-03-14T06:43:25.7460791Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T06:43:25.7461671Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 28s local 2025-03-14T06:43:25.7462575Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T06:43:25.7463365Z @stablehlo//:stablehlo_passes; 25s local ... 2025-03-14T06:43:25.9656115Z 2025-03-14T06:43:25.9656985Z  2025-03-14T06:43:25.9657479Z  2025-03-14T06:43:25.9657896Z  2025-03-14T06:43:25.9658305Z  2025-03-14T06:43:25.9658689Z  2025-03-14T06:43:25.9659090Z  2025-03-14T06:43:25.9659514Z  2025-03-14T06:43:25.9659980Z  2025-03-14T06:43:25.9661017Z [19,696 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:25.9662048Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T06:43:25.9662923Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 76s local 2025-03-14T06:43:25.9664315Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2025-03-14T06:43:25.9665693Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T06:43:25.9666692Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T06:43:25.9667577Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T06:43:25.9668471Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 27s local 2025-03-14T06:43:25.9669419Z @stablehlo//:stablehlo_passes; 25s local ... 2025-03-14T06:43:26.2045958Z 2025-03-14T06:43:26.2046784Z  2025-03-14T06:43:26.2047261Z  2025-03-14T06:43:26.2047693Z  2025-03-14T06:43:26.2048126Z  2025-03-14T06:43:26.2048490Z  2025-03-14T06:43:26.2048805Z  2025-03-14T06:43:26.2049142Z  2025-03-14T06:43:26.2049522Z  2025-03-14T06:43:26.2050550Z [19,698 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:26.2051576Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T06:43:26.2052428Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T06:43:26.2053493Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2025-03-14T06:43:26.2054654Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T06:43:26.2055694Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 33s local 2025-03-14T06:43:26.2057039Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T06:43:26.2058025Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2025-03-14T06:43:26.2058887Z @stablehlo//:stablehlo_passes; 25s local ... 2025-03-14T06:43:26.5590903Z 2025-03-14T06:43:26.5591750Z  2025-03-14T06:43:26.5592240Z  2025-03-14T06:43:26.5592660Z  2025-03-14T06:43:26.5593073Z  2025-03-14T06:43:26.5593750Z  2025-03-14T06:43:26.5594165Z  2025-03-14T06:43:26.5594578Z  2025-03-14T06:43:26.5595032Z  2025-03-14T06:43:26.5595997Z [19,699 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:26.5597018Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T06:43:26.5597805Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T06:43:26.5598867Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2025-03-14T06:43:26.5600033Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T06:43:26.5601096Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T06:43:26.5602016Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T06:43:26.5603006Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2025-03-14T06:43:26.5603859Z @stablehlo//:stablehlo_passes; 26s local ... 2025-03-14T06:43:26.8051076Z 2025-03-14T06:43:26.8051964Z  2025-03-14T06:43:26.8052492Z  2025-03-14T06:43:26.8052859Z  2025-03-14T06:43:26.8053236Z  2025-03-14T06:43:26.8053747Z  2025-03-14T06:43:26.8054126Z  2025-03-14T06:43:26.8054502Z  2025-03-14T06:43:26.8054923Z  2025-03-14T06:43:26.8055850Z [19,700 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:26.8056830Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T06:43:26.8057687Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T06:43:26.8058614Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2025-03-14T06:43:26.8059757Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 37s local 2025-03-14T06:43:26.8060775Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T06:43:26.8061727Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 29s local 2025-03-14T06:43:26.8063004Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 28s local 2025-03-14T06:43:26.8063803Z @stablehlo//:stablehlo_passes; 26s local ... 2025-03-14T06:43:27.1029771Z 2025-03-14T06:43:27.1030602Z  2025-03-14T06:43:27.1031086Z  2025-03-14T06:43:27.1031520Z  2025-03-14T06:43:27.1031940Z  2025-03-14T06:43:27.1032368Z  2025-03-14T06:43:27.1032794Z  2025-03-14T06:43:27.1033210Z  2025-03-14T06:43:27.1033638Z  2025-03-14T06:43:27.1035022Z [19,703 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:27.1036013Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T06:43:27.1036797Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 77s local 2025-03-14T06:43:27.1037790Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2025-03-14T06:43:27.1038810Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T06:43:27.1039769Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T06:43:27.1040670Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2025-03-14T06:43:27.1041628Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T06:43:27.1042437Z @stablehlo//:stablehlo_passes; 26s local ... 2025-03-14T06:43:27.3387346Z 2025-03-14T06:43:27.3388240Z  2025-03-14T06:43:27.3388670Z  2025-03-14T06:43:27.3388994Z  2025-03-14T06:43:27.3389628Z  2025-03-14T06:43:27.3390033Z  2025-03-14T06:43:27.3390414Z  2025-03-14T06:43:27.3390822Z  2025-03-14T06:43:27.3391198Z  2025-03-14T06:43:27.3392157Z [19,704 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:27.3393155Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T06:43:27.3393951Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T06:43:27.3395323Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2025-03-14T06:43:27.3396469Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T06:43:27.3397438Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 34s local 2025-03-14T06:43:27.3398415Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2025-03-14T06:43:27.3399385Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T06:43:27.3400232Z @stablehlo//:stablehlo_passes; 27s local ... 2025-03-14T06:43:27.6057406Z 2025-03-14T06:43:27.6058216Z  2025-03-14T06:43:27.6058735Z  2025-03-14T06:43:27.6059290Z  2025-03-14T06:43:27.6059707Z  2025-03-14T06:43:27.6060137Z  2025-03-14T06:43:27.6060554Z  2025-03-14T06:43:27.6060933Z  2025-03-14T06:43:27.6061338Z  2025-03-14T06:43:27.6062318Z [19,704 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:27.6063387Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T06:43:27.6064248Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T06:43:27.6065589Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 48s local 2025-03-14T06:43:27.6066771Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 38s local 2025-03-14T06:43:27.6067854Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T06:43:27.6068867Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 30s local 2025-03-14T06:43:27.6069887Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T06:43:27.6070758Z @stablehlo//:stablehlo_passes; 27s local ... 2025-03-14T06:43:27.9044289Z 2025-03-14T06:43:27.9045205Z  2025-03-14T06:43:27.9045630Z  2025-03-14T06:43:27.9046001Z  2025-03-14T06:43:27.9046367Z  2025-03-14T06:43:27.9046750Z  2025-03-14T06:43:27.9047098Z  2025-03-14T06:43:27.9047498Z  2025-03-14T06:43:27.9047868Z  2025-03-14T06:43:27.9048995Z [19,705 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:27.9049916Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T06:43:27.9050712Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 78s local 2025-03-14T06:43:27.9051640Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 48s local 2025-03-14T06:43:27.9052658Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2025-03-14T06:43:27.9053804Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T06:43:27.9054663Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2025-03-14T06:43:27.9055466Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 29s local 2025-03-14T06:43:27.9056193Z @stablehlo//:stablehlo_passes; 27s local ... 2025-03-14T06:43:28.2062686Z 2025-03-14T06:43:28.2063453Z  2025-03-14T06:43:28.2063962Z  2025-03-14T06:43:28.2064350Z  2025-03-14T06:43:28.2064702Z  2025-03-14T06:43:28.2065062Z  2025-03-14T06:43:28.2065583Z  2025-03-14T06:43:28.2065944Z  2025-03-14T06:43:28.2066278Z  2025-03-14T06:43:28.2067080Z [19,707 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:28.2067952Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T06:43:28.2068680Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2025-03-14T06:43:28.2069847Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 48s local 2025-03-14T06:43:28.2070885Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2025-03-14T06:43:28.2071744Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 35s local 2025-03-14T06:43:28.2072550Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2025-03-14T06:43:28.2073348Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T06:43:28.2074183Z @stablehlo//:stablehlo_passes; 27s local ... 2025-03-14T06:43:28.6962974Z 2025-03-14T06:43:28.6963806Z  2025-03-14T06:43:28.6964269Z  2025-03-14T06:43:28.6964798Z  2025-03-14T06:43:28.6965199Z  2025-03-14T06:43:28.6965751Z  2025-03-14T06:43:28.6966114Z  2025-03-14T06:43:28.6966505Z  2025-03-14T06:43:28.6966898Z  2025-03-14T06:43:28.6967829Z [19,708 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:28.6968856Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T06:43:28.6969696Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2025-03-14T06:43:28.6970706Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 49s local 2025-03-14T06:43:28.6971820Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 39s local 2025-03-14T06:43:28.6972835Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T06:43:28.6973774Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 31s local 2025-03-14T06:43:28.6974702Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T06:43:28.6975512Z @stablehlo//:stablehlo_passes; 28s local ... 2025-03-14T06:43:28.9531058Z 2025-03-14T06:43:28.9531918Z  2025-03-14T06:43:28.9532418Z  2025-03-14T06:43:28.9532841Z  2025-03-14T06:43:28.9533260Z  2025-03-14T06:43:28.9533668Z  2025-03-14T06:43:28.9534097Z  2025-03-14T06:43:28.9534502Z  2025-03-14T06:43:28.9534911Z  2025-03-14T06:43:28.9535867Z [19,710 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:28.9536859Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T06:43:28.9537718Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 79s local 2025-03-14T06:43:28.9538897Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 49s local 2025-03-14T06:43:28.9540340Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T06:43:28.9541413Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T06:43:28.9542392Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T06:43:28.9543364Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 30s local 2025-03-14T06:43:28.9544213Z @stablehlo//:stablehlo_passes; 28s local ... 2025-03-14T06:43:29.2069564Z 2025-03-14T06:43:29.2070575Z  2025-03-14T06:43:29.2071080Z  2025-03-14T06:43:29.2071518Z  2025-03-14T06:43:29.2072226Z  2025-03-14T06:43:29.2072674Z  2025-03-14T06:43:29.2073083Z  2025-03-14T06:43:29.2073467Z  2025-03-14T06:43:29.2073878Z  2025-03-14T06:43:29.2074836Z [19,713 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:29.2075861Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T06:43:29.2076765Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T06:43:29.2077756Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T06:43:29.2078811Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 36s local 2025-03-14T06:43:29.2079809Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T06:43:29.2080789Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T06:43:29.2081632Z @stablehlo//:stablehlo_passes; 28s local 2025-03-14T06:43:29.2082419Z @llvm-project//mlir:LinalgTransforms; 25s local ... 2025-03-14T06:43:29.4071045Z 2025-03-14T06:43:29.4071870Z  2025-03-14T06:43:29.4072394Z  2025-03-14T06:43:29.4072796Z  2025-03-14T06:43:29.4073234Z  2025-03-14T06:43:29.4073669Z  2025-03-14T06:43:29.4074070Z  2025-03-14T06:43:29.4074484Z  2025-03-14T06:43:29.4074968Z  2025-03-14T06:43:29.4076017Z [19,714 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:29.4077882Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T06:43:29.4079011Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T06:43:29.4080258Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T06:43:29.4081497Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2025-03-14T06:43:29.4082674Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T06:43:29.4083865Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T06:43:29.4084903Z @stablehlo//:stablehlo_passes; 29s local 2025-03-14T06:43:29.4085780Z @llvm-project//mlir:LinalgTransforms; 25s local ... 2025-03-14T06:43:29.6325847Z 2025-03-14T06:43:29.6326799Z  2025-03-14T06:43:29.6327294Z  2025-03-14T06:43:29.6327727Z  2025-03-14T06:43:29.6328136Z  2025-03-14T06:43:29.6328587Z  2025-03-14T06:43:29.6328959Z  2025-03-14T06:43:29.6329339Z  2025-03-14T06:43:29.6329757Z  2025-03-14T06:43:29.6330712Z [19,716 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:29.6331552Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T06:43:29.6332431Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T06:43:29.6333478Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 40s local 2025-03-14T06:43:29.6334451Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2025-03-14T06:43:29.6335427Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 32s local 2025-03-14T06:43:29.6336358Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T06:43:29.6337191Z @stablehlo//:stablehlo_passes; 29s local 2025-03-14T06:43:29.6337920Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2025-03-14T06:43:30.0076919Z 2025-03-14T06:43:30.0077818Z  2025-03-14T06:43:30.0078338Z  2025-03-14T06:43:30.0079014Z  2025-03-14T06:43:30.0079427Z  2025-03-14T06:43:30.0079821Z  2025-03-14T06:43:30.0080231Z  2025-03-14T06:43:30.0080615Z  2025-03-14T06:43:30.0081003Z  2025-03-14T06:43:30.0081952Z [19,716 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:30.0082886Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T06:43:30.0083753Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 80s local 2025-03-14T06:43:30.0086892Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2025-03-14T06:43:30.0088100Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2025-03-14T06:43:30.0089031Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T06:43:30.0089943Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 31s local 2025-03-14T06:43:30.0090856Z @stablehlo//:stablehlo_passes; 29s local 2025-03-14T06:43:30.0091591Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2025-03-14T06:43:30.2080318Z 2025-03-14T06:43:30.2081241Z  2025-03-14T06:43:30.2081692Z  2025-03-14T06:43:30.2082050Z  2025-03-14T06:43:30.2082452Z  2025-03-14T06:43:30.2082855Z  2025-03-14T06:43:30.2083248Z  2025-03-14T06:43:30.2083648Z  2025-03-14T06:43:30.2084056Z  2025-03-14T06:43:30.2085095Z [19,717 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:30.2086414Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T06:43:30.2087201Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T06:43:30.2088192Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2025-03-14T06:43:30.2089190Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 37s local 2025-03-14T06:43:30.2090117Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T06:43:30.2091182Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T06:43:30.2091957Z @stablehlo//:stablehlo_passes; 29s local 2025-03-14T06:43:30.2092645Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2025-03-14T06:43:30.4117302Z 2025-03-14T06:43:30.4118197Z  2025-03-14T06:43:30.4118695Z  2025-03-14T06:43:30.4119089Z  2025-03-14T06:43:30.4119500Z  2025-03-14T06:43:30.4119912Z  2025-03-14T06:43:30.4120356Z  2025-03-14T06:43:30.4120761Z  2025-03-14T06:43:30.4121167Z  2025-03-14T06:43:30.4122133Z [19,718 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:30.4123102Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T06:43:30.4123938Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T06:43:30.4125079Z Compiling xla/hlo/translate/mhlo_to_hlo/mlir_hlo_to_hlo.cc; 41s local 2025-03-14T06:43:30.4126127Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T06:43:30.4127055Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T06:43:30.4127972Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T06:43:30.4128759Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T06:43:30.4129457Z @llvm-project//mlir:LinalgTransforms; 26s local ... 2025-03-14T06:43:30.6790568Z 2025-03-14T06:43:30.6791606Z  2025-03-14T06:43:30.6792114Z  2025-03-14T06:43:30.6792516Z  2025-03-14T06:43:30.6792952Z  2025-03-14T06:43:30.6793378Z  2025-03-14T06:43:30.6793777Z  2025-03-14T06:43:30.6794174Z  2025-03-14T06:43:30.6794564Z  2025-03-14T06:43:30.6795528Z [19,720 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:30.6796467Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T06:43:30.6797290Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T06:43:30.6798473Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T06:43:30.6799420Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 33s local 2025-03-14T06:43:30.6800355Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T06:43:30.6801187Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T06:43:30.6802050Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T06:43:30.6803194Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local ... 2025-03-14T06:43:30.9756952Z 2025-03-14T06:43:30.9757748Z  2025-03-14T06:43:30.9758225Z  2025-03-14T06:43:30.9758668Z  2025-03-14T06:43:30.9759114Z  2025-03-14T06:43:30.9759545Z  2025-03-14T06:43:30.9759975Z  2025-03-14T06:43:30.9760371Z  2025-03-14T06:43:30.9760779Z  2025-03-14T06:43:30.9761694Z [19,723 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:30.9762731Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T06:43:30.9763603Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 81s local 2025-03-14T06:43:30.9764764Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T06:43:30.9765840Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T06:43:30.9766759Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 32s local 2025-03-14T06:43:30.9767858Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T06:43:30.9768965Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T06:43:30.9770117Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 26s local ... 2025-03-14T06:43:31.2086210Z 2025-03-14T06:43:31.2087063Z  2025-03-14T06:43:31.2087532Z  2025-03-14T06:43:31.2087964Z  2025-03-14T06:43:31.2088400Z  2025-03-14T06:43:31.2089134Z  2025-03-14T06:43:31.2089561Z  2025-03-14T06:43:31.2090009Z  2025-03-14T06:43:31.2090445Z  2025-03-14T06:43:31.2091455Z [19,723 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:31.2092461Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T06:43:31.2093560Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T06:43:31.2094557Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 38s local 2025-03-14T06:43:31.2095601Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T06:43:31.2096617Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T06:43:31.2097548Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T06:43:31.2099036Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T06:43:31.2100381Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local ... 2025-03-14T06:43:31.4089924Z 2025-03-14T06:43:31.4090896Z  2025-03-14T06:43:31.4091413Z  2025-03-14T06:43:31.4092002Z  2025-03-14T06:43:31.4092410Z  2025-03-14T06:43:31.4092836Z  2025-03-14T06:43:31.4093254Z  2025-03-14T06:43:31.4093672Z  2025-03-14T06:43:31.4094099Z  2025-03-14T06:43:31.4095055Z [19,724 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:31.4096097Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T06:43:31.4096977Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T06:43:31.4097962Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T06:43:31.4098966Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T06:43:31.4099971Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T06:43:31.4100854Z @stablehlo//:stablehlo_passes; 31s local 2025-03-14T06:43:31.4101839Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T06:43:31.4103302Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local ... 2025-03-14T06:43:31.6872467Z 2025-03-14T06:43:31.6873417Z  2025-03-14T06:43:31.6873859Z  2025-03-14T06:43:31.6874276Z  2025-03-14T06:43:31.6874682Z  2025-03-14T06:43:31.6875088Z  2025-03-14T06:43:31.6875451Z  2025-03-14T06:43:31.6875793Z  2025-03-14T06:43:31.6876179Z  2025-03-14T06:43:31.6877240Z [19,726 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:31.6878643Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T06:43:31.6879507Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T06:43:31.6880464Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T06:43:31.6881368Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 34s local 2025-03-14T06:43:31.6882370Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T06:43:31.6883240Z @stablehlo//:stablehlo_passes; 31s local 2025-03-14T06:43:31.6884132Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 28s local 2025-03-14T06:43:31.6885424Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 27s local ... 2025-03-14T06:43:32.0094974Z 2025-03-14T06:43:32.0095843Z  2025-03-14T06:43:32.0096387Z  2025-03-14T06:43:32.0096832Z  2025-03-14T06:43:32.0097263Z  2025-03-14T06:43:32.0098017Z  2025-03-14T06:43:32.0098464Z  2025-03-14T06:43:32.0098905Z  2025-03-14T06:43:32.0099484Z  2025-03-14T06:43:32.0100488Z [19,727 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:32.0101543Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T06:43:32.0102474Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 82s local 2025-03-14T06:43:32.0103638Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 39s local 2025-03-14T06:43:32.0104638Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2025-03-14T06:43:32.0105643Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 33s local 2025-03-14T06:43:32.0106524Z @stablehlo//:stablehlo_passes; 31s local 2025-03-14T06:43:32.0107641Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 28s local 2025-03-14T06:43:32.0108872Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local ... 2025-03-14T06:43:32.3820722Z 2025-03-14T06:43:32.3821604Z  2025-03-14T06:43:32.3822079Z  2025-03-14T06:43:32.3822530Z  2025-03-14T06:43:32.3822911Z  2025-03-14T06:43:32.3823297Z  2025-03-14T06:43:32.3823664Z  2025-03-14T06:43:32.3824045Z  2025-03-14T06:43:32.3824435Z  2025-03-14T06:43:32.3825364Z [19,730 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:32.3826345Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T06:43:32.3827163Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T06:43:32.3828119Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T06:43:32.3829063Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2025-03-14T06:43:32.3830043Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T06:43:32.3830876Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T06:43:32.3831674Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T06:43:32.3832577Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:43:32.5859493Z 2025-03-14T06:43:32.5860409Z  2025-03-14T06:43:32.5860915Z  2025-03-14T06:43:32.5861357Z  2025-03-14T06:43:32.5861769Z  2025-03-14T06:43:32.5862168Z  2025-03-14T06:43:32.5873357Z  2025-03-14T06:43:32.5874221Z  2025-03-14T06:43:32.5874653Z  2025-03-14T06:43:32.5875897Z [19,731 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:32.5876878Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T06:43:32.5877694Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T06:43:32.5878627Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T06:43:32.5879568Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2025-03-14T06:43:32.5880437Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T06:43:32.5881422Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T06:43:32.5882236Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T06:43:32.5883059Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:43:32.8101490Z 2025-03-14T06:43:32.8102361Z  2025-03-14T06:43:32.8102874Z  2025-03-14T06:43:32.8103266Z  2025-03-14T06:43:32.8103770Z  2025-03-14T06:43:32.8104214Z  2025-03-14T06:43:32.8104616Z  2025-03-14T06:43:32.8105009Z  2025-03-14T06:43:32.8105452Z  2025-03-14T06:43:32.8106458Z [19,731 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:32.8107478Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T06:43:32.8108334Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T06:43:32.8109366Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T06:43:32.8110564Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 35s local 2025-03-14T06:43:32.8111561Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 34s local 2025-03-14T06:43:32.8112361Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T06:43:32.8113133Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 28s local 2025-03-14T06:43:32.8114039Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:43:33.0674492Z 2025-03-14T06:43:33.0675437Z  2025-03-14T06:43:33.0675931Z  2025-03-14T06:43:33.0676367Z  2025-03-14T06:43:33.0676763Z  2025-03-14T06:43:33.0677165Z  2025-03-14T06:43:33.0677548Z  2025-03-14T06:43:33.0678083Z  2025-03-14T06:43:33.0678516Z  2025-03-14T06:43:33.0679365Z [19,733 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:33.0680317Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T06:43:33.0681172Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 83s local 2025-03-14T06:43:33.0682098Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 40s local 2025-03-14T06:43:33.0682972Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2025-03-14T06:43:33.0683892Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T06:43:33.0684809Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T06:43:33.0685619Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2025-03-14T06:43:33.0686528Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:43:33.4105346Z 2025-03-14T06:43:33.4106217Z  2025-03-14T06:43:33.4106708Z  2025-03-14T06:43:33.4107111Z  2025-03-14T06:43:33.4107506Z  2025-03-14T06:43:33.4107886Z  2025-03-14T06:43:33.4108271Z  2025-03-14T06:43:33.4108678Z  2025-03-14T06:43:33.4109098Z  2025-03-14T06:43:33.4110064Z [19,734 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:33.4111043Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T06:43:33.4112291Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2025-03-14T06:43:33.4113400Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2025-03-14T06:43:33.4114501Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2025-03-14T06:43:33.4115564Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T06:43:33.4116727Z @stablehlo//:stablehlo_passes; 33s local 2025-03-14T06:43:33.4117656Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2025-03-14T06:43:33.4118637Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:43:33.6109558Z 2025-03-14T06:43:33.6110453Z  2025-03-14T06:43:33.6110977Z  2025-03-14T06:43:33.6111390Z  2025-03-14T06:43:33.6112021Z  2025-03-14T06:43:33.6112423Z  2025-03-14T06:43:33.6112867Z  2025-03-14T06:43:33.6113244Z  2025-03-14T06:43:33.6113664Z  2025-03-14T06:43:33.6114891Z [19,737 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:33.6115872Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T06:43:33.6116854Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2025-03-14T06:43:33.6117797Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2025-03-14T06:43:33.6118788Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 36s local 2025-03-14T06:43:33.6119718Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T06:43:33.6120712Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 29s local 2025-03-14T06:43:33.6121581Z @llvm-project//mlir:LinalgTransforms; 13s local 2025-03-14T06:43:33.6122312Z @xla//xla/mlir_hlo:mhlo_passes; 13s local ... 2025-03-14T06:43:34.0113754Z 2025-03-14T06:43:34.0114945Z  2025-03-14T06:43:34.0115490Z  2025-03-14T06:43:34.0115914Z  2025-03-14T06:43:34.0116305Z  2025-03-14T06:43:34.0116742Z  2025-03-14T06:43:34.0117146Z  2025-03-14T06:43:34.0117553Z  2025-03-14T06:43:34.0117958Z  2025-03-14T06:43:34.0118907Z [19,738 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:34.0119923Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T06:43:34.0121060Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 84s local 2025-03-14T06:43:34.0122060Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 41s local 2025-03-14T06:43:34.0122977Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 37s local 2025-03-14T06:43:34.0123837Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 35s local 2025-03-14T06:43:34.0124887Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T06:43:34.0125732Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:43:34.0126438Z @xla//xla/mlir_hlo:mhlo_passes; 13s local ... 2025-03-14T06:43:34.4117837Z 2025-03-14T06:43:34.4118740Z  2025-03-14T06:43:34.4119320Z  2025-03-14T06:43:34.4119817Z  2025-03-14T06:43:34.4120313Z  2025-03-14T06:43:34.4120796Z  2025-03-14T06:43:34.4121285Z  2025-03-14T06:43:34.4121778Z  2025-03-14T06:43:34.4122277Z  2025-03-14T06:43:34.4123338Z [19,739 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:34.4124499Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T06:43:34.4125627Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T06:43:34.4126714Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T06:43:34.4127788Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 37s local 2025-03-14T06:43:34.4128854Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T06:43:34.4129887Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T06:43:34.4130729Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:43:34.4131424Z @xla//xla/mlir_hlo:mhlo_passes; 13s local ... 2025-03-14T06:43:34.6120686Z 2025-03-14T06:43:34.6121584Z  2025-03-14T06:43:34.6122072Z  2025-03-14T06:43:34.6122476Z  2025-03-14T06:43:34.6122880Z  2025-03-14T06:43:34.6123286Z  2025-03-14T06:43:34.6123709Z  2025-03-14T06:43:34.6124104Z  2025-03-14T06:43:34.6124875Z  2025-03-14T06:43:34.6125984Z [19,740 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:34.6127012Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T06:43:34.6127886Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T06:43:34.6128898Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T06:43:34.6129859Z Compiling xla/service/cpu/onednn_ops_rewriter.cc; 37s local 2025-03-14T06:43:34.6130925Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T06:43:34.6131925Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 30s local 2025-03-14T06:43:34.6132806Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:43:34.6133557Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2025-03-14T06:43:35.0125103Z 2025-03-14T06:43:35.0125856Z  2025-03-14T06:43:35.0126279Z  2025-03-14T06:43:35.0126613Z  2025-03-14T06:43:35.0126952Z  2025-03-14T06:43:35.0127267Z  2025-03-14T06:43:35.0127585Z  2025-03-14T06:43:35.0127902Z  2025-03-14T06:43:35.0128223Z  2025-03-14T06:43:35.0129107Z [19,743 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:35.0129914Z @llvm-project//mlir:LinalgTransforms; 100s local 2025-03-14T06:43:35.0130616Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 85s local 2025-03-14T06:43:35.0131906Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T06:43:35.0132692Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 36s local 2025-03-14T06:43:35.0133456Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T06:43:35.0134131Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:43:35.0134697Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2025-03-14T06:43:35.0135371Z @llvm-project//llvm:CodeGen; 14s local ... 2025-03-14T06:43:35.3587368Z 2025-03-14T06:43:35.3588153Z  2025-03-14T06:43:35.3588636Z  2025-03-14T06:43:35.3589027Z  2025-03-14T06:43:35.3589422Z  2025-03-14T06:43:35.3589810Z  2025-03-14T06:43:35.3590226Z  2025-03-14T06:43:35.3590609Z  2025-03-14T06:43:35.3591007Z  2025-03-14T06:43:35.3591938Z [19,744 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:35.3592929Z @llvm-project//mlir:LinalgTransforms; 100s local 2025-03-14T06:43:35.3593668Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T06:43:35.3594702Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 42s local 2025-03-14T06:43:35.3595638Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T06:43:35.3596628Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T06:43:35.3597491Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:43:35.3598213Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2025-03-14T06:43:35.3598876Z @llvm-project//llvm:CodeGen; 14s local ... 2025-03-14T06:43:35.6131576Z 2025-03-14T06:43:35.6132433Z  2025-03-14T06:43:35.6132942Z  2025-03-14T06:43:35.6133359Z  2025-03-14T06:43:35.6133778Z  2025-03-14T06:43:35.6134193Z  2025-03-14T06:43:35.6134596Z  2025-03-14T06:43:35.6135004Z  2025-03-14T06:43:35.6135396Z  2025-03-14T06:43:35.6136374Z [19,746 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:35.6137389Z @llvm-project//mlir:LinalgTransforms; 100s local 2025-03-14T06:43:35.6138188Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T06:43:35.6139143Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T06:43:35.6140130Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T06:43:35.6141421Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T06:43:35.6142247Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:43:35.6143053Z @llvm-project//llvm:CodeGen; 14s local 2025-03-14T06:43:35.6143947Z Compiling mlir/lib/Dialect/Linalg/Transforms/Padding.cpp; 14s local ... 2025-03-14T06:43:35.8974851Z 2025-03-14T06:43:35.8975695Z  2025-03-14T06:43:35.8976194Z  2025-03-14T06:43:35.8976608Z  2025-03-14T06:43:35.8977101Z  2025-03-14T06:43:35.8977641Z  2025-03-14T06:43:35.8978218Z  2025-03-14T06:43:35.8978876Z  2025-03-14T06:43:35.8979287Z  2025-03-14T06:43:35.8980216Z [19,747 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:35.8981148Z @llvm-project//mlir:LinalgTransforms; 101s local 2025-03-14T06:43:35.8981977Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 86s local 2025-03-14T06:43:35.8982891Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T06:43:35.8983876Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 37s local 2025-03-14T06:43:35.8984757Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 31s local 2025-03-14T06:43:35.8985570Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:43:35.8986311Z @llvm-project//llvm:CodeGen; 15s local 2025-03-14T06:43:35.8987167Z Compiling mlir/lib/Dialect/Linalg/Transforms/Padding.cpp; 15s local ... 2025-03-14T06:43:36.2136043Z 2025-03-14T06:43:36.2136837Z  2025-03-14T06:43:36.2137311Z  2025-03-14T06:43:36.2137763Z  2025-03-14T06:43:36.2138320Z  2025-03-14T06:43:36.2138762Z  2025-03-14T06:43:36.2139169Z  2025-03-14T06:43:36.2139569Z  2025-03-14T06:43:36.2139954Z  2025-03-14T06:43:36.2140906Z [19,747 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:36.2142065Z @llvm-project//mlir:LinalgTransforms; 101s local 2025-03-14T06:43:36.2142947Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T06:43:36.2143888Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 43s local 2025-03-14T06:43:36.2144841Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T06:43:36.2145773Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T06:43:36.2146538Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:43:36.2147283Z @llvm-project//llvm:CodeGen; 15s local 2025-03-14T06:43:36.2148112Z Compiling mlir/lib/Dialect/Linalg/Transforms/Padding.cpp; 15s local ... 2025-03-14T06:43:36.4143009Z 2025-03-14T06:43:36.4143834Z  2025-03-14T06:43:36.4144318Z  2025-03-14T06:43:36.4144730Z  2025-03-14T06:43:36.4145144Z  2025-03-14T06:43:36.4145499Z  2025-03-14T06:43:36.4145867Z  2025-03-14T06:43:36.4146248Z  2025-03-14T06:43:36.4146627Z  2025-03-14T06:43:36.4147669Z [19,749 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:36.4148624Z @llvm-project//mlir:LinalgTransforms; 101s local 2025-03-14T06:43:36.4149446Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T06:43:36.4150425Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T06:43:36.4151375Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T06:43:36.4152323Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T06:43:36.4153113Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:43:36.4153682Z @llvm-project//llvm:CodeGen; 15s local 2025-03-14T06:43:36.4154509Z Compiling mlir/lib/Dialect/Linalg/Transforms/Padding.cpp; 15s local ... 2025-03-14T06:43:36.6242160Z 2025-03-14T06:43:36.6243041Z  2025-03-14T06:43:36.6243543Z  2025-03-14T06:43:36.6243969Z  2025-03-14T06:43:36.6244436Z  2025-03-14T06:43:36.6244982Z  2025-03-14T06:43:36.6245645Z  2025-03-14T06:43:36.6246068Z  2025-03-14T06:43:36.6246616Z  2025-03-14T06:43:36.6247616Z [19,751 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:36.6248670Z @llvm-project//mlir:LinalgTransforms; 101s local 2025-03-14T06:43:36.6249583Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T06:43:36.6250569Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T06:43:36.6251610Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T06:43:36.6252549Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T06:43:36.6253582Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:43:36.6254258Z @llvm-project//llvm:CodeGen; 15s local 2025-03-14T06:43:36.6254924Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:43:36.9008345Z 2025-03-14T06:43:36.9009178Z  2025-03-14T06:43:36.9009656Z  2025-03-14T06:43:36.9010005Z  2025-03-14T06:43:36.9010369Z  2025-03-14T06:43:36.9010748Z  2025-03-14T06:43:36.9011123Z  2025-03-14T06:43:36.9011486Z  2025-03-14T06:43:36.9011856Z  2025-03-14T06:43:36.9012709Z [19,752 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:36.9013719Z @llvm-project//mlir:LinalgTransforms; 102s local 2025-03-14T06:43:36.9014777Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 87s local 2025-03-14T06:43:36.9015698Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T06:43:36.9016551Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 38s local 2025-03-14T06:43:36.9017388Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 32s local 2025-03-14T06:43:36.9018153Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:43:36.9018924Z @llvm-project//llvm:CodeGen; 16s local 2025-03-14T06:43:36.9019560Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:43:37.2148347Z 2025-03-14T06:43:37.2149134Z  2025-03-14T06:43:37.2149573Z  2025-03-14T06:43:37.2149920Z  2025-03-14T06:43:37.2150272Z  2025-03-14T06:43:37.2150608Z  2025-03-14T06:43:37.2150951Z  2025-03-14T06:43:37.2151302Z  2025-03-14T06:43:37.2151651Z  2025-03-14T06:43:37.2152482Z [19,752 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:37.2153398Z @llvm-project//mlir:LinalgTransforms; 102s local 2025-03-14T06:43:37.2154134Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T06:43:37.2155113Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 44s local 2025-03-14T06:43:37.2156029Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T06:43:37.2156918Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T06:43:37.2157706Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:43:37.2158332Z @llvm-project//llvm:CodeGen; 16s local 2025-03-14T06:43:37.2158987Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:43:37.4151256Z 2025-03-14T06:43:37.4152086Z  2025-03-14T06:43:37.4152572Z  2025-03-14T06:43:37.4153009Z  2025-03-14T06:43:37.4153436Z  2025-03-14T06:43:37.4153860Z  2025-03-14T06:43:37.4154325Z  2025-03-14T06:43:37.4154763Z  2025-03-14T06:43:37.4155195Z  2025-03-14T06:43:37.4156213Z [19,753 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:37.4157276Z @llvm-project//mlir:LinalgTransforms; 102s local 2025-03-14T06:43:37.4158201Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T06:43:37.4159226Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T06:43:37.4160493Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T06:43:37.4161522Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T06:43:37.4162444Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:43:37.4163165Z @llvm-project//llvm:CodeGen; 16s local 2025-03-14T06:43:37.4163908Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:43:37.8154980Z 2025-03-14T06:43:37.8155827Z  2025-03-14T06:43:37.8156335Z  2025-03-14T06:43:37.8156780Z  2025-03-14T06:43:37.8157227Z  2025-03-14T06:43:37.8157642Z  2025-03-14T06:43:37.8158603Z  2025-03-14T06:43:37.8159058Z  2025-03-14T06:43:37.8159454Z  2025-03-14T06:43:37.8160399Z [19,753 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:37.8161421Z @llvm-project//mlir:LinalgTransforms; 103s local 2025-03-14T06:43:37.8162081Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 88s local 2025-03-14T06:43:37.8163005Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T06:43:37.8163851Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 39s local 2025-03-14T06:43:37.8164769Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 33s local 2025-03-14T06:43:37.8165764Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:43:37.8166452Z @llvm-project//llvm:CodeGen; 17s local 2025-03-14T06:43:37.8167258Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2025-03-14T06:43:38.2158816Z 2025-03-14T06:43:38.2159699Z  2025-03-14T06:43:38.2160207Z  2025-03-14T06:43:38.2160609Z  2025-03-14T06:43:38.2161029Z  2025-03-14T06:43:38.2161429Z  2025-03-14T06:43:38.2161827Z  2025-03-14T06:43:38.2162210Z  2025-03-14T06:43:38.2162562Z  2025-03-14T06:43:38.2163443Z [19,754 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:38.2164868Z @llvm-project//mlir:LinalgTransforms; 103s local 2025-03-14T06:43:38.2166031Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T06:43:38.2167011Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 45s local 2025-03-14T06:43:38.2167977Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2025-03-14T06:43:38.2168891Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T06:43:38.2169712Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:43:38.2170450Z @llvm-project//llvm:CodeGen; 17s local 2025-03-14T06:43:38.2171096Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2025-03-14T06:43:38.4161754Z 2025-03-14T06:43:38.4162620Z  2025-03-14T06:43:38.4163082Z  2025-03-14T06:43:38.4163497Z  2025-03-14T06:43:38.4163913Z  2025-03-14T06:43:38.4164324Z  2025-03-14T06:43:38.4164871Z  2025-03-14T06:43:38.4165477Z  2025-03-14T06:43:38.4165943Z  2025-03-14T06:43:38.4166913Z [19,757 / 20,651] 4 / 17 tests; 47 actions running; last test: ...me:util_test 2025-03-14T06:43:38.4168005Z @llvm-project//mlir:LinalgTransforms; 103s local 2025-03-14T06:43:38.4168840Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T06:43:38.4169786Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2025-03-14T06:43:38.4170746Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2025-03-14T06:43:38.4171795Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T06:43:38.4172623Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:43:38.4173320Z @llvm-project//llvm:CodeGen; 17s local 2025-03-14T06:43:38.4173990Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2025-03-14T06:43:38.8166459Z 2025-03-14T06:43:38.8167300Z  2025-03-14T06:43:38.8167781Z  2025-03-14T06:43:38.8168190Z  2025-03-14T06:43:38.8168622Z  2025-03-14T06:43:38.8169016Z  2025-03-14T06:43:38.8169640Z  2025-03-14T06:43:38.8170058Z  2025-03-14T06:43:38.8170435Z  2025-03-14T06:43:38.8171368Z [19,758 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:38.8172313Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T06:43:38.8173175Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 89s local 2025-03-14T06:43:38.8174148Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2025-03-14T06:43:38.8175320Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 40s local 2025-03-14T06:43:38.8176225Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 34s local 2025-03-14T06:43:38.8177024Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:43:38.8177685Z @llvm-project//llvm:CodeGen; 18s local 2025-03-14T06:43:38.8178343Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2025-03-14T06:43:39.2170513Z 2025-03-14T06:43:39.2171381Z  2025-03-14T06:43:39.2171891Z  2025-03-14T06:43:39.2172288Z  2025-03-14T06:43:39.2172681Z  2025-03-14T06:43:39.2173073Z  2025-03-14T06:43:39.2173472Z  2025-03-14T06:43:39.2173870Z  2025-03-14T06:43:39.2174270Z  2025-03-14T06:43:39.2175018Z [19,759 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:39.2175939Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T06:43:39.2177086Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2025-03-14T06:43:39.2178010Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 46s local 2025-03-14T06:43:39.2178929Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T06:43:39.2179814Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T06:43:39.2180639Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:43:39.2183538Z @llvm-project//llvm:CodeGen; 18s local 2025-03-14T06:43:39.2184209Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2025-03-14T06:43:39.4767871Z 2025-03-14T06:43:39.4768664Z  2025-03-14T06:43:39.4769122Z  2025-03-14T06:43:39.4769492Z  2025-03-14T06:43:39.4769851Z  2025-03-14T06:43:39.4770216Z  2025-03-14T06:43:39.4770576Z  2025-03-14T06:43:39.4770936Z  2025-03-14T06:43:39.4771295Z  2025-03-14T06:43:39.4772150Z [19,760 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:39.4773095Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T06:43:39.4773871Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2025-03-14T06:43:39.4774843Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T06:43:39.4775690Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T06:43:39.4776574Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T06:43:39.4777327Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:43:39.4777914Z @llvm-project//llvm:CodeGen; 18s local 2025-03-14T06:43:39.4778532Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2025-03-14T06:43:39.7484957Z 2025-03-14T06:43:39.7485828Z  2025-03-14T06:43:39.7486302Z  2025-03-14T06:43:39.7486714Z  2025-03-14T06:43:39.7487113Z  2025-03-14T06:43:39.7487516Z  2025-03-14T06:43:39.7487922Z  2025-03-14T06:43:39.7488341Z  2025-03-14T06:43:39.7488745Z  2025-03-14T06:43:39.7489698Z [19,761 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:39.7490689Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T06:43:39.7491522Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2025-03-14T06:43:39.7492491Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T06:43:39.7493809Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T06:43:39.7494754Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 35s local 2025-03-14T06:43:39.7495610Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:43:39.7496277Z @llvm-project//llvm:CodeGen; 19s local 2025-03-14T06:43:39.7496948Z @llvm-project//mlir:LinalgTransforms; 18s local ... 2025-03-14T06:43:40.0105164Z 2025-03-14T06:43:40.0106027Z  2025-03-14T06:43:40.0106531Z  2025-03-14T06:43:40.0106973Z  2025-03-14T06:43:40.0107352Z  2025-03-14T06:43:40.0107716Z  2025-03-14T06:43:40.0108386Z  2025-03-14T06:43:40.0108804Z  2025-03-14T06:43:40.0109196Z  2025-03-14T06:43:40.0110114Z [19,762 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:40.0111097Z @llvm-project//mlir:LinalgTransforms; 105s local 2025-03-14T06:43:40.0111974Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 90s local 2025-03-14T06:43:40.0113096Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T06:43:40.0114023Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 41s local 2025-03-14T06:43:40.0114755Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T06:43:40.0115463Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:43:40.0116105Z @llvm-project//llvm:CodeGen; 19s local 2025-03-14T06:43:40.0116720Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2025-03-14T06:43:40.2175264Z 2025-03-14T06:43:40.2176061Z  2025-03-14T06:43:40.2176565Z  2025-03-14T06:43:40.2176979Z  2025-03-14T06:43:40.2177388Z  2025-03-14T06:43:40.2177799Z  2025-03-14T06:43:40.2178211Z  2025-03-14T06:43:40.2178602Z  2025-03-14T06:43:40.2179012Z  2025-03-14T06:43:40.2179976Z [19,763 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:40.2181268Z @llvm-project//mlir:LinalgTransforms; 105s local 2025-03-14T06:43:40.2182147Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 91s local 2025-03-14T06:43:40.2183123Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 47s local 2025-03-14T06:43:40.2184102Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 42s local 2025-03-14T06:43:40.2185073Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 36s local 2025-03-14T06:43:40.2185937Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:43:40.2186655Z @llvm-project//llvm:CodeGen; 19s local 2025-03-14T06:43:40.2187387Z @llvm-project//mlir:LinalgTransforms; 19s local ... 2025-03-14T06:43:41.2185093Z 2025-03-14T06:43:41.2185905Z  2025-03-14T06:43:41.2186311Z  2025-03-14T06:43:41.2186649Z  2025-03-14T06:43:41.2186979Z  2025-03-14T06:43:41.2187285Z  2025-03-14T06:43:41.2187607Z  2025-03-14T06:43:41.2187931Z  2025-03-14T06:43:41.2188273Z  2025-03-14T06:43:41.2189060Z [19,763 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:41.2189827Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T06:43:41.2190485Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T06:43:41.2191222Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 48s local 2025-03-14T06:43:41.2191967Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T06:43:41.2192703Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T06:43:41.2193357Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:43:41.2193886Z @llvm-project//llvm:CodeGen; 20s local 2025-03-14T06:43:41.2194436Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2025-03-14T06:43:41.5179105Z 2025-03-14T06:43:41.5179969Z  2025-03-14T06:43:41.5180458Z  2025-03-14T06:43:41.5180840Z  2025-03-14T06:43:41.5181245Z  2025-03-14T06:43:41.5181613Z  2025-03-14T06:43:41.5182238Z  2025-03-14T06:43:41.5182663Z  2025-03-14T06:43:41.5183042Z  2025-03-14T06:43:41.5183898Z [19,765 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:41.5184850Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T06:43:41.5185680Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T06:43:41.5186624Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T06:43:41.5187757Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T06:43:41.5188822Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T06:43:41.5189663Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:43:41.5190319Z @llvm-project//llvm:CodeGen; 20s local 2025-03-14T06:43:41.5190977Z @llvm-project//mlir:LinalgTransforms; 20s local ... 2025-03-14T06:43:41.7658651Z 2025-03-14T06:43:41.7659498Z  2025-03-14T06:43:41.7660049Z  2025-03-14T06:43:41.7660488Z  2025-03-14T06:43:41.7660906Z  2025-03-14T06:43:41.7661330Z  2025-03-14T06:43:41.7661747Z  2025-03-14T06:43:41.7662177Z  2025-03-14T06:43:41.7662598Z  2025-03-14T06:43:41.7663557Z [19,767 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:41.7664559Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T06:43:41.7666038Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T06:43:41.7667062Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T06:43:41.7667952Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T06:43:41.7668886Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 37s local 2025-03-14T06:43:41.7669678Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:43:41.7670493Z @llvm-project//llvm:CodeGen; 21s local 2025-03-14T06:43:41.7671164Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2025-03-14T06:43:42.0063237Z 2025-03-14T06:43:42.0064100Z  2025-03-14T06:43:42.0064574Z  2025-03-14T06:43:42.0064953Z  2025-03-14T06:43:42.0070266Z  2025-03-14T06:43:42.0071020Z  2025-03-14T06:43:42.0071434Z  2025-03-14T06:43:42.0071830Z  2025-03-14T06:43:42.0072232Z  2025-03-14T06:43:42.0073143Z [19,768 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:42.0074170Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T06:43:42.0075011Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 92s local 2025-03-14T06:43:42.0075984Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T06:43:42.0076912Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 43s local 2025-03-14T06:43:42.0077903Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T06:43:42.0078765Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:43:42.0079434Z @llvm-project//llvm:CodeGen; 21s local 2025-03-14T06:43:42.0080104Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2025-03-14T06:43:42.2192843Z 2025-03-14T06:43:42.2193707Z  2025-03-14T06:43:42.2194205Z  2025-03-14T06:43:42.2194621Z  2025-03-14T06:43:42.2195007Z  2025-03-14T06:43:42.2195398Z  2025-03-14T06:43:42.2195790Z  2025-03-14T06:43:42.2196215Z  2025-03-14T06:43:42.2196608Z  2025-03-14T06:43:42.2197576Z [19,768 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:42.2198537Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T06:43:42.2199363Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T06:43:42.2200298Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 49s local 2025-03-14T06:43:42.2201521Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2025-03-14T06:43:42.2202486Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T06:43:42.2203307Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:43:42.2203979Z @llvm-project//llvm:CodeGen; 21s local 2025-03-14T06:43:42.2204857Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2025-03-14T06:43:42.4257917Z 2025-03-14T06:43:42.4258750Z  2025-03-14T06:43:42.4259245Z  2025-03-14T06:43:42.4259685Z  2025-03-14T06:43:42.4260084Z  2025-03-14T06:43:42.4260497Z  2025-03-14T06:43:42.4261184Z  2025-03-14T06:43:42.4261611Z  2025-03-14T06:43:42.4262000Z  2025-03-14T06:43:42.4262919Z [19,770 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:42.4263951Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T06:43:42.4264820Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T06:43:42.4266107Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T06:43:42.4267105Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2025-03-14T06:43:42.4268073Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T06:43:42.4268945Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:43:42.4269674Z @llvm-project//llvm:CodeGen; 21s local 2025-03-14T06:43:42.4270382Z @llvm-project//mlir:LinalgTransforms; 21s local ... 2025-03-14T06:43:42.8198094Z 2025-03-14T06:43:42.8198940Z  2025-03-14T06:43:42.8199443Z  2025-03-14T06:43:42.8199845Z  2025-03-14T06:43:42.8200230Z  2025-03-14T06:43:42.8200611Z  2025-03-14T06:43:42.8200993Z  2025-03-14T06:43:42.8201390Z  2025-03-14T06:43:42.8201798Z  2025-03-14T06:43:42.8202720Z [19,770 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:42.8204054Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T06:43:42.8205046Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 93s local 2025-03-14T06:43:42.8206000Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T06:43:42.8206948Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 44s local 2025-03-14T06:43:42.8207873Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 38s local 2025-03-14T06:43:42.8208706Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:43:42.8209418Z @llvm-project//llvm:CodeGen; 22s local 2025-03-14T06:43:42.8210102Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2025-03-14T06:43:43.2242438Z 2025-03-14T06:43:43.2243249Z  2025-03-14T06:43:43.2243695Z  2025-03-14T06:43:43.2244057Z  2025-03-14T06:43:43.2244423Z  2025-03-14T06:43:43.2244911Z  2025-03-14T06:43:43.2245269Z  2025-03-14T06:43:43.2245606Z  2025-03-14T06:43:43.2245976Z  2025-03-14T06:43:43.2246839Z [19,771 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:43.2247694Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T06:43:43.2248411Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2025-03-14T06:43:43.2249241Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 50s local 2025-03-14T06:43:43.2250099Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T06:43:43.2250932Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2025-03-14T06:43:43.2251674Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:43:43.2252270Z @llvm-project//llvm:CodeGen; 22s local 2025-03-14T06:43:43.2252864Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2025-03-14T06:43:43.5234714Z 2025-03-14T06:43:43.5235533Z  2025-03-14T06:43:43.5236023Z  2025-03-14T06:43:43.5236438Z  2025-03-14T06:43:43.5236865Z  2025-03-14T06:43:43.5237265Z  2025-03-14T06:43:43.5237902Z  2025-03-14T06:43:43.5238312Z  2025-03-14T06:43:43.5238743Z  2025-03-14T06:43:43.5239665Z [19,773 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:43.5240610Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T06:43:43.5241446Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2025-03-14T06:43:43.5242391Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T06:43:43.5243540Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T06:43:43.5244499Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2025-03-14T06:43:43.5245507Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:43:43.5246217Z @llvm-project//llvm:CodeGen; 22s local 2025-03-14T06:43:43.5246922Z @llvm-project//mlir:LinalgTransforms; 22s local ... 2025-03-14T06:43:43.7613909Z 2025-03-14T06:43:43.7614728Z  2025-03-14T06:43:43.7615216Z  2025-03-14T06:43:43.7615649Z  2025-03-14T06:43:43.7616038Z  2025-03-14T06:43:43.7616435Z  2025-03-14T06:43:43.7616833Z  2025-03-14T06:43:43.7617222Z  2025-03-14T06:43:43.7617612Z  2025-03-14T06:43:43.7618502Z [19,775 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:43.7619478Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T06:43:43.7620654Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2025-03-14T06:43:43.7621718Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T06:43:43.7622682Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 45s local 2025-03-14T06:43:43.7623647Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 39s local 2025-03-14T06:43:43.7624497Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:43:43.7625422Z @llvm-project//llvm:CodeGen; 23s local 2025-03-14T06:43:43.7626110Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2025-03-14T06:43:44.0206353Z 2025-03-14T06:43:44.0207186Z  2025-03-14T06:43:44.0207674Z  2025-03-14T06:43:44.0208099Z  2025-03-14T06:43:44.0208502Z  2025-03-14T06:43:44.0208879Z  2025-03-14T06:43:44.0209261Z  2025-03-14T06:43:44.0209654Z  2025-03-14T06:43:44.0210043Z  2025-03-14T06:43:44.0210995Z [19,775 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:44.0212062Z @llvm-project//mlir:LinalgTransforms; 109s local 2025-03-14T06:43:44.0212938Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 94s local 2025-03-14T06:43:44.0213898Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T06:43:44.0214863Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T06:43:44.0215840Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T06:43:44.0216741Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:43:44.0217420Z @llvm-project//llvm:CodeGen; 23s local 2025-03-14T06:43:44.0218122Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2025-03-14T06:43:44.2890363Z 2025-03-14T06:43:44.2891228Z  2025-03-14T06:43:44.2891677Z  2025-03-14T06:43:44.2892042Z  2025-03-14T06:43:44.2892429Z  2025-03-14T06:43:44.2892802Z  2025-03-14T06:43:44.2893171Z  2025-03-14T06:43:44.2893537Z  2025-03-14T06:43:44.2893887Z  2025-03-14T06:43:44.2894744Z [19,778 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:44.2895625Z @llvm-project//mlir:LinalgTransforms; 109s local 2025-03-14T06:43:44.2896371Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T06:43:44.2897248Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 51s local 2025-03-14T06:43:44.2898115Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T06:43:44.2899279Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T06:43:44.2900025Z @llvm-project//llvm:CodeGen; 23s local 2025-03-14T06:43:44.2900632Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:43:44.2901332Z Compiling xla/service/spmd/dot_handler.cc; 17s local ... 2025-03-14T06:43:44.6211769Z 2025-03-14T06:43:44.6212607Z  2025-03-14T06:43:44.6213106Z  2025-03-14T06:43:44.6213567Z  2025-03-14T06:43:44.6213988Z  2025-03-14T06:43:44.6214388Z  2025-03-14T06:43:44.6215055Z  2025-03-14T06:43:44.6215483Z  2025-03-14T06:43:44.6215882Z  2025-03-14T06:43:44.6216852Z [19,779 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:44.6217773Z @llvm-project//mlir:LinalgTransforms; 109s local 2025-03-14T06:43:44.6218629Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T06:43:44.6219555Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T06:43:44.6220479Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T06:43:44.6221398Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T06:43:44.6222189Z @llvm-project//llvm:CodeGen; 23s local 2025-03-14T06:43:44.6222849Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:43:44.6223654Z Compiling xla/service/spmd/dot_handler.cc; 18s local ... 2025-03-14T06:43:44.8214744Z 2025-03-14T06:43:44.8215629Z  2025-03-14T06:43:44.8216160Z  2025-03-14T06:43:44.8216601Z  2025-03-14T06:43:44.8216995Z  2025-03-14T06:43:44.8217391Z  2025-03-14T06:43:44.8217802Z  2025-03-14T06:43:44.8218220Z  2025-03-14T06:43:44.8218643Z  2025-03-14T06:43:44.8219626Z [19,780 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:44.8221024Z @llvm-project//mlir:LinalgTransforms; 110s local 2025-03-14T06:43:44.8221886Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T06:43:44.8222722Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T06:43:44.8223588Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 46s local 2025-03-14T06:43:44.8224430Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 40s local 2025-03-14T06:43:44.8225225Z @llvm-project//llvm:CodeGen; 24s local 2025-03-14T06:43:44.8225897Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:43:44.8226705Z Compiling xla/service/spmd/dot_handler.cc; 18s local ... 2025-03-14T06:43:45.1649144Z 2025-03-14T06:43:45.1649987Z  2025-03-14T06:43:45.1650489Z  2025-03-14T06:43:45.1650934Z  2025-03-14T06:43:45.1651362Z  2025-03-14T06:43:45.1651786Z  2025-03-14T06:43:45.1652190Z  2025-03-14T06:43:45.1652592Z  2025-03-14T06:43:45.1653024Z  2025-03-14T06:43:45.1653964Z [19,781 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:45.1654931Z @llvm-project//mlir:LinalgTransforms; 110s local 2025-03-14T06:43:45.1655800Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 95s local 2025-03-14T06:43:45.1656823Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T06:43:45.1657728Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T06:43:45.1658671Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T06:43:45.1659513Z @llvm-project//llvm:CodeGen; 24s local 2025-03-14T06:43:45.1660204Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:43:45.1661023Z Compiling xla/service/spmd/dot_handler.cc; 18s local ... 2025-03-14T06:43:45.3687789Z 2025-03-14T06:43:45.3688609Z  2025-03-14T06:43:45.3689130Z  2025-03-14T06:43:45.3689568Z  2025-03-14T06:43:45.3690039Z  2025-03-14T06:43:45.3690461Z  2025-03-14T06:43:45.3691119Z  2025-03-14T06:43:45.3691545Z  2025-03-14T06:43:45.3691977Z  2025-03-14T06:43:45.3692976Z [19,782 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:45.3694020Z @llvm-project//mlir:LinalgTransforms; 110s local 2025-03-14T06:43:45.3694962Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2025-03-14T06:43:45.3695957Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 52s local 2025-03-14T06:43:45.3697214Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T06:43:45.3698295Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T06:43:45.3699260Z @llvm-project//llvm:CodeGen; 24s local 2025-03-14T06:43:45.3699929Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:43:45.3700761Z Compiling xla/service/spmd/dot_handler.cc; 18s local ... 2025-03-14T06:43:45.6220541Z 2025-03-14T06:43:45.6221406Z  2025-03-14T06:43:45.6221962Z  2025-03-14T06:43:45.6222418Z  2025-03-14T06:43:45.6222860Z  2025-03-14T06:43:45.6223281Z  2025-03-14T06:43:45.6223714Z  2025-03-14T06:43:45.6224152Z  2025-03-14T06:43:45.6224583Z  2025-03-14T06:43:45.6225607Z [19,782 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:45.6237117Z @llvm-project//mlir:LinalgTransforms; 110s local 2025-03-14T06:43:45.6238318Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2025-03-14T06:43:45.6239327Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T06:43:45.6240364Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T06:43:45.6241403Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T06:43:45.6242268Z @llvm-project//llvm:CodeGen; 24s local 2025-03-14T06:43:45.6243188Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:43:45.6244015Z Compiling xla/service/spmd/dot_handler.cc; 19s local ... 2025-03-14T06:43:45.8223277Z 2025-03-14T06:43:45.8224092Z  2025-03-14T06:43:45.8224568Z  2025-03-14T06:43:45.8224981Z  2025-03-14T06:43:45.8225427Z  2025-03-14T06:43:45.8225873Z  2025-03-14T06:43:45.8226305Z  2025-03-14T06:43:45.8226717Z  2025-03-14T06:43:45.8227154Z  2025-03-14T06:43:45.8228168Z [19,784 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:45.8229256Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T06:43:45.8230146Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 96s local 2025-03-14T06:43:45.8231142Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T06:43:45.8232210Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 47s local 2025-03-14T06:43:45.8233272Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 41s local 2025-03-14T06:43:45.8234142Z @llvm-project//llvm:CodeGen; 25s local 2025-03-14T06:43:45.8234964Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:43:45.8235806Z Compiling xla/service/spmd/dot_handler.cc; 19s local ... 2025-03-14T06:43:46.2225486Z 2025-03-14T06:43:46.2226316Z  2025-03-14T06:43:46.2226734Z  2025-03-14T06:43:46.2227099Z  2025-03-14T06:43:46.2227444Z  2025-03-14T06:43:46.2227784Z  2025-03-14T06:43:46.2228157Z  2025-03-14T06:43:46.2228497Z  2025-03-14T06:43:46.2228835Z  2025-03-14T06:43:46.2229646Z [19,784 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:46.2230487Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T06:43:46.2231246Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T06:43:46.2232078Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 53s local 2025-03-14T06:43:46.2233132Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T06:43:46.2234011Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2025-03-14T06:43:46.2234810Z @llvm-project//llvm:CodeGen; 25s local 2025-03-14T06:43:46.2235465Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:43:46.2236173Z Compiling xla/service/spmd/dot_handler.cc; 19s local ... 2025-03-14T06:43:46.4247270Z 2025-03-14T06:43:46.4248093Z  2025-03-14T06:43:46.4248622Z  2025-03-14T06:43:46.4249065Z  2025-03-14T06:43:46.4249498Z  2025-03-14T06:43:46.4250232Z  2025-03-14T06:43:46.4250676Z  2025-03-14T06:43:46.4251108Z  2025-03-14T06:43:46.4251512Z  2025-03-14T06:43:46.4252417Z [19,787 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:46.4253490Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T06:43:46.4254436Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T06:43:46.4255492Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T06:43:46.4256530Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T06:43:46.4257571Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2025-03-14T06:43:46.4258553Z @llvm-project//llvm:CodeGen; 25s local 2025-03-14T06:43:46.4259272Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:43:46.4260262Z Compiling xla/service/spmd/dot_handler.cc; 19s local ... 2025-03-14T06:43:46.6775695Z 2025-03-14T06:43:46.6776603Z  2025-03-14T06:43:46.6777085Z  2025-03-14T06:43:46.6777493Z  2025-03-14T06:43:46.6777898Z  2025-03-14T06:43:46.6778302Z  2025-03-14T06:43:46.6778713Z  2025-03-14T06:43:46.6779104Z  2025-03-14T06:43:46.6779622Z  2025-03-14T06:43:46.6780580Z [19,788 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:46.6782001Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T06:43:46.6782848Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T06:43:46.6783841Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T06:43:46.6784797Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 48s local 2025-03-14T06:43:46.6785759Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 42s local 2025-03-14T06:43:46.6786579Z @llvm-project//llvm:CodeGen; 26s local 2025-03-14T06:43:46.6787281Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:43:46.6788070Z Compiling xla/service/spmd/dot_handler.cc; 20s local ... 2025-03-14T06:43:47.0232340Z 2025-03-14T06:43:47.0233197Z  2025-03-14T06:43:47.0233713Z  2025-03-14T06:43:47.0234133Z  2025-03-14T06:43:47.0234551Z  2025-03-14T06:43:47.0234967Z  2025-03-14T06:43:47.0235370Z  2025-03-14T06:43:47.0235820Z  2025-03-14T06:43:47.0236236Z  2025-03-14T06:43:47.0237176Z [19,791 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:47.0238226Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T06:43:47.0239134Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 97s local 2025-03-14T06:43:47.0240086Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T06:43:47.0241102Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T06:43:47.0242140Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T06:43:47.0242976Z @llvm-project//llvm:CodeGen; 26s local 2025-03-14T06:43:47.0243715Z Compiling xla/service/spmd/dot_handler.cc; 20s local 2025-03-14T06:43:47.0244461Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T06:43:47.2235316Z 2025-03-14T06:43:47.2236126Z  2025-03-14T06:43:47.2236609Z  2025-03-14T06:43:47.2237044Z  2025-03-14T06:43:47.2237442Z  2025-03-14T06:43:47.2238093Z  2025-03-14T06:43:47.2238511Z  2025-03-14T06:43:47.2238910Z  2025-03-14T06:43:47.2239304Z  2025-03-14T06:43:47.2240263Z [19,794 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:47.2241255Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T06:43:47.2242113Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T06:43:47.2243083Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 54s local 2025-03-14T06:43:47.2244212Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T06:43:47.2245352Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T06:43:47.2246161Z @llvm-project//llvm:CodeGen; 26s local 2025-03-14T06:43:47.2246826Z Compiling xla/service/spmd/dot_handler.cc; 20s local 2025-03-14T06:43:47.2247458Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T06:43:47.4244317Z 2025-03-14T06:43:47.4245364Z  2025-03-14T06:43:47.4245865Z  2025-03-14T06:43:47.4246287Z  2025-03-14T06:43:47.4246734Z  2025-03-14T06:43:47.4247132Z  2025-03-14T06:43:47.4247518Z  2025-03-14T06:43:47.4247885Z  2025-03-14T06:43:47.4248294Z  2025-03-14T06:43:47.4249262Z [19,795 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:47.4250235Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T06:43:47.4251447Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T06:43:47.4252379Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2025-03-14T06:43:47.4253306Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T06:43:47.4254194Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T06:43:47.4255028Z Compiling xla/service/spmd/dot_handler.cc; 20s local 2025-03-14T06:43:47.4255947Z @stablehlo//:stablehlo_passes; 18s local 2025-03-14T06:43:47.4256666Z Compiling xla/pjrt/pjrt_executable.cc; 18s local ... 2025-03-14T06:43:47.8241028Z 2025-03-14T06:43:47.8241869Z  2025-03-14T06:43:47.8242411Z  2025-03-14T06:43:47.8242886Z  2025-03-14T06:43:47.8243351Z  2025-03-14T06:43:47.8243794Z  2025-03-14T06:43:47.8244177Z  2025-03-14T06:43:47.8244551Z  2025-03-14T06:43:47.8245132Z  2025-03-14T06:43:47.8246134Z [19,795 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:47.8247137Z @llvm-project//mlir:LinalgTransforms; 113s local 2025-03-14T06:43:47.8247972Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 98s local 2025-03-14T06:43:47.8248891Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2025-03-14T06:43:47.8249880Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 49s local 2025-03-14T06:43:47.8250877Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 43s local 2025-03-14T06:43:47.8251757Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2025-03-14T06:43:47.8252522Z @stablehlo//:stablehlo_passes; 18s local 2025-03-14T06:43:47.8253284Z Compiling xla/pjrt/pjrt_executable.cc; 18s local ... 2025-03-14T06:43:48.2944218Z 2025-03-14T06:43:48.2945089Z  2025-03-14T06:43:48.2945549Z  2025-03-14T06:43:48.2945939Z  2025-03-14T06:43:48.2946330Z  2025-03-14T06:43:48.2946748Z  2025-03-14T06:43:48.2947127Z  2025-03-14T06:43:48.2947615Z  2025-03-14T06:43:48.2948135Z  2025-03-14T06:43:48.2949159Z [19,796 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:48.2950142Z @llvm-project//mlir:LinalgTransforms; 113s local 2025-03-14T06:43:48.2950963Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T06:43:48.2951922Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 55s local 2025-03-14T06:43:48.2953201Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T06:43:48.2954169Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T06:43:48.2955025Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2025-03-14T06:43:48.2955722Z @stablehlo//:stablehlo_passes; 19s local 2025-03-14T06:43:48.2956460Z Compiling xla/pjrt/pjrt_executable.cc; 19s local ... 2025-03-14T06:43:48.5293328Z 2025-03-14T06:43:48.5294258Z  2025-03-14T06:43:48.5294750Z  2025-03-14T06:43:48.5295159Z  2025-03-14T06:43:48.5295891Z  2025-03-14T06:43:48.5296330Z  2025-03-14T06:43:48.5296721Z  2025-03-14T06:43:48.5297141Z  2025-03-14T06:43:48.5297502Z  2025-03-14T06:43:48.5301655Z [19,799 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:48.5302762Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T06:43:48.5303774Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T06:43:48.5304749Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T06:43:48.5305694Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T06:43:48.5306538Z Compiling xla/service/spmd/dot_handler.cc; 21s local 2025-03-14T06:43:48.5307378Z @stablehlo//:stablehlo_passes; 19s local 2025-03-14T06:43:48.5308059Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2025-03-14T06:43:48.5309254Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 15s local ... 2025-03-14T06:43:48.7969336Z 2025-03-14T06:43:48.7970183Z  2025-03-14T06:43:48.7970657Z  2025-03-14T06:43:48.7971033Z  2025-03-14T06:43:48.7971420Z  2025-03-14T06:43:48.7971840Z  2025-03-14T06:43:48.7972209Z  2025-03-14T06:43:48.7972617Z  2025-03-14T06:43:48.7973020Z  2025-03-14T06:43:48.7974033Z [19,800 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:48.7975426Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T06:43:48.7976393Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T06:43:48.7977375Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 50s local 2025-03-14T06:43:48.7978351Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 44s local 2025-03-14T06:43:48.7979237Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2025-03-14T06:43:48.7979932Z @stablehlo//:stablehlo_passes; 19s local 2025-03-14T06:43:48.7980737Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2025-03-14T06:43:48.7981862Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 15s local ... 2025-03-14T06:43:49.0248845Z 2025-03-14T06:43:49.0249674Z  2025-03-14T06:43:49.0250108Z  2025-03-14T06:43:49.0250496Z  2025-03-14T06:43:49.0250902Z  2025-03-14T06:43:49.0251261Z  2025-03-14T06:43:49.0251623Z  2025-03-14T06:43:49.0251991Z  2025-03-14T06:43:49.0252374Z  2025-03-14T06:43:49.0253211Z [19,800 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:49.0254161Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 99s local 2025-03-14T06:43:49.0255031Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T06:43:49.0255904Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T06:43:49.0256757Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T06:43:49.0257530Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2025-03-14T06:43:49.0258166Z @stablehlo//:stablehlo_passes; 20s local 2025-03-14T06:43:49.0258802Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2025-03-14T06:43:49.0259669Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 15s local ... 2025-03-14T06:43:49.2252371Z 2025-03-14T06:43:49.2253151Z  2025-03-14T06:43:49.2253563Z  2025-03-14T06:43:49.2254166Z  2025-03-14T06:43:49.2254508Z  2025-03-14T06:43:49.2254851Z  2025-03-14T06:43:49.2255194Z  2025-03-14T06:43:49.2255511Z  2025-03-14T06:43:49.2255846Z  2025-03-14T06:43:49.2256670Z [19,801 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:49.2257603Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2025-03-14T06:43:49.2258569Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 56s local 2025-03-14T06:43:49.2259522Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T06:43:49.2260377Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T06:43:49.2261133Z Compiling xla/service/spmd/dot_handler.cc; 22s local 2025-03-14T06:43:49.2261778Z @stablehlo//:stablehlo_passes; 20s local 2025-03-14T06:43:49.2262374Z Compiling xla/pjrt/pjrt_executable.cc; 20s local 2025-03-14T06:43:49.2263209Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 15s local ... 2025-03-14T06:43:49.6256671Z 2025-03-14T06:43:49.6257583Z  2025-03-14T06:43:49.6258178Z  2025-03-14T06:43:49.6258699Z  2025-03-14T06:43:49.6259203Z  2025-03-14T06:43:49.6259576Z  2025-03-14T06:43:49.6259936Z  2025-03-14T06:43:49.6260322Z  2025-03-14T06:43:49.6260709Z  2025-03-14T06:43:49.6261643Z [19,802 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:49.6262999Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2025-03-14T06:43:49.6263937Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 57s local 2025-03-14T06:43:49.6265062Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T06:43:49.6266356Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T06:43:49.6267376Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2025-03-14T06:43:49.6268074Z @stablehlo//:stablehlo_passes; 20s local 2025-03-14T06:43:49.6268752Z Compiling xla/pjrt/pjrt_executable.cc; 20s local 2025-03-14T06:43:49.6269675Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local ... 2025-03-14T06:43:49.9351904Z 2025-03-14T06:43:49.9352830Z  2025-03-14T06:43:49.9353334Z  2025-03-14T06:43:49.9353685Z  2025-03-14T06:43:49.9354105Z  2025-03-14T06:43:49.9354658Z  2025-03-14T06:43:49.9355073Z  2025-03-14T06:43:49.9355521Z  2025-03-14T06:43:49.9355977Z  2025-03-14T06:43:49.9356886Z [19,803 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:49.9357923Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 100s local 2025-03-14T06:43:49.9358959Z Compiling xla/backends/cpu/runtime/dot_thunk_c128.cc; 57s local 2025-03-14T06:43:49.9359839Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 51s local 2025-03-14T06:43:49.9360758Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 45s local 2025-03-14T06:43:49.9361563Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2025-03-14T06:43:49.9362248Z @stablehlo//:stablehlo_passes; 20s local 2025-03-14T06:43:49.9363053Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local 2025-03-14T06:43:49.9364010Z Compiling stablehlo/transforms/VhloToVersion.cpp; 16s local ... 2025-03-14T06:43:50.2259503Z 2025-03-14T06:43:50.2260346Z  2025-03-14T06:43:50.2260831Z  2025-03-14T06:43:50.2261238Z  2025-03-14T06:43:50.2261606Z  2025-03-14T06:43:50.2262060Z  2025-03-14T06:43:50.2262586Z  2025-03-14T06:43:50.2263083Z  2025-03-14T06:43:50.2263558Z  2025-03-14T06:43:50.2264664Z [19,806 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:50.2266024Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 101s local 2025-03-14T06:43:50.2267267Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T06:43:50.2268170Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T06:43:50.2269180Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2025-03-14T06:43:50.2270012Z @stablehlo//:stablehlo_passes; 21s local 2025-03-14T06:43:50.2270990Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local 2025-03-14T06:43:50.2272019Z Compiling stablehlo/transforms/VhloToVersion.cpp; 16s local 2025-03-14T06:43:50.2273325Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 14s local ... 2025-03-14T06:43:50.4262493Z 2025-03-14T06:43:50.4263469Z  2025-03-14T06:43:50.4263966Z  2025-03-14T06:43:50.4264372Z  2025-03-14T06:43:50.4264773Z  2025-03-14T06:43:50.4265189Z  2025-03-14T06:43:50.4265796Z  2025-03-14T06:43:50.4266215Z  2025-03-14T06:43:50.4266626Z  2025-03-14T06:43:50.4267787Z [19,807 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:50.4268930Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 101s local 2025-03-14T06:43:50.4269923Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T06:43:50.4270934Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T06:43:50.4271871Z Compiling xla/service/spmd/dot_handler.cc; 23s local 2025-03-14T06:43:50.4272852Z @stablehlo//:stablehlo_passes; 21s local 2025-03-14T06:43:50.4273668Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local 2025-03-14T06:43:50.4274635Z Compiling stablehlo/transforms/VhloToVersion.cpp; 16s local 2025-03-14T06:43:50.4275748Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 15s local ... 2025-03-14T06:43:50.8265252Z 2025-03-14T06:43:50.8266806Z  2025-03-14T06:43:50.8267262Z  2025-03-14T06:43:50.8268027Z  2025-03-14T06:43:50.8268474Z  2025-03-14T06:43:50.8268890Z  2025-03-14T06:43:50.8269329Z  2025-03-14T06:43:50.8269755Z  2025-03-14T06:43:50.8270205Z  2025-03-14T06:43:50.8271195Z [19,810 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:50.8272281Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 101s local 2025-03-14T06:43:50.8273157Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 52s local 2025-03-14T06:43:50.8274166Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 46s local 2025-03-14T06:43:50.8275056Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T06:43:50.8275816Z @stablehlo//:stablehlo_passes; 21s local 2025-03-14T06:43:50.8276590Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 17s local 2025-03-14T06:43:50.8277644Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 15s local 2025-03-14T06:43:50.8278566Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2025-03-14T06:43:51.0593151Z 2025-03-14T06:43:51.0594021Z  2025-03-14T06:43:51.0594522Z  2025-03-14T06:43:51.0594914Z  2025-03-14T06:43:51.0595309Z  2025-03-14T06:43:51.0595718Z  2025-03-14T06:43:51.0596108Z  2025-03-14T06:43:51.0596507Z  2025-03-14T06:43:51.0596928Z  2025-03-14T06:43:51.0597886Z [19,811 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:51.0599050Z Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 101s local 2025-03-14T06:43:51.0600073Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T06:43:51.0601053Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T06:43:51.0601928Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T06:43:51.0602666Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T06:43:51.0603526Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 17s local 2025-03-14T06:43:51.0605136Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 15s local 2025-03-14T06:43:51.0606175Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2025-03-14T06:43:51.3883125Z 2025-03-14T06:43:51.3884132Z  2025-03-14T06:43:51.3884774Z  2025-03-14T06:43:51.3885197Z  2025-03-14T06:43:51.3885615Z  2025-03-14T06:43:51.3885957Z  2025-03-14T06:43:51.3886382Z  2025-03-14T06:43:51.3886803Z  2025-03-14T06:43:51.3887227Z  2025-03-14T06:43:51.3888384Z [19,812 / 20,651] 4 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:43:51.3889494Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T06:43:51.3890445Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T06:43:51.3891312Z Compiling xla/service/spmd/dot_handler.cc; 24s local 2025-03-14T06:43:51.3892049Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T06:43:51.3892915Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 17s local 2025-03-14T06:43:51.3894032Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 16s local 2025-03-14T06:43:51.3894968Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2025-03-14T06:43:51.3895626Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:43:51.6271858Z 2025-03-14T06:43:51.6273249Z  2025-03-14T06:43:51.6273775Z  2025-03-14T06:43:51.6274332Z  2025-03-14T06:43:51.6275212Z  2025-03-14T06:43:51.6275742Z  2025-03-14T06:43:51.6276405Z  2025-03-14T06:43:51.6276896Z  2025-03-14T06:43:51.6277252Z  2025-03-14T06:43:51.6278144Z [19,813 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:51.6279265Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T06:43:51.6280177Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T06:43:51.6281261Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T06:43:51.6281957Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T06:43:51.6282770Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 18s local 2025-03-14T06:43:51.6283824Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 16s local 2025-03-14T06:43:51.6284804Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:43:51.6285524Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:43:51.9442603Z 2025-03-14T06:43:51.9443444Z  2025-03-14T06:43:51.9443939Z  2025-03-14T06:43:51.9444377Z  2025-03-14T06:43:51.9444884Z  2025-03-14T06:43:51.9445256Z  2025-03-14T06:43:51.9445640Z  2025-03-14T06:43:51.9446043Z  2025-03-14T06:43:51.9446437Z  2025-03-14T06:43:51.9447381Z [19,814 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:51.9448441Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 53s local 2025-03-14T06:43:51.9449414Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 47s local 2025-03-14T06:43:51.9450230Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T06:43:51.9450836Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T06:43:51.9451653Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 18s local 2025-03-14T06:43:51.9452757Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 16s local 2025-03-14T06:43:51.9453701Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:43:51.9454415Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:43:52.2276745Z 2025-03-14T06:43:52.2277667Z  2025-03-14T06:43:52.2278227Z  2025-03-14T06:43:52.2278689Z  2025-03-14T06:43:52.2279132Z  2025-03-14T06:43:52.2279574Z  2025-03-14T06:43:52.2279954Z  2025-03-14T06:43:52.2280320Z  2025-03-14T06:43:52.2280721Z  2025-03-14T06:43:52.2281989Z [19,814 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:52.2283141Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T06:43:52.2284136Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T06:43:52.2285165Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T06:43:52.2285923Z @stablehlo//:stablehlo_passes; 23s local 2025-03-14T06:43:52.2286801Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 18s local 2025-03-14T06:43:52.2288158Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 16s local 2025-03-14T06:43:52.2289085Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:43:52.2289802Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:43:52.4281775Z 2025-03-14T06:43:52.4282626Z  2025-03-14T06:43:52.4283145Z  2025-03-14T06:43:52.4283557Z  2025-03-14T06:43:52.4283977Z  2025-03-14T06:43:52.4284420Z  2025-03-14T06:43:52.4284944Z  2025-03-14T06:43:52.4285357Z  2025-03-14T06:43:52.4285752Z  2025-03-14T06:43:52.4286603Z [19,815 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:52.4287641Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 54s local 2025-03-14T06:43:52.4288570Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 48s local 2025-03-14T06:43:52.4289458Z Compiling xla/service/spmd/dot_handler.cc; 25s local 2025-03-14T06:43:52.4290428Z @stablehlo//:stablehlo_passes; 23s local 2025-03-14T06:43:52.4291317Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 17s local 2025-03-14T06:43:52.4292242Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:43:52.4292921Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:43:52.4293709Z Compiling torch_xla/csrc/runtime/xla_util.cc; 13s local ... 2025-03-14T06:43:53.1040287Z 2025-03-14T06:43:53.1041334Z  2025-03-14T06:43:53.1041764Z  2025-03-14T06:43:53.1042139Z  2025-03-14T06:43:53.1042482Z  2025-03-14T06:43:53.1042851Z  2025-03-14T06:43:53.1043225Z  2025-03-14T06:43:53.1043574Z  2025-03-14T06:43:53.1043930Z  2025-03-14T06:43:53.1044900Z [19,816 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:53.1045859Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T06:43:53.1046743Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T06:43:53.1047562Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2025-03-14T06:43:53.1048225Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T06:43:53.1049049Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 17s local 2025-03-14T06:43:53.1049892Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:43:53.1050482Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:43:53.1051229Z Compiling torch_xla/csrc/runtime/xla_util.cc; 14s local ... 2025-03-14T06:43:53.4287557Z 2025-03-14T06:43:53.4288424Z  2025-03-14T06:43:53.4288916Z  2025-03-14T06:43:53.4289326Z  2025-03-14T06:43:53.4289749Z  2025-03-14T06:43:53.4290158Z  2025-03-14T06:43:53.4290569Z  2025-03-14T06:43:53.4290985Z  2025-03-14T06:43:53.4291394Z  2025-03-14T06:43:53.4292356Z [19,816 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:53.4293516Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T06:43:53.4294488Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T06:43:53.4295392Z Compiling xla/service/spmd/dot_handler.cc; 26s local 2025-03-14T06:43:53.4296126Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T06:43:53.4297037Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 18s local 2025-03-14T06:43:53.4297979Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:43:53.4298967Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:43:53.4299810Z Compiling torch_xla/csrc/runtime/xla_util.cc; 14s local ... 2025-03-14T06:43:53.6290369Z 2025-03-14T06:43:53.6291372Z  2025-03-14T06:43:53.6291900Z  2025-03-14T06:43:53.6292351Z  2025-03-14T06:43:53.6292778Z  2025-03-14T06:43:53.6293234Z  2025-03-14T06:43:53.6293643Z  2025-03-14T06:43:53.6294166Z  2025-03-14T06:43:53.6294563Z  2025-03-14T06:43:53.6295766Z [19,817 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:53.6296924Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T06:43:53.6297877Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T06:43:53.6298702Z Compiling xla/service/spmd/dot_handler.cc; 27s local 2025-03-14T06:43:53.6299443Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T06:43:53.6300348Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 18s local 2025-03-14T06:43:53.6301252Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:43:53.6301909Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:43:53.6302699Z Compiling torch_xla/csrc/runtime/xla_util.cc; 15s local ... 2025-03-14T06:43:53.8461381Z 2025-03-14T06:43:53.8462485Z  2025-03-14T06:43:53.8463017Z  2025-03-14T06:43:53.8463725Z  2025-03-14T06:43:53.8464181Z  2025-03-14T06:43:53.8464626Z  2025-03-14T06:43:53.8464990Z  2025-03-14T06:43:53.8465572Z  2025-03-14T06:43:53.8465974Z  2025-03-14T06:43:53.8466869Z [19,819 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:53.8467945Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 55s local 2025-03-14T06:43:53.8468868Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 49s local 2025-03-14T06:43:53.8469962Z Compiling xla/service/spmd/dot_handler.cc; 27s local 2025-03-14T06:43:53.8470673Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T06:43:53.8471548Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 18s local 2025-03-14T06:43:53.8472443Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:43:53.8473118Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:43:53.8474040Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 14s local ... 2025-03-14T06:43:54.0488227Z 2025-03-14T06:43:54.0489169Z  2025-03-14T06:43:54.0489745Z  2025-03-14T06:43:54.0490197Z  2025-03-14T06:43:54.0490633Z  2025-03-14T06:43:54.0491087Z  2025-03-14T06:43:54.0491465Z  2025-03-14T06:43:54.0491856Z  2025-03-14T06:43:54.0492276Z  2025-03-14T06:43:54.0493259Z [19,821 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:54.0494520Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T06:43:54.0495515Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T06:43:54.0496392Z Compiling xla/service/spmd/dot_handler.cc; 27s local 2025-03-14T06:43:54.0497133Z @stablehlo//:stablehlo_passes; 25s local 2025-03-14T06:43:54.0498019Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 18s local 2025-03-14T06:43:54.0498987Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:43:54.0499695Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:43:54.0500637Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local ... 2025-03-14T06:43:54.4297100Z 2025-03-14T06:43:54.4298068Z  2025-03-14T06:43:54.4298595Z  2025-03-14T06:43:54.4299162Z  2025-03-14T06:43:54.4299581Z  2025-03-14T06:43:54.4300044Z  2025-03-14T06:43:54.4300437Z  2025-03-14T06:43:54.4300832Z  2025-03-14T06:43:54.4301263Z  2025-03-14T06:43:54.4302425Z [19,822 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:54.4303533Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T06:43:54.4304502Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T06:43:54.4305314Z @stablehlo//:stablehlo_passes; 25s local 2025-03-14T06:43:54.4306217Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 19s local 2025-03-14T06:43:54.4307154Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:43:54.4307979Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:43:54.4308949Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2025-03-14T06:43:54.4310054Z Compiling xla/service/spmd/convolution_handler.cc; 14s local ... 2025-03-14T06:43:54.6299672Z 2025-03-14T06:43:54.6300616Z  2025-03-14T06:43:54.6301135Z  2025-03-14T06:43:54.6301597Z  2025-03-14T06:43:54.6302090Z  2025-03-14T06:43:54.6302563Z  2025-03-14T06:43:54.6302951Z  2025-03-14T06:43:54.6303343Z  2025-03-14T06:43:54.6303750Z  2025-03-14T06:43:54.6304683Z [19,827 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:54.6305673Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T06:43:54.6306639Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T06:43:54.6307943Z @stablehlo//:stablehlo_passes; 25s local 2025-03-14T06:43:54.6308746Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 19s local 2025-03-14T06:43:54.6309722Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:43:54.6310663Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2025-03-14T06:43:54.6311733Z Compiling xla/service/spmd/convolution_handler.cc; 15s local 2025-03-14T06:43:54.6312871Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 14s local ... 2025-03-14T06:43:54.8998678Z 2025-03-14T06:43:54.8999666Z  2025-03-14T06:43:54.9000198Z  2025-03-14T06:43:54.9000644Z  2025-03-14T06:43:54.9001080Z  2025-03-14T06:43:54.9001531Z  2025-03-14T06:43:54.9001924Z  2025-03-14T06:43:54.9002346Z  2025-03-14T06:43:54.9002699Z  2025-03-14T06:43:54.9003620Z [19,829 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:54.9004814Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 56s local 2025-03-14T06:43:54.9005800Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 50s local 2025-03-14T06:43:54.9006874Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 19s local 2025-03-14T06:43:54.9007817Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:43:54.9008671Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 15s local 2025-03-14T06:43:54.9009676Z Compiling xla/service/spmd/convolution_handler.cc; 15s local 2025-03-14T06:43:54.9010727Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 14s local 2025-03-14T06:43:54.9011759Z Compiling xla/service/allocation_tracker.cc; 13s local ... 2025-03-14T06:43:55.2010546Z 2025-03-14T06:43:55.2011478Z  2025-03-14T06:43:55.2012022Z  2025-03-14T06:43:55.2012407Z  2025-03-14T06:43:55.2012796Z  2025-03-14T06:43:55.2013183Z  2025-03-14T06:43:55.2013556Z  2025-03-14T06:43:55.2013987Z  2025-03-14T06:43:55.2014384Z  2025-03-14T06:43:55.2015348Z [19,830 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:55.2016499Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T06:43:55.2017435Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T06:43:55.2018377Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 19s local 2025-03-14T06:43:55.2019347Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:43:55.2020422Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2025-03-14T06:43:55.2021276Z Compiling xla/service/spmd/convolution_handler.cc; 15s local 2025-03-14T06:43:55.2022271Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 15s local 2025-03-14T06:43:55.2023221Z Compiling xla/service/allocation_tracker.cc; 13s local ... 2025-03-14T06:43:55.4021978Z 2025-03-14T06:43:55.4022948Z  2025-03-14T06:43:55.4023477Z  2025-03-14T06:43:55.4023940Z  2025-03-14T06:43:55.4024704Z  2025-03-14T06:43:55.4025115Z  2025-03-14T06:43:55.4025493Z  2025-03-14T06:43:55.4025890Z  2025-03-14T06:43:55.4026292Z  2025-03-14T06:43:55.4027249Z [19,832 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:55.4028312Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T06:43:55.4029412Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T06:43:55.4030485Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2025-03-14T06:43:55.4031440Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:43:55.4032342Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2025-03-14T06:43:55.4033397Z Compiling xla/service/spmd/convolution_handler.cc; 15s local 2025-03-14T06:43:55.4034464Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 15s local 2025-03-14T06:43:55.4035688Z Compiling xla/service/allocation_tracker.cc; 13s local ... 2025-03-14T06:43:55.6183553Z 2025-03-14T06:43:55.6184462Z  2025-03-14T06:43:55.6184953Z  2025-03-14T06:43:55.6185351Z  2025-03-14T06:43:55.6185769Z  2025-03-14T06:43:55.6186200Z  2025-03-14T06:43:55.6186625Z  2025-03-14T06:43:55.6187038Z  2025-03-14T06:43:55.6187445Z  2025-03-14T06:43:55.6188703Z [19,835 / 20,651] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:55.6189831Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T06:43:55.6190803Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T06:43:55.6191912Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2025-03-14T06:43:55.6192907Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:43:55.6193875Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2025-03-14T06:43:55.6194896Z Compiling xla/service/spmd/convolution_handler.cc; 16s local 2025-03-14T06:43:55.6195924Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 15s local 2025-03-14T06:43:55.6196958Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2025-03-14T06:43:55.8311026Z 2025-03-14T06:43:55.8311902Z  2025-03-14T06:43:55.8312415Z  2025-03-14T06:43:55.8312877Z  2025-03-14T06:43:55.8313282Z  2025-03-14T06:43:55.8313693Z  2025-03-14T06:43:55.8314125Z  2025-03-14T06:43:55.8314526Z  2025-03-14T06:43:55.8314941Z  2025-03-14T06:43:55.8315849Z [19,835 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:55.8316934Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 57s local 2025-03-14T06:43:55.8317820Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 51s local 2025-03-14T06:43:55.8318903Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2025-03-14T06:43:55.8319849Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:43:55.8320779Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 16s local 2025-03-14T06:43:55.8321722Z Compiling xla/service/spmd/convolution_handler.cc; 16s local 2025-03-14T06:43:55.8322808Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 15s local 2025-03-14T06:43:55.8323840Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2025-03-14T06:43:56.0313782Z 2025-03-14T06:43:56.0314616Z  2025-03-14T06:43:56.0315037Z  2025-03-14T06:43:56.0315412Z  2025-03-14T06:43:56.0315766Z  2025-03-14T06:43:56.0316115Z  2025-03-14T06:43:56.0316484Z  2025-03-14T06:43:56.0316845Z  2025-03-14T06:43:56.0317187Z  2025-03-14T06:43:56.0317993Z [19,838 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:56.0318954Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T06:43:56.0319937Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T06:43:56.0320813Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 20s local 2025-03-14T06:43:56.0321626Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:43:56.0322406Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2025-03-14T06:43:56.0323435Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 15s local 2025-03-14T06:43:56.0324283Z Compiling xla/service/allocation_tracker.cc; 14s local 2025-03-14T06:43:56.0325222Z Compiling .../shardy/mhlo_round_trip/shard_map_import.cc; 13s local ... 2025-03-14T06:43:56.4318288Z 2025-03-14T06:43:56.4319105Z  2025-03-14T06:43:56.4319572Z  2025-03-14T06:43:56.4319933Z  2025-03-14T06:43:56.4320283Z  2025-03-14T06:43:56.4320652Z  2025-03-14T06:43:56.4321396Z  2025-03-14T06:43:56.4321789Z  2025-03-14T06:43:56.4322169Z  2025-03-14T06:43:56.4323075Z [19,839 / 20,651] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:56.4324140Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T06:43:56.4325240Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T06:43:56.4326240Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2025-03-14T06:43:56.4327344Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:43:56.4328214Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2025-03-14T06:43:56.4329273Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 16s local 2025-03-14T06:43:56.4330191Z Compiling xla/service/allocation_tracker.cc; 14s local 2025-03-14T06:43:56.4331111Z Compiling .../shardy/mhlo_round_trip/shard_map_import.cc; 14s local ... 2025-03-14T06:43:56.6584604Z 2025-03-14T06:43:56.6585437Z  2025-03-14T06:43:56.6585934Z  2025-03-14T06:43:56.6586371Z  2025-03-14T06:43:56.6586764Z  2025-03-14T06:43:56.6587115Z  2025-03-14T06:43:56.6587491Z  2025-03-14T06:43:56.6587860Z  2025-03-14T06:43:56.6588247Z  2025-03-14T06:43:56.6589135Z [19,840 / 20,652] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:56.6590170Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T06:43:56.6591306Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T06:43:56.6592336Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2025-03-14T06:43:56.6593292Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:43:56.6594245Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 17s local 2025-03-14T06:43:56.6595353Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 16s local 2025-03-14T06:43:56.6596468Z Compiling xla/service/allocation_tracker.cc; 15s local 2025-03-14T06:43:56.6597403Z Compiling .../shardy/mhlo_round_trip/shard_map_import.cc; 14s local ... 2025-03-14T06:43:56.9989615Z 2025-03-14T06:43:56.9990463Z  2025-03-14T06:43:56.9990946Z  2025-03-14T06:43:56.9991344Z  2025-03-14T06:43:56.9991731Z  2025-03-14T06:43:56.9992116Z  2025-03-14T06:43:56.9992509Z  2025-03-14T06:43:56.9992904Z  2025-03-14T06:43:56.9993374Z  2025-03-14T06:43:56.9994726Z [19,841 / 20,652] 4 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:56.9995732Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 58s local 2025-03-14T06:43:56.9996621Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 52s local 2025-03-14T06:43:56.9997696Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2025-03-14T06:43:56.9998646Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:43:56.9999742Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2025-03-14T06:43:57.0000825Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 16s local 2025-03-14T06:43:57.0001770Z Compiling xla/service/allocation_tracker.cc; 15s local 2025-03-14T06:43:57.0002600Z Compiling .../shardy/mhlo_round_trip/shard_map_import.cc; 14s local ... 2025-03-14T06:43:57.2324270Z 2025-03-14T06:43:57.2325280Z  2025-03-14T06:43:57.2325752Z  2025-03-14T06:43:57.2326128Z  2025-03-14T06:43:57.2326516Z  2025-03-14T06:43:57.2326890Z  2025-03-14T06:43:57.2327275Z  2025-03-14T06:43:57.2327660Z  2025-03-14T06:43:57.2328055Z  2025-03-14T06:43:57.2328980Z [19,841 / 20,652] 4 / 17 tests; 48 actions running; last test: ...me:util_test 2025-03-14T06:43:57.2330077Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T06:43:57.2331040Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2025-03-14T06:43:57.2332429Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 21s local 2025-03-14T06:43:57.2333380Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:43:57.2334284Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2025-03-14T06:43:57.2335311Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 17s local 2025-03-14T06:43:57.2336304Z Compiling xla/service/allocation_tracker.cc; 15s local 2025-03-14T06:43:57.2337422Z Compiling .../shardy/mhlo_round_trip/shard_map_import.cc; 14s local ... 2025-03-14T06:43:57.6328655Z 2025-03-14T06:43:57.6329535Z  2025-03-14T06:43:57.6330062Z  2025-03-14T06:43:57.6330459Z  2025-03-14T06:43:57.6330864Z  2025-03-14T06:43:57.6331256Z  2025-03-14T06:43:57.6331615Z  2025-03-14T06:43:57.6331963Z  2025-03-14T06:43:57.6332400Z  2025-03-14T06:43:57.6333275Z [19,843 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:43:57.6334332Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 59s local 2025-03-14T06:43:57.6335246Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 53s local 2025-03-14T06:43:57.6336381Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2025-03-14T06:43:57.6337413Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:43:57.6338340Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 18s local 2025-03-14T06:43:57.6339473Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 17s local 2025-03-14T06:43:57.6340432Z Compiling xla/service/allocation_tracker.cc; 16s local 2025-03-14T06:43:57.6341197Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2025-03-14T06:43:58.2619434Z 2025-03-14T06:43:58.2620324Z  2025-03-14T06:43:58.2620813Z  2025-03-14T06:43:58.2621197Z  2025-03-14T06:43:58.2621599Z  2025-03-14T06:43:58.2622031Z  2025-03-14T06:43:58.2622433Z  2025-03-14T06:43:58.2622853Z  2025-03-14T06:43:58.2623267Z  2025-03-14T06:43:58.2624221Z [19,844 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:58.2625295Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T06:43:58.2626275Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T06:43:58.2627338Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 22s local 2025-03-14T06:43:58.2638929Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:43:58.2640116Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2025-03-14T06:43:58.2641217Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local 2025-03-14T06:43:58.2642143Z Compiling xla/service/allocation_tracker.cc; 16s local 2025-03-14T06:43:58.2642932Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:43:58.6334277Z 2025-03-14T06:43:58.6335120Z  2025-03-14T06:43:58.6335604Z  2025-03-14T06:43:58.6336265Z  2025-03-14T06:43:58.6336705Z  2025-03-14T06:43:58.6337106Z  2025-03-14T06:43:58.6337531Z  2025-03-14T06:43:58.6338070Z  2025-03-14T06:43:58.6338598Z  2025-03-14T06:43:58.6339696Z [19,846 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:58.6340664Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 60s local 2025-03-14T06:43:58.6341580Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 54s local 2025-03-14T06:43:58.6342706Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2025-03-14T06:43:58.6343585Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:43:58.6344455Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 19s local 2025-03-14T06:43:58.6345502Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local 2025-03-14T06:43:58.6346707Z Compiling xla/service/allocation_tracker.cc; 17s local 2025-03-14T06:43:58.6347500Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:43:59.0338706Z 2025-03-14T06:43:59.0339589Z  2025-03-14T06:43:59.0340016Z  2025-03-14T06:43:59.0340393Z  2025-03-14T06:43:59.0340800Z  2025-03-14T06:43:59.0341261Z  2025-03-14T06:43:59.0341639Z  2025-03-14T06:43:59.0342014Z  2025-03-14T06:43:59.0342761Z  2025-03-14T06:43:59.0343772Z [19,847 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:43:59.0344837Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2025-03-14T06:43:59.0345725Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T06:43:59.0346733Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 23s local 2025-03-14T06:43:59.0347657Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:43:59.0348560Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2025-03-14T06:43:59.0349708Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 18s local 2025-03-14T06:43:59.0350754Z Compiling xla/service/allocation_tracker.cc; 17s local 2025-03-14T06:43:59.0351685Z Compiling .../shardy/mhlo_round_trip/shard_map_export.cc; 14s local ... 2025-03-14T06:43:59.5695599Z 2025-03-14T06:43:59.5696388Z  2025-03-14T06:43:59.5696910Z  2025-03-14T06:43:59.5697286Z  2025-03-14T06:43:59.5697681Z  2025-03-14T06:43:59.5698083Z  2025-03-14T06:43:59.5698461Z  2025-03-14T06:43:59.5698847Z  2025-03-14T06:43:59.5699186Z  2025-03-14T06:43:59.5700114Z [19,848 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:43:59.5701226Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2025-03-14T06:43:59.5702112Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T06:43:59.5703102Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2025-03-14T06:43:59.5703943Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:43:59.5704800Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2025-03-14T06:43:59.5705863Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local 2025-03-14T06:43:59.5706971Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 15s local 2025-03-14T06:43:59.5708359Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 13s local ... 2025-03-14T06:43:59.8346226Z 2025-03-14T06:43:59.8347041Z  2025-03-14T06:43:59.8347559Z  2025-03-14T06:43:59.8347952Z  2025-03-14T06:43:59.8348364Z  2025-03-14T06:43:59.8348775Z  2025-03-14T06:43:59.8349198Z  2025-03-14T06:43:59.8349570Z  2025-03-14T06:43:59.8349969Z  2025-03-14T06:43:59.8350935Z [19,848 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:43:59.8352374Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 61s local 2025-03-14T06:43:59.8353337Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 55s local 2025-03-14T06:43:59.8354370Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2025-03-14T06:43:59.8355342Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:43:59.8356270Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 20s local 2025-03-14T06:43:59.8357402Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local 2025-03-14T06:43:59.8358622Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 15s local 2025-03-14T06:43:59.8359680Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 13s local ... 2025-03-14T06:44:00.0492874Z 2025-03-14T06:44:00.0493687Z  2025-03-14T06:44:00.0494168Z  2025-03-14T06:44:00.0494550Z  2025-03-14T06:44:00.0495185Z  2025-03-14T06:44:00.0495566Z  2025-03-14T06:44:00.0495928Z  2025-03-14T06:44:00.0496319Z  2025-03-14T06:44:00.0496710Z  2025-03-14T06:44:00.0497612Z [19,850 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:00.0498629Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2025-03-14T06:44:00.0499584Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T06:44:00.0500891Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 24s local 2025-03-14T06:44:00.0501909Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:44:00.0502934Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T06:44:00.0504075Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 19s local 2025-03-14T06:44:00.0505240Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 15s local 2025-03-14T06:44:00.0506272Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 13s local ... 2025-03-14T06:44:00.4350580Z 2025-03-14T06:44:00.4351378Z  2025-03-14T06:44:00.4351825Z  2025-03-14T06:44:00.4352209Z  2025-03-14T06:44:00.4352553Z  2025-03-14T06:44:00.4352923Z  2025-03-14T06:44:00.4353294Z  2025-03-14T06:44:00.4353652Z  2025-03-14T06:44:00.4354010Z  2025-03-14T06:44:00.4354860Z [19,852 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:00.4355847Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 62s local 2025-03-14T06:44:00.4356682Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 56s local 2025-03-14T06:44:00.4357633Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T06:44:00.4358507Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:44:00.4359311Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 21s local 2025-03-14T06:44:00.4360363Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local 2025-03-14T06:44:00.4361485Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 16s local 2025-03-14T06:44:00.4362435Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 14s local ... 2025-03-14T06:44:01.0164021Z 2025-03-14T06:44:01.0164989Z  2025-03-14T06:44:01.0165598Z  2025-03-14T06:44:01.0165944Z  2025-03-14T06:44:01.0166320Z  2025-03-14T06:44:01.0166662Z  2025-03-14T06:44:01.0166995Z  2025-03-14T06:44:01.0167612Z  2025-03-14T06:44:01.0167976Z  2025-03-14T06:44:01.0168917Z [19,853 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:01.0169861Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2025-03-14T06:44:01.0170692Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2025-03-14T06:44:01.0171596Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T06:44:01.0172554Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:44:01.0173316Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T06:44:01.0174260Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 20s local 2025-03-14T06:44:01.0175198Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 16s local 2025-03-14T06:44:01.0176142Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 14s local ... 2025-03-14T06:44:01.2357249Z 2025-03-14T06:44:01.2358071Z  2025-03-14T06:44:01.2358526Z  2025-03-14T06:44:01.2358910Z  2025-03-14T06:44:01.2359290Z  2025-03-14T06:44:01.2359665Z  2025-03-14T06:44:01.2360031Z  2025-03-14T06:44:01.2360412Z  2025-03-14T06:44:01.2360778Z  2025-03-14T06:44:01.2361666Z [19,853 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:01.2363006Z Compiling xla/backends/cpu/runtime/dot_thunk_f16.cc; 63s local 2025-03-14T06:44:01.2363929Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2025-03-14T06:44:01.2365071Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 25s local 2025-03-14T06:44:01.2366201Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:44:01.2367117Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T06:44:01.2368395Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2025-03-14T06:44:01.2369548Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 16s local 2025-03-14T06:44:01.2370653Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 14s local ... 2025-03-14T06:44:01.4969051Z 2025-03-14T06:44:01.4969902Z  2025-03-14T06:44:01.4970376Z  2025-03-14T06:44:01.4970766Z  2025-03-14T06:44:01.4971160Z  2025-03-14T06:44:01.4971537Z  2025-03-14T06:44:01.4971953Z  2025-03-14T06:44:01.4972327Z  2025-03-14T06:44:01.4972715Z  2025-03-14T06:44:01.4973612Z [19,855 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:01.4974645Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2025-03-14T06:44:01.4975664Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T06:44:01.4976564Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:44:01.4977415Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T06:44:01.4978485Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2025-03-14T06:44:01.4979527Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 15s local 2025-03-14T06:44:01.4980774Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 14s local 2025-03-14T06:44:01.4981830Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:44:01.8362290Z 2025-03-14T06:44:01.8363119Z  2025-03-14T06:44:01.8363599Z  2025-03-14T06:44:01.8364038Z  2025-03-14T06:44:01.8364409Z  2025-03-14T06:44:01.8364986Z  2025-03-14T06:44:01.8365613Z  2025-03-14T06:44:01.8366022Z  2025-03-14T06:44:01.8366393Z  2025-03-14T06:44:01.8367301Z [19,855 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:01.8368403Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 57s local 2025-03-14T06:44:01.8369760Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T06:44:01.8370748Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:44:01.8371608Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 22s local 2025-03-14T06:44:01.8372638Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 21s local 2025-03-14T06:44:01.8373717Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 15s local 2025-03-14T06:44:01.8375126Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 15s local 2025-03-14T06:44:01.8376067Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:44:02.3272999Z 2025-03-14T06:44:02.3273859Z  2025-03-14T06:44:02.3274351Z  2025-03-14T06:44:02.3274736Z  2025-03-14T06:44:02.3275118Z  2025-03-14T06:44:02.3275515Z  2025-03-14T06:44:02.3275938Z  2025-03-14T06:44:02.3276407Z  2025-03-14T06:44:02.3276823Z  2025-03-14T06:44:02.3277730Z [19,856 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:02.3278631Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T06:44:02.3279431Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 26s local 2025-03-14T06:44:02.3280156Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:44:02.3280840Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2025-03-14T06:44:02.3282109Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2025-03-14T06:44:02.3283334Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 15s local 2025-03-14T06:44:02.3284422Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 15s local 2025-03-14T06:44:02.3285500Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:44:02.6369160Z 2025-03-14T06:44:02.6370319Z  2025-03-14T06:44:02.6370805Z  2025-03-14T06:44:02.6371223Z  2025-03-14T06:44:02.6371633Z  2025-03-14T06:44:02.6372033Z  2025-03-14T06:44:02.6372444Z  2025-03-14T06:44:02.6372818Z  2025-03-14T06:44:02.6373194Z  2025-03-14T06:44:02.6374150Z [19,857 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:02.6375162Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T06:44:02.6376207Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T06:44:02.6377129Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:44:02.6378025Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2025-03-14T06:44:02.6379063Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2025-03-14T06:44:02.6380171Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 16s local 2025-03-14T06:44:02.6381299Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 15s local 2025-03-14T06:44:02.6382211Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:44:02.8372239Z 2025-03-14T06:44:02.8373062Z  2025-03-14T06:44:02.8373543Z  2025-03-14T06:44:02.8373927Z  2025-03-14T06:44:02.8374291Z  2025-03-14T06:44:02.8374673Z  2025-03-14T06:44:02.8375041Z  2025-03-14T06:44:02.8375407Z  2025-03-14T06:44:02.8375777Z  2025-03-14T06:44:02.8376733Z [19,858 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:02.8377836Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 58s local 2025-03-14T06:44:02.8378868Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T06:44:02.8379785Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:44:02.8380640Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 23s local 2025-03-14T06:44:02.8382006Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 22s local 2025-03-14T06:44:02.8383139Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 16s local 2025-03-14T06:44:02.8384276Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 16s local 2025-03-14T06:44:02.8385300Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:44:03.1240534Z 2025-03-14T06:44:03.1241409Z  2025-03-14T06:44:03.1242027Z  2025-03-14T06:44:03.1242463Z  2025-03-14T06:44:03.1242877Z  2025-03-14T06:44:03.1243288Z  2025-03-14T06:44:03.1243975Z  2025-03-14T06:44:03.1244404Z  2025-03-14T06:44:03.1244967Z  2025-03-14T06:44:03.1245929Z [19,860 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:03.1247068Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 59s local 2025-03-14T06:44:03.1248105Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T06:44:03.1249133Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:44:03.1250093Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T06:44:03.1251203Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T06:44:03.1252411Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 16s local 2025-03-14T06:44:03.1253622Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 16s local 2025-03-14T06:44:03.1254897Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:44:03.3600410Z 2025-03-14T06:44:03.3601268Z  2025-03-14T06:44:03.3601744Z  2025-03-14T06:44:03.3602124Z  2025-03-14T06:44:03.3602523Z  2025-03-14T06:44:03.3602937Z  2025-03-14T06:44:03.3603323Z  2025-03-14T06:44:03.3603698Z  2025-03-14T06:44:03.3604085Z  2025-03-14T06:44:03.3605149Z [19,862 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:03.3606541Z Compiling xla/backends/cpu/runtime/dot_thunk_c64.cc; 59s local 2025-03-14T06:44:03.3607560Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 27s local 2025-03-14T06:44:03.3608545Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:44:03.3609399Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T06:44:03.3610524Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T06:44:03.3611669Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 16s local 2025-03-14T06:44:03.3612860Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 16s local 2025-03-14T06:44:03.3613829Z @llvm-project//mlir:LinalgTransforms; 16s local ... 2025-03-14T06:44:03.5616060Z 2025-03-14T06:44:03.5616912Z  2025-03-14T06:44:03.5617365Z  2025-03-14T06:44:03.5617725Z  2025-03-14T06:44:03.5618104Z  2025-03-14T06:44:03.5618482Z  2025-03-14T06:44:03.5618856Z  2025-03-14T06:44:03.5619259Z  2025-03-14T06:44:03.5619624Z  2025-03-14T06:44:03.5620507Z [19,864 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:03.5621596Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T06:44:03.5622500Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:44:03.5623325Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T06:44:03.5624381Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T06:44:03.5625471Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 17s local 2025-03-14T06:44:03.5626385Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 16s local 2025-03-14T06:44:03.5627200Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:03.5627977Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local ... 2025-03-14T06:44:03.8303754Z 2025-03-14T06:44:03.8304848Z  2025-03-14T06:44:03.8305267Z  2025-03-14T06:44:03.8305596Z  2025-03-14T06:44:03.8305906Z  2025-03-14T06:44:03.8306215Z  2025-03-14T06:44:03.8306524Z  2025-03-14T06:44:03.8306851Z  2025-03-14T06:44:03.8307166Z  2025-03-14T06:44:03.8308057Z [19,865 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:03.8309278Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T06:44:03.8310374Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T06:44:03.8311230Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 24s local 2025-03-14T06:44:03.8312272Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T06:44:03.8313298Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 17s local 2025-03-14T06:44:03.8314422Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 17s local 2025-03-14T06:44:03.8315344Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:03.8316166Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local ... 2025-03-14T06:44:04.0380141Z 2025-03-14T06:44:04.0380980Z  2025-03-14T06:44:04.0381473Z  2025-03-14T06:44:04.0381868Z  2025-03-14T06:44:04.0382271Z  2025-03-14T06:44:04.0382637Z  2025-03-14T06:44:04.0383020Z  2025-03-14T06:44:04.0383716Z  2025-03-14T06:44:04.0384105Z  2025-03-14T06:44:04.0384967Z [19,869 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:04.0386054Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T06:44:04.0386968Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T06:44:04.0387850Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T06:44:04.0391252Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 23s local 2025-03-14T06:44:04.0392360Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 17s local 2025-03-14T06:44:04.0393455Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 17s local 2025-03-14T06:44:04.0394489Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2025-03-14T06:44:04.0395416Z Compiling xla/service/spmd/gather_scatter_handler.cc; 15s local ... 2025-03-14T06:44:04.2383377Z 2025-03-14T06:44:04.2384246Z  2025-03-14T06:44:04.2384748Z  2025-03-14T06:44:04.2385174Z  2025-03-14T06:44:04.2385573Z  2025-03-14T06:44:04.2385927Z  2025-03-14T06:44:04.2386320Z  2025-03-14T06:44:04.2386714Z  2025-03-14T06:44:04.2387132Z  2025-03-14T06:44:04.2387993Z [19,870 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:04.2389292Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 28s local 2025-03-14T06:44:04.2390173Z @llvm-project//mlir:LinalgTransforms; 27s local 2025-03-14T06:44:04.2391003Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T06:44:04.2392042Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T06:44:04.2393148Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 17s local 2025-03-14T06:44:04.2394173Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 16s local 2025-03-14T06:44:04.2395071Z Compiling xla/service/spmd/gather_scatter_handler.cc; 15s local 2025-03-14T06:44:04.2396105Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 15s local ... 2025-03-14T06:44:04.6387514Z 2025-03-14T06:44:04.6388469Z  2025-03-14T06:44:04.6388952Z  2025-03-14T06:44:04.6389363Z  2025-03-14T06:44:04.6389759Z  2025-03-14T06:44:04.6390147Z  2025-03-14T06:44:04.6390532Z  2025-03-14T06:44:04.6390941Z  2025-03-14T06:44:04.6391299Z  2025-03-14T06:44:04.6392473Z [19,871 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:04.6393625Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2025-03-14T06:44:04.6394512Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T06:44:04.6395357Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T06:44:04.6396339Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T06:44:04.6397655Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 17s local 2025-03-14T06:44:04.6398685Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2025-03-14T06:44:04.6399610Z Compiling xla/service/spmd/gather_scatter_handler.cc; 16s local 2025-03-14T06:44:04.6400552Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local ... 2025-03-14T06:44:04.8889499Z 2025-03-14T06:44:04.8890328Z  2025-03-14T06:44:04.8890807Z  2025-03-14T06:44:04.8891219Z  2025-03-14T06:44:04.8891615Z  2025-03-14T06:44:04.8892008Z  2025-03-14T06:44:04.8892403Z  2025-03-14T06:44:04.8892806Z  2025-03-14T06:44:04.8893189Z  2025-03-14T06:44:04.8894129Z [19,872 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:04.8895292Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2025-03-14T06:44:04.8896608Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T06:44:04.8897503Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 25s local 2025-03-14T06:44:04.8898599Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 24s local 2025-03-14T06:44:04.8899751Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2025-03-14T06:44:04.8900817Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2025-03-14T06:44:04.8901915Z Compiling xla/service/spmd/gather_scatter_handler.cc; 16s local 2025-03-14T06:44:04.8902951Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local ... 2025-03-14T06:44:05.2392911Z 2025-03-14T06:44:05.2393753Z  2025-03-14T06:44:05.2394228Z  2025-03-14T06:44:05.2394620Z  2025-03-14T06:44:05.2395030Z  2025-03-14T06:44:05.2395415Z  2025-03-14T06:44:05.2395818Z  2025-03-14T06:44:05.2396206Z  2025-03-14T06:44:05.2396609Z  2025-03-14T06:44:05.2397620Z [19,872 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:05.2398740Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 29s local 2025-03-14T06:44:05.2399682Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T06:44:05.2400556Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T06:44:05.2401563Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2025-03-14T06:44:05.2402898Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2025-03-14T06:44:05.2404013Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 17s local 2025-03-14T06:44:05.2405127Z Compiling xla/service/spmd/gather_scatter_handler.cc; 16s local 2025-03-14T06:44:05.2406117Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 16s local ... 2025-03-14T06:44:05.5066943Z 2025-03-14T06:44:05.5067799Z  2025-03-14T06:44:05.5068275Z  2025-03-14T06:44:05.5068707Z  2025-03-14T06:44:05.5069099Z  2025-03-14T06:44:05.5069502Z  2025-03-14T06:44:05.5069899Z  2025-03-14T06:44:05.5070308Z  2025-03-14T06:44:05.5070710Z  2025-03-14T06:44:05.5071704Z [19,874 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:05.5072947Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T06:44:05.5073901Z @llvm-project//mlir:LinalgTransforms; 28s local 2025-03-14T06:44:05.5075032Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T06:44:05.5076146Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2025-03-14T06:44:05.5077269Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 18s local 2025-03-14T06:44:05.5078287Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2025-03-14T06:44:05.5079181Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local 2025-03-14T06:44:05.5080173Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 17s local ... 2025-03-14T06:44:05.8398457Z 2025-03-14T06:44:05.8399345Z  2025-03-14T06:44:05.8399862Z  2025-03-14T06:44:05.8400234Z  2025-03-14T06:44:05.8400608Z  2025-03-14T06:44:05.8400959Z  2025-03-14T06:44:05.8401332Z  2025-03-14T06:44:05.8401710Z  2025-03-14T06:44:05.8402097Z  2025-03-14T06:44:05.8403074Z [19,874 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:05.8404384Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T06:44:05.8405507Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T06:44:05.8406319Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 26s local 2025-03-14T06:44:05.8407324Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 25s local 2025-03-14T06:44:05.8408477Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 19s local 2025-03-14T06:44:05.8409866Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2025-03-14T06:44:05.8410815Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local 2025-03-14T06:44:05.8411878Z Compiling mlir/lib/Dialect/Linalg/Transforms/Tiling.cpp; 17s local ... 2025-03-14T06:44:06.2589527Z 2025-03-14T06:44:06.2590367Z  2025-03-14T06:44:06.2590918Z  2025-03-14T06:44:06.2591410Z  2025-03-14T06:44:06.2592174Z  2025-03-14T06:44:06.2592666Z  2025-03-14T06:44:06.2593129Z  2025-03-14T06:44:06.2593605Z  2025-03-14T06:44:06.2594017Z  2025-03-14T06:44:06.2595339Z [19,875 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:06.2596393Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 30s local 2025-03-14T06:44:06.2597145Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T06:44:06.2597873Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2025-03-14T06:44:06.2598752Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 26s local 2025-03-14T06:44:06.2599653Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 19s local 2025-03-14T06:44:06.2600473Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 18s local 2025-03-14T06:44:06.2601201Z Compiling xla/service/spmd/gather_scatter_handler.cc; 17s local 2025-03-14T06:44:06.2601962Z Compiling xla/pjrt/pjrt_executable.cc; 16s local ... 2025-03-14T06:44:06.5631804Z 2025-03-14T06:44:06.5632645Z  2025-03-14T06:44:06.5633168Z  2025-03-14T06:44:06.5633608Z  2025-03-14T06:44:06.5634027Z  2025-03-14T06:44:06.5634425Z  2025-03-14T06:44:06.5634848Z  2025-03-14T06:44:06.5635277Z  2025-03-14T06:44:06.5635710Z  2025-03-14T06:44:06.5636691Z [19,876 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:06.5637869Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2025-03-14T06:44:06.5638859Z @llvm-project//mlir:LinalgTransforms; 29s local 2025-03-14T06:44:06.5639773Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2025-03-14T06:44:06.5640841Z Compiling mlir/lib/Dialect/Linalg/Transforms/Transforms.cpp; 26s local 2025-03-14T06:44:06.5641966Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 19s local 2025-03-14T06:44:06.5643279Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2025-03-14T06:44:06.5644195Z Compiling xla/service/spmd/gather_scatter_handler.cc; 18s local 2025-03-14T06:44:06.5645260Z Compiling xla/pjrt/pjrt_executable.cc; 16s local ... 2025-03-14T06:44:06.8405274Z 2025-03-14T06:44:06.8406134Z  2025-03-14T06:44:06.8406611Z  2025-03-14T06:44:06.8407005Z  2025-03-14T06:44:06.8407399Z  2025-03-14T06:44:06.8407917Z  2025-03-14T06:44:06.8408300Z  2025-03-14T06:44:06.8408726Z  2025-03-14T06:44:06.8409126Z  2025-03-14T06:44:06.8410314Z [19,878 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:06.8411530Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 31s local 2025-03-14T06:44:06.8412475Z @llvm-project//mlir:LinalgTransforms; 30s local 2025-03-14T06:44:06.8413387Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 27s local 2025-03-14T06:44:06.8414575Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2025-03-14T06:44:06.8415622Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2025-03-14T06:44:06.8416579Z Compiling xla/service/spmd/gather_scatter_handler.cc; 18s local 2025-03-14T06:44:06.8417431Z Compiling xla/pjrt/pjrt_executable.cc; 16s local 2025-03-14T06:44:06.8418186Z Compiling xla/pjrt/pjrt_compiler.cc; 16s local ... 2025-03-14T06:44:07.3946722Z 2025-03-14T06:44:07.3947529Z  2025-03-14T06:44:07.3948349Z  2025-03-14T06:44:07.3948758Z  2025-03-14T06:44:07.3949154Z  2025-03-14T06:44:07.3949559Z  2025-03-14T06:44:07.3949949Z  2025-03-14T06:44:07.3950331Z  2025-03-14T06:44:07.3950697Z  2025-03-14T06:44:07.3951626Z [19,879 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:07.3952745Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2025-03-14T06:44:07.3953924Z @llvm-project//mlir:LinalgTransforms; 30s local 2025-03-14T06:44:07.3954801Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T06:44:07.3955911Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2025-03-14T06:44:07.3956948Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 19s local 2025-03-14T06:44:07.3957891Z Compiling xla/service/spmd/gather_scatter_handler.cc; 19s local 2025-03-14T06:44:07.3958745Z Compiling xla/pjrt/pjrt_executable.cc; 17s local 2025-03-14T06:44:07.3959520Z Compiling xla/pjrt/pjrt_compiler.cc; 17s local ... 2025-03-14T06:44:07.6412854Z 2025-03-14T06:44:07.6413709Z  2025-03-14T06:44:07.6414194Z  2025-03-14T06:44:07.6414594Z  2025-03-14T06:44:07.6414985Z  2025-03-14T06:44:07.6415359Z  2025-03-14T06:44:07.6415770Z  2025-03-14T06:44:07.6416153Z  2025-03-14T06:44:07.6416565Z  2025-03-14T06:44:07.6417539Z [19,880 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:07.6418758Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2025-03-14T06:44:07.6419762Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T06:44:07.6420666Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 28s local 2025-03-14T06:44:07.6421787Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 20s local 2025-03-14T06:44:07.6422844Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2025-03-14T06:44:07.6423823Z Compiling xla/service/spmd/gather_scatter_handler.cc; 19s local 2025-03-14T06:44:07.6424708Z Compiling xla/pjrt/pjrt_executable.cc; 17s local 2025-03-14T06:44:07.6425459Z Compiling xla/pjrt/pjrt_compiler.cc; 17s local ... 2025-03-14T06:44:08.3108857Z 2025-03-14T06:44:08.3109710Z  2025-03-14T06:44:08.3110210Z  2025-03-14T06:44:08.3110629Z  2025-03-14T06:44:08.3111040Z  2025-03-14T06:44:08.3111489Z  2025-03-14T06:44:08.3111877Z  2025-03-14T06:44:08.3112517Z  2025-03-14T06:44:08.3112944Z  2025-03-14T06:44:08.3113911Z [19,881 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:08.3115156Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 32s local 2025-03-14T06:44:08.3116053Z @llvm-project//mlir:LinalgTransforms; 31s local 2025-03-14T06:44:08.3116880Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T06:44:08.3118154Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2025-03-14T06:44:08.3119227Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 20s local 2025-03-14T06:44:08.3120167Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2025-03-14T06:44:08.3121043Z Compiling xla/pjrt/pjrt_executable.cc; 18s local 2025-03-14T06:44:08.3121822Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local ... 2025-03-14T06:44:08.6419213Z 2025-03-14T06:44:08.6420098Z  2025-03-14T06:44:08.6420644Z  2025-03-14T06:44:08.6421062Z  2025-03-14T06:44:08.6421464Z  2025-03-14T06:44:08.6421895Z  2025-03-14T06:44:08.6422333Z  2025-03-14T06:44:08.6422769Z  2025-03-14T06:44:08.6423313Z  2025-03-14T06:44:08.6424303Z [19,884 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:08.6425590Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2025-03-14T06:44:08.6426903Z @llvm-project//mlir:LinalgTransforms; 32s local 2025-03-14T06:44:08.6427857Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 29s local 2025-03-14T06:44:08.6429043Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 21s local 2025-03-14T06:44:08.6430104Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2025-03-14T06:44:08.6431092Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2025-03-14T06:44:08.6432072Z Compiling xla/pjrt/pjrt_executable.cc; 18s local 2025-03-14T06:44:08.6432794Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local ... 2025-03-14T06:44:08.9678092Z 2025-03-14T06:44:08.9678975Z  2025-03-14T06:44:08.9679453Z  2025-03-14T06:44:08.9679887Z  2025-03-14T06:44:08.9680257Z  2025-03-14T06:44:08.9680647Z  2025-03-14T06:44:08.9681041Z  2025-03-14T06:44:08.9681434Z  2025-03-14T06:44:08.9681827Z  2025-03-14T06:44:08.9682834Z [19,885 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:08.9684040Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2025-03-14T06:44:08.9685078Z @llvm-project//mlir:LinalgTransforms; 32s local 2025-03-14T06:44:08.9685950Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T06:44:08.9687103Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2025-03-14T06:44:08.9688217Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2025-03-14T06:44:08.9689224Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2025-03-14T06:44:08.9690127Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2025-03-14T06:44:08.9691032Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local ... 2025-03-14T06:44:09.2424928Z 2025-03-14T06:44:09.2425791Z  2025-03-14T06:44:09.2426254Z  2025-03-14T06:44:09.2426658Z  2025-03-14T06:44:09.2427096Z  2025-03-14T06:44:09.2427483Z  2025-03-14T06:44:09.2427906Z  2025-03-14T06:44:09.2428329Z  2025-03-14T06:44:09.2428752Z  2025-03-14T06:44:09.2429706Z [19,885 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:09.2430903Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 33s local 2025-03-14T06:44:09.2431840Z @llvm-project//mlir:LinalgTransforms; 32s local 2025-03-14T06:44:09.2433077Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T06:44:09.2434283Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2025-03-14T06:44:09.2435404Z Compiling llvm/lib/CodeGen/MachinePipeliner.cpp; 21s local 2025-03-14T06:44:09.2436387Z Compiling xla/service/spmd/gather_scatter_handler.cc; 20s local 2025-03-14T06:44:09.2437186Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2025-03-14T06:44:09.2437954Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local ... 2025-03-14T06:44:09.4782139Z 2025-03-14T06:44:09.4783004Z  2025-03-14T06:44:09.4783767Z  2025-03-14T06:44:09.4784215Z  2025-03-14T06:44:09.4784652Z  2025-03-14T06:44:09.4785068Z  2025-03-14T06:44:09.4785462Z  2025-03-14T06:44:09.4785879Z  2025-03-14T06:44:09.4786300Z  2025-03-14T06:44:09.4787295Z [19,887 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:09.4788596Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T06:44:09.4789628Z @llvm-project//mlir:LinalgTransforms; 32s local 2025-03-14T06:44:09.4790622Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T06:44:09.4791872Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 22s local 2025-03-14T06:44:09.4793033Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2025-03-14T06:44:09.4794205Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2025-03-14T06:44:09.4795003Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local 2025-03-14T06:44:09.4796003Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local ... 2025-03-14T06:44:09.7827350Z 2025-03-14T06:44:09.7828199Z  2025-03-14T06:44:09.7828654Z  2025-03-14T06:44:09.7829064Z  2025-03-14T06:44:09.7829459Z  2025-03-14T06:44:09.7829939Z  2025-03-14T06:44:09.7830331Z  2025-03-14T06:44:09.7831035Z  2025-03-14T06:44:09.7831437Z  2025-03-14T06:44:09.7832379Z [19,888 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:09.7833628Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T06:44:09.7834598Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T06:44:09.7835477Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 30s local 2025-03-14T06:44:09.7836493Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 23s local 2025-03-14T06:44:09.7837611Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2025-03-14T06:44:09.7838421Z Compiling xla/pjrt/pjrt_executable.cc; 19s local 2025-03-14T06:44:09.7839158Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local 2025-03-14T06:44:09.7839954Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local ... 2025-03-14T06:44:10.0431503Z 2025-03-14T06:44:10.0432364Z  2025-03-14T06:44:10.0432915Z  2025-03-14T06:44:10.0433352Z  2025-03-14T06:44:10.0433789Z  2025-03-14T06:44:10.0434216Z  2025-03-14T06:44:10.0434644Z  2025-03-14T06:44:10.0435079Z  2025-03-14T06:44:10.0435504Z  2025-03-14T06:44:10.0436507Z [19,890 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:10.0437797Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T06:44:10.0438835Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T06:44:10.0439824Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T06:44:10.0441050Z Compiling mlir/lib/Dialect/Linalg/Transforms/Vectorization.cpp; 23s local 2025-03-14T06:44:10.0442221Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2025-03-14T06:44:10.0443174Z Compiling xla/pjrt/pjrt_executable.cc; 20s local 2025-03-14T06:44:10.0443993Z Compiling xla/pjrt/pjrt_compiler.cc; 20s local 2025-03-14T06:44:10.0445339Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local ... 2025-03-14T06:44:10.2684900Z 2025-03-14T06:44:10.2685759Z  2025-03-14T06:44:10.2686251Z  2025-03-14T06:44:10.2686636Z  2025-03-14T06:44:10.2686994Z  2025-03-14T06:44:10.2687357Z  2025-03-14T06:44:10.2687771Z  2025-03-14T06:44:10.2688136Z  2025-03-14T06:44:10.2688673Z  2025-03-14T06:44:10.2689632Z [19,891 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:10.2691261Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 34s local 2025-03-14T06:44:10.2692260Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T06:44:10.2693236Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T06:44:10.2694344Z Compiling xla/service/spmd/gather_scatter_handler.cc; 21s local 2025-03-14T06:44:10.2695262Z Compiling xla/pjrt/pjrt_executable.cc; 20s local 2025-03-14T06:44:10.2696087Z Compiling xla/pjrt/pjrt_compiler.cc; 20s local 2025-03-14T06:44:10.2697091Z Compiling xla/service/spmd/spmd_partitioner.cc; 18s local 2025-03-14T06:44:10.2697980Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2025-03-14T06:44:10.5452701Z 2025-03-14T06:44:10.5453589Z  2025-03-14T06:44:10.5454030Z  2025-03-14T06:44:10.5454375Z  2025-03-14T06:44:10.5454706Z  2025-03-14T06:44:10.5455039Z  2025-03-14T06:44:10.5455369Z  2025-03-14T06:44:10.5455994Z  2025-03-14T06:44:10.5456324Z  2025-03-14T06:44:10.5457123Z [19,896 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:10.5458504Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T06:44:10.5459310Z @llvm-project//mlir:LinalgTransforms; 33s local 2025-03-14T06:44:10.5460030Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T06:44:10.5461198Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2025-03-14T06:44:10.5461934Z Compiling xla/pjrt/pjrt_executable.cc; 20s local 2025-03-14T06:44:10.5462640Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2025-03-14T06:44:10.5463392Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:44:10.5464079Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 16s local ... 2025-03-14T06:44:10.8437408Z 2025-03-14T06:44:10.8438277Z  2025-03-14T06:44:10.8438819Z  2025-03-14T06:44:10.8439265Z  2025-03-14T06:44:10.8439719Z  2025-03-14T06:44:10.8440159Z  2025-03-14T06:44:10.8440583Z  2025-03-14T06:44:10.8441015Z  2025-03-14T06:44:10.8441405Z  2025-03-14T06:44:10.8442418Z [19,899 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:10.8443644Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T06:44:10.8444758Z @llvm-project//mlir:LinalgTransforms; 34s local 2025-03-14T06:44:10.8445658Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 31s local 2025-03-14T06:44:10.8446621Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2025-03-14T06:44:10.8447515Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2025-03-14T06:44:10.8448237Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:44:10.8449053Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 16s local 2025-03-14T06:44:10.8449969Z @stablehlo//:stablehlo_passes; 15s local ... 2025-03-14T06:44:11.2245824Z 2025-03-14T06:44:11.2246648Z  2025-03-14T06:44:11.2247072Z  2025-03-14T06:44:11.2247425Z  2025-03-14T06:44:11.2247773Z  2025-03-14T06:44:11.2248129Z  2025-03-14T06:44:11.2248483Z  2025-03-14T06:44:11.2248838Z  2025-03-14T06:44:11.2249199Z  2025-03-14T06:44:11.2250024Z [19,900 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:11.2251508Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 35s local 2025-03-14T06:44:11.2252327Z @llvm-project//mlir:LinalgTransforms; 34s local 2025-03-14T06:44:11.2253089Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T06:44:11.2253954Z Compiling xla/service/spmd/gather_scatter_handler.cc; 22s local 2025-03-14T06:44:11.2254737Z Compiling xla/service/spmd/spmd_partitioner.cc; 19s local 2025-03-14T06:44:11.2255537Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 17s local 2025-03-14T06:44:11.2256593Z Compiling stablehlo/transforms/StablehloLegalizeQuantToMath.cpp; 16s local 2025-03-14T06:44:11.2257586Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 14s local ... 2025-03-14T06:44:11.4443108Z 2025-03-14T06:44:11.4443988Z  2025-03-14T06:44:11.4444521Z  2025-03-14T06:44:11.4445122Z  2025-03-14T06:44:11.4445545Z  2025-03-14T06:44:11.4445989Z  2025-03-14T06:44:11.4446404Z  2025-03-14T06:44:11.4446843Z  2025-03-14T06:44:11.4447252Z  2025-03-14T06:44:11.4448251Z [19,900 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:11.4449398Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T06:44:11.4450309Z @llvm-project//mlir:LinalgTransforms; 34s local 2025-03-14T06:44:11.4451203Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T06:44:11.4452629Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2025-03-14T06:44:11.4453555Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2025-03-14T06:44:11.4454527Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 17s local 2025-03-14T06:44:11.4455683Z Compiling stablehlo/transforms/StablehloLegalizeQuantToMath.cpp; 16s local 2025-03-14T06:44:11.4456972Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 14s local ... 2025-03-14T06:44:11.8447587Z 2025-03-14T06:44:11.8448509Z  2025-03-14T06:44:11.8449054Z  2025-03-14T06:44:11.8449479Z  2025-03-14T06:44:11.8449859Z  2025-03-14T06:44:11.8450249Z  2025-03-14T06:44:11.8450655Z  2025-03-14T06:44:11.8451056Z  2025-03-14T06:44:11.8451471Z  2025-03-14T06:44:11.8452470Z [19,902 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:11.8453652Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T06:44:11.8454606Z @llvm-project//mlir:LinalgTransforms; 35s local 2025-03-14T06:44:11.8455456Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 32s local 2025-03-14T06:44:11.8456519Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2025-03-14T06:44:11.8457467Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2025-03-14T06:44:11.8458419Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 17s local 2025-03-14T06:44:11.8459470Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 14s local 2025-03-14T06:44:11.8460456Z Compiling .../shardy/mhlo_round_trip/shard_map_import.cc; 14s local ... 2025-03-14T06:44:12.1988561Z 2025-03-14T06:44:12.1989430Z  2025-03-14T06:44:12.1989933Z  2025-03-14T06:44:12.1990347Z  2025-03-14T06:44:12.1990784Z  2025-03-14T06:44:12.1991199Z  2025-03-14T06:44:12.1991610Z  2025-03-14T06:44:12.1992041Z  2025-03-14T06:44:12.1992447Z  2025-03-14T06:44:12.1993441Z [19,903 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:12.1994665Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 36s local 2025-03-14T06:44:12.1995680Z @llvm-project//mlir:LinalgTransforms; 35s local 2025-03-14T06:44:12.1996595Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2025-03-14T06:44:12.1997831Z Compiling xla/service/spmd/gather_scatter_handler.cc; 23s local 2025-03-14T06:44:12.2012004Z Compiling xla/service/spmd/spmd_partitioner.cc; 20s local 2025-03-14T06:44:12.2013291Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 18s local 2025-03-14T06:44:12.2014248Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 15s local 2025-03-14T06:44:12.2015160Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2025-03-14T06:44:12.4452753Z 2025-03-14T06:44:12.4453602Z  2025-03-14T06:44:12.4454129Z  2025-03-14T06:44:12.4454552Z  2025-03-14T06:44:12.4455013Z  2025-03-14T06:44:12.4455817Z  2025-03-14T06:44:12.4456248Z  2025-03-14T06:44:12.4456648Z  2025-03-14T06:44:12.4457057Z  2025-03-14T06:44:12.4458017Z [19,904 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:12.4459230Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2025-03-14T06:44:12.4460217Z @llvm-project//mlir:LinalgTransforms; 35s local 2025-03-14T06:44:12.4461011Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 33s local 2025-03-14T06:44:12.4462058Z Compiling xla/service/spmd/gather_scatter_handler.cc; 24s local 2025-03-14T06:44:12.4463014Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2025-03-14T06:44:12.4463994Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 18s local 2025-03-14T06:44:12.4464989Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 15s local 2025-03-14T06:44:12.4466342Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2025-03-14T06:44:13.0370908Z 2025-03-14T06:44:13.0371809Z  2025-03-14T06:44:13.0372328Z  2025-03-14T06:44:13.0372741Z  2025-03-14T06:44:13.0373152Z  2025-03-14T06:44:13.0373580Z  2025-03-14T06:44:13.0374001Z  2025-03-14T06:44:13.0374427Z  2025-03-14T06:44:13.0374869Z  2025-03-14T06:44:13.0375873Z [19,905 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:13.0377522Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2025-03-14T06:44:13.0378511Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T06:44:13.0379471Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T06:44:13.0380652Z Compiling xla/service/spmd/gather_scatter_handler.cc; 24s local 2025-03-14T06:44:13.0381626Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2025-03-14T06:44:13.0382645Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 18s local 2025-03-14T06:44:13.0383581Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local 2025-03-14T06:44:13.0384416Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:44:13.2458821Z 2025-03-14T06:44:13.2459652Z  2025-03-14T06:44:13.2460138Z  2025-03-14T06:44:13.2460564Z  2025-03-14T06:44:13.2460975Z  2025-03-14T06:44:13.2461399Z  2025-03-14T06:44:13.2461808Z  2025-03-14T06:44:13.2462230Z  2025-03-14T06:44:13.2462641Z  2025-03-14T06:44:13.2463584Z [19,906 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:13.2464760Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 37s local 2025-03-14T06:44:13.2465931Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T06:44:13.2466805Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T06:44:13.2467846Z Compiling xla/service/spmd/gather_scatter_handler.cc; 24s local 2025-03-14T06:44:13.2468709Z Compiling xla/service/spmd/spmd_partitioner.cc; 21s local 2025-03-14T06:44:13.2469620Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2025-03-14T06:44:13.2470650Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local 2025-03-14T06:44:13.2471570Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:44:13.4461726Z 2025-03-14T06:44:13.4462534Z  2025-03-14T06:44:13.4463209Z  2025-03-14T06:44:13.4463576Z  2025-03-14T06:44:13.4463929Z  2025-03-14T06:44:13.4464274Z  2025-03-14T06:44:13.4464619Z  2025-03-14T06:44:13.4464973Z  2025-03-14T06:44:13.4465540Z  2025-03-14T06:44:13.4466420Z [19,908 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:13.4467521Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2025-03-14T06:44:13.4468497Z @llvm-project//mlir:LinalgTransforms; 36s local 2025-03-14T06:44:13.4469263Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T06:44:13.4470093Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2025-03-14T06:44:13.4470897Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2025-03-14T06:44:13.4471777Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local 2025-03-14T06:44:13.4472557Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:44:13.4473218Z Compiling xla/service/allocation_tracker.cc; 13s local ... 2025-03-14T06:44:13.6557924Z 2025-03-14T06:44:13.6558789Z  2025-03-14T06:44:13.6559204Z  2025-03-14T06:44:13.6559509Z  2025-03-14T06:44:13.6559858Z  2025-03-14T06:44:13.6560289Z  2025-03-14T06:44:13.6560669Z  2025-03-14T06:44:13.6561078Z  2025-03-14T06:44:13.6561479Z  2025-03-14T06:44:13.6562619Z [19,909 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:13.6563689Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2025-03-14T06:44:13.6564791Z @llvm-project//mlir:LinalgTransforms; 37s local 2025-03-14T06:44:13.6565883Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 34s local 2025-03-14T06:44:13.6566802Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2025-03-14T06:44:13.6567901Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2025-03-14T06:44:13.6568964Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 16s local 2025-03-14T06:44:13.6569798Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:44:13.6570584Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2025-03-14T06:44:14.0468971Z 2025-03-14T06:44:14.0469838Z  2025-03-14T06:44:14.0470415Z  2025-03-14T06:44:14.0470897Z  2025-03-14T06:44:14.0471266Z  2025-03-14T06:44:14.0471654Z  2025-03-14T06:44:14.0472027Z  2025-03-14T06:44:14.0472412Z  2025-03-14T06:44:14.0472781Z  2025-03-14T06:44:14.0473774Z [19,910 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:14.0474964Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 38s local 2025-03-14T06:44:14.0475972Z @llvm-project//mlir:LinalgTransforms; 37s local 2025-03-14T06:44:14.0476914Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T06:44:14.0477877Z Compiling xla/service/spmd/spmd_partitioner.cc; 22s local 2025-03-14T06:44:14.0478805Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 19s local 2025-03-14T06:44:14.0479787Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local 2025-03-14T06:44:14.0480679Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:44:14.0481509Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2025-03-14T06:44:14.5631554Z 2025-03-14T06:44:14.5632469Z  2025-03-14T06:44:14.5632987Z  2025-03-14T06:44:14.5633359Z  2025-03-14T06:44:14.5633746Z  2025-03-14T06:44:14.5634118Z  2025-03-14T06:44:14.5634499Z  2025-03-14T06:44:14.5634866Z  2025-03-14T06:44:14.5635242Z  2025-03-14T06:44:14.5636158Z [19,911 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:14.5637624Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2025-03-14T06:44:14.5638577Z @llvm-project//mlir:LinalgTransforms; 37s local 2025-03-14T06:44:14.5639484Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T06:44:14.5640492Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2025-03-14T06:44:14.5641386Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local 2025-03-14T06:44:14.5642340Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local 2025-03-14T06:44:14.5643424Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:44:14.5644235Z Compiling xla/service/allocation_tracker.cc; 14s local ... 2025-03-14T06:44:14.8484909Z 2025-03-14T06:44:14.8485758Z  2025-03-14T06:44:14.8486217Z  2025-03-14T06:44:14.8486620Z  2025-03-14T06:44:14.8486945Z  2025-03-14T06:44:14.8487304Z  2025-03-14T06:44:14.8487714Z  2025-03-14T06:44:14.8488138Z  2025-03-14T06:44:14.8488655Z  2025-03-14T06:44:14.8489595Z [19,911 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:14.8490674Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2025-03-14T06:44:14.8491479Z @llvm-project//mlir:LinalgTransforms; 38s local 2025-03-14T06:44:14.8492442Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 35s local 2025-03-14T06:44:14.8493719Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2025-03-14T06:44:14.8494662Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 20s local 2025-03-14T06:44:14.8495579Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 17s local 2025-03-14T06:44:14.8496431Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:14.8497182Z Compiling xla/service/allocation_tracker.cc; 15s local ... 2025-03-14T06:44:15.2478693Z 2025-03-14T06:44:15.2479572Z  2025-03-14T06:44:15.2480577Z  2025-03-14T06:44:15.2480967Z  2025-03-14T06:44:15.2481346Z  2025-03-14T06:44:15.2481770Z  2025-03-14T06:44:15.2482159Z  2025-03-14T06:44:15.2482540Z  2025-03-14T06:44:15.2482946Z  2025-03-14T06:44:15.2483886Z [19,913 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:15.2485184Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 39s local 2025-03-14T06:44:15.2486176Z @llvm-project//mlir:LinalgTransforms; 38s local 2025-03-14T06:44:15.2487043Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2025-03-14T06:44:15.2488028Z Compiling xla/service/spmd/spmd_partitioner.cc; 23s local 2025-03-14T06:44:15.2488938Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2025-03-14T06:44:15.2489910Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local 2025-03-14T06:44:15.2490772Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:15.2491640Z Compiling xla/service/allocation_tracker.cc; 15s local ... 2025-03-14T06:44:15.6483989Z 2025-03-14T06:44:15.6484965Z  2025-03-14T06:44:15.6485412Z  2025-03-14T06:44:15.6485748Z  2025-03-14T06:44:15.6486100Z  2025-03-14T06:44:15.6486465Z  2025-03-14T06:44:15.6486816Z  2025-03-14T06:44:15.6487159Z  2025-03-14T06:44:15.6487514Z  2025-03-14T06:44:15.6488346Z [19,915 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:15.6489388Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2025-03-14T06:44:15.6490217Z @llvm-project//mlir:LinalgTransforms; 39s local 2025-03-14T06:44:15.6490988Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2025-03-14T06:44:15.6491848Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T06:44:15.6492661Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2025-03-14T06:44:15.6493826Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local 2025-03-14T06:44:15.6494576Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:15.6495262Z Compiling xla/service/allocation_tracker.cc; 16s local ... 2025-03-14T06:44:15.8795354Z 2025-03-14T06:44:15.8796168Z  2025-03-14T06:44:15.8796584Z  2025-03-14T06:44:15.8796934Z  2025-03-14T06:44:15.8797266Z  2025-03-14T06:44:15.8797604Z  2025-03-14T06:44:15.8797978Z  2025-03-14T06:44:15.8798320Z  2025-03-14T06:44:15.8798663Z  2025-03-14T06:44:15.8799746Z [19,916 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:15.8800750Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2025-03-14T06:44:15.8801550Z @llvm-project//mlir:LinalgTransforms; 39s local 2025-03-14T06:44:15.8802294Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 36s local 2025-03-14T06:44:15.8803156Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T06:44:15.8803972Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2025-03-14T06:44:15.8804974Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 18s local 2025-03-14T06:44:15.8805712Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:15.8806399Z Compiling xla/service/allocation_tracker.cc; 16s local ... 2025-03-14T06:44:16.0867674Z 2025-03-14T06:44:16.0868510Z  2025-03-14T06:44:16.0868982Z  2025-03-14T06:44:16.0869363Z  2025-03-14T06:44:16.0869821Z  2025-03-14T06:44:16.0870208Z  2025-03-14T06:44:16.0870621Z  2025-03-14T06:44:16.0870990Z  2025-03-14T06:44:16.0871380Z  2025-03-14T06:44:16.0872307Z [19,917 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:16.0873497Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 40s local 2025-03-14T06:44:16.0874612Z @llvm-project//mlir:LinalgTransforms; 39s local 2025-03-14T06:44:16.0875428Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T06:44:16.0876285Z Compiling xla/service/spmd/spmd_partitioner.cc; 24s local 2025-03-14T06:44:16.0877116Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 21s local 2025-03-14T06:44:16.0878064Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local 2025-03-14T06:44:16.0878949Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:16.0879758Z Compiling xla/service/allocation_tracker.cc; 16s local ... 2025-03-14T06:44:16.4431595Z 2025-03-14T06:44:16.4432418Z  2025-03-14T06:44:16.4432929Z  2025-03-14T06:44:16.4433318Z  2025-03-14T06:44:16.4433720Z  2025-03-14T06:44:16.4434103Z  2025-03-14T06:44:16.4434510Z  2025-03-14T06:44:16.4434923Z  2025-03-14T06:44:16.4435318Z  2025-03-14T06:44:16.4436295Z [19,919 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:16.4437464Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T06:44:16.4438441Z @llvm-project//mlir:LinalgTransforms; 39s local 2025-03-14T06:44:16.4439381Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T06:44:16.4440309Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T06:44:16.4441298Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T06:44:16.4442261Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local 2025-03-14T06:44:16.4443167Z Compiling xla/service/allocation_tracker.cc; 16s local 2025-03-14T06:44:16.4444052Z Compiling .../shardy/mhlo_round_trip/shard_map_export.cc; 15s local ... 2025-03-14T06:44:16.6490962Z 2025-03-14T06:44:16.6491827Z  2025-03-14T06:44:16.6492275Z  2025-03-14T06:44:16.6492709Z  2025-03-14T06:44:16.6493113Z  2025-03-14T06:44:16.6493486Z  2025-03-14T06:44:16.6494125Z  2025-03-14T06:44:16.6494508Z  2025-03-14T06:44:16.6494898Z  2025-03-14T06:44:16.6495846Z [19,919 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:16.6496966Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T06:44:16.6497899Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T06:44:16.6498789Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T06:44:16.6500071Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T06:44:16.6500999Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T06:44:16.6501765Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local 2025-03-14T06:44:16.6502463Z Compiling xla/service/allocation_tracker.cc; 17s local 2025-03-14T06:44:16.6503302Z Compiling .../shardy/mhlo_round_trip/shard_map_export.cc; 15s local ... 2025-03-14T06:44:16.8493448Z 2025-03-14T06:44:16.8494315Z  2025-03-14T06:44:16.8494841Z  2025-03-14T06:44:16.8495305Z  2025-03-14T06:44:16.8495762Z  2025-03-14T06:44:16.8496216Z  2025-03-14T06:44:16.8496676Z  2025-03-14T06:44:16.8497130Z  2025-03-14T06:44:16.8497582Z  2025-03-14T06:44:16.8498677Z [19,920 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:16.8500318Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T06:44:16.8501423Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T06:44:16.8502463Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 37s local 2025-03-14T06:44:16.8503588Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T06:44:16.8504646Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T06:44:16.8505927Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 19s local 2025-03-14T06:44:16.8506970Z Compiling xla/service/allocation_tracker.cc; 17s local 2025-03-14T06:44:16.8508048Z Compiling .../shardy/mhlo_round_trip/shard_map_export.cc; 15s local ... 2025-03-14T06:44:17.1120497Z 2025-03-14T06:44:17.1121339Z  2025-03-14T06:44:17.1121808Z  2025-03-14T06:44:17.1122205Z  2025-03-14T06:44:17.1122620Z  2025-03-14T06:44:17.1123016Z  2025-03-14T06:44:17.1123460Z  2025-03-14T06:44:17.1123851Z  2025-03-14T06:44:17.1124236Z  2025-03-14T06:44:17.1125340Z [19,921 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:17.1126484Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 41s local 2025-03-14T06:44:17.1127523Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T06:44:17.1128428Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T06:44:17.1129464Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T06:44:17.1130439Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 22s local 2025-03-14T06:44:17.1131327Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 20s local 2025-03-14T06:44:17.1132191Z Compiling xla/service/allocation_tracker.cc; 17s local 2025-03-14T06:44:17.1133051Z Compiling .../shardy/mhlo_round_trip/shard_map_export.cc; 15s local ... 2025-03-14T06:44:17.3647230Z 2025-03-14T06:44:17.3648142Z  2025-03-14T06:44:17.3648598Z  2025-03-14T06:44:17.3648986Z  2025-03-14T06:44:17.3649383Z  2025-03-14T06:44:17.3649768Z  2025-03-14T06:44:17.3650151Z  2025-03-14T06:44:17.3650526Z  2025-03-14T06:44:17.3650929Z  2025-03-14T06:44:17.3651821Z [19,922 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:17.3652939Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2025-03-14T06:44:17.3654118Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T06:44:17.3655023Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T06:44:17.3655970Z Compiling xla/service/spmd/spmd_partitioner.cc; 25s local 2025-03-14T06:44:17.3656907Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T06:44:17.3657874Z Compiling .../spmd/shardy/mhlo_round_trip/mhlo_import.cc; 20s local 2025-03-14T06:44:17.3658801Z Compiling xla/service/allocation_tracker.cc; 17s local 2025-03-14T06:44:17.3659900Z Compiling .../shardy/mhlo_round_trip/shard_map_export.cc; 15s local ... 2025-03-14T06:44:17.6175442Z 2025-03-14T06:44:17.6176299Z  2025-03-14T06:44:17.6176747Z  2025-03-14T06:44:17.6177158Z  2025-03-14T06:44:17.6177561Z  2025-03-14T06:44:17.6177967Z  2025-03-14T06:44:17.6178378Z  2025-03-14T06:44:17.6178746Z  2025-03-14T06:44:17.6179123Z  2025-03-14T06:44:17.6180055Z [19,924 / 20,652] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:44:17.6181262Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2025-03-14T06:44:17.6182244Z @llvm-project//mlir:LinalgTransforms; 40s local 2025-03-14T06:44:17.6183122Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T06:44:17.6184134Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T06:44:17.6185418Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T06:44:17.6186428Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 16s local 2025-03-14T06:44:17.6187456Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local 2025-03-14T06:44:17.6188360Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:44:17.8305717Z 2025-03-14T06:44:17.8306561Z  2025-03-14T06:44:17.8307069Z  2025-03-14T06:44:17.8307791Z  2025-03-14T06:44:17.8308154Z  2025-03-14T06:44:17.8308551Z  2025-03-14T06:44:17.8308941Z  2025-03-14T06:44:17.8309326Z  2025-03-14T06:44:17.8309710Z  2025-03-14T06:44:17.8310647Z [19,925 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:17.8311745Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2025-03-14T06:44:17.8312609Z @llvm-project//mlir:LinalgTransforms; 41s local 2025-03-14T06:44:17.8313450Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 38s local 2025-03-14T06:44:17.8314359Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T06:44:17.8315256Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T06:44:17.8316240Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 16s local 2025-03-14T06:44:17.8317227Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local 2025-03-14T06:44:17.8318099Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:44:18.0501769Z 2025-03-14T06:44:18.0502648Z  2025-03-14T06:44:18.0503162Z  2025-03-14T06:44:18.0503594Z  2025-03-14T06:44:18.0503983Z  2025-03-14T06:44:18.0504344Z  2025-03-14T06:44:18.0504742Z  2025-03-14T06:44:18.0505129Z  2025-03-14T06:44:18.0505534Z  2025-03-14T06:44:18.0506504Z [19,925 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:18.0507840Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2025-03-14T06:44:18.0508816Z @llvm-project//mlir:LinalgTransforms; 41s local 2025-03-14T06:44:18.0509697Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T06:44:18.0510642Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T06:44:18.0511549Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 23s local 2025-03-14T06:44:18.0512861Z Compiling .../spmd/shardy/mhlo_round_trip/shard_map_export.cc; 16s local 2025-03-14T06:44:18.0513840Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local 2025-03-14T06:44:18.0514642Z @llvm-project//mlir:LinalgTransforms; 15s local ... 2025-03-14T06:44:18.2504589Z 2025-03-14T06:44:18.2505431Z  2025-03-14T06:44:18.2505920Z  2025-03-14T06:44:18.2506351Z  2025-03-14T06:44:18.2506752Z  2025-03-14T06:44:18.2507160Z  2025-03-14T06:44:18.2507579Z  2025-03-14T06:44:18.2507981Z  2025-03-14T06:44:18.2508361Z  2025-03-14T06:44:18.2509538Z [19,927 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:18.2510770Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 42s local 2025-03-14T06:44:18.2511764Z @llvm-project//mlir:LinalgTransforms; 41s local 2025-03-14T06:44:18.2512558Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T06:44:18.2513539Z Compiling xla/service/spmd/spmd_partitioner.cc; 26s local 2025-03-14T06:44:18.2514466Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2025-03-14T06:44:18.2515382Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local 2025-03-14T06:44:18.2516192Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:44:18.2517009Z Compiling xla/service/cpu/onednn_matmul.cc; 15s local ... 2025-03-14T06:44:18.6508599Z 2025-03-14T06:44:18.6509457Z  2025-03-14T06:44:18.6510328Z  2025-03-14T06:44:18.6510734Z  2025-03-14T06:44:18.6511096Z  2025-03-14T06:44:18.6511493Z  2025-03-14T06:44:18.6511916Z  2025-03-14T06:44:18.6512305Z  2025-03-14T06:44:18.6512702Z  2025-03-14T06:44:18.6513663Z [19,928 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:18.6514805Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2025-03-14T06:44:18.6516011Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T06:44:18.6516919Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 39s local 2025-03-14T06:44:18.6517960Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T06:44:18.6518866Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2025-03-14T06:44:18.6519858Z Compiling xla/pjrt/stream_executor_executable.cc; 17s local 2025-03-14T06:44:18.6520621Z Compiling xla/service/cpu/onednn_matmul.cc; 15s local 2025-03-14T06:44:18.6521495Z Compiling xla/pjrt/stream_executor_executable.cc; 15s local ... 2025-03-14T06:44:19.0460380Z 2025-03-14T06:44:19.0461197Z  2025-03-14T06:44:19.0461741Z  2025-03-14T06:44:19.0462117Z  2025-03-14T06:44:19.0462499Z  2025-03-14T06:44:19.0462861Z  2025-03-14T06:44:19.0463239Z  2025-03-14T06:44:19.0463639Z  2025-03-14T06:44:19.0464039Z  2025-03-14T06:44:19.0465049Z [19,930 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:19.0466643Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2025-03-14T06:44:19.0467613Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T06:44:19.0468571Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T06:44:19.0469466Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T06:44:19.0470366Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 24s local 2025-03-14T06:44:19.0471378Z Compiling xla/pjrt/stream_executor_executable.cc; 15s local 2025-03-14T06:44:19.0472240Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:44:19.0473115Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 14s local ... 2025-03-14T06:44:19.2513720Z 2025-03-14T06:44:19.2514537Z  2025-03-14T06:44:19.2515031Z  2025-03-14T06:44:19.2515437Z  2025-03-14T06:44:19.2515831Z  2025-03-14T06:44:19.2516245Z  2025-03-14T06:44:19.2516757Z  2025-03-14T06:44:19.2517387Z  2025-03-14T06:44:19.2517818Z  2025-03-14T06:44:19.2518782Z [19,930 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:19.2519965Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 43s local 2025-03-14T06:44:19.2520907Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T06:44:19.2521783Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T06:44:19.2522962Z Compiling xla/service/spmd/spmd_partitioner.cc; 27s local 2025-03-14T06:44:19.2523871Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2025-03-14T06:44:19.2524960Z Compiling xla/pjrt/stream_executor_executable.cc; 15s local 2025-03-14T06:44:19.2525838Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:44:19.2526758Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 14s local ... 2025-03-14T06:44:19.4740267Z 2025-03-14T06:44:19.4741146Z  2025-03-14T06:44:19.4741666Z  2025-03-14T06:44:19.4742082Z  2025-03-14T06:44:19.4742483Z  2025-03-14T06:44:19.4742859Z  2025-03-14T06:44:19.4743220Z  2025-03-14T06:44:19.4743576Z  2025-03-14T06:44:19.4743961Z  2025-03-14T06:44:19.4744887Z [19,931 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:19.4745993Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2025-03-14T06:44:19.4747325Z @llvm-project//mlir:LinalgTransforms; 42s local 2025-03-14T06:44:19.4748258Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T06:44:19.4749259Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T06:44:19.4750228Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2025-03-14T06:44:19.4751268Z Compiling xla/pjrt/stream_executor_executable.cc; 15s local 2025-03-14T06:44:19.4752201Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:44:19.4752982Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 15s local ... 2025-03-14T06:44:19.8518918Z 2025-03-14T06:44:19.8519733Z  2025-03-14T06:44:19.8520267Z  2025-03-14T06:44:19.8520729Z  2025-03-14T06:44:19.8521184Z  2025-03-14T06:44:19.8521641Z  2025-03-14T06:44:19.8522093Z  2025-03-14T06:44:19.8522556Z  2025-03-14T06:44:19.8523004Z  2025-03-14T06:44:19.8524162Z [19,931 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:19.8525691Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2025-03-14T06:44:19.8526812Z @llvm-project//mlir:LinalgTransforms; 43s local 2025-03-14T06:44:19.8527872Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 40s local 2025-03-14T06:44:19.8529030Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T06:44:19.8530145Z Compiling xla/service/spmd/spmd_partitioner_util.cc; 25s local 2025-03-14T06:44:19.8531234Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local 2025-03-14T06:44:19.8532201Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:44:19.8533222Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 15s local ... 2025-03-14T06:44:20.2523258Z 2025-03-14T06:44:20.2524126Z  2025-03-14T06:44:20.2524730Z  2025-03-14T06:44:20.2525131Z  2025-03-14T06:44:20.2525565Z  2025-03-14T06:44:20.2525954Z  2025-03-14T06:44:20.2526345Z  2025-03-14T06:44:20.2526733Z  2025-03-14T06:44:20.2527115Z  2025-03-14T06:44:20.2528028Z [19,933 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:20.2529192Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 44s local 2025-03-14T06:44:20.2530113Z @llvm-project//mlir:LinalgTransforms; 43s local 2025-03-14T06:44:20.2531270Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T06:44:20.2532261Z Compiling xla/service/spmd/spmd_partitioner.cc; 28s local 2025-03-14T06:44:20.2533156Z Compiling xla/pjrt/stream_executor_executable.cc; 16s local 2025-03-14T06:44:20.2533968Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:20.2534807Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 15s local 2025-03-14T06:44:20.2535615Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2025-03-14T06:44:20.6528196Z 2025-03-14T06:44:20.6529009Z  2025-03-14T06:44:20.6529753Z  2025-03-14T06:44:20.6530177Z  2025-03-14T06:44:20.6530594Z  2025-03-14T06:44:20.6530979Z  2025-03-14T06:44:20.6531373Z  2025-03-14T06:44:20.6531761Z  2025-03-14T06:44:20.6532146Z  2025-03-14T06:44:20.6533079Z [19,934 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:20.6534304Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T06:44:20.6535248Z @llvm-project//mlir:LinalgTransforms; 44s local 2025-03-14T06:44:20.6536108Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T06:44:20.6537094Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2025-03-14T06:44:20.6538000Z Compiling xla/pjrt/stream_executor_executable.cc; 17s local 2025-03-14T06:44:20.6538788Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:20.6539883Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 16s local 2025-03-14T06:44:20.6540742Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:44:20.8975187Z 2025-03-14T06:44:20.8976044Z  2025-03-14T06:44:20.8976534Z  2025-03-14T06:44:20.8976904Z  2025-03-14T06:44:20.8977275Z  2025-03-14T06:44:20.8977657Z  2025-03-14T06:44:20.8978023Z  2025-03-14T06:44:20.8978401Z  2025-03-14T06:44:20.8979130Z  2025-03-14T06:44:20.8980069Z [19,935 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:20.8981230Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T06:44:20.8982158Z @llvm-project//mlir:LinalgTransforms; 44s local 2025-03-14T06:44:20.8983033Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 41s local 2025-03-14T06:44:20.8984021Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2025-03-14T06:44:20.8984913Z Compiling xla/pjrt/stream_executor_executable.cc; 17s local 2025-03-14T06:44:20.8985733Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:20.8986558Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 16s local 2025-03-14T06:44:20.8987417Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:44:21.2532825Z 2025-03-14T06:44:21.2533683Z  2025-03-14T06:44:21.2534198Z  2025-03-14T06:44:21.2534673Z  2025-03-14T06:44:21.2535094Z  2025-03-14T06:44:21.2535498Z  2025-03-14T06:44:21.2535904Z  2025-03-14T06:44:21.2536312Z  2025-03-14T06:44:21.2536740Z  2025-03-14T06:44:21.2537699Z [19,935 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:21.2538975Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 45s local 2025-03-14T06:44:21.2539990Z @llvm-project//mlir:LinalgTransforms; 44s local 2025-03-14T06:44:21.2540936Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T06:44:21.2541951Z Compiling xla/service/spmd/spmd_partitioner.cc; 29s local 2025-03-14T06:44:21.2542910Z Compiling xla/pjrt/stream_executor_executable.cc; 17s local 2025-03-14T06:44:21.2543782Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:21.2544675Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 16s local 2025-03-14T06:44:21.2545589Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:44:21.5964040Z 2025-03-14T06:44:21.5965455Z  2025-03-14T06:44:21.5965910Z  2025-03-14T06:44:21.5966260Z  2025-03-14T06:44:21.5966608Z  2025-03-14T06:44:21.5966957Z  2025-03-14T06:44:21.5967293Z  2025-03-14T06:44:21.5967639Z  2025-03-14T06:44:21.5967987Z  2025-03-14T06:44:21.5968791Z [19,938 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:21.5969801Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2025-03-14T06:44:21.5970785Z @llvm-project//mlir:LinalgTransforms; 44s local 2025-03-14T06:44:21.5971547Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T06:44:21.5972378Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T06:44:21.5973065Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:21.5973768Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 17s local 2025-03-14T06:44:21.5974476Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:44:21.5975136Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 11s local ... 2025-03-14T06:44:21.8537912Z 2025-03-14T06:44:21.8538799Z  2025-03-14T06:44:21.8539310Z  2025-03-14T06:44:21.8539729Z  2025-03-14T06:44:21.8540154Z  2025-03-14T06:44:21.8540563Z  2025-03-14T06:44:21.8540969Z  2025-03-14T06:44:21.8541405Z  2025-03-14T06:44:21.8542288Z  2025-03-14T06:44:21.8543208Z [19,938 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:21.8544406Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2025-03-14T06:44:21.8545488Z @llvm-project//mlir:LinalgTransforms; 45s local 2025-03-14T06:44:21.8546361Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 42s local 2025-03-14T06:44:21.8547276Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T06:44:21.8548220Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:21.8549002Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 17s local 2025-03-14T06:44:21.8549765Z @llvm-project//mlir:LinalgTransforms; 15s local 2025-03-14T06:44:21.8550578Z Compiling llvm/lib/CodeGen/SafeStack.cpp; 12s local ... 2025-03-14T06:44:22.2542612Z 2025-03-14T06:44:22.2543441Z  2025-03-14T06:44:22.2543924Z  2025-03-14T06:44:22.2544303Z  2025-03-14T06:44:22.2544800Z  2025-03-14T06:44:22.2545237Z  2025-03-14T06:44:22.2545628Z  2025-03-14T06:44:22.2546000Z  2025-03-14T06:44:22.2546392Z  2025-03-14T06:44:22.2547305Z [19,941 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:22.2548422Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 46s local 2025-03-14T06:44:22.2549344Z @llvm-project//mlir:LinalgTransforms; 45s local 2025-03-14T06:44:22.2550289Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T06:44:22.2551202Z Compiling xla/service/spmd/spmd_partitioner.cc; 30s local 2025-03-14T06:44:22.2552015Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:22.2552756Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 17s local 2025-03-14T06:44:22.2553519Z @llvm-project//mlir:LinalgTransforms; 11s local 2025-03-14T06:44:22.2554294Z @llvm-project//mlir:LinalgTransforms; 11s local ... 2025-03-14T06:44:22.4545691Z 2025-03-14T06:44:22.4546558Z  2025-03-14T06:44:22.4547053Z  2025-03-14T06:44:22.4547487Z  2025-03-14T06:44:22.4547883Z  2025-03-14T06:44:22.4548300Z  2025-03-14T06:44:22.4548671Z  2025-03-14T06:44:22.4549051Z  2025-03-14T06:44:22.4549443Z  2025-03-14T06:44:22.4550409Z [19,942 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:22.4551586Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2025-03-14T06:44:22.4552848Z @llvm-project//mlir:LinalgTransforms; 45s local 2025-03-14T06:44:22.4553806Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T06:44:22.4554848Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2025-03-14T06:44:22.4555645Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:22.4556526Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 18s local 2025-03-14T06:44:22.4557591Z @llvm-project//mlir:LinalgTransforms; 12s local 2025-03-14T06:44:22.4558536Z @llvm-project//mlir:LinalgTransforms; 12s local ... 2025-03-14T06:44:22.8549399Z 2025-03-14T06:44:22.8550278Z  2025-03-14T06:44:22.8550758Z  2025-03-14T06:44:22.8551177Z  2025-03-14T06:44:22.8551582Z  2025-03-14T06:44:22.8551987Z  2025-03-14T06:44:22.8552384Z  2025-03-14T06:44:22.8552799Z  2025-03-14T06:44:22.8553189Z  2025-03-14T06:44:22.8554191Z [19,942 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:22.8555314Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 47s local 2025-03-14T06:44:22.8556220Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T06:44:22.8557080Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 43s local 2025-03-14T06:44:22.8558028Z Compiling xla/service/spmd/spmd_partitioner.cc; 31s local 2025-03-14T06:44:22.8559138Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:22.8560002Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 18s local 2025-03-14T06:44:22.8560984Z @llvm-project//mlir:LinalgTransforms; 12s local 2025-03-14T06:44:22.8561769Z @llvm-project//mlir:LinalgTransforms; 12s local ... 2025-03-14T06:44:23.5371184Z 2025-03-14T06:44:23.5372054Z  2025-03-14T06:44:23.5372538Z  2025-03-14T06:44:23.5372959Z  2025-03-14T06:44:23.5373654Z  2025-03-14T06:44:23.5374053Z  2025-03-14T06:44:23.5374432Z  2025-03-14T06:44:23.5374811Z  2025-03-14T06:44:23.5375197Z  2025-03-14T06:44:23.5376092Z [19,943 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:23.5377244Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 48s local 2025-03-14T06:44:23.5378198Z @llvm-project//mlir:LinalgTransforms; 46s local 2025-03-14T06:44:23.5379098Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2025-03-14T06:44:23.5380071Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2025-03-14T06:44:23.5380959Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 19s local 2025-03-14T06:44:23.5381788Z @llvm-project//mlir:LinalgTransforms; 13s local 2025-03-14T06:44:23.5382742Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 13s local 2025-03-14T06:44:23.5383740Z Compiling xla/pjrt/pjrt_compiler.cc; 13s local ... 2025-03-14T06:44:23.8556573Z 2025-03-14T06:44:23.8557454Z  2025-03-14T06:44:23.8557944Z  2025-03-14T06:44:23.8558349Z  2025-03-14T06:44:23.8558729Z  2025-03-14T06:44:23.8559129Z  2025-03-14T06:44:23.8559506Z  2025-03-14T06:44:23.8559913Z  2025-03-14T06:44:23.8560327Z  2025-03-14T06:44:23.8561292Z [19,943 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:23.8562444Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 48s local 2025-03-14T06:44:23.8563437Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T06:44:23.8564343Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 44s local 2025-03-14T06:44:23.8565660Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2025-03-14T06:44:23.8566569Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 19s local 2025-03-14T06:44:23.8567442Z @llvm-project//mlir:LinalgTransforms; 13s local 2025-03-14T06:44:23.8568723Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 13s local 2025-03-14T06:44:23.8569762Z Compiling xla/pjrt/pjrt_compiler.cc; 13s local ... 2025-03-14T06:44:24.2560853Z 2025-03-14T06:44:24.2561681Z  2025-03-14T06:44:24.2562157Z  2025-03-14T06:44:24.2562553Z  2025-03-14T06:44:24.2562947Z  2025-03-14T06:44:24.2563359Z  2025-03-14T06:44:24.2563737Z  2025-03-14T06:44:24.2564137Z  2025-03-14T06:44:24.2564726Z  2025-03-14T06:44:24.2566195Z [19,944 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:24.2567510Z Compiling stablehlo/transforms/StablehloLegalizeToVhlo.cpp; 48s local 2025-03-14T06:44:24.2568415Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T06:44:24.2569274Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T06:44:24.2570207Z Compiling xla/service/spmd/spmd_partitioner.cc; 32s local 2025-03-14T06:44:24.2571145Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 19s local 2025-03-14T06:44:24.2571971Z @llvm-project//mlir:LinalgTransforms; 13s local 2025-03-14T06:44:24.2572872Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 13s local 2025-03-14T06:44:24.2573866Z Compiling xla/pjrt/pjrt_compiler.cc; 13s local ... 2025-03-14T06:44:24.4802621Z 2025-03-14T06:44:24.4803489Z  2025-03-14T06:44:24.4804007Z  2025-03-14T06:44:24.4804824Z  2025-03-14T06:44:24.4805281Z  2025-03-14T06:44:24.4805626Z  2025-03-14T06:44:24.4805986Z  2025-03-14T06:44:24.4806351Z  2025-03-14T06:44:24.4806696Z  2025-03-14T06:44:24.4807555Z [19,945 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:24.4808433Z @llvm-project//mlir:LinalgTransforms; 47s local 2025-03-14T06:44:24.4809227Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T06:44:24.4810294Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2025-03-14T06:44:24.4811137Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local 2025-03-14T06:44:24.4811883Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:44:24.4812678Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 14s local 2025-03-14T06:44:24.4813513Z Compiling xla/pjrt/pjrt_compiler.cc; 14s local 2025-03-14T06:44:24.4814227Z @llvm-project//mlir:LinalgTransforms; 13s local ... 2025-03-14T06:44:24.7383507Z 2025-03-14T06:44:24.7384363Z  2025-03-14T06:44:24.7384869Z  2025-03-14T06:44:24.7385259Z  2025-03-14T06:44:24.7385652Z  2025-03-14T06:44:24.7386054Z  2025-03-14T06:44:24.7386439Z  2025-03-14T06:44:24.7386827Z  2025-03-14T06:44:24.7387222Z  2025-03-14T06:44:24.7388112Z [19,946 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:24.7389119Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T06:44:24.7390044Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 45s local 2025-03-14T06:44:24.7390984Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2025-03-14T06:44:24.7391892Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local 2025-03-14T06:44:24.7392736Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:44:24.7393658Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 14s local 2025-03-14T06:44:24.7394623Z Compiling xla/pjrt/pjrt_compiler.cc; 14s local 2025-03-14T06:44:24.7395366Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:44:25.0302413Z 2025-03-14T06:44:25.0303241Z  2025-03-14T06:44:25.0303763Z  2025-03-14T06:44:25.0304182Z  2025-03-14T06:44:25.0304555Z  2025-03-14T06:44:25.0304940Z  2025-03-14T06:44:25.0305325Z  2025-03-14T06:44:25.0305718Z  2025-03-14T06:44:25.0306150Z  2025-03-14T06:44:25.0307369Z [19,948 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:25.0308215Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T06:44:25.0309053Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T06:44:25.0309990Z Compiling xla/service/spmd/spmd_partitioner.cc; 33s local 2025-03-14T06:44:25.0310893Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local 2025-03-14T06:44:25.0311783Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:44:25.0312877Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 14s local 2025-03-14T06:44:25.0313838Z Compiling xla/pjrt/pjrt_compiler.cc; 14s local 2025-03-14T06:44:25.0314579Z @llvm-project//mlir:LinalgTransforms; 14s local ... 2025-03-14T06:44:25.2570065Z 2025-03-14T06:44:25.2570958Z  2025-03-14T06:44:25.2571338Z  2025-03-14T06:44:25.2571719Z  2025-03-14T06:44:25.2572154Z  2025-03-14T06:44:25.2572543Z  2025-03-14T06:44:25.2572952Z  2025-03-14T06:44:25.2573347Z  2025-03-14T06:44:25.2573762Z  2025-03-14T06:44:25.2574688Z [19,949 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:25.2575600Z @llvm-project//mlir:LinalgTransforms; 48s local 2025-03-14T06:44:25.2576465Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T06:44:25.2577749Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local 2025-03-14T06:44:25.2578585Z @llvm-project//mlir:LinalgTransforms; 14s local 2025-03-14T06:44:25.2579497Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 14s local 2025-03-14T06:44:25.2580371Z Compiling xla/pjrt/pjrt_compiler.cc; 14s local 2025-03-14T06:44:25.2581301Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 14s local 2025-03-14T06:44:25.2582246Z Compiling xla/service/llvm_compiler.cc; 14s local ... 2025-03-14T06:44:25.8248290Z 2025-03-14T06:44:25.8249117Z  2025-03-14T06:44:25.8249634Z  2025-03-14T06:44:25.8250197Z  2025-03-14T06:44:25.8250588Z  2025-03-14T06:44:25.8250984Z  2025-03-14T06:44:25.8251405Z  2025-03-14T06:44:25.8251797Z  2025-03-14T06:44:25.8252180Z  2025-03-14T06:44:25.8253117Z [19,950 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:25.8254116Z @llvm-project//mlir:LinalgTransforms; 49s local 2025-03-14T06:44:25.8255028Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 46s local 2025-03-14T06:44:25.8256128Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local 2025-03-14T06:44:25.8257235Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 15s local 2025-03-14T06:44:25.8267135Z Compiling xla/pjrt/pjrt_compiler.cc; 15s local 2025-03-14T06:44:25.8268258Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 15s local 2025-03-14T06:44:25.8269248Z Compiling xla/service/llvm_compiler.cc; 15s local 2025-03-14T06:44:25.8270017Z Compiling xla/service/llvm_ir/llvm_loop.cc; 12s local ... 2025-03-14T06:44:26.0575617Z 2025-03-14T06:44:26.0576450Z  2025-03-14T06:44:26.0576926Z  2025-03-14T06:44:26.0577341Z  2025-03-14T06:44:26.0577758Z  2025-03-14T06:44:26.0578170Z  2025-03-14T06:44:26.0578575Z  2025-03-14T06:44:26.0578994Z  2025-03-14T06:44:26.0579423Z  2025-03-14T06:44:26.0580418Z [19,950 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:26.0581371Z @llvm-project//mlir:LinalgTransforms; 49s local 2025-03-14T06:44:26.0582239Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2025-03-14T06:44:26.0583253Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local 2025-03-14T06:44:26.0584266Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 15s local 2025-03-14T06:44:26.0585609Z Compiling xla/pjrt/pjrt_compiler.cc; 15s local 2025-03-14T06:44:26.0586591Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 15s local 2025-03-14T06:44:26.0587581Z Compiling xla/service/llvm_compiler.cc; 15s local 2025-03-14T06:44:26.0588404Z Compiling xla/service/llvm_ir/llvm_loop.cc; 12s local ... 2025-03-14T06:44:26.4580352Z 2025-03-14T06:44:26.4581217Z  2025-03-14T06:44:26.4581716Z  2025-03-14T06:44:26.4582125Z  2025-03-14T06:44:26.4582509Z  2025-03-14T06:44:26.4582948Z  2025-03-14T06:44:26.4583626Z  2025-03-14T06:44:26.4584101Z  2025-03-14T06:44:26.4584479Z  2025-03-14T06:44:26.4585403Z [19,951 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:26.4586425Z @llvm-project//mlir:LinalgTransforms; 49s local 2025-03-14T06:44:26.4587259Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 47s local 2025-03-14T06:44:26.4588233Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2025-03-14T06:44:26.4589236Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 16s local 2025-03-14T06:44:26.4590141Z Compiling xla/pjrt/pjrt_compiler.cc; 16s local 2025-03-14T06:44:26.4591059Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 15s local 2025-03-14T06:44:26.4591998Z Compiling xla/service/llvm_compiler.cc; 15s local 2025-03-14T06:44:26.4592990Z Compiling xla/service/llvm_ir/llvm_loop.cc; 13s local ... 2025-03-14T06:44:27.0136866Z 2025-03-14T06:44:27.0137731Z  2025-03-14T06:44:27.0138226Z  2025-03-14T06:44:27.0138629Z  2025-03-14T06:44:27.0139075Z  2025-03-14T06:44:27.0139440Z  2025-03-14T06:44:27.0139808Z  2025-03-14T06:44:27.0140173Z  2025-03-14T06:44:27.0140512Z  2025-03-14T06:44:27.0141405Z [19,952 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:27.0142711Z @llvm-project//mlir:LinalgTransforms; 50s local 2025-03-14T06:44:27.0143616Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2025-03-14T06:44:27.0144570Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2025-03-14T06:44:27.0145568Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 16s local 2025-03-14T06:44:27.0146587Z Compiling xla/pjrt/pjrt_compiler.cc; 16s local 2025-03-14T06:44:27.0147524Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 16s local 2025-03-14T06:44:27.0148608Z Compiling xla/service/llvm_compiler.cc; 16s local 2025-03-14T06:44:27.0149350Z Compiling xla/service/llvm_ir/llvm_loop.cc; 13s local ... 2025-03-14T06:44:27.2585643Z 2025-03-14T06:44:27.2586469Z  2025-03-14T06:44:27.2586921Z  2025-03-14T06:44:27.2587270Z  2025-03-14T06:44:27.2587619Z  2025-03-14T06:44:27.2587975Z  2025-03-14T06:44:27.2588371Z  2025-03-14T06:44:27.2588715Z  2025-03-14T06:44:27.2589076Z  2025-03-14T06:44:27.2589933Z [19,952 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:27.2590840Z @llvm-project//mlir:LinalgTransforms; 50s local 2025-03-14T06:44:27.2591664Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2025-03-14T06:44:27.2592593Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2025-03-14T06:44:27.2593511Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 16s local 2025-03-14T06:44:27.2594343Z Compiling xla/pjrt/pjrt_compiler.cc; 16s local 2025-03-14T06:44:27.2595177Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 16s local 2025-03-14T06:44:27.2596022Z Compiling xla/service/llvm_compiler.cc; 16s local 2025-03-14T06:44:27.2596741Z Compiling xla/service/llvm_ir/llvm_loop.cc; 14s local ... 2025-03-14T06:44:27.8263950Z 2025-03-14T06:44:27.8264733Z  2025-03-14T06:44:27.8265156Z  2025-03-14T06:44:27.8265693Z  2025-03-14T06:44:27.8266301Z  2025-03-14T06:44:27.8266766Z  2025-03-14T06:44:27.8267285Z  2025-03-14T06:44:27.8267632Z  2025-03-14T06:44:27.8267980Z  2025-03-14T06:44:27.8268795Z [19,953 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:27.8269680Z @llvm-project//mlir:LinalgTransforms; 51s local 2025-03-14T06:44:27.8270514Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 48s local 2025-03-14T06:44:27.8271567Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 23s local 2025-03-14T06:44:27.8272509Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 17s local 2025-03-14T06:44:27.8273338Z Compiling xla/pjrt/pjrt_compiler.cc; 17s local 2025-03-14T06:44:27.8274184Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 17s local 2025-03-14T06:44:27.8275040Z Compiling xla/service/llvm_compiler.cc; 17s local 2025-03-14T06:44:27.8275775Z Compiling xla/service/llvm_ir/llvm_loop.cc; 14s local ... 2025-03-14T06:44:28.0591400Z 2025-03-14T06:44:28.0592214Z  2025-03-14T06:44:28.0592628Z  2025-03-14T06:44:28.0592956Z  2025-03-14T06:44:28.0593296Z  2025-03-14T06:44:28.0593617Z  2025-03-14T06:44:28.0593959Z  2025-03-14T06:44:28.0594273Z  2025-03-14T06:44:28.0594590Z  2025-03-14T06:44:28.0595376Z [19,954 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:28.0596510Z @llvm-project//mlir:LinalgTransforms; 51s local 2025-03-14T06:44:28.0597236Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T06:44:28.0598025Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 23s local 2025-03-14T06:44:28.0598858Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 17s local 2025-03-14T06:44:28.0599620Z Compiling xla/pjrt/pjrt_compiler.cc; 17s local 2025-03-14T06:44:28.0600544Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 17s local 2025-03-14T06:44:28.0601324Z Compiling xla/service/llvm_compiler.cc; 17s local 2025-03-14T06:44:28.0601907Z @xla//xla/mlir_hlo:mhlo_passes; 14s local ... 2025-03-14T06:44:28.2594611Z 2025-03-14T06:44:28.2595453Z  2025-03-14T06:44:28.2595918Z  2025-03-14T06:44:28.2596323Z  2025-03-14T06:44:28.2596815Z  2025-03-14T06:44:28.2597212Z  2025-03-14T06:44:28.2597629Z  2025-03-14T06:44:28.2598031Z  2025-03-14T06:44:28.2598423Z  2025-03-14T06:44:28.2599382Z [19,955 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:28.2600376Z @llvm-project//mlir:LinalgTransforms; 51s local 2025-03-14T06:44:28.2601281Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T06:44:28.2602310Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 23s local 2025-03-14T06:44:28.2603392Z Compiling mlir/lib/Dialect/Linalg/Transforms/Detensorize.cpp; 17s local 2025-03-14T06:44:28.2604334Z Compiling xla/pjrt/pjrt_compiler.cc; 17s local 2025-03-14T06:44:28.2605415Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 17s local 2025-03-14T06:44:28.2606361Z @xla//xla/mlir_hlo:mhlo_passes; 14s local 2025-03-14T06:44:28.2607047Z Compiling xla/service/llvm_compiler.cc; 14s local ... 2025-03-14T06:44:28.5232065Z 2025-03-14T06:44:28.5232907Z  2025-03-14T06:44:28.5233288Z  2025-03-14T06:44:28.5233643Z  2025-03-14T06:44:28.5233950Z  2025-03-14T06:44:28.5234293Z  2025-03-14T06:44:28.5234606Z  2025-03-14T06:44:28.5234924Z  2025-03-14T06:44:28.5235270Z  2025-03-14T06:44:28.5236019Z [19,956 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:28.5236813Z @llvm-project//mlir:LinalgTransforms; 51s local 2025-03-14T06:44:28.5237915Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T06:44:28.5238845Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 24s local 2025-03-14T06:44:28.5239633Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local 2025-03-14T06:44:28.5240431Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 17s local 2025-03-14T06:44:28.5241314Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:44:28.5241941Z Compiling xla/service/llvm_compiler.cc; 14s local 2025-03-14T06:44:28.5242996Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 14s local ... 2025-03-14T06:44:28.8600044Z 2025-03-14T06:44:28.8600917Z  2025-03-14T06:44:28.8601415Z  2025-03-14T06:44:28.8601806Z  2025-03-14T06:44:28.8602194Z  2025-03-14T06:44:28.8602584Z  2025-03-14T06:44:28.8602947Z  2025-03-14T06:44:28.8603319Z  2025-03-14T06:44:28.8603702Z  2025-03-14T06:44:28.8604812Z [19,956 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:28.8605803Z @llvm-project//mlir:LinalgTransforms; 52s local 2025-03-14T06:44:28.8606665Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 49s local 2025-03-14T06:44:28.8607703Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 24s local 2025-03-14T06:44:28.8608570Z Compiling xla/pjrt/pjrt_compiler.cc; 18s local 2025-03-14T06:44:28.8609435Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 18s local 2025-03-14T06:44:28.8610692Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:44:28.8611346Z Compiling xla/service/llvm_compiler.cc; 15s local 2025-03-14T06:44:28.8612209Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 15s local ... 2025-03-14T06:44:29.6954919Z 2025-03-14T06:44:29.6955786Z  2025-03-14T06:44:29.6956276Z  2025-03-14T06:44:29.6956659Z  2025-03-14T06:44:29.6957042Z  2025-03-14T06:44:29.6957739Z  2025-03-14T06:44:29.6958082Z  2025-03-14T06:44:29.6958416Z  2025-03-14T06:44:29.6958822Z  2025-03-14T06:44:29.6959728Z [19,957 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:29.6960668Z @llvm-project//mlir:LinalgTransforms; 53s local 2025-03-14T06:44:29.6961529Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 50s local 2025-03-14T06:44:29.6962498Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local 2025-03-14T06:44:29.6963341Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local 2025-03-14T06:44:29.6964293Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 19s local 2025-03-14T06:44:29.6965488Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:44:29.6966164Z Compiling xla/service/llvm_compiler.cc; 16s local 2025-03-14T06:44:29.6967057Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 15s local ... 2025-03-14T06:44:30.0608663Z 2025-03-14T06:44:30.0609538Z  2025-03-14T06:44:30.0610023Z  2025-03-14T06:44:30.0610456Z  2025-03-14T06:44:30.0610834Z  2025-03-14T06:44:30.0611199Z  2025-03-14T06:44:30.0611584Z  2025-03-14T06:44:30.0611933Z  2025-03-14T06:44:30.0612320Z  2025-03-14T06:44:30.0613230Z [19,957 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:30.0614258Z @llvm-project//mlir:LinalgTransforms; 53s local 2025-03-14T06:44:30.0615172Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2025-03-14T06:44:30.0616393Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local 2025-03-14T06:44:30.0617224Z Compiling xla/pjrt/pjrt_compiler.cc; 19s local 2025-03-14T06:44:30.0618097Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 19s local 2025-03-14T06:44:30.0618982Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:44:30.0619636Z Compiling xla/service/llvm_compiler.cc; 16s local 2025-03-14T06:44:30.0620785Z Compiling .../csrc/runtime/stablehlo_composite_helper.cc; 16s local ... 2025-03-14T06:44:30.7707353Z 2025-03-14T06:44:30.7708246Z  2025-03-14T06:44:30.7708782Z  2025-03-14T06:44:30.7709223Z  2025-03-14T06:44:30.7709661Z  2025-03-14T06:44:30.7710105Z  2025-03-14T06:44:30.7710466Z  2025-03-14T06:44:30.7710840Z  2025-03-14T06:44:30.7711233Z  2025-03-14T06:44:30.7712125Z [19,958 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:30.7713409Z @llvm-project//mlir:LinalgTransforms; 54s local 2025-03-14T06:44:30.7714338Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 51s local 2025-03-14T06:44:30.7715434Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local 2025-03-14T06:44:30.7716392Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 20s local 2025-03-14T06:44:30.7717291Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:30.7717994Z Compiling xla/service/llvm_compiler.cc; 17s local 2025-03-14T06:44:30.7718923Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 16s local 2025-03-14T06:44:30.7719887Z @xla//xla/mlir_hlo:mhlo_passes; 15s local ... 2025-03-14T06:44:31.0616052Z 2025-03-14T06:44:31.0616887Z  2025-03-14T06:44:31.0617386Z  2025-03-14T06:44:31.0617796Z  2025-03-14T06:44:31.0618196Z  2025-03-14T06:44:31.0618563Z  2025-03-14T06:44:31.0619264Z  2025-03-14T06:44:31.0619643Z  2025-03-14T06:44:31.0620046Z  2025-03-14T06:44:31.0621006Z [19,958 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:31.0621936Z @llvm-project//mlir:LinalgTransforms; 54s local 2025-03-14T06:44:31.0622829Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T06:44:31.0623807Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local 2025-03-14T06:44:31.0625095Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 20s local 2025-03-14T06:44:31.0626021Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:31.0626724Z Compiling xla/service/llvm_compiler.cc; 17s local 2025-03-14T06:44:31.0627653Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 17s local 2025-03-14T06:44:31.0628557Z @xla//xla/mlir_hlo:mhlo_passes; 16s local ... 2025-03-14T06:44:31.4620467Z 2025-03-14T06:44:31.4621368Z  2025-03-14T06:44:31.4621845Z  2025-03-14T06:44:31.4622235Z  2025-03-14T06:44:31.4622585Z  2025-03-14T06:44:31.4622947Z  2025-03-14T06:44:31.4623300Z  2025-03-14T06:44:31.4623651Z  2025-03-14T06:44:31.4624015Z  2025-03-14T06:44:31.4624898Z [19,959 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:31.4625794Z @llvm-project//mlir:LinalgTransforms; 54s local 2025-03-14T06:44:31.4626719Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T06:44:31.4627643Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local 2025-03-14T06:44:31.4628600Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 20s local 2025-03-14T06:44:31.4629446Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:31.4630089Z Compiling xla/service/llvm_compiler.cc; 17s local 2025-03-14T06:44:31.4631027Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 17s local 2025-03-14T06:44:31.4631883Z @xla//xla/mlir_hlo:mhlo_passes; 16s local ... 2025-03-14T06:44:31.6623846Z 2025-03-14T06:44:31.6624750Z  2025-03-14T06:44:31.6625240Z  2025-03-14T06:44:31.6625643Z  2025-03-14T06:44:31.6626046Z  2025-03-14T06:44:31.6626430Z  2025-03-14T06:44:31.6626802Z  2025-03-14T06:44:31.6627178Z  2025-03-14T06:44:31.6627572Z  2025-03-14T06:44:31.6628862Z [19,961 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:31.6629882Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T06:44:31.6630762Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 52s local 2025-03-14T06:44:31.6631767Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local 2025-03-14T06:44:31.6632814Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2025-03-14T06:44:31.6633726Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:31.6634787Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 17s local 2025-03-14T06:44:31.6635667Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:44:31.6636415Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 16s local ... 2025-03-14T06:44:32.0627703Z 2025-03-14T06:44:32.0628561Z  2025-03-14T06:44:32.0629036Z  2025-03-14T06:44:32.0629450Z  2025-03-14T06:44:32.0629821Z  2025-03-14T06:44:32.0630233Z  2025-03-14T06:44:32.0630747Z  2025-03-14T06:44:32.0631121Z  2025-03-14T06:44:32.0631504Z  2025-03-14T06:44:32.0632395Z [19,962 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:32.0633313Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T06:44:32.0634144Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 53s local 2025-03-14T06:44:32.0635039Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local 2025-03-14T06:44:32.0636339Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2025-03-14T06:44:32.0637244Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:32.0638022Z Compiling torch_xla/csrc/runtime/stablehlo_composite_helper.cc; 18s local 2025-03-14T06:44:32.0638831Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:32.0639554Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 17s local ... 2025-03-14T06:44:32.2713123Z 2025-03-14T06:44:32.2713992Z  2025-03-14T06:44:32.2714503Z  2025-03-14T06:44:32.2714926Z  2025-03-14T06:44:32.2715331Z  2025-03-14T06:44:32.2715760Z  2025-03-14T06:44:32.2716128Z  2025-03-14T06:44:32.2716502Z  2025-03-14T06:44:32.2716880Z  2025-03-14T06:44:32.2717806Z [19,965 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:32.2718761Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T06:44:32.2719625Z Compiling llvm/lib/CodeGen/SelectionDAG/DAGCombiner.cpp; 53s local 2025-03-14T06:44:32.2720601Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local 2025-03-14T06:44:32.2721596Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2025-03-14T06:44:32.2722487Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:32.2722997Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:32.2723622Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 17s local 2025-03-14T06:44:32.2724286Z Compiling xla/pjrt/pjrt_client.cc; 16s local ... 2025-03-14T06:44:32.5257665Z 2025-03-14T06:44:32.5258505Z  2025-03-14T06:44:32.5258998Z  2025-03-14T06:44:32.5259392Z  2025-03-14T06:44:32.5259785Z  2025-03-14T06:44:32.5260185Z  2025-03-14T06:44:32.5260560Z  2025-03-14T06:44:32.5260915Z  2025-03-14T06:44:32.5261319Z  2025-03-14T06:44:32.5262217Z [19,970 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:32.5263237Z @llvm-project//mlir:LinalgTransforms; 55s local 2025-03-14T06:44:32.5264154Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 21s local 2025-03-14T06:44:32.5265046Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:32.5265877Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:32.5266600Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 17s local 2025-03-14T06:44:32.5267707Z Compiling xla/pjrt/pjrt_client.cc; 17s local 2025-03-14T06:44:32.5268408Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:32.5269169Z Compiling xla/service/execution_tracker.cc; 15s local ... 2025-03-14T06:44:32.8159480Z 2025-03-14T06:44:32.8160334Z  2025-03-14T06:44:32.8160819Z  2025-03-14T06:44:32.8161221Z  2025-03-14T06:44:32.8161617Z  2025-03-14T06:44:32.8162020Z  2025-03-14T06:44:32.8162381Z  2025-03-14T06:44:32.8162824Z  2025-03-14T06:44:32.8163232Z  2025-03-14T06:44:32.8164412Z [19,971 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:32.8165648Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T06:44:32.8166423Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2025-03-14T06:44:32.8167156Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:32.8167648Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:32.8168284Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 17s local 2025-03-14T06:44:32.8168940Z Compiling xla/pjrt/pjrt_client.cc; 17s local 2025-03-14T06:44:32.8169580Z @llvm-project//mlir:LinalgTransforms; 16s local 2025-03-14T06:44:32.8170308Z Compiling xla/service/execution_tracker.cc; 16s local ... 2025-03-14T06:44:33.0516983Z 2025-03-14T06:44:33.0517828Z  2025-03-14T06:44:33.0518311Z  2025-03-14T06:44:33.0518988Z  2025-03-14T06:44:33.0519395Z  2025-03-14T06:44:33.0519801Z  2025-03-14T06:44:33.0520219Z  2025-03-14T06:44:33.0520627Z  2025-03-14T06:44:33.0521018Z  2025-03-14T06:44:33.0521976Z [19,972 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:33.0522954Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T06:44:33.0523924Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2025-03-14T06:44:33.0525164Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:33.0525806Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:33.0526594Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 18s local 2025-03-14T06:44:33.0527420Z Compiling xla/pjrt/pjrt_client.cc; 17s local 2025-03-14T06:44:33.0528127Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:33.0528924Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 15s local ... 2025-03-14T06:44:33.2544092Z 2025-03-14T06:44:33.2544919Z  2025-03-14T06:44:33.2545408Z  2025-03-14T06:44:33.2545826Z  2025-03-14T06:44:33.2546174Z  2025-03-14T06:44:33.2546550Z  2025-03-14T06:44:33.2546924Z  2025-03-14T06:44:33.2547287Z  2025-03-14T06:44:33.2547699Z  2025-03-14T06:44:33.2548639Z [19,973 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:33.2549640Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T06:44:33.2550550Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2025-03-14T06:44:33.2551397Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:33.2552034Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:33.2552841Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 18s local 2025-03-14T06:44:33.2553602Z Compiling xla/pjrt/pjrt_client.cc; 17s local 2025-03-14T06:44:33.2554224Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:33.2554963Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local ... 2025-03-14T06:44:33.4636654Z 2025-03-14T06:44:33.4637539Z  2025-03-14T06:44:33.4638139Z  2025-03-14T06:44:33.4638553Z  2025-03-14T06:44:33.4638988Z  2025-03-14T06:44:33.4639388Z  2025-03-14T06:44:33.4639767Z  2025-03-14T06:44:33.4640148Z  2025-03-14T06:44:33.4640556Z  2025-03-14T06:44:33.4641799Z [19,973 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:33.4642824Z @llvm-project//mlir:LinalgTransforms; 56s local 2025-03-14T06:44:33.4643731Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 22s local 2025-03-14T06:44:33.4644732Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:44:33.4645381Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:33.4646135Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 18s local 2025-03-14T06:44:33.4647081Z Compiling xla/pjrt/pjrt_client.cc; 18s local 2025-03-14T06:44:33.4647987Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:33.4648779Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local ... 2025-03-14T06:44:33.7231679Z 2025-03-14T06:44:33.7232629Z  2025-03-14T06:44:33.7233119Z  2025-03-14T06:44:33.7233544Z  2025-03-14T06:44:33.7233945Z  2025-03-14T06:44:33.7234364Z  2025-03-14T06:44:33.7234796Z  2025-03-14T06:44:33.7235175Z  2025-03-14T06:44:33.7235561Z  2025-03-14T06:44:33.7236558Z [19,974 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:33.7237550Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T06:44:33.7238538Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2025-03-14T06:44:33.7239444Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:44:33.7240064Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:33.7241111Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 18s local 2025-03-14T06:44:33.7241928Z Compiling xla/pjrt/pjrt_client.cc; 18s local 2025-03-14T06:44:33.7242711Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:33.7243380Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local ... 2025-03-14T06:44:34.0641946Z 2025-03-14T06:44:34.0642738Z  2025-03-14T06:44:34.0643226Z  2025-03-14T06:44:34.0643951Z  2025-03-14T06:44:34.0644363Z  2025-03-14T06:44:34.0644935Z  2025-03-14T06:44:34.0645366Z  2025-03-14T06:44:34.0645794Z  2025-03-14T06:44:34.0646192Z  2025-03-14T06:44:34.0647223Z [19,974 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:34.0648218Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T06:44:34.0649128Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2025-03-14T06:44:34.0650034Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:44:34.0650650Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:34.0651428Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 19s local 2025-03-14T06:44:34.0652251Z Compiling xla/pjrt/pjrt_client.cc; 18s local 2025-03-14T06:44:34.0652966Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:34.0653703Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 16s local ... 2025-03-14T06:44:34.3149849Z 2025-03-14T06:44:34.3150738Z  2025-03-14T06:44:34.3151262Z  2025-03-14T06:44:34.3151680Z  2025-03-14T06:44:34.3152059Z  2025-03-14T06:44:34.3152420Z  2025-03-14T06:44:34.3152792Z  2025-03-14T06:44:34.3153180Z  2025-03-14T06:44:34.3153566Z  2025-03-14T06:44:34.3154469Z [19,975 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:34.3155433Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T06:44:34.3156417Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2025-03-14T06:44:34.3157307Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:44:34.3157897Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:34.3158644Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 19s local 2025-03-14T06:44:34.3159439Z Compiling xla/pjrt/pjrt_client.cc; 18s local 2025-03-14T06:44:34.3160114Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:34.3161210Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local ... 2025-03-14T06:44:34.5164790Z 2025-03-14T06:44:34.5165851Z  2025-03-14T06:44:34.5166401Z  2025-03-14T06:44:34.5166797Z  2025-03-14T06:44:34.5167186Z  2025-03-14T06:44:34.5167560Z  2025-03-14T06:44:34.5167948Z  2025-03-14T06:44:34.5168345Z  2025-03-14T06:44:34.5168711Z  2025-03-14T06:44:34.5169627Z [19,977 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:34.5170861Z @llvm-project//mlir:LinalgTransforms; 57s local 2025-03-14T06:44:34.5171795Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 23s local 2025-03-14T06:44:34.5172725Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:44:34.5173372Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:34.5174130Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 19s local 2025-03-14T06:44:34.5174973Z Compiling xla/pjrt/pjrt_client.cc; 19s local 2025-03-14T06:44:34.5175648Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:34.5176410Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local ... 2025-03-14T06:44:34.8648985Z 2025-03-14T06:44:34.8649859Z  2025-03-14T06:44:34.8650345Z  2025-03-14T06:44:34.8650747Z  2025-03-14T06:44:34.8651112Z  2025-03-14T06:44:34.8651493Z  2025-03-14T06:44:34.8651863Z  2025-03-14T06:44:34.8652618Z  2025-03-14T06:44:34.8653027Z  2025-03-14T06:44:34.8653962Z [19,977 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:34.8654936Z @llvm-project//mlir:LinalgTransforms; 58s local 2025-03-14T06:44:34.8655767Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 24s local 2025-03-14T06:44:34.8656554Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:44:34.8657374Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:34.8658121Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 19s local 2025-03-14T06:44:34.8658922Z Compiling xla/pjrt/pjrt_client.cc; 19s local 2025-03-14T06:44:34.8659565Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:34.8660324Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 17s local ... 2025-03-14T06:44:35.7612878Z 2025-03-14T06:44:35.7613763Z  2025-03-14T06:44:35.7614249Z  2025-03-14T06:44:35.7614635Z  2025-03-14T06:44:35.7615008Z  2025-03-14T06:44:35.7615386Z  2025-03-14T06:44:35.7615782Z  2025-03-14T06:44:35.7616184Z  2025-03-14T06:44:35.7616558Z  2025-03-14T06:44:35.7617451Z [19,978 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:35.7618346Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T06:44:35.7619241Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 25s local 2025-03-14T06:44:35.7620138Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:35.7620730Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:44:35.7621514Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 20s local 2025-03-14T06:44:35.7622311Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2025-03-14T06:44:35.7622959Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:44:35.7623661Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local ... 2025-03-14T06:44:36.0572698Z 2025-03-14T06:44:36.0573547Z  2025-03-14T06:44:36.0574030Z  2025-03-14T06:44:36.0574448Z  2025-03-14T06:44:36.0574844Z  2025-03-14T06:44:36.0575251Z  2025-03-14T06:44:36.0575644Z  2025-03-14T06:44:36.0576061Z  2025-03-14T06:44:36.0576485Z  2025-03-14T06:44:36.0577427Z [19,979 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:36.0578428Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T06:44:36.0579608Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 25s local 2025-03-14T06:44:36.0580508Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:36.0581182Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:44:36.0581938Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local 2025-03-14T06:44:36.0582709Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2025-03-14T06:44:36.0583374Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:44:36.0584346Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 18s local ... 2025-03-14T06:44:36.2658539Z 2025-03-14T06:44:36.2659425Z  2025-03-14T06:44:36.2659915Z  2025-03-14T06:44:36.2660324Z  2025-03-14T06:44:36.2660714Z  2025-03-14T06:44:36.2661093Z  2025-03-14T06:44:36.2661519Z  2025-03-14T06:44:36.2661920Z  2025-03-14T06:44:36.2662326Z  2025-03-14T06:44:36.2663219Z [19,979 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:36.2664149Z @llvm-project//mlir:LinalgTransforms; 59s local 2025-03-14T06:44:36.2665102Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 25s local 2025-03-14T06:44:36.2666153Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:36.2666760Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:44:36.2667506Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local 2025-03-14T06:44:36.2668627Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2025-03-14T06:44:36.2669337Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:44:36.2670096Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local ... 2025-03-14T06:44:36.7372684Z 2025-03-14T06:44:36.7373532Z  2025-03-14T06:44:36.7373980Z  2025-03-14T06:44:36.7374330Z  2025-03-14T06:44:36.7374710Z  2025-03-14T06:44:36.7375062Z  2025-03-14T06:44:36.7375731Z  2025-03-14T06:44:36.7376086Z  2025-03-14T06:44:36.7376439Z  2025-03-14T06:44:36.7377272Z [19,980 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:36.7378128Z @llvm-project//mlir:LinalgTransforms; 60s local 2025-03-14T06:44:36.7379010Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 26s local 2025-03-14T06:44:36.7379859Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:36.7380446Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:44:36.7381163Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 21s local 2025-03-14T06:44:36.7381892Z Compiling xla/pjrt/pjrt_client.cc; 21s local 2025-03-14T06:44:36.7382518Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:44:36.7383252Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local ... 2025-03-14T06:44:37.0664775Z 2025-03-14T06:44:37.0665784Z  2025-03-14T06:44:37.0666240Z  2025-03-14T06:44:37.0666641Z  2025-03-14T06:44:37.0667029Z  2025-03-14T06:44:37.0667400Z  2025-03-14T06:44:37.0667750Z  2025-03-14T06:44:37.0668116Z  2025-03-14T06:44:37.0668468Z  2025-03-14T06:44:37.0669371Z [19,980 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:37.0670278Z @llvm-project//mlir:LinalgTransforms; 60s local 2025-03-14T06:44:37.0671146Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 26s local 2025-03-14T06:44:37.0671971Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:37.0672542Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:37.0673264Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2025-03-14T06:44:37.0673997Z Compiling xla/pjrt/pjrt_client.cc; 21s local 2025-03-14T06:44:37.0674618Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:44:37.0675328Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 19s local ... 2025-03-14T06:44:37.4668789Z 2025-03-14T06:44:37.4669623Z  2025-03-14T06:44:37.4670347Z  2025-03-14T06:44:37.4670729Z  2025-03-14T06:44:37.4671094Z  2025-03-14T06:44:37.4671453Z  2025-03-14T06:44:37.4671810Z  2025-03-14T06:44:37.4672161Z  2025-03-14T06:44:37.4672521Z  2025-03-14T06:44:37.4673404Z [19,981 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:37.4674315Z @llvm-project//mlir:LinalgTransforms; 60s local 2025-03-14T06:44:37.4675367Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 26s local 2025-03-14T06:44:37.4676178Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:44:37.4676738Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:37.4677427Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2025-03-14T06:44:37.4678173Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2025-03-14T06:44:37.4678812Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:44:37.4679569Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local ... 2025-03-14T06:44:37.6848043Z 2025-03-14T06:44:37.6848836Z  2025-03-14T06:44:37.6849287Z  2025-03-14T06:44:37.6849643Z  2025-03-14T06:44:37.6850002Z  2025-03-14T06:44:37.6850349Z  2025-03-14T06:44:37.6850704Z  2025-03-14T06:44:37.6851050Z  2025-03-14T06:44:37.6851414Z  2025-03-14T06:44:37.6852251Z [19,982 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:37.6853381Z @llvm-project//mlir:LinalgTransforms; 61s local 2025-03-14T06:44:37.6854221Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T06:44:37.6855004Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:44:37.6855543Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:37.6856223Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2025-03-14T06:44:37.6857140Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2025-03-14T06:44:37.6857762Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:44:37.6858452Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local ... 2025-03-14T06:44:37.9674385Z 2025-03-14T06:44:37.9675231Z  2025-03-14T06:44:37.9675648Z  2025-03-14T06:44:37.9676019Z  2025-03-14T06:44:37.9676351Z  2025-03-14T06:44:37.9676693Z  2025-03-14T06:44:37.9677021Z  2025-03-14T06:44:37.9677389Z  2025-03-14T06:44:37.9677741Z  2025-03-14T06:44:37.9678536Z [19,985 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:37.9679358Z @llvm-project//mlir:LinalgTransforms; 61s local 2025-03-14T06:44:37.9680172Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T06:44:37.9680972Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:44:37.9681514Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:37.9682206Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 22s local 2025-03-14T06:44:37.9682906Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2025-03-14T06:44:37.9683493Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:44:37.9684177Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local ... 2025-03-14T06:44:38.2675135Z 2025-03-14T06:44:38.2675922Z  2025-03-14T06:44:38.2676316Z  2025-03-14T06:44:38.2676677Z  2025-03-14T06:44:38.2677033Z  2025-03-14T06:44:38.2677382Z  2025-03-14T06:44:38.2677698Z  2025-03-14T06:44:38.2678042Z  2025-03-14T06:44:38.2678354Z  2025-03-14T06:44:38.2679248Z [19,989 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:38.2680038Z @llvm-project//mlir:LinalgTransforms; 61s local 2025-03-14T06:44:38.2680804Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 27s local 2025-03-14T06:44:38.2681838Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:44:38.2682354Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:38.2682982Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 23s local 2025-03-14T06:44:38.2683632Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2025-03-14T06:44:38.2684203Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:44:38.2684975Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local ... 2025-03-14T06:44:38.6414335Z 2025-03-14T06:44:38.6415117Z  2025-03-14T06:44:38.6415510Z  2025-03-14T06:44:38.6416128Z  2025-03-14T06:44:38.6416445Z  2025-03-14T06:44:38.6416798Z  2025-03-14T06:44:38.6417107Z  2025-03-14T06:44:38.6417451Z  2025-03-14T06:44:38.6417761Z  2025-03-14T06:44:38.6418521Z [19,990 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:38.6419296Z @llvm-project//mlir:LinalgTransforms; 62s local 2025-03-14T06:44:38.6420085Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 28s local 2025-03-14T06:44:38.6420813Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:44:38.6421324Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:38.6421930Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 23s local 2025-03-14T06:44:38.6422580Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:44:38.6423197Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T06:44:38.6424183Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local ... 2025-03-14T06:44:38.8680113Z 2025-03-14T06:44:38.8680973Z  2025-03-14T06:44:38.8681449Z  2025-03-14T06:44:38.8681825Z  2025-03-14T06:44:38.8682215Z  2025-03-14T06:44:38.8682615Z  2025-03-14T06:44:38.8682987Z  2025-03-14T06:44:38.8683361Z  2025-03-14T06:44:38.8683758Z  2025-03-14T06:44:38.8685177Z [19,990 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:38.8686164Z @llvm-project//mlir:LinalgTransforms; 62s local 2025-03-14T06:44:38.8687048Z Compiling mlir/lib/Dialect/Linalg/Transforms/DropUnitDims.cpp; 28s local 2025-03-14T06:44:38.8687930Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:44:38.8688522Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:38.8689253Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 23s local 2025-03-14T06:44:38.8690063Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:44:38.8690831Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T06:44:38.8691777Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local ... 2025-03-14T06:44:39.0682106Z 2025-03-14T06:44:39.0682898Z  2025-03-14T06:44:39.0683298Z  2025-03-14T06:44:39.0683656Z  2025-03-14T06:44:39.0683948Z  2025-03-14T06:44:39.0684442Z  2025-03-14T06:44:39.0684906Z  2025-03-14T06:44:39.0685241Z  2025-03-14T06:44:39.0685660Z  2025-03-14T06:44:39.0686625Z [19,991 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:39.0687573Z @llvm-project//mlir:LinalgTransforms; 62s local 2025-03-14T06:44:39.0688185Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:44:39.0688704Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:44:39.0689367Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 24s local 2025-03-14T06:44:39.0690123Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:44:39.0690768Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T06:44:39.0691585Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 21s local 2025-03-14T06:44:39.0692507Z Compiling xla/service/service.cc; 18s local ... 2025-03-14T06:44:39.7766009Z 2025-03-14T06:44:39.7766833Z  2025-03-14T06:44:39.7767307Z  2025-03-14T06:44:39.7767649Z  2025-03-14T06:44:39.7768280Z  2025-03-14T06:44:39.7768648Z  2025-03-14T06:44:39.7768990Z  2025-03-14T06:44:39.7769345Z  2025-03-14T06:44:39.7769685Z  2025-03-14T06:44:39.7770502Z [19,992 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:39.7771353Z @llvm-project//mlir:LinalgTransforms; 63s local 2025-03-14T06:44:39.7771976Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T06:44:39.7772548Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:44:39.7773384Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 24s local 2025-03-14T06:44:39.7774111Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:44:39.7774761Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2025-03-14T06:44:39.7775606Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 22s local 2025-03-14T06:44:39.7776412Z Compiling xla/service/service.cc; 19s local ... 2025-03-14T06:44:40.0690392Z 2025-03-14T06:44:40.0691300Z  2025-03-14T06:44:40.0691801Z  2025-03-14T06:44:40.0692209Z  2025-03-14T06:44:40.0692608Z  2025-03-14T06:44:40.0693003Z  2025-03-14T06:44:40.0693391Z  2025-03-14T06:44:40.0693787Z  2025-03-14T06:44:40.0694183Z  2025-03-14T06:44:40.0695112Z [19,993 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:40.0696446Z @llvm-project//mlir:LinalgTransforms; 63s local 2025-03-14T06:44:40.0697156Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T06:44:40.0697791Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:44:40.0698563Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local 2025-03-14T06:44:40.0699399Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:44:40.0700154Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2025-03-14T06:44:40.0701318Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 22s local 2025-03-14T06:44:40.0702346Z Compiling xla/service/service.cc; 19s local ... 2025-03-14T06:44:40.7456150Z 2025-03-14T06:44:40.7456954Z  2025-03-14T06:44:40.7457420Z  2025-03-14T06:44:40.7457807Z  2025-03-14T06:44:40.7458181Z  2025-03-14T06:44:40.7458560Z  2025-03-14T06:44:40.7458923Z  2025-03-14T06:44:40.7459294Z  2025-03-14T06:44:40.7459643Z  2025-03-14T06:44:40.7460467Z [19,994 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:40.7461369Z @llvm-project//mlir:LinalgTransforms; 64s local 2025-03-14T06:44:40.7462018Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:44:40.7462627Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:44:40.7463394Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 25s local 2025-03-14T06:44:40.7464180Z @llvm-project//mlir:LinalgTransforms; 24s local 2025-03-14T06:44:40.7464923Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2025-03-14T06:44:40.7465963Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local 2025-03-14T06:44:40.7466948Z Compiling xla/service/service.cc; 20s local ... 2025-03-14T06:44:41.0697403Z 2025-03-14T06:44:41.0698299Z  2025-03-14T06:44:41.0698751Z  2025-03-14T06:44:41.0699163Z  2025-03-14T06:44:41.0699574Z  2025-03-14T06:44:41.0699972Z  2025-03-14T06:44:41.0700420Z  2025-03-14T06:44:41.0700811Z  2025-03-14T06:44:41.0701222Z  2025-03-14T06:44:41.0702180Z [19,995 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:41.0703112Z @llvm-project//mlir:LinalgTransforms; 64s local 2025-03-14T06:44:41.0703711Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:44:41.0704319Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T06:44:41.0705056Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local 2025-03-14T06:44:41.0706099Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:44:41.0706838Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2025-03-14T06:44:41.0707731Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local 2025-03-14T06:44:41.0718168Z Compiling xla/service/service.cc; 20s local ... 2025-03-14T06:44:41.6827848Z 2025-03-14T06:44:41.6828661Z  2025-03-14T06:44:41.6829161Z  2025-03-14T06:44:41.6829631Z  2025-03-14T06:44:41.6830044Z  2025-03-14T06:44:41.6830459Z  2025-03-14T06:44:41.6831132Z  2025-03-14T06:44:41.6831564Z  2025-03-14T06:44:41.6831995Z  2025-03-14T06:44:41.6833107Z [19,996 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:41.6834027Z @llvm-project//mlir:LinalgTransforms; 65s local 2025-03-14T06:44:41.6834673Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:44:41.6835301Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T06:44:41.6836071Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 26s local 2025-03-14T06:44:41.6836908Z @llvm-project//mlir:LinalgTransforms; 25s local 2025-03-14T06:44:41.6837647Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2025-03-14T06:44:41.6838592Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2025-03-14T06:44:41.6839511Z Compiling xla/service/service.cc; 21s local ... 2025-03-14T06:44:42.0664101Z 2025-03-14T06:44:42.0665014Z  2025-03-14T06:44:42.0665743Z  2025-03-14T06:44:42.0666200Z  2025-03-14T06:44:42.0666599Z  2025-03-14T06:44:42.0666987Z  2025-03-14T06:44:42.0667394Z  2025-03-14T06:44:42.0667777Z  2025-03-14T06:44:42.0668203Z  2025-03-14T06:44:42.0669149Z [19,997 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:42.0670422Z @llvm-project//mlir:LinalgTransforms; 65s local 2025-03-14T06:44:42.0671131Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:44:42.0671785Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:44:42.0672589Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local 2025-03-14T06:44:42.0673482Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:44:42.0674270Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2025-03-14T06:44:42.0675284Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2025-03-14T06:44:42.0676429Z Compiling xla/service/service.cc; 21s local ... 2025-03-14T06:44:42.2704495Z 2025-03-14T06:44:42.2705262Z  2025-03-14T06:44:42.2705730Z  2025-03-14T06:44:42.2706111Z  2025-03-14T06:44:42.2706524Z  2025-03-14T06:44:42.2706879Z  2025-03-14T06:44:42.2707205Z  2025-03-14T06:44:42.2707533Z  2025-03-14T06:44:42.2707907Z  2025-03-14T06:44:42.2708813Z [19,998 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:42.2709779Z @llvm-project//mlir:LinalgTransforms; 65s local 2025-03-14T06:44:42.2710494Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:44:42.2711143Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:44:42.2711804Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local 2025-03-14T06:44:42.2712589Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:44:42.2713321Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 25s local 2025-03-14T06:44:42.2714147Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2025-03-14T06:44:42.2715070Z Compiling xla/service/service.cc; 21s local ... 2025-03-14T06:44:42.5521695Z 2025-03-14T06:44:42.5522655Z  2025-03-14T06:44:42.5523185Z  2025-03-14T06:44:42.5523587Z  2025-03-14T06:44:42.5524032Z  2025-03-14T06:44:42.5524477Z  2025-03-14T06:44:42.5525055Z  2025-03-14T06:44:42.5525482Z  2025-03-14T06:44:42.5525906Z  2025-03-14T06:44:42.5527086Z [20,001 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:42.5528078Z @llvm-project//mlir:LinalgTransforms; 65s local 2025-03-14T06:44:42.5528706Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:44:42.5529194Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:44:42.5529924Z Compiling torch_xla/csrc/runtime/stablehlo_helper.cc; 27s local 2025-03-14T06:44:42.5530727Z @llvm-project//mlir:LinalgTransforms; 26s local 2025-03-14T06:44:42.5531799Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local 2025-03-14T06:44:42.5532629Z Compiling xla/service/service.cc; 22s local 2025-03-14T06:44:42.5533302Z Compiling xla/pjrt/pjrt_api.cc; 20s local ... 2025-03-14T06:44:42.7748024Z 2025-03-14T06:44:42.7748869Z  2025-03-14T06:44:42.7749310Z  2025-03-14T06:44:42.7749711Z  2025-03-14T06:44:42.7750082Z  2025-03-14T06:44:42.7750434Z  2025-03-14T06:44:42.7750814Z  2025-03-14T06:44:42.7751163Z  2025-03-14T06:44:42.7751536Z  2025-03-14T06:44:42.7752362Z [20,004 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:42.7753234Z @llvm-project//mlir:LinalgTransforms; 66s local 2025-03-14T06:44:42.7753865Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:44:42.7754433Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:44:42.7755494Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:44:42.7756322Z Compiling xla/service/service.cc; 22s local 2025-03-14T06:44:42.7756921Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T06:44:42.7757564Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 20s local 2025-03-14T06:44:42.7758352Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local ... 2025-03-14T06:44:43.0663509Z 2025-03-14T06:44:43.0664294Z  2025-03-14T06:44:43.0664735Z  2025-03-14T06:44:43.0665130Z  2025-03-14T06:44:43.0665666Z  2025-03-14T06:44:43.0666015Z  2025-03-14T06:44:43.0666371Z  2025-03-14T06:44:43.0666743Z  2025-03-14T06:44:43.0667119Z  2025-03-14T06:44:43.0668008Z [20,006 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:43.0669016Z @llvm-project//mlir:LinalgTransforms; 66s local 2025-03-14T06:44:43.0669766Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:44:43.0670401Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:44:43.0671264Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:44:43.0672109Z Compiling xla/service/service.cc; 22s local 2025-03-14T06:44:43.0672780Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T06:44:43.0673552Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T06:44:43.0674446Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local ... 2025-03-14T06:44:43.2711561Z 2025-03-14T06:44:43.2712426Z  2025-03-14T06:44:43.2712882Z  2025-03-14T06:44:43.2713247Z  2025-03-14T06:44:43.2713649Z  2025-03-14T06:44:43.2714015Z  2025-03-14T06:44:43.2714388Z  2025-03-14T06:44:43.2714739Z  2025-03-14T06:44:43.2715119Z  2025-03-14T06:44:43.2716005Z [20,006 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:43.2716975Z @llvm-project//mlir:LinalgTransforms; 66s local 2025-03-14T06:44:43.2717646Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:44:43.2718278Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:44:43.2719163Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:44:43.2720086Z Compiling xla/service/service.cc; 22s local 2025-03-14T06:44:43.2720741Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T06:44:43.2721757Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T06:44:43.2722567Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local ... 2025-03-14T06:44:43.4716118Z 2025-03-14T06:44:43.4717006Z  2025-03-14T06:44:43.4717502Z  2025-03-14T06:44:43.4717946Z  2025-03-14T06:44:43.4718368Z  2025-03-14T06:44:43.4718804Z  2025-03-14T06:44:43.4719233Z  2025-03-14T06:44:43.4719652Z  2025-03-14T06:44:43.4720074Z  2025-03-14T06:44:43.4721603Z [20,007 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:43.4722611Z @llvm-project//mlir:LinalgTransforms; 66s local 2025-03-14T06:44:43.4723357Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:44:43.4724006Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:44:43.4725031Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:44:43.4725991Z Compiling xla/service/service.cc; 23s local 2025-03-14T06:44:43.4726695Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T06:44:43.4727439Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T06:44:43.4728338Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local ... 2025-03-14T06:44:43.8719302Z 2025-03-14T06:44:43.8720122Z  2025-03-14T06:44:43.8720623Z  2025-03-14T06:44:43.8721027Z  2025-03-14T06:44:43.8721424Z  2025-03-14T06:44:43.8721806Z  2025-03-14T06:44:43.8722536Z  2025-03-14T06:44:43.8722935Z  2025-03-14T06:44:43.8723318Z  2025-03-14T06:44:43.8724263Z [20,008 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:43.8725404Z @llvm-project//mlir:LinalgTransforms; 67s local 2025-03-14T06:44:43.8726075Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:44:43.8726702Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:44:43.8727830Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:44:43.8728756Z Compiling xla/service/service.cc; 23s local 2025-03-14T06:44:43.8729414Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2025-03-14T06:44:43.8730126Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 21s local 2025-03-14T06:44:43.8730999Z Compiling xla/pjrt/distributed/topology_util.cc; 19s local ... 2025-03-14T06:44:44.4068755Z 2025-03-14T06:44:44.4069658Z  2025-03-14T06:44:44.4070153Z  2025-03-14T06:44:44.4070579Z  2025-03-14T06:44:44.4070979Z  2025-03-14T06:44:44.4071368Z  2025-03-14T06:44:44.4071796Z  2025-03-14T06:44:44.4072183Z  2025-03-14T06:44:44.4072551Z  2025-03-14T06:44:44.4073593Z [20,009 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:44.4074627Z @llvm-project//mlir:LinalgTransforms; 67s local 2025-03-14T06:44:44.4075281Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:44:44.4076044Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:44:44.4076957Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:44:44.4077845Z Compiling xla/service/service.cc; 24s local 2025-03-14T06:44:44.4078570Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2025-03-14T06:44:44.4079429Z Compiling xla/pjrt/distributed/topology_util.cc; 19s local 2025-03-14T06:44:44.4080213Z Compiling xla/pjrt/pjrt_api.cc; 18s local ... 2025-03-14T06:44:44.6726168Z 2025-03-14T06:44:44.6727010Z  2025-03-14T06:44:44.6727545Z  2025-03-14T06:44:44.6728028Z  2025-03-14T06:44:44.6728406Z  2025-03-14T06:44:44.6728781Z  2025-03-14T06:44:44.6729161Z  2025-03-14T06:44:44.6729563Z  2025-03-14T06:44:44.6729978Z  2025-03-14T06:44:44.6730871Z [20,009 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:44.6731835Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T06:44:44.6732835Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:44:44.6733457Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:44:44.6734361Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:44:44.6735247Z Compiling xla/service/service.cc; 24s local 2025-03-14T06:44:44.6736072Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 22s local 2025-03-14T06:44:44.6736912Z Compiling xla/pjrt/distributed/topology_util.cc; 19s local 2025-03-14T06:44:44.6737982Z Compiling xla/pjrt/pjrt_api.cc; 18s local ... 2025-03-14T06:44:45.4638561Z 2025-03-14T06:44:45.4639412Z  2025-03-14T06:44:45.4639871Z  2025-03-14T06:44:45.4640262Z  2025-03-14T06:44:45.4640642Z  2025-03-14T06:44:45.4641035Z  2025-03-14T06:44:45.4641394Z  2025-03-14T06:44:45.4641771Z  2025-03-14T06:44:45.4642156Z  2025-03-14T06:44:45.4643088Z [20,010 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:45.4644044Z @llvm-project//mlir:LinalgTransforms; 68s local 2025-03-14T06:44:45.4644877Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:44:45.4645468Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:44:45.4646302Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:44:45.4647213Z Compiling xla/service/service.cc; 25s local 2025-03-14T06:44:45.4648192Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2025-03-14T06:44:45.4649010Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2025-03-14T06:44:45.4649778Z Compiling xla/pjrt/pjrt_api.cc; 19s local ... 2025-03-14T06:44:45.6733146Z 2025-03-14T06:44:45.6733957Z  2025-03-14T06:44:45.6734438Z  2025-03-14T06:44:45.6734841Z  2025-03-14T06:44:45.6735246Z  2025-03-14T06:44:45.6735654Z  2025-03-14T06:44:45.6736053Z  2025-03-14T06:44:45.6736747Z  2025-03-14T06:44:45.6737155Z  2025-03-14T06:44:45.6738112Z [20,010 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:45.6739093Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T06:44:45.6739791Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:44:45.6740450Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:44:45.6741344Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:44:45.6742269Z Compiling xla/service/service.cc; 25s local 2025-03-14T06:44:45.6743018Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 23s local 2025-03-14T06:44:45.6743863Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2025-03-14T06:44:45.6744650Z Compiling xla/pjrt/pjrt_api.cc; 19s local ... 2025-03-14T06:44:45.9790572Z 2025-03-14T06:44:45.9791399Z  2025-03-14T06:44:45.9791871Z  2025-03-14T06:44:45.9792227Z  2025-03-14T06:44:45.9792647Z  2025-03-14T06:44:45.9793040Z  2025-03-14T06:44:45.9793436Z  2025-03-14T06:44:45.9793842Z  2025-03-14T06:44:45.9794241Z  2025-03-14T06:44:45.9795163Z [20,012 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:45.9796124Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T06:44:45.9796817Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:44:45.9797448Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:44:45.9798342Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:44:45.9799271Z Compiling xla/service/service.cc; 25s local 2025-03-14T06:44:45.9800024Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2025-03-14T06:44:45.9800893Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2025-03-14T06:44:45.9801730Z Compiling xla/pjrt/pjrt_api.cc; 19s local ... 2025-03-14T06:44:46.2738617Z 2025-03-14T06:44:46.2739529Z  2025-03-14T06:44:46.2740009Z  2025-03-14T06:44:46.2740736Z  2025-03-14T06:44:46.2741156Z  2025-03-14T06:44:46.2741561Z  2025-03-14T06:44:46.2741979Z  2025-03-14T06:44:46.2742368Z  2025-03-14T06:44:46.2742760Z  2025-03-14T06:44:46.2743707Z [20,013 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:46.2744682Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T06:44:46.2745420Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:44:46.2746248Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:44:46.2747169Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:44:46.2748087Z Compiling xla/service/service.cc; 25s local 2025-03-14T06:44:46.2748781Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2025-03-14T06:44:46.2749579Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2025-03-14T06:44:46.2750352Z Compiling xla/pjrt/pjrt_api.cc; 20s local ... 2025-03-14T06:44:46.6033083Z 2025-03-14T06:44:46.6033882Z  2025-03-14T06:44:46.6034351Z  2025-03-14T06:44:46.6034759Z  2025-03-14T06:44:46.6035159Z  2025-03-14T06:44:46.6035558Z  2025-03-14T06:44:46.6035928Z  2025-03-14T06:44:46.6036283Z  2025-03-14T06:44:46.6036666Z  2025-03-14T06:44:46.6037603Z [20,014 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:46.6038984Z @llvm-project//mlir:LinalgTransforms; 69s local 2025-03-14T06:44:46.6039685Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:44:46.6040320Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:44:46.6041201Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:44:46.6042120Z Compiling xla/service/service.cc; 26s local 2025-03-14T06:44:46.6042860Z Compiling xla/pjrt/c/pjrt_c_api_helpers.cc; 24s local 2025-03-14T06:44:46.6043882Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2025-03-14T06:44:46.6044759Z Compiling xla/pjrt/pjrt_api.cc; 20s local ... 2025-03-14T06:44:46.8619460Z 2025-03-14T06:44:46.8620306Z  2025-03-14T06:44:46.8620819Z  2025-03-14T06:44:46.8621248Z  2025-03-14T06:44:46.8621676Z  2025-03-14T06:44:46.8622080Z  2025-03-14T06:44:46.8622493Z  2025-03-14T06:44:46.8622912Z  2025-03-14T06:44:46.8623316Z  2025-03-14T06:44:46.8624318Z [20,015 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:46.8625317Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T06:44:46.8625986Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:44:46.8626628Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:44:46.8627517Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:44:46.8628542Z Compiling xla/service/service.cc; 26s local 2025-03-14T06:44:46.8629305Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2025-03-14T06:44:46.8629937Z Compiling xla/pjrt/pjrt_api.cc; 20s local 2025-03-14T06:44:46.8630619Z Compiling xla/service/local_service_utils.cc; 16s local ... 2025-03-14T06:44:47.0745024Z 2025-03-14T06:44:47.0745922Z  2025-03-14T06:44:47.0746424Z  2025-03-14T06:44:47.0746836Z  2025-03-14T06:44:47.0747230Z  2025-03-14T06:44:47.0747624Z  2025-03-14T06:44:47.0748055Z  2025-03-14T06:44:47.0748457Z  2025-03-14T06:44:47.0748866Z  2025-03-14T06:44:47.0749938Z [20,015 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:47.0750931Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T06:44:47.0751614Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:44:47.0752257Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:44:47.0753153Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:44:47.0754345Z Compiling xla/service/service.cc; 26s local 2025-03-14T06:44:47.0755165Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2025-03-14T06:44:47.0755933Z Compiling xla/pjrt/pjrt_api.cc; 20s local 2025-03-14T06:44:47.0756721Z Compiling xla/service/local_service_utils.cc; 16s local ... 2025-03-14T06:44:47.3137369Z 2025-03-14T06:44:47.3138207Z  2025-03-14T06:44:47.3138695Z  2025-03-14T06:44:47.3139137Z  2025-03-14T06:44:47.3139549Z  2025-03-14T06:44:47.3139910Z  2025-03-14T06:44:47.3140620Z  2025-03-14T06:44:47.3141033Z  2025-03-14T06:44:47.3141427Z  2025-03-14T06:44:47.3142363Z [20,016 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:47.3143321Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T06:44:47.3144012Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:44:47.3144639Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:44:47.3145525Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:44:47.3146442Z Compiling xla/service/service.cc; 27s local 2025-03-14T06:44:47.3147231Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2025-03-14T06:44:47.3148022Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T06:44:47.3148691Z Compiling xla/pjrt/distributed/topology_util.cc; 15s local ... 2025-03-14T06:44:47.5804531Z 2025-03-14T06:44:47.5805474Z  2025-03-14T06:44:47.5805909Z  2025-03-14T06:44:47.5806318Z  2025-03-14T06:44:47.5806713Z  2025-03-14T06:44:47.5807125Z  2025-03-14T06:44:47.5807483Z  2025-03-14T06:44:47.5807861Z  2025-03-14T06:44:47.5808230Z  2025-03-14T06:44:47.5809135Z [20,020 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:47.5810300Z @llvm-project//mlir:LinalgTransforms; 70s local 2025-03-14T06:44:47.5810944Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:44:47.5811551Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:44:47.5812403Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:44:47.5813284Z Compiling xla/service/service.cc; 27s local 2025-03-14T06:44:47.5813998Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2025-03-14T06:44:47.5814712Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T06:44:47.5815464Z Compiling xla/pjrt/distributed/topology_util.cc; 15s local ... 2025-03-14T06:44:47.8533121Z 2025-03-14T06:44:47.8533953Z  2025-03-14T06:44:47.8534393Z  2025-03-14T06:44:47.8534749Z  2025-03-14T06:44:47.8535131Z  2025-03-14T06:44:47.8535473Z  2025-03-14T06:44:47.8535820Z  2025-03-14T06:44:47.8536154Z  2025-03-14T06:44:47.8536512Z  2025-03-14T06:44:47.8537351Z [20,021 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:47.8538190Z @llvm-project//mlir:LinalgTransforms; 71s local 2025-03-14T06:44:47.8538783Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:44:47.8539328Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:44:47.8540103Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:44:47.8540909Z Compiling xla/service/service.cc; 27s local 2025-03-14T06:44:47.8541596Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2025-03-14T06:44:47.8542294Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T06:44:47.8542999Z Compiling xla/pjrt/distributed/topology_util.cc; 16s local ... 2025-03-14T06:44:48.0752216Z 2025-03-14T06:44:48.0753054Z  2025-03-14T06:44:48.0753557Z  2025-03-14T06:44:48.0753943Z  2025-03-14T06:44:48.0754344Z  2025-03-14T06:44:48.0754711Z  2025-03-14T06:44:48.0755105Z  2025-03-14T06:44:48.0755502Z  2025-03-14T06:44:48.0755891Z  2025-03-14T06:44:48.0757149Z [20,021 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:48.0758173Z @llvm-project//mlir:LinalgTransforms; 71s local 2025-03-14T06:44:48.0758849Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:44:48.0759471Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:44:48.0760341Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:44:48.0761284Z Compiling xla/service/service.cc; 27s local 2025-03-14T06:44:48.0762248Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2025-03-14T06:44:48.0763039Z Compiling xla/pjrt/pjrt_api.cc; 21s local 2025-03-14T06:44:48.0763658Z Compiling xla/pjrt/distributed/topology_util.cc; 16s local ... 2025-03-14T06:44:48.5762348Z 2025-03-14T06:44:48.5763219Z  2025-03-14T06:44:48.5763718Z  2025-03-14T06:44:48.5764115Z  2025-03-14T06:44:48.5764690Z  2025-03-14T06:44:48.5765098Z  2025-03-14T06:44:48.5765663Z  2025-03-14T06:44:48.5766007Z  2025-03-14T06:44:48.5766380Z  2025-03-14T06:44:48.5767270Z [20,022 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:48.5768233Z @llvm-project//mlir:LinalgTransforms; 71s local 2025-03-14T06:44:48.5768883Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:44:48.5769526Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:44:48.5770688Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:44:48.5771602Z Compiling xla/service/service.cc; 28s local 2025-03-14T06:44:48.5772334Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2025-03-14T06:44:48.5773094Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2025-03-14T06:44:48.5773896Z Compiling xla/pjrt/distributed/topology_util.cc; 16s local ... 2025-03-14T06:44:48.8758483Z 2025-03-14T06:44:48.8759343Z  2025-03-14T06:44:48.8759826Z  2025-03-14T06:44:48.8760256Z  2025-03-14T06:44:48.8760655Z  2025-03-14T06:44:48.8761037Z  2025-03-14T06:44:48.8761405Z  2025-03-14T06:44:48.8761776Z  2025-03-14T06:44:48.8762145Z  2025-03-14T06:44:48.8763060Z [20,023 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:48.8763999Z @llvm-project//mlir:LinalgTransforms; 72s local 2025-03-14T06:44:48.8764822Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:44:48.8765617Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:44:48.8766484Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:44:48.8767383Z Compiling xla/service/service.cc; 28s local 2025-03-14T06:44:48.8767991Z Compiling xla/pjrt/pjrt_api.cc; 22s local 2025-03-14T06:44:48.8768746Z Compiling xla/pjrt/distributed/topology_util.cc; 17s local 2025-03-14T06:44:48.8769672Z Compiling xla/service/compile_only_service.cc; 16s local ... 2025-03-14T06:44:49.1243846Z 2025-03-14T06:44:49.1244876Z  2025-03-14T06:44:49.1245382Z  2025-03-14T06:44:49.1245738Z  2025-03-14T06:44:49.1246137Z  2025-03-14T06:44:49.1246489Z  2025-03-14T06:44:49.1246860Z  2025-03-14T06:44:49.1247248Z  2025-03-14T06:44:49.1247637Z  2025-03-14T06:44:49.1248540Z [20,024 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:49.1249474Z @llvm-project//mlir:LinalgTransforms; 72s local 2025-03-14T06:44:49.1250127Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:44:49.1250753Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:44:49.1251615Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:44:49.1252498Z Compiling xla/service/service.cc; 28s local 2025-03-14T06:44:49.1253165Z Compiling xla/pjrt/pjrt_api.cc; 23s local 2025-03-14T06:44:49.1254208Z Compiling xla/pjrt/distributed/topology_util.cc; 17s local 2025-03-14T06:44:49.1255137Z Compiling xla/service/compile_only_service.cc; 16s local ... 2025-03-14T06:44:49.3540096Z 2025-03-14T06:44:49.3540953Z  2025-03-14T06:44:49.3541388Z  2025-03-14T06:44:49.3541780Z  2025-03-14T06:44:49.3542152Z  2025-03-14T06:44:49.3542540Z  2025-03-14T06:44:49.3542863Z  2025-03-14T06:44:49.3543239Z  2025-03-14T06:44:49.3543609Z  2025-03-14T06:44:49.3544852Z [20,026 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:49.3545863Z @llvm-project//mlir:LinalgTransforms; 72s local 2025-03-14T06:44:49.3546554Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:44:49.3547198Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:44:49.3548022Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:44:49.3548970Z Compiling xla/service/service.cc; 29s local 2025-03-14T06:44:49.3549785Z Compiling xla/pjrt/distributed/topology_util.cc; 17s local 2025-03-14T06:44:49.3550652Z Compiling xla/service/compile_only_service.cc; 16s local 2025-03-14T06:44:49.3551397Z @xla//xla/mlir_hlo:mhlo_passes; 15s local ... 2025-03-14T06:44:49.6275380Z 2025-03-14T06:44:49.6276225Z  2025-03-14T06:44:49.6276731Z  2025-03-14T06:44:49.6277178Z  2025-03-14T06:44:49.6277584Z  2025-03-14T06:44:49.6278280Z  2025-03-14T06:44:49.6278657Z  2025-03-14T06:44:49.6279016Z  2025-03-14T06:44:49.6279380Z  2025-03-14T06:44:49.6280163Z [20,027 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:49.6281199Z @llvm-project//mlir:LinalgTransforms; 72s local 2025-03-14T06:44:49.6281857Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:44:49.6282505Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:44:49.6283643Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:44:49.6284797Z Compiling xla/pjrt/distributed/topology_util.cc; 17s local 2025-03-14T06:44:49.6285676Z Compiling xla/service/compile_only_service.cc; 17s local 2025-03-14T06:44:49.6286360Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:44:49.6287416Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 15s local ... 2025-03-14T06:44:49.8692871Z 2025-03-14T06:44:49.8693751Z  2025-03-14T06:44:49.8694310Z  2025-03-14T06:44:49.8694836Z  2025-03-14T06:44:49.8695239Z  2025-03-14T06:44:49.8695709Z  2025-03-14T06:44:49.8696112Z  2025-03-14T06:44:49.8696531Z  2025-03-14T06:44:49.8696947Z  2025-03-14T06:44:49.8697893Z [20,028 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:49.8698844Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T06:44:49.8699594Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:44:49.8700303Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:44:49.8701154Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:44:49.8702122Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local 2025-03-14T06:44:49.8702956Z Compiling xla/service/compile_only_service.cc; 17s local 2025-03-14T06:44:49.8703673Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:44:49.8704525Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 15s local ... 2025-03-14T06:44:50.0766993Z 2025-03-14T06:44:50.0767872Z  2025-03-14T06:44:50.0768335Z  2025-03-14T06:44:50.0768726Z  2025-03-14T06:44:50.0769120Z  2025-03-14T06:44:50.0769454Z  2025-03-14T06:44:50.0769797Z  2025-03-14T06:44:50.0770166Z  2025-03-14T06:44:50.0770554Z  2025-03-14T06:44:50.0771486Z [20,028 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:50.0772750Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T06:44:50.0773400Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:44:50.0773912Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:44:50.0774719Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:44:50.0775726Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local 2025-03-14T06:44:50.0776608Z Compiling xla/service/compile_only_service.cc; 17s local 2025-03-14T06:44:50.0777386Z @xla//xla/mlir_hlo:mhlo_passes; 15s local 2025-03-14T06:44:50.0778464Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 15s local ... 2025-03-14T06:44:50.4771287Z 2025-03-14T06:44:50.4772095Z  2025-03-14T06:44:50.4772586Z  2025-03-14T06:44:50.4773004Z  2025-03-14T06:44:50.4773406Z  2025-03-14T06:44:50.4773810Z  2025-03-14T06:44:50.4774220Z  2025-03-14T06:44:50.4774599Z  2025-03-14T06:44:50.4775035Z  2025-03-14T06:44:50.4775996Z [20,029 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:50.4776995Z @llvm-project//mlir:LinalgTransforms; 73s local 2025-03-14T06:44:50.4777697Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:44:50.4778348Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:44:50.4779228Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:44:50.4780565Z Compiling xla/pjrt/distributed/topology_util.cc; 18s local 2025-03-14T06:44:50.4781459Z Compiling xla/service/compile_only_service.cc; 17s local 2025-03-14T06:44:50.4782202Z @xla//xla/mlir_hlo:mhlo_passes; 16s local 2025-03-14T06:44:50.4783081Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 16s local ... 2025-03-14T06:44:51.4779094Z 2025-03-14T06:44:51.4779988Z  2025-03-14T06:44:51.4780450Z  2025-03-14T06:44:51.4780963Z  2025-03-14T06:44:51.4781825Z  2025-03-14T06:44:51.4782250Z  2025-03-14T06:44:51.4782623Z  2025-03-14T06:44:51.4782990Z  2025-03-14T06:44:51.4783397Z  2025-03-14T06:44:51.4784321Z [20,029 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:51.4785218Z @llvm-project//mlir:LinalgTransforms; 74s local 2025-03-14T06:44:51.4785870Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2025-03-14T06:44:51.4786509Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:44:51.4787455Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:44:51.4788551Z Compiling xla/pjrt/distributed/topology_util.cc; 19s local 2025-03-14T06:44:51.4789382Z Compiling xla/service/compile_only_service.cc; 18s local 2025-03-14T06:44:51.4790116Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:51.4791017Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 17s local ... 2025-03-14T06:44:51.8779388Z 2025-03-14T06:44:51.8780402Z  2025-03-14T06:44:51.8781010Z  2025-03-14T06:44:51.8781469Z  2025-03-14T06:44:51.8784393Z  2025-03-14T06:44:51.8785656Z  2025-03-14T06:44:51.8786166Z  2025-03-14T06:44:51.8786567Z  2025-03-14T06:44:51.8786993Z  2025-03-14T06:44:51.8787942Z [20,030 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:51.8788796Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T06:44:51.8789491Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2025-03-14T06:44:51.8790161Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:44:51.8790999Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:44:51.8792002Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2025-03-14T06:44:51.8792861Z Compiling xla/service/compile_only_service.cc; 19s local 2025-03-14T06:44:51.8793617Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:51.8794782Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 17s local ... 2025-03-14T06:44:52.2276161Z 2025-03-14T06:44:52.2277029Z  2025-03-14T06:44:52.2277442Z  2025-03-14T06:44:52.2277792Z  2025-03-14T06:44:52.2278147Z  2025-03-14T06:44:52.2278496Z  2025-03-14T06:44:52.2278839Z  2025-03-14T06:44:52.2279180Z  2025-03-14T06:44:52.2279526Z  2025-03-14T06:44:52.2280337Z [20,031 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:52.2281396Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T06:44:52.2281983Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2025-03-14T06:44:52.2282499Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:44:52.2283287Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:44:52.2284183Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2025-03-14T06:44:52.2285101Z Compiling xla/service/compile_only_service.cc; 19s local 2025-03-14T06:44:52.2285799Z @xla//xla/mlir_hlo:mhlo_passes; 17s local 2025-03-14T06:44:52.2286539Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 17s local ... 2025-03-14T06:44:52.4785346Z 2025-03-14T06:44:52.4786151Z  2025-03-14T06:44:52.4786536Z  2025-03-14T06:44:52.4786845Z  2025-03-14T06:44:52.4787154Z  2025-03-14T06:44:52.4787462Z  2025-03-14T06:44:52.4787771Z  2025-03-14T06:44:52.4788342Z  2025-03-14T06:44:52.4788653Z  2025-03-14T06:44:52.4789418Z [20,033 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:52.4790175Z @llvm-project//mlir:LinalgTransforms; 75s local 2025-03-14T06:44:52.4790705Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2025-03-14T06:44:52.4791194Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:44:52.4791863Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:44:52.4792775Z Compiling xla/pjrt/distributed/topology_util.cc; 20s local 2025-03-14T06:44:52.4793419Z Compiling xla/service/compile_only_service.cc; 19s local 2025-03-14T06:44:52.4793986Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:52.4794634Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 18s local ... 2025-03-14T06:44:52.8790198Z 2025-03-14T06:44:52.8791061Z  2025-03-14T06:44:52.8791573Z  2025-03-14T06:44:52.8792027Z  2025-03-14T06:44:52.8792401Z  2025-03-14T06:44:52.8792799Z  2025-03-14T06:44:52.8793200Z  2025-03-14T06:44:52.8793575Z  2025-03-14T06:44:52.8793978Z  2025-03-14T06:44:52.8794936Z [20,036 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:52.8795886Z @llvm-project//mlir:LinalgTransforms; 76s local 2025-03-14T06:44:52.8796446Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2025-03-14T06:44:52.8796929Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:44:52.8797606Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:44:52.8798430Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2025-03-14T06:44:52.8799204Z @xla//xla/mlir_hlo:mhlo_passes; 18s local 2025-03-14T06:44:52.8800002Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 18s local 2025-03-14T06:44:52.8800932Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 15s local ... 2025-03-14T06:44:53.5289876Z 2025-03-14T06:44:53.5290719Z  2025-03-14T06:44:53.5291221Z  2025-03-14T06:44:53.5291607Z  2025-03-14T06:44:53.5291976Z  2025-03-14T06:44:53.5292341Z  2025-03-14T06:44:53.5292709Z  2025-03-14T06:44:53.5293088Z  2025-03-14T06:44:53.5293460Z  2025-03-14T06:44:53.5294364Z [20,037 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:53.5295349Z @llvm-project//mlir:LinalgTransforms; 76s local 2025-03-14T06:44:53.5296253Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T06:44:53.5296898Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2025-03-14T06:44:53.5297803Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:44:53.5298769Z Compiling xla/pjrt/distributed/topology_util.cc; 21s local 2025-03-14T06:44:53.5299539Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:53.5300346Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 19s local 2025-03-14T06:44:53.5301625Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 15s local ... 2025-03-14T06:44:53.8765977Z 2025-03-14T06:44:53.8766830Z  2025-03-14T06:44:53.8767416Z  2025-03-14T06:44:53.8767800Z  2025-03-14T06:44:53.8768208Z  2025-03-14T06:44:53.8768619Z  2025-03-14T06:44:53.8769036Z  2025-03-14T06:44:53.8769427Z  2025-03-14T06:44:53.8769879Z  2025-03-14T06:44:53.8770839Z [20,040 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:53.8771784Z @llvm-project//mlir:LinalgTransforms; 77s local 2025-03-14T06:44:53.8772468Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T06:44:53.8773059Z @xla//xla/mlir_hlo:mhlo_passes; 38s local 2025-03-14T06:44:53.8773920Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:44:53.8774924Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2025-03-14T06:44:53.8776024Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:53.8776845Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 19s local 2025-03-14T06:44:53.8777870Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local ... 2025-03-14T06:44:54.0797743Z 2025-03-14T06:44:54.0798603Z  2025-03-14T06:44:54.0799053Z  2025-03-14T06:44:54.0799400Z  2025-03-14T06:44:54.0800077Z  2025-03-14T06:44:54.0800430Z  2025-03-14T06:44:54.0800796Z  2025-03-14T06:44:54.0801219Z  2025-03-14T06:44:54.0801603Z  2025-03-14T06:44:54.0802448Z [20,041 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:54.0803430Z @llvm-project//mlir:LinalgTransforms; 77s local 2025-03-14T06:44:54.0804072Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T06:44:54.0804856Z @xla//xla/mlir_hlo:mhlo_passes; 39s local 2025-03-14T06:44:54.0805765Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:44:54.0806726Z Compiling xla/pjrt/distributed/topology_util.cc; 22s local 2025-03-14T06:44:54.0807459Z @xla//xla/mlir_hlo:mhlo_passes; 19s local 2025-03-14T06:44:54.0808273Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 19s local 2025-03-14T06:44:54.0809292Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 16s local ... 2025-03-14T06:44:55.0806271Z 2025-03-14T06:44:55.0807146Z  2025-03-14T06:44:55.0807628Z  2025-03-14T06:44:55.0808053Z  2025-03-14T06:44:55.0808449Z  2025-03-14T06:44:55.0808877Z  2025-03-14T06:44:55.0809282Z  2025-03-14T06:44:55.0809659Z  2025-03-14T06:44:55.0810087Z  2025-03-14T06:44:55.0811051Z [20,041 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:55.0811952Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T06:44:55.0812670Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T06:44:55.0813338Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T06:44:55.0814229Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:44:55.0815297Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2025-03-14T06:44:55.0816078Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:44:55.0816937Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 20s local 2025-03-14T06:44:55.0818379Z Compiling mlir/lib/Dialect/Linalg/Transforms/Loops.cpp; 17s local ... 2025-03-14T06:44:55.2893562Z 2025-03-14T06:44:55.2894400Z  2025-03-14T06:44:55.2894847Z  2025-03-14T06:44:55.2895201Z  2025-03-14T06:44:55.2895542Z  2025-03-14T06:44:55.2895883Z  2025-03-14T06:44:55.2896228Z  2025-03-14T06:44:55.2896573Z  2025-03-14T06:44:55.2896899Z  2025-03-14T06:44:55.2897792Z [20,042 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:55.2898980Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T06:44:55.2899655Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T06:44:55.2900268Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T06:44:55.2901150Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:44:55.2907197Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2025-03-14T06:44:55.2908036Z @xla//xla/mlir_hlo:mhlo_passes; 20s local 2025-03-14T06:44:55.2908815Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 20s local 2025-03-14T06:44:55.2909777Z @llvm-project//mlir:LinalgTransforms; 17s local ... 2025-03-14T06:44:55.6078568Z 2025-03-14T06:44:55.6079453Z  2025-03-14T06:44:55.6079958Z  2025-03-14T06:44:55.6080386Z  2025-03-14T06:44:55.6080800Z  2025-03-14T06:44:55.6081215Z  2025-03-14T06:44:55.6081631Z  2025-03-14T06:44:55.6082334Z  2025-03-14T06:44:55.6082712Z  2025-03-14T06:44:55.6083646Z [20,044 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:55.6084756Z @llvm-project//mlir:LinalgTransforms; 78s local 2025-03-14T06:44:55.6085427Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T06:44:55.6086100Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T06:44:55.6086886Z Compiling xla/pjrt/distributed/topology_util.cc; 23s local 2025-03-14T06:44:55.6087885Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:44:55.6088710Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 21s local 2025-03-14T06:44:55.6089522Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:55.6090247Z Compiling xla/pjrt/pjrt_client.cc; 16s local ... 2025-03-14T06:44:55.8565554Z 2025-03-14T06:44:55.8566459Z  2025-03-14T06:44:55.8567030Z  2025-03-14T06:44:55.8567442Z  2025-03-14T06:44:55.8567865Z  2025-03-14T06:44:55.8568261Z  2025-03-14T06:44:55.8568669Z  2025-03-14T06:44:55.8569089Z  2025-03-14T06:44:55.8569466Z  2025-03-14T06:44:55.8570395Z [20,045 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:55.8571361Z @llvm-project//mlir:LinalgTransforms; 79s local 2025-03-14T06:44:55.8572035Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T06:44:55.8572681Z @xla//xla/mlir_hlo:mhlo_passes; 40s local 2025-03-14T06:44:55.8573332Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:44:55.8574151Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 21s local 2025-03-14T06:44:55.8575047Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:55.8575766Z Compiling xla/pjrt/pjrt_client.cc; 17s local 2025-03-14T06:44:55.8576436Z @stablehlo//:stablehlo_passes; 15s local ... 2025-03-14T06:44:56.0813106Z 2025-03-14T06:44:56.0813969Z  2025-03-14T06:44:56.0814507Z  2025-03-14T06:44:56.0814912Z  2025-03-14T06:44:56.0815297Z  2025-03-14T06:44:56.0815688Z  2025-03-14T06:44:56.0816087Z  2025-03-14T06:44:56.0816457Z  2025-03-14T06:44:56.0816818Z  2025-03-14T06:44:56.0817739Z [20,046 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:56.0818676Z @llvm-project//mlir:LinalgTransforms; 79s local 2025-03-14T06:44:56.0819344Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T06:44:56.0820290Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T06:44:56.0820938Z @xla//xla/mlir_hlo:mhlo_passes; 21s local 2025-03-14T06:44:56.0821892Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 21s local 2025-03-14T06:44:56.0822779Z @llvm-project//mlir:LinalgTransforms; 17s local 2025-03-14T06:44:56.0823511Z Compiling xla/pjrt/pjrt_client.cc; 17s local 2025-03-14T06:44:56.0824197Z @stablehlo//:stablehlo_passes; 15s local ... 2025-03-14T06:44:56.3261315Z 2025-03-14T06:44:56.3262281Z  2025-03-14T06:44:56.3262800Z  2025-03-14T06:44:56.3265651Z  2025-03-14T06:44:56.3266488Z  2025-03-14T06:44:56.3266912Z  2025-03-14T06:44:56.3267377Z  2025-03-14T06:44:56.3267775Z  2025-03-14T06:44:56.3268160Z  2025-03-14T06:44:56.3269107Z [20,047 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:56.3270073Z @llvm-project//mlir:LinalgTransforms; 79s local 2025-03-14T06:44:56.3270790Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T06:44:56.3271448Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T06:44:56.3272081Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:56.3272903Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 21s local 2025-03-14T06:44:56.3273823Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:56.3274526Z Compiling xla/pjrt/pjrt_client.cc; 17s local 2025-03-14T06:44:56.3275495Z @stablehlo//:stablehlo_passes; 15s local ... 2025-03-14T06:44:56.5539876Z 2025-03-14T06:44:56.5540743Z  2025-03-14T06:44:56.5541212Z  2025-03-14T06:44:56.5541603Z  2025-03-14T06:44:56.5542005Z  2025-03-14T06:44:56.5542418Z  2025-03-14T06:44:56.5542797Z  2025-03-14T06:44:56.5543190Z  2025-03-14T06:44:56.5543591Z  2025-03-14T06:44:56.5544520Z [20,048 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:56.5545795Z @llvm-project//mlir:LinalgTransforms; 79s local 2025-03-14T06:44:56.5546568Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T06:44:56.5547263Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T06:44:56.5547914Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:56.5548738Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 22s local 2025-03-14T06:44:56.5549677Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:56.5550401Z Compiling xla/pjrt/pjrt_client.cc; 17s local 2025-03-14T06:44:56.5551156Z @stablehlo//:stablehlo_passes; 15s local ... 2025-03-14T06:44:56.8817677Z 2025-03-14T06:44:56.8818471Z  2025-03-14T06:44:56.8818958Z  2025-03-14T06:44:56.8819415Z  2025-03-14T06:44:56.8819854Z  2025-03-14T06:44:56.8820276Z  2025-03-14T06:44:56.8820669Z  2025-03-14T06:44:56.8821076Z  2025-03-14T06:44:56.8821512Z  2025-03-14T06:44:56.8822476Z [20,049 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:56.8823429Z @llvm-project//mlir:LinalgTransforms; 80s local 2025-03-14T06:44:56.8824132Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T06:44:56.8824801Z @xla//xla/mlir_hlo:mhlo_passes; 41s local 2025-03-14T06:44:56.8825478Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:56.8826381Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 22s local 2025-03-14T06:44:56.8827327Z @llvm-project//mlir:LinalgTransforms; 18s local 2025-03-14T06:44:56.8828066Z Compiling xla/pjrt/pjrt_client.cc; 18s local 2025-03-14T06:44:56.8828744Z @stablehlo//:stablehlo_passes; 16s local ... 2025-03-14T06:44:57.2489562Z 2025-03-14T06:44:57.2490428Z  2025-03-14T06:44:57.2490875Z  2025-03-14T06:44:57.2491312Z  2025-03-14T06:44:57.2491752Z  2025-03-14T06:44:57.2492179Z  2025-03-14T06:44:57.2492632Z  2025-03-14T06:44:57.2493074Z  2025-03-14T06:44:57.2493749Z  2025-03-14T06:44:57.2494747Z [20,050 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:57.2495798Z @llvm-project//mlir:LinalgTransforms; 80s local 2025-03-14T06:44:57.2496533Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T06:44:57.2497234Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T06:44:57.2497919Z @xla//xla/mlir_hlo:mhlo_passes; 22s local 2025-03-14T06:44:57.2498835Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 22s local 2025-03-14T06:44:57.2499930Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:44:57.2500684Z Compiling xla/pjrt/pjrt_client.cc; 18s local 2025-03-14T06:44:57.2501419Z @stablehlo//:stablehlo_passes; 16s local ... 2025-03-14T06:44:57.4826371Z 2025-03-14T06:44:57.4827268Z  2025-03-14T06:44:57.4827722Z  2025-03-14T06:44:57.4828083Z  2025-03-14T06:44:57.4828465Z  2025-03-14T06:44:57.4828820Z  2025-03-14T06:44:57.4829200Z  2025-03-14T06:44:57.4829678Z  2025-03-14T06:44:57.4830026Z  2025-03-14T06:44:57.4830871Z [20,050 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:57.4831722Z @llvm-project//mlir:LinalgTransforms; 80s local 2025-03-14T06:44:57.4832302Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T06:44:57.4832849Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T06:44:57.4833632Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:57.4834340Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local 2025-03-14T06:44:57.4835103Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:44:57.4835720Z Compiling xla/pjrt/pjrt_client.cc; 18s local 2025-03-14T06:44:57.4836289Z @stablehlo//:stablehlo_passes; 16s local ... 2025-03-14T06:44:57.8831599Z 2025-03-14T06:44:57.8832724Z  2025-03-14T06:44:57.8833336Z  2025-03-14T06:44:57.8833731Z  2025-03-14T06:44:57.8834163Z  2025-03-14T06:44:57.8834575Z  2025-03-14T06:44:57.8834954Z  2025-03-14T06:44:57.8835366Z  2025-03-14T06:44:57.8835792Z  2025-03-14T06:44:57.8836775Z [20,051 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:57.8837795Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T06:44:57.8838508Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T06:44:57.8839187Z @xla//xla/mlir_hlo:mhlo_passes; 42s local 2025-03-14T06:44:57.8839890Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:57.8840765Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local 2025-03-14T06:44:57.8841702Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:44:57.8842458Z Compiling xla/pjrt/pjrt_client.cc; 19s local 2025-03-14T06:44:57.8843155Z @stablehlo//:stablehlo_passes; 17s local ... 2025-03-14T06:44:58.0833040Z 2025-03-14T06:44:58.0833934Z  2025-03-14T06:44:58.0834417Z  2025-03-14T06:44:58.0834816Z  2025-03-14T06:44:58.0835205Z  2025-03-14T06:44:58.0835617Z  2025-03-14T06:44:58.0836004Z  2025-03-14T06:44:58.0836407Z  2025-03-14T06:44:58.0836834Z  2025-03-14T06:44:58.0837766Z [20,052 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:58.0838792Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T06:44:58.0839483Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T06:44:58.0840121Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T06:44:58.0840775Z @xla//xla/mlir_hlo:mhlo_passes; 23s local 2025-03-14T06:44:58.0841580Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local 2025-03-14T06:44:58.0842410Z @llvm-project//mlir:LinalgTransforms; 19s local 2025-03-14T06:44:58.0843118Z Compiling xla/pjrt/pjrt_client.cc; 19s local 2025-03-14T06:44:58.0844083Z @stablehlo//:stablehlo_passes; 17s local ... 2025-03-14T06:44:58.3596207Z 2025-03-14T06:44:58.3597054Z  2025-03-14T06:44:58.3597562Z  2025-03-14T06:44:58.3597993Z  2025-03-14T06:44:58.3598426Z  2025-03-14T06:44:58.3598850Z  2025-03-14T06:44:58.3599276Z  2025-03-14T06:44:58.3599701Z  2025-03-14T06:44:58.3600119Z  2025-03-14T06:44:58.3601041Z [20,054 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:58.3602325Z @llvm-project//mlir:LinalgTransforms; 81s local 2025-03-14T06:44:58.3603055Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T06:44:58.3603725Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T06:44:58.3604381Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:44:58.3605441Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local 2025-03-14T06:44:58.3606439Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:44:58.3607208Z Compiling xla/pjrt/pjrt_client.cc; 19s local 2025-03-14T06:44:58.3607953Z @stablehlo//:stablehlo_passes; 17s local ... 2025-03-14T06:44:58.6838544Z 2025-03-14T06:44:58.6839387Z  2025-03-14T06:44:58.6839855Z  2025-03-14T06:44:58.6840251Z  2025-03-14T06:44:58.6840645Z  2025-03-14T06:44:58.6841038Z  2025-03-14T06:44:58.6841410Z  2025-03-14T06:44:58.6841829Z  2025-03-14T06:44:58.6842242Z  2025-03-14T06:44:58.6843525Z [20,054 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:58.6844526Z @llvm-project//mlir:LinalgTransforms; 82s local 2025-03-14T06:44:58.6845404Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2025-03-14T06:44:58.6846061Z @xla//xla/mlir_hlo:mhlo_passes; 43s local 2025-03-14T06:44:58.6846713Z @xla//xla/mlir_hlo:mhlo_passes; 24s local 2025-03-14T06:44:58.6847543Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local 2025-03-14T06:44:58.6848717Z @llvm-project//mlir:LinalgTransforms; 20s local 2025-03-14T06:44:58.6849434Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2025-03-14T06:44:58.6850132Z @stablehlo//:stablehlo_passes; 17s local ... 2025-03-14T06:44:59.5766156Z 2025-03-14T06:44:59.5767046Z  2025-03-14T06:44:59.5767548Z  2025-03-14T06:44:59.5767967Z  2025-03-14T06:44:59.5768382Z  2025-03-14T06:44:59.5768781Z  2025-03-14T06:44:59.5769215Z  2025-03-14T06:44:59.5769628Z  2025-03-14T06:44:59.5770028Z  2025-03-14T06:44:59.5770963Z [20,055 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:44:59.5771963Z @llvm-project//mlir:LinalgTransforms; 82s local 2025-03-14T06:44:59.5772685Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2025-03-14T06:44:59.5773359Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T06:44:59.5774020Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:44:59.5774879Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local 2025-03-14T06:44:59.5775828Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:44:59.5776592Z Compiling xla/pjrt/pjrt_client.cc; 20s local 2025-03-14T06:44:59.5777326Z @stablehlo//:stablehlo_passes; 18s local ... 2025-03-14T06:44:59.8847451Z 2025-03-14T06:44:59.8848264Z  2025-03-14T06:44:59.8848745Z  2025-03-14T06:44:59.8849147Z  2025-03-14T06:44:59.8849627Z  2025-03-14T06:44:59.8850051Z  2025-03-14T06:44:59.8850484Z  2025-03-14T06:44:59.8850894Z  2025-03-14T06:44:59.8851265Z  2025-03-14T06:44:59.8852175Z [20,055 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:44:59.8853179Z @llvm-project//mlir:LinalgTransforms; 83s local 2025-03-14T06:44:59.8853878Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2025-03-14T06:44:59.8854547Z @xla//xla/mlir_hlo:mhlo_passes; 44s local 2025-03-14T06:44:59.8855432Z @xla//xla/mlir_hlo:mhlo_passes; 25s local 2025-03-14T06:44:59.8856312Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local 2025-03-14T06:44:59.8857247Z @llvm-project//mlir:LinalgTransforms; 21s local 2025-03-14T06:44:59.8858016Z Compiling xla/pjrt/pjrt_client.cc; 21s local 2025-03-14T06:44:59.8858757Z @stablehlo//:stablehlo_passes; 19s local ... 2025-03-14T06:45:00.8855343Z 2025-03-14T06:45:00.8856366Z  2025-03-14T06:45:00.8856861Z  2025-03-14T06:45:00.8857292Z  2025-03-14T06:45:00.8857706Z  2025-03-14T06:45:00.8858421Z  2025-03-14T06:45:00.8858844Z  2025-03-14T06:45:00.8859265Z  2025-03-14T06:45:00.8859684Z  2025-03-14T06:45:00.8860672Z [20,055 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:00.8861707Z @llvm-project//mlir:LinalgTransforms; 84s local 2025-03-14T06:45:00.8862442Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2025-03-14T06:45:00.8863131Z @xla//xla/mlir_hlo:mhlo_passes; 45s local 2025-03-14T06:45:00.8863805Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T06:45:00.8864668Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local 2025-03-14T06:45:00.8865809Z @llvm-project//mlir:LinalgTransforms; 22s local 2025-03-14T06:45:00.8866517Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2025-03-14T06:45:00.8867201Z @stablehlo//:stablehlo_passes; 20s local ... 2025-03-14T06:45:01.2859177Z 2025-03-14T06:45:01.2859974Z  2025-03-14T06:45:01.2860506Z  2025-03-14T06:45:01.2860946Z  2025-03-14T06:45:01.2861373Z  2025-03-14T06:45:01.2861784Z  2025-03-14T06:45:01.2862212Z  2025-03-14T06:45:01.2862643Z  2025-03-14T06:45:01.2863045Z  2025-03-14T06:45:01.2863865Z [20,056 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:01.2865044Z @llvm-project//mlir:LinalgTransforms; 84s local 2025-03-14T06:45:01.2865912Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2025-03-14T06:45:01.2866475Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2025-03-14T06:45:01.2867025Z @xla//xla/mlir_hlo:mhlo_passes; 26s local 2025-03-14T06:45:01.2867885Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local 2025-03-14T06:45:01.2868736Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:45:01.2869459Z Compiling xla/pjrt/pjrt_client.cc; 22s local 2025-03-14T06:45:01.2877402Z @stablehlo//:stablehlo_passes; 20s local ... 2025-03-14T06:45:01.6925026Z 2025-03-14T06:45:01.6925845Z  2025-03-14T06:45:01.6926341Z  2025-03-14T06:45:01.6926763Z  2025-03-14T06:45:01.6927171Z  2025-03-14T06:45:01.6927579Z  2025-03-14T06:45:01.6927996Z  2025-03-14T06:45:01.6928396Z  2025-03-14T06:45:01.6928792Z  2025-03-14T06:45:01.6929860Z [20,057 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:01.6930837Z @llvm-project//mlir:LinalgTransforms; 85s local 2025-03-14T06:45:01.6931473Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2025-03-14T06:45:01.6932126Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2025-03-14T06:45:01.6932813Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:45:01.6933681Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2025-03-14T06:45:01.6934597Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:45:01.6935381Z Compiling xla/pjrt/pjrt_client.cc; 23s local 2025-03-14T06:45:01.6936136Z @stablehlo//:stablehlo_passes; 20s local ... 2025-03-14T06:45:01.9550368Z 2025-03-14T06:45:01.9551185Z  2025-03-14T06:45:01.9551650Z  2025-03-14T06:45:01.9552059Z  2025-03-14T06:45:01.9552477Z  2025-03-14T06:45:01.9552882Z  2025-03-14T06:45:01.9553281Z  2025-03-14T06:45:01.9553657Z  2025-03-14T06:45:01.9554092Z  2025-03-14T06:45:01.9555301Z [20,058 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:01.9556286Z @llvm-project//mlir:LinalgTransforms; 85s local 2025-03-14T06:45:01.9556995Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2025-03-14T06:45:01.9557674Z @xla//xla/mlir_hlo:mhlo_passes; 46s local 2025-03-14T06:45:01.9558363Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:45:01.9559271Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2025-03-14T06:45:01.9560432Z @llvm-project//mlir:LinalgTransforms; 23s local 2025-03-14T06:45:01.9561125Z @stablehlo//:stablehlo_passes; 21s local 2025-03-14T06:45:01.9561795Z Compiling xla/pjrt/mlir_to_hlo.cc; 19s local ... 2025-03-14T06:45:02.2866737Z 2025-03-14T06:45:02.2867604Z  2025-03-14T06:45:02.2868106Z  2025-03-14T06:45:02.2868525Z  2025-03-14T06:45:02.2868925Z  2025-03-14T06:45:02.2869362Z  2025-03-14T06:45:02.2869776Z  2025-03-14T06:45:02.2870191Z  2025-03-14T06:45:02.2870610Z  2025-03-14T06:45:02.2871578Z [20,059 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:02.2872651Z @llvm-project//mlir:LinalgTransforms; 85s local 2025-03-14T06:45:02.2873360Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2025-03-14T06:45:02.2874019Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2025-03-14T06:45:02.2874666Z @xla//xla/mlir_hlo:mhlo_passes; 27s local 2025-03-14T06:45:02.2875961Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2025-03-14T06:45:02.2876902Z @stablehlo//:stablehlo_passes; 21s local 2025-03-14T06:45:02.2877618Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local 2025-03-14T06:45:02.2878388Z Compiling xla/service/service.cc; 20s local ... 2025-03-14T06:45:02.6871125Z 2025-03-14T06:45:02.6871998Z  2025-03-14T06:45:02.6872480Z  2025-03-14T06:45:02.6873154Z  2025-03-14T06:45:02.6873531Z  2025-03-14T06:45:02.6873908Z  2025-03-14T06:45:02.6874315Z  2025-03-14T06:45:02.6874701Z  2025-03-14T06:45:02.6875107Z  2025-03-14T06:45:02.6876091Z [20,060 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:02.6877093Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T06:45:02.6877843Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2025-03-14T06:45:02.6878561Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2025-03-14T06:45:02.6879243Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:45:02.6880090Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2025-03-14T06:45:02.6880975Z @stablehlo//:stablehlo_passes; 21s local 2025-03-14T06:45:02.6881660Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local 2025-03-14T06:45:02.6882381Z Compiling xla/service/service.cc; 20s local ... 2025-03-14T06:45:02.8873821Z 2025-03-14T06:45:02.8874750Z  2025-03-14T06:45:02.8875222Z  2025-03-14T06:45:02.8875652Z  2025-03-14T06:45:02.8876085Z  2025-03-14T06:45:02.8876478Z  2025-03-14T06:45:02.8876875Z  2025-03-14T06:45:02.8877280Z  2025-03-14T06:45:02.8877679Z  2025-03-14T06:45:02.8878624Z [20,061 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:02.8879597Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T06:45:02.8880324Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2025-03-14T06:45:02.8880931Z @xla//xla/mlir_hlo:mhlo_passes; 47s local 2025-03-14T06:45:02.8881591Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:45:02.8882459Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2025-03-14T06:45:02.8883327Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T06:45:02.8883972Z Compiling xla/pjrt/mlir_to_hlo.cc; 20s local 2025-03-14T06:45:02.8884811Z Compiling xla/service/service.cc; 20s local ... 2025-03-14T06:45:03.1233028Z 2025-03-14T06:45:03.1234110Z  2025-03-14T06:45:03.1234599Z  2025-03-14T06:45:03.1234980Z  2025-03-14T06:45:03.1235376Z  2025-03-14T06:45:03.1235699Z  2025-03-14T06:45:03.1236104Z  2025-03-14T06:45:03.1236500Z  2025-03-14T06:45:03.1236885Z  2025-03-14T06:45:03.1237834Z [20,062 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:03.1238787Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T06:45:03.1239657Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2025-03-14T06:45:03.1240349Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2025-03-14T06:45:03.1241021Z @xla//xla/mlir_hlo:mhlo_passes; 28s local 2025-03-14T06:45:03.1241911Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2025-03-14T06:45:03.1242812Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T06:45:03.1243522Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local 2025-03-14T06:45:03.1244288Z Compiling xla/service/service.cc; 20s local ... 2025-03-14T06:45:03.4738568Z 2025-03-14T06:45:03.4739436Z  2025-03-14T06:45:03.4739932Z  2025-03-14T06:45:03.4740327Z  2025-03-14T06:45:03.4740698Z  2025-03-14T06:45:03.4741088Z  2025-03-14T06:45:03.4741482Z  2025-03-14T06:45:03.4741887Z  2025-03-14T06:45:03.4742285Z  2025-03-14T06:45:03.4743190Z [20,064 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:03.4744455Z @llvm-project//mlir:LinalgTransforms; 86s local 2025-03-14T06:45:03.4745125Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2025-03-14T06:45:03.4745761Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2025-03-14T06:45:03.4746363Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:45:03.4747195Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T06:45:03.4750119Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T06:45:03.4750794Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local 2025-03-14T06:45:03.4751462Z Compiling xla/service/service.cc; 21s local ... 2025-03-14T06:45:03.6772767Z 2025-03-14T06:45:03.6773679Z  2025-03-14T06:45:03.6774184Z  2025-03-14T06:45:03.6774589Z  2025-03-14T06:45:03.6774989Z  2025-03-14T06:45:03.6775396Z  2025-03-14T06:45:03.6775779Z  2025-03-14T06:45:03.6776176Z  2025-03-14T06:45:03.6776571Z  2025-03-14T06:45:03.6777558Z [20,065 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:03.6778566Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T06:45:03.6779313Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2025-03-14T06:45:03.6780013Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2025-03-14T06:45:03.6780681Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:45:03.6781511Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T06:45:03.6782401Z @stablehlo//:stablehlo_passes; 22s local 2025-03-14T06:45:03.6783044Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local 2025-03-14T06:45:03.6783689Z Compiling xla/service/service.cc; 21s local ... 2025-03-14T06:45:03.9239051Z 2025-03-14T06:45:03.9239875Z  2025-03-14T06:45:03.9240393Z  2025-03-14T06:45:03.9240807Z  2025-03-14T06:45:03.9241239Z  2025-03-14T06:45:03.9241667Z  2025-03-14T06:45:03.9242124Z  2025-03-14T06:45:03.9242533Z  2025-03-14T06:45:03.9242945Z  2025-03-14T06:45:03.9243940Z [20,066 / 20,652] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2025-03-14T06:45:03.9245075Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T06:45:03.9245811Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2025-03-14T06:45:03.9246482Z @xla//xla/mlir_hlo:mhlo_passes; 48s local 2025-03-14T06:45:03.9247165Z @xla//xla/mlir_hlo:mhlo_passes; 29s local 2025-03-14T06:45:03.9248351Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T06:45:03.9249282Z @stablehlo//:stablehlo_passes; 23s local 2025-03-14T06:45:03.9249929Z Compiling xla/pjrt/mlir_to_hlo.cc; 21s local 2025-03-14T06:45:03.9250621Z Compiling xla/service/service.cc; 21s local ... 2025-03-14T06:45:04.3243327Z 2025-03-14T06:45:04.3244136Z  2025-03-14T06:45:04.3244813Z  2025-03-14T06:45:04.3245264Z  2025-03-14T06:45:04.3245727Z  2025-03-14T06:45:04.3246134Z  2025-03-14T06:45:04.3246563Z  2025-03-14T06:45:04.3247289Z  2025-03-14T06:45:04.3247722Z  2025-03-14T06:45:04.3248714Z [20,066 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:04.3249795Z @llvm-project//mlir:LinalgTransforms; 87s local 2025-03-14T06:45:04.3250558Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2025-03-14T06:45:04.3251252Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2025-03-14T06:45:04.3251954Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:45:04.3252804Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T06:45:04.3253696Z @stablehlo//:stablehlo_passes; 23s local 2025-03-14T06:45:04.3254412Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local 2025-03-14T06:45:04.3255172Z Compiling xla/service/service.cc; 22s local ... 2025-03-14T06:45:04.9465680Z 2025-03-14T06:45:04.9466627Z  2025-03-14T06:45:04.9467474Z  2025-03-14T06:45:04.9467928Z  2025-03-14T06:45:04.9468371Z  2025-03-14T06:45:04.9468819Z  2025-03-14T06:45:04.9469234Z  2025-03-14T06:45:04.9469668Z  2025-03-14T06:45:04.9470101Z  2025-03-14T06:45:04.9471120Z [20,067 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:04.9472068Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T06:45:04.9472950Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T06:45:04.9473628Z @xla//xla/mlir_hlo:mhlo_passes; 49s local 2025-03-14T06:45:04.9474276Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:45:04.9475107Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2025-03-14T06:45:04.9479132Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T06:45:04.9479816Z Compiling xla/pjrt/mlir_to_hlo.cc; 22s local 2025-03-14T06:45:04.9480565Z Compiling xla/service/service.cc; 22s local ... 2025-03-14T06:45:05.1831762Z 2025-03-14T06:45:05.1832555Z  2025-03-14T06:45:05.1833061Z  2025-03-14T06:45:05.1833513Z  2025-03-14T06:45:05.1833909Z  2025-03-14T06:45:05.1834322Z  2025-03-14T06:45:05.1834727Z  2025-03-14T06:45:05.1835122Z  2025-03-14T06:45:05.1835512Z  2025-03-14T06:45:05.1836526Z [20,069 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:05.1837547Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T06:45:05.1838303Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T06:45:05.1838915Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2025-03-14T06:45:05.1839575Z @xla//xla/mlir_hlo:mhlo_passes; 30s local 2025-03-14T06:45:05.1840436Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2025-03-14T06:45:05.1841340Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T06:45:05.1841975Z Compiling xla/pjrt/mlir_to_hlo.cc; 23s local 2025-03-14T06:45:05.1842635Z Compiling xla/service/service.cc; 22s local ... 2025-03-14T06:45:05.5251380Z 2025-03-14T06:45:05.5252268Z  2025-03-14T06:45:05.5252769Z  2025-03-14T06:45:05.5253132Z  2025-03-14T06:45:05.5253553Z  2025-03-14T06:45:05.5253990Z  2025-03-14T06:45:05.5254422Z  2025-03-14T06:45:05.5254826Z  2025-03-14T06:45:05.5255219Z  2025-03-14T06:45:05.5256205Z [20,069 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:05.5257435Z @llvm-project//mlir:LinalgTransforms; 88s local 2025-03-14T06:45:05.5258142Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T06:45:05.5258810Z @xla//xla/mlir_hlo:mhlo_passes; 50s local 2025-03-14T06:45:05.5259473Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:45:05.5260411Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T06:45:05.5261282Z @stablehlo//:stablehlo_passes; 24s local 2025-03-14T06:45:05.5261972Z Compiling xla/pjrt/mlir_to_hlo.cc; 23s local 2025-03-14T06:45:05.5262869Z Compiling xla/service/service.cc; 23s local ... 2025-03-14T06:45:06.0953210Z 2025-03-14T06:45:06.0954086Z  2025-03-14T06:45:06.0954598Z  2025-03-14T06:45:06.0955027Z  2025-03-14T06:45:06.0955424Z  2025-03-14T06:45:06.0955805Z  2025-03-14T06:45:06.0956202Z  2025-03-14T06:45:06.0956613Z  2025-03-14T06:45:06.0957034Z  2025-03-14T06:45:06.0957995Z [20,070 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:06.0959155Z @llvm-project//mlir:LinalgTransforms; 89s local 2025-03-14T06:45:06.0959902Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T06:45:06.0960610Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T06:45:06.0961294Z @xla//xla/mlir_hlo:mhlo_passes; 31s local 2025-03-14T06:45:06.0962166Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T06:45:06.0963492Z @stablehlo//:stablehlo_passes; 25s local 2025-03-14T06:45:06.0964183Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2025-03-14T06:45:06.0965129Z Compiling xla/service/service.cc; 23s local ... 2025-03-14T06:45:06.3257044Z 2025-03-14T06:45:06.3257851Z  2025-03-14T06:45:06.3258343Z  2025-03-14T06:45:06.3258768Z  2025-03-14T06:45:06.3259193Z  2025-03-14T06:45:06.3259618Z  2025-03-14T06:45:06.3260370Z  2025-03-14T06:45:06.3260800Z  2025-03-14T06:45:06.3261233Z  2025-03-14T06:45:06.3262220Z [20,071 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:06.3263201Z @llvm-project//mlir:LinalgTransforms; 89s local 2025-03-14T06:45:06.3263903Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T06:45:06.3264550Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T06:45:06.3265211Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:45:06.3266384Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T06:45:06.3267249Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2025-03-14T06:45:06.3267909Z Compiling xla/service/service.cc; 24s local 2025-03-14T06:45:06.3268592Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2025-03-14T06:45:06.7261425Z 2025-03-14T06:45:06.7262274Z  2025-03-14T06:45:06.7262701Z  2025-03-14T06:45:06.7263049Z  2025-03-14T06:45:06.7263436Z  2025-03-14T06:45:06.7263788Z  2025-03-14T06:45:06.7264148Z  2025-03-14T06:45:06.7264496Z  2025-03-14T06:45:06.7264844Z  2025-03-14T06:45:06.7265930Z [20,073 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:06.7266920Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T06:45:06.7267577Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2025-03-14T06:45:06.7268219Z @xla//xla/mlir_hlo:mhlo_passes; 51s local 2025-03-14T06:45:06.7268862Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:45:06.7269714Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2025-03-14T06:45:06.7270583Z Compiling xla/pjrt/mlir_to_hlo.cc; 24s local 2025-03-14T06:45:06.7271298Z Compiling xla/service/service.cc; 24s local 2025-03-14T06:45:06.7272054Z @llvm-project//mlir:LinalgTransforms; 23s local ... 2025-03-14T06:45:07.1120291Z 2025-03-14T06:45:07.1121135Z  2025-03-14T06:45:07.1121654Z  2025-03-14T06:45:07.1122081Z  2025-03-14T06:45:07.1122759Z  2025-03-14T06:45:07.1123188Z  2025-03-14T06:45:07.1123589Z  2025-03-14T06:45:07.1123989Z  2025-03-14T06:45:07.1124360Z  2025-03-14T06:45:07.1125542Z [20,074 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:07.1126559Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T06:45:07.1127261Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2025-03-14T06:45:07.1127953Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T06:45:07.1128819Z @xla//xla/mlir_hlo:mhlo_passes; 32s local 2025-03-14T06:45:07.1129703Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2025-03-14T06:45:07.1130615Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2025-03-14T06:45:07.1131323Z Compiling xla/service/service.cc; 24s local 2025-03-14T06:45:07.1132104Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2025-03-14T06:45:07.3266523Z 2025-03-14T06:45:07.3267385Z  2025-03-14T06:45:07.3267864Z  2025-03-14T06:45:07.3268288Z  2025-03-14T06:45:07.3268692Z  2025-03-14T06:45:07.3269089Z  2025-03-14T06:45:07.3269419Z  2025-03-14T06:45:07.3269805Z  2025-03-14T06:45:07.3270195Z  2025-03-14T06:45:07.3271121Z [20,074 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:07.3272399Z @llvm-project//mlir:LinalgTransforms; 90s local 2025-03-14T06:45:07.3273116Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2025-03-14T06:45:07.3273763Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T06:45:07.3274441Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:45:07.3275317Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2025-03-14T06:45:07.3276165Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2025-03-14T06:45:07.3276882Z Compiling xla/service/service.cc; 25s local 2025-03-14T06:45:07.3277819Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2025-03-14T06:45:07.7270661Z 2025-03-14T06:45:07.7271489Z  2025-03-14T06:45:07.7271980Z  2025-03-14T06:45:07.7272407Z  2025-03-14T06:45:07.7272825Z  2025-03-14T06:45:07.7273234Z  2025-03-14T06:45:07.7273640Z  2025-03-14T06:45:07.7274067Z  2025-03-14T06:45:07.7274481Z  2025-03-14T06:45:07.7275469Z [20,075 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:07.7276590Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T06:45:07.7277359Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2025-03-14T06:45:07.7278067Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T06:45:07.7278771Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:45:07.7279683Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2025-03-14T06:45:07.7280793Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2025-03-14T06:45:07.7281499Z Compiling xla/service/service.cc; 25s local 2025-03-14T06:45:07.7282224Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2025-03-14T06:45:07.9273958Z 2025-03-14T06:45:07.9274821Z  2025-03-14T06:45:07.9275328Z  2025-03-14T06:45:07.9275726Z  2025-03-14T06:45:07.9276259Z  2025-03-14T06:45:07.9276689Z  2025-03-14T06:45:07.9277077Z  2025-03-14T06:45:07.9277487Z  2025-03-14T06:45:07.9277943Z  2025-03-14T06:45:07.9278928Z [20,076 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:07.9279943Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T06:45:07.9280674Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2025-03-14T06:45:07.9281355Z @xla//xla/mlir_hlo:mhlo_passes; 52s local 2025-03-14T06:45:07.9282015Z @xla//xla/mlir_hlo:mhlo_passes; 33s local 2025-03-14T06:45:07.9282914Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2025-03-14T06:45:07.9284244Z Compiling xla/pjrt/mlir_to_hlo.cc; 25s local 2025-03-14T06:45:07.9285174Z Compiling xla/service/service.cc; 25s local 2025-03-14T06:45:07.9285882Z @llvm-project//mlir:LinalgTransforms; 24s local ... 2025-03-14T06:45:08.6294762Z 2025-03-14T06:45:08.6295646Z  2025-03-14T06:45:08.6296126Z  2025-03-14T06:45:08.6296511Z  2025-03-14T06:45:08.6296900Z  2025-03-14T06:45:08.6297299Z  2025-03-14T06:45:08.6297740Z  2025-03-14T06:45:08.6298161Z  2025-03-14T06:45:08.6298561Z  2025-03-14T06:45:08.6299714Z [20,077 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:08.6300627Z @llvm-project//mlir:LinalgTransforms; 91s local 2025-03-14T06:45:08.6301273Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2025-03-14T06:45:08.6301890Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2025-03-14T06:45:08.6302502Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:45:08.6303293Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2025-03-14T06:45:08.6304139Z Compiling xla/pjrt/mlir_to_hlo.cc; 26s local 2025-03-14T06:45:08.6304770Z Compiling xla/service/service.cc; 26s local 2025-03-14T06:45:08.6305410Z Compiling xla/pjrt/host_callback.cc; 21s local ... 2025-03-14T06:45:08.9280366Z 2025-03-14T06:45:08.9281264Z  2025-03-14T06:45:08.9281749Z  2025-03-14T06:45:08.9282433Z  2025-03-14T06:45:08.9282813Z  2025-03-14T06:45:08.9283196Z  2025-03-14T06:45:08.9283600Z  2025-03-14T06:45:08.9284018Z  2025-03-14T06:45:08.9284423Z  2025-03-14T06:45:08.9285560Z [20,078 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:08.9286573Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T06:45:08.9287311Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2025-03-14T06:45:08.9288141Z @xla//xla/mlir_hlo:mhlo_passes; 53s local 2025-03-14T06:45:08.9288776Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:45:08.9289641Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2025-03-14T06:45:08.9290517Z Compiling xla/pjrt/mlir_to_hlo.cc; 26s local 2025-03-14T06:45:08.9291210Z Compiling xla/service/service.cc; 26s local 2025-03-14T06:45:08.9291991Z Compiling xla/pjrt/host_callback.cc; 21s local ... 2025-03-14T06:45:09.1282983Z 2025-03-14T06:45:09.1283869Z  2025-03-14T06:45:09.1284315Z  2025-03-14T06:45:09.1284828Z  2025-03-14T06:45:09.1285198Z  2025-03-14T06:45:09.1285568Z  2025-03-14T06:45:09.1285933Z  2025-03-14T06:45:09.1286300Z  2025-03-14T06:45:09.1286662Z  2025-03-14T06:45:09.1287569Z [20,079 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:09.1288480Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T06:45:09.1289132Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2025-03-14T06:45:09.1289746Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2025-03-14T06:45:09.1290334Z @xla//xla/mlir_hlo:mhlo_passes; 34s local 2025-03-14T06:45:09.1291100Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2025-03-14T06:45:09.1291908Z Compiling xla/pjrt/mlir_to_hlo.cc; 27s local 2025-03-14T06:45:09.1292542Z Compiling xla/service/service.cc; 26s local 2025-03-14T06:45:09.1293207Z Compiling xla/pjrt/host_callback.cc; 21s local ... 2025-03-14T06:45:09.5286734Z 2025-03-14T06:45:09.5287538Z  2025-03-14T06:45:09.5288017Z  2025-03-14T06:45:09.5288393Z  2025-03-14T06:45:09.5288778Z  2025-03-14T06:45:09.5289150Z  2025-03-14T06:45:09.5289512Z  2025-03-14T06:45:09.5289850Z  2025-03-14T06:45:09.5290154Z  2025-03-14T06:45:09.5290916Z [20,080 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:09.5292101Z @llvm-project//mlir:LinalgTransforms; 92s local 2025-03-14T06:45:09.5292748Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2025-03-14T06:45:09.5293333Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2025-03-14T06:45:09.5293907Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:45:09.5294668Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T06:45:09.5295438Z Compiling xla/pjrt/mlir_to_hlo.cc; 27s local 2025-03-14T06:45:09.5296054Z Compiling xla/service/service.cc; 27s local 2025-03-14T06:45:09.5296832Z Compiling xla/pjrt/host_callback.cc; 22s local ... 2025-03-14T06:45:09.9291247Z 2025-03-14T06:45:09.9292110Z  2025-03-14T06:45:09.9292626Z  2025-03-14T06:45:09.9293057Z  2025-03-14T06:45:09.9293457Z  2025-03-14T06:45:09.9293848Z  2025-03-14T06:45:09.9294235Z  2025-03-14T06:45:09.9294643Z  2025-03-14T06:45:09.9295061Z  2025-03-14T06:45:09.9296037Z [20,081 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:09.9297046Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T06:45:09.9297768Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2025-03-14T06:45:09.9298436Z @xla//xla/mlir_hlo:mhlo_passes; 54s local 2025-03-14T06:45:09.9299098Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:45:09.9299962Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T06:45:09.9301200Z Compiling xla/service/service.cc; 27s local 2025-03-14T06:45:09.9301925Z Compiling xla/pjrt/host_callback.cc; 22s local 2025-03-14T06:45:09.9302692Z Compiling xla/pjrt/host_callback.cc; 20s local ... 2025-03-14T06:45:10.1294100Z 2025-03-14T06:45:10.1294981Z  2025-03-14T06:45:10.1295483Z  2025-03-14T06:45:10.1295891Z  2025-03-14T06:45:10.1296305Z  2025-03-14T06:45:10.1296696Z  2025-03-14T06:45:10.1297208Z  2025-03-14T06:45:10.1298022Z  2025-03-14T06:45:10.1298452Z  2025-03-14T06:45:10.1299508Z [20,082 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:10.1300528Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T06:45:10.1301247Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2025-03-14T06:45:10.1301877Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2025-03-14T06:45:10.1302545Z @xla//xla/mlir_hlo:mhlo_passes; 35s local 2025-03-14T06:45:10.1303406Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T06:45:10.1304314Z Compiling xla/service/service.cc; 27s local 2025-03-14T06:45:10.1305019Z Compiling xla/pjrt/host_callback.cc; 22s local 2025-03-14T06:45:10.1305756Z Compiling xla/pjrt/host_callback.cc; 20s local ... 2025-03-14T06:45:10.5794725Z 2025-03-14T06:45:10.5795628Z  2025-03-14T06:45:10.5796136Z  2025-03-14T06:45:10.5796516Z  2025-03-14T06:45:10.5796901Z  2025-03-14T06:45:10.5797297Z  2025-03-14T06:45:10.5797708Z  2025-03-14T06:45:10.5798125Z  2025-03-14T06:45:10.5798526Z  2025-03-14T06:45:10.5799455Z [20,083 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:10.5800415Z @llvm-project//mlir:LinalgTransforms; 93s local 2025-03-14T06:45:10.5801139Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2025-03-14T06:45:10.5801770Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2025-03-14T06:45:10.5802410Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:45:10.5803275Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2025-03-14T06:45:10.5804088Z Compiling xla/service/service.cc; 28s local 2025-03-14T06:45:10.5804938Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T06:45:10.5805688Z Compiling xla/pjrt/host_callback.cc; 21s local ... 2025-03-14T06:45:10.9300179Z 2025-03-14T06:45:10.9301034Z  2025-03-14T06:45:10.9301553Z  2025-03-14T06:45:10.9301961Z  2025-03-14T06:45:10.9302366Z  2025-03-14T06:45:10.9303018Z  2025-03-14T06:45:10.9303426Z  2025-03-14T06:45:10.9303819Z  2025-03-14T06:45:10.9304202Z  2025-03-14T06:45:10.9305128Z [20,084 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:10.9306135Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T06:45:10.9306840Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2025-03-14T06:45:10.9307507Z @xla//xla/mlir_hlo:mhlo_passes; 55s local 2025-03-14T06:45:10.9308332Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:45:10.9309183Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2025-03-14T06:45:10.9310098Z Compiling xla/service/service.cc; 28s local 2025-03-14T06:45:10.9310748Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T06:45:10.9311498Z Compiling xla/pjrt/host_callback.cc; 21s local ... 2025-03-14T06:45:11.1512358Z 2025-03-14T06:45:11.1513251Z  2025-03-14T06:45:11.1513745Z  2025-03-14T06:45:11.1514140Z  2025-03-14T06:45:11.1514542Z  2025-03-14T06:45:11.1514920Z  2025-03-14T06:45:11.1515342Z  2025-03-14T06:45:11.1515734Z  2025-03-14T06:45:11.1516111Z  2025-03-14T06:45:11.1517041Z [20,085 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:11.1518038Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T06:45:11.1519056Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2025-03-14T06:45:11.1519759Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2025-03-14T06:45:11.1520418Z @xla//xla/mlir_hlo:mhlo_passes; 36s local 2025-03-14T06:45:11.1521242Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2025-03-14T06:45:11.1522095Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T06:45:11.1522832Z Compiling xla/pjrt/host_callback.cc; 22s local 2025-03-14T06:45:11.1523846Z Compiling xla/service/elemental_ir_emitter.cc; 21s local ... 2025-03-14T06:45:11.4957081Z 2025-03-14T06:45:11.4957895Z  2025-03-14T06:45:11.4958328Z  2025-03-14T06:45:11.4958691Z  2025-03-14T06:45:11.4959058Z  2025-03-14T06:45:11.4959424Z  2025-03-14T06:45:11.4959788Z  2025-03-14T06:45:11.4960142Z  2025-03-14T06:45:11.4960517Z  2025-03-14T06:45:11.4961383Z [20,086 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:11.4962311Z @llvm-project//mlir:LinalgTransforms; 94s local 2025-03-14T06:45:11.4962943Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T06:45:11.4963504Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2025-03-14T06:45:11.4964063Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:45:11.4964939Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2025-03-14T06:45:11.4965941Z Compiling xla/pjrt/host_callback.cc; 22s local 2025-03-14T06:45:11.4966660Z Compiling xla/service/elemental_ir_emitter.cc; 21s local 2025-03-14T06:45:11.4967585Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 19s local ... 2025-03-14T06:45:11.7305992Z 2025-03-14T06:45:11.7306823Z  2025-03-14T06:45:11.7307294Z  2025-03-14T06:45:11.7307698Z  2025-03-14T06:45:11.7308064Z  2025-03-14T06:45:11.7318956Z  2025-03-14T06:45:11.7319406Z  2025-03-14T06:45:11.7319826Z  2025-03-14T06:45:11.7320213Z  2025-03-14T06:45:11.7321138Z [20,086 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:11.7322065Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T06:45:11.7322728Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T06:45:11.7323309Z @xla//xla/mlir_hlo:mhlo_passes; 56s local 2025-03-14T06:45:11.7323931Z @xla//xla/mlir_hlo:mhlo_passes; 37s local 2025-03-14T06:45:11.7325071Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2025-03-14T06:45:11.7326230Z Compiling xla/pjrt/host_callback.cc; 22s local 2025-03-14T06:45:11.7326990Z Compiling xla/service/elemental_ir_emitter.cc; 22s local 2025-03-14T06:45:11.7328020Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 19s local ... 2025-03-14T06:45:12.1309951Z 2025-03-14T06:45:12.1310844Z  2025-03-14T06:45:12.1311373Z  2025-03-14T06:45:12.1311846Z  2025-03-14T06:45:12.1312346Z  2025-03-14T06:45:12.1312729Z  2025-03-14T06:45:12.1313096Z  2025-03-14T06:45:12.1313498Z  2025-03-14T06:45:12.1314202Z  2025-03-14T06:45:12.1315176Z [20,088 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:12.1316222Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T06:45:12.1316952Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T06:45:12.1317565Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2025-03-14T06:45:12.1318442Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2025-03-14T06:45:12.1319321Z Compiling xla/pjrt/host_callback.cc; 22s local 2025-03-14T06:45:12.1320095Z Compiling xla/service/elemental_ir_emitter.cc; 22s local 2025-03-14T06:45:12.1321182Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 19s local 2025-03-14T06:45:12.1322258Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 19s local ... 2025-03-14T06:45:12.3313183Z 2025-03-14T06:45:12.3314075Z  2025-03-14T06:45:12.3314582Z  2025-03-14T06:45:12.3315018Z  2025-03-14T06:45:12.3315426Z  2025-03-14T06:45:12.3315811Z  2025-03-14T06:45:12.3316224Z  2025-03-14T06:45:12.3316621Z  2025-03-14T06:45:12.3317040Z  2025-03-14T06:45:12.3318004Z [20,089 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:12.3319016Z @llvm-project//mlir:LinalgTransforms; 95s local 2025-03-14T06:45:12.3320078Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T06:45:12.3320735Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2025-03-14T06:45:12.3321590Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2025-03-14T06:45:12.3322499Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T06:45:12.3323271Z Compiling xla/service/elemental_ir_emitter.cc; 22s local 2025-03-14T06:45:12.3324237Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 20s local 2025-03-14T06:45:12.3325566Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 19s local ... 2025-03-14T06:45:12.9077427Z 2025-03-14T06:45:12.9078271Z  2025-03-14T06:45:12.9078706Z  2025-03-14T06:45:12.9079091Z  2025-03-14T06:45:12.9079448Z  2025-03-14T06:45:12.9079829Z  2025-03-14T06:45:12.9080218Z  2025-03-14T06:45:12.9080590Z  2025-03-14T06:45:12.9080956Z  2025-03-14T06:45:12.9081890Z [20,090 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:12.9082850Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T06:45:12.9083518Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2025-03-14T06:45:12.9084166Z @xla//xla/mlir_hlo:mhlo_passes; 57s local 2025-03-14T06:45:12.9085127Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 38s local 2025-03-14T06:45:12.9086024Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T06:45:12.9086824Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2025-03-14T06:45:12.9087820Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 20s local 2025-03-14T06:45:12.9088915Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 20s local ... 2025-03-14T06:45:13.1319397Z 2025-03-14T06:45:13.1320297Z  2025-03-14T06:45:13.1320741Z  2025-03-14T06:45:13.1321126Z  2025-03-14T06:45:13.1321583Z  2025-03-14T06:45:13.1321970Z  2025-03-14T06:45:13.1322374Z  2025-03-14T06:45:13.1322761Z  2025-03-14T06:45:13.1323422Z  2025-03-14T06:45:13.1324347Z [20,090 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:13.1325427Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T06:45:13.1326124Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2025-03-14T06:45:13.1326714Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T06:45:13.1327399Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 38s local 2025-03-14T06:45:13.1328496Z Compiling xla/pjrt/host_callback.cc; 23s local 2025-03-14T06:45:13.1329308Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2025-03-14T06:45:13.1330326Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 20s local 2025-03-14T06:45:13.1331431Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 20s local ... 2025-03-14T06:45:13.3322777Z 2025-03-14T06:45:13.3323629Z  2025-03-14T06:45:13.3324150Z  2025-03-14T06:45:13.3324503Z  2025-03-14T06:45:13.3324992Z  2025-03-14T06:45:13.3325359Z  2025-03-14T06:45:13.3325741Z  2025-03-14T06:45:13.3326137Z  2025-03-14T06:45:13.3326539Z  2025-03-14T06:45:13.3327524Z [20,091 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:13.3328537Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T06:45:13.3329289Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2025-03-14T06:45:13.3330284Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T06:45:13.3331171Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 38s local 2025-03-14T06:45:13.3332195Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2025-03-14T06:45:13.3333178Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local 2025-03-14T06:45:13.3334218Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 20s local 2025-03-14T06:45:13.3335388Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 20s local ... 2025-03-14T06:45:13.5609111Z 2025-03-14T06:45:13.5609966Z  2025-03-14T06:45:13.5610448Z  2025-03-14T06:45:13.5610851Z  2025-03-14T06:45:13.5611266Z  2025-03-14T06:45:13.5611674Z  2025-03-14T06:45:13.5612081Z  2025-03-14T06:45:13.5612509Z  2025-03-14T06:45:13.5612896Z  2025-03-14T06:45:13.5613868Z [20,092 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:13.5614915Z @llvm-project//mlir:LinalgTransforms; 96s local 2025-03-14T06:45:13.5615594Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T06:45:13.5616229Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T06:45:13.5617076Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 39s local 2025-03-14T06:45:13.5618052Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2025-03-14T06:45:13.5619055Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local 2025-03-14T06:45:13.5620144Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 21s local 2025-03-14T06:45:13.5621091Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 20s local ... 2025-03-14T06:45:13.8897268Z 2025-03-14T06:45:13.8898114Z  2025-03-14T06:45:13.8898637Z  2025-03-14T06:45:13.8899039Z  2025-03-14T06:45:13.8899428Z  2025-03-14T06:45:13.8899822Z  2025-03-14T06:45:13.8900215Z  2025-03-14T06:45:13.8900639Z  2025-03-14T06:45:13.8901040Z  2025-03-14T06:45:13.8901992Z [20,094 / 20,652] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:45:13.8902957Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T06:45:13.8903635Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T06:45:13.8904277Z @xla//xla/mlir_hlo:mhlo_passes; 58s local 2025-03-14T06:45:13.8905011Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2025-03-14T06:45:13.8906279Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local 2025-03-14T06:45:13.8907328Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 21s local 2025-03-14T06:45:13.8908271Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 21s local 2025-03-14T06:45:13.8909261Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local ... 2025-03-14T06:45:14.1330243Z 2025-03-14T06:45:14.1331087Z  2025-03-14T06:45:14.1331561Z  2025-03-14T06:45:14.1332009Z  2025-03-14T06:45:14.1332419Z  2025-03-14T06:45:14.1332809Z  2025-03-14T06:45:14.1333440Z  2025-03-14T06:45:14.1333774Z  2025-03-14T06:45:14.1334096Z  2025-03-14T06:45:14.1334988Z [20,094 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:14.1335949Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T06:45:14.1336624Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T06:45:14.1337299Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2025-03-14T06:45:14.1338046Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2025-03-14T06:45:14.1339041Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 21s local 2025-03-14T06:45:14.1340005Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 21s local 2025-03-14T06:45:14.1340803Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 21s local 2025-03-14T06:45:14.1341692Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local ... 2025-03-14T06:45:14.3725864Z 2025-03-14T06:45:14.3726704Z  2025-03-14T06:45:14.3727166Z  2025-03-14T06:45:14.3727648Z  2025-03-14T06:45:14.3727997Z  2025-03-14T06:45:14.3728358Z  2025-03-14T06:45:14.3728700Z  2025-03-14T06:45:14.3729040Z  2025-03-14T06:45:14.3729381Z  2025-03-14T06:45:14.3730218Z [20,096 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:14.3731331Z @llvm-project//mlir:LinalgTransforms; 97s local 2025-03-14T06:45:14.3731928Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T06:45:14.3732472Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2025-03-14T06:45:14.3733113Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2025-03-14T06:45:14.3734048Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local 2025-03-14T06:45:14.3734979Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 21s local 2025-03-14T06:45:14.3735765Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 21s local 2025-03-14T06:45:14.3736623Z Compiling torch_xla/csrc/runtime/computation_client.cc; 20s local ... 2025-03-14T06:45:14.7333956Z 2025-03-14T06:45:14.7334827Z  2025-03-14T06:45:14.7335330Z  2025-03-14T06:45:14.7335742Z  2025-03-14T06:45:14.7336176Z  2025-03-14T06:45:14.7336600Z  2025-03-14T06:45:14.7337038Z  2025-03-14T06:45:14.7337452Z  2025-03-14T06:45:14.7337911Z  2025-03-14T06:45:14.7338936Z [20,096 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:14.7339999Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T06:45:14.7340750Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2025-03-14T06:45:14.7341451Z @xla//xla/mlir_hlo:mhlo_passes; 59s local 2025-03-14T06:45:14.7342257Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T06:45:14.7343345Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local 2025-03-14T06:45:14.7344527Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 22s local 2025-03-14T06:45:14.7345582Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2025-03-14T06:45:14.7346657Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local ... 2025-03-14T06:45:15.1247645Z 2025-03-14T06:45:15.1248438Z  2025-03-14T06:45:15.1248912Z  2025-03-14T06:45:15.1249318Z  2025-03-14T06:45:15.1249749Z  2025-03-14T06:45:15.1250140Z  2025-03-14T06:45:15.1250787Z  2025-03-14T06:45:15.1251355Z  2025-03-14T06:45:15.1251741Z  2025-03-14T06:45:15.1252671Z [20,097 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:15.1253656Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T06:45:15.1254355Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2025-03-14T06:45:15.1255002Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T06:45:15.1255953Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T06:45:15.1257146Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 22s local 2025-03-14T06:45:15.1258177Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 22s local 2025-03-14T06:45:15.1259092Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2025-03-14T06:45:15.1260041Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local ... 2025-03-14T06:45:15.3338748Z 2025-03-14T06:45:15.3339579Z  2025-03-14T06:45:15.3340077Z  2025-03-14T06:45:15.3340494Z  2025-03-14T06:45:15.3340894Z  2025-03-14T06:45:15.3341303Z  2025-03-14T06:45:15.3341705Z  2025-03-14T06:45:15.3342105Z  2025-03-14T06:45:15.3342499Z  2025-03-14T06:45:15.3343504Z [20,097 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:15.3344475Z @llvm-project//mlir:LinalgTransforms; 98s local 2025-03-14T06:45:15.3345487Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2025-03-14T06:45:15.3346107Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T06:45:15.3346774Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T06:45:15.3347737Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local 2025-03-14T06:45:15.3348945Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 22s local 2025-03-14T06:45:15.3350099Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 22s local 2025-03-14T06:45:15.3351108Z Compiling torch_xla/csrc/runtime/computation_client.cc; 21s local ... 2025-03-14T06:45:15.7343293Z 2025-03-14T06:45:15.7344161Z  2025-03-14T06:45:15.7344697Z  2025-03-14T06:45:15.7345110Z  2025-03-14T06:45:15.7345476Z  2025-03-14T06:45:15.7345869Z  2025-03-14T06:45:15.7346272Z  2025-03-14T06:45:15.7346679Z  2025-03-14T06:45:15.7347101Z  2025-03-14T06:45:15.7348106Z [20,098 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:15.7349105Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T06:45:15.7349818Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2025-03-14T06:45:15.7350387Z @xla//xla/mlir_hlo:mhlo_passes; 60s local 2025-03-14T06:45:15.7351085Z Compiling xla/service/elemental_ir_emitter.cc; 26s local 2025-03-14T06:45:15.7352116Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local 2025-03-14T06:45:15.7353226Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2025-03-14T06:45:15.7354134Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2025-03-14T06:45:15.7355103Z Compiling xla/service/elemental_ir_emitter.cc; 21s local ... 2025-03-14T06:45:15.9887576Z 2025-03-14T06:45:15.9888373Z  2025-03-14T06:45:15.9888877Z  2025-03-14T06:45:15.9889315Z  2025-03-14T06:45:15.9889742Z  2025-03-14T06:45:15.9890202Z  2025-03-14T06:45:15.9890634Z  2025-03-14T06:45:15.9891052Z  2025-03-14T06:45:15.9891478Z  2025-03-14T06:45:15.9892454Z [20,099 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:15.9893497Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T06:45:15.9894249Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2025-03-14T06:45:15.9894945Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2025-03-14T06:45:15.9896028Z Compiling xla/service/elemental_ir_emitter.cc; 26s local 2025-03-14T06:45:15.9897106Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 23s local 2025-03-14T06:45:15.9898201Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2025-03-14T06:45:15.9899300Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2025-03-14T06:45:15.9900275Z Compiling xla/service/elemental_ir_emitter.cc; 22s local ... 2025-03-14T06:45:16.3348114Z 2025-03-14T06:45:16.3348961Z  2025-03-14T06:45:16.3349435Z  2025-03-14T06:45:16.3349838Z  2025-03-14T06:45:16.3350656Z  2025-03-14T06:45:16.3351073Z  2025-03-14T06:45:16.3351480Z  2025-03-14T06:45:16.3351863Z  2025-03-14T06:45:16.3352296Z  2025-03-14T06:45:16.3353246Z [20,099 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:16.3354290Z @llvm-project//mlir:LinalgTransforms; 99s local 2025-03-14T06:45:16.3354982Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2025-03-14T06:45:16.3355627Z @xla//xla/mlir_hlo:mhlo_passes; 61s local 2025-03-14T06:45:16.3356398Z Compiling xla/service/elemental_ir_emitter.cc; 26s local 2025-03-14T06:45:16.3357401Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 24s local 2025-03-14T06:45:16.3358448Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2025-03-14T06:45:16.3359415Z Compiling torch_xla/csrc/runtime/computation_client.cc; 22s local 2025-03-14T06:45:16.3360613Z Compiling xla/service/elemental_ir_emitter.cc; 22s local ... 2025-03-14T06:45:17.3355465Z 2025-03-14T06:45:17.3356287Z  2025-03-14T06:45:17.3356753Z  2025-03-14T06:45:17.3357150Z  2025-03-14T06:45:17.3357549Z  2025-03-14T06:45:17.3357947Z  2025-03-14T06:45:17.3358341Z  2025-03-14T06:45:17.3358735Z  2025-03-14T06:45:17.3359126Z  2025-03-14T06:45:17.3360072Z [20,099 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:17.3361408Z @llvm-project//mlir:LinalgTransforms; 100s local 2025-03-14T06:45:17.3362111Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2025-03-14T06:45:17.3362749Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2025-03-14T06:45:17.3363477Z Compiling xla/service/elemental_ir_emitter.cc; 27s local 2025-03-14T06:45:17.3364470Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:45:17.3365920Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 24s local 2025-03-14T06:45:17.3366868Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2025-03-14T06:45:17.3367815Z Compiling xla/service/elemental_ir_emitter.cc; 23s local ... 2025-03-14T06:45:17.5909336Z 2025-03-14T06:45:17.5910197Z  2025-03-14T06:45:17.5910690Z  2025-03-14T06:45:17.5911101Z  2025-03-14T06:45:17.5911505Z  2025-03-14T06:45:17.5911908Z  2025-03-14T06:45:17.5912333Z  2025-03-14T06:45:17.5912726Z  2025-03-14T06:45:17.5913124Z  2025-03-14T06:45:17.5914034Z [20,100 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:17.5915014Z @llvm-project//mlir:LinalgTransforms; 100s local 2025-03-14T06:45:17.5915717Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T06:45:17.5916376Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2025-03-14T06:45:17.5917103Z Compiling xla/service/elemental_ir_emitter.cc; 27s local 2025-03-14T06:45:17.5918111Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:45:17.5919145Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 24s local 2025-03-14T06:45:17.5920089Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local 2025-03-14T06:45:17.5921007Z Compiling xla/service/elemental_ir_emitter.cc; 23s local ... 2025-03-14T06:45:17.8433778Z 2025-03-14T06:45:17.8434646Z  2025-03-14T06:45:17.8435188Z  2025-03-14T06:45:17.8435605Z  2025-03-14T06:45:17.8436284Z  2025-03-14T06:45:17.8436717Z  2025-03-14T06:45:17.8437106Z  2025-03-14T06:45:17.8437489Z  2025-03-14T06:45:17.8437890Z  2025-03-14T06:45:17.8438783Z [20,101 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:17.8439695Z @llvm-project//mlir:LinalgTransforms; 101s local 2025-03-14T06:45:17.8440389Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T06:45:17.8441036Z @xla//xla/mlir_hlo:mhlo_passes; 62s local 2025-03-14T06:45:17.8442122Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:45:17.8443150Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 25s local 2025-03-14T06:45:17.8444097Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2025-03-14T06:45:17.8445186Z Compiling xla/service/elemental_ir_emitter.cc; 23s local 2025-03-14T06:45:17.8446248Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 23s local ... 2025-03-14T06:45:18.1362543Z 2025-03-14T06:45:18.1363351Z  2025-03-14T06:45:18.1363794Z  2025-03-14T06:45:18.1364123Z  2025-03-14T06:45:18.1364431Z  2025-03-14T06:45:18.1364896Z  2025-03-14T06:45:18.1365264Z  2025-03-14T06:45:18.1365800Z  2025-03-14T06:45:18.1366173Z  2025-03-14T06:45:18.1366986Z [20,101 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:18.1368247Z @llvm-project//mlir:LinalgTransforms; 101s local 2025-03-14T06:45:18.1368979Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T06:45:18.1369592Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2025-03-14T06:45:18.1370440Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 25s local 2025-03-14T06:45:18.1371454Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 25s local 2025-03-14T06:45:18.1372408Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local 2025-03-14T06:45:18.1373526Z Compiling xla/service/elemental_ir_emitter.cc; 24s local 2025-03-14T06:45:18.1374575Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local ... 2025-03-14T06:45:18.9283463Z 2025-03-14T06:45:18.9284307Z  2025-03-14T06:45:18.9284872Z  2025-03-14T06:45:18.9285231Z  2025-03-14T06:45:18.9285589Z  2025-03-14T06:45:18.9285956Z  2025-03-14T06:45:18.9286293Z  2025-03-14T06:45:18.9286682Z  2025-03-14T06:45:18.9287042Z  2025-03-14T06:45:18.9287874Z [20,102 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:18.9288736Z @llvm-project//mlir:LinalgTransforms; 102s local 2025-03-14T06:45:18.9289374Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T06:45:18.9289960Z @xla//xla/mlir_hlo:mhlo_passes; 63s local 2025-03-14T06:45:18.9290749Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:45:18.9291690Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2025-03-14T06:45:18.9292475Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2025-03-14T06:45:18.9293254Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T06:45:18.9294128Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 24s local ... 2025-03-14T06:45:19.1369601Z 2025-03-14T06:45:19.1370363Z  2025-03-14T06:45:19.1370791Z  2025-03-14T06:45:19.1371196Z  2025-03-14T06:45:19.1371586Z  2025-03-14T06:45:19.1371949Z  2025-03-14T06:45:19.1372318Z  2025-03-14T06:45:19.1372638Z  2025-03-14T06:45:19.1372976Z  2025-03-14T06:45:19.1373802Z [20,102 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:19.1374664Z @llvm-project//mlir:LinalgTransforms; 102s local 2025-03-14T06:45:19.1375279Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T06:45:19.1376080Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T06:45:19.1376871Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:45:19.1377753Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2025-03-14T06:45:19.1378625Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2025-03-14T06:45:19.1379434Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T06:45:19.1380325Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local ... 2025-03-14T06:45:19.3372312Z 2025-03-14T06:45:19.3373393Z  2025-03-14T06:45:19.3373813Z  2025-03-14T06:45:19.3374154Z  2025-03-14T06:45:19.3374469Z  2025-03-14T06:45:19.3374799Z  2025-03-14T06:45:19.3375130Z  2025-03-14T06:45:19.3375456Z  2025-03-14T06:45:19.3375786Z  2025-03-14T06:45:19.3376585Z [20,104 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:19.3377445Z @llvm-project//mlir:LinalgTransforms; 102s local 2025-03-14T06:45:19.3378023Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T06:45:19.3378537Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T06:45:19.3379264Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:45:19.3380109Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2025-03-14T06:45:19.3381007Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local 2025-03-14T06:45:19.3382071Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T06:45:19.3382990Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local ... 2025-03-14T06:45:19.7278560Z 2025-03-14T06:45:19.7279428Z  2025-03-14T06:45:19.7279909Z  2025-03-14T06:45:19.7280309Z  2025-03-14T06:45:19.7280680Z  2025-03-14T06:45:19.7281046Z  2025-03-14T06:45:19.7281410Z  2025-03-14T06:45:19.7282082Z  2025-03-14T06:45:19.7282449Z  2025-03-14T06:45:19.7283350Z [20,105 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:19.7284281Z @llvm-project//mlir:LinalgTransforms; 103s local 2025-03-14T06:45:19.7285145Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2025-03-14T06:45:19.7285717Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T06:45:19.7286638Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:45:19.7287766Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2025-03-14T06:45:19.7288648Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2025-03-14T06:45:19.7289540Z Compiling xla/service/elemental_ir_emitter.cc; 25s local 2025-03-14T06:45:19.7290539Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local ... 2025-03-14T06:45:19.9378105Z 2025-03-14T06:45:19.9378942Z  2025-03-14T06:45:19.9379355Z  2025-03-14T06:45:19.9379734Z  2025-03-14T06:45:19.9380093Z  2025-03-14T06:45:19.9380482Z  2025-03-14T06:45:19.9380853Z  2025-03-14T06:45:19.9381344Z  2025-03-14T06:45:19.9381730Z  2025-03-14T06:45:19.9382664Z [20,105 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:19.9383645Z @llvm-project//mlir:LinalgTransforms; 103s local 2025-03-14T06:45:19.9384333Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2025-03-14T06:45:19.9385163Z @xla//xla/mlir_hlo:mhlo_passes; 64s local 2025-03-14T06:45:19.9386023Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:45:19.9387029Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2025-03-14T06:45:19.9387970Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2025-03-14T06:45:19.9388821Z Compiling xla/service/elemental_ir_emitter.cc; 26s local 2025-03-14T06:45:19.9389762Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 25s local ... 2025-03-14T06:45:20.2355134Z 2025-03-14T06:45:20.2356299Z  2025-03-14T06:45:20.2356836Z  2025-03-14T06:45:20.2357234Z  2025-03-14T06:45:20.2357639Z  2025-03-14T06:45:20.2358010Z  2025-03-14T06:45:20.2358391Z  2025-03-14T06:45:20.2358799Z  2025-03-14T06:45:20.2359236Z  2025-03-14T06:45:20.2360265Z [20,107 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:20.2361251Z @llvm-project//mlir:LinalgTransforms; 103s local 2025-03-14T06:45:20.2362086Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2025-03-14T06:45:20.2362703Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T06:45:20.2363534Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:45:20.2364709Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2025-03-14T06:45:20.2365806Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2025-03-14T06:45:20.2367059Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:45:20.2368004Z Compiling xla/python/ifrt/topology.cc; 19s local ... 2025-03-14T06:45:20.5019108Z 2025-03-14T06:45:20.5019949Z  2025-03-14T06:45:20.5020448Z  2025-03-14T06:45:20.5020812Z  2025-03-14T06:45:20.5021193Z  2025-03-14T06:45:20.5021596Z  2025-03-14T06:45:20.5022009Z  2025-03-14T06:45:20.5022412Z  2025-03-14T06:45:20.5023099Z  2025-03-14T06:45:20.5024057Z [20,109 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:20.5025064Z @llvm-project//mlir:LinalgTransforms; 103s local 2025-03-14T06:45:20.5025749Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2025-03-14T06:45:20.5026538Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T06:45:20.5027457Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:45:20.5028669Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2025-03-14T06:45:20.5029610Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local 2025-03-14T06:45:20.5030694Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:45:20.5031710Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local ... 2025-03-14T06:45:20.7200467Z 2025-03-14T06:45:20.7201318Z  2025-03-14T06:45:20.7201803Z  2025-03-14T06:45:20.7202234Z  2025-03-14T06:45:20.7202665Z  2025-03-14T06:45:20.7203054Z  2025-03-14T06:45:20.7203449Z  2025-03-14T06:45:20.7203844Z  2025-03-14T06:45:20.7204240Z  2025-03-14T06:45:20.7205297Z [20,110 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:20.7206215Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T06:45:20.7206931Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2025-03-14T06:45:20.7207560Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T06:45:20.7208396Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:45:20.7209436Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 28s local 2025-03-14T06:45:20.7210226Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2025-03-14T06:45:20.7211157Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:45:20.7212205Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local ... 2025-03-14T06:45:20.9384367Z 2025-03-14T06:45:20.9385239Z  2025-03-14T06:45:20.9385770Z  2025-03-14T06:45:20.9386179Z  2025-03-14T06:45:20.9386566Z  2025-03-14T06:45:20.9386950Z  2025-03-14T06:45:20.9387347Z  2025-03-14T06:45:20.9387749Z  2025-03-14T06:45:20.9388150Z  2025-03-14T06:45:20.9389124Z [20,112 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:20.9390134Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T06:45:20.9391103Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2025-03-14T06:45:20.9391768Z @xla//xla/mlir_hlo:mhlo_passes; 65s local 2025-03-14T06:45:20.9392607Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:45:20.9393657Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 28s local 2025-03-14T06:45:20.9394585Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2025-03-14T06:45:20.9395685Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 26s local 2025-03-14T06:45:20.9396968Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 18s local ... 2025-03-14T06:45:21.5389561Z 2025-03-14T06:45:21.5390409Z  2025-03-14T06:45:21.5390866Z  2025-03-14T06:45:21.5391250Z  2025-03-14T06:45:21.5391684Z  2025-03-14T06:45:21.5392074Z  2025-03-14T06:45:21.5392489Z  2025-03-14T06:45:21.5392907Z  2025-03-14T06:45:21.5393317Z  2025-03-14T06:45:21.5394274Z [20,113 / 20,652] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2025-03-14T06:45:21.5395283Z @llvm-project//mlir:LinalgTransforms; 104s local 2025-03-14T06:45:21.5395987Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2025-03-14T06:45:21.5396658Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2025-03-14T06:45:21.5397572Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:45:21.5398904Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 28s local 2025-03-14T06:45:21.5399889Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local 2025-03-14T06:45:21.5400869Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:45:21.5401899Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local ... 2025-03-14T06:45:21.7392158Z 2025-03-14T06:45:21.7393055Z  2025-03-14T06:45:21.7393535Z  2025-03-14T06:45:21.7394305Z  2025-03-14T06:45:21.7394744Z  2025-03-14T06:45:21.7395172Z  2025-03-14T06:45:21.7395580Z  2025-03-14T06:45:21.7396010Z  2025-03-14T06:45:21.7396429Z  2025-03-14T06:45:21.7397399Z [20,114 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:21.7398432Z @llvm-project//mlir:LinalgTransforms; 105s local 2025-03-14T06:45:21.7399177Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2025-03-14T06:45:21.7399863Z @xla//xla/mlir_hlo:mhlo_passes; 66s local 2025-03-14T06:45:21.7400823Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:45:21.7401935Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2025-03-14T06:45:21.7402884Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2025-03-14T06:45:21.7403937Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 27s local 2025-03-14T06:45:21.7405252Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 19s local ... 2025-03-14T06:45:22.1397323Z 2025-03-14T06:45:22.1398220Z  2025-03-14T06:45:22.1398717Z  2025-03-14T06:45:22.1399123Z  2025-03-14T06:45:22.1399540Z  2025-03-14T06:45:22.1399963Z  2025-03-14T06:45:22.1400364Z  2025-03-14T06:45:22.1400776Z  2025-03-14T06:45:22.1401204Z  2025-03-14T06:45:22.1402195Z [20,115 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:22.1403276Z @llvm-project//mlir:LinalgTransforms; 105s local 2025-03-14T06:45:22.1403999Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2025-03-14T06:45:22.1404796Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2025-03-14T06:45:22.1405709Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:45:22.1406915Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2025-03-14T06:45:22.1407832Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2025-03-14T06:45:22.1409243Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:45:22.1410331Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local ... 2025-03-14T06:45:22.5605802Z 2025-03-14T06:45:22.5606627Z  2025-03-14T06:45:22.5607070Z  2025-03-14T06:45:22.5607439Z  2025-03-14T06:45:22.5607827Z  2025-03-14T06:45:22.5608224Z  2025-03-14T06:45:22.5608563Z  2025-03-14T06:45:22.5608911Z  2025-03-14T06:45:22.5609285Z  2025-03-14T06:45:22.5610390Z [20,116 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:22.5611262Z @llvm-project//mlir:LinalgTransforms; 105s local 2025-03-14T06:45:22.5611892Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2025-03-14T06:45:22.5612443Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2025-03-14T06:45:22.5613249Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:45:22.5614172Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2025-03-14T06:45:22.5615004Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2025-03-14T06:45:22.5615970Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:45:22.5616933Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local ... 2025-03-14T06:45:22.9403031Z 2025-03-14T06:45:22.9403897Z  2025-03-14T06:45:22.9404378Z  2025-03-14T06:45:22.9404937Z  2025-03-14T06:45:22.9405649Z  2025-03-14T06:45:22.9406044Z  2025-03-14T06:45:22.9406447Z  2025-03-14T06:45:22.9406856Z  2025-03-14T06:45:22.9407260Z  2025-03-14T06:45:22.9408176Z [20,116 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:22.9409173Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T06:45:22.9409833Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2025-03-14T06:45:22.9410648Z @xla//xla/mlir_hlo:mhlo_passes; 67s local 2025-03-14T06:45:22.9411516Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:45:22.9412561Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2025-03-14T06:45:22.9413507Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T06:45:22.9414583Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 28s local 2025-03-14T06:45:22.9415633Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 20s local ... 2025-03-14T06:45:23.4769616Z 2025-03-14T06:45:23.4770547Z  2025-03-14T06:45:23.4771113Z  2025-03-14T06:45:23.4771503Z  2025-03-14T06:45:23.4771886Z  2025-03-14T06:45:23.4772255Z  2025-03-14T06:45:23.4772632Z  2025-03-14T06:45:23.4772999Z  2025-03-14T06:45:23.4773362Z  2025-03-14T06:45:23.4774240Z [20,117 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:23.4775166Z @llvm-project//mlir:LinalgTransforms; 106s local 2025-03-14T06:45:23.4775827Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T06:45:23.4776484Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2025-03-14T06:45:23.4777308Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:45:23.4778317Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2025-03-14T06:45:23.4779082Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T06:45:23.4779952Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:45:23.4780820Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local ... 2025-03-14T06:45:23.7409637Z 2025-03-14T06:45:23.7410494Z  2025-03-14T06:45:23.7410995Z  2025-03-14T06:45:23.7411409Z  2025-03-14T06:45:23.7411827Z  2025-03-14T06:45:23.7412237Z  2025-03-14T06:45:23.7412649Z  2025-03-14T06:45:23.7413063Z  2025-03-14T06:45:23.7413498Z  2025-03-14T06:45:23.7414735Z [20,117 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:23.7415757Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T06:45:23.7416473Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T06:45:23.7417108Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2025-03-14T06:45:23.7417984Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:45:23.7419065Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 31s local 2025-03-14T06:45:23.7420150Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T06:45:23.7421276Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:45:23.7422388Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local ... 2025-03-14T06:45:23.9412442Z 2025-03-14T06:45:23.9413304Z  2025-03-14T06:45:23.9413761Z  2025-03-14T06:45:23.9414177Z  2025-03-14T06:45:23.9414559Z  2025-03-14T06:45:23.9414952Z  2025-03-14T06:45:23.9415460Z  2025-03-14T06:45:23.9415810Z  2025-03-14T06:45:23.9416185Z  2025-03-14T06:45:23.9417064Z [20,119 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:23.9417983Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T06:45:23.9418634Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T06:45:23.9419493Z @xla//xla/mlir_hlo:mhlo_passes; 68s local 2025-03-14T06:45:23.9420355Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:45:23.9421345Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T06:45:23.9422335Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 29s local 2025-03-14T06:45:23.9423288Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 21s local 2025-03-14T06:45:23.9424161Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 21s local ... 2025-03-14T06:45:24.3098446Z 2025-03-14T06:45:24.3099296Z  2025-03-14T06:45:24.3099742Z  2025-03-14T06:45:24.3100104Z  2025-03-14T06:45:24.3100475Z  2025-03-14T06:45:24.3100827Z  2025-03-14T06:45:24.3101175Z  2025-03-14T06:45:24.3101528Z  2025-03-14T06:45:24.3101874Z  2025-03-14T06:45:24.3102749Z [20,120 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:24.3103647Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T06:45:24.3104292Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T06:45:24.3104867Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2025-03-14T06:45:24.3105680Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:45:24.3106659Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T06:45:24.3107618Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:45:24.3108553Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2025-03-14T06:45:24.3109447Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 22s local ... 2025-03-14T06:45:24.5417980Z 2025-03-14T06:45:24.5418888Z  2025-03-14T06:45:24.5419378Z  2025-03-14T06:45:24.5419740Z  2025-03-14T06:45:24.5420116Z  2025-03-14T06:45:24.5420488Z  2025-03-14T06:45:24.5420887Z  2025-03-14T06:45:24.5421262Z  2025-03-14T06:45:24.5421697Z  2025-03-14T06:45:24.5422579Z [20,120 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:24.5423515Z @llvm-project//mlir:LinalgTransforms; 107s local 2025-03-14T06:45:24.5424176Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2025-03-14T06:45:24.5424753Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2025-03-14T06:45:24.5425593Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:45:24.5426900Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T06:45:24.5427947Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:45:24.5428910Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2025-03-14T06:45:24.5429789Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 22s local ... 2025-03-14T06:45:24.7828366Z 2025-03-14T06:45:24.7829222Z  2025-03-14T06:45:24.7829761Z  2025-03-14T06:45:24.7830207Z  2025-03-14T06:45:24.7830622Z  2025-03-14T06:45:24.7831071Z  2025-03-14T06:45:24.7831783Z  2025-03-14T06:45:24.7832210Z  2025-03-14T06:45:24.7832672Z  2025-03-14T06:45:24.7833589Z [20,121 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:24.7834694Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T06:45:24.7835381Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2025-03-14T06:45:24.7836032Z @xla//xla/mlir_hlo:mhlo_passes; 69s local 2025-03-14T06:45:24.7836918Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:45:24.7837994Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2025-03-14T06:45:24.7839078Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 30s local 2025-03-14T06:45:24.7840170Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 22s local 2025-03-14T06:45:24.7841156Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 22s local ... 2025-03-14T06:45:25.1423300Z 2025-03-14T06:45:25.1424208Z  2025-03-14T06:45:25.1424644Z  2025-03-14T06:45:25.1425059Z  2025-03-14T06:45:25.1425465Z  2025-03-14T06:45:25.1425863Z  2025-03-14T06:45:25.1426282Z  2025-03-14T06:45:25.1426673Z  2025-03-14T06:45:25.1427084Z  2025-03-14T06:45:25.1428056Z [20,121 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:25.1429429Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T06:45:25.1430263Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2025-03-14T06:45:25.1430925Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T06:45:25.1431835Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:45:25.1432909Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2025-03-14T06:45:25.1433934Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:45:25.1435015Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2025-03-14T06:45:25.1436022Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 23s local ... 2025-03-14T06:45:25.3495671Z 2025-03-14T06:45:25.3496484Z  2025-03-14T06:45:25.3496860Z  2025-03-14T06:45:25.3497195Z  2025-03-14T06:45:25.3497640Z  2025-03-14T06:45:25.3498079Z  2025-03-14T06:45:25.3498498Z  2025-03-14T06:45:25.3498953Z  2025-03-14T06:45:25.3499345Z  2025-03-14T06:45:25.3500283Z [20,122 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:25.3501340Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T06:45:25.3502105Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2025-03-14T06:45:25.3502778Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T06:45:25.3503661Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:45:25.3504830Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2025-03-14T06:45:25.3505959Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:45:25.3507057Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2025-03-14T06:45:25.3508066Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 23s local ... 2025-03-14T06:45:25.5718992Z 2025-03-14T06:45:25.5719819Z  2025-03-14T06:45:25.5720347Z  2025-03-14T06:45:25.5720768Z  2025-03-14T06:45:25.5721198Z  2025-03-14T06:45:25.5721988Z  2025-03-14T06:45:25.5722417Z  2025-03-14T06:45:25.5722794Z  2025-03-14T06:45:25.5723150Z  2025-03-14T06:45:25.5724268Z [20,124 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:25.5725416Z @llvm-project//mlir:LinalgTransforms; 108s local 2025-03-14T06:45:25.5726144Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2025-03-14T06:45:25.5726850Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T06:45:25.5727953Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:45:25.5729257Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:45:25.5730229Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2025-03-14T06:45:25.5731130Z Compiling xla/service/spmd/shardy/shardy_xla_pass.cc; 23s local 2025-03-14T06:45:25.5732126Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 22s local ... 2025-03-14T06:45:25.9429427Z 2025-03-14T06:45:25.9430316Z  2025-03-14T06:45:25.9430777Z  2025-03-14T06:45:25.9431208Z  2025-03-14T06:45:25.9431634Z  2025-03-14T06:45:25.9432032Z  2025-03-14T06:45:25.9442707Z  2025-03-14T06:45:25.9443475Z  2025-03-14T06:45:25.9443897Z  2025-03-14T06:45:25.9445001Z [20,128 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:25.9446310Z @llvm-project//mlir:LinalgTransforms; 109s local 2025-03-14T06:45:25.9447002Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2025-03-14T06:45:25.9447654Z @xla//xla/mlir_hlo:mhlo_passes; 70s local 2025-03-14T06:45:25.9448553Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:45:25.9449668Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 31s local 2025-03-14T06:45:25.9450745Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local 2025-03-14T06:45:25.9451930Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 22s local 2025-03-14T06:45:25.9452889Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local ... 2025-03-14T06:45:26.3126062Z 2025-03-14T06:45:26.3126889Z  2025-03-14T06:45:26.3127305Z  2025-03-14T06:45:26.3127653Z  2025-03-14T06:45:26.3128028Z  2025-03-14T06:45:26.3128413Z  2025-03-14T06:45:26.3128778Z  2025-03-14T06:45:26.3129177Z  2025-03-14T06:45:26.3129504Z  2025-03-14T06:45:26.3130289Z [20,129 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:26.3131110Z @llvm-project//mlir:LinalgTransforms; 109s local 2025-03-14T06:45:26.3131717Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2025-03-14T06:45:26.3132262Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2025-03-14T06:45:26.3133025Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:45:26.3134102Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:45:26.3135088Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2025-03-14T06:45:26.3135950Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local 2025-03-14T06:45:26.3136817Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local ... 2025-03-14T06:45:26.5434354Z 2025-03-14T06:45:26.5435204Z  2025-03-14T06:45:26.5435667Z  2025-03-14T06:45:26.5436077Z  2025-03-14T06:45:26.5436461Z  2025-03-14T06:45:26.5436835Z  2025-03-14T06:45:26.5437177Z  2025-03-14T06:45:26.5437503Z  2025-03-14T06:45:26.5437872Z  2025-03-14T06:45:26.5438810Z [20,129 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:26.5439831Z @llvm-project//mlir:LinalgTransforms; 109s local 2025-03-14T06:45:26.5440492Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2025-03-14T06:45:26.5441419Z @xla//xla/mlir_hlo:mhlo_passes; 71s local 2025-03-14T06:45:26.5442359Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:45:26.5443524Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 32s local 2025-03-14T06:45:26.5444736Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2025-03-14T06:45:26.5445605Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 23s local 2025-03-14T06:45:26.5446606Z Compiling xla/pjrt/tracked_device_buffer.cc; 22s local ... 2025-03-14T06:45:27.2355698Z 2025-03-14T06:45:27.2356939Z  2025-03-14T06:45:27.2357493Z  2025-03-14T06:45:27.2357911Z  2025-03-14T06:45:27.2358331Z  2025-03-14T06:45:27.2358754Z  2025-03-14T06:45:27.2359166Z  2025-03-14T06:45:27.2359586Z  2025-03-14T06:45:27.2359998Z  2025-03-14T06:45:27.2360946Z [20,130 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:27.2361990Z @llvm-project//mlir:LinalgTransforms; 110s local 2025-03-14T06:45:27.2362725Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2025-03-14T06:45:27.2363390Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2025-03-14T06:45:27.2364302Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:45:27.2365822Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:45:27.2366908Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2025-03-14T06:45:27.2368155Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local 2025-03-14T06:45:27.2369163Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local ... 2025-03-14T06:45:27.5442299Z 2025-03-14T06:45:27.5443144Z  2025-03-14T06:45:27.5443634Z  2025-03-14T06:45:27.5444046Z  2025-03-14T06:45:27.5444455Z  2025-03-14T06:45:27.5445028Z  2025-03-14T06:45:27.5445419Z  2025-03-14T06:45:27.5446104Z  2025-03-14T06:45:27.5446481Z  2025-03-14T06:45:27.5447457Z [20,130 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:27.5448472Z @llvm-project//mlir:LinalgTransforms; 110s local 2025-03-14T06:45:27.5449182Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2025-03-14T06:45:27.5449837Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2025-03-14T06:45:27.5450695Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:45:27.5451978Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:45:27.5452983Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2025-03-14T06:45:27.5453955Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local 2025-03-14T06:45:27.5454887Z Compiling xla/pjrt/tracked_device_buffer.cc; 23s local ... 2025-03-14T06:45:27.9446779Z 2025-03-14T06:45:27.9447792Z  2025-03-14T06:45:27.9448318Z  2025-03-14T06:45:27.9448746Z  2025-03-14T06:45:27.9449176Z  2025-03-14T06:45:27.9449608Z  2025-03-14T06:45:27.9450010Z  2025-03-14T06:45:27.9450420Z  2025-03-14T06:45:27.9450846Z  2025-03-14T06:45:27.9451836Z [20,131 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:27.9452872Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T06:45:27.9453469Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2025-03-14T06:45:27.9454114Z @xla//xla/mlir_hlo:mhlo_passes; 72s local 2025-03-14T06:45:27.9455019Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:45:27.9456147Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 33s local 2025-03-14T06:45:27.9457246Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2025-03-14T06:45:27.9458207Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 24s local 2025-03-14T06:45:27.9459157Z Compiling xla/pjrt/tracked_device_buffer.cc; 24s local ... 2025-03-14T06:45:28.3451067Z 2025-03-14T06:45:28.3451922Z  2025-03-14T06:45:28.3452412Z  2025-03-14T06:45:28.3452850Z  2025-03-14T06:45:28.3453256Z  2025-03-14T06:45:28.3453653Z  2025-03-14T06:45:28.3454053Z  2025-03-14T06:45:28.3454451Z  2025-03-14T06:45:28.3454972Z  2025-03-14T06:45:28.3455933Z [20,132 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:28.3456960Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T06:45:28.3457898Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2025-03-14T06:45:28.3458568Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2025-03-14T06:45:28.3459491Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:45:28.3460682Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:45:28.3461676Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2025-03-14T06:45:28.3462646Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local 2025-03-14T06:45:28.3463553Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local ... 2025-03-14T06:45:28.5454100Z 2025-03-14T06:45:28.5454931Z  2025-03-14T06:45:28.5455416Z  2025-03-14T06:45:28.5455820Z  2025-03-14T06:45:28.5456205Z  2025-03-14T06:45:28.5456588Z  2025-03-14T06:45:28.5456968Z  2025-03-14T06:45:28.5457659Z  2025-03-14T06:45:28.5458085Z  2025-03-14T06:45:28.5458995Z [20,133 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:28.5459971Z @llvm-project//mlir:LinalgTransforms; 111s local 2025-03-14T06:45:28.5460669Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T06:45:28.5461432Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2025-03-14T06:45:28.5462337Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:45:28.5463749Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:45:28.5464784Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2025-03-14T06:45:28.5466052Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local 2025-03-14T06:45:28.5467059Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local ... 2025-03-14T06:45:28.9458355Z 2025-03-14T06:45:28.9459209Z  2025-03-14T06:45:28.9459724Z  2025-03-14T06:45:28.9460117Z  2025-03-14T06:45:28.9460515Z  2025-03-14T06:45:28.9460879Z  2025-03-14T06:45:28.9461304Z  2025-03-14T06:45:28.9461689Z  2025-03-14T06:45:28.9462091Z  2025-03-14T06:45:28.9463014Z [20,134 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:28.9464049Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T06:45:28.9464715Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T06:45:28.9465606Z @xla//xla/mlir_hlo:mhlo_passes; 73s local 2025-03-14T06:45:28.9466473Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:45:28.9467633Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 34s local 2025-03-14T06:45:28.9468660Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2025-03-14T06:45:28.9469631Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 25s local 2025-03-14T06:45:28.9470637Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 23s local ... 2025-03-14T06:45:29.1659771Z 2025-03-14T06:45:29.1660667Z  2025-03-14T06:45:29.1661102Z  2025-03-14T06:45:29.1661464Z  2025-03-14T06:45:29.1661838Z  2025-03-14T06:45:29.1662210Z  2025-03-14T06:45:29.1662571Z  2025-03-14T06:45:29.1662926Z  2025-03-14T06:45:29.1663275Z  2025-03-14T06:45:29.1664097Z [20,135 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:29.1665221Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T06:45:29.1666104Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T06:45:29.1666681Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2025-03-14T06:45:29.1667438Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:45:29.1668508Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:45:29.1669458Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T06:45:29.1670554Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local 2025-03-14T06:45:29.1671465Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local ... 2025-03-14T06:45:29.5463238Z 2025-03-14T06:45:29.5464069Z  2025-03-14T06:45:29.5464464Z  2025-03-14T06:45:29.5464796Z  2025-03-14T06:45:29.5465115Z  2025-03-14T06:45:29.5465671Z  2025-03-14T06:45:29.5466029Z  2025-03-14T06:45:29.5466358Z  2025-03-14T06:45:29.5466679Z  2025-03-14T06:45:29.5467455Z [20,135 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:29.5468225Z @llvm-project//mlir:LinalgTransforms; 112s local 2025-03-14T06:45:29.5468776Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2025-03-14T06:45:29.5469281Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2025-03-14T06:45:29.5469977Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:45:29.5471152Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:45:29.5471959Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T06:45:29.5472727Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local 2025-03-14T06:45:29.5473514Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local ... 2025-03-14T06:45:29.9359044Z 2025-03-14T06:45:29.9359872Z  2025-03-14T06:45:29.9360612Z  2025-03-14T06:45:29.9361014Z  2025-03-14T06:45:29.9361420Z  2025-03-14T06:45:29.9361812Z  2025-03-14T06:45:29.9362198Z  2025-03-14T06:45:29.9362578Z  2025-03-14T06:45:29.9362976Z  2025-03-14T06:45:29.9363919Z [20,137 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:29.9365031Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2025-03-14T06:45:29.9365873Z @xla//xla/mlir_hlo:mhlo_passes; 74s local 2025-03-14T06:45:29.9366847Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:45:29.9367828Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 35s local 2025-03-14T06:45:29.9368815Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T06:45:29.9369806Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 26s local 2025-03-14T06:45:29.9370803Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 24s local 2025-03-14T06:45:29.9371753Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local ... 2025-03-14T06:45:30.1466537Z 2025-03-14T06:45:30.1467523Z  2025-03-14T06:45:30.1468170Z  2025-03-14T06:45:30.1468606Z  2025-03-14T06:45:30.1469054Z  2025-03-14T06:45:30.1469439Z  2025-03-14T06:45:30.1469836Z  2025-03-14T06:45:30.1470217Z  2025-03-14T06:45:30.1470598Z  2025-03-14T06:45:30.1471519Z [20,137 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:30.1472508Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2025-03-14T06:45:30.1473140Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T06:45:30.1474003Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:45:30.1475145Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:45:30.1476181Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 28s local 2025-03-14T06:45:30.1477477Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2025-03-14T06:45:30.1478479Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2025-03-14T06:45:30.1479424Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local ... 2025-03-14T06:45:30.3723319Z 2025-03-14T06:45:30.3724168Z  2025-03-14T06:45:30.3724812Z  2025-03-14T06:45:30.3725194Z  2025-03-14T06:45:30.3725592Z  2025-03-14T06:45:30.3726282Z  2025-03-14T06:45:30.3726874Z  2025-03-14T06:45:30.3727443Z  2025-03-14T06:45:30.3727999Z  2025-03-14T06:45:30.3729693Z [20,138 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:30.3731003Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2025-03-14T06:45:30.3731902Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T06:45:30.3733191Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2025-03-14T06:45:30.3734812Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:45:30.3736334Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2025-03-14T06:45:30.3737721Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2025-03-14T06:45:30.3738998Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 23s local 2025-03-14T06:45:30.3740398Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 23s local ... 2025-03-14T06:45:30.7484829Z 2025-03-14T06:45:30.7486872Z  2025-03-14T06:45:30.7487411Z  2025-03-14T06:45:30.7487807Z  2025-03-14T06:45:30.7488212Z  2025-03-14T06:45:30.7488595Z  2025-03-14T06:45:30.7488984Z  2025-03-14T06:45:30.7489393Z  2025-03-14T06:45:30.7489766Z  2025-03-14T06:45:30.7490633Z [20,138 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:30.7491538Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2025-03-14T06:45:30.7492425Z @xla//xla/mlir_hlo:mhlo_passes; 75s local 2025-03-14T06:45:30.7493309Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2025-03-14T06:45:30.7494398Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 36s local 2025-03-14T06:45:30.7495504Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2025-03-14T06:45:30.7496492Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 25s local 2025-03-14T06:45:30.7497400Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 24s local 2025-03-14T06:45:30.7498305Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local ... 2025-03-14T06:45:31.1106217Z 2025-03-14T06:45:31.1107057Z  2025-03-14T06:45:31.1107452Z  2025-03-14T06:45:31.1107779Z  2025-03-14T06:45:31.1108100Z  2025-03-14T06:45:31.1108414Z  2025-03-14T06:45:31.1108726Z  2025-03-14T06:45:31.1109043Z  2025-03-14T06:45:31.1109394Z  2025-03-14T06:45:31.1110277Z [20,139 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:31.1111067Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2025-03-14T06:45:31.1111585Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2025-03-14T06:45:31.1112307Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 38s local 2025-03-14T06:45:31.1113274Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:45:31.1114223Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 27s local 2025-03-14T06:45:31.1115114Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2025-03-14T06:45:31.1115831Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 24s local 2025-03-14T06:45:31.1116584Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local ... 2025-03-14T06:45:31.3474963Z 2025-03-14T06:45:31.3475826Z  2025-03-14T06:45:31.3476297Z  2025-03-14T06:45:31.3476674Z  2025-03-14T06:45:31.3477109Z  2025-03-14T06:45:31.3477503Z  2025-03-14T06:45:31.3477907Z  2025-03-14T06:45:31.3478536Z  2025-03-14T06:45:31.3478942Z  2025-03-14T06:45:31.3479919Z [20,139 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:31.3480819Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2025-03-14T06:45:31.3481580Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2025-03-14T06:45:31.3482446Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T06:45:31.3484250Z Compiling stablehlo/transforms/ChloLegalizeToStablehlo.cpp; 37s local 2025-03-14T06:45:31.3485452Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2025-03-14T06:45:31.3486447Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2025-03-14T06:45:31.3487520Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 24s local 2025-03-14T06:45:31.3488519Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local ... 2025-03-14T06:45:31.9429521Z 2025-03-14T06:45:31.9430635Z  2025-03-14T06:45:31.9431209Z  2025-03-14T06:45:31.9431606Z  2025-03-14T06:45:31.9431961Z  2025-03-14T06:45:31.9432349Z  2025-03-14T06:45:31.9432720Z  2025-03-14T06:45:31.9433094Z  2025-03-14T06:45:31.9433479Z  2025-03-14T06:45:31.9434434Z [20,140 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:31.9435377Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2025-03-14T06:45:31.9436277Z @xla//xla/mlir_hlo:mhlo_passes; 76s local 2025-03-14T06:45:31.9437166Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T06:45:31.9438276Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 28s local 2025-03-14T06:45:31.9439282Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 26s local 2025-03-14T06:45:31.9440206Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 25s local 2025-03-14T06:45:31.9441349Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2025-03-14T06:45:31.9442148Z @stablehlo//:stablehlo_passes; 24s local ... 2025-03-14T06:45:32.1484331Z 2025-03-14T06:45:32.1485312Z  2025-03-14T06:45:32.1485822Z  2025-03-14T06:45:32.1486235Z  2025-03-14T06:45:32.1486634Z  2025-03-14T06:45:32.1487039Z  2025-03-14T06:45:32.1487441Z  2025-03-14T06:45:32.1487845Z  2025-03-14T06:45:32.1488356Z  2025-03-14T06:45:32.1489341Z [20,140 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:32.1490272Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2025-03-14T06:45:32.1490923Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2025-03-14T06:45:32.1491832Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 39s local 2025-03-14T06:45:32.1492946Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T06:45:32.1493946Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T06:45:32.1494879Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 25s local 2025-03-14T06:45:32.1495787Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2025-03-14T06:45:32.1496601Z @stablehlo//:stablehlo_passes; 24s local ... 2025-03-14T06:45:32.8897123Z 2025-03-14T06:45:32.8898062Z  2025-03-14T06:45:32.8898628Z  2025-03-14T06:45:32.8899106Z  2025-03-14T06:45:32.8899498Z  2025-03-14T06:45:32.8899944Z  2025-03-14T06:45:32.8900343Z  2025-03-14T06:45:32.8900759Z  2025-03-14T06:45:32.8901213Z  2025-03-14T06:45:32.8902150Z [20,141 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:32.8903255Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2025-03-14T06:45:32.8903968Z @xla//xla/mlir_hlo:mhlo_passes; 77s local 2025-03-14T06:45:32.8904870Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2025-03-14T06:45:32.8906303Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 29s local 2025-03-14T06:45:32.8907383Z Compiling xla/pjrt/cpu/abstract_tfrt_cpu_buffer.cc; 27s local 2025-03-14T06:45:32.8908354Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2025-03-14T06:45:32.8909297Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2025-03-14T06:45:32.8910154Z @stablehlo//:stablehlo_passes; 25s local ... 2025-03-14T06:45:33.1488218Z 2025-03-14T06:45:33.1489108Z  2025-03-14T06:45:33.1489591Z  2025-03-14T06:45:33.1489993Z  2025-03-14T06:45:33.1490668Z  2025-03-14T06:45:33.1491100Z  2025-03-14T06:45:33.1491506Z  2025-03-14T06:45:33.1491909Z  2025-03-14T06:45:33.1492327Z  2025-03-14T06:45:33.1493279Z [20,142 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:33.1494209Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2025-03-14T06:45:33.1494880Z @xla//xla/mlir_hlo:mhlo_passes; 78s local 2025-03-14T06:45:33.1495759Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 40s local 2025-03-14T06:45:33.1496759Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2025-03-14T06:45:33.1497741Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 26s local 2025-03-14T06:45:33.1498683Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2025-03-14T06:45:33.1499460Z @stablehlo//:stablehlo_passes; 25s local 2025-03-14T06:45:33.1500533Z Compiling torch_xla/csrc/runtime/computation_client.cc; 23s local ... 2025-03-14T06:45:34.1183439Z 2025-03-14T06:45:34.1184292Z  2025-03-14T06:45:34.1184795Z  2025-03-14T06:45:34.1185189Z  2025-03-14T06:45:34.1185760Z  2025-03-14T06:45:34.1186174Z  2025-03-14T06:45:34.1186581Z  2025-03-14T06:45:34.1187000Z  2025-03-14T06:45:34.1187420Z  2025-03-14T06:45:34.1188314Z [20,143 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:34.1189482Z @xla//xla/mlir_hlo:mhlo_passes; 80s local 2025-03-14T06:45:34.1190072Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2025-03-14T06:45:34.1190957Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 41s local 2025-03-14T06:45:34.1192039Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 30s local 2025-03-14T06:45:34.1193001Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2025-03-14T06:45:34.1193942Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 27s local 2025-03-14T06:45:34.1194748Z @stablehlo//:stablehlo_passes; 26s local 2025-03-14T06:45:34.1195585Z Compiling torch_xla/csrc/runtime/computation_client.cc; 24s local ... 2025-03-14T06:45:34.3496474Z 2025-03-14T06:45:34.3497345Z  2025-03-14T06:45:34.3497843Z  2025-03-14T06:45:34.3498286Z  2025-03-14T06:45:34.3498717Z  2025-03-14T06:45:34.3499111Z  2025-03-14T06:45:34.3499569Z  2025-03-14T06:45:34.3500129Z  2025-03-14T06:45:34.3500527Z  2025-03-14T06:45:34.3501538Z [20,143 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:34.3502472Z @xla//xla/mlir_hlo:mhlo_passes; 80s local 2025-03-14T06:45:34.3503099Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2025-03-14T06:45:34.3503837Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2025-03-14T06:45:34.3504901Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T06:45:34.3505868Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 27s local 2025-03-14T06:45:34.3506836Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 27s local 2025-03-14T06:45:34.3507657Z @stablehlo//:stablehlo_passes; 26s local 2025-03-14T06:45:34.3508416Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local ... 2025-03-14T06:45:34.5499772Z 2025-03-14T06:45:34.5500628Z  2025-03-14T06:45:34.5501108Z  2025-03-14T06:45:34.5501523Z  2025-03-14T06:45:34.5502168Z  2025-03-14T06:45:34.5502582Z  2025-03-14T06:45:34.5502925Z  2025-03-14T06:45:34.5503247Z  2025-03-14T06:45:34.5503619Z  2025-03-14T06:45:34.5504579Z [20,144 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:34.5505465Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2025-03-14T06:45:34.5506081Z @xla//xla/mlir_hlo:mhlo_passes; 79s local 2025-03-14T06:45:34.5507135Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 42s local 2025-03-14T06:45:34.5508183Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 31s local 2025-03-14T06:45:34.5509325Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 28s local 2025-03-14T06:45:34.5510270Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 28s local 2025-03-14T06:45:34.5511097Z @stablehlo//:stablehlo_passes; 27s local 2025-03-14T06:45:34.5511987Z Compiling torch_xla/csrc/runtime/computation_client.cc; 25s local ... 2025-03-14T06:45:35.7508057Z 2025-03-14T06:45:35.7508886Z  2025-03-14T06:45:35.7509327Z  2025-03-14T06:45:35.7509696Z  2025-03-14T06:45:35.7510064Z  2025-03-14T06:45:35.7510427Z  2025-03-14T06:45:35.7510783Z  2025-03-14T06:45:35.7511148Z  2025-03-14T06:45:35.7511507Z  2025-03-14T06:45:35.7512351Z [20,144 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:35.7513500Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2025-03-14T06:45:35.7514079Z @xla//xla/mlir_hlo:mhlo_passes; 80s local 2025-03-14T06:45:35.7514837Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2025-03-14T06:45:35.7515812Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2025-03-14T06:45:35.7516696Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2025-03-14T06:45:35.7517703Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2025-03-14T06:45:35.7518432Z @stablehlo//:stablehlo_passes; 28s local 2025-03-14T06:45:35.7519174Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local ... 2025-03-14T06:45:35.9511217Z 2025-03-14T06:45:35.9512046Z  2025-03-14T06:45:35.9512475Z  2025-03-14T06:45:35.9512837Z  2025-03-14T06:45:35.9513177Z  2025-03-14T06:45:35.9513515Z  2025-03-14T06:45:35.9513873Z  2025-03-14T06:45:35.9514257Z  2025-03-14T06:45:35.9514618Z  2025-03-14T06:45:35.9515445Z [20,145 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:35.9516257Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2025-03-14T06:45:35.9516820Z @xla//xla/mlir_hlo:mhlo_passes; 80s local 2025-03-14T06:45:35.9517586Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 43s local 2025-03-14T06:45:35.9518545Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 32s local 2025-03-14T06:45:35.9519434Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 29s local 2025-03-14T06:45:35.9520248Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2025-03-14T06:45:35.9520946Z @stablehlo//:stablehlo_passes; 28s local 2025-03-14T06:45:35.9521690Z Compiling torch_xla/csrc/runtime/computation_client.cc; 26s local ... 2025-03-14T06:45:36.9519199Z 2025-03-14T06:45:36.9520157Z  2025-03-14T06:45:36.9520605Z  2025-03-14T06:45:36.9521032Z  2025-03-14T06:45:36.9521417Z  2025-03-14T06:45:36.9521799Z  2025-03-14T06:45:36.9522135Z  2025-03-14T06:45:36.9522496Z  2025-03-14T06:45:36.9522868Z  2025-03-14T06:45:36.9523791Z [20,145 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:36.9524822Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2025-03-14T06:45:36.9525452Z @xla//xla/mlir_hlo:mhlo_passes; 81s local 2025-03-14T06:45:36.9526476Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 44s local 2025-03-14T06:45:36.9527534Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 33s local 2025-03-14T06:45:36.9528459Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2025-03-14T06:45:36.9529208Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2025-03-14T06:45:36.9529895Z @stablehlo//:stablehlo_passes; 29s local 2025-03-14T06:45:36.9530582Z Compiling torch_xla/csrc/runtime/computation_client.cc; 27s local ... 2025-03-14T06:45:37.3524996Z 2025-03-14T06:45:37.3526177Z  2025-03-14T06:45:37.3526670Z  2025-03-14T06:45:37.3527098Z  2025-03-14T06:45:37.3527469Z  2025-03-14T06:45:37.3527838Z  2025-03-14T06:45:37.3528222Z  2025-03-14T06:45:37.3528616Z  2025-03-14T06:45:37.3528981Z  2025-03-14T06:45:37.3529926Z [20,146 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:37.3530856Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2025-03-14T06:45:37.3531469Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2025-03-14T06:45:37.3532330Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T06:45:37.3533409Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2025-03-14T06:45:37.3534406Z Compiling xla/pjrt/c/pjrt_c_api_wrapper_impl.cc; 30s local 2025-03-14T06:45:37.3535317Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2025-03-14T06:45:37.3536379Z @stablehlo//:stablehlo_passes; 29s local 2025-03-14T06:45:37.3537083Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local ... 2025-03-14T06:45:37.7529383Z 2025-03-14T06:45:37.7530497Z  2025-03-14T06:45:37.7531010Z  2025-03-14T06:45:37.7531406Z  2025-03-14T06:45:37.7531795Z  2025-03-14T06:45:37.7532184Z  2025-03-14T06:45:37.7532586Z  2025-03-14T06:45:37.7533300Z  2025-03-14T06:45:37.7533678Z  2025-03-14T06:45:37.7534593Z [20,148 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:37.7535520Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2025-03-14T06:45:37.7536101Z @xla//xla/mlir_hlo:mhlo_passes; 82s local 2025-03-14T06:45:37.7537015Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 45s local 2025-03-14T06:45:37.7538134Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 34s local 2025-03-14T06:45:37.7539123Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2025-03-14T06:45:37.7539928Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T06:45:37.7540728Z Compiling torch_xla/csrc/runtime/computation_client.cc; 28s local 2025-03-14T06:45:37.7541711Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 27s local ... 2025-03-14T06:45:38.2932075Z 2025-03-14T06:45:38.2932844Z  2025-03-14T06:45:38.2933306Z  2025-03-14T06:45:38.2933705Z  2025-03-14T06:45:38.2934072Z  2025-03-14T06:45:38.2934432Z  2025-03-14T06:45:38.2934780Z  2025-03-14T06:45:38.2935128Z  2025-03-14T06:45:38.2935476Z  2025-03-14T06:45:38.2936286Z [20,149 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:38.2937132Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2025-03-14T06:45:38.2937781Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2025-03-14T06:45:38.2938691Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2025-03-14T06:45:38.2939726Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T06:45:38.2940681Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2025-03-14T06:45:38.2941391Z @stablehlo//:stablehlo_passes; 30s local 2025-03-14T06:45:38.2942145Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T06:45:38.2943088Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 27s local ... 2025-03-14T06:45:38.5537919Z 2025-03-14T06:45:38.5539080Z  2025-03-14T06:45:38.5539569Z  2025-03-14T06:45:38.5539935Z  2025-03-14T06:45:38.5540320Z  2025-03-14T06:45:38.5540706Z  2025-03-14T06:45:38.5541101Z  2025-03-14T06:45:38.5541487Z  2025-03-14T06:45:38.5541872Z  2025-03-14T06:45:38.5542795Z [20,149 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:38.5543739Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2025-03-14T06:45:38.5544513Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2025-03-14T06:45:38.5545398Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2025-03-14T06:45:38.5546475Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T06:45:38.5547447Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2025-03-14T06:45:38.5548243Z @stablehlo//:stablehlo_passes; 31s local 2025-03-14T06:45:38.5549075Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T06:45:38.5550126Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 27s local ... 2025-03-14T06:45:38.7647236Z 2025-03-14T06:45:38.7648221Z  2025-03-14T06:45:38.7648761Z  2025-03-14T06:45:38.7649197Z  2025-03-14T06:45:38.7649618Z  2025-03-14T06:45:38.7650042Z  2025-03-14T06:45:38.7650437Z  2025-03-14T06:45:38.7650828Z  2025-03-14T06:45:38.7651279Z  2025-03-14T06:45:38.7652615Z [20,151 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:38.7653576Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2025-03-14T06:45:38.7654272Z @xla//xla/mlir_hlo:mhlo_passes; 83s local 2025-03-14T06:45:38.7655192Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2025-03-14T06:45:38.7656330Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 35s local 2025-03-14T06:45:38.7657592Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2025-03-14T06:45:38.7658440Z @stablehlo//:stablehlo_passes; 31s local 2025-03-14T06:45:38.7659270Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T06:45:38.7660233Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 28s local ... 2025-03-14T06:45:39.1542298Z 2025-03-14T06:45:39.1543176Z  2025-03-14T06:45:39.1543664Z  2025-03-14T06:45:39.1544083Z  2025-03-14T06:45:39.1544494Z  2025-03-14T06:45:39.1544938Z  2025-03-14T06:45:39.1545354Z  2025-03-14T06:45:39.1545753Z  2025-03-14T06:45:39.1546162Z  2025-03-14T06:45:39.1547117Z [20,151 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:39.1548000Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2025-03-14T06:45:39.1548596Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2025-03-14T06:45:39.1549477Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 46s local 2025-03-14T06:45:39.1550531Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2025-03-14T06:45:39.1551534Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2025-03-14T06:45:39.1552271Z @stablehlo//:stablehlo_passes; 31s local 2025-03-14T06:45:39.1552971Z Compiling torch_xla/csrc/runtime/computation_client.cc; 29s local 2025-03-14T06:45:39.1553948Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 28s local ... 2025-03-14T06:45:39.7004838Z 2025-03-14T06:45:39.7005740Z  2025-03-14T06:45:39.7006212Z  2025-03-14T06:45:39.7006608Z  2025-03-14T06:45:39.7006996Z  2025-03-14T06:45:39.7007410Z  2025-03-14T06:45:39.7007810Z  2025-03-14T06:45:39.7008184Z  2025-03-14T06:45:39.7008565Z  2025-03-14T06:45:39.7009507Z [20,152 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:39.7010432Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2025-03-14T06:45:39.7011321Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2025-03-14T06:45:39.7012215Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2025-03-14T06:45:39.7013289Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2025-03-14T06:45:39.7014248Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T06:45:39.7014998Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T06:45:39.7015774Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T06:45:39.7016873Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 28s local ... 2025-03-14T06:45:39.9548862Z 2025-03-14T06:45:39.9549661Z  2025-03-14T06:45:39.9550148Z  2025-03-14T06:45:39.9550545Z  2025-03-14T06:45:39.9550946Z  2025-03-14T06:45:39.9551335Z  2025-03-14T06:45:39.9551728Z  2025-03-14T06:45:39.9552127Z  2025-03-14T06:45:39.9552505Z  2025-03-14T06:45:39.9553491Z [20,153 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:39.9554462Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2025-03-14T06:45:39.9555157Z @xla//xla/mlir_hlo:mhlo_passes; 84s local 2025-03-14T06:45:39.9556053Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 47s local 2025-03-14T06:45:39.9557131Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 36s local 2025-03-14T06:45:39.9558132Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T06:45:39.9559262Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T06:45:39.9560085Z Compiling torch_xla/csrc/runtime/computation_client.cc; 30s local 2025-03-14T06:45:39.9561036Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local ... 2025-03-14T06:45:40.2803968Z 2025-03-14T06:45:40.2804997Z  2025-03-14T06:45:40.2805491Z  2025-03-14T06:45:40.2805999Z  2025-03-14T06:45:40.2806432Z  2025-03-14T06:45:40.2807239Z  2025-03-14T06:45:40.2807592Z  2025-03-14T06:45:40.2807970Z  2025-03-14T06:45:40.2808371Z  2025-03-14T06:45:40.2809332Z [20,154 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:40.2810424Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2025-03-14T06:45:40.2811059Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2025-03-14T06:45:40.2811942Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T06:45:40.2813082Z Compiling xla/service/cpu/onednn_contraction_rewriter.cc; 37s local 2025-03-14T06:45:40.2814029Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T06:45:40.2814825Z @stablehlo//:stablehlo_passes; 32s local 2025-03-14T06:45:40.2815600Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2025-03-14T06:45:40.2816564Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local ... 2025-03-14T06:45:40.5554040Z 2025-03-14T06:45:40.5554875Z  2025-03-14T06:45:40.5555357Z  2025-03-14T06:45:40.5555806Z  2025-03-14T06:45:40.5556241Z  2025-03-14T06:45:40.5556646Z  2025-03-14T06:45:40.5557036Z  2025-03-14T06:45:40.5557460Z  2025-03-14T06:45:40.5557885Z  2025-03-14T06:45:40.5558872Z [20,156 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:40.5559786Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2025-03-14T06:45:40.5560390Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2025-03-14T06:45:40.5561306Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T06:45:40.5562285Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T06:45:40.5563019Z @stablehlo//:stablehlo_passes; 33s local 2025-03-14T06:45:40.5563744Z Compiling torch_xla/csrc/runtime/computation_client.cc; 31s local 2025-03-14T06:45:40.5564765Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local 2025-03-14T06:45:40.5566245Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local ... 2025-03-14T06:45:40.7885848Z 2025-03-14T06:45:40.7886862Z  2025-03-14T06:45:40.7887339Z  2025-03-14T06:45:40.7887716Z  2025-03-14T06:45:40.7888099Z  2025-03-14T06:45:40.7888459Z  2025-03-14T06:45:40.7888836Z  2025-03-14T06:45:40.7889200Z  2025-03-14T06:45:40.7889602Z  2025-03-14T06:45:40.7890595Z [20,158 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:40.7891513Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2025-03-14T06:45:40.7892441Z @xla//xla/mlir_hlo:mhlo_passes; 85s local 2025-03-14T06:45:40.7893390Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T06:45:40.7894497Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T06:45:40.7895277Z @stablehlo//:stablehlo_passes; 33s local 2025-03-14T06:45:40.7896035Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2025-03-14T06:45:40.7897005Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local 2025-03-14T06:45:40.7897910Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local ... 2025-03-14T06:45:41.0382122Z 2025-03-14T06:45:41.0382965Z  2025-03-14T06:45:41.0383480Z  2025-03-14T06:45:41.0383849Z  2025-03-14T06:45:41.0384243Z  2025-03-14T06:45:41.0384634Z  2025-03-14T06:45:41.0384993Z  2025-03-14T06:45:41.0385348Z  2025-03-14T06:45:41.0386162Z  2025-03-14T06:45:41.0387259Z [20,160 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:41.0388112Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2025-03-14T06:45:41.0388735Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2025-03-14T06:45:41.0389588Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 48s local 2025-03-14T06:45:41.0390632Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T06:45:41.0391728Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2025-03-14T06:45:41.0392583Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local 2025-03-14T06:45:41.0393398Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T06:45:41.0394213Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local ... 2025-03-14T06:45:41.3558053Z 2025-03-14T06:45:41.3559276Z  2025-03-14T06:45:41.3559757Z  2025-03-14T06:45:41.3560159Z  2025-03-14T06:45:41.3560589Z  2025-03-14T06:45:41.3560980Z  2025-03-14T06:45:41.3561355Z  2025-03-14T06:45:41.3561763Z  2025-03-14T06:45:41.3562157Z  2025-03-14T06:45:41.3563086Z [20,160 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:41.3564022Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2025-03-14T06:45:41.3564779Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2025-03-14T06:45:41.3565846Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 49s local 2025-03-14T06:45:41.3566867Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T06:45:41.3567728Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2025-03-14T06:45:41.3568471Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 29s local 2025-03-14T06:45:41.3569245Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T06:45:41.3570013Z Compiling torch_xla/csrc/unwrap_data.cpp; 27s local ... 2025-03-14T06:45:41.9018338Z 2025-03-14T06:45:41.9019202Z  2025-03-14T06:45:41.9019677Z  2025-03-14T06:45:41.9020126Z  2025-03-14T06:45:41.9020520Z  2025-03-14T06:45:41.9020906Z  2025-03-14T06:45:41.9021405Z  2025-03-14T06:45:41.9021775Z  2025-03-14T06:45:41.9022161Z  2025-03-14T06:45:41.9023071Z [20,161 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:41.9023949Z @xla//xla/mlir_hlo:mhlo_passes; 86s local 2025-03-14T06:45:41.9025064Z Compiling stablehlo/transforms/VhloLegalizeToStablehlo.cpp; 49s local 2025-03-14T06:45:41.9025984Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2025-03-14T06:45:41.9026807Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2025-03-14T06:45:41.9027573Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2025-03-14T06:45:41.9028311Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T06:45:41.9029002Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T06:45:41.9029893Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local ... 2025-03-14T06:45:42.1564833Z 2025-03-14T06:45:42.1565824Z  2025-03-14T06:45:42.1566251Z  2025-03-14T06:45:42.1566607Z  2025-03-14T06:45:42.1566958Z  2025-03-14T06:45:42.1567309Z  2025-03-14T06:45:42.1567665Z  2025-03-14T06:45:42.1567995Z  2025-03-14T06:45:42.1568342Z  2025-03-14T06:45:42.1569223Z [20,162 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:42.1570029Z @xla//xla/mlir_hlo:mhlo_passes; 87s local 2025-03-14T06:45:42.1570704Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2025-03-14T06:45:42.1571462Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2025-03-14T06:45:42.1572191Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 30s local 2025-03-14T06:45:42.1572879Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T06:45:42.1573827Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T06:45:42.1574539Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T06:45:42.1575256Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local ... 2025-03-14T06:45:42.5495155Z 2025-03-14T06:45:42.5495955Z  2025-03-14T06:45:42.5496436Z  2025-03-14T06:45:42.5496837Z  2025-03-14T06:45:42.5497212Z  2025-03-14T06:45:42.5497595Z  2025-03-14T06:45:42.5498238Z  2025-03-14T06:45:42.5498601Z  2025-03-14T06:45:42.5499012Z  2025-03-14T06:45:42.5499842Z [20,163 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:42.5500861Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T06:45:42.5501714Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2025-03-14T06:45:42.5502527Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2025-03-14T06:45:42.5503372Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T06:45:42.5504136Z Compiling torch_xla/csrc/unwrap_data.cpp; 28s local 2025-03-14T06:45:42.5504933Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T06:45:42.5505754Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2025-03-14T06:45:42.5506598Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local ... 2025-03-14T06:45:42.7571415Z 2025-03-14T06:45:42.7572262Z  2025-03-14T06:45:42.7572774Z  2025-03-14T06:45:42.7573149Z  2025-03-14T06:45:42.7573557Z  2025-03-14T06:45:42.7573941Z  2025-03-14T06:45:42.7574306Z  2025-03-14T06:45:42.7585201Z  2025-03-14T06:45:42.7585994Z  2025-03-14T06:45:42.7586918Z [20,163 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:42.7587894Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T06:45:42.7588627Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T06:45:42.7589459Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2025-03-14T06:45:42.7590221Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T06:45:42.7590931Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T06:45:42.7591688Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T06:45:42.7592449Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2025-03-14T06:45:42.7593587Z Compiling torch_xla/csrc/lowering_context.cpp; 24s local ... 2025-03-14T06:45:43.1564979Z 2025-03-14T06:45:43.1566069Z  2025-03-14T06:45:43.1568003Z  2025-03-14T06:45:43.1568487Z  2025-03-14T06:45:43.1568905Z  2025-03-14T06:45:43.1569316Z  2025-03-14T06:45:43.1569713Z  2025-03-14T06:45:43.1570085Z  2025-03-14T06:45:43.1570490Z  2025-03-14T06:45:43.1571345Z [20,164 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:43.1572717Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T06:45:43.1573702Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T06:45:43.1574543Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2025-03-14T06:45:43.1575363Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2025-03-14T06:45:43.1576158Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T06:45:43.1576991Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T06:45:43.1577786Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2025-03-14T06:45:43.1578683Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local ... 2025-03-14T06:45:43.3574174Z 2025-03-14T06:45:43.3575067Z  2025-03-14T06:45:43.3575573Z  2025-03-14T06:45:43.3575936Z  2025-03-14T06:45:43.3576335Z  2025-03-14T06:45:43.3576695Z  2025-03-14T06:45:43.3577115Z  2025-03-14T06:45:43.3577502Z  2025-03-14T06:45:43.3578166Z  2025-03-14T06:45:43.3579047Z [20,165 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:43.3580072Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T06:45:43.3580921Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T06:45:43.3581743Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 31s local 2025-03-14T06:45:43.3582529Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2025-03-14T06:45:43.3583524Z Compiling torch_xla/csrc/unwrap_data.cpp; 29s local 2025-03-14T06:45:43.3584302Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T06:45:43.3585128Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2025-03-14T06:45:43.3586005Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local ... 2025-03-14T06:45:43.7260578Z 2025-03-14T06:45:43.7261519Z  2025-03-14T06:45:43.7261974Z  2025-03-14T06:45:43.7262397Z  2025-03-14T06:45:43.7262807Z  2025-03-14T06:45:43.7263251Z  2025-03-14T06:45:43.7263707Z  2025-03-14T06:45:43.7264116Z  2025-03-14T06:45:43.7264485Z  2025-03-14T06:45:43.7265618Z [20,168 / 20,652] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:45:43.7266632Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2025-03-14T06:45:43.7267451Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2025-03-14T06:45:43.7268278Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T06:45:43.7269074Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2025-03-14T06:45:43.7269874Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T06:45:43.7270616Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2025-03-14T06:45:43.7271360Z Compiling torch_xla/csrc/lowering_context.cpp; 25s local 2025-03-14T06:45:43.7272082Z Compiling torch_xla/csrc/ir.cpp; 24s local ... 2025-03-14T06:45:43.9579109Z 2025-03-14T06:45:43.9579899Z  2025-03-14T06:45:43.9580310Z  2025-03-14T06:45:43.9580674Z  2025-03-14T06:45:43.9581008Z  2025-03-14T06:45:43.9581327Z  2025-03-14T06:45:43.9581652Z  2025-03-14T06:45:43.9581976Z  2025-03-14T06:45:43.9582307Z  2025-03-14T06:45:43.9583060Z [20,169 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:43.9583930Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2025-03-14T06:45:43.9584891Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2025-03-14T06:45:43.9585551Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T06:45:43.9586162Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2025-03-14T06:45:43.9586788Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T06:45:43.9587424Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2025-03-14T06:45:43.9588063Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2025-03-14T06:45:43.9588777Z Compiling torch_xla/csrc/ir.cpp; 24s local ... 2025-03-14T06:45:44.2119355Z 2025-03-14T06:45:44.2120221Z  2025-03-14T06:45:44.2120691Z  2025-03-14T06:45:44.2121073Z  2025-03-14T06:45:44.2121469Z  2025-03-14T06:45:44.2121866Z  2025-03-14T06:45:44.2122224Z  2025-03-14T06:45:44.2122614Z  2025-03-14T06:45:44.2123129Z  2025-03-14T06:45:44.2124127Z [20,170 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:44.2125388Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2025-03-14T06:45:44.2126258Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T06:45:44.2127266Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2025-03-14T06:45:44.2128108Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T06:45:44.2128916Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2025-03-14T06:45:44.2130122Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2025-03-14T06:45:44.2130843Z Compiling torch_xla/csrc/ir.cpp; 24s local 2025-03-14T06:45:44.2131553Z Compiling torch_xla/csrc/ir.cpp; 23s local ... 2025-03-14T06:45:44.4514787Z 2025-03-14T06:45:44.4515591Z  2025-03-14T06:45:44.4516067Z  2025-03-14T06:45:44.4516476Z  2025-03-14T06:45:44.4516874Z  2025-03-14T06:45:44.4517525Z  2025-03-14T06:45:44.4517909Z  2025-03-14T06:45:44.4518300Z  2025-03-14T06:45:44.4518710Z  2025-03-14T06:45:44.4519627Z [20,171 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:44.4520479Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2025-03-14T06:45:44.4521344Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 32s local 2025-03-14T06:45:44.4522122Z Compiling torch_xla/csrc/unwrap_data.cpp; 30s local 2025-03-14T06:45:44.4522942Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T06:45:44.4523723Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T06:45:44.4524698Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2025-03-14T06:45:44.4525467Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T06:45:44.4526152Z Compiling torch_xla/csrc/ir.cpp; 23s local ... 2025-03-14T06:45:44.7584883Z 2025-03-14T06:45:44.7585777Z  2025-03-14T06:45:44.7586310Z  2025-03-14T06:45:44.7586723Z  2025-03-14T06:45:44.7587145Z  2025-03-14T06:45:44.7587497Z  2025-03-14T06:45:44.7587880Z  2025-03-14T06:45:44.7588286Z  2025-03-14T06:45:44.7588674Z  2025-03-14T06:45:44.7589630Z [20,173 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:44.7590716Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2025-03-14T06:45:44.7591590Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2025-03-14T06:45:44.7592435Z Compiling torch_xla/csrc/unwrap_data.cpp; 31s local 2025-03-14T06:45:44.7593234Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T06:45:44.7594065Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T06:45:44.7594872Z Compiling torch_xla/csrc/lowering_context.cpp; 26s local 2025-03-14T06:45:44.7595669Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T06:45:44.7596488Z Compiling torch_xla/csrc/ir.cpp; 24s local ... 2025-03-14T06:45:44.9587927Z 2025-03-14T06:45:44.9589053Z  2025-03-14T06:45:44.9589684Z  2025-03-14T06:45:44.9590082Z  2025-03-14T06:45:44.9590463Z  2025-03-14T06:45:44.9590830Z  2025-03-14T06:45:44.9591189Z  2025-03-14T06:45:44.9591558Z  2025-03-14T06:45:44.9591905Z  2025-03-14T06:45:44.9592819Z [20,174 / 20,652] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2025-03-14T06:45:44.9593957Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2025-03-14T06:45:44.9594985Z Compiling xla/pjrt/gpu/se_gpu_pjrt_client.cc; 33s local 2025-03-14T06:45:44.9595923Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T06:45:44.9596722Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T06:45:44.9597502Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2025-03-14T06:45:44.9598839Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T06:45:44.9599523Z Compiling torch_xla/csrc/ir.cpp; 24s local 2025-03-14T06:45:44.9600602Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local ... 2025-03-14T06:45:45.3021984Z 2025-03-14T06:45:45.3022839Z  2025-03-14T06:45:45.3023291Z  2025-03-14T06:45:45.3023707Z  2025-03-14T06:45:45.3024087Z  2025-03-14T06:45:45.3024462Z  2025-03-14T06:45:45.3024846Z  2025-03-14T06:45:45.3025249Z  2025-03-14T06:45:45.3025643Z  2025-03-14T06:45:45.3026885Z [20,177 / 20,652] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:45:45.3027974Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2025-03-14T06:45:45.3028893Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2025-03-14T06:45:45.3029753Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T06:45:45.3030603Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2025-03-14T06:45:45.3031563Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T06:45:45.3032262Z Compiling torch_xla/csrc/ir.cpp; 24s local 2025-03-14T06:45:45.3033091Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local 2025-03-14T06:45:45.3033901Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local ... 2025-03-14T06:45:45.5594305Z 2025-03-14T06:45:45.5595262Z  2025-03-14T06:45:45.5595802Z  2025-03-14T06:45:45.5596233Z  2025-03-14T06:45:45.5596663Z  2025-03-14T06:45:45.5597108Z  2025-03-14T06:45:45.5597531Z  2025-03-14T06:45:45.5597942Z  2025-03-14T06:45:45.5598372Z  2025-03-14T06:45:45.5599371Z [20,177 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:45.5600513Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T06:45:45.5601568Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2025-03-14T06:45:45.5602404Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T06:45:45.5603341Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2025-03-14T06:45:45.5604107Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T06:45:45.5604931Z Compiling torch_xla/csrc/ir.cpp; 24s local 2025-03-14T06:45:45.5605735Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local 2025-03-14T06:45:45.5606642Z Compiling xla/pjrt/pjrt_c_api_client.cc; 23s local ... 2025-03-14T06:45:45.7845590Z 2025-03-14T06:45:45.7846546Z  2025-03-14T06:45:45.7847054Z  2025-03-14T06:45:45.7847441Z  2025-03-14T06:45:45.7847818Z  2025-03-14T06:45:45.7848227Z  2025-03-14T06:45:45.7848679Z  2025-03-14T06:45:45.7849178Z  2025-03-14T06:45:45.7849594Z  2025-03-14T06:45:45.7850531Z [20,179 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:45.7851572Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T06:45:45.7852712Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2025-03-14T06:45:45.7853612Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T06:45:45.7854483Z Compiling torch_xla/csrc/lowering_context.cpp; 27s local 2025-03-14T06:45:45.7855240Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T06:45:45.7855895Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T06:45:45.7856646Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 24s local 2025-03-14T06:45:45.7857626Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local ... 2025-03-14T06:45:46.0767128Z 2025-03-14T06:45:46.0768799Z  2025-03-14T06:45:46.0769291Z  2025-03-14T06:45:46.0769646Z  2025-03-14T06:45:46.0770022Z  2025-03-14T06:45:46.0770374Z  2025-03-14T06:45:46.0770735Z  2025-03-14T06:45:46.0771073Z  2025-03-14T06:45:46.0771447Z  2025-03-14T06:45:46.0772305Z [20,181 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:46.0773293Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T06:45:46.0774068Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2025-03-14T06:45:46.0774791Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T06:45:46.0775536Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T06:45:46.0776194Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T06:45:46.0776756Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T06:45:46.0777705Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2025-03-14T06:45:46.0778439Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local ... 2025-03-14T06:45:46.3183136Z 2025-03-14T06:45:46.3183979Z  2025-03-14T06:45:46.3184400Z  2025-03-14T06:45:46.3184715Z  2025-03-14T06:45:46.3185060Z  2025-03-14T06:45:46.3185396Z  2025-03-14T06:45:46.3185711Z  2025-03-14T06:45:46.3186024Z  2025-03-14T06:45:46.3186621Z  2025-03-14T06:45:46.3187524Z [20,182 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:46.3188533Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T06:45:46.3189389Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2025-03-14T06:45:46.3190181Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T06:45:46.3190956Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T06:45:46.3191742Z Compiling torch_xla/csrc/ir.cpp; 27s local 2025-03-14T06:45:46.3192425Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T06:45:46.3193191Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2025-03-14T06:45:46.3194055Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local ... 2025-03-14T06:45:46.5600384Z 2025-03-14T06:45:46.5601261Z  2025-03-14T06:45:46.5601682Z  2025-03-14T06:45:46.5602011Z  2025-03-14T06:45:46.5602379Z  2025-03-14T06:45:46.5602709Z  2025-03-14T06:45:46.5603050Z  2025-03-14T06:45:46.5603379Z  2025-03-14T06:45:46.5603713Z  2025-03-14T06:45:46.5604513Z [20,182 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:46.5605508Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2025-03-14T06:45:46.5606235Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2025-03-14T06:45:46.5606901Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2025-03-14T06:45:46.5607578Z Compiling torch_xla/csrc/lowering_context.cpp; 28s local 2025-03-14T06:45:46.5608208Z Compiling torch_xla/csrc/ir.cpp; 27s local 2025-03-14T06:45:46.5608748Z Compiling torch_xla/csrc/ir.cpp; 25s local 2025-03-14T06:45:46.5609391Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 25s local 2025-03-14T06:45:46.5610092Z Compiling xla/pjrt/pjrt_c_api_client.cc; 24s local ... 2025-03-14T06:45:47.2059830Z 2025-03-14T06:45:47.2060768Z  2025-03-14T06:45:47.2061331Z  2025-03-14T06:45:47.2062087Z  2025-03-14T06:45:47.2062648Z  2025-03-14T06:45:47.2063062Z  2025-03-14T06:45:47.2063469Z  2025-03-14T06:45:47.2063894Z  2025-03-14T06:45:47.2064272Z  2025-03-14T06:45:47.2065181Z [20,183 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:47.2066452Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2025-03-14T06:45:47.2067355Z Compiling torch_xla/csrc/lowering_context.cpp; 33s local 2025-03-14T06:45:47.2068305Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2025-03-14T06:45:47.2069121Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T06:45:47.2069850Z Compiling torch_xla/csrc/ir.cpp; 27s local 2025-03-14T06:45:47.2070502Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T06:45:47.2071248Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2025-03-14T06:45:47.2072110Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local ... 2025-03-14T06:45:47.5607189Z 2025-03-14T06:45:47.5608059Z  2025-03-14T06:45:47.5608548Z  2025-03-14T06:45:47.5608942Z  2025-03-14T06:45:47.5609338Z  2025-03-14T06:45:47.5609743Z  2025-03-14T06:45:47.5610149Z  2025-03-14T06:45:47.5610723Z  2025-03-14T06:45:47.5611133Z  2025-03-14T06:45:47.5612089Z [20,184 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:47.5613835Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 41s local 2025-03-14T06:45:47.5614797Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2025-03-14T06:45:47.5615712Z Compiling torch_xla/csrc/lowering_context.cpp; 29s local 2025-03-14T06:45:47.5616578Z Compiling torch_xla/csrc/ir.cpp; 28s local 2025-03-14T06:45:47.5617396Z Compiling torch_xla/csrc/ir.cpp; 26s local 2025-03-14T06:45:47.5618648Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 26s local 2025-03-14T06:45:47.5619834Z Compiling xla/pjrt/pjrt_c_api_client.cc; 25s local 2025-03-14T06:45:47.5620685Z Compiling xla/service/cpu/ir_emitter.cc; 23s local ... 2025-03-14T06:45:48.2104435Z 2025-03-14T06:45:48.2105331Z  2025-03-14T06:45:48.2105832Z  2025-03-14T06:45:48.2106203Z  2025-03-14T06:45:48.2106569Z  2025-03-14T06:45:48.2106916Z  2025-03-14T06:45:48.2107300Z  2025-03-14T06:45:48.2107657Z  2025-03-14T06:45:48.2108053Z  2025-03-14T06:45:48.2108860Z [20,185 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:48.2110121Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 41s local 2025-03-14T06:45:48.2110918Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2025-03-14T06:45:48.2111771Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T06:45:48.2112486Z Compiling torch_xla/csrc/ir.cpp; 28s local 2025-03-14T06:45:48.2113158Z Compiling torch_xla/csrc/ir.cpp; 27s local 2025-03-14T06:45:48.2113923Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 27s local 2025-03-14T06:45:48.2114824Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2025-03-14T06:45:48.2115640Z Compiling xla/service/cpu/ir_emitter.cc; 23s local ... 2025-03-14T06:45:48.5614951Z 2025-03-14T06:45:48.5615758Z  2025-03-14T06:45:48.5616249Z  2025-03-14T06:45:48.5616680Z  2025-03-14T06:45:48.5617130Z  2025-03-14T06:45:48.5617557Z  2025-03-14T06:45:48.5617982Z  2025-03-14T06:45:48.5618421Z  2025-03-14T06:45:48.5618840Z  2025-03-14T06:45:48.5619864Z [20,186 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:48.5620980Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T06:45:48.5621895Z Compiling torch_xla/csrc/lowering_context.cpp; 30s local 2025-03-14T06:45:48.5622770Z Compiling torch_xla/csrc/ir.cpp; 29s local 2025-03-14T06:45:48.5623775Z Compiling torch_xla/csrc/ir.cpp; 27s local 2025-03-14T06:45:48.5624650Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 27s local 2025-03-14T06:45:48.5625586Z Compiling xla/pjrt/pjrt_c_api_client.cc; 26s local 2025-03-14T06:45:48.5626439Z Compiling xla/service/cpu/ir_emitter.cc; 24s local 2025-03-14T06:45:48.5627393Z Compiling xla/python/ifrt/client.cc; 22s local ... 2025-03-14T06:45:49.3718790Z 2025-03-14T06:45:49.3719664Z  2025-03-14T06:45:49.3720127Z  2025-03-14T06:45:49.3720529Z  2025-03-14T06:45:49.3721168Z  2025-03-14T06:45:49.3721581Z  2025-03-14T06:45:49.3721964Z  2025-03-14T06:45:49.3722345Z  2025-03-14T06:45:49.3722732Z  2025-03-14T06:45:49.3723605Z [20,187 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:49.3724749Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T06:45:49.3725640Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2025-03-14T06:45:49.3726424Z Compiling torch_xla/csrc/ir.cpp; 30s local 2025-03-14T06:45:49.3727115Z Compiling torch_xla/csrc/ir.cpp; 28s local 2025-03-14T06:45:49.3727920Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 28s local 2025-03-14T06:45:49.3728754Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2025-03-14T06:45:49.3729481Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2025-03-14T06:45:49.3730469Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local ... 2025-03-14T06:45:49.6630075Z 2025-03-14T06:45:49.6630994Z  2025-03-14T06:45:49.6631496Z  2025-03-14T06:45:49.6631893Z  2025-03-14T06:45:49.6632304Z  2025-03-14T06:45:49.6632684Z  2025-03-14T06:45:49.6633053Z  2025-03-14T06:45:49.6633413Z  2025-03-14T06:45:49.6633752Z  2025-03-14T06:45:49.6634725Z [20,188 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:49.6636099Z Compiling torch_xla/csrc/lowering_context.cpp; 31s local 2025-03-14T06:45:49.6636853Z Compiling torch_xla/csrc/ir.cpp; 30s local 2025-03-14T06:45:49.6637468Z Compiling torch_xla/csrc/ir.cpp; 29s local 2025-03-14T06:45:49.6638272Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 28s local 2025-03-14T06:45:49.6639124Z Compiling xla/pjrt/pjrt_c_api_client.cc; 27s local 2025-03-14T06:45:49.6639842Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2025-03-14T06:45:49.6640571Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2025-03-14T06:45:49.6641358Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local ... 2025-03-14T06:45:49.9624662Z 2025-03-14T06:45:49.9625491Z  2025-03-14T06:45:49.9625987Z  2025-03-14T06:45:49.9626417Z  2025-03-14T06:45:49.9626822Z  2025-03-14T06:45:49.9627208Z  2025-03-14T06:45:49.9627592Z  2025-03-14T06:45:49.9627996Z  2025-03-14T06:45:49.9628434Z  2025-03-14T06:45:49.9629395Z [20,188 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:49.9630454Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2025-03-14T06:45:49.9631223Z Compiling torch_xla/csrc/ir.cpp; 30s local 2025-03-14T06:45:49.9631882Z Compiling torch_xla/csrc/ir.cpp; 29s local 2025-03-14T06:45:49.9632666Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2025-03-14T06:45:49.9633496Z Compiling xla/pjrt/pjrt_c_api_client.cc; 28s local 2025-03-14T06:45:49.9634314Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2025-03-14T06:45:49.9635081Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local 2025-03-14T06:45:49.9635890Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local ... 2025-03-14T06:45:50.8052249Z 2025-03-14T06:45:50.8053088Z  2025-03-14T06:45:50.8053486Z  2025-03-14T06:45:50.8053855Z  2025-03-14T06:45:50.8054226Z  2025-03-14T06:45:50.8054584Z  2025-03-14T06:45:50.8054929Z  2025-03-14T06:45:50.8055520Z  2025-03-14T06:45:50.8055890Z  2025-03-14T06:45:50.8056711Z [20,189 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:50.8057620Z Compiling torch_xla/csrc/lowering_context.cpp; 32s local 2025-03-14T06:45:50.8058310Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T06:45:50.8058918Z Compiling torch_xla/csrc/ir.cpp; 30s local 2025-03-14T06:45:50.8059639Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 29s local 2025-03-14T06:45:50.8060521Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T06:45:50.8061195Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2025-03-14T06:45:50.8061861Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2025-03-14T06:45:50.8062598Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local ... 2025-03-14T06:45:51.1631346Z 2025-03-14T06:45:51.1632282Z  2025-03-14T06:45:51.1632779Z  2025-03-14T06:45:51.1633178Z  2025-03-14T06:45:51.1633550Z  2025-03-14T06:45:51.1633922Z  2025-03-14T06:45:51.1634301Z  2025-03-14T06:45:51.1634679Z  2025-03-14T06:45:51.1635065Z  2025-03-14T06:45:51.1636033Z [20,189 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:51.1637023Z Compiling torch_xla/csrc/lowering_context.cpp; 33s local 2025-03-14T06:45:51.1638129Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T06:45:51.1638814Z Compiling torch_xla/csrc/ir.cpp; 30s local 2025-03-14T06:45:51.1639601Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2025-03-14T06:45:51.1640428Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T06:45:51.1641188Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2025-03-14T06:45:51.1641980Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2025-03-14T06:45:51.1643020Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local ... 2025-03-14T06:45:51.5944046Z 2025-03-14T06:45:51.5944928Z  2025-03-14T06:45:51.5945432Z  2025-03-14T06:45:51.5945823Z  2025-03-14T06:45:51.5946543Z  2025-03-14T06:45:51.5947067Z  2025-03-14T06:45:51.5947549Z  2025-03-14T06:45:51.5947987Z  2025-03-14T06:45:51.5948493Z  2025-03-14T06:45:51.5949560Z [20,190 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:51.5950627Z Compiling torch_xla/csrc/ir.cpp; 32s local 2025-03-14T06:45:51.5951425Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T06:45:51.5952293Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 30s local 2025-03-14T06:45:51.5953220Z Compiling xla/pjrt/pjrt_c_api_client.cc; 29s local 2025-03-14T06:45:51.5954041Z Compiling xla/service/cpu/ir_emitter.cc; 27s local 2025-03-14T06:45:51.5954925Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2025-03-14T06:45:51.5955808Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2025-03-14T06:45:51.5956763Z Compiling xla/service/cpu/cpu_compiler.cc; 23s local ... 2025-03-14T06:45:51.9638951Z 2025-03-14T06:45:51.9639890Z  2025-03-14T06:45:51.9640357Z  2025-03-14T06:45:51.9640740Z  2025-03-14T06:45:51.9641145Z  2025-03-14T06:45:51.9641510Z  2025-03-14T06:45:51.9641899Z  2025-03-14T06:45:51.9642276Z  2025-03-14T06:45:51.9642617Z  2025-03-14T06:45:51.9643538Z [20,190 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:51.9644463Z Compiling torch_xla/csrc/ir.cpp; 32s local 2025-03-14T06:45:51.9645225Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T06:45:51.9646002Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2025-03-14T06:45:51.9646871Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T06:45:51.9647542Z Compiling xla/service/cpu/ir_emitter.cc; 27s local 2025-03-14T06:45:51.9648658Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2025-03-14T06:45:51.9649429Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T06:45:51.9650134Z Compiling xla/service/cpu/cpu_compiler.cc; 23s local ... 2025-03-14T06:45:52.1641435Z 2025-03-14T06:45:52.1642276Z  2025-03-14T06:45:52.1642761Z  2025-03-14T06:45:52.1643163Z  2025-03-14T06:45:52.1643559Z  2025-03-14T06:45:52.1643883Z  2025-03-14T06:45:52.1644326Z  2025-03-14T06:45:52.1644857Z  2025-03-14T06:45:52.1645251Z  2025-03-14T06:45:52.1646397Z [20,192 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:52.1647425Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T06:45:52.1648146Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2025-03-14T06:45:52.1649008Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T06:45:52.1649776Z Compiling xla/service/cpu/ir_emitter.cc; 27s local 2025-03-14T06:45:52.1650540Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2025-03-14T06:45:52.1651306Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T06:45:52.1652109Z Compiling xla/service/cpu/cpu_compiler.cc; 24s local 2025-03-14T06:45:52.1652865Z Compiling xla/pjrt/cpu/cpu_client.cc; 22s local ... 2025-03-14T06:45:52.5645447Z 2025-03-14T06:45:52.5646328Z  2025-03-14T06:45:52.5647197Z  2025-03-14T06:45:52.5647610Z  2025-03-14T06:45:52.5648000Z  2025-03-14T06:45:52.5648419Z  2025-03-14T06:45:52.5648843Z  2025-03-14T06:45:52.5649214Z  2025-03-14T06:45:52.5649579Z  2025-03-14T06:45:52.5650499Z [20,193 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:52.5651383Z Compiling torch_xla/csrc/ir.cpp; 31s local 2025-03-14T06:45:52.5652192Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 31s local 2025-03-14T06:45:52.5653225Z Compiling xla/pjrt/pjrt_c_api_client.cc; 30s local 2025-03-14T06:45:52.5653985Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2025-03-14T06:45:52.5654755Z Compiling xla/service/cpu/ir_emitter2.cc; 25s local 2025-03-14T06:45:52.5655501Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T06:45:52.5656252Z Compiling xla/service/cpu/cpu_compiler.cc; 24s local 2025-03-14T06:45:52.5657014Z Compiling xla/pjrt/cpu/cpu_client.cc; 23s local ... 2025-03-14T06:45:53.5652986Z 2025-03-14T06:45:53.5653823Z  2025-03-14T06:45:53.5654359Z  2025-03-14T06:45:53.5654953Z  2025-03-14T06:45:53.5655363Z  2025-03-14T06:45:53.5655763Z  2025-03-14T06:45:53.5656134Z  2025-03-14T06:45:53.5656487Z  2025-03-14T06:45:53.5656850Z  2025-03-14T06:45:53.5657674Z [20,193 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:53.5658390Z Compiling torch_xla/csrc/ir.cpp; 32s local 2025-03-14T06:45:53.5659134Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 32s local 2025-03-14T06:45:53.5659955Z Compiling xla/pjrt/pjrt_c_api_client.cc; 31s local 2025-03-14T06:45:53.5660759Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T06:45:53.5661524Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2025-03-14T06:45:53.5662350Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2025-03-14T06:45:53.5663050Z Compiling xla/service/cpu/cpu_compiler.cc; 25s local 2025-03-14T06:45:53.5663806Z Compiling xla/pjrt/cpu/cpu_client.cc; 24s local ... 2025-03-14T06:45:53.9656262Z 2025-03-14T06:45:53.9657086Z  2025-03-14T06:45:53.9657742Z  2025-03-14T06:45:53.9658226Z  2025-03-14T06:45:53.9658690Z  2025-03-14T06:45:53.9659160Z  2025-03-14T06:45:53.9659625Z  2025-03-14T06:45:53.9660077Z  2025-03-14T06:45:53.9660560Z  2025-03-14T06:45:53.9661771Z [20,194 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:53.9662860Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T06:45:53.9663750Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2025-03-14T06:45:53.9664553Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T06:45:53.9665513Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2025-03-14T06:45:53.9666310Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2025-03-14T06:45:53.9667286Z Compiling xla/service/cpu/cpu_compiler.cc; 25s local 2025-03-14T06:45:53.9668076Z Compiling xla/pjrt/cpu/cpu_client.cc; 24s local 2025-03-14T06:45:53.9668974Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 24s local ... 2025-03-14T06:45:54.1659257Z 2025-03-14T06:45:54.1660082Z  2025-03-14T06:45:54.1660510Z  2025-03-14T06:45:54.1660860Z  2025-03-14T06:45:54.1661225Z  2025-03-14T06:45:54.1661601Z  2025-03-14T06:45:54.1661956Z  2025-03-14T06:45:54.1662308Z  2025-03-14T06:45:54.1662644Z  2025-03-14T06:45:54.1663444Z [20,195 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:54.1664364Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T06:45:54.1665097Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2025-03-14T06:45:54.1665968Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T06:45:54.1666880Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2025-03-14T06:45:54.1667933Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2025-03-14T06:45:54.1668606Z Compiling xla/service/cpu/cpu_compiler.cc; 26s local 2025-03-14T06:45:54.1669350Z Compiling xla/pjrt/cpu/cpu_client.cc; 24s local 2025-03-14T06:45:54.1670212Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 24s local ... 2025-03-14T06:45:54.3695551Z 2025-03-14T06:45:54.3696607Z  2025-03-14T06:45:54.3697034Z  2025-03-14T06:45:54.3697399Z  2025-03-14T06:45:54.3697744Z  2025-03-14T06:45:54.3698089Z  2025-03-14T06:45:54.3698425Z  2025-03-14T06:45:54.3698772Z  2025-03-14T06:45:54.3699358Z  2025-03-14T06:45:54.3700256Z [20,196 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:54.3701288Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T06:45:54.3702153Z Compiling xla/pjrt/pjrt_c_api_client.cc; 32s local 2025-03-14T06:45:54.3702961Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2025-03-14T06:45:54.3703746Z Compiling xla/service/cpu/ir_emitter2.cc; 27s local 2025-03-14T06:45:54.3704541Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2025-03-14T06:45:54.3705323Z Compiling xla/service/cpu/cpu_compiler.cc; 26s local 2025-03-14T06:45:54.3706057Z Compiling xla/pjrt/cpu/cpu_client.cc; 25s local 2025-03-14T06:45:54.3707011Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 24s local ... 2025-03-14T06:45:54.7664525Z 2025-03-14T06:45:54.7665583Z  2025-03-14T06:45:54.7665985Z  2025-03-14T06:45:54.7666309Z  2025-03-14T06:45:54.7666625Z  2025-03-14T06:45:54.7666936Z  2025-03-14T06:45:54.7667238Z  2025-03-14T06:45:54.7667547Z  2025-03-14T06:45:54.7667854Z  2025-03-14T06:45:54.7668604Z [20,196 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:54.7669456Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 33s local 2025-03-14T06:45:54.7670093Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T06:45:54.7670669Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2025-03-14T06:45:54.7671238Z Compiling xla/service/cpu/ir_emitter2.cc; 27s local 2025-03-14T06:45:54.7671826Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T06:45:54.7672449Z Compiling xla/service/cpu/cpu_compiler.cc; 26s local 2025-03-14T06:45:54.7673284Z Compiling xla/pjrt/cpu/cpu_client.cc; 25s local 2025-03-14T06:45:54.7673988Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 24s local ... 2025-03-14T06:45:55.0542157Z 2025-03-14T06:45:55.0542995Z  2025-03-14T06:45:55.0543409Z  2025-03-14T06:45:55.0543737Z  2025-03-14T06:45:55.0544057Z  2025-03-14T06:45:55.0544375Z  2025-03-14T06:45:55.0544689Z  2025-03-14T06:45:55.0545025Z  2025-03-14T06:45:55.0545330Z  2025-03-14T06:45:55.0546343Z [20,197 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:55.0547159Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T06:45:55.0547825Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T06:45:55.0548418Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2025-03-14T06:45:55.0548993Z Compiling xla/service/cpu/ir_emitter2.cc; 27s local 2025-03-14T06:45:55.0549600Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T06:45:55.0550206Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2025-03-14T06:45:55.0550775Z Compiling xla/pjrt/cpu/cpu_client.cc; 25s local 2025-03-14T06:45:55.0551369Z Compiling xla/service/cpu/cpu_compiler.cc; 24s local ... 2025-03-14T06:45:55.3491547Z 2025-03-14T06:45:55.3492413Z  2025-03-14T06:45:55.3492892Z  2025-03-14T06:45:55.3493275Z  2025-03-14T06:45:55.3493937Z  2025-03-14T06:45:55.3494326Z  2025-03-14T06:45:55.3494711Z  2025-03-14T06:45:55.3495117Z  2025-03-14T06:45:55.3495481Z  2025-03-14T06:45:55.3496406Z [20,198 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:55.3497437Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T06:45:55.3498219Z Compiling xla/pjrt/pjrt_c_api_client.cc; 33s local 2025-03-14T06:45:55.3501106Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2025-03-14T06:45:55.3501869Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T06:45:55.3502604Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2025-03-14T06:45:55.3503328Z Compiling xla/pjrt/cpu/cpu_client.cc; 26s local 2025-03-14T06:45:55.3504080Z Compiling xla/service/cpu/cpu_compiler.cc; 24s local 2025-03-14T06:45:55.3504862Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local ... 2025-03-14T06:45:55.5671963Z 2025-03-14T06:45:55.5672835Z  2025-03-14T06:45:55.5673318Z  2025-03-14T06:45:55.5673746Z  2025-03-14T06:45:55.5674144Z  2025-03-14T06:45:55.5674544Z  2025-03-14T06:45:55.5674943Z  2025-03-14T06:45:55.5675312Z  2025-03-14T06:45:55.5675701Z  2025-03-14T06:45:55.5676639Z [20,200 / 20,652] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2025-03-14T06:45:55.5677709Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 34s local 2025-03-14T06:45:55.5678547Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2025-03-14T06:45:55.5679331Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T06:45:55.5680075Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2025-03-14T06:45:55.5680812Z Compiling xla/pjrt/cpu/cpu_client.cc; 26s local 2025-03-14T06:45:55.5681521Z Compiling xla/service/cpu/cpu_compiler.cc; 25s local 2025-03-14T06:45:55.5682286Z Compiling xla/service/cpu/thunk_emitter.cc; 22s local 2025-03-14T06:45:55.5683205Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local ... 2025-03-14T06:45:55.9675394Z 2025-03-14T06:45:55.9676222Z  2025-03-14T06:45:55.9676712Z  2025-03-14T06:45:55.9677095Z  2025-03-14T06:45:55.9677466Z  2025-03-14T06:45:55.9677954Z  2025-03-14T06:45:55.9678336Z  2025-03-14T06:45:55.9678729Z  2025-03-14T06:45:55.9679120Z  2025-03-14T06:45:55.9680473Z [20,200 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:55.9681584Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2025-03-14T06:45:55.9682414Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2025-03-14T06:45:55.9683213Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2025-03-14T06:45:55.9684044Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2025-03-14T06:45:55.9684991Z Compiling xla/pjrt/cpu/cpu_client.cc; 26s local 2025-03-14T06:45:55.9685789Z Compiling xla/service/cpu/cpu_compiler.cc; 25s local 2025-03-14T06:45:55.9686771Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2025-03-14T06:45:55.9687579Z Compiling xla/service/cpu/ir_emitter2.cc; 21s local ... 2025-03-14T06:45:56.8019922Z 2025-03-14T06:45:56.8020799Z  2025-03-14T06:45:56.8021280Z  2025-03-14T06:45:56.8021700Z  2025-03-14T06:45:56.8022098Z  2025-03-14T06:45:56.8022489Z  2025-03-14T06:45:56.8022894Z  2025-03-14T06:45:56.8023266Z  2025-03-14T06:45:56.8023656Z  2025-03-14T06:45:56.8024584Z [20,201 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:56.8025631Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 35s local 2025-03-14T06:45:56.8026465Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2025-03-14T06:45:56.8027275Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2025-03-14T06:45:56.8028406Z Compiling xla/service/cpu/cpu_compiler.cc; 28s local 2025-03-14T06:45:56.8029262Z Compiling xla/pjrt/cpu/cpu_client.cc; 27s local 2025-03-14T06:45:56.8030122Z Compiling xla/service/cpu/cpu_compiler.cc; 26s local 2025-03-14T06:45:56.8030999Z Compiling xla/service/cpu/thunk_emitter.cc; 23s local 2025-03-14T06:45:56.8031807Z Compiling xla/service/cpu/ir_emitter2.cc; 22s local ... 2025-03-14T06:45:57.1730302Z 2025-03-14T06:45:57.1731109Z  2025-03-14T06:45:57.1731887Z  2025-03-14T06:45:57.1732265Z  2025-03-14T06:45:57.1732639Z  2025-03-14T06:45:57.1732990Z  2025-03-14T06:45:57.1733338Z  2025-03-14T06:45:57.1733691Z  2025-03-14T06:45:57.1734053Z  2025-03-14T06:45:57.1734954Z [20,201 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:57.1735996Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T06:45:57.1736779Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2025-03-14T06:45:57.1737490Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2025-03-14T06:45:57.1738201Z Compiling xla/service/cpu/cpu_compiler.cc; 29s local 2025-03-14T06:45:57.1738844Z Compiling xla/pjrt/cpu/cpu_client.cc; 27s local 2025-03-14T06:45:57.1739512Z Compiling xla/service/cpu/cpu_compiler.cc; 26s local 2025-03-14T06:45:57.1740174Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T06:45:57.1740882Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local ... 2025-03-14T06:45:57.6377399Z 2025-03-14T06:45:57.6378314Z  2025-03-14T06:45:57.6378776Z  2025-03-14T06:45:57.6379110Z  2025-03-14T06:45:57.6379443Z  2025-03-14T06:45:57.6379770Z  2025-03-14T06:45:57.6380102Z  2025-03-14T06:45:57.6380417Z  2025-03-14T06:45:57.6380751Z  2025-03-14T06:45:57.6381629Z [20,202 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:57.6382667Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 36s local 2025-03-14T06:45:57.6383506Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2025-03-14T06:45:57.6384276Z Compiling xla/service/cpu/cpu_compiler.cc; 29s local 2025-03-14T06:45:57.6385032Z Compiling xla/pjrt/cpu/cpu_client.cc; 28s local 2025-03-14T06:45:57.6385793Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2025-03-14T06:45:57.6386569Z Compiling xla/service/cpu/thunk_emitter.cc; 24s local 2025-03-14T06:45:57.6387688Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2025-03-14T06:45:57.6388419Z Compiling xla/pjrt/cpu/cpu_client.cc; 21s local ... 2025-03-14T06:45:57.9736532Z 2025-03-14T06:45:57.9737453Z  2025-03-14T06:45:57.9737866Z  2025-03-14T06:45:57.9738341Z  2025-03-14T06:45:57.9738687Z  2025-03-14T06:45:57.9739125Z  2025-03-14T06:45:57.9739594Z  2025-03-14T06:45:57.9740030Z  2025-03-14T06:45:57.9740392Z  2025-03-14T06:45:57.9741653Z [20,202 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:57.9742689Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2025-03-14T06:45:57.9743508Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2025-03-14T06:45:57.9744263Z Compiling xla/service/cpu/cpu_compiler.cc; 29s local 2025-03-14T06:45:57.9744997Z Compiling xla/pjrt/cpu/cpu_client.cc; 28s local 2025-03-14T06:45:57.9745742Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2025-03-14T06:45:57.9746508Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2025-03-14T06:45:57.9747248Z Compiling xla/service/cpu/ir_emitter2.cc; 23s local 2025-03-14T06:45:57.9748000Z Compiling xla/pjrt/cpu/cpu_client.cc; 22s local ... 2025-03-14T06:45:58.1739259Z 2025-03-14T06:45:58.1740123Z  2025-03-14T06:45:58.1740593Z  2025-03-14T06:45:58.1740975Z  2025-03-14T06:45:58.1741404Z  2025-03-14T06:45:58.1742138Z  2025-03-14T06:45:58.1743033Z  2025-03-14T06:45:58.1743559Z  2025-03-14T06:45:58.1744093Z  2025-03-14T06:45:58.1745140Z [20,203 / 20,652] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2025-03-14T06:45:58.1746289Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2025-03-14T06:45:58.1747232Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2025-03-14T06:45:58.1748111Z Compiling xla/service/cpu/cpu_compiler.cc; 30s local 2025-03-14T06:45:58.1749244Z Compiling xla/pjrt/cpu/cpu_client.cc; 28s local 2025-03-14T06:45:58.1750104Z Compiling xla/service/cpu/cpu_compiler.cc; 27s local 2025-03-14T06:45:58.1750966Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2025-03-14T06:45:58.1751852Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2025-03-14T06:45:58.1752921Z Compiling xla/pjrt/cpu/cpu_client.cc; 22s local ... 2025-03-14T06:45:58.5743801Z 2025-03-14T06:45:58.5744750Z  2025-03-14T06:45:58.5745260Z  2025-03-14T06:45:58.5745655Z  2025-03-14T06:45:58.5746047Z  2025-03-14T06:45:58.5746760Z  2025-03-14T06:45:58.5747155Z  2025-03-14T06:45:58.5747719Z  2025-03-14T06:45:58.5748245Z  2025-03-14T06:45:58.5749281Z [20,203 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:58.5750482Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 37s local 2025-03-14T06:45:58.5751448Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2025-03-14T06:45:58.5752370Z Compiling xla/service/cpu/cpu_compiler.cc; 30s local 2025-03-14T06:45:58.5753221Z Compiling xla/pjrt/cpu/cpu_client.cc; 29s local 2025-03-14T06:45:58.5754082Z Compiling xla/service/cpu/cpu_compiler.cc; 28s local 2025-03-14T06:45:58.5754951Z Compiling xla/service/cpu/thunk_emitter.cc; 25s local 2025-03-14T06:45:58.5755868Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2025-03-14T06:45:58.5756765Z Compiling xla/pjrt/cpu/cpu_client.cc; 22s local ... 2025-03-14T06:45:59.0456000Z 2025-03-14T06:45:59.0456878Z  2025-03-14T06:45:59.0457398Z  2025-03-14T06:45:59.0457818Z  2025-03-14T06:45:59.0458188Z  2025-03-14T06:45:59.0458584Z  2025-03-14T06:45:59.0469950Z  2025-03-14T06:45:59.0470396Z  2025-03-14T06:45:59.0470822Z  2025-03-14T06:45:59.0471733Z [20,204 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:45:59.0473072Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2025-03-14T06:45:59.0473928Z Compiling xla/service/cpu/cpu_compiler.cc; 31s local 2025-03-14T06:45:59.0474714Z Compiling xla/pjrt/cpu/cpu_client.cc; 29s local 2025-03-14T06:45:59.0475463Z Compiling xla/service/cpu/cpu_compiler.cc; 28s local 2025-03-14T06:45:59.0476229Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2025-03-14T06:45:59.0477030Z Compiling xla/service/cpu/ir_emitter2.cc; 24s local 2025-03-14T06:45:59.0477802Z Compiling xla/pjrt/cpu/cpu_client.cc; 23s local 2025-03-14T06:45:59.0478818Z Compiling xla/python/ifrt/compiler.cc; 19s local ... 2025-03-14T06:45:59.3749333Z 2025-03-14T06:45:59.3750656Z  2025-03-14T06:45:59.3751157Z  2025-03-14T06:45:59.3751535Z  2025-03-14T06:45:59.3751885Z  2025-03-14T06:45:59.3752217Z  2025-03-14T06:45:59.3752556Z  2025-03-14T06:45:59.3752963Z  2025-03-14T06:45:59.3753427Z  2025-03-14T06:45:59.3754324Z [20,204 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:45:59.3755377Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 38s local 2025-03-14T06:45:59.3756248Z Compiling xla/service/cpu/cpu_compiler.cc; 31s local 2025-03-14T06:45:59.3756981Z Compiling xla/pjrt/cpu/cpu_client.cc; 30s local 2025-03-14T06:45:59.3757739Z Compiling xla/service/cpu/cpu_compiler.cc; 28s local 2025-03-14T06:45:59.3758452Z Compiling xla/service/cpu/thunk_emitter.cc; 26s local 2025-03-14T06:45:59.3759462Z Compiling xla/service/cpu/ir_emitter2.cc; 25s local 2025-03-14T06:45:59.3760236Z Compiling xla/pjrt/cpu/cpu_client.cc; 23s local 2025-03-14T06:45:59.3760970Z Compiling xla/python/ifrt/compiler.cc; 19s local ... 2025-03-14T06:46:00.4098368Z 2025-03-14T06:46:00.4099749Z  2025-03-14T06:46:00.4100255Z  2025-03-14T06:46:00.4100642Z  2025-03-14T06:46:00.4101017Z  2025-03-14T06:46:00.4101723Z  2025-03-14T06:46:00.4102114Z  2025-03-14T06:46:00.4102504Z  2025-03-14T06:46:00.4102899Z  2025-03-14T06:46:00.4103824Z [20,205 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:00.4104905Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T06:46:00.4105820Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2025-03-14T06:46:00.4106546Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2025-03-14T06:46:00.4107309Z Compiling xla/service/cpu/cpu_compiler.cc; 30s local 2025-03-14T06:46:00.4108107Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T06:46:00.4108847Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2025-03-14T06:46:00.4109582Z Compiling xla/pjrt/cpu/cpu_client.cc; 24s local 2025-03-14T06:46:00.4110369Z Compiling xla/python/ifrt/compiler.cc; 20s local ... 2025-03-14T06:46:00.7759124Z 2025-03-14T06:46:00.7760020Z  2025-03-14T06:46:00.7760542Z  2025-03-14T06:46:00.7760911Z  2025-03-14T06:46:00.7761268Z  2025-03-14T06:46:00.7761604Z  2025-03-14T06:46:00.7761942Z  2025-03-14T06:46:00.7762281Z  2025-03-14T06:46:00.7762640Z  2025-03-14T06:46:00.7763524Z [20,206 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:00.7764703Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 39s local 2025-03-14T06:46:00.7765756Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2025-03-14T06:46:00.7766502Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2025-03-14T06:46:00.7767220Z Compiling xla/service/cpu/cpu_compiler.cc; 30s local 2025-03-14T06:46:00.7767931Z Compiling xla/service/cpu/thunk_emitter.cc; 27s local 2025-03-14T06:46:00.7768714Z Compiling xla/service/cpu/ir_emitter2.cc; 26s local 2025-03-14T06:46:00.7769507Z Compiling xla/pjrt/cpu/cpu_client.cc; 24s local 2025-03-14T06:46:00.7770395Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local ... 2025-03-14T06:46:01.5312589Z 2025-03-14T06:46:01.5313480Z  2025-03-14T06:46:01.5313988Z  2025-03-14T06:46:01.5314380Z  2025-03-14T06:46:01.5314768Z  2025-03-14T06:46:01.5315123Z  2025-03-14T06:46:01.5315478Z  2025-03-14T06:46:01.5315843Z  2025-03-14T06:46:01.5316255Z  2025-03-14T06:46:01.5317081Z [20,207 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:01.5318122Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2025-03-14T06:46:01.5319129Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2025-03-14T06:46:01.5319878Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2025-03-14T06:46:01.5320616Z Compiling xla/service/cpu/cpu_compiler.cc; 31s local 2025-03-14T06:46:01.5321350Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2025-03-14T06:46:01.5322068Z Compiling xla/pjrt/cpu/cpu_client.cc; 25s local 2025-03-14T06:46:01.5322783Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2025-03-14T06:46:01.5323595Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local ... 2025-03-14T06:46:01.7768004Z 2025-03-14T06:46:01.7769122Z  2025-03-14T06:46:01.7769601Z  2025-03-14T06:46:01.7770024Z  2025-03-14T06:46:01.7770424Z  2025-03-14T06:46:01.7770845Z  2025-03-14T06:46:01.7771258Z  2025-03-14T06:46:01.7771663Z  2025-03-14T06:46:01.7772364Z  2025-03-14T06:46:01.7773268Z [20,207 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:01.7774193Z Compiling xla/pjrt/pjrt_stream_executor_client.cc; 40s local 2025-03-14T06:46:01.7775058Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2025-03-14T06:46:01.7775852Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2025-03-14T06:46:01.7776594Z Compiling xla/service/cpu/cpu_compiler.cc; 31s local 2025-03-14T06:46:01.7779585Z Compiling xla/service/cpu/thunk_emitter.cc; 28s local 2025-03-14T06:46:01.7780341Z Compiling xla/pjrt/cpu/cpu_client.cc; 25s local 2025-03-14T06:46:01.7781126Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2025-03-14T06:46:01.7781995Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 19s local ... 2025-03-14T06:46:02.3520032Z 2025-03-14T06:46:02.3521178Z  2025-03-14T06:46:02.3521630Z  2025-03-14T06:46:02.3522000Z  2025-03-14T06:46:02.3522380Z  2025-03-14T06:46:02.3522735Z  2025-03-14T06:46:02.3523091Z  2025-03-14T06:46:02.3523469Z  2025-03-14T06:46:02.3523849Z  2025-03-14T06:46:02.3524857Z [20,208 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:02.3525818Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2025-03-14T06:46:02.3526536Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T06:46:02.3527240Z Compiling xla/service/cpu/cpu_compiler.cc; 31s local 2025-03-14T06:46:02.3527966Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2025-03-14T06:46:02.3528654Z Compiling xla/pjrt/cpu/cpu_client.cc; 26s local 2025-03-14T06:46:02.3529386Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T06:46:02.3530234Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2025-03-14T06:46:02.3531094Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local ... 2025-03-14T06:46:02.5773185Z 2025-03-14T06:46:02.5773999Z  2025-03-14T06:46:02.5774439Z  2025-03-14T06:46:02.5774819Z  2025-03-14T06:46:02.5775197Z  2025-03-14T06:46:02.5775556Z  2025-03-14T06:46:02.5775917Z  2025-03-14T06:46:02.5776275Z  2025-03-14T06:46:02.5776623Z  2025-03-14T06:46:02.5777462Z [20,208 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:02.5778354Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2025-03-14T06:46:02.5779328Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T06:46:02.5779998Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2025-03-14T06:46:02.5780769Z Compiling xla/service/cpu/thunk_emitter.cc; 29s local 2025-03-14T06:46:02.5781444Z Compiling xla/pjrt/cpu/cpu_client.cc; 26s local 2025-03-14T06:46:02.5782156Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T06:46:02.5782930Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2025-03-14T06:46:02.5783732Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 18s local ... 2025-03-14T06:46:02.7821846Z 2025-03-14T06:46:02.7822704Z  2025-03-14T06:46:02.7823088Z  2025-03-14T06:46:02.7823436Z  2025-03-14T06:46:02.7823773Z  2025-03-14T06:46:02.7824106Z  2025-03-14T06:46:02.7824435Z  2025-03-14T06:46:02.7824762Z  2025-03-14T06:46:02.7825097Z  2025-03-14T06:46:02.7825874Z [20,209 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:02.7826728Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2025-03-14T06:46:02.7827358Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T06:46:02.7827978Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2025-03-14T06:46:02.7828598Z Compiling xla/pjrt/cpu/cpu_client.cc; 26s local 2025-03-14T06:46:02.7829256Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T06:46:02.7830146Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 20s local 2025-03-14T06:46:02.7830880Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 19s local 2025-03-14T06:46:02.7831573Z Compiling xla/service/cpu/ir_emitter.cc; 18s local ... 2025-03-14T06:46:03.1778362Z 2025-03-14T06:46:03.1779574Z  2025-03-14T06:46:03.1780074Z  2025-03-14T06:46:03.1780495Z  2025-03-14T06:46:03.1780910Z  2025-03-14T06:46:03.1781317Z  2025-03-14T06:46:03.1781722Z  2025-03-14T06:46:03.1782444Z  2025-03-14T06:46:03.1782852Z  2025-03-14T06:46:03.1783834Z [20,209 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:03.1784897Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2025-03-14T06:46:03.1785687Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T06:46:03.1786477Z Compiling xla/service/cpu/cpu_compiler.cc; 32s local 2025-03-14T06:46:03.1787251Z Compiling xla/pjrt/cpu/cpu_client.cc; 27s local 2025-03-14T06:46:03.1788082Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T06:46:03.1788982Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2025-03-14T06:46:03.1789911Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 19s local 2025-03-14T06:46:03.1790897Z Compiling xla/service/cpu/ir_emitter.cc; 19s local ... 2025-03-14T06:46:03.7429184Z 2025-03-14T06:46:03.7430156Z  2025-03-14T06:46:03.7430625Z  2025-03-14T06:46:03.7431050Z  2025-03-14T06:46:03.7431453Z  2025-03-14T06:46:03.7431846Z  2025-03-14T06:46:03.7432247Z  2025-03-14T06:46:03.7432612Z  2025-03-14T06:46:03.7432954Z  2025-03-14T06:46:03.7434009Z [20,210 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:03.7434968Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2025-03-14T06:46:03.7435696Z Compiling xla/pjrt/cpu/cpu_client.cc; 34s local 2025-03-14T06:46:03.7436429Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2025-03-14T06:46:03.7437009Z Compiling xla/pjrt/cpu/cpu_client.cc; 27s local 2025-03-14T06:46:03.7437563Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 21s local 2025-03-14T06:46:03.7438195Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 19s local 2025-03-14T06:46:03.7438858Z Compiling xla/service/cpu/ir_emitter.cc; 19s local 2025-03-14T06:46:03.7439546Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 19s local ... 2025-03-14T06:46:03.9783741Z 2025-03-14T06:46:03.9784904Z  2025-03-14T06:46:03.9785442Z  2025-03-14T06:46:03.9785842Z  2025-03-14T06:46:03.9786411Z  2025-03-14T06:46:03.9786781Z  2025-03-14T06:46:03.9787167Z  2025-03-14T06:46:03.9787530Z  2025-03-14T06:46:03.9787882Z  2025-03-14T06:46:03.9788790Z [20,210 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:03.9789794Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2025-03-14T06:46:03.9790704Z Compiling xla/pjrt/cpu/cpu_client.cc; 34s local 2025-03-14T06:46:03.9791438Z Compiling xla/service/cpu/cpu_compiler.cc; 33s local 2025-03-14T06:46:03.9792209Z Compiling xla/pjrt/cpu/cpu_client.cc; 28s local 2025-03-14T06:46:03.9792916Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 22s local 2025-03-14T06:46:03.9793733Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 20s local 2025-03-14T06:46:03.9794527Z Compiling xla/service/cpu/ir_emitter.cc; 20s local 2025-03-14T06:46:03.9795390Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 19s local ... 2025-03-14T06:46:04.9791311Z 2025-03-14T06:46:04.9792255Z  2025-03-14T06:46:04.9792757Z  2025-03-14T06:46:04.9793173Z  2025-03-14T06:46:04.9793555Z  2025-03-14T06:46:04.9793941Z  2025-03-14T06:46:04.9794345Z  2025-03-14T06:46:04.9794738Z  2025-03-14T06:46:04.9795131Z  2025-03-14T06:46:04.9796393Z [20,210 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:04.9797394Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local 2025-03-14T06:46:04.9798139Z Compiling xla/pjrt/cpu/cpu_client.cc; 35s local 2025-03-14T06:46:04.9798862Z Compiling xla/service/cpu/cpu_compiler.cc; 34s local 2025-03-14T06:46:04.9799576Z Compiling xla/pjrt/cpu/cpu_client.cc; 29s local 2025-03-14T06:46:04.9800294Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2025-03-14T06:46:04.9801392Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 21s local 2025-03-14T06:46:04.9802198Z Compiling xla/service/cpu/ir_emitter.cc; 21s local 2025-03-14T06:46:04.9803146Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 20s local ... 2025-03-14T06:46:05.8049009Z 2025-03-14T06:46:05.8050178Z  2025-03-14T06:46:05.8050629Z  2025-03-14T06:46:05.8051007Z  2025-03-14T06:46:05.8051375Z  2025-03-14T06:46:05.8051774Z  2025-03-14T06:46:05.8052127Z  2025-03-14T06:46:05.8052484Z  2025-03-14T06:46:05.8052885Z  2025-03-14T06:46:05.8053774Z [20,212 / 20,652] 5 / 17 tests; 47 actions, 46 running; last test: ...til_test 2025-03-14T06:46:05.8054735Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local 2025-03-14T06:46:05.8055451Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2025-03-14T06:46:05.8056173Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2025-03-14T06:46:05.8056935Z Compiling xla/pjrt/cpu/cpu_client.cc; 29s local 2025-03-14T06:46:05.8057685Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 23s local 2025-03-14T06:46:05.8058501Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T06:46:05.8059276Z Compiling xla/service/cpu/ir_emitter.cc; 21s local 2025-03-14T06:46:05.8060169Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 21s local ... 2025-03-14T06:46:06.1799930Z 2025-03-14T06:46:06.1801122Z  2025-03-14T06:46:06.1801593Z  2025-03-14T06:46:06.1801969Z  2025-03-14T06:46:06.1802364Z  2025-03-14T06:46:06.1802781Z  2025-03-14T06:46:06.1803161Z  2025-03-14T06:46:06.1803544Z  2025-03-14T06:46:06.1803914Z  2025-03-14T06:46:06.1804920Z [20,212 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:06.1805886Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2025-03-14T06:46:06.1806640Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2025-03-14T06:46:06.1807792Z Compiling xla/service/cpu/cpu_compiler.cc; 35s local 2025-03-14T06:46:06.1808555Z Compiling xla/pjrt/cpu/cpu_client.cc; 30s local 2025-03-14T06:46:06.1809334Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 24s local 2025-03-14T06:46:06.1810343Z Compiling xla/python/pjrt_ifrt/xla_compiler.cc; 22s local 2025-03-14T06:46:06.1811121Z Compiling xla/service/cpu/ir_emitter.cc; 22s local 2025-03-14T06:46:06.1812101Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 21s local ... 2025-03-14T06:46:07.2638018Z 2025-03-14T06:46:07.2639575Z  2025-03-14T06:46:07.2640067Z  2025-03-14T06:46:07.2640456Z  2025-03-14T06:46:07.2640813Z  2025-03-14T06:46:07.2641170Z  2025-03-14T06:46:07.2641620Z  2025-03-14T06:46:07.2641968Z  2025-03-14T06:46:07.2642339Z  2025-03-14T06:46:07.2643293Z [20,213 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:07.2644233Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2025-03-14T06:46:07.2645118Z Compiling xla/pjrt/cpu/cpu_client.cc; 38s local 2025-03-14T06:46:07.2645788Z Compiling xla/service/cpu/cpu_compiler.cc; 36s local 2025-03-14T06:46:07.2646462Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2025-03-14T06:46:07.2647158Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2025-03-14T06:46:07.2647949Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2025-03-14T06:46:07.2649109Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 23s local 2025-03-14T06:46:07.2650099Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 22s local ... 2025-03-14T06:46:07.5809168Z 2025-03-14T06:46:07.5810651Z  2025-03-14T06:46:07.5811169Z  2025-03-14T06:46:07.5812570Z  2025-03-14T06:46:07.5813538Z  2025-03-14T06:46:07.5814892Z  2025-03-14T06:46:07.5816076Z  2025-03-14T06:46:07.5817240Z  2025-03-14T06:46:07.5818455Z  2025-03-14T06:46:07.5820402Z [20,213 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:07.5821458Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2025-03-14T06:46:07.5822256Z Compiling xla/pjrt/cpu/cpu_client.cc; 38s local 2025-03-14T06:46:07.5823196Z Compiling xla/service/cpu/cpu_compiler.cc; 37s local 2025-03-14T06:46:07.5823952Z Compiling xla/pjrt/cpu/cpu_client.cc; 31s local 2025-03-14T06:46:07.5824756Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 25s local 2025-03-14T06:46:07.5825546Z Compiling xla/service/cpu/ir_emitter.cc; 23s local 2025-03-14T06:46:07.5826478Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 23s local 2025-03-14T06:46:07.5827510Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 23s local ... 2025-03-14T06:46:08.4422627Z 2025-03-14T06:46:08.4423930Z  2025-03-14T06:46:08.4424344Z  2025-03-14T06:46:08.4425883Z  2025-03-14T06:46:08.4426654Z  2025-03-14T06:46:08.4427875Z  2025-03-14T06:46:08.4428894Z  2025-03-14T06:46:08.4430118Z  2025-03-14T06:46:08.4431112Z  2025-03-14T06:46:08.4432820Z [20,214 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:08.4433910Z Compiling xla/service/cpu/cpu_compiler.cc; 40s local 2025-03-14T06:46:08.4434725Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2025-03-14T06:46:08.4435537Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2025-03-14T06:46:08.4436347Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2025-03-14T06:46:08.4437124Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2025-03-14T06:46:08.4437942Z Compiling xla/service/cpu/ir_emitter.cc; 24s local 2025-03-14T06:46:08.4438830Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 24s local 2025-03-14T06:46:08.4439925Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 23s local ... 2025-03-14T06:46:08.7470529Z 2025-03-14T06:46:08.7472219Z  2025-03-14T06:46:08.7472778Z  2025-03-14T06:46:08.7473156Z  2025-03-14T06:46:08.7473526Z  2025-03-14T06:46:08.7473918Z  2025-03-14T06:46:08.7474316Z  2025-03-14T06:46:08.7474677Z  2025-03-14T06:46:08.7474987Z  2025-03-14T06:46:08.7475846Z [20,215 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:08.7476799Z Compiling xla/service/cpu/cpu_compiler.cc; 40s local 2025-03-14T06:46:08.7477696Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2025-03-14T06:46:08.7478357Z Compiling xla/pjrt/cpu/cpu_client.cc; 32s local 2025-03-14T06:46:08.7479034Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 26s local 2025-03-14T06:46:08.7479660Z Compiling xla/service/cpu/ir_emitter.cc; 24s local 2025-03-14T06:46:08.7480358Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 24s local 2025-03-14T06:46:08.7481322Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 24s local 2025-03-14T06:46:08.7482289Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 24s local ... 2025-03-14T06:46:08.9818352Z 2025-03-14T06:46:08.9819798Z  2025-03-14T06:46:08.9820273Z  2025-03-14T06:46:08.9821759Z  2025-03-14T06:46:08.9822901Z  2025-03-14T06:46:08.9824002Z  2025-03-14T06:46:08.9825159Z  2025-03-14T06:46:08.9826401Z  2025-03-14T06:46:08.9827740Z  2025-03-14T06:46:08.9829374Z [20,215 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:08.9830365Z Compiling xla/service/cpu/cpu_compiler.cc; 40s local 2025-03-14T06:46:08.9831113Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2025-03-14T06:46:08.9831799Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T06:46:08.9832528Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 27s local 2025-03-14T06:46:08.9833484Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2025-03-14T06:46:08.9834452Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 24s local 2025-03-14T06:46:08.9835389Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 24s local 2025-03-14T06:46:08.9836444Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 24s local ... 2025-03-14T06:46:09.2101829Z 2025-03-14T06:46:09.2103302Z  2025-03-14T06:46:09.2103794Z  2025-03-14T06:46:09.2105110Z  2025-03-14T06:46:09.2106004Z  2025-03-14T06:46:09.2107107Z  2025-03-14T06:46:09.2108440Z  2025-03-14T06:46:09.2109681Z  2025-03-14T06:46:09.2111082Z  2025-03-14T06:46:09.2112743Z [20,216 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:09.2113643Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T06:46:09.2114433Z Compiling xla/service/cpu/cpu_compiler.cc; 38s local 2025-03-14T06:46:09.2115088Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T06:46:09.2115819Z Compiling xla/python/pjrt_ifrt/pjrt_array.cc; 27s local 2025-03-14T06:46:09.2116658Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2025-03-14T06:46:09.2117493Z Compiling xla/pjrt/plugin/xla_cpu/xla_cpu_pjrt_client.cc; 24s local 2025-03-14T06:46:09.2118360Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 24s local 2025-03-14T06:46:09.2119319Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 24s local ... 2025-03-14T06:46:09.5551558Z 2025-03-14T06:46:09.5553258Z  2025-03-14T06:46:09.5553773Z  2025-03-14T06:46:09.5555120Z  2025-03-14T06:46:09.5555943Z  2025-03-14T06:46:09.5557087Z  2025-03-14T06:46:09.5558180Z  2025-03-14T06:46:09.5559355Z  2025-03-14T06:46:09.5560444Z  2025-03-14T06:46:09.5562113Z [20,218 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:09.5563185Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T06:46:09.5564233Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2025-03-14T06:46:09.5565225Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T06:46:09.5566252Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2025-03-14T06:46:09.5567104Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 25s local 2025-03-14T06:46:09.5568057Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 25s local 2025-03-14T06:46:09.5569142Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 24s local 2025-03-14T06:46:09.5570377Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 24s local ... 2025-03-14T06:46:09.7824606Z 2025-03-14T06:46:09.7826115Z  2025-03-14T06:46:09.7826759Z  2025-03-14T06:46:09.7828066Z  2025-03-14T06:46:09.7828898Z  2025-03-14T06:46:09.7830008Z  2025-03-14T06:46:09.7831098Z  2025-03-14T06:46:09.7832243Z  2025-03-14T06:46:09.7833316Z  2025-03-14T06:46:09.7835016Z [20,218 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:09.7836028Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T06:46:09.7836774Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2025-03-14T06:46:09.7837482Z Compiling xla/pjrt/cpu/cpu_client.cc; 33s local 2025-03-14T06:46:09.7838059Z Compiling xla/service/cpu/ir_emitter.cc; 25s local 2025-03-14T06:46:09.7839026Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 25s local 2025-03-14T06:46:09.7840086Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 25s local 2025-03-14T06:46:09.7841144Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 25s local 2025-03-14T06:46:09.7841949Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 24s local ... 2025-03-14T06:46:10.0048831Z 2025-03-14T06:46:10.0050336Z  2025-03-14T06:46:10.0050817Z  2025-03-14T06:46:10.0051478Z  2025-03-14T06:46:10.0051848Z  2025-03-14T06:46:10.0052239Z  2025-03-14T06:46:10.0052624Z  2025-03-14T06:46:10.0053106Z  2025-03-14T06:46:10.0053708Z  2025-03-14T06:46:10.0054637Z [20,219 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:10.0055651Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2025-03-14T06:46:10.0056402Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2025-03-14T06:46:10.0057162Z Compiling xla/pjrt/cpu/cpu_client.cc; 34s local 2025-03-14T06:46:10.0057900Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2025-03-14T06:46:10.0058735Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 25s local 2025-03-14T06:46:10.0059740Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 25s local 2025-03-14T06:46:10.0060763Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 25s local 2025-03-14T06:46:10.0061819Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 24s local ... 2025-03-14T06:46:10.3830752Z 2025-03-14T06:46:10.3832183Z  2025-03-14T06:46:10.3832636Z  2025-03-14T06:46:10.3834058Z  2025-03-14T06:46:10.3834960Z  2025-03-14T06:46:10.3836280Z  2025-03-14T06:46:10.3837462Z  2025-03-14T06:46:10.3838861Z  2025-03-14T06:46:10.3839958Z  2025-03-14T06:46:10.3841734Z [20,219 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:10.3842827Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2025-03-14T06:46:10.3843632Z Compiling xla/service/cpu/cpu_compiler.cc; 39s local 2025-03-14T06:46:10.3844415Z Compiling xla/pjrt/cpu/cpu_client.cc; 34s local 2025-03-14T06:46:10.3845289Z Compiling xla/service/cpu/ir_emitter.cc; 26s local 2025-03-14T06:46:10.3846107Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 25s local 2025-03-14T06:46:10.3847127Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 25s local 2025-03-14T06:46:10.3848587Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 25s local 2025-03-14T06:46:10.3849645Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 25s local ... 2025-03-14T06:46:11.5839160Z 2025-03-14T06:46:11.5840673Z  2025-03-14T06:46:11.5841154Z  2025-03-14T06:46:11.5842648Z  2025-03-14T06:46:11.5843589Z  2025-03-14T06:46:11.5844924Z  2025-03-14T06:46:11.5846228Z  2025-03-14T06:46:11.5847676Z  2025-03-14T06:46:11.5848837Z  2025-03-14T06:46:11.5851026Z [20,219 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:11.5852173Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2025-03-14T06:46:11.5852990Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T06:46:11.5853768Z Compiling xla/pjrt/cpu/cpu_client.cc; 35s local 2025-03-14T06:46:11.5854525Z Compiling xla/service/cpu/ir_emitter.cc; 27s local 2025-03-14T06:46:11.5855451Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 27s local 2025-03-14T06:46:11.5856490Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 27s local 2025-03-14T06:46:11.5857599Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 26s local 2025-03-14T06:46:11.5858650Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 26s local ... 2025-03-14T06:46:11.9390700Z 2025-03-14T06:46:11.9392181Z  2025-03-14T06:46:11.9393109Z  2025-03-14T06:46:11.9393538Z  2025-03-14T06:46:11.9393963Z  2025-03-14T06:46:11.9394381Z  2025-03-14T06:46:11.9394800Z  2025-03-14T06:46:11.9395199Z  2025-03-14T06:46:11.9395620Z  2025-03-14T06:46:11.9396578Z [20,220 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:11.9397579Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2025-03-14T06:46:11.9398353Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T06:46:11.9399349Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2025-03-14T06:46:11.9400108Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2025-03-14T06:46:11.9400878Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 27s local 2025-03-14T06:46:11.9401821Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 27s local 2025-03-14T06:46:11.9402826Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 27s local 2025-03-14T06:46:11.9403846Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 26s local ... 2025-03-14T06:46:12.1844136Z 2025-03-14T06:46:12.1845782Z  2025-03-14T06:46:12.1846299Z  2025-03-14T06:46:12.1847805Z  2025-03-14T06:46:12.1848924Z  2025-03-14T06:46:12.1850058Z  2025-03-14T06:46:12.1850889Z  2025-03-14T06:46:12.1852108Z  2025-03-14T06:46:12.1853418Z  2025-03-14T06:46:12.1855240Z [20,220 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:12.1856360Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2025-03-14T06:46:12.1857208Z Compiling xla/service/cpu/cpu_compiler.cc; 41s local 2025-03-14T06:46:12.1857999Z Compiling xla/pjrt/cpu/cpu_client.cc; 36s local 2025-03-14T06:46:12.1858739Z Compiling xla/service/cpu/ir_emitter.cc; 28s local 2025-03-14T06:46:12.1859723Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 27s local 2025-03-14T06:46:12.1860955Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 27s local 2025-03-14T06:46:12.1862338Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 27s local 2025-03-14T06:46:12.1863422Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 27s local ... 2025-03-14T06:46:13.1440932Z 2025-03-14T06:46:13.1442387Z  2025-03-14T06:46:13.1442820Z  2025-03-14T06:46:13.1444320Z  2025-03-14T06:46:13.1445351Z  2025-03-14T06:46:13.1446565Z  2025-03-14T06:46:13.1447753Z  2025-03-14T06:46:13.1449071Z  2025-03-14T06:46:13.1450513Z  2025-03-14T06:46:13.1452054Z [20,221 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:13.1453168Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T06:46:13.1454036Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2025-03-14T06:46:13.1454841Z Compiling xla/pjrt/cpu/cpu_client.cc; 37s local 2025-03-14T06:46:13.1455651Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T06:46:13.1456904Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 28s local 2025-03-14T06:46:13.1457940Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 28s local 2025-03-14T06:46:13.1459049Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 28s local 2025-03-14T06:46:13.1460079Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 28s local ... 2025-03-14T06:46:13.3853183Z 2025-03-14T06:46:13.3854527Z  2025-03-14T06:46:13.3854965Z  2025-03-14T06:46:13.3856574Z  2025-03-14T06:46:13.3857494Z  2025-03-14T06:46:13.3858837Z  2025-03-14T06:46:13.3859934Z  2025-03-14T06:46:13.3860773Z  2025-03-14T06:46:13.3861700Z  2025-03-14T06:46:13.3863602Z [20,221 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:13.3864601Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T06:46:13.3865784Z Compiling xla/service/cpu/cpu_compiler.cc; 42s local 2025-03-14T06:46:13.3866531Z Compiling xla/pjrt/cpu/cpu_client.cc; 37s local 2025-03-14T06:46:13.3867238Z Compiling xla/service/cpu/ir_emitter.cc; 29s local 2025-03-14T06:46:13.3868067Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 28s local 2025-03-14T06:46:13.3868991Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 28s local 2025-03-14T06:46:13.3870046Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 28s local 2025-03-14T06:46:13.3871252Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 28s local ... 2025-03-14T06:46:14.3860485Z 2025-03-14T06:46:14.3861994Z  2025-03-14T06:46:14.3862502Z  2025-03-14T06:46:14.3863933Z  2025-03-14T06:46:14.3864948Z  2025-03-14T06:46:14.3866539Z  2025-03-14T06:46:14.3867918Z  2025-03-14T06:46:14.3869074Z  2025-03-14T06:46:14.3870403Z  2025-03-14T06:46:14.3872313Z [20,221 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:14.3873312Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2025-03-14T06:46:14.3874054Z Compiling xla/service/cpu/cpu_compiler.cc; 43s local 2025-03-14T06:46:14.3874758Z Compiling xla/pjrt/cpu/cpu_client.cc; 38s local 2025-03-14T06:46:14.3875442Z Compiling xla/service/cpu/ir_emitter.cc; 30s local 2025-03-14T06:46:14.3876205Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 29s local 2025-03-14T06:46:14.3877144Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 29s local 2025-03-14T06:46:14.3878154Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 29s local 2025-03-14T06:46:14.3878991Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 29s local ... 2025-03-14T06:46:15.1693257Z 2025-03-14T06:46:15.1694768Z  2025-03-14T06:46:15.1695229Z  2025-03-14T06:46:15.1696655Z  2025-03-14T06:46:15.1698347Z  2025-03-14T06:46:15.1698682Z  2025-03-14T06:46:15.1700334Z  2025-03-14T06:46:15.1700708Z  2025-03-14T06:46:15.1702590Z  2025-03-14T06:46:15.1703490Z [20,222 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:15.1704666Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2025-03-14T06:46:15.1705622Z Compiling xla/service/cpu/cpu_compiler.cc; 44s local 2025-03-14T06:46:15.1706439Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2025-03-14T06:46:15.1707230Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2025-03-14T06:46:15.1708361Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 30s local 2025-03-14T06:46:15.1709431Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 30s local 2025-03-14T06:46:15.1710451Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 30s local 2025-03-14T06:46:15.1711474Z Compiling torch_xla/csrc/runtime/pjrt_registry.cc; 30s local ... 2025-03-14T06:46:15.3868411Z 2025-03-14T06:46:15.3869347Z  2025-03-14T06:46:15.3869780Z  2025-03-14T06:46:15.3871472Z  2025-03-14T06:46:15.3872107Z  2025-03-14T06:46:15.3873590Z  2025-03-14T06:46:15.3873947Z  2025-03-14T06:46:15.3875615Z  2025-03-14T06:46:15.3875975Z  2025-03-14T06:46:15.3878127Z [20,227 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:15.3879004Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2025-03-14T06:46:15.3879715Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T06:46:15.3880387Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2025-03-14T06:46:15.3881088Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2025-03-14T06:46:15.3881866Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 30s local 2025-03-14T06:46:15.3882809Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 30s local 2025-03-14T06:46:15.3883764Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 30s local 2025-03-14T06:46:15.3886265Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 29s local ... 2025-03-14T06:46:15.5871611Z 2025-03-14T06:46:15.5873008Z  2025-03-14T06:46:15.5873432Z  2025-03-14T06:46:15.5874978Z  2025-03-14T06:46:15.5875840Z  2025-03-14T06:46:15.5877139Z  2025-03-14T06:46:15.5878229Z  2025-03-14T06:46:15.5879685Z  2025-03-14T06:46:15.5880802Z  2025-03-14T06:46:15.5882935Z [20,227 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:15.5883988Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2025-03-14T06:46:15.5884917Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T06:46:15.5885753Z Compiling xla/pjrt/cpu/cpu_client.cc; 39s local 2025-03-14T06:46:15.5886488Z Compiling xla/service/cpu/ir_emitter.cc; 31s local 2025-03-14T06:46:15.5887346Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 31s local 2025-03-14T06:46:15.5888416Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 30s local 2025-03-14T06:46:15.5889479Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 30s local 2025-03-14T06:46:15.5890559Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 30s local ... 2025-03-14T06:46:15.9839063Z 2025-03-14T06:46:15.9840519Z  2025-03-14T06:46:15.9840983Z  2025-03-14T06:46:15.9842360Z  2025-03-14T06:46:15.9843165Z  2025-03-14T06:46:15.9844293Z  2025-03-14T06:46:15.9845742Z  2025-03-14T06:46:15.9847008Z  2025-03-14T06:46:15.9848203Z  2025-03-14T06:46:15.9850129Z [20,228 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:15.9851165Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2025-03-14T06:46:15.9851993Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T06:46:15.9852791Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2025-03-14T06:46:15.9853680Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 31s local 2025-03-14T06:46:15.9854723Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 31s local 2025-03-14T06:46:15.9855818Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 30s local 2025-03-14T06:46:15.9856855Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 30s local 2025-03-14T06:46:15.9857775Z Compiling torch_xla/csrc/runtime/runtime.cc; 30s local ... 2025-03-14T06:46:16.1875570Z 2025-03-14T06:46:16.1877515Z  2025-03-14T06:46:16.1878006Z  2025-03-14T06:46:16.1879671Z  2025-03-14T06:46:16.1880797Z  2025-03-14T06:46:16.1881863Z  2025-03-14T06:46:16.1883058Z  2025-03-14T06:46:16.1884309Z  2025-03-14T06:46:16.1885775Z  2025-03-14T06:46:16.1887645Z [20,228 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:16.1888736Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2025-03-14T06:46:16.1889732Z Compiling xla/service/cpu/cpu_compiler.cc; 45s local 2025-03-14T06:46:16.1890517Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2025-03-14T06:46:16.1891372Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 31s local 2025-03-14T06:46:16.1892367Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 31s local 2025-03-14T06:46:16.1893570Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 31s local 2025-03-14T06:46:16.1894588Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 30s local 2025-03-14T06:46:16.1895546Z Compiling torch_xla/csrc/runtime/runtime.cc; 30s local ... 2025-03-14T06:46:16.6648556Z 2025-03-14T06:46:16.6650016Z  2025-03-14T06:46:16.6650420Z  2025-03-14T06:46:16.6651854Z  2025-03-14T06:46:16.6652802Z  2025-03-14T06:46:16.6654068Z  2025-03-14T06:46:16.6655132Z  2025-03-14T06:46:16.6656477Z  2025-03-14T06:46:16.6657395Z  2025-03-14T06:46:16.6659156Z [20,229 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:16.6660169Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2025-03-14T06:46:16.6660985Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2025-03-14T06:46:16.6661715Z Compiling xla/service/cpu/ir_emitter.cc; 32s local 2025-03-14T06:46:16.6662982Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local 2025-03-14T06:46:16.6664067Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local 2025-03-14T06:46:16.6665166Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 31s local 2025-03-14T06:46:16.6666437Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 31s local 2025-03-14T06:46:16.6667488Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 30s local ... 2025-03-14T06:46:16.9881733Z 2025-03-14T06:46:16.9883230Z  2025-03-14T06:46:16.9883713Z  2025-03-14T06:46:16.9885285Z  2025-03-14T06:46:16.9886260Z  2025-03-14T06:46:16.9887320Z  2025-03-14T06:46:16.9888502Z  2025-03-14T06:46:16.9889784Z  2025-03-14T06:46:16.9891219Z  2025-03-14T06:46:16.9892955Z [20,231 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:16.9894012Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2025-03-14T06:46:16.9894826Z Compiling xla/service/cpu/cpu_compiler.cc; 46s local 2025-03-14T06:46:16.9895633Z Compiling xla/service/cpu/ir_emitter.cc; 33s local 2025-03-14T06:46:16.9896582Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local 2025-03-14T06:46:16.9897611Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 32s local 2025-03-14T06:46:16.9898641Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 31s local 2025-03-14T06:46:16.9899655Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 31s local 2025-03-14T06:46:16.9900722Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 30s local ... 2025-03-14T06:46:17.9889529Z 2025-03-14T06:46:17.9890397Z  2025-03-14T06:46:17.9890880Z  2025-03-14T06:46:17.9891290Z  2025-03-14T06:46:17.9891714Z  2025-03-14T06:46:17.9892079Z  2025-03-14T06:46:17.9892465Z  2025-03-14T06:46:17.9892899Z  2025-03-14T06:46:17.9893302Z  2025-03-14T06:46:17.9894549Z [20,232 / 20,652] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2025-03-14T06:46:17.9895590Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2025-03-14T06:46:17.9896360Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2025-03-14T06:46:17.9897126Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2025-03-14T06:46:17.9897971Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local 2025-03-14T06:46:17.9899003Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local 2025-03-14T06:46:17.9900321Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local 2025-03-14T06:46:17.9901457Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 32s local 2025-03-14T06:46:17.9902555Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 31s local ... 2025-03-14T06:46:18.1958854Z 2025-03-14T06:46:18.1959741Z  2025-03-14T06:46:18.1960253Z  2025-03-14T06:46:18.1960687Z  2025-03-14T06:46:18.1961106Z  2025-03-14T06:46:18.1961486Z  2025-03-14T06:46:18.1961925Z  2025-03-14T06:46:18.1962328Z  2025-03-14T06:46:18.1962717Z  2025-03-14T06:46:18.1963683Z [20,233 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:18.1964872Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T06:46:18.1965909Z Compiling xla/service/cpu/cpu_compiler.cc; 47s local 2025-03-14T06:46:18.1966998Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2025-03-14T06:46:18.1967934Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local 2025-03-14T06:46:18.1969033Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local 2025-03-14T06:46:18.1970113Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2025-03-14T06:46:18.1970997Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 32s local 2025-03-14T06:46:18.1972091Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local ... 2025-03-14T06:46:18.5084930Z 2025-03-14T06:46:18.5085774Z  2025-03-14T06:46:18.5086296Z  2025-03-14T06:46:18.5086745Z  2025-03-14T06:46:18.5087121Z  2025-03-14T06:46:18.5087505Z  2025-03-14T06:46:18.5087904Z  2025-03-14T06:46:18.5088280Z  2025-03-14T06:46:18.5088684Z  2025-03-14T06:46:18.5089666Z [20,234 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:18.5090779Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T06:46:18.5091564Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2025-03-14T06:46:18.5092328Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2025-03-14T06:46:18.5093243Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local 2025-03-14T06:46:18.5094323Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 33s local 2025-03-14T06:46:18.5095464Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2025-03-14T06:46:18.5096504Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 33s local 2025-03-14T06:46:18.5097404Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local ... 2025-03-14T06:46:18.7895316Z 2025-03-14T06:46:18.7896189Z  2025-03-14T06:46:18.7896646Z  2025-03-14T06:46:18.7897090Z  2025-03-14T06:46:18.7897495Z  2025-03-14T06:46:18.7897889Z  2025-03-14T06:46:18.7898268Z  2025-03-14T06:46:18.7898656Z  2025-03-14T06:46:18.7899049Z  2025-03-14T06:46:18.7900018Z [20,235 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:18.7900971Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T06:46:18.7901768Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2025-03-14T06:46:18.7902508Z Compiling xla/service/cpu/ir_emitter.cc; 34s local 2025-03-14T06:46:18.7903767Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local 2025-03-14T06:46:18.7904837Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local 2025-03-14T06:46:18.7905939Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2025-03-14T06:46:18.7907004Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 33s local 2025-03-14T06:46:18.7908153Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local ... 2025-03-14T06:46:18.9898912Z 2025-03-14T06:46:18.9900096Z  2025-03-14T06:46:18.9900651Z  2025-03-14T06:46:18.9901122Z  2025-03-14T06:46:18.9901511Z  2025-03-14T06:46:18.9901927Z  2025-03-14T06:46:18.9902337Z  2025-03-14T06:46:18.9902742Z  2025-03-14T06:46:18.9903150Z  2025-03-14T06:46:18.9904162Z [20,236 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:18.9905251Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T06:46:18.9906082Z Compiling xla/service/cpu/cpu_compiler.cc; 48s local 2025-03-14T06:46:18.9906884Z Compiling xla/service/cpu/ir_emitter.cc; 35s local 2025-03-14T06:46:18.9907850Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local 2025-03-14T06:46:18.9909078Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 34s local 2025-03-14T06:46:18.9910112Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2025-03-14T06:46:18.9911399Z Compiling .../csrc/runtime/pjrt_computation_client_test.cc; 33s local 2025-03-14T06:46:18.9923631Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 32s local ... 2025-03-14T06:46:19.7575787Z 2025-03-14T06:46:19.7576638Z  2025-03-14T06:46:19.7577131Z  2025-03-14T06:46:19.7577528Z  2025-03-14T06:46:19.7577942Z  2025-03-14T06:46:19.7578334Z  2025-03-14T06:46:19.7579098Z  2025-03-14T06:46:19.7579471Z  2025-03-14T06:46:19.7579861Z  2025-03-14T06:46:19.7580806Z [20,237 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:19.7581805Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2025-03-14T06:46:19.7582597Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2025-03-14T06:46:19.7583338Z Compiling xla/service/cpu/ir_emitter.cc; 35s local 2025-03-14T06:46:19.7584234Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2025-03-14T06:46:19.7585146Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2025-03-14T06:46:19.7586207Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 34s local 2025-03-14T06:46:19.7587116Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2025-03-14T06:46:19.7588026Z Compiling test/cpp/cpp_test_util.cpp; 32s local ... 2025-03-14T06:46:19.9905375Z 2025-03-14T06:46:19.9906261Z  2025-03-14T06:46:19.9906713Z  2025-03-14T06:46:19.9907155Z  2025-03-14T06:46:19.9907568Z  2025-03-14T06:46:19.9907976Z  2025-03-14T06:46:19.9908387Z  2025-03-14T06:46:19.9908795Z  2025-03-14T06:46:19.9909166Z  2025-03-14T06:46:19.9910064Z [20,237 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:19.9910830Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2025-03-14T06:46:19.9911446Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2025-03-14T06:46:19.9912108Z Compiling xla/service/cpu/ir_emitter.cc; 36s local 2025-03-14T06:46:19.9912817Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2025-03-14T06:46:19.9913685Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2025-03-14T06:46:19.9914592Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 34s local 2025-03-14T06:46:20.1909578Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 33s local 2025-03-14T06:46:20.1910591Z Compiling test/cpp/cpp_test_util.cpp; 32s local ... 2025-03-14T06:46:20.1910997Z 2025-03-14T06:46:20.1911413Z  2025-03-14T06:46:20.1911769Z  2025-03-14T06:46:20.1912103Z  2025-03-14T06:46:20.1912425Z  2025-03-14T06:46:20.1912763Z  2025-03-14T06:46:20.1913103Z  2025-03-14T06:46:20.1913439Z  2025-03-14T06:46:20.1913779Z  2025-03-14T06:46:20.1914541Z [20,238 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:20.1915493Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2025-03-14T06:46:20.1916172Z Compiling xla/service/cpu/cpu_compiler.cc; 49s local 2025-03-14T06:46:20.1916929Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2025-03-14T06:46:20.1917786Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2025-03-14T06:46:20.1918679Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 35s local 2025-03-14T06:46:20.1919536Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 34s local 2025-03-14T06:46:20.1920273Z Compiling test/cpp/cpp_test_util.cpp; 32s local 2025-03-14T06:46:20.1920973Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local ... 2025-03-14T06:46:20.3976714Z 2025-03-14T06:46:20.3977536Z  2025-03-14T06:46:20.3977969Z  2025-03-14T06:46:20.3978337Z  2025-03-14T06:46:20.3978938Z  2025-03-14T06:46:20.3979299Z  2025-03-14T06:46:20.3979658Z  2025-03-14T06:46:20.3980033Z  2025-03-14T06:46:20.3980411Z  2025-03-14T06:46:20.3981285Z [20,240 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:20.3982178Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2025-03-14T06:46:20.3982913Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T06:46:20.3983896Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2025-03-14T06:46:20.3984876Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 35s local 2025-03-14T06:46:20.3985858Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 35s local 2025-03-14T06:46:20.3986820Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 34s local 2025-03-14T06:46:20.3987691Z Compiling test/cpp/cpp_test_util.cpp; 32s local 2025-03-14T06:46:20.3988398Z Compiling torch_xla/csrc/ops/view.cpp; 29s local ... 2025-03-14T06:46:20.7913462Z 2025-03-14T06:46:20.7914140Z  2025-03-14T06:46:20.7914512Z  2025-03-14T06:46:20.7914880Z  2025-03-14T06:46:20.7915238Z  2025-03-14T06:46:20.7915606Z  2025-03-14T06:46:20.7915972Z  2025-03-14T06:46:20.7916328Z  2025-03-14T06:46:20.7916689Z  2025-03-14T06:46:20.7917534Z [20,240 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:20.7918440Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2025-03-14T06:46:20.7919171Z Compiling xla/service/cpu/cpu_compiler.cc; 50s local 2025-03-14T06:46:20.7920011Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local 2025-03-14T06:46:20.7920960Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 36s local 2025-03-14T06:46:20.7921973Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 35s local 2025-03-14T06:46:20.7922950Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 34s local 2025-03-14T06:46:20.7923847Z Compiling test/cpp/cpp_test_util.cpp; 33s local 2025-03-14T06:46:20.7924657Z Compiling torch_xla/csrc/ops/view.cpp; 29s local ... 2025-03-14T06:46:21.7921918Z 2025-03-14T06:46:21.7922809Z  2025-03-14T06:46:21.7923279Z  2025-03-14T06:46:21.7923682Z  2025-03-14T06:46:21.7924075Z  2025-03-14T06:46:21.7924452Z  2025-03-14T06:46:21.7924984Z  2025-03-14T06:46:21.7925354Z  2025-03-14T06:46:21.7925723Z  2025-03-14T06:46:21.7926956Z [20,240 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:21.7927974Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2025-03-14T06:46:21.7928730Z Compiling xla/service/cpu/cpu_compiler.cc; 51s local 2025-03-14T06:46:21.7929612Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2025-03-14T06:46:21.7930699Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2025-03-14T06:46:21.7931944Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 36s local 2025-03-14T06:46:21.7933118Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 35s local 2025-03-14T06:46:21.7934029Z Compiling test/cpp/cpp_test_util.cpp; 34s local 2025-03-14T06:46:21.7934783Z Compiling torch_xla/csrc/ops/view.cpp; 30s local ... 2025-03-14T06:46:22.4888875Z 2025-03-14T06:46:22.4889785Z  2025-03-14T06:46:22.4890260Z  2025-03-14T06:46:22.4890660Z  2025-03-14T06:46:22.4891087Z  2025-03-14T06:46:22.4891471Z  2025-03-14T06:46:22.4891888Z  2025-03-14T06:46:22.4892293Z  2025-03-14T06:46:22.4892721Z  2025-03-14T06:46:22.4893645Z [20,241 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:22.4894616Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2025-03-14T06:46:22.4895607Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2025-03-14T06:46:22.4896533Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2025-03-14T06:46:22.4897606Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 37s local 2025-03-14T06:46:22.4898709Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 37s local 2025-03-14T06:46:22.4899804Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 36s local 2025-03-14T06:46:22.4900808Z Compiling test/cpp/cpp_test_util.cpp; 35s local 2025-03-14T06:46:22.4901478Z Compiling torch_xla/csrc/ops/view.cpp; 31s local ... 2025-03-14T06:46:22.7741123Z 2025-03-14T06:46:22.7741976Z  2025-03-14T06:46:22.7742470Z  2025-03-14T06:46:22.7742927Z  2025-03-14T06:46:22.7743406Z  2025-03-14T06:46:22.7743881Z  2025-03-14T06:46:22.7744359Z  2025-03-14T06:46:22.7744882Z  2025-03-14T06:46:22.7745310Z  2025-03-14T06:46:22.7746131Z [20,242 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:22.7747021Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2025-03-14T06:46:22.7747684Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2025-03-14T06:46:22.7748396Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2025-03-14T06:46:22.7749215Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2025-03-14T06:46:22.7750054Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 37s local 2025-03-14T06:46:22.7750887Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 36s local 2025-03-14T06:46:22.7751593Z Compiling test/cpp/cpp_test_util.cpp; 35s local 2025-03-14T06:46:22.7752187Z Compiling test/cpp/cpp_test_util.cpp; 31s local ... 2025-03-14T06:46:22.9930150Z 2025-03-14T06:46:22.9931055Z  2025-03-14T06:46:22.9931542Z  2025-03-14T06:46:22.9931948Z  2025-03-14T06:46:22.9932365Z  2025-03-14T06:46:22.9932803Z  2025-03-14T06:46:22.9933195Z  2025-03-14T06:46:22.9933587Z  2025-03-14T06:46:22.9933986Z  2025-03-14T06:46:22.9934893Z [20,242 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:22.9935943Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2025-03-14T06:46:22.9936724Z Compiling xla/service/cpu/cpu_compiler.cc; 52s local 2025-03-14T06:46:22.9937627Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2025-03-14T06:46:22.9938983Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 38s local 2025-03-14T06:46:22.9940063Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 37s local 2025-03-14T06:46:22.9941128Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 36s local 2025-03-14T06:46:22.9942014Z Compiling test/cpp/cpp_test_util.cpp; 35s local 2025-03-14T06:46:22.9942751Z Compiling test/cpp/cpp_test_util.cpp; 31s local ... 2025-03-14T06:46:24.1938236Z 2025-03-14T06:46:24.1939129Z  2025-03-14T06:46:24.1939901Z  2025-03-14T06:46:24.1940318Z  2025-03-14T06:46:24.1940653Z  2025-03-14T06:46:24.1941003Z  2025-03-14T06:46:24.1941376Z  2025-03-14T06:46:24.1941749Z  2025-03-14T06:46:24.1942101Z  2025-03-14T06:46:24.1943156Z [20,242 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:24.1944240Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T06:46:24.1945073Z Compiling xla/service/cpu/cpu_compiler.cc; 53s local 2025-03-14T06:46:24.1946012Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 39s local 2025-03-14T06:46:24.1947119Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 39s local 2025-03-14T06:46:24.1948117Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2025-03-14T06:46:24.1949067Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2025-03-14T06:46:24.1950099Z Compiling test/cpp/cpp_test_util.cpp; 36s local 2025-03-14T06:46:24.1950770Z Compiling test/cpp/cpp_test_util.cpp; 32s local ... 2025-03-14T06:46:24.7656558Z 2025-03-14T06:46:24.7657418Z  2025-03-14T06:46:24.7657913Z  2025-03-14T06:46:24.7658313Z  2025-03-14T06:46:24.7658710Z  2025-03-14T06:46:24.7659095Z  2025-03-14T06:46:24.7659516Z  2025-03-14T06:46:24.7660218Z  2025-03-14T06:46:24.7660624Z  2025-03-14T06:46:24.7661576Z [20,243 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:24.7662584Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T06:46:24.7663369Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2025-03-14T06:46:24.7664319Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T06:46:24.7665660Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T06:46:24.7666756Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2025-03-14T06:46:24.7667789Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2025-03-14T06:46:24.7668670Z Compiling test/cpp/cpp_test_util.cpp; 37s local 2025-03-14T06:46:24.7669376Z Compiling test/cpp/cpp_test_util.cpp; 33s local ... 2025-03-14T06:46:24.9945156Z 2025-03-14T06:46:24.9946051Z  2025-03-14T06:46:24.9946606Z  2025-03-14T06:46:24.9946985Z  2025-03-14T06:46:24.9947382Z  2025-03-14T06:46:24.9947770Z  2025-03-14T06:46:24.9948150Z  2025-03-14T06:46:24.9948569Z  2025-03-14T06:46:24.9948978Z  2025-03-14T06:46:24.9949888Z [20,243 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:24.9950807Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T06:46:24.9951597Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2025-03-14T06:46:24.9952539Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T06:46:24.9953537Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T06:46:24.9954596Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2025-03-14T06:46:24.9955673Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 38s local 2025-03-14T06:46:24.9956600Z Compiling test/cpp/cpp_test_util.cpp; 37s local 2025-03-14T06:46:24.9957595Z Compiling test/cpp/cpp_test_util.cpp; 33s local ... 2025-03-14T06:46:25.2230233Z 2025-03-14T06:46:25.2231080Z  2025-03-14T06:46:25.2231560Z  2025-03-14T06:46:25.2231972Z  2025-03-14T06:46:25.2232378Z  2025-03-14T06:46:25.2232783Z  2025-03-14T06:46:25.2233191Z  2025-03-14T06:46:25.2233597Z  2025-03-14T06:46:25.2233990Z  2025-03-14T06:46:25.2234987Z [20,244 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:25.2236275Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T06:46:25.2237075Z Compiling xla/service/cpu/cpu_compiler.cc; 54s local 2025-03-14T06:46:25.2237987Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T06:46:25.2239075Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T06:46:25.2240130Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T06:46:25.2241228Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2025-03-14T06:46:25.2242174Z Compiling test/cpp/cpp_test_util.cpp; 37s local 2025-03-14T06:46:25.2242964Z Compiling test/cpp/cpp_test_util.cpp; 33s local ... 2025-03-14T06:46:25.4349083Z 2025-03-14T06:46:25.4349956Z  2025-03-14T06:46:25.4350416Z  2025-03-14T06:46:25.4350797Z  2025-03-14T06:46:25.4351267Z  2025-03-14T06:46:25.4351678Z  2025-03-14T06:46:25.4352392Z  2025-03-14T06:46:25.4352774Z  2025-03-14T06:46:25.4353180Z  2025-03-14T06:46:25.4354161Z [20,247 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:25.4355187Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T06:46:25.4356033Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2025-03-14T06:46:25.4356888Z Compiling torch_xla/csrc/runtime/ifrt_computation_client.cc; 40s local 2025-03-14T06:46:25.4358203Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T06:46:25.4359424Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2025-03-14T06:46:25.4360335Z Compiling test/cpp/cpp_test_util.cpp; 38s local 2025-03-14T06:46:25.4361047Z Compiling test/cpp/cpp_test_util.cpp; 33s local 2025-03-14T06:46:25.4361800Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local ... 2025-03-14T06:46:25.7137654Z 2025-03-14T06:46:25.7138655Z  2025-03-14T06:46:25.7139053Z  2025-03-14T06:46:25.7139387Z  2025-03-14T06:46:25.7139719Z  2025-03-14T06:46:25.7140084Z  2025-03-14T06:46:25.7140403Z  2025-03-14T06:46:25.7140724Z  2025-03-14T06:46:25.7141047Z  2025-03-14T06:46:25.7141920Z [20,248 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:25.7142973Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T06:46:25.7143812Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2025-03-14T06:46:25.7144717Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T06:46:25.7145785Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2025-03-14T06:46:25.7146698Z Compiling test/cpp/cpp_test_util.cpp; 38s local 2025-03-14T06:46:25.7147627Z Compiling test/cpp/cpp_test_util.cpp; 34s local 2025-03-14T06:46:25.7148512Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2025-03-14T06:46:25.7149264Z Compiling torch_xla/csrc/ops/var.cpp; 33s local ... 2025-03-14T06:46:25.9951865Z 2025-03-14T06:46:25.9952748Z  2025-03-14T06:46:25.9953304Z  2025-03-14T06:46:25.9953700Z  2025-03-14T06:46:25.9954127Z  2025-03-14T06:46:25.9954535Z  2025-03-14T06:46:25.9954904Z  2025-03-14T06:46:25.9955273Z  2025-03-14T06:46:25.9955657Z  2025-03-14T06:46:25.9956883Z [20,250 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:25.9957985Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T06:46:25.9958792Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2025-03-14T06:46:25.9959647Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T06:46:25.9960754Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 39s local 2025-03-14T06:46:25.9961670Z Compiling test/cpp/cpp_test_util.cpp; 38s local 2025-03-14T06:46:25.9962417Z Compiling test/cpp/cpp_test_util.cpp; 34s local 2025-03-14T06:46:25.9963431Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2025-03-14T06:46:25.9964265Z Compiling torch_xla/csrc/ops/var.cpp; 33s local ... 2025-03-14T06:46:26.2445290Z 2025-03-14T06:46:26.2446103Z  2025-03-14T06:46:26.2446528Z  2025-03-14T06:46:26.2446901Z  2025-03-14T06:46:26.2447372Z  2025-03-14T06:46:26.2447707Z  2025-03-14T06:46:26.2448072Z  2025-03-14T06:46:26.2448402Z  2025-03-14T06:46:26.2448749Z  2025-03-14T06:46:26.2449724Z [20,251 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:26.2450583Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2025-03-14T06:46:26.2451239Z Compiling xla/service/cpu/cpu_compiler.cc; 55s local 2025-03-14T06:46:26.2452014Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T06:46:26.2453175Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T06:46:26.2453927Z Compiling test/cpp/cpp_test_util.cpp; 38s local 2025-03-14T06:46:26.2454535Z Compiling test/cpp/cpp_test_util.cpp; 34s local 2025-03-14T06:46:26.2455328Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2025-03-14T06:46:26.2456002Z Compiling torch_xla/csrc/ops/var.cpp; 33s local ... 2025-03-14T06:46:26.4806203Z 2025-03-14T06:46:26.4807085Z  2025-03-14T06:46:26.4807946Z  2025-03-14T06:46:26.4808361Z  2025-03-14T06:46:26.4808764Z  2025-03-14T06:46:26.4809174Z  2025-03-14T06:46:26.4809570Z  2025-03-14T06:46:26.4809974Z  2025-03-14T06:46:26.4810364Z  2025-03-14T06:46:26.4811332Z [20,252 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:26.4812313Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2025-03-14T06:46:26.4813046Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T06:46:26.4813979Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T06:46:26.4815028Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T06:46:26.4815939Z Compiling test/cpp/cpp_test_util.cpp; 39s local 2025-03-14T06:46:26.4816605Z Compiling test/cpp/cpp_test_util.cpp; 34s local 2025-03-14T06:46:26.4817315Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2025-03-14T06:46:26.4818061Z Compiling torch_xla/csrc/ops/var.cpp; 34s local ... 2025-03-14T06:46:26.7960453Z 2025-03-14T06:46:26.7961278Z  2025-03-14T06:46:26.7961659Z  2025-03-14T06:46:26.7961972Z  2025-03-14T06:46:26.7962307Z  2025-03-14T06:46:26.7962700Z  2025-03-14T06:46:26.7963127Z  2025-03-14T06:46:26.7963555Z  2025-03-14T06:46:26.7963939Z  2025-03-14T06:46:26.7964901Z [20,252 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:26.7966153Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2025-03-14T06:46:26.7966887Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T06:46:26.7967784Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T06:46:26.7968864Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T06:46:26.7969779Z Compiling test/cpp/cpp_test_util.cpp; 39s local 2025-03-14T06:46:26.7970538Z Compiling test/cpp/cpp_test_util.cpp; 35s local 2025-03-14T06:46:26.7971562Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2025-03-14T06:46:26.7972207Z Compiling torch_xla/csrc/ops/var.cpp; 34s local ... 2025-03-14T06:46:27.0513364Z 2025-03-14T06:46:27.0514239Z  2025-03-14T06:46:27.0514719Z  2025-03-14T06:46:27.0515141Z  2025-03-14T06:46:27.0515499Z  2025-03-14T06:46:27.0515869Z  2025-03-14T06:46:27.0516233Z  2025-03-14T06:46:27.0516668Z  2025-03-14T06:46:27.0517040Z  2025-03-14T06:46:27.0518161Z [20,253 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:27.0519106Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2025-03-14T06:46:27.0519900Z Compiling xla/service/cpu/cpu_compiler.cc; 56s local 2025-03-14T06:46:27.0520913Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T06:46:27.0522135Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 40s local 2025-03-14T06:46:27.0523143Z Compiling test/cpp/cpp_test_util.cpp; 39s local 2025-03-14T06:46:27.0523956Z Compiling test/cpp/cpp_test_util.cpp; 35s local 2025-03-14T06:46:27.0524910Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2025-03-14T06:46:27.0525606Z Compiling torch_xla/csrc/ops/var.cpp; 34s local ... 2025-03-14T06:46:27.3965815Z 2025-03-14T06:46:27.3967186Z  2025-03-14T06:46:27.3967688Z  2025-03-14T06:46:27.3968413Z  2025-03-14T06:46:27.3968798Z  2025-03-14T06:46:27.3969237Z  2025-03-14T06:46:27.3969913Z  2025-03-14T06:46:27.3970307Z  2025-03-14T06:46:27.3970677Z  2025-03-14T06:46:27.3971673Z [20,253 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:27.3972668Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2025-03-14T06:46:27.3973443Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T06:46:27.3974538Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 42s local 2025-03-14T06:46:27.3975527Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T06:46:27.3976405Z Compiling test/cpp/cpp_test_util.cpp; 39s local 2025-03-14T06:46:27.3977154Z Compiling test/cpp/cpp_test_util.cpp; 35s local 2025-03-14T06:46:27.3977895Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T06:46:27.3978644Z Compiling torch_xla/csrc/ops/var.cpp; 35s local ... 2025-03-14T06:46:27.5968742Z 2025-03-14T06:46:27.5969622Z  2025-03-14T06:46:27.5970171Z  2025-03-14T06:46:27.5970615Z  2025-03-14T06:46:27.5971021Z  2025-03-14T06:46:27.5971410Z  2025-03-14T06:46:27.5971810Z  2025-03-14T06:46:27.5972205Z  2025-03-14T06:46:27.5972618Z  2025-03-14T06:46:27.5973593Z [20,256 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:27.5974637Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2025-03-14T06:46:27.5975440Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T06:46:27.5976362Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T06:46:27.5977292Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2025-03-14T06:46:27.5978064Z Compiling test/cpp/cpp_test_util.cpp; 35s local 2025-03-14T06:46:27.5978951Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T06:46:27.5979717Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2025-03-14T06:46:27.5980503Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 30s local ... 2025-03-14T06:46:27.9972504Z 2025-03-14T06:46:27.9973329Z  2025-03-14T06:46:27.9973697Z  2025-03-14T06:46:27.9974015Z  2025-03-14T06:46:27.9974321Z  2025-03-14T06:46:27.9974633Z  2025-03-14T06:46:27.9974941Z  2025-03-14T06:46:27.9975247Z  2025-03-14T06:46:27.9975581Z  2025-03-14T06:46:27.9976689Z [20,256 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:27.9977717Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2025-03-14T06:46:27.9978536Z Compiling xla/service/cpu/cpu_compiler.cc; 57s local 2025-03-14T06:46:27.9979453Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 41s local 2025-03-14T06:46:27.9980403Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2025-03-14T06:46:27.9981185Z Compiling test/cpp/cpp_test_util.cpp; 36s local 2025-03-14T06:46:27.9982145Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T06:46:27.9982937Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2025-03-14T06:46:27.9983711Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 31s local ... 2025-03-14T06:46:28.5286039Z 2025-03-14T06:46:28.5286906Z  2025-03-14T06:46:28.5287400Z  2025-03-14T06:46:28.5287798Z  2025-03-14T06:46:28.5288246Z  2025-03-14T06:46:28.5288650Z  2025-03-14T06:46:28.5289017Z  2025-03-14T06:46:28.5289333Z  2025-03-14T06:46:28.5289636Z  2025-03-14T06:46:28.5290379Z [20,257 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:28.5291376Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2025-03-14T06:46:28.5292215Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2025-03-14T06:46:28.5293176Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 42s local 2025-03-14T06:46:28.5294400Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2025-03-14T06:46:28.5295183Z Compiling test/cpp/cpp_test_util.cpp; 36s local 2025-03-14T06:46:28.5295974Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2025-03-14T06:46:28.5296767Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2025-03-14T06:46:28.5297709Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 30s local ... 2025-03-14T06:46:28.7978663Z 2025-03-14T06:46:28.7979467Z  2025-03-14T06:46:28.7979978Z  2025-03-14T06:46:28.7980527Z  2025-03-14T06:46:28.7980973Z  2025-03-14T06:46:28.7981370Z  2025-03-14T06:46:28.7981799Z  2025-03-14T06:46:28.7982169Z  2025-03-14T06:46:28.7982559Z  2025-03-14T06:46:28.7983475Z [20,257 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:28.7984493Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2025-03-14T06:46:28.7985299Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2025-03-14T06:46:28.7986239Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 42s local 2025-03-14T06:46:28.7987047Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2025-03-14T06:46:28.7987739Z Compiling test/cpp/cpp_test_util.cpp; 37s local 2025-03-14T06:46:28.7988617Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2025-03-14T06:46:28.7989512Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2025-03-14T06:46:28.7990380Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 31s local ... 2025-03-14T06:46:29.3182263Z 2025-03-14T06:46:29.3183059Z  2025-03-14T06:46:29.3183481Z  2025-03-14T06:46:29.3183835Z  2025-03-14T06:46:29.3184188Z  2025-03-14T06:46:29.3184539Z  2025-03-14T06:46:29.3184902Z  2025-03-14T06:46:29.3185262Z  2025-03-14T06:46:29.3185601Z  2025-03-14T06:46:29.3186455Z [20,258 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:29.3187413Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2025-03-14T06:46:29.3188152Z Compiling xla/service/cpu/cpu_compiler.cc; 58s local 2025-03-14T06:46:29.3188938Z Compiling torch_xla/csrc/runtime/pjrt_computation_client.cc; 43s local 2025-03-14T06:46:29.3189729Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2025-03-14T06:46:29.3190384Z Compiling test/cpp/cpp_test_util.cpp; 37s local 2025-03-14T06:46:29.3191317Z Compiling torch_xla/csrc/ops/var_mean.cpp; 37s local 2025-03-14T06:46:29.3191984Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2025-03-14T06:46:29.3192748Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 31s local ... 2025-03-14T06:46:29.5267764Z 2025-03-14T06:46:29.5268618Z  2025-03-14T06:46:29.5269219Z  2025-03-14T06:46:29.5269746Z  2025-03-14T06:46:29.5270264Z  2025-03-14T06:46:29.5270687Z  2025-03-14T06:46:29.5271114Z  2025-03-14T06:46:29.5271468Z  2025-03-14T06:46:29.5271809Z  2025-03-14T06:46:29.5272985Z [20,262 / 20,652] 5 / 17 tests; 48 actions, 45 running; last test: ...til_test 2025-03-14T06:46:29.5273973Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2025-03-14T06:46:29.5274718Z Compiling test/cpp/cpp_test_util.cpp; 42s local 2025-03-14T06:46:29.5275392Z Compiling test/cpp/cpp_test_util.cpp; 37s local 2025-03-14T06:46:29.5276075Z Compiling torch_xla/csrc/ops/var.cpp; 37s local 2025-03-14T06:46:29.5276877Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 31s local 2025-03-14T06:46:29.5277795Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2025-03-14T06:46:29.5278641Z Compiling torch_xla/csrc/ops/update_slice.cpp; 27s local 2025-03-14T06:46:29.5279508Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 27s local ... 2025-03-14T06:46:30.1400036Z 2025-03-14T06:46:30.1400841Z  2025-03-14T06:46:30.1401237Z  2025-03-14T06:46:30.1401933Z  2025-03-14T06:46:30.1402268Z  2025-03-14T06:46:30.1402597Z  2025-03-14T06:46:30.1402935Z  2025-03-14T06:46:30.1403262Z  2025-03-14T06:46:30.1403581Z  2025-03-14T06:46:30.1404351Z [20,263 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:30.1405272Z Compiling xla/service/cpu/cpu_compiler.cc; 59s local 2025-03-14T06:46:30.1405889Z Compiling test/cpp/cpp_test_util.cpp; 42s local 2025-03-14T06:46:30.1406659Z Compiling test/cpp/cpp_test_util.cpp; 38s local 2025-03-14T06:46:30.1407257Z Compiling torch_xla/csrc/ops/var.cpp; 37s local 2025-03-14T06:46:30.1407893Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 29s local 2025-03-14T06:46:30.1408577Z Compiling torch_xla/csrc/ops/update_slice.cpp; 28s local 2025-03-14T06:46:30.1409229Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 27s local 2025-03-14T06:46:30.1409938Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local ... 2025-03-14T06:46:30.5377422Z 2025-03-14T06:46:30.5378267Z  2025-03-14T06:46:30.5378766Z  2025-03-14T06:46:30.5379143Z  2025-03-14T06:46:30.5379499Z  2025-03-14T06:46:30.5379873Z  2025-03-14T06:46:30.5380279Z  2025-03-14T06:46:30.5380656Z  2025-03-14T06:46:30.5381040Z  2025-03-14T06:46:30.5381968Z [20,264 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:30.5382989Z Compiling xla/service/cpu/cpu_compiler.cc; 60s local 2025-03-14T06:46:30.5383646Z Compiling test/cpp/cpp_test_util.cpp; 43s local 2025-03-14T06:46:30.5384212Z Compiling test/cpp/cpp_test_util.cpp; 38s local 2025-03-14T06:46:30.5384949Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 30s local 2025-03-14T06:46:30.5385792Z Compiling torch_xla/csrc/ops/update_slice.cpp; 28s local 2025-03-14T06:46:30.5386580Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 28s local 2025-03-14T06:46:30.5387349Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 24s local 2025-03-14T06:46:30.5388242Z Compiling torch_xla/csrc/ops/unselect.cpp; 24s local ... 2025-03-14T06:46:31.5384678Z 2025-03-14T06:46:31.5385572Z  2025-03-14T06:46:31.5386062Z  2025-03-14T06:46:31.5386497Z  2025-03-14T06:46:31.5386900Z  2025-03-14T06:46:31.5387289Z  2025-03-14T06:46:31.5387670Z  2025-03-14T06:46:31.5388062Z  2025-03-14T06:46:31.5388492Z  2025-03-14T06:46:31.5389739Z [20,264 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:31.5390716Z Compiling xla/service/cpu/cpu_compiler.cc; 61s local 2025-03-14T06:46:31.5391498Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2025-03-14T06:46:31.5392210Z Compiling test/cpp/cpp_test_util.cpp; 39s local 2025-03-14T06:46:31.5393031Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2025-03-14T06:46:31.5393851Z Compiling torch_xla/csrc/ops/update_slice.cpp; 29s local 2025-03-14T06:46:31.5394861Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 29s local 2025-03-14T06:46:31.5395731Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 25s local 2025-03-14T06:46:31.5396609Z Compiling torch_xla/csrc/ops/unselect.cpp; 25s local ... 2025-03-14T06:46:32.1290641Z 2025-03-14T06:46:32.1291539Z  2025-03-14T06:46:32.1292021Z  2025-03-14T06:46:32.1292411Z  2025-03-14T06:46:32.1292819Z  2025-03-14T06:46:32.1293276Z  2025-03-14T06:46:32.1293674Z  2025-03-14T06:46:32.1294087Z  2025-03-14T06:46:32.1294480Z  2025-03-14T06:46:32.1295426Z [20,265 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:32.1296382Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2025-03-14T06:46:32.1297129Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2025-03-14T06:46:32.1297924Z Compiling xla/python/pjrt_ifrt/pjrt_client.cc; 31s local 2025-03-14T06:46:32.1298991Z Compiling torch_xla/csrc/ops/update_slice.cpp; 30s local 2025-03-14T06:46:32.1299977Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 29s local 2025-03-14T06:46:32.1300752Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2025-03-14T06:46:32.1301611Z Compiling torch_xla/csrc/ops/unselect.cpp; 26s local 2025-03-14T06:46:32.1302435Z Compiling xla/python/pjrt_ifrt/pjrt_compiler.cc; 24s local ... 2025-03-14T06:46:32.3390410Z 2025-03-14T06:46:32.3391839Z  2025-03-14T06:46:32.3392292Z  2025-03-14T06:46:32.3392708Z  2025-03-14T06:46:32.3393069Z  2025-03-14T06:46:32.3393446Z  2025-03-14T06:46:32.3393796Z  2025-03-14T06:46:32.3394152Z  2025-03-14T06:46:32.3394518Z  2025-03-14T06:46:32.3395440Z [20,267 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:32.3396312Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2025-03-14T06:46:32.3397012Z Compiling test/cpp/cpp_test_util.cpp; 40s local 2025-03-14T06:46:32.3397693Z Compiling torch_xla/csrc/ops/update_slice.cpp; 30s local 2025-03-14T06:46:32.3398476Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 29s local 2025-03-14T06:46:32.3399297Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 26s local 2025-03-14T06:46:32.3400125Z Compiling torch_xla/csrc/ops/unselect.cpp; 26s local 2025-03-14T06:46:32.3400882Z Compiling torch_xla/csrc/ops/uniform.cpp; 23s local 2025-03-14T06:46:32.3401752Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local ... 2025-03-14T06:46:33.3397456Z 2025-03-14T06:46:33.3398322Z  2025-03-14T06:46:33.3398799Z  2025-03-14T06:46:33.3399229Z  2025-03-14T06:46:33.3399606Z  2025-03-14T06:46:33.3400004Z  2025-03-14T06:46:33.3400417Z  2025-03-14T06:46:33.3400793Z  2025-03-14T06:46:33.3401161Z  2025-03-14T06:46:33.3402020Z [20,268 / 20,652] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2025-03-14T06:46:33.3402888Z Compiling test/cpp/cpp_test_util.cpp; 45s local 2025-03-14T06:46:33.3403578Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2025-03-14T06:46:33.3404284Z Compiling torch_xla/csrc/ops/update_slice.cpp; 31s local 2025-03-14T06:46:33.3405318Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2025-03-14T06:46:33.3406120Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local 2025-03-14T06:46:33.3406862Z Compiling torch_xla/csrc/ops/uniform.cpp; 24s local 2025-03-14T06:46:33.3407899Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 24s local 2025-03-14T06:46:33.3408908Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 24s local ... 2025-03-14T06:46:33.5400646Z 2025-03-14T06:46:33.5401501Z  2025-03-14T06:46:33.5401960Z  2025-03-14T06:46:33.5402371Z  2025-03-14T06:46:33.5402752Z  2025-03-14T06:46:33.5403138Z  2025-03-14T06:46:33.5403531Z  2025-03-14T06:46:33.5403942Z  2025-03-14T06:46:33.5404337Z  2025-03-14T06:46:33.5405704Z [20,268 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:33.5406667Z Compiling test/cpp/cpp_test_util.cpp; 46s local 2025-03-14T06:46:33.5407379Z Compiling test/cpp/cpp_test_util.cpp; 41s local 2025-03-14T06:46:33.5408160Z Compiling torch_xla/csrc/ops/update_slice.cpp; 31s local 2025-03-14T06:46:33.5409016Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 27s local 2025-03-14T06:46:33.5409899Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local 2025-03-14T06:46:33.5410650Z Compiling torch_xla/csrc/ops/uniform.cpp; 25s local 2025-03-14T06:46:33.5411502Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 24s local 2025-03-14T06:46:33.5412445Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 24s local ... 2025-03-14T06:46:34.7409613Z 2025-03-14T06:46:34.7410451Z  2025-03-14T06:46:34.7410878Z  2025-03-14T06:46:34.7411552Z  2025-03-14T06:46:34.7411916Z  2025-03-14T06:46:34.7412282Z  2025-03-14T06:46:34.7412647Z  2025-03-14T06:46:34.7412993Z  2025-03-14T06:46:34.7413354Z  2025-03-14T06:46:34.7414221Z [20,268 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:34.7415094Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2025-03-14T06:46:34.7415740Z Compiling test/cpp/cpp_test_util.cpp; 43s local 2025-03-14T06:46:34.7416622Z Compiling torch_xla/csrc/ops/update_slice.cpp; 33s local 2025-03-14T06:46:34.7417320Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 28s local 2025-03-14T06:46:34.7417998Z Compiling torch_xla/csrc/ops/unselect.cpp; 28s local 2025-03-14T06:46:34.7418604Z Compiling torch_xla/csrc/ops/uniform.cpp; 26s local 2025-03-14T06:46:34.7419265Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 25s local 2025-03-14T06:46:34.7419979Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 25s local ... 2025-03-14T06:46:35.9417227Z 2025-03-14T06:46:35.9418075Z  2025-03-14T06:46:35.9418572Z  2025-03-14T06:46:35.9419141Z  2025-03-14T06:46:35.9419538Z  2025-03-14T06:46:35.9419968Z  2025-03-14T06:46:35.9420352Z  2025-03-14T06:46:35.9420737Z  2025-03-14T06:46:35.9421111Z  2025-03-14T06:46:35.9422006Z [20,268 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:35.9422965Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2025-03-14T06:46:35.9423648Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2025-03-14T06:46:35.9424429Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2025-03-14T06:46:35.9425258Z Compiling xla/python/pjrt_ifrt/pjrt_executable.cc; 30s local 2025-03-14T06:46:35.9426088Z Compiling torch_xla/csrc/ops/unselect.cpp; 30s local 2025-03-14T06:46:35.9426830Z Compiling torch_xla/csrc/ops/uniform.cpp; 27s local 2025-03-14T06:46:35.9427645Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 27s local 2025-03-14T06:46:35.9428590Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 26s local ... 2025-03-14T06:46:36.5239507Z 2025-03-14T06:46:36.5240413Z  2025-03-14T06:46:36.5240902Z  2025-03-14T06:46:36.5241334Z  2025-03-14T06:46:36.5241730Z  2025-03-14T06:46:36.5242121Z  2025-03-14T06:46:36.5242520Z  2025-03-14T06:46:36.5242932Z  2025-03-14T06:46:36.5243392Z  2025-03-14T06:46:36.5244819Z [20,269 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:36.5245917Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2025-03-14T06:46:36.5246694Z Compiling test/cpp/cpp_test_util.cpp; 44s local 2025-03-14T06:46:36.5247500Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2025-03-14T06:46:36.5248309Z Compiling torch_xla/csrc/ops/unselect.cpp; 30s local 2025-03-14T06:46:36.5249095Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2025-03-14T06:46:36.5250093Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 27s local 2025-03-14T06:46:36.5251027Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 27s local 2025-03-14T06:46:36.5251834Z Compiling torch_xla/csrc/ops/topk.cpp; 27s local ... 2025-03-14T06:46:36.7423690Z 2025-03-14T06:46:36.7424484Z  2025-03-14T06:46:36.7424960Z  2025-03-14T06:46:36.7425348Z  2025-03-14T06:46:36.7425746Z  2025-03-14T06:46:36.7426140Z  2025-03-14T06:46:36.7426510Z  2025-03-14T06:46:36.7426892Z  2025-03-14T06:46:36.7427255Z  2025-03-14T06:46:36.7428159Z [20,269 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:36.7429089Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2025-03-14T06:46:36.7429784Z Compiling test/cpp/cpp_test_util.cpp; 45s local 2025-03-14T06:46:36.7430554Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2025-03-14T06:46:36.7431640Z Compiling torch_xla/csrc/ops/unselect.cpp; 30s local 2025-03-14T06:46:36.7432368Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2025-03-14T06:46:36.7433143Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 27s local 2025-03-14T06:46:36.7434042Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 27s local 2025-03-14T06:46:36.7434840Z Compiling torch_xla/csrc/ops/topk.cpp; 27s local ... 2025-03-14T06:46:36.9659813Z 2025-03-14T06:46:36.9660626Z  2025-03-14T06:46:36.9661023Z  2025-03-14T06:46:36.9661368Z  2025-03-14T06:46:36.9661672Z  2025-03-14T06:46:36.9662016Z  2025-03-14T06:46:36.9662333Z  2025-03-14T06:46:36.9662644Z  2025-03-14T06:46:36.9662956Z  2025-03-14T06:46:36.9663704Z [20,270 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:36.9664477Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2025-03-14T06:46:36.9665191Z Compiling test/cpp/cpp_test_util.cpp; 45s local 2025-03-14T06:46:36.9666125Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2025-03-14T06:46:36.9666916Z Compiling torch_xla/csrc/ops/unselect.cpp; 31s local 2025-03-14T06:46:36.9667684Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2025-03-14T06:46:36.9668568Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 28s local 2025-03-14T06:46:36.9669441Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 27s local 2025-03-14T06:46:36.9670245Z Compiling torch_xla/csrc/ops/topk.cpp; 27s local ... 2025-03-14T06:46:37.3427843Z 2025-03-14T06:46:37.3429578Z  2025-03-14T06:46:37.3430098Z  2025-03-14T06:46:37.3430499Z  2025-03-14T06:46:37.3430921Z  2025-03-14T06:46:37.3431320Z  2025-03-14T06:46:37.3431758Z  2025-03-14T06:46:37.3432153Z  2025-03-14T06:46:37.3432530Z  2025-03-14T06:46:37.3433433Z [20,270 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:37.3434411Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2025-03-14T06:46:37.3435113Z Compiling test/cpp/cpp_test_util.cpp; 45s local 2025-03-14T06:46:37.3435927Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2025-03-14T06:46:37.3436716Z Compiling torch_xla/csrc/ops/unselect.cpp; 31s local 2025-03-14T06:46:37.3437491Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2025-03-14T06:46:37.3438290Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 28s local 2025-03-14T06:46:37.3439614Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 28s local 2025-03-14T06:46:37.3440440Z Compiling torch_xla/csrc/ops/topk.cpp; 27s local ... 2025-03-14T06:46:38.5436852Z 2025-03-14T06:46:38.5437995Z  2025-03-14T06:46:38.5438496Z  2025-03-14T06:46:38.5438904Z  2025-03-14T06:46:38.5439302Z  2025-03-14T06:46:38.5439705Z  2025-03-14T06:46:38.5440096Z  2025-03-14T06:46:38.5440517Z  2025-03-14T06:46:38.5440915Z  2025-03-14T06:46:38.5442175Z [20,270 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:38.5443187Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2025-03-14T06:46:38.5443953Z Compiling test/cpp/cpp_test_util.cpp; 46s local 2025-03-14T06:46:38.5445043Z Compiling torch_xla/csrc/ops/update_slice.cpp; 36s local 2025-03-14T06:46:38.5445880Z Compiling torch_xla/csrc/ops/unselect.cpp; 32s local 2025-03-14T06:46:38.5446654Z Compiling torch_xla/csrc/ops/uniform.cpp; 30s local 2025-03-14T06:46:38.5447490Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 29s local 2025-03-14T06:46:38.5448379Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 29s local 2025-03-14T06:46:38.5449217Z Compiling torch_xla/csrc/ops/topk.cpp; 29s local ... 2025-03-14T06:46:38.7440003Z 2025-03-14T06:46:38.7441238Z  2025-03-14T06:46:38.7441909Z  2025-03-14T06:46:38.7442570Z  2025-03-14T06:46:38.7442933Z  2025-03-14T06:46:38.7443286Z  2025-03-14T06:46:38.7443632Z  2025-03-14T06:46:38.7443997Z  2025-03-14T06:46:38.7444368Z  2025-03-14T06:46:38.7445407Z [20,271 / 20,652] 5 / 17 tests; 47 actions running; last test: ...la_util_test 2025-03-14T06:46:38.7446410Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2025-03-14T06:46:38.7447141Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2025-03-14T06:46:38.7448154Z Compiling torch_xla/csrc/ops/unselect.cpp; 32s local 2025-03-14T06:46:38.7448903Z Compiling torch_xla/csrc/ops/uniform.cpp; 30s local 2025-03-14T06:46:38.7449675Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 29s local 2025-03-14T06:46:38.7450484Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 29s local 2025-03-14T06:46:38.7451246Z Compiling torch_xla/csrc/ops/topk.cpp; 29s local 2025-03-14T06:46:38.7452061Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 29s local ... 2025-03-14T06:46:39.1443913Z 2025-03-14T06:46:39.1445368Z  2025-03-14T06:46:39.1445880Z  2025-03-14T06:46:39.1446312Z  2025-03-14T06:46:39.1446708Z  2025-03-14T06:46:39.1447089Z  2025-03-14T06:46:39.1447493Z  2025-03-14T06:46:39.1447893Z  2025-03-14T06:46:39.1448317Z  2025-03-14T06:46:39.1449223Z [20,271 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:39.1450216Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2025-03-14T06:46:39.1450944Z Compiling test/cpp/cpp_test_util.cpp; 47s local 2025-03-14T06:46:39.1451722Z Compiling torch_xla/csrc/ops/unselect.cpp; 33s local 2025-03-14T06:46:39.1462743Z Compiling torch_xla/csrc/ops/uniform.cpp; 30s local 2025-03-14T06:46:39.1463941Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 30s local 2025-03-14T06:46:39.1464917Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 29s local 2025-03-14T06:46:39.1466023Z Compiling torch_xla/csrc/ops/topk.cpp; 29s local 2025-03-14T06:46:39.1466946Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 29s local ... 2025-03-14T06:46:40.1452049Z 2025-03-14T06:46:40.1453354Z  2025-03-14T06:46:40.1453888Z  2025-03-14T06:46:40.1454305Z  2025-03-14T06:46:40.1454704Z  2025-03-14T06:46:40.1455113Z  2025-03-14T06:46:40.1455504Z  2025-03-14T06:46:40.1455897Z  2025-03-14T06:46:40.1456303Z  2025-03-14T06:46:40.1457597Z [20,271 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:40.1458580Z Compiling test/cpp/cpp_test_util.cpp; 52s local 2025-03-14T06:46:40.1459249Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2025-03-14T06:46:40.1459847Z Compiling torch_xla/csrc/ops/unselect.cpp; 34s local 2025-03-14T06:46:40.1460447Z Compiling torch_xla/csrc/ops/uniform.cpp; 31s local 2025-03-14T06:46:40.1461084Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 31s local 2025-03-14T06:46:40.1461887Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 30s local 2025-03-14T06:46:40.1462765Z Compiling torch_xla/csrc/ops/topk.cpp; 30s local 2025-03-14T06:46:40.1463512Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 30s local ... 2025-03-14T06:46:40.5433712Z 2025-03-14T06:46:40.5434650Z  2025-03-14T06:46:40.5435082Z  2025-03-14T06:46:40.5435501Z  2025-03-14T06:46:40.5435817Z  2025-03-14T06:46:40.5436159Z  2025-03-14T06:46:40.5436451Z  2025-03-14T06:46:40.5436788Z  2025-03-14T06:46:40.5437112Z  2025-03-14T06:46:40.5437886Z [20,272 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:40.5438779Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2025-03-14T06:46:40.5439378Z Compiling test/cpp/cpp_test_util.cpp; 48s local 2025-03-14T06:46:40.5440003Z Compiling torch_xla/csrc/ops/unselect.cpp; 34s local 2025-03-14T06:46:40.5441057Z Compiling torch_xla/csrc/ops/uniform.cpp; 32s local 2025-03-14T06:46:40.5441800Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 31s local 2025-03-14T06:46:40.5442518Z Compiling torch_xla/csrc/ops/topk.cpp; 31s local 2025-03-14T06:46:40.5443334Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 30s local 2025-03-14T06:46:40.5444081Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local ... 2025-03-14T06:46:40.7456645Z 2025-03-14T06:46:40.7457721Z  2025-03-14T06:46:40.7458203Z  2025-03-14T06:46:40.7458634Z  2025-03-14T06:46:40.7459061Z  2025-03-14T06:46:40.7459484Z  2025-03-14T06:46:40.7459891Z  2025-03-14T06:46:40.7460289Z  2025-03-14T06:46:40.7460680Z  2025-03-14T06:46:40.7461611Z [20,274 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:40.7462602Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2025-03-14T06:46:40.7463356Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2025-03-14T06:46:40.7464154Z Compiling torch_xla/csrc/ops/uniform.cpp; 32s local 2025-03-14T06:46:40.7465016Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 31s local 2025-03-14T06:46:40.7466164Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 31s local 2025-03-14T06:46:40.7467069Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2025-03-14T06:46:40.7467878Z Compiling torch_xla/csrc/ops/symeig.cpp; 28s local 2025-03-14T06:46:40.7468662Z Compiling torch_xla/csrc/ops/svd.cpp; 27s local ... 2025-03-14T06:46:40.9460091Z 2025-03-14T06:46:40.9461391Z  2025-03-14T06:46:40.9461938Z  2025-03-14T06:46:40.9462358Z  2025-03-14T06:46:40.9462757Z  2025-03-14T06:46:40.9463156Z  2025-03-14T06:46:40.9463543Z  2025-03-14T06:46:40.9463951Z  2025-03-14T06:46:40.9464337Z  2025-03-14T06:46:40.9465273Z [20,276 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:40.9466536Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2025-03-14T06:46:40.9467261Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2025-03-14T06:46:40.9468110Z Compiling torch_xla/csrc/ops/uniform.cpp; 32s local 2025-03-14T06:46:40.9469069Z Compiling torch_xla/csrc/ops/threshold.cpp; 30s local 2025-03-14T06:46:40.9469823Z Compiling torch_xla/csrc/ops/symeig.cpp; 28s local 2025-03-14T06:46:40.9470545Z Compiling torch_xla/csrc/ops/svd.cpp; 27s local 2025-03-14T06:46:40.9471566Z Compiling torch_xla/csrc/ops/sum.cpp; 25s local 2025-03-14T06:46:40.9472351Z Compiling torch_xla/csrc/ops/std_mean.cpp; 25s local ... 2025-03-14T06:46:41.3463193Z 2025-03-14T06:46:41.3464525Z  2025-03-14T06:46:41.3465030Z  2025-03-14T06:46:41.3465639Z  2025-03-14T06:46:41.3466053Z  2025-03-14T06:46:41.3466430Z  2025-03-14T06:46:41.3466817Z  2025-03-14T06:46:41.3467211Z  2025-03-14T06:46:41.3467615Z  2025-03-14T06:46:41.3468891Z [20,276 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:41.3469910Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2025-03-14T06:46:41.3470671Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2025-03-14T06:46:41.3471453Z Compiling torch_xla/csrc/ops/uniform.cpp; 32s local 2025-03-14T06:46:41.3472266Z Compiling torch_xla/csrc/ops/threshold.cpp; 31s local 2025-03-14T06:46:41.3473056Z Compiling torch_xla/csrc/ops/symeig.cpp; 29s local 2025-03-14T06:46:41.3473821Z Compiling torch_xla/csrc/ops/svd.cpp; 28s local 2025-03-14T06:46:41.3474589Z Compiling torch_xla/csrc/ops/sum.cpp; 26s local 2025-03-14T06:46:41.3475418Z Compiling torch_xla/csrc/ops/std_mean.cpp; 26s local ... 2025-03-14T06:46:41.6438365Z 2025-03-14T06:46:41.6439617Z  2025-03-14T06:46:41.6440153Z  2025-03-14T06:46:41.6440530Z  2025-03-14T06:46:41.6440924Z  2025-03-14T06:46:41.6441321Z  2025-03-14T06:46:41.6441988Z  2025-03-14T06:46:41.6442398Z  2025-03-14T06:46:41.6442784Z  2025-03-14T06:46:41.6443744Z [20,277 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:41.6444908Z Compiling test/cpp/cpp_test_util.cpp; 54s local 2025-03-14T06:46:41.6445680Z Compiling test/cpp/cpp_test_util.cpp; 49s local 2025-03-14T06:46:41.6446476Z Compiling torch_xla/csrc/ops/uniform.cpp; 33s local 2025-03-14T06:46:41.6447450Z Compiling torch_xla/csrc/ops/symeig.cpp; 29s local 2025-03-14T06:46:41.6448218Z Compiling torch_xla/csrc/ops/svd.cpp; 28s local 2025-03-14T06:46:41.6448981Z Compiling torch_xla/csrc/ops/sum.cpp; 26s local 2025-03-14T06:46:41.6449757Z Compiling torch_xla/csrc/ops/std_mean.cpp; 26s local 2025-03-14T06:46:41.6450573Z Compiling torch_xla/csrc/ops/std.cpp; 26s local ... 2025-03-14T06:46:41.9468781Z 2025-03-14T06:46:41.9470096Z  2025-03-14T06:46:41.9470527Z  2025-03-14T06:46:41.9470891Z  2025-03-14T06:46:41.9471190Z  2025-03-14T06:46:41.9471505Z  2025-03-14T06:46:41.9471906Z  2025-03-14T06:46:41.9472235Z  2025-03-14T06:46:41.9472715Z  2025-03-14T06:46:41.9473546Z [20,277 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:41.9474335Z Compiling test/cpp/cpp_test_util.cpp; 54s local 2025-03-14T06:46:41.9474918Z Compiling test/cpp/cpp_test_util.cpp; 50s local 2025-03-14T06:46:41.9475564Z Compiling torch_xla/csrc/ops/uniform.cpp; 33s local 2025-03-14T06:46:41.9476314Z Compiling torch_xla/csrc/ops/symeig.cpp; 29s local 2025-03-14T06:46:41.9476983Z Compiling torch_xla/csrc/ops/svd.cpp; 28s local 2025-03-14T06:46:41.9477595Z Compiling torch_xla/csrc/ops/sum.cpp; 26s local 2025-03-14T06:46:41.9478287Z Compiling torch_xla/csrc/ops/std_mean.cpp; 26s local 2025-03-14T06:46:41.9479062Z Compiling torch_xla/csrc/ops/std.cpp; 26s local ... 2025-03-14T06:46:43.1476605Z 2025-03-14T06:46:43.1477419Z  2025-03-14T06:46:43.1477847Z  2025-03-14T06:46:43.1478241Z  2025-03-14T06:46:43.1478614Z  2025-03-14T06:46:43.1478959Z  2025-03-14T06:46:43.1479311Z  2025-03-14T06:46:43.1479669Z  2025-03-14T06:46:43.1480017Z  2025-03-14T06:46:43.1480856Z [20,277 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:43.1481736Z Compiling test/cpp/cpp_test_util.cpp; 55s local 2025-03-14T06:46:43.1482693Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2025-03-14T06:46:43.1483362Z Compiling torch_xla/csrc/ops/uniform.cpp; 34s local 2025-03-14T06:46:43.1484101Z Compiling torch_xla/csrc/ops/symeig.cpp; 31s local 2025-03-14T06:46:43.1484918Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2025-03-14T06:46:43.1485696Z Compiling torch_xla/csrc/ops/sum.cpp; 27s local 2025-03-14T06:46:43.1486384Z Compiling torch_xla/csrc/ops/std_mean.cpp; 27s local 2025-03-14T06:46:43.1487110Z Compiling torch_xla/csrc/ops/std.cpp; 27s local ... 2025-03-14T06:46:43.5159316Z 2025-03-14T06:46:43.5160475Z  2025-03-14T06:46:43.5160990Z  2025-03-14T06:46:43.5161370Z  2025-03-14T06:46:43.5161724Z  2025-03-14T06:46:43.5162061Z  2025-03-14T06:46:43.5162404Z  2025-03-14T06:46:43.5162793Z  2025-03-14T06:46:43.5163180Z  2025-03-14T06:46:43.5164051Z [20,278 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:43.5165060Z Compiling test/cpp/cpp_test_util.cpp; 51s local 2025-03-14T06:46:43.5165947Z Compiling torch_xla/csrc/ops/uniform.cpp; 34s local 2025-03-14T06:46:43.5166639Z Compiling torch_xla/csrc/ops/symeig.cpp; 31s local 2025-03-14T06:46:43.5167359Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2025-03-14T06:46:43.5168001Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local 2025-03-14T06:46:43.5168643Z Compiling torch_xla/csrc/ops/std_mean.cpp; 28s local 2025-03-14T06:46:43.5169611Z Compiling torch_xla/csrc/ops/std.cpp; 28s local 2025-03-14T06:46:43.5170275Z Compiling torch_xla/csrc/ops/stack.cpp; 27s local ... 2025-03-14T06:46:43.7481069Z 2025-03-14T06:46:43.7482276Z  2025-03-14T06:46:43.7482746Z  2025-03-14T06:46:43.7483100Z  2025-03-14T06:46:43.7483458Z  2025-03-14T06:46:43.7483855Z  2025-03-14T06:46:43.7484209Z  2025-03-14T06:46:43.7484706Z  2025-03-14T06:46:43.7485383Z  2025-03-14T06:46:43.7486279Z [20,281 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:43.7487169Z Compiling test/cpp/cpp_test_util.cpp; 52s local 2025-03-14T06:46:43.7487880Z Compiling torch_xla/csrc/ops/uniform.cpp; 35s local 2025-03-14T06:46:43.7488553Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2025-03-14T06:46:43.7489211Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local 2025-03-14T06:46:43.7489904Z Compiling torch_xla/csrc/ops/std_mean.cpp; 28s local 2025-03-14T06:46:43.7490605Z Compiling torch_xla/csrc/ops/std.cpp; 28s local 2025-03-14T06:46:43.7491280Z Compiling torch_xla/csrc/ops/stack.cpp; 27s local 2025-03-14T06:46:43.7491988Z Compiling torch_xla/csrc/ops/squeeze.cpp; 26s local ... 2025-03-14T06:46:44.8495475Z 2025-03-14T06:46:44.8496267Z  2025-03-14T06:46:44.8496652Z  2025-03-14T06:46:44.8496960Z  2025-03-14T06:46:44.8497270Z  2025-03-14T06:46:44.8497612Z  2025-03-14T06:46:44.8497914Z  2025-03-14T06:46:44.8498229Z  2025-03-14T06:46:44.8498535Z  2025-03-14T06:46:44.8499268Z [20,282 / 20,652] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:44.8500004Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2025-03-14T06:46:44.8500579Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2025-03-14T06:46:44.8501154Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2025-03-14T06:46:44.8501728Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2025-03-14T06:46:44.8502307Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2025-03-14T06:46:44.8502865Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local 2025-03-14T06:46:44.8503457Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2025-03-14T06:46:44.8504052Z Compiling torch_xla/csrc/ops/split.cpp; 26s local ... 2025-03-14T06:46:45.1489362Z 2025-03-14T06:46:45.1490765Z  2025-03-14T06:46:45.1491315Z  2025-03-14T06:46:45.1491719Z  2025-03-14T06:46:45.1492352Z  2025-03-14T06:46:45.1492768Z  2025-03-14T06:46:45.1493139Z  2025-03-14T06:46:45.1493551Z  2025-03-14T06:46:45.1493947Z  2025-03-14T06:46:45.1494889Z [20,282 / 20,652] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:45.1495833Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2025-03-14T06:46:45.1496572Z Compiling torch_xla/csrc/ops/uniform.cpp; 36s local 2025-03-14T06:46:45.1497278Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2025-03-14T06:46:45.1498279Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2025-03-14T06:46:45.1499007Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2025-03-14T06:46:45.1499752Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2025-03-14T06:46:45.1500489Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2025-03-14T06:46:45.1501286Z Compiling torch_xla/csrc/ops/split.cpp; 26s local ... 2025-03-14T06:46:45.4855447Z 2025-03-14T06:46:45.4856330Z  2025-03-14T06:46:45.4856812Z  2025-03-14T06:46:45.4857216Z  2025-03-14T06:46:45.4857659Z  2025-03-14T06:46:45.4858062Z  2025-03-14T06:46:45.4858465Z  2025-03-14T06:46:45.4858873Z  2025-03-14T06:46:45.4859265Z  2025-03-14T06:46:45.4860184Z [20,284 / 20,653] 5 / 17 tests; 48 actions, 47 running; last test: ...til_test 2025-03-14T06:46:45.4861478Z Compiling test/cpp/cpp_test_util.cpp; 53s local 2025-03-14T06:46:45.4862230Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2025-03-14T06:46:45.4862957Z Compiling torch_xla/csrc/ops/std_mean.cpp; 30s local 2025-03-14T06:46:45.4863714Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2025-03-14T06:46:45.4864619Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2025-03-14T06:46:45.4865678Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2025-03-14T06:46:45.4866704Z Compiling torch_xla/csrc/ops/split.cpp; 27s local 2025-03-14T06:46:45.4867586Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 26s local ... 2025-03-14T06:46:45.7494217Z 2025-03-14T06:46:45.7495591Z  2025-03-14T06:46:45.7496002Z  2025-03-14T06:46:45.7496293Z  2025-03-14T06:46:45.7496603Z  2025-03-14T06:46:45.7496914Z  2025-03-14T06:46:45.7497218Z  2025-03-14T06:46:45.7497529Z  2025-03-14T06:46:45.7497832Z  2025-03-14T06:46:45.7498615Z [20,284 / 20,653] 5 / 17 tests; 48 actions running; last test: ...la_util_test 2025-03-14T06:46:45.7499407Z Compiling test/cpp/cpp_test_util.cpp; 54s local 2025-03-14T06:46:45.7500020Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2025-03-14T06:46:45.7500720Z Compiling torch_xla/csrc/ops/std_mean.cpp; 30s local 2025-03-14T06:46:45.7501440Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2025-03-14T06:46:45.7502046Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2025-03-14T06:46:45.7502647Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2025-03-14T06:46:45.7503209Z Compiling torch_xla/csrc/ops/split.cpp; 27s local 2025-03-14T06:46:45.7503849Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 27s local ... 2025-03-14T06:46:46.1276749Z 2025-03-14T06:46:46.1277942Z  2025-03-14T06:46:46.1278434Z  2025-03-14T06:46:46.1280080Z  2025-03-14T06:46:46.1281189Z  2025-03-14T06:46:46.1282423Z  2025-03-14T06:46:46.1283732Z  2025-03-14T06:46:46.1285342Z  2025-03-14T06:46:46.1286603Z  2025-03-14T06:46:46.1288555Z [20,284 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:46.1289556Z Compiling test/cpp/cpp_test_util.cpp; 54s local 2025-03-14T06:46:46.1290338Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2025-03-14T06:46:46.1291137Z Compiling torch_xla/csrc/ops/std_mean.cpp; 30s local 2025-03-14T06:46:46.1291992Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2025-03-14T06:46:46.1293022Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2025-03-14T06:46:46.1293752Z Compiling torch_xla/csrc/ops/squeeze.cpp; 29s local 2025-03-14T06:46:46.1294711Z Compiling torch_xla/csrc/ops/split.cpp; 27s local 2025-03-14T06:46:46.1295534Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 27s local ... 2025-03-14T06:46:46.3499199Z 2025-03-14T06:46:46.3501351Z  2025-03-14T06:46:46.3502455Z  2025-03-14T06:46:46.3503352Z  2025-03-14T06:46:46.3504541Z  2025-03-14T06:46:46.3505880Z  2025-03-14T06:46:46.3507583Z  2025-03-14T06:46:46.3508556Z  2025-03-14T06:46:46.3509778Z  2025-03-14T06:46:46.3511612Z [20,285 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:46.3512591Z Compiling test/cpp/cpp_test_util.cpp; 54s local 2025-03-14T06:46:46.3513294Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2025-03-14T06:46:46.3514002Z Compiling torch_xla/csrc/ops/std_mean.cpp; 31s local 2025-03-14T06:46:46.3514679Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2025-03-14T06:46:46.3515389Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2025-03-14T06:46:46.3516259Z Compiling torch_xla/csrc/ops/squeeze.cpp; 29s local 2025-03-14T06:46:46.3516991Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2025-03-14T06:46:46.3517777Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 27s local ... 2025-03-14T06:46:46.8748263Z 2025-03-14T06:46:46.8749732Z  2025-03-14T06:46:46.8750220Z  2025-03-14T06:46:46.8751653Z  2025-03-14T06:46:46.8752688Z  2025-03-14T06:46:46.8753850Z  2025-03-14T06:46:46.8755418Z  2025-03-14T06:46:46.8756758Z  2025-03-14T06:46:46.8757916Z  2025-03-14T06:46:46.8759489Z [20,286 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:46.8760753Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2025-03-14T06:46:46.8761564Z Compiling torch_xla/csrc/ops/std_mean.cpp; 31s local 2025-03-14T06:46:46.8762312Z Compiling torch_xla/csrc/ops/std.cpp; 31s local 2025-03-14T06:46:46.8763015Z Compiling torch_xla/csrc/ops/stack.cpp; 30s local 2025-03-14T06:46:46.8763779Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2025-03-14T06:46:46.8764459Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2025-03-14T06:46:46.8765533Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local 2025-03-14T06:46:46.8766419Z Compiling torch_xla/csrc/ops/softmax.cpp; 27s local ... 2025-03-14T06:46:47.1505386Z 2025-03-14T06:46:47.1506734Z  2025-03-14T06:46:47.1507127Z  2025-03-14T06:46:47.1508707Z  2025-03-14T06:46:47.1509578Z  2025-03-14T06:46:47.1510824Z  2025-03-14T06:46:47.1511955Z  2025-03-14T06:46:47.1512588Z  2025-03-14T06:46:47.1513447Z  2025-03-14T06:46:47.1515305Z [20,288 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:47.1516319Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2025-03-14T06:46:47.1517072Z Compiling torch_xla/csrc/ops/std.cpp; 31s local 2025-03-14T06:46:47.1517834Z Compiling torch_xla/csrc/ops/stack.cpp; 31s local 2025-03-14T06:46:47.1518783Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2025-03-14T06:46:47.1519569Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2025-03-14T06:46:47.1520451Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local 2025-03-14T06:46:47.1521276Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2025-03-14T06:46:47.1522181Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local ... 2025-03-14T06:46:47.5218511Z 2025-03-14T06:46:47.5220026Z  2025-03-14T06:46:47.5220570Z  2025-03-14T06:46:47.5220959Z  2025-03-14T06:46:47.5221332Z  2025-03-14T06:46:47.5221723Z  2025-03-14T06:46:47.5222129Z  2025-03-14T06:46:47.5222498Z  2025-03-14T06:46:47.5222862Z  2025-03-14T06:46:47.5224027Z [20,289 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:47.5224991Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2025-03-14T06:46:47.5225741Z Compiling torch_xla/csrc/ops/stack.cpp; 31s local 2025-03-14T06:46:47.5226452Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2025-03-14T06:46:47.5227179Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2025-03-14T06:46:47.5228214Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local 2025-03-14T06:46:47.5229033Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2025-03-14T06:46:47.5229900Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local 2025-03-14T06:46:47.5230795Z Compiling torch_xla/csrc/ops/send.cpp; 27s local ... 2025-03-14T06:46:47.7510544Z 2025-03-14T06:46:47.7512039Z  2025-03-14T06:46:47.7512474Z  2025-03-14T06:46:47.7513998Z  2025-03-14T06:46:47.7514854Z  2025-03-14T06:46:47.7516125Z  2025-03-14T06:46:47.7517214Z  2025-03-14T06:46:47.7518454Z  2025-03-14T06:46:47.7519717Z  2025-03-14T06:46:47.7521726Z [20,289 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:47.7522801Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2025-03-14T06:46:47.7523558Z Compiling torch_xla/csrc/ops/stack.cpp; 31s local 2025-03-14T06:46:47.7524668Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2025-03-14T06:46:47.7525432Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2025-03-14T06:46:47.7526295Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local 2025-03-14T06:46:47.7527156Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2025-03-14T06:46:47.7528024Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local 2025-03-14T06:46:47.7528936Z Compiling torch_xla/csrc/ops/send.cpp; 27s local ... 2025-03-14T06:46:48.1514892Z 2025-03-14T06:46:48.1516327Z  2025-03-14T06:46:48.1516725Z  2025-03-14T06:46:48.1518303Z  2025-03-14T06:46:48.1519172Z  2025-03-14T06:46:48.1520398Z  2025-03-14T06:46:48.1521666Z  2025-03-14T06:46:48.1523054Z  2025-03-14T06:46:48.1524090Z  2025-03-14T06:46:48.1525410Z [20,290 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:48.1527517Z Compiling torch_xla/csrc/ops/sum.cpp; 32s local 2025-03-14T06:46:48.1529331Z Compiling torch_xla/csrc/ops/squeeze.cpp; 31s local 2025-03-14T06:46:48.1531087Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2025-03-14T06:46:48.1533081Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local 2025-03-14T06:46:48.1534944Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2025-03-14T06:46:48.1536768Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2025-03-14T06:46:48.1538674Z Compiling torch_xla/csrc/ops/send.cpp; 27s local 2025-03-14T06:46:48.1540494Z Compiling torch_xla/csrc/ops/select.cpp; 27s local ... 2025-03-14T06:46:48.5319572Z 2025-03-14T06:46:48.5322444Z  2025-03-14T06:46:48.5323006Z  2025-03-14T06:46:48.5323440Z  2025-03-14T06:46:48.5323785Z  2025-03-14T06:46:48.5324165Z  2025-03-14T06:46:48.5326106Z  2025-03-14T06:46:48.5326606Z  2025-03-14T06:46:48.5328265Z  2025-03-14T06:46:48.5329383Z [20,291 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:48.5330364Z Compiling torch_xla/csrc/ops/sum.cpp; 33s local 2025-03-14T06:46:48.5331098Z Compiling torch_xla/csrc/ops/split.cpp; 30s local 2025-03-14T06:46:48.5331904Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local 2025-03-14T06:46:48.5332771Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2025-03-14T06:46:48.5333626Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2025-03-14T06:46:48.5334725Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2025-03-14T06:46:48.5335453Z Compiling torch_xla/csrc/ops/select.cpp; 28s local 2025-03-14T06:46:48.5336257Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 28s local ... 2025-03-14T06:46:48.7521040Z 2025-03-14T06:46:48.7521987Z  2025-03-14T06:46:48.7522441Z  2025-03-14T06:46:48.7524413Z  2025-03-14T06:46:48.7524952Z  2025-03-14T06:46:48.7526675Z  2025-03-14T06:46:48.7527101Z  2025-03-14T06:46:48.7528717Z  2025-03-14T06:46:48.7529122Z  2025-03-14T06:46:48.7531634Z [20,291 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:48.7532769Z Compiling torch_xla/csrc/ops/sum.cpp; 33s local 2025-03-14T06:46:48.7533457Z Compiling torch_xla/csrc/ops/split.cpp; 30s local 2025-03-14T06:46:48.7534275Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 30s local 2025-03-14T06:46:48.7535117Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2025-03-14T06:46:48.7535931Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2025-03-14T06:46:48.7536711Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2025-03-14T06:46:48.7537372Z Compiling torch_xla/csrc/ops/select.cpp; 28s local 2025-03-14T06:46:48.7538165Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 28s local ... 2025-03-14T06:46:49.9529653Z 2025-03-14T06:46:49.9530592Z  2025-03-14T06:46:49.9531517Z  2025-03-14T06:46:49.9531928Z  2025-03-14T06:46:49.9532339Z  2025-03-14T06:46:49.9532733Z  2025-03-14T06:46:49.9533121Z  2025-03-14T06:46:49.9533565Z  2025-03-14T06:46:49.9534019Z  2025-03-14T06:46:49.9534923Z [20,291 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:49.9535898Z Compiling torch_xla/csrc/ops/sum.cpp; 34s local 2025-03-14T06:46:49.9536851Z Compiling torch_xla/csrc/ops/split.cpp; 31s local 2025-03-14T06:46:49.9537690Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 31s local 2025-03-14T06:46:49.9538551Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2025-03-14T06:46:49.9539420Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2025-03-14T06:46:49.9540282Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2025-03-14T06:46:49.9541051Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2025-03-14T06:46:49.9541918Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local ... 2025-03-14T06:46:50.2566281Z 2025-03-14T06:46:50.2567143Z  2025-03-14T06:46:50.2567612Z  2025-03-14T06:46:50.2567984Z  2025-03-14T06:46:50.2568391Z  2025-03-14T06:46:50.2568780Z  2025-03-14T06:46:50.2569262Z  2025-03-14T06:46:50.2569626Z  2025-03-14T06:46:50.2570013Z  2025-03-14T06:46:50.2570911Z [20,292 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:50.2571852Z Compiling torch_xla/csrc/ops/sum.cpp; 35s local 2025-03-14T06:46:50.2572647Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 31s local 2025-03-14T06:46:50.2573628Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2025-03-14T06:46:50.2574438Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2025-03-14T06:46:50.2575184Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2025-03-14T06:46:50.2575939Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2025-03-14T06:46:50.2576743Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2025-03-14T06:46:50.2577604Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 27s local ... 2025-03-14T06:46:50.5533808Z 2025-03-14T06:46:50.5534697Z  2025-03-14T06:46:50.5535178Z  2025-03-14T06:46:50.5535594Z  2025-03-14T06:46:50.5536015Z  2025-03-14T06:46:50.5536411Z  2025-03-14T06:46:50.5536805Z  2025-03-14T06:46:50.5537232Z  2025-03-14T06:46:50.5537634Z  2025-03-14T06:46:50.5538873Z [20,292 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:50.5539886Z Compiling torch_xla/csrc/ops/sum.cpp; 35s local 2025-03-14T06:46:50.5540714Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 31s local 2025-03-14T06:46:50.5541513Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2025-03-14T06:46:50.5542352Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2025-03-14T06:46:50.5543203Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2025-03-14T06:46:50.5544181Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2025-03-14T06:46:50.5545013Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2025-03-14T06:46:50.5545912Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 27s local ... 2025-03-14T06:46:50.8278919Z 2025-03-14T06:46:50.8279792Z  2025-03-14T06:46:50.8280287Z  2025-03-14T06:46:50.8280719Z  2025-03-14T06:46:50.8281089Z  2025-03-14T06:46:50.8281485Z  2025-03-14T06:46:50.8281916Z  2025-03-14T06:46:50.8282312Z  2025-03-14T06:46:50.8282704Z  2025-03-14T06:46:50.8283605Z [20,293 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:50.8284736Z Compiling torch_xla/csrc/ops/sum.cpp; 35s local 2025-03-14T06:46:50.8285481Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2025-03-14T06:46:50.8286589Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2025-03-14T06:46:50.8287412Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2025-03-14T06:46:50.8288099Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2025-03-14T06:46:50.8288717Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2025-03-14T06:46:50.8289389Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local 2025-03-14T06:46:50.8290019Z Compiling torch_xla/csrc/ops/scatter.cpp; 27s local ... 2025-03-14T06:46:51.1538847Z 2025-03-14T06:46:51.1539710Z  2025-03-14T06:46:51.1540183Z  2025-03-14T06:46:51.1540580Z  2025-03-14T06:46:51.1540987Z  2025-03-14T06:46:51.1541350Z  2025-03-14T06:46:51.1541703Z  2025-03-14T06:46:51.1542071Z  2025-03-14T06:46:51.1542420Z  2025-03-14T06:46:51.1543274Z [20,293 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:51.1544186Z Compiling torch_xla/csrc/ops/sum.cpp; 35s local 2025-03-14T06:46:51.1544888Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2025-03-14T06:46:51.1545654Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 31s local 2025-03-14T06:46:51.1546520Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2025-03-14T06:46:51.1547233Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2025-03-14T06:46:51.1547979Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2025-03-14T06:46:51.1548837Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local 2025-03-14T06:46:51.1549610Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local ... 2025-03-14T06:46:51.5257272Z 2025-03-14T06:46:51.5258123Z  2025-03-14T06:46:51.5258633Z  2025-03-14T06:46:51.5259092Z  2025-03-14T06:46:51.5259501Z  2025-03-14T06:46:51.5259913Z  2025-03-14T06:46:51.5260306Z  2025-03-14T06:46:51.5260713Z  2025-03-14T06:46:51.5261107Z  2025-03-14T06:46:51.5261964Z [20,294 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:51.5262915Z Compiling torch_xla/csrc/ops/sum.cpp; 36s local 2025-03-14T06:46:51.5263715Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2025-03-14T06:46:51.5264456Z Compiling torch_xla/csrc/ops/send.cpp; 31s local 2025-03-14T06:46:51.5265180Z Compiling torch_xla/csrc/ops/select.cpp; 31s local 2025-03-14T06:46:51.5266231Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 31s local 2025-03-14T06:46:51.5267433Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local 2025-03-14T06:46:51.5268185Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local 2025-03-14T06:46:51.5268947Z Compiling torch_xla/csrc/ops/scalar.cpp; 26s local ... 2025-03-14T06:46:51.7544447Z 2025-03-14T06:46:51.7545309Z  2025-03-14T06:46:51.7545822Z  2025-03-14T06:46:51.7546216Z  2025-03-14T06:46:51.7546596Z  2025-03-14T06:46:51.7546954Z  2025-03-14T06:46:51.7547340Z  2025-03-14T06:46:51.7547720Z  2025-03-14T06:46:51.7548080Z  2025-03-14T06:46:51.7549238Z [20,294 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:51.7550232Z Compiling torch_xla/csrc/ops/sum.cpp; 36s local 2025-03-14T06:46:51.7550865Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2025-03-14T06:46:51.7551563Z Compiling torch_xla/csrc/ops/send.cpp; 31s local 2025-03-14T06:46:51.7552291Z Compiling torch_xla/csrc/ops/select.cpp; 31s local 2025-03-14T06:46:51.7553029Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 31s local 2025-03-14T06:46:51.7553820Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2025-03-14T06:46:51.7554588Z Compiling torch_xla/csrc/ops/scatter.cpp; 28s local 2025-03-14T06:46:51.7555358Z Compiling torch_xla/csrc/ops/scalar.cpp; 26s local ... 2025-03-14T06:46:51.9692802Z 2025-03-14T06:46:51.9693697Z  2025-03-14T06:46:51.9694277Z  2025-03-14T06:46:51.9694978Z  2025-03-14T06:46:51.9695383Z  2025-03-14T06:46:51.9695753Z  2025-03-14T06:46:51.9696097Z  2025-03-14T06:46:51.9696411Z  2025-03-14T06:46:51.9696774Z  2025-03-14T06:46:51.9697755Z [20,295 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:51.9698742Z Compiling torch_xla/csrc/ops/sum.cpp; 36s local 2025-03-14T06:46:51.9699580Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2025-03-14T06:46:51.9700533Z Compiling torch_xla/csrc/ops/select.cpp; 31s local 2025-03-14T06:46:51.9701304Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 31s local 2025-03-14T06:46:51.9702118Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2025-03-14T06:46:51.9702900Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2025-03-14T06:46:51.9703633Z Compiling torch_xla/csrc/ops/scalar.cpp; 27s local 2025-03-14T06:46:51.9704514Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 26s local ... 2025-03-14T06:46:52.2275805Z 2025-03-14T06:46:52.2276681Z  2025-03-14T06:46:52.2277228Z  2025-03-14T06:46:52.2277588Z  2025-03-14T06:46:52.2277979Z  2025-03-14T06:46:52.2278371Z  2025-03-14T06:46:52.2278758Z  2025-03-14T06:46:52.2279109Z  2025-03-14T06:46:52.2279460Z  2025-03-14T06:46:52.2280365Z [20,296 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:52.2281296Z Compiling torch_xla/csrc/ops/sum.cpp; 36s local 2025-03-14T06:46:52.2281988Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2025-03-14T06:46:52.2282929Z Compiling torch_xla/csrc/ops/select.cpp; 31s local 2025-03-14T06:46:52.2284055Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2025-03-14T06:46:52.2286795Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2025-03-14T06:46:52.2287902Z Compiling torch_xla/csrc/ops/scalar.cpp; 27s local 2025-03-14T06:46:52.2289810Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 26s local 2025-03-14T06:46:52.2291826Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 26s local ... 2025-03-14T06:46:52.4567961Z 2025-03-14T06:46:52.4569120Z  2025-03-14T06:46:52.4571003Z  2025-03-14T06:46:52.4572372Z  2025-03-14T06:46:52.4573643Z  2025-03-14T06:46:52.4574950Z  2025-03-14T06:46:52.4576356Z  2025-03-14T06:46:52.4577728Z  2025-03-14T06:46:52.4579119Z  2025-03-14T06:46:52.4581259Z [20,298 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:52.4582284Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2025-03-14T06:46:52.4583930Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2025-03-14T06:46:52.4584791Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2025-03-14T06:46:52.4586477Z Compiling torch_xla/csrc/ops/scalar.cpp; 27s local 2025-03-14T06:46:52.4588246Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 27s local 2025-03-14T06:46:52.4589530Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 26s local 2025-03-14T06:46:52.4591324Z Compiling torch_xla/csrc/ops/roll.cpp; 26s local 2025-03-14T06:46:52.4593006Z Compiling torch_xla/csrc/ops/resize.cpp; 26s local ... 2025-03-14T06:46:52.7551173Z 2025-03-14T06:46:52.7552351Z  2025-03-14T06:46:52.7553960Z  2025-03-14T06:46:52.7555417Z  2025-03-14T06:46:52.7556886Z  2025-03-14T06:46:52.7558233Z  2025-03-14T06:46:52.7559578Z  2025-03-14T06:46:52.7560874Z  2025-03-14T06:46:52.7562202Z  2025-03-14T06:46:52.7564095Z [20,298 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:52.7565486Z Compiling torch_xla/csrc/ops/softmax.cpp; 33s local 2025-03-14T06:46:52.7567221Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2025-03-14T06:46:52.7568109Z Compiling torch_xla/csrc/ops/scatter.cpp; 29s local 2025-03-14T06:46:52.7572474Z Compiling torch_xla/csrc/ops/scalar.cpp; 27s local 2025-03-14T06:46:52.7574285Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 27s local 2025-03-14T06:46:52.7576191Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 27s local 2025-03-14T06:46:52.7577971Z Compiling torch_xla/csrc/ops/roll.cpp; 26s local 2025-03-14T06:46:52.7578804Z Compiling torch_xla/csrc/ops/resize.cpp; 26s local ... 2025-03-14T06:46:53.1555155Z 2025-03-14T06:46:53.1556303Z  2025-03-14T06:46:53.1557991Z  2025-03-14T06:46:53.1559318Z  2025-03-14T06:46:53.1560578Z  2025-03-14T06:46:53.1561853Z  2025-03-14T06:46:53.1563170Z  2025-03-14T06:46:53.1565506Z  2025-03-14T06:46:53.1566254Z  2025-03-14T06:46:53.1567182Z [20,299 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:46:53.1567989Z Compiling torch_xla/csrc/ops/softmax.cpp; 34s local 2025-03-14T06:46:53.1568677Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2025-03-14T06:46:53.1569413Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2025-03-14T06:46:53.1570036Z Compiling torch_xla/csrc/ops/scalar.cpp; 28s local 2025-03-14T06:46:53.1570749Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 27s local 2025-03-14T06:46:53.1571573Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 27s local 2025-03-14T06:46:53.1572286Z Compiling torch_xla/csrc/ops/roll.cpp; 27s local 2025-03-14T06:46:53.1572971Z Compiling torch_xla/csrc/ops/resize.cpp; 27s local ... 2025-03-14T06:46:53.3558397Z 2025-03-14T06:46:53.3559261Z  2025-03-14T06:46:53.3559779Z  2025-03-14T06:46:53.3560179Z  2025-03-14T06:46:53.3560596Z  2025-03-14T06:46:53.3561005Z  2025-03-14T06:46:53.3561396Z  2025-03-14T06:46:53.3561822Z  2025-03-14T06:46:53.3562233Z  2025-03-14T06:46:53.3563198Z [20,299 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:53.3564296Z Compiling torch_xla/csrc/ops/softmax.cpp; 34s local 2025-03-14T06:46:53.3565263Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2025-03-14T06:46:53.3566280Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2025-03-14T06:46:53.3567061Z Compiling torch_xla/csrc/ops/scalar.cpp; 28s local 2025-03-14T06:46:53.3567993Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 28s local 2025-03-14T06:46:53.3569317Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 27s local 2025-03-14T06:46:53.3570138Z Compiling torch_xla/csrc/ops/roll.cpp; 27s local 2025-03-14T06:46:53.3571004Z Compiling torch_xla/csrc/ops/resize.cpp; 27s local ... 2025-03-14T06:46:54.4279162Z 2025-03-14T06:46:54.4280072Z  2025-03-14T06:46:54.4280615Z  2025-03-14T06:46:54.4281052Z  2025-03-14T06:46:54.4281507Z  2025-03-14T06:46:54.4281947Z  2025-03-14T06:46:54.4282422Z  2025-03-14T06:46:54.4282857Z  2025-03-14T06:46:54.4283295Z  2025-03-14T06:46:54.4284481Z [20,300 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:54.4285618Z Compiling torch_xla/csrc/ops/softmax.cpp; 35s local 2025-03-14T06:46:54.4286368Z Compiling torch_xla/csrc/ops/scatter.cpp; 31s local 2025-03-14T06:46:54.4287155Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2025-03-14T06:46:54.4288039Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local 2025-03-14T06:46:54.4289017Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 28s local 2025-03-14T06:46:54.4289849Z Compiling torch_xla/csrc/ops/roll.cpp; 28s local 2025-03-14T06:46:54.4290622Z Compiling torch_xla/csrc/ops/resize.cpp; 28s local 2025-03-14T06:46:54.4291588Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 28s local ... 2025-03-14T06:46:54.7568434Z 2025-03-14T06:46:54.7569588Z  2025-03-14T06:46:54.7570074Z  2025-03-14T06:46:54.7570478Z  2025-03-14T06:46:54.7570890Z  2025-03-14T06:46:54.7571260Z  2025-03-14T06:46:54.7571664Z  2025-03-14T06:46:54.7572065Z  2025-03-14T06:46:54.7572436Z  2025-03-14T06:46:54.7573334Z [20,301 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:54.7574287Z Compiling torch_xla/csrc/ops/softmax.cpp; 35s local 2025-03-14T06:46:54.7575293Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2025-03-14T06:46:54.7576210Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 29s local 2025-03-14T06:46:54.7577175Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 29s local 2025-03-14T06:46:54.7577977Z Compiling torch_xla/csrc/ops/roll.cpp; 28s local 2025-03-14T06:46:54.7578713Z Compiling torch_xla/csrc/ops/resize.cpp; 28s local 2025-03-14T06:46:54.7579514Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 28s local 2025-03-14T06:46:54.7580496Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 28s local ... 2025-03-14T06:46:55.9578346Z 2025-03-14T06:46:55.9579233Z  2025-03-14T06:46:55.9579717Z  2025-03-14T06:46:55.9580103Z  2025-03-14T06:46:55.9580515Z  2025-03-14T06:46:55.9581063Z  2025-03-14T06:46:55.9581454Z  2025-03-14T06:46:55.9581833Z  2025-03-14T06:46:55.9582240Z  2025-03-14T06:46:55.9583222Z [20,301 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:55.9584268Z Compiling torch_xla/csrc/ops/softmax.cpp; 37s local 2025-03-14T06:46:55.9585066Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2025-03-14T06:46:55.9586075Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 30s local 2025-03-14T06:46:55.9587032Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2025-03-14T06:46:55.9587842Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2025-03-14T06:46:55.9588606Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2025-03-14T06:46:55.9589411Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 29s local 2025-03-14T06:46:55.9590380Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 29s local ... 2025-03-14T06:46:56.3582760Z 2025-03-14T06:46:56.3583623Z  2025-03-14T06:46:56.3584084Z  2025-03-14T06:46:56.3584477Z  2025-03-14T06:46:56.3584861Z  2025-03-14T06:46:56.3585305Z  2025-03-14T06:46:56.3585690Z  2025-03-14T06:46:56.3586096Z  2025-03-14T06:46:56.3586757Z  2025-03-14T06:46:56.3587737Z [20,302 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:56.3588724Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2025-03-14T06:46:56.3589637Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 31s local 2025-03-14T06:46:56.3590627Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local 2025-03-14T06:46:56.3591468Z Compiling torch_xla/csrc/ops/roll.cpp; 30s local 2025-03-14T06:46:56.3592399Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local 2025-03-14T06:46:56.3593324Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2025-03-14T06:46:56.9589617Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 29s local 2025-03-14T06:46:56.9590815Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local ... 2025-03-14T06:46:56.9591561Z 2025-03-14T06:46:56.9592034Z  2025-03-14T06:46:56.9592510Z  2025-03-14T06:46:56.9592943Z  2025-03-14T06:46:56.9593379Z  2025-03-14T06:46:56.9593753Z  2025-03-14T06:46:56.9594126Z  2025-03-14T06:46:56.9594495Z  2025-03-14T06:46:56.9594898Z  2025-03-14T06:46:56.9595818Z [20,303 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:46:56.9596790Z Compiling torch_xla/csrc/ops/scalar.cpp; 32s local 2025-03-14T06:46:56.9598146Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 31s local 2025-03-14T06:46:56.9599090Z Compiling torch_xla/csrc/ops/roll.cpp; 31s local 2025-03-14T06:46:56.9599829Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2025-03-14T06:46:56.9600667Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2025-03-14T06:46:56.9601565Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2025-03-14T06:46:56.9602687Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local 2025-03-14T06:46:56.9603676Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 29s local ... 2025-03-14T06:46:57.2575554Z 2025-03-14T06:46:57.2576555Z  2025-03-14T06:46:57.2577075Z  2025-03-14T06:46:57.2578098Z  2025-03-14T06:46:57.2578551Z  2025-03-14T06:46:57.2578993Z  2025-03-14T06:46:57.2579440Z  2025-03-14T06:46:57.2579874Z  2025-03-14T06:46:57.2580311Z  2025-03-14T06:46:57.2581336Z [20,304 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:57.2582420Z Compiling torch_xla/csrc/ops/scalar.cpp; 32s local 2025-03-14T06:46:57.2583282Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 31s local 2025-03-14T06:46:57.2584146Z Compiling torch_xla/csrc/ops/roll.cpp; 31s local 2025-03-14T06:46:57.2585013Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 30s local 2025-03-14T06:46:57.2585997Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2025-03-14T06:46:57.2586972Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2025-03-14T06:46:57.2587869Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 29s local 2025-03-14T06:46:57.2588697Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 28s local ... 2025-03-14T06:46:57.4864620Z 2025-03-14T06:46:57.4865779Z  2025-03-14T06:46:57.4866323Z  2025-03-14T06:46:57.4866778Z  2025-03-14T06:46:57.4867222Z  2025-03-14T06:46:57.4867650Z  2025-03-14T06:46:57.4868092Z  2025-03-14T06:46:57.4868525Z  2025-03-14T06:46:57.4868959Z  2025-03-14T06:46:57.4869931Z [20,305 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:57.4870829Z Compiling torch_xla/csrc/ops/scalar.cpp; 32s local 2025-03-14T06:46:57.4871634Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 32s local 2025-03-14T06:46:57.4882015Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2025-03-14T06:46:57.4882937Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2025-03-14T06:46:57.4883780Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2025-03-14T06:46:57.4884748Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 29s local 2025-03-14T06:46:57.4885512Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 28s local 2025-03-14T06:46:57.4886241Z Compiling torch_xla/csrc/ops/recv.cpp; 28s local ... 2025-03-14T06:46:57.6993749Z 2025-03-14T06:46:57.6996534Z  2025-03-14T06:46:57.6997211Z  2025-03-14T06:46:57.6997547Z  2025-03-14T06:46:57.6997889Z  2025-03-14T06:46:57.6998222Z  2025-03-14T06:46:57.6998575Z  2025-03-14T06:46:57.6998961Z  2025-03-14T06:46:57.6999347Z  2025-03-14T06:46:57.7000243Z [20,306 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:57.7001334Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 32s local 2025-03-14T06:46:57.7002222Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2025-03-14T06:46:57.7003039Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2025-03-14T06:46:57.7003851Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2025-03-14T06:46:57.7004804Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2025-03-14T06:46:57.7005776Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 29s local 2025-03-14T06:46:57.7006487Z Compiling torch_xla/csrc/ops/recv.cpp; 28s local 2025-03-14T06:46:57.7007141Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local ... 2025-03-14T06:46:57.9598325Z 2025-03-14T06:46:57.9599222Z  2025-03-14T06:46:57.9599753Z  2025-03-14T06:46:57.9600174Z  2025-03-14T06:46:57.9600587Z  2025-03-14T06:46:57.9601127Z  2025-03-14T06:46:57.9601803Z  2025-03-14T06:46:57.9602199Z  2025-03-14T06:46:57.9602590Z  2025-03-14T06:46:57.9603363Z [20,306 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:57.9604223Z Compiling torch_xla/csrc/ops/rrelu_with_noise_backward.cpp; 32s local 2025-03-14T06:46:57.9605561Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2025-03-14T06:46:57.9606554Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2025-03-14T06:46:57.9607550Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2025-03-14T06:46:57.9608329Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2025-03-14T06:46:57.9609038Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 29s local 2025-03-14T06:46:57.9609744Z Compiling torch_xla/csrc/ops/recv.cpp; 28s local 2025-03-14T06:46:57.9610497Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local ... 2025-03-14T06:46:58.2459641Z 2025-03-14T06:46:58.2460619Z  2025-03-14T06:46:58.2461327Z  2025-03-14T06:46:58.2462369Z  2025-03-14T06:46:58.2462825Z  2025-03-14T06:46:58.2463267Z  2025-03-14T06:46:58.2463701Z  2025-03-14T06:46:58.2464132Z  2025-03-14T06:46:58.2464569Z  2025-03-14T06:46:58.2465711Z [20,307 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:58.2466950Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2025-03-14T06:46:58.2467905Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2025-03-14T06:46:58.2468845Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2025-03-14T06:46:58.2469803Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2025-03-14T06:46:58.2470681Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 29s local 2025-03-14T06:46:58.2471480Z Compiling torch_xla/csrc/ops/recv.cpp; 28s local 2025-03-14T06:46:58.2472223Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local 2025-03-14T06:46:58.2473310Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 28s local ... 2025-03-14T06:46:58.4634485Z 2025-03-14T06:46:58.4635402Z  2025-03-14T06:46:58.4635925Z  2025-03-14T06:46:58.4636367Z  2025-03-14T06:46:58.4636787Z  2025-03-14T06:46:58.4637126Z  2025-03-14T06:46:58.4637478Z  2025-03-14T06:46:58.4637812Z  2025-03-14T06:46:58.4638166Z  2025-03-14T06:46:58.4638938Z [20,309 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:46:58.4640194Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2025-03-14T06:46:58.4641343Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2025-03-14T06:46:58.4642310Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 29s local 2025-03-14T06:46:58.4643213Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local 2025-03-14T06:46:58.4643949Z Compiling torch_xla/csrc/ops/randperm.cpp; 28s local 2025-03-14T06:46:58.4644882Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 28s local 2025-03-14T06:46:58.4645591Z Compiling torch_xla/csrc/ops/qr.cpp; 28s local 2025-03-14T06:46:58.4646276Z Compiling torch_xla/csrc/ops/put.cpp; 28s local ... 2025-03-14T06:46:58.7600443Z 2025-03-14T06:46:58.7601314Z  2025-03-14T06:46:58.7601766Z  2025-03-14T06:46:58.7602139Z  2025-03-14T06:46:58.7602507Z  2025-03-14T06:46:58.7602873Z  2025-03-14T06:46:58.7603518Z  2025-03-14T06:46:58.7603892Z  2025-03-14T06:46:58.7604259Z  2025-03-14T06:46:58.7605289Z [20,309 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:58.7606304Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2025-03-14T06:46:58.7607189Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 31s local 2025-03-14T06:46:58.7607996Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local 2025-03-14T06:46:58.7608894Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local 2025-03-14T06:46:58.7609593Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local 2025-03-14T06:46:58.7610320Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 29s local 2025-03-14T06:46:58.7611020Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local 2025-03-14T06:46:58.7611681Z Compiling torch_xla/csrc/ops/put.cpp; 29s local ... 2025-03-14T06:46:59.1605500Z 2025-03-14T06:46:59.1606479Z  2025-03-14T06:46:59.1607036Z  2025-03-14T06:46:59.1608018Z  2025-03-14T06:46:59.1608460Z  2025-03-14T06:46:59.1608900Z  2025-03-14T06:46:59.1609307Z  2025-03-14T06:46:59.1609728Z  2025-03-14T06:46:59.1610142Z  2025-03-14T06:46:59.1611319Z [20,310 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:59.1612449Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 31s local 2025-03-14T06:46:59.1613248Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local 2025-03-14T06:46:59.1614002Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local 2025-03-14T06:46:59.1614737Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local 2025-03-14T06:46:59.1615501Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 29s local 2025-03-14T06:46:59.1616218Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local 2025-03-14T06:46:59.1616891Z Compiling torch_xla/csrc/ops/put.cpp; 29s local 2025-03-14T06:46:59.1617589Z Compiling torch_xla/csrc/ops/prod.cpp; 28s local ... 2025-03-14T06:46:59.5609601Z 2025-03-14T06:46:59.5610500Z  2025-03-14T06:46:59.5610910Z  2025-03-14T06:46:59.5611243Z  2025-03-14T06:46:59.5611578Z  2025-03-14T06:46:59.5611884Z  2025-03-14T06:46:59.5612213Z  2025-03-14T06:46:59.5612541Z  2025-03-14T06:46:59.5612869Z  2025-03-14T06:46:59.5613660Z [20,311 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:46:59.5614798Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local 2025-03-14T06:46:59.5615465Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local 2025-03-14T06:46:59.5616082Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local 2025-03-14T06:46:59.5616746Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2025-03-14T06:46:59.5617384Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local 2025-03-14T06:46:59.5617958Z Compiling torch_xla/csrc/ops/put.cpp; 29s local 2025-03-14T06:46:59.5618547Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local 2025-03-14T06:46:59.5619329Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local ... 2025-03-14T06:47:00.3526721Z 2025-03-14T06:47:00.3527675Z  2025-03-14T06:47:00.3529453Z  2025-03-14T06:47:00.3532427Z  2025-03-14T06:47:00.3534952Z  2025-03-14T06:47:00.3537833Z  2025-03-14T06:47:00.3540830Z  2025-03-14T06:47:00.3543701Z  2025-03-14T06:47:00.3546444Z  2025-03-14T06:47:00.3549932Z [20,312 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:00.3553383Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2025-03-14T06:47:00.3556678Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local 2025-03-14T06:47:00.3559787Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2025-03-14T06:47:00.3563080Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local 2025-03-14T06:47:00.3567059Z Compiling torch_xla/csrc/ops/put.cpp; 30s local 2025-03-14T06:47:00.3570251Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2025-03-14T06:47:00.3573269Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2025-03-14T06:47:00.3576611Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local ... 2025-03-14T06:47:00.5615665Z 2025-03-14T06:47:00.5619017Z  2025-03-14T06:47:00.5622025Z  2025-03-14T06:47:00.5624792Z  2025-03-14T06:47:00.5627961Z  2025-03-14T06:47:00.5630896Z  2025-03-14T06:47:00.5633798Z  2025-03-14T06:47:00.5636740Z  2025-03-14T06:47:00.5639667Z  2025-03-14T06:47:00.5642989Z [20,312 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:00.5644686Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2025-03-14T06:47:00.5645791Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2025-03-14T06:47:00.5646869Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2025-03-14T06:47:00.5647934Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local 2025-03-14T06:47:00.5648939Z Compiling torch_xla/csrc/ops/put.cpp; 30s local 2025-03-14T06:47:00.5649889Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2025-03-14T06:47:00.5650885Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2025-03-14T06:47:00.5652057Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local ... 2025-03-14T06:47:01.0817215Z 2025-03-14T06:47:01.0818571Z  2025-03-14T06:47:01.0819214Z  2025-03-14T06:47:01.0819887Z  2025-03-14T06:47:01.0820553Z  2025-03-14T06:47:01.0821025Z  2025-03-14T06:47:01.0821458Z  2025-03-14T06:47:01.0821894Z  2025-03-14T06:47:01.0822325Z  2025-03-14T06:47:01.0823230Z [20,313 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:01.0824190Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2025-03-14T06:47:01.0824986Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2025-03-14T06:47:01.0825774Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2025-03-14T06:47:01.0826495Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2025-03-14T06:47:01.0827246Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2025-03-14T06:47:01.0828024Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2025-03-14T06:47:01.0828922Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local 2025-03-14T06:47:01.0830221Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 24s local ... 2025-03-14T06:47:01.2955312Z 2025-03-14T06:47:01.2956182Z  2025-03-14T06:47:01.2956672Z  2025-03-14T06:47:01.2957064Z  2025-03-14T06:47:01.2957544Z  2025-03-14T06:47:01.2958050Z  2025-03-14T06:47:01.2958432Z  2025-03-14T06:47:01.2958795Z  2025-03-14T06:47:01.2959179Z  2025-03-14T06:47:01.2960207Z [20,314 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:01.2961663Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2025-03-14T06:47:01.2962571Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2025-03-14T06:47:01.2963377Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2025-03-14T06:47:01.2964062Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2025-03-14T06:47:01.2965063Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2025-03-14T06:47:01.2966231Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2025-03-14T06:47:01.2967298Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 24s local 2025-03-14T06:47:01.2968093Z Compiling torch_xla/csrc/ops/var_mean.cpp; 24s local ... 2025-03-14T06:47:01.5425067Z 2025-03-14T06:47:01.5425940Z  2025-03-14T06:47:01.5426461Z  2025-03-14T06:47:01.5426883Z  2025-03-14T06:47:01.5427287Z  2025-03-14T06:47:01.5427710Z  2025-03-14T06:47:01.5428116Z  2025-03-14T06:47:01.5428543Z  2025-03-14T06:47:01.5429283Z  2025-03-14T06:47:01.5430261Z [20,315 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:01.5431284Z Compiling torch_xla/csrc/ops/recv.cpp; 32s local 2025-03-14T06:47:01.5432017Z Compiling torch_xla/csrc/ops/put.cpp; 31s local 2025-03-14T06:47:01.5432705Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2025-03-14T06:47:01.5433456Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2025-03-14T06:47:01.5434544Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2025-03-14T06:47:01.5435426Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 24s local 2025-03-14T06:47:01.5436190Z Compiling torch_xla/csrc/ops/var_mean.cpp; 24s local 2025-03-14T06:47:01.5436902Z Compiling torch_xla/csrc/ops/ops.cpp; 22s local ... 2025-03-14T06:47:01.7624057Z 2025-03-14T06:47:01.7624931Z  2025-03-14T06:47:01.7625388Z  2025-03-14T06:47:01.7625767Z  2025-03-14T06:47:01.7626194Z  2025-03-14T06:47:01.7626555Z  2025-03-14T06:47:01.7626900Z  2025-03-14T06:47:01.7627224Z  2025-03-14T06:47:01.7627617Z  2025-03-14T06:47:01.7628521Z [20,316 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:01.7629451Z Compiling torch_xla/csrc/ops/recv.cpp; 32s local 2025-03-14T06:47:01.7630185Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2025-03-14T06:47:01.7630943Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2025-03-14T06:47:01.7631802Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2025-03-14T06:47:01.7632777Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local 2025-03-14T06:47:01.7633636Z Compiling torch_xla/csrc/ops/var_mean.cpp; 24s local 2025-03-14T06:47:01.7634333Z Compiling torch_xla/csrc/ops/ops.cpp; 22s local 2025-03-14T06:47:01.7635078Z Compiling torch_xla/csrc/ops/not_supported.cpp; 21s local ... 2025-03-14T06:47:02.1631999Z 2025-03-14T06:47:02.1632887Z  2025-03-14T06:47:02.1633381Z  2025-03-14T06:47:02.1633775Z  2025-03-14T06:47:02.1634143Z  2025-03-14T06:47:02.1634523Z  2025-03-14T06:47:02.1634938Z  2025-03-14T06:47:02.1635305Z  2025-03-14T06:47:02.1635689Z  2025-03-14T06:47:02.1636610Z [20,317 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:47:02.1637578Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2025-03-14T06:47:02.1638674Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2025-03-14T06:47:02.1639508Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 29s local 2025-03-14T06:47:02.1640358Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local 2025-03-14T06:47:02.1641140Z Compiling torch_xla/csrc/ops/var_mean.cpp; 25s local 2025-03-14T06:47:02.1641829Z Compiling torch_xla/csrc/ops/ops.cpp; 23s local 2025-03-14T06:47:02.1642578Z Compiling torch_xla/csrc/ops/not_supported.cpp; 21s local 2025-03-14T06:47:02.1643590Z Compiling torch_xla/csrc/ops/normal.cpp; 21s local ... 2025-03-14T06:47:02.5632511Z 2025-03-14T06:47:02.5633399Z  2025-03-14T06:47:02.5633930Z  2025-03-14T06:47:02.5634361Z  2025-03-14T06:47:02.5634772Z  2025-03-14T06:47:02.5635172Z  2025-03-14T06:47:02.5635597Z  2025-03-14T06:47:02.5636010Z  2025-03-14T06:47:02.5636509Z  2025-03-14T06:47:02.5637470Z [20,317 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:02.5638445Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2025-03-14T06:47:02.5639291Z Compiling torch_xla/csrc/ops/permute.cpp; 30s local 2025-03-14T06:47:02.5640134Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2025-03-14T06:47:02.5640975Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local 2025-03-14T06:47:02.5641764Z Compiling torch_xla/csrc/ops/var_mean.cpp; 25s local 2025-03-14T06:47:02.5642838Z Compiling torch_xla/csrc/ops/ops.cpp; 23s local 2025-03-14T06:47:02.5643579Z Compiling torch_xla/csrc/ops/not_supported.cpp; 21s local 2025-03-14T06:47:02.5644721Z Compiling torch_xla/csrc/ops/normal.cpp; 21s local ... 2025-03-14T06:47:03.5641009Z 2025-03-14T06:47:03.5642008Z  2025-03-14T06:47:03.5643827Z  2025-03-14T06:47:03.5645005Z  2025-03-14T06:47:03.5646314Z  2025-03-14T06:47:03.5647706Z  2025-03-14T06:47:03.5649418Z  2025-03-14T06:47:03.5650431Z  2025-03-14T06:47:03.5651009Z  2025-03-14T06:47:03.5652014Z [20,317 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:03.5653067Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2025-03-14T06:47:03.5653839Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2025-03-14T06:47:03.5654777Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 31s local 2025-03-14T06:47:03.5655779Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 26s local 2025-03-14T06:47:03.5656641Z Compiling torch_xla/csrc/ops/var_mean.cpp; 26s local 2025-03-14T06:47:03.5657297Z Compiling torch_xla/csrc/ops/ops.cpp; 24s local 2025-03-14T06:47:03.5658018Z Compiling torch_xla/csrc/ops/not_supported.cpp; 22s local 2025-03-14T06:47:03.5658830Z Compiling torch_xla/csrc/ops/normal.cpp; 22s local ... 2025-03-14T06:47:04.2625564Z 2025-03-14T06:47:04.2626399Z  2025-03-14T06:47:04.2626929Z  2025-03-14T06:47:04.2627336Z  2025-03-14T06:47:04.2627764Z  2025-03-14T06:47:04.2628195Z  2025-03-14T06:47:04.2628595Z  2025-03-14T06:47:04.2628988Z  2025-03-14T06:47:04.2629377Z  2025-03-14T06:47:04.2630284Z [20,318 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:04.2631235Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2025-03-14T06:47:04.2632102Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 31s local 2025-03-14T06:47:04.2633080Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 27s local 2025-03-14T06:47:04.2633845Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local 2025-03-14T06:47:04.2634584Z Compiling torch_xla/csrc/ops/ops.cpp; 25s local 2025-03-14T06:47:04.2635373Z Compiling torch_xla/csrc/ops/not_supported.cpp; 23s local 2025-03-14T06:47:04.2636171Z Compiling torch_xla/csrc/ops/normal.cpp; 23s local 2025-03-14T06:47:04.2636971Z Compiling torch_xla/csrc/ops/nonzero.cpp; 23s local ... 2025-03-14T06:47:04.5649232Z 2025-03-14T06:47:04.5650301Z  2025-03-14T06:47:04.5651840Z  2025-03-14T06:47:04.5653272Z  2025-03-14T06:47:04.5654709Z  2025-03-14T06:47:04.5656139Z  2025-03-14T06:47:04.5657572Z  2025-03-14T06:47:04.5659024Z  2025-03-14T06:47:04.5660451Z  2025-03-14T06:47:04.5662492Z [20,318 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:04.5663805Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2025-03-14T06:47:04.5665250Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2025-03-14T06:47:04.5666744Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 27s local 2025-03-14T06:47:04.5667822Z Compiling torch_xla/csrc/ops/var_mean.cpp; 27s local 2025-03-14T06:47:04.5668831Z Compiling torch_xla/csrc/ops/ops.cpp; 25s local 2025-03-14T06:47:04.5669904Z Compiling torch_xla/csrc/ops/not_supported.cpp; 23s local 2025-03-14T06:47:04.5671012Z Compiling torch_xla/csrc/ops/normal.cpp; 23s local 2025-03-14T06:47:04.5672080Z Compiling torch_xla/csrc/ops/nonzero.cpp; 23s local ... 2025-03-14T06:47:05.5655217Z 2025-03-14T06:47:05.5656325Z  2025-03-14T06:47:05.5656848Z  2025-03-14T06:47:05.5657281Z  2025-03-14T06:47:05.5657705Z  2025-03-14T06:47:05.5658077Z  2025-03-14T06:47:05.5658480Z  2025-03-14T06:47:05.5658901Z  2025-03-14T06:47:05.5659665Z  2025-03-14T06:47:05.5660685Z [20,318 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:05.5661627Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2025-03-14T06:47:05.5662401Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2025-03-14T06:47:05.5663259Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2025-03-14T06:47:05.5664064Z Compiling torch_xla/csrc/ops/var_mean.cpp; 28s local 2025-03-14T06:47:05.5665006Z Compiling torch_xla/csrc/ops/ops.cpp; 26s local 2025-03-14T06:47:05.5666075Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local 2025-03-14T06:47:05.5666891Z Compiling torch_xla/csrc/ops/normal.cpp; 24s local 2025-03-14T06:47:05.5667674Z Compiling torch_xla/csrc/ops/nonzero.cpp; 24s local ... 2025-03-14T06:47:06.5662912Z 2025-03-14T06:47:06.5664048Z  2025-03-14T06:47:06.5664583Z  2025-03-14T06:47:06.5665266Z  2025-03-14T06:47:06.5665951Z  2025-03-14T06:47:06.5666528Z  2025-03-14T06:47:06.5667082Z  2025-03-14T06:47:06.5667634Z  2025-03-14T06:47:06.5668205Z  2025-03-14T06:47:06.5669344Z [20,318 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:06.5670376Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2025-03-14T06:47:06.5671389Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 34s local 2025-03-14T06:47:06.5672371Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2025-03-14T06:47:06.5673291Z Compiling torch_xla/csrc/ops/var_mean.cpp; 29s local 2025-03-14T06:47:06.5674141Z Compiling torch_xla/csrc/ops/ops.cpp; 27s local 2025-03-14T06:47:06.5675093Z Compiling torch_xla/csrc/ops/not_supported.cpp; 25s local 2025-03-14T06:47:06.5676047Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local 2025-03-14T06:47:06.5676942Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local ... 2025-03-14T06:47:06.9666921Z 2025-03-14T06:47:06.9669150Z  2025-03-14T06:47:06.9669857Z  2025-03-14T06:47:06.9670399Z  2025-03-14T06:47:06.9670933Z  2025-03-14T06:47:06.9671462Z  2025-03-14T06:47:06.9671975Z  2025-03-14T06:47:06.9672492Z  2025-03-14T06:47:06.9673004Z  2025-03-14T06:47:06.9674079Z [20,319 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:06.9675393Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2025-03-14T06:47:06.9676757Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 34s local 2025-03-14T06:47:06.9677905Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2025-03-14T06:47:06.9678851Z Compiling torch_xla/csrc/ops/var_mean.cpp; 30s local 2025-03-14T06:47:06.9679770Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T06:47:06.9680730Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2025-03-14T06:47:06.9681680Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2025-03-14T06:47:06.9682567Z Compiling torch_xla/csrc/ops/nonzero.cpp; 26s local ... 2025-03-14T06:47:07.1669864Z 2025-03-14T06:47:07.1670750Z  2025-03-14T06:47:07.1671206Z  2025-03-14T06:47:07.1671597Z  2025-03-14T06:47:07.1671991Z  2025-03-14T06:47:07.1672401Z  2025-03-14T06:47:07.1672801Z  2025-03-14T06:47:07.1673207Z  2025-03-14T06:47:07.1673561Z  2025-03-14T06:47:07.1674490Z [20,320 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:07.1675511Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2025-03-14T06:47:07.1676318Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2025-03-14T06:47:07.1680125Z Compiling torch_xla/csrc/ops/var_mean.cpp; 30s local 2025-03-14T06:47:07.1680890Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T06:47:07.1681656Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2025-03-14T06:47:07.1682691Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2025-03-14T06:47:07.1683463Z Compiling torch_xla/csrc/ops/nonzero.cpp; 26s local 2025-03-14T06:47:07.1684199Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local ... 2025-03-14T06:47:07.7152824Z 2025-03-14T06:47:07.7154100Z  2025-03-14T06:47:07.7155672Z  2025-03-14T06:47:07.7157150Z  2025-03-14T06:47:07.7158585Z  2025-03-14T06:47:07.7160022Z  2025-03-14T06:47:07.7161456Z  2025-03-14T06:47:07.7163269Z  2025-03-14T06:47:07.7164823Z  2025-03-14T06:47:07.7167051Z [20,321 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:07.7169161Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2025-03-14T06:47:07.7171023Z Compiling torch_xla/csrc/ops/var_mean.cpp; 30s local 2025-03-14T06:47:07.7172053Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T06:47:07.7173131Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local 2025-03-14T06:47:07.7174228Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2025-03-14T06:47:07.7175270Z Compiling torch_xla/csrc/ops/nonzero.cpp; 26s local 2025-03-14T06:47:07.7176270Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local 2025-03-14T06:47:07.7177426Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local ... 2025-03-14T06:47:07.9675299Z 2025-03-14T06:47:07.9676491Z  2025-03-14T06:47:07.9677004Z  2025-03-14T06:47:07.9677461Z  2025-03-14T06:47:07.9677889Z  2025-03-14T06:47:07.9678306Z  2025-03-14T06:47:07.9678757Z  2025-03-14T06:47:07.9679144Z  2025-03-14T06:47:07.9679530Z  2025-03-14T06:47:07.9680466Z [20,321 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:07.9681477Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2025-03-14T06:47:07.9682455Z Compiling torch_xla/csrc/ops/var_mean.cpp; 31s local 2025-03-14T06:47:07.9683205Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2025-03-14T06:47:07.9684017Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local 2025-03-14T06:47:07.9684975Z Compiling torch_xla/csrc/ops/normal.cpp; 27s local 2025-03-14T06:47:07.9685744Z Compiling torch_xla/csrc/ops/nonzero.cpp; 27s local 2025-03-14T06:47:08.9682921Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2025-03-14T06:47:08.9683670Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local ... 2025-03-14T06:47:08.9684161Z 2025-03-14T06:47:08.9685242Z  2025-03-14T06:47:08.9686187Z  2025-03-14T06:47:08.9686798Z  2025-03-14T06:47:08.9687421Z  2025-03-14T06:47:08.9687827Z  2025-03-14T06:47:08.9688259Z  2025-03-14T06:47:08.9688682Z  2025-03-14T06:47:08.9689109Z  2025-03-14T06:47:08.9690095Z [20,321 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:08.9691049Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 32s local 2025-03-14T06:47:08.9692054Z Compiling torch_xla/csrc/ops/var_mean.cpp; 32s local 2025-03-14T06:47:08.9692798Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2025-03-14T06:47:08.9693584Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local 2025-03-14T06:47:08.9694502Z Compiling torch_xla/csrc/ops/normal.cpp; 28s local 2025-03-14T06:47:08.9695272Z Compiling torch_xla/csrc/ops/nonzero.cpp; 28s local 2025-03-14T06:47:08.9696016Z Compiling torch_xla/csrc/ops/nms.cpp; 28s local 2025-03-14T06:47:08.9696826Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local ... 2025-03-14T06:47:09.9689137Z 2025-03-14T06:47:09.9691269Z  2025-03-14T06:47:09.9692010Z  2025-03-14T06:47:09.9692527Z  2025-03-14T06:47:09.9693013Z  2025-03-14T06:47:09.9693520Z  2025-03-14T06:47:09.9694022Z  2025-03-14T06:47:09.9694513Z  2025-03-14T06:47:09.9695024Z  2025-03-14T06:47:09.9696047Z [20,321 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:09.9697447Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2025-03-14T06:47:09.9698317Z Compiling torch_xla/csrc/ops/var_mean.cpp; 33s local 2025-03-14T06:47:09.9699127Z Compiling torch_xla/csrc/ops/ops.cpp; 31s local 2025-03-14T06:47:09.9699996Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2025-03-14T06:47:09.9700871Z Compiling torch_xla/csrc/ops/normal.cpp; 29s local 2025-03-14T06:47:09.9701850Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2025-03-14T06:47:09.9702643Z Compiling torch_xla/csrc/ops/nms.cpp; 29s local 2025-03-14T06:47:09.9703513Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 28s local ... 2025-03-14T06:47:11.1697789Z 2025-03-14T06:47:11.1698922Z  2025-03-14T06:47:11.1699413Z  2025-03-14T06:47:11.1699814Z  2025-03-14T06:47:11.1700183Z  2025-03-14T06:47:11.1700554Z  2025-03-14T06:47:11.1700986Z  2025-03-14T06:47:11.1701393Z  2025-03-14T06:47:11.1701808Z  2025-03-14T06:47:11.1702777Z [20,321 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:11.1703891Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2025-03-14T06:47:11.1704779Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2025-03-14T06:47:11.1705479Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2025-03-14T06:47:11.1706235Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2025-03-14T06:47:11.1707029Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2025-03-14T06:47:11.1707823Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2025-03-14T06:47:11.1708586Z Compiling torch_xla/csrc/ops/nms.cpp; 30s local 2025-03-14T06:47:11.8523783Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 30s local ... 2025-03-14T06:47:11.8524418Z 2025-03-14T06:47:11.8525400Z  2025-03-14T06:47:11.8526014Z  2025-03-14T06:47:11.8526547Z  2025-03-14T06:47:11.8527067Z  2025-03-14T06:47:11.8527599Z  2025-03-14T06:47:11.8528115Z  2025-03-14T06:47:11.8528624Z  2025-03-14T06:47:11.8529118Z  2025-03-14T06:47:11.8530144Z [20,322 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:11.8531385Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2025-03-14T06:47:11.8532333Z Compiling torch_xla/csrc/ops/var_mean.cpp; 34s local 2025-03-14T06:47:11.8533566Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2025-03-14T06:47:11.8534489Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2025-03-14T06:47:11.8535397Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2025-03-14T06:47:11.8536247Z Compiling torch_xla/csrc/ops/nms.cpp; 30s local 2025-03-14T06:47:11.8537240Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 30s local 2025-03-14T06:47:11.8538288Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local ... 2025-03-14T06:47:12.1704196Z 2025-03-14T06:47:12.1705353Z  2025-03-14T06:47:12.1705900Z  2025-03-14T06:47:12.1706285Z  2025-03-14T06:47:12.1706678Z  2025-03-14T06:47:12.1707057Z  2025-03-14T06:47:12.1707436Z  2025-03-14T06:47:12.1707851Z  2025-03-14T06:47:12.1708249Z  2025-03-14T06:47:12.1709110Z [20,322 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:12.1710172Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2025-03-14T06:47:12.1710956Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T06:47:12.1711632Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2025-03-14T06:47:12.1712334Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2025-03-14T06:47:12.1713090Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2025-03-14T06:47:12.1713768Z Compiling torch_xla/csrc/ops/nms.cpp; 31s local 2025-03-14T06:47:12.1714910Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2025-03-14T06:47:12.1715870Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local ... 2025-03-14T06:47:12.3752710Z 2025-03-14T06:47:12.3754969Z  2025-03-14T06:47:12.3755497Z  2025-03-14T06:47:12.3756838Z  2025-03-14T06:47:12.3757233Z  2025-03-14T06:47:12.3757606Z  2025-03-14T06:47:12.3757962Z  2025-03-14T06:47:12.3758359Z  2025-03-14T06:47:12.3759143Z  2025-03-14T06:47:12.3760046Z [20,323 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:12.3761361Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2025-03-14T06:47:12.3762342Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T06:47:12.3763203Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2025-03-14T06:47:12.3764042Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2025-03-14T06:47:12.3765055Z Compiling torch_xla/csrc/ops/nms.cpp; 31s local 2025-03-14T06:47:12.3766271Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2025-03-14T06:47:12.3767447Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local 2025-03-14T06:47:12.3768433Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 28s local ... 2025-03-14T06:47:12.6842087Z 2025-03-14T06:47:12.6844213Z  2025-03-14T06:47:12.6844968Z  2025-03-14T06:47:12.6845498Z  2025-03-14T06:47:12.6846069Z  2025-03-14T06:47:12.6846576Z  2025-03-14T06:47:12.6847100Z  2025-03-14T06:47:12.6847606Z  2025-03-14T06:47:12.6848107Z  2025-03-14T06:47:12.6849138Z [20,324 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:12.6850406Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2025-03-14T06:47:12.6851343Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T06:47:12.6852219Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2025-03-14T06:47:12.6853106Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2025-03-14T06:47:12.6854093Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2025-03-14T06:47:12.6855140Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local 2025-03-14T06:47:12.6856112Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 28s local 2025-03-14T06:47:12.6857026Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 28s local ... 2025-03-14T06:47:13.1971410Z 2025-03-14T06:47:13.1973905Z  2025-03-14T06:47:13.1974860Z  2025-03-14T06:47:13.1975435Z  2025-03-14T06:47:13.1975955Z  2025-03-14T06:47:13.1976472Z  2025-03-14T06:47:13.1976982Z  2025-03-14T06:47:13.1977487Z  2025-03-14T06:47:13.1977984Z  2025-03-14T06:47:13.1978996Z [20,324 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:13.1980127Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2025-03-14T06:47:13.1981273Z Compiling torch_xla/csrc/ops/var_mean.cpp; 35s local 2025-03-14T06:47:13.1982095Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2025-03-14T06:47:13.1982936Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2025-03-14T06:47:13.1983878Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2025-03-14T06:47:13.1984827Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2025-03-14T06:47:13.1985812Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2025-03-14T06:47:13.1986720Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local ... 2025-03-14T06:47:13.2377024Z 2025-03-14T06:47:13.2379191Z  2025-03-14T06:47:13.2379690Z  2025-03-14T06:47:13.2381027Z  2025-03-14T06:47:13.2381567Z  2025-03-14T06:47:13.2381958Z  2025-03-14T06:47:13.2382357Z  2025-03-14T06:47:13.2382881Z  2025-03-14T06:47:13.2383440Z  2025-03-14T06:47:13.2384874Z [20,325 / 20,653] 6 / 17 tests; 48 actions, 46 running; last test: ...ent_test 2025-03-14T06:47:13.2386031Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2025-03-14T06:47:13.2386954Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2025-03-14T06:47:13.2387820Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2025-03-14T06:47:13.2388683Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2025-03-14T06:47:13.2389672Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2025-03-14T06:47:13.2390826Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2025-03-14T06:47:13.2391723Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2025-03-14T06:47:13.2392636Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 28s local ... 2025-03-14T06:47:13.5845893Z 2025-03-14T06:47:13.5848302Z  2025-03-14T06:47:13.5850114Z  2025-03-14T06:47:13.5850678Z  2025-03-14T06:47:13.5852099Z  2025-03-14T06:47:13.5853649Z  2025-03-14T06:47:13.5854216Z  2025-03-14T06:47:13.5855681Z  2025-03-14T06:47:13.5857057Z  2025-03-14T06:47:13.5858156Z [20,325 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:13.5860337Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2025-03-14T06:47:13.5862114Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2025-03-14T06:47:13.5863775Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2025-03-14T06:47:13.5864797Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2025-03-14T06:47:13.5866781Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2025-03-14T06:47:13.5868554Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2025-03-14T06:47:13.5869433Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2025-03-14T06:47:13.5871133Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 28s local ... 2025-03-14T06:47:13.7849448Z 2025-03-14T06:47:13.7850468Z  2025-03-14T06:47:13.7850969Z  2025-03-14T06:47:13.7851369Z  2025-03-14T06:47:13.7851795Z  2025-03-14T06:47:13.7852193Z  2025-03-14T06:47:13.7852578Z  2025-03-14T06:47:13.7852989Z  2025-03-14T06:47:13.7853393Z  2025-03-14T06:47:13.7854336Z [20,326 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:13.7855421Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2025-03-14T06:47:13.7856514Z Compiling torch_xla/csrc/ops/var_mean.cpp; 36s local 2025-03-14T06:47:13.7857299Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2025-03-14T06:47:13.7858169Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2025-03-14T06:47:13.7858941Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2025-03-14T06:47:13.7859727Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T06:47:13.7860530Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 28s local 2025-03-14T06:47:13.7861693Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 28s local ... 2025-03-14T06:47:14.1853708Z 2025-03-14T06:47:14.1854597Z  2025-03-14T06:47:14.1855084Z  2025-03-14T06:47:14.1855462Z  2025-03-14T06:47:14.1855850Z  2025-03-14T06:47:14.1856203Z  2025-03-14T06:47:14.1856557Z  2025-03-14T06:47:14.1856886Z  2025-03-14T06:47:14.1857232Z  2025-03-14T06:47:14.1858109Z [20,327 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:47:14.1859091Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2025-03-14T06:47:14.1859883Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2025-03-14T06:47:14.1860547Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2025-03-14T06:47:14.1861235Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2025-03-14T06:47:14.1861947Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T06:47:14.1863015Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2025-03-14T06:47:14.1863904Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 28s local 2025-03-14T06:47:14.1864876Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 27s local ... 2025-03-14T06:47:14.5280193Z 2025-03-14T06:47:14.5281013Z  2025-03-14T06:47:14.5281427Z  2025-03-14T06:47:14.5281791Z  2025-03-14T06:47:14.5282148Z  2025-03-14T06:47:14.5282499Z  2025-03-14T06:47:14.5283189Z  2025-03-14T06:47:14.5283537Z  2025-03-14T06:47:14.5283892Z  2025-03-14T06:47:14.5285061Z [20,328 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:14.5285951Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2025-03-14T06:47:14.5286644Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2025-03-14T06:47:14.5287357Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2025-03-14T06:47:14.5288112Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T06:47:14.5288909Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2025-03-14T06:47:14.5289786Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 28s local 2025-03-14T06:47:14.5290757Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 28s local 2025-03-14T06:47:14.5291685Z Compiling torch_xla/csrc/ops/multinomial.cpp; 27s local ... 2025-03-14T06:47:14.7859290Z 2025-03-14T06:47:14.7860174Z  2025-03-14T06:47:14.7860583Z  2025-03-14T06:47:14.7860934Z  2025-03-14T06:47:14.7861246Z  2025-03-14T06:47:14.7861575Z  2025-03-14T06:47:14.7861910Z  2025-03-14T06:47:14.7862238Z  2025-03-14T06:47:14.7862573Z  2025-03-14T06:47:14.7863353Z [20,328 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:14.7864151Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2025-03-14T06:47:14.7864775Z Compiling torch_xla/csrc/ops/nonzero.cpp; 34s local 2025-03-14T06:47:14.7865678Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2025-03-14T06:47:14.7866337Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2025-03-14T06:47:14.7867019Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2025-03-14T06:47:14.7867784Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 29s local 2025-03-14T06:47:14.7868649Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 28s local 2025-03-14T06:47:14.7869757Z Compiling torch_xla/csrc/ops/multinomial.cpp; 27s local ... 2025-03-14T06:47:15.3864924Z 2025-03-14T06:47:15.3866008Z  2025-03-14T06:47:15.3866453Z  2025-03-14T06:47:15.3866818Z  2025-03-14T06:47:15.3867179Z  2025-03-14T06:47:15.3867538Z  2025-03-14T06:47:15.3867887Z  2025-03-14T06:47:15.3868232Z  2025-03-14T06:47:15.3868575Z  2025-03-14T06:47:15.3869564Z [20,330 / 20,653] 6 / 17 tests; 46 actions running; last test: ..._client_test 2025-03-14T06:47:15.3870785Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2025-03-14T06:47:15.3871455Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 31s local 2025-03-14T06:47:15.3872194Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2025-03-14T06:47:15.3872972Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 29s local 2025-03-14T06:47:15.3873806Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local 2025-03-14T06:47:15.3874646Z Compiling torch_xla/csrc/ops/multinomial.cpp; 28s local 2025-03-14T06:47:15.3875422Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 28s local 2025-03-14T06:47:15.3876270Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 27s local ... 2025-03-14T06:47:15.5980716Z 2025-03-14T06:47:15.5981549Z  2025-03-14T06:47:15.5982043Z  2025-03-14T06:47:15.5982465Z  2025-03-14T06:47:15.5982874Z  2025-03-14T06:47:15.5983287Z  2025-03-14T06:47:15.5983972Z  2025-03-14T06:47:15.5984383Z  2025-03-14T06:47:15.5984788Z  2025-03-14T06:47:15.5985766Z [20,331 / 20,653] 6 / 17 tests; 48 actions, 45 running; last test: ...ent_test 2025-03-14T06:47:15.5986763Z Compiling torch_xla/csrc/ops/ops.cpp; 36s local 2025-03-14T06:47:15.5987613Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2025-03-14T06:47:15.5988506Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2025-03-14T06:47:15.5989793Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local 2025-03-14T06:47:15.5990804Z Compiling torch_xla/csrc/ops/multinomial.cpp; 28s local 2025-03-14T06:47:15.5991744Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 28s local 2025-03-14T06:47:15.5992616Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 28s local 2025-03-14T06:47:15.5993455Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 27s local ... 2025-03-14T06:47:15.9984231Z 2025-03-14T06:47:15.9985064Z  2025-03-14T06:47:15.9985544Z  2025-03-14T06:47:15.9985973Z  2025-03-14T06:47:15.9986404Z  2025-03-14T06:47:15.9986814Z  2025-03-14T06:47:15.9987230Z  2025-03-14T06:47:15.9987640Z  2025-03-14T06:47:15.9988048Z  2025-03-14T06:47:15.9988991Z [20,331 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:15.9989982Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2025-03-14T06:47:15.9990816Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 31s local 2025-03-14T06:47:15.9991724Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2025-03-14T06:47:15.9992810Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local 2025-03-14T06:47:15.9993763Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local 2025-03-14T06:47:15.9994641Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 28s local 2025-03-14T06:47:15.9995574Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 28s local 2025-03-14T06:47:15.9996593Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 28s local ... 2025-03-14T06:47:16.6893006Z 2025-03-14T06:47:16.6893802Z  2025-03-14T06:47:16.6894234Z  2025-03-14T06:47:16.6894624Z  2025-03-14T06:47:16.6895011Z  2025-03-14T06:47:16.6895381Z  2025-03-14T06:47:16.6895752Z  2025-03-14T06:47:16.6896141Z  2025-03-14T06:47:16.6896516Z  2025-03-14T06:47:16.6897730Z [20,332 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:16.6898604Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2025-03-14T06:47:16.6899417Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2025-03-14T06:47:16.6900496Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2025-03-14T06:47:16.6901384Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local 2025-03-14T06:47:16.6902291Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 29s local 2025-03-14T06:47:16.6903319Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 29s local 2025-03-14T06:47:16.6904034Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 28s local 2025-03-14T06:47:16.6904780Z Compiling torch_xla/csrc/ops/mean.cpp; 28s local ... 2025-03-14T06:47:16.9993196Z 2025-03-14T06:47:16.9994054Z  2025-03-14T06:47:16.9994516Z  2025-03-14T06:47:16.9994922Z  2025-03-14T06:47:16.9995348Z  2025-03-14T06:47:16.9995725Z  2025-03-14T06:47:16.9996128Z  2025-03-14T06:47:17.0006434Z  2025-03-14T06:47:17.0007227Z  2025-03-14T06:47:17.0008189Z [20,332 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:17.0009176Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2025-03-14T06:47:17.0010096Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2025-03-14T06:47:17.0011133Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2025-03-14T06:47:17.0012406Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T06:47:17.0013256Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 29s local 2025-03-14T06:47:17.0014107Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 29s local 2025-03-14T06:47:17.0014920Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 29s local 2025-03-14T06:47:17.0015745Z Compiling torch_xla/csrc/ops/mean.cpp; 28s local ... 2025-03-14T06:47:17.3997006Z 2025-03-14T06:47:17.3997844Z  2025-03-14T06:47:17.3998360Z  2025-03-14T06:47:17.3998786Z  2025-03-14T06:47:17.3999175Z  2025-03-14T06:47:17.3999591Z  2025-03-14T06:47:17.4000003Z  2025-03-14T06:47:17.4000425Z  2025-03-14T06:47:17.4000827Z  2025-03-14T06:47:17.4001789Z [20,333 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:17.4002768Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2025-03-14T06:47:17.4003666Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 31s local 2025-03-14T06:47:17.4004762Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T06:47:17.4005641Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2025-03-14T06:47:17.4006500Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 29s local 2025-03-14T06:47:17.4007313Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 29s local 2025-03-14T06:47:17.4008129Z Compiling torch_xla/csrc/ops/mean.cpp; 28s local 2025-03-14T06:47:17.4008973Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 27s local ... 2025-03-14T06:47:17.8001326Z 2025-03-14T06:47:17.8002212Z  2025-03-14T06:47:17.8002741Z  2025-03-14T06:47:17.8003176Z  2025-03-14T06:47:17.8003582Z  2025-03-14T06:47:17.8004028Z  2025-03-14T06:47:17.8004459Z  2025-03-14T06:47:17.8005057Z  2025-03-14T06:47:17.8005428Z  2025-03-14T06:47:17.8006310Z [20,334 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:17.8007273Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2025-03-14T06:47:17.8008024Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T06:47:17.8008950Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2025-03-14T06:47:17.8009786Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2025-03-14T06:47:17.8010516Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 29s local 2025-03-14T06:47:17.8011678Z Compiling torch_xla/csrc/ops/mean.cpp; 29s local 2025-03-14T06:47:17.8012514Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 27s local 2025-03-14T06:47:17.8013502Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 26s local ... 2025-03-14T06:47:18.8775774Z 2025-03-14T06:47:18.8776592Z  2025-03-14T06:47:18.8777080Z  2025-03-14T06:47:18.8777490Z  2025-03-14T06:47:18.8777908Z  2025-03-14T06:47:18.8778356Z  2025-03-14T06:47:18.8778760Z  2025-03-14T06:47:18.8779333Z  2025-03-14T06:47:18.8779993Z  2025-03-14T06:47:18.8780937Z [20,335 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:18.8781893Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2025-03-14T06:47:18.8782651Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2025-03-14T06:47:18.8783459Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 31s local 2025-03-14T06:47:18.8784273Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2025-03-14T06:47:18.8785031Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2025-03-14T06:47:18.8785818Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 28s local 2025-03-14T06:47:18.8786720Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 27s local 2025-03-14T06:47:18.8787644Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 27s local ... 2025-03-14T06:47:19.0990843Z 2025-03-14T06:47:19.0991998Z  2025-03-14T06:47:19.0992482Z  2025-03-14T06:47:19.0992902Z  2025-03-14T06:47:19.0993324Z  2025-03-14T06:47:19.0993746Z  2025-03-14T06:47:19.0994153Z  2025-03-14T06:47:19.0994545Z  2025-03-14T06:47:19.0994949Z  2025-03-14T06:47:19.0995898Z [20,337 / 20,653] 6 / 17 tests; 48 actions, 46 running; last test: ...ent_test 2025-03-14T06:47:19.0996897Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2025-03-14T06:47:19.0997870Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 31s local 2025-03-14T06:47:19.0998620Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2025-03-14T06:47:19.0999262Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 28s local 2025-03-14T06:47:19.0999934Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 28s local 2025-03-14T06:47:19.1000708Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 27s local 2025-03-14T06:47:19.1001510Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 27s local 2025-03-14T06:47:19.1002463Z Compiling torch_xla/csrc/ops/masked_select.cpp; 26s local ... 2025-03-14T06:47:19.3240085Z 2025-03-14T06:47:19.3240857Z  2025-03-14T06:47:19.3241272Z  2025-03-14T06:47:19.3241631Z  2025-03-14T06:47:19.3241987Z  2025-03-14T06:47:19.3242333Z  2025-03-14T06:47:19.3242675Z  2025-03-14T06:47:19.3243026Z  2025-03-14T06:47:19.3243353Z  2025-03-14T06:47:19.3244154Z [20,338 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:19.3245120Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2025-03-14T06:47:19.3245762Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2025-03-14T06:47:19.3246456Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 28s local 2025-03-14T06:47:19.3247222Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 28s local 2025-03-14T06:47:19.3248002Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 27s local 2025-03-14T06:47:19.3248727Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 27s local 2025-03-14T06:47:19.3249444Z Compiling torch_xla/csrc/ops/masked_select.cpp; 27s local 2025-03-14T06:47:19.3250244Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 26s local ... 2025-03-14T06:47:19.6013083Z 2025-03-14T06:47:19.6013861Z  2025-03-14T06:47:19.6014275Z  2025-03-14T06:47:19.6014648Z  2025-03-14T06:47:19.6015018Z  2025-03-14T06:47:19.6015406Z  2025-03-14T06:47:19.6015817Z  2025-03-14T06:47:19.6016197Z  2025-03-14T06:47:19.6016807Z  2025-03-14T06:47:19.6017658Z [20,338 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:19.6018502Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2025-03-14T06:47:19.6019102Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2025-03-14T06:47:19.6019782Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 29s local 2025-03-14T06:47:19.6020625Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 28s local 2025-03-14T06:47:19.6021646Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 27s local 2025-03-14T06:47:19.6022715Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 27s local 2025-03-14T06:47:19.6023443Z Compiling torch_xla/csrc/ops/masked_select.cpp; 27s local 2025-03-14T06:47:19.6024200Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 27s local ... 2025-03-14T06:47:20.6020537Z 2025-03-14T06:47:20.6021348Z  2025-03-14T06:47:20.6021853Z  2025-03-14T06:47:20.6022246Z  2025-03-14T06:47:20.6022655Z  2025-03-14T06:47:20.6023052Z  2025-03-14T06:47:20.6023445Z  2025-03-14T06:47:20.6023834Z  2025-03-14T06:47:20.6024213Z  2025-03-14T06:47:20.6025150Z [20,338 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:20.6026156Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2025-03-14T06:47:20.6027001Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2025-03-14T06:47:20.6028106Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2025-03-14T06:47:20.6029183Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 29s local 2025-03-14T06:47:20.6030144Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 28s local 2025-03-14T06:47:20.6031009Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 28s local 2025-03-14T06:47:20.6031780Z Compiling torch_xla/csrc/ops/masked_select.cpp; 28s local 2025-03-14T06:47:20.6032836Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 28s local ... 2025-03-14T06:47:21.8029378Z 2025-03-14T06:47:21.8030250Z  2025-03-14T06:47:21.8030719Z  2025-03-14T06:47:21.8031141Z  2025-03-14T06:47:21.8031549Z  2025-03-14T06:47:21.8031928Z  2025-03-14T06:47:21.8032307Z  2025-03-14T06:47:21.8032680Z  2025-03-14T06:47:21.8033067Z  2025-03-14T06:47:21.8033975Z [20,338 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:21.8034985Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2025-03-14T06:47:21.8035706Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2025-03-14T06:47:21.8036481Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2025-03-14T06:47:21.8037396Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local 2025-03-14T06:47:21.8038311Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2025-03-14T06:47:21.8039090Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local 2025-03-14T06:47:21.8039911Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local 2025-03-14T06:47:21.8040809Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 29s local ... 2025-03-14T06:47:22.8037582Z 2025-03-14T06:47:22.8038456Z  2025-03-14T06:47:22.8038959Z  2025-03-14T06:47:22.8039380Z  2025-03-14T06:47:22.8039798Z  2025-03-14T06:47:22.8040189Z  2025-03-14T06:47:22.8040586Z  2025-03-14T06:47:22.8041023Z  2025-03-14T06:47:22.8041405Z  2025-03-14T06:47:22.8042311Z [20,338 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:22.8043295Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2025-03-14T06:47:22.8044025Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T06:47:22.8044990Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2025-03-14T06:47:22.8045929Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 31s local 2025-03-14T06:47:22.8047196Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 31s local 2025-03-14T06:47:22.8048038Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2025-03-14T06:47:22.8048906Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2025-03-14T06:47:22.8049798Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local ... 2025-03-14T06:47:23.0969948Z 2025-03-14T06:47:23.0970844Z  2025-03-14T06:47:23.0971356Z  2025-03-14T06:47:23.0971752Z  2025-03-14T06:47:23.0972142Z  2025-03-14T06:47:23.0972566Z  2025-03-14T06:47:23.0973264Z  2025-03-14T06:47:23.0973691Z  2025-03-14T06:47:23.0974063Z  2025-03-14T06:47:23.0975270Z [20,339 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:23.0976242Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2025-03-14T06:47:23.0976931Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T06:47:23.0977627Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2025-03-14T06:47:23.0978358Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 31s local 2025-03-14T06:47:23.0979153Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 31s local 2025-03-14T06:47:23.0979949Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2025-03-14T06:47:23.0980806Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 30s local 2025-03-14T06:47:23.0981573Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local ... 2025-03-14T06:47:23.4044017Z 2025-03-14T06:47:23.4044991Z  2025-03-14T06:47:23.4045525Z  2025-03-14T06:47:23.4045933Z  2025-03-14T06:47:23.4046329Z  2025-03-14T06:47:23.4046705Z  2025-03-14T06:47:23.4047084Z  2025-03-14T06:47:23.4047499Z  2025-03-14T06:47:23.4047881Z  2025-03-14T06:47:23.4048799Z [20,340 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:47:23.4050080Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2025-03-14T06:47:23.4050802Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T06:47:23.4051575Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2025-03-14T06:47:23.4052410Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 31s local 2025-03-14T06:47:23.4053253Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2025-03-14T06:47:23.4054135Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 31s local 2025-03-14T06:47:23.4055044Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local 2025-03-14T06:47:23.4055929Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local ... 2025-03-14T06:47:23.7945920Z 2025-03-14T06:47:23.7946818Z  2025-03-14T06:47:23.7947303Z  2025-03-14T06:47:23.7947696Z  2025-03-14T06:47:23.7948095Z  2025-03-14T06:47:23.7948486Z  2025-03-14T06:47:23.7948884Z  2025-03-14T06:47:23.7949259Z  2025-03-14T06:47:23.7949690Z  2025-03-14T06:47:23.7950646Z [20,341 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:23.7951616Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2025-03-14T06:47:23.7952356Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2025-03-14T06:47:23.7953159Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2025-03-14T06:47:23.7954016Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 31s local 2025-03-14T06:47:23.7954859Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2025-03-14T06:47:23.7955686Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 31s local 2025-03-14T06:47:23.7956488Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local 2025-03-14T06:47:23.7957401Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 29s local ... 2025-03-14T06:47:24.0049544Z 2025-03-14T06:47:24.0050365Z  2025-03-14T06:47:24.0050857Z  2025-03-14T06:47:24.0051236Z  2025-03-14T06:47:24.0051662Z  2025-03-14T06:47:24.0052030Z  2025-03-14T06:47:24.0052719Z  2025-03-14T06:47:24.0053144Z  2025-03-14T06:47:24.0053516Z  2025-03-14T06:47:24.0054487Z [20,341 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:24.0055427Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2025-03-14T06:47:24.0056144Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2025-03-14T06:47:24.0056913Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2025-03-14T06:47:24.0057824Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 31s local 2025-03-14T06:47:24.0058684Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2025-03-14T06:47:24.0059507Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 31s local 2025-03-14T06:47:24.0060325Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local 2025-03-14T06:47:24.0061213Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 29s local ... 2025-03-14T06:47:24.4052848Z 2025-03-14T06:47:24.4053714Z  2025-03-14T06:47:24.4054164Z  2025-03-14T06:47:24.4054551Z  2025-03-14T06:47:24.4054910Z  2025-03-14T06:47:24.4055244Z  2025-03-14T06:47:24.4055595Z  2025-03-14T06:47:24.4055961Z  2025-03-14T06:47:24.4056340Z  2025-03-14T06:47:24.4057245Z [20,343 / 20,653] 6 / 17 tests; 46 actions running; last test: ..._client_test 2025-03-14T06:47:24.4058181Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2025-03-14T06:47:24.4059235Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T06:47:24.4060023Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 32s local 2025-03-14T06:47:24.4060830Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2025-03-14T06:47:24.4061592Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2025-03-14T06:47:24.4062366Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 29s local 2025-03-14T06:47:24.4063331Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 29s local 2025-03-14T06:47:24.4064094Z Compiling torch_xla/csrc/ops/linspace.cpp; 28s local ... 2025-03-14T06:47:24.8057013Z 2025-03-14T06:47:24.8057839Z  2025-03-14T06:47:24.8058267Z  2025-03-14T06:47:24.8058617Z  2025-03-14T06:47:24.8058949Z  2025-03-14T06:47:24.8059314Z  2025-03-14T06:47:24.8059673Z  2025-03-14T06:47:24.8060026Z  2025-03-14T06:47:24.8060387Z  2025-03-14T06:47:24.8061228Z [20,343 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:24.8062154Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2025-03-14T06:47:24.8062932Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T06:47:24.8063711Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 32s local 2025-03-14T06:47:24.8064473Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2025-03-14T06:47:24.8065233Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2025-03-14T06:47:24.8066317Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2025-03-14T06:47:24.8067133Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2025-03-14T06:47:24.8067907Z Compiling torch_xla/csrc/ops/linspace.cpp; 28s local ... 2025-03-14T06:47:25.1218154Z 2025-03-14T06:47:25.1218959Z  2025-03-14T06:47:25.1219344Z  2025-03-14T06:47:25.1219656Z  2025-03-14T06:47:25.1219971Z  2025-03-14T06:47:25.1220284Z  2025-03-14T06:47:25.1220611Z  2025-03-14T06:47:25.1220925Z  2025-03-14T06:47:25.1221231Z  2025-03-14T06:47:25.1221983Z [20,344 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:25.1222732Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2025-03-14T06:47:25.1223333Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 33s local 2025-03-14T06:47:25.1223968Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2025-03-14T06:47:25.1224901Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2025-03-14T06:47:25.1225584Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2025-03-14T06:47:25.1226265Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2025-03-14T06:47:25.1226879Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2025-03-14T06:47:25.1227566Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local ... 2025-03-14T06:47:25.4062376Z 2025-03-14T06:47:25.4063239Z  2025-03-14T06:47:25.4063670Z  2025-03-14T06:47:25.4064072Z  2025-03-14T06:47:25.4064720Z  2025-03-14T06:47:25.4065087Z  2025-03-14T06:47:25.4065708Z  2025-03-14T06:47:25.4066075Z  2025-03-14T06:47:25.4066445Z  2025-03-14T06:47:25.4067332Z [20,344 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:25.4068246Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2025-03-14T06:47:25.4069021Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 33s local 2025-03-14T06:47:25.4069844Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2025-03-14T06:47:25.4070670Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2025-03-14T06:47:25.4075995Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local 2025-03-14T06:47:25.4076939Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2025-03-14T06:47:25.4077754Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2025-03-14T06:47:25.4078733Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local ... 2025-03-14T06:47:25.6334966Z 2025-03-14T06:47:25.6335813Z  2025-03-14T06:47:25.6336317Z  2025-03-14T06:47:25.6336787Z  2025-03-14T06:47:25.6337268Z  2025-03-14T06:47:25.6337747Z  2025-03-14T06:47:25.6338218Z  2025-03-14T06:47:25.6338593Z  2025-03-14T06:47:25.6339084Z  2025-03-14T06:47:25.6340192Z [20,345 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:25.6341079Z Compiling torch_xla/csrc/ops/mean.cpp; 37s local 2025-03-14T06:47:25.6341797Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2025-03-14T06:47:25.6342526Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2025-03-14T06:47:25.6343410Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2025-03-14T06:47:25.6344239Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2025-03-14T06:47:25.6345172Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2025-03-14T06:47:25.6346022Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local 2025-03-14T06:47:25.6346886Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local ... 2025-03-14T06:47:26.0067743Z 2025-03-14T06:47:26.0068530Z  2025-03-14T06:47:26.0068997Z  2025-03-14T06:47:26.0069395Z  2025-03-14T06:47:26.0069804Z  2025-03-14T06:47:26.0070198Z  2025-03-14T06:47:26.0070591Z  2025-03-14T06:47:26.0070969Z  2025-03-14T06:47:26.0071379Z  2025-03-14T06:47:26.0072282Z [20,345 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:26.0073264Z Compiling torch_xla/csrc/ops/mean.cpp; 37s local 2025-03-14T06:47:26.0074083Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2025-03-14T06:47:26.0074917Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2025-03-14T06:47:26.0075780Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2025-03-14T06:47:26.0076673Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2025-03-14T06:47:26.0077460Z Compiling torch_xla/csrc/ops/linspace.cpp; 29s local 2025-03-14T06:47:26.0078527Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 28s local 2025-03-14T06:47:26.0079443Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local ... 2025-03-14T06:47:26.2071100Z 2025-03-14T06:47:26.2071964Z  2025-03-14T06:47:26.2072443Z  2025-03-14T06:47:26.2072852Z  2025-03-14T06:47:26.2073532Z  2025-03-14T06:47:26.2073933Z  2025-03-14T06:47:26.2074326Z  2025-03-14T06:47:26.2074704Z  2025-03-14T06:47:26.2075080Z  2025-03-14T06:47:26.2075999Z [20,347 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:26.2076962Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2025-03-14T06:47:26.2077783Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2025-03-14T06:47:26.2078790Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2025-03-14T06:47:26.2079618Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2025-03-14T06:47:26.2080494Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local 2025-03-14T06:47:26.2081362Z Compiling torch_xla/csrc/ops/kth_value.cpp; 28s local 2025-03-14T06:47:26.2082153Z Compiling torch_xla/csrc/ops/index_select.cpp; 28s local 2025-03-14T06:47:26.2082974Z Compiling torch_xla/csrc/ops/index_put.cpp; 27s local ... 2025-03-14T06:47:26.6072235Z 2025-03-14T06:47:26.6073084Z  2025-03-14T06:47:26.6073505Z  2025-03-14T06:47:26.6073861Z  2025-03-14T06:47:26.6074213Z  2025-03-14T06:47:26.6074894Z  2025-03-14T06:47:26.6075226Z  2025-03-14T06:47:26.6075558Z  2025-03-14T06:47:26.6075882Z  2025-03-14T06:47:26.6076648Z [20,347 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:26.6077950Z Compiling torch_xla/csrc/ops/masked_select.cpp; 34s local 2025-03-14T06:47:26.6078729Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2025-03-14T06:47:26.6079591Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2025-03-14T06:47:26.6080471Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2025-03-14T06:47:26.6081362Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 29s local 2025-03-14T06:47:26.6082274Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2025-03-14T06:47:26.6083150Z Compiling torch_xla/csrc/ops/index_select.cpp; 28s local 2025-03-14T06:47:26.6083983Z Compiling torch_xla/csrc/ops/index_put.cpp; 28s local ... 2025-03-14T06:47:27.0766618Z 2025-03-14T06:47:27.0767452Z  2025-03-14T06:47:27.0767896Z  2025-03-14T06:47:27.0768244Z  2025-03-14T06:47:27.0768809Z  2025-03-14T06:47:27.0769239Z  2025-03-14T06:47:27.0769696Z  2025-03-14T06:47:27.0770192Z  2025-03-14T06:47:27.0770659Z  2025-03-14T06:47:27.0771650Z [20,348 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:27.0772672Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2025-03-14T06:47:27.0773514Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2025-03-14T06:47:27.0774337Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local 2025-03-14T06:47:27.0775316Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2025-03-14T06:47:27.0776259Z Compiling torch_xla/csrc/ops/kth_value.cpp; 29s local 2025-03-14T06:47:27.0777111Z Compiling torch_xla/csrc/ops/index_select.cpp; 29s local 2025-03-14T06:47:27.0777994Z Compiling torch_xla/csrc/ops/index_put.cpp; 28s local 2025-03-14T06:47:27.0779043Z Compiling torch_xla/csrc/ops/index_ops.cpp; 28s local ... 2025-03-14T06:47:27.4078215Z 2025-03-14T06:47:27.4079097Z  2025-03-14T06:47:27.4079559Z  2025-03-14T06:47:27.4080036Z  2025-03-14T06:47:27.4080432Z  2025-03-14T06:47:27.4080846Z  2025-03-14T06:47:27.4081255Z  2025-03-14T06:47:27.4081629Z  2025-03-14T06:47:27.4082001Z  2025-03-14T06:47:27.4082906Z [20,348 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:27.4084042Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T06:47:27.4085044Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2025-03-14T06:47:27.4086173Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2025-03-14T06:47:27.4087142Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2025-03-14T06:47:27.4087986Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2025-03-14T06:47:27.4089327Z Compiling torch_xla/csrc/ops/index_select.cpp; 29s local 2025-03-14T06:47:27.4090349Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local 2025-03-14T06:47:27.4091396Z Compiling torch_xla/csrc/ops/index_ops.cpp; 29s local ... 2025-03-14T06:47:27.6263431Z 2025-03-14T06:47:27.6264587Z  2025-03-14T06:47:27.6265164Z  2025-03-14T06:47:27.6265794Z  2025-03-14T06:47:27.6266199Z  2025-03-14T06:47:27.6266607Z  2025-03-14T06:47:27.6267010Z  2025-03-14T06:47:27.6267412Z  2025-03-14T06:47:27.6267799Z  2025-03-14T06:47:27.6268731Z [20,349 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:27.6269712Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T06:47:27.6270450Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2025-03-14T06:47:27.6271330Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2025-03-14T06:47:27.6274457Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2025-03-14T06:47:27.6275223Z Compiling torch_xla/csrc/ops/index_select.cpp; 29s local 2025-03-14T06:47:27.6276039Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local 2025-03-14T06:47:27.6276978Z Compiling torch_xla/csrc/ops/index_ops.cpp; 29s local 2025-03-14T06:47:27.6277790Z Compiling torch_xla/csrc/ops/index_get.cpp; 29s local ... 2025-03-14T06:47:28.0082993Z 2025-03-14T06:47:28.0083857Z  2025-03-14T06:47:28.0084340Z  2025-03-14T06:47:28.0084959Z  2025-03-14T06:47:28.0085362Z  2025-03-14T06:47:28.0085755Z  2025-03-14T06:47:28.0086166Z  2025-03-14T06:47:28.0086563Z  2025-03-14T06:47:28.0086942Z  2025-03-14T06:47:28.0087943Z [20,349 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:28.0088954Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T06:47:28.0089772Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2025-03-14T06:47:28.0090667Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local 2025-03-14T06:47:28.0091525Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2025-03-14T06:47:28.0092362Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2025-03-14T06:47:28.0093162Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local 2025-03-14T06:47:28.0093935Z Compiling torch_xla/csrc/ops/index_ops.cpp; 29s local 2025-03-14T06:47:28.0094720Z Compiling torch_xla/csrc/ops/index_get.cpp; 29s local ... 2025-03-14T06:47:28.3495554Z 2025-03-14T06:47:28.3496408Z  2025-03-14T06:47:28.3496851Z  2025-03-14T06:47:28.3497229Z  2025-03-14T06:47:28.3497576Z  2025-03-14T06:47:28.3497988Z  2025-03-14T06:47:28.3498353Z  2025-03-14T06:47:28.3498712Z  2025-03-14T06:47:28.3499062Z  2025-03-14T06:47:28.3499928Z [20,350 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:28.3500856Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2025-03-14T06:47:28.3501605Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2025-03-14T06:47:28.3502328Z Compiling torch_xla/csrc/ops/kth_value.cpp; 31s local 2025-03-14T06:47:28.3503062Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2025-03-14T06:47:28.3503812Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2025-03-14T06:47:28.3504525Z Compiling torch_xla/csrc/ops/index_ops.cpp; 29s local 2025-03-14T06:47:28.3505218Z Compiling torch_xla/csrc/ops/index_get.cpp; 29s local 2025-03-14T06:47:28.3505979Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 29s local ... 2025-03-14T06:47:28.6088103Z 2025-03-14T06:47:28.6089281Z  2025-03-14T06:47:28.6089727Z  2025-03-14T06:47:28.6090076Z  2025-03-14T06:47:28.6090391Z  2025-03-14T06:47:28.6090767Z  2025-03-14T06:47:28.6091130Z  2025-03-14T06:47:28.6091491Z  2025-03-14T06:47:28.6091826Z  2025-03-14T06:47:28.6092651Z [20,350 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:28.6093547Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2025-03-14T06:47:28.6094429Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2025-03-14T06:47:28.6095145Z Compiling torch_xla/csrc/ops/kth_value.cpp; 31s local 2025-03-14T06:47:28.6095897Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2025-03-14T06:47:28.6096593Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2025-03-14T06:47:28.6097261Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2025-03-14T06:47:28.6097940Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2025-03-14T06:47:28.6098700Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 29s local ... 2025-03-14T06:47:29.1914531Z 2025-03-14T06:47:29.1915418Z  2025-03-14T06:47:29.1915886Z  2025-03-14T06:47:29.1916673Z  2025-03-14T06:47:29.1917104Z  2025-03-14T06:47:29.1917501Z  2025-03-14T06:47:29.1917913Z  2025-03-14T06:47:29.1918316Z  2025-03-14T06:47:29.1918713Z  2025-03-14T06:47:29.1919814Z [20,351 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:29.1920840Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2025-03-14T06:47:29.1921695Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2025-03-14T06:47:29.1922586Z Compiling torch_xla/csrc/ops/index_select.cpp; 31s local 2025-03-14T06:47:29.1923414Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2025-03-14T06:47:29.1924149Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2025-03-14T06:47:29.1925044Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2025-03-14T06:47:29.1925837Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2025-03-14T06:47:29.1926767Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 29s local ... 2025-03-14T06:47:29.4094878Z 2025-03-14T06:47:29.4095751Z  2025-03-14T06:47:29.4096274Z  2025-03-14T06:47:29.4096674Z  2025-03-14T06:47:29.4097078Z  2025-03-14T06:47:29.4097406Z  2025-03-14T06:47:29.4097803Z  2025-03-14T06:47:29.4098173Z  2025-03-14T06:47:29.4098583Z  2025-03-14T06:47:29.4099483Z [20,352 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:29.4100523Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2025-03-14T06:47:29.4101324Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2025-03-14T06:47:29.4102095Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2025-03-14T06:47:29.4102891Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2025-03-14T06:47:29.4103675Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2025-03-14T06:47:29.4104508Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2025-03-14T06:47:29.4105438Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2025-03-14T06:47:29.4106369Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 28s local ... 2025-03-14T06:47:29.8099281Z 2025-03-14T06:47:29.8100156Z  2025-03-14T06:47:29.8100655Z  2025-03-14T06:47:29.8101077Z  2025-03-14T06:47:29.8101482Z  2025-03-14T06:47:29.8101882Z  2025-03-14T06:47:29.8102285Z  2025-03-14T06:47:29.8102708Z  2025-03-14T06:47:29.8103125Z  2025-03-14T06:47:29.8104102Z [20,352 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:29.8105278Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2025-03-14T06:47:29.8106595Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2025-03-14T06:47:29.8107377Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2025-03-14T06:47:29.8108155Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2025-03-14T06:47:29.8108942Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2025-03-14T06:47:29.8109814Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local 2025-03-14T06:47:29.8110747Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local 2025-03-14T06:47:29.8111860Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local ... 2025-03-14T06:47:30.4103243Z 2025-03-14T06:47:30.4104150Z  2025-03-14T06:47:30.4104655Z  2025-03-14T06:47:30.4105070Z  2025-03-14T06:47:30.4105498Z  2025-03-14T06:47:30.4105909Z  2025-03-14T06:47:30.4106292Z  2025-03-14T06:47:30.4106673Z  2025-03-14T06:47:30.4107071Z  2025-03-14T06:47:30.4108045Z [20,353 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:47:30.4109012Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 37s local 2025-03-14T06:47:30.4109821Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2025-03-14T06:47:30.4111007Z Compiling torch_xla/csrc/ops/index_put.cpp; 32s local 2025-03-14T06:47:30.4111682Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T06:47:30.4112465Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2025-03-14T06:47:30.4113348Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2025-03-14T06:47:30.4114058Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 29s local 2025-03-14T06:47:30.4114774Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local ... 2025-03-14T06:47:30.6441347Z 2025-03-14T06:47:30.6442221Z  2025-03-14T06:47:30.6442742Z  2025-03-14T06:47:30.6443162Z  2025-03-14T06:47:30.6443611Z  2025-03-14T06:47:30.6444048Z  2025-03-14T06:47:30.6444631Z  2025-03-14T06:47:30.6445063Z  2025-03-14T06:47:30.6445475Z  2025-03-14T06:47:30.6446413Z [20,354 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:30.6447481Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2025-03-14T06:47:30.6448355Z Compiling torch_xla/csrc/ops/index_put.cpp; 32s local 2025-03-14T06:47:30.6449192Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T06:47:30.6450103Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2025-03-14T06:47:30.6451054Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2025-03-14T06:47:30.6452010Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2025-03-14T06:47:30.6452947Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2025-03-14T06:47:30.6453821Z Compiling torch_xla/csrc/ops/generic.cpp; 29s local ... 2025-03-14T06:47:30.8698093Z 2025-03-14T06:47:30.8698923Z  2025-03-14T06:47:30.8699447Z  2025-03-14T06:47:30.8699850Z  2025-03-14T06:47:30.8700271Z  2025-03-14T06:47:30.8700649Z  2025-03-14T06:47:30.8701035Z  2025-03-14T06:47:30.8701421Z  2025-03-14T06:47:30.8701828Z  2025-03-14T06:47:30.8702838Z [20,355 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:30.8703805Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2025-03-14T06:47:30.8704560Z Compiling torch_xla/csrc/ops/index_put.cpp; 32s local 2025-03-14T06:47:30.8705313Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T06:47:30.8706140Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2025-03-14T06:47:30.8707055Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2025-03-14T06:47:30.8707956Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2025-03-14T06:47:30.8708734Z Compiling torch_xla/csrc/ops/generic.cpp; 29s local 2025-03-14T06:47:30.8709835Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local ... 2025-03-14T06:47:31.2109113Z 2025-03-14T06:47:31.2109950Z  2025-03-14T06:47:31.2110387Z  2025-03-14T06:47:31.2110795Z  2025-03-14T06:47:31.2111184Z  2025-03-14T06:47:31.2111548Z  2025-03-14T06:47:31.2111949Z  2025-03-14T06:47:31.2112339Z  2025-03-14T06:47:31.2112715Z  2025-03-14T06:47:31.2113636Z [20,356 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:31.2114930Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2025-03-14T06:47:31.2115667Z Compiling torch_xla/csrc/ops/index_put.cpp; 32s local 2025-03-14T06:47:31.2116416Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T06:47:31.2117263Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 30s local 2025-03-14T06:47:31.2118122Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2025-03-14T06:47:31.2118935Z Compiling torch_xla/csrc/ops/generic.cpp; 29s local 2025-03-14T06:47:31.2119677Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local 2025-03-14T06:47:31.2120417Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local ... 2025-03-14T06:47:31.4922243Z 2025-03-14T06:47:31.4923066Z  2025-03-14T06:47:31.4923507Z  2025-03-14T06:47:31.4923871Z  2025-03-14T06:47:31.4924251Z  2025-03-14T06:47:31.4925037Z  2025-03-14T06:47:31.4925421Z  2025-03-14T06:47:31.4925784Z  2025-03-14T06:47:31.4926150Z  2025-03-14T06:47:31.4927011Z [20,357 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:31.4928106Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 36s local 2025-03-14T06:47:31.4928808Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T06:47:31.4929551Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2025-03-14T06:47:31.4930352Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2025-03-14T06:47:31.4931086Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2025-03-14T06:47:31.4931716Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local 2025-03-14T06:47:31.4932518Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local 2025-03-14T06:47:31.4933244Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local ... 2025-03-14T06:47:31.8114633Z 2025-03-14T06:47:31.8115542Z  2025-03-14T06:47:31.8116065Z  2025-03-14T06:47:31.8116380Z  2025-03-14T06:47:31.8116698Z  2025-03-14T06:47:31.8117004Z  2025-03-14T06:47:31.8117328Z  2025-03-14T06:47:31.8117646Z  2025-03-14T06:47:31.8118006Z  2025-03-14T06:47:31.8119037Z [20,357 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:31.8119986Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 37s local 2025-03-14T06:47:31.8120770Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T06:47:31.8121574Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2025-03-14T06:47:31.8122451Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2025-03-14T06:47:31.8123268Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2025-03-14T06:47:31.8123980Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2025-03-14T06:47:31.8124841Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2025-03-14T06:47:31.8125645Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local ... 2025-03-14T06:47:32.2119576Z 2025-03-14T06:47:32.2120451Z  2025-03-14T06:47:32.2120911Z  2025-03-14T06:47:32.2121300Z  2025-03-14T06:47:32.2121677Z  2025-03-14T06:47:32.2122069Z  2025-03-14T06:47:32.2122455Z  2025-03-14T06:47:32.2122826Z  2025-03-14T06:47:32.2123205Z  2025-03-14T06:47:32.2124113Z [20,358 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:32.2125573Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T06:47:32.2126350Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2025-03-14T06:47:32.2127159Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2025-03-14T06:47:32.2128014Z Compiling torch_xla/csrc/ops/generic.cpp; 30s local 2025-03-14T06:47:32.2128734Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2025-03-14T06:47:32.2129486Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2025-03-14T06:47:32.2130402Z Compiling torch_xla/csrc/ops/exponential.cpp; 29s local 2025-03-14T06:47:32.2131228Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 27s local ... 2025-03-14T06:47:32.8914179Z 2025-03-14T06:47:32.8915044Z  2025-03-14T06:47:32.8915571Z  2025-03-14T06:47:32.8915970Z  2025-03-14T06:47:32.8916391Z  2025-03-14T06:47:32.8916785Z  2025-03-14T06:47:32.8917169Z  2025-03-14T06:47:32.8917538Z  2025-03-14T06:47:32.8917952Z  2025-03-14T06:47:32.8918919Z [20,359 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:32.8919944Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2025-03-14T06:47:32.8921179Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T06:47:32.8922081Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2025-03-14T06:47:32.8923103Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2025-03-14T06:47:32.8923881Z Compiling torch_xla/csrc/ops/flip.cpp; 31s local 2025-03-14T06:47:32.8924782Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2025-03-14T06:47:32.8925593Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 28s local 2025-03-14T06:47:32.8926368Z Compiling torch_xla/csrc/ops/expand.cpp; 26s local ... 2025-03-14T06:47:33.2126456Z 2025-03-14T06:47:33.2127303Z  2025-03-14T06:47:33.2127795Z  2025-03-14T06:47:33.2128180Z  2025-03-14T06:47:33.2128582Z  2025-03-14T06:47:33.2129013Z  2025-03-14T06:47:33.2129394Z  2025-03-14T06:47:33.2129766Z  2025-03-14T06:47:33.2130159Z  2025-03-14T06:47:33.2131089Z [20,360 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:47:33.2132318Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2025-03-14T06:47:33.2133163Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T06:47:33.2133992Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T06:47:33.2134587Z Compiling torch_xla/csrc/ops/flip.cpp; 31s local 2025-03-14T06:47:33.2150542Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2025-03-14T06:47:33.2151719Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 28s local 2025-03-14T06:47:33.2152387Z Compiling torch_xla/csrc/ops/expand.cpp; 26s local 2025-03-14T06:47:33.4130519Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 26s local ... 2025-03-14T06:47:33.4131158Z 2025-03-14T06:47:33.4131610Z  2025-03-14T06:47:33.4132134Z  2025-03-14T06:47:33.4132519Z  2025-03-14T06:47:33.4132908Z  2025-03-14T06:47:33.4133313Z  2025-03-14T06:47:33.4133736Z  2025-03-14T06:47:33.4134088Z  2025-03-14T06:47:33.4134493Z  2025-03-14T06:47:33.4135410Z [20,360 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:33.4136432Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2025-03-14T06:47:33.4137346Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T06:47:33.4138255Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T06:47:33.4139063Z Compiling torch_xla/csrc/ops/flip.cpp; 31s local 2025-03-14T06:47:33.4139892Z Compiling torch_xla/csrc/ops/exponential.cpp; 31s local 2025-03-14T06:47:33.4140777Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2025-03-14T06:47:33.4141874Z Compiling torch_xla/csrc/ops/expand.cpp; 26s local 2025-03-14T06:47:33.4142706Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 26s local ... 2025-03-14T06:47:33.8134621Z 2025-03-14T06:47:33.8135472Z  2025-03-14T06:47:33.8137420Z  2025-03-14T06:47:33.8137889Z  2025-03-14T06:47:33.8138308Z  2025-03-14T06:47:33.8138728Z  2025-03-14T06:47:33.8139115Z  2025-03-14T06:47:33.8139504Z  2025-03-14T06:47:33.8139926Z  2025-03-14T06:47:33.8141014Z [20,361 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:33.8141829Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2025-03-14T06:47:33.8142529Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2025-03-14T06:47:33.8143348Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T06:47:33.8144209Z Compiling torch_xla/csrc/ops/exponential.cpp; 31s local 2025-03-14T06:47:33.8145112Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2025-03-14T06:47:33.8146006Z Compiling torch_xla/csrc/ops/expand.cpp; 27s local 2025-03-14T06:47:33.8146871Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 26s local 2025-03-14T06:47:33.8148047Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 26s local ... 2025-03-14T06:47:34.0244718Z 2025-03-14T06:47:34.0245673Z  2025-03-14T06:47:34.0246153Z  2025-03-14T06:47:34.0246994Z  2025-03-14T06:47:34.0247350Z  2025-03-14T06:47:34.0247661Z  2025-03-14T06:47:34.0247971Z  2025-03-14T06:47:34.0248351Z  2025-03-14T06:47:34.0248765Z  2025-03-14T06:47:34.0249691Z [20,362 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:34.0250702Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2025-03-14T06:47:34.0251783Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2025-03-14T06:47:34.0252850Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T06:47:34.0253844Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 29s local 2025-03-14T06:47:34.0254793Z Compiling torch_xla/csrc/ops/expand.cpp; 27s local 2025-03-14T06:47:34.0255738Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 26s local 2025-03-14T06:47:34.0256666Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 26s local 2025-03-14T06:47:34.0257471Z Compiling torch_xla/csrc/ops/einsum.cpp; 22s local ... 2025-03-14T06:47:34.4139489Z 2025-03-14T06:47:34.4140418Z  2025-03-14T06:47:34.4142188Z  2025-03-14T06:47:34.4142637Z  2025-03-14T06:47:34.4143033Z  2025-03-14T06:47:34.4143439Z  2025-03-14T06:47:34.4143829Z  2025-03-14T06:47:34.4144214Z  2025-03-14T06:47:34.4144647Z  2025-03-14T06:47:34.4145722Z [20,362 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:34.4146678Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2025-03-14T06:47:34.4147567Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2025-03-14T06:47:34.4148410Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2025-03-14T06:47:34.4149336Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2025-03-14T06:47:34.4150109Z Compiling torch_xla/csrc/ops/expand.cpp; 27s local 2025-03-14T06:47:34.4150970Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 27s local 2025-03-14T06:47:34.4151869Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 26s local 2025-03-14T06:47:34.4152773Z Compiling torch_xla/csrc/ops/einsum.cpp; 22s local ... 2025-03-14T06:47:34.9314289Z 2025-03-14T06:47:34.9315159Z  2025-03-14T06:47:34.9315643Z  2025-03-14T06:47:34.9316035Z  2025-03-14T06:47:34.9316432Z  2025-03-14T06:47:34.9316789Z  2025-03-14T06:47:34.9317184Z  2025-03-14T06:47:34.9317544Z  2025-03-14T06:47:34.9317917Z  2025-03-14T06:47:34.9319089Z [20,363 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:34.9320223Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2025-03-14T06:47:34.9320988Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2025-03-14T06:47:34.9322022Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2025-03-14T06:47:34.9322855Z Compiling torch_xla/csrc/ops/expand.cpp; 28s local 2025-03-14T06:47:34.9323650Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 27s local 2025-03-14T06:47:34.9324925Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 27s local 2025-03-14T06:47:34.9325771Z Compiling torch_xla/csrc/ops/einsum.cpp; 22s local 2025-03-14T06:47:34.9327009Z Compiling torch_xla/csrc/ops/eigh.cpp; 22s local ... 2025-03-14T06:47:35.2145535Z 2025-03-14T06:47:35.2147405Z  2025-03-14T06:47:35.2149435Z  2025-03-14T06:47:35.2149894Z  2025-03-14T06:47:35.2150278Z  2025-03-14T06:47:35.2150699Z  2025-03-14T06:47:35.2151143Z  2025-03-14T06:47:35.2151544Z  2025-03-14T06:47:35.2151959Z  2025-03-14T06:47:35.2152952Z [20,363 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:35.2154472Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2025-03-14T06:47:35.2155361Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2025-03-14T06:47:35.2156278Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local 2025-03-14T06:47:35.2157297Z Compiling torch_xla/csrc/ops/expand.cpp; 28s local 2025-03-14T06:47:35.2158164Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 28s local 2025-03-14T06:47:35.2159099Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 27s local 2025-03-14T06:47:35.2159983Z Compiling torch_xla/csrc/ops/einsum.cpp; 23s local 2025-03-14T06:47:35.2160802Z Compiling torch_xla/csrc/ops/eigh.cpp; 22s local ... 2025-03-14T06:47:36.2151690Z 2025-03-14T06:47:36.2152536Z  2025-03-14T06:47:36.2152970Z  2025-03-14T06:47:36.2153374Z  2025-03-14T06:47:36.2153762Z  2025-03-14T06:47:36.2154167Z  2025-03-14T06:47:36.2154563Z  2025-03-14T06:47:36.2154943Z  2025-03-14T06:47:36.2155326Z  2025-03-14T06:47:36.2156267Z [20,363 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:36.2157309Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2025-03-14T06:47:36.2158128Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2025-03-14T06:47:36.2158976Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2025-03-14T06:47:36.2159764Z Compiling torch_xla/csrc/ops/expand.cpp; 29s local 2025-03-14T06:47:36.2160541Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 29s local 2025-03-14T06:47:36.2161411Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 28s local 2025-03-14T06:47:36.2162277Z Compiling torch_xla/csrc/ops/einsum.cpp; 24s local 2025-03-14T06:47:36.2163137Z Compiling torch_xla/csrc/ops/eigh.cpp; 23s local ... 2025-03-14T06:47:37.2159390Z 2025-03-14T06:47:37.2160412Z  2025-03-14T06:47:37.2162384Z  2025-03-14T06:47:37.2162873Z  2025-03-14T06:47:37.2163305Z  2025-03-14T06:47:37.2163700Z  2025-03-14T06:47:37.2164130Z  2025-03-14T06:47:37.2164671Z  2025-03-14T06:47:37.2165086Z  2025-03-14T06:47:37.2166282Z [20,363 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:37.2167392Z Compiling torch_xla/csrc/ops/index_ops.cpp; 38s local 2025-03-14T06:47:37.2168210Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2025-03-14T06:47:37.2169053Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2025-03-14T06:47:37.2169890Z Compiling torch_xla/csrc/ops/expand.cpp; 30s local 2025-03-14T06:47:37.2170734Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local 2025-03-14T06:47:37.2171812Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local 2025-03-14T06:47:37.2172565Z Compiling torch_xla/csrc/ops/einsum.cpp; 25s local 2025-03-14T06:47:37.2173354Z Compiling torch_xla/csrc/ops/eigh.cpp; 24s local ... 2025-03-14T06:47:38.0091655Z 2025-03-14T06:47:38.0092500Z  2025-03-14T06:47:38.0093000Z  2025-03-14T06:47:38.0093384Z  2025-03-14T06:47:38.0093694Z  2025-03-14T06:47:38.0094004Z  2025-03-14T06:47:38.0094400Z  2025-03-14T06:47:38.0094826Z  2025-03-14T06:47:38.0095203Z  2025-03-14T06:47:38.0096480Z [20,364 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:38.0097500Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2025-03-14T06:47:38.0098342Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2025-03-14T06:47:38.0099202Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2025-03-14T06:47:38.0100069Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local 2025-03-14T06:47:38.0100921Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2025-03-14T06:47:38.0101738Z Compiling torch_xla/csrc/ops/einsum.cpp; 26s local 2025-03-14T06:47:38.0102687Z Compiling torch_xla/csrc/ops/eigh.cpp; 25s local 2025-03-14T06:47:38.0103483Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 24s local ... 2025-03-14T06:47:38.2166136Z 2025-03-14T06:47:38.2167519Z  2025-03-14T06:47:38.2168262Z  2025-03-14T06:47:38.2168625Z  2025-03-14T06:47:38.2168978Z  2025-03-14T06:47:38.2169327Z  2025-03-14T06:47:38.2169671Z  2025-03-14T06:47:38.2170019Z  2025-03-14T06:47:38.2170369Z  2025-03-14T06:47:38.2171202Z [20,364 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:38.2172071Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2025-03-14T06:47:38.2172796Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 37s local 2025-03-14T06:47:38.2173560Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2025-03-14T06:47:38.2174361Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2025-03-14T06:47:38.2175171Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2025-03-14T06:47:38.2175916Z Compiling torch_xla/csrc/ops/einsum.cpp; 26s local 2025-03-14T06:47:38.2176569Z Compiling torch_xla/csrc/ops/eigh.cpp; 25s local 2025-03-14T06:47:38.2177301Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 24s local ... 2025-03-14T06:47:38.4798680Z 2025-03-14T06:47:38.4800295Z  2025-03-14T06:47:38.4800789Z  2025-03-14T06:47:38.4801182Z  2025-03-14T06:47:38.4801548Z  2025-03-14T06:47:38.4801926Z  2025-03-14T06:47:38.4802323Z  2025-03-14T06:47:38.4802732Z  2025-03-14T06:47:38.4803121Z  2025-03-14T06:47:38.4804002Z [20,366 / 20,653] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2025-03-14T06:47:38.4805181Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2025-03-14T06:47:38.4806069Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2025-03-14T06:47:38.4806913Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2025-03-14T06:47:38.4807709Z Compiling torch_xla/csrc/ops/einsum.cpp; 26s local 2025-03-14T06:47:38.4808472Z Compiling torch_xla/csrc/ops/eigh.cpp; 26s local 2025-03-14T06:47:38.4809271Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 25s local 2025-03-14T06:47:38.4810134Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 25s local 2025-03-14T06:47:38.4811010Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 24s local ... 2025-03-14T06:47:38.8170861Z 2025-03-14T06:47:38.8172236Z  2025-03-14T06:47:38.8172738Z  2025-03-14T06:47:38.8173166Z  2025-03-14T06:47:38.8173579Z  2025-03-14T06:47:38.8173985Z  2025-03-14T06:47:38.8174401Z  2025-03-14T06:47:38.8174801Z  2025-03-14T06:47:38.8175221Z  2025-03-14T06:47:38.8176436Z [20,366 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:38.8177514Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 34s local 2025-03-14T06:47:38.8178413Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2025-03-14T06:47:38.8179328Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 31s local 2025-03-14T06:47:38.8180175Z Compiling torch_xla/csrc/ops/einsum.cpp; 26s local 2025-03-14T06:47:38.8181046Z Compiling torch_xla/csrc/ops/eigh.cpp; 26s local 2025-03-14T06:47:38.8181858Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 25s local 2025-03-14T06:47:38.8182712Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 25s local 2025-03-14T06:47:38.8183597Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 25s local ... 2025-03-14T06:47:39.7661937Z 2025-03-14T06:47:39.7663370Z  2025-03-14T06:47:39.7663863Z  2025-03-14T06:47:39.7664288Z  2025-03-14T06:47:39.7664747Z  2025-03-14T06:47:39.7665146Z  2025-03-14T06:47:39.7665748Z  2025-03-14T06:47:39.7666146Z  2025-03-14T06:47:39.7666520Z  2025-03-14T06:47:39.7667460Z [20,367 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:39.7668954Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T06:47:39.7669799Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 32s local 2025-03-14T06:47:39.7670729Z Compiling torch_xla/csrc/ops/einsum.cpp; 27s local 2025-03-14T06:47:39.7671457Z Compiling torch_xla/csrc/ops/eigh.cpp; 27s local 2025-03-14T06:47:39.7672259Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 26s local 2025-03-14T06:47:39.7673035Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 26s local 2025-03-14T06:47:39.7673841Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 26s local 2025-03-14T06:47:39.7674688Z Compiling torch_xla/csrc/ops/var.cpp; 25s local ... 2025-03-14T06:47:39.9876879Z 2025-03-14T06:47:39.9878071Z  2025-03-14T06:47:39.9878748Z  2025-03-14T06:47:39.9879329Z  2025-03-14T06:47:39.9879691Z  2025-03-14T06:47:39.9880175Z  2025-03-14T06:47:39.9880591Z  2025-03-14T06:47:39.9880997Z  2025-03-14T06:47:39.9881384Z  2025-03-14T06:47:39.9882321Z [20,368 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:39.9883293Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T06:47:39.9884102Z Compiling torch_xla/csrc/ops/einsum.cpp; 28s local 2025-03-14T06:47:39.9884982Z Compiling torch_xla/csrc/ops/eigh.cpp; 27s local 2025-03-14T06:47:39.9885723Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 26s local 2025-03-14T06:47:39.9886406Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 26s local 2025-03-14T06:47:39.9887023Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 26s local 2025-03-14T06:47:39.9887615Z Compiling torch_xla/csrc/ops/var.cpp; 25s local 2025-03-14T06:47:39.9888209Z Compiling torch_xla/csrc/ops/dot_general.cpp; 25s local ... 2025-03-14T06:47:40.2179840Z 2025-03-14T06:47:40.2181013Z  2025-03-14T06:47:40.2181694Z  2025-03-14T06:47:40.2182353Z  2025-03-14T06:47:40.2182834Z  2025-03-14T06:47:40.2183238Z  2025-03-14T06:47:40.2183607Z  2025-03-14T06:47:40.2183980Z  2025-03-14T06:47:40.2184384Z  2025-03-14T06:47:40.2185652Z [20,368 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:40.2186685Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T06:47:40.2187395Z Compiling torch_xla/csrc/ops/einsum.cpp; 28s local 2025-03-14T06:47:40.2188086Z Compiling torch_xla/csrc/ops/eigh.cpp; 27s local 2025-03-14T06:47:40.2189010Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 26s local 2025-03-14T06:47:40.2189831Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 26s local 2025-03-14T06:47:40.2190998Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 26s local 2025-03-14T06:47:40.2191814Z Compiling torch_xla/csrc/ops/var.cpp; 25s local 2025-03-14T06:47:40.2192629Z Compiling torch_xla/csrc/ops/dot_general.cpp; 25s local ... 2025-03-14T06:47:41.1554545Z 2025-03-14T06:47:41.1555767Z  2025-03-14T06:47:41.1556220Z  2025-03-14T06:47:41.1556602Z  2025-03-14T06:47:41.1556979Z  2025-03-14T06:47:41.1557389Z  2025-03-14T06:47:41.1557768Z  2025-03-14T06:47:41.1558127Z  2025-03-14T06:47:41.1558811Z  2025-03-14T06:47:41.1559927Z [20,369 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:41.1560890Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local 2025-03-14T06:47:41.1561606Z Compiling torch_xla/csrc/ops/eigh.cpp; 28s local 2025-03-14T06:47:41.1562371Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 27s local 2025-03-14T06:47:41.1563144Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 27s local 2025-03-14T06:47:41.1563949Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 27s local 2025-03-14T06:47:41.1564847Z Compiling torch_xla/csrc/ops/var.cpp; 26s local 2025-03-14T06:47:41.1566085Z Compiling torch_xla/csrc/ops/dot_general.cpp; 26s local 2025-03-14T06:47:41.1566949Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 25s local ... 2025-03-14T06:47:41.4187871Z 2025-03-14T06:47:41.4189350Z  2025-03-14T06:47:41.4189795Z  2025-03-14T06:47:41.4190171Z  2025-03-14T06:47:41.4190542Z  2025-03-14T06:47:41.4190930Z  2025-03-14T06:47:41.4191315Z  2025-03-14T06:47:41.4191663Z  2025-03-14T06:47:41.4192032Z  2025-03-14T06:47:41.4192952Z [20,369 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:41.4193930Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local 2025-03-14T06:47:41.4194645Z Compiling torch_xla/csrc/ops/eigh.cpp; 29s local 2025-03-14T06:47:41.4195399Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 28s local 2025-03-14T06:47:41.4196201Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 28s local 2025-03-14T06:47:41.4197025Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 27s local 2025-03-14T06:47:41.4197837Z Compiling torch_xla/csrc/ops/var.cpp; 27s local 2025-03-14T06:47:41.4198578Z Compiling torch_xla/csrc/ops/dot_general.cpp; 26s local 2025-03-14T06:47:41.4199502Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 25s local ... 2025-03-14T06:47:42.4194514Z 2025-03-14T06:47:42.4195804Z  2025-03-14T06:47:42.4196282Z  2025-03-14T06:47:42.4196690Z  2025-03-14T06:47:42.4197079Z  2025-03-14T06:47:42.4197469Z  2025-03-14T06:47:42.4198024Z  2025-03-14T06:47:42.4198406Z  2025-03-14T06:47:42.4198792Z  2025-03-14T06:47:42.4199716Z [20,369 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:42.4200713Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local 2025-03-14T06:47:42.4201464Z Compiling torch_xla/csrc/ops/eigh.cpp; 30s local 2025-03-14T06:47:42.4202252Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 29s local 2025-03-14T06:47:42.4203069Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local 2025-03-14T06:47:42.4203874Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2025-03-14T06:47:42.4204828Z Compiling torch_xla/csrc/ops/var.cpp; 28s local 2025-03-14T06:47:42.4205577Z Compiling torch_xla/csrc/ops/dot_general.cpp; 27s local 2025-03-14T06:47:42.4206459Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 26s local ... 2025-03-14T06:47:43.4201506Z 2025-03-14T06:47:43.4202986Z  2025-03-14T06:47:43.4203522Z  2025-03-14T06:47:43.4205136Z  2025-03-14T06:47:43.4206212Z  2025-03-14T06:47:43.4207169Z  2025-03-14T06:47:43.4208422Z  2025-03-14T06:47:43.4209677Z  2025-03-14T06:47:43.4210888Z  2025-03-14T06:47:43.4212831Z [20,369 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:43.4213871Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2025-03-14T06:47:43.4214642Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2025-03-14T06:47:43.4215437Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2025-03-14T06:47:43.4216267Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2025-03-14T06:47:43.4217305Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local 2025-03-14T06:47:43.4218102Z Compiling torch_xla/csrc/ops/var.cpp; 29s local 2025-03-14T06:47:43.4218847Z Compiling torch_xla/csrc/ops/dot_general.cpp; 28s local 2025-03-14T06:47:43.4219574Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 27s local ... 2025-03-14T06:47:43.8023628Z 2025-03-14T06:47:43.8025018Z  2025-03-14T06:47:43.8025519Z  2025-03-14T06:47:43.8026919Z  2025-03-14T06:47:43.8027823Z  2025-03-14T06:47:43.8029062Z  2025-03-14T06:47:43.8030219Z  2025-03-14T06:47:43.8031386Z  2025-03-14T06:47:43.8032540Z  2025-03-14T06:47:43.8034190Z [20,370 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:43.8035518Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2025-03-14T06:47:43.8036293Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2025-03-14T06:47:43.8037338Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2025-03-14T06:47:43.8038203Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2025-03-14T06:47:43.8039045Z Compiling torch_xla/csrc/ops/var.cpp; 29s local 2025-03-14T06:47:43.8039839Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2025-03-14T06:47:43.8040690Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local 2025-03-14T06:47:43.8041616Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 28s local ... 2025-03-14T06:47:44.0207397Z 2025-03-14T06:47:44.0208280Z  2025-03-14T06:47:44.0208773Z  2025-03-14T06:47:44.0209220Z  2025-03-14T06:47:44.0209656Z  2025-03-14T06:47:44.0210092Z  2025-03-14T06:47:44.0210535Z  2025-03-14T06:47:44.0210976Z  2025-03-14T06:47:44.0211407Z  2025-03-14T06:47:44.0212457Z [20,370 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:44.0213368Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2025-03-14T06:47:44.0214190Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2025-03-14T06:47:44.0214988Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2025-03-14T06:47:44.0215766Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2025-03-14T06:47:44.0216582Z Compiling torch_xla/csrc/ops/var.cpp; 29s local 2025-03-14T06:47:44.0217359Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2025-03-14T06:47:44.0218239Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local 2025-03-14T06:47:44.0219198Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 28s local ... 2025-03-14T06:47:45.0139965Z 2025-03-14T06:47:45.0140801Z  2025-03-14T06:47:45.0141260Z  2025-03-14T06:47:45.0141606Z  2025-03-14T06:47:45.0141966Z  2025-03-14T06:47:45.0142341Z  2025-03-14T06:47:45.0142721Z  2025-03-14T06:47:45.0143076Z  2025-03-14T06:47:45.0143436Z  2025-03-14T06:47:45.0144471Z [20,371 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:45.0145333Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2025-03-14T06:47:45.0146048Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2025-03-14T06:47:45.0146788Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2025-03-14T06:47:45.0147489Z Compiling torch_xla/csrc/ops/var.cpp; 30s local 2025-03-14T06:47:45.0148422Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2025-03-14T06:47:45.0149194Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2025-03-14T06:47:45.0149962Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local 2025-03-14T06:47:45.0150735Z Compiling torch_xla/csrc/ops/diagonal.cpp; 29s local ... 2025-03-14T06:47:45.2216082Z 2025-03-14T06:47:45.2217147Z  2025-03-14T06:47:45.2217563Z  2025-03-14T06:47:45.2217908Z  2025-03-14T06:47:45.2218256Z  2025-03-14T06:47:45.2218587Z  2025-03-14T06:47:45.2218946Z  2025-03-14T06:47:45.2219569Z  2025-03-14T06:47:45.2219950Z  2025-03-14T06:47:45.2220817Z [20,371 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:45.2221735Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2025-03-14T06:47:45.2222497Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2025-03-14T06:47:45.2223227Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2025-03-14T06:47:45.2223944Z Compiling torch_xla/csrc/ops/var.cpp; 30s local 2025-03-14T06:47:45.2224634Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2025-03-14T06:47:45.2225421Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2025-03-14T06:47:45.2226492Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local 2025-03-14T06:47:45.2227355Z Compiling torch_xla/csrc/ops/diagonal.cpp; 29s local ... 2025-03-14T06:47:45.7259491Z 2025-03-14T06:47:45.7260662Z  2025-03-14T06:47:45.7261584Z  2025-03-14T06:47:45.7262234Z  2025-03-14T06:47:45.7262712Z  2025-03-14T06:47:45.7263074Z  2025-03-14T06:47:45.7263397Z  2025-03-14T06:47:45.7263725Z  2025-03-14T06:47:45.7264050Z  2025-03-14T06:47:45.7264956Z [20,372 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:45.7266007Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2025-03-14T06:47:45.7266685Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2025-03-14T06:47:45.7267329Z Compiling torch_xla/csrc/ops/var.cpp; 31s local 2025-03-14T06:47:45.7268147Z Compiling torch_xla/csrc/ops/dot_general.cpp; 31s local 2025-03-14T06:47:45.7268900Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T06:47:45.7269706Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T06:47:45.7270487Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local 2025-03-14T06:47:45.7271208Z Compiling torch_xla/csrc/ops/device_data.cpp; 28s local ... 2025-03-14T06:47:46.0223512Z 2025-03-14T06:47:46.0224685Z  2025-03-14T06:47:46.0225539Z  2025-03-14T06:47:46.0226142Z  2025-03-14T06:47:46.0226607Z  2025-03-14T06:47:46.0227001Z  2025-03-14T06:47:46.0227325Z  2025-03-14T06:47:46.0227645Z  2025-03-14T06:47:46.0227961Z  2025-03-14T06:47:46.0228760Z [20,372 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:46.0229550Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2025-03-14T06:47:46.0230180Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2025-03-14T06:47:46.0230800Z Compiling torch_xla/csrc/ops/var.cpp; 31s local 2025-03-14T06:47:46.0231411Z Compiling torch_xla/csrc/ops/dot_general.cpp; 31s local 2025-03-14T06:47:46.0232099Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T06:47:46.0232861Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T06:47:46.0233573Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local 2025-03-14T06:47:46.0234222Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local ... 2025-03-14T06:47:46.2526791Z 2025-03-14T06:47:46.2528130Z  2025-03-14T06:47:46.2528601Z  2025-03-14T06:47:46.2528953Z  2025-03-14T06:47:46.2529253Z  2025-03-14T06:47:46.2529564Z  2025-03-14T06:47:46.2529863Z  2025-03-14T06:47:46.2530442Z  2025-03-14T06:47:46.2530750Z  2025-03-14T06:47:46.2531489Z [20,373 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:46.2532239Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2025-03-14T06:47:46.2532821Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2025-03-14T06:47:46.2533394Z Compiling torch_xla/csrc/ops/var.cpp; 31s local 2025-03-14T06:47:46.2534173Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T06:47:46.2535064Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T06:47:46.2535746Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local 2025-03-14T06:47:46.2536355Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local 2025-03-14T06:47:46.2537016Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 29s local ... 2025-03-14T06:47:46.6227937Z 2025-03-14T06:47:46.6228775Z  2025-03-14T06:47:46.6229363Z  2025-03-14T06:47:46.6229734Z  2025-03-14T06:47:46.6230092Z  2025-03-14T06:47:46.6230428Z  2025-03-14T06:47:46.6230773Z  2025-03-14T06:47:46.6231094Z  2025-03-14T06:47:46.6231725Z  2025-03-14T06:47:46.6232526Z [20,373 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:46.6233412Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2025-03-14T06:47:46.6234212Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2025-03-14T06:47:46.6234849Z Compiling torch_xla/csrc/ops/var.cpp; 32s local 2025-03-14T06:47:46.6235534Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T06:47:46.6236351Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T06:47:46.6237145Z Compiling torch_xla/csrc/ops/diagonal.cpp; 30s local 2025-03-14T06:47:46.6237826Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local 2025-03-14T06:47:46.6238573Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 29s local ... 2025-03-14T06:47:47.3719072Z 2025-03-14T06:47:47.3719912Z  2025-03-14T06:47:47.3720374Z  2025-03-14T06:47:47.3720749Z  2025-03-14T06:47:47.3721190Z  2025-03-14T06:47:47.3721675Z  2025-03-14T06:47:47.3722084Z  2025-03-14T06:47:47.3722454Z  2025-03-14T06:47:47.3722812Z  2025-03-14T06:47:47.3723771Z [20,374 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:47.3724911Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2025-03-14T06:47:47.3725682Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2025-03-14T06:47:47.3726423Z Compiling torch_xla/csrc/ops/var.cpp; 33s local 2025-03-14T06:47:47.3727139Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2025-03-14T06:47:47.3728026Z Compiling torch_xla/csrc/ops/diagonal.cpp; 31s local 2025-03-14T06:47:47.3728782Z Compiling torch_xla/csrc/ops/device_data.cpp; 30s local 2025-03-14T06:47:47.3729594Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 30s local 2025-03-14T06:47:47.3730421Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 29s local ... 2025-03-14T06:47:47.6234843Z 2025-03-14T06:47:47.6235683Z  2025-03-14T06:47:47.6236150Z  2025-03-14T06:47:47.6236489Z  2025-03-14T06:47:47.6236865Z  2025-03-14T06:47:47.6237227Z  2025-03-14T06:47:47.6237646Z  2025-03-14T06:47:47.6238011Z  2025-03-14T06:47:47.6238369Z  2025-03-14T06:47:47.6239301Z [20,375 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:47.6240305Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2025-03-14T06:47:47.6241016Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2025-03-14T06:47:47.6241704Z Compiling torch_xla/csrc/ops/var.cpp; 33s local 2025-03-14T06:47:47.6242490Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2025-03-14T06:47:47.6243621Z Compiling torch_xla/csrc/ops/device_data.cpp; 30s local 2025-03-14T06:47:47.6244443Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 30s local 2025-03-14T06:47:47.6245426Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 30s local 2025-03-14T06:47:47.6246298Z Compiling torch_xla/csrc/ops/custom_call.cpp; 28s local ... 2025-03-14T06:47:48.4241531Z 2025-03-14T06:47:48.4242366Z  2025-03-14T06:47:48.4242919Z  2025-03-14T06:47:48.4243298Z  2025-03-14T06:47:48.4243744Z  2025-03-14T06:47:48.4244409Z  2025-03-14T06:47:48.4244945Z  2025-03-14T06:47:48.4245323Z  2025-03-14T06:47:48.4245714Z  2025-03-14T06:47:48.4246581Z [20,376 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:47:48.4247519Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T06:47:48.4248275Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2025-03-14T06:47:48.4249023Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2025-03-14T06:47:48.4249848Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2025-03-14T06:47:48.4250703Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2025-03-14T06:47:48.4251964Z Compiling torch_xla/csrc/ops/dequant_tensor.cpp; 31s local 2025-03-14T06:47:48.4252840Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 30s local 2025-03-14T06:47:48.4254000Z Compiling torch_xla/csrc/ops/custom_call.cpp; 29s local ... 2025-03-14T06:47:48.7450168Z 2025-03-14T06:47:48.7451059Z  2025-03-14T06:47:48.7451498Z  2025-03-14T06:47:48.7451875Z  2025-03-14T06:47:48.7452254Z  2025-03-14T06:47:48.7452652Z  2025-03-14T06:47:48.7453079Z  2025-03-14T06:47:48.7453446Z  2025-03-14T06:47:48.7453822Z  2025-03-14T06:47:48.7454823Z [20,377 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:48.7455836Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T06:47:48.7456603Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2025-03-14T06:47:48.7457374Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2025-03-14T06:47:48.7458218Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2025-03-14T06:47:48.7459246Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2025-03-14T06:47:48.7460030Z Compiling torch_xla/csrc/ops/custom_sharding.cpp; 31s local 2025-03-14T06:47:48.7460906Z Compiling torch_xla/csrc/ops/custom_call.cpp; 29s local 2025-03-14T06:47:48.7461598Z Compiling torch_xla/csrc/ops/cumsum.cpp; 29s local ... 2025-03-14T06:47:49.0246461Z 2025-03-14T06:47:49.0247344Z  2025-03-14T06:47:49.0247846Z  2025-03-14T06:47:49.0248265Z  2025-03-14T06:47:49.0248671Z  2025-03-14T06:47:49.0249040Z  2025-03-14T06:47:49.0249425Z  2025-03-14T06:47:49.0249828Z  2025-03-14T06:47:49.0250231Z  2025-03-14T06:47:49.0251393Z [20,378 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:49.0252451Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T06:47:49.0253305Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2025-03-14T06:47:49.0254135Z Compiling torch_xla/csrc/ops/var.cpp; 34s local 2025-03-14T06:47:49.0255004Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2025-03-14T06:47:49.0255945Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2025-03-14T06:47:49.0256785Z Compiling torch_xla/csrc/ops/custom_call.cpp; 30s local 2025-03-14T06:47:49.0257579Z Compiling torch_xla/csrc/ops/cumsum.cpp; 29s local 2025-03-14T06:47:49.0258408Z Compiling torch_xla/csrc/ops/cumprod.cpp; 29s local ... 2025-03-14T06:47:49.7087698Z 2025-03-14T06:47:49.7089214Z  2025-03-14T06:47:49.7089709Z  2025-03-14T06:47:49.7090323Z  2025-03-14T06:47:49.7090755Z  2025-03-14T06:47:49.7091159Z  2025-03-14T06:47:49.7091827Z  2025-03-14T06:47:49.7092260Z  2025-03-14T06:47:49.7092665Z  2025-03-14T06:47:49.7093610Z [20,379 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:49.7094681Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T06:47:49.7095488Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2025-03-14T06:47:49.7096322Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2025-03-14T06:47:49.7097400Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2025-03-14T06:47:49.7098270Z Compiling torch_xla/csrc/ops/custom_call.cpp; 30s local 2025-03-14T06:47:49.7099086Z Compiling torch_xla/csrc/ops/cumsum.cpp; 30s local 2025-03-14T06:47:49.7099870Z Compiling torch_xla/csrc/ops/cumprod.cpp; 30s local 2025-03-14T06:47:49.7100756Z Compiling torch_xla/csrc/ops/count_nonzero.cpp; 30s local ... 2025-03-14T06:47:50.0254584Z 2025-03-14T06:47:50.0256012Z  2025-03-14T06:47:50.0256521Z  2025-03-14T06:47:50.0256945Z  2025-03-14T06:47:50.0257437Z  2025-03-14T06:47:50.0257928Z  2025-03-14T06:47:50.0258423Z  2025-03-14T06:47:50.0258927Z  2025-03-14T06:47:50.0259751Z  2025-03-14T06:47:50.0260895Z [20,379 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:50.0262035Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T06:47:50.0263165Z Compiling torch_xla/csrc/ops/var.cpp; 35s local 2025-03-14T06:47:50.0264147Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2025-03-14T06:47:50.0265209Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2025-03-14T06:47:50.0266238Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local 2025-03-14T06:47:50.0266928Z Compiling torch_xla/csrc/ops/cumsum.cpp; 30s local 2025-03-14T06:47:50.0267631Z Compiling torch_xla/csrc/ops/cumprod.cpp; 30s local 2025-03-14T06:47:50.0268439Z Compiling torch_xla/csrc/ops/count_nonzero.cpp; 30s local ... 2025-03-14T06:47:50.8885100Z 2025-03-14T06:47:50.8885960Z  2025-03-14T06:47:50.8886403Z  2025-03-14T06:47:50.8886725Z  2025-03-14T06:47:50.8887123Z  2025-03-14T06:47:50.8887523Z  2025-03-14T06:47:50.8887894Z  2025-03-14T06:47:50.8888302Z  2025-03-14T06:47:50.8888699Z  2025-03-14T06:47:50.8889596Z [20,380 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:50.8890639Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2025-03-14T06:47:50.8891407Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2025-03-14T06:47:50.8892178Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2025-03-14T06:47:50.8893033Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2025-03-14T06:47:50.8893820Z Compiling torch_xla/csrc/ops/custom_call.cpp; 31s local 2025-03-14T06:47:50.8894623Z Compiling torch_xla/csrc/ops/cumsum.cpp; 31s local 2025-03-14T06:47:50.8895392Z Compiling torch_xla/csrc/ops/cumprod.cpp; 31s local 2025-03-14T06:47:50.8896270Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 27s local ... 2025-03-14T06:47:51.2155072Z 2025-03-14T06:47:51.2155914Z  2025-03-14T06:47:51.2156295Z  2025-03-14T06:47:51.2156603Z  2025-03-14T06:47:51.2156911Z  2025-03-14T06:47:51.2157214Z  2025-03-14T06:47:51.2157548Z  2025-03-14T06:47:51.2157852Z  2025-03-14T06:47:51.2158197Z  2025-03-14T06:47:51.2159339Z [20,380 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:51.2160269Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2025-03-14T06:47:51.2161061Z Compiling torch_xla/csrc/ops/var.cpp; 36s local 2025-03-14T06:47:51.2161644Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2025-03-14T06:47:51.2162513Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2025-03-14T06:47:51.2163102Z Compiling torch_xla/csrc/ops/custom_call.cpp; 32s local 2025-03-14T06:47:51.2163664Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2025-03-14T06:47:51.2164223Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2025-03-14T06:47:51.2165149Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 28s local ... 2025-03-14T06:47:51.4158220Z 2025-03-14T06:47:51.4159129Z  2025-03-14T06:47:51.4159585Z  2025-03-14T06:47:51.4159906Z  2025-03-14T06:47:51.4160506Z  2025-03-14T06:47:51.4160911Z  2025-03-14T06:47:51.4161267Z  2025-03-14T06:47:51.4161645Z  2025-03-14T06:47:51.4162016Z  2025-03-14T06:47:51.4162831Z [20,381 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:51.4163832Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2025-03-14T06:47:51.4164940Z Compiling torch_xla/csrc/ops/var.cpp; 37s local 2025-03-14T06:47:51.4165946Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2025-03-14T06:47:51.4166630Z Compiling torch_xla/csrc/ops/device_data.cpp; 34s local 2025-03-14T06:47:51.4167507Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2025-03-14T06:47:51.4168118Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2025-03-14T06:47:51.4168826Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 28s local 2025-03-14T06:47:51.4169708Z //torch_xla/csrc:tensor; 27s local ... 2025-03-14T06:47:51.8102515Z 2025-03-14T06:47:51.8104005Z  2025-03-14T06:47:51.8104513Z  2025-03-14T06:47:51.8104894Z  2025-03-14T06:47:51.8105317Z  2025-03-14T06:47:51.8105728Z  2025-03-14T06:47:51.8106127Z  2025-03-14T06:47:51.8106501Z  2025-03-14T06:47:51.8106843Z  2025-03-14T06:47:51.8107765Z [20,382 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:51.8108769Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2025-03-14T06:47:51.8109587Z Compiling torch_xla/csrc/ops/var.cpp; 37s local 2025-03-14T06:47:51.8110391Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T06:47:51.8111223Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2025-03-14T06:47:51.8111958Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2025-03-14T06:47:51.8112866Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 28s local 2025-03-14T06:47:51.8113925Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 28s local 2025-03-14T06:47:51.8114905Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 27s local ... 2025-03-14T06:47:52.0162944Z 2025-03-14T06:47:52.0163829Z  2025-03-14T06:47:52.0164215Z  2025-03-14T06:47:52.0164653Z  2025-03-14T06:47:52.0164962Z  2025-03-14T06:47:52.0165261Z  2025-03-14T06:47:52.0165799Z  2025-03-14T06:47:52.0166099Z  2025-03-14T06:47:52.0166427Z  2025-03-14T06:47:52.0167150Z [20,382 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:52.0167881Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2025-03-14T06:47:52.0168453Z Compiling torch_xla/csrc/ops/var.cpp; 37s local 2025-03-14T06:47:52.0169157Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T06:47:52.0169796Z Compiling torch_xla/csrc/ops/cumsum.cpp; 32s local 2025-03-14T06:47:52.0170360Z Compiling torch_xla/csrc/ops/cumprod.cpp; 32s local 2025-03-14T06:47:52.0171025Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 28s local 2025-03-14T06:47:52.0171804Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 28s local 2025-03-14T06:47:52.0172581Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 28s local ... 2025-03-14T06:47:52.4167536Z 2025-03-14T06:47:52.4168384Z  2025-03-14T06:47:52.4168832Z  2025-03-14T06:47:52.4169178Z  2025-03-14T06:47:52.4169843Z  2025-03-14T06:47:52.4170238Z  2025-03-14T06:47:52.4170571Z  2025-03-14T06:47:52.4170927Z  2025-03-14T06:47:52.4171301Z  2025-03-14T06:47:52.4172241Z [20,383 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:47:52.4173206Z Compiling torch_xla/csrc/ops/var.cpp; 38s local 2025-03-14T06:47:52.4173985Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T06:47:52.4175054Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2025-03-14T06:47:52.4175823Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2025-03-14T06:47:52.4176659Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 29s local 2025-03-14T06:47:52.4177740Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 28s local 2025-03-14T06:47:52.4178795Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 28s local 2025-03-14T06:47:52.4179646Z Compiling torch_xla/csrc/ops/constant.cpp; 27s local ... 2025-03-14T06:47:52.6170336Z 2025-03-14T06:47:52.6171219Z  2025-03-14T06:47:52.6171699Z  2025-03-14T06:47:52.6172099Z  2025-03-14T06:47:52.6172492Z  2025-03-14T06:47:52.6173169Z  2025-03-14T06:47:52.6173562Z  2025-03-14T06:47:52.6173979Z  2025-03-14T06:47:52.6174378Z  2025-03-14T06:47:52.6175462Z [20,384 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:52.6176606Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T06:47:52.6177438Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2025-03-14T06:47:52.6178198Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2025-03-14T06:47:52.6179094Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 29s local 2025-03-14T06:47:52.6180126Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 29s local 2025-03-14T06:47:52.6181060Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 28s local 2025-03-14T06:47:52.6181867Z Compiling torch_xla/csrc/ops/constant.cpp; 28s local 2025-03-14T06:47:52.6182710Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 28s local ... 2025-03-14T06:47:53.0174352Z 2025-03-14T06:47:53.0175213Z  2025-03-14T06:47:53.0175714Z  2025-03-14T06:47:53.0176365Z  2025-03-14T06:47:53.0176780Z  2025-03-14T06:47:53.0177207Z  2025-03-14T06:47:53.0177652Z  2025-03-14T06:47:53.0178066Z  2025-03-14T06:47:53.0178496Z  2025-03-14T06:47:53.0179476Z [20,385 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:47:53.0180542Z Compiling torch_xla/csrc/ops/cumsum.cpp; 33s local 2025-03-14T06:47:53.0181380Z Compiling torch_xla/csrc/ops/cumprod.cpp; 33s local 2025-03-14T06:47:53.0182342Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 29s local 2025-03-14T06:47:53.0183504Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 29s local 2025-03-14T06:47:53.0184738Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 29s local 2025-03-14T06:47:53.0185626Z Compiling torch_xla/csrc/ops/constant.cpp; 28s local 2025-03-14T06:47:53.0186563Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 28s local 2025-03-14T06:47:53.0187484Z Compiling torch_xla/csrc/ops/cdist.cpp; 27s local ... 2025-03-14T06:47:53.4178178Z 2025-03-14T06:47:53.4179002Z  2025-03-14T06:47:53.4179478Z  2025-03-14T06:47:53.4179908Z  2025-03-14T06:47:53.4180351Z  2025-03-14T06:47:53.4180751Z  2025-03-14T06:47:53.4181133Z  2025-03-14T06:47:53.4181642Z  2025-03-14T06:47:53.4182104Z  2025-03-14T06:47:53.4183199Z [20,385 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:53.4184176Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2025-03-14T06:47:53.4197776Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local 2025-03-14T06:47:53.4198720Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 30s local 2025-03-14T06:47:53.4199986Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 29s local 2025-03-14T06:47:53.4200977Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 29s local 2025-03-14T06:47:53.4201804Z Compiling torch_xla/csrc/ops/constant.cpp; 28s local 2025-03-14T06:47:53.4202621Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 28s local 2025-03-14T06:47:53.4203657Z Compiling torch_xla/csrc/ops/cdist.cpp; 28s local ... 2025-03-14T06:47:54.6186157Z 2025-03-14T06:47:54.6186999Z  2025-03-14T06:47:54.6187449Z  2025-03-14T06:47:54.6187815Z  2025-03-14T06:47:54.6188179Z  2025-03-14T06:47:54.6188561Z  2025-03-14T06:47:54.6188936Z  2025-03-14T06:47:54.6189281Z  2025-03-14T06:47:54.6189659Z  2025-03-14T06:47:54.6190571Z [20,385 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:54.6191458Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2025-03-14T06:47:54.6192191Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local 2025-03-14T06:47:54.6193301Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 31s local 2025-03-14T06:47:54.6194279Z Compiling .../csrc/ops/convolution_backward_overrideable.cpp; 31s local 2025-03-14T06:47:54.6195380Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 30s local 2025-03-14T06:47:54.6196165Z Compiling torch_xla/csrc/ops/constant.cpp; 30s local 2025-03-14T06:47:54.6196947Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 30s local 2025-03-14T06:47:54.6197739Z Compiling torch_xla/csrc/ops/cdist.cpp; 29s local ... 2025-03-14T06:47:55.5943150Z 2025-03-14T06:47:55.5944049Z  2025-03-14T06:47:55.5944512Z  2025-03-14T06:47:55.5944891Z  2025-03-14T06:47:55.5945266Z  2025-03-14T06:47:55.5945626Z  2025-03-14T06:47:55.5945988Z  2025-03-14T06:47:55.5946400Z  2025-03-14T06:47:55.5946791Z  2025-03-14T06:47:55.5947663Z [20,386 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:55.5948607Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2025-03-14T06:47:55.5949331Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2025-03-14T06:47:55.5950228Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 32s local 2025-03-14T06:47:55.5951205Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 31s local 2025-03-14T06:47:55.5952000Z Compiling torch_xla/csrc/ops/constant.cpp; 31s local 2025-03-14T06:47:55.5952833Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 31s local 2025-03-14T06:47:55.5953703Z Compiling torch_xla/csrc/ops/cdist.cpp; 30s local 2025-03-14T06:47:55.5954438Z Compiling torch_xla/csrc/ops/cat.cpp; 29s local ... 2025-03-14T06:47:55.8194272Z 2025-03-14T06:47:55.8195132Z  2025-03-14T06:47:55.8195637Z  2025-03-14T06:47:55.8196041Z  2025-03-14T06:47:55.8196456Z  2025-03-14T06:47:55.8196854Z  2025-03-14T06:47:55.8197248Z  2025-03-14T06:47:55.8197653Z  2025-03-14T06:47:55.8198083Z  2025-03-14T06:47:55.8199055Z [20,386 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:55.8200070Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2025-03-14T06:47:55.8200869Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2025-03-14T06:47:55.8201815Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 32s local 2025-03-14T06:47:55.8202768Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 31s local 2025-03-14T06:47:55.8203648Z Compiling torch_xla/csrc/ops/constant.cpp; 31s local 2025-03-14T06:47:55.8204681Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 31s local 2025-03-14T06:47:55.8205536Z Compiling torch_xla/csrc/ops/cdist.cpp; 30s local 2025-03-14T06:47:56.0970055Z Compiling torch_xla/csrc/ops/cat.cpp; 30s local ... 2025-03-14T06:47:56.0970553Z 2025-03-14T06:47:56.0970961Z  2025-03-14T06:47:56.0971327Z  2025-03-14T06:47:56.0971688Z  2025-03-14T06:47:56.0972042Z  2025-03-14T06:47:56.0972401Z  2025-03-14T06:47:56.0972740Z  2025-03-14T06:47:56.0973102Z  2025-03-14T06:47:56.0973470Z  2025-03-14T06:47:56.0974281Z [20,387 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:56.0975379Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2025-03-14T06:47:56.0976243Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 32s local 2025-03-14T06:47:56.0977134Z Compiling torch_xla/csrc/ops/constant_pad_nd.cpp; 32s local 2025-03-14T06:47:56.0977908Z Compiling torch_xla/csrc/ops/constant.cpp; 31s local 2025-03-14T06:47:56.0978777Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 31s local 2025-03-14T06:47:56.0979580Z Compiling torch_xla/csrc/ops/cdist.cpp; 30s local 2025-03-14T06:47:56.0980258Z Compiling torch_xla/csrc/ops/cat.cpp; 30s local 2025-03-14T06:47:56.0980941Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 29s local ... 2025-03-14T06:47:56.3529926Z 2025-03-14T06:47:56.3530821Z  2025-03-14T06:47:56.3531299Z  2025-03-14T06:47:56.3531703Z  2025-03-14T06:47:56.3532093Z  2025-03-14T06:47:56.3532496Z  2025-03-14T06:47:56.3533180Z  2025-03-14T06:47:56.3533555Z  2025-03-14T06:47:56.3533927Z  2025-03-14T06:47:56.3534858Z [20,388 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:56.3535833Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2025-03-14T06:47:56.3536681Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 33s local 2025-03-14T06:47:56.3537511Z Compiling torch_xla/csrc/ops/constant.cpp; 31s local 2025-03-14T06:47:56.3538347Z Compiling torch_xla/csrc/ops/collective_permute.cpp; 31s local 2025-03-14T06:47:56.3539212Z Compiling torch_xla/csrc/ops/cdist.cpp; 31s local 2025-03-14T06:47:56.3539903Z Compiling torch_xla/csrc/ops/cat.cpp; 30s local 2025-03-14T06:47:56.3540632Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 30s local 2025-03-14T06:47:56.3541368Z Compiling torch_xla/csrc/ops/cast.cpp; 30s local ... 2025-03-14T06:47:56.6200276Z 2025-03-14T06:47:56.6201116Z  2025-03-14T06:47:56.6201654Z  2025-03-14T06:47:56.6202062Z  2025-03-14T06:47:56.6202465Z  2025-03-14T06:47:56.6202870Z  2025-03-14T06:47:56.6203268Z  2025-03-14T06:47:56.6203663Z  2025-03-14T06:47:56.6204040Z  2025-03-14T06:47:56.6205106Z [20,389 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:56.6206058Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2025-03-14T06:47:56.6206961Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 33s local 2025-03-14T06:47:56.6207855Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local 2025-03-14T06:47:56.6208579Z Compiling torch_xla/csrc/ops/cdist.cpp; 31s local 2025-03-14T06:47:56.6209296Z Compiling torch_xla/csrc/ops/cat.cpp; 30s local 2025-03-14T06:47:56.6210042Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 30s local 2025-03-14T06:47:56.6210765Z Compiling torch_xla/csrc/ops/cast.cpp; 30s local 2025-03-14T06:47:56.6211447Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 29s local ... 2025-03-14T06:47:56.8498937Z 2025-03-14T06:47:56.8499785Z  2025-03-14T06:47:56.8500231Z  2025-03-14T06:47:56.8500651Z  2025-03-14T06:47:56.8501032Z  2025-03-14T06:47:56.8501380Z  2025-03-14T06:47:56.8501766Z  2025-03-14T06:47:56.8502133Z  2025-03-14T06:47:56.8502639Z  2025-03-14T06:47:56.8503614Z [20,390 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:56.8504853Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2025-03-14T06:47:56.8505888Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 33s local 2025-03-14T06:47:56.8506837Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local 2025-03-14T06:47:56.8507583Z Compiling torch_xla/csrc/ops/cat.cpp; 31s local 2025-03-14T06:47:56.8508277Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 30s local 2025-03-14T06:47:56.8509034Z Compiling torch_xla/csrc/ops/cast.cpp; 30s local 2025-03-14T06:47:56.8509794Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 29s local 2025-03-14T06:47:56.8510903Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 29s local ... 2025-03-14T06:47:57.2205622Z 2025-03-14T06:47:57.2206504Z  2025-03-14T06:47:57.2206923Z  2025-03-14T06:47:57.2207301Z  2025-03-14T06:47:57.2207680Z  2025-03-14T06:47:57.2208029Z  2025-03-14T06:47:57.2208399Z  2025-03-14T06:47:57.2208782Z  2025-03-14T06:47:57.2209160Z  2025-03-14T06:47:57.2210094Z [20,390 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:57.2211041Z Compiling torch_xla/csrc/ops/cumsum.cpp; 38s local 2025-03-14T06:47:57.2212193Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 34s local 2025-03-14T06:47:57.2213122Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local 2025-03-14T06:47:57.2213828Z Compiling torch_xla/csrc/ops/cat.cpp; 31s local 2025-03-14T06:47:57.2214756Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 31s local 2025-03-14T06:47:57.2215474Z Compiling torch_xla/csrc/ops/cast.cpp; 30s local 2025-03-14T06:47:57.2216229Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 30s local 2025-03-14T06:47:57.2217115Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 29s local ... 2025-03-14T06:47:57.4208383Z 2025-03-14T06:47:57.4209229Z  2025-03-14T06:47:57.4209693Z  2025-03-14T06:47:57.4210119Z  2025-03-14T06:47:57.4210491Z  2025-03-14T06:47:57.4210870Z  2025-03-14T06:47:57.4211253Z  2025-03-14T06:47:57.4211629Z  2025-03-14T06:47:57.4212020Z  2025-03-14T06:47:57.4212927Z [20,393 / 20,653] 6 / 17 tests; 46 actions running; last test: ..._client_test 2025-03-14T06:47:57.4213860Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local 2025-03-14T06:47:57.4214566Z Compiling torch_xla/csrc/ops/cat.cpp; 31s local 2025-03-14T06:47:57.4215287Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 31s local 2025-03-14T06:47:57.4216016Z Compiling torch_xla/csrc/ops/cast.cpp; 31s local 2025-03-14T06:47:57.4216758Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 30s local 2025-03-14T06:47:57.4217620Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 29s local 2025-03-14T06:47:57.4218503Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 28s local 2025-03-14T06:47:57.4219340Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 28s local ... 2025-03-14T06:47:57.8212371Z 2025-03-14T06:47:57.8213263Z  2025-03-14T06:47:57.8213736Z  2025-03-14T06:47:57.8214132Z  2025-03-14T06:47:57.8214507Z  2025-03-14T06:47:57.8214906Z  2025-03-14T06:47:57.8215277Z  2025-03-14T06:47:57.8215698Z  2025-03-14T06:47:57.8216092Z  2025-03-14T06:47:57.8216976Z [20,393 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:57.8217911Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local 2025-03-14T06:47:57.8218664Z Compiling torch_xla/csrc/ops/cat.cpp; 32s local 2025-03-14T06:47:57.8219368Z Compiling torch_xla/csrc/ops/cast_int4.cpp; 31s local 2025-03-14T06:47:57.8220126Z Compiling torch_xla/csrc/ops/cast.cpp; 31s local 2025-03-14T06:47:57.8220929Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 30s local 2025-03-14T06:47:57.8221832Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 30s local 2025-03-14T06:47:57.8222772Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 29s local 2025-03-14T06:47:57.8224120Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 28s local ... 2025-03-14T06:47:58.0318461Z 2025-03-14T06:47:58.0319349Z  2025-03-14T06:47:58.0319800Z  2025-03-14T06:47:58.0320229Z  2025-03-14T06:47:58.0320661Z  2025-03-14T06:47:58.0321063Z  2025-03-14T06:47:58.0321453Z  2025-03-14T06:47:58.0321858Z  2025-03-14T06:47:58.0322249Z  2025-03-14T06:47:58.0323480Z [20,394 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:58.0324630Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local 2025-03-14T06:47:58.0325402Z Compiling torch_xla/csrc/ops/cat.cpp; 32s local 2025-03-14T06:47:58.0326128Z Compiling torch_xla/csrc/ops/cast.cpp; 31s local 2025-03-14T06:47:58.0326896Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 30s local 2025-03-14T06:47:58.0327794Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 30s local 2025-03-14T06:47:58.0328708Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 29s local 2025-03-14T06:47:58.0329636Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 28s local 2025-03-14T06:47:58.0330588Z Compiling torch_xla/csrc/ops/as_strided.cpp; 28s local ... 2025-03-14T06:47:58.4217626Z 2025-03-14T06:47:58.4219442Z  2025-03-14T06:47:58.4219933Z  2025-03-14T06:47:58.4220353Z  2025-03-14T06:47:58.4220750Z  2025-03-14T06:47:58.4221469Z  2025-03-14T06:47:58.4221878Z  2025-03-14T06:47:58.4222270Z  2025-03-14T06:47:58.4222787Z  2025-03-14T06:47:58.4223765Z [20,394 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:58.4224843Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local 2025-03-14T06:47:58.4225654Z Compiling torch_xla/csrc/ops/cat.cpp; 32s local 2025-03-14T06:47:58.4226439Z Compiling torch_xla/csrc/ops/cast.cpp; 32s local 2025-03-14T06:47:58.4227248Z Compiling torch_xla/csrc/ops/bernoulli.cpp; 31s local 2025-03-14T06:47:58.4228159Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 30s local 2025-03-14T06:47:58.4229056Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 29s local 2025-03-14T06:47:58.4230008Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 29s local 2025-03-14T06:47:58.4230924Z Compiling torch_xla/csrc/ops/as_strided.cpp; 28s local ... 2025-03-14T06:47:58.8850373Z 2025-03-14T06:47:58.8851236Z  2025-03-14T06:47:58.8851692Z  2025-03-14T06:47:58.8852101Z  2025-03-14T06:47:58.8852471Z  2025-03-14T06:47:58.8852838Z  2025-03-14T06:47:58.8853221Z  2025-03-14T06:47:58.8853599Z  2025-03-14T06:47:58.8853967Z  2025-03-14T06:47:58.8854794Z [20,395 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:58.8855727Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2025-03-14T06:47:58.8856427Z Compiling torch_xla/csrc/ops/cat.cpp; 33s local 2025-03-14T06:47:58.8857107Z Compiling torch_xla/csrc/ops/cast.cpp; 32s local 2025-03-14T06:47:58.8858068Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 31s local 2025-03-14T06:47:58.8858972Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 30s local 2025-03-14T06:47:58.8859722Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 29s local 2025-03-14T06:47:58.8860436Z Compiling torch_xla/csrc/ops/as_strided.cpp; 29s local 2025-03-14T06:47:58.8861131Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 28s local ... 2025-03-14T06:47:59.2224418Z 2025-03-14T06:47:59.2225289Z  2025-03-14T06:47:59.2225814Z  2025-03-14T06:47:59.2226237Z  2025-03-14T06:47:59.2226632Z  2025-03-14T06:47:59.2227055Z  2025-03-14T06:47:59.2227468Z  2025-03-14T06:47:59.2227892Z  2025-03-14T06:47:59.2228286Z  2025-03-14T06:47:59.2229507Z [20,395 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:47:59.2230524Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local 2025-03-14T06:47:59.2231280Z Compiling torch_xla/csrc/ops/cat.cpp; 33s local 2025-03-14T06:47:59.2232041Z Compiling torch_xla/csrc/ops/cast.cpp; 32s local 2025-03-14T06:47:59.2232914Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 31s local 2025-03-14T06:47:59.2233774Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 30s local 2025-03-14T06:47:59.2234820Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 29s local 2025-03-14T06:47:59.2235691Z Compiling torch_xla/csrc/ops/as_strided.cpp; 29s local 2025-03-14T06:47:59.2236536Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 28s local ... 2025-03-14T06:47:59.5137251Z 2025-03-14T06:47:59.5139116Z  2025-03-14T06:47:59.5139561Z  2025-03-14T06:47:59.5139918Z  2025-03-14T06:47:59.5140267Z  2025-03-14T06:47:59.5140611Z  2025-03-14T06:47:59.5140952Z  2025-03-14T06:47:59.5141327Z  2025-03-14T06:47:59.5141669Z  2025-03-14T06:47:59.5142501Z [20,396 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:59.5143632Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2025-03-14T06:47:59.5144297Z Compiling torch_xla/csrc/ops/cast.cpp; 33s local 2025-03-14T06:47:59.5145048Z Compiling torch_xla/csrc/ops/avg_pool_nd_backward.cpp; 31s local 2025-03-14T06:47:59.5145949Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 31s local 2025-03-14T06:47:59.5146761Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 30s local 2025-03-14T06:47:59.5147555Z Compiling torch_xla/csrc/ops/as_strided.cpp; 30s local 2025-03-14T06:47:59.5148291Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 28s local 2025-03-14T06:47:59.5149125Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 28s local ... 2025-03-14T06:47:59.7905758Z 2025-03-14T06:47:59.7906618Z  2025-03-14T06:47:59.7907091Z  2025-03-14T06:47:59.7907475Z  2025-03-14T06:47:59.7907836Z  2025-03-14T06:47:59.7908203Z  2025-03-14T06:47:59.7908565Z  2025-03-14T06:47:59.7908943Z  2025-03-14T06:47:59.7909332Z  2025-03-14T06:47:59.7910218Z [20,397 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:47:59.7911123Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2025-03-14T06:47:59.7911823Z Compiling torch_xla/csrc/ops/cast.cpp; 33s local 2025-03-14T06:47:59.7912539Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 31s local 2025-03-14T06:47:59.7913378Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 30s local 2025-03-14T06:47:59.7914181Z Compiling torch_xla/csrc/ops/as_strided.cpp; 30s local 2025-03-14T06:47:59.7914963Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 29s local 2025-03-14T06:47:59.7915772Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 29s local 2025-03-14T06:47:59.7916473Z //torch_xla/csrc:tensor; 28s local ... 2025-03-14T06:48:00.0231899Z 2025-03-14T06:48:00.0232762Z  2025-03-14T06:48:00.0233301Z  2025-03-14T06:48:00.0233712Z  2025-03-14T06:48:00.0234118Z  2025-03-14T06:48:00.0234483Z  2025-03-14T06:48:00.0234861Z  2025-03-14T06:48:00.0235271Z  2025-03-14T06:48:00.0235653Z  2025-03-14T06:48:00.0236572Z [20,397 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:00.0237622Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2025-03-14T06:48:00.0238386Z Compiling torch_xla/csrc/ops/cast.cpp; 33s local 2025-03-14T06:48:00.0239191Z Compiling torch_xla/csrc/ops/avg_pool_nd.cpp; 31s local 2025-03-14T06:48:00.0240099Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 30s local 2025-03-14T06:48:00.0241025Z Compiling torch_xla/csrc/ops/as_strided.cpp; 30s local 2025-03-14T06:48:00.0242208Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 29s local 2025-03-14T06:48:00.0243073Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 29s local 2025-03-14T06:48:00.0243844Z //torch_xla/csrc:tensor; 29s local ... 2025-03-14T06:48:00.7957051Z 2025-03-14T06:48:00.7958467Z  2025-03-14T06:48:00.7958991Z  2025-03-14T06:48:00.7960422Z  2025-03-14T06:48:00.7961495Z  2025-03-14T06:48:00.7962572Z  2025-03-14T06:48:00.7963780Z  2025-03-14T06:48:00.7965072Z  2025-03-14T06:48:00.7966117Z  2025-03-14T06:48:00.7967679Z [20,398 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:00.7969048Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2025-03-14T06:48:00.7970074Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2025-03-14T06:48:00.7971210Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 31s local 2025-03-14T06:48:00.7972422Z Compiling torch_xla/csrc/ops/as_strided.cpp; 31s local 2025-03-14T06:48:00.7973602Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 30s local 2025-03-14T06:48:00.7974883Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 30s local 2025-03-14T06:48:00.7976195Z //torch_xla/csrc:tensor; 29s local 2025-03-14T06:48:00.7977296Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 29s local ... 2025-03-14T06:48:01.0238541Z 2025-03-14T06:48:01.0239368Z  2025-03-14T06:48:01.0240160Z  2025-03-14T06:48:01.0240537Z  2025-03-14T06:48:01.0240944Z  2025-03-14T06:48:01.0241366Z  2025-03-14T06:48:01.0241772Z  2025-03-14T06:48:01.0242173Z  2025-03-14T06:48:01.0242559Z  2025-03-14T06:48:01.0243505Z [20,398 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:01.0244686Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2025-03-14T06:48:01.0245467Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local 2025-03-14T06:48:01.0246366Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 31s local 2025-03-14T06:48:01.0247220Z Compiling torch_xla/csrc/ops/as_strided.cpp; 31s local 2025-03-14T06:48:01.0247990Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 30s local 2025-03-14T06:48:01.0248907Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 30s local 2025-03-14T06:48:01.0249731Z //torch_xla/csrc:tensor; 30s local 2025-03-14T06:48:01.0250437Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 30s local ... 2025-03-14T06:48:02.0246133Z 2025-03-14T06:48:02.0246953Z  2025-03-14T06:48:02.0247376Z  2025-03-14T06:48:02.0247728Z  2025-03-14T06:48:02.0248070Z  2025-03-14T06:48:02.0248408Z  2025-03-14T06:48:02.0248740Z  2025-03-14T06:48:02.0249077Z  2025-03-14T06:48:02.0249415Z  2025-03-14T06:48:02.0250191Z [20,399 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:02.0251026Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local 2025-03-14T06:48:02.0251756Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 32s local 2025-03-14T06:48:02.0252522Z Compiling torch_xla/csrc/ops/as_strided.cpp; 32s local 2025-03-14T06:48:02.0253256Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 31s local 2025-03-14T06:48:02.0254014Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 31s local 2025-03-14T06:48:02.0254660Z //torch_xla/csrc:tensor; 31s local 2025-03-14T06:48:02.0255274Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 31s local 2025-03-14T06:48:02.0255965Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 30s local ... 2025-03-14T06:48:02.2249552Z 2025-03-14T06:48:02.2250366Z  2025-03-14T06:48:02.2250783Z  2025-03-14T06:48:02.2251141Z  2025-03-14T06:48:02.2251461Z  2025-03-14T06:48:02.2251810Z  2025-03-14T06:48:02.2252178Z  2025-03-14T06:48:02.2252525Z  2025-03-14T06:48:02.2252862Z  2025-03-14T06:48:02.2254005Z [20,399 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:02.2254918Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local 2025-03-14T06:48:02.2255679Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 32s local 2025-03-14T06:48:02.2256481Z Compiling torch_xla/csrc/ops/as_strided.cpp; 32s local 2025-03-14T06:48:02.2257265Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 31s local 2025-03-14T06:48:02.2258033Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 31s local 2025-03-14T06:48:02.2259250Z //torch_xla/csrc:tensor; 31s local 2025-03-14T06:48:02.2259848Z Compiling torch_xla/csrc/ops/all_to_all.cpp; 31s local 2025-03-14T06:48:02.2260664Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 30s local ... 2025-03-14T06:48:02.5642746Z 2025-03-14T06:48:02.5643630Z  2025-03-14T06:48:02.5644826Z  2025-03-14T06:48:02.5646391Z  2025-03-14T06:48:02.5647143Z  2025-03-14T06:48:02.5647494Z  2025-03-14T06:48:02.5647862Z  2025-03-14T06:48:02.5648188Z  2025-03-14T06:48:02.5648517Z  2025-03-14T06:48:02.5649282Z [20,400 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:02.5650355Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2025-03-14T06:48:02.5651056Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 33s local 2025-03-14T06:48:02.5651896Z Compiling torch_xla/csrc/ops/as_strided.cpp; 33s local 2025-03-14T06:48:02.5652576Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 32s local 2025-03-14T06:48:02.5653304Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 31s local 2025-03-14T06:48:02.5653906Z //torch_xla/csrc:tensor; 31s local 2025-03-14T06:48:02.5654459Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 30s local 2025-03-14T06:48:02.5655129Z Compiling torch_xla/csrc/ops/all_gather.cpp; 30s local ... 2025-03-14T06:48:02.7964432Z 2025-03-14T06:48:02.7965894Z  2025-03-14T06:48:02.7966407Z  2025-03-14T06:48:02.7966818Z  2025-03-14T06:48:02.7967222Z  2025-03-14T06:48:02.7967633Z  2025-03-14T06:48:02.7968023Z  2025-03-14T06:48:02.7968424Z  2025-03-14T06:48:02.7968822Z  2025-03-14T06:48:02.7969660Z [20,401 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:02.7970560Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2025-03-14T06:48:02.7971471Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 33s local 2025-03-14T06:48:02.7972363Z Compiling torch_xla/csrc/ops/as_strided.cpp; 33s local 2025-03-14T06:48:02.7973236Z Compiling torch_xla/csrc/ops/arithmetic_ir_ops.cpp; 32s local 2025-03-14T06:48:02.7974151Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 32s local 2025-03-14T06:48:02.7974875Z //torch_xla/csrc:tensor; 31s local 2025-03-14T06:48:02.7975481Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 31s local 2025-03-14T06:48:02.7976305Z Compiling torch_xla/csrc/ops/all_gather.cpp; 30s local ... 2025-03-14T06:48:03.0160951Z 2025-03-14T06:48:03.0161791Z  2025-03-14T06:48:03.0162186Z  2025-03-14T06:48:03.0162517Z  2025-03-14T06:48:03.0162822Z  2025-03-14T06:48:03.0163121Z  2025-03-14T06:48:03.0163467Z  2025-03-14T06:48:03.0163865Z  2025-03-14T06:48:03.0164281Z  2025-03-14T06:48:03.0165522Z [20,402 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:03.0166579Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2025-03-14T06:48:03.0167421Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 33s local 2025-03-14T06:48:03.0168102Z Compiling torch_xla/csrc/ops/as_strided.cpp; 33s local 2025-03-14T06:48:03.0168731Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 32s local 2025-03-14T06:48:03.0169316Z //torch_xla/csrc:tensor; 32s local 2025-03-14T06:48:03.0170124Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 31s local 2025-03-14T06:48:03.0170892Z Compiling torch_xla/csrc/ops/all_gather.cpp; 31s local 2025-03-14T06:48:03.0171735Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 30s local ... 2025-03-14T06:48:03.2256539Z 2025-03-14T06:48:03.2257726Z  2025-03-14T06:48:03.2258223Z  2025-03-14T06:48:03.2258601Z  2025-03-14T06:48:03.2258917Z  2025-03-14T06:48:03.2259240Z  2025-03-14T06:48:03.2259639Z  2025-03-14T06:48:03.2260029Z  2025-03-14T06:48:03.2260421Z  2025-03-14T06:48:03.2261782Z [20,402 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:03.2262890Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2025-03-14T06:48:03.2263604Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 33s local 2025-03-14T06:48:03.2264492Z Compiling torch_xla/csrc/ops/as_strided.cpp; 33s local 2025-03-14T06:48:03.2265591Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 32s local 2025-03-14T06:48:03.2266513Z //torch_xla/csrc:tensor; 32s local 2025-03-14T06:48:03.2267183Z Compiling torch_xla/csrc/ops/all_reduce.cpp; 31s local 2025-03-14T06:48:03.2268142Z Compiling torch_xla/csrc/ops/all_gather.cpp; 31s local 2025-03-14T06:48:03.2269051Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 30s local ... 2025-03-14T06:48:03.8261787Z 2025-03-14T06:48:03.8262898Z  2025-03-14T06:48:03.8263292Z  2025-03-14T06:48:03.8263674Z  2025-03-14T06:48:03.8263995Z  2025-03-14T06:48:03.8264312Z  2025-03-14T06:48:03.8264619Z  2025-03-14T06:48:03.8264923Z  2025-03-14T06:48:03.8265232Z  2025-03-14T06:48:03.8266194Z [20,404 / 20,653] 6 / 17 tests; 46 actions running; last test: ..._client_test 2025-03-14T06:48:03.8267034Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 34s local 2025-03-14T06:48:03.8267748Z Compiling torch_xla/csrc/ops/as_strided.cpp; 34s local 2025-03-14T06:48:03.8268464Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 33s local 2025-03-14T06:48:03.8269218Z //torch_xla/csrc:tensor; 32s local 2025-03-14T06:48:03.8269840Z Compiling torch_xla/csrc/ops/all_gather.cpp; 31s local 2025-03-14T06:48:03.8270661Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 30s local 2025-03-14T06:48:03.8271548Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 30s local 2025-03-14T06:48:03.8272440Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 30s local ... 2025-03-14T06:48:04.0457739Z 2025-03-14T06:48:04.0458581Z  2025-03-14T06:48:04.0459022Z  2025-03-14T06:48:04.0459392Z  2025-03-14T06:48:04.0459772Z  2025-03-14T06:48:04.0460141Z  2025-03-14T06:48:04.0460502Z  2025-03-14T06:48:04.0460872Z  2025-03-14T06:48:04.0461231Z  2025-03-14T06:48:04.0462075Z [20,405 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:04.0463085Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 34s local 2025-03-14T06:48:04.0463975Z Compiling torch_xla/csrc/ops/as_strided.cpp; 34s local 2025-03-14T06:48:04.0464921Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 33s local 2025-03-14T06:48:04.0465812Z //torch_xla/csrc:tensor; 33s local 2025-03-14T06:48:04.0466407Z Compiling torch_xla/csrc/ops/all_gather.cpp; 32s local 2025-03-14T06:48:04.0467173Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 31s local 2025-03-14T06:48:04.0467982Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 30s local 2025-03-14T06:48:04.0468752Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 30s local ... 2025-03-14T06:48:04.4266305Z 2025-03-14T06:48:04.4267198Z  2025-03-14T06:48:04.4267627Z  2025-03-14T06:48:04.4267980Z  2025-03-14T06:48:04.4268344Z  2025-03-14T06:48:04.4268693Z  2025-03-14T06:48:04.4269032Z  2025-03-14T06:48:04.4269359Z  2025-03-14T06:48:04.4269923Z  2025-03-14T06:48:04.4270725Z [20,405 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:04.4271674Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 35s local 2025-03-14T06:48:04.4272619Z Compiling torch_xla/csrc/ops/as_strided.cpp; 34s local 2025-03-14T06:48:04.4273590Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 33s local 2025-03-14T06:48:04.4274336Z //torch_xla/csrc:tensor; 33s local 2025-03-14T06:48:04.4275147Z Compiling torch_xla/csrc/ops/all_gather.cpp; 32s local 2025-03-14T06:48:04.4275948Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 31s local 2025-03-14T06:48:04.4276824Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 31s local 2025-03-14T06:48:04.4277740Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 30s local ... 2025-03-14T06:48:04.6269554Z 2025-03-14T06:48:04.6270373Z  2025-03-14T06:48:04.6270784Z  2025-03-14T06:48:04.6271156Z  2025-03-14T06:48:04.6271505Z  2025-03-14T06:48:04.6271827Z  2025-03-14T06:48:04.6272158Z  2025-03-14T06:48:04.6272519Z  2025-03-14T06:48:04.6272882Z  2025-03-14T06:48:04.6273964Z [20,406 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:04.6275182Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 35s local 2025-03-14T06:48:04.6276141Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2025-03-14T06:48:04.6276861Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 33s local 2025-03-14T06:48:04.6277478Z //torch_xla/csrc:tensor; 33s local 2025-03-14T06:48:04.6278104Z Compiling torch_xla/csrc/ops/adaptive_max_pool2d.cpp; 31s local 2025-03-14T06:48:04.6278872Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 31s local 2025-03-14T06:48:04.6279678Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 31s local 2025-03-14T06:48:04.6280466Z Compiling torch_xla/csrc/RegisterXLA.cpp; 30s local ... 2025-03-14T06:48:04.9947274Z 2025-03-14T06:48:04.9948376Z  2025-03-14T06:48:04.9948770Z  2025-03-14T06:48:04.9949086Z  2025-03-14T06:48:04.9949400Z  2025-03-14T06:48:04.9949744Z  2025-03-14T06:48:04.9950180Z  2025-03-14T06:48:04.9950483Z  2025-03-14T06:48:04.9950811Z  2025-03-14T06:48:04.9951562Z [20,407 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:04.9952464Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 35s local 2025-03-14T06:48:04.9953190Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2025-03-14T06:48:04.9953874Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 34s local 2025-03-14T06:48:04.9954462Z //torch_xla/csrc:tensor; 34s local 2025-03-14T06:48:04.9955227Z Compiling torch_xla/csrc/ops/adam_optimizer_step.cpp; 31s local 2025-03-14T06:48:04.9955956Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 31s local 2025-03-14T06:48:04.9956610Z Compiling torch_xla/csrc/RegisterXLA.cpp; 30s local 2025-03-14T06:48:04.9957315Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 26s local ... 2025-03-14T06:48:05.1958656Z 2025-03-14T06:48:05.1959821Z  2025-03-14T06:48:05.1960265Z  2025-03-14T06:48:05.1960660Z  2025-03-14T06:48:05.1961027Z  2025-03-14T06:48:05.1961404Z  2025-03-14T06:48:05.1961793Z  2025-03-14T06:48:05.1962172Z  2025-03-14T06:48:05.1962506Z  2025-03-14T06:48:05.1963350Z [20,408 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:05.1964648Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 35s local 2025-03-14T06:48:05.1965675Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2025-03-14T06:48:05.1966616Z Compiling torch_xla/csrc/ops/amp_update_scale.cpp; 34s local 2025-03-14T06:48:05.1967533Z //torch_xla/csrc:tensor; 34s local 2025-03-14T06:48:05.1968763Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 31s local 2025-03-14T06:48:05.1969675Z Compiling torch_xla/csrc/RegisterXLA.cpp; 31s local 2025-03-14T06:48:05.1970432Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 27s local 2025-03-14T06:48:05.1971289Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 26s local ... 2025-03-14T06:48:05.4280687Z 2025-03-14T06:48:05.4282193Z  2025-03-14T06:48:05.4282739Z  2025-03-14T06:48:05.4283130Z  2025-03-14T06:48:05.4283501Z  2025-03-14T06:48:05.4284147Z  2025-03-14T06:48:05.4284707Z  2025-03-14T06:48:05.4285109Z  2025-03-14T06:48:05.4285482Z  2025-03-14T06:48:05.4286378Z [20,409 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:05.4287494Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local 2025-03-14T06:48:05.4288405Z Compiling torch_xla/csrc/ops/as_strided.cpp; 35s local 2025-03-14T06:48:05.4289070Z //torch_xla/csrc:tensor; 34s local 2025-03-14T06:48:05.4289763Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 31s local 2025-03-14T06:48:05.4290590Z Compiling torch_xla/csrc/RegisterXLA.cpp; 31s local 2025-03-14T06:48:05.4291649Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 27s local 2025-03-14T06:48:05.4292536Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 26s local 2025-03-14T06:48:05.4293494Z Compiling torch_xla/csrc/xla_op_builder.cpp; 26s local ... 2025-03-14T06:48:05.7956950Z 2025-03-14T06:48:05.7957798Z  2025-03-14T06:48:05.7958281Z  2025-03-14T06:48:05.7958682Z  2025-03-14T06:48:05.7959083Z  2025-03-14T06:48:05.7959456Z  2025-03-14T06:48:05.7959838Z  2025-03-14T06:48:05.7960205Z  2025-03-14T06:48:05.7960593Z  2025-03-14T06:48:05.7961504Z [20,410 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:05.7962549Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local 2025-03-14T06:48:05.7963449Z Compiling torch_xla/csrc/ops/as_strided.cpp; 36s local 2025-03-14T06:48:05.7964257Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 32s local 2025-03-14T06:48:05.7965248Z Compiling torch_xla/csrc/RegisterXLA.cpp; 31s local 2025-03-14T06:48:05.7966261Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 27s local 2025-03-14T06:48:05.7967144Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 27s local 2025-03-14T06:48:05.7967964Z Compiling torch_xla/csrc/xla_op_builder.cpp; 27s local 2025-03-14T06:48:05.7968847Z Compiling torch_xla/csrc/xla_lower_util.cpp; 25s local ... 2025-03-14T06:48:06.0285617Z 2025-03-14T06:48:06.0286515Z  2025-03-14T06:48:06.0286951Z  2025-03-14T06:48:06.0287342Z  2025-03-14T06:48:06.0287719Z  2025-03-14T06:48:06.0288059Z  2025-03-14T06:48:06.0288388Z  2025-03-14T06:48:06.0288738Z  2025-03-14T06:48:06.0289086Z  2025-03-14T06:48:06.0289944Z [20,410 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:06.0290836Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 36s local 2025-03-14T06:48:06.0291658Z Compiling torch_xla/csrc/ops/as_strided.cpp; 36s local 2025-03-14T06:48:06.0292319Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 32s local 2025-03-14T06:48:06.0292982Z Compiling torch_xla/csrc/RegisterXLA.cpp; 31s local 2025-03-14T06:48:06.0293658Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 27s local 2025-03-14T06:48:06.0294337Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 27s local 2025-03-14T06:48:06.0294994Z Compiling torch_xla/csrc/xla_op_builder.cpp; 27s local 2025-03-14T06:48:06.0295732Z Compiling torch_xla/csrc/xla_lower_util.cpp; 26s local ... 2025-03-14T06:48:06.9095468Z 2025-03-14T06:48:06.9096346Z  2025-03-14T06:48:06.9096797Z  2025-03-14T06:48:06.9097182Z  2025-03-14T06:48:06.9097813Z  2025-03-14T06:48:06.9098219Z  2025-03-14T06:48:06.9098584Z  2025-03-14T06:48:06.9098951Z  2025-03-14T06:48:06.9099300Z  2025-03-14T06:48:06.9100162Z [20,411 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:06.9101170Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 37s local 2025-03-14T06:48:06.9102021Z Compiling torch_xla/csrc/ops/as_strided.cpp; 37s local 2025-03-14T06:48:06.9102936Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 33s local 2025-03-14T06:48:06.9103736Z Compiling torch_xla/csrc/RegisterXLA.cpp; 32s local 2025-03-14T06:48:06.9104538Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 28s local 2025-03-14T06:48:06.9105351Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 28s local 2025-03-14T06:48:06.9106107Z Compiling torch_xla/csrc/xla_op_builder.cpp; 28s local 2025-03-14T06:48:07.2293728Z Compiling torch_xla/csrc/xla_lower_util.cpp; 27s local ... 2025-03-14T06:48:07.2294341Z 2025-03-14T06:48:07.2294767Z  2025-03-14T06:48:07.2295164Z  2025-03-14T06:48:07.2295511Z  2025-03-14T06:48:07.2295934Z  2025-03-14T06:48:07.2296559Z  2025-03-14T06:48:07.2296920Z  2025-03-14T06:48:07.2297304Z  2025-03-14T06:48:07.2297700Z  2025-03-14T06:48:07.2298546Z [20,411 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:07.2299575Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 37s local 2025-03-14T06:48:07.2300235Z Compiling torch_xla/csrc/ops/as_strided.cpp; 37s local 2025-03-14T06:48:07.2300918Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 33s local 2025-03-14T06:48:07.2301553Z Compiling torch_xla/csrc/RegisterXLA.cpp; 33s local 2025-03-14T06:48:07.2302266Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 29s local 2025-03-14T06:48:07.2303150Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 28s local 2025-03-14T06:48:07.2303913Z Compiling torch_xla/csrc/xla_op_builder.cpp; 28s local 2025-03-14T06:48:07.2304595Z Compiling torch_xla/csrc/xla_lower_util.cpp; 27s local ... 2025-03-14T06:48:07.4561422Z 2025-03-14T06:48:07.4562916Z  2025-03-14T06:48:07.4563448Z  2025-03-14T06:48:07.4563933Z  2025-03-14T06:48:07.4564349Z  2025-03-14T06:48:07.4564902Z  2025-03-14T06:48:07.4573014Z  2025-03-14T06:48:07.4573777Z  2025-03-14T06:48:07.4574251Z  2025-03-14T06:48:07.4575268Z [20,413 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:07.4576298Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 33s local 2025-03-14T06:48:07.4577171Z Compiling torch_xla/csrc/RegisterXLA.cpp; 33s local 2025-03-14T06:48:07.4578003Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 29s local 2025-03-14T06:48:07.4578934Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 28s local 2025-03-14T06:48:07.4579785Z Compiling torch_xla/csrc/xla_op_builder.cpp; 28s local 2025-03-14T06:48:07.4580606Z Compiling torch_xla/csrc/xla_lower_util.cpp; 27s local 2025-03-14T06:48:07.4581386Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 27s local 2025-03-14T06:48:07.4582285Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 26s local ... 2025-03-14T06:48:07.8298294Z 2025-03-14T06:48:07.8299775Z  2025-03-14T06:48:07.8300351Z  2025-03-14T06:48:07.8300795Z  2025-03-14T06:48:07.8301254Z  2025-03-14T06:48:07.8301725Z  2025-03-14T06:48:07.8302147Z  2025-03-14T06:48:07.8302509Z  2025-03-14T06:48:07.8302858Z  2025-03-14T06:48:07.8303720Z [20,413 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:07.8304687Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 34s local 2025-03-14T06:48:07.8305466Z Compiling torch_xla/csrc/RegisterXLA.cpp; 33s local 2025-03-14T06:48:07.8306539Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 29s local 2025-03-14T06:48:07.8307404Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 29s local 2025-03-14T06:48:07.8308210Z Compiling torch_xla/csrc/xla_op_builder.cpp; 29s local 2025-03-14T06:48:07.8308953Z Compiling torch_xla/csrc/xla_lower_util.cpp; 27s local 2025-03-14T06:48:07.8309760Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 27s local 2025-03-14T06:48:07.8310617Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 26s local ... 2025-03-14T06:48:08.2302489Z 2025-03-14T06:48:08.2304215Z  2025-03-14T06:48:08.2304764Z  2025-03-14T06:48:08.2305142Z  2025-03-14T06:48:08.2305529Z  2025-03-14T06:48:08.2305919Z  2025-03-14T06:48:08.2306312Z  2025-03-14T06:48:08.2306687Z  2025-03-14T06:48:08.2307080Z  2025-03-14T06:48:08.2308043Z [20,414 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:08.2309173Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 34s local 2025-03-14T06:48:08.2310018Z Compiling torch_xla/csrc/RegisterXLA.cpp; 34s local 2025-03-14T06:48:08.2310903Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 30s local 2025-03-14T06:48:08.2312085Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 29s local 2025-03-14T06:48:08.2312931Z Compiling torch_xla/csrc/xla_op_builder.cpp; 29s local 2025-03-14T06:48:08.2313926Z Compiling torch_xla/csrc/xla_lower_util.cpp; 28s local 2025-03-14T06:48:08.2314822Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 28s local 2025-03-14T06:48:08.2315714Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 26s local ... 2025-03-14T06:48:08.6306116Z 2025-03-14T06:48:08.6307611Z  2025-03-14T06:48:08.6308109Z  2025-03-14T06:48:08.6308594Z  2025-03-14T06:48:08.6309037Z  2025-03-14T06:48:08.6309497Z  2025-03-14T06:48:08.6309874Z  2025-03-14T06:48:08.6310229Z  2025-03-14T06:48:08.6310594Z  2025-03-14T06:48:08.6311461Z [20,414 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:08.6312422Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 35s local 2025-03-14T06:48:08.6313205Z Compiling torch_xla/csrc/RegisterXLA.cpp; 34s local 2025-03-14T06:48:08.6313994Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 30s local 2025-03-14T06:48:08.6314821Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 30s local 2025-03-14T06:48:08.6315585Z Compiling torch_xla/csrc/xla_op_builder.cpp; 30s local 2025-03-14T06:48:08.6316318Z Compiling torch_xla/csrc/xla_lower_util.cpp; 28s local 2025-03-14T06:48:08.6317079Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 28s local 2025-03-14T06:48:08.6317841Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 27s local ... 2025-03-14T06:48:09.6313581Z 2025-03-14T06:48:09.6314658Z  2025-03-14T06:48:09.6315174Z  2025-03-14T06:48:09.6315570Z  2025-03-14T06:48:09.6315964Z  2025-03-14T06:48:09.6316391Z  2025-03-14T06:48:09.6316744Z  2025-03-14T06:48:09.6317106Z  2025-03-14T06:48:09.6317562Z  2025-03-14T06:48:09.6318563Z [20,414 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:09.6319643Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 36s local 2025-03-14T06:48:09.6320490Z Compiling torch_xla/csrc/RegisterXLA.cpp; 35s local 2025-03-14T06:48:09.6321390Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 31s local 2025-03-14T06:48:09.6322320Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 31s local 2025-03-14T06:48:09.6323171Z Compiling torch_xla/csrc/xla_op_builder.cpp; 31s local 2025-03-14T06:48:09.6324133Z Compiling torch_xla/csrc/xla_lower_util.cpp; 29s local 2025-03-14T06:48:09.6325153Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 29s local 2025-03-14T06:48:09.6326301Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 28s local ... 2025-03-14T06:48:10.6321449Z 2025-03-14T06:48:10.6322305Z  2025-03-14T06:48:10.6322796Z  2025-03-14T06:48:10.6323193Z  2025-03-14T06:48:10.6323592Z  2025-03-14T06:48:10.6324025Z  2025-03-14T06:48:10.6324421Z  2025-03-14T06:48:10.6324962Z  2025-03-14T06:48:10.6325367Z  2025-03-14T06:48:10.6326303Z [20,414 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:10.6327625Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 37s local 2025-03-14T06:48:10.6328741Z Compiling torch_xla/csrc/RegisterXLA.cpp; 36s local 2025-03-14T06:48:10.6329609Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 32s local 2025-03-14T06:48:10.6330492Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 32s local 2025-03-14T06:48:10.6331319Z Compiling torch_xla/csrc/xla_op_builder.cpp; 32s local 2025-03-14T06:48:10.6332131Z Compiling torch_xla/csrc/xla_lower_util.cpp; 30s local 2025-03-14T06:48:10.6332949Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 30s local 2025-03-14T06:48:10.6333801Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 29s local ... 2025-03-14T06:48:11.6329273Z 2025-03-14T06:48:11.6330484Z  2025-03-14T06:48:11.6330982Z  2025-03-14T06:48:11.6331387Z  2025-03-14T06:48:11.6331811Z  2025-03-14T06:48:11.6332219Z  2025-03-14T06:48:11.6332963Z  2025-03-14T06:48:11.6333361Z  2025-03-14T06:48:11.6333766Z  2025-03-14T06:48:11.6345359Z [20,414 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:11.6346443Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 38s local 2025-03-14T06:48:11.6347241Z Compiling torch_xla/csrc/RegisterXLA.cpp; 37s local 2025-03-14T06:48:11.6348089Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 33s local 2025-03-14T06:48:11.6348966Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 33s local 2025-03-14T06:48:11.6349777Z Compiling torch_xla/csrc/xla_op_builder.cpp; 33s local 2025-03-14T06:48:11.6350560Z Compiling torch_xla/csrc/xla_lower_util.cpp; 31s local 2025-03-14T06:48:11.6351399Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 31s local 2025-03-14T06:48:11.6352292Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 30s local ... 2025-03-14T06:48:12.0333597Z 2025-03-14T06:48:12.0334762Z  2025-03-14T06:48:12.0335354Z  2025-03-14T06:48:12.0335869Z  2025-03-14T06:48:12.0336233Z  2025-03-14T06:48:12.0336629Z  2025-03-14T06:48:12.0337023Z  2025-03-14T06:48:12.0337415Z  2025-03-14T06:48:12.0337836Z  2025-03-14T06:48:12.0338791Z [20,415 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:12.0339881Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 38s local 2025-03-14T06:48:12.0340737Z Compiling torch_xla/csrc/RegisterXLA.cpp; 37s local 2025-03-14T06:48:12.0341676Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 33s local 2025-03-14T06:48:12.0342565Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 33s local 2025-03-14T06:48:12.0343384Z Compiling torch_xla/csrc/xla_op_builder.cpp; 33s local 2025-03-14T06:48:12.0344245Z Compiling torch_xla/csrc/xla_lower_util.cpp; 32s local 2025-03-14T06:48:12.0345066Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 31s local 2025-03-14T06:48:12.0345989Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 30s local ... 2025-03-14T06:48:12.4338083Z 2025-03-14T06:48:12.4339332Z  2025-03-14T06:48:12.4339870Z  2025-03-14T06:48:12.4340371Z  2025-03-14T06:48:12.4340721Z  2025-03-14T06:48:12.4341090Z  2025-03-14T06:48:12.4341587Z  2025-03-14T06:48:12.4341964Z  2025-03-14T06:48:12.4342393Z  2025-03-14T06:48:12.4343557Z [20,415 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:12.4344841Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 38s local 2025-03-14T06:48:12.4345737Z Compiling torch_xla/csrc/RegisterXLA.cpp; 38s local 2025-03-14T06:48:12.4346606Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 34s local 2025-03-14T06:48:12.4347621Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 33s local 2025-03-14T06:48:12.4348556Z Compiling torch_xla/csrc/xla_op_builder.cpp; 33s local 2025-03-14T06:48:12.4349422Z Compiling torch_xla/csrc/xla_lower_util.cpp; 32s local 2025-03-14T06:48:12.4350470Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 32s local 2025-03-14T06:48:12.4351314Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 31s local ... 2025-03-14T06:48:12.7861327Z 2025-03-14T06:48:12.7862569Z  2025-03-14T06:48:12.7863102Z  2025-03-14T06:48:12.7863526Z  2025-03-14T06:48:12.7863897Z  2025-03-14T06:48:12.7864311Z  2025-03-14T06:48:12.7864735Z  2025-03-14T06:48:12.7865152Z  2025-03-14T06:48:12.7865912Z  2025-03-14T06:48:12.7866845Z [20,416 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:12.7867899Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 39s local 2025-03-14T06:48:12.7869078Z Compiling torch_xla/csrc/RegisterXLA.cpp; 38s local 2025-03-14T06:48:12.7870055Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 34s local 2025-03-14T06:48:12.7871156Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 34s local 2025-03-14T06:48:12.7872035Z Compiling torch_xla/csrc/xla_op_builder.cpp; 34s local 2025-03-14T06:48:12.7873045Z Compiling torch_xla/csrc/xla_lower_util.cpp; 32s local 2025-03-14T06:48:12.7873884Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 32s local 2025-03-14T06:48:12.7874792Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 31s local ... 2025-03-14T06:48:13.0343969Z 2025-03-14T06:48:13.0345081Z  2025-03-14T06:48:13.0345644Z  2025-03-14T06:48:13.0346037Z  2025-03-14T06:48:13.0346527Z  2025-03-14T06:48:13.0346949Z  2025-03-14T06:48:13.0347311Z  2025-03-14T06:48:13.0347730Z  2025-03-14T06:48:13.0348102Z  2025-03-14T06:48:13.0349081Z [20,416 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:13.0350188Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 39s local 2025-03-14T06:48:13.0351040Z Compiling torch_xla/csrc/RegisterXLA.cpp; 38s local 2025-03-14T06:48:13.0351924Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 34s local 2025-03-14T06:48:13.0352845Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 34s local 2025-03-14T06:48:13.0353714Z Compiling torch_xla/csrc/xla_op_builder.cpp; 34s local 2025-03-14T06:48:13.0354567Z Compiling torch_xla/csrc/xla_lower_util.cpp; 33s local 2025-03-14T06:48:13.0355412Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 32s local 2025-03-14T06:48:13.0356508Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 31s local ... 2025-03-14T06:48:14.0350874Z 2025-03-14T06:48:14.0351792Z  2025-03-14T06:48:14.0352329Z  2025-03-14T06:48:14.0352797Z  2025-03-14T06:48:14.0353274Z  2025-03-14T06:48:14.0353745Z  2025-03-14T06:48:14.0354209Z  2025-03-14T06:48:14.0354543Z  2025-03-14T06:48:14.0354912Z  2025-03-14T06:48:14.0355782Z [20,417 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:14.0356823Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 40s local 2025-03-14T06:48:14.0357606Z Compiling torch_xla/csrc/RegisterXLA.cpp; 39s local 2025-03-14T06:48:14.0358423Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 35s local 2025-03-14T06:48:14.0359288Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 35s local 2025-03-14T06:48:14.0360100Z Compiling torch_xla/csrc/xla_op_builder.cpp; 35s local 2025-03-14T06:48:14.0361207Z Compiling torch_xla/csrc/xla_lower_util.cpp; 34s local 2025-03-14T06:48:14.0362054Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 33s local 2025-03-14T06:48:14.0362928Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 32s local ... 2025-03-14T06:48:14.4356698Z 2025-03-14T06:48:14.4357764Z  2025-03-14T06:48:14.4358286Z  2025-03-14T06:48:14.4358918Z  2025-03-14T06:48:14.4359342Z  2025-03-14T06:48:14.4359788Z  2025-03-14T06:48:14.4360243Z  2025-03-14T06:48:14.4360598Z  2025-03-14T06:48:14.4361019Z  2025-03-14T06:48:14.4362473Z [20,417 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:14.4363490Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 40s local 2025-03-14T06:48:14.4364390Z Compiling torch_xla/csrc/RegisterXLA.cpp; 40s local 2025-03-14T06:48:14.4365766Z Compiling torch_xla/csrc/xla_manual_registration.cpp; 36s local 2025-03-14T06:48:14.4366670Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 35s local 2025-03-14T06:48:14.4367532Z Compiling torch_xla/csrc/xla_op_builder.cpp; 35s local 2025-03-14T06:48:14.4368420Z Compiling torch_xla/csrc/xla_lower_util.cpp; 34s local 2025-03-14T06:48:14.4369656Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 34s local 2025-03-14T06:48:14.4370549Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 33s local ... 2025-03-14T06:48:15.0106810Z 2025-03-14T06:48:15.0107827Z  2025-03-14T06:48:15.0109091Z  2025-03-14T06:48:15.0109536Z  2025-03-14T06:48:15.0109997Z  2025-03-14T06:48:15.0110451Z  2025-03-14T06:48:15.0110894Z  2025-03-14T06:48:15.0111308Z  2025-03-14T06:48:15.0111779Z  2025-03-14T06:48:15.0112900Z [20,418 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:15.0114204Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 41s local 2025-03-14T06:48:15.0115358Z Compiling torch_xla/csrc/RegisterXLA.cpp; 40s local 2025-03-14T06:48:15.0116160Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 36s local 2025-03-14T06:48:15.0117169Z Compiling torch_xla/csrc/xla_op_builder.cpp; 36s local 2025-03-14T06:48:15.0118116Z Compiling torch_xla/csrc/xla_lower_util.cpp; 35s local 2025-03-14T06:48:15.0119298Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 34s local 2025-03-14T06:48:15.0120333Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 33s local 2025-03-14T06:48:15.0121325Z Compiling torch_xla/csrc/torch_util.cpp; 29s local ... 2025-03-14T06:48:15.2791471Z 2025-03-14T06:48:15.2792420Z  2025-03-14T06:48:15.2792946Z  2025-03-14T06:48:15.2793410Z  2025-03-14T06:48:15.2793883Z  2025-03-14T06:48:15.2794310Z  2025-03-14T06:48:15.2794785Z  2025-03-14T06:48:15.2795167Z  2025-03-14T06:48:15.2795529Z  2025-03-14T06:48:15.2796503Z [20,418 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:15.2797575Z Compiling torch_xla/csrc/XLANativeFunctions.cpp; 41s local 2025-03-14T06:48:15.2798471Z Compiling torch_xla/csrc/RegisterXLA.cpp; 41s local 2025-03-14T06:48:15.2799287Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 36s local 2025-03-14T06:48:15.2800186Z Compiling torch_xla/csrc/xla_op_builder.cpp; 36s local 2025-03-14T06:48:15.2800992Z Compiling torch_xla/csrc/xla_lower_util.cpp; 35s local 2025-03-14T06:48:15.2801721Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 35s local 2025-03-14T06:48:15.2802469Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 34s local 2025-03-14T06:48:15.2803313Z Compiling torch_xla/csrc/torch_util.cpp; 30s local ... 2025-03-14T06:48:15.6529614Z 2025-03-14T06:48:15.6530650Z  2025-03-14T06:48:15.6531144Z  2025-03-14T06:48:15.6531546Z  2025-03-14T06:48:15.6532021Z  2025-03-14T06:48:15.6532498Z  2025-03-14T06:48:15.6532937Z  2025-03-14T06:48:15.6533376Z  2025-03-14T06:48:15.6533794Z  2025-03-14T06:48:15.6535147Z [20,419 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:15.6536105Z Compiling torch_xla/csrc/RegisterXLA.cpp; 41s local 2025-03-14T06:48:15.6536759Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 37s local 2025-03-14T06:48:15.6537406Z Compiling torch_xla/csrc/xla_op_builder.cpp; 37s local 2025-03-14T06:48:15.6538040Z Compiling torch_xla/csrc/xla_lower_util.cpp; 35s local 2025-03-14T06:48:15.6538821Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 35s local 2025-03-14T06:48:15.6539495Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 34s local 2025-03-14T06:48:15.6540122Z Compiling torch_xla/csrc/torch_util.cpp; 30s local 2025-03-14T06:48:15.6540737Z Compiling torch_xla/csrc/tensor_util.cpp; 29s local ... 2025-03-14T06:48:15.9195572Z 2025-03-14T06:48:15.9196577Z  2025-03-14T06:48:15.9197061Z  2025-03-14T06:48:15.9197471Z  2025-03-14T06:48:15.9197924Z  2025-03-14T06:48:15.9198394Z  2025-03-14T06:48:15.9198840Z  2025-03-14T06:48:15.9199302Z  2025-03-14T06:48:15.9199727Z  2025-03-14T06:48:15.9200700Z [20,419 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:15.9201956Z Compiling torch_xla/csrc/RegisterXLA.cpp; 41s local 2025-03-14T06:48:15.9202973Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 37s local 2025-03-14T06:48:15.9204069Z Compiling torch_xla/csrc/xla_op_builder.cpp; 37s local 2025-03-14T06:48:15.9205095Z Compiling torch_xla/csrc/xla_lower_util.cpp; 36s local 2025-03-14T06:48:15.9206143Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 35s local 2025-03-14T06:48:15.9206956Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 34s local 2025-03-14T06:48:15.9207866Z Compiling torch_xla/csrc/torch_util.cpp; 30s local 2025-03-14T06:48:15.9208599Z Compiling torch_xla/csrc/tensor_util.cpp; 29s local ... 2025-03-14T06:48:16.8795855Z 2025-03-14T06:48:16.8796887Z  2025-03-14T06:48:16.8797379Z  2025-03-14T06:48:16.8797779Z  2025-03-14T06:48:16.8798229Z  2025-03-14T06:48:16.8798658Z  2025-03-14T06:48:16.8799091Z  2025-03-14T06:48:16.8799537Z  2025-03-14T06:48:16.8799973Z  2025-03-14T06:48:16.8800978Z [20,420 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:16.8801956Z Compiling torch_xla/csrc/RegisterXLA.cpp; 42s local 2025-03-14T06:48:16.8802777Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 38s local 2025-03-14T06:48:16.8803602Z Compiling torch_xla/csrc/xla_op_builder.cpp; 38s local 2025-03-14T06:48:16.8804425Z Compiling torch_xla/csrc/xla_lower_util.cpp; 37s local 2025-03-14T06:48:16.8805425Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 36s local 2025-03-14T06:48:16.8806283Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 35s local 2025-03-14T06:48:16.8807081Z Compiling torch_xla/csrc/torch_util.cpp; 31s local 2025-03-14T06:48:16.8807909Z Compiling torch_xla/csrc/tensor_util.cpp; 30s local ... 2025-03-14T06:48:17.0968486Z 2025-03-14T06:48:17.0969457Z  2025-03-14T06:48:17.0969987Z  2025-03-14T06:48:17.0970459Z  2025-03-14T06:48:17.0970878Z  2025-03-14T06:48:17.0971330Z  2025-03-14T06:48:17.0971758Z  2025-03-14T06:48:17.0972114Z  2025-03-14T06:48:17.0972505Z  2025-03-14T06:48:17.0973410Z [20,421 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:17.0974391Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local 2025-03-14T06:48:17.0975142Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 38s local 2025-03-14T06:48:17.0975970Z Compiling torch_xla/csrc/xla_op_builder.cpp; 38s local 2025-03-14T06:48:17.0976773Z Compiling torch_xla/csrc/xla_lower_util.cpp; 37s local 2025-03-14T06:48:17.0977651Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 37s local 2025-03-14T06:48:17.0978853Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 35s local 2025-03-14T06:48:17.0979751Z Compiling torch_xla/csrc/torch_util.cpp; 32s local 2025-03-14T06:48:17.0980497Z Compiling torch_xla/csrc/tensor_util.cpp; 30s local ... 2025-03-14T06:48:17.3205113Z 2025-03-14T06:48:17.3206142Z  2025-03-14T06:48:17.3206617Z  2025-03-14T06:48:17.3207012Z  2025-03-14T06:48:17.3207462Z  2025-03-14T06:48:17.3207935Z  2025-03-14T06:48:17.3208400Z  2025-03-14T06:48:17.3208828Z  2025-03-14T06:48:17.3209568Z  2025-03-14T06:48:17.3210498Z [20,422 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:17.3211473Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local 2025-03-14T06:48:17.3212420Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 38s local 2025-03-14T06:48:17.3213227Z Compiling torch_xla/csrc/xla_op_builder.cpp; 38s local 2025-03-14T06:48:17.3214038Z Compiling torch_xla/csrc/xla_lower_util.cpp; 37s local 2025-03-14T06:48:17.3214875Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 37s local 2025-03-14T06:48:17.3215723Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 36s local 2025-03-14T06:48:17.3216709Z Compiling torch_xla/csrc/torch_util.cpp; 32s local 2025-03-14T06:48:17.3217492Z Compiling torch_xla/csrc/tensor_util.cpp; 31s local ... 2025-03-14T06:48:17.7209380Z 2025-03-14T06:48:17.7210656Z  2025-03-14T06:48:17.7211179Z  2025-03-14T06:48:17.7211625Z  2025-03-14T06:48:17.7212069Z  2025-03-14T06:48:17.7212534Z  2025-03-14T06:48:17.7212880Z  2025-03-14T06:48:17.7213244Z  2025-03-14T06:48:17.7213620Z  2025-03-14T06:48:17.7214501Z [20,423 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:17.7215439Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local 2025-03-14T06:48:17.7216250Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 39s local 2025-03-14T06:48:17.7217033Z Compiling torch_xla/csrc/xla_op_builder.cpp; 39s local 2025-03-14T06:48:17.7217823Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 37s local 2025-03-14T06:48:17.7218636Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 36s local 2025-03-14T06:48:17.7219432Z Compiling torch_xla/csrc/torch_util.cpp; 32s local 2025-03-14T06:48:17.7220141Z Compiling torch_xla/csrc/tensor_util.cpp; 31s local 2025-03-14T06:48:17.7220914Z Compiling torch_xla/csrc/tensor_ops.cpp; 30s local ... 2025-03-14T06:48:18.1213276Z 2025-03-14T06:48:18.1214260Z  2025-03-14T06:48:18.1214727Z  2025-03-14T06:48:18.1215119Z  2025-03-14T06:48:18.1215542Z  2025-03-14T06:48:18.1215963Z  2025-03-14T06:48:18.1216385Z  2025-03-14T06:48:18.1216827Z  2025-03-14T06:48:18.1217237Z  2025-03-14T06:48:18.1218228Z [20,424 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:18.1219128Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2025-03-14T06:48:18.1219914Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 39s local 2025-03-14T06:48:18.1220684Z Compiling torch_xla/csrc/xla_op_builder.cpp; 39s local 2025-03-14T06:48:18.1221470Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 38s local 2025-03-14T06:48:18.1222524Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 36s local 2025-03-14T06:48:18.1223346Z Compiling torch_xla/csrc/torch_util.cpp; 33s local 2025-03-14T06:48:18.1224097Z Compiling torch_xla/csrc/tensor_util.cpp; 31s local 2025-03-14T06:48:18.1224794Z Compiling torch_xla/csrc/tensor_ops.cpp; 30s local ... 2025-03-14T06:48:19.1220998Z 2025-03-14T06:48:19.1221890Z  2025-03-14T06:48:19.1222412Z  2025-03-14T06:48:19.1222854Z  2025-03-14T06:48:19.1223308Z  2025-03-14T06:48:19.1223730Z  2025-03-14T06:48:19.1224185Z  2025-03-14T06:48:19.1224604Z  2025-03-14T06:48:19.1224958Z  2025-03-14T06:48:19.1226158Z [20,424 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:19.1227148Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2025-03-14T06:48:19.1227903Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 40s local 2025-03-14T06:48:19.1228903Z Compiling torch_xla/csrc/xla_op_builder.cpp; 40s local 2025-03-14T06:48:19.1229714Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local 2025-03-14T06:48:19.1230685Z Compiling torch_xla/csrc/xla_backend_impl.cpp; 37s local 2025-03-14T06:48:19.1231455Z Compiling torch_xla/csrc/torch_util.cpp; 34s local 2025-03-14T06:48:19.1232186Z Compiling torch_xla/csrc/tensor_util.cpp; 32s local 2025-03-14T06:48:19.1232929Z Compiling torch_xla/csrc/tensor_ops.cpp; 31s local ... 2025-03-14T06:48:19.9227027Z 2025-03-14T06:48:19.9227993Z  2025-03-14T06:48:19.9228441Z  2025-03-14T06:48:19.9228849Z  2025-03-14T06:48:19.9229429Z  2025-03-14T06:48:19.9229906Z  2025-03-14T06:48:19.9230339Z  2025-03-14T06:48:19.9230771Z  2025-03-14T06:48:19.9231371Z  2025-03-14T06:48:19.9232344Z [20,425 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:19.9233565Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2025-03-14T06:48:19.9234344Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 41s local 2025-03-14T06:48:19.9235328Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2025-03-14T06:48:19.9236125Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local 2025-03-14T06:48:19.9236921Z Compiling torch_xla/csrc/torch_util.cpp; 34s local 2025-03-14T06:48:19.9237664Z Compiling torch_xla/csrc/tensor_util.cpp; 33s local 2025-03-14T06:48:19.9238400Z Compiling torch_xla/csrc/tensor_ops.cpp; 32s local 2025-03-14T06:48:19.9239133Z Compiling torch_xla/csrc/tensor_methods.cpp; 32s local ... 2025-03-14T06:48:20.1230310Z 2025-03-14T06:48:20.1231269Z  2025-03-14T06:48:20.1231804Z  2025-03-14T06:48:20.1232246Z  2025-03-14T06:48:20.1232683Z  2025-03-14T06:48:20.1233099Z  2025-03-14T06:48:20.1233549Z  2025-03-14T06:48:20.1233981Z  2025-03-14T06:48:20.1234349Z  2025-03-14T06:48:20.1235201Z [20,425 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:20.1236138Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2025-03-14T06:48:20.1236921Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 41s local 2025-03-14T06:48:20.1237728Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2025-03-14T06:48:20.1238558Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 40s local 2025-03-14T06:48:20.1239338Z Compiling torch_xla/csrc/torch_util.cpp; 35s local 2025-03-14T06:48:20.1240099Z Compiling torch_xla/csrc/tensor_util.cpp; 33s local 2025-03-14T06:48:20.1241009Z Compiling torch_xla/csrc/tensor_ops.cpp; 32s local 2025-03-14T06:48:20.1241804Z Compiling torch_xla/csrc/tensor_methods.cpp; 32s local ... 2025-03-14T06:48:20.5234353Z 2025-03-14T06:48:20.5235314Z  2025-03-14T06:48:20.5235846Z  2025-03-14T06:48:20.5236326Z  2025-03-14T06:48:20.5236737Z  2025-03-14T06:48:20.5237206Z  2025-03-14T06:48:20.5237629Z  2025-03-14T06:48:20.5237984Z  2025-03-14T06:48:20.5238356Z  2025-03-14T06:48:20.5239331Z [20,425 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:20.5240297Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2025-03-14T06:48:20.5241096Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 41s local 2025-03-14T06:48:20.5241926Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2025-03-14T06:48:20.5242768Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 40s local 2025-03-14T06:48:20.5243533Z Compiling torch_xla/csrc/torch_util.cpp; 35s local 2025-03-14T06:48:20.5244737Z Compiling torch_xla/csrc/tensor_util.cpp; 34s local 2025-03-14T06:48:20.5245519Z Compiling torch_xla/csrc/tensor_ops.cpp; 33s local 2025-03-14T06:48:20.5246322Z Compiling torch_xla/csrc/tensor_methods.cpp; 32s local ... 2025-03-14T06:48:20.7666342Z 2025-03-14T06:48:20.7667401Z  2025-03-14T06:48:20.7667881Z  2025-03-14T06:48:20.7668274Z  2025-03-14T06:48:20.7668741Z  2025-03-14T06:48:20.7669219Z  2025-03-14T06:48:20.7669658Z  2025-03-14T06:48:20.7670087Z  2025-03-14T06:48:20.7670785Z  2025-03-14T06:48:20.7671761Z [20,426 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:20.7672728Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2025-03-14T06:48:20.7673482Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 42s local 2025-03-14T06:48:20.7674269Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2025-03-14T06:48:20.7675073Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 40s local 2025-03-14T06:48:20.7675842Z Compiling torch_xla/csrc/torch_util.cpp; 35s local 2025-03-14T06:48:20.7676571Z Compiling torch_xla/csrc/tensor_util.cpp; 34s local 2025-03-14T06:48:20.7677563Z Compiling torch_xla/csrc/tensor_methods.cpp; 33s local 2025-03-14T06:48:20.7678372Z Compiling torch_xla/csrc/tensor_impl.cpp; 32s local ... 2025-03-14T06:48:21.1239275Z 2025-03-14T06:48:21.1240492Z  2025-03-14T06:48:21.1241031Z  2025-03-14T06:48:21.1241469Z  2025-03-14T06:48:21.1241914Z  2025-03-14T06:48:21.1242332Z  2025-03-14T06:48:21.1242797Z  2025-03-14T06:48:21.1243274Z  2025-03-14T06:48:21.1243737Z  2025-03-14T06:48:21.1244955Z [20,426 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:21.1246182Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local 2025-03-14T06:48:21.1247196Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 42s local 2025-03-14T06:48:21.1248235Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2025-03-14T06:48:21.1249243Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 41s local 2025-03-14T06:48:21.1250260Z Compiling torch_xla/csrc/torch_util.cpp; 36s local 2025-03-14T06:48:21.1251174Z Compiling torch_xla/csrc/tensor_util.cpp; 34s local 2025-03-14T06:48:21.1252114Z Compiling torch_xla/csrc/tensor_methods.cpp; 33s local 2025-03-14T06:48:21.1253107Z Compiling torch_xla/csrc/tensor_impl.cpp; 32s local ... 2025-03-14T06:48:22.3247548Z 2025-03-14T06:48:22.3248528Z  2025-03-14T06:48:22.3249060Z  2025-03-14T06:48:22.3249509Z  2025-03-14T06:48:22.3249932Z  2025-03-14T06:48:22.3250386Z  2025-03-14T06:48:22.3250819Z  2025-03-14T06:48:22.3251170Z  2025-03-14T06:48:22.3251516Z  2025-03-14T06:48:22.3252330Z [20,427 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:22.3253201Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2025-03-14T06:48:22.3253902Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local 2025-03-14T06:48:22.3254609Z Compiling torch_xla/csrc/xla_op_builder.cpp; 43s local 2025-03-14T06:48:22.3255342Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2025-03-14T06:48:22.3256026Z Compiling torch_xla/csrc/torch_util.cpp; 37s local 2025-03-14T06:48:22.3256694Z Compiling torch_xla/csrc/tensor_util.cpp; 36s local 2025-03-14T06:48:22.3257379Z Compiling torch_xla/csrc/tensor_methods.cpp; 34s local 2025-03-14T06:48:22.3258079Z Compiling torch_xla/csrc/tensor_impl.cpp; 33s local ... 2025-03-14T06:48:22.5250375Z 2025-03-14T06:48:22.5251361Z  2025-03-14T06:48:22.5251829Z  2025-03-14T06:48:22.5252264Z  2025-03-14T06:48:22.5252702Z  2025-03-14T06:48:22.5253156Z  2025-03-14T06:48:22.5253578Z  2025-03-14T06:48:22.5253989Z  2025-03-14T06:48:22.5254408Z  2025-03-14T06:48:22.5255631Z [20,427 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:22.5256676Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2025-03-14T06:48:22.5257526Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local 2025-03-14T06:48:22.5258582Z Compiling torch_xla/csrc/xla_op_builder.cpp; 43s local 2025-03-14T06:48:22.5259469Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2025-03-14T06:48:22.5260445Z Compiling torch_xla/csrc/torch_util.cpp; 37s local 2025-03-14T06:48:22.5261251Z Compiling torch_xla/csrc/tensor_util.cpp; 36s local 2025-03-14T06:48:22.5262055Z Compiling torch_xla/csrc/tensor_methods.cpp; 34s local 2025-03-14T06:48:22.5262908Z Compiling torch_xla/csrc/tensor_impl.cpp; 34s local ... 2025-03-14T06:48:22.9254164Z 2025-03-14T06:48:22.9255108Z  2025-03-14T06:48:22.9255625Z  2025-03-14T06:48:22.9256070Z  2025-03-14T06:48:22.9256499Z  2025-03-14T06:48:22.9256969Z  2025-03-14T06:48:22.9257402Z  2025-03-14T06:48:22.9257796Z  2025-03-14T06:48:22.9258205Z  2025-03-14T06:48:22.9259148Z [20,428 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:22.9260507Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2025-03-14T06:48:22.9261379Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 44s local 2025-03-14T06:48:22.9262366Z Compiling torch_xla/csrc/xla_op_builder.cpp; 44s local 2025-03-14T06:48:22.9263162Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2025-03-14T06:48:22.9264007Z Compiling torch_xla/csrc/torch_util.cpp; 37s local 2025-03-14T06:48:22.9264799Z Compiling torch_xla/csrc/tensor_util.cpp; 36s local 2025-03-14T06:48:22.9265906Z Compiling torch_xla/csrc/tensor_methods.cpp; 35s local 2025-03-14T06:48:22.9266768Z Compiling torch_xla/csrc/tensor_impl.cpp; 34s local ... 2025-03-14T06:48:23.6722934Z 2025-03-14T06:48:23.6723913Z  2025-03-14T06:48:23.6724442Z  2025-03-14T06:48:23.6725009Z  2025-03-14T06:48:23.6725476Z  2025-03-14T06:48:23.6725893Z  2025-03-14T06:48:23.6726349Z  2025-03-14T06:48:23.6726757Z  2025-03-14T06:48:23.6727176Z  2025-03-14T06:48:23.6728250Z [20,430 / 20,653] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2025-03-14T06:48:23.6729197Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2025-03-14T06:48:23.6730080Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 45s local 2025-03-14T06:48:23.6730956Z Compiling torch_xla/csrc/xla_op_builder.cpp; 45s local 2025-03-14T06:48:23.6731634Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local 2025-03-14T06:48:23.6732285Z Compiling torch_xla/csrc/tensor_util.cpp; 37s local 2025-03-14T06:48:23.6732942Z Compiling torch_xla/csrc/tensor_methods.cpp; 36s local 2025-03-14T06:48:23.6733558Z Compiling torch_xla/csrc/tensor_impl.cpp; 35s local 2025-03-14T06:48:23.6734143Z Compiling torch_xla/csrc/tensor.cpp; 34s local ... 2025-03-14T06:48:23.9262163Z 2025-03-14T06:48:23.9263197Z  2025-03-14T06:48:23.9263658Z  2025-03-14T06:48:23.9264123Z  2025-03-14T06:48:23.9264578Z  2025-03-14T06:48:23.9265016Z  2025-03-14T06:48:23.9265597Z  2025-03-14T06:48:23.9266014Z  2025-03-14T06:48:23.9266441Z  2025-03-14T06:48:23.9267450Z [20,430 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:23.9268494Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2025-03-14T06:48:23.9269363Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 45s local 2025-03-14T06:48:23.9270257Z Compiling torch_xla/csrc/xla_op_builder.cpp; 45s local 2025-03-14T06:48:23.9271151Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local 2025-03-14T06:48:23.9272031Z Compiling torch_xla/csrc/tensor_util.cpp; 37s local 2025-03-14T06:48:23.9273190Z Compiling torch_xla/csrc/tensor_methods.cpp; 36s local 2025-03-14T06:48:23.9274046Z Compiling torch_xla/csrc/tensor_impl.cpp; 35s local 2025-03-14T06:48:23.9274867Z Compiling torch_xla/csrc/tensor.cpp; 35s local ... 2025-03-14T06:48:24.4132706Z 2025-03-14T06:48:24.4133653Z  2025-03-14T06:48:24.4134176Z  2025-03-14T06:48:24.4134613Z  2025-03-14T06:48:24.4135029Z  2025-03-14T06:48:24.4135495Z  2025-03-14T06:48:24.4135890Z  2025-03-14T06:48:24.4136229Z  2025-03-14T06:48:24.4136866Z  2025-03-14T06:48:24.4137728Z [20,431 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:24.4138641Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2025-03-14T06:48:24.4139403Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 45s local 2025-03-14T06:48:24.4140353Z Compiling torch_xla/csrc/xla_op_builder.cpp; 45s local 2025-03-14T06:48:24.4141172Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 44s local 2025-03-14T06:48:24.4141958Z Compiling torch_xla/csrc/tensor_util.cpp; 38s local 2025-03-14T06:48:24.4142707Z Compiling torch_xla/csrc/tensor_methods.cpp; 36s local 2025-03-14T06:48:24.4143609Z Compiling torch_xla/csrc/tensor_impl.cpp; 35s local 2025-03-14T06:48:24.4144323Z Compiling torch_xla/csrc/tensor.cpp; 35s local ... 2025-03-14T06:48:24.7268305Z 2025-03-14T06:48:24.7269211Z  2025-03-14T06:48:24.7270002Z  2025-03-14T06:48:24.7270427Z  2025-03-14T06:48:24.7270845Z  2025-03-14T06:48:24.7271304Z  2025-03-14T06:48:24.7271637Z  2025-03-14T06:48:24.7271985Z  2025-03-14T06:48:24.7272314Z  2025-03-14T06:48:24.7273137Z [20,431 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:24.7274026Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2025-03-14T06:48:24.7274772Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2025-03-14T06:48:24.7275519Z Compiling torch_xla/csrc/xla_op_builder.cpp; 46s local 2025-03-14T06:48:24.7276269Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 44s local 2025-03-14T06:48:24.7277002Z Compiling torch_xla/csrc/tensor_util.cpp; 38s local 2025-03-14T06:48:24.7277709Z Compiling torch_xla/csrc/tensor_methods.cpp; 37s local 2025-03-14T06:48:24.7278400Z Compiling torch_xla/csrc/tensor_impl.cpp; 36s local 2025-03-14T06:48:24.7279094Z Compiling torch_xla/csrc/tensor.cpp; 35s local ... 2025-03-14T06:48:25.3273072Z 2025-03-14T06:48:25.3274060Z  2025-03-14T06:48:25.3274594Z  2025-03-14T06:48:25.3275041Z  2025-03-14T06:48:25.3275482Z  2025-03-14T06:48:25.3276028Z  2025-03-14T06:48:25.3276435Z  2025-03-14T06:48:25.3276784Z  2025-03-14T06:48:25.3277142Z  2025-03-14T06:48:25.3278133Z [20,432 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:25.3279035Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2025-03-14T06:48:25.3279767Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2025-03-14T06:48:25.3280517Z Compiling torch_xla/csrc/xla_op_builder.cpp; 46s local 2025-03-14T06:48:25.3281282Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2025-03-14T06:48:25.3281991Z Compiling torch_xla/csrc/tensor_util.cpp; 39s local 2025-03-14T06:48:25.3282706Z Compiling torch_xla/csrc/tensor_methods.cpp; 37s local 2025-03-14T06:48:25.3283433Z Compiling torch_xla/csrc/tensor_impl.cpp; 36s local 2025-03-14T06:48:25.3284127Z Compiling torch_xla/csrc/tensor.cpp; 36s local ... 2025-03-14T06:48:25.7276761Z 2025-03-14T06:48:25.7277653Z  2025-03-14T06:48:25.7278181Z  2025-03-14T06:48:25.7278640Z  2025-03-14T06:48:25.7279066Z  2025-03-14T06:48:25.7279515Z  2025-03-14T06:48:25.7279939Z  2025-03-14T06:48:25.7280269Z  2025-03-14T06:48:25.7280620Z  2025-03-14T06:48:25.7281740Z [20,432 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:25.7282637Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2025-03-14T06:48:25.7283389Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2025-03-14T06:48:25.7284147Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2025-03-14T06:48:25.7285041Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2025-03-14T06:48:25.7285824Z Compiling torch_xla/csrc/tensor_util.cpp; 39s local 2025-03-14T06:48:25.7286717Z Compiling torch_xla/csrc/tensor_methods.cpp; 38s local 2025-03-14T06:48:25.7287495Z Compiling torch_xla/csrc/tensor_impl.cpp; 37s local 2025-03-14T06:48:25.7288153Z Compiling torch_xla/csrc/tensor.cpp; 36s local ... 2025-03-14T06:48:26.1280927Z 2025-03-14T06:48:26.1281824Z  2025-03-14T06:48:26.1282336Z  2025-03-14T06:48:26.1282760Z  2025-03-14T06:48:26.1283199Z  2025-03-14T06:48:26.1283615Z  2025-03-14T06:48:26.1284091Z  2025-03-14T06:48:26.1284645Z  2025-03-14T06:48:26.1284983Z  2025-03-14T06:48:26.1285776Z [20,433 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:26.1286958Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T06:48:26.1287712Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2025-03-14T06:48:26.1288664Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2025-03-14T06:48:26.1289459Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2025-03-14T06:48:26.1290179Z Compiling torch_xla/csrc/tensor_util.cpp; 39s local 2025-03-14T06:48:26.1290858Z Compiling torch_xla/csrc/tensor_methods.cpp; 38s local 2025-03-14T06:48:26.1291547Z Compiling torch_xla/csrc/tensor.cpp; 37s local 2025-03-14T06:48:26.1292232Z Compiling torch_xla/csrc/reduction.cpp; 34s local ... 2025-03-14T06:48:26.5284756Z 2025-03-14T06:48:26.5285748Z  2025-03-14T06:48:26.5286286Z  2025-03-14T06:48:26.5286737Z  2025-03-14T06:48:26.5287272Z  2025-03-14T06:48:26.5287890Z  2025-03-14T06:48:26.5288318Z  2025-03-14T06:48:26.5288700Z  2025-03-14T06:48:26.5289069Z  2025-03-14T06:48:26.5289935Z [20,433 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:26.5290823Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T06:48:26.5291540Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2025-03-14T06:48:26.5292292Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2025-03-14T06:48:26.5293027Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2025-03-14T06:48:26.5293759Z Compiling torch_xla/csrc/tensor_util.cpp; 40s local 2025-03-14T06:48:26.5294459Z Compiling torch_xla/csrc/tensor_methods.cpp; 38s local 2025-03-14T06:48:26.5295127Z Compiling torch_xla/csrc/tensor.cpp; 37s local 2025-03-14T06:48:26.5295811Z Compiling torch_xla/csrc/reduction.cpp; 35s local ... 2025-03-14T06:48:27.5292112Z 2025-03-14T06:48:27.5294438Z  2025-03-14T06:48:27.5294895Z  2025-03-14T06:48:27.5295299Z  2025-03-14T06:48:27.5295740Z  2025-03-14T06:48:27.5296154Z  2025-03-14T06:48:27.5296566Z  2025-03-14T06:48:27.5296961Z  2025-03-14T06:48:27.5297362Z  2025-03-14T06:48:27.5298457Z [20,433 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:27.5299680Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2025-03-14T06:48:27.5300486Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local 2025-03-14T06:48:27.5301326Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2025-03-14T06:48:27.5302188Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2025-03-14T06:48:27.5303015Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local 2025-03-14T06:48:27.5304167Z Compiling torch_xla/csrc/tensor_methods.cpp; 39s local 2025-03-14T06:48:27.5304992Z Compiling torch_xla/csrc/tensor.cpp; 38s local 2025-03-14T06:48:27.5305776Z Compiling torch_xla/csrc/reduction.cpp; 36s local ... 2025-03-14T06:48:28.0293832Z 2025-03-14T06:48:28.0294828Z  2025-03-14T06:48:28.0295359Z  2025-03-14T06:48:28.0295830Z  2025-03-14T06:48:28.0296279Z  2025-03-14T06:48:28.0296716Z  2025-03-14T06:48:28.0297127Z  2025-03-14T06:48:28.0297634Z  2025-03-14T06:48:28.0298055Z  2025-03-14T06:48:28.0299260Z [20,434 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:28.0300330Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2025-03-14T06:48:28.0301217Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 49s local 2025-03-14T06:48:28.0302130Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2025-03-14T06:48:28.0303052Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2025-03-14T06:48:28.0303971Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local 2025-03-14T06:48:28.0304834Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local 2025-03-14T06:48:28.0305668Z Compiling torch_xla/csrc/tensor.cpp; 39s local 2025-03-14T06:48:28.0306668Z Compiling torch_xla/csrc/reduction.cpp; 36s local ... 2025-03-14T06:48:28.3298256Z 2025-03-14T06:48:28.3299369Z  2025-03-14T06:48:28.3299888Z  2025-03-14T06:48:28.3300682Z  2025-03-14T06:48:28.3301110Z  2025-03-14T06:48:28.3301563Z  2025-03-14T06:48:28.3301997Z  2025-03-14T06:48:28.3302347Z  2025-03-14T06:48:28.3302706Z  2025-03-14T06:48:28.3303556Z [20,436 / 20,653] 6 / 17 tests; 46 actions running; last test: ..._client_test 2025-03-14T06:48:28.3304449Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2025-03-14T06:48:28.3305197Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 49s local 2025-03-14T06:48:28.3305960Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2025-03-14T06:48:28.3306717Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local 2025-03-14T06:48:28.3307467Z Compiling torch_xla/csrc/tensor_util.cpp; 42s local 2025-03-14T06:48:28.3308170Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local 2025-03-14T06:48:28.3308855Z Compiling torch_xla/csrc/tensor.cpp; 39s local 2025-03-14T06:48:28.3309545Z Compiling torch_xla/csrc/ir_dump_util.cpp; 32s local ... 2025-03-14T06:48:28.7302555Z 2025-03-14T06:48:28.7303814Z  2025-03-14T06:48:28.7304390Z  2025-03-14T06:48:28.7304858Z  2025-03-14T06:48:28.7305288Z  2025-03-14T06:48:28.7305718Z  2025-03-14T06:48:28.7306109Z  2025-03-14T06:48:28.7306554Z  2025-03-14T06:48:28.7306983Z  2025-03-14T06:48:28.7307991Z [20,436 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:28.7309089Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2025-03-14T06:48:28.7309833Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2025-03-14T06:48:28.7310642Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2025-03-14T06:48:28.7311488Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local 2025-03-14T06:48:28.7312326Z Compiling torch_xla/csrc/tensor_util.cpp; 42s local 2025-03-14T06:48:28.7313048Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2025-03-14T06:48:28.7313801Z Compiling torch_xla/csrc/tensor.cpp; 39s local 2025-03-14T06:48:28.7314568Z Compiling torch_xla/csrc/ir_dump_util.cpp; 32s local ... 2025-03-14T06:48:28.9477994Z 2025-03-14T06:48:28.9479032Z  2025-03-14T06:48:28.9479565Z  2025-03-14T06:48:28.9480033Z  2025-03-14T06:48:28.9480484Z  2025-03-14T06:48:28.9480907Z  2025-03-14T06:48:28.9481377Z  2025-03-14T06:48:28.9481811Z  2025-03-14T06:48:28.9482276Z  2025-03-14T06:48:28.9483664Z [20,437 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:28.9485013Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2025-03-14T06:48:28.9486009Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2025-03-14T06:48:28.9487084Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local 2025-03-14T06:48:28.9488076Z Compiling torch_xla/csrc/tensor_util.cpp; 42s local 2025-03-14T06:48:28.9489026Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2025-03-14T06:48:28.9490090Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2025-03-14T06:48:28.9490982Z Compiling torch_xla/csrc/ir_dump_util.cpp; 32s local 2025-03-14T06:48:28.9491908Z Compiling torch_xla/csrc/helpers.cpp; 32s local ... 2025-03-14T06:48:29.3308255Z 2025-03-14T06:48:29.3309812Z  2025-03-14T06:48:29.3310328Z  2025-03-14T06:48:29.3310769Z  2025-03-14T06:48:29.3311214Z  2025-03-14T06:48:29.3311648Z  2025-03-14T06:48:29.3312086Z  2025-03-14T06:48:29.3312531Z  2025-03-14T06:48:29.3312978Z  2025-03-14T06:48:29.3313880Z [20,437 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:29.3315206Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2025-03-14T06:48:29.3315979Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2025-03-14T06:48:29.3317015Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2025-03-14T06:48:29.3317978Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2025-03-14T06:48:29.3318770Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2025-03-14T06:48:29.3319517Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2025-03-14T06:48:29.3320218Z Compiling torch_xla/csrc/ir_dump_util.cpp; 33s local 2025-03-14T06:48:29.3320919Z Compiling torch_xla/csrc/helpers.cpp; 32s local ... 2025-03-14T06:48:30.3315921Z 2025-03-14T06:48:30.3317483Z  2025-03-14T06:48:30.3317976Z  2025-03-14T06:48:30.3318471Z  2025-03-14T06:48:30.3318893Z  2025-03-14T06:48:30.3319278Z  2025-03-14T06:48:30.3319719Z  2025-03-14T06:48:30.3320162Z  2025-03-14T06:48:30.3320600Z  2025-03-14T06:48:30.3321583Z [20,437 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:30.3322586Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2025-03-14T06:48:30.3323292Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local 2025-03-14T06:48:30.3324042Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2025-03-14T06:48:30.3324911Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2025-03-14T06:48:30.3325569Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local 2025-03-14T06:48:30.3326216Z Compiling torch_xla/csrc/tensor.cpp; 41s local 2025-03-14T06:48:30.3326831Z Compiling torch_xla/csrc/ir_dump_util.cpp; 34s local 2025-03-14T06:48:30.3327473Z Compiling torch_xla/csrc/helpers.cpp; 33s local ... 2025-03-14T06:48:30.8765791Z 2025-03-14T06:48:30.8767128Z  2025-03-14T06:48:30.8767640Z  2025-03-14T06:48:30.8768088Z  2025-03-14T06:48:30.8768503Z  2025-03-14T06:48:30.8768908Z  2025-03-14T06:48:30.8769356Z  2025-03-14T06:48:30.8769774Z  2025-03-14T06:48:30.8770171Z  2025-03-14T06:48:30.8771134Z [20,438 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:30.8772189Z Compiling torch_xla/csrc/RegisterXLA.cpp; 56s local 2025-03-14T06:48:30.8772892Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2025-03-14T06:48:30.8773605Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2025-03-14T06:48:30.8774277Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2025-03-14T06:48:30.8774928Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local 2025-03-14T06:48:30.8775574Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T06:48:30.8776475Z Compiling torch_xla/csrc/ir_dump_util.cpp; 34s local 2025-03-14T06:48:30.8777116Z Compiling torch_xla/csrc/helpers.cpp; 34s local ... 2025-03-14T06:48:31.1321879Z 2025-03-14T06:48:31.1325852Z  2025-03-14T06:48:31.1326399Z  2025-03-14T06:48:31.1326817Z  2025-03-14T06:48:31.1327237Z  2025-03-14T06:48:31.1327617Z  2025-03-14T06:48:31.1327953Z  2025-03-14T06:48:31.1328284Z  2025-03-14T06:48:31.1328638Z  2025-03-14T06:48:31.1329782Z [20,438 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:31.1330622Z Compiling torch_xla/csrc/RegisterXLA.cpp; 57s local 2025-03-14T06:48:31.1331327Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2025-03-14T06:48:31.1332070Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2025-03-14T06:48:31.1332783Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2025-03-14T06:48:31.1333415Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local 2025-03-14T06:48:31.1334042Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T06:48:31.1334679Z Compiling torch_xla/csrc/ir_dump_util.cpp; 34s local 2025-03-14T06:48:31.1335527Z Compiling torch_xla/csrc/helpers.cpp; 34s local ... 2025-03-14T06:48:31.5327600Z 2025-03-14T06:48:31.5328503Z  2025-03-14T06:48:31.5328942Z  2025-03-14T06:48:31.5331475Z  2025-03-14T06:48:31.5334114Z  2025-03-14T06:48:31.5337126Z  2025-03-14T06:48:31.5339744Z  2025-03-14T06:48:31.5342361Z  2025-03-14T06:48:31.5344908Z  2025-03-14T06:48:31.5347871Z [20,439 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:31.5350863Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2025-03-14T06:48:31.5353667Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2025-03-14T06:48:31.5356444Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local 2025-03-14T06:48:31.5359356Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local 2025-03-14T06:48:31.5362277Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T06:48:31.5365279Z Compiling torch_xla/csrc/ir_dump_util.cpp; 35s local 2025-03-14T06:48:31.5368300Z Compiling torch_xla/csrc/helpers.cpp; 35s local 2025-03-14T06:48:31.5371048Z Compiling torch_xla/csrc/elementwise.cpp; 35s local ... 2025-03-14T06:48:32.5333530Z 2025-03-14T06:48:32.5336852Z  2025-03-14T06:48:32.5339718Z  2025-03-14T06:48:32.5342422Z  2025-03-14T06:48:32.5345210Z  2025-03-14T06:48:32.5347962Z  2025-03-14T06:48:32.5360968Z  2025-03-14T06:48:32.5364757Z  2025-03-14T06:48:32.5369967Z  2025-03-14T06:48:32.5373582Z [20,439 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:32.5377400Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2025-03-14T06:48:32.5380751Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2025-03-14T06:48:32.5384064Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2025-03-14T06:48:32.5387362Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local 2025-03-14T06:48:32.5390596Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2025-03-14T06:48:32.5393818Z Compiling torch_xla/csrc/ir_dump_util.cpp; 36s local 2025-03-14T06:48:32.5396962Z Compiling torch_xla/csrc/helpers.cpp; 36s local 2025-03-14T06:48:32.5400271Z Compiling torch_xla/csrc/elementwise.cpp; 36s local ... 2025-03-14T06:48:33.5341875Z 2025-03-14T06:48:33.5345397Z  2025-03-14T06:48:33.5348497Z  2025-03-14T06:48:33.5351440Z  2025-03-14T06:48:33.5354371Z  2025-03-14T06:48:33.5357299Z  2025-03-14T06:48:33.5360204Z  2025-03-14T06:48:33.5363075Z  2025-03-14T06:48:33.5366357Z  2025-03-14T06:48:33.5369679Z [20,440 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:33.5373532Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 54s local 2025-03-14T06:48:33.5376926Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2025-03-14T06:48:33.5380197Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2025-03-14T06:48:33.5383378Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local 2025-03-14T06:48:33.5386580Z Compiling torch_xla/csrc/tensor.cpp; 44s local 2025-03-14T06:48:33.5389721Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local 2025-03-14T06:48:33.5393266Z Compiling torch_xla/csrc/helpers.cpp; 37s local 2025-03-14T06:48:33.5396406Z Compiling torch_xla/csrc/dl_convertor.cpp; 36s local ... 2025-03-14T06:48:33.9345660Z 2025-03-14T06:48:33.9348908Z  2025-03-14T06:48:33.9349861Z  2025-03-14T06:48:33.9350986Z  2025-03-14T06:48:33.9351469Z  2025-03-14T06:48:33.9351861Z  2025-03-14T06:48:33.9352261Z  2025-03-14T06:48:33.9352672Z  2025-03-14T06:48:33.9353071Z  2025-03-14T06:48:33.9354055Z [20,441 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:33.9355108Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T06:48:33.9356286Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2025-03-14T06:48:33.9357122Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2025-03-14T06:48:33.9357939Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2025-03-14T06:48:33.9358913Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2025-03-14T06:48:33.9359704Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local 2025-03-14T06:48:33.9360472Z Compiling torch_xla/csrc/helpers.cpp; 37s local 2025-03-14T06:48:33.9361268Z Compiling torch_xla/csrc/dl_convertor.cpp; 37s local ... 2025-03-14T06:48:34.1348903Z 2025-03-14T06:48:34.1350017Z  2025-03-14T06:48:34.1350495Z  2025-03-14T06:48:34.1350886Z  2025-03-14T06:48:34.1351265Z  2025-03-14T06:48:34.1351650Z  2025-03-14T06:48:34.1352113Z  2025-03-14T06:48:34.1352511Z  2025-03-14T06:48:34.1352910Z  2025-03-14T06:48:34.1353825Z [20,442 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:34.1354845Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T06:48:34.1355664Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T06:48:34.1356506Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2025-03-14T06:48:34.1357762Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2025-03-14T06:48:34.1358663Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2025-03-14T06:48:34.1359515Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local 2025-03-14T06:48:34.1360416Z Compiling torch_xla/csrc/dl_convertor.cpp; 37s local 2025-03-14T06:48:34.1361345Z Compiling torch_xla/csrc/debug_util.cpp; 36s local ... 2025-03-14T06:48:34.5352783Z 2025-03-14T06:48:34.5354047Z  2025-03-14T06:48:34.5354565Z  2025-03-14T06:48:34.5354932Z  2025-03-14T06:48:34.5355309Z  2025-03-14T06:48:34.5355671Z  2025-03-14T06:48:34.5356025Z  2025-03-14T06:48:34.5356391Z  2025-03-14T06:48:34.5356775Z  2025-03-14T06:48:34.5357644Z [20,442 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:34.5358601Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T06:48:34.5359412Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T06:48:34.5360153Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2025-03-14T06:48:34.5360846Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2025-03-14T06:48:34.5361546Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2025-03-14T06:48:34.5362202Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local 2025-03-14T06:48:34.5362947Z Compiling torch_xla/csrc/dl_convertor.cpp; 37s local 2025-03-14T06:48:34.5363968Z Compiling torch_xla/csrc/debug_util.cpp; 37s local ... 2025-03-14T06:48:34.9357351Z 2025-03-14T06:48:34.9361060Z  2025-03-14T06:48:34.9361853Z  2025-03-14T06:48:34.9362427Z  2025-03-14T06:48:34.9362987Z  2025-03-14T06:48:34.9363406Z  2025-03-14T06:48:34.9363948Z  2025-03-14T06:48:34.9364454Z  2025-03-14T06:48:34.9364993Z  2025-03-14T06:48:34.9366210Z [20,443 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:34.9367705Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2025-03-14T06:48:34.9368747Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T06:48:34.9369695Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2025-03-14T06:48:34.9370792Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2025-03-14T06:48:34.9371703Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T06:48:34.9372610Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local 2025-03-14T06:48:34.9373495Z Compiling torch_xla/csrc/dl_convertor.cpp; 38s local 2025-03-14T06:48:34.9374429Z Compiling torch_xla/csrc/debug_util.cpp; 37s local ... 2025-03-14T06:48:35.4827589Z 2025-03-14T06:48:35.4828538Z  2025-03-14T06:48:35.4829026Z  2025-03-14T06:48:35.4831790Z  2025-03-14T06:48:35.4834698Z  2025-03-14T06:48:35.4837833Z  2025-03-14T06:48:35.4841308Z  2025-03-14T06:48:35.4844252Z  2025-03-14T06:48:35.4847281Z  2025-03-14T06:48:35.4850751Z [20,444 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:35.4854345Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2025-03-14T06:48:35.4857937Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2025-03-14T06:48:35.4861106Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2025-03-14T06:48:35.4864250Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2025-03-14T06:48:35.4867737Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T06:48:35.4870841Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local 2025-03-14T06:48:35.4874253Z Compiling torch_xla/csrc/debug_util.cpp; 38s local 2025-03-14T06:48:35.4876708Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 37s local ... 2025-03-14T06:48:35.7363879Z 2025-03-14T06:48:35.7366067Z  2025-03-14T06:48:35.7367701Z  2025-03-14T06:48:35.7369071Z  2025-03-14T06:48:35.7370492Z  2025-03-14T06:48:35.7371912Z  2025-03-14T06:48:35.7373453Z  2025-03-14T06:48:35.7374860Z  2025-03-14T06:48:35.7376244Z  2025-03-14T06:48:35.7378152Z [20,444 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:35.7380223Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2025-03-14T06:48:35.7382061Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2025-03-14T06:48:35.7383939Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2025-03-14T06:48:35.7385752Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2025-03-14T06:48:35.7387557Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T06:48:35.7389426Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local 2025-03-14T06:48:35.7391979Z Compiling torch_xla/csrc/debug_util.cpp; 38s local 2025-03-14T06:48:35.7394643Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 38s local ... 2025-03-14T06:48:36.7372567Z 2025-03-14T06:48:36.7375157Z  2025-03-14T06:48:36.7377714Z  2025-03-14T06:48:36.7379793Z  2025-03-14T06:48:36.7381893Z  2025-03-14T06:48:36.7383963Z  2025-03-14T06:48:36.7385951Z  2025-03-14T06:48:36.7387983Z  2025-03-14T06:48:36.7390009Z  2025-03-14T06:48:36.7392729Z [20,444 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:36.7395817Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2025-03-14T06:48:36.7398434Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2025-03-14T06:48:36.7400975Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2025-03-14T06:48:36.7403322Z Compiling torch_xla/csrc/tensor_methods.cpp; 49s local 2025-03-14T06:48:36.7406040Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2025-03-14T06:48:36.7408317Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local 2025-03-14T06:48:36.7410635Z Compiling torch_xla/csrc/debug_util.cpp; 39s local 2025-03-14T06:48:36.7413491Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local ... 2025-03-14T06:48:37.9381603Z 2025-03-14T06:48:37.9382376Z  2025-03-14T06:48:37.9382817Z  2025-03-14T06:48:37.9383196Z  2025-03-14T06:48:37.9383561Z  2025-03-14T06:48:37.9383928Z  2025-03-14T06:48:37.9384296Z  2025-03-14T06:48:37.9384625Z  2025-03-14T06:48:37.9384988Z  2025-03-14T06:48:37.9385866Z [20,444 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:37.9386887Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2025-03-14T06:48:37.9387659Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 57s local 2025-03-14T06:48:37.9388852Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2025-03-14T06:48:37.9389525Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2025-03-14T06:48:37.9390343Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2025-03-14T06:48:37.9391008Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2025-03-14T06:48:37.9391686Z Compiling torch_xla/csrc/debug_util.cpp; 40s local 2025-03-14T06:48:37.9392433Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 40s local ... 2025-03-14T06:48:38.2557459Z 2025-03-14T06:48:38.2558323Z  2025-03-14T06:48:38.2558772Z  2025-03-14T06:48:38.2559161Z  2025-03-14T06:48:38.2559539Z  2025-03-14T06:48:38.2559927Z  2025-03-14T06:48:38.2560360Z  2025-03-14T06:48:38.2560778Z  2025-03-14T06:48:38.2561180Z  2025-03-14T06:48:38.2562093Z [20,445 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:38.2563091Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2025-03-14T06:48:38.2563757Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T06:48:38.2564657Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2025-03-14T06:48:38.2565608Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2025-03-14T06:48:38.2566348Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2025-03-14T06:48:38.2567051Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2025-03-14T06:48:38.2567790Z Compiling torch_xla/csrc/debug_util.cpp; 40s local 2025-03-14T06:48:38.2568608Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 40s local ... 2025-03-14T06:48:38.5386699Z 2025-03-14T06:48:38.5387587Z  2025-03-14T06:48:38.5388095Z  2025-03-14T06:48:38.5388501Z  2025-03-14T06:48:38.5388900Z  2025-03-14T06:48:38.5389299Z  2025-03-14T06:48:38.5389674Z  2025-03-14T06:48:38.5390059Z  2025-03-14T06:48:38.5390485Z  2025-03-14T06:48:38.5391455Z [20,445 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:38.5392512Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2025-03-14T06:48:38.5393412Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T06:48:38.5394244Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2025-03-14T06:48:38.5395026Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2025-03-14T06:48:38.5395800Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2025-03-14T06:48:38.5396551Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2025-03-14T06:48:38.5397333Z Compiling torch_xla/csrc/debug_util.cpp; 41s local 2025-03-14T06:48:38.5398551Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 41s local ... 2025-03-14T06:48:38.7664375Z 2025-03-14T06:48:38.7665167Z  2025-03-14T06:48:38.7665830Z  2025-03-14T06:48:38.7666239Z  2025-03-14T06:48:38.7666669Z  2025-03-14T06:48:38.7667072Z  2025-03-14T06:48:38.7667479Z  2025-03-14T06:48:38.7667881Z  2025-03-14T06:48:38.7668251Z  2025-03-14T06:48:38.7669158Z [20,446 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:38.7672378Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T06:48:38.7673463Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2025-03-14T06:48:38.7674231Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T06:48:38.7674959Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2025-03-14T06:48:38.7675678Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2025-03-14T06:48:38.7676438Z Compiling torch_xla/csrc/debug_util.cpp; 41s local 2025-03-14T06:48:38.7677258Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 41s local 2025-03-14T06:48:38.7678132Z Compiling torch_xla/csrc/aten_xla_type.cpp; 36s local ... 2025-03-14T06:48:39.1391842Z 2025-03-14T06:48:39.1392700Z  2025-03-14T06:48:39.1393216Z  2025-03-14T06:48:39.1393606Z  2025-03-14T06:48:39.1393991Z  2025-03-14T06:48:39.1394351Z  2025-03-14T06:48:39.1395435Z  2025-03-14T06:48:39.1395814Z  2025-03-14T06:48:39.1396222Z  2025-03-14T06:48:39.1397155Z [20,446 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:39.1398233Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 59s local 2025-03-14T06:48:39.1399046Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2025-03-14T06:48:39.1399847Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T06:48:39.1400655Z Compiling torch_xla/csrc/tensor.cpp; 50s local 2025-03-14T06:48:39.1401409Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2025-03-14T06:48:39.1402199Z Compiling torch_xla/csrc/debug_util.cpp; 41s local 2025-03-14T06:48:39.1403050Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 41s local 2025-03-14T06:48:39.1403858Z Compiling torch_xla/csrc/aten_xla_type.cpp; 37s local ... 2025-03-14T06:48:39.5395733Z 2025-03-14T06:48:39.5396603Z  2025-03-14T06:48:39.5397122Z  2025-03-14T06:48:39.5397471Z  2025-03-14T06:48:39.5397883Z  2025-03-14T06:48:39.5398276Z  2025-03-14T06:48:39.5398670Z  2025-03-14T06:48:39.5399069Z  2025-03-14T06:48:39.5399481Z  2025-03-14T06:48:39.5400411Z [20,447 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:39.5401358Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T06:48:39.5402132Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T06:48:39.5402890Z Compiling torch_xla/csrc/tensor.cpp; 50s local 2025-03-14T06:48:39.5403612Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2025-03-14T06:48:39.5404311Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2025-03-14T06:48:39.5405301Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 42s local 2025-03-14T06:48:39.5406161Z Compiling torch_xla/csrc/aten_xla_type.cpp; 37s local 2025-03-14T06:48:39.5406954Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 36s local ... 2025-03-14T06:48:39.9400319Z 2025-03-14T06:48:39.9401235Z  2025-03-14T06:48:39.9401732Z  2025-03-14T06:48:39.9402130Z  2025-03-14T06:48:39.9402533Z  2025-03-14T06:48:39.9402907Z  2025-03-14T06:48:39.9403303Z  2025-03-14T06:48:39.9403689Z  2025-03-14T06:48:39.9404086Z  2025-03-14T06:48:39.9405203Z [20,447 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:39.9406488Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T06:48:39.9407333Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2025-03-14T06:48:39.9408128Z Compiling torch_xla/csrc/tensor.cpp; 51s local 2025-03-14T06:48:39.9408866Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2025-03-14T06:48:39.9409620Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2025-03-14T06:48:39.9410437Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 42s local 2025-03-14T06:48:39.9411283Z Compiling torch_xla/csrc/aten_xla_type.cpp; 37s local 2025-03-14T06:48:39.9412378Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 37s local ... 2025-03-14T06:48:40.1404180Z 2025-03-14T06:48:40.1405214Z  2025-03-14T06:48:40.1405725Z  2025-03-14T06:48:40.1406124Z  2025-03-14T06:48:40.1406499Z  2025-03-14T06:48:40.1406891Z  2025-03-14T06:48:40.1407319Z  2025-03-14T06:48:40.1407715Z  2025-03-14T06:48:40.1408096Z  2025-03-14T06:48:40.1409071Z [20,448 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:40.1410050Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T06:48:40.1410850Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2025-03-14T06:48:40.1411923Z Compiling torch_xla/csrc/tensor.cpp; 51s local 2025-03-14T06:48:40.1412701Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2025-03-14T06:48:40.1413625Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2025-03-14T06:48:40.1414455Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 42s local 2025-03-14T06:48:40.1415333Z Compiling torch_xla/csrc/aten_xla_type.cpp; 38s local 2025-03-14T06:48:40.1416185Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 37s local ... 2025-03-14T06:48:40.5407933Z 2025-03-14T06:48:40.5408756Z  2025-03-14T06:48:40.5409234Z  2025-03-14T06:48:40.5409649Z  2025-03-14T06:48:40.5410057Z  2025-03-14T06:48:40.5410455Z  2025-03-14T06:48:40.5410904Z  2025-03-14T06:48:40.5411304Z  2025-03-14T06:48:40.5411707Z  2025-03-14T06:48:40.5412676Z [20,449 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:40.5413690Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T06:48:40.5414495Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2025-03-14T06:48:40.5415280Z Compiling torch_xla/csrc/tensor.cpp; 51s local 2025-03-14T06:48:40.5416049Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2025-03-14T06:48:40.5416824Z Compiling torch_xla/csrc/debug_util.cpp; 43s local 2025-03-14T06:48:40.5417634Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 43s local 2025-03-14T06:48:40.5418499Z Compiling torch_xla/csrc/aten_xla_type.cpp; 38s local 2025-03-14T06:48:40.5419340Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 37s local ... 2025-03-14T06:48:40.9413065Z 2025-03-14T06:48:40.9413889Z  2025-03-14T06:48:40.9414326Z  2025-03-14T06:48:40.9414713Z  2025-03-14T06:48:40.9415074Z  2025-03-14T06:48:40.9415431Z  2025-03-14T06:48:40.9415784Z  2025-03-14T06:48:40.9416138Z  2025-03-14T06:48:40.9416510Z  2025-03-14T06:48:40.9417311Z [20,450 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:40.9418171Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T06:48:40.9418869Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2025-03-14T06:48:40.9419519Z Compiling torch_xla/csrc/tensor.cpp; 52s local 2025-03-14T06:48:40.9420181Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2025-03-14T06:48:40.9420907Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 43s local 2025-03-14T06:48:40.9421644Z Compiling torch_xla/csrc/aten_xla_type.cpp; 38s local 2025-03-14T06:48:40.9422337Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local 2025-03-14T06:48:40.9423340Z Compiling torch_xla/csrc/aten_fallback.cpp; 38s local ... 2025-03-14T06:48:41.1606432Z 2025-03-14T06:48:41.1607266Z  2025-03-14T06:48:41.1607727Z  2025-03-14T06:48:41.1608129Z  2025-03-14T06:48:41.1608523Z  2025-03-14T06:48:41.1608957Z  2025-03-14T06:48:41.1609366Z  2025-03-14T06:48:41.1609763Z  2025-03-14T06:48:41.1610166Z  2025-03-14T06:48:41.1610960Z [20,451 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:41.1611971Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T06:48:41.1612587Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2025-03-14T06:48:41.1613173Z Compiling torch_xla/csrc/tensor.cpp; 52s local 2025-03-14T06:48:41.1613823Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2025-03-14T06:48:41.1614433Z Compiling torch_xla/csrc/aten_xla_type.cpp; 39s local 2025-03-14T06:48:41.1615041Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local 2025-03-14T06:48:41.1615675Z Compiling torch_xla/csrc/aten_fallback.cpp; 38s local 2025-03-14T06:48:41.1616439Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 38s local ... 2025-03-14T06:48:41.5416230Z 2025-03-14T06:48:41.5417425Z  2025-03-14T06:48:41.5417899Z  2025-03-14T06:48:41.5418315Z  2025-03-14T06:48:41.5418730Z  2025-03-14T06:48:41.5419138Z  2025-03-14T06:48:41.5419513Z  2025-03-14T06:48:41.5421194Z  2025-03-14T06:48:41.5421590Z  2025-03-14T06:48:41.5422529Z [20,451 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:41.5423542Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2025-03-14T06:48:41.5424350Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2025-03-14T06:48:41.5425063Z Compiling torch_xla/csrc/tensor.cpp; 52s local 2025-03-14T06:48:41.5425827Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2025-03-14T06:48:41.5426557Z Compiling torch_xla/csrc/aten_xla_type.cpp; 39s local 2025-03-14T06:48:41.5427487Z Compiling torch_xla/csrc/aten_xla_bridge.cpp; 38s local 2025-03-14T06:48:41.5428426Z Compiling torch_xla/csrc/aten_fallback.cpp; 38s local 2025-03-14T06:48:41.5429351Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 38s local ... 2025-03-14T06:48:41.8543847Z 2025-03-14T06:48:41.8544899Z  2025-03-14T06:48:41.8545419Z  2025-03-14T06:48:41.8545862Z  2025-03-14T06:48:41.8546286Z  2025-03-14T06:48:41.8546699Z  2025-03-14T06:48:41.8547118Z  2025-03-14T06:48:41.8547503Z  2025-03-14T06:48:41.8547886Z  2025-03-14T06:48:41.8548857Z [20,452 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:41.8549893Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2025-03-14T06:48:41.8550672Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2025-03-14T06:48:41.8551510Z Compiling torch_xla/csrc/tensor.cpp; 53s local 2025-03-14T06:48:41.8552308Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2025-03-14T06:48:41.8553094Z Compiling torch_xla/csrc/aten_xla_type.cpp; 39s local 2025-03-14T06:48:41.8553887Z Compiling torch_xla/csrc/aten_fallback.cpp; 38s local 2025-03-14T06:48:41.8554758Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 38s local 2025-03-14T06:48:41.8555635Z Compiling test/cpp/test_xla_sharding.cpp; 37s local ... 2025-03-14T06:48:42.1421135Z 2025-03-14T06:48:42.1421982Z  2025-03-14T06:48:42.1422473Z  2025-03-14T06:48:42.1422875Z  2025-03-14T06:48:42.1423302Z  2025-03-14T06:48:42.1423728Z  2025-03-14T06:48:42.1424074Z  2025-03-14T06:48:42.1424414Z  2025-03-14T06:48:42.1424785Z  2025-03-14T06:48:42.1425694Z [20,452 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:42.1426659Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2025-03-14T06:48:42.1427709Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2025-03-14T06:48:42.1428474Z Compiling torch_xla/csrc/tensor.cpp; 53s local 2025-03-14T06:48:42.1429202Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2025-03-14T06:48:42.1429998Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2025-03-14T06:48:42.1430841Z Compiling torch_xla/csrc/aten_fallback.cpp; 39s local 2025-03-14T06:48:42.1431713Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 39s local 2025-03-14T06:48:42.1432745Z Compiling test/cpp/test_xla_sharding.cpp; 38s local ... 2025-03-14T06:48:43.0387635Z 2025-03-14T06:48:43.0388439Z  2025-03-14T06:48:43.0388918Z  2025-03-14T06:48:43.0389290Z  2025-03-14T06:48:43.0389692Z  2025-03-14T06:48:43.0390058Z  2025-03-14T06:48:43.0390405Z  2025-03-14T06:48:43.0390758Z  2025-03-14T06:48:43.0391114Z  2025-03-14T06:48:43.0392011Z [20,453 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:43.0392955Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T06:48:43.0393722Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2025-03-14T06:48:43.0394748Z Compiling torch_xla/csrc/tensor.cpp; 54s local 2025-03-14T06:48:43.0395512Z Compiling torch_xla/csrc/ir_dump_util.cpp; 46s local 2025-03-14T06:48:43.0396384Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local 2025-03-14T06:48:43.0397388Z Compiling torch_xla/csrc/aten_fallback.cpp; 40s local 2025-03-14T06:48:43.0398217Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 39s local 2025-03-14T06:48:43.0399099Z Compiling test/cpp/test_xla_sharding.cpp; 39s local ... 2025-03-14T06:48:43.3430595Z 2025-03-14T06:48:43.3431473Z  2025-03-14T06:48:43.3431942Z  2025-03-14T06:48:43.3432347Z  2025-03-14T06:48:43.3432757Z  2025-03-14T06:48:43.3433178Z  2025-03-14T06:48:43.3433587Z  2025-03-14T06:48:43.3433981Z  2025-03-14T06:48:43.3434439Z  2025-03-14T06:48:43.3435370Z [20,453 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:43.3436373Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2025-03-14T06:48:43.3437203Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2025-03-14T06:48:43.3438023Z Compiling torch_xla/csrc/tensor.cpp; 54s local 2025-03-14T06:48:43.3438826Z Compiling torch_xla/csrc/ir_dump_util.cpp; 47s local 2025-03-14T06:48:43.3439675Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2025-03-14T06:48:43.3440478Z Compiling torch_xla/csrc/aten_fallback.cpp; 40s local 2025-03-14T06:48:43.3441334Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2025-03-14T06:48:43.3442135Z Compiling test/cpp/test_xla_sharding.cpp; 39s local ... 2025-03-14T06:48:43.7434926Z 2025-03-14T06:48:43.7435746Z  2025-03-14T06:48:43.7436222Z  2025-03-14T06:48:43.7436617Z  2025-03-14T06:48:43.7437072Z  2025-03-14T06:48:43.7437480Z  2025-03-14T06:48:43.7437906Z  2025-03-14T06:48:43.7438294Z  2025-03-14T06:48:43.7438679Z  2025-03-14T06:48:43.7439601Z [20,454 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:43.7440644Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2025-03-14T06:48:43.7441415Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T06:48:43.7442198Z Compiling torch_xla/csrc/tensor.cpp; 54s local 2025-03-14T06:48:43.7442970Z Compiling torch_xla/csrc/ir_dump_util.cpp; 47s local 2025-03-14T06:48:43.7443768Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2025-03-14T06:48:43.7444780Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2025-03-14T06:48:43.7450379Z Compiling test/cpp/test_xla_sharding.cpp; 39s local 2025-03-14T06:48:43.7451451Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 39s local ... 2025-03-14T06:48:43.9827221Z 2025-03-14T06:48:43.9828299Z  2025-03-14T06:48:43.9828956Z  2025-03-14T06:48:43.9829516Z  2025-03-14T06:48:43.9830049Z  2025-03-14T06:48:43.9830592Z  2025-03-14T06:48:43.9831145Z  2025-03-14T06:48:43.9831687Z  2025-03-14T06:48:43.9832229Z  2025-03-14T06:48:43.9833453Z [20,455 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:43.9834815Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2025-03-14T06:48:43.9835898Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T06:48:43.9836946Z Compiling torch_xla/csrc/tensor.cpp; 55s local 2025-03-14T06:48:43.9837985Z Compiling torch_xla/csrc/ir_dump_util.cpp; 47s local 2025-03-14T06:48:43.9839049Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local 2025-03-14T06:48:43.9840245Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local 2025-03-14T06:48:43.9841375Z Compiling test/cpp/test_xla_sharding.cpp; 40s local 2025-03-14T06:48:43.9842516Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2025-03-14T06:48:44.1940241Z 2025-03-14T06:48:44.1941310Z  2025-03-14T06:48:44.1942074Z  2025-03-14T06:48:44.1942400Z  2025-03-14T06:48:44.1942719Z  2025-03-14T06:48:44.1943042Z  2025-03-14T06:48:44.1943360Z  2025-03-14T06:48:44.1943666Z  2025-03-14T06:48:44.1943982Z  2025-03-14T06:48:44.1944872Z [20,457 / 20,653] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2025-03-14T06:48:44.1945658Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2025-03-14T06:48:44.1946273Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T06:48:44.1946856Z Compiling torch_xla/csrc/tensor.cpp; 55s local 2025-03-14T06:48:44.1947460Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2025-03-14T06:48:44.1948080Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local 2025-03-14T06:48:44.1948725Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2025-03-14T06:48:44.1949366Z Compiling test/cpp/test_xla_sharding.cpp; 40s local 2025-03-14T06:48:44.1950008Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2025-03-14T06:48:44.5439050Z 2025-03-14T06:48:44.5439929Z  2025-03-14T06:48:44.5440391Z  2025-03-14T06:48:44.5440806Z  2025-03-14T06:48:44.5441187Z  2025-03-14T06:48:44.5441595Z  2025-03-14T06:48:44.5442022Z  2025-03-14T06:48:44.5442414Z  2025-03-14T06:48:44.5442805Z  2025-03-14T06:48:44.5443744Z [20,458 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:44.5445036Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2025-03-14T06:48:44.5445787Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T06:48:44.5446578Z Compiling torch_xla/csrc/tensor.cpp; 55s local 2025-03-14T06:48:44.5447321Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2025-03-14T06:48:44.5448057Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local 2025-03-14T06:48:44.5449352Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2025-03-14T06:48:44.5450164Z Compiling test/cpp/test_xla_sharding.cpp; 40s local 2025-03-14T06:48:44.5451161Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2025-03-14T06:48:44.9442940Z 2025-03-14T06:48:44.9444184Z  2025-03-14T06:48:44.9445178Z  2025-03-14T06:48:44.9445859Z  2025-03-14T06:48:44.9446649Z  2025-03-14T06:48:44.9447190Z  2025-03-14T06:48:44.9447803Z  2025-03-14T06:48:44.9539499Z  2025-03-14T06:48:44.9539984Z  2025-03-14T06:48:44.9540927Z [20,458 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:44.9542319Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2025-03-14T06:48:44.9543316Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2025-03-14T06:48:44.9544077Z Compiling torch_xla/csrc/tensor.cpp; 56s local 2025-03-14T06:48:44.9544842Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2025-03-14T06:48:44.9545693Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local 2025-03-14T06:48:44.9546560Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local 2025-03-14T06:48:44.9547408Z Compiling test/cpp/test_xla_sharding.cpp; 41s local 2025-03-14T06:48:44.9548279Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 40s local ... 2025-03-14T06:48:45.9450976Z 2025-03-14T06:48:45.9452174Z  2025-03-14T06:48:45.9453009Z  2025-03-14T06:48:45.9453749Z  2025-03-14T06:48:45.9454621Z  2025-03-14T06:48:45.9455309Z  2025-03-14T06:48:45.9455952Z  2025-03-14T06:48:45.9456606Z  2025-03-14T06:48:45.9457291Z  2025-03-14T06:48:45.9459222Z [20,458 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:45.9472455Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2025-03-14T06:48:45.9473717Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2025-03-14T06:48:45.9474716Z Compiling torch_xla/csrc/tensor.cpp; 57s local 2025-03-14T06:48:45.9476224Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2025-03-14T06:48:45.9477228Z Compiling torch_xla/csrc/aten_xla_type.cpp; 43s local 2025-03-14T06:48:45.9478339Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2025-03-14T06:48:45.9479553Z Compiling test/cpp/test_xla_sharding.cpp; 42s local 2025-03-14T06:48:45.9480580Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 41s local ... 2025-03-14T06:48:46.1608187Z 2025-03-14T06:48:46.1609343Z  2025-03-14T06:48:46.1610130Z  2025-03-14T06:48:46.1610797Z  2025-03-14T06:48:46.1611602Z  2025-03-14T06:48:46.1612878Z  2025-03-14T06:48:46.1613369Z  2025-03-14T06:48:46.1613758Z  2025-03-14T06:48:46.1614146Z  2025-03-14T06:48:46.1615085Z [20,459 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:46.1615929Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2025-03-14T06:48:46.1616586Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2025-03-14T06:48:46.1617245Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2025-03-14T06:48:46.1618027Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2025-03-14T06:48:46.1618862Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2025-03-14T06:48:46.1619570Z Compiling test/cpp/test_xla_sharding.cpp; 42s local 2025-03-14T06:48:46.1620256Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2025-03-14T06:48:46.1620978Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local ... 2025-03-14T06:48:46.5456718Z 2025-03-14T06:48:46.5458001Z  2025-03-14T06:48:46.5458506Z  2025-03-14T06:48:46.5458937Z  2025-03-14T06:48:46.5459365Z  2025-03-14T06:48:46.5459812Z  2025-03-14T06:48:46.5460232Z  2025-03-14T06:48:46.5460659Z  2025-03-14T06:48:46.5461087Z  2025-03-14T06:48:46.5462019Z [20,459 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:46.5463079Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2025-03-14T06:48:46.5463842Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2025-03-14T06:48:46.5464667Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2025-03-14T06:48:46.5465704Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2025-03-14T06:48:46.5466526Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2025-03-14T06:48:46.5467370Z Compiling test/cpp/test_xla_sharding.cpp; 42s local 2025-03-14T06:48:46.5468193Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 42s local 2025-03-14T06:48:46.5469414Z Compiling torch_xla/csrc/aten_xla_type.cpp; 40s local ... 2025-03-14T06:48:47.5465577Z 2025-03-14T06:48:47.5466803Z  2025-03-14T06:48:47.5467418Z  2025-03-14T06:48:47.5467793Z  2025-03-14T06:48:47.5468202Z  2025-03-14T06:48:47.5468629Z  2025-03-14T06:48:47.5469040Z  2025-03-14T06:48:47.5469462Z  2025-03-14T06:48:47.5469858Z  2025-03-14T06:48:47.5470844Z [20,459 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:47.5471901Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2025-03-14T06:48:47.5472691Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T06:48:47.5473464Z Compiling torch_xla/csrc/ir_dump_util.cpp; 51s local 2025-03-14T06:48:47.5474240Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2025-03-14T06:48:47.5475095Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2025-03-14T06:48:47.5475944Z Compiling test/cpp/test_xla_sharding.cpp; 43s local 2025-03-14T06:48:47.5476783Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 43s local 2025-03-14T06:48:47.5477790Z Compiling torch_xla/csrc/aten_xla_type.cpp; 41s local ... 2025-03-14T06:48:48.3003600Z 2025-03-14T06:48:48.3004473Z  2025-03-14T06:48:48.3005136Z  2025-03-14T06:48:48.3005792Z  2025-03-14T06:48:48.3006190Z  2025-03-14T06:48:48.3006588Z  2025-03-14T06:48:48.3006995Z  2025-03-14T06:48:48.3007386Z  2025-03-14T06:48:48.3007740Z  2025-03-14T06:48:48.3008790Z [20,460 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:48.3009787Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T06:48:48.3010585Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2025-03-14T06:48:48.3011355Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2025-03-14T06:48:48.3012143Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2025-03-14T06:48:48.3013009Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2025-03-14T06:48:48.3013834Z Compiling test/cpp/test_xla_sharding.cpp; 44s local 2025-03-14T06:48:48.3014647Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2025-03-14T06:48:48.3015509Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local ... 2025-03-14T06:48:48.5383964Z 2025-03-14T06:48:48.5384830Z  2025-03-14T06:48:48.5385308Z  2025-03-14T06:48:48.5385721Z  2025-03-14T06:48:48.5386123Z  2025-03-14T06:48:48.5386561Z  2025-03-14T06:48:48.5386979Z  2025-03-14T06:48:48.5387372Z  2025-03-14T06:48:48.5387785Z  2025-03-14T06:48:48.5388686Z [20,461 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:48.5389861Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T06:48:48.5390663Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2025-03-14T06:48:48.5391487Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2025-03-14T06:48:48.5392303Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2025-03-14T06:48:48.5393156Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2025-03-14T06:48:48.5394011Z Compiling test/cpp/test_xla_sharding.cpp; 44s local 2025-03-14T06:48:48.5394797Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2025-03-14T06:48:48.5395584Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local ... 2025-03-14T06:48:48.7472485Z 2025-03-14T06:48:48.7473768Z  2025-03-14T06:48:48.7474263Z  2025-03-14T06:48:48.7474650Z  2025-03-14T06:48:48.7475056Z  2025-03-14T06:48:48.7475448Z  2025-03-14T06:48:48.7475853Z  2025-03-14T06:48:48.7476240Z  2025-03-14T06:48:48.7476623Z  2025-03-14T06:48:48.7477583Z [20,461 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:48.7478914Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T06:48:48.7479876Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2025-03-14T06:48:48.7480660Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2025-03-14T06:48:48.7481365Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2025-03-14T06:48:48.7482159Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2025-03-14T06:48:48.7483022Z Compiling test/cpp/test_xla_sharding.cpp; 44s local 2025-03-14T06:48:48.7483851Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 44s local 2025-03-14T06:48:48.7484803Z Compiling torch_xla/csrc/aten_xla_type.cpp; 42s local ... 2025-03-14T06:48:49.1480410Z 2025-03-14T06:48:49.1481326Z  2025-03-14T06:48:49.1481848Z  2025-03-14T06:48:49.1482279Z  2025-03-14T06:48:49.1482690Z  2025-03-14T06:48:49.1483128Z  2025-03-14T06:48:49.1483549Z  2025-03-14T06:48:49.1483978Z  2025-03-14T06:48:49.1484376Z  2025-03-14T06:48:49.1485468Z [20,462 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:49.1486430Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T06:48:49.1487186Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2025-03-14T06:48:49.1487930Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2025-03-14T06:48:49.1488966Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2025-03-14T06:48:49.1489833Z Compiling test/cpp/test_xla_sharding.cpp; 45s local 2025-03-14T06:48:49.1490791Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2025-03-14T06:48:49.1491591Z Compiling torch_xla/csrc/aten_xla_type.cpp; 43s local 2025-03-14T06:48:49.1492368Z Compiling torch_xla/csrc/debug_util.cpp; 40s local ... 2025-03-14T06:48:49.3480815Z 2025-03-14T06:48:49.3481680Z  2025-03-14T06:48:49.3482196Z  2025-03-14T06:48:49.3484200Z  2025-03-14T06:48:49.3485298Z  2025-03-14T06:48:49.3486159Z  2025-03-14T06:48:49.3486649Z  2025-03-14T06:48:49.3487049Z  2025-03-14T06:48:49.3487426Z  2025-03-14T06:48:49.3488392Z [20,462 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:49.3489440Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2025-03-14T06:48:49.3490247Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2025-03-14T06:48:49.3490990Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2025-03-14T06:48:49.3491771Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2025-03-14T06:48:49.3492606Z Compiling test/cpp/test_xla_sharding.cpp; 45s local 2025-03-14T06:48:49.3493376Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 45s local 2025-03-14T06:48:49.3494138Z Compiling torch_xla/csrc/aten_xla_type.cpp; 43s local 2025-03-14T06:48:49.3494914Z Compiling torch_xla/csrc/debug_util.cpp; 40s local ... 2025-03-14T06:48:50.1360171Z 2025-03-14T06:48:50.1361370Z  2025-03-14T06:48:50.1361824Z  2025-03-14T06:48:50.1362181Z  2025-03-14T06:48:50.1362528Z  2025-03-14T06:48:50.1362885Z  2025-03-14T06:48:50.1363228Z  2025-03-14T06:48:50.1363564Z  2025-03-14T06:48:50.1363911Z  2025-03-14T06:48:50.1364854Z [20,463 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:50.1365950Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2025-03-14T06:48:50.1366636Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2025-03-14T06:48:50.1367355Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2025-03-14T06:48:50.1368066Z Compiling test/cpp/test_xla_sharding.cpp; 46s local 2025-03-14T06:48:50.1368782Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 46s local 2025-03-14T06:48:50.1369473Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2025-03-14T06:48:50.1370143Z Compiling torch_xla/csrc/debug_util.cpp; 41s local 2025-03-14T06:48:50.1371161Z Compiling torch_xla/csrc/dl_convertor.cpp; 37s local ... 2025-03-14T06:48:50.6589283Z 2025-03-14T06:48:50.6590149Z  2025-03-14T06:48:50.6590788Z  2025-03-14T06:48:50.6591109Z  2025-03-14T06:48:50.6591578Z  2025-03-14T06:48:50.6591890Z  2025-03-14T06:48:50.6592197Z  2025-03-14T06:48:50.6592500Z  2025-03-14T06:48:50.6592807Z  2025-03-14T06:48:50.6593987Z [20,463 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:50.6594737Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2025-03-14T06:48:50.6595320Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2025-03-14T06:48:50.6595904Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2025-03-14T06:48:50.6596488Z Compiling test/cpp/test_xla_sharding.cpp; 46s local 2025-03-14T06:48:50.6597107Z Compiling torch_xla/csrc/aten_autograd_ops.cpp; 46s local 2025-03-14T06:48:50.6597722Z Compiling torch_xla/csrc/aten_xla_type.cpp; 44s local 2025-03-14T06:48:50.6598296Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2025-03-14T06:48:50.6598904Z Compiling torch_xla/csrc/dl_convertor.cpp; 38s local ... 2025-03-14T06:48:50.9175338Z 2025-03-14T06:48:50.9176225Z  2025-03-14T06:48:50.9176805Z  2025-03-14T06:48:50.9177204Z  2025-03-14T06:48:50.9177842Z  2025-03-14T06:48:50.9178201Z  2025-03-14T06:48:50.9178596Z  2025-03-14T06:48:50.9179003Z  2025-03-14T06:48:50.9179383Z  2025-03-14T06:48:50.9180256Z [20,465 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:50.9181548Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2025-03-14T06:48:50.9182307Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2025-03-14T06:48:50.9183186Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2025-03-14T06:48:50.9183907Z Compiling test/cpp/test_xla_sharding.cpp; 46s local 2025-03-14T06:48:50.9184674Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2025-03-14T06:48:50.9185492Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2025-03-14T06:48:50.9186301Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 38s local 2025-03-14T06:48:50.9187131Z Compiling torch_xla/csrc/helpers.cpp; 35s local ... 2025-03-14T06:48:51.2596875Z 2025-03-14T06:48:51.2597765Z  2025-03-14T06:48:51.2598243Z  2025-03-14T06:48:51.2598661Z  2025-03-14T06:48:51.2599063Z  2025-03-14T06:48:51.2611805Z  2025-03-14T06:48:51.2612285Z  2025-03-14T06:48:51.2612690Z  2025-03-14T06:48:51.2613074Z  2025-03-14T06:48:51.2613957Z [20,465 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:51.2614939Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2025-03-14T06:48:51.2615705Z Compiling torch_xla/csrc/ir_dump_util.cpp; 55s local 2025-03-14T06:48:51.2616457Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2025-03-14T06:48:51.2617227Z Compiling test/cpp/test_xla_sharding.cpp; 47s local 2025-03-14T06:48:51.2618017Z Compiling torch_xla/csrc/aten_xla_type.cpp; 45s local 2025-03-14T06:48:51.2618727Z Compiling torch_xla/csrc/debug_util.cpp; 42s local 2025-03-14T06:48:51.2619546Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 38s local 2025-03-14T06:48:51.2620369Z Compiling torch_xla/csrc/helpers.cpp; 36s local ... 2025-03-14T06:48:51.9198474Z 2025-03-14T06:48:51.9199325Z  2025-03-14T06:48:51.9199867Z  2025-03-14T06:48:51.9201757Z  2025-03-14T06:48:51.9202555Z  2025-03-14T06:48:51.9203203Z  2025-03-14T06:48:51.9203669Z  2025-03-14T06:48:51.9204096Z  2025-03-14T06:48:51.9204646Z  2025-03-14T06:48:51.9205609Z [20,466 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:51.9206644Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2025-03-14T06:48:51.9207753Z Compiling torch_xla/csrc/ir_dump_util.cpp; 55s local 2025-03-14T06:48:51.9210331Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2025-03-14T06:48:51.9211271Z Compiling test/cpp/test_xla_sharding.cpp; 47s local 2025-03-14T06:48:51.9212096Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2025-03-14T06:48:51.9213021Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local 2025-03-14T06:48:51.9213893Z Compiling torch_xla/csrc/helpers.cpp; 36s local 2025-03-14T06:48:51.9214712Z Compiling torch_xla/csrc/elementwise.cpp; 36s local ... 2025-03-14T06:48:52.1440132Z 2025-03-14T06:48:52.1441002Z  2025-03-14T06:48:52.1441508Z  2025-03-14T06:48:52.1441913Z  2025-03-14T06:48:52.1442306Z  2025-03-14T06:48:52.1442703Z  2025-03-14T06:48:52.1443104Z  2025-03-14T06:48:52.1443509Z  2025-03-14T06:48:52.1443919Z  2025-03-14T06:48:52.1445013Z [20,467 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:52.1445806Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2025-03-14T06:48:52.1446589Z Compiling torch_xla/csrc/ir_dump_util.cpp; 55s local 2025-03-14T06:48:52.1447353Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T06:48:52.1448221Z Compiling test/cpp/test_xla_sharding.cpp; 48s local 2025-03-14T06:48:52.1448915Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2025-03-14T06:48:52.1449764Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local 2025-03-14T06:48:52.1450717Z Compiling torch_xla/csrc/helpers.cpp; 37s local 2025-03-14T06:48:52.1451407Z Compiling torch_xla/csrc/ir_dump_util.cpp; 35s local ... 2025-03-14T06:48:52.3473736Z 2025-03-14T06:48:52.3474774Z  2025-03-14T06:48:52.3475187Z  2025-03-14T06:48:52.3475515Z  2025-03-14T06:48:52.3475826Z  2025-03-14T06:48:52.3476141Z  2025-03-14T06:48:52.3476456Z  2025-03-14T06:48:52.3476807Z  2025-03-14T06:48:52.3477139Z  2025-03-14T06:48:52.3477899Z [20,468 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:52.3478665Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2025-03-14T06:48:52.3479291Z Compiling torch_xla/csrc/ir_dump_util.cpp; 56s local 2025-03-14T06:48:52.3479918Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T06:48:52.3480525Z Compiling test/cpp/test_xla_sharding.cpp; 48s local 2025-03-14T06:48:52.3481139Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2025-03-14T06:48:52.3481812Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local 2025-03-14T06:48:52.3482445Z Compiling torch_xla/csrc/helpers.cpp; 37s local 2025-03-14T06:48:52.3483079Z Compiling torch_xla/csrc/ir_dump_util.cpp; 35s local ... 2025-03-14T06:48:52.6601841Z 2025-03-14T06:48:52.6603013Z  2025-03-14T06:48:52.6603453Z  2025-03-14T06:48:52.6603813Z  2025-03-14T06:48:52.6604196Z  2025-03-14T06:48:52.6604673Z  2025-03-14T06:48:52.6605033Z  2025-03-14T06:48:52.6605391Z  2025-03-14T06:48:52.6605736Z  2025-03-14T06:48:52.6606742Z [20,468 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:52.6607625Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2025-03-14T06:48:52.6608318Z Compiling torch_xla/csrc/ir_dump_util.cpp; 56s local 2025-03-14T06:48:52.6609022Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T06:48:52.6609724Z Compiling test/cpp/test_xla_sharding.cpp; 48s local 2025-03-14T06:48:52.6610414Z Compiling torch_xla/csrc/aten_xla_type.cpp; 46s local 2025-03-14T06:48:52.6611157Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 39s local 2025-03-14T06:48:52.6611878Z Compiling torch_xla/csrc/helpers.cpp; 37s local 2025-03-14T06:48:52.6612552Z Compiling torch_xla/csrc/ir_dump_util.cpp; 35s local ... 2025-03-14T06:48:52.9491172Z 2025-03-14T06:48:52.9492065Z  2025-03-14T06:48:52.9492575Z  2025-03-14T06:48:52.9493115Z  2025-03-14T06:48:52.9493528Z  2025-03-14T06:48:52.9493937Z  2025-03-14T06:48:52.9494354Z  2025-03-14T06:48:52.9494773Z  2025-03-14T06:48:52.9495194Z  2025-03-14T06:48:52.9496188Z [20,470 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:52.9497124Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2025-03-14T06:48:52.9497939Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T06:48:52.9498720Z Compiling test/cpp/test_xla_sharding.cpp; 49s local 2025-03-14T06:48:52.9499561Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2025-03-14T06:48:52.9500471Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 40s local 2025-03-14T06:48:52.9501342Z Compiling torch_xla/csrc/ir_dump_util.cpp; 35s local 2025-03-14T06:48:52.9502101Z Compiling torch_xla/csrc/pooling.cpp; 35s local 2025-03-14T06:48:52.9502891Z Compiling torch_xla/csrc/reduction.cpp; 32s local ... 2025-03-14T06:48:53.2666276Z 2025-03-14T06:48:53.2667528Z  2025-03-14T06:48:53.2667984Z  2025-03-14T06:48:53.2668367Z  2025-03-14T06:48:53.2668745Z  2025-03-14T06:48:53.2669493Z  2025-03-14T06:48:53.2669844Z  2025-03-14T06:48:53.2670213Z  2025-03-14T06:48:53.2670634Z  2025-03-14T06:48:53.2671500Z [20,470 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:53.2673183Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2025-03-14T06:48:53.2674155Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2025-03-14T06:48:53.2675128Z Compiling test/cpp/test_xla_sharding.cpp; 49s local 2025-03-14T06:48:53.2676161Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2025-03-14T06:48:53.2677270Z Compiling torch_xla/csrc/cross_replica_reduces.cpp; 40s local 2025-03-14T06:48:53.2678373Z Compiling torch_xla/csrc/ir_dump_util.cpp; 36s local 2025-03-14T06:48:53.2679294Z Compiling torch_xla/csrc/pooling.cpp; 35s local 2025-03-14T06:48:53.2680301Z Compiling torch_xla/csrc/reduction.cpp; 33s local ... 2025-03-14T06:48:53.4611526Z 2025-03-14T06:48:53.4615004Z  2025-03-14T06:48:53.4615461Z  2025-03-14T06:48:53.4615818Z  2025-03-14T06:48:53.4616174Z  2025-03-14T06:48:53.4616535Z  2025-03-14T06:48:53.4616891Z  2025-03-14T06:48:53.4617248Z  2025-03-14T06:48:53.4617618Z  2025-03-14T06:48:53.4618494Z [20,471 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:53.4619391Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T06:48:53.4620106Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2025-03-14T06:48:53.4620835Z Compiling test/cpp/test_xla_sharding.cpp; 49s local 2025-03-14T06:48:53.4621551Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2025-03-14T06:48:53.4622271Z Compiling torch_xla/csrc/ir_dump_util.cpp; 36s local 2025-03-14T06:48:53.4622943Z Compiling torch_xla/csrc/pooling.cpp; 35s local 2025-03-14T06:48:53.4623604Z Compiling torch_xla/csrc/reduction.cpp; 33s local 2025-03-14T06:48:53.4624319Z Compiling torch_xla/csrc/tensor_ops.cpp; 30s local ... 2025-03-14T06:48:53.7004267Z 2025-03-14T06:48:53.7005202Z  2025-03-14T06:48:53.7005644Z  2025-03-14T06:48:53.7006021Z  2025-03-14T06:48:53.7007116Z  2025-03-14T06:48:53.7007478Z  2025-03-14T06:48:53.7007847Z  2025-03-14T06:48:53.7008215Z  2025-03-14T06:48:53.7008574Z  2025-03-14T06:48:53.7009438Z [20,472 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:48:53.7010343Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T06:48:53.7011347Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2025-03-14T06:48:53.7012076Z Compiling test/cpp/test_xla_sharding.cpp; 49s local 2025-03-14T06:48:53.7012916Z Compiling torch_xla/csrc/aten_xla_type.cpp; 47s local 2025-03-14T06:48:53.7013660Z Compiling torch_xla/csrc/ir_dump_util.cpp; 36s local 2025-03-14T06:48:53.7014377Z Compiling torch_xla/csrc/reduction.cpp; 33s local 2025-03-14T06:48:53.7015095Z Compiling torch_xla/csrc/tensor_ops.cpp; 31s local 2025-03-14T06:48:53.7015846Z Compiling torch_xla/csrc/tensor_impl.cpp; 29s local ... 2025-03-14T06:48:54.0615846Z 2025-03-14T06:48:54.0617130Z  2025-03-14T06:48:54.0617574Z  2025-03-14T06:48:54.0617947Z  2025-03-14T06:48:54.0618317Z  2025-03-14T06:48:54.0618676Z  2025-03-14T06:48:54.0619031Z  2025-03-14T06:48:54.0619380Z  2025-03-14T06:48:54.0619736Z  2025-03-14T06:48:54.0620614Z [20,472 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:54.0621501Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T06:48:54.0622210Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2025-03-14T06:48:54.0622927Z Compiling test/cpp/test_xla_sharding.cpp; 50s local 2025-03-14T06:48:54.0623650Z Compiling torch_xla/csrc/aten_xla_type.cpp; 48s local 2025-03-14T06:48:54.0624640Z Compiling torch_xla/csrc/ir_dump_util.cpp; 37s local 2025-03-14T06:48:54.0625377Z Compiling torch_xla/csrc/reduction.cpp; 33s local 2025-03-14T06:48:54.0626081Z Compiling torch_xla/csrc/tensor_ops.cpp; 31s local 2025-03-14T06:48:54.0626918Z Compiling torch_xla/csrc/tensor_impl.cpp; 30s local ... 2025-03-14T06:48:55.0624174Z 2025-03-14T06:48:55.0625099Z  2025-03-14T06:48:55.0625702Z  2025-03-14T06:48:55.0626158Z  2025-03-14T06:48:55.0626598Z  2025-03-14T06:48:55.0626973Z  2025-03-14T06:48:55.0627459Z  2025-03-14T06:48:55.0627908Z  2025-03-14T06:48:55.0628293Z  2025-03-14T06:48:55.0629244Z [20,472 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:55.0630252Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2025-03-14T06:48:55.0631041Z Compiling torch_xla/csrc/aten_xla_type.cpp; 52s local 2025-03-14T06:48:55.0631994Z Compiling test/cpp/test_xla_sharding.cpp; 51s local 2025-03-14T06:48:55.0632783Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2025-03-14T06:48:55.0633621Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local 2025-03-14T06:48:55.0634376Z Compiling torch_xla/csrc/reduction.cpp; 34s local 2025-03-14T06:48:55.0635143Z Compiling torch_xla/csrc/tensor_ops.cpp; 32s local 2025-03-14T06:48:55.0635921Z Compiling torch_xla/csrc/tensor_impl.cpp; 31s local ... 2025-03-14T06:48:55.6629386Z 2025-03-14T06:48:55.6630305Z  2025-03-14T06:48:55.6630818Z  2025-03-14T06:48:55.6631208Z  2025-03-14T06:48:55.6631583Z  2025-03-14T06:48:55.6631992Z  2025-03-14T06:48:55.6632424Z  2025-03-14T06:48:55.6632775Z  2025-03-14T06:48:55.6633156Z  2025-03-14T06:48:55.6634063Z [20,473 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:55.6635106Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2025-03-14T06:48:55.6635909Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2025-03-14T06:48:55.6636656Z Compiling test/cpp/test_xla_sharding.cpp; 51s local 2025-03-14T06:48:55.6637432Z Compiling torch_xla/csrc/aten_xla_type.cpp; 49s local 2025-03-14T06:48:55.6638397Z Compiling torch_xla/csrc/ir_dump_util.cpp; 38s local 2025-03-14T06:48:55.6639407Z Compiling torch_xla/csrc/reduction.cpp; 35s local 2025-03-14T06:48:55.6640186Z Compiling torch_xla/csrc/tensor_impl.cpp; 31s local 2025-03-14T06:48:55.6640964Z Compiling torch_xla/csrc/tensor.cpp; 31s local ... 2025-03-14T06:48:56.0632628Z 2025-03-14T06:48:56.0633831Z  2025-03-14T06:48:56.0634336Z  2025-03-14T06:48:56.0634956Z  2025-03-14T06:48:56.0635421Z  2025-03-14T06:48:56.0635805Z  2025-03-14T06:48:56.0636345Z  2025-03-14T06:48:56.0636793Z  2025-03-14T06:48:56.0637186Z  2025-03-14T06:48:56.0638139Z [20,473 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:56.0639093Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2025-03-14T06:48:56.0639893Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2025-03-14T06:48:56.0640718Z Compiling test/cpp/test_xla_sharding.cpp; 52s local 2025-03-14T06:48:56.0641512Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T06:48:56.0642300Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local 2025-03-14T06:48:56.0643063Z Compiling torch_xla/csrc/reduction.cpp; 35s local 2025-03-14T06:48:56.0643840Z Compiling torch_xla/csrc/tensor_impl.cpp; 32s local 2025-03-14T06:48:56.0644784Z Compiling torch_xla/csrc/tensor.cpp; 32s local ... 2025-03-14T06:48:56.6641899Z 2025-03-14T06:48:56.6642745Z  2025-03-14T06:48:56.6643278Z  2025-03-14T06:48:56.6643694Z  2025-03-14T06:48:56.6644066Z  2025-03-14T06:48:56.6644422Z  2025-03-14T06:48:56.6644926Z  2025-03-14T06:48:56.6645292Z  2025-03-14T06:48:56.6645640Z  2025-03-14T06:48:56.6646936Z [20,474 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:48:56.6647940Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2025-03-14T06:48:56.6649035Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2025-03-14T06:48:56.6649786Z Compiling test/cpp/test_xla_sharding.cpp; 52s local 2025-03-14T06:48:56.6650566Z Compiling torch_xla/csrc/aten_xla_type.cpp; 50s local 2025-03-14T06:48:56.6651222Z Compiling torch_xla/csrc/ir_dump_util.cpp; 39s local 2025-03-14T06:48:56.6651939Z Compiling torch_xla/csrc/tensor_impl.cpp; 32s local 2025-03-14T06:48:56.6652664Z Compiling torch_xla/csrc/tensor.cpp; 32s local 2025-03-14T06:48:56.6653559Z Compiling .../csrc/ops/upsample_nearest2d_backward.cpp; 32s local ... 2025-03-14T06:48:57.0643598Z 2025-03-14T06:48:57.0644657Z  2025-03-14T06:48:57.0645080Z  2025-03-14T06:48:57.0647166Z  2025-03-14T06:48:57.0647987Z  2025-03-14T06:48:57.0648776Z  2025-03-14T06:48:57.0649210Z  2025-03-14T06:48:57.0651223Z  2025-03-14T06:48:57.0651954Z  2025-03-14T06:48:57.0653251Z [20,475 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:57.0654326Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2025-03-14T06:48:57.0655153Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2025-03-14T06:48:57.0655966Z Compiling test/cpp/test_xla_sharding.cpp; 53s local 2025-03-14T06:48:57.0656760Z Compiling torch_xla/csrc/aten_xla_type.cpp; 51s local 2025-03-14T06:48:57.0657598Z Compiling torch_xla/csrc/ir_dump_util.cpp; 40s local 2025-03-14T06:48:57.0658404Z Compiling torch_xla/csrc/tensor_impl.cpp; 33s local 2025-03-14T06:48:57.0659175Z Compiling torch_xla/csrc/tensor.cpp; 33s local 2025-03-14T06:48:57.0660001Z Compiling torch_xla/csrc/tensor_methods.cpp; 31s local ... 2025-03-14T06:48:58.0651482Z 2025-03-14T06:48:58.0652443Z  2025-03-14T06:48:58.0652957Z  2025-03-14T06:48:58.0653366Z  2025-03-14T06:48:58.0653744Z  2025-03-14T06:48:58.0654148Z  2025-03-14T06:48:58.0654547Z  2025-03-14T06:48:58.0654958Z  2025-03-14T06:48:58.0655369Z  2025-03-14T06:48:58.0656342Z [20,475 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:58.0657311Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2025-03-14T06:48:58.0658128Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2025-03-14T06:48:58.0658953Z Compiling test/cpp/test_xla_sharding.cpp; 54s local 2025-03-14T06:48:58.0660124Z Compiling torch_xla/csrc/aten_xla_type.cpp; 52s local 2025-03-14T06:48:58.0661076Z Compiling torch_xla/csrc/ir_dump_util.cpp; 41s local 2025-03-14T06:48:58.0661810Z Compiling torch_xla/csrc/tensor_impl.cpp; 34s local 2025-03-14T06:48:58.0662550Z Compiling torch_xla/csrc/tensor.cpp; 34s local 2025-03-14T06:48:58.0663357Z Compiling torch_xla/csrc/tensor_methods.cpp; 32s local ... 2025-03-14T06:48:59.2659560Z 2025-03-14T06:48:59.2660489Z  2025-03-14T06:48:59.2660982Z  2025-03-14T06:48:59.2661376Z  2025-03-14T06:48:59.2661786Z  2025-03-14T06:48:59.2662183Z  2025-03-14T06:48:59.2662564Z  2025-03-14T06:48:59.2662931Z  2025-03-14T06:48:59.2663317Z  2025-03-14T06:48:59.2664249Z [20,475 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:48:59.2665229Z Compiling torch_xla/csrc/tensor_util.cpp; 72s local 2025-03-14T06:48:59.2666259Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2025-03-14T06:48:59.2667032Z Compiling test/cpp/test_xla_sharding.cpp; 55s local 2025-03-14T06:48:59.2667776Z Compiling torch_xla/csrc/aten_xla_type.cpp; 53s local 2025-03-14T06:48:59.2668547Z Compiling torch_xla/csrc/ir_dump_util.cpp; 42s local 2025-03-14T06:48:59.2669265Z Compiling torch_xla/csrc/tensor_impl.cpp; 35s local 2025-03-14T06:48:59.2670326Z Compiling torch_xla/csrc/tensor.cpp; 35s local 2025-03-14T06:48:59.2671106Z Compiling torch_xla/csrc/tensor_methods.cpp; 33s local ... 2025-03-14T06:49:00.4668268Z 2025-03-14T06:49:00.4669178Z  2025-03-14T06:49:00.4669675Z  2025-03-14T06:49:00.4670078Z  2025-03-14T06:49:00.4670486Z  2025-03-14T06:49:00.4670889Z  2025-03-14T06:49:00.4671269Z  2025-03-14T06:49:00.4671665Z  2025-03-14T06:49:00.4672062Z  2025-03-14T06:49:00.4673006Z [20,475 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:00.4674046Z Compiling torch_xla/csrc/tensor_util.cpp; 74s local 2025-03-14T06:49:00.4674855Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2025-03-14T06:49:00.4675653Z Compiling test/cpp/test_xla_sharding.cpp; 56s local 2025-03-14T06:49:00.4676430Z Compiling torch_xla/csrc/aten_xla_type.cpp; 54s local 2025-03-14T06:49:00.4677238Z Compiling torch_xla/csrc/ir_dump_util.cpp; 43s local 2025-03-14T06:49:00.4678023Z Compiling torch_xla/csrc/tensor_impl.cpp; 36s local 2025-03-14T06:49:00.4678775Z Compiling torch_xla/csrc/tensor.cpp; 36s local 2025-03-14T06:49:00.4679588Z Compiling torch_xla/csrc/tensor_methods.cpp; 35s local ... 2025-03-14T06:49:01.2674085Z 2025-03-14T06:49:01.2674952Z  2025-03-14T06:49:01.2675440Z  2025-03-14T06:49:01.2675826Z  2025-03-14T06:49:01.2676222Z  2025-03-14T06:49:01.2676606Z  2025-03-14T06:49:01.2676990Z  2025-03-14T06:49:01.2677383Z  2025-03-14T06:49:01.2677777Z  2025-03-14T06:49:01.2678914Z [20,476 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:01.2679918Z Compiling torch_xla/csrc/tensor_util.cpp; 74s local 2025-03-14T06:49:01.2680844Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2025-03-14T06:49:01.2681547Z Compiling test/cpp/test_xla_sharding.cpp; 57s local 2025-03-14T06:49:01.2682493Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2025-03-14T06:49:01.2683358Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2025-03-14T06:49:01.2684184Z Compiling torch_xla/csrc/tensor.cpp; 37s local 2025-03-14T06:49:01.2685185Z Compiling torch_xla/csrc/tensor_methods.cpp; 35s local 2025-03-14T06:49:01.2685913Z Compiling torch_xla/csrc/torch_util.cpp; 32s local ... 2025-03-14T06:49:01.6677317Z 2025-03-14T06:49:01.6678612Z  2025-03-14T06:49:01.6679118Z  2025-03-14T06:49:01.6679523Z  2025-03-14T06:49:01.6679935Z  2025-03-14T06:49:01.6680324Z  2025-03-14T06:49:01.6681091Z  2025-03-14T06:49:01.6681528Z  2025-03-14T06:49:01.6681974Z  2025-03-14T06:49:01.6683063Z [20,476 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:01.6684068Z Compiling torch_xla/csrc/tensor_util.cpp; 75s local 2025-03-14T06:49:01.6685061Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2025-03-14T06:49:01.6685847Z Compiling test/cpp/test_xla_sharding.cpp; 57s local 2025-03-14T06:49:01.6686640Z Compiling torch_xla/csrc/aten_xla_type.cpp; 55s local 2025-03-14T06:49:01.6687436Z Compiling torch_xla/csrc/ir_dump_util.cpp; 44s local 2025-03-14T06:49:01.6688191Z Compiling torch_xla/csrc/tensor.cpp; 37s local 2025-03-14T06:49:01.6688961Z Compiling torch_xla/csrc/tensor_methods.cpp; 36s local 2025-03-14T06:49:01.6689798Z Compiling torch_xla/csrc/torch_util.cpp; 33s local ... 2025-03-14T06:49:02.6686063Z 2025-03-14T06:49:02.6686981Z  2025-03-14T06:49:02.6687469Z  2025-03-14T06:49:02.6687885Z  2025-03-14T06:49:02.6688267Z  2025-03-14T06:49:02.6688664Z  2025-03-14T06:49:02.6689036Z  2025-03-14T06:49:02.6689433Z  2025-03-14T06:49:02.6689827Z  2025-03-14T06:49:02.6690761Z [20,476 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:02.6692066Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2025-03-14T06:49:02.6692850Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2025-03-14T06:49:02.6693740Z Compiling test/cpp/test_xla_sharding.cpp; 58s local 2025-03-14T06:49:02.6694491Z Compiling torch_xla/csrc/aten_xla_type.cpp; 56s local 2025-03-14T06:49:02.6695255Z Compiling torch_xla/csrc/ir_dump_util.cpp; 45s local 2025-03-14T06:49:02.6695969Z Compiling torch_xla/csrc/tensor.cpp; 38s local 2025-03-14T06:49:02.6696718Z Compiling torch_xla/csrc/tensor_methods.cpp; 37s local 2025-03-14T06:49:02.6697555Z Compiling torch_xla/csrc/torch_util.cpp; 34s local ... 2025-03-14T06:49:03.6692856Z 2025-03-14T06:49:03.6693761Z  2025-03-14T06:49:03.6694228Z  2025-03-14T06:49:03.6694579Z  2025-03-14T06:49:03.6694924Z  2025-03-14T06:49:03.6695262Z  2025-03-14T06:49:03.6695591Z  2025-03-14T06:49:03.6695937Z  2025-03-14T06:49:03.6696280Z  2025-03-14T06:49:03.6697090Z [20,476 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:03.6697981Z Compiling torch_xla/csrc/tensor_util.cpp; 77s local 2025-03-14T06:49:03.6698696Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2025-03-14T06:49:03.6699398Z Compiling test/cpp/test_xla_sharding.cpp; 59s local 2025-03-14T06:49:03.6700112Z Compiling torch_xla/csrc/aten_xla_type.cpp; 57s local 2025-03-14T06:49:03.6700790Z Compiling torch_xla/csrc/ir_dump_util.cpp; 46s local 2025-03-14T06:49:03.6701430Z Compiling torch_xla/csrc/tensor.cpp; 39s local 2025-03-14T06:49:03.6702128Z Compiling torch_xla/csrc/tensor_methods.cpp; 38s local 2025-03-14T06:49:03.6702869Z Compiling torch_xla/csrc/torch_util.cpp; 35s local ... 2025-03-14T06:49:04.6698777Z 2025-03-14T06:49:04.6737810Z  2025-03-14T06:49:04.6738294Z  2025-03-14T06:49:04.6738668Z  2025-03-14T06:49:04.6739033Z  2025-03-14T06:49:04.6739451Z  2025-03-14T06:49:04.6739800Z  2025-03-14T06:49:04.6740143Z  2025-03-14T06:49:04.6740479Z  2025-03-14T06:49:04.6741337Z [20,476 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:04.6742244Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2025-03-14T06:49:04.6742941Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2025-03-14T06:49:04.6743661Z Compiling test/cpp/test_xla_sharding.cpp; 60s local 2025-03-14T06:49:04.6744401Z Compiling torch_xla/csrc/aten_xla_type.cpp; 58s local 2025-03-14T06:49:04.6745394Z Compiling torch_xla/csrc/ir_dump_util.cpp; 47s local 2025-03-14T06:49:04.6746086Z Compiling torch_xla/csrc/tensor.cpp; 40s local 2025-03-14T06:49:04.6746907Z Compiling torch_xla/csrc/tensor_methods.cpp; 39s local 2025-03-14T06:49:04.6747649Z Compiling torch_xla/csrc/torch_util.cpp; 36s local ... 2025-03-14T06:49:05.8708616Z 2025-03-14T06:49:05.8740642Z  2025-03-14T06:49:05.8741138Z  2025-03-14T06:49:05.8741522Z  2025-03-14T06:49:05.8741905Z  2025-03-14T06:49:05.8742294Z  2025-03-14T06:49:05.8742672Z  2025-03-14T06:49:05.8743109Z  2025-03-14T06:49:05.8743500Z  2025-03-14T06:49:05.8744450Z [20,476 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:05.8745379Z Compiling torch_xla/csrc/tensor_util.cpp; 79s local 2025-03-14T06:49:05.8745983Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2025-03-14T06:49:05.8746702Z Compiling test/cpp/test_xla_sharding.cpp; 61s local 2025-03-14T06:49:05.8747461Z Compiling torch_xla/csrc/aten_xla_type.cpp; 59s local 2025-03-14T06:49:05.8748239Z Compiling torch_xla/csrc/ir_dump_util.cpp; 48s local 2025-03-14T06:49:05.8748945Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T06:49:05.8749637Z Compiling torch_xla/csrc/tensor_methods.cpp; 40s local 2025-03-14T06:49:05.8750964Z Compiling torch_xla/csrc/torch_util.cpp; 37s local ... 2025-03-14T06:49:06.4714593Z 2025-03-14T06:49:06.4715535Z  2025-03-14T06:49:06.4716007Z  2025-03-14T06:49:06.4716439Z  2025-03-14T06:49:06.4717136Z  2025-03-14T06:49:06.4717535Z  2025-03-14T06:49:06.4717911Z  2025-03-14T06:49:06.4718290Z  2025-03-14T06:49:06.4718657Z  2025-03-14T06:49:06.4719675Z [20,477 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:06.4720866Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2025-03-14T06:49:06.4721611Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T06:49:06.4722345Z Compiling test/cpp/test_xla_sharding.cpp; 62s local 2025-03-14T06:49:06.4723102Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2025-03-14T06:49:06.4723857Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2025-03-14T06:49:06.4724762Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T06:49:06.4725476Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2025-03-14T06:49:06.4726209Z Compiling torch_xla/csrc/tensor_util.cpp; 38s local ... 2025-03-14T06:49:06.7451017Z 2025-03-14T06:49:06.7451968Z  2025-03-14T06:49:06.7452448Z  2025-03-14T06:49:06.7452872Z  2025-03-14T06:49:06.7453244Z  2025-03-14T06:49:06.7453622Z  2025-03-14T06:49:06.7454003Z  2025-03-14T06:49:06.7454391Z  2025-03-14T06:49:06.7454767Z  2025-03-14T06:49:06.7455687Z [20,478 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:06.7456656Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2025-03-14T06:49:06.7457460Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T06:49:06.7458220Z Compiling test/cpp/test_xla_sharding.cpp; 62s local 2025-03-14T06:49:06.7458964Z Compiling torch_xla/csrc/aten_xla_type.cpp; 60s local 2025-03-14T06:49:06.7459753Z Compiling torch_xla/csrc/ir_dump_util.cpp; 49s local 2025-03-14T06:49:06.7460479Z Compiling torch_xla/csrc/tensor.cpp; 42s local 2025-03-14T06:49:06.7461247Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2025-03-14T06:49:06.7462081Z Compiling torch_xla/csrc/tensor_util.cpp; 38s local ... 2025-03-14T06:49:07.0718639Z 2025-03-14T06:49:07.0719835Z  2025-03-14T06:49:07.0720239Z  2025-03-14T06:49:07.0720570Z  2025-03-14T06:49:07.0720909Z  2025-03-14T06:49:07.0721280Z  2025-03-14T06:49:07.0721656Z  2025-03-14T06:49:07.0722045Z  2025-03-14T06:49:07.0722461Z  2025-03-14T06:49:07.0723801Z [20,478 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:07.0725134Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2025-03-14T06:49:07.0725921Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T06:49:07.0726707Z Compiling test/cpp/test_xla_sharding.cpp; 63s local 2025-03-14T06:49:07.0727486Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2025-03-14T06:49:07.0728179Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2025-03-14T06:49:07.0728821Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2025-03-14T06:49:07.0729560Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2025-03-14T06:49:07.0730342Z Compiling torch_xla/csrc/tensor_util.cpp; 38s local ... 2025-03-14T06:49:07.3772728Z 2025-03-14T06:49:07.3773931Z  2025-03-14T06:49:07.3774404Z  2025-03-14T06:49:07.3774800Z  2025-03-14T06:49:07.3775204Z  2025-03-14T06:49:07.3775602Z  2025-03-14T06:49:07.3776003Z  2025-03-14T06:49:07.3776367Z  2025-03-14T06:49:07.3776732Z  2025-03-14T06:49:07.3777652Z [20,479 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:07.3778611Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2025-03-14T06:49:07.3779734Z Compiling torch_xla/csrc/aten_xla_type.cpp; 65s local 2025-03-14T06:49:07.3780478Z Compiling test/cpp/test_xla_sharding.cpp; 63s local 2025-03-14T06:49:07.3781168Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2025-03-14T06:49:07.3782088Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2025-03-14T06:49:07.3782797Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2025-03-14T06:49:07.3783567Z Compiling torch_xla/csrc/tensor_methods.cpp; 41s local 2025-03-14T06:49:07.3784394Z Compiling torch_xla/csrc/tensor_util.cpp; 38s local ... 2025-03-14T06:49:07.6725675Z 2025-03-14T06:49:07.6726568Z  2025-03-14T06:49:07.6727039Z  2025-03-14T06:49:07.6727383Z  2025-03-14T06:49:07.6727783Z  2025-03-14T06:49:07.6728138Z  2025-03-14T06:49:07.6728477Z  2025-03-14T06:49:07.6728850Z  2025-03-14T06:49:07.6729235Z  2025-03-14T06:49:07.6730160Z [20,479 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:07.6731082Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2025-03-14T06:49:07.6731748Z Compiling torch_xla/csrc/aten_xla_type.cpp; 65s local 2025-03-14T06:49:07.6732470Z Compiling test/cpp/test_xla_sharding.cpp; 63s local 2025-03-14T06:49:07.6733159Z Compiling torch_xla/csrc/aten_xla_type.cpp; 61s local 2025-03-14T06:49:07.6733875Z Compiling torch_xla/csrc/ir_dump_util.cpp; 50s local 2025-03-14T06:49:07.6734571Z Compiling torch_xla/csrc/tensor.cpp; 43s local 2025-03-14T06:49:07.6735313Z Compiling torch_xla/csrc/tensor_methods.cpp; 42s local 2025-03-14T06:49:07.6736111Z Compiling torch_xla/csrc/tensor_util.cpp; 39s local ... 2025-03-14T06:49:08.6732389Z 2025-03-14T06:49:08.6733679Z  2025-03-14T06:49:08.6734229Z  2025-03-14T06:49:08.6734655Z  2025-03-14T06:49:08.6735060Z  2025-03-14T06:49:08.6735447Z  2025-03-14T06:49:08.6735864Z  2025-03-14T06:49:08.6736254Z  2025-03-14T06:49:08.6736674Z  2025-03-14T06:49:08.6737646Z [20,479 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:08.6738684Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2025-03-14T06:49:08.6739476Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2025-03-14T06:49:08.6740274Z Compiling test/cpp/test_xla_sharding.cpp; 64s local 2025-03-14T06:49:08.6741029Z Compiling torch_xla/csrc/aten_xla_type.cpp; 62s local 2025-03-14T06:49:08.6741758Z Compiling torch_xla/csrc/ir_dump_util.cpp; 51s local 2025-03-14T06:49:08.6742479Z Compiling torch_xla/csrc/tensor.cpp; 44s local 2025-03-14T06:49:08.6743557Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local 2025-03-14T06:49:08.6744550Z Compiling torch_xla/csrc/tensor_util.cpp; 40s local ... 2025-03-14T06:49:09.2271741Z 2025-03-14T06:49:09.2272939Z  2025-03-14T06:49:09.2273467Z  2025-03-14T06:49:09.2273841Z  2025-03-14T06:49:09.2274224Z  2025-03-14T06:49:09.2274599Z  2025-03-14T06:49:09.2274987Z  2025-03-14T06:49:09.2275377Z  2025-03-14T06:49:09.2275746Z  2025-03-14T06:49:09.2276638Z [20,480 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:09.2277607Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2025-03-14T06:49:09.2278380Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2025-03-14T06:49:09.2279133Z Compiling test/cpp/test_xla_sharding.cpp; 65s local 2025-03-14T06:49:09.2279907Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2025-03-14T06:49:09.2280716Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2025-03-14T06:49:09.2281475Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2025-03-14T06:49:09.2282245Z Compiling torch_xla/csrc/tensor_methods.cpp; 43s local 2025-03-14T06:49:09.2283060Z Compiling torch_xla/csrc/tensor_util.cpp; 40s local ... 2025-03-14T06:49:09.4740246Z 2025-03-14T06:49:09.4741594Z  2025-03-14T06:49:09.4742017Z  2025-03-14T06:49:09.4742372Z  2025-03-14T06:49:09.4742724Z  2025-03-14T06:49:09.4743091Z  2025-03-14T06:49:09.4743438Z  2025-03-14T06:49:09.4743936Z  2025-03-14T06:49:09.4744288Z  2025-03-14T06:49:09.4745152Z [20,480 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:09.4746071Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2025-03-14T06:49:09.4746763Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2025-03-14T06:49:09.4747445Z Compiling test/cpp/test_xla_sharding.cpp; 65s local 2025-03-14T06:49:09.4748153Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2025-03-14T06:49:09.4748857Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2025-03-14T06:49:09.4749510Z Compiling torch_xla/csrc/tensor.cpp; 45s local 2025-03-14T06:49:09.4750184Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local 2025-03-14T06:49:09.4750935Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local ... 2025-03-14T06:49:09.8329962Z 2025-03-14T06:49:09.8331858Z  2025-03-14T06:49:09.8332344Z  2025-03-14T06:49:09.8332749Z  2025-03-14T06:49:09.8333095Z  2025-03-14T06:49:09.8333466Z  2025-03-14T06:49:09.8333826Z  2025-03-14T06:49:09.8334174Z  2025-03-14T06:49:09.8334512Z  2025-03-14T06:49:09.8335341Z [20,481 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:09.8336203Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2025-03-14T06:49:09.8336902Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2025-03-14T06:49:09.8337620Z Compiling torch_xla/csrc/aten_xla_type.cpp; 63s local 2025-03-14T06:49:09.8338321Z Compiling torch_xla/csrc/ir_dump_util.cpp; 52s local 2025-03-14T06:49:09.8338948Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T06:49:09.8339613Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local 2025-03-14T06:49:09.8340317Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local 2025-03-14T06:49:09.8341084Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 38s local ... 2025-03-14T06:49:10.0745926Z 2025-03-14T06:49:10.0746878Z  2025-03-14T06:49:10.0747362Z  2025-03-14T06:49:10.0747781Z  2025-03-14T06:49:10.0748164Z  2025-03-14T06:49:10.0748587Z  2025-03-14T06:49:10.0748963Z  2025-03-14T06:49:10.0749351Z  2025-03-14T06:49:10.0749732Z  2025-03-14T06:49:10.0750965Z [20,481 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:10.0751969Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2025-03-14T06:49:10.0752850Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2025-03-14T06:49:10.0753651Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T06:49:10.0754431Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2025-03-14T06:49:10.0755150Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T06:49:10.0755903Z Compiling torch_xla/csrc/tensor_methods.cpp; 44s local 2025-03-14T06:49:10.0756625Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local 2025-03-14T06:49:10.0757487Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local ... 2025-03-14T06:49:10.4365087Z 2025-03-14T06:49:10.4366182Z  2025-03-14T06:49:10.4366681Z  2025-03-14T06:49:10.4367062Z  2025-03-14T06:49:10.4367459Z  2025-03-14T06:49:10.4367846Z  2025-03-14T06:49:10.4368270Z  2025-03-14T06:49:10.4368661Z  2025-03-14T06:49:10.4369083Z  2025-03-14T06:49:10.4370008Z [20,482 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:10.4370984Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2025-03-14T06:49:10.4371736Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2025-03-14T06:49:10.4372814Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T06:49:10.4373568Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2025-03-14T06:49:10.4374319Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T06:49:10.4375350Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local 2025-03-14T06:49:10.4376115Z Compiling torch_xla/csrc/tensor_util.cpp; 41s local 2025-03-14T06:49:10.4377070Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local ... 2025-03-14T06:49:10.6779184Z 2025-03-14T06:49:10.6780022Z  2025-03-14T06:49:10.6780509Z  2025-03-14T06:49:10.6780906Z  2025-03-14T06:49:10.6781290Z  2025-03-14T06:49:10.6781704Z  2025-03-14T06:49:10.6782091Z  2025-03-14T06:49:10.6782478Z  2025-03-14T06:49:10.6782871Z  2025-03-14T06:49:10.6783800Z [20,482 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:10.6784785Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2025-03-14T06:49:10.6785579Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2025-03-14T06:49:10.6786351Z Compiling torch_xla/csrc/aten_xla_type.cpp; 64s local 2025-03-14T06:49:10.6787121Z Compiling torch_xla/csrc/ir_dump_util.cpp; 53s local 2025-03-14T06:49:10.6787837Z Compiling torch_xla/csrc/tensor.cpp; 46s local 2025-03-14T06:49:10.6788591Z Compiling torch_xla/csrc/tensor_methods.cpp; 45s local 2025-03-14T06:49:10.6789357Z Compiling torch_xla/csrc/tensor_util.cpp; 42s local 2025-03-14T06:49:10.6790184Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 39s local ... 2025-03-14T06:49:11.6786336Z 2025-03-14T06:49:11.6787222Z  2025-03-14T06:49:11.6787688Z  2025-03-14T06:49:11.6788080Z  2025-03-14T06:49:11.6788509Z  2025-03-14T06:49:11.6788911Z  2025-03-14T06:49:11.6789323Z  2025-03-14T06:49:11.6789663Z  2025-03-14T06:49:11.6790030Z  2025-03-14T06:49:11.6790970Z [20,483 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:11.6791987Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2025-03-14T06:49:11.6792667Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2025-03-14T06:49:11.6793397Z Compiling torch_xla/csrc/aten_xla_type.cpp; 65s local 2025-03-14T06:49:11.6794191Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2025-03-14T06:49:11.6794889Z Compiling torch_xla/csrc/tensor.cpp; 47s local 2025-03-14T06:49:11.6795692Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2025-03-14T06:49:11.6796444Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2025-03-14T06:49:11.6797500Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 40s local ... 2025-03-14T06:49:11.8789140Z 2025-03-14T06:49:11.8790172Z  2025-03-14T06:49:11.8790709Z  2025-03-14T06:49:11.8791127Z  2025-03-14T06:49:11.8791545Z  2025-03-14T06:49:11.8791913Z  2025-03-14T06:49:11.8792309Z  2025-03-14T06:49:11.8792687Z  2025-03-14T06:49:11.8793074Z  2025-03-14T06:49:11.8794005Z [20,483 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:11.8795018Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2025-03-14T06:49:11.8795802Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2025-03-14T06:49:11.8796637Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2025-03-14T06:49:11.8797419Z Compiling torch_xla/csrc/ir_dump_util.cpp; 54s local 2025-03-14T06:49:11.8798225Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2025-03-14T06:49:11.8799040Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2025-03-14T06:49:11.8799910Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2025-03-14T06:49:11.8800789Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 40s local ... 2025-03-14T06:49:12.1742178Z 2025-03-14T06:49:12.1743072Z  2025-03-14T06:49:12.1743562Z  2025-03-14T06:49:12.1744377Z  2025-03-14T06:49:12.1744768Z  2025-03-14T06:49:12.1745126Z  2025-03-14T06:49:12.1745510Z  2025-03-14T06:49:12.1745899Z  2025-03-14T06:49:12.1746277Z  2025-03-14T06:49:12.1747375Z [20,484 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:12.1748315Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2025-03-14T06:49:12.1749086Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T06:49:12.1749781Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2025-03-14T06:49:12.1750504Z Compiling torch_xla/csrc/ir_dump_util.cpp; 55s local 2025-03-14T06:49:12.1751230Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2025-03-14T06:49:12.1751966Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2025-03-14T06:49:12.1752712Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2025-03-14T06:49:12.1753506Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 41s local ... 2025-03-14T06:49:12.4012951Z 2025-03-14T06:49:12.4013821Z  2025-03-14T06:49:12.4014308Z  2025-03-14T06:49:12.4014722Z  2025-03-14T06:49:12.4015134Z  2025-03-14T06:49:12.4015594Z  2025-03-14T06:49:12.4016020Z  2025-03-14T06:49:12.4016429Z  2025-03-14T06:49:12.4016949Z  2025-03-14T06:49:12.4018073Z [20,485 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:12.4019043Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T06:49:12.4019824Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T06:49:12.4020682Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2025-03-14T06:49:12.4021518Z Compiling torch_xla/csrc/ir_dump_util.cpp; 55s local 2025-03-14T06:49:12.4022320Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2025-03-14T06:49:12.4023128Z Compiling torch_xla/csrc/tensor_methods.cpp; 46s local 2025-03-14T06:49:12.4023975Z Compiling torch_xla/csrc/tensor_util.cpp; 43s local 2025-03-14T06:49:12.4024896Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 41s local ... 2025-03-14T06:49:12.6794120Z 2025-03-14T06:49:12.6795099Z  2025-03-14T06:49:12.6795631Z  2025-03-14T06:49:12.6796078Z  2025-03-14T06:49:12.6796513Z  2025-03-14T06:49:12.6796951Z  2025-03-14T06:49:12.6797369Z  2025-03-14T06:49:12.6797814Z  2025-03-14T06:49:12.6798244Z  2025-03-14T06:49:12.6799267Z [20,485 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:12.6800646Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T06:49:12.6801547Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T06:49:12.6803073Z Compiling torch_xla/csrc/aten_xla_type.cpp; 66s local 2025-03-14T06:49:12.6804159Z Compiling torch_xla/csrc/ir_dump_util.cpp; 55s local 2025-03-14T06:49:12.6805263Z Compiling torch_xla/csrc/tensor.cpp; 48s local 2025-03-14T06:49:12.6806252Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2025-03-14T06:49:12.6807266Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2025-03-14T06:49:12.6808348Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 41s local ... 2025-03-14T06:49:13.0797946Z 2025-03-14T06:49:13.0798838Z  2025-03-14T06:49:13.0799308Z  2025-03-14T06:49:13.0799688Z  2025-03-14T06:49:13.0800054Z  2025-03-14T06:49:13.0800410Z  2025-03-14T06:49:13.0800800Z  2025-03-14T06:49:13.0801171Z  2025-03-14T06:49:13.0801548Z  2025-03-14T06:49:13.0802429Z [20,486 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:13.0803330Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T06:49:13.0804048Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T06:49:13.0804909Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2025-03-14T06:49:13.0805917Z Compiling torch_xla/csrc/ir_dump_util.cpp; 56s local 2025-03-14T06:49:13.0806600Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2025-03-14T06:49:13.0807317Z Compiling torch_xla/csrc/tensor_methods.cpp; 47s local 2025-03-14T06:49:13.0808153Z Compiling torch_xla/csrc/tensor_util.cpp; 44s local 2025-03-14T06:49:13.0808908Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local ... 2025-03-14T06:49:13.4801781Z 2025-03-14T06:49:13.4802692Z  2025-03-14T06:49:13.4803178Z  2025-03-14T06:49:13.4803598Z  2025-03-14T06:49:13.4804169Z  2025-03-14T06:49:13.4804786Z  2025-03-14T06:49:13.4805222Z  2025-03-14T06:49:13.4805637Z  2025-03-14T06:49:13.4806048Z  2025-03-14T06:49:13.4807033Z [20,487 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:13.4808270Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2025-03-14T06:49:13.4809047Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T06:49:13.4809893Z Compiling torch_xla/csrc/aten_xla_type.cpp; 67s local 2025-03-14T06:49:13.4810671Z Compiling torch_xla/csrc/ir_dump_util.cpp; 56s local 2025-03-14T06:49:13.4811482Z Compiling torch_xla/csrc/tensor.cpp; 49s local 2025-03-14T06:49:13.4812273Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2025-03-14T06:49:13.4813116Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local 2025-03-14T06:49:13.4813950Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local ... 2025-03-14T06:49:13.8807870Z 2025-03-14T06:49:13.8808903Z  2025-03-14T06:49:13.8809380Z  2025-03-14T06:49:13.8809815Z  2025-03-14T06:49:13.8810378Z  2025-03-14T06:49:13.8810760Z  2025-03-14T06:49:13.8811152Z  2025-03-14T06:49:13.8811542Z  2025-03-14T06:49:13.8811923Z  2025-03-14T06:49:13.8812820Z [20,488 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:13.8813790Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2025-03-14T06:49:13.8814548Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T06:49:13.8815304Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2025-03-14T06:49:13.8816268Z Compiling torch_xla/csrc/tensor.cpp; 50s local 2025-03-14T06:49:13.8817022Z Compiling torch_xla/csrc/tensor_methods.cpp; 48s local 2025-03-14T06:49:13.8817911Z Compiling torch_xla/csrc/tensor_util.cpp; 45s local 2025-03-14T06:49:13.8818863Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 42s local 2025-03-14T06:49:13.8820147Z Compiling torch_xla/csrc/xla_op_builder.cpp; 40s local ... 2025-03-14T06:49:14.6563296Z 2025-03-14T06:49:14.6564271Z  2025-03-14T06:49:14.8818852Z  2025-03-14T06:49:14.8819435Z  2025-03-14T06:49:14.8819861Z  2025-03-14T06:49:14.8820261Z  2025-03-14T06:49:14.8820654Z  2025-03-14T06:49:14.8821032Z  2025-03-14T06:49:14.8821438Z  2025-03-14T06:49:14.8822373Z [20,489 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:14.8823370Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2025-03-14T06:49:14.8824178Z Compiling torch_xla/csrc/aten_xla_type.cpp; 68s local 2025-03-14T06:49:14.8824910Z Compiling torch_xla/csrc/tensor.cpp; 50s local 2025-03-14T06:49:14.8825677Z Compiling torch_xla/csrc/tensor_methods.cpp; 49s local 2025-03-14T06:49:14.8826469Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2025-03-14T06:49:14.8827280Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local 2025-03-14T06:49:14.8828143Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2025-03-14T06:49:14.8829006Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 40s local ... 2025-03-14T06:49:14.8829552Z 2025-03-14T06:49:14.8829882Z  2025-03-14T06:49:14.8830264Z  2025-03-14T06:49:14.8830670Z  2025-03-14T06:49:14.8831332Z  2025-03-14T06:49:14.8831721Z  2025-03-14T06:49:14.8832111Z  2025-03-14T06:49:14.8832491Z  2025-03-14T06:49:14.8832911Z  2025-03-14T06:49:14.8833801Z [20,489 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:14.8835001Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2025-03-14T06:49:14.8835786Z Compiling torch_xla/csrc/aten_xla_type.cpp; 69s local 2025-03-14T06:49:14.8836543Z Compiling torch_xla/csrc/tensor.cpp; 51s local 2025-03-14T06:49:14.8837280Z Compiling torch_xla/csrc/tensor_methods.cpp; 49s local 2025-03-14T06:49:14.8838090Z Compiling torch_xla/csrc/tensor_util.cpp; 46s local 2025-03-14T06:49:14.8838926Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 43s local 2025-03-14T06:49:14.8839761Z Compiling torch_xla/csrc/xla_op_builder.cpp; 41s local 2025-03-14T06:49:14.8840617Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 40s local ... 2025-03-14T06:49:15.8824675Z 2025-03-14T06:49:15.8825528Z  2025-03-14T06:49:15.8825998Z  2025-03-14T06:49:15.8826320Z  2025-03-14T06:49:15.8826636Z  2025-03-14T06:49:15.8826980Z  2025-03-14T06:49:15.8827387Z  2025-03-14T06:49:15.8827752Z  2025-03-14T06:49:15.8828122Z  2025-03-14T06:49:15.8828997Z [20,489 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:15.8829910Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2025-03-14T06:49:15.8830615Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T06:49:15.8831325Z Compiling torch_xla/csrc/tensor.cpp; 52s local 2025-03-14T06:49:15.8832182Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2025-03-14T06:49:15.8832882Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2025-03-14T06:49:15.8833642Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 44s local 2025-03-14T06:49:15.8834430Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2025-03-14T06:49:15.8835266Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 41s local ... 2025-03-14T06:49:16.3317310Z 2025-03-14T06:49:16.3318175Z  2025-03-14T06:49:16.3318678Z  2025-03-14T06:49:16.3319094Z  2025-03-14T06:49:16.3319487Z  2025-03-14T06:49:16.3319887Z  2025-03-14T06:49:16.3320282Z  2025-03-14T06:49:16.3320642Z  2025-03-14T06:49:16.3321020Z  2025-03-14T06:49:16.3321876Z [20,490 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:16.3322833Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2025-03-14T06:49:16.3323909Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T06:49:16.3324940Z Compiling torch_xla/csrc/tensor.cpp; 52s local 2025-03-14T06:49:16.3325729Z Compiling torch_xla/csrc/tensor_methods.cpp; 50s local 2025-03-14T06:49:16.3326531Z Compiling torch_xla/csrc/tensor_util.cpp; 47s local 2025-03-14T06:49:16.3327355Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2025-03-14T06:49:16.3328159Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2025-03-14T06:49:16.3328995Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 42s local ... 2025-03-14T06:49:16.5815230Z 2025-03-14T06:49:16.5816084Z  2025-03-14T06:49:16.5816579Z  2025-03-14T06:49:16.5816998Z  2025-03-14T06:49:16.5817422Z  2025-03-14T06:49:16.5817832Z  2025-03-14T06:49:16.5818242Z  2025-03-14T06:49:16.5818663Z  2025-03-14T06:49:16.5819043Z  2025-03-14T06:49:16.5819985Z [20,491 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:16.5821071Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2025-03-14T06:49:16.5821875Z Compiling torch_xla/csrc/aten_xla_type.cpp; 70s local 2025-03-14T06:49:16.5822605Z Compiling torch_xla/csrc/tensor.cpp; 52s local 2025-03-14T06:49:16.5823570Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T06:49:16.5824605Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2025-03-14T06:49:16.5825313Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2025-03-14T06:49:16.5826334Z Compiling torch_xla/csrc/xla_op_builder.cpp; 42s local 2025-03-14T06:49:16.5827143Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 42s local ... 2025-03-14T06:49:16.8831071Z 2025-03-14T06:49:16.8831934Z  2025-03-14T06:49:16.8832396Z  2025-03-14T06:49:16.8832768Z  2025-03-14T06:49:16.8833145Z  2025-03-14T06:49:16.8833532Z  2025-03-14T06:49:16.8833950Z  2025-03-14T06:49:16.8834349Z  2025-03-14T06:49:16.8834748Z  2025-03-14T06:49:16.8835682Z [20,491 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:16.8836655Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2025-03-14T06:49:16.8837437Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T06:49:16.8838139Z Compiling torch_xla/csrc/tensor.cpp; 53s local 2025-03-14T06:49:16.8838858Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T06:49:16.8839636Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2025-03-14T06:49:16.8840377Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 45s local 2025-03-14T06:49:16.8841063Z Compiling torch_xla/csrc/xla_op_builder.cpp; 43s local 2025-03-14T06:49:16.8841779Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 42s local ... 2025-03-14T06:49:17.0834120Z 2025-03-14T06:49:17.0834958Z  2025-03-14T06:49:17.0835470Z  2025-03-14T06:49:17.0835877Z  2025-03-14T06:49:17.0836344Z  2025-03-14T06:49:17.0836766Z  2025-03-14T06:49:17.0837175Z  2025-03-14T06:49:17.0837594Z  2025-03-14T06:49:17.0837986Z  2025-03-14T06:49:17.0838955Z [20,492 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:17.0840026Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2025-03-14T06:49:17.0840827Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T06:49:17.0841604Z Compiling torch_xla/csrc/tensor.cpp; 53s local 2025-03-14T06:49:17.0842421Z Compiling torch_xla/csrc/tensor_methods.cpp; 51s local 2025-03-14T06:49:17.0843244Z Compiling torch_xla/csrc/tensor_util.cpp; 48s local 2025-03-14T06:49:17.0844091Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2025-03-14T06:49:17.0845160Z Compiling torch_xla/csrc/xla_op_builder.cpp; 43s local 2025-03-14T06:49:17.0846344Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 42s local ... 2025-03-14T06:49:17.4837927Z 2025-03-14T06:49:17.4838785Z  2025-03-14T06:49:17.4839254Z  2025-03-14T06:49:17.4839993Z  2025-03-14T06:49:17.4840373Z  2025-03-14T06:49:17.4840738Z  2025-03-14T06:49:17.4841102Z  2025-03-14T06:49:17.4841467Z  2025-03-14T06:49:17.4841849Z  2025-03-14T06:49:17.4842804Z [20,493 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:17.4843749Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2025-03-14T06:49:17.4844498Z Compiling torch_xla/csrc/aten_xla_type.cpp; 71s local 2025-03-14T06:49:17.4845377Z Compiling torch_xla/csrc/tensor.cpp; 53s local 2025-03-14T06:49:17.4846088Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2025-03-14T06:49:17.4846836Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2025-03-14T06:49:17.4847661Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2025-03-14T06:49:17.4848513Z Compiling torch_xla/csrc/xla_op_builder.cpp; 43s local 2025-03-14T06:49:17.4849332Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local ... 2025-03-14T06:49:17.9539371Z 2025-03-14T06:49:17.9540240Z  2025-03-14T06:49:17.9540734Z  2025-03-14T06:49:17.9541143Z  2025-03-14T06:49:17.9541530Z  2025-03-14T06:49:17.9542280Z  2025-03-14T06:49:17.9542673Z  2025-03-14T06:49:17.9543079Z  2025-03-14T06:49:17.9543491Z  2025-03-14T06:49:17.9544385Z [20,494 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:17.9545608Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2025-03-14T06:49:17.9546439Z Compiling torch_xla/csrc/aten_xla_type.cpp; 72s local 2025-03-14T06:49:17.9547146Z Compiling torch_xla/csrc/tensor.cpp; 54s local 2025-03-14T06:49:17.9547922Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2025-03-14T06:49:17.9548743Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2025-03-14T06:49:17.9549546Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 46s local 2025-03-14T06:49:17.9550336Z Compiling torch_xla/csrc/xla_op_builder.cpp; 44s local 2025-03-14T06:49:17.9551193Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local ... 2025-03-14T06:49:18.1694776Z 2025-03-14T06:49:18.1695598Z  2025-03-14T06:49:18.1695975Z  2025-03-14T06:49:18.1696288Z  2025-03-14T06:49:18.1696631Z  2025-03-14T06:49:18.1697006Z  2025-03-14T06:49:18.1697373Z  2025-03-14T06:49:18.1697737Z  2025-03-14T06:49:18.1698107Z  2025-03-14T06:49:18.1698986Z [20,496 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:18.1699930Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2025-03-14T06:49:18.1700598Z Compiling torch_xla/csrc/tensor.cpp; 54s local 2025-03-14T06:49:18.1701295Z Compiling torch_xla/csrc/tensor_methods.cpp; 52s local 2025-03-14T06:49:18.1702013Z Compiling torch_xla/csrc/tensor_util.cpp; 49s local 2025-03-14T06:49:18.1702736Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2025-03-14T06:49:18.1703477Z Compiling torch_xla/csrc/xla_op_builder.cpp; 44s local 2025-03-14T06:49:18.1704285Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 43s local 2025-03-14T06:49:18.1705225Z Compiling torch_xla/csrc/RegisterXLA.cpp; 39s local ... 2025-03-14T06:49:18.4846119Z 2025-03-14T06:49:18.4847022Z  2025-03-14T06:49:18.4847489Z  2025-03-14T06:49:18.4847917Z  2025-03-14T06:49:18.4848261Z  2025-03-14T06:49:18.4848656Z  2025-03-14T06:49:18.4849035Z  2025-03-14T06:49:18.4849475Z  2025-03-14T06:49:18.4850019Z  2025-03-14T06:49:18.4850894Z [20,496 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:18.4851857Z Compiling torch_xla/csrc/tensor_util.cpp; 92s local 2025-03-14T06:49:18.4852870Z Compiling torch_xla/csrc/tensor.cpp; 54s local 2025-03-14T06:49:18.4853750Z Compiling torch_xla/csrc/tensor_methods.cpp; 53s local 2025-03-14T06:49:18.4854493Z Compiling torch_xla/csrc/tensor_util.cpp; 50s local 2025-03-14T06:49:18.4855205Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 47s local 2025-03-14T06:49:18.4856011Z Compiling torch_xla/csrc/xla_op_builder.cpp; 44s local 2025-03-14T06:49:18.4856770Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 44s local 2025-03-14T06:49:18.4857593Z Compiling torch_xla/csrc/RegisterXLA.cpp; 40s local ... 2025-03-14T06:49:19.4853634Z 2025-03-14T06:49:19.4854490Z  2025-03-14T06:49:19.4854967Z  2025-03-14T06:49:19.4855330Z  2025-03-14T06:49:19.4855687Z  2025-03-14T06:49:19.4856057Z  2025-03-14T06:49:19.4856437Z  2025-03-14T06:49:19.4856828Z  2025-03-14T06:49:19.4857228Z  2025-03-14T06:49:19.4858178Z [20,496 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:19.4859163Z Compiling torch_xla/csrc/tensor_util.cpp; 93s local 2025-03-14T06:49:19.4859869Z Compiling torch_xla/csrc/tensor.cpp; 55s local 2025-03-14T06:49:19.4860567Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2025-03-14T06:49:19.4861279Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2025-03-14T06:49:19.4862325Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 48s local 2025-03-14T06:49:19.4863137Z Compiling torch_xla/csrc/xla_op_builder.cpp; 45s local 2025-03-14T06:49:19.4864115Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 45s local 2025-03-14T06:49:19.4864958Z Compiling torch_xla/csrc/RegisterXLA.cpp; 41s local ... 2025-03-14T06:49:20.3681821Z 2025-03-14T06:49:20.3682679Z  2025-03-14T06:49:20.3683138Z  2025-03-14T06:49:20.3683547Z  2025-03-14T06:49:20.3683970Z  2025-03-14T06:49:20.3684387Z  2025-03-14T06:49:20.3686946Z  2025-03-14T06:49:20.3687347Z  2025-03-14T06:49:20.3687784Z  2025-03-14T06:49:20.3688749Z [20,497 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:20.3689692Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2025-03-14T06:49:20.3690368Z Compiling torch_xla/csrc/tensor.cpp; 56s local 2025-03-14T06:49:20.3691138Z Compiling torch_xla/csrc/tensor_methods.cpp; 54s local 2025-03-14T06:49:20.3691878Z Compiling torch_xla/csrc/tensor_util.cpp; 51s local 2025-03-14T06:49:20.3692661Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2025-03-14T06:49:20.3693460Z Compiling torch_xla/csrc/xla_op_builder.cpp; 46s local 2025-03-14T06:49:20.3694229Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2025-03-14T06:49:20.3695015Z Compiling torch_xla/csrc/RegisterXLA.cpp; 42s local ... 2025-03-14T06:49:20.6862058Z 2025-03-14T06:49:20.6862962Z  2025-03-14T06:49:20.6863465Z  2025-03-14T06:49:20.6863847Z  2025-03-14T06:49:20.6864387Z  2025-03-14T06:49:20.6864737Z  2025-03-14T06:49:20.6865109Z  2025-03-14T06:49:20.6865745Z  2025-03-14T06:49:20.6866163Z  2025-03-14T06:49:20.6867068Z [20,498 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:20.6868073Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2025-03-14T06:49:20.6868811Z Compiling torch_xla/csrc/tensor.cpp; 56s local 2025-03-14T06:49:20.6869563Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2025-03-14T06:49:20.6870332Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2025-03-14T06:49:20.6871104Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 49s local 2025-03-14T06:49:20.6871910Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2025-03-14T06:49:20.6872753Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 46s local 2025-03-14T06:49:20.6873589Z Compiling torch_xla/csrc/RegisterXLA.cpp; 42s local ... 2025-03-14T06:49:21.2867433Z 2025-03-14T06:49:21.2868564Z  2025-03-14T06:49:21.2869083Z  2025-03-14T06:49:21.2869475Z  2025-03-14T06:49:21.2869972Z  2025-03-14T06:49:21.2870342Z  2025-03-14T06:49:21.2870730Z  2025-03-14T06:49:21.2871105Z  2025-03-14T06:49:21.2871529Z  2025-03-14T06:49:21.2872480Z [20,499 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:21.2873469Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2025-03-14T06:49:21.2874209Z Compiling torch_xla/csrc/tensor.cpp; 57s local 2025-03-14T06:49:21.2875030Z Compiling torch_xla/csrc/tensor_methods.cpp; 55s local 2025-03-14T06:49:21.2875833Z Compiling torch_xla/csrc/tensor_util.cpp; 52s local 2025-03-14T06:49:21.2876653Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2025-03-14T06:49:21.2877549Z Compiling torch_xla/csrc/xla_op_builder.cpp; 47s local 2025-03-14T06:49:21.2878353Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2025-03-14T06:49:21.2879179Z Compiling torch_xla/csrc/RegisterXLA.cpp; 42s local ... 2025-03-14T06:49:21.6871228Z 2025-03-14T06:49:21.6872070Z  2025-03-14T06:49:21.6872556Z  2025-03-14T06:49:21.6872928Z  2025-03-14T06:49:21.6873294Z  2025-03-14T06:49:21.6873713Z  2025-03-14T06:49:21.6874413Z  2025-03-14T06:49:21.6874781Z  2025-03-14T06:49:21.6875191Z  2025-03-14T06:49:21.6876109Z [20,499 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:21.6877262Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2025-03-14T06:49:21.6878011Z Compiling torch_xla/csrc/tensor.cpp; 57s local 2025-03-14T06:49:21.6878768Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T06:49:21.6879518Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T06:49:21.6880307Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 50s local 2025-03-14T06:49:21.6881184Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2025-03-14T06:49:21.6882019Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2025-03-14T06:49:21.6882822Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local ... 2025-03-14T06:49:22.1498489Z 2025-03-14T06:49:22.1499358Z  2025-03-14T06:49:22.1499800Z  2025-03-14T06:49:22.1500161Z  2025-03-14T06:49:22.1500496Z  2025-03-14T06:49:22.1500851Z  2025-03-14T06:49:22.1501184Z  2025-03-14T06:49:22.1501505Z  2025-03-14T06:49:22.1501862Z  2025-03-14T06:49:22.1502643Z [20,502 / 20,653] 6 / 17 tests; 45 actions running; last test: ..._client_test 2025-03-14T06:49:22.1503481Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2025-03-14T06:49:22.1504151Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T06:49:22.1504834Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T06:49:22.1505512Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2025-03-14T06:49:22.1506240Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2025-03-14T06:49:22.1506952Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 47s local 2025-03-14T06:49:22.1507634Z Compiling torch_xla/csrc/RegisterXLA.cpp; 43s local 2025-03-14T06:49:22.1508415Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 37s local ... 2025-03-14T06:49:22.3502121Z 2025-03-14T06:49:22.3502909Z  2025-03-14T06:49:22.3503344Z  2025-03-14T06:49:22.3503692Z  2025-03-14T06:49:22.3504084Z  2025-03-14T06:49:22.3504430Z  2025-03-14T06:49:22.3504782Z  2025-03-14T06:49:22.3505135Z  2025-03-14T06:49:22.3505456Z  2025-03-14T06:49:22.3506317Z [20,502 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:22.3507165Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2025-03-14T06:49:22.3508079Z Compiling torch_xla/csrc/tensor_methods.cpp; 56s local 2025-03-14T06:49:22.3508780Z Compiling torch_xla/csrc/tensor_util.cpp; 53s local 2025-03-14T06:49:22.3509607Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2025-03-14T06:49:22.3510336Z Compiling torch_xla/csrc/xla_op_builder.cpp; 48s local 2025-03-14T06:49:22.3511077Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local 2025-03-14T06:49:22.3511749Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2025-03-14T06:49:22.3512510Z Compiling torch_xla/csrc/ops/as_strided_view_update.cpp; 38s local ... 2025-03-14T06:49:22.9134714Z 2025-03-14T06:49:22.9135555Z  2025-03-14T06:49:22.9136180Z  2025-03-14T06:49:22.9136573Z  2025-03-14T06:49:22.9136990Z  2025-03-14T06:49:22.9137410Z  2025-03-14T06:49:22.9137807Z  2025-03-14T06:49:22.9138200Z  2025-03-14T06:49:22.9138596Z  2025-03-14T06:49:22.9139588Z [20,503 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:22.9140597Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2025-03-14T06:49:22.9141403Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2025-03-14T06:49:22.9142217Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T06:49:22.9143059Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 51s local 2025-03-14T06:49:22.9144223Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2025-03-14T06:49:22.9145083Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local 2025-03-14T06:49:22.9146214Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2025-03-14T06:49:22.9146997Z Compiling torch_xla/csrc/ops/cast.cpp; 33s local ... 2025-03-14T06:49:23.1508284Z 2025-03-14T06:49:23.1509109Z  2025-03-14T06:49:23.1509594Z  2025-03-14T06:49:23.1510022Z  2025-03-14T06:49:23.1510420Z  2025-03-14T06:49:23.1510813Z  2025-03-14T06:49:23.1511204Z  2025-03-14T06:49:23.1511586Z  2025-03-14T06:49:23.1512013Z  2025-03-14T06:49:23.1512954Z [20,504 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:23.1513918Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2025-03-14T06:49:23.1514747Z Compiling torch_xla/csrc/tensor_methods.cpp; 57s local 2025-03-14T06:49:23.1515532Z Compiling torch_xla/csrc/tensor_util.cpp; 54s local 2025-03-14T06:49:23.1516314Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2025-03-14T06:49:23.1517099Z Compiling torch_xla/csrc/xla_op_builder.cpp; 49s local 2025-03-14T06:49:23.1517957Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 48s local 2025-03-14T06:49:23.1518764Z Compiling torch_xla/csrc/RegisterXLA.cpp; 44s local 2025-03-14T06:49:23.1519523Z Compiling torch_xla/csrc/ops/cast.cpp; 33s local ... 2025-03-14T06:49:23.8464111Z 2025-03-14T06:49:23.8464985Z  2025-03-14T06:49:23.8465789Z  2025-03-14T06:49:23.8466186Z  2025-03-14T06:49:23.8466600Z  2025-03-14T06:49:23.8467002Z  2025-03-14T06:49:23.8467389Z  2025-03-14T06:49:23.8467790Z  2025-03-14T06:49:23.8468197Z  2025-03-14T06:49:23.8469234Z [20,505 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:23.8470231Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T06:49:23.8471046Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2025-03-14T06:49:23.8471902Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2025-03-14T06:49:23.8472780Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 52s local 2025-03-14T06:49:23.8473619Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2025-03-14T06:49:23.8474405Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 49s local 2025-03-14T06:49:23.8475262Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2025-03-14T06:49:23.8476072Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local ... 2025-03-14T06:49:24.1145483Z 2025-03-14T06:49:24.1146372Z  2025-03-14T06:49:24.1146849Z  2025-03-14T06:49:24.1147265Z  2025-03-14T06:49:24.1147790Z  2025-03-14T06:49:24.1148155Z  2025-03-14T06:49:24.1148548Z  2025-03-14T06:49:24.1148911Z  2025-03-14T06:49:24.1149289Z  2025-03-14T06:49:24.1150170Z [20,506 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:24.1151113Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T06:49:24.1151872Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2025-03-14T06:49:24.1152643Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2025-03-14T06:49:24.1153400Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2025-03-14T06:49:24.1154229Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2025-03-14T06:49:24.1155035Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 49s local 2025-03-14T06:49:24.1155861Z Compiling torch_xla/csrc/RegisterXLA.cpp; 45s local 2025-03-14T06:49:24.1156622Z Compiling torch_xla/csrc/ops/cast.cpp; 34s local ... 2025-03-14T06:49:24.3516711Z 2025-03-14T06:49:24.3517518Z  2025-03-14T06:49:24.3518012Z  2025-03-14T06:49:24.3518424Z  2025-03-14T06:49:24.3518853Z  2025-03-14T06:49:24.3519510Z  2025-03-14T06:49:24.3519925Z  2025-03-14T06:49:24.3520448Z  2025-03-14T06:49:24.3520871Z  2025-03-14T06:49:24.3521874Z [20,506 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:24.3523100Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T06:49:24.3523950Z Compiling torch_xla/csrc/tensor_methods.cpp; 58s local 2025-03-14T06:49:24.3525000Z Compiling torch_xla/csrc/tensor_util.cpp; 55s local 2025-03-14T06:49:24.3525770Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2025-03-14T06:49:24.3526658Z Compiling torch_xla/csrc/xla_op_builder.cpp; 50s local 2025-03-14T06:49:24.3527593Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2025-03-14T06:49:24.3528470Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2025-03-14T06:49:24.3529229Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local ... 2025-03-14T06:49:24.5952693Z 2025-03-14T06:49:24.5953539Z  2025-03-14T06:49:24.5954066Z  2025-03-14T06:49:24.5954468Z  2025-03-14T06:49:24.5954870Z  2025-03-14T06:49:24.5955255Z  2025-03-14T06:49:24.5955619Z  2025-03-14T06:49:24.5955986Z  2025-03-14T06:49:24.5956344Z  2025-03-14T06:49:24.5957344Z [20,508 / 20,653] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2025-03-14T06:49:24.5958359Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T06:49:24.5959201Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T06:49:24.5960069Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T06:49:24.5960972Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2025-03-14T06:49:24.5961935Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2025-03-14T06:49:24.5962814Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2025-03-14T06:49:24.5963610Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local 2025-03-14T06:49:24.5964718Z Compiling torch_xla/csrc/ops/convolution_overrideable.cpp; 32s local ... 2025-03-14T06:49:24.9432783Z 2025-03-14T06:49:24.9433605Z  2025-03-14T06:49:24.9434092Z  2025-03-14T06:49:24.9434494Z  2025-03-14T06:49:24.9434979Z  2025-03-14T06:49:24.9435445Z  2025-03-14T06:49:24.9435906Z  2025-03-14T06:49:24.9436388Z  2025-03-14T06:49:24.9436814Z  2025-03-14T06:49:24.9437776Z [20,509 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:24.9438736Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T06:49:24.9439862Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T06:49:24.9440798Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T06:49:24.9441646Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 53s local 2025-03-14T06:49:24.9442533Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2025-03-14T06:49:24.9443398Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2025-03-14T06:49:24.9444235Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local 2025-03-14T06:49:24.9445256Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local ... 2025-03-14T06:49:25.1523027Z 2025-03-14T06:49:25.1523882Z  2025-03-14T06:49:25.1524373Z  2025-03-14T06:49:25.1524951Z  2025-03-14T06:49:25.1525346Z  2025-03-14T06:49:25.1525742Z  2025-03-14T06:49:25.1526148Z  2025-03-14T06:49:25.1526546Z  2025-03-14T06:49:25.1526914Z  2025-03-14T06:49:25.1527931Z [20,509 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:25.1528979Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T06:49:25.1529750Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T06:49:25.1530464Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T06:49:25.1531198Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T06:49:25.1532419Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 50s local 2025-03-14T06:49:25.1533216Z Compiling torch_xla/csrc/RegisterXLA.cpp; 46s local 2025-03-14T06:49:25.1534052Z Compiling torch_xla/csrc/ops/cast.cpp; 35s local 2025-03-14T06:49:25.1534909Z Compiling torch_xla/csrc/ops/constant.cpp; 32s local ... 2025-03-14T06:49:25.3826883Z 2025-03-14T06:49:25.3827794Z  2025-03-14T06:49:25.3828266Z  2025-03-14T06:49:25.3828652Z  2025-03-14T06:49:25.3829087Z  2025-03-14T06:49:25.3829508Z  2025-03-14T06:49:25.3829946Z  2025-03-14T06:49:25.3830351Z  2025-03-14T06:49:25.3830795Z  2025-03-14T06:49:25.3831762Z [20,510 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:25.3832843Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2025-03-14T06:49:25.3833784Z Compiling torch_xla/csrc/tensor_methods.cpp; 59s local 2025-03-14T06:49:25.3834625Z Compiling torch_xla/csrc/tensor_util.cpp; 56s local 2025-03-14T06:49:25.3835432Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T06:49:25.3836318Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local 2025-03-14T06:49:25.3837155Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local 2025-03-14T06:49:25.3837942Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2025-03-14T06:49:25.3838729Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local ... 2025-03-14T06:49:25.7527924Z 2025-03-14T06:49:25.7528795Z  2025-03-14T06:49:25.7529340Z  2025-03-14T06:49:25.7529819Z  2025-03-14T06:49:25.7530257Z  2025-03-14T06:49:25.7530749Z  2025-03-14T06:49:25.7531156Z  2025-03-14T06:49:25.7531552Z  2025-03-14T06:49:25.7531961Z  2025-03-14T06:49:25.7532927Z [20,510 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:25.7533920Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2025-03-14T06:49:25.7534763Z Compiling torch_xla/csrc/tensor_methods.cpp; 60s local 2025-03-14T06:49:25.7535569Z Compiling torch_xla/csrc/tensor_util.cpp; 57s local 2025-03-14T06:49:25.7536466Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 54s local 2025-03-14T06:49:25.7537437Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 51s local 2025-03-14T06:49:25.7538358Z Compiling torch_xla/csrc/RegisterXLA.cpp; 47s local 2025-03-14T06:49:25.7539168Z Compiling torch_xla/csrc/ops/cast.cpp; 36s local 2025-03-14T06:49:25.7539994Z Compiling torch_xla/csrc/ops/constant.cpp; 33s local ... 2025-03-14T06:49:26.7535544Z 2025-03-14T06:49:26.7536700Z  2025-03-14T06:49:26.7537225Z  2025-03-14T06:49:26.7537649Z  2025-03-14T06:49:26.7538169Z  2025-03-14T06:49:26.7538552Z  2025-03-14T06:49:26.7538963Z  2025-03-14T06:49:26.7539344Z  2025-03-14T06:49:26.7539731Z  2025-03-14T06:49:26.7540700Z [20,510 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:26.7541724Z Compiling torch_xla/csrc/tensor_util.cpp; 100s local 2025-03-14T06:49:26.7542489Z Compiling torch_xla/csrc/tensor_methods.cpp; 61s local 2025-03-14T06:49:26.7543276Z Compiling torch_xla/csrc/tensor_util.cpp; 58s local 2025-03-14T06:49:26.7544086Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 55s local 2025-03-14T06:49:26.7545010Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 52s local 2025-03-14T06:49:26.7545896Z Compiling torch_xla/csrc/RegisterXLA.cpp; 48s local 2025-03-14T06:49:26.7546725Z Compiling torch_xla/csrc/ops/cast.cpp; 37s local 2025-03-14T06:49:26.7547558Z Compiling torch_xla/csrc/ops/constant.cpp; 34s local ... 2025-03-14T06:49:27.5228277Z 2025-03-14T06:49:27.5229248Z  2025-03-14T06:49:27.5229742Z  2025-03-14T06:49:27.5230128Z  2025-03-14T06:49:27.5230518Z  2025-03-14T06:49:27.5230913Z  2025-03-14T06:49:27.5231591Z  2025-03-14T06:49:27.5231983Z  2025-03-14T06:49:27.5232378Z  2025-03-14T06:49:27.5233304Z [20,512 / 20,653] 6 / 17 tests; 48 actions, 46 running; last test: ...ent_test 2025-03-14T06:49:27.5234575Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2025-03-14T06:49:27.5235397Z Compiling torch_xla/csrc/tensor_methods.cpp; 62s local 2025-03-14T06:49:27.5236199Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2025-03-14T06:49:27.5236992Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2025-03-14T06:49:27.5237843Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2025-03-14T06:49:27.5238723Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2025-03-14T06:49:27.5239492Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2025-03-14T06:49:27.5240309Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local ... 2025-03-14T06:49:27.7542219Z 2025-03-14T06:49:27.7543077Z  2025-03-14T06:49:27.7543609Z  2025-03-14T06:49:27.7543997Z  2025-03-14T06:49:27.7544376Z  2025-03-14T06:49:27.7544723Z  2025-03-14T06:49:27.7545105Z  2025-03-14T06:49:27.7545465Z  2025-03-14T06:49:27.7545858Z  2025-03-14T06:49:27.7546884Z [20,513 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:27.7547872Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2025-03-14T06:49:27.7548611Z Compiling torch_xla/csrc/tensor_util.cpp; 59s local 2025-03-14T06:49:27.7549400Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 56s local 2025-03-14T06:49:27.7550337Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 53s local 2025-03-14T06:49:27.7551207Z Compiling torch_xla/csrc/RegisterXLA.cpp; 49s local 2025-03-14T06:49:27.7551984Z Compiling torch_xla/csrc/ops/constant.cpp; 35s local 2025-03-14T06:49:27.7552796Z Compiling torch_xla/csrc/ops/cumsum.cpp; 34s local 2025-03-14T06:49:27.7553586Z Compiling torch_xla/csrc/ops/cumprod.cpp; 34s local ... 2025-03-14T06:49:28.9551492Z 2025-03-14T06:49:28.9552365Z  2025-03-14T06:49:28.9552816Z  2025-03-14T06:49:28.9553186Z  2025-03-14T06:49:28.9553586Z  2025-03-14T06:49:28.9553957Z  2025-03-14T06:49:28.9554318Z  2025-03-14T06:49:28.9554675Z  2025-03-14T06:49:28.9555033Z  2025-03-14T06:49:28.9555907Z [20,513 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:28.9556815Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2025-03-14T06:49:28.9557854Z Compiling torch_xla/csrc/tensor_util.cpp; 60s local 2025-03-14T06:49:28.9558614Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T06:49:28.9559550Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 54s local 2025-03-14T06:49:28.9560299Z Compiling torch_xla/csrc/RegisterXLA.cpp; 50s local 2025-03-14T06:49:28.9561005Z Compiling torch_xla/csrc/ops/constant.cpp; 36s local 2025-03-14T06:49:28.9561729Z Compiling torch_xla/csrc/ops/cumsum.cpp; 35s local 2025-03-14T06:49:28.9562445Z Compiling torch_xla/csrc/ops/cumprod.cpp; 35s local ... 2025-03-14T06:49:29.9520999Z 2025-03-14T06:49:29.9521825Z  2025-03-14T06:49:29.9522338Z  2025-03-14T06:49:29.9522749Z  2025-03-14T06:49:29.9523162Z  2025-03-14T06:49:29.9523570Z  2025-03-14T06:49:29.9523985Z  2025-03-14T06:49:29.9524397Z  2025-03-14T06:49:29.9524959Z  2025-03-14T06:49:29.9525883Z [20,514 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:29.9526919Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2025-03-14T06:49:29.9527748Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2025-03-14T06:49:29.9528618Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 58s local 2025-03-14T06:49:29.9529517Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T06:49:29.9530750Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2025-03-14T06:49:29.9531570Z Compiling torch_xla/csrc/ops/constant.cpp; 37s local 2025-03-14T06:49:29.9532424Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2025-03-14T06:49:29.9533361Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local ... 2025-03-14T06:49:30.1559751Z 2025-03-14T06:49:30.1560614Z  2025-03-14T06:49:30.1561070Z  2025-03-14T06:49:30.1561491Z  2025-03-14T06:49:30.1561918Z  2025-03-14T06:49:30.1562329Z  2025-03-14T06:49:30.1562756Z  2025-03-14T06:49:30.1563175Z  2025-03-14T06:49:30.1563595Z  2025-03-14T06:49:30.1564712Z [20,514 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:30.1565953Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2025-03-14T06:49:30.1566746Z Compiling torch_xla/csrc/tensor_util.cpp; 61s local 2025-03-14T06:49:30.1567450Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 59s local 2025-03-14T06:49:30.1568261Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 55s local 2025-03-14T06:49:30.1569046Z Compiling torch_xla/csrc/RegisterXLA.cpp; 51s local 2025-03-14T06:49:30.1569864Z Compiling torch_xla/csrc/ops/constant.cpp; 37s local 2025-03-14T06:49:30.1570676Z Compiling torch_xla/csrc/ops/cumsum.cpp; 36s local 2025-03-14T06:49:30.1571490Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local ... 2025-03-14T06:49:30.7204071Z 2025-03-14T06:49:30.7205096Z  2025-03-14T06:49:30.7205572Z  2025-03-14T06:49:30.7205970Z  2025-03-14T06:49:30.7206383Z  2025-03-14T06:49:30.7206808Z  2025-03-14T06:49:30.7207165Z  2025-03-14T06:49:30.7207523Z  2025-03-14T06:49:30.7207897Z  2025-03-14T06:49:30.7208827Z [20,515 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:30.7209857Z Compiling torch_xla/csrc/tensor_util.cpp; 104s local 2025-03-14T06:49:30.7210670Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T06:49:30.7211510Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 59s local 2025-03-14T06:49:30.7212352Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2025-03-14T06:49:30.7213243Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T06:49:30.7214062Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2025-03-14T06:49:30.7214850Z Compiling torch_xla/csrc/ops/cumprod.cpp; 36s local 2025-03-14T06:49:30.7215709Z Compiling torch_xla/csrc/ops/update_slice.cpp; 33s local ... 2025-03-14T06:49:30.9567173Z 2025-03-14T06:49:30.9567976Z  2025-03-14T06:49:30.9568765Z  2025-03-14T06:49:30.9569181Z  2025-03-14T06:49:30.9569581Z  2025-03-14T06:49:30.9570085Z  2025-03-14T06:49:30.9570517Z  2025-03-14T06:49:30.9570932Z  2025-03-14T06:49:30.9571356Z  2025-03-14T06:49:30.9572350Z [20,515 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:30.9573373Z Compiling torch_xla/csrc/tensor_util.cpp; 104s local 2025-03-14T06:49:30.9574161Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T06:49:30.9575023Z Compiling torch_xla/csrc/xla_graph_executor.cpp; 60s local 2025-03-14T06:49:30.9575937Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 56s local 2025-03-14T06:49:30.9576771Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T06:49:30.9577513Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2025-03-14T06:49:30.9578341Z Compiling torch_xla/csrc/ops/cumprod.cpp; 37s local 2025-03-14T06:49:30.9579216Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local ... 2025-03-14T06:49:31.3203334Z 2025-03-14T06:49:31.3204207Z  2025-03-14T06:49:31.3204867Z  2025-03-14T06:49:31.3205272Z  2025-03-14T06:49:31.3205665Z  2025-03-14T06:49:31.3206090Z  2025-03-14T06:49:31.3206500Z  2025-03-14T06:49:31.3207232Z  2025-03-14T06:49:31.3207650Z  2025-03-14T06:49:31.3208601Z [20,517 / 20,653] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2025-03-14T06:49:31.3209754Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T06:49:31.3210596Z Compiling torch_xla/csrc/tensor_util.cpp; 62s local 2025-03-14T06:49:31.3211483Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2025-03-14T06:49:31.3212335Z Compiling torch_xla/csrc/RegisterXLA.cpp; 52s local 2025-03-14T06:49:31.3213169Z Compiling torch_xla/csrc/ops/cumsum.cpp; 37s local 2025-03-14T06:49:31.3214024Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2025-03-14T06:49:31.3214950Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 29s local 2025-03-14T06:49:31.3215938Z Compiling torch_xla/csrc/ops/device_data.cpp; 24s local ... 2025-03-14T06:49:31.5571741Z 2025-03-14T06:49:31.5572565Z  2025-03-14T06:49:31.5573099Z  2025-03-14T06:49:31.5573537Z  2025-03-14T06:49:31.5573968Z  2025-03-14T06:49:31.5574386Z  2025-03-14T06:49:31.5574783Z  2025-03-14T06:49:31.5575185Z  2025-03-14T06:49:31.5575595Z  2025-03-14T06:49:31.5576585Z [20,518 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:31.5577621Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T06:49:31.5578460Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2025-03-14T06:49:31.5579289Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2025-03-14T06:49:31.5580176Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2025-03-14T06:49:31.5580953Z Compiling torch_xla/csrc/ops/cumsum.cpp; 38s local 2025-03-14T06:49:31.5581824Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2025-03-14T06:49:31.5582840Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T06:49:31.5583782Z Compiling torch_xla/csrc/ops/device_data.cpp; 25s local ... 2025-03-14T06:49:31.7575173Z 2025-03-14T06:49:31.7576024Z  2025-03-14T06:49:31.7576493Z  2025-03-14T06:49:31.7576893Z  2025-03-14T06:49:31.7577352Z  2025-03-14T06:49:31.7577756Z  2025-03-14T06:49:31.7578171Z  2025-03-14T06:49:31.7578568Z  2025-03-14T06:49:31.7578995Z  2025-03-14T06:49:31.7579971Z [20,518 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:31.7581031Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T06:49:31.7582201Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2025-03-14T06:49:31.7582986Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2025-03-14T06:49:31.7583978Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2025-03-14T06:49:31.7584784Z Compiling torch_xla/csrc/ops/cumsum.cpp; 38s local 2025-03-14T06:49:31.7585580Z Compiling torch_xla/csrc/ops/update_slice.cpp; 34s local 2025-03-14T06:49:31.7586533Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T06:49:31.7587481Z Compiling torch_xla/csrc/ops/device_data.cpp; 25s local ... 2025-03-14T06:49:32.0175460Z 2025-03-14T06:49:32.0176325Z  2025-03-14T06:49:32.0176810Z  2025-03-14T06:49:32.0177246Z  2025-03-14T06:49:32.0177673Z  2025-03-14T06:49:32.0178117Z  2025-03-14T06:49:32.0178525Z  2025-03-14T06:49:32.0178927Z  2025-03-14T06:49:32.0179318Z  2025-03-14T06:49:32.0180264Z [20,519 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:32.0181357Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T06:49:32.0182190Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2025-03-14T06:49:32.0183042Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 57s local 2025-03-14T06:49:32.0183797Z Compiling torch_xla/csrc/RegisterXLA.cpp; 53s local 2025-03-14T06:49:32.0184939Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2025-03-14T06:49:32.0185909Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T06:49:32.0186859Z Compiling torch_xla/csrc/ops/device_data.cpp; 25s local 2025-03-14T06:49:32.0187943Z Compiling torch_xla/csrc/ops/dot_general.cpp; 25s local ... 2025-03-14T06:49:32.3597325Z 2025-03-14T06:49:32.3598127Z  2025-03-14T06:49:32.3598633Z  2025-03-14T06:49:32.3599054Z  2025-03-14T06:49:32.3599455Z  2025-03-14T06:49:32.3599836Z  2025-03-14T06:49:32.3600226Z  2025-03-14T06:49:32.3600628Z  2025-03-14T06:49:32.3601026Z  2025-03-14T06:49:32.3601986Z [20,519 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:32.3603036Z Compiling torch_xla/csrc/tensor_util.cpp; 106s local 2025-03-14T06:49:32.3603866Z Compiling torch_xla/csrc/tensor_util.cpp; 63s local 2025-03-14T06:49:32.3604923Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 58s local 2025-03-14T06:49:32.3605773Z Compiling torch_xla/csrc/RegisterXLA.cpp; 54s local 2025-03-14T06:49:32.3606658Z Compiling torch_xla/csrc/ops/update_slice.cpp; 35s local 2025-03-14T06:49:32.3607600Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 30s local 2025-03-14T06:49:32.3608537Z Compiling torch_xla/csrc/ops/device_data.cpp; 25s local 2025-03-14T06:49:32.3609460Z Compiling torch_xla/csrc/ops/dot_general.cpp; 25s local ... 2025-03-14T06:49:33.3604896Z 2025-03-14T06:49:33.3605717Z  2025-03-14T06:49:33.3606180Z  2025-03-14T06:49:33.3606567Z  2025-03-14T06:49:33.3607008Z  2025-03-14T06:49:33.3607419Z  2025-03-14T06:49:33.3607828Z  2025-03-14T06:49:33.3608246Z  2025-03-14T06:49:33.3608632Z  2025-03-14T06:49:33.3609579Z [20,519 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:33.3610605Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2025-03-14T06:49:33.3611378Z Compiling torch_xla/csrc/tensor_util.cpp; 64s local 2025-03-14T06:49:33.3612215Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2025-03-14T06:49:33.3613026Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2025-03-14T06:49:33.3613835Z Compiling torch_xla/csrc/ops/update_slice.cpp; 36s local 2025-03-14T06:49:33.3614809Z Compiling torch_xla/csrc/ops/diagonal_view_update.cpp; 31s local 2025-03-14T06:49:33.3615772Z Compiling torch_xla/csrc/ops/device_data.cpp; 26s local 2025-03-14T06:49:33.3616682Z Compiling torch_xla/csrc/ops/dot_general.cpp; 26s local ... 2025-03-14T06:49:33.5751456Z 2025-03-14T06:49:33.5752431Z  2025-03-14T06:49:33.5762956Z  2025-03-14T06:49:33.5764148Z  2025-03-14T06:49:33.5764741Z  2025-03-14T06:49:33.5765140Z  2025-03-14T06:49:33.5765805Z  2025-03-14T06:49:33.5766209Z  2025-03-14T06:49:33.5766607Z  2025-03-14T06:49:33.5767522Z [20,520 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:33.5768473Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2025-03-14T06:49:33.5769315Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2025-03-14T06:49:33.5770166Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2025-03-14T06:49:33.5770988Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2025-03-14T06:49:33.5771808Z Compiling torch_xla/csrc/ops/update_slice.cpp; 36s local 2025-03-14T06:49:33.5772798Z Compiling torch_xla/csrc/ops/device_data.cpp; 27s local 2025-03-14T06:49:33.5773630Z Compiling torch_xla/csrc/ops/dot_general.cpp; 26s local 2025-03-14T06:49:33.5774543Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 26s local ... 2025-03-14T06:49:33.9610681Z 2025-03-14T06:49:33.9611525Z  2025-03-14T06:49:33.9611999Z  2025-03-14T06:49:33.9612425Z  2025-03-14T06:49:33.9612834Z  2025-03-14T06:49:33.9613534Z  2025-03-14T06:49:33.9613932Z  2025-03-14T06:49:33.9614337Z  2025-03-14T06:49:33.9614727Z  2025-03-14T06:49:33.9615692Z [20,520 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:33.9616882Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2025-03-14T06:49:33.9617635Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2025-03-14T06:49:33.9618529Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2025-03-14T06:49:33.9619444Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2025-03-14T06:49:33.9620318Z Compiling torch_xla/csrc/ops/update_slice.cpp; 37s local 2025-03-14T06:49:33.9621194Z Compiling torch_xla/csrc/ops/device_data.cpp; 27s local 2025-03-14T06:49:33.9622000Z Compiling torch_xla/csrc/ops/dot_general.cpp; 27s local 2025-03-14T06:49:33.9622845Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 26s local ... 2025-03-14T06:49:34.1613825Z 2025-03-14T06:49:34.1614630Z  2025-03-14T06:49:34.1615090Z  2025-03-14T06:49:34.1615501Z  2025-03-14T06:49:34.1615869Z  2025-03-14T06:49:34.1616252Z  2025-03-14T06:49:34.1616649Z  2025-03-14T06:49:34.1617075Z  2025-03-14T06:49:34.1617458Z  2025-03-14T06:49:34.1618372Z [20,521 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:34.1619388Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2025-03-14T06:49:34.1620139Z Compiling torch_xla/csrc/tensor_util.cpp; 65s local 2025-03-14T06:49:34.1620988Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 59s local 2025-03-14T06:49:34.1621783Z Compiling torch_xla/csrc/RegisterXLA.cpp; 55s local 2025-03-14T06:49:34.1622596Z Compiling torch_xla/csrc/ops/device_data.cpp; 27s local 2025-03-14T06:49:34.1623659Z Compiling torch_xla/csrc/ops/dot_general.cpp; 27s local 2025-03-14T06:49:34.1624538Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 26s local 2025-03-14T06:49:34.1625482Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 24s local ... 2025-03-14T06:49:35.3621786Z 2025-03-14T06:49:35.3622631Z  2025-03-14T06:49:35.3623162Z  2025-03-14T06:49:35.3623602Z  2025-03-14T06:49:35.3624036Z  2025-03-14T06:49:35.3624479Z  2025-03-14T06:49:35.3624900Z  2025-03-14T06:49:35.3625312Z  2025-03-14T06:49:35.3625735Z  2025-03-14T06:49:35.3626714Z [20,521 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:35.3627794Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2025-03-14T06:49:35.3628894Z Compiling torch_xla/csrc/tensor_util.cpp; 66s local 2025-03-14T06:49:35.3629823Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 61s local 2025-03-14T06:49:35.3630715Z Compiling torch_xla/csrc/RegisterXLA.cpp; 57s local 2025-03-14T06:49:35.3631575Z Compiling torch_xla/csrc/ops/device_data.cpp; 28s local 2025-03-14T06:49:35.3632470Z Compiling torch_xla/csrc/ops/dot_general.cpp; 28s local 2025-03-14T06:49:35.3633370Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 27s local 2025-03-14T06:49:35.3634508Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 26s local ... 2025-03-14T06:49:35.7614538Z 2025-03-14T06:49:35.7615411Z  2025-03-14T06:49:35.7615853Z  2025-03-14T06:49:35.7616237Z  2025-03-14T06:49:35.7616607Z  2025-03-14T06:49:35.7616989Z  2025-03-14T06:49:35.7617380Z  2025-03-14T06:49:35.7617763Z  2025-03-14T06:49:35.7618146Z  2025-03-14T06:49:35.7619088Z [20,522 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:35.7620103Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2025-03-14T06:49:35.7620907Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T06:49:35.7621673Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 61s local 2025-03-14T06:49:35.7622863Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local 2025-03-14T06:49:35.7623691Z Compiling torch_xla/csrc/ops/dot_general.cpp; 28s local 2025-03-14T06:49:35.7624544Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2025-03-14T06:49:35.7625563Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 26s local 2025-03-14T06:49:35.7626502Z Compiling test/cpp/test_symint.cpp; 25s local ... 2025-03-14T06:49:35.9627294Z 2025-03-14T06:49:35.9628140Z  2025-03-14T06:49:35.9628614Z  2025-03-14T06:49:35.9629020Z  2025-03-14T06:49:35.9629427Z  2025-03-14T06:49:35.9629803Z  2025-03-14T06:49:35.9630238Z  2025-03-14T06:49:35.9630640Z  2025-03-14T06:49:35.9631037Z  2025-03-14T06:49:35.9631963Z [20,522 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:35.9632935Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2025-03-14T06:49:35.9633738Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T06:49:35.9634560Z Compiling torch_xla/csrc/xla_sharding_util.cpp; 61s local 2025-03-14T06:49:35.9635421Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local 2025-03-14T06:49:35.9636274Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2025-03-14T06:49:35.9637127Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2025-03-14T06:49:35.9638019Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 26s local 2025-03-14T06:49:35.9638841Z Compiling test/cpp/test_symint.cpp; 26s local ... 2025-03-14T06:49:36.1941161Z 2025-03-14T06:49:36.1942014Z  2025-03-14T06:49:36.1942520Z  2025-03-14T06:49:36.1942908Z  2025-03-14T06:49:36.1943303Z  2025-03-14T06:49:36.1943674Z  2025-03-14T06:49:36.1944054Z  2025-03-14T06:49:36.1944384Z  2025-03-14T06:49:36.1944759Z  2025-03-14T06:49:36.1945626Z [20,523 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:36.1946584Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2025-03-14T06:49:36.1947332Z Compiling torch_xla/csrc/tensor_util.cpp; 67s local 2025-03-14T06:49:36.1948122Z Compiling torch_xla/csrc/ops/device_data.cpp; 29s local 2025-03-14T06:49:36.1948889Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2025-03-14T06:49:36.1949728Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 28s local 2025-03-14T06:49:36.1950626Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 26s local 2025-03-14T06:49:36.1951384Z Compiling test/cpp/test_symint.cpp; 26s local 2025-03-14T06:49:36.1952474Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 25s local ... 2025-03-14T06:49:36.5632071Z 2025-03-14T06:49:36.5632947Z  2025-03-14T06:49:36.5633697Z  2025-03-14T06:49:36.5634116Z  2025-03-14T06:49:36.5634487Z  2025-03-14T06:49:36.5634876Z  2025-03-14T06:49:36.5635256Z  2025-03-14T06:49:36.5635669Z  2025-03-14T06:49:36.5636028Z  2025-03-14T06:49:36.5636928Z [20,523 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:36.5637874Z Compiling torch_xla/csrc/tensor_util.cpp; 110s local 2025-03-14T06:49:36.5638645Z Compiling torch_xla/csrc/tensor_util.cpp; 68s local 2025-03-14T06:49:36.5639396Z Compiling torch_xla/csrc/ops/device_data.cpp; 30s local 2025-03-14T06:49:36.5640176Z Compiling torch_xla/csrc/ops/dot_general.cpp; 29s local 2025-03-14T06:49:36.5640992Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 29s local 2025-03-14T06:49:36.5641912Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 27s local 2025-03-14T06:49:36.5642840Z Compiling test/cpp/test_symint.cpp; 26s local 2025-03-14T06:49:36.5643584Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 25s local ... 2025-03-14T06:49:37.7640905Z 2025-03-14T06:49:37.7641751Z  2025-03-14T06:49:37.7642258Z  2025-03-14T06:49:37.7642989Z  2025-03-14T06:49:37.7643341Z  2025-03-14T06:49:37.7643736Z  2025-03-14T06:49:37.7644141Z  2025-03-14T06:49:37.7644668Z  2025-03-14T06:49:37.7645043Z  2025-03-14T06:49:37.7646145Z [20,523 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:37.7647092Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2025-03-14T06:49:37.7647829Z Compiling torch_xla/csrc/tensor_util.cpp; 69s local 2025-03-14T06:49:37.7648591Z Compiling torch_xla/csrc/ops/device_data.cpp; 31s local 2025-03-14T06:49:37.7649456Z Compiling torch_xla/csrc/ops/dot_general.cpp; 30s local 2025-03-14T06:49:37.7650341Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 30s local 2025-03-14T06:49:37.7651170Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 28s local 2025-03-14T06:49:37.7651891Z Compiling test/cpp/test_symint.cpp; 27s local 2025-03-14T06:49:37.7652642Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 27s local ... 2025-03-14T06:49:38.7649684Z 2025-03-14T06:49:38.7650552Z  2025-03-14T06:49:38.7651072Z  2025-03-14T06:49:38.7651502Z  2025-03-14T06:49:38.7651914Z  2025-03-14T06:49:38.7652325Z  2025-03-14T06:49:38.7652757Z  2025-03-14T06:49:38.7653183Z  2025-03-14T06:49:38.7653607Z  2025-03-14T06:49:38.7654558Z [20,523 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:38.7655612Z Compiling torch_xla/csrc/tensor_util.cpp; 112s local 2025-03-14T06:49:38.7656455Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2025-03-14T06:49:38.7657305Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2025-03-14T06:49:38.7658125Z Compiling torch_xla/csrc/ops/dot_general.cpp; 31s local 2025-03-14T06:49:38.7658905Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2025-03-14T06:49:38.7659697Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2025-03-14T06:49:38.7660359Z Compiling test/cpp/test_symint.cpp; 28s local 2025-03-14T06:49:38.7661083Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 28s local ... 2025-03-14T06:49:38.9652507Z 2025-03-14T06:49:38.9653408Z  2025-03-14T06:49:38.9653876Z  2025-03-14T06:49:38.9654288Z  2025-03-14T06:49:38.9654651Z  2025-03-14T06:49:38.9655030Z  2025-03-14T06:49:38.9655388Z  2025-03-14T06:49:38.9655744Z  2025-03-14T06:49:38.9656108Z  2025-03-14T06:49:38.9657007Z [20,524 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:38.9658219Z Compiling torch_xla/csrc/tensor_util.cpp; 112s local 2025-03-14T06:49:38.9658842Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2025-03-14T06:49:38.9659693Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2025-03-14T06:49:38.9660527Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2025-03-14T06:49:38.9661409Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 29s local 2025-03-14T06:49:38.9662273Z Compiling test/cpp/test_symint.cpp; 29s local 2025-03-14T06:49:38.9662995Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 28s local 2025-03-14T06:49:38.9663902Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 27s local ... 2025-03-14T06:49:39.3656464Z 2025-03-14T06:49:39.3657298Z  2025-03-14T06:49:39.3657768Z  2025-03-14T06:49:39.3658101Z  2025-03-14T06:49:39.3658475Z  2025-03-14T06:49:39.3658860Z  2025-03-14T06:49:39.3659248Z  2025-03-14T06:49:39.3659604Z  2025-03-14T06:49:39.3659986Z  2025-03-14T06:49:39.3660967Z [20,524 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:39.3661945Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2025-03-14T06:49:39.3662739Z Compiling torch_xla/csrc/tensor_util.cpp; 70s local 2025-03-14T06:49:39.3663467Z Compiling torch_xla/csrc/ops/device_data.cpp; 32s local 2025-03-14T06:49:39.3664611Z Compiling torch_xla/csrc/ops/dynamic_expand.cpp; 31s local 2025-03-14T06:49:39.3665761Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T06:49:39.3666739Z Compiling test/cpp/test_symint.cpp; 29s local 2025-03-14T06:49:39.3667422Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 28s local 2025-03-14T06:49:39.3668216Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 27s local ... 2025-03-14T06:49:40.1186718Z 2025-03-14T06:49:40.1187581Z  2025-03-14T06:49:40.1188024Z  2025-03-14T06:49:40.1188393Z  2025-03-14T06:49:40.1188749Z  2025-03-14T06:49:40.1189105Z  2025-03-14T06:49:40.1189498Z  2025-03-14T06:49:40.1189860Z  2025-03-14T06:49:40.1190214Z  2025-03-14T06:49:40.1191017Z [20,525 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:40.1191931Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2025-03-14T06:49:40.1192679Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2025-03-14T06:49:40.1193406Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2025-03-14T06:49:40.1194223Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 30s local 2025-03-14T06:49:40.1194951Z Compiling test/cpp/test_symint.cpp; 30s local 2025-03-14T06:49:40.1195677Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local 2025-03-14T06:49:40.1196440Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 28s local 2025-03-14T06:49:40.1197289Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 27s local ... 2025-03-14T06:49:40.3663740Z 2025-03-14T06:49:40.3664586Z  2025-03-14T06:49:40.3665090Z  2025-03-14T06:49:40.3665702Z  2025-03-14T06:49:40.3666094Z  2025-03-14T06:49:40.3666482Z  2025-03-14T06:49:40.3666862Z  2025-03-14T06:49:40.3667266Z  2025-03-14T06:49:40.3667653Z  2025-03-14T06:49:40.3668635Z [20,525 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:40.3669656Z Compiling torch_xla/csrc/tensor_util.cpp; 114s local 2025-03-14T06:49:40.3670359Z Compiling torch_xla/csrc/tensor_util.cpp; 71s local 2025-03-14T06:49:40.3671090Z Compiling torch_xla/csrc/ops/device_data.cpp; 33s local 2025-03-14T06:49:40.3671872Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 31s local 2025-03-14T06:49:40.3672634Z Compiling test/cpp/test_symint.cpp; 30s local 2025-03-14T06:49:40.3673365Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 29s local 2025-03-14T06:49:40.3674154Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 28s local 2025-03-14T06:49:40.3675374Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 28s local ... 2025-03-14T06:49:41.5672393Z 2025-03-14T06:49:41.5673527Z  2025-03-14T06:49:41.5673968Z  2025-03-14T06:49:41.5674311Z  2025-03-14T06:49:41.5674662Z  2025-03-14T06:49:41.5675005Z  2025-03-14T06:49:41.5675367Z  2025-03-14T06:49:41.5675735Z  2025-03-14T06:49:41.5676074Z  2025-03-14T06:49:41.5676896Z [20,525 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:41.5677780Z Compiling torch_xla/csrc/tensor_util.cpp; 115s local 2025-03-14T06:49:41.5678436Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2025-03-14T06:49:41.5679112Z Compiling torch_xla/csrc/ops/device_data.cpp; 35s local 2025-03-14T06:49:41.5679838Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2025-03-14T06:49:41.5680494Z Compiling test/cpp/test_symint.cpp; 31s local 2025-03-14T06:49:41.5681141Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 30s local 2025-03-14T06:49:41.5681847Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 29s local 2025-03-14T06:49:41.5682615Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local ... 2025-03-14T06:49:41.7977250Z 2025-03-14T06:49:41.7978067Z  2025-03-14T06:49:41.7978482Z  2025-03-14T06:49:41.7979079Z  2025-03-14T06:49:41.7979414Z  2025-03-14T06:49:41.7979750Z  2025-03-14T06:49:41.7980092Z  2025-03-14T06:49:41.7980437Z  2025-03-14T06:49:41.7980770Z  2025-03-14T06:49:41.7981703Z [20,526 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:41.7982546Z Compiling torch_xla/csrc/tensor_util.cpp; 115s local 2025-03-14T06:49:41.7983210Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2025-03-14T06:49:41.7983917Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2025-03-14T06:49:41.7984626Z Compiling test/cpp/test_symint.cpp; 31s local 2025-03-14T06:49:41.7985267Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2025-03-14T06:49:41.7986097Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2025-03-14T06:49:41.7987022Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local 2025-03-14T06:49:41.7987760Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local ... 2025-03-14T06:49:42.1677638Z 2025-03-14T06:49:42.1678486Z  2025-03-14T06:49:42.1678975Z  2025-03-14T06:49:42.1679378Z  2025-03-14T06:49:42.1679789Z  2025-03-14T06:49:42.1680205Z  2025-03-14T06:49:42.1680594Z  2025-03-14T06:49:42.1680988Z  2025-03-14T06:49:42.1681375Z  2025-03-14T06:49:42.1682307Z [20,526 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:42.1683304Z Compiling torch_xla/csrc/tensor_util.cpp; 115s local 2025-03-14T06:49:42.1684065Z Compiling torch_xla/csrc/tensor_util.cpp; 73s local 2025-03-14T06:49:42.1685036Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 32s local 2025-03-14T06:49:42.1685818Z Compiling test/cpp/test_symint.cpp; 32s local 2025-03-14T06:49:42.1686572Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 31s local 2025-03-14T06:49:42.1687392Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 30s local 2025-03-14T06:49:42.1688252Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 29s local 2025-03-14T06:49:42.1689070Z Compiling torch_xla/csrc/ops/einsum.cpp; 29s local ... 2025-03-14T06:49:43.1685004Z 2025-03-14T06:49:43.1685876Z  2025-03-14T06:49:43.1686339Z  2025-03-14T06:49:43.1686715Z  2025-03-14T06:49:43.1687110Z  2025-03-14T06:49:43.1687496Z  2025-03-14T06:49:43.1687899Z  2025-03-14T06:49:43.1688292Z  2025-03-14T06:49:43.1688658Z  2025-03-14T06:49:43.1689552Z [20,526 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:43.1690886Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2025-03-14T06:49:43.1691785Z Compiling torch_xla/csrc/tensor_util.cpp; 74s local 2025-03-14T06:49:43.1692544Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 33s local 2025-03-14T06:49:43.1693465Z Compiling test/cpp/test_symint.cpp; 33s local 2025-03-14T06:49:43.1694245Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 32s local 2025-03-14T06:49:43.1695066Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 31s local 2025-03-14T06:49:43.1695932Z Compiling torch_xla/csrc/ops/einsum_backward.cpp; 30s local 2025-03-14T06:49:43.1696727Z Compiling torch_xla/csrc/ops/einsum.cpp; 30s local ... 2025-03-14T06:49:44.1691801Z 2025-03-14T06:49:44.1692650Z  2025-03-14T06:49:44.1693125Z  2025-03-14T06:49:44.1693490Z  2025-03-14T06:49:44.1693845Z  2025-03-14T06:49:44.1694217Z  2025-03-14T06:49:44.1694572Z  2025-03-14T06:49:44.1694927Z  2025-03-14T06:49:44.1695298Z  2025-03-14T06:49:44.1696242Z [20,527 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:44.1697478Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2025-03-14T06:49:44.1698025Z Compiling torch_xla/csrc/tensor_util.cpp; 75s local 2025-03-14T06:49:44.1698616Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 34s local 2025-03-14T06:49:44.1699512Z Compiling test/cpp/test_symint.cpp; 34s local 2025-03-14T06:49:44.1700110Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2025-03-14T06:49:44.1700814Z Compiling torch_xla/csrc/ops/dynamic_view.cpp; 32s local 2025-03-14T06:49:44.1701387Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2025-03-14T06:49:44.1702112Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 30s local ... 2025-03-14T06:49:44.3695513Z 2025-03-14T06:49:44.3696283Z  2025-03-14T06:49:44.3696767Z  2025-03-14T06:49:44.3697150Z  2025-03-14T06:49:44.3697517Z  2025-03-14T06:49:44.3697883Z  2025-03-14T06:49:44.3698292Z  2025-03-14T06:49:44.3698665Z  2025-03-14T06:49:44.3699026Z  2025-03-14T06:49:44.3699918Z [20,528 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:44.3700867Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2025-03-14T06:49:44.3701591Z Compiling torch_xla/csrc/tensor_util.cpp; 75s local 2025-03-14T06:49:44.3702381Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2025-03-14T06:49:44.3703167Z Compiling test/cpp/test_symint.cpp; 34s local 2025-03-14T06:49:44.3703859Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 33s local 2025-03-14T06:49:44.3704551Z Compiling torch_xla/csrc/ops/einsum.cpp; 31s local 2025-03-14T06:49:44.3705275Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2025-03-14T06:49:44.3706044Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local ... 2025-03-14T06:49:44.7698839Z 2025-03-14T06:49:44.7699700Z  2025-03-14T06:49:44.7700211Z  2025-03-14T06:49:44.7700603Z  2025-03-14T06:49:44.7701002Z  2025-03-14T06:49:44.7701395Z  2025-03-14T06:49:44.7701789Z  2025-03-14T06:49:44.7702166Z  2025-03-14T06:49:44.7702542Z  2025-03-14T06:49:44.7703466Z [20,529 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:44.7704485Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2025-03-14T06:49:44.7705283Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2025-03-14T06:49:44.7706061Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 35s local 2025-03-14T06:49:44.7706866Z Compiling test/cpp/test_symint.cpp; 34s local 2025-03-14T06:49:44.7707546Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2025-03-14T06:49:44.7708167Z Compiling torch_xla/csrc/ops/embedding_bag.cpp; 31s local 2025-03-14T06:49:44.7708800Z Compiling torch_xla/csrc/ops/eigh.cpp; 31s local 2025-03-14T06:49:44.7709881Z Compiling torch_xla/csrc/ops/expand.cpp; 31s local ... 2025-03-14T06:49:45.3704588Z 2025-03-14T06:49:45.3705649Z  2025-03-14T06:49:45.3706173Z  2025-03-14T06:49:45.3706564Z  2025-03-14T06:49:45.3706941Z  2025-03-14T06:49:45.3707342Z  2025-03-14T06:49:45.3707720Z  2025-03-14T06:49:45.3708087Z  2025-03-14T06:49:45.3708459Z  2025-03-14T06:49:45.3709354Z [20,530 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:45.3710335Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2025-03-14T06:49:45.3711103Z Compiling torch_xla/csrc/tensor_util.cpp; 76s local 2025-03-14T06:49:45.3711891Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T06:49:45.3712679Z Compiling test/cpp/test_symint.cpp; 35s local 2025-03-14T06:49:45.3713428Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 34s local 2025-03-14T06:49:45.3714198Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2025-03-14T06:49:45.3714905Z Compiling torch_xla/csrc/ops/expand.cpp; 31s local 2025-03-14T06:49:45.3715713Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local ... 2025-03-14T06:49:45.7195579Z 2025-03-14T06:49:45.7196455Z  2025-03-14T06:49:45.7196935Z  2025-03-14T06:49:45.7197291Z  2025-03-14T06:49:45.7197988Z  2025-03-14T06:49:45.7198484Z  2025-03-14T06:49:45.7198860Z  2025-03-14T06:49:45.7199266Z  2025-03-14T06:49:45.7199673Z  2025-03-14T06:49:45.7200601Z [20,531 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:45.7201959Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2025-03-14T06:49:45.7202681Z Compiling torch_xla/csrc/tensor_util.cpp; 77s local 2025-03-14T06:49:45.7203467Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T06:49:45.7204300Z Compiling test/cpp/test_symint.cpp; 35s local 2025-03-14T06:49:45.7205242Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2025-03-14T06:49:45.7206049Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2025-03-14T06:49:45.7206831Z Compiling torch_xla/csrc/ops/exponential.cpp; 30s local 2025-03-14T06:49:45.7207690Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local ... 2025-03-14T06:49:45.9708550Z 2025-03-14T06:49:45.9709506Z  2025-03-14T06:49:45.9710018Z  2025-03-14T06:49:45.9710613Z  2025-03-14T06:49:45.9711016Z  2025-03-14T06:49:45.9711426Z  2025-03-14T06:49:45.9711876Z  2025-03-14T06:49:45.9712246Z  2025-03-14T06:49:45.9712563Z  2025-03-14T06:49:45.9713297Z [20,531 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:45.9714065Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2025-03-14T06:49:45.9714658Z Compiling torch_xla/csrc/tensor_util.cpp; 77s local 2025-03-14T06:49:45.9715336Z Compiling torch_xla/csrc/ops/discrete_uniform.cpp; 36s local 2025-03-14T06:49:45.9715992Z Compiling test/cpp/test_symint.cpp; 36s local 2025-03-14T06:49:45.9716716Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 35s local 2025-03-14T06:49:45.9717454Z Compiling torch_xla/csrc/ops/eigh.cpp; 32s local 2025-03-14T06:49:45.9718226Z Compiling torch_xla/csrc/ops/exponential.cpp; 31s local 2025-03-14T06:49:45.9719054Z Compiling torch_xla/csrc/ops/flip.cpp; 29s local ... 2025-03-14T06:49:46.6536969Z 2025-03-14T06:49:46.6537945Z  2025-03-14T06:49:46.6538427Z  2025-03-14T06:49:46.6538866Z  2025-03-14T06:49:46.6539230Z  2025-03-14T06:49:46.6539593Z  2025-03-14T06:49:46.6539970Z  2025-03-14T06:49:46.6540349Z  2025-03-14T06:49:46.6540739Z  2025-03-14T06:49:46.6541651Z [20,532 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:46.6542599Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2025-03-14T06:49:46.6543709Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2025-03-14T06:49:46.6544601Z Compiling test/cpp/test_symint.cpp; 36s local 2025-03-14T06:49:46.6545355Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T06:49:46.6546121Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2025-03-14T06:49:46.6546913Z Compiling torch_xla/csrc/ops/exponential.cpp; 31s local 2025-03-14T06:49:46.6547716Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2025-03-14T06:49:46.6548445Z Compiling torch_xla/csrc/ops/gather.cpp; 29s local ... 2025-03-14T06:49:46.9716146Z 2025-03-14T06:49:46.9716994Z  2025-03-14T06:49:46.9717492Z  2025-03-14T06:49:46.9717879Z  2025-03-14T06:49:46.9718308Z  2025-03-14T06:49:46.9718714Z  2025-03-14T06:49:46.9719117Z  2025-03-14T06:49:46.9719516Z  2025-03-14T06:49:46.9719916Z  2025-03-14T06:49:46.9720889Z [20,532 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:46.9721882Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2025-03-14T06:49:46.9722653Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2025-03-14T06:49:46.9723368Z Compiling test/cpp/test_symint.cpp; 37s local 2025-03-14T06:49:46.9724071Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T06:49:46.9725412Z Compiling torch_xla/csrc/ops/eigh.cpp; 33s local 2025-03-14T06:49:46.9726175Z Compiling torch_xla/csrc/ops/exponential.cpp; 32s local 2025-03-14T06:49:46.9727270Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2025-03-14T06:49:46.9727968Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local ... 2025-03-14T06:49:47.2823960Z 2025-03-14T06:49:47.2824836Z  2025-03-14T06:49:47.2825339Z  2025-03-14T06:49:47.2825737Z  2025-03-14T06:49:47.2826111Z  2025-03-14T06:49:47.2826516Z  2025-03-14T06:49:47.2826910Z  2025-03-14T06:49:47.2827313Z  2025-03-14T06:49:47.2827741Z  2025-03-14T06:49:47.2828680Z [20,533 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:47.2829678Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2025-03-14T06:49:47.2830449Z Compiling torch_xla/csrc/tensor_util.cpp; 78s local 2025-03-14T06:49:47.2831149Z Compiling test/cpp/test_symint.cpp; 37s local 2025-03-14T06:49:47.2831864Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T06:49:47.2832558Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2025-03-14T06:49:47.2833292Z Compiling torch_xla/csrc/ops/flip.cpp; 30s local 2025-03-14T06:49:47.2834037Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2025-03-14T06:49:47.2834882Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local ... 2025-03-14T06:49:47.5721452Z 2025-03-14T06:49:47.5722256Z  2025-03-14T06:49:47.5722679Z  2025-03-14T06:49:47.5722996Z  2025-03-14T06:49:47.5723304Z  2025-03-14T06:49:47.5723865Z  2025-03-14T06:49:47.5724184Z  2025-03-14T06:49:47.5724685Z  2025-03-14T06:49:47.5725013Z  2025-03-14T06:49:47.5725768Z [20,533 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:47.5726536Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2025-03-14T06:49:47.5727136Z Compiling torch_xla/csrc/tensor_util.cpp; 79s local 2025-03-14T06:49:47.5727689Z Compiling test/cpp/test_symint.cpp; 37s local 2025-03-14T06:49:47.5728264Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 36s local 2025-03-14T06:49:47.5728864Z Compiling torch_xla/csrc/ops/eigh.cpp; 34s local 2025-03-14T06:49:47.5729413Z Compiling torch_xla/csrc/ops/flip.cpp; 31s local 2025-03-14T06:49:47.5730006Z Compiling torch_xla/csrc/ops/gather.cpp; 30s local 2025-03-14T06:49:47.5730817Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 30s local ... 2025-03-14T06:49:48.3386178Z 2025-03-14T06:49:48.3387023Z  2025-03-14T06:49:48.3387717Z  2025-03-14T06:49:48.3388138Z  2025-03-14T06:49:48.3388542Z  2025-03-14T06:49:48.3389037Z  2025-03-14T06:49:48.3389444Z  2025-03-14T06:49:48.3389842Z  2025-03-14T06:49:48.3390242Z  2025-03-14T06:49:48.3391189Z [20,534 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:48.3392202Z Compiling torch_xla/csrc/tensor_util.cpp; 122s local 2025-03-14T06:49:48.3392973Z Compiling torch_xla/csrc/tensor_util.cpp; 79s local 2025-03-14T06:49:48.3393720Z Compiling test/cpp/test_symint.cpp; 38s local 2025-03-14T06:49:48.3394480Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2025-03-14T06:49:48.3395240Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2025-03-14T06:49:48.3396010Z Compiling torch_xla/csrc/ops/gather.cpp; 31s local 2025-03-14T06:49:48.3396824Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2025-03-14T06:49:48.3397694Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local ... 2025-03-14T06:49:48.5398451Z 2025-03-14T06:49:48.5399264Z  2025-03-14T06:49:48.5399758Z  2025-03-14T06:49:48.5400182Z  2025-03-14T06:49:48.5400580Z  2025-03-14T06:49:48.5401004Z  2025-03-14T06:49:48.5401361Z  2025-03-14T06:49:48.5401983Z  2025-03-14T06:49:48.5402362Z  2025-03-14T06:49:48.5403349Z [20,535 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:48.5404313Z Compiling torch_xla/csrc/tensor_util.cpp; 122s local 2025-03-14T06:49:48.5405437Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2025-03-14T06:49:48.5406146Z Compiling test/cpp/test_symint.cpp; 38s local 2025-03-14T06:49:48.5406923Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 37s local 2025-03-14T06:49:48.5407644Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2025-03-14T06:49:48.5408521Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2025-03-14T06:49:48.5409340Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2025-03-14T06:49:48.5410134Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local ... 2025-03-14T06:49:48.7730140Z 2025-03-14T06:49:48.7731026Z  2025-03-14T06:49:48.7731510Z  2025-03-14T06:49:48.7731879Z  2025-03-14T06:49:48.7732287Z  2025-03-14T06:49:48.7732619Z  2025-03-14T06:49:48.7733053Z  2025-03-14T06:49:48.7733364Z  2025-03-14T06:49:48.7733737Z  2025-03-14T06:49:48.7734553Z [20,535 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:48.7735435Z Compiling torch_xla/csrc/tensor_util.cpp; 122s local 2025-03-14T06:49:48.7736053Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2025-03-14T06:49:48.7736669Z Compiling test/cpp/test_symint.cpp; 38s local 2025-03-14T06:49:48.7737358Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2025-03-14T06:49:48.7737965Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2025-03-14T06:49:48.7738590Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2025-03-14T06:49:48.7739219Z Compiling torch_xla/csrc/ops/generic.cpp; 31s local 2025-03-14T06:49:48.7739864Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 30s local ... 2025-03-14T06:49:49.1261125Z 2025-03-14T06:49:49.1261976Z  2025-03-14T06:49:49.1262475Z  2025-03-14T06:49:49.1262888Z  2025-03-14T06:49:49.1263302Z  2025-03-14T06:49:49.1263705Z  2025-03-14T06:49:49.1264128Z  2025-03-14T06:49:49.1264527Z  2025-03-14T06:49:49.1264916Z  2025-03-14T06:49:49.1266071Z [20,536 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:49.1267100Z Compiling torch_xla/csrc/tensor_util.cpp; 122s local 2025-03-14T06:49:49.1267783Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2025-03-14T06:49:49.1268771Z Compiling test/cpp/test_symint.cpp; 39s local 2025-03-14T06:49:49.1269635Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2025-03-14T06:49:49.1270542Z Compiling torch_xla/csrc/ops/eigh.cpp; 35s local 2025-03-14T06:49:49.1271310Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 31s local 2025-03-14T06:49:49.1272143Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2025-03-14T06:49:49.1273091Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 30s local ... 2025-03-14T06:49:49.3734897Z 2025-03-14T06:49:49.3735715Z  2025-03-14T06:49:49.3736179Z  2025-03-14T06:49:49.3736528Z  2025-03-14T06:49:49.3736889Z  2025-03-14T06:49:49.3737222Z  2025-03-14T06:49:49.3737553Z  2025-03-14T06:49:49.3737893Z  2025-03-14T06:49:49.3738233Z  2025-03-14T06:49:49.3739060Z [20,536 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:49.3739879Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2025-03-14T06:49:49.3740535Z Compiling torch_xla/csrc/tensor_util.cpp; 80s local 2025-03-14T06:49:49.3741180Z Compiling test/cpp/test_symint.cpp; 39s local 2025-03-14T06:49:49.3741874Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 38s local 2025-03-14T06:49:49.3742510Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T06:49:49.3743481Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2025-03-14T06:49:49.3744199Z Compiling torch_xla/csrc/ops/gpu_custom_call.cpp; 31s local 2025-03-14T06:49:49.3744996Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local ... 2025-03-14T06:49:49.7739483Z 2025-03-14T06:49:49.7740335Z  2025-03-14T06:49:49.7740771Z  2025-03-14T06:49:49.7741173Z  2025-03-14T06:49:49.7741498Z  2025-03-14T06:49:49.7741812Z  2025-03-14T06:49:49.7742164Z  2025-03-14T06:49:49.7742479Z  2025-03-14T06:49:49.7742789Z  2025-03-14T06:49:49.7743568Z [20,537 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:49.7744350Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2025-03-14T06:49:49.7744945Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2025-03-14T06:49:49.7745488Z Compiling test/cpp/test_symint.cpp; 39s local 2025-03-14T06:49:49.7746078Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 39s local 2025-03-14T06:49:49.7746665Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T06:49:49.7747267Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2025-03-14T06:49:49.7747950Z Compiling torch_xla/csrc/ops/hardtanh_backward.cpp; 31s local 2025-03-14T06:49:49.7748667Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local ... 2025-03-14T06:49:49.9742730Z 2025-03-14T06:49:49.9743604Z  2025-03-14T06:49:49.9744106Z  2025-03-14T06:49:49.9744493Z  2025-03-14T06:49:49.9744884Z  2025-03-14T06:49:49.9745289Z  2025-03-14T06:49:49.9745684Z  2025-03-14T06:49:49.9746089Z  2025-03-14T06:49:49.9746479Z  2025-03-14T06:49:49.9747395Z [20,538 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:49.9748411Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2025-03-14T06:49:49.9749209Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2025-03-14T06:49:49.9749994Z Compiling test/cpp/test_symint.cpp; 40s local 2025-03-14T06:49:49.9750771Z Compiling torch_xla/csrc/ops/dynamic_ir.cpp; 39s local 2025-03-14T06:49:49.9751617Z Compiling torch_xla/csrc/ops/eigh.cpp; 36s local 2025-03-14T06:49:49.9752430Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 32s local 2025-03-14T06:49:49.9753387Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 31s local 2025-03-14T06:49:49.9754284Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local ... 2025-03-14T06:49:50.2304360Z 2025-03-14T06:49:50.2305194Z  2025-03-14T06:49:50.2305662Z  2025-03-14T06:49:50.2306390Z  2025-03-14T06:49:50.2306797Z  2025-03-14T06:49:50.2307197Z  2025-03-14T06:49:50.2307791Z  2025-03-14T06:49:50.2308192Z  2025-03-14T06:49:50.2308605Z  2025-03-14T06:49:50.2309519Z [20,539 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:50.2310532Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2025-03-14T06:49:50.2311257Z Compiling torch_xla/csrc/tensor_util.cpp; 81s local 2025-03-14T06:49:50.2311940Z Compiling test/cpp/test_symint.cpp; 40s local 2025-03-14T06:49:50.2312669Z Compiling torch_xla/csrc/ops/eigh.cpp; 37s local 2025-03-14T06:49:50.2313518Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2025-03-14T06:49:50.2314482Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T06:49:50.2315411Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 29s local 2025-03-14T06:49:50.2316324Z Compiling torch_xla/csrc/ops/index_get.cpp; 29s local ... 2025-03-14T06:49:50.5747887Z 2025-03-14T06:49:50.5748750Z  2025-03-14T06:49:50.5749236Z  2025-03-14T06:49:50.5749818Z  2025-03-14T06:49:50.5750237Z  2025-03-14T06:49:50.5750630Z  2025-03-14T06:49:50.5751030Z  2025-03-14T06:49:50.5751426Z  2025-03-14T06:49:50.5752136Z  2025-03-14T06:49:50.5753105Z [20,540 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:50.5754068Z Compiling torch_xla/csrc/tensor_util.cpp; 124s local 2025-03-14T06:49:50.5754987Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2025-03-14T06:49:50.5755749Z Compiling test/cpp/test_symint.cpp; 40s local 2025-03-14T06:49:50.5756559Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2025-03-14T06:49:50.5757457Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T06:49:50.5758406Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2025-03-14T06:49:50.5759250Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2025-03-14T06:49:50.5760120Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local ... 2025-03-14T06:49:50.9751990Z 2025-03-14T06:49:50.9752791Z  2025-03-14T06:49:50.9753190Z  2025-03-14T06:49:50.9753534Z  2025-03-14T06:49:50.9753893Z  2025-03-14T06:49:50.9754242Z  2025-03-14T06:49:50.9754601Z  2025-03-14T06:49:50.9754941Z  2025-03-14T06:49:50.9755286Z  2025-03-14T06:49:50.9756075Z [20,540 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:50.9756952Z Compiling torch_xla/csrc/tensor_util.cpp; 124s local 2025-03-14T06:49:50.9757610Z Compiling torch_xla/csrc/tensor_util.cpp; 82s local 2025-03-14T06:49:50.9758234Z Compiling test/cpp/test_symint.cpp; 41s local 2025-03-14T06:49:50.9758892Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 33s local 2025-03-14T06:49:50.9759673Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 32s local 2025-03-14T06:49:50.9760482Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 30s local 2025-03-14T06:49:50.9761197Z Compiling torch_xla/csrc/ops/index_get.cpp; 30s local 2025-03-14T06:49:50.9761908Z Compiling torch_xla/csrc/ops/index_put.cpp; 29s local ... 2025-03-14T06:49:52.1760477Z 2025-03-14T06:49:52.1761316Z  2025-03-14T06:49:52.1761760Z  2025-03-14T06:49:52.1762110Z  2025-03-14T06:49:52.1762498Z  2025-03-14T06:49:52.1762877Z  2025-03-14T06:49:52.1763270Z  2025-03-14T06:49:52.1763649Z  2025-03-14T06:49:52.1764045Z  2025-03-14T06:49:52.1765074Z [20,540 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:52.1766191Z Compiling torch_xla/csrc/tensor_util.cpp; 125s local 2025-03-14T06:49:52.1766879Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2025-03-14T06:49:52.1767765Z Compiling test/cpp/test_symint.cpp; 42s local 2025-03-14T06:49:52.1768474Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T06:49:52.1769468Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 33s local 2025-03-14T06:49:52.1770271Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2025-03-14T06:49:52.1771086Z Compiling torch_xla/csrc/ops/index_get.cpp; 31s local 2025-03-14T06:49:52.1771822Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local ... 2025-03-14T06:49:52.3763624Z 2025-03-14T06:49:52.3764438Z  2025-03-14T06:49:52.3765031Z  2025-03-14T06:49:52.3765580Z  2025-03-14T06:49:52.3765921Z  2025-03-14T06:49:52.3766257Z  2025-03-14T06:49:52.3766599Z  2025-03-14T06:49:52.3766921Z  2025-03-14T06:49:52.3767257Z  2025-03-14T06:49:52.3768019Z [20,541 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:52.3768849Z Compiling torch_xla/csrc/tensor_util.cpp; 126s local 2025-03-14T06:49:52.3769472Z Compiling torch_xla/csrc/tensor_util.cpp; 83s local 2025-03-14T06:49:52.3770059Z Compiling test/cpp/test_symint.cpp; 42s local 2025-03-14T06:49:52.3770707Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T06:49:52.3771435Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2025-03-14T06:49:52.3772694Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 31s local 2025-03-14T06:49:52.3773406Z Compiling torch_xla/csrc/ops/index_put.cpp; 30s local 2025-03-14T06:49:52.3774204Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local ... 2025-03-14T06:49:52.7298001Z 2025-03-14T06:49:52.7298804Z  2025-03-14T06:49:52.7299213Z  2025-03-14T06:49:52.7299545Z  2025-03-14T06:49:52.7299874Z  2025-03-14T06:49:52.7300189Z  2025-03-14T06:49:52.7300519Z  2025-03-14T06:49:52.7300848Z  2025-03-14T06:49:52.7301178Z  2025-03-14T06:49:52.7301984Z [20,542 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:52.7302920Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2025-03-14T06:49:52.7303509Z Compiling test/cpp/test_symint.cpp; 42s local 2025-03-14T06:49:52.7304133Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T06:49:52.7304857Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2025-03-14T06:49:52.7305585Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T06:49:52.7306242Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2025-03-14T06:49:52.7306909Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2025-03-14T06:49:52.7307587Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local ... 2025-03-14T06:49:52.9769076Z 2025-03-14T06:49:52.9769884Z  2025-03-14T06:49:52.9770275Z  2025-03-14T06:49:52.9770595Z  2025-03-14T06:49:52.9771206Z  2025-03-14T06:49:52.9771515Z  2025-03-14T06:49:52.9771864Z  2025-03-14T06:49:52.9772181Z  2025-03-14T06:49:52.9772491Z  2025-03-14T06:49:52.9773249Z [20,542 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:52.9774024Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2025-03-14T06:49:52.9774623Z Compiling test/cpp/test_symint.cpp; 43s local 2025-03-14T06:49:52.9775234Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 35s local 2025-03-14T06:49:52.9775930Z Compiling torch_xla/csrc/ops/get_dimensions_size.cpp; 34s local 2025-03-14T06:49:52.9776639Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T06:49:52.9777261Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2025-03-14T06:49:52.9777882Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2025-03-14T06:49:52.9778524Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local ... 2025-03-14T06:49:53.1772334Z 2025-03-14T06:49:53.1773095Z  2025-03-14T06:49:53.1773768Z  2025-03-14T06:49:53.1774108Z  2025-03-14T06:49:53.1774439Z  2025-03-14T06:49:53.1774843Z  2025-03-14T06:49:53.1775170Z  2025-03-14T06:49:53.1775483Z  2025-03-14T06:49:53.1775804Z  2025-03-14T06:49:53.1776574Z [20,543 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:53.1777391Z Compiling torch_xla/csrc/tensor_util.cpp; 84s local 2025-03-14T06:49:53.1777998Z Compiling test/cpp/test_symint.cpp; 43s local 2025-03-14T06:49:53.1778668Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2025-03-14T06:49:53.1779399Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 32s local 2025-03-14T06:49:53.1780112Z Compiling torch_xla/csrc/ops/index_put.cpp; 31s local 2025-03-14T06:49:53.1780806Z Compiling torch_xla/csrc/ops/index_select.cpp; 30s local 2025-03-14T06:49:53.1781535Z Compiling torch_xla/csrc/ops/index_ops.cpp; 30s local 2025-03-14T06:49:53.1782255Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local ... 2025-03-14T06:49:53.9383679Z 2025-03-14T06:49:53.9384572Z  2025-03-14T06:49:53.9385061Z  2025-03-14T06:49:53.9385428Z  2025-03-14T06:49:53.9385823Z  2025-03-14T06:49:53.9386386Z  2025-03-14T06:49:53.9386801Z  2025-03-14T06:49:53.9387533Z  2025-03-14T06:49:53.9387952Z  2025-03-14T06:49:53.9388882Z [20,544 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:53.9390061Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2025-03-14T06:49:53.9390723Z Compiling test/cpp/test_symint.cpp; 44s local 2025-03-14T06:49:53.9391533Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 36s local 2025-03-14T06:49:53.9392370Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2025-03-14T06:49:53.9393218Z Compiling torch_xla/csrc/ops/index_put.cpp; 32s local 2025-03-14T06:49:53.9394026Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2025-03-14T06:49:53.9394776Z Compiling torch_xla/csrc/ops/kth_value.cpp; 30s local 2025-03-14T06:49:53.9395654Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 30s local ... 2025-03-14T06:49:54.1779343Z 2025-03-14T06:49:54.1780225Z  2025-03-14T06:49:54.1780696Z  2025-03-14T06:49:54.1781151Z  2025-03-14T06:49:54.1781543Z  2025-03-14T06:49:54.1781922Z  2025-03-14T06:49:54.1782310Z  2025-03-14T06:49:54.1782684Z  2025-03-14T06:49:54.1783051Z  2025-03-14T06:49:54.1783991Z [20,544 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:54.1785006Z Compiling torch_xla/csrc/tensor_util.cpp; 85s local 2025-03-14T06:49:54.1785729Z Compiling test/cpp/test_symint.cpp; 44s local 2025-03-14T06:49:54.1786472Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 37s local 2025-03-14T06:49:54.1787243Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 33s local 2025-03-14T06:49:54.1788021Z Compiling torch_xla/csrc/ops/index_put.cpp; 32s local 2025-03-14T06:49:54.1788803Z Compiling torch_xla/csrc/ops/index_ops.cpp; 31s local 2025-03-14T06:49:54.1789540Z Compiling torch_xla/csrc/ops/kth_value.cpp; 31s local 2025-03-14T06:49:54.1790425Z Compiling torch_xla/csrc/ops/linear_interpolation.cpp; 31s local ... 2025-03-14T06:49:54.7671720Z 2025-03-14T06:49:54.7672539Z  2025-03-14T06:49:54.7673036Z  2025-03-14T06:49:54.7673436Z  2025-03-14T06:49:54.7673783Z  2025-03-14T06:49:54.7674203Z  2025-03-14T06:49:54.7674564Z  2025-03-14T06:49:54.7674946Z  2025-03-14T06:49:54.7675347Z  2025-03-14T06:49:54.7676227Z [20,545 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:54.7677157Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T06:49:54.7677863Z Compiling test/cpp/test_symint.cpp; 44s local 2025-03-14T06:49:54.7678954Z Compiling torch_xla/csrc/ops/expand_symint.cpp; 37s local 2025-03-14T06:49:54.7679929Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2025-03-14T06:49:54.7680737Z Compiling torch_xla/csrc/ops/index_put.cpp; 33s local 2025-03-14T06:49:54.7681470Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T06:49:54.7682190Z Compiling torch_xla/csrc/ops/kth_value.cpp; 31s local 2025-03-14T06:49:54.7682936Z Compiling torch_xla/csrc/ops/linspace.cpp; 30s local ... 2025-03-14T06:49:54.9785027Z 2025-03-14T06:49:54.9785921Z  2025-03-14T06:49:54.9786375Z  2025-03-14T06:49:54.9786751Z  2025-03-14T06:49:54.9787128Z  2025-03-14T06:49:54.9787518Z  2025-03-14T06:49:54.9787903Z  2025-03-14T06:49:54.9788280Z  2025-03-14T06:49:54.9788675Z  2025-03-14T06:49:54.9789544Z [20,546 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:54.9790568Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T06:49:54.9791271Z Compiling test/cpp/test_symint.cpp; 45s local 2025-03-14T06:49:54.9791973Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2025-03-14T06:49:54.9792781Z Compiling torch_xla/csrc/ops/index_put.cpp; 33s local 2025-03-14T06:49:54.9793525Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T06:49:54.9794642Z Compiling torch_xla/csrc/ops/kth_value.cpp; 31s local 2025-03-14T06:49:54.9795345Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2025-03-14T06:49:54.9796346Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 30s local ... 2025-03-14T06:49:55.2335283Z 2025-03-14T06:49:55.2336172Z  2025-03-14T06:49:55.2336648Z  2025-03-14T06:49:55.2337053Z  2025-03-14T06:49:55.2337433Z  2025-03-14T06:49:55.2337800Z  2025-03-14T06:49:55.2338183Z  2025-03-14T06:49:55.2338586Z  2025-03-14T06:49:55.2338976Z  2025-03-14T06:49:55.2339917Z [20,547 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:55.2340912Z Compiling torch_xla/csrc/tensor_util.cpp; 86s local 2025-03-14T06:49:55.2341660Z Compiling test/cpp/test_symint.cpp; 45s local 2025-03-14T06:49:55.2342396Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 34s local 2025-03-14T06:49:55.2343167Z Compiling torch_xla/csrc/ops/index_ops.cpp; 32s local 2025-03-14T06:49:55.2343881Z Compiling torch_xla/csrc/ops/kth_value.cpp; 32s local 2025-03-14T06:49:55.2344676Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2025-03-14T06:49:55.2345554Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2025-03-14T06:49:55.2346459Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local ... 2025-03-14T06:49:55.5418608Z 2025-03-14T06:49:55.5419438Z  2025-03-14T06:49:55.5419969Z  2025-03-14T06:49:55.5420342Z  2025-03-14T06:49:55.5420732Z  2025-03-14T06:49:55.5421096Z  2025-03-14T06:49:55.5421512Z  2025-03-14T06:49:55.5421877Z  2025-03-14T06:49:55.5422243Z  2025-03-14T06:49:55.5423170Z [20,547 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:55.5424127Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2025-03-14T06:49:55.5424875Z Compiling test/cpp/test_symint.cpp; 45s local 2025-03-14T06:49:55.5425631Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2025-03-14T06:49:55.5426400Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T06:49:55.5427190Z Compiling torch_xla/csrc/ops/kth_value.cpp; 32s local 2025-03-14T06:49:55.5427914Z Compiling torch_xla/csrc/ops/linspace.cpp; 31s local 2025-03-14T06:49:55.5428699Z Compiling torch_xla/csrc/ops/log_softmax_backward.cpp; 31s local 2025-03-14T06:49:55.5429596Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 30s local ... 2025-03-14T06:49:55.7680415Z 2025-03-14T06:49:55.7681223Z  2025-03-14T06:49:55.7682033Z  2025-03-14T06:49:55.7682402Z  2025-03-14T06:49:55.7682761Z  2025-03-14T06:49:55.7683202Z  2025-03-14T06:49:55.7683548Z  2025-03-14T06:49:55.7683904Z  2025-03-14T06:49:55.7684224Z  2025-03-14T06:49:55.7685234Z [20,550 / 20,653] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2025-03-14T06:49:55.7686080Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2025-03-14T06:49:55.7686833Z Compiling test/cpp/test_symint.cpp; 45s local 2025-03-14T06:49:55.7687677Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2025-03-14T06:49:55.7688392Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T06:49:55.7689136Z Compiling torch_xla/csrc/ops/mark_tensor.cpp; 31s local 2025-03-14T06:49:55.7689918Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 31s local 2025-03-14T06:49:55.7690730Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 30s local 2025-03-14T06:49:55.7691531Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local ... 2025-03-14T06:49:56.1423413Z 2025-03-14T06:49:56.1424292Z  2025-03-14T06:49:56.1424760Z  2025-03-14T06:49:56.1425145Z  2025-03-14T06:49:56.1425529Z  2025-03-14T06:49:56.1425920Z  2025-03-14T06:49:56.1426297Z  2025-03-14T06:49:56.1426983Z  2025-03-14T06:49:56.1427377Z  2025-03-14T06:49:56.1428323Z [20,551 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:49:56.1429461Z Compiling torch_xla/csrc/tensor_util.cpp; 87s local 2025-03-14T06:49:56.1430187Z Compiling test/cpp/test_symint.cpp; 46s local 2025-03-14T06:49:56.1430951Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 35s local 2025-03-14T06:49:56.1431732Z Compiling torch_xla/csrc/ops/index_ops.cpp; 33s local 2025-03-14T06:49:56.1432528Z Compiling torch_xla/csrc/ops/masked_scatter.cpp; 31s local 2025-03-14T06:49:56.1433351Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2025-03-14T06:49:56.1434101Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 30s local 2025-03-14T06:49:56.1434926Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 28s local ... 2025-03-14T06:49:56.4893348Z 2025-03-14T06:49:56.4894204Z  2025-03-14T06:49:56.4894689Z  2025-03-14T06:49:56.4895081Z  2025-03-14T06:49:56.4895453Z  2025-03-14T06:49:56.4895831Z  2025-03-14T06:49:56.4896178Z  2025-03-14T06:49:56.4896523Z  2025-03-14T06:49:56.4896895Z  2025-03-14T06:49:56.4897956Z [20,552 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:56.4898894Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2025-03-14T06:49:56.4899662Z Compiling test/cpp/test_symint.cpp; 46s local 2025-03-14T06:49:56.4900646Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2025-03-14T06:49:56.4901509Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2025-03-14T06:49:56.4902299Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2025-03-14T06:49:56.4903163Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2025-03-14T06:49:56.4903971Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 28s local 2025-03-14T06:49:56.4904752Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 28s local ... 2025-03-14T06:49:56.7428498Z 2025-03-14T06:49:56.7429347Z  2025-03-14T06:49:56.7429834Z  2025-03-14T06:49:56.7430246Z  2025-03-14T06:49:56.7430620Z  2025-03-14T06:49:56.7431047Z  2025-03-14T06:49:56.7431450Z  2025-03-14T06:49:56.7431802Z  2025-03-14T06:49:56.7432157Z  2025-03-14T06:49:56.7433232Z [20,552 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:56.7434181Z Compiling torch_xla/csrc/tensor_util.cpp; 88s local 2025-03-14T06:49:56.7434914Z Compiling test/cpp/test_symint.cpp; 46s local 2025-03-14T06:49:56.7436045Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 36s local 2025-03-14T06:49:56.7437000Z Compiling torch_xla/csrc/ops/index_ops.cpp; 34s local 2025-03-14T06:49:56.7437803Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 31s local 2025-03-14T06:49:56.7438584Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 31s local 2025-03-14T06:49:56.7439422Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 29s local 2025-03-14T06:49:56.7440267Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 29s local ... 2025-03-14T06:49:57.7435457Z 2025-03-14T06:49:57.7436317Z  2025-03-14T06:49:57.7436772Z  2025-03-14T06:49:57.7437176Z  2025-03-14T06:49:57.7437578Z  2025-03-14T06:49:57.7437964Z  2025-03-14T06:49:57.7438322Z  2025-03-14T06:49:57.7438698Z  2025-03-14T06:49:57.7439064Z  2025-03-14T06:49:57.7439895Z [20,552 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:57.7440727Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2025-03-14T06:49:57.7441423Z Compiling test/cpp/test_symint.cpp; 47s local 2025-03-14T06:49:57.7442192Z Compiling torch_xla/csrc/ops/generic_slice.cpp; 37s local 2025-03-14T06:49:57.7443005Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2025-03-14T06:49:57.7443794Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2025-03-14T06:49:57.7445084Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2025-03-14T06:49:57.7445844Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2025-03-14T06:49:57.7446776Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local ... 2025-03-14T06:49:57.9662390Z 2025-03-14T06:49:57.9663231Z  2025-03-14T06:49:57.9663684Z  2025-03-14T06:49:57.9664079Z  2025-03-14T06:49:57.9664450Z  2025-03-14T06:49:57.9664826Z  2025-03-14T06:49:57.9665183Z  2025-03-14T06:49:57.9665845Z  2025-03-14T06:49:57.9666230Z  2025-03-14T06:49:57.9667162Z [20,553 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:57.9668109Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2025-03-14T06:49:57.9668818Z Compiling test/cpp/test_symint.cpp; 48s local 2025-03-14T06:49:57.9669584Z Compiling torch_xla/csrc/ops/index_ops.cpp; 35s local 2025-03-14T06:49:57.9670373Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 32s local 2025-03-14T06:49:57.9671124Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2025-03-14T06:49:57.9671922Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2025-03-14T06:49:57.9672754Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2025-03-14T06:49:57.9673645Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local ... 2025-03-14T06:49:58.3440595Z 2025-03-14T06:49:58.3441443Z  2025-03-14T06:49:58.3441909Z  2025-03-14T06:49:58.3442398Z  2025-03-14T06:49:58.3442767Z  2025-03-14T06:49:58.3443123Z  2025-03-14T06:49:58.3443540Z  2025-03-14T06:49:58.3443905Z  2025-03-14T06:49:58.3444290Z  2025-03-14T06:49:58.3445404Z [20,553 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:58.3446411Z Compiling torch_xla/csrc/tensor_util.cpp; 89s local 2025-03-14T06:49:58.3447118Z Compiling test/cpp/test_symint.cpp; 48s local 2025-03-14T06:49:58.3447783Z Compiling torch_xla/csrc/ops/index_ops.cpp; 36s local 2025-03-14T06:49:58.3448541Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 33s local 2025-03-14T06:49:58.3449319Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 32s local 2025-03-14T06:49:58.3450073Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 30s local 2025-03-14T06:49:58.3450863Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 30s local 2025-03-14T06:49:58.3451781Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 30s local ... 2025-03-14T06:49:59.3447919Z 2025-03-14T06:49:59.3448782Z  2025-03-14T06:49:59.3449570Z  2025-03-14T06:49:59.3450019Z  2025-03-14T06:49:59.3450424Z  2025-03-14T06:49:59.3450973Z  2025-03-14T06:49:59.3451347Z  2025-03-14T06:49:59.3451732Z  2025-03-14T06:49:59.3452167Z  2025-03-14T06:49:59.3453051Z [20,553 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:49:59.3454073Z Compiling torch_xla/csrc/tensor_util.cpp; 90s local 2025-03-14T06:49:59.3454805Z Compiling test/cpp/test_symint.cpp; 49s local 2025-03-14T06:49:59.3455514Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2025-03-14T06:49:59.3456230Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T06:49:59.3457028Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 33s local 2025-03-14T06:49:59.3457720Z Compiling torch_xla/csrc/ops/max_in_dim.cpp; 31s local 2025-03-14T06:49:59.3458426Z Compiling torch_xla/csrc/ops/max_pool_nd.cpp; 31s local 2025-03-14T06:49:59.3459237Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 31s local ... 2025-03-14T06:49:59.5595239Z 2025-03-14T06:49:59.5596134Z  2025-03-14T06:49:59.5596627Z  2025-03-14T06:49:59.5597012Z  2025-03-14T06:49:59.5597397Z  2025-03-14T06:49:59.5597795Z  2025-03-14T06:49:59.5598185Z  2025-03-14T06:49:59.5598850Z  2025-03-14T06:49:59.5599233Z  2025-03-14T06:49:59.5600142Z [20,555 / 20,653] 6 / 17 tests; 48 actions, 46 running; last test: ...ent_test 2025-03-14T06:49:59.5601242Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2025-03-14T06:49:59.5601935Z Compiling test/cpp/test_symint.cpp; 49s local 2025-03-14T06:49:59.5602659Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2025-03-14T06:49:59.5603404Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T06:49:59.5604229Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2025-03-14T06:49:59.5605300Z Compiling torch_xla/csrc/ops/max_pool_nd_backward.cpp; 31s local 2025-03-14T06:49:59.5606203Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local 2025-03-14T06:49:59.5607084Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 28s local ... 2025-03-14T06:49:59.8597939Z 2025-03-14T06:49:59.8598794Z  2025-03-14T06:49:59.8599275Z  2025-03-14T06:49:59.8599715Z  2025-03-14T06:49:59.8600129Z  2025-03-14T06:49:59.8600522Z  2025-03-14T06:49:59.8600898Z  2025-03-14T06:49:59.8601291Z  2025-03-14T06:49:59.8601694Z  2025-03-14T06:49:59.8602577Z [20,556 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:49:59.8603502Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2025-03-14T06:49:59.8604274Z Compiling test/cpp/test_symint.cpp; 49s local 2025-03-14T06:49:59.8605141Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2025-03-14T06:49:59.8605888Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 34s local 2025-03-14T06:49:59.8606680Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2025-03-14T06:49:59.8607514Z Compiling torch_xla/csrc/ops/masked_select.cpp; 29s local 2025-03-14T06:49:59.8608330Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 29s local 2025-03-14T06:49:59.8609163Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 28s local ... 2025-03-14T06:50:00.1454806Z 2025-03-14T06:50:00.1455682Z  2025-03-14T06:50:00.1456165Z  2025-03-14T06:50:00.1456590Z  2025-03-14T06:50:00.1456978Z  2025-03-14T06:50:00.1457450Z  2025-03-14T06:50:00.1457836Z  2025-03-14T06:50:00.1458212Z  2025-03-14T06:50:00.1458650Z  2025-03-14T06:50:00.1459603Z [20,556 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:00.1460631Z Compiling torch_xla/csrc/tensor_util.cpp; 91s local 2025-03-14T06:50:00.1461401Z Compiling test/cpp/test_symint.cpp; 50s local 2025-03-14T06:50:00.1462457Z Compiling torch_xla/csrc/ops/index_ops.cpp; 37s local 2025-03-14T06:50:00.1463347Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 35s local 2025-03-14T06:50:00.1464197Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 34s local 2025-03-14T06:50:00.1465022Z Compiling torch_xla/csrc/ops/masked_select.cpp; 30s local 2025-03-14T06:50:00.1466154Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 29s local 2025-03-14T06:50:00.1466880Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 28s local ... 2025-03-14T06:50:01.3462506Z 2025-03-14T06:50:01.3463402Z  2025-03-14T06:50:01.3463814Z  2025-03-14T06:50:01.3464148Z  2025-03-14T06:50:01.3464480Z  2025-03-14T06:50:01.3464807Z  2025-03-14T06:50:01.3465173Z  2025-03-14T06:50:01.3471243Z  2025-03-14T06:50:01.3471600Z  2025-03-14T06:50:01.3472383Z [20,556 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:01.3473227Z Compiling torch_xla/csrc/tensor_util.cpp; 92s local 2025-03-14T06:50:01.3473838Z Compiling test/cpp/test_symint.cpp; 51s local 2025-03-14T06:50:01.3474463Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2025-03-14T06:50:01.3475115Z Compiling torch_xla/csrc/ops/logsumexp.cpp; 36s local 2025-03-14T06:50:01.3475780Z Compiling torch_xla/csrc/ops/log_softmax.cpp; 35s local 2025-03-14T06:50:01.3476805Z Compiling torch_xla/csrc/ops/masked_select.cpp; 31s local 2025-03-14T06:50:01.3477489Z Compiling torch_xla/csrc/ops/min_in_dim.cpp; 30s local 2025-03-14T06:50:01.3478292Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 29s local ... 2025-03-14T06:50:02.2220791Z 2025-03-14T06:50:02.2221598Z  2025-03-14T06:50:02.2222097Z  2025-03-14T06:50:02.2222513Z  2025-03-14T06:50:02.2222917Z  2025-03-14T06:50:02.2223305Z  2025-03-14T06:50:02.2223703Z  2025-03-14T06:50:02.2224079Z  2025-03-14T06:50:02.2224459Z  2025-03-14T06:50:02.2225421Z [20,559 / 20,653] 6 / 17 tests; 46 actions, 45 running; last test: ...ent_test 2025-03-14T06:50:02.2226450Z Compiling torch_xla/csrc/tensor_util.cpp; 93s local 2025-03-14T06:50:02.2227193Z Compiling test/cpp/test_symint.cpp; 52s local 2025-03-14T06:50:02.2227986Z Compiling torch_xla/csrc/ops/index_ops.cpp; 39s local 2025-03-14T06:50:02.2228849Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2025-03-14T06:50:02.2229752Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 30s local 2025-03-14T06:50:02.2230588Z Compiling torch_xla/csrc/ops/mean.cpp; 30s local 2025-03-14T06:50:02.2231388Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2025-03-14T06:50:02.2232244Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local ... 2025-03-14T06:50:02.5471564Z 2025-03-14T06:50:02.5472441Z  2025-03-14T06:50:02.5472949Z  2025-03-14T06:50:02.5473336Z  2025-03-14T06:50:02.5473675Z  2025-03-14T06:50:02.5474053Z  2025-03-14T06:50:02.5474441Z  2025-03-14T06:50:02.5474829Z  2025-03-14T06:50:02.5475212Z  2025-03-14T06:50:02.5476183Z [20,559 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:02.5477198Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2025-03-14T06:50:02.5477963Z Compiling test/cpp/test_symint.cpp; 52s local 2025-03-14T06:50:02.5478744Z Compiling torch_xla/csrc/ops/index_ops.cpp; 40s local 2025-03-14T06:50:02.5479591Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2025-03-14T06:50:02.5480337Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2025-03-14T06:50:02.5481030Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2025-03-14T06:50:02.5481820Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 30s local 2025-03-14T06:50:02.5482711Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local ... 2025-03-14T06:50:02.7474726Z 2025-03-14T06:50:02.7475531Z  2025-03-14T06:50:02.7476241Z  2025-03-14T06:50:02.7476611Z  2025-03-14T06:50:02.7476958Z  2025-03-14T06:50:02.7477396Z  2025-03-14T06:50:02.7477743Z  2025-03-14T06:50:02.7478092Z  2025-03-14T06:50:02.7478435Z  2025-03-14T06:50:02.7479256Z [20,560 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:50:02.7480120Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2025-03-14T06:50:02.7480731Z Compiling test/cpp/test_symint.cpp; 52s local 2025-03-14T06:50:02.7481399Z Compiling torch_xla/csrc/ops/masked_select.cpp; 32s local 2025-03-14T06:50:02.7482092Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2025-03-14T06:50:02.7482757Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2025-03-14T06:50:02.7483382Z Compiling torch_xla/csrc/ops/mse_loss.cpp; 31s local 2025-03-14T06:50:02.7484070Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 30s local 2025-03-14T06:50:02.7484978Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local ... 2025-03-14T06:50:03.1478626Z 2025-03-14T06:50:03.1479539Z  2025-03-14T06:50:03.1480052Z  2025-03-14T06:50:03.1480470Z  2025-03-14T06:50:03.1480846Z  2025-03-14T06:50:03.1481240Z  2025-03-14T06:50:03.1481632Z  2025-03-14T06:50:03.1482269Z  2025-03-14T06:50:03.1482659Z  2025-03-14T06:50:03.1483617Z [20,561 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:03.1484756Z Compiling torch_xla/csrc/tensor_util.cpp; 94s local 2025-03-14T06:50:03.1485639Z Compiling test/cpp/test_symint.cpp; 53s local 2025-03-14T06:50:03.1486442Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2025-03-14T06:50:03.1487298Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 31s local 2025-03-14T06:50:03.1488098Z Compiling torch_xla/csrc/ops/mean.cpp; 31s local 2025-03-14T06:50:03.1488915Z Compiling torch_xla/csrc/ops/mse_loss_backward.cpp; 31s local 2025-03-14T06:50:03.1489767Z Compiling torch_xla/csrc/ops/multinomial.cpp; 29s local 2025-03-14T06:50:03.1490655Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 28s local ... 2025-03-14T06:50:04.0006204Z 2025-03-14T06:50:04.0007029Z  2025-03-14T06:50:04.0007444Z  2025-03-14T06:50:04.0007808Z  2025-03-14T06:50:04.0008135Z  2025-03-14T06:50:04.0008472Z  2025-03-14T06:50:04.0008811Z  2025-03-14T06:50:04.0009148Z  2025-03-14T06:50:04.0009481Z  2025-03-14T06:50:04.0010305Z [20,562 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:04.0011161Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2025-03-14T06:50:04.0011796Z Compiling test/cpp/test_symint.cpp; 54s local 2025-03-14T06:50:04.0012467Z Compiling torch_xla/csrc/ops/masked_select.cpp; 33s local 2025-03-14T06:50:04.0013249Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2025-03-14T06:50:04.0013956Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2025-03-14T06:50:04.0014686Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T06:50:04.0015470Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 29s local 2025-03-14T06:50:04.0016502Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 28s local ... 2025-03-14T06:50:04.3487105Z 2025-03-14T06:50:04.3487969Z  2025-03-14T06:50:04.3488417Z  2025-03-14T06:50:04.3488746Z  2025-03-14T06:50:04.3489094Z  2025-03-14T06:50:04.3489451Z  2025-03-14T06:50:04.3489815Z  2025-03-14T06:50:04.3490172Z  2025-03-14T06:50:04.3490526Z  2025-03-14T06:50:04.3491399Z [20,562 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:04.3492315Z Compiling torch_xla/csrc/tensor_util.cpp; 95s local 2025-03-14T06:50:04.3492994Z Compiling test/cpp/test_symint.cpp; 54s local 2025-03-14T06:50:04.3494047Z Compiling torch_xla/csrc/ops/masked_select.cpp; 34s local 2025-03-14T06:50:04.3494952Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 32s local 2025-03-14T06:50:04.3495690Z Compiling torch_xla/csrc/ops/mean.cpp; 32s local 2025-03-14T06:50:04.3496421Z Compiling torch_xla/csrc/ops/multinomial.cpp; 30s local 2025-03-14T06:50:04.3497228Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 30s local 2025-03-14T06:50:04.3498170Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 28s local ... 2025-03-14T06:50:05.3397692Z 2025-03-14T06:50:05.3398545Z  2025-03-14T06:50:05.3399029Z  2025-03-14T06:50:05.3399445Z  2025-03-14T06:50:05.3399845Z  2025-03-14T06:50:05.3400228Z  2025-03-14T06:50:05.3400627Z  2025-03-14T06:50:05.3401021Z  2025-03-14T06:50:05.3401413Z  2025-03-14T06:50:05.3402328Z [20,564 / 20,653] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2025-03-14T06:50:05.3403305Z Compiling torch_xla/csrc/tensor_util.cpp; 96s local 2025-03-14T06:50:05.3404129Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 33s local 2025-03-14T06:50:05.3405084Z Compiling torch_xla/csrc/ops/mean.cpp; 33s local 2025-03-14T06:50:05.3405851Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2025-03-14T06:50:05.3407110Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 31s local 2025-03-14T06:50:05.3408024Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local 2025-03-14T06:50:05.3409143Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 29s local 2025-03-14T06:50:05.3410234Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 26s local ... 2025-03-14T06:50:05.5495110Z 2025-03-14T06:50:05.5495910Z  2025-03-14T06:50:05.5496407Z  2025-03-14T06:50:05.5496765Z  2025-03-14T06:50:05.5497139Z  2025-03-14T06:50:05.5497505Z  2025-03-14T06:50:05.5497879Z  2025-03-14T06:50:05.5498262Z  2025-03-14T06:50:05.5498646Z  2025-03-14T06:50:05.5499898Z [20,564 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:05.5500908Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T06:50:05.5501631Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T06:50:05.5502471Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T06:50:05.5503196Z Compiling torch_xla/csrc/ops/multinomial.cpp; 31s local 2025-03-14T06:50:05.5504068Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 31s local 2025-03-14T06:50:05.5505048Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local 2025-03-14T06:50:05.5506072Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 29s local 2025-03-14T06:50:05.5507058Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 26s local ... 2025-03-14T06:50:05.7837213Z 2025-03-14T06:50:05.7838076Z  2025-03-14T06:50:05.7838547Z  2025-03-14T06:50:05.7838959Z  2025-03-14T06:50:05.7839391Z  2025-03-14T06:50:05.7839800Z  2025-03-14T06:50:05.7840216Z  2025-03-14T06:50:05.7840630Z  2025-03-14T06:50:05.7840997Z  2025-03-14T06:50:05.7841884Z [20,565 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:05.7842879Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T06:50:05.7843692Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T06:50:05.7844675Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T06:50:05.7845504Z Compiling torch_xla/csrc/ops/upsample_nearest2d.cpp; 31s local 2025-03-14T06:50:05.7846480Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 29s local 2025-03-14T06:50:05.7847509Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 29s local 2025-03-14T06:50:05.7848468Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 26s local 2025-03-14T06:50:05.7849681Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 25s local ... 2025-03-14T06:50:06.0049027Z 2025-03-14T06:50:06.0050235Z  2025-03-14T06:50:06.0050808Z  2025-03-14T06:50:06.0051241Z  2025-03-14T06:50:06.0051632Z  2025-03-14T06:50:06.0052030Z  2025-03-14T06:50:06.0052414Z  2025-03-14T06:50:06.0052822Z  2025-03-14T06:50:06.0053234Z  2025-03-14T06:50:06.0054171Z [20,566 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:06.0055199Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T06:50:06.0056024Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T06:50:06.0056814Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T06:50:06.0057711Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2025-03-14T06:50:06.0058756Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 29s local 2025-03-14T06:50:06.0059776Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 26s local 2025-03-14T06:50:06.0060650Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 25s local 2025-03-14T06:50:06.0061503Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 24s local ... 2025-03-14T06:50:06.3500985Z 2025-03-14T06:50:06.3501796Z  2025-03-14T06:50:06.3502518Z  2025-03-14T06:50:06.3502919Z  2025-03-14T06:50:06.3503327Z  2025-03-14T06:50:06.3503735Z  2025-03-14T06:50:06.3504127Z  2025-03-14T06:50:06.3504499Z  2025-03-14T06:50:06.3504983Z  2025-03-14T06:50:06.3505843Z [20,566 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:06.3506774Z Compiling torch_xla/csrc/tensor_util.cpp; 97s local 2025-03-14T06:50:06.3507582Z Compiling torch_xla/csrc/ops/max_unpool_nd.cpp; 34s local 2025-03-14T06:50:06.3508287Z Compiling torch_xla/csrc/ops/mean.cpp; 34s local 2025-03-14T06:50:06.3509137Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2025-03-14T06:50:06.3510102Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2025-03-14T06:50:06.3511011Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 27s local 2025-03-14T06:50:06.3511760Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 26s local 2025-03-14T06:50:06.3512470Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 24s local ... 2025-03-14T06:50:06.5506190Z 2025-03-14T06:50:06.5507039Z  2025-03-14T06:50:06.5507533Z  2025-03-14T06:50:06.5507951Z  2025-03-14T06:50:06.5508335Z  2025-03-14T06:50:06.5508721Z  2025-03-14T06:50:06.5509118Z  2025-03-14T06:50:06.5509495Z  2025-03-14T06:50:06.5509872Z  2025-03-14T06:50:06.5510761Z [20,567 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:06.5511762Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T06:50:06.5512532Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2025-03-14T06:50:06.5513373Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 30s local 2025-03-14T06:50:06.5514402Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 30s local 2025-03-14T06:50:06.5515355Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 27s local 2025-03-14T06:50:06.5516182Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 26s local 2025-03-14T06:50:06.5516958Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 24s local 2025-03-14T06:50:06.5517798Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 22s local ... 2025-03-14T06:50:07.3123460Z 2025-03-14T06:50:07.3124292Z  2025-03-14T06:50:07.3124965Z  2025-03-14T06:50:07.3125367Z  2025-03-14T06:50:07.3125762Z  2025-03-14T06:50:07.3126157Z  2025-03-14T06:50:07.3126553Z  2025-03-14T06:50:07.3126951Z  2025-03-14T06:50:07.3127348Z  2025-03-14T06:50:07.3128800Z [20,568 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:07.3129874Z Compiling torch_xla/csrc/tensor_util.cpp; 98s local 2025-03-14T06:50:07.3130588Z Compiling torch_xla/csrc/ops/mean.cpp; 35s local 2025-03-14T06:50:07.3131463Z Compiling torch_xla/csrc/ops/native_batch_norm_backward.cpp; 31s local 2025-03-14T06:50:07.3132495Z Compiling torch_xla/csrc/ops/native_batch_norm_forward.cpp; 31s local 2025-03-14T06:50:07.3133432Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 28s local 2025-03-14T06:50:07.3134261Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 27s local 2025-03-14T06:50:07.3135033Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 25s local 2025-03-14T06:50:07.3135917Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 23s local ... 2025-03-14T06:50:07.5380517Z 2025-03-14T06:50:07.5381625Z  2025-03-14T06:50:07.5382150Z  2025-03-14T06:50:07.5382640Z  2025-03-14T06:50:07.5383008Z  2025-03-14T06:50:07.5383374Z  2025-03-14T06:50:07.5383780Z  2025-03-14T06:50:07.5384155Z  2025-03-14T06:50:07.5384498Z  2025-03-14T06:50:07.5385582Z [20,570 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:07.5386531Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2025-03-14T06:50:07.5387647Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2025-03-14T06:50:07.5388460Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 28s local 2025-03-14T06:50:07.5389252Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 27s local 2025-03-14T06:50:07.5390138Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 25s local 2025-03-14T06:50:07.5391155Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 23s local 2025-03-14T06:50:07.5392023Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 23s local 2025-03-14T06:50:07.5392828Z Compiling torch_xla/csrc/ops/nms.cpp; 23s local ... 2025-03-14T06:50:07.7514657Z 2025-03-14T06:50:07.7515516Z  2025-03-14T06:50:07.7515992Z  2025-03-14T06:50:07.7516361Z  2025-03-14T06:50:07.7516747Z  2025-03-14T06:50:07.7517152Z  2025-03-14T06:50:07.7517614Z  2025-03-14T06:50:07.7518004Z  2025-03-14T06:50:07.7518405Z  2025-03-14T06:50:07.7519349Z [20,570 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:07.7520391Z Compiling torch_xla/csrc/tensor_util.cpp; 99s local 2025-03-14T06:50:07.7521143Z Compiling torch_xla/csrc/ops/mean.cpp; 36s local 2025-03-14T06:50:07.7521992Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 28s local 2025-03-14T06:50:07.7522839Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 27s local 2025-03-14T06:50:07.7523662Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 25s local 2025-03-14T06:50:07.7524701Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 23s local 2025-03-14T06:50:07.7525657Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 23s local 2025-03-14T06:50:07.7526533Z Compiling torch_xla/csrc/ops/nms.cpp; 23s local ... 2025-03-14T06:50:08.7523299Z 2025-03-14T06:50:08.7524176Z  2025-03-14T06:50:08.7524861Z  2025-03-14T06:50:08.7525271Z  2025-03-14T06:50:08.7525674Z  2025-03-14T06:50:08.7526076Z  2025-03-14T06:50:08.7526488Z  2025-03-14T06:50:08.7526901Z  2025-03-14T06:50:08.7527317Z  2025-03-14T06:50:08.7528242Z [20,570 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:08.7529229Z Compiling torch_xla/csrc/tensor_util.cpp; 100s local 2025-03-14T06:50:08.7529951Z Compiling torch_xla/csrc/ops/mean.cpp; 37s local 2025-03-14T06:50:08.7530789Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 29s local 2025-03-14T06:50:08.7531619Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 28s local 2025-03-14T06:50:08.7532409Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 26s local 2025-03-14T06:50:08.7533606Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 24s local 2025-03-14T06:50:08.7534674Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 24s local 2025-03-14T06:50:08.7535526Z Compiling torch_xla/csrc/ops/nms.cpp; 24s local ... 2025-03-14T06:50:09.3528689Z 2025-03-14T06:50:09.3529538Z  2025-03-14T06:50:09.3530012Z  2025-03-14T06:50:09.3530377Z  2025-03-14T06:50:09.3530731Z  2025-03-14T06:50:09.3531091Z  2025-03-14T06:50:09.3531452Z  2025-03-14T06:50:09.3531816Z  2025-03-14T06:50:09.3532200Z  2025-03-14T06:50:09.3533108Z [20,571 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:50:09.3534046Z Compiling torch_xla/csrc/tensor_util.cpp; 100s local 2025-03-14T06:50:09.3534801Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2025-03-14T06:50:09.3535565Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2025-03-14T06:50:09.3536320Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 27s local 2025-03-14T06:50:09.3537142Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 25s local 2025-03-14T06:50:09.3537997Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 24s local 2025-03-14T06:50:09.3538757Z Compiling torch_xla/csrc/ops/nms.cpp; 24s local 2025-03-14T06:50:09.3539798Z Compiling torch_xla/csrc/ops/normal.cpp; 23s local ... 2025-03-14T06:50:09.5531927Z 2025-03-14T06:50:09.5532759Z  2025-03-14T06:50:09.5533167Z  2025-03-14T06:50:09.5533516Z  2025-03-14T06:50:09.5534132Z  2025-03-14T06:50:09.5534484Z  2025-03-14T06:50:09.5534820Z  2025-03-14T06:50:09.5535163Z  2025-03-14T06:50:09.5535502Z  2025-03-14T06:50:09.5536303Z [20,571 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:09.5537188Z Compiling torch_xla/csrc/tensor_util.cpp; 101s local 2025-03-14T06:50:09.5537942Z Compiling torch_xla/csrc/ops/native_dropout.cpp; 30s local 2025-03-14T06:50:09.5538654Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 29s local 2025-03-14T06:50:09.5539353Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 27s local 2025-03-14T06:50:09.5540119Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 25s local 2025-03-14T06:50:09.5540924Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 25s local 2025-03-14T06:50:09.5541642Z Compiling torch_xla/csrc/ops/nms.cpp; 25s local 2025-03-14T06:50:09.5542316Z Compiling torch_xla/csrc/ops/normal.cpp; 24s local ... 2025-03-14T06:50:10.7540868Z 2025-03-14T06:50:10.7541660Z  2025-03-14T06:50:10.7542041Z  2025-03-14T06:50:10.7542354Z  2025-03-14T06:50:10.7542660Z  2025-03-14T06:50:10.7542944Z  2025-03-14T06:50:10.7543251Z  2025-03-14T06:50:10.7543553Z  2025-03-14T06:50:10.7543851Z  2025-03-14T06:50:10.7544718Z [20,572 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:50:10.7545690Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2025-03-14T06:50:10.7546651Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T06:50:10.7547441Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 28s local 2025-03-14T06:50:10.7548293Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 26s local 2025-03-14T06:50:10.7549177Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local 2025-03-14T06:50:10.7550000Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local 2025-03-14T06:50:10.7550719Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local 2025-03-14T06:50:10.7551519Z Compiling torch_xla/csrc/ops/not_supported.cpp; 24s local ... 2025-03-14T06:50:10.9543803Z 2025-03-14T06:50:10.9544693Z  2025-03-14T06:50:10.9545172Z  2025-03-14T06:50:10.9545550Z  2025-03-14T06:50:10.9545943Z  2025-03-14T06:50:10.9546338Z  2025-03-14T06:50:10.9546735Z  2025-03-14T06:50:10.9547124Z  2025-03-14T06:50:10.9547808Z  2025-03-14T06:50:10.9548892Z [20,572 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:10.9549887Z Compiling torch_xla/csrc/tensor_util.cpp; 102s local 2025-03-14T06:50:10.9550669Z Compiling torch_xla/csrc/ops/nll_loss.cpp; 30s local 2025-03-14T06:50:10.9551449Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 29s local 2025-03-14T06:50:10.9552472Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 26s local 2025-03-14T06:50:10.9553429Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 26s local 2025-03-14T06:50:10.9554274Z Compiling torch_xla/csrc/ops/nms.cpp; 26s local 2025-03-14T06:50:10.9555019Z Compiling torch_xla/csrc/ops/normal.cpp; 25s local 2025-03-14T06:50:10.9555848Z Compiling torch_xla/csrc/ops/not_supported.cpp; 25s local ... 2025-03-14T06:50:12.1199599Z 2025-03-14T06:50:12.1200444Z  2025-03-14T06:50:12.1200928Z  2025-03-14T06:50:12.1201335Z  2025-03-14T06:50:12.1201749Z  2025-03-14T06:50:12.1202157Z  2025-03-14T06:50:12.1202558Z  2025-03-14T06:50:12.1202977Z  2025-03-14T06:50:12.1203378Z  2025-03-14T06:50:12.1204328Z [20,573 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:12.1205897Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2025-03-14T06:50:12.1206712Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2025-03-14T06:50:12.1207537Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 27s local 2025-03-14T06:50:12.1208661Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local 2025-03-14T06:50:12.1209457Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2025-03-14T06:50:12.1210174Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2025-03-14T06:50:12.1210983Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2025-03-14T06:50:12.1211835Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local ... 2025-03-14T06:50:12.3553688Z 2025-03-14T06:50:12.3554503Z  2025-03-14T06:50:12.3554984Z  2025-03-14T06:50:12.3555396Z  2025-03-14T06:50:12.3555805Z  2025-03-14T06:50:12.3556212Z  2025-03-14T06:50:12.3556609Z  2025-03-14T06:50:12.3557007Z  2025-03-14T06:50:12.3557380Z  2025-03-14T06:50:12.3558375Z [20,573 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:12.3559379Z Compiling torch_xla/csrc/tensor_util.cpp; 103s local 2025-03-14T06:50:12.3560186Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 30s local 2025-03-14T06:50:12.3561061Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 28s local 2025-03-14T06:50:12.3562013Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 27s local 2025-03-14T06:50:12.3562834Z Compiling torch_xla/csrc/ops/nms.cpp; 27s local 2025-03-14T06:50:12.3563577Z Compiling torch_xla/csrc/ops/normal.cpp; 26s local 2025-03-14T06:50:12.3564418Z Compiling torch_xla/csrc/ops/not_supported.cpp; 26s local 2025-03-14T06:50:12.3565697Z Compiling torch_xla/csrc/ops/nonzero.cpp; 25s local ... 2025-03-14T06:50:13.5562964Z 2025-03-14T06:50:13.5563752Z  2025-03-14T06:50:13.5564235Z  2025-03-14T06:50:13.5564813Z  2025-03-14T06:50:13.5565184Z  2025-03-14T06:50:13.5565811Z  2025-03-14T06:50:13.5566189Z  2025-03-14T06:50:13.5566594Z  2025-03-14T06:50:13.5566957Z  2025-03-14T06:50:13.5567873Z [20,573 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:13.5568895Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T06:50:13.5569680Z Compiling torch_xla/csrc/ops/nll_loss2d.cpp; 31s local 2025-03-14T06:50:13.5570547Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2025-03-14T06:50:13.5571444Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2025-03-14T06:50:13.5572874Z Compiling torch_xla/csrc/ops/nms.cpp; 29s local 2025-03-14T06:50:13.5573724Z Compiling torch_xla/csrc/ops/normal.cpp; 28s local 2025-03-14T06:50:13.5574531Z Compiling torch_xla/csrc/ops/not_supported.cpp; 27s local 2025-03-14T06:50:13.5575276Z Compiling torch_xla/csrc/ops/nonzero.cpp; 26s local ... 2025-03-14T06:50:13.9027674Z 2025-03-14T06:50:13.9028545Z  2025-03-14T06:50:13.9029047Z  2025-03-14T06:50:13.9029477Z  2025-03-14T06:50:13.9029893Z  2025-03-14T06:50:13.9030278Z  2025-03-14T06:50:13.9030631Z  2025-03-14T06:50:13.9031044Z  2025-03-14T06:50:13.9031415Z  2025-03-14T06:50:13.9032163Z [20,574 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:13.9032900Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T06:50:13.9033552Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2025-03-14T06:50:13.9034398Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2025-03-14T06:50:13.9035339Z Compiling torch_xla/csrc/ops/nms.cpp; 29s local 2025-03-14T06:50:13.9036065Z Compiling torch_xla/csrc/ops/normal.cpp; 28s local 2025-03-14T06:50:13.9036919Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local 2025-03-14T06:50:13.9037740Z Compiling torch_xla/csrc/ops/nonzero.cpp; 27s local 2025-03-14T06:50:13.9038913Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local ... 2025-03-14T06:50:14.1568456Z 2025-03-14T06:50:14.1569245Z  2025-03-14T06:50:14.1569666Z  2025-03-14T06:50:14.1570315Z  2025-03-14T06:50:14.1570673Z  2025-03-14T06:50:14.1571019Z  2025-03-14T06:50:14.1571378Z  2025-03-14T06:50:14.1571736Z  2025-03-14T06:50:14.1572072Z  2025-03-14T06:50:14.1572905Z [20,574 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:14.1573784Z Compiling torch_xla/csrc/tensor_util.cpp; 105s local 2025-03-14T06:50:14.1574545Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 29s local 2025-03-14T06:50:14.1575367Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 29s local 2025-03-14T06:50:14.1576071Z Compiling torch_xla/csrc/ops/nms.cpp; 29s local 2025-03-14T06:50:14.1576709Z Compiling torch_xla/csrc/ops/normal.cpp; 28s local 2025-03-14T06:50:14.1577449Z Compiling torch_xla/csrc/ops/not_supported.cpp; 28s local 2025-03-14T06:50:14.1578169Z Compiling torch_xla/csrc/ops/nonzero.cpp; 27s local 2025-03-14T06:50:14.1578902Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 25s local ... 2025-03-14T06:50:15.1576261Z 2025-03-14T06:50:15.1577238Z  2025-03-14T06:50:15.1577626Z  2025-03-14T06:50:15.1577948Z  2025-03-14T06:50:15.1578266Z  2025-03-14T06:50:15.1578567Z  2025-03-14T06:50:15.1578884Z  2025-03-14T06:50:15.1579194Z  2025-03-14T06:50:15.1579503Z  2025-03-14T06:50:15.1580292Z [20,574 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:15.1581077Z Compiling torch_xla/csrc/tensor_util.cpp; 106s local 2025-03-14T06:50:15.1581742Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 30s local 2025-03-14T06:50:15.1582460Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 30s local 2025-03-14T06:50:15.1583100Z Compiling torch_xla/csrc/ops/nms.cpp; 30s local 2025-03-14T06:50:15.1583665Z Compiling torch_xla/csrc/ops/normal.cpp; 29s local 2025-03-14T06:50:15.1584288Z Compiling torch_xla/csrc/ops/not_supported.cpp; 29s local 2025-03-14T06:50:15.1584927Z Compiling torch_xla/csrc/ops/nonzero.cpp; 28s local 2025-03-14T06:50:15.1585555Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 26s local ... 2025-03-14T06:50:15.9583062Z 2025-03-14T06:50:15.9583940Z  2025-03-14T06:50:15.9584424Z  2025-03-14T06:50:15.9584822Z  2025-03-14T06:50:15.9585223Z  2025-03-14T06:50:15.9585594Z  2025-03-14T06:50:15.9585963Z  2025-03-14T06:50:15.9586745Z  2025-03-14T06:50:15.9587320Z  2025-03-14T06:50:15.9588356Z [20,575 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:50:15.9589335Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2025-03-14T06:50:15.9590204Z Compiling torch_xla/csrc/ops/nll_loss2d_backward.cpp; 31s local 2025-03-14T06:50:15.9591054Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2025-03-14T06:50:15.9591827Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2025-03-14T06:50:15.9592639Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2025-03-14T06:50:15.9593437Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2025-03-14T06:50:15.9594196Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 27s local 2025-03-14T06:50:15.9595096Z Compiling torch_xla/csrc/ops/ops.cpp; 27s local ... 2025-03-14T06:50:16.3305218Z 2025-03-14T06:50:16.3306061Z  2025-03-14T06:50:16.3306755Z  2025-03-14T06:50:16.3307158Z  2025-03-14T06:50:16.3307562Z  2025-03-14T06:50:16.3307975Z  2025-03-14T06:50:16.3308359Z  2025-03-14T06:50:16.3308667Z  2025-03-14T06:50:16.3309048Z  2025-03-14T06:50:16.3309974Z [20,576 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:16.3311281Z Compiling torch_xla/csrc/tensor_util.cpp; 107s local 2025-03-14T06:50:16.3312158Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 31s local 2025-03-14T06:50:16.3313149Z Compiling torch_xla/csrc/ops/normal.cpp; 30s local 2025-03-14T06:50:16.3313994Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2025-03-14T06:50:16.3314883Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2025-03-14T06:50:16.3315823Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 27s local 2025-03-14T06:50:16.3316652Z Compiling torch_xla/csrc/ops/ops.cpp; 27s local 2025-03-14T06:50:16.3317588Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local ... 2025-03-14T06:50:16.5588139Z 2025-03-14T06:50:16.5589037Z  2025-03-14T06:50:16.5589517Z  2025-03-14T06:50:16.5589909Z  2025-03-14T06:50:16.5590305Z  2025-03-14T06:50:16.5590729Z  2025-03-14T06:50:16.5591113Z  2025-03-14T06:50:16.5591556Z  2025-03-14T06:50:16.5591917Z  2025-03-14T06:50:16.5592761Z [20,576 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:16.5593741Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2025-03-14T06:50:16.5594600Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 32s local 2025-03-14T06:50:16.5595338Z Compiling torch_xla/csrc/ops/normal.cpp; 31s local 2025-03-14T06:50:16.5596132Z Compiling torch_xla/csrc/ops/not_supported.cpp; 30s local 2025-03-14T06:50:16.5596844Z Compiling torch_xla/csrc/ops/nonzero.cpp; 29s local 2025-03-14T06:50:16.5597628Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2025-03-14T06:50:16.5598334Z Compiling torch_xla/csrc/ops/ops.cpp; 27s local 2025-03-14T06:50:16.5599277Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local ... 2025-03-14T06:50:16.8327422Z 2025-03-14T06:50:16.8328250Z  2025-03-14T06:50:16.8328628Z  2025-03-14T06:50:16.8328964Z  2025-03-14T06:50:16.8329263Z  2025-03-14T06:50:16.8329561Z  2025-03-14T06:50:16.8329852Z  2025-03-14T06:50:16.8330204Z  2025-03-14T06:50:16.8330559Z  2025-03-14T06:50:16.8331432Z [20,577 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:16.8332253Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2025-03-14T06:50:16.8333046Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 32s local 2025-03-14T06:50:16.8333709Z Compiling torch_xla/csrc/ops/not_supported.cpp; 31s local 2025-03-14T06:50:16.8334559Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2025-03-14T06:50:16.8335192Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2025-03-14T06:50:16.8335875Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T06:50:16.8336645Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2025-03-14T06:50:16.8337490Z Compiling torch_xla/csrc/ops/permute.cpp; 26s local ... 2025-03-14T06:50:17.1592948Z 2025-03-14T06:50:17.1593757Z  2025-03-14T06:50:17.1594176Z  2025-03-14T06:50:17.1594524Z  2025-03-14T06:50:17.1594895Z  2025-03-14T06:50:17.1595278Z  2025-03-14T06:50:17.1595670Z  2025-03-14T06:50:17.1596081Z  2025-03-14T06:50:17.1596495Z  2025-03-14T06:50:17.1597375Z [20,577 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:17.1598379Z Compiling torch_xla/csrc/tensor_util.cpp; 108s local 2025-03-14T06:50:17.1599218Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 32s local 2025-03-14T06:50:17.1600112Z Compiling torch_xla/csrc/ops/not_supported.cpp; 31s local 2025-03-14T06:50:17.1600915Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2025-03-14T06:50:17.1601720Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 28s local 2025-03-14T06:50:17.1602535Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T06:50:17.1603679Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 27s local 2025-03-14T06:50:17.1604827Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local ... 2025-03-14T06:50:17.5597122Z 2025-03-14T06:50:17.5597978Z  2025-03-14T06:50:17.5598448Z  2025-03-14T06:50:17.5598845Z  2025-03-14T06:50:17.5599228Z  2025-03-14T06:50:17.5599630Z  2025-03-14T06:50:17.5600000Z  2025-03-14T06:50:17.5600387Z  2025-03-14T06:50:17.5600775Z  2025-03-14T06:50:17.5601810Z [20,578 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:50:17.5602974Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2025-03-14T06:50:17.5603721Z Compiling torch_xla/csrc/ops/nll_loss_backward.cpp; 33s local 2025-03-14T06:50:17.5604624Z Compiling torch_xla/csrc/ops/nonzero.cpp; 30s local 2025-03-14T06:50:17.5605404Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2025-03-14T06:50:17.5606179Z Compiling torch_xla/csrc/ops/ops.cpp; 28s local 2025-03-14T06:50:17.5607027Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local 2025-03-14T06:50:17.5607900Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local 2025-03-14T06:50:17.5608580Z Compiling torch_xla/csrc/ops/put.cpp; 27s local ... 2025-03-14T06:50:17.7935902Z 2025-03-14T06:50:17.7936709Z  2025-03-14T06:50:17.7937186Z  2025-03-14T06:50:17.7937571Z  2025-03-14T06:50:17.7937935Z  2025-03-14T06:50:17.7938309Z  2025-03-14T06:50:17.7938694Z  2025-03-14T06:50:17.7939079Z  2025-03-14T06:50:17.7939472Z  2025-03-14T06:50:17.7940407Z [20,579 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:17.7941349Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2025-03-14T06:50:17.7942088Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2025-03-14T06:50:17.7942898Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2025-03-14T06:50:17.7943592Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2025-03-14T06:50:17.7944198Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local 2025-03-14T06:50:17.7944953Z Compiling torch_xla/csrc/ops/permute.cpp; 27s local 2025-03-14T06:50:17.7945603Z Compiling torch_xla/csrc/ops/put.cpp; 27s local 2025-03-14T06:50:17.7946307Z Compiling torch_xla/csrc/ops/qr.cpp; 27s local ... 2025-03-14T06:50:18.1603269Z 2025-03-14T06:50:18.1604098Z  2025-03-14T06:50:18.1604754Z  2025-03-14T06:50:18.1605159Z  2025-03-14T06:50:18.1605573Z  2025-03-14T06:50:18.1606464Z  2025-03-14T06:50:18.1606906Z  2025-03-14T06:50:18.1607281Z  2025-03-14T06:50:18.1607631Z  2025-03-14T06:50:18.1608771Z [20,579 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:18.1609810Z Compiling torch_xla/csrc/tensor_util.cpp; 109s local 2025-03-14T06:50:18.1610611Z Compiling torch_xla/csrc/ops/nonzero.cpp; 31s local 2025-03-14T06:50:18.1611398Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 29s local 2025-03-14T06:50:18.1612212Z Compiling torch_xla/csrc/ops/ops.cpp; 29s local 2025-03-14T06:50:18.1613091Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 28s local 2025-03-14T06:50:18.1613958Z Compiling torch_xla/csrc/ops/permute.cpp; 28s local 2025-03-14T06:50:18.1614744Z Compiling torch_xla/csrc/ops/put.cpp; 28s local 2025-03-14T06:50:18.1615461Z Compiling torch_xla/csrc/ops/qr.cpp; 27s local ... 2025-03-14T06:50:19.3611358Z 2025-03-14T06:50:19.3612204Z  2025-03-14T06:50:19.3612739Z  2025-03-14T06:50:19.3613162Z  2025-03-14T06:50:19.3613545Z  2025-03-14T06:50:19.3613938Z  2025-03-14T06:50:19.3614327Z  2025-03-14T06:50:19.3614699Z  2025-03-14T06:50:19.3615085Z  2025-03-14T06:50:19.3615973Z [20,579 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:19.3617269Z Compiling torch_xla/csrc/tensor_util.cpp; 110s local 2025-03-14T06:50:19.3618034Z Compiling torch_xla/csrc/ops/nonzero.cpp; 32s local 2025-03-14T06:50:19.3618979Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 30s local 2025-03-14T06:50:19.3619738Z Compiling torch_xla/csrc/ops/ops.cpp; 30s local 2025-03-14T06:50:19.3620527Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 30s local 2025-03-14T06:50:19.3621378Z Compiling torch_xla/csrc/ops/permute.cpp; 29s local 2025-03-14T06:50:19.3622099Z Compiling torch_xla/csrc/ops/put.cpp; 29s local 2025-03-14T06:50:19.3622796Z Compiling torch_xla/csrc/ops/qr.cpp; 29s local ... 2025-03-14T06:50:20.3619745Z 2025-03-14T06:50:20.3620594Z  2025-03-14T06:50:20.3621121Z  2025-03-14T06:50:20.3621528Z  2025-03-14T06:50:20.3621942Z  2025-03-14T06:50:20.3622355Z  2025-03-14T06:50:20.3622698Z  2025-03-14T06:50:20.3623063Z  2025-03-14T06:50:20.3623428Z  2025-03-14T06:50:20.3624301Z [20,579 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:20.3625309Z Compiling torch_xla/csrc/tensor_util.cpp; 111s local 2025-03-14T06:50:20.3626069Z Compiling torch_xla/csrc/ops/nonzero.cpp; 33s local 2025-03-14T06:50:20.3626852Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 31s local 2025-03-14T06:50:20.3627598Z Compiling torch_xla/csrc/ops/ops.cpp; 31s local 2025-03-14T06:50:20.3628440Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 31s local 2025-03-14T06:50:20.3629329Z Compiling torch_xla/csrc/ops/permute.cpp; 30s local 2025-03-14T06:50:20.3630052Z Compiling torch_xla/csrc/ops/put.cpp; 30s local 2025-03-14T06:50:20.3630711Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local ... 2025-03-14T06:50:21.2338787Z 2025-03-14T06:50:21.2339646Z  2025-03-14T06:50:21.2340057Z  2025-03-14T06:50:21.2340396Z  2025-03-14T06:50:21.2340763Z  2025-03-14T06:50:21.2341092Z  2025-03-14T06:50:21.2341427Z  2025-03-14T06:50:21.2341757Z  2025-03-14T06:50:21.2342088Z  2025-03-14T06:50:21.2342866Z [20,580 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:21.2343702Z Compiling torch_xla/csrc/tensor_util.cpp; 112s local 2025-03-14T06:50:21.2344335Z Compiling torch_xla/csrc/ops/nonzero.cpp; 34s local 2025-03-14T06:50:21.2344982Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 32s local 2025-03-14T06:50:21.2345615Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2025-03-14T06:50:21.2346684Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2025-03-14T06:50:21.2347562Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2025-03-14T06:50:21.2348141Z Compiling torch_xla/csrc/ops/qr.cpp; 30s local 2025-03-14T06:50:21.2348778Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local ... 2025-03-14T06:50:21.5628980Z 2025-03-14T06:50:21.5629796Z  2025-03-14T06:50:21.5630309Z  2025-03-14T06:50:21.5630736Z  2025-03-14T06:50:21.5631137Z  2025-03-14T06:50:21.5631518Z  2025-03-14T06:50:21.5631952Z  2025-03-14T06:50:21.5632344Z  2025-03-14T06:50:21.5632713Z  2025-03-14T06:50:21.5633654Z [20,581 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:21.5634696Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2025-03-14T06:50:21.5635513Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2025-03-14T06:50:21.5636299Z Compiling torch_xla/csrc/ops/ops.cpp; 32s local 2025-03-14T06:50:21.5637156Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2025-03-14T06:50:21.5638017Z Compiling torch_xla/csrc/ops/permute.cpp; 31s local 2025-03-14T06:50:21.5638728Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2025-03-14T06:50:21.5639518Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 30s local 2025-03-14T06:50:21.5640731Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local ... 2025-03-14T06:50:21.9034758Z 2025-03-14T06:50:21.9035639Z  2025-03-14T06:50:21.9036331Z  2025-03-14T06:50:21.9036702Z  2025-03-14T06:50:21.9037062Z  2025-03-14T06:50:21.9037380Z  2025-03-14T06:50:21.9037693Z  2025-03-14T06:50:21.9037996Z  2025-03-14T06:50:21.9038318Z  2025-03-14T06:50:21.9039127Z [20,582 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:21.9039999Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2025-03-14T06:50:21.9040651Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2025-03-14T06:50:21.9041263Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2025-03-14T06:50:21.9041912Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2025-03-14T06:50:21.9042566Z Compiling torch_xla/csrc/ops/qr.cpp; 31s local 2025-03-14T06:50:21.9043184Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2025-03-14T06:50:21.9043812Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local 2025-03-14T06:50:21.9044410Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local ... 2025-03-14T06:50:22.1634089Z 2025-03-14T06:50:22.1634905Z  2025-03-14T06:50:22.1635403Z  2025-03-14T06:50:22.1635808Z  2025-03-14T06:50:22.1636206Z  2025-03-14T06:50:22.1636572Z  2025-03-14T06:50:22.1636950Z  2025-03-14T06:50:22.1637315Z  2025-03-14T06:50:22.1637681Z  2025-03-14T06:50:22.1638633Z [20,583 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:50:22.1639636Z Compiling torch_xla/csrc/tensor_util.cpp; 113s local 2025-03-14T06:50:22.1640431Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 33s local 2025-03-14T06:50:22.1641161Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2025-03-14T06:50:22.1641942Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 32s local 2025-03-14T06:50:22.1642796Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2025-03-14T06:50:22.1643678Z Compiling torch_xla/csrc/ops/randperm.cpp; 29s local 2025-03-14T06:50:22.1644633Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local 2025-03-14T06:50:22.1645397Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local ... 2025-03-14T06:50:22.5638563Z 2025-03-14T06:50:22.5639383Z  2025-03-14T06:50:22.5639816Z  2025-03-14T06:50:22.5640186Z  2025-03-14T06:50:22.5640535Z  2025-03-14T06:50:22.5640873Z  2025-03-14T06:50:22.5641234Z  2025-03-14T06:50:22.5641889Z  2025-03-14T06:50:22.5642249Z  2025-03-14T06:50:22.5643236Z [20,583 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:22.5644146Z Compiling torch_xla/csrc/tensor_util.cpp; 114s local 2025-03-14T06:50:22.5645028Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2025-03-14T06:50:22.5645726Z Compiling torch_xla/csrc/ops/ops.cpp; 33s local 2025-03-14T06:50:22.5646456Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2025-03-14T06:50:22.5647275Z Compiling torch_xla/csrc/ops/quant_tensor.cpp; 31s local 2025-03-14T06:50:22.5647996Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local 2025-03-14T06:50:22.5648694Z Compiling torch_xla/csrc/ops/prod.cpp; 29s local 2025-03-14T06:50:22.5649386Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local ... 2025-03-14T06:50:22.9642493Z 2025-03-14T06:50:22.9643312Z  2025-03-14T06:50:22.9643738Z  2025-03-14T06:50:22.9644114Z  2025-03-14T06:50:22.9644462Z  2025-03-14T06:50:22.9644980Z  2025-03-14T06:50:22.9645340Z  2025-03-14T06:50:22.9645685Z  2025-03-14T06:50:22.9646049Z  2025-03-14T06:50:22.9646875Z [20,584 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:22.9648052Z Compiling torch_xla/csrc/tensor_util.cpp; 114s local 2025-03-14T06:50:22.9648760Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 34s local 2025-03-14T06:50:22.9649416Z Compiling torch_xla/csrc/ops/ops.cpp; 34s local 2025-03-14T06:50:22.9650271Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 33s local 2025-03-14T06:50:22.9651088Z Compiling torch_xla/csrc/ops/randperm.cpp; 30s local 2025-03-14T06:50:22.9651763Z Compiling torch_xla/csrc/ops/prod.cpp; 30s local 2025-03-14T06:50:22.9652452Z Compiling torch_xla/csrc/ops/recv.cpp; 29s local 2025-03-14T06:50:22.9653374Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 28s local ... 2025-03-14T06:50:24.0692161Z 2025-03-14T06:50:24.0692980Z  2025-03-14T06:50:24.0693416Z  2025-03-14T06:50:24.0693750Z  2025-03-14T06:50:24.0694065Z  2025-03-14T06:50:24.0694388Z  2025-03-14T06:50:24.0694707Z  2025-03-14T06:50:24.0695033Z  2025-03-14T06:50:24.0695364Z  2025-03-14T06:50:24.0696130Z [20,585 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:50:24.0696947Z Compiling torch_xla/csrc/tensor_util.cpp; 115s local 2025-03-14T06:50:24.0697614Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2025-03-14T06:50:24.0698242Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2025-03-14T06:50:24.0698922Z Compiling torch_xla/csrc/ops/optimization_barrier.cpp; 34s local 2025-03-14T06:50:24.0699616Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2025-03-14T06:50:24.0700212Z Compiling torch_xla/csrc/ops/recv.cpp; 30s local 2025-03-14T06:50:24.0700882Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2025-03-14T06:50:24.0701628Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 29s local ... 2025-03-14T06:50:24.3378560Z 2025-03-14T06:50:24.3379345Z  2025-03-14T06:50:24.3379699Z  2025-03-14T06:50:24.3380006Z  2025-03-14T06:50:24.3380336Z  2025-03-14T06:50:24.3380636Z  2025-03-14T06:50:24.3380929Z  2025-03-14T06:50:24.3381228Z  2025-03-14T06:50:24.3381522Z  2025-03-14T06:50:24.3382227Z [20,586 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:24.3382968Z Compiling torch_xla/csrc/tensor_util.cpp; 115s local 2025-03-14T06:50:24.3383567Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 35s local 2025-03-14T06:50:24.3384145Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2025-03-14T06:50:24.3384686Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2025-03-14T06:50:24.3385466Z Compiling torch_xla/csrc/ops/recv.cpp; 31s local 2025-03-14T06:50:24.3388574Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2025-03-14T06:50:24.3389240Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 29s local 2025-03-14T06:50:24.3389972Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local ... 2025-03-14T06:50:24.5381948Z 2025-03-14T06:50:24.5382770Z  2025-03-14T06:50:24.5383162Z  2025-03-14T06:50:24.5383517Z  2025-03-14T06:50:24.5383820Z  2025-03-14T06:50:24.5384138Z  2025-03-14T06:50:24.5384506Z  2025-03-14T06:50:24.5384826Z  2025-03-14T06:50:24.5385142Z  2025-03-14T06:50:24.5385901Z [20,587 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:24.5386684Z Compiling torch_xla/csrc/tensor_util.cpp; 116s local 2025-03-14T06:50:24.5387316Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 36s local 2025-03-14T06:50:24.5387945Z Compiling torch_xla/csrc/ops/ops.cpp; 35s local 2025-03-14T06:50:24.5388514Z Compiling torch_xla/csrc/ops/prod.cpp; 31s local 2025-03-14T06:50:24.5389159Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 30s local 2025-03-14T06:50:24.5389854Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 29s local 2025-03-14T06:50:24.5390601Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 29s local 2025-03-14T06:50:24.5391708Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 28s local ... 2025-03-14T06:50:25.7390800Z 2025-03-14T06:50:25.7391617Z  2025-03-14T06:50:25.7392273Z  2025-03-14T06:50:25.7392573Z  2025-03-14T06:50:25.7392867Z  2025-03-14T06:50:25.7393156Z  2025-03-14T06:50:25.7393451Z  2025-03-14T06:50:25.7393740Z  2025-03-14T06:50:25.7394096Z  2025-03-14T06:50:25.7394860Z [20,587 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:25.7395596Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2025-03-14T06:50:25.7396186Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2025-03-14T06:50:25.7396765Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2025-03-14T06:50:25.7397297Z Compiling torch_xla/csrc/ops/prod.cpp; 32s local 2025-03-14T06:50:25.7398029Z Compiling torch_xla/csrc/ops/reflection_pad2d.cpp; 31s local 2025-03-14T06:50:25.7398816Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 30s local 2025-03-14T06:50:25.7399687Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2025-03-14T06:50:25.7400420Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local ... 2025-03-14T06:50:25.9393755Z 2025-03-14T06:50:25.9394584Z  2025-03-14T06:50:25.9395048Z  2025-03-14T06:50:25.9395413Z  2025-03-14T06:50:25.9395774Z  2025-03-14T06:50:25.9396143Z  2025-03-14T06:50:25.9396525Z  2025-03-14T06:50:25.9396905Z  2025-03-14T06:50:25.9397282Z  2025-03-14T06:50:25.9398214Z [20,588 / 20,653] 6 / 17 tests; 47 actions running; last test: ..._client_test 2025-03-14T06:50:25.9399209Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2025-03-14T06:50:25.9400000Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2025-03-14T06:50:25.9400721Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2025-03-14T06:50:25.9401390Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2025-03-14T06:50:25.9402198Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2025-03-14T06:50:25.9403166Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 30s local 2025-03-14T06:50:25.9404138Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2025-03-14T06:50:25.9405115Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local ... 2025-03-14T06:50:26.3397729Z 2025-03-14T06:50:26.3398601Z  2025-03-14T06:50:26.3399098Z  2025-03-14T06:50:26.3399498Z  2025-03-14T06:50:26.3399909Z  2025-03-14T06:50:26.3400612Z  2025-03-14T06:50:26.3401017Z  2025-03-14T06:50:26.3401440Z  2025-03-14T06:50:26.3401944Z  2025-03-14T06:50:26.3402904Z [20,588 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:26.3403876Z Compiling torch_xla/csrc/tensor_util.cpp; 117s local 2025-03-14T06:50:26.3404873Z Compiling torch_xla/csrc/ops/ops_lower_fn.cpp; 37s local 2025-03-14T06:50:26.3405665Z Compiling torch_xla/csrc/ops/ops.cpp; 37s local 2025-03-14T06:50:26.3406420Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2025-03-14T06:50:26.3407211Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2025-03-14T06:50:26.3408140Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2025-03-14T06:50:26.3409054Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 30s local 2025-03-14T06:50:26.3409828Z Compiling torch_xla/csrc/ops/resize.cpp; 30s local ... 2025-03-14T06:50:26.7962788Z 2025-03-14T06:50:26.7963779Z  2025-03-14T06:50:26.7964301Z  2025-03-14T06:50:26.7964844Z  2025-03-14T06:50:26.7965244Z  2025-03-14T06:50:26.7965846Z  2025-03-14T06:50:26.7966217Z  2025-03-14T06:50:26.7966774Z  2025-03-14T06:50:26.7967144Z  2025-03-14T06:50:26.7968012Z [20,589 / 20,653] 6 / 17 tests; 48 actions, 47 running; last test: ...ent_test 2025-03-14T06:50:26.7969268Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2025-03-14T06:50:26.7969960Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2025-03-14T06:50:26.7970824Z Compiling torch_xla/csrc/ops/prod.cpp; 33s local 2025-03-14T06:50:26.7971578Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 31s local 2025-03-14T06:50:26.7972487Z Compiling torch_xla/csrc/ops/reflection_pad2d_backward.cpp; 31s local 2025-03-14T06:50:26.7973417Z Compiling torch_xla/csrc/ops/replication_pad.cpp; 31s local 2025-03-14T06:50:26.7974201Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2025-03-14T06:50:26.7975033Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local ... 2025-03-14T06:50:27.0075092Z 2025-03-14T06:50:27.0075950Z  2025-03-14T06:50:27.0076439Z  2025-03-14T06:50:27.0076845Z  2025-03-14T06:50:27.0077248Z  2025-03-14T06:50:27.0077676Z  2025-03-14T06:50:27.0078057Z  2025-03-14T06:50:27.0078455Z  2025-03-14T06:50:27.0078851Z  2025-03-14T06:50:27.0079752Z [20,591 / 20,653] 6 / 17 tests; 47 actions, 46 running; last test: ...ent_test 2025-03-14T06:50:27.0080731Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2025-03-14T06:50:27.0081433Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2025-03-14T06:50:27.0082166Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2025-03-14T06:50:27.0082969Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 32s local 2025-03-14T06:50:27.0083811Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2025-03-14T06:50:27.0084866Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2025-03-14T06:50:27.0085778Z Compiling torch_xla/csrc/ops/roll.cpp; 31s local 2025-03-14T06:50:27.0086578Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 30s local ... 2025-03-14T06:50:27.3405301Z 2025-03-14T06:50:27.3406135Z  2025-03-14T06:50:27.3406646Z  2025-03-14T06:50:27.3407056Z  2025-03-14T06:50:27.3407464Z  2025-03-14T06:50:27.3407870Z  2025-03-14T06:50:27.3408241Z  2025-03-14T06:50:27.3408631Z  2025-03-14T06:50:27.3408980Z  2025-03-14T06:50:27.3409878Z [20,591 / 20,653] 6 / 17 tests; 48 actions running; last test: ..._client_test 2025-03-14T06:50:27.3410856Z Compiling torch_xla/csrc/tensor_util.cpp; 118s local 2025-03-14T06:50:27.3411647Z Compiling torch_xla/csrc/ops/ops.cpp; 38s local 2025-03-14T06:50:27.3412391Z Compiling torch_xla/csrc/ops/prod.cpp; 34s local 2025-03-14T06:50:27.3413522Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 32s local 2025-03-14T06:50:27.3414508Z Compiling torch_xla/csrc/ops/resize.cpp; 31s local 2025-03-14T06:50:27.3415445Z Compiling torch_xla/csrc/ops/replication_pad_backward.cpp; 31s local 2025-03-14T06:50:27.3416366Z Compiling torch_xla/csrc/ops/roll.cpp; 31s local 2025-03-14T06:50:27.3417191Z Compiling torch_xla/csrc/ops/rrelu_with_noise.cpp; 31s local ... 2025-03-14T06:50:28.1260003Z 2025-03-14T06:50:28.1260755Z  2025-03-14T06:50:28.1261202Z  2025-03-14T06:50:28.1261602Z  2025-03-14T06:50:28.1261954Z  2025-03-14T06:50:28.1262294Z  2025-03-14T06:50:28.1262644Z  2025-03-14T06:50:28.1262979Z  2025-03-14T06:50:28.1263341Z  2025-03-14T06:50:28.1264211Z [20,596 / 20,653] 6 / 17 tests; 43 actions running; last test: ..._client_test 2025-03-14T06:50:28.1265132Z Compiling torch_xla/csrc/tensor_util.cpp; 119s local 2025-03-14T06:50:28.1266102Z Compiling torch_xla/csrc/ops/ops.cpp; 39s local 2025-03-14T06:50:28.1266766Z Compiling torch_xla/csrc/ops/prod.cpp; 35s local 2025-03-14T06:50:28.1267526Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 33s local 2025-03-14T06:50:28.1268307Z Compiling torch_xla/csrc/ops/scatter.cpp; 30s local 2025-03-14T06:50:28.1269035Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 28s local 2025-03-14T06:50:28.1270100Z Compiling torch_xla/csrc/ops/scalar.cpp; 28s local 2025-03-14T06:50:28.1270864Z Compiling torch_xla/csrc/ops/select.cpp; 28s local ... 2025-03-14T06:50:29.1267913Z 2025-03-14T06:50:29.1268784Z  2025-03-14T06:50:29.1269266Z  2025-03-14T06:50:29.1269649Z  2025-03-14T06:50:29.1270037Z  2025-03-14T06:50:29.1270375Z  2025-03-14T06:50:29.1270708Z  2025-03-14T06:50:29.1271182Z  2025-03-14T06:50:29.1271677Z  2025-03-14T06:50:29.1272795Z [20,596 / 20,653] 6 / 17 tests; 43 actions running; last test: ..._client_test 2025-03-14T06:50:29.1274014Z Compiling torch_xla/csrc/tensor_util.cpp; 120s local 2025-03-14T06:50:29.1274741Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2025-03-14T06:50:29.1275412Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2025-03-14T06:50:29.1276355Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 34s local 2025-03-14T06:50:29.1277220Z Compiling torch_xla/csrc/ops/scatter.cpp; 31s local 2025-03-14T06:50:29.1278089Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2025-03-14T06:50:29.1278821Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2025-03-14T06:50:29.1279679Z Compiling torch_xla/csrc/ops/select.cpp; 29s local ... 2025-03-14T06:50:29.5271281Z 2025-03-14T06:50:29.5272086Z  2025-03-14T06:50:29.5272590Z  2025-03-14T06:50:29.5273011Z  2025-03-14T06:50:29.5273426Z  2025-03-14T06:50:29.5273838Z  2025-03-14T06:50:29.5274239Z  2025-03-14T06:50:29.5274641Z  2025-03-14T06:50:29.5275046Z  2025-03-14T06:50:29.5276019Z [20,597 / 20,653] 6 / 17 tests; 42 actions running; last test: ..._client_test 2025-03-14T06:50:29.5277038Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2025-03-14T06:50:29.5277940Z Compiling torch_xla/csrc/ops/ops.cpp; 40s local 2025-03-14T06:50:29.5278709Z Compiling torch_xla/csrc/ops/prod.cpp; 36s local 2025-03-14T06:50:29.5279581Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 34s local 2025-03-14T06:50:29.5280439Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 29s local 2025-03-14T06:50:29.5281444Z Compiling torch_xla/csrc/ops/scalar.cpp; 29s local 2025-03-14T06:50:29.5282230Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2025-03-14T06:50:29.5283132Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local ... 2025-03-14T06:50:29.9275482Z 2025-03-14T06:50:29.9276367Z  2025-03-14T06:50:29.9276861Z  2025-03-14T06:50:29.9277251Z  2025-03-14T06:50:29.9277620Z  2025-03-14T06:50:29.9278359Z  2025-03-14T06:50:29.9278733Z  2025-03-14T06:50:29.9279109Z  2025-03-14T06:50:29.9279594Z  2025-03-14T06:50:29.9280530Z [20,598 / 20,653] 6 / 17 tests; 41 actions running; last test: ..._client_test 2025-03-14T06:50:29.9281485Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2025-03-14T06:50:29.9282233Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2025-03-14T06:50:29.9283005Z Compiling torch_xla/csrc/ops/reduce_scatter.cpp; 35s local 2025-03-14T06:50:29.9283836Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2025-03-14T06:50:29.9284765Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2025-03-14T06:50:29.9285484Z Compiling torch_xla/csrc/ops/select.cpp; 29s local 2025-03-14T06:50:29.9286104Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 27s local 2025-03-14T06:50:29.9286895Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 27s local ... 2025-03-14T06:50:30.3279386Z 2025-03-14T06:50:30.3280251Z  2025-03-14T06:50:30.3280736Z  2025-03-14T06:50:30.3281215Z  2025-03-14T06:50:30.3281669Z  2025-03-14T06:50:30.3282085Z  2025-03-14T06:50:30.3282474Z  2025-03-14T06:50:30.3282862Z  2025-03-14T06:50:30.3283187Z  2025-03-14T06:50:30.3284187Z [20,599 / 20,653] 6 / 17 tests; 40 actions running; last test: ..._client_test 2025-03-14T06:50:30.3285724Z Compiling torch_xla/csrc/tensor_util.cpp; 121s local 2025-03-14T06:50:30.3286445Z Compiling torch_xla/csrc/ops/ops.cpp; 41s local 2025-03-14T06:50:30.3287469Z Compiling torch_xla/csrc/ops/scatter_add.cpp; 30s local 2025-03-14T06:50:30.3288238Z Compiling torch_xla/csrc/ops/scalar.cpp; 30s local 2025-03-14T06:50:30.3289004Z Compiling torch_xla/csrc/ops/select.cpp; 30s local 2025-03-14T06:50:30.3289843Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 28s local 2025-03-14T06:50:30.3290752Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 28s local 2025-03-14T06:50:30.3291738Z Compiling torch_xla/csrc/ops/send.cpp; 27s local ... 2025-03-14T06:50:31.3285220Z 2025-03-14T06:50:31.3285997Z  2025-03-14T06:50:31.3286434Z  2025-03-14T06:50:31.3286791Z  2025-03-14T06:50:31.3287128Z  2025-03-14T06:50:31.3287477Z  2025-03-14T06:50:31.3287831Z  2025-03-14T06:50:31.3288173Z  2025-03-14T06:50:31.3288499Z  2025-03-14T06:50:31.3289283Z [20,600 / 20,653] 6 / 17 tests; 39 actions running; last test: ..._client_test 2025-03-14T06:50:31.3290143Z Compiling torch_xla/csrc/tensor_util.cpp; 122s local 2025-03-14T06:50:31.3290774Z Compiling torch_xla/csrc/ops/ops.cpp; 42s local 2025-03-14T06:50:31.3291423Z Compiling torch_xla/csrc/ops/scalar.cpp; 31s local 2025-03-14T06:50:31.3292062Z Compiling torch_xla/csrc/ops/select.cpp; 31s local 2025-03-14T06:50:31.3292774Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 29s local 2025-03-14T06:50:31.3293518Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2025-03-14T06:50:31.3294204Z Compiling torch_xla/csrc/ops/send.cpp; 28s local 2025-03-14T06:50:31.3294829Z Compiling torch_xla/csrc/ops/split.cpp; 28s local ... 2025-03-14T06:50:31.7289215Z 2025-03-14T06:50:31.7290061Z  2025-03-14T06:50:31.7290513Z  2025-03-14T06:50:31.7290906Z  2025-03-14T06:50:31.7291280Z  2025-03-14T06:50:31.7291643Z  2025-03-14T06:50:31.7292006Z  2025-03-14T06:50:31.7292385Z  2025-03-14T06:50:31.7292736Z  2025-03-14T06:50:31.7293562Z [20,601 / 20,653] 6 / 17 tests; 38 actions running; last test: ..._client_test 2025-03-14T06:50:31.7294399Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2025-03-14T06:50:31.7295120Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2025-03-14T06:50:31.7295939Z Compiling torch_xla/csrc/ops/scalar.cpp; 32s local 2025-03-14T06:50:31.7296960Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 29s local 2025-03-14T06:50:31.7297836Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 29s local 2025-03-14T06:50:31.7298678Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2025-03-14T06:50:31.7299362Z Compiling torch_xla/csrc/ops/split.cpp; 28s local 2025-03-14T06:50:31.7300204Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 28s local ... 2025-03-14T06:50:32.3293958Z 2025-03-14T06:50:32.3294822Z  2025-03-14T06:50:32.3295368Z  2025-03-14T06:50:32.3295734Z  2025-03-14T06:50:32.3296117Z  2025-03-14T06:50:32.3296520Z  2025-03-14T06:50:32.3296902Z  2025-03-14T06:50:32.3297291Z  2025-03-14T06:50:32.3297650Z  2025-03-14T06:50:32.3298608Z [20,602 / 20,653] 6 / 17 tests; 37 actions running; last test: ..._client_test 2025-03-14T06:50:32.3299601Z Compiling torch_xla/csrc/tensor_util.cpp; 123s local 2025-03-14T06:50:32.3300366Z Compiling torch_xla/csrc/ops/ops.cpp; 43s local 2025-03-14T06:50:32.3301180Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2025-03-14T06:50:32.3302068Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2025-03-14T06:50:32.3302824Z Compiling torch_xla/csrc/ops/send.cpp; 29s local 2025-03-14T06:50:32.3303550Z Compiling torch_xla/csrc/ops/split.cpp; 29s local 2025-03-14T06:50:32.3304815Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local 2025-03-14T06:50:32.3305654Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local ... 2025-03-14T06:50:32.9293110Z 2025-03-14T06:50:32.9294119Z  2025-03-14T06:50:32.9294504Z  2025-03-14T06:50:32.9294815Z  2025-03-14T06:50:32.9295122Z  2025-03-14T06:50:32.9295429Z  2025-03-14T06:50:32.9295729Z  2025-03-14T06:50:32.9296032Z  2025-03-14T06:50:32.9296331Z  2025-03-14T06:50:32.9297070Z [20,603 / 20,653] 6 / 17 tests; 36 actions running; last test: ..._client_test 2025-03-14T06:50:32.9297841Z Compiling torch_xla/csrc/tensor_util.cpp; 124s local 2025-03-14T06:50:32.9298420Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2025-03-14T06:50:32.9299037Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 30s local 2025-03-14T06:50:32.9299740Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 30s local 2025-03-14T06:50:32.9300356Z Compiling torch_xla/csrc/ops/send.cpp; 30s local 2025-03-14T06:50:32.9300961Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 29s local 2025-03-14T06:50:32.9301592Z Compiling torch_xla/csrc/ops/squeeze.cpp; 28s local 2025-03-14T06:50:32.9302175Z Compiling test/cpp/test_tensor.cpp; 27s local ... 2025-03-14T06:50:33.3297210Z 2025-03-14T06:50:33.3298062Z  2025-03-14T06:50:33.3298545Z  2025-03-14T06:50:33.3298952Z  2025-03-14T06:50:33.3299367Z  2025-03-14T06:50:33.3299743Z  2025-03-14T06:50:33.3300147Z  2025-03-14T06:50:33.3300545Z  2025-03-14T06:50:33.3300891Z  2025-03-14T06:50:33.3301916Z [20,604 / 20,653] 6 / 17 tests; 35 actions running; last test: ..._client_test 2025-03-14T06:50:33.3302967Z Compiling torch_xla/csrc/tensor_util.cpp; 124s local 2025-03-14T06:50:33.3303745Z Compiling torch_xla/csrc/ops/ops.cpp; 44s local 2025-03-14T06:50:33.3304580Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 31s local 2025-03-14T06:50:33.3305446Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 31s local 2025-03-14T06:50:33.3306278Z Compiling torch_xla/csrc/ops/softmax_backward.cpp; 30s local 2025-03-14T06:50:33.3307107Z Compiling torch_xla/csrc/ops/squeeze.cpp; 29s local 2025-03-14T06:50:33.3307811Z Compiling test/cpp/test_tensor.cpp; 27s local 2025-03-14T06:50:33.3308527Z Compiling torch_xla/csrc/ops/softmax.cpp; 27s local ... 2025-03-14T06:50:33.7301366Z 2025-03-14T06:50:33.7302207Z  2025-03-14T06:50:33.7302791Z  2025-03-14T06:50:33.7303330Z  2025-03-14T06:50:33.7303837Z  2025-03-14T06:50:33.7304325Z  2025-03-14T06:50:33.7305086Z  2025-03-14T06:50:33.7305532Z  2025-03-14T06:50:33.7305884Z  2025-03-14T06:50:33.7307043Z [20,605 / 20,653] 6 / 17 tests; 34 actions running; last test: ..._client_test 2025-03-14T06:50:33.7308317Z Compiling torch_xla/csrc/tensor_util.cpp; 125s local 2025-03-14T06:50:33.7309250Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2025-03-14T06:50:33.7310211Z Compiling torch_xla/csrc/ops/sgd_optimizer_step.cpp; 31s local 2025-03-14T06:50:33.7311281Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 31s local 2025-03-14T06:50:33.7312265Z Compiling torch_xla/csrc/ops/squeeze.cpp; 29s local 2025-03-14T06:50:33.7312900Z Compiling test/cpp/test_tensor.cpp; 28s local 2025-03-14T06:50:33.7313600Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2025-03-14T06:50:33.7314362Z Compiling torch_xla/csrc/ops/stack.cpp; 27s local ... 2025-03-14T06:50:34.1305044Z 2025-03-14T06:50:34.1305870Z  2025-03-14T06:50:34.1306662Z  2025-03-14T06:50:34.1307122Z  2025-03-14T06:50:34.1307622Z  2025-03-14T06:50:34.1308141Z  2025-03-14T06:50:34.1308618Z  2025-03-14T06:50:34.1309122Z  2025-03-14T06:50:34.1309625Z  2025-03-14T06:50:34.1310586Z [20,606 / 20,653] 6 / 17 tests; 33 actions running; last test: ..._client_test 2025-03-14T06:50:34.1311997Z Compiling torch_xla/csrc/tensor_util.cpp; 125s local 2025-03-14T06:50:34.1312807Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2025-03-14T06:50:34.1313726Z Compiling torch_xla/csrc/ops/scatter_reduce.cpp; 31s local 2025-03-14T06:50:34.1314504Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2025-03-14T06:50:34.1315362Z Compiling test/cpp/test_tensor.cpp; 28s local 2025-03-14T06:50:34.1316184Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2025-03-14T06:50:34.1316853Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local 2025-03-14T06:50:34.1317878Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 28s local ... 2025-03-14T06:50:34.3308613Z 2025-03-14T06:50:34.3309419Z  2025-03-14T06:50:34.3310005Z  2025-03-14T06:50:34.3310407Z  2025-03-14T06:50:34.3310890Z  2025-03-14T06:50:34.3311278Z  2025-03-14T06:50:34.3311680Z  2025-03-14T06:50:34.3312092Z  2025-03-14T06:50:34.3312459Z  2025-03-14T06:50:34.3313418Z [20,607 / 20,653] 6 / 17 tests; 32 actions running; last test: ..._client_test 2025-03-14T06:50:34.3314441Z Compiling torch_xla/csrc/tensor_util.cpp; 125s local 2025-03-14T06:50:34.3315186Z Compiling torch_xla/csrc/ops/ops.cpp; 45s local 2025-03-14T06:50:34.3316114Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2025-03-14T06:50:34.3316863Z Compiling test/cpp/test_tensor.cpp; 28s local 2025-03-14T06:50:34.3317586Z Compiling torch_xla/csrc/ops/softmax.cpp; 28s local 2025-03-14T06:50:34.3318335Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local 2025-03-14T06:50:34.3319148Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 28s local 2025-03-14T06:50:34.3320068Z Compiling torch_xla/csrc/ops/std.cpp; 27s local ... 2025-03-14T06:50:34.7312239Z 2025-03-14T06:50:34.7313071Z  2025-03-14T06:50:34.7313558Z  2025-03-14T06:50:34.7313983Z  2025-03-14T06:50:34.7314400Z  2025-03-14T06:50:34.7314776Z  2025-03-14T06:50:34.7315118Z  2025-03-14T06:50:34.7315474Z  2025-03-14T06:50:34.7315825Z  2025-03-14T06:50:34.7316712Z [20,609 / 20,653] 6 / 17 tests; 30 actions running; last test: ..._client_test 2025-03-14T06:50:34.7317717Z Compiling torch_xla/csrc/ops/squeeze.cpp; 30s local 2025-03-14T06:50:34.7318430Z Compiling test/cpp/test_tensor.cpp; 29s local 2025-03-14T06:50:34.7319155Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2025-03-14T06:50:34.7319874Z Compiling torch_xla/csrc/ops/stack.cpp; 28s local 2025-03-14T06:50:34.7321149Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 28s local 2025-03-14T06:50:34.7322115Z Compiling torch_xla/csrc/ops/std.cpp; 28s local 2025-03-14T06:50:34.7322860Z Compiling torch_xla/csrc/ops/std_mean.cpp; 27s local 2025-03-14T06:50:34.7323563Z Compiling torch_xla/csrc/ops/svd.cpp; 27s local ... 2025-03-14T06:50:35.1316196Z 2025-03-14T06:50:35.1317192Z  2025-03-14T06:50:35.1317678Z  2025-03-14T06:50:35.1318083Z  2025-03-14T06:50:35.1318478Z  2025-03-14T06:50:35.1318851Z  2025-03-14T06:50:35.1319233Z  2025-03-14T06:50:35.1319650Z  2025-03-14T06:50:35.1320003Z  2025-03-14T06:50:35.1320885Z [20,610 / 20,653] 6 / 17 tests; 29 actions running; last test: ..._client_test 2025-03-14T06:50:35.1321837Z Compiling test/cpp/test_tensor.cpp; 29s local 2025-03-14T06:50:35.1322554Z Compiling torch_xla/csrc/ops/softmax.cpp; 29s local 2025-03-14T06:50:35.1323293Z Compiling torch_xla/csrc/ops/stack.cpp; 29s local 2025-03-14T06:50:35.1324114Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 29s local 2025-03-14T06:50:35.1325094Z Compiling torch_xla/csrc/ops/std.cpp; 28s local 2025-03-14T06:50:35.1325822Z Compiling torch_xla/csrc/ops/std_mean.cpp; 27s local 2025-03-14T06:50:35.1326542Z Compiling torch_xla/csrc/ops/svd.cpp; 27s local 2025-03-14T06:50:35.1327609Z Compiling torch_xla/csrc/ops/symeig.cpp; 27s local ... 2025-03-14T06:50:35.7321042Z 2025-03-14T06:50:35.7321845Z  2025-03-14T06:50:35.7322310Z  2025-03-14T06:50:35.7322937Z  2025-03-14T06:50:35.7323322Z  2025-03-14T06:50:35.7323712Z  2025-03-14T06:50:35.7324085Z  2025-03-14T06:50:35.7324459Z  2025-03-14T06:50:35.7324973Z  2025-03-14T06:50:35.7325880Z [20,611 / 20,653] 6 / 17 tests; 28 actions running; last test: ..._client_test 2025-03-14T06:50:35.7326831Z Compiling test/cpp/test_tensor.cpp; 30s local 2025-03-14T06:50:35.7327451Z Compiling torch_xla/csrc/ops/softmax.cpp; 30s local 2025-03-14T06:50:35.7328140Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 29s local 2025-03-14T06:50:35.7328903Z Compiling torch_xla/csrc/ops/std.cpp; 29s local 2025-03-14T06:50:35.7329614Z Compiling torch_xla/csrc/ops/std_mean.cpp; 28s local 2025-03-14T06:50:35.7330351Z Compiling torch_xla/csrc/ops/svd.cpp; 28s local 2025-03-14T06:50:35.7331077Z Compiling torch_xla/csrc/ops/symeig.cpp; 28s local 2025-03-14T06:50:35.7331803Z Compiling torch_xla/csrc/ops/sum.cpp; 26s local ... 2025-03-14T06:50:36.7327991Z 2025-03-14T06:50:36.7328821Z  2025-03-14T06:50:36.7329300Z  2025-03-14T06:50:36.7329665Z  2025-03-14T06:50:36.7330049Z  2025-03-14T06:50:36.7330431Z  2025-03-14T06:50:36.7330817Z  2025-03-14T06:50:36.7331207Z  2025-03-14T06:50:36.7331607Z  2025-03-14T06:50:36.7332568Z [20,611 / 20,653] 6 / 17 tests; 28 actions running; last test: ..._client_test 2025-03-14T06:50:36.7333503Z Compiling test/cpp/test_tensor.cpp; 31s local 2025-03-14T06:50:36.7334208Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2025-03-14T06:50:36.7335042Z Compiling torch_xla/csrc/ops/upsample_bilinear2d.cpp; 30s local 2025-03-14T06:50:36.7345059Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2025-03-14T06:50:36.7346052Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2025-03-14T06:50:36.7346769Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2025-03-14T06:50:36.7347469Z Compiling torch_xla/csrc/ops/symeig.cpp; 29s local 2025-03-14T06:50:36.7348232Z Compiling torch_xla/csrc/ops/sum.cpp; 27s local ... 2025-03-14T06:50:37.1331990Z 2025-03-14T06:50:37.1332775Z  2025-03-14T06:50:37.1333250Z  2025-03-14T06:50:37.1333658Z  2025-03-14T06:50:37.1334015Z  2025-03-14T06:50:37.1334409Z  2025-03-14T06:50:37.1334779Z  2025-03-14T06:50:37.1335171Z  2025-03-14T06:50:37.1335522Z  2025-03-14T06:50:37.1336654Z [20,612 / 20,653] 6 / 17 tests; 27 actions running; last test: ..._client_test 2025-03-14T06:50:37.1337729Z Compiling test/cpp/test_tensor.cpp; 31s local 2025-03-14T06:50:37.1338466Z Compiling torch_xla/csrc/ops/softmax.cpp; 31s local 2025-03-14T06:50:37.1339146Z Compiling torch_xla/csrc/ops/std.cpp; 30s local 2025-03-14T06:50:37.1339916Z Compiling torch_xla/csrc/ops/std_mean.cpp; 29s local 2025-03-14T06:50:37.1340624Z Compiling torch_xla/csrc/ops/svd.cpp; 29s local 2025-03-14T06:50:37.1341280Z Compiling torch_xla/csrc/ops/symeig.cpp; 29s local 2025-03-14T06:50:37.1341986Z Compiling torch_xla/csrc/ops/sum.cpp; 27s local 2025-03-14T06:50:37.1342759Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 26s local ... 2025-03-14T06:50:37.5335820Z 2025-03-14T06:50:37.5336620Z  2025-03-14T06:50:37.5337081Z  2025-03-14T06:50:37.5337480Z  2025-03-14T06:50:37.5337878Z  2025-03-14T06:50:37.5338276Z  2025-03-14T06:50:37.5338695Z  2025-03-14T06:50:37.5339053Z  2025-03-14T06:50:37.5339457Z  2025-03-14T06:50:37.5340380Z [20,614 / 20,653] 6 / 17 tests; 25 actions running; last test: ..._client_test 2025-03-14T06:50:37.5341347Z Compiling test/cpp/test_tensor.cpp; 32s local 2025-03-14T06:50:37.5342337Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2025-03-14T06:50:37.5343061Z Compiling torch_xla/csrc/ops/svd.cpp; 30s local 2025-03-14T06:50:37.5343758Z Compiling torch_xla/csrc/ops/symeig.cpp; 29s local 2025-03-14T06:50:37.5344589Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local 2025-03-14T06:50:37.5345381Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 26s local 2025-03-14T06:50:37.5346206Z Compiling torch_xla/csrc/ops/topk.cpp; 25s local 2025-03-14T06:50:37.5346849Z Compiling torch_xla/csrc/ops/threshold.cpp; 23s local ... 2025-03-14T06:50:38.3341943Z 2025-03-14T06:50:38.3342772Z  2025-03-14T06:50:38.3343259Z  2025-03-14T06:50:38.3343695Z  2025-03-14T06:50:38.3344124Z  2025-03-14T06:50:38.3344522Z  2025-03-14T06:50:38.3344920Z  2025-03-14T06:50:38.3345306Z  2025-03-14T06:50:38.3345679Z  2025-03-14T06:50:38.3346589Z [20,615 / 20,653] 6 / 17 tests; 24 actions running; last test: ..._client_test 2025-03-14T06:50:38.3347574Z Compiling test/cpp/test_tensor.cpp; 32s local 2025-03-14T06:50:38.3348282Z Compiling torch_xla/csrc/ops/softmax.cpp; 32s local 2025-03-14T06:50:38.3349029Z Compiling torch_xla/csrc/ops/symeig.cpp; 30s local 2025-03-14T06:50:38.3349729Z Compiling torch_xla/csrc/ops/sum.cpp; 28s local 2025-03-14T06:50:38.3350495Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 27s local 2025-03-14T06:50:38.3351226Z Compiling torch_xla/csrc/ops/topk.cpp; 26s local 2025-03-14T06:50:38.3351903Z Compiling torch_xla/csrc/ops/threshold.cpp; 24s local 2025-03-14T06:50:38.3352756Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 22s local ... 2025-03-14T06:50:38.7345592Z 2025-03-14T06:50:38.7346435Z  2025-03-14T06:50:38.7346934Z  2025-03-14T06:50:38.7347331Z  2025-03-14T06:50:38.7347756Z  2025-03-14T06:50:38.7348157Z  2025-03-14T06:50:38.7348545Z  2025-03-14T06:50:38.7348928Z  2025-03-14T06:50:38.7349305Z  2025-03-14T06:50:38.7350233Z [20,616 / 20,653] 6 / 17 tests; 23 actions running; last test: ..._client_test 2025-03-14T06:50:38.7351249Z Compiling test/cpp/test_tensor.cpp; 33s local 2025-03-14T06:50:38.7352014Z Compiling torch_xla/csrc/ops/symeig.cpp; 31s local 2025-03-14T06:50:38.7352791Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2025-03-14T06:50:38.7353581Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 27s local 2025-03-14T06:50:38.7354405Z Compiling torch_xla/csrc/ops/topk.cpp; 26s local 2025-03-14T06:50:38.7355095Z Compiling torch_xla/csrc/ops/threshold.cpp; 24s local 2025-03-14T06:50:38.7356201Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 22s local 2025-03-14T06:50:38.7357259Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 22s local ... 2025-03-14T06:50:38.9348787Z 2025-03-14T06:50:38.9349590Z  2025-03-14T06:50:38.9350050Z  2025-03-14T06:50:38.9350433Z  2025-03-14T06:50:38.9350857Z  2025-03-14T06:50:38.9351246Z  2025-03-14T06:50:38.9351718Z  2025-03-14T06:50:38.9352157Z  2025-03-14T06:50:38.9352616Z  2025-03-14T06:50:38.9353640Z [20,617 / 20,653] 6 / 17 tests; 22 actions running; last test: ..._client_test 2025-03-14T06:50:38.9354657Z Compiling test/cpp/test_tensor.cpp; 33s local 2025-03-14T06:50:38.9355378Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2025-03-14T06:50:38.9356217Z Compiling torch_xla/csrc/ops/threshold_backward.cpp; 28s local 2025-03-14T06:50:38.9357054Z Compiling torch_xla/csrc/ops/topk.cpp; 26s local 2025-03-14T06:50:38.9357865Z Compiling torch_xla/csrc/ops/threshold.cpp; 24s local 2025-03-14T06:50:38.9358746Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 22s local 2025-03-14T06:50:38.9359573Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 22s local 2025-03-14T06:50:38.9360417Z Compiling torch_xla/csrc/ops/unselect.cpp; 22s local ... 2025-03-14T06:50:39.3353130Z 2025-03-14T06:50:39.3353788Z  2025-03-14T06:50:39.3354136Z  2025-03-14T06:50:39.3354392Z  2025-03-14T06:50:39.3354705Z  2025-03-14T06:50:39.3354961Z  2025-03-14T06:50:39.3355212Z  2025-03-14T06:50:39.3355676Z  2025-03-14T06:50:39.3355911Z  2025-03-14T06:50:39.3356456Z [20,618 / 20,653] 6 / 17 tests; 21 actions running; last test: ..._client_test 2025-03-14T06:50:39.3357012Z Compiling test/cpp/test_tensor.cpp; 33s local 2025-03-14T06:50:39.3357431Z Compiling torch_xla/csrc/ops/sum.cpp; 29s local 2025-03-14T06:50:39.3357849Z Compiling torch_xla/csrc/ops/topk.cpp; 27s local 2025-03-14T06:50:39.3358306Z Compiling torch_xla/csrc/ops/threshold.cpp; 25s local 2025-03-14T06:50:39.3358800Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 23s local 2025-03-14T06:50:39.3359316Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 22s local 2025-03-14T06:50:39.3359802Z Compiling torch_xla/csrc/ops/unselect.cpp; 22s local 2025-03-14T06:50:39.3360273Z Compiling torch_xla/csrc/ops/uniform.cpp; 21s local ... 2025-03-14T06:50:39.7357223Z 2025-03-14T06:50:39.7357993Z  2025-03-14T06:50:39.7358459Z  2025-03-14T06:50:39.7358880Z  2025-03-14T06:50:39.7359294Z  2025-03-14T06:50:39.7359682Z  2025-03-14T06:50:39.7360074Z  2025-03-14T06:50:39.7360459Z  2025-03-14T06:50:39.7360837Z  2025-03-14T06:50:39.7361762Z [20,619 / 20,653] 6 / 17 tests; 20 actions running; last test: ..._client_test 2025-03-14T06:50:39.7362701Z Compiling test/cpp/test_tensor.cpp; 34s local 2025-03-14T06:50:39.7363427Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2025-03-14T06:50:39.7364156Z Compiling torch_xla/csrc/ops/threshold.cpp; 25s local 2025-03-14T06:50:39.7365079Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 23s local 2025-03-14T06:50:39.7366167Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local 2025-03-14T06:50:39.7367009Z Compiling torch_xla/csrc/ops/unselect.cpp; 22s local 2025-03-14T06:50:39.7367767Z Compiling torch_xla/csrc/ops/uniform.cpp; 22s local 2025-03-14T06:50:39.7368555Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 21s local ... 2025-03-14T06:50:39.9359877Z 2025-03-14T06:50:39.9360679Z  2025-03-14T06:50:39.9361151Z  2025-03-14T06:50:39.9361535Z  2025-03-14T06:50:39.9361915Z  2025-03-14T06:50:39.9362313Z  2025-03-14T06:50:39.9362687Z  2025-03-14T06:50:39.9363093Z  2025-03-14T06:50:39.9363483Z  2025-03-14T06:50:39.9364823Z [20,620 / 20,653] 6 / 17 tests; 19 actions running; last test: ..._client_test 2025-03-14T06:50:39.9366005Z Compiling test/cpp/test_tensor.cpp; 34s local 2025-03-14T06:50:39.9366858Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2025-03-14T06:50:39.9367625Z Compiling torch_xla/csrc/ops/threshold.cpp; 25s local 2025-03-14T06:50:39.9368417Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 23s local 2025-03-14T06:50:39.9369294Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local 2025-03-14T06:50:39.9369950Z Compiling torch_xla/csrc/ops/unselect.cpp; 23s local 2025-03-14T06:50:39.9370554Z Compiling torch_xla/csrc/ops/uniform.cpp; 22s local 2025-03-14T06:50:39.9371155Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 22s local ... 2025-03-14T06:50:40.3363918Z 2025-03-14T06:50:40.3364858Z  2025-03-14T06:50:40.3365585Z  2025-03-14T06:50:40.3366019Z  2025-03-14T06:50:40.3366449Z  2025-03-14T06:50:40.3366822Z  2025-03-14T06:50:40.3367203Z  2025-03-14T06:50:40.3367603Z  2025-03-14T06:50:40.3368047Z  2025-03-14T06:50:40.3369000Z [20,621 / 20,653] 6 / 17 tests; 18 actions running; last test: ..._client_test 2025-03-14T06:50:40.3370019Z Compiling test/cpp/test_tensor.cpp; 34s local 2025-03-14T06:50:40.3370693Z Compiling torch_xla/csrc/ops/sum.cpp; 30s local 2025-03-14T06:50:40.3371687Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 24s local 2025-03-14T06:50:40.3372582Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 23s local 2025-03-14T06:50:40.3373418Z Compiling torch_xla/csrc/ops/unselect.cpp; 23s local 2025-03-14T06:50:40.3375748Z Compiling torch_xla/csrc/ops/uniform.cpp; 22s local 2025-03-14T06:50:40.3376569Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 22s local 2025-03-14T06:50:40.3377345Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 19s local ... 2025-03-14T06:50:41.3369050Z 2025-03-14T06:50:41.3369853Z  2025-03-14T06:50:41.3370306Z  2025-03-14T06:50:41.3370687Z  2025-03-14T06:50:41.3371119Z  2025-03-14T06:50:41.3371487Z  2025-03-14T06:50:41.3371880Z  2025-03-14T06:50:41.3372234Z  2025-03-14T06:50:41.3372598Z  2025-03-14T06:50:41.3373522Z [20,621 / 20,653] 6 / 17 tests; 18 actions running; last test: ..._client_test 2025-03-14T06:50:41.3374446Z Compiling test/cpp/test_tensor.cpp; 35s local 2025-03-14T06:50:41.3375145Z Compiling torch_xla/csrc/ops/sum.cpp; 31s local 2025-03-14T06:50:41.3375942Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 25s local 2025-03-14T06:50:41.3376829Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 24s local 2025-03-14T06:50:41.3377612Z Compiling torch_xla/csrc/ops/unselect.cpp; 24s local 2025-03-14T06:50:41.3378376Z Compiling torch_xla/csrc/ops/uniform.cpp; 23s local 2025-03-14T06:50:41.3379144Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 23s local 2025-03-14T06:50:41.3380000Z Compiling .../csrc/ops/upsample_bilinear2d_backward.cpp; 20s local ... 2025-03-14T06:50:42.3375255Z 2025-03-14T06:50:42.3376059Z  2025-03-14T06:50:42.3376547Z  2025-03-14T06:50:42.3376968Z  2025-03-14T06:50:42.3377397Z  2025-03-14T06:50:42.3377760Z  2025-03-14T06:50:42.3378048Z  2025-03-14T06:50:42.3378327Z  2025-03-14T06:50:42.3378614Z  2025-03-14T06:50:42.3379344Z [20,622 / 20,653] 6 / 17 tests; 17 actions running; last test: ..._client_test 2025-03-14T06:50:42.3380053Z Compiling test/cpp/test_tensor.cpp; 36s local 2025-03-14T06:50:42.3380645Z Compiling torch_xla/csrc/ops/tpu_custom_call.cpp; 26s local 2025-03-14T06:50:42.3381300Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 25s local 2025-03-14T06:50:42.3381960Z Compiling torch_xla/csrc/ops/unselect.cpp; 25s local 2025-03-14T06:50:42.3382725Z Compiling torch_xla/csrc/ops/uniform.cpp; 24s local 2025-03-14T06:50:42.3383539Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 24s local 2025-03-14T06:50:42.3384757Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 21s local 2025-03-14T06:50:42.3385756Z Compiling test/cpp/torch_xla_test.cpp; 20s local ... 2025-03-14T06:50:43.1382177Z 2025-03-14T06:50:43.1382831Z  2025-03-14T06:50:43.1383174Z  2025-03-14T06:50:43.1383431Z  2025-03-14T06:50:43.1383684Z  2025-03-14T06:50:43.1383963Z  2025-03-14T06:50:43.1384199Z  2025-03-14T06:50:43.1384429Z  2025-03-14T06:50:43.1384664Z  2025-03-14T06:50:43.1385209Z [20,623 / 20,653] 6 / 17 tests; 16 actions running; last test: ..._client_test 2025-03-14T06:50:43.1385775Z Compiling test/cpp/test_tensor.cpp; 37s local 2025-03-14T06:50:43.1386246Z Compiling torch_xla/csrc/ops/triangular_solve.cpp; 26s local 2025-03-14T06:50:43.1386742Z Compiling torch_xla/csrc/ops/unselect.cpp; 26s local 2025-03-14T06:50:43.1387178Z Compiling torch_xla/csrc/ops/uniform.cpp; 25s local 2025-03-14T06:50:43.1387632Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 25s local 2025-03-14T06:50:43.1388182Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 21s local 2025-03-14T06:50:43.1388712Z Compiling test/cpp/torch_xla_test.cpp; 21s local 2025-03-14T06:50:43.1389175Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 21s local ... 2025-03-14T06:50:43.7385904Z 2025-03-14T06:50:43.7386569Z  2025-03-14T06:50:43.7386886Z  2025-03-14T06:50:43.7387129Z  2025-03-14T06:50:43.7387366Z  2025-03-14T06:50:43.7387599Z  2025-03-14T06:50:43.7388168Z  2025-03-14T06:50:43.7388400Z  2025-03-14T06:50:43.7388633Z  2025-03-14T06:50:43.7389183Z [20,624 / 20,653] 6 / 17 tests; 15 actions running; last test: ..._client_test 2025-03-14T06:50:43.7389739Z Compiling test/cpp/test_tensor.cpp; 38s local 2025-03-14T06:50:43.7390178Z Compiling torch_xla/csrc/ops/unselect.cpp; 26s local 2025-03-14T06:50:43.7390617Z Compiling torch_xla/csrc/ops/uniform.cpp; 26s local 2025-03-14T06:50:43.7391067Z Compiling torch_xla/csrc/ops/unsqueeze.cpp; 25s local 2025-03-14T06:50:43.7391608Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 22s local 2025-03-14T06:50:43.7392131Z Compiling test/cpp/torch_xla_test.cpp; 22s local 2025-03-14T06:50:43.7392579Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 21s local 2025-03-14T06:50:43.7393071Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 21s local ... 2025-03-14T06:50:44.7393898Z 2025-03-14T06:50:44.7394565Z  2025-03-14T06:50:44.7395008Z  2025-03-14T06:50:44.7395283Z  2025-03-14T06:50:44.7395556Z  2025-03-14T06:50:44.7395838Z  2025-03-14T06:50:44.7396102Z  2025-03-14T06:50:44.7396361Z  2025-03-14T06:50:44.7396607Z  2025-03-14T06:50:44.7397144Z [20,625 / 20,653] 6 / 17 tests; 14 actions running; last test: ..._client_test 2025-03-14T06:50:44.7397705Z Compiling test/cpp/test_tensor.cpp; 39s local 2025-03-14T06:50:44.7398142Z Compiling torch_xla/csrc/ops/unselect.cpp; 27s local 2025-03-14T06:50:44.7398598Z Compiling torch_xla/csrc/ops/uniform.cpp; 27s local 2025-03-14T06:50:44.7399129Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 23s local 2025-03-14T06:50:44.7399653Z Compiling test/cpp/torch_xla_test.cpp; 23s local 2025-03-14T06:50:44.7400107Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 22s local 2025-03-14T06:50:44.7400579Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 22s local 2025-03-14T06:50:44.7401071Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 22s local ... 2025-03-14T06:50:45.7401382Z 2025-03-14T06:50:45.7402036Z  2025-03-14T06:50:45.7402406Z  2025-03-14T06:50:45.7402679Z  2025-03-14T06:50:45.7402949Z  2025-03-14T06:50:45.7403230Z  2025-03-14T06:50:45.7403482Z  2025-03-14T06:50:45.7403735Z  2025-03-14T06:50:45.7403988Z  2025-03-14T06:50:45.7404900Z [20,625 / 20,653] 6 / 17 tests; 14 actions running; last test: ..._client_test 2025-03-14T06:50:45.7405550Z Compiling test/cpp/test_tensor.cpp; 40s local 2025-03-14T06:50:45.7405999Z Compiling torch_xla/csrc/ops/unselect.cpp; 28s local 2025-03-14T06:50:45.7406452Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2025-03-14T06:50:45.7406996Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 24s local 2025-03-14T06:50:45.7407525Z Compiling test/cpp/torch_xla_test.cpp; 24s local 2025-03-14T06:50:45.7407975Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 23s local 2025-03-14T06:50:45.7408464Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 23s local 2025-03-14T06:50:45.7408966Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 23s local ... 2025-03-14T06:50:46.1406110Z 2025-03-14T06:50:46.1406778Z  2025-03-14T06:50:46.1407132Z  2025-03-14T06:50:46.1407411Z  2025-03-14T06:50:46.1407670Z  2025-03-14T06:50:46.1407918Z  2025-03-14T06:50:46.1408196Z  2025-03-14T06:50:46.1408430Z  2025-03-14T06:50:46.1408664Z  2025-03-14T06:50:46.1409218Z [20,626 / 20,653] 6 / 17 tests; 13 actions running; last test: ..._client_test 2025-03-14T06:50:46.1409775Z Compiling test/cpp/test_tensor.cpp; 40s local 2025-03-14T06:50:46.1410210Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2025-03-14T06:50:46.1410944Z Compiling torch_xla/csrc/ops/upsample_bilinear2d_backward.cpp; 24s local 2025-03-14T06:50:46.1411476Z Compiling test/cpp/torch_xla_test.cpp; 24s local 2025-03-14T06:50:46.1412018Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 24s local 2025-03-14T06:50:46.1412496Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 23s local 2025-03-14T06:50:46.1412969Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 23s local 2025-03-14T06:50:46.1413460Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 21s local ... 2025-03-14T06:50:46.5407498Z 2025-03-14T06:50:46.5408170Z  2025-03-14T06:50:46.5408544Z  2025-03-14T06:50:46.5408804Z  2025-03-14T06:50:46.5409052Z  2025-03-14T06:50:46.5409302Z  2025-03-14T06:50:46.5409525Z  2025-03-14T06:50:46.5409756Z  2025-03-14T06:50:46.5409989Z  2025-03-14T06:50:46.5410532Z [20,627 / 20,653] 6 / 17 tests; 12 actions running; last test: ..._client_test 2025-03-14T06:50:46.5411106Z Compiling test/cpp/test_tensor.cpp; 41s local 2025-03-14T06:50:46.5411539Z Compiling torch_xla/csrc/ops/uniform.cpp; 28s local 2025-03-14T06:50:46.5411976Z Compiling test/cpp/torch_xla_test.cpp; 25s local 2025-03-14T06:50:46.5412424Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 24s local 2025-03-14T06:50:46.5412899Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 24s local 2025-03-14T06:50:46.5413373Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 23s local 2025-03-14T06:50:46.5413841Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 22s local 2025-03-14T06:50:46.5414332Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 22s local ... 2025-03-14T06:50:47.7413005Z 2025-03-14T06:50:47.7413677Z  2025-03-14T06:50:47.7414046Z  2025-03-14T06:50:47.7414311Z  2025-03-14T06:50:47.7414567Z  2025-03-14T06:50:47.7414818Z  2025-03-14T06:50:47.7415058Z  2025-03-14T06:50:47.7415304Z  2025-03-14T06:50:47.7415538Z  2025-03-14T06:50:47.7416076Z [20,627 / 20,653] 6 / 17 tests; 12 actions running; last test: ..._client_test 2025-03-14T06:50:47.7416629Z Compiling test/cpp/test_tensor.cpp; 42s local 2025-03-14T06:50:47.7417067Z Compiling torch_xla/csrc/ops/uniform.cpp; 30s local 2025-03-14T06:50:47.7417507Z Compiling test/cpp/torch_xla_test.cpp; 26s local 2025-03-14T06:50:47.7417955Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 25s local 2025-03-14T06:50:47.7418432Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 25s local 2025-03-14T06:50:47.7419108Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 25s local 2025-03-14T06:50:47.7419598Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 23s local 2025-03-14T06:50:47.7420155Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 23s local ... 2025-03-14T06:50:48.1416535Z 2025-03-14T06:50:48.1417138Z  2025-03-14T06:50:48.1417441Z  2025-03-14T06:50:48.1417712Z  2025-03-14T06:50:48.1417955Z  2025-03-14T06:50:48.1418198Z  2025-03-14T06:50:48.1418437Z  2025-03-14T06:50:48.1418675Z  2025-03-14T06:50:48.1418908Z  2025-03-14T06:50:48.1419436Z [20,628 / 20,653] 6 / 17 tests; 11 actions running; last test: ..._client_test 2025-03-14T06:50:48.1420008Z Compiling test/cpp/test_tensor.cpp; 42s local 2025-03-14T06:50:48.1420435Z Compiling test/cpp/torch_xla_test.cpp; 26s local 2025-03-14T06:50:48.1420888Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 26s local 2025-03-14T06:50:48.1421365Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 25s local 2025-03-14T06:50:48.1421859Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 25s local 2025-03-14T06:50:48.1422342Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 23s local 2025-03-14T06:50:48.1422818Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 23s local 2025-03-14T06:50:48.1423317Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 23s local ... 2025-03-14T06:50:48.7424423Z 2025-03-14T06:50:48.7425077Z  2025-03-14T06:50:48.7425377Z  2025-03-14T06:50:48.7425625Z  2025-03-14T06:50:48.7425867Z  2025-03-14T06:50:48.7426119Z  2025-03-14T06:50:48.7426585Z  2025-03-14T06:50:48.7426823Z  2025-03-14T06:50:48.7427064Z  2025-03-14T06:50:48.7427620Z [20,629 / 20,653] 6 / 17 tests; 10 actions running; last test: ..._client_test 2025-03-14T06:50:48.7428190Z Compiling test/cpp/torch_xla_test.cpp; 27s local 2025-03-14T06:50:48.7428659Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 26s local 2025-03-14T06:50:48.7429152Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 26s local 2025-03-14T06:50:48.7429638Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 26s local 2025-03-14T06:50:48.7430106Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 24s local 2025-03-14T06:50:48.7430582Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 24s local 2025-03-14T06:50:48.7431064Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 24s local 2025-03-14T06:50:48.7431507Z Compiling test/cpp/test_ir.cpp; 22s local ... 2025-03-14T06:50:48.9600883Z 2025-03-14T06:50:48.9601554Z  2025-03-14T06:50:48.9601884Z  2025-03-14T06:50:48.9602123Z  2025-03-14T06:50:48.9602362Z  2025-03-14T06:50:48.9602596Z  2025-03-14T06:50:48.9602833Z  2025-03-14T06:50:48.9603063Z  2025-03-14T06:50:48.9603301Z  2025-03-14T06:50:48.9603848Z [20,630 / 20,653] 6 / 17 tests; 10 actions, 9 running; last test: ...ient_test 2025-03-14T06:50:48.9604431Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 26s local 2025-03-14T06:50:48.9605160Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 26s local 2025-03-14T06:50:48.9605648Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 26s local 2025-03-14T06:50:48.9606125Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 24s local 2025-03-14T06:50:48.9606596Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 24s local 2025-03-14T06:50:48.9607075Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 24s local 2025-03-14T06:50:48.9607499Z Compiling test/cpp/test_ir.cpp; 22s local 2025-03-14T06:50:48.9607941Z Compiling test/cpp/test_replication.cpp; 22s local ... 2025-03-14T06:50:49.3428528Z 2025-03-14T06:50:49.3429296Z  2025-03-14T06:50:49.3429773Z  2025-03-14T06:50:49.3430155Z  2025-03-14T06:50:49.3430527Z  2025-03-14T06:50:49.3430926Z  2025-03-14T06:50:49.3431311Z  2025-03-14T06:50:49.3431698Z  2025-03-14T06:50:49.3432095Z  2025-03-14T06:50:49.3433203Z [20,631 / 20,653] 6 / 17 tests; 12 actions running; last test: ..._client_test 2025-03-14T06:50:49.3434312Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 27s local 2025-03-14T06:50:49.3435099Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 27s local 2025-03-14T06:50:49.3435895Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 26s local 2025-03-14T06:50:49.3436715Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 25s local 2025-03-14T06:50:49.3437524Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 24s local 2025-03-14T06:50:49.3438287Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 24s local 2025-03-14T06:50:49.3438986Z Compiling test/cpp/test_ir.cpp; 23s local 2025-03-14T06:50:49.3439704Z Compiling test/cpp/test_replication.cpp; 22s local ... 2025-03-14T06:50:50.3434736Z 2025-03-14T06:50:50.3435381Z  2025-03-14T06:50:50.3435677Z  2025-03-14T06:50:50.3435920Z  2025-03-14T06:50:50.3436158Z  2025-03-14T06:50:50.3436393Z  2025-03-14T06:50:50.3436652Z  2025-03-14T06:50:50.3436885Z  2025-03-14T06:50:50.3437117Z  2025-03-14T06:50:50.3437666Z [20,631 / 20,653] 6 / 17 tests; 12 actions running; last test: ..._client_test 2025-03-14T06:50:50.3438261Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 28s local 2025-03-14T06:50:50.3438957Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 28s local 2025-03-14T06:50:50.3439435Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 27s local 2025-03-14T06:50:50.3439907Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 26s local 2025-03-14T06:50:50.3440453Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 25s local 2025-03-14T06:50:50.3440927Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 25s local 2025-03-14T06:50:50.3441341Z Compiling test/cpp/test_ir.cpp; 24s local 2025-03-14T06:50:50.3441770Z Compiling test/cpp/test_replication.cpp; 23s local ... 2025-03-14T06:50:51.3441710Z 2025-03-14T06:50:51.3442359Z  2025-03-14T06:50:51.3442754Z  2025-03-14T06:50:51.3443028Z  2025-03-14T06:50:51.3443290Z  2025-03-14T06:50:51.3443552Z  2025-03-14T06:50:51.3443831Z  2025-03-14T06:50:51.3444084Z  2025-03-14T06:50:51.3444324Z  2025-03-14T06:50:51.3445012Z [20,631 / 20,653] 6 / 17 tests; 12 actions running; last test: ..._client_test 2025-03-14T06:50:51.3445618Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 29s local 2025-03-14T06:50:51.3446103Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 29s local 2025-03-14T06:50:51.3446588Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 28s local 2025-03-14T06:50:51.3447063Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 27s local 2025-03-14T06:50:51.3447525Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 26s local 2025-03-14T06:50:51.3448003Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 26s local 2025-03-14T06:50:51.3448434Z Compiling test/cpp/test_ir.cpp; 25s local 2025-03-14T06:50:51.3448868Z Compiling test/cpp/test_replication.cpp; 24s local ... 2025-03-14T06:50:52.5447517Z 2025-03-14T06:50:52.5448150Z  2025-03-14T06:50:52.5448481Z  2025-03-14T06:50:52.5448733Z  2025-03-14T06:50:52.5448981Z  2025-03-14T06:50:52.5449218Z  2025-03-14T06:50:52.5449456Z  2025-03-14T06:50:52.5449702Z  2025-03-14T06:50:52.5449935Z  2025-03-14T06:50:52.5450490Z [20,631 / 20,653] 6 / 17 tests; 12 actions running; last test: ..._client_test 2025-03-14T06:50:52.5451090Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 30s local 2025-03-14T06:50:52.5451585Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 30s local 2025-03-14T06:50:52.5452053Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 29s local 2025-03-14T06:50:52.5452533Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 28s local 2025-03-14T06:50:52.5453008Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 28s local 2025-03-14T06:50:52.5453660Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 28s local 2025-03-14T06:50:52.5454098Z Compiling test/cpp/test_ir.cpp; 26s local 2025-03-14T06:50:52.5455330Z Compiling test/cpp/test_replication.cpp; 25s local ... 2025-03-14T06:50:53.3920835Z 2025-03-14T06:50:53.3921483Z  2025-03-14T06:50:53.3921784Z  2025-03-14T06:50:53.3922025Z  2025-03-14T06:50:53.3922291Z  2025-03-14T06:50:53.3922525Z  2025-03-14T06:50:53.3922765Z  2025-03-14T06:50:53.3923000Z  2025-03-14T06:50:53.3923235Z  2025-03-14T06:50:53.3923779Z [20,632 / 20,653] 6 / 17 tests; 12 actions, 11 running; last test: ...ent_test 2025-03-14T06:50:53.3924363Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 31s local 2025-03-14T06:50:53.3924977Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 31s local 2025-03-14T06:50:53.3925456Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 30s local 2025-03-14T06:50:53.3925929Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 29s local 2025-03-14T06:50:53.3926403Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 29s local 2025-03-14T06:50:53.3926882Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 28s local 2025-03-14T06:50:53.3927307Z Compiling test/cpp/test_ir.cpp; 27s local 2025-03-14T06:50:53.3927734Z Compiling test/cpp/test_replication.cpp; 26s local ... 2025-03-14T06:50:53.7453524Z 2025-03-14T06:50:53.7454163Z  2025-03-14T06:50:53.7454506Z  2025-03-14T06:50:53.7454783Z  2025-03-14T06:50:53.7455040Z  2025-03-14T06:50:53.7455292Z  2025-03-14T06:50:53.7455777Z  2025-03-14T06:50:53.7456014Z  2025-03-14T06:50:53.7456249Z  2025-03-14T06:50:53.7456794Z [20,634 / 20,653] 6 / 17 tests; 11 actions running; last test: ..._client_test 2025-03-14T06:50:53.7457392Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 31s local 2025-03-14T06:50:53.7457877Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 31s local 2025-03-14T06:50:53.7458359Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 31s local 2025-03-14T06:50:53.7458839Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 29s local 2025-03-14T06:50:53.7459305Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 29s local 2025-03-14T06:50:53.7459774Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 29s local 2025-03-14T06:50:53.7460206Z Compiling test/cpp/test_ir.cpp; 27s local 2025-03-14T06:50:53.7460629Z Compiling test/cpp/test_replication.cpp; 26s local ... 2025-03-14T06:50:54.7464023Z 2025-03-14T06:50:54.7464655Z  2025-03-14T06:50:54.7464978Z  2025-03-14T06:50:54.7465217Z  2025-03-14T06:50:54.7465679Z  2025-03-14T06:50:54.7465918Z  2025-03-14T06:50:54.7466150Z  2025-03-14T06:50:54.7466383Z  2025-03-14T06:50:54.7466615Z  2025-03-14T06:50:54.7467161Z [20,634 / 20,653] 6 / 17 tests; 11 actions running; last test: ..._client_test 2025-03-14T06:50:54.7467766Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 32s local 2025-03-14T06:50:54.7468254Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 32s local 2025-03-14T06:50:54.7468737Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 32s local 2025-03-14T06:50:54.7469211Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 30s local 2025-03-14T06:50:54.7469687Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 30s local 2025-03-14T06:50:54.7470153Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 30s local 2025-03-14T06:50:54.7470579Z Compiling test/cpp/test_ir.cpp; 28s local 2025-03-14T06:50:54.7471012Z Compiling test/cpp/test_replication.cpp; 27s local ... 2025-03-14T06:50:55.7469969Z 2025-03-14T06:50:55.7470611Z  2025-03-14T06:50:55.7470950Z  2025-03-14T06:50:55.7471209Z  2025-03-14T06:50:55.7471495Z  2025-03-14T06:50:55.7471752Z  2025-03-14T06:50:55.7471993Z  2025-03-14T06:50:55.7472231Z  2025-03-14T06:50:55.7472472Z  2025-03-14T06:50:55.7473247Z [20,634 / 20,653] 6 / 17 tests; 11 actions running; last test: ..._client_test 2025-03-14T06:50:55.7473923Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 33s local 2025-03-14T06:50:55.7474420Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 33s local 2025-03-14T06:50:55.7474909Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 33s local 2025-03-14T06:50:55.7475396Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 31s local 2025-03-14T06:50:55.7475876Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 31s local 2025-03-14T06:50:55.7476357Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 31s local 2025-03-14T06:50:55.7476798Z Compiling test/cpp/test_ir.cpp; 29s local 2025-03-14T06:50:55.7477225Z Compiling test/cpp/test_replication.cpp; 28s local ... 2025-03-14T06:50:56.9473403Z 2025-03-14T06:50:56.9474079Z  2025-03-14T06:50:56.9474429Z  2025-03-14T06:50:56.9474707Z  2025-03-14T06:50:56.9474963Z  2025-03-14T06:50:56.9475211Z  2025-03-14T06:50:56.9475477Z  2025-03-14T06:50:56.9475721Z  2025-03-14T06:50:56.9475962Z  2025-03-14T06:50:56.9476531Z [20,634 / 20,653] 6 / 17 tests; 11 actions running; last test: ..._client_test 2025-03-14T06:50:56.9477124Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 34s local 2025-03-14T06:50:56.9477805Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 34s local 2025-03-14T06:50:56.9478280Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 34s local 2025-03-14T06:50:56.9478751Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 32s local 2025-03-14T06:50:56.9479306Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 32s local 2025-03-14T06:50:56.9479779Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 32s local 2025-03-14T06:50:56.9480211Z Compiling test/cpp/test_ir.cpp; 30s local 2025-03-14T06:50:56.9480623Z Compiling test/cpp/test_replication.cpp; 30s local ... 2025-03-14T06:50:57.9482415Z 2025-03-14T06:50:57.9483059Z  2025-03-14T06:50:57.9483433Z  2025-03-14T06:50:57.9483691Z  2025-03-14T06:50:57.9483943Z  2025-03-14T06:50:57.9484194Z  2025-03-14T06:50:57.9484570Z  2025-03-14T06:50:57.9484845Z  2025-03-14T06:50:57.9485082Z  2025-03-14T06:50:57.9485626Z [20,634 / 20,653] 6 / 17 tests; 11 actions running; last test: ..._client_test 2025-03-14T06:50:57.9486227Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 35s local 2025-03-14T06:50:57.9486717Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 35s local 2025-03-14T06:50:57.9487205Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 35s local 2025-03-14T06:50:57.9487681Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 33s local 2025-03-14T06:50:57.9488156Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 33s local 2025-03-14T06:50:57.9488629Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 33s local 2025-03-14T06:50:57.9489059Z Compiling test/cpp/test_ir.cpp; 31s local 2025-03-14T06:50:57.9489479Z Compiling test/cpp/test_replication.cpp; 31s local ... 2025-03-14T06:50:58.2370489Z 2025-03-14T06:50:58.2371116Z  2025-03-14T06:50:58.2371454Z  2025-03-14T06:50:58.2371703Z  2025-03-14T06:50:58.2371940Z  2025-03-14T06:50:58.2372186Z  2025-03-14T06:50:58.2372423Z  2025-03-14T06:50:58.2372658Z  2025-03-14T06:50:58.2372897Z  2025-03-14T06:50:58.2373456Z [20,635 / 20,654] 6 / 17 tests; 11 actions, 10 running; last test: ...ent_test 2025-03-14T06:50:58.2374049Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 36s local 2025-03-14T06:50:58.2374541Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 35s local 2025-03-14T06:50:58.2375020Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 35s local 2025-03-14T06:50:58.2375494Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 34s local 2025-03-14T06:50:58.2375952Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 33s local 2025-03-14T06:50:58.2376611Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 33s local 2025-03-14T06:50:58.2377049Z Compiling test/cpp/test_ir.cpp; 32s local 2025-03-14T06:50:58.2377532Z Compiling test/cpp/test_replication.cpp; 31s local ... 2025-03-14T06:50:58.5486505Z 2025-03-14T06:50:58.5487266Z  2025-03-14T06:50:58.5487564Z  2025-03-14T06:50:58.5487813Z  2025-03-14T06:50:58.5488101Z  2025-03-14T06:50:58.5488342Z  2025-03-14T06:50:58.5488580Z  2025-03-14T06:50:58.5488804Z  2025-03-14T06:50:58.5489043Z  2025-03-14T06:50:58.5489595Z [20,637 / 20,656] 6 / 17 tests; 11 actions running; last test: ..._client_test 2025-03-14T06:50:58.5490209Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 36s local 2025-03-14T06:50:58.5490700Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 36s local 2025-03-14T06:50:58.5491179Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 35s local 2025-03-14T06:50:58.5491651Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 34s local 2025-03-14T06:50:58.5492129Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 34s local 2025-03-14T06:50:58.5492605Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 34s local 2025-03-14T06:50:58.5493030Z Compiling test/cpp/test_ir.cpp; 32s local 2025-03-14T06:50:58.5493452Z Compiling test/cpp/test_replication.cpp; 31s local ... 2025-03-14T06:50:58.8714686Z 2025-03-14T06:50:58.8715319Z  2025-03-14T06:50:58.8715685Z  2025-03-14T06:50:58.8715958Z  2025-03-14T06:50:58.8716217Z  2025-03-14T06:50:58.8716476Z  2025-03-14T06:50:58.8716951Z  2025-03-14T06:50:58.8717192Z  2025-03-14T06:50:58.8717437Z  2025-03-14T06:50:58.8717996Z [20,637 / 20,656] 7 / 17 tests; 11 actions running; last test: ...pp:test_lazy 2025-03-14T06:50:58.8718600Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 36s local 2025-03-14T06:50:58.8719090Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 36s local 2025-03-14T06:50:58.8719583Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 36s local 2025-03-14T06:50:58.8720071Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 34s local 2025-03-14T06:50:58.8720549Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 34s local 2025-03-14T06:50:58.8721028Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 34s local 2025-03-14T06:50:58.8721451Z Compiling test/cpp/test_ir.cpp; 32s local 2025-03-14T06:50:58.8721886Z Compiling test/cpp/test_replication.cpp; 31s local ... 2025-03-14T06:50:59.1489428Z 2025-03-14T06:50:59.1490233Z  2025-03-14T06:50:59.1490701Z  2025-03-14T06:50:59.1491100Z  2025-03-14T06:50:59.1491493Z  2025-03-14T06:50:59.1491881Z  2025-03-14T06:50:59.1492261Z  2025-03-14T06:50:59.1492641Z  2025-03-14T06:50:59.1493019Z  2025-03-14T06:50:59.1493899Z [20,639 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:50:59.1494914Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 37s local 2025-03-14T06:50:59.1495750Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 36s local 2025-03-14T06:50:59.1496573Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 36s local 2025-03-14T06:50:59.1497385Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 34s local 2025-03-14T06:50:59.1498199Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 34s local 2025-03-14T06:50:59.1499033Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 34s local 2025-03-14T06:50:59.1499764Z Compiling test/cpp/test_ir.cpp; 33s local 2025-03-14T06:50:59.1500491Z Compiling test/cpp/test_replication.cpp; 32s local ... 2025-03-14T06:51:00.3496146Z 2025-03-14T06:51:00.3496912Z  2025-03-14T06:51:00.3497366Z  2025-03-14T06:51:00.3497763Z  2025-03-14T06:51:00.3498177Z  2025-03-14T06:51:00.3498563Z  2025-03-14T06:51:00.3498957Z  2025-03-14T06:51:00.3499338Z  2025-03-14T06:51:00.3499727Z  2025-03-14T06:51:00.3500848Z [20,639 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:00.3501977Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 38s local 2025-03-14T06:51:00.3502810Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 38s local 2025-03-14T06:51:00.3503644Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 37s local 2025-03-14T06:51:00.3504477Z Compiling test/cpp/test_aten_xla_tensor_3.cpp; 36s local 2025-03-14T06:51:00.3505297Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 35s local 2025-03-14T06:51:00.3506125Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 35s local 2025-03-14T06:51:00.3506873Z Compiling test/cpp/test_ir.cpp; 34s local 2025-03-14T06:51:00.3507567Z Compiling test/cpp/test_replication.cpp; 33s local ... 2025-03-14T06:51:00.6824385Z 2025-03-14T06:51:00.6825148Z  2025-03-14T06:51:00.6825639Z  2025-03-14T06:51:00.6826060Z  2025-03-14T06:51:00.6826480Z  2025-03-14T06:51:00.6826888Z  2025-03-14T06:51:00.6827313Z  2025-03-14T06:51:00.6827697Z  2025-03-14T06:51:00.6828089Z  2025-03-14T06:51:00.6829012Z [20,640 / 20,656] 8 / 17 tests; 9 actions, 8 running; last test: ...a_sharding 2025-03-14T06:51:00.6830107Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 38s local 2025-03-14T06:51:00.6831211Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 38s local 2025-03-14T06:51:00.6832101Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 37s local 2025-03-14T06:51:00.6832985Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 36s local 2025-03-14T06:51:00.6833957Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 36s local 2025-03-14T06:51:00.6834729Z Compiling test/cpp/test_ir.cpp; 34s local 2025-03-14T06:51:00.6835445Z Compiling test/cpp/test_replication.cpp; 33s local 2025-03-14T06:51:00.6836207Z Testing //test/cpp:test_tensor; 2s local ... 2025-03-14T06:51:00.9499368Z 2025-03-14T06:51:00.9500161Z  2025-03-14T06:51:00.9500659Z  2025-03-14T06:51:00.9501085Z  2025-03-14T06:51:00.9501473Z  2025-03-14T06:51:00.9501893Z  2025-03-14T06:51:00.9502261Z  2025-03-14T06:51:00.9502659Z  2025-03-14T06:51:00.9503064Z  2025-03-14T06:51:00.9504018Z [20,640 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:00.9505046Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 38s local 2025-03-14T06:51:00.9505902Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 38s local 2025-03-14T06:51:00.9506781Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 38s local 2025-03-14T06:51:00.9507641Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 36s local 2025-03-14T06:51:00.9508456Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 36s local 2025-03-14T06:51:00.9509189Z Compiling test/cpp/test_ir.cpp; 34s local 2025-03-14T06:51:00.9509867Z Compiling test/cpp/test_replication.cpp; 34s local 2025-03-14T06:51:00.9510655Z Testing //test/cpp:test_tensor; 2s local ... 2025-03-14T06:51:01.4561102Z 2025-03-14T06:51:01.4561873Z  2025-03-14T06:51:01.4562333Z  2025-03-14T06:51:01.4562761Z  2025-03-14T06:51:01.4563146Z  2025-03-14T06:51:01.4563612Z  2025-03-14T06:51:01.4564008Z  2025-03-14T06:51:01.4564400Z  2025-03-14T06:51:01.4564854Z  2025-03-14T06:51:01.4565874Z [20,641 / 20,656] 8 / 17 tests; 9 actions, 8 running; last test: ...a_sharding 2025-03-14T06:51:01.4566887Z Compiling test/cpp/test_aten_xla_tensor_5.cpp; 39s local 2025-03-14T06:51:01.4567720Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 39s local 2025-03-14T06:51:01.4568539Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 38s local 2025-03-14T06:51:01.4569353Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 37s local 2025-03-14T06:51:01.4570175Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 36s local 2025-03-14T06:51:01.4570915Z Compiling test/cpp/test_ir.cpp; 35s local 2025-03-14T06:51:01.4571759Z Testing //test/cpp:test_tensor; 3s local 2025-03-14T06:51:01.4572572Z Linking test/cpp/test_aten_xla_tensor_3; 0s local ... 2025-03-14T06:51:01.6723673Z 2025-03-14T06:51:01.6724577Z  2025-03-14T06:51:01.6725068Z  2025-03-14T06:51:01.6725486Z  2025-03-14T06:51:01.6725910Z  2025-03-14T06:51:01.6726347Z  2025-03-14T06:51:01.6726774Z  2025-03-14T06:51:01.6727189Z  2025-03-14T06:51:01.6727596Z  2025-03-14T06:51:01.6728577Z [20,642 / 20,656] 8 / 17 tests; 9 actions, 8 running; last test: ...a_sharding 2025-03-14T06:51:01.6729704Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 39s local 2025-03-14T06:51:01.6730616Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 38s local 2025-03-14T06:51:01.6731531Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 37s local 2025-03-14T06:51:01.6732436Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 37s local 2025-03-14T06:51:01.6733258Z Compiling test/cpp/test_ir.cpp; 35s local 2025-03-14T06:51:01.6733959Z Testing //test/cpp:test_tensor; 3s local 2025-03-14T06:51:01.6734705Z Linking test/cpp/test_aten_xla_tensor_3; 0s local 2025-03-14T06:51:01.6735501Z Linking test/cpp/test_replication; 0s local ... 2025-03-14T06:51:01.9520985Z 2025-03-14T06:51:01.9521742Z  2025-03-14T06:51:01.9522429Z  2025-03-14T06:51:01.9522806Z  2025-03-14T06:51:01.9523196Z  2025-03-14T06:51:01.9523592Z  2025-03-14T06:51:01.9524003Z  2025-03-14T06:51:01.9524393Z  2025-03-14T06:51:01.9524999Z  2025-03-14T06:51:01.9525889Z [20,642 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:01.9526846Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 39s local 2025-03-14T06:51:01.9527628Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 39s local 2025-03-14T06:51:01.9528433Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 37s local 2025-03-14T06:51:01.9529247Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 37s local 2025-03-14T06:51:01.9530003Z Compiling test/cpp/test_ir.cpp; 35s local 2025-03-14T06:51:01.9530655Z Testing //test/cpp:test_tensor; 3s local 2025-03-14T06:51:01.9531305Z Linking test/cpp/test_aten_xla_tensor_3; 1s local 2025-03-14T06:51:01.9532000Z Linking test/cpp/test_replication; 0s local ... 2025-03-14T06:51:02.9553763Z 2025-03-14T06:51:02.9554515Z  2025-03-14T06:51:02.9554966Z  2025-03-14T06:51:02.9555331Z  2025-03-14T06:51:02.9555707Z  2025-03-14T06:51:02.9556113Z  2025-03-14T06:51:02.9556495Z  2025-03-14T06:51:02.9556879Z  2025-03-14T06:51:02.9557247Z  2025-03-14T06:51:02.9558083Z [20,642 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:02.9558975Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 40s local 2025-03-14T06:51:02.9559662Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 40s local 2025-03-14T06:51:02.9560378Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 38s local 2025-03-14T06:51:02.9561082Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 38s local 2025-03-14T06:51:02.9561769Z Compiling test/cpp/test_ir.cpp; 36s local 2025-03-14T06:51:02.9562388Z Testing //test/cpp:test_tensor; 4s local 2025-03-14T06:51:02.9562908Z Linking test/cpp/test_aten_xla_tensor_3; 2s local 2025-03-14T06:51:02.9563488Z Linking test/cpp/test_replication; 1s local ... 2025-03-14T06:51:03.1556046Z 2025-03-14T06:51:03.1556813Z  2025-03-14T06:51:03.1557227Z  2025-03-14T06:51:03.1557551Z  2025-03-14T06:51:03.1557857Z  2025-03-14T06:51:03.1558167Z  2025-03-14T06:51:03.1558482Z  2025-03-14T06:51:03.1558808Z  2025-03-14T06:51:03.1559131Z  2025-03-14T06:51:03.1568953Z [20,643 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:03.1570113Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 40s local 2025-03-14T06:51:03.1570907Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 40s local 2025-03-14T06:51:03.1571754Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 38s local 2025-03-14T06:51:03.1572591Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 38s local 2025-03-14T06:51:03.1573293Z Testing //test/cpp:test_tensor; 4s local 2025-03-14T06:51:03.1573940Z Linking test/cpp/test_aten_xla_tensor_3; 2s local 2025-03-14T06:51:03.1574597Z Linking test/cpp/test_replication; 1s local 2025-03-14T06:51:03.1575278Z Linking test/cpp/test_aten_xla_tensor_5; 1s local ... 2025-03-14T06:51:04.3562973Z 2025-03-14T06:51:04.3563739Z  2025-03-14T06:51:04.3564156Z  2025-03-14T06:51:04.3564590Z  2025-03-14T06:51:04.3564979Z  2025-03-14T06:51:04.3565511Z  2025-03-14T06:51:04.3565873Z  2025-03-14T06:51:04.3566266Z  2025-03-14T06:51:04.3566655Z  2025-03-14T06:51:04.3567495Z [20,643 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:04.3568408Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 42s local 2025-03-14T06:51:04.3569165Z Compiling test/cpp/test_aten_xla_tensor_6.cpp; 41s local 2025-03-14T06:51:04.3569906Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 39s local 2025-03-14T06:51:04.3570901Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 39s local 2025-03-14T06:51:04.3571551Z Testing //test/cpp:test_tensor; 6s local 2025-03-14T06:51:04.3572165Z Linking test/cpp/test_aten_xla_tensor_3; 3s local 2025-03-14T06:51:04.3572888Z Linking test/cpp/test_replication; 2s local 2025-03-14T06:51:04.3573572Z Linking test/cpp/test_aten_xla_tensor_5; 2s local ... 2025-03-14T06:51:04.5676683Z 2025-03-14T06:51:04.5677457Z  2025-03-14T06:51:04.5677875Z  2025-03-14T06:51:04.5678248Z  2025-03-14T06:51:04.5678615Z  2025-03-14T06:51:04.5678988Z  2025-03-14T06:51:04.5679356Z  2025-03-14T06:51:04.5679721Z  2025-03-14T06:51:04.5680115Z  2025-03-14T06:51:04.5680957Z [20,644 / 20,656] 8 / 17 tests; 9 actions, 8 running; last test: ...a_sharding 2025-03-14T06:51:04.5681914Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 42s local 2025-03-14T06:51:04.5682701Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 40s local 2025-03-14T06:51:04.5683492Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 40s local 2025-03-14T06:51:04.5684154Z Testing //test/cpp:test_tensor; 6s local 2025-03-14T06:51:04.5684873Z Linking test/cpp/test_aten_xla_tensor_3; 3s local 2025-03-14T06:51:04.5685531Z Linking test/cpp/test_replication; 3s local 2025-03-14T06:51:04.5686196Z Linking test/cpp/test_aten_xla_tensor_5; 2s local 2025-03-14T06:51:04.5686837Z Linking test/cpp/test_ir; 1s local ... 2025-03-14T06:51:04.9567185Z 2025-03-14T06:51:04.9567941Z  2025-03-14T06:51:04.9568397Z  2025-03-14T06:51:04.9568795Z  2025-03-14T06:51:04.9569191Z  2025-03-14T06:51:04.9569586Z  2025-03-14T06:51:04.9569970Z  2025-03-14T06:51:04.9570361Z  2025-03-14T06:51:04.9570753Z  2025-03-14T06:51:04.9571639Z [20,644 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:04.9572651Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 42s local 2025-03-14T06:51:04.9573479Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 40s local 2025-03-14T06:51:04.9574306Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 40s local 2025-03-14T06:51:04.9575050Z Testing //test/cpp:test_tensor; 6s local 2025-03-14T06:51:04.9575706Z Linking test/cpp/test_aten_xla_tensor_3; 4s local 2025-03-14T06:51:04.9576407Z Linking test/cpp/test_replication; 3s local 2025-03-14T06:51:04.9577097Z Linking test/cpp/test_aten_xla_tensor_5; 3s local 2025-03-14T06:51:04.9577762Z Linking test/cpp/test_ir; 1s local ... 2025-03-14T06:51:06.1575581Z 2025-03-14T06:51:06.1576517Z  2025-03-14T06:51:06.1577317Z  2025-03-14T06:51:06.1577807Z  2025-03-14T06:51:06.1578310Z  2025-03-14T06:51:06.1578868Z  2025-03-14T06:51:06.1579335Z  2025-03-14T06:51:06.1579883Z  2025-03-14T06:51:06.1580299Z  2025-03-14T06:51:06.1581264Z [20,644 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:06.1582387Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 43s local 2025-03-14T06:51:06.1583298Z Compiling test/cpp/test_aten_xla_tensor_4.cpp; 41s local 2025-03-14T06:51:06.1584183Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 41s local 2025-03-14T06:51:06.1585101Z Testing //test/cpp:test_tensor; 7s local 2025-03-14T06:51:06.1585997Z Linking test/cpp/test_aten_xla_tensor_3; 5s local 2025-03-14T06:51:06.1586865Z Linking test/cpp/test_replication; 4s local 2025-03-14T06:51:06.1587726Z Linking test/cpp/test_aten_xla_tensor_5; 4s local 2025-03-14T06:51:06.1588557Z Linking test/cpp/test_ir; 3s local ... 2025-03-14T06:51:06.3578982Z 2025-03-14T06:51:06.3579871Z  2025-03-14T06:51:06.3580432Z  2025-03-14T06:51:06.3580912Z  2025-03-14T06:51:06.3581389Z  2025-03-14T06:51:06.3581872Z  2025-03-14T06:51:06.3582357Z  2025-03-14T06:51:06.3582849Z  2025-03-14T06:51:06.3583570Z  2025-03-14T06:51:06.3584692Z [20,645 / 20,656] 8 / 17 tests; 8 actions running; last test: ..._xla_sharding 2025-03-14T06:51:06.3585961Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 44s local 2025-03-14T06:51:06.3587098Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 41s local 2025-03-14T06:51:06.3588009Z Testing //test/cpp:test_tensor; 8s local 2025-03-14T06:51:06.3588847Z Linking test/cpp/test_aten_xla_tensor_3; 5s local 2025-03-14T06:51:06.3589711Z Linking test/cpp/test_replication; 4s local 2025-03-14T06:51:06.3590575Z Linking test/cpp/test_aten_xla_tensor_5; 4s local 2025-03-14T06:51:06.3591406Z Linking test/cpp/test_ir; 3s local 2025-03-14T06:51:06.3592203Z Linking test/cpp/test_aten_xla_tensor_6; 1s local 2025-03-14T06:51:06.7581518Z 2025-03-14T06:51:06.7582291Z  2025-03-14T06:51:06.7582829Z  2025-03-14T06:51:06.7583353Z  2025-03-14T06:51:06.7583829Z  2025-03-14T06:51:06.7584301Z  2025-03-14T06:51:06.7584789Z  2025-03-14T06:51:06.7585272Z  2025-03-14T06:51:06.7585736Z  2025-03-14T06:51:06.7586910Z [20,645 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:06.7588001Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 44s local 2025-03-14T06:51:06.7589073Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 42s local 2025-03-14T06:51:06.7589978Z Testing //test/cpp:test_tensor; 8s local 2025-03-14T06:51:06.7590812Z Linking test/cpp/test_aten_xla_tensor_3; 6s local 2025-03-14T06:51:06.7591673Z Linking test/cpp/test_replication; 5s local 2025-03-14T06:51:06.7592531Z Linking test/cpp/test_aten_xla_tensor_5; 5s local 2025-03-14T06:51:06.7593343Z Linking test/cpp/test_ir; 3s local 2025-03-14T06:51:06.7594243Z Linking test/cpp/test_aten_xla_tensor_6; 2s local ... 2025-03-14T06:51:07.7589080Z 2025-03-14T06:51:07.7590085Z  2025-03-14T06:51:07.7590574Z  2025-03-14T06:51:07.7591057Z  2025-03-14T06:51:07.7591484Z  2025-03-14T06:51:07.7591892Z  2025-03-14T06:51:07.7592318Z  2025-03-14T06:51:07.7592743Z  2025-03-14T06:51:07.7593170Z  2025-03-14T06:51:07.7594248Z [20,645 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:07.7595515Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 45s local 2025-03-14T06:51:07.7596557Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 43s local 2025-03-14T06:51:07.7597472Z Testing //test/cpp:test_tensor; 9s local 2025-03-14T06:51:07.7598311Z Linking test/cpp/test_aten_xla_tensor_3; 7s local 2025-03-14T06:51:07.7599396Z Linking test/cpp/test_replication; 6s local 2025-03-14T06:51:07.7600354Z Linking test/cpp/test_aten_xla_tensor_5; 6s local 2025-03-14T06:51:07.7601253Z Linking test/cpp/test_ir; 4s local 2025-03-14T06:51:07.7602004Z Linking test/cpp/test_aten_xla_tensor_6; 3s local ... 2025-03-14T06:51:08.9594547Z 2025-03-14T06:51:08.9595430Z  2025-03-14T06:51:08.9596010Z  2025-03-14T06:51:08.9596516Z  2025-03-14T06:51:08.9597010Z  2025-03-14T06:51:08.9597513Z  2025-03-14T06:51:08.9598023Z  2025-03-14T06:51:08.9598554Z  2025-03-14T06:51:08.9599068Z  2025-03-14T06:51:08.9600227Z [20,645 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:08.9601363Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 46s local 2025-03-14T06:51:08.9602179Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 44s local 2025-03-14T06:51:08.9602908Z Testing //test/cpp:test_tensor; 10s local 2025-03-14T06:51:08.9603589Z Linking test/cpp/test_aten_xla_tensor_3; 8s local 2025-03-14T06:51:08.9604282Z Linking test/cpp/test_replication; 7s local 2025-03-14T06:51:08.9605032Z Linking test/cpp/test_aten_xla_tensor_5; 7s local 2025-03-14T06:51:08.9605686Z Linking test/cpp/test_ir; 5s local 2025-03-14T06:51:08.9606543Z Linking test/cpp/test_aten_xla_tensor_6; 4s local ... 2025-03-14T06:51:09.9601680Z 2025-03-14T06:51:09.9602478Z  2025-03-14T06:51:09.9602903Z  2025-03-14T06:51:09.9603279Z  2025-03-14T06:51:09.9603891Z  2025-03-14T06:51:09.9604261Z  2025-03-14T06:51:09.9604737Z  2025-03-14T06:51:09.9605084Z  2025-03-14T06:51:09.9605459Z  2025-03-14T06:51:09.9606383Z [20,645 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:09.9607408Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 47s local 2025-03-14T06:51:09.9608285Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 45s local 2025-03-14T06:51:09.9609078Z Testing //test/cpp:test_tensor; 11s local 2025-03-14T06:51:09.9609779Z Linking test/cpp/test_aten_xla_tensor_3; 9s local 2025-03-14T06:51:09.9610512Z Linking test/cpp/test_replication; 8s local 2025-03-14T06:51:09.9611259Z Linking test/cpp/test_aten_xla_tensor_5; 8s local 2025-03-14T06:51:09.9611977Z Linking test/cpp/test_ir; 6s local 2025-03-14T06:51:09.9612692Z Linking test/cpp/test_aten_xla_tensor_6; 5s local ... 2025-03-14T06:51:11.1607484Z 2025-03-14T06:51:11.1608256Z  2025-03-14T06:51:11.1608748Z  2025-03-14T06:51:11.1609149Z  2025-03-14T06:51:11.1609549Z  2025-03-14T06:51:11.1609942Z  2025-03-14T06:51:11.1610315Z  2025-03-14T06:51:11.1610698Z  2025-03-14T06:51:11.1611200Z  2025-03-14T06:51:11.1612248Z [20,645 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:11.1613457Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 48s local 2025-03-14T06:51:11.1614434Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 46s local 2025-03-14T06:51:11.1615303Z Testing //test/cpp:test_tensor; 12s local 2025-03-14T06:51:11.1616095Z Linking test/cpp/test_aten_xla_tensor_3; 10s local 2025-03-14T06:51:11.1616923Z Linking test/cpp/test_replication; 9s local 2025-03-14T06:51:11.1617822Z Linking test/cpp/test_aten_xla_tensor_5; 9s local 2025-03-14T06:51:11.1618502Z Linking test/cpp/test_ir; 8s local 2025-03-14T06:51:11.1619182Z Linking test/cpp/test_aten_xla_tensor_6; 6s local ... 2025-03-14T06:51:12.3614477Z 2025-03-14T06:51:12.3615417Z  2025-03-14T06:51:12.3615865Z  2025-03-14T06:51:12.3616248Z  2025-03-14T06:51:12.3616647Z  2025-03-14T06:51:12.3617025Z  2025-03-14T06:51:12.3617385Z  2025-03-14T06:51:12.3617820Z  2025-03-14T06:51:12.3618204Z  2025-03-14T06:51:12.3619366Z [20,645 / 20,656] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:12.3620983Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 50s local 2025-03-14T06:51:12.3622064Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 47s local 2025-03-14T06:51:12.3623049Z Testing //test/cpp:test_tensor; 14s local 2025-03-14T06:51:12.3623966Z Linking test/cpp/test_aten_xla_tensor_3; 11s local 2025-03-14T06:51:12.3624927Z Linking test/cpp/test_replication; 10s local 2025-03-14T06:51:12.3625879Z Linking test/cpp/test_aten_xla_tensor_5; 10s local 2025-03-14T06:51:12.3626780Z Linking test/cpp/test_ir; 9s local 2025-03-14T06:51:12.3627581Z Linking test/cpp/test_aten_xla_tensor_6; 7s local ... 2025-03-14T06:51:13.3228278Z 2025-03-14T06:51:13.3229052Z  2025-03-14T06:51:13.3229671Z  2025-03-14T06:51:13.3230132Z  2025-03-14T06:51:13.3230589Z  2025-03-14T06:51:13.3231044Z  2025-03-14T06:51:13.3231491Z  2025-03-14T06:51:13.3231944Z  2025-03-14T06:51:13.3232398Z  2025-03-14T06:51:13.3233505Z [20,646 / 20,657] 8 / 17 tests; 9 actions, 8 running; last test: ...a_sharding 2025-03-14T06:51:13.3234718Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 51s local 2025-03-14T06:51:13.3235723Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 48s local 2025-03-14T06:51:13.3236821Z Testing //test/cpp:test_tensor; 15s local 2025-03-14T06:51:13.3237497Z Linking test/cpp/test_replication; 11s local 2025-03-14T06:51:13.3238230Z Linking test/cpp/test_aten_xla_tensor_5; 11s local 2025-03-14T06:51:13.3239022Z Linking test/cpp/test_ir; 10s local 2025-03-14T06:51:13.3239688Z Linking test/cpp/test_aten_xla_tensor_6; 8s local 2025-03-14T06:51:13.3240464Z Linking test/cpp/test_aten_xla_tensor_4; 6s local ... 2025-03-14T06:51:13.5620176Z 2025-03-14T06:51:13.5620969Z  2025-03-14T06:51:13.5621441Z  2025-03-14T06:51:13.5621847Z  2025-03-14T06:51:13.5622271Z  2025-03-14T06:51:13.5622657Z  2025-03-14T06:51:13.5623180Z  2025-03-14T06:51:13.5623642Z  2025-03-14T06:51:13.5624104Z  2025-03-14T06:51:13.5625169Z [20,646 / 20,657] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:13.5626382Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 51s local 2025-03-14T06:51:13.5627385Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 49s local 2025-03-14T06:51:13.5628257Z Testing //test/cpp:test_tensor; 15s local 2025-03-14T06:51:13.5629022Z Linking test/cpp/test_replication; 12s local 2025-03-14T06:51:13.5629959Z Linking test/cpp/test_aten_xla_tensor_5; 11s local 2025-03-14T06:51:13.5630726Z Linking test/cpp/test_ir; 10s local 2025-03-14T06:51:13.5631385Z Linking test/cpp/test_aten_xla_tensor_6; 8s local 2025-03-14T06:51:13.5632147Z Linking test/cpp/test_aten_xla_tensor_4; 7s local ... 2025-03-14T06:51:14.3594451Z 2025-03-14T06:51:14.3595235Z  2025-03-14T06:51:14.3595701Z  2025-03-14T06:51:14.3596116Z  2025-03-14T06:51:14.3596516Z  2025-03-14T06:51:14.3596926Z  2025-03-14T06:51:14.3597319Z  2025-03-14T06:51:14.3597715Z  2025-03-14T06:51:14.3598107Z  2025-03-14T06:51:14.3599018Z [20,647 / 20,658] 8 / 17 tests; 9 actions, 8 running; last test: ...a_sharding 2025-03-14T06:51:14.3600061Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 52s local 2025-03-14T06:51:14.3600977Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 49s local 2025-03-14T06:51:14.3601738Z Testing //test/cpp:test_tensor; 16s local 2025-03-14T06:51:14.3602448Z Linking test/cpp/test_aten_xla_tensor_5; 12s local 2025-03-14T06:51:14.3603141Z Linking test/cpp/test_ir; 11s local 2025-03-14T06:51:14.3603812Z Linking test/cpp/test_aten_xla_tensor_6; 9s local 2025-03-14T06:51:14.3604624Z Linking test/cpp/test_aten_xla_tensor_4; 7s local 2025-03-14T06:51:14.3605409Z Testing //test/cpp:test_aten_xla_tensor_3; 1s local ... 2025-03-14T06:51:14.5626733Z 2025-03-14T06:51:14.5627688Z  2025-03-14T06:51:14.5628144Z  2025-03-14T06:51:14.5628558Z  2025-03-14T06:51:14.5629018Z  2025-03-14T06:51:14.5629389Z  2025-03-14T06:51:14.5629783Z  2025-03-14T06:51:14.5630547Z  2025-03-14T06:51:14.5631116Z  2025-03-14T06:51:14.5632333Z [20,647 / 20,658] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:14.5633675Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 52s local 2025-03-14T06:51:14.5634758Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 50s local 2025-03-14T06:51:14.5635743Z Testing //test/cpp:test_tensor; 16s local 2025-03-14T06:51:14.5636628Z Linking test/cpp/test_aten_xla_tensor_5; 12s local 2025-03-14T06:51:14.5637590Z Linking test/cpp/test_ir; 11s local 2025-03-14T06:51:14.5638269Z Linking test/cpp/test_aten_xla_tensor_6; 9s local 2025-03-14T06:51:14.5638975Z Linking test/cpp/test_aten_xla_tensor_4; 8s local 2025-03-14T06:51:14.5639718Z Testing //test/cpp:test_aten_xla_tensor_3; 1s local ... 2025-03-14T06:51:14.7629262Z 2025-03-14T06:51:14.7630076Z  2025-03-14T06:51:14.7630531Z  2025-03-14T06:51:14.7630927Z  2025-03-14T06:51:14.7631336Z  2025-03-14T06:51:14.7631731Z  2025-03-14T06:51:14.7632121Z  2025-03-14T06:51:14.7632688Z  2025-03-14T06:51:14.7633078Z  2025-03-14T06:51:14.7634015Z [20,648 / 20,659] 8 / 17 tests; 9 actions running; last test: ..._xla_sharding 2025-03-14T06:51:14.7635147Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 52s local 2025-03-14T06:51:14.7636006Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 50s local 2025-03-14T06:51:14.7636765Z Testing //test/cpp:test_tensor; 16s local 2025-03-14T06:51:14.7637394Z Linking test/cpp/test_ir; 11s local 2025-03-14T06:51:14.7638062Z Linking test/cpp/test_aten_xla_tensor_6; 10s local 2025-03-14T06:51:14.7638813Z Linking test/cpp/test_aten_xla_tensor_4; 8s local 2025-03-14T06:51:14.7639557Z Testing //test/cpp:test_aten_xla_tensor_3; 1s local 2025-03-14T06:51:14.7640301Z Testing //test/cpp:test_replication; 0s local ... 2025-03-14T06:51:15.5923153Z 2025-03-14T06:51:15.5924237Z  2025-03-14T06:51:15.5925049Z  2025-03-14T06:51:15.5925736Z  2025-03-14T06:51:15.5926332Z  2025-03-14T06:51:15.5926856Z  2025-03-14T06:51:15.5927423Z  2025-03-14T06:51:15.5927991Z  2025-03-14T06:51:15.5928580Z  2025-03-14T06:51:15.5929749Z [20,648 / 20,659] 9 / 17 tests; 9 actions running; last test: ...t_replication 2025-03-14T06:51:15.5930897Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 53s local 2025-03-14T06:51:15.5931980Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 51s local 2025-03-14T06:51:15.5932983Z Testing //test/cpp:test_tensor; 17s local 2025-03-14T06:51:15.5933756Z Linking test/cpp/test_ir; 12s local 2025-03-14T06:51:15.5934495Z Linking test/cpp/test_aten_xla_tensor_6; 11s local 2025-03-14T06:51:15.5935133Z Linking test/cpp/test_aten_xla_tensor_4; 9s local 2025-03-14T06:51:15.5935945Z Testing //test/cpp:test_aten_xla_tensor_3; 2s local 2025-03-14T06:51:15.5936822Z Testing //test/cpp:test_replication; 1s local ... 2025-03-14T06:51:15.9636047Z 2025-03-14T06:51:15.9636904Z  2025-03-14T06:51:15.9637484Z  2025-03-14T06:51:15.9638000Z  2025-03-14T06:51:15.9638524Z  2025-03-14T06:51:15.9639324Z  2025-03-14T06:51:15.9639712Z  2025-03-14T06:51:15.9640113Z  2025-03-14T06:51:15.9640498Z  2025-03-14T06:51:15.9641395Z [20,649 / 20,659] 9 / 17 tests; 8 actions running; last test: ...t_replication 2025-03-14T06:51:15.9642409Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 53s local 2025-03-14T06:51:15.9643237Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 51s local 2025-03-14T06:51:15.9643969Z Testing //test/cpp:test_tensor; 17s local 2025-03-14T06:51:15.9644828Z Linking test/cpp/test_ir; 12s local 2025-03-14T06:51:15.9645557Z Linking test/cpp/test_aten_xla_tensor_6; 11s local 2025-03-14T06:51:15.9646267Z Linking test/cpp/test_aten_xla_tensor_4; 9s local 2025-03-14T06:51:15.9646988Z Testing //test/cpp:test_aten_xla_tensor_3; 2s local 2025-03-14T06:51:15.9647708Z Testing //test/cpp:test_aten_xla_tensor_5; 1s local 2025-03-14T06:51:16.5380769Z 2025-03-14T06:51:16.5381498Z  2025-03-14T06:51:16.5381967Z  2025-03-14T06:51:16.5382372Z  2025-03-14T06:51:16.5382774Z  2025-03-14T06:51:16.5383195Z  2025-03-14T06:51:16.5383591Z  2025-03-14T06:51:16.5383982Z  2025-03-14T06:51:16.5384377Z  2025-03-14T06:51:16.5385311Z [20,650 / 20,660] 9 / 17 tests; 8 actions, 7 running; last test: ...eplication 2025-03-14T06:51:16.5386355Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 54s local 2025-03-14T06:51:16.5387215Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 52s local 2025-03-14T06:51:16.5387980Z Testing //test/cpp:test_tensor; 18s local 2025-03-14T06:51:16.5388690Z Linking test/cpp/test_aten_xla_tensor_6; 11s local 2025-03-14T06:51:16.5389438Z Linking test/cpp/test_aten_xla_tensor_4; 10s local 2025-03-14T06:51:16.5390681Z Testing //test/cpp:test_aten_xla_tensor_3; 3s local 2025-03-14T06:51:16.5391970Z Testing //test/cpp:test_aten_xla_tensor_5; 1s local 2025-03-14T06:51:16.5392878Z [Prepa] Testing //test/cpp:test_ir 2025-03-14T06:51:16.7769371Z 2025-03-14T06:51:16.7770173Z  2025-03-14T06:51:16.7771071Z  2025-03-14T06:51:16.7771537Z  2025-03-14T06:51:16.7772052Z  2025-03-14T06:51:16.7772591Z  2025-03-14T06:51:16.7772997Z  2025-03-14T06:51:16.7773401Z  2025-03-14T06:51:16.7773797Z  2025-03-14T06:51:16.7774726Z [20,650 / 20,660] 9 / 17 tests; 8 actions running; last test: ...t_replication 2025-03-14T06:51:16.7775821Z Compiling test/cpp/test_aten_xla_tensor_2.cpp; 54s local 2025-03-14T06:51:16.7776708Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 52s local 2025-03-14T06:51:16.7777486Z Testing //test/cpp:test_tensor; 18s local 2025-03-14T06:51:16.7778484Z Linking test/cpp/test_aten_xla_tensor_6; 12s local 2025-03-14T06:51:16.7779562Z Linking test/cpp/test_aten_xla_tensor_4; 10s local 2025-03-14T06:51:16.7780569Z Testing //test/cpp:test_aten_xla_tensor_3; 3s local 2025-03-14T06:51:16.7781561Z Testing //test/cpp:test_aten_xla_tensor_5; 2s local 2025-03-14T06:51:16.7782465Z Testing //test/cpp:test_ir; 0s local 2025-03-14T06:51:17.5500304Z 2025-03-14T06:51:17.5501133Z  2025-03-14T06:51:17.5501605Z  2025-03-14T06:51:17.5502014Z  2025-03-14T06:51:17.5502415Z  2025-03-14T06:51:17.5502808Z  2025-03-14T06:51:17.5503207Z  2025-03-14T06:51:17.5503606Z  2025-03-14T06:51:17.5503999Z  2025-03-14T06:51:17.5504936Z [20,651 / 20,660] 9 / 17 tests; 8 actions, 7 running; last test: ...eplication 2025-03-14T06:51:17.5505979Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 53s local 2025-03-14T06:51:17.5506745Z Testing //test/cpp:test_tensor; 19s local 2025-03-14T06:51:17.5507442Z Linking test/cpp/test_aten_xla_tensor_6; 12s local 2025-03-14T06:51:17.5508185Z Linking test/cpp/test_aten_xla_tensor_4; 11s local 2025-03-14T06:51:17.5508941Z Testing //test/cpp:test_aten_xla_tensor_3; 4s local 2025-03-14T06:51:17.5509683Z Testing //test/cpp:test_aten_xla_tensor_5; 2s local 2025-03-14T06:51:17.5510374Z Testing //test/cpp:test_ir; 1s local 2025-03-14T06:51:17.5511027Z [Prepa] Linking test/cpp/test_aten_xla_tensor_2 2025-03-14T06:51:17.7646409Z 2025-03-14T06:51:17.7647174Z  2025-03-14T06:51:17.7647658Z  2025-03-14T06:51:17.7648024Z  2025-03-14T06:51:17.7648554Z  2025-03-14T06:51:17.7649000Z  2025-03-14T06:51:17.7649448Z  2025-03-14T06:51:17.7649901Z  2025-03-14T06:51:17.7650349Z  2025-03-14T06:51:17.7651725Z [20,651 / 20,660] 9 / 17 tests; 8 actions running; last test: ...t_replication 2025-03-14T06:51:17.7652939Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 53s local 2025-03-14T06:51:17.7653819Z Testing //test/cpp:test_tensor; 19s local 2025-03-14T06:51:17.7654615Z Linking test/cpp/test_aten_xla_tensor_6; 13s local 2025-03-14T06:51:17.7655513Z Linking test/cpp/test_aten_xla_tensor_4; 11s local 2025-03-14T06:51:17.7656277Z Testing //test/cpp:test_aten_xla_tensor_3; 4s local 2025-03-14T06:51:17.7657037Z Testing //test/cpp:test_aten_xla_tensor_5; 3s local 2025-03-14T06:51:17.7657717Z Testing //test/cpp:test_ir; 1s local 2025-03-14T06:51:17.7658391Z Linking test/cpp/test_aten_xla_tensor_2; 0s local 2025-03-14T06:51:18.5517145Z 2025-03-14T06:51:18.5517970Z  2025-03-14T06:51:18.5518447Z  2025-03-14T06:51:18.5518871Z  2025-03-14T06:51:18.5519303Z  2025-03-14T06:51:18.5519710Z  2025-03-14T06:51:18.5520152Z  2025-03-14T06:51:18.5520552Z  2025-03-14T06:51:18.5520941Z  2025-03-14T06:51:18.5521901Z [20,651 / 20,660] 10 / 17 tests; 8 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:18.5522969Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 54s local 2025-03-14T06:51:18.5523950Z Testing //test/cpp:test_tensor; 20s local 2025-03-14T06:51:18.5524759Z Linking test/cpp/test_aten_xla_tensor_6; 13s local 2025-03-14T06:51:18.5525533Z Linking test/cpp/test_aten_xla_tensor_4; 12s local 2025-03-14T06:51:18.5526385Z Testing //test/cpp:test_aten_xla_tensor_3; 5s local 2025-03-14T06:51:18.5527155Z Testing //test/cpp:test_aten_xla_tensor_5; 3s local 2025-03-14T06:51:18.5527853Z Testing //test/cpp:test_ir; 2s local 2025-03-14T06:51:18.5528539Z Linking test/cpp/test_aten_xla_tensor_2; 0s local 2025-03-14T06:51:18.7745687Z 2025-03-14T06:51:18.7746494Z  2025-03-14T06:51:18.7746967Z  2025-03-14T06:51:18.7747410Z  2025-03-14T06:51:18.7747846Z  2025-03-14T06:51:18.7748256Z  2025-03-14T06:51:18.7748665Z  2025-03-14T06:51:18.7749065Z  2025-03-14T06:51:18.7749478Z  2025-03-14T06:51:18.7750422Z [20,652 / 20,660] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:18.7751509Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 54s local 2025-03-14T06:51:18.7752300Z Testing //test/cpp:test_tensor; 20s local 2025-03-14T06:51:18.7753018Z Linking test/cpp/test_aten_xla_tensor_6; 14s local 2025-03-14T06:51:18.7753796Z Linking test/cpp/test_aten_xla_tensor_4; 12s local 2025-03-14T06:51:18.7754560Z Testing //test/cpp:test_aten_xla_tensor_3; 5s local 2025-03-14T06:51:18.7755324Z Testing //test/cpp:test_aten_xla_tensor_5; 4s local 2025-03-14T06:51:18.7756082Z Linking test/cpp/test_aten_xla_tensor_2; 1s local 2025-03-14T06:51:19.6561247Z 2025-03-14T06:51:19.6562027Z  2025-03-14T06:51:19.6562556Z  2025-03-14T06:51:19.6563046Z  2025-03-14T06:51:19.6563495Z  2025-03-14T06:51:19.6563941Z  2025-03-14T06:51:19.6564403Z  2025-03-14T06:51:19.6564912Z  2025-03-14T06:51:19.6566112Z [20,653 / 20,661] 10 / 17 tests; 7 actions, 6 running; last test: ...p:test_ir 2025-03-14T06:51:19.6567255Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 55s local 2025-03-14T06:51:19.6568009Z Testing //test/cpp:test_tensor; 21s local 2025-03-14T06:51:19.6568688Z Linking test/cpp/test_aten_xla_tensor_4; 13s local 2025-03-14T06:51:19.6569446Z Testing //test/cpp:test_aten_xla_tensor_3; 6s local 2025-03-14T06:51:19.6570170Z Testing //test/cpp:test_aten_xla_tensor_5; 4s local 2025-03-14T06:51:19.6570884Z Linking test/cpp/test_aten_xla_tensor_2; 2s local 2025-03-14T06:51:19.6571610Z [Prepa] Testing //test/cpp:test_aten_xla_tensor_6 2025-03-14T06:51:20.0186724Z 2025-03-14T06:51:20.0187539Z  2025-03-14T06:51:20.0187989Z  2025-03-14T06:51:20.0188616Z  2025-03-14T06:51:20.0189059Z  2025-03-14T06:51:20.0189450Z  2025-03-14T06:51:20.0189933Z  2025-03-14T06:51:20.0190335Z  2025-03-14T06:51:20.0191285Z [20,653 / 20,661] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:20.0192350Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 55s local 2025-03-14T06:51:20.0193149Z Testing //test/cpp:test_tensor; 21s local 2025-03-14T06:51:20.0193873Z Linking test/cpp/test_aten_xla_tensor_4; 13s local 2025-03-14T06:51:20.0194620Z Testing //test/cpp:test_aten_xla_tensor_3; 6s local 2025-03-14T06:51:20.0195393Z Testing //test/cpp:test_aten_xla_tensor_5; 5s local 2025-03-14T06:51:20.0196117Z Linking test/cpp/test_aten_xla_tensor_2; 2s local 2025-03-14T06:51:20.0196734Z Testing //test/cpp:test_aten_xla_tensor_6; 0s local 2025-03-14T06:51:21.0202695Z 2025-03-14T06:51:21.0203867Z  2025-03-14T06:51:21.0204558Z  2025-03-14T06:51:21.0205153Z  2025-03-14T06:51:21.0205726Z  2025-03-14T06:51:21.0206264Z  2025-03-14T06:51:21.0206833Z  2025-03-14T06:51:21.0207420Z  2025-03-14T06:51:21.0208643Z [20,653 / 20,661] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:21.0210374Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 56s local 2025-03-14T06:51:21.0211402Z Testing //test/cpp:test_tensor; 22s local 2025-03-14T06:51:21.0212350Z Linking test/cpp/test_aten_xla_tensor_4; 14s local 2025-03-14T06:51:21.0213457Z Testing //test/cpp:test_aten_xla_tensor_3; 7s local 2025-03-14T06:51:21.0214465Z Testing //test/cpp:test_aten_xla_tensor_5; 6s local 2025-03-14T06:51:21.0215457Z Linking test/cpp/test_aten_xla_tensor_2; 3s local 2025-03-14T06:51:21.0216463Z Testing //test/cpp:test_aten_xla_tensor_6; 1s local 2025-03-14T06:51:22.0345429Z 2025-03-14T06:51:22.0346337Z  2025-03-14T06:51:22.0346863Z  2025-03-14T06:51:22.0347348Z  2025-03-14T06:51:22.0347790Z  2025-03-14T06:51:22.0348235Z  2025-03-14T06:51:22.0348691Z  2025-03-14T06:51:22.0349110Z  2025-03-14T06:51:22.0350127Z [20,653 / 20,661] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:22.0351266Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 57s local 2025-03-14T06:51:22.0352139Z Testing //test/cpp:test_tensor; 23s local 2025-03-14T06:51:22.0352892Z Linking test/cpp/test_aten_xla_tensor_4; 15s local 2025-03-14T06:51:22.0353717Z Testing //test/cpp:test_aten_xla_tensor_3; 8s local 2025-03-14T06:51:22.0354539Z Testing //test/cpp:test_aten_xla_tensor_5; 7s local 2025-03-14T06:51:22.0355354Z Linking test/cpp/test_aten_xla_tensor_2; 4s local 2025-03-14T06:51:22.0356155Z Testing //test/cpp:test_aten_xla_tensor_6; 2s local 2025-03-14T06:51:23.0402531Z 2025-03-14T06:51:23.0403632Z  2025-03-14T06:51:23.0404281Z  2025-03-14T06:51:23.0404941Z  2025-03-14T06:51:23.0405484Z  2025-03-14T06:51:23.0406001Z  2025-03-14T06:51:23.0406560Z  2025-03-14T06:51:23.0407105Z  2025-03-14T06:51:23.0408338Z [20,653 / 20,661] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:23.0409738Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 58s local 2025-03-14T06:51:23.0410778Z Testing //test/cpp:test_tensor; 24s local 2025-03-14T06:51:23.0411712Z Linking test/cpp/test_aten_xla_tensor_4; 16s local 2025-03-14T06:51:23.0412732Z Testing //test/cpp:test_aten_xla_tensor_3; 9s local 2025-03-14T06:51:23.0413750Z Testing //test/cpp:test_aten_xla_tensor_5; 8s local 2025-03-14T06:51:23.0414737Z Linking test/cpp/test_aten_xla_tensor_2; 5s local 2025-03-14T06:51:23.0415717Z Testing //test/cpp:test_aten_xla_tensor_6; 3s local 2025-03-14T06:51:23.6131823Z 2025-03-14T06:51:23.6132816Z  2025-03-14T06:51:23.6133303Z  2025-03-14T06:51:23.6133732Z  2025-03-14T06:51:23.6134402Z  2025-03-14T06:51:23.6134825Z  2025-03-14T06:51:23.6135258Z  2025-03-14T06:51:23.6135765Z  2025-03-14T06:51:23.6136709Z [20,654 / 20,662] 10 / 17 tests; 7 actions, 6 running; last test: ...p:test_ir 2025-03-14T06:51:23.6137760Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 59s local 2025-03-14T06:51:23.6138540Z Testing //test/cpp:test_tensor; 25s local 2025-03-14T06:51:23.6139269Z Testing //test/cpp:test_aten_xla_tensor_3; 10s local 2025-03-14T06:51:23.6140049Z Testing //test/cpp:test_aten_xla_tensor_5; 8s local 2025-03-14T06:51:23.6140800Z Linking test/cpp/test_aten_xla_tensor_2; 6s local 2025-03-14T06:51:23.6141545Z Testing //test/cpp:test_aten_xla_tensor_6; 3s local 2025-03-14T06:51:23.6142294Z [Prepa] Testing //test/cpp:test_aten_xla_tensor_4 2025-03-14T06:51:23.8407276Z 2025-03-14T06:51:23.8407910Z  2025-03-14T06:51:23.8408381Z  2025-03-14T06:51:23.8408806Z  2025-03-14T06:51:23.8409223Z  2025-03-14T06:51:23.8409656Z  2025-03-14T06:51:23.8410075Z  2025-03-14T06:51:23.8410510Z  2025-03-14T06:51:23.8411447Z [20,654 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:23.8412536Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 59s local 2025-03-14T06:51:23.8413509Z Testing //test/cpp:test_tensor; 25s local 2025-03-14T06:51:23.8414301Z Testing //test/cpp:test_aten_xla_tensor_3; 10s local 2025-03-14T06:51:23.8415296Z Testing //test/cpp:test_aten_xla_tensor_5; 9s local 2025-03-14T06:51:23.8416085Z Linking test/cpp/test_aten_xla_tensor_2; 6s local 2025-03-14T06:51:23.8416872Z Testing //test/cpp:test_aten_xla_tensor_6; 4s local 2025-03-14T06:51:23.8417671Z Testing //test/cpp:test_aten_xla_tensor_4; 0s local 2025-03-14T06:51:24.8412534Z 2025-03-14T06:51:24.8413328Z  2025-03-14T06:51:24.8413804Z  2025-03-14T06:51:24.8414196Z  2025-03-14T06:51:24.8414622Z  2025-03-14T06:51:24.8415027Z  2025-03-14T06:51:24.8415428Z  2025-03-14T06:51:24.8415833Z  2025-03-14T06:51:24.8416761Z [20,654 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:24.8417806Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 60s local 2025-03-14T06:51:24.8418585Z Testing //test/cpp:test_tensor; 26s local 2025-03-14T06:51:24.8419299Z Testing //test/cpp:test_aten_xla_tensor_3; 11s local 2025-03-14T06:51:24.8420049Z Testing //test/cpp:test_aten_xla_tensor_5; 10s local 2025-03-14T06:51:24.8420811Z Linking test/cpp/test_aten_xla_tensor_2; 7s local 2025-03-14T06:51:24.8421560Z Testing //test/cpp:test_aten_xla_tensor_6; 5s local 2025-03-14T06:51:24.8422302Z Testing //test/cpp:test_aten_xla_tensor_4; 1s local 2025-03-14T06:51:25.8419317Z 2025-03-14T06:51:25.8420250Z  2025-03-14T06:51:25.8420717Z  2025-03-14T06:51:25.8421121Z  2025-03-14T06:51:25.8421562Z  2025-03-14T06:51:25.8421957Z  2025-03-14T06:51:25.8422329Z  2025-03-14T06:51:25.8422730Z  2025-03-14T06:51:25.8423629Z [20,654 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:25.8424654Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 61s local 2025-03-14T06:51:25.8425404Z Testing //test/cpp:test_tensor; 27s local 2025-03-14T06:51:25.8426090Z Testing //test/cpp:test_aten_xla_tensor_3; 12s local 2025-03-14T06:51:25.8426824Z Testing //test/cpp:test_aten_xla_tensor_5; 11s local 2025-03-14T06:51:25.8427559Z Linking test/cpp/test_aten_xla_tensor_2; 8s local 2025-03-14T06:51:25.8428275Z Testing //test/cpp:test_aten_xla_tensor_6; 6s local 2025-03-14T06:51:25.8428990Z Testing //test/cpp:test_aten_xla_tensor_4; 2s local 2025-03-14T06:51:27.0426825Z 2025-03-14T06:51:27.0427635Z  2025-03-14T06:51:27.0428682Z  2025-03-14T06:51:27.0429121Z  2025-03-14T06:51:27.0429748Z  2025-03-14T06:51:27.0430145Z  2025-03-14T06:51:27.0430525Z  2025-03-14T06:51:27.0430985Z  2025-03-14T06:51:27.0431902Z [20,654 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:27.0432910Z Compiling test/cpp/test_aten_xla_tensor_1.cpp; 62s local 2025-03-14T06:51:27.0433655Z Testing //test/cpp:test_tensor; 28s local 2025-03-14T06:51:27.0434332Z Testing //test/cpp:test_aten_xla_tensor_3; 13s local 2025-03-14T06:51:27.0435074Z Testing //test/cpp:test_aten_xla_tensor_5; 12s local 2025-03-14T06:51:27.0435806Z Linking test/cpp/test_aten_xla_tensor_2; 9s local 2025-03-14T06:51:27.0436524Z Testing //test/cpp:test_aten_xla_tensor_6; 7s local 2025-03-14T06:51:27.0437239Z Testing //test/cpp:test_aten_xla_tensor_4; 3s local 2025-03-14T06:51:28.0620360Z 2025-03-14T06:51:28.0621333Z  2025-03-14T06:51:28.0621882Z  2025-03-14T06:51:28.0622348Z  2025-03-14T06:51:28.0622840Z  2025-03-14T06:51:28.0623317Z  2025-03-14T06:51:28.0623785Z  2025-03-14T06:51:28.0624242Z  2025-03-14T06:51:28.0625348Z [20,655 / 20,662] 10 / 17 tests; 6 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:28.0626455Z Testing //test/cpp:test_tensor; 29s local 2025-03-14T06:51:28.0627533Z Testing //test/cpp:test_aten_xla_tensor_3; 14s local 2025-03-14T06:51:28.0628460Z Testing //test/cpp:test_aten_xla_tensor_5; 13s local 2025-03-14T06:51:28.0629338Z Linking test/cpp/test_aten_xla_tensor_2; 10s local 2025-03-14T06:51:28.0630322Z Testing //test/cpp:test_aten_xla_tensor_6; 8s local 2025-03-14T06:51:28.0631182Z Testing //test/cpp:test_aten_xla_tensor_4; 4s local 2025-03-14T06:51:28.4623129Z 2025-03-14T06:51:28.4623963Z  2025-03-14T06:51:28.4624542Z  2025-03-14T06:51:28.4625053Z  2025-03-14T06:51:28.4625557Z  2025-03-14T06:51:28.4626136Z  2025-03-14T06:51:28.4626528Z  2025-03-14T06:51:28.4627452Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:28.4628369Z Testing //test/cpp:test_tensor; 30s local 2025-03-14T06:51:28.4629043Z Testing //test/cpp:test_aten_xla_tensor_3; 15s local 2025-03-14T06:51:28.4629771Z Testing //test/cpp:test_aten_xla_tensor_5; 13s local 2025-03-14T06:51:28.4630494Z Linking test/cpp/test_aten_xla_tensor_2; 10s local 2025-03-14T06:51:28.4631262Z Testing //test/cpp:test_aten_xla_tensor_6; 8s local 2025-03-14T06:51:28.4631983Z Testing //test/cpp:test_aten_xla_tensor_4; 4s local 2025-03-14T06:51:28.4632754Z Linking test/cpp/test_aten_xla_tensor_1; 0s local 2025-03-14T06:51:29.4628583Z 2025-03-14T06:51:29.4629330Z  2025-03-14T06:51:29.4629777Z  2025-03-14T06:51:29.4630168Z  2025-03-14T06:51:29.4630568Z  2025-03-14T06:51:29.4630935Z  2025-03-14T06:51:29.4631348Z  2025-03-14T06:51:29.4631733Z  2025-03-14T06:51:29.4632635Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:29.4633539Z Testing //test/cpp:test_tensor; 31s local 2025-03-14T06:51:29.4634210Z Testing //test/cpp:test_aten_xla_tensor_3; 16s local 2025-03-14T06:51:29.4634916Z Testing //test/cpp:test_aten_xla_tensor_5; 14s local 2025-03-14T06:51:29.4635621Z Linking test/cpp/test_aten_xla_tensor_2; 11s local 2025-03-14T06:51:29.4636325Z Testing //test/cpp:test_aten_xla_tensor_6; 9s local 2025-03-14T06:51:29.4637027Z Testing //test/cpp:test_aten_xla_tensor_4; 5s local 2025-03-14T06:51:29.4637728Z Linking test/cpp/test_aten_xla_tensor_1; 1s local 2025-03-14T06:51:30.6635244Z 2025-03-14T06:51:30.6636131Z  2025-03-14T06:51:30.6636698Z  2025-03-14T06:51:30.6637300Z  2025-03-14T06:51:30.6637807Z  2025-03-14T06:51:30.6638333Z  2025-03-14T06:51:30.6638843Z  2025-03-14T06:51:30.6639350Z  2025-03-14T06:51:30.6640770Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:30.6641754Z Testing //test/cpp:test_tensor; 32s local 2025-03-14T06:51:30.6642428Z Testing //test/cpp:test_aten_xla_tensor_3; 17s local 2025-03-14T06:51:30.6643146Z Testing //test/cpp:test_aten_xla_tensor_5; 15s local 2025-03-14T06:51:30.6643866Z Linking test/cpp/test_aten_xla_tensor_2; 13s local 2025-03-14T06:51:30.6644655Z Testing //test/cpp:test_aten_xla_tensor_6; 11s local 2025-03-14T06:51:30.6645409Z Testing //test/cpp:test_aten_xla_tensor_4; 7s local 2025-03-14T06:51:30.6646114Z Linking test/cpp/test_aten_xla_tensor_1; 2s local 2025-03-14T06:51:31.6641262Z 2025-03-14T06:51:31.6642063Z  2025-03-14T06:51:31.6642554Z  2025-03-14T06:51:31.6642978Z  2025-03-14T06:51:31.6643379Z  2025-03-14T06:51:31.6643793Z  2025-03-14T06:51:31.6644196Z  2025-03-14T06:51:31.6644662Z  2025-03-14T06:51:31.6645655Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:31.6646621Z Testing //test/cpp:test_tensor; 33s local 2025-03-14T06:51:31.6647337Z Testing //test/cpp:test_aten_xla_tensor_3; 18s local 2025-03-14T06:51:31.6648103Z Testing //test/cpp:test_aten_xla_tensor_5; 16s local 2025-03-14T06:51:31.6649106Z Linking test/cpp/test_aten_xla_tensor_2; 14s local 2025-03-14T06:51:31.6649865Z Testing //test/cpp:test_aten_xla_tensor_6; 12s local 2025-03-14T06:51:31.6650622Z Testing //test/cpp:test_aten_xla_tensor_4; 8s local 2025-03-14T06:51:31.6651471Z Linking test/cpp/test_aten_xla_tensor_1; 3s local 2025-03-14T06:51:32.8649624Z 2025-03-14T06:51:32.8650730Z  2025-03-14T06:51:32.8651450Z  2025-03-14T06:51:32.8652072Z  2025-03-14T06:51:34.0655434Z  2025-03-14T06:51:34.0655913Z  2025-03-14T06:51:34.0656353Z  2025-03-14T06:51:34.0656738Z  2025-03-14T06:51:34.0657903Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:34.0659002Z Testing //test/cpp:test_tensor; 34s local 2025-03-14T06:51:34.0659819Z Testing //test/cpp:test_aten_xla_tensor_3; 19s local 2025-03-14T06:51:34.0660684Z Testing //test/cpp:test_aten_xla_tensor_5; 18s local 2025-03-14T06:51:34.0661541Z Linking test/cpp/test_aten_xla_tensor_2; 15s local 2025-03-14T06:51:34.0662384Z Testing //test/cpp:test_aten_xla_tensor_6; 13s local 2025-03-14T06:51:34.0663249Z Testing //test/cpp:test_aten_xla_tensor_4; 9s local 2025-03-14T06:51:34.0664196Z Linking test/cpp/test_aten_xla_tensor_1; 4s local 2025-03-14T06:51:34.0664701Z 2025-03-14T06:51:34.0664899Z  2025-03-14T06:51:34.0665496Z  2025-03-14T06:51:34.0665892Z  2025-03-14T06:51:34.0666293Z  2025-03-14T06:51:34.0666695Z  2025-03-14T06:51:34.0667097Z  2025-03-14T06:51:34.0667543Z  2025-03-14T06:51:34.0668439Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:34.0669379Z Testing //test/cpp:test_tensor; 35s local 2025-03-14T06:51:34.0670083Z Testing //test/cpp:test_aten_xla_tensor_3; 20s local 2025-03-14T06:51:34.0670841Z Testing //test/cpp:test_aten_xla_tensor_5; 19s local 2025-03-14T06:51:34.0671601Z Linking test/cpp/test_aten_xla_tensor_2; 16s local 2025-03-14T06:51:34.0672334Z Testing //test/cpp:test_aten_xla_tensor_6; 14s local 2025-03-14T06:51:34.0673073Z Testing //test/cpp:test_aten_xla_tensor_4; 10s local 2025-03-14T06:51:34.0673812Z Linking test/cpp/test_aten_xla_tensor_1; 5s local 2025-03-14T06:51:35.0661658Z 2025-03-14T06:51:35.0662816Z  2025-03-14T06:51:35.0663422Z  2025-03-14T06:51:35.0663898Z  2025-03-14T06:51:35.0664370Z  2025-03-14T06:51:35.0664839Z  2025-03-14T06:51:35.0665521Z  2025-03-14T06:51:35.0666046Z  2025-03-14T06:51:35.0667471Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:35.0668702Z Testing //test/cpp:test_tensor; 36s local 2025-03-14T06:51:35.0669546Z Testing //test/cpp:test_aten_xla_tensor_3; 21s local 2025-03-14T06:51:35.0670514Z Testing //test/cpp:test_aten_xla_tensor_5; 20s local 2025-03-14T06:51:35.0671371Z Linking test/cpp/test_aten_xla_tensor_2; 17s local 2025-03-14T06:51:35.0672197Z Testing //test/cpp:test_aten_xla_tensor_6; 15s local 2025-03-14T06:51:35.0673009Z Testing //test/cpp:test_aten_xla_tensor_4; 11s local 2025-03-14T06:51:35.0673876Z Linking test/cpp/test_aten_xla_tensor_1; 6s local 2025-03-14T06:51:36.2667099Z 2025-03-14T06:51:36.2667939Z  2025-03-14T06:51:36.2668418Z  2025-03-14T06:51:36.2668838Z  2025-03-14T06:51:36.2669255Z  2025-03-14T06:51:36.2669678Z  2025-03-14T06:51:36.2670088Z  2025-03-14T06:51:36.2670535Z  2025-03-14T06:51:36.2671484Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:36.2672464Z Testing //test/cpp:test_tensor; 38s local 2025-03-14T06:51:36.2673297Z Testing //test/cpp:test_aten_xla_tensor_3; 22s local 2025-03-14T06:51:36.2674064Z Testing //test/cpp:test_aten_xla_tensor_5; 21s local 2025-03-14T06:51:36.2675077Z Linking test/cpp/test_aten_xla_tensor_2; 18s local 2025-03-14T06:51:36.2675817Z Testing //test/cpp:test_aten_xla_tensor_6; 16s local 2025-03-14T06:51:36.2676576Z Testing //test/cpp:test_aten_xla_tensor_4; 12s local 2025-03-14T06:51:36.2677405Z Linking test/cpp/test_aten_xla_tensor_1; 8s local 2025-03-14T06:51:37.4675719Z 2025-03-14T06:51:37.4676638Z  2025-03-14T06:51:37.4677183Z  2025-03-14T06:51:37.4677732Z  2025-03-14T06:51:37.4678148Z  2025-03-14T06:51:37.4678559Z  2025-03-14T06:51:37.4678971Z  2025-03-14T06:51:37.4679384Z  2025-03-14T06:51:37.4680344Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:37.4681315Z Testing //test/cpp:test_tensor; 39s local 2025-03-14T06:51:37.4682032Z Testing //test/cpp:test_aten_xla_tensor_3; 24s local 2025-03-14T06:51:37.4682786Z Testing //test/cpp:test_aten_xla_tensor_5; 22s local 2025-03-14T06:51:37.4683550Z Linking test/cpp/test_aten_xla_tensor_2; 19s local 2025-03-14T06:51:37.4684315Z Testing //test/cpp:test_aten_xla_tensor_6; 17s local 2025-03-14T06:51:37.4685148Z Testing //test/cpp:test_aten_xla_tensor_4; 13s local 2025-03-14T06:51:37.4685911Z Linking test/cpp/test_aten_xla_tensor_1; 9s local 2025-03-14T06:51:38.4683622Z 2025-03-14T06:51:38.4684444Z  2025-03-14T06:51:38.4685148Z  2025-03-14T06:51:38.4685664Z  2025-03-14T06:51:38.4686167Z  2025-03-14T06:51:38.4686694Z  2025-03-14T06:51:38.4687081Z  2025-03-14T06:51:38.4695761Z  2025-03-14T06:51:38.4696950Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:38.4697890Z Testing //test/cpp:test_tensor; 40s local 2025-03-14T06:51:38.4698597Z Testing //test/cpp:test_aten_xla_tensor_3; 25s local 2025-03-14T06:51:38.4699535Z Testing //test/cpp:test_aten_xla_tensor_5; 23s local 2025-03-14T06:51:38.4700840Z Linking test/cpp/test_aten_xla_tensor_2; 20s local 2025-03-14T06:51:38.4701817Z Testing //test/cpp:test_aten_xla_tensor_6; 18s local 2025-03-14T06:51:38.4702830Z Testing //test/cpp:test_aten_xla_tensor_4; 14s local 2025-03-14T06:51:38.4703795Z Linking test/cpp/test_aten_xla_tensor_1; 10s local 2025-03-14T06:51:39.3453191Z 2025-03-14T06:51:39.3454016Z  2025-03-14T06:51:39.3454600Z  2025-03-14T06:51:39.3455168Z  2025-03-14T06:51:39.3455566Z  2025-03-14T06:51:39.3455958Z  2025-03-14T06:51:39.3456349Z  2025-03-14T06:51:39.3456741Z  2025-03-14T06:51:39.3457932Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:39.3458853Z Testing //test/cpp:test_tensor; 41s local 2025-03-14T06:51:39.3459608Z Testing //test/cpp:test_aten_xla_tensor_3; 26s local 2025-03-14T06:51:39.3460351Z Testing //test/cpp:test_aten_xla_tensor_5; 24s local 2025-03-14T06:51:39.3461078Z Linking test/cpp/test_aten_xla_tensor_2; 21s local 2025-03-14T06:51:39.3461805Z Testing //test/cpp:test_aten_xla_tensor_6; 19s local 2025-03-14T06:51:39.3462524Z Testing //test/cpp:test_aten_xla_tensor_4; 15s local 2025-03-14T06:51:39.3463243Z Linking test/cpp/test_aten_xla_tensor_1; 11s local 2025-03-14T06:51:40.4751799Z 2025-03-14T06:51:40.4752575Z  2025-03-14T06:51:40.4753096Z  2025-03-14T06:51:40.4753552Z  2025-03-14T06:51:40.4753998Z  2025-03-14T06:51:40.4754451Z  2025-03-14T06:51:40.4754890Z  2025-03-14T06:51:40.4755395Z  2025-03-14T06:51:40.4756349Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:40.4757308Z Testing //test/cpp:test_tensor; 42s local 2025-03-14T06:51:40.4758032Z Testing //test/cpp:test_aten_xla_tensor_3; 27s local 2025-03-14T06:51:40.4758972Z Testing //test/cpp:test_aten_xla_tensor_5; 25s local 2025-03-14T06:51:40.4759736Z Linking test/cpp/test_aten_xla_tensor_2; 22s local 2025-03-14T06:51:40.4760749Z Testing //test/cpp:test_aten_xla_tensor_6; 20s local 2025-03-14T06:51:40.4761531Z Testing //test/cpp:test_aten_xla_tensor_4; 16s local 2025-03-14T06:51:40.4764203Z Linking test/cpp/test_aten_xla_tensor_1; 12s local 2025-03-14T06:51:41.4758732Z 2025-03-14T06:51:41.4759944Z  2025-03-14T06:51:41.4760795Z  2025-03-14T06:51:41.4761445Z  2025-03-14T06:51:41.4762066Z  2025-03-14T06:51:41.4762759Z  2025-03-14T06:51:41.4763385Z  2025-03-14T06:51:41.4764015Z  2025-03-14T06:51:41.4765646Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:41.4766951Z Testing //test/cpp:test_tensor; 43s local 2025-03-14T06:51:41.4767704Z Testing //test/cpp:test_aten_xla_tensor_3; 28s local 2025-03-14T06:51:41.4768467Z Testing //test/cpp:test_aten_xla_tensor_5; 26s local 2025-03-14T06:51:41.4769624Z Linking test/cpp/test_aten_xla_tensor_2; 23s local 2025-03-14T06:51:41.4770606Z Testing //test/cpp:test_aten_xla_tensor_6; 21s local 2025-03-14T06:51:41.4771590Z Testing //test/cpp:test_aten_xla_tensor_4; 17s local 2025-03-14T06:51:41.4772577Z Linking test/cpp/test_aten_xla_tensor_1; 13s local 2025-03-14T06:51:42.6765748Z 2025-03-14T06:51:42.6766757Z  2025-03-14T06:51:42.6767573Z  2025-03-14T06:51:42.6768710Z  2025-03-14T06:51:42.6769266Z  2025-03-14T06:51:42.6769776Z  2025-03-14T06:51:42.6770280Z  2025-03-14T06:51:42.6770788Z  2025-03-14T06:51:42.6771996Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:42.6773031Z Testing //test/cpp:test_tensor; 44s local 2025-03-14T06:51:42.6773733Z Testing //test/cpp:test_aten_xla_tensor_3; 29s local 2025-03-14T06:51:42.6774477Z Testing //test/cpp:test_aten_xla_tensor_5; 27s local 2025-03-14T06:51:42.6775202Z Linking test/cpp/test_aten_xla_tensor_2; 25s local 2025-03-14T06:51:42.6775941Z Testing //test/cpp:test_aten_xla_tensor_6; 23s local 2025-03-14T06:51:42.6776677Z Testing //test/cpp:test_aten_xla_tensor_4; 19s local 2025-03-14T06:51:42.6777394Z Linking test/cpp/test_aten_xla_tensor_1; 14s local 2025-03-14T06:51:43.6771023Z 2025-03-14T06:51:43.6771846Z  2025-03-14T06:51:43.6772406Z  2025-03-14T06:51:43.6772857Z  2025-03-14T06:51:43.6773284Z  2025-03-14T06:51:43.6773722Z  2025-03-14T06:51:43.6774133Z  2025-03-14T06:51:43.6774560Z  2025-03-14T06:51:43.6775837Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:43.6776824Z Testing //test/cpp:test_tensor; 45s local 2025-03-14T06:51:43.6777704Z Testing //test/cpp:test_aten_xla_tensor_3; 30s local 2025-03-14T06:51:43.6778492Z Testing //test/cpp:test_aten_xla_tensor_5; 28s local 2025-03-14T06:51:43.6779275Z Linking test/cpp/test_aten_xla_tensor_2; 26s local 2025-03-14T06:51:43.6780059Z Testing //test/cpp:test_aten_xla_tensor_6; 24s local 2025-03-14T06:51:43.6780850Z Testing //test/cpp:test_aten_xla_tensor_4; 20s local 2025-03-14T06:51:43.6781614Z Linking test/cpp/test_aten_xla_tensor_1; 15s local 2025-03-14T06:51:44.8778092Z 2025-03-14T06:51:44.8779087Z  2025-03-14T06:51:44.8779688Z  2025-03-14T06:51:44.8780210Z  2025-03-14T06:51:44.8780720Z  2025-03-14T06:51:44.8781232Z  2025-03-14T06:51:44.8781740Z  2025-03-14T06:51:44.8782256Z  2025-03-14T06:51:44.8783455Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:44.8784688Z Testing //test/cpp:test_tensor; 46s local 2025-03-14T06:51:44.8785620Z Testing //test/cpp:test_aten_xla_tensor_3; 31s local 2025-03-14T06:51:44.8786575Z Testing //test/cpp:test_aten_xla_tensor_5; 30s local 2025-03-14T06:51:44.8787525Z Linking test/cpp/test_aten_xla_tensor_2; 27s local 2025-03-14T06:51:44.8788695Z Testing //test/cpp:test_aten_xla_tensor_6; 25s local 2025-03-14T06:51:44.8789645Z Testing //test/cpp:test_aten_xla_tensor_4; 21s local 2025-03-14T06:51:44.8790623Z Linking test/cpp/test_aten_xla_tensor_1; 16s local 2025-03-14T06:51:46.0784906Z 2025-03-14T06:51:46.0785728Z  2025-03-14T06:51:46.0786255Z  2025-03-14T06:51:46.0786792Z  2025-03-14T06:51:46.0787248Z  2025-03-14T06:51:46.0787697Z  2025-03-14T06:51:46.0788162Z  2025-03-14T06:51:46.0788614Z  2025-03-14T06:51:46.0789669Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:46.0790624Z Testing //test/cpp:test_tensor; 47s local 2025-03-14T06:51:46.0791504Z Testing //test/cpp:test_aten_xla_tensor_3; 32s local 2025-03-14T06:51:46.0792242Z Testing //test/cpp:test_aten_xla_tensor_5; 31s local 2025-03-14T06:51:46.0792972Z Linking test/cpp/test_aten_xla_tensor_2; 28s local 2025-03-14T06:51:46.0793708Z Testing //test/cpp:test_aten_xla_tensor_6; 26s local 2025-03-14T06:51:46.0794425Z Testing //test/cpp:test_aten_xla_tensor_4; 22s local 2025-03-14T06:51:46.0795137Z Linking test/cpp/test_aten_xla_tensor_1; 17s local 2025-03-14T06:51:47.1008091Z 2025-03-14T06:51:47.1009081Z  2025-03-14T06:51:47.1009636Z  2025-03-14T06:51:47.1010091Z  2025-03-14T06:51:47.1010595Z  2025-03-14T06:51:47.1011038Z  2025-03-14T06:51:47.1011486Z  2025-03-14T06:51:47.1011956Z  2025-03-14T06:51:47.1013001Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:47.1014094Z Testing //test/cpp:test_tensor; 48s local 2025-03-14T06:51:47.1014907Z Testing //test/cpp:test_aten_xla_tensor_3; 33s local 2025-03-14T06:51:47.1015764Z Testing //test/cpp:test_aten_xla_tensor_5; 32s local 2025-03-14T06:51:47.1016604Z Linking test/cpp/test_aten_xla_tensor_2; 29s local 2025-03-14T06:51:47.1017455Z Testing //test/cpp:test_aten_xla_tensor_6; 27s local 2025-03-14T06:51:47.1018300Z Testing //test/cpp:test_aten_xla_tensor_4; 23s local 2025-03-14T06:51:47.1019132Z Linking test/cpp/test_aten_xla_tensor_1; 19s local 2025-03-14T06:51:48.1013544Z 2025-03-14T06:51:48.1014405Z  2025-03-14T06:51:48.1014923Z  2025-03-14T06:51:48.1015363Z  2025-03-14T06:51:48.1015785Z  2025-03-14T06:51:48.1016216Z  2025-03-14T06:51:48.1016641Z  2025-03-14T06:51:48.1017074Z  2025-03-14T06:51:48.1018053Z [20,655 / 20,662] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:48.1019378Z Testing //test/cpp:test_tensor; 49s local 2025-03-14T06:51:48.1020237Z Testing //test/cpp:test_aten_xla_tensor_3; 34s local 2025-03-14T06:51:48.1021087Z Testing //test/cpp:test_aten_xla_tensor_5; 33s local 2025-03-14T06:51:48.1021865Z Linking test/cpp/test_aten_xla_tensor_2; 30s local 2025-03-14T06:51:48.1022647Z Testing //test/cpp:test_aten_xla_tensor_6; 28s local 2025-03-14T06:51:48.1023423Z Testing //test/cpp:test_aten_xla_tensor_4; 24s local 2025-03-14T06:51:48.1024537Z Linking test/cpp/test_aten_xla_tensor_1; 20s local 2025-03-14T06:51:48.5018266Z 2025-03-14T06:51:48.5019140Z  2025-03-14T06:51:48.5019644Z  2025-03-14T06:51:48.5020054Z  2025-03-14T06:51:48.5020470Z  2025-03-14T06:51:48.5020887Z  2025-03-14T06:51:48.5021311Z  2025-03-14T06:51:48.5021727Z  2025-03-14T06:51:48.5022679Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:48.5023678Z Testing //test/cpp:test_tensor; 50s local 2025-03-14T06:51:48.5024419Z Testing //test/cpp:test_aten_xla_tensor_3; 35s local 2025-03-14T06:51:48.5025199Z Testing //test/cpp:test_aten_xla_tensor_5; 33s local 2025-03-14T06:51:48.5025967Z Testing //test/cpp:test_aten_xla_tensor_6; 28s local 2025-03-14T06:51:48.5026981Z Testing //test/cpp:test_aten_xla_tensor_4; 24s local 2025-03-14T06:51:48.5027747Z Linking test/cpp/test_aten_xla_tensor_1; 20s local 2025-03-14T06:51:48.5028516Z Testing //test/cpp:test_aten_xla_tensor_2; 0s local 2025-03-14T06:51:49.5024641Z 2025-03-14T06:51:49.5025613Z  2025-03-14T06:51:49.5026122Z  2025-03-14T06:51:49.5026626Z  2025-03-14T06:51:49.5027069Z  2025-03-14T06:51:49.5027506Z  2025-03-14T06:51:49.5027940Z  2025-03-14T06:51:49.5028375Z  2025-03-14T06:51:49.5029377Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:49.5030396Z Testing //test/cpp:test_tensor; 51s local 2025-03-14T06:51:49.5031154Z Testing //test/cpp:test_aten_xla_tensor_3; 36s local 2025-03-14T06:51:49.5032001Z Testing //test/cpp:test_aten_xla_tensor_5; 34s local 2025-03-14T06:51:49.5032846Z Testing //test/cpp:test_aten_xla_tensor_6; 29s local 2025-03-14T06:51:49.5033660Z Testing //test/cpp:test_aten_xla_tensor_4; 25s local 2025-03-14T06:51:49.5034450Z Linking test/cpp/test_aten_xla_tensor_1; 21s local 2025-03-14T06:51:49.5035251Z Testing //test/cpp:test_aten_xla_tensor_2; 1s local 2025-03-14T06:51:50.5031570Z 2025-03-14T06:51:50.5032363Z  2025-03-14T06:51:50.5032869Z  2025-03-14T06:51:50.5033296Z  2025-03-14T06:51:50.5033718Z  2025-03-14T06:51:50.5034144Z  2025-03-14T06:51:50.5034564Z  2025-03-14T06:51:50.5034979Z  2025-03-14T06:51:50.5035910Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:50.5036909Z Testing //test/cpp:test_tensor; 52s local 2025-03-14T06:51:50.5037640Z Testing //test/cpp:test_aten_xla_tensor_3; 37s local 2025-03-14T06:51:50.5038416Z Testing //test/cpp:test_aten_xla_tensor_5; 35s local 2025-03-14T06:51:50.5039179Z Testing //test/cpp:test_aten_xla_tensor_6; 30s local 2025-03-14T06:51:50.5039955Z Testing //test/cpp:test_aten_xla_tensor_4; 26s local 2025-03-14T06:51:50.5040715Z Linking test/cpp/test_aten_xla_tensor_1; 22s local 2025-03-14T06:51:50.5041469Z Testing //test/cpp:test_aten_xla_tensor_2; 2s local 2025-03-14T06:51:51.7037729Z 2025-03-14T06:51:51.7038633Z  2025-03-14T06:51:51.7039162Z  2025-03-14T06:51:51.7039617Z  2025-03-14T06:51:51.7040470Z  2025-03-14T06:51:51.7040920Z  2025-03-14T06:51:51.7041360Z  2025-03-14T06:51:51.7041805Z  2025-03-14T06:51:51.7042889Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:51.7044334Z Testing //test/cpp:test_tensor; 53s local 2025-03-14T06:51:51.7045430Z Testing //test/cpp:test_aten_xla_tensor_3; 38s local 2025-03-14T06:51:51.7046330Z Testing //test/cpp:test_aten_xla_tensor_5; 36s local 2025-03-14T06:51:51.7047236Z Testing //test/cpp:test_aten_xla_tensor_6; 32s local 2025-03-14T06:51:51.7048151Z Testing //test/cpp:test_aten_xla_tensor_4; 28s local 2025-03-14T06:51:51.7049052Z Linking test/cpp/test_aten_xla_tensor_1; 23s local 2025-03-14T06:51:51.7049946Z Testing //test/cpp:test_aten_xla_tensor_2; 3s local 2025-03-14T06:51:52.7061167Z 2025-03-14T06:51:52.7062363Z  2025-03-14T06:51:52.7062891Z  2025-03-14T06:51:52.7063368Z  2025-03-14T06:51:52.7063813Z  2025-03-14T06:51:52.7064277Z  2025-03-14T06:51:52.7064731Z  2025-03-14T06:51:52.7065167Z  2025-03-14T06:51:52.7066361Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:52.7067403Z Testing //test/cpp:test_tensor; 54s local 2025-03-14T06:51:52.7068150Z Testing //test/cpp:test_aten_xla_tensor_3; 39s local 2025-03-14T06:51:52.7068955Z Testing //test/cpp:test_aten_xla_tensor_5; 37s local 2025-03-14T06:51:52.7069895Z Testing //test/cpp:test_aten_xla_tensor_6; 33s local 2025-03-14T06:51:52.7070676Z Testing //test/cpp:test_aten_xla_tensor_4; 29s local 2025-03-14T06:51:52.7071725Z Linking test/cpp/test_aten_xla_tensor_1; 24s local 2025-03-14T06:51:52.7072511Z Testing //test/cpp:test_aten_xla_tensor_2; 4s local 2025-03-14T06:51:53.7174305Z 2025-03-14T06:51:53.7175150Z  2025-03-14T06:51:53.7175631Z  2025-03-14T06:51:53.7176053Z  2025-03-14T06:51:53.7176490Z  2025-03-14T06:51:53.7176932Z  2025-03-14T06:51:53.7177355Z  2025-03-14T06:51:53.7177784Z  2025-03-14T06:51:53.7178765Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:53.7179822Z Testing //test/cpp:test_tensor; 55s local 2025-03-14T06:51:53.7180546Z Testing //test/cpp:test_aten_xla_tensor_3; 40s local 2025-03-14T06:51:53.7181367Z Testing //test/cpp:test_aten_xla_tensor_5; 38s local 2025-03-14T06:51:53.7182217Z Testing //test/cpp:test_aten_xla_tensor_6; 34s local 2025-03-14T06:51:53.7183019Z Testing //test/cpp:test_aten_xla_tensor_4; 30s local 2025-03-14T06:51:53.7183819Z Linking test/cpp/test_aten_xla_tensor_1; 25s local 2025-03-14T06:51:53.7184616Z Testing //test/cpp:test_aten_xla_tensor_2; 5s local 2025-03-14T06:51:54.7179593Z 2025-03-14T06:51:54.7180369Z  2025-03-14T06:51:54.7180837Z  2025-03-14T06:51:54.7181245Z  2025-03-14T06:51:54.7181651Z  2025-03-14T06:51:54.7182059Z  2025-03-14T06:51:54.7182466Z  2025-03-14T06:51:54.7182868Z  2025-03-14T06:51:54.7183783Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:54.7184729Z Testing //test/cpp:test_tensor; 56s local 2025-03-14T06:51:54.7185423Z Testing //test/cpp:test_aten_xla_tensor_3; 41s local 2025-03-14T06:51:54.7186174Z Testing //test/cpp:test_aten_xla_tensor_5; 39s local 2025-03-14T06:51:54.7186907Z Testing //test/cpp:test_aten_xla_tensor_6; 35s local 2025-03-14T06:51:54.7187642Z Testing //test/cpp:test_aten_xla_tensor_4; 31s local 2025-03-14T06:51:54.7188369Z Linking test/cpp/test_aten_xla_tensor_1; 26s local 2025-03-14T06:51:54.7189121Z Testing //test/cpp:test_aten_xla_tensor_2; 6s local 2025-03-14T06:51:55.9187195Z 2025-03-14T06:51:55.9187985Z  2025-03-14T06:51:55.9188439Z  2025-03-14T06:51:55.9188835Z  2025-03-14T06:51:55.9189306Z  2025-03-14T06:51:55.9189699Z  2025-03-14T06:51:55.9190090Z  2025-03-14T06:51:55.9190472Z  2025-03-14T06:51:55.9191362Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:55.9192537Z Testing //test/cpp:test_tensor; 57s local 2025-03-14T06:51:55.9193233Z Testing //test/cpp:test_aten_xla_tensor_3; 42s local 2025-03-14T06:51:55.9194032Z Testing //test/cpp:test_aten_xla_tensor_5; 41s local 2025-03-14T06:51:55.9194764Z Testing //test/cpp:test_aten_xla_tensor_6; 36s local 2025-03-14T06:51:55.9195485Z Testing //test/cpp:test_aten_xla_tensor_4; 32s local 2025-03-14T06:51:55.9196212Z Linking test/cpp/test_aten_xla_tensor_1; 27s local 2025-03-14T06:51:55.9196925Z Testing //test/cpp:test_aten_xla_tensor_2; 7s local 2025-03-14T06:51:56.9192710Z 2025-03-14T06:51:56.9194119Z  2025-03-14T06:51:56.9194616Z  2025-03-14T06:51:56.9195019Z  2025-03-14T06:51:56.9195436Z  2025-03-14T06:51:56.9195856Z  2025-03-14T06:51:56.9196277Z  2025-03-14T06:51:56.9196692Z  2025-03-14T06:51:56.9197674Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:56.9198716Z Testing //test/cpp:test_tensor; 58s local 2025-03-14T06:51:56.9199457Z Testing //test/cpp:test_aten_xla_tensor_3; 43s local 2025-03-14T06:51:56.9200269Z Testing //test/cpp:test_aten_xla_tensor_5; 42s local 2025-03-14T06:51:56.9201078Z Testing //test/cpp:test_aten_xla_tensor_6; 37s local 2025-03-14T06:51:56.9201863Z Testing //test/cpp:test_aten_xla_tensor_4; 33s local 2025-03-14T06:51:56.9202910Z Linking test/cpp/test_aten_xla_tensor_1; 28s local 2025-03-14T06:51:56.9203702Z Testing //test/cpp:test_aten_xla_tensor_2; 8s local 2025-03-14T06:51:57.9198693Z 2025-03-14T06:51:57.9200051Z  2025-03-14T06:51:57.9200533Z  2025-03-14T06:51:57.9200944Z  2025-03-14T06:51:57.9201348Z  2025-03-14T06:51:57.9201748Z  2025-03-14T06:51:57.9202150Z  2025-03-14T06:51:57.9202556Z  2025-03-14T06:51:57.9203488Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:57.9204474Z Testing //test/cpp:test_tensor; 59s local 2025-03-14T06:51:57.9205270Z Testing //test/cpp:test_aten_xla_tensor_3; 44s local 2025-03-14T06:51:57.9206056Z Testing //test/cpp:test_aten_xla_tensor_5; 43s local 2025-03-14T06:51:57.9206828Z Testing //test/cpp:test_aten_xla_tensor_6; 38s local 2025-03-14T06:51:57.9207614Z Testing //test/cpp:test_aten_xla_tensor_4; 34s local 2025-03-14T06:51:57.9208385Z Linking test/cpp/test_aten_xla_tensor_1; 29s local 2025-03-14T06:51:57.9209162Z Testing //test/cpp:test_aten_xla_tensor_2; 9s local 2025-03-14T06:51:59.1206324Z 2025-03-14T06:51:59.1207173Z  2025-03-14T06:51:59.1207679Z  2025-03-14T06:51:59.1208098Z  2025-03-14T06:51:59.1208503Z  2025-03-14T06:51:59.1208915Z  2025-03-14T06:51:59.1209333Z  2025-03-14T06:51:59.1209740Z  2025-03-14T06:51:59.1210672Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:59.1211629Z Testing //test/cpp:test_tensor; 60s local 2025-03-14T06:51:59.1212363Z Testing //test/cpp:test_aten_xla_tensor_3; 45s local 2025-03-14T06:51:59.1213245Z Testing //test/cpp:test_aten_xla_tensor_5; 44s local 2025-03-14T06:51:59.1213988Z Testing //test/cpp:test_aten_xla_tensor_6; 39s local 2025-03-14T06:51:59.1214732Z Testing //test/cpp:test_aten_xla_tensor_4; 35s local 2025-03-14T06:51:59.1215471Z Linking test/cpp/test_aten_xla_tensor_1; 31s local 2025-03-14T06:51:59.1216216Z Testing //test/cpp:test_aten_xla_tensor_2; 10s local 2025-03-14T06:51:59.3468574Z 2025-03-14T06:51:59.3469450Z  2025-03-14T06:51:59.3470015Z  2025-03-14T06:51:59.3470610Z  2025-03-14T06:51:59.3471000Z  2025-03-14T06:51:59.3471395Z  2025-03-14T06:51:59.3471775Z  2025-03-14T06:51:59.3472157Z  2025-03-14T06:51:59.3473036Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:51:59.3473941Z Testing //test/cpp:test_tensor; 61s local 2025-03-14T06:51:59.3474816Z Testing //test/cpp:test_aten_xla_tensor_3; 46s local 2025-03-14T06:51:59.3475618Z Testing //test/cpp:test_aten_xla_tensor_5; 44s local 2025-03-14T06:51:59.3476378Z Testing //test/cpp:test_aten_xla_tensor_6; 39s local 2025-03-14T06:51:59.3477116Z Testing //test/cpp:test_aten_xla_tensor_4; 35s local 2025-03-14T06:51:59.3477876Z Linking test/cpp/test_aten_xla_tensor_1; 31s local 2025-03-14T06:51:59.3478596Z Testing //test/cpp:test_aten_xla_tensor_2; 11s local 2025-03-14T06:52:00.5212832Z 2025-03-14T06:52:00.5213925Z  2025-03-14T06:52:00.5214696Z  2025-03-14T06:52:00.5215251Z  2025-03-14T06:52:00.5215727Z  2025-03-14T06:52:00.5216402Z  2025-03-14T06:52:00.5216982Z  2025-03-14T06:52:00.5217558Z  2025-03-14T06:52:00.5218929Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:00.5220305Z Testing //test/cpp:test_tensor; 62s local 2025-03-14T06:52:00.5221359Z Testing //test/cpp:test_aten_xla_tensor_3; 47s local 2025-03-14T06:52:00.5222408Z Testing //test/cpp:test_aten_xla_tensor_5; 45s local 2025-03-14T06:52:00.5223502Z Testing //test/cpp:test_aten_xla_tensor_6; 40s local 2025-03-14T06:52:00.5224399Z Testing //test/cpp:test_aten_xla_tensor_4; 36s local 2025-03-14T06:52:00.5225518Z Linking test/cpp/test_aten_xla_tensor_1; 32s local 2025-03-14T06:52:00.5226363Z Testing //test/cpp:test_aten_xla_tensor_2; 12s local 2025-03-14T06:52:01.5219303Z 2025-03-14T06:52:01.5220524Z  2025-03-14T06:52:01.5221043Z  2025-03-14T06:52:01.5221497Z  2025-03-14T06:52:01.5221939Z  2025-03-14T06:52:01.5222384Z  2025-03-14T06:52:01.5222833Z  2025-03-14T06:52:01.5223284Z  2025-03-14T06:52:01.5224282Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:01.5225295Z Testing //test/cpp:test_tensor; 63s local 2025-03-14T06:52:01.5226087Z Testing //test/cpp:test_aten_xla_tensor_3; 48s local 2025-03-14T06:52:01.5226909Z Testing //test/cpp:test_aten_xla_tensor_5; 46s local 2025-03-14T06:52:01.5227723Z Testing //test/cpp:test_aten_xla_tensor_6; 41s local 2025-03-14T06:52:01.5228547Z Testing //test/cpp:test_aten_xla_tensor_4; 37s local 2025-03-14T06:52:01.5229372Z Linking test/cpp/test_aten_xla_tensor_1; 33s local 2025-03-14T06:52:01.5230193Z Testing //test/cpp:test_aten_xla_tensor_2; 13s local 2025-03-14T06:52:02.7224498Z 2025-03-14T06:52:02.7225311Z  2025-03-14T06:52:02.7225816Z  2025-03-14T06:52:02.7226204Z  2025-03-14T06:52:02.7226610Z  2025-03-14T06:52:02.7227014Z  2025-03-14T06:52:02.7227412Z  2025-03-14T06:52:02.7227811Z  2025-03-14T06:52:02.7228744Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:02.7229831Z Testing //test/cpp:test_tensor; 64s local 2025-03-14T06:52:02.7230651Z Testing //test/cpp:test_aten_xla_tensor_3; 49s local 2025-03-14T06:52:02.7231524Z Testing //test/cpp:test_aten_xla_tensor_5; 47s local 2025-03-14T06:52:02.7232387Z Testing //test/cpp:test_aten_xla_tensor_6; 43s local 2025-03-14T06:52:02.7233242Z Testing //test/cpp:test_aten_xla_tensor_4; 39s local 2025-03-14T06:52:02.7234099Z Linking test/cpp/test_aten_xla_tensor_1; 34s local 2025-03-14T06:52:02.7234951Z Testing //test/cpp:test_aten_xla_tensor_2; 14s local 2025-03-14T06:52:03.7230800Z 2025-03-14T06:52:03.7231578Z  2025-03-14T06:52:03.7232126Z  2025-03-14T06:52:03.7232586Z  2025-03-14T06:52:03.7233034Z  2025-03-14T06:52:03.7233483Z  2025-03-14T06:52:03.7233926Z  2025-03-14T06:52:03.7234382Z  2025-03-14T06:52:03.7235436Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:03.7236515Z Testing //test/cpp:test_tensor; 65s local 2025-03-14T06:52:03.7237606Z Testing //test/cpp:test_aten_xla_tensor_3; 50s local 2025-03-14T06:52:03.7238537Z Testing //test/cpp:test_aten_xla_tensor_5; 48s local 2025-03-14T06:52:03.7239396Z Testing //test/cpp:test_aten_xla_tensor_6; 44s local 2025-03-14T06:52:03.7240250Z Testing //test/cpp:test_aten_xla_tensor_4; 40s local 2025-03-14T06:52:03.7241112Z Linking test/cpp/test_aten_xla_tensor_1; 35s local 2025-03-14T06:52:03.7241964Z Testing //test/cpp:test_aten_xla_tensor_2; 15s local 2025-03-14T06:52:04.9236967Z 2025-03-14T06:52:04.9237796Z  2025-03-14T06:52:04.9238362Z  2025-03-14T06:52:04.9238815Z  2025-03-14T06:52:04.9239281Z  2025-03-14T06:52:04.9239723Z  2025-03-14T06:52:04.9240169Z  2025-03-14T06:52:04.9240621Z  2025-03-14T06:52:04.9241677Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:04.9242848Z Testing //test/cpp:test_tensor; 66s local 2025-03-14T06:52:04.9243582Z Testing //test/cpp:test_aten_xla_tensor_3; 51s local 2025-03-14T06:52:04.9244363Z Testing //test/cpp:test_aten_xla_tensor_5; 50s local 2025-03-14T06:52:04.9245193Z Testing //test/cpp:test_aten_xla_tensor_6; 45s local 2025-03-14T06:52:04.9245962Z Testing //test/cpp:test_aten_xla_tensor_4; 41s local 2025-03-14T06:52:04.9247008Z Linking test/cpp/test_aten_xla_tensor_1; 36s local 2025-03-14T06:52:04.9247772Z Testing //test/cpp:test_aten_xla_tensor_2; 16s local 2025-03-14T06:52:05.9398379Z 2025-03-14T06:52:05.9399278Z  2025-03-14T06:52:05.9400030Z  2025-03-14T06:52:05.9400449Z  2025-03-14T06:52:05.9400881Z  2025-03-14T06:52:05.9401281Z  2025-03-14T06:52:05.9401684Z  2025-03-14T06:52:05.9402093Z  2025-03-14T06:52:05.9403022Z [20,656 / 20,663] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:05.9404260Z Testing //test/cpp:test_tensor; 67s local 2025-03-14T06:52:05.9405157Z Testing //test/cpp:test_aten_xla_tensor_3; 52s local 2025-03-14T06:52:05.9406038Z Testing //test/cpp:test_aten_xla_tensor_5; 51s local 2025-03-14T06:52:05.9406906Z Testing //test/cpp:test_aten_xla_tensor_6; 46s local 2025-03-14T06:52:05.9407768Z Testing //test/cpp:test_aten_xla_tensor_4; 42s local 2025-03-14T06:52:05.9408632Z Linking test/cpp/test_aten_xla_tensor_1; 37s local 2025-03-14T06:52:05.9409490Z Testing //test/cpp:test_aten_xla_tensor_2; 17s local 2025-03-14T06:52:07.0072804Z 2025-03-14T06:52:07.0073712Z  2025-03-14T06:52:07.0074205Z  2025-03-14T06:52:07.0074610Z  2025-03-14T06:52:07.0075009Z  2025-03-14T06:52:07.0075402Z  2025-03-14T06:52:07.0075771Z  2025-03-14T06:52:07.0076155Z  2025-03-14T06:52:07.0077050Z [20,657 / 20,663] 10 / 17 tests; 6 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:07.0078124Z Testing //test/cpp:test_tensor; 68s local 2025-03-14T06:52:07.0078809Z Testing //test/cpp:test_aten_xla_tensor_3; 53s local 2025-03-14T06:52:07.0079544Z Testing //test/cpp:test_aten_xla_tensor_5; 52s local 2025-03-14T06:52:07.0080267Z Testing //test/cpp:test_aten_xla_tensor_6; 47s local 2025-03-14T06:52:07.0080988Z Testing //test/cpp:test_aten_xla_tensor_4; 43s local 2025-03-14T06:52:07.0081710Z Testing //test/cpp:test_aten_xla_tensor_2; 18s local 2025-03-14T06:52:07.4076479Z 2025-03-14T06:52:07.4077293Z  2025-03-14T06:52:07.4077770Z  2025-03-14T06:52:07.4078195Z  2025-03-14T06:52:07.4078665Z  2025-03-14T06:52:07.4079138Z  2025-03-14T06:52:07.4079552Z  2025-03-14T06:52:07.4080645Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:07.4081591Z Testing //test/cpp:test_tensor; 69s local 2025-03-14T06:52:07.4082311Z Testing //test/cpp:test_aten_xla_tensor_3; 54s local 2025-03-14T06:52:07.4083395Z Testing //test/cpp:test_aten_xla_tensor_5; 52s local 2025-03-14T06:52:07.4084170Z Testing //test/cpp:test_aten_xla_tensor_6; 47s local 2025-03-14T06:52:07.4085082Z Testing //test/cpp:test_aten_xla_tensor_4; 43s local 2025-03-14T06:52:07.4085837Z Testing //test/cpp:test_aten_xla_tensor_2; 19s local 2025-03-14T06:52:07.4086595Z Testing //test/cpp:test_aten_xla_tensor_1; 0s local 2025-03-14T06:52:08.4083291Z 2025-03-14T06:52:08.4084114Z  2025-03-14T06:52:08.4084701Z  2025-03-14T06:52:08.4085123Z  2025-03-14T06:52:08.4085536Z  2025-03-14T06:52:08.4085943Z  2025-03-14T06:52:08.4086380Z  2025-03-14T06:52:08.4086786Z  2025-03-14T06:52:08.4087704Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:08.4088617Z Testing //test/cpp:test_tensor; 70s local 2025-03-14T06:52:08.4089317Z Testing //test/cpp:test_aten_xla_tensor_3; 55s local 2025-03-14T06:52:08.4090068Z Testing //test/cpp:test_aten_xla_tensor_5; 53s local 2025-03-14T06:52:08.4090815Z Testing //test/cpp:test_aten_xla_tensor_6; 48s local 2025-03-14T06:52:08.4091844Z Testing //test/cpp:test_aten_xla_tensor_4; 44s local 2025-03-14T06:52:08.4092867Z Testing //test/cpp:test_aten_xla_tensor_2; 20s local 2025-03-14T06:52:08.4093818Z Testing //test/cpp:test_aten_xla_tensor_1; 1s local 2025-03-14T06:52:09.4278110Z 2025-03-14T06:52:09.4280044Z  2025-03-14T06:52:09.4280536Z  2025-03-14T06:52:09.4280958Z  2025-03-14T06:52:09.4281311Z  2025-03-14T06:52:09.4281661Z  2025-03-14T06:52:09.4282321Z  2025-03-14T06:52:09.4282669Z  2025-03-14T06:52:09.4283528Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:09.4284461Z Testing //test/cpp:test_tensor; 71s local 2025-03-14T06:52:09.4285214Z Testing //test/cpp:test_aten_xla_tensor_3; 56s local 2025-03-14T06:52:09.4285900Z Testing //test/cpp:test_aten_xla_tensor_5; 54s local 2025-03-14T06:52:09.4286659Z Testing //test/cpp:test_aten_xla_tensor_6; 49s local 2025-03-14T06:52:09.4287353Z Testing //test/cpp:test_aten_xla_tensor_4; 45s local 2025-03-14T06:52:09.4287998Z Testing //test/cpp:test_aten_xla_tensor_2; 21s local 2025-03-14T06:52:09.4288718Z Testing //test/cpp:test_aten_xla_tensor_1; 2s local 2025-03-14T06:52:10.4281106Z 2025-03-14T06:52:10.4281935Z  2025-03-14T06:52:10.4282418Z  2025-03-14T06:52:10.4282846Z  2025-03-14T06:52:10.4283247Z  2025-03-14T06:52:10.4283641Z  2025-03-14T06:52:10.4284066Z  2025-03-14T06:52:10.4284466Z  2025-03-14T06:52:10.4285510Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:10.4286449Z Testing //test/cpp:test_tensor; 72s local 2025-03-14T06:52:10.4287158Z Testing //test/cpp:test_aten_xla_tensor_3; 57s local 2025-03-14T06:52:10.4287919Z Testing //test/cpp:test_aten_xla_tensor_5; 55s local 2025-03-14T06:52:10.4288678Z Testing //test/cpp:test_aten_xla_tensor_6; 50s local 2025-03-14T06:52:10.4289440Z Testing //test/cpp:test_aten_xla_tensor_4; 46s local 2025-03-14T06:52:10.4290183Z Testing //test/cpp:test_aten_xla_tensor_2; 22s local 2025-03-14T06:52:10.4290925Z Testing //test/cpp:test_aten_xla_tensor_1; 3s local 2025-03-14T06:52:11.6288912Z 2025-03-14T06:52:11.6289736Z  2025-03-14T06:52:11.6290229Z  2025-03-14T06:52:11.6290662Z  2025-03-14T06:52:11.6291066Z  2025-03-14T06:52:11.6291469Z  2025-03-14T06:52:11.6291899Z  2025-03-14T06:52:11.6292312Z  2025-03-14T06:52:11.6293217Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:11.6294138Z Testing //test/cpp:test_tensor; 73s local 2025-03-14T06:52:11.6294833Z Testing //test/cpp:test_aten_xla_tensor_3; 58s local 2025-03-14T06:52:11.6295578Z Testing //test/cpp:test_aten_xla_tensor_5; 56s local 2025-03-14T06:52:11.6296542Z Testing //test/cpp:test_aten_xla_tensor_6; 51s local 2025-03-14T06:52:11.6297357Z Testing //test/cpp:test_aten_xla_tensor_4; 48s local 2025-03-14T06:52:11.6298086Z Testing //test/cpp:test_aten_xla_tensor_2; 23s local 2025-03-14T06:52:11.6298803Z Testing //test/cpp:test_aten_xla_tensor_1; 4s local 2025-03-14T06:52:12.8295443Z 2025-03-14T06:52:12.8296268Z  2025-03-14T06:52:12.8296740Z  2025-03-14T06:52:12.8297141Z  2025-03-14T06:52:12.8297543Z  2025-03-14T06:52:12.8297926Z  2025-03-14T06:52:12.8298350Z  2025-03-14T06:52:12.8298754Z  2025-03-14T06:52:12.8299691Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:12.8300651Z Testing //test/cpp:test_tensor; 74s local 2025-03-14T06:52:12.8301367Z Testing //test/cpp:test_aten_xla_tensor_3; 59s local 2025-03-14T06:52:12.8302141Z Testing //test/cpp:test_aten_xla_tensor_5; 58s local 2025-03-14T06:52:12.8302903Z Testing //test/cpp:test_aten_xla_tensor_6; 53s local 2025-03-14T06:52:12.8303666Z Testing //test/cpp:test_aten_xla_tensor_4; 49s local 2025-03-14T06:52:12.8304474Z Testing //test/cpp:test_aten_xla_tensor_2; 24s local 2025-03-14T06:52:12.8305231Z Testing //test/cpp:test_aten_xla_tensor_1; 5s local 2025-03-14T06:52:13.8301664Z 2025-03-14T06:52:13.8303005Z  2025-03-14T06:52:13.8303485Z  2025-03-14T06:52:13.8303913Z  2025-03-14T06:52:13.8304734Z  2025-03-14T06:52:13.8305309Z  2025-03-14T06:52:13.8306152Z  2025-03-14T06:52:13.8306677Z  2025-03-14T06:52:13.8307899Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:13.8309172Z Testing //test/cpp:test_tensor; 75s local 2025-03-14T06:52:13.8310127Z Testing //test/cpp:test_aten_xla_tensor_3; 60s local 2025-03-14T06:52:13.8311144Z Testing //test/cpp:test_aten_xla_tensor_5; 59s local 2025-03-14T06:52:13.8312204Z Testing //test/cpp:test_aten_xla_tensor_6; 54s local 2025-03-14T06:52:13.8313009Z Testing //test/cpp:test_aten_xla_tensor_4; 50s local 2025-03-14T06:52:13.8313805Z Testing //test/cpp:test_aten_xla_tensor_2; 25s local 2025-03-14T06:52:13.8314588Z Testing //test/cpp:test_aten_xla_tensor_1; 6s local 2025-03-14T06:52:14.8307164Z 2025-03-14T06:52:14.8308452Z  2025-03-14T06:52:14.8308942Z  2025-03-14T06:52:14.8309342Z  2025-03-14T06:52:14.8309726Z  2025-03-14T06:52:14.8310127Z  2025-03-14T06:52:14.8310548Z  2025-03-14T06:52:14.8310950Z  2025-03-14T06:52:14.8311853Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:14.8312784Z Testing //test/cpp:test_tensor; 76s local 2025-03-14T06:52:14.8313493Z Testing //test/cpp:test_aten_xla_tensor_3; 61s local 2025-03-14T06:52:14.8314248Z Testing //test/cpp:test_aten_xla_tensor_5; 60s local 2025-03-14T06:52:14.8314998Z Testing //test/cpp:test_aten_xla_tensor_6; 55s local 2025-03-14T06:52:14.8315746Z Testing //test/cpp:test_aten_xla_tensor_4; 51s local 2025-03-14T06:52:14.8316483Z Testing //test/cpp:test_aten_xla_tensor_2; 26s local 2025-03-14T06:52:14.8317225Z Testing //test/cpp:test_aten_xla_tensor_1; 7s local 2025-03-14T06:52:16.0314052Z 2025-03-14T06:52:16.0315204Z  2025-03-14T06:52:16.0315666Z  2025-03-14T06:52:16.0316054Z  2025-03-14T06:52:16.0316443Z  2025-03-14T06:52:16.0316826Z  2025-03-14T06:52:16.0317238Z  2025-03-14T06:52:16.0317607Z  2025-03-14T06:52:16.0318495Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:16.0319402Z Testing //test/cpp:test_tensor; 77s local 2025-03-14T06:52:16.0320086Z Testing //test/cpp:test_aten_xla_tensor_3; 62s local 2025-03-14T06:52:16.0320995Z Testing //test/cpp:test_aten_xla_tensor_5; 61s local 2025-03-14T06:52:16.0321976Z Testing //test/cpp:test_aten_xla_tensor_6; 56s local 2025-03-14T06:52:16.0322802Z Testing //test/cpp:test_aten_xla_tensor_4; 52s local 2025-03-14T06:52:16.0323532Z Testing //test/cpp:test_aten_xla_tensor_2; 27s local 2025-03-14T06:52:16.0324237Z Testing //test/cpp:test_aten_xla_tensor_1; 8s local 2025-03-14T06:52:17.0320801Z 2025-03-14T06:52:17.0321979Z  2025-03-14T06:52:17.0322472Z  2025-03-14T06:52:17.0322881Z  2025-03-14T06:52:17.0323289Z  2025-03-14T06:52:17.0323692Z  2025-03-14T06:52:17.0324130Z  2025-03-14T06:52:17.0324589Z  2025-03-14T06:52:17.0325547Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:17.0326487Z Testing //test/cpp:test_tensor; 78s local 2025-03-14T06:52:17.0327228Z Testing //test/cpp:test_aten_xla_tensor_3; 63s local 2025-03-14T06:52:17.0327993Z Testing //test/cpp:test_aten_xla_tensor_5; 62s local 2025-03-14T06:52:17.0328752Z Testing //test/cpp:test_aten_xla_tensor_6; 57s local 2025-03-14T06:52:17.0329517Z Testing //test/cpp:test_aten_xla_tensor_4; 53s local 2025-03-14T06:52:17.0330269Z Testing //test/cpp:test_aten_xla_tensor_2; 28s local 2025-03-14T06:52:17.0331010Z Testing //test/cpp:test_aten_xla_tensor_1; 9s local 2025-03-14T06:52:18.2327516Z 2025-03-14T06:52:18.2328283Z  2025-03-14T06:52:18.2328755Z  2025-03-14T06:52:18.2329163Z  2025-03-14T06:52:18.2329569Z  2025-03-14T06:52:18.2329970Z  2025-03-14T06:52:18.2330363Z  2025-03-14T06:52:18.2331014Z  2025-03-14T06:52:18.2331964Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:18.2332957Z Testing //test/cpp:test_tensor; 79s local 2025-03-14T06:52:18.2333733Z Testing //test/cpp:test_aten_xla_tensor_3; 64s local 2025-03-14T06:52:18.2334535Z Testing //test/cpp:test_aten_xla_tensor_5; 63s local 2025-03-14T06:52:18.2335340Z Testing //test/cpp:test_aten_xla_tensor_6; 58s local 2025-03-14T06:52:18.2336098Z Testing //test/cpp:test_aten_xla_tensor_4; 54s local 2025-03-14T06:52:18.2336863Z Testing //test/cpp:test_aten_xla_tensor_2; 30s local 2025-03-14T06:52:18.2337617Z Testing //test/cpp:test_aten_xla_tensor_1; 11s local 2025-03-14T06:52:18.4330794Z 2025-03-14T06:52:18.4331809Z  2025-03-14T06:52:18.4332430Z  2025-03-14T06:52:18.4332973Z  2025-03-14T06:52:18.4333509Z  2025-03-14T06:52:18.4334042Z  2025-03-14T06:52:18.4334572Z  2025-03-14T06:52:18.4335143Z  2025-03-14T06:52:18.4336350Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:18.4337619Z Testing //test/cpp:test_tensor; 80s local 2025-03-14T06:52:18.4338573Z Testing //test/cpp:test_aten_xla_tensor_3; 65s local 2025-03-14T06:52:18.4339598Z Testing //test/cpp:test_aten_xla_tensor_5; 63s local 2025-03-14T06:52:18.4340613Z Testing //test/cpp:test_aten_xla_tensor_6; 58s local 2025-03-14T06:52:18.4341635Z Testing //test/cpp:test_aten_xla_tensor_4; 54s local 2025-03-14T06:52:18.4342642Z Testing //test/cpp:test_aten_xla_tensor_2; 30s local 2025-03-14T06:52:18.4343650Z Testing //test/cpp:test_aten_xla_tensor_1; 11s local 2025-03-14T06:52:19.6337134Z 2025-03-14T06:52:19.6338014Z  2025-03-14T06:52:19.6338549Z  2025-03-14T06:52:19.6339004Z  2025-03-14T06:52:19.6339441Z  2025-03-14T06:52:19.6339888Z  2025-03-14T06:52:19.6340341Z  2025-03-14T06:52:19.6340805Z  2025-03-14T06:52:19.6341835Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:19.6342882Z Testing //test/cpp:test_tensor; 81s local 2025-03-14T06:52:19.6343675Z Testing //test/cpp:test_aten_xla_tensor_3; 66s local 2025-03-14T06:52:19.6344521Z Testing //test/cpp:test_aten_xla_tensor_5; 64s local 2025-03-14T06:52:19.6345720Z Testing //test/cpp:test_aten_xla_tensor_6; 59s local 2025-03-14T06:52:19.6346651Z Testing //test/cpp:test_aten_xla_tensor_4; 56s local 2025-03-14T06:52:19.6347502Z Testing //test/cpp:test_aten_xla_tensor_2; 31s local 2025-03-14T06:52:19.6348317Z Testing //test/cpp:test_aten_xla_tensor_1; 12s local 2025-03-14T06:52:20.6343351Z 2025-03-14T06:52:20.6344174Z  2025-03-14T06:52:20.6344688Z  2025-03-14T06:52:20.6345116Z  2025-03-14T06:52:20.6345550Z  2025-03-14T06:52:20.6345969Z  2025-03-14T06:52:20.6346403Z  2025-03-14T06:52:20.6346847Z  2025-03-14T06:52:20.6347848Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:20.6348854Z Testing //test/cpp:test_tensor; 82s local 2025-03-14T06:52:20.6349628Z Testing //test/cpp:test_aten_xla_tensor_3; 67s local 2025-03-14T06:52:20.6350441Z Testing //test/cpp:test_aten_xla_tensor_5; 65s local 2025-03-14T06:52:20.6351262Z Testing //test/cpp:test_aten_xla_tensor_6; 60s local 2025-03-14T06:52:20.6352084Z Testing //test/cpp:test_aten_xla_tensor_4; 57s local 2025-03-14T06:52:20.6352884Z Testing //test/cpp:test_aten_xla_tensor_2; 32s local 2025-03-14T06:52:20.6353684Z Testing //test/cpp:test_aten_xla_tensor_1; 13s local 2025-03-14T06:52:21.6476457Z 2025-03-14T06:52:21.6477563Z  2025-03-14T06:52:21.6478115Z  2025-03-14T06:52:21.6478550Z  2025-03-14T06:52:21.6478988Z  2025-03-14T06:52:21.6479417Z  2025-03-14T06:52:21.6479845Z  2025-03-14T06:52:21.6480373Z  2025-03-14T06:52:21.6481371Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:21.6482396Z Testing //test/cpp:test_tensor; 83s local 2025-03-14T06:52:21.6483171Z Testing //test/cpp:test_aten_xla_tensor_3; 68s local 2025-03-14T06:52:21.6483992Z Testing //test/cpp:test_aten_xla_tensor_5; 66s local 2025-03-14T06:52:21.6484891Z Testing //test/cpp:test_aten_xla_tensor_6; 61s local 2025-03-14T06:52:21.6485702Z Testing //test/cpp:test_aten_xla_tensor_4; 58s local 2025-03-14T06:52:21.6486516Z Testing //test/cpp:test_aten_xla_tensor_2; 33s local 2025-03-14T06:52:21.6487333Z Testing //test/cpp:test_aten_xla_tensor_1; 14s local 2025-03-14T06:52:22.6483078Z 2025-03-14T06:52:22.6483990Z  2025-03-14T06:52:22.6484489Z  2025-03-14T06:52:22.6485013Z  2025-03-14T06:52:22.6485439Z  2025-03-14T06:52:22.6485873Z  2025-03-14T06:52:22.6486321Z  2025-03-14T06:52:22.6486754Z  2025-03-14T06:52:22.6487770Z [20,657 / 20,664] 10 / 17 tests; 7 actions running; last test: .../cpp:test_ir 2025-03-14T06:52:22.6488750Z Testing //test/cpp:test_tensor; 84s local 2025-03-14T06:52:22.6489498Z Testing //test/cpp:test_aten_xla_tensor_3; 69s local 2025-03-14T06:52:22.6490406Z Testing //test/cpp:test_aten_xla_tensor_5; 67s local 2025-03-14T06:52:22.6491395Z Testing //test/cpp:test_aten_xla_tensor_6; 62s local 2025-03-14T06:52:22.6492213Z Testing //test/cpp:test_aten_xla_tensor_4; 59s local 2025-03-14T06:52:22.6493100Z Testing //test/cpp:test_aten_xla_tensor_2; 34s local 2025-03-14T06:52:22.6493916Z Testing //test/cpp:test_aten_xla_tensor_1; 15s local 2025-03-14T06:52:23.0486503Z 2025-03-14T06:52:23.0487362Z  2025-03-14T06:52:23.0487833Z  2025-03-14T06:52:23.0488256Z  2025-03-14T06:52:23.0488657Z  2025-03-14T06:52:23.0489070Z  2025-03-14T06:52:23.0489482Z  2025-03-14T06:52:23.0489884Z  2025-03-14T06:52:23.0490837Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:23.0491972Z Testing //test/cpp:test_tensor; 84s local 2025-03-14T06:52:23.0492887Z Testing //test/cpp:test_aten_xla_tensor_5; 68s local 2025-03-14T06:52:23.0493704Z Testing //test/cpp:test_aten_xla_tensor_6; 63s local 2025-03-14T06:52:23.0494992Z Testing //test/cpp:test_aten_xla_tensor_4; 59s local 2025-03-14T06:52:23.0495956Z Testing //test/cpp:test_aten_xla_tensor_2; 34s local 2025-03-14T06:52:23.0496986Z Testing //test/cpp:test_aten_xla_tensor_1; 15s local 2025-03-14T06:52:24.0492520Z 2025-03-14T06:52:24.0493597Z  2025-03-14T06:52:24.0494158Z  2025-03-14T06:52:24.0494653Z  2025-03-14T06:52:24.0495110Z  2025-03-14T06:52:24.0495718Z  2025-03-14T06:52:24.0496173Z  2025-03-14T06:52:24.0497206Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:24.0498271Z Testing //test/cpp:test_tensor; 85s local 2025-03-14T06:52:24.0499067Z Testing //test/cpp:test_aten_xla_tensor_5; 69s local 2025-03-14T06:52:24.0499914Z Testing //test/cpp:test_aten_xla_tensor_6; 64s local 2025-03-14T06:52:24.0500857Z Testing //test/cpp:test_aten_xla_tensor_4; 60s local 2025-03-14T06:52:24.0501661Z Testing //test/cpp:test_aten_xla_tensor_2; 35s local 2025-03-14T06:52:24.0502412Z Testing //test/cpp:test_aten_xla_tensor_1; 16s local 2025-03-14T06:52:25.0498571Z 2025-03-14T06:52:25.0499393Z  2025-03-14T06:52:25.0499866Z  2025-03-14T06:52:25.0500272Z  2025-03-14T06:52:25.0500677Z  2025-03-14T06:52:25.0501084Z  2025-03-14T06:52:25.0501480Z  2025-03-14T06:52:25.0502638Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:25.0503572Z Testing //test/cpp:test_tensor; 86s local 2025-03-14T06:52:25.0504350Z Testing //test/cpp:test_aten_xla_tensor_5; 70s local 2025-03-14T06:52:25.0505101Z Testing //test/cpp:test_aten_xla_tensor_6; 65s local 2025-03-14T06:52:25.0505946Z Testing //test/cpp:test_aten_xla_tensor_4; 61s local 2025-03-14T06:52:25.0507239Z Testing //test/cpp:test_aten_xla_tensor_2; 36s local 2025-03-14T06:52:25.0508223Z Testing //test/cpp:test_aten_xla_tensor_1; 17s local 2025-03-14T06:52:26.2505359Z 2025-03-14T06:52:26.2506266Z  2025-03-14T06:52:26.2506938Z  2025-03-14T06:52:26.2507352Z  2025-03-14T06:52:26.2507769Z  2025-03-14T06:52:26.2508178Z  2025-03-14T06:52:26.2508589Z  2025-03-14T06:52:26.2521267Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:26.2522298Z Testing //test/cpp:test_tensor; 88s local 2025-03-14T06:52:26.2523038Z Testing //test/cpp:test_aten_xla_tensor_5; 71s local 2025-03-14T06:52:26.2523825Z Testing //test/cpp:test_aten_xla_tensor_6; 66s local 2025-03-14T06:52:26.2524655Z Testing //test/cpp:test_aten_xla_tensor_4; 62s local 2025-03-14T06:52:26.2525461Z Testing //test/cpp:test_aten_xla_tensor_2; 38s local 2025-03-14T06:52:26.2526217Z Testing //test/cpp:test_aten_xla_tensor_1; 19s local 2025-03-14T06:52:27.2511313Z 2025-03-14T06:52:27.2512178Z  2025-03-14T06:52:27.2512776Z  2025-03-14T06:52:27.2513317Z  2025-03-14T06:52:27.2513869Z  2025-03-14T06:52:27.2514400Z  2025-03-14T06:52:27.2514924Z  2025-03-14T06:52:27.2516124Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:27.2517425Z Testing //test/cpp:test_tensor; 89s local 2025-03-14T06:52:27.2518144Z Testing //test/cpp:test_aten_xla_tensor_5; 72s local 2025-03-14T06:52:27.2518897Z Testing //test/cpp:test_aten_xla_tensor_6; 67s local 2025-03-14T06:52:27.2519805Z Testing //test/cpp:test_aten_xla_tensor_4; 63s local 2025-03-14T06:52:27.2520962Z Testing //test/cpp:test_aten_xla_tensor_2; 39s local 2025-03-14T06:52:27.2521985Z Testing //test/cpp:test_aten_xla_tensor_1; 20s local 2025-03-14T06:52:28.4518366Z 2025-03-14T06:52:28.4519370Z  2025-03-14T06:52:28.4519849Z  2025-03-14T06:52:28.4520245Z  2025-03-14T06:52:28.4520627Z  2025-03-14T06:52:28.4521014Z  2025-03-14T06:52:28.4521394Z  2025-03-14T06:52:28.4522580Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:28.4523587Z Testing //test/cpp:test_tensor; 90s local 2025-03-14T06:52:28.4524295Z Testing //test/cpp:test_aten_xla_tensor_5; 73s local 2025-03-14T06:52:28.4525093Z Testing //test/cpp:test_aten_xla_tensor_6; 68s local 2025-03-14T06:52:28.4525841Z Testing //test/cpp:test_aten_xla_tensor_4; 64s local 2025-03-14T06:52:28.4526569Z Testing //test/cpp:test_aten_xla_tensor_2; 40s local 2025-03-14T06:52:28.4527302Z Testing //test/cpp:test_aten_xla_tensor_1; 21s local 2025-03-14T06:52:29.6525716Z 2025-03-14T06:52:29.6526409Z  2025-03-14T06:52:29.6526734Z  2025-03-14T06:52:29.6526990Z  2025-03-14T06:52:29.6527241Z  2025-03-14T06:52:29.6527497Z  2025-03-14T06:52:29.6527743Z  2025-03-14T06:52:29.6528326Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:29.6528915Z Testing //test/cpp:test_tensor; 91s local 2025-03-14T06:52:29.6529356Z Testing //test/cpp:test_aten_xla_tensor_5; 74s local 2025-03-14T06:52:29.6529819Z Testing //test/cpp:test_aten_xla_tensor_6; 69s local 2025-03-14T06:52:29.6530271Z Testing //test/cpp:test_aten_xla_tensor_4; 66s local 2025-03-14T06:52:29.6530720Z Testing //test/cpp:test_aten_xla_tensor_2; 41s local 2025-03-14T06:52:29.6531388Z Testing //test/cpp:test_aten_xla_tensor_1; 22s local 2025-03-14T06:52:30.6531835Z 2025-03-14T06:52:30.6532554Z  2025-03-14T06:52:30.6533277Z  2025-03-14T06:52:30.6533809Z  2025-03-14T06:52:30.6534267Z  2025-03-14T06:52:30.6534706Z  2025-03-14T06:52:30.6535148Z  2025-03-14T06:52:30.6536198Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:30.6537273Z Testing //test/cpp:test_tensor; 92s local 2025-03-14T06:52:30.6538083Z Testing //test/cpp:test_aten_xla_tensor_5; 75s local 2025-03-14T06:52:30.6538953Z Testing //test/cpp:test_aten_xla_tensor_6; 70s local 2025-03-14T06:52:30.6539818Z Testing //test/cpp:test_aten_xla_tensor_4; 67s local 2025-03-14T06:52:30.6540749Z Testing //test/cpp:test_aten_xla_tensor_2; 42s local 2025-03-14T06:52:30.6541617Z Testing //test/cpp:test_aten_xla_tensor_1; 23s local 2025-03-14T06:52:31.8542496Z 2025-03-14T06:52:31.8543593Z  2025-03-14T06:52:31.8544229Z  2025-03-14T06:52:31.8544784Z  2025-03-14T06:52:31.8545335Z  2025-03-14T06:52:31.8545877Z  2025-03-14T06:52:31.8546455Z  2025-03-14T06:52:31.8547697Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:31.8548988Z Testing //test/cpp:test_tensor; 93s local 2025-03-14T06:52:31.8549954Z Testing //test/cpp:test_aten_xla_tensor_5; 77s local 2025-03-14T06:52:31.8550991Z Testing //test/cpp:test_aten_xla_tensor_6; 72s local 2025-03-14T06:52:31.8552036Z Testing //test/cpp:test_aten_xla_tensor_4; 68s local 2025-03-14T06:52:31.8553070Z Testing //test/cpp:test_aten_xla_tensor_2; 43s local 2025-03-14T06:52:31.8554099Z Testing //test/cpp:test_aten_xla_tensor_1; 24s local 2025-03-14T06:52:33.0547472Z 2025-03-14T06:52:33.0548244Z  2025-03-14T06:52:33.0548694Z  2025-03-14T06:52:33.0549130Z  2025-03-14T06:52:33.0549535Z  2025-03-14T06:52:33.0549934Z  2025-03-14T06:52:33.0550333Z  2025-03-14T06:52:33.0551261Z [20,658 / 20,664] 11 / 17 tests; 6 actions running; last test: ...xla_tensor_3 2025-03-14T06:52:33.0552229Z Testing //test/cpp:test_tensor; 94s local 2025-03-14T06:52:33.0552947Z Testing //test/cpp:test_aten_xla_tensor_5; 78s local 2025-03-14T06:52:33.0553719Z Testing //test/cpp:test_aten_xla_tensor_6; 73s local 2025-03-14T06:52:33.0554488Z Testing //test/cpp:test_aten_xla_tensor_4; 69s local 2025-03-14T06:52:33.0555466Z Testing //test/cpp:test_aten_xla_tensor_2; 44s local 2025-03-14T06:52:33.0556228Z Testing //test/cpp:test_aten_xla_tensor_1; 25s local 2025-03-14T06:52:33.8740772Z 2025-03-14T06:52:33.8741535Z  2025-03-14T06:52:33.8741973Z  2025-03-14T06:52:33.8742371Z  2025-03-14T06:52:33.8742801Z  2025-03-14T06:52:33.8743182Z  2025-03-14T06:52:33.8743574Z  2025-03-14T06:52:33.8744464Z [20,658 / 20,664] 12 / 17 tests; 6 actions running; last test: ...xla_tensor_5 2025-03-14T06:52:33.8745371Z Testing //test/cpp:test_tensor; 95s local 2025-03-14T06:52:33.8746064Z Testing //test/cpp:test_aten_xla_tensor_5; 79s local 2025-03-14T06:52:33.8746803Z Testing //test/cpp:test_aten_xla_tensor_6; 74s local 2025-03-14T06:52:33.8747533Z Testing //test/cpp:test_aten_xla_tensor_4; 70s local 2025-03-14T06:52:33.8748248Z Testing //test/cpp:test_aten_xla_tensor_2; 45s local 2025-03-14T06:52:33.8748970Z Testing //test/cpp:test_aten_xla_tensor_1; 26s local 2025-03-14T06:52:34.2553604Z 2025-03-14T06:52:34.2554405Z  2025-03-14T06:52:34.2554847Z  2025-03-14T06:52:34.2555233Z  2025-03-14T06:52:34.2555634Z  2025-03-14T06:52:34.2556024Z  2025-03-14T06:52:34.2556387Z  2025-03-14T06:52:34.2557257Z [20,659 / 20,664] 12 / 17 tests; 5 actions running; last test: ...xla_tensor_5 2025-03-14T06:52:34.2558376Z Testing //test/cpp:test_tensor; 96s local 2025-03-14T06:52:34.2559126Z Testing //test/cpp:test_aten_xla_tensor_6; 74s local 2025-03-14T06:52:34.2559854Z Testing //test/cpp:test_aten_xla_tensor_4; 70s local 2025-03-14T06:52:34.2560841Z Testing //test/cpp:test_aten_xla_tensor_2; 46s local 2025-03-14T06:52:34.2561571Z Testing //test/cpp:test_aten_xla_tensor_1; 27s local 2025-03-14T06:52:35.2558925Z 2025-03-14T06:52:35.2559667Z  2025-03-14T06:52:35.2560126Z  2025-03-14T06:52:35.2560521Z  2025-03-14T06:52:35.2560910Z  2025-03-14T06:52:35.2561318Z  2025-03-14T06:52:35.2562227Z [20,659 / 20,664] 12 / 17 tests; 5 actions running; last test: ...xla_tensor_5 2025-03-14T06:52:35.2563145Z Testing //test/cpp:test_tensor; 97s local 2025-03-14T06:52:35.2563831Z Testing //test/cpp:test_aten_xla_tensor_6; 75s local 2025-03-14T06:52:35.2564609Z Testing //test/cpp:test_aten_xla_tensor_4; 71s local 2025-03-14T06:52:35.2565471Z Testing //test/cpp:test_aten_xla_tensor_2; 47s local 2025-03-14T06:52:35.2566193Z Testing //test/cpp:test_aten_xla_tensor_1; 28s local 2025-03-14T06:52:36.4565946Z 2025-03-14T06:52:36.4566783Z  2025-03-14T06:52:36.4567234Z  2025-03-14T06:52:36.4567621Z  2025-03-14T06:52:36.4568007Z  2025-03-14T06:52:36.4568394Z  2025-03-14T06:52:36.4569282Z [20,659 / 20,664] 12 / 17 tests; 5 actions running; last test: ...xla_tensor_5 2025-03-14T06:52:36.4570195Z Testing //test/cpp:test_tensor; 98s local 2025-03-14T06:52:36.4570896Z Testing //test/cpp:test_aten_xla_tensor_6; 76s local 2025-03-14T06:52:36.4571605Z Testing //test/cpp:test_aten_xla_tensor_4; 72s local 2025-03-14T06:52:36.4572334Z Testing //test/cpp:test_aten_xla_tensor_2; 48s local 2025-03-14T06:52:37.4572080Z Testing //test/cpp:test_aten_xla_tensor_1; 29s local 2025-03-14T06:52:37.4572695Z 2025-03-14T06:52:37.4573109Z  2025-03-14T06:52:37.4573549Z  2025-03-14T06:52:37.4573962Z  2025-03-14T06:52:37.4574365Z  2025-03-14T06:52:37.4574770Z  2025-03-14T06:52:37.4575679Z [20,659 / 20,664] 12 / 17 tests; 5 actions running; last test: ...xla_tensor_5 2025-03-14T06:52:37.4576652Z Testing //test/cpp:test_tensor; 99s local 2025-03-14T06:52:37.4577364Z Testing //test/cpp:test_aten_xla_tensor_6; 77s local 2025-03-14T06:52:37.4578136Z Testing //test/cpp:test_aten_xla_tensor_4; 73s local 2025-03-14T06:52:37.4578904Z Testing //test/cpp:test_aten_xla_tensor_2; 49s local 2025-03-14T06:52:37.4579886Z Testing //test/cpp:test_aten_xla_tensor_1; 30s local 2025-03-14T06:52:38.6578034Z 2025-03-14T06:52:38.6578860Z  2025-03-14T06:52:38.6579621Z  2025-03-14T06:52:38.6580531Z  2025-03-14T06:52:38.6581117Z  2025-03-14T06:52:38.6581641Z  2025-03-14T06:52:38.6582828Z [20,659 / 20,664] 12 / 17 tests; 5 actions running; last test: ...xla_tensor_5 2025-03-14T06:52:38.6584049Z Testing //test/cpp:test_tensor; 100s local 2025-03-14T06:52:38.6584947Z Testing //test/cpp:test_aten_xla_tensor_6; 79s local 2025-03-14T06:52:38.6585918Z Testing //test/cpp:test_aten_xla_tensor_4; 75s local 2025-03-14T06:52:38.6586869Z Testing //test/cpp:test_aten_xla_tensor_2; 50s local 2025-03-14T06:52:38.6587852Z Testing //test/cpp:test_aten_xla_tensor_1; 31s local 2025-03-14T06:52:39.0581207Z 2025-03-14T06:52:39.0582049Z  2025-03-14T06:52:39.0582524Z  2025-03-14T06:52:39.0582948Z  2025-03-14T06:52:39.0583392Z  2025-03-14T06:52:39.0583806Z  2025-03-14T06:52:39.0584785Z [20,660 / 20,664] 13 / 17 tests; 4 actions running; last test: ...xla_tensor_4 2025-03-14T06:52:39.0585735Z Testing //test/cpp:test_tensor; 100s local 2025-03-14T06:52:39.0586454Z Testing //test/cpp:test_aten_xla_tensor_6; 79s local 2025-03-14T06:52:39.0587414Z Testing //test/cpp:test_aten_xla_tensor_2; 50s local 2025-03-14T06:52:39.0588175Z Testing //test/cpp:test_aten_xla_tensor_1; 31s local 2025-03-14T06:52:40.2589112Z 2025-03-14T06:52:40.2589968Z  2025-03-14T06:52:40.2590738Z  2025-03-14T06:52:40.2591161Z  2025-03-14T06:52:40.2591566Z  2025-03-14T06:52:40.2592525Z [20,660 / 20,664] 13 / 17 tests; 4 actions running; last test: ...xla_tensor_4 2025-03-14T06:52:40.2593517Z Testing //test/cpp:test_tensor; 102s local 2025-03-14T06:52:40.2594260Z Testing //test/cpp:test_aten_xla_tensor_6; 80s local 2025-03-14T06:52:40.2595058Z Testing //test/cpp:test_aten_xla_tensor_2; 52s local 2025-03-14T06:52:40.2595851Z Testing //test/cpp:test_aten_xla_tensor_1; 33s local 2025-03-14T06:52:41.4595157Z 2025-03-14T06:52:41.4595953Z  2025-03-14T06:52:41.4596424Z  2025-03-14T06:52:41.4596829Z  2025-03-14T06:52:41.4597241Z  2025-03-14T06:52:41.4598162Z [20,660 / 20,664] 13 / 17 tests; 4 actions running; last test: ...xla_tensor_4 2025-03-14T06:52:41.4599242Z Testing //test/cpp:test_tensor; 103s local 2025-03-14T06:52:41.4599980Z Testing //test/cpp:test_aten_xla_tensor_6; 81s local 2025-03-14T06:52:41.4600766Z Testing //test/cpp:test_aten_xla_tensor_2; 53s local 2025-03-14T06:52:41.4601545Z Testing //test/cpp:test_aten_xla_tensor_1; 34s local 2025-03-14T06:52:42.4600299Z 2025-03-14T06:52:42.4601220Z  2025-03-14T06:52:42.4601796Z  2025-03-14T06:52:42.4602302Z  2025-03-14T06:52:42.4602901Z  2025-03-14T06:52:42.4604005Z [20,660 / 20,664] 13 / 17 tests; 4 actions running; last test: ...xla_tensor_4 2025-03-14T06:52:42.4605199Z Testing //test/cpp:test_tensor; 104s local 2025-03-14T06:52:42.4606034Z Testing //test/cpp:test_aten_xla_tensor_6; 82s local 2025-03-14T06:52:42.4606919Z Testing //test/cpp:test_aten_xla_tensor_2; 54s local 2025-03-14T06:52:42.4607795Z Testing //test/cpp:test_aten_xla_tensor_1; 35s local 2025-03-14T06:52:43.6608175Z 2025-03-14T06:52:43.6608863Z  2025-03-14T06:52:43.6609333Z  2025-03-14T06:52:43.6609756Z  2025-03-14T06:52:43.6610174Z  2025-03-14T06:52:43.6611115Z [20,660 / 20,664] 13 / 17 tests; 4 actions running; last test: ...xla_tensor_4 2025-03-14T06:52:43.6612070Z Testing //test/cpp:test_tensor; 105s local 2025-03-14T06:52:43.6612790Z Testing //test/cpp:test_aten_xla_tensor_6; 84s local 2025-03-14T06:52:43.6613689Z Testing //test/cpp:test_aten_xla_tensor_2; 55s local 2025-03-14T06:52:43.6614672Z Testing //test/cpp:test_aten_xla_tensor_1; 36s local 2025-03-14T06:52:43.9381454Z 2025-03-14T06:52:43.9382434Z  2025-03-14T06:52:43.9382891Z  2025-03-14T06:52:43.9383612Z  2025-03-14T06:52:43.9384043Z  2025-03-14T06:52:43.9385019Z [20,660 / 20,664] 14 / 17 tests; 4 actions running; last test: ...:test_tensor 2025-03-14T06:52:43.9386049Z Testing //test/cpp:test_tensor; 105s local 2025-03-14T06:52:43.9386798Z Testing //test/cpp:test_aten_xla_tensor_6; 84s local 2025-03-14T06:52:43.9387593Z Testing //test/cpp:test_aten_xla_tensor_2; 55s local 2025-03-14T06:52:43.9388390Z Testing //test/cpp:test_aten_xla_tensor_1; 36s local 2025-03-14T06:52:44.2611733Z 2025-03-14T06:52:44.2612946Z  2025-03-14T06:52:44.2613759Z  2025-03-14T06:52:44.2614455Z  2025-03-14T06:52:44.2615199Z  2025-03-14T06:52:44.2616437Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:44.2617813Z Testing //test/cpp:test_aten_xla_tensor_6; 84s local 2025-03-14T06:52:44.2618863Z Testing //test/cpp:test_aten_xla_tensor_2; 56s local 2025-03-14T06:52:44.2619871Z Testing //test/cpp:test_aten_xla_tensor_1; 37s local 2025-03-14T06:52:45.4618738Z 2025-03-14T06:52:45.4619951Z  2025-03-14T06:52:45.4620636Z  2025-03-14T06:52:45.4621685Z  2025-03-14T06:52:45.4623011Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:45.4624452Z Testing //test/cpp:test_aten_xla_tensor_6; 85s local 2025-03-14T06:52:45.4625823Z Testing //test/cpp:test_aten_xla_tensor_2; 57s local 2025-03-14T06:52:45.4627090Z Testing //test/cpp:test_aten_xla_tensor_1; 38s local 2025-03-14T06:52:46.6624027Z 2025-03-14T06:52:46.6625190Z  2025-03-14T06:52:46.6625844Z  2025-03-14T06:52:46.6626537Z  2025-03-14T06:52:46.6627868Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:46.6629284Z Testing //test/cpp:test_aten_xla_tensor_6; 87s local 2025-03-14T06:52:46.6630389Z Testing //test/cpp:test_aten_xla_tensor_2; 58s local 2025-03-14T06:52:46.6631448Z Testing //test/cpp:test_aten_xla_tensor_1; 39s local 2025-03-14T06:52:47.6628994Z 2025-03-14T06:52:47.6630082Z  2025-03-14T06:52:47.6630545Z  2025-03-14T06:52:47.6630939Z  2025-03-14T06:52:47.6631840Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:47.6632836Z Testing //test/cpp:test_aten_xla_tensor_6; 88s local 2025-03-14T06:52:47.6633580Z Testing //test/cpp:test_aten_xla_tensor_2; 59s local 2025-03-14T06:52:47.6634305Z Testing //test/cpp:test_aten_xla_tensor_1; 40s local 2025-03-14T06:52:48.8636001Z 2025-03-14T06:52:48.8637713Z  2025-03-14T06:52:48.8638381Z  2025-03-14T06:52:48.8638949Z  2025-03-14T06:52:48.8640250Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:48.8641775Z Testing //test/cpp:test_aten_xla_tensor_6; 89s local 2025-03-14T06:52:48.8642916Z Testing //test/cpp:test_aten_xla_tensor_2; 60s local 2025-03-14T06:52:48.8643960Z Testing //test/cpp:test_aten_xla_tensor_1; 41s local 2025-03-14T06:52:49.8641512Z 2025-03-14T06:52:49.8642798Z  2025-03-14T06:52:49.8643292Z  2025-03-14T06:52:49.8643696Z  2025-03-14T06:52:49.8644809Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:49.8645838Z Testing //test/cpp:test_aten_xla_tensor_6; 90s local 2025-03-14T06:52:49.8646609Z Testing //test/cpp:test_aten_xla_tensor_2; 61s local 2025-03-14T06:52:49.8647356Z Testing //test/cpp:test_aten_xla_tensor_1; 42s local 2025-03-14T06:52:51.0647418Z 2025-03-14T06:52:51.0648055Z  2025-03-14T06:52:51.0648348Z  2025-03-14T06:52:51.0648588Z  2025-03-14T06:52:51.0649390Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:51.0649967Z Testing //test/cpp:test_aten_xla_tensor_6; 91s local 2025-03-14T06:52:51.0650408Z Testing //test/cpp:test_aten_xla_tensor_2; 62s local 2025-03-14T06:52:51.0650848Z Testing //test/cpp:test_aten_xla_tensor_1; 43s local 2025-03-14T06:52:52.2655191Z 2025-03-14T06:52:52.2656568Z  2025-03-14T06:52:52.2657138Z  2025-03-14T06:52:52.2657621Z  2025-03-14T06:52:52.2658780Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:52.2659972Z Testing //test/cpp:test_aten_xla_tensor_6; 92s local 2025-03-14T06:52:52.2660890Z Testing //test/cpp:test_aten_xla_tensor_2; 64s local 2025-03-14T06:52:52.2661804Z Testing //test/cpp:test_aten_xla_tensor_1; 45s local 2025-03-14T06:52:53.2738604Z 2025-03-14T06:52:53.2739366Z  2025-03-14T06:52:53.2739856Z  2025-03-14T06:52:53.2740249Z  2025-03-14T06:52:53.2741162Z [20,661 / 20,664] 14 / 17 tests; 3 actions running; last test: ...:test_tensor 2025-03-14T06:52:53.2742131Z Testing //test/cpp:test_aten_xla_tensor_6; 93s local 2025-03-14T06:52:53.2742858Z Testing //test/cpp:test_aten_xla_tensor_2; 65s local 2025-03-14T06:52:53.2743806Z Testing //test/cpp:test_aten_xla_tensor_1; 46s local 2025-03-14T06:52:53.9715619Z 2025-03-14T06:52:53.9716411Z  2025-03-14T06:52:53.9716872Z  2025-03-14T06:52:53.9717492Z  2025-03-14T06:52:53.9718404Z [20,661 / 20,664] 15 / 17 tests; 3 actions running; last test: ...xla_tensor_2 2025-03-14T06:52:53.9719385Z Testing //test/cpp:test_aten_xla_tensor_6; 94s local 2025-03-14T06:52:53.9720137Z Testing //test/cpp:test_aten_xla_tensor_2; 65s local 2025-03-14T06:52:53.9720873Z Testing //test/cpp:test_aten_xla_tensor_1; 46s local 2025-03-14T06:52:54.2745309Z 2025-03-14T06:52:54.2746188Z  2025-03-14T06:52:54.2746700Z  2025-03-14T06:52:54.2747119Z  2025-03-14T06:52:54.2748088Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:52:54.2749114Z Testing //test/cpp:test_aten_xla_tensor_6; 94s local 2025-03-14T06:52:54.2749907Z Testing //test/cpp:test_aten_xla_tensor_1; 47s local 2025-03-14T06:52:55.2750725Z 2025-03-14T06:52:55.2751346Z  2025-03-14T06:52:55.2751648Z  2025-03-14T06:52:55.2752207Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:52:55.2752806Z Testing //test/cpp:test_aten_xla_tensor_6; 95s local 2025-03-14T06:52:55.2753243Z Testing //test/cpp:test_aten_xla_tensor_1; 48s local 2025-03-14T06:52:56.2756474Z 2025-03-14T06:52:56.2757141Z  2025-03-14T06:52:56.2757457Z  2025-03-14T06:52:56.2758094Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:52:56.2758739Z Testing //test/cpp:test_aten_xla_tensor_6; 96s local 2025-03-14T06:52:56.2759230Z Testing //test/cpp:test_aten_xla_tensor_1; 49s local 2025-03-14T06:52:57.4763576Z 2025-03-14T06:52:57.4764312Z  2025-03-14T06:52:57.4764827Z  2025-03-14T06:52:57.4765887Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:52:57.4766859Z Testing //test/cpp:test_aten_xla_tensor_6; 97s local 2025-03-14T06:52:57.4767607Z Testing //test/cpp:test_aten_xla_tensor_1; 50s local 2025-03-14T06:52:58.4769354Z 2025-03-14T06:52:58.4770570Z  2025-03-14T06:52:58.4771057Z  2025-03-14T06:52:58.4771988Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:52:58.4772992Z Testing //test/cpp:test_aten_xla_tensor_6; 98s local 2025-03-14T06:52:58.4774006Z Testing //test/cpp:test_aten_xla_tensor_1; 51s local 2025-03-14T06:52:59.4861942Z 2025-03-14T06:52:59.4862650Z  2025-03-14T06:52:59.4863383Z  2025-03-14T06:52:59.4864328Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:52:59.4865441Z Testing //test/cpp:test_aten_xla_tensor_6; 99s local 2025-03-14T06:52:59.4866209Z Testing //test/cpp:test_aten_xla_tensor_1; 52s local 2025-03-14T06:53:00.4865999Z 2025-03-14T06:53:00.4867078Z  2025-03-14T06:53:00.4867541Z  2025-03-14T06:53:00.4868465Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:53:00.4869441Z Testing //test/cpp:test_aten_xla_tensor_6; 100s local 2025-03-14T06:53:00.4870193Z Testing //test/cpp:test_aten_xla_tensor_1; 53s local 2025-03-14T06:53:01.6876714Z 2025-03-14T06:53:01.6877448Z  2025-03-14T06:53:01.6877930Z  2025-03-14T06:53:01.6878890Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:53:01.6879913Z Testing //test/cpp:test_aten_xla_tensor_6; 102s local 2025-03-14T06:53:01.6880705Z Testing //test/cpp:test_aten_xla_tensor_1; 54s local 2025-03-14T06:53:02.8882493Z 2025-03-14T06:53:02.8883301Z  2025-03-14T06:53:02.8884011Z  2025-03-14T06:53:02.8884909Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:53:02.8885692Z Testing //test/cpp:test_aten_xla_tensor_6; 103s local 2025-03-14T06:53:02.8886447Z Testing //test/cpp:test_aten_xla_tensor_1; 55s local 2025-03-14T06:53:03.8887424Z 2025-03-14T06:53:03.8888207Z  2025-03-14T06:53:03.8888663Z  2025-03-14T06:53:03.8889564Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:53:03.8890539Z Testing //test/cpp:test_aten_xla_tensor_6; 104s local 2025-03-14T06:53:03.8891310Z Testing //test/cpp:test_aten_xla_tensor_1; 56s local 2025-03-14T06:53:05.0892962Z 2025-03-14T06:53:05.0893765Z  2025-03-14T06:53:05.0894232Z  2025-03-14T06:53:05.0895121Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:53:05.0896103Z Testing //test/cpp:test_aten_xla_tensor_6; 105s local 2025-03-14T06:53:05.0896848Z Testing //test/cpp:test_aten_xla_tensor_1; 57s local 2025-03-14T06:53:05.3517593Z 2025-03-14T06:53:05.3518158Z  2025-03-14T06:53:05.3518608Z  2025-03-14T06:53:05.3519479Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:53:05.3520459Z Testing //test/cpp:test_aten_xla_tensor_6; 105s local 2025-03-14T06:53:05.3521201Z Testing //test/cpp:test_aten_xla_tensor_1; 58s local 2025-03-14T06:53:06.4900055Z 2025-03-14T06:53:06.4900761Z  2025-03-14T06:53:06.4901221Z  2025-03-14T06:53:06.4902151Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:53:06.4903136Z Testing //test/cpp:test_aten_xla_tensor_6; 106s local 2025-03-14T06:53:06.4903887Z Testing //test/cpp:test_aten_xla_tensor_1; 59s local 2025-03-14T06:53:07.4907659Z 2025-03-14T06:53:07.4908288Z  2025-03-14T06:53:07.4908654Z  2025-03-14T06:53:07.4909230Z [20,662 / 20,664] 15 / 17 tests; 2 actions running; last test: ...xla_tensor_2 2025-03-14T06:53:07.4909850Z Testing //test/cpp:test_aten_xla_tensor_6; 107s local 2025-03-14T06:53:07.4910306Z Testing //test/cpp:test_aten_xla_tensor_1; 60s local 2025-03-14T06:53:08.1033548Z 2025-03-14T06:53:08.1034130Z  2025-03-14T06:53:08.1034469Z  2025-03-14T06:53:08.1035071Z [20,662 / 20,664] 16 / 17 tests; 2 actions running; last test: ...xla_tensor_1 2025-03-14T06:53:08.1035850Z Testing //test/cpp:test_aten_xla_tensor_6; 108s local 2025-03-14T06:53:08.1036319Z Testing //test/cpp:test_aten_xla_tensor_1; 60s local 2025-03-14T06:53:08.4918017Z 2025-03-14T06:53:08.4918561Z  2025-03-14T06:53:08.4918837Z  2025-03-14T06:53:08.4919390Z [20,663 / 20,664] 16 / 17 tests; 1 action; last test: ...st_aten_xla_tensor_1 2025-03-14T06:53:08.4919976Z Testing //test/cpp:test_aten_xla_tensor_6; 108s local 2025-03-14T06:53:09.4926315Z 2025-03-14T06:53:09.4926914Z  2025-03-14T06:53:09.4927575Z [20,663 / 20,664] 16 / 17 tests; 1 action; last test: ...st_aten_xla_tensor_1 2025-03-14T06:53:09.4928187Z Testing //test/cpp:test_aten_xla_tensor_6; 109s local 2025-03-14T06:53:10.0342402Z 2025-03-14T06:53:10.0343309Z  2025-03-14T06:53:10.0344076Z [20,663 / 20,664] 17 / 17 tests; 1 action; last test: ...st_aten_xla_tensor_6 2025-03-14T06:53:10.0344679Z Testing //test/cpp:test_aten_xla_tensor_6; 110s local 2025-03-14T06:53:10.1276840Z 2025-03-14T06:53:10.1277579Z  2025-03-14T06:53:10.1278094Z INFO: Elapsed time: 1746.084s, Critical Path: 327.70s 2025-03-14T06:53:10.1278802Z [20,664 / 20,664] 17 / 17 tests; checking cached actions; last test: ...nsor_6 2025-03-14T06:53:10.1279361Z 2025-03-14T06:53:10.1279635Z INFO: 20664 processes: 9314 internal, 11350 local. 2025-03-14T06:53:10.1280300Z [20,664 / 20,664] 17 / 17 tests; checking cached actions; last test: ...nsor_6 2025-03-14T06:53:10.1280752Z 2025-03-14T06:53:10.1281041Z INFO: Build completed successfully, 20664 total actions 2025-03-14T06:53:10.1406947Z //test/cpp:test_aten_xla_tensor_1 PASSED in 60.9s 2025-03-14T06:53:10.1407787Z //test/cpp:test_aten_xla_tensor_2 PASSED in 65.8s 2025-03-14T06:53:10.1408563Z //test/cpp:test_aten_xla_tensor_3 PASSED in 69.5s 2025-03-14T06:53:10.1409359Z //test/cpp:test_aten_xla_tensor_4 PASSED in 75.2s 2025-03-14T06:53:10.1410127Z //test/cpp:test_aten_xla_tensor_5 PASSED in 79.1s 2025-03-14T06:53:10.1410949Z //test/cpp:test_aten_xla_tensor_6 PASSED in 110.4s 2025-03-14T06:53:10.1411692Z //test/cpp:test_ir PASSED in 2.0s 2025-03-14T06:53:10.1412396Z //test/cpp:test_lazy PASSED in 0.5s 2025-03-14T06:53:10.1413506Z //test/cpp:test_replication PASSED in 1.2s 2025-03-14T06:53:10.1414479Z //test/cpp:test_tensor PASSED in 105.7s 2025-03-14T06:53:10.1415569Z //test/cpp:test_xla_sharding PASSED in 0.6s 2025-03-14T06:53:10.1416397Z //torch_xla/csrc/runtime:cache_test PASSED in 0.7s 2025-03-14T06:53:10.1417223Z //torch_xla/csrc/runtime:env_hash_test PASSED in 0.8s 2025-03-14T06:53:10.1418192Z //torch_xla/csrc/runtime:pjrt_computation_client_test PASSED in 0.9s 2025-03-14T06:53:10.1419096Z //torch_xla/csrc/runtime:sys_util_test PASSED in 0.0s 2025-03-14T06:53:10.1420008Z //torch_xla/csrc/runtime:util_test PASSED in 0.1s 2025-03-14T06:53:10.1421002Z //torch_xla/csrc/runtime:xla_util_test PASSED in 0.7s 2025-03-14T06:53:10.1422572Z 2025-03-14T06:53:10.1422712Z Executed 17 out of 17 tests: 17 tests pass. 2025-03-14T06:53:10.1423637Z There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. 2025-03-14T06:53:10.1465952Z + popd 2025-03-14T06:53:10.1466315Z /var/lib/jenkins/workspace 2025-03-14T06:53:10.1466715Z + run_torch_xla_benchmark_tests /var/lib/jenkins/workspace/xla 2025-03-14T06:53:10.1467165Z + XLA_DIR=/var/lib/jenkins/workspace/xla 2025-03-14T06:53:10.1467524Z + pushd /var/lib/jenkins/workspace/xla 2025-03-14T06:53:10.1467952Z /var/lib/jenkins/workspace/xla /var/lib/jenkins/workspace 2025-03-14T06:53:10.1468383Z + echo 'Running Benchmark Tests' 2025-03-14T06:53:10.1468702Z Running Benchmark Tests 2025-03-14T06:53:10.1469004Z + test/benchmarks/run_tests.sh -L 2025-03-14T06:53:10.1483561Z /bin/bash: /opt/conda/lib/libtinfo.so.6: no version information available (required by /bin/bash) 2025-03-14T06:53:10.1494048Z +++ dirname test/benchmarks/run_tests.sh 2025-03-14T06:53:10.1503136Z ++ cd test/benchmarks 2025-03-14T06:53:10.1503426Z ++ pwd -P 2025-03-14T06:53:10.1504875Z + CDIR=/var/lib/jenkins/workspace/xla/test/benchmarks 2025-03-14T06:53:10.1505300Z + LOGFILE=/tmp/pytorch_benchmarks_test.log 2025-03-14T06:53:10.1505638Z + VERBOSITY=0 2025-03-14T06:53:10.1506091Z + export PYTHONPATH=:/var/lib/jenkins/workspace/xla/test/benchmarks/../../benchmarks/ 2025-03-14T06:53:10.1506937Z + PYTHONPATH=:/var/lib/jenkins/workspace/xla/test/benchmarks/../../benchmarks/ 2025-03-14T06:53:10.1507438Z + CONTINUE_ON_ERROR=0 2025-03-14T06:53:10.1507706Z + [[ 0 == \1 ]] 2025-03-14T06:53:10.1507938Z + getopts LV: OPTION 2025-03-14T06:53:10.1508261Z + case $OPTION in 2025-03-14T06:53:10.1508510Z + LOGFILE= 2025-03-14T06:53:10.1508744Z + getopts LV: OPTION 2025-03-14T06:53:10.1508997Z + shift 1 2025-03-14T06:53:10.1509219Z + '[' '' '!=' '' ']' 2025-03-14T06:53:10.1509466Z + run_tests 2025-03-14T06:53:10.1509695Z + run_make_tests 2025-03-14T06:53:10.1509935Z + MAKE_V= 2025-03-14T06:53:10.1510155Z + '[' 0 '!=' 0 ']' 2025-03-14T06:53:10.1510500Z + make -C /var/lib/jenkins/workspace/xla/test/benchmarks all 2025-03-14T06:53:10.1564452Z make: Entering directory '/var/lib/jenkins/workspace/xla/test/benchmarks' 2025-03-14T06:53:10.1949837Z AGGREGATE --accelerator=a6000 --test=inference --report=speedup 2025-03-14T06:53:10.7339664Z DIFF a6000.inference.speedup.test 2025-03-14T06:53:10.7407393Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:10.7430021Z [?1h= 2025-03-14T06:53:10.7430201Z 2025-03-14T06:53:10.7441934Z [?1l> RM a6000.inference.speedup.test.tmp 2025-03-14T06:53:10.7567369Z AGGREGATE --accelerator=a6000 --test=training --report=latest --backends openxla+lazytensor -- 2025-03-14T06:53:11.2369200Z cannot find data for accelerator a6000 2025-03-14T06:53:11.2887672Z DIFF a6000.training.latest.empty.test 2025-03-14T06:53:11.2907863Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:11.2910812Z [?1h= 2025-03-14T06:53:11.2910992Z 2025-03-14T06:53:11.2925051Z [?1l> RM a6000.training.latest.empty.test.tmp 2025-03-14T06:53:11.3063274Z AGGREGATE --accelerator=a6000 --test=training --report=latest 2025-03-14T06:53:11.8374793Z DIFF a6000.training.latest.test 2025-03-14T06:53:11.8396503Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:11.8399764Z [?1h= 2025-03-14T06:53:11.8399900Z 2025-03-14T06:53:11.8410124Z [?1l> RM a6000.training.latest.test.tmp 2025-03-14T06:53:11.8541128Z AGGREGATE --accelerator=v100 --test=inference --report=histogram --backends inductor openxla+lazytensor -- 2025-03-14T06:53:12.3931721Z DIFF v100.inference.histogram.lazytensor.test 2025-03-14T06:53:12.3953541Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:12.3956994Z [?1h= 2025-03-14T06:53:12.3957144Z 2025-03-14T06:53:12.3967276Z [?1l> RM v100.inference.histogram.lazytensor.test.tmp 2025-03-14T06:53:12.4098744Z AGGREGATE --accelerator=v100 --test=inference --report=histogram --backends inductor openxla+lazytensor --format=tab 2025-03-14T06:53:12.9468603Z DIFF v100.inference.histogram.lazytensor_tab.test 2025-03-14T06:53:12.9487194Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:12.9489436Z [?1h= 2025-03-14T06:53:12.9489570Z 2025-03-14T06:53:12.9498789Z [?1l> RM v100.inference.histogram.lazytensor_tab.test.tmp 2025-03-14T06:53:12.9630970Z AGGREGATE --accelerator=v100 --test=inference --report=histogram --format=tab 2025-03-14T06:53:13.5013802Z DIFF v100.inference.histogram.tab.test 2025-03-14T06:53:13.5036176Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:13.5038718Z [?1h= 2025-03-14T06:53:13.5038867Z 2025-03-14T06:53:13.5049905Z [?1l> RM v100.inference.histogram.tab.test.tmp 2025-03-14T06:53:13.5183010Z AGGREGATE --accelerator=v100 --test=inference --report=histogram 2025-03-14T06:53:14.0574052Z DIFF v100.inference.histogram.test 2025-03-14T06:53:14.0596187Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:14.0598123Z [?1h= 2025-03-14T06:53:14.0598277Z 2025-03-14T06:53:14.0609385Z [?1l> RM v100.inference.histogram.test.tmp 2025-03-14T06:53:14.0736856Z AGGREGATE --accelerator=v100 --test=inference --report=latest --backends openxla+dynamo inductor --baseline=latest --filter-by-tier=1 2025-03-14T06:53:14.6096366Z DIFF v100.inference.latest.openxla_baseline.test 2025-03-14T06:53:14.6118571Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:14.6120162Z [?1h= 2025-03-14T06:53:14.6120296Z 2025-03-14T06:53:14.6131571Z [?1l> RM v100.inference.latest.openxla_baseline.test.tmp 2025-03-14T06:53:14.6264011Z AGGREGATE --accelerator=v100 --test=inference --report=latest --backends inductor openxla+dynamo openxla+lazytensor --format=tab 2025-03-14T06:53:15.1582197Z DIFF v100.inference.latest.tab.test 2025-03-14T06:53:15.1601741Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:15.1603542Z [?1h= 2025-03-14T06:53:15.1603692Z 2025-03-14T06:53:15.1615356Z [?1l> RM v100.inference.latest.tab.test.tmp 2025-03-14T06:53:15.1745827Z AGGREGATE --accelerator=v100 --test=inference --report=latest --backends inductor openxla+dynamo openxla+lazytensor -- 2025-03-14T06:53:15.7072745Z DIFF v100.inference.latest.test 2025-03-14T06:53:15.7090834Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:15.7095884Z [?1h= 2025-03-14T06:53:15.7096033Z 2025-03-14T06:53:15.7112993Z [?1l> RM v100.inference.latest.test.tmp 2025-03-14T06:53:15.7243968Z AGGREGATE --accelerator=v100 --test=inference --report=latest --filter-by-tier=1 2025-03-14T06:53:16.2639353Z DIFF v100.inference.latest.tier1.test 2025-03-14T06:53:16.2653669Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:16.2658940Z [?1h= 2025-03-14T06:53:16.2659073Z 2025-03-14T06:53:16.2669925Z [?1l> RM v100.inference.latest.tier1.test.tmp 2025-03-14T06:53:16.2805178Z AGGREGATE --accelerator=v100 --test=inference --report=latest_grouped 2025-03-14T06:53:16.8234041Z DIFF v100.inference.latest_grouped.test 2025-03-14T06:53:16.8248936Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:16.8254168Z [?1h= 2025-03-14T06:53:16.8254304Z 2025-03-14T06:53:16.8263650Z [?1l> RM v100.inference.latest_grouped.test.tmp 2025-03-14T06:53:16.8401435Z AGGREGATE --accelerator=v100 --test=inference --report=speedup --baseline=latest 2025-03-14T06:53:17.3779271Z DIFF v100.inference.speedup.baseline_latest.test 2025-03-14T06:53:17.3800170Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:17.3803023Z [?1h= 2025-03-14T06:53:17.3803172Z 2025-03-14T06:53:17.3817914Z [?1l> RM v100.inference.speedup.baseline_latest.test.tmp 2025-03-14T06:53:17.3943963Z AGGREGATE --accelerator=v100 --test=inference --report=speedup --backends inductor openxla+lazytensor -- 2025-03-14T06:53:17.9300115Z DIFF v100.inference.speedup.lazytensor.test 2025-03-14T06:53:17.9321399Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:17.9323034Z [?1h= 2025-03-14T06:53:17.9323173Z 2025-03-14T06:53:17.9334043Z [?1l> RM v100.inference.speedup.lazytensor.test.tmp 2025-03-14T06:53:17.9470068Z AGGREGATE --accelerator=v100 --test=inference --report=speedup --backends inductor openxla+lazytensor --format=tab 2025-03-14T06:53:18.4847271Z DIFF v100.inference.speedup.lazytensor_tab.test 2025-03-14T06:53:18.4868004Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:18.4875001Z [?1h= 2025-03-14T06:53:18.4875152Z 2025-03-14T06:53:18.4886450Z [?1l> RM v100.inference.speedup.lazytensor_tab.test.tmp 2025-03-14T06:53:18.5013012Z AGGREGATE --accelerator=v100 --test=inference --report=speedup --format=tab 2025-03-14T06:53:19.0368284Z DIFF v100.inference.speedup.tab.test 2025-03-14T06:53:19.0390368Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:19.0392000Z [?1h= 2025-03-14T06:53:19.0392147Z 2025-03-14T06:53:19.0402414Z [?1l> RM v100.inference.speedup.tab.test.tmp 2025-03-14T06:53:19.0528759Z AGGREGATE --accelerator=v100 --test=inference --report=speedup 2025-03-14T06:53:19.5943112Z DIFF v100.inference.speedup.test 2025-03-14T06:53:19.5962545Z /usr/bin/pager: /opt/conda/lib/libtinfo.so.6: no version information available (required by /usr/bin/pager) 2025-03-14T06:53:19.5964414Z [?1h= 2025-03-14T06:53:19.5964680Z 2025-03-14T06:53:19.5978556Z [?1l> RM v100.inference.speedup.test.tmp 2025-03-14T06:53:19.5984607Z make: Leaving directory '/var/lib/jenkins/workspace/xla/test/benchmarks' 2025-03-14T06:53:19.5987437Z + run_python_tests 2025-03-14T06:53:19.5987776Z + pushd /var/lib/jenkins/workspace/xla/test/benchmarks 2025-03-14T06:53:19.5988525Z /var/lib/jenkins/workspace/xla/test/benchmarks /var/lib/jenkins/workspace/xla 2025-03-14T06:53:19.5989061Z + python3 test_experiment_runner.py 2025-03-14T06:53:22.9147186Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2025-03-14T06:53:38.4349340Z .sss.ss 2025-03-14T06:53:38.4349808Z ---------------------------------------------------------------------- 2025-03-14T06:53:38.4350255Z Ran 7 tests in 15.504s 2025-03-14T06:53:38.4350445Z 2025-03-14T06:53:38.4350557Z OK (skipped=5) 2025-03-14T06:53:39.0570396Z + python3 test_benchmark_experiment.py 2025-03-14T06:53:42.2011063Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2025-03-14T06:53:42.2163957Z . 2025-03-14T06:53:42.2164393Z ---------------------------------------------------------------------- 2025-03-14T06:53:42.2164907Z Ran 1 test in 0.013s 2025-03-14T06:53:42.2165109Z 2025-03-14T06:53:42.2165222Z OK 2025-03-14T06:53:42.8998110Z + python3 test_benchmark_model.py 2025-03-14T06:53:46.2212577Z WARNING:root:Defaulting to PJRT_DEVICE=CPU 2025-03-14T06:53:46.2234608Z . 2025-03-14T06:53:46.2234978Z ---------------------------------------------------------------------- 2025-03-14T06:53:46.2235401Z Ran 1 test in 0.000s 2025-03-14T06:53:46.2235571Z 2025-03-14T06:53:46.2235675Z OK 2025-03-14T06:53:46.8518388Z + python3 test_result_analyzer.py 2025-03-14T06:53:47.1443866Z .. 2025-03-14T06:53:47.1444618Z ---------------------------------------------------------------------- 2025-03-14T06:53:47.1445197Z Ran 2 tests in 0.004s 2025-03-14T06:53:47.1445387Z 2025-03-14T06:53:47.1445479Z OK 2025-03-14T06:53:47.1801448Z + popd 2025-03-14T06:53:47.1801780Z /var/lib/jenkins/workspace/xla 2025-03-14T06:53:47.1802162Z + assert_git_not_dirty 2025-03-14T06:53:47.1802512Z + [[ linux-focal-py3.9-clang9-xla != *rocm* ]] 2025-03-14T06:53:47.1802918Z + [[ linux-focal-py3.9-clang9-xla != *xla* ]] 2025-03-14T06:53:47.1803274Z + cleanup_workspace 2025-03-14T06:53:47.1803809Z + echo 'sudo may print the following warning message that can be ignored. The chown command will still run.' 2025-03-14T06:53:47.1804748Z sudo may print the following warning message that can be ignored. The chown command will still run. 2025-03-14T06:53:47.1805405Z + echo ' sudo: setrlimit(RLIMIT_STACK): Operation not permitted' 2025-03-14T06:53:47.1805900Z sudo: setrlimit(RLIMIT_STACK): Operation not permitted 2025-03-14T06:53:47.1806466Z + echo 'For more details refer to https://github.com/sudo-project/sudo/issues/42' 2025-03-14T06:53:47.1807089Z For more details refer to https://github.com/sudo-project/sudo/issues/42 2025-03-14T06:53:47.1807588Z + sudo chown -R 1000 /var/lib/jenkins/workspace 2025-03-14T06:53:50.3529856Z + sccache_epilogue 2025-03-14T06:53:50.3530508Z + echo '::group::Sccache Compilation Log' 2025-03-14T06:53:50.3531292Z ##[group]Sccache Compilation Log 2025-03-14T06:53:50.3531672Z + echo '=================== sccache compilation log ===================' 2025-03-14T06:53:50.3532188Z =================== sccache compilation log =================== 2025-03-14T06:53:50.3532822Z + python /var/lib/jenkins/workspace/.ci/pytorch/print_sccache_log.py /home/jenkins/sccache_error.log 2025-03-14T06:53:50.3713644Z + echo '=========== If your build fails, please take a look at the log above for possible reasons ===========' 2025-03-14T06:53:50.3714412Z =========== If your build fails, please take a look at the log above for possible reasons =========== 2025-03-14T06:53:50.3714937Z + sccache --show-stats 2025-03-14T06:53:50.3742574Z Compile requests 0 2025-03-14T06:53:50.3742999Z Compile requests executed 0 2025-03-14T06:53:50.3743352Z Cache hits 0 2025-03-14T06:53:50.3743681Z Cache misses 0 2025-03-14T06:53:50.3744014Z Cache timeouts 0 2025-03-14T06:53:50.3744345Z Cache read errors 0 2025-03-14T06:53:50.3744662Z Forced recaches 0 2025-03-14T06:53:50.3744997Z Cache write errors 0 2025-03-14T06:53:50.3745333Z Compilation failures 0 2025-03-14T06:53:50.3745666Z Cache errors 0 2025-03-14T06:53:50.3746009Z Non-cacheable compilations 0 2025-03-14T06:53:50.3746352Z Non-cacheable calls 0 2025-03-14T06:53:50.3746690Z Non-compilation calls 0 2025-03-14T06:53:50.3747039Z Unsupported compiler calls 0 2025-03-14T06:53:50.3747385Z Average cache write 0.000 s 2025-03-14T06:53:50.3747738Z Average cache read miss 0.000 s 2025-03-14T06:53:50.3748089Z Average cache read hit 0.000 s 2025-03-14T06:53:50.3748446Z Failed distributed compilations 0 2025-03-14T06:53:50.3749256Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2025-03-14T06:53:50.3750053Z + sccache --stop-server 2025-03-14T06:53:50.3768279Z Stopping sccache server... 2025-03-14T06:53:50.3769573Z Compile requests 0 2025-03-14T06:53:50.3769926Z Compile requests executed 0 2025-03-14T06:53:50.3770265Z Cache hits 0 2025-03-14T06:53:50.3770589Z Cache misses 0 2025-03-14T06:53:50.3770925Z Cache timeouts 0 2025-03-14T06:53:50.3771253Z Cache read errors 0 2025-03-14T06:53:50.3771732Z Forced recaches 0 2025-03-14T06:53:50.3772071Z Cache write errors 0 2025-03-14T06:53:50.3772459Z Compilation failures 0 2025-03-14T06:53:50.3772795Z Cache errors 0 2025-03-14T06:53:50.3773133Z Non-cacheable compilations 0 2025-03-14T06:53:50.3773486Z Non-cacheable calls 0 2025-03-14T06:53:50.3773826Z Non-compilation calls 0 2025-03-14T06:53:50.3774177Z Unsupported compiler calls 0 2025-03-14T06:53:50.3774527Z Average cache write 0.000 s 2025-03-14T06:53:50.3774882Z Average cache read miss 0.000 s 2025-03-14T06:53:50.3775237Z Average cache read hit 0.000 s 2025-03-14T06:53:50.3775592Z Failed distributed compilations 0 2025-03-14T06:53:50.3776396Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2025-03-14T06:53:50.3777196Z + echo ::endgroup:: 2025-03-14T06:53:50.3777685Z ##[endgroup] 2025-03-14T06:53:50.3777930Z + ccache_epilogue 2025-03-14T06:53:50.3778288Z + ccache --show-stats 2025-03-14T06:53:50.3830901Z cache directory /home/jenkins/.cache/ccache 2025-03-14T06:53:50.3831970Z primary config /home/jenkins/.config/ccache/ccache.conf 2025-03-14T06:53:50.3832826Z secondary config (readonly) /etc/ccache.conf 2025-03-14T06:53:50.3833278Z stats updated Fri Mar 14 05:56:00 2025 2025-03-14T06:53:50.3833785Z stats zeroed Fri Mar 14 05:55:59 2025 2025-03-14T06:53:50.3834191Z cache hit (direct) 0 2025-03-14T06:53:50.3834547Z cache hit (preprocessed) 0 2025-03-14T06:53:50.3834896Z cache miss 0 2025-03-14T06:53:50.3835238Z cache hit rate 0.00 % 2025-03-14T06:53:50.3835591Z cleanups performed 0 2025-03-14T06:53:50.3835937Z files in cache 0 2025-03-14T06:53:50.3836282Z cache size 0.0 kB 2025-03-14T06:53:50.3836625Z max cache size 5.0 GB 2025-03-14T06:53:50.3836961Z + sccache_epilogue 2025-03-14T06:53:50.3837266Z + echo '::group::Sccache Compilation Log' 2025-03-14T06:53:50.3837872Z ##[group]Sccache Compilation Log 2025-03-14T06:53:50.3838257Z + echo '=================== sccache compilation log ===================' 2025-03-14T06:53:50.3838694Z =================== sccache compilation log =================== 2025-03-14T06:53:50.3839335Z + python /var/lib/jenkins/workspace/.ci/pytorch/print_sccache_log.py /home/jenkins/sccache_error.log 2025-03-14T06:53:50.3997504Z + echo '=========== If your build fails, please take a look at the log above for possible reasons ===========' 2025-03-14T06:53:50.3998255Z =========== If your build fails, please take a look at the log above for possible reasons =========== 2025-03-14T06:53:50.3998774Z + sccache --show-stats 2025-03-14T06:53:50.4191563Z Compile requests 0 2025-03-14T06:53:50.4191984Z Compile requests executed 0 2025-03-14T06:53:50.4192334Z Cache hits 0 2025-03-14T06:53:50.4192659Z Cache misses 0 2025-03-14T06:53:50.4192985Z Cache timeouts 0 2025-03-14T06:53:50.4193327Z Cache read errors 0 2025-03-14T06:53:50.4193658Z Forced recaches 0 2025-03-14T06:53:50.4193995Z Cache write errors 0 2025-03-14T06:53:50.4194335Z Compilation failures 0 2025-03-14T06:53:50.4194671Z Cache errors 0 2025-03-14T06:53:50.4195014Z Non-cacheable compilations 0 2025-03-14T06:53:50.4195347Z Non-cacheable calls 0 2025-03-14T06:53:50.4195687Z Non-compilation calls 0 2025-03-14T06:53:50.4196031Z Unsupported compiler calls 0 2025-03-14T06:53:50.4196386Z Average cache write 0.000 s 2025-03-14T06:53:50.4198201Z Average cache read miss 0.000 s 2025-03-14T06:53:50.4198667Z Average cache read hit 0.000 s 2025-03-14T06:53:50.4199033Z Failed distributed compilations 0 2025-03-14T06:53:50.4199847Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2025-03-14T06:53:50.4200647Z + sccache --stop-server 2025-03-14T06:53:50.4218026Z Stopping sccache server... 2025-03-14T06:53:50.4218423Z Compile requests 0 2025-03-14T06:53:50.4218821Z Compile requests executed 0 2025-03-14T06:53:50.4219167Z Cache hits 0 2025-03-14T06:53:50.4219493Z Cache misses 0 2025-03-14T06:53:50.4219821Z Cache timeouts 0 2025-03-14T06:53:50.4220150Z Cache read errors 0 2025-03-14T06:53:50.4220482Z Forced recaches 0 2025-03-14T06:53:50.4220818Z Cache write errors 0 2025-03-14T06:53:50.4221154Z Compilation failures 0 2025-03-14T06:53:50.4221492Z Cache errors 0 2025-03-14T06:53:50.4221830Z Non-cacheable compilations 0 2025-03-14T06:53:50.4222161Z Non-cacheable calls 0 2025-03-14T06:53:50.4222505Z Non-compilation calls 0 2025-03-14T06:53:50.4222976Z Unsupported compiler calls 0 2025-03-14T06:53:50.4223327Z Average cache write 0.000 s 2025-03-14T06:53:50.4223683Z Average cache read miss 0.000 s 2025-03-14T06:53:50.4224084Z Average cache read hit 0.000 s 2025-03-14T06:53:50.4224443Z Failed distributed compilations 0 2025-03-14T06:53:50.4225447Z Cache location S3, bucket: Bucket(name=ossci-compiler-cache-circleci-v2, base_url=http://ossci-compiler-cache-circleci-v2.s3.amazonaws.com/) 2025-03-14T06:53:50.4226542Z + echo ::endgroup:: 2025-03-14T06:53:50.4227290Z ##[endgroup] 2025-03-14T06:53:50.4227591Z + ccache_epilogue 2025-03-14T06:53:50.4227916Z + ccache --show-stats 2025-03-14T06:53:50.4272990Z cache directory /home/jenkins/.cache/ccache 2025-03-14T06:53:50.4273554Z primary config /home/jenkins/.config/ccache/ccache.conf 2025-03-14T06:53:50.4274031Z secondary config (readonly) /etc/ccache.conf 2025-03-14T06:53:50.4274476Z stats updated Fri Mar 14 05:56:00 2025 2025-03-14T06:53:50.4274916Z stats zeroed Fri Mar 14 05:55:59 2025 2025-03-14T06:53:50.4275309Z cache hit (direct) 0 2025-03-14T06:53:50.4275666Z cache hit (preprocessed) 0 2025-03-14T06:53:50.4276010Z cache miss 0 2025-03-14T06:53:50.4276349Z cache hit rate 0.00 % 2025-03-14T06:53:50.4276694Z cleanups performed 0 2025-03-14T06:53:50.4277035Z files in cache 0 2025-03-14T06:53:50.4277368Z cache size 0.0 kB 2025-03-14T06:53:50.4284468Z max cache size 5.0 GB 2025-03-14T06:53:50.4423077Z ##[group]Run pytorch/test-infra/.github/actions/upload-benchmark-results@main 2025-03-14T06:53:50.4423514Z with: 2025-03-14T06:53:50.4423755Z benchmark-results-dir: test/test-reports 2025-03-14T06:53:50.4424074Z dry-run: false 2025-03-14T06:53:50.4424324Z schema-version: v3 2025-03-14T06:53:50.4424763Z github-token: *** 2025-03-14T06:53:50.4425002Z env: 2025-03-14T06:53:50.4425225Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:50.4425677Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:50.4426161Z ##[endgroup] 2025-03-14T06:53:50.4456031Z ##[group]Run set -eux 2025-03-14T06:53:50.4456316Z set -eux 2025-03-14T06:53:50.4456612Z python3 -mpip install boto3==1.35.33 2025-03-14T06:53:50.4465609Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:50.4466371Z env: 2025-03-14T06:53:50.4466805Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:50.4467378Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:50.4467901Z ##[endgroup] 2025-03-14T06:53:50.4496069Z + python3 -mpip install boto3==1.35.33 2025-03-14T06:53:50.7413673Z Defaulting to user installation because normal site-packages is not writeable 2025-03-14T06:53:51.7186616Z Collecting boto3==1.35.33 2025-03-14T06:53:51.7223447Z Using cached boto3-1.35.33-py3-none-any.whl (139 kB) 2025-03-14T06:53:51.7284829Z Requirement already satisfied: botocore<1.36.0,>=1.35.33 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (1.35.99) 2025-03-14T06:53:51.7287614Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.4) 2025-03-14T06:53:51.7292945Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.33) (0.10.0) 2025-03-14T06:53:51.7347223Z Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /home/ec2-user/.local/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (2.8.2) 2025-03-14T06:53:51.7355627Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.25.10) 2025-03-14T06:53:51.7396569Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.15.0) 2025-03-14T06:53:51.8928390Z Installing collected packages: boto3 2025-03-14T06:53:51.8928969Z Attempting uninstall: boto3 2025-03-14T06:53:51.8929903Z Found existing installation: boto3 1.35.42 2025-03-14T06:53:51.9033311Z Uninstalling boto3-1.35.42: 2025-03-14T06:53:51.9063421Z Successfully uninstalled boto3-1.35.42 2025-03-14T06:53:51.9905047Z Successfully installed boto3-1.35.33 2025-03-14T06:53:52.0543572Z ##[group]Run set -eux 2025-03-14T06:53:52.0543863Z set -eux 2025-03-14T06:53:52.0544110Z  2025-03-14T06:53:52.0544392Z if [[ -z "${GITHUB_TOKEN}" ]]; then 2025-03-14T06:53:52.0544773Z  echo "Missing github-token input" 2025-03-14T06:53:52.0545112Z  exit 1 2025-03-14T06:53:52.0545350Z fi 2025-03-14T06:53:52.0551477Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:52.0551866Z env: 2025-03-14T06:53:52.0552079Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:52.0552530Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:52.0553285Z GITHUB_TOKEN: *** 2025-03-14T06:53:52.0553517Z ##[endgroup] 2025-03-14T06:53:52.0580153Z + [[ -z *** ]] 2025-03-14T06:53:52.0630491Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main 2025-03-14T06:53:52.0630941Z with: 2025-03-14T06:53:52.0631293Z github-token: *** 2025-03-14T06:53:52.0631538Z env: 2025-03-14T06:53:52.0631769Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:52.0632407Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:52.0632915Z ##[endgroup] 2025-03-14T06:53:52.0657288Z ##[group]Run set -eux 2025-03-14T06:53:52.0657568Z set -eux 2025-03-14T06:53:52.0657811Z  2025-03-14T06:53:52.0658303Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2025-03-14T06:53:52.0664020Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:52.0664409Z env: 2025-03-14T06:53:52.0664632Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:52.0665104Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:52.0666256Z GITHUB_TOKEN: *** 2025-03-14T06:53:52.0666499Z ##[endgroup] 2025-03-14T06:53:52.0689246Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 13849515290 i-011f73f0c8d1623b6 2025-03-14T06:53:54.5379889Z setting job-id=38757034389 2025-03-14T06:53:54.5380513Z setting job-name=linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T06:53:54.5503640Z ##[group]Run set -eux 2025-03-14T06:53:54.5503943Z set -eux 2025-03-14T06:53:54.5504310Z  2025-03-14T06:53:54.5504705Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \ 2025-03-14T06:53:54.5505234Z  --schema-version "${SCHEMA_VERSION}" \ 2025-03-14T06:53:54.5505597Z  --repo "${REPO}" \ 2025-03-14T06:53:54.5505923Z  --head-branch "${HEAD_BRANCH}" \ 2025-03-14T06:53:54.5506279Z  --head-sha "${HEAD_SHA}" \ 2025-03-14T06:53:54.5506615Z  --workflow-id "${WORKFLOW_RUN_ID}" \ 2025-03-14T06:53:54.5507002Z  --run-attempt "${RUN_ATTEMPT}" \ 2025-03-14T06:53:54.5507345Z  --job-id "${JOB_ID}" \ 2025-03-14T06:53:54.5507664Z  --job-name "${JOB_NAME}" 2025-03-14T06:53:54.5513065Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:54.5513466Z env: 2025-03-14T06:53:54.5513710Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:54.5514182Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:54.5514685Z SCHEMA_VERSION: v3 2025-03-14T06:53:54.5515069Z REPO: pytorch/pytorch 2025-03-14T06:53:54.5515356Z HEAD_BRANCH: refs/heads/main 2025-03-14T06:53:54.5515696Z HEAD_SHA: aed0b7a742a2d7b7901790622829cbd2135049a4 2025-03-14T06:53:54.5516060Z WORKFLOW_RUN_ID: 13849515290 2025-03-14T06:53:54.5516413Z RUN_ATTEMPT: 1 2025-03-14T06:53:54.5516662Z JOB_ID: 38757034389 2025-03-14T06:53:54.5517065Z JOB_NAME: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T06:53:54.5517524Z ##[endgroup] 2025-03-14T06:53:54.5544068Z + python3 /home/ec2-user/actions-runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/main --head-sha aed0b7a742a2d7b7901790622829cbd2135049a4 --workflow-id 13849515290 --run-attempt 1 --job-id 38757034389 --job-name 'linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge)' 2025-03-14T06:53:54.5873788Z ##[group]Run set -eux 2025-03-14T06:53:54.5874069Z set -eux 2025-03-14T06:53:54.5874322Z  2025-03-14T06:53:54.5874591Z # TODO (huydhn): Implement this part 2025-03-14T06:53:54.5874968Z echo "runners=[]" >> "${GITHUB_OUTPUT}" 2025-03-14T06:53:54.5879976Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:54.5880359Z env: 2025-03-14T06:53:54.5880591Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:54.5881051Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:54.5881540Z ##[endgroup] 2025-03-14T06:53:54.5905846Z + echo 'runners=[]' 2025-03-14T06:53:54.5935690Z ##[group]Run set -eux 2025-03-14T06:53:54.5935967Z set -eux 2025-03-14T06:53:54.5936209Z  2025-03-14T06:53:54.5936625Z # TODO (huydhn): Implement this part 2025-03-14T06:53:54.5937018Z echo "dependencies={}" >> "${GITHUB_OUTPUT}" 2025-03-14T06:53:54.5942220Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:54.5942620Z env: 2025-03-14T06:53:54.5942882Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:54.5943359Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:54.5943873Z ##[endgroup] 2025-03-14T06:53:54.5966099Z + echo 'dependencies={}' 2025-03-14T06:53:54.5993534Z ##[group]Run set -eux 2025-03-14T06:53:54.5993849Z set -eux 2025-03-14T06:53:54.5994091Z  2025-03-14T06:53:54.5994368Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then 2025-03-14T06:53:54.5994813Z  echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping" 2025-03-14T06:53:54.5995304Z  # We don't want the job to fail if the directory doesn't exist 2025-03-14T06:53:54.5995702Z  exit 0 2025-03-14T06:53:54.5995955Z fi 2025-03-14T06:53:54.5996185Z  2025-03-14T06:53:54.5996434Z if [[ "${DRY_RUN}" == "true" ]]; then 2025-03-14T06:53:54.5996914Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2025-03-14T06:53:54.5997471Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2025-03-14T06:53:54.5997901Z  --metadata "${BENCHMARK_METADATA}" \ 2025-03-14T06:53:54.5998257Z  --runners "${RUNNER_INFO}" \ 2025-03-14T06:53:54.5998598Z  --dependencies "${DEPENDENCIES}" \ 2025-03-14T06:53:54.5998930Z  --dry-run 2025-03-14T06:53:54.5999185Z else 2025-03-14T06:53:54.5999565Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2025-03-14T06:53:54.6000108Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2025-03-14T06:53:54.6000534Z  --metadata "${BENCHMARK_METADATA}" \ 2025-03-14T06:53:54.6000888Z  --runners "${RUNNER_INFO}" \ 2025-03-14T06:53:54.6001235Z  --dependencies "${DEPENDENCIES}" 2025-03-14T06:53:54.6001560Z fi 2025-03-14T06:53:54.6006758Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:54.6007265Z env: 2025-03-14T06:53:54.6007495Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:54.6007988Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:54.6008548Z BENCHMARK_RESULTS_DIR: test/test-reports 2025-03-14T06:53:54.6008956Z DRY_RUN: false 2025-03-14T06:53:54.6010268Z BENCHMARK_METADATA: {"timestamp": 1741935234, "schema_version": "v3", "name": "linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/main", "head_sha": "aed0b7a742a2d7b7901790622829cbd2135049a4", "workflow_id": 13849515290, "run_attempt": 1, "job_id": 38757034389} 2025-03-14T06:53:54.6011661Z RUNNER_INFO: [] 2025-03-14T06:53:54.6011916Z DEPENDENCIES: {} 2025-03-14T06:53:54.6012174Z ##[endgroup] 2025-03-14T06:53:54.6034157Z + [[ ! -d test/test-reports ]] 2025-03-14T06:53:54.6034570Z + echo 'test/test-reports does not exist, skipping' 2025-03-14T06:53:54.6035069Z + exit 0 2025-03-14T06:53:54.6035520Z test/test-reports does not exist, skipping 2025-03-14T06:53:54.6088767Z ##[group]Run cat test/**/*_toprint.log || true 2025-03-14T06:53:54.6089169Z cat test/**/*_toprint.log || true 2025-03-14T06:53:54.6094075Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:54.6094469Z env: 2025-03-14T06:53:54.6094696Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:54.6095169Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:54.6095675Z ##[endgroup] 2025-03-14T06:53:54.6164636Z cat: 'test/**/*_toprint.log': No such file or directory 2025-03-14T06:53:54.6203709Z ##[group]Run kill "$MONITOR_SCRIPT_PID" 2025-03-14T06:53:54.6204076Z kill "$MONITOR_SCRIPT_PID" 2025-03-14T06:53:54.6209151Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:54.6209560Z env: 2025-03-14T06:53:54.6209801Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:54.6210290Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:54.6210820Z MONITOR_SCRIPT_PID: 300250 2025-03-14T06:53:54.6211116Z ##[endgroup] 2025-03-14T06:53:54.6364780Z Prepare all required actions 2025-03-14T06:53:54.6365567Z Getting action download info 2025-03-14T06:53:54.7727552Z Download action repository 'actions/upload-artifact@v4' (SHA:4cec3d8aa04e39d1a68397de0c4cd6fb9dce8ec1) 2025-03-14T06:53:55.2349348Z ##[group]Run ./.github/actions/upload-test-artifacts 2025-03-14T06:53:55.2349732Z with: 2025-03-14T06:53:55.2350046Z file-suffix: test-xla-1-1-lf.linux.12xlarge_38757034389 2025-03-14T06:53:55.2350453Z s3-bucket: gha-artifacts 2025-03-14T06:53:55.2350735Z env: 2025-03-14T06:53:55.2350953Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:55.2351440Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:55.2351962Z ##[endgroup] 2025-03-14T06:53:55.2380774Z ##[group]Run # Remove any previous test jsons if they exist 2025-03-14T06:53:55.2381251Z # Remove any previous test jsons if they exist 2025-03-14T06:53:55.2381657Z rm -f test-jsons-*.zip 2025-03-14T06:53:55.2382144Z zip -r "test-jsons-${FILE_SUFFIX}.zip" test/test-reports -i '*.json' 2025-03-14T06:53:55.2387446Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:55.2387841Z env: 2025-03-14T06:53:55.2388104Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:55.2388579Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:55.2389271Z FILE_SUFFIX: test-xla-1-1-lf.linux.12xlarge_38757034389 2025-03-14T06:53:55.2389633Z ##[endgroup] 2025-03-14T06:53:55.2438848Z zip warning: name not matched: test/test-reports 2025-03-14T06:53:55.2439368Z zip warning: zip file empty 2025-03-14T06:53:55.2464939Z ##[group]Run # Remove any previous test reports if they exist 2025-03-14T06:53:55.2465587Z # Remove any previous test reports if they exist 2025-03-14T06:53:55.2466164Z rm -f test-reports-*.zip 2025-03-14T06:53:55.2466833Z zip -r "test-reports-${FILE_SUFFIX}.zip" test/test-reports -i '*.xml' -i '*.csv' 2025-03-14T06:53:55.2472138Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:55.2472540Z env: 2025-03-14T06:53:55.2486815Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:55.2487320Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:55.2487903Z FILE_SUFFIX: test-xla-1-1-lf.linux.12xlarge_38757034389 2025-03-14T06:53:55.2488274Z ##[endgroup] 2025-03-14T06:53:55.2527018Z zip warning: name not matched: test/test-reports 2025-03-14T06:53:55.2527445Z zip warning: zip file empty 2025-03-14T06:53:55.2551993Z ##[group]Run # Remove any previous usage logs if they exist 2025-03-14T06:53:55.2552448Z # Remove any previous usage logs if they exist 2025-03-14T06:53:55.2552811Z rm -f logs-*.zip 2025-03-14T06:53:55.2553267Z # this workflow is also run in bazel build test, but we dont generate usage reports for it 2025-03-14T06:53:55.2553816Z # so check to see if the file exists first 2025-03-14T06:53:55.2554183Z if [ -f 'usage_log.txt' ]; then 2025-03-14T06:53:55.2554552Z  zip "logs-${FILE_SUFFIX}.zip" 'usage_log.txt' 2025-03-14T06:53:55.2554894Z fi 2025-03-14T06:53:55.2555257Z if find "test/test-reports" -name "*.log" 2>/dev/null | grep -q .; then 2025-03-14T06:53:55.2555804Z  zip -r "logs-${FILE_SUFFIX}.zip" test/test-reports -i '*.log' 2025-03-14T06:53:55.2556189Z fi 2025-03-14T06:53:55.2560769Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:55.2561144Z env: 2025-03-14T06:53:55.2561358Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:55.2561807Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:55.2562369Z FILE_SUFFIX: test-xla-1-1-lf.linux.12xlarge_38757034389 2025-03-14T06:53:55.2562739Z ##[endgroup] 2025-03-14T06:53:55.2630841Z adding: usage_log.txt (deflated 94%) 2025-03-14T06:53:55.2675277Z ##[group]Run # Remove any previous debugging artifacts if they exist 2025-03-14T06:53:55.2675952Z # Remove any previous debugging artifacts if they exist 2025-03-14T06:53:55.2676391Z rm -f debug-*.zip 2025-03-14T06:53:55.2676698Z if [ -d 'test/debug' ]; then 2025-03-14T06:53:55.2677080Z  zip -r "debug-${FILE_SUFFIX}.zip" test/debug 2025-03-14T06:53:55.2677442Z fi 2025-03-14T06:53:55.2681991Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:55.2682362Z env: 2025-03-14T06:53:55.2682588Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:55.2683044Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:55.2683600Z FILE_SUFFIX: test-xla-1-1-lf.linux.12xlarge_38757034389 2025-03-14T06:53:55.2683957Z ##[endgroup] 2025-03-14T06:53:55.2759864Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-03-14T06:53:55.2760197Z with: 2025-03-14T06:53:55.2760430Z s3-bucket: gha-artifacts 2025-03-14T06:53:55.2760765Z s3-prefix: pytorch/pytorch/13849515290/1/artifact 2025-03-14T06:53:55.2761119Z retention-days: 14 2025-03-14T06:53:55.2761376Z if-no-files-found: warn 2025-03-14T06:53:55.2761658Z path: test-jsons-*.zip 2025-03-14T06:53:55.2761917Z name: artifact 2025-03-14T06:53:55.2762153Z region: us-east-1 2025-03-14T06:53:55.2762383Z env: 2025-03-14T06:53:55.2762602Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:55.2763062Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:55.2763556Z ##[endgroup] 2025-03-14T06:53:55.6286981Z NOTE: s3-prefix specified, ignoring name parameter 2025-03-14T06:53:55.6287497Z With the provided path, there will be 1 file uploaded 2025-03-14T06:53:55.6287982Z Uploading to s3 prefix: pytorch/pytorch/13849515290/1/artifact 2025-03-14T06:53:55.6326273Z Starting upload of test-jsons-test-xla-1-1-lf.linux.12xlarge_38757034389.zip 2025-03-14T06:53:55.7313387Z Finished upload of test-jsons-test-xla-1-1-lf.linux.12xlarge_38757034389.zip 2025-03-14T06:53:55.7507701Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-03-14T06:53:55.7508055Z with: 2025-03-14T06:53:55.7508394Z s3-bucket: gha-artifacts 2025-03-14T06:53:55.7508819Z s3-prefix: pytorch/pytorch/13849515290/1/artifact 2025-03-14T06:53:55.7509167Z retention-days: 14 2025-03-14T06:53:55.7509427Z if-no-files-found: error 2025-03-14T06:53:55.7509707Z path: test-reports-*.zip 2025-03-14T06:53:55.7509973Z name: artifact 2025-03-14T06:53:55.7510196Z region: us-east-1 2025-03-14T06:53:55.7510427Z env: 2025-03-14T06:53:55.7510645Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:55.7511096Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:55.7511585Z ##[endgroup] 2025-03-14T06:53:56.0646240Z NOTE: s3-prefix specified, ignoring name parameter 2025-03-14T06:53:56.0646758Z With the provided path, there will be 1 file uploaded 2025-03-14T06:53:56.0647239Z Uploading to s3 prefix: pytorch/pytorch/13849515290/1/artifact 2025-03-14T06:53:56.0685756Z Starting upload of test-reports-test-xla-1-1-lf.linux.12xlarge_38757034389.zip 2025-03-14T06:53:56.1806828Z Finished upload of test-reports-test-xla-1-1-lf.linux.12xlarge_38757034389.zip 2025-03-14T06:53:56.2005919Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-03-14T06:53:56.2006281Z with: 2025-03-14T06:53:56.2006524Z s3-bucket: gha-artifacts 2025-03-14T06:53:56.2006870Z s3-prefix: pytorch/pytorch/13849515290/1/artifact 2025-03-14T06:53:56.2007245Z retention-days: 14 2025-03-14T06:53:56.2007526Z if-no-files-found: ignore 2025-03-14T06:53:56.2007822Z path: logs-*.zip 2025-03-14T06:53:56.2008075Z name: artifact 2025-03-14T06:53:56.2008314Z region: us-east-1 2025-03-14T06:53:56.2008568Z env: 2025-03-14T06:53:56.2008803Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:56.2009288Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:56.2009806Z ##[endgroup] 2025-03-14T06:53:56.5135701Z NOTE: s3-prefix specified, ignoring name parameter 2025-03-14T06:53:56.5136531Z With the provided path, there will be 1 file uploaded 2025-03-14T06:53:56.5137029Z Uploading to s3 prefix: pytorch/pytorch/13849515290/1/artifact 2025-03-14T06:53:56.5174381Z Starting upload of logs-test-xla-1-1-lf.linux.12xlarge_38757034389.zip 2025-03-14T06:53:56.6680367Z Finished upload of logs-test-xla-1-1-lf.linux.12xlarge_38757034389.zip 2025-03-14T06:53:56.6885758Z ##[group]Run seemethere/upload-artifact-s3@v5 2025-03-14T06:53:56.6886127Z with: 2025-03-14T06:53:56.6886374Z s3-bucket: gha-artifacts 2025-03-14T06:53:56.6886725Z s3-prefix: pytorch/pytorch/13849515290/1/artifact 2025-03-14T06:53:56.6887103Z retention-days: 14 2025-03-14T06:53:56.6887383Z if-no-files-found: ignore 2025-03-14T06:53:56.6887683Z path: debug-*.zip 2025-03-14T06:53:56.6887937Z name: artifact 2025-03-14T06:53:56.6888175Z region: us-east-1 2025-03-14T06:53:56.6888426Z env: 2025-03-14T06:53:56.6888662Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:56.6889176Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:56.6889697Z ##[endgroup] 2025-03-14T06:53:56.9969130Z No files were found with the provided path: debug-*.zip. No artifacts will be uploaded. 2025-03-14T06:53:57.0182539Z ##[group]Run # shellcheck disable=SC2156 2025-03-14T06:53:57.0182936Z # shellcheck disable=SC2156 2025-03-14T06:53:57.0183532Z find . -iname "core.[1-9]*" -exec docker exec "${DOCKER_CONTAINER_ID}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2025-03-14T06:53:57.0189384Z shell: /usr/bin/bash -e {0} 2025-03-14T06:53:57.0189674Z env: 2025-03-14T06:53:57.0189894Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:57.0190369Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:57.0190875Z ##[endgroup] 2025-03-14T06:53:57.2535348Z Prepare all required actions 2025-03-14T06:53:57.2535775Z Getting action download info 2025-03-14T06:53:57.3461643Z ##[group]Run ./.github/actions/upload-utilization-stats 2025-03-14T06:53:57.3462013Z with: 2025-03-14T06:53:57.3462221Z job_id: 38757034389 2025-03-14T06:53:57.3462612Z job_name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T06:53:57.3463166Z workflow_name: pull 2025-03-14T06:53:57.3463429Z workflow_run_id: 13849515290 2025-03-14T06:53:57.3463707Z workflow_attempt: 1 2025-03-14T06:53:57.3463952Z env: 2025-03-14T06:53:57.3464173Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:57.3464622Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:57.3465101Z ##[endgroup] 2025-03-14T06:53:57.3485532Z ##[group]Run echo "workflow_id: 13849515290" 2025-03-14T06:53:57.3485921Z echo "workflow_id: 13849515290" 2025-03-14T06:53:57.3486281Z echo "workflow_attempt: 1" 2025-03-14T06:53:57.3486681Z echo "workflow_Name: pull" 2025-03-14T06:53:57.3487014Z echo "job_id: 38757034389" 2025-03-14T06:53:57.3487535Z echo "job_name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge)" 2025-03-14T06:53:57.3493165Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:57.3493580Z env: 2025-03-14T06:53:57.3493822Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:57.3494314Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:57.3494836Z ##[endgroup] 2025-03-14T06:53:57.3516883Z workflow_id: 13849515290 2025-03-14T06:53:57.3517218Z workflow_attempt: 1 2025-03-14T06:53:57.3517488Z workflow_Name: pull 2025-03-14T06:53:57.3517796Z job_id: 38757034389 2025-03-14T06:53:57.3518233Z job_name: linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge) 2025-03-14T06:53:57.3555525Z ##[group]Run nick-fields/retry@v3.0.0 2025-03-14T06:53:57.3555832Z with: 2025-03-14T06:53:57.3556163Z shell: bash 2025-03-14T06:53:57.3556373Z timeout_minutes: 5 2025-03-14T06:53:57.3556600Z max_attempts: 5 2025-03-14T06:53:57.3556849Z retry_wait_seconds: 30 2025-03-14T06:53:57.3557308Z command: set -eu python3 -m pip install python-dateutil==2.8.2 boto3==1.35.42 pandas==2.1.3 2025-03-14T06:53:57.3557813Z polling_interval_seconds: 1 2025-03-14T06:53:57.3558103Z warning_on_retry: true 2025-03-14T06:53:57.3558370Z continue_on_error: false 2025-03-14T06:53:57.3558631Z env: 2025-03-14T06:53:57.3558848Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:57.3559301Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:57.3559788Z ##[endgroup] 2025-03-14T06:53:57.6710412Z Defaulting to user installation because normal site-packages is not writeable 2025-03-14T06:53:57.6865890Z Requirement already satisfied: python-dateutil==2.8.2 in /home/ec2-user/.local/lib/python3.9/site-packages (2.8.2) 2025-03-14T06:53:58.6276836Z Collecting boto3==1.35.42 2025-03-14T06:53:58.6314906Z Using cached boto3-1.35.42-py3-none-any.whl (139 kB) 2025-03-14T06:53:58.6339858Z Requirement already satisfied: pandas==2.1.3 in /home/ec2-user/.local/lib/python3.9/site-packages (2.1.3) 2025-03-14T06:53:58.6356109Z Requirement already satisfied: six>=1.5 in /usr/lib/python3.9/site-packages (from python-dateutil==2.8.2) (1.15.0) 2025-03-14T06:53:58.6400721Z Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /usr/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.0) 2025-03-14T06:53:58.6402171Z Requirement already satisfied: botocore<1.36.0,>=1.35.42 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (1.35.99) 2025-03-14T06:53:58.6406398Z Requirement already satisfied: s3transfer<0.11.0,>=0.10.0 in /home/ec2-user/.local/lib/python3.9/site-packages (from boto3==1.35.42) (0.10.4) 2025-03-14T06:53:58.7234173Z Requirement already satisfied: numpy<2,>=1.22.4 in /home/ec2-user/.local/lib/python3.9/site-packages (from pandas==2.1.3) (1.26.4) 2025-03-14T06:53:58.7235894Z Requirement already satisfied: tzdata>=2022.1 in /home/ec2-user/.local/lib/python3.9/site-packages (from pandas==2.1.3) (2025.1) 2025-03-14T06:53:58.7241140Z Requirement already satisfied: pytz>=2020.1 in /usr/lib/python3.9/site-packages (from pandas==2.1.3) (2022.7.1) 2025-03-14T06:53:58.7302443Z Requirement already satisfied: urllib3<1.27,>=1.25.4 in /usr/lib/python3.9/site-packages (from botocore<1.36.0,>=1.35.42->boto3==1.35.42) (1.25.10) 2025-03-14T06:53:58.8090656Z Installing collected packages: boto3 2025-03-14T06:53:58.8091016Z Attempting uninstall: boto3 2025-03-14T06:53:58.8092241Z Found existing installation: boto3 1.35.33 2025-03-14T06:53:58.8187676Z Uninstalling boto3-1.35.33: 2025-03-14T06:53:58.8197366Z Successfully uninstalled boto3-1.35.33 2025-03-14T06:53:58.8729097Z Successfully installed boto3-1.35.42 2025-03-14T06:53:59.4320681Z Command completed after 1 attempt(s). 2025-03-14T06:53:59.4390793Z ##[group]Run python3 -m tools.stats.upload_utilization_stats.upload_utilization_stats \ 2025-03-14T06:53:59.4391527Z python3 -m tools.stats.upload_utilization_stats.upload_utilization_stats \ 2025-03-14T06:53:59.4392071Z  --workflow-run-id "13849515290" \ 2025-03-14T06:53:59.4392440Z  --workflow-name "pull" \ 2025-03-14T06:53:59.4392799Z  --workflow-run-attempt "1" \ 2025-03-14T06:53:59.4393160Z  --job-id "38757034389" \ 2025-03-14T06:53:59.4393657Z  --job-name "linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge)" 2025-03-14T06:53:59.4399891Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:53:59.4400301Z env: 2025-03-14T06:53:59.4400555Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:53:59.4401157Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:53:59.4401654Z ##[endgroup] 2025-03-14T06:54:01.7335998Z repo: pytorch/pytorch 2025-03-14T06:54:01.7336514Z Downloading logs-test-xla-1-1-lf.linux.12xlarge_38757034389.zip 2025-03-14T06:54:01.7337054Z Converted Log Model: UtilizationMetadata: 2025-03-14T06:54:01.7338440Z UtilizationMetadata(level='metadata', workflow_id='13849515290', job_id='38757034389', workflow_name='pull', job_name='linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge)', usage_collect_interval=1.0, data_model_version=1.0, start_at=1741930703, gpu_count=0, cpu_count=48, gpu_type='', error=None) 2025-03-14T06:54:01.7339912Z [Db Segments] detected pytest cmd: 99, generated segments: 99 2025-03-14T06:54:01.7340351Z [db model] Peek db timeseries 2025-03-14T06:54:01.7340652Z :{ 2025-03-14T06:54:01.7340986Z "created_at": 1741935241, 2025-03-14T06:54:01.7341266Z "type": "utilization", 2025-03-14T06:54:01.7341539Z "tags": [ 2025-03-14T06:54:01.7341766Z "record" 2025-03-14T06:54:01.7341998Z ], 2025-03-14T06:54:01.7342223Z "time_stamp": 1741930703, 2025-03-14T06:54:01.7342619Z "repo": "pytorch/pytorch", 2025-03-14T06:54:01.7342903Z "workflow_id": 13849515290, 2025-03-14T06:54:01.7343184Z "run_attempt": 1, 2025-03-14T06:54:01.7343432Z "job_id": 38757034389, 2025-03-14T06:54:01.7343697Z "workflow_name": "pull", 2025-03-14T06:54:01.7344125Z "job_name": "linux-focal-py3_9-clang9-xla / test (xla, 1, 1, lf.linux.12xlarge)", 2025-03-14T06:54:01.7344570Z "json_data": "{}" 2025-03-14T06:54:01.7344805Z } 2025-03-14T06:54:01.7345291Z Writing 1 documents to S3 ossci-utilization/util_metadata/v_1.0/pytorch/pytorch/13849515290/1/38757034389/metadata 2025-03-14T06:54:01.7346178Z Done! Finish writing document to S3 ossci-utilization/util_metadata/v_1.0/pytorch/pytorch/13849515290/1/38757034389/metadata 2025-03-14T06:54:01.7347093Z Writing 894 documents to S3 ossci-utilization/util_timeseries/v_1.0/pytorch/pytorch/13849515290/1/38757034389/time_series 2025-03-14T06:54:01.7348036Z Done! Finish writing document to S3 ossci-utilization/util_timeseries/v_1.0/pytorch/pytorch/13849515290/1/38757034389/time_series 2025-03-14T06:54:01.8273334Z ##[group]Run pytorch/test-infra/.github/actions/teardown-linux@main 2025-03-14T06:54:01.8273794Z with: 2025-03-14T06:54:01.8274022Z env: 2025-03-14T06:54:01.8274259Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:54:01.8274839Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:54:01.8275357Z ##[endgroup] 2025-03-14T06:54:01.8299332Z ##[group]Run set -eou pipefail 2025-03-14T06:54:01.8299742Z set -eou pipefail 2025-03-14T06:54:01.8300016Z  2025-03-14T06:54:01.8300380Z echo "Holding runner for 2 hours until all ssh sessions have logged out" 2025-03-14T06:54:01.8300833Z for _ in $(seq 1440); do 2025-03-14T06:54:01.8301164Z  # Break if no ssh session exists anymore 2025-03-14T06:54:01.8301510Z  if [ "$(who)" = "" ]; then 2025-03-14T06:54:01.8301806Z  break 2025-03-14T06:54:01.8302044Z  fi 2025-03-14T06:54:01.8302308Z  echo "." 2025-03-14T06:54:01.8302552Z  sleep 5 2025-03-14T06:54:01.8302788Z done 2025-03-14T06:54:01.8308006Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:54:01.8308388Z env: 2025-03-14T06:54:01.8308615Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:54:01.8309068Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:54:01.8309545Z ##[endgroup] 2025-03-14T06:54:01.8332418Z Holding runner for 2 hours until all ssh sessions have logged out 2025-03-14T06:54:01.8411436Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T06:54:01.8412025Z # ignore expansion of "docker ps -q" since it could be empty 2025-03-14T06:54:01.8412482Z # shellcheck disable=SC2046 2025-03-14T06:54:01.8412841Z docker stop $(docker ps -q) || true 2025-03-14T06:54:01.8413208Z # Prune all of the docker images 2025-03-14T06:54:01.8413559Z docker system prune -af 2025-03-14T06:54:01.8418806Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:54:01.8419181Z env: 2025-03-14T06:54:01.8419407Z GIT_DEFAULT_BRANCH: main 2025-03-14T06:54:01.8419858Z DOCKER_CONTAINER_ID: 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:54:01.8420346Z ##[endgroup] 2025-03-14T06:54:13.0684108Z 009676804ee5 2025-03-14T06:54:21.1787599Z Deleted Containers: 2025-03-14T06:54:21.1788084Z 009676804ee501445d0edb68b175ecc57f3356b4e94532abff300eab12074ec9 2025-03-14T06:54:21.1788430Z 2025-03-14T06:54:30.2673777Z Deleted Images: 2025-03-14T06:54:30.2674356Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base:v1.3-lite 2025-03-14T06:54:30.2675344Z untagged: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/xla_base@sha256:2e8aa6551e059f9b636de3582c14d5b861af3c8419e08937c6dde4d8446823c7 2025-03-14T06:54:30.2676328Z deleted: sha256:3f0a96285c3f041ba3fb0458700ecf22dcae07db7d2673d53620cfb6e910a801 2025-03-14T06:54:30.2677054Z deleted: sha256:eeb2b556747342a4484c8d828bba21f376b179a914fe6ba395fe95e39ddd6758 2025-03-14T06:54:30.2677749Z deleted: sha256:86a51fcaa555d5c6df573179cb28f159f8e38a25c22dff618e9e99fd5337ea8c 2025-03-14T06:54:30.2678444Z deleted: sha256:f26219be95a095d96e5b3d4fb102d93afea2df001119f2d910a1feaeb7d6bec9 2025-03-14T06:54:30.2679115Z deleted: sha256:6d8d781b60ce3882967f997c23ece72669a713e0303d21cd8f54031364cb890f 2025-03-14T06:54:30.2679780Z deleted: sha256:50c489d3e9e630d319dede77ba37d0d158d76a238d3914769ca04eeda27a5c09 2025-03-14T06:54:30.2680445Z deleted: sha256:367bc3a2abb6207f0b159f5db6af85d4ae2a5c55ce64513b04b9505841866502 2025-03-14T06:54:30.2681140Z deleted: sha256:9c9fb7581fc403a8cc3b59491d77b9f6f943b2efedf66eb0c84a7a50f02e5dc0 2025-03-14T06:54:30.2681823Z deleted: sha256:b5ed431793dbbb1ffd101e270b1fb1e60fa712927cc277a4cb5cdb1579bb875d 2025-03-14T06:54:30.2682511Z deleted: sha256:de8d5295abcb875aa5ee735f917add142a9260dfff15cec3f4af5145f03bfc68 2025-03-14T06:54:30.2683535Z deleted: sha256:b7596afccdb1e80340dfccab89daf0d62b6c763c00908d223f847392bd2e108e 2025-03-14T06:54:30.2684235Z deleted: sha256:382d0f73fc9ed06d66ef89da09793575a0eb6c5595c3984c62e681de04526a0d 2025-03-14T06:54:30.2684991Z deleted: sha256:80a7c7779a8aaa2b8742836cf96f7714fd567b3114da0a1d9003699d2e58dfb0 2025-03-14T06:54:30.2685746Z deleted: sha256:4feb9e6229281cd234e5877e7fc6a56eed611190b62d6d661e149b90a010e895 2025-03-14T06:54:30.2686415Z deleted: sha256:05ca95e3e0d57ab78dd4834c7248e2d610955139d540f61a18e0528c9b6f9db1 2025-03-14T06:54:30.2687150Z deleted: sha256:1fabaab5ec63e0ff2e66c189733474b264b5b7c5213c0a85169599fefc601775 2025-03-14T06:54:30.2687832Z deleted: sha256:fcc605db6f3f7dd93598a3d336a24d00c7c703074ccdfeb9667401b273f7ecef 2025-03-14T06:54:30.2688514Z deleted: sha256:0bd75df2e97764d48b64b7b4d58c878ece0c0eb906d229bc09fb9eca3df308c5 2025-03-14T06:54:30.2689190Z deleted: sha256:45d8097fc42ff126aa57e0094665e0b80d6d661194ad8f4b2afff2c896189794 2025-03-14T06:54:30.2689883Z deleted: sha256:a135df76dc3e5c396746ad5e10447221eccae7d0cad77de8c6d85626e2069b50 2025-03-14T06:54:30.2690558Z deleted: sha256:246a090a35f44b7e38400a2d04044c5d1dadff4c396c09a1de1c938d9bb00392 2025-03-14T06:54:30.2691238Z deleted: sha256:d3cd031a5f4e344d98ff72a9772fbaa7574323a7beaa010a5708eea2f4618e22 2025-03-14T06:54:30.2691917Z deleted: sha256:360d7a39f001a9f419052b315d33fb9ae76cdf74be5531ee63f0089fa8bb21f0 2025-03-14T06:54:30.2692594Z deleted: sha256:a6a1c5389bd5351f55b3669060c78bb3fc57ccf46ecea6f3f97cb8caecf7877b 2025-03-14T06:54:30.2693286Z deleted: sha256:571ab35fdb4fa6a05bbdec8486ed11457af5dbfdbd5e2bd0a9aae698fa28972e 2025-03-14T06:54:30.2693974Z deleted: sha256:96bb627abcba5a743a203122a2951c3a18d0e3a4b09fafa68676591d54c10321 2025-03-14T06:54:30.2694649Z deleted: sha256:da86a897aa6bbd81c77bbf6f221faae637c66b96863335fb4750909b0a0ad867 2025-03-14T06:54:30.2695327Z deleted: sha256:0fb62bc68ed7f4b06eb4114f9a357e5cfe767d1235137b02a4890f50f5664fab 2025-03-14T06:54:30.2695992Z deleted: sha256:02c55101ffcb82316d60d4cf97444a4f50b112aa7e430e644566bf67fd193263 2025-03-14T06:54:30.2696662Z deleted: sha256:b5dc43bc8889a3e132a0f0654126aba37f4434385add28cdc5422a6cb99ccfa9 2025-03-14T06:54:30.2697334Z deleted: sha256:5d5837a9f7fb3154fed7b2fcef0fc38400b4ef98a36c4b017bc5c8ad4a75e3a7 2025-03-14T06:54:30.2698010Z deleted: sha256:1367e9e125f78229e8234a11fa1dfee9239b36c66b53fea13cda8bdb27f4d6ba 2025-03-14T06:54:30.2698800Z deleted: sha256:001ee02ac1dacf9e609f85d02a9462b7ba37b7efdea2b9476a9b8b8aa49b3dba 2025-03-14T06:54:30.2699204Z 2025-03-14T06:54:30.2699341Z Total reclaimed space: 30.45GB 2025-03-14T06:54:30.2818091Z Post job cleanup. 2025-03-14T06:54:30.2870152Z Post job cleanup. 2025-03-14T06:54:30.3869363Z [command]/usr/bin/git version 2025-03-14T06:54:30.3925245Z git version 2.47.1 2025-03-14T06:54:30.3957708Z Copying '/home/ec2-user/.gitconfig' to '/home/ec2-user/actions-runner/_work/_temp/edce4156-12ad-4ba4-b3a2-ea84feae9fa1/.gitconfig' 2025-03-14T06:54:30.3967082Z Temporarily overriding HOME='/home/ec2-user/actions-runner/_work/_temp/edce4156-12ad-4ba4-b3a2-ea84feae9fa1' before making global git config changes 2025-03-14T06:54:30.3968081Z Adding repository directory to the temporary git global config as a safe directory 2025-03-14T06:54:30.3971928Z [command]/usr/bin/git config --global --add safe.directory /home/ec2-user/actions-runner/_work/pytorch/pytorch 2025-03-14T06:54:30.4008282Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-03-14T06:54:30.4042231Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-03-14T06:54:30.4341510Z Entering 'android/libs/fbjni' 2025-03-14T06:54:30.4391726Z Entering 'third_party/FP16' 2025-03-14T06:54:30.4441754Z Entering 'third_party/FXdiv' 2025-03-14T06:54:30.4491503Z Entering 'third_party/NNPACK' 2025-03-14T06:54:30.4541913Z Entering 'third_party/NVTX' 2025-03-14T06:54:30.4594160Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:54:30.4644002Z Entering 'third_party/XNNPACK' 2025-03-14T06:54:30.4712325Z Entering 'third_party/benchmark' 2025-03-14T06:54:30.4762408Z Entering 'third_party/composable_kernel' 2025-03-14T06:54:30.4822092Z Entering 'third_party/cpp-httplib' 2025-03-14T06:54:30.4871908Z Entering 'third_party/cpuinfo' 2025-03-14T06:54:30.4923456Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:54:30.4973640Z Entering 'third_party/cutlass' 2025-03-14T06:54:30.5031700Z Entering 'third_party/eigen' 2025-03-14T06:54:30.5085499Z Entering 'third_party/fbgemm' 2025-03-14T06:54:30.5134111Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:54:30.5182877Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:54:30.5231633Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:54:30.5287675Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:54:30.5341146Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:54:30.5392799Z Entering 'third_party/flash-attention' 2025-03-14T06:54:30.5444105Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:54:30.5498928Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:54:30.5563341Z Entering 'third_party/flatbuffers' 2025-03-14T06:54:30.5619610Z Entering 'third_party/fmt' 2025-03-14T06:54:30.5668550Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:54:30.5720801Z Entering 'third_party/gloo' 2025-03-14T06:54:30.5769247Z Entering 'third_party/googletest' 2025-03-14T06:54:30.5821342Z Entering 'third_party/ideep' 2025-03-14T06:54:30.5868993Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:54:30.5927789Z Entering 'third_party/ittapi' 2025-03-14T06:54:30.5981302Z Entering 'third_party/kineto' 2025-03-14T06:54:30.6031954Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:54:30.6081714Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:54:30.6132343Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:54:30.6185054Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:54:30.6236974Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:54:30.6286252Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:54:30.6338356Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:54:30.6389911Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:54:30.6440311Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:54:30.6491875Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:54:30.6544943Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:54:30.6595847Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:54:30.6646604Z Entering 'third_party/kleidiai' 2025-03-14T06:54:30.6701715Z Entering 'third_party/mimalloc' 2025-03-14T06:54:30.6753057Z Entering 'third_party/nlohmann' 2025-03-14T06:54:30.6805829Z Entering 'third_party/onnx' 2025-03-14T06:54:30.6870651Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:54:30.6925406Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:54:30.6979431Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:54:30.7029397Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:54:30.7080411Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:54:30.7128393Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:54:30.7182078Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:54:30.7231248Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:54:30.7286566Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:54:30.7340661Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:54:30.7393063Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:54:30.7446403Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:54:30.7522165Z Entering 'third_party/pocketfft' 2025-03-14T06:54:30.7574804Z Entering 'third_party/protobuf' 2025-03-14T06:54:30.7627103Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:54:30.7675763Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:54:30.7727001Z Entering 'third_party/psimd' 2025-03-14T06:54:30.7780459Z Entering 'third_party/pthreadpool' 2025-03-14T06:54:30.7837682Z Entering 'third_party/pybind11' 2025-03-14T06:54:30.7886541Z Entering 'third_party/python-peachpy' 2025-03-14T06:54:30.7935516Z Entering 'third_party/sleef' 2025-03-14T06:54:30.7987218Z Entering 'third_party/tensorpipe' 2025-03-14T06:54:30.8037998Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:54:30.8086954Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:54:30.8135511Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:54:30.8186568Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:54:30.8234871Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:54:30.8302043Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-03-14T06:54:30.8322839Z http.https://github.com/.extraheader 2025-03-14T06:54:30.8330058Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-03-14T06:54:30.8358148Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-03-14T06:54:30.8638610Z Entering 'android/libs/fbjni' 2025-03-14T06:54:30.8671293Z http.https://github.com/.extraheader 2025-03-14T06:54:30.8706965Z Entering 'third_party/FP16' 2025-03-14T06:54:30.8740396Z http.https://github.com/.extraheader 2025-03-14T06:54:30.8776551Z Entering 'third_party/FXdiv' 2025-03-14T06:54:30.8809686Z http.https://github.com/.extraheader 2025-03-14T06:54:30.8843933Z Entering 'third_party/NNPACK' 2025-03-14T06:54:30.8876846Z http.https://github.com/.extraheader 2025-03-14T06:54:30.8910390Z Entering 'third_party/NVTX' 2025-03-14T06:54:30.8944824Z http.https://github.com/.extraheader 2025-03-14T06:54:30.8976516Z Entering 'third_party/VulkanMemoryAllocator' 2025-03-14T06:54:30.9009696Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9042911Z Entering 'third_party/XNNPACK' 2025-03-14T06:54:30.9077279Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9126797Z Entering 'third_party/benchmark' 2025-03-14T06:54:30.9163036Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9201235Z Entering 'third_party/composable_kernel' 2025-03-14T06:54:30.9236777Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9275882Z Entering 'third_party/cpp-httplib' 2025-03-14T06:54:30.9312493Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9345137Z Entering 'third_party/cpuinfo' 2025-03-14T06:54:30.9380765Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9411836Z Entering 'third_party/cudnn_frontend' 2025-03-14T06:54:30.9446532Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9481199Z Entering 'third_party/cutlass' 2025-03-14T06:54:30.9513927Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9554156Z Entering 'third_party/eigen' 2025-03-14T06:54:30.9587974Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9624901Z Entering 'third_party/fbgemm' 2025-03-14T06:54:30.9659636Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9723028Z Entering 'third_party/fbgemm/third_party/asmjit' 2025-03-14T06:54:30.9756717Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9787699Z Entering 'third_party/fbgemm/third_party/cpuinfo' 2025-03-14T06:54:30.9821024Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9856020Z Entering 'third_party/fbgemm/third_party/cutlass' 2025-03-14T06:54:30.9889078Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9928487Z Entering 'third_party/fbgemm/third_party/googletest' 2025-03-14T06:54:30.9963484Z http.https://github.com/.extraheader 2025-03-14T06:54:30.9997674Z Entering 'third_party/fbgemm/third_party/hipify_torch' 2025-03-14T06:54:31.0030892Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0064958Z Entering 'third_party/flash-attention' 2025-03-14T06:54:31.0101217Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0133865Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-03-14T06:54:31.0167770Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0209589Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-03-14T06:54:31.0244780Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0287096Z Entering 'third_party/flatbuffers' 2025-03-14T06:54:31.0321463Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0360756Z Entering 'third_party/fmt' 2025-03-14T06:54:31.0396428Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0427696Z Entering 'third_party/gemmlowp/gemmlowp' 2025-03-14T06:54:31.0476489Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0508820Z Entering 'third_party/gloo' 2025-03-14T06:54:31.0543206Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0574995Z Entering 'third_party/googletest' 2025-03-14T06:54:31.0609473Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0642984Z Entering 'third_party/ideep' 2025-03-14T06:54:31.0679048Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0709278Z Entering 'third_party/ideep/mkl-dnn' 2025-03-14T06:54:31.0743445Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0791038Z Entering 'third_party/ittapi' 2025-03-14T06:54:31.0825669Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0860248Z Entering 'third_party/kineto' 2025-03-14T06:54:31.0893598Z http.https://github.com/.extraheader 2025-03-14T06:54:31.0928921Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-03-14T06:54:31.0963282Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1000735Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-03-14T06:54:31.1033884Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1066395Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-03-14T06:54:31.1099310Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1130270Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-03-14T06:54:31.1165946Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1202480Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-03-14T06:54:31.1236881Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1268083Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-03-14T06:54:31.1303012Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1342944Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-03-14T06:54:31.1374759Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1411296Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-03-14T06:54:31.1445402Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1483714Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-03-14T06:54:31.1515702Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1548388Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-03-14T06:54:31.1583918Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1621892Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-03-14T06:54:31.1656207Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1686605Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-03-14T06:54:31.1720493Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1754798Z Entering 'third_party/kleidiai' 2025-03-14T06:54:31.1789591Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1827781Z Entering 'third_party/mimalloc' 2025-03-14T06:54:31.1862579Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1893159Z Entering 'third_party/nlohmann' 2025-03-14T06:54:31.1926369Z http.https://github.com/.extraheader 2025-03-14T06:54:31.1959808Z Entering 'third_party/onnx' 2025-03-14T06:54:31.1994510Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2041924Z Entering 'third_party/onnx/third_party/pybind11' 2025-03-14T06:54:31.2074160Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2107965Z Entering 'third_party/opentelemetry-cpp' 2025-03-14T06:54:31.2142935Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2178542Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-03-14T06:54:31.2210092Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2246264Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-03-14T06:54:31.2280739Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2316619Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-03-14T06:54:31.2350100Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2382495Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-03-14T06:54:31.2414445Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2451004Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-03-14T06:54:31.2485393Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2517812Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-03-14T06:54:31.2550618Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2582751Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-03-14T06:54:31.2614128Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2646381Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-03-14T06:54:31.2680193Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2714489Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-03-14T06:54:31.2747498Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2782350Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-03-14T06:54:31.2815040Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2871187Z Entering 'third_party/pocketfft' 2025-03-14T06:54:31.2907197Z http.https://github.com/.extraheader 2025-03-14T06:54:31.2942539Z Entering 'third_party/protobuf' 2025-03-14T06:54:31.2977366Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3020912Z Entering 'third_party/protobuf/third_party/benchmark' 2025-03-14T06:54:31.3054301Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3085122Z Entering 'third_party/protobuf/third_party/googletest' 2025-03-14T06:54:31.3118602Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3154277Z Entering 'third_party/psimd' 2025-03-14T06:54:31.3188250Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3221605Z Entering 'third_party/pthreadpool' 2025-03-14T06:54:31.3256490Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3286530Z Entering 'third_party/pybind11' 2025-03-14T06:54:31.3320806Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3353823Z Entering 'third_party/python-peachpy' 2025-03-14T06:54:31.3388346Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3421374Z Entering 'third_party/sleef' 2025-03-14T06:54:31.3454096Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3485477Z Entering 'third_party/tensorpipe' 2025-03-14T06:54:31.3519682Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3550687Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-03-14T06:54:31.3585164Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3620285Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-03-14T06:54:31.3652256Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3684364Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-03-14T06:54:31.3717669Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3750047Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-03-14T06:54:31.3784344Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3823192Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-03-14T06:54:31.3855073Z http.https://github.com/.extraheader 2025-03-14T06:54:31.3978718Z A job completed hook has been configured by the self-hosted runner administrator 2025-03-14T06:54:31.4011165Z ##[group]Run '/home/ec2-user/runner-scripts/after_job.sh' 2025-03-14T06:54:31.4016294Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-03-14T06:54:31.4016680Z ##[endgroup] 2025-03-14T06:54:37.9503685Z Cleaning up orphan processes